2024-09-19T05:18:57.285 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T05:18:57.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:18:57.386 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911672' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI8tn7N/CisrSYcsE9GZpZbAJnfEuIUfdUYQsi6ik45XAXGSbmH5oSoAT34lz3jl3/yIC5xXrdT30x0GcgvoIUo= smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTdmhxZGF9R3FoMK79r+AhYECsEgg/tDECnXzCZmdKuom7tJe3c5xuQyf4b7wpyDzAS5N3TxlXMt2k+sehWphg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T05:18:57.386 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T05:18:57.387 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T05:18:57.387 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T05:18:57.389 INFO:teuthology.task.internal:Checking packages... 2024-09-19T05:18:57.410 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T05:18:57.410 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T05:18:57.410 INFO:teuthology.packaging:ref: None 2024-09-19T05:18:57.410 INFO:teuthology.packaging:tag: None 2024-09-19T05:18:57.410 INFO:teuthology.packaging:branch: squid 2024-09-19T05:18:57.410 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:18:57.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-19T05:18:57.645 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363-g6fad5dd7-1jammy 2024-09-19T05:18:57.646 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T05:18:57.653 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T05:18:57.653 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T05:18:57.662 INFO:teuthology.task.internal:Saving configuration 2024-09-19T05:18:57.678 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T05:18:57.684 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T05:18:57.709 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:13:21.530368', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKCRhGId1DpGvoXunQI5PpZDOfsF/oRp/yQdrl3IljHr'} 2024-09-19T05:18:57.732 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:13:21.528754', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBeAGa76Yt6JZCtHgcA6HFvJ73XTZONloK/NC1DUo87J'} 2024-09-19T05:18:57.733 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T05:18:57.739 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-19T05:18:57.739 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-19T05:18:57.739 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T05:18:57.794 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5e40a7f0a0>, signals=[15]) 2024-09-19T05:18:57.795 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T05:18:57.800 INFO:teuthology.task.internal:Opening connections... 2024-09-19T05:18:57.801 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:18:57.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:18:57.892 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:18:57.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:18:57.977 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T05:18:57.984 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-09-19T05:18:57.989 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-09-19T05:18:57.989 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Ubuntu" 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="22.04" 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_CODENAME=jammy 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:ID=ubuntu 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE=debian 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-19T05:18:58.035 INFO:teuthology.orchestra.run.smithi067.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-19T05:18:58.036 INFO:teuthology.orchestra.run.smithi067.stdout:UBUNTU_CODENAME=jammy 2024-09-19T05:18:58.036 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-09-19T05:18:58.068 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-09-19T05:18:58.074 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-09-19T05:18:58.074 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-09-19T05:18:58.121 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-19T05:18:58.121 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2024-09-19T05:18:58.121 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04" 2024-09-19T05:18:58.121 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-19T05:18:58.121 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy 2024-09-19T05:18:58.121 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2024-09-19T05:18:58.121 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2024-09-19T05:18:58.122 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-19T05:18:58.122 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-19T05:18:58.122 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-19T05:18:58.122 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-19T05:18:58.122 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy 2024-09-19T05:18:58.122 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-09-19T05:18:58.151 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T05:18:58.159 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T05:18:58.203 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T05:18:58.203 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:18:58.206 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:18:58.210 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T05:18:58.216 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T05:18:58.217 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:18:58.252 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:18:58.271 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T05:18:58.327 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T05:18:58.342 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T05:18:58.342 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T05:18:58.342 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:18:58.343 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:18:58.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:18:58.347 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-09-19T05:18:58.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:18:58.348 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-19T05:18:58.393 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-56-generic 2024-09-19T05:18:58.394 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.15.0-56-generic 2024-09-19T05:18:58.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-09-19T05:18:58.395 INFO:teuthology.orchestra.run.smithi067.stdout:5.15.0-56-generic 2024-09-19T05:18:58.395 INFO:teuthology.task.kernel:Running kernel on smithi067: 5.15.0-56-generic 2024-09-19T05:18:58.395 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get clean 2024-09-19T05:18:58.523 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-09-19T05:18:58.534 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2024-09-19T05:18:58.645 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T05:18:58.646 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-19T05:18:58.650 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-19T05:18:58.668 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-19T05:18:58.726 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-19T05:18:58.783 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T05:18:58.865 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-19T05:18:58.876 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-19T05:18:58.948 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-19T05:18:58.987 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-19T05:18:58.997 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-19T05:18:58.997 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-19T05:18:58.998 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-19T05:18:58.998 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-19T05:18:59.010 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-19T05:18:59.014 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-19T05:18:59.017 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-19T05:18:59.017 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-19T05:18:59.021 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-19T05:18:59.026 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-19T05:18:59.027 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-19T05:18:59.028 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-19T05:18:59.030 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-19T05:18:59.032 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-19T05:18:59.032 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-19T05:18:59.033 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-19T05:18:59.053 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-19T05:18:59.055 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-19T05:18:59.055 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-19T05:18:59.055 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-19T05:18:59.056 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-19T05:18:59.056 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-19T05:18:59.056 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-19T05:18:59.056 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-19T05:18:59.058 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-19T05:18:59.059 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-19T05:18:59.060 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-19T05:18:59.062 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-19T05:18:59.067 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-19T05:18:59.068 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-19T05:18:59.068 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-19T05:18:59.069 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-19T05:18:59.069 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-19T05:18:59.078 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-19T05:18:59.082 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-19T05:18:59.082 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-19T05:18:59.090 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-19T05:18:59.096 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-19T05:18:59.098 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-19T05:18:59.098 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-19T05:18:59.099 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-19T05:18:59.099 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-19T05:18:59.100 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-19T05:18:59.109 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-19T05:18:59.110 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-19T05:18:59.110 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-19T05:18:59.117 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-19T05:18:59.117 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-19T05:18:59.117 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-19T05:18:59.118 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-19T05:18:59.118 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-19T05:18:59.126 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-19T05:18:59.219 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-19T05:18:59.358 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-19T05:18:59.677 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-19T05:18:59.712 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-19T05:18:59.725 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-19T05:18:59.726 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-19T05:18:59.727 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-19T05:18:59.805 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-19T05:18:59.822 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-19T05:18:59.822 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-19T05:18:59.851 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-19T05:18:59.867 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-19T05:18:59.874 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-19T05:18:59.875 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-19T05:18:59.882 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-19T05:18:59.883 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-19T05:18:59.922 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-19T05:18:59.922 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-19T05:18:59.923 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-19T05:18:59.965 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-19T05:18:59.965 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-19T05:18:59.966 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-19T05:18:59.966 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-19T05:18:59.967 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-19T05:19:00.003 INFO:teuthology.orchestra.run.smithi067.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-19T05:19:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 16.2 MB in 2s (7,527 kB/s) 2024-09-19T05:19:06.223 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 16.2 MB in 2s (7,098 kB/s) 2024-09-19T05:19:06.686 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-19T05:19:06.704 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T05:19:06.757 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-19T05:19:06.944 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-19T05:19:06.945 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-19T05:19:07.109 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T05:19:07.109 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T05:19:07.109 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T05:19:07.110 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T05:19:07.110 INFO:teuthology.orchestra.run.smithi097.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-19T05:19:07.110 INFO:teuthology.orchestra.run.smithi097.stdout: python2.7-minimal 2024-09-19T05:19:07.110 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T05:19:07.111 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-09-19T05:19:07.111 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T05:19:07.111 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-19T05:19:07.111 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-19T05:19:07.113 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-09-19T05:19:07.113 INFO:teuthology.orchestra.run.smithi097.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-19T05:19:07.113 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-09-19T05:19:07.113 INFO:teuthology.orchestra.run.smithi097.stdout: thermald 2024-09-19T05:19:07.158 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-09-19T05:19:07.158 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T05:19:07.158 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-19T05:19:07.158 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-19T05:19:07.159 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-09-19T05:19:07.160 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-19T05:19:07.211 INFO:teuthology.orchestra.run.smithi097.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T05:19:07.211 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 113 MB of archives. 2024-09-19T05:19:07.211 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-19T05:19:07.211 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-19T05:19:07.631 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-19T05:19:07.728 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-19T05:19:07.754 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-09-19T05:19:07.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T05:19:07.880 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-09-19T05:19:08.097 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2024-09-19T05:19:08.097 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2024-09-19T05:19:08.297 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T05:19:08.297 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T05:19:08.297 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T05:19:08.297 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T05:19:08.298 INFO:teuthology.orchestra.run.smithi067.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-19T05:19:08.298 INFO:teuthology.orchestra.run.smithi067.stdout: python2.7-minimal 2024-09-19T05:19:08.298 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T05:19:08.299 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2024-09-19T05:19:08.299 INFO:teuthology.orchestra.run.smithi067.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T05:19:08.299 INFO:teuthology.orchestra.run.smithi067.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-19T05:19:08.300 INFO:teuthology.orchestra.run.smithi067.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2024-09-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi067.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi067.stdout:Recommended packages: 2024-09-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi067.stdout: thermald 2024-09-19T05:19:08.352 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2024-09-19T05:19:08.353 INFO:teuthology.orchestra.run.smithi067.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T05:19:08.353 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-19T05:19:08.353 INFO:teuthology.orchestra.run.smithi067.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-19T05:19:08.354 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages will be upgraded: 2024-09-19T05:19:08.355 INFO:teuthology.orchestra.run.smithi067.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-19T05:19:08.409 INFO:teuthology.orchestra.run.smithi067.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T05:19:08.409 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 113 MB of archives. 2024-09-19T05:19:08.409 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-19T05:19:08.409 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-19T05:19:08.588 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-19T05:19:08.588 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-19T05:19:08.588 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-19T05:19:08.719 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-19T05:19:08.740 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-19T05:19:08.874 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-19T05:19:08.979 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-19T05:19:09.202 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 113 MB in 2s (69.2 MB/s) 2024-09-19T05:19:09.364 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-19T05:19:09.789 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-19T05:19:09.789 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-19T05:19:09.789 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-19T05:19:09.914 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-19T05:19:09.936 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-19T05:19:10.354 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 113 MB in 2s (72.1 MB/s) 2024-09-19T05:19:10.530 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-19T05:19:11.400 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-19T05:19:11.404 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T05:19:11.579 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:12.519 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-19T05:19:12.523 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T05:19:12.735 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:13.789 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-19T05:19:13.810 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T05:19:13.901 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:14.367 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-19T05:19:14.388 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T05:19:14.426 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:14.886 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-19T05:19:14.908 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T05:19:14.996 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:15.490 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-19T05:19:15.511 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T05:19:15.548 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:21.235 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T05:19:21.346 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T05:19:21.687 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T05:19:21.816 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T05:19:22.119 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-19T05:19:22.141 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-19T05:19:22.185 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T05:19:22.491 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T05:19:22.610 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T05:19:22.935 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T05:19:23.063 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T05:19:23.385 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-19T05:19:23.405 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-19T05:19:23.449 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T05:19:27.693 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-19T05:19:27.731 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T05:19:27.768 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:29.718 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-19T05:19:29.752 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T05:19:29.788 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:31.047 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T05:19:31.163 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T05:19:31.464 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T05:19:31.593 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:31.719 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-19T05:19:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:32.577 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T05:19:32.701 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T05:19:33.035 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T05:19:33.149 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-19T05:19:33.149 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-19T05:19:33.149 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-19T05:19:33.149 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-19T05:19:33.181 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:33.300 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:33.307 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-19T05:19:33.419 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:34.811 INFO:teuthology.orchestra.run.smithi067.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-19T05:19:34.811 INFO:teuthology.orchestra.run.smithi067.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-19T05:19:34.811 INFO:teuthology.orchestra.run.smithi067.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-19T05:19:34.811 INFO:teuthology.orchestra.run.smithi067.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-19T05:19:35.070 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:35.160 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-19T05:19:35.286 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-19T05:19:35.412 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:36.530 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-19T05:19:36.656 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-19T05:19:36.780 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:36.798 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:36.848 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-19T05:19:36.848 INFO:teuthology.orchestra.run.smithi097.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-19T05:19:38.209 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T05:19:38.257 INFO:teuthology.orchestra.run.smithi067.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-19T05:19:38.258 INFO:teuthology.orchestra.run.smithi067.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-19T05:19:51.434 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-19T05:19:51.434 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub' 2024-09-19T05:19:51.443 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T05:19:51.463 INFO:teuthology.orchestra.run.smithi097.stdout:Generating grub configuration file ... 2024-09-19T05:19:51.738 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T05:19:51.761 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T05:19:52.094 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T05:19:52.099 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T05:19:52.170 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T05:19:52.176 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T05:19:52.352 INFO:teuthology.orchestra.run.smithi097.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T05:19:52.352 INFO:teuthology.orchestra.run.smithi097.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T05:19:52.352 INFO:teuthology.orchestra.run.smithi097.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T05:19:52.388 INFO:teuthology.orchestra.run.smithi097.stdout:done 2024-09-19T05:19:52.820 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-09-19T05:19:52.841 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-09-19T05:19:52.842 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-09-19T05:19:52.842 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-09-19T05:19:52.842 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-09-19T05:19:52.842 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-09-19T05:19:52.842 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T05:19:52.842 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-09-19T05:19:52.842 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-09-19T05:19:52.842 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.122.122 2024-09-19T05:19:52.842 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T05:19:52.842 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T05:19:52.843 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-09-19T05:19:52.843 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-09-19T05:19:52.843 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-09-19T05:19:52.843 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-09-19T05:19:52.843 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-19T05:19:52.843 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:19:52.843 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:19:52.843 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T05:19:52.843 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:19:52.844 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-09-19T05:19:52.913 INFO:teuthology.orchestra.run.smithi067.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-19T05:19:52.913 INFO:teuthology.orchestra.run.smithi067.stdout:Sourcing file `/etc/default/grub' 2024-09-19T05:19:52.945 INFO:teuthology.orchestra.run.smithi067.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T05:19:52.976 INFO:teuthology.orchestra.run.smithi067.stdout:Generating grub configuration file ... 2024-09-19T05:19:53.024 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-09-19T05:19:53.168 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T05:19:53.170 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T05:19:53.187 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T05:19:53.224 INFO:teuthology.orchestra.run.smithi067.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T05:19:53.244 INFO:teuthology.orchestra.run.smithi067.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T05:19:53.282 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T05:19:53.569 INFO:teuthology.orchestra.run.smithi067.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T05:19:53.574 INFO:teuthology.orchestra.run.smithi067.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T05:19:53.646 INFO:teuthology.orchestra.run.smithi067.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T05:19:53.651 INFO:teuthology.orchestra.run.smithi067.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T05:19:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T05:19:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T05:19:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T05:19:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:done 2024-09-19T05:19:54.367 DEBUG:teuthology.orchestra.run.smithi067:> dpkg -s linux-image-generic 2024-09-19T05:19:54.391 INFO:teuthology.orchestra.run.smithi067.stdout:Package: linux-image-generic 2024-09-19T05:19:54.391 INFO:teuthology.orchestra.run.smithi067.stdout:Status: install ok installed 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Priority: optional 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Section: kernel 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Installed-Size: 21 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: amd64 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Source: linux-meta 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Version: 5.15.0.122.122 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Recommends: thermald 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout:Description: Generic Linux kernel image 2024-09-19T05:19:54.392 INFO:teuthology.orchestra.run.smithi067.stdout: This package will always depend on the latest generic kernel image 2024-09-19T05:19:54.393 INFO:teuthology.orchestra.run.smithi067.stdout: available. 2024-09-19T05:19:54.393 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-19T05:19:54.393 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:19:54.393 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:19:54.393 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T05:19:54.393 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:19:54.393 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get clean 2024-09-19T05:19:54.608 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-19T05:19:54.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T05:19:54.673 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2024-09-19T05:19:54.680 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-19T05:19:54.792 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T05:19:54.867 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-19T05:19:54.867 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-19T05:19:54.913 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T05:19:54.994 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T05:19:55.037 INFO:teuthology.orchestra.run.smithi097.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-19T05:19:55.037 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T05:19:55.037 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T05:19:55.037 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T05:19:55.037 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T05:19:55.038 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T05:19:55.038 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T05:19:55.038 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T05:19:55.076 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T05:19:55.078 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T05:19:55.080 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-09-19T05:19:55.135 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.122.122 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T05:19:55.136 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-09-19T05:19:55.137 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-09-19T05:19:55.137 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-09-19T05:19:55.137 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-09-19T05:19:55.137 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-19T05:19:55.181 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.TnCYXnEnK4 2024-09-19T05:19:55.181 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub/grub.cfg /tmp/tmp.TnCYXnEnK4 2024-09-19T05:19:55.241 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.TnCYXnEnK4 2024-09-19T05:19:55.370 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.TnCYXnEnK4 is 10KB 2024-09-19T05:19:55.382 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.TnCYXnEnK4 2024-09-19T05:19:55.387 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-19T05:19:55.440 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:19:55.440 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-19T05:19:55.440 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-19T05:19:55.524 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-19T05:19:55.524 DEBUG:teuthology.orchestra.run.smithi097:> sudo update-grub 2024-09-19T05:19:56.298 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-09-19T05:19:56.317 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T05:19:56.379 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-09-19T05:19:56.601 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2024-09-19T05:19:56.602 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2024-09-19T05:19:56.777 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2024-09-19T05:19:56.778 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T05:19:56.780 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2024-09-19T05:19:56.801 INFO:teuthology.orchestra.run.smithi067.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-19T05:19:56.801 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T05:19:56.801 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T05:19:56.801 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T05:19:56.801 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T05:19:56.801 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T05:19:56.801 INFO:teuthology.orchestra.run.smithi067.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T05:19:56.801 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T05:19:56.848 INFO:teuthology.orchestra.run.smithi067.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T05:19:56.850 DEBUG:teuthology.orchestra.run.smithi067:> dpkg -s linux-image-generic 2024-09-19T05:19:56.866 INFO:teuthology.orchestra.run.smithi067.stdout:Package: linux-image-generic 2024-09-19T05:19:56.866 INFO:teuthology.orchestra.run.smithi067.stdout:Status: install ok installed 2024-09-19T05:19:56.866 INFO:teuthology.orchestra.run.smithi067.stdout:Priority: optional 2024-09-19T05:19:56.866 INFO:teuthology.orchestra.run.smithi067.stdout:Section: kernel 2024-09-19T05:19:56.866 INFO:teuthology.orchestra.run.smithi067.stdout:Installed-Size: 21 2024-09-19T05:19:56.866 INFO:teuthology.orchestra.run.smithi067.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T05:19:56.866 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: amd64 2024-09-19T05:19:56.866 INFO:teuthology.orchestra.run.smithi067.stdout:Source: linux-meta 2024-09-19T05:19:56.866 INFO:teuthology.orchestra.run.smithi067.stdout:Version: 5.15.0.122.122 2024-09-19T05:19:56.867 INFO:teuthology.orchestra.run.smithi067.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T05:19:56.867 INFO:teuthology.orchestra.run.smithi067.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T05:19:56.867 INFO:teuthology.orchestra.run.smithi067.stdout:Recommends: thermald 2024-09-19T05:19:56.867 INFO:teuthology.orchestra.run.smithi067.stdout:Description: Generic Linux kernel image 2024-09-19T05:19:56.867 INFO:teuthology.orchestra.run.smithi067.stdout: This package will always depend on the latest generic kernel image 2024-09-19T05:19:56.867 INFO:teuthology.orchestra.run.smithi067.stdout: available. 2024-09-19T05:19:56.867 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-09-19T05:19:56.914 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.f34w2NyoDD 2024-09-19T05:19:56.914 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub/grub.cfg /tmp/tmp.f34w2NyoDD 2024-09-19T05:19:56.955 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T05:19:56.961 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T05:19:56.977 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.f34w2NyoDD 2024-09-19T05:19:57.095 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.f34w2NyoDD is 10KB 2024-09-19T05:19:57.109 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.f34w2NyoDD 2024-09-19T05:19:57.114 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-19T05:19:57.170 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:19:57.170 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-19T05:19:57.170 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-19T05:19:57.218 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T05:19:57.223 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T05:19:57.238 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-19T05:19:57.238 DEBUG:teuthology.orchestra.run.smithi067:> sudo update-grub 2024-09-19T05:19:57.269 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T05:19:57.274 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T05:19:57.394 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T05:19:57.394 INFO:teuthology.orchestra.run.smithi097.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T05:19:57.394 INFO:teuthology.orchestra.run.smithi097.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T05:19:57.416 INFO:teuthology.orchestra.run.smithi097.stderr:done 2024-09-19T05:19:57.425 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2024-09-19T05:19:58.525 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub' 2024-09-19T05:19:58.526 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T05:19:58.538 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2024-09-19T05:19:58.711 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T05:19:58.717 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T05:19:58.939 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T05:19:58.944 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T05:19:58.986 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T05:19:58.991 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T05:19:59.119 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T05:19:59.119 INFO:teuthology.orchestra.run.smithi067.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T05:19:59.119 INFO:teuthology.orchestra.run.smithi067.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T05:19:59.129 INFO:teuthology.orchestra.run.smithi067.stderr:done 2024-09-19T05:19:59.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2024-09-19T05:20:27.453 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T05:20:27.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-19T05:20:27.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:20:29.149 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T05:20:29.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-19T05:20:29.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:20:47.677 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-09-19T05:20:56.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-19T05:20:56.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:20:59.745 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-09-19T05:21:11.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-19T05:21:11.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:21:27.472 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T05:21:30.177 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-09-19T05:21:36.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-19T05:21:36.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:21:36.723 ERROR:teuthology.orchestra.connection:Error authenticating with smithi097.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-09-19T05:21:40.807 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-19T05:21:41.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-19T05:21:41.665 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-19T05:21:41.665 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-19T05:21:41.714 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-122-generic 2024-09-19T05:21:41.714 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-19T05:21:41.714 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:21:41.714 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-19T05:21:42.716 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T05:21:42.716 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:21:42.808 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2024-09-19T05:21:42.827 DEBUG:teuthology.parallel:result is None 2024-09-19T05:21:45.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-19T05:21:45.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:21:45.627 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-09-19T05:21:46.442 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-19T05:21:46.443 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-19T05:21:46.443 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-09-19T05:21:46.487 INFO:teuthology.orchestra.run.smithi067.stdout:5.15.0-122-generic 2024-09-19T05:21:46.487 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-19T05:21:46.487 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:21:46.487 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-19T05:21:47.488 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T05:21:47.488 DEBUG:teuthology.orchestra.run.smithi067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:21:47.629 INFO:teuthology.orchestra.run.smithi067.stdout:ttyS1 2024-09-19T05:21:47.665 DEBUG:teuthology.parallel:result is None 2024-09-19T05:21:47.665 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T05:21:47.675 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T05:21:47.675 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:21:47.677 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:21:47.683 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T05:21:47.694 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T05:21:47.708 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T05:21:47.709 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:21:47.725 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:21:47.791 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T05:21:47.801 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T05:21:47.802 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:21:47.804 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:21:47.829 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:21:47.834 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:21:47.838 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:21:47.841 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:21:47.843 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T05:21:47.854 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T05:21:47.854 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:21:47.888 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:21:47.918 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T05:21:47.930 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T05:21:47.930 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:21:47.945 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:21:47.966 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:21:47.995 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:21:48.048 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:21:48.048 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:21:48.113 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:21:48.119 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:21:48.165 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:21:48.166 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:21:48.230 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-09-19T05:21:48.232 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-09-19T05:21:48.341 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T05:21:48.353 INFO:teuthology.task.internal:Starting timer... 2024-09-19T05:21:48.353 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T05:21:48.371 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T05:21:48.381 DEBUG:teuthology.task.selinux:Excluding smithi067: OS 'ubuntu' does not support SELinux 2024-09-19T05:21:48.381 DEBUG:teuthology.task.selinux:Excluding smithi097: OS 'ubuntu' does not support SELinux 2024-09-19T05:21:48.382 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T05:21:48.382 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-19T05:21:48.382 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T05:21:48.382 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T05:21:48.396 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T05:21:48.399 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T05:21:48.512 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T05:21:48.523 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T05:21:48.524 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi097.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T05:29:24.802 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi097.front.sepia.ceph.com')] 2024-09-19T05:29:24.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-19T05:29:24.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:29:24.924 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-09-19T05:29:25.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-19T05:29:25.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-19T05:29:25.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:29:25.090 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-19T05:29:25.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-19T05:29:25.165 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T05:29:25.180 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T05:29:25.180 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:29:25.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:29:25.184 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:29:25.185 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:29:25.212 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-19T05:29:25.212 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: Command line: ntpd -gq 2024-09-19T05:29:25.212 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: ---------------------------------------------------- 2024-09-19T05:29:25.212 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: ntp-4 is maintained by Network Time Foundation, 2024-09-19T05:29:25.212 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-19T05:29:25.212 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: corporation. Support and training for ntp-4 are 2024-09-19T05:29:25.213 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: available at https://www.nwtime.org/support 2024-09-19T05:29:25.213 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: ---------------------------------------------------- 2024-09-19T05:29:25.213 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: proto: precision = 0.068 usec (-24) 2024-09-19T05:29:25.213 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: basedate set to 2022-02-04 2024-09-19T05:29:25.213 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: gps base set to 2022-02-06 (week 2196) 2024-09-19T05:29:25.213 INFO:teuthology.orchestra.run.smithi067.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T05:29:25.214 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T05:29:25.214 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: restrict ::: KOD does nothing without LIMITED. 2024-09-19T05:29:25.214 INFO:teuthology.orchestra.run.smithi067.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-19T05:29:25.215 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: Listen and drop on 0 v6wildcard [::]:123 2024-09-19T05:29:25.215 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-19T05:29:25.215 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: Listen normally on 2 lo 127.0.0.1:123 2024-09-19T05:29:25.215 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: Listen normally on 3 enp3s0f1 172.21.15.67:123 2024-09-19T05:29:25.215 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: Listen normally on 4 lo [::1]:123 2024-09-19T05:29:25.215 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:fc0b%5]:123 2024-09-19T05:29:25.215 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:25 ntpd[18493]: Listening on routing socket on fd #22 for interface updates 2024-09-19T05:29:25.233 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-19T05:29:25.233 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: Command line: ntpd -gq 2024-09-19T05:29:25.233 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: ---------------------------------------------------- 2024-09-19T05:29:25.233 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: ntp-4 is maintained by Network Time Foundation, 2024-09-19T05:29:25.233 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-19T05:29:25.233 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: corporation. Support and training for ntp-4 are 2024-09-19T05:29:25.234 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: available at https://www.nwtime.org/support 2024-09-19T05:29:25.234 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: ---------------------------------------------------- 2024-09-19T05:29:25.234 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: proto: precision = 0.043 usec (-24) 2024-09-19T05:29:25.234 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: basedate set to 2022-02-04 2024-09-19T05:29:25.234 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: gps base set to 2022-02-06 (week 2196) 2024-09-19T05:29:25.235 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T05:29:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T05:29:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-19T05:29:25.236 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: restrict ::: KOD does nothing without LIMITED. 2024-09-19T05:29:25.236 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: Listen and drop on 0 v6wildcard [::]:123 2024-09-19T05:29:25.236 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-19T05:29:25.236 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: Listen normally on 2 lo 127.0.0.1:123 2024-09-19T05:29:25.236 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: Listen normally on 3 enp3s0f1 172.21.15.97:123 2024-09-19T05:29:25.236 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: Listen normally on 4 lo [::1]:123 2024-09-19T05:29:25.236 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d805%5]:123 2024-09-19T05:29:25.236 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:25 ntpd[18449]: Listening on routing socket on fd #22 for interface updates 2024-09-19T05:29:26.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:26.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:26 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:26.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:26.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:26.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:26.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:26.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:26 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:27.233 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:27 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:27.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:27 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:28.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:28.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:28.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:28.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:28.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:28.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:28.215 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:28.215 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:28.215 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:28.215 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:28.215 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:28.215 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:28 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:28.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:28.236 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:28 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:29 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:29 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:29 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:29 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:29 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:29 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:29 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:29 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:29.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:29 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:29.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:29 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:29.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:29 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:29.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:29 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:29.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:29 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:29.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:29 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:30.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:30.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:30.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:30.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:30.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:30.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:30.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:30.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:30.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:30.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:30.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:30.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:30 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:30.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:30.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:30.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:30.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:30.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:30.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:30.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:30.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:30.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:30.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:30.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:30.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:30 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:31 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:31 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:31 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:31 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:31 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:31 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:31 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:31 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:31 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:31 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:31 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:31 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:32.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:32 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:32.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:32 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:32.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:32 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:32.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:32 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:32.213 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:32 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:32.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:32 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:32.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:32 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:32.214 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:32 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:32.214 INFO:teuthology.orchestra.run.smithi067.stdout:19 Sep 05:29:32 ntpd[18493]: ntpd: time slew -0.000632 s 2024-09-19T05:29:32.214 INFO:teuthology.orchestra.run.smithi067.stdout:ntpd: time slew -0.000632s 2024-09-19T05:29:32.215 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:32 ntpd[18493]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-19T05:29:32.215 INFO:teuthology.orchestra.run.smithi067.stderr:19 Sep 05:29:32 ntpd[18493]: can't open /var/log/ntpstats/loopstats.20240919: Permission denied 2024-09-19T05:29:32.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:32.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:32 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:32.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:32.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:32 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:32.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T05:29:32.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:32 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T05:29:32.234 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T05:29:32.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:32 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T05:29:32.235 INFO:teuthology.orchestra.run.smithi097.stdout:19 Sep 05:29:32 ntpd[18449]: ntpd: time slew -0.000793 s 2024-09-19T05:29:32.235 INFO:teuthology.orchestra.run.smithi097.stdout:ntpd: time slew -0.000793s 2024-09-19T05:29:32.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-19T05:29:32.235 INFO:teuthology.orchestra.run.smithi097.stderr:19 Sep 05:29:32 ntpd[18449]: can't open /var/log/ntpstats/loopstats.20240919: Permission denied 2024-09-19T05:29:32.266 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T05:29:32.266 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2024-09-19T05:29:32.266 INFO:teuthology.orchestra.run.smithi067.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T05:29:32.266 INFO:teuthology.orchestra.run.smithi067.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T05:29:32.266 INFO:teuthology.orchestra.run.smithi067.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T05:29:32.266 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T05:29:32.294 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T05:29:32.295 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-09-19T05:29:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T05:29:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T05:29:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T05:29:32.295 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T05:29:32.296 INFO:teuthology.run_tasks:Running task install... 2024-09-19T05:29:32.308 DEBUG:teuthology.task.install:project ceph 2024-09-19T05:29:32.308 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T05:29:32.309 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T05:29:32.309 INFO:teuthology.task.install:Using flavor: default 2024-09-19T05:29:32.317 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T05:29:32.317 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T05:29:32.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-key list | grep Ceph 2024-09-19T05:29:32.318 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-key list | grep Ceph 2024-09-19T05:29:32.374 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-19T05:29:32.394 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-19T05:29:32.403 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-19T05:29:32.403 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph.com (release key) 2024-09-19T05:29:32.404 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-19T05:29:32.405 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-19T05:29:32.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:29:32.421 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-19T05:29:32.421 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph.com (release key) 2024-09-19T05:29:32.422 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-19T05:29:32.422 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-19T05:29:32.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:29:32.554 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default/ 2024-09-19T05:29:32.554 INFO:teuthology.task.install.deb:Package version is 19.1.1-361-g2f599a46-1jammy 2024-09-19T05:29:32.561 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default/ 2024-09-19T05:29:32.561 INFO:teuthology.task.install.deb:Package version is 19.1.1-361-g2f599a46-1jammy 2024-09-19T05:29:32.684 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:29:32.684 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-19T05:29:32.698 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2024-09-19T05:29:32.719 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:29:32.719 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-19T05:29:32.733 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-09-19T05:29:32.890 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T05:29:32.902 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T05:29:32.923 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy InRelease 2024-09-19T05:29:32.944 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-19T05:29:32.957 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy InRelease 2024-09-19T05:29:32.966 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-19T05:29:32.978 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-19T05:29:32.987 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-19T05:29:32.993 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T05:29:33.000 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-19T05:29:33.014 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-09-19T05:29:33.021 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-19T05:29:33.027 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T05:29:33.048 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-09-19T05:29:33.074 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T05:29:33.107 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T05:29:33.153 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T05:29:33.187 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T05:29:33.295 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 29.0 kB in 0s (70.6 kB/s) 2024-09-19T05:29:33.325 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 29.0 kB in 0s (70.5 kB/s) 2024-09-19T05:29:34.331 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-19T05:29:34.337 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-09-19T05:29:34.347 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-361-g2f599a46-1jammy cephadm=19.1.1-361-g2f599a46-1jammy ceph-mds=19.1.1-361-g2f599a46-1jammy ceph-mgr=19.1.1-361-g2f599a46-1jammy ceph-common=19.1.1-361-g2f599a46-1jammy ceph-fuse=19.1.1-361-g2f599a46-1jammy ceph-test=19.1.1-361-g2f599a46-1jammy ceph-volume=19.1.1-361-g2f599a46-1jammy radosgw=19.1.1-361-g2f599a46-1jammy python3-rados=19.1.1-361-g2f599a46-1jammy python3-rgw=19.1.1-361-g2f599a46-1jammy python3-cephfs=19.1.1-361-g2f599a46-1jammy python3-rbd=19.1.1-361-g2f599a46-1jammy libcephfs2=19.1.1-361-g2f599a46-1jammy libcephfs-dev=19.1.1-361-g2f599a46-1jammy librados2=19.1.1-361-g2f599a46-1jammy librbd1=19.1.1-361-g2f599a46-1jammy rbd-fuse=19.1.1-361-g2f599a46-1jammy python3-cephfs=19.1.1-361-g2f599a46-1jammy cephfs-shell=19.1.1-361-g2f599a46-1jammy cephfs-top=19.1.1-361-g2f599a46-1jammy cephfs-mirror=19.1.1-361-g2f599a46-1jammy 2024-09-19T05:29:34.354 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-361-g2f599a46-1jammy cephadm=19.1.1-361-g2f599a46-1jammy ceph-mds=19.1.1-361-g2f599a46-1jammy ceph-mgr=19.1.1-361-g2f599a46-1jammy ceph-common=19.1.1-361-g2f599a46-1jammy ceph-fuse=19.1.1-361-g2f599a46-1jammy ceph-test=19.1.1-361-g2f599a46-1jammy ceph-volume=19.1.1-361-g2f599a46-1jammy radosgw=19.1.1-361-g2f599a46-1jammy python3-rados=19.1.1-361-g2f599a46-1jammy python3-rgw=19.1.1-361-g2f599a46-1jammy python3-cephfs=19.1.1-361-g2f599a46-1jammy python3-rbd=19.1.1-361-g2f599a46-1jammy libcephfs2=19.1.1-361-g2f599a46-1jammy libcephfs-dev=19.1.1-361-g2f599a46-1jammy librados2=19.1.1-361-g2f599a46-1jammy librbd1=19.1.1-361-g2f599a46-1jammy rbd-fuse=19.1.1-361-g2f599a46-1jammy python3-cephfs=19.1.1-361-g2f599a46-1jammy cephfs-shell=19.1.1-361-g2f599a46-1jammy cephfs-top=19.1.1-361-g2f599a46-1jammy cephfs-mirror=19.1.1-361-g2f599a46-1jammy 2024-09-19T05:29:34.400 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-19T05:29:34.419 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-09-19T05:29:34.585 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-19T05:29:34.586 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-19T05:29:34.634 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2024-09-19T05:29:34.635 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2024-09-19T05:29:34.772 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T05:29:34.772 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T05:29:34.772 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T05:29:34.772 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T05:29:34.773 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T05:29:34.773 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T05:29:34.773 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T05:29:34.773 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-09-19T05:29:34.773 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-19T05:29:34.774 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-19T05:29:34.774 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-19T05:29:34.774 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-19T05:29:34.775 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-19T05:29:34.776 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-19T05:29:34.776 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-19T05:29:34.776 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-19T05:29:34.776 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-19T05:29:34.776 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-19T05:29:34.776 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-19T05:29:34.776 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-19T05:29:34.776 INFO:teuthology.orchestra.run.smithi097.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-19T05:29:34.777 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-09-19T05:29:34.777 INFO:teuthology.orchestra.run.smithi097.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-19T05:29:34.777 INFO:teuthology.orchestra.run.smithi097.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-19T05:29:34.777 INFO:teuthology.orchestra.run.smithi097.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-19T05:29:34.777 INFO:teuthology.orchestra.run.smithi097.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-19T05:29:34.777 INFO:teuthology.orchestra.run.smithi097.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-19T05:29:34.777 INFO:teuthology.orchestra.run.smithi097.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-19T05:29:34.777 INFO:teuthology.orchestra.run.smithi097.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-19T05:29:34.777 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-09-19T05:29:34.777 INFO:teuthology.orchestra.run.smithi097.stdout: btrfs-tools 2024-09-19T05:29:34.854 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T05:29:34.854 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T05:29:34.854 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T05:29:34.855 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T05:29:34.855 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T05:29:34.855 INFO:teuthology.orchestra.run.smithi067.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T05:29:34.855 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T05:29:34.856 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2024-09-19T05:29:34.856 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-19T05:29:34.856 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-19T05:29:34.856 INFO:teuthology.orchestra.run.smithi067.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-19T05:29:34.856 INFO:teuthology.orchestra.run.smithi067.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-19T05:29:34.857 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-19T05:29:34.857 INFO:teuthology.orchestra.run.smithi067.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-19T05:29:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-19T05:29:34.859 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-19T05:29:34.859 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-19T05:29:34.859 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-19T05:29:34.859 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-19T05:29:34.859 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-19T05:29:34.859 INFO:teuthology.orchestra.run.smithi067.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-19T05:29:34.860 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2024-09-19T05:29:34.860 INFO:teuthology.orchestra.run.smithi067.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-19T05:29:34.860 INFO:teuthology.orchestra.run.smithi067.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-19T05:29:34.860 INFO:teuthology.orchestra.run.smithi067.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-19T05:29:34.860 INFO:teuthology.orchestra.run.smithi067.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-19T05:29:34.860 INFO:teuthology.orchestra.run.smithi067.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-19T05:29:34.860 INFO:teuthology.orchestra.run.smithi067.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-19T05:29:34.860 INFO:teuthology.orchestra.run.smithi067.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-19T05:29:34.860 INFO:teuthology.orchestra.run.smithi067.stdout:Recommended packages: 2024-09-19T05:29:34.861 INFO:teuthology.orchestra.run.smithi067.stdout: btrfs-tools 2024-09-19T05:29:34.884 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-09-19T05:29:34.884 INFO:teuthology.orchestra.run.smithi097.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-19T05:29:34.884 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-19T05:29:34.884 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-19T05:29:34.885 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-19T05:29:34.886 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-19T05:29:34.886 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-19T05:29:34.886 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-19T05:29:34.886 INFO:teuthology.orchestra.run.smithi097.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-19T05:29:34.886 INFO:teuthology.orchestra.run.smithi097.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-19T05:29:34.887 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-19T05:29:34.888 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-19T05:29:34.888 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-19T05:29:34.888 INFO:teuthology.orchestra.run.smithi097.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-19T05:29:34.888 INFO:teuthology.orchestra.run.smithi097.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-19T05:29:34.888 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-19T05:29:34.888 INFO:teuthology.orchestra.run.smithi097.stdout: socat unzip xmlstarlet zip 2024-09-19T05:29:34.973 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2024-09-19T05:29:34.974 INFO:teuthology.orchestra.run.smithi067.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-19T05:29:34.974 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-19T05:29:34.974 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-19T05:29:34.974 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-19T05:29:34.974 INFO:teuthology.orchestra.run.smithi067.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-19T05:29:34.974 INFO:teuthology.orchestra.run.smithi067.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-19T05:29:34.974 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-19T05:29:34.975 INFO:teuthology.orchestra.run.smithi067.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-19T05:29:34.975 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-19T05:29:34.975 INFO:teuthology.orchestra.run.smithi067.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-19T05:29:34.975 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-19T05:29:34.976 INFO:teuthology.orchestra.run.smithi067.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-19T05:29:34.977 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-19T05:29:34.977 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-19T05:29:34.977 INFO:teuthology.orchestra.run.smithi067.stdout: socat unzip xmlstarlet zip 2024-09-19T05:29:35.026 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T05:29:35.027 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 181 MB of archives. 2024-09-19T05:29:35.027 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-19T05:29:35.027 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-361-g2f599a46-1jammy [3,590 kB] 2024-09-19T05:29:35.074 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-19T05:29:35.119 INFO:teuthology.orchestra.run.smithi067.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T05:29:35.120 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 181 MB of archives. 2024-09-19T05:29:35.120 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-19T05:29:35.120 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-361-g2f599a46-1jammy [3,590 kB] 2024-09-19T05:29:35.156 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-19T05:29:35.164 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-19T05:29:35.202 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-19T05:29:35.222 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-361-g2f599a46-1jammy [3,241 kB] 2024-09-19T05:29:35.247 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-19T05:29:35.271 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-361-g2f599a46-1jammy [719 kB] 2024-09-19T05:29:35.283 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-361-g2f599a46-1jammy [357 kB] 2024-09-19T05:29:35.292 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-361-g2f599a46-1jammy [32.8 kB] 2024-09-19T05:29:35.293 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-19T05:29:35.293 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-361-g2f599a46-1jammy [180 kB] 2024-09-19T05:29:35.296 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-361-g2f599a46-1jammy [67.8 kB] 2024-09-19T05:29:35.297 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-361-g2f599a46-1jammy [333 kB] 2024-09-19T05:29:35.302 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-361-g2f599a46-1jammy [6,875 kB] 2024-09-19T05:29:35.397 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-19T05:29:35.430 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-361-g2f599a46-1jammy [112 kB] 2024-09-19T05:29:35.432 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-361-g2f599a46-1jammy [472 kB] 2024-09-19T05:29:35.438 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-361-g2f599a46-1jammy [25.9 MB] 2024-09-19T05:29:35.488 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-19T05:29:35.489 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-19T05:29:35.502 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-19T05:29:35.551 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-19T05:29:35.580 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-19T05:29:35.593 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-19T05:29:35.643 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-19T05:29:35.705 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-361-g2f599a46-1jammy [3,241 kB] 2024-09-19T05:29:35.728 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-19T05:29:35.737 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-19T05:29:35.764 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-19T05:29:35.772 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-19T05:29:35.773 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-19T05:29:35.790 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-19T05:29:35.794 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-19T05:29:35.799 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-19T05:29:35.803 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-19T05:29:35.811 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-19T05:29:35.816 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-19T05:29:35.825 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-19T05:29:35.852 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-19T05:29:35.860 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-19T05:29:35.861 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-19T05:29:35.879 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-19T05:29:35.885 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-19T05:29:35.885 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-19T05:29:35.889 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-19T05:29:35.890 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-19T05:29:35.891 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-19T05:29:35.893 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-19T05:29:35.894 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-19T05:29:35.895 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-19T05:29:35.897 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-19T05:29:35.898 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-19T05:29:35.899 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-19T05:29:35.899 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-19T05:29:35.899 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-19T05:29:35.974 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-19T05:29:35.974 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-19T05:29:35.979 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-19T05:29:35.982 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-19T05:29:35.983 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-19T05:29:35.984 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-19T05:29:35.986 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-19T05:29:35.987 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-19T05:29:35.988 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-19T05:29:35.988 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-19T05:29:36.005 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-19T05:29:36.005 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-19T05:29:36.030 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-361-g2f599a46-1jammy [719 kB] 2024-09-19T05:29:36.055 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-361-g2f599a46-1jammy [357 kB] 2024-09-19T05:29:36.062 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-19T05:29:36.062 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-361-g2f599a46-1jammy [32.8 kB] 2024-09-19T05:29:36.063 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-361-g2f599a46-1jammy [180 kB] 2024-09-19T05:29:36.064 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-19T05:29:36.064 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-361-g2f599a46-1jammy [5,145 kB] 2024-09-19T05:29:36.065 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-19T05:29:36.066 INFO:teuthology.orchestra.run.smithi097.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-19T05:29:36.067 INFO:teuthology.orchestra.run.smithi097.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-19T05:29:36.069 INFO:teuthology.orchestra.run.smithi097.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-19T05:29:36.069 INFO:teuthology.orchestra.run.smithi097.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-19T05:29:36.070 INFO:teuthology.orchestra.run.smithi097.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-19T05:29:36.071 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-19T05:29:36.072 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-19T05:29:36.075 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-361-g2f599a46-1jammy [67.8 kB] 2024-09-19T05:29:36.077 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-19T05:29:36.077 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-361-g2f599a46-1jammy [333 kB] 2024-09-19T05:29:36.078 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-19T05:29:36.079 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-19T05:29:36.080 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-19T05:29:36.084 INFO:teuthology.orchestra.run.smithi067.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-361-g2f599a46-1jammy [6,875 kB] 2024-09-19T05:29:36.135 INFO:teuthology.orchestra.run.smithi097.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-361-g2f599a46-1jammy [245 kB] 2024-09-19T05:29:36.136 INFO:teuthology.orchestra.run.smithi097.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-19T05:29:36.137 INFO:teuthology.orchestra.run.smithi097.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-361-g2f599a46-1jammy [124 kB] 2024-09-19T05:29:36.138 INFO:teuthology.orchestra.run.smithi097.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-19T05:29:36.139 INFO:teuthology.orchestra.run.smithi097.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-361-g2f599a46-1jammy [1,555 kB] 2024-09-19T05:29:36.143 INFO:teuthology.orchestra.run.smithi067.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-19T05:29:36.152 INFO:teuthology.orchestra.run.smithi097.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-361-g2f599a46-1jammy [6,142 kB] 2024-09-19T05:29:36.166 INFO:teuthology.orchestra.run.smithi067.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-19T05:29:36.167 INFO:teuthology.orchestra.run.smithi067.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-19T05:29:36.168 INFO:teuthology.orchestra.run.smithi067.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-19T05:29:36.178 INFO:teuthology.orchestra.run.smithi067.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-19T05:29:36.179 INFO:teuthology.orchestra.run.smithi067.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-19T05:29:36.219 INFO:teuthology.orchestra.run.smithi097.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-19T05:29:36.225 INFO:teuthology.orchestra.run.smithi067.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-19T05:29:36.227 INFO:teuthology.orchestra.run.smithi067.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-19T05:29:36.229 INFO:teuthology.orchestra.run.smithi097.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-19T05:29:36.229 INFO:teuthology.orchestra.run.smithi067.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-19T05:29:36.230 INFO:teuthology.orchestra.run.smithi097.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-19T05:29:36.231 INFO:teuthology.orchestra.run.smithi097.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-19T05:29:36.232 INFO:teuthology.orchestra.run.smithi097.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-19T05:29:36.233 INFO:teuthology.orchestra.run.smithi067.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-19T05:29:36.234 INFO:teuthology.orchestra.run.smithi097.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-19T05:29:36.238 INFO:teuthology.orchestra.run.smithi097.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-19T05:29:36.240 INFO:teuthology.orchestra.run.smithi097.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-19T05:29:36.284 INFO:teuthology.orchestra.run.smithi097.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-361-g2f599a46-1jammy [22.8 MB] 2024-09-19T05:29:36.301 INFO:teuthology.orchestra.run.smithi097.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-19T05:29:36.302 INFO:teuthology.orchestra.run.smithi097.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-19T05:29:36.307 INFO:teuthology.orchestra.run.smithi067.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-19T05:29:36.309 INFO:teuthology.orchestra.run.smithi067.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-19T05:29:36.310 INFO:teuthology.orchestra.run.smithi067.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-19T05:29:36.315 INFO:teuthology.orchestra.run.smithi067.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-19T05:29:36.316 INFO:teuthology.orchestra.run.smithi067.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-19T05:29:36.382 INFO:teuthology.orchestra.run.smithi097.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-19T05:29:36.383 INFO:teuthology.orchestra.run.smithi097.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-19T05:29:36.384 INFO:teuthology.orchestra.run.smithi097.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-19T05:29:36.388 INFO:teuthology.orchestra.run.smithi067.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-19T05:29:36.389 INFO:teuthology.orchestra.run.smithi097.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-19T05:29:36.393 INFO:teuthology.orchestra.run.smithi067.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-19T05:29:36.552 INFO:teuthology.orchestra.run.smithi097.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-19T05:29:36.553 INFO:teuthology.orchestra.run.smithi097.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-19T05:29:36.556 INFO:teuthology.orchestra.run.smithi097.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-19T05:29:36.556 INFO:teuthology.orchestra.run.smithi097.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-19T05:29:36.557 INFO:teuthology.orchestra.run.smithi067.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-19T05:29:36.558 INFO:teuthology.orchestra.run.smithi097.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-19T05:29:36.559 INFO:teuthology.orchestra.run.smithi067.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-19T05:29:36.561 INFO:teuthology.orchestra.run.smithi067.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-19T05:29:36.562 INFO:teuthology.orchestra.run.smithi067.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-19T05:29:36.564 INFO:teuthology.orchestra.run.smithi067.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-19T05:29:36.590 INFO:teuthology.orchestra.run.smithi097.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-19T05:29:36.598 INFO:teuthology.orchestra.run.smithi067.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-361-g2f599a46-1jammy [112 kB] 2024-09-19T05:29:36.600 INFO:teuthology.orchestra.run.smithi067.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-361-g2f599a46-1jammy [472 kB] 2024-09-19T05:29:36.601 INFO:teuthology.orchestra.run.smithi067.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-19T05:29:36.605 INFO:teuthology.orchestra.run.smithi067.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-19T05:29:36.605 INFO:teuthology.orchestra.run.smithi067.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-19T05:29:36.611 INFO:teuthology.orchestra.run.smithi067.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-361-g2f599a46-1jammy [25.9 MB] 2024-09-19T05:29:36.629 INFO:teuthology.orchestra.run.smithi097.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-19T05:29:36.629 INFO:teuthology.orchestra.run.smithi097.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-19T05:29:36.658 INFO:teuthology.orchestra.run.smithi097.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-19T05:29:36.658 INFO:teuthology.orchestra.run.smithi097.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-19T05:29:36.667 INFO:teuthology.orchestra.run.smithi067.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-19T05:29:36.667 INFO:teuthology.orchestra.run.smithi067.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-19T05:29:36.725 INFO:teuthology.orchestra.run.smithi097.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-19T05:29:36.726 INFO:teuthology.orchestra.run.smithi067.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-19T05:29:36.726 INFO:teuthology.orchestra.run.smithi097.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-19T05:29:36.726 INFO:teuthology.orchestra.run.smithi097.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-19T05:29:36.727 INFO:teuthology.orchestra.run.smithi067.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-19T05:29:36.728 INFO:teuthology.orchestra.run.smithi097.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-19T05:29:36.728 INFO:teuthology.orchestra.run.smithi067.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-19T05:29:36.728 INFO:teuthology.orchestra.run.smithi097.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-19T05:29:36.729 INFO:teuthology.orchestra.run.smithi067.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-19T05:29:36.729 INFO:teuthology.orchestra.run.smithi097.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-19T05:29:36.730 INFO:teuthology.orchestra.run.smithi067.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-19T05:29:36.731 INFO:teuthology.orchestra.run.smithi067.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-19T05:29:36.736 INFO:teuthology.orchestra.run.smithi097.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-19T05:29:36.738 INFO:teuthology.orchestra.run.smithi067.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-19T05:29:36.806 INFO:teuthology.orchestra.run.smithi097.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-19T05:29:36.807 INFO:teuthology.orchestra.run.smithi067.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-19T05:29:36.811 INFO:teuthology.orchestra.run.smithi067.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-19T05:29:36.812 INFO:teuthology.orchestra.run.smithi067.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-19T05:29:36.849 INFO:teuthology.orchestra.run.smithi097.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-19T05:29:36.850 INFO:teuthology.orchestra.run.smithi097.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-361-g2f599a46-1jammy [14.1 kB] 2024-09-19T05:29:36.850 INFO:teuthology.orchestra.run.smithi097.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-19T05:29:36.851 INFO:teuthology.orchestra.run.smithi097.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-361-g2f599a46-1jammy [877 kB] 2024-09-19T05:29:36.865 INFO:teuthology.orchestra.run.smithi097.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-361-g2f599a46-1jammy [2,462 kB] 2024-09-19T05:29:36.889 INFO:teuthology.orchestra.run.smithi097.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-19T05:29:36.889 INFO:teuthology.orchestra.run.smithi067.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-19T05:29:36.895 INFO:teuthology.orchestra.run.smithi097.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-19T05:29:36.895 INFO:teuthology.orchestra.run.smithi067.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-19T05:29:36.896 INFO:teuthology.orchestra.run.smithi097.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-19T05:29:36.896 INFO:teuthology.orchestra.run.smithi067.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-19T05:29:36.898 INFO:teuthology.orchestra.run.smithi097.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-19T05:29:36.899 INFO:teuthology.orchestra.run.smithi067.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-19T05:29:36.899 INFO:teuthology.orchestra.run.smithi097.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-19T05:29:36.900 INFO:teuthology.orchestra.run.smithi067.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-19T05:29:36.903 INFO:teuthology.orchestra.run.smithi097.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-361-g2f599a46-1jammy [794 kB] 2024-09-19T05:29:36.911 INFO:teuthology.orchestra.run.smithi097.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-19T05:29:36.911 INFO:teuthology.orchestra.run.smithi067.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-19T05:29:36.912 INFO:teuthology.orchestra.run.smithi067.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-19T05:29:36.913 INFO:teuthology.orchestra.run.smithi097.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-361-g2f599a46-1jammy [152 kB] 2024-09-19T05:29:36.913 INFO:teuthology.orchestra.run.smithi097.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-19T05:29:36.914 INFO:teuthology.orchestra.run.smithi097.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-361-g2f599a46-1jammy [2,347 kB] 2024-09-19T05:29:36.961 INFO:teuthology.orchestra.run.smithi097.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-361-g2f599a46-1jammy [8,625 kB] 2024-09-19T05:29:36.970 INFO:teuthology.orchestra.run.smithi097.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-19T05:29:36.972 INFO:teuthology.orchestra.run.smithi097.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-19T05:29:36.972 INFO:teuthology.orchestra.run.smithi097.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-19T05:29:36.972 INFO:teuthology.orchestra.run.smithi067.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-19T05:29:36.973 INFO:teuthology.orchestra.run.smithi067.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-19T05:29:36.973 INFO:teuthology.orchestra.run.smithi067.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-19T05:29:37.052 INFO:teuthology.orchestra.run.smithi097.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-19T05:29:37.052 INFO:teuthology.orchestra.run.smithi067.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-19T05:29:37.055 INFO:teuthology.orchestra.run.smithi097.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-19T05:29:37.056 INFO:teuthology.orchestra.run.smithi067.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-19T05:29:37.057 INFO:teuthology.orchestra.run.smithi097.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-19T05:29:37.058 INFO:teuthology.orchestra.run.smithi067.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-19T05:29:37.074 INFO:teuthology.orchestra.run.smithi097.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-19T05:29:37.075 INFO:teuthology.orchestra.run.smithi097.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-19T05:29:37.075 INFO:teuthology.orchestra.run.smithi067.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-19T05:29:37.076 INFO:teuthology.orchestra.run.smithi097.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-19T05:29:37.076 INFO:teuthology.orchestra.run.smithi067.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-19T05:29:37.076 INFO:teuthology.orchestra.run.smithi067.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-19T05:29:37.081 INFO:teuthology.orchestra.run.smithi097.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-19T05:29:37.082 INFO:teuthology.orchestra.run.smithi067.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-19T05:29:37.133 INFO:teuthology.orchestra.run.smithi097.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-19T05:29:37.134 INFO:teuthology.orchestra.run.smithi067.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-19T05:29:37.177 INFO:teuthology.orchestra.run.smithi097.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-361-g2f599a46-1jammy [14.2 kB] 2024-09-19T05:29:37.178 INFO:teuthology.orchestra.run.smithi097.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-361-g2f599a46-1jammy [51.4 MB] 2024-09-19T05:29:37.777 INFO:teuthology.orchestra.run.smithi067.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-361-g2f599a46-1jammy [5,145 kB] 2024-09-19T05:29:37.864 INFO:teuthology.orchestra.run.smithi067.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-361-g2f599a46-1jammy [245 kB] 2024-09-19T05:29:37.869 INFO:teuthology.orchestra.run.smithi067.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-361-g2f599a46-1jammy [124 kB] 2024-09-19T05:29:37.872 INFO:teuthology.orchestra.run.smithi067.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-361-g2f599a46-1jammy [1,555 kB] 2024-09-19T05:29:37.923 INFO:teuthology.orchestra.run.smithi067.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-361-g2f599a46-1jammy [6,142 kB] 2024-09-19T05:29:38.087 INFO:teuthology.orchestra.run.smithi067.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-361-g2f599a46-1jammy [22.8 MB] 2024-09-19T05:29:38.725 INFO:teuthology.orchestra.run.smithi067.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-361-g2f599a46-1jammy [14.1 kB] 2024-09-19T05:29:38.726 INFO:teuthology.orchestra.run.smithi067.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-361-g2f599a46-1jammy [877 kB] 2024-09-19T05:29:38.741 INFO:teuthology.orchestra.run.smithi067.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-361-g2f599a46-1jammy [2,462 kB] 2024-09-19T05:29:38.781 INFO:teuthology.orchestra.run.smithi067.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-361-g2f599a46-1jammy [794 kB] 2024-09-19T05:29:38.791 INFO:teuthology.orchestra.run.smithi067.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-361-g2f599a46-1jammy [152 kB] 2024-09-19T05:29:38.793 INFO:teuthology.orchestra.run.smithi067.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-361-g2f599a46-1jammy [2,347 kB] 2024-09-19T05:29:38.838 INFO:teuthology.orchestra.run.smithi067.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-361-g2f599a46-1jammy [8,625 kB] 2024-09-19T05:29:39.050 INFO:teuthology.orchestra.run.smithi067.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-361-g2f599a46-1jammy [14.2 kB] 2024-09-19T05:29:39.050 INFO:teuthology.orchestra.run.smithi067.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-361-g2f599a46-1jammy [51.4 MB] 2024-09-19T05:29:39.556 INFO:teuthology.orchestra.run.smithi097.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-361-g2f599a46-1jammy [130 kB] 2024-09-19T05:29:39.558 INFO:teuthology.orchestra.run.smithi097.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-361-g2f599a46-1jammy [236 kB] 2024-09-19T05:29:39.563 INFO:teuthology.orchestra.run.smithi097.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-361-g2f599a46-1jammy [34.0 kB] 2024-09-19T05:29:39.564 INFO:teuthology.orchestra.run.smithi097.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-361-g2f599a46-1jammy [23.5 kB] 2024-09-19T05:29:39.565 INFO:teuthology.orchestra.run.smithi097.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-361-g2f599a46-1jammy [39.0 kB] 2024-09-19T05:29:39.566 INFO:teuthology.orchestra.run.smithi097.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-361-g2f599a46-1jammy [13.6 MB] 2024-09-19T05:29:40.222 INFO:teuthology.orchestra.run.smithi097.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-361-g2f599a46-1jammy [91.5 kB] 2024-09-19T05:29:40.503 INFO:teuthology.orchestra.run.smithi067.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-361-g2f599a46-1jammy [130 kB] 2024-09-19T05:29:40.505 INFO:teuthology.orchestra.run.smithi067.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-361-g2f599a46-1jammy [236 kB] 2024-09-19T05:29:40.510 INFO:teuthology.orchestra.run.smithi067.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-361-g2f599a46-1jammy [34.0 kB] 2024-09-19T05:29:40.511 INFO:teuthology.orchestra.run.smithi067.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-361-g2f599a46-1jammy [23.5 kB] 2024-09-19T05:29:40.512 INFO:teuthology.orchestra.run.smithi067.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-361-g2f599a46-1jammy [39.0 kB] 2024-09-19T05:29:40.513 INFO:teuthology.orchestra.run.smithi067.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-361-g2f599a46-1jammy [13.6 MB] 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi067.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-361-g2f599a46-1jammy [91.5 kB] 2024-09-19T05:29:40.855 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 181 MB in 5s (34.1 MB/s) 2024-09-19T05:29:40.967 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-19T05:29:41.050 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-19T05:29:41.055 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-19T05:29:41.091 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-19T05:29:41.352 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-19T05:29:41.366 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 181 MB in 6s (31.7 MB/s) 2024-09-19T05:29:41.378 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-19T05:29:41.419 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T05:29:41.513 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-19T05:29:41.613 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-19T05:29:41.618 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-19T05:29:41.661 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-19T05:29:41.746 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cmd2. 2024-09-19T05:29:41.772 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-19T05:29:41.813 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-19T05:29:41.915 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-19T05:29:41.941 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-19T05:29:41.973 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T05:29:42.183 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-19T05:29:42.209 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-19T05:29:42.291 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cmd2. 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-19T05:29:42.384 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-19T05:29:42.728 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-19T05:29:42.755 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-19T05:29:42.803 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-19T05:29:42.829 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-19T05:29:42.837 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T05:29:42.869 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T05:29:43.164 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-19T05:29:43.182 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-19T05:29:43.190 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-19T05:29:43.209 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-19T05:29:43.222 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T05:29:43.249 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T05:29:43.527 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-19T05:29:43.543 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-19T05:29:43.577 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T05:29:43.676 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-19T05:29:43.702 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T05:29:43.751 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:29:44.005 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-19T05:29:44.032 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T05:29:44.081 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:29:44.162 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-19T05:29:44.188 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T05:29:44.228 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:29:44.417 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-19T05:29:44.433 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T05:29:44.466 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:29:44.557 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-19T05:29:44.583 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T05:29:44.615 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:29:44.819 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-19T05:29:44.836 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T05:29:44.877 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:29:44.984 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-19T05:29:45.011 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-19T05:29:45.051 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T05:29:45.273 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-19T05:29:45.299 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-19T05:29:45.339 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T05:29:45.404 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librados2. 2024-09-19T05:29:45.430 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../010-librados2_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:45.470 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librados2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:45.617 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librados2. 2024-09-19T05:29:45.644 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../010-librados2_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:45.675 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librados2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:45.907 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librbd1. 2024-09-19T05:29:45.933 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../011-librbd1_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:45.990 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librbd1 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:46.094 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librbd1. 2024-09-19T05:29:46.121 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../011-librbd1_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:46.161 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librbd1 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:46.393 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs2. 2024-09-19T05:29:46.418 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:46.459 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:46.606 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs2. 2024-09-19T05:29:46.632 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:46.672 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:46.728 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rados. 2024-09-19T05:29:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../013-python3-rados_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:46.786 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rados (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:46.949 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rados. 2024-09-19T05:29:46.965 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../013-python3-rados_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:47.008 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rados (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:47.106 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-19T05:29:47.132 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:29:47.172 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-argparse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-19T05:29:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:29:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-argparse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:47.408 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cephfs. 2024-09-19T05:29:47.423 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:47.458 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cephfs (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:47.529 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cephfs. 2024-09-19T05:29:47.546 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:47.588 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cephfs (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:47.736 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-19T05:29:47.762 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:29:47.802 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-common (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:47.916 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-19T05:29:47.942 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:29:47.982 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-common (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:48.222 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-prettytable. 2024-09-19T05:29:48.248 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-19T05:29:48.288 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-19T05:29:48.301 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-prettytable. 2024-09-19T05:29:48.328 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-19T05:29:48.368 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-19T05:29:48.566 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rbd. 2024-09-19T05:29:48.581 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:48.604 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rbd. 2024-09-19T05:29:48.620 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:48.624 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rbd (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:48.654 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rbd (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:48.957 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-19T05:29:48.977 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-19T05:29:48.984 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-19T05:29:49.003 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-19T05:29:49.024 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T05:29:49.044 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T05:29:49.276 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-19T05:29:49.292 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-19T05:29:49.313 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-19T05:29:49.328 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-19T05:29:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T05:29:49.363 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T05:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-19T05:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-19T05:29:49.674 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-19T05:29:49.689 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-19T05:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T05:29:49.732 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T05:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua5.1. 2024-09-19T05:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-19T05:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-19T05:29:50.060 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua5.1. 2024-09-19T05:29:50.087 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-19T05:29:50.127 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-19T05:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-any. 2024-09-19T05:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-19T05:29:50.446 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-any. 2024-09-19T05:29:50.461 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-19T05:29:50.496 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-19T05:29:50.673 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package zip. 2024-09-19T05:29:50.700 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-19T05:29:50.732 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package zip. 2024-09-19T05:29:50.745 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking zip (3.0-12build2) ... 2024-09-19T05:29:50.758 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-19T05:29:50.799 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking zip (3.0-12build2) ... 2024-09-19T05:29:51.074 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package unzip. 2024-09-19T05:29:51.101 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-19T05:29:51.127 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package unzip. 2024-09-19T05:29:51.140 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-19T05:29:51.153 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-19T05:29:51.193 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-19T05:29:51.485 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package luarocks. 2024-09-19T05:29:51.501 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-19T05:29:51.535 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-19T05:29:51.580 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package luarocks. 2024-09-19T05:29:51.606 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-19T05:29:51.647 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-19T05:29:51.893 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librgw2. 2024-09-19T05:29:51.920 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../027-librgw2_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:51.959 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librgw2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:52.013 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librgw2. 2024-09-19T05:29:52.039 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../027-librgw2_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:52.079 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librgw2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:52.512 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rgw. 2024-09-19T05:29:52.539 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:52.578 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rgw (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:52.848 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rgw. 2024-09-19T05:29:52.865 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:52.882 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-19T05:29:52.898 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rgw (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:52.908 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-19T05:29:52.940 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T05:29:53.192 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libradosstriper1. 2024-09-19T05:29:53.219 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:53.251 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libradosstriper1 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:53.259 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-19T05:29:53.286 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-19T05:29:53.326 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T05:29:53.654 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libradosstriper1. 2024-09-19T05:29:53.680 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:53.720 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libradosstriper1 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:53.896 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-common. 2024-09-19T05:29:53.923 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../031-ceph-common_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:53.962 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-common (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:54.148 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-common. 2024-09-19T05:29:54.175 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../031-ceph-common_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:54.215 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-common (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:55.351 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-base. 2024-09-19T05:29:55.378 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../032-ceph-base_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:55.427 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-base (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:55.645 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-base. 2024-09-19T05:29:55.671 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../032-ceph-base_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:29:55.721 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-base (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:29:56.039 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-19T05:29:56.065 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-19T05:29:56.105 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-19T05:29:56.308 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-19T05:29:56.334 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-19T05:29:56.374 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-19T05:29:56.400 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cheroot. 2024-09-19T05:29:56.426 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-19T05:29:56.458 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T05:29:56.652 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cheroot. 2024-09-19T05:29:56.678 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-19T05:29:56.719 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-19T05:29:56.743 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T05:29:56.746 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-19T05:29:56.785 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-19T05:29:57.054 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-19T05:29:57.081 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-19T05:29:57.088 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-19T05:29:57.115 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-19T05:29:57.121 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-19T05:29:57.155 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-19T05:29:57.390 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-19T05:29:57.416 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-19T05:29:57.457 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-19T05:29:57.466 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-19T05:29:57.493 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-19T05:29:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-19T05:29:57.794 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempora. 2024-09-19T05:29:57.821 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-19T05:29:57.852 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-19T05:29:57.977 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-19T05:29:58.003 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-19T05:29:58.043 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-19T05:29:58.155 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-portend. 2024-09-19T05:29:58.182 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-19T05:29:58.221 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-19T05:29:58.346 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempora. 2024-09-19T05:29:58.372 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-19T05:29:58.412 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-19T05:29:58.533 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-19T05:29:58.560 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-19T05:29:58.599 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-19T05:29:58.690 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-portend. 2024-09-19T05:29:58.716 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-19T05:29:58.757 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-19T05:29:58.902 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-19T05:29:58.929 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-19T05:29:58.969 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-19T05:29:59.026 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-19T05:29:59.053 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-19T05:29:59.093 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-19T05:29:59.347 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-natsort. 2024-09-19T05:29:59.374 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-19T05:29:59.395 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-19T05:29:59.414 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-19T05:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-19T05:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-19T05:29:59.725 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-logutils. 2024-09-19T05:29:59.753 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-19T05:29:59.792 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-19T05:29:59.807 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-natsort. 2024-09-19T05:29:59.833 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-19T05:29:59.873 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-19T05:30:00.053 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-19T05:30:00.065 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-19T05:30:00.094 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-19T05:30:00.177 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-logutils. 2024-09-19T05:30:00.204 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-19T05:30:00.243 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-19T05:30:00.381 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-mako. 2024-09-19T05:30:00.406 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-19T05:30:00.439 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T05:30:00.571 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-19T05:30:00.598 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-19T05:30:00.637 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-19T05:30:00.709 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-19T05:30:00.725 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-19T05:30:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-19T05:30:00.940 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-mako. 2024-09-19T05:30:00.967 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-19T05:30:01.007 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T05:30:01.028 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-19T05:30:01.055 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-19T05:30:01.095 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-19T05:30:01.293 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-19T05:30:01.308 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-19T05:30:01.343 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-19T05:30:01.356 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webob. 2024-09-19T05:30:01.383 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-19T05:30:01.422 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T05:30:01.612 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-19T05:30:01.639 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-19T05:30:01.679 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-19T05:30:01.759 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-waitress. 2024-09-19T05:30:01.786 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-19T05:30:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T05:30:01.990 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webob. 2024-09-19T05:30:02.017 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-19T05:30:02.056 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T05:30:02.162 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempita. 2024-09-19T05:30:02.189 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-19T05:30:02.228 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T05:30:02.418 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-waitress. 2024-09-19T05:30:02.445 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-19T05:30:02.488 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T05:30:02.531 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-paste. 2024-09-19T05:30:02.559 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-19T05:30:02.598 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T05:30:02.804 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempita. 2024-09-19T05:30:02.831 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-19T05:30:02.870 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T05:30:02.901 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-19T05:30:02.914 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-19T05:30:02.959 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T05:30:03.165 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-paste. 2024-09-19T05:30:03.192 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-19T05:30:03.223 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T05:30:03.254 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-19T05:30:03.267 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-19T05:30:03.303 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-19T05:30:03.551 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-19T05:30:03.578 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-19T05:30:03.614 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webtest. 2024-09-19T05:30:03.618 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T05:30:03.639 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-19T05:30:03.681 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-19T05:30:03.904 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-19T05:30:03.931 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-19T05:30:03.959 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pecan. 2024-09-19T05:30:03.962 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-19T05:30:03.987 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-19T05:30:04.143 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T05:30:04.240 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webtest. 2024-09-19T05:30:04.267 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-19T05:30:04.306 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-19T05:30:04.464 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-certifi. 2024-09-19T05:30:04.491 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-19T05:30:04.544 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-19T05:30:04.627 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pecan. 2024-09-19T05:30:04.653 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-19T05:30:04.693 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T05:30:04.859 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-idna. 2024-09-19T05:30:04.886 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-19T05:30:04.925 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T05:30:05.064 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-certifi. 2024-09-19T05:30:05.091 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-19T05:30:05.130 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-19T05:30:05.236 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-urllib3. 2024-09-19T05:30:05.252 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-19T05:30:05.294 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T05:30:05.467 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-idna. 2024-09-19T05:30:05.493 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-19T05:30:05.533 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T05:30:05.623 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests. 2024-09-19T05:30:05.651 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-19T05:30:05.689 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T05:30:05.903 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-urllib3. 2024-09-19T05:30:05.929 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-19T05:30:05.977 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T05:30:05.984 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-19T05:30:06.011 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-19T05:30:06.050 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T05:30:06.328 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-19T05:30:06.355 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:06.381 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests. 2024-09-19T05:30:06.394 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-modules-core (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:06.407 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-19T05:30:06.447 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T05:30:06.777 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-19T05:30:06.800 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-19T05:30:06.803 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-19T05:30:06.827 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:06.843 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T05:30:06.882 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:07.138 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-19T05:30:07.153 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:07.185 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-19T05:30:07.196 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-modules-core (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:07.213 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-19T05:30:07.252 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-19T05:30:07.530 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-openssl. 2024-09-19T05:30:07.557 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-19T05:30:07.559 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-19T05:30:07.586 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:07.596 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-19T05:30:07.626 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:07.891 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr. 2024-09-19T05:30:07.918 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:07.945 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-19T05:30:07.966 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:07.972 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-19T05:30:08.012 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-19T05:30:09.157 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-openssl. 2024-09-19T05:30:09.184 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-19T05:30:09.203 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mon. 2024-09-19T05:30:09.223 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-19T05:30:09.230 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:09.269 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mon (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:09.526 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr. 2024-09-19T05:30:09.553 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:09.584 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:09.864 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-osd. 2024-09-19T05:30:09.891 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:09.930 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-osd (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:09.996 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mon. 2024-09-19T05:30:10.014 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:10.054 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mon (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:10.691 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-osd. 2024-09-19T05:30:10.717 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:10.757 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-osd (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:10.926 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph. 2024-09-19T05:30:10.941 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../068-ceph_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:10.985 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:11.253 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-fuse. 2024-09-19T05:30:11.280 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:11.311 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-fuse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:11.656 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mds. 2024-09-19T05:30:11.683 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:11.722 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mds (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:11.852 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph. 2024-09-19T05:30:11.867 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../068-ceph_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:11.902 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:12.125 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephadm. 2024-09-19T05:30:12.153 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../071-cephadm_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:12.188 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-fuse. 2024-09-19T05:30:12.191 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephadm (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:12.214 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:12.254 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-fuse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:12.495 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-19T05:30:12.522 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-19T05:30:12.561 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-19T05:30:12.617 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mds. 2024-09-19T05:30:12.642 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:12.682 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mds (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:12.872 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-19T05:30:12.899 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T05:30:12.938 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T05:30:13.085 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephadm. 2024-09-19T05:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../071-cephadm_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephadm (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:13.629 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-19T05:30:13.655 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-19T05:30:13.687 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-19T05:30:13.943 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-babel. 2024-09-19T05:30:13.957 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T05:30:14.002 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T05:30:14.031 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-19T05:30:14.046 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T05:30:14.089 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T05:30:14.438 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jinja2. 2024-09-19T05:30:14.466 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-19T05:30:14.504 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T05:30:14.816 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-19T05:30:14.832 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:14.865 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-cephadm (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:15.152 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-19T05:30:15.169 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-babel. 2024-09-19T05:30:15.180 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-19T05:30:15.197 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T05:30:15.219 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-19T05:30:15.236 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T05:30:15.497 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jinja2. 2024-09-19T05:30:15.520 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-19T05:30:15.521 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-routes. 2024-09-19T05:30:15.549 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-19T05:30:15.555 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T05:30:15.588 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T05:30:15.866 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-19T05:30:15.893 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:15.893 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-19T05:30:15.919 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:15.924 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-cephadm (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:15.950 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-dashboard (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:16.236 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-19T05:30:16.263 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-19T05:30:16.294 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-19T05:30:16.589 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-routes. 2024-09-19T05:30:16.615 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-19T05:30:16.655 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T05:30:16.958 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-19T05:30:16.985 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:17.025 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-dashboard (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:17.179 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-19T05:30:17.196 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-19T05:30:17.238 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T05:30:17.728 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-joblib. 2024-09-19T05:30:17.752 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-19T05:30:17.799 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T05:30:18.170 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-19T05:30:18.197 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-19T05:30:18.313 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-19T05:30:18.371 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-19T05:30:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-19T05:30:18.429 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T05:30:18.616 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn. 2024-09-19T05:30:18.643 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-19T05:30:18.682 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T05:30:18.924 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-joblib. 2024-09-19T05:30:18.940 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-19T05:30:18.974 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T05:30:19.328 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-19T05:30:19.355 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-19T05:30:19.383 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-19T05:30:19.411 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:19.451 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:19.488 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-19T05:30:19.749 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn. 2024-09-19T05:30:19.776 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-19T05:30:19.807 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T05:30:20.413 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cachetools. 2024-09-19T05:30:20.441 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-19T05:30:20.474 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-19T05:30:20.479 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-19T05:30:20.502 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:20.541 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:20.782 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-19T05:30:20.812 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-19T05:30:20.849 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-19T05:30:21.194 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-19T05:30:21.222 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-19T05:30:21.260 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T05:30:21.510 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cachetools. 2024-09-19T05:30:21.537 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-19T05:30:21.572 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rsa. 2024-09-19T05:30:21.585 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-19T05:30:21.599 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-19T05:30:21.663 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-19T05:30:21.905 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-19T05:30:21.924 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-google-auth. 2024-09-19T05:30:21.932 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-19T05:30:21.941 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-19T05:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-19T05:30:21.975 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-19T05:30:22.278 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-19T05:30:22.306 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-19T05:30:22.316 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-19T05:30:22.343 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-19T05:30:22.344 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T05:30:22.383 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T05:30:22.614 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-websocket. 2024-09-19T05:30:22.642 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-19T05:30:22.681 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-19T05:30:22.694 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rsa. 2024-09-19T05:30:22.720 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-19T05:30:22.760 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-19T05:30:22.984 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-19T05:30:23.012 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-19T05:30:23.022 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-google-auth. 2024-09-19T05:30:23.049 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-19T05:30:23.050 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T05:30:23.080 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-19T05:30:23.384 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-19T05:30:23.411 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-19T05:30:23.450 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T05:30:23.672 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-19T05:30:23.689 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:23.722 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:23.761 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-websocket. 2024-09-19T05:30:23.789 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-19T05:30:23.936 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-19T05:30:24.025 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-19T05:30:24.053 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-19T05:30:24.092 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T05:30:24.323 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-19T05:30:24.350 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-19T05:30:24.389 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T05:30:24.488 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-19T05:30:24.518 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T05:30:24.762 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T05:30:25.007 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package jq. 2024-09-19T05:30:25.035 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T05:30:25.073 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-19T05:30:25.103 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-19T05:30:25.131 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:25.169 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:25.343 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package socat. 2024-09-19T05:30:25.371 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-19T05:30:25.409 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-19T05:30:25.497 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-19T05:30:25.525 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-19T05:30:25.564 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T05:30:25.883 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-19T05:30:25.911 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T05:30:25.950 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T05:30:26.063 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package xmlstarlet. 2024-09-19T05:30:26.080 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-19T05:30:26.121 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-19T05:30:26.169 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package jq. 2024-09-19T05:30:26.184 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T05:30:26.219 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-19T05:30:26.472 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package socat. 2024-09-19T05:30:26.492 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-test. 2024-09-19T05:30:26.499 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-19T05:30:26.509 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../099-ceph-test_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:26.538 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-19T05:30:26.550 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-test (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:26.849 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package xmlstarlet. 2024-09-19T05:30:26.865 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-19T05:30:26.907 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-19T05:30:27.287 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-test. 2024-09-19T05:30:27.303 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../099-ceph-test_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:27.345 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-test (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:28.847 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-volume. 2024-09-19T05:30:28.875 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:28.905 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-volume (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:29.217 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-19T05:30:29.246 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:29.275 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-mirror (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:29.664 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-colorama. 2024-09-19T05:30:29.692 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-19T05:30:29.761 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-19T05:30:29.949 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-volume. 2024-09-19T05:30:29.976 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:30.015 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-volume (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:30.030 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-shell. 2024-09-19T05:30:30.048 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:30.114 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-shell (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:30.375 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-top. 2024-09-19T05:30:30.392 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:30.403 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-19T05:30:30.430 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:30.433 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-top (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:30.469 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-mirror (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:30.652 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-19T05:30:30.668 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:30.710 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs-dev (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:30.730 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-colorama. 2024-09-19T05:30:30.746 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-19T05:30:30.780 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-19T05:30:31.021 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-19T05:30:31.041 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-shell. 2024-09-19T05:30:31.049 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-19T05:30:31.057 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:31.088 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T05:30:31.099 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-shell (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:31.368 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-top. 2024-09-19T05:30:31.384 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-361-g2f599a46-1jammy_all.deb ... 2024-09-19T05:30:31.409 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-19T05:30:31.426 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-top (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:31.437 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-19T05:30:31.475 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-19T05:30:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-19T05:30:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:31.746 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs-dev (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:31.821 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package nvme-cli. 2024-09-19T05:30:31.849 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-19T05:30:31.888 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T05:30:32.048 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-19T05:30:32.076 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-19T05:30:32.115 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T05:30:32.276 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package pkg-config. 2024-09-19T05:30:32.305 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-19T05:30:32.342 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T05:30:32.402 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-19T05:30:32.430 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-19T05:30:32.460 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-19T05:30:32.596 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-19T05:30:32.624 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-19T05:30:32.662 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-19T05:30:32.864 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package nvme-cli. 2024-09-19T05:30:32.892 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-19T05:30:32.931 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T05:30:33.090 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-19T05:30:33.118 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-19T05:30:33.157 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-19T05:30:33.327 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pkg-config. 2024-09-19T05:30:33.355 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-19T05:30:33.393 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T05:30:33.443 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastescript. 2024-09-19T05:30:33.471 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-19T05:30:33.509 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-19T05:30:33.638 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-19T05:30:33.665 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-19T05:30:33.705 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-19T05:30:33.804 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pluggy. 2024-09-19T05:30:33.832 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-19T05:30:33.862 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-19T05:30:34.149 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-19T05:30:34.165 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-psutil. 2024-09-19T05:30:34.177 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-19T05:30:34.193 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-19T05:30:34.216 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-19T05:30:34.231 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-19T05:30:34.477 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastescript. 2024-09-19T05:30:34.504 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-19T05:30:34.535 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-19T05:30:34.560 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-py. 2024-09-19T05:30:34.588 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-19T05:30:34.626 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-19T05:30:34.830 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pluggy. 2024-09-19T05:30:34.857 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-19T05:30:34.897 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-19T05:30:35.191 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-psutil. 2024-09-19T05:30:35.218 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-19T05:30:35.448 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-19T05:30:35.448 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pygments. 2024-09-19T05:30:35.448 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-19T05:30:35.448 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T05:30:35.585 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-py. 2024-09-19T05:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-19T05:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-19T05:30:35.729 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-19T05:30:35.757 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-19T05:30:35.799 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-19T05:30:35.972 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pygments. 2024-09-19T05:30:35.999 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-19T05:30:36.038 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T05:30:36.102 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-toml. 2024-09-19T05:30:36.130 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-19T05:30:36.169 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-19T05:30:36.480 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pytest. 2024-09-19T05:30:36.508 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-19T05:30:36.525 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-19T05:30:36.546 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T05:30:36.553 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-19T05:30:36.592 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-19T05:30:36.892 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplejson. 2024-09-19T05:30:36.903 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-toml. 2024-09-19T05:30:36.920 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-19T05:30:36.931 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-19T05:30:36.958 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-19T05:30:36.969 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-19T05:30:37.227 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-19T05:30:37.230 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pytest. 2024-09-19T05:30:37.244 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-19T05:30:37.246 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-19T05:30:37.280 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T05:30:37.285 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-19T05:30:37.642 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplejson. 2024-09-19T05:30:37.670 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-19T05:30:37.708 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-19T05:30:37.977 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-19T05:30:37.981 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package radosgw. 2024-09-19T05:30:37.994 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-19T05:30:38.010 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../122-radosgw_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:38.027 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-19T05:30:38.039 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking radosgw (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:38.681 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package radosgw. 2024-09-19T05:30:38.698 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../122-radosgw_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:38.740 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking radosgw (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:38.826 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-fuse. 2024-09-19T05:30:38.854 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:38.892 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-fuse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:39.190 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-19T05:30:39.447 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T05:30:39.534 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package rbd-fuse. 2024-09-19T05:30:39.562 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-361-g2f599a46-1jammy_amd64.deb ... 2024-09-19T05:30:39.573 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T05:30:39.601 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking rbd-fuse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:39.840 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-19T05:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-19T05:30:40.189 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T05:30:40.199 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-19T05:30:40.315 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T05:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-19T05:30:40.643 INFO:teuthology.orchestra.run.smithi067.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-19T05:30:40.700 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephadm (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:40.890 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-19T05:30:41.200 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user cephadm....done 2024-09-19T05:30:41.323 INFO:teuthology.orchestra.run.smithi097.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-19T05:30:41.331 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T05:30:41.425 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephadm (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:41.632 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-19T05:30:41.892 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-19T05:30:42.018 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-19T05:30:42.269 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-19T05:30:42.310 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user cephadm....done 2024-09-19T05:30:42.466 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T05:30:42.537 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T05:30:42.663 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-19T05:30:42.742 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-19T05:30:42.973 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T05:30:43.001 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-19T05:30:43.102 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-19T05:30:43.333 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-19T05:30:43.337 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-19T05:30:43.584 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-19T05:30:43.588 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T05:30:43.714 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-19T05:30:43.827 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-19T05:30:44.015 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T05:30:44.087 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-19T05:30:44.348 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-19T05:30:44.375 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-19T05:30:44.606 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-19T05:30:44.626 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-19T05:30:44.861 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-19T05:30:44.865 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-19T05:30:45.112 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-19T05:30:45.216 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-argparse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:45.372 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-19T05:30:45.467 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T05:30:45.585 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T05:30:45.623 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-19T05:30:45.686 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-19T05:30:45.929 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T05:30:45.932 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-19T05:30:46.055 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-19T05:30:46.258 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-argparse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:46.314 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-19T05:30:46.517 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T05:30:46.618 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T05:30:46.716 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-19T05:30:46.736 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-19T05:30:46.745 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-19T05:30:46.809 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T05:30:46.935 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-19T05:30:46.996 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T05:30:47.114 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-19T05:30:47.344 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T05:30:47.373 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-19T05:30:47.479 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-19T05:30:47.736 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-19T05:30:47.755 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T05:30:47.770 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-19T05:30:47.826 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T05:30:47.927 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-19T05:30:48.022 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-19T05:30:48.278 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T05:30:48.332 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up zip (3.0-12build2) ... 2024-09-19T05:30:48.404 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-19T05:30:48.433 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T05:30:48.672 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T05:30:48.939 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-19T05:30:49.152 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T05:30:49.241 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up zip (3.0-12build2) ... 2024-09-19T05:30:49.350 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T05:30:49.411 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T05:30:49.546 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-19T05:30:49.672 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T05:30:49.972 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-19T05:30:50.010 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T05:30:50.253 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T05:30:50.365 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-19T05:30:50.381 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-19T05:30:50.524 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T05:30:50.600 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T05:30:50.841 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-19T05:30:50.968 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T05:30:51.217 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-19T05:30:51.244 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-19T05:30:51.460 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T05:30:51.621 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T05:30:51.862 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T05:30:51.972 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-19T05:30:52.138 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-19T05:30:52.231 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-19T05:30:52.357 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-common (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:52.456 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T05:30:52.658 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T05:30:52.799 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-19T05:30:52.985 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T05:30:53.058 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-19T05:30:53.184 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-common (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:30:53.477 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T05:30:53.795 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T05:30:54.190 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T05:30:54.434 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:30:54.576 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-19T05:30:54.827 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T05:30:54.928 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-19T05:30:55.001 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T05:30:55.054 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T05:30:55.244 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:30:55.362 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-19T05:30:55.364 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-19T05:30:55.621 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T05:30:55.674 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-19T05:30:55.756 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-19T05:30:55.882 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T05:30:55.908 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:30:56.034 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-19T05:30:56.175 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-19T05:30:56.335 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-19T05:30:56.426 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-19T05:30:56.586 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-19T05:30:56.652 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:30:56.753 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-19T05:30:56.837 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-19T05:30:57.038 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-19T05:30:57.097 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-19T05:30:57.306 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-19T05:30:57.356 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-19T05:30:57.565 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-19T05:30:57.669 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T05:30:57.767 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-19T05:30:57.841 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-19T05:30:58.051 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T05:30:58.076 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-19T05:30:58.177 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T05:30:58.335 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T05:30:58.444 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-19T05:30:58.478 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T05:30:58.745 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T05:30:58.796 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-19T05:30:58.863 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T05:30:59.047 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T05:30:59.148 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T05:30:59.173 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-19T05:30:59.299 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T05:30:59.388 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-19T05:30:59.440 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-19T05:30:59.634 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T05:30:59.691 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T05:30:59.760 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T05:30:59.792 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-19T05:30:59.893 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T05:31:00.187 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-19T05:31:00.285 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-19T05:31:00.446 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-19T05:31:00.572 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-19T05:31:00.626 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T05:31:00.754 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T05:31:00.831 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:31:00.949 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T05:31:01.156 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-19T05:31:01.267 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T05:31:01.432 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-19T05:31:01.558 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-19T05:31:01.576 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T05:31:01.809 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T05:31:01.844 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-19T05:31:01.910 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T05:31:02.039 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-19T05:31:02.220 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T05:31:02.307 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-19T05:31:02.529 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T05:31:02.574 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T05:31:02.813 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-19T05:31:02.851 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-19T05:31:03.042 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-19T05:31:03.261 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-19T05:31:03.293 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-19T05:31:03.536 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T05:31:03.548 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T05:31:03.787 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-19T05:31:03.925 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T05:31:04.051 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librados2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-19T05:31:04.177 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libsqlite3-mod-ceph (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:04.303 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-19T05:31:04.457 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T05:31:04.640 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:04.740 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libradosstriper1 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T05:31:04.866 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-19T05:31:04.944 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librados2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:05.045 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsqlite3-mod-ceph (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:05.143 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librbd1 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:05.154 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-19T05:31:05.252 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-modules-core (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:05.353 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-fuse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:05.499 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:05.555 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T05:31:05.555 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T05:31:05.642 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libradosstriper1 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:05.767 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-19T05:31:06.044 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librbd1 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:06.045 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs-dev (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:06.145 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-modules-core (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:06.172 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rados (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:06.250 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-fuse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:06.306 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librgw2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:06.432 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-top (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:06.467 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T05:31:06.468 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T05:31:06.558 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T05:31:06.931 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs-dev (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:07.057 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rados (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:07.183 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librgw2 (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:07.284 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-top (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:07.385 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T05:31:07.770 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rbd (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:07.896 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-fuse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:08.005 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rgw (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:08.123 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cephfs (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:08.241 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-shell (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:08.367 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-common (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rbd (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:08.714 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up rbd-fuse (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:08.840 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rgw (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:08.926 INFO:teuthology.orchestra.run.smithi067.stdout:Adding group ceph....done 2024-09-19T05:31:08.974 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cephfs (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:09.100 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-shell (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:09.226 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-common (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:09.245 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user ceph....done 2024-09-19T05:31:09.413 INFO:teuthology.orchestra.run.smithi067.stdout:Setting system user ceph properties....done 2024-09-19T05:31:09.426 INFO:teuthology.orchestra.run.smithi067.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-19T05:31:09.569 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-19T05:31:09.721 INFO:teuthology.orchestra.run.smithi097.stdout:Adding group ceph....done 2024-09-19T05:31:09.943 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-19T05:31:10.104 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user ceph....done 2024-09-19T05:31:10.224 INFO:teuthology.orchestra.run.smithi097.stdout:Setting system user ceph properties....done 2024-09-19T05:31:10.243 INFO:teuthology.orchestra.run.smithi097.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-19T05:31:10.378 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-19T05:31:10.410 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-mirror (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:10.626 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:31:10.626 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:31:10.684 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-19T05:31:11.094 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-test (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:11.161 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-mirror (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:11.195 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up radosgw (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:11.364 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:31:11.365 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:31:11.661 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:31:11.661 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:31:11.897 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-test (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:12.121 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-base (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:12.137 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up radosgw (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:12.467 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-19T05:31:12.643 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:31:12.643 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:31:12.924 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mds (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:13.075 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-base (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:13.145 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T05:31:13.145 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T05:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-19T05:31:13.659 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:13.860 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mds (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:13.885 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T05:31:13.885 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T05:31:14.058 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T05:31:14.058 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T05:31:14.394 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-osd (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:14.545 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:14.664 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T05:31:14.665 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T05:31:14.763 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T05:31:14.763 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T05:31:15.170 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-k8sevents (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:15.213 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-osd (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:15.296 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:15.439 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mon (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:15.503 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T05:31:15.504 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T05:31:15.653 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T05:31:15.653 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T05:31:15.974 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-k8sevents (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:16.075 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:16.115 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-cephadm (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:16.209 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mon (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:16.300 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:16.403 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T05:31:16.403 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T05:31:16.426 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-dashboard (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-volume (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:16.852 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-cephadm (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:16.914 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-19T05:31:16.995 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:17.022 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-19T05:31:17.121 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-dashboard (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:17.175 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T05:31:17.272 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-volume (19.1.1-361-g2f599a46-1jammy) ... 2024-09-19T05:31:17.625 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-19T05:31:17.726 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-19T05:31:17.845 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T05:31:18.276 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-19T05:31:18.620 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-19T05:31:18.930 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T05:31:18.934 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-19T05:31:19.002 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-09-19T05:31:19.217 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2024-09-19T05:31:19.218 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2024-09-19T05:31:19.272 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T05:31:19.275 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-19T05:31:19.390 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-19T05:31:19.433 INFO:teuthology.orchestra.run.smithi067.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-19T05:31:19.433 INFO:teuthology.orchestra.run.smithi067.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-19T05:31:19.433 INFO:teuthology.orchestra.run.smithi067.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-19T05:31:19.433 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T05:31:19.434 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T05:31:19.434 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T05:31:19.434 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T05:31:19.434 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T05:31:19.435 INFO:teuthology.orchestra.run.smithi067.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T05:31:19.435 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T05:31:19.435 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2024-09-19T05:31:19.435 INFO:teuthology.orchestra.run.smithi067.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-19T05:31:19.435 INFO:teuthology.orchestra.run.smithi067.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-19T05:31:19.436 INFO:teuthology.orchestra.run.smithi067.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-19T05:31:19.436 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-19T05:31:19.436 INFO:teuthology.orchestra.run.smithi067.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-19T05:31:19.437 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2024-09-19T05:31:19.437 INFO:teuthology.orchestra.run.smithi067.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-19T05:31:19.437 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-19T05:31:19.437 INFO:teuthology.orchestra.run.smithi067.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-19T05:31:19.481 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2024-09-19T05:31:19.481 INFO:teuthology.orchestra.run.smithi067.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-19T05:31:19.482 INFO:teuthology.orchestra.run.smithi067.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-19T05:31:19.483 INFO:teuthology.orchestra.run.smithi067.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-19T05:31:19.483 INFO:teuthology.orchestra.run.smithi067.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-19T05:31:19.483 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-19T05:31:19.483 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-19T05:31:19.483 INFO:teuthology.orchestra.run.smithi067.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-19T05:31:19.484 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages will be upgraded: 2024-09-19T05:31:19.484 INFO:teuthology.orchestra.run.smithi067.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-19T05:31:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-19T05:31:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-19T05:31:19.667 INFO:teuthology.orchestra.run.smithi067.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-19T05:31:19.667 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 55.8 MB of archives. 2024-09-19T05:31:19.668 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-19T05:31:19.668 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-19T05:31:19.812 INFO:teuthology.orchestra.run.smithi097.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-19T05:31:19.812 INFO:teuthology.orchestra.run.smithi097.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-19T05:31:19.812 INFO:teuthology.orchestra.run.smithi097.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-19T05:31:19.812 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T05:31:19.812 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T05:31:19.812 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T05:31:19.812 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T05:31:19.814 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T05:31:19.814 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T05:31:19.814 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T05:31:19.814 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-09-19T05:31:19.814 INFO:teuthology.orchestra.run.smithi097.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-19T05:31:19.815 INFO:teuthology.orchestra.run.smithi097.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-19T05:31:19.816 INFO:teuthology.orchestra.run.smithi097.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-19T05:31:19.816 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-19T05:31:19.816 INFO:teuthology.orchestra.run.smithi097.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-19T05:31:19.816 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-09-19T05:31:19.816 INFO:teuthology.orchestra.run.smithi097.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-19T05:31:19.816 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-19T05:31:19.816 INFO:teuthology.orchestra.run.smithi097.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-19T05:31:19.858 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-09-19T05:31:19.858 INFO:teuthology.orchestra.run.smithi097.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-19T05:31:19.858 INFO:teuthology.orchestra.run.smithi097.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-19T05:31:19.859 INFO:teuthology.orchestra.run.smithi097.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-19T05:31:19.859 INFO:teuthology.orchestra.run.smithi097.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-19T05:31:19.859 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-19T05:31:19.859 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-19T05:31:19.859 INFO:teuthology.orchestra.run.smithi097.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-19T05:31:19.860 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-09-19T05:31:19.861 INFO:teuthology.orchestra.run.smithi097.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-19T05:31:19.913 INFO:teuthology.orchestra.run.smithi097.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-19T05:31:19.913 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 55.8 MB of archives. 2024-09-19T05:31:19.913 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-19T05:31:19.914 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-19T05:31:20.046 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-19T05:31:20.053 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-19T05:31:20.092 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-19T05:31:20.092 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-19T05:31:20.093 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-19T05:31:20.104 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-19T05:31:20.104 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-19T05:31:20.106 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-19T05:31:20.108 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-19T05:31:20.108 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-19T05:31:20.110 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-19T05:31:20.111 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-19T05:31:20.127 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-19T05:31:20.128 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-19T05:31:20.129 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-19T05:31:20.289 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-19T05:31:20.305 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-19T05:31:20.405 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-19T05:31:20.406 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-19T05:31:20.407 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-19T05:31:20.429 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-19T05:31:20.430 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-19T05:31:20.432 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-19T05:31:20.460 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-19T05:31:20.461 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-19T05:31:20.465 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-19T05:31:20.467 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-19T05:31:20.467 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-19T05:31:20.468 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-19T05:31:20.468 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-19T05:31:20.471 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-19T05:31:20.471 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-19T05:31:20.472 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-19T05:31:20.479 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-19T05:31:20.479 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-19T05:31:20.499 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-19T05:31:20.499 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-19T05:31:20.507 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-19T05:31:20.525 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-19T05:31:20.528 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-19T05:31:20.528 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-19T05:31:20.529 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-19T05:31:20.529 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-19T05:31:20.533 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-19T05:31:20.534 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-19T05:31:20.535 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-19T05:31:20.539 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-19T05:31:20.540 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-19T05:31:20.615 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-19T05:31:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-19T05:31:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-19T05:31:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-19T05:31:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-19T05:31:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-19T05:31:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-19T05:31:20.759 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-19T05:31:20.759 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-19T05:31:21.170 INFO:teuthology.orchestra.run.smithi097.stdout:Preconfiguring packages ... 2024-09-19T05:31:21.339 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 55.8 MB in 1s (62.6 MB/s) 2024-09-19T05:31:21.432 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-19T05:31:21.437 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-19T05:31:21.438 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-19T05:31:21.444 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-19T05:31:21.444 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-19T05:31:21.455 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-19T05:31:21.459 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-19T05:31:21.477 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-19T05:31:21.477 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-19T05:31:21.546 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-19T05:31:21.562 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-19T05:31:21.588 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-19T05:31:21.597 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-19T05:31:21.602 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-19T05:31:21.653 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-19T05:31:21.660 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-19T05:31:21.661 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-19T05:31:21.662 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-19T05:31:21.664 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-19T05:31:21.696 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-19T05:31:21.700 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-19T05:31:21.743 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-19T05:31:22.241 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-19T05:31:22.242 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-19T05:31:22.242 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-19T05:31:22.242 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-19T05:31:22.243 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-19T05:31:22.243 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-19T05:31:22.268 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-19T05:31:22.268 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-19T05:31:22.522 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-19T05:31:22.703 INFO:teuthology.orchestra.run.smithi067.stdout:Preconfiguring packages ... 2024-09-19T05:31:22.840 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 55.8 MB in 3s (20.1 MB/s) 2024-09-19T05:31:23.140 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-19T05:31:23.146 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-19T05:31:23.282 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-19T05:31:23.477 INFO:teuthology.orchestra.run.smithi097.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-19T05:31:23.722 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package flex. 2024-09-19T05:31:23.819 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-19T05:31:23.825 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-19T05:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-19T05:31:23.928 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-19T05:31:24.404 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-19T05:31:24.577 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-19T05:31:24.866 INFO:teuthology.orchestra.run.smithi067.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-19T05:31:25.004 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-19T05:31:25.112 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package flex. 2024-09-19T05:31:25.215 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-19T05:31:25.221 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-19T05:31:25.260 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-19T05:31:25.552 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-19T05:31:25.557 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-19T05:31:25.659 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-19T05:31:25.768 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-19T05:31:25.949 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-19T05:31:26.185 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-19T05:31:26.326 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-19T05:31:26.360 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-19T05:31:26.645 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-19T05:31:27.060 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package bison. 2024-09-19T05:31:27.151 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-19T05:31:27.156 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-19T05:31:27.165 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-19T05:31:27.171 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-19T05:31:27.212 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-19T05:31:27.283 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-19T05:31:27.709 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-19T05:31:27.779 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-19T05:31:27.807 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-19T05:31:27.831 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-19T05:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-19T05:31:28.199 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package dump. 2024-09-19T05:31:28.200 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-19T05:31:28.227 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-19T05:31:28.266 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking dump (0.4b47-3) ... 2024-09-19T05:31:28.557 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package bison. 2024-09-19T05:31:28.578 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package indent. 2024-09-19T05:31:28.605 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-19T05:31:28.665 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-19T05:31:28.671 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-19T05:31:28.726 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-19T05:31:28.964 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-19T05:31:28.991 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-19T05:31:29.038 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-19T05:31:29.135 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-19T05:31:29.163 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-19T05:31:29.201 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-19T05:31:29.376 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-19T05:31:29.405 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-19T05:31:29.443 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-19T05:31:29.521 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package dump. 2024-09-19T05:31:29.549 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-19T05:31:29.579 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking dump (0.4b47-3) ... 2024-09-19T05:31:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-19T05:31:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-19T05:31:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-19T05:31:29.858 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package indent. 2024-09-19T05:31:29.886 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:29.925 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-19T05:31:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-19T05:31:30.202 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-19T05:31:30.240 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-19T05:31:30.244 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-19T05:31:30.268 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-19T05:31:30.315 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-19T05:31:30.573 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-19T05:31:30.593 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-19T05:31:30.601 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-19T05:31:30.620 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-19T05:31:30.639 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-19T05:31:30.659 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-19T05:31:30.892 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-19T05:31:30.895 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjson-perl. 2024-09-19T05:31:30.909 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-19T05:31:30.911 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-19T05:31:30.950 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-19T05:31:30.953 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-19T05:31:31.279 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-19T05:31:31.307 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-19T05:31:31.346 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-19T05:31:31.606 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-19T05:31:31.615 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-19T05:31:31.657 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-19T05:31:31.733 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-19T05:31:31.761 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-19T05:31:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-19T05:31:31.934 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjson-perl. 2024-09-19T05:31:31.951 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-19T05:31:31.992 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-19T05:31:32.321 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-19T05:31:32.348 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-19T05:31:32.387 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-19T05:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-19T05:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-19T05:31:33.577 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-19T05:31:33.821 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-19T05:31:33.837 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-19T05:31:33.871 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-19T05:31:34.107 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-19T05:31:34.135 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-19T05:31:34.174 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-19T05:31:34.182 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-19T05:31:34.210 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-19T05:31:34.249 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-19T05:31:34.410 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-19T05:31:34.427 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-19T05:31:34.460 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-19T05:31:34.594 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-19T05:31:34.622 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-19T05:31:34.662 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-19T05:31:34.747 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-19T05:31:34.775 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-19T05:31:34.813 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-19T05:31:34.972 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-19T05:31:35.005 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-19T05:31:35.038 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-19T05:31:35.185 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-19T05:31:35.211 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-19T05:31:35.249 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-19T05:31:35.360 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-19T05:31:35.388 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:35.427 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:35.543 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-19T05:31:35.561 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-19T05:31:35.602 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-19T05:31:35.746 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-19T05:31:35.774 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:35.813 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-19T05:31:35.913 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-19T05:31:35.942 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:35.979 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:36.082 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-19T05:31:36.098 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:36.132 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-19T05:31:36.332 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-19T05:31:36.361 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:36.385 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-19T05:31:36.407 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-19T05:31:36.412 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-19T05:31:36.451 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-19T05:31:36.721 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-19T05:31:36.747 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:36.785 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-19T05:31:36.987 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-19T05:31:37.004 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-19T05:31:37.023 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-19T05:31:37.037 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-19T05:31:37.052 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-19T05:31:37.106 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-19T05:31:37.477 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package modemmanager. 2024-09-19T05:31:37.504 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-19T05:31:37.533 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-19T05:31:37.543 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-19T05:31:37.562 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-19T05:31:37.600 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-19T05:31:37.969 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package modemmanager. 2024-09-19T05:31:37.997 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-19T05:31:38.035 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-19T05:31:38.192 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager. 2024-09-19T05:31:38.220 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-19T05:31:38.267 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-19T05:31:38.968 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ppp. 2024-09-19T05:31:38.994 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-19T05:31:39.236 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package network-manager. 2024-09-19T05:31:39.261 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-19T05:31:39.264 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-19T05:31:39.312 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-19T05:31:39.596 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pptp-linux. 2024-09-19T05:31:39.624 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-19T05:31:39.663 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-19T05:31:39.868 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ppp. 2024-09-19T05:31:39.896 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-19T05:31:39.907 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-19T05:31:39.924 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-19T05:31:39.957 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-19T05:31:40.155 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-19T05:31:40.236 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-19T05:31:40.263 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-19T05:31:40.302 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client-common (238) ... 2024-09-19T05:31:40.506 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package pptp-linux. 2024-09-19T05:31:40.535 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-19T05:31:40.573 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-19T05:31:40.589 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-19T05:31:40.617 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:40.672 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:40.825 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-19T05:31:40.842 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-19T05:31:40.884 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-19T05:31:41.153 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-19T05:31:41.170 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-19T05:31:41.203 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client-common (238) ... 2024-09-19T05:31:41.219 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-common. 2024-09-19T05:31:41.248 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-19T05:31:41.296 INFO:teuthology.orchestra.run.smithi097.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-19T05:31:41.326 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-common (238) ... 2024-09-19T05:31:41.524 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-19T05:31:41.552 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:41.590 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:41.768 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-14. 2024-09-19T05:31:41.796 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:41.837 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:42.203 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-common. 2024-09-19T05:31:42.232 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-19T05:31:42.289 INFO:teuthology.orchestra.run.smithi067.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-19T05:31:42.318 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-common (238) ... 2024-09-19T05:31:42.744 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-14. 2024-09-19T05:31:42.772 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-19T05:31:42.814 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:43.131 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql. 2024-09-19T05:31:43.148 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-19T05:31:43.181 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql (14+238) ... 2024-09-19T05:31:43.399 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client. 2024-09-19T05:31:43.416 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-19T05:31:43.535 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client (14+238) ... 2024-09-19T05:31:43.802 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-19T05:31:43.818 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-19T05:31:43.868 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-19T05:31:44.188 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tcl8.6. 2024-09-19T05:31:44.205 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql. 2024-09-19T05:31:44.216 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-19T05:31:44.222 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-19T05:31:44.263 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-19T05:31:44.263 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql (14+238) ... 2024-09-19T05:31:44.498 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client. 2024-09-19T05:31:44.515 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tcl. 2024-09-19T05:31:44.516 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-19T05:31:44.532 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-19T05:31:44.548 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client (14+238) ... 2024-09-19T05:31:44.571 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-19T05:31:44.767 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-19T05:31:44.784 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-19T05:31:44.826 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-19T05:31:44.905 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package wpasupplicant. 2024-09-19T05:31:44.929 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-19T05:31:44.968 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-19T05:31:45.145 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package tcl8.6. 2024-09-19T05:31:45.174 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-19T05:31:45.211 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-19T05:31:45.331 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-19T05:31:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-19T05:31:45.397 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-19T05:31:45.489 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package tcl. 2024-09-19T05:31:45.518 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-19T05:31:45.561 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-19T05:31:45.734 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-19T05:31:45.762 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-19T05:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-19T05:31:45.908 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package wpasupplicant. 2024-09-19T05:31:45.937 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-19T05:31:45.975 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-19T05:31:46.080 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client-common (238) ... 2024-09-19T05:31:46.290 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-19T05:31:46.356 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-19T05:31:46.373 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-19T05:31:46.414 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-19T05:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-19T05:31:46.542 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:46.668 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-19T05:31:46.769 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-19T05:31:46.776 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-19T05:31:46.804 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-19T05:31:46.851 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-19T05:31:46.879 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:47.147 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client-common (238) ... 2024-09-19T05:31:47.357 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-19T05:31:47.397 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-19T05:31:47.483 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-19T05:31:47.492 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-19T05:31:47.609 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:47.726 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-19T05:31:47.844 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-19T05:31:47.872 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-19T05:31:47.873 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-19T05:31:47.970 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:48.338 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-19T05:31:48.464 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-19T05:31:48.548 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-19T05:31:48.606 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-19T05:31:48.642 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-19T05:31:48.732 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-19T05:31:48.864 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-19T05:31:48.984 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-19T05:31:49.004 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-19T05:31:49.004 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-19T05:31:49.102 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-19T05:31:49.211 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-19T05:31:49.562 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-19T05:31:49.688 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-19T05:31:49.817 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-19T05:31:49.841 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-19T05:31:49.940 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-19T05:31:49.967 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up dump (0.4b47-3) ... 2024-09-19T05:31:50.061 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-19T05:31:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-19T05:31:50.192 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-19T05:31:50.279 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-19T05:31:50.310 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-19T05:31:50.379 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-19T05:31:50.428 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-19T05:31:50.496 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-19T05:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-19T05:31:50.748 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-19T05:31:50.838 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-19T05:31:50.900 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-19T05:31:51.017 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-19T05:31:51.066 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-19T05:31:51.192 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up dump (0.4b47-3) ... 2024-09-19T05:31:51.193 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-19T05:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-19T05:31:51.477 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-19T05:31:51.479 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-19T05:31:51.543 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-19T05:31:51.647 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client (14+238) ... 2024-09-19T05:31:51.670 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-19T05:31:51.773 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-19T05:31:51.821 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-19T05:31:51.922 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-19T05:31:52.023 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-19T05:31:52.105 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-19T05:31:52.166 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-19T05:31:52.292 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-19T05:31:52.468 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-19T05:31:52.487 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:31:52.487 INFO:teuthology.orchestra.run.smithi097.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-19T05:31:52.488 INFO:teuthology.orchestra.run.smithi097.stdout:which means they are currently configured by ifupdown: 2024-09-19T05:31:52.488 INFO:teuthology.orchestra.run.smithi097.stdout:- enp3s0f1 2024-09-19T05:31:52.488 INFO:teuthology.orchestra.run.smithi097.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-19T05:31:52.488 INFO:teuthology.orchestra.run.smithi097.stdout:remove their configuration from /etc/network/interfaces. 2024-09-19T05:31:52.488 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:31:52.594 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-19T05:31:52.623 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-19T05:31:52.720 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-19T05:31:52.880 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client (14+238) ... 2024-09-19T05:31:52.977 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-19T05:31:52.989 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-19T05:31:53.328 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-19T05:31:53.446 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:31:53.446 INFO:teuthology.orchestra.run.smithi067.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-19T05:31:53.446 INFO:teuthology.orchestra.run.smithi067.stdout:which means they are currently configured by ifupdown: 2024-09-19T05:31:53.447 INFO:teuthology.orchestra.run.smithi067.stdout:- enp3s0f1 2024-09-19T05:31:53.447 INFO:teuthology.orchestra.run.smithi067.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-19T05:31:53.447 INFO:teuthology.orchestra.run.smithi067.stdout:remove their configuration from /etc/network/interfaces. 2024-09-19T05:31:53.447 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:31:53.586 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-19T05:31:53.826 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-19T05:31:53.901 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-19T05:31:53.969 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-19T05:31:54.070 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-19T05:31:54.197 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-common (238) ... 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-19T05:31:54.708 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-19T05:31:54.860 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-19T05:31:54.969 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-19T05:31:55.071 INFO:teuthology.orchestra.run.smithi097.stdout:Adding user postgres to group ssl-cert 2024-09-19T05:31:55.095 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-common (238) ... 2024-09-19T05:31:55.288 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:31:55.288 INFO:teuthology.orchestra.run.smithi097.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-19T05:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-19T05:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout:Removing obsolete dictionary files: 2024-09-19T05:31:56.015 INFO:teuthology.orchestra.run.smithi067.stdout:Adding user postgres to group ssl-cert 2024-09-19T05:31:56.024 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-19T05:31:56.235 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:31:56.236 INFO:teuthology.orchestra.run.smithi067.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-19T05:31:56.415 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:56.432 INFO:teuthology.orchestra.run.smithi067.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-19T05:31:56.433 INFO:teuthology.orchestra.run.smithi067.stdout:Removing obsolete dictionary files: 2024-09-19T05:31:56.745 INFO:teuthology.orchestra.run.smithi097.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-19T05:31:56.765 INFO:teuthology.orchestra.run.smithi097.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-19T05:31:56.807 INFO:teuthology.orchestra.run.smithi097.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-19T05:31:56.807 INFO:teuthology.orchestra.run.smithi097.stdout:This user must also own the server process. 2024-09-19T05:31:56.808 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:31:56.808 INFO:teuthology.orchestra.run.smithi097.stdout:The database cluster will be initialized with locale "en_US". 2024-09-19T05:31:56.808 INFO:teuthology.orchestra.run.smithi097.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-19T05:31:56.808 INFO:teuthology.orchestra.run.smithi097.stdout:The default text search configuration will be set to "english". 2024-09-19T05:31:56.808 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:31:56.809 INFO:teuthology.orchestra.run.smithi097.stdout:Data page checksums are disabled. 2024-09-19T05:31:56.809 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:31:56.809 INFO:teuthology.orchestra.run.smithi097.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-19T05:31:56.809 INFO:teuthology.orchestra.run.smithi097.stdout:creating subdirectories ... ok 2024-09-19T05:31:56.809 INFO:teuthology.orchestra.run.smithi097.stdout:selecting dynamic shared memory implementation ... posix 2024-09-19T05:31:56.823 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default max_connections ... 100 2024-09-19T05:31:56.842 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default shared_buffers ... 128MB 2024-09-19T05:31:56.850 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default time zone ... Etc/UTC 2024-09-19T05:31:56.850 INFO:teuthology.orchestra.run.smithi097.stdout:creating configuration files ... ok 2024-09-19T05:31:56.962 INFO:teuthology.orchestra.run.smithi097.stdout:running bootstrap script ... ok 2024-09-19T05:31:57.006 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-19T05:31:57.405 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-19T05:31:57.600 INFO:teuthology.orchestra.run.smithi097.stdout:performing post-bootstrap initialization ... ok 2024-09-19T05:31:57.743 INFO:teuthology.orchestra.run.smithi067.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-19T05:31:57.762 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-19T05:31:57.801 INFO:teuthology.orchestra.run.smithi067.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-19T05:31:57.801 INFO:teuthology.orchestra.run.smithi067.stdout:This user must also own the server process. 2024-09-19T05:31:57.802 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:31:57.802 INFO:teuthology.orchestra.run.smithi067.stdout:The database cluster will be initialized with locale "en_US". 2024-09-19T05:31:57.802 INFO:teuthology.orchestra.run.smithi067.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-19T05:31:57.802 INFO:teuthology.orchestra.run.smithi067.stdout:The default text search configuration will be set to "english". 2024-09-19T05:31:57.802 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:31:57.802 INFO:teuthology.orchestra.run.smithi067.stdout:Data page checksums are disabled. 2024-09-19T05:31:57.802 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:31:57.802 INFO:teuthology.orchestra.run.smithi067.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-19T05:31:57.802 INFO:teuthology.orchestra.run.smithi067.stdout:creating subdirectories ... ok 2024-09-19T05:31:57.803 INFO:teuthology.orchestra.run.smithi067.stdout:selecting dynamic shared memory implementation ... posix 2024-09-19T05:31:57.815 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default max_connections ... 100 2024-09-19T05:31:57.833 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default shared_buffers ... 128MB 2024-09-19T05:31:57.843 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default time zone ... Etc/UTC 2024-09-19T05:31:57.844 INFO:teuthology.orchestra.run.smithi067.stdout:creating configuration files ... ok 2024-09-19T05:31:57.956 INFO:teuthology.orchestra.run.smithi067.stdout:running bootstrap script ... ok 2024-09-19T05:31:58.260 INFO:teuthology.orchestra.run.smithi097.stdout:syncing data to disk ... ok 2024-09-19T05:31:58.604 INFO:teuthology.orchestra.run.smithi067.stdout:performing post-bootstrap initialization ... ok 2024-09-19T05:31:58.627 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-19T05:31:59.207 INFO:teuthology.orchestra.run.smithi067.stdout:syncing data to disk ... ok 2024-09-19T05:31:59.590 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-19T05:32:01.488 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-19T05:32:01.614 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-19T05:32:01.740 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql (14+238) ... 2024-09-19T05:32:01.869 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-19T05:32:01.984 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-19T05:32:02.228 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-19T05:32:02.229 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-19T05:32:02.353 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-19T05:32:02.481 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-19T05:32:02.580 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql (14+238) ... 2024-09-19T05:32:02.684 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-19T05:32:02.753 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-19T05:32:02.790 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-19T05:32:02.846 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-19T05:32:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-19T05:32:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-19T05:32:03.115 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-19T05:32:03.266 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T05:32:03.601 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-19T05:32:03.694 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-19T05:32:03.979 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-19T05:32:04.131 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T05:32:05.036 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-19T05:32:05.128 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-19T05:32:05.509 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-19T05:32:05.608 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-19T05:32:05.627 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T05:32:05.632 DEBUG:teuthology.parallel:result is None 2024-09-19T05:32:06.140 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T05:32:06.145 DEBUG:teuthology.parallel:result is None 2024-09-19T05:32:06.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:32:06.290 DEBUG:teuthology.orchestra.run.smithi067:> dpkg-query -W -f '${Version}' ceph 2024-09-19T05:32:06.309 INFO:teuthology.orchestra.run.smithi067.stdout:19.1.1-361-g2f599a46-1jammy 2024-09-19T05:32:06.310 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361-g2f599a46-1jammy 2024-09-19T05:32:06.310 INFO:teuthology.task.install:The correct ceph version 19.1.1-361-g2f599a46-1jammy is installed. 2024-09-19T05:32:06.312 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:32:06.451 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-query -W -f '${Version}' ceph 2024-09-19T05:32:06.470 INFO:teuthology.orchestra.run.smithi097.stdout:19.1.1-361-g2f599a46-1jammy 2024-09-19T05:32:06.471 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361-g2f599a46-1jammy 2024-09-19T05:32:06.471 INFO:teuthology.task.install:The correct ceph version 19.1.1-361-g2f599a46-1jammy is installed. 2024-09-19T05:32:06.473 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T05:32:06.473 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:06.473 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:32:06.488 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:06.488 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:32:06.523 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T05:32:06.523 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:06.523 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:32:06.543 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:32:06.598 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:06.599 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:32:06.612 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:32:06.667 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T05:32:06.667 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:06.667 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:32:06.680 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:32:06.735 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:06.736 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:32:06.748 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:32:06.802 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T05:32:06.802 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:06.802 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:32:06.816 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:32:06.871 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:06.871 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:32:06.884 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:32:06.939 INFO:teuthology.run_tasks:Running task ceph... 2024-09-19T05:32:07.021 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-19T05:32:07.022 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2024-09-19T05:32:07.024 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2024-09-19T05:32:07.036 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-19T05:32:07.036 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T05:32:07.080 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T05:32:07.092 INFO:tasks.ceph:Creating extra log directories... 2024-09-19T05:32:07.092 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T05:32:07.136 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T05:32:07.156 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-19T05:32:07.156 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-19T05:32:07.156 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-19T05:32:07.156 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:07.157 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T05:32:07.201 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T05:32:07.275 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:07.275 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T05:32:07.281 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T05:32:07.360 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-19T05:32:07.361 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-19T05:32:07.361 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7911672', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1747, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'sleep_before_teardown': 0, 'subset': '176/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi067.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI8tn7N/CisrSYcsE9GZpZbAJnfEuIUfdUYQsi6ik45XAXGSbmH5oSoAT34lz3jl3/yIC5xXrdT30x0GcgvoIUo=', 'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTdmhxZGF9R3FoMK79r+AhYECsEgg/tDECnXzCZmdKuom7tJe3c5xuQyf4b7wpyDzAS5N3TxlXMt2k+sehWphg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-18_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-19T05:32:07.362 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T05:32:07.364 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T05:32:07.400 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T05:32:07.412 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T05:32:07.457 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:07.457 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:32:07.472 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:32:07.472 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-09-19T05:32:07.520 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:32:07.520 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:32:07.520 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-09-19T05:32:07.521 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:32:07.521 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-19 05:25:51.951990091 +0000 2024-09-19T05:32:07.521 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-19 05:25:51.703992306 +0000 2024-09-19T05:32:07.521 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-19 05:25:51.703992306 +0000 2024-09-19T05:32:07.521 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2024-09-19T05:32:07.522 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:32:07.574 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:32:07.574 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:32:07.575 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000464227 s, 1.1 MB/s 2024-09-19T05:32:07.576 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:32:07.625 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-09-19T05:32:07.671 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:32:07.671 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:32:07.671 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-19T05:32:07.671 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:32:07.671 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-19 05:25:52.411985981 +0000 2024-09-19T05:32:07.671 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-19 05:25:52.179988054 +0000 2024-09-19T05:32:07.671 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-19 05:25:52.179988054 +0000 2024-09-19T05:32:07.671 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2024-09-19T05:32:07.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:32:07.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:32:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:32:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000342108 s, 1.5 MB/s 2024-09-19T05:32:07.730 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:32:07.776 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-09-19T05:32:07.823 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:32:07.823 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:32:07.823 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-19T05:32:07.823 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:32:07.823 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-19 05:25:52.935981301 +0000 2024-09-19T05:32:07.823 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-19 05:25:52.691983481 +0000 2024-09-19T05:32:07.823 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-19 05:25:52.691983481 +0000 2024-09-19T05:32:07.824 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2024-09-19T05:32:07.824 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:32:07.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:32:07.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:32:07.877 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000401832 s, 1.3 MB/s 2024-09-19T05:32:07.878 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:32:07.929 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-09-19T05:32:07.975 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:32:07.976 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:32:07.976 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-09-19T05:32:07.976 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:32:07.976 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-19 05:25:53.427976907 +0000 2024-09-19T05:32:07.976 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-19 05:25:53.147979408 +0000 2024-09-19T05:32:07.976 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-19 05:25:53.147979408 +0000 2024-09-19T05:32:07.976 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2024-09-19T05:32:07.976 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:32:08.030 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:32:08.030 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:32:08.030 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000327539 s, 1.6 MB/s 2024-09-19T05:32:08.032 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:32:08.080 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T05:32:08.081 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:08.081 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:32:08.087 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:32:08.087 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2024-09-19T05:32:08.136 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:32:08.136 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:32:08.137 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-19T05:32:08.137 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:32:08.137 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-19 05:25:47.129137474 +0000 2024-09-19T05:32:08.137 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-19 05:25:46.901139507 +0000 2024-09-19T05:32:08.137 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-19 05:25:46.901139507 +0000 2024-09-19T05:32:08.137 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-19T05:32:08.137 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:32:08.191 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-19T05:32:08.191 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-19T05:32:08.191 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000443517 s, 1.2 MB/s 2024-09-19T05:32:08.192 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:32:08.242 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2024-09-19T05:32:08.288 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:32:08.288 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:32:08.288 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-19T05:32:08.288 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:32:08.288 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-19 05:25:47.609133198 +0000 2024-09-19T05:32:08.288 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-19 05:25:47.365135373 +0000 2024-09-19T05:32:08.288 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-19 05:25:47.365135373 +0000 2024-09-19T05:32:08.289 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-19T05:32:08.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:32:08.343 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-19T05:32:08.343 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-19T05:32:08.343 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000388917 s, 1.3 MB/s 2024-09-19T05:32:08.344 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:32:08.393 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2024-09-19T05:32:08.440 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:32:08.440 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:32:08.440 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-19T05:32:08.441 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:32:08.441 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-19 05:25:48.089128922 +0000 2024-09-19T05:32:08.441 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-19 05:25:47.841131132 +0000 2024-09-19T05:32:08.441 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-19 05:25:47.841131132 +0000 2024-09-19T05:32:08.441 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-19T05:32:08.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:32:08.494 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-19T05:32:08.494 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-19T05:32:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000428052 s, 1.2 MB/s 2024-09-19T05:32:08.495 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:32:08.545 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2024-09-19T05:32:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:32:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:32:08.592 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-19T05:32:08.592 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:32:08.592 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-19 05:25:48.625124147 +0000 2024-09-19T05:32:08.592 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-19 05:25:48.365126463 +0000 2024-09-19T05:32:08.592 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-19 05:25:48.365126463 +0000 2024-09-19T05:32:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-19T05:32:08.593 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:32:08.646 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-19T05:32:08.646 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-19T05:32:08.646 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000327139 s, 1.6 MB/s 2024-09-19T05:32:08.647 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:32:08.697 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T05:32:08.698 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T05:32:08.698 INFO:tasks.ceph:Generating config... 2024-09-19T05:32:08.699 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-19T05:32:08.699 INFO:tasks.ceph:[client] debug client = 20 2024-09-19T05:32:08.699 INFO:tasks.ceph:[client] debug ms = 1 2024-09-19T05:32:08.699 INFO:tasks.ceph:[client] pid file = 2024-09-19T05:32:08.700 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-19T05:32:08.700 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-19T05:32:08.700 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-19T05:32:08.700 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-19T05:32:08.700 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-19T05:32:08.700 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-09-19T05:32:08.700 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-19T05:32:08.700 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-19T05:32:08.700 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-09-19T05:32:08.700 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-19T05:32:08.700 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-19T05:32:08.701 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-19T05:32:08.702 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-19T05:32:08.703 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-19T05:32:08.703 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-19T05:32:08.703 INFO:tasks.ceph:Setting up mon.a... 2024-09-19T05:32:08.703 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-19T05:32:08.737 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.keyring 2024-09-19T05:32:08.746 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-19T05:32:08.825 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T05:32:08.879 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.67'), ('mon.b', '172.21.15.97'), ('mon.c', '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]')] 2024-09-19T05:32:08.879 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.67,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-19T05:32:08.880 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:08.880 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T05:32:08.928 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.67 --add b 172.21.15.97 --addv c '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: generated fsid dd76f598-8c3d-42aa-abf8-24c2f9728b78 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:setting min_mon_release = quincy 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 0 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:fsid dd76f598-8c3d-42aa-abf8-24c2f9728b78 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:last_changed 2024-09-19T05:32:09.017495+0000 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-09-19T05:32:09.017495+0000 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:min_mon_release 17 (quincy) 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:election_strategy: 1 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-19T05:32:09.016 INFO:teuthology.orchestra.run.smithi067.stdout:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-19T05:32:09.017 INFO:teuthology.orchestra.run.smithi067.stdout:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-19T05:32:09.017 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-19T05:32:09.018 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T05:32:09.023 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dd76f598-8c3d-42aa-abf8-24c2f9728b78... 2024-09-19T05:32:09.024 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T05:32:09.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T05:32:09.093 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-09-19T05:32:09.093 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2024-09-19T05:32:09.093 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T05:32:09.093 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2024-09-19T05:32:09.093 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.093 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T05:32:09.094 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2024-09-19T05:32:09.095 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.67,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]" 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = dd76f598-8c3d-42aa-abf8-24c2f9728b78 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2024-09-19T05:32:09.096 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug trim objects = true 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.097 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2024-09-19T05:32:09.098 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 20 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 20 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 10 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.099 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2024-09-19T05:32:09.100 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T05:32:09.101 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: mon down mkfs grace = 300 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on pool no app = False 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T05:32:09.102 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = "" 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2024-09-19T05:32:09.103 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds balancer = 20 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: mds cache max size = 1000 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: mds log max segments = 1 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = True 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-09-19T05:32:09.104 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-09-19T05:32:09.105 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-09-19T05:32:09.105 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-09-19T05:32:09.105 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T05:32:09.105 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-09-19T05:32:09.105 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.105 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-09-19T05:32:09.105 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.105 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-09-19T05:32:09.105 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-09-19T05:32:09.106 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-09-19T05:32:09.107 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.67,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]" 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = dd76f598-8c3d-42aa-abf8-24c2f9728b78 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-09-19T05:32:09.108 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.109 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 20 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 20 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:32:09.110 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 10 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:32:09.111 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:32:09.112 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-09-19T05:32:09.112 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-09-19T05:32:09.112 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.112 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-09-19T05:32:09.112 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:32:09.112 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-19T05:32:09.112 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-09-19T05:32:09.112 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-19T05:32:09.112 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-09-19T05:32:09.112 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-09-19T05:32:09.113 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: mon down mkfs grace = 300 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: mon op complaint time = 120 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on pool no app = False 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: client mount timeout = 600 2024-09-19T05:32:09.114 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = "" 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout:[mds] 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds = 20 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds balancer = 20 2024-09-19T05:32:09.115 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:32:09.116 INFO:teuthology.orchestra.run.smithi097.stdout: mds cache max size = 1000 2024-09-19T05:32:09.116 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug frag = True 2024-09-19T05:32:09.116 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug scatterstat = True 2024-09-19T05:32:09.116 INFO:teuthology.orchestra.run.smithi097.stdout: mds log max segments = 1 2024-09-19T05:32:09.116 INFO:teuthology.orchestra.run.smithi097.stdout: mds op complaint time = 180 2024-09-19T05:32:09.116 INFO:teuthology.orchestra.run.smithi097.stdout: mds verify scatter = True 2024-09-19T05:32:09.116 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-09-19T05:32:09.116 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-09-19T05:32:09.116 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-09-19T05:32:09.117 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-19T05:32:09.118 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-19T05:32:09.204 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-19T05:32:09.205 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:09.205 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-19T05:32:09.210 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:09.210 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-19T05:32:09.255 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:32:09.255 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:09.255 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T05:32:09.256 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T05:32:09.321 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:09.321 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:09.367 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:32:09.367 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:09.367 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T05:32:09.367 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T05:32:09.390 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:09.390 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:09.437 INFO:tasks.ceph:Setting up mon nodes... 2024-09-19T05:32:09.437 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-19T05:32:09.437 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T05:32:09.481 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T05:32:09.484 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T05:32:09.528 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T05:32:09.542 INFO:tasks.ceph:Setting up mds nodes... 2024-09-19T05:32:09.543 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T05:32:09.583 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T05:32:09.586 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-19T05:32:09.642 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T05:32:09.728 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T05:32:09.731 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-19T05:32:09.786 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T05:32:09.830 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T05:32:09.833 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-19T05:32:09.887 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T05:32:09.970 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T05:32:09.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-19T05:32:10.028 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-19T05:32:10.028 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T05:32:10.065 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-19T05:32:10.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-19T05:32:10.153 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-19T05:32:10.162 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-19T05:32:10.198 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-19T05:32:10.208 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-19T05:32:10.283 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-19T05:32:10.294 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-19T05:32:10.295 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T05:32:10.295 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-19T05:32:10.309 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T05:32:10.309 INFO:tasks.ceph:role: osd.0 2024-09-19T05:32:10.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:32:10.309 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T05:32:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:32:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:32:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:32:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T05:32:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:32:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:32:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:32:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T05:32:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:32:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:32:10.820 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-19T05:32:10.822 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-19T05:32:10.823 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-19T05:32:10.919 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-19T05:32:10.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:32:10.931 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T05:32:10.931 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-19T05:32:10.986 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T05:32:10.986 INFO:tasks.ceph:role: osd.1 2024-09-19T05:32:10.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:32:10.986 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T05:32:11.052 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:32:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:32:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:32:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T05:32:11.052 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:32:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:32:11.052 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:32:11.053 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T05:32:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:32:11.053 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:32:11.516 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-19T05:32:11.518 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-19T05:32:11.519 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-19T05:32:11.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-19T05:32:11.689 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T05:32:11.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:32:11.691 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-19T05:32:11.747 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T05:32:11.748 INFO:tasks.ceph:role: osd.2 2024-09-19T05:32:11.748 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:32:11.748 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T05:32:11.811 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:32:11.811 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:32:11.811 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:32:11.811 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T05:32:11.811 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:32:11.811 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:32:11.811 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:32:11.811 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T05:32:11.811 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:32:11.811 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:32:12.297 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-19T05:32:12.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-19T05:32:12.300 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-19T05:32:12.448 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-19T05:32:12.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:32:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T05:32:12.463 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-19T05:32:12.521 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T05:32:12.521 INFO:tasks.ceph:role: osd.3 2024-09-19T05:32:12.521 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:32:12.521 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T05:32:12.583 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:32:12.583 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:32:12.583 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:32:12.583 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T05:32:12.583 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:32:12.583 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:32:12.583 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:32:12.583 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T05:32:12.584 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:32:12.584 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:32:13.004 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-19T05:32:13.006 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-19T05:32:13.006 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-19T05:32:13.111 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-19T05:32:13.121 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T05:32:13.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:32:13.122 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:13.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:13.233+0000 7fdc0b67e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-19T05:32:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:13.233+0000 7fdc0b67e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-19T05:32:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:13.233+0000 7fdc0b67e7c0 -1 bdev(0x55a7c5697800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-19T05:32:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:13.233+0000 7fdc0b67e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-19T05:32:16.376 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T05:32:16.390 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:16.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:16.469+0000 7f7787e537c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-19T05:32:16.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:16.473+0000 7f7787e537c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-19T05:32:16.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:16.473+0000 7f7787e537c0 -1 bdev(0x559596413800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-19T05:32:16.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:16.473+0000 7f7787e537c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-19T05:32:19.590 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T05:32:19.648 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:19.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:19.729+0000 7fda08e227c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-19T05:32:19.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:19.729+0000 7fda08e227c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-19T05:32:19.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:19.729+0000 7fda08e227c0 -1 bdev(0x55deb2309800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-19T05:32:19.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:19.729+0000 7fda08e227c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-19T05:32:22.854 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T05:32:22.912 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:23.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:22.996+0000 7f8759ab87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-19T05:32:23.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:22.996+0000 7f8759ab87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-19T05:32:23.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:22.996+0000 7f8759ab87c0 -1 bdev(0x559320eaf800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-19T05:32:23.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:22.996+0000 7f8759ab87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-19T05:32:26.139 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T05:32:26.196 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-19T05:32:26.211 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T05:32:26.211 INFO:tasks.ceph:role: osd.4 2024-09-19T05:32:26.212 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:32:26.212 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T05:32:26.275 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:32:26.275 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:32:26.275 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:32:26.275 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T05:32:26.276 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:32:26.276 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:32:26.276 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:32:26.276 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T05:32:26.276 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:32:26.276 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:32:26.725 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-19T05:32:26.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-19T05:32:26.727 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-19T05:32:26.817 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-19T05:32:26.868 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T05:32:26.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:32:26.870 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-19T05:32:26.923 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T05:32:26.924 INFO:tasks.ceph:role: osd.5 2024-09-19T05:32:26.924 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:32:26.924 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T05:32:26.988 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:32:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:32:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:32:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T05:32:26.988 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:32:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:32:26.988 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:32:26.988 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T05:32:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:32:26.989 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:32:27.456 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-19T05:32:27.459 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-19T05:32:27.459 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-19T05:32:27.632 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-19T05:32:27.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:32:27.644 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T05:32:27.645 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-19T05:32:27.700 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T05:32:27.700 INFO:tasks.ceph:role: osd.6 2024-09-19T05:32:27.700 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:32:27.700 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T05:32:27.767 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:32:27.767 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:32:27.767 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:32:27.767 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T05:32:27.767 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:32:27.767 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:32:27.767 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:32:27.767 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T05:32:27.767 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:32:27.768 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:32:28.245 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-19T05:32:28.247 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-19T05:32:28.247 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-19T05:32:28.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-19T05:32:28.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:32:28.415 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T05:32:28.415 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-19T05:32:28.472 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T05:32:28.472 INFO:tasks.ceph:role: osd.7 2024-09-19T05:32:28.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:32:28.473 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T05:32:28.535 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:32:28.535 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:32:28.535 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:32:28.535 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T05:32:28.535 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:32:28.535 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:32:28.535 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:32:28.535 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T05:32:28.536 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:32:28.536 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:32:28.958 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-19T05:32:28.960 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-19T05:32:28.960 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-19T05:32:29.056 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-19T05:32:29.065 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T05:32:29.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:32:29.067 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:29.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:29.190+0000 7f26df2777c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-19T05:32:29.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:29.190+0000 7f26df2777c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-19T05:32:29.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:29.190+0000 7f26df2777c0 -1 bdev(0x55b741d95800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-19T05:32:29.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:29.190+0000 7f26df2777c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-19T05:32:32.335 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T05:32:32.349 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:32.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:32.430+0000 7fc55a57f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-19T05:32:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:32.430+0000 7fc55a57f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-19T05:32:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:32.430+0000 7fc55a57f7c0 -1 bdev(0x557da4237800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-19T05:32:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:32.430+0000 7fc55a57f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-19T05:32:35.606 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T05:32:35.660 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:35.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:35.738+0000 7f360125c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-19T05:32:35.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:35.742+0000 7f360125c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-19T05:32:35.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:35.742+0000 7f360125c7c0 -1 bdev(0x55c79c267800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-19T05:32:35.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:35.742+0000 7f360125c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-19T05:32:37.363 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:32:37.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:32:38.870 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-19T05:32:38.884 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:38.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:38.962+0000 7f5a7ba1d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-19T05:32:38.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:38.962+0000 7f5a7ba1d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-19T05:32:38.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:38.962+0000 7f5a7ba1d7c0 -1 bdev(0x563b3d301800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-19T05:32:38.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:38.962+0000 7f5a7ba1d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-19T05:32:42.082 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-19T05:32:42.136 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-19T05:32:42.136 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:42.137 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-19T05:32:42.153 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:42.153 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-19T05:32:42.207 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:42.207 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-19T05:32:42.262 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:42.262 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-19T05:32:42.318 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:42.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-19T05:32:42.374 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:42.375 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-19T05:32:42.431 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:42.431 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-19T05:32:42.487 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:42.487 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-19T05:32:42.500 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:42.501 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-19T05:32:42.564 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:42.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-19T05:32:42.619 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:42.619 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-19T05:32:42.674 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:42.675 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-19T05:32:42.730 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:42.731 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-19T05:32:42.787 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:42.787 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-19T05:32:42.842 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:42.843 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-19T05:32:42.849 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:42.849 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-19T05:32:42.896 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:42.896 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-19T05:32:42.901 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:42.902 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-19T05:32:42.948 INFO:tasks.ceph:Adding keys to all mons... 2024-09-19T05:32:42.948 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T05:32:42.950 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T05:32:42.993 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg== 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw== 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg== 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw== 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg== 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A== 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2024-09-19T05:32:42.994 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g== 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg== 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig== 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw== 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A== 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg== 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ== 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ== 2024-09-19T05:32:42.995 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:32:42.996 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:32:42.996 INFO:teuthology.orchestra.run.smithi067.stdout:[client.2] 2024-09-19T05:32:42.996 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ== 2024-09-19T05:32:42.996 INFO:teuthology.orchestra.run.smithi067.stdout:[client.1] 2024-09-19T05:32:42.996 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g== 2024-09-19T05:32:42.996 INFO:teuthology.orchestra.run.smithi067.stdout:[client.3] 2024-09-19T05:32:42.996 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg== 2024-09-19T05:32:43.002 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.y] 2024-09-19T05:32:43.002 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg== 2024-09-19T05:32:43.002 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2024-09-19T05:32:43.002 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw== 2024-09-19T05:32:43.002 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2024-09-19T05:32:43.002 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg== 2024-09-19T05:32:43.002 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2024-09-19T05:32:43.002 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw== 2024-09-19T05:32:43.002 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2024-09-19T05:32:43.002 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg== 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A== 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g== 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg== 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig== 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw== 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.4] 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A== 2024-09-19T05:32:43.003 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.5] 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg== 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.6] 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ== 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.7] 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ== 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout:[client.2] 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ== 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g== 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout:[client.3] 2024-09-19T05:32:43.004 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg== 2024-09-19T05:32:43.005 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T05:32:43.040 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T05:32:43.093 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:32:43.095 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:32:43.140 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:32:43.184 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:32:43.230 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.272 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.320 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.401 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.488 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.492 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.531 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T05:32:43.576 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T05:32:43.616 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:32:43.664 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:32:43.711 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:32:43.752 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:32:43.806 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.841 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.882 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:43.970 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:44.008 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:44.060 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:44.092 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:32:44.135 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T05:32:44.176 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T05:32:44.225 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T05:32:44.227 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T05:32:44.270 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T05:32:44.316 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T05:32:44.363 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T05:32:44.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T05:32:44.444 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-19T05:32:44.444 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-19T05:32:44.464 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T05:32:44.553 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-19T05:32:44.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-19T05:32:44.579 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T05:32:44.674 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-19T05:32:44.685 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-19T05:32:44.738 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T05:32:44.827 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-19T05:32:44.882 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:44.885 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:32:44.927 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-19T05:32:44.927 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T05:32:44.927 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T05:32:44.932 INFO:tasks.ceph.mon.a:Started 2024-09-19T05:32:44.932 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T05:32:44.932 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T05:32:44.972 INFO:tasks.ceph.mon.b:Started 2024-09-19T05:32:44.973 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T05:32:44.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T05:32:44.975 INFO:tasks.ceph.mon.c:Started 2024-09-19T05:32:44.975 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-19T05:32:44.975 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-19T05:32:44.975 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-19T05:32:44.978 INFO:tasks.ceph.mgr.y:Started 2024-09-19T05:32:44.978 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-19T05:32:44.978 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-19T05:32:44.980 INFO:tasks.ceph.mgr.x:Started 2024-09-19T05:32:44.981 INFO:tasks.ceph:Setting crush tunables to default 2024-09-19T05:32:44.981 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd crush tunables default 2024-09-19T05:32:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f836ba0a640 1 Processor -- start 2024-09-19T05:32:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f836ba0a640 1 -- start start 2024-09-19T05:32:45.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f836ba0a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:45.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f836ba0a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:45.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f836ba0a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83640cec10 con 0x7f83640add70 2024-09-19T05:32:45.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f836ba0a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f83640cf7b0 con 0x7f836406d2c0 2024-09-19T05:32:45.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f836ba0a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f836406f1e0 con 0x7f836406e8c0 2024-09-19T05:32:45.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f83697a6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:45.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f8369fa7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:45.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f8369fa7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46260/0 (socket says 172.21.15.67:46260) 2024-09-19T05:32:45.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 learned_addr learned my addr 172.21.15.67:0/716356806 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:32:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 msgr2=0x7f8364165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T05:32:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 msgr2=0x7f8364165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:32:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 msgr2=0x7f836406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:32:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 msgr2=0x7f836406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.108+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:32:45.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.312+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:45.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.312+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:45.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.312+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 msgr2=0x7f8364165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T05:32:45.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.312+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 msgr2=0x7f8364165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:45.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.312+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:45.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.312+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:32:45.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.312+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 msgr2=0x7f836406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:32:45.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.312+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 msgr2=0x7f836406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:45.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.312+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:45.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.312+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:32:45.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.716+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:45.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.716+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:45.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.716+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 msgr2=0x7f8364165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:32:45.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.716+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 msgr2=0x7f8364165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:45.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.716+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:45.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.716+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 msgr2=0x7f836406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T05:32:45.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.716+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:32:45.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.716+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 msgr2=0x7f836406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:45.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.716+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:45.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:45.716+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:32:46.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:46.520+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:46.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:46.520+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:46.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:46.520+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 msgr2=0x7f8364165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:32:46.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:46.520+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 msgr2=0x7f8364165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:46.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:46.520+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:46.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:46.520+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:32:46.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:46.520+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 msgr2=0x7f836406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T05:32:46.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:46.520+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 msgr2=0x7f836406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:46.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:46.520+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:46.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:46.520+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:32:48.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.108+0000 7f835affd640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 msgr2=0x7f836406eca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:32:48.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.108+0000 7f835affd640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f836406e8c0 0x7f836406eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:48.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.108+0000 7f835affd640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 msgr2=0x7f8364165e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:32:48.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.108+0000 7f835affd640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.97:3300/0 conn(0x7f836406d2c0 0x7f8364165e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:48.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.108+0000 7f835affd640 1 -- 172.21.15.67:0/716356806 >> v1:172.21.15.97:6789/0 conn(0x7f83640add70 legacy=0x7f836406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:48.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.108+0000 7f835affd640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:48.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.108+0000 7f835affd640 1 -- 172.21.15.67:0/716356806 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83640cee80 con 0x7f8348006180 2024-09-19T05:32:48.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.108+0000 7f835affd640 1 -- 172.21.15.67:0/716356806 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f83640cf7b0 con 0x7f83480036d0 2024-09-19T05:32:48.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.108+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:48.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.112+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 msgr2=0x7f8348005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:32:48.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.112+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 msgr2=0x7f8348005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:48.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.112+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:48.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.112+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:32:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.316+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.316+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 msgr2=0x7f8348005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:32:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.316+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 msgr2=0x7f8348005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.316+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.316+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:32:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.720+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.720+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 msgr2=0x7f8348005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:32:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.720+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 msgr2=0x7f8348005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.720+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:48.720+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:32:49.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:49.524+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:49.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:49.524+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 msgr2=0x7f8348005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:32:49.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:49.524+0000 7f83697a6640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 msgr2=0x7f8348005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:32:49.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:49.524+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:32:49.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:49.524+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:32:50.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457304299 0 0) 0x7f83640cee80 con 0x7f8348006180 2024-09-19T05:32:50.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8350003530 con 0x7f8348006180 2024-09-19T05:32:50.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1275704892 0 0) 0x7f8350003530 con 0x7f8348006180 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 msgr2=0x7f8348005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 --2- 172.21.15.67:0/716356806 >> v2:172.21.15.67:3300/0 conn(0x7f83480036d0 0x7f8348005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834800af20 con 0x7f8348006180 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f8354001700 con 0x7f8348006180 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 >> v1:172.21.15.67:6789/0 conn(0x7f8348006180 legacy=0x7f8348008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 reap_dead start 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 0x7f8350003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 0x7f8350004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f835000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f83640cf7b0 con 0x7f83500053d0 2024-09-19T05:32:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f835000c290 con 0x7f8350004810 2024-09-19T05:32:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f835000c490 con 0x7f8350003a10 2024-09-19T05:32:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f835000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f8368fa5640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 0x7f8350004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.344+0000 7f83697a6640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 0x7f8350003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.348+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 msgr2=0x7f8350003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.348+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 0x7f8350003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.348+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 msgr2=0x7f8350004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.348+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 0x7f8350004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.348+0000 7f8369fa7640 1 -- 172.21.15.67:0/716356806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8350003530 con 0x7f83500053d0 2024-09-19T05:32:50.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f8369fa7640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f835000b9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83640705c0 tx=0x7f835c01d020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71184bc01fcae1c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:50.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c0ab070 con 0x7f83500053d0 2024-09-19T05:32:50.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835c0a5cf0 con 0x7f83500053d0 2024-09-19T05:32:50.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f835bfff640 1 -- 172.21.15.67:0/716356806 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c009700 con 0x7f83500053d0 2024-09-19T05:32:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f836ba0a640 1 -- 172.21.15.67:0/716356806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 msgr2=0x7f835000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f836ba0a640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f835000b9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83640705c0 tx=0x7f835c01d020 comp rx=0 tx=0).stop 2024-09-19T05:32:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f836ba0a640 1 -- 172.21.15.67:0/716356806 shutdown_connections 2024-09-19T05:32:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f836ba0a640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f835000b9d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f836ba0a640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 0x7f8350004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f836ba0a640 1 --2- 172.21.15.67:0/716356806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 0x7f8350003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f836ba0a640 1 -- 172.21.15.67:0/716356806 >> 172.21.15.67:0/716356806 conn(0x7f83640cd770 msgr2=0x7f83640cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f836ba0a640 1 -- 172.21.15.67:0/716356806 shutdown_connections 2024-09-19T05:32:50.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.352+0000 7f836ba0a640 1 -- 172.21.15.67:0/716356806 wait complete. 2024-09-19T05:32:50.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f836ba0a640 1 Processor -- start 2024-09-19T05:32:50.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f836ba0a640 1 -- start start 2024-09-19T05:32:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f836ba0a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 0x7f8364155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f836ba0a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 0x7f8364136b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f836ba0a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f8364137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f836ba0a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8364142900 con 0x7f83500053d0 2024-09-19T05:32:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f836ba0a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f83640cf440 con 0x7f8350004810 2024-09-19T05:32:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f836ba0a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8364142a80 con 0x7f8350003a10 2024-09-19T05:32:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8369fa7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f8364137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8369fa7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f8364137040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60772/0 (socket says 172.21.15.67:60772) 2024-09-19T05:32:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8369fa7640 1 -- 172.21.15.67:0/1343810237 learned_addr learned my addr 172.21.15.67:0/1343810237 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:32:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8368fa5640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 0x7f8364136b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f83697a6640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 0x7f8364155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8369fa7640 1 -- 172.21.15.67:0/1343810237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 msgr2=0x7f8364155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8369fa7640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 0x7f8364155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8369fa7640 1 -- 172.21.15.67:0/1343810237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 msgr2=0x7f8364136b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8369fa7640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 0x7f8364136b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8369fa7640 1 -- 172.21.15.67:0/1343810237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8364130fb0 con 0x7f83500053d0 2024-09-19T05:32:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f83697a6640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 0x7f8364155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:32:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8368fa5640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 0x7f8364136b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:32:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8369fa7640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f8364137040 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f835c0b1040 tx=0x7f835c019e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8359ffb640 1 -- 172.21.15.67:0/1343810237 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c0ab040 con 0x7f83500053d0 2024-09-19T05:32:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8359ffb640 1 -- 172.21.15.67:0/1343810237 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835c0be070 con 0x7f83500053d0 2024-09-19T05:32:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f836ba0a640 1 -- 172.21.15.67:0/1343810237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8364131250 con 0x7f83500053d0 2024-09-19T05:32:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8359ffb640 1 -- 172.21.15.67:0/1343810237 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c009700 con 0x7f83500053d0 2024-09-19T05:32:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f836ba0a640 1 -- 172.21.15.67:0/1343810237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8364131810 con 0x7f83500053d0 2024-09-19T05:32:50.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8359ffb640 1 -- 172.21.15.67:0/1343810237 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f835c0b6070 con 0x7f83500053d0 2024-09-19T05:32:50.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.356+0000 7f8359ffb640 1 -- 172.21.15.67:0/1343810237 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f835c0b9d80 con 0x7f83500053d0 2024-09-19T05:32:50.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.360+0000 7f836ba0a640 1 -- 172.21.15.67:0/1343810237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f836406eca0 con 0x7f83500053d0 2024-09-19T05:32:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.360+0000 7f8359ffb640 1 -- 172.21.15.67:0/1343810237 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f835c016dc0 con 0x7f83500053d0 2024-09-19T05:32:50.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.428+0000 7f836ba0a640 1 -- 172.21.15.67:0/1343810237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f83640cd1c0 con 0x7f83500053d0 2024-09-19T05:32:50.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.432+0000 7f8359ffb640 1 -- 172.21.15.67:0/1343810237 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f835c0b9650 con 0x7f83500053d0 2024-09-19T05:32:50.435 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2024-09-19T05:32:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.432+0000 7f836ba0a640 1 -- 172.21.15.67:0/1343810237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 msgr2=0x7f8364137040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.432+0000 7f836ba0a640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f8364137040 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f835c0b1040 tx=0x7f835c019e10 comp rx=0 tx=0).stop 2024-09-19T05:32:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.432+0000 7f836ba0a640 1 -- 172.21.15.67:0/1343810237 shutdown_connections 2024-09-19T05:32:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.432+0000 7f836ba0a640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83500053d0 0x7f8364137040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.432+0000 7f836ba0a640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8350004810 0x7f8364136b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.432+0000 7f836ba0a640 1 --2- 172.21.15.67:0/1343810237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8350003a10 0x7f8364155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.432+0000 7f836ba0a640 1 -- 172.21.15.67:0/1343810237 >> 172.21.15.67:0/1343810237 conn(0x7f83640cd770 msgr2=0x7f836415f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.432+0000 7f836ba0a640 1 -- 172.21.15.67:0/1343810237 shutdown_connections 2024-09-19T05:32:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:50.432+0000 7f836ba0a640 1 -- 172.21.15.67:0/1343810237 wait complete. 2024-09-19T05:32:50.453 INFO:tasks.ceph:check_enable_crimson: False 2024-09-19T05:32:50.454 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-19T05:32:50.454 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:50.454 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-19T05:32:50.465 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:50.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-19T05:32:50.516 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:50.516 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-19T05:32:50.569 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:32:50.569 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-19T05:32:50.623 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:50.623 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-19T05:32:50.635 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:50.636 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-19T05:32:50.678 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:50.674+0000 7f2e59602180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:32:50.690 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:50.691 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-19T05:32:50.742 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:32:50.742 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-19T05:32:50.794 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 87ebf7df-59d2-4d0c-ab12-2168183fc2a4 0 2024-09-19T05:32:50.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.950+0000 7fdfd3332640 1 Processor -- start 2024-09-19T05:32:50.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.950+0000 7fdfd3332640 1 -- start start 2024-09-19T05:32:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd3332640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdfcc06e8c0 0x7fdfcc06eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd3332640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd3332640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfcc0cec10 con 0x7fdfcc06d0f0 2024-09-19T05:32:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd3332640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdfcc0cf7b0 con 0x7fdfcc06e8c0 2024-09-19T05:32:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd3332640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdfcc06f1e0 con 0x7fdfcc0add70 2024-09-19T05:32:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd08cd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd08cd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc06cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:44372/0 (socket says 172.21.15.97:44372) 2024-09-19T05:32:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd08cd640 1 -- 172.21.15.97:0/1278504377 learned_addr learned my addr 172.21.15.97:0/1278504377 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd08cd640 1 -- 172.21.15.97:0/1278504377 >> v2:172.21.15.67:3300/0 conn(0x7fdfcc06e8c0 msgr2=0x7fdfcc06eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:50.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd10ce640 1 --2- 172.21.15.97:0/1278504377 >> v2:172.21.15.67:3300/0 conn(0x7fdfcc06e8c0 0x7fdfcc06eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd08cd640 1 --2- 172.21.15.97:0/1278504377 >> v2:172.21.15.67:3300/0 conn(0x7fdfcc06e8c0 0x7fdfcc06eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd08cd640 1 -- 172.21.15.97:0/1278504377 >> v1:172.21.15.67:6789/0 conn(0x7fdfcc06d0f0 legacy=0x7fdfcc0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:50.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd08cd640 1 -- 172.21.15.97:0/1278504377 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfcc0cee80 con 0x7fdfcc0add70 2024-09-19T05:32:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfd08cd640 1 --2- 172.21.15.97:0/1278504377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc06cbb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009870 tx=0x7fdfbc01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57df5d92b3ac8da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfc3fff640 1 -- 172.21.15.97:0/1278504377 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0b1070 con 0x7fdfcc0add70 2024-09-19T05:32:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfc3fff640 1 -- 172.21.15.97:0/1278504377 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0ac630 con 0x7fdfcc0add70 2024-09-19T05:32:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.954+0000 7fdfc3fff640 1 -- 172.21.15.97:0/1278504377 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0a8050 con 0x7fdfcc0add70 2024-09-19T05:32:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- 172.21.15.97:0/1278504377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 msgr2=0x7fdfcc06cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 --2- 172.21.15.97:0/1278504377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc06cbb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009870 tx=0x7fdfbc01c520 comp rx=0 tx=0).stop 2024-09-19T05:32:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- 172.21.15.97:0/1278504377 shutdown_connections 2024-09-19T05:32:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 --2- 172.21.15.97:0/1278504377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc06cbb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 --2- 172.21.15.97:0/1278504377 >> v2:172.21.15.67:3300/0 conn(0x7fdfcc06e8c0 0x7fdfcc06eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- 172.21.15.97:0/1278504377 >> 172.21.15.97:0/1278504377 conn(0x7fdfcc0cd770 msgr2=0x7fdfcc0cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- 172.21.15.97:0/1278504377 shutdown_connections 2024-09-19T05:32:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- 172.21.15.97:0/1278504377 wait complete. 2024-09-19T05:32:50.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 Processor -- start 2024-09-19T05:32:50.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- start start 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfcc06d0f0 0x7fdfcc0b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc06e8c0 0x7fdfcc0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc142a80 con 0x7fdfcc06d0f0 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc142900 con 0x7fdfcc06e8c0 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdfcc168e50 con 0x7fdfcc0add70 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd18cf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd08cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc06e8c0 0x7fdfcc0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd18cf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:44384/0 (socket says 172.21.15.97:44384) 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd18cf640 1 -- 172.21.15.97:0/481650182 learned_addr learned my addr 172.21.15.97:0/481650182 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd10ce640 1 --2- 172.21.15.97:0/481650182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfcc06d0f0 0x7fdfcc0b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd18cf640 1 -- 172.21.15.97:0/481650182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc06e8c0 msgr2=0x7fdfcc0cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd18cf640 1 --2- 172.21.15.97:0/481650182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc06e8c0 0x7fdfcc0cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd18cf640 1 -- 172.21.15.97:0/481650182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfcc06d0f0 msgr2=0x7fdfcc0b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd18cf640 1 --2- 172.21.15.97:0/481650182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfcc06d0f0 0x7fdfcc0b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd18cf640 1 -- 172.21.15.97:0/481650182 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfcc0b5470 con 0x7fdfcc0add70 2024-09-19T05:32:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd10ce640 1 --2- 172.21.15.97:0/481650182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfcc06d0f0 0x7fdfcc0b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:32:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd08cd640 1 --2- 172.21.15.97:0/481650182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc06e8c0 0x7fdfcc0cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:32:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd18cf640 1 --2- 172.21.15.97:0/481650182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc157e90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800c7b0 tx=0x7fdfc800cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfc1ffb640 1 -- 172.21.15.97:0/481650182 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8017070 con 0x7fdfcc0add70 2024-09-19T05:32:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfc1ffb640 1 -- 172.21.15.97:0/481650182 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc8003db0 con 0x7fdfcc0add70 2024-09-19T05:32:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- 172.21.15.97:0/481650182 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfcc0b3f50 con 0x7fdfcc0add70 2024-09-19T05:32:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfc1ffb640 1 -- 172.21.15.97:0/481650182 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80052b0 con 0x7fdfcc0add70 2024-09-19T05:32:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfd3332640 1 -- 172.21.15.97:0/481650182 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfcc0b4510 con 0x7fdfcc0add70 2024-09-19T05:32:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfc1ffb640 1 -- 172.21.15.97:0/481650182 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdfc801a070 con 0x7fdfcc0add70 2024-09-19T05:32:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.958+0000 7fdfc1ffb640 1 -- 172.21.15.97:0/481650182 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fdfc801c780 con 0x7fdfcc0add70 2024-09-19T05:32:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.962+0000 7fdfd3332640 1 -- 172.21.15.97:0/481650182 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfcc06eca0 con 0x7fdfcc0add70 2024-09-19T05:32:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:50.962+0000 7fdfc1ffb640 1 -- 172.21.15.97:0/481650182 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdfc8021020 con 0x7fdfcc0add70 2024-09-19T05:32:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.034+0000 7fdfd3332640 1 -- 172.21.15.97:0/481650182 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "87ebf7df-59d2-4d0c-ab12-2168183fc2a4", "id": 0} v 0) -- 0x7fdfcc0b46e0 con 0x7fdfcc0add70 2024-09-19T05:32:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.042+0000 7fdfc1ffb640 1 -- 172.21.15.97:0/481650182 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "87ebf7df-59d2-4d0c-ab12-2168183fc2a4", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fdfc800ad40 con 0x7fdfcc0add70 2024-09-19T05:32:51.044 INFO:teuthology.orchestra.run.smithi097.stdout:0 2024-09-19T05:32:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.042+0000 7fdfd3332640 1 -- 172.21.15.97:0/481650182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 msgr2=0x7fdfcc157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.042+0000 7fdfd3332640 1 --2- 172.21.15.97:0/481650182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc157e90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800c7b0 tx=0x7fdfc800cc70 comp rx=0 tx=0).stop 2024-09-19T05:32:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.042+0000 7fdfd3332640 1 -- 172.21.15.97:0/481650182 shutdown_connections 2024-09-19T05:32:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.042+0000 7fdfd3332640 1 --2- 172.21.15.97:0/481650182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfcc0add70 0x7fdfcc157e90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.042+0000 7fdfd3332640 1 --2- 172.21.15.97:0/481650182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc06e8c0 0x7fdfcc0cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.042+0000 7fdfd3332640 1 --2- 172.21.15.97:0/481650182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfcc06d0f0 0x7fdfcc0b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.042+0000 7fdfd3332640 1 -- 172.21.15.97:0/481650182 >> 172.21.15.97:0/481650182 conn(0x7fdfcc0cd770 msgr2=0x7fdfcc0731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:51.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.042+0000 7fdfd3332640 1 -- 172.21.15.97:0/481650182 shutdown_connections 2024-09-19T05:32:51.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.042+0000 7fdfd3332640 1 -- 172.21.15.97:0/481650182 wait complete. 2024-09-19T05:32:51.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 107bed39-5265-4ceb-bcb9-a136b4ce865c 1 2024-09-19T05:32:51.161 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:51.158+0000 7f2e59602180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:32:51.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.174+0000 7f96b9b52640 1 Processor -- start 2024-09-19T05:32:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.174+0000 7f96b9b52640 1 -- start start 2024-09-19T05:32:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.174+0000 7f96b9b52640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96b4161ee0 0x7f96b41622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.174+0000 7f96b9b52640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b4162820 con 0x7f96b415e3f0 2024-09-19T05:32:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.174+0000 7f96b9b52640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b406cb10 con 0x7f96b406d5b0 2024-09-19T05:32:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.174+0000 7f96b9b52640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f96b415e7d0 con 0x7f96b4161ee0 2024-09-19T05:32:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.174+0000 7f96b2ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96b4161ee0 0x7f96b41622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.174+0000 7f96b3fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f96b406d5b0 0x7f96b406da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57004/0 (socket says 172.21.15.97:57004) 2024-09-19T05:32:51.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.174+0000 7f96b3fff640 1 -- 172.21.15.97:0/55342622 learned_addr learned my addr 172.21.15.97:0/55342622 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-19T05:32:51.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b2ffd640 1 -- 172.21.15.97:0/55342622 >> v1:172.21.15.97:6789/0 conn(0x7f96b406d5b0 legacy=0x7f96b406da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b2ffd640 1 -- 172.21.15.97:0/55342622 >> v1:172.21.15.67:6789/0 conn(0x7f96b415e3f0 legacy=0x7f96b40b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:51.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b27fc640 1 -- 172.21.15.97:0/55342622 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466500175 0 0) 0x7f96b406cb10 con 0x7f96b406d5b0 2024-09-19T05:32:51.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b2ffd640 1 -- 172.21.15.97:0/55342622 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b40b7040 con 0x7f96b4161ee0 2024-09-19T05:32:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b2ffd640 1 --2- 172.21.15.97:0/55342622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b4161ee0 0x7f96b41622e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f96a80097c0 tx=0x7f96a801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c954f9722e38cff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b27fc640 1 -- 172.21.15.97:0/55342622 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80ab430 con 0x7f96b4161ee0 2024-09-19T05:32:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b27fc640 1 -- 172.21.15.97:0/55342622 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a80b0070 con 0x7f96b4161ee0 2024-09-19T05:32:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b27fc640 1 -- 172.21.15.97:0/55342622 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80ab7f0 con 0x7f96b4161ee0 2024-09-19T05:32:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b9b52640 1 -- 172.21.15.97:0/55342622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b4161ee0 msgr2=0x7f96b41622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b9b52640 1 --2- 172.21.15.97:0/55342622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b4161ee0 0x7f96b41622e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f96a80097c0 tx=0x7f96a801c430 comp rx=0 tx=0).stop 2024-09-19T05:32:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b9b52640 1 -- 172.21.15.97:0/55342622 shutdown_connections 2024-09-19T05:32:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b9b52640 1 --2- 172.21.15.97:0/55342622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b4161ee0 0x7f96b41622e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b9b52640 1 -- 172.21.15.97:0/55342622 >> 172.21.15.97:0/55342622 conn(0x7f96b40b7970 msgr2=0x7f96b40b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b9b52640 1 -- 172.21.15.97:0/55342622 shutdown_connections 2024-09-19T05:32:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.178+0000 7f96b9b52640 1 -- 172.21.15.97:0/55342622 wait complete. 2024-09-19T05:32:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 Processor -- start 2024-09-19T05:32:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 -- start start 2024-09-19T05:32:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b406d5b0 0x7f96b415e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96b415e3f0 0x7f96b41535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96b4161ee0 0x7f96b4153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f96b406e520 con 0x7f96b415e3f0 2024-09-19T05:32:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f96b406d090 con 0x7f96b406d5b0 2024-09-19T05:32:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f96b406e6a0 con 0x7f96b4161ee0 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b406d5b0 0x7f96b415e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b406d5b0 0x7f96b415e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53964/0 (socket says 172.21.15.97:53964) 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96b4161ee0 0x7f96b4153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b37fe640 1 -- 172.21.15.97:0/1087514855 learned_addr learned my addr 172.21.15.97:0/1087514855 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b2ffd640 1 --2- 172.21.15.97:0/1087514855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96b415e3f0 0x7f96b41535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b37fe640 1 -- 172.21.15.97:0/1087514855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96b4161ee0 msgr2=0x7f96b4153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b37fe640 1 --2- 172.21.15.97:0/1087514855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96b4161ee0 0x7f96b4153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b37fe640 1 -- 172.21.15.97:0/1087514855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96b415e3f0 msgr2=0x7f96b41535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b37fe640 1 --2- 172.21.15.97:0/1087514855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96b415e3f0 0x7f96b41535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b37fe640 1 -- 172.21.15.97:0/1087514855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b4161480 con 0x7f96b406d5b0 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b3fff640 1 --2- 172.21.15.97:0/1087514855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96b4161ee0 0x7f96b4153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b37fe640 1 --2- 172.21.15.97:0/1087514855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b406d5b0 0x7f96b415e9e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c450 tx=0x7f96a400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f969bfff640 1 -- 172.21.15.97:0/1087514855 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4012830 con 0x7f96b406d5b0 2024-09-19T05:32:51.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f969bfff640 1 -- 172.21.15.97:0/1087514855 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a4017070 con 0x7f96b406d5b0 2024-09-19T05:32:51.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 -- 172.21.15.97:0/1087514855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b4161760 con 0x7f96b406d5b0 2024-09-19T05:32:51.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f969bfff640 1 -- 172.21.15.97:0/1087514855 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4012c30 con 0x7f96b406d5b0 2024-09-19T05:32:51.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 -- 172.21.15.97:0/1087514855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b40b23e0 con 0x7f96b406d5b0 2024-09-19T05:32:51.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f969bfff640 1 -- 172.21.15.97:0/1087514855 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f96a401c460 con 0x7f96b406d5b0 2024-09-19T05:32:51.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f96b9b52640 1 -- 172.21.15.97:0/1087514855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b40af210 con 0x7f96b406d5b0 2024-09-19T05:32:51.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.182+0000 7f969bfff640 1 -- 172.21.15.97:0/1087514855 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f96a401b7c0 con 0x7f96b406d5b0 2024-09-19T05:32:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.190+0000 7f969bfff640 1 -- 172.21.15.97:0/1087514855 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f96a4012dd0 con 0x7f96b406d5b0 2024-09-19T05:32:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.262+0000 7f96b9b52640 1 -- 172.21.15.97:0/1087514855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "107bed39-5265-4ceb-bcb9-a136b4ce865c", "id": 1} v 0) -- 0x7f96b40afed0 con 0x7f96b406d5b0 2024-09-19T05:32:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.270+0000 7f969bfff640 1 -- 172.21.15.97:0/1087514855 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "107bed39-5265-4ceb-bcb9-a136b4ce865c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f96a401ba60 con 0x7f96b406d5b0 2024-09-19T05:32:51.275 INFO:teuthology.orchestra.run.smithi097.stdout:1 2024-09-19T05:32:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.274+0000 7f96b9b52640 1 -- 172.21.15.97:0/1087514855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b406d5b0 msgr2=0x7f96b415e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.274+0000 7f96b9b52640 1 --2- 172.21.15.97:0/1087514855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b406d5b0 0x7f96b415e9e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c450 tx=0x7f96a400c910 comp rx=0 tx=0).stop 2024-09-19T05:32:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.274+0000 7f96b9b52640 1 -- 172.21.15.97:0/1087514855 shutdown_connections 2024-09-19T05:32:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.274+0000 7f96b9b52640 1 --2- 172.21.15.97:0/1087514855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96b4161ee0 0x7f96b4153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.274+0000 7f96b9b52640 1 --2- 172.21.15.97:0/1087514855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96b415e3f0 0x7f96b41535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.274+0000 7f96b9b52640 1 --2- 172.21.15.97:0/1087514855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96b406d5b0 0x7f96b415e9e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.274+0000 7f96b9b52640 1 -- 172.21.15.97:0/1087514855 >> 172.21.15.97:0/1087514855 conn(0x7f96b40b7970 msgr2=0x7f96b40b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.274+0000 7f96b9b52640 1 -- 172.21.15.97:0/1087514855 shutdown_connections 2024-09-19T05:32:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.274+0000 7f96b9b52640 1 -- 172.21.15.97:0/1087514855 wait complete. 2024-09-19T05:32:51.292 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 29548f31-3605-4ea8-8df8-e81fc231c108 2 2024-09-19T05:32:51.340 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:51.336+0000 7f062403a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:32:51.350 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:51.346+0000 7f2e59602180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:32:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.406+0000 7f0431e91640 1 Processor -- start 2024-09-19T05:32:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.406+0000 7f0431e91640 1 -- start start 2024-09-19T05:32:51.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f0431e91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f042c15b380 0x7f042c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f0431e91640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f042c15edc0 0x7f042c15f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f0431e91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f042c15fbd0 con 0x7f042c15f740 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f0431e91640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f042c06f8d0 con 0x7f042c15edc0 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f0431e91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f042c0cf720 con 0x7f042c15b380 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f042c15b380 0x7f042c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f042c15b380 0x7f042c0ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53980/0 (socket says 172.21.15.97:53980) 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042b7fe640 1 -- 172.21.15.97:0/3379896392 learned_addr learned my addr 172.21.15.97:0/3379896392 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042bfff640 1 --1- 172.21.15.97:0/3379896392 >> v1:172.21.15.97:6789/0 conn(0x7f042c15f740 0x7f042c0b4ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57014/0 (socket says 172.21.15.97:57014) 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f0422ffd640 1 --2- 172.21.15.97:0/3379896392 >> v2:172.21.15.67:3300/0 conn(0x7f042c15edc0 0x7f042c15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042b7fe640 1 -- 172.21.15.97:0/3379896392 >> v2:172.21.15.67:3300/0 conn(0x7f042c15edc0 msgr2=0x7f042c15f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042b7fe640 1 --2- 172.21.15.97:0/3379896392 >> v2:172.21.15.67:3300/0 conn(0x7f042c15edc0 0x7f042c15f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042b7fe640 1 -- 172.21.15.97:0/3379896392 >> v1:172.21.15.97:6789/0 conn(0x7f042c15f740 legacy=0x7f042c0b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042b7fe640 1 -- 172.21.15.97:0/3379896392 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042c0cfa00 con 0x7f042c15b380 2024-09-19T05:32:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042b7fe640 1 --2- 172.21.15.97:0/3379896392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f042c15b380 0x7f042c0ce340 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f042c073cc0 tx=0x7f041c01ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b50f8465c73f3e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042affd640 1 -- 172.21.15.97:0/3379896392 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c0b4070 con 0x7f042c15b380 2024-09-19T05:32:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042affd640 1 -- 172.21.15.97:0/3379896392 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c0a7bb0 con 0x7f042c15b380 2024-09-19T05:32:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.410+0000 7f042affd640 1 -- 172.21.15.97:0/3379896392 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c0af440 con 0x7f042c15b380 2024-09-19T05:32:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 -- 172.21.15.97:0/3379896392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f042c15b380 msgr2=0x7f042c0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 --2- 172.21.15.97:0/3379896392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f042c15b380 0x7f042c0ce340 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f042c073cc0 tx=0x7f041c01ebf0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 -- 172.21.15.97:0/3379896392 shutdown_connections 2024-09-19T05:32:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 --2- 172.21.15.97:0/3379896392 >> v2:172.21.15.67:3300/0 conn(0x7f042c15edc0 0x7f042c15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 --2- 172.21.15.97:0/3379896392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f042c15b380 0x7f042c0ce340 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 -- 172.21.15.97:0/3379896392 >> 172.21.15.97:0/3379896392 conn(0x7f042c0cd770 msgr2=0x7f042c0cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 -- 172.21.15.97:0/3379896392 shutdown_connections 2024-09-19T05:32:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 -- 172.21.15.97:0/3379896392 wait complete. 2024-09-19T05:32:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 Processor -- start 2024-09-19T05:32:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 -- start start 2024-09-19T05:32:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f042c15b380 0x7f042c1444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f042c15edc0 0x7f042c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042c15f740 0x7f042c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f042c0d0660 con 0x7f042c15f740 2024-09-19T05:32:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f042c0d04e0 con 0x7f042c15edc0 2024-09-19T05:32:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0431e91640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f042c06bcc0 con 0x7f042c15b380 2024-09-19T05:32:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f042b7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f042c15b380 0x7f042c1444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f0422ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f042c15edc0 0x7f042c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f042b7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f042c15b380 0x7f042c1444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:44402/0 (socket says 172.21.15.97:44402) 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f042b7fe640 1 -- 172.21.15.97:0/2042969449 learned_addr learned my addr 172.21.15.97:0/2042969449 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.414+0000 7f042bfff640 1 --2- 172.21.15.97:0/2042969449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042c15f740 0x7f042c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0422ffd640 1 -- 172.21.15.97:0/2042969449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f042c15b380 msgr2=0x7f042c1444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0422ffd640 1 --2- 172.21.15.97:0/2042969449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f042c15b380 0x7f042c1444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0422ffd640 1 -- 172.21.15.97:0/2042969449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042c15f740 msgr2=0x7f042c154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0422ffd640 1 --2- 172.21.15.97:0/2042969449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042c15f740 0x7f042c154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0422ffd640 1 -- 172.21.15.97:0/2042969449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042c0ae380 con 0x7f042c15edc0 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f042bfff640 1 --2- 172.21.15.97:0/2042969449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042c15f740 0x7f042c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f042b7fe640 1 --2- 172.21.15.97:0/2042969449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f042c15b380 0x7f042c1444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0422ffd640 1 --2- 172.21.15.97:0/2042969449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f042c15edc0 0x7f042c153b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f041400c7f0 tx=0x7f041400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0428ff9640 1 -- 172.21.15.97:0/2042969449 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414015070 con 0x7f042c15edc0 2024-09-19T05:32:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0428ff9640 1 -- 172.21.15.97:0/2042969449 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0414004220 con 0x7f042c15edc0 2024-09-19T05:32:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0431e91640 1 -- 172.21.15.97:0/2042969449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f042c0ae660 con 0x7f042c15edc0 2024-09-19T05:32:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0428ff9640 1 -- 172.21.15.97:0/2042969449 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414003620 con 0x7f042c15edc0 2024-09-19T05:32:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0431e91640 1 -- 172.21.15.97:0/2042969449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f042c0aec20 con 0x7f042c15edc0 2024-09-19T05:32:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0428ff9640 1 -- 172.21.15.97:0/2042969449 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f04140037c0 con 0x7f042c15edc0 2024-09-19T05:32:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0428ff9640 1 -- 172.21.15.97:0/2042969449 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f0414007da0 con 0x7f042c15edc0 2024-09-19T05:32:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0431e91640 1 -- 172.21.15.97:0/2042969449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f042c0ce340 con 0x7f042c15edc0 2024-09-19T05:32:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.418+0000 7f0428ff9640 1 -- 172.21.15.97:0/2042969449 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0414019610 con 0x7f042c15edc0 2024-09-19T05:32:51.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.490+0000 7f0431e91640 1 -- 172.21.15.97:0/2042969449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "29548f31-3605-4ea8-8df8-e81fc231c108", "id": 2} v 0) -- 0x7f042c0cd4e0 con 0x7f042c15edc0 2024-09-19T05:32:51.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.502+0000 7f0428ff9640 1 -- 172.21.15.97:0/2042969449 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29548f31-3605-4ea8-8df8-e81fc231c108", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f0414003c40 con 0x7f042c15edc0 2024-09-19T05:32:51.503 INFO:teuthology.orchestra.run.smithi097.stdout:2 2024-09-19T05:32:51.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.502+0000 7f0431e91640 1 -- 172.21.15.97:0/2042969449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f042c15edc0 msgr2=0x7f042c153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.502+0000 7f0431e91640 1 --2- 172.21.15.97:0/2042969449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f042c15edc0 0x7f042c153b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f041400c7f0 tx=0x7f041400ccb0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.502+0000 7f0431e91640 1 -- 172.21.15.97:0/2042969449 shutdown_connections 2024-09-19T05:32:51.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.502+0000 7f0431e91640 1 --2- 172.21.15.97:0/2042969449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042c15f740 0x7f042c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.502+0000 7f0431e91640 1 --2- 172.21.15.97:0/2042969449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f042c15edc0 0x7f042c153b10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.502+0000 7f0431e91640 1 --2- 172.21.15.97:0/2042969449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f042c15b380 0x7f042c1444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.502+0000 7f0431e91640 1 -- 172.21.15.97:0/2042969449 >> 172.21.15.97:0/2042969449 conn(0x7f042c0cd770 msgr2=0x7f042c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:51.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.502+0000 7f0431e91640 1 -- 172.21.15.97:0/2042969449 shutdown_connections 2024-09-19T05:32:51.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.502+0000 7f0431e91640 1 -- 172.21.15.97:0/2042969449 wait complete. 2024-09-19T05:32:51.520 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 9d87ca79-16a4-4477-a769-b67e2366d2e0 3 2024-09-19T05:32:51.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.630+0000 7f4b9fe5f640 1 Processor -- start 2024-09-19T05:32:51.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.630+0000 7f4b9fe5f640 1 -- start start 2024-09-19T05:32:51.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9fe5f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9fe5f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4b9815d950 0x7f4b980b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9fe5f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9815ddd0 con 0x7f4b980cecd0 2024-09-19T05:32:51.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9fe5f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9815e0b0 con 0x7f4b9815d950 2024-09-19T05:32:51.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9fe5f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9815e390 con 0x7f4b9815c210 2024-09-19T05:32:51.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9dbfb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9dbfb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9815c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:44406/0 (socket says 172.21.15.97:44406) 2024-09-19T05:32:51.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9dbfb640 1 -- 172.21.15.97:0/3961805560 learned_addr learned my addr 172.21.15.97:0/3961805560 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:51.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9d3fa640 1 --2- 172.21.15.97:0/3961805560 >> v2:172.21.15.67:3300/0 conn(0x7f4b9815d950 0x7f4b980b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9dbfb640 1 -- 172.21.15.97:0/3961805560 >> v2:172.21.15.67:3300/0 conn(0x7f4b9815d950 msgr2=0x7f4b980b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:51.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9dbfb640 1 --2- 172.21.15.97:0/3961805560 >> v2:172.21.15.67:3300/0 conn(0x7f4b9815d950 0x7f4b980b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9dbfb640 1 -- 172.21.15.97:0/3961805560 >> v1:172.21.15.67:6789/0 conn(0x7f4b980cecd0 legacy=0x7f4b9809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:51.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9dbfb640 1 -- 172.21.15.97:0/3961805560 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9815e670 con 0x7f4b9815c210 2024-09-19T05:32:51.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9dbfb640 1 --2- 172.21.15.97:0/3961805560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9815c5f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009870 tx=0x7f4b9401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4406639eeed433b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:51.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9cbf9640 1 -- 172.21.15.97:0/3961805560 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b940b2070 con 0x7f4b9815c210 2024-09-19T05:32:51.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9cbf9640 1 -- 172.21.15.97:0/3961805560 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b940a9070 con 0x7f4b9815c210 2024-09-19T05:32:51.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9cbf9640 1 -- 172.21.15.97:0/3961805560 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b940ad880 con 0x7f4b9815c210 2024-09-19T05:32:51.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/3961805560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 msgr2=0x7f4b9815c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.634+0000 7f4b9fe5f640 1 --2- 172.21.15.97:0/3961805560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9815c5f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009870 tx=0x7f4b9401c490 comp rx=0 tx=0).stop 2024-09-19T05:32:51.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/3961805560 shutdown_connections 2024-09-19T05:32:51.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 --2- 172.21.15.97:0/3961805560 >> v2:172.21.15.67:3300/0 conn(0x7f4b9815d950 0x7f4b980b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 --2- 172.21.15.97:0/3961805560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9815c5f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/3961805560 >> 172.21.15.97:0/3961805560 conn(0x7f4b980b7970 msgr2=0x7f4b980b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:51.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/3961805560 shutdown_connections 2024-09-19T05:32:51.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/3961805560 wait complete. 2024-09-19T05:32:51.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 Processor -- start 2024-09-19T05:32:51.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 -- start start 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b980cecd0 0x7f4b9814f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9813d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9815d950 0x7f4b9813dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4b981691e0 con 0x7f4b9815d950 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4b980b6830 con 0x7f4b980cecd0 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9fe5f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4b98169360 con 0x7f4b9815c210 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9d3fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9813d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9dbfb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b980cecd0 0x7f4b9814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9d3fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9813d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:44410/0 (socket says 172.21.15.97:44410) 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9d3fa640 1 -- 172.21.15.97:0/700542457 learned_addr learned my addr 172.21.15.97:0/700542457 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:51.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9dbfb640 1 -- 172.21.15.97:0/700542457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 msgr2=0x7f4b9813d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9dbfb640 1 --2- 172.21.15.97:0/700542457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9813d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9dbfb640 1 -- 172.21.15.97:0/700542457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9815d950 msgr2=0x7f4b9813dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9dbfb640 1 --2- 172.21.15.97:0/700542457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9815d950 0x7f4b9813dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9dbfb640 1 -- 172.21.15.97:0/700542457 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b98154620 con 0x7f4b980cecd0 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9d3fa640 1 --2- 172.21.15.97:0/700542457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9813d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.638+0000 7f4b9dbfb640 1 --2- 172.21.15.97:0/700542457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b980cecd0 0x7f4b9814f570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4b940ac000 tx=0x7f4b94019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.642+0000 7f4b8a7fc640 1 -- 172.21.15.97:0/700542457 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b940b2040 con 0x7f4b980cecd0 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.642+0000 7f4b8a7fc640 1 -- 172.21.15.97:0/700542457 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b940b6610 con 0x7f4b980cecd0 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.642+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/700542457 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b98154900 con 0x7f4b980cecd0 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.642+0000 7f4b8a7fc640 1 -- 172.21.15.97:0/700542457 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b940b6a00 con 0x7f4b980cecd0 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.642+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/700542457 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b98154ec0 con 0x7f4b980cecd0 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.642+0000 7f4b8a7fc640 1 -- 172.21.15.97:0/700542457 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4b940bd060 con 0x7f4b980cecd0 2024-09-19T05:32:51.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.642+0000 7f4b8a7fc640 1 -- 172.21.15.97:0/700542457 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4b940b53c0 con 0x7f4b980cecd0 2024-09-19T05:32:51.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.642+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/700542457 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9815c5f0 con 0x7f4b980cecd0 2024-09-19T05:32:51.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.642+0000 7f4b8a7fc640 1 -- 172.21.15.97:0/700542457 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4b940c4020 con 0x7f4b980cecd0 2024-09-19T05:32:51.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.710+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/700542457 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d87ca79-16a4-4477-a769-b67e2366d2e0", "id": 3} v 0) -- 0x7f4b98157400 con 0x7f4b980cecd0 2024-09-19T05:32:51.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.722+0000 7f4b8a7fc640 1 -- 172.21.15.97:0/700542457 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d87ca79-16a4-4477-a769-b67e2366d2e0", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4b94016110 con 0x7f4b980cecd0 2024-09-19T05:32:51.724 INFO:teuthology.orchestra.run.smithi097.stdout:3 2024-09-19T05:32:51.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.722+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/700542457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b980cecd0 msgr2=0x7f4b9814f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.722+0000 7f4b9fe5f640 1 --2- 172.21.15.97:0/700542457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b980cecd0 0x7f4b9814f570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4b940ac000 tx=0x7f4b94019230 comp rx=0 tx=0).stop 2024-09-19T05:32:51.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.722+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/700542457 shutdown_connections 2024-09-19T05:32:51.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.722+0000 7f4b9fe5f640 1 --2- 172.21.15.97:0/700542457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9815d950 0x7f4b9813dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.722+0000 7f4b9fe5f640 1 --2- 172.21.15.97:0/700542457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9815c210 0x7f4b9813d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.722+0000 7f4b9fe5f640 1 --2- 172.21.15.97:0/700542457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b980cecd0 0x7f4b9814f570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.722+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/700542457 >> 172.21.15.97:0/700542457 conn(0x7f4b980b7970 msgr2=0x7f4b9815b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:51.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.722+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/700542457 shutdown_connections 2024-09-19T05:32:51.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.722+0000 7f4b9fe5f640 1 -- 172.21.15.97:0/700542457 wait complete. 2024-09-19T05:32:51.740 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 965c2ff0-d4e2-432b-8ea8-44423ec51b58 4 2024-09-19T05:32:51.838 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:51.832+0000 7f062403a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:32:51.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.854+0000 7f3e5c0d6640 1 Processor -- start 2024-09-19T05:32:51.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.854+0000 7f3e5c0d6640 1 -- start start 2024-09-19T05:32:51.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5c0d6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3e5415b380 0x7f3e540ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5c0d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3e5415f910 0x7f3e5406e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5c0d6640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e540cf720 con 0x7f3e5415edc0 2024-09-19T05:32:51.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5c0d6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3e540cfa00 con 0x7f3e5415b380 2024-09-19T05:32:51.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5c0d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3e540cfce0 con 0x7f3e5415f910 2024-09-19T05:32:51.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5a673640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3e5415f910 0x7f3e5406e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5a673640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3e5415f910 0x7f3e5406e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53998/0 (socket says 172.21.15.97:53998) 2024-09-19T05:32:51.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5a673640 1 -- 172.21.15.97:0/1093318086 learned_addr learned my addr 172.21.15.97:0/1093318086 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e59e72640 1 --2- 172.21.15.97:0/1093318086 >> v2:172.21.15.67:3300/0 conn(0x7f3e5415b380 0x7f3e540ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5a673640 1 -- 172.21.15.97:0/1093318086 >> v2:172.21.15.67:3300/0 conn(0x7f3e5415b380 msgr2=0x7f3e540ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5a673640 1 --2- 172.21.15.97:0/1093318086 >> v2:172.21.15.67:3300/0 conn(0x7f3e5415b380 0x7f3e540ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5a673640 1 -- 172.21.15.97:0/1093318086 >> v1:172.21.15.67:6789/0 conn(0x7f3e5415edc0 legacy=0x7f3e5415f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5a673640 1 -- 172.21.15.97:0/1093318086 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e540cffc0 con 0x7f3e5415f910 2024-09-19T05:32:51.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.858+0000 7f3e5a673640 1 --2- 172.21.15.97:0/1093318086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5415f910 0x7f3e5406e8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e540681b0 tx=0x7f3e5001c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e22a26e4f219e5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:51.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e58e70640 1 -- 172.21.15.97:0/1093318086 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e500a5670 con 0x7f3e5415f910 2024-09-19T05:32:51.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e58e70640 1 -- 172.21.15.97:0/1093318086 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e500a5810 con 0x7f3e5415f910 2024-09-19T05:32:51.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e58e70640 1 -- 172.21.15.97:0/1093318086 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e500a5be0 con 0x7f3e5415f910 2024-09-19T05:32:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/1093318086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5415f910 msgr2=0x7f3e5406e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 --2- 172.21.15.97:0/1093318086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5415f910 0x7f3e5406e8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e540681b0 tx=0x7f3e5001c9b0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/1093318086 shutdown_connections 2024-09-19T05:32:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 --2- 172.21.15.97:0/1093318086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5415f910 0x7f3e5406e8c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 --2- 172.21.15.97:0/1093318086 >> v2:172.21.15.67:3300/0 conn(0x7f3e5415b380 0x7f3e540ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/1093318086 >> 172.21.15.97:0/1093318086 conn(0x7f3e540cd770 msgr2=0x7f3e540cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/1093318086 shutdown_connections 2024-09-19T05:32:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/1093318086 wait complete. 2024-09-19T05:32:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 Processor -- start 2024-09-19T05:32:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 -- start start 2024-09-19T05:32:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5415b380 0x7f3e54145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5415edc0 0x7f3e540b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e5415f910 0x7f3e540b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e54168160 con 0x7f3e5415f910 2024-09-19T05:32:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5406f820 con 0x7f3e5415edc0 2024-09-19T05:32:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5c0d6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e541682e0 con 0x7f3e5415b380 2024-09-19T05:32:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e59e72640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5415b380 0x7f3e54145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e59671640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5415edc0 0x7f3e540b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e59e72640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5415b380 0x7f3e54145bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:44414/0 (socket says 172.21.15.97:44414) 2024-09-19T05:32:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e59e72640 1 -- 172.21.15.97:0/2410499726 learned_addr learned my addr 172.21.15.97:0/2410499726 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.862+0000 7f3e5a673640 1 --2- 172.21.15.97:0/2410499726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e5415f910 0x7f3e540b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e59671640 1 -- 172.21.15.97:0/2410499726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5415b380 msgr2=0x7f3e54145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e59671640 1 --2- 172.21.15.97:0/2410499726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5415b380 0x7f3e54145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e59671640 1 -- 172.21.15.97:0/2410499726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e5415f910 msgr2=0x7f3e540b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e59671640 1 --2- 172.21.15.97:0/2410499726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e5415f910 0x7f3e540b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e59671640 1 -- 172.21.15.97:0/2410499726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e54146110 con 0x7f3e5415edc0 2024-09-19T05:32:51.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e59e72640 1 --2- 172.21.15.97:0/2410499726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5415b380 0x7f3e54145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:32:51.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e59671640 1 --2- 172.21.15.97:0/2410499726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5415edc0 0x7f3e540b18a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400c410 tx=0x7f3e4400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:51.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e4a7fc640 1 -- 172.21.15.97:0/2410499726 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44017070 con 0x7f3e5415edc0 2024-09-19T05:32:51.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e4a7fc640 1 -- 172.21.15.97:0/2410499726 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e440069e0 con 0x7f3e5415edc0 2024-09-19T05:32:51.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/2410499726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e54155220 con 0x7f3e5415edc0 2024-09-19T05:32:51.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e4a7fc640 1 -- 172.21.15.97:0/2410499726 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44006e10 con 0x7f3e5415edc0 2024-09-19T05:32:51.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/2410499726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5415ca40 con 0x7f3e5415edc0 2024-09-19T05:32:51.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e4a7fc640 1 -- 172.21.15.97:0/2410499726 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3e4401a070 con 0x7f3e5415edc0 2024-09-19T05:32:51.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e4a7fc640 1 -- 172.21.15.97:0/2410499726 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f3e44011b30 con 0x7f3e5415edc0 2024-09-19T05:32:51.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.866+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/2410499726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e540ce340 con 0x7f3e5415edc0 2024-09-19T05:32:51.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.870+0000 7f3e4a7fc640 1 -- 172.21.15.97:0/2410499726 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3e44021020 con 0x7f3e5415edc0 2024-09-19T05:32:51.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.938+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/2410499726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "965c2ff0-d4e2-432b-8ea8-44423ec51b58", "id": 4} v 0) -- 0x7f3e540cd4e0 con 0x7f3e5415edc0 2024-09-19T05:32:51.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.942+0000 7f3e4a7fc640 1 -- 172.21.15.97:0/2410499726 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "965c2ff0-d4e2-432b-8ea8-44423ec51b58", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f3e44011590 con 0x7f3e5415edc0 2024-09-19T05:32:51.946 INFO:teuthology.orchestra.run.smithi097.stdout:4 2024-09-19T05:32:51.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.942+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/2410499726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5415edc0 msgr2=0x7f3e540b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:51.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.942+0000 7f3e5c0d6640 1 --2- 172.21.15.97:0/2410499726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5415edc0 0x7f3e540b18a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400c410 tx=0x7f3e4400c8d0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.942+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/2410499726 shutdown_connections 2024-09-19T05:32:51.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.942+0000 7f3e5c0d6640 1 --2- 172.21.15.97:0/2410499726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e5415f910 0x7f3e540b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.942+0000 7f3e5c0d6640 1 --2- 172.21.15.97:0/2410499726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5415edc0 0x7f3e540b18a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.942+0000 7f3e5c0d6640 1 --2- 172.21.15.97:0/2410499726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5415b380 0x7f3e54145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:51.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.942+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/2410499726 >> 172.21.15.97:0/2410499726 conn(0x7f3e540cd770 msgr2=0x7f3e54157f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:51.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.942+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/2410499726 shutdown_connections 2024-09-19T05:32:51.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:51.946+0000 7f3e5c0d6640 1 -- 172.21.15.97:0/2410499726 wait complete. 2024-09-19T05:32:51.948 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:51.946+0000 7f2e59602180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:32:51.963 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 18ec9c58-2074-4265-b302-5f366c996986 5 2024-09-19T05:32:52.004 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:52.002+0000 7f2e59602180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:32:52.031 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:52.028+0000 7f062403a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:32:52.057 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:52.054+0000 7f2e59602180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:32:52.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f7741f14640 1 Processor -- start 2024-09-19T05:32:52.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f7741f14640 1 -- start start 2024-09-19T05:32:52.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f7741f14640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f773c15c210 0x7f773c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f7741f14640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15d950 0x7f773c0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f7741f14640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f773c0cecd0 0x7f773c0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f7741f14640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f773c15ddd0 con 0x7f773c0cecd0 2024-09-19T05:32:52.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f7741f14640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f773c15e0b0 con 0x7f773c15c210 2024-09-19T05:32:52.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f7741f14640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f773c15e390 con 0x7f773c15d950 2024-09-19T05:32:52.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f773affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15d950 0x7f773c0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f773affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15d950 0x7f773c0b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:44420/0 (socket says 172.21.15.97:44420) 2024-09-19T05:32:52.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f773affd640 1 -- 172.21.15.97:0/3839482762 learned_addr learned my addr 172.21.15.97:0/3839482762 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:52.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f773b7fe640 1 --2- 172.21.15.97:0/3839482762 >> v2:172.21.15.97:3300/0 conn(0x7f773c15c210 0x7f773c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f773affd640 1 -- 172.21.15.97:0/3839482762 >> v2:172.21.15.97:3300/0 conn(0x7f773c15c210 msgr2=0x7f773c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:52.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f773affd640 1 --2- 172.21.15.97:0/3839482762 >> v2:172.21.15.97:3300/0 conn(0x7f773c15c210 0x7f773c15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f773affd640 1 -- 172.21.15.97:0/3839482762 >> v2:172.21.15.67:3300/0 conn(0x7f773c0cecd0 msgr2=0x7f773c0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:52.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f773affd640 1 --2- 172.21.15.97:0/3839482762 >> v2:172.21.15.67:3300/0 conn(0x7f773c0cecd0 0x7f773c0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.066+0000 7f773affd640 1 -- 172.21.15.97:0/3839482762 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773c15e670 con 0x7f773c15d950 2024-09-19T05:32:52.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f773affd640 1 --2- 172.21.15.97:0/3839482762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15d950 0x7f773c0b5ee0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f773c0d33e0 tx=0x7f772401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2df61da03a8a247 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:52.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f773a7fc640 1 -- 172.21.15.97:0/3839482762 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77240b2070 con 0x7f773c15d950 2024-09-19T05:32:52.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f773a7fc640 1 -- 172.21.15.97:0/3839482762 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77240a9070 con 0x7f773c15d950 2024-09-19T05:32:52.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f773a7fc640 1 -- 172.21.15.97:0/3839482762 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77240ad880 con 0x7f773c15d950 2024-09-19T05:32:52.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 -- 172.21.15.97:0/3839482762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15d950 msgr2=0x7f773c0b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 --2- 172.21.15.97:0/3839482762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15d950 0x7f773c0b5ee0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f773c0d33e0 tx=0x7f772401c490 comp rx=0 tx=0).stop 2024-09-19T05:32:52.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 -- 172.21.15.97:0/3839482762 shutdown_connections 2024-09-19T05:32:52.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 --2- 172.21.15.97:0/3839482762 >> v2:172.21.15.67:3300/0 conn(0x7f773c0cecd0 0x7f773c0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 --2- 172.21.15.97:0/3839482762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15d950 0x7f773c0b5ee0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 --2- 172.21.15.97:0/3839482762 >> v2:172.21.15.97:3300/0 conn(0x7f773c15c210 0x7f773c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 -- 172.21.15.97:0/3839482762 >> 172.21.15.97:0/3839482762 conn(0x7f773c0b7970 msgr2=0x7f773c0b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:52.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 -- 172.21.15.97:0/3839482762 shutdown_connections 2024-09-19T05:32:52.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 -- 172.21.15.97:0/3839482762 wait complete. 2024-09-19T05:32:52.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 Processor -- start 2024-09-19T05:32:52.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.070+0000 7f7741f14640 1 -- start start 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7741f14640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0cecd0 0x7f773c14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7741f14640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15c210 0x7f773c09d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7741f14640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f773c15d950 0x7f773c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7741f14640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f773c09b5d0 con 0x7f773c0cecd0 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7741f14640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f773c09b450 con 0x7f773c15d950 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7741f14640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f773c09b750 con 0x7f773c15c210 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15c210 0x7f773c09d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f773c15d950 0x7f773c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15c210 0x7f773c09d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:44430/0 (socket says 172.21.15.97:44430) 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773affd640 1 -- 172.21.15.97:0/2430151629 learned_addr learned my addr 172.21.15.97:0/2430151629 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773b7fe640 1 --2- 172.21.15.97:0/2430151629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0cecd0 0x7f773c14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773affd640 1 -- 172.21.15.97:0/2430151629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f773c15d950 msgr2=0x7f773c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773affd640 1 --2- 172.21.15.97:0/2430151629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f773c15d950 0x7f773c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773affd640 1 -- 172.21.15.97:0/2430151629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0cecd0 msgr2=0x7f773c14fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773affd640 1 --2- 172.21.15.97:0/2430151629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0cecd0 0x7f773c14fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773affd640 1 -- 172.21.15.97:0/2430151629 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773c09fe50 con 0x7f773c15c210 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773b7fe640 1 --2- 172.21.15.97:0/2430151629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0cecd0 0x7f773c14fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f773affd640 1 --2- 172.21.15.97:0/2430151629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15c210 0x7f773c09d260 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77240b0040 tx=0x7f7724019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7733fff640 1 -- 172.21.15.97:0/2430151629 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77240bc020 con 0x7f773c15c210 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7733fff640 1 -- 172.21.15.97:0/2430151629 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77240aedd0 con 0x7f773c15c210 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7733fff640 1 -- 172.21.15.97:0/2430151629 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77240b2040 con 0x7f773c15c210 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7741f14640 1 -- 172.21.15.97:0/2430151629 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f773c09c780 con 0x7f773c15c210 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7741f14640 1 -- 172.21.15.97:0/2430151629 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f773c09cd40 con 0x7f773c15c210 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7733fff640 1 -- 172.21.15.97:0/2430151629 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f77240bf020 con 0x7f773c15c210 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7733fff640 1 -- 172.21.15.97:0/2430151629 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f77240c19d0 con 0x7f773c15c210 2024-09-19T05:32:52.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.074+0000 7f7741f14640 1 -- 172.21.15.97:0/2430151629 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f773c15c5f0 con 0x7f773c15c210 2024-09-19T05:32:52.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.078+0000 7f7733fff640 1 -- 172.21.15.97:0/2430151629 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f77240c6030 con 0x7f773c15c210 2024-09-19T05:32:52.137 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:52.134+0000 7f2e59602180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:32:52.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.146+0000 7f7741f14640 1 -- 172.21.15.97:0/2430151629 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "18ec9c58-2074-4265-b302-5f366c996986", "id": 5} v 0) -- 0x7f773c0af210 con 0x7f773c15c210 2024-09-19T05:32:52.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.154+0000 7f7733fff640 1 -- 172.21.15.97:0/2430151629 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "18ec9c58-2074-4265-b302-5f366c996986", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f7724016110 con 0x7f773c15c210 2024-09-19T05:32:52.158 INFO:teuthology.orchestra.run.smithi097.stdout:5 2024-09-19T05:32:52.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.154+0000 7f7741f14640 1 -- 172.21.15.97:0/2430151629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15c210 msgr2=0x7f773c09d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.154+0000 7f7741f14640 1 --2- 172.21.15.97:0/2430151629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15c210 0x7f773c09d260 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77240b0040 tx=0x7f7724019230 comp rx=0 tx=0).stop 2024-09-19T05:32:52.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.154+0000 7f7741f14640 1 -- 172.21.15.97:0/2430151629 shutdown_connections 2024-09-19T05:32:52.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.154+0000 7f7741f14640 1 --2- 172.21.15.97:0/2430151629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f773c15d950 0x7f773c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.154+0000 7f7741f14640 1 --2- 172.21.15.97:0/2430151629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f773c15c210 0x7f773c09d260 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.154+0000 7f7741f14640 1 --2- 172.21.15.97:0/2430151629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0cecd0 0x7f773c14fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.154+0000 7f7741f14640 1 -- 172.21.15.97:0/2430151629 >> 172.21.15.97:0/2430151629 conn(0x7f773c0b7970 msgr2=0x7f773c15b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:52.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.154+0000 7f7741f14640 1 -- 172.21.15.97:0/2430151629 shutdown_connections 2024-09-19T05:32:52.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.154+0000 7f7741f14640 1 -- 172.21.15.97:0/2430151629 wait complete. 2024-09-19T05:32:52.172 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 55d1bccb-1876-4e18-a368-bd7c74ae178a 6 2024-09-19T05:32:52.193 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:52.190+0000 7f2e59602180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:32:52.272 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:52.270+0000 7f2e59602180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:32:52.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d2710c640 1 Processor -- start 2024-09-19T05:32:52.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d2710c640 1 -- start start 2024-09-19T05:32:52.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d2710c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d2006ccd0 0x7f7d2015ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d2710c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d200b4f00 0x7f7d20168070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d2710c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d2006fde0 con 0x7f7d2006f9a0 2024-09-19T05:32:52.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d2710c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7d2015f030 con 0x7f7d2006ccd0 2024-09-19T05:32:52.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d2710c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2015f310 con 0x7f7d200b4f00 2024-09-19T05:32:52.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d24ea8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d2006ccd0 0x7f7d2015ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d256a9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d200b4f00 0x7f7d20168070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d1ffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7d2006f9a0 0x7f7d2006d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57016/0 (socket says 172.21.15.97:57016) 2024-09-19T05:32:52.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d24ea8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d2006ccd0 0x7f7d2015ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:54040/0 (socket says 172.21.15.97:54040) 2024-09-19T05:32:52.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d1ffff640 1 -- 172.21.15.97:0/2475640933 learned_addr learned my addr 172.21.15.97:0/2475640933 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-19T05:32:52.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d256a9640 1 -- 172.21.15.97:0/2475640933 >> v2:172.21.15.97:3300/0 conn(0x7f7d2006ccd0 msgr2=0x7f7d2015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:52.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d256a9640 1 --2- 172.21.15.97:0/2475640933 >> v2:172.21.15.97:3300/0 conn(0x7f7d2006ccd0 0x7f7d2015ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d256a9640 1 -- 172.21.15.97:0/2475640933 >> v1:172.21.15.97:6789/0 conn(0x7f7d2006f9a0 legacy=0x7f7d2006d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/2475640933 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4011685902 0 0) 0x7f7d2006fde0 con 0x7f7d2006f9a0 2024-09-19T05:32:52.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d256a9640 1 -- 172.21.15.97:0/2475640933 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2015f5f0 con 0x7f7d200b4f00 2024-09-19T05:32:52.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.306+0000 7f7d24ea8640 1 --2- 172.21.15.97:0/2475640933 >> v2:172.21.15.97:3300/0 conn(0x7f7d2006ccd0 0x7f7d2015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:32:52.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d256a9640 1 --2- 172.21.15.97:0/2475640933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d200b4f00 0x7f7d20168070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009d90 tx=0x7f7d1801d3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9550defc8b7e0f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:52.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/2475640933 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d180b2070 con 0x7f7d200b4f00 2024-09-19T05:32:52.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/2475640933 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d180a5940 con 0x7f7d200b4f00 2024-09-19T05:32:52.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/2475640933 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d180a5d10 con 0x7f7d200b4f00 2024-09-19T05:32:52.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- 172.21.15.97:0/2475640933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d200b4f00 msgr2=0x7f7d20168070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 --2- 172.21.15.97:0/2475640933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d200b4f00 0x7f7d20168070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009d90 tx=0x7f7d1801d3d0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- 172.21.15.97:0/2475640933 shutdown_connections 2024-09-19T05:32:52.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 --2- 172.21.15.97:0/2475640933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d200b4f00 0x7f7d20168070 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 --2- 172.21.15.97:0/2475640933 >> v2:172.21.15.97:3300/0 conn(0x7f7d2006ccd0 0x7f7d2015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- 172.21.15.97:0/2475640933 >> 172.21.15.97:0/2475640933 conn(0x7f7d200727b0 msgr2=0x7f7d20072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:52.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- 172.21.15.97:0/2475640933 shutdown_connections 2024-09-19T05:32:52.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- 172.21.15.97:0/2475640933 wait complete. 2024-09-19T05:32:52.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 Processor -- start 2024-09-19T05:32:52.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- start start 2024-09-19T05:32:52.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d2006ccd0 0x7f7d201576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d2006f9a0 0x7f7d2013ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d200b4f00 0x7f7d20140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2016add0 con 0x7f7d2006ccd0 2024-09-19T05:32:52.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7d200b0380 con 0x7f7d200b4f00 2024-09-19T05:32:52.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2016af50 con 0x7f7d2006f9a0 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d256a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d200b4f00 0x7f7d20140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d1ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d2006f9a0 0x7f7d2013ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d256a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d200b4f00 0x7f7d20140460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:54054/0 (socket says 172.21.15.97:54054) 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d256a9640 1 -- 172.21.15.97:0/2759614712 learned_addr learned my addr 172.21.15.97:0/2759614712 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d24ea8640 1 --2- 172.21.15.97:0/2759614712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d2006ccd0 0x7f7d201576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d256a9640 1 -- 172.21.15.97:0/2759614712 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d2006f9a0 msgr2=0x7f7d2013ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d256a9640 1 --2- 172.21.15.97:0/2759614712 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d2006f9a0 0x7f7d2013ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d256a9640 1 -- 172.21.15.97:0/2759614712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d2006ccd0 msgr2=0x7f7d201576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d256a9640 1 --2- 172.21.15.97:0/2759614712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d2006ccd0 0x7f7d201576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d256a9640 1 -- 172.21.15.97:0/2759614712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d20151160 con 0x7f7d200b4f00 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d24ea8640 1 --2- 172.21.15.97:0/2759614712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d2006ccd0 0x7f7d201576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:32:52.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d256a9640 1 --2- 172.21.15.97:0/2759614712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d200b4f00 0x7f7d20140460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7d180b0040 tx=0x7f7d18019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:52.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d1d7fa640 1 -- 172.21.15.97:0/2759614712 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d180b2040 con 0x7f7d200b4f00 2024-09-19T05:32:52.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d1d7fa640 1 -- 172.21.15.97:0/2759614712 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d180ad440 con 0x7f7d200b4f00 2024-09-19T05:32:52.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d1d7fa640 1 -- 172.21.15.97:0/2759614712 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d180ad830 con 0x7f7d200b4f00 2024-09-19T05:32:52.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- 172.21.15.97:0/2759614712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d20151440 con 0x7f7d200b4f00 2024-09-19T05:32:52.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d2710c640 1 -- 172.21.15.97:0/2759614712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d200cd590 con 0x7f7d200b4f00 2024-09-19T05:32:52.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d1d7fa640 1 -- 172.21.15.97:0/2759614712 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d180c0030 con 0x7f7d200b4f00 2024-09-19T05:32:52.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.310+0000 7f7d1d7fa640 1 -- 172.21.15.97:0/2759614712 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f7d180046b0 con 0x7f7d200b4f00 2024-09-19T05:32:52.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.314+0000 7f7d2710c640 1 -- 172.21.15.97:0/2759614712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d20151960 con 0x7f7d200b4f00 2024-09-19T05:32:52.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.314+0000 7f7d1d7fa640 1 -- 172.21.15.97:0/2759614712 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7d20151960 con 0x7f7d200b4f00 2024-09-19T05:32:52.335 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:52.334+0000 7f2e59602180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:32:52.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.394+0000 7f7d2710c640 1 -- 172.21.15.97:0/2759614712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "55d1bccb-1876-4e18-a368-bd7c74ae178a", "id": 6} v 0) -- 0x7f7d2015ea50 con 0x7f7d200b4f00 2024-09-19T05:32:52.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.398+0000 7f7d1d7fa640 1 -- 172.21.15.97:0/2759614712 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "55d1bccb-1876-4e18-a368-bd7c74ae178a", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7d180c7020 con 0x7f7d200b4f00 2024-09-19T05:32:52.401 INFO:teuthology.orchestra.run.smithi097.stdout:6 2024-09-19T05:32:52.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.398+0000 7f7d2710c640 1 -- 172.21.15.97:0/2759614712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d200b4f00 msgr2=0x7f7d20140460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.398+0000 7f7d2710c640 1 --2- 172.21.15.97:0/2759614712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d200b4f00 0x7f7d20140460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7d180b0040 tx=0x7f7d18019710 comp rx=0 tx=0).stop 2024-09-19T05:32:52.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.398+0000 7f7d2710c640 1 -- 172.21.15.97:0/2759614712 shutdown_connections 2024-09-19T05:32:52.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.398+0000 7f7d2710c640 1 --2- 172.21.15.97:0/2759614712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d200b4f00 0x7f7d20140460 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.398+0000 7f7d2710c640 1 --2- 172.21.15.97:0/2759614712 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d2006f9a0 0x7f7d2013ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.398+0000 7f7d2710c640 1 --2- 172.21.15.97:0/2759614712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d2006ccd0 0x7f7d201576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.398+0000 7f7d2710c640 1 -- 172.21.15.97:0/2759614712 >> 172.21.15.97:0/2759614712 conn(0x7f7d200727b0 msgr2=0x7f7d200b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:52.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.398+0000 7f7d2710c640 1 -- 172.21.15.97:0/2759614712 shutdown_connections 2024-09-19T05:32:52.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.398+0000 7f7d2710c640 1 -- 172.21.15.97:0/2759614712 wait complete. 2024-09-19T05:32:52.418 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 0afdef64-e7cc-4586-94ea-75283cd56966 7 2024-09-19T05:32:52.497 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:52.494+0000 7f2e59602180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:32:52.662 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:52.612+0000 7f062403a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:32:52.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.530+0000 7f4d7557d640 1 Processor -- start 2024-09-19T05:32:52.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.530+0000 7f4d7557d640 1 -- start start 2024-09-19T05:32:52.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d7557d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4d7015ea00 0x7f4d700b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d7557d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4d700b2910 0x7f4d700cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d7557d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d700b3c20 con 0x7f4d700cf560 2024-09-19T05:32:52.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d7557d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4d700b1940 con 0x7f4d7015ea00 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d7557d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4d700cfa20 con 0x7f4d700b2910 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4d700b2910 0x7f4d700cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4d700b2910 0x7f4d700cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:54062/0 (socket says 172.21.15.97:54062) 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6f7fe640 1 -- 172.21.15.97:0/1015721438 learned_addr learned my addr 172.21.15.97:0/1015721438 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6effd640 1 --2- 172.21.15.97:0/1015721438 >> v2:172.21.15.67:3300/0 conn(0x7f4d7015ea00 0x7f4d700b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6f7fe640 1 -- 172.21.15.97:0/1015721438 >> v2:172.21.15.67:3300/0 conn(0x7f4d7015ea00 msgr2=0x7f4d700b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6f7fe640 1 --2- 172.21.15.97:0/1015721438 >> v2:172.21.15.67:3300/0 conn(0x7f4d7015ea00 0x7f4d700b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6f7fe640 1 -- 172.21.15.97:0/1015721438 >> v1:172.21.15.67:6789/0 conn(0x7f4d700cf560 legacy=0x7f4d700b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6f7fe640 1 -- 172.21.15.97:0/1015721438 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d700b1b60 con 0x7f4d700b2910 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6f7fe640 1 --2- 172.21.15.97:0/1015721438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d700b2910 0x7f4d700cbfb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4d700cfba0 tx=0x7f4d6801c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d9cb525a020f84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6dffb640 1 -- 172.21.15.97:0/1015721438 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d680a57d0 con 0x7f4d700b2910 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6dffb640 1 -- 172.21.15.97:0/1015721438 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d680a5970 con 0x7f4d700b2910 2024-09-19T05:32:52.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.534+0000 7f4d6dffb640 1 -- 172.21.15.97:0/1015721438 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d680a5d40 con 0x7f4d700b2910 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 -- 172.21.15.97:0/1015721438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d700b2910 msgr2=0x7f4d700cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 --2- 172.21.15.97:0/1015721438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d700b2910 0x7f4d700cbfb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4d700cfba0 tx=0x7f4d6801c9f0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 -- 172.21.15.97:0/1015721438 shutdown_connections 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 --2- 172.21.15.97:0/1015721438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d700b2910 0x7f4d700cbfb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 --2- 172.21.15.97:0/1015721438 >> v2:172.21.15.67:3300/0 conn(0x7f4d7015ea00 0x7f4d700b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 -- 172.21.15.97:0/1015721438 >> 172.21.15.97:0/1015721438 conn(0x7f4d7009aa30 msgr2=0x7f4d700b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 -- 172.21.15.97:0/1015721438 shutdown_connections 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 -- 172.21.15.97:0/1015721438 wait complete. 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 Processor -- start 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 -- start start 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d700b2910 0x7f4d7015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d700cf560 0x7f4d701f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d7015ea00 0x7f4d700c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4d700cce80 con 0x7f4d7015ea00 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4d700ccd00 con 0x7f4d700b2910 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4d700cd000 con 0x7f4d700cf560 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6e7fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d700cf560 0x7f4d701f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6e7fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d700cf560 0x7f4d701f77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:44452/0 (socket says 172.21.15.97:44452) 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6e7fc640 1 -- 172.21.15.97:0/4099936744 learned_addr learned my addr 172.21.15.97:0/4099936744 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6effd640 1 --2- 172.21.15.97:0/4099936744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d700b2910 0x7f4d7015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6f7fe640 1 --2- 172.21.15.97:0/4099936744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d7015ea00 0x7f4d700c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6e7fc640 1 -- 172.21.15.97:0/4099936744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d700b2910 msgr2=0x7f4d7015a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6e7fc640 1 --2- 172.21.15.97:0/4099936744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d700b2910 0x7f4d7015a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6e7fc640 1 -- 172.21.15.97:0/4099936744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d7015ea00 msgr2=0x7f4d700c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6e7fc640 1 --2- 172.21.15.97:0/4099936744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d7015ea00 0x7f4d700c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6e7fc640 1 -- 172.21.15.97:0/4099936744 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7015a890 con 0x7f4d700cf560 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6effd640 1 --2- 172.21.15.97:0/4099936744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d700b2910 0x7f4d7015a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d6e7fc640 1 --2- 172.21.15.97:0/4099936744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d700cf560 0x7f4d701f77e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c420 tx=0x7f4d6400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d577fe640 1 -- 172.21.15.97:0/4099936744 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d640052d0 con 0x7f4d700cf560 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d577fe640 1 -- 172.21.15.97:0/4099936744 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d64005470 con 0x7f4d700cf560 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d577fe640 1 -- 172.21.15.97:0/4099936744 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64007260 con 0x7f4d700cf560 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.538+0000 7f4d7557d640 1 -- 172.21.15.97:0/4099936744 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7015ab70 con 0x7f4d700cf560 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.542+0000 7f4d7557d640 1 -- 172.21.15.97:0/4099936744 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7015b130 con 0x7f4d700cf560 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.542+0000 7f4d577fe640 1 -- 172.21.15.97:0/4099936744 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4d64007400 con 0x7f4d700cf560 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.542+0000 7f4d577fe640 1 -- 172.21.15.97:0/4099936744 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f4d64011bf0 con 0x7f4d700cf560 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.542+0000 7f4d7557d640 1 -- 172.21.15.97:0/4099936744 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d700cbfb0 con 0x7f4d700cf560 2024-09-19T05:32:52.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.546+0000 7f4d577fe640 1 -- 172.21.15.97:0/4099936744 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4d700b3c20 con 0x7f4d700cf560 2024-09-19T05:32:52.671 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:52.558+0000 7f2e59602180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:32:52.671 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:52.668+0000 7f062403a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:32:52.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.610+0000 7f4d7557d640 1 -- 172.21.15.97:0/4099936744 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0afdef64-e7cc-4586-94ea-75283cd56966", "id": 7} v 0) -- 0x7f4d701592a0 con 0x7f4d700cf560 2024-09-19T05:32:52.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.618+0000 7f4d577fe640 1 -- 172.21.15.97:0/4099936744 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0afdef64-e7cc-4586-94ea-75283cd56966", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f4d640039c0 con 0x7f4d700cf560 2024-09-19T05:32:52.672 INFO:teuthology.orchestra.run.smithi097.stdout:7 2024-09-19T05:32:52.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.618+0000 7f4d7557d640 1 -- 172.21.15.97:0/4099936744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d700cf560 msgr2=0x7f4d701f77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.618+0000 7f4d7557d640 1 --2- 172.21.15.97:0/4099936744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d700cf560 0x7f4d701f77e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c420 tx=0x7f4d6400c8e0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.618+0000 7f4d7557d640 1 -- 172.21.15.97:0/4099936744 shutdown_connections 2024-09-19T05:32:52.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.618+0000 7f4d7557d640 1 --2- 172.21.15.97:0/4099936744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d7015ea00 0x7f4d700c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.618+0000 7f4d7557d640 1 --2- 172.21.15.97:0/4099936744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d700cf560 0x7f4d701f77e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.618+0000 7f4d7557d640 1 --2- 172.21.15.97:0/4099936744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d700b2910 0x7f4d7015a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.618+0000 7f4d7557d640 1 -- 172.21.15.97:0/4099936744 >> 172.21.15.97:0/4099936744 conn(0x7f4d7009aa30 msgr2=0x7f4d7015cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:52.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.618+0000 7f4d7557d640 1 -- 172.21.15.97:0/4099936744 shutdown_connections 2024-09-19T05:32:52.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:32:52.618+0000 7f4d7557d640 1 -- 172.21.15.97:0/4099936744 wait complete. 2024-09-19T05:32:52.674 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-19T05:32:52.674 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-19T05:32:52.676 INFO:tasks.ceph.osd.0:Started 2024-09-19T05:32:52.676 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-19T05:32:52.677 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-19T05:32:52.679 INFO:tasks.ceph.osd.1:Started 2024-09-19T05:32:52.679 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-19T05:32:52.680 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-19T05:32:52.682 INFO:tasks.ceph.osd.2:Started 2024-09-19T05:32:52.682 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-19T05:32:52.682 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-19T05:32:52.685 INFO:tasks.ceph.osd.3:Started 2024-09-19T05:32:52.685 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-19T05:32:52.685 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-19T05:32:52.687 INFO:tasks.ceph.osd.4:Started 2024-09-19T05:32:52.687 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-19T05:32:52.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-19T05:32:52.690 INFO:tasks.ceph.osd.5:Started 2024-09-19T05:32:52.690 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-19T05:32:52.690 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-19T05:32:52.692 INFO:tasks.ceph.osd.6:Started 2024-09-19T05:32:52.692 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-19T05:32:52.692 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-19T05:32:52.694 INFO:tasks.ceph.osd.7:Started 2024-09-19T05:32:52.694 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:32:52.736 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:52.732+0000 7f062403a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:32:52.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f1717200640 1 Processor -- start 2024-09-19T05:32:52.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f1717200640 1 -- start start 2024-09-19T05:32:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f1717200640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f171015f830 0x7f17100ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f1717200640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17100cdea0 0x7f17100d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f1717200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1710071e50 con 0x7f17100d0720 2024-09-19T05:32:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f1717200640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f17100d10a0 con 0x7f17100cdea0 2024-09-19T05:32:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f1717200640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1710072130 con 0x7f171015f830 2024-09-19T05:32:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f17100d0720 0x7f171015ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38422/0 (socket says 172.21.15.67:38422) 2024-09-19T05:32:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170ffff640 1 -- 172.21.15.67:0/992423180 learned_addr learned my addr 172.21.15.67:0/992423180 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:32:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f1714f9c640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f171015f830 0x7f17100ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811994376 0 0) 0x7f1710071e50 con 0x7f17100d0720 2024-09-19T05:32:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f171579d640 1 --2- 172.21.15.67:0/992423180 >> v2:172.21.15.97:3300/0 conn(0x7f17100cdea0 0x7f17100d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16fc003530 con 0x7f17100d0720 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4026399062 0 0) 0x7f16fc003530 con 0x7f17100d0720 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f171015f830 msgr2=0x7f17100ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f171015f830 0x7f17100ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 >> v2:172.21.15.97:3300/0 conn(0x7f17100cdea0 msgr2=0x7f17100d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 --2- 172.21.15.67:0/992423180 >> v2:172.21.15.97:3300/0 conn(0x7f17100cdea0 0x7f17100d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1710070bd0 con 0x7f17100d0720 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f16f8001680 con 0x7f17100d0720 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 >> v1:172.21.15.67:6789/0 conn(0x7f17100d0720 legacy=0x7f171015ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0039c0 0x7f16fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 0x7f16fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f171015f830 0x7f16fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f17100d10a0 con 0x7f16fc004810 2024-09-19T05:32:52.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1710072130 con 0x7f16fc0039c0 2024-09-19T05:32:52.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f16fc00b9d0 con 0x7f171015f830 2024-09-19T05:32:52.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170ffff640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 0x7f16fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f1714f9c640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0039c0 0x7f16fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f171579d640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f171015f830 0x7f16fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170ffff640 1 -- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f171015f830 msgr2=0x7f16fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:52.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170ffff640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f171015f830 0x7f16fc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170ffff640 1 -- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0039c0 msgr2=0x7f16fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:52.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170ffff640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0039c0 0x7f16fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.816+0000 7f170ffff640 1 -- 172.21.15.67:0/992423180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16fc003530 con 0x7f16fc004810 2024-09-19T05:32:52.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f170ffff640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 0x7f16fc004c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c210 tx=0x7f16f801f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629ed208c764bd5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:52.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8007d60 con 0x7f16fc004810 2024-09-19T05:32:52.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f8005ae0 con 0x7f16fc004810 2024-09-19T05:32:52.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f170f7fe640 1 -- 172.21.15.67:0/992423180 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8007070 con 0x7f16fc004810 2024-09-19T05:32:52.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f1717200640 1 -- 172.21.15.67:0/992423180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 msgr2=0x7f16fc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f1717200640 1 --2- 172.21.15.67:0/992423180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 0x7f16fc004c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c210 tx=0x7f16f801f3f0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f171579d640 1 -- 172.21.15.67:0/992423180 reap_dead start 2024-09-19T05:32:52.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f1717200640 1 -- 172.21.15.67:0/992423180 shutdown_connections 2024-09-19T05:32:52.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f1717200640 1 -- 172.21.15.67:0/992423180 >> 172.21.15.67:0/992423180 conn(0x7f17100d22d0 msgr2=0x7f17100d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:52.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f1717200640 1 -- 172.21.15.67:0/992423180 shutdown_connections 2024-09-19T05:32:52.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f1717200640 1 -- 172.21.15.67:0/992423180 wait complete. 2024-09-19T05:32:52.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f1717200640 1 Processor -- start 2024-09-19T05:32:52.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.820+0000 7f1717200640 1 -- start start 2024-09-19T05:32:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1717200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 0x7f171014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1717200640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17100cb090 0x7f17100b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1717200640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17100b0980 0x7f17100c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1717200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1710071b50 con 0x7f16fc004810 2024-09-19T05:32:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1717200640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1710071190 con 0x7f17100cb090 2024-09-19T05:32:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1717200640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f17100b18a0 con 0x7f17100b0980 2024-09-19T05:32:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1714f9c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 0x7f171014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1714f9c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 0x7f171014a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60836/0 (socket says 172.21.15.67:60836) 2024-09-19T05:32:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1714f9c640 1 -- 172.21.15.67:0/357574962 learned_addr learned my addr 172.21.15.67:0/357574962 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:32:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f170ffff640 1 --2- 172.21.15.67:0/357574962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17100cb090 0x7f17100b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f171579d640 1 --2- 172.21.15.67:0/357574962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17100b0980 0x7f17100c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1714f9c640 1 -- 172.21.15.67:0/357574962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17100b0980 msgr2=0x7f17100c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1714f9c640 1 --2- 172.21.15.67:0/357574962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17100b0980 0x7f17100c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1714f9c640 1 -- 172.21.15.67:0/357574962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17100cb090 msgr2=0x7f17100b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1714f9c640 1 --2- 172.21.15.67:0/357574962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17100cb090 0x7f17100b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1714f9c640 1 -- 172.21.15.67:0/357574962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17100c9ff0 con 0x7f16fc004810 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1714f9c640 1 --2- 172.21.15.67:0/357574962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 0x7f171014a900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1708009f90 tx=0x7f170800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f170d7fa640 1 -- 172.21.15.67:0/357574962 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708015430 con 0x7f16fc004810 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f170d7fa640 1 -- 172.21.15.67:0/357574962 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17080155d0 con 0x7f16fc004810 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1717200640 1 -- 172.21.15.67:0/357574962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17100ca2d0 con 0x7f16fc004810 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f170d7fa640 1 -- 172.21.15.67:0/357574962 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17080159c0 con 0x7f16fc004810 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1717200640 1 -- 172.21.15.67:0/357574962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17100ca890 con 0x7f16fc004810 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f170d7fa640 1 -- 172.21.15.67:0/357574962 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1708015b60 con 0x7f16fc004810 2024-09-19T05:32:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f170d7fa640 1 -- 172.21.15.67:0/357574962 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f17080143b0 con 0x7f16fc004810 2024-09-19T05:32:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.824+0000 7f1717200640 1 -- 172.21.15.67:0/357574962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17100b0d90 con 0x7f16fc004810 2024-09-19T05:32:52.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.828+0000 7f170d7fa640 1 -- 172.21.15.67:0/357574962 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f17100b0d90 con 0x7f16fc004810 2024-09-19T05:32:52.835 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:52.832+0000 7f062403a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:32:52.891 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f062403a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:32:52.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f1717200640 1 -- 172.21.15.67:0/357574962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f171015fc10 con 0x7f16fc004810 2024-09-19T05:32:52.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f170d7fa640 1 -- 172.21.15.67:0/357574962 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1708019030 con 0x7f16fc004810 2024-09-19T05:32:52.892 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:32:52.893 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":10,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:32:52.616116+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:32:52.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f1717200640 1 -- 172.21.15.67:0/357574962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 msgr2=0x7f171014a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f1717200640 1 --2- 172.21.15.67:0/357574962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 0x7f171014a900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1708009f90 tx=0x7f170800f580 comp rx=0 tx=0).stop 2024-09-19T05:32:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f1717200640 1 -- 172.21.15.67:0/357574962 shutdown_connections 2024-09-19T05:32:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f1717200640 1 --2- 172.21.15.67:0/357574962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17100b0980 0x7f17100c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f1717200640 1 --2- 172.21.15.67:0/357574962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17100cb090 0x7f17100b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f1717200640 1 --2- 172.21.15.67:0/357574962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16fc004810 0x7f171014a900 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f1717200640 1 -- 172.21.15.67:0/357574962 >> 172.21.15.67:0/357574962 conn(0x7f17100d22d0 msgr2=0x7f17101606c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f1717200640 1 -- 172.21.15.67:0/357574962 shutdown_connections 2024-09-19T05:32:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:32:52.888+0000 7f1717200640 1 -- 172.21.15.67:0/357574962 wait complete. 2024-09-19T05:32:52.909 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-19T05:32:52.909 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-19T05:32:52.974 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:52.968+0000 7f062403a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:32:53.029 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:53.024+0000 7f062403a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:32:53.188 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:53.184+0000 7f062403a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:32:53.189 INFO:tasks.ceph.mgr.x.smithi097.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-19T05:32:53.189 INFO:tasks.ceph.mgr.x.smithi097.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-19T05:32:53.189 INFO:tasks.ceph.mgr.x.smithi097.stderr: from numpy import show_config as show_numpy_config 2024-09-19T05:32:53.253 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:53.248+0000 7f062403a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:32:53.257 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:53.254+0000 7f2e59602180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:32:53.416 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:53.414+0000 7f2e59602180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:32:53.577 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:53.574+0000 7f2e59602180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:32:53.640 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:53.638+0000 7f2e59602180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:32:53.716 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T05:32:53.774 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:53.770+0000 7f2e59602180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:32:53.776 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-09-19T05:32:53.774+0000 7fdd587c87c0 -1 Falling back to public interface 2024-09-19T05:32:53.777 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-09-19T05:32:53.774+0000 7f14ede807c0 -1 Falling back to public interface 2024-09-19T05:32:53.777 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-09-19T05:32:53.774+0000 7f14ece40640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6807/0: (98) Address already in use 2024-09-19T05:32:53.779 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-09-19T05:32:53.778+0000 7fba140ff7c0 -1 Falling back to public interface 2024-09-19T05:32:53.827 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb697fb2640 1 Processor -- start 2024-09-19T05:32:53.828 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb697fb2640 1 -- start start 2024-09-19T05:32:53.829 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb697fb2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb690161dd0 0x7fb6900d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:53.829 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb697fb2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb6900d0190 0x7fb6900b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:53.829 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb697fb2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6901621b0 con 0x7fb6900d1360 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb697fb2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb6900d17a0 con 0x7fb6900d0190 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb697fb2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb6900b5a80 con 0x7fb690161dd0 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb695d4e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb690161dd0 0x7fb6900d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb69554d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb6900d1360 0x7fb6900b3ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:46602/0 (socket says 172.21.15.67:46602) 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb695d4e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb690161dd0 0x7fb6900d0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:58398/0 (socket says 172.21.15.67:58398) 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb69554d640 1 -- 172.21.15.67:0/3627022194 learned_addr learned my addr 172.21.15.67:0/3627022194 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb69654f640 1 --2- 172.21.15.67:0/3627022194 >> v2:172.21.15.97:3300/0 conn(0x7fb6900d0190 0x7fb6900b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb694d4c640 1 -- 172.21.15.67:0/3627022194 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610769144 0 0) 0x7fb6901621b0 con 0x7fb6900d1360 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb694d4c640 1 -- 172.21.15.67:0/3627022194 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb678003530 con 0x7fb6900d1360 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb695d4e640 1 -- 172.21.15.67:0/3627022194 >> v2:172.21.15.97:3300/0 conn(0x7fb6900d0190 msgr2=0x7fb6900b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:32:53.830 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb695d4e640 1 --2- 172.21.15.67:0/3627022194 >> v2:172.21.15.97:3300/0 conn(0x7fb6900d0190 0x7fb6900b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:53.831 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb695d4e640 1 -- 172.21.15.67:0/3627022194 >> v1:172.21.15.97:6789/0 conn(0x7fb6900d1360 legacy=0x7fb6900b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:53.831 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.824+0000 7fb695d4e640 1 -- 172.21.15.67:0/3627022194 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6900d2a00 con 0x7fb690161dd0 2024-09-19T05:32:53.831 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fdb7b5dd7c0 -1 Falling back to public interface 2024-09-19T05:32:53.832 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb695d4e640 1 --2- 172.21.15.67:0/3627022194 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb690161dd0 0x7fb6900d0e20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb688009d90 tx=0x7fb68801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d52f6965e2a714a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:53.832 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb694d4c640 1 -- 172.21.15.67:0/3627022194 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6880b2070 con 0x7fb690161dd0 2024-09-19T05:32:53.832 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb694d4c640 1 -- 172.21.15.67:0/3627022194 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6880a5920 con 0x7fb690161dd0 2024-09-19T05:32:53.833 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb694d4c640 1 -- 172.21.15.67:0/3627022194 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6880a5cf0 con 0x7fb690161dd0 2024-09-19T05:32:53.833 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb697fb2640 1 -- 172.21.15.67:0/3627022194 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb690161dd0 msgr2=0x7fb6900d0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:53.833 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb697fb2640 1 --2- 172.21.15.67:0/3627022194 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb690161dd0 0x7fb6900d0e20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb688009d90 tx=0x7fb68801c970 comp rx=0 tx=0).stop 2024-09-19T05:32:53.833 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb697fb2640 1 -- 172.21.15.67:0/3627022194 shutdown_connections 2024-09-19T05:32:53.833 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb697fb2640 1 --2- 172.21.15.67:0/3627022194 >> v2:172.21.15.97:3300/0 conn(0x7fb6900d0190 0x7fb6900b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:53.833 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb697fb2640 1 --2- 172.21.15.67:0/3627022194 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb690161dd0 0x7fb6900d0e20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:53.833 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb697fb2640 1 -- 172.21.15.67:0/3627022194 >> 172.21.15.67:0/3627022194 conn(0x7fb69008bff0 msgr2=0x7fb6900d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:53.833 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb697fb2640 1 -- 172.21.15.67:0/3627022194 shutdown_connections 2024-09-19T05:32:53.833 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.828+0000 7fb697fb2640 1 -- 172.21.15.67:0/3627022194 wait complete. 2024-09-19T05:32:53.834 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 Processor -- start 2024-09-19T05:32:53.834 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 -- start start 2024-09-19T05:32:53.837 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6900d0190 0x7fb6900cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:53.837 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb6900d1360 0x7fb69015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:53.837 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb690161dd0 0x7fb690155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb6900d34e0 con 0x7fb6900d0190 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb6900b5710 con 0x7fb690161dd0 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb6900d3660 con 0x7fb6900d1360 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb695d4e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6900d0190 0x7fb6900cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb695d4e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6900d0190 0x7fb6900cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60842/0 (socket says 172.21.15.67:60842) 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb69554d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb6900d1360 0x7fb69015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb695d4e640 1 -- 172.21.15.67:0/3155867405 learned_addr learned my addr 172.21.15.67:0/3155867405 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb69654f640 1 --2- 172.21.15.67:0/3155867405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb690161dd0 0x7fb690155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb69554d640 1 -- 172.21.15.67:0/3155867405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb690161dd0 msgr2=0x7fb690155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb69554d640 1 --2- 172.21.15.67:0/3155867405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb690161dd0 0x7fb690155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb69554d640 1 -- 172.21.15.67:0/3155867405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6900d0190 msgr2=0x7fb6900cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:53.838 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb69554d640 1 --2- 172.21.15.67:0/3155867405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6900d0190 0x7fb6900cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb69554d640 1 -- 172.21.15.67:0/3155867405 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6900ccbe0 con 0x7fb6900d1360 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb695d4e640 1 --2- 172.21.15.67:0/3155867405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6900d0190 0x7fb6900cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb69554d640 1 --2- 172.21.15.67:0/3155867405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb6900d1360 0x7fb69015ada0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb680007fd0 tx=0x7fb68000c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb68e7fc640 1 -- 172.21.15.67:0/3155867405 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680017070 con 0x7fb6900d1360 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb68e7fc640 1 -- 172.21.15.67:0/3155867405 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb680005cf0 con 0x7fb6900d1360 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 -- 172.21.15.67:0/3155867405 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6900ccec0 con 0x7fb6900d1360 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb68e7fc640 1 -- 172.21.15.67:0/3155867405 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6800072f0 con 0x7fb6900d1360 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 -- 172.21.15.67:0/3155867405 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6900cd480 con 0x7fb6900d1360 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb68e7fc640 1 -- 172.21.15.67:0/3155867405 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb68001a070 con 0x7fb6900d1360 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb68e7fc640 1 -- 172.21.15.67:0/3155867405 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb680007490 con 0x7fb6900d1360 2024-09-19T05:32:53.839 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.832+0000 7fb697fb2640 1 -- 172.21.15.67:0/3155867405 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6900cd680 con 0x7fb6900d1360 2024-09-19T05:32:53.840 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.836+0000 7fb68e7fc640 1 -- 172.21.15.67:0/3155867405 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb6900cd680 con 0x7fb6900d1360 2024-09-19T05:32:53.859 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-19T05:32:53.856+0000 7fdabcff27c0 -1 Falling back to public interface 2024-09-19T05:32:53.900 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.896+0000 7fb697fb2640 1 -- 172.21.15.67:0/3155867405 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6900b3400 con 0x7fb6900d1360 2024-09-19T05:32:53.901 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.896+0000 7fb68e7fc640 1 -- 172.21.15.67:0/3155867405 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb680021020 con 0x7fb6900d1360 2024-09-19T05:32:53.901 INFO:teuthology.misc.health.smithi067.stdout: 2024-09-19T05:32:53.902 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":10,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:32:52.616116+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:32:53.903 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.900+0000 7fb697fb2640 1 -- 172.21.15.67:0/3155867405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb6900d1360 msgr2=0x7fb69015ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:32:53.903 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.900+0000 7fb697fb2640 1 --2- 172.21.15.67:0/3155867405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb6900d1360 0x7fb69015ada0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb680007fd0 tx=0x7fb68000c890 comp rx=0 tx=0).stop 2024-09-19T05:32:53.903 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.900+0000 7fb697fb2640 1 -- 172.21.15.67:0/3155867405 shutdown_connections 2024-09-19T05:32:53.903 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.900+0000 7fb697fb2640 1 --2- 172.21.15.67:0/3155867405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb690161dd0 0x7fb690155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:53.903 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.900+0000 7fb697fb2640 1 --2- 172.21.15.67:0/3155867405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb6900d1360 0x7fb69015ada0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:53.904 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.900+0000 7fb697fb2640 1 --2- 172.21.15.67:0/3155867405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6900d0190 0x7fb6900cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:32:53.904 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.900+0000 7fb697fb2640 1 -- 172.21.15.67:0/3155867405 >> 172.21.15.67:0/3155867405 conn(0x7fb69008bff0 msgr2=0x7fb6900d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:32:53.904 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.900+0000 7fb697fb2640 1 -- 172.21.15.67:0/3155867405 shutdown_connections 2024-09-19T05:32:53.904 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:32:53.900+0000 7fb697fb2640 1 -- 172.21.15.67:0/3155867405 wait complete. 2024-09-19T05:32:53.917 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T05:32:53.919 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-19T05:32:53.916+0000 7fe0642177c0 -1 Falling back to public interface 2024-09-19T05:32:53.961 INFO:tasks.ceph.mgr.y.smithi067.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-19T05:32:53.961 INFO:tasks.ceph.mgr.y.smithi067.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-19T05:32:53.961 INFO:tasks.ceph.mgr.y.smithi067.stderr: from numpy import show_config as show_numpy_config 2024-09-19T05:32:54.008 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:54.004+0000 7f062403a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:32:54.056 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-09-19T05:32:54.054+0000 7f18f83c07c0 -1 Falling back to public interface 2024-09-19T05:32:54.149 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:54.144+0000 7f062403a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:32:54.312 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:54.308+0000 7f062403a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:32:54.380 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:54.376+0000 7f062403a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:32:54.384 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:54.382+0000 7f2e59602180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:32:54.459 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:54.454+0000 7f2e59602180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:32:54.523 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:54.520+0000 7f062403a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:32:54.600 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-19T05:32:54.596+0000 7f93d944f7c0 -1 Falling back to public interface 2024-09-19T05:32:54.640 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:54.638+0000 7f2e59602180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:32:54.714 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:54.710+0000 7f2e59602180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:32:55.006 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:55.002+0000 7f2e59602180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:32:55.069 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:55.066+0000 7f2e59602180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:32:55.164 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:55.160+0000 7f062403a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:32:55.244 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:55.240+0000 7f062403a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:32:55.437 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:55.432+0000 7f062403a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:32:55.528 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:55.512+0000 7f062403a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:32:55.827 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:55.824+0000 7f062403a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:32:55.892 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-19T05:32:55.888+0000 7f062403a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:32:56.116 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:56.114+0000 7f2e00138640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T05:32:56.116 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-19T05:32:56.114+0000 7f2e00138640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T05:32:57.780 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-09-19T05:32:57.778+0000 7fdd587c87c0 -1 osd.6 0 log_to_monitors true 2024-09-19T05:32:57.897 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-19T05:32:57.896+0000 7fdb7b5dd7c0 -1 osd.3 0 log_to_monitors true 2024-09-19T05:32:57.904 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-09-19T05:32:57.902+0000 7f14ede807c0 -1 osd.4 0 log_to_monitors true 2024-09-19T05:32:57.958 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-19T05:32:57.956+0000 7fdabcff27c0 -1 osd.1 0 log_to_monitors true 2024-09-19T05:32:58.014 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-19T05:32:58.016+0000 7fe0642177c0 -1 osd.0 0 log_to_monitors true 2024-09-19T05:32:58.208 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-09-19T05:32:58.206+0000 7fba140ff7c0 -1 osd.7 0 log_to_monitors true 2024-09-19T05:32:58.433 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-09-19T05:32:58.430+0000 7f18f83c07c0 -1 osd.5 0 log_to_monitors true 2024-09-19T05:32:58.711 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-19T05:32:58.712+0000 7f93d944f7c0 -1 osd.2 0 log_to_monitors true 2024-09-19T05:33:00.724 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:00.858 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.856+0000 7f9c08765640 1 Processor -- start 2024-09-19T05:33:00.858 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.856+0000 7f9c08765640 1 -- start start 2024-09-19T05:33:00.859 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c08765640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c0006c3d0 0x7f9c000af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:00.859 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c08765640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c00146130 con 0x7f9c00145d50 2024-09-19T05:33:00.859 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c08765640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c000b36a0 con 0x7f9c0009aa60 2024-09-19T05:33:00.859 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c08765640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9c000b3980 con 0x7f9c0006c3d0 2024-09-19T05:33:00.859 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c05d00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c0006c3d0 0x7f9c000af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:00.859 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c05d00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c0006c3d0 0x7f9c000af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:32782/0 (socket says 172.21.15.67:32782) 2024-09-19T05:33:00.859 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c05d00640 1 -- 172.21.15.67:0/2059316605 learned_addr learned my addr 172.21.15.67:0/2059316605 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:00.860 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c05d00640 1 -- 172.21.15.67:0/2059316605 >> v1:172.21.15.97:6789/0 conn(0x7f9c0009aa60 legacy=0x7f9c0015ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:00.860 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c05d00640 1 -- 172.21.15.67:0/2059316605 >> v1:172.21.15.67:6789/0 conn(0x7f9c00145d50 legacy=0x7f9c0006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:00.860 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c05d00640 1 -- 172.21.15.67:0/2059316605 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c000b3c60 con 0x7f9c0006c3d0 2024-09-19T05:33:00.860 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c054ff640 1 -- 172.21.15.67:0/2059316605 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361886393 0 0) 0x7f9c00146130 con 0x7f9c00145d50 2024-09-19T05:33:00.862 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c05d00640 1 --2- 172.21.15.67:0/2059316605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 0x7f9c000af9a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009870 tx=0x7f9bf001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ccef5029b3ca46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:00.862 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c054ff640 1 -- 172.21.15.67:0/2059316605 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00a7070 con 0x7f9c0006c3d0 2024-09-19T05:33:00.862 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c054ff640 1 -- 172.21.15.67:0/2059316605 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf00b0070 con 0x7f9c0006c3d0 2024-09-19T05:33:00.862 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.860+0000 7f9c054ff640 1 -- 172.21.15.67:0/2059316605 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00ab890 con 0x7f9c0006c3d0 2024-09-19T05:33:00.863 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.864+0000 7f9c08765640 1 -- 172.21.15.67:0/2059316605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 msgr2=0x7f9c000af9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:00.863 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.864+0000 7f9c08765640 1 --2- 172.21.15.67:0/2059316605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 0x7f9c000af9a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009870 tx=0x7f9bf001c560 comp rx=0 tx=0).stop 2024-09-19T05:33:00.866 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.864+0000 7f9c08765640 1 -- 172.21.15.67:0/2059316605 shutdown_connections 2024-09-19T05:33:00.866 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.864+0000 7f9c08765640 1 --2- 172.21.15.67:0/2059316605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 0x7f9c000af9a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:00.866 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.864+0000 7f9c08765640 1 -- 172.21.15.67:0/2059316605 >> 172.21.15.67:0/2059316605 conn(0x7f9c00073540 msgr2=0x7f9c000b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:00.866 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.864+0000 7f9c08765640 1 -- 172.21.15.67:0/2059316605 shutdown_connections 2024-09-19T05:33:00.866 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.864+0000 7f9c08765640 1 -- 172.21.15.67:0/2059316605 wait complete. 2024-09-19T05:33:00.867 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c08765640 1 Processor -- start 2024-09-19T05:33:00.867 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c08765640 1 -- start start 2024-09-19T05:33:00.869 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c08765640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 0x7f9c0015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:00.869 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c08765640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0009aa60 0x7f9c0013cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:00.869 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c08765640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c00145d50 0x7f9c0013d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:00.869 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c08765640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0016a130 con 0x7f9c0006c3d0 2024-09-19T05:33:00.869 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c08765640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00169fb0 con 0x7f9c0009aa60 2024-09-19T05:33:00.869 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c08765640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0016a2b0 con 0x7f9c00145d50 2024-09-19T05:33:00.869 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c06501640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 0x7f9c0015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:00.869 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c06501640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 0x7f9c0015bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:32798/0 (socket says 172.21.15.67:32798) 2024-09-19T05:33:00.869 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c06501640 1 -- 172.21.15.67:0/1145402756 learned_addr learned my addr 172.21.15.67:0/1145402756 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:00.869 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c06d02640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c00145d50 0x7f9c0013d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:00.870 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c06501640 1 -- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c00145d50 msgr2=0x7f9c0013d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:00.870 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c06501640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c00145d50 0x7f9c0013d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:00.870 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c06501640 1 -- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0009aa60 msgr2=0x7f9c0013cc60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:33:00.870 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c06501640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0009aa60 0x7f9c0013cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:00.870 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c06501640 1 -- 172.21.15.67:0/1145402756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0013a030 con 0x7f9c0006c3d0 2024-09-19T05:33:00.871 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c06501640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 0x7f9c0015bf40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c480 tx=0x7f9bfc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:00.871 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/1145402756 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc003600 con 0x7f9c0006c3d0 2024-09-19T05:33:00.871 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/1145402756 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc0037c0 con 0x7f9c0006c3d0 2024-09-19T05:33:00.871 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/1145402756 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc003bb0 con 0x7f9c0006c3d0 2024-09-19T05:33:00.871 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c08765640 1 -- 172.21.15.67:0/1145402756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0013a310 con 0x7f9c0006c3d0 2024-09-19T05:33:00.871 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.868+0000 7f9c08765640 1 -- 172.21.15.67:0/1145402756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0013a8d0 con 0x7f9c0006c3d0 2024-09-19T05:33:00.871 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.872+0000 7f9c08765640 1 -- 172.21.15.67:0/1145402756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c000af9a0 con 0x7f9c0006c3d0 2024-09-19T05:33:00.873 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.872+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/1145402756 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f9bfc01b400 con 0x7f9c0006c3d0 2024-09-19T05:33:00.873 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.872+0000 7f9bf6ffd640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678b0 0x7f9be4069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:00.873 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.872+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/1145402756 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f9bfc0849b0 con 0x7f9c0006c3d0 2024-09-19T05:33:00.874 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.872+0000 7f9c05d00640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678b0 0x7f9be4069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:00.875 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.876+0000 7f9c05d00640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678b0 0x7f9be4069d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00af000 tx=0x7f9bf0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:00.879 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:00.880+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/1145402756 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9bfc056440 con 0x7f9c0006c3d0 2024-09-19T05:33:01.143 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.143+0000 7f9c08765640 1 -- 172.21.15.67:0/1145402756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c000b0e10 con 0x7f9c0006c3d0 2024-09-19T05:33:01.143 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.143+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/1145402756 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f9bfc055d40 con 0x7f9c0006c3d0 2024-09-19T05:33:01.144 INFO:teuthology.misc.health.smithi067.stdout: 2024-09-19T05:33:01.144 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":13,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:00.367581+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:01.146 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.143+0000 7f9c08765640 1 -- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678b0 msgr2=0x7f9be4069d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.143+0000 7f9c08765640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678b0 0x7f9be4069d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00af000 tx=0x7f9bf0008040 comp rx=0 tx=0).stop 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.143+0000 7f9c08765640 1 -- 172.21.15.67:0/1145402756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 msgr2=0x7f9c0015bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.143+0000 7f9c08765640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 0x7f9c0015bf40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c480 tx=0x7f9bfc00c940 comp rx=0 tx=0).stop 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.147+0000 7f9c08765640 1 -- 172.21.15.67:0/1145402756 shutdown_connections 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.147+0000 7f9c08765640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678b0 0x7f9be4069d70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.147+0000 7f9c08765640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c00145d50 0x7f9c0013d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.147+0000 7f9c08765640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0009aa60 0x7f9c0013cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.147+0000 7f9c08765640 1 --2- 172.21.15.67:0/1145402756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c0006c3d0 0x7f9c0015bf40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.147+0000 7f9c08765640 1 -- 172.21.15.67:0/1145402756 >> 172.21.15.67:0/1145402756 conn(0x7f9c00073540 msgr2=0x7f9c000b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.147+0000 7f9c08765640 1 -- 172.21.15.67:0/1145402756 shutdown_connections 2024-09-19T05:33:01.147 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:01.147+0000 7f9c08765640 1 -- 172.21.15.67:0/1145402756 wait complete. 2024-09-19T05:33:01.166 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T05:33:01.284 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-19T05:33:01.283+0000 7fe0609d2640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T05:33:01.312 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-19T05:33:01.311+0000 7fdb77586640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T05:33:01.317 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-19T05:33:01.315+0000 7fe057ff5640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:33:01.335 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-19T05:33:01.335+0000 7fdb6f3bb640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:33:01.355 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-09-19T05:33:01.350+0000 7fdd54771640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T05:33:01.373 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-19T05:33:01.371+0000 7fdab97ad640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T05:33:01.380 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-09-19T05:33:01.378+0000 7fdd4c5a6640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:33:01.385 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-09-19T05:33:01.382+0000 7fba100a8640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T05:33:01.403 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-19T05:33:01.403+0000 7fdab0dd0640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:33:01.441 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-09-19T05:33:01.438+0000 7f14e9e29640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T05:33:01.441 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-09-19T05:33:01.438+0000 7fba07edd640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:33:01.472 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-09-19T05:33:01.470+0000 7f14e1c5e640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:33:01.597 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-19T05:33:01.595+0000 7f93d5c0a640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T05:33:01.619 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-19T05:33:01.619+0000 7f93cd22d640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:33:01.651 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-09-19T05:33:01.646+0000 7f18f4369640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T05:33:01.676 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-09-19T05:33:01.674+0000 7f18ec19e640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:33:07.491 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:33:07.493 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:33:07.973 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:08.102 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f8793403640 1 Processor -- start 2024-09-19T05:33:08.102 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f8793403640 1 -- start start 2024-09-19T05:33:08.104 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f8793403640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c0ccf30 0x7f878c1606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.104 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f8793403640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f878c15d1f0 con 0x7f878c0cd310 2024-09-19T05:33:08.104 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f8793403640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f878c15d4d0 con 0x7f878c159800 2024-09-19T05:33:08.104 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f8793403640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f878c15d7b0 con 0x7f878c0ccf30 2024-09-19T05:33:08.104 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f879099e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f878c0cd310 0x7f878c15c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47578/0 (socket says 172.21.15.67:47578) 2024-09-19T05:33:08.104 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f879099e640 1 -- 172.21.15.67:0/480937784 learned_addr learned my addr 172.21.15.67:0/480937784 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:08.104 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f879119f640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c0ccf30 0x7f878c1606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.104 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580182853 0 0) 0x7f878c15d1f0 con 0x7f878c0cd310 2024-09-19T05:33:08.104 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.099+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8778003530 con 0x7f878c0cd310 2024-09-19T05:33:08.104 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3661332846 0 0) 0x7f8778003530 con 0x7f878c0cd310 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c0ccf30 msgr2=0x7f878c1606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c0ccf30 0x7f878c1606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 >> v1:172.21.15.97:6789/0 conn(0x7f878c159800 legacy=0x7f878c159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878c15fee0 con 0x7f878c0cd310 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f877c001680 con 0x7f878c0cd310 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 >> v1:172.21.15.67:6789/0 conn(0x7f878c0cd310 legacy=0x7f878c15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87780039f0 0x7f8778003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c0ccf30 0x7f8778004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8778004d50 0x7f87780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f878c15d7b0 con 0x7f87780039f0 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f877800bb00 con 0x7f8778004d50 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f877800bd00 con 0x7f878c0ccf30 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f879119f640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87780039f0 0x7f8778003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.105 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f879099e640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c0ccf30 0x7f8778004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.106 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f87919a0640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8778004d50 0x7f87780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.106 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f879119f640 1 -- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c0ccf30 msgr2=0x7f8778004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:08.106 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f879119f640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c0ccf30 0x7f8778004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.106 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f879119f640 1 -- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8778004d50 msgr2=0x7f87780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:08.106 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f879119f640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8778004d50 0x7f87780051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.106 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f879119f640 1 -- 172.21.15.67:0/480937784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8778003530 con 0x7f87780039f0 2024-09-19T05:33:08.107 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f879119f640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87780039f0 0x7f8778003e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8788009ae0 tx=0x7f878801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd4fcc308ec4b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:08.107 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87880096b0 con 0x7f87780039f0 2024-09-19T05:33:08.107 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87880b0400 con 0x7f87780039f0 2024-09-19T05:33:08.107 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8783fff640 1 -- 172.21.15.67:0/480937784 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87880b07f0 con 0x7f87780039f0 2024-09-19T05:33:08.107 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8793403640 1 -- 172.21.15.67:0/480937784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87780039f0 msgr2=0x7f8778003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.107 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f8793403640 1 --2- 172.21.15.67:0/480937784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87780039f0 0x7f8778003e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8788009ae0 tx=0x7f878801c9b0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.107 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.103+0000 7f87919a0640 1 -- 172.21.15.67:0/480937784 reap_dead start 2024-09-19T05:33:08.107 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- 172.21.15.67:0/480937784 shutdown_connections 2024-09-19T05:33:08.108 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- 172.21.15.67:0/480937784 >> 172.21.15.67:0/480937784 conn(0x7f878c06bcc0 msgr2=0x7f878c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:08.108 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- 172.21.15.67:0/480937784 shutdown_connections 2024-09-19T05:33:08.108 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- 172.21.15.67:0/480937784 wait complete. 2024-09-19T05:33:08.108 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 Processor -- start 2024-09-19T05:33:08.108 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- start start 2024-09-19T05:33:08.110 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87780039f0 0x7f878c09adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.110 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f878c09b330 0x7f878c09d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.110 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c09d5a0 0x7f878c09da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.110 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f878c160af0 con 0x7f878c09b330 2024-09-19T05:33:08.110 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f878c0d0090 con 0x7f87780039f0 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f878c160c70 con 0x7f878c09d5a0 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f879099e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f878c09b330 0x7f878c09d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f879099e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f878c09b330 0x7f878c09d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46174/0 (socket says 172.21.15.67:46174) 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f879099e640 1 -- 172.21.15.67:0/3032711003 learned_addr learned my addr 172.21.15.67:0/3032711003 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f87919a0640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c09d5a0 0x7f878c09da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f879119f640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87780039f0 0x7f878c09adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f879099e640 1 -- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c09d5a0 msgr2=0x7f878c09da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f879099e640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c09d5a0 0x7f878c09da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f879099e640 1 -- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87780039f0 msgr2=0x7f878c09adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f879099e640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87780039f0 0x7f878c09adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f879099e640 1 -- 172.21.15.67:0/3032711003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878c14bc20 con 0x7f878c09b330 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f879099e640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f878c09b330 0x7f878c09d060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f877c00e7b0 tx=0x7f877c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8781ffb640 1 -- 172.21.15.67:0/3032711003 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c00c8d0 con 0x7f878c09b330 2024-09-19T05:33:08.111 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8781ffb640 1 -- 172.21.15.67:0/3032711003 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877c018070 con 0x7f878c09b330 2024-09-19T05:33:08.112 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- 172.21.15.67:0/3032711003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f878c09bb20 con 0x7f878c09b330 2024-09-19T05:33:08.112 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8781ffb640 1 -- 172.21.15.67:0/3032711003 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c00ccb0 con 0x7f878c09b330 2024-09-19T05:33:08.112 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- 172.21.15.67:0/3032711003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f878c1e82b0 con 0x7f878c09b330 2024-09-19T05:33:08.112 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.107+0000 7f8793403640 1 -- 172.21.15.67:0/3032711003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f878c0b4350 con 0x7f878c09b330 2024-09-19T05:33:08.113 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.111+0000 7f8781ffb640 1 -- 172.21.15.67:0/3032711003 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f877c01d460 con 0x7f878c09b330 2024-09-19T05:33:08.113 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.111+0000 7f8781ffb640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87700678c0 0x7f8770069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.113 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.111+0000 7f8781ffb640 1 -- 172.21.15.67:0/3032711003 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f877c085800 con 0x7f878c09b330 2024-09-19T05:33:08.113 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.111+0000 7f879119f640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87700678c0 0x7f8770069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.113 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.111+0000 7f879119f640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87700678c0 0x7f8770069d80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87880af000 tx=0x7f87880046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:08.117 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.115+0000 7f8781ffb640 1 -- 172.21.15.67:0/3032711003 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f877c056690 con 0x7f878c09b330 2024-09-19T05:33:08.281 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.279+0000 7f8793403640 1 -- 172.21.15.67:0/3032711003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f878c145e30 con 0x7f878c09b330 2024-09-19T05:33:08.282 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.279+0000 7f8781ffb640 1 -- 172.21.15.67:0/3032711003 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7f877c055f90 con 0x7f878c09b330 2024-09-19T05:33:08.282 INFO:teuthology.misc.health.smithi067.stdout: 2024-09-19T05:33:08.283 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":17,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:05.325636+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:08.284 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 -- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87700678c0 msgr2=0x7f8770069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.285 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87700678c0 0x7f8770069d80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87880af000 tx=0x7f87880046d0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.285 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 -- 172.21.15.67:0/3032711003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f878c09b330 msgr2=0x7f878c09d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.285 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f878c09b330 0x7f878c09d060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f877c00e7b0 tx=0x7f877c00ec70 comp rx=0 tx=0).stop 2024-09-19T05:33:08.285 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 -- 172.21.15.67:0/3032711003 shutdown_connections 2024-09-19T05:33:08.285 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87700678c0 0x7f8770069d80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.285 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f878c09d5a0 0x7f878c09da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.285 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f878c09b330 0x7f878c09d060 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.285 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 --2- 172.21.15.67:0/3032711003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87780039f0 0x7f878c09adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.285 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 -- 172.21.15.67:0/3032711003 >> 172.21.15.67:0/3032711003 conn(0x7f878c06bcc0 msgr2=0x7f878c0b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:08.285 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 -- 172.21.15.67:0/3032711003 shutdown_connections 2024-09-19T05:33:08.286 INFO:teuthology.misc.health.smithi067.stderr:2024-09-19T05:33:08.283+0000 7f8793403640 1 -- 172.21.15.67:0/3032711003 wait complete. 2024-09-19T05:33:08.300 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-19T05:33:08.301 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-19T05:33:08.301 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:33:08.301 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:33:08.303 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:33:08.303 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:33:08.303 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:33:08.305 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:33:08.305 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:33:08.305 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:33:08.308 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:33:08.308 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:33:08.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:33:08.310 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:33:08.311 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-19T05:33:08.311 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:08.393 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:33:08.395 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:33:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ef7b1640 1 Processor -- start 2024-09-19T05:33:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ef7b1640 1 -- start start 2024-09-19T05:33:08.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ef7b1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c360 0x7ff8e806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ef7b1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff8e815d4d0 0x7ff8e80b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ef7b1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff8e815c740 0x7ff8e815cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ef7b1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e806f680 con 0x7ff8e815c740 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ef7b1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e8068160 con 0x7ff8e815d4d0 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ef7b1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e8067ba0 con 0x7ff8e815c360 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8edd4e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff8e815c740 0x7ff8e815cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8edd4e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff8e815c740 0x7ff8e815cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46190/0 (socket says 172.21.15.67:46190) 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8edd4e640 1 -- 172.21.15.67:0/454831366 learned_addr learned my addr 172.21.15.67:0/454831366 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ed54d640 1 --2- 172.21.15.67:0/454831366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c360 0x7ff8e806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ecd4c640 1 --2- 172.21.15.67:0/454831366 >> v2:172.21.15.97:3300/0 conn(0x7ff8e815d4d0 0x7ff8e80b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8edd4e640 1 -- 172.21.15.67:0/454831366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c360 msgr2=0x7ff8e806fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8edd4e640 1 --2- 172.21.15.67:0/454831366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c360 0x7ff8e806fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8edd4e640 1 -- 172.21.15.67:0/454831366 >> v2:172.21.15.97:3300/0 conn(0x7ff8e815d4d0 msgr2=0x7ff8e80b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8edd4e640 1 --2- 172.21.15.67:0/454831366 >> v2:172.21.15.97:3300/0 conn(0x7ff8e815d4d0 0x7ff8e80b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8edd4e640 1 -- 172.21.15.67:0/454831366 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e8067e80 con 0x7ff8e815c740 2024-09-19T05:33:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.427+0000 7ff8ed54d640 1 --2- 172.21.15.67:0/454831366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c360 0x7ff8e806fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.431+0000 7ff8edd4e640 1 --2- 172.21.15.67:0/454831366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c740 0x7ff8e815cb90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8069940 tx=0x7ff8e001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de850c8967e370fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:08.451 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:33:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8dffff640 1 -- 172.21.15.67:0/454831366 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00a57d0 con 0x7ff8e815c740 2024-09-19T05:33:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8dffff640 1 -- 172.21.15.67:0/454831366 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e00a5970 con 0x7ff8e815c740 2024-09-19T05:33:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8dffff640 1 -- 172.21.15.67:0/454831366 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00a5d40 con 0x7ff8e815c740 2024-09-19T05:33:08.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/454831366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c740 msgr2=0x7ff8e815cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8ef7b1640 1 --2- 172.21.15.67:0/454831366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c740 0x7ff8e815cb90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8069940 tx=0x7ff8e001c930 comp rx=0 tx=0).stop 2024-09-19T05:33:08.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/454831366 shutdown_connections 2024-09-19T05:33:08.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8ef7b1640 1 --2- 172.21.15.67:0/454831366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c740 0x7ff8e815cb90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8ef7b1640 1 --2- 172.21.15.67:0/454831366 >> v2:172.21.15.97:3300/0 conn(0x7ff8e815d4d0 0x7ff8e80b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8ef7b1640 1 --2- 172.21.15.67:0/454831366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c360 0x7ff8e806fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/454831366 >> 172.21.15.67:0/454831366 conn(0x7ff8e8073500 msgr2=0x7ff8e806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:08.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/454831366 shutdown_connections 2024-09-19T05:33:08.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/454831366 wait complete. 2024-09-19T05:33:08.458 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:33:08.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.455+0000 7ff8ef7b1640 1 Processor -- start 2024-09-19T05:33:08.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ef7b1640 1 -- start start 2024-09-19T05:33:08.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ef7b1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c360 0x7ff8e806cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ef7b1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c740 0x7ff8e813c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ef7b1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8e815d4d0 0x7ff8e806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ef7b1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e815d250 con 0x7ff8e815c360 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ef7b1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e815d0d0 con 0x7ff8e815d4d0 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ef7b1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e80cddc0 con 0x7ff8e815c740 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ed54d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c360 0x7ff8e806cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ed54d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c360 0x7ff8e806cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46232/0 (socket says 172.21.15.67:46232) 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ed54d640 1 -- 172.21.15.67:0/156359300 learned_addr learned my addr 172.21.15.67:0/156359300 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ecd4c640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c740 0x7ff8e813c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8edd4e640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8e815d4d0 0x7ff8e806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ed54d640 1 -- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c740 msgr2=0x7ff8e813c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ed54d640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c740 0x7ff8e813c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ed54d640 1 -- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8e815d4d0 msgr2=0x7ff8e806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ed54d640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8e815d4d0 0x7ff8e806bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ed54d640 1 -- 172.21.15.67:0/156359300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e813c8f0 con 0x7ff8e815c360 2024-09-19T05:33:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.459+0000 7ff8ed54d640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c360 0x7ff8e806cdc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400e840 tx=0x7ff8e400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:08.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.463+0000 7ff8ddffb640 1 -- 172.21.15.67:0/156359300 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e400f040 con 0x7ff8e815c360 2024-09-19T05:33:08.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.463+0000 7ff8ddffb640 1 -- 172.21.15.67:0/156359300 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e4004030 con 0x7ff8e815c360 2024-09-19T05:33:08.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.463+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/156359300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e80b40b0 con 0x7ff8e815c360 2024-09-19T05:33:08.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.463+0000 7ff8ddffb640 1 -- 172.21.15.67:0/156359300 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4004400 con 0x7ff8e815c360 2024-09-19T05:33:08.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.463+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/156359300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e80b4670 con 0x7ff8e815c360 2024-09-19T05:33:08.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.463+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/156359300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e80b4d80 con 0x7ff8e815c360 2024-09-19T05:33:08.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.463+0000 7ff8ddffb640 1 -- 172.21.15.67:0/156359300 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8e400c6d0 con 0x7ff8e815c360 2024-09-19T05:33:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.463+0000 7ff8ddffb640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8cc0678c0 0x7ff8cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.463+0000 7ff8ddffb640 1 -- 172.21.15.67:0/156359300 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff8e4083f40 con 0x7ff8e815c360 2024-09-19T05:33:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.463+0000 7ff8ecd4c640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8cc0678c0 0x7ff8cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.467+0000 7ff8ecd4c640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8cc0678c0 0x7ff8cc069d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8e814d1b0 tx=0x7ff8d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:08.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.471+0000 7ff8ddffb640 1 -- 172.21.15.67:0/156359300 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff8e4017020 con 0x7ff8e815c360 2024-09-19T05:33:08.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.663+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/156359300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8e80ce050 con 0x7ff8e815c360 2024-09-19T05:33:08.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.663+0000 7ff8ddffb640 1 -- 172.21.15.67:0/156359300 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1431 (secure 0 0 0) 0x7ff8e4055d60 con 0x7ff8e815c360 2024-09-19T05:33:08.665 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:08.665 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":2,"btime":"2024-09-19T05:33:08:457279+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T05:33:08.666 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 2 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8cc0678c0 msgr2=0x7ff8cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8cc0678c0 0x7ff8cc069d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8e814d1b0 tx=0x7ff8d8008040 comp rx=0 tx=0).stop 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/156359300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c360 msgr2=0x7ff8e806cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c360 0x7ff8e806cdc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400e840 tx=0x7ff8e400ed00 comp rx=0 tx=0).stop 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/156359300 shutdown_connections 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8e815d4d0 0x7ff8e806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8cc0678c0 0x7ff8cc069d80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8e815c740 0x7ff8e813c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 --2- 172.21.15.67:0/156359300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e815c360 0x7ff8e806cdc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/156359300 >> 172.21.15.67:0/156359300 conn(0x7ff8e8073500 msgr2=0x7ff8e815e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:08.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/156359300 shutdown_connections 2024-09-19T05:33:08.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:08.667+0000 7ff8ef7b1640 1 -- 172.21.15.67:0/156359300 wait complete. 2024-09-19T05:33:10.684 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.819+0000 7fa0d2db4640 1 Processor -- start 2024-09-19T05:33:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.819+0000 7fa0d2db4640 1 -- start start 2024-09-19T05:33:10.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0cc0af730 0x7fa0cc06e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0cc0730e0 con 0x7fa0cc15a920 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0cc0733c0 con 0x7fa0cc06ebb0 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa0cc06efe0 con 0x7fa0cc0af730 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d0b50640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa0cc15a920 0x7fa0cc072840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47604/0 (socket says 172.21.15.67:47604) 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d0b50640 1 -- 172.21.15.67:0/1845101540 learned_addr learned my addr 172.21.15.67:0/1845101540 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0cbfff640 1 --2- 172.21.15.67:0/1845101540 >> v2:172.21.15.67:3300/0 conn(0x7fa0cc0af730 0x7fa0cc06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0cb7fe640 1 -- 172.21.15.67:0/1845101540 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502959343 0 0) 0x7fa0cc0730e0 con 0x7fa0cc15a920 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0cb7fe640 1 -- 172.21.15.67:0/1845101540 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0bc003530 con 0x7fa0cc15a920 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0cbfff640 1 -- 172.21.15.67:0/1845101540 >> v1:172.21.15.97:6789/0 conn(0x7fa0cc06ebb0 legacy=0x7fa0cc0ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0cbfff640 1 -- 172.21.15.67:0/1845101540 >> v1:172.21.15.67:6789/0 conn(0x7fa0cc15a920 legacy=0x7fa0cc072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0cbfff640 1 -- 172.21.15.67:0/1845101540 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0cc0ad8c0 con 0x7fa0cc0af730 2024-09-19T05:33:10.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0cbfff640 1 --2- 172.21.15.67:0/1845101540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 0x7fa0cc06e670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800a960 tx=0x7fa0b801d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b71656975adb164 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:10.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0cb7fe640 1 -- 172.21.15.67:0/1845101540 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80b3070 con 0x7fa0cc0af730 2024-09-19T05:33:10.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0cb7fe640 1 -- 172.21.15.67:0/1845101540 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b80a67d0 con 0x7fa0cc0af730 2024-09-19T05:33:10.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0cb7fe640 1 -- 172.21.15.67:0/1845101540 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800b040 con 0x7fa0cc0af730 2024-09-19T05:33:10.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 -- 172.21.15.67:0/1845101540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 msgr2=0x7fa0cc06e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:10.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 --2- 172.21.15.67:0/1845101540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 0x7fa0cc06e670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800a960 tx=0x7fa0b801d870 comp rx=0 tx=0).stop 2024-09-19T05:33:10.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 -- 172.21.15.67:0/1845101540 shutdown_connections 2024-09-19T05:33:10.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 --2- 172.21.15.67:0/1845101540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 0x7fa0cc06e670 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:10.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 -- 172.21.15.67:0/1845101540 >> 172.21.15.67:0/1845101540 conn(0x7fa0cc0d0080 msgr2=0x7fa0cc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:10.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 -- 172.21.15.67:0/1845101540 shutdown_connections 2024-09-19T05:33:10.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.823+0000 7fa0d2db4640 1 -- 172.21.15.67:0/1845101540 wait complete. 2024-09-19T05:33:10.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 Processor -- start 2024-09-19T05:33:10.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 -- start start 2024-09-19T05:33:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0cc06ebb0 0x7fa0cc1455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 0x7fa0cc1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc15a920 0x7fa0cc1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc0ae950 con 0x7fa0cc0af730 2024-09-19T05:33:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc0ae7d0 con 0x7fa0cc15a920 2024-09-19T05:33:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa0cc0aead0 con 0x7fa0cc06ebb0 2024-09-19T05:33:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0cbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 0x7fa0cc1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0cbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 0x7fa0cc1500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46254/0 (socket says 172.21.15.67:46254) 2024-09-19T05:33:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0cbfff640 1 -- 172.21.15.67:0/2272464547 learned_addr learned my addr 172.21.15.67:0/2272464547 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0cbfff640 1 -- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0cc06ebb0 msgr2=0x7fa0cc1455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d1351640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc15a920 0x7fa0cc1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d0b50640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0cc06ebb0 0x7fa0cc1455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0cbfff640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0cc06ebb0 0x7fa0cc1455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0cbfff640 1 -- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc15a920 msgr2=0x7fa0cc1505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0cbfff640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc15a920 0x7fa0cc1505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0cbfff640 1 -- 172.21.15.67:0/2272464547 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0cc14a040 con 0x7fa0cc0af730 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d1351640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc15a920 0x7fa0cc1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d0b50640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0cc06ebb0 0x7fa0cc1455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0cbfff640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 0x7fa0cc1500b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80b1040 tx=0x7fa0b801c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0c97fa640 1 -- 172.21.15.67:0/2272464547 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80b3040 con 0x7fa0cc0af730 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0c97fa640 1 -- 172.21.15.67:0/2272464547 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b8004020 con 0x7fa0cc0af730 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 -- 172.21.15.67:0/2272464547 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0cc0cd340 con 0x7fa0cc0af730 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0c97fa640 1 -- 172.21.15.67:0/2272464547 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80043f0 con 0x7fa0cc0af730 2024-09-19T05:33:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 -- 172.21.15.67:0/2272464547 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0cc0cd900 con 0x7fa0cc0af730 2024-09-19T05:33:10.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.827+0000 7fa0d2db4640 1 -- 172.21.15.67:0/2272464547 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0cc06e670 con 0x7fa0cc0af730 2024-09-19T05:33:10.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.831+0000 7fa0c97fa640 1 -- 172.21.15.67:0/2272464547 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0b80be060 con 0x7fa0cc0af730 2024-09-19T05:33:10.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.831+0000 7fa0c97fa640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 0x7fa0b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:10.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.831+0000 7fa0c97fa640 1 -- 172.21.15.67:0/2272464547 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa0b811ed90 con 0x7fa0cc0af730 2024-09-19T05:33:10.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.831+0000 7fa0d0b50640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 0x7fa0b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:10.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.831+0000 7fa0d0b50640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 0x7fa0b0069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00011f0 tx=0x7fa0c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:10.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:10.835+0000 7fa0c97fa640 1 -- 172.21.15.67:0/2272464547 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa0b8017460 con 0x7fa0cc0af730 2024-09-19T05:33:11.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.027+0000 7fa0d2db4640 1 -- 172.21.15.67:0/2272464547 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0cc072e20 con 0x7fa0cc0af730 2024-09-19T05:33:11.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.027+0000 7fa0c97fa640 1 -- 172.21.15.67:0/2272464547 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3903 (secure 0 0 0) 0x7fa0b80efcb0 con 0x7fa0cc0af730 2024-09-19T05:33:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:11.030 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":3,"btime":"2024-09-19T05:33:09:461713+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T05:33:11.031 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 3 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 -- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 msgr2=0x7fa0b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 0x7fa0b0069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00011f0 tx=0x7fa0c0009040 comp rx=0 tx=0).stop 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 -- 172.21.15.67:0/2272464547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 msgr2=0x7fa0cc1500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 0x7fa0cc1500b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80b1040 tx=0x7fa0b801c0b0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 -- 172.21.15.67:0/2272464547 shutdown_connections 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc15a920 0x7fa0cc1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc0af730 0x7fa0cc1500b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 0x7fa0b0069d80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 --2- 172.21.15.67:0/2272464547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0cc06ebb0 0x7fa0cc1455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 -- 172.21.15.67:0/2272464547 >> 172.21.15.67:0/2272464547 conn(0x7fa0cc0d0080 msgr2=0x7fa0cc0b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:11.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 -- 172.21.15.67:0/2272464547 shutdown_connections 2024-09-19T05:33:11.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.031+0000 7fa0d2db4640 1 -- 172.21.15.67:0/2272464547 wait complete. 2024-09-19T05:33:11.048 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:33:11.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.159+0000 7f1841255640 1 Processor -- start 2024-09-19T05:33:11.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.159+0000 7f1841255640 1 -- start start 2024-09-19T05:33:11.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f1841255640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f183c15b710 0x7f183c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f1841255640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c0aef40 0x7f183c0af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f1841255640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c0b3070 con 0x7f183c15baf0 2024-09-19T05:33:11.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f1841255640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f183c0b32e0 con 0x7f183c15b710 2024-09-19T05:33:11.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f1841255640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f183c0b35c0 con 0x7f183c0aef40 2024-09-19T05:33:11.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f183ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f183c15b710 0x7f183c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f183ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f183c15b710 0x7f183c071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46264/0 (socket says 172.21.15.67:46264) 2024-09-19T05:33:11.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f183ad9d640 1 -- 172.21.15.67:0/3852791267 learned_addr learned my addr 172.21.15.67:0/3852791267 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:11.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f183b59e640 1 --2- 172.21.15.67:0/3852791267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c0aef40 0x7f183c0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f183ad9d640 1 -- 172.21.15.67:0/3852791267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c0aef40 msgr2=0x7f183c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:11.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f183ad9d640 1 --2- 172.21.15.67:0/3852791267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c0aef40 0x7f183c0af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f183ad9d640 1 -- 172.21.15.67:0/3852791267 >> v1:172.21.15.97:6789/0 conn(0x7f183c15baf0 legacy=0x7f183c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:11.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f183ad9d640 1 -- 172.21.15.67:0/3852791267 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c0b38a0 con 0x7f183c15b710 2024-09-19T05:33:11.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f183b59e640 1 --2- 172.21.15.67:0/3852791267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c0aef40 0x7f183c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:11.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.163+0000 7f183ad9d640 1 --2- 172.21.15.67:0/3852791267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c15b710 0x7f183c071e80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f182c009870 tx=0x7f182c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cff2e06f672572 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:11.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1839d9b640 1 -- 172.21.15.67:0/3852791267 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0aa430 con 0x7f183c15b710 2024-09-19T05:33:11.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1839d9b640 1 -- 172.21.15.67:0/3852791267 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182c0af070 con 0x7f183c15b710 2024-09-19T05:33:11.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1839d9b640 1 -- 172.21.15.67:0/3852791267 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0aa7f0 con 0x7f183c15b710 2024-09-19T05:33:11.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- 172.21.15.67:0/3852791267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c15b710 msgr2=0x7f183c071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 --2- 172.21.15.67:0/3852791267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c15b710 0x7f183c071e80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f182c009870 tx=0x7f182c01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- 172.21.15.67:0/3852791267 shutdown_connections 2024-09-19T05:33:11.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 --2- 172.21.15.67:0/3852791267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c0aef40 0x7f183c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 --2- 172.21.15.67:0/3852791267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c15b710 0x7f183c071e80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- 172.21.15.67:0/3852791267 >> 172.21.15.67:0/3852791267 conn(0x7f183c0d0080 msgr2=0x7f183c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:11.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- 172.21.15.67:0/3852791267 shutdown_connections 2024-09-19T05:33:11.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- 172.21.15.67:0/3852791267 wait complete. 2024-09-19T05:33:11.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 Processor -- start 2024-09-19T05:33:11.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- start start 2024-09-19T05:33:11.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c0aef40 0x7f183c146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c15b710 0x7f183c09d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f183c15baf0 0x7f183c09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f183c0b4c40 con 0x7f183c0aef40 2024-09-19T05:33:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f183c0b4ac0 con 0x7f183c15baf0 2024-09-19T05:33:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f183c0b4dc0 con 0x7f183c15b710 2024-09-19T05:33:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c0aef40 0x7f183c146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c0aef40 0x7f183c146f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46270/0 (socket says 172.21.15.67:46270) 2024-09-19T05:33:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183ad9d640 1 -- 172.21.15.67:0/2877814371 learned_addr learned my addr 172.21.15.67:0/2877814371 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183b59e640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f183c15baf0 0x7f183c09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183a59c640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c15b710 0x7f183c09d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183ad9d640 1 -- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c15b710 msgr2=0x7f183c09d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183ad9d640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c15b710 0x7f183c09d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183ad9d640 1 -- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f183c15baf0 msgr2=0x7f183c09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183ad9d640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f183c15baf0 0x7f183c09c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183ad9d640 1 -- 172.21.15.67:0/2877814371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c14bd20 con 0x7f183c0aef40 2024-09-19T05:33:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183a59c640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c15b710 0x7f183c09d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f183ad9d640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c0aef40 0x7f183c146f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f182c0ac040 tx=0x7f182c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f18237fe640 1 -- 172.21.15.67:0/2877814371 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0b3800 con 0x7f183c0aef40 2024-09-19T05:33:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f18237fe640 1 -- 172.21.15.67:0/2877814371 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182c0b39c0 con 0x7f183c0aef40 2024-09-19T05:33:11.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- 172.21.15.67:0/2877814371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c14f280 con 0x7f183c0aef40 2024-09-19T05:33:11.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f18237fe640 1 -- 172.21.15.67:0/2877814371 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0b3db0 con 0x7f183c0aef40 2024-09-19T05:33:11.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.167+0000 7f1841255640 1 -- 172.21.15.67:0/2877814371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c14f840 con 0x7f183c0aef40 2024-09-19T05:33:11.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.171+0000 7f1841255640 1 -- 172.21.15.67:0/2877814371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183c0af360 con 0x7f183c0aef40 2024-09-19T05:33:11.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.171+0000 7f18237fe640 1 -- 172.21.15.67:0/2877814371 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f182c0c6440 con 0x7f183c0aef40 2024-09-19T05:33:11.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.171+0000 7f18237fe640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18280678c0 0x7f1828069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.171+0000 7f18237fe640 1 -- 172.21.15.67:0/2877814371 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f182c120190 con 0x7f183c0aef40 2024-09-19T05:33:11.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.171+0000 7f183a59c640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18280678c0 0x7f1828069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.171+0000 7f183a59c640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18280678c0 0x7f1828069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f183000a850 tx=0x7f1830008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:11.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.175+0000 7f18237fe640 1 -- 172.21.15.67:0/2877814371 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f182c016110 con 0x7f183c0aef40 2024-09-19T05:33:11.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.343+0000 7f1841255640 1 -- 172.21.15.67:0/2877814371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f183c0b5020 con 0x7f183c0aef40 2024-09-19T05:33:11.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.343+0000 7f18237fe640 1 -- 172.21.15.67:0/2877814371 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f182c0aae20 con 0x7f183c0aef40 2024-09-19T05:33:11.346 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:11.346 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:33:11.346 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:33:11.346 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:33:11.346 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:33:11.346 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:33:11.346 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:33:11.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 -- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18280678c0 msgr2=0x7f1828069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18280678c0 0x7f1828069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f183000a850 tx=0x7f1830008040 comp rx=0 tx=0).stop 2024-09-19T05:33:11.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 -- 172.21.15.67:0/2877814371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c0aef40 msgr2=0x7f183c146f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c0aef40 0x7f183c146f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f182c0ac040 tx=0x7f182c01ad30 comp rx=0 tx=0).stop 2024-09-19T05:33:11.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 -- 172.21.15.67:0/2877814371 shutdown_connections 2024-09-19T05:33:11.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f183c15baf0 0x7f183c09c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18280678c0 0x7f1828069d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f183c15b710 0x7f183c09d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 --2- 172.21.15.67:0/2877814371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c0aef40 0x7f183c146f10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 -- 172.21.15.67:0/2877814371 >> 172.21.15.67:0/2877814371 conn(0x7f183c0d0080 msgr2=0x7f183c072400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:11.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 -- 172.21.15.67:0/2877814371 shutdown_connections 2024-09-19T05:33:11.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.347+0000 7f1841255640 1 -- 172.21.15.67:0/2877814371 wait complete. 2024-09-19T05:33:11.365 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:33:11.365 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:33:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.479+0000 7f421bd69640 1 Processor -- start 2024-09-19T05:33:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.479+0000 7f421bd69640 1 -- start start 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f421bd69640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f421415e800 0x7f421406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f421bd69640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42140cf040 0x7f42140cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f421bd69640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f421415ebe0 con 0x7f421406f080 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f421bd69640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f421406f920 con 0x7f421415e800 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f421bd69640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f421406fc00 con 0x7f42140cf040 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4219b05640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f421415e800 0x7f421406bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4219304640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f421406f080 0x7f421406c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47608/0 (socket says 172.21.15.67:47608) 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4219304640 1 -- 172.21.15.67:0/3080181273 learned_addr learned my addr 172.21.15.67:0/3080181273 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f421a306640 1 --2- 172.21.15.67:0/3080181273 >> v2:172.21.15.97:3300/0 conn(0x7f42140cf040 0x7f42140cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4218b03640 1 -- 172.21.15.67:0/3080181273 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4246213646 0 0) 0x7f4204001120 con 0x7f421406f080 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4218b03640 1 -- 172.21.15.67:0/3080181273 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4200003530 con 0x7f421406f080 2024-09-19T05:33:11.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4219b05640 1 -- 172.21.15.67:0/3080181273 >> v2:172.21.15.97:3300/0 conn(0x7f42140cf040 msgr2=0x7f42140cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:11.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4219b05640 1 --2- 172.21.15.67:0/3080181273 >> v2:172.21.15.97:3300/0 conn(0x7f42140cf040 0x7f42140cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4219b05640 1 -- 172.21.15.67:0/3080181273 >> v1:172.21.15.67:6789/0 conn(0x7f421406f080 legacy=0x7f421406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4219b05640 1 -- 172.21.15.67:0/3080181273 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42140ca680 con 0x7f421415e800 2024-09-19T05:33:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4219b05640 1 --2- 172.21.15.67:0/3080181273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f421415e800 0x7f421406bcc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f421406eb00 tx=0x7f421001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a47b22d690f798 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4218b03640 1 -- 172.21.15.67:0/3080181273 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42100b1070 con 0x7f421415e800 2024-09-19T05:33:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4218b03640 1 -- 172.21.15.67:0/3080181273 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42100ac5f0 con 0x7f421415e800 2024-09-19T05:33:11.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.483+0000 7f4218b03640 1 -- 172.21.15.67:0/3080181273 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42100ac9c0 con 0x7f421415e800 2024-09-19T05:33:11.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- 172.21.15.67:0/3080181273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f421415e800 msgr2=0x7f421406bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 --2- 172.21.15.67:0/3080181273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f421415e800 0x7f421406bcc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f421406eb00 tx=0x7f421001c480 comp rx=0 tx=0).stop 2024-09-19T05:33:11.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- 172.21.15.67:0/3080181273 shutdown_connections 2024-09-19T05:33:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 --2- 172.21.15.67:0/3080181273 >> v2:172.21.15.97:3300/0 conn(0x7f42140cf040 0x7f42140cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 --2- 172.21.15.67:0/3080181273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f421415e800 0x7f421406bcc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- 172.21.15.67:0/3080181273 >> 172.21.15.67:0/3080181273 conn(0x7f42140b2e60 msgr2=0x7f42140b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- 172.21.15.67:0/3080181273 shutdown_connections 2024-09-19T05:33:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- 172.21.15.67:0/3080181273 wait complete. 2024-09-19T05:33:11.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 Processor -- start 2024-09-19T05:33:11.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- start start 2024-09-19T05:33:11.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f421406f080 0x7f421414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42140cf040 0x7f42140cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f421415e800 0x7f42140cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f421406ca90 con 0x7f42140cf040 2024-09-19T05:33:11.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f421406c910 con 0x7f421406f080 2024-09-19T05:33:11.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f421416b310 con 0x7f421415e800 2024-09-19T05:33:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f4219304640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42140cf040 0x7f42140cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f4219304640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42140cf040 0x7f42140cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46292/0 (socket says 172.21.15.67:46292) 2024-09-19T05:33:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f4219304640 1 -- 172.21.15.67:0/185042851 learned_addr learned my addr 172.21.15.67:0/185042851 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f4219b05640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f421406f080 0x7f421414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f4219304640 1 -- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f421415e800 msgr2=0x7f42140cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f4219304640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f421415e800 0x7f42140cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f4219304640 1 -- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f421406f080 msgr2=0x7f421414ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f4219304640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f421406f080 0x7f421414ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f4219304640 1 -- 172.21.15.67:0/185042851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421415d600 con 0x7f42140cf040 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f4219304640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42140cf040 0x7f42140cbd20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f420400c730 tx=0x7f420400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f420a7fc640 1 -- 172.21.15.67:0/185042851 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204017070 con 0x7f42140cf040 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f420a7fc640 1 -- 172.21.15.67:0/185042851 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4204005ae0 con 0x7f42140cf040 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- 172.21.15.67:0/185042851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421415d320 con 0x7f42140cf040 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f420a7fc640 1 -- 172.21.15.67:0/185042851 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204007e30 con 0x7f42140cf040 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.487+0000 7f421bd69640 1 -- 172.21.15.67:0/185042851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42140aed10 con 0x7f42140cf040 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.491+0000 7f421bd69640 1 -- 172.21.15.67:0/185042851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42140cf450 con 0x7f42140cf040 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.491+0000 7f420a7fc640 1 -- 172.21.15.67:0/185042851 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f420401a070 con 0x7f42140cf040 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.491+0000 7f420a7fc640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41f80678c0 0x7f41f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.491+0000 7f420a7fc640 1 -- 172.21.15.67:0/185042851 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4204084ce0 con 0x7f42140cf040 2024-09-19T05:33:11.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.491+0000 7f4219b05640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41f80678c0 0x7f41f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:11.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.491+0000 7f4219b05640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41f80678c0 0x7f41f8069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42100ae000 tx=0x7f4210008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:11.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.495+0000 7f420a7fc640 1 -- 172.21.15.67:0/185042851 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f421415ebe0 con 0x7f42140cf040 2024-09-19T05:33:11.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:11.651+0000 7f421bd69640 1 -- 172.21.15.67:0/185042851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4214155540 con 0x7f42140cf040 2024-09-19T05:33:12.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.487+0000 7f420a7fc640 1 -- 172.21.15.67:0/185042851 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f4204055c00 con 0x7f42140cf040 2024-09-19T05:33:12.490 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:33:12.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 -- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41f80678c0 msgr2=0x7f41f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:12.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41f80678c0 0x7f41f8069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42100ae000 tx=0x7f4210008040 comp rx=0 tx=0).stop 2024-09-19T05:33:12.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 -- 172.21.15.67:0/185042851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42140cf040 msgr2=0x7f42140cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:12.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42140cf040 0x7f42140cbd20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f420400c730 tx=0x7f420400cbf0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 -- 172.21.15.67:0/185042851 shutdown_connections 2024-09-19T05:33:12.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41f80678c0 0x7f41f8069d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f421415e800 0x7f42140cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42140cf040 0x7f42140cbd20 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f420400c730 tx=0x7f420400cbf0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 --2- 172.21.15.67:0/185042851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f421406f080 0x7f421414ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 -- 172.21.15.67:0/185042851 >> 172.21.15.67:0/185042851 conn(0x7f42140b2e60 msgr2=0x7f42141587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:12.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.491+0000 7f421bd69640 1 -- 172.21.15.67:0/185042851 shutdown_connections 2024-09-19T05:33:12.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.495+0000 7f421bd69640 1 -- 172.21.15.67:0/185042851 wait complete. 2024-09-19T05:33:12.522 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-19T05:33:12.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f477d639640 1 Processor -- start 2024-09-19T05:33:12.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f477d639640 1 -- start start 2024-09-19T05:33:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f477d639640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477815b1d0 0x7f47780adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f477d639640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f477806dfc0 0x7f477806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f477d639640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47780aef30 con 0x7f477806fea0 2024-09-19T05:33:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f477d639640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4778072210 con 0x7f477806dfc0 2024-09-19T05:33:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f477d639640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f47780ae0f0 con 0x7f477815b1d0 2024-09-19T05:33:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f47777fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f477806fea0 0x7f477815ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47616/0 (socket says 172.21.15.67:47616) 2024-09-19T05:33:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f47777fe640 1 -- 172.21.15.67:0/3446039856 learned_addr learned my addr 172.21.15.67:0/3446039856 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4776ffd640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477815b1d0 0x7f47780adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:12.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f47767fc640 1 --2- 172.21.15.67:0/3446039856 >> v2:172.21.15.97:3300/0 conn(0x7f477806dfc0 0x7f477806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:12.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439396559 0 0) 0x7f47780aef30 con 0x7f477806fea0 2024-09-19T05:33:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4760003530 con 0x7f477806fea0 2024-09-19T05:33:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1955027389 0 0) 0x7f4760003530 con 0x7f477806fea0 2024-09-19T05:33:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477815b1d0 msgr2=0x7f47780adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477815b1d0 0x7f47780adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 >> v2:172.21.15.97:3300/0 conn(0x7f477806dfc0 msgr2=0x7f477806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 --2- 172.21.15.67:0/3446039856 >> v2:172.21.15.97:3300/0 conn(0x7f477806dfc0 0x7f477806f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47780ae3b0 con 0x7f477806fea0 2024-09-19T05:33:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f4770001a00 con 0x7f477806fea0 2024-09-19T05:33:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 >> v1:172.21.15.67:6789/0 conn(0x7f477806fea0 legacy=0x7f477815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47600039c0 0x7f4760003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4760004810 0x7f4760004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477815b1d0 0x7f47600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4778072210 con 0x7f47600039c0 2024-09-19T05:33:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f47780ae0f0 con 0x7f4760004810 2024-09-19T05:33:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f476000b9d0 con 0x7f477815b1d0 2024-09-19T05:33:12.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4776ffd640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47600039c0 0x7f4760003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:12.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f47767fc640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4760004810 0x7f4760004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f47777fe640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477815b1d0 0x7f47600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4776ffd640 1 -- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477815b1d0 msgr2=0x7f47600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4776ffd640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477815b1d0 0x7f47600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4776ffd640 1 -- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4760004810 msgr2=0x7f4760004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4776ffd640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4760004810 0x7f4760004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f4776ffd640 1 -- 172.21.15.67:0/3446039856 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4760003530 con 0x7f47600039c0 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f47777fe640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477815b1d0 0x7f47600051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.651+0000 7f47767fc640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4760004810 0x7f4760004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f4776ffd640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47600039c0 0x7f4760003de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4768009ac0 tx=0x7f476801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37dce1eb2d758d2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768009690 con 0x7f47600039c0 2024-09-19T05:33:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47680a9450 con 0x7f47600039c0 2024-09-19T05:33:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f4775ffb640 1 -- 172.21.15.67:0/3446039856 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47680a9820 con 0x7f47600039c0 2024-09-19T05:33:12.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f477d639640 1 -- 172.21.15.67:0/3446039856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47600039c0 msgr2=0x7f4760003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f477d639640 1 --2- 172.21.15.67:0/3446039856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47600039c0 0x7f4760003de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4768009ac0 tx=0x7f476801ca50 comp rx=0 tx=0).stop 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f47777fe640 1 -- 172.21.15.67:0/3446039856 reap_dead start 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f477d639640 1 -- 172.21.15.67:0/3446039856 shutdown_connections 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f477d639640 1 -- 172.21.15.67:0/3446039856 >> 172.21.15.67:0/3446039856 conn(0x7f47780b1e50 msgr2=0x7f47780b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f477d639640 1 -- 172.21.15.67:0/3446039856 shutdown_connections 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f477d639640 1 -- 172.21.15.67:0/3446039856 wait complete. 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f477d639640 1 Processor -- start 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.655+0000 7f477d639640 1 -- start start 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f477d639640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47600039c0 0x7f4778163bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f477d639640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f477814f8f0 0x7f4778153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f477d639640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477814f3c0 0x7f4778159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f477d639640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47780b4440 con 0x7f477814f8f0 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f477d639640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4778072420 con 0x7f47600039c0 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f477d639640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4778165de0 con 0x7f477814f3c0 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f47767fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f477814f8f0 0x7f4778153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f47767fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f477814f8f0 0x7f4778153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46308/0 (socket says 172.21.15.67:46308) 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f47767fc640 1 -- 172.21.15.67:0/2911399578 learned_addr learned my addr 172.21.15.67:0/2911399578 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f4776ffd640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47600039c0 0x7f4778163bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f47777fe640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477814f3c0 0x7f4778159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f47767fc640 1 -- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477814f3c0 msgr2=0x7f4778159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f47767fc640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477814f3c0 0x7f4778159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f47767fc640 1 -- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47600039c0 msgr2=0x7f4778163bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f47767fc640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47600039c0 0x7f4778163bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f47767fc640 1 -- 172.21.15.67:0/2911399578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4778164530 con 0x7f477814f8f0 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f47767fc640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f477814f8f0 0x7f4778153fc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f476c010920 tx=0x7f476c010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f475f7fe640 1 -- 172.21.15.67:0/2911399578 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c00f040 con 0x7f477814f8f0 2024-09-19T05:33:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f475f7fe640 1 -- 172.21.15.67:0/2911399578 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476c00ec20 con 0x7f477814f8f0 2024-09-19T05:33:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f477d639640 1 -- 172.21.15.67:0/2911399578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4778164810 con 0x7f477814f8f0 2024-09-19T05:33:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f475f7fe640 1 -- 172.21.15.67:0/2911399578 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c01c400 con 0x7f477814f8f0 2024-09-19T05:33:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f477d639640 1 -- 172.21.15.67:0/2911399578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47781537c0 con 0x7f477814f8f0 2024-09-19T05:33:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f477d639640 1 -- 172.21.15.67:0/2911399578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4778153cb0 con 0x7f477814f8f0 2024-09-19T05:33:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f475f7fe640 1 -- 172.21.15.67:0/2911399578 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f476c025420 con 0x7f477814f8f0 2024-09-19T05:33:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f475f7fe640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47640678c0 0x7f4764069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f475f7fe640 1 -- 172.21.15.67:0/2911399578 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f476c086250 con 0x7f477814f8f0 2024-09-19T05:33:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.659+0000 7f4776ffd640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47640678c0 0x7f4764069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.663+0000 7f4776ffd640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47640678c0 0x7f4764069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47680ae000 tx=0x7f47680b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:12.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.663+0000 7f475f7fe640 1 -- 172.21.15.67:0/2911399578 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f476c018030 con 0x7f477814f8f0 2024-09-19T05:33:12.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:12.827+0000 7f477d639640 1 -- 172.21.15.67:0/2911399578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f477806f960 con 0x7f477814f8f0 2024-09-19T05:33:13.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.499+0000 7f475f7fe640 1 -- 172.21.15.67:0/2911399578 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f476c056ec0 con 0x7f477814f8f0 2024-09-19T05:33:13.500 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:33:13.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 -- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47640678c0 msgr2=0x7f4764069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:13.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47640678c0 0x7f4764069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47680ae000 tx=0x7f47680b3040 comp rx=0 tx=0).stop 2024-09-19T05:33:13.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 -- 172.21.15.67:0/2911399578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f477814f8f0 msgr2=0x7f4778153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:13.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f477814f8f0 0x7f4778153fc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f476c010920 tx=0x7f476c010de0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 -- 172.21.15.67:0/2911399578 shutdown_connections 2024-09-19T05:33:13.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47640678c0 0x7f4764069d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477814f3c0 0x7f4778159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f477814f8f0 0x7f4778153fc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 --2- 172.21.15.67:0/2911399578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47600039c0 0x7f4778163bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 -- 172.21.15.67:0/2911399578 >> 172.21.15.67:0/2911399578 conn(0x7f47780b1e50 msgr2=0x7f477815a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:13.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 -- 172.21.15.67:0/2911399578 shutdown_connections 2024-09-19T05:33:13.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.503+0000 7f477d639640 1 -- 172.21.15.67:0/2911399578 wait complete. 2024-09-19T05:33:13.538 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:33:13.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d9ee8640 1 Processor -- start 2024-09-19T05:33:13.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d9ee8640 1 -- start start 2024-09-19T05:33:13.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d9ee8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f53d4070070 0x7f53d4165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:13.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d9ee8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d40aef30 con 0x7f53d406dfc0 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d9ee8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d40ae3b0 con 0x7f53d415b1d0 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d9ee8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f53d4072210 con 0x7f53d4070070 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d2ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f53d406dfc0 0x7f53d406f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47622/0 (socket says 172.21.15.67:47622) 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d2ffd640 1 -- 172.21.15.67:0/1685610842 learned_addr learned my addr 172.21.15.67:0/1685610842 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d3fff640 1 --2- 172.21.15.67:0/1685610842 >> v2:172.21.15.97:3300/0 conn(0x7f53d4070070 0x7f53d4165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543815529 0 0) 0x7f53d40aef30 con 0x7f53d406dfc0 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53c0003530 con 0x7f53d406dfc0 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 514387586 0 0) 0x7f53c0003530 con 0x7f53d406dfc0 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 >> v2:172.21.15.97:3300/0 conn(0x7f53d4070070 msgr2=0x7f53d4165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 --2- 172.21.15.67:0/1685610842 >> v2:172.21.15.97:3300/0 conn(0x7f53d4070070 0x7f53d4165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 >> v1:172.21.15.97:6789/0 conn(0x7f53d415b1d0 legacy=0x7f53d40adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d40ae690 con 0x7f53d406dfc0 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f53c4001680 con 0x7f53d406dfc0 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 >> v1:172.21.15.67:6789/0 conn(0x7f53d406dfc0 legacy=0x7f53d406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53c00039c0 0x7f53c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c0004810 0x7f53c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53c00051d0 0x7f53c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4072210 con 0x7f53c0004810 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f53c000c070 con 0x7f53c00051d0 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f53c000e480 con 0x7f53c00039c0 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d2ffd640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c0004810 0x7f53c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d3fff640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53c00051d0 0x7f53c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d37fe640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53c00039c0 0x7f53c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d2ffd640 1 -- 172.21.15.67:0/1685610842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53c00039c0 msgr2=0x7f53c0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d2ffd640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53c00039c0 0x7f53c0003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d2ffd640 1 -- 172.21.15.67:0/1685610842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53c00051d0 msgr2=0x7f53c000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d2ffd640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53c00051d0 0x7f53c000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d2ffd640 1 -- 172.21.15.67:0/1685610842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c0003530 con 0x7f53c0004810 2024-09-19T05:33:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d3fff640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53c00051d0 0x7f53c000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.659+0000 7f53d3fff640 1 -- 172.21.15.67:0/1685610842 reap_dead start 2024-09-19T05:33:13.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d2ffd640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c0004810 0x7f53c0004c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53c400c1c0 tx=0x7f53c401f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420fe1b6b918ec9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4007d00 con 0x7f53c0004810 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c4005b00 con 0x7f53c0004810 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d27fc640 1 -- 172.21.15.67:0/1685610842 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4007070 con 0x7f53c0004810 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d9ee8640 1 -- 172.21.15.67:0/1685610842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c0004810 msgr2=0x7f53c0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d9ee8640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c0004810 0x7f53c0004c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53c400c1c0 tx=0x7f53c401f350 comp rx=0 tx=0).stop 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d9ee8640 1 -- 172.21.15.67:0/1685610842 shutdown_connections 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d9ee8640 1 --2- 172.21.15.67:0/1685610842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c0004810 0x7f53c0004c90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d9ee8640 1 -- 172.21.15.67:0/1685610842 >> 172.21.15.67:0/1685610842 conn(0x7f53d40b1e50 msgr2=0x7f53d40b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d9ee8640 1 -- 172.21.15.67:0/1685610842 shutdown_connections 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d9ee8640 1 -- 172.21.15.67:0/1685610842 wait complete. 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d9ee8640 1 Processor -- start 2024-09-19T05:33:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.663+0000 7f53d9ee8640 1 -- start start 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d9ee8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53c0004810 0x7f53d414dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d9ee8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d41f3660 0x7f53d4099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d9ee8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d4151e60 0x7f53d40affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d9ee8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4072420 con 0x7f53d4151e60 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d9ee8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f53d40aec50 con 0x7f53d41f3660 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d9ee8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f53d40adbb0 con 0x7f53c0004810 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d4151e60 0x7f53d40affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d4151e60 0x7f53d40affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46332/0 (socket says 172.21.15.67:46332) 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d3fff640 1 -- 172.21.15.67:0/398571114 learned_addr learned my addr 172.21.15.67:0/398571114 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d2ffd640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d41f3660 0x7f53d4099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d37fe640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53c0004810 0x7f53d414dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d3fff640 1 -- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53c0004810 msgr2=0x7f53d414dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d3fff640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53c0004810 0x7f53d414dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d3fff640 1 -- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d41f3660 msgr2=0x7f53d4099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d3fff640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d41f3660 0x7f53d4099900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d3fff640 1 -- 172.21.15.67:0/398571114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d41f3af0 con 0x7f53d4151e60 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d3fff640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d4151e60 0x7f53d40affc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53d4071a60 tx=0x7f53cc00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53cbfff640 1 -- 172.21.15.67:0/398571114 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc016420 con 0x7f53d4151e60 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53cbfff640 1 -- 172.21.15.67:0/398571114 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc01b070 con 0x7f53d4151e60 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d9ee8640 1 -- 172.21.15.67:0/398571114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d41f3dd0 con 0x7f53d4151e60 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53cbfff640 1 -- 172.21.15.67:0/398571114 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0167e0 con 0x7f53d4151e60 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d9ee8640 1 -- 172.21.15.67:0/398571114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d41f4390 con 0x7f53d4151e60 2024-09-19T05:33:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d9ee8640 1 -- 172.21.15.67:0/398571114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d4068530 con 0x7f53d4151e60 2024-09-19T05:33:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53cbfff640 1 -- 172.21.15.67:0/398571114 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53cc016980 con 0x7f53d4151e60 2024-09-19T05:33:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53cbfff640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53b40678c0 0x7f53b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53cbfff640 1 -- 172.21.15.67:0/398571114 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f53cc086b00 con 0x7f53d4151e60 2024-09-19T05:33:13.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.667+0000 7f53d37fe640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53b40678c0 0x7f53b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:13.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.671+0000 7f53d37fe640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53b40678c0 0x7f53b4069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53bc000c10 tx=0x7f53bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:13.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.671+0000 7f53cbfff640 1 -- 172.21.15.67:0/398571114 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f53cc025020 con 0x7f53d4151e60 2024-09-19T05:33:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:13.871+0000 7f53d9ee8640 1 -- 172.21.15.67:0/398571114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f53d40aef30 con 0x7f53d4151e60 2024-09-19T05:33:14.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.499+0000 7f53cbfff640 1 -- 172.21.15.67:0/398571114 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f53cc016c70 con 0x7f53d4151e60 2024-09-19T05:33:14.502 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T05:33:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 -- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53b40678c0 msgr2=0x7f53b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53b40678c0 0x7f53b4069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53bc000c10 tx=0x7f53bc009040 comp rx=0 tx=0).stop 2024-09-19T05:33:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 -- 172.21.15.67:0/398571114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d4151e60 msgr2=0x7f53d40affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d4151e60 0x7f53d40affc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53d4071a60 tx=0x7f53cc00f520 comp rx=0 tx=0).stop 2024-09-19T05:33:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 -- 172.21.15.67:0/398571114 shutdown_connections 2024-09-19T05:33:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d4151e60 0x7f53d40affc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d41f3660 0x7f53d4099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53b40678c0 0x7f53b4069d80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 --2- 172.21.15.67:0/398571114 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53c0004810 0x7f53d414dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 -- 172.21.15.67:0/398571114 >> 172.21.15.67:0/398571114 conn(0x7f53d40b1e50 msgr2=0x7f53d40cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 -- 172.21.15.67:0/398571114 shutdown_connections 2024-09-19T05:33:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.503+0000 7f53d9ee8640 1 -- 172.21.15.67:0/398571114 wait complete. 2024-09-19T05:33:14.540 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-19T05:33:14.540 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-19T05:33:14.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea237db640 1 Processor -- start 2024-09-19T05:33:14.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea237db640 1 -- start start 2024-09-19T05:33:14.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea237db640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fea1c071e30 0x7fea1c072740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:14.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea237db640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fea1c0ad550 0x7fea1c072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:14.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea237db640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea1c0b5200 con 0x7fea1c15a950 2024-09-19T05:33:14.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea237db640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fea1c06dfc0 con 0x7fea1c071e30 2024-09-19T05:33:14.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea237db640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fea1c0b4f20 con 0x7fea1c0ad550 2024-09-19T05:33:14.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea20d76640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fea1c071e30 0x7fea1c072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:14.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea20d76640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fea1c071e30 0x7fea1c072740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46348/0 (socket says 172.21.15.67:46348) 2024-09-19T05:33:14.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea21d78640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fea1c0ad550 0x7fea1c072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:14.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.667+0000 7fea20d76640 1 -- 172.21.15.67:0/1024538354 learned_addr learned my addr 172.21.15.67:0/1024538354 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:14.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea20d76640 1 -- 172.21.15.67:0/1024538354 >> v2:172.21.15.97:3300/0 conn(0x7fea1c0ad550 msgr2=0x7fea1c072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:14.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea20d76640 1 --2- 172.21.15.67:0/1024538354 >> v2:172.21.15.97:3300/0 conn(0x7fea1c0ad550 0x7fea1c072c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:14.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea20d76640 1 -- 172.21.15.67:0/1024538354 >> v1:172.21.15.97:6789/0 conn(0x7fea1c15a950 legacy=0x7fea1c0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:14.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea20d76640 1 -- 172.21.15.67:0/1024538354 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c06e260 con 0x7fea1c071e30 2024-09-19T05:33:14.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea20d76640 1 --2- 172.21.15.67:0/1024538354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 0x7fea1c072740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0cc590 tx=0x7fea0c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a14bd06c6baac6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:14.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea13fff640 1 -- 172.21.15.67:0/1024538354 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0b0070 con 0x7fea1c071e30 2024-09-19T05:33:14.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea13fff640 1 -- 172.21.15.67:0/1024538354 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea0c0ab600 con 0x7fea1c071e30 2024-09-19T05:33:14.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea13fff640 1 -- 172.21.15.67:0/1024538354 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0ab9d0 con 0x7fea1c071e30 2024-09-19T05:33:14.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea237db640 1 -- 172.21.15.67:0/1024538354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 msgr2=0x7fea1c072740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:14.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea237db640 1 --2- 172.21.15.67:0/1024538354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 0x7fea1c072740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0cc590 tx=0x7fea0c01c490 comp rx=0 tx=0).stop 2024-09-19T05:33:14.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea237db640 1 -- 172.21.15.67:0/1024538354 shutdown_connections 2024-09-19T05:33:14.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea237db640 1 --2- 172.21.15.67:0/1024538354 >> v2:172.21.15.97:3300/0 conn(0x7fea1c0ad550 0x7fea1c072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:14.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea237db640 1 --2- 172.21.15.67:0/1024538354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 0x7fea1c072740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:14.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea237db640 1 -- 172.21.15.67:0/1024538354 >> 172.21.15.67:0/1024538354 conn(0x7fea1c06c0c0 msgr2=0x7fea1c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:14.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea237db640 1 -- 172.21.15.67:0/1024538354 shutdown_connections 2024-09-19T05:33:14.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.671+0000 7fea237db640 1 -- 172.21.15.67:0/1024538354 wait complete. 2024-09-19T05:33:14.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 Processor -- start 2024-09-19T05:33:14.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 -- start start 2024-09-19T05:33:14.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 0x7fea1c0999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:14.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea1c0ad550 0x7fea1c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:14.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea1c15a950 0x7fea1c158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:14.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c06f680 con 0x7fea1c071e30 2024-09-19T05:33:14.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c06f500 con 0x7fea1c0ad550 2024-09-19T05:33:14.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fea1c06f800 con 0x7fea1c15a950 2024-09-19T05:33:14.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea21577640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 0x7fea1c0999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:14.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea21577640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 0x7fea1c0999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46356/0 (socket says 172.21.15.67:46356) 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea21577640 1 -- 172.21.15.67:0/615871790 learned_addr learned my addr 172.21.15.67:0/615871790 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea20d76640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea1c0ad550 0x7fea1c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea21d78640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea1c15a950 0x7fea1c158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea21577640 1 -- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea1c15a950 msgr2=0x7fea1c158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea21577640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea1c15a950 0x7fea1c158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea21577640 1 -- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea1c0ad550 msgr2=0x7fea1c0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea21577640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea1c0ad550 0x7fea1c0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea21577640 1 -- 172.21.15.67:0/615871790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c0cd380 con 0x7fea1c071e30 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea21577640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 0x7fea1c0999e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c450 tx=0x7fea1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea11ffb640 1 -- 172.21.15.67:0/615871790 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea140052d0 con 0x7fea1c071e30 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea11ffb640 1 -- 172.21.15.67:0/615871790 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea14005470 con 0x7fea1c071e30 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 -- 172.21.15.67:0/615871790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1c14df70 con 0x7fea1c071e30 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea11ffb640 1 -- 172.21.15.67:0/615871790 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14007260 con 0x7fea1c071e30 2024-09-19T05:33:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 -- 172.21.15.67:0/615871790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1c14e530 con 0x7fea1c071e30 2024-09-19T05:33:14.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.675+0000 7fea237db640 1 -- 172.21.15.67:0/615871790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea1c0b4760 con 0x7fea1c071e30 2024-09-19T05:33:14.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.679+0000 7fea11ffb640 1 -- 172.21.15.67:0/615871790 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fea14007400 con 0x7fea1c071e30 2024-09-19T05:33:14.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.679+0000 7fea11ffb640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea000678f0 0x7fea00069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:14.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.679+0000 7fea11ffb640 1 -- 172.21.15.67:0/615871790 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fea14085190 con 0x7fea1c071e30 2024-09-19T05:33:14.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.679+0000 7fea20d76640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea000678f0 0x7fea00069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:14.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.679+0000 7fea20d76640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea000678f0 0x7fea00069db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0ad000 tx=0x7fea0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:14.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.683+0000 7fea11ffb640 1 -- 172.21.15.67:0/615871790 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fea140555f0 con 0x7fea1c071e30 2024-09-19T05:33:14.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:14.847+0000 7fea237db640 1 -- 172.21.15.67:0/615871790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fea1c0cc760 con 0x7fea1c071e30 2024-09-19T05:33:15.476 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-09-19T05:33:15.475+0000 7f24d713a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:33:15.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.503+0000 7fea11ffb640 1 -- 172.21.15.67:0/615871790 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fea140598f0 con 0x7fea1c071e30 2024-09-19T05:33:15.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 -- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea000678f0 msgr2=0x7fea00069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:15.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea000678f0 0x7fea00069db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0ad000 tx=0x7fea0c008040 comp rx=0 tx=0).stop 2024-09-19T05:33:15.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 -- 172.21.15.67:0/615871790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 msgr2=0x7fea1c0999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:15.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 0x7fea1c0999e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c450 tx=0x7fea1400c910 comp rx=0 tx=0).stop 2024-09-19T05:33:15.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 -- 172.21.15.67:0/615871790 shutdown_connections 2024-09-19T05:33:15.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea000678f0 0x7fea00069db0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:15.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea1c15a950 0x7fea1c158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:15.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea1c0ad550 0x7fea1c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:15.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 --2- 172.21.15.67:0/615871790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea1c071e30 0x7fea1c0999e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:15.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 -- 172.21.15.67:0/615871790 >> 172.21.15.67:0/615871790 conn(0x7fea1c06c0c0 msgr2=0x7fea1c0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:15.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 -- 172.21.15.67:0/615871790 shutdown_connections 2024-09-19T05:33:15.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.507+0000 7fea237db640 1 -- 172.21.15.67:0/615871790 wait complete. 2024-09-19T05:33:15.534 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:33:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86da517640 1 Processor -- start 2024-09-19T05:33:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86da517640 1 -- start start 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86da517640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f86d406ffd0 0x7f86d40aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86da517640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d40ad840 con 0x7f86d4159c60 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86da517640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d415a040 con 0x7f86d40b3150 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86da517640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f86d415d460 con 0x7f86d406ffd0 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86d37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f86d406ffd0 0x7f86d40aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86d37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f86d406ffd0 0x7f86d40aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46368/0 (socket says 172.21.15.67:46368) 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86d37fe640 1 -- 172.21.15.67:0/4262370299 learned_addr learned my addr 172.21.15.67:0/4262370299 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86d3fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f86d4159c60 0x7f86d40ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47638/0 (socket says 172.21.15.67:47638) 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86d37fe640 1 -- 172.21.15.67:0/4262370299 >> v1:172.21.15.97:6789/0 conn(0x7f86d40b3150 legacy=0x7f86d415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86d37fe640 1 -- 172.21.15.67:0/4262370299 >> v1:172.21.15.67:6789/0 conn(0x7f86d4159c60 legacy=0x7f86d40ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.663+0000 7f86d37fe640 1 -- 172.21.15.67:0/4262370299 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d415c850 con 0x7f86d406ffd0 2024-09-19T05:33:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86d37fe640 1 --2- 172.21.15.67:0/4262370299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d406ffd0 0x7f86d40aec90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009870 tx=0x7f86c801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f65df5394d43ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86d2ffd640 1 -- 172.21.15.67:0/4262370299 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c80aa650 con 0x7f86d406ffd0 2024-09-19T05:33:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86d2ffd640 1 -- 172.21.15.67:0/4262370299 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c80af070 con 0x7f86d406ffd0 2024-09-19T05:33:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86d2ffd640 1 -- 172.21.15.67:0/4262370299 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c80aaa10 con 0x7f86d406ffd0 2024-09-19T05:33:15.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 -- 172.21.15.67:0/4262370299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d406ffd0 msgr2=0x7f86d40aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:15.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 --2- 172.21.15.67:0/4262370299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d406ffd0 0x7f86d40aec90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009870 tx=0x7f86c801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:33:15.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 -- 172.21.15.67:0/4262370299 shutdown_connections 2024-09-19T05:33:15.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 --2- 172.21.15.67:0/4262370299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d406ffd0 0x7f86d40aec90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:15.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 -- 172.21.15.67:0/4262370299 >> 172.21.15.67:0/4262370299 conn(0x7f86d40b1e50 msgr2=0x7f86d40b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:15.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 -- 172.21.15.67:0/4262370299 shutdown_connections 2024-09-19T05:33:15.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 -- 172.21.15.67:0/4262370299 wait complete. 2024-09-19T05:33:15.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 Processor -- start 2024-09-19T05:33:15.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 -- start start 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86d406ffd0 0x7f86d414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86d40b3150 0x7f86d409a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d4159c60 0x7f86d4153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f86d4169e40 con 0x7f86d4159c60 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f86d40af5e0 con 0x7f86d40b3150 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86da517640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f86d4169fc0 con 0x7f86d406ffd0 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86d8ab4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d4159c60 0x7f86d4153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86d8ab4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d4159c60 0x7f86d4153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46384/0 (socket says 172.21.15.67:46384) 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.667+0000 7f86d8ab4640 1 -- 172.21.15.67:0/3868042955 learned_addr learned my addr 172.21.15.67:0/3868042955 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d37fe640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86d40b3150 0x7f86d409a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:15.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d3fff640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86d406ffd0 0x7f86d414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d8ab4640 1 -- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86d406ffd0 msgr2=0x7f86d414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d8ab4640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86d406ffd0 0x7f86d414ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d8ab4640 1 -- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86d40b3150 msgr2=0x7f86d409a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d8ab4640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86d40b3150 0x7f86d409a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d8ab4640 1 -- 172.21.15.67:0/3868042955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d4166670 con 0x7f86d4159c60 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d37fe640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86d40b3150 0x7f86d409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d8ab4640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d4159c60 0x7f86d4153a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c7b0 tx=0x7f86cc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d0ff9640 1 -- 172.21.15.67:0/3868042955 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc004b70 con 0x7f86d4159c60 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d0ff9640 1 -- 172.21.15.67:0/3868042955 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc004d10 con 0x7f86d4159c60 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86da517640 1 -- 172.21.15.67:0/3868042955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d4166a10 con 0x7f86d4159c60 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d0ff9640 1 -- 172.21.15.67:0/3868042955 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc00aa90 con 0x7f86d4159c60 2024-09-19T05:33:15.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86da517640 1 -- 172.21.15.67:0/3868042955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d4166390 con 0x7f86d4159c60 2024-09-19T05:33:15.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86da517640 1 -- 172.21.15.67:0/3868042955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d40aec90 con 0x7f86d4159c60 2024-09-19T05:33:15.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d0ff9640 1 -- 172.21.15.67:0/3868042955 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86cc00ac30 con 0x7f86d4159c60 2024-09-19T05:33:15.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d0ff9640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86c00678c0 0x7f86c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:15.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d0ff9640 1 -- 172.21.15.67:0/3868042955 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f86cc0862b0 con 0x7f86d4159c60 2024-09-19T05:33:15.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d3fff640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86c00678c0 0x7f86c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:15.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.671+0000 7f86d3fff640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86c00678c0 0x7f86c0069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86d4160190 tx=0x7f86c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:15.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.675+0000 7f86d0ff9640 1 -- 172.21.15.67:0/3868042955 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f86cc056d50 con 0x7f86d4159c60 2024-09-19T05:33:15.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:15.835+0000 7f86da517640 1 -- 172.21.15.67:0/3868042955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f86d406cf40 con 0x7f86d4159c60 2024-09-19T05:33:17.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.550+0000 7f86d0ff9640 1 -- 172.21.15.67:0/3868042955 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f86cc056650 con 0x7f86d4159c60 2024-09-19T05:33:17.552 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data_ec' created 2024-09-19T05:33:17.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 -- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86c00678c0 msgr2=0x7f86c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:17.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86c00678c0 0x7f86c0069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86d4160190 tx=0x7f86c4009040 comp rx=0 tx=0).stop 2024-09-19T05:33:17.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 -- 172.21.15.67:0/3868042955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d4159c60 msgr2=0x7f86d4153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:17.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d4159c60 0x7f86d4153a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c7b0 tx=0x7f86cc00cc70 comp rx=0 tx=0).stop 2024-09-19T05:33:17.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 -- 172.21.15.67:0/3868042955 shutdown_connections 2024-09-19T05:33:17.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86d4159c60 0x7f86d4153a50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86d40b3150 0x7f86d409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86c00678c0 0x7f86c0069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 --2- 172.21.15.67:0/3868042955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86d406ffd0 0x7f86d414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 -- 172.21.15.67:0/3868042955 >> 172.21.15.67:0/3868042955 conn(0x7f86d40b1e50 msgr2=0x7f86d406f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 -- 172.21.15.67:0/3868042955 shutdown_connections 2024-09-19T05:33:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.554+0000 7f86da517640 1 -- 172.21.15.67:0/3868042955 wait complete. 2024-09-19T05:33:17.584 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-19T05:33:17.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.710+0000 7f3683d46640 1 Processor -- start 2024-09-19T05:33:17.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.710+0000 7f3683d46640 1 -- start start 2024-09-19T05:33:17.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.710+0000 7f3683d46640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f367c0b36d0 0x7f367c0d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:17.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.710+0000 7f3683d46640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f367c0c7a30 0x7f367c0c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:17.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.710+0000 7f3683d46640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367c09b4e0 con 0x7f367c0d0210 2024-09-19T05:33:17.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.710+0000 7f3683d46640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f367c0d1240 con 0x7f367c0c7a30 2024-09-19T05:33:17.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.710+0000 7f3683d46640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f367c09b7c0 con 0x7f367c0b36d0 2024-09-19T05:33:17.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.710+0000 7f3681ae2640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f367c0d0210 0x7f367c0d05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48702/0 (socket says 172.21.15.67:48702) 2024-09-19T05:33:17.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.710+0000 7f3681ae2640 1 -- 172.21.15.67:0/104208541 learned_addr learned my addr 172.21.15.67:0/104208541 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:17.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f36822e3640 1 --2- 172.21.15.67:0/104208541 >> v2:172.21.15.97:3300/0 conn(0x7f367c0c7a30 0x7f367c0c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:17.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029624267 0 0) 0x7f367c09b4e0 con 0x7f367c0d0210 2024-09-19T05:33:17.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3668003530 con 0x7f367c0d0210 2024-09-19T05:33:17.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f36812e1640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f367c0b36d0 0x7f367c0d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:17.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3419033803 0 0) 0x7f3668003530 con 0x7f367c0d0210 2024-09-19T05:33:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f367c0b36d0 msgr2=0x7f367c0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f367c0b36d0 0x7f367c0d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 >> v2:172.21.15.97:3300/0 conn(0x7f367c0c7a30 msgr2=0x7f367c0c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 --2- 172.21.15.67:0/104208541 >> v2:172.21.15.97:3300/0 conn(0x7f367c0c7a30 0x7f367c0c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c09baa0 con 0x7f367c0d0210 2024-09-19T05:33:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3678001680 con 0x7f367c0d0210 2024-09-19T05:33:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 >> v1:172.21.15.67:6789/0 conn(0x7f367c0d0210 legacy=0x7f367c0d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36680039c0 0x7f3668003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f367c0b36d0 0x7f3668004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3668004d50 0x7f36680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f367c0d1240 con 0x7f36680039c0 2024-09-19T05:33:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f367c09b7c0 con 0x7f3668004d50 2024-09-19T05:33:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f366800b9d0 con 0x7f367c0b36d0 2024-09-19T05:33:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3681ae2640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36680039c0 0x7f3668003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f36822e3640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3668004d50 0x7f36680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f36812e1640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f367c0b36d0 0x7f3668004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3681ae2640 1 -- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f367c0b36d0 msgr2=0x7f3668004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3681ae2640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f367c0b36d0 0x7f3668004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3681ae2640 1 -- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3668004d50 msgr2=0x7f36680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3681ae2640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3668004d50 0x7f36680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3681ae2640 1 -- 172.21.15.67:0/104208541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3668003530 con 0x7f36680039c0 2024-09-19T05:33:17.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3681ae2640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36680039c0 0x7f3668003de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f367800c210 tx=0x7f367801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80290ae00c9a63c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:17.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678007d40 con 0x7f36680039c0 2024-09-19T05:33:17.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36780a9020 con 0x7f36680039c0 2024-09-19T05:33:17.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.714+0000 7f3680ae0640 1 -- 172.21.15.67:0/104208541 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678005ae0 con 0x7f36680039c0 2024-09-19T05:33:17.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- 172.21.15.67:0/104208541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36680039c0 msgr2=0x7f3668003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:17.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 --2- 172.21.15.67:0/104208541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36680039c0 0x7f3668003de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f367800c210 tx=0x7f367801cca0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36822e3640 1 -- 172.21.15.67:0/104208541 reap_dead start 2024-09-19T05:33:17.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- 172.21.15.67:0/104208541 shutdown_connections 2024-09-19T05:33:17.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- 172.21.15.67:0/104208541 >> 172.21.15.67:0/104208541 conn(0x7f367c0d2310 msgr2=0x7f367c0d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- 172.21.15.67:0/104208541 shutdown_connections 2024-09-19T05:33:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- 172.21.15.67:0/104208541 wait complete. 2024-09-19T05:33:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 Processor -- start 2024-09-19T05:33:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- start start 2024-09-19T05:33:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36680039c0 0x7f367c1504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f367c156d40 0x7f367c1f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f367c1511d0 0x7f367c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f367c169290 con 0x7f367c1511d0 2024-09-19T05:33:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f367c15eb90 con 0x7f367c156d40 2024-09-19T05:33:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f367c169410 con 0x7f36680039c0 2024-09-19T05:33:17.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36822e3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f367c1511d0 0x7f367c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:17.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36822e3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f367c1511d0 0x7f367c1560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45710/0 (socket says 172.21.15.67:45710) 2024-09-19T05:33:17.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36822e3640 1 -- 172.21.15.67:0/1474395038 learned_addr learned my addr 172.21.15.67:0/1474395038 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:17.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36812e1640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f367c156d40 0x7f367c1f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:17.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3681ae2640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36680039c0 0x7f367c1504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:17.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36822e3640 1 -- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36680039c0 msgr2=0x7f367c1504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:17.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36822e3640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36680039c0 0x7f367c1504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36822e3640 1 -- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f367c156d40 msgr2=0x7f367c1f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:17.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36822e3640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f367c156d40 0x7f367c1f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:17.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36822e3640 1 -- 172.21.15.67:0/1474395038 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c15c650 con 0x7f367c1511d0 2024-09-19T05:33:17.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36812e1640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f367c156d40 0x7f367c1f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:17.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36822e3640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f367c1511d0 0x7f367c1560f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f367c073270 tx=0x7f36740115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:17.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36727fc640 1 -- 172.21.15.67:0/1474395038 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674011e10 con 0x7f367c1511d0 2024-09-19T05:33:17.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36727fc640 1 -- 172.21.15.67:0/1474395038 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367401b070 con 0x7f367c1511d0 2024-09-19T05:33:17.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- 172.21.15.67:0/1474395038 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367c150a00 con 0x7f367c1511d0 2024-09-19T05:33:17.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f36727fc640 1 -- 172.21.15.67:0/1474395038 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36740039a0 con 0x7f367c1511d0 2024-09-19T05:33:17.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.718+0000 7f3683d46640 1 -- 172.21.15.67:0/1474395038 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367c15cba0 con 0x7f367c1511d0 2024-09-19T05:33:17.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.722+0000 7f3683d46640 1 -- 172.21.15.67:0/1474395038 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367c0c7e40 con 0x7f367c1511d0 2024-09-19T05:33:17.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.722+0000 7f36727fc640 1 -- 172.21.15.67:0/1474395038 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3674003b60 con 0x7f367c1511d0 2024-09-19T05:33:17.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.722+0000 7f36727fc640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36600678c0 0x7f3660069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:17.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.722+0000 7f36727fc640 1 -- 172.21.15.67:0/1474395038 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f36740875d0 con 0x7f367c1511d0 2024-09-19T05:33:17.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.722+0000 7f3681ae2640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36600678c0 0x7f3660069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:17.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.722+0000 7f3681ae2640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36600678c0 0x7f3660069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f36780aa000 tx=0x7f36780b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:17.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.726+0000 7f36727fc640 1 -- 172.21.15.67:0/1474395038 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3674025020 con 0x7f367c1511d0 2024-09-19T05:33:17.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:17.902+0000 7f3683d46640 1 -- 172.21.15.67:0/1474395038 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f367c06f100 con 0x7f367c1511d0 2024-09-19T05:33:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.550+0000 7f36727fc640 1 -- 172.21.15.67:0/1474395038 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f3674057ed0 con 0x7f367c1511d0 2024-09-19T05:33:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:set pool 4 allow_ec_overwrites to true 2024-09-19T05:33:18.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.558+0000 7f3683d46640 1 -- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36600678c0 msgr2=0x7f3660069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:18.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.558+0000 7f3683d46640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36600678c0 0x7f3660069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f36780aa000 tx=0x7f36780b0040 comp rx=0 tx=0).stop 2024-09-19T05:33:18.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.558+0000 7f3683d46640 1 -- 172.21.15.67:0/1474395038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f367c1511d0 msgr2=0x7f367c1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:18.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.558+0000 7f3683d46640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f367c1511d0 0x7f367c1560f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f367c073270 tx=0x7f36740115a0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.558+0000 7f3683d46640 1 -- 172.21.15.67:0/1474395038 shutdown_connections 2024-09-19T05:33:18.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.558+0000 7f3683d46640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f367c1511d0 0x7f367c1560f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.558+0000 7f3683d46640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f367c156d40 0x7f367c1f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.558+0000 7f3683d46640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36600678c0 0x7f3660069d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.558+0000 7f3683d46640 1 --2- 172.21.15.67:0/1474395038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36680039c0 0x7f367c1504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.562+0000 7f3683d46640 1 -- 172.21.15.67:0/1474395038 >> 172.21.15.67:0/1474395038 conn(0x7f367c0d2310 msgr2=0x7f367c15a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:18.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.562+0000 7f3683d46640 1 -- 172.21.15.67:0/1474395038 shutdown_connections 2024-09-19T05:33:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.570+0000 7f3683d46640 1 -- 172.21.15.67:0/1474395038 wait complete. 2024-09-19T05:33:18.607 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-19T05:33:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.726+0000 7f80a668a640 1 Processor -- start 2024-09-19T05:33:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.726+0000 7f80a668a640 1 -- start start 2024-09-19T05:33:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.726+0000 7f80a668a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f80a014c2c0 0x7f80a0166f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.726+0000 7f80a668a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80a01674d0 con 0x7f80a006c3d0 2024-09-19T05:33:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.726+0000 7f80a668a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80a00b2950 con 0x7f80a014c6a0 2024-09-19T05:33:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.726+0000 7f80a668a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f80a00b2c30 con 0x7f80a014c2c0 2024-09-19T05:33:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f80a4c27640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f80a006c3d0 0x7f80a0163240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48710/0 (socket says 172.21.15.67:48710) 2024-09-19T05:33:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f80a4c27640 1 -- 172.21.15.67:0/4227466006 learned_addr learned my addr 172.21.15.67:0/4227466006 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809ffff640 1 --2- 172.21.15.67:0/4227466006 >> v2:172.21.15.97:3300/0 conn(0x7f80a014c2c0 0x7f80a0166f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769639566 0 0) 0x7f8094001120 con 0x7f80a006c3d0 2024-09-19T05:33:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8088003530 con 0x7f80a006c3d0 2024-09-19T05:33:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3959216292 0 0) 0x7f8088003530 con 0x7f80a006c3d0 2024-09-19T05:33:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 >> v2:172.21.15.97:3300/0 conn(0x7f80a014c2c0 msgr2=0x7f80a0166f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 --2- 172.21.15.67:0/4227466006 >> v2:172.21.15.97:3300/0 conn(0x7f80a014c2c0 0x7f80a0166f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 >> v1:172.21.15.97:6789/0 conn(0x7f80a014c6a0 legacy=0x7f80a006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a00b5d60 con 0x7f80a006c3d0 2024-09-19T05:33:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f8094001850 con 0x7f80a006c3d0 2024-09-19T05:33:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 >> v1:172.21.15.67:6789/0 conn(0x7f80a006c3d0 legacy=0x7f80a0163240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f8088003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8088004810 0x7f8088004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80880051d0 0x7f808800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f80a00b2c30 con 0x7f80880039c0 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f808800c070 con 0x7f8088004810 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f808800c270 con 0x7f80880051d0 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809ffff640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f8088003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809f7fe640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8088004810 0x7f8088004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f80a4c27640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80880051d0 0x7f808800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809ffff640 1 -- 172.21.15.67:0/4227466006 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80880051d0 msgr2=0x7f808800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809ffff640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80880051d0 0x7f808800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809ffff640 1 -- 172.21.15.67:0/4227466006 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8088004810 msgr2=0x7f8088004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809ffff640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8088004810 0x7f8088004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f809ffff640 1 -- 172.21.15.67:0/4227466006 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8088003530 con 0x7f80880039c0 2024-09-19T05:33:18.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.730+0000 7f80a4c27640 1 -- 172.21.15.67:0/4227466006 reap_dead start 2024-09-19T05:33:18.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f809f7fe640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8088004810 0x7f8088004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:18.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f809ffff640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f8088003de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8098009fc0 tx=0x7f809801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9e2d7aa30180b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:18.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80980b2070 con 0x7f80880039c0 2024-09-19T05:33:18.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80980a5a40 con 0x7f80880039c0 2024-09-19T05:33:18.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f809effd640 1 -- 172.21.15.67:0/4227466006 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098009c10 con 0x7f80880039c0 2024-09-19T05:33:18.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f80a668a640 1 -- 172.21.15.67:0/4227466006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 msgr2=0x7f8088003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:18.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f80a668a640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f8088003de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8098009fc0 tx=0x7f809801cc80 comp rx=0 tx=0).stop 2024-09-19T05:33:18.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f80a668a640 1 -- 172.21.15.67:0/4227466006 shutdown_connections 2024-09-19T05:33:18.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f80a668a640 1 --2- 172.21.15.67:0/4227466006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f8088003de0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f80a668a640 1 -- 172.21.15.67:0/4227466006 >> 172.21.15.67:0/4227466006 conn(0x7f80a009aa30 msgr2=0x7f80a00b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:18.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f80a668a640 1 -- 172.21.15.67:0/4227466006 shutdown_connections 2024-09-19T05:33:18.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f80a668a640 1 -- 172.21.15.67:0/4227466006 wait complete. 2024-09-19T05:33:18.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f80a668a640 1 Processor -- start 2024-09-19T05:33:18.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.734+0000 7f80a668a640 1 -- start start 2024-09-19T05:33:18.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f80a668a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f80a0147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f80a668a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80a00cd6e0 0x7f80a0148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f80a668a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80a0161f30 0x7f80a01623c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f80a668a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f80a006c250 con 0x7f80880039c0 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f80a668a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f80a006c0d0 con 0x7f80a00cd6e0 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f80a668a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f80a00d1950 con 0x7f80a0161f30 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f80a0147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f80a0147290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45732/0 (socket says 172.21.15.67:45732) 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809ffff640 1 -- 172.21.15.67:0/531547533 learned_addr learned my addr 172.21.15.67:0/531547533 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809f7fe640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80a00cd6e0 0x7f80a0148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f80a4c27640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80a0161f30 0x7f80a01623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809ffff640 1 -- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80a0161f30 msgr2=0x7f80a01623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809ffff640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80a0161f30 0x7f80a01623c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809ffff640 1 -- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80a00cd6e0 msgr2=0x7f80a0148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:18.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809ffff640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80a00cd6e0 0x7f80a0148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:18.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809ffff640 1 -- 172.21.15.67:0/531547533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a0147c00 con 0x7f80880039c0 2024-09-19T05:33:18.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809f7fe640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80a00cd6e0 0x7f80a0148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:18.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809ffff640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f80a0147290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f809801d520 tx=0x7f8098009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:18.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809cff9640 1 -- 172.21.15.67:0/531547533 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80980bf070 con 0x7f80880039c0 2024-09-19T05:33:18.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809cff9640 1 -- 172.21.15.67:0/531547533 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80980ad9e0 con 0x7f80880039c0 2024-09-19T05:33:18.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809cff9640 1 -- 172.21.15.67:0/531547533 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80980b2040 con 0x7f80880039c0 2024-09-19T05:33:18.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f80a668a640 1 -- 172.21.15.67:0/531547533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a0147ee0 con 0x7f80880039c0 2024-09-19T05:33:18.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f80a668a640 1 -- 172.21.15.67:0/531547533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a0143e40 con 0x7f80880039c0 2024-09-19T05:33:18.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f80a668a640 1 -- 172.21.15.67:0/531547533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a00d1ce0 con 0x7f80880039c0 2024-09-19T05:33:18.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809cff9640 1 -- 172.21.15.67:0/531547533 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80980039a0 con 0x7f80880039c0 2024-09-19T05:33:18.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809cff9640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f808c0678c0 0x7f808c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:18.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809cff9640 1 -- 172.21.15.67:0/531547533 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f8098120900 con 0x7f80880039c0 2024-09-19T05:33:18.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.738+0000 7f809f7fe640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f808c0678c0 0x7f808c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:18.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.742+0000 7f809f7fe640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f808c0678c0 0x7f808c069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8090007fd0 tx=0x7f8090009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:18.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.742+0000 7f809cff9640 1 -- 172.21.15.67:0/531547533 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8098016990 con 0x7f80880039c0 2024-09-19T05:33:18.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:18.946+0000 7f80a668a640 1 -- 172.21.15.67:0/531547533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f80a006a130 con 0x7f80880039c0 2024-09-19T05:33:19.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.570+0000 7f809cff9640 1 -- 172.21.15.67:0/531547533 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f80980f0ad0 con 0x7f80880039c0 2024-09-19T05:33:19.572 INFO:teuthology.orchestra.run.smithi067.stderr:added data pool 4 to fsmap 2024-09-19T05:33:19.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 -- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f808c0678c0 msgr2=0x7f808c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:19.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f808c0678c0 0x7f808c069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8090007fd0 tx=0x7f8090009040 comp rx=0 tx=0).stop 2024-09-19T05:33:19.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 -- 172.21.15.67:0/531547533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 msgr2=0x7f80a0147290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:19.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f80a0147290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f809801d520 tx=0x7f8098009750 comp rx=0 tx=0).stop 2024-09-19T05:33:19.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 -- 172.21.15.67:0/531547533 shutdown_connections 2024-09-19T05:33:19.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f808c0678c0 0x7f808c069d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80a0161f30 0x7f80a01623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80a00cd6e0 0x7f80a0148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 --2- 172.21.15.67:0/531547533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80880039c0 0x7f80a0147290 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f809801d520 tx=0x7f8098009750 comp rx=0 tx=0).stop 2024-09-19T05:33:19.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 -- 172.21.15.67:0/531547533 >> 172.21.15.67:0/531547533 conn(0x7f80a009aa30 msgr2=0x7f80a0163140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:19.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 -- 172.21.15.67:0/531547533 shutdown_connections 2024-09-19T05:33:19.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.574+0000 7f80a668a640 1 -- 172.21.15.67:0/531547533 wait complete. 2024-09-19T05:33:19.599 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.722+0000 7f364f9a0640 1 Processor -- start 2024-09-19T05:33:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.722+0000 7f364f9a0640 1 -- start start 2024-09-19T05:33:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364f9a0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f364815b1e0 0x7f36480b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364f9a0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f36480b4900 0x7f3648071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364f9a0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36480b3860 con 0x7f36480723c0 2024-09-19T05:33:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364f9a0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f364815b5c0 con 0x7f36480b4900 2024-09-19T05:33:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364f9a0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f36480b3b40 con 0x7f364815b1e0 2024-09-19T05:33:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364d73c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f364815b1e0 0x7f36480b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364d73c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f364815b1e0 0x7f36480b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:59234/0 (socket says 172.21.15.67:59234) 2024-09-19T05:33:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364d73c640 1 -- 172.21.15.67:0/109437665 learned_addr learned my addr 172.21.15.67:0/109437665 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364cf3b640 1 --2- 172.21.15.67:0/109437665 >> v2:172.21.15.97:3300/0 conn(0x7f36480b4900 0x7f3648071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364d73c640 1 -- 172.21.15.67:0/109437665 >> v2:172.21.15.97:3300/0 conn(0x7f36480b4900 msgr2=0x7f3648071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364d73c640 1 --2- 172.21.15.67:0/109437665 >> v2:172.21.15.97:3300/0 conn(0x7f36480b4900 0x7f3648071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364d73c640 1 -- 172.21.15.67:0/109437665 >> v1:172.21.15.97:6789/0 conn(0x7f36480723c0 legacy=0x7f364815ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:19.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.726+0000 7f364d73c640 1 -- 172.21.15.67:0/109437665 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36480b3e20 con 0x7f364815b1e0 2024-09-19T05:33:19.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364d73c640 1 --2- 172.21.15.67:0/109437665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f364815b1e0 0x7f36480b2fd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f36440098a0 tx=0x7f364401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e81fbc51d68de44b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:19.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f363ffff640 1 -- 172.21.15.67:0/109437665 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36440a95f0 con 0x7f364815b1e0 2024-09-19T05:33:19.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f363ffff640 1 -- 172.21.15.67:0/109437665 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36440a9790 con 0x7f364815b1e0 2024-09-19T05:33:19.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f363ffff640 1 -- 172.21.15.67:0/109437665 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36440a9b60 con 0x7f364815b1e0 2024-09-19T05:33:19.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 -- 172.21.15.67:0/109437665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f364815b1e0 msgr2=0x7f36480b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:19.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 --2- 172.21.15.67:0/109437665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f364815b1e0 0x7f36480b2fd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f36440098a0 tx=0x7f364401c510 comp rx=0 tx=0).stop 2024-09-19T05:33:19.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 -- 172.21.15.67:0/109437665 shutdown_connections 2024-09-19T05:33:19.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 --2- 172.21.15.67:0/109437665 >> v2:172.21.15.97:3300/0 conn(0x7f36480b4900 0x7f3648071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 --2- 172.21.15.67:0/109437665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f364815b1e0 0x7f36480b2fd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 -- 172.21.15.67:0/109437665 >> 172.21.15.67:0/109437665 conn(0x7f36480d0080 msgr2=0x7f36480d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:19.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 -- 172.21.15.67:0/109437665 shutdown_connections 2024-09-19T05:33:19.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 -- 172.21.15.67:0/109437665 wait complete. 2024-09-19T05:33:19.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 Processor -- start 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 -- start start 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36480723c0 0x7f36480af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480b4900 0x7f3648168a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f364815b1e0 0x7f36481f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f364806e670 con 0x7f36480b4900 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f36480b3510 con 0x7f364815b1e0 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364f9a0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f364806e7f0 con 0x7f36480723c0 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364cf3b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480b4900 0x7f3648168a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364cf3b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480b4900 0x7f3648168a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45734/0 (socket says 172.21.15.67:45734) 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364cf3b640 1 -- 172.21.15.67:0/546072922 learned_addr learned my addr 172.21.15.67:0/546072922 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364d73c640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36480723c0 0x7f36480af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364df3d640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f364815b1e0 0x7f36481f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364cf3b640 1 -- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36480723c0 msgr2=0x7f36480af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364cf3b640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36480723c0 0x7f36480af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364cf3b640 1 -- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f364815b1e0 msgr2=0x7f36481f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364cf3b640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f364815b1e0 0x7f36481f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364cf3b640 1 -- 172.21.15.67:0/546072922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36480b1310 con 0x7f36480b4900 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.730+0000 7f364cf3b640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480b4900 0x7f3648168a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f363800e930 tx=0x7f363800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f363dffb640 1 -- 172.21.15.67:0/546072922 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638017070 con 0x7f36480b4900 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f363dffb640 1 -- 172.21.15.67:0/546072922 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363800ca00 con 0x7f36480b4900 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f364f9a0640 1 -- 172.21.15.67:0/546072922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36481691e0 con 0x7f36480b4900 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f363dffb640 1 -- 172.21.15.67:0/546072922 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363800cdd0 con 0x7f36480b4900 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f364f9a0640 1 -- 172.21.15.67:0/546072922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36481697a0 con 0x7f36480b4900 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f364f9a0640 1 -- 172.21.15.67:0/546072922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3648071e80 con 0x7f36480b4900 2024-09-19T05:33:19.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f363dffb640 1 -- 172.21.15.67:0/546072922 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f363801a070 con 0x7f36480b4900 2024-09-19T05:33:19.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f363dffb640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f362c0678c0 0x7f362c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:19.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f363dffb640 1 -- 172.21.15.67:0/546072922 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3638085ec0 con 0x7f36480b4900 2024-09-19T05:33:19.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f364d73c640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f362c0678c0 0x7f362c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:19.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.734+0000 7f364d73c640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f362c0678c0 0x7f362c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36440ae000 tx=0x7f36440a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:19.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.738+0000 7f363dffb640 1 -- 172.21.15.67:0/546072922 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f36380561c0 con 0x7f36480b4900 2024-09-19T05:33:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.942+0000 7f364f9a0640 1 -- 172.21.15.67:0/546072922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36480b4e30 con 0x7f36480b4900 2024-09-19T05:33:19.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.942+0000 7f363dffb640 1 -- 172.21.15.67:0/546072922 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5216 (secure 0 0 0) 0x7f363805a4c0 con 0x7f36480b4900 2024-09-19T05:33:19.947 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:19.947 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":6,"btime":"2024-09-19T05:33:19:569790+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:33:13.876770+0000","modified":"2024-09-19T05:33:18.949301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-19T05:33:19.948 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 6 2024-09-19T05:33:19.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 -- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f362c0678c0 msgr2=0x7f362c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f362c0678c0 0x7f362c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36440ae000 tx=0x7f36440a7000 comp rx=0 tx=0).stop 2024-09-19T05:33:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 -- 172.21.15.67:0/546072922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480b4900 msgr2=0x7f3648168a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480b4900 0x7f3648168a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f363800e930 tx=0x7f363800edf0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 -- 172.21.15.67:0/546072922 shutdown_connections 2024-09-19T05:33:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f364815b1e0 0x7f36481f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480b4900 0x7f3648168a70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f362c0678c0 0x7f362c069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 --2- 172.21.15.67:0/546072922 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36480723c0 0x7f36480af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 -- 172.21.15.67:0/546072922 >> 172.21.15.67:0/546072922 conn(0x7f36480d0080 msgr2=0x7f364814a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 -- 172.21.15.67:0/546072922 shutdown_connections 2024-09-19T05:33:19.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:19.946+0000 7f364f9a0640 1 -- 172.21.15.67:0/546072922 wait complete. 2024-09-19T05:33:19.966 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:20.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5be140640 1 Processor -- start 2024-09-19T05:33:20.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5be140640 1 -- start start 2024-09-19T05:33:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5be140640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5b815e610 0x7fb5b8162a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5be140640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5b80cf070 0x7fb5b815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5be140640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b815ef30 0x7fb5b80d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5be140640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb5b80d0120 con 0x7fb5b815e610 2024-09-19T05:33:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5be140640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb5b8162fb0 con 0x7fb5b80cf070 2024-09-19T05:33:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5be140640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b80cf510 con 0x7fb5b815ef30 2024-09-19T05:33:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5b77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5b815e610 0x7fb5b8162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5b77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5b815e610 0x7fb5b8162a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45750/0 (socket says 172.21.15.67:45750) 2024-09-19T05:33:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5b77fe640 1 -- 172.21.15.67:0/2258525682 learned_addr learned my addr 172.21.15.67:0/2258525682 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5b6ffd640 1 --2- 172.21.15.67:0/2258525682 >> v2:172.21.15.97:3300/0 conn(0x7fb5b80cf070 0x7fb5b815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5b7fff640 1 --2- 172.21.15.67:0/2258525682 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b815ef30 0x7fb5b80d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5b77fe640 1 -- 172.21.15.67:0/2258525682 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b815ef30 msgr2=0x7fb5b80d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:20.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5b77fe640 1 --2- 172.21.15.67:0/2258525682 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b815ef30 0x7fb5b80d0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5b77fe640 1 -- 172.21.15.67:0/2258525682 >> v2:172.21.15.97:3300/0 conn(0x7fb5b80cf070 msgr2=0x7fb5b815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:20.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5b77fe640 1 --2- 172.21.15.67:0/2258525682 >> v2:172.21.15.97:3300/0 conn(0x7fb5b80cf070 0x7fb5b815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.082+0000 7fb5b77fe640 1 -- 172.21.15.67:0/2258525682 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b80cf7f0 con 0x7fb5b815e610 2024-09-19T05:33:20.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b77fe640 1 --2- 172.21.15.67:0/2258525682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b815e610 0x7fb5b8162a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80d0860 tx=0x7fb5a801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cf511d2e712c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:20.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b67fc640 1 -- 172.21.15.67:0/2258525682 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80a5580 con 0x7fb5b815e610 2024-09-19T05:33:20.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b67fc640 1 -- 172.21.15.67:0/2258525682 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a80a5720 con 0x7fb5b815e610 2024-09-19T05:33:20.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b67fc640 1 -- 172.21.15.67:0/2258525682 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80a5af0 con 0x7fb5b815e610 2024-09-19T05:33:20.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 -- 172.21.15.67:0/2258525682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b815e610 msgr2=0x7fb5b8162a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 --2- 172.21.15.67:0/2258525682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b815e610 0x7fb5b8162a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80d0860 tx=0x7fb5a801c700 comp rx=0 tx=0).stop 2024-09-19T05:33:20.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 -- 172.21.15.67:0/2258525682 shutdown_connections 2024-09-19T05:33:20.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 --2- 172.21.15.67:0/2258525682 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b815ef30 0x7fb5b80d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 --2- 172.21.15.67:0/2258525682 >> v2:172.21.15.97:3300/0 conn(0x7fb5b80cf070 0x7fb5b815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 --2- 172.21.15.67:0/2258525682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b815e610 0x7fb5b8162a70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 -- 172.21.15.67:0/2258525682 >> 172.21.15.67:0/2258525682 conn(0x7fb5b808bfc0 msgr2=0x7fb5b80d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:20.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 -- 172.21.15.67:0/2258525682 shutdown_connections 2024-09-19T05:33:20.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 -- 172.21.15.67:0/2258525682 wait complete. 2024-09-19T05:33:20.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 Processor -- start 2024-09-19T05:33:20.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 -- start start 2024-09-19T05:33:20.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80cf070 0x7fb5b8161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b815e610 0x7fb5b81532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b815ef30 0x7fb5b8154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b80d2070 con 0x7fb5b80cf070 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b815f340 con 0x7fb5b815ef30 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5be140640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b80d21f0 con 0x7fb5b815e610 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80cf070 0x7fb5b8161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80cf070 0x7fb5b8161130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45754/0 (socket says 172.21.15.67:45754) 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b77fe640 1 -- 172.21.15.67:0/166030424 learned_addr learned my addr 172.21.15.67:0/166030424 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b7fff640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b815ef30 0x7fb5b8154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b6ffd640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b815e610 0x7fb5b81532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b77fe640 1 -- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b815e610 msgr2=0x7fb5b81532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b77fe640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b815e610 0x7fb5b81532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b77fe640 1 -- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b815ef30 msgr2=0x7fb5b8154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b77fe640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b815ef30 0x7fb5b8154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b77fe640 1 -- 172.21.15.67:0/166030424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b8161980 con 0x7fb5b80cf070 2024-09-19T05:33:20.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.086+0000 7fb5b7fff640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b815ef30 0x7fb5b8154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:20.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb5b77fe640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80cf070 0x7fb5b8161130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80af040 tx=0x7fb5a80194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:20.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb59ffff640 1 -- 172.21.15.67:0/166030424 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8009510 con 0x7fb5b80cf070 2024-09-19T05:33:20.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb59ffff640 1 -- 172.21.15.67:0/166030424 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a80be070 con 0x7fb5b80cf070 2024-09-19T05:33:20.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb5be140640 1 -- 172.21.15.67:0/166030424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b8153c80 con 0x7fb5b80cf070 2024-09-19T05:33:20.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb59ffff640 1 -- 172.21.15.67:0/166030424 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80b88b0 con 0x7fb5b80cf070 2024-09-19T05:33:20.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb5be140640 1 -- 172.21.15.67:0/166030424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b8154240 con 0x7fb5b80cf070 2024-09-19T05:33:20.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb5be140640 1 -- 172.21.15.67:0/166030424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b8162a70 con 0x7fb5b80cf070 2024-09-19T05:33:20.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb59ffff640 1 -- 172.21.15.67:0/166030424 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5a80b8a50 con 0x7fb5b80cf070 2024-09-19T05:33:20.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb59ffff640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5a40678c0 0x7fb5a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb59ffff640 1 -- 172.21.15.67:0/166030424 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb5a8121010 con 0x7fb5b80cf070 2024-09-19T05:33:20.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb5b6ffd640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5a40678c0 0x7fb5a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.090+0000 7fb5b6ffd640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5a40678c0 0x7fb5a4069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80ce6e0 tx=0x7fb5ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:20.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.094+0000 7fb59ffff640 1 -- 172.21.15.67:0/166030424 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb5a80165e0 con 0x7fb5b80cf070 2024-09-19T05:33:20.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.258+0000 7fb5be140640 1 -- 172.21.15.67:0/166030424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5b80cec70 con 0x7fb5b80cf070 2024-09-19T05:33:20.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb59ffff640 1 -- 172.21.15.67:0/166030424 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7fb5a80f1810 con 0x7fb5b80cf070 2024-09-19T05:33:20.264 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:20.264 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:20.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 -- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5a40678c0 msgr2=0x7fb5a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5a40678c0 0x7fb5a4069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80ce6e0 tx=0x7fb5ac008040 comp rx=0 tx=0).stop 2024-09-19T05:33:20.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 -- 172.21.15.67:0/166030424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80cf070 msgr2=0x7fb5b8161130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80cf070 0x7fb5b8161130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80af040 tx=0x7fb5a80194a0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 -- 172.21.15.67:0/166030424 shutdown_connections 2024-09-19T05:33:20.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b815ef30 0x7fb5b8154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5a40678c0 0x7fb5a4069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b815e610 0x7fb5b81532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 --2- 172.21.15.67:0/166030424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80cf070 0x7fb5b8161130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 -- 172.21.15.67:0/166030424 >> 172.21.15.67:0/166030424 conn(0x7fb5b808bfc0 msgr2=0x7fb5b80b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:20.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 -- 172.21.15.67:0/166030424 shutdown_connections 2024-09-19T05:33:20.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.262+0000 7fb5be140640 1 -- 172.21.15.67:0/166030424 wait complete. 2024-09-19T05:33:20.283 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:20.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830fe92640 1 Processor -- start 2024-09-19T05:33:20.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830fe92640 1 -- start start 2024-09-19T05:33:20.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830fe92640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830815c030 0x7f830806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830fe92640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f830815d1d0 0x7f83080b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830fe92640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f830806e3c0 con 0x7f83080b3510 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830fe92640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f830806e6a0 con 0x7f830815d1d0 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830fe92640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f830806e980 con 0x7f830815c030 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830e42f640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f83080b3510 0x7f830806f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48720/0 (socket says 172.21.15.67:48720) 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830d42d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f830815d1d0 0x7f83080b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830e42f640 1 -- 172.21.15.67:0/2741433305 learned_addr learned my addr 172.21.15.67:0/2741433305 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830dc2e640 1 --2- 172.21.15.67:0/2741433305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830815c030 0x7f830806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830d42d640 1 -- 172.21.15.67:0/2741433305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830815c030 msgr2=0x7f830806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830d42d640 1 --2- 172.21.15.67:0/2741433305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830815c030 0x7f830806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830d42d640 1 -- 172.21.15.67:0/2741433305 >> v1:172.21.15.67:6789/0 conn(0x7f83080b3510 legacy=0x7f830806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830cc2c640 1 -- 172.21.15.67:0/2741433305 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831616643 0 0) 0x7f830806e3c0 con 0x7f83080b3510 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830d42d640 1 -- 172.21.15.67:0/2741433305 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830806ec60 con 0x7f830815d1d0 2024-09-19T05:33:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830dc2e640 1 --2- 172.21.15.67:0/2741433305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830815c030 0x7f830806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.402+0000 7f830d42d640 1 --2- 172.21.15.67:0/2741433305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f830815d1d0 0x7f83080b2fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f82f80097c0 tx=0x7f82f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e2ed97312f4a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830cc2c640 1 -- 172.21.15.67:0/2741433305 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80aa5f0 con 0x7f830815d1d0 2024-09-19T05:33:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830cc2c640 1 -- 172.21.15.67:0/2741433305 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f80af070 con 0x7f830815d1d0 2024-09-19T05:33:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830cc2c640 1 -- 172.21.15.67:0/2741433305 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80aa9b0 con 0x7f830815d1d0 2024-09-19T05:33:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- 172.21.15.67:0/2741433305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f830815d1d0 msgr2=0x7f83080b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 --2- 172.21.15.67:0/2741433305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f830815d1d0 0x7f83080b2fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f82f80097c0 tx=0x7f82f801c470 comp rx=0 tx=0).stop 2024-09-19T05:33:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- 172.21.15.67:0/2741433305 shutdown_connections 2024-09-19T05:33:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 --2- 172.21.15.67:0/2741433305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f830815d1d0 0x7f83080b2fd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 --2- 172.21.15.67:0/2741433305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830815c030 0x7f830806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- 172.21.15.67:0/2741433305 >> 172.21.15.67:0/2741433305 conn(0x7f83080d0080 msgr2=0x7f83080d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- 172.21.15.67:0/2741433305 shutdown_connections 2024-09-19T05:33:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- 172.21.15.67:0/2741433305 wait complete. 2024-09-19T05:33:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 Processor -- start 2024-09-19T05:33:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- start start 2024-09-19T05:33:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83080b3510 0x7f83081495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830815c030 0x7f83080b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830815d1d0 0x7f83080b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f830815c590 con 0x7f83080b3510 2024-09-19T05:33:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f830815c410 con 0x7f830815c030 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f83081690e0 con 0x7f830815d1d0 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830dc2e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83080b3510 0x7f83081495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830dc2e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83080b3510 0x7f83081495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45760/0 (socket says 172.21.15.67:45760) 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830dc2e640 1 -- 172.21.15.67:0/3079285029 learned_addr learned my addr 172.21.15.67:0/3079285029 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830dc2e640 1 -- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830815d1d0 msgr2=0x7f83080b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830dc2e640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830815d1d0 0x7f83080b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830dc2e640 1 -- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830815c030 msgr2=0x7f83080b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830dc2e640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830815c030 0x7f83080b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830dc2e640 1 -- 172.21.15.67:0/3079285029 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830814fe10 con 0x7f83080b3510 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830dc2e640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83080b3510 0x7f83081495a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f830000cf90 tx=0x7f830000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f82fe7fc640 1 -- 172.21.15.67:0/3079285029 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830001a070 con 0x7f83080b3510 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f82fe7fc640 1 -- 172.21.15.67:0/3079285029 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830000d840 con 0x7f83080b3510 2024-09-19T05:33:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- 172.21.15.67:0/3079285029 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83081500f0 con 0x7f83080b3510 2024-09-19T05:33:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f82fe7fc640 1 -- 172.21.15.67:0/3079285029 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830000dc10 con 0x7f83080b3510 2024-09-19T05:33:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.406+0000 7f830fe92640 1 -- 172.21.15.67:0/3079285029 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83081506b0 con 0x7f83080b3510 2024-09-19T05:33:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.410+0000 7f830fe92640 1 -- 172.21.15.67:0/3079285029 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f830806dde0 con 0x7f83080b3510 2024-09-19T05:33:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.410+0000 7f82fe7fc640 1 -- 172.21.15.67:0/3079285029 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f830001d070 con 0x7f83080b3510 2024-09-19T05:33:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.410+0000 7f82fe7fc640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82ec0678c0 0x7f82ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.410+0000 7f82fe7fc640 1 -- 172.21.15.67:0/3079285029 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8300086810 con 0x7f83080b3510 2024-09-19T05:33:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.410+0000 7f830d42d640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82ec0678c0 0x7f82ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.410+0000 7f830d42d640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82ec0678c0 0x7f82ec069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82f80ae000 tx=0x7f82f8004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:20.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.422+0000 7f82fe7fc640 1 -- 172.21.15.67:0/3079285029 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f83000569c0 con 0x7f83080b3510 2024-09-19T05:33:20.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.582+0000 7f830fe92640 1 -- 172.21.15.67:0/3079285029 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f830815f400 con 0x7f83080b3510 2024-09-19T05:33:20.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.586+0000 7f82fe7fc640 1 -- 172.21.15.67:0/3079285029 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f8300084e20 con 0x7f83080b3510 2024-09-19T05:33:20.591 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:20.591 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:20.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 -- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82ec0678c0 msgr2=0x7f82ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82ec0678c0 0x7f82ec069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82f80ae000 tx=0x7f82f8004740 comp rx=0 tx=0).stop 2024-09-19T05:33:20.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 -- 172.21.15.67:0/3079285029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83080b3510 msgr2=0x7f83081495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83080b3510 0x7f83081495a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f830000cf90 tx=0x7f830000a7d0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 -- 172.21.15.67:0/3079285029 shutdown_connections 2024-09-19T05:33:20.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82ec0678c0 0x7f82ec069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830815d1d0 0x7f83080b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830815c030 0x7f83080b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 --2- 172.21.15.67:0/3079285029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83080b3510 0x7f83081495a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 -- 172.21.15.67:0/3079285029 >> 172.21.15.67:0/3079285029 conn(0x7f83080d0080 msgr2=0x7f83080745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:20.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 -- 172.21.15.67:0/3079285029 shutdown_connections 2024-09-19T05:33:20.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.590+0000 7f830fe92640 1 -- 172.21.15.67:0/3079285029 wait complete. 2024-09-19T05:33:20.626 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:20.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00d5475640 1 Processor -- start 2024-09-19T05:33:20.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00d5475640 1 -- start start 2024-09-19T05:33:20.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00d5475640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f00d00b1990 0x7f00d00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00d5475640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00d00b27e0 0x7f00d006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00d5475640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d006c610 con 0x7f00d006c200 2024-09-19T05:33:20.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00d5475640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f00d015f950 con 0x7f00d00b27e0 2024-09-19T05:33:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00d5475640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f00d00b2d60 con 0x7f00d00b1990 2024-09-19T05:33:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00ce7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00d00b27e0 0x7f00d006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00ce7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00d00b27e0 0x7f00d006bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45772/0 (socket says 172.21.15.67:45772) 2024-09-19T05:33:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00ce7fc640 1 -- 172.21.15.67:0/2804262037 learned_addr learned my addr 172.21.15.67:0/2804262037 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00ceffd640 1 --2- 172.21.15.67:0/2804262037 >> v2:172.21.15.97:3300/0 conn(0x7f00d00b1990 0x7f00d00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00ce7fc640 1 -- 172.21.15.67:0/2804262037 >> v2:172.21.15.97:3300/0 conn(0x7f00d00b1990 msgr2=0x7f00d00b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00ce7fc640 1 --2- 172.21.15.67:0/2804262037 >> v2:172.21.15.97:3300/0 conn(0x7f00d00b1990 0x7f00d00b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00ce7fc640 1 -- 172.21.15.67:0/2804262037 >> v1:172.21.15.67:6789/0 conn(0x7f00d006c200 legacy=0x7f00d0161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00ce7fc640 1 -- 172.21.15.67:0/2804262037 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d00b1d70 con 0x7f00d00b27e0 2024-09-19T05:33:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.746+0000 7f00cdffb640 1 -- 172.21.15.67:0/2804262037 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851965166 0 0) 0x7f00c80014a0 con 0x7f00d006c200 2024-09-19T05:33:20.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00ce7fc640 1 --2- 172.21.15.67:0/2804262037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d00b27e0 0x7f00d006bcc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00d00d22d0 tx=0x7f00b801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cab4be5515bb615 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:20.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00cdffb640 1 -- 172.21.15.67:0/2804262037 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b80ab610 con 0x7f00d00b27e0 2024-09-19T05:33:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00cdffb640 1 -- 172.21.15.67:0/2804262037 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b80b0070 con 0x7f00d00b27e0 2024-09-19T05:33:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00cdffb640 1 -- 172.21.15.67:0/2804262037 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b80ab9d0 con 0x7f00d00b27e0 2024-09-19T05:33:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 -- 172.21.15.67:0/2804262037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d00b27e0 msgr2=0x7f00d006bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 --2- 172.21.15.67:0/2804262037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d00b27e0 0x7f00d006bcc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00d00d22d0 tx=0x7f00b801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 -- 172.21.15.67:0/2804262037 shutdown_connections 2024-09-19T05:33:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 --2- 172.21.15.67:0/2804262037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d00b27e0 0x7f00d006bcc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 --2- 172.21.15.67:0/2804262037 >> v2:172.21.15.97:3300/0 conn(0x7f00d00b1990 0x7f00d00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 -- 172.21.15.67:0/2804262037 >> 172.21.15.67:0/2804262037 conn(0x7f00d009aa30 msgr2=0x7f00d00b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 -- 172.21.15.67:0/2804262037 shutdown_connections 2024-09-19T05:33:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 -- 172.21.15.67:0/2804262037 wait complete. 2024-09-19T05:33:20.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 Processor -- start 2024-09-19T05:33:20.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 -- start start 2024-09-19T05:33:20.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d006c200 0x7f00d0161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00d00b1990 0x7f00d009d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00d00b27e0 0x7f00d0160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f00d00b4470 con 0x7f00d006c200 2024-09-19T05:33:20.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f00d015f430 con 0x7f00d00b27e0 2024-09-19T05:33:20.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00d5475640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f00d0160b10 con 0x7f00d00b1990 2024-09-19T05:33:20.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.750+0000 7f00ceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d006c200 0x7f00d0161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00ceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d006c200 0x7f00d0161dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45774/0 (socket says 172.21.15.67:45774) 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00ceffd640 1 -- 172.21.15.67:0/3024109410 learned_addr learned my addr 172.21.15.67:0/3024109410 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00ceffd640 1 -- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00d00b1990 msgr2=0x7f00d009d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00ceffd640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00d00b1990 0x7f00d009d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00cf7fe640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00d00b27e0 0x7f00d0160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00ceffd640 1 -- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00d00b27e0 msgr2=0x7f00d0160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00ceffd640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00d00b27e0 0x7f00d0160e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00ceffd640 1 -- 172.21.15.67:0/3024109410 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d0152960 con 0x7f00d006c200 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00ceffd640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d006c200 0x7f00d0161dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00c000e9e0 tx=0x7f00c000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00c77fe640 1 -- 172.21.15.67:0/3024109410 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0017070 con 0x7f00d006c200 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00c77fe640 1 -- 172.21.15.67:0/3024109410 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c000c9d0 con 0x7f00d006c200 2024-09-19T05:33:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00c77fe640 1 -- 172.21.15.67:0/3024109410 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c000cda0 con 0x7f00d006c200 2024-09-19T05:33:20.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00d5475640 1 -- 172.21.15.67:0/3024109410 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d0152c40 con 0x7f00d006c200 2024-09-19T05:33:20.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00d5475640 1 -- 172.21.15.67:0/3024109410 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d009b7f0 con 0x7f00d006c200 2024-09-19T05:33:20.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00d5475640 1 -- 172.21.15.67:0/3024109410 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d00b22a0 con 0x7f00d006c200 2024-09-19T05:33:20.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00c77fe640 1 -- 172.21.15.67:0/3024109410 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00c001a070 con 0x7f00d006c200 2024-09-19T05:33:20.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00c77fe640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00b00678c0 0x7f00b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:20.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00c77fe640 1 -- 172.21.15.67:0/3024109410 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f00c0086350 con 0x7f00d006c200 2024-09-19T05:33:20.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.754+0000 7f00ce7fc640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00b00678c0 0x7f00b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:20.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.758+0000 7f00ce7fc640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00b00678c0 0x7f00b0069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f00b80af000 tx=0x7f00b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:20.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.758+0000 7f00c77fe640 1 -- 172.21.15.67:0/3024109410 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f00c0056be0 con 0x7f00d006c200 2024-09-19T05:33:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.958+0000 7f00d5475640 1 -- 172.21.15.67:0/3024109410 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00d006f490 con 0x7f00d006c200 2024-09-19T05:33:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.958+0000 7f00c77fe640 1 -- 172.21.15.67:0/3024109410 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5216 (secure 0 0 0) 0x7f00c00564e0 con 0x7f00d006c200 2024-09-19T05:33:20.963 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:20.963 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":6,"btime":"2024-09-19T05:33:19:569790+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:33:13.876770+0000","modified":"2024-09-19T05:33:18.949301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-19T05:33:20.964 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 6 2024-09-19T05:33:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 -- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00b00678c0 msgr2=0x7f00b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00b00678c0 0x7f00b0069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f00b80af000 tx=0x7f00b8008040 comp rx=0 tx=0).stop 2024-09-19T05:33:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 -- 172.21.15.67:0/3024109410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d006c200 msgr2=0x7f00d0161dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d006c200 0x7f00d0161dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00c000e9e0 tx=0x7f00c000eea0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 -- 172.21.15.67:0/3024109410 shutdown_connections 2024-09-19T05:33:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00d00b27e0 0x7f00d0160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00b00678c0 0x7f00b0069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00d00b1990 0x7f00d009d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 --2- 172.21.15.67:0/3024109410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00d006c200 0x7f00d0161dd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:20.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 -- 172.21.15.67:0/3024109410 >> 172.21.15.67:0/3024109410 conn(0x7f00d009aa30 msgr2=0x7f00d00b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:20.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 -- 172.21.15.67:0/3024109410 shutdown_connections 2024-09-19T05:33:20.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:20.962+0000 7f00d5475640 1 -- 172.21.15.67:0/3024109410 wait complete. 2024-09-19T05:33:20.984 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:21.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2917cea640 1 Processor -- start 2024-09-19T05:33:21.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2917cea640 1 -- start start 2024-09-19T05:33:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2917cea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f291015a920 0x7f2910072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2917cea640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f291006ed80 0x7f29100ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2917cea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29100730e0 con 0x7f29100af730 2024-09-19T05:33:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2917cea640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f29100733c0 con 0x7f291006ed80 2024-09-19T05:33:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2917cea640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f29100ad8c0 con 0x7f291015a920 2024-09-19T05:33:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2916287640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f291006ed80 0x7f29100ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2916287640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f291006ed80 0x7f29100ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45776/0 (socket says 172.21.15.67:45776) 2024-09-19T05:33:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2916287640 1 -- 172.21.15.67:0/1567292966 learned_addr learned my addr 172.21.15.67:0/1567292966 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2915a86640 1 --2- 172.21.15.67:0/1567292966 >> v2:172.21.15.97:3300/0 conn(0x7f291015a920 0x7f2910072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2916287640 1 -- 172.21.15.67:0/1567292966 >> v2:172.21.15.97:3300/0 conn(0x7f291015a920 msgr2=0x7f2910072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2916287640 1 --2- 172.21.15.67:0/1567292966 >> v2:172.21.15.97:3300/0 conn(0x7f291015a920 0x7f2910072840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2916287640 1 -- 172.21.15.67:0/1567292966 >> v1:172.21.15.97:6789/0 conn(0x7f29100af730 legacy=0x7f291006e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.098+0000 7f2916287640 1 -- 172.21.15.67:0/1567292966 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29100adba0 con 0x7f291006ed80 2024-09-19T05:33:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2916287640 1 --2- 172.21.15.67:0/1567292966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f291006ed80 0x7f29100ae0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2910071680 tx=0x7f290801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665f8dfe7d49f852 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2914a84640 1 -- 172.21.15.67:0/1567292966 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080a5640 con 0x7f291006ed80 2024-09-19T05:33:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2914a84640 1 -- 172.21.15.67:0/1567292966 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29080a57e0 con 0x7f291006ed80 2024-09-19T05:33:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2914a84640 1 -- 172.21.15.67:0/1567292966 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080a5bb0 con 0x7f291006ed80 2024-09-19T05:33:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2917cea640 1 -- 172.21.15.67:0/1567292966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f291006ed80 msgr2=0x7f29100ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2917cea640 1 --2- 172.21.15.67:0/1567292966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f291006ed80 0x7f29100ae0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2910071680 tx=0x7f290801c9f0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2917cea640 1 -- 172.21.15.67:0/1567292966 shutdown_connections 2024-09-19T05:33:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2917cea640 1 --2- 172.21.15.67:0/1567292966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f291006ed80 0x7f29100ae0c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2917cea640 1 --2- 172.21.15.67:0/1567292966 >> v2:172.21.15.97:3300/0 conn(0x7f291015a920 0x7f2910072840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2917cea640 1 -- 172.21.15.67:0/1567292966 >> 172.21.15.67:0/1567292966 conn(0x7f29100d0080 msgr2=0x7f29100d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:21.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2917cea640 1 -- 172.21.15.67:0/1567292966 shutdown_connections 2024-09-19T05:33:21.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2917cea640 1 -- 172.21.15.67:0/1567292966 wait complete. 2024-09-19T05:33:21.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2917cea640 1 Processor -- start 2024-09-19T05:33:21.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.102+0000 7f2917cea640 1 -- start start 2024-09-19T05:33:21.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2917cea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f291006ed80 0x7f291014d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2917cea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29100af730 0x7f291014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2917cea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f291015a920 0x7f29100b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2917cea640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f29100ae780 con 0x7f29100af730 2024-09-19T05:33:21.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2917cea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f29100ae600 con 0x7f291006ed80 2024-09-19T05:33:21.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2917cea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f29100ae900 con 0x7f291015a920 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915285640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29100af730 0x7f291014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915285640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29100af730 0x7f291014cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45792/0 (socket says 172.21.15.67:45792) 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915285640 1 -- 172.21.15.67:0/2390241978 learned_addr learned my addr 172.21.15.67:0/2390241978 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915a86640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f291006ed80 0x7f291014d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2916287640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f291015a920 0x7f29100b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915285640 1 -- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f291015a920 msgr2=0x7f29100b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915285640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f291015a920 0x7f29100b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915285640 1 -- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f291006ed80 msgr2=0x7f291014d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915285640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f291006ed80 0x7f291014d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915285640 1 -- 172.21.15.67:0/2390241978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2910165450 con 0x7f29100af730 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915285640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29100af730 0x7f291014cbb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f290000c420 tx=0x7f290000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f29067fc640 1 -- 172.21.15.67:0/2390241978 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29000052d0 con 0x7f29100af730 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f29067fc640 1 -- 172.21.15.67:0/2390241978 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900005470 con 0x7f29100af730 2024-09-19T05:33:21.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2917cea640 1 -- 172.21.15.67:0/2390241978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291014f0d0 con 0x7f29100af730 2024-09-19T05:33:21.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f29067fc640 1 -- 172.21.15.67:0/2390241978 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900007260 con 0x7f29100af730 2024-09-19T05:33:21.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2917cea640 1 -- 172.21.15.67:0/2390241978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291014f690 con 0x7f29100af730 2024-09-19T05:33:21.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2917cea640 1 -- 172.21.15.67:0/2390241978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f291014eef0 con 0x7f29100af730 2024-09-19T05:33:21.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f29067fc640 1 -- 172.21.15.67:0/2390241978 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2900007400 con 0x7f29100af730 2024-09-19T05:33:21.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f29067fc640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f40678c0 0x7f28f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f29067fc640 1 -- 172.21.15.67:0/2390241978 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f29000854c0 con 0x7f29100af730 2024-09-19T05:33:21.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.106+0000 7f2915a86640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f40678c0 0x7f28f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.110+0000 7f2915a86640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f40678c0 0x7f28f4069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29100cf2c0 tx=0x7f290c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:21.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.110+0000 7f29067fc640 1 -- 172.21.15.67:0/2390241978 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f291014eef0 con 0x7f29100af730 2024-09-19T05:33:21.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.274+0000 7f2917cea640 1 -- 172.21.15.67:0/2390241978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29100ae0c0 con 0x7f29100af730 2024-09-19T05:33:21.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.278+0000 7f29067fc640 1 -- 172.21.15.67:0/2390241978 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f2900055d50 con 0x7f29100af730 2024-09-19T05:33:21.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:21.282 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:21.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 -- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f40678c0 msgr2=0x7f28f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f40678c0 0x7f28f4069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29100cf2c0 tx=0x7f290c008040 comp rx=0 tx=0).stop 2024-09-19T05:33:21.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 -- 172.21.15.67:0/2390241978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29100af730 msgr2=0x7f291014cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29100af730 0x7f291014cbb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f290000c420 tx=0x7f290000c8e0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 -- 172.21.15.67:0/2390241978 shutdown_connections 2024-09-19T05:33:21.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f40678c0 0x7f28f4069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f291015a920 0x7f29100b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29100af730 0x7f291014cbb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 --2- 172.21.15.67:0/2390241978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f291006ed80 0x7f291014d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 -- 172.21.15.67:0/2390241978 >> 172.21.15.67:0/2390241978 conn(0x7f29100d0080 msgr2=0x7f29100b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:21.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 -- 172.21.15.67:0/2390241978 shutdown_connections 2024-09-19T05:33:21.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.282+0000 7f2917cea640 1 -- 172.21.15.67:0/2390241978 wait complete. 2024-09-19T05:33:21.703 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:33:13.876770+0000', 'modified': '2024-09-19T05:33:18.949301+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/3064059806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 3064059806}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 3064059806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4288, 'qdb_cluster': [4288]} 2024-09-19T05:33:21.703 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:33:21.704 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T05:33:21.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f762a567640 1 Processor -- start 2024-09-19T05:33:21.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f762a567640 1 -- start start 2024-09-19T05:33:21.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f762a567640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762415a920 0x7f7624072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f762a567640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f762406ed80 0x7f76240ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f762a567640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76240730e0 con 0x7f76240af730 2024-09-19T05:33:21.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f762a567640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f76240733c0 con 0x7f762406ed80 2024-09-19T05:33:21.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f762a567640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f76240ad8c0 con 0x7f762415a920 2024-09-19T05:33:21.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f7628b04640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f762406ed80 0x7f76240ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f7628b04640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f762406ed80 0x7f76240ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45802/0 (socket says 172.21.15.67:45802) 2024-09-19T05:33:21.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f7628b04640 1 -- 172.21.15.67:0/225734022 learned_addr learned my addr 172.21.15.67:0/225734022 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:21.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f7623fff640 1 --2- 172.21.15.67:0/225734022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762415a920 0x7f7624072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f7628b04640 1 -- 172.21.15.67:0/225734022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762415a920 msgr2=0x7f7624072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:21.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f7628b04640 1 --2- 172.21.15.67:0/225734022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762415a920 0x7f7624072840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.838+0000 7f7628b04640 1 -- 172.21.15.67:0/225734022 >> v1:172.21.15.97:6789/0 conn(0x7f76240af730 legacy=0x7f762406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f7628b04640 1 -- 172.21.15.67:0/225734022 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76240adba0 con 0x7f762406ed80 2024-09-19T05:33:21.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f7628b04640 1 --2- 172.21.15.67:0/225734022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762406ed80 0x7f76240ae0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f761c009e50 tx=0x7f761c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb1be8433e202a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:21.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f7622ffd640 1 -- 172.21.15.67:0/225734022 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c0a5790 con 0x7f762406ed80 2024-09-19T05:33:21.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f7622ffd640 1 -- 172.21.15.67:0/225734022 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c0a5930 con 0x7f762406ed80 2024-09-19T05:33:21.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f7622ffd640 1 -- 172.21.15.67:0/225734022 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c0a5d00 con 0x7f762406ed80 2024-09-19T05:33:21.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f762a567640 1 -- 172.21.15.67:0/225734022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762406ed80 msgr2=0x7f76240ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f762a567640 1 --2- 172.21.15.67:0/225734022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762406ed80 0x7f76240ae0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f761c009e50 tx=0x7f761c01ca30 comp rx=0 tx=0).stop 2024-09-19T05:33:21.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f762a567640 1 -- 172.21.15.67:0/225734022 shutdown_connections 2024-09-19T05:33:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f762a567640 1 --2- 172.21.15.67:0/225734022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762406ed80 0x7f76240ae0c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f762a567640 1 --2- 172.21.15.67:0/225734022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762415a920 0x7f7624072840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f762a567640 1 -- 172.21.15.67:0/225734022 >> 172.21.15.67:0/225734022 conn(0x7f76240d0080 msgr2=0x7f76240d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f762a567640 1 -- 172.21.15.67:0/225734022 shutdown_connections 2024-09-19T05:33:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.842+0000 7f762a567640 1 -- 172.21.15.67:0/225734022 wait complete. 2024-09-19T05:33:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f762a567640 1 Processor -- start 2024-09-19T05:33:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f762a567640 1 -- start start 2024-09-19T05:33:21.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f762a567640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f762406ed80 0x7f7624099160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f762a567640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76240af730 0x7f7624156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f762a567640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762415a920 0x7f762414b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f762a567640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f76240ae780 con 0x7f76240af730 2024-09-19T05:33:21.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f762a567640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f76240ae600 con 0x7f762406ed80 2024-09-19T05:33:21.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f762a567640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f76240ae900 con 0x7f762415a920 2024-09-19T05:33:21.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f76237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76240af730 0x7f7624156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f76237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76240af730 0x7f7624156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45810/0 (socket says 172.21.15.67:45810) 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f76237fe640 1 -- 172.21.15.67:0/2484369626 learned_addr learned my addr 172.21.15.67:0/2484369626 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f7623fff640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f762406ed80 0x7f7624099160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f7628b04640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762415a920 0x7f762414b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f76237fe640 1 -- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762415a920 msgr2=0x7f762414b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f76237fe640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762415a920 0x7f762414b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f76237fe640 1 -- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f762406ed80 msgr2=0x7f7624099160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f76237fe640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f762406ed80 0x7f7624099160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f76237fe640 1 -- 172.21.15.67:0/2484369626 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76240cccc0 con 0x7f76240af730 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f76237fe640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76240af730 0x7f7624156320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f761400c420 tx=0x7f761400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f7620ff9640 1 -- 172.21.15.67:0/2484369626 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76140052d0 con 0x7f76240af730 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f7620ff9640 1 -- 172.21.15.67:0/2484369626 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7614005470 con 0x7f76240af730 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f762a567640 1 -- 172.21.15.67:0/2484369626 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76240ccfa0 con 0x7f76240af730 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f7620ff9640 1 -- 172.21.15.67:0/2484369626 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614007260 con 0x7f76240af730 2024-09-19T05:33:21.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f762a567640 1 -- 172.21.15.67:0/2484369626 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76240cd560 con 0x7f76240af730 2024-09-19T05:33:21.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.846+0000 7f7620ff9640 1 -- 172.21.15.67:0/2484369626 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7614007400 con 0x7f76240af730 2024-09-19T05:33:21.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f7620ff9640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678c0 0x7f7610069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f7620ff9640 1 -- 172.21.15.67:0/2484369626 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7614085510 con 0x7f76240af730 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f7623fff640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678c0 0x7f7610069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 Processor -- start 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 -- start start 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f7623fff640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678c0 0x7f7610069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f761800ab50 tx=0x7f7618008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be2b20 0x557141be2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be3440 0x557141b98d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b99290 0x557141b99670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557141a80b60 con 0x557141be3440 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5571419e7c70 con 0x557141be2b20 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55714198ded0 con 0x557141b99290 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f76237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be3440 0x557141b98d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f76237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be3440 0x557141b98d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45824/0 (socket says 172.21.15.67:45824) 2024-09-19T05:33:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f76237fe640 1 -- 172.21.15.67:0/182441683 learned_addr learned my addr 172.21.15.67:0/182441683 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f7623fff640 1 --2- 172.21.15.67:0/182441683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be2b20 0x557141be2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f7628b04640 1 --2- 172.21.15.67:0/182441683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b99290 0x557141b99670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f76237fe640 1 -- 172.21.15.67:0/182441683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b99290 msgr2=0x557141b99670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f76237fe640 1 --2- 172.21.15.67:0/182441683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b99290 0x557141b99670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f76237fe640 1 -- 172.21.15.67:0/182441683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be2b20 msgr2=0x557141be2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f76237fe640 1 --2- 172.21.15.67:0/182441683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be2b20 0x557141be2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f76237fe640 1 -- 172.21.15.67:0/182441683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55714199fe50 con 0x557141be3440 2024-09-19T05:33:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f7628b04640 1 --2- 172.21.15.67:0/182441683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b99290 0x557141b99670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f76237fe640 1 --2- 172.21.15.67:0/182441683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be3440 0x557141b98d50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76140836a0 tx=0x7f761400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da9b0ba887d378c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f7609ffb640 1 -- 172.21.15.67:0/182441683 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761405e1f0 con 0x557141be3440 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f7609ffb640 1 -- 172.21.15.67:0/182441683 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7614053910 con 0x557141be3440 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f7609ffb640 1 -- 172.21.15.67:0/182441683 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76140850c0 con 0x557141be3440 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 -- 172.21.15.67:0/182441683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be3440 msgr2=0x557141b98d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 --2- 172.21.15.67:0/182441683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be3440 0x557141b98d50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76140836a0 tx=0x7f761400cf90 comp rx=0 tx=0).stop 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 -- 172.21.15.67:0/182441683 shutdown_connections 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 --2- 172.21.15.67:0/182441683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b99290 0x557141b99670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 --2- 172.21.15.67:0/182441683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be3440 0x557141b98d50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 --2- 172.21.15.67:0/182441683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be2b20 0x557141be2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 -- 172.21.15.67:0/182441683 >> 172.21.15.67:0/182441683 conn(0x557141b9f600 msgr2=0x557141b97630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 -- 172.21.15.67:0/182441683 shutdown_connections 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 -- 172.21.15.67:0/182441683 wait complete. 2024-09-19T05:33:21.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.850+0000 7f762d623000 1 -- start start 2024-09-19T05:33:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 Processor -- start 2024-09-19T05:33:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141b9de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be3440 0x557141ba3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b9e390 0x557141ba4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557141a49b00 con 0x557141be2b20 2024-09-19T05:33:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5571419c2360 con 0x557141be3440 2024-09-19T05:33:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5571419bf2d0 con 0x557141b9e390 2024-09-19T05:33:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 10 client.0 _ll_register_callbacks cb 0x557141b84820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:33:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7623fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141b9de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7623fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141b9de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45826/0 (socket says 172.21.15.67:45826) 2024-09-19T05:33:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7623fff640 1 -- 172.21.15.67:0/282151840 learned_addr learned my addr 172.21.15.67:0/282151840 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f76237fe640 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be3440 0x557141ba3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7628b04640 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b9e390 0x557141ba4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7623fff640 1 -- 172.21.15.67:0/282151840 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b9e390 msgr2=0x557141ba4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7623fff640 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b9e390 0x557141ba4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7623fff640 1 -- 172.21.15.67:0/282151840 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be3440 msgr2=0x557141ba3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7623fff640 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be3440 0x557141ba3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7623fff640 1 -- 172.21.15.67:0/282151840 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55714198e120 con 0x557141be2b20 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7623fff640 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141b9de50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f76180137f0 tx=0x7f76180046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa248442fe66097 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7602ffd640 1 -- 172.21.15.67:0/282151840 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618025070 con 0x557141be2b20 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- 172.21.15.67:0/282151840 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7614053910 con 0x557141be2b20 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7602ffd640 1 -- 172.21.15.67:0/282151840 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7618012b50 con 0x557141be2b20 2024-09-19T05:33:21.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7602ffd640 1 -- 172.21.15.67:0/282151840 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f7618030050 con 0x557141be2b20 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 10 client.4380 fetch_fsmap learned FSMap version 6 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- 172.21.15.67:0/282151840 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x557141987450 con 0x557141be2b20 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7602ffd640 1 -- 172.21.15.67:0/282151840 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7614053910 con 0x557141be2b20 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7602ffd640 1 -- 172.21.15.67:0/282151840 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f7618033020 con 0x557141be2b20 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 10 client.4380 fetch_fsmap finished waiting for FSMap version 6 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 10 client.4380 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 20 client.4380 populate_metadata read hostname 'smithi067' 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x557141bf1280 0x557141bf3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 4 client.4380 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- 172.21.15.67:0/282151840 --> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557141981c00 con 0x557141bf1280 2024-09-19T05:33:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f76237fe640 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x557141bf1280 0x557141bf3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f76237fe640 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x557141bf1280 0x557141bf3670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c01e13ba6ccd3751 server_cookie=5f1b55f7fae629d7 in_seq=0 out_seq=0 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7602ffd640 10 client.4380 ms_handle_connect on v2:172.21.15.67:6834/3064059806 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7602ffd640 1 -- 172.21.15.67:0/282151840 <== mds.0 v2:172.21.15.67:6834/3064059806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557141981c00 con 0x557141bf1280 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7602ffd640 10 client.4380 handle_command_reply: tid=0 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 client.4380 shutdown 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- 172.21.15.67:0/282151840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 msgr2=0x557141b9de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141b9de50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f76180137f0 tx=0x7f76180046d0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- 172.21.15.67:0/282151840 shutdown_connections 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x557141bf1280 0x557141bf3670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b9e390 0x557141ba4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be3440 0x557141ba3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 --2- 172.21.15.67:0/282151840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141b9de50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f7602ffd640 0 client.4380 ms_handle_reset on v2:172.21.15.67:6834/3064059806 2024-09-19T05:33:21.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- 172.21.15.67:0/282151840 >> 172.21.15.67:0/282151840 conn(0x557141b99290 msgr2=0x557141b97d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:21.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- 172.21.15.67:0/282151840 shutdown_connections 2024-09-19T05:33:21.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 1 -- 172.21.15.67:0/282151840 wait complete. 2024-09-19T05:33:21.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.854+0000 7f762d623000 20 client.4380 trim_cache size 0 max 16384 2024-09-19T05:33:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f762d623000 1 Processor -- start 2024-09-19T05:33:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f762d623000 1 -- start start 2024-09-19T05:33:21.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f762d623000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141b9e390 0x557141c561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f762d623000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be2b20 0x557141c566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f762d623000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141be3440 0x557141c56c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f762d623000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7624201d30 con 0x557141b9e390 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f762d623000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f76241431f0 con 0x557141be2b20 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f762d623000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f76241f9340 con 0x557141be3440 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f7623fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141b9e390 0x557141c561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f7623fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141b9e390 0x557141c561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45842/0 (socket says 172.21.15.67:45842) 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f7623fff640 1 -- 172.21.15.67:0/2465852986 learned_addr learned my addr 172.21.15.67:0/2465852986 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f7623fff640 1 -- 172.21.15.67:0/2465852986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141be3440 msgr2=0x557141c56c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f7623fff640 1 --2- 172.21.15.67:0/2465852986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141be3440 0x557141c56c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f7623fff640 1 -- 172.21.15.67:0/2465852986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be2b20 msgr2=0x557141c566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f7623fff640 1 --2- 172.21.15.67:0/2465852986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be2b20 0x557141c566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f7623fff640 1 -- 172.21.15.67:0/2465852986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557141bee8e0 con 0x557141b9e390 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f7623fff640 1 --2- 172.21.15.67:0/2465852986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141b9e390 0x557141c561b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7618004780 tx=0x7f7618021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf9d48037f79b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f76097fa640 1 -- 172.21.15.67:0/2465852986 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618025040 con 0x557141b9e390 2024-09-19T05:33:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f76097fa640 1 -- 172.21.15.67:0/2465852986 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7618019040 con 0x557141b9e390 2024-09-19T05:33:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f76097fa640 1 -- 172.21.15.67:0/2465852986 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761800b040 con 0x557141b9e390 2024-09-19T05:33:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f762d623000 1 -- 172.21.15.67:0/2465852986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141b9e390 msgr2=0x557141c561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.874+0000 7f762d623000 1 --2- 172.21.15.67:0/2465852986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141b9e390 0x557141c561b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7618004780 tx=0x7f7618021000 comp rx=0 tx=0).stop 2024-09-19T05:33:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/2465852986 shutdown_connections 2024-09-19T05:33:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- 172.21.15.67:0/2465852986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141be3440 0x557141c56c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- 172.21.15.67:0/2465852986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be2b20 0x557141c566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- 172.21.15.67:0/2465852986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141b9e390 0x557141c561b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/2465852986 >> 172.21.15.67:0/2465852986 conn(0x557141b99290 msgr2=0x557141b9d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/2465852986 shutdown_connections 2024-09-19T05:33:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/2465852986 wait complete. 2024-09-19T05:33:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- start start 2024-09-19T05:33:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 Processor -- start 2024-09-19T05:33:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b9e390 0x557141c5a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141c5acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be3440 0x557141c41e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5571419e6f80 con 0x557141be2b20 2024-09-19T05:33:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55714199fca0 con 0x557141be3440 2024-09-19T05:33:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5571419ec2a0 con 0x557141b9e390 2024-09-19T05:33:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 10 client.0 _ll_register_callbacks cb 0x7f7618013470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:33:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f76237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141c5acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f76237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141c5acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45846/0 (socket says 172.21.15.67:45846) 2024-09-19T05:33:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f76237fe640 1 -- 172.21.15.67:0/989784056 learned_addr learned my addr 172.21.15.67:0/989784056 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7628b04640 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be3440 0x557141c41e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f76237fe640 1 -- 172.21.15.67:0/989784056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b9e390 msgr2=0x557141c5a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f76237fe640 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b9e390 0x557141c5a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f76237fe640 1 -- 172.21.15.67:0/989784056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be3440 msgr2=0x557141c41e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f76237fe640 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be3440 0x557141c41e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f76237fe640 1 -- 172.21.15.67:0/989784056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557141be3270 con 0x557141be2b20 2024-09-19T05:33:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f76237fe640 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141c5acb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f76140557d0 tx=0x7f7614000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d0488fe559c04c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:33:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7602ffd640 1 -- 172.21.15.67:0/989784056 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614051c80 con 0x557141be2b20 2024-09-19T05:33:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7602ffd640 1 -- 172.21.15.67:0/989784056 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f76140850c0 con 0x557141be2b20 2024-09-19T05:33:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/989784056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7618019040 con 0x557141be2b20 2024-09-19T05:33:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7602ffd640 1 -- 172.21.15.67:0/989784056 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f7614051e20 con 0x557141be2b20 2024-09-19T05:33:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 10 client.4386 fetch_fsmap learned FSMap version 6 2024-09-19T05:33:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/989784056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55714196efd0 con 0x557141be2b20 2024-09-19T05:33:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7602ffd640 1 -- 172.21.15.67:0/989784056 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7618019040 con 0x557141be2b20 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7602ffd640 1 -- 172.21.15.67:0/989784056 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f7614083070 con 0x557141be2b20 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 10 client.4386 fetch_fsmap finished waiting for FSMap version 6 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 10 client.4386 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 20 client.4386 populate_metadata read hostname 'smithi067' 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x557141c42360 0x557141c42740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 4 client.4386 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/989784056 --> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] -- command(tid 0: {"prefix": "status"}) -- 0x5571419f53a0 con 0x557141c42360 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7623fff640 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x557141c42360 0x557141c42740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7623fff640 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x557141c42360 0x557141c42740 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b86746b2272c297 server_cookie=3982d2e791be2bb5 in_seq=0 out_seq=0 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7602ffd640 10 client.4386 ms_handle_connect on v2:172.21.15.67:6834/3064059806 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7602ffd640 1 -- 172.21.15.67:0/989784056 <== mds.0 v2:172.21.15.67:6834/3064059806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5571419f53a0 con 0x557141c42360 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7602ffd640 10 client.4386 handle_command_reply: tid=0 2024-09-19T05:33:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 client.4386 shutdown 2024-09-19T05:33:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/989784056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 msgr2=0x557141c5acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141c5acb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f76140557d0 tx=0x7f7614000bd0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/989784056 shutdown_connections 2024-09-19T05:33:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x557141c42360 0x557141c42740 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557141be3440 0x557141c41e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557141be2b20 0x557141c5acb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f7602ffd640 0 client.4386 ms_handle_reset on v2:172.21.15.67:6834/3064059806 2024-09-19T05:33:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 --2- 172.21.15.67:0/989784056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557141b9e390 0x557141c5a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/989784056 >> 172.21.15.67:0/989784056 conn(0x557141b99290 msgr2=0x557141bf5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/989784056 shutdown_connections 2024-09-19T05:33:21.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 1 -- 172.21.15.67:0/989784056 wait complete. 2024-09-19T05:33:21.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.878+0000 7f762d623000 20 client.4386 trim_cache size 0 max 16384 2024-09-19T05:33:21.891 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:33:21.891 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:33:21.891 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:33:21.891 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4288, 2024-09-19T05:33:21.891 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:33:21.891 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:33:21.891 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:33:21.891 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 7.3785653699999996, 2024-09-19T05:33:21.892 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 6, 2024-09-19T05:33:21.892 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 25, 2024-09-19T05:33:21.892 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 24, 2024-09-19T05:33:21.892 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 13.422952756999999 2024-09-19T05:33:21.892 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:33:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 -- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678c0 msgr2=0x7f7610069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678c0 0x7f7610069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f761800ab50 tx=0x7f7618008040 comp rx=0 tx=0).stop 2024-09-19T05:33:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 -- 172.21.15.67:0/2484369626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76240af730 msgr2=0x7f7624156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76240af730 0x7f7624156320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f761400c420 tx=0x7f761400c8e0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 -- 172.21.15.67:0/2484369626 shutdown_connections 2024-09-19T05:33:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678c0 0x7f7610069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762415a920 0x7f762414b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76240af730 0x7f7624156320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 --2- 172.21.15.67:0/2484369626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f762406ed80 0x7f7624099160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:21.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 -- 172.21.15.67:0/2484369626 >> 172.21.15.67:0/2484369626 conn(0x7f76240d0080 msgr2=0x7f762406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:21.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 -- 172.21.15.67:0/2484369626 shutdown_connections 2024-09-19T05:33:21.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:21.882+0000 7f762a567640 1 -- 172.21.15.67:0/2484369626 wait complete. 2024-09-19T05:33:21.900 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T05:33:21.900 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:33:21.901 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:33:22.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.010+0000 7f2725d0d640 1 Processor -- start 2024-09-19T05:33:22.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.010+0000 7f2725d0d640 1 -- start start 2024-09-19T05:33:22.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f272015c030 0x7f272006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:22.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f272015d1d0 0x7f27200b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:22.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f272006e3c0 con 0x7f27200b3510 2024-09-19T05:33:22.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f272006e6a0 con 0x7f272015c030 2024-09-19T05:33:22.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f272006e980 con 0x7f272015d1d0 2024-09-19T05:33:22.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f272015c030 0x7f272006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:22.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f272015c030 0x7f272006dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45850/0 (socket says 172.21.15.67:45850) 2024-09-19T05:33:22.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271f7fe640 1 -- 172.21.15.67:0/695105819 learned_addr learned my addr 172.21.15.67:0/695105819 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:22.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271effd640 1 --2- 172.21.15.67:0/695105819 >> v2:172.21.15.97:3300/0 conn(0x7f272015d1d0 0x7f27200b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:22.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271f7fe640 1 -- 172.21.15.67:0/695105819 >> v2:172.21.15.97:3300/0 conn(0x7f272015d1d0 msgr2=0x7f27200b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:22.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271f7fe640 1 --2- 172.21.15.67:0/695105819 >> v2:172.21.15.97:3300/0 conn(0x7f272015d1d0 0x7f27200b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:22.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271f7fe640 1 -- 172.21.15.67:0/695105819 >> v1:172.21.15.97:6789/0 conn(0x7f27200b3510 legacy=0x7f272006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:22.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271f7fe640 1 -- 172.21.15.67:0/695105819 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272006ec60 con 0x7f272015c030 2024-09-19T05:33:22.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271f7fe640 1 --2- 172.21.15.67:0/695105819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f272015c030 0x7f272006dde0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f27200add20 tx=0x7f271001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b144d0fd782f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:22.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271e7fc640 1 -- 172.21.15.67:0/695105819 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27100ab610 con 0x7f272015c030 2024-09-19T05:33:22.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271e7fc640 1 -- 172.21.15.67:0/695105819 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27100b0070 con 0x7f272015c030 2024-09-19T05:33:22.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f271e7fc640 1 -- 172.21.15.67:0/695105819 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27100ab9d0 con 0x7f272015c030 2024-09-19T05:33:22.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 -- 172.21.15.67:0/695105819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f272015c030 msgr2=0x7f272006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:22.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 --2- 172.21.15.67:0/695105819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f272015c030 0x7f272006dde0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f27200add20 tx=0x7f271001c4f0 comp rx=0 tx=0).stop 2024-09-19T05:33:22.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 -- 172.21.15.67:0/695105819 shutdown_connections 2024-09-19T05:33:22.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 --2- 172.21.15.67:0/695105819 >> v2:172.21.15.97:3300/0 conn(0x7f272015d1d0 0x7f27200b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:22.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 --2- 172.21.15.67:0/695105819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f272015c030 0x7f272006dde0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:22.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 -- 172.21.15.67:0/695105819 >> 172.21.15.67:0/695105819 conn(0x7f27200d0080 msgr2=0x7f27200d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:22.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 -- 172.21.15.67:0/695105819 shutdown_connections 2024-09-19T05:33:22.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.014+0000 7f2725d0d640 1 -- 172.21.15.67:0/695105819 wait complete. 2024-09-19T05:33:22.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2725d0d640 1 Processor -- start 2024-09-19T05:33:22.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2725d0d640 1 -- start start 2024-09-19T05:33:22.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2725d0d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27200b3510 0x7f2720099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:22.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2725d0d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272015c030 0x7f2720154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:22.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2725d0d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272015d1d0 0x7f272014e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:22.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2725d0d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f272015c590 con 0x7f27200b3510 2024-09-19T05:33:22.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2725d0d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f272015c410 con 0x7f272015d1d0 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2725d0d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f27201690e0 con 0x7f272015c030 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27200b3510 0x7f2720099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27200b3510 0x7f2720099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45858/0 (socket says 172.21.15.67:45858) 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271f7fe640 1 -- 172.21.15.67:0/3847228814 learned_addr learned my addr 172.21.15.67:0/3847228814 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271effd640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272015c030 0x7f2720154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271ffff640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272015d1d0 0x7f272014e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271f7fe640 1 -- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272015c030 msgr2=0x7f2720154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271f7fe640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272015c030 0x7f2720154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271f7fe640 1 -- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272015d1d0 msgr2=0x7f272014e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271f7fe640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272015d1d0 0x7f272014e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271f7fe640 1 -- 172.21.15.67:0/3847228814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272014e750 con 0x7f27200b3510 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271effd640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272015c030 0x7f2720154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:22.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271ffff640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272015d1d0 0x7f272014e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:22.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f271f7fe640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27200b3510 0x7f2720099a90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f271001aba0 tx=0x7f271001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:22.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2707fff640 1 -- 172.21.15.67:0/3847228814 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27100be5f0 con 0x7f27200b3510 2024-09-19T05:33:22.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2707fff640 1 -- 172.21.15.67:0/3847228814 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27100be790 con 0x7f27200b3510 2024-09-19T05:33:22.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2725d0d640 1 -- 172.21.15.67:0/3847228814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272014ea10 con 0x7f27200b3510 2024-09-19T05:33:22.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2707fff640 1 -- 172.21.15.67:0/3847228814 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27100beb60 con 0x7f27200b3510 2024-09-19T05:33:22.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.018+0000 7f2725d0d640 1 -- 172.21.15.67:0/3847228814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272014efd0 con 0x7f27200b3510 2024-09-19T05:33:22.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.022+0000 7f2725d0d640 1 -- 172.21.15.67:0/3847228814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272006dde0 con 0x7f27200b3510 2024-09-19T05:33:22.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.022+0000 7f2707fff640 1 -- 172.21.15.67:0/3847228814 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27100b43f0 con 0x7f27200b3510 2024-09-19T05:33:22.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.022+0000 7f2707fff640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f270c0678f0 0x7f270c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:22.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.022+0000 7f2707fff640 1 -- 172.21.15.67:0/3847228814 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2710120970 con 0x7f27200b3510 2024-09-19T05:33:22.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.022+0000 7f271effd640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f270c0678f0 0x7f270c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:22.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.022+0000 7f271effd640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f270c0678f0 0x7f270c069db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27200cf2a0 tx=0x7f2714008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:22.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.026+0000 7f2707fff640 1 -- 172.21.15.67:0/3847228814 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f27100c4060 con 0x7f27200b3510 2024-09-19T05:33:22.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 -- 172.21.15.67:0/3847228814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f27200d0f20 con 0x7f27200b3510 2024-09-19T05:33:22.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2707fff640 1 -- 172.21.15.67:0/3847228814 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f27100a8050 con 0x7f27200b3510 2024-09-19T05:33:22.225 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T05:33:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 -- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f270c0678f0 msgr2=0x7f270c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f270c0678f0 0x7f270c069db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27200cf2a0 tx=0x7f2714008040 comp rx=0 tx=0).stop 2024-09-19T05:33:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 -- 172.21.15.67:0/3847228814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27200b3510 msgr2=0x7f2720099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27200b3510 0x7f2720099a90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f271001aba0 tx=0x7f271001ad30 comp rx=0 tx=0).stop 2024-09-19T05:33:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 -- 172.21.15.67:0/3847228814 shutdown_connections 2024-09-19T05:33:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272015d1d0 0x7f272014e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f270c0678f0 0x7f270c069db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272015c030 0x7f2720154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 --2- 172.21.15.67:0/3847228814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27200b3510 0x7f2720099a90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:22.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 -- 172.21.15.67:0/3847228814 >> 172.21.15.67:0/3847228814 conn(0x7f27200d0080 msgr2=0x7f27200af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:22.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 -- 172.21.15.67:0/3847228814 shutdown_connections 2024-09-19T05:33:22.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22.222+0000 7f2725d0d640 1 -- 172.21.15.67:0/3847228814 wait complete. 2024-09-19T05:33:22.242 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T05:33:22.242 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:33:22.242 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:33:22.242 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-19T05:33:22.243 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:33:22.243 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T05:33:22.243 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:33:22.243 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:33:22.243 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T05:33:22.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:22.243 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:33:22.249 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:22.250 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:22.251 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:33:22.251 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:22.251 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:33:22.251 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42502sec preferred_lft 42502sec 2024-09-19T05:33:22.251 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:33:22.251 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:22.251 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:33:22.251 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:22.251 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:33:22.251 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:22.252 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T05:33:22.252 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:22.252 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:22.252 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2024-09-19T05:33:22.252 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2024-09-19T05:33:22.252 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2024-09-19T05:33:22.252 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T05:33:22.252 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:22.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:22.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:22.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:22.383 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:33:22.439 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:33:22.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:22.441 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:33:22.511 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:33:22.511 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:33:22.511 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:33:22.511 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:33:22.511 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:33:22.511 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:33:22.511 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:33:22.511 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:22.511 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:22.511 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:22.512 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:33:22.512 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:22.512 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:22.512 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:33:22.512 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:33:22.512 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:33:22.512 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:22.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:22.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:22.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:22.638 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:33:22.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:22.644 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-09-19T05:33:22.692 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:22.692 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:22.693 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:33:22.693 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-19T05:33:22.693 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:22.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:22.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:22.815 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-19T05:33:22.815 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:22.815 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:22.815 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-19T05:33:22.815 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T05:33:22.815 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-19T05:33:22.815 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-19T05:33:22.815 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-19T05:33:22.815 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:22.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:22.915 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:22.915 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:22.915 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:33:22.916 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T05:33:22.916 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:23.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:23.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:23.022 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-19T05:33:23.022 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:33:23.022 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:33:23.068 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T05:33:23.068 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:33:23.068 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:33:23.116 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:33:23.173 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:23.221 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:33:23.222 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:33:23.223 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:33:23.224 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:33:23.224 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:33:23.224 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:33:23.224 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:33:23.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:23.225 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:33:23.273 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:33:23.273 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-19T05:33:23.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:33:23.334 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:23.383 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:33:23.383 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:33:23.383 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:33:23.383 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:33:23.383 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:33:23.383 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:33:23.383 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:33:23.384 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:33:23.384 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:33:23.384 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:33:23.384 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:33:23.384 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:33:23.384 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:23.384 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:33:23.386 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:33:23.386 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:33:23.386 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:33:23.386 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:33:23.386 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:23.386 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:33:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:33:23.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:23.389 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:33:23.405 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:2024-09-19T05:33:23.402+0000 7ff17d851580 -1 init, newargv = 0x560875560a60 newargc=15 2024-09-19T05:33:23.405 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:ceph-fuse[34950]: starting ceph client 2024-09-19T05:33:23.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:ceph-fuse[34950]: starting fuse 2024-09-19T05:33:24.516 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:33:24.533 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:24.581 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:33:24.581 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:24.582 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:33:24.583 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:33:24.584 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:33:24.584 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:33:24.584 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:33:24.584 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:33:24.584 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-19T05:33:24.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:24.585 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:33:24.632 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:33:24.633 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:33:24.636 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:33:24.637 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:33:24.638 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:33:24.638 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:24.638 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:33:24.638 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:33:24.638 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:33:24.638 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:33:24.638 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:33:24.638 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:33:24.638 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:33:24.639 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:33:24.639 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:24.639 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.admin")) 2024-09-19T05:33:24.639 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:33:24.760 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.admin.34950.asok 2024-09-19T05:33:24.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:24.772 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34950.asok 2024-09-19T05:33:24.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:24.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34950.asok status 2024-09-19T05:33:24.933 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:33:24.933 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "admin", 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "34950", 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:33:24.934 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4398, 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 4398 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.67:0", 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 1011204269 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.67:0", 2024-09-19T05:33:24.935 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 1011204269 2024-09-19T05:33:24.936 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:24.936 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.4398 172.21.15.67:0/1011204269", 2024-09-19T05:33:24.936 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "172.21.15.67:0/1011204269", 2024-09-19T05:33:24.936 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:33:24.936 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 6, 2024-09-19T05:33:24.936 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 25, 2024-09-19T05:33:24.936 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:33:24.936 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:33:24.936 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:33:24.936 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:33:24.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:24.948 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:33:24.948 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:33:24.954 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:33:24.954 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:33:24.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:24.954 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:33:25.008 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-19T05:33:25.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:33:25.136 INFO:teuthology.orchestra.run.smithi067.stdout:# file: . 2024-09-19T05:33:25.136 INFO:teuthology.orchestra.run.smithi067.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-19T05:33:25.136 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:25.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:25.144 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:33:25.145 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:25.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:33:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.318+0000 7f178c40e640 1 Processor -- start 2024-09-19T05:33:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.318+0000 7f178c40e640 1 -- start start 2024-09-19T05:33:25.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.318+0000 7f178c40e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17840d15f0 0x7f1784165c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.318+0000 7f178c40e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17840cdae0 con 0x7f17840d1d70 2024-09-19T05:33:25.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.318+0000 7f178c40e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17840cddc0 con 0x7f178415b210 2024-09-19T05:33:25.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.318+0000 7f178c40e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f17840cd890 con 0x7f17840d15f0 2024-09-19T05:33:25.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.318+0000 7f17899a9640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f17840d1d70 0x7f17840d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48728/0 (socket says 172.21.15.67:48728) 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.318+0000 7f17899a9640 1 -- 172.21.15.67:0/3531899711 learned_addr learned my addr 172.21.15.67:0/3531899711 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178a9ab640 1 --2- 172.21.15.67:0/3531899711 >> v2:172.21.15.97:3300/0 conn(0x7f17840d15f0 0x7f1784165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041625770 0 0) 0x7f17840cdae0 con 0x7f17840d1d70 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1770003530 con 0x7f17840d1d70 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1817885928 0 0) 0x7f1770003530 con 0x7f17840d1d70 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 >> v2:172.21.15.97:3300/0 conn(0x7f17840d15f0 msgr2=0x7f1784165c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 --2- 172.21.15.67:0/3531899711 >> v2:172.21.15.97:3300/0 conn(0x7f17840d15f0 0x7f1784165c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 >> v1:172.21.15.97:6789/0 conn(0x7f178415b210 legacy=0x7f17840b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17840ce0a0 con 0x7f17840d1d70 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1778001680 con 0x7f17840d1d70 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 >> v1:172.21.15.67:6789/0 conn(0x7f17840d1d70 legacy=0x7f17840d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 --2- 172.21.15.67:0/3531899711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f1770003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 --2- 172.21.15.67:0/3531899711 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1770004810 0x7f1770004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 --2- 172.21.15.67:0/3531899711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1770005240 0x7f177000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f17840cd890 con 0x7f1770003a10 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f177000c1a0 con 0x7f1770005240 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f177000c3a0 con 0x7f1770004810 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178a1aa640 1 --2- 172.21.15.67:0/3531899711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f1770003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17899a9640 1 --2- 172.21.15.67:0/3531899711 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1770004810 0x7f1770004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178a1aa640 1 -- 172.21.15.67:0/3531899711 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1770004810 msgr2=0x7f1770004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178a1aa640 1 --2- 172.21.15.67:0/3531899711 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1770004810 0x7f1770004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178a1aa640 1 -- 172.21.15.67:0/3531899711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1770005240 msgr2=0x7f177000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178a1aa640 1 --2- 172.21.15.67:0/3531899711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1770005240 0x7f177000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178a9ab640 1 -- 172.21.15.67:0/3531899711 reap_dead start 2024-09-19T05:33:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178a1aa640 1 -- 172.21.15.67:0/3531899711 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1770003530 con 0x7f1770003a10 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178a1aa640 1 --2- 172.21.15.67:0/3531899711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f1770003e50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1780001360 tx=0x7f178001e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1b189de970614a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17800013a0 con 0x7f1770003a10 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800052f0 con 0x7f1770003a10 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f17891a8640 1 -- 172.21.15.67:0/3531899711 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780003840 con 0x7f1770003a10 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178c40e640 1 -- 172.21.15.67:0/3531899711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 msgr2=0x7f1770003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178c40e640 1 --2- 172.21.15.67:0/3531899711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f1770003e50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1780001360 tx=0x7f178001e570 comp rx=0 tx=0).stop 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178c40e640 1 -- 172.21.15.67:0/3531899711 shutdown_connections 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178c40e640 1 --2- 172.21.15.67:0/3531899711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f1770003e50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.322+0000 7f178c40e640 1 -- 172.21.15.67:0/3531899711 >> 172.21.15.67:0/3531899711 conn(0x7f178409aa30 msgr2=0x7f17840b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 -- 172.21.15.67:0/3531899711 shutdown_connections 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 -- 172.21.15.67:0/3531899711 wait complete. 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 Processor -- start 2024-09-19T05:33:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 -- start start 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f178415c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178415deb0 0x7f17841515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784154900 0x7f17841f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f178406c4d0 con 0x7f1770003a10 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f178406c650 con 0x7f1784154900 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f178406c7d0 con 0x7f178415deb0 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178a1aa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f178415c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178a1aa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f178415c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45876/0 (socket says 172.21.15.67:45876) 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178a1aa640 1 -- 172.21.15.67:0/1721127595 learned_addr learned my addr 172.21.15.67:0/1721127595 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178a9ab640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784154900 0x7f17841f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f17899a9640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178415deb0 0x7f17841515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178a1aa640 1 -- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178415deb0 msgr2=0x7f17841515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178a1aa640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178415deb0 0x7f17841515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178a1aa640 1 -- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784154900 msgr2=0x7f17841f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178a1aa640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784154900 0x7f17841f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178a1aa640 1 -- 172.21.15.67:0/1721127595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178415ce10 con 0x7f1770003a10 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f17899a9640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178415deb0 0x7f17841515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178a1aa640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f178415c750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1780099e70 tx=0x7f1770005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f1776ffd640 1 -- 172.21.15.67:0/1721127595 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780007a40 con 0x7f1770003a10 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f1776ffd640 1 -- 172.21.15.67:0/1721127595 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800bc070 con 0x7f1770003a10 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 -- 172.21.15.67:0/1721127595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178415d0f0 con 0x7f1770003a10 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f1776ffd640 1 -- 172.21.15.67:0/1721127595 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17800054a0 con 0x7f1770003a10 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 -- 172.21.15.67:0/1721127595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178415d6b0 con 0x7f1770003a10 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.326+0000 7f178c40e640 1 -- 172.21.15.67:0/1721127595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17840ae770 con 0x7f1770003a10 2024-09-19T05:33:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.330+0000 7f1776ffd640 1 -- 172.21.15.67:0/1721127595 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1780007030 con 0x7f1770003a10 2024-09-19T05:33:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.330+0000 7f1776ffd640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17680678c0 0x7f1768069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.330+0000 7f1776ffd640 1 -- 172.21.15.67:0/1721127595 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1780122860 con 0x7f1770003a10 2024-09-19T05:33:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.330+0000 7f17899a9640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17680678c0 0x7f1768069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.330+0000 7f17899a9640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17680678c0 0x7f1768069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1778000c10 tx=0x7f1778000ee0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:25.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.334+0000 7f1776ffd640 1 -- 172.21.15.67:0/1721127595 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1780018280 con 0x7f1770003a10 2024-09-19T05:33:25.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.510+0000 7f178c40e640 1 -- 172.21.15.67:0/1721127595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f178415a2d0 con 0x7f1770003a10 2024-09-19T05:33:25.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.510+0000 7f1776ffd640 1 -- 172.21.15.67:0/1721127595 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f17800f31d0 con 0x7f1770003a10 2024-09-19T05:33:25.515 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:33:25.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 -- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17680678c0 msgr2=0x7f1768069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17680678c0 0x7f1768069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1778000c10 tx=0x7f1778000ee0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 -- 172.21.15.67:0/1721127595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 msgr2=0x7f178415c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f178415c750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1780099e70 tx=0x7f1770005840 comp rx=0 tx=0).stop 2024-09-19T05:33:25.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 -- 172.21.15.67:0/1721127595 shutdown_connections 2024-09-19T05:33:25.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784154900 0x7f17841f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17680678c0 0x7f1768069d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178415deb0 0x7f17841515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 --2- 172.21.15.67:0/1721127595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1770003a10 0x7f178415c750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 -- 172.21.15.67:0/1721127595 >> 172.21.15.67:0/1721127595 conn(0x7f178409aa30 msgr2=0x7f17840ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:25.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 -- 172.21.15.67:0/1721127595 shutdown_connections 2024-09-19T05:33:25.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.514+0000 7f178c40e640 1 -- 172.21.15.67:0/1721127595 wait complete. 2024-09-19T05:33:25.535 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:33:25.535 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:25.541 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:33:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c498e7640 1 Processor -- start 2024-09-19T05:33:25.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c498e7640 1 -- start start 2024-09-19T05:33:25.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c498e7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6c4415e330 0x7f6c44071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c498e7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c440b4420 con 0x7f6c440b4bc0 2024-09-19T05:33:25.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c498e7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c44162d90 con 0x7f6c440b2fd0 2024-09-19T05:33:25.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c498e7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6c440acfb0 con 0x7f6c4415e330 2024-09-19T05:33:25.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c437fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6c440b4bc0 0x7f6c44162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48742/0 (socket says 172.21.15.67:48742) 2024-09-19T05:33:25.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c437fe640 1 -- 172.21.15.67:0/3642798061 learned_addr learned my addr 172.21.15.67:0/3642798061 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:25.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c42ffd640 1 --2- 172.21.15.67:0/3642798061 >> v2:172.21.15.97:3300/0 conn(0x7f6c4415e330 0x7f6c44071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510335780 0 0) 0x7f6c440b4420 con 0x7f6c440b4bc0 2024-09-19T05:33:25.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c2c003530 con 0x7f6c440b4bc0 2024-09-19T05:33:25.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2850966637 0 0) 0x7f6c2c003530 con 0x7f6c440b4bc0 2024-09-19T05:33:25.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 >> v2:172.21.15.97:3300/0 conn(0x7f6c4415e330 msgr2=0x7f6c44071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:25.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 --2- 172.21.15.67:0/3642798061 >> v2:172.21.15.97:3300/0 conn(0x7f6c4415e330 0x7f6c44071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 >> v1:172.21.15.97:6789/0 conn(0x7f6c440b2fd0 legacy=0x7f6c44161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c440b4140 con 0x7f6c440b4bc0 2024-09-19T05:33:25.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6c3c001a00 con 0x7f6c440b4bc0 2024-09-19T05:33:25.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c42ffd640 1 --2- 172.21.15.67:0/3642798061 >> v2:172.21.15.97:3300/0 conn(0x7f6c4415e330 0x7f6c44071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:33:25.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 >> v1:172.21.15.67:6789/0 conn(0x7f6c440b4bc0 legacy=0x7f6c44162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c2c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c2c004810 0x7f6c2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c2c0051d0 0x7f6c2c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c00c040 con 0x7f6c2c0039c0 2024-09-19T05:33:25.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c00c1f0 con 0x7f6c2c004810 2024-09-19T05:33:25.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2c00c3f0 con 0x7f6c2c0051d0 2024-09-19T05:33:25.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c42ffd640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c2c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c427fc640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c2c004810 0x7f6c2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c42ffd640 1 -- 172.21.15.67:0/3642798061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c2c0051d0 msgr2=0x7f6c2c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:25.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c437fe640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c2c0051d0 0x7f6c2c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c42ffd640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c2c0051d0 0x7f6c2c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c42ffd640 1 -- 172.21.15.67:0/3642798061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c2c004810 msgr2=0x7f6c2c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:25.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c42ffd640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c2c004810 0x7f6c2c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c42ffd640 1 -- 172.21.15.67:0/3642798061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c003530 con 0x7f6c2c0039c0 2024-09-19T05:33:25.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c427fc640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c2c004810 0x7f6c2c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:25.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.710+0000 7f6c437fe640 1 -- 172.21.15.67:0/3642798061 reap_dead start 2024-09-19T05:33:25.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c42ffd640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c2c003de0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009cb0 tx=0x7f6c3401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79190d0e52edf627 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:25.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c340b2070 con 0x7f6c2c0039c0 2024-09-19T05:33:25.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c340a57c0 con 0x7f6c2c0039c0 2024-09-19T05:33:25.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c41ffb640 1 -- 172.21.15.67:0/3642798061 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34009880 con 0x7f6c2c0039c0 2024-09-19T05:33:25.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c498e7640 1 -- 172.21.15.67:0/3642798061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 msgr2=0x7f6c2c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c498e7640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c2c003de0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009cb0 tx=0x7f6c3401cc30 comp rx=0 tx=0).stop 2024-09-19T05:33:25.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c498e7640 1 -- 172.21.15.67:0/3642798061 shutdown_connections 2024-09-19T05:33:25.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c498e7640 1 --2- 172.21.15.67:0/3642798061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c2c003de0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c498e7640 1 -- 172.21.15.67:0/3642798061 >> 172.21.15.67:0/3642798061 conn(0x7f6c440d0080 msgr2=0x7f6c440d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:25.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c498e7640 1 -- 172.21.15.67:0/3642798061 shutdown_connections 2024-09-19T05:33:25.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c498e7640 1 -- 172.21.15.67:0/3642798061 wait complete. 2024-09-19T05:33:25.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c498e7640 1 Processor -- start 2024-09-19T05:33:25.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.714+0000 7f6c498e7640 1 -- start start 2024-09-19T05:33:25.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c498e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c4414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c498e7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4415ae00 0x7f6c44153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c498e7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c4415b280 0x7f6c441541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c498e7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6c440cfe40 con 0x7f6c2c0039c0 2024-09-19T05:33:25.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c498e7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c440cfcc0 con 0x7f6c4415ae00 2024-09-19T05:33:25.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c498e7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6c44161f70 con 0x7f6c4415b280 2024-09-19T05:33:25.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c42ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c4414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c42ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c4414fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45892/0 (socket says 172.21.15.67:45892) 2024-09-19T05:33:25.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c42ffd640 1 -- 172.21.15.67:0/2745144984 learned_addr learned my addr 172.21.15.67:0/2745144984 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:25.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c427fc640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4415ae00 0x7f6c44153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c437fe640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c4415b280 0x7f6c441541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c42ffd640 1 -- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c4415b280 msgr2=0x7f6c441541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c42ffd640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c4415b280 0x7f6c441541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c42ffd640 1 -- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4415ae00 msgr2=0x7f6c44153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c42ffd640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4415ae00 0x7f6c44153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c42ffd640 1 -- 172.21.15.67:0/2745144984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c441515f0 con 0x7f6c2c0039c0 2024-09-19T05:33:25.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c427fc640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4415ae00 0x7f6c44153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:25.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c42ffd640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c4414fc30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6c3401ca60 tx=0x7f6c340199d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:25.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c2bfff640 1 -- 172.21.15.67:0/2745144984 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c340b2040 con 0x7f6c2c0039c0 2024-09-19T05:33:25.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c2bfff640 1 -- 172.21.15.67:0/2745144984 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c340bd070 con 0x7f6c2c0039c0 2024-09-19T05:33:25.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c498e7640 1 -- 172.21.15.67:0/2745144984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c441518d0 con 0x7f6c2c0039c0 2024-09-19T05:33:25.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c2bfff640 1 -- 172.21.15.67:0/2745144984 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c340b8670 con 0x7f6c2c0039c0 2024-09-19T05:33:25.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c498e7640 1 -- 172.21.15.67:0/2745144984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c44151e90 con 0x7f6c2c0039c0 2024-09-19T05:33:25.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c498e7640 1 -- 172.21.15.67:0/2745144984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c44162300 con 0x7f6c2c0039c0 2024-09-19T05:33:25.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c2bfff640 1 -- 172.21.15.67:0/2745144984 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c340b8810 con 0x7f6c2c0039c0 2024-09-19T05:33:25.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c2bfff640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c300678f0 0x7f6c30069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:25.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.718+0000 7f6c2bfff640 1 -- 172.21.15.67:0/2745144984 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6c341200c0 con 0x7f6c2c0039c0 2024-09-19T05:33:25.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.722+0000 7f6c427fc640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c300678f0 0x7f6c30069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:25.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.722+0000 7f6c427fc640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c300678f0 0x7f6c30069db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c38000c10 tx=0x7f6c38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:25.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.726+0000 7f6c2bfff640 1 -- 172.21.15.67:0/2745144984 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6c340c6020 con 0x7f6c2c0039c0 2024-09-19T05:33:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.902+0000 7f6c498e7640 1 -- 172.21.15.67:0/2745144984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6c44161ce0 con 0x7f6c2c0039c0 2024-09-19T05:33:25.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c2bfff640 1 -- 172.21.15.67:0/2745144984 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f6c34016940 con 0x7f6c2c0039c0 2024-09-19T05:33:25.908 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:33:25.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 -- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c300678f0 msgr2=0x7f6c30069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c300678f0 0x7f6c30069db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c38000c10 tx=0x7f6c38009040 comp rx=0 tx=0).stop 2024-09-19T05:33:25.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 -- 172.21.15.67:0/2745144984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 msgr2=0x7f6c4414fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:25.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c4414fc30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6c3401ca60 tx=0x7f6c340199d0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 -- 172.21.15.67:0/2745144984 shutdown_connections 2024-09-19T05:33:25.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c300678f0 0x7f6c30069db0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c4415b280 0x7f6c441541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4415ae00 0x7f6c44153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 --2- 172.21.15.67:0/2745144984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c2c0039c0 0x7f6c4414fc30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:25.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 -- 172.21.15.67:0/2745144984 >> 172.21.15.67:0/2745144984 conn(0x7f6c440d0080 msgr2=0x7f6c440adbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:25.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 -- 172.21.15.67:0/2745144984 shutdown_connections 2024-09-19T05:33:25.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:25.906+0000 7f6c498e7640 1 -- 172.21.15.67:0/2745144984 wait complete. 2024-09-19T05:33:25.927 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:33:25.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:25.927 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:33:25.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:ceph-fuse[34950]: fuse finished with error 0 and tester_r 0 2024-09-19T05:33:25.959 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:33:25.991 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:33:25.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:25.991 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-19T05:33:26.050 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:26.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c0e33b640 1 Processor -- start 2024-09-19T05:33:26.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c0e33b640 1 -- start start 2024-09-19T05:33:26.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c0e33b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1c0815e550 0x7f1c080d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c0e33b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c08161af0 0x7f1c0815e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c0e33b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c080d0bc0 con 0x7f1c0809b5d0 2024-09-19T05:33:26.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c0e33b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1c080d0970 con 0x7f1c0815e550 2024-09-19T05:33:26.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c0e33b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1c080d0ea0 con 0x7f1c08161af0 2024-09-19T05:33:26.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c077fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1c0809b5d0 0x7f1c081613e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34416/0 (socket says 172.21.15.67:34416) 2024-09-19T05:33:26.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c077fe640 1 -- 172.21.15.67:0/1179865334 learned_addr learned my addr 172.21.15.67:0/1179865334 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:26.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c0c8d8640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c08161af0 0x7f1c0815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c07fff640 1 --2- 172.21.15.67:0/1179865334 >> v2:172.21.15.97:3300/0 conn(0x7f1c0815e550 0x7f1c080d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1828217200 0 0) 0x7f1c080d0bc0 con 0x7f1c0809b5d0 2024-09-19T05:33:26.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bf0003530 con 0x7f1c0809b5d0 2024-09-19T05:33:26.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3595094034 0 0) 0x7f1bf0003530 con 0x7f1c0809b5d0 2024-09-19T05:33:26.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c08161af0 msgr2=0x7f1c0815e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:26.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c08161af0 0x7f1c0815e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 >> v2:172.21.15.97:3300/0 conn(0x7f1c0815e550 msgr2=0x7f1c080d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:26.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 --2- 172.21.15.67:0/1179865334 >> v2:172.21.15.97:3300/0 conn(0x7f1c0815e550 0x7f1c080d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c080d1180 con 0x7f1c0809b5d0 2024-09-19T05:33:26.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1bfc001a20 con 0x7f1c0809b5d0 2024-09-19T05:33:26.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 >> v1:172.21.15.67:6789/0 conn(0x7f1c0809b5d0 legacy=0x7f1c081613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf00039c0 0x7f1bf0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bf0004810 0x7f1bf0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c08161af0 0x7f1bf00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1c080d0970 con 0x7f1bf0004810 2024-09-19T05:33:26.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1c080d0ea0 con 0x7f1bf00039c0 2024-09-19T05:33:26.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf000b9d0 con 0x7f1c08161af0 2024-09-19T05:33:26.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c077fe640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bf0004810 0x7f1bf0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c07fff640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf00039c0 0x7f1bf0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c0c8d8640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c08161af0 0x7f1bf00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c077fe640 1 -- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c08161af0 msgr2=0x7f1bf00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:26.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c077fe640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c08161af0 0x7f1bf00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c077fe640 1 -- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf00039c0 msgr2=0x7f1bf0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:26.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c077fe640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf00039c0 0x7f1bf0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c077fe640 1 -- 172.21.15.67:0/1179865334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf0003530 con 0x7f1bf0004810 2024-09-19T05:33:26.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.222+0000 7f1c07fff640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf00039c0 0x7f1bf0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:26.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c077fe640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bf0004810 0x7f1bf0004c90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00a890 tx=0x7f1bfc01fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5bbbd8ada82dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:26.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00a4e0 con 0x7f1bf0004810 2024-09-19T05:33:26.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0aa650 con 0x7f1bf0004810 2024-09-19T05:33:26.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c06ffd640 1 -- 172.21.15.67:0/1179865334 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0aaa40 con 0x7f1bf0004810 2024-09-19T05:33:26.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c0e33b640 1 -- 172.21.15.67:0/1179865334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bf0004810 msgr2=0x7f1bf0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c0e33b640 1 --2- 172.21.15.67:0/1179865334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bf0004810 0x7f1bf0004c90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00a890 tx=0x7f1bfc01fb00 comp rx=0 tx=0).stop 2024-09-19T05:33:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c0c8d8640 1 -- 172.21.15.67:0/1179865334 reap_dead start 2024-09-19T05:33:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c0e33b640 1 -- 172.21.15.67:0/1179865334 shutdown_connections 2024-09-19T05:33:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c0e33b640 1 -- 172.21.15.67:0/1179865334 >> 172.21.15.67:0/1179865334 conn(0x7f1c080b3d90 msgr2=0x7f1c080b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c0e33b640 1 -- 172.21.15.67:0/1179865334 shutdown_connections 2024-09-19T05:33:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c0e33b640 1 -- 172.21.15.67:0/1179865334 wait complete. 2024-09-19T05:33:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c0e33b640 1 Processor -- start 2024-09-19T05:33:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c0e33b640 1 -- start start 2024-09-19T05:33:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.226+0000 7f1c0e33b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c081474e0 0x7f1c0806df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c0e33b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c081478c0 0x7f1c0806e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c0e33b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c080cb820 0x7f1c080cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c0e33b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0815fe50 con 0x7f1c081474e0 2024-09-19T05:33:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c0e33b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1c080d1740 con 0x7f1c080cb820 2024-09-19T05:33:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c0e33b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1c0809ba40 con 0x7f1c081478c0 2024-09-19T05:33:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c07fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c081474e0 0x7f1c0806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c07fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c081474e0 0x7f1c0806df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34230/0 (socket says 172.21.15.67:34230) 2024-09-19T05:33:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c07fff640 1 -- 172.21.15.67:0/2828156318 learned_addr learned my addr 172.21.15.67:0/2828156318 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c0c8d8640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c080cb820 0x7f1c080cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c077fe640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c081478c0 0x7f1c0806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c07fff640 1 -- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c081478c0 msgr2=0x7f1c0806e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c07fff640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c081478c0 0x7f1c0806e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c07fff640 1 -- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c080cb820 msgr2=0x7f1c080cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c07fff640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c080cb820 0x7f1c080cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c07fff640 1 -- 172.21.15.67:0/2828156318 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c080af510 con 0x7f1c081474e0 2024-09-19T05:33:26.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c07fff640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c081474e0 0x7f1c0806df00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1c000115f0 tx=0x7f1c00011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:26.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c04ff9640 1 -- 172.21.15.67:0/2828156318 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00004220 con 0x7f1c081474e0 2024-09-19T05:33:26.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c04ff9640 1 -- 172.21.15.67:0/2828156318 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c000043c0 con 0x7f1c081474e0 2024-09-19T05:33:26.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c04ff9640 1 -- 172.21.15.67:0/2828156318 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00015890 con 0x7f1c081474e0 2024-09-19T05:33:26.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c0e33b640 1 -- 172.21.15.67:0/2828156318 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c080af7b0 con 0x7f1c081474e0 2024-09-19T05:33:26.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c0e33b640 1 -- 172.21.15.67:0/2828156318 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c080afd70 con 0x7f1c081474e0 2024-09-19T05:33:26.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c0e33b640 1 -- 172.21.15.67:0/2828156318 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c080d0430 con 0x7f1c081474e0 2024-09-19T05:33:26.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c04ff9640 1 -- 172.21.15.67:0/2828156318 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c00015a30 con 0x7f1c081474e0 2024-09-19T05:33:26.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c04ff9640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bf40678f0 0x7f1bf4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c04ff9640 1 -- 172.21.15.67:0/2828156318 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1c000865a0 con 0x7f1c081474e0 2024-09-19T05:33:26.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.230+0000 7f1c077fe640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bf40678f0 0x7f1bf4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.234+0000 7f1c077fe640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bf40678f0 0x7f1bf4069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0b0000 tx=0x7f1bfc007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:26.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.238+0000 7f1c04ff9640 1 -- 172.21.15.67:0/2828156318 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1c00019030 con 0x7f1c081474e0 2024-09-19T05:33:26.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.398+0000 7f1c0e33b640 1 -- 172.21.15.67:0/2828156318 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c080b8220 con 0x7f1c081474e0 2024-09-19T05:33:26.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c04ff9640 1 -- 172.21.15.67:0/2828156318 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f1c00056da0 con 0x7f1c081474e0 2024-09-19T05:33:26.405 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:26.405 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:26.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 -- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bf40678f0 msgr2=0x7f1bf4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bf40678f0 0x7f1bf4069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0b0000 tx=0x7f1bfc007040 comp rx=0 tx=0).stop 2024-09-19T05:33:26.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 -- 172.21.15.67:0/2828156318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c081474e0 msgr2=0x7f1c0806df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c081474e0 0x7f1c0806df00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1c000115f0 tx=0x7f1c00011ab0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 -- 172.21.15.67:0/2828156318 shutdown_connections 2024-09-19T05:33:26.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c080cb820 0x7f1c080cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bf40678f0 0x7f1bf4069db0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c081478c0 0x7f1c0806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 --2- 172.21.15.67:0/2828156318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c081474e0 0x7f1c0806df00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 -- 172.21.15.67:0/2828156318 >> 172.21.15.67:0/2828156318 conn(0x7f1c080b3d90 msgr2=0x7f1c0815efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:26.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 -- 172.21.15.67:0/2828156318 shutdown_connections 2024-09-19T05:33:26.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.402+0000 7f1c0e33b640 1 -- 172.21.15.67:0/2828156318 wait complete. 2024-09-19T05:33:26.426 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:26.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.542+0000 7f7d68cfd640 1 Processor -- start 2024-09-19T05:33:26.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d68cfd640 1 -- start start 2024-09-19T05:33:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d68cfd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415e330 0x7f7d64071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d68cfd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d640b2fd0 0x7f7d640724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d68cfd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d640b4420 con 0x7f7d640b4bc0 2024-09-19T05:33:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d68cfd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7d640acfb0 con 0x7f7d640b2fd0 2024-09-19T05:33:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d68cfd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d640b3ef0 con 0x7f7d6415e330 2024-09-19T05:33:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d62d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7d640b4bc0 0x7f7d64161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34428/0 (socket says 172.21.15.67:34428) 2024-09-19T05:33:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d62d9d640 1 -- 172.21.15.67:0/2604529650 learned_addr learned my addr 172.21.15.67:0/2604529650 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d61d9b640 1 --2- 172.21.15.67:0/2604529650 >> v2:172.21.15.97:3300/0 conn(0x7f7d640b2fd0 0x7f7d640724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6259c640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415e330 0x7f7d64071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725863439 0 0) 0x7f7d640b4420 con 0x7f7d640b4bc0 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d50003530 con 0x7f7d640b4bc0 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1336020656 0 0) 0x7f7d50003530 con 0x7f7d640b4bc0 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415e330 msgr2=0x7f7d64071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415e330 0x7f7d64071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 >> v2:172.21.15.97:3300/0 conn(0x7f7d640b2fd0 msgr2=0x7f7d640724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 --2- 172.21.15.67:0/2604529650 >> v2:172.21.15.97:3300/0 conn(0x7f7d640b2fd0 0x7f7d640724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d640b4140 con 0x7f7d640b4bc0 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7d5c001680 con 0x7f7d640b4bc0 2024-09-19T05:33:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 >> v1:172.21.15.67:6789/0 conn(0x7f7d640b4bc0 legacy=0x7f7d64161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415e330 0x7f7d500039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 0x7f7d50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d50004d50 0x7f7d500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7d640b3ef0 con 0x7f7d50003f40 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5000b9d0 con 0x7f7d50004d50 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d5000bb50 con 0x7f7d6415e330 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d61d9b640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 0x7f7d50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d6259c640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415e330 0x7f7d500039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d62d9d640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d50004d50 0x7f7d500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d61d9b640 1 -- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415e330 msgr2=0x7f7d500039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d61d9b640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415e330 0x7f7d500039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d61d9b640 1 -- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d50004d50 msgr2=0x7f7d500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d61d9b640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d50004d50 0x7f7d500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.546+0000 7f7d61d9b640 1 -- 172.21.15.67:0/2604529650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d50003530 con 0x7f7d50003f40 2024-09-19T05:33:26.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d61d9b640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 0x7f7d50004810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d640af6a0 tx=0x7f7d4c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3b88c414332b80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:26.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0b2070 con 0x7f7d50003f40 2024-09-19T05:33:26.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0a5510 con 0x7f7d50003f40 2024-09-19T05:33:26.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d6159a640 1 -- 172.21.15.67:0/2604529650 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0096b0 con 0x7f7d50003f40 2024-09-19T05:33:26.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d68cfd640 1 -- 172.21.15.67:0/2604529650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 msgr2=0x7f7d50004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d68cfd640 1 --2- 172.21.15.67:0/2604529650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 0x7f7d50004810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d640af6a0 tx=0x7f7d4c01c9d0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d62d9d640 1 -- 172.21.15.67:0/2604529650 reap_dead start 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d68cfd640 1 -- 172.21.15.67:0/2604529650 shutdown_connections 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d68cfd640 1 -- 172.21.15.67:0/2604529650 >> 172.21.15.67:0/2604529650 conn(0x7f7d640d0080 msgr2=0x7f7d640d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d68cfd640 1 -- 172.21.15.67:0/2604529650 shutdown_connections 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d68cfd640 1 -- 172.21.15.67:0/2604529650 wait complete. 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d68cfd640 1 Processor -- start 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.550+0000 7f7d68cfd640 1 -- start start 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d68cfd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 0x7f7d640adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d68cfd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d640ae5f0 0x7f7d6409d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d68cfd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415cc90 0x7f7d640b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d68cfd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6415e710 con 0x7f7d50003f40 2024-09-19T05:33:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d68cfd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6406e1d0 con 0x7f7d640ae5f0 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d68cfd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6406f700 con 0x7f7d6415cc90 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d6259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 0x7f7d640adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d6259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 0x7f7d640adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34258/0 (socket says 172.21.15.67:34258) 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d6259c640 1 -- 172.21.15.67:0/188873683 learned_addr learned my addr 172.21.15.67:0/188873683 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d61d9b640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d640ae5f0 0x7f7d6409d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d62d9d640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415cc90 0x7f7d640b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d6259c640 1 -- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415cc90 msgr2=0x7f7d640b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d6259c640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415cc90 0x7f7d640b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d6259c640 1 -- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d640ae5f0 msgr2=0x7f7d6409d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d6259c640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d640ae5f0 0x7f7d6409d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d6259c640 1 -- 172.21.15.67:0/188873683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6409cc20 con 0x7f7d50003f40 2024-09-19T05:33:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d62d9d640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415cc90 0x7f7d640b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d6259c640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 0x7f7d640adc00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d54007f30 tx=0x7f7d54011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d5affd640 1 -- 172.21.15.67:0/188873683 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5401a020 con 0x7f7d50003f40 2024-09-19T05:33:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d5affd640 1 -- 172.21.15.67:0/188873683 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d54016470 con 0x7f7d50003f40 2024-09-19T05:33:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d5affd640 1 -- 172.21.15.67:0/188873683 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54016860 con 0x7f7d50003f40 2024-09-19T05:33:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d68cfd640 1 -- 172.21.15.67:0/188873683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6409cec0 con 0x7f7d50003f40 2024-09-19T05:33:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d68cfd640 1 -- 172.21.15.67:0/188873683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d640aea50 con 0x7f7d50003f40 2024-09-19T05:33:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d68cfd640 1 -- 172.21.15.67:0/188873683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d640cfcc0 con 0x7f7d50003f40 2024-09-19T05:33:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d5affd640 1 -- 172.21.15.67:0/188873683 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d5401d020 con 0x7f7d50003f40 2024-09-19T05:33:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d5affd640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d440678c0 0x7f7d44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.554+0000 7f7d5affd640 1 -- 172.21.15.67:0/188873683 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7d54086d60 con 0x7f7d50003f40 2024-09-19T05:33:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.558+0000 7f7d61d9b640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d440678c0 0x7f7d44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.558+0000 7f7d61d9b640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d440678c0 0x7f7d44069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0af000 tx=0x7f7d4c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.562+0000 7f7d5affd640 1 -- 172.21.15.67:0/188873683 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7d54024030 con 0x7f7d50003f40 2024-09-19T05:33:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.726+0000 7f7d68cfd640 1 -- 172.21.15.67:0/188873683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d640b1a90 con 0x7f7d50003f40 2024-09-19T05:33:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d5affd640 1 -- 172.21.15.67:0/188873683 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f7d54057560 con 0x7f7d50003f40 2024-09-19T05:33:26.733 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:26.733 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:26.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 -- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d440678c0 msgr2=0x7f7d44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d440678c0 0x7f7d44069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0af000 tx=0x7f7d4c0046d0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 -- 172.21.15.67:0/188873683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 msgr2=0x7f7d640adc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 0x7f7d640adc00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d54007f30 tx=0x7f7d54011660 comp rx=0 tx=0).stop 2024-09-19T05:33:26.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 -- 172.21.15.67:0/188873683 shutdown_connections 2024-09-19T05:33:26.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d440678c0 0x7f7d44069d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d6415cc90 0x7f7d640b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d640ae5f0 0x7f7d6409d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 --2- 172.21.15.67:0/188873683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d50003f40 0x7f7d640adc00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 -- 172.21.15.67:0/188873683 >> 172.21.15.67:0/188873683 conn(0x7f7d640d0080 msgr2=0x7f7d6415ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:26.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 -- 172.21.15.67:0/188873683 shutdown_connections 2024-09-19T05:33:26.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.730+0000 7f7d68cfd640 1 -- 172.21.15.67:0/188873683 wait complete. 2024-09-19T05:33:26.751 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:33:26.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.866+0000 7f001f3fb640 1 Processor -- start 2024-09-19T05:33:26.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.866+0000 7f001f3fb640 1 -- start start 2024-09-19T05:33:26.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.866+0000 7f001f3fb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d4fb0 0x7f00180d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.866+0000 7f001f3fb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00180d13c0 0x7f001806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.866+0000 7f001f3fb640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00180d35a0 con 0x7f001815e690 2024-09-19T05:33:26.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.866+0000 7f001f3fb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f00180d32c0 con 0x7f00180d13c0 2024-09-19T05:33:26.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.866+0000 7f001f3fb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f001806d040 con 0x7f00180d4fb0 2024-09-19T05:33:26.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001d197640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f001815e690 0x7f00180d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34432/0 (socket says 172.21.15.67:34432) 2024-09-19T05:33:26.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001d998640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00180d13c0 0x7f001806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001d197640 1 -- 172.21.15.67:0/3982552532 learned_addr learned my addr 172.21.15.67:0/3982552532 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:26.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001c996640 1 --2- 172.21.15.67:0/3982552532 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d4fb0 0x7f00180d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f000ffff640 1 -- 172.21.15.67:0/3982552532 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311223791 0 0) 0x7f00180d35a0 con 0x7f001815e690 2024-09-19T05:33:26.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f000ffff640 1 -- 172.21.15.67:0/3982552532 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0004003530 con 0x7f001815e690 2024-09-19T05:33:26.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001d998640 1 -- 172.21.15.67:0/3982552532 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d4fb0 msgr2=0x7f00180d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:26.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001d998640 1 --2- 172.21.15.67:0/3982552532 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d4fb0 0x7f00180d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001d998640 1 -- 172.21.15.67:0/3982552532 >> v1:172.21.15.67:6789/0 conn(0x7f001815e690 legacy=0x7f00180d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001d998640 1 -- 172.21.15.67:0/3982552532 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001806d320 con 0x7f00180d13c0 2024-09-19T05:33:26.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001d998640 1 --2- 172.21.15.67:0/3982552532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d13c0 0x7f001806db20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0010009d90 tx=0x7f001001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782654285826d0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:26.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f000ffff640 1 -- 172.21.15.67:0/3982552532 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00100b2070 con 0x7f00180d13c0 2024-09-19T05:33:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f000ffff640 1 -- 172.21.15.67:0/3982552532 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00100a58c0 con 0x7f00180d13c0 2024-09-19T05:33:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f000ffff640 1 -- 172.21.15.67:0/3982552532 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00100a5c70 con 0x7f00180d13c0 2024-09-19T05:33:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001f3fb640 1 -- 172.21.15.67:0/3982552532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d13c0 msgr2=0x7f001806db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001f3fb640 1 --2- 172.21.15.67:0/3982552532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d13c0 0x7f001806db20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0010009d90 tx=0x7f001001c970 comp rx=0 tx=0).stop 2024-09-19T05:33:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001f3fb640 1 -- 172.21.15.67:0/3982552532 shutdown_connections 2024-09-19T05:33:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001f3fb640 1 --2- 172.21.15.67:0/3982552532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d13c0 0x7f001806db20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001f3fb640 1 --2- 172.21.15.67:0/3982552532 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d4fb0 0x7f00180d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001f3fb640 1 -- 172.21.15.67:0/3982552532 >> 172.21.15.67:0/3982552532 conn(0x7f00180d4490 msgr2=0x7f00180d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001f3fb640 1 -- 172.21.15.67:0/3982552532 shutdown_connections 2024-09-19T05:33:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.870+0000 7f001f3fb640 1 -- 172.21.15.67:0/3982552532 wait complete. 2024-09-19T05:33:26.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 Processor -- start 2024-09-19T05:33:26.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 -- start start 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d13c0 0x7f0018154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d4fb0 0x7f00181547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f001815e690 0x7f00180b9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f001806ec00 con 0x7f00180d4fb0 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f001806ea80 con 0x7f001815e690 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f001816b250 con 0x7f00180d13c0 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001c996640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d4fb0 0x7f00181547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001c996640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d4fb0 0x7f00181547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34288/0 (socket says 172.21.15.67:34288) 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001c996640 1 -- 172.21.15.67:0/23236250 learned_addr learned my addr 172.21.15.67:0/23236250 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001d998640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f001815e690 0x7f00180b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001d197640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d13c0 0x7f0018154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001c996640 1 -- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d13c0 msgr2=0x7f0018154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001c996640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d13c0 0x7f0018154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001c996640 1 -- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f001815e690 msgr2=0x7f00180b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001c996640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f001815e690 0x7f00180b9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001c996640 1 -- 172.21.15.67:0/23236250 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0018156500 con 0x7f00180d4fb0 2024-09-19T05:33:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001d197640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d13c0 0x7f0018154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001c996640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d4fb0 0x7f00181547b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f000800d800 tx=0x7f000800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f000dffb640 1 -- 172.21.15.67:0/23236250 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000800b6c0 con 0x7f00180d4fb0 2024-09-19T05:33:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f000dffb640 1 -- 172.21.15.67:0/23236250 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0008019070 con 0x7f00180d4fb0 2024-09-19T05:33:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f000dffb640 1 -- 172.21.15.67:0/23236250 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000800ba60 con 0x7f00180d4fb0 2024-09-19T05:33:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 -- 172.21.15.67:0/23236250 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0018156770 con 0x7f00180d4fb0 2024-09-19T05:33:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 -- 172.21.15.67:0/23236250 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00180b7fb0 con 0x7f00180d4fb0 2024-09-19T05:33:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.874+0000 7f001f3fb640 1 -- 172.21.15.67:0/23236250 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001806db20 con 0x7f00180d4fb0 2024-09-19T05:33:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.878+0000 7f000dffb640 1 -- 172.21.15.67:0/23236250 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f000800bc00 con 0x7f00180d4fb0 2024-09-19T05:33:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.878+0000 7f000dffb640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efffc0678c0 0x7efffc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.878+0000 7f000dffb640 1 -- 172.21.15.67:0/23236250 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0008086490 con 0x7f00180d4fb0 2024-09-19T05:33:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.878+0000 7f001d197640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efffc0678c0 0x7efffc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.878+0000 7f001d197640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efffc0678c0 0x7efffc069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0014005890 tx=0x7f0014009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:26.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:26.882+0000 7f000dffb640 1 -- 172.21.15.67:0/23236250 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0008056c90 con 0x7f00180d4fb0 2024-09-19T05:33:27.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.070+0000 7f001f3fb640 1 -- 172.21.15.67:0/23236250 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f001815b3c0 con 0x7f00180d4fb0 2024-09-19T05:33:27.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.170+0000 7f000dffb640 1 -- 172.21.15.67:0/23236250 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f0008056590 con 0x7f00180d4fb0 2024-09-19T05:33:27.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 -- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efffc0678c0 msgr2=0x7efffc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:27.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efffc0678c0 0x7efffc069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0014005890 tx=0x7f0014009040 comp rx=0 tx=0).stop 2024-09-19T05:33:27.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 -- 172.21.15.67:0/23236250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d4fb0 msgr2=0x7f00181547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:27.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d4fb0 0x7f00181547b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f000800d800 tx=0x7f000800dcc0 comp rx=0 tx=0).stop 2024-09-19T05:33:27.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 -- 172.21.15.67:0/23236250 shutdown_connections 2024-09-19T05:33:27.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f001815e690 0x7f00180b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:27.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00180d4fb0 0x7f00181547b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:27.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efffc0678c0 0x7efffc069d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:27.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 --2- 172.21.15.67:0/23236250 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00180d13c0 0x7f0018154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:27.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 -- 172.21.15.67:0/23236250 >> 172.21.15.67:0/23236250 conn(0x7f00180d4490 msgr2=0x7f001815d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:27.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 -- 172.21.15.67:0/23236250 shutdown_connections 2024-09-19T05:33:27.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.174+0000 7f001f3fb640 1 -- 172.21.15.67:0/23236250 wait complete. 2024-09-19T05:33:27.195 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-19T05:33:27.195 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:33:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f7074640 1 Processor -- start 2024-09-19T05:33:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f7074640 1 -- start start 2024-09-19T05:33:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f7074640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f006dfc0 0x7f13f0071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f7074640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f13f00724a0 0x7f13f00b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f7074640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13f006e540 con 0x7f13f00cf9c0 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f7074640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f13f00728d0 con 0x7f13f00724a0 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f7074640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f13f006e820 con 0x7f13f006dfc0 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f5611640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f13f00724a0 0x7f13f00b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13effff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f006dfc0 0x7f13f0071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f5611640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f13f00724a0 0x7f13f00b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:45892/0 (socket says 172.21.15.67:45892) 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f5611640 1 -- 172.21.15.67:0/1373688611 learned_addr learned my addr 172.21.15.67:0/1373688611 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f4e10640 1 --1- 172.21.15.67:0/1373688611 >> v1:172.21.15.97:6789/0 conn(0x7f13f00cf9c0 0x7f13f015f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:47826/0 (socket says 172.21.15.67:47826) 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f5611640 1 -- 172.21.15.67:0/1373688611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f006dfc0 msgr2=0x7f13f0071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:27.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f5611640 1 --2- 172.21.15.67:0/1373688611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f006dfc0 0x7f13f0071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f5611640 1 -- 172.21.15.67:0/1373688611 >> v1:172.21.15.97:6789/0 conn(0x7f13f00cf9c0 legacy=0x7f13f015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.322+0000 7f13f5611640 1 -- 172.21.15.67:0/1373688611 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f006eb00 con 0x7f13f00724a0 2024-09-19T05:33:27.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13f5611640 1 --2- 172.21.15.67:0/1373688611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13f00724a0 0x7f13f00b3250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009870 tx=0x7f13e801c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af8a85d520896fd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:27.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13ef7fe640 1 -- 172.21.15.67:0/1373688611 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e80a95f0 con 0x7f13f00724a0 2024-09-19T05:33:27.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13ef7fe640 1 -- 172.21.15.67:0/1373688611 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e80a9790 con 0x7f13f00724a0 2024-09-19T05:33:27.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13ef7fe640 1 -- 172.21.15.67:0/1373688611 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e80a9b60 con 0x7f13f00724a0 2024-09-19T05:33:27.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13f7074640 1 -- 172.21.15.67:0/1373688611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13f00724a0 msgr2=0x7f13f00b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:27.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13f7074640 1 --2- 172.21.15.67:0/1373688611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13f00724a0 0x7f13f00b3250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009870 tx=0x7f13e801c530 comp rx=0 tx=0).stop 2024-09-19T05:33:27.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13f7074640 1 -- 172.21.15.67:0/1373688611 shutdown_connections 2024-09-19T05:33:27.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13f7074640 1 --2- 172.21.15.67:0/1373688611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13f00724a0 0x7f13f00b3250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:27.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13f7074640 1 --2- 172.21.15.67:0/1373688611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f006dfc0 0x7f13f0071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:27.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13f7074640 1 -- 172.21.15.67:0/1373688611 >> 172.21.15.67:0/1373688611 conn(0x7f13f00b1e50 msgr2=0x7f13f00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:27.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13f7074640 1 -- 172.21.15.67:0/1373688611 shutdown_connections 2024-09-19T05:33:27.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.326+0000 7f13f7074640 1 -- 172.21.15.67:0/1373688611 wait complete. 2024-09-19T05:33:27.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 Processor -- start 2024-09-19T05:33:27.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 -- start start 2024-09-19T05:33:27.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f006dfc0 0x7f13f0151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:27.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f00724a0 0x7f13f014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:27.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13f00cf9c0 0x7f13f014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:27.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f13f00b4120 con 0x7f13f006dfc0 2024-09-19T05:33:27.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f13f00b3fa0 con 0x7f13f00cf9c0 2024-09-19T05:33:27.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f13f00b42a0 con 0x7f13f00724a0 2024-09-19T05:33:27.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f4e10640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f006dfc0 0x7f13f0151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:27.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f4e10640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f006dfc0 0x7f13f0151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34302/0 (socket says 172.21.15.67:34302) 2024-09-19T05:33:27.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f4e10640 1 -- 172.21.15.67:0/2525919300 learned_addr learned my addr 172.21.15.67:0/2525919300 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:27.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f5611640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13f00cf9c0 0x7f13f014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:27.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13effff640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f00724a0 0x7f13f014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:27.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f4e10640 1 -- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f00724a0 msgr2=0x7f13f014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:27.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f4e10640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f00724a0 0x7f13f014f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:27.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f4e10640 1 -- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13f00cf9c0 msgr2=0x7f13f014f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:27.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f4e10640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13f00cf9c0 0x7f13f014f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:27.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f4e10640 1 -- 172.21.15.67:0/2525919300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f009c7c0 con 0x7f13f006dfc0 2024-09-19T05:33:27.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13effff640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f00724a0 0x7f13f014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:27.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f4e10640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f006dfc0 0x7f13f0151850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f13e000c790 tx=0x7f13e000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:27.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13ed7fa640 1 -- 172.21.15.67:0/2525919300 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0017070 con 0x7f13f006dfc0 2024-09-19T05:33:27.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13ed7fa640 1 -- 172.21.15.67:0/2525919300 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e000a640 con 0x7f13f006dfc0 2024-09-19T05:33:27.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13ed7fa640 1 -- 172.21.15.67:0/2525919300 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e000a9f0 con 0x7f13f006dfc0 2024-09-19T05:33:27.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 -- 172.21.15.67:0/2525919300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f009a2b0 con 0x7f13f006dfc0 2024-09-19T05:33:27.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 -- 172.21.15.67:0/2525919300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f009cd10 con 0x7f13f006dfc0 2024-09-19T05:33:27.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.330+0000 7f13f7074640 1 -- 172.21.15.67:0/2525919300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f0071f60 con 0x7f13f006dfc0 2024-09-19T05:33:27.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.334+0000 7f13ed7fa640 1 -- 172.21.15.67:0/2525919300 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f13e001a070 con 0x7f13f006dfc0 2024-09-19T05:33:27.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.334+0000 7f13ed7fa640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13dc0678c0 0x7f13dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:27.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.334+0000 7f13ed7fa640 1 -- 172.21.15.67:0/2525919300 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f13e0085550 con 0x7f13f006dfc0 2024-09-19T05:33:27.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.334+0000 7f13effff640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13dc0678c0 0x7f13dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:27.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.334+0000 7f13effff640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13dc0678c0 0x7f13dc069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009a40 tx=0x7f13e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:27.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.338+0000 7f13ed7fa640 1 -- 172.21.15.67:0/2525919300 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f13e0055710 con 0x7f13f006dfc0 2024-09-19T05:33:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:27.550+0000 7f13f7074640 1 -- 172.21.15.67:0/2525919300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f13f01562f0 con 0x7f13f006dfc0 2024-09-19T05:33:28.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.178+0000 7f13ed7fa640 1 -- 172.21.15.67:0/2525919300 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f13e0059a10 con 0x7f13f006dfc0 2024-09-19T05:33:28.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 -- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13dc0678c0 msgr2=0x7f13dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13dc0678c0 0x7f13dc069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009a40 tx=0x7f13e4008040 comp rx=0 tx=0).stop 2024-09-19T05:33:28.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 -- 172.21.15.67:0/2525919300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f006dfc0 msgr2=0x7f13f0151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f006dfc0 0x7f13f0151850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f13e000c790 tx=0x7f13e000cc50 comp rx=0 tx=0).stop 2024-09-19T05:33:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 -- 172.21.15.67:0/2525919300 shutdown_connections 2024-09-19T05:33:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13f00cf9c0 0x7f13f014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13dc0678c0 0x7f13dc069d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13f00724a0 0x7f13f014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 --2- 172.21.15.67:0/2525919300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13f006dfc0 0x7f13f0151850 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 -- 172.21.15.67:0/2525919300 >> 172.21.15.67:0/2525919300 conn(0x7f13f00b1e50 msgr2=0x7f13f00ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 -- 172.21.15.67:0/2525919300 shutdown_connections 2024-09-19T05:33:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.182+0000 7f13f7074640 1 -- 172.21.15.67:0/2525919300 wait complete. 2024-09-19T05:33:28.204 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:33:28.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:28.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9edb482640 1 Processor -- start 2024-09-19T05:33:28.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9edb482640 1 -- start start 2024-09-19T05:33:28.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9edb482640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ed40d1590 0x7f9ed40d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9edb482640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed40d4d40 con 0x7f9ed40b51d0 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9edb482640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed40d5020 con 0x7f9ed4161da0 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9edb482640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed40d0840 con 0x7f9ed40d1590 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed9a1f640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9ed40b51d0 0x7f9ed40cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34448/0 (socket says 172.21.15.67:34448) 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed9a1f640 1 -- 172.21.15.67:0/2853133751 learned_addr learned my addr 172.21.15.67:0/2853133751 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed8a1d640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ed40d1590 0x7f9ed40d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832398390 0 0) 0x7f9ed40d4d40 con 0x7f9ed40b51d0 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ebc003530 con 0x7f9ed40b51d0 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2286004964 0 0) 0x7f9ebc003530 con 0x7f9ed40b51d0 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ed40d1590 msgr2=0x7f9ed40d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ed40d1590 0x7f9ed40d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 >> v1:172.21.15.97:6789/0 conn(0x7f9ed4161da0 legacy=0x7f9ed40d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed40d5300 con 0x7f9ed40b51d0 2024-09-19T05:33:28.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9ec4001680 con 0x7f9ed40b51d0 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed8a1d640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ed40d1590 0x7f9ed40d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 >> v1:172.21.15.67:6789/0 conn(0x7f9ed40b51d0 legacy=0x7f9ed40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ebc0039f0 0x7f9ebc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ebc004810 0x7f9ebc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ed40d1590 0x7f9ebc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed40d0840 con 0x7f9ebc004810 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9ebc00bb00 con 0x7f9ebc0039f0 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9ebc00bd00 con 0x7f9ed40d1590 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed8a1d640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ebc004810 0x7f9ebc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed921e640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ebc0039f0 0x7f9ebc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed9a1f640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ed40d1590 0x7f9ebc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed8a1d640 1 -- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ed40d1590 msgr2=0x7f9ebc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:28.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed8a1d640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ed40d1590 0x7f9ebc0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed8a1d640 1 -- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ebc0039f0 msgr2=0x7f9ebc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:28.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed8a1d640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ebc0039f0 0x7f9ebc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.326+0000 7f9ed8a1d640 1 -- 172.21.15.67:0/2853133751 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ebc003530 con 0x7f9ebc004810 2024-09-19T05:33:28.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9ed8a1d640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ebc004810 0x7f9ebc004c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80073e0 tx=0x7f9ec801cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27cca553b9c230c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:28.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80b2070 con 0x7f9ebc004810 2024-09-19T05:33:28.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec80a5ce0 con 0x7f9ebc004810 2024-09-19T05:33:28.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9ed3fff640 1 -- 172.21.15.67:0/2853133751 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8009c80 con 0x7f9ebc004810 2024-09-19T05:33:28.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9edb482640 1 -- 172.21.15.67:0/2853133751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ebc004810 msgr2=0x7f9ebc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9edb482640 1 --2- 172.21.15.67:0/2853133751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ebc004810 0x7f9ebc004c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80073e0 tx=0x7f9ec801cec0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9ed9a1f640 1 -- 172.21.15.67:0/2853133751 reap_dead start 2024-09-19T05:33:28.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9edb482640 1 -- 172.21.15.67:0/2853133751 shutdown_connections 2024-09-19T05:33:28.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9edb482640 1 -- 172.21.15.67:0/2853133751 >> 172.21.15.67:0/2853133751 conn(0x7f9ed408bfc0 msgr2=0x7f9ed40d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:28.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9edb482640 1 -- 172.21.15.67:0/2853133751 shutdown_connections 2024-09-19T05:33:28.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9edb482640 1 -- 172.21.15.67:0/2853133751 wait complete. 2024-09-19T05:33:28.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9edb482640 1 Processor -- start 2024-09-19T05:33:28.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.330+0000 7f9edb482640 1 -- start start 2024-09-19T05:33:28.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9edb482640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ebc004810 0x7f9ed415e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9edb482640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ed40b9fb0 0x7f9ed414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9edb482640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ed40b88a0 0x7f9ed40b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9edb482640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed4162180 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9edb482640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed40b5d00 con 0x7f9ed40b88a0 2024-09-19T05:33:28.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9edb482640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed40d1af0 con 0x7f9ebc004810 2024-09-19T05:33:28.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed8a1d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ed40b9fb0 0x7f9ed414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed8a1d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ed40b9fb0 0x7f9ed414d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34320/0 (socket says 172.21.15.67:34320) 2024-09-19T05:33:28.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed8a1d640 1 -- 172.21.15.67:0/1312980515 learned_addr learned my addr 172.21.15.67:0/1312980515 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:28.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed921e640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ebc004810 0x7f9ed415e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed9a1f640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ed40b88a0 0x7f9ed40b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed8a1d640 1 -- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ebc004810 msgr2=0x7f9ed415e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed8a1d640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ebc004810 0x7f9ed415e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed8a1d640 1 -- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ed40b88a0 msgr2=0x7f9ed40b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed8a1d640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ed40b88a0 0x7f9ed40b8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed8a1d640 1 -- 172.21.15.67:0/1312980515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed40b2830 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed8a1d640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ed40b9fb0 0x7f9ed414d840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80073e0 tx=0x7f9ebc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:28.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed1ffb640 1 -- 172.21.15.67:0/1312980515 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80b2040 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed1ffb640 1 -- 172.21.15.67:0/1312980515 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec80adae0 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9edb482640 1 -- 172.21.15.67:0/1312980515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed40b2b10 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed1ffb640 1 -- 172.21.15.67:0/1312980515 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8009c80 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9edb482640 1 -- 172.21.15.67:0/1312980515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed40b9a90 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9edb482640 1 -- 172.21.15.67:0/1312980515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed40d0e80 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed1ffb640 1 -- 172.21.15.67:0/1312980515 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ec80bf060 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed1ffb640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ec00678f0 0x7f9ec0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed1ffb640 1 -- 172.21.15.67:0/1312980515 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9ec811fe90 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.334+0000 7f9ed921e640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ec00678f0 0x7f9ec0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.338+0000 7f9ed921e640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ec00678f0 0x7f9ec0069db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc005510 tx=0x7f9ecc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:28.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.338+0000 7f9ed1ffb640 1 -- 172.21.15.67:0/1312980515 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9ec8016bd0 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.534+0000 7f9edb482640 1 -- 172.21.15.67:0/1312980515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ed406d9c0 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.534+0000 7f9ed1ffb640 1 -- 172.21.15.67:0/1312980515 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7f9ec80f05f0 con 0x7f9ed40b9fb0 2024-09-19T05:33:28.539 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:28.539 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"btime":"2024-09-19T05:33:28:174068+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:33:13.876770+0000","modified":"2024-09-19T05:33:27.556615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-19T05:33:28.539 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-09-19T05:33:28.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 -- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ec00678f0 msgr2=0x7f9ec0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ec00678f0 0x7f9ec0069db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc005510 tx=0x7f9ecc009040 comp rx=0 tx=0).stop 2024-09-19T05:33:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 -- 172.21.15.67:0/1312980515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ed40b9fb0 msgr2=0x7f9ed414d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ed40b9fb0 0x7f9ed414d840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80073e0 tx=0x7f9ebc005840 comp rx=0 tx=0).stop 2024-09-19T05:33:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 -- 172.21.15.67:0/1312980515 shutdown_connections 2024-09-19T05:33:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ed40b88a0 0x7f9ed40b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ed40b9fb0 0x7f9ed414d840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ec00678f0 0x7f9ec0069db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 --2- 172.21.15.67:0/1312980515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ebc004810 0x7f9ed415e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 -- 172.21.15.67:0/1312980515 >> 172.21.15.67:0/1312980515 conn(0x7f9ed408bfc0 msgr2=0x7f9ed406e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 -- 172.21.15.67:0/1312980515 shutdown_connections 2024-09-19T05:33:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.538+0000 7f9edb482640 1 -- 172.21.15.67:0/1312980515 wait complete. 2024-09-19T05:33:28.557 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa11c1a4640 1 Processor -- start 2024-09-19T05:33:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa11c1a4640 1 -- start start 2024-09-19T05:33:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa11c1a4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa11415c030 0x7fa11406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa11c1a4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa11415d1d0 0x7fa1140b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa11c1a4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa11406e3c0 con 0x7fa1140b3510 2024-09-19T05:33:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa11c1a4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa11406e6a0 con 0x7fa11415c030 2024-09-19T05:33:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa11c1a4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa11406e980 con 0x7fa11415d1d0 2024-09-19T05:33:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa119f40640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa11415c030 0x7fa11406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa119f40640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa11415c030 0x7fa11406dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34324/0 (socket says 172.21.15.67:34324) 2024-09-19T05:33:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa119f40640 1 -- 172.21.15.67:0/1220318073 learned_addr learned my addr 172.21.15.67:0/1220318073 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa11973f640 1 --2- 172.21.15.67:0/1220318073 >> v2:172.21.15.97:3300/0 conn(0x7fa11415d1d0 0x7fa1140b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa119f40640 1 -- 172.21.15.67:0/1220318073 >> v2:172.21.15.97:3300/0 conn(0x7fa11415d1d0 msgr2=0x7fa1140b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa119f40640 1 --2- 172.21.15.67:0/1220318073 >> v2:172.21.15.97:3300/0 conn(0x7fa11415d1d0 0x7fa1140b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa119f40640 1 -- 172.21.15.67:0/1220318073 >> v1:172.21.15.97:6789/0 conn(0x7fa1140b3510 legacy=0x7fa11406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa119f40640 1 -- 172.21.15.67:0/1220318073 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11406ec60 con 0x7fa11415c030 2024-09-19T05:33:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.678+0000 7fa11973f640 1 --2- 172.21.15.67:0/1220318073 >> v2:172.21.15.97:3300/0 conn(0x7fa11415d1d0 0x7fa1140b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa119f40640 1 --2- 172.21.15.67:0/1220318073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11415c030 0x7fa11406dde0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa1140add20 tx=0x7fa11001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fbf2be5e0cb247 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa118f3e640 1 -- 172.21.15.67:0/1220318073 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100ab610 con 0x7fa11415c030 2024-09-19T05:33:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa118f3e640 1 -- 172.21.15.67:0/1220318073 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1100b0070 con 0x7fa11415c030 2024-09-19T05:33:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa118f3e640 1 -- 172.21.15.67:0/1220318073 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100ab9d0 con 0x7fa11415c030 2024-09-19T05:33:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa11c1a4640 1 -- 172.21.15.67:0/1220318073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11415c030 msgr2=0x7fa11406dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa11c1a4640 1 --2- 172.21.15.67:0/1220318073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11415c030 0x7fa11406dde0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa1140add20 tx=0x7fa11001c4f0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa11c1a4640 1 -- 172.21.15.67:0/1220318073 shutdown_connections 2024-09-19T05:33:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa11c1a4640 1 --2- 172.21.15.67:0/1220318073 >> v2:172.21.15.97:3300/0 conn(0x7fa11415d1d0 0x7fa1140b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa11c1a4640 1 --2- 172.21.15.67:0/1220318073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11415c030 0x7fa11406dde0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa11c1a4640 1 -- 172.21.15.67:0/1220318073 >> 172.21.15.67:0/1220318073 conn(0x7fa1140d0080 msgr2=0x7fa1140d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa11c1a4640 1 -- 172.21.15.67:0/1220318073 shutdown_connections 2024-09-19T05:33:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.682+0000 7fa11c1a4640 1 -- 172.21.15.67:0/1220318073 wait complete. 2024-09-19T05:33:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 Processor -- start 2024-09-19T05:33:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 -- start start 2024-09-19T05:33:28.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1140b3510 0x7fa114099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11415c030 0x7fa1141583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa11415d1d0 0x7fa1141588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa11415c590 con 0x7fa1140b3510 2024-09-19T05:33:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa11415c410 con 0x7fa11415d1d0 2024-09-19T05:33:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa1141690e0 con 0x7fa11415c030 2024-09-19T05:33:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa119f40640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1140b3510 0x7fa114099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa119f40640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1140b3510 0x7fa114099870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34338/0 (socket says 172.21.15.67:34338) 2024-09-19T05:33:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa119f40640 1 -- 172.21.15.67:0/2568294127 learned_addr learned my addr 172.21.15.67:0/2568294127 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11973f640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11415c030 0x7fa1141583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11a741640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa11415d1d0 0x7fa1141588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa119f40640 1 -- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11415c030 msgr2=0x7fa1141583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa119f40640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11415c030 0x7fa1141583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa119f40640 1 -- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa11415d1d0 msgr2=0x7fa1141588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa119f40640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa11415d1d0 0x7fa1141588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa119f40640 1 -- 172.21.15.67:0/2568294127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa114164eb0 con 0x7fa1140b3510 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11973f640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11415c030 0x7fa1141583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa119f40640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1140b3510 0x7fa114099870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa1100ad040 tx=0x7fa11001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa10a7fc640 1 -- 172.21.15.67:0/2568294127 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100be5f0 con 0x7fa1140b3510 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa10a7fc640 1 -- 172.21.15.67:0/2568294127 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1100be790 con 0x7fa1140b3510 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa10a7fc640 1 -- 172.21.15.67:0/2568294127 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100beb60 con 0x7fa1140b3510 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 -- 172.21.15.67:0/2568294127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa114165190 con 0x7fa1140b3510 2024-09-19T05:33:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 -- 172.21.15.67:0/2568294127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa114165750 con 0x7fa1140b3510 2024-09-19T05:33:28.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.686+0000 7fa11c1a4640 1 -- 172.21.15.67:0/2568294127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11406dde0 con 0x7fa1140b3510 2024-09-19T05:33:28.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.690+0000 7fa10a7fc640 1 -- 172.21.15.67:0/2568294127 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1100b43f0 con 0x7fa1140b3510 2024-09-19T05:33:28.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.690+0000 7fa10a7fc640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0f80678f0 0x7fa0f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:28.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.690+0000 7fa10a7fc640 1 -- 172.21.15.67:0/2568294127 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa110120b20 con 0x7fa1140b3510 2024-09-19T05:33:28.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.690+0000 7fa11973f640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0f80678f0 0x7fa0f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:28.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.690+0000 7fa11973f640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0f80678f0 0x7fa0f8069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa1140b1240 tx=0x7fa104008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.694+0000 7fa10a7fc640 1 -- 172.21.15.67:0/2568294127 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa1100c4060 con 0x7fa1140b3510 2024-09-19T05:33:28.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.858+0000 7fa11c1a4640 1 -- 172.21.15.67:0/2568294127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1140af650 con 0x7fa1140b3510 2024-09-19T05:33:28.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.858+0000 7fa10a7fc640 1 -- 172.21.15.67:0/2568294127 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7fa1100a8050 con 0x7fa1140b3510 2024-09-19T05:33:28.864 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:28.864 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:28.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 -- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0f80678f0 msgr2=0x7fa0f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0f80678f0 0x7fa0f8069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa1140b1240 tx=0x7fa104008040 comp rx=0 tx=0).stop 2024-09-19T05:33:28.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 -- 172.21.15.67:0/2568294127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1140b3510 msgr2=0x7fa114099870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:28.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1140b3510 0x7fa114099870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa1100ad040 tx=0x7fa11001ad30 comp rx=0 tx=0).stop 2024-09-19T05:33:28.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 -- 172.21.15.67:0/2568294127 shutdown_connections 2024-09-19T05:33:28.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa11415d1d0 0x7fa1141588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0f80678f0 0x7fa0f8069db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11415c030 0x7fa1141583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 --2- 172.21.15.67:0/2568294127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1140b3510 0x7fa114099870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:28.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 -- 172.21.15.67:0/2568294127 >> 172.21.15.67:0/2568294127 conn(0x7fa1140d0080 msgr2=0x7fa1140b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:28.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 -- 172.21.15.67:0/2568294127 shutdown_connections 2024-09-19T05:33:28.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:28.862+0000 7fa11c1a4640 1 -- 172.21.15.67:0/2568294127 wait complete. 2024-09-19T05:33:28.883 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:33:28.884 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:33:29.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb31e0db640 1 Processor -- start 2024-09-19T05:33:29.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb31e0db640 1 -- start start 2024-09-19T05:33:29.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb31e0db640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb318071e80 0x7fb3180af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb31e0db640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3180b3070 con 0x7fb31815c200 2024-09-19T05:33:29.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb31e0db640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3180b32e0 con 0x7fb31815b710 2024-09-19T05:33:29.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb31e0db640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb3180b35c0 con 0x7fb318071e80 2024-09-19T05:33:29.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb316ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb31815c200 0x7fb3180aef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34462/0 (socket says 172.21.15.67:34462) 2024-09-19T05:33:29.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb317fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb318071e80 0x7fb3180af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb316ffd640 1 -- 172.21.15.67:0/2399763743 learned_addr learned my addr 172.21.15.67:0/2399763743 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:29.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb317fff640 1 -- 172.21.15.67:0/2399763743 >> v1:172.21.15.97:6789/0 conn(0x7fb31815b710 legacy=0x7fb31815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb317fff640 1 -- 172.21.15.67:0/2399763743 >> v1:172.21.15.67:6789/0 conn(0x7fb31815c200 legacy=0x7fb3180aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.006+0000 7fb317fff640 1 -- 172.21.15.67:0/2399763743 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3180b38a0 con 0x7fb318071e80 2024-09-19T05:33:29.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb317fff640 1 --2- 172.21.15.67:0/2399763743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb318071e80 0x7fb3180af650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb310009d90 tx=0x7fb31001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349bd5a5f3606d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:29.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb3167fc640 1 -- 172.21.15.67:0/2399763743 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3100b2070 con 0x7fb318071e80 2024-09-19T05:33:29.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb3167fc640 1 -- 172.21.15.67:0/2399763743 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3100a5940 con 0x7fb318071e80 2024-09-19T05:33:29.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb3167fc640 1 -- 172.21.15.67:0/2399763743 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3100a5d10 con 0x7fb318071e80 2024-09-19T05:33:29.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 -- 172.21.15.67:0/2399763743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb318071e80 msgr2=0x7fb3180af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 --2- 172.21.15.67:0/2399763743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb318071e80 0x7fb3180af650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb310009d90 tx=0x7fb31001c970 comp rx=0 tx=0).stop 2024-09-19T05:33:29.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 -- 172.21.15.67:0/2399763743 shutdown_connections 2024-09-19T05:33:29.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 --2- 172.21.15.67:0/2399763743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb318071e80 0x7fb3180af650 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 -- 172.21.15.67:0/2399763743 >> 172.21.15.67:0/2399763743 conn(0x7fb3180d0080 msgr2=0x7fb3180d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:29.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 -- 172.21.15.67:0/2399763743 shutdown_connections 2024-09-19T05:33:29.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 -- 172.21.15.67:0/2399763743 wait complete. 2024-09-19T05:33:29.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 Processor -- start 2024-09-19T05:33:29.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 -- start start 2024-09-19T05:33:29.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb318071e80 0x7fb318169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb31815b710 0x7fb318154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb31815c200 0x7fb3181511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb3180b4c40 con 0x7fb31815b710 2024-09-19T05:33:29.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb3180b4ac0 con 0x7fb318071e80 2024-09-19T05:33:29.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb31e0db640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb3180b4dc0 con 0x7fb31815c200 2024-09-19T05:33:29.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb316ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb31815b710 0x7fb318154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb316ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb31815b710 0x7fb318154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34346/0 (socket says 172.21.15.67:34346) 2024-09-19T05:33:29.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb316ffd640 1 -- 172.21.15.67:0/379312920 learned_addr learned my addr 172.21.15.67:0/379312920 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:29.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb3177fe640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb318071e80 0x7fb318169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.010+0000 7fb317fff640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb31815c200 0x7fb3181511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb316ffd640 1 -- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb31815c200 msgr2=0x7fb3181511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb316ffd640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb31815c200 0x7fb3181511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb316ffd640 1 -- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb318071e80 msgr2=0x7fb318169c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb316ffd640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb318071e80 0x7fb318169c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb316ffd640 1 -- 172.21.15.67:0/379312920 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31816a1a0 con 0x7fb31815b710 2024-09-19T05:33:29.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb316ffd640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb31815b710 0x7fb318154d40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00c400 tx=0x7fb30c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:29.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb2fffff640 1 -- 172.21.15.67:0/379312920 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c017070 con 0x7fb31815b710 2024-09-19T05:33:29.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb2fffff640 1 -- 172.21.15.67:0/379312920 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb30c005cf0 con 0x7fb31815b710 2024-09-19T05:33:29.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb31e0db640 1 -- 172.21.15.67:0/379312920 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb318168ea0 con 0x7fb31815b710 2024-09-19T05:33:29.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb2fffff640 1 -- 172.21.15.67:0/379312920 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0072d0 con 0x7fb31815b710 2024-09-19T05:33:29.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb31e0db640 1 -- 172.21.15.67:0/379312920 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb318169740 con 0x7fb31815b710 2024-09-19T05:33:29.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb31e0db640 1 -- 172.21.15.67:0/379312920 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb31815baf0 con 0x7fb31815b710 2024-09-19T05:33:29.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb2fffff640 1 -- 172.21.15.67:0/379312920 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb30c01a070 con 0x7fb31815b710 2024-09-19T05:33:29.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb2fffff640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3040678f0 0x7fb304069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb2fffff640 1 -- 172.21.15.67:0/379312920 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb30c085250 con 0x7fb31815b710 2024-09-19T05:33:29.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb3177fe640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3040678f0 0x7fb304069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.014+0000 7fb3177fe640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3040678f0 0x7fb304069db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb308000f70 tx=0x7fb308009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.018+0000 7fb2fffff640 1 -- 172.21.15.67:0/379312920 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb30c055400 con 0x7fb31815b710 2024-09-19T05:33:29.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.174+0000 7fb31e0db640 1 -- 172.21.15.67:0/379312920 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3180b5020 con 0x7fb3040678f0 2024-09-19T05:33:29.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.210+0000 7fb2fffff640 1 -- 172.21.15.67:0/379312920 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7fb3180b5020 con 0x7fb3040678f0 2024-09-19T05:33:29.215 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:29.217 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:33:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 -- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3040678f0 msgr2=0x7fb304069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3040678f0 0x7fb304069db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb308000f70 tx=0x7fb308009040 comp rx=0 tx=0).stop 2024-09-19T05:33:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 -- 172.21.15.67:0/379312920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb31815b710 msgr2=0x7fb318154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb31815b710 0x7fb318154d40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00c400 tx=0x7fb30c00c8c0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 -- 172.21.15.67:0/379312920 shutdown_connections 2024-09-19T05:33:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3040678f0 0x7fb304069db0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb31815c200 0x7fb3181511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb31815b710 0x7fb318154d40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 --2- 172.21.15.67:0/379312920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb318071e80 0x7fb318169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 -- 172.21.15.67:0/379312920 >> 172.21.15.67:0/379312920 conn(0x7fb3180d0080 msgr2=0x7fb3180b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 -- 172.21.15.67:0/379312920 shutdown_connections 2024-09-19T05:33:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.214+0000 7fb31e0db640 1 -- 172.21.15.67:0/379312920 wait complete. 2024-09-19T05:33:29.233 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-19T05:33:29.109773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219496,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755224,"statfs":{"total":773094113280,"available":772869349376,"internally_reserved":0,"allocated":3350528,"data_stored":2017900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003683"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123907+0000","last_change":"2024-09-19T05:33:13.530341+0000","last_active":"2024-09-19T05:33:20.123907+0000","last_peered":"2024-09-19T05:33:20.123907+0000","last_clean":"2024-09-19T05:33:20.123907+0000","last_became_active":"2024-09-19T05:33:13.530048+0000","last_became_peered":"2024-09-19T05:33:13.530048+0000","last_unstale":"2024-09-19T05:33:20.123907+0000","last_undegraded":"2024-09-19T05:33:20.123907+0000","last_fullsized":"2024-09-19T05:33:20.123907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:42.052958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007572+0000","last_change":"2024-09-19T05:33:14.561113+0000","last_active":"2024-09-19T05:33:20.007572+0000","last_peered":"2024-09-19T05:33:20.007572+0000","last_clean":"2024-09-19T05:33:20.007572+0000","last_became_active":"2024-09-19T05:33:14.560582+0000","last_became_peered":"2024-09-19T05:33:14.560582+0000","last_unstale":"2024-09-19T05:33:20.007572+0000","last_undegraded":"2024-09-19T05:33:20.007572+0000","last_fullsized":"2024-09-19T05:33:20.007572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006991+0000","last_change":"2024-09-19T05:33:18.730325+0000","last_active":"2024-09-19T05:33:20.006991+0000","last_peered":"2024-09-19T05:33:20.006991+0000","last_clean":"2024-09-19T05:33:20.006991+0000","last_became_active":"2024-09-19T05:33:18.729806+0000","last_became_peered":"2024-09-19T05:33:18.729806+0000","last_unstale":"2024-09-19T05:33:20.006991+0000","last_undegraded":"2024-09-19T05:33:20.006991+0000","last_fullsized":"2024-09-19T05:33:20.006991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:39.340032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007739+0000","last_change":"2024-09-19T05:33:13.523215+0000","last_active":"2024-09-19T05:33:20.007739+0000","last_peered":"2024-09-19T05:33:20.007739+0000","last_clean":"2024-09-19T05:33:20.007739+0000","last_became_active":"2024-09-19T05:33:13.522889+0000","last_became_peered":"2024-09-19T05:33:13.522889+0000","last_unstale":"2024-09-19T05:33:20.007739+0000","last_undegraded":"2024-09-19T05:33:20.007739+0000","last_fullsized":"2024-09-19T05:33:20.007739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:42.052958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123695+0000","last_change":"2024-09-19T05:33:14.551843+0000","last_active":"2024-09-19T05:33:20.123695+0000","last_peered":"2024-09-19T05:33:20.123695+0000","last_clean":"2024-09-19T05:33:20.123695+0000","last_became_active":"2024-09-19T05:33:14.551518+0000","last_became_peered":"2024-09-19T05:33:14.551518+0000","last_unstale":"2024-09-19T05:33:20.123695+0000","last_undegraded":"2024-09-19T05:33:20.123695+0000","last_fullsized":"2024-09-19T05:33:20.123695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577133+0000","last_change":"2024-09-19T05:33:18.599217+0000","last_active":"2024-09-19T05:33:19.577133+0000","last_peered":"2024-09-19T05:33:19.577133+0000","last_clean":"2024-09-19T05:33:19.577133+0000","last_became_active":"2024-09-19T05:33:18.598214+0000","last_became_peered":"2024-09-19T05:33:18.598214+0000","last_unstale":"2024-09-19T05:33:19.577133+0000","last_undegraded":"2024-09-19T05:33:19.577133+0000","last_fullsized":"2024-09-19T05:33:19.577133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:34.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924522+0000","last_change":"2024-09-19T05:33:13.543770+0000","last_active":"2024-09-19T05:33:20.924522+0000","last_peered":"2024-09-19T05:33:20.924522+0000","last_clean":"2024-09-19T05:33:20.924522+0000","last_became_active":"2024-09-19T05:33:13.543056+0000","last_became_peered":"2024-09-19T05:33:13.543056+0000","last_unstale":"2024-09-19T05:33:20.924522+0000","last_undegraded":"2024-09-19T05:33:20.924522+0000","last_fullsized":"2024-09-19T05:33:20.924522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543508+0000","last_change":"2024-09-19T05:33:14.570231+0000","last_active":"2024-09-19T05:33:20.543508+0000","last_peered":"2024-09-19T05:33:20.543508+0000","last_clean":"2024-09-19T05:33:20.543508+0000","last_became_active":"2024-09-19T05:33:14.569664+0000","last_became_peered":"2024-09-19T05:33:14.569664+0000","last_unstale":"2024-09-19T05:33:20.543508+0000","last_undegraded":"2024-09-19T05:33:20.543508+0000","last_fullsized":"2024-09-19T05:33:20.543508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.290827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577443+0000","last_change":"2024-09-19T05:33:18.596831+0000","last_active":"2024-09-19T05:33:19.577443+0000","last_peered":"2024-09-19T05:33:19.577443+0000","last_clean":"2024-09-19T05:33:19.577443+0000","last_became_active":"2024-09-19T05:33:18.595733+0000","last_became_peered":"2024-09-19T05:33:18.595733+0000","last_unstale":"2024-09-19T05:33:19.577443+0000","last_undegraded":"2024-09-19T05:33:19.577443+0000","last_fullsized":"2024-09-19T05:33:19.577443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:32.766631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924142+0000","last_change":"2024-09-19T05:33:13.555869+0000","last_active":"2024-09-19T05:33:20.924142+0000","last_peered":"2024-09-19T05:33:20.924142+0000","last_clean":"2024-09-19T05:33:20.924142+0000","last_became_active":"2024-09-19T05:33:13.555335+0000","last_became_peered":"2024-09-19T05:33:13.555335+0000","last_unstale":"2024-09-19T05:33:20.924142+0000","last_undegraded":"2024-09-19T05:33:20.924142+0000","last_fullsized":"2024-09-19T05:33:20.924142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.724638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543769+0000","last_change":"2024-09-19T05:33:14.570470+0000","last_active":"2024-09-19T05:33:20.543769+0000","last_peered":"2024-09-19T05:33:20.543769+0000","last_clean":"2024-09-19T05:33:20.543769+0000","last_became_active":"2024-09-19T05:33:14.569698+0000","last_became_peered":"2024-09-19T05:33:14.569698+0000","last_unstale":"2024-09-19T05:33:20.543769+0000","last_undegraded":"2024-09-19T05:33:20.543769+0000","last_fullsized":"2024-09-19T05:33:20.543769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:06.821907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577368+0000","last_change":"2024-09-19T05:33:18.595934+0000","last_active":"2024-09-19T05:33:19.577368+0000","last_peered":"2024-09-19T05:33:19.577368+0000","last_clean":"2024-09-19T05:33:19.577368+0000","last_became_active":"2024-09-19T05:33:18.594894+0000","last_became_peered":"2024-09-19T05:33:18.594894+0000","last_unstale":"2024-09-19T05:33:19.577368+0000","last_undegraded":"2024-09-19T05:33:19.577368+0000","last_fullsized":"2024-09-19T05:33:19.577368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:40.713471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923638+0000","last_change":"2024-09-19T05:33:14.550250+0000","last_active":"2024-09-19T05:33:20.923638+0000","last_peered":"2024-09-19T05:33:20.923638+0000","last_clean":"2024-09-19T05:33:20.923638+0000","last_became_active":"2024-09-19T05:33:14.549364+0000","last_became_peered":"2024-09-19T05:33:14.549364+0000","last_unstale":"2024-09-19T05:33:20.923638+0000","last_undegraded":"2024-09-19T05:33:20.923638+0000","last_fullsized":"2024-09-19T05:33:20.923638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924425+0000","last_change":"2024-09-19T05:33:13.539570+0000","last_active":"2024-09-19T05:33:20.924425+0000","last_peered":"2024-09-19T05:33:20.924425+0000","last_clean":"2024-09-19T05:33:20.924425+0000","last_became_active":"2024-09-19T05:33:13.538888+0000","last_became_peered":"2024-09-19T05:33:13.538888+0000","last_unstale":"2024-09-19T05:33:20.924425+0000","last_undegraded":"2024-09-19T05:33:20.924425+0000","last_fullsized":"2024-09-19T05:33:20.924425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:45.954638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579051+0000","last_change":"2024-09-19T05:33:18.592794+0000","last_active":"2024-09-19T05:33:19.579051+0000","last_peered":"2024-09-19T05:33:19.579051+0000","last_clean":"2024-09-19T05:33:19.579051+0000","last_became_active":"2024-09-19T05:33:18.591024+0000","last_became_peered":"2024-09-19T05:33:18.591024+0000","last_unstale":"2024-09-19T05:33:19.579051+0000","last_undegraded":"2024-09-19T05:33:19.579051+0000","last_fullsized":"2024-09-19T05:33:19.579051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:57.960270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007498+0000","last_change":"2024-09-19T05:33:14.521242+0000","last_active":"2024-09-19T05:33:20.007498+0000","last_peered":"2024-09-19T05:33:20.007498+0000","last_clean":"2024-09-19T05:33:20.007498+0000","last_became_active":"2024-09-19T05:33:14.520972+0000","last_became_peered":"2024-09-19T05:33:14.520972+0000","last_unstale":"2024-09-19T05:33:20.007498+0000","last_undegraded":"2024-09-19T05:33:20.007498+0000","last_fullsized":"2024-09-19T05:33:20.007498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923376+0000","last_change":"2024-09-19T05:33:13.519454+0000","last_active":"2024-09-19T05:33:20.923376+0000","last_peered":"2024-09-19T05:33:20.923376+0000","last_clean":"2024-09-19T05:33:20.923376+0000","last_became_active":"2024-09-19T05:33:13.518870+0000","last_became_peered":"2024-09-19T05:33:13.518870+0000","last_unstale":"2024-09-19T05:33:20.923376+0000","last_undegraded":"2024-09-19T05:33:20.923376+0000","last_fullsized":"2024-09-19T05:33:20.923376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.724638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579015+0000","last_change":"2024-09-19T05:33:18.604812+0000","last_active":"2024-09-19T05:33:19.579015+0000","last_peered":"2024-09-19T05:33:19.579015+0000","last_clean":"2024-09-19T05:33:19.579015+0000","last_became_active":"2024-09-19T05:33:18.603949+0000","last_became_peered":"2024-09-19T05:33:18.603949+0000","last_unstale":"2024-09-19T05:33:19.579015+0000","last_undegraded":"2024-09-19T05:33:19.579015+0000","last_fullsized":"2024-09-19T05:33:19.579015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:42.509239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007398+0000","last_change":"2024-09-19T05:33:14.530704+0000","last_active":"2024-09-19T05:33:20.007398+0000","last_peered":"2024-09-19T05:33:20.007398+0000","last_clean":"2024-09-19T05:33:20.007398+0000","last_became_active":"2024-09-19T05:33:14.530029+0000","last_became_peered":"2024-09-19T05:33:14.530029+0000","last_unstale":"2024-09-19T05:33:20.007398+0000","last_undegraded":"2024-09-19T05:33:20.007398+0000","last_fullsized":"2024-09-19T05:33:20.007398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922903+0000","last_change":"2024-09-19T05:33:13.536984+0000","last_active":"2024-09-19T05:33:20.922903+0000","last_peered":"2024-09-19T05:33:20.922903+0000","last_clean":"2024-09-19T05:33:20.922903+0000","last_became_active":"2024-09-19T05:33:13.536584+0000","last_became_peered":"2024-09-19T05:33:13.536584+0000","last_unstale":"2024-09-19T05:33:20.922903+0000","last_undegraded":"2024-09-19T05:33:20.922903+0000","last_fullsized":"2024-09-19T05:33:20.922903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924954+0000","last_change":"2024-09-19T05:33:18.731101+0000","last_active":"2024-09-19T05:33:20.924954+0000","last_peered":"2024-09-19T05:33:20.924954+0000","last_clean":"2024-09-19T05:33:20.924954+0000","last_became_active":"2024-09-19T05:33:18.730688+0000","last_became_peered":"2024-09-19T05:33:18.730688+0000","last_unstale":"2024-09-19T05:33:20.924954+0000","last_undegraded":"2024-09-19T05:33:20.924954+0000","last_fullsized":"2024-09-19T05:33:20.924954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:03.333739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578871+0000","last_change":"2024-09-19T05:33:14.543745+0000","last_active":"2024-09-19T05:33:19.578871+0000","last_peered":"2024-09-19T05:33:19.578871+0000","last_clean":"2024-09-19T05:33:19.578871+0000","last_became_active":"2024-09-19T05:33:14.541218+0000","last_became_peered":"2024-09-19T05:33:14.541218+0000","last_unstale":"2024-09-19T05:33:19.578871+0000","last_undegraded":"2024-09-19T05:33:19.578871+0000","last_fullsized":"2024-09-19T05:33:19.578871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:31.945487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923405+0000","last_change":"2024-09-19T05:33:13.534122+0000","last_active":"2024-09-19T05:33:20.923405+0000","last_peered":"2024-09-19T05:33:20.923405+0000","last_clean":"2024-09-19T05:33:20.923405+0000","last_became_active":"2024-09-19T05:33:13.533442+0000","last_became_peered":"2024-09-19T05:33:13.533442+0000","last_unstale":"2024-09-19T05:33:20.923405+0000","last_undegraded":"2024-09-19T05:33:20.923405+0000","last_fullsized":"2024-09-19T05:33:20.923405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578804+0000","last_change":"2024-09-19T05:33:18.595747+0000","last_active":"2024-09-19T05:33:19.578804+0000","last_peered":"2024-09-19T05:33:19.578804+0000","last_clean":"2024-09-19T05:33:19.578804+0000","last_became_active":"2024-09-19T05:33:18.594611+0000","last_became_peered":"2024-09-19T05:33:18.594611+0000","last_unstale":"2024-09-19T05:33:19.578804+0000","last_undegraded":"2024-09-19T05:33:19.578804+0000","last_fullsized":"2024-09-19T05:33:19.578804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:47.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123977+0000","last_change":"2024-09-19T05:33:14.530979+0000","last_active":"2024-09-19T05:33:20.123977+0000","last_peered":"2024-09-19T05:33:20.123977+0000","last_clean":"2024-09-19T05:33:20.123977+0000","last_became_active":"2024-09-19T05:33:14.530680+0000","last_became_peered":"2024-09-19T05:33:14.530680+0000","last_unstale":"2024-09-19T05:33:20.123977+0000","last_undegraded":"2024-09-19T05:33:20.123977+0000","last_fullsized":"2024-09-19T05:33:20.123977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926403+0000","last_change":"2024-09-19T05:33:13.532595+0000","last_active":"2024-09-19T05:33:20.926403+0000","last_peered":"2024-09-19T05:33:20.926403+0000","last_clean":"2024-09-19T05:33:20.926403+0000","last_became_active":"2024-09-19T05:33:13.531963+0000","last_became_peered":"2024-09-19T05:33:13.531963+0000","last_unstale":"2024-09-19T05:33:20.926403+0000","last_undegraded":"2024-09-19T05:33:20.926403+0000","last_fullsized":"2024-09-19T05:33:20.926403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:41.192975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577289+0000","last_change":"2024-09-19T05:33:18.727908+0000","last_active":"2024-09-19T05:33:19.577289+0000","last_peered":"2024-09-19T05:33:19.577289+0000","last_clean":"2024-09-19T05:33:19.577289+0000","last_became_active":"2024-09-19T05:33:18.726858+0000","last_became_peered":"2024-09-19T05:33:18.726858+0000","last_unstale":"2024-09-19T05:33:19.577289+0000","last_undegraded":"2024-09-19T05:33:19.577289+0000","last_fullsized":"2024-09-19T05:33:19.577289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:24.769636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.008051+0000","last_change":"2024-09-19T05:33:14.562327+0000","last_active":"2024-09-19T05:33:20.008051+0000","last_peered":"2024-09-19T05:33:20.008051+0000","last_clean":"2024-09-19T05:33:20.008051+0000","last_became_active":"2024-09-19T05:33:14.561984+0000","last_became_peered":"2024-09-19T05:33:14.561984+0000","last_unstale":"2024-09-19T05:33:20.008051+0000","last_undegraded":"2024-09-19T05:33:20.008051+0000","last_fullsized":"2024-09-19T05:33:20.008051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924849+0000","last_change":"2024-09-19T05:33:13.536758+0000","last_active":"2024-09-19T05:33:20.924849+0000","last_peered":"2024-09-19T05:33:20.924849+0000","last_clean":"2024-09-19T05:33:20.924849+0000","last_became_active":"2024-09-19T05:33:13.536502+0000","last_became_peered":"2024-09-19T05:33:13.536502+0000","last_unstale":"2024-09-19T05:33:20.924849+0000","last_undegraded":"2024-09-19T05:33:20.924849+0000","last_fullsized":"2024-09-19T05:33:20.924849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006886+0000","last_change":"2024-09-19T05:33:18.723398+0000","last_active":"2024-09-19T05:33:20.006886+0000","last_peered":"2024-09-19T05:33:20.006886+0000","last_clean":"2024-09-19T05:33:20.006886+0000","last_became_active":"2024-09-19T05:33:18.722953+0000","last_became_peered":"2024-09-19T05:33:18.722953+0000","last_unstale":"2024-09-19T05:33:20.006886+0000","last_undegraded":"2024-09-19T05:33:20.006886+0000","last_fullsized":"2024-09-19T05:33:20.006886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:15.960409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924131+0000","last_change":"2024-09-19T05:33:14.527703+0000","last_active":"2024-09-19T05:33:20.924131+0000","last_peered":"2024-09-19T05:33:20.924131+0000","last_clean":"2024-09-19T05:33:20.924131+0000","last_became_active":"2024-09-19T05:33:14.527335+0000","last_became_peered":"2024-09-19T05:33:14.527335+0000","last_unstale":"2024-09-19T05:33:20.924131+0000","last_undegraded":"2024-09-19T05:33:20.924131+0000","last_fullsized":"2024-09-19T05:33:20.924131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924672+0000","last_change":"2024-09-19T05:33:13.534591+0000","last_active":"2024-09-19T05:33:20.924672+0000","last_peered":"2024-09-19T05:33:20.924672+0000","last_clean":"2024-09-19T05:33:20.924672+0000","last_became_active":"2024-09-19T05:33:13.533520+0000","last_became_peered":"2024-09-19T05:33:13.533520+0000","last_unstale":"2024-09-19T05:33:20.924672+0000","last_undegraded":"2024-09-19T05:33:20.924672+0000","last_fullsized":"2024-09-19T05:33:20.924672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:40.138729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123671+0000","last_change":"2024-09-19T05:33:18.727847+0000","last_active":"2024-09-19T05:33:20.123671+0000","last_peered":"2024-09-19T05:33:20.123671+0000","last_clean":"2024-09-19T05:33:20.123671+0000","last_became_active":"2024-09-19T05:33:18.727377+0000","last_became_peered":"2024-09-19T05:33:18.727377+0000","last_unstale":"2024-09-19T05:33:20.123671+0000","last_undegraded":"2024-09-19T05:33:20.123671+0000","last_fullsized":"2024-09-19T05:33:20.123671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:47.968935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544028+0000","last_change":"2024-09-19T05:33:14.552094+0000","last_active":"2024-09-19T05:33:20.544028+0000","last_peered":"2024-09-19T05:33:20.544028+0000","last_clean":"2024-09-19T05:33:20.544028+0000","last_became_active":"2024-09-19T05:33:14.551244+0000","last_became_peered":"2024-09-19T05:33:14.551244+0000","last_unstale":"2024-09-19T05:33:20.544028+0000","last_undegraded":"2024-09-19T05:33:20.544028+0000","last_fullsized":"2024-09-19T05:33:20.544028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:29.504706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924385+0000","last_change":"2024-09-19T05:33:13.523378+0000","last_active":"2024-09-19T05:33:20.924385+0000","last_peered":"2024-09-19T05:33:20.924385+0000","last_clean":"2024-09-19T05:33:20.924385+0000","last_became_active":"2024-09-19T05:33:13.523053+0000","last_became_peered":"2024-09-19T05:33:13.523053+0000","last_unstale":"2024-09-19T05:33:20.924385+0000","last_undegraded":"2024-09-19T05:33:20.924385+0000","last_fullsized":"2024-09-19T05:33:20.924385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:41.192975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923121+0000","last_change":"2024-09-19T05:33:18.602228+0000","last_active":"2024-09-19T05:33:20.923121+0000","last_peered":"2024-09-19T05:33:20.923121+0000","last_clean":"2024-09-19T05:33:20.923121+0000","last_became_active":"2024-09-19T05:33:18.601292+0000","last_became_peered":"2024-09-19T05:33:18.601292+0000","last_unstale":"2024-09-19T05:33:20.923121+0000","last_undegraded":"2024-09-19T05:33:20.923121+0000","last_fullsized":"2024-09-19T05:33:20.923121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:57.747825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578328+0000","last_change":"2024-09-19T05:33:14.537118+0000","last_active":"2024-09-19T05:33:19.578328+0000","last_peered":"2024-09-19T05:33:19.578328+0000","last_clean":"2024-09-19T05:33:19.578328+0000","last_became_active":"2024-09-19T05:33:14.535816+0000","last_became_peered":"2024-09-19T05:33:14.535816+0000","last_unstale":"2024-09-19T05:33:19.578328+0000","last_undegraded":"2024-09-19T05:33:19.578328+0000","last_fullsized":"2024-09-19T05:33:19.578328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:49.497300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543873+0000","last_change":"2024-09-19T05:33:13.550593+0000","last_active":"2024-09-19T05:33:20.543873+0000","last_peered":"2024-09-19T05:33:20.543873+0000","last_clean":"2024-09-19T05:33:20.543873+0000","last_became_active":"2024-09-19T05:33:13.549511+0000","last_became_peered":"2024-09-19T05:33:13.549511+0000","last_unstale":"2024-09-19T05:33:20.543873+0000","last_undegraded":"2024-09-19T05:33:20.543873+0000","last_fullsized":"2024-09-19T05:33:20.543873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:13.595105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924258+0000","last_change":"2024-09-19T05:33:18.607825+0000","last_active":"2024-09-19T05:33:20.924258+0000","last_peered":"2024-09-19T05:33:20.924258+0000","last_clean":"2024-09-19T05:33:20.924258+0000","last_became_active":"2024-09-19T05:33:18.606441+0000","last_became_peered":"2024-09-19T05:33:18.606441+0000","last_unstale":"2024-09-19T05:33:20.924258+0000","last_undegraded":"2024-09-19T05:33:20.924258+0000","last_fullsized":"2024-09-19T05:33:20.924258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:47.248958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922997+0000","last_change":"2024-09-19T05:33:14.530018+0000","last_active":"2024-09-19T05:33:20.922997+0000","last_peered":"2024-09-19T05:33:20.922997+0000","last_clean":"2024-09-19T05:33:20.922997+0000","last_became_active":"2024-09-19T05:33:14.528997+0000","last_became_peered":"2024-09-19T05:33:14.528997+0000","last_unstale":"2024-09-19T05:33:20.922997+0000","last_undegraded":"2024-09-19T05:33:20.922997+0000","last_fullsized":"2024-09-19T05:33:20.922997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576385+0000","last_change":"2024-09-19T05:33:13.518923+0000","last_active":"2024-09-19T05:33:19.576385+0000","last_peered":"2024-09-19T05:33:19.576385+0000","last_clean":"2024-09-19T05:33:19.576385+0000","last_became_active":"2024-09-19T05:33:13.517867+0000","last_became_peered":"2024-09-19T05:33:13.517867+0000","last_unstale":"2024-09-19T05:33:19.576385+0000","last_undegraded":"2024-09-19T05:33:19.576385+0000","last_fullsized":"2024-09-19T05:33:19.576385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:41.939363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925137+0000","last_change":"2024-09-19T05:33:18.600087+0000","last_active":"2024-09-19T05:33:20.925137+0000","last_peered":"2024-09-19T05:33:20.925137+0000","last_clean":"2024-09-19T05:33:20.925137+0000","last_became_active":"2024-09-19T05:33:18.599484+0000","last_became_peered":"2024-09-19T05:33:18.599484+0000","last_unstale":"2024-09-19T05:33:20.925137+0000","last_undegraded":"2024-09-19T05:33:20.925137+0000","last_fullsized":"2024-09-19T05:33:20.925137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:03.032844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123142+0000","last_change":"2024-09-19T05:33:14.549619+0000","last_active":"2024-09-19T05:33:20.123142+0000","last_peered":"2024-09-19T05:33:20.123142+0000","last_clean":"2024-09-19T05:33:20.123142+0000","last_became_active":"2024-09-19T05:33:14.549390+0000","last_became_peered":"2024-09-19T05:33:14.549390+0000","last_unstale":"2024-09-19T05:33:20.123142+0000","last_undegraded":"2024-09-19T05:33:20.123142+0000","last_fullsized":"2024-09-19T05:33:20.123142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:29.911108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923683+0000","last_change":"2024-09-19T05:33:13.533988+0000","last_active":"2024-09-19T05:33:20.923683+0000","last_peered":"2024-09-19T05:33:20.923683+0000","last_clean":"2024-09-19T05:33:20.923683+0000","last_became_active":"2024-09-19T05:33:13.533251+0000","last_became_peered":"2024-09-19T05:33:13.533251+0000","last_unstale":"2024-09-19T05:33:20.923683+0000","last_undegraded":"2024-09-19T05:33:20.923683+0000","last_fullsized":"2024-09-19T05:33:20.923683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123842+0000","last_change":"2024-09-19T05:33:18.731732+0000","last_active":"2024-09-19T05:33:20.123842+0000","last_peered":"2024-09-19T05:33:20.123842+0000","last_clean":"2024-09-19T05:33:20.123842+0000","last_became_active":"2024-09-19T05:33:18.731060+0000","last_became_peered":"2024-09-19T05:33:18.731060+0000","last_unstale":"2024-09-19T05:33:20.123842+0000","last_undegraded":"2024-09-19T05:33:20.123842+0000","last_fullsized":"2024-09-19T05:33:20.123842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:03.333739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007078+0000","last_change":"2024-09-19T05:33:14.564726+0000","last_active":"2024-09-19T05:33:20.007078+0000","last_peered":"2024-09-19T05:33:20.007078+0000","last_clean":"2024-09-19T05:33:20.007078+0000","last_became_active":"2024-09-19T05:33:14.564425+0000","last_became_peered":"2024-09-19T05:33:14.564425+0000","last_unstale":"2024-09-19T05:33:20.007078+0000","last_undegraded":"2024-09-19T05:33:20.007078+0000","last_fullsized":"2024-09-19T05:33:20.007078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543194+0000","last_change":"2024-09-19T05:33:13.553641+0000","last_active":"2024-09-19T05:33:20.543194+0000","last_peered":"2024-09-19T05:33:20.543194+0000","last_clean":"2024-09-19T05:33:20.543194+0000","last_became_active":"2024-09-19T05:33:13.552684+0000","last_became_peered":"2024-09-19T05:33:13.552684+0000","last_unstale":"2024-09-19T05:33:20.543194+0000","last_undegraded":"2024-09-19T05:33:20.543194+0000","last_fullsized":"2024-09-19T05:33:20.543194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:01.312371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922618+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:33:20.922618+0000","last_peered":"2024-09-19T05:33:20.922618+0000","last_clean":"2024-09-19T05:33:20.922618+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:33:20.922618+0000","last_undegraded":"2024-09-19T05:33:20.922618+0000","last_fullsized":"2024-09-19T05:33:20.922618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923213+0000","last_change":"2024-09-19T05:33:18.730082+0000","last_active":"2024-09-19T05:33:20.923213+0000","last_peered":"2024-09-19T05:33:20.923213+0000","last_clean":"2024-09-19T05:33:20.923213+0000","last_became_active":"2024-09-19T05:33:18.728956+0000","last_became_peered":"2024-09-19T05:33:18.728956+0000","last_unstale":"2024-09-19T05:33:20.923213+0000","last_undegraded":"2024-09-19T05:33:20.923213+0000","last_fullsized":"2024-09-19T05:33:20.923213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:42.509239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924260+0000","last_change":"2024-09-19T05:33:14.556753+0000","last_active":"2024-09-19T05:33:20.924260+0000","last_peered":"2024-09-19T05:33:20.924260+0000","last_clean":"2024-09-19T05:33:20.924260+0000","last_became_active":"2024-09-19T05:33:14.555774+0000","last_became_peered":"2024-09-19T05:33:14.555774+0000","last_unstale":"2024-09-19T05:33:20.924260+0000","last_undegraded":"2024-09-19T05:33:20.924260+0000","last_fullsized":"2024-09-19T05:33:20.924260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:43.675511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576694+0000","last_change":"2024-09-19T05:33:13.554975+0000","last_active":"2024-09-19T05:33:19.576694+0000","last_peered":"2024-09-19T05:33:19.576694+0000","last_clean":"2024-09-19T05:33:19.576694+0000","last_became_active":"2024-09-19T05:33:13.554687+0000","last_became_peered":"2024-09-19T05:33:13.554687+0000","last_unstale":"2024-09-19T05:33:19.576694+0000","last_undegraded":"2024-09-19T05:33:19.576694+0000","last_fullsized":"2024-09-19T05:33:19.576694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:19.118135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923096+0000","last_change":"2024-09-19T05:33:18.725840+0000","last_active":"2024-09-19T05:33:20.923096+0000","last_peered":"2024-09-19T05:33:20.923096+0000","last_clean":"2024-09-19T05:33:20.923096+0000","last_became_active":"2024-09-19T05:33:18.724609+0000","last_became_peered":"2024-09-19T05:33:18.724609+0000","last_unstale":"2024-09-19T05:33:20.923096+0000","last_undegraded":"2024-09-19T05:33:20.923096+0000","last_fullsized":"2024-09-19T05:33:20.923096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:47.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543949+0000","last_change":"2024-09-19T05:33:14.537550+0000","last_active":"2024-09-19T05:33:20.543949+0000","last_peered":"2024-09-19T05:33:20.543949+0000","last_clean":"2024-09-19T05:33:20.543949+0000","last_became_active":"2024-09-19T05:33:14.536832+0000","last_became_peered":"2024-09-19T05:33:14.536832+0000","last_unstale":"2024-09-19T05:33:20.543949+0000","last_undegraded":"2024-09-19T05:33:20.543949+0000","last_fullsized":"2024-09-19T05:33:20.543949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:45.451882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924358+0000","last_change":"2024-09-19T05:33:13.524749+0000","last_active":"2024-09-19T05:33:20.924358+0000","last_peered":"2024-09-19T05:33:20.924358+0000","last_clean":"2024-09-19T05:33:20.924358+0000","last_became_active":"2024-09-19T05:33:13.523674+0000","last_became_peered":"2024-09-19T05:33:13.523674+0000","last_unstale":"2024-09-19T05:33:20.924358+0000","last_undegraded":"2024-09-19T05:33:20.924358+0000","last_fullsized":"2024-09-19T05:33:20.924358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:45.954638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123714+0000","last_change":"2024-09-19T05:33:18.598514+0000","last_active":"2024-09-19T05:33:20.123714+0000","last_peered":"2024-09-19T05:33:20.123714+0000","last_clean":"2024-09-19T05:33:20.123714+0000","last_became_active":"2024-09-19T05:33:18.598011+0000","last_became_peered":"2024-09-19T05:33:18.598011+0000","last_unstale":"2024-09-19T05:33:20.123714+0000","last_undegraded":"2024-09-19T05:33:20.123714+0000","last_fullsized":"2024-09-19T05:33:20.123714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.531745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925304+0000","last_change":"2024-09-19T05:33:14.574183+0000","last_active":"2024-09-19T05:33:20.925304+0000","last_peered":"2024-09-19T05:33:20.925304+0000","last_clean":"2024-09-19T05:33:20.925304+0000","last_became_active":"2024-09-19T05:33:14.572292+0000","last_became_peered":"2024-09-19T05:33:14.572292+0000","last_unstale":"2024-09-19T05:33:20.925304+0000","last_undegraded":"2024-09-19T05:33:20.925304+0000","last_fullsized":"2024-09-19T05:33:20.925304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:23.479624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576694+0000","last_change":"2024-09-19T05:33:13.518160+0000","last_active":"2024-09-19T05:33:19.576694+0000","last_peered":"2024-09-19T05:33:19.576694+0000","last_clean":"2024-09-19T05:33:19.576694+0000","last_became_active":"2024-09-19T05:33:13.517669+0000","last_became_peered":"2024-09-19T05:33:13.517669+0000","last_unstale":"2024-09-19T05:33:19.576694+0000","last_undegraded":"2024-09-19T05:33:19.576694+0000","last_fullsized":"2024-09-19T05:33:19.576694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.869187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542731+0000","last_change":"2024-09-19T05:33:18.731204+0000","last_active":"2024-09-19T05:33:20.542731+0000","last_peered":"2024-09-19T05:33:20.542731+0000","last_clean":"2024-09-19T05:33:20.542731+0000","last_became_active":"2024-09-19T05:33:18.730150+0000","last_became_peered":"2024-09-19T05:33:18.730150+0000","last_unstale":"2024-09-19T05:33:20.542731+0000","last_undegraded":"2024-09-19T05:33:20.542731+0000","last_fullsized":"2024-09-19T05:33:20.542731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:39.847635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924886+0000","last_change":"2024-09-19T05:33:14.568190+0000","last_active":"2024-09-19T05:33:20.924886+0000","last_peered":"2024-09-19T05:33:20.924886+0000","last_clean":"2024-09-19T05:33:20.924886+0000","last_became_active":"2024-09-19T05:33:14.566383+0000","last_became_peered":"2024-09-19T05:33:14.566383+0000","last_unstale":"2024-09-19T05:33:20.924886+0000","last_undegraded":"2024-09-19T05:33:20.924886+0000","last_fullsized":"2024-09-19T05:33:20.924886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:43.196836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578722+0000","last_change":"2024-09-19T05:33:13.523746+0000","last_active":"2024-09-19T05:33:19.578722+0000","last_peered":"2024-09-19T05:33:19.578722+0000","last_clean":"2024-09-19T05:33:19.578722+0000","last_became_active":"2024-09-19T05:33:13.522995+0000","last_became_peered":"2024-09-19T05:33:13.522995+0000","last_unstale":"2024-09-19T05:33:19.578722+0000","last_undegraded":"2024-09-19T05:33:19.578722+0000","last_fullsized":"2024-09-19T05:33:19.578722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:37.675142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576913+0000","last_change":"2024-09-19T05:33:18.595330+0000","last_active":"2024-09-19T05:33:19.576913+0000","last_peered":"2024-09-19T05:33:19.576913+0000","last_clean":"2024-09-19T05:33:19.576913+0000","last_became_active":"2024-09-19T05:33:18.594314+0000","last_became_peered":"2024-09-19T05:33:18.594314+0000","last_unstale":"2024-09-19T05:33:19.576913+0000","last_undegraded":"2024-09-19T05:33:19.576913+0000","last_fullsized":"2024-09-19T05:33:19.576913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:17.535329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925421+0000","last_change":"2024-09-19T05:33:14.568254+0000","last_active":"2024-09-19T05:33:20.925421+0000","last_peered":"2024-09-19T05:33:20.925421+0000","last_clean":"2024-09-19T05:33:20.925421+0000","last_became_active":"2024-09-19T05:33:14.567525+0000","last_became_peered":"2024-09-19T05:33:14.567525+0000","last_unstale":"2024-09-19T05:33:20.925421+0000","last_undegraded":"2024-09-19T05:33:20.925421+0000","last_fullsized":"2024-09-19T05:33:20.925421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:20.717515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576007+0000","last_change":"2024-09-19T05:33:13.518203+0000","last_active":"2024-09-19T05:33:19.576007+0000","last_peered":"2024-09-19T05:33:19.576007+0000","last_clean":"2024-09-19T05:33:19.576007+0000","last_became_active":"2024-09-19T05:33:13.517450+0000","last_became_peered":"2024-09-19T05:33:13.517450+0000","last_unstale":"2024-09-19T05:33:19.576007+0000","last_undegraded":"2024-09-19T05:33:19.576007+0000","last_fullsized":"2024-09-19T05:33:19.576007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:01.312371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123779+0000","last_change":"2024-09-19T05:33:18.596006+0000","last_active":"2024-09-19T05:33:20.123779+0000","last_peered":"2024-09-19T05:33:20.123779+0000","last_clean":"2024-09-19T05:33:20.123779+0000","last_became_active":"2024-09-19T05:33:18.595625+0000","last_became_peered":"2024-09-19T05:33:18.595625+0000","last_unstale":"2024-09-19T05:33:20.123779+0000","last_undegraded":"2024-09-19T05:33:20.123779+0000","last_fullsized":"2024-09-19T05:33:20.123779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:47.248958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924329+0000","last_change":"2024-09-19T05:33:14.550442+0000","last_active":"2024-09-19T05:33:20.924329+0000","last_peered":"2024-09-19T05:33:20.924329+0000","last_clean":"2024-09-19T05:33:20.924329+0000","last_became_active":"2024-09-19T05:33:14.549648+0000","last_became_peered":"2024-09-19T05:33:14.549648+0000","last_unstale":"2024-09-19T05:33:20.924329+0000","last_undegraded":"2024-09-19T05:33:20.924329+0000","last_fullsized":"2024-09-19T05:33:20.924329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923348+0000","last_change":"2024-09-19T05:33:13.541793+0000","last_active":"2024-09-19T05:33:20.923348+0000","last_peered":"2024-09-19T05:33:20.923348+0000","last_clean":"2024-09-19T05:33:20.923348+0000","last_became_active":"2024-09-19T05:33:13.541034+0000","last_became_peered":"2024-09-19T05:33:13.541034+0000","last_unstale":"2024-09-19T05:33:20.923348+0000","last_undegraded":"2024-09-19T05:33:20.923348+0000","last_fullsized":"2024-09-19T05:33:20.923348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007972+0000","last_change":"2024-09-19T05:33:18.734544+0000","last_active":"2024-09-19T05:33:20.007972+0000","last_peered":"2024-09-19T05:33:20.007972+0000","last_clean":"2024-09-19T05:33:20.007972+0000","last_became_active":"2024-09-19T05:33:18.734217+0000","last_became_peered":"2024-09-19T05:33:18.734217+0000","last_unstale":"2024-09-19T05:33:20.007972+0000","last_undegraded":"2024-09-19T05:33:20.007972+0000","last_fullsized":"2024-09-19T05:33:20.007972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:29.423972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924156+0000","last_change":"2024-09-19T05:33:14.568196+0000","last_active":"2024-09-19T05:33:20.924156+0000","last_peered":"2024-09-19T05:33:20.924156+0000","last_clean":"2024-09-19T05:33:20.924156+0000","last_became_active":"2024-09-19T05:33:14.567764+0000","last_became_peered":"2024-09-19T05:33:14.567764+0000","last_unstale":"2024-09-19T05:33:20.924156+0000","last_undegraded":"2024-09-19T05:33:20.924156+0000","last_fullsized":"2024-09-19T05:33:20.924156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:38.457117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543797+0000","last_change":"2024-09-19T05:33:13.550337+0000","last_active":"2024-09-19T05:33:20.543797+0000","last_peered":"2024-09-19T05:33:20.543797+0000","last_clean":"2024-09-19T05:33:20.543797+0000","last_became_active":"2024-09-19T05:33:13.549450+0000","last_became_peered":"2024-09-19T05:33:13.549450+0000","last_unstale":"2024-09-19T05:33:20.543797+0000","last_undegraded":"2024-09-19T05:33:20.543797+0000","last_fullsized":"2024-09-19T05:33:20.543797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:29.032420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007818+0000","last_change":"2024-09-19T05:33:18.728533+0000","last_active":"2024-09-19T05:33:20.007818+0000","last_peered":"2024-09-19T05:33:20.007818+0000","last_clean":"2024-09-19T05:33:20.007818+0000","last_became_active":"2024-09-19T05:33:18.728056+0000","last_became_peered":"2024-09-19T05:33:18.728056+0000","last_unstale":"2024-09-19T05:33:20.007818+0000","last_undegraded":"2024-09-19T05:33:20.007818+0000","last_fullsized":"2024-09-19T05:33:20.007818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:33.730399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123383+0000","last_change":"2024-09-19T05:33:14.555119+0000","last_active":"2024-09-19T05:33:20.123383+0000","last_peered":"2024-09-19T05:33:20.123383+0000","last_clean":"2024-09-19T05:33:20.123383+0000","last_became_active":"2024-09-19T05:33:14.554798+0000","last_became_peered":"2024-09-19T05:33:14.554798+0000","last_unstale":"2024-09-19T05:33:20.123383+0000","last_undegraded":"2024-09-19T05:33:20.123383+0000","last_fullsized":"2024-09-19T05:33:20.123383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123886+0000","last_change":"2024-09-19T05:33:13.529400+0000","last_active":"2024-09-19T05:33:20.123886+0000","last_peered":"2024-09-19T05:33:20.123886+0000","last_clean":"2024-09-19T05:33:20.123886+0000","last_became_active":"2024-09-19T05:33:13.529106+0000","last_became_peered":"2024-09-19T05:33:13.529106+0000","last_unstale":"2024-09-19T05:33:20.123886+0000","last_undegraded":"2024-09-19T05:33:20.123886+0000","last_fullsized":"2024-09-19T05:33:20.123886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:11.761526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544051+0000","last_change":"2024-09-19T05:33:18.723038+0000","last_active":"2024-09-19T05:33:20.544051+0000","last_peered":"2024-09-19T05:33:20.544051+0000","last_clean":"2024-09-19T05:33:20.544051+0000","last_became_active":"2024-09-19T05:33:18.722087+0000","last_became_peered":"2024-09-19T05:33:18.722087+0000","last_unstale":"2024-09-19T05:33:20.544051+0000","last_undegraded":"2024-09-19T05:33:20.544051+0000","last_fullsized":"2024-09-19T05:33:20.544051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:40.558697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924126+0000","last_change":"2024-09-19T05:33:14.556157+0000","last_active":"2024-09-19T05:33:20.924126+0000","last_peered":"2024-09-19T05:33:20.924126+0000","last_clean":"2024-09-19T05:33:20.924126+0000","last_became_active":"2024-09-19T05:33:14.555055+0000","last_became_peered":"2024-09-19T05:33:14.555055+0000","last_unstale":"2024-09-19T05:33:20.924126+0000","last_undegraded":"2024-09-19T05:33:20.924126+0000","last_fullsized":"2024-09-19T05:33:20.924126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:36.661349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:25.122224+0000","last_change":"2024-09-19T05:33:13.534975+0000","last_active":"2024-09-19T05:33:25.122224+0000","last_peered":"2024-09-19T05:33:25.122224+0000","last_clean":"2024-09-19T05:33:25.122224+0000","last_became_active":"2024-09-19T05:33:13.533864+0000","last_became_peered":"2024-09-19T05:33:13.533864+0000","last_unstale":"2024-09-19T05:33:25.122224+0000","last_undegraded":"2024-09-19T05:33:25.122224+0000","last_fullsized":"2024-09-19T05:33:25.122224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923321+0000","last_change":"2024-09-19T05:33:18.592141+0000","last_active":"2024-09-19T05:33:20.923321+0000","last_peered":"2024-09-19T05:33:20.923321+0000","last_clean":"2024-09-19T05:33:20.923321+0000","last_became_active":"2024-09-19T05:33:18.591748+0000","last_became_peered":"2024-09-19T05:33:18.591748+0000","last_unstale":"2024-09-19T05:33:20.923321+0000","last_undegraded":"2024-09-19T05:33:20.923321+0000","last_fullsized":"2024-09-19T05:33:20.923321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.531745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578732+0000","last_change":"2024-09-19T05:33:14.557457+0000","last_active":"2024-09-19T05:33:19.578732+0000","last_peered":"2024-09-19T05:33:19.578732+0000","last_clean":"2024-09-19T05:33:19.578732+0000","last_became_active":"2024-09-19T05:33:14.556954+0000","last_became_peered":"2024-09-19T05:33:14.556954+0000","last_unstale":"2024-09-19T05:33:19.578732+0000","last_undegraded":"2024-09-19T05:33:19.578732+0000","last_fullsized":"2024-09-19T05:33:19.578732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:46.964162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924088+0000","last_change":"2024-09-19T05:33:13.548294+0000","last_active":"2024-09-19T05:33:20.924088+0000","last_peered":"2024-09-19T05:33:20.924088+0000","last_clean":"2024-09-19T05:33:20.924088+0000","last_became_active":"2024-09-19T05:33:13.547981+0000","last_became_peered":"2024-09-19T05:33:13.547981+0000","last_unstale":"2024-09-19T05:33:20.924088+0000","last_undegraded":"2024-09-19T05:33:20.924088+0000","last_fullsized":"2024-09-19T05:33:20.924088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579238+0000","last_change":"2024-09-19T05:33:18.596736+0000","last_active":"2024-09-19T05:33:19.579238+0000","last_peered":"2024-09-19T05:33:19.579238+0000","last_clean":"2024-09-19T05:33:19.579238+0000","last_became_active":"2024-09-19T05:33:18.594148+0000","last_became_peered":"2024-09-19T05:33:18.594148+0000","last_unstale":"2024-09-19T05:33:19.579238+0000","last_undegraded":"2024-09-19T05:33:19.579238+0000","last_fullsized":"2024-09-19T05:33:19.579238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:47.968935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123796+0000","last_change":"2024-09-19T05:33:14.551870+0000","last_active":"2024-09-19T05:33:20.123796+0000","last_peered":"2024-09-19T05:33:20.123796+0000","last_clean":"2024-09-19T05:33:20.123796+0000","last_became_active":"2024-09-19T05:33:14.551566+0000","last_became_peered":"2024-09-19T05:33:14.551566+0000","last_unstale":"2024-09-19T05:33:20.123796+0000","last_undegraded":"2024-09-19T05:33:20.123796+0000","last_fullsized":"2024-09-19T05:33:20.123796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543615+0000","last_change":"2024-09-19T05:33:13.553089+0000","last_active":"2024-09-19T05:33:20.543615+0000","last_peered":"2024-09-19T05:33:20.543615+0000","last_clean":"2024-09-19T05:33:20.543615+0000","last_became_active":"2024-09-19T05:33:13.552446+0000","last_became_peered":"2024-09-19T05:33:13.552446+0000","last_unstale":"2024-09-19T05:33:20.543615+0000","last_undegraded":"2024-09-19T05:33:20.543615+0000","last_fullsized":"2024-09-19T05:33:20.543615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.869187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007319+0000","last_change":"2024-09-19T05:33:18.595633+0000","last_active":"2024-09-19T05:33:20.007319+0000","last_peered":"2024-09-19T05:33:20.007319+0000","last_clean":"2024-09-19T05:33:20.007319+0000","last_became_active":"2024-09-19T05:33:18.594796+0000","last_became_peered":"2024-09-19T05:33:18.594796+0000","last_unstale":"2024-09-19T05:33:20.007319+0000","last_undegraded":"2024-09-19T05:33:20.007319+0000","last_fullsized":"2024-09-19T05:33:20.007319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:01.766766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543414+0000","last_change":"2024-09-19T05:33:14.562226+0000","last_active":"2024-09-19T05:33:20.543414+0000","last_peered":"2024-09-19T05:33:20.543414+0000","last_clean":"2024-09-19T05:33:20.543414+0000","last_became_active":"2024-09-19T05:33:14.561518+0000","last_became_peered":"2024-09-19T05:33:14.561518+0000","last_unstale":"2024-09-19T05:33:20.543414+0000","last_undegraded":"2024-09-19T05:33:20.543414+0000","last_fullsized":"2024-09-19T05:33:20.543414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:56.884042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926192+0000","last_change":"2024-09-19T05:33:13.554061+0000","last_active":"2024-09-19T05:33:20.926192+0000","last_peered":"2024-09-19T05:33:20.926192+0000","last_clean":"2024-09-19T05:33:20.926192+0000","last_became_active":"2024-09-19T05:33:13.553573+0000","last_became_peered":"2024-09-19T05:33:13.553573+0000","last_unstale":"2024-09-19T05:33:20.926192+0000","last_undegraded":"2024-09-19T05:33:20.926192+0000","last_fullsized":"2024-09-19T05:33:20.926192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007220+0000","last_change":"2024-09-19T05:33:18.728406+0000","last_active":"2024-09-19T05:33:20.007220+0000","last_peered":"2024-09-19T05:33:20.007220+0000","last_clean":"2024-09-19T05:33:20.007220+0000","last_became_active":"2024-09-19T05:33:18.728024+0000","last_became_peered":"2024-09-19T05:33:18.728024+0000","last_unstale":"2024-09-19T05:33:20.007220+0000","last_undegraded":"2024-09-19T05:33:20.007220+0000","last_fullsized":"2024-09-19T05:33:20.007220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:21.487284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123656+0000","last_change":"2024-09-19T05:33:18.731432+0000","last_active":"2024-09-19T05:33:20.123656+0000","last_peered":"2024-09-19T05:33:20.123656+0000","last_clean":"2024-09-19T05:33:20.123656+0000","last_became_active":"2024-09-19T05:33:18.730553+0000","last_became_peered":"2024-09-19T05:33:18.730553+0000","last_unstale":"2024-09-19T05:33:20.123656+0000","last_undegraded":"2024-09-19T05:33:20.123656+0000","last_fullsized":"2024-09-19T05:33:20.123656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:57.747825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922747+0000","last_change":"2024-09-19T05:33:14.528607+0000","last_active":"2024-09-19T05:33:20.922747+0000","last_peered":"2024-09-19T05:33:20.922747+0000","last_clean":"2024-09-19T05:33:20.922747+0000","last_became_active":"2024-09-19T05:33:14.528243+0000","last_became_peered":"2024-09-19T05:33:14.528243+0000","last_unstale":"2024-09-19T05:33:20.922747+0000","last_undegraded":"2024-09-19T05:33:20.922747+0000","last_fullsized":"2024-09-19T05:33:20.922747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542883+0000","last_change":"2024-09-19T05:33:13.550160+0000","last_active":"2024-09-19T05:33:20.542883+0000","last_peered":"2024-09-19T05:33:20.542883+0000","last_clean":"2024-09-19T05:33:20.542883+0000","last_became_active":"2024-09-19T05:33:13.548497+0000","last_became_peered":"2024-09-19T05:33:13.548497+0000","last_unstale":"2024-09-19T05:33:20.542883+0000","last_undegraded":"2024-09-19T05:33:20.542883+0000","last_fullsized":"2024-09-19T05:33:20.542883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:41.939363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926179+0000","last_change":"2024-09-19T05:33:18.598114+0000","last_active":"2024-09-19T05:33:20.926179+0000","last_peered":"2024-09-19T05:33:20.926179+0000","last_clean":"2024-09-19T05:33:20.926179+0000","last_became_active":"2024-09-19T05:33:18.597017+0000","last_became_peered":"2024-09-19T05:33:18.597017+0000","last_unstale":"2024-09-19T05:33:20.926179+0000","last_undegraded":"2024-09-19T05:33:20.926179+0000","last_fullsized":"2024-09-19T05:33:20.926179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:57.960270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007352+0000","last_change":"2024-09-19T05:33:14.521880+0000","last_active":"2024-09-19T05:33:20.007352+0000","last_peered":"2024-09-19T05:33:20.007352+0000","last_clean":"2024-09-19T05:33:20.007352+0000","last_became_active":"2024-09-19T05:33:14.521480+0000","last_became_peered":"2024-09-19T05:33:14.521480+0000","last_unstale":"2024-09-19T05:33:20.007352+0000","last_undegraded":"2024-09-19T05:33:20.007352+0000","last_fullsized":"2024-09-19T05:33:20.007352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007858+0000","last_change":"2024-09-19T05:33:13.536792+0000","last_active":"2024-09-19T05:33:20.007858+0000","last_peered":"2024-09-19T05:33:20.007858+0000","last_clean":"2024-09-19T05:33:20.007858+0000","last_became_active":"2024-09-19T05:33:13.536509+0000","last_became_peered":"2024-09-19T05:33:13.536509+0000","last_unstale":"2024-09-19T05:33:20.007858+0000","last_undegraded":"2024-09-19T05:33:20.007858+0000","last_fullsized":"2024-09-19T05:33:20.007858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:27.720089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924007+0000","last_change":"2024-09-19T05:33:13.541454+0000","last_active":"2024-09-19T05:33:20.924007+0000","last_peered":"2024-09-19T05:33:20.924007+0000","last_clean":"2024-09-19T05:33:20.924007+0000","last_became_active":"2024-09-19T05:33:13.536977+0000","last_became_peered":"2024-09-19T05:33:13.536977+0000","last_unstale":"2024-09-19T05:33:20.924007+0000","last_undegraded":"2024-09-19T05:33:20.924007+0000","last_fullsized":"2024-09-19T05:33:20.924007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:47.982621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123776+0000","last_change":"2024-09-19T05:33:14.547549+0000","last_active":"2024-09-19T05:33:20.123776+0000","last_peered":"2024-09-19T05:33:20.123776+0000","last_clean":"2024-09-19T05:33:20.123776+0000","last_became_active":"2024-09-19T05:33:14.547287+0000","last_became_peered":"2024-09-19T05:33:14.547287+0000","last_unstale":"2024-09-19T05:33:20.123776+0000","last_undegraded":"2024-09-19T05:33:20.123776+0000","last_fullsized":"2024-09-19T05:33:20.123776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576575+0000","last_change":"2024-09-19T05:33:18.605731+0000","last_active":"2024-09-19T05:33:19.576575+0000","last_peered":"2024-09-19T05:33:19.576575+0000","last_clean":"2024-09-19T05:33:19.576575+0000","last_became_active":"2024-09-19T05:33:18.605085+0000","last_became_peered":"2024-09-19T05:33:18.605085+0000","last_unstale":"2024-09-19T05:33:19.576575+0000","last_undegraded":"2024-09-19T05:33:19.576575+0000","last_fullsized":"2024-09-19T05:33:19.576575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:27.605669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007619+0000","last_change":"2024-09-19T05:33:13.525111+0000","last_active":"2024-09-19T05:33:20.007619+0000","last_peered":"2024-09-19T05:33:20.007619+0000","last_clean":"2024-09-19T05:33:20.007619+0000","last_became_active":"2024-09-19T05:33:13.524706+0000","last_became_peered":"2024-09-19T05:33:13.524706+0000","last_unstale":"2024-09-19T05:33:20.007619+0000","last_undegraded":"2024-09-19T05:33:20.007619+0000","last_fullsized":"2024-09-19T05:33:20.007619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:11.761526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577527+0000","last_change":"2024-09-19T05:33:14.530059+0000","last_active":"2024-09-19T05:33:19.577527+0000","last_peered":"2024-09-19T05:33:19.577527+0000","last_clean":"2024-09-19T05:33:19.577527+0000","last_became_active":"2024-09-19T05:33:14.529323+0000","last_became_peered":"2024-09-19T05:33:14.529323+0000","last_unstale":"2024-09-19T05:33:19.577527+0000","last_undegraded":"2024-09-19T05:33:19.577527+0000","last_fullsized":"2024-09-19T05:33:19.577527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:42.202499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007585+0000","last_change":"2024-09-19T05:33:18.597937+0000","last_active":"2024-09-19T05:33:20.007585+0000","last_peered":"2024-09-19T05:33:20.007585+0000","last_clean":"2024-09-19T05:33:20.007585+0000","last_became_active":"2024-09-19T05:33:18.596030+0000","last_became_peered":"2024-09-19T05:33:18.596030+0000","last_unstale":"2024-09-19T05:33:20.007585+0000","last_undegraded":"2024-09-19T05:33:20.007585+0000","last_fullsized":"2024-09-19T05:33:20.007585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.813147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922700+0000","last_change":"2024-09-19T05:33:14.537267+0000","last_active":"2024-09-19T05:33:20.922700+0000","last_peered":"2024-09-19T05:33:20.922700+0000","last_clean":"2024-09-19T05:33:20.922700+0000","last_became_active":"2024-09-19T05:33:14.536536+0000","last_became_peered":"2024-09-19T05:33:14.536536+0000","last_unstale":"2024-09-19T05:33:20.922700+0000","last_undegraded":"2024-09-19T05:33:20.922700+0000","last_fullsized":"2024-09-19T05:33:20.922700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576104+0000","last_change":"2024-09-19T05:33:14.526620+0000","last_active":"2024-09-19T05:33:19.576104+0000","last_peered":"2024-09-19T05:33:19.576104+0000","last_clean":"2024-09-19T05:33:19.576104+0000","last_became_active":"2024-09-19T05:33:14.526328+0000","last_became_peered":"2024-09-19T05:33:14.526328+0000","last_unstale":"2024-09-19T05:33:19.576104+0000","last_undegraded":"2024-09-19T05:33:19.576104+0000","last_fullsized":"2024-09-19T05:33:19.576104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:30.041945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543608+0000","last_change":"2024-09-19T05:33:14.559878+0000","last_active":"2024-09-19T05:33:20.543608+0000","last_peered":"2024-09-19T05:33:20.543608+0000","last_clean":"2024-09-19T05:33:20.543608+0000","last_became_active":"2024-09-19T05:33:14.559351+0000","last_became_peered":"2024-09-19T05:33:14.559351+0000","last_unstale":"2024-09-19T05:33:20.543608+0000","last_undegraded":"2024-09-19T05:33:20.543608+0000","last_fullsized":"2024-09-19T05:33:20.543608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:59.661877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123777+0000","last_change":"2024-09-19T05:33:14.530062+0000","last_active":"2024-09-19T05:33:20.123777+0000","last_peered":"2024-09-19T05:33:20.123777+0000","last_clean":"2024-09-19T05:33:20.123777+0000","last_became_active":"2024-09-19T05:33:14.529783+0000","last_became_peered":"2024-09-19T05:33:14.529783+0000","last_unstale":"2024-09-19T05:33:20.123777+0000","last_undegraded":"2024-09-19T05:33:20.123777+0000","last_fullsized":"2024-09-19T05:33:20.123777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007840+0000","last_change":"2024-09-19T05:33:14.542588+0000","last_active":"2024-09-19T05:33:20.007840+0000","last_peered":"2024-09-19T05:33:20.007840+0000","last_clean":"2024-09-19T05:33:20.007840+0000","last_became_active":"2024-09-19T05:33:14.542329+0000","last_became_peered":"2024-09-19T05:33:14.542329+0000","last_unstale":"2024-09-19T05:33:20.007840+0000","last_undegraded":"2024-09-19T05:33:20.007840+0000","last_fullsized":"2024-09-19T05:33:20.007840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923626+0000","last_change":"2024-09-19T05:33:14.526902+0000","last_active":"2024-09-19T05:33:20.923626+0000","last_peered":"2024-09-19T05:33:20.923626+0000","last_clean":"2024-09-19T05:33:20.923626+0000","last_became_active":"2024-09-19T05:33:14.526640+0000","last_became_peered":"2024-09-19T05:33:14.526640+0000","last_unstale":"2024-09-19T05:33:20.923626+0000","last_undegraded":"2024-09-19T05:33:20.923626+0000","last_fullsized":"2024-09-19T05:33:20.923626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926202+0000","last_change":"2024-09-19T05:33:14.559155+0000","last_active":"2024-09-19T05:33:20.926202+0000","last_peered":"2024-09-19T05:33:20.926202+0000","last_clean":"2024-09-19T05:33:20.926202+0000","last_became_active":"2024-09-19T05:33:14.558755+0000","last_became_peered":"2024-09-19T05:33:14.558755+0000","last_unstale":"2024-09-19T05:33:20.926202+0000","last_undegraded":"2024-09-19T05:33:20.926202+0000","last_fullsized":"2024-09-19T05:33:20.926202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.008000+0000","last_change":"2024-09-19T05:33:14.541132+0000","last_active":"2024-09-19T05:33:20.008000+0000","last_peered":"2024-09-19T05:33:20.008000+0000","last_clean":"2024-09-19T05:33:20.008000+0000","last_became_active":"2024-09-19T05:33:14.540863+0000","last_became_peered":"2024-09-19T05:33:14.540863+0000","last_unstale":"2024-09-19T05:33:20.008000+0000","last_undegraded":"2024-09-19T05:33:20.008000+0000","last_fullsized":"2024-09-19T05:33:20.008000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:20.717515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542901+0000","last_change":"2024-09-19T05:33:14.533210+0000","last_active":"2024-09-19T05:33:20.542901+0000","last_peered":"2024-09-19T05:33:20.542901+0000","last_clean":"2024-09-19T05:33:20.542901+0000","last_became_active":"2024-09-19T05:33:14.532432+0000","last_became_peered":"2024-09-19T05:33:14.532432+0000","last_unstale":"2024-09-19T05:33:20.542901+0000","last_undegraded":"2024-09-19T05:33:20.542901+0000","last_fullsized":"2024-09-19T05:33:20.542901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:52.178220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007605+0000","last_change":"2024-09-19T05:33:14.547002+0000","last_active":"2024-09-19T05:33:20.007605+0000","last_peered":"2024-09-19T05:33:20.007605+0000","last_clean":"2024-09-19T05:33:20.007605+0000","last_became_active":"2024-09-19T05:33:14.546737+0000","last_became_peered":"2024-09-19T05:33:14.546737+0000","last_unstale":"2024-09-19T05:33:20.007605+0000","last_undegraded":"2024-09-19T05:33:20.007605+0000","last_fullsized":"2024-09-19T05:33:20.007605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:45.387641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543418+0000","last_change":"2024-09-19T05:33:14.568172+0000","last_active":"2024-09-19T05:33:20.543418+0000","last_peered":"2024-09-19T05:33:20.543418+0000","last_clean":"2024-09-19T05:33:20.543418+0000","last_became_active":"2024-09-19T05:33:14.567760+0000","last_became_peered":"2024-09-19T05:33:14.567760+0000","last_unstale":"2024-09-19T05:33:20.543418+0000","last_undegraded":"2024-09-19T05:33:20.543418+0000","last_fullsized":"2024-09-19T05:33:20.543418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:30.905148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123485+0000","last_change":"2024-09-19T05:33:14.558783+0000","last_active":"2024-09-19T05:33:20.123485+0000","last_peered":"2024-09-19T05:33:20.123485+0000","last_clean":"2024-09-19T05:33:20.123485+0000","last_became_active":"2024-09-19T05:33:14.558567+0000","last_became_peered":"2024-09-19T05:33:14.558567+0000","last_unstale":"2024-09-19T05:33:20.123485+0000","last_undegraded":"2024-09-19T05:33:20.123485+0000","last_fullsized":"2024-09-19T05:33:20.123485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923405+0000","last_change":"2024-09-19T05:33:14.551691+0000","last_active":"2024-09-19T05:33:20.923405+0000","last_peered":"2024-09-19T05:33:20.923405+0000","last_clean":"2024-09-19T05:33:20.923405+0000","last_became_active":"2024-09-19T05:33:14.549872+0000","last_became_peered":"2024-09-19T05:33:14.549872+0000","last_unstale":"2024-09-19T05:33:20.923405+0000","last_undegraded":"2024-09-19T05:33:20.923405+0000","last_fullsized":"2024-09-19T05:33:20.923405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924685+0000","last_change":"2024-09-19T05:33:14.556297+0000","last_active":"2024-09-19T05:33:20.924685+0000","last_peered":"2024-09-19T05:33:20.924685+0000","last_clean":"2024-09-19T05:33:20.924685+0000","last_became_active":"2024-09-19T05:33:14.555403+0000","last_became_peered":"2024-09-19T05:33:14.555403+0000","last_unstale":"2024-09-19T05:33:20.924685+0000","last_undegraded":"2024-09-19T05:33:20.924685+0000","last_fullsized":"2024-09-19T05:33:20.924685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:43.916813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576705+0000","last_change":"2024-09-19T05:33:14.535228+0000","last_active":"2024-09-19T05:33:19.576705+0000","last_peered":"2024-09-19T05:33:19.576705+0000","last_clean":"2024-09-19T05:33:19.576705+0000","last_became_active":"2024-09-19T05:33:14.534931+0000","last_became_peered":"2024-09-19T05:33:14.534931+0000","last_unstale":"2024-09-19T05:33:19.576705+0000","last_undegraded":"2024-09-19T05:33:19.576705+0000","last_fullsized":"2024-09-19T05:33:19.576705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:12.979751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544152+0000","last_change":"2024-09-19T05:33:14.565336+0000","last_active":"2024-09-19T05:33:20.544152+0000","last_peered":"2024-09-19T05:33:20.544152+0000","last_clean":"2024-09-19T05:33:20.544152+0000","last_became_active":"2024-09-19T05:33:14.564756+0000","last_became_peered":"2024-09-19T05:33:14.564756+0000","last_unstale":"2024-09-19T05:33:20.544152+0000","last_undegraded":"2024-09-19T05:33:20.544152+0000","last_fullsized":"2024-09-19T05:33:20.544152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:07.067023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542591+0000","last_change":"2024-09-19T05:33:14.552325+0000","last_active":"2024-09-19T05:33:20.542591+0000","last_peered":"2024-09-19T05:33:20.542591+0000","last_clean":"2024-09-19T05:33:20.542591+0000","last_became_active":"2024-09-19T05:33:14.551613+0000","last_became_peered":"2024-09-19T05:33:14.551613+0000","last_unstale":"2024-09-19T05:33:20.542591+0000","last_undegraded":"2024-09-19T05:33:20.542591+0000","last_fullsized":"2024-09-19T05:33:20.542591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:07.394046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922935+0000","last_change":"2024-09-19T05:33:14.546485+0000","last_active":"2024-09-19T05:33:20.922935+0000","last_peered":"2024-09-19T05:33:20.922935+0000","last_clean":"2024-09-19T05:33:20.922935+0000","last_became_active":"2024-09-19T05:33:14.546193+0000","last_became_peered":"2024-09-19T05:33:14.546193+0000","last_unstale":"2024-09-19T05:33:20.922935+0000","last_undegraded":"2024-09-19T05:33:20.922935+0000","last_fullsized":"2024-09-19T05:33:20.922935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123351+0000","last_change":"2024-09-19T05:33:14.531122+0000","last_active":"2024-09-19T05:33:20.123351+0000","last_peered":"2024-09-19T05:33:20.123351+0000","last_clean":"2024-09-19T05:33:20.123351+0000","last_became_active":"2024-09-19T05:33:14.530715+0000","last_became_peered":"2024-09-19T05:33:14.530715+0000","last_unstale":"2024-09-19T05:33:20.123351+0000","last_undegraded":"2024-09-19T05:33:20.123351+0000","last_fullsized":"2024-09-19T05:33:20.123351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:45.387641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007456+0000","last_change":"2024-09-19T05:33:14.560886+0000","last_active":"2024-09-19T05:33:20.007456+0000","last_peered":"2024-09-19T05:33:20.007456+0000","last_clean":"2024-09-19T05:33:20.007456+0000","last_became_active":"2024-09-19T05:33:14.560569+0000","last_became_peered":"2024-09-19T05:33:14.560569+0000","last_unstale":"2024-09-19T05:33:20.007456+0000","last_undegraded":"2024-09-19T05:33:20.007456+0000","last_fullsized":"2024-09-19T05:33:20.007456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578400+0000","last_change":"2024-09-19T05:33:14.539186+0000","last_active":"2024-09-19T05:33:19.578400+0000","last_peered":"2024-09-19T05:33:19.578400+0000","last_clean":"2024-09-19T05:33:19.578400+0000","last_became_active":"2024-09-19T05:33:14.538758+0000","last_became_peered":"2024-09-19T05:33:14.538758+0000","last_unstale":"2024-09-19T05:33:19.578400+0000","last_undegraded":"2024-09-19T05:33:19.578400+0000","last_fullsized":"2024-09-19T05:33:19.578400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:59.297383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925456+0000","last_change":"2024-09-19T05:33:14.568844+0000","last_active":"2024-09-19T05:33:20.925456+0000","last_peered":"2024-09-19T05:33:20.925456+0000","last_clean":"2024-09-19T05:33:20.925456+0000","last_became_active":"2024-09-19T05:33:14.565254+0000","last_became_peered":"2024-09-19T05:33:14.565254+0000","last_unstale":"2024-09-19T05:33:20.925456+0000","last_undegraded":"2024-09-19T05:33:20.925456+0000","last_fullsized":"2024-09-19T05:33:20.925456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926051+0000","last_change":"2024-09-19T05:33:14.561841+0000","last_active":"2024-09-19T05:33:20.926051+0000","last_peered":"2024-09-19T05:33:20.926051+0000","last_clean":"2024-09-19T05:33:20.926051+0000","last_became_active":"2024-09-19T05:33:14.561439+0000","last_became_peered":"2024-09-19T05:33:14.561439+0000","last_unstale":"2024-09-19T05:33:20.926051+0000","last_undegraded":"2024-09-19T05:33:20.926051+0000","last_fullsized":"2024-09-19T05:33:20.926051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925143+0000","last_change":"2024-09-19T05:33:14.573138+0000","last_active":"2024-09-19T05:33:20.925143+0000","last_peered":"2024-09-19T05:33:20.925143+0000","last_clean":"2024-09-19T05:33:20.925143+0000","last_became_active":"2024-09-19T05:33:14.564119+0000","last_became_peered":"2024-09-19T05:33:14.564119+0000","last_unstale":"2024-09-19T05:33:20.925143+0000","last_undegraded":"2024-09-19T05:33:20.925143+0000","last_fullsized":"2024-09-19T05:33:20.925143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:53.695703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006962+0000","last_change":"2024-09-19T05:33:14.528043+0000","last_active":"2024-09-19T05:33:20.006962+0000","last_peered":"2024-09-19T05:33:20.006962+0000","last_clean":"2024-09-19T05:33:20.006962+0000","last_became_active":"2024-09-19T05:33:14.527737+0000","last_became_peered":"2024-09-19T05:33:14.527737+0000","last_unstale":"2024-09-19T05:33:20.006962+0000","last_undegraded":"2024-09-19T05:33:20.006962+0000","last_fullsized":"2024-09-19T05:33:20.006962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:29.911108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925350+0000","last_change":"2024-09-19T05:33:14.555049+0000","last_active":"2024-09-19T05:33:20.925350+0000","last_peered":"2024-09-19T05:33:20.925350+0000","last_clean":"2024-09-19T05:33:20.925350+0000","last_became_active":"2024-09-19T05:33:14.554452+0000","last_became_peered":"2024-09-19T05:33:14.554452+0000","last_unstale":"2024-09-19T05:33:20.925350+0000","last_undegraded":"2024-09-19T05:33:20.925350+0000","last_fullsized":"2024-09-19T05:33:20.925350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543115+0000","last_change":"2024-09-19T05:33:14.562090+0000","last_active":"2024-09-19T05:33:20.543115+0000","last_peered":"2024-09-19T05:33:20.543115+0000","last_clean":"2024-09-19T05:33:20.543115+0000","last_became_active":"2024-09-19T05:33:14.561559+0000","last_became_peered":"2024-09-19T05:33:14.561559+0000","last_unstale":"2024-09-19T05:33:20.543115+0000","last_undegraded":"2024-09-19T05:33:20.543115+0000","last_fullsized":"2024-09-19T05:33:20.543115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:53.148319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923829+0000","last_change":"2024-09-19T05:33:14.558005+0000","last_active":"2024-09-19T05:33:20.923829+0000","last_peered":"2024-09-19T05:33:20.923829+0000","last_clean":"2024-09-19T05:33:20.923829+0000","last_became_active":"2024-09-19T05:33:14.556969+0000","last_became_peered":"2024-09-19T05:33:14.556969+0000","last_unstale":"2024-09-19T05:33:20.923829+0000","last_undegraded":"2024-09-19T05:33:20.923829+0000","last_fullsized":"2024-09-19T05:33:20.923829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:28.714509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543428+0000","last_change":"2024-09-19T05:33:14.562103+0000","last_active":"2024-09-19T05:33:20.543428+0000","last_peered":"2024-09-19T05:33:20.543428+0000","last_clean":"2024-09-19T05:33:20.543428+0000","last_became_active":"2024-09-19T05:33:14.561395+0000","last_became_peered":"2024-09-19T05:33:14.561395+0000","last_unstale":"2024-09-19T05:33:20.543428+0000","last_undegraded":"2024-09-19T05:33:20.543428+0000","last_fullsized":"2024-09-19T05:33:20.543428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:49.601339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123567+0000","last_change":"2024-09-19T05:33:14.523507+0000","last_active":"2024-09-19T05:33:20.123567+0000","last_peered":"2024-09-19T05:33:20.123567+0000","last_clean":"2024-09-19T05:33:20.123567+0000","last_became_active":"2024-09-19T05:33:14.523206+0000","last_became_peered":"2024-09-19T05:33:14.523206+0000","last_unstale":"2024-09-19T05:33:20.123567+0000","last_undegraded":"2024-09-19T05:33:20.123567+0000","last_fullsized":"2024-09-19T05:33:20.123567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924802+0000","last_change":"2024-09-19T05:33:14.537324+0000","last_active":"2024-09-19T05:33:20.924802+0000","last_peered":"2024-09-19T05:33:20.924802+0000","last_clean":"2024-09-19T05:33:20.924802+0000","last_became_active":"2024-09-19T05:33:14.536850+0000","last_became_peered":"2024-09-19T05:33:14.536850+0000","last_unstale":"2024-09-19T05:33:20.924802+0000","last_undegraded":"2024-09-19T05:33:20.924802+0000","last_fullsized":"2024-09-19T05:33:20.924802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924919+0000","last_change":"2024-09-19T05:33:14.559373+0000","last_active":"2024-09-19T05:33:20.924919+0000","last_peered":"2024-09-19T05:33:20.924919+0000","last_clean":"2024-09-19T05:33:20.924919+0000","last_became_active":"2024-09-19T05:33:14.558720+0000","last_became_peered":"2024-09-19T05:33:14.558720+0000","last_unstale":"2024-09-19T05:33:20.924919+0000","last_undegraded":"2024-09-19T05:33:20.924919+0000","last_fullsized":"2024-09-19T05:33:20.924919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:53.908148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":694435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":103611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":694491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:33:29.238 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:33:29.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3358944640 1 Processor -- start 2024-09-19T05:33:29.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3358944640 1 -- start start 2024-09-19T05:33:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3358944640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3354144e90 0x7f33540d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3358944640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33540ae6c0 0x7f33540b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3358944640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33540b1190 con 0x7f33540aeb00 2024-09-19T05:33:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3358944640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f33540b1470 con 0x7f33540ae6c0 2024-09-19T05:33:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3358944640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f33540b1750 con 0x7f3354144e90 2024-09-19T05:33:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3351d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33540ae6c0 0x7f33540b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3352d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f33540aeb00 0x7f33540b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34466/0 (socket says 172.21.15.67:34466) 2024-09-19T05:33:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3351d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33540ae6c0 0x7f33540b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34362/0 (socket says 172.21.15.67:34362) 2024-09-19T05:33:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3352d9d640 1 -- 172.21.15.67:0/246274892 learned_addr learned my addr 172.21.15.67:0/246274892 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f335259c640 1 --2- 172.21.15.67:0/246274892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3354144e90 0x7f33540d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3351d9b640 1 -- 172.21.15.67:0/246274892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3354144e90 msgr2=0x7f33540d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3351d9b640 1 --2- 172.21.15.67:0/246274892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3354144e90 0x7f33540d1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3351d9b640 1 -- 172.21.15.67:0/246274892 >> v1:172.21.15.67:6789/0 conn(0x7f33540aeb00 legacy=0x7f33540b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f3351d9b640 1 -- 172.21.15.67:0/246274892 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33540b1a30 con 0x7f33540ae6c0 2024-09-19T05:33:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.398+0000 7f335159a640 1 -- 172.21.15.67:0/246274892 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478284406 0 0) 0x7f33540b1190 con 0x7f33540aeb00 2024-09-19T05:33:29.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3351d9b640 1 --2- 172.21.15.67:0/246274892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33540ae6c0 0x7f33540b49e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f33480097c0 tx=0x7f334801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f0eadf2bd4a9a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:29.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f335159a640 1 -- 172.21.15.67:0/246274892 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33480b0070 con 0x7f33540ae6c0 2024-09-19T05:33:29.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f335159a640 1 -- 172.21.15.67:0/246274892 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33480ab600 con 0x7f33540ae6c0 2024-09-19T05:33:29.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f335159a640 1 -- 172.21.15.67:0/246274892 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33480ab9d0 con 0x7f33540ae6c0 2024-09-19T05:33:29.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 -- 172.21.15.67:0/246274892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33540ae6c0 msgr2=0x7f33540b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 --2- 172.21.15.67:0/246274892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33540ae6c0 0x7f33540b49e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f33480097c0 tx=0x7f334801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 -- 172.21.15.67:0/246274892 shutdown_connections 2024-09-19T05:33:29.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 --2- 172.21.15.67:0/246274892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33540ae6c0 0x7f33540b49e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 --2- 172.21.15.67:0/246274892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3354144e90 0x7f33540d1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 -- 172.21.15.67:0/246274892 >> 172.21.15.67:0/246274892 conn(0x7f335409aa30 msgr2=0x7f33540b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:29.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 -- 172.21.15.67:0/246274892 shutdown_connections 2024-09-19T05:33:29.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 -- 172.21.15.67:0/246274892 wait complete. 2024-09-19T05:33:29.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 Processor -- start 2024-09-19T05:33:29.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 -- start start 2024-09-19T05:33:29.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33540ae6c0 0x7f3354160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33540aeb00 0x7f3354161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3354144e90 0x7f335415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3354168880 con 0x7f3354144e90 2024-09-19T05:33:29.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33540b5330 con 0x7f33540aeb00 2024-09-19T05:33:29.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3358944640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3354168a00 con 0x7f33540ae6c0 2024-09-19T05:33:29.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3352d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3354144e90 0x7f335415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3352d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3354144e90 0x7f335415b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34374/0 (socket says 172.21.15.67:34374) 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3352d9d640 1 -- 172.21.15.67:0/682382500 learned_addr learned my addr 172.21.15.67:0/682382500 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f335259c640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33540ae6c0 0x7f3354160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3351d9b640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33540aeb00 0x7f3354161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3352d9d640 1 -- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33540ae6c0 msgr2=0x7f3354160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3352d9d640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33540ae6c0 0x7f3354160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3352d9d640 1 -- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33540aeb00 msgr2=0x7f3354161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3352d9d640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33540aeb00 0x7f3354161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3352d9d640 1 -- 172.21.15.67:0/682382500 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3354143330 con 0x7f3354144e90 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.402+0000 7f3351d9b640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33540aeb00 0x7f3354161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f3352d9d640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3354144e90 0x7f335415b7c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f334c00c7a0 tx=0x7f334c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f3342ffd640 1 -- 172.21.15.67:0/682382500 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c018070 con 0x7f3354144e90 2024-09-19T05:33:29.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f3342ffd640 1 -- 172.21.15.67:0/682382500 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c00a640 con 0x7f3354144e90 2024-09-19T05:33:29.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f3342ffd640 1 -- 172.21.15.67:0/682382500 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c00aab0 con 0x7f3354144e90 2024-09-19T05:33:29.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f3358944640 1 -- 172.21.15.67:0/682382500 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3354143610 con 0x7f3354144e90 2024-09-19T05:33:29.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f3358944640 1 -- 172.21.15.67:0/682382500 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3354143bd0 con 0x7f3354144e90 2024-09-19T05:33:29.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f3358944640 1 -- 172.21.15.67:0/682382500 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33540b49e0 con 0x7f3354144e90 2024-09-19T05:33:29.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f3342ffd640 1 -- 172.21.15.67:0/682382500 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f334c00ac50 con 0x7f3354144e90 2024-09-19T05:33:29.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f3342ffd640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33340678c0 0x7f3334069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f3342ffd640 1 -- 172.21.15.67:0/682382500 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f334c0856c0 con 0x7f3354144e90 2024-09-19T05:33:29.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f335259c640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33340678c0 0x7f3334069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.406+0000 7f335259c640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33340678c0 0x7f3334069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f335415c470 tx=0x7f3344008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:29.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.410+0000 7f3342ffd640 1 -- 172.21.15.67:0/682382500 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f334c055ec0 con 0x7f3354144e90 2024-09-19T05:33:29.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.570+0000 7f3358944640 1 -- 172.21.15.67:0/682382500 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3354165e40 con 0x7f33340678c0 2024-09-19T05:33:29.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.594+0000 7f3342ffd640 1 -- 172.21.15.67:0/682382500 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7f3354165e40 con 0x7f33340678c0 2024-09-19T05:33:29.601 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:29.603 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:33:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 -- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33340678c0 msgr2=0x7f3334069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33340678c0 0x7f3334069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f335415c470 tx=0x7f3344008040 comp rx=0 tx=0).stop 2024-09-19T05:33:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 -- 172.21.15.67:0/682382500 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3354144e90 msgr2=0x7f335415b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3354144e90 0x7f335415b7c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f334c00c7a0 tx=0x7f334c00cc60 comp rx=0 tx=0).stop 2024-09-19T05:33:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 -- 172.21.15.67:0/682382500 shutdown_connections 2024-09-19T05:33:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3354144e90 0x7f335415b7c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33540aeb00 0x7f3354161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33340678c0 0x7f3334069d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 --2- 172.21.15.67:0/682382500 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33540ae6c0 0x7f3354160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 -- 172.21.15.67:0/682382500 >> 172.21.15.67:0/682382500 conn(0x7f335409aa30 msgr2=0x7f33540b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:29.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 -- 172.21.15.67:0/682382500 shutdown_connections 2024-09-19T05:33:29.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.598+0000 7f3358944640 1 -- 172.21.15.67:0/682382500 wait complete. 2024-09-19T05:33:29.621 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-19T05:33:29.109773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219496,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755224,"statfs":{"total":773094113280,"available":772869349376,"internally_reserved":0,"allocated":3350528,"data_stored":2017900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003683"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123907+0000","last_change":"2024-09-19T05:33:13.530341+0000","last_active":"2024-09-19T05:33:20.123907+0000","last_peered":"2024-09-19T05:33:20.123907+0000","last_clean":"2024-09-19T05:33:20.123907+0000","last_became_active":"2024-09-19T05:33:13.530048+0000","last_became_peered":"2024-09-19T05:33:13.530048+0000","last_unstale":"2024-09-19T05:33:20.123907+0000","last_undegraded":"2024-09-19T05:33:20.123907+0000","last_fullsized":"2024-09-19T05:33:20.123907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:42.052958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007572+0000","last_change":"2024-09-19T05:33:14.561113+0000","last_active":"2024-09-19T05:33:20.007572+0000","last_peered":"2024-09-19T05:33:20.007572+0000","last_clean":"2024-09-19T05:33:20.007572+0000","last_became_active":"2024-09-19T05:33:14.560582+0000","last_became_peered":"2024-09-19T05:33:14.560582+0000","last_unstale":"2024-09-19T05:33:20.007572+0000","last_undegraded":"2024-09-19T05:33:20.007572+0000","last_fullsized":"2024-09-19T05:33:20.007572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006991+0000","last_change":"2024-09-19T05:33:18.730325+0000","last_active":"2024-09-19T05:33:20.006991+0000","last_peered":"2024-09-19T05:33:20.006991+0000","last_clean":"2024-09-19T05:33:20.006991+0000","last_became_active":"2024-09-19T05:33:18.729806+0000","last_became_peered":"2024-09-19T05:33:18.729806+0000","last_unstale":"2024-09-19T05:33:20.006991+0000","last_undegraded":"2024-09-19T05:33:20.006991+0000","last_fullsized":"2024-09-19T05:33:20.006991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:39.340032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007739+0000","last_change":"2024-09-19T05:33:13.523215+0000","last_active":"2024-09-19T05:33:20.007739+0000","last_peered":"2024-09-19T05:33:20.007739+0000","last_clean":"2024-09-19T05:33:20.007739+0000","last_became_active":"2024-09-19T05:33:13.522889+0000","last_became_peered":"2024-09-19T05:33:13.522889+0000","last_unstale":"2024-09-19T05:33:20.007739+0000","last_undegraded":"2024-09-19T05:33:20.007739+0000","last_fullsized":"2024-09-19T05:33:20.007739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:42.052958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123695+0000","last_change":"2024-09-19T05:33:14.551843+0000","last_active":"2024-09-19T05:33:20.123695+0000","last_peered":"2024-09-19T05:33:20.123695+0000","last_clean":"2024-09-19T05:33:20.123695+0000","last_became_active":"2024-09-19T05:33:14.551518+0000","last_became_peered":"2024-09-19T05:33:14.551518+0000","last_unstale":"2024-09-19T05:33:20.123695+0000","last_undegraded":"2024-09-19T05:33:20.123695+0000","last_fullsized":"2024-09-19T05:33:20.123695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577133+0000","last_change":"2024-09-19T05:33:18.599217+0000","last_active":"2024-09-19T05:33:19.577133+0000","last_peered":"2024-09-19T05:33:19.577133+0000","last_clean":"2024-09-19T05:33:19.577133+0000","last_became_active":"2024-09-19T05:33:18.598214+0000","last_became_peered":"2024-09-19T05:33:18.598214+0000","last_unstale":"2024-09-19T05:33:19.577133+0000","last_undegraded":"2024-09-19T05:33:19.577133+0000","last_fullsized":"2024-09-19T05:33:19.577133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:34.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924522+0000","last_change":"2024-09-19T05:33:13.543770+0000","last_active":"2024-09-19T05:33:20.924522+0000","last_peered":"2024-09-19T05:33:20.924522+0000","last_clean":"2024-09-19T05:33:20.924522+0000","last_became_active":"2024-09-19T05:33:13.543056+0000","last_became_peered":"2024-09-19T05:33:13.543056+0000","last_unstale":"2024-09-19T05:33:20.924522+0000","last_undegraded":"2024-09-19T05:33:20.924522+0000","last_fullsized":"2024-09-19T05:33:20.924522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543508+0000","last_change":"2024-09-19T05:33:14.570231+0000","last_active":"2024-09-19T05:33:20.543508+0000","last_peered":"2024-09-19T05:33:20.543508+0000","last_clean":"2024-09-19T05:33:20.543508+0000","last_became_active":"2024-09-19T05:33:14.569664+0000","last_became_peered":"2024-09-19T05:33:14.569664+0000","last_unstale":"2024-09-19T05:33:20.543508+0000","last_undegraded":"2024-09-19T05:33:20.543508+0000","last_fullsized":"2024-09-19T05:33:20.543508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.290827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577443+0000","last_change":"2024-09-19T05:33:18.596831+0000","last_active":"2024-09-19T05:33:19.577443+0000","last_peered":"2024-09-19T05:33:19.577443+0000","last_clean":"2024-09-19T05:33:19.577443+0000","last_became_active":"2024-09-19T05:33:18.595733+0000","last_became_peered":"2024-09-19T05:33:18.595733+0000","last_unstale":"2024-09-19T05:33:19.577443+0000","last_undegraded":"2024-09-19T05:33:19.577443+0000","last_fullsized":"2024-09-19T05:33:19.577443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:32.766631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924142+0000","last_change":"2024-09-19T05:33:13.555869+0000","last_active":"2024-09-19T05:33:20.924142+0000","last_peered":"2024-09-19T05:33:20.924142+0000","last_clean":"2024-09-19T05:33:20.924142+0000","last_became_active":"2024-09-19T05:33:13.555335+0000","last_became_peered":"2024-09-19T05:33:13.555335+0000","last_unstale":"2024-09-19T05:33:20.924142+0000","last_undegraded":"2024-09-19T05:33:20.924142+0000","last_fullsized":"2024-09-19T05:33:20.924142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.724638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543769+0000","last_change":"2024-09-19T05:33:14.570470+0000","last_active":"2024-09-19T05:33:20.543769+0000","last_peered":"2024-09-19T05:33:20.543769+0000","last_clean":"2024-09-19T05:33:20.543769+0000","last_became_active":"2024-09-19T05:33:14.569698+0000","last_became_peered":"2024-09-19T05:33:14.569698+0000","last_unstale":"2024-09-19T05:33:20.543769+0000","last_undegraded":"2024-09-19T05:33:20.543769+0000","last_fullsized":"2024-09-19T05:33:20.543769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:06.821907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577368+0000","last_change":"2024-09-19T05:33:18.595934+0000","last_active":"2024-09-19T05:33:19.577368+0000","last_peered":"2024-09-19T05:33:19.577368+0000","last_clean":"2024-09-19T05:33:19.577368+0000","last_became_active":"2024-09-19T05:33:18.594894+0000","last_became_peered":"2024-09-19T05:33:18.594894+0000","last_unstale":"2024-09-19T05:33:19.577368+0000","last_undegraded":"2024-09-19T05:33:19.577368+0000","last_fullsized":"2024-09-19T05:33:19.577368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:40.713471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923638+0000","last_change":"2024-09-19T05:33:14.550250+0000","last_active":"2024-09-19T05:33:20.923638+0000","last_peered":"2024-09-19T05:33:20.923638+0000","last_clean":"2024-09-19T05:33:20.923638+0000","last_became_active":"2024-09-19T05:33:14.549364+0000","last_became_peered":"2024-09-19T05:33:14.549364+0000","last_unstale":"2024-09-19T05:33:20.923638+0000","last_undegraded":"2024-09-19T05:33:20.923638+0000","last_fullsized":"2024-09-19T05:33:20.923638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924425+0000","last_change":"2024-09-19T05:33:13.539570+0000","last_active":"2024-09-19T05:33:20.924425+0000","last_peered":"2024-09-19T05:33:20.924425+0000","last_clean":"2024-09-19T05:33:20.924425+0000","last_became_active":"2024-09-19T05:33:13.538888+0000","last_became_peered":"2024-09-19T05:33:13.538888+0000","last_unstale":"2024-09-19T05:33:20.924425+0000","last_undegraded":"2024-09-19T05:33:20.924425+0000","last_fullsized":"2024-09-19T05:33:20.924425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:45.954638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579051+0000","last_change":"2024-09-19T05:33:18.592794+0000","last_active":"2024-09-19T05:33:19.579051+0000","last_peered":"2024-09-19T05:33:19.579051+0000","last_clean":"2024-09-19T05:33:19.579051+0000","last_became_active":"2024-09-19T05:33:18.591024+0000","last_became_peered":"2024-09-19T05:33:18.591024+0000","last_unstale":"2024-09-19T05:33:19.579051+0000","last_undegraded":"2024-09-19T05:33:19.579051+0000","last_fullsized":"2024-09-19T05:33:19.579051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:57.960270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007498+0000","last_change":"2024-09-19T05:33:14.521242+0000","last_active":"2024-09-19T05:33:20.007498+0000","last_peered":"2024-09-19T05:33:20.007498+0000","last_clean":"2024-09-19T05:33:20.007498+0000","last_became_active":"2024-09-19T05:33:14.520972+0000","last_became_peered":"2024-09-19T05:33:14.520972+0000","last_unstale":"2024-09-19T05:33:20.007498+0000","last_undegraded":"2024-09-19T05:33:20.007498+0000","last_fullsized":"2024-09-19T05:33:20.007498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923376+0000","last_change":"2024-09-19T05:33:13.519454+0000","last_active":"2024-09-19T05:33:20.923376+0000","last_peered":"2024-09-19T05:33:20.923376+0000","last_clean":"2024-09-19T05:33:20.923376+0000","last_became_active":"2024-09-19T05:33:13.518870+0000","last_became_peered":"2024-09-19T05:33:13.518870+0000","last_unstale":"2024-09-19T05:33:20.923376+0000","last_undegraded":"2024-09-19T05:33:20.923376+0000","last_fullsized":"2024-09-19T05:33:20.923376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.724638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579015+0000","last_change":"2024-09-19T05:33:18.604812+0000","last_active":"2024-09-19T05:33:19.579015+0000","last_peered":"2024-09-19T05:33:19.579015+0000","last_clean":"2024-09-19T05:33:19.579015+0000","last_became_active":"2024-09-19T05:33:18.603949+0000","last_became_peered":"2024-09-19T05:33:18.603949+0000","last_unstale":"2024-09-19T05:33:19.579015+0000","last_undegraded":"2024-09-19T05:33:19.579015+0000","last_fullsized":"2024-09-19T05:33:19.579015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:42.509239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007398+0000","last_change":"2024-09-19T05:33:14.530704+0000","last_active":"2024-09-19T05:33:20.007398+0000","last_peered":"2024-09-19T05:33:20.007398+0000","last_clean":"2024-09-19T05:33:20.007398+0000","last_became_active":"2024-09-19T05:33:14.530029+0000","last_became_peered":"2024-09-19T05:33:14.530029+0000","last_unstale":"2024-09-19T05:33:20.007398+0000","last_undegraded":"2024-09-19T05:33:20.007398+0000","last_fullsized":"2024-09-19T05:33:20.007398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922903+0000","last_change":"2024-09-19T05:33:13.536984+0000","last_active":"2024-09-19T05:33:20.922903+0000","last_peered":"2024-09-19T05:33:20.922903+0000","last_clean":"2024-09-19T05:33:20.922903+0000","last_became_active":"2024-09-19T05:33:13.536584+0000","last_became_peered":"2024-09-19T05:33:13.536584+0000","last_unstale":"2024-09-19T05:33:20.922903+0000","last_undegraded":"2024-09-19T05:33:20.922903+0000","last_fullsized":"2024-09-19T05:33:20.922903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924954+0000","last_change":"2024-09-19T05:33:18.731101+0000","last_active":"2024-09-19T05:33:20.924954+0000","last_peered":"2024-09-19T05:33:20.924954+0000","last_clean":"2024-09-19T05:33:20.924954+0000","last_became_active":"2024-09-19T05:33:18.730688+0000","last_became_peered":"2024-09-19T05:33:18.730688+0000","last_unstale":"2024-09-19T05:33:20.924954+0000","last_undegraded":"2024-09-19T05:33:20.924954+0000","last_fullsized":"2024-09-19T05:33:20.924954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:03.333739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578871+0000","last_change":"2024-09-19T05:33:14.543745+0000","last_active":"2024-09-19T05:33:19.578871+0000","last_peered":"2024-09-19T05:33:19.578871+0000","last_clean":"2024-09-19T05:33:19.578871+0000","last_became_active":"2024-09-19T05:33:14.541218+0000","last_became_peered":"2024-09-19T05:33:14.541218+0000","last_unstale":"2024-09-19T05:33:19.578871+0000","last_undegraded":"2024-09-19T05:33:19.578871+0000","last_fullsized":"2024-09-19T05:33:19.578871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:31.945487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923405+0000","last_change":"2024-09-19T05:33:13.534122+0000","last_active":"2024-09-19T05:33:20.923405+0000","last_peered":"2024-09-19T05:33:20.923405+0000","last_clean":"2024-09-19T05:33:20.923405+0000","last_became_active":"2024-09-19T05:33:13.533442+0000","last_became_peered":"2024-09-19T05:33:13.533442+0000","last_unstale":"2024-09-19T05:33:20.923405+0000","last_undegraded":"2024-09-19T05:33:20.923405+0000","last_fullsized":"2024-09-19T05:33:20.923405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578804+0000","last_change":"2024-09-19T05:33:18.595747+0000","last_active":"2024-09-19T05:33:19.578804+0000","last_peered":"2024-09-19T05:33:19.578804+0000","last_clean":"2024-09-19T05:33:19.578804+0000","last_became_active":"2024-09-19T05:33:18.594611+0000","last_became_peered":"2024-09-19T05:33:18.594611+0000","last_unstale":"2024-09-19T05:33:19.578804+0000","last_undegraded":"2024-09-19T05:33:19.578804+0000","last_fullsized":"2024-09-19T05:33:19.578804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:47.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123977+0000","last_change":"2024-09-19T05:33:14.530979+0000","last_active":"2024-09-19T05:33:20.123977+0000","last_peered":"2024-09-19T05:33:20.123977+0000","last_clean":"2024-09-19T05:33:20.123977+0000","last_became_active":"2024-09-19T05:33:14.530680+0000","last_became_peered":"2024-09-19T05:33:14.530680+0000","last_unstale":"2024-09-19T05:33:20.123977+0000","last_undegraded":"2024-09-19T05:33:20.123977+0000","last_fullsized":"2024-09-19T05:33:20.123977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926403+0000","last_change":"2024-09-19T05:33:13.532595+0000","last_active":"2024-09-19T05:33:20.926403+0000","last_peered":"2024-09-19T05:33:20.926403+0000","last_clean":"2024-09-19T05:33:20.926403+0000","last_became_active":"2024-09-19T05:33:13.531963+0000","last_became_peered":"2024-09-19T05:33:13.531963+0000","last_unstale":"2024-09-19T05:33:20.926403+0000","last_undegraded":"2024-09-19T05:33:20.926403+0000","last_fullsized":"2024-09-19T05:33:20.926403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:41.192975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577289+0000","last_change":"2024-09-19T05:33:18.727908+0000","last_active":"2024-09-19T05:33:19.577289+0000","last_peered":"2024-09-19T05:33:19.577289+0000","last_clean":"2024-09-19T05:33:19.577289+0000","last_became_active":"2024-09-19T05:33:18.726858+0000","last_became_peered":"2024-09-19T05:33:18.726858+0000","last_unstale":"2024-09-19T05:33:19.577289+0000","last_undegraded":"2024-09-19T05:33:19.577289+0000","last_fullsized":"2024-09-19T05:33:19.577289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:24.769636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.008051+0000","last_change":"2024-09-19T05:33:14.562327+0000","last_active":"2024-09-19T05:33:20.008051+0000","last_peered":"2024-09-19T05:33:20.008051+0000","last_clean":"2024-09-19T05:33:20.008051+0000","last_became_active":"2024-09-19T05:33:14.561984+0000","last_became_peered":"2024-09-19T05:33:14.561984+0000","last_unstale":"2024-09-19T05:33:20.008051+0000","last_undegraded":"2024-09-19T05:33:20.008051+0000","last_fullsized":"2024-09-19T05:33:20.008051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924849+0000","last_change":"2024-09-19T05:33:13.536758+0000","last_active":"2024-09-19T05:33:20.924849+0000","last_peered":"2024-09-19T05:33:20.924849+0000","last_clean":"2024-09-19T05:33:20.924849+0000","last_became_active":"2024-09-19T05:33:13.536502+0000","last_became_peered":"2024-09-19T05:33:13.536502+0000","last_unstale":"2024-09-19T05:33:20.924849+0000","last_undegraded":"2024-09-19T05:33:20.924849+0000","last_fullsized":"2024-09-19T05:33:20.924849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006886+0000","last_change":"2024-09-19T05:33:18.723398+0000","last_active":"2024-09-19T05:33:20.006886+0000","last_peered":"2024-09-19T05:33:20.006886+0000","last_clean":"2024-09-19T05:33:20.006886+0000","last_became_active":"2024-09-19T05:33:18.722953+0000","last_became_peered":"2024-09-19T05:33:18.722953+0000","last_unstale":"2024-09-19T05:33:20.006886+0000","last_undegraded":"2024-09-19T05:33:20.006886+0000","last_fullsized":"2024-09-19T05:33:20.006886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:15.960409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924131+0000","last_change":"2024-09-19T05:33:14.527703+0000","last_active":"2024-09-19T05:33:20.924131+0000","last_peered":"2024-09-19T05:33:20.924131+0000","last_clean":"2024-09-19T05:33:20.924131+0000","last_became_active":"2024-09-19T05:33:14.527335+0000","last_became_peered":"2024-09-19T05:33:14.527335+0000","last_unstale":"2024-09-19T05:33:20.924131+0000","last_undegraded":"2024-09-19T05:33:20.924131+0000","last_fullsized":"2024-09-19T05:33:20.924131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924672+0000","last_change":"2024-09-19T05:33:13.534591+0000","last_active":"2024-09-19T05:33:20.924672+0000","last_peered":"2024-09-19T05:33:20.924672+0000","last_clean":"2024-09-19T05:33:20.924672+0000","last_became_active":"2024-09-19T05:33:13.533520+0000","last_became_peered":"2024-09-19T05:33:13.533520+0000","last_unstale":"2024-09-19T05:33:20.924672+0000","last_undegraded":"2024-09-19T05:33:20.924672+0000","last_fullsized":"2024-09-19T05:33:20.924672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:40.138729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123671+0000","last_change":"2024-09-19T05:33:18.727847+0000","last_active":"2024-09-19T05:33:20.123671+0000","last_peered":"2024-09-19T05:33:20.123671+0000","last_clean":"2024-09-19T05:33:20.123671+0000","last_became_active":"2024-09-19T05:33:18.727377+0000","last_became_peered":"2024-09-19T05:33:18.727377+0000","last_unstale":"2024-09-19T05:33:20.123671+0000","last_undegraded":"2024-09-19T05:33:20.123671+0000","last_fullsized":"2024-09-19T05:33:20.123671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:47.968935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544028+0000","last_change":"2024-09-19T05:33:14.552094+0000","last_active":"2024-09-19T05:33:20.544028+0000","last_peered":"2024-09-19T05:33:20.544028+0000","last_clean":"2024-09-19T05:33:20.544028+0000","last_became_active":"2024-09-19T05:33:14.551244+0000","last_became_peered":"2024-09-19T05:33:14.551244+0000","last_unstale":"2024-09-19T05:33:20.544028+0000","last_undegraded":"2024-09-19T05:33:20.544028+0000","last_fullsized":"2024-09-19T05:33:20.544028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:29.504706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924385+0000","last_change":"2024-09-19T05:33:13.523378+0000","last_active":"2024-09-19T05:33:20.924385+0000","last_peered":"2024-09-19T05:33:20.924385+0000","last_clean":"2024-09-19T05:33:20.924385+0000","last_became_active":"2024-09-19T05:33:13.523053+0000","last_became_peered":"2024-09-19T05:33:13.523053+0000","last_unstale":"2024-09-19T05:33:20.924385+0000","last_undegraded":"2024-09-19T05:33:20.924385+0000","last_fullsized":"2024-09-19T05:33:20.924385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:41.192975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923121+0000","last_change":"2024-09-19T05:33:18.602228+0000","last_active":"2024-09-19T05:33:20.923121+0000","last_peered":"2024-09-19T05:33:20.923121+0000","last_clean":"2024-09-19T05:33:20.923121+0000","last_became_active":"2024-09-19T05:33:18.601292+0000","last_became_peered":"2024-09-19T05:33:18.601292+0000","last_unstale":"2024-09-19T05:33:20.923121+0000","last_undegraded":"2024-09-19T05:33:20.923121+0000","last_fullsized":"2024-09-19T05:33:20.923121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:57.747825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578328+0000","last_change":"2024-09-19T05:33:14.537118+0000","last_active":"2024-09-19T05:33:19.578328+0000","last_peered":"2024-09-19T05:33:19.578328+0000","last_clean":"2024-09-19T05:33:19.578328+0000","last_became_active":"2024-09-19T05:33:14.535816+0000","last_became_peered":"2024-09-19T05:33:14.535816+0000","last_unstale":"2024-09-19T05:33:19.578328+0000","last_undegraded":"2024-09-19T05:33:19.578328+0000","last_fullsized":"2024-09-19T05:33:19.578328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:49.497300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543873+0000","last_change":"2024-09-19T05:33:13.550593+0000","last_active":"2024-09-19T05:33:20.543873+0000","last_peered":"2024-09-19T05:33:20.543873+0000","last_clean":"2024-09-19T05:33:20.543873+0000","last_became_active":"2024-09-19T05:33:13.549511+0000","last_became_peered":"2024-09-19T05:33:13.549511+0000","last_unstale":"2024-09-19T05:33:20.543873+0000","last_undegraded":"2024-09-19T05:33:20.543873+0000","last_fullsized":"2024-09-19T05:33:20.543873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:13.595105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924258+0000","last_change":"2024-09-19T05:33:18.607825+0000","last_active":"2024-09-19T05:33:20.924258+0000","last_peered":"2024-09-19T05:33:20.924258+0000","last_clean":"2024-09-19T05:33:20.924258+0000","last_became_active":"2024-09-19T05:33:18.606441+0000","last_became_peered":"2024-09-19T05:33:18.606441+0000","last_unstale":"2024-09-19T05:33:20.924258+0000","last_undegraded":"2024-09-19T05:33:20.924258+0000","last_fullsized":"2024-09-19T05:33:20.924258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:47.248958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922997+0000","last_change":"2024-09-19T05:33:14.530018+0000","last_active":"2024-09-19T05:33:20.922997+0000","last_peered":"2024-09-19T05:33:20.922997+0000","last_clean":"2024-09-19T05:33:20.922997+0000","last_became_active":"2024-09-19T05:33:14.528997+0000","last_became_peered":"2024-09-19T05:33:14.528997+0000","last_unstale":"2024-09-19T05:33:20.922997+0000","last_undegraded":"2024-09-19T05:33:20.922997+0000","last_fullsized":"2024-09-19T05:33:20.922997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576385+0000","last_change":"2024-09-19T05:33:13.518923+0000","last_active":"2024-09-19T05:33:19.576385+0000","last_peered":"2024-09-19T05:33:19.576385+0000","last_clean":"2024-09-19T05:33:19.576385+0000","last_became_active":"2024-09-19T05:33:13.517867+0000","last_became_peered":"2024-09-19T05:33:13.517867+0000","last_unstale":"2024-09-19T05:33:19.576385+0000","last_undegraded":"2024-09-19T05:33:19.576385+0000","last_fullsized":"2024-09-19T05:33:19.576385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:41.939363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925137+0000","last_change":"2024-09-19T05:33:18.600087+0000","last_active":"2024-09-19T05:33:20.925137+0000","last_peered":"2024-09-19T05:33:20.925137+0000","last_clean":"2024-09-19T05:33:20.925137+0000","last_became_active":"2024-09-19T05:33:18.599484+0000","last_became_peered":"2024-09-19T05:33:18.599484+0000","last_unstale":"2024-09-19T05:33:20.925137+0000","last_undegraded":"2024-09-19T05:33:20.925137+0000","last_fullsized":"2024-09-19T05:33:20.925137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:03.032844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123142+0000","last_change":"2024-09-19T05:33:14.549619+0000","last_active":"2024-09-19T05:33:20.123142+0000","last_peered":"2024-09-19T05:33:20.123142+0000","last_clean":"2024-09-19T05:33:20.123142+0000","last_became_active":"2024-09-19T05:33:14.549390+0000","last_became_peered":"2024-09-19T05:33:14.549390+0000","last_unstale":"2024-09-19T05:33:20.123142+0000","last_undegraded":"2024-09-19T05:33:20.123142+0000","last_fullsized":"2024-09-19T05:33:20.123142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:29.911108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923683+0000","last_change":"2024-09-19T05:33:13.533988+0000","last_active":"2024-09-19T05:33:20.923683+0000","last_peered":"2024-09-19T05:33:20.923683+0000","last_clean":"2024-09-19T05:33:20.923683+0000","last_became_active":"2024-09-19T05:33:13.533251+0000","last_became_peered":"2024-09-19T05:33:13.533251+0000","last_unstale":"2024-09-19T05:33:20.923683+0000","last_undegraded":"2024-09-19T05:33:20.923683+0000","last_fullsized":"2024-09-19T05:33:20.923683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123842+0000","last_change":"2024-09-19T05:33:18.731732+0000","last_active":"2024-09-19T05:33:20.123842+0000","last_peered":"2024-09-19T05:33:20.123842+0000","last_clean":"2024-09-19T05:33:20.123842+0000","last_became_active":"2024-09-19T05:33:18.731060+0000","last_became_peered":"2024-09-19T05:33:18.731060+0000","last_unstale":"2024-09-19T05:33:20.123842+0000","last_undegraded":"2024-09-19T05:33:20.123842+0000","last_fullsized":"2024-09-19T05:33:20.123842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:03.333739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007078+0000","last_change":"2024-09-19T05:33:14.564726+0000","last_active":"2024-09-19T05:33:20.007078+0000","last_peered":"2024-09-19T05:33:20.007078+0000","last_clean":"2024-09-19T05:33:20.007078+0000","last_became_active":"2024-09-19T05:33:14.564425+0000","last_became_peered":"2024-09-19T05:33:14.564425+0000","last_unstale":"2024-09-19T05:33:20.007078+0000","last_undegraded":"2024-09-19T05:33:20.007078+0000","last_fullsized":"2024-09-19T05:33:20.007078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543194+0000","last_change":"2024-09-19T05:33:13.553641+0000","last_active":"2024-09-19T05:33:20.543194+0000","last_peered":"2024-09-19T05:33:20.543194+0000","last_clean":"2024-09-19T05:33:20.543194+0000","last_became_active":"2024-09-19T05:33:13.552684+0000","last_became_peered":"2024-09-19T05:33:13.552684+0000","last_unstale":"2024-09-19T05:33:20.543194+0000","last_undegraded":"2024-09-19T05:33:20.543194+0000","last_fullsized":"2024-09-19T05:33:20.543194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:01.312371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922618+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:33:20.922618+0000","last_peered":"2024-09-19T05:33:20.922618+0000","last_clean":"2024-09-19T05:33:20.922618+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:33:20.922618+0000","last_undegraded":"2024-09-19T05:33:20.922618+0000","last_fullsized":"2024-09-19T05:33:20.922618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923213+0000","last_change":"2024-09-19T05:33:18.730082+0000","last_active":"2024-09-19T05:33:20.923213+0000","last_peered":"2024-09-19T05:33:20.923213+0000","last_clean":"2024-09-19T05:33:20.923213+0000","last_became_active":"2024-09-19T05:33:18.728956+0000","last_became_peered":"2024-09-19T05:33:18.728956+0000","last_unstale":"2024-09-19T05:33:20.923213+0000","last_undegraded":"2024-09-19T05:33:20.923213+0000","last_fullsized":"2024-09-19T05:33:20.923213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:42.509239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924260+0000","last_change":"2024-09-19T05:33:14.556753+0000","last_active":"2024-09-19T05:33:20.924260+0000","last_peered":"2024-09-19T05:33:20.924260+0000","last_clean":"2024-09-19T05:33:20.924260+0000","last_became_active":"2024-09-19T05:33:14.555774+0000","last_became_peered":"2024-09-19T05:33:14.555774+0000","last_unstale":"2024-09-19T05:33:20.924260+0000","last_undegraded":"2024-09-19T05:33:20.924260+0000","last_fullsized":"2024-09-19T05:33:20.924260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:43.675511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576694+0000","last_change":"2024-09-19T05:33:13.554975+0000","last_active":"2024-09-19T05:33:19.576694+0000","last_peered":"2024-09-19T05:33:19.576694+0000","last_clean":"2024-09-19T05:33:19.576694+0000","last_became_active":"2024-09-19T05:33:13.554687+0000","last_became_peered":"2024-09-19T05:33:13.554687+0000","last_unstale":"2024-09-19T05:33:19.576694+0000","last_undegraded":"2024-09-19T05:33:19.576694+0000","last_fullsized":"2024-09-19T05:33:19.576694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:19.118135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923096+0000","last_change":"2024-09-19T05:33:18.725840+0000","last_active":"2024-09-19T05:33:20.923096+0000","last_peered":"2024-09-19T05:33:20.923096+0000","last_clean":"2024-09-19T05:33:20.923096+0000","last_became_active":"2024-09-19T05:33:18.724609+0000","last_became_peered":"2024-09-19T05:33:18.724609+0000","last_unstale":"2024-09-19T05:33:20.923096+0000","last_undegraded":"2024-09-19T05:33:20.923096+0000","last_fullsized":"2024-09-19T05:33:20.923096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:47.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543949+0000","last_change":"2024-09-19T05:33:14.537550+0000","last_active":"2024-09-19T05:33:20.543949+0000","last_peered":"2024-09-19T05:33:20.543949+0000","last_clean":"2024-09-19T05:33:20.543949+0000","last_became_active":"2024-09-19T05:33:14.536832+0000","last_became_peered":"2024-09-19T05:33:14.536832+0000","last_unstale":"2024-09-19T05:33:20.543949+0000","last_undegraded":"2024-09-19T05:33:20.543949+0000","last_fullsized":"2024-09-19T05:33:20.543949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:45.451882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924358+0000","last_change":"2024-09-19T05:33:13.524749+0000","last_active":"2024-09-19T05:33:20.924358+0000","last_peered":"2024-09-19T05:33:20.924358+0000","last_clean":"2024-09-19T05:33:20.924358+0000","last_became_active":"2024-09-19T05:33:13.523674+0000","last_became_peered":"2024-09-19T05:33:13.523674+0000","last_unstale":"2024-09-19T05:33:20.924358+0000","last_undegraded":"2024-09-19T05:33:20.924358+0000","last_fullsized":"2024-09-19T05:33:20.924358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:45.954638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123714+0000","last_change":"2024-09-19T05:33:18.598514+0000","last_active":"2024-09-19T05:33:20.123714+0000","last_peered":"2024-09-19T05:33:20.123714+0000","last_clean":"2024-09-19T05:33:20.123714+0000","last_became_active":"2024-09-19T05:33:18.598011+0000","last_became_peered":"2024-09-19T05:33:18.598011+0000","last_unstale":"2024-09-19T05:33:20.123714+0000","last_undegraded":"2024-09-19T05:33:20.123714+0000","last_fullsized":"2024-09-19T05:33:20.123714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.531745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925304+0000","last_change":"2024-09-19T05:33:14.574183+0000","last_active":"2024-09-19T05:33:20.925304+0000","last_peered":"2024-09-19T05:33:20.925304+0000","last_clean":"2024-09-19T05:33:20.925304+0000","last_became_active":"2024-09-19T05:33:14.572292+0000","last_became_peered":"2024-09-19T05:33:14.572292+0000","last_unstale":"2024-09-19T05:33:20.925304+0000","last_undegraded":"2024-09-19T05:33:20.925304+0000","last_fullsized":"2024-09-19T05:33:20.925304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:23.479624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576694+0000","last_change":"2024-09-19T05:33:13.518160+0000","last_active":"2024-09-19T05:33:19.576694+0000","last_peered":"2024-09-19T05:33:19.576694+0000","last_clean":"2024-09-19T05:33:19.576694+0000","last_became_active":"2024-09-19T05:33:13.517669+0000","last_became_peered":"2024-09-19T05:33:13.517669+0000","last_unstale":"2024-09-19T05:33:19.576694+0000","last_undegraded":"2024-09-19T05:33:19.576694+0000","last_fullsized":"2024-09-19T05:33:19.576694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.869187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542731+0000","last_change":"2024-09-19T05:33:18.731204+0000","last_active":"2024-09-19T05:33:20.542731+0000","last_peered":"2024-09-19T05:33:20.542731+0000","last_clean":"2024-09-19T05:33:20.542731+0000","last_became_active":"2024-09-19T05:33:18.730150+0000","last_became_peered":"2024-09-19T05:33:18.730150+0000","last_unstale":"2024-09-19T05:33:20.542731+0000","last_undegraded":"2024-09-19T05:33:20.542731+0000","last_fullsized":"2024-09-19T05:33:20.542731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:39.847635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924886+0000","last_change":"2024-09-19T05:33:14.568190+0000","last_active":"2024-09-19T05:33:20.924886+0000","last_peered":"2024-09-19T05:33:20.924886+0000","last_clean":"2024-09-19T05:33:20.924886+0000","last_became_active":"2024-09-19T05:33:14.566383+0000","last_became_peered":"2024-09-19T05:33:14.566383+0000","last_unstale":"2024-09-19T05:33:20.924886+0000","last_undegraded":"2024-09-19T05:33:20.924886+0000","last_fullsized":"2024-09-19T05:33:20.924886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:43.196836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578722+0000","last_change":"2024-09-19T05:33:13.523746+0000","last_active":"2024-09-19T05:33:19.578722+0000","last_peered":"2024-09-19T05:33:19.578722+0000","last_clean":"2024-09-19T05:33:19.578722+0000","last_became_active":"2024-09-19T05:33:13.522995+0000","last_became_peered":"2024-09-19T05:33:13.522995+0000","last_unstale":"2024-09-19T05:33:19.578722+0000","last_undegraded":"2024-09-19T05:33:19.578722+0000","last_fullsized":"2024-09-19T05:33:19.578722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:37.675142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576913+0000","last_change":"2024-09-19T05:33:18.595330+0000","last_active":"2024-09-19T05:33:19.576913+0000","last_peered":"2024-09-19T05:33:19.576913+0000","last_clean":"2024-09-19T05:33:19.576913+0000","last_became_active":"2024-09-19T05:33:18.594314+0000","last_became_peered":"2024-09-19T05:33:18.594314+0000","last_unstale":"2024-09-19T05:33:19.576913+0000","last_undegraded":"2024-09-19T05:33:19.576913+0000","last_fullsized":"2024-09-19T05:33:19.576913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:17.535329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925421+0000","last_change":"2024-09-19T05:33:14.568254+0000","last_active":"2024-09-19T05:33:20.925421+0000","last_peered":"2024-09-19T05:33:20.925421+0000","last_clean":"2024-09-19T05:33:20.925421+0000","last_became_active":"2024-09-19T05:33:14.567525+0000","last_became_peered":"2024-09-19T05:33:14.567525+0000","last_unstale":"2024-09-19T05:33:20.925421+0000","last_undegraded":"2024-09-19T05:33:20.925421+0000","last_fullsized":"2024-09-19T05:33:20.925421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:20.717515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576007+0000","last_change":"2024-09-19T05:33:13.518203+0000","last_active":"2024-09-19T05:33:19.576007+0000","last_peered":"2024-09-19T05:33:19.576007+0000","last_clean":"2024-09-19T05:33:19.576007+0000","last_became_active":"2024-09-19T05:33:13.517450+0000","last_became_peered":"2024-09-19T05:33:13.517450+0000","last_unstale":"2024-09-19T05:33:19.576007+0000","last_undegraded":"2024-09-19T05:33:19.576007+0000","last_fullsized":"2024-09-19T05:33:19.576007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:01.312371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123779+0000","last_change":"2024-09-19T05:33:18.596006+0000","last_active":"2024-09-19T05:33:20.123779+0000","last_peered":"2024-09-19T05:33:20.123779+0000","last_clean":"2024-09-19T05:33:20.123779+0000","last_became_active":"2024-09-19T05:33:18.595625+0000","last_became_peered":"2024-09-19T05:33:18.595625+0000","last_unstale":"2024-09-19T05:33:20.123779+0000","last_undegraded":"2024-09-19T05:33:20.123779+0000","last_fullsized":"2024-09-19T05:33:20.123779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:47.248958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924329+0000","last_change":"2024-09-19T05:33:14.550442+0000","last_active":"2024-09-19T05:33:20.924329+0000","last_peered":"2024-09-19T05:33:20.924329+0000","last_clean":"2024-09-19T05:33:20.924329+0000","last_became_active":"2024-09-19T05:33:14.549648+0000","last_became_peered":"2024-09-19T05:33:14.549648+0000","last_unstale":"2024-09-19T05:33:20.924329+0000","last_undegraded":"2024-09-19T05:33:20.924329+0000","last_fullsized":"2024-09-19T05:33:20.924329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923348+0000","last_change":"2024-09-19T05:33:13.541793+0000","last_active":"2024-09-19T05:33:20.923348+0000","last_peered":"2024-09-19T05:33:20.923348+0000","last_clean":"2024-09-19T05:33:20.923348+0000","last_became_active":"2024-09-19T05:33:13.541034+0000","last_became_peered":"2024-09-19T05:33:13.541034+0000","last_unstale":"2024-09-19T05:33:20.923348+0000","last_undegraded":"2024-09-19T05:33:20.923348+0000","last_fullsized":"2024-09-19T05:33:20.923348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007972+0000","last_change":"2024-09-19T05:33:18.734544+0000","last_active":"2024-09-19T05:33:20.007972+0000","last_peered":"2024-09-19T05:33:20.007972+0000","last_clean":"2024-09-19T05:33:20.007972+0000","last_became_active":"2024-09-19T05:33:18.734217+0000","last_became_peered":"2024-09-19T05:33:18.734217+0000","last_unstale":"2024-09-19T05:33:20.007972+0000","last_undegraded":"2024-09-19T05:33:20.007972+0000","last_fullsized":"2024-09-19T05:33:20.007972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:29.423972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924156+0000","last_change":"2024-09-19T05:33:14.568196+0000","last_active":"2024-09-19T05:33:20.924156+0000","last_peered":"2024-09-19T05:33:20.924156+0000","last_clean":"2024-09-19T05:33:20.924156+0000","last_became_active":"2024-09-19T05:33:14.567764+0000","last_became_peered":"2024-09-19T05:33:14.567764+0000","last_unstale":"2024-09-19T05:33:20.924156+0000","last_undegraded":"2024-09-19T05:33:20.924156+0000","last_fullsized":"2024-09-19T05:33:20.924156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:38.457117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543797+0000","last_change":"2024-09-19T05:33:13.550337+0000","last_active":"2024-09-19T05:33:20.543797+0000","last_peered":"2024-09-19T05:33:20.543797+0000","last_clean":"2024-09-19T05:33:20.543797+0000","last_became_active":"2024-09-19T05:33:13.549450+0000","last_became_peered":"2024-09-19T05:33:13.549450+0000","last_unstale":"2024-09-19T05:33:20.543797+0000","last_undegraded":"2024-09-19T05:33:20.543797+0000","last_fullsized":"2024-09-19T05:33:20.543797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:29.032420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007818+0000","last_change":"2024-09-19T05:33:18.728533+0000","last_active":"2024-09-19T05:33:20.007818+0000","last_peered":"2024-09-19T05:33:20.007818+0000","last_clean":"2024-09-19T05:33:20.007818+0000","last_became_active":"2024-09-19T05:33:18.728056+0000","last_became_peered":"2024-09-19T05:33:18.728056+0000","last_unstale":"2024-09-19T05:33:20.007818+0000","last_undegraded":"2024-09-19T05:33:20.007818+0000","last_fullsized":"2024-09-19T05:33:20.007818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:33.730399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123383+0000","last_change":"2024-09-19T05:33:14.555119+0000","last_active":"2024-09-19T05:33:20.123383+0000","last_peered":"2024-09-19T05:33:20.123383+0000","last_clean":"2024-09-19T05:33:20.123383+0000","last_became_active":"2024-09-19T05:33:14.554798+0000","last_became_peered":"2024-09-19T05:33:14.554798+0000","last_unstale":"2024-09-19T05:33:20.123383+0000","last_undegraded":"2024-09-19T05:33:20.123383+0000","last_fullsized":"2024-09-19T05:33:20.123383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123886+0000","last_change":"2024-09-19T05:33:13.529400+0000","last_active":"2024-09-19T05:33:20.123886+0000","last_peered":"2024-09-19T05:33:20.123886+0000","last_clean":"2024-09-19T05:33:20.123886+0000","last_became_active":"2024-09-19T05:33:13.529106+0000","last_became_peered":"2024-09-19T05:33:13.529106+0000","last_unstale":"2024-09-19T05:33:20.123886+0000","last_undegraded":"2024-09-19T05:33:20.123886+0000","last_fullsized":"2024-09-19T05:33:20.123886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:11.761526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544051+0000","last_change":"2024-09-19T05:33:18.723038+0000","last_active":"2024-09-19T05:33:20.544051+0000","last_peered":"2024-09-19T05:33:20.544051+0000","last_clean":"2024-09-19T05:33:20.544051+0000","last_became_active":"2024-09-19T05:33:18.722087+0000","last_became_peered":"2024-09-19T05:33:18.722087+0000","last_unstale":"2024-09-19T05:33:20.544051+0000","last_undegraded":"2024-09-19T05:33:20.544051+0000","last_fullsized":"2024-09-19T05:33:20.544051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:40.558697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924126+0000","last_change":"2024-09-19T05:33:14.556157+0000","last_active":"2024-09-19T05:33:20.924126+0000","last_peered":"2024-09-19T05:33:20.924126+0000","last_clean":"2024-09-19T05:33:20.924126+0000","last_became_active":"2024-09-19T05:33:14.555055+0000","last_became_peered":"2024-09-19T05:33:14.555055+0000","last_unstale":"2024-09-19T05:33:20.924126+0000","last_undegraded":"2024-09-19T05:33:20.924126+0000","last_fullsized":"2024-09-19T05:33:20.924126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:36.661349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:25.122224+0000","last_change":"2024-09-19T05:33:13.534975+0000","last_active":"2024-09-19T05:33:25.122224+0000","last_peered":"2024-09-19T05:33:25.122224+0000","last_clean":"2024-09-19T05:33:25.122224+0000","last_became_active":"2024-09-19T05:33:13.533864+0000","last_became_peered":"2024-09-19T05:33:13.533864+0000","last_unstale":"2024-09-19T05:33:25.122224+0000","last_undegraded":"2024-09-19T05:33:25.122224+0000","last_fullsized":"2024-09-19T05:33:25.122224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923321+0000","last_change":"2024-09-19T05:33:18.592141+0000","last_active":"2024-09-19T05:33:20.923321+0000","last_peered":"2024-09-19T05:33:20.923321+0000","last_clean":"2024-09-19T05:33:20.923321+0000","last_became_active":"2024-09-19T05:33:18.591748+0000","last_became_peered":"2024-09-19T05:33:18.591748+0000","last_unstale":"2024-09-19T05:33:20.923321+0000","last_undegraded":"2024-09-19T05:33:20.923321+0000","last_fullsized":"2024-09-19T05:33:20.923321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.531745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578732+0000","last_change":"2024-09-19T05:33:14.557457+0000","last_active":"2024-09-19T05:33:19.578732+0000","last_peered":"2024-09-19T05:33:19.578732+0000","last_clean":"2024-09-19T05:33:19.578732+0000","last_became_active":"2024-09-19T05:33:14.556954+0000","last_became_peered":"2024-09-19T05:33:14.556954+0000","last_unstale":"2024-09-19T05:33:19.578732+0000","last_undegraded":"2024-09-19T05:33:19.578732+0000","last_fullsized":"2024-09-19T05:33:19.578732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:46.964162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924088+0000","last_change":"2024-09-19T05:33:13.548294+0000","last_active":"2024-09-19T05:33:20.924088+0000","last_peered":"2024-09-19T05:33:20.924088+0000","last_clean":"2024-09-19T05:33:20.924088+0000","last_became_active":"2024-09-19T05:33:13.547981+0000","last_became_peered":"2024-09-19T05:33:13.547981+0000","last_unstale":"2024-09-19T05:33:20.924088+0000","last_undegraded":"2024-09-19T05:33:20.924088+0000","last_fullsized":"2024-09-19T05:33:20.924088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579238+0000","last_change":"2024-09-19T05:33:18.596736+0000","last_active":"2024-09-19T05:33:19.579238+0000","last_peered":"2024-09-19T05:33:19.579238+0000","last_clean":"2024-09-19T05:33:19.579238+0000","last_became_active":"2024-09-19T05:33:18.594148+0000","last_became_peered":"2024-09-19T05:33:18.594148+0000","last_unstale":"2024-09-19T05:33:19.579238+0000","last_undegraded":"2024-09-19T05:33:19.579238+0000","last_fullsized":"2024-09-19T05:33:19.579238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:47.968935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123796+0000","last_change":"2024-09-19T05:33:14.551870+0000","last_active":"2024-09-19T05:33:20.123796+0000","last_peered":"2024-09-19T05:33:20.123796+0000","last_clean":"2024-09-19T05:33:20.123796+0000","last_became_active":"2024-09-19T05:33:14.551566+0000","last_became_peered":"2024-09-19T05:33:14.551566+0000","last_unstale":"2024-09-19T05:33:20.123796+0000","last_undegraded":"2024-09-19T05:33:20.123796+0000","last_fullsized":"2024-09-19T05:33:20.123796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543615+0000","last_change":"2024-09-19T05:33:13.553089+0000","last_active":"2024-09-19T05:33:20.543615+0000","last_peered":"2024-09-19T05:33:20.543615+0000","last_clean":"2024-09-19T05:33:20.543615+0000","last_became_active":"2024-09-19T05:33:13.552446+0000","last_became_peered":"2024-09-19T05:33:13.552446+0000","last_unstale":"2024-09-19T05:33:20.543615+0000","last_undegraded":"2024-09-19T05:33:20.543615+0000","last_fullsized":"2024-09-19T05:33:20.543615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.869187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007319+0000","last_change":"2024-09-19T05:33:18.595633+0000","last_active":"2024-09-19T05:33:20.007319+0000","last_peered":"2024-09-19T05:33:20.007319+0000","last_clean":"2024-09-19T05:33:20.007319+0000","last_became_active":"2024-09-19T05:33:18.594796+0000","last_became_peered":"2024-09-19T05:33:18.594796+0000","last_unstale":"2024-09-19T05:33:20.007319+0000","last_undegraded":"2024-09-19T05:33:20.007319+0000","last_fullsized":"2024-09-19T05:33:20.007319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:01.766766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543414+0000","last_change":"2024-09-19T05:33:14.562226+0000","last_active":"2024-09-19T05:33:20.543414+0000","last_peered":"2024-09-19T05:33:20.543414+0000","last_clean":"2024-09-19T05:33:20.543414+0000","last_became_active":"2024-09-19T05:33:14.561518+0000","last_became_peered":"2024-09-19T05:33:14.561518+0000","last_unstale":"2024-09-19T05:33:20.543414+0000","last_undegraded":"2024-09-19T05:33:20.543414+0000","last_fullsized":"2024-09-19T05:33:20.543414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:56.884042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926192+0000","last_change":"2024-09-19T05:33:13.554061+0000","last_active":"2024-09-19T05:33:20.926192+0000","last_peered":"2024-09-19T05:33:20.926192+0000","last_clean":"2024-09-19T05:33:20.926192+0000","last_became_active":"2024-09-19T05:33:13.553573+0000","last_became_peered":"2024-09-19T05:33:13.553573+0000","last_unstale":"2024-09-19T05:33:20.926192+0000","last_undegraded":"2024-09-19T05:33:20.926192+0000","last_fullsized":"2024-09-19T05:33:20.926192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007220+0000","last_change":"2024-09-19T05:33:18.728406+0000","last_active":"2024-09-19T05:33:20.007220+0000","last_peered":"2024-09-19T05:33:20.007220+0000","last_clean":"2024-09-19T05:33:20.007220+0000","last_became_active":"2024-09-19T05:33:18.728024+0000","last_became_peered":"2024-09-19T05:33:18.728024+0000","last_unstale":"2024-09-19T05:33:20.007220+0000","last_undegraded":"2024-09-19T05:33:20.007220+0000","last_fullsized":"2024-09-19T05:33:20.007220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:21.487284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123656+0000","last_change":"2024-09-19T05:33:18.731432+0000","last_active":"2024-09-19T05:33:20.123656+0000","last_peered":"2024-09-19T05:33:20.123656+0000","last_clean":"2024-09-19T05:33:20.123656+0000","last_became_active":"2024-09-19T05:33:18.730553+0000","last_became_peered":"2024-09-19T05:33:18.730553+0000","last_unstale":"2024-09-19T05:33:20.123656+0000","last_undegraded":"2024-09-19T05:33:20.123656+0000","last_fullsized":"2024-09-19T05:33:20.123656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:57.747825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922747+0000","last_change":"2024-09-19T05:33:14.528607+0000","last_active":"2024-09-19T05:33:20.922747+0000","last_peered":"2024-09-19T05:33:20.922747+0000","last_clean":"2024-09-19T05:33:20.922747+0000","last_became_active":"2024-09-19T05:33:14.528243+0000","last_became_peered":"2024-09-19T05:33:14.528243+0000","last_unstale":"2024-09-19T05:33:20.922747+0000","last_undegraded":"2024-09-19T05:33:20.922747+0000","last_fullsized":"2024-09-19T05:33:20.922747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542883+0000","last_change":"2024-09-19T05:33:13.550160+0000","last_active":"2024-09-19T05:33:20.542883+0000","last_peered":"2024-09-19T05:33:20.542883+0000","last_clean":"2024-09-19T05:33:20.542883+0000","last_became_active":"2024-09-19T05:33:13.548497+0000","last_became_peered":"2024-09-19T05:33:13.548497+0000","last_unstale":"2024-09-19T05:33:20.542883+0000","last_undegraded":"2024-09-19T05:33:20.542883+0000","last_fullsized":"2024-09-19T05:33:20.542883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:41.939363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926179+0000","last_change":"2024-09-19T05:33:18.598114+0000","last_active":"2024-09-19T05:33:20.926179+0000","last_peered":"2024-09-19T05:33:20.926179+0000","last_clean":"2024-09-19T05:33:20.926179+0000","last_became_active":"2024-09-19T05:33:18.597017+0000","last_became_peered":"2024-09-19T05:33:18.597017+0000","last_unstale":"2024-09-19T05:33:20.926179+0000","last_undegraded":"2024-09-19T05:33:20.926179+0000","last_fullsized":"2024-09-19T05:33:20.926179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:57.960270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007352+0000","last_change":"2024-09-19T05:33:14.521880+0000","last_active":"2024-09-19T05:33:20.007352+0000","last_peered":"2024-09-19T05:33:20.007352+0000","last_clean":"2024-09-19T05:33:20.007352+0000","last_became_active":"2024-09-19T05:33:14.521480+0000","last_became_peered":"2024-09-19T05:33:14.521480+0000","last_unstale":"2024-09-19T05:33:20.007352+0000","last_undegraded":"2024-09-19T05:33:20.007352+0000","last_fullsized":"2024-09-19T05:33:20.007352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007858+0000","last_change":"2024-09-19T05:33:13.536792+0000","last_active":"2024-09-19T05:33:20.007858+0000","last_peered":"2024-09-19T05:33:20.007858+0000","last_clean":"2024-09-19T05:33:20.007858+0000","last_became_active":"2024-09-19T05:33:13.536509+0000","last_became_peered":"2024-09-19T05:33:13.536509+0000","last_unstale":"2024-09-19T05:33:20.007858+0000","last_undegraded":"2024-09-19T05:33:20.007858+0000","last_fullsized":"2024-09-19T05:33:20.007858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:27.720089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924007+0000","last_change":"2024-09-19T05:33:13.541454+0000","last_active":"2024-09-19T05:33:20.924007+0000","last_peered":"2024-09-19T05:33:20.924007+0000","last_clean":"2024-09-19T05:33:20.924007+0000","last_became_active":"2024-09-19T05:33:13.536977+0000","last_became_peered":"2024-09-19T05:33:13.536977+0000","last_unstale":"2024-09-19T05:33:20.924007+0000","last_undegraded":"2024-09-19T05:33:20.924007+0000","last_fullsized":"2024-09-19T05:33:20.924007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:47.982621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123776+0000","last_change":"2024-09-19T05:33:14.547549+0000","last_active":"2024-09-19T05:33:20.123776+0000","last_peered":"2024-09-19T05:33:20.123776+0000","last_clean":"2024-09-19T05:33:20.123776+0000","last_became_active":"2024-09-19T05:33:14.547287+0000","last_became_peered":"2024-09-19T05:33:14.547287+0000","last_unstale":"2024-09-19T05:33:20.123776+0000","last_undegraded":"2024-09-19T05:33:20.123776+0000","last_fullsized":"2024-09-19T05:33:20.123776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576575+0000","last_change":"2024-09-19T05:33:18.605731+0000","last_active":"2024-09-19T05:33:19.576575+0000","last_peered":"2024-09-19T05:33:19.576575+0000","last_clean":"2024-09-19T05:33:19.576575+0000","last_became_active":"2024-09-19T05:33:18.605085+0000","last_became_peered":"2024-09-19T05:33:18.605085+0000","last_unstale":"2024-09-19T05:33:19.576575+0000","last_undegraded":"2024-09-19T05:33:19.576575+0000","last_fullsized":"2024-09-19T05:33:19.576575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:27.605669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007619+0000","last_change":"2024-09-19T05:33:13.525111+0000","last_active":"2024-09-19T05:33:20.007619+0000","last_peered":"2024-09-19T05:33:20.007619+0000","last_clean":"2024-09-19T05:33:20.007619+0000","last_became_active":"2024-09-19T05:33:13.524706+0000","last_became_peered":"2024-09-19T05:33:13.524706+0000","last_unstale":"2024-09-19T05:33:20.007619+0000","last_undegraded":"2024-09-19T05:33:20.007619+0000","last_fullsized":"2024-09-19T05:33:20.007619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:11.761526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577527+0000","last_change":"2024-09-19T05:33:14.530059+0000","last_active":"2024-09-19T05:33:19.577527+0000","last_peered":"2024-09-19T05:33:19.577527+0000","last_clean":"2024-09-19T05:33:19.577527+0000","last_became_active":"2024-09-19T05:33:14.529323+0000","last_became_peered":"2024-09-19T05:33:14.529323+0000","last_unstale":"2024-09-19T05:33:19.577527+0000","last_undegraded":"2024-09-19T05:33:19.577527+0000","last_fullsized":"2024-09-19T05:33:19.577527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:42.202499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007585+0000","last_change":"2024-09-19T05:33:18.597937+0000","last_active":"2024-09-19T05:33:20.007585+0000","last_peered":"2024-09-19T05:33:20.007585+0000","last_clean":"2024-09-19T05:33:20.007585+0000","last_became_active":"2024-09-19T05:33:18.596030+0000","last_became_peered":"2024-09-19T05:33:18.596030+0000","last_unstale":"2024-09-19T05:33:20.007585+0000","last_undegraded":"2024-09-19T05:33:20.007585+0000","last_fullsized":"2024-09-19T05:33:20.007585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.813147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922700+0000","last_change":"2024-09-19T05:33:14.537267+0000","last_active":"2024-09-19T05:33:20.922700+0000","last_peered":"2024-09-19T05:33:20.922700+0000","last_clean":"2024-09-19T05:33:20.922700+0000","last_became_active":"2024-09-19T05:33:14.536536+0000","last_became_peered":"2024-09-19T05:33:14.536536+0000","last_unstale":"2024-09-19T05:33:20.922700+0000","last_undegraded":"2024-09-19T05:33:20.922700+0000","last_fullsized":"2024-09-19T05:33:20.922700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576104+0000","last_change":"2024-09-19T05:33:14.526620+0000","last_active":"2024-09-19T05:33:19.576104+0000","last_peered":"2024-09-19T05:33:19.576104+0000","last_clean":"2024-09-19T05:33:19.576104+0000","last_became_active":"2024-09-19T05:33:14.526328+0000","last_became_peered":"2024-09-19T05:33:14.526328+0000","last_unstale":"2024-09-19T05:33:19.576104+0000","last_undegraded":"2024-09-19T05:33:19.576104+0000","last_fullsized":"2024-09-19T05:33:19.576104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:30.041945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543608+0000","last_change":"2024-09-19T05:33:14.559878+0000","last_active":"2024-09-19T05:33:20.543608+0000","last_peered":"2024-09-19T05:33:20.543608+0000","last_clean":"2024-09-19T05:33:20.543608+0000","last_became_active":"2024-09-19T05:33:14.559351+0000","last_became_peered":"2024-09-19T05:33:14.559351+0000","last_unstale":"2024-09-19T05:33:20.543608+0000","last_undegraded":"2024-09-19T05:33:20.543608+0000","last_fullsized":"2024-09-19T05:33:20.543608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:59.661877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123777+0000","last_change":"2024-09-19T05:33:14.530062+0000","last_active":"2024-09-19T05:33:20.123777+0000","last_peered":"2024-09-19T05:33:20.123777+0000","last_clean":"2024-09-19T05:33:20.123777+0000","last_became_active":"2024-09-19T05:33:14.529783+0000","last_became_peered":"2024-09-19T05:33:14.529783+0000","last_unstale":"2024-09-19T05:33:20.123777+0000","last_undegraded":"2024-09-19T05:33:20.123777+0000","last_fullsized":"2024-09-19T05:33:20.123777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007840+0000","last_change":"2024-09-19T05:33:14.542588+0000","last_active":"2024-09-19T05:33:20.007840+0000","last_peered":"2024-09-19T05:33:20.007840+0000","last_clean":"2024-09-19T05:33:20.007840+0000","last_became_active":"2024-09-19T05:33:14.542329+0000","last_became_peered":"2024-09-19T05:33:14.542329+0000","last_unstale":"2024-09-19T05:33:20.007840+0000","last_undegraded":"2024-09-19T05:33:20.007840+0000","last_fullsized":"2024-09-19T05:33:20.007840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923626+0000","last_change":"2024-09-19T05:33:14.526902+0000","last_active":"2024-09-19T05:33:20.923626+0000","last_peered":"2024-09-19T05:33:20.923626+0000","last_clean":"2024-09-19T05:33:20.923626+0000","last_became_active":"2024-09-19T05:33:14.526640+0000","last_became_peered":"2024-09-19T05:33:14.526640+0000","last_unstale":"2024-09-19T05:33:20.923626+0000","last_undegraded":"2024-09-19T05:33:20.923626+0000","last_fullsized":"2024-09-19T05:33:20.923626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926202+0000","last_change":"2024-09-19T05:33:14.559155+0000","last_active":"2024-09-19T05:33:20.926202+0000","last_peered":"2024-09-19T05:33:20.926202+0000","last_clean":"2024-09-19T05:33:20.926202+0000","last_became_active":"2024-09-19T05:33:14.558755+0000","last_became_peered":"2024-09-19T05:33:14.558755+0000","last_unstale":"2024-09-19T05:33:20.926202+0000","last_undegraded":"2024-09-19T05:33:20.926202+0000","last_fullsized":"2024-09-19T05:33:20.926202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.008000+0000","last_change":"2024-09-19T05:33:14.541132+0000","last_active":"2024-09-19T05:33:20.008000+0000","last_peered":"2024-09-19T05:33:20.008000+0000","last_clean":"2024-09-19T05:33:20.008000+0000","last_became_active":"2024-09-19T05:33:14.540863+0000","last_became_peered":"2024-09-19T05:33:14.540863+0000","last_unstale":"2024-09-19T05:33:20.008000+0000","last_undegraded":"2024-09-19T05:33:20.008000+0000","last_fullsized":"2024-09-19T05:33:20.008000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:20.717515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542901+0000","last_change":"2024-09-19T05:33:14.533210+0000","last_active":"2024-09-19T05:33:20.542901+0000","last_peered":"2024-09-19T05:33:20.542901+0000","last_clean":"2024-09-19T05:33:20.542901+0000","last_became_active":"2024-09-19T05:33:14.532432+0000","last_became_peered":"2024-09-19T05:33:14.532432+0000","last_unstale":"2024-09-19T05:33:20.542901+0000","last_undegraded":"2024-09-19T05:33:20.542901+0000","last_fullsized":"2024-09-19T05:33:20.542901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:52.178220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007605+0000","last_change":"2024-09-19T05:33:14.547002+0000","last_active":"2024-09-19T05:33:20.007605+0000","last_peered":"2024-09-19T05:33:20.007605+0000","last_clean":"2024-09-19T05:33:20.007605+0000","last_became_active":"2024-09-19T05:33:14.546737+0000","last_became_peered":"2024-09-19T05:33:14.546737+0000","last_unstale":"2024-09-19T05:33:20.007605+0000","last_undegraded":"2024-09-19T05:33:20.007605+0000","last_fullsized":"2024-09-19T05:33:20.007605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:45.387641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543418+0000","last_change":"2024-09-19T05:33:14.568172+0000","last_active":"2024-09-19T05:33:20.543418+0000","last_peered":"2024-09-19T05:33:20.543418+0000","last_clean":"2024-09-19T05:33:20.543418+0000","last_became_active":"2024-09-19T05:33:14.567760+0000","last_became_peered":"2024-09-19T05:33:14.567760+0000","last_unstale":"2024-09-19T05:33:20.543418+0000","last_undegraded":"2024-09-19T05:33:20.543418+0000","last_fullsized":"2024-09-19T05:33:20.543418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:30.905148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123485+0000","last_change":"2024-09-19T05:33:14.558783+0000","last_active":"2024-09-19T05:33:20.123485+0000","last_peered":"2024-09-19T05:33:20.123485+0000","last_clean":"2024-09-19T05:33:20.123485+0000","last_became_active":"2024-09-19T05:33:14.558567+0000","last_became_peered":"2024-09-19T05:33:14.558567+0000","last_unstale":"2024-09-19T05:33:20.123485+0000","last_undegraded":"2024-09-19T05:33:20.123485+0000","last_fullsized":"2024-09-19T05:33:20.123485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923405+0000","last_change":"2024-09-19T05:33:14.551691+0000","last_active":"2024-09-19T05:33:20.923405+0000","last_peered":"2024-09-19T05:33:20.923405+0000","last_clean":"2024-09-19T05:33:20.923405+0000","last_became_active":"2024-09-19T05:33:14.549872+0000","last_became_peered":"2024-09-19T05:33:14.549872+0000","last_unstale":"2024-09-19T05:33:20.923405+0000","last_undegraded":"2024-09-19T05:33:20.923405+0000","last_fullsized":"2024-09-19T05:33:20.923405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924685+0000","last_change":"2024-09-19T05:33:14.556297+0000","last_active":"2024-09-19T05:33:20.924685+0000","last_peered":"2024-09-19T05:33:20.924685+0000","last_clean":"2024-09-19T05:33:20.924685+0000","last_became_active":"2024-09-19T05:33:14.555403+0000","last_became_peered":"2024-09-19T05:33:14.555403+0000","last_unstale":"2024-09-19T05:33:20.924685+0000","last_undegraded":"2024-09-19T05:33:20.924685+0000","last_fullsized":"2024-09-19T05:33:20.924685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:43.916813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576705+0000","last_change":"2024-09-19T05:33:14.535228+0000","last_active":"2024-09-19T05:33:19.576705+0000","last_peered":"2024-09-19T05:33:19.576705+0000","last_clean":"2024-09-19T05:33:19.576705+0000","last_became_active":"2024-09-19T05:33:14.534931+0000","last_became_peered":"2024-09-19T05:33:14.534931+0000","last_unstale":"2024-09-19T05:33:19.576705+0000","last_undegraded":"2024-09-19T05:33:19.576705+0000","last_fullsized":"2024-09-19T05:33:19.576705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:12.979751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544152+0000","last_change":"2024-09-19T05:33:14.565336+0000","last_active":"2024-09-19T05:33:20.544152+0000","last_peered":"2024-09-19T05:33:20.544152+0000","last_clean":"2024-09-19T05:33:20.544152+0000","last_became_active":"2024-09-19T05:33:14.564756+0000","last_became_peered":"2024-09-19T05:33:14.564756+0000","last_unstale":"2024-09-19T05:33:20.544152+0000","last_undegraded":"2024-09-19T05:33:20.544152+0000","last_fullsized":"2024-09-19T05:33:20.544152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:07.067023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542591+0000","last_change":"2024-09-19T05:33:14.552325+0000","last_active":"2024-09-19T05:33:20.542591+0000","last_peered":"2024-09-19T05:33:20.542591+0000","last_clean":"2024-09-19T05:33:20.542591+0000","last_became_active":"2024-09-19T05:33:14.551613+0000","last_became_peered":"2024-09-19T05:33:14.551613+0000","last_unstale":"2024-09-19T05:33:20.542591+0000","last_undegraded":"2024-09-19T05:33:20.542591+0000","last_fullsized":"2024-09-19T05:33:20.542591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:07.394046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922935+0000","last_change":"2024-09-19T05:33:14.546485+0000","last_active":"2024-09-19T05:33:20.922935+0000","last_peered":"2024-09-19T05:33:20.922935+0000","last_clean":"2024-09-19T05:33:20.922935+0000","last_became_active":"2024-09-19T05:33:14.546193+0000","last_became_peered":"2024-09-19T05:33:14.546193+0000","last_unstale":"2024-09-19T05:33:20.922935+0000","last_undegraded":"2024-09-19T05:33:20.922935+0000","last_fullsized":"2024-09-19T05:33:20.922935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123351+0000","last_change":"2024-09-19T05:33:14.531122+0000","last_active":"2024-09-19T05:33:20.123351+0000","last_peered":"2024-09-19T05:33:20.123351+0000","last_clean":"2024-09-19T05:33:20.123351+0000","last_became_active":"2024-09-19T05:33:14.530715+0000","last_became_peered":"2024-09-19T05:33:14.530715+0000","last_unstale":"2024-09-19T05:33:20.123351+0000","last_undegraded":"2024-09-19T05:33:20.123351+0000","last_fullsized":"2024-09-19T05:33:20.123351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:45.387641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007456+0000","last_change":"2024-09-19T05:33:14.560886+0000","last_active":"2024-09-19T05:33:20.007456+0000","last_peered":"2024-09-19T05:33:20.007456+0000","last_clean":"2024-09-19T05:33:20.007456+0000","last_became_active":"2024-09-19T05:33:14.560569+0000","last_became_peered":"2024-09-19T05:33:14.560569+0000","last_unstale":"2024-09-19T05:33:20.007456+0000","last_undegraded":"2024-09-19T05:33:20.007456+0000","last_fullsized":"2024-09-19T05:33:20.007456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578400+0000","last_change":"2024-09-19T05:33:14.539186+0000","last_active":"2024-09-19T05:33:19.578400+0000","last_peered":"2024-09-19T05:33:19.578400+0000","last_clean":"2024-09-19T05:33:19.578400+0000","last_became_active":"2024-09-19T05:33:14.538758+0000","last_became_peered":"2024-09-19T05:33:14.538758+0000","last_unstale":"2024-09-19T05:33:19.578400+0000","last_undegraded":"2024-09-19T05:33:19.578400+0000","last_fullsized":"2024-09-19T05:33:19.578400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:59.297383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925456+0000","last_change":"2024-09-19T05:33:14.568844+0000","last_active":"2024-09-19T05:33:20.925456+0000","last_peered":"2024-09-19T05:33:20.925456+0000","last_clean":"2024-09-19T05:33:20.925456+0000","last_became_active":"2024-09-19T05:33:14.565254+0000","last_became_peered":"2024-09-19T05:33:14.565254+0000","last_unstale":"2024-09-19T05:33:20.925456+0000","last_undegraded":"2024-09-19T05:33:20.925456+0000","last_fullsized":"2024-09-19T05:33:20.925456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926051+0000","last_change":"2024-09-19T05:33:14.561841+0000","last_active":"2024-09-19T05:33:20.926051+0000","last_peered":"2024-09-19T05:33:20.926051+0000","last_clean":"2024-09-19T05:33:20.926051+0000","last_became_active":"2024-09-19T05:33:14.561439+0000","last_became_peered":"2024-09-19T05:33:14.561439+0000","last_unstale":"2024-09-19T05:33:20.926051+0000","last_undegraded":"2024-09-19T05:33:20.926051+0000","last_fullsized":"2024-09-19T05:33:20.926051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925143+0000","last_change":"2024-09-19T05:33:14.573138+0000","last_active":"2024-09-19T05:33:20.925143+0000","last_peered":"2024-09-19T05:33:20.925143+0000","last_clean":"2024-09-19T05:33:20.925143+0000","last_became_active":"2024-09-19T05:33:14.564119+0000","last_became_peered":"2024-09-19T05:33:14.564119+0000","last_unstale":"2024-09-19T05:33:20.925143+0000","last_undegraded":"2024-09-19T05:33:20.925143+0000","last_fullsized":"2024-09-19T05:33:20.925143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:53.695703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006962+0000","last_change":"2024-09-19T05:33:14.528043+0000","last_active":"2024-09-19T05:33:20.006962+0000","last_peered":"2024-09-19T05:33:20.006962+0000","last_clean":"2024-09-19T05:33:20.006962+0000","last_became_active":"2024-09-19T05:33:14.527737+0000","last_became_peered":"2024-09-19T05:33:14.527737+0000","last_unstale":"2024-09-19T05:33:20.006962+0000","last_undegraded":"2024-09-19T05:33:20.006962+0000","last_fullsized":"2024-09-19T05:33:20.006962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:29.911108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925350+0000","last_change":"2024-09-19T05:33:14.555049+0000","last_active":"2024-09-19T05:33:20.925350+0000","last_peered":"2024-09-19T05:33:20.925350+0000","last_clean":"2024-09-19T05:33:20.925350+0000","last_became_active":"2024-09-19T05:33:14.554452+0000","last_became_peered":"2024-09-19T05:33:14.554452+0000","last_unstale":"2024-09-19T05:33:20.925350+0000","last_undegraded":"2024-09-19T05:33:20.925350+0000","last_fullsized":"2024-09-19T05:33:20.925350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543115+0000","last_change":"2024-09-19T05:33:14.562090+0000","last_active":"2024-09-19T05:33:20.543115+0000","last_peered":"2024-09-19T05:33:20.543115+0000","last_clean":"2024-09-19T05:33:20.543115+0000","last_became_active":"2024-09-19T05:33:14.561559+0000","last_became_peered":"2024-09-19T05:33:14.561559+0000","last_unstale":"2024-09-19T05:33:20.543115+0000","last_undegraded":"2024-09-19T05:33:20.543115+0000","last_fullsized":"2024-09-19T05:33:20.543115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:53.148319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923829+0000","last_change":"2024-09-19T05:33:14.558005+0000","last_active":"2024-09-19T05:33:20.923829+0000","last_peered":"2024-09-19T05:33:20.923829+0000","last_clean":"2024-09-19T05:33:20.923829+0000","last_became_active":"2024-09-19T05:33:14.556969+0000","last_became_peered":"2024-09-19T05:33:14.556969+0000","last_unstale":"2024-09-19T05:33:20.923829+0000","last_undegraded":"2024-09-19T05:33:20.923829+0000","last_fullsized":"2024-09-19T05:33:20.923829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:28.714509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543428+0000","last_change":"2024-09-19T05:33:14.562103+0000","last_active":"2024-09-19T05:33:20.543428+0000","last_peered":"2024-09-19T05:33:20.543428+0000","last_clean":"2024-09-19T05:33:20.543428+0000","last_became_active":"2024-09-19T05:33:14.561395+0000","last_became_peered":"2024-09-19T05:33:14.561395+0000","last_unstale":"2024-09-19T05:33:20.543428+0000","last_undegraded":"2024-09-19T05:33:20.543428+0000","last_fullsized":"2024-09-19T05:33:20.543428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:49.601339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123567+0000","last_change":"2024-09-19T05:33:14.523507+0000","last_active":"2024-09-19T05:33:20.123567+0000","last_peered":"2024-09-19T05:33:20.123567+0000","last_clean":"2024-09-19T05:33:20.123567+0000","last_became_active":"2024-09-19T05:33:14.523206+0000","last_became_peered":"2024-09-19T05:33:14.523206+0000","last_unstale":"2024-09-19T05:33:20.123567+0000","last_undegraded":"2024-09-19T05:33:20.123567+0000","last_fullsized":"2024-09-19T05:33:20.123567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924802+0000","last_change":"2024-09-19T05:33:14.537324+0000","last_active":"2024-09-19T05:33:20.924802+0000","last_peered":"2024-09-19T05:33:20.924802+0000","last_clean":"2024-09-19T05:33:20.924802+0000","last_became_active":"2024-09-19T05:33:14.536850+0000","last_became_peered":"2024-09-19T05:33:14.536850+0000","last_unstale":"2024-09-19T05:33:20.924802+0000","last_undegraded":"2024-09-19T05:33:20.924802+0000","last_fullsized":"2024-09-19T05:33:20.924802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924919+0000","last_change":"2024-09-19T05:33:14.559373+0000","last_active":"2024-09-19T05:33:20.924919+0000","last_peered":"2024-09-19T05:33:20.924919+0000","last_clean":"2024-09-19T05:33:20.924919+0000","last_became_active":"2024-09-19T05:33:14.558720+0000","last_became_peered":"2024-09-19T05:33:14.558720+0000","last_unstale":"2024-09-19T05:33:20.924919+0000","last_undegraded":"2024-09-19T05:33:20.924919+0000","last_fullsized":"2024-09-19T05:33:20.924919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:53.908148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":694435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":103611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":694491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:33:29.626 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:33:29.626 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T05:33:29.626 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-19T05:33:29.626 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-19T05:33:29.627 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-19T05:33:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77b0489640 1 Processor -- start 2024-09-19T05:33:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77b0489640 1 -- start start 2024-09-19T05:33:29.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77b0489640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77a815b1e0 0x7f77a80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77b0489640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77a80b4900 0x7f77a8071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77b0489640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f77a80723c0 0x7f77a8072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77b0489640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f77a815b5c0 con 0x7f77a815b1e0 2024-09-19T05:33:29.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77b0489640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f77a80b3860 con 0x7f77a80723c0 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77b0489640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f77a80b3b40 con 0x7f77a80b4900 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77ae225640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77a815b1e0 0x7f77a80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77ae225640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77a815b1e0 0x7f77a80b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34378/0 (socket says 172.21.15.67:34378) 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77ae225640 1 -- 172.21.15.67:0/335205511 learned_addr learned my addr 172.21.15.67:0/335205511 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77ada24640 1 --2- 172.21.15.67:0/335205511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77a80b4900 0x7f77a8071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77aea26640 1 --2- 172.21.15.67:0/335205511 >> v2:172.21.15.97:3300/0 conn(0x7f77a80723c0 0x7f77a8072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77ae225640 1 -- 172.21.15.67:0/335205511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77a80b4900 msgr2=0x7f77a8071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77ae225640 1 --2- 172.21.15.67:0/335205511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77a80b4900 0x7f77a8071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77ae225640 1 -- 172.21.15.67:0/335205511 >> v2:172.21.15.97:3300/0 conn(0x7f77a80723c0 msgr2=0x7f77a8072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77ae225640 1 --2- 172.21.15.67:0/335205511 >> v2:172.21.15.97:3300/0 conn(0x7f77a80723c0 0x7f77a8072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.790+0000 7f77ae225640 1 -- 172.21.15.67:0/335205511 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a80b3e20 con 0x7f77a815b1e0 2024-09-19T05:33:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77ae225640 1 --2- 172.21.15.67:0/335205511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 0x7f77a80b2fd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f77a80d0e40 tx=0x7f77a401ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7423af86d5249166 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77ad223640 1 -- 172.21.15.67:0/335205511 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a40b4070 con 0x7f77a815b1e0 2024-09-19T05:33:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77ad223640 1 -- 172.21.15.67:0/335205511 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a40a7c70 con 0x7f77a815b1e0 2024-09-19T05:33:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77ad223640 1 -- 172.21.15.67:0/335205511 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a40af660 con 0x7f77a815b1e0 2024-09-19T05:33:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 -- 172.21.15.67:0/335205511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 msgr2=0x7f77a80b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 --2- 172.21.15.67:0/335205511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 0x7f77a80b2fd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f77a80d0e40 tx=0x7f77a401ebc0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 -- 172.21.15.67:0/335205511 shutdown_connections 2024-09-19T05:33:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 --2- 172.21.15.67:0/335205511 >> v2:172.21.15.97:3300/0 conn(0x7f77a80723c0 0x7f77a8072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 --2- 172.21.15.67:0/335205511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77a80b4900 0x7f77a8071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 --2- 172.21.15.67:0/335205511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 0x7f77a80b2fd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 -- 172.21.15.67:0/335205511 >> 172.21.15.67:0/335205511 conn(0x7f77a80d0080 msgr2=0x7f77a80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 -- 172.21.15.67:0/335205511 shutdown_connections 2024-09-19T05:33:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 -- 172.21.15.67:0/335205511 wait complete. 2024-09-19T05:33:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 Processor -- start 2024-09-19T05:33:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.794+0000 7f77b0489640 1 -- start start 2024-09-19T05:33:29.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77b0489640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77a80723c0 0x7f77a8099b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77b0489640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77a80b4900 0x7f77a815d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77b0489640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 0x7f77a8144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77b0489640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f77a815f650 con 0x7f77a815b1e0 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77b0489640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f77a815f4d0 con 0x7f77a80723c0 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77b0489640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f77a815f7d0 con 0x7f77a80b4900 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77aea26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 0x7f77a8144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77aea26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 0x7f77a8144970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34380/0 (socket says 172.21.15.67:34380) 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77aea26640 1 -- 172.21.15.67:0/2926331181 learned_addr learned my addr 172.21.15.67:0/2926331181 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77ae225640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77a80723c0 0x7f77a8099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77ada24640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77a80b4900 0x7f77a815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77aea26640 1 -- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77a80b4900 msgr2=0x7f77a815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77aea26640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77a80b4900 0x7f77a815d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77aea26640 1 -- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77a80723c0 msgr2=0x7f77a8099b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:29.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77aea26640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77a80723c0 0x7f77a8099b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:29.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77aea26640 1 -- 172.21.15.67:0/2926331181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a814ed80 con 0x7f77a815b1e0 2024-09-19T05:33:29.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77ae225640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77a80723c0 0x7f77a8099b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:29.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77aea26640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 0x7f77a8144970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f77a0007e70 tx=0x7f77a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:29.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f779effd640 1 -- 172.21.15.67:0/2926331181 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0014620 con 0x7f77a815b1e0 2024-09-19T05:33:29.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f779effd640 1 -- 172.21.15.67:0/2926331181 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a0019070 con 0x7f77a815b1e0 2024-09-19T05:33:29.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f779effd640 1 -- 172.21.15.67:0/2926331181 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0014a20 con 0x7f77a815b1e0 2024-09-19T05:33:29.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77b0489640 1 -- 172.21.15.67:0/2926331181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a814f060 con 0x7f77a815b1e0 2024-09-19T05:33:29.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77b0489640 1 -- 172.21.15.67:0/2926331181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a814f620 con 0x7f77a815b1e0 2024-09-19T05:33:29.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77b0489640 1 -- 172.21.15.67:0/2926331181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a815faa0 con 0x7f77a815b1e0 2024-09-19T05:33:29.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f779effd640 1 -- 172.21.15.67:0/2926331181 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77a0014bc0 con 0x7f77a815b1e0 2024-09-19T05:33:29.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f779effd640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f778c0678c0 0x7f778c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:29.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f779effd640 1 -- 172.21.15.67:0/2926331181 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f77a00868a0 con 0x7f77a815b1e0 2024-09-19T05:33:29.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.798+0000 7f77ae225640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f778c0678c0 0x7f778c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:29.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.802+0000 7f77ae225640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f778c0678c0 0x7f778c069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77a40b1000 tx=0x7f77a40a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:29.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:29.802+0000 7f779effd640 1 -- 172.21.15.67:0/2926331181 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f77a0011260 con 0x7f77a815b1e0 2024-09-19T05:33:30.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.010+0000 7f77b0489640 1 -- 172.21.15.67:0/2926331181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f77a8072fb0 con 0x7f77a815b1e0 2024-09-19T05:33:30.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.018+0000 7f779effd640 1 -- 172.21.15.67:0/2926331181 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166883 (secure 0 0 0) 0x7f77a00570a0 con 0x7f77a815b1e0 2024-09-19T05:33:30.023 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:30.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 -- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f778c0678c0 msgr2=0x7f778c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f778c0678c0 0x7f778c069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77a40b1000 tx=0x7f77a40a9070 comp rx=0 tx=0).stop 2024-09-19T05:33:30.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 -- 172.21.15.67:0/2926331181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 msgr2=0x7f77a8144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 0x7f77a8144970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f77a0007e70 tx=0x7f77a000e4b0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 -- 172.21.15.67:0/2926331181 shutdown_connections 2024-09-19T05:33:30.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a815b1e0 0x7f77a8144970 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f778c0678c0 0x7f778c069d80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77a80b4900 0x7f77a815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 --2- 172.21.15.67:0/2926331181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77a80723c0 0x7f77a8099b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 -- 172.21.15.67:0/2926331181 >> 172.21.15.67:0/2926331181 conn(0x7f77a80d0080 msgr2=0x7f77a806e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 -- 172.21.15.67:0/2926331181 shutdown_connections 2024-09-19T05:33:30.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.022+0000 7f77b0489640 1 -- 172.21.15.67:0/2926331181 wait complete. 2024-09-19T05:33:30.042 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":4012304794},{"type":"v1","addr":"172.21.15.97:6833","nonce":4012304794}]},"active_addr":"172.21.15.97:6833/4012304794","active_change":"2024-09-19T05:32:55.092511+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":660697398}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":3405877100}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":35995487}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":648851647}]}]} 2024-09-19T05:33:30.047 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-19T05:33:30.047 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-19T05:33:30.047 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:30.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.162+0000 7f846b951640 1 Processor -- start 2024-09-19T05:33:30.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.162+0000 7f846b951640 1 -- start start 2024-09-19T05:33:30.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.162+0000 7f846b951640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846406f460 0x7f846406f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.162+0000 7f846b951640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846406e3c0 con 0x7f846415c030 2024-09-19T05:33:30.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.162+0000 7f846b951640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846406e6a0 con 0x7f846406dde0 2024-09-19T05:33:30.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.162+0000 7f846b951640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f846406e980 con 0x7f846406f460 2024-09-19T05:33:30.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.162+0000 7f84696ed640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f846415c030 0x7f846415d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34474/0 (socket says 172.21.15.67:34474) 2024-09-19T05:33:30.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.162+0000 7f84696ed640 1 -- 172.21.15.67:0/3711338096 learned_addr learned my addr 172.21.15.67:0/3711338096 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:30.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.162+0000 7f8469eee640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846406f460 0x7f846406f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432985656 0 0) 0x7f846406e3c0 con 0x7f846415c030 2024-09-19T05:33:30.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f844c003530 con 0x7f846415c030 2024-09-19T05:33:30.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 288918861 0 0) 0x7f844c003530 con 0x7f846415c030 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846406f460 msgr2=0x7f846406f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846406f460 0x7f846406f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 >> v1:172.21.15.97:6789/0 conn(0x7f846406dde0 legacy=0x7f84640b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846406ec60 con 0x7f846415c030 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f845c001680 con 0x7f846415c030 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f8469eee640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846406f460 0x7f846406f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 >> v1:172.21.15.67:6789/0 conn(0x7f846415c030 legacy=0x7f846415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844c0039f0 0x7f844c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f844c0043a0 0x7f844c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846406f460 0x7f844c005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f846406e980 con 0x7f844c0039f0 2024-09-19T05:33:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f844c00b9d0 con 0x7f844c0043a0 2024-09-19T05:33:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f844c00bb80 con 0x7f846406f460 2024-09-19T05:33:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f84696ed640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844c0039f0 0x7f844c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f8468eec640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f844c0043a0 0x7f844c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f8469eee640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846406f460 0x7f844c005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f84696ed640 1 -- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846406f460 msgr2=0x7f844c005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f84696ed640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846406f460 0x7f844c005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f84696ed640 1 -- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f844c0043a0 msgr2=0x7f844c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f84696ed640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f844c0043a0 0x7f844c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f84696ed640 1 -- 172.21.15.67:0/3711338096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c003530 con 0x7f844c0039f0 2024-09-19T05:33:30.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f84696ed640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844c0039f0 0x7f844c003dd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f845c00c160 tx=0x7f845c01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d216652e3045c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c007cb0 con 0x7f844c0039f0 2024-09-19T05:33:30.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845c0a9020 con 0x7f844c0039f0 2024-09-19T05:33:30.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f845bfff640 1 -- 172.21.15.67:0/3711338096 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c005ae0 con 0x7f844c0039f0 2024-09-19T05:33:30.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f846b951640 1 -- 172.21.15.67:0/3711338096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844c0039f0 msgr2=0x7f844c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f846b951640 1 --2- 172.21.15.67:0/3711338096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844c0039f0 0x7f844c003dd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f845c00c160 tx=0x7f845c01cbd0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f8469eee640 1 -- 172.21.15.67:0/3711338096 reap_dead start 2024-09-19T05:33:30.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f846b951640 1 -- 172.21.15.67:0/3711338096 shutdown_connections 2024-09-19T05:33:30.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.166+0000 7f846b951640 1 -- 172.21.15.67:0/3711338096 >> 172.21.15.67:0/3711338096 conn(0x7f84640d0080 msgr2=0x7f84640d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 -- 172.21.15.67:0/3711338096 shutdown_connections 2024-09-19T05:33:30.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 -- 172.21.15.67:0/3711338096 wait complete. 2024-09-19T05:33:30.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 Processor -- start 2024-09-19T05:33:30.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 -- start start 2024-09-19T05:33:30.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f844c0039f0 0x7f8464096900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84641484b0 0x7f84641561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846414c010 0x7f846414c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f846415c590 con 0x7f846414c010 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f846415c410 con 0x7f844c0039f0 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f84641680e0 con 0x7f84641484b0 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8469eee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846414c010 0x7f846414c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8469eee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846414c010 0x7f846414c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34404/0 (socket says 172.21.15.67:34404) 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8469eee640 1 -- 172.21.15.67:0/1102827135 learned_addr learned my addr 172.21.15.67:0/1102827135 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f84696ed640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f844c0039f0 0x7f8464096900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8468eec640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84641484b0 0x7f84641561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8469eee640 1 -- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84641484b0 msgr2=0x7f84641561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8469eee640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84641484b0 0x7f84641561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8469eee640 1 -- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f844c0039f0 msgr2=0x7f8464096900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8469eee640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f844c0039f0 0x7f8464096900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8469eee640 1 -- 172.21.15.67:0/1102827135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846414ff60 con 0x7f846414c010 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8468eec640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84641484b0 0x7f84641561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8469eee640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846414c010 0x7f846414c4c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8454011490 tx=0x7f8454009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8459ffb640 1 -- 172.21.15.67:0/1102827135 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454019020 con 0x7f846414c010 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8459ffb640 1 -- 172.21.15.67:0/1102827135 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8454004440 con 0x7f846414c010 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f8459ffb640 1 -- 172.21.15.67:0/1102827135 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454003820 con 0x7f846414c010 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 -- 172.21.15.67:0/1102827135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846414b530 con 0x7f846414c010 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 -- 172.21.15.67:0/1102827135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f846414fc00 con 0x7f846414c010 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.170+0000 7f846b951640 1 -- 172.21.15.67:0/1102827135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84641566f0 con 0x7f846414c010 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.174+0000 7f8459ffb640 1 -- 172.21.15.67:0/1102827135 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f845401c020 con 0x7f846414c010 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.174+0000 7f8459ffb640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84500678f0 0x7f8450069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.174+0000 7f8459ffb640 1 -- 172.21.15.67:0/1102827135 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f84540863a0 con 0x7f846414c010 2024-09-19T05:33:30.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.174+0000 7f84696ed640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84500678f0 0x7f8450069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.174+0000 7f84696ed640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84500678f0 0x7f8450069db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f845c0aa000 tx=0x7f846406e590 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.178+0000 7f8459ffb640 1 -- 172.21.15.67:0/1102827135 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8454023020 con 0x7f846414c010 2024-09-19T05:33:30.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.342+0000 7f846b951640 1 -- 172.21.15.67:0/1102827135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84640b2fd0 con 0x7f846414c010 2024-09-19T05:33:30.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.342+0000 7f8459ffb640 1 -- 172.21.15.67:0/1102827135 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f8454056c30 con 0x7f846414c010 2024-09-19T05:33:30.347 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:30.347 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 -- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84500678f0 msgr2=0x7f8450069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84500678f0 0x7f8450069db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f845c0aa000 tx=0x7f846406e590 comp rx=0 tx=0).stop 2024-09-19T05:33:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 -- 172.21.15.67:0/1102827135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846414c010 msgr2=0x7f846414c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846414c010 0x7f846414c4c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8454011490 tx=0x7f8454009540 comp rx=0 tx=0).stop 2024-09-19T05:33:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 -- 172.21.15.67:0/1102827135 shutdown_connections 2024-09-19T05:33:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846414c010 0x7f846414c4c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84500678f0 0x7f8450069db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84641484b0 0x7f84641561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 --2- 172.21.15.67:0/1102827135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f844c0039f0 0x7f8464096900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 -- 172.21.15.67:0/1102827135 >> 172.21.15.67:0/1102827135 conn(0x7f84640d0080 msgr2=0x7f846415e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 -- 172.21.15.67:0/1102827135 shutdown_connections 2024-09-19T05:33:30.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.346+0000 7f846b951640 1 -- 172.21.15.67:0/1102827135 wait complete. 2024-09-19T05:33:30.365 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-19T05:33:30.365 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:30.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb626a2e640 1 Processor -- start 2024-09-19T05:33:30.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb626a2e640 1 -- start start 2024-09-19T05:33:30.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb626a2e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb62015c030 0x7fb62006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb626a2e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb62006f460 0x7fb62006f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb626a2e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb62006e3c0 con 0x7fb62015d1d0 2024-09-19T05:33:30.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb626a2e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb62006e6a0 con 0x7fb62015c030 2024-09-19T05:33:30.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb626a2e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb62006e980 con 0x7fb62006f460 2024-09-19T05:33:30.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb61ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb62015c030 0x7fb62006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb61ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb62015c030 0x7fb62006dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34406/0 (socket says 172.21.15.67:34406) 2024-09-19T05:33:30.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb61ffff640 1 -- 172.21.15.67:0/954992419 learned_addr learned my addr 172.21.15.67:0/954992419 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb624fcb640 1 --2- 172.21.15.67:0/954992419 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb62006f460 0x7fb62006f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb61ffff640 1 -- 172.21.15.67:0/954992419 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb62006f460 msgr2=0x7fb62006f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb61ffff640 1 --2- 172.21.15.67:0/954992419 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb62006f460 0x7fb62006f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb61ffff640 1 -- 172.21.15.67:0/954992419 >> v1:172.21.15.97:6789/0 conn(0x7fb62015d1d0 legacy=0x7fb6200b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.474+0000 7fb61ffff640 1 -- 172.21.15.67:0/954992419 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62006ec60 con 0x7fb62015c030 2024-09-19T05:33:30.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb61ffff640 1 --2- 172.21.15.67:0/954992419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62015c030 0x7fb62006dde0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb610009870 tx=0x7fb61001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b703b8d5ced0a63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb61effd640 1 -- 172.21.15.67:0/954992419 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6100b0070 con 0x7fb62015c030 2024-09-19T05:33:30.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb61effd640 1 -- 172.21.15.67:0/954992419 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6100ab600 con 0x7fb62015c030 2024-09-19T05:33:30.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb61effd640 1 -- 172.21.15.67:0/954992419 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6100ab9d0 con 0x7fb62015c030 2024-09-19T05:33:30.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb626a2e640 1 -- 172.21.15.67:0/954992419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62015c030 msgr2=0x7fb62006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb626a2e640 1 --2- 172.21.15.67:0/954992419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62015c030 0x7fb62006dde0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb610009870 tx=0x7fb61001c520 comp rx=0 tx=0).stop 2024-09-19T05:33:30.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb626a2e640 1 -- 172.21.15.67:0/954992419 shutdown_connections 2024-09-19T05:33:30.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb626a2e640 1 --2- 172.21.15.67:0/954992419 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb62006f460 0x7fb62006f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb626a2e640 1 --2- 172.21.15.67:0/954992419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62015c030 0x7fb62006dde0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb626a2e640 1 -- 172.21.15.67:0/954992419 >> 172.21.15.67:0/954992419 conn(0x7fb6200d0080 msgr2=0x7fb6200d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb626a2e640 1 -- 172.21.15.67:0/954992419 shutdown_connections 2024-09-19T05:33:30.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb626a2e640 1 -- 172.21.15.67:0/954992419 wait complete. 2024-09-19T05:33:30.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb626a2e640 1 Processor -- start 2024-09-19T05:33:30.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.478+0000 7fb626a2e640 1 -- start start 2024-09-19T05:33:30.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb626a2e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62006f460 0x7fb6201f7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb626a2e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb62015c030 0x7fb620153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb626a2e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb62015d1d0 0x7fb62015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb626a2e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb62015c590 con 0x7fb62006f460 2024-09-19T05:33:30.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb626a2e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb62015c410 con 0x7fb62015c030 2024-09-19T05:33:30.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb626a2e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb6201690e0 con 0x7fb62015d1d0 2024-09-19T05:33:30.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62006f460 0x7fb6201f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62006f460 0x7fb6201f7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34414/0 (socket says 172.21.15.67:34414) 2024-09-19T05:33:30.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61ffff640 1 -- 172.21.15.67:0/4072178650 learned_addr learned my addr 172.21.15.67:0/4072178650 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb624fcb640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb62015d1d0 0x7fb62015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61f7fe640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb62015c030 0x7fb620153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61ffff640 1 -- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb62015d1d0 msgr2=0x7fb62015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61ffff640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb62015d1d0 0x7fb62015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61ffff640 1 -- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb62015c030 msgr2=0x7fb620153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61ffff640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb62015c030 0x7fb620153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61ffff640 1 -- 172.21.15.67:0/4072178650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6201546b0 con 0x7fb62006f460 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61f7fe640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb62015c030 0x7fb620153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61ffff640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62006f460 0x7fb6201f7820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb6100ae040 tx=0x7fb6100192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61cff9640 1 -- 172.21.15.67:0/4072178650 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6100ba070 con 0x7fb62006f460 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61cff9640 1 -- 172.21.15.67:0/4072178650 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6100b4420 con 0x7fb62006f460 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61cff9640 1 -- 172.21.15.67:0/4072178650 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6100b0040 con 0x7fb62006f460 2024-09-19T05:33:30.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb626a2e640 1 -- 172.21.15.67:0/4072178650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6200967e0 con 0x7fb62006f460 2024-09-19T05:33:30.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb626a2e640 1 -- 172.21.15.67:0/4072178650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb620096da0 con 0x7fb62006f460 2024-09-19T05:33:30.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb626a2e640 1 -- 172.21.15.67:0/4072178650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb62006f890 con 0x7fb62006f460 2024-09-19T05:33:30.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61cff9640 1 -- 172.21.15.67:0/4072178650 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb6100bd070 con 0x7fb62006f460 2024-09-19T05:33:30.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61cff9640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 0x7fb600069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61cff9640 1 -- 172.21.15.67:0/4072178650 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb61011f040 con 0x7fb62006f460 2024-09-19T05:33:30.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.482+0000 7fb61f7fe640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 0x7fb600069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.486+0000 7fb61f7fe640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 0x7fb600069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6201fb340 tx=0x7fb608008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.486+0000 7fb61cff9640 1 -- 172.21.15.67:0/4072178650 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb610016110 con 0x7fb62006f460 2024-09-19T05:33:30.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.650+0000 7fb626a2e640 1 -- 172.21.15.67:0/4072178650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb62015cfb0 con 0x7fb62006f460 2024-09-19T05:33:30.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.654+0000 7fb61cff9640 1 -- 172.21.15.67:0/4072178650 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7fb6100ef8d0 con 0x7fb62006f460 2024-09-19T05:33:30.658 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:30.658 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 -- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 msgr2=0x7fb600069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 0x7fb600069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6201fb340 tx=0x7fb608008040 comp rx=0 tx=0).stop 2024-09-19T05:33:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 -- 172.21.15.67:0/4072178650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62006f460 msgr2=0x7fb6201f7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62006f460 0x7fb6201f7820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb6100ae040 tx=0x7fb6100192c0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 -- 172.21.15.67:0/4072178650 shutdown_connections 2024-09-19T05:33:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 0x7fb600069d80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb62015d1d0 0x7fb62015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb62015c030 0x7fb620153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 --2- 172.21.15.67:0/4072178650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb62006f460 0x7fb6201f7820 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 -- 172.21.15.67:0/4072178650 >> 172.21.15.67:0/4072178650 conn(0x7fb6200d0080 msgr2=0x7fb62015c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 -- 172.21.15.67:0/4072178650 shutdown_connections 2024-09-19T05:33:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.658+0000 7fb626a2e640 1 -- 172.21.15.67:0/4072178650 wait complete. 2024-09-19T05:33:30.676 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-19T05:33:30.676 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-19T05:33:30.677 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-19T05:33:30.677 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-19T05:33:30.677 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-19T05:33:30.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-19T05:33:30.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-19T05:33:30.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-19T05:33:30.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.850+0000 7f549ed73640 1 Processor -- start 2024-09-19T05:33:30.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.850+0000 7f549ed73640 1 -- start start 2024-09-19T05:33:30.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.850+0000 7f549ed73640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f54980d1590 0x7f54980d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.850+0000 7f549ed73640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54980b51d0 0x7f54980cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.850+0000 7f549ed73640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54980d4d40 con 0x7f5498161da0 2024-09-19T05:33:30.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.850+0000 7f549ed73640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f54980d0840 con 0x7f54980b51d0 2024-09-19T05:33:30.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.850+0000 7f549ed73640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f54980d5020 con 0x7f54980d1590 2024-09-19T05:33:30.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.850+0000 7f549d310640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54980b51d0 0x7f54980cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.850+0000 7f549d310640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54980b51d0 0x7f54980cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34426/0 (socket says 172.21.15.67:34426) 2024-09-19T05:33:30.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.850+0000 7f549d310640 1 -- 172.21.15.67:0/1739255392 learned_addr learned my addr 172.21.15.67:0/1739255392 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.854+0000 7f549d310640 1 -- 172.21.15.67:0/1739255392 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f54980d1590 msgr2=0x7f54980d1af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T05:33:30.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.854+0000 7f549d310640 1 --2- 172.21.15.67:0/1739255392 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f54980d1590 0x7f54980d1af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.854+0000 7f549d310640 1 -- 172.21.15.67:0/1739255392 >> v1:172.21.15.97:6789/0 conn(0x7f5498161da0 legacy=0x7f54980d0e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T05:33:30.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.854+0000 7f549d310640 1 -- 172.21.15.67:0/1739255392 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54980d5300 con 0x7f54980b51d0 2024-09-19T05:33:30.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.854+0000 7f549d310640 1 --2- 172.21.15.67:0/1739255392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54980b51d0 0x7f54980cf150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5490009e50 tx=0x7f549001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d82fb01ee57ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.854+0000 7f54977fe640 1 -- 172.21.15.67:0/1739255392 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54900a5660 con 0x7f54980b51d0 2024-09-19T05:33:30.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.854+0000 7f54977fe640 1 -- 172.21.15.67:0/1739255392 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54900a5800 con 0x7f54980b51d0 2024-09-19T05:33:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.854+0000 7f54977fe640 1 -- 172.21.15.67:0/1739255392 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54900a5bd0 con 0x7f54980b51d0 2024-09-19T05:33:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 -- 172.21.15.67:0/1739255392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54980b51d0 msgr2=0x7f54980cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 --2- 172.21.15.67:0/1739255392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54980b51d0 0x7f54980cf150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5490009e50 tx=0x7f549001ca10 comp rx=0 tx=0).stop 2024-09-19T05:33:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 -- 172.21.15.67:0/1739255392 shutdown_connections 2024-09-19T05:33:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 --2- 172.21.15.67:0/1739255392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54980b51d0 0x7f54980cf150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 --2- 172.21.15.67:0/1739255392 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f54980d1590 0x7f54980d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 -- 172.21.15.67:0/1739255392 >> 172.21.15.67:0/1739255392 conn(0x7f549808bfc0 msgr2=0x7f54980d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 -- 172.21.15.67:0/1739255392 shutdown_connections 2024-09-19T05:33:30.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 -- 172.21.15.67:0/1739255392 wait complete. 2024-09-19T05:33:30.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f524c9c1640 1 Processor -- start 2024-09-19T05:33:30.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f524c9c1640 1 -- start start 2024-09-19T05:33:30.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f8233478640 1 Processor -- start 2024-09-19T05:33:30.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 Processor -- start 2024-09-19T05:33:30.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f8233478640 1 -- start start 2024-09-19T05:33:30.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7fd80ea4c640 1 Processor -- start 2024-09-19T05:33:30.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7fd80ea4c640 1 -- start start 2024-09-19T05:33:30.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f524c9c1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5240037dc0 0x7f5240052fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f524c9c1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f52400e6540 0x7f52400e6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 -- start start 2024-09-19T05:33:30.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54980b51d0 0x7f54980b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f54980d1590 0x7f54981555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5498161da0 0x7f5498155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f54980d0020 con 0x7f5498161da0 2024-09-19T05:33:30.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f54980cfea0 con 0x7f54980b51d0 2024-09-19T05:33:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f549ed73640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f54980d01a0 con 0x7f54980d1590 2024-09-19T05:33:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f524c9c1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52400e6ea0 con 0x7f524003dc00 2024-09-19T05:33:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f5246d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5240037dc0 0x7f5240052fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f524c9c1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5240053930 con 0x7f52400e6540 2024-09-19T05:33:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f5246d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5240037dc0 0x7f5240052fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:34578/0 (socket says 172.21.15.67:34578) 2024-09-19T05:33:30.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f5246d9d640 1 -- 172.21.15.67:0/1044353305 learned_addr learned my addr 172.21.15.67:0/1044353305 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f524c9c1640 1 -- 172.21.15.67:0/1044353305 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5240057430 con 0x7f5240037dc0 2024-09-19T05:33:30.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f549cb0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54980b51d0 0x7f54980b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f549cb0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54980b51d0 0x7f54980b9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46012/0 (socket says 172.21.15.67:46012) 2024-09-19T05:33:30.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f549cb0f640 1 -- 172.21.15.67:0/329544300 learned_addr learned my addr 172.21.15.67:0/329544300 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f524659c640 1 --2- 172.21.15.67:0/1044353305 >> v2:172.21.15.67:3300/0 conn(0x7f52400e6540 0x7f52400e6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7fdf4db1a640 1 Processor -- start 2024-09-19T05:33:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7fdf4db1a640 1 -- start start 2024-09-19T05:33:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7fd80ea4c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd808072590 0x7fd808166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7fd80ea4c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8080b3860 con 0x7fd80815b1e0 2024-09-19T05:33:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd80ea4c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8080b3b40 con 0x7fd8080b4900 2024-09-19T05:33:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd80ea4c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd80815b5c0 con 0x7fd808072590 2024-09-19T05:33:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f8233478640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8224005eb0 0x7f82240070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f8233478640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8224033bf0 0x7f8224006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f8233478640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f822400b840 con 0x7f8224007610 2024-09-19T05:33:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f8233478640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f822400a2f0 con 0x7f8224033bf0 2024-09-19T05:33:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.858+0000 7f8233478640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8224055600 con 0x7f8224005eb0 2024-09-19T05:33:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5497fff640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f54980d1590 0x7f54981555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f549d310640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5498161da0 0x7f5498155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f8232c77640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8224033bf0 0x7f8224006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f8232c77640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8224033bf0 0x7f8224006290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34458/0 (socket says 172.21.15.67:34458) 2024-09-19T05:33:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f8232c77640 1 -- 172.21.15.67:0/2976262482 learned_addr learned my addr 172.21.15.67:0/2976262482 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd8077fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd8080b4900 0x7fd808071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:47896/0 (socket says 172.21.15.67:47896) 2024-09-19T05:33:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd8077fe640 1 -- 172.21.15.67:0/1105545000 learned_addr learned my addr 172.21.15.67:0/1105545000 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:30.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f8232476640 1 --2- 172.21.15.67:0/2976262482 >> v2:172.21.15.97:3300/0 conn(0x7f8224005eb0 0x7f82240070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fdf4db1a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf40100440 0x7fdf40100860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fdf4db1a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf4000a260 con 0x7fdf40006fc0 2024-09-19T05:33:30.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fdf4db1a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf40009f80 con 0x7fdf40036030 2024-09-19T05:33:30.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fdf4db1a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdf40055470 con 0x7fdf40100440 2024-09-19T05:33:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5497fff640 1 -- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54980b51d0 msgr2=0x7f54980b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5497fff640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54980b51d0 0x7f54980b9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5497fff640 1 -- 172.21.15.67:0/329544300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5498161da0 msgr2=0x7f5498155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5497fff640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5498161da0 0x7f5498155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5497fff640 1 -- 172.21.15.67:0/329544300 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54980b8ba0 con 0x7f54980d1590 2024-09-19T05:33:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5245d9b640 1 -- 172.21.15.67:0/1044353305 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297274183 0 0) 0x7f52400e6ea0 con 0x7f524003dc00 2024-09-19T05:33:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5245d9b640 1 -- 172.21.15.67:0/1044353305 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5230003530 con 0x7f524003dc00 2024-09-19T05:33:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf40100440 0x7fdf40100860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fdf4cb18640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdf40006fc0 0x7fdf40006750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34512/0 (socket says 172.21.15.67:34512) 2024-09-19T05:33:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fdf4cb18640 1 -- 172.21.15.67:0/530448658 learned_addr learned my addr 172.21.15.67:0/530448658 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3058703915 0 0) 0x7fd8080b3860 con 0x7fd80815b1e0 2024-09-19T05:33:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7f0003530 con 0x7fd80815b1e0 2024-09-19T05:33:30.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5246d9d640 1 -- 172.21.15.67:0/1044353305 >> v2:172.21.15.67:3300/0 conn(0x7f52400e6540 msgr2=0x7f52400e6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5246d9d640 1 --2- 172.21.15.67:0/1044353305 >> v2:172.21.15.67:3300/0 conn(0x7f52400e6540 0x7f52400e6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5246d9d640 1 -- 172.21.15.67:0/1044353305 >> v1:172.21.15.67:6789/0 conn(0x7f524003dc00 legacy=0x7f524003e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5246d9d640 1 -- 172.21.15.67:0/1044353305 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5240057100 con 0x7f5240037dc0 2024-09-19T05:33:30.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f5497fff640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f54980d1590 0x7f54981555a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f548400b3f0 tx=0x7f548400b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1074546547 0 0) 0x7fd8080b3b40 con 0x7fd8080b4900 2024-09-19T05:33:30.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7f00048f0 con 0x7fd8080b4900 2024-09-19T05:33:30.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f8232c77640 1 -- 172.21.15.67:0/2976262482 >> v2:172.21.15.97:3300/0 conn(0x7f8224005eb0 msgr2=0x7f82240070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f8232c77640 1 --2- 172.21.15.67:0/2976262482 >> v2:172.21.15.97:3300/0 conn(0x7f8224005eb0 0x7f82240070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f8232c77640 1 -- 172.21.15.67:0/2976262482 >> v1:172.21.15.67:6789/0 conn(0x7f8224007610 legacy=0x7f822403a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f8232c77640 1 -- 172.21.15.67:0/2976262482 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822400bb20 con 0x7f8224033bf0 2024-09-19T05:33:30.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f8232476640 1 --2- 172.21.15.67:0/2976262482 >> v2:172.21.15.97:3300/0 conn(0x7f8224005eb0 0x7f82240070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:30.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd80cfe9640 1 --2- 172.21.15.67:0/1105545000 >> v2:172.21.15.97:3300/0 conn(0x7fd808072590 0x7fd808166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f75f3e7a640 1 Processor -- start 2024-09-19T05:33:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f75f3e7a640 1 -- start start 2024-09-19T05:33:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3848770442 0 0) 0x7fd7f0003530 con 0x7fd80815b1e0 2024-09-19T05:33:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 >> v2:172.21.15.97:3300/0 conn(0x7fd808072590 msgr2=0x7fd808166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 --2- 172.21.15.67:0/1105545000 >> v2:172.21.15.97:3300/0 conn(0x7fd808072590 0x7fd808166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 >> v1:172.21.15.97:6789/0 conn(0x7fd8080b4900 legacy=0x7fd808071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8080b3e20 con 0x7fd80815b1e0 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fd7fc001660 con 0x7fd80815b1e0 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 >> v1:172.21.15.67:6789/0 conn(0x7fd80815b1e0 legacy=0x7fd8080b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 --2- 172.21.15.67:0/1105545000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7f0004da0 0x7fd7f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 --2- 172.21.15.67:0/1105545000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7f0003800 0x7fd7f0003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 --2- 172.21.15.67:0/1105545000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7f00042b0 0x7fd7f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd80815b5c0 con 0x7fd7f0004da0 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0014a80 con 0x7fd7f0003800 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd7f0014c80 con 0x7fd7f00042b0 2024-09-19T05:33:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd807fff640 1 --2- 172.21.15.67:0/1105545000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7f0004da0 0x7fd7f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f54957fa640 1 -- 172.21.15.67:0/329544300 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484015020 con 0x7f54980d1590 2024-09-19T05:33:30.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f54957fa640 1 -- 172.21.15.67:0/329544300 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5484011850 con 0x7f54980d1590 2024-09-19T05:33:30.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd807fff640 1 -- 172.21.15.67:0/1105545000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7f00042b0 msgr2=0x7fd7f000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd807fff640 1 --2- 172.21.15.67:0/1105545000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7f00042b0 0x7fd7f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd807fff640 1 -- 172.21.15.67:0/1105545000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7f0003800 msgr2=0x7fd7f0003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd807fff640 1 --2- 172.21.15.67:0/1105545000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7f0003800 0x7fd7f0003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd807fff640 1 -- 172.21.15.67:0/1105545000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8080b3e20 con 0x7fd7f0004da0 2024-09-19T05:33:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fd80cfe9640 1 -- 172.21.15.67:0/1105545000 reap_dead start 2024-09-19T05:33:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f54957fa640 1 -- 172.21.15.67:0/329544300 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484011c40 con 0x7f54980d1590 2024-09-19T05:33:30.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f75f3e7a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f75ec15e610 0x7f75ec162a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f75f3e7a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75ec0cf070 0x7f75ec15e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f75f3e7a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ec162fb0 con 0x7f75ec15ef30 2024-09-19T05:33:30.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f75f3e7a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f75ec0d0120 con 0x7f75ec15e610 2024-09-19T05:33:30.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f75f3e7a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0cf510 con 0x7f75ec0cf070 2024-09-19T05:33:30.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f75f2417640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f75ec15ef30 0x7f75ec0d0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34516/0 (socket says 172.21.15.67:34516) 2024-09-19T05:33:30.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7f75f2417640 1 -- 172.21.15.67:0/1347302999 learned_addr learned my addr 172.21.15.67:0/1347302999 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:30.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f1c16640 1 --2- 172.21.15.67:0/1347302999 >> v2:172.21.15.67:3300/0 conn(0x7f75ec15e610 0x7f75ec162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f1415640 1 --2- 172.21.15.67:0/1347302999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75ec0cf070 0x7f75ec15e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fdf47fff640 1 -- 172.21.15.67:0/530448658 >> v1:172.21.15.97:6789/0 conn(0x7fdf40036030 legacy=0x7fdf4004eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fdf47fff640 1 -- 172.21.15.67:0/530448658 >> v1:172.21.15.67:6789/0 conn(0x7fdf40006fc0 legacy=0x7fdf40006750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.862+0000 7fdf47fff640 1 -- 172.21.15.67:0/530448658 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf40055100 con 0x7fdf40100440 2024-09-19T05:33:30.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f0c14640 1 -- 172.21.15.67:0/1347302999 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207384180 0 0) 0x7f75e40014a0 con 0x7f75ec15ef30 2024-09-19T05:33:30.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f8232c77640 1 --2- 172.21.15.67:0/2976262482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8224033bf0 0x7f8224006290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8224009ce0 tx=0x7f822801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0377f569640f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f0c14640 1 -- 172.21.15.67:0/1347302999 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75d8003530 con 0x7f75ec15ef30 2024-09-19T05:33:30.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f549ed73640 1 -- 172.21.15.67:0/329544300 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54980b8e80 con 0x7f54980d1590 2024-09-19T05:33:30.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f549ed73640 1 -- 172.21.15.67:0/329544300 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54980b9440 con 0x7f54980d1590 2024-09-19T05:33:30.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f1c16640 1 -- 172.21.15.67:0/1347302999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75ec0cf070 msgr2=0x7f75ec15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f1c16640 1 --2- 172.21.15.67:0/1347302999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75ec0cf070 0x7f75ec15e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f1c16640 1 -- 172.21.15.67:0/1347302999 >> v1:172.21.15.67:6789/0 conn(0x7f75ec15ef30 legacy=0x7f75ec0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f1c16640 1 -- 172.21.15.67:0/1347302999 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec0cf7f0 con 0x7f75ec15e610 2024-09-19T05:33:30.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f549ed73640 1 -- 172.21.15.67:0/329544300 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54980cf150 con 0x7f54980d1590 2024-09-19T05:33:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf47fff640 1 --2- 172.21.15.67:0/530448658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf40100440 0x7fdf40100860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf400555f0 tx=0x7fdf3c01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d745996cda01c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f5246d9d640 1 --2- 172.21.15.67:0/1044353305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5240037dc0 0x7f5240052fd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5238009870 tx=0x7f523801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=913b2e41c3c98598 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf477fe640 1 -- 172.21.15.67:0/530448658 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0b0070 con 0x7fdf40100440 2024-09-19T05:33:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf477fe640 1 -- 172.21.15.67:0/530448658 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3c0ab600 con 0x7fdf40100440 2024-09-19T05:33:30.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f5245d9b640 1 -- 172.21.15.67:0/1044353305 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52380b5070 con 0x7f5240037dc0 2024-09-19T05:33:30.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf477fe640 1 -- 172.21.15.67:0/530448658 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0ab9d0 con 0x7fdf40100440 2024-09-19T05:33:30.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f5245d9b640 1 -- 172.21.15.67:0/1044353305 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52380a8a50 con 0x7f5240037dc0 2024-09-19T05:33:30.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f5245d9b640 1 -- 172.21.15.67:0/1044353305 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52380a8e00 con 0x7f5240037dc0 2024-09-19T05:33:30.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd807fff640 1 --2- 172.21.15.67:0/1105545000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7f0004da0 0x7fd7f00051c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c0e0 tx=0x7fd7fc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162fd65a64849e12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc007bc0 con 0x7fd7f0004da0 2024-09-19T05:33:30.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7fc0a9070 con 0x7fd7f0004da0 2024-09-19T05:33:30.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd806ffd640 1 -- 172.21.15.67:0/1105545000 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0a5810 con 0x7fd7f0004da0 2024-09-19T05:33:30.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf4db1a640 1 -- 172.21.15.67:0/530448658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf40100440 msgr2=0x7fdf40100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf4db1a640 1 --2- 172.21.15.67:0/530448658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf40100440 0x7fdf40100860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf400555f0 tx=0x7fdf3c01c430 comp rx=0 tx=0).stop 2024-09-19T05:33:30.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf4db1a640 1 -- 172.21.15.67:0/530448658 shutdown_connections 2024-09-19T05:33:30.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf4db1a640 1 --2- 172.21.15.67:0/530448658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf40100440 0x7fdf40100860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf4db1a640 1 -- 172.21.15.67:0/530448658 >> 172.21.15.67:0/530448658 conn(0x7fdf4001d940 msgr2=0x7fdf400545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f524c9c1640 1 -- 172.21.15.67:0/1044353305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5240037dc0 msgr2=0x7f5240052fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f524c9c1640 1 --2- 172.21.15.67:0/1044353305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5240037dc0 0x7f5240052fd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5238009870 tx=0x7f523801ed50 comp rx=0 tx=0).stop 2024-09-19T05:33:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf4db1a640 1 -- 172.21.15.67:0/530448658 shutdown_connections 2024-09-19T05:33:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f524c9c1640 1 -- 172.21.15.67:0/1044353305 shutdown_connections 2024-09-19T05:33:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f524c9c1640 1 --2- 172.21.15.67:0/1044353305 >> v2:172.21.15.67:3300/0 conn(0x7f52400e6540 0x7f52400e6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f524c9c1640 1 --2- 172.21.15.67:0/1044353305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5240037dc0 0x7f5240052fd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f524c9c1640 1 -- 172.21.15.67:0/1044353305 >> 172.21.15.67:0/1044353305 conn(0x7f524003a500 msgr2=0x7f524003a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f524c9c1640 1 -- 172.21.15.67:0/1044353305 shutdown_connections 2024-09-19T05:33:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f524c9c1640 1 -- 172.21.15.67:0/1044353305 wait complete. 2024-09-19T05:33:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd80ea4c640 1 -- 172.21.15.67:0/1105545000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7f0004da0 msgr2=0x7fd7f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd80ea4c640 1 --2- 172.21.15.67:0/1105545000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7f0004da0 0x7fd7f00051c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c0e0 tx=0x7fd7fc01ca90 comp rx=0 tx=0).stop 2024-09-19T05:33:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd80ea4c640 1 -- 172.21.15.67:0/1105545000 shutdown_connections 2024-09-19T05:33:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd80ea4c640 1 --2- 172.21.15.67:0/1105545000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7f0004da0 0x7fd7f00051c0 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c0e0 tx=0x7fd7fc01ca90 comp rx=0 tx=0).stop 2024-09-19T05:33:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd80ea4c640 1 -- 172.21.15.67:0/1105545000 >> 172.21.15.67:0/1105545000 conn(0x7fd8080d0080 msgr2=0x7fd8080d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f8231474640 1 -- 172.21.15.67:0/2976262482 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82280b0070 con 0x7f8224033bf0 2024-09-19T05:33:30.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f8231474640 1 -- 172.21.15.67:0/2976262482 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82280ab600 con 0x7f8224033bf0 2024-09-19T05:33:30.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f8231474640 1 -- 172.21.15.67:0/2976262482 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82280ab9d0 con 0x7f8224033bf0 2024-09-19T05:33:30.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fdf4db1a640 1 -- 172.21.15.67:0/530448658 wait complete. 2024-09-19T05:33:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f1c16640 1 --2- 172.21.15.67:0/1347302999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec15e610 0x7f75ec162a70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f75e80097c0 tx=0x7f75e801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d2a5bbc1b585ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f0c14640 1 -- 172.21.15.67:0/1347302999 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e80a7070 con 0x7f75ec15e610 2024-09-19T05:33:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd80ea4c640 1 -- 172.21.15.67:0/1105545000 shutdown_connections 2024-09-19T05:33:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7fd80ea4c640 1 -- 172.21.15.67:0/1105545000 wait complete. 2024-09-19T05:33:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f54957fa640 1 -- 172.21.15.67:0/329544300 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5484018020 con 0x7f54980d1590 2024-09-19T05:33:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f75f0c14640 1 -- 172.21.15.67:0/1347302999 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e80b0070 con 0x7f75ec15e610 2024-09-19T05:33:30.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.866+0000 7f54957fa640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f547c067990 0x7f547c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f8233478640 1 -- 172.21.15.67:0/2976262482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8224033bf0 msgr2=0x7f8224006290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f8233478640 1 --2- 172.21.15.67:0/2976262482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8224033bf0 0x7f8224006290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8224009ce0 tx=0x7f822801c400 comp rx=0 tx=0).stop 2024-09-19T05:33:30.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f54957fa640 1 -- 172.21.15.67:0/329544300 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f54840863c0 con 0x7f54980d1590 2024-09-19T05:33:30.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f8233478640 1 -- 172.21.15.67:0/2976262482 shutdown_connections 2024-09-19T05:33:30.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f8233478640 1 --2- 172.21.15.67:0/2976262482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8224033bf0 0x7f8224006290 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f8233478640 1 --2- 172.21.15.67:0/2976262482 >> v2:172.21.15.97:3300/0 conn(0x7f8224005eb0 0x7f82240070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f8233478640 1 -- 172.21.15.67:0/2976262482 >> 172.21.15.67:0/2976262482 conn(0x7f822401dd90 msgr2=0x7f8224054a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f54957fa640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x7f547c071110 0x7f547c073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f549cb0f640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f547c067990 0x7f547c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f54957fa640 1 -- 172.21.15.67:0/329544300 --> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f548400de50 con 0x7f547c071110 2024-09-19T05:33:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524c9c1640 1 Processor -- start 2024-09-19T05:33:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f54957fa640 1 -- 172.21.15.67:0/329544300 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f54840867b0 con 0x7f54980d1590 2024-09-19T05:33:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f8233478640 1 -- 172.21.15.67:0/2976262482 shutdown_connections 2024-09-19T05:33:30.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf4db1a640 1 Processor -- start 2024-09-19T05:33:30.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f75f3e7a640 1 -- 172.21.15.67:0/1347302999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec15e610 msgr2=0x7f75ec162a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f75f3e7a640 1 --2- 172.21.15.67:0/1347302999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec15e610 0x7f75ec162a70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f75e80097c0 tx=0x7f75e801c470 comp rx=0 tx=0).stop 2024-09-19T05:33:30.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f549d310640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x7f547c071110 0x7f547c073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf4db1a640 1 -- start start 2024-09-19T05:33:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524c9c1640 1 -- start start 2024-09-19T05:33:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5c062f1640 1 Processor -- start 2024-09-19T05:33:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5c062f1640 1 -- start start 2024-09-19T05:33:30.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd80ea4c640 1 Processor -- start 2024-09-19T05:33:30.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd80ea4c640 1 -- start start 2024-09-19T05:33:30.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f8233478640 1 -- 172.21.15.67:0/2976262482 wait complete. 2024-09-19T05:33:30.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f75f3e7a640 1 -- 172.21.15.67:0/1347302999 shutdown_connections 2024-09-19T05:33:30.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f75f3e7a640 1 --2- 172.21.15.67:0/1347302999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75ec0cf070 0x7f75ec15e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f75f3e7a640 1 --2- 172.21.15.67:0/1347302999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec15e610 0x7f75ec162a70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f75f3e7a640 1 -- 172.21.15.67:0/1347302999 >> 172.21.15.67:0/1347302999 conn(0x7f75ec08bfc0 msgr2=0x7f75ec0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f549d310640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x7f547c071110 0x7f547c073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524c9c1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5240037dc0 0x7f5240004e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524c9c1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f524003dc00 0x7f52400dbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524c9c1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52400e6540 0x7f524004e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524c9c1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5240053e60 con 0x7f524003dc00 2024-09-19T05:33:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524c9c1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5240053b80 con 0x7f52400e6540 2024-09-19T05:33:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524c9c1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5240053510 con 0x7f5240037dc0 2024-09-19T05:33:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52400e6540 0x7f524004e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52400e6540 0x7f524004e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46056/0 (socket says 172.21.15.67:46056) 2024-09-19T05:33:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524759e640 1 -- 172.21.15.67:0/2000377369 learned_addr learned my addr 172.21.15.67:0/2000377369 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5c062f1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5c00073980 0x7f5c000b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5c062f1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c000afb40 con 0x7f5c00166f30 2024-09-19T05:33:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5c062f1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c000afe20 con 0x7f5c00162950 2024-09-19T05:33:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5c062f1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5c000b0100 con 0x7f5c00073980 2024-09-19T05:33:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf4db1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf40006fc0 0x7fdf400fa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd80ea4c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8080cf470 0x7fd808155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd80ea4c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8081557a0 0x7fd80815d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd80ea4c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80815d720 0x7fd8081456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd80ea4c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd808072000 con 0x7fd8081557a0 2024-09-19T05:33:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd80ea4c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd808071e80 con 0x7fd80815d720 2024-09-19T05:33:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd80ea4c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd808072180 con 0x7fd8080cf470 2024-09-19T05:33:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524659c640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f524003dc00 0x7f52400dbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bff7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5c00166f30 0x7f5c00073270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34530/0 (socket says 172.21.15.67:34530) 2024-09-19T05:33:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bff7fe640 1 -- 172.21.15.67:0/2543429897 learned_addr learned my addr 172.21.15.67:0/2543429897 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5c0488e640 1 --2- 172.21.15.67:0/2543429897 >> v2:172.21.15.67:3300/0 conn(0x7f5c00073980 0x7f5c000b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f75f3e7a640 1 -- 172.21.15.67:0/1347302999 shutdown_connections 2024-09-19T05:33:30.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f549cb0f640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f547c067990 0x7f547c069e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f548c0099a0 tx=0x7f548c0090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f75f3e7a640 1 -- 172.21.15.67:0/1347302999 wait complete. 2024-09-19T05:33:30.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524759e640 1 -- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5240037dc0 msgr2=0x7f5240004e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524759e640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5240037dc0 0x7f5240004e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524759e640 1 -- 172.21.15.67:0/2000377369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f524003dc00 msgr2=0x7f52400dbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524759e640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f524003dc00 0x7f52400dbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524759e640 1 -- 172.21.15.67:0/2000377369 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524004dfe0 con 0x7f52400e6540 2024-09-19T05:33:30.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd807fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8080cf470 0x7fd808155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd807fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8080cf470 0x7fd808155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:34630/0 (socket says 172.21.15.67:34630) 2024-09-19T05:33:30.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd807fff640 1 -- 172.21.15.67:0/2990319609 learned_addr learned my addr 172.21.15.67:0/2990319609 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd80cfe9640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80815d720 0x7fd8081456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf4db1a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf40036030 0x7fdf40102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220775619 0 0) 0x7f5c000afb40 con 0x7f5c00166f30 2024-09-19T05:33:30.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5be8003530 con 0x7f5c00166f30 2024-09-19T05:33:30.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f8233478640 1 Processor -- start 2024-09-19T05:33:30.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf4db1a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf40100440 0x7fdf40103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f524759e640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52400e6540 0x7f524004e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5248051960 tx=0x7f52480697f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf4db1a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4000bb40 con 0x7fdf40006fc0 2024-09-19T05:33:30.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f8233478640 1 -- start start 2024-09-19T05:33:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 461901976 0 0) 0x7f5be8003530 con 0x7f5c00166f30 2024-09-19T05:33:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 >> v2:172.21.15.67:3300/0 conn(0x7f5c00073980 msgr2=0x7f5c000b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 --2- 172.21.15.67:0/2543429897 >> v2:172.21.15.67:3300/0 conn(0x7f5c00073980 0x7f5c000b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 >> v1:172.21.15.97:6789/0 conn(0x7f5c00162950 legacy=0x7f5c000acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c000b03e0 con 0x7f5c00166f30 2024-09-19T05:33:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f5bf0001680 con 0x7f5c00166f30 2024-09-19T05:33:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 >> v1:172.21.15.67:6789/0 conn(0x7f5c00166f30 legacy=0x7f5c00073270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80039c0 0x7f5be8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be8004810 0x7f5be8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf40036030 0x7fdf40102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf40036030 0x7fdf40102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46068/0 (socket says 172.21.15.67:46068) 2024-09-19T05:33:30.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf47fff640 1 -- 172.21.15.67:0/2819954847 learned_addr learned my addr 172.21.15.67:0/2819954847 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf4d319640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf40100440 0x7fdf40103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4000b9c0 con 0x7fdf40036030 2024-09-19T05:33:30.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdf40009ba0 con 0x7fdf40100440 2024-09-19T05:33:30.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80051d0 0x7f5be800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5c000b0100 con 0x7f5be80051d0 2024-09-19T05:33:30.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5be800c100 con 0x7f5be80039c0 2024-09-19T05:33:30.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5be800c300 con 0x7f5be8004810 2024-09-19T05:33:30.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd807fff640 1 -- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80815d720 msgr2=0x7fd8081456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd807fff640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80815d720 0x7fd8081456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd807fff640 1 -- 172.21.15.67:0/2990319609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8081557a0 msgr2=0x7fd80815d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd807fff640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8081557a0 0x7fd80815d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.870+0000 7fd807fff640 1 -- 172.21.15.67:0/2990319609 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd808155c20 con 0x7fd8080cf470 2024-09-19T05:33:30.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f522f7fe640 1 -- 172.21.15.67:0/2000377369 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52480741c0 con 0x7f52400e6540 2024-09-19T05:33:30.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52400de8d0 con 0x7f52400e6540 2024-09-19T05:33:30.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524004c990 con 0x7f52400e6540 2024-09-19T05:33:30.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f5c0488e640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80051d0 0x7f5be800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f5bfffff640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80039c0 0x7f5be8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fd807fff640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8080cf470 0x7fd808155260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc01d330 tx=0x7fd7f0005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f5bff7fe640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be8004810 0x7f5be8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f5c0488e640 1 -- 172.21.15.67:0/2543429897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be8004810 msgr2=0x7f5be8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f5c0488e640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be8004810 0x7f5be8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f5c0488e640 1 -- 172.21.15.67:0/2543429897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80039c0 msgr2=0x7f5be8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f5c0488e640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80039c0 0x7f5be8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf4cb18640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf40006fc0 0x7fdf400fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8233478640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8224005eb0 0x7f8224036840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8233478640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8224033bf0 0x7f822404f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8233478640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82240daac0 0x7f8224034620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8233478640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f82240e6330 con 0x7f8224005eb0 2024-09-19T05:33:30.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8233478640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8224006be0 con 0x7f8224033bf0 2024-09-19T05:33:30.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8233478640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f82240e64b0 con 0x7f82240daac0 2024-09-19T05:33:30.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f3e7a640 1 Processor -- start 2024-09-19T05:33:30.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c8bbc640 1 Processor -- start 2024-09-19T05:33:30.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf47fff640 1 -- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf40100440 msgr2=0x7fdf40103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf47fff640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf40100440 0x7fdf40103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf47fff640 1 -- 172.21.15.67:0/2819954847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf40006fc0 msgr2=0x7fdf400fa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf47fff640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf40006fc0 0x7fdf400fa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf47fff640 1 -- 172.21.15.67:0/2819954847 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf400f8ac0 con 0x7fdf40036030 2024-09-19T05:33:30.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f3e7a640 1 -- start start 2024-09-19T05:33:30.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f5c0488e640 1 -- 172.21.15.67:0/2543429897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c000b03e0 con 0x7f5be80051d0 2024-09-19T05:33:30.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8231c75640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8224033bf0 0x7f822404f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8232476640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8224005eb0 0x7f8224036840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8231c75640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8224033bf0 0x7f822404f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46086/0 (socket says 172.21.15.67:46086) 2024-09-19T05:33:30.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8231c75640 1 -- 172.21.15.67:0/771724076 learned_addr learned my addr 172.21.15.67:0/771724076 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c8bbc640 1 -- start start 2024-09-19T05:33:30.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f522f7fe640 1 -- 172.21.15.67:0/2000377369 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524806de50 con 0x7f52400e6540 2024-09-19T05:33:30.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8232c77640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82240daac0 0x7f8224034620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8232476640 1 -- 172.21.15.67:0/771724076 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82240daac0 msgr2=0x7f8224034620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8232476640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82240daac0 0x7f8224034620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8232476640 1 -- 172.21.15.67:0/771724076 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8224033bf0 msgr2=0x7f822404f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8232476640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8224033bf0 0x7f822404f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8232476640 1 -- 172.21.15.67:0/771724076 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82240db080 con 0x7f8224005eb0 2024-09-19T05:33:30.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f3e7a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec0cf070 0x7f75ec151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8232476640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8224005eb0 0x7f8224036840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f822c06af10 tx=0x7f822c0690e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f3e7a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec15e610 0x7f75ec158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f3e7a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75ec15ef30 0x7f75ec0b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f3e7a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec16b400 con 0x7f75ec0cf070 2024-09-19T05:33:30.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f3e7a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec15f340 con 0x7f75ec15e610 2024-09-19T05:33:30.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f3e7a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec16b580 con 0x7f75ec15ef30 2024-09-19T05:33:30.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c8bbc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77c41455c0 0x7f77c40b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c8bbc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c40702d0 0x7f77c406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c8bbc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c40b4250 con 0x7f77c40b5f90 2024-09-19T05:33:30.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c8bbc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f77c40b4530 con 0x7f77c41455c0 2024-09-19T05:33:30.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c8bbc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f77c40b4810 con 0x7f77c40702d0 2024-09-19T05:33:30.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f54957fa640 1 -- 172.21.15.67:0/329544300 <== osd.6 v2:172.21.15.97:6800/2892447445 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f548400de50 con 0x7f547c071110 2024-09-19T05:33:30.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52400e7230 con 0x7f52400e6540 2024-09-19T05:33:30.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f1c16640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec0cf070 0x7f75ec151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f1c16640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec0cf070 0x7f75ec151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34528/0 (socket says 172.21.15.67:34528) 2024-09-19T05:33:30.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f1c16640 1 -- 172.21.15.67:0/2357241923 learned_addr learned my addr 172.21.15.67:0/2357241923 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f522f7fe640 1 -- 172.21.15.67:0/2000377369 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248093640 con 0x7f52400e6540 2024-09-19T05:33:30.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8222ffd640 1 -- 172.21.15.67:0/771724076 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c098070 con 0x7f8224005eb0 2024-09-19T05:33:30.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f2417640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75ec15ef30 0x7f75ec0b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8222ffd640 1 -- 172.21.15.67:0/771724076 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822c06de50 con 0x7f8224005eb0 2024-09-19T05:33:30.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8222ffd640 1 -- 172.21.15.67:0/771724076 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c0933f0 con 0x7f8224005eb0 2024-09-19T05:33:30.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f1c16640 1 -- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75ec15ef30 msgr2=0x7f75ec0b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c40702d0 0x7f77c406bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c40702d0 0x7f77c406bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:34678/0 (socket says 172.21.15.67:34678) 2024-09-19T05:33:30.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c2ffd640 1 -- 172.21.15.67:0/303945944 learned_addr learned my addr 172.21.15.67:0/303945944 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82240db360 con 0x7f8224005eb0 2024-09-19T05:33:30.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82240db920 con 0x7f8224005eb0 2024-09-19T05:33:30.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f1c16640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75ec15ef30 0x7f75ec0b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f1c16640 1 -- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec15e610 msgr2=0x7f75ec158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f1c16640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec15e610 0x7f75ec158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f1c16640 1 -- 172.21.15.67:0/2357241923 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec15ac10 con 0x7f75ec0cf070 2024-09-19T05:33:30.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f2417640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75ec15ef30 0x7f75ec0b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:30.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f1c16640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec0cf070 0x7f75ec151390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75e80ad040 tx=0x7f75e801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75e27fc640 1 -- 172.21.15.67:0/2357241923 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e80b58d0 con 0x7f75ec0cf070 2024-09-19T05:33:30.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f5c0488e640 1 -- 172.21.15.67:0/2543429897 reap_dead start 2024-09-19T05:33:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf47fff640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf40036030 0x7fdf40102f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c019040 tx=0x7fdf3c0191d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf457fa640 1 -- 172.21.15.67:0/2819954847 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0ba070 con 0x7fdf40036030 2024-09-19T05:33:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf457fa640 1 -- 172.21.15.67:0/2819954847 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3c0b5460 con 0x7fdf40036030 2024-09-19T05:33:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf457fa640 1 -- 172.21.15.67:0/2819954847 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0b0040 con 0x7fdf40036030 2024-09-19T05:33:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf40103990 con 0x7fdf40036030 2024-09-19T05:33:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf400fd3f0 con 0x7fdf40036030 2024-09-19T05:33:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75e27fc640 1 -- 172.21.15.67:0/2357241923 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e80b5a70 con 0x7f75ec0cf070 2024-09-19T05:33:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75e27fc640 1 -- 172.21.15.67:0/2357241923 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e80b5e60 con 0x7f75ec0cf070 2024-09-19T05:33:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec15aef0 con 0x7f75ec0cf070 2024-09-19T05:33:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec1518d0 con 0x7f75ec0cf070 2024-09-19T05:33:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fd804ff9640 1 -- 172.21.15.67:0/2990319609 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc007bc0 con 0x7fd8080cf470 2024-09-19T05:33:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fd804ff9640 1 -- 172.21.15.67:0/2990319609 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7fc001460 con 0x7fd8080cf470 2024-09-19T05:33:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fd80ea4c640 1 -- 172.21.15.67:0/2990319609 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd808155f00 con 0x7fd8080cf470 2024-09-19T05:33:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fd804ff9640 1 -- 172.21.15.67:0/2990319609 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc005290 con 0x7fd8080cf470 2024-09-19T05:33:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75d4001040 con 0x7f75ec0cf070 2024-09-19T05:33:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7fd80ea4c640 1 -- 172.21.15.67:0/2990319609 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80809a1a0 con 0x7fd8080cf470 2024-09-19T05:33:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7fd80ea4c640 1 -- 172.21.15.67:0/2990319609 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8080b2fd0 con 0x7fd8080cf470 2024-09-19T05:33:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf40100860 con 0x7fdf40036030 2024-09-19T05:33:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82240070d0 con 0x7f8224005eb0 2024-09-19T05:33:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8222ffd640 1 -- 172.21.15.67:0/771724076 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f822c093590 con 0x7f8224005eb0 2024-09-19T05:33:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8222ffd640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82100678c0 0x7f8210069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8222ffd640 1 -- 172.21.15.67:0/771724076 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f822c100f70 con 0x7f8224005eb0 2024-09-19T05:33:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8222ffd640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x7f8210070f30 0x7f8210073370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8222ffd640 1 -- 172.21.15.67:0/771724076 --> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f822c08ee80 con 0x7f8210070f30 2024-09-19T05:33:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8232c77640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x7f8210070f30 0x7f8210073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c2ffd640 1 -- 172.21.15.67:0/303945944 >> v2:172.21.15.67:3300/0 conn(0x7f77c41455c0 msgr2=0x7f77c40b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c2ffd640 1 --2- 172.21.15.67:0/303945944 >> v2:172.21.15.67:3300/0 conn(0x7f77c41455c0 0x7f77c40b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c2ffd640 1 -- 172.21.15.67:0/303945944 >> v1:172.21.15.97:6789/0 conn(0x7f77c40b5f90 legacy=0x7f77c4072d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8231c75640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82100678c0 0x7f8210069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.874+0000 7f77c2ffd640 1 -- 172.21.15.67:0/303945944 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c40b4af0 con 0x7f77c40702d0 2024-09-19T05:33:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f522f7fe640 1 -- 172.21.15.67:0/2000377369 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f52480937e0 con 0x7f52400e6540 2024-09-19T05:33:30.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f77c2ffd640 1 --2- 172.21.15.67:0/303945944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c40702d0 0x7f77c406bcc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009870 tx=0x7f77b401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a3f4a4d595275a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8232c77640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x7f8210070f30 0x7f8210073370 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8231c75640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82100678c0 0x7f8210069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8224051400 tx=0x7f821c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f75e27fc640 1 -- 172.21.15.67:0/2357241923 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75e80bd020 con 0x7f75ec0cf070 2024-09-19T05:33:30.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f5c0488e640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80051d0 0x7f5be800b9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c000720d0 tx=0x7f5bf401c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57b5517923466a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f8222ffd640 1 -- 172.21.15.67:0/771724076 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f822c0cd450 con 0x7f8224005eb0 2024-09-19T05:33:30.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7fd804ff9640 1 -- 172.21.15.67:0/2990319609 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd7fc003600 con 0x7fd8080cf470 2024-09-19T05:33:30.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7fd804ff9640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7f4067940 0x7fd7f4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7fd804ff9640 1 -- 172.21.15.67:0/2990319609 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd7fc11fcd0 con 0x7fd8080cf470 2024-09-19T05:33:30.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7fd804ff9640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] conn(0x7fd7f40710c0 0x7fd7f4073500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7fd804ff9640 1 -- 172.21.15.67:0/2990319609 --> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7fc008e50 con 0x7fd7f40710c0 2024-09-19T05:33:30.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7fd804ff9640 1 -- 172.21.15.67:0/2990319609 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd7fc1201b0 con 0x7fd8080cf470 2024-09-19T05:33:30.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40af020 con 0x7f5be80051d0 2024-09-19T05:33:30.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4004220 con 0x7f5be80051d0 2024-09-19T05:33:30.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f5bfeffd640 1 -- 172.21.15.67:0/2543429897 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf400b600 con 0x7f5be80051d0 2024-09-19T05:33:30.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7fd8077fe640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7f4067940 0x7fd7f4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f77c27fc640 1 -- 172.21.15.67:0/303945944 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40b0070 con 0x7f77c40702d0 2024-09-19T05:33:30.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f522f7fe640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5234067990 0x7f5234069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f77c27fc640 1 -- 172.21.15.67:0/303945944 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b40ab600 con 0x7f77c40702d0 2024-09-19T05:33:30.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7fdf457fa640 1 -- 172.21.15.67:0/2819954847 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf3c0bd070 con 0x7fdf40036030 2024-09-19T05:33:30.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f77c27fc640 1 -- 172.21.15.67:0/303945944 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40ab9b0 con 0x7f77c40702d0 2024-09-19T05:33:30.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fd80cfe9640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] conn(0x7fd7f40710c0 0x7fd7f4073500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fdf457fa640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf34067940 0x7fdf34069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f75e27fc640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75d0067910 0x7f75d0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f75e27fc640 1 -- 172.21.15.67:0/2357241923 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f75e8121060 con 0x7f75ec0cf070 2024-09-19T05:33:30.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f75e27fc640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] conn(0x7f75d0071090 0x7f75d00734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f75e27fc640 1 -- 172.21.15.67:0/2357241923 --> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75e80b1ec0 con 0x7f75d0071090 2024-09-19T05:33:30.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.878+0000 7f75e27fc640 1 -- 172.21.15.67:0/2357241923 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75e8121410 con 0x7f75ec0cf070 2024-09-19T05:33:30.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f75f2417640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] conn(0x7f75d0071090 0x7f75d00734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 -- 172.21.15.67:0/2543429897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80051d0 msgr2=0x7f5be800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80051d0 0x7f5be800b9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c000720d0 tx=0x7f5bf401c680 comp rx=0 tx=0).stop 2024-09-19T05:33:30.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fdf457fa640 1 -- 172.21.15.67:0/2819954847 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdf3c1208b0 con 0x7fdf40036030 2024-09-19T05:33:30.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fdf457fa640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] conn(0x7fdf340710b0 0x7fdf340734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fdf457fa640 1 -- 172.21.15.67:0/2819954847 --> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf3c0afe90 con 0x7fdf340710b0 2024-09-19T05:33:30.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fdf457fa640 1 -- 172.21.15.67:0/2819954847 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdf3c120c60 con 0x7fdf40036030 2024-09-19T05:33:30.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f77c8bbc640 1 -- 172.21.15.67:0/303945944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c40702d0 msgr2=0x7f77c406bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f77c8bbc640 1 --2- 172.21.15.67:0/303945944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c40702d0 0x7f77c406bcc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009870 tx=0x7f77b401c420 comp rx=0 tx=0).stop 2024-09-19T05:33:30.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f522f7fe640 1 -- 172.21.15.67:0/2000377369 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5248101990 con 0x7f52400e6540 2024-09-19T05:33:30.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5246d9d640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5234067990 0x7f5234069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f522f7fe640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] conn(0x7f5234071110 0x7f5234073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f522f7fe640 1 -- 172.21.15.67:0/2000377369 --> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f524806de50 con 0x7f5234071110 2024-09-19T05:33:30.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f522f7fe640 1 -- 172.21.15.67:0/2000377369 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5248101d80 con 0x7f52400e6540 2024-09-19T05:33:30.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f524659c640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] conn(0x7f5234071110 0x7f5234073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fdf4d319640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] conn(0x7fdf340710b0 0x7fdf340734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fdf4cb18640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf34067940 0x7fdf34069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fd80cfe9640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] conn(0x7fd7f40710c0 0x7fd7f4073500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fd8077fe640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7f4067940 0x7fd7f4069e00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8000f70 tx=0x7fd7f80079f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f77c8bbc640 1 -- 172.21.15.67:0/303945944 shutdown_connections 2024-09-19T05:33:30.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f77c8bbc640 1 --2- 172.21.15.67:0/303945944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c40702d0 0x7f77c406bcc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f77c8bbc640 1 --2- 172.21.15.67:0/303945944 >> v2:172.21.15.67:3300/0 conn(0x7f77c41455c0 0x7f77c40b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f77c8bbc640 1 -- 172.21.15.67:0/303945944 >> 172.21.15.67:0/303945944 conn(0x7f77c40b2eb0 msgr2=0x7f77c40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 -- 172.21.15.67:0/2543429897 shutdown_connections 2024-09-19T05:33:30.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 --2- 172.21.15.67:0/2543429897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80051d0 0x7f5be800b9d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f8222ffd640 1 -- 172.21.15.67:0/771724076 <== osd.2 v2:172.21.15.67:6824/3795893630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f822c08ee80 con 0x7f8210070f30 2024-09-19T05:33:30.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 -- 172.21.15.67:0/2543429897 >> 172.21.15.67:0/2543429897 conn(0x7f5c000b5710 msgr2=0x7f5c000b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f75f1415640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75d0067910 0x7f75d0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f75f2417640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] conn(0x7f75d0071090 0x7f75d00734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 -- 172.21.15.67:0/2543429897 shutdown_connections 2024-09-19T05:33:30.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 -- 172.21.15.67:0/2543429897 wait complete. 2024-09-19T05:33:30.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fdf4d319640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] conn(0x7fdf340710b0 0x7fdf340734f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f77c8bbc640 1 -- 172.21.15.67:0/303945944 shutdown_connections 2024-09-19T05:33:30.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5246d9d640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5234067990 0x7f5234069e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f52380b2000 tx=0x7f5238004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f524659c640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] conn(0x7f5234071110 0x7f5234073550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f75f1415640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75d0067910 0x7f75d0069dd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75dc006aa0 tx=0x7f75dc006a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f75e27fc640 1 -- 172.21.15.67:0/2357241923 <== osd.3 v2:172.21.15.67:6800/1322632471 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75e80b1ec0 con 0x7f75d0071090 2024-09-19T05:33:30.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fdf4cb18640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf34067940 0x7fdf34069e00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf38005890 tx=0x7fdf38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 Processor -- start 2024-09-19T05:33:30.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 -- start start 2024-09-19T05:33:30.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fd804ff9640 1 -- 172.21.15.67:0/2990319609 <== osd.5 v2:172.21.15.97:6824/112548817 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7fc008e50 con 0x7fd7f40710c0 2024-09-19T05:33:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80051d0 0x7f5c0015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c00154570 0x7f5c0009c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0009c6d0 0x7f5c0014a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5c001673a0 con 0x7f5c00154570 2024-09-19T05:33:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5c000b09a0 con 0x7f5be80051d0 2024-09-19T05:33:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5c062f1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5c00162d30 con 0x7f5c0009c6d0 2024-09-19T05:33:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f522f7fe640 1 -- 172.21.15.67:0/2000377369 <== osd.7 v2:172.21.15.97:6816/3738159386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f524806de50 con 0x7f5234071110 2024-09-19T05:33:30.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7f5bfffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80051d0 0x7f5c0015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.882+0000 7fdf457fa640 1 -- 172.21.15.67:0/2819954847 <== osd.1 v2:172.21.15.67:6808/4222529913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf3c0afe90 con 0x7fdf340710b0 2024-09-19T05:33:30.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80051d0 0x7f5c0015d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46096/0 (socket says 172.21.15.67:46096) 2024-09-19T05:33:30.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5c0488e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0009c6d0 0x7f5c0014a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfffff640 1 -- 172.21.15.67:0/2726301886 learned_addr learned my addr 172.21.15.67:0/2726301886 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bff7fe640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c00154570 0x7f5c0009c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfffff640 1 -- 172.21.15.67:0/2726301886 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0009c6d0 msgr2=0x7f5c0014a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfffff640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0009c6d0 0x7f5c0014a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfffff640 1 -- 172.21.15.67:0/2726301886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c00154570 msgr2=0x7f5c0009c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfffff640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c00154570 0x7f5c0009c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfffff640 1 -- 172.21.15.67:0/2726301886 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0009cb70 con 0x7f5be80051d0 2024-09-19T05:33:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfffff640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80051d0 0x7f5c0015d6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800e7b0 tx=0x7f5bf800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfcff9640 1 -- 172.21.15.67:0/2726301886 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8003b90 con 0x7f5be80051d0 2024-09-19T05:33:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0009ce50 con 0x7f5be80051d0 2024-09-19T05:33:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c0009d410 con 0x7f5be80051d0 2024-09-19T05:33:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f77c8bbc640 1 -- 172.21.15.67:0/303945944 wait complete. 2024-09-19T05:33:30.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c000742b0 con 0x7f5be80051d0 2024-09-19T05:33:30.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f77c8bbc640 1 Processor -- start 2024-09-19T05:33:30.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfcff9640 1 -- 172.21.15.67:0/2726301886 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf8018070 con 0x7f5be80051d0 2024-09-19T05:33:30.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.886+0000 7f5bfcff9640 1 -- 172.21.15.67:0/2726301886 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf80050d0 con 0x7f5be80051d0 2024-09-19T05:33:30.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f77c8bbc640 1 -- start start 2024-09-19T05:33:30.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f77c8bbc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77c40702d0 0x7f77c4155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f5bfcff9640 1 -- 172.21.15.67:0/2726301886 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5bf8005270 con 0x7f5be80051d0 2024-09-19T05:33:30.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f5bfcff9640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bec0678c0 0x7f5bec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f5bfcff9640 1 -- 172.21.15.67:0/2726301886 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5bf8086980 con 0x7f5be80051d0 2024-09-19T05:33:30.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f5bfcff9640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x7f5bec071040 0x7f5bec073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f5bfcff9640 1 -- 172.21.15.67:0/2726301886 --> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bf800dfb0 con 0x7f5bec071040 2024-09-19T05:33:30.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f5bfcff9640 1 -- 172.21.15.67:0/2726301886 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5bf8086d70 con 0x7f5be80051d0 2024-09-19T05:33:30.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f5c0488e640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x7f5bec071040 0x7f5bec073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f5bff7fe640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bec0678c0 0x7f5bec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f5c0488e640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x7f5bec071040 0x7f5bec073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.890+0000 7f5bff7fe640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bec0678c0 0x7f5bec069d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5c0015e420 tx=0x7f5bf0007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f5bfcff9640 1 -- 172.21.15.67:0/2726301886 <== osd.0 v2:172.21.15.67:6816/1029707859 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5bf800dfb0 con 0x7f5bec071040 2024-09-19T05:33:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c8bbc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77c40b5f90 0x7f77c4142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77c40702d0 0x7f77c4155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77c40b5f90 0x7f77c4142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77c40b5f90 0x7f77c4142f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34548/0 (socket says 172.21.15.67:34548) 2024-09-19T05:33:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77c40702d0 0x7f77c4155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46100/0 (socket says 172.21.15.67:46100) 2024-09-19T05:33:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c2ffd640 1 -- 172.21.15.67:0/837390433 learned_addr learned my addr 172.21.15.67:0/837390433 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c8bbc640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c41455c0 0x7f77c41434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c8bbc640 1 -- 172.21.15.67:0/837390433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f77c416f510 con 0x7f77c40b5f90 2024-09-19T05:33:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c8bbc640 1 -- 172.21.15.67:0/837390433 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f77c40b0a70 con 0x7f77c40702d0 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c8bbc640 1 -- 172.21.15.67:0/837390433 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f77c416f690 con 0x7f77c41455c0 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c3fff640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c41455c0 0x7f77c41434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c2ffd640 1 -- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c41455c0 msgr2=0x7f77c41434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c2ffd640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77c41455c0 0x7f77c41434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c2ffd640 1 -- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77c40702d0 msgr2=0x7f77c4155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c2ffd640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77c40702d0 0x7f77c4155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.894+0000 7f77c2ffd640 1 -- 172.21.15.67:0/837390433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c4155e40 con 0x7f77c40b5f90 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.898+0000 7f77c2ffd640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77c40b5f90 0x7f77c4142f80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f77b401aad0 tx=0x7f77b40191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.898+0000 7f77abfff640 1 -- 172.21.15.67:0/837390433 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40b9020 con 0x7f77c40b5f90 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.898+0000 7f77abfff640 1 -- 172.21.15.67:0/837390433 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b40ab9b0 con 0x7f77c40b5f90 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.898+0000 7f77abfff640 1 -- 172.21.15.67:0/837390433 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40b0040 con 0x7f77c40b5f90 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.898+0000 7f77c8bbc640 1 -- 172.21.15.67:0/837390433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c4144a50 con 0x7f77c40b5f90 2024-09-19T05:33:30.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.902+0000 7f77abfff640 1 -- 172.21.15.67:0/837390433 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77b40bc020 con 0x7f77c40b5f90 2024-09-19T05:33:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.902+0000 7f77abfff640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77b0067910 0x7f77b0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.902+0000 7f77c8bbc640 1 -- 172.21.15.67:0/837390433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c40cedf0 con 0x7f77c40b5f90 2024-09-19T05:33:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.902+0000 7f77c37fe640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77b0067910 0x7f77b0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.902+0000 7f77abfff640 1 -- 172.21.15.67:0/837390433 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f77b40ed960 con 0x7f77c40b5f90 2024-09-19T05:33:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.902+0000 7f77c37fe640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77b0067910 0x7f77b0069dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00a400 tx=0x7f77bc00d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.902+0000 7f77c8bbc640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] conn(0x7f77c413cf40 0x7f77c4140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.902+0000 7f77c8bbc640 1 -- 172.21.15.67:0/837390433 --> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77c4144d10 con 0x7f77c413cf40 2024-09-19T05:33:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.902+0000 7f77c3fff640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] conn(0x7f77c413cf40 0x7f77c4140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f77c3fff640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] conn(0x7f77c413cf40 0x7f77c4140db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f549ed73640 1 -- 172.21.15.67:0/329544300 --> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f54980c7c90 con 0x7f547c071110 2024-09-19T05:33:30.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f54957fa640 1 -- 172.21.15.67:0/329544300 <== osd.6 v2:172.21.15.97:6800/2892447445 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f54980c7c90 con 0x7f547c071110 2024-09-19T05:33:30.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f5482ffd640 1 -- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x7f547c071110 msgr2=0x7f547c073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f5482ffd640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x7f547c071110 0x7f547c073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f5482ffd640 1 -- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f547c067990 msgr2=0x7f547c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f5482ffd640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f547c067990 0x7f547c069e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f548c0099a0 tx=0x7f548c0090e0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f5482ffd640 1 -- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f54980d1590 msgr2=0x7f54981555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f5482ffd640 1 --2- 172.21.15.67:0/329544300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f54980d1590 0x7f54981555a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f548400b3f0 tx=0x7f548400b8b0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f549d310640 1 -- 172.21.15.67:0/329544300 reap_dead start 2024-09-19T05:33:30.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f77abfff640 1 -- 172.21.15.67:0/837390433 <== osd.4 v2:172.21.15.97:6802/1358994016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f77c4144d10 con 0x7f77c413cf40 2024-09-19T05:33:30.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7fd80ea4c640 1 -- 172.21.15.67:0/2990319609 --> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd808156a90 con 0x7fd7f40710c0 2024-09-19T05:33:30.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7fd804ff9640 1 -- 172.21.15.67:0/2990319609 <== osd.5 v2:172.21.15.97:6824/112548817 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd808156a90 con 0x7fd7f40710c0 2024-09-19T05:33:30.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd7ee7fc640 1 -- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] conn(0x7fd7f40710c0 msgr2=0x7fd7f4073500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f5482ffd640 1 -- 172.21.15.67:0/329544300 shutdown_connections 2024-09-19T05:33:30.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f5482ffd640 1 -- 172.21.15.67:0/329544300 >> 172.21.15.67:0/329544300 conn(0x7f549808bfc0 msgr2=0x7f549806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f5482ffd640 1 -- 172.21.15.67:0/329544300 shutdown_connections 2024-09-19T05:33:30.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.906+0000 7f5482ffd640 1 -- 172.21.15.67:0/329544300 wait complete. 2024-09-19T05:33:30.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd7ee7fc640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] conn(0x7fd7f40710c0 0x7fd7f4073500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd7ee7fc640 1 -- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7f4067940 msgr2=0x7fd7f4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd7ee7fc640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7f4067940 0x7fd7f4069e00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8000f70 tx=0x7fd7f80079f0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd7ee7fc640 1 -- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8080cf470 msgr2=0x7fd808155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd7ee7fc640 1 --2- 172.21.15.67:0/2990319609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8080cf470 0x7fd808155260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc01d330 tx=0x7fd7f0005840 comp rx=0 tx=0).stop 2024-09-19T05:33:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd80cfe9640 1 -- 172.21.15.67:0/2990319609 reap_dead start 2024-09-19T05:33:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd7ee7fc640 1 -- 172.21.15.67:0/2990319609 shutdown_connections 2024-09-19T05:33:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd7ee7fc640 1 -- 172.21.15.67:0/2990319609 >> 172.21.15.67:0/2990319609 conn(0x7fd8080d0080 msgr2=0x7fd8080b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd7ee7fc640 1 -- 172.21.15.67:0/2990319609 shutdown_connections 2024-09-19T05:33:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fd7ee7fc640 1 -- 172.21.15.67:0/2990319609 wait complete. 2024-09-19T05:33:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 --> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82240dbda0 con 0x7f8210070f30 2024-09-19T05:33:30.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7f8222ffd640 1 -- 172.21.15.67:0/771724076 <== osd.2 v2:172.21.15.67:6824/3795893630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f82240dbda0 con 0x7f8210070f30 2024-09-19T05:33:30.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 --> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f524004c0a0 con 0x7f5234071110 2024-09-19T05:33:30.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.910+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 --> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf40100860 con 0x7fdf340710b0 2024-09-19T05:33:30.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x7f8210070f30 msgr2=0x7f8210073370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8233478640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x7f8210070f30 0x7f8210073370 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82100678c0 msgr2=0x7f8210069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8233478640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82100678c0 0x7f8210069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8224051400 tx=0x7f821c009040 comp rx=0 tx=0).stop 2024-09-19T05:33:30.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8224005eb0 msgr2=0x7f8224036840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8233478640 1 --2- 172.21.15.67:0/771724076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8224005eb0 0x7f8224036840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f822c06af10 tx=0x7f822c0690e0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8232c77640 1 -- 172.21.15.67:0/771724076 reap_dead start 2024-09-19T05:33:30.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 shutdown_connections 2024-09-19T05:33:30.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 >> 172.21.15.67:0/771724076 conn(0x7f822401dd90 msgr2=0x7f82240dcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 --> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f75d4002de0 con 0x7f75d0071090 2024-09-19T05:33:30.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f522f7fe640 1 -- 172.21.15.67:0/2000377369 <== osd.7 v2:172.21.15.97:6816/3738159386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f524004c0a0 con 0x7f5234071110 2024-09-19T05:33:30.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf457fa640 1 -- 172.21.15.67:0/2819954847 <== osd.1 v2:172.21.15.67:6808/4222529913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf40100860 con 0x7fdf340710b0 2024-09-19T05:33:30.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75e27fc640 1 -- 172.21.15.67:0/2357241923 <== osd.3 v2:172.21.15.67:6800/1322632471 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f75d4002de0 con 0x7f75d0071090 2024-09-19T05:33:30.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] conn(0x7f5234071110 msgr2=0x7f5234073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f524c9c1640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] conn(0x7f5234071110 0x7f5234073550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 >> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] conn(0x7fdf340710b0 msgr2=0x7fdf340734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4db1a640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] conn(0x7fdf340710b0 0x7fdf340734f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf34067940 msgr2=0x7fdf34069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 >> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] conn(0x7f75d0071090 msgr2=0x7f75d00734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] conn(0x7f75d0071090 0x7f75d00734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4db1a640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf34067940 0x7fdf34069e00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf38005890 tx=0x7fdf38009040 comp rx=0 tx=0).stop 2024-09-19T05:33:30.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75d0067910 msgr2=0x7f75d0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75d0067910 0x7f75d0069dd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75dc006aa0 tx=0x7f75dc006a30 comp rx=0 tx=0).stop 2024-09-19T05:33:30.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec0cf070 msgr2=0x7f75ec151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 --2- 172.21.15.67:0/2357241923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec0cf070 0x7f75ec151390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75e80ad040 tx=0x7f75e801acb0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5234067990 msgr2=0x7f5234069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf40036030 msgr2=0x7fdf40102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f524c9c1640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5234067990 0x7f5234069e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f52380b2000 tx=0x7f5238004740 comp rx=0 tx=0).stop 2024-09-19T05:33:30.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4db1a640 1 --2- 172.21.15.67:0/2819954847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf40036030 0x7fdf40102f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c019040 tx=0x7fdf3c0191d0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4d319640 1 -- 172.21.15.67:0/2819954847 reap_dead start 2024-09-19T05:33:30.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f2417640 1 -- 172.21.15.67:0/2357241923 reap_dead start 2024-09-19T05:33:30.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 shutdown_connections 2024-09-19T05:33:30.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 shutdown_connections 2024-09-19T05:33:30.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 >> 172.21.15.67:0/2819954847 conn(0x7fdf4001d940 msgr2=0x7fdf40051030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f8233478640 1 -- 172.21.15.67:0/771724076 wait complete. 2024-09-19T05:33:30.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 shutdown_connections 2024-09-19T05:33:30.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52400e6540 msgr2=0x7f524004e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7fdf4db1a640 1 -- 172.21.15.67:0/2819954847 wait complete. 2024-09-19T05:33:30.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f524c9c1640 1 --2- 172.21.15.67:0/2000377369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52400e6540 0x7f524004e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5248051960 tx=0x7f52480697f0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 shutdown_connections 2024-09-19T05:33:30.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f524759e640 1 -- 172.21.15.67:0/2000377369 reap_dead start 2024-09-19T05:33:30.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 >> 172.21.15.67:0/2357241923 conn(0x7f75ec08bfc0 msgr2=0x7f75ec0b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 shutdown_connections 2024-09-19T05:33:30.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.914+0000 7f75f3e7a640 1 -- 172.21.15.67:0/2357241923 wait complete. 2024-09-19T05:33:30.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.922+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 --> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5c0006e0c0 con 0x7f5bec071040 2024-09-19T05:33:30.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.922+0000 7f5bfcff9640 1 -- 172.21.15.67:0/2726301886 <== osd.0 v2:172.21.15.67:6816/1029707859 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5c0006e0c0 con 0x7f5bec071040 2024-09-19T05:33:30.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.922+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x7f5bec071040 msgr2=0x7f5bec073480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.922+0000 7f5c062f1640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x7f5bec071040 0x7f5bec073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.922+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bec0678c0 msgr2=0x7f5bec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.922+0000 7f5c062f1640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bec0678c0 0x7f5bec069d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5c0015e420 tx=0x7f5bf0007040 comp rx=0 tx=0).stop 2024-09-19T05:33:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.922+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80051d0 msgr2=0x7f5c0015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.922+0000 7f5c062f1640 1 --2- 172.21.15.67:0/2726301886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80051d0 0x7f5c0015d6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800e7b0 tx=0x7f5bf800ec70 comp rx=0 tx=0).stop 2024-09-19T05:33:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.922+0000 7f5c0488e640 1 -- 172.21.15.67:0/2726301886 reap_dead start 2024-09-19T05:33:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.922+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 shutdown_connections 2024-09-19T05:33:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.926+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 >> 172.21.15.67:0/2726301886 conn(0x7f5c000b5710 msgr2=0x7f5c000b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.926+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 shutdown_connections 2024-09-19T05:33:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.926+0000 7f5c062f1640 1 -- 172.21.15.67:0/2726301886 wait complete. 2024-09-19T05:33:30.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.926+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 shutdown_connections 2024-09-19T05:33:30.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.926+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 >> 172.21.15.67:0/2000377369 conn(0x7f524003a500 msgr2=0x7f52400e2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.926+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 shutdown_connections 2024-09-19T05:33:30.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.926+0000 7f524c9c1640 1 -- 172.21.15.67:0/2000377369 wait complete. 2024-09-19T05:33:30.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.938+0000 7f77c8bbc640 1 -- 172.21.15.67:0/837390433 --> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77c406bcc0 con 0x7f77c413cf40 2024-09-19T05:33:30.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.938+0000 7f77abfff640 1 -- 172.21.15.67:0/837390433 <== osd.4 v2:172.21.15.97:6802/1358994016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f77c406bcc0 con 0x7f77c413cf40 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.938+0000 7f77a9ffb640 1 -- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] conn(0x7f77c413cf40 msgr2=0x7f77c4140db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.938+0000 7f77a9ffb640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] conn(0x7f77c413cf40 0x7f77c4140db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.938+0000 7f77a9ffb640 1 -- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77b0067910 msgr2=0x7f77b0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.938+0000 7f77a9ffb640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77b0067910 0x7f77b0069dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00a400 tx=0x7f77bc00d040 comp rx=0 tx=0).stop 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.938+0000 7f77a9ffb640 1 -- 172.21.15.67:0/837390433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77c40b5f90 msgr2=0x7f77c4142f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.938+0000 7f77a9ffb640 1 --2- 172.21.15.67:0/837390433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77c40b5f90 0x7f77c4142f80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f77b401aad0 tx=0x7f77b40191c0 comp rx=0 tx=0).stop 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.938+0000 7f77c3fff640 1 -- 172.21.15.67:0/837390433 reap_dead start 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.942+0000 7f77a9ffb640 1 -- 172.21.15.67:0/837390433 shutdown_connections 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.942+0000 7f77a9ffb640 1 -- 172.21.15.67:0/837390433 >> 172.21.15.67:0/837390433 conn(0x7f77c40b2eb0 msgr2=0x7f77c4162dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.942+0000 7f77a9ffb640 1 -- 172.21.15.67:0/837390433 shutdown_connections 2024-09-19T05:33:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:30.942+0000 7f77a9ffb640 1 -- 172.21.15.67:0/837390433 wait complete. 2024-09-19T05:33:30.982 INFO:teuthology.orchestra.run.smithi067.stdout:60129542153 2024-09-19T05:33:30.982 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T05:33:30.983 INFO:teuthology.orchestra.run.smithi067.stdout:60129542151 2024-09-19T05:33:30.984 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T05:33:30.984 INFO:teuthology.orchestra.run.smithi067.stdout:60129542152 2024-09-19T05:33:30.985 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T05:33:30.985 INFO:teuthology.orchestra.run.smithi067.stdout:60129542152 2024-09-19T05:33:30.986 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T05:33:30.986 INFO:teuthology.orchestra.run.smithi067.stdout:60129542154 2024-09-19T05:33:30.987 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T05:33:30.987 INFO:teuthology.orchestra.run.smithi067.stdout:60129542151 2024-09-19T05:33:30.988 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T05:33:30.988 INFO:teuthology.orchestra.run.smithi067.stdout:60129542151 2024-09-19T05:33:30.989 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T05:33:30.990 INFO:teuthology.orchestra.run.smithi067.stdout:60129542151 2024-09-19T05:33:30.990 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T05:33:31.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2971c88640 1 Processor -- start 2024-09-19T05:33:31.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2971c88640 1 -- start start 2024-09-19T05:33:31.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c85cde640 1 Processor -- start 2024-09-19T05:33:31.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c85cde640 1 -- start start 2024-09-19T05:33:31.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fc336605640 1 Processor -- start 2024-09-19T05:33:31.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fc336605640 1 -- start start 2024-09-19T05:33:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c85cde640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2c80158290 0x7f2c800b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c85cde640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 0x7f2c8006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2971c88640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c15a540 0x7f296c06f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2971c88640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f296c0b5520 0x7f296c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c85cde640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c800cf940 con 0x7f2c800cec10 2024-09-19T05:33:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c85cde640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2c8006e730 con 0x7f2c80158290 2024-09-19T05:33:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c7f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2c80158290 0x7f2c800b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c7effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 0x7f2c8006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2970c86640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c15a540 0x7f296c06f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2970c86640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c15a540 0x7f296c06f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:34702/0 (socket says 172.21.15.67:34702) 2024-09-19T05:33:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2970c86640 1 -- 172.21.15.67:0/3409062571 learned_addr learned my addr 172.21.15.67:0/3409062571 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f296bfff640 1 --2- 172.21.15.67:0/3409062571 >> v2:172.21.15.67:3300/0 conn(0x7f296c0b5520 0x7f296c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c7f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2c80158290 0x7f2c800b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46116/0 (socket says 172.21.15.67:46116) 2024-09-19T05:33:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c7f7fe640 1 -- 172.21.15.67:0/44136116 learned_addr learned my addr 172.21.15.67:0/44136116 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c85cde640 1 -- 172.21.15.67:0/44136116 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2c800cff00 con 0x7f2c8006dd90 2024-09-19T05:33:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2971c88640 1 -- 172.21.15.67:0/3409062571 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296c06f7e0 con 0x7f296c0cfa80 2024-09-19T05:33:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2971c88640 1 -- 172.21.15.67:0/3409062571 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f296c06fd70 con 0x7f296c0b5520 2024-09-19T05:33:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2971c88640 1 -- 172.21.15.67:0/3409062571 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f296c06fa90 con 0x7f296c15a540 2024-09-19T05:33:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddbb08b640 1 Processor -- start 2024-09-19T05:33:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddbb08b640 1 -- start start 2024-09-19T05:33:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddbb08b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fddb4099840 0x7fddb40acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddbb08b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fddb4073270 0x7fddb40b1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddbb08b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddb40aff80 con 0x7fddb40afaf0 2024-09-19T05:33:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddbb08b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fddb40b0b90 con 0x7fddb4073270 2024-09-19T05:33:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddbb08b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fddb40b0260 con 0x7fddb4099840 2024-09-19T05:33:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddb9628640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fddb4073270 0x7fddb40b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddb9628640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fddb4073270 0x7fddb40b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34560/0 (socket says 172.21.15.67:34560) 2024-09-19T05:33:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddb9628640 1 -- 172.21.15.67:0/65155722 learned_addr learned my addr 172.21.15.67:0/65155722 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddb8e27640 1 --2- 172.21.15.67:0/65155722 >> v2:172.21.15.97:3300/0 conn(0x7fddb4099840 0x7fddb40acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fc336605640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc33015e5e0 0x7fc3300cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddb37fe640 1 -- 172.21.15.67:0/65155722 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391695990 0 0) 0x7fddb40aff80 con 0x7fddb40afaf0 2024-09-19T05:33:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fc336605640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 0x7fc3300ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddb37fe640 1 -- 172.21.15.67:0/65155722 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda4003530 con 0x7fddb40afaf0 2024-09-19T05:33:31.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddb9628640 1 -- 172.21.15.67:0/65155722 >> v2:172.21.15.97:3300/0 conn(0x7fddb4099840 msgr2=0x7fddb40acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddb9628640 1 --2- 172.21.15.67:0/65155722 >> v2:172.21.15.97:3300/0 conn(0x7fddb4099840 0x7fddb40acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fc334e02640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc330073360 0x7fc3300b4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34536/0 (socket says 172.21.15.67:34536) 2024-09-19T05:33:31.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fc334e02640 1 -- 172.21.15.67:0/4215351111 learned_addr learned my addr 172.21.15.67:0/4215351111 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddb9628640 1 -- 172.21.15.67:0/65155722 >> v1:172.21.15.97:6789/0 conn(0x7fddb40afaf0 legacy=0x7fddb40b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7fddb9628640 1 -- 172.21.15.67:0/65155722 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb40b0540 con 0x7fddb4073270 2024-09-19T05:33:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2970c86640 1 -- 172.21.15.67:0/3409062571 >> v2:172.21.15.67:3300/0 conn(0x7f296c0b5520 msgr2=0x7f296c0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2970c86640 1 --2- 172.21.15.67:0/3409062571 >> v2:172.21.15.67:3300/0 conn(0x7f296c0b5520 0x7f296c0cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2970c86640 1 -- 172.21.15.67:0/3409062571 >> v1:172.21.15.97:6789/0 conn(0x7f296c0cfa80 legacy=0x7f296c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2970c86640 1 -- 172.21.15.67:0/3409062571 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296c071df0 con 0x7f296c15a540 2024-09-19T05:33:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc335e04640 1 --2- 172.21.15.67:0/4215351111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 0x7fc3300ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c7effd640 1 -- 172.21.15.67:0/44136116 >> v2:172.21.15.97:3300/0 conn(0x7f2c80158290 msgr2=0x7f2c800b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c7effd640 1 --2- 172.21.15.67:0/44136116 >> v2:172.21.15.97:3300/0 conn(0x7f2c80158290 0x7f2c800b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c7effd640 1 -- 172.21.15.67:0/44136116 >> v1:172.21.15.97:6789/0 conn(0x7f2c800cec10 legacy=0x7f2c800cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.202+0000 7f2c7effd640 1 -- 172.21.15.67:0/44136116 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c800cfc20 con 0x7f2c8006dd90 2024-09-19T05:33:31.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e12681640 1 Processor -- start 2024-09-19T05:33:31.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e12681640 1 -- start start 2024-09-19T05:33:31.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fb5f89fe640 1 Processor -- start 2024-09-19T05:33:31.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fb5f89fe640 1 -- start start 2024-09-19T05:33:31.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e12681640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c162570 0x7f4e0c071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e12681640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e0c06e7a0 0x7f4e0c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e12681640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4e0c0b5b60 0x7f4e0c0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e12681640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0c06ed20 con 0x7f4e0c06e7a0 2024-09-19T05:33:31.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e12681640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0c0b4320 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e12681640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0c0b4600 con 0x7f4e0c162570 2024-09-19T05:33:31.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fcd130d7640 1 Processor -- start 2024-09-19T05:33:31.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e10e7e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e0c06e7a0 0x7f4e0c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e10e7e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e0c06e7a0 0x7f4e0c0ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34586/0 (socket says 172.21.15.67:34586) 2024-09-19T05:33:31.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e10e7e640 1 -- 172.21.15.67:0/4058689538 learned_addr learned my addr 172.21.15.67:0/4058689538 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e1167f640 1 --2- 172.21.15.67:0/4058689538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c162570 0x7f4e0c071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc336605640 1 -- 172.21.15.67:0/4215351111 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33006eff0 con 0x7fc330073360 2024-09-19T05:33:31.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc336605640 1 -- 172.21.15.67:0/4215351111 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc33015e9c0 con 0x7fc33015e5e0 2024-09-19T05:33:31.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc336605640 1 -- 172.21.15.67:0/4215351111 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc33009af10 con 0x7fc3300b5190 2024-09-19T05:33:31.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc335603640 1 --2- 172.21.15.67:0/4215351111 >> v2:172.21.15.67:3300/0 conn(0x7fc33015e5e0 0x7fc3300cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f2c7effd640 1 --2- 172.21.15.67:0/44136116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 0x7f2c8006e1f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2c740097c0 tx=0x7f2c7401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f874e151a2f0fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fb5f89fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415a8b0 0x7fb5f40cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc327fff640 1 -- 172.21.15.67:0/4215351111 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301770866 0 0) 0x7fc33006eff0 con 0x7fc330073360 2024-09-19T05:33:31.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc327fff640 1 -- 172.21.15.67:0/4215351111 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc31c003530 con 0x7fc330073360 2024-09-19T05:33:31.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fb5f89fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5f415f040 0x7fb5f415e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fb5f89fe640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f40cdaa0 con 0x7fb5f415e950 2024-09-19T05:33:31.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fb5f89fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f4071070 con 0x7fb5f415f040 2024-09-19T05:33:31.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fb5f89fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f415eda0 con 0x7fb5f415a8b0 2024-09-19T05:33:31.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4a43fff640 1 Processor -- start 2024-09-19T05:33:31.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fcd130d7640 1 -- start start 2024-09-19T05:33:31.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4a43fff640 1 -- start start 2024-09-19T05:33:31.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f2970c86640 1 --2- 172.21.15.67:0/3409062571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c15a540 0x7f296c06f2a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f29600083f0 tx=0x7f296001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b7ece8e5660e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fb5f1d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5f415f040 0x7fb5f415e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fb5f1d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5f415f040 0x7fb5f415e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46150/0 (socket says 172.21.15.67:46150) 2024-09-19T05:33:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e11e80640 1 --2- 172.21.15.67:0/4058689538 >> v2:172.21.15.97:3300/0 conn(0x7f4e0c0b5b60 0x7f4e0c0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e10e7e640 1 -- 172.21.15.67:0/4058689538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c162570 msgr2=0x7f4e0c071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e10e7e640 1 --2- 172.21.15.67:0/4058689538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c162570 0x7f4e0c071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e10e7e640 1 -- 172.21.15.67:0/4058689538 >> v2:172.21.15.97:3300/0 conn(0x7f4e0c0b5b60 msgr2=0x7f4e0c0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e10e7e640 1 --2- 172.21.15.67:0/4058689538 >> v2:172.21.15.97:3300/0 conn(0x7f4e0c0b5b60 0x7f4e0c0ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f4e10e7e640 1 -- 172.21.15.67:0/4058689538 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c0b48e0 con 0x7f4e0c06e7a0 2024-09-19T05:33:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fb5f1d9b640 1 -- 172.21.15.67:0/1204166270 learned_addr learned my addr 172.21.15.67:0/1204166270 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc335e04640 1 -- 172.21.15.67:0/4215351111 >> v2:172.21.15.67:3300/0 conn(0x7fc33015e5e0 msgr2=0x7fc3300cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f296b7fe640 1 -- 172.21.15.67:0/3409062571 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29600b0070 con 0x7f296c15a540 2024-09-19T05:33:31.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fddb9628640 1 --2- 172.21.15.67:0/65155722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddb4073270 0x7fddb40b1730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fddb40b0d10 tx=0x7fddac01f560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce49b1a5576d83b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f2c7e7fc640 1 -- 172.21.15.67:0/44136116 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c740b1070 con 0x7f2c8006dd90 2024-09-19T05:33:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f2c7e7fc640 1 -- 172.21.15.67:0/44136116 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c740ac640 con 0x7f2c8006dd90 2024-09-19T05:33:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f2c7e7fc640 1 -- 172.21.15.67:0/44136116 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c740aca10 con 0x7f2c8006dd90 2024-09-19T05:33:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2c85cde640 1 -- 172.21.15.67:0/44136116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 msgr2=0x7f2c8006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2c85cde640 1 --2- 172.21.15.67:0/44136116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 0x7f2c8006e1f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2c740097c0 tx=0x7f2c7401c4e0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f296b7fe640 1 -- 172.21.15.67:0/3409062571 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29600089e0 con 0x7f296c15a540 2024-09-19T05:33:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7f296b7fe640 1 -- 172.21.15.67:0/3409062571 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960008db0 con 0x7f296c15a540 2024-09-19T05:33:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a43fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a3c009cc0 0x7f4a3c04f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a43fff640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c050300 con 0x7f4a3c04f670 2024-09-19T05:33:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a43fff640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c0509f0 con 0x7f4a3c0dd420 2024-09-19T05:33:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a43fff640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4a3c0061d0 con 0x7f4a3c009cc0 2024-09-19T05:33:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2971c88640 1 -- 172.21.15.67:0/3409062571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c15a540 msgr2=0x7f296c06f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2971c88640 1 --2- 172.21.15.67:0/3409062571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c15a540 0x7f296c06f2a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f29600083f0 tx=0x7f296001c450 comp rx=0 tx=0).stop 2024-09-19T05:33:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a437fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4a3c04f670 0x7f4a3c0e32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34576/0 (socket says 172.21.15.67:34576) 2024-09-19T05:33:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a437fe640 1 -- 172.21.15.67:0/1026146806 learned_addr learned my addr 172.21.15.67:0/1026146806 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fb5f259c640 1 --2- 172.21.15.67:0/1204166270 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415a8b0 0x7fb5f40cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fb5f1d9b640 1 -- 172.21.15.67:0/1204166270 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415a8b0 msgr2=0x7fb5f40cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fb5f1d9b640 1 --2- 172.21.15.67:0/1204166270 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415a8b0 0x7fb5f40cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fb5f1d9b640 1 -- 172.21.15.67:0/1204166270 >> v1:172.21.15.67:6789/0 conn(0x7fb5f415e950 legacy=0x7fb5f406e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fb5f1d9b640 1 -- 172.21.15.67:0/1204166270 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f415ac90 con 0x7fb5f415f040 2024-09-19T05:33:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a427fc640 1 --2- 172.21.15.67:0/1026146806 >> v2:172.21.15.67:3300/0 conn(0x7f4a3c009cc0 0x7f4a3c04f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2971c88640 1 -- 172.21.15.67:0/3409062571 shutdown_connections 2024-09-19T05:33:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2971c88640 1 --2- 172.21.15.67:0/3409062571 >> v2:172.21.15.67:3300/0 conn(0x7f296c0b5520 0x7f296c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2971c88640 1 --2- 172.21.15.67:0/3409062571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c15a540 0x7f296c06f2a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2971c88640 1 -- 172.21.15.67:0/3409062571 >> 172.21.15.67:0/3409062571 conn(0x7f296c0ccc60 msgr2=0x7f296c0cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2971c88640 1 -- 172.21.15.67:0/3409062571 shutdown_connections 2024-09-19T05:33:31.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc335e04640 1 --2- 172.21.15.67:0/4215351111 >> v2:172.21.15.67:3300/0 conn(0x7fc33015e5e0 0x7fc3300cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc335e04640 1 -- 172.21.15.67:0/4215351111 >> v1:172.21.15.67:6789/0 conn(0x7fc330073360 legacy=0x7fc3300b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fc335e04640 1 -- 172.21.15.67:0/4215351111 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33006f2d0 con 0x7fc3300b5190 2024-09-19T05:33:31.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc335603640 1 --2- 172.21.15.67:0/4215351111 >> v2:172.21.15.67:3300/0 conn(0x7fc33015e5e0 0x7fc3300cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:33:31.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a41ffb640 1 -- 172.21.15.67:0/1026146806 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584820769 0 0) 0x7f4a3c0509f0 con 0x7f4a3c0dd420 2024-09-19T05:33:31.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a41ffb640 1 -- 172.21.15.67:0/1026146806 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a2c005740 con 0x7f4a3c0dd420 2024-09-19T05:33:31.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2c85cde640 1 -- 172.21.15.67:0/44136116 shutdown_connections 2024-09-19T05:33:31.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2c85cde640 1 --2- 172.21.15.67:0/44136116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 0x7f2c8006e1f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2c85cde640 1 --2- 172.21.15.67:0/44136116 >> v2:172.21.15.97:3300/0 conn(0x7f2c80158290 0x7f2c800b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2c85cde640 1 -- 172.21.15.67:0/44136116 >> 172.21.15.67:0/44136116 conn(0x7f2c80067bd0 msgr2=0x7f2c8006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e10e7e640 1 --2- 172.21.15.67:0/4058689538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c06e7a0 0x7f4e0c0ce060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0b3d90 tx=0x7f4dfc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcc59be5aff2d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e03fff640 1 -- 172.21.15.67:0/4058689538 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0b1070 con 0x7f4e0c06e7a0 2024-09-19T05:33:31.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e03fff640 1 -- 172.21.15.67:0/4058689538 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dfc0a8050 con 0x7f4e0c06e7a0 2024-09-19T05:33:31.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e03fff640 1 -- 172.21.15.67:0/4058689538 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0ac860 con 0x7f4e0c06e7a0 2024-09-19T05:33:31.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fcd130d7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcd0c06c250 0x7fcd0c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fcd130d7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd0c162e60 0x7fcd0c0b3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fcd130d7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd0c1660d0 con 0x7fcd0c162a40 2024-09-19T05:33:31.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fcd130d7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0c166f70 con 0x7fcd0c06c250 2024-09-19T05:33:31.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.206+0000 7fcd130d7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcd0c1663d0 con 0x7fcd0c162e60 2024-09-19T05:33:31.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fcd128d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd0c162e60 0x7fcd0c0b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fcd118d4640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcd0c162a40 0x7fcd0c166860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34568/0 (socket says 172.21.15.67:34568) 2024-09-19T05:33:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fcd118d4640 1 -- 172.21.15.67:0/767792266 learned_addr learned my addr 172.21.15.67:0/767792266 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fcd120d5640 1 --2- 172.21.15.67:0/767792266 >> v2:172.21.15.67:3300/0 conn(0x7fcd0c06c250 0x7fcd0c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2c85cde640 1 -- 172.21.15.67:0/44136116 shutdown_connections 2024-09-19T05:33:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2c85cde640 1 -- 172.21.15.67:0/44136116 wait complete. 2024-09-19T05:33:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fcd120d5640 1 -- 172.21.15.67:0/767792266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd0c162e60 msgr2=0x7fcd0c0b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fcd120d5640 1 --2- 172.21.15.67:0/767792266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd0c162e60 0x7fcd0c0b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc335e04640 1 --2- 172.21.15.67:0/4215351111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 0x7fc3300ae3c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc328009d90 tx=0x7fc32801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54d48670c63c0d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fcd120d5640 1 -- 172.21.15.67:0/767792266 >> v1:172.21.15.67:6789/0 conn(0x7fcd0c162a40 legacy=0x7fcd0c166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2971c88640 1 -- 172.21.15.67:0/3409062571 wait complete. 2024-09-19T05:33:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2971c88640 1 Processor -- start 2024-09-19T05:33:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fcd120d5640 1 -- 172.21.15.67:0/767792266 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c1632e0 con 0x7fcd0c06c250 2024-09-19T05:33:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc327fff640 1 -- 172.21.15.67:0/4215351111 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3280b2070 con 0x7fc3300b5190 2024-09-19T05:33:31.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e12681640 1 -- 172.21.15.67:0/4058689538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c06e7a0 msgr2=0x7f4e0c0ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e12681640 1 --2- 172.21.15.67:0/4058689538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c06e7a0 0x7f4e0c0ce060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0b3d90 tx=0x7f4dfc01c400 comp rx=0 tx=0).stop 2024-09-19T05:33:31.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc327fff640 1 -- 172.21.15.67:0/4215351111 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3280a58b0 con 0x7fc3300b5190 2024-09-19T05:33:31.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc327fff640 1 -- 172.21.15.67:0/4215351111 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3280a5c60 con 0x7fc3300b5190 2024-09-19T05:33:31.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f2971c88640 1 -- start start 2024-09-19T05:33:31.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a427fc640 1 -- 172.21.15.67:0/1026146806 >> v1:172.21.15.97:6789/0 conn(0x7f4a3c0dd420 legacy=0x7f4a3c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a427fc640 1 -- 172.21.15.67:0/1026146806 >> v1:172.21.15.67:6789/0 conn(0x7f4a3c04f670 legacy=0x7f4a3c0e32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4a427fc640 1 -- 172.21.15.67:0/1026146806 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c050cd0 con 0x7f4a3c009cc0 2024-09-19T05:33:31.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e12681640 1 -- 172.21.15.67:0/4058689538 shutdown_connections 2024-09-19T05:33:31.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e12681640 1 --2- 172.21.15.67:0/4058689538 >> v2:172.21.15.97:3300/0 conn(0x7f4e0c0b5b60 0x7f4e0c0ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e12681640 1 --2- 172.21.15.67:0/4058689538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c06e7a0 0x7f4e0c0ce060 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e12681640 1 --2- 172.21.15.67:0/4058689538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c162570 0x7f4e0c071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e12681640 1 -- 172.21.15.67:0/4058689538 >> 172.21.15.67:0/4058689538 conn(0x7f4e0c0b1f10 msgr2=0x7f4e0c0b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fddb37fe640 1 -- 172.21.15.67:0/65155722 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac0b5070 con 0x7fddb4073270 2024-09-19T05:33:31.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fddb37fe640 1 -- 172.21.15.67:0/65155722 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddac0b0630 con 0x7fddb4073270 2024-09-19T05:33:31.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fddb37fe640 1 -- 172.21.15.67:0/65155722 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac0ac050 con 0x7fddb4073270 2024-09-19T05:33:31.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e12681640 1 -- 172.21.15.67:0/4058689538 shutdown_connections 2024-09-19T05:33:31.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc336605640 1 -- 172.21.15.67:0/4215351111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 msgr2=0x7fc3300ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc336605640 1 --2- 172.21.15.67:0/4215351111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 0x7fc3300ae3c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc328009d90 tx=0x7fc32801c920 comp rx=0 tx=0).stop 2024-09-19T05:33:31.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc336605640 1 -- 172.21.15.67:0/4215351111 shutdown_connections 2024-09-19T05:33:31.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc336605640 1 --2- 172.21.15.67:0/4215351111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 0x7fc3300ae3c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc336605640 1 --2- 172.21.15.67:0/4215351111 >> v2:172.21.15.67:3300/0 conn(0x7fc33015e5e0 0x7fc3300cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7fc336605640 1 -- 172.21.15.67:0/4215351111 >> 172.21.15.67:0/4215351111 conn(0x7fc3300b6790 msgr2=0x7fc3300b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2971c88640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c0b5520 0x7f296c144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2971c88640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f296c0cfa80 0x7f296c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f1d9b640 1 --2- 172.21.15.67:0/1204166270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5f415f040 0x7fb5f415e410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400bba0 tx=0x7fb5e4020c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31d6d7e458950bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc336605640 1 -- 172.21.15.67:0/4215351111 shutdown_connections 2024-09-19T05:33:31.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c85cde640 1 Processor -- start 2024-09-19T05:33:31.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc336605640 1 -- 172.21.15.67:0/4215351111 wait complete. 2024-09-19T05:33:31.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.210+0000 7f4e12681640 1 -- 172.21.15.67:0/4058689538 wait complete. 2024-09-19T05:33:31.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c85cde640 1 -- start start 2024-09-19T05:33:31.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f296bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f296c0cfa80 0x7f296c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f296bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f296c0cfa80 0x7f296c15b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34620/0 (socket says 172.21.15.67:34620) 2024-09-19T05:33:31.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f159a640 1 -- 172.21.15.67:0/1204166270 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40af070 con 0x7fb5f415f040 2024-09-19T05:33:31.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fddbb08b640 1 -- 172.21.15.67:0/65155722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddb4073270 msgr2=0x7fddb40b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fddbb08b640 1 --2- 172.21.15.67:0/65155722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddb4073270 0x7fddb40b1730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fddb40b0d10 tx=0x7fddac01f560 comp rx=0 tx=0).stop 2024-09-19T05:33:31.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f159a640 1 -- 172.21.15.67:0/1204166270 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e4004230 con 0x7fb5f415f040 2024-09-19T05:33:31.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f159a640 1 -- 172.21.15.67:0/1204166270 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40a9850 con 0x7fb5f415f040 2024-09-19T05:33:31.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2970c86640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c0b5520 0x7f296c144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2970c86640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c0b5520 0x7f296c144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:34772/0 (socket says 172.21.15.67:34772) 2024-09-19T05:33:31.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2971c88640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f296c15a540 0x7f296c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2971c88640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f296c167300 con 0x7f296c0cfa80 2024-09-19T05:33:31.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2971c88640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f296c167180 con 0x7f296c15a540 2024-09-19T05:33:31.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2971c88640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f296c167480 con 0x7f296c0b5520 2024-09-19T05:33:31.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4a427fc640 1 --2- 172.21.15.67:0/1026146806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c009cc0 0x7f4a3c04f130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a340097c0 tx=0x7f4a3401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6d2694924ed8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2970c86640 1 -- 172.21.15.67:0/20193873 learned_addr learned my addr 172.21.15.67:0/20193873 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2971487640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f296c15a540 0x7f296c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fddbb08b640 1 -- 172.21.15.67:0/65155722 shutdown_connections 2024-09-19T05:33:31.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fddbb08b640 1 --2- 172.21.15.67:0/65155722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddb4073270 0x7fddb40b1730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fddbb08b640 1 --2- 172.21.15.67:0/65155722 >> v2:172.21.15.97:3300/0 conn(0x7fddb4099840 0x7fddb40acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fddbb08b640 1 -- 172.21.15.67:0/65155722 >> 172.21.15.67:0/65155722 conn(0x7fddb40b5710 msgr2=0x7fddb40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e12681640 1 Processor -- start 2024-09-19T05:33:31.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4a41ffb640 1 -- 172.21.15.67:0/1026146806 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b0070 con 0x7f4a3c009cc0 2024-09-19T05:33:31.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4a41ffb640 1 -- 172.21.15.67:0/1026146806 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a340ab600 con 0x7f4a3c009cc0 2024-09-19T05:33:31.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4a41ffb640 1 -- 172.21.15.67:0/1026146806 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340ab9d0 con 0x7f4a3c009cc0 2024-09-19T05:33:31.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f296bfff640 1 -- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c0b5520 msgr2=0x7f296c144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f296bfff640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c0b5520 0x7f296c144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f296bfff640 1 -- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f296c15a540 msgr2=0x7f296c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f296bfff640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f296c15a540 0x7f296c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f296bfff640 1 -- 172.21.15.67:0/20193873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296c0afe80 con 0x7f296c0cfa80 2024-09-19T05:33:31.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f89fe640 1 -- 172.21.15.67:0/1204166270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5f415f040 msgr2=0x7fb5f415e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f89fe640 1 --2- 172.21.15.67:0/1204166270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5f415f040 0x7fb5f415e410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400bba0 tx=0x7fb5e4020c00 comp rx=0 tx=0).stop 2024-09-19T05:33:31.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c85cde640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 0x7f2c8014ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c85cde640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c800cec10 0x7f2c80159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c85cde640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c80158290 0x7f2c8015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c85cde640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2c80072990 con 0x7f2c800cec10 2024-09-19T05:33:31.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c85cde640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2c800b41a0 con 0x7f2c80158290 2024-09-19T05:33:31.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c85cde640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2c80072b10 con 0x7f2c8006dd90 2024-09-19T05:33:31.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f89fe640 1 -- 172.21.15.67:0/1204166270 shutdown_connections 2024-09-19T05:33:31.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f89fe640 1 --2- 172.21.15.67:0/1204166270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5f415f040 0x7fb5f415e410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f89fe640 1 --2- 172.21.15.67:0/1204166270 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415a8b0 0x7fb5f40cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc336605640 1 Processor -- start 2024-09-19T05:33:31.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f89fe640 1 -- 172.21.15.67:0/1204166270 >> 172.21.15.67:0/1204166270 conn(0x7fb5f4073500 msgr2=0x7fb5f406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc336605640 1 -- start start 2024-09-19T05:33:31.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c7effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c800cec10 0x7f2c80159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c7effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c800cec10 0x7f2c80159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34622/0 (socket says 172.21.15.67:34622) 2024-09-19T05:33:31.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c7effd640 1 -- 172.21.15.67:0/3472449775 learned_addr learned my addr 172.21.15.67:0/3472449775 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f296bfff640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f296c0cfa80 0x7f296c15b330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f295800d960 tx=0x7f295800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c7f7fe640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 0x7f2c8014ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4a43fff640 1 -- 172.21.15.67:0/1026146806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c009cc0 msgr2=0x7f4a3c04f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4a43fff640 1 --2- 172.21.15.67:0/1026146806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c009cc0 0x7f4a3c04f130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a340097c0 tx=0x7f4a3401c410 comp rx=0 tx=0).stop 2024-09-19T05:33:31.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fddbb08b640 1 -- 172.21.15.67:0/65155722 shutdown_connections 2024-09-19T05:33:31.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f29697fa640 1 -- 172.21.15.67:0/20193873 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958015020 con 0x7f296c0cfa80 2024-09-19T05:33:31.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f29697fa640 1 -- 172.21.15.67:0/20193873 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2958004440 con 0x7f296c0cfa80 2024-09-19T05:33:31.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f29697fa640 1 -- 172.21.15.67:0/20193873 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29580078a0 con 0x7f296c0cfa80 2024-09-19T05:33:31.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2971c88640 1 -- 172.21.15.67:0/20193873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f296c15b870 con 0x7f296c0cfa80 2024-09-19T05:33:31.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2971c88640 1 -- 172.21.15.67:0/20193873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f296c156c50 con 0x7f296c0cfa80 2024-09-19T05:33:31.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c7ffff640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c80158290 0x7f2c8015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc336605640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc330073360 0x7fc3300ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc336605640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 0x7fc3300cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc336605640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc33015e5e0 0x7fc330146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc336605640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc330070a20 con 0x7fc33015e5e0 2024-09-19T05:33:31.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc336605640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc3300708a0 con 0x7fc330073360 2024-09-19T05:33:31.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc336605640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc330070ba0 con 0x7fc3300b5190 2024-09-19T05:33:31.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f89fe640 1 -- 172.21.15.67:0/1204166270 shutdown_connections 2024-09-19T05:33:31.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fb5f89fe640 1 -- 172.21.15.67:0/1204166270 wait complete. 2024-09-19T05:33:31.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c7f7fe640 1 -- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c80158290 msgr2=0x7f2c8015d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c7f7fe640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c80158290 0x7f2c8015d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c7f7fe640 1 -- 172.21.15.67:0/3472449775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c800cec10 msgr2=0x7f2c80159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c7f7fe640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c800cec10 0x7f2c80159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2c7f7fe640 1 -- 172.21.15.67:0/3472449775 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8015c910 con 0x7f2c8006dd90 2024-09-19T05:33:31.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e12681640 1 -- start start 2024-09-19T05:33:31.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e12681640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c06e7a0 0x7f4e0c14cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e12681640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c0b5b60 0x7f4e0c168290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e12681640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e0c162570 0x7f4e0c16bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e12681640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c0b5790 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e12681640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c0b5610 con 0x7f4e0c162570 2024-09-19T05:33:31.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e12681640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0c0b5910 con 0x7f4e0c06e7a0 2024-09-19T05:33:31.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fcd120d5640 1 --2- 172.21.15.67:0/767792266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 0x7fcd0c06c630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0097c0 tx=0x7fccfc02d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a638f70535958e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e1167f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c06e7a0 0x7f4e0c14cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fddbb08b640 1 -- 172.21.15.67:0/65155722 wait complete. 2024-09-19T05:33:31.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fddbb08b640 1 Processor -- start 2024-09-19T05:33:31.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc334e02640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 0x7fc3300cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc335603640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc330073360 0x7fc3300ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f2971c88640 1 -- 172.21.15.67:0/20193873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f296c0cd250 con 0x7f296c0cfa80 2024-09-19T05:33:31.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e1167f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c06e7a0 0x7f4e0c14cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:34788/0 (socket says 172.21.15.67:34788) 2024-09-19T05:33:31.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e1167f640 1 -- 172.21.15.67:0/1682090854 learned_addr learned my addr 172.21.15.67:0/1682090854 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc335603640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc330073360 0x7fc3300ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46174/0 (socket says 172.21.15.67:46174) 2024-09-19T05:33:31.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fc335603640 1 -- 172.21.15.67:0/3870014464 learned_addr learned my addr 172.21.15.67:0/3870014464 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7f4e11e80640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e0c162570 0x7f4e0c16bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 -- 172.21.15.67:0/1026146806 shutdown_connections 2024-09-19T05:33:31.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 --2- 172.21.15.67:0/1026146806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c009cc0 0x7f4a3c04f130 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 -- 172.21.15.67:0/1026146806 >> 172.21.15.67:0/1026146806 conn(0x7f4a3c0360a0 msgr2=0x7f4a3c036480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f89fe640 1 Processor -- start 2024-09-19T05:33:31.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fc335e04640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc33015e5e0 0x7fc330146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 -- 172.21.15.67:0/1026146806 shutdown_connections 2024-09-19T05:33:31.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 -- 172.21.15.67:0/1026146806 wait complete. 2024-09-19T05:33:31.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f89fe640 1 -- start start 2024-09-19T05:33:31.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.214+0000 7fddbb08b640 1 -- start start 2024-09-19T05:33:31.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f2c7f7fe640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 0x7f2c8014ba80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2c780074e0 tx=0x7f2c780079a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4e10e7e640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c0b5b60 0x7f4e0c168290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fc335e04640 1 -- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 msgr2=0x7fc3300cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fc335e04640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 0x7fc3300cfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fc335e04640 1 -- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc330073360 msgr2=0x7fc3300ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fc335e04640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc330073360 0x7fc3300ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fc335e04640 1 -- 172.21.15.67:0/3870014464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc330147080 con 0x7fc33015e5e0 2024-09-19T05:33:31.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4e10e7e640 1 -- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c06e7a0 msgr2=0x7f4e0c14cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4e10e7e640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c06e7a0 0x7f4e0c14cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4e10e7e640 1 -- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e0c162570 msgr2=0x7f4e0c16bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4e10e7e640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e0c162570 0x7f4e0c16bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4e10e7e640 1 -- 172.21.15.67:0/1682090854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c16c670 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f89fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5f415a8b0 0x7fb5f4153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f89fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5f415e950 0x7fb5f4163170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddbb08b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fddb4073270 0x7fddb4095e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddbb08b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddb4099840 0x7fddb409d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f89fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415f040 0x7fb5f4161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f2c67fff640 1 -- 172.21.15.67:0/3472449775 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800d110 con 0x7f2c8006dd90 2024-09-19T05:33:31.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f2c67fff640 1 -- 172.21.15.67:0/3472449775 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7800d2b0 con 0x7f2c8006dd90 2024-09-19T05:33:31.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f2c67fff640 1 -- 172.21.15.67:0/3472449775 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800d6a0 con 0x7f2c8006dd90 2024-09-19T05:33:31.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddbb08b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddb406f090 0x7fddb406f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddbb08b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fddb4099c20 con 0x7fddb406f090 2024-09-19T05:33:31.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddbb08b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fddb40ad4f0 con 0x7fddb4099840 2024-09-19T05:33:31.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddbb08b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fddb4099da0 con 0x7fddb4073270 2024-09-19T05:33:31.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f2c85cde640 1 -- 172.21.15.67:0/3472449775 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8015cbf0 con 0x7f2c8006dd90 2024-09-19T05:33:31.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f2c85cde640 1 -- 172.21.15.67:0/3472449775 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8015d1b0 con 0x7f2c8006dd90 2024-09-19T05:33:31.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fcd110d3640 1 -- 172.21.15.67:0/767792266 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0c2070 con 0x7fcd0c06c250 2024-09-19T05:33:31.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f89fe640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f40d0680 con 0x7fb5f415a8b0 2024-09-19T05:33:31.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f89fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f4070a40 con 0x7fb5f415e950 2024-09-19T05:33:31.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f89fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f40d0800 con 0x7fb5f415f040 2024-09-19T05:33:31.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fc335e04640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc33015e5e0 0x7fc330146b40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc3280ac000 tx=0x7fc3280196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f1d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5f415e950 0x7fb5f4163170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f1d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5f415e950 0x7fb5f4163170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46196/0 (socket says 172.21.15.67:46196) 2024-09-19T05:33:31.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f1d9b640 1 -- 172.21.15.67:0/4002239833 learned_addr learned my addr 172.21.15.67:0/4002239833 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fcd110d3640 1 -- 172.21.15.67:0/767792266 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccfc0b9050 con 0x7fcd0c06c250 2024-09-19T05:33:31.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fcd110d3640 1 -- 172.21.15.67:0/767792266 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0bd860 con 0x7fcd0c06c250 2024-09-19T05:33:31.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f2d9d640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415f040 0x7fb5f4161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4e10e7e640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c0b5b60 0x7f4e0c168290 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0ac000 tx=0x7f4dfc0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb8e27640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fddb4073270 0x7fddb4095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb8e27640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fddb4073270 0x7fddb4095e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:34808/0 (socket says 172.21.15.67:34808) 2024-09-19T05:33:31.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb8e27640 1 -- 172.21.15.67:0/1580946334 learned_addr learned my addr 172.21.15.67:0/1580946334 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb9628640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddb406f090 0x7fddb406f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 Processor -- start 2024-09-19T05:33:31.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb3fff640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddb4099840 0x7fddb409d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 -- start start 2024-09-19T05:33:31.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb9628640 1 -- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fddb4073270 msgr2=0x7fddb4095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb9628640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fddb4073270 0x7fddb4095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb9628640 1 -- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddb4099840 msgr2=0x7fddb409d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb9628640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddb4099840 0x7fddb409d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb9628640 1 -- 172.21.15.67:0/1580946334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb42162c0 con 0x7fddb406f090 2024-09-19T05:33:31.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f2d9d640 1 -- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5f415e950 msgr2=0x7fb5f4163170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f2d9d640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5f415e950 0x7fb5f4163170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f2d9d640 1 -- 172.21.15.67:0/4002239833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5f415a8b0 msgr2=0x7fb5f4153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f2d9d640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5f415a8b0 0x7fb5f4153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f2d9d640 1 -- 172.21.15.67:0/4002239833 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f4154370 con 0x7fb5f415f040 2024-09-19T05:33:31.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fddb9628640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddb406f090 0x7fddb406f520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fddac0af000 tx=0x7fddac008800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f2d9d640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415f040 0x7fb5f4161600 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c730 tx=0x7fb5ec00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f2c85cde640 1 -- 172.21.15.67:0/3472449775 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8006e1f0 con 0x7f2c8006dd90 2024-09-19T05:33:31.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a3c009cc0 0x7f4a3c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c04f670 0x7f4a3c0d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a3c0dd420 0x7f4a3c0d52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5e2ffd640 1 -- 172.21.15.67:0/4002239833 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec016020 con 0x7fb5f415f040 2024-09-19T05:33:31.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c01d190 con 0x7f4a3c04f670 2024-09-19T05:33:31.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a427fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c04f670 0x7f4a3c0d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a427fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c04f670 0x7f4a3c0d4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34662/0 (socket says 172.21.15.67:34662) 2024-09-19T05:33:31.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a427fc640 1 -- 172.21.15.67:0/930724401 learned_addr learned my addr 172.21.15.67:0/930724401 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c01d010 con 0x7f4a3c0dd420 2024-09-19T05:33:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a42ffd640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a3c009cc0 0x7f4a3c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3c01d310 con 0x7f4a3c009cc0 2024-09-19T05:33:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f4a437fe640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a3c0dd420 0x7f4a3c0d52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f29697fa640 1 -- 172.21.15.67:0/20193873 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2958018020 con 0x7f296c0cfa80 2024-09-19T05:33:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f29697fa640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2950067990 0x7f2950069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7f29697fa640 1 -- 172.21.15.67:0/20193873 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2958086700 con 0x7f296c0cfa80 2024-09-19T05:33:31.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f4a427fc640 1 -- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a3c009cc0 msgr2=0x7f4a3c037af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f4a427fc640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a3c009cc0 0x7f4a3c037af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f4a427fc640 1 -- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a3c0dd420 msgr2=0x7f4a3c0d52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f4a427fc640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a3c0dd420 0x7f4a3c0d52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f4a427fc640 1 -- 172.21.15.67:0/930724401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c037630 con 0x7f4a3c04f670 2024-09-19T05:33:31.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f2970c86640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2950067990 0x7f2950069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f4a427fc640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c04f670 0x7f4a3c0d4d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4a3401a040 tx=0x7f4a340191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f89fe640 1 -- 172.21.15.67:0/4002239833 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f41fea50 con 0x7fb5f415f040 2024-09-19T05:33:31.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.218+0000 7fb5f89fe640 1 -- 172.21.15.67:0/4002239833 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f41ff010 con 0x7fb5f415f040 2024-09-19T05:33:31.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fb5e2ffd640 1 -- 172.21.15.67:0/4002239833 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ec006d60 con 0x7fb5f415f040 2024-09-19T05:33:31.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 -- 172.21.15.67:0/767792266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 msgr2=0x7fcd0c06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 --2- 172.21.15.67:0/767792266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 0x7fcd0c06c630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0097c0 tx=0x7fccfc02d4d0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 -- 172.21.15.67:0/767792266 shutdown_connections 2024-09-19T05:33:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 --2- 172.21.15.67:0/767792266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd0c162e60 0x7fcd0c0b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 --2- 172.21.15.67:0/767792266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 0x7fcd0c06c630 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 -- 172.21.15.67:0/767792266 >> 172.21.15.67:0/767792266 conn(0x7fcd0c0b6660 msgr2=0x7fcd0c0b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fb5f89fe640 1 -- 172.21.15.67:0/4002239833 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f40cd560 con 0x7fb5f415f040 2024-09-19T05:33:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 -- 172.21.15.67:0/767792266 shutdown_connections 2024-09-19T05:33:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 -- 172.21.15.67:0/767792266 wait complete. 2024-09-19T05:33:31.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fb5e2ffd640 1 -- 172.21.15.67:0/4002239833 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec003bc0 con 0x7fb5f415f040 2024-09-19T05:33:31.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f2970c86640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2950067990 0x7f2950069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f296001ab00 tx=0x7f2960008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f2c67fff640 1 -- 172.21.15.67:0/3472449775 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c7800b800 con 0x7f2c8006dd90 2024-09-19T05:33:31.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f2c67fff640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c6c067910 0x7f2c6c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f2c67fff640 1 -- 172.21.15.67:0/3472449775 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2c78086bf0 con 0x7f2c8006dd90 2024-09-19T05:33:31.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f2c7effd640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c6c067910 0x7f2c6c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fc325ffb640 1 -- 172.21.15.67:0/3870014464 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3280b2050 con 0x7fc33015e5e0 2024-09-19T05:33:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fc336605640 1 -- 172.21.15.67:0/3870014464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3300cedb0 con 0x7fc33015e5e0 2024-09-19T05:33:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 Processor -- start 2024-09-19T05:33:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 -- start start 2024-09-19T05:33:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fb5e2ffd640 1 -- 172.21.15.67:0/4002239833 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5ec00a640 con 0x7fb5f415f040 2024-09-19T05:33:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fb5e2ffd640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5d40678f0 0x7fb5d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fb5e2ffd640 1 -- 172.21.15.67:0/4002239833 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb5ec086860 con 0x7fb5f415f040 2024-09-19T05:33:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fc336605640 1 -- 172.21.15.67:0/3870014464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3300cf370 con 0x7fc33015e5e0 2024-09-19T05:33:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f2c7effd640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c6c067910 0x7f2c6c069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c740097c0 tx=0x7f2c74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f4a2b7fe640 1 -- 172.21.15.67:0/930724401 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b9020 con 0x7f4a3c04f670 2024-09-19T05:33:31.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f29697fa640 1 -- 172.21.15.67:0/20193873 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f295801f020 con 0x7f296c0cfa80 2024-09-19T05:33:31.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 0x7fcd0c149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd0c162a40 0x7fcd0c0cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fb5f259c640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5d40678f0 0x7fb5d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3c0dcd50 con 0x7f4a3c04f670 2024-09-19T05:33:31.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3c0cebf0 con 0x7f4a3c04f670 2024-09-19T05:33:31.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd0c162e60 0x7fcd0c155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c12af20 con 0x7fcd0c06c250 2024-09-19T05:33:31.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c0b5710 con 0x7fcd0c162a40 2024-09-19T05:33:31.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.222+0000 7fcd130d7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcd0c12b0a0 con 0x7fcd0c162e60 2024-09-19T05:33:31.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd120d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 0x7fcd0c149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd120d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 0x7fcd0c149940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34672/0 (socket says 172.21.15.67:34672) 2024-09-19T05:33:31.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd120d5640 1 -- 172.21.15.67:0/2187371044 learned_addr learned my addr 172.21.15.67:0/2187371044 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd128d6640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd0c162e60 0x7fcd0c155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd118d4640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd0c162a40 0x7fcd0c0cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fddb17fa640 1 -- 172.21.15.67:0/1580946334 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac0ac070 con 0x7fddb406f090 2024-09-19T05:33:31.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fddbb08b640 1 -- 172.21.15.67:0/1580946334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb4095330 con 0x7fddb406f090 2024-09-19T05:33:31.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7f4e01ffb640 1 -- 172.21.15.67:0/1682090854 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0b1040 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7f4e01ffb640 1 -- 172.21.15.67:0/1682090854 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dfc0acb30 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7f4e01ffb640 1 -- 172.21.15.67:0/1682090854 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0b5440 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7f4e12681640 1 -- 172.21.15.67:0/1682090854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0c1674d0 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fc336605640 1 -- 172.21.15.67:0/3870014464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3300ae3c0 con 0x7fc33015e5e0 2024-09-19T05:33:31.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a3c0dcb40 con 0x7f4a3c04f670 2024-09-19T05:33:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7f4e12681640 1 -- 172.21.15.67:0/1682090854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0c167a90 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fc325ffb640 1 -- 172.21.15.67:0/3870014464 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3280b3040 con 0x7fc33015e5e0 2024-09-19T05:33:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fc325ffb640 1 -- 172.21.15.67:0/3870014464 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328003db0 con 0x7fc33015e5e0 2024-09-19T05:33:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7f4a2b7fe640 1 -- 172.21.15.67:0/930724401 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a340ab600 con 0x7f4a3c04f670 2024-09-19T05:33:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7f4a2b7fe640 1 -- 172.21.15.67:0/930724401 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b0040 con 0x7f4a3c04f670 2024-09-19T05:33:31.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fddbb08b640 1 -- 172.21.15.67:0/1580946334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb40958f0 con 0x7fddb406f090 2024-09-19T05:33:31.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd120d5640 1 -- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd0c162e60 msgr2=0x7fcd0c155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd120d5640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd0c162e60 0x7fcd0c155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd120d5640 1 -- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd0c162a40 msgr2=0x7fcd0c0cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd120d5640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd0c162a40 0x7fcd0c0cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd120d5640 1 -- 172.21.15.67:0/2187371044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c0d0cc0 con 0x7fcd0c06c250 2024-09-19T05:33:31.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fcd120d5640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 0x7fcd0c149940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0c0040 tx=0x7fccfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7f4e12681640 1 -- 172.21.15.67:0/1682090854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0c071cc0 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fddb17fa640 1 -- 172.21.15.67:0/1580946334 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddac0bf070 con 0x7fddb406f090 2024-09-19T05:33:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fddbb08b640 1 -- 172.21.15.67:0/1580946334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb4095af0 con 0x7fddb406f090 2024-09-19T05:33:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.226+0000 7fddb17fa640 1 -- 172.21.15.67:0/1580946334 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac0b5040 con 0x7fddb406f090 2024-09-19T05:33:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fc325ffb640 1 -- 172.21.15.67:0/3870014464 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3280c0030 con 0x7fc33015e5e0 2024-09-19T05:33:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fc325ffb640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3140678c0 0x7fc314069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fc325ffb640 1 -- 172.21.15.67:0/3870014464 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc328120fd0 con 0x7fc33015e5e0 2024-09-19T05:33:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7f4a2b7fe640 1 -- 172.21.15.67:0/930724401 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a340bc020 con 0x7f4a3c04f670 2024-09-19T05:33:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7f4a2b7fe640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a300678c0 0x7f4a30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7f4a2b7fe640 1 -- 172.21.15.67:0/930724401 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4a34120280 con 0x7f4a3c04f670 2024-09-19T05:33:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7f4a42ffd640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a300678c0 0x7f4a30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fb5f259c640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5d40678f0 0x7fb5d4069db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8006aa0 tx=0x7fb5e8006a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fc335603640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3140678c0 0x7fc314069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fcd02ffd640 1 -- 172.21.15.67:0/2187371044 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0c2040 con 0x7fcd0c06c250 2024-09-19T05:33:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fcd02ffd640 1 -- 172.21.15.67:0/2187371044 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccfc0cc070 con 0x7fcd0c06c250 2024-09-19T05:33:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fcd130d7640 1 -- 172.21.15.67:0/2187371044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0c14a290 con 0x7fcd0c06c250 2024-09-19T05:33:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fcd02ffd640 1 -- 172.21.15.67:0/2187371044 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0c6630 con 0x7fcd0c06c250 2024-09-19T05:33:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fcd130d7640 1 -- 172.21.15.67:0/2187371044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0c14a850 con 0x7fcd0c06c250 2024-09-19T05:33:31.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7f4a42ffd640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a300678c0 0x7f4a30069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4a4406b770 tx=0x7f4a4406ba40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fc335603640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3140678c0 0x7fc314069d80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009600 tx=0x7fc32c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7f4e01ffb640 1 -- 172.21.15.67:0/1682090854 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4dfc0bc070 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7fcd130d7640 1 -- 172.21.15.67:0/2187371044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd0c06c630 con 0x7fcd0c06c250 2024-09-19T05:33:31.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7f4e01ffb640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4df00678f0 0x7f4df0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7f4e01ffb640 1 -- 172.21.15.67:0/1682090854 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4dfc11f6a0 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7f4e1167f640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4df00678f0 0x7f4df0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.230+0000 7f4e1167f640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4df00678f0 0x7f4df0069db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009ba0 tx=0x7f4e08009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.238+0000 7fc325ffb640 1 -- 172.21.15.67:0/3870014464 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc3280c7060 con 0x7fc33015e5e0 2024-09-19T05:33:31.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.238+0000 7f2c67fff640 1 -- 172.21.15.67:0/3472449775 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2c78057450 con 0x7f2c8006dd90 2024-09-19T05:33:31.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.246+0000 7f4a2b7fe640 1 -- 172.21.15.67:0/930724401 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4a340c3030 con 0x7f4a3c04f670 2024-09-19T05:33:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.246+0000 7fcd02ffd640 1 -- 172.21.15.67:0/2187371044 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fccfc0c67d0 con 0x7fcd0c06c250 2024-09-19T05:33:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.246+0000 7fcd02ffd640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccf00678c0 0x7fccf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.246+0000 7fcd118d4640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccf00678c0 0x7fccf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.250+0000 7fcd118d4640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccf00678c0 0x7fccf0069d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcd08007fd0 tx=0x7fcd08009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.250+0000 7fb5e2ffd640 1 -- 172.21.15.67:0/4002239833 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb5ec020020 con 0x7fb5f415f040 2024-09-19T05:33:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.254+0000 7f4e01ffb640 1 -- 172.21.15.67:0/1682090854 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4dfc0c3020 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.258+0000 7fcd02ffd640 1 -- 172.21.15.67:0/2187371044 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fccfc0ffaa0 con 0x7fcd0c06c250 2024-09-19T05:33:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.258+0000 7fddb17fa640 1 -- 172.21.15.67:0/1580946334 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fddac00a3b0 con 0x7fddb406f090 2024-09-19T05:33:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.258+0000 7fddb17fa640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdd980678c0 0x7fdd98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.258+0000 7fddb17fa640 1 -- 172.21.15.67:0/1580946334 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fddac1247e0 con 0x7fddb406f090 2024-09-19T05:33:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.258+0000 7fddb8e27640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdd980678c0 0x7fdd98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.258+0000 7fddb8e27640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdd980678c0 0x7fdd98069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdda800b410 tx=0x7fdda800d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.266+0000 7fcd02ffd640 1 -- 172.21.15.67:0/2187371044 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fccfc0270c0 con 0x7fcd0c06c250 2024-09-19T05:33:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.274+0000 7fddb17fa640 1 -- 172.21.15.67:0/1580946334 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fddb4095af0 con 0x7fddb406f090 2024-09-19T05:33:31.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.550+0000 7f2c85cde640 1 -- 172.21.15.67:0/3472449775 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2c800cc5b0 con 0x7f2c8006dd90 2024-09-19T05:33:31.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.554+0000 7f2c67fff640 1 -- 172.21.15.67:0/3472449775 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c78056d50 con 0x7f2c8006dd90 2024-09-19T05:33:31.558 INFO:teuthology.orchestra.run.smithi067.stdout:60129542153 2024-09-19T05:33:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.554+0000 7fc336605640 1 -- 172.21.15.67:0/3870014464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc3300b4990 con 0x7fc33015e5e0 2024-09-19T05:33:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.554+0000 7fc325ffb640 1 -- 172.21.15.67:0/3870014464 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc330147080 con 0x7fc33015e5e0 2024-09-19T05:33:31.559 INFO:teuthology.orchestra.run.smithi067.stdout:60129542154 2024-09-19T05:33:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.554+0000 7f2c65ffb640 1 -- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c6c067910 msgr2=0x7f2c6c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.554+0000 7f2c65ffb640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c6c067910 0x7f2c6c069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c740097c0 tx=0x7f2c74008040 comp rx=0 tx=0).stop 2024-09-19T05:33:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.554+0000 7f2c65ffb640 1 -- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 msgr2=0x7f2c8014ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.554+0000 7f2c65ffb640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 0x7f2c8014ba80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2c780074e0 tx=0x7f2c780079a0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7f2c65ffb640 1 -- 172.21.15.67:0/3472449775 shutdown_connections 2024-09-19T05:33:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7f2c65ffb640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c80158290 0x7f2c8015d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7f2c65ffb640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c800cec10 0x7f2c80159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7f2c65ffb640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c6c067910 0x7f2c6c069dd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7f2c65ffb640 1 --2- 172.21.15.67:0/3472449775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c8006dd90 0x7f2c8014ba80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7f2c65ffb640 1 -- 172.21.15.67:0/3472449775 >> 172.21.15.67:0/3472449775 conn(0x7f2c80067bd0 msgr2=0x7f2c800cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7f2c65ffb640 1 -- 172.21.15.67:0/3472449775 shutdown_connections 2024-09-19T05:33:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7f2c65ffb640 1 -- 172.21.15.67:0/3472449775 wait complete. 2024-09-19T05:33:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7f2971c88640 1 -- 172.21.15.67:0/20193873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f296c06ccd0 con 0x7f296c0cfa80 2024-09-19T05:33:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 -- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3140678c0 msgr2=0x7fc314069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3140678c0 0x7fc314069d80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009600 tx=0x7fc32c009190 comp rx=0 tx=0).stop 2024-09-19T05:33:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 -- 172.21.15.67:0/3870014464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc33015e5e0 msgr2=0x7fc330146b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc33015e5e0 0x7fc330146b40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc3280ac000 tx=0x7fc3280196c0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7f29697fa640 1 -- 172.21.15.67:0/20193873 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2958056ee0 con 0x7f296c0cfa80 2024-09-19T05:33:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 -- 172.21.15.67:0/3870014464 shutdown_connections 2024-09-19T05:33:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc33015e5e0 0x7fc330146b40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3140678c0 0x7fc314069d80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3300b5190 0x7fc3300cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 --2- 172.21.15.67:0/3870014464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc330073360 0x7fc3300ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 -- 172.21.15.67:0/3870014464 >> 172.21.15.67:0/3870014464 conn(0x7fc3300b6790 msgr2=0x7fc33006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 -- 172.21.15.67:0/3870014464 shutdown_connections 2024-09-19T05:33:31.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.558+0000 7fc336605640 1 -- 172.21.15.67:0/3870014464 wait complete. 2024-09-19T05:33:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:60129542151 2024-09-19T05:33:31.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 -- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2950067990 msgr2=0x7f2950069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2950067990 0x7f2950069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f296001ab00 tx=0x7f2960008040 comp rx=0 tx=0).stop 2024-09-19T05:33:31.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 -- 172.21.15.67:0/20193873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f296c0cfa80 msgr2=0x7f296c15b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f296c0cfa80 0x7f296c15b330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f295800d960 tx=0x7f295800de20 comp rx=0 tx=0).stop 2024-09-19T05:33:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 -- 172.21.15.67:0/20193873 shutdown_connections 2024-09-19T05:33:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f296c15a540 0x7f296c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f296c0cfa80 0x7f296c15b330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2950067990 0x7f2950069e50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 --2- 172.21.15.67:0/20193873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f296c0b5520 0x7f296c144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 -- 172.21.15.67:0/20193873 >> 172.21.15.67:0/20193873 conn(0x7f296c0ccc60 msgr2=0x7f296c159590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 -- 172.21.15.67:0/20193873 shutdown_connections 2024-09-19T05:33:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.566+0000 7f2971c88640 1 -- 172.21.15.67:0/20193873 wait complete. 2024-09-19T05:33:31.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.578+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f4a3c0e2cb0 con 0x7f4a3c04f670 2024-09-19T05:33:31.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.578+0000 7fb5f89fe640 1 -- 172.21.15.67:0/4002239833 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb5f40b0620 con 0x7fb5f415f040 2024-09-19T05:33:31.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.578+0000 7f4a2b7fe640 1 -- 172.21.15.67:0/930724401 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a34016090 con 0x7f4a3c04f670 2024-09-19T05:33:31.583 INFO:teuthology.orchestra.run.smithi067.stdout:60129542151 2024-09-19T05:33:31.583 INFO:teuthology.orchestra.run.smithi067.stdout:60129542151 2024-09-19T05:33:31.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.578+0000 7fb5e2ffd640 1 -- 172.21.15.67:0/4002239833 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5ec0570d0 con 0x7fb5f415f040 2024-09-19T05:33:31.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4e12681640 1 -- 172.21.15.67:0/1682090854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4e0c0b1520 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4e01ffb640 1 -- 172.21.15.67:0/1682090854 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4dfc016110 con 0x7f4e0c0b5b60 2024-09-19T05:33:31.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a300678c0 msgr2=0x7f4a30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a300678c0 0x7f4a30069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4a4406b770 tx=0x7f4a4406ba40 comp rx=0 tx=0).stop 2024-09-19T05:33:31.591 INFO:teuthology.orchestra.run.smithi067.stdout:60129542152 2024-09-19T05:33:31.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c04f670 msgr2=0x7f4a3c0d4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c04f670 0x7f4a3c0d4d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4a3401a040 tx=0x7f4a340191b0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 shutdown_connections 2024-09-19T05:33:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a3c0dd420 0x7f4a3c0d52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3c04f670 0x7f4a3c0d4d70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a300678c0 0x7f4a30069d80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 --2- 172.21.15.67:0/930724401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a3c009cc0 0x7f4a3c037af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 >> 172.21.15.67:0/930724401 conn(0x7f4a3c0360a0 msgr2=0x7f4a3c0d8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 shutdown_connections 2024-09-19T05:33:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.582+0000 7f4a43fff640 1 -- 172.21.15.67:0/930724401 wait complete. 2024-09-19T05:33:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 -- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5d40678f0 msgr2=0x7fb5d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5d40678f0 0x7fb5d4069db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8006aa0 tx=0x7fb5e8006a30 comp rx=0 tx=0).stop 2024-09-19T05:33:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 -- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415f040 msgr2=0x7fb5f4161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415f040 0x7fb5f4161600 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c730 tx=0x7fb5ec00cbf0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 -- 172.21.15.67:0/4002239833 shutdown_connections 2024-09-19T05:33:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5d40678f0 0x7fb5d4069db0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5f415f040 0x7fb5f4161600 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5f415e950 0x7fb5f4163170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 --2- 172.21.15.67:0/4002239833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5f415a8b0 0x7fb5f4153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 -- 172.21.15.67:0/4002239833 >> 172.21.15.67:0/4002239833 conn(0x7fb5f4073500 msgr2=0x7fb5f40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 -- 172.21.15.67:0/4002239833 shutdown_connections 2024-09-19T05:33:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7fb5f89fe640 1 -- 172.21.15.67:0/4002239833 wait complete. 2024-09-19T05:33:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 -- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4df00678f0 msgr2=0x7f4df0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4df00678f0 0x7f4df0069db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009ba0 tx=0x7f4e08009190 comp rx=0 tx=0).stop 2024-09-19T05:33:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 -- 172.21.15.67:0/1682090854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c0b5b60 msgr2=0x7f4e0c168290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c0b5b60 0x7f4e0c168290 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0ac000 tx=0x7f4dfc0191a0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.5 2024-09-19T05:33:31.598 DEBUG:teuthology.parallel:result is None 2024-09-19T05:33:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 -- 172.21.15.67:0/1682090854 shutdown_connections 2024-09-19T05:33:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e0c162570 0x7f4e0c16bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c0b5b60 0x7f4e0c168290 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4df00678f0 0x7f4df0069db0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 --2- 172.21.15.67:0/1682090854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e0c06e7a0 0x7f4e0c14cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 -- 172.21.15.67:0/1682090854 >> 172.21.15.67:0/1682090854 conn(0x7f4e0c0b1f10 msgr2=0x7f4e0c0afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 -- 172.21.15.67:0/1682090854 shutdown_connections 2024-09-19T05:33:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.586+0000 7f4e12681640 1 -- 172.21.15.67:0/1682090854 wait complete. 2024-09-19T05:33:31.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2024-09-19T05:33:31.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.1 2024-09-19T05:33:31.601 DEBUG:teuthology.parallel:result is None 2024-09-19T05:33:31.601 DEBUG:teuthology.parallel:result is None 2024-09-19T05:33:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.606+0000 7fddbb08b640 1 -- 172.21.15.67:0/1580946334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fddb4095120 con 0x7fddb406f090 2024-09-19T05:33:31.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2024-09-19T05:33:31.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.606+0000 7fddb17fa640 1 -- 172.21.15.67:0/1580946334 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fddac0190c0 con 0x7fddb406f090 2024-09-19T05:33:31.611 INFO:teuthology.orchestra.run.smithi067.stdout:60129542152 2024-09-19T05:33:31.611 DEBUG:teuthology.parallel:result is None 2024-09-19T05:33:31.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fcd130d7640 1 -- 172.21.15.67:0/2187371044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcd0c06d900 con 0x7fcd0c06c250 2024-09-19T05:33:31.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 -- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdd980678c0 msgr2=0x7fdd98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdd980678c0 0x7fdd98069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdda800b410 tx=0x7fdda800d040 comp rx=0 tx=0).stop 2024-09-19T05:33:31.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 -- 172.21.15.67:0/1580946334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddb406f090 msgr2=0x7fddb406f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddb406f090 0x7fddb406f520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fddac0af000 tx=0x7fddac008800 comp rx=0 tx=0).stop 2024-09-19T05:33:31.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 -- 172.21.15.67:0/1580946334 shutdown_connections 2024-09-19T05:33:31.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddb406f090 0x7fddb406f520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddb4099840 0x7fddb409d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdd980678c0 0x7fdd98069d80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 --2- 172.21.15.67:0/1580946334 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fddb4073270 0x7fddb4095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 -- 172.21.15.67:0/1580946334 >> 172.21.15.67:0/1580946334 conn(0x7fddb40b5710 msgr2=0x7fddb40cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 -- 172.21.15.67:0/1580946334 shutdown_connections 2024-09-19T05:33:31.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fddbb08b640 1 -- 172.21.15.67:0/1580946334 wait complete. 2024-09-19T05:33:31.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.610+0000 7fcd02ffd640 1 -- 172.21.15.67:0/2187371044 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fccfc102100 con 0x7fcd0c06c250 2024-09-19T05:33:31.615 INFO:teuthology.orchestra.run.smithi067.stdout:60129542151 2024-09-19T05:33:31.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-09-19T05:33:31.617 DEBUG:teuthology.parallel:result is None 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 -- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccf00678c0 msgr2=0x7fccf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccf00678c0 0x7fccf0069d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcd08007fd0 tx=0x7fcd08009040 comp rx=0 tx=0).stop 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 -- 172.21.15.67:0/2187371044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 msgr2=0x7fcd0c149940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 0x7fcd0c149940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0c0040 tx=0x7fccfc02a270 comp rx=0 tx=0).stop 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 -- 172.21.15.67:0/2187371044 shutdown_connections 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccf00678c0 0x7fccf0069d80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd0c162e60 0x7fcd0c155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd0c162a40 0x7fcd0c0cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 --2- 172.21.15.67:0/2187371044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0c06c250 0x7fcd0c149940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 -- 172.21.15.67:0/2187371044 >> 172.21.15.67:0/2187371044 conn(0x7fcd0c0b6660 msgr2=0x7fcd0c0b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 -- 172.21.15.67:0/2187371044 shutdown_connections 2024-09-19T05:33:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.614+0000 7fcd130d7640 1 -- 172.21.15.67:0/2187371044 wait complete. 2024-09-19T05:33:31.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.2 2024-09-19T05:33:31.621 DEBUG:teuthology.parallel:result is None 2024-09-19T05:33:31.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.3 2024-09-19T05:33:31.633 DEBUG:teuthology.parallel:result is None 2024-09-19T05:33:31.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-09-19T05:33:31.634 DEBUG:teuthology.parallel:result is None 2024-09-19T05:33:31.634 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:33:31.634 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:33:31.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f0500a12640 1 Processor -- start 2024-09-19T05:33:31.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f0500a12640 1 -- start start 2024-09-19T05:33:31.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f0500a12640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04fc070e90 0x7f04fc09ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f0500a12640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f04fc09b350 0x7f04fc162050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f0500a12640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc0d1270 con 0x7f04fc09aa30 2024-09-19T05:33:31.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f0500a12640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f04fc0d1510 con 0x7f04fc09b350 2024-09-19T05:33:31.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f0500a12640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc071340 con 0x7f04fc070e90 2024-09-19T05:33:31.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04fa59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f04fc09aa30 0x7f04fc070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34580/0 (socket says 172.21.15.67:34580) 2024-09-19T05:33:31.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04fa59c640 1 -- 172.21.15.67:0/1673232221 learned_addr learned my addr 172.21.15.67:0/1673232221 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:31.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04fad9d640 1 --2- 172.21.15.67:0/1673232221 >> v2:172.21.15.97:3300/0 conn(0x7f04fc09b350 0x7f04fc162050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f9d9b640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04fc070e90 0x7f04fc09ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311639956 0 0) 0x7f04fc0d1270 con 0x7f04fc09aa30 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e4003530 con 0x7f04fc09aa30 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4106561667 0 0) 0x7f04e4003530 con 0x7f04fc09aa30 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04fc070e90 msgr2=0x7f04fc09ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04fc070e90 0x7f04fc09ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 >> v2:172.21.15.97:3300/0 conn(0x7f04fc09b350 msgr2=0x7f04fc162050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 --2- 172.21.15.67:0/1673232221 >> v2:172.21.15.97:3300/0 conn(0x7f04fc09b350 0x7f04fc162050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc071620 con 0x7f04fc09aa30 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f04ec001680 con 0x7f04fc09aa30 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 >> v1:172.21.15.67:6789/0 conn(0x7f04fc09aa30 legacy=0x7f04fc070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04fc070e90 0x7f04e40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04e4003f40 0x7f04e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04e4004d50 0x7f04e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc0d1510 con 0x7f04e4004d50 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc071340 con 0x7f04e4003f40 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f04e400b9d0 con 0x7f04fc070e90 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04fad9d640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04e4004d50 0x7f04e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04fa59c640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04fc070e90 0x7f04e40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f9d9b640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04e4003f40 0x7f04e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04fad9d640 1 -- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04fc070e90 msgr2=0x7f04e40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04fad9d640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04fc070e90 0x7f04e40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04fad9d640 1 -- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04e4003f40 msgr2=0x7f04e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04fad9d640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04e4003f40 0x7f04e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04fad9d640 1 -- 172.21.15.67:0/1673232221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e4003530 con 0x7f04e4004d50 2024-09-19T05:33:31.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.778+0000 7f04f9d9b640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04e4003f40 0x7f04e4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:31.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f04fad9d640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04e4004d50 0x7f04e40051d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009fc0 tx=0x7f04f401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1380e6ae998b57f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f40b2070 con 0x7f04e4004d50 2024-09-19T05:33:31.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f40a5cd0 con 0x7f04e4004d50 2024-09-19T05:33:31.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f04f959a640 1 -- 172.21.15.67:0/1673232221 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4009c10 con 0x7f04e4004d50 2024-09-19T05:33:31.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 -- 172.21.15.67:0/1673232221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04e4004d50 msgr2=0x7f04e40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 --2- 172.21.15.67:0/1673232221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04e4004d50 0x7f04e40051d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009fc0 tx=0x7f04f401cc60 comp rx=0 tx=0).stop 2024-09-19T05:33:31.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f04fad9d640 1 -- 172.21.15.67:0/1673232221 reap_dead start 2024-09-19T05:33:31.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 -- 172.21.15.67:0/1673232221 shutdown_connections 2024-09-19T05:33:31.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 -- 172.21.15.67:0/1673232221 >> 172.21.15.67:0/1673232221 conn(0x7f04fc0d22b0 msgr2=0x7f04fc0d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 -- 172.21.15.67:0/1673232221 shutdown_connections 2024-09-19T05:33:31.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 -- 172.21.15.67:0/1673232221 wait complete. 2024-09-19T05:33:31.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 Processor -- start 2024-09-19T05:33:31.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 -- start start 2024-09-19T05:33:31.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04e4004d50 0x7f04fc15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04fc1ea270 0x7f04fc0af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04fc0afde0 0x7f04fc1f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc09b800 con 0x7f04fc1ea270 2024-09-19T05:33:31.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc071be0 con 0x7f04fc0afde0 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f0500a12640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc0c7690 con 0x7f04e4004d50 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.782+0000 7f04f9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04fc1ea270 0x7f04fc0af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04f9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04fc1ea270 0x7f04fc0af8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34696/0 (socket says 172.21.15.67:34696) 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04f9d9b640 1 -- 172.21.15.67:0/3394243944 learned_addr learned my addr 172.21.15.67:0/3394243944 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04fad9d640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04fc0afde0 0x7f04fc1f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04f9d9b640 1 -- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04e4004d50 msgr2=0x7f04fc15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04f9d9b640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04e4004d50 0x7f04fc15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04f9d9b640 1 -- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04fc0afde0 msgr2=0x7f04fc1f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04f9d9b640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04fc0afde0 0x7f04fc1f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04f9d9b640 1 -- 172.21.15.67:0/3394243944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc1e87f0 con 0x7f04fc1ea270 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04fad9d640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04fc0afde0 0x7f04fc1f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04f9d9b640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04fc1ea270 0x7f04fc0af8a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04f00108c0 tx=0x7f04f0010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04eaffd640 1 -- 172.21.15.67:0/3394243944 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f000f040 con 0x7f04fc1ea270 2024-09-19T05:33:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04eaffd640 1 -- 172.21.15.67:0/3394243944 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f0004220 con 0x7f04fc1ea270 2024-09-19T05:33:31.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f0500a12640 1 -- 172.21.15.67:0/3394243944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc1e8ad0 con 0x7f04fc1ea270 2024-09-19T05:33:31.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04eaffd640 1 -- 172.21.15.67:0/3394243944 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f000e960 con 0x7f04fc1ea270 2024-09-19T05:33:31.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f0500a12640 1 -- 172.21.15.67:0/3394243944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc15d7e0 con 0x7f04fc1ea270 2024-09-19T05:33:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f0500a12640 1 -- 172.21.15.67:0/3394243944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04fc09ae10 con 0x7f04fc1ea270 2024-09-19T05:33:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04eaffd640 1 -- 172.21.15.67:0/3394243944 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04f000eb00 con 0x7f04fc1ea270 2024-09-19T05:33:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04eaffd640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04dc0678c0 0x7f04dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04eaffd640 1 -- 172.21.15.67:0/3394243944 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f04f0086380 con 0x7f04fc1ea270 2024-09-19T05:33:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04fa59c640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04dc0678c0 0x7f04dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.786+0000 7f04fa59c640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04dc0678c0 0x7f04dc069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f04ec001210 tx=0x7f04ec001160 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.790+0000 7f04eaffd640 1 -- 172.21.15.67:0/3394243944 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f04f0018030 con 0x7f04fc1ea270 2024-09-19T05:33:31.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.942+0000 7f0500a12640 1 -- 172.21.15.67:0/3394243944 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04fc0b06f0 con 0x7f04dc0678c0 2024-09-19T05:33:31.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.966+0000 7f04eaffd640 1 -- 172.21.15.67:0/3394243944 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f04ec00e870 con 0x7f04dc0678c0 2024-09-19T05:33:31.974 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:31.976 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:33:31.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 -- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04dc0678c0 msgr2=0x7f04dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04dc0678c0 0x7f04dc069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f04ec001210 tx=0x7f04ec001160 comp rx=0 tx=0).stop 2024-09-19T05:33:31.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 -- 172.21.15.67:0/3394243944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04fc1ea270 msgr2=0x7f04fc0af8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:31.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04fc1ea270 0x7f04fc0af8a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04f00108c0 tx=0x7f04f0010d80 comp rx=0 tx=0).stop 2024-09-19T05:33:31.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 -- 172.21.15.67:0/3394243944 shutdown_connections 2024-09-19T05:33:31.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04fc0afde0 0x7f04fc1f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04fc1ea270 0x7f04fc0af8a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04dc0678c0 0x7f04dc069d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 --2- 172.21.15.67:0/3394243944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04e4004d50 0x7f04fc15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:31.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 -- 172.21.15.67:0/3394243944 >> 172.21.15.67:0/3394243944 conn(0x7f04fc0d22b0 msgr2=0x7f04fc06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:31.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 -- 172.21.15.67:0/3394243944 shutdown_connections 2024-09-19T05:33:31.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:31.974+0000 7f0500a12640 1 -- 172.21.15.67:0/3394243944 wait complete. 2024-09-19T05:33:31.991 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-19T05:33:31.110865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219496,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755224,"statfs":{"total":773094113280,"available":772869349376,"internally_reserved":0,"allocated":3350528,"data_stored":2017900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.537480"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123907+0000","last_change":"2024-09-19T05:33:13.530341+0000","last_active":"2024-09-19T05:33:20.123907+0000","last_peered":"2024-09-19T05:33:20.123907+0000","last_clean":"2024-09-19T05:33:20.123907+0000","last_became_active":"2024-09-19T05:33:13.530048+0000","last_became_peered":"2024-09-19T05:33:13.530048+0000","last_unstale":"2024-09-19T05:33:20.123907+0000","last_undegraded":"2024-09-19T05:33:20.123907+0000","last_fullsized":"2024-09-19T05:33:20.123907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:42.052958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007572+0000","last_change":"2024-09-19T05:33:14.561113+0000","last_active":"2024-09-19T05:33:20.007572+0000","last_peered":"2024-09-19T05:33:20.007572+0000","last_clean":"2024-09-19T05:33:20.007572+0000","last_became_active":"2024-09-19T05:33:14.560582+0000","last_became_peered":"2024-09-19T05:33:14.560582+0000","last_unstale":"2024-09-19T05:33:20.007572+0000","last_undegraded":"2024-09-19T05:33:20.007572+0000","last_fullsized":"2024-09-19T05:33:20.007572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006991+0000","last_change":"2024-09-19T05:33:18.730325+0000","last_active":"2024-09-19T05:33:20.006991+0000","last_peered":"2024-09-19T05:33:20.006991+0000","last_clean":"2024-09-19T05:33:20.006991+0000","last_became_active":"2024-09-19T05:33:18.729806+0000","last_became_peered":"2024-09-19T05:33:18.729806+0000","last_unstale":"2024-09-19T05:33:20.006991+0000","last_undegraded":"2024-09-19T05:33:20.006991+0000","last_fullsized":"2024-09-19T05:33:20.006991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:39.340032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007739+0000","last_change":"2024-09-19T05:33:13.523215+0000","last_active":"2024-09-19T05:33:20.007739+0000","last_peered":"2024-09-19T05:33:20.007739+0000","last_clean":"2024-09-19T05:33:20.007739+0000","last_became_active":"2024-09-19T05:33:13.522889+0000","last_became_peered":"2024-09-19T05:33:13.522889+0000","last_unstale":"2024-09-19T05:33:20.007739+0000","last_undegraded":"2024-09-19T05:33:20.007739+0000","last_fullsized":"2024-09-19T05:33:20.007739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:42.052958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123695+0000","last_change":"2024-09-19T05:33:14.551843+0000","last_active":"2024-09-19T05:33:20.123695+0000","last_peered":"2024-09-19T05:33:20.123695+0000","last_clean":"2024-09-19T05:33:20.123695+0000","last_became_active":"2024-09-19T05:33:14.551518+0000","last_became_peered":"2024-09-19T05:33:14.551518+0000","last_unstale":"2024-09-19T05:33:20.123695+0000","last_undegraded":"2024-09-19T05:33:20.123695+0000","last_fullsized":"2024-09-19T05:33:20.123695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577133+0000","last_change":"2024-09-19T05:33:18.599217+0000","last_active":"2024-09-19T05:33:19.577133+0000","last_peered":"2024-09-19T05:33:19.577133+0000","last_clean":"2024-09-19T05:33:19.577133+0000","last_became_active":"2024-09-19T05:33:18.598214+0000","last_became_peered":"2024-09-19T05:33:18.598214+0000","last_unstale":"2024-09-19T05:33:19.577133+0000","last_undegraded":"2024-09-19T05:33:19.577133+0000","last_fullsized":"2024-09-19T05:33:19.577133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:34.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924522+0000","last_change":"2024-09-19T05:33:13.543770+0000","last_active":"2024-09-19T05:33:20.924522+0000","last_peered":"2024-09-19T05:33:20.924522+0000","last_clean":"2024-09-19T05:33:20.924522+0000","last_became_active":"2024-09-19T05:33:13.543056+0000","last_became_peered":"2024-09-19T05:33:13.543056+0000","last_unstale":"2024-09-19T05:33:20.924522+0000","last_undegraded":"2024-09-19T05:33:20.924522+0000","last_fullsized":"2024-09-19T05:33:20.924522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543508+0000","last_change":"2024-09-19T05:33:14.570231+0000","last_active":"2024-09-19T05:33:20.543508+0000","last_peered":"2024-09-19T05:33:20.543508+0000","last_clean":"2024-09-19T05:33:20.543508+0000","last_became_active":"2024-09-19T05:33:14.569664+0000","last_became_peered":"2024-09-19T05:33:14.569664+0000","last_unstale":"2024-09-19T05:33:20.543508+0000","last_undegraded":"2024-09-19T05:33:20.543508+0000","last_fullsized":"2024-09-19T05:33:20.543508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.290827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577443+0000","last_change":"2024-09-19T05:33:18.596831+0000","last_active":"2024-09-19T05:33:19.577443+0000","last_peered":"2024-09-19T05:33:19.577443+0000","last_clean":"2024-09-19T05:33:19.577443+0000","last_became_active":"2024-09-19T05:33:18.595733+0000","last_became_peered":"2024-09-19T05:33:18.595733+0000","last_unstale":"2024-09-19T05:33:19.577443+0000","last_undegraded":"2024-09-19T05:33:19.577443+0000","last_fullsized":"2024-09-19T05:33:19.577443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:32.766631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924142+0000","last_change":"2024-09-19T05:33:13.555869+0000","last_active":"2024-09-19T05:33:20.924142+0000","last_peered":"2024-09-19T05:33:20.924142+0000","last_clean":"2024-09-19T05:33:20.924142+0000","last_became_active":"2024-09-19T05:33:13.555335+0000","last_became_peered":"2024-09-19T05:33:13.555335+0000","last_unstale":"2024-09-19T05:33:20.924142+0000","last_undegraded":"2024-09-19T05:33:20.924142+0000","last_fullsized":"2024-09-19T05:33:20.924142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.724638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543769+0000","last_change":"2024-09-19T05:33:14.570470+0000","last_active":"2024-09-19T05:33:20.543769+0000","last_peered":"2024-09-19T05:33:20.543769+0000","last_clean":"2024-09-19T05:33:20.543769+0000","last_became_active":"2024-09-19T05:33:14.569698+0000","last_became_peered":"2024-09-19T05:33:14.569698+0000","last_unstale":"2024-09-19T05:33:20.543769+0000","last_undegraded":"2024-09-19T05:33:20.543769+0000","last_fullsized":"2024-09-19T05:33:20.543769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:06.821907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577368+0000","last_change":"2024-09-19T05:33:18.595934+0000","last_active":"2024-09-19T05:33:19.577368+0000","last_peered":"2024-09-19T05:33:19.577368+0000","last_clean":"2024-09-19T05:33:19.577368+0000","last_became_active":"2024-09-19T05:33:18.594894+0000","last_became_peered":"2024-09-19T05:33:18.594894+0000","last_unstale":"2024-09-19T05:33:19.577368+0000","last_undegraded":"2024-09-19T05:33:19.577368+0000","last_fullsized":"2024-09-19T05:33:19.577368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:40.713471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923638+0000","last_change":"2024-09-19T05:33:14.550250+0000","last_active":"2024-09-19T05:33:20.923638+0000","last_peered":"2024-09-19T05:33:20.923638+0000","last_clean":"2024-09-19T05:33:20.923638+0000","last_became_active":"2024-09-19T05:33:14.549364+0000","last_became_peered":"2024-09-19T05:33:14.549364+0000","last_unstale":"2024-09-19T05:33:20.923638+0000","last_undegraded":"2024-09-19T05:33:20.923638+0000","last_fullsized":"2024-09-19T05:33:20.923638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924425+0000","last_change":"2024-09-19T05:33:13.539570+0000","last_active":"2024-09-19T05:33:20.924425+0000","last_peered":"2024-09-19T05:33:20.924425+0000","last_clean":"2024-09-19T05:33:20.924425+0000","last_became_active":"2024-09-19T05:33:13.538888+0000","last_became_peered":"2024-09-19T05:33:13.538888+0000","last_unstale":"2024-09-19T05:33:20.924425+0000","last_undegraded":"2024-09-19T05:33:20.924425+0000","last_fullsized":"2024-09-19T05:33:20.924425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:45.954638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579051+0000","last_change":"2024-09-19T05:33:18.592794+0000","last_active":"2024-09-19T05:33:19.579051+0000","last_peered":"2024-09-19T05:33:19.579051+0000","last_clean":"2024-09-19T05:33:19.579051+0000","last_became_active":"2024-09-19T05:33:18.591024+0000","last_became_peered":"2024-09-19T05:33:18.591024+0000","last_unstale":"2024-09-19T05:33:19.579051+0000","last_undegraded":"2024-09-19T05:33:19.579051+0000","last_fullsized":"2024-09-19T05:33:19.579051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:57.960270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007498+0000","last_change":"2024-09-19T05:33:14.521242+0000","last_active":"2024-09-19T05:33:20.007498+0000","last_peered":"2024-09-19T05:33:20.007498+0000","last_clean":"2024-09-19T05:33:20.007498+0000","last_became_active":"2024-09-19T05:33:14.520972+0000","last_became_peered":"2024-09-19T05:33:14.520972+0000","last_unstale":"2024-09-19T05:33:20.007498+0000","last_undegraded":"2024-09-19T05:33:20.007498+0000","last_fullsized":"2024-09-19T05:33:20.007498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923376+0000","last_change":"2024-09-19T05:33:13.519454+0000","last_active":"2024-09-19T05:33:20.923376+0000","last_peered":"2024-09-19T05:33:20.923376+0000","last_clean":"2024-09-19T05:33:20.923376+0000","last_became_active":"2024-09-19T05:33:13.518870+0000","last_became_peered":"2024-09-19T05:33:13.518870+0000","last_unstale":"2024-09-19T05:33:20.923376+0000","last_undegraded":"2024-09-19T05:33:20.923376+0000","last_fullsized":"2024-09-19T05:33:20.923376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.724638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579015+0000","last_change":"2024-09-19T05:33:18.604812+0000","last_active":"2024-09-19T05:33:19.579015+0000","last_peered":"2024-09-19T05:33:19.579015+0000","last_clean":"2024-09-19T05:33:19.579015+0000","last_became_active":"2024-09-19T05:33:18.603949+0000","last_became_peered":"2024-09-19T05:33:18.603949+0000","last_unstale":"2024-09-19T05:33:19.579015+0000","last_undegraded":"2024-09-19T05:33:19.579015+0000","last_fullsized":"2024-09-19T05:33:19.579015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:42.509239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007398+0000","last_change":"2024-09-19T05:33:14.530704+0000","last_active":"2024-09-19T05:33:20.007398+0000","last_peered":"2024-09-19T05:33:20.007398+0000","last_clean":"2024-09-19T05:33:20.007398+0000","last_became_active":"2024-09-19T05:33:14.530029+0000","last_became_peered":"2024-09-19T05:33:14.530029+0000","last_unstale":"2024-09-19T05:33:20.007398+0000","last_undegraded":"2024-09-19T05:33:20.007398+0000","last_fullsized":"2024-09-19T05:33:20.007398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922903+0000","last_change":"2024-09-19T05:33:13.536984+0000","last_active":"2024-09-19T05:33:20.922903+0000","last_peered":"2024-09-19T05:33:20.922903+0000","last_clean":"2024-09-19T05:33:20.922903+0000","last_became_active":"2024-09-19T05:33:13.536584+0000","last_became_peered":"2024-09-19T05:33:13.536584+0000","last_unstale":"2024-09-19T05:33:20.922903+0000","last_undegraded":"2024-09-19T05:33:20.922903+0000","last_fullsized":"2024-09-19T05:33:20.922903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924954+0000","last_change":"2024-09-19T05:33:18.731101+0000","last_active":"2024-09-19T05:33:20.924954+0000","last_peered":"2024-09-19T05:33:20.924954+0000","last_clean":"2024-09-19T05:33:20.924954+0000","last_became_active":"2024-09-19T05:33:18.730688+0000","last_became_peered":"2024-09-19T05:33:18.730688+0000","last_unstale":"2024-09-19T05:33:20.924954+0000","last_undegraded":"2024-09-19T05:33:20.924954+0000","last_fullsized":"2024-09-19T05:33:20.924954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:03.333739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578871+0000","last_change":"2024-09-19T05:33:14.543745+0000","last_active":"2024-09-19T05:33:19.578871+0000","last_peered":"2024-09-19T05:33:19.578871+0000","last_clean":"2024-09-19T05:33:19.578871+0000","last_became_active":"2024-09-19T05:33:14.541218+0000","last_became_peered":"2024-09-19T05:33:14.541218+0000","last_unstale":"2024-09-19T05:33:19.578871+0000","last_undegraded":"2024-09-19T05:33:19.578871+0000","last_fullsized":"2024-09-19T05:33:19.578871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:31.945487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923405+0000","last_change":"2024-09-19T05:33:13.534122+0000","last_active":"2024-09-19T05:33:20.923405+0000","last_peered":"2024-09-19T05:33:20.923405+0000","last_clean":"2024-09-19T05:33:20.923405+0000","last_became_active":"2024-09-19T05:33:13.533442+0000","last_became_peered":"2024-09-19T05:33:13.533442+0000","last_unstale":"2024-09-19T05:33:20.923405+0000","last_undegraded":"2024-09-19T05:33:20.923405+0000","last_fullsized":"2024-09-19T05:33:20.923405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578804+0000","last_change":"2024-09-19T05:33:18.595747+0000","last_active":"2024-09-19T05:33:19.578804+0000","last_peered":"2024-09-19T05:33:19.578804+0000","last_clean":"2024-09-19T05:33:19.578804+0000","last_became_active":"2024-09-19T05:33:18.594611+0000","last_became_peered":"2024-09-19T05:33:18.594611+0000","last_unstale":"2024-09-19T05:33:19.578804+0000","last_undegraded":"2024-09-19T05:33:19.578804+0000","last_fullsized":"2024-09-19T05:33:19.578804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:47.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123977+0000","last_change":"2024-09-19T05:33:14.530979+0000","last_active":"2024-09-19T05:33:20.123977+0000","last_peered":"2024-09-19T05:33:20.123977+0000","last_clean":"2024-09-19T05:33:20.123977+0000","last_became_active":"2024-09-19T05:33:14.530680+0000","last_became_peered":"2024-09-19T05:33:14.530680+0000","last_unstale":"2024-09-19T05:33:20.123977+0000","last_undegraded":"2024-09-19T05:33:20.123977+0000","last_fullsized":"2024-09-19T05:33:20.123977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926403+0000","last_change":"2024-09-19T05:33:13.532595+0000","last_active":"2024-09-19T05:33:20.926403+0000","last_peered":"2024-09-19T05:33:20.926403+0000","last_clean":"2024-09-19T05:33:20.926403+0000","last_became_active":"2024-09-19T05:33:13.531963+0000","last_became_peered":"2024-09-19T05:33:13.531963+0000","last_unstale":"2024-09-19T05:33:20.926403+0000","last_undegraded":"2024-09-19T05:33:20.926403+0000","last_fullsized":"2024-09-19T05:33:20.926403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:41.192975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577289+0000","last_change":"2024-09-19T05:33:18.727908+0000","last_active":"2024-09-19T05:33:19.577289+0000","last_peered":"2024-09-19T05:33:19.577289+0000","last_clean":"2024-09-19T05:33:19.577289+0000","last_became_active":"2024-09-19T05:33:18.726858+0000","last_became_peered":"2024-09-19T05:33:18.726858+0000","last_unstale":"2024-09-19T05:33:19.577289+0000","last_undegraded":"2024-09-19T05:33:19.577289+0000","last_fullsized":"2024-09-19T05:33:19.577289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:24.769636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.008051+0000","last_change":"2024-09-19T05:33:14.562327+0000","last_active":"2024-09-19T05:33:20.008051+0000","last_peered":"2024-09-19T05:33:20.008051+0000","last_clean":"2024-09-19T05:33:20.008051+0000","last_became_active":"2024-09-19T05:33:14.561984+0000","last_became_peered":"2024-09-19T05:33:14.561984+0000","last_unstale":"2024-09-19T05:33:20.008051+0000","last_undegraded":"2024-09-19T05:33:20.008051+0000","last_fullsized":"2024-09-19T05:33:20.008051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924849+0000","last_change":"2024-09-19T05:33:13.536758+0000","last_active":"2024-09-19T05:33:20.924849+0000","last_peered":"2024-09-19T05:33:20.924849+0000","last_clean":"2024-09-19T05:33:20.924849+0000","last_became_active":"2024-09-19T05:33:13.536502+0000","last_became_peered":"2024-09-19T05:33:13.536502+0000","last_unstale":"2024-09-19T05:33:20.924849+0000","last_undegraded":"2024-09-19T05:33:20.924849+0000","last_fullsized":"2024-09-19T05:33:20.924849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006886+0000","last_change":"2024-09-19T05:33:18.723398+0000","last_active":"2024-09-19T05:33:20.006886+0000","last_peered":"2024-09-19T05:33:20.006886+0000","last_clean":"2024-09-19T05:33:20.006886+0000","last_became_active":"2024-09-19T05:33:18.722953+0000","last_became_peered":"2024-09-19T05:33:18.722953+0000","last_unstale":"2024-09-19T05:33:20.006886+0000","last_undegraded":"2024-09-19T05:33:20.006886+0000","last_fullsized":"2024-09-19T05:33:20.006886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:15.960409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924131+0000","last_change":"2024-09-19T05:33:14.527703+0000","last_active":"2024-09-19T05:33:20.924131+0000","last_peered":"2024-09-19T05:33:20.924131+0000","last_clean":"2024-09-19T05:33:20.924131+0000","last_became_active":"2024-09-19T05:33:14.527335+0000","last_became_peered":"2024-09-19T05:33:14.527335+0000","last_unstale":"2024-09-19T05:33:20.924131+0000","last_undegraded":"2024-09-19T05:33:20.924131+0000","last_fullsized":"2024-09-19T05:33:20.924131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924672+0000","last_change":"2024-09-19T05:33:13.534591+0000","last_active":"2024-09-19T05:33:20.924672+0000","last_peered":"2024-09-19T05:33:20.924672+0000","last_clean":"2024-09-19T05:33:20.924672+0000","last_became_active":"2024-09-19T05:33:13.533520+0000","last_became_peered":"2024-09-19T05:33:13.533520+0000","last_unstale":"2024-09-19T05:33:20.924672+0000","last_undegraded":"2024-09-19T05:33:20.924672+0000","last_fullsized":"2024-09-19T05:33:20.924672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:40.138729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123671+0000","last_change":"2024-09-19T05:33:18.727847+0000","last_active":"2024-09-19T05:33:20.123671+0000","last_peered":"2024-09-19T05:33:20.123671+0000","last_clean":"2024-09-19T05:33:20.123671+0000","last_became_active":"2024-09-19T05:33:18.727377+0000","last_became_peered":"2024-09-19T05:33:18.727377+0000","last_unstale":"2024-09-19T05:33:20.123671+0000","last_undegraded":"2024-09-19T05:33:20.123671+0000","last_fullsized":"2024-09-19T05:33:20.123671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:47.968935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544028+0000","last_change":"2024-09-19T05:33:14.552094+0000","last_active":"2024-09-19T05:33:20.544028+0000","last_peered":"2024-09-19T05:33:20.544028+0000","last_clean":"2024-09-19T05:33:20.544028+0000","last_became_active":"2024-09-19T05:33:14.551244+0000","last_became_peered":"2024-09-19T05:33:14.551244+0000","last_unstale":"2024-09-19T05:33:20.544028+0000","last_undegraded":"2024-09-19T05:33:20.544028+0000","last_fullsized":"2024-09-19T05:33:20.544028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:29.504706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924385+0000","last_change":"2024-09-19T05:33:13.523378+0000","last_active":"2024-09-19T05:33:20.924385+0000","last_peered":"2024-09-19T05:33:20.924385+0000","last_clean":"2024-09-19T05:33:20.924385+0000","last_became_active":"2024-09-19T05:33:13.523053+0000","last_became_peered":"2024-09-19T05:33:13.523053+0000","last_unstale":"2024-09-19T05:33:20.924385+0000","last_undegraded":"2024-09-19T05:33:20.924385+0000","last_fullsized":"2024-09-19T05:33:20.924385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:41.192975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923121+0000","last_change":"2024-09-19T05:33:18.602228+0000","last_active":"2024-09-19T05:33:20.923121+0000","last_peered":"2024-09-19T05:33:20.923121+0000","last_clean":"2024-09-19T05:33:20.923121+0000","last_became_active":"2024-09-19T05:33:18.601292+0000","last_became_peered":"2024-09-19T05:33:18.601292+0000","last_unstale":"2024-09-19T05:33:20.923121+0000","last_undegraded":"2024-09-19T05:33:20.923121+0000","last_fullsized":"2024-09-19T05:33:20.923121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:57.747825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578328+0000","last_change":"2024-09-19T05:33:14.537118+0000","last_active":"2024-09-19T05:33:19.578328+0000","last_peered":"2024-09-19T05:33:19.578328+0000","last_clean":"2024-09-19T05:33:19.578328+0000","last_became_active":"2024-09-19T05:33:14.535816+0000","last_became_peered":"2024-09-19T05:33:14.535816+0000","last_unstale":"2024-09-19T05:33:19.578328+0000","last_undegraded":"2024-09-19T05:33:19.578328+0000","last_fullsized":"2024-09-19T05:33:19.578328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:49.497300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543873+0000","last_change":"2024-09-19T05:33:13.550593+0000","last_active":"2024-09-19T05:33:20.543873+0000","last_peered":"2024-09-19T05:33:20.543873+0000","last_clean":"2024-09-19T05:33:20.543873+0000","last_became_active":"2024-09-19T05:33:13.549511+0000","last_became_peered":"2024-09-19T05:33:13.549511+0000","last_unstale":"2024-09-19T05:33:20.543873+0000","last_undegraded":"2024-09-19T05:33:20.543873+0000","last_fullsized":"2024-09-19T05:33:20.543873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:13.595105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924258+0000","last_change":"2024-09-19T05:33:18.607825+0000","last_active":"2024-09-19T05:33:20.924258+0000","last_peered":"2024-09-19T05:33:20.924258+0000","last_clean":"2024-09-19T05:33:20.924258+0000","last_became_active":"2024-09-19T05:33:18.606441+0000","last_became_peered":"2024-09-19T05:33:18.606441+0000","last_unstale":"2024-09-19T05:33:20.924258+0000","last_undegraded":"2024-09-19T05:33:20.924258+0000","last_fullsized":"2024-09-19T05:33:20.924258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:47.248958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922997+0000","last_change":"2024-09-19T05:33:14.530018+0000","last_active":"2024-09-19T05:33:20.922997+0000","last_peered":"2024-09-19T05:33:20.922997+0000","last_clean":"2024-09-19T05:33:20.922997+0000","last_became_active":"2024-09-19T05:33:14.528997+0000","last_became_peered":"2024-09-19T05:33:14.528997+0000","last_unstale":"2024-09-19T05:33:20.922997+0000","last_undegraded":"2024-09-19T05:33:20.922997+0000","last_fullsized":"2024-09-19T05:33:20.922997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576385+0000","last_change":"2024-09-19T05:33:13.518923+0000","last_active":"2024-09-19T05:33:19.576385+0000","last_peered":"2024-09-19T05:33:19.576385+0000","last_clean":"2024-09-19T05:33:19.576385+0000","last_became_active":"2024-09-19T05:33:13.517867+0000","last_became_peered":"2024-09-19T05:33:13.517867+0000","last_unstale":"2024-09-19T05:33:19.576385+0000","last_undegraded":"2024-09-19T05:33:19.576385+0000","last_fullsized":"2024-09-19T05:33:19.576385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:41.939363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925137+0000","last_change":"2024-09-19T05:33:18.600087+0000","last_active":"2024-09-19T05:33:20.925137+0000","last_peered":"2024-09-19T05:33:20.925137+0000","last_clean":"2024-09-19T05:33:20.925137+0000","last_became_active":"2024-09-19T05:33:18.599484+0000","last_became_peered":"2024-09-19T05:33:18.599484+0000","last_unstale":"2024-09-19T05:33:20.925137+0000","last_undegraded":"2024-09-19T05:33:20.925137+0000","last_fullsized":"2024-09-19T05:33:20.925137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:03.032844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123142+0000","last_change":"2024-09-19T05:33:14.549619+0000","last_active":"2024-09-19T05:33:20.123142+0000","last_peered":"2024-09-19T05:33:20.123142+0000","last_clean":"2024-09-19T05:33:20.123142+0000","last_became_active":"2024-09-19T05:33:14.549390+0000","last_became_peered":"2024-09-19T05:33:14.549390+0000","last_unstale":"2024-09-19T05:33:20.123142+0000","last_undegraded":"2024-09-19T05:33:20.123142+0000","last_fullsized":"2024-09-19T05:33:20.123142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:29.911108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923683+0000","last_change":"2024-09-19T05:33:13.533988+0000","last_active":"2024-09-19T05:33:20.923683+0000","last_peered":"2024-09-19T05:33:20.923683+0000","last_clean":"2024-09-19T05:33:20.923683+0000","last_became_active":"2024-09-19T05:33:13.533251+0000","last_became_peered":"2024-09-19T05:33:13.533251+0000","last_unstale":"2024-09-19T05:33:20.923683+0000","last_undegraded":"2024-09-19T05:33:20.923683+0000","last_fullsized":"2024-09-19T05:33:20.923683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123842+0000","last_change":"2024-09-19T05:33:18.731732+0000","last_active":"2024-09-19T05:33:20.123842+0000","last_peered":"2024-09-19T05:33:20.123842+0000","last_clean":"2024-09-19T05:33:20.123842+0000","last_became_active":"2024-09-19T05:33:18.731060+0000","last_became_peered":"2024-09-19T05:33:18.731060+0000","last_unstale":"2024-09-19T05:33:20.123842+0000","last_undegraded":"2024-09-19T05:33:20.123842+0000","last_fullsized":"2024-09-19T05:33:20.123842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:03.333739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007078+0000","last_change":"2024-09-19T05:33:14.564726+0000","last_active":"2024-09-19T05:33:20.007078+0000","last_peered":"2024-09-19T05:33:20.007078+0000","last_clean":"2024-09-19T05:33:20.007078+0000","last_became_active":"2024-09-19T05:33:14.564425+0000","last_became_peered":"2024-09-19T05:33:14.564425+0000","last_unstale":"2024-09-19T05:33:20.007078+0000","last_undegraded":"2024-09-19T05:33:20.007078+0000","last_fullsized":"2024-09-19T05:33:20.007078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543194+0000","last_change":"2024-09-19T05:33:13.553641+0000","last_active":"2024-09-19T05:33:20.543194+0000","last_peered":"2024-09-19T05:33:20.543194+0000","last_clean":"2024-09-19T05:33:20.543194+0000","last_became_active":"2024-09-19T05:33:13.552684+0000","last_became_peered":"2024-09-19T05:33:13.552684+0000","last_unstale":"2024-09-19T05:33:20.543194+0000","last_undegraded":"2024-09-19T05:33:20.543194+0000","last_fullsized":"2024-09-19T05:33:20.543194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:01.312371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922618+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:33:20.922618+0000","last_peered":"2024-09-19T05:33:20.922618+0000","last_clean":"2024-09-19T05:33:20.922618+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:33:20.922618+0000","last_undegraded":"2024-09-19T05:33:20.922618+0000","last_fullsized":"2024-09-19T05:33:20.922618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923213+0000","last_change":"2024-09-19T05:33:18.730082+0000","last_active":"2024-09-19T05:33:20.923213+0000","last_peered":"2024-09-19T05:33:20.923213+0000","last_clean":"2024-09-19T05:33:20.923213+0000","last_became_active":"2024-09-19T05:33:18.728956+0000","last_became_peered":"2024-09-19T05:33:18.728956+0000","last_unstale":"2024-09-19T05:33:20.923213+0000","last_undegraded":"2024-09-19T05:33:20.923213+0000","last_fullsized":"2024-09-19T05:33:20.923213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:42.509239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924260+0000","last_change":"2024-09-19T05:33:14.556753+0000","last_active":"2024-09-19T05:33:20.924260+0000","last_peered":"2024-09-19T05:33:20.924260+0000","last_clean":"2024-09-19T05:33:20.924260+0000","last_became_active":"2024-09-19T05:33:14.555774+0000","last_became_peered":"2024-09-19T05:33:14.555774+0000","last_unstale":"2024-09-19T05:33:20.924260+0000","last_undegraded":"2024-09-19T05:33:20.924260+0000","last_fullsized":"2024-09-19T05:33:20.924260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:43.675511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576694+0000","last_change":"2024-09-19T05:33:13.554975+0000","last_active":"2024-09-19T05:33:19.576694+0000","last_peered":"2024-09-19T05:33:19.576694+0000","last_clean":"2024-09-19T05:33:19.576694+0000","last_became_active":"2024-09-19T05:33:13.554687+0000","last_became_peered":"2024-09-19T05:33:13.554687+0000","last_unstale":"2024-09-19T05:33:19.576694+0000","last_undegraded":"2024-09-19T05:33:19.576694+0000","last_fullsized":"2024-09-19T05:33:19.576694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:19.118135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923096+0000","last_change":"2024-09-19T05:33:18.725840+0000","last_active":"2024-09-19T05:33:20.923096+0000","last_peered":"2024-09-19T05:33:20.923096+0000","last_clean":"2024-09-19T05:33:20.923096+0000","last_became_active":"2024-09-19T05:33:18.724609+0000","last_became_peered":"2024-09-19T05:33:18.724609+0000","last_unstale":"2024-09-19T05:33:20.923096+0000","last_undegraded":"2024-09-19T05:33:20.923096+0000","last_fullsized":"2024-09-19T05:33:20.923096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:47.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543949+0000","last_change":"2024-09-19T05:33:14.537550+0000","last_active":"2024-09-19T05:33:20.543949+0000","last_peered":"2024-09-19T05:33:20.543949+0000","last_clean":"2024-09-19T05:33:20.543949+0000","last_became_active":"2024-09-19T05:33:14.536832+0000","last_became_peered":"2024-09-19T05:33:14.536832+0000","last_unstale":"2024-09-19T05:33:20.543949+0000","last_undegraded":"2024-09-19T05:33:20.543949+0000","last_fullsized":"2024-09-19T05:33:20.543949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:45.451882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924358+0000","last_change":"2024-09-19T05:33:13.524749+0000","last_active":"2024-09-19T05:33:20.924358+0000","last_peered":"2024-09-19T05:33:20.924358+0000","last_clean":"2024-09-19T05:33:20.924358+0000","last_became_active":"2024-09-19T05:33:13.523674+0000","last_became_peered":"2024-09-19T05:33:13.523674+0000","last_unstale":"2024-09-19T05:33:20.924358+0000","last_undegraded":"2024-09-19T05:33:20.924358+0000","last_fullsized":"2024-09-19T05:33:20.924358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:45.954638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123714+0000","last_change":"2024-09-19T05:33:18.598514+0000","last_active":"2024-09-19T05:33:20.123714+0000","last_peered":"2024-09-19T05:33:20.123714+0000","last_clean":"2024-09-19T05:33:20.123714+0000","last_became_active":"2024-09-19T05:33:18.598011+0000","last_became_peered":"2024-09-19T05:33:18.598011+0000","last_unstale":"2024-09-19T05:33:20.123714+0000","last_undegraded":"2024-09-19T05:33:20.123714+0000","last_fullsized":"2024-09-19T05:33:20.123714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.531745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925304+0000","last_change":"2024-09-19T05:33:14.574183+0000","last_active":"2024-09-19T05:33:20.925304+0000","last_peered":"2024-09-19T05:33:20.925304+0000","last_clean":"2024-09-19T05:33:20.925304+0000","last_became_active":"2024-09-19T05:33:14.572292+0000","last_became_peered":"2024-09-19T05:33:14.572292+0000","last_unstale":"2024-09-19T05:33:20.925304+0000","last_undegraded":"2024-09-19T05:33:20.925304+0000","last_fullsized":"2024-09-19T05:33:20.925304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:23.479624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576694+0000","last_change":"2024-09-19T05:33:13.518160+0000","last_active":"2024-09-19T05:33:19.576694+0000","last_peered":"2024-09-19T05:33:19.576694+0000","last_clean":"2024-09-19T05:33:19.576694+0000","last_became_active":"2024-09-19T05:33:13.517669+0000","last_became_peered":"2024-09-19T05:33:13.517669+0000","last_unstale":"2024-09-19T05:33:19.576694+0000","last_undegraded":"2024-09-19T05:33:19.576694+0000","last_fullsized":"2024-09-19T05:33:19.576694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.869187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542731+0000","last_change":"2024-09-19T05:33:18.731204+0000","last_active":"2024-09-19T05:33:20.542731+0000","last_peered":"2024-09-19T05:33:20.542731+0000","last_clean":"2024-09-19T05:33:20.542731+0000","last_became_active":"2024-09-19T05:33:18.730150+0000","last_became_peered":"2024-09-19T05:33:18.730150+0000","last_unstale":"2024-09-19T05:33:20.542731+0000","last_undegraded":"2024-09-19T05:33:20.542731+0000","last_fullsized":"2024-09-19T05:33:20.542731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:39.847635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924886+0000","last_change":"2024-09-19T05:33:14.568190+0000","last_active":"2024-09-19T05:33:20.924886+0000","last_peered":"2024-09-19T05:33:20.924886+0000","last_clean":"2024-09-19T05:33:20.924886+0000","last_became_active":"2024-09-19T05:33:14.566383+0000","last_became_peered":"2024-09-19T05:33:14.566383+0000","last_unstale":"2024-09-19T05:33:20.924886+0000","last_undegraded":"2024-09-19T05:33:20.924886+0000","last_fullsized":"2024-09-19T05:33:20.924886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:43.196836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578722+0000","last_change":"2024-09-19T05:33:13.523746+0000","last_active":"2024-09-19T05:33:19.578722+0000","last_peered":"2024-09-19T05:33:19.578722+0000","last_clean":"2024-09-19T05:33:19.578722+0000","last_became_active":"2024-09-19T05:33:13.522995+0000","last_became_peered":"2024-09-19T05:33:13.522995+0000","last_unstale":"2024-09-19T05:33:19.578722+0000","last_undegraded":"2024-09-19T05:33:19.578722+0000","last_fullsized":"2024-09-19T05:33:19.578722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:37.675142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576913+0000","last_change":"2024-09-19T05:33:18.595330+0000","last_active":"2024-09-19T05:33:19.576913+0000","last_peered":"2024-09-19T05:33:19.576913+0000","last_clean":"2024-09-19T05:33:19.576913+0000","last_became_active":"2024-09-19T05:33:18.594314+0000","last_became_peered":"2024-09-19T05:33:18.594314+0000","last_unstale":"2024-09-19T05:33:19.576913+0000","last_undegraded":"2024-09-19T05:33:19.576913+0000","last_fullsized":"2024-09-19T05:33:19.576913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:17.535329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925421+0000","last_change":"2024-09-19T05:33:14.568254+0000","last_active":"2024-09-19T05:33:20.925421+0000","last_peered":"2024-09-19T05:33:20.925421+0000","last_clean":"2024-09-19T05:33:20.925421+0000","last_became_active":"2024-09-19T05:33:14.567525+0000","last_became_peered":"2024-09-19T05:33:14.567525+0000","last_unstale":"2024-09-19T05:33:20.925421+0000","last_undegraded":"2024-09-19T05:33:20.925421+0000","last_fullsized":"2024-09-19T05:33:20.925421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:20.717515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576007+0000","last_change":"2024-09-19T05:33:13.518203+0000","last_active":"2024-09-19T05:33:19.576007+0000","last_peered":"2024-09-19T05:33:19.576007+0000","last_clean":"2024-09-19T05:33:19.576007+0000","last_became_active":"2024-09-19T05:33:13.517450+0000","last_became_peered":"2024-09-19T05:33:13.517450+0000","last_unstale":"2024-09-19T05:33:19.576007+0000","last_undegraded":"2024-09-19T05:33:19.576007+0000","last_fullsized":"2024-09-19T05:33:19.576007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:01.312371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123779+0000","last_change":"2024-09-19T05:33:18.596006+0000","last_active":"2024-09-19T05:33:20.123779+0000","last_peered":"2024-09-19T05:33:20.123779+0000","last_clean":"2024-09-19T05:33:20.123779+0000","last_became_active":"2024-09-19T05:33:18.595625+0000","last_became_peered":"2024-09-19T05:33:18.595625+0000","last_unstale":"2024-09-19T05:33:20.123779+0000","last_undegraded":"2024-09-19T05:33:20.123779+0000","last_fullsized":"2024-09-19T05:33:20.123779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:47.248958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924329+0000","last_change":"2024-09-19T05:33:14.550442+0000","last_active":"2024-09-19T05:33:20.924329+0000","last_peered":"2024-09-19T05:33:20.924329+0000","last_clean":"2024-09-19T05:33:20.924329+0000","last_became_active":"2024-09-19T05:33:14.549648+0000","last_became_peered":"2024-09-19T05:33:14.549648+0000","last_unstale":"2024-09-19T05:33:20.924329+0000","last_undegraded":"2024-09-19T05:33:20.924329+0000","last_fullsized":"2024-09-19T05:33:20.924329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923348+0000","last_change":"2024-09-19T05:33:13.541793+0000","last_active":"2024-09-19T05:33:20.923348+0000","last_peered":"2024-09-19T05:33:20.923348+0000","last_clean":"2024-09-19T05:33:20.923348+0000","last_became_active":"2024-09-19T05:33:13.541034+0000","last_became_peered":"2024-09-19T05:33:13.541034+0000","last_unstale":"2024-09-19T05:33:20.923348+0000","last_undegraded":"2024-09-19T05:33:20.923348+0000","last_fullsized":"2024-09-19T05:33:20.923348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007972+0000","last_change":"2024-09-19T05:33:18.734544+0000","last_active":"2024-09-19T05:33:20.007972+0000","last_peered":"2024-09-19T05:33:20.007972+0000","last_clean":"2024-09-19T05:33:20.007972+0000","last_became_active":"2024-09-19T05:33:18.734217+0000","last_became_peered":"2024-09-19T05:33:18.734217+0000","last_unstale":"2024-09-19T05:33:20.007972+0000","last_undegraded":"2024-09-19T05:33:20.007972+0000","last_fullsized":"2024-09-19T05:33:20.007972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:29.423972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924156+0000","last_change":"2024-09-19T05:33:14.568196+0000","last_active":"2024-09-19T05:33:20.924156+0000","last_peered":"2024-09-19T05:33:20.924156+0000","last_clean":"2024-09-19T05:33:20.924156+0000","last_became_active":"2024-09-19T05:33:14.567764+0000","last_became_peered":"2024-09-19T05:33:14.567764+0000","last_unstale":"2024-09-19T05:33:20.924156+0000","last_undegraded":"2024-09-19T05:33:20.924156+0000","last_fullsized":"2024-09-19T05:33:20.924156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:38.457117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543797+0000","last_change":"2024-09-19T05:33:13.550337+0000","last_active":"2024-09-19T05:33:20.543797+0000","last_peered":"2024-09-19T05:33:20.543797+0000","last_clean":"2024-09-19T05:33:20.543797+0000","last_became_active":"2024-09-19T05:33:13.549450+0000","last_became_peered":"2024-09-19T05:33:13.549450+0000","last_unstale":"2024-09-19T05:33:20.543797+0000","last_undegraded":"2024-09-19T05:33:20.543797+0000","last_fullsized":"2024-09-19T05:33:20.543797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:29.032420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007818+0000","last_change":"2024-09-19T05:33:18.728533+0000","last_active":"2024-09-19T05:33:20.007818+0000","last_peered":"2024-09-19T05:33:20.007818+0000","last_clean":"2024-09-19T05:33:20.007818+0000","last_became_active":"2024-09-19T05:33:18.728056+0000","last_became_peered":"2024-09-19T05:33:18.728056+0000","last_unstale":"2024-09-19T05:33:20.007818+0000","last_undegraded":"2024-09-19T05:33:20.007818+0000","last_fullsized":"2024-09-19T05:33:20.007818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:33.730399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123383+0000","last_change":"2024-09-19T05:33:14.555119+0000","last_active":"2024-09-19T05:33:20.123383+0000","last_peered":"2024-09-19T05:33:20.123383+0000","last_clean":"2024-09-19T05:33:20.123383+0000","last_became_active":"2024-09-19T05:33:14.554798+0000","last_became_peered":"2024-09-19T05:33:14.554798+0000","last_unstale":"2024-09-19T05:33:20.123383+0000","last_undegraded":"2024-09-19T05:33:20.123383+0000","last_fullsized":"2024-09-19T05:33:20.123383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123886+0000","last_change":"2024-09-19T05:33:13.529400+0000","last_active":"2024-09-19T05:33:20.123886+0000","last_peered":"2024-09-19T05:33:20.123886+0000","last_clean":"2024-09-19T05:33:20.123886+0000","last_became_active":"2024-09-19T05:33:13.529106+0000","last_became_peered":"2024-09-19T05:33:13.529106+0000","last_unstale":"2024-09-19T05:33:20.123886+0000","last_undegraded":"2024-09-19T05:33:20.123886+0000","last_fullsized":"2024-09-19T05:33:20.123886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:11.761526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544051+0000","last_change":"2024-09-19T05:33:18.723038+0000","last_active":"2024-09-19T05:33:20.544051+0000","last_peered":"2024-09-19T05:33:20.544051+0000","last_clean":"2024-09-19T05:33:20.544051+0000","last_became_active":"2024-09-19T05:33:18.722087+0000","last_became_peered":"2024-09-19T05:33:18.722087+0000","last_unstale":"2024-09-19T05:33:20.544051+0000","last_undegraded":"2024-09-19T05:33:20.544051+0000","last_fullsized":"2024-09-19T05:33:20.544051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:40.558697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924126+0000","last_change":"2024-09-19T05:33:14.556157+0000","last_active":"2024-09-19T05:33:20.924126+0000","last_peered":"2024-09-19T05:33:20.924126+0000","last_clean":"2024-09-19T05:33:20.924126+0000","last_became_active":"2024-09-19T05:33:14.555055+0000","last_became_peered":"2024-09-19T05:33:14.555055+0000","last_unstale":"2024-09-19T05:33:20.924126+0000","last_undegraded":"2024-09-19T05:33:20.924126+0000","last_fullsized":"2024-09-19T05:33:20.924126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:36.661349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:25.122224+0000","last_change":"2024-09-19T05:33:13.534975+0000","last_active":"2024-09-19T05:33:25.122224+0000","last_peered":"2024-09-19T05:33:25.122224+0000","last_clean":"2024-09-19T05:33:25.122224+0000","last_became_active":"2024-09-19T05:33:13.533864+0000","last_became_peered":"2024-09-19T05:33:13.533864+0000","last_unstale":"2024-09-19T05:33:25.122224+0000","last_undegraded":"2024-09-19T05:33:25.122224+0000","last_fullsized":"2024-09-19T05:33:25.122224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923321+0000","last_change":"2024-09-19T05:33:18.592141+0000","last_active":"2024-09-19T05:33:20.923321+0000","last_peered":"2024-09-19T05:33:20.923321+0000","last_clean":"2024-09-19T05:33:20.923321+0000","last_became_active":"2024-09-19T05:33:18.591748+0000","last_became_peered":"2024-09-19T05:33:18.591748+0000","last_unstale":"2024-09-19T05:33:20.923321+0000","last_undegraded":"2024-09-19T05:33:20.923321+0000","last_fullsized":"2024-09-19T05:33:20.923321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.531745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578732+0000","last_change":"2024-09-19T05:33:14.557457+0000","last_active":"2024-09-19T05:33:19.578732+0000","last_peered":"2024-09-19T05:33:19.578732+0000","last_clean":"2024-09-19T05:33:19.578732+0000","last_became_active":"2024-09-19T05:33:14.556954+0000","last_became_peered":"2024-09-19T05:33:14.556954+0000","last_unstale":"2024-09-19T05:33:19.578732+0000","last_undegraded":"2024-09-19T05:33:19.578732+0000","last_fullsized":"2024-09-19T05:33:19.578732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:46.964162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924088+0000","last_change":"2024-09-19T05:33:13.548294+0000","last_active":"2024-09-19T05:33:20.924088+0000","last_peered":"2024-09-19T05:33:20.924088+0000","last_clean":"2024-09-19T05:33:20.924088+0000","last_became_active":"2024-09-19T05:33:13.547981+0000","last_became_peered":"2024-09-19T05:33:13.547981+0000","last_unstale":"2024-09-19T05:33:20.924088+0000","last_undegraded":"2024-09-19T05:33:20.924088+0000","last_fullsized":"2024-09-19T05:33:20.924088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579238+0000","last_change":"2024-09-19T05:33:18.596736+0000","last_active":"2024-09-19T05:33:19.579238+0000","last_peered":"2024-09-19T05:33:19.579238+0000","last_clean":"2024-09-19T05:33:19.579238+0000","last_became_active":"2024-09-19T05:33:18.594148+0000","last_became_peered":"2024-09-19T05:33:18.594148+0000","last_unstale":"2024-09-19T05:33:19.579238+0000","last_undegraded":"2024-09-19T05:33:19.579238+0000","last_fullsized":"2024-09-19T05:33:19.579238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:47.968935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123796+0000","last_change":"2024-09-19T05:33:14.551870+0000","last_active":"2024-09-19T05:33:20.123796+0000","last_peered":"2024-09-19T05:33:20.123796+0000","last_clean":"2024-09-19T05:33:20.123796+0000","last_became_active":"2024-09-19T05:33:14.551566+0000","last_became_peered":"2024-09-19T05:33:14.551566+0000","last_unstale":"2024-09-19T05:33:20.123796+0000","last_undegraded":"2024-09-19T05:33:20.123796+0000","last_fullsized":"2024-09-19T05:33:20.123796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543615+0000","last_change":"2024-09-19T05:33:13.553089+0000","last_active":"2024-09-19T05:33:20.543615+0000","last_peered":"2024-09-19T05:33:20.543615+0000","last_clean":"2024-09-19T05:33:20.543615+0000","last_became_active":"2024-09-19T05:33:13.552446+0000","last_became_peered":"2024-09-19T05:33:13.552446+0000","last_unstale":"2024-09-19T05:33:20.543615+0000","last_undegraded":"2024-09-19T05:33:20.543615+0000","last_fullsized":"2024-09-19T05:33:20.543615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.869187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007319+0000","last_change":"2024-09-19T05:33:18.595633+0000","last_active":"2024-09-19T05:33:20.007319+0000","last_peered":"2024-09-19T05:33:20.007319+0000","last_clean":"2024-09-19T05:33:20.007319+0000","last_became_active":"2024-09-19T05:33:18.594796+0000","last_became_peered":"2024-09-19T05:33:18.594796+0000","last_unstale":"2024-09-19T05:33:20.007319+0000","last_undegraded":"2024-09-19T05:33:20.007319+0000","last_fullsized":"2024-09-19T05:33:20.007319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:01.766766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543414+0000","last_change":"2024-09-19T05:33:14.562226+0000","last_active":"2024-09-19T05:33:20.543414+0000","last_peered":"2024-09-19T05:33:20.543414+0000","last_clean":"2024-09-19T05:33:20.543414+0000","last_became_active":"2024-09-19T05:33:14.561518+0000","last_became_peered":"2024-09-19T05:33:14.561518+0000","last_unstale":"2024-09-19T05:33:20.543414+0000","last_undegraded":"2024-09-19T05:33:20.543414+0000","last_fullsized":"2024-09-19T05:33:20.543414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:56.884042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926192+0000","last_change":"2024-09-19T05:33:13.554061+0000","last_active":"2024-09-19T05:33:20.926192+0000","last_peered":"2024-09-19T05:33:20.926192+0000","last_clean":"2024-09-19T05:33:20.926192+0000","last_became_active":"2024-09-19T05:33:13.553573+0000","last_became_peered":"2024-09-19T05:33:13.553573+0000","last_unstale":"2024-09-19T05:33:20.926192+0000","last_undegraded":"2024-09-19T05:33:20.926192+0000","last_fullsized":"2024-09-19T05:33:20.926192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007220+0000","last_change":"2024-09-19T05:33:18.728406+0000","last_active":"2024-09-19T05:33:20.007220+0000","last_peered":"2024-09-19T05:33:20.007220+0000","last_clean":"2024-09-19T05:33:20.007220+0000","last_became_active":"2024-09-19T05:33:18.728024+0000","last_became_peered":"2024-09-19T05:33:18.728024+0000","last_unstale":"2024-09-19T05:33:20.007220+0000","last_undegraded":"2024-09-19T05:33:20.007220+0000","last_fullsized":"2024-09-19T05:33:20.007220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:21.487284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123656+0000","last_change":"2024-09-19T05:33:18.731432+0000","last_active":"2024-09-19T05:33:20.123656+0000","last_peered":"2024-09-19T05:33:20.123656+0000","last_clean":"2024-09-19T05:33:20.123656+0000","last_became_active":"2024-09-19T05:33:18.730553+0000","last_became_peered":"2024-09-19T05:33:18.730553+0000","last_unstale":"2024-09-19T05:33:20.123656+0000","last_undegraded":"2024-09-19T05:33:20.123656+0000","last_fullsized":"2024-09-19T05:33:20.123656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:57.747825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922747+0000","last_change":"2024-09-19T05:33:14.528607+0000","last_active":"2024-09-19T05:33:20.922747+0000","last_peered":"2024-09-19T05:33:20.922747+0000","last_clean":"2024-09-19T05:33:20.922747+0000","last_became_active":"2024-09-19T05:33:14.528243+0000","last_became_peered":"2024-09-19T05:33:14.528243+0000","last_unstale":"2024-09-19T05:33:20.922747+0000","last_undegraded":"2024-09-19T05:33:20.922747+0000","last_fullsized":"2024-09-19T05:33:20.922747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542883+0000","last_change":"2024-09-19T05:33:13.550160+0000","last_active":"2024-09-19T05:33:20.542883+0000","last_peered":"2024-09-19T05:33:20.542883+0000","last_clean":"2024-09-19T05:33:20.542883+0000","last_became_active":"2024-09-19T05:33:13.548497+0000","last_became_peered":"2024-09-19T05:33:13.548497+0000","last_unstale":"2024-09-19T05:33:20.542883+0000","last_undegraded":"2024-09-19T05:33:20.542883+0000","last_fullsized":"2024-09-19T05:33:20.542883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:41.939363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926179+0000","last_change":"2024-09-19T05:33:18.598114+0000","last_active":"2024-09-19T05:33:20.926179+0000","last_peered":"2024-09-19T05:33:20.926179+0000","last_clean":"2024-09-19T05:33:20.926179+0000","last_became_active":"2024-09-19T05:33:18.597017+0000","last_became_peered":"2024-09-19T05:33:18.597017+0000","last_unstale":"2024-09-19T05:33:20.926179+0000","last_undegraded":"2024-09-19T05:33:20.926179+0000","last_fullsized":"2024-09-19T05:33:20.926179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:57.960270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007352+0000","last_change":"2024-09-19T05:33:14.521880+0000","last_active":"2024-09-19T05:33:20.007352+0000","last_peered":"2024-09-19T05:33:20.007352+0000","last_clean":"2024-09-19T05:33:20.007352+0000","last_became_active":"2024-09-19T05:33:14.521480+0000","last_became_peered":"2024-09-19T05:33:14.521480+0000","last_unstale":"2024-09-19T05:33:20.007352+0000","last_undegraded":"2024-09-19T05:33:20.007352+0000","last_fullsized":"2024-09-19T05:33:20.007352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007858+0000","last_change":"2024-09-19T05:33:13.536792+0000","last_active":"2024-09-19T05:33:20.007858+0000","last_peered":"2024-09-19T05:33:20.007858+0000","last_clean":"2024-09-19T05:33:20.007858+0000","last_became_active":"2024-09-19T05:33:13.536509+0000","last_became_peered":"2024-09-19T05:33:13.536509+0000","last_unstale":"2024-09-19T05:33:20.007858+0000","last_undegraded":"2024-09-19T05:33:20.007858+0000","last_fullsized":"2024-09-19T05:33:20.007858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:27.720089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924007+0000","last_change":"2024-09-19T05:33:13.541454+0000","last_active":"2024-09-19T05:33:20.924007+0000","last_peered":"2024-09-19T05:33:20.924007+0000","last_clean":"2024-09-19T05:33:20.924007+0000","last_became_active":"2024-09-19T05:33:13.536977+0000","last_became_peered":"2024-09-19T05:33:13.536977+0000","last_unstale":"2024-09-19T05:33:20.924007+0000","last_undegraded":"2024-09-19T05:33:20.924007+0000","last_fullsized":"2024-09-19T05:33:20.924007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:47.982621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123776+0000","last_change":"2024-09-19T05:33:14.547549+0000","last_active":"2024-09-19T05:33:20.123776+0000","last_peered":"2024-09-19T05:33:20.123776+0000","last_clean":"2024-09-19T05:33:20.123776+0000","last_became_active":"2024-09-19T05:33:14.547287+0000","last_became_peered":"2024-09-19T05:33:14.547287+0000","last_unstale":"2024-09-19T05:33:20.123776+0000","last_undegraded":"2024-09-19T05:33:20.123776+0000","last_fullsized":"2024-09-19T05:33:20.123776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576575+0000","last_change":"2024-09-19T05:33:18.605731+0000","last_active":"2024-09-19T05:33:19.576575+0000","last_peered":"2024-09-19T05:33:19.576575+0000","last_clean":"2024-09-19T05:33:19.576575+0000","last_became_active":"2024-09-19T05:33:18.605085+0000","last_became_peered":"2024-09-19T05:33:18.605085+0000","last_unstale":"2024-09-19T05:33:19.576575+0000","last_undegraded":"2024-09-19T05:33:19.576575+0000","last_fullsized":"2024-09-19T05:33:19.576575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:27.605669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007619+0000","last_change":"2024-09-19T05:33:13.525111+0000","last_active":"2024-09-19T05:33:20.007619+0000","last_peered":"2024-09-19T05:33:20.007619+0000","last_clean":"2024-09-19T05:33:20.007619+0000","last_became_active":"2024-09-19T05:33:13.524706+0000","last_became_peered":"2024-09-19T05:33:13.524706+0000","last_unstale":"2024-09-19T05:33:20.007619+0000","last_undegraded":"2024-09-19T05:33:20.007619+0000","last_fullsized":"2024-09-19T05:33:20.007619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:11.761526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577527+0000","last_change":"2024-09-19T05:33:14.530059+0000","last_active":"2024-09-19T05:33:19.577527+0000","last_peered":"2024-09-19T05:33:19.577527+0000","last_clean":"2024-09-19T05:33:19.577527+0000","last_became_active":"2024-09-19T05:33:14.529323+0000","last_became_peered":"2024-09-19T05:33:14.529323+0000","last_unstale":"2024-09-19T05:33:19.577527+0000","last_undegraded":"2024-09-19T05:33:19.577527+0000","last_fullsized":"2024-09-19T05:33:19.577527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:42.202499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007585+0000","last_change":"2024-09-19T05:33:18.597937+0000","last_active":"2024-09-19T05:33:20.007585+0000","last_peered":"2024-09-19T05:33:20.007585+0000","last_clean":"2024-09-19T05:33:20.007585+0000","last_became_active":"2024-09-19T05:33:18.596030+0000","last_became_peered":"2024-09-19T05:33:18.596030+0000","last_unstale":"2024-09-19T05:33:20.007585+0000","last_undegraded":"2024-09-19T05:33:20.007585+0000","last_fullsized":"2024-09-19T05:33:20.007585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.813147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922700+0000","last_change":"2024-09-19T05:33:14.537267+0000","last_active":"2024-09-19T05:33:20.922700+0000","last_peered":"2024-09-19T05:33:20.922700+0000","last_clean":"2024-09-19T05:33:20.922700+0000","last_became_active":"2024-09-19T05:33:14.536536+0000","last_became_peered":"2024-09-19T05:33:14.536536+0000","last_unstale":"2024-09-19T05:33:20.922700+0000","last_undegraded":"2024-09-19T05:33:20.922700+0000","last_fullsized":"2024-09-19T05:33:20.922700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576104+0000","last_change":"2024-09-19T05:33:14.526620+0000","last_active":"2024-09-19T05:33:19.576104+0000","last_peered":"2024-09-19T05:33:19.576104+0000","last_clean":"2024-09-19T05:33:19.576104+0000","last_became_active":"2024-09-19T05:33:14.526328+0000","last_became_peered":"2024-09-19T05:33:14.526328+0000","last_unstale":"2024-09-19T05:33:19.576104+0000","last_undegraded":"2024-09-19T05:33:19.576104+0000","last_fullsized":"2024-09-19T05:33:19.576104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:30.041945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543608+0000","last_change":"2024-09-19T05:33:14.559878+0000","last_active":"2024-09-19T05:33:20.543608+0000","last_peered":"2024-09-19T05:33:20.543608+0000","last_clean":"2024-09-19T05:33:20.543608+0000","last_became_active":"2024-09-19T05:33:14.559351+0000","last_became_peered":"2024-09-19T05:33:14.559351+0000","last_unstale":"2024-09-19T05:33:20.543608+0000","last_undegraded":"2024-09-19T05:33:20.543608+0000","last_fullsized":"2024-09-19T05:33:20.543608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:59.661877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123777+0000","last_change":"2024-09-19T05:33:14.530062+0000","last_active":"2024-09-19T05:33:20.123777+0000","last_peered":"2024-09-19T05:33:20.123777+0000","last_clean":"2024-09-19T05:33:20.123777+0000","last_became_active":"2024-09-19T05:33:14.529783+0000","last_became_peered":"2024-09-19T05:33:14.529783+0000","last_unstale":"2024-09-19T05:33:20.123777+0000","last_undegraded":"2024-09-19T05:33:20.123777+0000","last_fullsized":"2024-09-19T05:33:20.123777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007840+0000","last_change":"2024-09-19T05:33:14.542588+0000","last_active":"2024-09-19T05:33:20.007840+0000","last_peered":"2024-09-19T05:33:20.007840+0000","last_clean":"2024-09-19T05:33:20.007840+0000","last_became_active":"2024-09-19T05:33:14.542329+0000","last_became_peered":"2024-09-19T05:33:14.542329+0000","last_unstale":"2024-09-19T05:33:20.007840+0000","last_undegraded":"2024-09-19T05:33:20.007840+0000","last_fullsized":"2024-09-19T05:33:20.007840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923626+0000","last_change":"2024-09-19T05:33:14.526902+0000","last_active":"2024-09-19T05:33:20.923626+0000","last_peered":"2024-09-19T05:33:20.923626+0000","last_clean":"2024-09-19T05:33:20.923626+0000","last_became_active":"2024-09-19T05:33:14.526640+0000","last_became_peered":"2024-09-19T05:33:14.526640+0000","last_unstale":"2024-09-19T05:33:20.923626+0000","last_undegraded":"2024-09-19T05:33:20.923626+0000","last_fullsized":"2024-09-19T05:33:20.923626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926202+0000","last_change":"2024-09-19T05:33:14.559155+0000","last_active":"2024-09-19T05:33:20.926202+0000","last_peered":"2024-09-19T05:33:20.926202+0000","last_clean":"2024-09-19T05:33:20.926202+0000","last_became_active":"2024-09-19T05:33:14.558755+0000","last_became_peered":"2024-09-19T05:33:14.558755+0000","last_unstale":"2024-09-19T05:33:20.926202+0000","last_undegraded":"2024-09-19T05:33:20.926202+0000","last_fullsized":"2024-09-19T05:33:20.926202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.008000+0000","last_change":"2024-09-19T05:33:14.541132+0000","last_active":"2024-09-19T05:33:20.008000+0000","last_peered":"2024-09-19T05:33:20.008000+0000","last_clean":"2024-09-19T05:33:20.008000+0000","last_became_active":"2024-09-19T05:33:14.540863+0000","last_became_peered":"2024-09-19T05:33:14.540863+0000","last_unstale":"2024-09-19T05:33:20.008000+0000","last_undegraded":"2024-09-19T05:33:20.008000+0000","last_fullsized":"2024-09-19T05:33:20.008000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:20.717515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542901+0000","last_change":"2024-09-19T05:33:14.533210+0000","last_active":"2024-09-19T05:33:20.542901+0000","last_peered":"2024-09-19T05:33:20.542901+0000","last_clean":"2024-09-19T05:33:20.542901+0000","last_became_active":"2024-09-19T05:33:14.532432+0000","last_became_peered":"2024-09-19T05:33:14.532432+0000","last_unstale":"2024-09-19T05:33:20.542901+0000","last_undegraded":"2024-09-19T05:33:20.542901+0000","last_fullsized":"2024-09-19T05:33:20.542901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:52.178220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007605+0000","last_change":"2024-09-19T05:33:14.547002+0000","last_active":"2024-09-19T05:33:20.007605+0000","last_peered":"2024-09-19T05:33:20.007605+0000","last_clean":"2024-09-19T05:33:20.007605+0000","last_became_active":"2024-09-19T05:33:14.546737+0000","last_became_peered":"2024-09-19T05:33:14.546737+0000","last_unstale":"2024-09-19T05:33:20.007605+0000","last_undegraded":"2024-09-19T05:33:20.007605+0000","last_fullsized":"2024-09-19T05:33:20.007605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:45.387641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543418+0000","last_change":"2024-09-19T05:33:14.568172+0000","last_active":"2024-09-19T05:33:20.543418+0000","last_peered":"2024-09-19T05:33:20.543418+0000","last_clean":"2024-09-19T05:33:20.543418+0000","last_became_active":"2024-09-19T05:33:14.567760+0000","last_became_peered":"2024-09-19T05:33:14.567760+0000","last_unstale":"2024-09-19T05:33:20.543418+0000","last_undegraded":"2024-09-19T05:33:20.543418+0000","last_fullsized":"2024-09-19T05:33:20.543418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:30.905148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123485+0000","last_change":"2024-09-19T05:33:14.558783+0000","last_active":"2024-09-19T05:33:20.123485+0000","last_peered":"2024-09-19T05:33:20.123485+0000","last_clean":"2024-09-19T05:33:20.123485+0000","last_became_active":"2024-09-19T05:33:14.558567+0000","last_became_peered":"2024-09-19T05:33:14.558567+0000","last_unstale":"2024-09-19T05:33:20.123485+0000","last_undegraded":"2024-09-19T05:33:20.123485+0000","last_fullsized":"2024-09-19T05:33:20.123485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923405+0000","last_change":"2024-09-19T05:33:14.551691+0000","last_active":"2024-09-19T05:33:20.923405+0000","last_peered":"2024-09-19T05:33:20.923405+0000","last_clean":"2024-09-19T05:33:20.923405+0000","last_became_active":"2024-09-19T05:33:14.549872+0000","last_became_peered":"2024-09-19T05:33:14.549872+0000","last_unstale":"2024-09-19T05:33:20.923405+0000","last_undegraded":"2024-09-19T05:33:20.923405+0000","last_fullsized":"2024-09-19T05:33:20.923405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924685+0000","last_change":"2024-09-19T05:33:14.556297+0000","last_active":"2024-09-19T05:33:20.924685+0000","last_peered":"2024-09-19T05:33:20.924685+0000","last_clean":"2024-09-19T05:33:20.924685+0000","last_became_active":"2024-09-19T05:33:14.555403+0000","last_became_peered":"2024-09-19T05:33:14.555403+0000","last_unstale":"2024-09-19T05:33:20.924685+0000","last_undegraded":"2024-09-19T05:33:20.924685+0000","last_fullsized":"2024-09-19T05:33:20.924685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:43.916813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576705+0000","last_change":"2024-09-19T05:33:14.535228+0000","last_active":"2024-09-19T05:33:19.576705+0000","last_peered":"2024-09-19T05:33:19.576705+0000","last_clean":"2024-09-19T05:33:19.576705+0000","last_became_active":"2024-09-19T05:33:14.534931+0000","last_became_peered":"2024-09-19T05:33:14.534931+0000","last_unstale":"2024-09-19T05:33:19.576705+0000","last_undegraded":"2024-09-19T05:33:19.576705+0000","last_fullsized":"2024-09-19T05:33:19.576705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:12.979751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544152+0000","last_change":"2024-09-19T05:33:14.565336+0000","last_active":"2024-09-19T05:33:20.544152+0000","last_peered":"2024-09-19T05:33:20.544152+0000","last_clean":"2024-09-19T05:33:20.544152+0000","last_became_active":"2024-09-19T05:33:14.564756+0000","last_became_peered":"2024-09-19T05:33:14.564756+0000","last_unstale":"2024-09-19T05:33:20.544152+0000","last_undegraded":"2024-09-19T05:33:20.544152+0000","last_fullsized":"2024-09-19T05:33:20.544152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:07.067023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542591+0000","last_change":"2024-09-19T05:33:14.552325+0000","last_active":"2024-09-19T05:33:20.542591+0000","last_peered":"2024-09-19T05:33:20.542591+0000","last_clean":"2024-09-19T05:33:20.542591+0000","last_became_active":"2024-09-19T05:33:14.551613+0000","last_became_peered":"2024-09-19T05:33:14.551613+0000","last_unstale":"2024-09-19T05:33:20.542591+0000","last_undegraded":"2024-09-19T05:33:20.542591+0000","last_fullsized":"2024-09-19T05:33:20.542591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:07.394046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922935+0000","last_change":"2024-09-19T05:33:14.546485+0000","last_active":"2024-09-19T05:33:20.922935+0000","last_peered":"2024-09-19T05:33:20.922935+0000","last_clean":"2024-09-19T05:33:20.922935+0000","last_became_active":"2024-09-19T05:33:14.546193+0000","last_became_peered":"2024-09-19T05:33:14.546193+0000","last_unstale":"2024-09-19T05:33:20.922935+0000","last_undegraded":"2024-09-19T05:33:20.922935+0000","last_fullsized":"2024-09-19T05:33:20.922935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123351+0000","last_change":"2024-09-19T05:33:14.531122+0000","last_active":"2024-09-19T05:33:20.123351+0000","last_peered":"2024-09-19T05:33:20.123351+0000","last_clean":"2024-09-19T05:33:20.123351+0000","last_became_active":"2024-09-19T05:33:14.530715+0000","last_became_peered":"2024-09-19T05:33:14.530715+0000","last_unstale":"2024-09-19T05:33:20.123351+0000","last_undegraded":"2024-09-19T05:33:20.123351+0000","last_fullsized":"2024-09-19T05:33:20.123351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:45.387641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007456+0000","last_change":"2024-09-19T05:33:14.560886+0000","last_active":"2024-09-19T05:33:20.007456+0000","last_peered":"2024-09-19T05:33:20.007456+0000","last_clean":"2024-09-19T05:33:20.007456+0000","last_became_active":"2024-09-19T05:33:14.560569+0000","last_became_peered":"2024-09-19T05:33:14.560569+0000","last_unstale":"2024-09-19T05:33:20.007456+0000","last_undegraded":"2024-09-19T05:33:20.007456+0000","last_fullsized":"2024-09-19T05:33:20.007456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578400+0000","last_change":"2024-09-19T05:33:14.539186+0000","last_active":"2024-09-19T05:33:19.578400+0000","last_peered":"2024-09-19T05:33:19.578400+0000","last_clean":"2024-09-19T05:33:19.578400+0000","last_became_active":"2024-09-19T05:33:14.538758+0000","last_became_peered":"2024-09-19T05:33:14.538758+0000","last_unstale":"2024-09-19T05:33:19.578400+0000","last_undegraded":"2024-09-19T05:33:19.578400+0000","last_fullsized":"2024-09-19T05:33:19.578400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:59.297383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925456+0000","last_change":"2024-09-19T05:33:14.568844+0000","last_active":"2024-09-19T05:33:20.925456+0000","last_peered":"2024-09-19T05:33:20.925456+0000","last_clean":"2024-09-19T05:33:20.925456+0000","last_became_active":"2024-09-19T05:33:14.565254+0000","last_became_peered":"2024-09-19T05:33:14.565254+0000","last_unstale":"2024-09-19T05:33:20.925456+0000","last_undegraded":"2024-09-19T05:33:20.925456+0000","last_fullsized":"2024-09-19T05:33:20.925456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926051+0000","last_change":"2024-09-19T05:33:14.561841+0000","last_active":"2024-09-19T05:33:20.926051+0000","last_peered":"2024-09-19T05:33:20.926051+0000","last_clean":"2024-09-19T05:33:20.926051+0000","last_became_active":"2024-09-19T05:33:14.561439+0000","last_became_peered":"2024-09-19T05:33:14.561439+0000","last_unstale":"2024-09-19T05:33:20.926051+0000","last_undegraded":"2024-09-19T05:33:20.926051+0000","last_fullsized":"2024-09-19T05:33:20.926051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925143+0000","last_change":"2024-09-19T05:33:14.573138+0000","last_active":"2024-09-19T05:33:20.925143+0000","last_peered":"2024-09-19T05:33:20.925143+0000","last_clean":"2024-09-19T05:33:20.925143+0000","last_became_active":"2024-09-19T05:33:14.564119+0000","last_became_peered":"2024-09-19T05:33:14.564119+0000","last_unstale":"2024-09-19T05:33:20.925143+0000","last_undegraded":"2024-09-19T05:33:20.925143+0000","last_fullsized":"2024-09-19T05:33:20.925143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:53.695703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006962+0000","last_change":"2024-09-19T05:33:14.528043+0000","last_active":"2024-09-19T05:33:20.006962+0000","last_peered":"2024-09-19T05:33:20.006962+0000","last_clean":"2024-09-19T05:33:20.006962+0000","last_became_active":"2024-09-19T05:33:14.527737+0000","last_became_peered":"2024-09-19T05:33:14.527737+0000","last_unstale":"2024-09-19T05:33:20.006962+0000","last_undegraded":"2024-09-19T05:33:20.006962+0000","last_fullsized":"2024-09-19T05:33:20.006962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:29.911108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925350+0000","last_change":"2024-09-19T05:33:14.555049+0000","last_active":"2024-09-19T05:33:20.925350+0000","last_peered":"2024-09-19T05:33:20.925350+0000","last_clean":"2024-09-19T05:33:20.925350+0000","last_became_active":"2024-09-19T05:33:14.554452+0000","last_became_peered":"2024-09-19T05:33:14.554452+0000","last_unstale":"2024-09-19T05:33:20.925350+0000","last_undegraded":"2024-09-19T05:33:20.925350+0000","last_fullsized":"2024-09-19T05:33:20.925350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543115+0000","last_change":"2024-09-19T05:33:14.562090+0000","last_active":"2024-09-19T05:33:20.543115+0000","last_peered":"2024-09-19T05:33:20.543115+0000","last_clean":"2024-09-19T05:33:20.543115+0000","last_became_active":"2024-09-19T05:33:14.561559+0000","last_became_peered":"2024-09-19T05:33:14.561559+0000","last_unstale":"2024-09-19T05:33:20.543115+0000","last_undegraded":"2024-09-19T05:33:20.543115+0000","last_fullsized":"2024-09-19T05:33:20.543115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:53.148319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923829+0000","last_change":"2024-09-19T05:33:14.558005+0000","last_active":"2024-09-19T05:33:20.923829+0000","last_peered":"2024-09-19T05:33:20.923829+0000","last_clean":"2024-09-19T05:33:20.923829+0000","last_became_active":"2024-09-19T05:33:14.556969+0000","last_became_peered":"2024-09-19T05:33:14.556969+0000","last_unstale":"2024-09-19T05:33:20.923829+0000","last_undegraded":"2024-09-19T05:33:20.923829+0000","last_fullsized":"2024-09-19T05:33:20.923829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:28.714509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543428+0000","last_change":"2024-09-19T05:33:14.562103+0000","last_active":"2024-09-19T05:33:20.543428+0000","last_peered":"2024-09-19T05:33:20.543428+0000","last_clean":"2024-09-19T05:33:20.543428+0000","last_became_active":"2024-09-19T05:33:14.561395+0000","last_became_peered":"2024-09-19T05:33:14.561395+0000","last_unstale":"2024-09-19T05:33:20.543428+0000","last_undegraded":"2024-09-19T05:33:20.543428+0000","last_fullsized":"2024-09-19T05:33:20.543428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:49.601339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123567+0000","last_change":"2024-09-19T05:33:14.523507+0000","last_active":"2024-09-19T05:33:20.123567+0000","last_peered":"2024-09-19T05:33:20.123567+0000","last_clean":"2024-09-19T05:33:20.123567+0000","last_became_active":"2024-09-19T05:33:14.523206+0000","last_became_peered":"2024-09-19T05:33:14.523206+0000","last_unstale":"2024-09-19T05:33:20.123567+0000","last_undegraded":"2024-09-19T05:33:20.123567+0000","last_fullsized":"2024-09-19T05:33:20.123567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924802+0000","last_change":"2024-09-19T05:33:14.537324+0000","last_active":"2024-09-19T05:33:20.924802+0000","last_peered":"2024-09-19T05:33:20.924802+0000","last_clean":"2024-09-19T05:33:20.924802+0000","last_became_active":"2024-09-19T05:33:14.536850+0000","last_became_peered":"2024-09-19T05:33:14.536850+0000","last_unstale":"2024-09-19T05:33:20.924802+0000","last_undegraded":"2024-09-19T05:33:20.924802+0000","last_fullsized":"2024-09-19T05:33:20.924802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924919+0000","last_change":"2024-09-19T05:33:14.559373+0000","last_active":"2024-09-19T05:33:20.924919+0000","last_peered":"2024-09-19T05:33:20.924919+0000","last_clean":"2024-09-19T05:33:20.924919+0000","last_became_active":"2024-09-19T05:33:14.558720+0000","last_became_peered":"2024-09-19T05:33:14.558720+0000","last_unstale":"2024-09-19T05:33:20.924919+0000","last_undegraded":"2024-09-19T05:33:20.924919+0000","last_fullsized":"2024-09-19T05:33:20.924919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:53.908148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":694435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":103611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":694491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:33:31.996 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:33:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efcab3c5640 1 Processor -- start 2024-09-19T05:33:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efcab3c5640 1 -- start start 2024-09-19T05:33:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efcab3c5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efca4161da0 0x7efca40d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efcab3c5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efca40d0160 0x7efca40d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efcab3c5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca40d05d0 con 0x7efca40d0e80 2024-09-19T05:33:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efcab3c5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7efca40d1830 con 0x7efca4161da0 2024-09-19T05:33:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efcab3c5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7efca40d0840 con 0x7efca40d0160 2024-09-19T05:33:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efca9161640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efca4161da0 0x7efca40d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efca9161640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efca4161da0 0x7efca40d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34700/0 (socket says 172.21.15.67:34700) 2024-09-19T05:33:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efca9161640 1 -- 172.21.15.67:0/1633483841 learned_addr learned my addr 172.21.15.67:0/1633483841 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efca9161640 1 -- 172.21.15.67:0/1633483841 >> v2:172.21.15.97:3300/0 conn(0x7efca40d0160 msgr2=0x7efca40d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efca9161640 1 --2- 172.21.15.67:0/1633483841 >> v2:172.21.15.97:3300/0 conn(0x7efca40d0160 0x7efca40d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efca9161640 1 -- 172.21.15.67:0/1633483841 >> v1:172.21.15.97:6789/0 conn(0x7efca40d0e80 legacy=0x7efca40b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.154+0000 7efca9161640 1 -- 172.21.15.67:0/1633483841 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca40d4d40 con 0x7efca4161da0 2024-09-19T05:33:32.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9161640 1 --2- 172.21.15.67:0/1633483841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca4161da0 0x7efca40d1af0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efca406cad0 tx=0x7efca001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344aeb6ff4231750 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:32.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efc9bfff640 1 -- 172.21.15.67:0/1633483841 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca00b1070 con 0x7efca4161da0 2024-09-19T05:33:32.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efc9bfff640 1 -- 172.21.15.67:0/1633483841 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca00ac630 con 0x7efca4161da0 2024-09-19T05:33:32.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efc9bfff640 1 -- 172.21.15.67:0/1633483841 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca00a8050 con 0x7efca4161da0 2024-09-19T05:33:32.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- 172.21.15.67:0/1633483841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca4161da0 msgr2=0x7efca40d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 --2- 172.21.15.67:0/1633483841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca4161da0 0x7efca40d1af0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efca406cad0 tx=0x7efca001c4e0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- 172.21.15.67:0/1633483841 shutdown_connections 2024-09-19T05:33:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 --2- 172.21.15.67:0/1633483841 >> v2:172.21.15.97:3300/0 conn(0x7efca40d0160 0x7efca40d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 --2- 172.21.15.67:0/1633483841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca4161da0 0x7efca40d1af0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- 172.21.15.67:0/1633483841 >> 172.21.15.67:0/1633483841 conn(0x7efca408bfc0 msgr2=0x7efca40d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- 172.21.15.67:0/1633483841 shutdown_connections 2024-09-19T05:33:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- 172.21.15.67:0/1633483841 wait complete. 2024-09-19T05:33:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 Processor -- start 2024-09-19T05:33:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- start start 2024-09-19T05:33:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca40d0160 0x7efca40ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca40d0e80 0x7efca406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efca4161da0 0x7efca415fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efca4162180 con 0x7efca40d0160 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efca40b5d00 con 0x7efca40d0e80 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efca40b50e0 con 0x7efca4161da0 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9161640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca40d0160 0x7efca40ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9161640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca40d0160 0x7efca40ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34708/0 (socket says 172.21.15.67:34708) 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9161640 1 -- 172.21.15.67:0/3152451842 learned_addr learned my addr 172.21.15.67:0/3152451842 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca8960640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca40d0e80 0x7efca406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9962640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efca4161da0 0x7efca415fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9161640 1 -- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efca4161da0 msgr2=0x7efca415fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9161640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efca4161da0 0x7efca415fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9161640 1 -- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca40d0e80 msgr2=0x7efca406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9161640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca40d0e80 0x7efca406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9161640 1 -- 172.21.15.67:0/3152451842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca406eaf0 con 0x7efca40d0160 2024-09-19T05:33:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca8960640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca40d0e80 0x7efca406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efca9161640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca40d0160 0x7efca40ce010 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efca00af040 tx=0x7efca0019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efc99ffb640 1 -- 172.21.15.67:0/3152451842 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca00bc070 con 0x7efca40d0160 2024-09-19T05:33:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efc99ffb640 1 -- 172.21.15.67:0/3152451842 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca00b7430 con 0x7efca40d0160 2024-09-19T05:33:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- 172.21.15.67:0/3152451842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca40cccf0 con 0x7efca40d0160 2024-09-19T05:33:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efc99ffb640 1 -- 172.21.15.67:0/3152451842 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca00b1040 con 0x7efca40d0160 2024-09-19T05:33:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.158+0000 7efcab3c5640 1 -- 172.21.15.67:0/3152451842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca40cd2b0 con 0x7efca40d0160 2024-09-19T05:33:32.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.162+0000 7efcab3c5640 1 -- 172.21.15.67:0/3152451842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca4068ea0 con 0x7efca40d0160 2024-09-19T05:33:32.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.162+0000 7efc99ffb640 1 -- 172.21.15.67:0/3152451842 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efca00bf070 con 0x7efca40d0160 2024-09-19T05:33:32.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.162+0000 7efc99ffb640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc880678c0 0x7efc88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.162+0000 7efc99ffb640 1 -- 172.21.15.67:0/3152451842 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efca011f850 con 0x7efca40d0160 2024-09-19T05:33:32.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.162+0000 7efca8960640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc880678c0 0x7efc88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.162+0000 7efca8960640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc880678c0 0x7efc88069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc940016e0 tx=0x7efc94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:32.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.166+0000 7efc99ffb640 1 -- 172.21.15.67:0/3152451842 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7efca00160d0 con 0x7efca40d0160 2024-09-19T05:33:32.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.318+0000 7efcab3c5640 1 -- 172.21.15.67:0/3152451842 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efca40b5470 con 0x7efc880678c0 2024-09-19T05:33:32.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.342+0000 7efc99ffb640 1 -- 172.21.15.67:0/3152451842 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7efca40b5470 con 0x7efc880678c0 2024-09-19T05:33:32.350 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:32.353 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:33:32.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 -- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc880678c0 msgr2=0x7efc88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc880678c0 0x7efc88069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc940016e0 tx=0x7efc94009040 comp rx=0 tx=0).stop 2024-09-19T05:33:32.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 -- 172.21.15.67:0/3152451842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca40d0160 msgr2=0x7efca40ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca40d0160 0x7efca40ce010 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efca00af040 tx=0x7efca0019280 comp rx=0 tx=0).stop 2024-09-19T05:33:32.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 -- 172.21.15.67:0/3152451842 shutdown_connections 2024-09-19T05:33:32.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc880678c0 0x7efc88069d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efca4161da0 0x7efca415fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca40d0e80 0x7efca406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 --2- 172.21.15.67:0/3152451842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efca40d0160 0x7efca40ce010 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 -- 172.21.15.67:0/3152451842 >> 172.21.15.67:0/3152451842 conn(0x7efca408bfc0 msgr2=0x7efca40b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:32.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 -- 172.21.15.67:0/3152451842 shutdown_connections 2024-09-19T05:33:32.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.346+0000 7efcab3c5640 1 -- 172.21.15.67:0/3152451842 wait complete. 2024-09-19T05:33:32.367 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-19T05:33:31.110865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219496,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755224,"statfs":{"total":773094113280,"available":772869349376,"internally_reserved":0,"allocated":3350528,"data_stored":2017900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.537480"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123907+0000","last_change":"2024-09-19T05:33:13.530341+0000","last_active":"2024-09-19T05:33:20.123907+0000","last_peered":"2024-09-19T05:33:20.123907+0000","last_clean":"2024-09-19T05:33:20.123907+0000","last_became_active":"2024-09-19T05:33:13.530048+0000","last_became_peered":"2024-09-19T05:33:13.530048+0000","last_unstale":"2024-09-19T05:33:20.123907+0000","last_undegraded":"2024-09-19T05:33:20.123907+0000","last_fullsized":"2024-09-19T05:33:20.123907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:42.052958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007572+0000","last_change":"2024-09-19T05:33:14.561113+0000","last_active":"2024-09-19T05:33:20.007572+0000","last_peered":"2024-09-19T05:33:20.007572+0000","last_clean":"2024-09-19T05:33:20.007572+0000","last_became_active":"2024-09-19T05:33:14.560582+0000","last_became_peered":"2024-09-19T05:33:14.560582+0000","last_unstale":"2024-09-19T05:33:20.007572+0000","last_undegraded":"2024-09-19T05:33:20.007572+0000","last_fullsized":"2024-09-19T05:33:20.007572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006991+0000","last_change":"2024-09-19T05:33:18.730325+0000","last_active":"2024-09-19T05:33:20.006991+0000","last_peered":"2024-09-19T05:33:20.006991+0000","last_clean":"2024-09-19T05:33:20.006991+0000","last_became_active":"2024-09-19T05:33:18.729806+0000","last_became_peered":"2024-09-19T05:33:18.729806+0000","last_unstale":"2024-09-19T05:33:20.006991+0000","last_undegraded":"2024-09-19T05:33:20.006991+0000","last_fullsized":"2024-09-19T05:33:20.006991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:39.340032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007739+0000","last_change":"2024-09-19T05:33:13.523215+0000","last_active":"2024-09-19T05:33:20.007739+0000","last_peered":"2024-09-19T05:33:20.007739+0000","last_clean":"2024-09-19T05:33:20.007739+0000","last_became_active":"2024-09-19T05:33:13.522889+0000","last_became_peered":"2024-09-19T05:33:13.522889+0000","last_unstale":"2024-09-19T05:33:20.007739+0000","last_undegraded":"2024-09-19T05:33:20.007739+0000","last_fullsized":"2024-09-19T05:33:20.007739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:42.052958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123695+0000","last_change":"2024-09-19T05:33:14.551843+0000","last_active":"2024-09-19T05:33:20.123695+0000","last_peered":"2024-09-19T05:33:20.123695+0000","last_clean":"2024-09-19T05:33:20.123695+0000","last_became_active":"2024-09-19T05:33:14.551518+0000","last_became_peered":"2024-09-19T05:33:14.551518+0000","last_unstale":"2024-09-19T05:33:20.123695+0000","last_undegraded":"2024-09-19T05:33:20.123695+0000","last_fullsized":"2024-09-19T05:33:20.123695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577133+0000","last_change":"2024-09-19T05:33:18.599217+0000","last_active":"2024-09-19T05:33:19.577133+0000","last_peered":"2024-09-19T05:33:19.577133+0000","last_clean":"2024-09-19T05:33:19.577133+0000","last_became_active":"2024-09-19T05:33:18.598214+0000","last_became_peered":"2024-09-19T05:33:18.598214+0000","last_unstale":"2024-09-19T05:33:19.577133+0000","last_undegraded":"2024-09-19T05:33:19.577133+0000","last_fullsized":"2024-09-19T05:33:19.577133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:34.548847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924522+0000","last_change":"2024-09-19T05:33:13.543770+0000","last_active":"2024-09-19T05:33:20.924522+0000","last_peered":"2024-09-19T05:33:20.924522+0000","last_clean":"2024-09-19T05:33:20.924522+0000","last_became_active":"2024-09-19T05:33:13.543056+0000","last_became_peered":"2024-09-19T05:33:13.543056+0000","last_unstale":"2024-09-19T05:33:20.924522+0000","last_undegraded":"2024-09-19T05:33:20.924522+0000","last_fullsized":"2024-09-19T05:33:20.924522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543508+0000","last_change":"2024-09-19T05:33:14.570231+0000","last_active":"2024-09-19T05:33:20.543508+0000","last_peered":"2024-09-19T05:33:20.543508+0000","last_clean":"2024-09-19T05:33:20.543508+0000","last_became_active":"2024-09-19T05:33:14.569664+0000","last_became_peered":"2024-09-19T05:33:14.569664+0000","last_unstale":"2024-09-19T05:33:20.543508+0000","last_undegraded":"2024-09-19T05:33:20.543508+0000","last_fullsized":"2024-09-19T05:33:20.543508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.290827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577443+0000","last_change":"2024-09-19T05:33:18.596831+0000","last_active":"2024-09-19T05:33:19.577443+0000","last_peered":"2024-09-19T05:33:19.577443+0000","last_clean":"2024-09-19T05:33:19.577443+0000","last_became_active":"2024-09-19T05:33:18.595733+0000","last_became_peered":"2024-09-19T05:33:18.595733+0000","last_unstale":"2024-09-19T05:33:19.577443+0000","last_undegraded":"2024-09-19T05:33:19.577443+0000","last_fullsized":"2024-09-19T05:33:19.577443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:32.766631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924142+0000","last_change":"2024-09-19T05:33:13.555869+0000","last_active":"2024-09-19T05:33:20.924142+0000","last_peered":"2024-09-19T05:33:20.924142+0000","last_clean":"2024-09-19T05:33:20.924142+0000","last_became_active":"2024-09-19T05:33:13.555335+0000","last_became_peered":"2024-09-19T05:33:13.555335+0000","last_unstale":"2024-09-19T05:33:20.924142+0000","last_undegraded":"2024-09-19T05:33:20.924142+0000","last_fullsized":"2024-09-19T05:33:20.924142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.724638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543769+0000","last_change":"2024-09-19T05:33:14.570470+0000","last_active":"2024-09-19T05:33:20.543769+0000","last_peered":"2024-09-19T05:33:20.543769+0000","last_clean":"2024-09-19T05:33:20.543769+0000","last_became_active":"2024-09-19T05:33:14.569698+0000","last_became_peered":"2024-09-19T05:33:14.569698+0000","last_unstale":"2024-09-19T05:33:20.543769+0000","last_undegraded":"2024-09-19T05:33:20.543769+0000","last_fullsized":"2024-09-19T05:33:20.543769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:06.821907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577368+0000","last_change":"2024-09-19T05:33:18.595934+0000","last_active":"2024-09-19T05:33:19.577368+0000","last_peered":"2024-09-19T05:33:19.577368+0000","last_clean":"2024-09-19T05:33:19.577368+0000","last_became_active":"2024-09-19T05:33:18.594894+0000","last_became_peered":"2024-09-19T05:33:18.594894+0000","last_unstale":"2024-09-19T05:33:19.577368+0000","last_undegraded":"2024-09-19T05:33:19.577368+0000","last_fullsized":"2024-09-19T05:33:19.577368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:40.713471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923638+0000","last_change":"2024-09-19T05:33:14.550250+0000","last_active":"2024-09-19T05:33:20.923638+0000","last_peered":"2024-09-19T05:33:20.923638+0000","last_clean":"2024-09-19T05:33:20.923638+0000","last_became_active":"2024-09-19T05:33:14.549364+0000","last_became_peered":"2024-09-19T05:33:14.549364+0000","last_unstale":"2024-09-19T05:33:20.923638+0000","last_undegraded":"2024-09-19T05:33:20.923638+0000","last_fullsized":"2024-09-19T05:33:20.923638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924425+0000","last_change":"2024-09-19T05:33:13.539570+0000","last_active":"2024-09-19T05:33:20.924425+0000","last_peered":"2024-09-19T05:33:20.924425+0000","last_clean":"2024-09-19T05:33:20.924425+0000","last_became_active":"2024-09-19T05:33:13.538888+0000","last_became_peered":"2024-09-19T05:33:13.538888+0000","last_unstale":"2024-09-19T05:33:20.924425+0000","last_undegraded":"2024-09-19T05:33:20.924425+0000","last_fullsized":"2024-09-19T05:33:20.924425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:45.954638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579051+0000","last_change":"2024-09-19T05:33:18.592794+0000","last_active":"2024-09-19T05:33:19.579051+0000","last_peered":"2024-09-19T05:33:19.579051+0000","last_clean":"2024-09-19T05:33:19.579051+0000","last_became_active":"2024-09-19T05:33:18.591024+0000","last_became_peered":"2024-09-19T05:33:18.591024+0000","last_unstale":"2024-09-19T05:33:19.579051+0000","last_undegraded":"2024-09-19T05:33:19.579051+0000","last_fullsized":"2024-09-19T05:33:19.579051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:57.960270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007498+0000","last_change":"2024-09-19T05:33:14.521242+0000","last_active":"2024-09-19T05:33:20.007498+0000","last_peered":"2024-09-19T05:33:20.007498+0000","last_clean":"2024-09-19T05:33:20.007498+0000","last_became_active":"2024-09-19T05:33:14.520972+0000","last_became_peered":"2024-09-19T05:33:14.520972+0000","last_unstale":"2024-09-19T05:33:20.007498+0000","last_undegraded":"2024-09-19T05:33:20.007498+0000","last_fullsized":"2024-09-19T05:33:20.007498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923376+0000","last_change":"2024-09-19T05:33:13.519454+0000","last_active":"2024-09-19T05:33:20.923376+0000","last_peered":"2024-09-19T05:33:20.923376+0000","last_clean":"2024-09-19T05:33:20.923376+0000","last_became_active":"2024-09-19T05:33:13.518870+0000","last_became_peered":"2024-09-19T05:33:13.518870+0000","last_unstale":"2024-09-19T05:33:20.923376+0000","last_undegraded":"2024-09-19T05:33:20.923376+0000","last_fullsized":"2024-09-19T05:33:20.923376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.724638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579015+0000","last_change":"2024-09-19T05:33:18.604812+0000","last_active":"2024-09-19T05:33:19.579015+0000","last_peered":"2024-09-19T05:33:19.579015+0000","last_clean":"2024-09-19T05:33:19.579015+0000","last_became_active":"2024-09-19T05:33:18.603949+0000","last_became_peered":"2024-09-19T05:33:18.603949+0000","last_unstale":"2024-09-19T05:33:19.579015+0000","last_undegraded":"2024-09-19T05:33:19.579015+0000","last_fullsized":"2024-09-19T05:33:19.579015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:42.509239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007398+0000","last_change":"2024-09-19T05:33:14.530704+0000","last_active":"2024-09-19T05:33:20.007398+0000","last_peered":"2024-09-19T05:33:20.007398+0000","last_clean":"2024-09-19T05:33:20.007398+0000","last_became_active":"2024-09-19T05:33:14.530029+0000","last_became_peered":"2024-09-19T05:33:14.530029+0000","last_unstale":"2024-09-19T05:33:20.007398+0000","last_undegraded":"2024-09-19T05:33:20.007398+0000","last_fullsized":"2024-09-19T05:33:20.007398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922903+0000","last_change":"2024-09-19T05:33:13.536984+0000","last_active":"2024-09-19T05:33:20.922903+0000","last_peered":"2024-09-19T05:33:20.922903+0000","last_clean":"2024-09-19T05:33:20.922903+0000","last_became_active":"2024-09-19T05:33:13.536584+0000","last_became_peered":"2024-09-19T05:33:13.536584+0000","last_unstale":"2024-09-19T05:33:20.922903+0000","last_undegraded":"2024-09-19T05:33:20.922903+0000","last_fullsized":"2024-09-19T05:33:20.922903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924954+0000","last_change":"2024-09-19T05:33:18.731101+0000","last_active":"2024-09-19T05:33:20.924954+0000","last_peered":"2024-09-19T05:33:20.924954+0000","last_clean":"2024-09-19T05:33:20.924954+0000","last_became_active":"2024-09-19T05:33:18.730688+0000","last_became_peered":"2024-09-19T05:33:18.730688+0000","last_unstale":"2024-09-19T05:33:20.924954+0000","last_undegraded":"2024-09-19T05:33:20.924954+0000","last_fullsized":"2024-09-19T05:33:20.924954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:03.333739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578871+0000","last_change":"2024-09-19T05:33:14.543745+0000","last_active":"2024-09-19T05:33:19.578871+0000","last_peered":"2024-09-19T05:33:19.578871+0000","last_clean":"2024-09-19T05:33:19.578871+0000","last_became_active":"2024-09-19T05:33:14.541218+0000","last_became_peered":"2024-09-19T05:33:14.541218+0000","last_unstale":"2024-09-19T05:33:19.578871+0000","last_undegraded":"2024-09-19T05:33:19.578871+0000","last_fullsized":"2024-09-19T05:33:19.578871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:31.945487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923405+0000","last_change":"2024-09-19T05:33:13.534122+0000","last_active":"2024-09-19T05:33:20.923405+0000","last_peered":"2024-09-19T05:33:20.923405+0000","last_clean":"2024-09-19T05:33:20.923405+0000","last_became_active":"2024-09-19T05:33:13.533442+0000","last_became_peered":"2024-09-19T05:33:13.533442+0000","last_unstale":"2024-09-19T05:33:20.923405+0000","last_undegraded":"2024-09-19T05:33:20.923405+0000","last_fullsized":"2024-09-19T05:33:20.923405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578804+0000","last_change":"2024-09-19T05:33:18.595747+0000","last_active":"2024-09-19T05:33:19.578804+0000","last_peered":"2024-09-19T05:33:19.578804+0000","last_clean":"2024-09-19T05:33:19.578804+0000","last_became_active":"2024-09-19T05:33:18.594611+0000","last_became_peered":"2024-09-19T05:33:18.594611+0000","last_unstale":"2024-09-19T05:33:19.578804+0000","last_undegraded":"2024-09-19T05:33:19.578804+0000","last_fullsized":"2024-09-19T05:33:19.578804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:47.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123977+0000","last_change":"2024-09-19T05:33:14.530979+0000","last_active":"2024-09-19T05:33:20.123977+0000","last_peered":"2024-09-19T05:33:20.123977+0000","last_clean":"2024-09-19T05:33:20.123977+0000","last_became_active":"2024-09-19T05:33:14.530680+0000","last_became_peered":"2024-09-19T05:33:14.530680+0000","last_unstale":"2024-09-19T05:33:20.123977+0000","last_undegraded":"2024-09-19T05:33:20.123977+0000","last_fullsized":"2024-09-19T05:33:20.123977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926403+0000","last_change":"2024-09-19T05:33:13.532595+0000","last_active":"2024-09-19T05:33:20.926403+0000","last_peered":"2024-09-19T05:33:20.926403+0000","last_clean":"2024-09-19T05:33:20.926403+0000","last_became_active":"2024-09-19T05:33:13.531963+0000","last_became_peered":"2024-09-19T05:33:13.531963+0000","last_unstale":"2024-09-19T05:33:20.926403+0000","last_undegraded":"2024-09-19T05:33:20.926403+0000","last_fullsized":"2024-09-19T05:33:20.926403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:41.192975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577289+0000","last_change":"2024-09-19T05:33:18.727908+0000","last_active":"2024-09-19T05:33:19.577289+0000","last_peered":"2024-09-19T05:33:19.577289+0000","last_clean":"2024-09-19T05:33:19.577289+0000","last_became_active":"2024-09-19T05:33:18.726858+0000","last_became_peered":"2024-09-19T05:33:18.726858+0000","last_unstale":"2024-09-19T05:33:19.577289+0000","last_undegraded":"2024-09-19T05:33:19.577289+0000","last_fullsized":"2024-09-19T05:33:19.577289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:24.769636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.008051+0000","last_change":"2024-09-19T05:33:14.562327+0000","last_active":"2024-09-19T05:33:20.008051+0000","last_peered":"2024-09-19T05:33:20.008051+0000","last_clean":"2024-09-19T05:33:20.008051+0000","last_became_active":"2024-09-19T05:33:14.561984+0000","last_became_peered":"2024-09-19T05:33:14.561984+0000","last_unstale":"2024-09-19T05:33:20.008051+0000","last_undegraded":"2024-09-19T05:33:20.008051+0000","last_fullsized":"2024-09-19T05:33:20.008051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924849+0000","last_change":"2024-09-19T05:33:13.536758+0000","last_active":"2024-09-19T05:33:20.924849+0000","last_peered":"2024-09-19T05:33:20.924849+0000","last_clean":"2024-09-19T05:33:20.924849+0000","last_became_active":"2024-09-19T05:33:13.536502+0000","last_became_peered":"2024-09-19T05:33:13.536502+0000","last_unstale":"2024-09-19T05:33:20.924849+0000","last_undegraded":"2024-09-19T05:33:20.924849+0000","last_fullsized":"2024-09-19T05:33:20.924849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006886+0000","last_change":"2024-09-19T05:33:18.723398+0000","last_active":"2024-09-19T05:33:20.006886+0000","last_peered":"2024-09-19T05:33:20.006886+0000","last_clean":"2024-09-19T05:33:20.006886+0000","last_became_active":"2024-09-19T05:33:18.722953+0000","last_became_peered":"2024-09-19T05:33:18.722953+0000","last_unstale":"2024-09-19T05:33:20.006886+0000","last_undegraded":"2024-09-19T05:33:20.006886+0000","last_fullsized":"2024-09-19T05:33:20.006886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:15.960409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924131+0000","last_change":"2024-09-19T05:33:14.527703+0000","last_active":"2024-09-19T05:33:20.924131+0000","last_peered":"2024-09-19T05:33:20.924131+0000","last_clean":"2024-09-19T05:33:20.924131+0000","last_became_active":"2024-09-19T05:33:14.527335+0000","last_became_peered":"2024-09-19T05:33:14.527335+0000","last_unstale":"2024-09-19T05:33:20.924131+0000","last_undegraded":"2024-09-19T05:33:20.924131+0000","last_fullsized":"2024-09-19T05:33:20.924131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924672+0000","last_change":"2024-09-19T05:33:13.534591+0000","last_active":"2024-09-19T05:33:20.924672+0000","last_peered":"2024-09-19T05:33:20.924672+0000","last_clean":"2024-09-19T05:33:20.924672+0000","last_became_active":"2024-09-19T05:33:13.533520+0000","last_became_peered":"2024-09-19T05:33:13.533520+0000","last_unstale":"2024-09-19T05:33:20.924672+0000","last_undegraded":"2024-09-19T05:33:20.924672+0000","last_fullsized":"2024-09-19T05:33:20.924672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:40.138729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123671+0000","last_change":"2024-09-19T05:33:18.727847+0000","last_active":"2024-09-19T05:33:20.123671+0000","last_peered":"2024-09-19T05:33:20.123671+0000","last_clean":"2024-09-19T05:33:20.123671+0000","last_became_active":"2024-09-19T05:33:18.727377+0000","last_became_peered":"2024-09-19T05:33:18.727377+0000","last_unstale":"2024-09-19T05:33:20.123671+0000","last_undegraded":"2024-09-19T05:33:20.123671+0000","last_fullsized":"2024-09-19T05:33:20.123671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:47.968935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544028+0000","last_change":"2024-09-19T05:33:14.552094+0000","last_active":"2024-09-19T05:33:20.544028+0000","last_peered":"2024-09-19T05:33:20.544028+0000","last_clean":"2024-09-19T05:33:20.544028+0000","last_became_active":"2024-09-19T05:33:14.551244+0000","last_became_peered":"2024-09-19T05:33:14.551244+0000","last_unstale":"2024-09-19T05:33:20.544028+0000","last_undegraded":"2024-09-19T05:33:20.544028+0000","last_fullsized":"2024-09-19T05:33:20.544028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:29.504706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924385+0000","last_change":"2024-09-19T05:33:13.523378+0000","last_active":"2024-09-19T05:33:20.924385+0000","last_peered":"2024-09-19T05:33:20.924385+0000","last_clean":"2024-09-19T05:33:20.924385+0000","last_became_active":"2024-09-19T05:33:13.523053+0000","last_became_peered":"2024-09-19T05:33:13.523053+0000","last_unstale":"2024-09-19T05:33:20.924385+0000","last_undegraded":"2024-09-19T05:33:20.924385+0000","last_fullsized":"2024-09-19T05:33:20.924385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:41.192975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923121+0000","last_change":"2024-09-19T05:33:18.602228+0000","last_active":"2024-09-19T05:33:20.923121+0000","last_peered":"2024-09-19T05:33:20.923121+0000","last_clean":"2024-09-19T05:33:20.923121+0000","last_became_active":"2024-09-19T05:33:18.601292+0000","last_became_peered":"2024-09-19T05:33:18.601292+0000","last_unstale":"2024-09-19T05:33:20.923121+0000","last_undegraded":"2024-09-19T05:33:20.923121+0000","last_fullsized":"2024-09-19T05:33:20.923121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:57.747825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578328+0000","last_change":"2024-09-19T05:33:14.537118+0000","last_active":"2024-09-19T05:33:19.578328+0000","last_peered":"2024-09-19T05:33:19.578328+0000","last_clean":"2024-09-19T05:33:19.578328+0000","last_became_active":"2024-09-19T05:33:14.535816+0000","last_became_peered":"2024-09-19T05:33:14.535816+0000","last_unstale":"2024-09-19T05:33:19.578328+0000","last_undegraded":"2024-09-19T05:33:19.578328+0000","last_fullsized":"2024-09-19T05:33:19.578328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:49.497300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543873+0000","last_change":"2024-09-19T05:33:13.550593+0000","last_active":"2024-09-19T05:33:20.543873+0000","last_peered":"2024-09-19T05:33:20.543873+0000","last_clean":"2024-09-19T05:33:20.543873+0000","last_became_active":"2024-09-19T05:33:13.549511+0000","last_became_peered":"2024-09-19T05:33:13.549511+0000","last_unstale":"2024-09-19T05:33:20.543873+0000","last_undegraded":"2024-09-19T05:33:20.543873+0000","last_fullsized":"2024-09-19T05:33:20.543873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:13.595105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924258+0000","last_change":"2024-09-19T05:33:18.607825+0000","last_active":"2024-09-19T05:33:20.924258+0000","last_peered":"2024-09-19T05:33:20.924258+0000","last_clean":"2024-09-19T05:33:20.924258+0000","last_became_active":"2024-09-19T05:33:18.606441+0000","last_became_peered":"2024-09-19T05:33:18.606441+0000","last_unstale":"2024-09-19T05:33:20.924258+0000","last_undegraded":"2024-09-19T05:33:20.924258+0000","last_fullsized":"2024-09-19T05:33:20.924258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:47.248958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922997+0000","last_change":"2024-09-19T05:33:14.530018+0000","last_active":"2024-09-19T05:33:20.922997+0000","last_peered":"2024-09-19T05:33:20.922997+0000","last_clean":"2024-09-19T05:33:20.922997+0000","last_became_active":"2024-09-19T05:33:14.528997+0000","last_became_peered":"2024-09-19T05:33:14.528997+0000","last_unstale":"2024-09-19T05:33:20.922997+0000","last_undegraded":"2024-09-19T05:33:20.922997+0000","last_fullsized":"2024-09-19T05:33:20.922997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576385+0000","last_change":"2024-09-19T05:33:13.518923+0000","last_active":"2024-09-19T05:33:19.576385+0000","last_peered":"2024-09-19T05:33:19.576385+0000","last_clean":"2024-09-19T05:33:19.576385+0000","last_became_active":"2024-09-19T05:33:13.517867+0000","last_became_peered":"2024-09-19T05:33:13.517867+0000","last_unstale":"2024-09-19T05:33:19.576385+0000","last_undegraded":"2024-09-19T05:33:19.576385+0000","last_fullsized":"2024-09-19T05:33:19.576385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:41.939363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925137+0000","last_change":"2024-09-19T05:33:18.600087+0000","last_active":"2024-09-19T05:33:20.925137+0000","last_peered":"2024-09-19T05:33:20.925137+0000","last_clean":"2024-09-19T05:33:20.925137+0000","last_became_active":"2024-09-19T05:33:18.599484+0000","last_became_peered":"2024-09-19T05:33:18.599484+0000","last_unstale":"2024-09-19T05:33:20.925137+0000","last_undegraded":"2024-09-19T05:33:20.925137+0000","last_fullsized":"2024-09-19T05:33:20.925137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:03.032844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123142+0000","last_change":"2024-09-19T05:33:14.549619+0000","last_active":"2024-09-19T05:33:20.123142+0000","last_peered":"2024-09-19T05:33:20.123142+0000","last_clean":"2024-09-19T05:33:20.123142+0000","last_became_active":"2024-09-19T05:33:14.549390+0000","last_became_peered":"2024-09-19T05:33:14.549390+0000","last_unstale":"2024-09-19T05:33:20.123142+0000","last_undegraded":"2024-09-19T05:33:20.123142+0000","last_fullsized":"2024-09-19T05:33:20.123142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:29.911108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923683+0000","last_change":"2024-09-19T05:33:13.533988+0000","last_active":"2024-09-19T05:33:20.923683+0000","last_peered":"2024-09-19T05:33:20.923683+0000","last_clean":"2024-09-19T05:33:20.923683+0000","last_became_active":"2024-09-19T05:33:13.533251+0000","last_became_peered":"2024-09-19T05:33:13.533251+0000","last_unstale":"2024-09-19T05:33:20.923683+0000","last_undegraded":"2024-09-19T05:33:20.923683+0000","last_fullsized":"2024-09-19T05:33:20.923683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123842+0000","last_change":"2024-09-19T05:33:18.731732+0000","last_active":"2024-09-19T05:33:20.123842+0000","last_peered":"2024-09-19T05:33:20.123842+0000","last_clean":"2024-09-19T05:33:20.123842+0000","last_became_active":"2024-09-19T05:33:18.731060+0000","last_became_peered":"2024-09-19T05:33:18.731060+0000","last_unstale":"2024-09-19T05:33:20.123842+0000","last_undegraded":"2024-09-19T05:33:20.123842+0000","last_fullsized":"2024-09-19T05:33:20.123842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:03.333739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007078+0000","last_change":"2024-09-19T05:33:14.564726+0000","last_active":"2024-09-19T05:33:20.007078+0000","last_peered":"2024-09-19T05:33:20.007078+0000","last_clean":"2024-09-19T05:33:20.007078+0000","last_became_active":"2024-09-19T05:33:14.564425+0000","last_became_peered":"2024-09-19T05:33:14.564425+0000","last_unstale":"2024-09-19T05:33:20.007078+0000","last_undegraded":"2024-09-19T05:33:20.007078+0000","last_fullsized":"2024-09-19T05:33:20.007078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:24.609475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543194+0000","last_change":"2024-09-19T05:33:13.553641+0000","last_active":"2024-09-19T05:33:20.543194+0000","last_peered":"2024-09-19T05:33:20.543194+0000","last_clean":"2024-09-19T05:33:20.543194+0000","last_became_active":"2024-09-19T05:33:13.552684+0000","last_became_peered":"2024-09-19T05:33:13.552684+0000","last_unstale":"2024-09-19T05:33:20.543194+0000","last_undegraded":"2024-09-19T05:33:20.543194+0000","last_fullsized":"2024-09-19T05:33:20.543194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:01.312371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922618+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:33:20.922618+0000","last_peered":"2024-09-19T05:33:20.922618+0000","last_clean":"2024-09-19T05:33:20.922618+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:33:20.922618+0000","last_undegraded":"2024-09-19T05:33:20.922618+0000","last_fullsized":"2024-09-19T05:33:20.922618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923213+0000","last_change":"2024-09-19T05:33:18.730082+0000","last_active":"2024-09-19T05:33:20.923213+0000","last_peered":"2024-09-19T05:33:20.923213+0000","last_clean":"2024-09-19T05:33:20.923213+0000","last_became_active":"2024-09-19T05:33:18.728956+0000","last_became_peered":"2024-09-19T05:33:18.728956+0000","last_unstale":"2024-09-19T05:33:20.923213+0000","last_undegraded":"2024-09-19T05:33:20.923213+0000","last_fullsized":"2024-09-19T05:33:20.923213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:42.509239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924260+0000","last_change":"2024-09-19T05:33:14.556753+0000","last_active":"2024-09-19T05:33:20.924260+0000","last_peered":"2024-09-19T05:33:20.924260+0000","last_clean":"2024-09-19T05:33:20.924260+0000","last_became_active":"2024-09-19T05:33:14.555774+0000","last_became_peered":"2024-09-19T05:33:14.555774+0000","last_unstale":"2024-09-19T05:33:20.924260+0000","last_undegraded":"2024-09-19T05:33:20.924260+0000","last_fullsized":"2024-09-19T05:33:20.924260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:43.675511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576694+0000","last_change":"2024-09-19T05:33:13.554975+0000","last_active":"2024-09-19T05:33:19.576694+0000","last_peered":"2024-09-19T05:33:19.576694+0000","last_clean":"2024-09-19T05:33:19.576694+0000","last_became_active":"2024-09-19T05:33:13.554687+0000","last_became_peered":"2024-09-19T05:33:13.554687+0000","last_unstale":"2024-09-19T05:33:19.576694+0000","last_undegraded":"2024-09-19T05:33:19.576694+0000","last_fullsized":"2024-09-19T05:33:19.576694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:19.118135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923096+0000","last_change":"2024-09-19T05:33:18.725840+0000","last_active":"2024-09-19T05:33:20.923096+0000","last_peered":"2024-09-19T05:33:20.923096+0000","last_clean":"2024-09-19T05:33:20.923096+0000","last_became_active":"2024-09-19T05:33:18.724609+0000","last_became_peered":"2024-09-19T05:33:18.724609+0000","last_unstale":"2024-09-19T05:33:20.923096+0000","last_undegraded":"2024-09-19T05:33:20.923096+0000","last_fullsized":"2024-09-19T05:33:20.923096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:47.727632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543949+0000","last_change":"2024-09-19T05:33:14.537550+0000","last_active":"2024-09-19T05:33:20.543949+0000","last_peered":"2024-09-19T05:33:20.543949+0000","last_clean":"2024-09-19T05:33:20.543949+0000","last_became_active":"2024-09-19T05:33:14.536832+0000","last_became_peered":"2024-09-19T05:33:14.536832+0000","last_unstale":"2024-09-19T05:33:20.543949+0000","last_undegraded":"2024-09-19T05:33:20.543949+0000","last_fullsized":"2024-09-19T05:33:20.543949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:45.451882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924358+0000","last_change":"2024-09-19T05:33:13.524749+0000","last_active":"2024-09-19T05:33:20.924358+0000","last_peered":"2024-09-19T05:33:20.924358+0000","last_clean":"2024-09-19T05:33:20.924358+0000","last_became_active":"2024-09-19T05:33:13.523674+0000","last_became_peered":"2024-09-19T05:33:13.523674+0000","last_unstale":"2024-09-19T05:33:20.924358+0000","last_undegraded":"2024-09-19T05:33:20.924358+0000","last_fullsized":"2024-09-19T05:33:20.924358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:45.954638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123714+0000","last_change":"2024-09-19T05:33:18.598514+0000","last_active":"2024-09-19T05:33:20.123714+0000","last_peered":"2024-09-19T05:33:20.123714+0000","last_clean":"2024-09-19T05:33:20.123714+0000","last_became_active":"2024-09-19T05:33:18.598011+0000","last_became_peered":"2024-09-19T05:33:18.598011+0000","last_unstale":"2024-09-19T05:33:20.123714+0000","last_undegraded":"2024-09-19T05:33:20.123714+0000","last_fullsized":"2024-09-19T05:33:20.123714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.531745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925304+0000","last_change":"2024-09-19T05:33:14.574183+0000","last_active":"2024-09-19T05:33:20.925304+0000","last_peered":"2024-09-19T05:33:20.925304+0000","last_clean":"2024-09-19T05:33:20.925304+0000","last_became_active":"2024-09-19T05:33:14.572292+0000","last_became_peered":"2024-09-19T05:33:14.572292+0000","last_unstale":"2024-09-19T05:33:20.925304+0000","last_undegraded":"2024-09-19T05:33:20.925304+0000","last_fullsized":"2024-09-19T05:33:20.925304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:23.479624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576694+0000","last_change":"2024-09-19T05:33:13.518160+0000","last_active":"2024-09-19T05:33:19.576694+0000","last_peered":"2024-09-19T05:33:19.576694+0000","last_clean":"2024-09-19T05:33:19.576694+0000","last_became_active":"2024-09-19T05:33:13.517669+0000","last_became_peered":"2024-09-19T05:33:13.517669+0000","last_unstale":"2024-09-19T05:33:19.576694+0000","last_undegraded":"2024-09-19T05:33:19.576694+0000","last_fullsized":"2024-09-19T05:33:19.576694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.869187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542731+0000","last_change":"2024-09-19T05:33:18.731204+0000","last_active":"2024-09-19T05:33:20.542731+0000","last_peered":"2024-09-19T05:33:20.542731+0000","last_clean":"2024-09-19T05:33:20.542731+0000","last_became_active":"2024-09-19T05:33:18.730150+0000","last_became_peered":"2024-09-19T05:33:18.730150+0000","last_unstale":"2024-09-19T05:33:20.542731+0000","last_undegraded":"2024-09-19T05:33:20.542731+0000","last_fullsized":"2024-09-19T05:33:20.542731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:39.847635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924886+0000","last_change":"2024-09-19T05:33:14.568190+0000","last_active":"2024-09-19T05:33:20.924886+0000","last_peered":"2024-09-19T05:33:20.924886+0000","last_clean":"2024-09-19T05:33:20.924886+0000","last_became_active":"2024-09-19T05:33:14.566383+0000","last_became_peered":"2024-09-19T05:33:14.566383+0000","last_unstale":"2024-09-19T05:33:20.924886+0000","last_undegraded":"2024-09-19T05:33:20.924886+0000","last_fullsized":"2024-09-19T05:33:20.924886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:43.196836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578722+0000","last_change":"2024-09-19T05:33:13.523746+0000","last_active":"2024-09-19T05:33:19.578722+0000","last_peered":"2024-09-19T05:33:19.578722+0000","last_clean":"2024-09-19T05:33:19.578722+0000","last_became_active":"2024-09-19T05:33:13.522995+0000","last_became_peered":"2024-09-19T05:33:13.522995+0000","last_unstale":"2024-09-19T05:33:19.578722+0000","last_undegraded":"2024-09-19T05:33:19.578722+0000","last_fullsized":"2024-09-19T05:33:19.578722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:37.675142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576913+0000","last_change":"2024-09-19T05:33:18.595330+0000","last_active":"2024-09-19T05:33:19.576913+0000","last_peered":"2024-09-19T05:33:19.576913+0000","last_clean":"2024-09-19T05:33:19.576913+0000","last_became_active":"2024-09-19T05:33:18.594314+0000","last_became_peered":"2024-09-19T05:33:18.594314+0000","last_unstale":"2024-09-19T05:33:19.576913+0000","last_undegraded":"2024-09-19T05:33:19.576913+0000","last_fullsized":"2024-09-19T05:33:19.576913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:17.535329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925421+0000","last_change":"2024-09-19T05:33:14.568254+0000","last_active":"2024-09-19T05:33:20.925421+0000","last_peered":"2024-09-19T05:33:20.925421+0000","last_clean":"2024-09-19T05:33:20.925421+0000","last_became_active":"2024-09-19T05:33:14.567525+0000","last_became_peered":"2024-09-19T05:33:14.567525+0000","last_unstale":"2024-09-19T05:33:20.925421+0000","last_undegraded":"2024-09-19T05:33:20.925421+0000","last_fullsized":"2024-09-19T05:33:20.925421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:20.717515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576007+0000","last_change":"2024-09-19T05:33:13.518203+0000","last_active":"2024-09-19T05:33:19.576007+0000","last_peered":"2024-09-19T05:33:19.576007+0000","last_clean":"2024-09-19T05:33:19.576007+0000","last_became_active":"2024-09-19T05:33:13.517450+0000","last_became_peered":"2024-09-19T05:33:13.517450+0000","last_unstale":"2024-09-19T05:33:19.576007+0000","last_undegraded":"2024-09-19T05:33:19.576007+0000","last_fullsized":"2024-09-19T05:33:19.576007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:01.312371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123779+0000","last_change":"2024-09-19T05:33:18.596006+0000","last_active":"2024-09-19T05:33:20.123779+0000","last_peered":"2024-09-19T05:33:20.123779+0000","last_clean":"2024-09-19T05:33:20.123779+0000","last_became_active":"2024-09-19T05:33:18.595625+0000","last_became_peered":"2024-09-19T05:33:18.595625+0000","last_unstale":"2024-09-19T05:33:20.123779+0000","last_undegraded":"2024-09-19T05:33:20.123779+0000","last_fullsized":"2024-09-19T05:33:20.123779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:47.248958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924329+0000","last_change":"2024-09-19T05:33:14.550442+0000","last_active":"2024-09-19T05:33:20.924329+0000","last_peered":"2024-09-19T05:33:20.924329+0000","last_clean":"2024-09-19T05:33:20.924329+0000","last_became_active":"2024-09-19T05:33:14.549648+0000","last_became_peered":"2024-09-19T05:33:14.549648+0000","last_unstale":"2024-09-19T05:33:20.924329+0000","last_undegraded":"2024-09-19T05:33:20.924329+0000","last_fullsized":"2024-09-19T05:33:20.924329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923348+0000","last_change":"2024-09-19T05:33:13.541793+0000","last_active":"2024-09-19T05:33:20.923348+0000","last_peered":"2024-09-19T05:33:20.923348+0000","last_clean":"2024-09-19T05:33:20.923348+0000","last_became_active":"2024-09-19T05:33:13.541034+0000","last_became_peered":"2024-09-19T05:33:13.541034+0000","last_unstale":"2024-09-19T05:33:20.923348+0000","last_undegraded":"2024-09-19T05:33:20.923348+0000","last_fullsized":"2024-09-19T05:33:20.923348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:48.487775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007972+0000","last_change":"2024-09-19T05:33:18.734544+0000","last_active":"2024-09-19T05:33:20.007972+0000","last_peered":"2024-09-19T05:33:20.007972+0000","last_clean":"2024-09-19T05:33:20.007972+0000","last_became_active":"2024-09-19T05:33:18.734217+0000","last_became_peered":"2024-09-19T05:33:18.734217+0000","last_unstale":"2024-09-19T05:33:20.007972+0000","last_undegraded":"2024-09-19T05:33:20.007972+0000","last_fullsized":"2024-09-19T05:33:20.007972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:29.423972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924156+0000","last_change":"2024-09-19T05:33:14.568196+0000","last_active":"2024-09-19T05:33:20.924156+0000","last_peered":"2024-09-19T05:33:20.924156+0000","last_clean":"2024-09-19T05:33:20.924156+0000","last_became_active":"2024-09-19T05:33:14.567764+0000","last_became_peered":"2024-09-19T05:33:14.567764+0000","last_unstale":"2024-09-19T05:33:20.924156+0000","last_undegraded":"2024-09-19T05:33:20.924156+0000","last_fullsized":"2024-09-19T05:33:20.924156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:38.457117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543797+0000","last_change":"2024-09-19T05:33:13.550337+0000","last_active":"2024-09-19T05:33:20.543797+0000","last_peered":"2024-09-19T05:33:20.543797+0000","last_clean":"2024-09-19T05:33:20.543797+0000","last_became_active":"2024-09-19T05:33:13.549450+0000","last_became_peered":"2024-09-19T05:33:13.549450+0000","last_unstale":"2024-09-19T05:33:20.543797+0000","last_undegraded":"2024-09-19T05:33:20.543797+0000","last_fullsized":"2024-09-19T05:33:20.543797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:29.032420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007818+0000","last_change":"2024-09-19T05:33:18.728533+0000","last_active":"2024-09-19T05:33:20.007818+0000","last_peered":"2024-09-19T05:33:20.007818+0000","last_clean":"2024-09-19T05:33:20.007818+0000","last_became_active":"2024-09-19T05:33:18.728056+0000","last_became_peered":"2024-09-19T05:33:18.728056+0000","last_unstale":"2024-09-19T05:33:20.007818+0000","last_undegraded":"2024-09-19T05:33:20.007818+0000","last_fullsized":"2024-09-19T05:33:20.007818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:33.730399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123383+0000","last_change":"2024-09-19T05:33:14.555119+0000","last_active":"2024-09-19T05:33:20.123383+0000","last_peered":"2024-09-19T05:33:20.123383+0000","last_clean":"2024-09-19T05:33:20.123383+0000","last_became_active":"2024-09-19T05:33:14.554798+0000","last_became_peered":"2024-09-19T05:33:14.554798+0000","last_unstale":"2024-09-19T05:33:20.123383+0000","last_undegraded":"2024-09-19T05:33:20.123383+0000","last_fullsized":"2024-09-19T05:33:20.123383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123886+0000","last_change":"2024-09-19T05:33:13.529400+0000","last_active":"2024-09-19T05:33:20.123886+0000","last_peered":"2024-09-19T05:33:20.123886+0000","last_clean":"2024-09-19T05:33:20.123886+0000","last_became_active":"2024-09-19T05:33:13.529106+0000","last_became_peered":"2024-09-19T05:33:13.529106+0000","last_unstale":"2024-09-19T05:33:20.123886+0000","last_undegraded":"2024-09-19T05:33:20.123886+0000","last_fullsized":"2024-09-19T05:33:20.123886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:11.761526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544051+0000","last_change":"2024-09-19T05:33:18.723038+0000","last_active":"2024-09-19T05:33:20.544051+0000","last_peered":"2024-09-19T05:33:20.544051+0000","last_clean":"2024-09-19T05:33:20.544051+0000","last_became_active":"2024-09-19T05:33:18.722087+0000","last_became_peered":"2024-09-19T05:33:18.722087+0000","last_unstale":"2024-09-19T05:33:20.544051+0000","last_undegraded":"2024-09-19T05:33:20.544051+0000","last_fullsized":"2024-09-19T05:33:20.544051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:40.558697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924126+0000","last_change":"2024-09-19T05:33:14.556157+0000","last_active":"2024-09-19T05:33:20.924126+0000","last_peered":"2024-09-19T05:33:20.924126+0000","last_clean":"2024-09-19T05:33:20.924126+0000","last_became_active":"2024-09-19T05:33:14.555055+0000","last_became_peered":"2024-09-19T05:33:14.555055+0000","last_unstale":"2024-09-19T05:33:20.924126+0000","last_undegraded":"2024-09-19T05:33:20.924126+0000","last_fullsized":"2024-09-19T05:33:20.924126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:36.661349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:25.122224+0000","last_change":"2024-09-19T05:33:13.534975+0000","last_active":"2024-09-19T05:33:25.122224+0000","last_peered":"2024-09-19T05:33:25.122224+0000","last_clean":"2024-09-19T05:33:25.122224+0000","last_became_active":"2024-09-19T05:33:13.533864+0000","last_became_peered":"2024-09-19T05:33:13.533864+0000","last_unstale":"2024-09-19T05:33:25.122224+0000","last_undegraded":"2024-09-19T05:33:25.122224+0000","last_fullsized":"2024-09-19T05:33:25.122224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:30.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923321+0000","last_change":"2024-09-19T05:33:18.592141+0000","last_active":"2024-09-19T05:33:20.923321+0000","last_peered":"2024-09-19T05:33:20.923321+0000","last_clean":"2024-09-19T05:33:20.923321+0000","last_became_active":"2024-09-19T05:33:18.591748+0000","last_became_peered":"2024-09-19T05:33:18.591748+0000","last_unstale":"2024-09-19T05:33:20.923321+0000","last_undegraded":"2024-09-19T05:33:20.923321+0000","last_fullsized":"2024-09-19T05:33:20.923321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.531745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578732+0000","last_change":"2024-09-19T05:33:14.557457+0000","last_active":"2024-09-19T05:33:19.578732+0000","last_peered":"2024-09-19T05:33:19.578732+0000","last_clean":"2024-09-19T05:33:19.578732+0000","last_became_active":"2024-09-19T05:33:14.556954+0000","last_became_peered":"2024-09-19T05:33:14.556954+0000","last_unstale":"2024-09-19T05:33:19.578732+0000","last_undegraded":"2024-09-19T05:33:19.578732+0000","last_fullsized":"2024-09-19T05:33:19.578732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:46.964162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924088+0000","last_change":"2024-09-19T05:33:13.548294+0000","last_active":"2024-09-19T05:33:20.924088+0000","last_peered":"2024-09-19T05:33:20.924088+0000","last_clean":"2024-09-19T05:33:20.924088+0000","last_became_active":"2024-09-19T05:33:13.547981+0000","last_became_peered":"2024-09-19T05:33:13.547981+0000","last_unstale":"2024-09-19T05:33:20.924088+0000","last_undegraded":"2024-09-19T05:33:20.924088+0000","last_fullsized":"2024-09-19T05:33:20.924088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.579238+0000","last_change":"2024-09-19T05:33:18.596736+0000","last_active":"2024-09-19T05:33:19.579238+0000","last_peered":"2024-09-19T05:33:19.579238+0000","last_clean":"2024-09-19T05:33:19.579238+0000","last_became_active":"2024-09-19T05:33:18.594148+0000","last_became_peered":"2024-09-19T05:33:18.594148+0000","last_unstale":"2024-09-19T05:33:19.579238+0000","last_undegraded":"2024-09-19T05:33:19.579238+0000","last_fullsized":"2024-09-19T05:33:19.579238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:47.968935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123796+0000","last_change":"2024-09-19T05:33:14.551870+0000","last_active":"2024-09-19T05:33:20.123796+0000","last_peered":"2024-09-19T05:33:20.123796+0000","last_clean":"2024-09-19T05:33:20.123796+0000","last_became_active":"2024-09-19T05:33:14.551566+0000","last_became_peered":"2024-09-19T05:33:14.551566+0000","last_unstale":"2024-09-19T05:33:20.123796+0000","last_undegraded":"2024-09-19T05:33:20.123796+0000","last_fullsized":"2024-09-19T05:33:20.123796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543615+0000","last_change":"2024-09-19T05:33:13.553089+0000","last_active":"2024-09-19T05:33:20.543615+0000","last_peered":"2024-09-19T05:33:20.543615+0000","last_clean":"2024-09-19T05:33:20.543615+0000","last_became_active":"2024-09-19T05:33:13.552446+0000","last_became_peered":"2024-09-19T05:33:13.552446+0000","last_unstale":"2024-09-19T05:33:20.543615+0000","last_undegraded":"2024-09-19T05:33:20.543615+0000","last_fullsized":"2024-09-19T05:33:20.543615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.869187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007319+0000","last_change":"2024-09-19T05:33:18.595633+0000","last_active":"2024-09-19T05:33:20.007319+0000","last_peered":"2024-09-19T05:33:20.007319+0000","last_clean":"2024-09-19T05:33:20.007319+0000","last_became_active":"2024-09-19T05:33:18.594796+0000","last_became_peered":"2024-09-19T05:33:18.594796+0000","last_unstale":"2024-09-19T05:33:20.007319+0000","last_undegraded":"2024-09-19T05:33:20.007319+0000","last_fullsized":"2024-09-19T05:33:20.007319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:01.766766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543414+0000","last_change":"2024-09-19T05:33:14.562226+0000","last_active":"2024-09-19T05:33:20.543414+0000","last_peered":"2024-09-19T05:33:20.543414+0000","last_clean":"2024-09-19T05:33:20.543414+0000","last_became_active":"2024-09-19T05:33:14.561518+0000","last_became_peered":"2024-09-19T05:33:14.561518+0000","last_unstale":"2024-09-19T05:33:20.543414+0000","last_undegraded":"2024-09-19T05:33:20.543414+0000","last_fullsized":"2024-09-19T05:33:20.543414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:56.884042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926192+0000","last_change":"2024-09-19T05:33:13.554061+0000","last_active":"2024-09-19T05:33:20.926192+0000","last_peered":"2024-09-19T05:33:20.926192+0000","last_clean":"2024-09-19T05:33:20.926192+0000","last_became_active":"2024-09-19T05:33:13.553573+0000","last_became_peered":"2024-09-19T05:33:13.553573+0000","last_unstale":"2024-09-19T05:33:20.926192+0000","last_undegraded":"2024-09-19T05:33:20.926192+0000","last_fullsized":"2024-09-19T05:33:20.926192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:58.287859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007220+0000","last_change":"2024-09-19T05:33:18.728406+0000","last_active":"2024-09-19T05:33:20.007220+0000","last_peered":"2024-09-19T05:33:20.007220+0000","last_clean":"2024-09-19T05:33:20.007220+0000","last_became_active":"2024-09-19T05:33:18.728024+0000","last_became_peered":"2024-09-19T05:33:18.728024+0000","last_unstale":"2024-09-19T05:33:20.007220+0000","last_undegraded":"2024-09-19T05:33:20.007220+0000","last_fullsized":"2024-09-19T05:33:20.007220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:21.487284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123656+0000","last_change":"2024-09-19T05:33:18.731432+0000","last_active":"2024-09-19T05:33:20.123656+0000","last_peered":"2024-09-19T05:33:20.123656+0000","last_clean":"2024-09-19T05:33:20.123656+0000","last_became_active":"2024-09-19T05:33:18.730553+0000","last_became_peered":"2024-09-19T05:33:18.730553+0000","last_unstale":"2024-09-19T05:33:20.123656+0000","last_undegraded":"2024-09-19T05:33:20.123656+0000","last_fullsized":"2024-09-19T05:33:20.123656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:57.747825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922747+0000","last_change":"2024-09-19T05:33:14.528607+0000","last_active":"2024-09-19T05:33:20.922747+0000","last_peered":"2024-09-19T05:33:20.922747+0000","last_clean":"2024-09-19T05:33:20.922747+0000","last_became_active":"2024-09-19T05:33:14.528243+0000","last_became_peered":"2024-09-19T05:33:14.528243+0000","last_unstale":"2024-09-19T05:33:20.922747+0000","last_undegraded":"2024-09-19T05:33:20.922747+0000","last_fullsized":"2024-09-19T05:33:20.922747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542883+0000","last_change":"2024-09-19T05:33:13.550160+0000","last_active":"2024-09-19T05:33:20.542883+0000","last_peered":"2024-09-19T05:33:20.542883+0000","last_clean":"2024-09-19T05:33:20.542883+0000","last_became_active":"2024-09-19T05:33:13.548497+0000","last_became_peered":"2024-09-19T05:33:13.548497+0000","last_unstale":"2024-09-19T05:33:20.542883+0000","last_undegraded":"2024-09-19T05:33:20.542883+0000","last_fullsized":"2024-09-19T05:33:20.542883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:41.939363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926179+0000","last_change":"2024-09-19T05:33:18.598114+0000","last_active":"2024-09-19T05:33:20.926179+0000","last_peered":"2024-09-19T05:33:20.926179+0000","last_clean":"2024-09-19T05:33:20.926179+0000","last_became_active":"2024-09-19T05:33:18.597017+0000","last_became_peered":"2024-09-19T05:33:18.597017+0000","last_unstale":"2024-09-19T05:33:20.926179+0000","last_undegraded":"2024-09-19T05:33:20.926179+0000","last_fullsized":"2024-09-19T05:33:20.926179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:57.960270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007352+0000","last_change":"2024-09-19T05:33:14.521880+0000","last_active":"2024-09-19T05:33:20.007352+0000","last_peered":"2024-09-19T05:33:20.007352+0000","last_clean":"2024-09-19T05:33:20.007352+0000","last_became_active":"2024-09-19T05:33:14.521480+0000","last_became_peered":"2024-09-19T05:33:14.521480+0000","last_unstale":"2024-09-19T05:33:20.007352+0000","last_undegraded":"2024-09-19T05:33:20.007352+0000","last_fullsized":"2024-09-19T05:33:20.007352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007858+0000","last_change":"2024-09-19T05:33:13.536792+0000","last_active":"2024-09-19T05:33:20.007858+0000","last_peered":"2024-09-19T05:33:20.007858+0000","last_clean":"2024-09-19T05:33:20.007858+0000","last_became_active":"2024-09-19T05:33:13.536509+0000","last_became_peered":"2024-09-19T05:33:13.536509+0000","last_unstale":"2024-09-19T05:33:20.007858+0000","last_undegraded":"2024-09-19T05:33:20.007858+0000","last_fullsized":"2024-09-19T05:33:20.007858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:27.720089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924007+0000","last_change":"2024-09-19T05:33:13.541454+0000","last_active":"2024-09-19T05:33:20.924007+0000","last_peered":"2024-09-19T05:33:20.924007+0000","last_clean":"2024-09-19T05:33:20.924007+0000","last_became_active":"2024-09-19T05:33:13.536977+0000","last_became_peered":"2024-09-19T05:33:13.536977+0000","last_unstale":"2024-09-19T05:33:20.924007+0000","last_undegraded":"2024-09-19T05:33:20.924007+0000","last_fullsized":"2024-09-19T05:33:20.924007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:47.982621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123776+0000","last_change":"2024-09-19T05:33:14.547549+0000","last_active":"2024-09-19T05:33:20.123776+0000","last_peered":"2024-09-19T05:33:20.123776+0000","last_clean":"2024-09-19T05:33:20.123776+0000","last_became_active":"2024-09-19T05:33:14.547287+0000","last_became_peered":"2024-09-19T05:33:14.547287+0000","last_unstale":"2024-09-19T05:33:20.123776+0000","last_undegraded":"2024-09-19T05:33:20.123776+0000","last_fullsized":"2024-09-19T05:33:20.123776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576575+0000","last_change":"2024-09-19T05:33:18.605731+0000","last_active":"2024-09-19T05:33:19.576575+0000","last_peered":"2024-09-19T05:33:19.576575+0000","last_clean":"2024-09-19T05:33:19.576575+0000","last_became_active":"2024-09-19T05:33:18.605085+0000","last_became_peered":"2024-09-19T05:33:18.605085+0000","last_unstale":"2024-09-19T05:33:19.576575+0000","last_undegraded":"2024-09-19T05:33:19.576575+0000","last_fullsized":"2024-09-19T05:33:19.576575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:27.605669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007619+0000","last_change":"2024-09-19T05:33:13.525111+0000","last_active":"2024-09-19T05:33:20.007619+0000","last_peered":"2024-09-19T05:33:20.007619+0000","last_clean":"2024-09-19T05:33:20.007619+0000","last_became_active":"2024-09-19T05:33:13.524706+0000","last_became_peered":"2024-09-19T05:33:13.524706+0000","last_unstale":"2024-09-19T05:33:20.007619+0000","last_undegraded":"2024-09-19T05:33:20.007619+0000","last_fullsized":"2024-09-19T05:33:20.007619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:12.481503+0000","last_clean_scrub_stamp":"2024-09-19T05:33:12.481503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:11.761526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.577527+0000","last_change":"2024-09-19T05:33:14.530059+0000","last_active":"2024-09-19T05:33:19.577527+0000","last_peered":"2024-09-19T05:33:19.577527+0000","last_clean":"2024-09-19T05:33:19.577527+0000","last_became_active":"2024-09-19T05:33:14.529323+0000","last_became_peered":"2024-09-19T05:33:14.529323+0000","last_unstale":"2024-09-19T05:33:19.577527+0000","last_undegraded":"2024-09-19T05:33:19.577527+0000","last_fullsized":"2024-09-19T05:33:19.577527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:42.202499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007585+0000","last_change":"2024-09-19T05:33:18.597937+0000","last_active":"2024-09-19T05:33:20.007585+0000","last_peered":"2024-09-19T05:33:20.007585+0000","last_clean":"2024-09-19T05:33:20.007585+0000","last_became_active":"2024-09-19T05:33:18.596030+0000","last_became_peered":"2024-09-19T05:33:18.596030+0000","last_unstale":"2024-09-19T05:33:20.007585+0000","last_undegraded":"2024-09-19T05:33:20.007585+0000","last_fullsized":"2024-09-19T05:33:20.007585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:17.543149+0000","last_clean_scrub_stamp":"2024-09-19T05:33:17.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.813147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922700+0000","last_change":"2024-09-19T05:33:14.537267+0000","last_active":"2024-09-19T05:33:20.922700+0000","last_peered":"2024-09-19T05:33:20.922700+0000","last_clean":"2024-09-19T05:33:20.922700+0000","last_became_active":"2024-09-19T05:33:14.536536+0000","last_became_peered":"2024-09-19T05:33:14.536536+0000","last_unstale":"2024-09-19T05:33:20.922700+0000","last_undegraded":"2024-09-19T05:33:20.922700+0000","last_fullsized":"2024-09-19T05:33:20.922700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.535578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576104+0000","last_change":"2024-09-19T05:33:14.526620+0000","last_active":"2024-09-19T05:33:19.576104+0000","last_peered":"2024-09-19T05:33:19.576104+0000","last_clean":"2024-09-19T05:33:19.576104+0000","last_became_active":"2024-09-19T05:33:14.526328+0000","last_became_peered":"2024-09-19T05:33:14.526328+0000","last_unstale":"2024-09-19T05:33:19.576104+0000","last_undegraded":"2024-09-19T05:33:19.576104+0000","last_fullsized":"2024-09-19T05:33:19.576104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:30.041945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543608+0000","last_change":"2024-09-19T05:33:14.559878+0000","last_active":"2024-09-19T05:33:20.543608+0000","last_peered":"2024-09-19T05:33:20.543608+0000","last_clean":"2024-09-19T05:33:20.543608+0000","last_became_active":"2024-09-19T05:33:14.559351+0000","last_became_peered":"2024-09-19T05:33:14.559351+0000","last_unstale":"2024-09-19T05:33:20.543608+0000","last_undegraded":"2024-09-19T05:33:20.543608+0000","last_fullsized":"2024-09-19T05:33:20.543608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:59.661877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123777+0000","last_change":"2024-09-19T05:33:14.530062+0000","last_active":"2024-09-19T05:33:20.123777+0000","last_peered":"2024-09-19T05:33:20.123777+0000","last_clean":"2024-09-19T05:33:20.123777+0000","last_became_active":"2024-09-19T05:33:14.529783+0000","last_became_peered":"2024-09-19T05:33:14.529783+0000","last_unstale":"2024-09-19T05:33:20.123777+0000","last_undegraded":"2024-09-19T05:33:20.123777+0000","last_fullsized":"2024-09-19T05:33:20.123777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007840+0000","last_change":"2024-09-19T05:33:14.542588+0000","last_active":"2024-09-19T05:33:20.007840+0000","last_peered":"2024-09-19T05:33:20.007840+0000","last_clean":"2024-09-19T05:33:20.007840+0000","last_became_active":"2024-09-19T05:33:14.542329+0000","last_became_peered":"2024-09-19T05:33:14.542329+0000","last_unstale":"2024-09-19T05:33:20.007840+0000","last_undegraded":"2024-09-19T05:33:20.007840+0000","last_fullsized":"2024-09-19T05:33:20.007840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923626+0000","last_change":"2024-09-19T05:33:14.526902+0000","last_active":"2024-09-19T05:33:20.923626+0000","last_peered":"2024-09-19T05:33:20.923626+0000","last_clean":"2024-09-19T05:33:20.923626+0000","last_became_active":"2024-09-19T05:33:14.526640+0000","last_became_peered":"2024-09-19T05:33:14.526640+0000","last_unstale":"2024-09-19T05:33:20.923626+0000","last_undegraded":"2024-09-19T05:33:20.923626+0000","last_fullsized":"2024-09-19T05:33:20.923626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926202+0000","last_change":"2024-09-19T05:33:14.559155+0000","last_active":"2024-09-19T05:33:20.926202+0000","last_peered":"2024-09-19T05:33:20.926202+0000","last_clean":"2024-09-19T05:33:20.926202+0000","last_became_active":"2024-09-19T05:33:14.558755+0000","last_became_peered":"2024-09-19T05:33:14.558755+0000","last_unstale":"2024-09-19T05:33:20.926202+0000","last_undegraded":"2024-09-19T05:33:20.926202+0000","last_fullsized":"2024-09-19T05:33:20.926202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:13.483207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.008000+0000","last_change":"2024-09-19T05:33:14.541132+0000","last_active":"2024-09-19T05:33:20.008000+0000","last_peered":"2024-09-19T05:33:20.008000+0000","last_clean":"2024-09-19T05:33:20.008000+0000","last_became_active":"2024-09-19T05:33:14.540863+0000","last_became_peered":"2024-09-19T05:33:14.540863+0000","last_unstale":"2024-09-19T05:33:20.008000+0000","last_undegraded":"2024-09-19T05:33:20.008000+0000","last_fullsized":"2024-09-19T05:33:20.008000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:20.717515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542901+0000","last_change":"2024-09-19T05:33:14.533210+0000","last_active":"2024-09-19T05:33:20.542901+0000","last_peered":"2024-09-19T05:33:20.542901+0000","last_clean":"2024-09-19T05:33:20.542901+0000","last_became_active":"2024-09-19T05:33:14.532432+0000","last_became_peered":"2024-09-19T05:33:14.532432+0000","last_unstale":"2024-09-19T05:33:20.542901+0000","last_undegraded":"2024-09-19T05:33:20.542901+0000","last_fullsized":"2024-09-19T05:33:20.542901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:52.178220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007605+0000","last_change":"2024-09-19T05:33:14.547002+0000","last_active":"2024-09-19T05:33:20.007605+0000","last_peered":"2024-09-19T05:33:20.007605+0000","last_clean":"2024-09-19T05:33:20.007605+0000","last_became_active":"2024-09-19T05:33:14.546737+0000","last_became_peered":"2024-09-19T05:33:14.546737+0000","last_unstale":"2024-09-19T05:33:20.007605+0000","last_undegraded":"2024-09-19T05:33:20.007605+0000","last_fullsized":"2024-09-19T05:33:20.007605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:45.387641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543418+0000","last_change":"2024-09-19T05:33:14.568172+0000","last_active":"2024-09-19T05:33:20.543418+0000","last_peered":"2024-09-19T05:33:20.543418+0000","last_clean":"2024-09-19T05:33:20.543418+0000","last_became_active":"2024-09-19T05:33:14.567760+0000","last_became_peered":"2024-09-19T05:33:14.567760+0000","last_unstale":"2024-09-19T05:33:20.543418+0000","last_undegraded":"2024-09-19T05:33:20.543418+0000","last_fullsized":"2024-09-19T05:33:20.543418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:30.905148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123485+0000","last_change":"2024-09-19T05:33:14.558783+0000","last_active":"2024-09-19T05:33:20.123485+0000","last_peered":"2024-09-19T05:33:20.123485+0000","last_clean":"2024-09-19T05:33:20.123485+0000","last_became_active":"2024-09-19T05:33:14.558567+0000","last_became_peered":"2024-09-19T05:33:14.558567+0000","last_unstale":"2024-09-19T05:33:20.123485+0000","last_undegraded":"2024-09-19T05:33:20.123485+0000","last_fullsized":"2024-09-19T05:33:20.123485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923405+0000","last_change":"2024-09-19T05:33:14.551691+0000","last_active":"2024-09-19T05:33:20.923405+0000","last_peered":"2024-09-19T05:33:20.923405+0000","last_clean":"2024-09-19T05:33:20.923405+0000","last_became_active":"2024-09-19T05:33:14.549872+0000","last_became_peered":"2024-09-19T05:33:14.549872+0000","last_unstale":"2024-09-19T05:33:20.923405+0000","last_undegraded":"2024-09-19T05:33:20.923405+0000","last_fullsized":"2024-09-19T05:33:20.923405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924685+0000","last_change":"2024-09-19T05:33:14.556297+0000","last_active":"2024-09-19T05:33:20.924685+0000","last_peered":"2024-09-19T05:33:20.924685+0000","last_clean":"2024-09-19T05:33:20.924685+0000","last_became_active":"2024-09-19T05:33:14.555403+0000","last_became_peered":"2024-09-19T05:33:14.555403+0000","last_unstale":"2024-09-19T05:33:20.924685+0000","last_undegraded":"2024-09-19T05:33:20.924685+0000","last_fullsized":"2024-09-19T05:33:20.924685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:43.916813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.576705+0000","last_change":"2024-09-19T05:33:14.535228+0000","last_active":"2024-09-19T05:33:19.576705+0000","last_peered":"2024-09-19T05:33:19.576705+0000","last_clean":"2024-09-19T05:33:19.576705+0000","last_became_active":"2024-09-19T05:33:14.534931+0000","last_became_peered":"2024-09-19T05:33:14.534931+0000","last_unstale":"2024-09-19T05:33:19.576705+0000","last_undegraded":"2024-09-19T05:33:19.576705+0000","last_fullsized":"2024-09-19T05:33:19.576705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:12.979751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.544152+0000","last_change":"2024-09-19T05:33:14.565336+0000","last_active":"2024-09-19T05:33:20.544152+0000","last_peered":"2024-09-19T05:33:20.544152+0000","last_clean":"2024-09-19T05:33:20.544152+0000","last_became_active":"2024-09-19T05:33:14.564756+0000","last_became_peered":"2024-09-19T05:33:14.564756+0000","last_unstale":"2024-09-19T05:33:20.544152+0000","last_undegraded":"2024-09-19T05:33:20.544152+0000","last_fullsized":"2024-09-19T05:33:20.544152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:07.067023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.542591+0000","last_change":"2024-09-19T05:33:14.552325+0000","last_active":"2024-09-19T05:33:20.542591+0000","last_peered":"2024-09-19T05:33:20.542591+0000","last_clean":"2024-09-19T05:33:20.542591+0000","last_became_active":"2024-09-19T05:33:14.551613+0000","last_became_peered":"2024-09-19T05:33:14.551613+0000","last_unstale":"2024-09-19T05:33:20.542591+0000","last_undegraded":"2024-09-19T05:33:20.542591+0000","last_fullsized":"2024-09-19T05:33:20.542591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:07.394046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.922935+0000","last_change":"2024-09-19T05:33:14.546485+0000","last_active":"2024-09-19T05:33:20.922935+0000","last_peered":"2024-09-19T05:33:20.922935+0000","last_clean":"2024-09-19T05:33:20.922935+0000","last_became_active":"2024-09-19T05:33:14.546193+0000","last_became_peered":"2024-09-19T05:33:14.546193+0000","last_unstale":"2024-09-19T05:33:20.922935+0000","last_undegraded":"2024-09-19T05:33:20.922935+0000","last_fullsized":"2024-09-19T05:33:20.922935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123351+0000","last_change":"2024-09-19T05:33:14.531122+0000","last_active":"2024-09-19T05:33:20.123351+0000","last_peered":"2024-09-19T05:33:20.123351+0000","last_clean":"2024-09-19T05:33:20.123351+0000","last_became_active":"2024-09-19T05:33:14.530715+0000","last_became_peered":"2024-09-19T05:33:14.530715+0000","last_unstale":"2024-09-19T05:33:20.123351+0000","last_undegraded":"2024-09-19T05:33:20.123351+0000","last_fullsized":"2024-09-19T05:33:20.123351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:45.387641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.007456+0000","last_change":"2024-09-19T05:33:14.560886+0000","last_active":"2024-09-19T05:33:20.007456+0000","last_peered":"2024-09-19T05:33:20.007456+0000","last_clean":"2024-09-19T05:33:20.007456+0000","last_became_active":"2024-09-19T05:33:14.560569+0000","last_became_peered":"2024-09-19T05:33:14.560569+0000","last_unstale":"2024-09-19T05:33:20.007456+0000","last_undegraded":"2024-09-19T05:33:20.007456+0000","last_fullsized":"2024-09-19T05:33:20.007456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:17.886627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:19.578400+0000","last_change":"2024-09-19T05:33:14.539186+0000","last_active":"2024-09-19T05:33:19.578400+0000","last_peered":"2024-09-19T05:33:19.578400+0000","last_clean":"2024-09-19T05:33:19.578400+0000","last_became_active":"2024-09-19T05:33:14.538758+0000","last_became_peered":"2024-09-19T05:33:14.538758+0000","last_unstale":"2024-09-19T05:33:19.578400+0000","last_undegraded":"2024-09-19T05:33:19.578400+0000","last_fullsized":"2024-09-19T05:33:19.578400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:59.297383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925456+0000","last_change":"2024-09-19T05:33:14.568844+0000","last_active":"2024-09-19T05:33:20.925456+0000","last_peered":"2024-09-19T05:33:20.925456+0000","last_clean":"2024-09-19T05:33:20.925456+0000","last_became_active":"2024-09-19T05:33:14.565254+0000","last_became_peered":"2024-09-19T05:33:14.565254+0000","last_unstale":"2024-09-19T05:33:20.925456+0000","last_undegraded":"2024-09-19T05:33:20.925456+0000","last_fullsized":"2024-09-19T05:33:20.925456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.967486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.926051+0000","last_change":"2024-09-19T05:33:14.561841+0000","last_active":"2024-09-19T05:33:20.926051+0000","last_peered":"2024-09-19T05:33:20.926051+0000","last_clean":"2024-09-19T05:33:20.926051+0000","last_became_active":"2024-09-19T05:33:14.561439+0000","last_became_peered":"2024-09-19T05:33:14.561439+0000","last_unstale":"2024-09-19T05:33:20.926051+0000","last_undegraded":"2024-09-19T05:33:20.926051+0000","last_fullsized":"2024-09-19T05:33:20.926051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:13.639264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925143+0000","last_change":"2024-09-19T05:33:14.573138+0000","last_active":"2024-09-19T05:33:20.925143+0000","last_peered":"2024-09-19T05:33:20.925143+0000","last_clean":"2024-09-19T05:33:20.925143+0000","last_became_active":"2024-09-19T05:33:14.564119+0000","last_became_peered":"2024-09-19T05:33:14.564119+0000","last_unstale":"2024-09-19T05:33:20.925143+0000","last_undegraded":"2024-09-19T05:33:20.925143+0000","last_fullsized":"2024-09-19T05:33:20.925143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:53.695703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.006962+0000","last_change":"2024-09-19T05:33:14.528043+0000","last_active":"2024-09-19T05:33:20.006962+0000","last_peered":"2024-09-19T05:33:20.006962+0000","last_clean":"2024-09-19T05:33:20.006962+0000","last_became_active":"2024-09-19T05:33:14.527737+0000","last_became_peered":"2024-09-19T05:33:14.527737+0000","last_unstale":"2024-09-19T05:33:20.006962+0000","last_undegraded":"2024-09-19T05:33:20.006962+0000","last_fullsized":"2024-09-19T05:33:20.006962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:29.911108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.925350+0000","last_change":"2024-09-19T05:33:14.555049+0000","last_active":"2024-09-19T05:33:20.925350+0000","last_peered":"2024-09-19T05:33:20.925350+0000","last_clean":"2024-09-19T05:33:20.925350+0000","last_became_active":"2024-09-19T05:33:14.554452+0000","last_became_peered":"2024-09-19T05:33:14.554452+0000","last_unstale":"2024-09-19T05:33:20.925350+0000","last_undegraded":"2024-09-19T05:33:20.925350+0000","last_fullsized":"2024-09-19T05:33:20.925350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543115+0000","last_change":"2024-09-19T05:33:14.562090+0000","last_active":"2024-09-19T05:33:20.543115+0000","last_peered":"2024-09-19T05:33:20.543115+0000","last_clean":"2024-09-19T05:33:20.543115+0000","last_became_active":"2024-09-19T05:33:14.561559+0000","last_became_peered":"2024-09-19T05:33:14.561559+0000","last_unstale":"2024-09-19T05:33:20.543115+0000","last_undegraded":"2024-09-19T05:33:20.543115+0000","last_fullsized":"2024-09-19T05:33:20.543115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:53.148319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.923829+0000","last_change":"2024-09-19T05:33:14.558005+0000","last_active":"2024-09-19T05:33:20.923829+0000","last_peered":"2024-09-19T05:33:20.923829+0000","last_clean":"2024-09-19T05:33:20.923829+0000","last_became_active":"2024-09-19T05:33:14.556969+0000","last_became_peered":"2024-09-19T05:33:14.556969+0000","last_unstale":"2024-09-19T05:33:20.923829+0000","last_undegraded":"2024-09-19T05:33:20.923829+0000","last_fullsized":"2024-09-19T05:33:20.923829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:28.714509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.543428+0000","last_change":"2024-09-19T05:33:14.562103+0000","last_active":"2024-09-19T05:33:20.543428+0000","last_peered":"2024-09-19T05:33:20.543428+0000","last_clean":"2024-09-19T05:33:20.543428+0000","last_became_active":"2024-09-19T05:33:14.561395+0000","last_became_peered":"2024-09-19T05:33:14.561395+0000","last_unstale":"2024-09-19T05:33:20.543428+0000","last_undegraded":"2024-09-19T05:33:20.543428+0000","last_fullsized":"2024-09-19T05:33:20.543428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:49.601339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.123567+0000","last_change":"2024-09-19T05:33:14.523507+0000","last_active":"2024-09-19T05:33:20.123567+0000","last_peered":"2024-09-19T05:33:20.123567+0000","last_clean":"2024-09-19T05:33:20.123567+0000","last_became_active":"2024-09-19T05:33:14.523206+0000","last_became_peered":"2024-09-19T05:33:14.523206+0000","last_unstale":"2024-09-19T05:33:20.123567+0000","last_undegraded":"2024-09-19T05:33:20.123567+0000","last_fullsized":"2024-09-19T05:33:20.123567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:23.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924802+0000","last_change":"2024-09-19T05:33:14.537324+0000","last_active":"2024-09-19T05:33:20.924802+0000","last_peered":"2024-09-19T05:33:20.924802+0000","last_clean":"2024-09-19T05:33:20.924802+0000","last_became_active":"2024-09-19T05:33:14.536850+0000","last_became_peered":"2024-09-19T05:33:14.536850+0000","last_unstale":"2024-09-19T05:33:20.924802+0000","last_undegraded":"2024-09-19T05:33:20.924802+0000","last_fullsized":"2024-09-19T05:33:20.924802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:30.496725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T05:33:20.924919+0000","last_change":"2024-09-19T05:33:14.559373+0000","last_active":"2024-09-19T05:33:20.924919+0000","last_peered":"2024-09-19T05:33:20.924919+0000","last_clean":"2024-09-19T05:33:20.924919+0000","last_became_active":"2024-09-19T05:33:14.558720+0000","last_became_peered":"2024-09-19T05:33:14.558720+0000","last_unstale":"2024-09-19T05:33:20.924919+0000","last_undegraded":"2024-09-19T05:33:20.924919+0000","last_fullsized":"2024-09-19T05:33:20.924919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:13.491027+0000","last_clean_scrub_stamp":"2024-09-19T05:33:13.491027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:53.908148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":694435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":103611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":694491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:33:32.373 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:33:32.373 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T05:33:32.373 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-19T05:33:32.373 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T05:33:32.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.522+0000 7f66dbf64640 1 Processor -- start 2024-09-19T05:33:32.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.522+0000 7f66dbf64640 1 -- start start 2024-09-19T05:33:32.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.522+0000 7f66dbf64640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66d415b1e0 0x7f66d40b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.522+0000 7f66dbf64640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66d40b4900 0x7f66d4071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.522+0000 7f66dbf64640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d40b3860 con 0x7f66d40723c0 2024-09-19T05:33:32.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66dbf64640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f66d415b5c0 con 0x7f66d415b1e0 2024-09-19T05:33:32.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66dbf64640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f66d40b3b40 con 0x7f66d40b4900 2024-09-19T05:33:32.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66da501640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f66d40723c0 0x7f66d415ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34590/0 (socket says 172.21.15.67:34590) 2024-09-19T05:33:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66da501640 1 -- 172.21.15.67:0/2777862845 learned_addr learned my addr 172.21.15.67:0/2777862845 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d9d00640 1 --2- 172.21.15.67:0/2777862845 >> v2:172.21.15.67:3300/0 conn(0x7f66d415b1e0 0x7f66d40b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d94ff640 1 --2- 172.21.15.67:0/2777862845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66d40b4900 0x7f66d4071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d8cfe640 1 -- 172.21.15.67:0/2777862845 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404399672 0 0) 0x7f66d40b3860 con 0x7f66d40723c0 2024-09-19T05:33:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d8cfe640 1 -- 172.21.15.67:0/2777862845 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66c0003530 con 0x7f66d40723c0 2024-09-19T05:33:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d9d00640 1 -- 172.21.15.67:0/2777862845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66d40b4900 msgr2=0x7f66d4071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d9d00640 1 --2- 172.21.15.67:0/2777862845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66d40b4900 0x7f66d4071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d9d00640 1 -- 172.21.15.67:0/2777862845 >> v1:172.21.15.67:6789/0 conn(0x7f66d40723c0 legacy=0x7f66d415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d9d00640 1 -- 172.21.15.67:0/2777862845 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d40b3e20 con 0x7f66d415b1e0 2024-09-19T05:33:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d9d00640 1 --2- 172.21.15.67:0/2777862845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 0x7f66d40b2fd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f66d00097c0 tx=0x7f66d001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3ed1fa2d9f5765 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d8cfe640 1 -- 172.21.15.67:0/2777862845 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d00aa5f0 con 0x7f66d415b1e0 2024-09-19T05:33:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d8cfe640 1 -- 172.21.15.67:0/2777862845 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d00af070 con 0x7f66d415b1e0 2024-09-19T05:33:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66d8cfe640 1 -- 172.21.15.67:0/2777862845 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d00aa9b0 con 0x7f66d415b1e0 2024-09-19T05:33:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66dbf64640 1 -- 172.21.15.67:0/2777862845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 msgr2=0x7f66d40b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66dbf64640 1 --2- 172.21.15.67:0/2777862845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 0x7f66d40b2fd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f66d00097c0 tx=0x7f66d001c470 comp rx=0 tx=0).stop 2024-09-19T05:33:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66dbf64640 1 -- 172.21.15.67:0/2777862845 shutdown_connections 2024-09-19T05:33:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66dbf64640 1 --2- 172.21.15.67:0/2777862845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66d40b4900 0x7f66d4071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66dbf64640 1 --2- 172.21.15.67:0/2777862845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 0x7f66d40b2fd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66dbf64640 1 -- 172.21.15.67:0/2777862845 >> 172.21.15.67:0/2777862845 conn(0x7f66d40d0080 msgr2=0x7f66d40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:32.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66dbf64640 1 -- 172.21.15.67:0/2777862845 shutdown_connections 2024-09-19T05:33:32.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.526+0000 7f66dbf64640 1 -- 172.21.15.67:0/2777862845 wait complete. 2024-09-19T05:33:32.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 Processor -- start 2024-09-19T05:33:32.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 -- start start 2024-09-19T05:33:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66d40723c0 0x7f66d4146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66d40b4900 0x7f66d4072e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 0x7f66d4073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66d4166050 con 0x7f66d415b1e0 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f66d40b3510 con 0x7f66d40b4900 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f66d41661d0 con 0x7f66d40723c0 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66da501640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 0x7f66d4073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66da501640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 0x7f66d4073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34722/0 (socket says 172.21.15.67:34722) 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66da501640 1 -- 172.21.15.67:0/3108164715 learned_addr learned my addr 172.21.15.67:0/3108164715 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66d9d00640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66d40723c0 0x7f66d4146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66d94ff640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66d40b4900 0x7f66d4072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66da501640 1 -- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66d40723c0 msgr2=0x7f66d4146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66da501640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66d40723c0 0x7f66d4146800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66da501640 1 -- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66d40b4900 msgr2=0x7f66d4072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66da501640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66d40b4900 0x7f66d4072e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66da501640 1 -- 172.21.15.67:0/3108164715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d415ba50 con 0x7f66d415b1e0 2024-09-19T05:33:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66da501640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 0x7f66d4073390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00cb40 tx=0x7f66cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66ca7fc640 1 -- 172.21.15.67:0/3108164715 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc017070 con 0x7f66d415b1e0 2024-09-19T05:33:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66ca7fc640 1 -- 172.21.15.67:0/3108164715 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc00aca0 con 0x7f66d415b1e0 2024-09-19T05:33:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66ca7fc640 1 -- 172.21.15.67:0/3108164715 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc012620 con 0x7f66d415b1e0 2024-09-19T05:33:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 -- 172.21.15.67:0/3108164715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d414b980 con 0x7f66d415b1e0 2024-09-19T05:33:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 -- 172.21.15.67:0/3108164715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d414bf40 con 0x7f66d415b1e0 2024-09-19T05:33:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66dbf64640 1 -- 172.21.15.67:0/3108164715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d4071e80 con 0x7f66d415b1e0 2024-09-19T05:33:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.530+0000 7f66ca7fc640 1 -- 172.21.15.67:0/3108164715 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66cc01a070 con 0x7f66d415b1e0 2024-09-19T05:33:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.534+0000 7f66ca7fc640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66b80678c0 0x7f66b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.534+0000 7f66ca7fc640 1 -- 172.21.15.67:0/3108164715 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f66cc085ed0 con 0x7f66d415b1e0 2024-09-19T05:33:32.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.534+0000 7f66d9d00640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66b80678c0 0x7f66b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.534+0000 7f66d9d00640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66b80678c0 0x7f66b8069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f66d00ae000 tx=0x7f66d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:32.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.538+0000 7f66ca7fc640 1 -- 172.21.15.67:0/3108164715 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f66cc056650 con 0x7f66d415b1e0 2024-09-19T05:33:32.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 -- 172.21.15.67:0/3108164715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f66d40b4e30 con 0x7f66d415b1e0 2024-09-19T05:33:32.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66ca7fc640 1 -- 172.21.15.67:0/3108164715 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f66cc055f50 con 0x7f66d415b1e0 2024-09-19T05:33:32.733 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:32.733 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T05:33:32.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 -- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66b80678c0 msgr2=0x7f66b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66b80678c0 0x7f66b8069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f66d00ae000 tx=0x7f66d0008040 comp rx=0 tx=0).stop 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 -- 172.21.15.67:0/3108164715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 msgr2=0x7f66d4073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 0x7f66d4073390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00cb40 tx=0x7f66cc00a060 comp rx=0 tx=0).stop 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 -- 172.21.15.67:0/3108164715 shutdown_connections 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66d415b1e0 0x7f66d4073390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66d40b4900 0x7f66d4072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66b80678c0 0x7f66b8069d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 --2- 172.21.15.67:0/3108164715 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66d40723c0 0x7f66d4146800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 -- 172.21.15.67:0/3108164715 >> 172.21.15.67:0/3108164715 conn(0x7f66d40d0080 msgr2=0x7f66d40af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 -- 172.21.15.67:0/3108164715 shutdown_connections 2024-09-19T05:33:32.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.730+0000 7f66dbf64640 1 -- 172.21.15.67:0/3108164715 wait complete. 2024-09-19T05:33:32.751 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-19T05:33:32.751 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.858+0000 7fc0073df640 1 Processor -- start 2024-09-19T05:33:32.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.858+0000 7fc0073df640 1 -- start start 2024-09-19T05:33:32.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc0073df640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc000145ee0 0x7fc0000b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc0073df640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0000b1490 con 0x7fc0000ae1b0 2024-09-19T05:33:32.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc0073df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0000b1770 con 0x7fc00006bcc0 2024-09-19T05:33:32.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc0073df640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc0000cda60 con 0x7fc000145ee0 2024-09-19T05:33:32.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc00517b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc000145ee0 0x7fc0000b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc00597c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc0000ae1b0 0x7fc0000ccc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34602/0 (socket says 172.21.15.67:34602) 2024-09-19T05:33:32.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc00517b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc000145ee0 0x7fc0000b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34728/0 (socket says 172.21.15.67:34728) 2024-09-19T05:33:32.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc00597c640 1 -- 172.21.15.67:0/2130620626 learned_addr learned my addr 172.21.15.67:0/2130620626 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:32.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc00517b640 1 -- 172.21.15.67:0/2130620626 >> v1:172.21.15.97:6789/0 conn(0x7fc00006bcc0 legacy=0x7fc0000b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:32.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc00517b640 1 -- 172.21.15.67:0/2130620626 >> v1:172.21.15.67:6789/0 conn(0x7fc0000ae1b0 legacy=0x7fc0000ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc00517b640 1 -- 172.21.15.67:0/2130620626 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0000b1a50 con 0x7fc000145ee0 2024-09-19T05:33:32.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fbff7fff640 1 -- 172.21.15.67:0/2130620626 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008414851 0 0) 0x7fc0000b1490 con 0x7fc0000ae1b0 2024-09-19T05:33:32.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fc00517b640 1 --2- 172.21.15.67:0/2130620626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc000145ee0 0x7fc0000b0d40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbff00097c0 tx=0x7fbff001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7472270012f8d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:32.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fbff7fff640 1 -- 172.21.15.67:0/2130620626 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff00b0070 con 0x7fc000145ee0 2024-09-19T05:33:32.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fbff7fff640 1 -- 172.21.15.67:0/2130620626 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff00ab600 con 0x7fc000145ee0 2024-09-19T05:33:32.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.862+0000 7fbff7fff640 1 -- 172.21.15.67:0/2130620626 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff00a4e60 con 0x7fc000145ee0 2024-09-19T05:33:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- 172.21.15.67:0/2130620626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc000145ee0 msgr2=0x7fc0000b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 --2- 172.21.15.67:0/2130620626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc000145ee0 0x7fc0000b0d40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbff00097c0 tx=0x7fbff001c3d0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- 172.21.15.67:0/2130620626 shutdown_connections 2024-09-19T05:33:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 --2- 172.21.15.67:0/2130620626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc000145ee0 0x7fc0000b0d40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- 172.21.15.67:0/2130620626 >> 172.21.15.67:0/2130620626 conn(0x7fc00009aa30 msgr2=0x7fc0000b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- 172.21.15.67:0/2130620626 shutdown_connections 2024-09-19T05:33:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- 172.21.15.67:0/2130620626 wait complete. 2024-09-19T05:33:32.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 Processor -- start 2024-09-19T05:33:32.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- start start 2024-09-19T05:33:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc00006bcc0 0x7fc0000b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0000ae1b0 0x7fc00013a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc000145ee0 0x7fc00013ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc0000ae9d0 con 0x7fc00006bcc0 2024-09-19T05:33:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc00016a660 con 0x7fc0000ae1b0 2024-09-19T05:33:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc000167780 con 0x7fc000145ee0 2024-09-19T05:33:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00517b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc00006bcc0 0x7fc0000b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00517b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc00006bcc0 0x7fc0000b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34744/0 (socket says 172.21.15.67:34744) 2024-09-19T05:33:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00517b640 1 -- 172.21.15.67:0/536942982 learned_addr learned my addr 172.21.15.67:0/536942982 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00597c640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc000145ee0 0x7fc00013ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00497a640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0000ae1b0 0x7fc00013a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00517b640 1 -- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc000145ee0 msgr2=0x7fc00013ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00517b640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc000145ee0 0x7fc00013ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00517b640 1 -- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0000ae1b0 msgr2=0x7fc00013a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00517b640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0000ae1b0 0x7fc00013a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00517b640 1 -- 172.21.15.67:0/536942982 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00013cd10 con 0x7fc00006bcc0 2024-09-19T05:33:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00597c640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc000145ee0 0x7fc00013ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00497a640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0000ae1b0 0x7fc00013a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc00517b640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc00006bcc0 0x7fc0000b57b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbff0018fe0 tx=0x7fbff001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fbff5ffb640 1 -- 172.21.15.67:0/536942982 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff00b0050 con 0x7fc00006bcc0 2024-09-19T05:33:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fbff5ffb640 1 -- 172.21.15.67:0/536942982 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff00bc070 con 0x7fc00006bcc0 2024-09-19T05:33:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- 172.21.15.67:0/536942982 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00013cff0 con 0x7fc00006bcc0 2024-09-19T05:33:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fbff5ffb640 1 -- 172.21.15.67:0/536942982 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff00b5850 con 0x7fc00006bcc0 2024-09-19T05:33:32.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- 172.21.15.67:0/536942982 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00013d5b0 con 0x7fc00006bcc0 2024-09-19T05:33:32.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.866+0000 7fc0073df640 1 -- 172.21.15.67:0/536942982 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc00013c080 con 0x7fc00006bcc0 2024-09-19T05:33:32.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.870+0000 7fbff5ffb640 1 -- 172.21.15.67:0/536942982 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbff00b59f0 con 0x7fc00006bcc0 2024-09-19T05:33:32.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.870+0000 7fbff5ffb640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbfe40678c0 0x7fbfe4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:32.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.870+0000 7fbff5ffb640 1 -- 172.21.15.67:0/536942982 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbff0120740 con 0x7fc00006bcc0 2024-09-19T05:33:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.870+0000 7fc00497a640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbfe40678c0 0x7fbfe4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.870+0000 7fc00497a640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbfe40678c0 0x7fbfe4069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc000135d90 tx=0x7fbffc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:32.874+0000 7fbff5ffb640 1 -- 172.21.15.67:0/536942982 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fbff0016050 con 0x7fc00006bcc0 2024-09-19T05:33:33.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.062+0000 7fc0073df640 1 -- 172.21.15.67:0/536942982 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc00013bda0 con 0x7fc00006bcc0 2024-09-19T05:33:33.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.062+0000 7fbff5ffb640 1 -- 172.21.15.67:0/536942982 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7fbff00f0fd0 con 0x7fc00006bcc0 2024-09-19T05:33:33.067 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:33.067 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"btime":"2024-09-19T05:33:28:174068+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:33:13.876770+0000","modified":"2024-09-19T05:33:27.556615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-19T05:33:33.067 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-09-19T05:33:33.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 -- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbfe40678c0 msgr2=0x7fbfe4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbfe40678c0 0x7fbfe4069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc000135d90 tx=0x7fbffc008040 comp rx=0 tx=0).stop 2024-09-19T05:33:33.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 -- 172.21.15.67:0/536942982 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc00006bcc0 msgr2=0x7fc0000b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc00006bcc0 0x7fc0000b57b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbff0018fe0 tx=0x7fbff001ac10 comp rx=0 tx=0).stop 2024-09-19T05:33:33.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 -- 172.21.15.67:0/536942982 shutdown_connections 2024-09-19T05:33:33.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbfe40678c0 0x7fbfe4069d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc000145ee0 0x7fc00013ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0000ae1b0 0x7fc00013a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 --2- 172.21.15.67:0/536942982 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc00006bcc0 0x7fc0000b57b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 -- 172.21.15.67:0/536942982 >> 172.21.15.67:0/536942982 conn(0x7fc00009aa30 msgr2=0x7fc0000aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:33.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 -- 172.21.15.67:0/536942982 shutdown_connections 2024-09-19T05:33:33.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.066+0000 7fc0073df640 1 -- 172.21.15.67:0/536942982 wait complete. 2024-09-19T05:33:33.085 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:33.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febf17dd640 1 Processor -- start 2024-09-19T05:33:33.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febf17dd640 1 -- start start 2024-09-19T05:33:33.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febf17dd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febec15c030 0x7febec06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febf17dd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 0x7febec0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febf17dd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febec06e3c0 con 0x7febec0b3510 2024-09-19T05:33:33.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febf17dd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7febec06e6a0 con 0x7febec15c030 2024-09-19T05:33:33.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febf17dd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7febec06e980 con 0x7febec15d1d0 2024-09-19T05:33:33.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febeaffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febec15c030 0x7febec06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febeaffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febec15c030 0x7febec06dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34754/0 (socket says 172.21.15.67:34754) 2024-09-19T05:33:33.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febeaffd640 1 -- 172.21.15.67:0/4153982705 learned_addr learned my addr 172.21.15.67:0/4153982705 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:33.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febea7fc640 1 --2- 172.21.15.67:0/4153982705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 0x7febec0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febeaffd640 1 -- 172.21.15.67:0/4153982705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 msgr2=0x7febec0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:33.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febeaffd640 1 --2- 172.21.15.67:0/4153982705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 0x7febec0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febeaffd640 1 -- 172.21.15.67:0/4153982705 >> v1:172.21.15.97:6789/0 conn(0x7febec0b3510 legacy=0x7febec06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.194+0000 7febeaffd640 1 -- 172.21.15.67:0/4153982705 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec06ec60 con 0x7febec15c030 2024-09-19T05:33:33.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febeaffd640 1 --2- 172.21.15.67:0/4153982705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15c030 0x7febec06dde0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7febdc009870 tx=0x7febdc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b629e345176ac8fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:33.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febe9ffb640 1 -- 172.21.15.67:0/4153982705 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc0aa620 con 0x7febec15c030 2024-09-19T05:33:33.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febe9ffb640 1 -- 172.21.15.67:0/4153982705 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febdc0af070 con 0x7febec15c030 2024-09-19T05:33:33.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febe9ffb640 1 -- 172.21.15.67:0/4153982705 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc0aa9e0 con 0x7febec15c030 2024-09-19T05:33:33.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 -- 172.21.15.67:0/4153982705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15c030 msgr2=0x7febec06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 --2- 172.21.15.67:0/4153982705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15c030 0x7febec06dde0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7febdc009870 tx=0x7febdc01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 -- 172.21.15.67:0/4153982705 shutdown_connections 2024-09-19T05:33:33.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 --2- 172.21.15.67:0/4153982705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 0x7febec0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 --2- 172.21.15.67:0/4153982705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15c030 0x7febec06dde0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 -- 172.21.15.67:0/4153982705 >> 172.21.15.67:0/4153982705 conn(0x7febec0d0080 msgr2=0x7febec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:33.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 -- 172.21.15.67:0/4153982705 shutdown_connections 2024-09-19T05:33:33.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 -- 172.21.15.67:0/4153982705 wait complete. 2024-09-19T05:33:33.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 Processor -- start 2024-09-19T05:33:33.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 -- start start 2024-09-19T05:33:33.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec0b3510 0x7febec15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec15c030 0x7febec147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 0x7febec099570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7febec15c590 con 0x7febec0b3510 2024-09-19T05:33:33.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7febec15c410 con 0x7febec15c030 2024-09-19T05:33:33.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febf17dd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7febec1690e0 con 0x7febec15d1d0 2024-09-19T05:33:33.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febeaffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec0b3510 0x7febec15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febeaffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec0b3510 0x7febec15dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34768/0 (socket says 172.21.15.67:34768) 2024-09-19T05:33:33.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.198+0000 7febeaffd640 1 -- 172.21.15.67:0/4112180814 learned_addr learned my addr 172.21.15.67:0/4112180814 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:33.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febea7fc640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec15c030 0x7febec147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febeb7fe640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 0x7febec099570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febeaffd640 1 -- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 msgr2=0x7febec099570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febeaffd640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 0x7febec099570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febeaffd640 1 -- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec15c030 msgr2=0x7febec147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febeaffd640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec15c030 0x7febec147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febeaffd640 1 -- 172.21.15.67:0/4112180814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec149bf0 con 0x7febec0b3510 2024-09-19T05:33:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febea7fc640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec15c030 0x7febec147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febeb7fe640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 0x7febec099570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febeaffd640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec0b3510 0x7febec15dc90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7febdc0ac040 tx=0x7febdc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:33.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febd37fe640 1 -- 172.21.15.67:0/4112180814 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc0aad90 con 0x7febec0b3510 2024-09-19T05:33:33.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febd37fe640 1 -- 172.21.15.67:0/4112180814 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febdc0bd3f0 con 0x7febec0b3510 2024-09-19T05:33:33.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febf17dd640 1 -- 172.21.15.67:0/4112180814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febec149e60 con 0x7febec0b3510 2024-09-19T05:33:33.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febd37fe640 1 -- 172.21.15.67:0/4112180814 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc0bd7e0 con 0x7febec0b3510 2024-09-19T05:33:33.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febf17dd640 1 -- 172.21.15.67:0/4112180814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febec15ec50 con 0x7febec0b3510 2024-09-19T05:33:33.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febf17dd640 1 -- 172.21.15.67:0/4112180814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febec06dde0 con 0x7febec0b3510 2024-09-19T05:33:33.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febd37fe640 1 -- 172.21.15.67:0/4112180814 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7febdc0c6440 con 0x7febec0b3510 2024-09-19T05:33:33.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febd37fe640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd80678c0 0x7febd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febd37fe640 1 -- 172.21.15.67:0/4112180814 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7febdc1204c0 con 0x7febec0b3510 2024-09-19T05:33:33.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.202+0000 7febea7fc640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd80678c0 0x7febd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.206+0000 7febea7fc640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd80678c0 0x7febd8069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7febec1517c0 tx=0x7febe0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.206+0000 7febd37fe640 1 -- 172.21.15.67:0/4112180814 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7febdc016150 con 0x7febec0b3510 2024-09-19T05:33:33.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.402+0000 7febf17dd640 1 -- 172.21.15.67:0/4112180814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febec0d0f20 con 0x7febec0b3510 2024-09-19T05:33:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.402+0000 7febd37fe640 1 -- 172.21.15.67:0/4112180814 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7febdc0f0d50 con 0x7febec0b3510 2024-09-19T05:33:33.406 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:33.406 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"btime":"2024-09-19T05:33:28:174068+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:33:13.876770+0000","modified":"2024-09-19T05:33:27.556615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-19T05:33:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-09-19T05:33:33.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 -- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd80678c0 msgr2=0x7febd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd80678c0 0x7febd8069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7febec1517c0 tx=0x7febe0008040 comp rx=0 tx=0).stop 2024-09-19T05:33:33.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 -- 172.21.15.67:0/4112180814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec0b3510 msgr2=0x7febec15dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec0b3510 0x7febec15dc90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7febdc0ac040 tx=0x7febdc01ace0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 -- 172.21.15.67:0/4112180814 shutdown_connections 2024-09-19T05:33:33.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd80678c0 0x7febd8069d80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec15d1d0 0x7febec099570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec15c030 0x7febec147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 --2- 172.21.15.67:0/4112180814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec0b3510 0x7febec15dc90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 -- 172.21.15.67:0/4112180814 >> 172.21.15.67:0/4112180814 conn(0x7febec0d0080 msgr2=0x7febec06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:33.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 -- 172.21.15.67:0/4112180814 shutdown_connections 2024-09-19T05:33:33.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.406+0000 7febf17dd640 1 -- 172.21.15.67:0/4112180814 wait complete. 2024-09-19T05:33:33.424 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:33.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f600a830640 1 Processor -- start 2024-09-19T05:33:33.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f600a830640 1 -- start start 2024-09-19T05:33:33.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f600a830640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60040b4900 0x7f6004071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f600a830640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60040b3860 con 0x7f600415b1e0 2024-09-19T05:33:33.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f600a830640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60040b3b40 con 0x7f60040723c0 2024-09-19T05:33:33.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f600a830640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f600415b5c0 con 0x7f60040b4900 2024-09-19T05:33:33.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6003fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f600415b1e0 0x7f60040b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34618/0 (socket says 172.21.15.67:34618) 2024-09-19T05:33:33.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6003fff640 1 -- 172.21.15.67:0/522910844 learned_addr learned my addr 172.21.15.67:0/522910844 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:33.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f60037fe640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60040b4900 0x7f6004071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686217271 0 0) 0x7f60040b3860 con 0x7f600415b1e0 2024-09-19T05:33:33.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fec003530 con 0x7f600415b1e0 2024-09-19T05:33:33.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931400537 0 0) 0x7f60040b3b40 con 0x7f60040723c0 2024-09-19T05:33:33.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60040b3860 con 0x7f60040723c0 2024-09-19T05:33:33.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 134030887 0 0) 0x7f5fec003530 con 0x7f600415b1e0 2024-09-19T05:33:33.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60040b4900 msgr2=0x7f6004071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:33.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60040b4900 0x7f6004071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 >> v1:172.21.15.97:6789/0 conn(0x7f60040723c0 legacy=0x7f60040ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60040b3e20 con 0x7f600415b1e0 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f5ff4001680 con 0x7f600415b1e0 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 >> v1:172.21.15.67:6789/0 conn(0x7f600415b1e0 legacy=0x7f60040b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fec003b80 0x7f5fec003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60040b4900 0x7f5fec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5fec004d50 0x7f5fec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f600415b5c0 con 0x7f5fec003b80 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec00ba80 con 0x7f5fec004d50 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5fec00bc30 con 0x7f60040b4900 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6003fff640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fec003b80 0x7f5fec003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6008dcd640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5fec004d50 0x7f5fec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f60037fe640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60040b4900 0x7f5fec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6003fff640 1 -- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60040b4900 msgr2=0x7f5fec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6003fff640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60040b4900 0x7f5fec004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6003fff640 1 -- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5fec004d50 msgr2=0x7f5fec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:33.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6003fff640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5fec004d50 0x7f5fec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.542+0000 7f6003fff640 1 -- 172.21.15.67:0/522910844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec003530 con 0x7f5fec003b80 2024-09-19T05:33:33.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f6003fff640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fec003b80 0x7f5fec003f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c190 tx=0x7f5ff401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a8730e0391bec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:33.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4007cd0 con 0x7f5fec003b80 2024-09-19T05:33:33.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff40a9020 con 0x7f5fec003b80 2024-09-19T05:33:33.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f6002ffd640 1 -- 172.21.15.67:0/522910844 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff40a5af0 con 0x7f5fec003b80 2024-09-19T05:33:33.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f600a830640 1 -- 172.21.15.67:0/522910844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fec003b80 msgr2=0x7f5fec003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f600a830640 1 --2- 172.21.15.67:0/522910844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fec003b80 0x7f5fec003f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c190 tx=0x7f5ff401cbf0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f6008dcd640 1 -- 172.21.15.67:0/522910844 reap_dead start 2024-09-19T05:33:33.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f600a830640 1 -- 172.21.15.67:0/522910844 shutdown_connections 2024-09-19T05:33:33.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f600a830640 1 -- 172.21.15.67:0/522910844 >> 172.21.15.67:0/522910844 conn(0x7f60040d0080 msgr2=0x7f60040d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:33.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f600a830640 1 -- 172.21.15.67:0/522910844 shutdown_connections 2024-09-19T05:33:33.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f600a830640 1 -- 172.21.15.67:0/522910844 wait complete. 2024-09-19T05:33:33.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f600a830640 1 Processor -- start 2024-09-19T05:33:33.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.546+0000 7f600a830640 1 -- start start 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f600a830640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5fec003b80 0x7f6004147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f600a830640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f600415fff0 0x7f6004160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f600a830640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60041560f0 0x7f6004156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f600a830640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6004167060 con 0x7f600415fff0 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f600a830640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f60040aed30 con 0x7f5fec003b80 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f600a830640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f60041671e0 con 0x7f60041560f0 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f60037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f600415fff0 0x7f6004160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f60037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f600415fff0 0x7f6004160470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34798/0 (socket says 172.21.15.67:34798) 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f60037fe640 1 -- 172.21.15.67:0/1232961337 learned_addr learned my addr 172.21.15.67:0/1232961337 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f6003fff640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5fec003b80 0x7f6004147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f6008dcd640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60041560f0 0x7f6004156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f60037fe640 1 -- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60041560f0 msgr2=0x7f6004156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f60037fe640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60041560f0 0x7f6004156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f60037fe640 1 -- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5fec003b80 msgr2=0x7f6004147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f60037fe640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5fec003b80 0x7f6004147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f60037fe640 1 -- 172.21.15.67:0/1232961337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6004147ac0 con 0x7f600415fff0 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f6003fff640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5fec003b80 0x7f6004147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f60037fe640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f600415fff0 0x7f6004160470 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80108c0 tx=0x7f5ff8010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f6000ff9640 1 -- 172.21.15.67:0/1232961337 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff800f040 con 0x7f600415fff0 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f6000ff9640 1 -- 172.21.15.67:0/1232961337 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff800eb60 con 0x7f600415fff0 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f6000ff9640 1 -- 172.21.15.67:0/1232961337 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff801c400 con 0x7f600415fff0 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f600a830640 1 -- 172.21.15.67:0/1232961337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6004160ab0 con 0x7f600415fff0 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f600a830640 1 -- 172.21.15.67:0/1232961337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6004161070 con 0x7f600415fff0 2024-09-19T05:33:33.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f600a830640 1 -- 172.21.15.67:0/1232961337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60040ade10 con 0x7f600415fff0 2024-09-19T05:33:33.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f6000ff9640 1 -- 172.21.15.67:0/1232961337 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ff801c5a0 con 0x7f600415fff0 2024-09-19T05:33:33.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f6000ff9640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ff00678c0 0x7f5ff0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f6000ff9640 1 -- 172.21.15.67:0/1232961337 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5ff8086690 con 0x7f600415fff0 2024-09-19T05:33:33.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.550+0000 7f6003fff640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ff00678c0 0x7f5ff0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.554+0000 7f6003fff640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ff00678c0 0x7f5ff0069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40aa000 tx=0x7f5ff40b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:33.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.554+0000 7f6000ff9640 1 -- 172.21.15.67:0/1232961337 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5ff8018030 con 0x7f600415fff0 2024-09-19T05:33:33.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.718+0000 7f600a830640 1 -- 172.21.15.67:0/1232961337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60040b4e30 con 0x7f600415fff0 2024-09-19T05:33:33.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.722+0000 7f6000ff9640 1 -- 172.21.15.67:0/1232961337 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f5ff8056e90 con 0x7f600415fff0 2024-09-19T05:33:33.726 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:33.726 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:33.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 -- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ff00678c0 msgr2=0x7f5ff0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ff00678c0 0x7f5ff0069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40aa000 tx=0x7f5ff40b0040 comp rx=0 tx=0).stop 2024-09-19T05:33:33.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 -- 172.21.15.67:0/1232961337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f600415fff0 msgr2=0x7f6004160470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f600415fff0 0x7f6004160470 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80108c0 tx=0x7f5ff8010d80 comp rx=0 tx=0).stop 2024-09-19T05:33:33.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 -- 172.21.15.67:0/1232961337 shutdown_connections 2024-09-19T05:33:33.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ff00678c0 0x7f5ff0069d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60041560f0 0x7f6004156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f600415fff0 0x7f6004160470 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 --2- 172.21.15.67:0/1232961337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5fec003b80 0x7f6004147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 -- 172.21.15.67:0/1232961337 >> 172.21.15.67:0/1232961337 conn(0x7f60040d0080 msgr2=0x7f600415eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:33.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 -- 172.21.15.67:0/1232961337 shutdown_connections 2024-09-19T05:33:33.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.726+0000 7f600a830640 1 -- 172.21.15.67:0/1232961337 wait complete. 2024-09-19T05:33:33.745 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:33.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.858+0000 7fd7b329e640 1 Processor -- start 2024-09-19T05:33:33.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.858+0000 7fd7b329e640 1 -- start start 2024-09-19T05:33:33.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b329e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd7ac15b710 0x7fd7ac071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b329e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7ac0b3070 con 0x7fd7ac15baf0 2024-09-19T05:33:33.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b329e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7ac0afa70 con 0x7fd7ac0aef40 2024-09-19T05:33:33.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b329e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd7ac0b32e0 con 0x7fd7ac15b710 2024-09-19T05:33:33.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b103a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd7ac15b710 0x7fd7ac071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b0839640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd7ac15baf0 0x7fd7ac15bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34632/0 (socket says 172.21.15.67:34632) 2024-09-19T05:33:33.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b0839640 1 -- 172.21.15.67:0/2348004175 learned_addr learned my addr 172.21.15.67:0/2348004175 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:33.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b103a640 1 -- 172.21.15.67:0/2348004175 >> v1:172.21.15.97:6789/0 conn(0x7fd7ac0aef40 legacy=0x7fd7ac0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b103a640 1 -- 172.21.15.67:0/2348004175 >> v1:172.21.15.67:6789/0 conn(0x7fd7ac15baf0 legacy=0x7fd7ac15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b103a640 1 -- 172.21.15.67:0/2348004175 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac0b35c0 con 0x7fd7ac15b710 2024-09-19T05:33:33.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b103a640 1 --2- 172.21.15.67:0/2348004175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15b710 0x7fd7ac071e80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80097c0 tx=0x7fd7a801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf8626650289c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:33.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7a3fff640 1 -- 172.21.15.67:0/2348004175 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80a7070 con 0x7fd7ac15b710 2024-09-19T05:33:33.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7a3fff640 1 -- 172.21.15.67:0/2348004175 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a80b0070 con 0x7fd7ac15b710 2024-09-19T05:33:33.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7a3fff640 1 -- 172.21.15.67:0/2348004175 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80ab890 con 0x7fd7ac15b710 2024-09-19T05:33:33.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.862+0000 7fd7b329e640 1 -- 172.21.15.67:0/2348004175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15b710 msgr2=0x7fd7ac071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 --2- 172.21.15.67:0/2348004175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15b710 0x7fd7ac071e80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80097c0 tx=0x7fd7a801c470 comp rx=0 tx=0).stop 2024-09-19T05:33:33.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- 172.21.15.67:0/2348004175 shutdown_connections 2024-09-19T05:33:33.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 --2- 172.21.15.67:0/2348004175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15b710 0x7fd7ac071e80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- 172.21.15.67:0/2348004175 >> 172.21.15.67:0/2348004175 conn(0x7fd7ac0d0080 msgr2=0x7fd7ac0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:33.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- 172.21.15.67:0/2348004175 shutdown_connections 2024-09-19T05:33:33.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- 172.21.15.67:0/2348004175 wait complete. 2024-09-19T05:33:33.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 Processor -- start 2024-09-19T05:33:33.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- start start 2024-09-19T05:33:33.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7ac0aef40 0x7fd7ac15a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7ac15b710 0x7fd7ac1450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15baf0 0x7fd7ac145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac0b4c40 con 0x7fd7ac15baf0 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac0b4ac0 con 0x7fd7ac15b710 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd7ac0b4dc0 con 0x7fd7ac0aef40 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b183b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15baf0 0x7fd7ac145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b183b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15baf0 0x7fd7ac145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34808/0 (socket says 172.21.15.67:34808) 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b183b640 1 -- 172.21.15.67:0/308672636 learned_addr learned my addr 172.21.15.67:0/308672636 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b0839640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7ac15b710 0x7fd7ac1450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b103a640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7ac0aef40 0x7fd7ac15a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b183b640 1 -- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7ac0aef40 msgr2=0x7fd7ac15a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b183b640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7ac0aef40 0x7fd7ac15a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b183b640 1 -- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7ac15b710 msgr2=0x7fd7ac1450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b183b640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7ac15b710 0x7fd7ac1450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b183b640 1 -- 172.21.15.67:0/308672636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac15b0b0 con 0x7fd7ac15baf0 2024-09-19T05:33:33.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b183b640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15baf0 0x7fd7ac145610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400c770 tx=0x7fd7a400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:33.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7a1ffb640 1 -- 172.21.15.67:0/308672636 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4003b80 con 0x7fd7ac15baf0 2024-09-19T05:33:33.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7a1ffb640 1 -- 172.21.15.67:0/308672636 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a4003d20 con 0x7fd7ac15baf0 2024-09-19T05:33:33.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- 172.21.15.67:0/308672636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ac1490a0 con 0x7fd7ac15baf0 2024-09-19T05:33:33.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7a1ffb640 1 -- 172.21.15.67:0/308672636 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400aa90 con 0x7fd7ac15baf0 2024-09-19T05:33:33.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- 172.21.15.67:0/308672636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ac14b320 con 0x7fd7ac15baf0 2024-09-19T05:33:33.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.866+0000 7fd7b329e640 1 -- 172.21.15.67:0/308672636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ac071e80 con 0x7fd7ac15baf0 2024-09-19T05:33:33.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.870+0000 7fd7a1ffb640 1 -- 172.21.15.67:0/308672636 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd7a400ac30 con 0x7fd7ac15baf0 2024-09-19T05:33:33.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.870+0000 7fd7a1ffb640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7900678c0 0x7fd790069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:33.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.870+0000 7fd7a1ffb640 1 -- 172.21.15.67:0/308672636 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd7a4085e60 con 0x7fd7ac15baf0 2024-09-19T05:33:33.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.870+0000 7fd7b103a640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7900678c0 0x7fd790069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:33.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.870+0000 7fd7b103a640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7900678c0 0x7fd790069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80af000 tx=0x7fd7a80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:33.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:33.874+0000 7fd7a1ffb640 1 -- 172.21.15.67:0/308672636 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd7a40566f0 con 0x7fd7ac15baf0 2024-09-19T05:33:34.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.066+0000 7fd7b329e640 1 -- 172.21.15.67:0/308672636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7ac0b5020 con 0x7fd7ac15baf0 2024-09-19T05:33:34.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.066+0000 7fd7a1ffb640 1 -- 172.21.15.67:0/308672636 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7fd7a4055ff0 con 0x7fd7ac15baf0 2024-09-19T05:33:34.071 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:34.071 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"btime":"2024-09-19T05:33:28:174068+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:33:13.876770+0000","modified":"2024-09-19T05:33:27.556615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-19T05:33:34.071 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-09-19T05:33:34.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 -- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7900678c0 msgr2=0x7fd790069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7900678c0 0x7fd790069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80af000 tx=0x7fd7a80a7000 comp rx=0 tx=0).stop 2024-09-19T05:33:34.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 -- 172.21.15.67:0/308672636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15baf0 msgr2=0x7fd7ac145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15baf0 0x7fd7ac145610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400c770 tx=0x7fd7a400cc30 comp rx=0 tx=0).stop 2024-09-19T05:33:34.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 -- 172.21.15.67:0/308672636 shutdown_connections 2024-09-19T05:33:34.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac15baf0 0x7fd7ac145610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7ac15b710 0x7fd7ac1450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7900678c0 0x7fd790069d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 --2- 172.21.15.67:0/308672636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7ac0aef40 0x7fd7ac15a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 -- 172.21.15.67:0/308672636 >> 172.21.15.67:0/308672636 conn(0x7fd7ac0d0080 msgr2=0x7fd7ac0ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:34.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 -- 172.21.15.67:0/308672636 shutdown_connections 2024-09-19T05:33:34.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.070+0000 7fd7b329e640 1 -- 172.21.15.67:0/308672636 wait complete. 2024-09-19T05:33:34.491 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:33:13.876770+0000', 'modified': '2024-09-19T05:33:27.556615+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/3064059806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 3064059806}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 3064059806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4288, 'qdb_cluster': [4288]} 2024-09-19T05:33:34.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:33:34.492 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T05:33:34.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237ebf1640 1 Processor -- start 2024-09-19T05:33:34.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237ebf1640 1 -- start start 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237ebf1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f237815e330 0x7f2378071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237ebf1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f23780b2fd0 0x7f23780724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237ebf1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23780b4420 con 0x7f23780b4bc0 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237ebf1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f23780acfb0 con 0x7f237815e330 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237ebf1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f23780b3ef0 con 0x7f23780b2fd0 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237c98d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f237815e330 0x7f2378071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237c98d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f237815e330 0x7f2378071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34816/0 (socket says 172.21.15.67:34816) 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237c98d640 1 -- 172.21.15.67:0/770284947 learned_addr learned my addr 172.21.15.67:0/770284947 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237c98d640 1 -- 172.21.15.67:0/770284947 >> v2:172.21.15.97:3300/0 conn(0x7f23780b2fd0 msgr2=0x7f23780724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f2377fff640 1 --2- 172.21.15.67:0/770284947 >> v2:172.21.15.97:3300/0 conn(0x7f23780b2fd0 0x7f23780724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237c98d640 1 --2- 172.21.15.67:0/770284947 >> v2:172.21.15.97:3300/0 conn(0x7f23780b2fd0 0x7f23780724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237c98d640 1 -- 172.21.15.67:0/770284947 >> v1:172.21.15.97:6789/0 conn(0x7f23780b4bc0 legacy=0x7f2378161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:34.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f237c98d640 1 -- 172.21.15.67:0/770284947 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23780b4140 con 0x7f237815e330 2024-09-19T05:33:34.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.626+0000 7f2377fff640 1 --2- 172.21.15.67:0/770284947 >> v2:172.21.15.97:3300/0 conn(0x7f23780b2fd0 0x7f23780724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:34.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237c98d640 1 --2- 172.21.15.67:0/770284947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f237815e330 0x7f2378071fa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f23780b2d60 tx=0x7f236801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c04cc4e0df05d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:34.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f23777fe640 1 -- 172.21.15.67:0/770284947 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23680b1070 con 0x7f237815e330 2024-09-19T05:33:34.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f23777fe640 1 -- 172.21.15.67:0/770284947 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23680ac630 con 0x7f237815e330 2024-09-19T05:33:34.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f23777fe640 1 -- 172.21.15.67:0/770284947 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23680a8050 con 0x7f237815e330 2024-09-19T05:33:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237ebf1640 1 -- 172.21.15.67:0/770284947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f237815e330 msgr2=0x7f2378071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237ebf1640 1 --2- 172.21.15.67:0/770284947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f237815e330 0x7f2378071fa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f23780b2d60 tx=0x7f236801c4b0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237ebf1640 1 -- 172.21.15.67:0/770284947 shutdown_connections 2024-09-19T05:33:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237ebf1640 1 --2- 172.21.15.67:0/770284947 >> v2:172.21.15.97:3300/0 conn(0x7f23780b2fd0 0x7f23780724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237ebf1640 1 --2- 172.21.15.67:0/770284947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f237815e330 0x7f2378071fa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237ebf1640 1 -- 172.21.15.67:0/770284947 >> 172.21.15.67:0/770284947 conn(0x7f23780d0080 msgr2=0x7f23780d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237ebf1640 1 -- 172.21.15.67:0/770284947 shutdown_connections 2024-09-19T05:33:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237ebf1640 1 -- 172.21.15.67:0/770284947 wait complete. 2024-09-19T05:33:34.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237ebf1640 1 Processor -- start 2024-09-19T05:33:34.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.630+0000 7f237ebf1640 1 -- start start 2024-09-19T05:33:34.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237ebf1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23780b4bc0 0x7f2378160f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237ebf1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f237815e330 0x7f2378154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237ebf1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2378154660 0x7f2378150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237ebf1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f237806f880 con 0x7f2378154660 2024-09-19T05:33:34.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237ebf1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f237806f700 con 0x7f237815e330 2024-09-19T05:33:34.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237ebf1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f23780cfcc0 con 0x7f23780b4bc0 2024-09-19T05:33:34.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237d18e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2378154660 0x7f2378150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237d18e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2378154660 0x7f2378150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34824/0 (socket says 172.21.15.67:34824) 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237d18e640 1 -- 172.21.15.67:0/1679101329 learned_addr learned my addr 172.21.15.67:0/1679101329 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237c98d640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23780b4bc0 0x7f2378160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f2377fff640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f237815e330 0x7f2378154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237d18e640 1 -- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23780b4bc0 msgr2=0x7f2378160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237d18e640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23780b4bc0 0x7f2378160f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237d18e640 1 -- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f237815e330 msgr2=0x7f2378154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237d18e640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f237815e330 0x7f2378154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237d18e640 1 -- 172.21.15.67:0/1679101329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237814fc50 con 0x7f2378154660 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237c98d640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23780b4bc0 0x7f2378160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237d18e640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2378154660 0x7f2378150df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f237000c7b0 tx=0x7f237000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f23757fa640 1 -- 172.21.15.67:0/1679101329 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370016020 con 0x7f2378154660 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f23757fa640 1 -- 172.21.15.67:0/1679101329 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237000a9f0 con 0x7f2378154660 2024-09-19T05:33:34.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237ebf1640 1 -- 172.21.15.67:0/1679101329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23781509a0 con 0x7f2378154660 2024-09-19T05:33:34.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f23757fa640 1 -- 172.21.15.67:0/1679101329 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237000ade0 con 0x7f2378154660 2024-09-19T05:33:34.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237ebf1640 1 -- 172.21.15.67:0/1679101329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237814fec0 con 0x7f2378154660 2024-09-19T05:33:34.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f23757fa640 1 -- 172.21.15.67:0/1679101329 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2370019020 con 0x7f2378154660 2024-09-19T05:33:34.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f23757fa640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23640678f0 0x7f2364069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f23757fa640 1 -- 172.21.15.67:0/1679101329 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2370085f10 con 0x7f2378154660 2024-09-19T05:33:34.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.634+0000 7f237c98d640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23640678f0 0x7f2364069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 Processor -- start 2024-09-19T05:33:34.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 -- start start 2024-09-19T05:33:34.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f237c98d640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23640678f0 0x7f2364069db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23680ae000 tx=0x7f2368008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:34.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 0x55d228a25f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289dbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289dc290 0x55d2289dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d2288c3b60 con 0x55d228a26440 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d22882ac70 con 0x55d2289dc290 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d2287d0ed0 con 0x55d228a25b20 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2377fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289dbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2377fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289dbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34832/0 (socket says 172.21.15.67:34832) 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2377fff640 1 -- 172.21.15.67:0/289992842 learned_addr learned my addr 172.21.15.67:0/289992842 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f237d18e640 1 --2- 172.21.15.67:0/289992842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289dc290 0x55d2289dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f237c98d640 1 --2- 172.21.15.67:0/289992842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 0x55d228a25f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2377fff640 1 -- 172.21.15.67:0/289992842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 msgr2=0x55d228a25f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2377fff640 1 --2- 172.21.15.67:0/289992842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 0x55d228a25f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2377fff640 1 -- 172.21.15.67:0/289992842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289dc290 msgr2=0x55d2289dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2377fff640 1 --2- 172.21.15.67:0/289992842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289dc290 0x55d2289dc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2377fff640 1 -- 172.21.15.67:0/289992842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2287e2e50 con 0x55d228a26440 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2377fff640 1 --2- 172.21.15.67:0/289992842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289dbd50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f236c004660 tx=0x7f236c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05a35fca3b69292 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f235e7fc640 1 -- 172.21.15.67:0/289992842 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c00f9c0 con 0x55d228a26440 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f235e7fc640 1 -- 172.21.15.67:0/289992842 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236c00fb60 con 0x55d228a26440 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f235e7fc640 1 -- 172.21.15.67:0/289992842 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c014480 con 0x55d228a26440 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 -- 172.21.15.67:0/289992842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 msgr2=0x55d2289dbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 --2- 172.21.15.67:0/289992842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289dbd50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f236c004660 tx=0x7f236c00dd90 comp rx=0 tx=0).stop 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 -- 172.21.15.67:0/289992842 shutdown_connections 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 --2- 172.21.15.67:0/289992842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289dc290 0x55d2289dc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 --2- 172.21.15.67:0/289992842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289dbd50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 --2- 172.21.15.67:0/289992842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 0x55d228a25f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 -- 172.21.15.67:0/289992842 >> 172.21.15.67:0/289992842 conn(0x55d2289e2600 msgr2=0x55d2289da630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 -- 172.21.15.67:0/289992842 shutdown_connections 2024-09-19T05:33:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 -- 172.21.15.67:0/289992842 wait complete. 2024-09-19T05:33:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 -- start start 2024-09-19T05:33:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.638+0000 7f2381cad000 1 Processor -- start 2024-09-19T05:33:34.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 0x55d2289e0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289e6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d2289e7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d22888cb00 con 0x55d228a26440 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d228805360 con 0x55d2289e1330 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d2288022d0 con 0x55d228a25b20 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 10 client.0 _ll_register_callbacks cb 0x55d2289c7820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2377fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289e6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2377fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289e6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34840/0 (socket says 172.21.15.67:34840) 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2377fff640 1 -- 172.21.15.67:0/601362927 learned_addr learned my addr 172.21.15.67:0/601362927 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f237c98d640 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 0x55d2289e0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f237d18e640 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d2289e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2377fff640 1 -- 172.21.15.67:0/601362927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 msgr2=0x55d2289e0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2377fff640 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 0x55d2289e0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2377fff640 1 -- 172.21.15.67:0/601362927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 msgr2=0x55d2289e7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:34.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2377fff640 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d2289e7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2377fff640 1 -- 172.21.15.67:0/601362927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2287d1120 con 0x55d228a26440 2024-09-19T05:33:34.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f237c98d640 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 0x55d2289e0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:34.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f237d18e640 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d2289e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:34.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2377fff640 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289e6cf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f236c008010 tx=0x7f236c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d692446a5f4db2df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:34.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f23577fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:33:34.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f23577fe640 1 -- 172.21.15.67:0/601362927 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c02c060 con 0x55d228a26440 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f23577fe640 1 -- 172.21.15.67:0/601362927 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f236c014a50 con 0x55d228a26440 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- 172.21.15.67:0/601362927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f236c00fb60 con 0x55d228a26440 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f23577fe640 1 -- 172.21.15.67:0/601362927 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f236c032050 con 0x55d228a26440 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 10 client.4647 fetch_fsmap learned FSMap version 8 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- 172.21.15.67:0/601362927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d2287ca450 con 0x55d228a26440 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f23577fe640 1 -- 172.21.15.67:0/601362927 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236c00fb60 con 0x55d228a26440 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f23577fe640 1 -- 172.21.15.67:0/601362927 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f236c035020 con 0x55d228a26440 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 10 client.4647 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 20 client.4647 populate_metadata read hostname 'smithi067' 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x55d228a34280 0x55d228a36670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 4 client.4647 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:33:34.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- 172.21.15.67:0/601362927 --> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2287c4c00 con 0x55d228a34280 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f237c98d640 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x55d228a34280 0x55d228a36670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f237c98d640 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x55d228a34280 0x55d228a36670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c0e94287208e1d2 server_cookie=d53cbd67387e21a3 in_seq=0 out_seq=0 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f23577fe640 10 client.4647 ms_handle_connect on v2:172.21.15.67:6834/3064059806 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f23577fe640 1 -- 172.21.15.67:0/601362927 <== mds.0 v2:172.21.15.67:6834/3064059806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2287c4c00 con 0x55d228a34280 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f23577fe640 10 client.4647 handle_command_reply: tid=0 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 client.4647 shutdown 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- 172.21.15.67:0/601362927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 msgr2=0x55d2289e6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289e6cf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f236c008010 tx=0x7f236c012000 comp rx=0 tx=0).stop 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- 172.21.15.67:0/601362927 shutdown_connections 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x55d228a34280 0x55d228a36670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d2289e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a26440 0x55d2289e6cf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 --2- 172.21.15.67:0/601362927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a25b20 0x55d2289e0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f23577fe640 0 client.4647 ms_handle_reset on v2:172.21.15.67:6834/3064059806 2024-09-19T05:33:34.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- 172.21.15.67:0/601362927 >> 172.21.15.67:0/601362927 conn(0x55d2289dc290 msgr2=0x55d2289dad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:34.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- 172.21.15.67:0/601362927 shutdown_connections 2024-09-19T05:33:34.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 1 -- 172.21.15.67:0/601362927 wait complete. 2024-09-19T05:33:34.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.642+0000 7f2381cad000 20 client.4647 trim_cache size 0 max 16384 2024-09-19T05:33:34.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 Processor -- start 2024-09-19T05:33:34.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 -- start start 2024-09-19T05:33:34.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d2289e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d2289e0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a26440 0x55d228a36670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2378203e00 con 0x55d228a25b20 2024-09-19T05:33:34.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2378203160 con 0x55d2289e1330 2024-09-19T05:33:34.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f23782037b0 con 0x55d228a26440 2024-09-19T05:33:34.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2377fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d2289e0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2377fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d2289e0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34856/0 (socket says 172.21.15.67:34856) 2024-09-19T05:33:34.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2377fff640 1 -- 172.21.15.67:0/1084438126 learned_addr learned my addr 172.21.15.67:0/1084438126 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:34.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2377fff640 1 -- 172.21.15.67:0/1084438126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a26440 msgr2=0x55d228a36670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2377fff640 1 --2- 172.21.15.67:0/1084438126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a26440 0x55d228a36670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2377fff640 1 -- 172.21.15.67:0/1084438126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 msgr2=0x55d2289e05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2377fff640 1 --2- 172.21.15.67:0/1084438126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d2289e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2377fff640 1 -- 172.21.15.67:0/1084438126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d228a318e0 con 0x55d228a25b20 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2377fff640 1 --2- 172.21.15.67:0/1084438126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d2289e0b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f236c00d320 tx=0x7f236c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec24e6a924b6ec36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f235dffb640 1 -- 172.21.15.67:0/1084438126 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c014850 con 0x55d228a25b20 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f235dffb640 1 -- 172.21.15.67:0/1084438126 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236c000e50 con 0x55d228a25b20 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f235dffb640 1 -- 172.21.15.67:0/1084438126 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c004040 con 0x55d228a25b20 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 -- 172.21.15.67:0/1084438126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 msgr2=0x55d2289e0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 --2- 172.21.15.67:0/1084438126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d2289e0b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f236c00d320 tx=0x7f236c016000 comp rx=0 tx=0).stop 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 -- 172.21.15.67:0/1084438126 shutdown_connections 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 --2- 172.21.15.67:0/1084438126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a26440 0x55d228a36670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 --2- 172.21.15.67:0/1084438126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d2289e0b30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 --2- 172.21.15.67:0/1084438126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d2289e05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 -- 172.21.15.67:0/1084438126 >> 172.21.15.67:0/1084438126 conn(0x55d2289dc290 msgr2=0x55d228a398c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:34.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 -- 172.21.15.67:0/1084438126 shutdown_connections 2024-09-19T05:33:34.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 -- 172.21.15.67:0/1084438126 wait complete. 2024-09-19T05:33:34.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 -- start start 2024-09-19T05:33:34.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.662+0000 7f2381cad000 1 Processor -- start 2024-09-19T05:33:34.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d228a389b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d228a38ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a26440 0x55d228a7e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d228829f80 con 0x55d228a25b20 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d2287e2ca0 con 0x55d2289e1330 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d22882f2a0 con 0x55d228a26440 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 10 client.0 _ll_register_callbacks cb 0x7f236c00d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2377fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d228a38ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2377fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d228a38ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34862/0 (socket says 172.21.15.67:34862) 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2377fff640 1 -- 172.21.15.67:0/2283153308 learned_addr learned my addr 172.21.15.67:0/2283153308 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237c98d640 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d228a389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2377fff640 1 -- 172.21.15.67:0/2283153308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a26440 msgr2=0x55d228a7e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2377fff640 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a26440 0x55d228a7e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2377fff640 1 -- 172.21.15.67:0/2283153308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 msgr2=0x55d228a389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2377fff640 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d228a389b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2377fff640 1 -- 172.21.15.67:0/2283153308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d228a26270 con 0x55d228a25b20 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2377fff640 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d228a38ef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f236c02f010 tx=0x7f236c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b10892448f5af77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f23577fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f23577fe640 1 -- 172.21.15.67:0/2283153308 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c004510 con 0x55d228a25b20 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- 172.21.15.67:0/2283153308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f236c000e50 con 0x55d228a25b20 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f23577fe640 1 -- 172.21.15.67:0/2283153308 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f236c02d250 con 0x55d228a25b20 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f23577fe640 1 -- 172.21.15.67:0/2283153308 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f236c046050 con 0x55d228a25b20 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 10 client.4653 fetch_fsmap learned FSMap version 8 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- 172.21.15.67:0/2283153308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d2287b1fd0 con 0x55d228a25b20 2024-09-19T05:33:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f23577fe640 1 -- 172.21.15.67:0/2283153308 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236c000e50 con 0x55d228a25b20 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f23577fe640 1 -- 172.21.15.67:0/2283153308 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f236c049020 con 0x55d228a25b20 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 10 client.4653 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 20 client.4653 populate_metadata read hostname 'smithi067' 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x55d228a7e550 0x55d228a7e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 4 client.4653 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- 172.21.15.67:0/2283153308 --> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] -- command(tid 0: {"prefix": "status"}) -- 0x55d2288383a0 con 0x55d228a7e550 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237c98d640 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x55d228a7e550 0x55d228a7e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237c98d640 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x55d228a7e550 0x55d228a7e930 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9f96863a286c8fc server_cookie=64789dc0c398ca72 in_seq=0 out_seq=0 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f23577fe640 10 client.4653 ms_handle_connect on v2:172.21.15.67:6834/3064059806 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f23577fe640 1 -- 172.21.15.67:0/2283153308 <== mds.0 v2:172.21.15.67:6834/3064059806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55d2288383a0 con 0x55d228a7e550 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f23577fe640 10 client.4653 handle_command_reply: tid=0 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 client.4653 shutdown 2024-09-19T05:33:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- 172.21.15.67:0/2283153308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 msgr2=0x55d228a38ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d228a38ef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f236c02f010 tx=0x7f236c004740 comp rx=0 tx=0).stop 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- 172.21.15.67:0/2283153308 shutdown_connections 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.67:6834/3064059806,v1:172.21.15.67:6835/3064059806] conn(0x55d228a7e550 0x55d228a7e930 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d228a26440 0x55d228a7e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f23577fe640 0 client.4653 ms_handle_reset on v2:172.21.15.67:6834/3064059806 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d228a25b20 0x55d228a38ef0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 --2- 172.21.15.67:0/2283153308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2289e1330 0x55d228a389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- 172.21.15.67:0/2283153308 >> 172.21.15.67:0/2283153308 conn(0x55d2289dc290 msgr2=0x55d2289e05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- 172.21.15.67:0/2283153308 shutdown_connections 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 1 -- 172.21.15.67:0/2283153308 wait complete. 2024-09-19T05:33:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f2381cad000 20 client.4653 trim_cache size 0 max 16384 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4288, 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 20.165460954, 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 8, 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 25, 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 25, 2024-09-19T05:33:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 26.209848556000001 2024-09-19T05:33:34.678 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:33:34.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 -- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23640678f0 msgr2=0x7f2364069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23640678f0 0x7f2364069db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23680ae000 tx=0x7f2368008040 comp rx=0 tx=0).stop 2024-09-19T05:33:34.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 -- 172.21.15.67:0/1679101329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2378154660 msgr2=0x7f2378150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:34.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2378154660 0x7f2378150df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f237000c7b0 tx=0x7f237000cc70 comp rx=0 tx=0).stop 2024-09-19T05:33:34.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 -- 172.21.15.67:0/1679101329 shutdown_connections 2024-09-19T05:33:34.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2378154660 0x7f2378150df0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f237815e330 0x7f2378154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23640678f0 0x7f2364069db0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 --2- 172.21.15.67:0/1679101329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23780b4bc0 0x7f2378160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:34.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 -- 172.21.15.67:0/1679101329 >> 172.21.15.67:0/1679101329 conn(0x7f23780d0080 msgr2=0x7f23780adb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:34.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 -- 172.21.15.67:0/1679101329 shutdown_connections 2024-09-19T05:33:34.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:34.666+0000 7f237ebf1640 1 -- 172.21.15.67:0/1679101329 wait complete. 2024-09-19T05:33:34.686 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T05:33:34.695 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T05:33:34.695 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T05:33:34.695 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T05:33:34.695 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T05:33:34.705 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T05:33:34.705 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-19T05:33:34.705 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-19T05:33:34.705 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T05:33:34.705 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:34.705 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-19T05:33:34.706 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T05:33:34.706 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-19T05:33:34.706 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-19T05:33:34.706 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T05:33:34.706 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:34.706 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-19T05:33:34.706 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T05:33:34.706 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-19T05:33:34.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:34.706 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:33:34.711 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-19T05:33:34.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:34.712 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:33:34.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:34.770 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-09-19T05:33:34.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:34.962 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2024-09-19T05:33:34.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:34.969 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link delete ceph-brx 2024-09-19T05:33:35.029 INFO:teuthology.orchestra.run.smithi097.stderr:Cannot find device "ceph-brx" 2024-09-19T05:33:35.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:33:35.030 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T05:33:35.030 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T05:33:35.030 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:33:35.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.162+0000 7f6b5a8b5640 1 Processor -- start 2024-09-19T05:33:35.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.162+0000 7f6b5a8b5640 1 -- start start 2024-09-19T05:33:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.162+0000 7f6b5a8b5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b54072590 0x7f6b54166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.162+0000 7f6b5a8b5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b540b3860 con 0x7f6b5415b1e0 2024-09-19T05:33:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.162+0000 7f6b5a8b5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b540b3b40 con 0x7f6b540b4900 2024-09-19T05:33:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.162+0000 7f6b5a8b5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5415b5c0 con 0x7f6b54072590 2024-09-19T05:33:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.162+0000 7f6b53fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6b5415b1e0 0x7f6b540b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34646/0 (socket says 172.21.15.67:34646) 2024-09-19T05:33:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.162+0000 7f6b53fff640 1 -- 172.21.15.67:0/3497649136 learned_addr learned my addr 172.21.15.67:0/3497649136 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:35.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381232162 0 0) 0x7f6b540b3860 con 0x7f6b5415b1e0 2024-09-19T05:33:35.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b58e52640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b54072590 0x7f6b54166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b3c003530 con 0x7f6b5415b1e0 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2867146885 0 0) 0x7f6b3c003530 con 0x7f6b5415b1e0 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b54072590 msgr2=0x7f6b54166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b54072590 0x7f6b54166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 >> v1:172.21.15.97:6789/0 conn(0x7f6b540b4900 legacy=0x7f6b54071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b540b3e20 con 0x7f6b5415b1e0 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6b44001680 con 0x7f6b5415b1e0 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b58e52640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b54072590 0x7f6b54166050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 >> v1:172.21.15.67:6789/0 conn(0x7f6b5415b1e0 legacy=0x7f6b540b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b3c0039f0 0x7f6b3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 0x7f6b3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b54072590 0x7f6b3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5415b5c0 con 0x7f6b3c004810 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c00bb00 con 0x7f6b3c0039f0 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b3c00bd00 con 0x7f6b54072590 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b537fe640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 0x7f6b3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b58e52640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b54072590 0x7f6b3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b53fff640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b3c0039f0 0x7f6b3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b537fe640 1 -- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b54072590 msgr2=0x7f6b3c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b537fe640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b54072590 0x7f6b3c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b537fe640 1 -- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b3c0039f0 msgr2=0x7f6b3c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b537fe640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b3c0039f0 0x7f6b3c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b537fe640 1 -- 172.21.15.67:0/3497649136 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3c003530 con 0x7f6b3c004810 2024-09-19T05:33:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b53fff640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b3c0039f0 0x7f6b3c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:35.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b537fe640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 0x7f6b3c004c90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6b48001780 tx=0x7f6b4801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae43f05b23cc492 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b480013a0 con 0x7f6b3c004810 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b480052f0 con 0x7f6b3c004810 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b52ffd640 1 -- 172.21.15.67:0/3497649136 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44001d50 con 0x7f6b3c004810 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/3497649136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 msgr2=0x7f6b3c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b5a8b5640 1 --2- 172.21.15.67:0/3497649136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 0x7f6b3c004c90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6b48001780 tx=0x7f6b4801c420 comp rx=0 tx=0).stop 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b58e52640 1 -- 172.21.15.67:0/3497649136 reap_dead start 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/3497649136 shutdown_connections 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/3497649136 >> 172.21.15.67:0/3497649136 conn(0x7f6b540d0080 msgr2=0x7f6b540d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/3497649136 shutdown_connections 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.166+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/3497649136 wait complete. 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 Processor -- start 2024-09-19T05:33:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 -- start start 2024-09-19T05:33:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 0x7f6b5415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b540ae290 0x7f6b54099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b54144c00 0x7f6b541430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54072a20 con 0x7f6b3c004810 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b540b43e0 con 0x7f6b54144c00 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b54072ba0 con 0x7f6b540ae290 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 0x7f6b5415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 0x7f6b5415b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34878/0 (socket says 172.21.15.67:34878) 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b53fff640 1 -- 172.21.15.67:0/2668837784 learned_addr learned my addr 172.21.15.67:0/2668837784 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b537fe640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b540ae290 0x7f6b54099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b58e52640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b54144c00 0x7f6b541430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b53fff640 1 -- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b540ae290 msgr2=0x7f6b54099520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b53fff640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b540ae290 0x7f6b54099520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b53fff640 1 -- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b54144c00 msgr2=0x7f6b541430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b53fff640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b54144c00 0x7f6b541430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b53fff640 1 -- 172.21.15.67:0/2668837784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b54146160 con 0x7f6b3c004810 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b58e52640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b54144c00 0x7f6b541430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b53fff640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 0x7f6b5415b740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6b44012d20 tx=0x7f6b440106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b50ff9640 1 -- 172.21.15.67:0/2668837784 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4401d630 con 0x7f6b3c004810 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b50ff9640 1 -- 172.21.15.67:0/2668837784 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b44017030 con 0x7f6b3c004810 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/2668837784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b54144400 con 0x7f6b3c004810 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b50ff9640 1 -- 172.21.15.67:0/2668837784 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4401d9d0 con 0x7f6b3c004810 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/2668837784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b54145e10 con 0x7f6b3c004810 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.170+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/2668837784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b54071e80 con 0x7f6b3c004810 2024-09-19T05:33:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.174+0000 7f6b50ff9640 1 -- 172.21.15.67:0/2668837784 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b44013400 con 0x7f6b3c004810 2024-09-19T05:33:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.174+0000 7f6b50ff9640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b400678c0 0x7f6b40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.174+0000 7f6b50ff9640 1 -- 172.21.15.67:0/2668837784 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6b4408b7e0 con 0x7f6b3c004810 2024-09-19T05:33:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.174+0000 7f6b537fe640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b400678c0 0x7f6b40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.174+0000 7f6b537fe640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b400678c0 0x7f6b40069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6b48001750 tx=0x7f6b480011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:35.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.178+0000 7f6b50ff9640 1 -- 172.21.15.67:0/2668837784 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6b4405c070 con 0x7f6b3c004810 2024-09-19T05:33:35.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.374+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/2668837784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6b540b4e30 con 0x7f6b3c004810 2024-09-19T05:33:35.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.374+0000 7f6b50ff9640 1 -- 172.21.15.67:0/2668837784 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f6b4405b970 con 0x7f6b3c004810 2024-09-19T05:33:35.378 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T05:33:35.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b400678c0 msgr2=0x7f6b40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:35.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b400678c0 0x7f6b40069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6b48001750 tx=0x7f6b480011a0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/2668837784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 msgr2=0x7f6b5415b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:35.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 0x7f6b5415b740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6b44012d20 tx=0x7f6b440106e0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/2668837784 shutdown_connections 2024-09-19T05:33:35.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b54144c00 0x7f6b541430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b400678c0 0x7f6b40069d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b540ae290 0x7f6b54099520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 --2- 172.21.15.67:0/2668837784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b3c004810 0x7f6b5415b740 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/2668837784 >> 172.21.15.67:0/2668837784 conn(0x7f6b540d0080 msgr2=0x7f6b540af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/2668837784 shutdown_connections 2024-09-19T05:33:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35.378+0000 7f6b5a8b5640 1 -- 172.21.15.67:0/2668837784 wait complete. 2024-09-19T05:33:35.396 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:33:35.396 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:33:35.396 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:33:35.396 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:33:35.396 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:35.396 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:33:35.396 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:33:35.396 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:33:35.397 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:33:35.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:35.397 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:33:35.402 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:33:35.402 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:33:35.402 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:33:35.404 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42489sec preferred_lft 42489sec 2024-09-19T05:33:35.404 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:33:35.404 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:35.404 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:33:35.404 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:35.404 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:33:35.404 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:35.404 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T05:33:35.404 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:35.405 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:35.405 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2024-09-19T05:33:35.405 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2024-09-19T05:33:35.405 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2024-09-19T05:33:35.405 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T05:33:35.405 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:35.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:35.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:35.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:35.519 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:33:35.568 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:33:35.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:35.569 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:33:35.618 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:33:35.619 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:33:35.619 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:33:35.619 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:33:35.619 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:33:35.619 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:33:35.619 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:33:35.619 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:35.619 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:35.619 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:35.619 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:33:35.620 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:35.620 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:35.620 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:33:35.620 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:33:35.620 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:33:35.620 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:35.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:35.737 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:33:35.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:35.743 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-09-19T05:33:35.792 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:35.792 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:35.792 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:35.792 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T05:33:35.792 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:35.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:35.913 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T05:33:35.913 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:35.913 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:35.913 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T05:33:35.913 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T05:33:35.913 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T05:33:35.913 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T05:33:35.914 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T05:33:35.914 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:35.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:36.010 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:36.010 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:36.011 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:33:36.011 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T05:33:36.011 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:36.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:36.069 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:33:36.070 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:33:36.070 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:36.115 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:33:36.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:33:36.116 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:36.163 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:33:36.214 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:36.263 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:33:36.263 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:33:36.263 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:33:36.263 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:33:36.263 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:33:36.263 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:33:36.264 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:36.265 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:36.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:36.266 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:33:36.316 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:33:36.317 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:33:36.361 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:33:36.378 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:36.424 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:33:36.424 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:33:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:33:36.426 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:33:36.427 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:33:36.427 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:36.427 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:36.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:36.428 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:33:36.445 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:33:36.442+0000 7f195e7e4580 -1 init, newargv = 0x55eb94c622f0 newargc=15 2024-09-19T05:33:36.446 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[36136]: starting ceph client 2024-09-19T05:33:36.452 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[36136]: starting fuse 2024-09-19T05:33:37.551 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:33:37.567 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:37.618 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:33:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:33:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:33:37.621 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:33:37.621 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:33:37.621 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:33:37.621 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:37.621 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:37.621 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:37.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:37.622 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:33:37.668 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:33:37.669 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:33:37.669 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:33:37.669 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:33:37.669 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:33:37.669 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:33:37.669 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:33:37.669 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:37.669 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:33:37.669 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:33:37.669 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:33:37.669 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:37.670 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:33:37.671 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:33:37.796 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.36136.asok 2024-09-19T05:33:37.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:37.808 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36136.asok 2024-09-19T05:33:37.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:37.809 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36136.asok status 2024-09-19T05:33:37.955 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:33:37.957 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:33:37.963 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:33:37.963 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:33:37.963 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "36136", 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4668, 2024-09-19T05:33:37.964 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 4668 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 466208454 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:37.965 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 466208454 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.4668 192.168.0.1:0/466208454", 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/466208454", 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 8, 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 25, 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:33:37.966 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:33:37.967 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:33:37.978 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T05:33:37.979 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:33:38.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9afa5a0640 1 Processor -- start 2024-09-19T05:33:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9afa5a0640 1 -- start start 2024-09-19T05:33:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9afa5a0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9af415c030 0x7f9af406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9afa5a0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af406f460 0x7f9af406f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9afa5a0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af406e3c0 con 0x7f9af415d1d0 2024-09-19T05:33:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9afa5a0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9af406e6a0 con 0x7f9af415c030 2024-09-19T05:33:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9afa5a0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9af406e980 con 0x7f9af406f460 2024-09-19T05:33:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9af415d1d0 0x7f9af40b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41266/0 (socket says 172.21.15.67:41266) 2024-09-19T05:33:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af37fe640 1 -- 172.21.15.67:0/277780564 learned_addr learned my addr 172.21.15.67:0/277780564 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af3fff640 1 --2- 172.21.15.67:0/277780564 >> v2:172.21.15.97:3300/0 conn(0x7f9af415c030 0x7f9af406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af8b3d640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af406f460 0x7f9af406f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970937116 0 0) 0x7f9af406e3c0 con 0x7f9af415d1d0 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae0003530 con 0x7f9af415d1d0 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4208338072 0 0) 0x7f9ae0003530 con 0x7f9af415d1d0 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af406f460 msgr2=0x7f9af406f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af406f460 0x7f9af406f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 >> v2:172.21.15.97:3300/0 conn(0x7f9af415c030 msgr2=0x7f9af406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 --2- 172.21.15.67:0/277780564 >> v2:172.21.15.97:3300/0 conn(0x7f9af415c030 0x7f9af406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af406ec60 con 0x7f9af415d1d0 2024-09-19T05:33:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9ae4001680 con 0x7f9af415d1d0 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 >> v1:172.21.15.67:6789/0 conn(0x7f9af415d1d0 legacy=0x7f9af40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af406f460 0x7f9ae00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ae0003f40 0x7f9ae0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 0x7f9ae00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9af406e6a0 con 0x7f9ae0004d50 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9af406e980 con 0x7f9ae0003f40 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae000b9d0 con 0x7f9af406f460 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af8b3d640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 0x7f9ae00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af3fff640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af406f460 0x7f9ae00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af37fe640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ae0003f40 0x7f9ae0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af8b3d640 1 -- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af406f460 msgr2=0x7f9ae00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af8b3d640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af406f460 0x7f9ae00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af8b3d640 1 -- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ae0003f40 msgr2=0x7f9ae0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af8b3d640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ae0003f40 0x7f9ae0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:38.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af8b3d640 1 -- 172.21.15.67:0/277780564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae0003530 con 0x7f9ae0004d50 2024-09-19T05:33:38.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.158+0000 7f9af37fe640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ae0003f40 0x7f9ae0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9af8b3d640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 0x7f9ae00051d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009fc0 tx=0x7f9aec01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b225d059d88f0bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0b2070 con 0x7f9ae0004d50 2024-09-19T05:33:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aec0a5c90 con 0x7f9ae0004d50 2024-09-19T05:33:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9af2ffd640 1 -- 172.21.15.67:0/277780564 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec009c10 con 0x7f9ae0004d50 2024-09-19T05:33:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9afa5a0640 1 -- 172.21.15.67:0/277780564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 msgr2=0x7f9ae00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9afa5a0640 1 --2- 172.21.15.67:0/277780564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 0x7f9ae00051d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009fc0 tx=0x7f9aec01cc20 comp rx=0 tx=0).stop 2024-09-19T05:33:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9af8b3d640 1 -- 172.21.15.67:0/277780564 reap_dead start 2024-09-19T05:33:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9afa5a0640 1 -- 172.21.15.67:0/277780564 shutdown_connections 2024-09-19T05:33:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9afa5a0640 1 -- 172.21.15.67:0/277780564 >> 172.21.15.67:0/277780564 conn(0x7f9af40d0080 msgr2=0x7f9af40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9afa5a0640 1 -- 172.21.15.67:0/277780564 shutdown_connections 2024-09-19T05:33:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9afa5a0640 1 -- 172.21.15.67:0/277780564 wait complete. 2024-09-19T05:33:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9afa5a0640 1 Processor -- start 2024-09-19T05:33:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.162+0000 7f9afa5a0640 1 -- start start 2024-09-19T05:33:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9afa5a0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 0x7f9af4156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9afa5a0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af41543d0 0x7f9af4154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9afa5a0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af409ab70 0x7f9af409aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9afa5a0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9af40b36e0 con 0x7f9ae0004d50 2024-09-19T05:33:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9afa5a0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9af415d660 con 0x7f9af409ab70 2024-09-19T05:33:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9afa5a0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9af4154d70 con 0x7f9af41543d0 2024-09-19T05:33:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 0x7f9af4156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 0x7f9af4156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34296/0 (socket says 172.21.15.67:34296) 2024-09-19T05:33:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af3fff640 1 -- 172.21.15.67:0/2205693600 learned_addr learned my addr 172.21.15.67:0/2205693600 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af8b3d640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af409ab70 0x7f9af409aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af37fe640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af41543d0 0x7f9af4154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af3fff640 1 -- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af41543d0 msgr2=0x7f9af4154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af3fff640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af41543d0 0x7f9af4154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af3fff640 1 -- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af409ab70 msgr2=0x7f9af409aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af3fff640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af409ab70 0x7f9af409aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af3fff640 1 -- 172.21.15.67:0/2205693600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af41f7200 con 0x7f9ae0004d50 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af8b3d640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af409ab70 0x7f9af409aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af3fff640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 0x7f9af4156230 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9adc011690 tx=0x7f9adc011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af0ff9640 1 -- 172.21.15.67:0/2205693600 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00f960 con 0x7f9ae0004d50 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af0ff9640 1 -- 172.21.15.67:0/2205693600 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc00fb00 con 0x7f9ae0004d50 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af0ff9640 1 -- 172.21.15.67:0/2205693600 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc015460 con 0x7f9ae0004d50 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9afa5a0640 1 -- 172.21.15.67:0/2205693600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af41f74e0 con 0x7f9ae0004d50 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9afa5a0640 1 -- 172.21.15.67:0/2205693600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af41f7aa0 con 0x7f9ae0004d50 2024-09-19T05:33:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9afa5a0640 1 -- 172.21.15.67:0/2205693600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af415cbd0 con 0x7f9ae0004d50 2024-09-19T05:33:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af0ff9640 1 -- 172.21.15.67:0/2205693600 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9adc015600 con 0x7f9ae0004d50 2024-09-19T05:33:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af0ff9640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad40678f0 0x7f9ad4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af0ff9640 1 -- 172.21.15.67:0/2205693600 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9adc086990 con 0x7f9ae0004d50 2024-09-19T05:33:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.166+0000 7f9af37fe640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad40678f0 0x7f9ad4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:38.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.170+0000 7f9af37fe640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad40678f0 0x7f9ad4069db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4001ec0 tx=0x7f9ae4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:38.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.170+0000 7f9af0ff9640 1 -- 172.21.15.67:0/2205693600 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9adc019030 con 0x7f9ae0004d50 2024-09-19T05:33:38.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.374+0000 7f9afa5a0640 1 -- 172.21.15.67:0/2205693600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9af40d0f20 con 0x7f9ae0004d50 2024-09-19T05:33:38.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.374+0000 7f9af0ff9640 1 -- 172.21.15.67:0/2205693600 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f9adc057190 con 0x7f9ae0004d50 2024-09-19T05:33:38.378 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T05:33:38.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 -- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad40678f0 msgr2=0x7f9ad4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:38.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad40678f0 0x7f9ad4069db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4001ec0 tx=0x7f9ae4009040 comp rx=0 tx=0).stop 2024-09-19T05:33:38.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 -- 172.21.15.67:0/2205693600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 msgr2=0x7f9af4156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:38.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 0x7f9af4156230 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9adc011690 tx=0x7f9adc011b50 comp rx=0 tx=0).stop 2024-09-19T05:33:38.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 -- 172.21.15.67:0/2205693600 shutdown_connections 2024-09-19T05:33:38.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af409ab70 0x7f9af409aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:38.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad40678f0 0x7f9ad4069db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:38.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af41543d0 0x7f9af4154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:38.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 --2- 172.21.15.67:0/2205693600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ae0004d50 0x7f9af4156230 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:38.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 -- 172.21.15.67:0/2205693600 >> 172.21.15.67:0/2205693600 conn(0x7f9af40d0080 msgr2=0x7f9af40afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:38.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 -- 172.21.15.67:0/2205693600 shutdown_connections 2024-09-19T05:33:38.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38.378+0000 7f9afa5a0640 1 -- 172.21.15.67:0/2205693600 wait complete. 2024-09-19T05:33:38.397 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:33:38.397 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:33:38.398 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:33:38.398 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-19T05:33:38.398 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-19T05:33:38.398 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:33:38.398 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:33:38.398 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:33:38.398 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-19T05:33:38.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:38.398 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:33:38.404 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:33:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:33:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:33:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:33:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.404 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:38.404 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:33:38.404 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42486sec preferred_lft 42486sec 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:33:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:38.406 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:33:38.459 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:33:38.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:38.461 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:33:38.512 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:33:38.512 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:33:38.512 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:33:38.512 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:33:38.512 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:33:38.513 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:33:38.513 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:33:38.513 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:38.513 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:38.513 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:38.513 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:33:38.513 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:38.513 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:38.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:33:38.514 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:33:38.514 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:33:38.514 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:38.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:38.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:38.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:38.640 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:33:38.646 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:33:38.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:38.646 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-09-19T05:33:38.692 INFO:teuthology.orchestra.run.smithi067.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-19T05:33:38.692 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:38.693 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:38.693 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:33:38.693 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-19T05:33:38.693 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:38.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:38.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:38.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:38.809 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-19T05:33:38.865 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:33:38.865 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:33:38.865 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:33:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:33:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.866 INFO:teuthology.orchestra.run.smithi067.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:33:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether ca:7b:84:c2:4a:ad brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T05:33:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T05:33:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c87b:84ff:fec2:4aad/64 scope link 2024-09-19T05:33:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:38.868 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-19T05:33:38.925 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:33:38.925 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:33:38.925 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:33:38.925 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.926 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:33:38.926 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.926 INFO:teuthology.orchestra.run.smithi067.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:33:38.926 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether ca:7b:84:c2:4a:ad brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T05:33:38.926 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T05:33:38.926 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.926 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c87b:84ff:fec2:4aad/64 scope link 2024-09-19T05:33:38.926 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:38.927 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-19T05:33:38.927 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:38.927 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:38.927 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-19T05:33:38.928 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-19T05:33:38.928 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-19T05:33:38.928 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-19T05:33:38.928 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-19T05:33:38.928 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:39.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:39.076 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:39.076 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:33:39.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.1 up 2024-09-19T05:33:39.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.1 master ceph-brx 2024-09-19T05:33:39.076 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:33:39.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:39.142 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-19T05:33:39.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:33:39.142 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-19T05:33:39.187 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-19T05:33:39.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:33:39.188 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-19T05:33:39.236 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:33:39.293 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:39.341 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:33:39.341 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:33:39.342 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:33:39.343 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:39.344 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:39.344 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:39.344 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:33:39.344 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:33:39.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:39.345 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:33:39.392 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:33:39.392 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-19T05:33:39.393 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-19T05:33:39.437 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:33:39.451 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:39.500 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:33:39.501 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:33:39.502 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:33:39.503 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:39.503 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:39.503 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:39.503 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:33:39.503 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:33:39.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:39.504 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:33:39.523 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi067.stderr:2024-09-19T05:33:39.518+0000 7f8996ed6580 -1 init, newargv = 0x5583b5e331e0 newargc=15 2024-09-19T05:33:39.523 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi067.stderr:ceph-fuse[36283]: starting ceph client 2024-09-19T05:33:39.527 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:33:39.529 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi067.stderr:ceph-fuse[36283]: starting fuse 2024-09-19T05:33:40.629 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:33:40.646 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:40.693 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:33:40.693 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:33:40.693 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:33:40.693 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:33:40.694 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:33:40.696 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:40.696 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:33:40.696 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:33:40.696 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.2 2024-09-19T05:33:40.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:40.697 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:33:40.745 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:33:40.745 INFO:teuthology.orchestra.run.smithi067.stdout:46 2024-09-19T05:33:40.745 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-19T05:33:40.746 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:33:40.746 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:33:40.746 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:33:40.746 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:33:40.746 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:33:40.746 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:40.746 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:33:40.746 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-19T05:33:40.746 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:33:40.747 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:33:40.748 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:33:40.748 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:33:40.748 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.2")) 2024-09-19T05:33:40.748 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:33:40.872 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.2.36283.asok 2024-09-19T05:33:40.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:40.883 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.36283.asok 2024-09-19T05:33:40.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:40.884 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.36283.asok status 2024-09-19T05:33:41.045 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:33:41.045 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:33:41.045 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:33:41.045 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "2", 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "36283", 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4683, 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:33:41.046 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 4683 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.2:0", 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3499082251 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.2:0", 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3499082251 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.4683 192.168.0.2:0/3499082251", 2024-09-19T05:33:41.047 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.2:0/3499082251", 2024-09-19T05:33:41.048 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:33:41.048 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 8, 2024-09-19T05:33:41.048 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 25, 2024-09-19T05:33:41.048 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:33:41.048 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:33:41.048 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:33:41.048 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:33:41.059 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T05:33:41.059 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:33:41.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f66988aa640 1 Processor -- start 2024-09-19T05:33:41.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f66988aa640 1 -- start start 2024-09-19T05:33:41.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f66988aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f669415a920 0x7f6694072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:41.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f66988aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669406ed80 0x7f66940ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:41.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f66988aa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66940730e0 con 0x7f66940af730 2024-09-19T05:33:41.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f66988aa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f66940733c0 con 0x7f669415a920 2024-09-19T05:33:41.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f66988aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f66940ad8c0 con 0x7f669406ed80 2024-09-19T05:33:41.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f6692d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669406ed80 0x7f66940ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:41.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f669259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f669415a920 0x7f6694072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:41.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f669259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f669415a920 0x7f6694072840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:34280/0 (socket says 172.21.15.67:34280) 2024-09-19T05:33:41.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f6692d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669406ed80 0x7f66940ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:49122/0 (socket says 172.21.15.67:49122) 2024-09-19T05:33:41.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f669259c640 1 -- 172.21.15.67:0/2101070130 learned_addr learned my addr 172.21.15.67:0/2101070130 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:41.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f669259c640 1 -- 172.21.15.67:0/2101070130 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669406ed80 msgr2=0x7f66940ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:41.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f669259c640 1 --2- 172.21.15.67:0/2101070130 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669406ed80 0x7f66940ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:41.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f669259c640 1 -- 172.21.15.67:0/2101070130 >> v1:172.21.15.97:6789/0 conn(0x7f66940af730 legacy=0x7f669406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:41.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.182+0000 7f669259c640 1 -- 172.21.15.67:0/2101070130 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66940adba0 con 0x7f669415a920 2024-09-19T05:33:41.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f669259c640 1 --2- 172.21.15.67:0/2101070130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f669415a920 0x7f6694072840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6688009870 tx=0x7f668801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a603c907ecf9ebcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:41.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f669159a640 1 -- 172.21.15.67:0/2101070130 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880ab5f0 con 0x7f669415a920 2024-09-19T05:33:41.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f669159a640 1 -- 172.21.15.67:0/2101070130 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66880b0070 con 0x7f669415a920 2024-09-19T05:33:41.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f669159a640 1 -- 172.21.15.67:0/2101070130 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880ab9b0 con 0x7f669415a920 2024-09-19T05:33:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f66988aa640 1 -- 172.21.15.67:0/2101070130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f669415a920 msgr2=0x7f6694072840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f66988aa640 1 --2- 172.21.15.67:0/2101070130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f669415a920 0x7f6694072840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6688009870 tx=0x7f668801c560 comp rx=0 tx=0).stop 2024-09-19T05:33:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f66988aa640 1 -- 172.21.15.67:0/2101070130 shutdown_connections 2024-09-19T05:33:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f66988aa640 1 --2- 172.21.15.67:0/2101070130 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669406ed80 0x7f66940ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f66988aa640 1 --2- 172.21.15.67:0/2101070130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f669415a920 0x7f6694072840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f66988aa640 1 -- 172.21.15.67:0/2101070130 >> 172.21.15.67:0/2101070130 conn(0x7f66940d0080 msgr2=0x7f66940d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f66988aa640 1 -- 172.21.15.67:0/2101070130 shutdown_connections 2024-09-19T05:33:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f66988aa640 1 -- 172.21.15.67:0/2101070130 wait complete. 2024-09-19T05:33:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f66988aa640 1 Processor -- start 2024-09-19T05:33:41.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.186+0000 7f66988aa640 1 -- start start 2024-09-19T05:33:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f66988aa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669406ed80 0x7f6694146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f66988aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66940af730 0x7f6694149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f66988aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f669415a920 0x7f669415d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f66988aa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66940ae780 con 0x7f669406ed80 2024-09-19T05:33:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f66988aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f66940ae600 con 0x7f669415a920 2024-09-19T05:33:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f66988aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f66940ae900 con 0x7f66940af730 2024-09-19T05:33:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f669259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669406ed80 0x7f6694146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f669259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669406ed80 0x7f6694146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34312/0 (socket says 172.21.15.67:34312) 2024-09-19T05:33:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f669259c640 1 -- 172.21.15.67:0/3095930268 learned_addr learned my addr 172.21.15.67:0/3095930268 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f6692d9d640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f669415a920 0x7f669415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f6691d9b640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66940af730 0x7f6694149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f669259c640 1 -- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66940af730 msgr2=0x7f6694149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f669259c640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66940af730 0x7f6694149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f669259c640 1 -- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f669415a920 msgr2=0x7f669415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f669259c640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f669415a920 0x7f669415d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f669259c640 1 -- 172.21.15.67:0/3095930268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66941499c0 con 0x7f669406ed80 2024-09-19T05:33:41.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f669259c640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669406ed80 0x7f6694146000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f668801ce00 tx=0x7f668801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:41.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f6682ffd640 1 -- 172.21.15.67:0/3095930268 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880be430 con 0x7f669406ed80 2024-09-19T05:33:41.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f6682ffd640 1 -- 172.21.15.67:0/3095930268 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66880be5d0 con 0x7f669406ed80 2024-09-19T05:33:41.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f66988aa640 1 -- 172.21.15.67:0/3095930268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6694149ca0 con 0x7f669406ed80 2024-09-19T05:33:41.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f6682ffd640 1 -- 172.21.15.67:0/3095930268 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880be9c0 con 0x7f669406ed80 2024-09-19T05:33:41.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f66988aa640 1 -- 172.21.15.67:0/3095930268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66940ccc00 con 0x7f669406ed80 2024-09-19T05:33:41.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f66988aa640 1 -- 172.21.15.67:0/3095930268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66940ae0c0 con 0x7f669406ed80 2024-09-19T05:33:41.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f6682ffd640 1 -- 172.21.15.67:0/3095930268 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66880b43f0 con 0x7f669406ed80 2024-09-19T05:33:41.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f6682ffd640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66740678c0 0x7f6674069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:41.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f6682ffd640 1 -- 172.21.15.67:0/3095930268 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f668811fab0 con 0x7f669406ed80 2024-09-19T05:33:41.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.190+0000 7f6691d9b640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66740678c0 0x7f6674069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:41.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.194+0000 7f6691d9b640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66740678c0 0x7f6674069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6694165810 tx=0x7f6684009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:41.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.194+0000 7f6682ffd640 1 -- 172.21.15.67:0/3095930268 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6688016150 con 0x7f669406ed80 2024-09-19T05:33:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 -- 172.21.15.67:0/3095930268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f66941505e0 con 0x7f669406ed80 2024-09-19T05:33:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f6682ffd640 1 -- 172.21.15.67:0/3095930268 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f66880efd80 con 0x7f669406ed80 2024-09-19T05:33:41.401 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T05:33:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 -- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66740678c0 msgr2=0x7f6674069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66740678c0 0x7f6674069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6694165810 tx=0x7f6684009040 comp rx=0 tx=0).stop 2024-09-19T05:33:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 -- 172.21.15.67:0/3095930268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669406ed80 msgr2=0x7f6694146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669406ed80 0x7f6694146000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f668801ce00 tx=0x7f668801ada0 comp rx=0 tx=0).stop 2024-09-19T05:33:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 -- 172.21.15.67:0/3095930268 shutdown_connections 2024-09-19T05:33:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f669415a920 0x7f669415d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66740678c0 0x7f6674069d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66940af730 0x7f6694149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 --2- 172.21.15.67:0/3095930268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669406ed80 0x7f6694146000 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 -- 172.21.15.67:0/3095930268 >> 172.21.15.67:0/3095930268 conn(0x7f66940d0080 msgr2=0x7f66940b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 -- 172.21.15.67:0/3095930268 shutdown_connections 2024-09-19T05:33:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:41.398+0000 7f66988aa640 1 -- 172.21.15.67:0/3095930268 wait complete. 2024-09-19T05:33:41.421 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:33:41.421 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:33:41.421 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2024-09-19T05:33:41.421 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T05:33:41.421 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:41.421 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:33:41.421 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:33:41.421 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:33:41.422 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T05:33:41.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:41.422 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2024-09-19T05:33:41.429 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:33:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:33:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:33:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2024-09-19T05:33:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:41.429 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2024-09-19T05:33:41.429 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42477sec preferred_lft 42477sec 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:41.430 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:33:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:dd:2b:4e:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:33:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:41.431 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T05:33:41.431 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:41.431 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-09-19T05:33:41.431 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add name ceph-brx type bridge 2024-09-19T05:33:41.431 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr flush dev ceph-brx 2024-09-19T05:33:41.431 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set ceph-brx up 2024-09-19T05:33:41.431 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T05:33:41.432 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-09-19T05:33:41.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:41.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:41.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:41.560 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:33:41.569 INFO:teuthology.orchestra.run.smithi097.stdout:1 2024-09-19T05:33:41.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:41.570 DEBUG:teuthology.orchestra.run.smithi097:> route 2024-09-19T05:33:41.719 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2024-09-19T05:33:41.719 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:33:41.719 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:33:41.719 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:33:41.720 INFO:teuthology.orchestra.run.smithi097.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:33:41.720 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:33:41.720 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:33:41.720 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:41.720 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:41.720 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:41.720 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:33:41.720 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:41.721 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-09-19T05:33:41.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:33:41.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:33:41.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:33:41.721 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-09-19T05:33:41.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:41.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:41.805 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2024-09-19T05:33:41.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:41.811 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list-id 2024-09-19T05:33:41.856 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:41.856 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-09-19T05:33:41.857 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:41.857 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-19T05:33:41.857 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-09-19T05:33:41.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:41.974 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-19T05:33:41.974 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:41.974 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-09-19T05:33:41.974 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-19T05:33:41.974 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T05:33:41.974 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-19T05:33:41.974 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-19T05:33:41.974 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-19T05:33:41.974 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-09-19T05:33:42.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:42.076 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:42.076 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-09-19T05:33:42.077 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2024-09-19T05:33:42.077 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T05:33:42.077 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-09-19T05:33:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:42.181 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-19T05:33:42.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:33:42.181 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:42.231 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T05:33:42.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:33:42.232 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:42.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2024-09-19T05:33:42.342 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:42.389 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2024-09-19T05:33:42.389 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/run/lock 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/bpf 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2024-09-19T05:33:42.390 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/fs/nfsd 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/run/rpc_pipefs 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-4 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-5 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-6 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-7 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2024-09-19T05:33:42.391 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:42.392 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:42.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:42.393 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2024-09-19T05:33:42.440 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:33:42.440 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-19T05:33:42.485 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2024-09-19T05:33:42.500 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:42.548 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/run/lock 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/bpf 2024-09-19T05:33:42.549 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/fs/nfsd 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/run/rpc_pipefs 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-4 2024-09-19T05:33:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-5 2024-09-19T05:33:42.551 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-6 2024-09-19T05:33:42.551 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-7 2024-09-19T05:33:42.551 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2024-09-19T05:33:42.551 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:42.551 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:42.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:42.552 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2024-09-19T05:33:42.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi097.stderr:2024-09-19T05:33:42.561+0000 7fe340d66580 -1 init, newargv = 0x56470ad9d540 newargc=15 2024-09-19T05:33:42.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi097.stderr:ceph-fuse[34927]: starting ceph client 2024-09-19T05:33:42.571 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi097.stderr:ceph-fuse[34927]: starting fuse 2024-09-19T05:33:43.670 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2024-09-19T05:33:43.686 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:43.733 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/run/lock 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/bpf 2024-09-19T05:33:43.734 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/fs/nfsd 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/run/rpc_pipefs 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-4 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-5 2024-09-19T05:33:43.735 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-6 2024-09-19T05:33:43.736 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-7 2024-09-19T05:33:43.736 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2024-09-19T05:33:43.736 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:43.736 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:43.736 INFO:teuthology.orchestra.run.smithi097.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:43.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:43.737 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2024-09-19T05:33:43.789 INFO:teuthology.orchestra.run.smithi097.stdout:45 2024-09-19T05:33:43.789 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:33:43.789 DEBUG:teuthology.orchestra.run.smithi097:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:33:43.789 DEBUG:teuthology.orchestra.run.smithi097:> import glob 2024-09-19T05:33:43.789 DEBUG:teuthology.orchestra.run.smithi097:> import re 2024-09-19T05:33:43.789 DEBUG:teuthology.orchestra.run.smithi097:> import os 2024-09-19T05:33:43.789 DEBUG:teuthology.orchestra.run.smithi097:> import subprocess 2024-09-19T05:33:43.789 DEBUG:teuthology.orchestra.run.smithi097:> 2024-09-19T05:33:43.789 DEBUG:teuthology.orchestra.run.smithi097:> def _find_admin_socket(client_name): 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> files = glob.glob(asok_path) 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> # Given a non-glob path, it better be there 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> if "*" not in asok_path: 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> assert(len(files) == 1) 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> return files[0] 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> for f in files: 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:33:43.790 DEBUG:teuthology.orchestra.run.smithi097:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:33:43.791 DEBUG:teuthology.orchestra.run.smithi097:> contents = proc_f.read() 2024-09-19T05:33:43.791 DEBUG:teuthology.orchestra.run.smithi097:> if mountpoint in contents: 2024-09-19T05:33:43.791 DEBUG:teuthology.orchestra.run.smithi097:> return f 2024-09-19T05:33:43.791 DEBUG:teuthology.orchestra.run.smithi097:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:33:43.791 DEBUG:teuthology.orchestra.run.smithi097:> 2024-09-19T05:33:43.791 DEBUG:teuthology.orchestra.run.smithi097:> print(_find_admin_socket("client.1")) 2024-09-19T05:33:43.791 DEBUG:teuthology.orchestra.run.smithi097:> ' 2024-09-19T05:33:43.911 INFO:teuthology.orchestra.run.smithi097.stdout:/var/run/ceph/ceph-client.1.34927.asok 2024-09-19T05:33:43.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:43.922 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34927.asok 2024-09-19T05:33:43.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:43.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34927.asok status 2024-09-19T05:33:44.071 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-19T05:33:44.071 INFO:teuthology.orchestra.run.smithi097.stdout: "metadata": { 2024-09-19T05:33:44.071 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:33:44.071 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:33:44.071 INFO:teuthology.orchestra.run.smithi097.stdout: "entity_id": "1", 2024-09-19T05:33:44.071 INFO:teuthology.orchestra.run.smithi097.stdout: "hostname": "smithi097", 2024-09-19T05:33:44.071 INFO:teuthology.orchestra.run.smithi097.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-19T05:33:44.071 INFO:teuthology.orchestra.run.smithi097.stdout: "pid": "34927", 2024-09-19T05:33:44.071 INFO:teuthology.orchestra.run.smithi097.stdout: "root": "/" 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_count": 0, 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_pinned_count": 0, 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4582, 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "inst": { 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "name": { 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "client", 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "num": 4582 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1043888726 2024-09-19T05:33:44.072 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1043888726 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "inst_str": "client.4582 192.168.0.1:0/1043888726", 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "addr_str": "192.168.0.1:0/1043888726", 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "inode_count": 1, 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_epoch": 8, 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch": 25, 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklisted": false, 2024-09-19T05:33:44.073 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs" 2024-09-19T05:33:44.074 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-19T05:33:44.083 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T05:33:44.083 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:33:44.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.213+0000 7f1b11f51640 1 Processor -- start 2024-09-19T05:33:44.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.213+0000 7f1b11f51640 1 -- start start 2024-09-19T05:33:44.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b11f51640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b0c15e330 0x7f1b0c071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:44.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b11f51640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b0c0b4bc0 0x7f1b0c0724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:44.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b11f51640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b0c0b4420 con 0x7f1b0c0b2fd0 2024-09-19T05:33:44.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b11f51640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0c0acfb0 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b11f51640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c0b3ef0 con 0x7f1b0c15e330 2024-09-19T05:33:44.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b0bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b0c0b4bc0 0x7f1b0c0724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:44.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b0bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b0c0b4bc0 0x7f1b0c0724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34328/0 (socket says 172.21.15.67:34328) 2024-09-19T05:33:44.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b0bfff640 1 -- 172.21.15.67:0/611006762 learned_addr learned my addr 172.21.15.67:0/611006762 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:44.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b0b7fe640 1 --2- 172.21.15.67:0/611006762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b0c15e330 0x7f1b0c071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:44.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b0bfff640 1 -- 172.21.15.67:0/611006762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b0c15e330 msgr2=0x7f1b0c071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:44.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b0bfff640 1 --2- 172.21.15.67:0/611006762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b0c15e330 0x7f1b0c071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:44.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b0bfff640 1 -- 172.21.15.67:0/611006762 >> v1:172.21.15.97:6789/0 conn(0x7f1b0c0b2fd0 legacy=0x7f1b0c161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:44.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.217+0000 7f1b0bfff640 1 -- 172.21.15.67:0/611006762 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c0b4140 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0bfff640 1 --2- 172.21.15.67:0/611006762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 0x7f1b0c0724e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009870 tx=0x7f1afc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8328081ae5ba393c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:44.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0a7fc640 1 -- 172.21.15.67:0/611006762 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0ab650 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0a7fc640 1 -- 172.21.15.67:0/611006762 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1afc0b0070 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0a7fc640 1 -- 172.21.15.67:0/611006762 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0aba10 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 -- 172.21.15.67:0/611006762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 msgr2=0x7f1b0c0724e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 --2- 172.21.15.67:0/611006762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 0x7f1b0c0724e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009870 tx=0x7f1afc01c530 comp rx=0 tx=0).stop 2024-09-19T05:33:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 -- 172.21.15.67:0/611006762 shutdown_connections 2024-09-19T05:33:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 --2- 172.21.15.67:0/611006762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 0x7f1b0c0724e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 --2- 172.21.15.67:0/611006762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b0c15e330 0x7f1b0c071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 -- 172.21.15.67:0/611006762 >> 172.21.15.67:0/611006762 conn(0x7f1b0c0d0080 msgr2=0x7f1b0c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 -- 172.21.15.67:0/611006762 shutdown_connections 2024-09-19T05:33:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 -- 172.21.15.67:0/611006762 wait complete. 2024-09-19T05:33:44.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 Processor -- start 2024-09-19T05:33:44.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 -- start start 2024-09-19T05:33:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 0x7f1b0c146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b0c15e330 0x7f1b0c0aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b0c0ad340 0x7f1b0c0ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c06f880 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c06f700 con 0x7f1b0c15e330 2024-09-19T05:33:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b11f51640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c0cfcc0 con 0x7f1b0c0ad340 2024-09-19T05:33:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 0x7f1b0c146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 0x7f1b0c146570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34340/0 (socket says 172.21.15.67:34340) 2024-09-19T05:33:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0b7fe640 1 -- 172.21.15.67:0/1472914956 learned_addr learned my addr 172.21.15.67:0/1472914956 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0bfff640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b0c0ad340 0x7f1b0c0ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0affd640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b0c15e330 0x7f1b0c0aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0b7fe640 1 -- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b0c0ad340 msgr2=0x7f1b0c0ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0b7fe640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b0c0ad340 0x7f1b0c0ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0b7fe640 1 -- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b0c15e330 msgr2=0x7f1b0c0aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0b7fe640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b0c15e330 0x7f1b0c0aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0b7fe640 1 -- 172.21.15.67:0/1472914956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c0af3c0 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0affd640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b0c15e330 0x7f1b0c0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.221+0000 7f1b0b7fe640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 0x7f1b0c146570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400d5f0 tx=0x7f1b0400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b03fff640 1 -- 172.21.15.67:0/1472914956 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b040125f0 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b03fff640 1 -- 172.21.15.67:0/1472914956 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b04019070 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b03fff640 1 -- 172.21.15.67:0/1472914956 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b040129b0 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b11f51640 1 -- 172.21.15.67:0/1472914956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c153020 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b11f51640 1 -- 172.21.15.67:0/1472914956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c15f580 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b11f51640 1 -- 172.21.15.67:0/1472914956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0c161f70 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b03fff640 1 -- 172.21.15.67:0/1472914956 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b04012b50 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b03fff640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aec0678c0 0x7f1aec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:44.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b03fff640 1 -- 172.21.15.67:0/1472914956 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1b04086430 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b0affd640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aec0678c0 0x7f1aec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:44.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.225+0000 7f1b0affd640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aec0678c0 0x7f1aec069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1af4007fd0 tx=0x7f1af4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:44.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.229+0000 7f1b03fff640 1 -- 172.21.15.67:0/1472914956 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1b04056ba0 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.433+0000 7f1b11f51640 1 -- 172.21.15.67:0/1472914956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1b0c072b00 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.433+0000 7f1b03fff640 1 -- 172.21.15.67:0/1472914956 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f1b040564a0 con 0x7f1b0c0b4bc0 2024-09-19T05:33:44.439 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T05:33:44.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 -- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aec0678c0 msgr2=0x7f1aec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:44.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aec0678c0 0x7f1aec069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1af4007fd0 tx=0x7f1af4009040 comp rx=0 tx=0).stop 2024-09-19T05:33:44.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 -- 172.21.15.67:0/1472914956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 msgr2=0x7f1b0c146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:44.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 0x7f1b0c146570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400d5f0 tx=0x7f1b0400dab0 comp rx=0 tx=0).stop 2024-09-19T05:33:44.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 -- 172.21.15.67:0/1472914956 shutdown_connections 2024-09-19T05:33:44.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aec0678c0 0x7f1aec069d80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:44.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b0c0ad340 0x7f1b0c0ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:44.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b0c15e330 0x7f1b0c0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:44.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 --2- 172.21.15.67:0/1472914956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b0c0b4bc0 0x7f1b0c146570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:44.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 -- 172.21.15.67:0/1472914956 >> 172.21.15.67:0/1472914956 conn(0x7f1b0c0d0080 msgr2=0x7f1b0c071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:44.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 -- 172.21.15.67:0/1472914956 shutdown_connections 2024-09-19T05:33:44.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:44.437+0000 7f1b11f51640 1 -- 172.21.15.67:0/1472914956 wait complete. 2024-09-19T05:33:44.459 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:33:44.459 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:33:44.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2024-09-19T05:33:44.459 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-19T05:33:44.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-19T05:33:44.459 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:33:44.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:33:44.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:33:44.460 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-19T05:33:44.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:44.460 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2024-09-19T05:33:44.467 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:33:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:33:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:33:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2024-09-19T05:33:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.467 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42474sec preferred_lft 42474sec 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2024-09-19T05:33:44.468 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.469 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:33:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:dd:2b:4e:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:33:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.469 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:33:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:33:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:33:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:33:44.469 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.470 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:33:44.470 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:44.470 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:33:44.470 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:44.470 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:33:44.524 INFO:teuthology.orchestra.run.smithi097.stdout:1 2024-09-19T05:33:44.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:44.525 DEBUG:teuthology.orchestra.run.smithi097:> route 2024-09-19T05:33:44.581 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2024-09-19T05:33:44.581 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:33:44.581 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:33:44.581 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:33:44.581 INFO:teuthology.orchestra.run.smithi097.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:33:44.581 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:33:44.581 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:33:44.582 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:44.582 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:44.582 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:33:44.582 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:33:44.582 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:44.582 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-09-19T05:33:44.582 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:33:44.582 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:33:44.582 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:33:44.583 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-09-19T05:33:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:44.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:44.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:44.706 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2024-09-19T05:33:44.712 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T05:33:44.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:44.713 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list-id 2024-09-19T05:33:44.761 INFO:teuthology.orchestra.run.smithi097.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-19T05:33:44.761 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:44.761 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-09-19T05:33:44.761 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T05:33:44.762 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-19T05:33:44.762 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-09-19T05:33:44.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:44.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:44.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:44.879 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-19T05:33:44.890 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:33:44.890 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:33:44.891 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:33:44.891 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.891 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2024-09-19T05:33:44.891 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.891 INFO:teuthology.orchestra.run.smithi097.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:33:44.891 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 7e:b4:f7:f0:3a:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T05:33:44.891 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T05:33:44.891 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.891 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::7cb4:f7ff:fef0:3af1/64 scope link 2024-09-19T05:33:44.891 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:44.892 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-19T05:33:44.946 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:33:44.946 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:33:44.946 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:33:44.946 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.946 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2024-09-19T05:33:44.946 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.947 INFO:teuthology.orchestra.run.smithi097.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:33:44.947 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 7e:b4:f7:f0:3a:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T05:33:44.947 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T05:33:44.947 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.947 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::7cb4:f7ff:fef0:3af1/64 scope link 2024-09-19T05:33:44.947 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:33:44.948 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-19T05:33:44.948 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:44.948 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-09-19T05:33:44.948 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-19T05:33:44.948 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-19T05:33:44.949 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-19T05:33:44.949 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-19T05:33:44.949 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-19T05:33:44.949 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-09-19T05:33:45.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:45.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:45.092 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:33:45.092 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-09-19T05:33:45.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.1 up 2024-09-19T05:33:45.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set dev brx.1 master ceph-brx 2024-09-19T05:33:45.093 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-09-19T05:33:45.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:33:45.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:45.156 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-19T05:33:45.156 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:33:45.156 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-19T05:33:45.204 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-19T05:33:45.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:33:45.204 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-19T05:33:45.252 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2024-09-19T05:33:45.308 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:45.357 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2024-09-19T05:33:45.357 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2024-09-19T05:33:45.357 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/run/lock 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/bpf 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2024-09-19T05:33:45.358 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/fs/nfsd 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/run/rpc_pipefs 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-4 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-5 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-6 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-7 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:45.359 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:45.360 INFO:teuthology.orchestra.run.smithi097.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:45.360 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T05:33:45.360 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T05:33:45.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:45.361 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2024-09-19T05:33:45.412 INFO:teuthology.orchestra.run.smithi097.stdout:45 2024-09-19T05:33:45.413 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-19T05:33:45.413 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-19T05:33:45.457 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2024-09-19T05:33:45.471 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/run/lock 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2024-09-19T05:33:45.521 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/bpf 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/fs/nfsd 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/run/rpc_pipefs 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2024-09-19T05:33:45.522 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-4 2024-09-19T05:33:45.523 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-5 2024-09-19T05:33:45.523 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-6 2024-09-19T05:33:45.523 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-7 2024-09-19T05:33:45.523 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2024-09-19T05:33:45.523 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:45.523 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:45.523 INFO:teuthology.orchestra.run.smithi097.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:45.523 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T05:33:45.523 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T05:33:45.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:45.524 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2024-09-19T05:33:45.537 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi097.stderr:2024-09-19T05:33:45.533+0000 7fba4a5c7580 -1 init, newargv = 0x55b629f334a0 newargc=15 2024-09-19T05:33:45.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi097.stderr:ceph-fuse[35046]: starting ceph client 2024-09-19T05:33:45.541 INFO:teuthology.orchestra.run.smithi097.stdout:45 2024-09-19T05:33:45.544 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi097.stderr:ceph-fuse[35046]: starting fuse 2024-09-19T05:33:46.643 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2024-09-19T05:33:46.660 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:33:46.709 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/run/lock 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2024-09-19T05:33:46.710 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/bpf 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/fs/nfsd 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/run/rpc_pipefs 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-4 2024-09-19T05:33:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-5 2024-09-19T05:33:46.712 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-6 2024-09-19T05:33:46.712 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-7 2024-09-19T05:33:46.712 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2024-09-19T05:33:46.712 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:46.712 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:33:46.712 INFO:teuthology.orchestra.run.smithi097.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:46.712 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T05:33:46.712 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T05:33:46.712 INFO:teuthology.orchestra.run.smithi097.stdout:/home/ubuntu/cephtest/mnt.3 2024-09-19T05:33:46.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:46.713 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2024-09-19T05:33:46.765 INFO:teuthology.orchestra.run.smithi097.stdout:45 2024-09-19T05:33:46.765 INFO:teuthology.orchestra.run.smithi097.stdout:46 2024-09-19T05:33:46.765 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-19T05:33:46.765 DEBUG:teuthology.orchestra.run.smithi097:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:33:46.765 DEBUG:teuthology.orchestra.run.smithi097:> import glob 2024-09-19T05:33:46.765 DEBUG:teuthology.orchestra.run.smithi097:> import re 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> import os 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> import subprocess 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> def _find_admin_socket(client_name): 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> files = glob.glob(asok_path) 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> # Given a non-glob path, it better be there 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> if "*" not in asok_path: 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> assert(len(files) == 1) 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> return files[0] 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> 2024-09-19T05:33:46.766 DEBUG:teuthology.orchestra.run.smithi097:> for f in files: 2024-09-19T05:33:46.767 DEBUG:teuthology.orchestra.run.smithi097:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:33:46.767 DEBUG:teuthology.orchestra.run.smithi097:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:33:46.767 DEBUG:teuthology.orchestra.run.smithi097:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:33:46.767 DEBUG:teuthology.orchestra.run.smithi097:> contents = proc_f.read() 2024-09-19T05:33:46.767 DEBUG:teuthology.orchestra.run.smithi097:> if mountpoint in contents: 2024-09-19T05:33:46.767 DEBUG:teuthology.orchestra.run.smithi097:> return f 2024-09-19T05:33:46.767 DEBUG:teuthology.orchestra.run.smithi097:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:33:46.767 DEBUG:teuthology.orchestra.run.smithi097:> 2024-09-19T05:33:46.767 DEBUG:teuthology.orchestra.run.smithi097:> print(_find_admin_socket("client.3")) 2024-09-19T05:33:46.767 DEBUG:teuthology.orchestra.run.smithi097:> ' 2024-09-19T05:33:46.890 INFO:teuthology.orchestra.run.smithi097.stdout:/var/run/ceph/ceph-client.3.35046.asok 2024-09-19T05:33:46.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-19T05:33:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:33:46.901 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.35046.asok 2024-09-19T05:33:46.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:46.902 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.35046.asok status 2024-09-19T05:33:47.056 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-19T05:33:47.056 INFO:teuthology.orchestra.run.smithi097.stdout: "metadata": { 2024-09-19T05:33:47.056 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "entity_id": "3", 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "hostname": "smithi097", 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "pid": "35046", 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "root": "/" 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_count": 0, 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_pinned_count": 0, 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4472, 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "inst": { 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "name": { 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "client", 2024-09-19T05:33:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "num": 4472 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.2:0", 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3604169138 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.2:0", 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3604169138 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "inst_str": "client.4472 192.168.0.2:0/3604169138", 2024-09-19T05:33:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "addr_str": "192.168.0.2:0/3604169138", 2024-09-19T05:33:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "inode_count": 1, 2024-09-19T05:33:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_epoch": 8, 2024-09-19T05:33:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch": 25, 2024-09-19T05:33:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:33:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklisted": false, 2024-09-19T05:33:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs" 2024-09-19T05:33:47.059 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-19T05:33:47.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:47.070 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:33:47.070 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:47.077 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:33:47.077 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:47.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:47.077 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:47.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:47.134 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:33:47.134 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-19T05:33:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:33:47.182 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-19T05:33:47.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:47.182 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-19T05:33:47.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:47.237 DEBUG:teuthology.orchestra.run.smithi097:> stat --file-system '--printf=%T 2024-09-19T05:33:47.237 DEBUG:teuthology.orchestra.run.smithi097:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:47.244 INFO:teuthology.orchestra.run.smithi097.stdout:fuseblk 2024-09-19T05:33:47.244 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:47.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:47.245 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:47.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:47.302 DEBUG:teuthology.orchestra.run.smithi097:> stat --file-system '--printf=%T 2024-09-19T05:33:47.302 DEBUG:teuthology.orchestra.run.smithi097:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-19T05:33:47.349 INFO:teuthology.orchestra.run.smithi097.stdout:fuseblk 2024-09-19T05:33:47.350 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-19T05:33:47.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:47.350 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-19T05:33:47.405 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-19T05:33:47.609 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-09-19T05:33:47.609 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-19T05:33:47.609 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:47.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96c4ba3640 1 Processor -- start 2024-09-19T05:33:47.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96c4ba3640 1 -- start start 2024-09-19T05:33:47.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96c4ba3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f96c00b6050 0x7f96c00ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:47.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96c4ba3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c00b5b90 con 0x7f96c00b6cf0 2024-09-19T05:33:47.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96c4ba3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c00b15f0 con 0x7f96c015e640 2024-09-19T05:33:47.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96c4ba3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f96c00b4780 con 0x7f96c00b6050 2024-09-19T05:33:47.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96bdd9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f96c00b6050 0x7f96c00ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:47.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96bed9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f96c00b6cf0 0x7f96c006bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48138/0 (socket says 172.21.15.67:48138) 2024-09-19T05:33:47.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96bed9d640 1 -- 172.21.15.67:0/393099184 learned_addr learned my addr 172.21.15.67:0/393099184 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:47.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96bdd9b640 1 -- 172.21.15.67:0/393099184 >> v1:172.21.15.97:6789/0 conn(0x7f96c015e640 legacy=0x7f96c00b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:47.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96bdd9b640 1 -- 172.21.15.67:0/393099184 >> v1:172.21.15.67:6789/0 conn(0x7f96c00b6cf0 legacy=0x7f96c006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.741+0000 7f96bdd9b640 1 -- 172.21.15.67:0/393099184 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c00b44a0 con 0x7f96c00b6050 2024-09-19T05:33:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96bdd9b640 1 --2- 172.21.15.67:0/393099184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c00b6050 0x7f96c00ae0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009d90 tx=0x7f96a801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6c5ff4a271efdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96bd59a640 1 -- 172.21.15.67:0/393099184 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80b2070 con 0x7f96c00b6050 2024-09-19T05:33:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96bd59a640 1 -- 172.21.15.67:0/393099184 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a80a58d0 con 0x7f96c00b6050 2024-09-19T05:33:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96bd59a640 1 -- 172.21.15.67:0/393099184 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80a5ca0 con 0x7f96c00b6050 2024-09-19T05:33:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 -- 172.21.15.67:0/393099184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c00b6050 msgr2=0x7f96c00ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 --2- 172.21.15.67:0/393099184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c00b6050 0x7f96c00ae0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009d90 tx=0x7f96a801c810 comp rx=0 tx=0).stop 2024-09-19T05:33:47.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 -- 172.21.15.67:0/393099184 shutdown_connections 2024-09-19T05:33:47.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 --2- 172.21.15.67:0/393099184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c00b6050 0x7f96c00ae0a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 -- 172.21.15.67:0/393099184 >> 172.21.15.67:0/393099184 conn(0x7f96c009aa30 msgr2=0x7f96c00b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:47.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 -- 172.21.15.67:0/393099184 shutdown_connections 2024-09-19T05:33:47.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 -- 172.21.15.67:0/393099184 wait complete. 2024-09-19T05:33:47.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 Processor -- start 2024-09-19T05:33:47.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 -- start start 2024-09-19T05:33:47.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96c00b6050 0x7f96c015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:47.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96c00b6cf0 0x7f96c00cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:47.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c015e640 0x7f96c0160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:47.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f96c00b0790 con 0x7f96c015e640 2024-09-19T05:33:47.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f96c00b2b40 con 0x7f96c00b6050 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.745+0000 7f96c4ba3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f96c00b0910 con 0x7f96c00b6cf0 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96bed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c015e640 0x7f96c0160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96bed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c015e640 0x7f96c0160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58702/0 (socket says 172.21.15.67:58702) 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96bed9d640 1 -- 172.21.15.67:0/2200894639 learned_addr learned my addr 172.21.15.67:0/2200894639 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96bed9d640 1 -- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96c00b6cf0 msgr2=0x7f96c00cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96bed9d640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96c00b6cf0 0x7f96c00cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96bed9d640 1 -- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96c00b6050 msgr2=0x7f96c015b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96bed9d640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96c00b6050 0x7f96c015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96bed9d640 1 -- 172.21.15.67:0/2200894639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c015bf20 con 0x7f96c015e640 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96bed9d640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c015e640 0x7f96c0160ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f96b800c400 tx=0x7f96b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96b6ffd640 1 -- 172.21.15.67:0/2200894639 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8017070 con 0x7f96c015e640 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96b6ffd640 1 -- 172.21.15.67:0/2200894639 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b8005cf0 con 0x7f96c015e640 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96c4ba3640 1 -- 172.21.15.67:0/2200894639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c015c200 con 0x7f96c015e640 2024-09-19T05:33:47.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96b6ffd640 1 -- 172.21.15.67:0/2200894639 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b80072d0 con 0x7f96c015e640 2024-09-19T05:33:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96c4ba3640 1 -- 172.21.15.67:0/2200894639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c015caa0 con 0x7f96c015e640 2024-09-19T05:33:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96c4ba3640 1 -- 172.21.15.67:0/2200894639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c00b40c0 con 0x7f96c015e640 2024-09-19T05:33:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96b6ffd640 1 -- 172.21.15.67:0/2200894639 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96b801a070 con 0x7f96c015e640 2024-09-19T05:33:47.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96b6ffd640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96a00678c0 0x7f96a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:47.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96b6ffd640 1 -- 172.21.15.67:0/2200894639 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f96b8085290 con 0x7f96c015e640 2024-09-19T05:33:47.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96be59c640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96a00678c0 0x7f96a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:47.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.749+0000 7f96be59c640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96a00678c0 0x7f96a0069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f96b0003cf0 tx=0x7f96b00079c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:47.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.753+0000 7f96b6ffd640 1 -- 172.21.15.67:0/2200894639 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f96c00b5b90 con 0x7f96c015e640 2024-09-19T05:33:47.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.921+0000 7f96c4ba3640 1 -- 172.21.15.67:0/2200894639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96c015c3d0 con 0x7f96c015e640 2024-09-19T05:33:47.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.921+0000 7f96b6ffd640 1 -- 172.21.15.67:0/2200894639 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f96b8055440 con 0x7f96c015e640 2024-09-19T05:33:47.927 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:47.927 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:47.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 -- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96a00678c0 msgr2=0x7f96a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96a00678c0 0x7f96a0069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f96b0003cf0 tx=0x7f96b00079c0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 -- 172.21.15.67:0/2200894639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c015e640 msgr2=0x7f96c0160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c015e640 0x7f96c0160ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f96b800c400 tx=0x7f96b800c8c0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 -- 172.21.15.67:0/2200894639 shutdown_connections 2024-09-19T05:33:47.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96c015e640 0x7f96c0160ee0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96a00678c0 0x7f96a0069d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96c00b6cf0 0x7f96c00cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 --2- 172.21.15.67:0/2200894639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96c00b6050 0x7f96c015b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 -- 172.21.15.67:0/2200894639 >> 172.21.15.67:0/2200894639 conn(0x7f96c009aa30 msgr2=0x7f96c00ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 -- 172.21.15.67:0/2200894639 shutdown_connections 2024-09-19T05:33:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:47.925+0000 7f96c4ba3640 1 -- 172.21.15.67:0/2200894639 wait complete. 2024-09-19T05:33:47.946 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T05:33:11.695580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T05:33:12.872293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-19T05:33:16.589603+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-19T05:33:47.947 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:33:48.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bff09b640 1 Processor -- start 2024-09-19T05:33:48.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bff09b640 1 -- start start 2024-09-19T05:33:48.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bff09b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8bf806d920 0x7f8bf80b7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bff09b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bf80cf410 con 0x7f8bf815e5c0 2024-09-19T05:33:48.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bff09b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bf80cf6f0 con 0x7f8bf80b7aa0 2024-09-19T05:33:48.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bff09b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8bf815e9a0 con 0x7f8bf806d920 2024-09-19T05:33:48.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bfce37640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8bf815e5c0 0x7f8bf80d28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48152/0 (socket says 172.21.15.67:48152) 2024-09-19T05:33:48.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bfce37640 1 -- 172.21.15.67:0/3285340274 learned_addr learned my addr 172.21.15.67:0/3285340274 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:48.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf7fff640 1 --2- 172.21.15.67:0/3285340274 >> v2:172.21.15.97:3300/0 conn(0x7f8bf806d920 0x7f8bf80b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289090372 0 0) 0x7f8bf80cf410 con 0x7f8bf815e5c0 2024-09-19T05:33:48.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8be8003530 con 0x7f8bf815e5c0 2024-09-19T05:33:48.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3875824248 0 0) 0x7f8be8003530 con 0x7f8bf815e5c0 2024-09-19T05:33:48.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 >> v2:172.21.15.97:3300/0 conn(0x7f8bf806d920 msgr2=0x7f8bf80b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:48.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 --2- 172.21.15.67:0/3285340274 >> v2:172.21.15.97:3300/0 conn(0x7f8bf806d920 0x7f8bf80b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 >> v1:172.21.15.97:6789/0 conn(0x7f8bf80b7aa0 legacy=0x7f8bf80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf80cf9d0 con 0x7f8bf815e5c0 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f8be4001680 con 0x7f8bf815e5c0 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 >> v1:172.21.15.67:6789/0 conn(0x7f8bf815e5c0 legacy=0x7f8bf80d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8be8003a10 0x7f8be8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8be8004810 0x7f8be8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8be800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf815e9a0 con 0x7f8be80051d0 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8be800c0b0 con 0x7f8be8003a10 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8be800c2b0 con 0x7f8be8004810 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bfd638640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8be800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bfce37640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8be8003a10 0x7f8be8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bf7fff640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8be8004810 0x7f8be8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bfd638640 1 -- 172.21.15.67:0/3285340274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8be8004810 msgr2=0x7f8be8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:48.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bfd638640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8be8004810 0x7f8be8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bfd638640 1 -- 172.21.15.67:0/3285340274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8be8003a10 msgr2=0x7f8be8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:48.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bfd638640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8be8003a10 0x7f8be8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.065+0000 7f8bfd638640 1 -- 172.21.15.67:0/3285340274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be8003530 con 0x7f8be80051d0 2024-09-19T05:33:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bfd638640 1 -- 172.21.15.67:0/3285340274 reap_dead start 2024-09-19T05:33:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bfd638640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8be800b9d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0001e70 tx=0x7f8bf001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d6d8f56f20bacd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0001a90 con 0x7f8be80051d0 2024-09-19T05:33:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf0003bc0 con 0x7f8be80051d0 2024-09-19T05:33:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bf77fe640 1 -- 172.21.15.67:0/3285340274 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0005020 con 0x7f8be80051d0 2024-09-19T05:33:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 -- 172.21.15.67:0/3285340274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 msgr2=0x7f8be800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8be800b9d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0001e70 tx=0x7f8bf001c780 comp rx=0 tx=0).stop 2024-09-19T05:33:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 -- 172.21.15.67:0/3285340274 shutdown_connections 2024-09-19T05:33:48.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 --2- 172.21.15.67:0/3285340274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8be800b9d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 -- 172.21.15.67:0/3285340274 >> 172.21.15.67:0/3285340274 conn(0x7f8bf80d46b0 msgr2=0x7f8bf80d4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:48.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 -- 172.21.15.67:0/3285340274 shutdown_connections 2024-09-19T05:33:48.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 -- 172.21.15.67:0/3285340274 wait complete. 2024-09-19T05:33:48.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 Processor -- start 2024-09-19T05:33:48.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 -- start start 2024-09-19T05:33:48.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8bf814c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8bf80b66e0 0x7f8bf80b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bf80c9e10 0x7f8bf80ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf80b78f0 con 0x7f8be80051d0 2024-09-19T05:33:48.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf80b7770 con 0x7f8bf80c9e10 2024-09-19T05:33:48.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.069+0000 7f8bff09b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf80cfd40 con 0x7f8bf80b66e0 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfce37640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8bf814c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfce37640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8bf814c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58706/0 (socket says 172.21.15.67:58706) 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfce37640 1 -- 172.21.15.67:0/2165841242 learned_addr learned my addr 172.21.15.67:0/2165841242 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bf7fff640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8bf80b66e0 0x7f8bf80b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfd638640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bf80c9e10 0x7f8bf80ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfce37640 1 -- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8bf80b66e0 msgr2=0x7f8bf80b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfce37640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8bf80b66e0 0x7f8bf80b6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfce37640 1 -- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bf80c9e10 msgr2=0x7f8bf80ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfce37640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bf80c9e10 0x7f8bf80ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfce37640 1 -- 172.21.15.67:0/2165841242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf80b4b10 con 0x7f8be80051d0 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfd638640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bf80c9e10 0x7f8bf80ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bfce37640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8bf814c730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8be400e7b0 tx=0x7f8be400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:48.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bf57fa640 1 -- 172.21.15.67:0/2165841242 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be400c6c0 con 0x7f8be80051d0 2024-09-19T05:33:48.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bf57fa640 1 -- 172.21.15.67:0/2165841242 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be4018070 con 0x7f8be80051d0 2024-09-19T05:33:48.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bff09b640 1 -- 172.21.15.67:0/2165841242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf80b4df0 con 0x7f8be80051d0 2024-09-19T05:33:48.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bf57fa640 1 -- 172.21.15.67:0/2165841242 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be400ca80 con 0x7f8be80051d0 2024-09-19T05:33:48.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bff09b640 1 -- 172.21.15.67:0/2165841242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf80b53b0 con 0x7f8be80051d0 2024-09-19T05:33:48.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bff09b640 1 -- 172.21.15.67:0/2165841242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf80d2930 con 0x7f8be80051d0 2024-09-19T05:33:48.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bf57fa640 1 -- 172.21.15.67:0/2165841242 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8be400cc20 con 0x7f8be80051d0 2024-09-19T05:33:48.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bf57fa640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8bdc0678f0 0x7f8bdc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bf57fa640 1 -- 172.21.15.67:0/2165841242 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8be40866b0 con 0x7f8be80051d0 2024-09-19T05:33:48.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.073+0000 7f8bf7fff640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8bdc0678f0 0x7f8bdc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.077+0000 7f8bf7fff640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8bdc0678f0 0x7f8bdc069db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80b9a60 tx=0x7f8bec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:48.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.077+0000 7f8bf57fa640 1 -- 172.21.15.67:0/2165841242 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8be4056f20 con 0x7f8be80051d0 2024-09-19T05:33:48.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.241+0000 7f8bff09b640 1 -- 172.21.15.67:0/2165841242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8bf815d330 con 0x7f8be80051d0 2024-09-19T05:33:48.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.241+0000 7f8bf57fa640 1 -- 172.21.15.67:0/2165841242 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f8be4056820 con 0x7f8be80051d0 2024-09-19T05:33:48.247 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:33:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 -- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8bdc0678f0 msgr2=0x7f8bdc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8bdc0678f0 0x7f8bdc069db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80b9a60 tx=0x7f8bec008040 comp rx=0 tx=0).stop 2024-09-19T05:33:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 -- 172.21.15.67:0/2165841242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 msgr2=0x7f8bf814c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8bf814c730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8be400e7b0 tx=0x7f8be400ec70 comp rx=0 tx=0).stop 2024-09-19T05:33:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 -- 172.21.15.67:0/2165841242 shutdown_connections 2024-09-19T05:33:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bf80c9e10 0x7f8bf80ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8bdc0678f0 0x7f8bdc069db0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8bf80b66e0 0x7f8bf80b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 --2- 172.21.15.67:0/2165841242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8be80051d0 0x7f8bf814c730 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 -- 172.21.15.67:0/2165841242 >> 172.21.15.67:0/2165841242 conn(0x7f8bf80d46b0 msgr2=0x7f8bf80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 -- 172.21.15.67:0/2165841242 shutdown_connections 2024-09-19T05:33:48.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.245+0000 7f8bff09b640 1 -- 172.21.15.67:0/2165841242 wait complete. 2024-09-19T05:33:48.266 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T05:33:48.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f6524a50640 1 Processor -- start 2024-09-19T05:33:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f6524a50640 1 -- start start 2024-09-19T05:33:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f6524a50640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f652015c200 0x7f652006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f6524a50640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6520070990 0x7f652006d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f6524a50640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65200d0330 con 0x7f65200732f0 2024-09-19T05:33:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f6524a50640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f65200b3a10 con 0x7f652015c200 2024-09-19T05:33:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f6524a50640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f65200d00e0 con 0x7f6520070990 2024-09-19T05:33:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f651e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f652015c200 0x7f652006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f651e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f652015c200 0x7f652006ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58720/0 (socket says 172.21.15.67:58720) 2024-09-19T05:33:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f651e59c640 1 -- 172.21.15.67:0/4282940850 learned_addr learned my addr 172.21.15.67:0/4282940850 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f651ed9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f65200732f0 0x7f652015c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48166/0 (socket says 172.21.15.67:48166) 2024-09-19T05:33:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f651dd9b640 1 --2- 172.21.15.67:0/4282940850 >> v2:172.21.15.97:3300/0 conn(0x7f6520070990 0x7f652006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f651e59c640 1 -- 172.21.15.67:0/4282940850 >> v2:172.21.15.97:3300/0 conn(0x7f6520070990 msgr2=0x7f652006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f651e59c640 1 --2- 172.21.15.67:0/4282940850 >> v2:172.21.15.97:3300/0 conn(0x7f6520070990 0x7f652006d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f651e59c640 1 -- 172.21.15.67:0/4282940850 >> v1:172.21.15.67:6789/0 conn(0x7f65200732f0 legacy=0x7f652015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.389+0000 7f651e59c640 1 -- 172.21.15.67:0/4282940850 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65200d0610 con 0x7f652015c200 2024-09-19T05:33:48.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f651e59c640 1 --2- 172.21.15.67:0/4282940850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 0x7f652006ccd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6520073740 tx=0x7f651001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1370190c7b38f8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:48.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f651d59a640 1 -- 172.21.15.67:0/4282940850 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65100a58a0 con 0x7f652015c200 2024-09-19T05:33:48.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f651d59a640 1 -- 172.21.15.67:0/4282940850 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65100a5a40 con 0x7f652015c200 2024-09-19T05:33:48.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f651d59a640 1 -- 172.21.15.67:0/4282940850 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65100a5e10 con 0x7f652015c200 2024-09-19T05:33:48.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 -- 172.21.15.67:0/4282940850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 msgr2=0x7f652006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 --2- 172.21.15.67:0/4282940850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 0x7f652006ccd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6520073740 tx=0x7f651001c9c0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 -- 172.21.15.67:0/4282940850 shutdown_connections 2024-09-19T05:33:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 --2- 172.21.15.67:0/4282940850 >> v2:172.21.15.97:3300/0 conn(0x7f6520070990 0x7f652006d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 --2- 172.21.15.67:0/4282940850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 0x7f652006ccd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 -- 172.21.15.67:0/4282940850 >> 172.21.15.67:0/4282940850 conn(0x7f65200727d0 msgr2=0x7f6520072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 -- 172.21.15.67:0/4282940850 shutdown_connections 2024-09-19T05:33:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 -- 172.21.15.67:0/4282940850 wait complete. 2024-09-19T05:33:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 Processor -- start 2024-09-19T05:33:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 -- start start 2024-09-19T05:33:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200732f0 0x7f652014aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 0x7f652015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6520145570 0x7f652014c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f65201691a0 con 0x7f652015c200 2024-09-19T05:33:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6520169020 con 0x7f65200732f0 2024-09-19T05:33:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f6524a50640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6520169320 con 0x7f6520145570 2024-09-19T05:33:48.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f651dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 0x7f652015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f651dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 0x7f652015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58734/0 (socket says 172.21.15.67:58734) 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.393+0000 7f651dd9b640 1 -- 172.21.15.67:0/1229304786 learned_addr learned my addr 172.21.15.67:0/1229304786 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f651e59c640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200732f0 0x7f652014aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f651dd9b640 1 -- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6520145570 msgr2=0x7f652014c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f651dd9b640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6520145570 0x7f652014c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f651dd9b640 1 -- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200732f0 msgr2=0x7f652014aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f651dd9b640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200732f0 0x7f652014aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f651dd9b640 1 -- 172.21.15.67:0/1229304786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6520146a20 con 0x7f652015c200 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f651e59c640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200732f0 0x7f652014aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f651dd9b640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 0x7f652015a360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f651400d800 tx=0x7f651400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f650effd640 1 -- 172.21.15.67:0/1229304786 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514004020 con 0x7f652015c200 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f650effd640 1 -- 172.21.15.67:0/1229304786 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65140041c0 con 0x7f652015c200 2024-09-19T05:33:48.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f650effd640 1 -- 172.21.15.67:0/1229304786 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140043b0 con 0x7f652015c200 2024-09-19T05:33:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f6524a50640 1 -- 172.21.15.67:0/1229304786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6520146d00 con 0x7f652015c200 2024-09-19T05:33:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f6524a50640 1 -- 172.21.15.67:0/1229304786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6520145a00 con 0x7f652015c200 2024-09-19T05:33:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f6524a50640 1 -- 172.21.15.67:0/1229304786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652015c5e0 con 0x7f652015c200 2024-09-19T05:33:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f650effd640 1 -- 172.21.15.67:0/1229304786 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f651401b020 con 0x7f652015c200 2024-09-19T05:33:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f650effd640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65000678f0 0x7f6500069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f650effd640 1 -- 172.21.15.67:0/1229304786 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6514085e80 con 0x7f652015c200 2024-09-19T05:33:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.397+0000 7f651e59c640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65000678f0 0x7f6500069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.401+0000 7f651e59c640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65000678f0 0x7f6500069db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f65100ae000 tx=0x7f65100a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:48.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.401+0000 7f650effd640 1 -- 172.21.15.67:0/1229304786 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f65140565f0 con 0x7f652015c200 2024-09-19T05:33:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 -- 172.21.15.67:0/1229304786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f652015ba10 con 0x7f652015c200 2024-09-19T05:33:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f650effd640 1 -- 172.21.15.67:0/1229304786 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f6514055ef0 con 0x7f652015c200 2024-09-19T05:33:48.573 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-09-19T05:33:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 -- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65000678f0 msgr2=0x7f6500069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65000678f0 0x7f6500069db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f65100ae000 tx=0x7f65100a7070 comp rx=0 tx=0).stop 2024-09-19T05:33:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 -- 172.21.15.67:0/1229304786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 msgr2=0x7f652015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 0x7f652015a360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f651400d800 tx=0x7f651400dcc0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 -- 172.21.15.67:0/1229304786 shutdown_connections 2024-09-19T05:33:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65000678f0 0x7f6500069db0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6520145570 0x7f652014c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652015c200 0x7f652015a360 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 --2- 172.21.15.67:0/1229304786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200732f0 0x7f652014aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 -- 172.21.15.67:0/1229304786 >> 172.21.15.67:0/1229304786 conn(0x7f65200727d0 msgr2=0x7f65200b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 -- 172.21.15.67:0/1229304786 shutdown_connections 2024-09-19T05:33:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.569+0000 7f6524a50640 1 -- 172.21.15.67:0/1229304786 wait complete. 2024-09-19T05:33:48.591 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T05:33:48.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7ffaa640 1 Processor -- start 2024-09-19T05:33:48.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7ffaa640 1 -- start start 2024-09-19T05:33:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7ffaa640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b7815b2a0 0x7f6b780af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7ffaa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b780b67a0 0x7f6b780afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7ffaa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b780b7340 con 0x7f6b7806f210 2024-09-19T05:33:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7ffaa640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6b780aed60 con 0x7f6b7815b2a0 2024-09-19T05:33:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7ffaa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b780b7060 con 0x7f6b780b67a0 2024-09-19T05:33:48.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7dd46640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b7815b2a0 0x7f6b780af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7dd46640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b7815b2a0 0x7f6b780af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58744/0 (socket says 172.21.15.67:58744) 2024-09-19T05:33:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7dd46640 1 -- 172.21.15.67:0/715179635 learned_addr learned my addr 172.21.15.67:0/715179635 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7d545640 1 --2- 172.21.15.67:0/715179635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b780b67a0 0x7f6b780afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7dd46640 1 -- 172.21.15.67:0/715179635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b780b67a0 msgr2=0x7f6b780afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7dd46640 1 --2- 172.21.15.67:0/715179635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b780b67a0 0x7f6b780afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7dd46640 1 -- 172.21.15.67:0/715179635 >> v1:172.21.15.97:6789/0 conn(0x7f6b7806f210 legacy=0x7f6b7806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7dd46640 1 -- 172.21.15.67:0/715179635 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b780af000 con 0x7f6b7815b2a0 2024-09-19T05:33:48.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.709+0000 7f6b7d545640 1 --2- 172.21.15.67:0/715179635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b780b67a0 0x7f6b780afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7dd46640 1 --2- 172.21.15.67:0/715179635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b7815b2a0 0x7f6b780af900 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009870 tx=0x7f6b7401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a07708c74d7378 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7cd44640 1 -- 172.21.15.67:0/715179635 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740b0070 con 0x7f6b7815b2a0 2024-09-19T05:33:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7cd44640 1 -- 172.21.15.67:0/715179635 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b740ab600 con 0x7f6b7815b2a0 2024-09-19T05:33:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7cd44640 1 -- 172.21.15.67:0/715179635 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740ab9d0 con 0x7f6b7815b2a0 2024-09-19T05:33:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/715179635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b7815b2a0 msgr2=0x7f6b780af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 --2- 172.21.15.67:0/715179635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b7815b2a0 0x7f6b780af900 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009870 tx=0x7f6b7401c490 comp rx=0 tx=0).stop 2024-09-19T05:33:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/715179635 shutdown_connections 2024-09-19T05:33:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 --2- 172.21.15.67:0/715179635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b780b67a0 0x7f6b780afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 --2- 172.21.15.67:0/715179635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b7815b2a0 0x7f6b780af900 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/715179635 >> 172.21.15.67:0/715179635 conn(0x7f6b780b2f40 msgr2=0x7f6b780b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/715179635 shutdown_connections 2024-09-19T05:33:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/715179635 wait complete. 2024-09-19T05:33:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 Processor -- start 2024-09-19T05:33:48.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 -- start start 2024-09-19T05:33:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b7806f210 0x7f6b78149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b780b67a0 0x7f6b78157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7815b2a0 0x7f6b78158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b78167ff0 con 0x7f6b780b67a0 2024-09-19T05:33:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b78167e70 con 0x7f6b7815b2a0 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7ffaa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b78168170 con 0x7f6b7806f210 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7d545640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b780b67a0 0x7f6b78157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7d545640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b780b67a0 0x7f6b78157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58750/0 (socket says 172.21.15.67:58750) 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.713+0000 7f6b7d545640 1 -- 172.21.15.67:0/1423830773 learned_addr learned my addr 172.21.15.67:0/1423830773 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7dd46640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b7806f210 0x7f6b78149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7e547640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7815b2a0 0x7f6b78158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7d545640 1 -- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b7806f210 msgr2=0x7f6b78149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7d545640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b7806f210 0x7f6b78149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7d545640 1 -- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7815b2a0 msgr2=0x7f6b78158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7d545640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7815b2a0 0x7f6b78158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7d545640 1 -- 172.21.15.67:0/1423830773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7814a110 con 0x7f6b780b67a0 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7e547640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7815b2a0 0x7f6b78158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:48.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7dd46640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b7806f210 0x7f6b78149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7d545640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b780b67a0 0x7f6b78157b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c7c0 tx=0x7f6b6800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b6e7fc640 1 -- 172.21.15.67:0/1423830773 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68007a30 con 0x7f6b780b67a0 2024-09-19T05:33:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b6e7fc640 1 -- 172.21.15.67:0/1423830773 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b68007bd0 con 0x7f6b780b67a0 2024-09-19T05:33:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/1423830773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7814fe80 con 0x7f6b780b67a0 2024-09-19T05:33:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b6e7fc640 1 -- 172.21.15.67:0/1423830773 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b680113f0 con 0x7f6b780b67a0 2024-09-19T05:33:48.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/1423830773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b78150440 con 0x7f6b780b67a0 2024-09-19T05:33:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/1423830773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b7806f660 con 0x7f6b780b67a0 2024-09-19T05:33:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b6e7fc640 1 -- 172.21.15.67:0/1423830773 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b68011590 con 0x7f6b780b67a0 2024-09-19T05:33:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b6e7fc640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b5c067910 0x7f6b5c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b6e7fc640 1 -- 172.21.15.67:0/1423830773 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6b680860b0 con 0x7f6b780b67a0 2024-09-19T05:33:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7dd46640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b5c067910 0x7f6b5c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.717+0000 7f6b7dd46640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b5c067910 0x7f6b5c069dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b740ad000 tx=0x7f6b74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.721+0000 7f6b6e7fc640 1 -- 172.21.15.67:0/1423830773 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6b68015020 con 0x7f6b780b67a0 2024-09-19T05:33:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.885+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/1423830773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6b78152d00 con 0x7f6b780b67a0 2024-09-19T05:33:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.885+0000 7f6b6e7fc640 1 -- 172.21.15.67:0/1423830773 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f6b680569a0 con 0x7f6b780b67a0 2024-09-19T05:33:48.890 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-09-19T05:33:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b5c067910 msgr2=0x7f6b5c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b5c067910 0x7f6b5c069dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b740ad000 tx=0x7f6b74008040 comp rx=0 tx=0).stop 2024-09-19T05:33:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/1423830773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b780b67a0 msgr2=0x7f6b78157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b780b67a0 0x7f6b78157b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c7c0 tx=0x7f6b6800cc80 comp rx=0 tx=0).stop 2024-09-19T05:33:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/1423830773 shutdown_connections 2024-09-19T05:33:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7815b2a0 0x7f6b78158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b780b67a0 0x7f6b78157b00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b5c067910 0x7f6b5c069dd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 --2- 172.21.15.67:0/1423830773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b7806f210 0x7f6b78149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/1423830773 >> 172.21.15.67:0/1423830773 conn(0x7f6b780b2f40 msgr2=0x7f6b78158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/1423830773 shutdown_connections 2024-09-19T05:33:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:48.889+0000 7f6b7ffaa640 1 -- 172.21.15.67:0/1423830773 wait complete. 2024-09-19T05:33:48.910 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-19T05:33:49.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63ac788640 1 Processor -- start 2024-09-19T05:33:49.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63ac788640 1 -- start start 2024-09-19T05:33:49.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63ac788640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63a4159c60 0x7f63a40ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63ac788640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f63a406ffd0 0x7f63a40aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63ac788640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a415a040 con 0x7f63a40b3150 2024-09-19T05:33:49.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63ac788640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f63a415d460 con 0x7f63a406ffd0 2024-09-19T05:33:49.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63ac788640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f63a415c850 con 0x7f63a4159c60 2024-09-19T05:33:49.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63a9d23640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f63a406ffd0 0x7f63a40aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63a9d23640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f63a406ffd0 0x7f63a40aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58762/0 (socket says 172.21.15.67:58762) 2024-09-19T05:33:49.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63a9d23640 1 -- 172.21.15.67:0/1422489603 learned_addr learned my addr 172.21.15.67:0/1422489603 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:49.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63aad25640 1 --1- 172.21.15.67:0/1422489603 >> v1:172.21.15.67:6789/0 conn(0x7f63a40b3150 0x7f63a415fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48178/0 (socket says 172.21.15.67:48178) 2024-09-19T05:33:49.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63aa524640 1 --2- 172.21.15.67:0/1422489603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63a4159c60 0x7f63a40ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63a9d23640 1 -- 172.21.15.67:0/1422489603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63a4159c60 msgr2=0x7f63a40ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:49.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63a9d23640 1 --2- 172.21.15.67:0/1422489603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63a4159c60 0x7f63a40ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63a9d23640 1 -- 172.21.15.67:0/1422489603 >> v1:172.21.15.67:6789/0 conn(0x7f63a40b3150 legacy=0x7f63a415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63a9522640 1 -- 172.21.15.67:0/1422489603 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1350971456 0 0) 0x7f63a415a040 con 0x7f63a40b3150 2024-09-19T05:33:49.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.025+0000 7f63a9d23640 1 -- 172.21.15.67:0/1422489603 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a415cb30 con 0x7f63a406ffd0 2024-09-19T05:33:49.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63a9d23640 1 --2- 172.21.15.67:0/1422489603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a406ffd0 0x7f63a40aec90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6394009870 tx=0x7f639401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb346079ea968ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63a9522640 1 -- 172.21.15.67:0/1422489603 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63940a95f0 con 0x7f63a406ffd0 2024-09-19T05:33:49.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63a9522640 1 -- 172.21.15.67:0/1422489603 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63940a9790 con 0x7f63a406ffd0 2024-09-19T05:33:49.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63a9522640 1 -- 172.21.15.67:0/1422489603 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63940a9b60 con 0x7f63a406ffd0 2024-09-19T05:33:49.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63ac788640 1 -- 172.21.15.67:0/1422489603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a406ffd0 msgr2=0x7f63a40aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63ac788640 1 --2- 172.21.15.67:0/1422489603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a406ffd0 0x7f63a40aec90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6394009870 tx=0x7f639401c530 comp rx=0 tx=0).stop 2024-09-19T05:33:49.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63ac788640 1 -- 172.21.15.67:0/1422489603 shutdown_connections 2024-09-19T05:33:49.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63ac788640 1 --2- 172.21.15.67:0/1422489603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a406ffd0 0x7f63a40aec90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63ac788640 1 --2- 172.21.15.67:0/1422489603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63a4159c60 0x7f63a40ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63ac788640 1 -- 172.21.15.67:0/1422489603 >> 172.21.15.67:0/1422489603 conn(0x7f63a40b1e50 msgr2=0x7f63a40b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:49.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63ac788640 1 -- 172.21.15.67:0/1422489603 shutdown_connections 2024-09-19T05:33:49.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63ac788640 1 -- 172.21.15.67:0/1422489603 wait complete. 2024-09-19T05:33:49.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63ac788640 1 Processor -- start 2024-09-19T05:33:49.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.029+0000 7f63ac788640 1 -- start start 2024-09-19T05:33:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63ac788640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63a406ffd0 0x7f63a409dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63ac788640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63a40b3150 0x7f63a415d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63ac788640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4159c60 0x7f63a41539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63ac788640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f63a40ad7f0 con 0x7f63a4159c60 2024-09-19T05:33:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63ac788640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f63a40ad670 con 0x7f63a406ffd0 2024-09-19T05:33:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63ac788640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f63a4168e30 con 0x7f63a40b3150 2024-09-19T05:33:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aad25640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4159c60 0x7f63a41539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aad25640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4159c60 0x7f63a41539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58776/0 (socket says 172.21.15.67:58776) 2024-09-19T05:33:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aad25640 1 -- 172.21.15.67:0/2706404873 learned_addr learned my addr 172.21.15.67:0/2706404873 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63a9d23640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63a40b3150 0x7f63a415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aa524640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63a406ffd0 0x7f63a409dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aad25640 1 -- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63a40b3150 msgr2=0x7f63a415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aad25640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63a40b3150 0x7f63a415d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aad25640 1 -- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63a406ffd0 msgr2=0x7f63a409dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aad25640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63a406ffd0 0x7f63a409dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aad25640 1 -- 172.21.15.67:0/2706404873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a415dc80 con 0x7f63a4159c60 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aa524640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63a406ffd0 0x7f63a409dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aad25640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4159c60 0x7f63a41539e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f639c00c7a0 tx=0x7f639c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f639affd640 1 -- 172.21.15.67:0/2706404873 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c018070 con 0x7f63a4159c60 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f639affd640 1 -- 172.21.15.67:0/2706404873 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c00a640 con 0x7f63a4159c60 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63ac788640 1 -- 172.21.15.67:0/2706404873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a4153f20 con 0x7f63a4159c60 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f639affd640 1 -- 172.21.15.67:0/2706404873 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c00aa70 con 0x7f63a4159c60 2024-09-19T05:33:49.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63ac788640 1 -- 172.21.15.67:0/2706404873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a415e1e0 con 0x7f63a4159c60 2024-09-19T05:33:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63ac788640 1 -- 172.21.15.67:0/2706404873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a40aec90 con 0x7f63a4159c60 2024-09-19T05:33:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f639affd640 1 -- 172.21.15.67:0/2706404873 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f639c01b070 con 0x7f63a4159c60 2024-09-19T05:33:49.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f639affd640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63880678c0 0x7f6388069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f639affd640 1 -- 172.21.15.67:0/2706404873 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f639c085510 con 0x7f63a4159c60 2024-09-19T05:33:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.033+0000 7f63aa524640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63880678c0 0x7f6388069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.037+0000 7f63aa524640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63880678c0 0x7f6388069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009a40 tx=0x7f63a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.037+0000 7f639affd640 1 -- 172.21.15.67:0/2706404873 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f63a415dc80 con 0x7f63a4159c60 2024-09-19T05:33:49.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 -- 172.21.15.67:0/2706404873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f63a40b4330 con 0x7f63a4159c60 2024-09-19T05:33:49.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f639affd640 1 -- 172.21.15.67:0/2706404873 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f639c055da0 con 0x7f63a4159c60 2024-09-19T05:33:49.209 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-09-19T05:33:49.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 -- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63880678c0 msgr2=0x7f6388069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63880678c0 0x7f6388069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009a40 tx=0x7f63a0008040 comp rx=0 tx=0).stop 2024-09-19T05:33:49.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 -- 172.21.15.67:0/2706404873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4159c60 msgr2=0x7f63a41539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4159c60 0x7f63a41539e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f639c00c7a0 tx=0x7f639c00cc60 comp rx=0 tx=0).stop 2024-09-19T05:33:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 -- 172.21.15.67:0/2706404873 shutdown_connections 2024-09-19T05:33:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4159c60 0x7f63a41539e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63880678c0 0x7f6388069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63a40b3150 0x7f63a415d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 --2- 172.21.15.67:0/2706404873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63a406ffd0 0x7f63a409dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 -- 172.21.15.67:0/2706404873 >> 172.21.15.67:0/2706404873 conn(0x7f63a40b1e50 msgr2=0x7f63a406eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 -- 172.21.15.67:0/2706404873 shutdown_connections 2024-09-19T05:33:49.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.205+0000 7f63ac788640 1 -- 172.21.15.67:0/2706404873 wait complete. 2024-09-19T05:33:49.228 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-19T05:33:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.345+0000 7f2e7ce3a640 1 Processor -- start 2024-09-19T05:33:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.345+0000 7f2e7ce3a640 1 -- start start 2024-09-19T05:33:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e7ce3a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e78144e90 0x7f2e780d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e7ce3a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2e780ae6c0 0x7f2e780b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e7ce3a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e780b1190 con 0x7f2e780aeb00 2024-09-19T05:33:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e7ce3a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2e780b1470 con 0x7f2e780ae6c0 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e7ce3a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2e780b1750 con 0x7f2e78144e90 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e76d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2e780aeb00 0x7f2e780b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48190/0 (socket says 172.21.15.67:48190) 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e76d9d640 1 -- 172.21.15.67:0/58804597 learned_addr learned my addr 172.21.15.67:0/58804597 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e6dd9b640 1 --2- 172.21.15.67:0/58804597 >> v2:172.21.15.97:3300/0 conn(0x7f2e780ae6c0 0x7f2e780b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e7659c640 1 --2- 172.21.15.67:0/58804597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e78144e90 0x7f2e780d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e75d9b640 1 -- 172.21.15.67:0/58804597 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606765583 0 0) 0x7f2e780b1190 con 0x7f2e780aeb00 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e75d9b640 1 -- 172.21.15.67:0/58804597 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e64003530 con 0x7f2e780aeb00 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e6dd9b640 1 -- 172.21.15.67:0/58804597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e78144e90 msgr2=0x7f2e780d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e6dd9b640 1 --2- 172.21.15.67:0/58804597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e78144e90 0x7f2e780d1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e6dd9b640 1 -- 172.21.15.67:0/58804597 >> v1:172.21.15.67:6789/0 conn(0x7f2e780aeb00 legacy=0x7f2e780b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.349+0000 7f2e6dd9b640 1 -- 172.21.15.67:0/58804597 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e780b1a30 con 0x7f2e780ae6c0 2024-09-19T05:33:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e6dd9b640 1 --2- 172.21.15.67:0/58804597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e780ae6c0 0x7f2e780b49e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e600097c0 tx=0x7f2e6001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdddbaea58c0d73b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e75d9b640 1 -- 172.21.15.67:0/58804597 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e600b0070 con 0x7f2e780ae6c0 2024-09-19T05:33:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e75d9b640 1 -- 172.21.15.67:0/58804597 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e600ab600 con 0x7f2e780ae6c0 2024-09-19T05:33:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e75d9b640 1 -- 172.21.15.67:0/58804597 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e600ab9b0 con 0x7f2e780ae6c0 2024-09-19T05:33:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/58804597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e780ae6c0 msgr2=0x7f2e780b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 --2- 172.21.15.67:0/58804597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e780ae6c0 0x7f2e780b49e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e600097c0 tx=0x7f2e6001c4a0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/58804597 shutdown_connections 2024-09-19T05:33:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 --2- 172.21.15.67:0/58804597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e780ae6c0 0x7f2e780b49e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 --2- 172.21.15.67:0/58804597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e78144e90 0x7f2e780d1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/58804597 >> 172.21.15.67:0/58804597 conn(0x7f2e7809aa30 msgr2=0x7f2e780b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/58804597 shutdown_connections 2024-09-19T05:33:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/58804597 wait complete. 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 Processor -- start 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- start start 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e780ae6c0 0x7f2e781419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e780aeb00 0x7f2e78144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e78144e90 0x7f2e78158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2e78168880 con 0x7f2e78144e90 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2e780b5330 con 0x7f2e780aeb00 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2e78168a00 con 0x7f2e780ae6c0 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e76d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e78144e90 0x7f2e78158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e76d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e78144e90 0x7f2e78158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58780/0 (socket says 172.21.15.67:58780) 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e76d9d640 1 -- 172.21.15.67:0/1470398111 learned_addr learned my addr 172.21.15.67:0/1470398111 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7659c640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e780ae6c0 0x7f2e781419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e6dd9b640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e780aeb00 0x7f2e78144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e76d9d640 1 -- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e780ae6c0 msgr2=0x7f2e781419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e76d9d640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e780ae6c0 0x7f2e781419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e76d9d640 1 -- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e780aeb00 msgr2=0x7f2e78144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e76d9d640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e780aeb00 0x7f2e78144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e76d9d640 1 -- 172.21.15.67:0/1470398111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e780af990 con 0x7f2e78144e90 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e6dd9b640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e780aeb00 0x7f2e78144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7659c640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e780ae6c0 0x7f2e781419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e76d9d640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e78144e90 0x7f2e78158320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000cb70 tx=0x7f2e7000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e6f7fe640 1 -- 172.21.15.67:0/1470398111 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e70017070 con 0x7f2e78144e90 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e6f7fe640 1 -- 172.21.15.67:0/1470398111 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7000ad40 con 0x7f2e78144e90 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/1470398111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e78159100 con 0x7f2e78144e90 2024-09-19T05:33:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e6f7fe640 1 -- 172.21.15.67:0/1470398111 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e70012620 con 0x7f2e78144e90 2024-09-19T05:33:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.353+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/1470398111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e78158e20 con 0x7f2e78144e90 2024-09-19T05:33:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.357+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/1470398111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e780b1190 con 0x7f2e78144e90 2024-09-19T05:33:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.357+0000 7f2e6f7fe640 1 -- 172.21.15.67:0/1470398111 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e7001a070 con 0x7f2e78144e90 2024-09-19T05:33:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.357+0000 7f2e6f7fe640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e580678c0 0x7f2e58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.357+0000 7f2e6f7fe640 1 -- 172.21.15.67:0/1470398111 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2e70085e80 con 0x7f2e78144e90 2024-09-19T05:33:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.357+0000 7f2e7659c640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e580678c0 0x7f2e58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.357+0000 7f2e7659c640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e580678c0 0x7f2e58069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e7815b6b0 tx=0x7f2e68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.361+0000 7f2e6f7fe640 1 -- 172.21.15.67:0/1470398111 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2e70056600 con 0x7f2e78144e90 2024-09-19T05:33:49.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:49.577+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/1470398111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f2e780cd8b0 con 0x7f2e78144e90 2024-09-19T05:33:50.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.261+0000 7f2e6f7fe640 1 -- 172.21.15.67:0/1470398111 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v53) ==== 151+0+0 (secure 0 0 0) 0x7f2e70055f00 con 0x7f2e78144e90 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e580678c0 msgr2=0x7f2e58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e580678c0 0x7f2e58069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e7815b6b0 tx=0x7f2e68008040 comp rx=0 tx=0).stop 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/1470398111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e78144e90 msgr2=0x7f2e78158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e78144e90 0x7f2e78158320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000cb70 tx=0x7f2e7000a430 comp rx=0 tx=0).stop 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/1470398111 shutdown_connections 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e78144e90 0x7f2e78158320 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e780aeb00 0x7f2e78144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e580678c0 0x7f2e58069d80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 --2- 172.21.15.67:0/1470398111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e780ae6c0 0x7f2e781419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/1470398111 >> 172.21.15.67:0/1470398111 conn(0x7f2e7809aa30 msgr2=0x7f2e780b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/1470398111 shutdown_connections 2024-09-19T05:33:50.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.265+0000 7f2e7ce3a640 1 -- 172.21.15.67:0/1470398111 wait complete. 2024-09-19T05:33:50.292 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:33:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa930df6640 1 Processor -- start 2024-09-19T05:33:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa930df6640 1 -- start start 2024-09-19T05:33:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa930df6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa92c15f950 0x7fa92c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa930df6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa92c0b3750 0x7fa92c0d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa930df6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa92c0d0c10 0x7fa92c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa930df6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa92c0d1080 con 0x7fa92c0b3750 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa930df6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa92c0af1a0 con 0x7fa92c0d0c10 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa930df6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa92c0ce110 con 0x7fa92c15f950 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa929d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa92c0b3750 0x7fa92c0d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa929d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa92c0b3750 0x7fa92c0d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58790/0 (socket says 172.21.15.67:58790) 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa929d9b640 1 -- 172.21.15.67:0/3307533587 learned_addr learned my addr 172.21.15.67:0/3307533587 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa92ad9d640 1 --2- 172.21.15.67:0/3307533587 >> v2:172.21.15.97:3300/0 conn(0x7fa92c0d0c10 0x7fa92c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa92a59c640 1 --2- 172.21.15.67:0/3307533587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa92c15f950 0x7fa92c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa929d9b640 1 -- 172.21.15.67:0/3307533587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa92c15f950 msgr2=0x7fa92c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa929d9b640 1 --2- 172.21.15.67:0/3307533587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa92c15f950 0x7fa92c0ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa929d9b640 1 -- 172.21.15.67:0/3307533587 >> v2:172.21.15.97:3300/0 conn(0x7fa92c0d0c10 msgr2=0x7fa92c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa929d9b640 1 --2- 172.21.15.67:0/3307533587 >> v2:172.21.15.97:3300/0 conn(0x7fa92c0d0c10 0x7fa92c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa929d9b640 1 -- 172.21.15.67:0/3307533587 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92c0cea90 con 0x7fa92c0b3750 2024-09-19T05:33:50.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.413+0000 7fa92ad9d640 1 --2- 172.21.15.67:0/3307533587 >> v2:172.21.15.97:3300/0 conn(0x7fa92c0d0c10 0x7fa92c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:50.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa929d9b640 1 --2- 172.21.15.67:0/3307533587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 0x7fa92c0d06d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0a04d0 tx=0x7fa92001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82f1e265a103b57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:50.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92959a640 1 -- 172.21.15.67:0/3307533587 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9200b0070 con 0x7fa92c0b3750 2024-09-19T05:33:50.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92959a640 1 -- 172.21.15.67:0/3307533587 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9200ab600 con 0x7fa92c0b3750 2024-09-19T05:33:50.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92959a640 1 -- 172.21.15.67:0/3307533587 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9200ab9d0 con 0x7fa92c0b3750 2024-09-19T05:33:50.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 -- 172.21.15.67:0/3307533587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 msgr2=0x7fa92c0d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:50.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 --2- 172.21.15.67:0/3307533587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 0x7fa92c0d06d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0a04d0 tx=0x7fa92001c230 comp rx=0 tx=0).stop 2024-09-19T05:33:50.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 -- 172.21.15.67:0/3307533587 shutdown_connections 2024-09-19T05:33:50.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 --2- 172.21.15.67:0/3307533587 >> v2:172.21.15.97:3300/0 conn(0x7fa92c0d0c10 0x7fa92c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 --2- 172.21.15.67:0/3307533587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 0x7fa92c0d06d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 --2- 172.21.15.67:0/3307533587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa92c15f950 0x7fa92c0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 -- 172.21.15.67:0/3307533587 >> 172.21.15.67:0/3307533587 conn(0x7fa92c0d22f0 msgr2=0x7fa92c0d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 -- 172.21.15.67:0/3307533587 shutdown_connections 2024-09-19T05:33:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 -- 172.21.15.67:0/3307533587 wait complete. 2024-09-19T05:33:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 Processor -- start 2024-09-19T05:33:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 -- start start 2024-09-19T05:33:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 0x7fa92c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa92c0d0c10 0x7fa92c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa92c15f950 0x7fa92c156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c15fd30 con 0x7fa92c0b3750 2024-09-19T05:33:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c09bc40 con 0x7fa92c15f950 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa930df6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa92c15feb0 con 0x7fa92c0d0c10 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 0x7fa92c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 0x7fa92c15ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58806/0 (socket says 172.21.15.67:58806) 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92a59c640 1 -- 172.21.15.67:0/1403611807 learned_addr learned my addr 172.21.15.67:0/1403611807 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa929d9b640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa92c0d0c10 0x7fa92c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92a59c640 1 -- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa92c0d0c10 msgr2=0x7fa92c15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92ad9d640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa92c15f950 0x7fa92c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92a59c640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa92c0d0c10 0x7fa92c15ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92a59c640 1 -- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa92c15f950 msgr2=0x7fa92c156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92a59c640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa92c15f950 0x7fa92c156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92a59c640 1 -- 172.21.15.67:0/1403611807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92c159d90 con 0x7fa92c0b3750 2024-09-19T05:33:50.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.417+0000 7fa92a59c640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 0x7fa92c15ed20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00c7f0 tx=0x7fa91c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:50.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa91affd640 1 -- 172.21.15.67:0/1403611807 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c015070 con 0x7fa92c0b3750 2024-09-19T05:33:50.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa91affd640 1 -- 172.21.15.67:0/1403611807 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91c004240 con 0x7fa92c0b3750 2024-09-19T05:33:50.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa930df6640 1 -- 172.21.15.67:0/1403611807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa92c15a070 con 0x7fa92c0b3750 2024-09-19T05:33:50.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa91affd640 1 -- 172.21.15.67:0/1403611807 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c003620 con 0x7fa92c0b3750 2024-09-19T05:33:50.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa930df6640 1 -- 172.21.15.67:0/1403611807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa92c15a630 con 0x7fa92c0b3750 2024-09-19T05:33:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa930df6640 1 -- 172.21.15.67:0/1403611807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa92c09aa30 con 0x7fa92c0b3750 2024-09-19T05:33:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa91affd640 1 -- 172.21.15.67:0/1403611807 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa91c0037c0 con 0x7fa92c0b3750 2024-09-19T05:33:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa91affd640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa90c0678f0 0x7fa90c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa91affd640 1 -- 172.21.15.67:0/1403611807 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa91c085e20 con 0x7fa92c0b3750 2024-09-19T05:33:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa929d9b640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa90c0678f0 0x7fa90c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.421+0000 7fa929d9b640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa90c0678f0 0x7fa90c069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9200ad000 tx=0x7fa920008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.425+0000 7fa91affd640 1 -- 172.21.15.67:0/1403611807 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa91c056620 con 0x7fa92c0b3750 2024-09-19T05:33:50.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.589+0000 7fa930df6640 1 -- 172.21.15.67:0/1403611807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa92c0b1310 con 0x7fa92c0b3750 2024-09-19T05:33:50.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.593+0000 7fa91affd640 1 -- 172.21.15.67:0/1403611807 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fa91c055f20 con 0x7fa92c0b3750 2024-09-19T05:33:50.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 -- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa90c0678f0 msgr2=0x7fa90c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:50.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa90c0678f0 0x7fa90c069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9200ad000 tx=0x7fa920008040 comp rx=0 tx=0).stop 2024-09-19T05:33:50.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 -- 172.21.15.67:0/1403611807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 msgr2=0x7fa92c15ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:50.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 0x7fa92c15ed20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00c7f0 tx=0x7fa91c00ccb0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 -- 172.21.15.67:0/1403611807 shutdown_connections 2024-09-19T05:33:50.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa92c15f950 0x7fa92c156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa90c0678f0 0x7fa90c069db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa92c0d0c10 0x7fa92c15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 --2- 172.21.15.67:0/1403611807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c0b3750 0x7fa92c15ed20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:50.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 -- 172.21.15.67:0/1403611807 >> 172.21.15.67:0/1403611807 conn(0x7fa92c0d22f0 msgr2=0x7fa92c074650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:50.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 -- 172.21.15.67:0/1403611807 shutdown_connections 2024-09-19T05:33:50.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.597+0000 7fa930df6640 1 -- 172.21.15.67:0/1403611807 wait complete. 2024-09-19T05:33:50.618 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:33:50.619 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:33:50.689 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:33:50.774 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:33:50.774 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:33:50.774 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:50.780 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:33:50.780 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:50.828 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:33:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b1da7f640 1 Processor -- start 2024-09-19T05:33:50.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b1da7f640 1 -- start start 2024-09-19T05:33:50.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b1da7f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b1815b1e0 0x7f1b180b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:50.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b1da7f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b180b4900 0x7f1b18071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:50.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b1da7f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b180723c0 0x7f1b18072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:50.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b1da7f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1815b5c0 con 0x7f1b180723c0 2024-09-19T05:33:50.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b1da7f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1b180b3860 con 0x7f1b1815b1e0 2024-09-19T05:33:50.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b1da7f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b180b3b40 con 0x7f1b180b4900 2024-09-19T05:33:51.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b17fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b180723c0 0x7f1b18072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b17fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b180723c0 0x7f1b18072850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58808/0 (socket says 172.21.15.67:58808) 2024-09-19T05:33:51.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b17fff640 1 -- 172.21.15.67:0/2266889652 learned_addr learned my addr 172.21.15.67:0/2266889652 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:51.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b0effd640 1 --2- 172.21.15.67:0/2266889652 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b180b4900 0x7f1b18071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b177fe640 1 --2- 172.21.15.67:0/2266889652 >> v2:172.21.15.97:3300/0 conn(0x7f1b1815b1e0 0x7f1b180b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b17fff640 1 -- 172.21.15.67:0/2266889652 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b180b4900 msgr2=0x7f1b18071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:51.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b17fff640 1 --2- 172.21.15.67:0/2266889652 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b180b4900 0x7f1b18071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b17fff640 1 -- 172.21.15.67:0/2266889652 >> v2:172.21.15.97:3300/0 conn(0x7f1b1815b1e0 msgr2=0x7f1b180b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:51.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b17fff640 1 --2- 172.21.15.67:0/2266889652 >> v2:172.21.15.97:3300/0 conn(0x7f1b1815b1e0 0x7f1b180b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.993+0000 7f1b17fff640 1 -- 172.21.15.67:0/2266889652 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b180b3e20 con 0x7f1b180723c0 2024-09-19T05:33:51.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b17fff640 1 --2- 172.21.15.67:0/2266889652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b180723c0 0x7f1b18072850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b1815fde0 tx=0x7f1b1001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa73e31312b51886 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:51.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b16ffd640 1 -- 172.21.15.67:0/2266889652 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100a7a80 con 0x7f1b180723c0 2024-09-19T05:33:51.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b16ffd640 1 -- 172.21.15.67:0/2266889652 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b100a7c20 con 0x7f1b180723c0 2024-09-19T05:33:51.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b16ffd640 1 -- 172.21.15.67:0/2266889652 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100af3f0 con 0x7f1b180723c0 2024-09-19T05:33:51.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2266889652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b180723c0 msgr2=0x7f1b18072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b1da7f640 1 --2- 172.21.15.67:0/2266889652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b180723c0 0x7f1b18072850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b1815fde0 tx=0x7f1b1001ebd0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2266889652 shutdown_connections 2024-09-19T05:33:51.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b1da7f640 1 --2- 172.21.15.67:0/2266889652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b180723c0 0x7f1b18072850 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b1da7f640 1 --2- 172.21.15.67:0/2266889652 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b180b4900 0x7f1b18071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b1da7f640 1 --2- 172.21.15.67:0/2266889652 >> v2:172.21.15.97:3300/0 conn(0x7f1b1815b1e0 0x7f1b180b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2266889652 >> 172.21.15.67:0/2266889652 conn(0x7f1b180d0080 msgr2=0x7f1b180d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2266889652 shutdown_connections 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2266889652 wait complete. 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:50.997+0000 7f1b1da7f640 1 Processor -- start 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b1da7f640 1 -- start start 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b1da7f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b180723c0 0x7f1b1814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b1da7f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b180b4900 0x7f1b18151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b1da7f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1815b1e0 0x7f1b18157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b1da7f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1815f650 con 0x7f1b1815b1e0 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b1da7f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1815f4d0 con 0x7f1b180723c0 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b1da7f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1815f7d0 con 0x7f1b180b4900 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b17fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1815b1e0 0x7f1b18157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b17fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1815b1e0 0x7f1b18157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58814/0 (socket says 172.21.15.67:58814) 2024-09-19T05:33:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b17fff640 1 -- 172.21.15.67:0/2795105103 learned_addr learned my addr 172.21.15.67:0/2795105103 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b177fe640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b180723c0 0x7f1b1814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b17fff640 1 -- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b180b4900 msgr2=0x7f1b18151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b17fff640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b180b4900 0x7f1b18151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b17fff640 1 -- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b180723c0 msgr2=0x7f1b1814fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b17fff640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b180723c0 0x7f1b1814fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b17fff640 1 -- 172.21.15.67:0/2795105103 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b18150460 con 0x7f1b1815b1e0 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b177fe640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b180723c0 0x7f1b1814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b17fff640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1815b1e0 0x7f1b18157350 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1b100b1040 tx=0x7f1b1001b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b14ff9640 1 -- 172.21.15.67:0/2795105103 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100be020 con 0x7f1b1815b1e0 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b14ff9640 1 -- 172.21.15.67:0/2795105103 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b100ba470 con 0x7f1b1815b1e0 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b14ff9640 1 -- 172.21.15.67:0/2795105103 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100a7a80 con 0x7f1b1815b1e0 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2795105103 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b18150740 con 0x7f1b1815b1e0 2024-09-19T05:33:51.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2795105103 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b18150d00 con 0x7f1b1815b1e0 2024-09-19T05:33:51.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2795105103 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b18071e80 con 0x7f1b1815b1e0 2024-09-19T05:33:51.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b14ff9640 1 -- 172.21.15.67:0/2795105103 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b100c1020 con 0x7f1b1815b1e0 2024-09-19T05:33:51.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.001+0000 7f1b14ff9640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1af80678c0 0x7f1af8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.005+0000 7f1b14ff9640 1 -- 172.21.15.67:0/2795105103 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1b101237f0 con 0x7f1b1815b1e0 2024-09-19T05:33:51.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.005+0000 7f1b177fe640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1af80678c0 0x7f1af8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.005+0000 7f1b177fe640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1af80678c0 0x7f1af8069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b180b3440 tx=0x7f1b08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:51.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.005+0000 7f1b14ff9640 1 -- 172.21.15.67:0/2795105103 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1b100c8030 con 0x7f1b1815b1e0 2024-09-19T05:33:51.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2795105103 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1b18141000 con 0x7f1b1815b1e0 2024-09-19T05:33:51.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b14ff9640 1 -- 172.21.15.67:0/2795105103 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f1b100187f0 con 0x7f1b1815b1e0 2024-09-19T05:33:51.180 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:33:51.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1af80678c0 msgr2=0x7f1af8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1af80678c0 0x7f1af8069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b180b3440 tx=0x7f1b08008040 comp rx=0 tx=0).stop 2024-09-19T05:33:51.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2795105103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1815b1e0 msgr2=0x7f1b18157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1815b1e0 0x7f1b18157350 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1b100b1040 tx=0x7f1b1001b970 comp rx=0 tx=0).stop 2024-09-19T05:33:51.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2795105103 shutdown_connections 2024-09-19T05:33:51.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1815b1e0 0x7f1b18157350 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1af80678c0 0x7f1af8069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b180b4900 0x7f1b18151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 --2- 172.21.15.67:0/2795105103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b180723c0 0x7f1b1814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2795105103 >> 172.21.15.67:0/2795105103 conn(0x7f1b180d0080 msgr2=0x7f1b18073010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:51.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2795105103 shutdown_connections 2024-09-19T05:33:51.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.177+0000 7f1b1da7f640 1 -- 172.21.15.67:0/2795105103 wait complete. 2024-09-19T05:33:51.199 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:33:51.199 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:51.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:33:51.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.365+0000 7fe8c5f5e640 1 Processor -- start 2024-09-19T05:33:51.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.365+0000 7fe8c5f5e640 1 -- start start 2024-09-19T05:33:51.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.365+0000 7fe8c5f5e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe8c015c200 0x7fe8c0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.365+0000 7fe8c5f5e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe8c00aef40 0x7fe8c00af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.365+0000 7fe8c5f5e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c00b3070 con 0x7fe8c015b710 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.365+0000 7fe8c5f5e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c00b32e0 con 0x7fe8c015c200 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.365+0000 7fe8c5f5e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c00b35c0 con 0x7fe8c00aef40 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8beffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe8c015c200 0x7fe8c0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8beffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe8c015c200 0x7fe8c0071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58828/0 (socket says 172.21.15.67:58828) 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8beffd640 1 -- 172.21.15.67:0/3387897519 learned_addr learned my addr 172.21.15.67:0/3387897519 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8bffff640 1 --2- 172.21.15.67:0/3387897519 >> v2:172.21.15.97:3300/0 conn(0x7fe8c00aef40 0x7fe8c00af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8beffd640 1 -- 172.21.15.67:0/3387897519 >> v2:172.21.15.97:3300/0 conn(0x7fe8c00aef40 msgr2=0x7fe8c00af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8beffd640 1 --2- 172.21.15.67:0/3387897519 >> v2:172.21.15.97:3300/0 conn(0x7fe8c00aef40 0x7fe8c00af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8beffd640 1 -- 172.21.15.67:0/3387897519 >> v1:172.21.15.97:6789/0 conn(0x7fe8c015b710 legacy=0x7fe8c015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8beffd640 1 -- 172.21.15.67:0/3387897519 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c00b38a0 con 0x7fe8c015c200 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8beffd640 1 --2- 172.21.15.67:0/3387897519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 0x7fe8c0071e80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0074470 tx=0x7fe8b401ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599e42c863ed49fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8be7fc640 1 -- 172.21.15.67:0/3387897519 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40b4070 con 0x7fe8c015c200 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8be7fc640 1 -- 172.21.15.67:0/3387897519 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b40a7cb0 con 0x7fe8c015c200 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8be7fc640 1 -- 172.21.15.67:0/3387897519 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40a7e60 con 0x7fe8c015c200 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3387897519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 msgr2=0x7fe8c0071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8c5f5e640 1 --2- 172.21.15.67:0/3387897519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 0x7fe8c0071e80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0074470 tx=0x7fe8b401ebc0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3387897519 shutdown_connections 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8c5f5e640 1 --2- 172.21.15.67:0/3387897519 >> v2:172.21.15.97:3300/0 conn(0x7fe8c00aef40 0x7fe8c00af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8c5f5e640 1 --2- 172.21.15.67:0/3387897519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 0x7fe8c0071e80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3387897519 >> 172.21.15.67:0/3387897519 conn(0x7fe8c00d0080 msgr2=0x7fe8c00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3387897519 shutdown_connections 2024-09-19T05:33:51.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.369+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3387897519 wait complete. 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 Processor -- start 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 -- start start 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8c00aef40 0x7fe8c0099240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8c015b710 0x7fe8c006eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 0x7fe8c006f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c00b4c40 con 0x7fe8c015c200 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c00b4ac0 con 0x7fe8c00aef40 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c00b4dc0 con 0x7fe8c015b710 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8bffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 0x7fe8c006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8bffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 0x7fe8c006f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58830/0 (socket says 172.21.15.67:58830) 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8bffff640 1 -- 172.21.15.67:0/3233036008 learned_addr learned my addr 172.21.15.67:0/3233036008 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8beffd640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8c015b710 0x7fe8c006eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8bf7fe640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8c00aef40 0x7fe8c0099240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8bffff640 1 -- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8c015b710 msgr2=0x7fe8c006eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8bffff640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8c015b710 0x7fe8c006eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8bffff640 1 -- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8c00aef40 msgr2=0x7fe8c0099240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8bffff640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8c00aef40 0x7fe8c0099240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8bffff640 1 -- 172.21.15.67:0/3233036008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c014d4a0 con 0x7fe8c015c200 2024-09-19T05:33:51.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8bffff640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 0x7fe8c006f050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8007e40 tx=0x7fe8b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8a7fff640 1 -- 172.21.15.67:0/3233036008 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8014620 con 0x7fe8c015c200 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8a7fff640 1 -- 172.21.15.67:0/3233036008 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b8019070 con 0x7fe8c015c200 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8a7fff640 1 -- 172.21.15.67:0/3233036008 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8014a20 con 0x7fe8c015c200 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3233036008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c015caa0 con 0x7fe8c015c200 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3233036008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c015d060 con 0x7fe8c015c200 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.373+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3233036008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c00af360 con 0x7fe8c015c200 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.377+0000 7fe8a7fff640 1 -- 172.21.15.67:0/3233036008 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8b8014bc0 con 0x7fe8c015c200 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.377+0000 7fe8a7fff640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8ac0678c0 0x7fe8ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.377+0000 7fe8a7fff640 1 -- 172.21.15.67:0/3233036008 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe8b80868e0 con 0x7fe8c015c200 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.377+0000 7fe8bf7fe640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8ac0678c0 0x7fe8ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.377+0000 7fe8bf7fe640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8ac0678c0 0x7fe8ac069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0000f70 tx=0x7fe8b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.381+0000 7fe8a7fff640 1 -- 172.21.15.67:0/3233036008 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe8b80570e0 con 0x7fe8c015c200 2024-09-19T05:33:51.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3233036008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe8c0073220 con 0x7fe8c015c200 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8a7fff640 1 -- 172.21.15.67:0/3233036008 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fe8b80569e0 con 0x7fe8c015c200 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8ac0678c0 msgr2=0x7fe8ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8ac0678c0 0x7fe8ac069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0000f70 tx=0x7fe8b0009040 comp rx=0 tx=0).stop 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3233036008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 msgr2=0x7fe8c006f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 0x7fe8c006f050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8007e40 tx=0x7fe8b800e4b0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3233036008 shutdown_connections 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8c015c200 0x7fe8c006f050 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8ac0678c0 0x7fe8ac069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8c015b710 0x7fe8c006eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 --2- 172.21.15.67:0/3233036008 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8c00aef40 0x7fe8c0099240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3233036008 >> 172.21.15.67:0/3233036008 conn(0x7fe8c00d0080 msgr2=0x7fe8c00b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3233036008 shutdown_connections 2024-09-19T05:33:51.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.557+0000 7fe8c5f5e640 1 -- 172.21.15.67:0/3233036008 wait complete. 2024-09-19T05:33:51.580 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:33:51.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:51.581 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:33:51.592 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:33:51.593 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:33:51.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:51.593 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:33:51.641 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:33:51.641 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:51.648 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:33:51.648 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:51.698 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:33:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.817+0000 7f66a6060640 1 Processor -- start 2024-09-19T05:33:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.817+0000 7f66a6060640 1 -- start start 2024-09-19T05:33:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f66a6060640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66a015b1e0 0x7f66a00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f66a6060640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a00b3860 con 0x7f66a0072590 2024-09-19T05:33:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f66a6060640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a00b3b40 con 0x7f66a00b4900 2024-09-19T05:33:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f66a6060640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f66a015b5c0 con 0x7f66a015b1e0 2024-09-19T05:33:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f66a0072590 0x7f66a00ade10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48202/0 (socket says 172.21.15.67:48202) 2024-09-19T05:33:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669ffff640 1 -- 172.21.15.67:0/1809119427 learned_addr learned my addr 172.21.15.67:0/1809119427 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669f7fe640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66a015b1e0 0x7f66a00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136481153 0 0) 0x7f66a00b3860 con 0x7f66a0072590 2024-09-19T05:33:51.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f668c005740 con 0x7f66a0072590 2024-09-19T05:33:51.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889838368 0 0) 0x7f66a00b3b40 con 0x7f66a00b4900 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66a00b3860 con 0x7f66a00b4900 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 773901862 0 0) 0x7f668c005740 con 0x7f66a0072590 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66a015b1e0 msgr2=0x7f66a00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66a015b1e0 0x7f66a00b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 >> v1:172.21.15.97:6789/0 conn(0x7f66a00b4900 legacy=0x7f66a0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a00b3e20 con 0x7f66a0072590 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6690001680 con 0x7f66a0072590 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 >> v1:172.21.15.67:6789/0 conn(0x7f66a0072590 legacy=0x7f66a00ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66a015b1e0 0x7f668c005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f668c0062f0 0x7f668c006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f668c006f60 0x7f668c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66a015b5c0 con 0x7f668c0062f0 2024-09-19T05:33:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f668c00dcc0 con 0x7f668c006f60 2024-09-19T05:33:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f668c00dec0 con 0x7f66a015b1e0 2024-09-19T05:33:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669effd640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f668c0062f0 0x7f668c006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669f7fe640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66a015b1e0 0x7f668c005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669ffff640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f668c006f60 0x7f668c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669effd640 1 -- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66a015b1e0 msgr2=0x7f668c005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669effd640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66a015b1e0 0x7f668c005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669effd640 1 -- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f668c006f60 msgr2=0x7f668c0073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669effd640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f668c006f60 0x7f668c0073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.821+0000 7f669effd640 1 -- 172.21.15.67:0/1809119427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668c005740 con 0x7f668c0062f0 2024-09-19T05:33:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669effd640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f668c0062f0 0x7f668c006a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f66a00b2d60 tx=0x7f668801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce19bc3abec5bc4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688001520 con 0x7f668c0062f0 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66880052f0 con 0x7f668c0062f0 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669e7fc640 1 -- 172.21.15.67:0/1809119427 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880a8930 con 0x7f668c0062f0 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- 172.21.15.67:0/1809119427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f668c0062f0 msgr2=0x7f668c006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 --2- 172.21.15.67:0/1809119427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f668c0062f0 0x7f668c006a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f66a00b2d60 tx=0x7f668801ecd0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669ffff640 1 -- 172.21.15.67:0/1809119427 reap_dead start 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- 172.21.15.67:0/1809119427 shutdown_connections 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- 172.21.15.67:0/1809119427 >> 172.21.15.67:0/1809119427 conn(0x7f66a00d0080 msgr2=0x7f66a00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- 172.21.15.67:0/1809119427 shutdown_connections 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- 172.21.15.67:0/1809119427 wait complete. 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 Processor -- start 2024-09-19T05:33:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- start start 2024-09-19T05:33:51.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f668c0062f0 0x7f66a014a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a014b0f0 0x7f66a014be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66a014b620 0x7f66a014c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66a0072a40 con 0x7f66a014b0f0 2024-09-19T05:33:51.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f66a00b43e0 con 0x7f66a014b620 2024-09-19T05:33:51.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f66a0072bc0 con 0x7f668c0062f0 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a014b0f0 0x7f66a014be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a014b0f0 0x7f66a014be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58854/0 (socket says 172.21.15.67:58854) 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669effd640 1 -- 172.21.15.67:0/415643450 learned_addr learned my addr 172.21.15.67:0/415643450 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669ffff640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66a014b620 0x7f66a014c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669f7fe640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f668c0062f0 0x7f66a014a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669effd640 1 -- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f668c0062f0 msgr2=0x7f66a014a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669effd640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f668c0062f0 0x7f66a014a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669effd640 1 -- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66a014b620 msgr2=0x7f66a014c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669effd640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66a014b620 0x7f66a014c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669effd640 1 -- 172.21.15.67:0/415643450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a0153410 con 0x7f66a014b0f0 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f669effd640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a014b0f0 0x7f66a014be60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6688005040 tx=0x7f668c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f6697fff640 1 -- 172.21.15.67:0/415643450 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880bd020 con 0x7f66a014b0f0 2024-09-19T05:33:51.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f6697fff640 1 -- 172.21.15.67:0/415643450 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66880054a0 con 0x7f66a014b0f0 2024-09-19T05:33:51.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- 172.21.15.67:0/415643450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a01536f0 con 0x7f66a014b0f0 2024-09-19T05:33:51.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f6697fff640 1 -- 172.21.15.67:0/415643450 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688001500 con 0x7f66a014b0f0 2024-09-19T05:33:51.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.825+0000 7f66a6060640 1 -- 172.21.15.67:0/415643450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a0153cb0 con 0x7f66a014b0f0 2024-09-19T05:33:51.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.829+0000 7f66a6060640 1 -- 172.21.15.67:0/415643450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a0071e80 con 0x7f66a014b0f0 2024-09-19T05:33:51.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.829+0000 7f6697fff640 1 -- 172.21.15.67:0/415643450 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66880c0020 con 0x7f66a014b0f0 2024-09-19T05:33:51.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.829+0000 7f6697fff640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66800678c0 0x7f6680069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:51.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.829+0000 7f6697fff640 1 -- 172.21.15.67:0/415643450 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6688123160 con 0x7f66a014b0f0 2024-09-19T05:33:51.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.829+0000 7f669f7fe640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66800678c0 0x7f6680069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:51.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.829+0000 7f669f7fe640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66800678c0 0x7f6680069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f66980133c0 tx=0x7f669800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:51.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:51.833+0000 7f6697fff640 1 -- 172.21.15.67:0/415643450 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f66880c7030 con 0x7f66a014b0f0 2024-09-19T05:33:52.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 -- 172.21.15.67:0/415643450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f66a00b4e30 con 0x7f66a014b0f0 2024-09-19T05:33:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f6697fff640 1 -- 172.21.15.67:0/415643450 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f66880189e0 con 0x7f66a014b0f0 2024-09-19T05:33:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:33:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 -- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66800678c0 msgr2=0x7f6680069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66800678c0 0x7f6680069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f66980133c0 tx=0x7f669800b040 comp rx=0 tx=0).stop 2024-09-19T05:33:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 -- 172.21.15.67:0/415643450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a014b0f0 msgr2=0x7f66a014be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a014b0f0 0x7f66a014be60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6688005040 tx=0x7f668c007a50 comp rx=0 tx=0).stop 2024-09-19T05:33:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 -- 172.21.15.67:0/415643450 shutdown_connections 2024-09-19T05:33:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66a014b620 0x7f66a014c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a014b0f0 0x7f66a014be60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66800678c0 0x7f6680069d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 --2- 172.21.15.67:0/415643450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f668c0062f0 0x7f66a014a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 -- 172.21.15.67:0/415643450 >> 172.21.15.67:0/415643450 conn(0x7f66a00d0080 msgr2=0x7f66a0072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 -- 172.21.15.67:0/415643450 shutdown_connections 2024-09-19T05:33:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.001+0000 7f66a6060640 1 -- 172.21.15.67:0/415643450 wait complete. 2024-09-19T05:33:52.023 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:33:52.023 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:52.030 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:33:52.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f090b721640 1 Processor -- start 2024-09-19T05:33:52.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f090b721640 1 -- start start 2024-09-19T05:33:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f090b721640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f09040b4900 0x7f0904071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f090b721640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09040723c0 0x7f0904072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f090b721640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09040b3860 con 0x7f090415b1e0 2024-09-19T05:33:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f090b721640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f090415b5c0 con 0x7f09040b4900 2024-09-19T05:33:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f090b721640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f09040b3b40 con 0x7f09040723c0 2024-09-19T05:33:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f09094bd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f090415b1e0 0x7f09040b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48206/0 (socket says 172.21.15.67:48206) 2024-09-19T05:33:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f09094bd640 1 -- 172.21.15.67:0/763813598 learned_addr learned my addr 172.21.15.67:0/763813598 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f0908cbc640 1 --2- 172.21.15.67:0/763813598 >> v2:172.21.15.97:3300/0 conn(0x7f09040b4900 0x7f0904071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f0909cbe640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09040723c0 0x7f0904072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291271447 0 0) 0x7f09040b3860 con 0x7f090415b1e0 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08f0003530 con 0x7f090415b1e0 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3689350734 0 0) 0x7f08f0003530 con 0x7f090415b1e0 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09040723c0 msgr2=0x7f0904072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09040723c0 0x7f0904072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 >> v2:172.21.15.97:3300/0 conn(0x7f09040b4900 msgr2=0x7f0904071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 --2- 172.21.15.67:0/763813598 >> v2:172.21.15.97:3300/0 conn(0x7f09040b4900 0x7f0904071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09040b3e20 con 0x7f090415b1e0 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f0900001680 con 0x7f090415b1e0 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 >> v1:172.21.15.67:6789/0 conn(0x7f090415b1e0 legacy=0x7f09040b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f00039c0 0x7f08f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08f0004810 0x7f08f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09040723c0 0x7f08f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f090415b5c0 con 0x7f08f00039c0 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f09040b3b40 con 0x7f08f0004810 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f08f000b9d0 con 0x7f09040723c0 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f09094bd640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f00039c0 0x7f08f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f0908cbc640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08f0004810 0x7f08f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f0909cbe640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09040723c0 0x7f08f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f09094bd640 1 -- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09040723c0 msgr2=0x7f08f00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f09094bd640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09040723c0 0x7f08f00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f09094bd640 1 -- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08f0004810 msgr2=0x7f08f0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f09094bd640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08f0004810 0x7f08f0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f09094bd640 1 -- 172.21.15.67:0/763813598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f0003530 con 0x7f08f00039c0 2024-09-19T05:33:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.149+0000 7f0908cbc640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08f0004810 0x7f08f0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:52.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f09094bd640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f00039c0 0x7f08f0003de0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f090000c210 tx=0x7f090001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fafbd9c16dbf86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:52.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900007d60 con 0x7f08f00039c0 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09000a9020 con 0x7f08f00039c0 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f08fbfff640 1 -- 172.21.15.67:0/763813598 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900005b20 con 0x7f08f00039c0 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f090b721640 1 -- 172.21.15.67:0/763813598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f00039c0 msgr2=0x7f08f0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f090b721640 1 --2- 172.21.15.67:0/763813598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f00039c0 0x7f08f0003de0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f090000c210 tx=0x7f090001cc70 comp rx=0 tx=0).stop 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f0909cbe640 1 -- 172.21.15.67:0/763813598 reap_dead start 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f090b721640 1 -- 172.21.15.67:0/763813598 shutdown_connections 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f090b721640 1 -- 172.21.15.67:0/763813598 >> 172.21.15.67:0/763813598 conn(0x7f09040d0080 msgr2=0x7f09040d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f090b721640 1 -- 172.21.15.67:0/763813598 shutdown_connections 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.153+0000 7f090b721640 1 -- 172.21.15.67:0/763813598 wait complete. 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 Processor -- start 2024-09-19T05:33:52.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 -- start start 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0904146800 0x7f0904150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0904146f80 0x7f0904147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0904147940 0x7f0904166050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f09040ae7a0 con 0x7f0904146800 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f09040ae620 con 0x7f0904147940 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f09040ae920 con 0x7f0904146f80 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f09094bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0904146800 0x7f0904150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f09094bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0904146800 0x7f0904150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58870/0 (socket says 172.21.15.67:58870) 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f09094bd640 1 -- 172.21.15.67:0/1030057185 learned_addr learned my addr 172.21.15.67:0/1030057185 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f0908cbc640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0904146f80 0x7f0904147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f09094bd640 1 -- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0904146f80 msgr2=0x7f0904147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f09094bd640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0904146f80 0x7f0904147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f09094bd640 1 -- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0904147940 msgr2=0x7f0904166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f09094bd640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0904147940 0x7f0904166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f09094bd640 1 -- 172.21.15.67:0/1030057185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090415c510 con 0x7f0904146800 2024-09-19T05:33:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f0908cbc640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0904146f80 0x7f0904147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f09094bd640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0904146800 0x7f0904150590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f090001caa0 tx=0x7f08f0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f08f9ffb640 1 -- 172.21.15.67:0/1030057185 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900004b70 con 0x7f0904146800 2024-09-19T05:33:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f08f9ffb640 1 -- 172.21.15.67:0/1030057185 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0900004d10 con 0x7f0904146800 2024-09-19T05:33:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 -- 172.21.15.67:0/1030057185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0904147fe0 con 0x7f0904146800 2024-09-19T05:33:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f08f9ffb640 1 -- 172.21.15.67:0/1030057185 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09000a59b0 con 0x7f0904146800 2024-09-19T05:33:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 -- 172.21.15.67:0/1030057185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09041485a0 con 0x7f0904146800 2024-09-19T05:33:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f090b721640 1 -- 172.21.15.67:0/1030057185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0904147d60 con 0x7f0904146800 2024-09-19T05:33:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f08f9ffb640 1 -- 172.21.15.67:0/1030057185 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09000bd060 con 0x7f0904146800 2024-09-19T05:33:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.157+0000 7f08f9ffb640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08e80678f0 0x7f08e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.161+0000 7f08f9ffb640 1 -- 172.21.15.67:0/1030057185 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f090011ec20 con 0x7f0904146800 2024-09-19T05:33:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.161+0000 7f0908cbc640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08e80678f0 0x7f08e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.161+0000 7f0908cbc640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08e80678f0 0x7f08e8069db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f090414fc30 tx=0x7f08f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:52.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.165+0000 7f08f9ffb640 1 -- 172.21.15.67:0/1030057185 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0904147d60 con 0x7f0904146800 2024-09-19T05:33:52.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.337+0000 7f090b721640 1 -- 172.21.15.67:0/1030057185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f09040b4e30 con 0x7f0904146800 2024-09-19T05:33:52.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.337+0000 7f08f9ffb640 1 -- 172.21.15.67:0/1030057185 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f09000169b0 con 0x7f0904146800 2024-09-19T05:33:52.343 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:33:52.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 -- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08e80678f0 msgr2=0x7f08e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08e80678f0 0x7f08e8069db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f090414fc30 tx=0x7f08f4008040 comp rx=0 tx=0).stop 2024-09-19T05:33:52.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 -- 172.21.15.67:0/1030057185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0904146800 msgr2=0x7f0904150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0904146800 0x7f0904150590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f090001caa0 tx=0x7f08f0005840 comp rx=0 tx=0).stop 2024-09-19T05:33:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 -- 172.21.15.67:0/1030057185 shutdown_connections 2024-09-19T05:33:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0904147940 0x7f0904166050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08e80678f0 0x7f08e8069db0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0904146f80 0x7f0904147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 --2- 172.21.15.67:0/1030057185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0904146800 0x7f0904150590 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 -- 172.21.15.67:0/1030057185 >> 172.21.15.67:0/1030057185 conn(0x7f09040d0080 msgr2=0x7f09040997f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 -- 172.21.15.67:0/1030057185 shutdown_connections 2024-09-19T05:33:52.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.341+0000 7f090b721640 1 -- 172.21.15.67:0/1030057185 wait complete. 2024-09-19T05:33:52.361 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi097.front.sepia.ceph.com... 2024-09-19T05:33:52.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:52.361 DEBUG:teuthology.orchestra.run.smithi097:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-19T05:33:52.476 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:33:52.477 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:33:52.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:52.477 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:33:52.490 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:33:52.491 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:52.497 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:33:52.497 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:52.545 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:33:52.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f7918640 1 Processor -- start 2024-09-19T05:33:52.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f7918640 1 -- start start 2024-09-19T05:33:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f7918640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f60f0161da0 0x7f60f00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f7918640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f00d05d0 con 0x7f60f00d0160 2024-09-19T05:33:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f7918640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f00d4d40 con 0x7f60f00d0e80 2024-09-19T05:33:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f7918640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f60f00d0840 con 0x7f60f0161da0 2024-09-19T05:33:52.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f56b4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f60f0161da0 0x7f60f00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f5eb5640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f60f00d0160 0x7f60f00b48d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48220/0 (socket says 172.21.15.67:48220) 2024-09-19T05:33:52.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f5eb5640 1 -- 172.21.15.67:0/999719713 learned_addr learned my addr 172.21.15.67:0/999719713 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:52.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60effff640 1 -- 172.21.15.67:0/999719713 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859995249 0 0) 0x7f60f00d05d0 con 0x7f60f00d0160 2024-09-19T05:33:52.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60effff640 1 -- 172.21.15.67:0/999719713 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60d8003530 con 0x7f60f00d0160 2024-09-19T05:33:52.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f56b4640 1 -- 172.21.15.67:0/999719713 >> v1:172.21.15.97:6789/0 conn(0x7f60f00d0e80 legacy=0x7f60f00b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:52.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f56b4640 1 -- 172.21.15.67:0/999719713 >> v1:172.21.15.67:6789/0 conn(0x7f60f00d0160 legacy=0x7f60f00b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.709+0000 7f60f56b4640 1 -- 172.21.15.67:0/999719713 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f00d5020 con 0x7f60f0161da0 2024-09-19T05:33:52.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60f56b4640 1 --2- 172.21.15.67:0/999719713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f0161da0 0x7f60f00d1af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009d90 tx=0x7f60e001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431851ea56f3b70f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:52.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60effff640 1 -- 172.21.15.67:0/999719713 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e00b2070 con 0x7f60f0161da0 2024-09-19T05:33:52.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60effff640 1 -- 172.21.15.67:0/999719713 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e00a5920 con 0x7f60f0161da0 2024-09-19T05:33:52.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60effff640 1 -- 172.21.15.67:0/999719713 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e00a5cd0 con 0x7f60f0161da0 2024-09-19T05:33:52.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60f7918640 1 -- 172.21.15.67:0/999719713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f0161da0 msgr2=0x7f60f00d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60f7918640 1 --2- 172.21.15.67:0/999719713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f0161da0 0x7f60f00d1af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009d90 tx=0x7f60e001c970 comp rx=0 tx=0).stop 2024-09-19T05:33:52.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60f7918640 1 -- 172.21.15.67:0/999719713 shutdown_connections 2024-09-19T05:33:52.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60f7918640 1 --2- 172.21.15.67:0/999719713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f0161da0 0x7f60f00d1af0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60f7918640 1 -- 172.21.15.67:0/999719713 >> 172.21.15.67:0/999719713 conn(0x7f60f008bfc0 msgr2=0x7f60f00d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:52.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60f7918640 1 -- 172.21.15.67:0/999719713 shutdown_connections 2024-09-19T05:33:52.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60f7918640 1 -- 172.21.15.67:0/999719713 wait complete. 2024-09-19T05:33:52.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60f7918640 1 Processor -- start 2024-09-19T05:33:52.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.713+0000 7f60f7918640 1 -- start start 2024-09-19T05:33:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f7918640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60f00d0160 0x7f60f0150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f7918640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f00d0e80 0x7f60f00c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f7918640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f0161da0 0x7f60f00c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f7918640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f60f0162180 con 0x7f60f00d0e80 2024-09-19T05:33:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f7918640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f60f00b53f0 con 0x7f60f0161da0 2024-09-19T05:33:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f7918640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f60f00d16a0 con 0x7f60f00d0160 2024-09-19T05:33:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f4eb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f00d0e80 0x7f60f00c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f4eb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f00d0e80 0x7f60f00c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58900/0 (socket says 172.21.15.67:58900) 2024-09-19T05:33:52.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f4eb3640 1 -- 172.21.15.67:0/671001060 learned_addr learned my addr 172.21.15.67:0/671001060 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:52.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f56b4640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60f00d0160 0x7f60f0150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f5eb5640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f0161da0 0x7f60f00c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f4eb3640 1 -- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60f00d0160 msgr2=0x7f60f0150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f4eb3640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60f00d0160 0x7f60f0150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f4eb3640 1 -- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f0161da0 msgr2=0x7f60f00c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f4eb3640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f0161da0 0x7f60f00c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f4eb3640 1 -- 172.21.15.67:0/671001060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f00b37b0 con 0x7f60f00d0e80 2024-09-19T05:33:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f5eb5640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f0161da0 0x7f60f00c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f4eb3640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f00d0e80 0x7f60f00c7fc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f60e400c420 tx=0x7f60e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60edffb640 1 -- 172.21.15.67:0/671001060 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40052d0 con 0x7f60f00d0e80 2024-09-19T05:33:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60edffb640 1 -- 172.21.15.67:0/671001060 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e4005470 con 0x7f60f00d0e80 2024-09-19T05:33:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f7918640 1 -- 172.21.15.67:0/671001060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f013c060 con 0x7f60f00d0e80 2024-09-19T05:33:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60edffb640 1 -- 172.21.15.67:0/671001060 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4007260 con 0x7f60f00d0e80 2024-09-19T05:33:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f7918640 1 -- 172.21.15.67:0/671001060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f013c620 con 0x7f60f00d0e80 2024-09-19T05:33:52.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f7918640 1 -- 172.21.15.67:0/671001060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f00d1af0 con 0x7f60f00d0e80 2024-09-19T05:33:52.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60edffb640 1 -- 172.21.15.67:0/671001060 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f60e4007400 con 0x7f60f00d0e80 2024-09-19T05:33:52.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60edffb640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f60dc0678c0 0x7f60dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:52.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60edffb640 1 -- 172.21.15.67:0/671001060 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f60e4085550 con 0x7f60f00d0e80 2024-09-19T05:33:52.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.717+0000 7f60f56b4640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f60dc0678c0 0x7f60dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:52.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.721+0000 7f60f56b4640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f60dc0678c0 0x7f60dc069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f60e00af000 tx=0x7f60e00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:52.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.721+0000 7f60edffb640 1 -- 172.21.15.67:0/671001060 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f60e4055d50 con 0x7f60f00d0e80 2024-09-19T05:33:52.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.897+0000 7f60f7918640 1 -- 172.21.15.67:0/671001060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f60f015fff0 con 0x7f60f00d0e80 2024-09-19T05:33:52.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.897+0000 7f60edffb640 1 -- 172.21.15.67:0/671001060 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f60e4055650 con 0x7f60f00d0e80 2024-09-19T05:33:52.902 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:33:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 -- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f60dc0678c0 msgr2=0x7f60dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f60dc0678c0 0x7f60dc069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f60e00af000 tx=0x7f60e00a7070 comp rx=0 tx=0).stop 2024-09-19T05:33:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 -- 172.21.15.67:0/671001060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f00d0e80 msgr2=0x7f60f00c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f00d0e80 0x7f60f00c7fc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f60e400c420 tx=0x7f60e400c8e0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 -- 172.21.15.67:0/671001060 shutdown_connections 2024-09-19T05:33:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f0161da0 0x7f60f00c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f00d0e80 0x7f60f00c7fc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f60dc0678c0 0x7f60dc069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 --2- 172.21.15.67:0/671001060 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60f00d0160 0x7f60f0150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 -- 172.21.15.67:0/671001060 >> 172.21.15.67:0/671001060 conn(0x7f60f008bfc0 msgr2=0x7f60f006e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 -- 172.21.15.67:0/671001060 shutdown_connections 2024-09-19T05:33:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:52.901+0000 7f60f7918640 1 -- 172.21.15.67:0/671001060 wait complete. 2024-09-19T05:33:52.920 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:33:52.920 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:52.927 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:33:53.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.089+0000 7f9e24a07640 1 Processor -- start 2024-09-19T05:33:53.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.089+0000 7f9e24a07640 1 -- start start 2024-09-19T05:33:53.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.089+0000 7f9e24a07640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e2006f460 0x7f9e2006f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.089+0000 7f9e24a07640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e2006e3c0 con 0x7f9e2006dde0 2024-09-19T05:33:53.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.089+0000 7f9e24a07640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e2006e6a0 con 0x7f9e2015c030 2024-09-19T05:33:53.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.089+0000 7f9e24a07640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2006e980 con 0x7f9e2006f460 2024-09-19T05:33:53.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1dd9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9e2006dde0 0x7f9e200b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48222/0 (socket says 172.21.15.67:48222) 2024-09-19T05:33:53.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1dd9b640 1 -- 172.21.15.67:0/2173907949 learned_addr learned my addr 172.21.15.67:0/2173907949 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:53.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1ed9d640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e2006f460 0x7f9e2006f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889520262 0 0) 0x7f9e2006e3c0 con 0x7f9e2006dde0 2024-09-19T05:33:53.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e08003530 con 0x7f9e2006dde0 2024-09-19T05:33:53.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1908410178 0 0) 0x7f9e08003530 con 0x7f9e2006dde0 2024-09-19T05:33:53.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e2006f460 msgr2=0x7f9e2006f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:53.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e2006f460 0x7f9e2006f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 >> v1:172.21.15.97:6789/0 conn(0x7f9e2015c030 legacy=0x7f9e2015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2006ec60 con 0x7f9e2006dde0 2024-09-19T05:33:53.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9e14001680 con 0x7f9e2006dde0 2024-09-19T05:33:53.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 >> v1:172.21.15.67:6789/0 conn(0x7f9e2006dde0 legacy=0x7f9e200b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e080039f0 0x7f9e08003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e2006f460 0x7f9e08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e08004d50 0x7f9e080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2006e980 con 0x7f9e08004d50 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0800ba80 con 0x7f9e080039f0 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0800bc80 con 0x7f9e2006f460 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1ed9d640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e08004d50 0x7f9e080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1e59c640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e080039f0 0x7f9e08003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1dd9b640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e2006f460 0x7f9e08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1ed9d640 1 -- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e2006f460 msgr2=0x7f9e08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1ed9d640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e2006f460 0x7f9e08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1ed9d640 1 -- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e080039f0 msgr2=0x7f9e08003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1ed9d640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e080039f0 0x7f9e08003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1ed9d640 1 -- 172.21.15.67:0/2173907949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e08003530 con 0x7f9e08004d50 2024-09-19T05:33:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1ed9d640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e08004d50 0x7f9e080051d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009a90 tx=0x7f9e1001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb3785d027bc458 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e100b2070 con 0x7f9e08004d50 2024-09-19T05:33:53.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e100a5620 con 0x7f9e08004d50 2024-09-19T05:33:53.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.093+0000 7f9e1d59a640 1 -- 172.21.15.67:0/2173907949 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e10009690 con 0x7f9e08004d50 2024-09-19T05:33:53.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- 172.21.15.67:0/2173907949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e08004d50 msgr2=0x7f9e080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 --2- 172.21.15.67:0/2173907949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e08004d50 0x7f9e080051d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009a90 tx=0x7f9e1001ca30 comp rx=0 tx=0).stop 2024-09-19T05:33:53.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1ed9d640 1 -- 172.21.15.67:0/2173907949 reap_dead start 2024-09-19T05:33:53.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- 172.21.15.67:0/2173907949 shutdown_connections 2024-09-19T05:33:53.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- 172.21.15.67:0/2173907949 >> 172.21.15.67:0/2173907949 conn(0x7f9e200d0080 msgr2=0x7f9e200d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:53.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- 172.21.15.67:0/2173907949 shutdown_connections 2024-09-19T05:33:53.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- 172.21.15.67:0/2173907949 wait complete. 2024-09-19T05:33:53.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 Processor -- start 2024-09-19T05:33:53.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- start start 2024-09-19T05:33:53.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e08004d50 0x7f9e20099740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e20142f20 0x7f9e20143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e20154500 0x7f9e20154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9e200b36e0 con 0x7f9e20142f20 2024-09-19T05:33:53.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2015c410 con 0x7f9e20154500 2024-09-19T05:33:53.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9e20144590 con 0x7f9e08004d50 2024-09-19T05:33:53.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e20142f20 0x7f9e20143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e20142f20 0x7f9e20143380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58918/0 (socket says 172.21.15.67:58918) 2024-09-19T05:33:53.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1dd9b640 1 -- 172.21.15.67:0/1964583158 learned_addr learned my addr 172.21.15.67:0/1964583158 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1ed9d640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e20154500 0x7f9e20154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1e59c640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e08004d50 0x7f9e20099740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1dd9b640 1 -- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e08004d50 msgr2=0x7f9e20099740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1dd9b640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e08004d50 0x7f9e20099740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1dd9b640 1 -- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e20154500 msgr2=0x7f9e20154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1dd9b640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e20154500 0x7f9e20154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1dd9b640 1 -- 172.21.15.67:0/1964583158 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e20099c80 con 0x7f9e20142f20 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1e59c640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e08004d50 0x7f9e20099740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e1dd9b640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e20142f20 0x7f9e20143380 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400e7b0 tx=0x7f9e1400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e0effd640 1 -- 172.21.15.67:0/1964583158 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1400c8d0 con 0x7f9e20142f20 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e0effd640 1 -- 172.21.15.67:0/1964583158 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e14018070 con 0x7f9e20142f20 2024-09-19T05:33:53.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- 172.21.15.67:0/1964583158 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e20143980 con 0x7f9e20142f20 2024-09-19T05:33:53.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e0effd640 1 -- 172.21.15.67:0/1964583158 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1400ccb0 con 0x7f9e20142f20 2024-09-19T05:33:53.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.097+0000 7f9e24a07640 1 -- 172.21.15.67:0/1964583158 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e20143f40 con 0x7f9e20142f20 2024-09-19T05:33:53.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.101+0000 7f9e24a07640 1 -- 172.21.15.67:0/1964583158 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e2006f890 con 0x7f9e20142f20 2024-09-19T05:33:53.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.101+0000 7f9e0effd640 1 -- 172.21.15.67:0/1964583158 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e1401d460 con 0x7f9e20142f20 2024-09-19T05:33:53.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.101+0000 7f9e0effd640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e000678c0 0x7f9e00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.101+0000 7f9e0effd640 1 -- 172.21.15.67:0/1964583158 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9e14085f30 con 0x7f9e20142f20 2024-09-19T05:33:53.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.101+0000 7f9e1e59c640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e000678c0 0x7f9e00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.101+0000 7f9e1e59c640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e000678c0 0x7f9e00069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e18001dd0 tx=0x7f9e18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:53.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.105+0000 7f9e0effd640 1 -- 172.21.15.67:0/1964583158 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9e14056730 con 0x7f9e20142f20 2024-09-19T05:33:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 -- 172.21.15.67:0/1964583158 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9e200cf210 con 0x7f9e20142f20 2024-09-19T05:33:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e0effd640 1 -- 172.21.15.67:0/1964583158 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f9e14056030 con 0x7f9e20142f20 2024-09-19T05:33:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:33:53.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 -- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e000678c0 msgr2=0x7f9e00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e000678c0 0x7f9e00069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e18001dd0 tx=0x7f9e18009040 comp rx=0 tx=0).stop 2024-09-19T05:33:53.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 -- 172.21.15.67:0/1964583158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e20142f20 msgr2=0x7f9e20143380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e20142f20 0x7f9e20143380 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400e7b0 tx=0x7f9e1400ec70 comp rx=0 tx=0).stop 2024-09-19T05:33:53.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 -- 172.21.15.67:0/1964583158 shutdown_connections 2024-09-19T05:33:53.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e20154500 0x7f9e20154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e20142f20 0x7f9e20143380 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e000678c0 0x7f9e00069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 --2- 172.21.15.67:0/1964583158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e08004d50 0x7f9e20099740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 -- 172.21.15.67:0/1964583158 >> 172.21.15.67:0/1964583158 conn(0x7f9e200d0080 msgr2=0x7f9e200acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:53.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 -- 172.21.15.67:0/1964583158 shutdown_connections 2024-09-19T05:33:53.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.285+0000 7f9e24a07640 1 -- 172.21.15.67:0/1964583158 wait complete. 2024-09-19T05:33:53.307 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:33:53.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:53.308 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-19T05:33:53.321 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:33:53.321 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:33:53.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:53.321 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:33:53.368 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:33:53.368 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:53.374 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:33:53.375 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:53.421 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:33:53.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c10b8c640 1 Processor -- start 2024-09-19T05:33:53.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c10b8c640 1 -- start start 2024-09-19T05:33:53.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c10b8c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2c0c15c200 0x7f2c0c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c10b8c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c0c0b3070 con 0x7f2c0c15b710 2024-09-19T05:33:53.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c10b8c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c0c0afa70 con 0x7f2c0c0aef40 2024-09-19T05:33:53.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c10b8c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2c0c0b32e0 con 0x7f2c0c15c200 2024-09-19T05:33:53.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0a59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2c0c15b710 0x7f2c0c15baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48228/0 (socket says 172.21.15.67:48228) 2024-09-19T05:33:53.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0a59c640 1 -- 172.21.15.67:0/346251760 learned_addr learned my addr 172.21.15.67:0/346251760 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:53.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4234518676 0 0) 0x7f2c0c0b3070 con 0x7f2c0c15b710 2024-09-19T05:33:53.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c09d9b640 1 --2- 172.21.15.67:0/346251760 >> v2:172.21.15.97:3300/0 conn(0x7f2c0c15c200 0x7f2c0c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf4003530 con 0x7f2c0c15b710 2024-09-19T05:33:53.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2448374428 0 0) 0x7f2bf4003530 con 0x7f2c0c15b710 2024-09-19T05:33:53.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 >> v2:172.21.15.97:3300/0 conn(0x7f2c0c15c200 msgr2=0x7f2c0c071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:53.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 --2- 172.21.15.67:0/346251760 >> v2:172.21.15.97:3300/0 conn(0x7f2c0c15c200 0x7f2c0c071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 >> v1:172.21.15.97:6789/0 conn(0x7f2c0c0aef40 legacy=0x7f2c0c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c0b35c0 con 0x7f2c0c15b710 2024-09-19T05:33:53.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f2bfc001680 con 0x7f2c0c15b710 2024-09-19T05:33:53.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 >> v1:172.21.15.67:6789/0 conn(0x7f2c0c15b710 legacy=0x7f2c0c15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2bf4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf4004810 0x7f2bf4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf40051d0 0x7f2bf400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c0b32e0 con 0x7f2bf40039c0 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf40148b0 con 0x7f2bf40051d0 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf4014ab0 con 0x7f2bf4004810 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0a59c640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2bf4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0ad9d640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf40051d0 0x7f2bf400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c09d9b640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf4004810 0x7f2bf4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0a59c640 1 -- 172.21.15.67:0/346251760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf4004810 msgr2=0x7f2bf4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0a59c640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf4004810 0x7f2bf4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0a59c640 1 -- 172.21.15.67:0/346251760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf40051d0 msgr2=0x7f2bf400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:53.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.545+0000 7f2c0a59c640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf40051d0 0x7f2bf400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c0a59c640 1 -- 172.21.15.67:0/346251760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf4003530 con 0x7f2bf40039c0 2024-09-19T05:33:53.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c09d9b640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf4004810 0x7f2bf4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:53.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c0ad9d640 1 -- 172.21.15.67:0/346251760 reap_dead start 2024-09-19T05:33:53.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c0a59c640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2bf4003de0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00c240 tx=0x7f2bfc01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc284c4382af6434 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:53.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc007d20 con 0x7f2bf40039c0 2024-09-19T05:33:53.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc0a9070 con 0x7f2bf40039c0 2024-09-19T05:33:53.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c0959a640 1 -- 172.21.15.67:0/346251760 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc005d20 con 0x7f2bf40039c0 2024-09-19T05:33:53.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c10b8c640 1 -- 172.21.15.67:0/346251760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 msgr2=0x7f2bf4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c10b8c640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2bf4003de0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00c240 tx=0x7f2bfc01cc50 comp rx=0 tx=0).stop 2024-09-19T05:33:53.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c10b8c640 1 -- 172.21.15.67:0/346251760 shutdown_connections 2024-09-19T05:33:53.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c10b8c640 1 --2- 172.21.15.67:0/346251760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2bf4003de0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c10b8c640 1 -- 172.21.15.67:0/346251760 >> 172.21.15.67:0/346251760 conn(0x7f2c0c0d0080 msgr2=0x7f2c0c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:53.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c10b8c640 1 -- 172.21.15.67:0/346251760 shutdown_connections 2024-09-19T05:33:53.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.549+0000 7f2c10b8c640 1 -- 172.21.15.67:0/346251760 wait complete. 2024-09-19T05:33:53.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 Processor -- start 2024-09-19T05:33:53.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 -- start start 2024-09-19T05:33:53.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2c0c1537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c0c09d9e0 0x7f2c0c153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c0c072830 0x7f2c0c14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c0b4a30 con 0x7f2bf40039c0 2024-09-19T05:33:53.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c0b48b0 con 0x7f2c0c09d9e0 2024-09-19T05:33:53.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2c0c0b4bb0 con 0x7f2c0c072830 2024-09-19T05:33:53.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2c0c1537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2c0c1537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58924/0 (socket says 172.21.15.67:58924) 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0a59c640 1 -- 172.21.15.67:0/1927088929 learned_addr learned my addr 172.21.15.67:0/1927088929 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c09d9b640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c0c09d9e0 0x7f2c0c153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0ad9d640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c0c072830 0x7f2c0c14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0a59c640 1 -- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c0c072830 msgr2=0x7f2c0c14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0a59c640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c0c072830 0x7f2c0c14a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0a59c640 1 -- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c0c09d9e0 msgr2=0x7f2c0c153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0a59c640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c0c09d9e0 0x7f2c0c153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0a59c640 1 -- 172.21.15.67:0/1927088929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c09de70 con 0x7f2bf40039c0 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0ad9d640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c0c072830 0x7f2c0c14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c0a59c640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2c0c1537c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc01ca80 tx=0x7f2bf4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2bfaffd640 1 -- 172.21.15.67:0/1927088929 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0bc070 con 0x7f2bf40039c0 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2bfaffd640 1 -- 172.21.15.67:0/1927088929 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc0a6e50 con 0x7f2bf40039c0 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 -- 172.21.15.67:0/1927088929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0c152d00 con 0x7f2bf40039c0 2024-09-19T05:33:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2bfaffd640 1 -- 172.21.15.67:0/1927088929 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc007d20 con 0x7f2bf40039c0 2024-09-19T05:33:53.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 -- 172.21.15.67:0/1927088929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0c1532c0 con 0x7f2bf40039c0 2024-09-19T05:33:53.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2c10b8c640 1 -- 172.21.15.67:0/1927088929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0c0af320 con 0x7f2bf40039c0 2024-09-19T05:33:53.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2bfaffd640 1 -- 172.21.15.67:0/1927088929 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2bfc0bf070 con 0x7f2bf40039c0 2024-09-19T05:33:53.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.553+0000 7f2bfaffd640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bec0678c0 0x7f2bec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.557+0000 7f2bfaffd640 1 -- 172.21.15.67:0/1927088929 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2bfc11f510 con 0x7f2bf40039c0 2024-09-19T05:33:53.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.557+0000 7f2c09d9b640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bec0678c0 0x7f2bec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.557+0000 7f2c09d9b640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bec0678c0 0x7f2bec069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c06cd00 tx=0x7f2c00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:53.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.561+0000 7f2bfaffd640 1 -- 172.21.15.67:0/1927088929 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2bfc016990 con 0x7f2bf40039c0 2024-09-19T05:33:53.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.737+0000 7f2c10b8c640 1 -- 172.21.15.67:0/1927088929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2c0c0b5020 con 0x7f2bf40039c0 2024-09-19T05:33:53.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.737+0000 7f2bfaffd640 1 -- 172.21.15.67:0/1927088929 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f2bfc0efd10 con 0x7f2bf40039c0 2024-09-19T05:33:53.742 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:33:53.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 -- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bec0678c0 msgr2=0x7f2bec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bec0678c0 0x7f2bec069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c06cd00 tx=0x7f2c00008040 comp rx=0 tx=0).stop 2024-09-19T05:33:53.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 -- 172.21.15.67:0/1927088929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 msgr2=0x7f2c0c1537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2c0c1537c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc01ca80 tx=0x7f2bf4005840 comp rx=0 tx=0).stop 2024-09-19T05:33:53.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 -- 172.21.15.67:0/1927088929 shutdown_connections 2024-09-19T05:33:53.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bec0678c0 0x7f2bec069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c0c072830 0x7f2c0c14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c0c09d9e0 0x7f2c0c153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 --2- 172.21.15.67:0/1927088929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf40039c0 0x7f2c0c1537c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 -- 172.21.15.67:0/1927088929 >> 172.21.15.67:0/1927088929 conn(0x7f2c0c0d0080 msgr2=0x7f2c0c0b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:53.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 -- 172.21.15.67:0/1927088929 shutdown_connections 2024-09-19T05:33:53.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.741+0000 7f2c10b8c640 1 -- 172.21.15.67:0/1927088929 wait complete. 2024-09-19T05:33:53.761 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:33:53.762 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:33:53.769 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:33:53.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f669580f640 1 Processor -- start 2024-09-19T05:33:53.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f669580f640 1 -- start start 2024-09-19T05:33:53.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f669580f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f669009b140 0x7f66900705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f669580f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f669015d290 0x7f6690159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f669580f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66900c7130 con 0x7f66900c8c40 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f669580f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6690070b90 con 0x7f669015d290 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f669580f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6690070e70 con 0x7f669009b140 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f668f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f669015d290 0x7f6690159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f668f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f669015d290 0x7f6690159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58936/0 (socket says 172.21.15.67:58936) 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f668f7fe640 1 -- 172.21.15.67:0/429896817 learned_addr learned my addr 172.21.15.67:0/429896817 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f668e7fc640 1 --2- 172.21.15.67:0/429896817 >> v2:172.21.15.97:3300/0 conn(0x7f669009b140 0x7f66900705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f668f7fe640 1 -- 172.21.15.67:0/429896817 >> v2:172.21.15.97:3300/0 conn(0x7f669009b140 msgr2=0x7f66900705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f668f7fe640 1 --2- 172.21.15.67:0/429896817 >> v2:172.21.15.97:3300/0 conn(0x7f669009b140 0x7f66900705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f668f7fe640 1 -- 172.21.15.67:0/429896817 >> v1:172.21.15.97:6789/0 conn(0x7f66900c8c40 legacy=0x7f669009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.897+0000 7f668f7fe640 1 -- 172.21.15.67:0/429896817 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6690071150 con 0x7f669015d290 2024-09-19T05:33:53.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f668f7fe640 1 --2- 172.21.15.67:0/429896817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 0x7f6690159550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f669009be90 tx=0x7f668801d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2e3c5dc243a8e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:53.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f668dffb640 1 -- 172.21.15.67:0/429896817 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880a57d0 con 0x7f669015d290 2024-09-19T05:33:53.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f668dffb640 1 -- 172.21.15.67:0/429896817 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66880a5970 con 0x7f669015d290 2024-09-19T05:33:53.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f668dffb640 1 -- 172.21.15.67:0/429896817 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880a5d40 con 0x7f669015d290 2024-09-19T05:33:53.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 -- 172.21.15.67:0/429896817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 msgr2=0x7f6690159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 --2- 172.21.15.67:0/429896817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 0x7f6690159550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f669009be90 tx=0x7f668801d450 comp rx=0 tx=0).stop 2024-09-19T05:33:53.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 -- 172.21.15.67:0/429896817 shutdown_connections 2024-09-19T05:33:53.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 --2- 172.21.15.67:0/429896817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 0x7f6690159550 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 --2- 172.21.15.67:0/429896817 >> v2:172.21.15.97:3300/0 conn(0x7f669009b140 0x7f66900705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 -- 172.21.15.67:0/429896817 >> 172.21.15.67:0/429896817 conn(0x7f66900d22b0 msgr2=0x7f66900d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:53.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 -- 172.21.15.67:0/429896817 shutdown_connections 2024-09-19T05:33:53.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 -- 172.21.15.67:0/429896817 wait complete. 2024-09-19T05:33:53.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 Processor -- start 2024-09-19T05:33:53.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 -- start start 2024-09-19T05:33:53.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669009b140 0x7f66900b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66900c8c40 0x7f6690153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 0x7f6690153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66900d0be0 con 0x7f669015d290 2024-09-19T05:33:53.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f66900d0a60 con 0x7f66900c8c40 2024-09-19T05:33:53.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.901+0000 7f669580f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f66900d0d60 con 0x7f669009b140 2024-09-19T05:33:53.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 0x7f6690153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 0x7f6690153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58940/0 (socket says 172.21.15.67:58940) 2024-09-19T05:33:53.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668f7fe640 1 -- 172.21.15.67:0/877662822 learned_addr learned my addr 172.21.15.67:0/877662822 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668e7fc640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66900c8c40 0x7f6690153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668effd640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669009b140 0x7f66900b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668f7fe640 1 -- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669009b140 msgr2=0x7f66900b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668f7fe640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669009b140 0x7f66900b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668f7fe640 1 -- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66900c8c40 msgr2=0x7f6690153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668f7fe640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66900c8c40 0x7f6690153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668f7fe640 1 -- 172.21.15.67:0/877662822 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66901535b0 con 0x7f669015d290 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668effd640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669009b140 0x7f66900b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668f7fe640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 0x7f6690153d30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66880af040 tx=0x7f6688019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f6677fff640 1 -- 172.21.15.67:0/877662822 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880b8670 con 0x7f669015d290 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f6677fff640 1 -- 172.21.15.67:0/877662822 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66880be070 con 0x7f669015d290 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f6677fff640 1 -- 172.21.15.67:0/877662822 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880b8a50 con 0x7f669015d290 2024-09-19T05:33:53.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f669580f640 1 -- 172.21.15.67:0/877662822 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6690155bd0 con 0x7f669015d290 2024-09-19T05:33:53.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f669580f640 1 -- 172.21.15.67:0/877662822 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6690156190 con 0x7f669015d290 2024-09-19T05:33:53.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f669580f640 1 -- 172.21.15.67:0/877662822 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66900705b0 con 0x7f669015d290 2024-09-19T05:33:53.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f6677fff640 1 -- 172.21.15.67:0/877662822 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66880b8bf0 con 0x7f669015d290 2024-09-19T05:33:53.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f6677fff640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f667c0678f0 0x7f667c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:53.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f6677fff640 1 -- 172.21.15.67:0/877662822 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6688121030 con 0x7f669015d290 2024-09-19T05:33:53.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668effd640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f667c0678f0 0x7f667c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:53.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.905+0000 7f668effd640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f667c0678f0 0x7f667c069db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f66800016f0 tx=0x7f6680009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:53.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:53.909+0000 7f6677fff640 1 -- 172.21.15.67:0/877662822 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f66901535b0 con 0x7f669015d290 2024-09-19T05:33:54.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.085+0000 7f669580f640 1 -- 172.21.15.67:0/877662822 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f669006f100 con 0x7f669015d290 2024-09-19T05:33:54.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.085+0000 7f6677fff640 1 -- 172.21.15.67:0/877662822 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f66880165e0 con 0x7f669015d290 2024-09-19T05:33:54.091 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 -- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f667c0678f0 msgr2=0x7f667c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f667c0678f0 0x7f667c069db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f66800016f0 tx=0x7f6680009040 comp rx=0 tx=0).stop 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 -- 172.21.15.67:0/877662822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 msgr2=0x7f6690153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 0x7f6690153d30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66880af040 tx=0x7f6688019790 comp rx=0 tx=0).stop 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 -- 172.21.15.67:0/877662822 shutdown_connections 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669015d290 0x7f6690153d30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66900c8c40 0x7f6690153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f667c0678f0 0x7f667c069db0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 --2- 172.21.15.67:0/877662822 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f669009b140 0x7f66900b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 -- 172.21.15.67:0/877662822 >> 172.21.15.67:0/877662822 conn(0x7f66900d22b0 msgr2=0x7f66900d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:54.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 -- 172.21.15.67:0/877662822 shutdown_connections 2024-09-19T05:33:54.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.089+0000 7f669580f640 1 -- 172.21.15.67:0/877662822 wait complete. 2024-09-19T05:33:54.109 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi097.front.sepia.ceph.com... 2024-09-19T05:33:54.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:54.109 DEBUG:teuthology.orchestra.run.smithi097:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-19T05:33:54.123 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:33:54.124 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:33:54.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:33:54.124 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:33:54.173 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:33:54.173 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d3add640 1 Processor -- start 2024-09-19T05:33:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d3add640 1 -- start start 2024-09-19T05:33:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d3add640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81cc0ce840 0x7f81cc06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d3add640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc067a00 0x7f81cc0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d3add640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81cc0cf160 con 0x7f81cc0cd550 2024-09-19T05:33:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d3add640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f81cc070170 con 0x7f81cc0ce840 2024-09-19T05:33:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d3add640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f81cc06f1e0 con 0x7f81cc067a00 2024-09-19T05:33:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d1078640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc067a00 0x7f81cc0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d1879640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81cc0ce840 0x7f81cc06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d1879640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81cc0ce840 0x7f81cc06fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:46954/0 (socket says 172.21.15.67:46954) 2024-09-19T05:33:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d1879640 1 -- 172.21.15.67:0/1210783068 learned_addr learned my addr 172.21.15.67:0/1210783068 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d207a640 1 --1- 172.21.15.67:0/1210783068 >> v1:172.21.15.97:6789/0 conn(0x7f81cc0cd550 0x7f81cc0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:48972/0 (socket says 172.21.15.67:48972) 2024-09-19T05:33:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d1078640 1 -- 172.21.15.67:0/1210783068 >> v2:172.21.15.97:3300/0 conn(0x7f81cc0ce840 msgr2=0x7f81cc06fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d1078640 1 --2- 172.21.15.67:0/1210783068 >> v2:172.21.15.97:3300/0 conn(0x7f81cc0ce840 0x7f81cc06fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d1078640 1 -- 172.21.15.67:0/1210783068 >> v1:172.21.15.97:6789/0 conn(0x7f81cc0cd550 legacy=0x7f81cc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d1078640 1 -- 172.21.15.67:0/1210783068 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc073980 con 0x7f81cc067a00 2024-09-19T05:33:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.285+0000 7f81d1879640 1 --2- 172.21.15.67:0/1210783068 >> v2:172.21.15.97:3300/0 conn(0x7f81cc0ce840 0x7f81cc06fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:33:54.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d1078640 1 --2- 172.21.15.67:0/1210783068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc067a00 0x7f81cc0cec20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0097c0 tx=0x7f81bc01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5207614f7d2aea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:54.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d0877640 1 -- 172.21.15.67:0/1210783068 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0b0070 con 0x7f81cc067a00 2024-09-19T05:33:54.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d0877640 1 -- 172.21.15.67:0/1210783068 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81bc0ab600 con 0x7f81cc067a00 2024-09-19T05:33:54.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d0877640 1 -- 172.21.15.67:0/1210783068 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0ab9d0 con 0x7f81cc067a00 2024-09-19T05:33:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d3add640 1 -- 172.21.15.67:0/1210783068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc067a00 msgr2=0x7f81cc0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d3add640 1 --2- 172.21.15.67:0/1210783068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc067a00 0x7f81cc0cec20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0097c0 tx=0x7f81bc01c380 comp rx=0 tx=0).stop 2024-09-19T05:33:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d3add640 1 -- 172.21.15.67:0/1210783068 shutdown_connections 2024-09-19T05:33:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d3add640 1 --2- 172.21.15.67:0/1210783068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc067a00 0x7f81cc0cec20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d3add640 1 --2- 172.21.15.67:0/1210783068 >> v2:172.21.15.97:3300/0 conn(0x7f81cc0ce840 0x7f81cc06fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d3add640 1 -- 172.21.15.67:0/1210783068 >> 172.21.15.67:0/1210783068 conn(0x7f81cc073500 msgr2=0x7f81cc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d3add640 1 -- 172.21.15.67:0/1210783068 shutdown_connections 2024-09-19T05:33:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.289+0000 7f81d3add640 1 -- 172.21.15.67:0/1210783068 wait complete. 2024-09-19T05:33:54.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d3add640 1 Processor -- start 2024-09-19T05:33:54.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d3add640 1 -- start start 2024-09-19T05:33:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d3add640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81cc067a00 0x7f81cc15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d3add640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81cc0cd550 0x7f81cc14f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d3add640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc0ce840 0x7f81cc14fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d3add640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc06d560 con 0x7f81cc067a00 2024-09-19T05:33:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d3add640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc06d3e0 con 0x7f81cc0cd550 2024-09-19T05:33:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d3add640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f81cc1695d0 con 0x7f81cc0ce840 2024-09-19T05:33:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d1879640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81cc067a00 0x7f81cc15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d1879640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81cc067a00 0x7f81cc15b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58952/0 (socket says 172.21.15.67:58952) 2024-09-19T05:33:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d1879640 1 -- 172.21.15.67:0/2013512586 learned_addr learned my addr 172.21.15.67:0/2013512586 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d207a640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc0ce840 0x7f81cc14fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d1078640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81cc0cd550 0x7f81cc14f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d1879640 1 -- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc0ce840 msgr2=0x7f81cc14fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d1879640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc0ce840 0x7f81cc14fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d1879640 1 -- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81cc0cd550 msgr2=0x7f81cc14f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d1879640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81cc0cd550 0x7f81cc14f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d1879640 1 -- 172.21.15.67:0/2013512586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc15a5f0 con 0x7f81cc067a00 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d1879640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81cc067a00 0x7f81cc15b3b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f81c800e930 tx=0x7f81c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81c27fc640 1 -- 172.21.15.67:0/2013512586 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8017070 con 0x7f81cc067a00 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81c27fc640 1 -- 172.21.15.67:0/2013512586 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c800ca00 con 0x7f81cc067a00 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81c27fc640 1 -- 172.21.15.67:0/2013512586 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c800cdd0 con 0x7f81cc067a00 2024-09-19T05:33:54.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d3add640 1 -- 172.21.15.67:0/2013512586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81cc15a8d0 con 0x7f81cc067a00 2024-09-19T05:33:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.293+0000 7f81d3add640 1 -- 172.21.15.67:0/2013512586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81cc14be10 con 0x7f81cc067a00 2024-09-19T05:33:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.297+0000 7f81d3add640 1 -- 172.21.15.67:0/2013512586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81cc0cec20 con 0x7f81cc067a00 2024-09-19T05:33:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.297+0000 7f81c27fc640 1 -- 172.21.15.67:0/2013512586 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81c801a070 con 0x7f81cc067a00 2024-09-19T05:33:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.297+0000 7f81c27fc640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81b00678c0 0x7f81b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.297+0000 7f81c27fc640 1 -- 172.21.15.67:0/2013512586 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f81c8086290 con 0x7f81cc067a00 2024-09-19T05:33:54.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.297+0000 7f81d1078640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81b00678c0 0x7f81b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.297+0000 7f81d1078640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81b00678c0 0x7f81b0069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0ad000 tx=0x7f81bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:54.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.301+0000 7f81c27fc640 1 -- 172.21.15.67:0/2013512586 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f81c8056a90 con 0x7f81cc067a00 2024-09-19T05:33:54.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.489+0000 7f81d3add640 1 -- 172.21.15.67:0/2013512586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81cc0cee90 con 0x7f81cc067a00 2024-09-19T05:33:54.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.489+0000 7f81c27fc640 1 -- 172.21.15.67:0/2013512586 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7f81c8056390 con 0x7f81cc067a00 2024-09-19T05:33:54.496 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:54.496 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"btime":"2024-09-19T05:33:28:174068+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:33:13.876770+0000","modified":"2024-09-19T05:33:27.556615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-19T05:33:54.496 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-09-19T05:33:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 -- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81b00678c0 msgr2=0x7f81b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81b00678c0 0x7f81b0069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0ad000 tx=0x7f81bc008040 comp rx=0 tx=0).stop 2024-09-19T05:33:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 -- 172.21.15.67:0/2013512586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81cc067a00 msgr2=0x7f81cc15b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81cc067a00 0x7f81cc15b3b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f81c800e930 tx=0x7f81c800edf0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 -- 172.21.15.67:0/2013512586 shutdown_connections 2024-09-19T05:33:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81b00678c0 0x7f81b0069d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81cc0ce840 0x7f81cc14fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81cc0cd550 0x7f81cc14f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 --2- 172.21.15.67:0/2013512586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81cc067a00 0x7f81cc15b3b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 -- 172.21.15.67:0/2013512586 >> 172.21.15.67:0/2013512586 conn(0x7f81cc073500 msgr2=0x7f81cc06ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:54.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 -- 172.21.15.67:0/2013512586 shutdown_connections 2024-09-19T05:33:54.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.493+0000 7f81d3add640 1 -- 172.21.15.67:0/2013512586 wait complete. 2024-09-19T05:33:54.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:54.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a3815640 1 Processor -- start 2024-09-19T05:33:54.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a3815640 1 -- start start 2024-09-19T05:33:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a3815640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c15c030 0x7fa19c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a3815640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa19c15d1d0 0x7fa19c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a3815640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa19c06e3c0 con 0x7fa19c0b3510 2024-09-19T05:33:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a3815640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa19c06e6a0 con 0x7fa19c15d1d0 2024-09-19T05:33:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a3815640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa19c06e980 con 0x7fa19c15c030 2024-09-19T05:33:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a0db0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa19c15d1d0 0x7fa19c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a0db0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa19c15d1d0 0x7fa19c0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58954/0 (socket says 172.21.15.67:58954) 2024-09-19T05:33:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a0db0640 1 -- 172.21.15.67:0/3495936023 learned_addr learned my addr 172.21.15.67:0/3495936023 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a15b1640 1 --2- 172.21.15.67:0/3495936023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c15c030 0x7fa19c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a0db0640 1 -- 172.21.15.67:0/3495936023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c15c030 msgr2=0x7fa19c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a0db0640 1 --2- 172.21.15.67:0/3495936023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c15c030 0x7fa19c06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a0db0640 1 -- 172.21.15.67:0/3495936023 >> v1:172.21.15.97:6789/0 conn(0x7fa19c0b3510 legacy=0x7fa19c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a0db0640 1 -- 172.21.15.67:0/3495936023 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19c06ec60 con 0x7fa19c15d1d0 2024-09-19T05:33:54.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.625+0000 7fa1a15b1640 1 --2- 172.21.15.67:0/3495936023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c15c030 0x7fa19c06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a0db0640 1 --2- 172.21.15.67:0/3495936023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15d1d0 0x7fa19c0b2fd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa190009e50 tx=0x7fa19001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa43d953efeb14a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:54.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa19bfff640 1 -- 172.21.15.67:0/3495936023 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900a58f0 con 0x7fa19c15d1d0 2024-09-19T05:33:54.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa19bfff640 1 -- 172.21.15.67:0/3495936023 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1900a5a90 con 0x7fa19c15d1d0 2024-09-19T05:33:54.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa19bfff640 1 -- 172.21.15.67:0/3495936023 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900a5e60 con 0x7fa19c15d1d0 2024-09-19T05:33:54.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 -- 172.21.15.67:0/3495936023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15d1d0 msgr2=0x7fa19c0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 --2- 172.21.15.67:0/3495936023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15d1d0 0x7fa19c0b2fd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa190009e50 tx=0x7fa19001ca00 comp rx=0 tx=0).stop 2024-09-19T05:33:54.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 -- 172.21.15.67:0/3495936023 shutdown_connections 2024-09-19T05:33:54.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 --2- 172.21.15.67:0/3495936023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15d1d0 0x7fa19c0b2fd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 --2- 172.21.15.67:0/3495936023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c15c030 0x7fa19c06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 -- 172.21.15.67:0/3495936023 >> 172.21.15.67:0/3495936023 conn(0x7fa19c0d0080 msgr2=0x7fa19c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:54.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 -- 172.21.15.67:0/3495936023 shutdown_connections 2024-09-19T05:33:54.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 -- 172.21.15.67:0/3495936023 wait complete. 2024-09-19T05:33:54.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 Processor -- start 2024-09-19T05:33:54.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 -- start start 2024-09-19T05:33:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c0b3510 0x7fa19c14aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15c030 0x7fa19c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15d1d0 0x7fa19c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c15c590 con 0x7fa19c15c030 2024-09-19T05:33:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c15c410 con 0x7fa19c15d1d0 2024-09-19T05:33:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a3815640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa19c1690e0 con 0x7fa19c0b3510 2024-09-19T05:33:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a0db0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15c030 0x7fa19c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a0db0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15c030 0x7fa19c14b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58970/0 (socket says 172.21.15.67:58970) 2024-09-19T05:33:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.629+0000 7fa1a0db0640 1 -- 172.21.15.67:0/1643516749 learned_addr learned my addr 172.21.15.67:0/1643516749 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a15b1640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c0b3510 0x7fa19c14aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a1db2640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15d1d0 0x7fa19c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a0db0640 1 -- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c0b3510 msgr2=0x7fa19c14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a0db0640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c0b3510 0x7fa19c14aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a0db0640 1 -- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15d1d0 msgr2=0x7fa19c150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a0db0640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15d1d0 0x7fa19c150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a0db0640 1 -- 172.21.15.67:0/1643516749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19c14afb0 con 0x7fa19c15c030 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a1db2640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15d1d0 0x7fa19c150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a0db0640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15c030 0x7fa19c14b1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa1900af040 tx=0x7fa1900197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa199ffb640 1 -- 172.21.15.67:0/1643516749 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900be020 con 0x7fa19c15c030 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa199ffb640 1 -- 172.21.15.67:0/1643516749 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1900b8440 con 0x7fa19c15c030 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a3815640 1 -- 172.21.15.67:0/1643516749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19c156bd0 con 0x7fa19c15c030 2024-09-19T05:33:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa199ffb640 1 -- 172.21.15.67:0/1643516749 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900a58f0 con 0x7fa19c15c030 2024-09-19T05:33:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a3815640 1 -- 172.21.15.67:0/1643516749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19c157190 con 0x7fa19c15c030 2024-09-19T05:33:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a3815640 1 -- 172.21.15.67:0/1643516749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa19c06dde0 con 0x7fa19c15c030 2024-09-19T05:33:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa199ffb640 1 -- 172.21.15.67:0/1643516749 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1900c1070 con 0x7fa19c15c030 2024-09-19T05:33:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa199ffb640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1880678c0 0x7fa188069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa199ffb640 1 -- 172.21.15.67:0/1643516749 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa190120470 con 0x7fa19c15c030 2024-09-19T05:33:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a15b1640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1880678c0 0x7fa188069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.633+0000 7fa1a15b1640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1880678c0 0x7fa188069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0098b0 tx=0x7fa18c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.637+0000 7fa199ffb640 1 -- 172.21.15.67:0/1643516749 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa190016620 con 0x7fa19c15c030 2024-09-19T05:33:54.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.833+0000 7fa1a3815640 1 -- 172.21.15.67:0/1643516749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa19c0d0f20 con 0x7fa19c15c030 2024-09-19T05:33:54.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa199ffb640 1 -- 172.21.15.67:0/1643516749 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7fa1900f0c70 con 0x7fa19c15c030 2024-09-19T05:33:54.841 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:54.841 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"btime":"2024-09-19T05:33:28:174068+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:33:13.876770+0000","modified":"2024-09-19T05:33:27.556615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-19T05:33:54.841 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-09-19T05:33:54.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 -- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1880678c0 msgr2=0x7fa188069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1880678c0 0x7fa188069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0098b0 tx=0x7fa18c008040 comp rx=0 tx=0).stop 2024-09-19T05:33:54.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 -- 172.21.15.67:0/1643516749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15c030 msgr2=0x7fa19c14b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15c030 0x7fa19c14b1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa1900af040 tx=0x7fa1900197a0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 -- 172.21.15.67:0/1643516749 shutdown_connections 2024-09-19T05:33:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15d1d0 0x7fa19c150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c15c030 0x7fa19c14b1a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1880678c0 0x7fa188069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 --2- 172.21.15.67:0/1643516749 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c0b3510 0x7fa19c14aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 -- 172.21.15.67:0/1643516749 >> 172.21.15.67:0/1643516749 conn(0x7fa19c0d0080 msgr2=0x7fa19c151b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 -- 172.21.15.67:0/1643516749 shutdown_connections 2024-09-19T05:33:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.837+0000 7fa1a3815640 1 -- 172.21.15.67:0/1643516749 wait complete. 2024-09-19T05:33:54.861 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:54.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f04553bb640 1 Processor -- start 2024-09-19T05:33:54.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f04553bb640 1 -- start start 2024-09-19T05:33:54.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f04553bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f045015f370 0x7f04500ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f04553bb640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045006e790 con 0x7f0450070140 2024-09-19T05:33:54.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f04553bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045006ea50 con 0x7f04500ae8c0 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f04553bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f045015f7b0 con 0x7f045015f370 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044effd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0450070140 0x7f0450070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48230/0 (socket says 172.21.15.67:48230) 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044effd640 1 -- 172.21.15.67:0/2606602411 learned_addr learned my addr 172.21.15.67:0/2606602411 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044e7fc640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f045015f370 0x7f04500ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937902556 0 0) 0x7f045006e790 con 0x7f0450070140 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0438003530 con 0x7f0450070140 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1988224303 0 0) 0x7f045006ea50 con 0x7f04500ae8c0 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f045006e790 con 0x7f04500ae8c0 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2970439772 0 0) 0x7f0438003530 con 0x7f0450070140 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f045015f370 msgr2=0x7f04500ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f045015f370 0x7f04500ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 >> v1:172.21.15.97:6789/0 conn(0x7f04500ae8c0 legacy=0x7f04500aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045006ed30 con 0x7f0450070140 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f0444001680 con 0x7f0450070140 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 >> v1:172.21.15.67:6789/0 conn(0x7f0450070140 legacy=0x7f0450070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0438003b80 0x7f0438003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f045015f370 0x7f0438004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0438004d50 0x7f04380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f043800ba80 con 0x7f0438003b80 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f043800bc00 con 0x7f0438004d50 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f043800be00 con 0x7f045015f370 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044effd640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0438003b80 0x7f0438003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044e7fc640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f045015f370 0x7f0438004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044f7fe640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0438004d50 0x7f04380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:54.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044effd640 1 -- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f045015f370 msgr2=0x7f0438004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:54.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044effd640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f045015f370 0x7f0438004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044effd640 1 -- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0438004d50 msgr2=0x7f04380051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:54.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044effd640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0438004d50 0x7f04380051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:54.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044effd640 1 -- 172.21.15.67:0/2606602411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0438003530 con 0x7f0438003b80 2024-09-19T05:33:54.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.985+0000 7f044f7fe640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0438004d50 0x7f04380051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f044effd640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0438003b80 0x7f0438003f80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f044400c1c0 tx=0x7f044401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a514b52354af2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444007cf0 con 0x7f0438003b80 2024-09-19T05:33:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04440a9020 con 0x7f0438003b80 2024-09-19T05:33:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f044dffb640 1 -- 172.21.15.67:0/2606602411 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04440a5b10 con 0x7f0438003b80 2024-09-19T05:33:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f04553bb640 1 -- 172.21.15.67:0/2606602411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0438003b80 msgr2=0x7f0438003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f04553bb640 1 --2- 172.21.15.67:0/2606602411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0438003b80 0x7f0438003f80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f044400c1c0 tx=0x7f044401cc10 comp rx=0 tx=0).stop 2024-09-19T05:33:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f044f7fe640 1 -- 172.21.15.67:0/2606602411 reap_dead start 2024-09-19T05:33:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f04553bb640 1 -- 172.21.15.67:0/2606602411 shutdown_connections 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f04553bb640 1 -- 172.21.15.67:0/2606602411 >> 172.21.15.67:0/2606602411 conn(0x7f0450073500 msgr2=0x7f045006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f04553bb640 1 -- 172.21.15.67:0/2606602411 shutdown_connections 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f04553bb640 1 -- 172.21.15.67:0/2606602411 wait complete. 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f04553bb640 1 Processor -- start 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.989+0000 7f04553bb640 1 -- start start 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04553bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438003b80 0x7f04500cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04553bb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0450160890 0x7f0450160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04553bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04500cf640 0x7f04500cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04553bb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f045015c160 con 0x7f0450160890 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04553bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f045006f810 con 0x7f04500cf640 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04553bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f045015c2e0 con 0x7f0438003b80 2024-09-19T05:33:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0450160890 0x7f0450160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0450160890 0x7f0450160d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58986/0 (socket says 172.21.15.67:58986) 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044e7fc640 1 -- 172.21.15.67:0/614925240 learned_addr learned my addr 172.21.15.67:0/614925240 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044effd640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438003b80 0x7f04500cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044f7fe640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04500cf640 0x7f04500cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044e7fc640 1 -- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438003b80 msgr2=0x7f04500cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044e7fc640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438003b80 0x7f04500cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044e7fc640 1 -- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04500cf640 msgr2=0x7f04500cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044e7fc640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04500cf640 0x7f04500cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044e7fc640 1 -- 172.21.15.67:0/614925240 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04500d0630 con 0x7f0450160890 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044f7fe640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04500cf640 0x7f04500cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044e7fc640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0450160890 0x7f0450160d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0440011610 tx=0x7f0440011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04377fe640 1 -- 172.21.15.67:0/614925240 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044000f8f0 con 0x7f0450160890 2024-09-19T05:33:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04377fe640 1 -- 172.21.15.67:0/614925240 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044000fa90 con 0x7f0450160890 2024-09-19T05:33:55.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04553bb640 1 -- 172.21.15.67:0/614925240 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04501626c0 con 0x7f0450160890 2024-09-19T05:33:55.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04377fe640 1 -- 172.21.15.67:0/614925240 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044000fe40 con 0x7f0450160890 2024-09-19T05:33:55.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04553bb640 1 -- 172.21.15.67:0/614925240 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0450162960 con 0x7f0450160890 2024-09-19T05:33:55.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04553bb640 1 -- 172.21.15.67:0/614925240 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04500af870 con 0x7f0450160890 2024-09-19T05:33:55.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04377fe640 1 -- 172.21.15.67:0/614925240 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0440015460 con 0x7f0450160890 2024-09-19T05:33:55.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04377fe640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f043c0678c0 0x7f043c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f04377fe640 1 -- 172.21.15.67:0/614925240 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0440086800 con 0x7f0450160890 2024-09-19T05:33:55.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.993+0000 7f044effd640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f043c0678c0 0x7f043c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:54.997+0000 7f044effd640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f043c0678c0 0x7f043c069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04440aa000 tx=0x7f0444001a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:55.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.001+0000 7f04377fe640 1 -- 172.21.15.67:0/614925240 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0440019030 con 0x7f0450160890 2024-09-19T05:33:55.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.165+0000 7f04553bb640 1 -- 172.21.15.67:0/614925240 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04500b5ac0 con 0x7f0450160890 2024-09-19T05:33:55.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.165+0000 7f04377fe640 1 -- 172.21.15.67:0/614925240 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f0440057090 con 0x7f0450160890 2024-09-19T05:33:55.171 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:55.171 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:18.949137+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:55.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 -- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f043c0678c0 msgr2=0x7f043c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f043c0678c0 0x7f043c069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04440aa000 tx=0x7f0444001a40 comp rx=0 tx=0).stop 2024-09-19T05:33:55.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 -- 172.21.15.67:0/614925240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0450160890 msgr2=0x7f0450160d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0450160890 0x7f0450160d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0440011610 tx=0x7f0440011ad0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 -- 172.21.15.67:0/614925240 shutdown_connections 2024-09-19T05:33:55.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04500cf640 0x7f04500cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0450160890 0x7f0450160d10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f043c0678c0 0x7f043c069d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 --2- 172.21.15.67:0/614925240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0438003b80 0x7f04500cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 -- 172.21.15.67:0/614925240 >> 172.21.15.67:0/614925240 conn(0x7f0450073500 msgr2=0x7f04500afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:55.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 -- 172.21.15.67:0/614925240 shutdown_connections 2024-09-19T05:33:55.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.169+0000 7f04553bb640 1 -- 172.21.15.67:0/614925240 wait complete. 2024-09-19T05:33:55.191 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:33:55.192 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:55.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18ecf51640 1 Processor -- start 2024-09-19T05:33:55.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18ecf51640 1 -- start start 2024-09-19T05:33:55.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18ecf51640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f18e80b51d0 0x7f18e80d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18ecf51640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e80d4d40 con 0x7f18e80d1590 2024-09-19T05:33:55.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18ecf51640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e80d5020 con 0x7f18e8161da0 2024-09-19T05:33:55.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18ecf51640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f18e80d0840 con 0x7f18e80b51d0 2024-09-19T05:33:55.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e5d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f18e80d1590 0x7f18e80cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48232/0 (socket says 172.21.15.67:48232) 2024-09-19T05:33:55.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e5d9b640 1 -- 172.21.15.67:0/214582177 learned_addr learned my addr 172.21.15.67:0/214582177 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:55.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e6d9d640 1 --2- 172.21.15.67:0/214582177 >> v2:172.21.15.97:3300/0 conn(0x7f18e80b51d0 0x7f18e80d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 549230822 0 0) 0x7f18e80d4d40 con 0x7f18e80d1590 2024-09-19T05:33:55.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18d4003530 con 0x7f18e80d1590 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 702327891 0 0) 0x7f18d4003530 con 0x7f18e80d1590 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 >> v2:172.21.15.97:3300/0 conn(0x7f18e80b51d0 msgr2=0x7f18e80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 --2- 172.21.15.67:0/214582177 >> v2:172.21.15.97:3300/0 conn(0x7f18e80b51d0 0x7f18e80d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 >> v1:172.21.15.97:6789/0 conn(0x7f18e8161da0 legacy=0x7f18e80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e80d5300 con 0x7f18e80d1590 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f18d0001a00 con 0x7f18e80d1590 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 >> v1:172.21.15.67:6789/0 conn(0x7f18e80d1590 legacy=0x7f18e80cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d40039c0 0x7f18d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18d40043c0 0x7f18d4004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d4005090 0x7f18d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f18e80d0840 con 0x7f18d40043c0 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f18d400bff0 con 0x7f18d4005090 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f18d400c1f0 con 0x7f18d40039c0 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e5d9b640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18d40043c0 0x7f18d4004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e6d9d640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d4005090 0x7f18d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.313+0000 7f18e659c640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d40039c0 0x7f18d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e5d9b640 1 -- 172.21.15.67:0/214582177 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d40039c0 msgr2=0x7f18d4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e5d9b640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d40039c0 0x7f18d4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e5d9b640 1 -- 172.21.15.67:0/214582177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d4005090 msgr2=0x7f18d400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e5d9b640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d4005090 0x7f18d400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e5d9b640 1 -- 172.21.15.67:0/214582177 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d4003530 con 0x7f18d40043c0 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e659c640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d40039c0 0x7f18d4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e6d9d640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d4005090 0x7f18d400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:55.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e6d9d640 1 -- 172.21.15.67:0/214582177 reap_dead start 2024-09-19T05:33:55.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e5d9b640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18d40043c0 0x7f18d4004890 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f18d000a7c0 tx=0x7f18d001d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7611c851baa79f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:55.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d000a410 con 0x7f18d40043c0 2024-09-19T05:33:55.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d00ad650 con 0x7f18d40043c0 2024-09-19T05:33:55.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18e559a640 1 -- 172.21.15.67:0/214582177 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d00ada80 con 0x7f18d40043c0 2024-09-19T05:33:55.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18ecf51640 1 -- 172.21.15.67:0/214582177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18d40043c0 msgr2=0x7f18d4004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18ecf51640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18d40043c0 0x7f18d4004890 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f18d000a7c0 tx=0x7f18d001d2a0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18ecf51640 1 -- 172.21.15.67:0/214582177 shutdown_connections 2024-09-19T05:33:55.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18ecf51640 1 --2- 172.21.15.67:0/214582177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18d40043c0 0x7f18d4004890 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18ecf51640 1 -- 172.21.15.67:0/214582177 >> 172.21.15.67:0/214582177 conn(0x7f18e808bfc0 msgr2=0x7f18e80d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:55.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18ecf51640 1 -- 172.21.15.67:0/214582177 shutdown_connections 2024-09-19T05:33:55.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.317+0000 7f18ecf51640 1 -- 172.21.15.67:0/214582177 wait complete. 2024-09-19T05:33:55.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 Processor -- start 2024-09-19T05:33:55.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 -- start start 2024-09-19T05:33:55.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d40043c0 0x7f18e814e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18e815da40 0x7f18e8151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e814df90 0x7f18e80d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f18e8162180 con 0x7f18e814df90 2024-09-19T05:33:55.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f18e80b5d00 con 0x7f18d40043c0 2024-09-19T05:33:55.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f18e80d1af0 con 0x7f18e815da40 2024-09-19T05:33:55.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e814df90 0x7f18e80d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e814df90 0x7f18e80d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58998/0 (socket says 172.21.15.67:58998) 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e6d9d640 1 -- 172.21.15.67:0/2601397361 learned_addr learned my addr 172.21.15.67:0/2601397361 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e659c640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d40043c0 0x7f18e814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e5d9b640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18e815da40 0x7f18e8151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e6d9d640 1 -- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18e815da40 msgr2=0x7f18e8151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e6d9d640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18e815da40 0x7f18e8151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e6d9d640 1 -- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d40043c0 msgr2=0x7f18e814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e6d9d640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d40043c0 0x7f18e814e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e6d9d640 1 -- 172.21.15.67:0/2601397361 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e81518c0 con 0x7f18e814df90 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e5d9b640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18e815da40 0x7f18e8151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18e6d9d640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e814df90 0x7f18e80d2ea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f18e80c7f90 tx=0x7f18d8011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18deffd640 1 -- 172.21.15.67:0/2601397361 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8004230 con 0x7f18e814df90 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18deffd640 1 -- 172.21.15.67:0/2601397361 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d80043f0 con 0x7f18e814df90 2024-09-19T05:33:55.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 -- 172.21.15.67:0/2601397361 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e80b9d60 con 0x7f18e814df90 2024-09-19T05:33:55.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18deffd640 1 -- 172.21.15.67:0/2601397361 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8015970 con 0x7f18e814df90 2024-09-19T05:33:55.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 -- 172.21.15.67:0/2601397361 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e80c9bd0 con 0x7f18e814df90 2024-09-19T05:33:55.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18ecf51640 1 -- 172.21.15.67:0/2601397361 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e80d0e80 con 0x7f18e814df90 2024-09-19T05:33:55.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.321+0000 7f18deffd640 1 -- 172.21.15.67:0/2601397361 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f18d8015b10 con 0x7f18e814df90 2024-09-19T05:33:55.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.325+0000 7f18deffd640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18c80678f0 0x7f18c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.325+0000 7f18deffd640 1 -- 172.21.15.67:0/2601397361 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f18d8086100 con 0x7f18e814df90 2024-09-19T05:33:55.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.325+0000 7f18e659c640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18c80678f0 0x7f18c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.325+0000 7f18e659c640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18c80678f0 0x7f18c8069db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f18e0005630 tx=0x7f18e0007180 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:55.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.329+0000 7f18deffd640 1 -- 172.21.15.67:0/2601397361 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f18d8019020 con 0x7f18e814df90 2024-09-19T05:33:55.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.525+0000 7f18ecf51640 1 -- 172.21.15.67:0/2601397361 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18e806ec10 con 0x7f18e814df90 2024-09-19T05:33:55.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18deffd640 1 -- 172.21.15.67:0/2601397361 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7f18d80561f0 con 0x7f18e814df90 2024-09-19T05:33:55.533 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:55.533 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"btime":"2024-09-19T05:33:28:174068+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:33:13.876770+0000","modified":"2024-09-19T05:33:27.556615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-19T05:33:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-09-19T05:33:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 -- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18c80678f0 msgr2=0x7f18c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18c80678f0 0x7f18c8069db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f18e0005630 tx=0x7f18e0007180 comp rx=0 tx=0).stop 2024-09-19T05:33:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 -- 172.21.15.67:0/2601397361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e814df90 msgr2=0x7f18e80d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e814df90 0x7f18e80d2ea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f18e80c7f90 tx=0x7f18d8011920 comp rx=0 tx=0).stop 2024-09-19T05:33:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 -- 172.21.15.67:0/2601397361 shutdown_connections 2024-09-19T05:33:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e814df90 0x7f18e80d2ea0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18c80678f0 0x7f18c8069db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18e815da40 0x7f18e8151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 --2- 172.21.15.67:0/2601397361 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d40043c0 0x7f18e814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 -- 172.21.15.67:0/2601397361 >> 172.21.15.67:0/2601397361 conn(0x7f18e808bfc0 msgr2=0x7f18e80cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 -- 172.21.15.67:0/2601397361 shutdown_connections 2024-09-19T05:33:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.529+0000 7f18ecf51640 1 -- 172.21.15.67:0/2601397361 wait complete. 2024-09-19T05:33:55.552 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:33:55.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b765c640 1 Processor -- start 2024-09-19T05:33:55.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b765c640 1 -- start start 2024-09-19T05:33:55.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b765c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b1990 0x7fb0b00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b765c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb0b006c3d0 0x7fb0b015fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b765c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b00b1d70 con 0x7fb0b00b27e0 2024-09-19T05:33:55.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b765c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b015f950 con 0x7fb0b006c3d0 2024-09-19T05:33:55.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b765c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b00b2d60 con 0x7fb0b00b1990 2024-09-19T05:33:55.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b53f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b1990 0x7fb0b00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b5bf9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb0b006c3d0 0x7fb0b015fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b53f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b1990 0x7fb0b00b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:52528/0 (socket says 172.21.15.67:52528) 2024-09-19T05:33:55.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b53f8640 1 -- 172.21.15.67:0/2159547894 learned_addr learned my addr 172.21.15.67:0/2159547894 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:55.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b5bf9640 1 -- 172.21.15.67:0/2159547894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b1990 msgr2=0x7fb0b00b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:55.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b5bf9640 1 --2- 172.21.15.67:0/2159547894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b1990 0x7fb0b00b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b5bf9640 1 -- 172.21.15.67:0/2159547894 >> v1:172.21.15.97:6789/0 conn(0x7fb0b00b27e0 legacy=0x7fb0b006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.669+0000 7fb0b5bf9640 1 -- 172.21.15.67:0/2159547894 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b015eb90 con 0x7fb0b006c3d0 2024-09-19T05:33:55.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0b5bf9640 1 --2- 172.21.15.67:0/2159547894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b006c3d0 0x7fb0b015fb00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009d90 tx=0x7fb0a801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a8af31c8693a1ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:55.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0a7fff640 1 -- 172.21.15.67:0/2159547894 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80b2070 con 0x7fb0b006c3d0 2024-09-19T05:33:55.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0a7fff640 1 -- 172.21.15.67:0/2159547894 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a80a5a00 con 0x7fb0b006c3d0 2024-09-19T05:33:55.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0a7fff640 1 -- 172.21.15.67:0/2159547894 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80a5dd0 con 0x7fb0b006c3d0 2024-09-19T05:33:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0b765c640 1 -- 172.21.15.67:0/2159547894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b006c3d0 msgr2=0x7fb0b015fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0b765c640 1 --2- 172.21.15.67:0/2159547894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b006c3d0 0x7fb0b015fb00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009d90 tx=0x7fb0a801c940 comp rx=0 tx=0).stop 2024-09-19T05:33:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0b765c640 1 -- 172.21.15.67:0/2159547894 shutdown_connections 2024-09-19T05:33:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0b765c640 1 --2- 172.21.15.67:0/2159547894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b006c3d0 0x7fb0b015fb00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0b765c640 1 --2- 172.21.15.67:0/2159547894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b1990 0x7fb0b00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0b765c640 1 -- 172.21.15.67:0/2159547894 >> 172.21.15.67:0/2159547894 conn(0x7fb0b009aa30 msgr2=0x7fb0b00b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0b765c640 1 -- 172.21.15.67:0/2159547894 shutdown_connections 2024-09-19T05:33:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0b765c640 1 -- 172.21.15.67:0/2159547894 wait complete. 2024-09-19T05:33:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.673+0000 7fb0b765c640 1 Processor -- start 2024-09-19T05:33:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b765c640 1 -- start start 2024-09-19T05:33:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b765c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b006c3d0 0x7fb0b009c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b765c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b00b1990 0x7fb0b0151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b765c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b27e0 0x7fb0b0151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b765c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b0160850 con 0x7fb0b00b27e0 2024-09-19T05:33:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b765c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b00b4470 con 0x7fb0b00b1990 2024-09-19T05:33:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b765c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b01609d0 con 0x7fb0b006c3d0 2024-09-19T05:33:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b5bf9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b27e0 0x7fb0b0151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b5bf9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b27e0 0x7fb0b0151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59004/0 (socket says 172.21.15.67:59004) 2024-09-19T05:33:55.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b5bf9640 1 -- 172.21.15.67:0/1948617292 learned_addr learned my addr 172.21.15.67:0/1948617292 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:55.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b53f8640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b006c3d0 0x7fb0b009c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b4bf7640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b00b1990 0x7fb0b0151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b5bf9640 1 -- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b006c3d0 msgr2=0x7fb0b009c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b5bf9640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b006c3d0 0x7fb0b009c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b5bf9640 1 -- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b00b1990 msgr2=0x7fb0b0151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b5bf9640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b00b1990 0x7fb0b0151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b5bf9640 1 -- 172.21.15.67:0/1948617292 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b01544c0 con 0x7fb0b00b27e0 2024-09-19T05:33:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b5bf9640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b27e0 0x7fb0b0151a40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0a801a570 tx=0x7fb0a80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0a5ffb640 1 -- 172.21.15.67:0/1948617292 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80b2050 con 0x7fb0b00b27e0 2024-09-19T05:33:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b765c640 1 -- 172.21.15.67:0/1948617292 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b01547a0 con 0x7fb0b00b27e0 2024-09-19T05:33:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0a5ffb640 1 -- 172.21.15.67:0/1948617292 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a80be070 con 0x7fb0b00b27e0 2024-09-19T05:33:55.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0a5ffb640 1 -- 172.21.15.67:0/1948617292 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80adb10 con 0x7fb0b00b27e0 2024-09-19T05:33:55.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b765c640 1 -- 172.21.15.67:0/1948617292 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b0154d60 con 0x7fb0b00b27e0 2024-09-19T05:33:55.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0b765c640 1 -- 172.21.15.67:0/1948617292 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b015fb00 con 0x7fb0b00b27e0 2024-09-19T05:33:55.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.677+0000 7fb0a5ffb640 1 -- 172.21.15.67:0/1948617292 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0a80adcb0 con 0x7fb0b00b27e0 2024-09-19T05:33:55.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.681+0000 7fb0a5ffb640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0940678c0 0x7fb094069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:55.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.681+0000 7fb0a5ffb640 1 -- 172.21.15.67:0/1948617292 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb0a8121e10 con 0x7fb0b00b27e0 2024-09-19T05:33:55.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.681+0000 7fb0b53f8640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0940678c0 0x7fb094069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:55.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.681+0000 7fb0b53f8640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0940678c0 0x7fb094069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb0b015e220 tx=0x7fb0ac009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:55.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.685+0000 7fb0a5ffb640 1 -- 172.21.15.67:0/1948617292 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb0a8016560 con 0x7fb0b00b27e0 2024-09-19T05:33:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.881+0000 7fb0b765c640 1 -- 172.21.15.67:0/1948617292 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0b01534a0 con 0x7fb0b00b27e0 2024-09-19T05:33:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.881+0000 7fb0a5ffb640 1 -- 172.21.15.67:0/1948617292 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7fb0a80f1f00 con 0x7fb0b00b27e0 2024-09-19T05:33:55.886 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:55.886 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"btime":"2024-09-19T05:33:28:174068+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2856251148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2856251148},{"type":"v1","addr":"172.21.15.97:6835","nonce":2856251148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/404060918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":404060918},{"type":"v1","addr":"172.21.15.97:6837","nonce":404060918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2150700577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2150700577},{"type":"v1","addr":"172.21.15.67:6833","nonce":2150700577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:33:13.876770+0000","modified":"2024-09-19T05:33:27.556615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3064059806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3064059806},{"type":"v1","addr":"172.21.15.67:6835","nonce":3064059806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-19T05:33:55.886 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-09-19T05:33:55.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.881+0000 7fb0b765c640 1 -- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0940678c0 msgr2=0x7fb094069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.881+0000 7fb0b765c640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0940678c0 0x7fb094069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb0b015e220 tx=0x7fb0ac009240 comp rx=0 tx=0).stop 2024-09-19T05:33:55.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.881+0000 7fb0b765c640 1 -- 172.21.15.67:0/1948617292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b27e0 msgr2=0x7fb0b0151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:55.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.881+0000 7fb0b765c640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b27e0 0x7fb0b0151a40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0a801a570 tx=0x7fb0a80196e0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.885+0000 7fb0b765c640 1 -- 172.21.15.67:0/1948617292 shutdown_connections 2024-09-19T05:33:55.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.885+0000 7fb0b765c640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b27e0 0x7fb0b0151a40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.885+0000 7fb0b765c640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b00b1990 0x7fb0b0151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.885+0000 7fb0b765c640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0940678c0 0x7fb094069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.885+0000 7fb0b765c640 1 --2- 172.21.15.67:0/1948617292 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b006c3d0 0x7fb0b009c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:55.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.885+0000 7fb0b765c640 1 -- 172.21.15.67:0/1948617292 >> 172.21.15.67:0/1948617292 conn(0x7fb0b009aa30 msgr2=0x7fb0b0161d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:55.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.885+0000 7fb0b765c640 1 -- 172.21.15.67:0/1948617292 shutdown_connections 2024-09-19T05:33:55.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:55.885+0000 7fb0b765c640 1 -- 172.21.15.67:0/1948617292 wait complete. 2024-09-19T05:33:55.905 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:33:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f654c96a640 1 Processor -- start 2024-09-19T05:33:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f654c96a640 1 -- start start 2024-09-19T05:33:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f654c96a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65480cf070 0x7f654815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f654c96a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f654815ef30 0x7f65480d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f654c96a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65480cf510 con 0x7f654815e610 2024-09-19T05:33:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f654c96a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f65480d0120 con 0x7f654815ef30 2024-09-19T05:33:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f654c96a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f65480cf7f0 con 0x7f65480cf070 2024-09-19T05:33:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f6546d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f654815ef30 0x7f65480d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f654659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f654815e610 0x7f6548162a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46732/0 (socket says 172.21.15.67:46732) 2024-09-19T05:33:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f654659c640 1 -- 172.21.15.67:0/3799218459 learned_addr learned my addr 172.21.15.67:0/3799218459 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f653dd9b640 1 --2- 172.21.15.67:0/3799218459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65480cf070 0x7f654815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f6546d9d640 1 -- 172.21.15.67:0/3799218459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65480cf070 msgr2=0x7f654815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f6546d9d640 1 --2- 172.21.15.67:0/3799218459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65480cf070 0x7f654815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f6546d9d640 1 -- 172.21.15.67:0/3799218459 >> v1:172.21.15.67:6789/0 conn(0x7f654815e610 legacy=0x7f6548162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f6545d9b640 1 -- 172.21.15.67:0/3799218459 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371907467 0 0) 0x7f65480cf510 con 0x7f654815e610 2024-09-19T05:33:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f6546d9d640 1 -- 172.21.15.67:0/3799218459 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65480cfad0 con 0x7f654815ef30 2024-09-19T05:33:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.021+0000 7f653dd9b640 1 --2- 172.21.15.67:0/3799218459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65480cf070 0x7f654815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f6546d9d640 1 --2- 172.21.15.67:0/3799218459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654815ef30 0x7f65480d2070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6540009d90 tx=0x7f654001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8169404dc4568f30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f6545d9b640 1 -- 172.21.15.67:0/3799218459 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65400b2070 con 0x7f654815ef30 2024-09-19T05:33:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f6545d9b640 1 -- 172.21.15.67:0/3799218459 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65400a59c0 con 0x7f654815ef30 2024-09-19T05:33:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f6545d9b640 1 -- 172.21.15.67:0/3799218459 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65400a5d90 con 0x7f654815ef30 2024-09-19T05:33:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- 172.21.15.67:0/3799218459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654815ef30 msgr2=0x7f65480d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 --2- 172.21.15.67:0/3799218459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654815ef30 0x7f65480d2070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6540009d90 tx=0x7f654001c940 comp rx=0 tx=0).stop 2024-09-19T05:33:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- 172.21.15.67:0/3799218459 shutdown_connections 2024-09-19T05:33:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 --2- 172.21.15.67:0/3799218459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654815ef30 0x7f65480d2070 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 --2- 172.21.15.67:0/3799218459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65480cf070 0x7f654815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- 172.21.15.67:0/3799218459 >> 172.21.15.67:0/3799218459 conn(0x7f654808bfc0 msgr2=0x7f65480d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- 172.21.15.67:0/3799218459 shutdown_connections 2024-09-19T05:33:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- 172.21.15.67:0/3799218459 wait complete. 2024-09-19T05:33:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 Processor -- start 2024-09-19T05:33:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- start start 2024-09-19T05:33:56.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65480cf070 0x7f65481f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f654815e610 0x7f65480c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f654815ef30 0x7f65480b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f65480d2f40 con 0x7f65480cf070 2024-09-19T05:33:56.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f65480d2dc0 con 0x7f654815ef30 2024-09-19T05:33:56.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f65480d30c0 con 0x7f654815e610 2024-09-19T05:33:56.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65480cf070 0x7f65481f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65480cf070 0x7f65481f7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46236/0 (socket says 172.21.15.67:46236) 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654659c640 1 -- 172.21.15.67:0/3773493967 learned_addr learned my addr 172.21.15.67:0/3773493967 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654659c640 1 -- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f654815e610 msgr2=0x7f65480c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f6546d9d640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f654815ef30 0x7f65480b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654659c640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f654815e610 0x7f65480c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654659c640 1 -- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f654815ef30 msgr2=0x7f65480b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654659c640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f654815ef30 0x7f65480b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654659c640 1 -- 172.21.15.67:0/3773493967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65480cb0f0 con 0x7f65480cf070 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654659c640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65480cf070 0x7f65481f7180 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f65380011f0 tx=0x7f653800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f653f7fe640 1 -- 172.21.15.67:0/3773493967 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538018070 con 0x7f65480cf070 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f653f7fe640 1 -- 172.21.15.67:0/3773493967 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65380074e0 con 0x7f65480cf070 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- 172.21.15.67:0/3773493967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65480b8a20 con 0x7f65480cf070 2024-09-19T05:33:56.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f653f7fe640 1 -- 172.21.15.67:0/3773493967 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538004a10 con 0x7f65480cf070 2024-09-19T05:33:56.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.025+0000 7f654c96a640 1 -- 172.21.15.67:0/3773493967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65481f76c0 con 0x7f65480cf070 2024-09-19T05:33:56.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.029+0000 7f654c96a640 1 -- 172.21.15.67:0/3773493967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f654815e9f0 con 0x7f65480cf070 2024-09-19T05:33:56.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.029+0000 7f653f7fe640 1 -- 172.21.15.67:0/3773493967 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f653801b070 con 0x7f65480cf070 2024-09-19T05:33:56.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.029+0000 7f653f7fe640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65280678c0 0x7f6528069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.029+0000 7f653f7fe640 1 -- 172.21.15.67:0/3773493967 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f65380854c0 con 0x7f65480cf070 2024-09-19T05:33:56.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.029+0000 7f653dd9b640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65280678c0 0x7f6528069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.029+0000 7f653dd9b640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65280678c0 0x7f6528069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f65480b4250 tx=0x7f6530008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:56.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.033+0000 7f653f7fe640 1 -- 172.21.15.67:0/3773493967 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6538055b60 con 0x7f65480cf070 2024-09-19T05:33:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.197+0000 7f654c96a640 1 -- 172.21.15.67:0/3773493967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65480cec70 con 0x7f65480cf070 2024-09-19T05:33:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f653f7fe640 1 -- 172.21.15.67:0/3773493967 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18952 (secure 0 0 0) 0x7f6538055460 con 0x7f65480cf070 2024-09-19T05:33:56.204 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:33:56.204 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":26,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:33:55.281037+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:33:11.695580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:33:12.872293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:33:16.589603+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:33:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 -- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65280678c0 msgr2=0x7f6528069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65280678c0 0x7f6528069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f65480b4250 tx=0x7f6530008040 comp rx=0 tx=0).stop 2024-09-19T05:33:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 -- 172.21.15.67:0/3773493967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65480cf070 msgr2=0x7f65481f7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65480cf070 0x7f65481f7180 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f65380011f0 tx=0x7f653800c9b0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 -- 172.21.15.67:0/3773493967 shutdown_connections 2024-09-19T05:33:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f654815ef30 0x7f65480b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65280678c0 0x7f6528069d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f654815e610 0x7f65480c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 --2- 172.21.15.67:0/3773493967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65480cf070 0x7f65481f7180 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 -- 172.21.15.67:0/3773493967 >> 172.21.15.67:0/3773493967 conn(0x7f654808bfc0 msgr2=0x7f6548160520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 -- 172.21.15.67:0/3773493967 shutdown_connections 2024-09-19T05:33:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.201+0000 7f654c96a640 1 -- 172.21.15.67:0/3773493967 wait complete. 2024-09-19T05:33:56.223 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:33:56.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb6813d5640 1 Processor -- start 2024-09-19T05:33:56.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb6813d5640 1 -- start start 2024-09-19T05:33:56.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb6813d5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb67c15b1e0 0x7fb67c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb6813d5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb67c072590 0x7fb67c0ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb6813d5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c0b3860 con 0x7fb67c0b4900 2024-09-19T05:33:56.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb6813d5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb67c15b5c0 con 0x7fb67c15b1e0 2024-09-19T05:33:56.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb6813d5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb67c0b3b40 con 0x7fb67c072590 2024-09-19T05:33:56.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb67affd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb67c15b1e0 0x7fb67c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb67a7fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb67c0b4900 0x7fb67c071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46744/0 (socket says 172.21.15.67:46744) 2024-09-19T05:33:56.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb67a7fc640 1 -- 172.21.15.67:0/1428890120 learned_addr learned my addr 172.21.15.67:0/1428890120 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:56.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb679ffb640 1 -- 172.21.15.67:0/1428890120 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365817509 0 0) 0x7fb67c0b3860 con 0x7fb67c0b4900 2024-09-19T05:33:56.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb67b7fe640 1 --2- 172.21.15.67:0/1428890120 >> v2:172.21.15.97:3300/0 conn(0x7fb67c072590 0x7fb67c0ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb679ffb640 1 -- 172.21.15.67:0/1428890120 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb668005740 con 0x7fb67c0b4900 2024-09-19T05:33:56.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb67affd640 1 -- 172.21.15.67:0/1428890120 >> v2:172.21.15.97:3300/0 conn(0x7fb67c072590 msgr2=0x7fb67c0ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:56.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb67affd640 1 --2- 172.21.15.67:0/1428890120 >> v2:172.21.15.97:3300/0 conn(0x7fb67c072590 0x7fb67c0ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb67affd640 1 -- 172.21.15.67:0/1428890120 >> v1:172.21.15.67:6789/0 conn(0x7fb67c0b4900 legacy=0x7fb67c071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb679ffb640 1 -- 172.21.15.67:0/1428890120 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 776748501 0 0) 0x7fb668005740 con 0x7fb67c0b4900 2024-09-19T05:33:56.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.341+0000 7fb67affd640 1 -- 172.21.15.67:0/1428890120 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c0b3e20 con 0x7fb67c15b1e0 2024-09-19T05:33:56.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67affd640 1 --2- 172.21.15.67:0/1428890120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 0x7fb67c0b2fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0ad040 tx=0x7fb66401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be33efad8eac2297 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:56.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb679ffb640 1 -- 172.21.15.67:0/1428890120 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6640b0070 con 0x7fb67c15b1e0 2024-09-19T05:33:56.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb679ffb640 1 -- 172.21.15.67:0/1428890120 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6640ab400 con 0x7fb67c15b1e0 2024-09-19T05:33:56.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb679ffb640 1 -- 172.21.15.67:0/1428890120 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c001680 con 0x7fb67c15b1e0 2024-09-19T05:33:56.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 -- 172.21.15.67:0/1428890120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 msgr2=0x7fb67c0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 --2- 172.21.15.67:0/1428890120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 0x7fb67c0b2fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0ad040 tx=0x7fb66401c370 comp rx=0 tx=0).stop 2024-09-19T05:33:56.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 -- 172.21.15.67:0/1428890120 shutdown_connections 2024-09-19T05:33:56.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 --2- 172.21.15.67:0/1428890120 >> v2:172.21.15.97:3300/0 conn(0x7fb67c072590 0x7fb67c0ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 --2- 172.21.15.67:0/1428890120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 0x7fb67c0b2fd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 -- 172.21.15.67:0/1428890120 >> 172.21.15.67:0/1428890120 conn(0x7fb67c0d0080 msgr2=0x7fb67c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:56.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 -- 172.21.15.67:0/1428890120 shutdown_connections 2024-09-19T05:33:56.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 -- 172.21.15.67:0/1428890120 wait complete. 2024-09-19T05:33:56.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 Processor -- start 2024-09-19T05:33:56.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 -- start start 2024-09-19T05:33:56.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb67c072590 0x7fb67c099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb67c0b4900 0x7fb67c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 0x7fb67c15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c06e7f0 con 0x7fb67c15b1e0 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c06e670 con 0x7fb67c0b4900 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb6813d5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb67c06e970 con 0x7fb67c072590 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 0x7fb67c15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 0x7fb67c15d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46242/0 (socket says 172.21.15.67:46242) 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67b7fe640 1 -- 172.21.15.67:0/3754433579 learned_addr learned my addr 172.21.15.67:0/3754433579 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67a7fc640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb67c0b4900 0x7fb67c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67affd640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb67c072590 0x7fb67c099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67b7fe640 1 -- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb67c072590 msgr2=0x7fb67c099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67b7fe640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb67c072590 0x7fb67c099900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67b7fe640 1 -- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb67c0b4900 msgr2=0x7fb67c15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67b7fe640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb67c0b4900 0x7fb67c15cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67b7fe640 1 -- 172.21.15.67:0/3754433579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c14cac0 con 0x7fb67c15b1e0 2024-09-19T05:33:56.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.345+0000 7fb67a7fc640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb67c0b4900 0x7fb67c15cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:56.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb67b7fe640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 0x7fb67c15d0c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb674007e70 tx=0x7fb67400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:56.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb6737fe640 1 -- 172.21.15.67:0/3754433579 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674014620 con 0x7fb67c15b1e0 2024-09-19T05:33:56.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb6737fe640 1 -- 172.21.15.67:0/3754433579 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb674019070 con 0x7fb67c15b1e0 2024-09-19T05:33:56.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb6813d5640 1 -- 172.21.15.67:0/3754433579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67c14cda0 con 0x7fb67c15b1e0 2024-09-19T05:33:56.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb6737fe640 1 -- 172.21.15.67:0/3754433579 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674014a20 con 0x7fb67c15b1e0 2024-09-19T05:33:56.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb6813d5640 1 -- 172.21.15.67:0/3754433579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67c14d360 con 0x7fb67c15b1e0 2024-09-19T05:33:56.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb6813d5640 1 -- 172.21.15.67:0/3754433579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67c0ade10 con 0x7fb67c15b1e0 2024-09-19T05:33:56.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb6737fe640 1 -- 172.21.15.67:0/3754433579 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb674014bc0 con 0x7fb67c15b1e0 2024-09-19T05:33:56.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb6737fe640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb65c0678c0 0x7fb65c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb6737fe640 1 -- 172.21.15.67:0/3754433579 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb674086aa0 con 0x7fb67c15b1e0 2024-09-19T05:33:56.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb67affd640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb65c0678c0 0x7fb65c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.349+0000 7fb67affd640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb65c0678c0 0x7fb65c069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb6640ad000 tx=0x7fb664008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:56.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.353+0000 7fb6737fe640 1 -- 172.21.15.67:0/3754433579 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb674011260 con 0x7fb67c15b1e0 2024-09-19T05:33:56.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.553+0000 7fb6813d5640 1 -- 172.21.15.67:0/3754433579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb67c14e900 con 0x7fb67c15b1e0 2024-09-19T05:33:56.557 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:33:56.553+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:33:56.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6737fe640 1 -- 172.21.15.67:0/3754433579 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fb674057150 con 0x7fb67c15b1e0 2024-09-19T05:33:56.560 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:33:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 -- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb65c0678c0 msgr2=0x7fb65c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb65c0678c0 0x7fb65c069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb6640ad000 tx=0x7fb664008040 comp rx=0 tx=0).stop 2024-09-19T05:33:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 -- 172.21.15.67:0/3754433579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 msgr2=0x7fb67c15d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 0x7fb67c15d0c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb674007e70 tx=0x7fb67400e4b0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 -- 172.21.15.67:0/3754433579 shutdown_connections 2024-09-19T05:33:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb67c15b1e0 0x7fb67c15d0c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb67c0b4900 0x7fb67c15cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb65c0678c0 0x7fb65c069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 --2- 172.21.15.67:0/3754433579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb67c072590 0x7fb67c099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 -- 172.21.15.67:0/3754433579 >> 172.21.15.67:0/3754433579 conn(0x7fb67c0d0080 msgr2=0x7fb67c06ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 -- 172.21.15.67:0/3754433579 shutdown_connections 2024-09-19T05:33:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.557+0000 7fb6813d5640 1 -- 172.21.15.67:0/3754433579 wait complete. 2024-09-19T05:33:56.567 INFO:tasks.ceph.mds.a.smithi067.stderr: -3529> 2024-09-19T05:33:15.475+0000 7f24d713a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:33:56.580 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:33:56.606 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:33:56.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.693+0000 7fd5ad0a8640 1 Processor -- start 2024-09-19T05:33:56.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.693+0000 7fd5ad0a8640 1 -- start start 2024-09-19T05:33:56.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.693+0000 7fd5ad0a8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5a80d4fb0 0x7fd5a80d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.693+0000 7fd5ad0a8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a80d35a0 con 0x7fd5a815e690 2024-09-19T05:33:56.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.693+0000 7fd5ad0a8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a80d32c0 con 0x7fd5a80d13c0 2024-09-19T05:33:56.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.693+0000 7fd5ad0a8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd5a80d17f0 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.693+0000 7fd5a6d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd5a815e690 0x7fd5a80d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46754/0 (socket says 172.21.15.67:46754) 2024-09-19T05:33:56.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.693+0000 7fd5a6d9d640 1 -- 172.21.15.67:0/2549311295 learned_addr learned my addr 172.21.15.67:0/2549311295 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:56.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.693+0000 7fd5a659c640 1 --2- 172.21.15.67:0/2549311295 >> v2:172.21.15.67:3300/0 conn(0x7fd5a80d4fb0 0x7fd5a80d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.697+0000 7fd5a659c640 1 -- 172.21.15.67:0/2549311295 >> v1:172.21.15.97:6789/0 conn(0x7fd5a80d13c0 legacy=0x7fd5a806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.697+0000 7fd5a659c640 1 -- 172.21.15.67:0/2549311295 >> v1:172.21.15.67:6789/0 conn(0x7fd5a815e690 legacy=0x7fd5a80d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.697+0000 7fd5a659c640 1 -- 172.21.15.67:0/2549311295 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a806d040 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.697+0000 7fd5a5d9b640 1 -- 172.21.15.67:0/2549311295 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 27775143 0 0) 0x7fd5a80d35a0 con 0x7fd5a815e690 2024-09-19T05:33:56.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a659c640 1 --2- 172.21.15.67:0/2549311295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 0x7fd5a80d0e80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0097c0 tx=0x7fd59c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a7211b1c4225c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:56.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a5d9b640 1 -- 172.21.15.67:0/2549311295 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0a7070 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a5d9b640 1 -- 172.21.15.67:0/2549311295 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59c0b0070 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a5d9b640 1 -- 172.21.15.67:0/2549311295 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0ab890 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/2549311295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 msgr2=0x7fd5a80d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 --2- 172.21.15.67:0/2549311295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 0x7fd5a80d0e80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0097c0 tx=0x7fd59c01c470 comp rx=0 tx=0).stop 2024-09-19T05:33:56.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/2549311295 shutdown_connections 2024-09-19T05:33:56.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 --2- 172.21.15.67:0/2549311295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 0x7fd5a80d0e80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/2549311295 >> 172.21.15.67:0/2549311295 conn(0x7fd5a80d4490 msgr2=0x7fd5a80d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:56.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/2549311295 shutdown_connections 2024-09-19T05:33:56.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/2549311295 wait complete. 2024-09-19T05:33:56.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 Processor -- start 2024-09-19T05:33:56.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 -- start start 2024-09-19T05:33:56.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5a80d13c0 0x7fd5a815d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 0x7fd5a815af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5a815e690 0x7fd5a8153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a806ebc0 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a806ea40 con 0x7fd5a80d13c0 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5ad0a8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a816c260 con 0x7fd5a815e690 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 0x7fd5a815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 0x7fd5a815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46256/0 (socket says 172.21.15.67:46256) 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a659c640 1 -- 172.21.15.67:0/1035190724 learned_addr learned my addr 172.21.15.67:0/1035190724 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a6d9d640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5a80d13c0 0x7fd5a815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a659c640 1 -- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5a815e690 msgr2=0x7fd5a8153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a659c640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5a815e690 0x7fd5a8153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a659c640 1 -- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5a80d13c0 msgr2=0x7fd5a815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a659c640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5a80d13c0 0x7fd5a815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:56.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a659c640 1 -- 172.21.15.67:0/1035190724 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a815b670 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.701+0000 7fd5a6d9d640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5a80d13c0 0x7fd5a815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:56.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd5a659c640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 0x7fd5a815af00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0ad040 tx=0x7fd59c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:56.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd58f7fe640 1 -- 172.21.15.67:0/1035190724 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c004230 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd58f7fe640 1 -- 172.21.15.67:0/1035190724 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59c0043d0 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/1035190724 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a80c8450 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd58f7fe640 1 -- 172.21.15.67:0/1035190724 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c003820 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/1035190724 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a80c8a10 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/1035190724 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a80d0e80 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd58f7fe640 1 -- 172.21.15.67:0/1035190724 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd59c0039c0 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd58f7fe640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5940678c0 0x7fd594069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:56.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd58f7fe640 1 -- 172.21.15.67:0/1035190724 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fd59c120db0 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd5a6d9d640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5940678c0 0x7fd594069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:56.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.705+0000 7fd5a6d9d640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5940678c0 0x7fd594069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd598007fd0 tx=0x7fd598009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:56.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.709+0000 7fd58f7fe640 1 -- 172.21.15.67:0/1035190724 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd59c016090 con 0x7fd5a80d4fb0 2024-09-19T05:33:56.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:56.913+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/1035190724 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd5a80d4910 con 0x7fd5a80d4fb0 2024-09-19T05:33:57.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.557+0000 7fd58f7fe640 1 -- 172.21.15.67:0/1035190724 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fd59c0f1490 con 0x7fd5a80d4fb0 2024-09-19T05:33:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5940678c0 msgr2=0x7fd594069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5940678c0 0x7fd594069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd598007fd0 tx=0x7fd598009040 comp rx=0 tx=0).stop 2024-09-19T05:33:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/1035190724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 msgr2=0x7fd5a815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 0x7fd5a815af00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0ad040 tx=0x7fd59c01acb0 comp rx=0 tx=0).stop 2024-09-19T05:33:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/1035190724 shutdown_connections 2024-09-19T05:33:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5940678c0 0x7fd594069d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5a815e690 0x7fd5a8153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5a80d4fb0 0x7fd5a815af00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 --2- 172.21.15.67:0/1035190724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5a80d13c0 0x7fd5a815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/1035190724 >> 172.21.15.67:0/1035190724 conn(0x7fd5a80d4490 msgr2=0x7fd5a80b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/1035190724 shutdown_connections 2024-09-19T05:33:57.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.561+0000 7fd5ad0a8640 1 -- 172.21.15.67:0/1035190724 wait complete. 2024-09-19T05:33:57.589 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:33:57.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc1d3ac640 1 Processor -- start 2024-09-19T05:33:57.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc1d3ac640 1 -- start start 2024-09-19T05:33:57.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc1d3ac640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc181628f0 0x7fcc1806de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:57.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc1d3ac640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc180cc5c0 0x7fcc180d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:57.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc1d3ac640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc18072c20 con 0x7fcc180d0a60 2024-09-19T05:33:57.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc1d3ac640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fcc1806e3d0 con 0x7fcc180cc5c0 2024-09-19T05:33:57.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc1d3ac640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcc180d0eb0 con 0x7fcc181628f0 2024-09-19T05:33:57.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc177fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcc180d0a60 0x7fcc18166340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46762/0 (socket says 172.21.15.67:46762) 2024-09-19T05:33:57.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc177fe640 1 -- 172.21.15.67:0/3481629979 learned_addr learned my addr 172.21.15.67:0/3481629979 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:57.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc16ffd640 1 --2- 172.21.15.67:0/3481629979 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc181628f0 0x7fcc1806de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:57.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc167fc640 1 --2- 172.21.15.67:0/3481629979 >> v2:172.21.15.97:3300/0 conn(0x7fcc180cc5c0 0x7fcc180d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:57.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc15ffb640 1 -- 172.21.15.67:0/3481629979 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224744361 0 0) 0x7fcc18072c20 con 0x7fcc180d0a60 2024-09-19T05:33:57.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc15ffb640 1 -- 172.21.15.67:0/3481629979 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc04003530 con 0x7fcc180d0a60 2024-09-19T05:33:57.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc16ffd640 1 -- 172.21.15.67:0/3481629979 >> v2:172.21.15.97:3300/0 conn(0x7fcc180cc5c0 msgr2=0x7fcc180d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:57.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc16ffd640 1 --2- 172.21.15.67:0/3481629979 >> v2:172.21.15.97:3300/0 conn(0x7fcc180cc5c0 0x7fcc180d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:57.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc16ffd640 1 -- 172.21.15.67:0/3481629979 >> v1:172.21.15.67:6789/0 conn(0x7fcc180d0a60 legacy=0x7fcc18166340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:57.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.765+0000 7fcc16ffd640 1 -- 172.21.15.67:0/3481629979 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1806e600 con 0x7fcc181628f0 2024-09-19T05:33:57.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc16ffd640 1 --2- 172.21.15.67:0/3481629979 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc181628f0 0x7fcc1806de90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc080097c0 tx=0x7fcc0801c250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2aa6d8edb569ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:57.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc15ffb640 1 -- 172.21.15.67:0/3481629979 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc080b0070 con 0x7fcc181628f0 2024-09-19T05:33:57.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc15ffb640 1 -- 172.21.15.67:0/3481629979 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc080ab400 con 0x7fcc181628f0 2024-09-19T05:33:57.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc15ffb640 1 -- 172.21.15.67:0/3481629979 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10001a00 con 0x7fcc181628f0 2024-09-19T05:33:57.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3481629979 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc181628f0 msgr2=0x7fcc1806de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:57.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc1d3ac640 1 --2- 172.21.15.67:0/3481629979 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc181628f0 0x7fcc1806de90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc080097c0 tx=0x7fcc0801c250 comp rx=0 tx=0).stop 2024-09-19T05:33:57.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3481629979 shutdown_connections 2024-09-19T05:33:57.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc1d3ac640 1 --2- 172.21.15.67:0/3481629979 >> v2:172.21.15.97:3300/0 conn(0x7fcc180cc5c0 0x7fcc180d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:57.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc1d3ac640 1 --2- 172.21.15.67:0/3481629979 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc181628f0 0x7fcc1806de90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:57.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3481629979 >> 172.21.15.67:0/3481629979 conn(0x7fcc1806c0c0 msgr2=0x7fcc1806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:57.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3481629979 shutdown_connections 2024-09-19T05:33:57.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3481629979 wait complete. 2024-09-19T05:33:57.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc1d3ac640 1 Processor -- start 2024-09-19T05:33:57.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.769+0000 7fcc1d3ac640 1 -- start start 2024-09-19T05:33:57.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc1d3ac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc180cc5c0 0x7fcc18159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:57.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc1d3ac640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc180d0a60 0x7fcc18149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:57.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc1d3ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc181628f0 0x7fcc18162e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:57.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc1d3ac640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1816f610 con 0x7fcc181628f0 2024-09-19T05:33:57.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc1d3ac640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1816f490 con 0x7fcc180cc5c0 2024-09-19T05:33:57.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc1d3ac640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1816f790 con 0x7fcc180d0a60 2024-09-19T05:33:57.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc177fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc181628f0 0x7fcc18162e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:57.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc177fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc181628f0 0x7fcc18162e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46258/0 (socket says 172.21.15.67:46258) 2024-09-19T05:33:57.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc177fe640 1 -- 172.21.15.67:0/3773009627 learned_addr learned my addr 172.21.15.67:0/3773009627 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:57.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc16ffd640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc180cc5c0 0x7fcc18159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:57.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc167fc640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc180d0a60 0x7fcc18149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:57.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc177fe640 1 -- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc180d0a60 msgr2=0x7fcc18149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:57.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc177fe640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc180d0a60 0x7fcc18149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:57.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc177fe640 1 -- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc180cc5c0 msgr2=0x7fcc18159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:57.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc177fe640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc180cc5c0 0x7fcc18159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:57.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc177fe640 1 -- 172.21.15.67:0/3773009627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc18159c40 con 0x7fcc181628f0 2024-09-19T05:33:57.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc177fe640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc181628f0 0x7fcc18162e40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000cb60 tx=0x7fcc1000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:57.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc0f7fe640 1 -- 172.21.15.67:0/3773009627 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10018070 con 0x7fcc181628f0 2024-09-19T05:33:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc0f7fe640 1 -- 172.21.15.67:0/3773009627 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc10004d70 con 0x7fcc181628f0 2024-09-19T05:33:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc0f7fe640 1 -- 172.21.15.67:0/3773009627 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1000ace0 con 0x7fcc181628f0 2024-09-19T05:33:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3773009627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc18159f20 con 0x7fcc181628f0 2024-09-19T05:33:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3773009627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1815a4e0 con 0x7fcc181628f0 2024-09-19T05:33:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3773009627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc180d0520 con 0x7fcc181628f0 2024-09-19T05:33:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.773+0000 7fcc0f7fe640 1 -- 172.21.15.67:0/3773009627 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc100070d0 con 0x7fcc181628f0 2024-09-19T05:33:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.777+0000 7fcc0f7fe640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf80678c0 0x7fcbf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.777+0000 7fcc0f7fe640 1 -- 172.21.15.67:0/3773009627 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fcc10085b00 con 0x7fcc181628f0 2024-09-19T05:33:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.777+0000 7fcc16ffd640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf80678c0 0x7fcbf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:57.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.777+0000 7fcc16ffd640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf80678c0 0x7fcbf8069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcc080ad000 tx=0x7fcc080a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:57.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.781+0000 7fcc0f7fe640 1 -- 172.21.15.67:0/3773009627 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fcc100561d0 con 0x7fcc181628f0 2024-09-19T05:33:57.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:57.945+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3773009627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcc1806cdf0 con 0x7fcc181628f0 2024-09-19T05:33:58.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.565+0000 7fcc0f7fe640 1 -- 172.21.15.67:0/3773009627 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fcc10055ad0 con 0x7fcc181628f0 2024-09-19T05:33:58.571 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:33:58.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf80678c0 msgr2=0x7fcbf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf80678c0 0x7fcbf8069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcc080ad000 tx=0x7fcc080a6000 comp rx=0 tx=0).stop 2024-09-19T05:33:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3773009627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc181628f0 msgr2=0x7fcc18162e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc181628f0 0x7fcc18162e40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000cb60 tx=0x7fcc1000a430 comp rx=0 tx=0).stop 2024-09-19T05:33:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3773009627 shutdown_connections 2024-09-19T05:33:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc181628f0 0x7fcc18162e40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf80678c0 0x7fcbf8069d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc180d0a60 0x7fcc18149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 --2- 172.21.15.67:0/3773009627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc180cc5c0 0x7fcc18159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3773009627 >> 172.21.15.67:0/3773009627 conn(0x7fcc1806c0c0 msgr2=0x7fcc180b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3773009627 shutdown_connections 2024-09-19T05:33:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.569+0000 7fcc1d3ac640 1 -- 172.21.15.67:0/3773009627 wait complete. 2024-09-19T05:33:58.602 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:33:58.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.733+0000 7fa1026f0640 1 Processor -- start 2024-09-19T05:33:58.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.733+0000 7fa1026f0640 1 -- start start 2024-09-19T05:33:58.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.733+0000 7fa1026f0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 0x7fa0fc0d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:58.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.733+0000 7fa1026f0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0fc0cfe30 0x7fa0fc0d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:58.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.733+0000 7fa1026f0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0fc15ead0 con 0x7fa0fc0b5f70 2024-09-19T05:33:58.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.733+0000 7fa1026f0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa0fc0ceb40 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.733+0000 7fa1026f0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa0fc0ced90 con 0x7fa0fc15e6f0 2024-09-19T05:33:58.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.733+0000 7fa0f37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0fc0cfe30 0x7fa0fc0d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:58.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0f37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0fc0cfe30 0x7fa0fc0d35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46260/0 (socket says 172.21.15.67:46260) 2024-09-19T05:33:58.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0f37fe640 1 -- 172.21.15.67:0/2406688633 learned_addr learned my addr 172.21.15.67:0/2406688633 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:58.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0fbfff640 1 --2- 172.21.15.67:0/2406688633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 0x7fa0fc0d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:58.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0f37fe640 1 -- 172.21.15.67:0/2406688633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 msgr2=0x7fa0fc0d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:58.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0f37fe640 1 --2- 172.21.15.67:0/2406688633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 0x7fa0fc0d3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:58.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0f37fe640 1 -- 172.21.15.67:0/2406688633 >> v1:172.21.15.97:6789/0 conn(0x7fa0fc0b5f70 legacy=0x7fa0fc1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:58.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0f37fe640 1 -- 172.21.15.67:0/2406688633 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc0cf070 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0fbfff640 1 --2- 172.21.15.67:0/2406688633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 0x7fa0fc0d3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:33:58.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0f37fe640 1 --2- 172.21.15.67:0/2406688633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 0x7fa0fc0d35d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009870 tx=0x7fa0e401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a259484d1dd100fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:58.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0fb7fe640 1 -- 172.21.15.67:0/2406688633 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40b0070 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0fb7fe640 1 -- 172.21.15.67:0/2406688633 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e40ab600 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa0fb7fe640 1 -- 172.21.15.67:0/2406688633 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40ab9d0 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa1026f0640 1 -- 172.21.15.67:0/2406688633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 msgr2=0x7fa0fc0d35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:58.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa1026f0640 1 --2- 172.21.15.67:0/2406688633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 0x7fa0fc0d35d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009870 tx=0x7fa0e401c440 comp rx=0 tx=0).stop 2024-09-19T05:33:58.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa1026f0640 1 -- 172.21.15.67:0/2406688633 shutdown_connections 2024-09-19T05:33:58.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa1026f0640 1 --2- 172.21.15.67:0/2406688633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 0x7fa0fc0d35d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:58.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa1026f0640 1 --2- 172.21.15.67:0/2406688633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 0x7fa0fc0d3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:58.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa1026f0640 1 -- 172.21.15.67:0/2406688633 >> 172.21.15.67:0/2406688633 conn(0x7fa0fc08bfc0 msgr2=0x7fa0fc0d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:58.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa1026f0640 1 -- 172.21.15.67:0/2406688633 shutdown_connections 2024-09-19T05:33:58.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.737+0000 7fa1026f0640 1 -- 172.21.15.67:0/2406688633 wait complete. 2024-09-19T05:33:58.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 Processor -- start 2024-09-19T05:33:58.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 -- start start 2024-09-19T05:33:58.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0fc0b5f70 0x7fa0fc155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:58.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 0x7fa0fc0b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:58.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 0x7fa0fc0b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:58.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc16b500 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc0b67b0 con 0x7fa0fc0b5f70 2024-09-19T05:33:58.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa0fc16b680 con 0x7fa0fc15e6f0 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 0x7fa0fc0b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 0x7fa0fc0b9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46262/0 (socket says 172.21.15.67:46262) 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f37fe640 1 -- 172.21.15.67:0/4115108037 learned_addr learned my addr 172.21.15.67:0/4115108037 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0fbfff640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0fc0b5f70 0x7fa0fc155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa100c8d640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 0x7fa0fc0b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f37fe640 1 -- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 msgr2=0x7fa0fc0b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f37fe640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 0x7fa0fc0b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f37fe640 1 -- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0fc0b5f70 msgr2=0x7fa0fc155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f37fe640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0fc0b5f70 0x7fa0fc155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f37fe640 1 -- 172.21.15.67:0/4115108037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc156030 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa100c8d640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 0x7fa0fc0b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f37fe640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 0x7fa0fc0b9c70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40ae040 tx=0x7fa0e40191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f97fa640 1 -- 172.21.15.67:0/4115108037 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40bb070 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f97fa640 1 -- 172.21.15.67:0/4115108037 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e40b6430 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 -- 172.21.15.67:0/4115108037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0fc156310 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa0f97fa640 1 -- 172.21.15.67:0/4115108037 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40b0040 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 -- 172.21.15.67:0/4115108037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0fc1568d0 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.741+0000 7fa1026f0640 1 -- 172.21.15.67:0/4115108037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0fc1621c0 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.745+0000 7fa0f97fa640 1 -- 172.21.15.67:0/4115108037 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0e40be070 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.745+0000 7fa0f97fa640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0dc0678c0 0x7fa0dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:58.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.745+0000 7fa0f97fa640 1 -- 172.21.15.67:0/4115108037 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7fa0e411f5d0 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.745+0000 7fa0fbfff640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0dc0678c0 0x7fa0dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:58.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.745+0000 7fa0fbfff640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0dc0678c0 0x7fa0dc069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc1579b0 tx=0x7fa0ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:58.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.749+0000 7fa0f97fa640 1 -- 172.21.15.67:0/4115108037 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa0e4016150 con 0x7fa0fc0cfe30 2024-09-19T05:33:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:58.917+0000 7fa1026f0640 1 -- 172.21.15.67:0/4115108037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa0fc0d3dd0 con 0x7fa0fc0cfe30 2024-09-19T05:33:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.573+0000 7fa0f97fa640 1 -- 172.21.15.67:0/4115108037 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fa0e40eff00 con 0x7fa0fc0cfe30 2024-09-19T05:33:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:33:59.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 -- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0dc0678c0 msgr2=0x7fa0dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0dc0678c0 0x7fa0dc069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc1579b0 tx=0x7fa0ec008040 comp rx=0 tx=0).stop 2024-09-19T05:33:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 -- 172.21.15.67:0/4115108037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 msgr2=0x7fa0fc0b9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 0x7fa0fc0b9c70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40ae040 tx=0x7fa0e40191e0 comp rx=0 tx=0).stop 2024-09-19T05:33:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 -- 172.21.15.67:0/4115108037 shutdown_connections 2024-09-19T05:33:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0dc0678c0 0x7fa0dc069d80 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc1579b0 tx=0x7fa0ec008040 comp rx=0 tx=0).stop 2024-09-19T05:33:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0fc15e6f0 0x7fa0fc0b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0cfe30 0x7fa0fc0b9c70 secure :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40ae040 tx=0x7fa0e40191e0 comp rx=0 tx=0).stop 2024-09-19T05:33:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 --2- 172.21.15.67:0/4115108037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0fc0b5f70 0x7fa0fc155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 -- 172.21.15.67:0/4115108037 >> 172.21.15.67:0/4115108037 conn(0x7fa0fc08bfc0 msgr2=0x7fa0fc0d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 -- 172.21.15.67:0/4115108037 shutdown_connections 2024-09-19T05:33:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.581+0000 7fa1026f0640 1 -- 172.21.15.67:0/4115108037 wait complete. 2024-09-19T05:33:59.610 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-19T05:33:59.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4ab299b640 1 Processor -- start 2024-09-19T05:33:59.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4ab299b640 1 -- start start 2024-09-19T05:33:59.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4ab299b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4aac15e6f0 0x7f4aac0d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:59.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4ab299b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4aac0cfe30 0x7f4aac0d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:59.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4ab299b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aac15ead0 con 0x7f4aac0b5f70 2024-09-19T05:33:59.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4ab299b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4aac0ceb40 con 0x7f4aac0cfe30 2024-09-19T05:33:59.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4ab299b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4aac0ced90 con 0x7f4aac15e6f0 2024-09-19T05:33:59.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4aabfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4aac15e6f0 0x7f4aac0d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:59.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4aab7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4aac0cfe30 0x7f4aac0d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:59.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4ab0f38640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4aac0b5f70 0x7f4aac1621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:39644/0 (socket says 172.21.15.67:39644) 2024-09-19T05:33:59.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4ab0f38640 1 -- 172.21.15.67:0/1863759189 learned_addr learned my addr 172.21.15.67:0/1863759189 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:33:59.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4aaaffd640 1 -- 172.21.15.67:0/1863759189 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375183926 0 0) 0x7f4aac15ead0 con 0x7f4aac0b5f70 2024-09-19T05:33:59.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4aaaffd640 1 -- 172.21.15.67:0/1863759189 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a94003530 con 0x7f4aac0b5f70 2024-09-19T05:33:59.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4aab7fe640 1 -- 172.21.15.67:0/1863759189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4aac15e6f0 msgr2=0x7f4aac0d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:59.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4aab7fe640 1 --2- 172.21.15.67:0/1863759189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4aac15e6f0 0x7f4aac0d3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:59.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4aab7fe640 1 -- 172.21.15.67:0/1863759189 >> v1:172.21.15.97:6789/0 conn(0x7f4aac0b5f70 legacy=0x7f4aac1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:59.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.733+0000 7f4aab7fe640 1 -- 172.21.15.67:0/1863759189 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac0cf070 con 0x7f4aac0cfe30 2024-09-19T05:33:59.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4aab7fe640 1 --2- 172.21.15.67:0/1863759189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4aac0cfe30 0x7f4aac0d35d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00097c0 tx=0x7f4aa001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48f5e000e8b494ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:59.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4aaaffd640 1 -- 172.21.15.67:0/1863759189 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00b0070 con 0x7f4aac0cfe30 2024-09-19T05:33:59.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4aaaffd640 1 -- 172.21.15.67:0/1863759189 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa00ab600 con 0x7f4aac0cfe30 2024-09-19T05:33:59.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4aaaffd640 1 -- 172.21.15.67:0/1863759189 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00ab9b0 con 0x7f4aac0cfe30 2024-09-19T05:33:59.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4ab299b640 1 -- 172.21.15.67:0/1863759189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4aac0cfe30 msgr2=0x7f4aac0d35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:59.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4ab299b640 1 --2- 172.21.15.67:0/1863759189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4aac0cfe30 0x7f4aac0d35d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00097c0 tx=0x7f4aa001c380 comp rx=0 tx=0).stop 2024-09-19T05:33:59.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4ab299b640 1 -- 172.21.15.67:0/1863759189 shutdown_connections 2024-09-19T05:33:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4ab299b640 1 --2- 172.21.15.67:0/1863759189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4aac0cfe30 0x7f4aac0d35d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4ab299b640 1 --2- 172.21.15.67:0/1863759189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4aac15e6f0 0x7f4aac0d3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4ab299b640 1 -- 172.21.15.67:0/1863759189 >> 172.21.15.67:0/1863759189 conn(0x7f4aac08bfc0 msgr2=0x7f4aac0d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4ab299b640 1 -- 172.21.15.67:0/1863759189 shutdown_connections 2024-09-19T05:33:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.737+0000 7f4ab299b640 1 -- 172.21.15.67:0/1863759189 wait complete. 2024-09-19T05:33:59.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 Processor -- start 2024-09-19T05:33:59.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 -- start start 2024-09-19T05:33:59.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4aac0b5f70 0x7f4aac151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:59.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4aac0cfe30 0x7f4aac151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:59.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aac15e6f0 0x7f4aac152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:59.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac16b500 con 0x7f4aac15e6f0 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac0b67b0 con 0x7f4aac0b5f70 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4aac16b680 con 0x7f4aac0cfe30 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab0f38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aac15e6f0 0x7f4aac152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab0f38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aac15e6f0 0x7f4aac152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46276/0 (socket says 172.21.15.67:46276) 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab0f38640 1 -- 172.21.15.67:0/2644589312 learned_addr learned my addr 172.21.15.67:0/2644589312 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4aabfff640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4aac0b5f70 0x7f4aac151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4aab7fe640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4aac0cfe30 0x7f4aac151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab0f38640 1 -- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4aac0cfe30 msgr2=0x7f4aac151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab0f38640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4aac0cfe30 0x7f4aac151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab0f38640 1 -- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4aac0b5f70 msgr2=0x7f4aac151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab0f38640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4aac0b5f70 0x7f4aac151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab0f38640 1 -- 172.21.15.67:0/2644589312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac0b8e40 con 0x7f4aac15e6f0 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab0f38640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aac15e6f0 0x7f4aac152270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400c9f0 tx=0x7f4aa400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4aa8ff9640 1 -- 172.21.15.67:0/2644589312 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4017070 con 0x7f4aac15e6f0 2024-09-19T05:33:59.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4aa8ff9640 1 -- 172.21.15.67:0/2644589312 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa400ab70 con 0x7f4aac15e6f0 2024-09-19T05:33:59.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 -- 172.21.15.67:0/2644589312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac0b9120 con 0x7f4aac15e6f0 2024-09-19T05:33:59.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4aa8ff9640 1 -- 172.21.15.67:0/2644589312 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4012400 con 0x7f4aac15e6f0 2024-09-19T05:33:59.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 -- 172.21.15.67:0/2644589312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac0b96e0 con 0x7f4aac15e6f0 2024-09-19T05:33:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.741+0000 7f4ab299b640 1 -- 172.21.15.67:0/2644589312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aac1621c0 con 0x7f4aac15e6f0 2024-09-19T05:33:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.745+0000 7f4aa8ff9640 1 -- 172.21.15.67:0/2644589312 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4aa401a070 con 0x7f4aac15e6f0 2024-09-19T05:33:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.745+0000 7f4aa8ff9640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a980678c0 0x7f4a98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.745+0000 7f4aa8ff9640 1 -- 172.21.15.67:0/2644589312 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f4aa4085830 con 0x7f4aac15e6f0 2024-09-19T05:33:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.745+0000 7f4aabfff640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a980678c0 0x7f4a98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.745+0000 7f4aabfff640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a980678c0 0x7f4a98069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4aac15e1c0 tx=0x7f4a9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:59.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.749+0000 7f4aa8ff9640 1 -- 172.21.15.67:0/2644589312 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4aa4055d20 con 0x7f4aac15e6f0 2024-09-19T05:33:59.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:33:59.913+0000 7f4ab299b640 1 -- 172.21.15.67:0/2644589312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4aac0b9b70 con 0x7f4aac15e6f0 2024-09-19T05:34:00.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.577+0000 7f4aa8ff9640 1 -- 172.21.15.67:0/2644589312 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f4aa405c030 con 0x7f4aac15e6f0 2024-09-19T05:34:00.582 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data_ec' removed 2024-09-19T05:34:00.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.581+0000 7f4ab299b640 1 -- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a980678c0 msgr2=0x7f4a98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:00.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.581+0000 7f4ab299b640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a980678c0 0x7f4a98069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4aac15e1c0 tx=0x7f4a9c008040 comp rx=0 tx=0).stop 2024-09-19T05:34:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.581+0000 7f4ab299b640 1 -- 172.21.15.67:0/2644589312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aac15e6f0 msgr2=0x7f4aac152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.581+0000 7f4ab299b640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aac15e6f0 0x7f4aac152270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400c9f0 tx=0x7f4aa400ceb0 comp rx=0 tx=0).stop 2024-09-19T05:34:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.581+0000 7f4ab299b640 1 -- 172.21.15.67:0/2644589312 shutdown_connections 2024-09-19T05:34:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.581+0000 7f4ab299b640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4aac15e6f0 0x7f4aac152270 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.581+0000 7f4ab299b640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a980678c0 0x7f4a98069d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.581+0000 7f4ab299b640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4aac0cfe30 0x7f4aac151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.581+0000 7f4ab299b640 1 --2- 172.21.15.67:0/2644589312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4aac0b5f70 0x7f4aac151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.581+0000 7f4ab299b640 1 -- 172.21.15.67:0/2644589312 >> 172.21.15.67:0/2644589312 conn(0x7f4aac08bfc0 msgr2=0x7f4aac0b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:00.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.585+0000 7f4ab299b640 1 -- 172.21.15.67:0/2644589312 shutdown_connections 2024-09-19T05:34:00.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.585+0000 7f4ab299b640 1 -- 172.21.15.67:0/2644589312 wait complete. 2024-09-19T05:34:00.611 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:34:00.611 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:34:00.611 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:34:00.611 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:34:00.612 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:34:00.612 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:34:00.612 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:34:00.612 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:34:00.612 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:34:00.612 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:34:00.612 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:34:00.613 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:34:00.613 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:34:00.613 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:34:00.613 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:34:00.613 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:34:00.623 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:34:00.623 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:34:00.625 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:34:00.625 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:34:00.626 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:34:00.626 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:34:00.627 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:34:00.628 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:34:00.673 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:34:00.673 DEBUG:teuthology.parallel:result is None 2024-09-19T05:34:00.673 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:34:00.674 DEBUG:teuthology.parallel:result is None 2024-09-19T05:34:00.674 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:34:00.674 DEBUG:teuthology.parallel:result is None 2024-09-19T05:34:00.675 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:34:00.675 DEBUG:teuthology.parallel:result is None 2024-09-19T05:34:00.675 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:34:00.741 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:34:00.742 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:34:00.743 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:34:00.746 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:34:00.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.785+0000 7f308ee73640 1 Processor -- start 2024-09-19T05:34:00.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.785+0000 7f308ee73640 1 -- start start 2024-09-19T05:34:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3088161da0 0x7f30880d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30880d05d0 con 0x7f30880d0e80 2024-09-19T05:34:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30880d4d40 con 0x7f30880d0160 2024-09-19T05:34:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f30880d0840 con 0x7f3088161da0 2024-09-19T05:34:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308cc0f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3088161da0 0x7f30880d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f3087fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f30880d0e80 0x7f30880b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46786/0 (socket says 172.21.15.67:46786) 2024-09-19T05:34:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f3087fff640 1 -- 172.21.15.67:0/18599147 learned_addr learned my addr 172.21.15.67:0/18599147 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308cc0f640 1 -- 172.21.15.67:0/18599147 >> v1:172.21.15.97:6789/0 conn(0x7f30880d0160 legacy=0x7f30880b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308cc0f640 1 -- 172.21.15.67:0/18599147 >> v1:172.21.15.67:6789/0 conn(0x7f30880d0e80 legacy=0x7f30880b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308cc0f640 1 -- 172.21.15.67:0/18599147 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30880d5020 con 0x7f3088161da0 2024-09-19T05:34:00.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308cc0f640 1 --2- 172.21.15.67:0/18599147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3088161da0 0x7f30880d1af0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3078009d90 tx=0x7f307801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0dc6affcac5c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:00.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f30877fe640 1 -- 172.21.15.67:0/18599147 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30780b2070 con 0x7f3088161da0 2024-09-19T05:34:00.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f30877fe640 1 -- 172.21.15.67:0/18599147 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30780a5920 con 0x7f3088161da0 2024-09-19T05:34:00.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f30877fe640 1 -- 172.21.15.67:0/18599147 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30780a5cf0 con 0x7f3088161da0 2024-09-19T05:34:00.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 -- 172.21.15.67:0/18599147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3088161da0 msgr2=0x7f30880d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:00.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 --2- 172.21.15.67:0/18599147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3088161da0 0x7f30880d1af0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3078009d90 tx=0x7f307801c970 comp rx=0 tx=0).stop 2024-09-19T05:34:00.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 -- 172.21.15.67:0/18599147 shutdown_connections 2024-09-19T05:34:00.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 --2- 172.21.15.67:0/18599147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3088161da0 0x7f30880d1af0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:00.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 -- 172.21.15.67:0/18599147 >> 172.21.15.67:0/18599147 conn(0x7f308808bfc0 msgr2=0x7f30880d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:00.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 -- 172.21.15.67:0/18599147 shutdown_connections 2024-09-19T05:34:00.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.789+0000 7f308ee73640 1 -- 172.21.15.67:0/18599147 wait complete. 2024-09-19T05:34:00.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 Processor -- start 2024-09-19T05:34:00.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 -- start start 2024-09-19T05:34:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30880d0160 0x7f30880cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30880d0e80 0x7f30880b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3088161da0 0x7f30880b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3088162180 con 0x7f30880d0e80 2024-09-19T05:34:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f30880b53f0 con 0x7f30880d0160 2024-09-19T05:34:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f30880d16a0 con 0x7f3088161da0 2024-09-19T05:34:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f3087fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30880d0e80 0x7f30880b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f3087fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30880d0e80 0x7f30880b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46324/0 (socket says 172.21.15.67:46324) 2024-09-19T05:34:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f3087fff640 1 -- 172.21.15.67:0/3506079726 learned_addr learned my addr 172.21.15.67:0/3506079726 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308cc0f640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30880d0160 0x7f30880cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308d410640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3088161da0 0x7f30880b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f3087fff640 1 -- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3088161da0 msgr2=0x7f30880b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f3087fff640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3088161da0 0x7f30880b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f3087fff640 1 -- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30880d0160 msgr2=0x7f30880cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f3087fff640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30880d0160 0x7f30880cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f3087fff640 1 -- 172.21.15.67:0/3506079726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30880b3300 con 0x7f30880d0e80 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f3087fff640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30880d0e80 0x7f30880b72c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f307c00c500 tx=0x7f307c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f30857fa640 1 -- 172.21.15.67:0/3506079726 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c017070 con 0x7f30880d0e80 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f30857fa640 1 -- 172.21.15.67:0/3506079726 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307c005cf0 con 0x7f30880d0e80 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 -- 172.21.15.67:0/3506079726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30880ce1e0 con 0x7f30880d0e80 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f30857fa640 1 -- 172.21.15.67:0/3506079726 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c0072f0 con 0x7f30880d0e80 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 -- 172.21.15.67:0/3506079726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30881590f0 con 0x7f30880d0e80 2024-09-19T05:34:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.793+0000 7f308ee73640 1 -- 172.21.15.67:0/3506079726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3088158c00 con 0x7f30880d0e80 2024-09-19T05:34:00.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.797+0000 7f30857fa640 1 -- 172.21.15.67:0/3506079726 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f307c01a070 con 0x7f30880d0e80 2024-09-19T05:34:00.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.797+0000 7f30857fa640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30740678c0 0x7f3074069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:00.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.797+0000 7f30857fa640 1 -- 172.21.15.67:0/3506079726 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7f307c084d20 con 0x7f30880d0e80 2024-09-19T05:34:00.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.797+0000 7f308cc0f640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30740678c0 0x7f3074069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:00.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.797+0000 7f308cc0f640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30740678c0 0x7f3074069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f30780af000 tx=0x7f30780a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:00.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.801+0000 7f30857fa640 1 -- 172.21.15.67:0/3506079726 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f307c055410 con 0x7f30880d0e80 2024-09-19T05:34:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:00.981+0000 7f308ee73640 1 -- 172.21.15.67:0/3506079726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f30880d1af0 con 0x7f30880d0e80 2024-09-19T05:34:01.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.605+0000 7f30857fa640 1 -- 172.21.15.67:0/3506079726 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7f307c059710 con 0x7f30880d0e80 2024-09-19T05:34:01.610 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 -- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30740678c0 msgr2=0x7f3074069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30740678c0 0x7f3074069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f30780af000 tx=0x7f30780a7070 comp rx=0 tx=0).stop 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 -- 172.21.15.67:0/3506079726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30880d0e80 msgr2=0x7f30880b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30880d0e80 0x7f30880b72c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f307c00c500 tx=0x7f307c00c9c0 comp rx=0 tx=0).stop 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 -- 172.21.15.67:0/3506079726 shutdown_connections 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30740678c0 0x7f3074069d80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3088161da0 0x7f30880b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30880d0e80 0x7f30880b72c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 --2- 172.21.15.67:0/3506079726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30880d0160 0x7f30880cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 -- 172.21.15.67:0/3506079726 >> 172.21.15.67:0/3506079726 conn(0x7f308808bfc0 msgr2=0x7f308814e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 -- 172.21.15.67:0/3506079726 shutdown_connections 2024-09-19T05:34:01.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.609+0000 7f308ee73640 1 -- 172.21.15.67:0/3506079726 wait complete. 2024-09-19T05:34:01.636 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:34:01.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.757+0000 7f4fa300f640 1 Processor -- start 2024-09-19T05:34:01.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.757+0000 7f4fa300f640 1 -- start start 2024-09-19T05:34:01.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4fa300f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4f9c0b4900 0x7f4f9c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:01.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4fa300f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f9c0723c0 0x7f4f9c072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:01.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4fa300f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9c0b3860 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4fa300f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4f9c15b5c0 con 0x7f4f9c0b4900 2024-09-19T05:34:01.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4fa300f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9c0b3b40 con 0x7f4f9c0723c0 2024-09-19T05:34:01.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4f9c0b4900 0x7f4f9c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:01.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4f9c0b4900 0x7f4f9c071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46338/0 (socket says 172.21.15.67:46338) 2024-09-19T05:34:01.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9bfff640 1 -- 172.21.15.67:0/455854465 learned_addr learned my addr 172.21.15.67:0/455854465 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:01.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4fa15ac640 1 --2- 172.21.15.67:0/455854465 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f9c0723c0 0x7f4f9c072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:01.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9bfff640 1 -- 172.21.15.67:0/455854465 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f9c0723c0 msgr2=0x7f4f9c072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:01.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9bfff640 1 --2- 172.21.15.67:0/455854465 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f9c0723c0 0x7f4f9c072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:01.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9bfff640 1 -- 172.21.15.67:0/455854465 >> v1:172.21.15.97:6789/0 conn(0x7f4f9c15b1e0 legacy=0x7f4f9c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:01.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9bfff640 1 -- 172.21.15.67:0/455854465 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c0b3e20 con 0x7f4f9c0b4900 2024-09-19T05:34:01.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9bfff640 1 --2- 172.21.15.67:0/455854465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c0b4900 0x7f4f9c071e80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009e50 tx=0x7f4f8c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdda964e3c26b01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:01.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9b7fe640 1 -- 172.21.15.67:0/455854465 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0a57d0 con 0x7f4f9c0b4900 2024-09-19T05:34:01.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9b7fe640 1 -- 172.21.15.67:0/455854465 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c0a5970 con 0x7f4f9c0b4900 2024-09-19T05:34:01.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.761+0000 7f4f9b7fe640 1 -- 172.21.15.67:0/455854465 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0a5d40 con 0x7f4f9c0b4900 2024-09-19T05:34:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- 172.21.15.67:0/455854465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c0b4900 msgr2=0x7f4f9c071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 --2- 172.21.15.67:0/455854465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c0b4900 0x7f4f9c071e80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009e50 tx=0x7f4f8c01ca00 comp rx=0 tx=0).stop 2024-09-19T05:34:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- 172.21.15.67:0/455854465 shutdown_connections 2024-09-19T05:34:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 --2- 172.21.15.67:0/455854465 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f9c0723c0 0x7f4f9c072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 --2- 172.21.15.67:0/455854465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c0b4900 0x7f4f9c071e80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- 172.21.15.67:0/455854465 >> 172.21.15.67:0/455854465 conn(0x7f4f9c0d0080 msgr2=0x7f4f9c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- 172.21.15.67:0/455854465 shutdown_connections 2024-09-19T05:34:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- 172.21.15.67:0/455854465 wait complete. 2024-09-19T05:34:01.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 Processor -- start 2024-09-19T05:34:01.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- start start 2024-09-19T05:34:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f9c0723c0 0x7f4f9c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f9c0b4900 0x7f4f9c158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c15b1e0 0x7f4f9c150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c0aea30 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c0ae8b0 con 0x7f4f9c0b4900 2024-09-19T05:34:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9c0aebb0 con 0x7f4f9c0723c0 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa15ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c15b1e0 0x7f4f9c150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa15ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c15b1e0 0x7f4f9c150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46346/0 (socket says 172.21.15.67:46346) 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa15ac640 1 -- 172.21.15.67:0/1963912266 learned_addr learned my addr 172.21.15.67:0/1963912266 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4f9bfff640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f9c0b4900 0x7f4f9c158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa0dab640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f9c0723c0 0x7f4f9c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa15ac640 1 -- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f9c0723c0 msgr2=0x7f4f9c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa15ac640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f9c0723c0 0x7f4f9c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa15ac640 1 -- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f9c0b4900 msgr2=0x7f4f9c158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa15ac640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f9c0b4900 0x7f4f9c158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa15ac640 1 -- 172.21.15.67:0/1963912266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c14fa90 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa15ac640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c15b1e0 0x7f4f9c150df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400e7f0 tx=0x7f4f9400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:01.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4f997fa640 1 -- 172.21.15.67:0/1963912266 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94017070 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4f997fa640 1 -- 172.21.15.67:0/1963912266 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f9400c8e0 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- 172.21.15.67:0/1963912266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c1561e0 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4f997fa640 1 -- 172.21.15.67:0/1963912266 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9400eea0 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.765+0000 7f4fa300f640 1 -- 172.21.15.67:0/1963912266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c1567a0 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.769+0000 7f4fa300f640 1 -- 172.21.15.67:0/1963912266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9c072850 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.769+0000 7f4f997fa640 1 -- 172.21.15.67:0/1963912266 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f9401a070 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.769+0000 7f4f997fa640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f7c0678c0 0x7f4f7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:01.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.769+0000 7f4f997fa640 1 -- 172.21.15.67:0/1963912266 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f4f940858a0 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.769+0000 7f4fa0dab640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f7c0678c0 0x7f4f7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:01.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.769+0000 7f4fa0dab640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f7c0678c0 0x7f4f7c069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f84001650 tx=0x7f4f84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:01.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.773+0000 7f4f997fa640 1 -- 172.21.15.67:0/1963912266 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4f94056630 con 0x7f4f9c15b1e0 2024-09-19T05:34:01.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.993+0000 7f4fa300f640 1 -- 172.21.15.67:0/1963912266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4f9c15a4d0 con 0x7f4f9c15b1e0 2024-09-19T05:34:02.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4f997fa640 1 -- 172.21.15.67:0/1963912266 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f4f94055f30 con 0x7f4f9c15b1e0 2024-09-19T05:34:02.000 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.001 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:34:02.002 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:34:02.003 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.004 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:34:02.005 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.006 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.007 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:34:02.007 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:34:02.007 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.007 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:34:02.007 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:34:02.007 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.007 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.007 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.007 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.008 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:34:02.009 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:34:02.009 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.009 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.009 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.009 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.009 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:34:02.009 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.010 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:34:02.011 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:34:02.011 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:34:02.011 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:34:02.011 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.011 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.011 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.011 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:34:02.011 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:34:02.011 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.011 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:34:02.012 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:34:02.013 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:34:02.013 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.013 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.013 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.013 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:34:02.013 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:34:02.013 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.013 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:34:02.013 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:34:02.013 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:34:02.014 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.015 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.015 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.015 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.015 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-mds", 2024-09-19T05:34:02.015 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCCt+tm5R3kEhAAO++5AIilokhjbSm/xFILdQ==", 2024-09-19T05:34:02.015 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.015 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-mds" 2024-09-19T05:34:02.015 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.015 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-mgr", 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCCt+tmnDfkEhAATMncG+dZgroHPyyEMAoaQQ==", 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-osd", 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCCt+tm3U3kEhAAjV5vW+vfQ3GuslsFXwyJXw==", 2024-09-19T05:34:02.016 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.017 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-osd" 2024-09-19T05:34:02.017 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.017 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.017 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.017 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rbd", 2024-09-19T05:34:02.017 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCCt+tm8mPkEhAARYMm8591wPXIesveze2Cqw==", 2024-09-19T05:34:02.017 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.017 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-19T05:34:02.017 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.017 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCCt+tmL3rkEhAAnqoPQE2/t8RHhS+NlE3SCA==", 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rgw", 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCCt+tmbZHkEhAA4DqiYU37X3j1GVf0wwQrbA==", 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.018 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-19T05:34:02.019 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.019 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.019 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.019 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:34:02.019 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:34:02.019 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.019 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:34:02.019 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:34:02.019 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:34:02.020 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:34:02.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 -- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f7c0678c0 msgr2=0x7f4f7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f7c0678c0 0x7f4f7c069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f84001650 tx=0x7f4f84009040 comp rx=0 tx=0).stop 2024-09-19T05:34:02.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 -- 172.21.15.67:0/1963912266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c15b1e0 msgr2=0x7f4f9c150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c15b1e0 0x7f4f9c150df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400e7f0 tx=0x7f4f9400ecb0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 -- 172.21.15.67:0/1963912266 shutdown_connections 2024-09-19T05:34:02.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f9c15b1e0 0x7f4f9c150df0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f9c0b4900 0x7f4f9c158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f7c0678c0 0x7f4f7c069d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 --2- 172.21.15.67:0/1963912266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f9c0723c0 0x7f4f9c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 -- 172.21.15.67:0/1963912266 >> 172.21.15.67:0/1963912266 conn(0x7f4f9c0d0080 msgr2=0x7f4f9c0d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:02.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 -- 172.21.15.67:0/1963912266 shutdown_connections 2024-09-19T05:34:02.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:01.997+0000 7f4fa300f640 1 -- 172.21.15.67:0/1963912266 wait complete. 2024-09-19T05:34:02.024 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-19T05:34:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.145+0000 7f1f5a6af640 1 Processor -- start 2024-09-19T05:34:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.145+0000 7f1f5a6af640 1 -- start start 2024-09-19T05:34:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.145+0000 7f1f5a6af640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f5406f460 0x7f1f5406f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.145+0000 7f1f5a6af640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5406e3c0 con 0x7f1f5415c030 2024-09-19T05:34:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.145+0000 7f1f5a6af640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5406e6a0 con 0x7f1f5406dde0 2024-09-19T05:34:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.145+0000 7f1f5a6af640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1f5406e980 con 0x7f1f5406f460 2024-09-19T05:34:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.145+0000 7f1f53fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1f5415c030 0x7f1f5415d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46798/0 (socket says 172.21.15.67:46798) 2024-09-19T05:34:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.145+0000 7f1f53fff640 1 -- 172.21.15.67:0/3688049315 learned_addr learned my addr 172.21.15.67:0/3688049315 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.145+0000 7f1f58c4c640 1 --2- 172.21.15.67:0/3688049315 >> v2:172.21.15.97:3300/0 conn(0x7f1f5406f460 0x7f1f5406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2652543296 0 0) 0x7f1f5406e3c0 con 0x7f1f5415c030 2024-09-19T05:34:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f3c003530 con 0x7f1f5415c030 2024-09-19T05:34:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1099470441 0 0) 0x7f1f3c003530 con 0x7f1f5415c030 2024-09-19T05:34:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 >> v2:172.21.15.97:3300/0 conn(0x7f1f5406f460 msgr2=0x7f1f5406f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 --2- 172.21.15.67:0/3688049315 >> v2:172.21.15.97:3300/0 conn(0x7f1f5406f460 0x7f1f5406f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 >> v1:172.21.15.97:6789/0 conn(0x7f1f5406dde0 legacy=0x7f1f540b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5406ec60 con 0x7f1f5415c030 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1f4c001680 con 0x7f1f5415c030 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 >> v1:172.21.15.67:6789/0 conn(0x7f1f5415c030 legacy=0x7f1f5415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3c0039c0 0x7f1f3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c0051d0 0x7f1f3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5406e980 con 0x7f1f3c004810 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c00c070 con 0x7f1f3c0039c0 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3c00c270 con 0x7f1f3c0051d0 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f537fe640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f53fff640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3c0039c0 0x7f1f3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f58c4c640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c0051d0 0x7f1f3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f537fe640 1 -- 172.21.15.67:0/3688049315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c0051d0 msgr2=0x7f1f3c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f537fe640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c0051d0 0x7f1f3c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f537fe640 1 -- 172.21.15.67:0/3688049315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3c0039c0 msgr2=0x7f1f3c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f537fe640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3c0039c0 0x7f1f3c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f537fe640 1 -- 172.21.15.67:0/3688049315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c003530 con 0x7f1f3c004810 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f58c4c640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3c0051d0 0x7f1f3c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f58c4c640 1 -- 172.21.15.67:0/3688049315 reap_dead start 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f537fe640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f3c004c90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f48001e70 tx=0x7f1f4801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988772dae6efac4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f480af070 con 0x7f1f3c004810 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f48003b80 con 0x7f1f3c004810 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f52ffd640 1 -- 172.21.15.67:0/3688049315 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48001a90 con 0x7f1f3c004810 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f5a6af640 1 -- 172.21.15.67:0/3688049315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 msgr2=0x7f1f3c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.149+0000 7f1f5a6af640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f3c004c90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f48001e70 tx=0x7f1f4801c760 comp rx=0 tx=0).stop 2024-09-19T05:34:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 -- 172.21.15.67:0/3688049315 shutdown_connections 2024-09-19T05:34:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 --2- 172.21.15.67:0/3688049315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f3c004c90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 -- 172.21.15.67:0/3688049315 >> 172.21.15.67:0/3688049315 conn(0x7f1f540d0080 msgr2=0x7f1f540d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 -- 172.21.15.67:0/3688049315 shutdown_connections 2024-09-19T05:34:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 -- 172.21.15.67:0/3688049315 wait complete. 2024-09-19T05:34:02.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 Processor -- start 2024-09-19T05:34:02.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 -- start start 2024-09-19T05:34:02.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f5415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5415b130 0x7f1f5414f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5415b590 0x7f1f5414fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5415c590 con 0x7f1f3c004810 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5415c410 con 0x7f1f5415b590 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5406f870 con 0x7f1f5415b130 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f5415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f5415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46360/0 (socket says 172.21.15.67:46360) 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f53fff640 1 -- 172.21.15.67:0/564836323 learned_addr learned my addr 172.21.15.67:0/564836323 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f537fe640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5415b130 0x7f1f5414f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f58c4c640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5415b590 0x7f1f5414fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f53fff640 1 -- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5415b130 msgr2=0x7f1f5414f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f53fff640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5415b130 0x7f1f5414f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f53fff640 1 -- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5415b590 msgr2=0x7f1f5414fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f53fff640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5415b590 0x7f1f5414fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f53fff640 1 -- 172.21.15.67:0/564836323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5415f640 con 0x7f1f3c004810 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f53fff640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f5415f100 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c012540 tx=0x7f1f4c012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f50ff9640 1 -- 172.21.15.67:0/564836323 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c01c070 con 0x7f1f3c004810 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f50ff9640 1 -- 172.21.15.67:0/564836323 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c014810 con 0x7f1f3c004810 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 -- 172.21.15.67:0/564836323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5415c710 con 0x7f1f3c004810 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f50ff9640 1 -- 172.21.15.67:0/564836323 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c014be0 con 0x7f1f3c004810 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.153+0000 7f1f5a6af640 1 -- 172.21.15.67:0/564836323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f541537c0 con 0x7f1f3c004810 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.157+0000 7f1f5a6af640 1 -- 172.21.15.67:0/564836323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5406fc00 con 0x7f1f3c004810 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.157+0000 7f1f50ff9640 1 -- 172.21.15.67:0/564836323 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f4c01f070 con 0x7f1f3c004810 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.157+0000 7f1f50ff9640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f400678c0 0x7f1f40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.157+0000 7f1f50ff9640 1 -- 172.21.15.67:0/564836323 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f1f4c088410 con 0x7f1f3c004810 2024-09-19T05:34:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.157+0000 7f1f537fe640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f400678c0 0x7f1f40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.157+0000 7f1f537fe640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f400678c0 0x7f1f40069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f480ac000 tx=0x7f1f48001520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:02.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.161+0000 7f1f50ff9640 1 -- 172.21.15.67:0/564836323 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1f4c059110 con 0x7f1f3c004810 2024-09-19T05:34:02.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.385+0000 7f1f5a6af640 1 -- 172.21.15.67:0/564836323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f1f540b07a0 con 0x7f1f3c004810 2024-09-19T05:34:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f50ff9640 1 -- 172.21.15.67:0/564836323 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f1f4c058a10 con 0x7f1f3c004810 2024-09-19T05:34:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 -- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f400678c0 msgr2=0x7f1f40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f400678c0 0x7f1f40069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f480ac000 tx=0x7f1f48001520 comp rx=0 tx=0).stop 2024-09-19T05:34:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 -- 172.21.15.67:0/564836323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 msgr2=0x7f1f5415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f5415f100 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c012540 tx=0x7f1f4c012a00 comp rx=0 tx=0).stop 2024-09-19T05:34:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 -- 172.21.15.67:0/564836323 shutdown_connections 2024-09-19T05:34:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f5415b590 0x7f1f5414fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f400678c0 0x7f1f40069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5415b130 0x7f1f5414f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 --2- 172.21.15.67:0/564836323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f3c004810 0x7f1f5415f100 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 -- 172.21.15.67:0/564836323 >> 172.21.15.67:0/564836323 conn(0x7f1f540d0080 msgr2=0x7f1f540acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 -- 172.21.15.67:0/564836323 shutdown_connections 2024-09-19T05:34:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.389+0000 7f1f5a6af640 1 -- 172.21.15.67:0/564836323 wait complete. 2024-09-19T05:34:02.412 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-19T05:34:02.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f4910209640 1 Processor -- start 2024-09-19T05:34:02.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f4910209640 1 -- start start 2024-09-19T05:34:02.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f4910209640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49081609b0 0x7f49080b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f4910209640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49080afee0 0x7f490815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f4910209640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49080b4710 con 0x7f490815fcf0 2024-09-19T05:34:02.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f4910209640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f49080b5cf0 con 0x7f49081609b0 2024-09-19T05:34:02.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f4910209640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f49080b49f0 con 0x7f49080afee0 2024-09-19T05:34:02.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f490d7a4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49081609b0 0x7f49080b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f490d7a4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49081609b0 0x7f49080b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46372/0 (socket says 172.21.15.67:46372) 2024-09-19T05:34:02.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f490d7a4640 1 -- 172.21.15.67:0/793690446 learned_addr learned my addr 172.21.15.67:0/793690446 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:02.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f490e7a6640 1 --2- 172.21.15.67:0/793690446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49080afee0 0x7f490815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f490d7a4640 1 -- 172.21.15.67:0/793690446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49080afee0 msgr2=0x7f490815d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:02.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f490d7a4640 1 --2- 172.21.15.67:0/793690446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49080afee0 0x7f490815d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f490d7a4640 1 -- 172.21.15.67:0/793690446 >> v1:172.21.15.67:6789/0 conn(0x7f490815fcf0 legacy=0x7f49081600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f490d7a4640 1 -- 172.21.15.67:0/793690446 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49080b4cd0 con 0x7f49081609b0 2024-09-19T05:34:02.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.537+0000 7f490cfa3640 1 -- 172.21.15.67:0/793690446 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288955320 0 0) 0x7f49080b4710 con 0x7f490815fcf0 2024-09-19T05:34:02.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f490d7a4640 1 --2- 172.21.15.67:0/793690446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 0x7f49080b57b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009870 tx=0x7f48f801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb1ce864817f93f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:02.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f490cfa3640 1 -- 172.21.15.67:0/793690446 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f80ab620 con 0x7f49081609b0 2024-09-19T05:34:02.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f490cfa3640 1 -- 172.21.15.67:0/793690446 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f80b0070 con 0x7f49081609b0 2024-09-19T05:34:02.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f490cfa3640 1 -- 172.21.15.67:0/793690446 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f80ab9e0 con 0x7f49081609b0 2024-09-19T05:34:02.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f4910209640 1 -- 172.21.15.67:0/793690446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 msgr2=0x7f49080b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f4910209640 1 --2- 172.21.15.67:0/793690446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 0x7f49080b57b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009870 tx=0x7f48f801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f4910209640 1 -- 172.21.15.67:0/793690446 shutdown_connections 2024-09-19T05:34:02.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f4910209640 1 --2- 172.21.15.67:0/793690446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49080afee0 0x7f490815d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f4910209640 1 --2- 172.21.15.67:0/793690446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 0x7f49080b57b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f4910209640 1 -- 172.21.15.67:0/793690446 >> 172.21.15.67:0/793690446 conn(0x7f4908073500 msgr2=0x7f490806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:02.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f4910209640 1 -- 172.21.15.67:0/793690446 shutdown_connections 2024-09-19T05:34:02.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f4910209640 1 -- 172.21.15.67:0/793690446 wait complete. 2024-09-19T05:34:02.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f4910209640 1 Processor -- start 2024-09-19T05:34:02.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.541+0000 7f4910209640 1 -- start start 2024-09-19T05:34:02.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f4910209640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49080afee0 0x7f490814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f4910209640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f490815fcf0 0x7f490814b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f4910209640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 0x7f490814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f4910209640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f490815d580 con 0x7f49081609b0 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f4910209640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f490815d400 con 0x7f49080afee0 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f4910209640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4908168e80 con 0x7f490815fcf0 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490e7a6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 0x7f490814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490e7a6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 0x7f490814b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46378/0 (socket says 172.21.15.67:46378) 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490e7a6640 1 -- 172.21.15.67:0/751358120 learned_addr learned my addr 172.21.15.67:0/751358120 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490d7a4640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f490815fcf0 0x7f490814b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490dfa5640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49080afee0 0x7f490814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490e7a6640 1 -- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f490815fcf0 msgr2=0x7f490814b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490e7a6640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f490815fcf0 0x7f490814b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490e7a6640 1 -- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49080afee0 msgr2=0x7f490814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490e7a6640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49080afee0 0x7f490814c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490e7a6640 1 -- 172.21.15.67:0/751358120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490814c250 con 0x7f49081609b0 2024-09-19T05:34:02.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490e7a6640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 0x7f490814b610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f490000d580 tx=0x7f490000da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:02.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f48fe7fc640 1 -- 172.21.15.67:0/751358120 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49000125f0 con 0x7f49081609b0 2024-09-19T05:34:02.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f48fe7fc640 1 -- 172.21.15.67:0/751358120 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4900019070 con 0x7f49081609b0 2024-09-19T05:34:02.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f4910209640 1 -- 172.21.15.67:0/751358120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f490814bc90 con 0x7f49081609b0 2024-09-19T05:34:02.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f48fe7fc640 1 -- 172.21.15.67:0/751358120 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49000129d0 con 0x7f49081609b0 2024-09-19T05:34:02.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f4910209640 1 -- 172.21.15.67:0/751358120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4908150c30 con 0x7f49081609b0 2024-09-19T05:34:02.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f4910209640 1 -- 172.21.15.67:0/751358120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f490815d8c0 con 0x7f49081609b0 2024-09-19T05:34:02.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f48fe7fc640 1 -- 172.21.15.67:0/751358120 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4900012b70 con 0x7f49081609b0 2024-09-19T05:34:02.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f48fe7fc640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ec0678c0 0x7f48ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f48fe7fc640 1 -- 172.21.15.67:0/751358120 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f4900085ee0 con 0x7f49081609b0 2024-09-19T05:34:02.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.545+0000 7f490dfa5640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ec0678c0 0x7f48ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.549+0000 7f490dfa5640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ec0678c0 0x7f48ec069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f49040012f0 tx=0x7f4904009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:02.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.553+0000 7f48fe7fc640 1 -- 172.21.15.67:0/751358120 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4900056bf0 con 0x7f49081609b0 2024-09-19T05:34:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.781+0000 7f4910209640 1 -- 172.21.15.67:0/751358120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f49080cf1f0 con 0x7f49081609b0 2024-09-19T05:34:02.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f48fe7fc640 1 -- 172.21.15.67:0/751358120 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f49000564f0 con 0x7f49081609b0 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 -- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ec0678c0 msgr2=0x7f48ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ec0678c0 0x7f48ec069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f49040012f0 tx=0x7f4904009040 comp rx=0 tx=0).stop 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 -- 172.21.15.67:0/751358120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 msgr2=0x7f490814b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 0x7f490814b610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f490000d580 tx=0x7f490000da40 comp rx=0 tx=0).stop 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 -- 172.21.15.67:0/751358120 shutdown_connections 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49081609b0 0x7f490814b610 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ec0678c0 0x7f48ec069d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f490815fcf0 0x7f490814b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 --2- 172.21.15.67:0/751358120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49080afee0 0x7f490814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 -- 172.21.15.67:0/751358120 >> 172.21.15.67:0/751358120 conn(0x7f4908073500 msgr2=0x7f49080b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 -- 172.21.15.67:0/751358120 shutdown_connections 2024-09-19T05:34:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.785+0000 7f4910209640 1 -- 172.21.15.67:0/751358120 wait complete. 2024-09-19T05:34:02.809 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-19T05:34:02.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.925+0000 7fe9cc674640 1 Processor -- start 2024-09-19T05:34:02.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.925+0000 7fe9cc674640 1 -- start start 2024-09-19T05:34:02.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.925+0000 7fe9cc674640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe9c406dde0 0x7fe9c40b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cc674640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c406e3c0 con 0x7fe9c40b3510 2024-09-19T05:34:02.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cc674640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c406e6a0 con 0x7fe9c415c030 2024-09-19T05:34:02.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cc674640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c406e980 con 0x7fe9c406dde0 2024-09-19T05:34:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c9c0f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe9c406dde0 0x7fe9c40b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c9c0f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe9c406dde0 0x7fe9c40b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46382/0 (socket says 172.21.15.67:46382) 2024-09-19T05:34:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c9c0f640 1 -- 172.21.15.67:0/3000102287 learned_addr learned my addr 172.21.15.67:0/3000102287 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cac11640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe9c40b3510 0x7fe9c406f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46818/0 (socket says 172.21.15.67:46818) 2024-09-19T05:34:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c9c0f640 1 -- 172.21.15.67:0/3000102287 >> v1:172.21.15.97:6789/0 conn(0x7fe9c415c030 legacy=0x7fe9c415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c9c0f640 1 -- 172.21.15.67:0/3000102287 >> v1:172.21.15.67:6789/0 conn(0x7fe9c40b3510 legacy=0x7fe9c406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c9c0f640 1 -- 172.21.15.67:0/3000102287 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c406ec60 con 0x7fe9c406dde0 2024-09-19T05:34:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c940e640 1 -- 172.21.15.67:0/3000102287 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909177217 0 0) 0x7fe9c406e3c0 con 0x7fe9c40b3510 2024-09-19T05:34:02.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c9c0f640 1 --2- 172.21.15.67:0/3000102287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 0x7fe9c40b2fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009870 tx=0x7fe9b801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f2c270fdac5dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:02.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c940e640 1 -- 172.21.15.67:0/3000102287 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80a9610 con 0x7fe9c406dde0 2024-09-19T05:34:02.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c940e640 1 -- 172.21.15.67:0/3000102287 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b80a97b0 con 0x7fe9c406dde0 2024-09-19T05:34:02.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9c940e640 1 -- 172.21.15.67:0/3000102287 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80a9b80 con 0x7fe9c406dde0 2024-09-19T05:34:02.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cc674640 1 -- 172.21.15.67:0/3000102287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 msgr2=0x7fe9c40b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cc674640 1 --2- 172.21.15.67:0/3000102287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 0x7fe9c40b2fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009870 tx=0x7fe9b801c530 comp rx=0 tx=0).stop 2024-09-19T05:34:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cc674640 1 -- 172.21.15.67:0/3000102287 shutdown_connections 2024-09-19T05:34:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cc674640 1 --2- 172.21.15.67:0/3000102287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 0x7fe9c40b2fd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cc674640 1 -- 172.21.15.67:0/3000102287 >> 172.21.15.67:0/3000102287 conn(0x7fe9c40d0080 msgr2=0x7fe9c40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cc674640 1 -- 172.21.15.67:0/3000102287 shutdown_connections 2024-09-19T05:34:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.929+0000 7fe9cc674640 1 -- 172.21.15.67:0/3000102287 wait complete. 2024-09-19T05:34:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 Processor -- start 2024-09-19T05:34:02.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 -- start start 2024-09-19T05:34:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 0x7fe9c414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9c40b3510 0x7fe9c414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9c415c030 0x7fe9c414c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c416a270 con 0x7fe9c406dde0 2024-09-19T05:34:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c416a0f0 con 0x7fe9c415c030 2024-09-19T05:34:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c416a3f0 con 0x7fe9c40b3510 2024-09-19T05:34:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9ca410640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 0x7fe9c414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9ca410640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 0x7fe9c414b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46386/0 (socket says 172.21.15.67:46386) 2024-09-19T05:34:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9ca410640 1 -- 172.21.15.67:0/1879117989 learned_addr learned my addr 172.21.15.67:0/1879117989 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cac11640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9c415c030 0x7fe9c414c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9c9c0f640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9c40b3510 0x7fe9c414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9ca410640 1 -- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9c40b3510 msgr2=0x7fe9c414c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9ca410640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9c40b3510 0x7fe9c414c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9ca410640 1 -- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9c415c030 msgr2=0x7fe9c414c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9ca410640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9c415c030 0x7fe9c414c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9ca410640 1 -- 172.21.15.67:0/1879117989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c415abe0 con 0x7fe9c406dde0 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9ca410640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 0x7fe9c414b9f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400c800 tx=0x7fe9b400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9c2ffd640 1 -- 172.21.15.67:0/1879117989 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4003b80 con 0x7fe9c406dde0 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9c2ffd640 1 -- 172.21.15.67:0/1879117989 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b4003d20 con 0x7fe9c406dde0 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 -- 172.21.15.67:0/1879117989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c415a900 con 0x7fe9c406dde0 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9c2ffd640 1 -- 172.21.15.67:0/1879117989 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b400aa90 con 0x7fe9c406dde0 2024-09-19T05:34:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 -- 172.21.15.67:0/1879117989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c40b4a70 con 0x7fe9c406dde0 2024-09-19T05:34:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.933+0000 7fe9cc674640 1 -- 172.21.15.67:0/1879117989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c40b2fd0 con 0x7fe9c406dde0 2024-09-19T05:34:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.937+0000 7fe9c2ffd640 1 -- 172.21.15.67:0/1879117989 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9b400ac30 con 0x7fe9c406dde0 2024-09-19T05:34:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.937+0000 7fe9c2ffd640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe9b00678f0 0x7fe9b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.937+0000 7fe9c2ffd640 1 -- 172.21.15.67:0/1879117989 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fe9b4086460 con 0x7fe9c406dde0 2024-09-19T05:34:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.937+0000 7fe9c9c0f640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe9b00678f0 0x7fe9b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:02.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.937+0000 7fe9c9c0f640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe9b00678f0 0x7fe9b0069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80ae000 tx=0x7fe9b80b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:02.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:02.941+0000 7fe9c2ffd640 1 -- 172.21.15.67:0/1879117989 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe9b40571d0 con 0x7fe9c406dde0 2024-09-19T05:34:03.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.161+0000 7fe9cc674640 1 -- 172.21.15.67:0/1879117989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fe9c41593f0 con 0x7fe9c406dde0 2024-09-19T05:34:03.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.161+0000 7fe9c2ffd640 1 -- 172.21.15.67:0/1879117989 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fe9b4056ad0 con 0x7fe9c406dde0 2024-09-19T05:34:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 -- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe9b00678f0 msgr2=0x7fe9b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe9b00678f0 0x7fe9b0069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80ae000 tx=0x7fe9b80b3040 comp rx=0 tx=0).stop 2024-09-19T05:34:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 -- 172.21.15.67:0/1879117989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 msgr2=0x7fe9c414b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 0x7fe9c414b9f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400c800 tx=0x7fe9b400ccc0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 -- 172.21.15.67:0/1879117989 shutdown_connections 2024-09-19T05:34:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9c415c030 0x7fe9c414c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe9b00678f0 0x7fe9b0069db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9c40b3510 0x7fe9c414c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 --2- 172.21.15.67:0/1879117989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9c406dde0 0x7fe9c414b9f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 -- 172.21.15.67:0/1879117989 >> 172.21.15.67:0/1879117989 conn(0x7fe9c40d0080 msgr2=0x7fe9c41504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 -- 172.21.15.67:0/1879117989 shutdown_connections 2024-09-19T05:34:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.165+0000 7fe9cc674640 1 -- 172.21.15.67:0/1879117989 wait complete. 2024-09-19T05:34:03.186 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-19T05:34:03.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e830a640 1 Processor -- start 2024-09-19T05:34:03.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e830a640 1 -- start start 2024-09-19T05:34:03.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e830a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79e015c030 0x7f79e006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e830a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79e006f460 0x7f79e006f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e830a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e006e3c0 con 0x7f79e015d1d0 2024-09-19T05:34:03.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e830a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f79e006e6a0 con 0x7f79e006f460 2024-09-19T05:34:03.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e830a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f79e006e980 con 0x7f79e015c030 2024-09-19T05:34:03.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e68a7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79e006f460 0x7f79e006f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e68a7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79e006f460 0x7f79e006f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46398/0 (socket says 172.21.15.67:46398) 2024-09-19T05:34:03.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e68a7640 1 -- 172.21.15.67:0/2578436838 learned_addr learned my addr 172.21.15.67:0/2578436838 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:03.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e60a6640 1 --2- 172.21.15.67:0/2578436838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79e015c030 0x7f79e006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e68a7640 1 -- 172.21.15.67:0/2578436838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79e015c030 msgr2=0x7f79e006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:03.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e68a7640 1 --2- 172.21.15.67:0/2578436838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79e015c030 0x7f79e006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e68a7640 1 -- 172.21.15.67:0/2578436838 >> v1:172.21.15.97:6789/0 conn(0x7f79e015d1d0 legacy=0x7f79e00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.293+0000 7f79e68a7640 1 -- 172.21.15.67:0/2578436838 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e006ec60 con 0x7f79e006f460 2024-09-19T05:34:03.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e68a7640 1 --2- 172.21.15.67:0/2578436838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e006f460 0x7f79e006f8d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009e50 tx=0x7f79d801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed986d71ae147d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:03.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e50a4640 1 -- 172.21.15.67:0/2578436838 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d80a57f0 con 0x7f79e006f460 2024-09-19T05:34:03.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e50a4640 1 -- 172.21.15.67:0/2578436838 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d80a5990 con 0x7f79e006f460 2024-09-19T05:34:03.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e50a4640 1 -- 172.21.15.67:0/2578436838 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d80a5d60 con 0x7f79e006f460 2024-09-19T05:34:03.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e830a640 1 -- 172.21.15.67:0/2578436838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e006f460 msgr2=0x7f79e006f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e830a640 1 --2- 172.21.15.67:0/2578436838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e006f460 0x7f79e006f8d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009e50 tx=0x7f79d801ca00 comp rx=0 tx=0).stop 2024-09-19T05:34:03.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e830a640 1 -- 172.21.15.67:0/2578436838 shutdown_connections 2024-09-19T05:34:03.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e830a640 1 --2- 172.21.15.67:0/2578436838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e006f460 0x7f79e006f8d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e830a640 1 --2- 172.21.15.67:0/2578436838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79e015c030 0x7f79e006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e830a640 1 -- 172.21.15.67:0/2578436838 >> 172.21.15.67:0/2578436838 conn(0x7f79e00d0080 msgr2=0x7f79e00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:03.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e830a640 1 -- 172.21.15.67:0/2578436838 shutdown_connections 2024-09-19T05:34:03.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e830a640 1 -- 172.21.15.67:0/2578436838 wait complete. 2024-09-19T05:34:03.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e830a640 1 Processor -- start 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.297+0000 7f79e830a640 1 -- start start 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e830a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79e006f460 0x7f79e0156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e830a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e015c030 0x7f79e0145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e830a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79e015d1d0 0x7f79e0153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e830a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f79e015c590 con 0x7f79e015c030 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e830a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f79e015c410 con 0x7f79e015d1d0 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e830a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f79e01690e0 con 0x7f79e006f460 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e58a5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e015c030 0x7f79e0145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e58a5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e015c030 0x7f79e0145460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46402/0 (socket says 172.21.15.67:46402) 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e58a5640 1 -- 172.21.15.67:0/1008709004 learned_addr learned my addr 172.21.15.67:0/1008709004 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e60a6640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79e006f460 0x7f79e0156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e58a5640 1 -- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79e006f460 msgr2=0x7f79e0156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e58a5640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79e006f460 0x7f79e0156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e58a5640 1 -- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79e015d1d0 msgr2=0x7f79e0153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e68a7640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79e015d1d0 0x7f79e0153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e58a5640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79e015d1d0 0x7f79e0153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e58a5640 1 -- 172.21.15.67:0/1008709004 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e01459a0 con 0x7f79e015c030 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e58a5640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e015c030 0x7f79e0145460 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f79d000c340 tx=0x7f79d000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79d6ffd640 1 -- 172.21.15.67:0/1008709004 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d00052d0 con 0x7f79e015c030 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79d6ffd640 1 -- 172.21.15.67:0/1008709004 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d0005470 con 0x7f79e015c030 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e830a640 1 -- 172.21.15.67:0/1008709004 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e015a940 con 0x7f79e015c030 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79d6ffd640 1 -- 172.21.15.67:0/1008709004 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0007260 con 0x7f79e015c030 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e830a640 1 -- 172.21.15.67:0/1008709004 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e0156ec0 con 0x7f79e015c030 2024-09-19T05:34:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e830a640 1 -- 172.21.15.67:0/1008709004 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e006dde0 con 0x7f79e015c030 2024-09-19T05:34:03.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79d6ffd640 1 -- 172.21.15.67:0/1008709004 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f79d0007400 con 0x7f79e015c030 2024-09-19T05:34:03.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79d6ffd640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79c40678f0 0x7f79c4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79d6ffd640 1 -- 172.21.15.67:0/1008709004 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f79d0084ee0 con 0x7f79e015c030 2024-09-19T05:34:03.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e60a6640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79c40678f0 0x7f79c4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.301+0000 7f79e60a6640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79c40678f0 0x7f79c4069db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009790 tx=0x7f79dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:03.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.305+0000 7f79d6ffd640 1 -- 172.21.15.67:0/1008709004 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f79d0055be0 con 0x7f79e015c030 2024-09-19T05:34:03.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.517+0000 7f79e830a640 1 -- 172.21.15.67:0/1008709004 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f79e00d0f20 con 0x7f79e015c030 2024-09-19T05:34:03.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.521+0000 7f79d6ffd640 1 -- 172.21.15.67:0/1008709004 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f79d00554e0 con 0x7f79e015c030 2024-09-19T05:34:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 -- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79c40678f0 msgr2=0x7f79c4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79c40678f0 0x7f79c4069db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009790 tx=0x7f79dc008040 comp rx=0 tx=0).stop 2024-09-19T05:34:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 -- 172.21.15.67:0/1008709004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e015c030 msgr2=0x7f79e0145460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e015c030 0x7f79e0145460 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f79d000c340 tx=0x7f79d000c800 comp rx=0 tx=0).stop 2024-09-19T05:34:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 -- 172.21.15.67:0/1008709004 shutdown_connections 2024-09-19T05:34:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79e015d1d0 0x7f79e0153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79e015c030 0x7f79e0145460 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79c40678f0 0x7f79c4069db0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 --2- 172.21.15.67:0/1008709004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79e006f460 0x7f79e0156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 -- 172.21.15.67:0/1008709004 >> 172.21.15.67:0/1008709004 conn(0x7f79e00d0080 msgr2=0x7f79e00b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:03.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 -- 172.21.15.67:0/1008709004 shutdown_connections 2024-09-19T05:34:03.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.525+0000 7f79e830a640 1 -- 172.21.15.67:0/1008709004 wait complete. 2024-09-19T05:34:03.545 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-19T05:34:03.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6c298a640 1 Processor -- start 2024-09-19T05:34:03.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6c298a640 1 -- start start 2024-09-19T05:34:03.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6c298a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6bc15c030 0x7fe6bc06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6c298a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15d1d0 0x7fe6bc0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6c298a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6bc06e3c0 con 0x7fe6bc0b3510 2024-09-19T05:34:03.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6c298a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe6bc06e6a0 con 0x7fe6bc15c030 2024-09-19T05:34:03.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6c298a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe6bc06e980 con 0x7fe6bc15d1d0 2024-09-19T05:34:03.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6b3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15d1d0 0x7fe6bc0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6bbfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6bc15c030 0x7fe6bc06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6bbfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6bc15c030 0x7fe6bc06dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:57666/0 (socket says 172.21.15.67:57666) 2024-09-19T05:34:03.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.653+0000 7fe6b3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15d1d0 0x7fe6bc0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:54948/0 (socket says 172.21.15.67:54948) 2024-09-19T05:34:03.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6bbfff640 1 -- 172.21.15.67:0/497522434 learned_addr learned my addr 172.21.15.67:0/497522434 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:03.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6b3fff640 1 -- 172.21.15.67:0/497522434 >> v2:172.21.15.97:3300/0 conn(0x7fe6bc15c030 msgr2=0x7fe6bc06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:03.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6b3fff640 1 --2- 172.21.15.67:0/497522434 >> v2:172.21.15.97:3300/0 conn(0x7fe6bc15c030 0x7fe6bc06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6b3fff640 1 -- 172.21.15.67:0/497522434 >> v1:172.21.15.97:6789/0 conn(0x7fe6bc0b3510 legacy=0x7fe6bc06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6b3fff640 1 -- 172.21.15.67:0/497522434 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc06ec60 con 0x7fe6bc15d1d0 2024-09-19T05:34:03.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6bbfff640 1 --2- 172.21.15.67:0/497522434 >> v2:172.21.15.97:3300/0 conn(0x7fe6bc15c030 0x7fe6bc06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:34:03.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6b3fff640 1 --2- 172.21.15.67:0/497522434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15d1d0 0x7fe6bc0b2fd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40097c0 tx=0x7fe6a401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d1451dd4dc5689a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:03.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6bb7fe640 1 -- 172.21.15.67:0/497522434 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a40ab600 con 0x7fe6bc15d1d0 2024-09-19T05:34:03.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6bb7fe640 1 -- 172.21.15.67:0/497522434 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a40b0070 con 0x7fe6bc15d1d0 2024-09-19T05:34:03.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6bb7fe640 1 -- 172.21.15.67:0/497522434 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a40ab9c0 con 0x7fe6bc15d1d0 2024-09-19T05:34:03.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6c298a640 1 -- 172.21.15.67:0/497522434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15d1d0 msgr2=0x7fe6bc0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6c298a640 1 --2- 172.21.15.67:0/497522434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15d1d0 0x7fe6bc0b2fd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40097c0 tx=0x7fe6a401c3e0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6c298a640 1 -- 172.21.15.67:0/497522434 shutdown_connections 2024-09-19T05:34:03.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6c298a640 1 --2- 172.21.15.67:0/497522434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15d1d0 0x7fe6bc0b2fd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6c298a640 1 --2- 172.21.15.67:0/497522434 >> v2:172.21.15.97:3300/0 conn(0x7fe6bc15c030 0x7fe6bc06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6c298a640 1 -- 172.21.15.67:0/497522434 >> 172.21.15.67:0/497522434 conn(0x7fe6bc0d0080 msgr2=0x7fe6bc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:03.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6c298a640 1 -- 172.21.15.67:0/497522434 shutdown_connections 2024-09-19T05:34:03.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.657+0000 7fe6c298a640 1 -- 172.21.15.67:0/497522434 wait complete. 2024-09-19T05:34:03.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c298a640 1 Processor -- start 2024-09-19T05:34:03.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c298a640 1 -- start start 2024-09-19T05:34:03.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c298a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6bc0b3510 0x7fe6bc099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c298a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15c030 0x7fe6bc156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c298a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6bc15d1d0 0x7fe6bc147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c298a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc15c410 con 0x7fe6bc0b3510 2024-09-19T05:34:03.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c298a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc15c590 con 0x7fe6bc15d1d0 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c298a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe6bc1690e0 con 0x7fe6bc15c030 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6bbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6bc0b3510 0x7fe6bc099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6bbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6bc0b3510 0x7fe6bc099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46408/0 (socket says 172.21.15.67:46408) 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6bbfff640 1 -- 172.21.15.67:0/1091340929 learned_addr learned my addr 172.21.15.67:0/1091340929 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6b3fff640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15c030 0x7fe6bc156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c0f27640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6bc15d1d0 0x7fe6bc147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6bbfff640 1 -- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15c030 msgr2=0x7fe6bc156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6bbfff640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15c030 0x7fe6bc156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6bbfff640 1 -- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6bc15d1d0 msgr2=0x7fe6bc147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6bbfff640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6bc15d1d0 0x7fe6bc147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6bbfff640 1 -- 172.21.15.67:0/1091340929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc099eb0 con 0x7fe6bc0b3510 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6bbfff640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6bc0b3510 0x7fe6bc099970 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00ea00 tx=0x7fe6ac00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:03.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6b97fa640 1 -- 172.21.15.67:0/1091340929 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac017070 con 0x7fe6bc0b3510 2024-09-19T05:34:03.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6b97fa640 1 -- 172.21.15.67:0/1091340929 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ac00ca60 con 0x7fe6bc0b3510 2024-09-19T05:34:03.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c298a640 1 -- 172.21.15.67:0/1091340929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc159880 con 0x7fe6bc0b3510 2024-09-19T05:34:03.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6b97fa640 1 -- 172.21.15.67:0/1091340929 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac00ce10 con 0x7fe6bc0b3510 2024-09-19T05:34:03.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.661+0000 7fe6c298a640 1 -- 172.21.15.67:0/1091340929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc159e40 con 0x7fe6bc0b3510 2024-09-19T05:34:03.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.665+0000 7fe6c298a640 1 -- 172.21.15.67:0/1091340929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6bc06dde0 con 0x7fe6bc0b3510 2024-09-19T05:34:03.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.665+0000 7fe6b97fa640 1 -- 172.21.15.67:0/1091340929 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6ac01a070 con 0x7fe6bc0b3510 2024-09-19T05:34:03.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.665+0000 7fe6b97fa640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe69c0678c0 0x7fe69c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:03.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.665+0000 7fe6b97fa640 1 -- 172.21.15.67:0/1091340929 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fe6ac0860b0 con 0x7fe6bc0b3510 2024-09-19T05:34:03.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.665+0000 7fe6b3fff640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe69c0678c0 0x7fe69c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:03.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.665+0000 7fe6b3fff640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe69c0678c0 0x7fe69c069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40af000 tx=0x7fe6a40b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:03.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.669+0000 7fe6b97fa640 1 -- 172.21.15.67:0/1091340929 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe6ac056f20 con 0x7fe6bc0b3510 2024-09-19T05:34:03.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.893+0000 7fe6c298a640 1 -- 172.21.15.67:0/1091340929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fe6bc0d0f20 con 0x7fe6bc0b3510 2024-09-19T05:34:03.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6b97fa640 1 -- 172.21.15.67:0/1091340929 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7fe6ac056820 con 0x7fe6bc0b3510 2024-09-19T05:34:03.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 -- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe69c0678c0 msgr2=0x7fe69c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe69c0678c0 0x7fe69c069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40af000 tx=0x7fe6a40b6040 comp rx=0 tx=0).stop 2024-09-19T05:34:03.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 -- 172.21.15.67:0/1091340929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6bc0b3510 msgr2=0x7fe6bc099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:03.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6bc0b3510 0x7fe6bc099970 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00ea00 tx=0x7fe6ac00eec0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 -- 172.21.15.67:0/1091340929 shutdown_connections 2024-09-19T05:34:03.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6bc15d1d0 0x7fe6bc147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe69c0678c0 0x7fe69c069d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6bc15c030 0x7fe6bc156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 --2- 172.21.15.67:0/1091340929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6bc0b3510 0x7fe6bc099970 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:03.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 -- 172.21.15.67:0/1091340929 >> 172.21.15.67:0/1091340929 conn(0x7fe6bc0d0080 msgr2=0x7fe6bc15c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:03.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 -- 172.21.15.67:0/1091340929 shutdown_connections 2024-09-19T05:34:03.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:03.897+0000 7fe6c298a640 1 -- 172.21.15.67:0/1091340929 wait complete. 2024-09-19T05:34:03.919 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-19T05:34:04.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a17386640 1 Processor -- start 2024-09-19T05:34:04.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a17386640 1 -- start start 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a17386640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3a10161da0 0x7f3a100d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a17386640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a100d0160 0x7f3a100d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a17386640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a100d05d0 con 0x7f3a100d0e80 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a17386640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3a100d1830 con 0x7f3a100d0160 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a17386640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3a100d0840 con 0x7f3a10161da0 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a15923640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a100d0160 0x7f3a100d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a15923640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a100d0160 0x7f3a100d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46414/0 (socket says 172.21.15.67:46414) 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a14921640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3a100d0e80 0x7f3a100b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46830/0 (socket says 172.21.15.67:46830) 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a15923640 1 -- 172.21.15.67:0/1556678311 learned_addr learned my addr 172.21.15.67:0/1556678311 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a15122640 1 --2- 172.21.15.67:0/1556678311 >> v2:172.21.15.97:3300/0 conn(0x7f3a10161da0 0x7f3a100d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a15923640 1 -- 172.21.15.67:0/1556678311 >> v2:172.21.15.97:3300/0 conn(0x7f3a10161da0 msgr2=0x7f3a100d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a15923640 1 --2- 172.21.15.67:0/1556678311 >> v2:172.21.15.97:3300/0 conn(0x7f3a10161da0 0x7f3a100d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a15923640 1 -- 172.21.15.67:0/1556678311 >> v1:172.21.15.67:6789/0 conn(0x7f3a100d0e80 legacy=0x7f3a100b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a15923640 1 -- 172.21.15.67:0/1556678311 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a100d4d40 con 0x7f3a100d0160 2024-09-19T05:34:04.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a07fff640 1 -- 172.21.15.67:0/1556678311 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598151215 0 0) 0x7f3a100d05d0 con 0x7f3a100d0e80 2024-09-19T05:34:04.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.037+0000 7f3a15122640 1 --2- 172.21.15.67:0/1556678311 >> v2:172.21.15.97:3300/0 conn(0x7f3a10161da0 0x7f3a100d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:04.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a15923640 1 --2- 172.21.15.67:0/1556678311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 0x7f3a100d12f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3a100b5f50 tx=0x7f3a0801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d67d0e4a03f64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:04.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a07fff640 1 -- 172.21.15.67:0/1556678311 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a080a57a0 con 0x7f3a100d0160 2024-09-19T05:34:04.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a07fff640 1 -- 172.21.15.67:0/1556678311 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a080a5940 con 0x7f3a100d0160 2024-09-19T05:34:04.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a07fff640 1 -- 172.21.15.67:0/1556678311 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a080a5d10 con 0x7f3a100d0160 2024-09-19T05:34:04.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- 172.21.15.67:0/1556678311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 msgr2=0x7f3a100d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 --2- 172.21.15.67:0/1556678311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 0x7f3a100d12f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3a100b5f50 tx=0x7f3a0801c9f0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- 172.21.15.67:0/1556678311 shutdown_connections 2024-09-19T05:34:04.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 --2- 172.21.15.67:0/1556678311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 0x7f3a100d12f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 --2- 172.21.15.67:0/1556678311 >> v2:172.21.15.97:3300/0 conn(0x7f3a10161da0 0x7f3a100d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- 172.21.15.67:0/1556678311 >> 172.21.15.67:0/1556678311 conn(0x7f3a1008bfc0 msgr2=0x7f3a100d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:04.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- 172.21.15.67:0/1556678311 shutdown_connections 2024-09-19T05:34:04.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- 172.21.15.67:0/1556678311 wait complete. 2024-09-19T05:34:04.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 Processor -- start 2024-09-19T05:34:04.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- start start 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 0x7f3a1014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a100d0e80 0x7f3a100cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a10161da0 0x7f3a10155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a10162180 con 0x7f3a100d0160 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3a100b5d00 con 0x7f3a10161da0 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3a100b50e0 con 0x7f3a100d0e80 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a15122640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 0x7f3a1014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a15122640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 0x7f3a1014e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46424/0 (socket says 172.21.15.67:46424) 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a15122640 1 -- 172.21.15.67:0/1787072047 learned_addr learned my addr 172.21.15.67:0/1787072047 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a15122640 1 -- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a100d0e80 msgr2=0x7f3a100cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a15122640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a100d0e80 0x7f3a100cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a15122640 1 -- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a10161da0 msgr2=0x7f3a10155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a15122640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a10161da0 0x7f3a10155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a15122640 1 -- 172.21.15.67:0/1787072047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1015e5c0 con 0x7f3a100d0160 2024-09-19T05:34:04.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a15122640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 0x7f3a1014e450 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c820 tx=0x7f3a0c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:04.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a05ffb640 1 -- 172.21.15.67:0/1787072047 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c015070 con 0x7f3a100d0160 2024-09-19T05:34:04.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a05ffb640 1 -- 172.21.15.67:0/1787072047 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0c007a30 con 0x7f3a100d0160 2024-09-19T05:34:04.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- 172.21.15.67:0/1787072047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a100cbfb0 con 0x7f3a100d0160 2024-09-19T05:34:04.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a05ffb640 1 -- 172.21.15.67:0/1787072047 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c007e00 con 0x7f3a100d0160 2024-09-19T05:34:04.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.041+0000 7f3a17386640 1 -- 172.21.15.67:0/1787072047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a100cc570 con 0x7f3a100d0160 2024-09-19T05:34:04.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.045+0000 7f3a17386640 1 -- 172.21.15.67:0/1787072047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a10068ea0 con 0x7f3a100d0160 2024-09-19T05:34:04.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.045+0000 7f3a05ffb640 1 -- 172.21.15.67:0/1787072047 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a0c018070 con 0x7f3a100d0160 2024-09-19T05:34:04.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.045+0000 7f3a05ffb640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39f40678c0 0x7f39f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.045+0000 7f3a05ffb640 1 -- 172.21.15.67:0/1787072047 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f3a0c085920 con 0x7f3a100d0160 2024-09-19T05:34:04.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.045+0000 7f3a14921640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39f40678c0 0x7f39f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.045+0000 7f3a14921640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39f40678c0 0x7f39f4069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3a000011f0 tx=0x7f3a00007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:04.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.049+0000 7f3a05ffb640 1 -- 172.21.15.67:0/1787072047 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3a1015e5c0 con 0x7f3a100d0160 2024-09-19T05:34:04.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.261+0000 7f3a17386640 1 -- 172.21.15.67:0/1787072047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f3a100b5470 con 0x7f3a100d0160 2024-09-19T05:34:04.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.265+0000 7f3a05ffb640 1 -- 172.21.15.67:0/1787072047 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f3a0c0566b0 con 0x7f3a100d0160 2024-09-19T05:34:04.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 -- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39f40678c0 msgr2=0x7f39f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39f40678c0 0x7f39f4069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3a000011f0 tx=0x7f3a00007930 comp rx=0 tx=0).stop 2024-09-19T05:34:04.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 -- 172.21.15.67:0/1787072047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 msgr2=0x7f3a1014e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 0x7f3a1014e450 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c820 tx=0x7f3a0c00cce0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 -- 172.21.15.67:0/1787072047 shutdown_connections 2024-09-19T05:34:04.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a10161da0 0x7f3a10155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39f40678c0 0x7f39f4069d80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a100d0e80 0x7f3a100cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 --2- 172.21.15.67:0/1787072047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100d0160 0x7f3a1014e450 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 -- 172.21.15.67:0/1787072047 >> 172.21.15.67:0/1787072047 conn(0x7f3a1008bfc0 msgr2=0x7f3a100b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:04.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 -- 172.21.15.67:0/1787072047 shutdown_connections 2024-09-19T05:34:04.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.269+0000 7f3a17386640 1 -- 172.21.15.67:0/1787072047 wait complete. 2024-09-19T05:34:04.289 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:34:04.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f7102f4e640 1 Processor -- start 2024-09-19T05:34:04.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f7102f4e640 1 -- start start 2024-09-19T05:34:04.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f7102f4e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70fc06dde0 0x7f70fc0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f7102f4e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0b3510 0x7f70fc06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f7102f4e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70fc06e3c0 con 0x7f70fc15c030 2024-09-19T05:34:04.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f7102f4e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f70fc06e6a0 con 0x7f70fc06dde0 2024-09-19T05:34:04.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f7102f4e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f70fc06e980 con 0x7f70fc0b3510 2024-09-19T05:34:04.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f70fbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70fc06dde0 0x7f70fc0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f70fbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70fc06dde0 0x7f70fc0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46426/0 (socket says 172.21.15.67:46426) 2024-09-19T05:34:04.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f7100cea640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f70fc15c030 0x7f70fc15d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:39728/0 (socket says 172.21.15.67:39728) 2024-09-19T05:34:04.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f70fbfff640 1 -- 172.21.15.67:0/681179011 learned_addr learned my addr 172.21.15.67:0/681179011 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:04.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f71014eb640 1 --2- 172.21.15.67:0/681179011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0b3510 0x7f70fc06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f70fbfff640 1 -- 172.21.15.67:0/681179011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0b3510 msgr2=0x7f70fc06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:04.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f70fbfff640 1 --2- 172.21.15.67:0/681179011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0b3510 0x7f70fc06f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f70fbfff640 1 -- 172.21.15.67:0/681179011 >> v1:172.21.15.97:6789/0 conn(0x7f70fc15c030 legacy=0x7f70fc15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.401+0000 7f70fbfff640 1 -- 172.21.15.67:0/681179011 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70fc06ec60 con 0x7f70fc06dde0 2024-09-19T05:34:04.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fbfff640 1 --2- 172.21.15.67:0/681179011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc06dde0 0x7f70fc0b2fd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009870 tx=0x7f70f001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111da01d9b7fb43c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:04.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fb7fe640 1 -- 172.21.15.67:0/681179011 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f00ab640 con 0x7f70fc06dde0 2024-09-19T05:34:04.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fb7fe640 1 -- 172.21.15.67:0/681179011 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f00b0070 con 0x7f70fc06dde0 2024-09-19T05:34:04.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fb7fe640 1 -- 172.21.15.67:0/681179011 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f00aba00 con 0x7f70fc06dde0 2024-09-19T05:34:04.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 -- 172.21.15.67:0/681179011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc06dde0 msgr2=0x7f70fc0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 --2- 172.21.15.67:0/681179011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc06dde0 0x7f70fc0b2fd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009870 tx=0x7f70f001c530 comp rx=0 tx=0).stop 2024-09-19T05:34:04.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 -- 172.21.15.67:0/681179011 shutdown_connections 2024-09-19T05:34:04.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 --2- 172.21.15.67:0/681179011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0b3510 0x7f70fc06f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 --2- 172.21.15.67:0/681179011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc06dde0 0x7f70fc0b2fd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 -- 172.21.15.67:0/681179011 >> 172.21.15.67:0/681179011 conn(0x7f70fc0d0080 msgr2=0x7f70fc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:04.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 -- 172.21.15.67:0/681179011 shutdown_connections 2024-09-19T05:34:04.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 -- 172.21.15.67:0/681179011 wait complete. 2024-09-19T05:34:04.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 Processor -- start 2024-09-19T05:34:04.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 -- start start 2024-09-19T05:34:04.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc06dde0 0x7f70fc14b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc0b3510 0x7f70fc14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc15c030 0x7f70fc14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1692f0 con 0x7f70fc0b3510 2024-09-19T05:34:04.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc15c620 con 0x7f70fc15c030 2024-09-19T05:34:04.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f7102f4e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f70fc169470 con 0x7f70fc06dde0 2024-09-19T05:34:04.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc0b3510 0x7f70fc14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc0b3510 0x7f70fc14c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46442/0 (socket says 172.21.15.67:46442) 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fbfff640 1 -- 172.21.15.67:0/1777815114 learned_addr learned my addr 172.21.15.67:0/1777815114 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f71014eb640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc15c030 0x7f70fc14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fbfff640 1 -- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc06dde0 msgr2=0x7f70fc14b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fbfff640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc06dde0 0x7f70fc14b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fbfff640 1 -- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc15c030 msgr2=0x7f70fc14dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fbfff640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc15c030 0x7f70fc14dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fbfff640 1 -- 172.21.15.67:0/1777815114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70fc14eee0 con 0x7f70fc0b3510 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f71014eb640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc15c030 0x7f70fc14dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.405+0000 7f70fbfff640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc0b3510 0x7f70fc14c2d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f70f00ad040 tx=0x7f70f001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f70f97fa640 1 -- 172.21.15.67:0/1777815114 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f00be3f0 con 0x7f70fc0b3510 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f70f97fa640 1 -- 172.21.15.67:0/1777815114 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f00be590 con 0x7f70fc0b3510 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f7102f4e640 1 -- 172.21.15.67:0/1777815114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70fc14f150 con 0x7f70fc0b3510 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f70f97fa640 1 -- 172.21.15.67:0/1777815114 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f00be980 con 0x7f70fc0b3510 2024-09-19T05:34:04.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f7102f4e640 1 -- 172.21.15.67:0/1777815114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70fc14c810 con 0x7f70fc0b3510 2024-09-19T05:34:04.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f7102f4e640 1 -- 172.21.15.67:0/1777815114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70fc0b2fd0 con 0x7f70fc0b3510 2024-09-19T05:34:04.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f70f97fa640 1 -- 172.21.15.67:0/1777815114 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70f00b43f0 con 0x7f70fc0b3510 2024-09-19T05:34:04.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f70f97fa640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70e80678f0 0x7f70e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f70f97fa640 1 -- 172.21.15.67:0/1777815114 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f70f011ff90 con 0x7f70fc0b3510 2024-09-19T05:34:04.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f7100cea640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70e80678f0 0x7f70e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.409+0000 7f7100cea640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70e80678f0 0x7f70e8069db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f70ec001550 tx=0x7f70ec0079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:04.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.413+0000 7f70f97fa640 1 -- 172.21.15.67:0/1777815114 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f70f00c4060 con 0x7f70fc0b3510 2024-09-19T05:34:04.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 -- 172.21.15.67:0/1777815114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f70fc0d0f20 con 0x7f70fc0b3510 2024-09-19T05:34:04.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f70f97fa640 1 -- 172.21.15.67:0/1777815114 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f70f0016150 con 0x7f70fc0b3510 2024-09-19T05:34:04.577 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:04.577 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:34:04.578 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:34:04.578 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:34:04.578 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:34:04.578 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:04.578 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 -- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70e80678f0 msgr2=0x7f70e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70e80678f0 0x7f70e8069db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f70ec001550 tx=0x7f70ec0079d0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 -- 172.21.15.67:0/1777815114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc0b3510 msgr2=0x7f70fc14c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc0b3510 0x7f70fc14c2d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f70f00ad040 tx=0x7f70f001ad70 comp rx=0 tx=0).stop 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 -- 172.21.15.67:0/1777815114 shutdown_connections 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc15c030 0x7f70fc14dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70fc0b3510 0x7f70fc14c2d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70e80678f0 0x7f70e8069db0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 --2- 172.21.15.67:0/1777815114 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc06dde0 0x7f70fc14b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 -- 172.21.15.67:0/1777815114 >> 172.21.15.67:0/1777815114 conn(0x7f70fc0d0080 msgr2=0x7f70fc15f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 -- 172.21.15.67:0/1777815114 shutdown_connections 2024-09-19T05:34:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.573+0000 7f7102f4e640 1 -- 172.21.15.67:0/1777815114 wait complete. 2024-09-19T05:34:04.595 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:34:04.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:34:04.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448f869640 1 Processor -- start 2024-09-19T05:34:04.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448f869640 1 -- start start 2024-09-19T05:34:04.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448f869640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f44880cf5e0 0x7f44880d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448f869640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f448815c850 0x7f448806e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448f869640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448815d030 con 0x7f448806eb40 2024-09-19T05:34:04.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448f869640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f448806de90 con 0x7f44880cf5e0 2024-09-19T05:34:04.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448f869640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f448806e170 con 0x7f448815c850 2024-09-19T05:34:04.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448d605640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f44880cf5e0 0x7f44880d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448d605640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f44880cf5e0 0x7f44880d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46458/0 (socket says 172.21.15.67:46458) 2024-09-19T05:34:04.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448d605640 1 -- 172.21.15.67:0/25694893 learned_addr learned my addr 172.21.15.67:0/25694893 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:04.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448ce04640 1 --2- 172.21.15.67:0/25694893 >> v2:172.21.15.97:3300/0 conn(0x7f448815c850 0x7f448806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448d605640 1 -- 172.21.15.67:0/25694893 >> v2:172.21.15.97:3300/0 conn(0x7f448815c850 msgr2=0x7f448806e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:04.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448d605640 1 --2- 172.21.15.67:0/25694893 >> v2:172.21.15.97:3300/0 conn(0x7f448815c850 0x7f448806e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448d605640 1 -- 172.21.15.67:0/25694893 >> v1:172.21.15.97:6789/0 conn(0x7f448806eb40 legacy=0x7f448815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:04.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.713+0000 7f448d605640 1 -- 172.21.15.67:0/25694893 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448815d310 con 0x7f44880cf5e0 2024-09-19T05:34:04.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448d605640 1 --2- 172.21.15.67:0/25694893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44880cf5e0 0x7f44880d0aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f448815a380 tx=0x7f447801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba278fc40e1a37e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:04.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f447ffff640 1 -- 172.21.15.67:0/25694893 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44780aa430 con 0x7f44880cf5e0 2024-09-19T05:34:04.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f447ffff640 1 -- 172.21.15.67:0/25694893 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44780af070 con 0x7f44880cf5e0 2024-09-19T05:34:04.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f447ffff640 1 -- 172.21.15.67:0/25694893 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44780aa7f0 con 0x7f44880cf5e0 2024-09-19T05:34:04.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448f869640 1 -- 172.21.15.67:0/25694893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44880cf5e0 msgr2=0x7f44880d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448f869640 1 --2- 172.21.15.67:0/25694893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44880cf5e0 0x7f44880d0aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f448815a380 tx=0x7f447801c4b0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448f869640 1 -- 172.21.15.67:0/25694893 shutdown_connections 2024-09-19T05:34:04.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448f869640 1 --2- 172.21.15.67:0/25694893 >> v2:172.21.15.97:3300/0 conn(0x7f448815c850 0x7f448806e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448f869640 1 --2- 172.21.15.67:0/25694893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44880cf5e0 0x7f44880d0aa0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448f869640 1 -- 172.21.15.67:0/25694893 >> 172.21.15.67:0/25694893 conn(0x7f448806c0c0 msgr2=0x7f448806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:04.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448f869640 1 -- 172.21.15.67:0/25694893 shutdown_connections 2024-09-19T05:34:04.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448f869640 1 -- 172.21.15.67:0/25694893 wait complete. 2024-09-19T05:34:04.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448f869640 1 Processor -- start 2024-09-19T05:34:04.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.717+0000 7f448f869640 1 -- start start 2024-09-19T05:34:04.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448f869640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f448806eb40 0x7f4488073610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448f869640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44880cf5e0 0x7f448814f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448f869640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f448815c850 0x7f448814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448f869640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4488169130 con 0x7f448815c850 2024-09-19T05:34:04.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448f869640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4488168fb0 con 0x7f448806eb40 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448f869640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f44881692b0 con 0x7f44880cf5e0 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448de06640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f448815c850 0x7f448814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448de06640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f448815c850 0x7f448814b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46464/0 (socket says 172.21.15.67:46464) 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448de06640 1 -- 172.21.15.67:0/3467745105 learned_addr learned my addr 172.21.15.67:0/3467745105 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448ce04640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44880cf5e0 0x7f448814f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448de06640 1 -- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44880cf5e0 msgr2=0x7f448814f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448de06640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44880cf5e0 0x7f448814f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448de06640 1 -- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f448806eb40 msgr2=0x7f4488073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448de06640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f448806eb40 0x7f4488073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448de06640 1 -- 172.21.15.67:0/3467745105 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44881512c0 con 0x7f448815c850 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448de06640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f448815c850 0x7f448814b4d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f448000c780 tx=0x7f448000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f447dffb640 1 -- 172.21.15.67:0/3467745105 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480017070 con 0x7f448815c850 2024-09-19T05:34:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f447dffb640 1 -- 172.21.15.67:0/3467745105 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4480003db0 con 0x7f448815c850 2024-09-19T05:34:04.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f447dffb640 1 -- 172.21.15.67:0/3467745105 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44800052b0 con 0x7f448815c850 2024-09-19T05:34:04.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448f869640 1 -- 172.21.15.67:0/3467745105 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4488072b30 con 0x7f448815c850 2024-09-19T05:34:04.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448f869640 1 -- 172.21.15.67:0/3467745105 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44880730f0 con 0x7f448815c850 2024-09-19T05:34:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448f869640 1 -- 172.21.15.67:0/3467745105 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44880b5070 con 0x7f448815c850 2024-09-19T05:34:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f447dffb640 1 -- 172.21.15.67:0/3467745105 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f448001a070 con 0x7f448815c850 2024-09-19T05:34:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f447dffb640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f446c0678c0 0x7f446c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f447dffb640 1 -- 172.21.15.67:0/3467745105 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f4480085070 con 0x7f448815c850 2024-09-19T05:34:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.721+0000 7f448d605640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f446c0678c0 0x7f446c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.725+0000 7f448d605640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f446c0678c0 0x7f446c069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44780ae000 tx=0x7f4478004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:04.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.729+0000 7f447dffb640 1 -- 172.21.15.67:0/3467745105 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4480055e00 con 0x7f448815c850 2024-09-19T05:34:04.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:04.893+0000 7f448f869640 1 -- 172.21.15.67:0/3467745105 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f448806cdf0 con 0x7f448815c850 2024-09-19T05:34:05.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.797+0000 7f447dffb640 1 -- 172.21.15.67:0/3467745105 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f4480055700 con 0x7f448815c850 2024-09-19T05:34:05.803 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:34:05.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 -- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f446c0678c0 msgr2=0x7f446c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:05.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f446c0678c0 0x7f446c069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44780ae000 tx=0x7f4478004740 comp rx=0 tx=0).stop 2024-09-19T05:34:05.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 -- 172.21.15.67:0/3467745105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f448815c850 msgr2=0x7f448814b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:05.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f448815c850 0x7f448814b4d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f448000c780 tx=0x7f448000cc40 comp rx=0 tx=0).stop 2024-09-19T05:34:05.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 -- 172.21.15.67:0/3467745105 shutdown_connections 2024-09-19T05:34:05.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f448815c850 0x7f448814b4d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:05.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f446c0678c0 0x7f446c069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:05.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44880cf5e0 0x7f448814f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:05.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 --2- 172.21.15.67:0/3467745105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f448806eb40 0x7f4488073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:05.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 -- 172.21.15.67:0/3467745105 >> 172.21.15.67:0/3467745105 conn(0x7f448806c0c0 msgr2=0x7f44880b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:05.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 -- 172.21.15.67:0/3467745105 shutdown_connections 2024-09-19T05:34:05.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.805+0000 7f448f869640 1 -- 172.21.15.67:0/3467745105 wait complete. 2024-09-19T05:34:05.837 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:34:05.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.957+0000 7fa5f63a1640 1 Processor -- start 2024-09-19T05:34:05.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.957+0000 7fa5f63a1640 1 -- start start 2024-09-19T05:34:05.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.957+0000 7fa5f63a1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa5f00b4f00 0x7fa5f015ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:05.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.957+0000 7fa5f63a1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5f006f9a0 0x7fa5f0168070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.957+0000 7fa5f63a1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f015f030 con 0x7fa5f006ccd0 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.957+0000 7fa5f63a1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f006fe30 con 0x7fa5f006f9a0 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.957+0000 7fa5f63a1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f015f310 con 0x7fa5f00b4f00 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f493e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5f006f9a0 0x7fa5f0168070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f493e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5f006f9a0 0x7fa5f0168070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36480/0 (socket says 172.21.15.67:36480) 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f493e640 1 -- 172.21.15.67:0/3800190799 learned_addr learned my addr 172.21.15.67:0/3800190799 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f493e640 1 -- 172.21.15.67:0/3800190799 >> v2:172.21.15.97:3300/0 conn(0x7fa5f00b4f00 msgr2=0x7fa5f015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5ef7fe640 1 --2- 172.21.15.67:0/3800190799 >> v2:172.21.15.97:3300/0 conn(0x7fa5f00b4f00 0x7fa5f015ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f493e640 1 --2- 172.21.15.67:0/3800190799 >> v2:172.21.15.97:3300/0 conn(0x7fa5f00b4f00 0x7fa5f015ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f493e640 1 -- 172.21.15.67:0/3800190799 >> v1:172.21.15.97:6789/0 conn(0x7fa5f006ccd0 legacy=0x7fa5f006d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f493e640 1 -- 172.21.15.67:0/3800190799 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f015f5f0 con 0x7fa5f006f9a0 2024-09-19T05:34:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5ef7fe640 1 --2- 172.21.15.67:0/3800190799 >> v2:172.21.15.97:3300/0 conn(0x7fa5f00b4f00 0x7fa5f015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:05.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f493e640 1 --2- 172.21.15.67:0/3800190799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 0x7fa5f0168070 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0073f40 tx=0x7fa5e801cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ee835bc22c751 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:05.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5eeffd640 1 -- 172.21.15.67:0/3800190799 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80ab5f0 con 0x7fa5f006f9a0 2024-09-19T05:34:05.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5eeffd640 1 -- 172.21.15.67:0/3800190799 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e80b0070 con 0x7fa5f006f9a0 2024-09-19T05:34:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5eeffd640 1 -- 172.21.15.67:0/3800190799 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80ab9b0 con 0x7fa5f006f9a0 2024-09-19T05:34:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f63a1640 1 -- 172.21.15.67:0/3800190799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 msgr2=0x7fa5f0168070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:05.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f63a1640 1 --2- 172.21.15.67:0/3800190799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 0x7fa5f0168070 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0073f40 tx=0x7fa5e801cf40 comp rx=0 tx=0).stop 2024-09-19T05:34:05.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f63a1640 1 -- 172.21.15.67:0/3800190799 shutdown_connections 2024-09-19T05:34:05.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f63a1640 1 --2- 172.21.15.67:0/3800190799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 0x7fa5f0168070 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:05.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f63a1640 1 --2- 172.21.15.67:0/3800190799 >> v2:172.21.15.97:3300/0 conn(0x7fa5f00b4f00 0x7fa5f015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:05.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f63a1640 1 -- 172.21.15.67:0/3800190799 >> 172.21.15.67:0/3800190799 conn(0x7fa5f00727b0 msgr2=0x7fa5f0072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:05.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f63a1640 1 -- 172.21.15.67:0/3800190799 shutdown_connections 2024-09-19T05:34:05.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.961+0000 7fa5f63a1640 1 -- 172.21.15.67:0/3800190799 wait complete. 2024-09-19T05:34:05.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 Processor -- start 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 -- start start 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5f006ccd0 0x7fa5f0151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 0x7fa5f01584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f00b4f00 0x7fa5f014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f016add0 con 0x7fa5f006f9a0 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f00b0380 con 0x7fa5f00b4f00 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f016af50 con 0x7fa5f006ccd0 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ef7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 0x7fa5f01584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ef7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 0x7fa5f01584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36496/0 (socket says 172.21.15.67:36496) 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ef7fe640 1 -- 172.21.15.67:0/2199178585 learned_addr learned my addr 172.21.15.67:0/2199178585 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f493e640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f00b4f00 0x7fa5f014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5effff640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5f006ccd0 0x7fa5f0151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ef7fe640 1 -- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5f006ccd0 msgr2=0x7fa5f0151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ef7fe640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5f006ccd0 0x7fa5f0151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ef7fe640 1 -- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f00b4f00 msgr2=0x7fa5f014dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ef7fe640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f00b4f00 0x7fa5f014dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ef7fe640 1 -- 172.21.15.67:0/2199178585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f014e010 con 0x7fa5f006f9a0 2024-09-19T05:34:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f493e640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f00b4f00 0x7fa5f014dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:34:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ef7fe640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 0x7fa5f01584e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400c7f0 tx=0x7fa5e400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ecff9640 1 -- 172.21.15.67:0/2199178585 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4007a30 con 0x7fa5f006f9a0 2024-09-19T05:34:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ecff9640 1 -- 172.21.15.67:0/2199178585 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e4007bd0 con 0x7fa5f006f9a0 2024-09-19T05:34:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5ecff9640 1 -- 172.21.15.67:0/2199178585 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e40113f0 con 0x7fa5f006f9a0 2024-09-19T05:34:05.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 -- 172.21.15.67:0/2199178585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f0157bc0 con 0x7fa5f006f9a0 2024-09-19T05:34:05.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 -- 172.21.15.67:0/2199178585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f0156e00 con 0x7fa5f006f9a0 2024-09-19T05:34:05.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.965+0000 7fa5f63a1640 1 -- 172.21.15.67:0/2199178585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f015ea50 con 0x7fa5f006f9a0 2024-09-19T05:34:05.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.969+0000 7fa5ecff9640 1 -- 172.21.15.67:0/2199178585 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5e4011590 con 0x7fa5f006f9a0 2024-09-19T05:34:05.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.969+0000 7fa5ecff9640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5dc0678c0 0x7fa5dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:05.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.969+0000 7fa5ecff9640 1 -- 172.21.15.67:0/2199178585 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7fa5e4085e50 con 0x7fa5f006f9a0 2024-09-19T05:34:05.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.969+0000 7fa5effff640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5dc0678c0 0x7fa5dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:05.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.969+0000 7fa5effff640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5dc0678c0 0x7fa5dc069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009f20 tx=0x7fa5e00094d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:05.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:05.973+0000 7fa5ecff9640 1 -- 172.21.15.67:0/2199178585 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa5e4015020 con 0x7fa5f006f9a0 2024-09-19T05:34:06.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.137+0000 7fa5f63a1640 1 -- 172.21.15.67:0/2199178585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa5f006ec90 con 0x7fa5f006f9a0 2024-09-19T05:34:06.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.800+0000 7fa5ecff9640 1 -- 172.21.15.67:0/2199178585 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7fa5e40569d0 con 0x7fa5f006f9a0 2024-09-19T05:34:06.808 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:34:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 -- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5dc0678c0 msgr2=0x7fa5dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5dc0678c0 0x7fa5dc069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009f20 tx=0x7fa5e00094d0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 -- 172.21.15.67:0/2199178585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 msgr2=0x7fa5f01584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 0x7fa5f01584e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400c7f0 tx=0x7fa5e400ccb0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 -- 172.21.15.67:0/2199178585 shutdown_connections 2024-09-19T05:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f00b4f00 0x7fa5f014dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f006f9a0 0x7fa5f01584e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5dc0678c0 0x7fa5dc069d80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 --2- 172.21.15.67:0/2199178585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5f006ccd0 0x7fa5f0151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 -- 172.21.15.67:0/2199178585 >> 172.21.15.67:0/2199178585 conn(0x7fa5f00727b0 msgr2=0x7fa5f00b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 -- 172.21.15.67:0/2199178585 shutdown_connections 2024-09-19T05:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.804+0000 7fa5f63a1640 1 -- 172.21.15.67:0/2199178585 wait complete. 2024-09-19T05:34:06.849 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:34:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4663e85640 1 Processor -- start 2024-09-19T05:34:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4663e85640 1 -- start start 2024-09-19T05:34:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4663e85640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465c15e690 0x7f465c0d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4663e85640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f465c0d4fb0 0x7f465c0d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4663e85640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c0d35a0 con 0x7f465c0d13c0 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4663e85640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f465c0d32c0 con 0x7f465c0d4fb0 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4663e85640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f465c06d040 con 0x7f465c15e690 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4661420640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f465c0d4fb0 0x7f465c0d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4661420640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f465c0d4fb0 0x7f465c0d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36504/0 (socket says 172.21.15.67:36504) 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4661420640 1 -- 172.21.15.67:0/2494503999 learned_addr learned my addr 172.21.15.67:0/2494503999 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4661c21640 1 --2- 172.21.15.67:0/2494503999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465c15e690 0x7f465c0d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4661420640 1 -- 172.21.15.67:0/2494503999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465c15e690 msgr2=0x7f465c0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4661420640 1 --2- 172.21.15.67:0/2494503999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465c15e690 0x7f465c0d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4661420640 1 -- 172.21.15.67:0/2494503999 >> v1:172.21.15.97:6789/0 conn(0x7f465c0d13c0 legacy=0x7f465c0cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.972+0000 7f4661420640 1 -- 172.21.15.67:0/2494503999 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c06d320 con 0x7f465c0d4fb0 2024-09-19T05:34:06.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4661420640 1 --2- 172.21.15.67:0/2494503999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c0d4fb0 0x7f465c0d0e80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f464c009870 tx=0x7f464c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890faab022e1bf02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:06.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4660c1f640 1 -- 172.21.15.67:0/2494503999 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c0b0070 con 0x7f465c0d4fb0 2024-09-19T05:34:06.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4660c1f640 1 -- 172.21.15.67:0/2494503999 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f464c0ab600 con 0x7f465c0d4fb0 2024-09-19T05:34:06.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4660c1f640 1 -- 172.21.15.67:0/2494503999 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c0ab9d0 con 0x7f465c0d4fb0 2024-09-19T05:34:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 -- 172.21.15.67:0/2494503999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c0d4fb0 msgr2=0x7f465c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 --2- 172.21.15.67:0/2494503999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c0d4fb0 0x7f465c0d0e80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f464c009870 tx=0x7f464c01c520 comp rx=0 tx=0).stop 2024-09-19T05:34:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 -- 172.21.15.67:0/2494503999 shutdown_connections 2024-09-19T05:34:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 --2- 172.21.15.67:0/2494503999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c0d4fb0 0x7f465c0d0e80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 --2- 172.21.15.67:0/2494503999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465c15e690 0x7f465c0d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 -- 172.21.15.67:0/2494503999 >> 172.21.15.67:0/2494503999 conn(0x7f465c0d4490 msgr2=0x7f465c0d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 -- 172.21.15.67:0/2494503999 shutdown_connections 2024-09-19T05:34:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 -- 172.21.15.67:0/2494503999 wait complete. 2024-09-19T05:34:06.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 Processor -- start 2024-09-19T05:34:06.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 -- start start 2024-09-19T05:34:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465c0d13c0 0x7f465c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f465c0d4fb0 0x7f465c159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c15e690 0x7f465c156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f465c06ecb0 con 0x7f465c15e690 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f465c06eb30 con 0x7f465c0d4fb0 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4663e85640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f465c16b250 con 0x7f465c0d13c0 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4662422640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c15e690 0x7f465c156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4662422640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c15e690 0x7f465c156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36506/0 (socket says 172.21.15.67:36506) 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.976+0000 7f4662422640 1 -- 172.21.15.67:0/2725865362 learned_addr learned my addr 172.21.15.67:0/2725865362 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4661c21640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465c0d13c0 0x7f465c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4661420640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f465c0d4fb0 0x7f465c159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4662422640 1 -- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465c0d13c0 msgr2=0x7f465c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4662422640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465c0d13c0 0x7f465c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4662422640 1 -- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f465c0d4fb0 msgr2=0x7f465c159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4662422640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f465c0d4fb0 0x7f465c159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4662422640 1 -- 172.21.15.67:0/2725865362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c156600 con 0x7f465c15e690 2024-09-19T05:34:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4661420640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f465c0d4fb0 0x7f465c159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4662422640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c15e690 0x7f465c156970 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f465400c780 tx=0x7f465400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f46527fc640 1 -- 172.21.15.67:0/2725865362 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654004b70 con 0x7f465c15e690 2024-09-19T05:34:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f46527fc640 1 -- 172.21.15.67:0/2725865362 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4654004d10 con 0x7f465c15e690 2024-09-19T05:34:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4663e85640 1 -- 172.21.15.67:0/2725865362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c1526f0 con 0x7f465c15e690 2024-09-19T05:34:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f46527fc640 1 -- 172.21.15.67:0/2725865362 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465400aa90 con 0x7f465c15e690 2024-09-19T05:34:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4663e85640 1 -- 172.21.15.67:0/2725865362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c152cb0 con 0x7f465c15e690 2024-09-19T05:34:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4663e85640 1 -- 172.21.15.67:0/2725865362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c0d0e80 con 0x7f465c15e690 2024-09-19T05:34:06.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f46527fc640 1 -- 172.21.15.67:0/2725865362 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f465400ac30 con 0x7f465c15e690 2024-09-19T05:34:06.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f46527fc640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46400678c0 0x7f4640069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:06.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f46527fc640 1 -- 172.21.15.67:0/2725865362 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7f46540860c0 con 0x7f465c15e690 2024-09-19T05:34:06.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4661c21640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46400678c0 0x7f4640069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:06.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.980+0000 7f4661c21640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46400678c0 0x7f4640069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f465c0ce830 tx=0x7f4658008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:06.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:06.984+0000 7f46527fc640 1 -- 172.21.15.67:0/2725865362 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4654020070 con 0x7f465c15e690 2024-09-19T05:34:07.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.188+0000 7f4663e85640 1 -- 172.21.15.67:0/2725865362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f465c0b54b0 con 0x7f465c15e690 2024-09-19T05:34:07.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.820+0000 7f46527fc640 1 -- 172.21.15.67:0/2725865362 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f4654056ad0 con 0x7f465c15e690 2024-09-19T05:34:07.828 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 5 and data pool 6 2024-09-19T05:34:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.824+0000 7f4663e85640 1 -- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46400678c0 msgr2=0x7f4640069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.824+0000 7f4663e85640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46400678c0 0x7f4640069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f465c0ce830 tx=0x7f4658008040 comp rx=0 tx=0).stop 2024-09-19T05:34:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.828+0000 7f4663e85640 1 -- 172.21.15.67:0/2725865362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c15e690 msgr2=0x7f465c156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.828+0000 7f4663e85640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c15e690 0x7f465c156970 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f465400c780 tx=0x7f465400cc40 comp rx=0 tx=0).stop 2024-09-19T05:34:07.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.828+0000 7f4663e85640 1 -- 172.21.15.67:0/2725865362 shutdown_connections 2024-09-19T05:34:07.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.828+0000 7f4663e85640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f465c15e690 0x7f465c156970 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:07.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.828+0000 7f4663e85640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f465c0d4fb0 0x7f465c159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:07.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.828+0000 7f4663e85640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46400678c0 0x7f4640069d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:07.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.828+0000 7f4663e85640 1 --2- 172.21.15.67:0/2725865362 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465c0d13c0 0x7f465c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:07.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.828+0000 7f4663e85640 1 -- 172.21.15.67:0/2725865362 >> 172.21.15.67:0/2725865362 conn(0x7f465c0d4490 msgr2=0x7f465c0b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:07.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.828+0000 7f4663e85640 1 -- 172.21.15.67:0/2725865362 shutdown_connections 2024-09-19T05:34:07.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.828+0000 7f4663e85640 1 -- 172.21.15.67:0/2725865362 wait complete. 2024-09-19T05:34:07.867 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:34:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d42ec1640 1 Processor -- start 2024-09-19T05:34:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d42ec1640 1 -- start start 2024-09-19T05:34:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d42ec1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d3c15c030 0x7f1d3c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d42ec1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d3c06f460 0x7f1d3c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d42ec1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3c06e3c0 con 0x7f1d3c15d1d0 2024-09-19T05:34:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d42ec1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3c06e6a0 con 0x7f1d3c15c030 2024-09-19T05:34:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d42ec1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3c06e980 con 0x7f1d3c06f460 2024-09-19T05:34:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d3bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1d3c15d1d0 0x7f1d3c0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38414/0 (socket says 172.21.15.67:38414) 2024-09-19T05:34:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d3bfff640 1 -- 172.21.15.67:0/3807318234 learned_addr learned my addr 172.21.15.67:0/3807318234 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d40c5d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d3c15c030 0x7f1d3c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d40c5d640 1 -- 172.21.15.67:0/3807318234 >> v2:172.21.15.97:3300/0 conn(0x7f1d3c06f460 msgr2=0x7f1d3c06f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d4145e640 1 --2- 172.21.15.67:0/3807318234 >> v2:172.21.15.97:3300/0 conn(0x7f1d3c06f460 0x7f1d3c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d3b7fe640 1 -- 172.21.15.67:0/3807318234 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641243290 0 0) 0x7f1d3c06e3c0 con 0x7f1d3c15d1d0 2024-09-19T05:34:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d40c5d640 1 --2- 172.21.15.67:0/3807318234 >> v2:172.21.15.97:3300/0 conn(0x7f1d3c06f460 0x7f1d3c06f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d40c5d640 1 -- 172.21.15.67:0/3807318234 >> v1:172.21.15.67:6789/0 conn(0x7f1d3c15d1d0 legacy=0x7f1d3c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d40c5d640 1 -- 172.21.15.67:0/3807318234 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c06ec60 con 0x7f1d3c15c030 2024-09-19T05:34:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d4145e640 1 --2- 172.21.15.67:0/3807318234 >> v2:172.21.15.97:3300/0 conn(0x7f1d3c06f460 0x7f1d3c06f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d40c5d640 1 --2- 172.21.15.67:0/3807318234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 0x7f1d3c06dde0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0afbf0 tx=0x7f1d3001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75868d39d32b4190 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.984+0000 7f1d3b7fe640 1 -- 172.21.15.67:0/3807318234 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d300b0070 con 0x7f1d3c15c030 2024-09-19T05:34:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3b7fe640 1 -- 172.21.15.67:0/3807318234 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d300ab600 con 0x7f1d3c15c030 2024-09-19T05:34:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3b7fe640 1 -- 172.21.15.67:0/3807318234 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d300ab9d0 con 0x7f1d3c15c030 2024-09-19T05:34:07.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- 172.21.15.67:0/3807318234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 msgr2=0x7f1d3c06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:07.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 --2- 172.21.15.67:0/3807318234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 0x7f1d3c06dde0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0afbf0 tx=0x7f1d3001c480 comp rx=0 tx=0).stop 2024-09-19T05:34:07.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- 172.21.15.67:0/3807318234 shutdown_connections 2024-09-19T05:34:07.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 --2- 172.21.15.67:0/3807318234 >> v2:172.21.15.97:3300/0 conn(0x7f1d3c06f460 0x7f1d3c06f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:07.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 --2- 172.21.15.67:0/3807318234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 0x7f1d3c06dde0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:07.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- 172.21.15.67:0/3807318234 >> 172.21.15.67:0/3807318234 conn(0x7f1d3c0d0080 msgr2=0x7f1d3c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:07.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- 172.21.15.67:0/3807318234 shutdown_connections 2024-09-19T05:34:07.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- 172.21.15.67:0/3807318234 wait complete. 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 Processor -- start 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- start start 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d3c06f460 0x7f1d3c14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 0x7f1d3c072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d3c15d1d0 0x7f1d3c073460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c15c590 con 0x7f1d3c15c030 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c15c410 con 0x7f1d3c15d1d0 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3c1690e0 con 0x7f1d3c06f460 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 0x7f1d3c072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 0x7f1d3c072f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36532/0 (socket says 172.21.15.67:36532) 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3bfff640 1 -- 172.21.15.67:0/1264731226 learned_addr learned my addr 172.21.15.67:0/1264731226 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d40c5d640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d3c06f460 0x7f1d3c14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3bfff640 1 -- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d3c06f460 msgr2=0x7f1d3c14e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d4145e640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d3c15d1d0 0x7f1d3c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3bfff640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d3c06f460 0x7f1d3c14e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3bfff640 1 -- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d3c15d1d0 msgr2=0x7f1d3c073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3bfff640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d3c15d1d0 0x7f1d3c073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3bfff640 1 -- 172.21.15.67:0/1264731226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c073a90 con 0x7f1d3c15c030 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d3bfff640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 0x7f1d3c072f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c480 tx=0x7f1d2c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d397fa640 1 -- 172.21.15.67:0/1264731226 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c018070 con 0x7f1d3c15c030 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d397fa640 1 -- 172.21.15.67:0/1264731226 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2c007500 con 0x7f1d3c15c030 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- 172.21.15.67:0/1264731226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3c14d2c0 con 0x7f1d3c15c030 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d397fa640 1 -- 172.21.15.67:0/1264731226 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c004a30 con 0x7f1d3c15c030 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.988+0000 7f1d42ec1640 1 -- 172.21.15.67:0/1264731226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3c14d880 con 0x7f1d3c15c030 2024-09-19T05:34:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.992+0000 7f1d42ec1640 1 -- 172.21.15.67:0/1264731226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3c06f870 con 0x7f1d3c15c030 2024-09-19T05:34:07.999 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:34:08.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.992+0000 7f1d397fa640 1 -- 172.21.15.67:0/1264731226 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d2c01b070 con 0x7f1d3c15c030 2024-09-19T05:34:08.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.992+0000 7f1d397fa640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 0x7f1d28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.992+0000 7f1d397fa640 1 -- 172.21.15.67:0/1264731226 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f1d2c0850a0 con 0x7f1d3c15c030 2024-09-19T05:34:08.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.992+0000 7f1d40c5d640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 0x7f1d28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.992+0000 7f1d40c5d640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 0x7f1d28069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d300ad000 tx=0x7f1d300a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:08.002 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:34:08.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:07.996+0000 7f1d397fa640 1 -- 172.21.15.67:0/1264731226 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1d2c055ae0 con 0x7f1d3c15c030 2024-09-19T05:34:08.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.160+0000 7f1d42ec1640 1 -- 172.21.15.67:0/1264731226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d3c14bc60 con 0x7f1d3c15c030 2024-09-19T05:34:08.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.160+0000 7f1d397fa640 1 -- 172.21.15.67:0/1264731226 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16979 (secure 0 0 0) 0x7f1d2c0553e0 con 0x7f1d3c15c030 2024-09-19T05:34:08.167 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:08.167 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":38,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:34:07.193254+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:34:04.937667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-19T05:34:06.182518+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 -- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 msgr2=0x7f1d28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 0x7f1d28069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d300ad000 tx=0x7f1d300a6000 comp rx=0 tx=0).stop 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 -- 172.21.15.67:0/1264731226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 msgr2=0x7f1d3c072f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 0x7f1d3c072f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c480 tx=0x7f1d2c00c940 comp rx=0 tx=0).stop 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 -- 172.21.15.67:0/1264731226 shutdown_connections 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d3c15d1d0 0x7f1d3c073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c15c030 0x7f1d3c072f20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 0x7f1d28069d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 --2- 172.21.15.67:0/1264731226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d3c06f460 0x7f1d3c14e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 -- 172.21.15.67:0/1264731226 >> 172.21.15.67:0/1264731226 conn(0x7f1d3c0d0080 msgr2=0x7f1d3c0b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 -- 172.21.15.67:0/1264731226 shutdown_connections 2024-09-19T05:34:08.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.164+0000 7f1d42ec1640 1 -- 172.21.15.67:0/1264731226 wait complete. 2024-09-19T05:34:08.186 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:34:08.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa757f08640 1 Processor -- start 2024-09-19T05:34:08.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa757f08640 1 -- start start 2024-09-19T05:34:08.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa757f08640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75013f270 0x7fa750140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa757f08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa750140980 0x7fa75006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa757f08640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa75006d210 0x7fa750141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa757f08640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa75006d680 con 0x7fa75006d210 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa757f08640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa750140e70 con 0x7fa750140980 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa757f08640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa750141150 con 0x7fa75013f270 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa7564a5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa75006d210 0x7fa750141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa7564a5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa75006d210 0x7fa750141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36542/0 (socket says 172.21.15.67:36542) 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa7564a5640 1 -- 172.21.15.67:0/2534277765 learned_addr learned my addr 172.21.15.67:0/2534277765 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa755ca4640 1 --2- 172.21.15.67:0/2534277765 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75013f270 0x7fa750140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa7554a3640 1 --2- 172.21.15.67:0/2534277765 >> v2:172.21.15.97:3300/0 conn(0x7fa750140980 0x7fa75006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa7564a5640 1 -- 172.21.15.67:0/2534277765 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75013f270 msgr2=0x7fa750140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa7564a5640 1 --2- 172.21.15.67:0/2534277765 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75013f270 0x7fa750140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa7564a5640 1 -- 172.21.15.67:0/2534277765 >> v2:172.21.15.97:3300/0 conn(0x7fa750140980 msgr2=0x7fa75006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:08.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa7564a5640 1 --2- 172.21.15.67:0/2534277765 >> v2:172.21.15.97:3300/0 conn(0x7fa750140980 0x7fa75006ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.292+0000 7fa7564a5640 1 -- 172.21.15.67:0/2534277765 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa750141430 con 0x7fa75006d210 2024-09-19T05:34:08.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7564a5640 1 --2- 172.21.15.67:0/2534277765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75006d210 0x7fa750141ac0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa750070af0 tx=0x7fa74801c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feddc9c72a6141bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:08.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa754ca2640 1 -- 172.21.15.67:0/2534277765 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480b0070 con 0x7fa75006d210 2024-09-19T05:34:08.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa754ca2640 1 -- 172.21.15.67:0/2534277765 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7480ab600 con 0x7fa75006d210 2024-09-19T05:34:08.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa754ca2640 1 -- 172.21.15.67:0/2534277765 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480ab9d0 con 0x7fa75006d210 2024-09-19T05:34:08.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 -- 172.21.15.67:0/2534277765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75006d210 msgr2=0x7fa750141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 --2- 172.21.15.67:0/2534277765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75006d210 0x7fa750141ac0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa750070af0 tx=0x7fa74801c1a0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 -- 172.21.15.67:0/2534277765 shutdown_connections 2024-09-19T05:34:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 --2- 172.21.15.67:0/2534277765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75006d210 0x7fa750141ac0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 --2- 172.21.15.67:0/2534277765 >> v2:172.21.15.97:3300/0 conn(0x7fa750140980 0x7fa75006ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 --2- 172.21.15.67:0/2534277765 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75013f270 0x7fa750140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 -- 172.21.15.67:0/2534277765 >> 172.21.15.67:0/2534277765 conn(0x7fa750072800 msgr2=0x7fa750072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 -- 172.21.15.67:0/2534277765 shutdown_connections 2024-09-19T05:34:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 -- 172.21.15.67:0/2534277765 wait complete. 2024-09-19T05:34:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 Processor -- start 2024-09-19T05:34:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 -- start start 2024-09-19T05:34:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75006d210 0x7fa75015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75013f270 0x7fa75015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa750140980 0x7fa750138bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa75015cb40 con 0x7fa75013f270 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa75015c9c0 con 0x7fa75006d210 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa75015dea0 con 0x7fa750140980 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7554a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75013f270 0x7fa75015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7554a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75013f270 0x7fa75015b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36550/0 (socket says 172.21.15.67:36550) 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7554a3640 1 -- 172.21.15.67:0/1381525759 learned_addr learned my addr 172.21.15.67:0/1381525759 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa755ca4640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75006d210 0x7fa75015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7554a3640 1 -- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa750140980 msgr2=0x7fa750138bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7564a5640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa750140980 0x7fa750138bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7554a3640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa750140980 0x7fa750138bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7554a3640 1 -- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75006d210 msgr2=0x7fa75015a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7554a3640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75006d210 0x7fa75015a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7554a3640 1 -- 172.21.15.67:0/1381525759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75015a670 con 0x7fa75013f270 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa755ca4640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75006d210 0x7fa75015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7554a3640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75013f270 0x7fa75015b2d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa74000d800 tx=0x7fa74000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7467fc640 1 -- 172.21.15.67:0/1381525759 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74000b6c0 con 0x7fa75013f270 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7467fc640 1 -- 172.21.15.67:0/1381525759 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa740019070 con 0x7fa75013f270 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa757f08640 1 -- 172.21.15.67:0/1381525759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa750143ab0 con 0x7fa75013f270 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.296+0000 7fa7467fc640 1 -- 172.21.15.67:0/1381525759 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74000ba80 con 0x7fa75013f270 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.300+0000 7fa757f08640 1 -- 172.21.15.67:0/1381525759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa750144070 con 0x7fa75013f270 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.300+0000 7fa757f08640 1 -- 172.21.15.67:0/1381525759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa750140440 con 0x7fa75013f270 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.300+0000 7fa7467fc640 1 -- 172.21.15.67:0/1381525759 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa74000bc20 con 0x7fa75013f270 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.300+0000 7fa7467fc640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7340678c0 0x7fa734069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.300+0000 7fa7467fc640 1 -- 172.21.15.67:0/1381525759 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa740086130 con 0x7fa75013f270 2024-09-19T05:34:08.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.300+0000 7fa755ca4640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7340678c0 0x7fa734069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.300+0000 7fa755ca4640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7340678c0 0x7fa734069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa74c007330 tx=0x7fa74c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:08.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.304+0000 7fa7467fc640 1 -- 172.21.15.67:0/1381525759 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa740056b70 con 0x7fa75013f270 2024-09-19T05:34:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.464+0000 7fa757f08640 1 -- 172.21.15.67:0/1381525759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa75006a010 con 0x7fa75013f270 2024-09-19T05:34:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa7467fc640 1 -- 172.21.15.67:0/1381525759 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16979 (secure 0 0 0) 0x7fa740056470 con 0x7fa75013f270 2024-09-19T05:34:08.473 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:08.473 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":38,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:34:07.193254+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:34:04.937667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-19T05:34:06.182518+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:34:08.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 -- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7340678c0 msgr2=0x7fa734069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7340678c0 0x7fa734069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa74c007330 tx=0x7fa74c00b040 comp rx=0 tx=0).stop 2024-09-19T05:34:08.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 -- 172.21.15.67:0/1381525759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75013f270 msgr2=0x7fa75015b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75013f270 0x7fa75015b2d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa74000d800 tx=0x7fa74000dcc0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 -- 172.21.15.67:0/1381525759 shutdown_connections 2024-09-19T05:34:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7340678c0 0x7fa734069d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa750140980 0x7fa750138bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa75013f270 0x7fa75015b2d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 --2- 172.21.15.67:0/1381525759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75006d210 0x7fa75015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 -- 172.21.15.67:0/1381525759 >> 172.21.15.67:0/1381525759 conn(0x7fa750072800 msgr2=0x7fa7500b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 -- 172.21.15.67:0/1381525759 shutdown_connections 2024-09-19T05:34:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.468+0000 7fa757f08640 1 -- 172.21.15.67:0/1381525759 wait complete. 2024-09-19T05:34:08.491 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:34:08.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e911c5640 1 Processor -- start 2024-09-19T05:34:08.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e911c5640 1 -- start start 2024-09-19T05:34:08.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e911c5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3e8c15b1d0 0x7f3e8c0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e911c5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3e8c070070 0x7f3e8c0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e911c5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8c0aef30 con 0x7f3e8c06dfc0 2024-09-19T05:34:08.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e911c5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3e8c072210 con 0x7f3e8c15b1d0 2024-09-19T05:34:08.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e911c5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3e8c0ae0f0 con 0x7f3e8c070070 2024-09-19T05:34:08.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e8ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3e8c15b1d0 0x7f3e8c0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e8a59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3e8c06dfc0 0x7f3e8c06f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38416/0 (socket says 172.21.15.67:38416) 2024-09-19T05:34:08.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e8a59c640 1 -- 172.21.15.67:0/2299330775 learned_addr learned my addr 172.21.15.67:0/2299330775 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:08.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e8b59e640 1 --2- 172.21.15.67:0/2299330775 >> v2:172.21.15.97:3300/0 conn(0x7f3e8c070070 0x7f3e8c0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.600+0000 7f3e8ad9d640 1 -- 172.21.15.67:0/2299330775 >> v2:172.21.15.97:3300/0 conn(0x7f3e8c070070 msgr2=0x7f3e8c0b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:08.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e8ad9d640 1 --2- 172.21.15.67:0/2299330775 >> v2:172.21.15.97:3300/0 conn(0x7f3e8c070070 0x7f3e8c0b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e8ad9d640 1 -- 172.21.15.67:0/2299330775 >> v1:172.21.15.67:6789/0 conn(0x7f3e8c06dfc0 legacy=0x7f3e8c06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e8ad9d640 1 -- 172.21.15.67:0/2299330775 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c0ae3b0 con 0x7f3e8c15b1d0 2024-09-19T05:34:08.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e89d9b640 1 -- 172.21.15.67:0/2299330775 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775509019 0 0) 0x7f3e8c0aef30 con 0x7f3e8c06dfc0 2024-09-19T05:34:08.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e8ad9d640 1 --2- 172.21.15.67:0/2299330775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c15b1d0 0x7f3e8c0adbb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0b52f0 tx=0x7f3e7c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d48347cc9ee7a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:08.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e89d9b640 1 -- 172.21.15.67:0/2299330775 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0b2070 con 0x7f3e8c15b1d0 2024-09-19T05:34:08.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e89d9b640 1 -- 172.21.15.67:0/2299330775 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e7c0a58e0 con 0x7f3e8c15b1d0 2024-09-19T05:34:08.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e89d9b640 1 -- 172.21.15.67:0/2299330775 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0a5cb0 con 0x7f3e8c15b1d0 2024-09-19T05:34:08.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e911c5640 1 -- 172.21.15.67:0/2299330775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c15b1d0 msgr2=0x7f3e8c0adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e911c5640 1 --2- 172.21.15.67:0/2299330775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c15b1d0 0x7f3e8c0adbb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0b52f0 tx=0x7f3e7c01c930 comp rx=0 tx=0).stop 2024-09-19T05:34:08.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e911c5640 1 -- 172.21.15.67:0/2299330775 shutdown_connections 2024-09-19T05:34:08.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e911c5640 1 --2- 172.21.15.67:0/2299330775 >> v2:172.21.15.97:3300/0 conn(0x7f3e8c070070 0x7f3e8c0b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e911c5640 1 --2- 172.21.15.67:0/2299330775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c15b1d0 0x7f3e8c0adbb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e911c5640 1 -- 172.21.15.67:0/2299330775 >> 172.21.15.67:0/2299330775 conn(0x7f3e8c0b1e50 msgr2=0x7f3e8c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:08.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e911c5640 1 -- 172.21.15.67:0/2299330775 shutdown_connections 2024-09-19T05:34:08.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.604+0000 7f3e911c5640 1 -- 172.21.15.67:0/2299330775 wait complete. 2024-09-19T05:34:08.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 Processor -- start 2024-09-19T05:34:08.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 -- start start 2024-09-19T05:34:08.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e8c06dfc0 0x7f3e8c153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c070070 0x7f3e8c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e8c15b1d0 0x7f3e8c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c0b4180 con 0x7f3e8c070070 2024-09-19T05:34:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c072420 con 0x7f3e8c06dfc0 2024-09-19T05:34:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8c0b4300 con 0x7f3e8c15b1d0 2024-09-19T05:34:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c070070 0x7f3e8c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c070070 0x7f3e8c14f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36556/0 (socket says 172.21.15.67:36556) 2024-09-19T05:34:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8a59c640 1 -- 172.21.15.67:0/1643194165 learned_addr learned my addr 172.21.15.67:0/1643194165 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8ad9d640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e8c06dfc0 0x7f3e8c153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8a59c640 1 -- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e8c15b1d0 msgr2=0x7f3e8c157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8b59e640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e8c15b1d0 0x7f3e8c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8a59c640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e8c15b1d0 0x7f3e8c157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8a59c640 1 -- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e8c06dfc0 msgr2=0x7f3e8c153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8a59c640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e8c06dfc0 0x7f3e8c153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8a59c640 1 -- 172.21.15.67:0/1643194165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c1584e0 con 0x7f3e8c070070 2024-09-19T05:34:08.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8ad9d640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e8c06dfc0 0x7f3e8c153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:08.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e8a59c640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c070070 0x7f3e8c14f2c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000c480 tx=0x7f3e8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:08.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e737fe640 1 -- 172.21.15.67:0/1643194165 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80018070 con 0x7f3e8c070070 2024-09-19T05:34:08.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e737fe640 1 -- 172.21.15.67:0/1643194165 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e80007500 con 0x7f3e8c070070 2024-09-19T05:34:08.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e737fe640 1 -- 172.21.15.67:0/1643194165 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80004a30 con 0x7f3e8c070070 2024-09-19T05:34:08.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 -- 172.21.15.67:0/1643194165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8c153280 con 0x7f3e8c070070 2024-09-19T05:34:08.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 -- 172.21.15.67:0/1643194165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8c14f800 con 0x7f3e8c070070 2024-09-19T05:34:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e911c5640 1 -- 172.21.15.67:0/1643194165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e8c068530 con 0x7f3e8c070070 2024-09-19T05:34:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e737fe640 1 -- 172.21.15.67:0/1643194165 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e8001b070 con 0x7f3e8c070070 2024-09-19T05:34:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e737fe640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e780678c0 0x7f3e78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.608+0000 7f3e737fe640 1 -- 172.21.15.67:0/1643194165 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3e80085100 con 0x7f3e8c070070 2024-09-19T05:34:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.612+0000 7f3e8ad9d640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e780678c0 0x7f3e78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.612+0000 7f3e8ad9d640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e780678c0 0x7f3e78069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0af000 tx=0x7f3e7c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:08.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.616+0000 7f3e737fe640 1 -- 172.21.15.67:0/1643194165 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3e80055b40 con 0x7f3e8c070070 2024-09-19T05:34:08.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.804+0000 7f3e911c5640 1 -- 172.21.15.67:0/1643194165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3e8c0737e0 con 0x7f3e8c070070 2024-09-19T05:34:08.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e737fe640 1 -- 172.21.15.67:0/1643194165 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f3e80055440 con 0x7f3e8c070070 2024-09-19T05:34:08.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 -- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e780678c0 msgr2=0x7f3e78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e780678c0 0x7f3e78069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0af000 tx=0x7f3e7c0a7070 comp rx=0 tx=0).stop 2024-09-19T05:34:08.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 -- 172.21.15.67:0/1643194165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c070070 msgr2=0x7f3e8c14f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:08.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c070070 0x7f3e8c14f2c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000c480 tx=0x7f3e8000c940 comp rx=0 tx=0).stop 2024-09-19T05:34:08.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 -- 172.21.15.67:0/1643194165 shutdown_connections 2024-09-19T05:34:08.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e780678c0 0x7f3e78069d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e8c15b1d0 0x7f3e8c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e8c070070 0x7f3e8c14f2c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 --2- 172.21.15.67:0/1643194165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e8c06dfc0 0x7f3e8c153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:08.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 -- 172.21.15.67:0/1643194165 >> 172.21.15.67:0/1643194165 conn(0x7f3e8c0b1e50 msgr2=0x7f3e8c0b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:08.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 -- 172.21.15.67:0/1643194165 shutdown_connections 2024-09-19T05:34:08.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.860+0000 7f3e911c5640 1 -- 172.21.15.67:0/1643194165 wait complete. 2024-09-19T05:34:08.883 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:34:08.883 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:34:09.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd31cb38640 1 Processor -- start 2024-09-19T05:34:09.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd31cb38640 1 -- start start 2024-09-19T05:34:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd31cb38640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd31815e660 0x7fd3180b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd31cb38640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3180b3a60 0x7fd3180aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd31cb38640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd3180aef50 0x7fd31806f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd31cb38640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd31815ea40 con 0x7fd3180b3a60 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd31cb38640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd318070610 con 0x7fd3180aef50 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd31cb38640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd318071110 con 0x7fd31815e660 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd315d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3180b3a60 0x7fd3180aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd315d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3180b3a60 0x7fd3180aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36568/0 (socket says 172.21.15.67:36568) 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd315d9b640 1 -- 172.21.15.67:0/1474697038 learned_addr learned my addr 172.21.15.67:0/1474697038 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd316d9d640 1 --2- 172.21.15.67:0/1474697038 >> v2:172.21.15.97:3300/0 conn(0x7fd3180aef50 0x7fd31806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd31659c640 1 --2- 172.21.15.67:0/1474697038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd31815e660 0x7fd3180b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd315d9b640 1 -- 172.21.15.67:0/1474697038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd31815e660 msgr2=0x7fd3180b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd315d9b640 1 --2- 172.21.15.67:0/1474697038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd31815e660 0x7fd3180b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd315d9b640 1 -- 172.21.15.67:0/1474697038 >> v2:172.21.15.97:3300/0 conn(0x7fd3180aef50 msgr2=0x7fd31806f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:09.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd315d9b640 1 --2- 172.21.15.67:0/1474697038 >> v2:172.21.15.97:3300/0 conn(0x7fd3180aef50 0x7fd31806f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd315d9b640 1 -- 172.21.15.67:0/1474697038 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3180b4240 con 0x7fd3180b3a60 2024-09-19T05:34:09.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:08.996+0000 7fd316d9d640 1 --2- 172.21.15.67:0/1474697038 >> v2:172.21.15.97:3300/0 conn(0x7fd3180aef50 0x7fd31806f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:09.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd315d9b640 1 --2- 172.21.15.67:0/1474697038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3180b3a60 0x7fd3180aea10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd31806dd60 tx=0x7fd30c01c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f707fc3afe64e995 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:09.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31559a640 1 -- 172.21.15.67:0/1474697038 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0b0070 con 0x7fd3180b3a60 2024-09-19T05:34:09.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31559a640 1 -- 172.21.15.67:0/1474697038 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c0ab600 con 0x7fd3180b3a60 2024-09-19T05:34:09.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31559a640 1 -- 172.21.15.67:0/1474697038 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0ab9d0 con 0x7fd3180b3a60 2024-09-19T05:34:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 -- 172.21.15.67:0/1474697038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3180b3a60 msgr2=0x7fd3180aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 --2- 172.21.15.67:0/1474697038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3180b3a60 0x7fd3180aea10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd31806dd60 tx=0x7fd30c01c1d0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 -- 172.21.15.67:0/1474697038 shutdown_connections 2024-09-19T05:34:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 --2- 172.21.15.67:0/1474697038 >> v2:172.21.15.97:3300/0 conn(0x7fd3180aef50 0x7fd31806f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 --2- 172.21.15.67:0/1474697038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3180b3a60 0x7fd3180aea10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 --2- 172.21.15.67:0/1474697038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd31815e660 0x7fd3180b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 -- 172.21.15.67:0/1474697038 >> 172.21.15.67:0/1474697038 conn(0x7fd3180b2f40 msgr2=0x7fd3180b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 -- 172.21.15.67:0/1474697038 shutdown_connections 2024-09-19T05:34:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 -- 172.21.15.67:0/1474697038 wait complete. 2024-09-19T05:34:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 Processor -- start 2024-09-19T05:34:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 -- start start 2024-09-19T05:34:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3180aef50 0x7fd3180b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3180b3a60 0x7fd318149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd31815e660 0x7fd318154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180b48c0 con 0x7fd31815e660 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180b4740 con 0x7fd3180b3a60 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31cb38640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd3180b4a40 con 0x7fd3180aef50 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd316d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd31815e660 0x7fd318154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd316d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd31815e660 0x7fd318154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36578/0 (socket says 172.21.15.67:36578) 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd316d9d640 1 -- 172.21.15.67:0/582473140 learned_addr learned my addr 172.21.15.67:0/582473140 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd31659c640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3180aef50 0x7fd3180b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd316d9d640 1 -- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3180aef50 msgr2=0x7fd3180b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd316d9d640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3180aef50 0x7fd3180b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd316d9d640 1 -- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3180b3a60 msgr2=0x7fd318149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd316d9d640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3180b3a60 0x7fd318149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd316d9d640 1 -- 172.21.15.67:0/582473140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3180b5d50 con 0x7fd31815e660 2024-09-19T05:34:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd316d9d640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd31815e660 0x7fd318154760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd31000cef0 tx=0x7fd31000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.000+0000 7fd306ffd640 1 -- 172.21.15.67:0/582473140 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31001a070 con 0x7fd31815e660 2024-09-19T05:34:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.004+0000 7fd31cb38640 1 -- 172.21.15.67:0/582473140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3180b6030 con 0x7fd31815e660 2024-09-19T05:34:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.004+0000 7fd306ffd640 1 -- 172.21.15.67:0/582473140 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31000d840 con 0x7fd31815e660 2024-09-19T05:34:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.004+0000 7fd306ffd640 1 -- 172.21.15.67:0/582473140 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31000dc30 con 0x7fd31815e660 2024-09-19T05:34:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.004+0000 7fd31cb38640 1 -- 172.21.15.67:0/582473140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3180b65f0 con 0x7fd31815e660 2024-09-19T05:34:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.004+0000 7fd31cb38640 1 -- 172.21.15.67:0/582473140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3180aea10 con 0x7fd31815e660 2024-09-19T05:34:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.004+0000 7fd306ffd640 1 -- 172.21.15.67:0/582473140 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd31001d070 con 0x7fd31815e660 2024-09-19T05:34:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.004+0000 7fd306ffd640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2f80678c0 0x7fd2f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.004+0000 7fd306ffd640 1 -- 172.21.15.67:0/582473140 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd310086620 con 0x7fd31815e660 2024-09-19T05:34:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.004+0000 7fd31659c640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2f80678c0 0x7fd2f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.004+0000 7fd31659c640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2f80678c0 0x7fd2f8069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd30800a8d0 tx=0x7fd308008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:09.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.008+0000 7fd306ffd640 1 -- 172.21.15.67:0/582473140 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd310056fe0 con 0x7fd31815e660 2024-09-19T05:34:09.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.200+0000 7fd31cb38640 1 -- 172.21.15.67:0/582473140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd3180b12c0 con 0x7fd31815e660 2024-09-19T05:34:09.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.868+0000 7fd306ffd640 1 -- 172.21.15.67:0/582473140 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7fd31005be20 con 0x7fd31815e660 2024-09-19T05:34:09.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 -- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2f80678c0 msgr2=0x7fd2f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2f80678c0 0x7fd2f8069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd30800a8d0 tx=0x7fd308008040 comp rx=0 tx=0).stop 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 -- 172.21.15.67:0/582473140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd31815e660 msgr2=0x7fd318154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd31815e660 0x7fd318154760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd31000cef0 tx=0x7fd31000a710 comp rx=0 tx=0).stop 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 -- 172.21.15.67:0/582473140 shutdown_connections 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd31815e660 0x7fd318154760 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3180b3a60 0x7fd318149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2f80678c0 0x7fd2f8069d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 --2- 172.21.15.67:0/582473140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3180aef50 0x7fd3180b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 -- 172.21.15.67:0/582473140 >> 172.21.15.67:0/582473140 conn(0x7fd3180b2f40 msgr2=0x7fd31815d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 -- 172.21.15.67:0/582473140 shutdown_connections 2024-09-19T05:34:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:09.872+0000 7fd31cb38640 1 -- 172.21.15.67:0/582473140 wait complete. 2024-09-19T05:34:09.900 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:34:09.900 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:34:10.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.016+0000 7f3c30f35640 1 Processor -- start 2024-09-19T05:34:10.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.016+0000 7f3c30f35640 1 -- start start 2024-09-19T05:34:10.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c30f35640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3c2c15e640 0x7f3c2c0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c30f35640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2c0b5b90 con 0x7f3c2c0ae0a0 2024-09-19T05:34:10.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c30f35640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2c0ae510 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c30f35640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3c2c0b4780 con 0x7f3c2c15e640 2024-09-19T05:34:10.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c2a59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3c2c15e640 0x7f3c2c0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c29d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3c2c0ae0a0 0x7f3c2c0b2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38432/0 (socket says 172.21.15.67:38432) 2024-09-19T05:34:10.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c2a59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3c2c15e640 0x7f3c2c0b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36584/0 (socket says 172.21.15.67:36584) 2024-09-19T05:34:10.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c29d9b640 1 -- 172.21.15.67:0/3904619231 learned_addr learned my addr 172.21.15.67:0/3904619231 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:10.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c2959a640 1 -- 172.21.15.67:0/3904619231 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074367025 0 0) 0x7f3c1c001120 con 0x7f3c2c0ae0a0 2024-09-19T05:34:10.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c2959a640 1 -- 172.21.15.67:0/3904619231 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c18003530 con 0x7f3c2c0ae0a0 2024-09-19T05:34:10.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c2a59c640 1 -- 172.21.15.67:0/3904619231 >> v1:172.21.15.97:6789/0 conn(0x7f3c2c0b6cf0 legacy=0x7f3c2c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:10.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c2a59c640 1 -- 172.21.15.67:0/3904619231 >> v1:172.21.15.67:6789/0 conn(0x7f3c2c0ae0a0 legacy=0x7f3c2c0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.020+0000 7f3c2a59c640 1 -- 172.21.15.67:0/3904619231 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2c0b15f0 con 0x7f3c2c15e640 2024-09-19T05:34:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c2a59c640 1 --2- 172.21.15.67:0/3904619231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c15e640 0x7f3c2c0b6050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3c140097c0 tx=0x7f3c1401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c05e38b7d3d986 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c2959a640 1 -- 172.21.15.67:0/3904619231 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140b1070 con 0x7f3c2c15e640 2024-09-19T05:34:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c2959a640 1 -- 172.21.15.67:0/3904619231 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c140ac640 con 0x7f3c2c15e640 2024-09-19T05:34:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c2959a640 1 -- 172.21.15.67:0/3904619231 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140ac9f0 con 0x7f3c2c15e640 2024-09-19T05:34:10.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- 172.21.15.67:0/3904619231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c15e640 msgr2=0x7f3c2c0b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 --2- 172.21.15.67:0/3904619231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c15e640 0x7f3c2c0b6050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3c140097c0 tx=0x7f3c1401c310 comp rx=0 tx=0).stop 2024-09-19T05:34:10.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- 172.21.15.67:0/3904619231 shutdown_connections 2024-09-19T05:34:10.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 --2- 172.21.15.67:0/3904619231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c15e640 0x7f3c2c0b6050 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- 172.21.15.67:0/3904619231 >> 172.21.15.67:0/3904619231 conn(0x7f3c2c09aa30 msgr2=0x7f3c2c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:10.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- 172.21.15.67:0/3904619231 shutdown_connections 2024-09-19T05:34:10.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- 172.21.15.67:0/3904619231 wait complete. 2024-09-19T05:34:10.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 Processor -- start 2024-09-19T05:34:10.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- start start 2024-09-19T05:34:10.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c0ae0a0 0x7f3c2c150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c0b6cf0 0x7f3c2c15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c2c15e640 0x7f3c2c1fa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c0b2b40 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c0b7120 con 0x7f3c2c15e640 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3c2c0b0790 con 0x7f3c2c0ae0a0 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c29d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c0b6cf0 0x7f3c2c15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c29d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c0b6cf0 0x7f3c2c15cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36590/0 (socket says 172.21.15.67:36590) 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c29d9b640 1 -- 172.21.15.67:0/45986231 learned_addr learned my addr 172.21.15.67:0/45986231 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c2a59c640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c0ae0a0 0x7f3c2c150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c2ad9d640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c2c15e640 0x7f3c2c1fa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c29d9b640 1 -- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c0ae0a0 msgr2=0x7f3c2c150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c29d9b640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c0ae0a0 0x7f3c2c150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c29d9b640 1 -- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c2c15e640 msgr2=0x7f3c2c1fa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c29d9b640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c2c15e640 0x7f3c2c1fa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c29d9b640 1 -- 172.21.15.67:0/45986231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2c157c30 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c2a59c640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c0ae0a0 0x7f3c2c150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c2ad9d640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c2c15e640 0x7f3c2c1fa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c29d9b640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c0b6cf0 0x7f3c2c15cab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00c3c0 tx=0x7f3c1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c22ffd640 1 -- 172.21.15.67:0/45986231 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c017070 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c22ffd640 1 -- 172.21.15.67:0/45986231 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1c005cf0 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- 172.21.15.67:0/45986231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2c15f560 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c22ffd640 1 -- 172.21.15.67:0/45986231 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c007310 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.024+0000 7f3c30f35640 1 -- 172.21.15.67:0/45986231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2c15fb20 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.028+0000 7f3c30f35640 1 -- 172.21.15.67:0/45986231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c2c1579a0 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.028+0000 7f3c22ffd640 1 -- 172.21.15.67:0/45986231 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c1c01a070 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.028+0000 7f3c22ffd640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c0c0678c0 0x7f3c0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.028+0000 7f3c22ffd640 1 -- 172.21.15.67:0/45986231 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3c1c085230 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.028+0000 7f3c2a59c640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c0c0678c0 0x7f3c0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.028+0000 7f3c2a59c640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c0c0678c0 0x7f3c0c069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c140ae000 tx=0x7f3c14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:10.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.032+0000 7f3c22ffd640 1 -- 172.21.15.67:0/45986231 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3c2c0b5b90 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.240+0000 7f3c30f35640 1 -- 172.21.15.67:0/45986231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c2c0b40c0 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.240+0000 7f3c22ffd640 1 -- 172.21.15.67:0/45986231 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5220 (secure 0 0 0) 0x7f3c1c055be0 con 0x7f3c2c0b6cf0 2024-09-19T05:34:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:10.248 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":15,"btime":"2024-09-19T05:34:09:865438+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2848495891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2848495891},{"type":"v1","addr":"172.21.15.97:6835","nonce":2848495891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4741,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2818377677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2818377677},{"type":"v1","addr":"172.21.15.97:6837","nonce":2818377677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4887,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/244834094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":244834094},{"type":"v1","addr":"172.21.15.67:6834","nonce":244834094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:34:07.193697+0000","modified":"2024-09-19T05:34:09.207710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3857596366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3857596366},{"type":"v1","addr":"172.21.15.67:6835","nonce":3857596366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-19T05:34:10.250 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-09-19T05:34:10.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 -- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c0c0678c0 msgr2=0x7f3c0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c0c0678c0 0x7f3c0c069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c140ae000 tx=0x7f3c14008040 comp rx=0 tx=0).stop 2024-09-19T05:34:10.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 -- 172.21.15.67:0/45986231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c0b6cf0 msgr2=0x7f3c2c15cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c0b6cf0 0x7f3c2c15cab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00c3c0 tx=0x7f3c1c00c880 comp rx=0 tx=0).stop 2024-09-19T05:34:10.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 -- 172.21.15.67:0/45986231 shutdown_connections 2024-09-19T05:34:10.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c2c15e640 0x7f3c2c1fa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c2c0b6cf0 0x7f3c2c15cab0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c0c0678c0 0x7f3c0c069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 --2- 172.21.15.67:0/45986231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c0ae0a0 0x7f3c2c150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 -- 172.21.15.67:0/45986231 >> 172.21.15.67:0/45986231 conn(0x7f3c2c09aa30 msgr2=0x7f3c2c0b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 -- 172.21.15.67:0/45986231 shutdown_connections 2024-09-19T05:34:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.244+0000 7f3c30f35640 1 -- 172.21.15.67:0/45986231 wait complete. 2024-09-19T05:34:10.266 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:34:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69fa86d640 1 Processor -- start 2024-09-19T05:34:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69fa86d640 1 -- start start 2024-09-19T05:34:10.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69fa86d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f69f41609b0 0x7f69f40b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69fa86d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f40b4710 con 0x7f69f40afee0 2024-09-19T05:34:10.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69fa86d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f40b49f0 con 0x7f69f415fcf0 2024-09-19T05:34:10.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69fa86d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f69f40b5cf0 con 0x7f69f41609b0 2024-09-19T05:34:10.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f8e0a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f69f40afee0 0x7f69f415d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38438/0 (socket says 172.21.15.67:38438) 2024-09-19T05:34:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f8e0a640 1 -- 172.21.15.67:0/2699379049 learned_addr learned my addr 172.21.15.67:0/2699379049 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69ebfff640 1 --2- 172.21.15.67:0/2699379049 >> v2:172.21.15.97:3300/0 conn(0x7f69f41609b0 0x7f69f40b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1770985535 0 0) 0x7f69f40b4710 con 0x7f69f40afee0 2024-09-19T05:34:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e0003530 con 0x7f69f40afee0 2024-09-19T05:34:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1539774183 0 0) 0x7f69e0003530 con 0x7f69f40afee0 2024-09-19T05:34:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 >> v2:172.21.15.97:3300/0 conn(0x7f69f41609b0 msgr2=0x7f69f40b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 --2- 172.21.15.67:0/2699379049 >> v2:172.21.15.97:3300/0 conn(0x7f69f41609b0 0x7f69f40b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 >> v1:172.21.15.97:6789/0 conn(0x7f69f415fcf0 legacy=0x7f69f41600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f40b4cd0 con 0x7f69f40afee0 2024-09-19T05:34:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f69ec001a00 con 0x7f69f40afee0 2024-09-19T05:34:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 >> v1:172.21.15.67:6789/0 conn(0x7f69f40afee0 legacy=0x7f69f415d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e00039c0 0x7f69e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e0004810 0x7f69e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69e00051d0 0x7f69e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f69f40b5cf0 con 0x7f69e00051d0 2024-09-19T05:34:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f69e000c170 con 0x7f69e0004810 2024-09-19T05:34:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f69e000c370 con 0x7f69e00039c0 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f8e0a640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69e00051d0 0x7f69e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f3fff640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e00039c0 0x7f69e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69ebfff640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e0004810 0x7f69e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f8e0a640 1 -- 172.21.15.67:0/2699379049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e00039c0 msgr2=0x7f69e0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f8e0a640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e00039c0 0x7f69e0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f8e0a640 1 -- 172.21.15.67:0/2699379049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e0004810 msgr2=0x7f69e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f8e0a640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e0004810 0x7f69e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f8e0a640 1 -- 172.21.15.67:0/2699379049 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e0003530 con 0x7f69e00051d0 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69f3fff640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e00039c0 0x7f69e0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.384+0000 7f69ebfff640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e0004810 0x7f69e0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69f8e0a640 1 -- 172.21.15.67:0/2699379049 reap_dead start 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69f8e0a640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69e00051d0 0x7f69e000b9d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00a860 tx=0x7f69ec01fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baec160cd789d3af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00a480 con 0x7f69e00051d0 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec0aa510 con 0x7f69e00051d0 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69f37fe640 1 -- 172.21.15.67:0/2699379049 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0aa8e0 con 0x7f69e00051d0 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69fa86d640 1 -- 172.21.15.67:0/2699379049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69e00051d0 msgr2=0x7f69e000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69fa86d640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69e00051d0 0x7f69e000b9d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00a860 tx=0x7f69ec01fae0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69fa86d640 1 -- 172.21.15.67:0/2699379049 shutdown_connections 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69fa86d640 1 --2- 172.21.15.67:0/2699379049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69e00051d0 0x7f69e000b9d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69fa86d640 1 -- 172.21.15.67:0/2699379049 >> 172.21.15.67:0/2699379049 conn(0x7f69f4073500 msgr2=0x7f69f406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69fa86d640 1 -- 172.21.15.67:0/2699379049 shutdown_connections 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69fa86d640 1 -- 172.21.15.67:0/2699379049 wait complete. 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69fa86d640 1 Processor -- start 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.388+0000 7f69fa86d640 1 -- start start 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69fa86d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e00051d0 0x7f69f4156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69fa86d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69f4155ae0 0x7f69f415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69fa86d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69f415aa80 0x7f69f4145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69fa86d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f69f40b0330 con 0x7f69f415aa80 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69fa86d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f69f40b5290 con 0x7f69f4155ae0 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69fa86d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f69f4154a40 con 0x7f69e00051d0 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f8e0a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69f415aa80 0x7f69f4145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f8e0a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69f415aa80 0x7f69f4145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36598/0 (socket says 172.21.15.67:36598) 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f8e0a640 1 -- 172.21.15.67:0/2869781617 learned_addr learned my addr 172.21.15.67:0/2869781617 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f3fff640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e00051d0 0x7f69f4156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69ebfff640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69f4155ae0 0x7f69f415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f8e0a640 1 -- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e00051d0 msgr2=0x7f69f4156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f8e0a640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e00051d0 0x7f69f4156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f8e0a640 1 -- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69f4155ae0 msgr2=0x7f69f415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f8e0a640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69f4155ae0 0x7f69f415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f8e0a640 1 -- 172.21.15.67:0/2869781617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f4154d20 con 0x7f69f415aa80 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f8e0a640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69f415aa80 0x7f69f4145020 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69ec01f910 tx=0x7f69e0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f17fa640 1 -- 172.21.15.67:0/2869781617 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0bc070 con 0x7f69f415aa80 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f17fa640 1 -- 172.21.15.67:0/2869781617 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec004b70 con 0x7f69f415aa80 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69fa86d640 1 -- 172.21.15.67:0/2869781617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f4155000 con 0x7f69f415aa80 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f17fa640 1 -- 172.21.15.67:0/2869781617 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00a480 con 0x7f69f415aa80 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69fa86d640 1 -- 172.21.15.67:0/2869781617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f41555c0 con 0x7f69f415aa80 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69fa86d640 1 -- 172.21.15.67:0/2869781617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f40b57b0 con 0x7f69f415aa80 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f17fa640 1 -- 172.21.15.67:0/2869781617 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f69ec0b3070 con 0x7f69f415aa80 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f17fa640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f69d40678f0 0x7f69d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f17fa640 1 -- 172.21.15.67:0/2869781617 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f69ec122630 con 0x7f69f415aa80 2024-09-19T05:34:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f3fff640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f69d40678f0 0x7f69d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.392+0000 7f69f3fff640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f69d40678f0 0x7f69d4069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007fd0 tx=0x7f69e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:10.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.396+0000 7f69f17fa640 1 -- 172.21.15.67:0/2869781617 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f69ec0197f0 con 0x7f69f415aa80 2024-09-19T05:34:10.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.560+0000 7f69fa86d640 1 -- 172.21.15.67:0/2869781617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69f4158150 con 0x7f69f415aa80 2024-09-19T05:34:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69f17fa640 1 -- 172.21.15.67:0/2869781617 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16966 (secure 0 0 0) 0x7f69ec0f2a20 con 0x7f69f415aa80 2024-09-19T05:34:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:10.570 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":39,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:34:08.827708+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:34:04.937667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-19T05:34:06.182518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:34:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69fa86d640 1 -- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f69d40678f0 msgr2=0x7f69d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69fa86d640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f69d40678f0 0x7f69d4069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007fd0 tx=0x7f69e4009040 comp rx=0 tx=0).stop 2024-09-19T05:34:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69fa86d640 1 -- 172.21.15.67:0/2869781617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69f415aa80 msgr2=0x7f69f4145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69fa86d640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69f415aa80 0x7f69f4145020 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69ec01f910 tx=0x7f69e0005840 comp rx=0 tx=0).stop 2024-09-19T05:34:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69fa86d640 1 -- 172.21.15.67:0/2869781617 shutdown_connections 2024-09-19T05:34:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69fa86d640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69f415aa80 0x7f69f4145020 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69fa86d640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69f4155ae0 0x7f69f415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69fa86d640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f69d40678f0 0x7f69d4069db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69fa86d640 1 --2- 172.21.15.67:0/2869781617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e00051d0 0x7f69f4156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.564+0000 7f69fa86d640 1 -- 172.21.15.67:0/2869781617 >> 172.21.15.67:0/2869781617 conn(0x7f69f4073500 msgr2=0x7f69f41600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.568+0000 7f69fa86d640 1 -- 172.21.15.67:0/2869781617 shutdown_connections 2024-09-19T05:34:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.568+0000 7f69fa86d640 1 -- 172.21.15.67:0/2869781617 wait complete. 2024-09-19T05:34:10.589 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:34:10.589 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:34:10.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.700+0000 7f9b088cd640 1 Processor -- start 2024-09-19T05:34:10.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.700+0000 7f9b088cd640 1 -- start start 2024-09-19T05:34:10.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b088cd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9b040b03a0 0x7f9b040b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b088cd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b0406bcc0 0x7f9b0406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b088cd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b040b1140 con 0x7f9b04145e10 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b088cd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0406c670 con 0x7f9b040b03a0 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b088cd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9b041461f0 con 0x7f9b0406bcc0 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b0259c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9b04145e10 0x7f9b0415c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38442/0 (socket says 172.21.15.67:38442) 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b01d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9b040b03a0 0x7f9b040b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b0259c640 1 -- 172.21.15.67:0/1399823884 learned_addr learned my addr 172.21.15.67:0/1399823884 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b02d9d640 1 --2- 172.21.15.67:0/1399823884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b0406bcc0 0x7f9b0406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b01d9b640 1 -- 172.21.15.67:0/1399823884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b0406bcc0 msgr2=0x7f9b0406c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b01d9b640 1 --2- 172.21.15.67:0/1399823884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b0406bcc0 0x7f9b0406c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b01d9b640 1 -- 172.21.15.67:0/1399823884 >> v1:172.21.15.67:6789/0 conn(0x7f9b04145e10 legacy=0x7f9b0415c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b0159a640 1 -- 172.21.15.67:0/1399823884 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199671434 0 0) 0x7f9b040b1140 con 0x7f9b04145e10 2024-09-19T05:34:10.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b01d9b640 1 -- 172.21.15.67:0/1399823884 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b040b1420 con 0x7f9b040b03a0 2024-09-19T05:34:10.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b01d9b640 1 --2- 172.21.15.67:0/1399823884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b040b03a0 0x7f9b040b0810 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0097c0 tx=0x7f9aec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf7ec68d3a66c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:10.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b0159a640 1 -- 172.21.15.67:0/1399823884 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0b2070 con 0x7f9b040b03a0 2024-09-19T05:34:10.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b0159a640 1 -- 172.21.15.67:0/1399823884 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aec0ad640 con 0x7f9b040b03a0 2024-09-19T05:34:10.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.704+0000 7f9b0159a640 1 -- 172.21.15.67:0/1399823884 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0ada10 con 0x7f9b040b03a0 2024-09-19T05:34:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- 172.21.15.67:0/1399823884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b040b03a0 msgr2=0x7f9b040b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 --2- 172.21.15.67:0/1399823884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b040b03a0 0x7f9b040b0810 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0097c0 tx=0x7f9aec01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- 172.21.15.67:0/1399823884 shutdown_connections 2024-09-19T05:34:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 --2- 172.21.15.67:0/1399823884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b0406bcc0 0x7f9b0406c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 --2- 172.21.15.67:0/1399823884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b040b03a0 0x7f9b040b0810 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- 172.21.15.67:0/1399823884 >> 172.21.15.67:0/1399823884 conn(0x7f9b0409aa30 msgr2=0x7f9b040b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- 172.21.15.67:0/1399823884 shutdown_connections 2024-09-19T05:34:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- 172.21.15.67:0/1399823884 wait complete. 2024-09-19T05:34:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 Processor -- start 2024-09-19T05:34:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- start start 2024-09-19T05:34:10.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b0406bcc0 0x7f9b04141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b040b03a0 0x7f9b04138c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b04145e10 0x7f9b041f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9b040b2b70 con 0x7f9b04145e10 2024-09-19T05:34:10.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9b040b29f0 con 0x7f9b040b03a0 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9b040b2cf0 con 0x7f9b0406bcc0 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b02d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b04145e10 0x7f9b041f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b02d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b04145e10 0x7f9b041f7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36620/0 (socket says 172.21.15.67:36620) 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b02d9d640 1 -- 172.21.15.67:0/1329951344 learned_addr learned my addr 172.21.15.67:0/1329951344 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b0259c640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b0406bcc0 0x7f9b04141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b01d9b640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b040b03a0 0x7f9b04138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b02d9d640 1 -- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b0406bcc0 msgr2=0x7f9b04141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b02d9d640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b0406bcc0 0x7f9b04141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b02d9d640 1 -- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b040b03a0 msgr2=0x7f9b04138c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b02d9d640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b040b03a0 0x7f9b04138c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b02d9d640 1 -- 172.21.15.67:0/1329951344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b04141e50 con 0x7f9b04145e10 2024-09-19T05:34:10.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b02d9d640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b04145e10 0x7f9b041f7070 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007e90 tx=0x7f9afc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:10.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9afaffd640 1 -- 172.21.15.67:0/1329951344 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc014420 con 0x7f9b04145e10 2024-09-19T05:34:10.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9afaffd640 1 -- 172.21.15.67:0/1329951344 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc019070 con 0x7f9b04145e10 2024-09-19T05:34:10.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9afaffd640 1 -- 172.21.15.67:0/1329951344 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc014800 con 0x7f9b04145e10 2024-09-19T05:34:10.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- 172.21.15.67:0/1329951344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b040b45b0 con 0x7f9b04145e10 2024-09-19T05:34:10.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.708+0000 7f9b088cd640 1 -- 172.21.15.67:0/1329951344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b040b4b70 con 0x7f9b04145e10 2024-09-19T05:34:10.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.712+0000 7f9b088cd640 1 -- 172.21.15.67:0/1329951344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0406c130 con 0x7f9b04145e10 2024-09-19T05:34:10.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.712+0000 7f9afaffd640 1 -- 172.21.15.67:0/1329951344 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9afc0149a0 con 0x7f9b04145e10 2024-09-19T05:34:10.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.712+0000 7f9afaffd640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ae40678c0 0x7f9ae4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:10.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.712+0000 7f9afaffd640 1 -- 172.21.15.67:0/1329951344 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9afc0865b0 con 0x7f9b04145e10 2024-09-19T05:34:10.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.712+0000 7f9b0259c640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ae40678c0 0x7f9ae4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:10.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.712+0000 7f9b0259c640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ae40678c0 0x7f9ae4069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9af4007fd0 tx=0x7f9af4007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:10.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.716+0000 7f9afaffd640 1 -- 172.21.15.67:0/1329951344 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9afc056fd0 con 0x7f9b04145e10 2024-09-19T05:34:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.876+0000 7f9b088cd640 1 -- 172.21.15.67:0/1329951344 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b0409d820 con 0x7f9ae40678c0 2024-09-19T05:34:10.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.896+0000 7f9afaffd640 1 -- 172.21.15.67:0/1329951344 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246640 (secure 0 0 0) 0x7f9b0409d820 con 0x7f9ae40678c0 2024-09-19T05:34:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:10.905 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:34:10.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 -- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ae40678c0 msgr2=0x7f9ae4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ae40678c0 0x7f9ae4069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9af4007fd0 tx=0x7f9af4007d60 comp rx=0 tx=0).stop 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 -- 172.21.15.67:0/1329951344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b04145e10 msgr2=0x7f9b041f7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b04145e10 0x7f9b041f7070 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007e90 tx=0x7f9afc00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 -- 172.21.15.67:0/1329951344 shutdown_connections 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b04145e10 0x7f9b041f7070 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b040b03a0 0x7f9b04138c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ae40678c0 0x7f9ae4069d80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 --2- 172.21.15.67:0/1329951344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b0406bcc0 0x7f9b04141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 -- 172.21.15.67:0/1329951344 >> 172.21.15.67:0/1329951344 conn(0x7f9b0409aa30 msgr2=0x7f9b0409da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 -- 172.21.15.67:0/1329951344 shutdown_connections 2024-09-19T05:34:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:10.900+0000 7f9b088cd640 1 -- 172.21.15.67:0/1329951344 wait complete. 2024-09-19T05:34:10.922 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-19T05:34:09.125076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220696,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754024,"statfs":{"total":773094113280,"available":772868120576,"internally_reserved":0,"allocated":4562944,"data_stored":2615856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001149"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.836604+0000","last_change":"2024-09-19T05:34:06.836604+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.836604+0000","last_undegraded":"2024-09-19T05:34:06.836604+0000","last_fullsized":"2024-09-19T05:34:06.836604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.835511+0000","last_change":"2024-09-19T05:34:06.835511+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.835511+0000","last_undegraded":"2024-09-19T05:34:06.835511+0000","last_fullsized":"2024-09-19T05:34:06.835511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820312+0000","last_change":"2024-09-19T05:34:06.820312+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820312+0000","last_undegraded":"2024-09-19T05:34:06.820312+0000","last_fullsized":"2024-09-19T05:34:06.820312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829261+0000","last_change":"2024-09-19T05:34:06.829261+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829261+0000","last_undegraded":"2024-09-19T05:34:06.829261+0000","last_fullsized":"2024-09-19T05:34:06.829261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829785+0000","last_change":"2024-09-19T05:34:06.829785+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829785+0000","last_undegraded":"2024-09-19T05:34:06.829785+0000","last_fullsized":"2024-09-19T05:34:06.829785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.828835+0000","last_change":"2024-09-19T05:34:06.828835+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.828835+0000","last_undegraded":"2024-09-19T05:34:06.828835+0000","last_fullsized":"2024-09-19T05:34:06.828835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823236+0000","last_change":"2024-09-19T05:34:06.823236+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823236+0000","last_undegraded":"2024-09-19T05:34:06.823236+0000","last_fullsized":"2024-09-19T05:34:06.823236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830660+0000","last_change":"2024-09-19T05:34:06.830660+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830660+0000","last_undegraded":"2024-09-19T05:34:06.830660+0000","last_fullsized":"2024-09-19T05:34:06.830660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819609+0000","last_change":"2024-09-19T05:34:06.819609+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819609+0000","last_undegraded":"2024-09-19T05:34:06.819609+0000","last_fullsized":"2024-09-19T05:34:06.819609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827096+0000","last_change":"2024-09-19T05:34:06.827096+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827096+0000","last_undegraded":"2024-09-19T05:34:06.827096+0000","last_fullsized":"2024-09-19T05:34:06.827096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.835381+0000","last_change":"2024-09-19T05:34:06.835381+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.835381+0000","last_undegraded":"2024-09-19T05:34:06.835381+0000","last_fullsized":"2024-09-19T05:34:06.835381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819493+0000","last_change":"2024-09-19T05:34:06.819493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819493+0000","last_undegraded":"2024-09-19T05:34:06.819493+0000","last_fullsized":"2024-09-19T05:34:06.819493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822917+0000","last_change":"2024-09-19T05:34:06.822917+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822917+0000","last_undegraded":"2024-09-19T05:34:06.822917+0000","last_fullsized":"2024-09-19T05:34:06.822917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.817924+0000","last_change":"2024-09-19T05:34:06.817924+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.817924+0000","last_undegraded":"2024-09-19T05:34:06.817924+0000","last_fullsized":"2024-09-19T05:34:06.817924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822032+0000","last_change":"2024-09-19T05:34:06.822032+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822032+0000","last_undegraded":"2024-09-19T05:34:06.822032+0000","last_fullsized":"2024-09-19T05:34:06.822032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824959+0000","last_change":"2024-09-19T05:34:06.824959+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824959+0000","last_undegraded":"2024-09-19T05:34:06.824959+0000","last_fullsized":"2024-09-19T05:34:06.824959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829314+0000","last_change":"2024-09-19T05:34:06.829314+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829314+0000","last_undegraded":"2024-09-19T05:34:06.829314+0000","last_fullsized":"2024-09-19T05:34:06.829314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822019+0000","last_change":"2024-09-19T05:34:06.822019+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822019+0000","last_undegraded":"2024-09-19T05:34:06.822019+0000","last_fullsized":"2024-09-19T05:34:06.822019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821810+0000","last_change":"2024-09-19T05:34:06.821810+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821810+0000","last_undegraded":"2024-09-19T05:34:06.821810+0000","last_fullsized":"2024-09-19T05:34:06.821810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.833600+0000","last_change":"2024-09-19T05:34:06.833600+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.833600+0000","last_undegraded":"2024-09-19T05:34:06.833600+0000","last_fullsized":"2024-09-19T05:34:06.833600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821882+0000","last_change":"2024-09-19T05:34:06.821882+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821882+0000","last_undegraded":"2024-09-19T05:34:06.821882+0000","last_fullsized":"2024-09-19T05:34:06.821882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.813884+0000","last_change":"2024-09-19T05:34:06.813884+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.813884+0000","last_undegraded":"2024-09-19T05:34:06.813884+0000","last_fullsized":"2024-09-19T05:34:06.813884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.831688+0000","last_change":"2024-09-19T05:34:06.831688+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.831688+0000","last_undegraded":"2024-09-19T05:34:06.831688+0000","last_fullsized":"2024-09-19T05:34:06.831688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821661+0000","last_change":"2024-09-19T05:34:06.821661+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821661+0000","last_undegraded":"2024-09-19T05:34:06.821661+0000","last_fullsized":"2024-09-19T05:34:06.821661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822490+0000","last_change":"2024-09-19T05:34:06.822490+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822490+0000","last_undegraded":"2024-09-19T05:34:06.822490+0000","last_fullsized":"2024-09-19T05:34:06.822490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827013+0000","last_change":"2024-09-19T05:34:06.827013+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827013+0000","last_undegraded":"2024-09-19T05:34:06.827013+0000","last_fullsized":"2024-09-19T05:34:06.827013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.834957+0000","last_change":"2024-09-19T05:34:06.834957+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.834957+0000","last_undegraded":"2024-09-19T05:34:06.834957+0000","last_fullsized":"2024-09-19T05:34:06.834957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.825476+0000","last_change":"2024-09-19T05:34:06.825476+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.825476+0000","last_undegraded":"2024-09-19T05:34:06.825476+0000","last_fullsized":"2024-09-19T05:34:06.825476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.832898+0000","last_change":"2024-09-19T05:34:06.832898+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.832898+0000","last_undegraded":"2024-09-19T05:34:06.832898+0000","last_fullsized":"2024-09-19T05:34:06.832898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821191+0000","last_change":"2024-09-19T05:34:06.821191+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821191+0000","last_undegraded":"2024-09-19T05:34:06.821191+0000","last_fullsized":"2024-09-19T05:34:06.821191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827166+0000","last_change":"2024-09-19T05:34:06.827166+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827166+0000","last_undegraded":"2024-09-19T05:34:06.827166+0000","last_fullsized":"2024-09-19T05:34:06.827166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823397+0000","last_change":"2024-09-19T05:34:06.823397+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823397+0000","last_undegraded":"2024-09-19T05:34:06.823397+0000","last_fullsized":"2024-09-19T05:34:06.823397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830708+0000","last_change":"2024-09-19T05:34:06.830708+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830708+0000","last_undegraded":"2024-09-19T05:34:06.830708+0000","last_fullsized":"2024-09-19T05:34:06.830708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854676+0000","last_change":"2024-09-19T05:34:06.852439+0000","last_active":"2024-09-19T05:34:06.854676+0000","last_peered":"2024-09-19T05:34:06.854676+0000","last_clean":"2024-09-19T05:34:06.854676+0000","last_became_active":"2024-09-19T05:34:06.851717+0000","last_became_peered":"2024-09-19T05:34:06.851717+0000","last_unstale":"2024-09-19T05:34:06.854676+0000","last_undegraded":"2024-09-19T05:34:06.854676+0000","last_fullsized":"2024-09-19T05:34:06.854676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:56.835003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824227+0000","last_change":"2024-09-19T05:34:06.824227+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824227+0000","last_undegraded":"2024-09-19T05:34:06.824227+0000","last_fullsized":"2024-09-19T05:34:06.824227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.852108+0000","last_change":"2024-09-19T05:34:06.845116+0000","last_active":"2024-09-19T05:34:06.852108+0000","last_peered":"2024-09-19T05:34:06.852108+0000","last_clean":"2024-09-19T05:34:06.852108+0000","last_became_active":"2024-09-19T05:34:06.844043+0000","last_became_peered":"2024-09-19T05:34:06.844043+0000","last_unstale":"2024-09-19T05:34:06.852108+0000","last_undegraded":"2024-09-19T05:34:06.852108+0000","last_fullsized":"2024-09-19T05:34:06.852108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.815160+0000","last_change":"2024-09-19T05:34:06.815160+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.815160+0000","last_undegraded":"2024-09-19T05:34:06.815160+0000","last_fullsized":"2024-09-19T05:34:06.815160+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849490+0000","last_change":"2024-09-19T05:34:06.845387+0000","last_active":"2024-09-19T05:34:06.849490+0000","last_peered":"2024-09-19T05:34:06.849490+0000","last_clean":"2024-09-19T05:34:06.849490+0000","last_became_active":"2024-09-19T05:34:06.845018+0000","last_became_peered":"2024-09-19T05:34:06.845018+0000","last_unstale":"2024-09-19T05:34:06.849490+0000","last_undegraded":"2024-09-19T05:34:06.849490+0000","last_fullsized":"2024-09-19T05:34:06.849490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:14.356013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.834210+0000","last_change":"2024-09-19T05:34:06.834210+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.834210+0000","last_undegraded":"2024-09-19T05:34:06.834210+0000","last_fullsized":"2024-09-19T05:34:06.834210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.853118+0000","last_change":"2024-09-19T05:34:06.849848+0000","last_active":"2024-09-19T05:34:06.853118+0000","last_peered":"2024-09-19T05:34:06.853118+0000","last_clean":"2024-09-19T05:34:06.853118+0000","last_became_active":"2024-09-19T05:34:06.849061+0000","last_became_peered":"2024-09-19T05:34:06.849061+0000","last_unstale":"2024-09-19T05:34:06.853118+0000","last_undegraded":"2024-09-19T05:34:06.853118+0000","last_fullsized":"2024-09-19T05:34:06.853118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:34.095147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822046+0000","last_change":"2024-09-19T05:34:06.822046+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822046+0000","last_undegraded":"2024-09-19T05:34:06.822046+0000","last_fullsized":"2024-09-19T05:34:06.822046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854942+0000","last_change":"2024-09-19T05:34:06.838559+0000","last_active":"2024-09-19T05:34:06.854942+0000","last_peered":"2024-09-19T05:34:06.854942+0000","last_clean":"2024-09-19T05:34:06.854942+0000","last_became_active":"2024-09-19T05:34:06.837817+0000","last_became_peered":"2024-09-19T05:34:06.837817+0000","last_unstale":"2024-09-19T05:34:06.854942+0000","last_undegraded":"2024-09-19T05:34:06.854942+0000","last_fullsized":"2024-09-19T05:34:06.854942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:29.930489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820763+0000","last_change":"2024-09-19T05:34:06.820763+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820763+0000","last_undegraded":"2024-09-19T05:34:06.820763+0000","last_fullsized":"2024-09-19T05:34:06.820763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.864174+0000","last_change":"2024-09-19T05:34:06.859044+0000","last_active":"2024-09-19T05:34:06.864174+0000","last_peered":"2024-09-19T05:34:06.864174+0000","last_clean":"2024-09-19T05:34:06.864174+0000","last_became_active":"2024-09-19T05:34:06.858309+0000","last_became_peered":"2024-09-19T05:34:06.858309+0000","last_unstale":"2024-09-19T05:34:06.864174+0000","last_undegraded":"2024-09-19T05:34:06.864174+0000","last_fullsized":"2024-09-19T05:34:06.864174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816022+0000","last_change":"2024-09-19T05:34:06.816022+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816022+0000","last_undegraded":"2024-09-19T05:34:06.816022+0000","last_fullsized":"2024-09-19T05:34:06.816022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.857972+0000","last_change":"2024-09-19T05:34:06.857190+0000","last_active":"2024-09-19T05:34:06.857972+0000","last_peered":"2024-09-19T05:34:06.857972+0000","last_clean":"2024-09-19T05:34:06.857972+0000","last_became_active":"2024-09-19T05:34:06.856825+0000","last_became_peered":"2024-09-19T05:34:06.856825+0000","last_unstale":"2024-09-19T05:34:06.857972+0000","last_undegraded":"2024-09-19T05:34:06.857972+0000","last_fullsized":"2024-09-19T05:34:06.857972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:32.836196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829917+0000","last_change":"2024-09-19T05:34:06.829917+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829917+0000","last_undegraded":"2024-09-19T05:34:06.829917+0000","last_fullsized":"2024-09-19T05:34:06.829917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850723+0000","last_change":"2024-09-19T05:34:06.842643+0000","last_active":"2024-09-19T05:34:06.850723+0000","last_peered":"2024-09-19T05:34:06.850723+0000","last_clean":"2024-09-19T05:34:06.850723+0000","last_became_active":"2024-09-19T05:34:06.841913+0000","last_became_peered":"2024-09-19T05:34:06.841913+0000","last_unstale":"2024-09-19T05:34:06.850723+0000","last_undegraded":"2024-09-19T05:34:06.850723+0000","last_fullsized":"2024-09-19T05:34:06.850723+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.764872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821014+0000","last_change":"2024-09-19T05:34:06.821014+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821014+0000","last_undegraded":"2024-09-19T05:34:06.821014+0000","last_fullsized":"2024-09-19T05:34:06.821014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849021+0000","last_change":"2024-09-19T05:34:06.841162+0000","last_active":"2024-09-19T05:34:06.849021+0000","last_peered":"2024-09-19T05:34:06.849021+0000","last_clean":"2024-09-19T05:34:06.849021+0000","last_became_active":"2024-09-19T05:34:06.840853+0000","last_became_peered":"2024-09-19T05:34:06.840853+0000","last_unstale":"2024-09-19T05:34:06.849021+0000","last_undegraded":"2024-09-19T05:34:06.849021+0000","last_fullsized":"2024-09-19T05:34:06.849021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:21.838375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.833585+0000","last_change":"2024-09-19T05:34:06.833585+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.833585+0000","last_undegraded":"2024-09-19T05:34:06.833585+0000","last_fullsized":"2024-09-19T05:34:06.833585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859409+0000","last_change":"2024-09-19T05:34:06.853535+0000","last_active":"2024-09-19T05:34:06.859409+0000","last_peered":"2024-09-19T05:34:06.859409+0000","last_clean":"2024-09-19T05:34:06.859409+0000","last_became_active":"2024-09-19T05:34:06.847562+0000","last_became_peered":"2024-09-19T05:34:06.847562+0000","last_unstale":"2024-09-19T05:34:06.859409+0000","last_undegraded":"2024-09-19T05:34:06.859409+0000","last_fullsized":"2024-09-19T05:34:06.859409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:32.065609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822230+0000","last_change":"2024-09-19T05:34:06.822230+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822230+0000","last_undegraded":"2024-09-19T05:34:06.822230+0000","last_fullsized":"2024-09-19T05:34:06.822230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859525+0000","last_change":"2024-09-19T05:34:06.848198+0000","last_active":"2024-09-19T05:34:06.859525+0000","last_peered":"2024-09-19T05:34:06.859525+0000","last_clean":"2024-09-19T05:34:06.859525+0000","last_became_active":"2024-09-19T05:34:06.847343+0000","last_became_peered":"2024-09-19T05:34:06.847343+0000","last_unstale":"2024-09-19T05:34:06.859525+0000","last_undegraded":"2024-09-19T05:34:06.859525+0000","last_fullsized":"2024-09-19T05:34:06.859525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:37.529574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.814493+0000","last_change":"2024-09-19T05:34:06.814493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.814493+0000","last_undegraded":"2024-09-19T05:34:06.814493+0000","last_fullsized":"2024-09-19T05:34:06.814493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.862889+0000","last_change":"2024-09-19T05:34:06.860750+0000","last_active":"2024-09-19T05:34:06.862889+0000","last_peered":"2024-09-19T05:34:06.862889+0000","last_clean":"2024-09-19T05:34:06.862889+0000","last_became_active":"2024-09-19T05:34:06.860241+0000","last_became_peered":"2024-09-19T05:34:06.860241+0000","last_unstale":"2024-09-19T05:34:06.862889+0000","last_undegraded":"2024-09-19T05:34:06.862889+0000","last_fullsized":"2024-09-19T05:34:06.862889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:02.255476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821481+0000","last_change":"2024-09-19T05:34:06.821481+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821481+0000","last_undegraded":"2024-09-19T05:34:06.821481+0000","last_fullsized":"2024-09-19T05:34:06.821481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850206+0000","last_change":"2024-09-19T05:34:06.843826+0000","last_active":"2024-09-19T05:34:06.850206+0000","last_peered":"2024-09-19T05:34:06.850206+0000","last_clean":"2024-09-19T05:34:06.850206+0000","last_became_active":"2024-09-19T05:34:06.843513+0000","last_became_peered":"2024-09-19T05:34:06.843513+0000","last_unstale":"2024-09-19T05:34:06.850206+0000","last_undegraded":"2024-09-19T05:34:06.850206+0000","last_fullsized":"2024-09-19T05:34:06.850206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:10.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.828946+0000","last_change":"2024-09-19T05:34:06.828946+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.828946+0000","last_undegraded":"2024-09-19T05:34:06.828946+0000","last_fullsized":"2024-09-19T05:34:06.828946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854780+0000","last_change":"2024-09-19T05:34:06.848974+0000","last_active":"2024-09-19T05:34:06.854780+0000","last_peered":"2024-09-19T05:34:06.854780+0000","last_clean":"2024-09-19T05:34:06.854780+0000","last_became_active":"2024-09-19T05:34:06.848530+0000","last_became_peered":"2024-09-19T05:34:06.848530+0000","last_unstale":"2024-09-19T05:34:06.854780+0000","last_undegraded":"2024-09-19T05:34:06.854780+0000","last_fullsized":"2024-09-19T05:34:06.854780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:49.609195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.825156+0000","last_change":"2024-09-19T05:34:06.825156+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.825156+0000","last_undegraded":"2024-09-19T05:34:06.825156+0000","last_fullsized":"2024-09-19T05:34:06.825156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.843504+0000","last_change":"2024-09-19T05:34:06.834851+0000","last_active":"2024-09-19T05:34:06.843504+0000","last_peered":"2024-09-19T05:34:06.843504+0000","last_clean":"2024-09-19T05:34:06.843504+0000","last_became_active":"2024-09-19T05:34:06.833971+0000","last_became_peered":"2024-09-19T05:34:06.833971+0000","last_unstale":"2024-09-19T05:34:06.843504+0000","last_undegraded":"2024-09-19T05:34:06.843504+0000","last_fullsized":"2024-09-19T05:34:06.843504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:17.675046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829302+0000","last_change":"2024-09-19T05:34:06.829302+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829302+0000","last_undegraded":"2024-09-19T05:34:06.829302+0000","last_fullsized":"2024-09-19T05:34:06.829302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.858265+0000","last_change":"2024-09-19T05:34:06.845734+0000","last_active":"2024-09-19T05:34:06.858265+0000","last_peered":"2024-09-19T05:34:06.858265+0000","last_clean":"2024-09-19T05:34:06.858265+0000","last_became_active":"2024-09-19T05:34:06.845025+0000","last_became_peered":"2024-09-19T05:34:06.845025+0000","last_unstale":"2024-09-19T05:34:06.858265+0000","last_undegraded":"2024-09-19T05:34:06.858265+0000","last_fullsized":"2024-09-19T05:34:06.858265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:03.879574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.836944+0000","last_change":"2024-09-19T05:34:06.836944+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.836944+0000","last_undegraded":"2024-09-19T05:34:06.836944+0000","last_fullsized":"2024-09-19T05:34:06.836944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859621+0000","last_change":"2024-09-19T05:34:06.854395+0000","last_active":"2024-09-19T05:34:06.859621+0000","last_peered":"2024-09-19T05:34:06.859621+0000","last_clean":"2024-09-19T05:34:06.859621+0000","last_became_active":"2024-09-19T05:34:06.847844+0000","last_became_peered":"2024-09-19T05:34:06.847844+0000","last_unstale":"2024-09-19T05:34:06.859621+0000","last_undegraded":"2024-09-19T05:34:06.859621+0000","last_fullsized":"2024-09-19T05:34:06.859621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:47.344590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.826435+0000","last_change":"2024-09-19T05:34:06.826435+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.826435+0000","last_undegraded":"2024-09-19T05:34:06.826435+0000","last_fullsized":"2024-09-19T05:34:06.826435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.853027+0000","last_change":"2024-09-19T05:34:06.849562+0000","last_active":"2024-09-19T05:34:06.853027+0000","last_peered":"2024-09-19T05:34:06.853027+0000","last_clean":"2024-09-19T05:34:06.853027+0000","last_became_active":"2024-09-19T05:34:06.848829+0000","last_became_peered":"2024-09-19T05:34:06.848829+0000","last_unstale":"2024-09-19T05:34:06.853027+0000","last_undegraded":"2024-09-19T05:34:06.853027+0000","last_fullsized":"2024-09-19T05:34:06.853027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:56.835003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816398+0000","last_change":"2024-09-19T05:34:06.816398+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816398+0000","last_undegraded":"2024-09-19T05:34:06.816398+0000","last_fullsized":"2024-09-19T05:34:06.816398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.860008+0000","last_change":"2024-09-19T05:34:06.859213+0000","last_active":"2024-09-19T05:34:06.860008+0000","last_peered":"2024-09-19T05:34:06.860008+0000","last_clean":"2024-09-19T05:34:06.860008+0000","last_became_active":"2024-09-19T05:34:06.858840+0000","last_became_peered":"2024-09-19T05:34:06.858840+0000","last_unstale":"2024-09-19T05:34:06.860008+0000","last_undegraded":"2024-09-19T05:34:06.860008+0000","last_fullsized":"2024-09-19T05:34:06.860008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.248248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820128+0000","last_change":"2024-09-19T05:34:06.820128+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820128+0000","last_undegraded":"2024-09-19T05:34:06.820128+0000","last_fullsized":"2024-09-19T05:34:06.820128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.835427+0000","last_change":"2024-09-19T05:34:06.832278+0000","last_active":"2024-09-19T05:34:06.835427+0000","last_peered":"2024-09-19T05:34:06.835427+0000","last_clean":"2024-09-19T05:34:06.835427+0000","last_became_active":"2024-09-19T05:34:06.831901+0000","last_became_peered":"2024-09-19T05:34:06.831901+0000","last_unstale":"2024-09-19T05:34:06.835427+0000","last_undegraded":"2024-09-19T05:34:06.835427+0000","last_fullsized":"2024-09-19T05:34:06.835427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823802+0000","last_change":"2024-09-19T05:34:06.823802+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823802+0000","last_undegraded":"2024-09-19T05:34:06.823802+0000","last_fullsized":"2024-09-19T05:34:06.823802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.833632+0000","last_change":"2024-09-19T05:34:06.830513+0000","last_active":"2024-09-19T05:34:06.833632+0000","last_peered":"2024-09-19T05:34:06.833632+0000","last_clean":"2024-09-19T05:34:06.833632+0000","last_became_active":"2024-09-19T05:34:06.830201+0000","last_became_peered":"2024-09-19T05:34:06.830201+0000","last_unstale":"2024-09-19T05:34:06.833632+0000","last_undegraded":"2024-09-19T05:34:06.833632+0000","last_fullsized":"2024-09-19T05:34:06.833632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:15.697350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819493+0000","last_change":"2024-09-19T05:34:06.819493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819493+0000","last_undegraded":"2024-09-19T05:34:06.819493+0000","last_fullsized":"2024-09-19T05:34:06.819493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.833978+0000","last_change":"2024-09-19T05:34:06.832694+0000","last_active":"2024-09-19T05:34:06.833978+0000","last_peered":"2024-09-19T05:34:06.833978+0000","last_clean":"2024-09-19T05:34:06.833978+0000","last_became_active":"2024-09-19T05:34:06.832147+0000","last_became_peered":"2024-09-19T05:34:06.832147+0000","last_unstale":"2024-09-19T05:34:06.833978+0000","last_undegraded":"2024-09-19T05:34:06.833978+0000","last_fullsized":"2024-09-19T05:34:06.833978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:28.098709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821025+0000","last_change":"2024-09-19T05:34:06.821025+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821025+0000","last_undegraded":"2024-09-19T05:34:06.821025+0000","last_fullsized":"2024-09-19T05:34:06.821025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.863501+0000","last_change":"2024-09-19T05:34:06.857960+0000","last_active":"2024-09-19T05:34:06.863501+0000","last_peered":"2024-09-19T05:34:06.863501+0000","last_clean":"2024-09-19T05:34:06.863501+0000","last_became_active":"2024-09-19T05:34:06.857184+0000","last_became_peered":"2024-09-19T05:34:06.857184+0000","last_unstale":"2024-09-19T05:34:06.863501+0000","last_undegraded":"2024-09-19T05:34:06.863501+0000","last_fullsized":"2024-09-19T05:34:06.863501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:45.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824342+0000","last_change":"2024-09-19T05:34:06.824342+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824342+0000","last_undegraded":"2024-09-19T05:34:06.824342+0000","last_fullsized":"2024-09-19T05:34:06.824342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.826810+0000","last_change":"2024-09-19T05:34:06.826244+0000","last_active":"2024-09-19T05:34:06.826810+0000","last_peered":"2024-09-19T05:34:06.826810+0000","last_clean":"2024-09-19T05:34:06.826810+0000","last_became_active":"2024-09-19T05:34:06.825918+0000","last_became_peered":"2024-09-19T05:34:06.825918+0000","last_unstale":"2024-09-19T05:34:06.826810+0000","last_undegraded":"2024-09-19T05:34:06.826810+0000","last_fullsized":"2024-09-19T05:34:06.826810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:13.779353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821762+0000","last_change":"2024-09-19T05:34:06.821762+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821762+0000","last_undegraded":"2024-09-19T05:34:06.821762+0000","last_fullsized":"2024-09-19T05:34:06.821762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859669+0000","last_change":"2024-09-19T05:34:06.855068+0000","last_active":"2024-09-19T05:34:06.859669+0000","last_peered":"2024-09-19T05:34:06.859669+0000","last_clean":"2024-09-19T05:34:06.859669+0000","last_became_active":"2024-09-19T05:34:06.847302+0000","last_became_peered":"2024-09-19T05:34:06.847302+0000","last_unstale":"2024-09-19T05:34:06.859669+0000","last_undegraded":"2024-09-19T05:34:06.859669+0000","last_fullsized":"2024-09-19T05:34:06.859669+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:30.860434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830904+0000","last_change":"2024-09-19T05:34:06.830904+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830904+0000","last_undegraded":"2024-09-19T05:34:06.830904+0000","last_fullsized":"2024-09-19T05:34:06.830904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854852+0000","last_change":"2024-09-19T05:34:06.850006+0000","last_active":"2024-09-19T05:34:06.854852+0000","last_peered":"2024-09-19T05:34:06.854852+0000","last_clean":"2024-09-19T05:34:06.854852+0000","last_became_active":"2024-09-19T05:34:06.849652+0000","last_became_peered":"2024-09-19T05:34:06.849652+0000","last_unstale":"2024-09-19T05:34:06.854852+0000","last_undegraded":"2024-09-19T05:34:06.854852+0000","last_fullsized":"2024-09-19T05:34:06.854852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:28.809771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829745+0000","last_change":"2024-09-19T05:34:06.829745+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829745+0000","last_undegraded":"2024-09-19T05:34:06.829745+0000","last_fullsized":"2024-09-19T05:34:06.829745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.834948+0000","last_change":"2024-09-19T05:34:06.831923+0000","last_active":"2024-09-19T05:34:06.834948+0000","last_peered":"2024-09-19T05:34:06.834948+0000","last_clean":"2024-09-19T05:34:06.834948+0000","last_became_active":"2024-09-19T05:34:06.831515+0000","last_became_peered":"2024-09-19T05:34:06.831515+0000","last_unstale":"2024-09-19T05:34:06.834948+0000","last_undegraded":"2024-09-19T05:34:06.834948+0000","last_fullsized":"2024-09-19T05:34:06.834948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:03.879574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820860+0000","last_change":"2024-09-19T05:34:06.820860+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820860+0000","last_undegraded":"2024-09-19T05:34:06.820860+0000","last_fullsized":"2024-09-19T05:34:06.820860+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850246+0000","last_change":"2024-09-19T05:34:06.842780+0000","last_active":"2024-09-19T05:34:06.850246+0000","last_peered":"2024-09-19T05:34:06.850246+0000","last_clean":"2024-09-19T05:34:06.850246+0000","last_became_active":"2024-09-19T05:34:06.838570+0000","last_became_peered":"2024-09-19T05:34:06.838570+0000","last_unstale":"2024-09-19T05:34:06.850246+0000","last_undegraded":"2024-09-19T05:34:06.850246+0000","last_fullsized":"2024-09-19T05:34:06.850246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:45.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820223+0000","last_change":"2024-09-19T05:34:06.820223+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820223+0000","last_undegraded":"2024-09-19T05:34:06.820223+0000","last_fullsized":"2024-09-19T05:34:06.820223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850634+0000","last_change":"2024-09-19T05:34:06.842616+0000","last_active":"2024-09-19T05:34:06.850634+0000","last_peered":"2024-09-19T05:34:06.850634+0000","last_clean":"2024-09-19T05:34:06.850634+0000","last_became_active":"2024-09-19T05:34:06.841906+0000","last_became_peered":"2024-09-19T05:34:06.841906+0000","last_unstale":"2024-09-19T05:34:06.850634+0000","last_undegraded":"2024-09-19T05:34:06.850634+0000","last_fullsized":"2024-09-19T05:34:06.850634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.764872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816968+0000","last_change":"2024-09-19T05:34:06.816968+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816968+0000","last_undegraded":"2024-09-19T05:34:06.816968+0000","last_fullsized":"2024-09-19T05:34:06.816968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850808+0000","last_change":"2024-09-19T05:34:06.840695+0000","last_active":"2024-09-19T05:34:06.850808+0000","last_peered":"2024-09-19T05:34:06.850808+0000","last_clean":"2024-09-19T05:34:06.850808+0000","last_became_active":"2024-09-19T05:34:06.837229+0000","last_became_peered":"2024-09-19T05:34:06.837229+0000","last_unstale":"2024-09-19T05:34:06.850808+0000","last_undegraded":"2024-09-19T05:34:06.850808+0000","last_fullsized":"2024-09-19T05:34:06.850808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:17.675046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829424+0000","last_change":"2024-09-19T05:34:06.829424+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829424+0000","last_undegraded":"2024-09-19T05:34:06.829424+0000","last_fullsized":"2024-09-19T05:34:06.829424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849102+0000","last_change":"2024-09-19T05:34:06.844825+0000","last_active":"2024-09-19T05:34:06.849102+0000","last_peered":"2024-09-19T05:34:06.849102+0000","last_clean":"2024-09-19T05:34:06.849102+0000","last_became_active":"2024-09-19T05:34:06.844291+0000","last_became_peered":"2024-09-19T05:34:06.844291+0000","last_unstale":"2024-09-19T05:34:06.849102+0000","last_undegraded":"2024-09-19T05:34:06.849102+0000","last_fullsized":"2024-09-19T05:34:06.849102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:02.484585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824647+0000","last_change":"2024-09-19T05:34:06.824647+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824647+0000","last_undegraded":"2024-09-19T05:34:06.824647+0000","last_fullsized":"2024-09-19T05:34:06.824647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.864224+0000","last_change":"2024-09-19T05:34:06.859069+0000","last_active":"2024-09-19T05:34:06.864224+0000","last_peered":"2024-09-19T05:34:06.864224+0000","last_clean":"2024-09-19T05:34:06.864224+0000","last_became_active":"2024-09-19T05:34:06.858269+0000","last_became_peered":"2024-09-19T05:34:06.858269+0000","last_unstale":"2024-09-19T05:34:06.864224+0000","last_undegraded":"2024-09-19T05:34:06.864224+0000","last_fullsized":"2024-09-19T05:34:06.864224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:14.356013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.826217+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:34:06.826217+0000","last_peered":"2024-09-19T05:34:06.826217+0000","last_clean":"2024-09-19T05:34:06.826217+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:34:06.826217+0000","last_undegraded":"2024-09-19T05:34:06.826217+0000","last_fullsized":"2024-09-19T05:34:06.826217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":769758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":769758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:34:10.927 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:34:11.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede9d98640 1 Processor -- start 2024-09-19T05:34:11.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede9d98640 1 -- start start 2024-09-19T05:34:11.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede9d98640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fede4161da0 0x7fede40d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede9d98640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40d0e80 0x7fede40d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede9d98640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede40d4d40 con 0x7fede40b41c0 2024-09-19T05:34:11.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede9d98640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fede40d0840 con 0x7fede4161da0 2024-09-19T05:34:11.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede9d98640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fede40d1800 con 0x7fede40d0e80 2024-09-19T05:34:11.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede3fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fede40b41c0 0x7fede40b4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38450/0 (socket says 172.21.15.67:38450) 2024-09-19T05:34:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede3fff640 1 -- 172.21.15.67:0/115274571 learned_addr learned my addr 172.21.15.67:0/115274571 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede2ffd640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40d0e80 0x7fede40d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede37fe640 1 --2- 172.21.15.67:0/115274571 >> v2:172.21.15.97:3300/0 conn(0x7fede4161da0 0x7fede40d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568543352 0 0) 0x7fede40d4d40 con 0x7fede40b41c0 2024-09-19T05:34:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedcc003530 con 0x7fede40b41c0 2024-09-19T05:34:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2956216721 0 0) 0x7fedcc003530 con 0x7fede40b41c0 2024-09-19T05:34:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40d0e80 msgr2=0x7fede40d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40d0e80 0x7fede40d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 >> v2:172.21.15.97:3300/0 conn(0x7fede4161da0 msgr2=0x7fede40d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 --2- 172.21.15.67:0/115274571 >> v2:172.21.15.97:3300/0 conn(0x7fede4161da0 0x7fede40d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede40d5020 con 0x7fede40b41c0 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7feddc001a00 con 0x7fede40b41c0 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 >> v1:172.21.15.67:6789/0 conn(0x7fede40b41c0 legacy=0x7fede40b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedcc0039c0 0x7fedcc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40d0e80 0x7fedcc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedcc004d50 0x7fedcc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fede40d0840 con 0x7fedcc0039c0 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fede40d1800 con 0x7fedcc004d50 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fedcc00b9d0 con 0x7fede40d0e80 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede37fe640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedcc0039c0 0x7fedcc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede37fe640 1 -- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40d0e80 msgr2=0x7fedcc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede3fff640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedcc004d50 0x7fedcc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede2ffd640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40d0e80 0x7fedcc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede37fe640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40d0e80 0x7fedcc004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede37fe640 1 -- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedcc004d50 msgr2=0x7fedcc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede37fe640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedcc004d50 0x7fedcc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede37fe640 1 -- 172.21.15.67:0/115274571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc003530 con 0x7fedcc0039c0 2024-09-19T05:34:11.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.084+0000 7fede3fff640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedcc004d50 0x7fedcc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede37fe640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedcc0039c0 0x7fedcc003de0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009b10 tx=0x7fedd801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783b79e23091e68c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80096b0 con 0x7fedcc0039c0 2024-09-19T05:34:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd80a6490 con 0x7fedcc0039c0 2024-09-19T05:34:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede27fc640 1 -- 172.21.15.67:0/115274571 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80a6880 con 0x7fedcc0039c0 2024-09-19T05:34:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede9d98640 1 -- 172.21.15.67:0/115274571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedcc0039c0 msgr2=0x7fedcc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede9d98640 1 --2- 172.21.15.67:0/115274571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedcc0039c0 0x7fedcc003de0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009b10 tx=0x7fedd801cab0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede3fff640 1 -- 172.21.15.67:0/115274571 reap_dead start 2024-09-19T05:34:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede9d98640 1 -- 172.21.15.67:0/115274571 shutdown_connections 2024-09-19T05:34:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede9d98640 1 -- 172.21.15.67:0/115274571 >> 172.21.15.67:0/115274571 conn(0x7fede408bfc0 msgr2=0x7fede40d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede9d98640 1 -- 172.21.15.67:0/115274571 shutdown_connections 2024-09-19T05:34:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.088+0000 7fede9d98640 1 -- 172.21.15.67:0/115274571 wait complete. 2024-09-19T05:34:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 Processor -- start 2024-09-19T05:34:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 -- start start 2024-09-19T05:34:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede4154990 0x7fede4164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4154d70 0x7fede415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40cb560 0x7fede415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fede4162180 con 0x7fede4154990 2024-09-19T05:34:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fede40b5d00 con 0x7fede4154d70 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fede41694e0 con 0x7fede40cb560 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede4154990 0x7fede4164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede4154990 0x7fede4164710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36632/0 (socket says 172.21.15.67:36632) 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede37fe640 1 -- 172.21.15.67:0/3352010096 learned_addr learned my addr 172.21.15.67:0/3352010096 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede2ffd640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4154d70 0x7fede415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede3fff640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40cb560 0x7fede415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede37fe640 1 -- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40cb560 msgr2=0x7fede415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede37fe640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40cb560 0x7fede415dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede37fe640 1 -- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4154d70 msgr2=0x7fede415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede37fe640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4154d70 0x7fede415d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede37fe640 1 -- 172.21.15.67:0/3352010096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede40cbad0 con 0x7fede4154990 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede2ffd640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4154d70 0x7fede415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede37fe640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede4154990 0x7fede4164710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009b10 tx=0x7fedd8019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fedcbfff640 1 -- 172.21.15.67:0/3352010096 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80be070 con 0x7fede4154990 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fedcbfff640 1 -- 172.21.15.67:0/3352010096 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd800f000 con 0x7fede4154990 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fedcbfff640 1 -- 172.21.15.67:0/3352010096 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80a7470 con 0x7fede4154990 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 -- 172.21.15.67:0/3352010096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede40cbdb0 con 0x7fede4154990 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 -- 172.21.15.67:0/3352010096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede40cc370 con 0x7fede4154990 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fede9d98640 1 -- 172.21.15.67:0/3352010096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede40d1af0 con 0x7fede4154990 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fedcbfff640 1 -- 172.21.15.67:0/3352010096 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fedd80c1070 con 0x7fede4154990 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fedcbfff640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fedd00678f0 0x7fedd0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.092+0000 7fedcbfff640 1 -- 172.21.15.67:0/3352010096 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fedd811f7d0 con 0x7fede4154990 2024-09-19T05:34:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.096+0000 7fede2ffd640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fedd00678f0 0x7fedd0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.096+0000 7fede2ffd640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fedd00678f0 0x7fedd0069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fede41fad30 tx=0x7fedd4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.100+0000 7fedcbfff640 1 -- 172.21.15.67:0/3352010096 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fedd80ac020 con 0x7fede4154990 2024-09-19T05:34:11.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.256+0000 7fede9d98640 1 -- 172.21.15.67:0/3352010096 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fede40b4960 con 0x7fedd00678f0 2024-09-19T05:34:11.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.276+0000 7fedcbfff640 1 -- 172.21.15.67:0/3352010096 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246640 (secure 0 0 0) 0x7fede40b4960 con 0x7fedd00678f0 2024-09-19T05:34:11.284 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:11.289 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:34:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 -- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fedd00678f0 msgr2=0x7fedd0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fedd00678f0 0x7fedd0069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fede41fad30 tx=0x7fedd4008040 comp rx=0 tx=0).stop 2024-09-19T05:34:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 -- 172.21.15.67:0/3352010096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede4154990 msgr2=0x7fede4164710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede4154990 0x7fede4164710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009b10 tx=0x7fedd8019850 comp rx=0 tx=0).stop 2024-09-19T05:34:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 -- 172.21.15.67:0/3352010096 shutdown_connections 2024-09-19T05:34:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fedd00678f0 0x7fedd0069db0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede40cb560 0x7fede415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4154d70 0x7fede415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 --2- 172.21.15.67:0/3352010096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede4154990 0x7fede4164710 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 -- 172.21.15.67:0/3352010096 >> 172.21.15.67:0/3352010096 conn(0x7fede408bfc0 msgr2=0x7fede41674d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 -- 172.21.15.67:0/3352010096 shutdown_connections 2024-09-19T05:34:11.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.280+0000 7fede9d98640 1 -- 172.21.15.67:0/3352010096 wait complete. 2024-09-19T05:34:11.301 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-19T05:34:11.125638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220696,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754024,"statfs":{"total":773094113280,"available":772868120576,"internally_reserved":0,"allocated":4562944,"data_stored":2615856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.321667"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.836604+0000","last_change":"2024-09-19T05:34:06.836604+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.836604+0000","last_undegraded":"2024-09-19T05:34:06.836604+0000","last_fullsized":"2024-09-19T05:34:06.836604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.835511+0000","last_change":"2024-09-19T05:34:06.835511+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.835511+0000","last_undegraded":"2024-09-19T05:34:06.835511+0000","last_fullsized":"2024-09-19T05:34:06.835511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820312+0000","last_change":"2024-09-19T05:34:06.820312+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820312+0000","last_undegraded":"2024-09-19T05:34:06.820312+0000","last_fullsized":"2024-09-19T05:34:06.820312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829261+0000","last_change":"2024-09-19T05:34:06.829261+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829261+0000","last_undegraded":"2024-09-19T05:34:06.829261+0000","last_fullsized":"2024-09-19T05:34:06.829261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829785+0000","last_change":"2024-09-19T05:34:06.829785+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829785+0000","last_undegraded":"2024-09-19T05:34:06.829785+0000","last_fullsized":"2024-09-19T05:34:06.829785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.828835+0000","last_change":"2024-09-19T05:34:06.828835+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.828835+0000","last_undegraded":"2024-09-19T05:34:06.828835+0000","last_fullsized":"2024-09-19T05:34:06.828835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823236+0000","last_change":"2024-09-19T05:34:06.823236+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823236+0000","last_undegraded":"2024-09-19T05:34:06.823236+0000","last_fullsized":"2024-09-19T05:34:06.823236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830660+0000","last_change":"2024-09-19T05:34:06.830660+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830660+0000","last_undegraded":"2024-09-19T05:34:06.830660+0000","last_fullsized":"2024-09-19T05:34:06.830660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819609+0000","last_change":"2024-09-19T05:34:06.819609+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819609+0000","last_undegraded":"2024-09-19T05:34:06.819609+0000","last_fullsized":"2024-09-19T05:34:06.819609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827096+0000","last_change":"2024-09-19T05:34:06.827096+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827096+0000","last_undegraded":"2024-09-19T05:34:06.827096+0000","last_fullsized":"2024-09-19T05:34:06.827096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.835381+0000","last_change":"2024-09-19T05:34:06.835381+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.835381+0000","last_undegraded":"2024-09-19T05:34:06.835381+0000","last_fullsized":"2024-09-19T05:34:06.835381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819493+0000","last_change":"2024-09-19T05:34:06.819493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819493+0000","last_undegraded":"2024-09-19T05:34:06.819493+0000","last_fullsized":"2024-09-19T05:34:06.819493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822917+0000","last_change":"2024-09-19T05:34:06.822917+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822917+0000","last_undegraded":"2024-09-19T05:34:06.822917+0000","last_fullsized":"2024-09-19T05:34:06.822917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.817924+0000","last_change":"2024-09-19T05:34:06.817924+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.817924+0000","last_undegraded":"2024-09-19T05:34:06.817924+0000","last_fullsized":"2024-09-19T05:34:06.817924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822032+0000","last_change":"2024-09-19T05:34:06.822032+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822032+0000","last_undegraded":"2024-09-19T05:34:06.822032+0000","last_fullsized":"2024-09-19T05:34:06.822032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824959+0000","last_change":"2024-09-19T05:34:06.824959+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824959+0000","last_undegraded":"2024-09-19T05:34:06.824959+0000","last_fullsized":"2024-09-19T05:34:06.824959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829314+0000","last_change":"2024-09-19T05:34:06.829314+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829314+0000","last_undegraded":"2024-09-19T05:34:06.829314+0000","last_fullsized":"2024-09-19T05:34:06.829314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822019+0000","last_change":"2024-09-19T05:34:06.822019+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822019+0000","last_undegraded":"2024-09-19T05:34:06.822019+0000","last_fullsized":"2024-09-19T05:34:06.822019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821810+0000","last_change":"2024-09-19T05:34:06.821810+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821810+0000","last_undegraded":"2024-09-19T05:34:06.821810+0000","last_fullsized":"2024-09-19T05:34:06.821810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.833600+0000","last_change":"2024-09-19T05:34:06.833600+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.833600+0000","last_undegraded":"2024-09-19T05:34:06.833600+0000","last_fullsized":"2024-09-19T05:34:06.833600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821882+0000","last_change":"2024-09-19T05:34:06.821882+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821882+0000","last_undegraded":"2024-09-19T05:34:06.821882+0000","last_fullsized":"2024-09-19T05:34:06.821882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.813884+0000","last_change":"2024-09-19T05:34:06.813884+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.813884+0000","last_undegraded":"2024-09-19T05:34:06.813884+0000","last_fullsized":"2024-09-19T05:34:06.813884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.831688+0000","last_change":"2024-09-19T05:34:06.831688+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.831688+0000","last_undegraded":"2024-09-19T05:34:06.831688+0000","last_fullsized":"2024-09-19T05:34:06.831688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821661+0000","last_change":"2024-09-19T05:34:06.821661+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821661+0000","last_undegraded":"2024-09-19T05:34:06.821661+0000","last_fullsized":"2024-09-19T05:34:06.821661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822490+0000","last_change":"2024-09-19T05:34:06.822490+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822490+0000","last_undegraded":"2024-09-19T05:34:06.822490+0000","last_fullsized":"2024-09-19T05:34:06.822490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827013+0000","last_change":"2024-09-19T05:34:06.827013+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827013+0000","last_undegraded":"2024-09-19T05:34:06.827013+0000","last_fullsized":"2024-09-19T05:34:06.827013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.834957+0000","last_change":"2024-09-19T05:34:06.834957+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.834957+0000","last_undegraded":"2024-09-19T05:34:06.834957+0000","last_fullsized":"2024-09-19T05:34:06.834957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.825476+0000","last_change":"2024-09-19T05:34:06.825476+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.825476+0000","last_undegraded":"2024-09-19T05:34:06.825476+0000","last_fullsized":"2024-09-19T05:34:06.825476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.832898+0000","last_change":"2024-09-19T05:34:06.832898+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.832898+0000","last_undegraded":"2024-09-19T05:34:06.832898+0000","last_fullsized":"2024-09-19T05:34:06.832898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821191+0000","last_change":"2024-09-19T05:34:06.821191+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821191+0000","last_undegraded":"2024-09-19T05:34:06.821191+0000","last_fullsized":"2024-09-19T05:34:06.821191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827166+0000","last_change":"2024-09-19T05:34:06.827166+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827166+0000","last_undegraded":"2024-09-19T05:34:06.827166+0000","last_fullsized":"2024-09-19T05:34:06.827166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823397+0000","last_change":"2024-09-19T05:34:06.823397+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823397+0000","last_undegraded":"2024-09-19T05:34:06.823397+0000","last_fullsized":"2024-09-19T05:34:06.823397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830708+0000","last_change":"2024-09-19T05:34:06.830708+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830708+0000","last_undegraded":"2024-09-19T05:34:06.830708+0000","last_fullsized":"2024-09-19T05:34:06.830708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854676+0000","last_change":"2024-09-19T05:34:06.852439+0000","last_active":"2024-09-19T05:34:06.854676+0000","last_peered":"2024-09-19T05:34:06.854676+0000","last_clean":"2024-09-19T05:34:06.854676+0000","last_became_active":"2024-09-19T05:34:06.851717+0000","last_became_peered":"2024-09-19T05:34:06.851717+0000","last_unstale":"2024-09-19T05:34:06.854676+0000","last_undegraded":"2024-09-19T05:34:06.854676+0000","last_fullsized":"2024-09-19T05:34:06.854676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:56.835003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824227+0000","last_change":"2024-09-19T05:34:06.824227+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824227+0000","last_undegraded":"2024-09-19T05:34:06.824227+0000","last_fullsized":"2024-09-19T05:34:06.824227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.852108+0000","last_change":"2024-09-19T05:34:06.845116+0000","last_active":"2024-09-19T05:34:06.852108+0000","last_peered":"2024-09-19T05:34:06.852108+0000","last_clean":"2024-09-19T05:34:06.852108+0000","last_became_active":"2024-09-19T05:34:06.844043+0000","last_became_peered":"2024-09-19T05:34:06.844043+0000","last_unstale":"2024-09-19T05:34:06.852108+0000","last_undegraded":"2024-09-19T05:34:06.852108+0000","last_fullsized":"2024-09-19T05:34:06.852108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.815160+0000","last_change":"2024-09-19T05:34:06.815160+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.815160+0000","last_undegraded":"2024-09-19T05:34:06.815160+0000","last_fullsized":"2024-09-19T05:34:06.815160+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849490+0000","last_change":"2024-09-19T05:34:06.845387+0000","last_active":"2024-09-19T05:34:06.849490+0000","last_peered":"2024-09-19T05:34:06.849490+0000","last_clean":"2024-09-19T05:34:06.849490+0000","last_became_active":"2024-09-19T05:34:06.845018+0000","last_became_peered":"2024-09-19T05:34:06.845018+0000","last_unstale":"2024-09-19T05:34:06.849490+0000","last_undegraded":"2024-09-19T05:34:06.849490+0000","last_fullsized":"2024-09-19T05:34:06.849490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:14.356013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.834210+0000","last_change":"2024-09-19T05:34:06.834210+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.834210+0000","last_undegraded":"2024-09-19T05:34:06.834210+0000","last_fullsized":"2024-09-19T05:34:06.834210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.853118+0000","last_change":"2024-09-19T05:34:06.849848+0000","last_active":"2024-09-19T05:34:06.853118+0000","last_peered":"2024-09-19T05:34:06.853118+0000","last_clean":"2024-09-19T05:34:06.853118+0000","last_became_active":"2024-09-19T05:34:06.849061+0000","last_became_peered":"2024-09-19T05:34:06.849061+0000","last_unstale":"2024-09-19T05:34:06.853118+0000","last_undegraded":"2024-09-19T05:34:06.853118+0000","last_fullsized":"2024-09-19T05:34:06.853118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:34.095147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822046+0000","last_change":"2024-09-19T05:34:06.822046+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822046+0000","last_undegraded":"2024-09-19T05:34:06.822046+0000","last_fullsized":"2024-09-19T05:34:06.822046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854942+0000","last_change":"2024-09-19T05:34:06.838559+0000","last_active":"2024-09-19T05:34:06.854942+0000","last_peered":"2024-09-19T05:34:06.854942+0000","last_clean":"2024-09-19T05:34:06.854942+0000","last_became_active":"2024-09-19T05:34:06.837817+0000","last_became_peered":"2024-09-19T05:34:06.837817+0000","last_unstale":"2024-09-19T05:34:06.854942+0000","last_undegraded":"2024-09-19T05:34:06.854942+0000","last_fullsized":"2024-09-19T05:34:06.854942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:29.930489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820763+0000","last_change":"2024-09-19T05:34:06.820763+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820763+0000","last_undegraded":"2024-09-19T05:34:06.820763+0000","last_fullsized":"2024-09-19T05:34:06.820763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.864174+0000","last_change":"2024-09-19T05:34:06.859044+0000","last_active":"2024-09-19T05:34:06.864174+0000","last_peered":"2024-09-19T05:34:06.864174+0000","last_clean":"2024-09-19T05:34:06.864174+0000","last_became_active":"2024-09-19T05:34:06.858309+0000","last_became_peered":"2024-09-19T05:34:06.858309+0000","last_unstale":"2024-09-19T05:34:06.864174+0000","last_undegraded":"2024-09-19T05:34:06.864174+0000","last_fullsized":"2024-09-19T05:34:06.864174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816022+0000","last_change":"2024-09-19T05:34:06.816022+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816022+0000","last_undegraded":"2024-09-19T05:34:06.816022+0000","last_fullsized":"2024-09-19T05:34:06.816022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.857972+0000","last_change":"2024-09-19T05:34:06.857190+0000","last_active":"2024-09-19T05:34:06.857972+0000","last_peered":"2024-09-19T05:34:06.857972+0000","last_clean":"2024-09-19T05:34:06.857972+0000","last_became_active":"2024-09-19T05:34:06.856825+0000","last_became_peered":"2024-09-19T05:34:06.856825+0000","last_unstale":"2024-09-19T05:34:06.857972+0000","last_undegraded":"2024-09-19T05:34:06.857972+0000","last_fullsized":"2024-09-19T05:34:06.857972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:32.836196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829917+0000","last_change":"2024-09-19T05:34:06.829917+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829917+0000","last_undegraded":"2024-09-19T05:34:06.829917+0000","last_fullsized":"2024-09-19T05:34:06.829917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850723+0000","last_change":"2024-09-19T05:34:06.842643+0000","last_active":"2024-09-19T05:34:06.850723+0000","last_peered":"2024-09-19T05:34:06.850723+0000","last_clean":"2024-09-19T05:34:06.850723+0000","last_became_active":"2024-09-19T05:34:06.841913+0000","last_became_peered":"2024-09-19T05:34:06.841913+0000","last_unstale":"2024-09-19T05:34:06.850723+0000","last_undegraded":"2024-09-19T05:34:06.850723+0000","last_fullsized":"2024-09-19T05:34:06.850723+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.764872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821014+0000","last_change":"2024-09-19T05:34:06.821014+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821014+0000","last_undegraded":"2024-09-19T05:34:06.821014+0000","last_fullsized":"2024-09-19T05:34:06.821014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849021+0000","last_change":"2024-09-19T05:34:06.841162+0000","last_active":"2024-09-19T05:34:06.849021+0000","last_peered":"2024-09-19T05:34:06.849021+0000","last_clean":"2024-09-19T05:34:06.849021+0000","last_became_active":"2024-09-19T05:34:06.840853+0000","last_became_peered":"2024-09-19T05:34:06.840853+0000","last_unstale":"2024-09-19T05:34:06.849021+0000","last_undegraded":"2024-09-19T05:34:06.849021+0000","last_fullsized":"2024-09-19T05:34:06.849021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:21.838375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.833585+0000","last_change":"2024-09-19T05:34:06.833585+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.833585+0000","last_undegraded":"2024-09-19T05:34:06.833585+0000","last_fullsized":"2024-09-19T05:34:06.833585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859409+0000","last_change":"2024-09-19T05:34:06.853535+0000","last_active":"2024-09-19T05:34:06.859409+0000","last_peered":"2024-09-19T05:34:06.859409+0000","last_clean":"2024-09-19T05:34:06.859409+0000","last_became_active":"2024-09-19T05:34:06.847562+0000","last_became_peered":"2024-09-19T05:34:06.847562+0000","last_unstale":"2024-09-19T05:34:06.859409+0000","last_undegraded":"2024-09-19T05:34:06.859409+0000","last_fullsized":"2024-09-19T05:34:06.859409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:32.065609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822230+0000","last_change":"2024-09-19T05:34:06.822230+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822230+0000","last_undegraded":"2024-09-19T05:34:06.822230+0000","last_fullsized":"2024-09-19T05:34:06.822230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859525+0000","last_change":"2024-09-19T05:34:06.848198+0000","last_active":"2024-09-19T05:34:06.859525+0000","last_peered":"2024-09-19T05:34:06.859525+0000","last_clean":"2024-09-19T05:34:06.859525+0000","last_became_active":"2024-09-19T05:34:06.847343+0000","last_became_peered":"2024-09-19T05:34:06.847343+0000","last_unstale":"2024-09-19T05:34:06.859525+0000","last_undegraded":"2024-09-19T05:34:06.859525+0000","last_fullsized":"2024-09-19T05:34:06.859525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:37.529574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.814493+0000","last_change":"2024-09-19T05:34:06.814493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.814493+0000","last_undegraded":"2024-09-19T05:34:06.814493+0000","last_fullsized":"2024-09-19T05:34:06.814493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.862889+0000","last_change":"2024-09-19T05:34:06.860750+0000","last_active":"2024-09-19T05:34:06.862889+0000","last_peered":"2024-09-19T05:34:06.862889+0000","last_clean":"2024-09-19T05:34:06.862889+0000","last_became_active":"2024-09-19T05:34:06.860241+0000","last_became_peered":"2024-09-19T05:34:06.860241+0000","last_unstale":"2024-09-19T05:34:06.862889+0000","last_undegraded":"2024-09-19T05:34:06.862889+0000","last_fullsized":"2024-09-19T05:34:06.862889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:02.255476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821481+0000","last_change":"2024-09-19T05:34:06.821481+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821481+0000","last_undegraded":"2024-09-19T05:34:06.821481+0000","last_fullsized":"2024-09-19T05:34:06.821481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850206+0000","last_change":"2024-09-19T05:34:06.843826+0000","last_active":"2024-09-19T05:34:06.850206+0000","last_peered":"2024-09-19T05:34:06.850206+0000","last_clean":"2024-09-19T05:34:06.850206+0000","last_became_active":"2024-09-19T05:34:06.843513+0000","last_became_peered":"2024-09-19T05:34:06.843513+0000","last_unstale":"2024-09-19T05:34:06.850206+0000","last_undegraded":"2024-09-19T05:34:06.850206+0000","last_fullsized":"2024-09-19T05:34:06.850206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:10.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.828946+0000","last_change":"2024-09-19T05:34:06.828946+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.828946+0000","last_undegraded":"2024-09-19T05:34:06.828946+0000","last_fullsized":"2024-09-19T05:34:06.828946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854780+0000","last_change":"2024-09-19T05:34:06.848974+0000","last_active":"2024-09-19T05:34:06.854780+0000","last_peered":"2024-09-19T05:34:06.854780+0000","last_clean":"2024-09-19T05:34:06.854780+0000","last_became_active":"2024-09-19T05:34:06.848530+0000","last_became_peered":"2024-09-19T05:34:06.848530+0000","last_unstale":"2024-09-19T05:34:06.854780+0000","last_undegraded":"2024-09-19T05:34:06.854780+0000","last_fullsized":"2024-09-19T05:34:06.854780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:49.609195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.825156+0000","last_change":"2024-09-19T05:34:06.825156+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.825156+0000","last_undegraded":"2024-09-19T05:34:06.825156+0000","last_fullsized":"2024-09-19T05:34:06.825156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.843504+0000","last_change":"2024-09-19T05:34:06.834851+0000","last_active":"2024-09-19T05:34:06.843504+0000","last_peered":"2024-09-19T05:34:06.843504+0000","last_clean":"2024-09-19T05:34:06.843504+0000","last_became_active":"2024-09-19T05:34:06.833971+0000","last_became_peered":"2024-09-19T05:34:06.833971+0000","last_unstale":"2024-09-19T05:34:06.843504+0000","last_undegraded":"2024-09-19T05:34:06.843504+0000","last_fullsized":"2024-09-19T05:34:06.843504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:17.675046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829302+0000","last_change":"2024-09-19T05:34:06.829302+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829302+0000","last_undegraded":"2024-09-19T05:34:06.829302+0000","last_fullsized":"2024-09-19T05:34:06.829302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.858265+0000","last_change":"2024-09-19T05:34:06.845734+0000","last_active":"2024-09-19T05:34:06.858265+0000","last_peered":"2024-09-19T05:34:06.858265+0000","last_clean":"2024-09-19T05:34:06.858265+0000","last_became_active":"2024-09-19T05:34:06.845025+0000","last_became_peered":"2024-09-19T05:34:06.845025+0000","last_unstale":"2024-09-19T05:34:06.858265+0000","last_undegraded":"2024-09-19T05:34:06.858265+0000","last_fullsized":"2024-09-19T05:34:06.858265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:03.879574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.836944+0000","last_change":"2024-09-19T05:34:06.836944+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.836944+0000","last_undegraded":"2024-09-19T05:34:06.836944+0000","last_fullsized":"2024-09-19T05:34:06.836944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859621+0000","last_change":"2024-09-19T05:34:06.854395+0000","last_active":"2024-09-19T05:34:06.859621+0000","last_peered":"2024-09-19T05:34:06.859621+0000","last_clean":"2024-09-19T05:34:06.859621+0000","last_became_active":"2024-09-19T05:34:06.847844+0000","last_became_peered":"2024-09-19T05:34:06.847844+0000","last_unstale":"2024-09-19T05:34:06.859621+0000","last_undegraded":"2024-09-19T05:34:06.859621+0000","last_fullsized":"2024-09-19T05:34:06.859621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:47.344590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.826435+0000","last_change":"2024-09-19T05:34:06.826435+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.826435+0000","last_undegraded":"2024-09-19T05:34:06.826435+0000","last_fullsized":"2024-09-19T05:34:06.826435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.853027+0000","last_change":"2024-09-19T05:34:06.849562+0000","last_active":"2024-09-19T05:34:06.853027+0000","last_peered":"2024-09-19T05:34:06.853027+0000","last_clean":"2024-09-19T05:34:06.853027+0000","last_became_active":"2024-09-19T05:34:06.848829+0000","last_became_peered":"2024-09-19T05:34:06.848829+0000","last_unstale":"2024-09-19T05:34:06.853027+0000","last_undegraded":"2024-09-19T05:34:06.853027+0000","last_fullsized":"2024-09-19T05:34:06.853027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:56.835003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816398+0000","last_change":"2024-09-19T05:34:06.816398+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816398+0000","last_undegraded":"2024-09-19T05:34:06.816398+0000","last_fullsized":"2024-09-19T05:34:06.816398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.860008+0000","last_change":"2024-09-19T05:34:06.859213+0000","last_active":"2024-09-19T05:34:06.860008+0000","last_peered":"2024-09-19T05:34:06.860008+0000","last_clean":"2024-09-19T05:34:06.860008+0000","last_became_active":"2024-09-19T05:34:06.858840+0000","last_became_peered":"2024-09-19T05:34:06.858840+0000","last_unstale":"2024-09-19T05:34:06.860008+0000","last_undegraded":"2024-09-19T05:34:06.860008+0000","last_fullsized":"2024-09-19T05:34:06.860008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.248248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820128+0000","last_change":"2024-09-19T05:34:06.820128+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820128+0000","last_undegraded":"2024-09-19T05:34:06.820128+0000","last_fullsized":"2024-09-19T05:34:06.820128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.835427+0000","last_change":"2024-09-19T05:34:06.832278+0000","last_active":"2024-09-19T05:34:06.835427+0000","last_peered":"2024-09-19T05:34:06.835427+0000","last_clean":"2024-09-19T05:34:06.835427+0000","last_became_active":"2024-09-19T05:34:06.831901+0000","last_became_peered":"2024-09-19T05:34:06.831901+0000","last_unstale":"2024-09-19T05:34:06.835427+0000","last_undegraded":"2024-09-19T05:34:06.835427+0000","last_fullsized":"2024-09-19T05:34:06.835427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823802+0000","last_change":"2024-09-19T05:34:06.823802+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823802+0000","last_undegraded":"2024-09-19T05:34:06.823802+0000","last_fullsized":"2024-09-19T05:34:06.823802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.833632+0000","last_change":"2024-09-19T05:34:06.830513+0000","last_active":"2024-09-19T05:34:06.833632+0000","last_peered":"2024-09-19T05:34:06.833632+0000","last_clean":"2024-09-19T05:34:06.833632+0000","last_became_active":"2024-09-19T05:34:06.830201+0000","last_became_peered":"2024-09-19T05:34:06.830201+0000","last_unstale":"2024-09-19T05:34:06.833632+0000","last_undegraded":"2024-09-19T05:34:06.833632+0000","last_fullsized":"2024-09-19T05:34:06.833632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:15.697350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819493+0000","last_change":"2024-09-19T05:34:06.819493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819493+0000","last_undegraded":"2024-09-19T05:34:06.819493+0000","last_fullsized":"2024-09-19T05:34:06.819493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.833978+0000","last_change":"2024-09-19T05:34:06.832694+0000","last_active":"2024-09-19T05:34:06.833978+0000","last_peered":"2024-09-19T05:34:06.833978+0000","last_clean":"2024-09-19T05:34:06.833978+0000","last_became_active":"2024-09-19T05:34:06.832147+0000","last_became_peered":"2024-09-19T05:34:06.832147+0000","last_unstale":"2024-09-19T05:34:06.833978+0000","last_undegraded":"2024-09-19T05:34:06.833978+0000","last_fullsized":"2024-09-19T05:34:06.833978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:28.098709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821025+0000","last_change":"2024-09-19T05:34:06.821025+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821025+0000","last_undegraded":"2024-09-19T05:34:06.821025+0000","last_fullsized":"2024-09-19T05:34:06.821025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.863501+0000","last_change":"2024-09-19T05:34:06.857960+0000","last_active":"2024-09-19T05:34:06.863501+0000","last_peered":"2024-09-19T05:34:06.863501+0000","last_clean":"2024-09-19T05:34:06.863501+0000","last_became_active":"2024-09-19T05:34:06.857184+0000","last_became_peered":"2024-09-19T05:34:06.857184+0000","last_unstale":"2024-09-19T05:34:06.863501+0000","last_undegraded":"2024-09-19T05:34:06.863501+0000","last_fullsized":"2024-09-19T05:34:06.863501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:45.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824342+0000","last_change":"2024-09-19T05:34:06.824342+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824342+0000","last_undegraded":"2024-09-19T05:34:06.824342+0000","last_fullsized":"2024-09-19T05:34:06.824342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.826810+0000","last_change":"2024-09-19T05:34:06.826244+0000","last_active":"2024-09-19T05:34:06.826810+0000","last_peered":"2024-09-19T05:34:06.826810+0000","last_clean":"2024-09-19T05:34:06.826810+0000","last_became_active":"2024-09-19T05:34:06.825918+0000","last_became_peered":"2024-09-19T05:34:06.825918+0000","last_unstale":"2024-09-19T05:34:06.826810+0000","last_undegraded":"2024-09-19T05:34:06.826810+0000","last_fullsized":"2024-09-19T05:34:06.826810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:13.779353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821762+0000","last_change":"2024-09-19T05:34:06.821762+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821762+0000","last_undegraded":"2024-09-19T05:34:06.821762+0000","last_fullsized":"2024-09-19T05:34:06.821762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859669+0000","last_change":"2024-09-19T05:34:06.855068+0000","last_active":"2024-09-19T05:34:06.859669+0000","last_peered":"2024-09-19T05:34:06.859669+0000","last_clean":"2024-09-19T05:34:06.859669+0000","last_became_active":"2024-09-19T05:34:06.847302+0000","last_became_peered":"2024-09-19T05:34:06.847302+0000","last_unstale":"2024-09-19T05:34:06.859669+0000","last_undegraded":"2024-09-19T05:34:06.859669+0000","last_fullsized":"2024-09-19T05:34:06.859669+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:30.860434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830904+0000","last_change":"2024-09-19T05:34:06.830904+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830904+0000","last_undegraded":"2024-09-19T05:34:06.830904+0000","last_fullsized":"2024-09-19T05:34:06.830904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854852+0000","last_change":"2024-09-19T05:34:06.850006+0000","last_active":"2024-09-19T05:34:06.854852+0000","last_peered":"2024-09-19T05:34:06.854852+0000","last_clean":"2024-09-19T05:34:06.854852+0000","last_became_active":"2024-09-19T05:34:06.849652+0000","last_became_peered":"2024-09-19T05:34:06.849652+0000","last_unstale":"2024-09-19T05:34:06.854852+0000","last_undegraded":"2024-09-19T05:34:06.854852+0000","last_fullsized":"2024-09-19T05:34:06.854852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:28.809771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829745+0000","last_change":"2024-09-19T05:34:06.829745+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829745+0000","last_undegraded":"2024-09-19T05:34:06.829745+0000","last_fullsized":"2024-09-19T05:34:06.829745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.834948+0000","last_change":"2024-09-19T05:34:06.831923+0000","last_active":"2024-09-19T05:34:06.834948+0000","last_peered":"2024-09-19T05:34:06.834948+0000","last_clean":"2024-09-19T05:34:06.834948+0000","last_became_active":"2024-09-19T05:34:06.831515+0000","last_became_peered":"2024-09-19T05:34:06.831515+0000","last_unstale":"2024-09-19T05:34:06.834948+0000","last_undegraded":"2024-09-19T05:34:06.834948+0000","last_fullsized":"2024-09-19T05:34:06.834948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:03.879574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820860+0000","last_change":"2024-09-19T05:34:06.820860+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820860+0000","last_undegraded":"2024-09-19T05:34:06.820860+0000","last_fullsized":"2024-09-19T05:34:06.820860+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850246+0000","last_change":"2024-09-19T05:34:06.842780+0000","last_active":"2024-09-19T05:34:06.850246+0000","last_peered":"2024-09-19T05:34:06.850246+0000","last_clean":"2024-09-19T05:34:06.850246+0000","last_became_active":"2024-09-19T05:34:06.838570+0000","last_became_peered":"2024-09-19T05:34:06.838570+0000","last_unstale":"2024-09-19T05:34:06.850246+0000","last_undegraded":"2024-09-19T05:34:06.850246+0000","last_fullsized":"2024-09-19T05:34:06.850246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:45.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820223+0000","last_change":"2024-09-19T05:34:06.820223+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820223+0000","last_undegraded":"2024-09-19T05:34:06.820223+0000","last_fullsized":"2024-09-19T05:34:06.820223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850634+0000","last_change":"2024-09-19T05:34:06.842616+0000","last_active":"2024-09-19T05:34:06.850634+0000","last_peered":"2024-09-19T05:34:06.850634+0000","last_clean":"2024-09-19T05:34:06.850634+0000","last_became_active":"2024-09-19T05:34:06.841906+0000","last_became_peered":"2024-09-19T05:34:06.841906+0000","last_unstale":"2024-09-19T05:34:06.850634+0000","last_undegraded":"2024-09-19T05:34:06.850634+0000","last_fullsized":"2024-09-19T05:34:06.850634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.764872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816968+0000","last_change":"2024-09-19T05:34:06.816968+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816968+0000","last_undegraded":"2024-09-19T05:34:06.816968+0000","last_fullsized":"2024-09-19T05:34:06.816968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850808+0000","last_change":"2024-09-19T05:34:06.840695+0000","last_active":"2024-09-19T05:34:06.850808+0000","last_peered":"2024-09-19T05:34:06.850808+0000","last_clean":"2024-09-19T05:34:06.850808+0000","last_became_active":"2024-09-19T05:34:06.837229+0000","last_became_peered":"2024-09-19T05:34:06.837229+0000","last_unstale":"2024-09-19T05:34:06.850808+0000","last_undegraded":"2024-09-19T05:34:06.850808+0000","last_fullsized":"2024-09-19T05:34:06.850808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:17.675046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829424+0000","last_change":"2024-09-19T05:34:06.829424+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829424+0000","last_undegraded":"2024-09-19T05:34:06.829424+0000","last_fullsized":"2024-09-19T05:34:06.829424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849102+0000","last_change":"2024-09-19T05:34:06.844825+0000","last_active":"2024-09-19T05:34:06.849102+0000","last_peered":"2024-09-19T05:34:06.849102+0000","last_clean":"2024-09-19T05:34:06.849102+0000","last_became_active":"2024-09-19T05:34:06.844291+0000","last_became_peered":"2024-09-19T05:34:06.844291+0000","last_unstale":"2024-09-19T05:34:06.849102+0000","last_undegraded":"2024-09-19T05:34:06.849102+0000","last_fullsized":"2024-09-19T05:34:06.849102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:02.484585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824647+0000","last_change":"2024-09-19T05:34:06.824647+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824647+0000","last_undegraded":"2024-09-19T05:34:06.824647+0000","last_fullsized":"2024-09-19T05:34:06.824647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.864224+0000","last_change":"2024-09-19T05:34:06.859069+0000","last_active":"2024-09-19T05:34:06.864224+0000","last_peered":"2024-09-19T05:34:06.864224+0000","last_clean":"2024-09-19T05:34:06.864224+0000","last_became_active":"2024-09-19T05:34:06.858269+0000","last_became_peered":"2024-09-19T05:34:06.858269+0000","last_unstale":"2024-09-19T05:34:06.864224+0000","last_undegraded":"2024-09-19T05:34:06.864224+0000","last_fullsized":"2024-09-19T05:34:06.864224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:14.356013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.826217+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:34:06.826217+0000","last_peered":"2024-09-19T05:34:06.826217+0000","last_clean":"2024-09-19T05:34:06.826217+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:34:06.826217+0000","last_undegraded":"2024-09-19T05:34:06.826217+0000","last_fullsized":"2024-09-19T05:34:06.826217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":769758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":769758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:34:11.305 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:34:11.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b2d572640 1 Processor -- start 2024-09-19T05:34:11.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b2d572640 1 -- start start 2024-09-19T05:34:11.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b2d572640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5b281609b0 0x7f5b280b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b2d572640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5b280afee0 0x7f5b2815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b2d572640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b280b4710 con 0x7f5b2815fcf0 2024-09-19T05:34:11.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b2d572640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5b280b5cf0 con 0x7f5b280afee0 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b2d572640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5b280b49f0 con 0x7f5b281609b0 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b26ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5b2815fcf0 0x7f5b281600d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38452/0 (socket says 172.21.15.67:38452) 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b26ffd640 1 -- 172.21.15.67:0/121821700 learned_addr learned my addr 172.21.15.67:0/121821700 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b277fe640 1 --2- 172.21.15.67:0/121821700 >> v2:172.21.15.67:3300/0 conn(0x7f5b280afee0 0x7f5b2815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b25ffb640 1 -- 172.21.15.67:0/121821700 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2506067009 0 0) 0x7f5b280b4710 con 0x7f5b2815fcf0 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b267fc640 1 --2- 172.21.15.67:0/121821700 >> v2:172.21.15.97:3300/0 conn(0x7f5b281609b0 0x7f5b280b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b25ffb640 1 -- 172.21.15.67:0/121821700 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b10003530 con 0x7f5b2815fcf0 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b277fe640 1 -- 172.21.15.67:0/121821700 >> v2:172.21.15.97:3300/0 conn(0x7f5b281609b0 msgr2=0x7f5b280b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b277fe640 1 --2- 172.21.15.67:0/121821700 >> v2:172.21.15.97:3300/0 conn(0x7f5b281609b0 0x7f5b280b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b277fe640 1 -- 172.21.15.67:0/121821700 >> v1:172.21.15.67:6789/0 conn(0x7f5b2815fcf0 legacy=0x7f5b281600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b25ffb640 1 -- 172.21.15.67:0/121821700 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1378509826 0 0) 0x7f5b10003530 con 0x7f5b2815fcf0 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b277fe640 1 -- 172.21.15.67:0/121821700 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b280b4cd0 con 0x7f5b280afee0 2024-09-19T05:34:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.460+0000 7f5b267fc640 1 --2- 172.21.15.67:0/121821700 >> v2:172.21.15.97:3300/0 conn(0x7f5b281609b0 0x7f5b280b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:34:11.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b277fe640 1 --2- 172.21.15.67:0/121821700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b280afee0 0x7f5b2815d8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5b280b07d0 tx=0x7f5b2001c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52046fa3fa6a8c22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b25ffb640 1 -- 172.21.15.67:0/121821700 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b200b2070 con 0x7f5b280afee0 2024-09-19T05:34:11.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b25ffb640 1 -- 172.21.15.67:0/121821700 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b200a5550 con 0x7f5b280afee0 2024-09-19T05:34:11.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b25ffb640 1 -- 172.21.15.67:0/121821700 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18001680 con 0x7f5b280afee0 2024-09-19T05:34:11.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 -- 172.21.15.67:0/121821700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b280afee0 msgr2=0x7f5b2815d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 --2- 172.21.15.67:0/121821700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b280afee0 0x7f5b2815d8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5b280b07d0 tx=0x7f5b2001c790 comp rx=0 tx=0).stop 2024-09-19T05:34:11.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 -- 172.21.15.67:0/121821700 shutdown_connections 2024-09-19T05:34:11.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 --2- 172.21.15.67:0/121821700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b280afee0 0x7f5b2815d8c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 --2- 172.21.15.67:0/121821700 >> v2:172.21.15.97:3300/0 conn(0x7f5b281609b0 0x7f5b280b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 -- 172.21.15.67:0/121821700 >> 172.21.15.67:0/121821700 conn(0x7f5b28073500 msgr2=0x7f5b2806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 -- 172.21.15.67:0/121821700 shutdown_connections 2024-09-19T05:34:11.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 -- 172.21.15.67:0/121821700 wait complete. 2024-09-19T05:34:11.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 Processor -- start 2024-09-19T05:34:11.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 -- start start 2024-09-19T05:34:11.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b280afee0 0x7f5b28158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b2815fcf0 0x7f5b2814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b281609b0 0x7f5b2814a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2815d580 con 0x7f5b2815fcf0 2024-09-19T05:34:11.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2815d400 con 0x7f5b280afee0 2024-09-19T05:34:11.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.464+0000 7f5b2d572640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5b28168e80 con 0x7f5b281609b0 2024-09-19T05:34:11.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b267fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b2815fcf0 0x7f5b2814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b267fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b2815fcf0 0x7f5b2814ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36644/0 (socket says 172.21.15.67:36644) 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b267fc640 1 -- 172.21.15.67:0/2412142448 learned_addr learned my addr 172.21.15.67:0/2412142448 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b26ffd640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b280afee0 0x7f5b28158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b267fc640 1 -- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b281609b0 msgr2=0x7f5b2814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b267fc640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b281609b0 0x7f5b2814a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b267fc640 1 -- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b280afee0 msgr2=0x7f5b28158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b267fc640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b280afee0 0x7f5b28158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b267fc640 1 -- 172.21.15.67:0/2412142448 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b28157b60 con 0x7f5b2815fcf0 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b26ffd640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b280afee0 0x7f5b28158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b267fc640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b2815fcf0 0x7f5b2814ca60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00d830 tx=0x7f5b1c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b0f7fe640 1 -- 172.21.15.67:0/2412142448 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c018020 con 0x7f5b2815fcf0 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b0f7fe640 1 -- 172.21.15.67:0/2412142448 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1c0096c0 con 0x7f5b2815fcf0 2024-09-19T05:34:11.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b0f7fe640 1 -- 172.21.15.67:0/2412142448 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c009ab0 con 0x7f5b2815fcf0 2024-09-19T05:34:11.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b2d572640 1 -- 172.21.15.67:0/2412142448 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b28157e40 con 0x7f5b2815fcf0 2024-09-19T05:34:11.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b2d572640 1 -- 172.21.15.67:0/2412142448 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b28158400 con 0x7f5b2815fcf0 2024-09-19T05:34:11.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b2d572640 1 -- 172.21.15.67:0/2412142448 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2815d8c0 con 0x7f5b2815fcf0 2024-09-19T05:34:11.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b0f7fe640 1 -- 172.21.15.67:0/2412142448 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b1c01b020 con 0x7f5b2815fcf0 2024-09-19T05:34:11.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b0f7fe640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5b140678c0 0x7f5b14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b0f7fe640 1 -- 172.21.15.67:0/2412142448 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f5b1c0866c0 con 0x7f5b2815fcf0 2024-09-19T05:34:11.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b26ffd640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5b140678c0 0x7f5b14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.468+0000 7f5b26ffd640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5b140678c0 0x7f5b14069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5b28159610 tx=0x7f5b18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.472+0000 7f5b0f7fe640 1 -- 172.21.15.67:0/2412142448 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5b1c022020 con 0x7f5b2815fcf0 2024-09-19T05:34:11.608 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-09-19T05:34:11.600+0000 7f12b8c7e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:34:11.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.628+0000 7f5b2d572640 1 -- 172.21.15.67:0/2412142448 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b280b1bd0 con 0x7f5b140678c0 2024-09-19T05:34:11.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.644+0000 7f5b0f7fe640 1 -- 172.21.15.67:0/2412142448 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246640 (secure 0 0 0) 0x7f5b280b1bd0 con 0x7f5b140678c0 2024-09-19T05:34:11.653 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:11.654 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:34:11.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 -- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5b140678c0 msgr2=0x7f5b14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5b140678c0 0x7f5b14069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5b28159610 tx=0x7f5b18009040 comp rx=0 tx=0).stop 2024-09-19T05:34:11.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 -- 172.21.15.67:0/2412142448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b2815fcf0 msgr2=0x7f5b2814ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b2815fcf0 0x7f5b2814ca60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00d830 tx=0x7f5b1c00dcf0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 -- 172.21.15.67:0/2412142448 shutdown_connections 2024-09-19T05:34:11.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5b140678c0 0x7f5b14069d80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b281609b0 0x7f5b2814a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b2815fcf0 0x7f5b2814ca60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 --2- 172.21.15.67:0/2412142448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b280afee0 0x7f5b28158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 -- 172.21.15.67:0/2412142448 >> 172.21.15.67:0/2412142448 conn(0x7f5b28073500 msgr2=0x7f5b280b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 -- 172.21.15.67:0/2412142448 shutdown_connections 2024-09-19T05:34:11.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.648+0000 7f5b2d572640 1 -- 172.21.15.67:0/2412142448 wait complete. 2024-09-19T05:34:11.670 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-19T05:34:11.125638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220696,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754024,"statfs":{"total":773094113280,"available":772868120576,"internally_reserved":0,"allocated":4562944,"data_stored":2615856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.321667"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.836604+0000","last_change":"2024-09-19T05:34:06.836604+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.836604+0000","last_undegraded":"2024-09-19T05:34:06.836604+0000","last_fullsized":"2024-09-19T05:34:06.836604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.835511+0000","last_change":"2024-09-19T05:34:06.835511+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.835511+0000","last_undegraded":"2024-09-19T05:34:06.835511+0000","last_fullsized":"2024-09-19T05:34:06.835511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820312+0000","last_change":"2024-09-19T05:34:06.820312+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820312+0000","last_undegraded":"2024-09-19T05:34:06.820312+0000","last_fullsized":"2024-09-19T05:34:06.820312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829261+0000","last_change":"2024-09-19T05:34:06.829261+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829261+0000","last_undegraded":"2024-09-19T05:34:06.829261+0000","last_fullsized":"2024-09-19T05:34:06.829261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829785+0000","last_change":"2024-09-19T05:34:06.829785+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829785+0000","last_undegraded":"2024-09-19T05:34:06.829785+0000","last_fullsized":"2024-09-19T05:34:06.829785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.828835+0000","last_change":"2024-09-19T05:34:06.828835+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.828835+0000","last_undegraded":"2024-09-19T05:34:06.828835+0000","last_fullsized":"2024-09-19T05:34:06.828835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823236+0000","last_change":"2024-09-19T05:34:06.823236+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823236+0000","last_undegraded":"2024-09-19T05:34:06.823236+0000","last_fullsized":"2024-09-19T05:34:06.823236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830660+0000","last_change":"2024-09-19T05:34:06.830660+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830660+0000","last_undegraded":"2024-09-19T05:34:06.830660+0000","last_fullsized":"2024-09-19T05:34:06.830660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819609+0000","last_change":"2024-09-19T05:34:06.819609+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819609+0000","last_undegraded":"2024-09-19T05:34:06.819609+0000","last_fullsized":"2024-09-19T05:34:06.819609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827096+0000","last_change":"2024-09-19T05:34:06.827096+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827096+0000","last_undegraded":"2024-09-19T05:34:06.827096+0000","last_fullsized":"2024-09-19T05:34:06.827096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.835381+0000","last_change":"2024-09-19T05:34:06.835381+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.835381+0000","last_undegraded":"2024-09-19T05:34:06.835381+0000","last_fullsized":"2024-09-19T05:34:06.835381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819493+0000","last_change":"2024-09-19T05:34:06.819493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819493+0000","last_undegraded":"2024-09-19T05:34:06.819493+0000","last_fullsized":"2024-09-19T05:34:06.819493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822917+0000","last_change":"2024-09-19T05:34:06.822917+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822917+0000","last_undegraded":"2024-09-19T05:34:06.822917+0000","last_fullsized":"2024-09-19T05:34:06.822917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.817924+0000","last_change":"2024-09-19T05:34:06.817924+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.817924+0000","last_undegraded":"2024-09-19T05:34:06.817924+0000","last_fullsized":"2024-09-19T05:34:06.817924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822032+0000","last_change":"2024-09-19T05:34:06.822032+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822032+0000","last_undegraded":"2024-09-19T05:34:06.822032+0000","last_fullsized":"2024-09-19T05:34:06.822032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824959+0000","last_change":"2024-09-19T05:34:06.824959+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824959+0000","last_undegraded":"2024-09-19T05:34:06.824959+0000","last_fullsized":"2024-09-19T05:34:06.824959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829314+0000","last_change":"2024-09-19T05:34:06.829314+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829314+0000","last_undegraded":"2024-09-19T05:34:06.829314+0000","last_fullsized":"2024-09-19T05:34:06.829314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822019+0000","last_change":"2024-09-19T05:34:06.822019+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822019+0000","last_undegraded":"2024-09-19T05:34:06.822019+0000","last_fullsized":"2024-09-19T05:34:06.822019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821810+0000","last_change":"2024-09-19T05:34:06.821810+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821810+0000","last_undegraded":"2024-09-19T05:34:06.821810+0000","last_fullsized":"2024-09-19T05:34:06.821810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.833600+0000","last_change":"2024-09-19T05:34:06.833600+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.833600+0000","last_undegraded":"2024-09-19T05:34:06.833600+0000","last_fullsized":"2024-09-19T05:34:06.833600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821882+0000","last_change":"2024-09-19T05:34:06.821882+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821882+0000","last_undegraded":"2024-09-19T05:34:06.821882+0000","last_fullsized":"2024-09-19T05:34:06.821882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.813884+0000","last_change":"2024-09-19T05:34:06.813884+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.813884+0000","last_undegraded":"2024-09-19T05:34:06.813884+0000","last_fullsized":"2024-09-19T05:34:06.813884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.831688+0000","last_change":"2024-09-19T05:34:06.831688+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.831688+0000","last_undegraded":"2024-09-19T05:34:06.831688+0000","last_fullsized":"2024-09-19T05:34:06.831688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821661+0000","last_change":"2024-09-19T05:34:06.821661+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821661+0000","last_undegraded":"2024-09-19T05:34:06.821661+0000","last_fullsized":"2024-09-19T05:34:06.821661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822490+0000","last_change":"2024-09-19T05:34:06.822490+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822490+0000","last_undegraded":"2024-09-19T05:34:06.822490+0000","last_fullsized":"2024-09-19T05:34:06.822490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827013+0000","last_change":"2024-09-19T05:34:06.827013+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827013+0000","last_undegraded":"2024-09-19T05:34:06.827013+0000","last_fullsized":"2024-09-19T05:34:06.827013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.834957+0000","last_change":"2024-09-19T05:34:06.834957+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.834957+0000","last_undegraded":"2024-09-19T05:34:06.834957+0000","last_fullsized":"2024-09-19T05:34:06.834957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.825476+0000","last_change":"2024-09-19T05:34:06.825476+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.825476+0000","last_undegraded":"2024-09-19T05:34:06.825476+0000","last_fullsized":"2024-09-19T05:34:06.825476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.832898+0000","last_change":"2024-09-19T05:34:06.832898+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.832898+0000","last_undegraded":"2024-09-19T05:34:06.832898+0000","last_fullsized":"2024-09-19T05:34:06.832898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821191+0000","last_change":"2024-09-19T05:34:06.821191+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821191+0000","last_undegraded":"2024-09-19T05:34:06.821191+0000","last_fullsized":"2024-09-19T05:34:06.821191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827166+0000","last_change":"2024-09-19T05:34:06.827166+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827166+0000","last_undegraded":"2024-09-19T05:34:06.827166+0000","last_fullsized":"2024-09-19T05:34:06.827166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823397+0000","last_change":"2024-09-19T05:34:06.823397+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823397+0000","last_undegraded":"2024-09-19T05:34:06.823397+0000","last_fullsized":"2024-09-19T05:34:06.823397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830708+0000","last_change":"2024-09-19T05:34:06.830708+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830708+0000","last_undegraded":"2024-09-19T05:34:06.830708+0000","last_fullsized":"2024-09-19T05:34:06.830708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854676+0000","last_change":"2024-09-19T05:34:06.852439+0000","last_active":"2024-09-19T05:34:06.854676+0000","last_peered":"2024-09-19T05:34:06.854676+0000","last_clean":"2024-09-19T05:34:06.854676+0000","last_became_active":"2024-09-19T05:34:06.851717+0000","last_became_peered":"2024-09-19T05:34:06.851717+0000","last_unstale":"2024-09-19T05:34:06.854676+0000","last_undegraded":"2024-09-19T05:34:06.854676+0000","last_fullsized":"2024-09-19T05:34:06.854676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:56.835003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824227+0000","last_change":"2024-09-19T05:34:06.824227+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824227+0000","last_undegraded":"2024-09-19T05:34:06.824227+0000","last_fullsized":"2024-09-19T05:34:06.824227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.852108+0000","last_change":"2024-09-19T05:34:06.845116+0000","last_active":"2024-09-19T05:34:06.852108+0000","last_peered":"2024-09-19T05:34:06.852108+0000","last_clean":"2024-09-19T05:34:06.852108+0000","last_became_active":"2024-09-19T05:34:06.844043+0000","last_became_peered":"2024-09-19T05:34:06.844043+0000","last_unstale":"2024-09-19T05:34:06.852108+0000","last_undegraded":"2024-09-19T05:34:06.852108+0000","last_fullsized":"2024-09-19T05:34:06.852108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.815160+0000","last_change":"2024-09-19T05:34:06.815160+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.815160+0000","last_undegraded":"2024-09-19T05:34:06.815160+0000","last_fullsized":"2024-09-19T05:34:06.815160+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849490+0000","last_change":"2024-09-19T05:34:06.845387+0000","last_active":"2024-09-19T05:34:06.849490+0000","last_peered":"2024-09-19T05:34:06.849490+0000","last_clean":"2024-09-19T05:34:06.849490+0000","last_became_active":"2024-09-19T05:34:06.845018+0000","last_became_peered":"2024-09-19T05:34:06.845018+0000","last_unstale":"2024-09-19T05:34:06.849490+0000","last_undegraded":"2024-09-19T05:34:06.849490+0000","last_fullsized":"2024-09-19T05:34:06.849490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:14.356013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.834210+0000","last_change":"2024-09-19T05:34:06.834210+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.834210+0000","last_undegraded":"2024-09-19T05:34:06.834210+0000","last_fullsized":"2024-09-19T05:34:06.834210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.853118+0000","last_change":"2024-09-19T05:34:06.849848+0000","last_active":"2024-09-19T05:34:06.853118+0000","last_peered":"2024-09-19T05:34:06.853118+0000","last_clean":"2024-09-19T05:34:06.853118+0000","last_became_active":"2024-09-19T05:34:06.849061+0000","last_became_peered":"2024-09-19T05:34:06.849061+0000","last_unstale":"2024-09-19T05:34:06.853118+0000","last_undegraded":"2024-09-19T05:34:06.853118+0000","last_fullsized":"2024-09-19T05:34:06.853118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:34.095147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822046+0000","last_change":"2024-09-19T05:34:06.822046+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822046+0000","last_undegraded":"2024-09-19T05:34:06.822046+0000","last_fullsized":"2024-09-19T05:34:06.822046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854942+0000","last_change":"2024-09-19T05:34:06.838559+0000","last_active":"2024-09-19T05:34:06.854942+0000","last_peered":"2024-09-19T05:34:06.854942+0000","last_clean":"2024-09-19T05:34:06.854942+0000","last_became_active":"2024-09-19T05:34:06.837817+0000","last_became_peered":"2024-09-19T05:34:06.837817+0000","last_unstale":"2024-09-19T05:34:06.854942+0000","last_undegraded":"2024-09-19T05:34:06.854942+0000","last_fullsized":"2024-09-19T05:34:06.854942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:29.930489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820763+0000","last_change":"2024-09-19T05:34:06.820763+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820763+0000","last_undegraded":"2024-09-19T05:34:06.820763+0000","last_fullsized":"2024-09-19T05:34:06.820763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.864174+0000","last_change":"2024-09-19T05:34:06.859044+0000","last_active":"2024-09-19T05:34:06.864174+0000","last_peered":"2024-09-19T05:34:06.864174+0000","last_clean":"2024-09-19T05:34:06.864174+0000","last_became_active":"2024-09-19T05:34:06.858309+0000","last_became_peered":"2024-09-19T05:34:06.858309+0000","last_unstale":"2024-09-19T05:34:06.864174+0000","last_undegraded":"2024-09-19T05:34:06.864174+0000","last_fullsized":"2024-09-19T05:34:06.864174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816022+0000","last_change":"2024-09-19T05:34:06.816022+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816022+0000","last_undegraded":"2024-09-19T05:34:06.816022+0000","last_fullsized":"2024-09-19T05:34:06.816022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.857972+0000","last_change":"2024-09-19T05:34:06.857190+0000","last_active":"2024-09-19T05:34:06.857972+0000","last_peered":"2024-09-19T05:34:06.857972+0000","last_clean":"2024-09-19T05:34:06.857972+0000","last_became_active":"2024-09-19T05:34:06.856825+0000","last_became_peered":"2024-09-19T05:34:06.856825+0000","last_unstale":"2024-09-19T05:34:06.857972+0000","last_undegraded":"2024-09-19T05:34:06.857972+0000","last_fullsized":"2024-09-19T05:34:06.857972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:32.836196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829917+0000","last_change":"2024-09-19T05:34:06.829917+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829917+0000","last_undegraded":"2024-09-19T05:34:06.829917+0000","last_fullsized":"2024-09-19T05:34:06.829917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850723+0000","last_change":"2024-09-19T05:34:06.842643+0000","last_active":"2024-09-19T05:34:06.850723+0000","last_peered":"2024-09-19T05:34:06.850723+0000","last_clean":"2024-09-19T05:34:06.850723+0000","last_became_active":"2024-09-19T05:34:06.841913+0000","last_became_peered":"2024-09-19T05:34:06.841913+0000","last_unstale":"2024-09-19T05:34:06.850723+0000","last_undegraded":"2024-09-19T05:34:06.850723+0000","last_fullsized":"2024-09-19T05:34:06.850723+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.764872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821014+0000","last_change":"2024-09-19T05:34:06.821014+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821014+0000","last_undegraded":"2024-09-19T05:34:06.821014+0000","last_fullsized":"2024-09-19T05:34:06.821014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849021+0000","last_change":"2024-09-19T05:34:06.841162+0000","last_active":"2024-09-19T05:34:06.849021+0000","last_peered":"2024-09-19T05:34:06.849021+0000","last_clean":"2024-09-19T05:34:06.849021+0000","last_became_active":"2024-09-19T05:34:06.840853+0000","last_became_peered":"2024-09-19T05:34:06.840853+0000","last_unstale":"2024-09-19T05:34:06.849021+0000","last_undegraded":"2024-09-19T05:34:06.849021+0000","last_fullsized":"2024-09-19T05:34:06.849021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:21.838375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.833585+0000","last_change":"2024-09-19T05:34:06.833585+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.833585+0000","last_undegraded":"2024-09-19T05:34:06.833585+0000","last_fullsized":"2024-09-19T05:34:06.833585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859409+0000","last_change":"2024-09-19T05:34:06.853535+0000","last_active":"2024-09-19T05:34:06.859409+0000","last_peered":"2024-09-19T05:34:06.859409+0000","last_clean":"2024-09-19T05:34:06.859409+0000","last_became_active":"2024-09-19T05:34:06.847562+0000","last_became_peered":"2024-09-19T05:34:06.847562+0000","last_unstale":"2024-09-19T05:34:06.859409+0000","last_undegraded":"2024-09-19T05:34:06.859409+0000","last_fullsized":"2024-09-19T05:34:06.859409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:32.065609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822230+0000","last_change":"2024-09-19T05:34:06.822230+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822230+0000","last_undegraded":"2024-09-19T05:34:06.822230+0000","last_fullsized":"2024-09-19T05:34:06.822230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859525+0000","last_change":"2024-09-19T05:34:06.848198+0000","last_active":"2024-09-19T05:34:06.859525+0000","last_peered":"2024-09-19T05:34:06.859525+0000","last_clean":"2024-09-19T05:34:06.859525+0000","last_became_active":"2024-09-19T05:34:06.847343+0000","last_became_peered":"2024-09-19T05:34:06.847343+0000","last_unstale":"2024-09-19T05:34:06.859525+0000","last_undegraded":"2024-09-19T05:34:06.859525+0000","last_fullsized":"2024-09-19T05:34:06.859525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:37.529574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.814493+0000","last_change":"2024-09-19T05:34:06.814493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.814493+0000","last_undegraded":"2024-09-19T05:34:06.814493+0000","last_fullsized":"2024-09-19T05:34:06.814493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.862889+0000","last_change":"2024-09-19T05:34:06.860750+0000","last_active":"2024-09-19T05:34:06.862889+0000","last_peered":"2024-09-19T05:34:06.862889+0000","last_clean":"2024-09-19T05:34:06.862889+0000","last_became_active":"2024-09-19T05:34:06.860241+0000","last_became_peered":"2024-09-19T05:34:06.860241+0000","last_unstale":"2024-09-19T05:34:06.862889+0000","last_undegraded":"2024-09-19T05:34:06.862889+0000","last_fullsized":"2024-09-19T05:34:06.862889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:02.255476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821481+0000","last_change":"2024-09-19T05:34:06.821481+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821481+0000","last_undegraded":"2024-09-19T05:34:06.821481+0000","last_fullsized":"2024-09-19T05:34:06.821481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850206+0000","last_change":"2024-09-19T05:34:06.843826+0000","last_active":"2024-09-19T05:34:06.850206+0000","last_peered":"2024-09-19T05:34:06.850206+0000","last_clean":"2024-09-19T05:34:06.850206+0000","last_became_active":"2024-09-19T05:34:06.843513+0000","last_became_peered":"2024-09-19T05:34:06.843513+0000","last_unstale":"2024-09-19T05:34:06.850206+0000","last_undegraded":"2024-09-19T05:34:06.850206+0000","last_fullsized":"2024-09-19T05:34:06.850206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:10.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.828946+0000","last_change":"2024-09-19T05:34:06.828946+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.828946+0000","last_undegraded":"2024-09-19T05:34:06.828946+0000","last_fullsized":"2024-09-19T05:34:06.828946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854780+0000","last_change":"2024-09-19T05:34:06.848974+0000","last_active":"2024-09-19T05:34:06.854780+0000","last_peered":"2024-09-19T05:34:06.854780+0000","last_clean":"2024-09-19T05:34:06.854780+0000","last_became_active":"2024-09-19T05:34:06.848530+0000","last_became_peered":"2024-09-19T05:34:06.848530+0000","last_unstale":"2024-09-19T05:34:06.854780+0000","last_undegraded":"2024-09-19T05:34:06.854780+0000","last_fullsized":"2024-09-19T05:34:06.854780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:49.609195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.825156+0000","last_change":"2024-09-19T05:34:06.825156+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.825156+0000","last_undegraded":"2024-09-19T05:34:06.825156+0000","last_fullsized":"2024-09-19T05:34:06.825156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.843504+0000","last_change":"2024-09-19T05:34:06.834851+0000","last_active":"2024-09-19T05:34:06.843504+0000","last_peered":"2024-09-19T05:34:06.843504+0000","last_clean":"2024-09-19T05:34:06.843504+0000","last_became_active":"2024-09-19T05:34:06.833971+0000","last_became_peered":"2024-09-19T05:34:06.833971+0000","last_unstale":"2024-09-19T05:34:06.843504+0000","last_undegraded":"2024-09-19T05:34:06.843504+0000","last_fullsized":"2024-09-19T05:34:06.843504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:17.675046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829302+0000","last_change":"2024-09-19T05:34:06.829302+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829302+0000","last_undegraded":"2024-09-19T05:34:06.829302+0000","last_fullsized":"2024-09-19T05:34:06.829302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.858265+0000","last_change":"2024-09-19T05:34:06.845734+0000","last_active":"2024-09-19T05:34:06.858265+0000","last_peered":"2024-09-19T05:34:06.858265+0000","last_clean":"2024-09-19T05:34:06.858265+0000","last_became_active":"2024-09-19T05:34:06.845025+0000","last_became_peered":"2024-09-19T05:34:06.845025+0000","last_unstale":"2024-09-19T05:34:06.858265+0000","last_undegraded":"2024-09-19T05:34:06.858265+0000","last_fullsized":"2024-09-19T05:34:06.858265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:03.879574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.836944+0000","last_change":"2024-09-19T05:34:06.836944+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.836944+0000","last_undegraded":"2024-09-19T05:34:06.836944+0000","last_fullsized":"2024-09-19T05:34:06.836944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859621+0000","last_change":"2024-09-19T05:34:06.854395+0000","last_active":"2024-09-19T05:34:06.859621+0000","last_peered":"2024-09-19T05:34:06.859621+0000","last_clean":"2024-09-19T05:34:06.859621+0000","last_became_active":"2024-09-19T05:34:06.847844+0000","last_became_peered":"2024-09-19T05:34:06.847844+0000","last_unstale":"2024-09-19T05:34:06.859621+0000","last_undegraded":"2024-09-19T05:34:06.859621+0000","last_fullsized":"2024-09-19T05:34:06.859621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:47.344590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.826435+0000","last_change":"2024-09-19T05:34:06.826435+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.826435+0000","last_undegraded":"2024-09-19T05:34:06.826435+0000","last_fullsized":"2024-09-19T05:34:06.826435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.853027+0000","last_change":"2024-09-19T05:34:06.849562+0000","last_active":"2024-09-19T05:34:06.853027+0000","last_peered":"2024-09-19T05:34:06.853027+0000","last_clean":"2024-09-19T05:34:06.853027+0000","last_became_active":"2024-09-19T05:34:06.848829+0000","last_became_peered":"2024-09-19T05:34:06.848829+0000","last_unstale":"2024-09-19T05:34:06.853027+0000","last_undegraded":"2024-09-19T05:34:06.853027+0000","last_fullsized":"2024-09-19T05:34:06.853027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:56.835003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816398+0000","last_change":"2024-09-19T05:34:06.816398+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816398+0000","last_undegraded":"2024-09-19T05:34:06.816398+0000","last_fullsized":"2024-09-19T05:34:06.816398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.860008+0000","last_change":"2024-09-19T05:34:06.859213+0000","last_active":"2024-09-19T05:34:06.860008+0000","last_peered":"2024-09-19T05:34:06.860008+0000","last_clean":"2024-09-19T05:34:06.860008+0000","last_became_active":"2024-09-19T05:34:06.858840+0000","last_became_peered":"2024-09-19T05:34:06.858840+0000","last_unstale":"2024-09-19T05:34:06.860008+0000","last_undegraded":"2024-09-19T05:34:06.860008+0000","last_fullsized":"2024-09-19T05:34:06.860008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.248248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820128+0000","last_change":"2024-09-19T05:34:06.820128+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820128+0000","last_undegraded":"2024-09-19T05:34:06.820128+0000","last_fullsized":"2024-09-19T05:34:06.820128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.835427+0000","last_change":"2024-09-19T05:34:06.832278+0000","last_active":"2024-09-19T05:34:06.835427+0000","last_peered":"2024-09-19T05:34:06.835427+0000","last_clean":"2024-09-19T05:34:06.835427+0000","last_became_active":"2024-09-19T05:34:06.831901+0000","last_became_peered":"2024-09-19T05:34:06.831901+0000","last_unstale":"2024-09-19T05:34:06.835427+0000","last_undegraded":"2024-09-19T05:34:06.835427+0000","last_fullsized":"2024-09-19T05:34:06.835427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823802+0000","last_change":"2024-09-19T05:34:06.823802+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823802+0000","last_undegraded":"2024-09-19T05:34:06.823802+0000","last_fullsized":"2024-09-19T05:34:06.823802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.833632+0000","last_change":"2024-09-19T05:34:06.830513+0000","last_active":"2024-09-19T05:34:06.833632+0000","last_peered":"2024-09-19T05:34:06.833632+0000","last_clean":"2024-09-19T05:34:06.833632+0000","last_became_active":"2024-09-19T05:34:06.830201+0000","last_became_peered":"2024-09-19T05:34:06.830201+0000","last_unstale":"2024-09-19T05:34:06.833632+0000","last_undegraded":"2024-09-19T05:34:06.833632+0000","last_fullsized":"2024-09-19T05:34:06.833632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:15.697350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819493+0000","last_change":"2024-09-19T05:34:06.819493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819493+0000","last_undegraded":"2024-09-19T05:34:06.819493+0000","last_fullsized":"2024-09-19T05:34:06.819493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.833978+0000","last_change":"2024-09-19T05:34:06.832694+0000","last_active":"2024-09-19T05:34:06.833978+0000","last_peered":"2024-09-19T05:34:06.833978+0000","last_clean":"2024-09-19T05:34:06.833978+0000","last_became_active":"2024-09-19T05:34:06.832147+0000","last_became_peered":"2024-09-19T05:34:06.832147+0000","last_unstale":"2024-09-19T05:34:06.833978+0000","last_undegraded":"2024-09-19T05:34:06.833978+0000","last_fullsized":"2024-09-19T05:34:06.833978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:28.098709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821025+0000","last_change":"2024-09-19T05:34:06.821025+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821025+0000","last_undegraded":"2024-09-19T05:34:06.821025+0000","last_fullsized":"2024-09-19T05:34:06.821025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.863501+0000","last_change":"2024-09-19T05:34:06.857960+0000","last_active":"2024-09-19T05:34:06.863501+0000","last_peered":"2024-09-19T05:34:06.863501+0000","last_clean":"2024-09-19T05:34:06.863501+0000","last_became_active":"2024-09-19T05:34:06.857184+0000","last_became_peered":"2024-09-19T05:34:06.857184+0000","last_unstale":"2024-09-19T05:34:06.863501+0000","last_undegraded":"2024-09-19T05:34:06.863501+0000","last_fullsized":"2024-09-19T05:34:06.863501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:45.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824342+0000","last_change":"2024-09-19T05:34:06.824342+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824342+0000","last_undegraded":"2024-09-19T05:34:06.824342+0000","last_fullsized":"2024-09-19T05:34:06.824342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.826810+0000","last_change":"2024-09-19T05:34:06.826244+0000","last_active":"2024-09-19T05:34:06.826810+0000","last_peered":"2024-09-19T05:34:06.826810+0000","last_clean":"2024-09-19T05:34:06.826810+0000","last_became_active":"2024-09-19T05:34:06.825918+0000","last_became_peered":"2024-09-19T05:34:06.825918+0000","last_unstale":"2024-09-19T05:34:06.826810+0000","last_undegraded":"2024-09-19T05:34:06.826810+0000","last_fullsized":"2024-09-19T05:34:06.826810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:13.779353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821762+0000","last_change":"2024-09-19T05:34:06.821762+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821762+0000","last_undegraded":"2024-09-19T05:34:06.821762+0000","last_fullsized":"2024-09-19T05:34:06.821762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859669+0000","last_change":"2024-09-19T05:34:06.855068+0000","last_active":"2024-09-19T05:34:06.859669+0000","last_peered":"2024-09-19T05:34:06.859669+0000","last_clean":"2024-09-19T05:34:06.859669+0000","last_became_active":"2024-09-19T05:34:06.847302+0000","last_became_peered":"2024-09-19T05:34:06.847302+0000","last_unstale":"2024-09-19T05:34:06.859669+0000","last_undegraded":"2024-09-19T05:34:06.859669+0000","last_fullsized":"2024-09-19T05:34:06.859669+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:30.860434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830904+0000","last_change":"2024-09-19T05:34:06.830904+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830904+0000","last_undegraded":"2024-09-19T05:34:06.830904+0000","last_fullsized":"2024-09-19T05:34:06.830904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854852+0000","last_change":"2024-09-19T05:34:06.850006+0000","last_active":"2024-09-19T05:34:06.854852+0000","last_peered":"2024-09-19T05:34:06.854852+0000","last_clean":"2024-09-19T05:34:06.854852+0000","last_became_active":"2024-09-19T05:34:06.849652+0000","last_became_peered":"2024-09-19T05:34:06.849652+0000","last_unstale":"2024-09-19T05:34:06.854852+0000","last_undegraded":"2024-09-19T05:34:06.854852+0000","last_fullsized":"2024-09-19T05:34:06.854852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:28.809771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829745+0000","last_change":"2024-09-19T05:34:06.829745+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829745+0000","last_undegraded":"2024-09-19T05:34:06.829745+0000","last_fullsized":"2024-09-19T05:34:06.829745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.834948+0000","last_change":"2024-09-19T05:34:06.831923+0000","last_active":"2024-09-19T05:34:06.834948+0000","last_peered":"2024-09-19T05:34:06.834948+0000","last_clean":"2024-09-19T05:34:06.834948+0000","last_became_active":"2024-09-19T05:34:06.831515+0000","last_became_peered":"2024-09-19T05:34:06.831515+0000","last_unstale":"2024-09-19T05:34:06.834948+0000","last_undegraded":"2024-09-19T05:34:06.834948+0000","last_fullsized":"2024-09-19T05:34:06.834948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:03.879574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820860+0000","last_change":"2024-09-19T05:34:06.820860+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820860+0000","last_undegraded":"2024-09-19T05:34:06.820860+0000","last_fullsized":"2024-09-19T05:34:06.820860+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850246+0000","last_change":"2024-09-19T05:34:06.842780+0000","last_active":"2024-09-19T05:34:06.850246+0000","last_peered":"2024-09-19T05:34:06.850246+0000","last_clean":"2024-09-19T05:34:06.850246+0000","last_became_active":"2024-09-19T05:34:06.838570+0000","last_became_peered":"2024-09-19T05:34:06.838570+0000","last_unstale":"2024-09-19T05:34:06.850246+0000","last_undegraded":"2024-09-19T05:34:06.850246+0000","last_fullsized":"2024-09-19T05:34:06.850246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:45.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820223+0000","last_change":"2024-09-19T05:34:06.820223+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820223+0000","last_undegraded":"2024-09-19T05:34:06.820223+0000","last_fullsized":"2024-09-19T05:34:06.820223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850634+0000","last_change":"2024-09-19T05:34:06.842616+0000","last_active":"2024-09-19T05:34:06.850634+0000","last_peered":"2024-09-19T05:34:06.850634+0000","last_clean":"2024-09-19T05:34:06.850634+0000","last_became_active":"2024-09-19T05:34:06.841906+0000","last_became_peered":"2024-09-19T05:34:06.841906+0000","last_unstale":"2024-09-19T05:34:06.850634+0000","last_undegraded":"2024-09-19T05:34:06.850634+0000","last_fullsized":"2024-09-19T05:34:06.850634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.764872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816968+0000","last_change":"2024-09-19T05:34:06.816968+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816968+0000","last_undegraded":"2024-09-19T05:34:06.816968+0000","last_fullsized":"2024-09-19T05:34:06.816968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850808+0000","last_change":"2024-09-19T05:34:06.840695+0000","last_active":"2024-09-19T05:34:06.850808+0000","last_peered":"2024-09-19T05:34:06.850808+0000","last_clean":"2024-09-19T05:34:06.850808+0000","last_became_active":"2024-09-19T05:34:06.837229+0000","last_became_peered":"2024-09-19T05:34:06.837229+0000","last_unstale":"2024-09-19T05:34:06.850808+0000","last_undegraded":"2024-09-19T05:34:06.850808+0000","last_fullsized":"2024-09-19T05:34:06.850808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:17.675046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829424+0000","last_change":"2024-09-19T05:34:06.829424+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829424+0000","last_undegraded":"2024-09-19T05:34:06.829424+0000","last_fullsized":"2024-09-19T05:34:06.829424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849102+0000","last_change":"2024-09-19T05:34:06.844825+0000","last_active":"2024-09-19T05:34:06.849102+0000","last_peered":"2024-09-19T05:34:06.849102+0000","last_clean":"2024-09-19T05:34:06.849102+0000","last_became_active":"2024-09-19T05:34:06.844291+0000","last_became_peered":"2024-09-19T05:34:06.844291+0000","last_unstale":"2024-09-19T05:34:06.849102+0000","last_undegraded":"2024-09-19T05:34:06.849102+0000","last_fullsized":"2024-09-19T05:34:06.849102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:02.484585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824647+0000","last_change":"2024-09-19T05:34:06.824647+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824647+0000","last_undegraded":"2024-09-19T05:34:06.824647+0000","last_fullsized":"2024-09-19T05:34:06.824647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.864224+0000","last_change":"2024-09-19T05:34:06.859069+0000","last_active":"2024-09-19T05:34:06.864224+0000","last_peered":"2024-09-19T05:34:06.864224+0000","last_clean":"2024-09-19T05:34:06.864224+0000","last_became_active":"2024-09-19T05:34:06.858269+0000","last_became_peered":"2024-09-19T05:34:06.858269+0000","last_unstale":"2024-09-19T05:34:06.864224+0000","last_undegraded":"2024-09-19T05:34:06.864224+0000","last_fullsized":"2024-09-19T05:34:06.864224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:14.356013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.826217+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:34:06.826217+0000","last_peered":"2024-09-19T05:34:06.826217+0000","last_clean":"2024-09-19T05:34:06.826217+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:34:06.826217+0000","last_undegraded":"2024-09-19T05:34:06.826217+0000","last_fullsized":"2024-09-19T05:34:06.826217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":769758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":769758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:34:11.674 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-09-19T05:34:11.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.836604+0000', 'last_change': '2024-09-19T05:34:06.836604+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.836604+0000', 'last_undegraded': '2024-09-19T05:34:06.836604+0000', 'last_fullsized': '2024-09-19T05:34:06.836604+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:34:11.674 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-09-19T05:34:11.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.835511+0000', 'last_change': '2024-09-19T05:34:06.835511+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.835511+0000', 'last_undegraded': '2024-09-19T05:34:06.835511+0000', 'last_fullsized': '2024-09-19T05:34:06.835511+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:34:11.674 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.820312+0000', 'last_change': '2024-09-19T05:34:06.820312+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.820312+0000', 'last_undegraded': '2024-09-19T05:34:06.820312+0000', 'last_fullsized': '2024-09-19T05:34:06.820312+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.829261+0000', 'last_change': '2024-09-19T05:34:06.829261+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.829261+0000', 'last_undegraded': '2024-09-19T05:34:06.829261+0000', 'last_fullsized': '2024-09-19T05:34:06.829261+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.829785+0000', 'last_change': '2024-09-19T05:34:06.829785+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.829785+0000', 'last_undegraded': '2024-09-19T05:34:06.829785+0000', 'last_fullsized': '2024-09-19T05:34:06.829785+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.828835+0000', 'last_change': '2024-09-19T05:34:06.828835+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.828835+0000', 'last_undegraded': '2024-09-19T05:34:06.828835+0000', 'last_fullsized': '2024-09-19T05:34:06.828835+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.823236+0000', 'last_change': '2024-09-19T05:34:06.823236+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.823236+0000', 'last_undegraded': '2024-09-19T05:34:06.823236+0000', 'last_fullsized': '2024-09-19T05:34:06.823236+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-09-19T05:34:11.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.830660+0000', 'last_change': '2024-09-19T05:34:06.830660+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.830660+0000', 'last_undegraded': '2024-09-19T05:34:06.830660+0000', 'last_fullsized': '2024-09-19T05:34:06.830660+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:34:11.676 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-09-19T05:34:11.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.819609+0000', 'last_change': '2024-09-19T05:34:06.819609+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.819609+0000', 'last_undegraded': '2024-09-19T05:34:06.819609+0000', 'last_fullsized': '2024-09-19T05:34:06.819609+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:34:11.676 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-09-19T05:34:11.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.827096+0000', 'last_change': '2024-09-19T05:34:06.827096+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.827096+0000', 'last_undegraded': '2024-09-19T05:34:06.827096+0000', 'last_fullsized': '2024-09-19T05:34:06.827096+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.676 INFO:tasks.ceph.ceph_manager.ceph:PG 6.35 is not active+clean 2024-09-19T05:34:11.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.835381+0000', 'last_change': '2024-09-19T05:34:06.835381+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.835381+0000', 'last_undegraded': '2024-09-19T05:34:06.835381+0000', 'last_fullsized': '2024-09-19T05:34:06.835381+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.676 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-09-19T05:34:11.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.819493+0000', 'last_change': '2024-09-19T05:34:06.819493+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.819493+0000', 'last_undegraded': '2024-09-19T05:34:06.819493+0000', 'last_fullsized': '2024-09-19T05:34:06.819493+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:34:11.676 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-09-19T05:34:11.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.822917+0000', 'last_change': '2024-09-19T05:34:06.822917+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.822917+0000', 'last_undegraded': '2024-09-19T05:34:06.822917+0000', 'last_fullsized': '2024-09-19T05:34:06.822917+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.677 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-09-19T05:34:11.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.817924+0000', 'last_change': '2024-09-19T05:34:06.817924+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.817924+0000', 'last_undegraded': '2024-09-19T05:34:06.817924+0000', 'last_fullsized': '2024-09-19T05:34:06.817924+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:34:11.677 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-09-19T05:34:11.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.822032+0000', 'last_change': '2024-09-19T05:34:06.822032+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.822032+0000', 'last_undegraded': '2024-09-19T05:34:06.822032+0000', 'last_fullsized': '2024-09-19T05:34:06.822032+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.677 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-09-19T05:34:11.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.824959+0000', 'last_change': '2024-09-19T05:34:06.824959+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.824959+0000', 'last_undegraded': '2024-09-19T05:34:06.824959+0000', 'last_fullsized': '2024-09-19T05:34:06.824959+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:34:11.677 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-09-19T05:34:11.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.829314+0000', 'last_change': '2024-09-19T05:34:06.829314+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.829314+0000', 'last_undegraded': '2024-09-19T05:34:06.829314+0000', 'last_fullsized': '2024-09-19T05:34:06.829314+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:34:11.677 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-09-19T05:34:11.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.822019+0000', 'last_change': '2024-09-19T05:34:06.822019+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.822019+0000', 'last_undegraded': '2024-09-19T05:34:06.822019+0000', 'last_fullsized': '2024-09-19T05:34:06.822019+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:34:11.678 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-09-19T05:34:11.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.821810+0000', 'last_change': '2024-09-19T05:34:06.821810+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.821810+0000', 'last_undegraded': '2024-09-19T05:34:06.821810+0000', 'last_fullsized': '2024-09-19T05:34:06.821810+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:34:11.678 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-09-19T05:34:11.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.833600+0000', 'last_change': '2024-09-19T05:34:06.833600+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.833600+0000', 'last_undegraded': '2024-09-19T05:34:06.833600+0000', 'last_fullsized': '2024-09-19T05:34:06.833600+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:34:11.678 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-09-19T05:34:11.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.821882+0000', 'last_change': '2024-09-19T05:34:06.821882+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.821882+0000', 'last_undegraded': '2024-09-19T05:34:06.821882+0000', 'last_fullsized': '2024-09-19T05:34:06.821882+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.678 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-09-19T05:34:11.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.813884+0000', 'last_change': '2024-09-19T05:34:06.813884+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.813884+0000', 'last_undegraded': '2024-09-19T05:34:06.813884+0000', 'last_fullsized': '2024-09-19T05:34:06.813884+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:34:11.678 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-09-19T05:34:11.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.831688+0000', 'last_change': '2024-09-19T05:34:06.831688+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.831688+0000', 'last_undegraded': '2024-09-19T05:34:06.831688+0000', 'last_fullsized': '2024-09-19T05:34:06.831688+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:34:11.679 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-09-19T05:34:11.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.821661+0000', 'last_change': '2024-09-19T05:34:06.821661+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.821661+0000', 'last_undegraded': '2024-09-19T05:34:06.821661+0000', 'last_fullsized': '2024-09-19T05:34:06.821661+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:34:11.679 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-09-19T05:34:11.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.822490+0000', 'last_change': '2024-09-19T05:34:06.822490+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.822490+0000', 'last_undegraded': '2024-09-19T05:34:06.822490+0000', 'last_fullsized': '2024-09-19T05:34:06.822490+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:34:11.679 INFO:tasks.ceph.ceph_manager.ceph:PG 6.26 is not active+clean 2024-09-19T05:34:11.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.827013+0000', 'last_change': '2024-09-19T05:34:06.827013+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.827013+0000', 'last_undegraded': '2024-09-19T05:34:06.827013+0000', 'last_fullsized': '2024-09-19T05:34:06.827013+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:34:11.679 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-09-19T05:34:11.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.834957+0000', 'last_change': '2024-09-19T05:34:06.834957+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.834957+0000', 'last_undegraded': '2024-09-19T05:34:06.834957+0000', 'last_fullsized': '2024-09-19T05:34:06.834957+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:34:11.679 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-09-19T05:34:11.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.825476+0000', 'last_change': '2024-09-19T05:34:06.825476+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.825476+0000', 'last_undegraded': '2024-09-19T05:34:06.825476+0000', 'last_fullsized': '2024-09-19T05:34:06.825476+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.680 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-09-19T05:34:11.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.832898+0000', 'last_change': '2024-09-19T05:34:06.832898+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.832898+0000', 'last_undegraded': '2024-09-19T05:34:06.832898+0000', 'last_fullsized': '2024-09-19T05:34:06.832898+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:34:11.680 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-09-19T05:34:11.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.821191+0000', 'last_change': '2024-09-19T05:34:06.821191+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.821191+0000', 'last_undegraded': '2024-09-19T05:34:06.821191+0000', 'last_fullsized': '2024-09-19T05:34:06.821191+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:34:11.680 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-09-19T05:34:11.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.827166+0000', 'last_change': '2024-09-19T05:34:06.827166+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.827166+0000', 'last_undegraded': '2024-09-19T05:34:06.827166+0000', 'last_fullsized': '2024-09-19T05:34:06.827166+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:34:11.680 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-09-19T05:34:11.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.823397+0000', 'last_change': '2024-09-19T05:34:06.823397+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.823397+0000', 'last_undegraded': '2024-09-19T05:34:06.823397+0000', 'last_fullsized': '2024-09-19T05:34:06.823397+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:34:11.681 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-09-19T05:34:11.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.830708+0000', 'last_change': '2024-09-19T05:34:06.830708+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.830708+0000', 'last_undegraded': '2024-09-19T05:34:06.830708+0000', 'last_fullsized': '2024-09-19T05:34:06.830708+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:34:11.681 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-09-19T05:34:11.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.824227+0000', 'last_change': '2024-09-19T05:34:06.824227+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.824227+0000', 'last_undegraded': '2024-09-19T05:34:06.824227+0000', 'last_fullsized': '2024-09-19T05:34:06.824227+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:34:11.681 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-09-19T05:34:11.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.815160+0000', 'last_change': '2024-09-19T05:34:06.815160+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.815160+0000', 'last_undegraded': '2024-09-19T05:34:06.815160+0000', 'last_fullsized': '2024-09-19T05:34:06.815160+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:34:11.681 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-09-19T05:34:11.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.834210+0000', 'last_change': '2024-09-19T05:34:06.834210+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.834210+0000', 'last_undegraded': '2024-09-19T05:34:06.834210+0000', 'last_fullsized': '2024-09-19T05:34:06.834210+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:34:11.681 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-09-19T05:34:11.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.822046+0000', 'last_change': '2024-09-19T05:34:06.822046+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.822046+0000', 'last_undegraded': '2024-09-19T05:34:06.822046+0000', 'last_fullsized': '2024-09-19T05:34:06.822046+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:34:11.682 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-09-19T05:34:11.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.820763+0000', 'last_change': '2024-09-19T05:34:06.820763+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.820763+0000', 'last_undegraded': '2024-09-19T05:34:06.820763+0000', 'last_fullsized': '2024-09-19T05:34:06.820763+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.682 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-09-19T05:34:11.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.816022+0000', 'last_change': '2024-09-19T05:34:06.816022+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.816022+0000', 'last_undegraded': '2024-09-19T05:34:06.816022+0000', 'last_fullsized': '2024-09-19T05:34:06.816022+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:34:11.682 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-09-19T05:34:11.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.829917+0000', 'last_change': '2024-09-19T05:34:06.829917+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.829917+0000', 'last_undegraded': '2024-09-19T05:34:06.829917+0000', 'last_fullsized': '2024-09-19T05:34:06.829917+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:34:11.682 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-09-19T05:34:11.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.821014+0000', 'last_change': '2024-09-19T05:34:06.821014+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.821014+0000', 'last_undegraded': '2024-09-19T05:34:06.821014+0000', 'last_fullsized': '2024-09-19T05:34:06.821014+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:34:11.682 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-09-19T05:34:11.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.833585+0000', 'last_change': '2024-09-19T05:34:06.833585+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.833585+0000', 'last_undegraded': '2024-09-19T05:34:06.833585+0000', 'last_fullsized': '2024-09-19T05:34:06.833585+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:34:11.683 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-09-19T05:34:11.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.822230+0000', 'last_change': '2024-09-19T05:34:06.822230+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.822230+0000', 'last_undegraded': '2024-09-19T05:34:06.822230+0000', 'last_fullsized': '2024-09-19T05:34:06.822230+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:34:11.683 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-09-19T05:34:11.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.814493+0000', 'last_change': '2024-09-19T05:34:06.814493+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.814493+0000', 'last_undegraded': '2024-09-19T05:34:06.814493+0000', 'last_fullsized': '2024-09-19T05:34:06.814493+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:34:11.683 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-09-19T05:34:11.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.821481+0000', 'last_change': '2024-09-19T05:34:06.821481+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.821481+0000', 'last_undegraded': '2024-09-19T05:34:06.821481+0000', 'last_fullsized': '2024-09-19T05:34:06.821481+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:34:11.683 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-09-19T05:34:11.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.828946+0000', 'last_change': '2024-09-19T05:34:06.828946+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.828946+0000', 'last_undegraded': '2024-09-19T05:34:06.828946+0000', 'last_fullsized': '2024-09-19T05:34:06.828946+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:34:11.683 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-09-19T05:34:11.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.825156+0000', 'last_change': '2024-09-19T05:34:06.825156+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.825156+0000', 'last_undegraded': '2024-09-19T05:34:06.825156+0000', 'last_fullsized': '2024-09-19T05:34:06.825156+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:34:11.684 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-09-19T05:34:11.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.829302+0000', 'last_change': '2024-09-19T05:34:06.829302+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.829302+0000', 'last_undegraded': '2024-09-19T05:34:06.829302+0000', 'last_fullsized': '2024-09-19T05:34:06.829302+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:34:11.684 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-09-19T05:34:11.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.836944+0000', 'last_change': '2024-09-19T05:34:06.836944+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.836944+0000', 'last_undegraded': '2024-09-19T05:34:06.836944+0000', 'last_fullsized': '2024-09-19T05:34:06.836944+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:34:11.684 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-09-19T05:34:11.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.826435+0000', 'last_change': '2024-09-19T05:34:06.826435+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.826435+0000', 'last_undegraded': '2024-09-19T05:34:06.826435+0000', 'last_fullsized': '2024-09-19T05:34:06.826435+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.684 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-09-19T05:34:11.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.816398+0000', 'last_change': '2024-09-19T05:34:06.816398+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.816398+0000', 'last_undegraded': '2024-09-19T05:34:06.816398+0000', 'last_fullsized': '2024-09-19T05:34:06.816398+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:34:11.685 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-19T05:34:11.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.820128+0000', 'last_change': '2024-09-19T05:34:06.820128+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.820128+0000', 'last_undegraded': '2024-09-19T05:34:06.820128+0000', 'last_fullsized': '2024-09-19T05:34:06.820128+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:34:11.685 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-09-19T05:34:11.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.823802+0000', 'last_change': '2024-09-19T05:34:06.823802+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.823802+0000', 'last_undegraded': '2024-09-19T05:34:06.823802+0000', 'last_fullsized': '2024-09-19T05:34:06.823802+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:34:11.685 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-09-19T05:34:11.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.819493+0000', 'last_change': '2024-09-19T05:34:06.819493+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.819493+0000', 'last_undegraded': '2024-09-19T05:34:06.819493+0000', 'last_fullsized': '2024-09-19T05:34:06.819493+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:34:11.685 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-09-19T05:34:11.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.821025+0000', 'last_change': '2024-09-19T05:34:06.821025+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.821025+0000', 'last_undegraded': '2024-09-19T05:34:06.821025+0000', 'last_fullsized': '2024-09-19T05:34:06.821025+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.685 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-09-19T05:34:11.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.824342+0000', 'last_change': '2024-09-19T05:34:06.824342+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.824342+0000', 'last_undegraded': '2024-09-19T05:34:06.824342+0000', 'last_fullsized': '2024-09-19T05:34:06.824342+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:34:11.686 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-09-19T05:34:11.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.821762+0000', 'last_change': '2024-09-19T05:34:06.821762+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.821762+0000', 'last_undegraded': '2024-09-19T05:34:06.821762+0000', 'last_fullsized': '2024-09-19T05:34:06.821762+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:34:11.686 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-09-19T05:34:11.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.830904+0000', 'last_change': '2024-09-19T05:34:06.830904+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.830904+0000', 'last_undegraded': '2024-09-19T05:34:06.830904+0000', 'last_fullsized': '2024-09-19T05:34:06.830904+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:34:11.686 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-19T05:34:11.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.829745+0000', 'last_change': '2024-09-19T05:34:06.829745+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.829745+0000', 'last_undegraded': '2024-09-19T05:34:06.829745+0000', 'last_fullsized': '2024-09-19T05:34:06.829745+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:34:11.686 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-09-19T05:34:11.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.820860+0000', 'last_change': '2024-09-19T05:34:06.820860+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.820860+0000', 'last_undegraded': '2024-09-19T05:34:06.820860+0000', 'last_fullsized': '2024-09-19T05:34:06.820860+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:34:11.686 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-09-19T05:34:11.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.820223+0000', 'last_change': '2024-09-19T05:34:06.820223+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.820223+0000', 'last_undegraded': '2024-09-19T05:34:06.820223+0000', 'last_fullsized': '2024-09-19T05:34:06.820223+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:34:11.687 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-09-19T05:34:11.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.816968+0000', 'last_change': '2024-09-19T05:34:06.816968+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.816968+0000', 'last_undegraded': '2024-09-19T05:34:06.816968+0000', 'last_fullsized': '2024-09-19T05:34:06.816968+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:34:11.687 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-09-19T05:34:11.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.829424+0000', 'last_change': '2024-09-19T05:34:06.829424+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.829424+0000', 'last_undegraded': '2024-09-19T05:34:06.829424+0000', 'last_fullsized': '2024-09-19T05:34:06.829424+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:34:11.687 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-09-19T05:34:11.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:34:06.824647+0000', 'last_change': '2024-09-19T05:34:06.824647+0000', 'last_active': '2024-09-19T05:34:06.803087+0000', 'last_peered': '2024-09-19T05:34:06.803087+0000', 'last_clean': '2024-09-19T05:34:06.803087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:34:06.824647+0000', 'last_undegraded': '2024-09-19T05:34:06.824647+0000', 'last_fullsized': '2024-09-19T05:34:06.824647+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'last_clean_scrub_stamp': '2024-09-19T05:34:06.803087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:34:11.688 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:34:11.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f033674e640 1 Processor -- start 2024-09-19T05:34:11.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f033674e640 1 -- start start 2024-09-19T05:34:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f033674e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033015f370 0x7f03300ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f033674e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f03300ae8c0 0x7f03300aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f033674e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033006e790 con 0x7f0330070140 2024-09-19T05:34:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f033674e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f033015f7b0 con 0x7f03300ae8c0 2024-09-19T05:34:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f033674e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f033006ea50 con 0x7f033015f370 2024-09-19T05:34:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f032ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0330070140 0x7f0330070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38454/0 (socket says 172.21.15.67:38454) 2024-09-19T05:34:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f032ffff640 1 -- 172.21.15.67:0/2637976856 learned_addr learned my addr 172.21.15.67:0/2637976856 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f032f7fe640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033015f370 0x7f03300ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.824+0000 7f0334ceb640 1 --2- 172.21.15.67:0/2637976856 >> v2:172.21.15.97:3300/0 conn(0x7f03300ae8c0 0x7f03300aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250426753 0 0) 0x7f033006e790 con 0x7f0330070140 2024-09-19T05:34:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f031c003530 con 0x7f0330070140 2024-09-19T05:34:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1863831911 0 0) 0x7f031c003530 con 0x7f0330070140 2024-09-19T05:34:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033015f370 msgr2=0x7f03300ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033015f370 0x7f03300ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 >> v2:172.21.15.97:3300/0 conn(0x7f03300ae8c0 msgr2=0x7f03300aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 --2- 172.21.15.67:0/2637976856 >> v2:172.21.15.97:3300/0 conn(0x7f03300ae8c0 0x7f03300aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033006ed30 con 0x7f0330070140 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f0328001680 con 0x7f0330070140 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 >> v1:172.21.15.67:6789/0 conn(0x7f0330070140 legacy=0x7f0330070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f031c0039c0 0x7f031c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033015f370 0x7f031c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f031c004d50 0x7f031c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f033006ea50 con 0x7f031c0039c0 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f031c00b9d0 con 0x7f031c004d50 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f031c00bb50 con 0x7f033015f370 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032ffff640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f031c0039c0 0x7f031c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f0334ceb640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f031c004d50 0x7f031c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032f7fe640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033015f370 0x7f031c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032ffff640 1 -- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033015f370 msgr2=0x7f031c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032ffff640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033015f370 0x7f031c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032ffff640 1 -- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f031c004d50 msgr2=0x7f031c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032ffff640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f031c004d50 0x7f031c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032ffff640 1 -- 172.21.15.67:0/2637976856 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c003530 con 0x7f031c0039c0 2024-09-19T05:34:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f0334ceb640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f031c004d50 0x7f031c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032f7fe640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033015f370 0x7f031c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032ffff640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f031c0039c0 0x7f031c003de0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f032800c270 tx=0x7f032801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921218b97be5fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328007d60 con 0x7f031c0039c0 2024-09-19T05:34:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03280a9020 con 0x7f031c0039c0 2024-09-19T05:34:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f032effd640 1 -- 172.21.15.67:0/2637976856 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03280a5b70 con 0x7f031c0039c0 2024-09-19T05:34:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f033674e640 1 -- 172.21.15.67:0/2637976856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f031c0039c0 msgr2=0x7f031c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f033674e640 1 --2- 172.21.15.67:0/2637976856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f031c0039c0 0x7f031c003de0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f032800c270 tx=0x7f032801cc90 comp rx=0 tx=0).stop 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f0334ceb640 1 -- 172.21.15.67:0/2637976856 reap_dead start 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f033674e640 1 -- 172.21.15.67:0/2637976856 shutdown_connections 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f033674e640 1 -- 172.21.15.67:0/2637976856 >> 172.21.15.67:0/2637976856 conn(0x7f0330073500 msgr2=0x7f033006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f033674e640 1 -- 172.21.15.67:0/2637976856 shutdown_connections 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.828+0000 7f033674e640 1 -- 172.21.15.67:0/2637976856 wait complete. 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 Processor -- start 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 -- start start 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f031c0039c0 0x7f0330157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f033015af50 0x7f03301473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03300ce0c0 0x7f033015d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f033015c160 con 0x7f03300ce0c0 2024-09-19T05:34:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f033006f810 con 0x7f033015af50 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f033015c2e0 con 0x7f031c0039c0 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f0334ceb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03300ce0c0 0x7f033015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f0334ceb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03300ce0c0 0x7f033015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36666/0 (socket says 172.21.15.67:36666) 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f0334ceb640 1 -- 172.21.15.67:0/867763659 learned_addr learned my addr 172.21.15.67:0/867763659 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f032ffff640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f031c0039c0 0x7f0330157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f032f7fe640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f033015af50 0x7f03301473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f0334ceb640 1 -- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f031c0039c0 msgr2=0x7f0330157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f0334ceb640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f031c0039c0 0x7f0330157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f0334ceb640 1 -- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f033015af50 msgr2=0x7f03301473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f0334ceb640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f033015af50 0x7f03301473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f0334ceb640 1 -- 172.21.15.67:0/867763659 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033015b6c0 con 0x7f03300ce0c0 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f0334ceb640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03300ce0c0 0x7f033015d630 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0330067cd0 tx=0x7f032000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f032cff9640 1 -- 172.21.15.67:0/867763659 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032001c070 con 0x7f03300ce0c0 2024-09-19T05:34:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f032cff9640 1 -- 172.21.15.67:0/867763659 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0320017400 con 0x7f03300ce0c0 2024-09-19T05:34:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 -- 172.21.15.67:0/867763659 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033015b9a0 con 0x7f03300ce0c0 2024-09-19T05:34:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f032cff9640 1 -- 172.21.15.67:0/867763659 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03200177b0 con 0x7f03300ce0c0 2024-09-19T05:34:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 -- 172.21.15.67:0/867763659 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03301622f0 con 0x7f03300ce0c0 2024-09-19T05:34:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.832+0000 7f033674e640 1 -- 172.21.15.67:0/867763659 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0330158200 con 0x7f03300ce0c0 2024-09-19T05:34:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.836+0000 7f032cff9640 1 -- 172.21.15.67:0/867763659 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f032001f070 con 0x7f03300ce0c0 2024-09-19T05:34:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.836+0000 7f032cff9640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03100678f0 0x7f0310069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.836+0000 7f032cff9640 1 -- 172.21.15.67:0/867763659 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0320086160 con 0x7f03300ce0c0 2024-09-19T05:34:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.836+0000 7f032ffff640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03100678f0 0x7f0310069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.836+0000 7f032ffff640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03100678f0 0x7f0310069db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f03280aa000 tx=0x7f03280b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:11.840+0000 7f032cff9640 1 -- 172.21.15.67:0/867763659 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0330158200 con 0x7f03300ce0c0 2024-09-19T05:34:12.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 -- 172.21.15.67:0/867763659 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f03301624f0 con 0x7f03300ce0c0 2024-09-19T05:34:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f032cff9640 1 -- 172.21.15.67:0/867763659 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1623 (secure 0 0 0) 0x7f03301624f0 con 0x7f03300ce0c0 2024-09-19T05:34:12.070 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:12.070 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":81,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225992704,"bytes_avail":772868120576,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":15,"btime":"2024-09-19T05:34:09:865438+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4890}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-19T05:34:03.123458+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:34:12.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 -- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03100678f0 msgr2=0x7f0310069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:12.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03100678f0 0x7f0310069db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f03280aa000 tx=0x7f03280b0040 comp rx=0 tx=0).stop 2024-09-19T05:34:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 -- 172.21.15.67:0/867763659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03300ce0c0 msgr2=0x7f033015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03300ce0c0 0x7f033015d630 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0330067cd0 tx=0x7f032000f4a0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 -- 172.21.15.67:0/867763659 shutdown_connections 2024-09-19T05:34:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03300ce0c0 0x7f033015d630 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f033015af50 0x7f03301473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03100678f0 0x7f0310069db0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 --2- 172.21.15.67:0/867763659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f031c0039c0 0x7f0330157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 -- 172.21.15.67:0/867763659 >> 172.21.15.67:0/867763659 conn(0x7f0330073500 msgr2=0x7f033015e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 -- 172.21.15.67:0/867763659 shutdown_connections 2024-09-19T05:34:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.064+0000 7f033674e640 1 -- 172.21.15.67:0/867763659 wait complete. 2024-09-19T05:34:12.088 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T05:34:12.088 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:34:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.192+0000 7f634fc4e640 1 Processor -- start 2024-09-19T05:34:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.192+0000 7f634fc4e640 1 -- start start 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634fc4e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f63480b4900 0x7f6348071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634fc4e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480723c0 0x7f6348072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634fc4e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63480b3860 con 0x7f634815b1e0 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634fc4e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f634815b5c0 con 0x7f63480b4900 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634fc4e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f63480b3b40 con 0x7f63480723c0 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634d1e9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f63480b4900 0x7f6348071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634d1e9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f63480b4900 0x7f6348071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36676/0 (socket says 172.21.15.67:36676) 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634d1e9640 1 -- 172.21.15.67:0/2646104112 learned_addr learned my addr 172.21.15.67:0/2646104112 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634e1eb640 1 --2- 172.21.15.67:0/2646104112 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480723c0 0x7f6348072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634d1e9640 1 -- 172.21.15.67:0/2646104112 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480723c0 msgr2=0x7f6348072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634d1e9640 1 --2- 172.21.15.67:0/2646104112 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480723c0 0x7f6348072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634d1e9640 1 -- 172.21.15.67:0/2646104112 >> v1:172.21.15.97:6789/0 conn(0x7f634815b1e0 legacy=0x7f63480b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634d1e9640 1 -- 172.21.15.67:0/2646104112 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63480b3e20 con 0x7f63480b4900 2024-09-19T05:34:12.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634d1e9640 1 --2- 172.21.15.67:0/2646104112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480b4900 0x7f6348071e80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6344009870 tx=0x7f634401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379b90072dac3502 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:12.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634c9e8640 1 -- 172.21.15.67:0/2646104112 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440b1070 con 0x7f63480b4900 2024-09-19T05:34:12.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634c9e8640 1 -- 172.21.15.67:0/2646104112 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63440ac410 con 0x7f63480b4900 2024-09-19T05:34:12.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.196+0000 7f634c9e8640 1 -- 172.21.15.67:0/2646104112 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440ac7e0 con 0x7f63480b4900 2024-09-19T05:34:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 -- 172.21.15.67:0/2646104112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480b4900 msgr2=0x7f6348071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 --2- 172.21.15.67:0/2646104112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480b4900 0x7f6348071e80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6344009870 tx=0x7f634401c4f0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 -- 172.21.15.67:0/2646104112 shutdown_connections 2024-09-19T05:34:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 --2- 172.21.15.67:0/2646104112 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480723c0 0x7f6348072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 --2- 172.21.15.67:0/2646104112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480b4900 0x7f6348071e80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 -- 172.21.15.67:0/2646104112 >> 172.21.15.67:0/2646104112 conn(0x7f63480d0080 msgr2=0x7f63480d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 -- 172.21.15.67:0/2646104112 shutdown_connections 2024-09-19T05:34:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 -- 172.21.15.67:0/2646104112 wait complete. 2024-09-19T05:34:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 Processor -- start 2024-09-19T05:34:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 -- start start 2024-09-19T05:34:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480723c0 0x7f6348153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480b4900 0x7f63480998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f634815b1e0 0x7f6348139e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f63480aea30 con 0x7f63480723c0 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f63480ae8b0 con 0x7f634815b1e0 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634fc4e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f63480aebb0 con 0x7f63480b4900 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d9ea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480723c0 0x7f6348153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d9ea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480723c0 0x7f6348153fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36680/0 (socket says 172.21.15.67:36680) 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d9ea640 1 -- 172.21.15.67:0/1188222173 learned_addr learned my addr 172.21.15.67:0/1188222173 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d1e9640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480b4900 0x7f63480998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634e1eb640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f634815b1e0 0x7f6348139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d9ea640 1 -- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480b4900 msgr2=0x7f63480998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d9ea640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480b4900 0x7f63480998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d9ea640 1 -- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f634815b1e0 msgr2=0x7f6348139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d9ea640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f634815b1e0 0x7f6348139e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d9ea640 1 -- 172.21.15.67:0/1188222173 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63481544f0 con 0x7f63480723c0 2024-09-19T05:34:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d1e9640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480b4900 0x7f63480998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.200+0000 7f634d9ea640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480723c0 0x7f6348153fb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f633800e760 tx=0x7f633800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f633e7fc640 1 -- 172.21.15.67:0/1188222173 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338004260 con 0x7f63480723c0 2024-09-19T05:34:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f634fc4e640 1 -- 172.21.15.67:0/1188222173 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63481547b0 con 0x7f63480723c0 2024-09-19T05:34:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f633e7fc640 1 -- 172.21.15.67:0/1188222173 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6338004420 con 0x7f63480723c0 2024-09-19T05:34:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f633e7fc640 1 -- 172.21.15.67:0/1188222173 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63380116b0 con 0x7f63480723c0 2024-09-19T05:34:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f634fc4e640 1 -- 172.21.15.67:0/1188222173 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634814e0d0 con 0x7f63480723c0 2024-09-19T05:34:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f634fc4e640 1 -- 172.21.15.67:0/1188222173 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6348154cd0 con 0x7f63480723c0 2024-09-19T05:34:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f633e7fc640 1 -- 172.21.15.67:0/1188222173 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6338011850 con 0x7f63480723c0 2024-09-19T05:34:12.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f633e7fc640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f632c0678c0 0x7f632c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:12.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f633e7fc640 1 -- 172.21.15.67:0/1188222173 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f63380884e0 con 0x7f63480723c0 2024-09-19T05:34:12.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f634d1e9640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f632c0678c0 0x7f632c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:12.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.204+0000 7f634d1e9640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f632c0678c0 0x7f632c069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f63440ae000 tx=0x7f63440a6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:12.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.208+0000 7f633e7fc640 1 -- 172.21.15.67:0/1188222173 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6348154cd0 con 0x7f63480723c0 2024-09-19T05:34:12.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.368+0000 7f634fc4e640 1 -- 172.21.15.67:0/1188222173 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6348072850 con 0x7f632c0678c0 2024-09-19T05:34:12.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f633e7fc640 1 -- 172.21.15.67:0/1188222173 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246640 (secure 0 0 0) 0x7f6348072850 con 0x7f632c0678c0 2024-09-19T05:34:12.393 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:34:12.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 -- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f632c0678c0 msgr2=0x7f632c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:12.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f632c0678c0 0x7f632c069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f63440ae000 tx=0x7f63440a6040 comp rx=0 tx=0).stop 2024-09-19T05:34:12.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 -- 172.21.15.67:0/1188222173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480723c0 msgr2=0x7f6348153fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:12.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480723c0 0x7f6348153fb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f633800e760 tx=0x7f633800ec20 comp rx=0 tx=0).stop 2024-09-19T05:34:12.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 -- 172.21.15.67:0/1188222173 shutdown_connections 2024-09-19T05:34:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f634815b1e0 0x7f6348139e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f632c0678c0 0x7f632c069d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63480b4900 0x7f63480998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 --2- 172.21.15.67:0/1188222173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63480723c0 0x7f6348153fb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 -- 172.21.15.67:0/1188222173 >> 172.21.15.67:0/1188222173 conn(0x7f63480d0080 msgr2=0x7f63481512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 -- 172.21.15.67:0/1188222173 shutdown_connections 2024-09-19T05:34:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:12.388+0000 7f634fc4e640 1 -- 172.21.15.67:0/1188222173 wait complete. 2024-09-19T05:34:12.411 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-19T05:34:11.125638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220696,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754024,"statfs":{"total":773094113280,"available":772868120576,"internally_reserved":0,"allocated":4562944,"data_stored":2615856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.321667"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.836604+0000","last_change":"2024-09-19T05:34:06.836604+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.836604+0000","last_undegraded":"2024-09-19T05:34:06.836604+0000","last_fullsized":"2024-09-19T05:34:06.836604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.835511+0000","last_change":"2024-09-19T05:34:06.835511+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.835511+0000","last_undegraded":"2024-09-19T05:34:06.835511+0000","last_fullsized":"2024-09-19T05:34:06.835511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820312+0000","last_change":"2024-09-19T05:34:06.820312+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820312+0000","last_undegraded":"2024-09-19T05:34:06.820312+0000","last_fullsized":"2024-09-19T05:34:06.820312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829261+0000","last_change":"2024-09-19T05:34:06.829261+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829261+0000","last_undegraded":"2024-09-19T05:34:06.829261+0000","last_fullsized":"2024-09-19T05:34:06.829261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829785+0000","last_change":"2024-09-19T05:34:06.829785+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829785+0000","last_undegraded":"2024-09-19T05:34:06.829785+0000","last_fullsized":"2024-09-19T05:34:06.829785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.828835+0000","last_change":"2024-09-19T05:34:06.828835+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.828835+0000","last_undegraded":"2024-09-19T05:34:06.828835+0000","last_fullsized":"2024-09-19T05:34:06.828835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823236+0000","last_change":"2024-09-19T05:34:06.823236+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823236+0000","last_undegraded":"2024-09-19T05:34:06.823236+0000","last_fullsized":"2024-09-19T05:34:06.823236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830660+0000","last_change":"2024-09-19T05:34:06.830660+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830660+0000","last_undegraded":"2024-09-19T05:34:06.830660+0000","last_fullsized":"2024-09-19T05:34:06.830660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819609+0000","last_change":"2024-09-19T05:34:06.819609+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819609+0000","last_undegraded":"2024-09-19T05:34:06.819609+0000","last_fullsized":"2024-09-19T05:34:06.819609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827096+0000","last_change":"2024-09-19T05:34:06.827096+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827096+0000","last_undegraded":"2024-09-19T05:34:06.827096+0000","last_fullsized":"2024-09-19T05:34:06.827096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.835381+0000","last_change":"2024-09-19T05:34:06.835381+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.835381+0000","last_undegraded":"2024-09-19T05:34:06.835381+0000","last_fullsized":"2024-09-19T05:34:06.835381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819493+0000","last_change":"2024-09-19T05:34:06.819493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819493+0000","last_undegraded":"2024-09-19T05:34:06.819493+0000","last_fullsized":"2024-09-19T05:34:06.819493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822917+0000","last_change":"2024-09-19T05:34:06.822917+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822917+0000","last_undegraded":"2024-09-19T05:34:06.822917+0000","last_fullsized":"2024-09-19T05:34:06.822917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.817924+0000","last_change":"2024-09-19T05:34:06.817924+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.817924+0000","last_undegraded":"2024-09-19T05:34:06.817924+0000","last_fullsized":"2024-09-19T05:34:06.817924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822032+0000","last_change":"2024-09-19T05:34:06.822032+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822032+0000","last_undegraded":"2024-09-19T05:34:06.822032+0000","last_fullsized":"2024-09-19T05:34:06.822032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824959+0000","last_change":"2024-09-19T05:34:06.824959+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824959+0000","last_undegraded":"2024-09-19T05:34:06.824959+0000","last_fullsized":"2024-09-19T05:34:06.824959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829314+0000","last_change":"2024-09-19T05:34:06.829314+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829314+0000","last_undegraded":"2024-09-19T05:34:06.829314+0000","last_fullsized":"2024-09-19T05:34:06.829314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822019+0000","last_change":"2024-09-19T05:34:06.822019+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822019+0000","last_undegraded":"2024-09-19T05:34:06.822019+0000","last_fullsized":"2024-09-19T05:34:06.822019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821810+0000","last_change":"2024-09-19T05:34:06.821810+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821810+0000","last_undegraded":"2024-09-19T05:34:06.821810+0000","last_fullsized":"2024-09-19T05:34:06.821810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.833600+0000","last_change":"2024-09-19T05:34:06.833600+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.833600+0000","last_undegraded":"2024-09-19T05:34:06.833600+0000","last_fullsized":"2024-09-19T05:34:06.833600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821882+0000","last_change":"2024-09-19T05:34:06.821882+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821882+0000","last_undegraded":"2024-09-19T05:34:06.821882+0000","last_fullsized":"2024-09-19T05:34:06.821882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.813884+0000","last_change":"2024-09-19T05:34:06.813884+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.813884+0000","last_undegraded":"2024-09-19T05:34:06.813884+0000","last_fullsized":"2024-09-19T05:34:06.813884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.831688+0000","last_change":"2024-09-19T05:34:06.831688+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.831688+0000","last_undegraded":"2024-09-19T05:34:06.831688+0000","last_fullsized":"2024-09-19T05:34:06.831688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821661+0000","last_change":"2024-09-19T05:34:06.821661+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821661+0000","last_undegraded":"2024-09-19T05:34:06.821661+0000","last_fullsized":"2024-09-19T05:34:06.821661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822490+0000","last_change":"2024-09-19T05:34:06.822490+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822490+0000","last_undegraded":"2024-09-19T05:34:06.822490+0000","last_fullsized":"2024-09-19T05:34:06.822490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827013+0000","last_change":"2024-09-19T05:34:06.827013+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827013+0000","last_undegraded":"2024-09-19T05:34:06.827013+0000","last_fullsized":"2024-09-19T05:34:06.827013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.834957+0000","last_change":"2024-09-19T05:34:06.834957+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.834957+0000","last_undegraded":"2024-09-19T05:34:06.834957+0000","last_fullsized":"2024-09-19T05:34:06.834957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.825476+0000","last_change":"2024-09-19T05:34:06.825476+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.825476+0000","last_undegraded":"2024-09-19T05:34:06.825476+0000","last_fullsized":"2024-09-19T05:34:06.825476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.832898+0000","last_change":"2024-09-19T05:34:06.832898+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.832898+0000","last_undegraded":"2024-09-19T05:34:06.832898+0000","last_fullsized":"2024-09-19T05:34:06.832898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821191+0000","last_change":"2024-09-19T05:34:06.821191+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821191+0000","last_undegraded":"2024-09-19T05:34:06.821191+0000","last_fullsized":"2024-09-19T05:34:06.821191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.827166+0000","last_change":"2024-09-19T05:34:06.827166+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.827166+0000","last_undegraded":"2024-09-19T05:34:06.827166+0000","last_fullsized":"2024-09-19T05:34:06.827166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823397+0000","last_change":"2024-09-19T05:34:06.823397+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823397+0000","last_undegraded":"2024-09-19T05:34:06.823397+0000","last_fullsized":"2024-09-19T05:34:06.823397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830708+0000","last_change":"2024-09-19T05:34:06.830708+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830708+0000","last_undegraded":"2024-09-19T05:34:06.830708+0000","last_fullsized":"2024-09-19T05:34:06.830708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854676+0000","last_change":"2024-09-19T05:34:06.852439+0000","last_active":"2024-09-19T05:34:06.854676+0000","last_peered":"2024-09-19T05:34:06.854676+0000","last_clean":"2024-09-19T05:34:06.854676+0000","last_became_active":"2024-09-19T05:34:06.851717+0000","last_became_peered":"2024-09-19T05:34:06.851717+0000","last_unstale":"2024-09-19T05:34:06.854676+0000","last_undegraded":"2024-09-19T05:34:06.854676+0000","last_fullsized":"2024-09-19T05:34:06.854676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:56.835003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824227+0000","last_change":"2024-09-19T05:34:06.824227+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824227+0000","last_undegraded":"2024-09-19T05:34:06.824227+0000","last_fullsized":"2024-09-19T05:34:06.824227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.852108+0000","last_change":"2024-09-19T05:34:06.845116+0000","last_active":"2024-09-19T05:34:06.852108+0000","last_peered":"2024-09-19T05:34:06.852108+0000","last_clean":"2024-09-19T05:34:06.852108+0000","last_became_active":"2024-09-19T05:34:06.844043+0000","last_became_peered":"2024-09-19T05:34:06.844043+0000","last_unstale":"2024-09-19T05:34:06.852108+0000","last_undegraded":"2024-09-19T05:34:06.852108+0000","last_fullsized":"2024-09-19T05:34:06.852108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.815160+0000","last_change":"2024-09-19T05:34:06.815160+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.815160+0000","last_undegraded":"2024-09-19T05:34:06.815160+0000","last_fullsized":"2024-09-19T05:34:06.815160+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849490+0000","last_change":"2024-09-19T05:34:06.845387+0000","last_active":"2024-09-19T05:34:06.849490+0000","last_peered":"2024-09-19T05:34:06.849490+0000","last_clean":"2024-09-19T05:34:06.849490+0000","last_became_active":"2024-09-19T05:34:06.845018+0000","last_became_peered":"2024-09-19T05:34:06.845018+0000","last_unstale":"2024-09-19T05:34:06.849490+0000","last_undegraded":"2024-09-19T05:34:06.849490+0000","last_fullsized":"2024-09-19T05:34:06.849490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:14.356013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.834210+0000","last_change":"2024-09-19T05:34:06.834210+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.834210+0000","last_undegraded":"2024-09-19T05:34:06.834210+0000","last_fullsized":"2024-09-19T05:34:06.834210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.853118+0000","last_change":"2024-09-19T05:34:06.849848+0000","last_active":"2024-09-19T05:34:06.853118+0000","last_peered":"2024-09-19T05:34:06.853118+0000","last_clean":"2024-09-19T05:34:06.853118+0000","last_became_active":"2024-09-19T05:34:06.849061+0000","last_became_peered":"2024-09-19T05:34:06.849061+0000","last_unstale":"2024-09-19T05:34:06.853118+0000","last_undegraded":"2024-09-19T05:34:06.853118+0000","last_fullsized":"2024-09-19T05:34:06.853118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:34.095147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822046+0000","last_change":"2024-09-19T05:34:06.822046+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822046+0000","last_undegraded":"2024-09-19T05:34:06.822046+0000","last_fullsized":"2024-09-19T05:34:06.822046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854942+0000","last_change":"2024-09-19T05:34:06.838559+0000","last_active":"2024-09-19T05:34:06.854942+0000","last_peered":"2024-09-19T05:34:06.854942+0000","last_clean":"2024-09-19T05:34:06.854942+0000","last_became_active":"2024-09-19T05:34:06.837817+0000","last_became_peered":"2024-09-19T05:34:06.837817+0000","last_unstale":"2024-09-19T05:34:06.854942+0000","last_undegraded":"2024-09-19T05:34:06.854942+0000","last_fullsized":"2024-09-19T05:34:06.854942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:29.930489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820763+0000","last_change":"2024-09-19T05:34:06.820763+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820763+0000","last_undegraded":"2024-09-19T05:34:06.820763+0000","last_fullsized":"2024-09-19T05:34:06.820763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.864174+0000","last_change":"2024-09-19T05:34:06.859044+0000","last_active":"2024-09-19T05:34:06.864174+0000","last_peered":"2024-09-19T05:34:06.864174+0000","last_clean":"2024-09-19T05:34:06.864174+0000","last_became_active":"2024-09-19T05:34:06.858309+0000","last_became_peered":"2024-09-19T05:34:06.858309+0000","last_unstale":"2024-09-19T05:34:06.864174+0000","last_undegraded":"2024-09-19T05:34:06.864174+0000","last_fullsized":"2024-09-19T05:34:06.864174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816022+0000","last_change":"2024-09-19T05:34:06.816022+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816022+0000","last_undegraded":"2024-09-19T05:34:06.816022+0000","last_fullsized":"2024-09-19T05:34:06.816022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.857972+0000","last_change":"2024-09-19T05:34:06.857190+0000","last_active":"2024-09-19T05:34:06.857972+0000","last_peered":"2024-09-19T05:34:06.857972+0000","last_clean":"2024-09-19T05:34:06.857972+0000","last_became_active":"2024-09-19T05:34:06.856825+0000","last_became_peered":"2024-09-19T05:34:06.856825+0000","last_unstale":"2024-09-19T05:34:06.857972+0000","last_undegraded":"2024-09-19T05:34:06.857972+0000","last_fullsized":"2024-09-19T05:34:06.857972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:32.836196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829917+0000","last_change":"2024-09-19T05:34:06.829917+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829917+0000","last_undegraded":"2024-09-19T05:34:06.829917+0000","last_fullsized":"2024-09-19T05:34:06.829917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850723+0000","last_change":"2024-09-19T05:34:06.842643+0000","last_active":"2024-09-19T05:34:06.850723+0000","last_peered":"2024-09-19T05:34:06.850723+0000","last_clean":"2024-09-19T05:34:06.850723+0000","last_became_active":"2024-09-19T05:34:06.841913+0000","last_became_peered":"2024-09-19T05:34:06.841913+0000","last_unstale":"2024-09-19T05:34:06.850723+0000","last_undegraded":"2024-09-19T05:34:06.850723+0000","last_fullsized":"2024-09-19T05:34:06.850723+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.764872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821014+0000","last_change":"2024-09-19T05:34:06.821014+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821014+0000","last_undegraded":"2024-09-19T05:34:06.821014+0000","last_fullsized":"2024-09-19T05:34:06.821014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849021+0000","last_change":"2024-09-19T05:34:06.841162+0000","last_active":"2024-09-19T05:34:06.849021+0000","last_peered":"2024-09-19T05:34:06.849021+0000","last_clean":"2024-09-19T05:34:06.849021+0000","last_became_active":"2024-09-19T05:34:06.840853+0000","last_became_peered":"2024-09-19T05:34:06.840853+0000","last_unstale":"2024-09-19T05:34:06.849021+0000","last_undegraded":"2024-09-19T05:34:06.849021+0000","last_fullsized":"2024-09-19T05:34:06.849021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:21.838375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.833585+0000","last_change":"2024-09-19T05:34:06.833585+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.833585+0000","last_undegraded":"2024-09-19T05:34:06.833585+0000","last_fullsized":"2024-09-19T05:34:06.833585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859409+0000","last_change":"2024-09-19T05:34:06.853535+0000","last_active":"2024-09-19T05:34:06.859409+0000","last_peered":"2024-09-19T05:34:06.859409+0000","last_clean":"2024-09-19T05:34:06.859409+0000","last_became_active":"2024-09-19T05:34:06.847562+0000","last_became_peered":"2024-09-19T05:34:06.847562+0000","last_unstale":"2024-09-19T05:34:06.859409+0000","last_undegraded":"2024-09-19T05:34:06.859409+0000","last_fullsized":"2024-09-19T05:34:06.859409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:32.065609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.822230+0000","last_change":"2024-09-19T05:34:06.822230+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.822230+0000","last_undegraded":"2024-09-19T05:34:06.822230+0000","last_fullsized":"2024-09-19T05:34:06.822230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859525+0000","last_change":"2024-09-19T05:34:06.848198+0000","last_active":"2024-09-19T05:34:06.859525+0000","last_peered":"2024-09-19T05:34:06.859525+0000","last_clean":"2024-09-19T05:34:06.859525+0000","last_became_active":"2024-09-19T05:34:06.847343+0000","last_became_peered":"2024-09-19T05:34:06.847343+0000","last_unstale":"2024-09-19T05:34:06.859525+0000","last_undegraded":"2024-09-19T05:34:06.859525+0000","last_fullsized":"2024-09-19T05:34:06.859525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:37.529574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.814493+0000","last_change":"2024-09-19T05:34:06.814493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.814493+0000","last_undegraded":"2024-09-19T05:34:06.814493+0000","last_fullsized":"2024-09-19T05:34:06.814493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.862889+0000","last_change":"2024-09-19T05:34:06.860750+0000","last_active":"2024-09-19T05:34:06.862889+0000","last_peered":"2024-09-19T05:34:06.862889+0000","last_clean":"2024-09-19T05:34:06.862889+0000","last_became_active":"2024-09-19T05:34:06.860241+0000","last_became_peered":"2024-09-19T05:34:06.860241+0000","last_unstale":"2024-09-19T05:34:06.862889+0000","last_undegraded":"2024-09-19T05:34:06.862889+0000","last_fullsized":"2024-09-19T05:34:06.862889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:02.255476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821481+0000","last_change":"2024-09-19T05:34:06.821481+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821481+0000","last_undegraded":"2024-09-19T05:34:06.821481+0000","last_fullsized":"2024-09-19T05:34:06.821481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850206+0000","last_change":"2024-09-19T05:34:06.843826+0000","last_active":"2024-09-19T05:34:06.850206+0000","last_peered":"2024-09-19T05:34:06.850206+0000","last_clean":"2024-09-19T05:34:06.850206+0000","last_became_active":"2024-09-19T05:34:06.843513+0000","last_became_peered":"2024-09-19T05:34:06.843513+0000","last_unstale":"2024-09-19T05:34:06.850206+0000","last_undegraded":"2024-09-19T05:34:06.850206+0000","last_fullsized":"2024-09-19T05:34:06.850206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:10.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.828946+0000","last_change":"2024-09-19T05:34:06.828946+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.828946+0000","last_undegraded":"2024-09-19T05:34:06.828946+0000","last_fullsized":"2024-09-19T05:34:06.828946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854780+0000","last_change":"2024-09-19T05:34:06.848974+0000","last_active":"2024-09-19T05:34:06.854780+0000","last_peered":"2024-09-19T05:34:06.854780+0000","last_clean":"2024-09-19T05:34:06.854780+0000","last_became_active":"2024-09-19T05:34:06.848530+0000","last_became_peered":"2024-09-19T05:34:06.848530+0000","last_unstale":"2024-09-19T05:34:06.854780+0000","last_undegraded":"2024-09-19T05:34:06.854780+0000","last_fullsized":"2024-09-19T05:34:06.854780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:49.609195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.825156+0000","last_change":"2024-09-19T05:34:06.825156+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.825156+0000","last_undegraded":"2024-09-19T05:34:06.825156+0000","last_fullsized":"2024-09-19T05:34:06.825156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.843504+0000","last_change":"2024-09-19T05:34:06.834851+0000","last_active":"2024-09-19T05:34:06.843504+0000","last_peered":"2024-09-19T05:34:06.843504+0000","last_clean":"2024-09-19T05:34:06.843504+0000","last_became_active":"2024-09-19T05:34:06.833971+0000","last_became_peered":"2024-09-19T05:34:06.833971+0000","last_unstale":"2024-09-19T05:34:06.843504+0000","last_undegraded":"2024-09-19T05:34:06.843504+0000","last_fullsized":"2024-09-19T05:34:06.843504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:17.675046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829302+0000","last_change":"2024-09-19T05:34:06.829302+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829302+0000","last_undegraded":"2024-09-19T05:34:06.829302+0000","last_fullsized":"2024-09-19T05:34:06.829302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.858265+0000","last_change":"2024-09-19T05:34:06.845734+0000","last_active":"2024-09-19T05:34:06.858265+0000","last_peered":"2024-09-19T05:34:06.858265+0000","last_clean":"2024-09-19T05:34:06.858265+0000","last_became_active":"2024-09-19T05:34:06.845025+0000","last_became_peered":"2024-09-19T05:34:06.845025+0000","last_unstale":"2024-09-19T05:34:06.858265+0000","last_undegraded":"2024-09-19T05:34:06.858265+0000","last_fullsized":"2024-09-19T05:34:06.858265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:03.879574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.836944+0000","last_change":"2024-09-19T05:34:06.836944+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.836944+0000","last_undegraded":"2024-09-19T05:34:06.836944+0000","last_fullsized":"2024-09-19T05:34:06.836944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859621+0000","last_change":"2024-09-19T05:34:06.854395+0000","last_active":"2024-09-19T05:34:06.859621+0000","last_peered":"2024-09-19T05:34:06.859621+0000","last_clean":"2024-09-19T05:34:06.859621+0000","last_became_active":"2024-09-19T05:34:06.847844+0000","last_became_peered":"2024-09-19T05:34:06.847844+0000","last_unstale":"2024-09-19T05:34:06.859621+0000","last_undegraded":"2024-09-19T05:34:06.859621+0000","last_fullsized":"2024-09-19T05:34:06.859621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:47.344590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.826435+0000","last_change":"2024-09-19T05:34:06.826435+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.826435+0000","last_undegraded":"2024-09-19T05:34:06.826435+0000","last_fullsized":"2024-09-19T05:34:06.826435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.853027+0000","last_change":"2024-09-19T05:34:06.849562+0000","last_active":"2024-09-19T05:34:06.853027+0000","last_peered":"2024-09-19T05:34:06.853027+0000","last_clean":"2024-09-19T05:34:06.853027+0000","last_became_active":"2024-09-19T05:34:06.848829+0000","last_became_peered":"2024-09-19T05:34:06.848829+0000","last_unstale":"2024-09-19T05:34:06.853027+0000","last_undegraded":"2024-09-19T05:34:06.853027+0000","last_fullsized":"2024-09-19T05:34:06.853027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:56.835003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816398+0000","last_change":"2024-09-19T05:34:06.816398+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816398+0000","last_undegraded":"2024-09-19T05:34:06.816398+0000","last_fullsized":"2024-09-19T05:34:06.816398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.860008+0000","last_change":"2024-09-19T05:34:06.859213+0000","last_active":"2024-09-19T05:34:06.860008+0000","last_peered":"2024-09-19T05:34:06.860008+0000","last_clean":"2024-09-19T05:34:06.860008+0000","last_became_active":"2024-09-19T05:34:06.858840+0000","last_became_peered":"2024-09-19T05:34:06.858840+0000","last_unstale":"2024-09-19T05:34:06.860008+0000","last_undegraded":"2024-09-19T05:34:06.860008+0000","last_fullsized":"2024-09-19T05:34:06.860008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.248248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820128+0000","last_change":"2024-09-19T05:34:06.820128+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820128+0000","last_undegraded":"2024-09-19T05:34:06.820128+0000","last_fullsized":"2024-09-19T05:34:06.820128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.835427+0000","last_change":"2024-09-19T05:34:06.832278+0000","last_active":"2024-09-19T05:34:06.835427+0000","last_peered":"2024-09-19T05:34:06.835427+0000","last_clean":"2024-09-19T05:34:06.835427+0000","last_became_active":"2024-09-19T05:34:06.831901+0000","last_became_peered":"2024-09-19T05:34:06.831901+0000","last_unstale":"2024-09-19T05:34:06.835427+0000","last_undegraded":"2024-09-19T05:34:06.835427+0000","last_fullsized":"2024-09-19T05:34:06.835427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.823802+0000","last_change":"2024-09-19T05:34:06.823802+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.823802+0000","last_undegraded":"2024-09-19T05:34:06.823802+0000","last_fullsized":"2024-09-19T05:34:06.823802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.833632+0000","last_change":"2024-09-19T05:34:06.830513+0000","last_active":"2024-09-19T05:34:06.833632+0000","last_peered":"2024-09-19T05:34:06.833632+0000","last_clean":"2024-09-19T05:34:06.833632+0000","last_became_active":"2024-09-19T05:34:06.830201+0000","last_became_peered":"2024-09-19T05:34:06.830201+0000","last_unstale":"2024-09-19T05:34:06.833632+0000","last_undegraded":"2024-09-19T05:34:06.833632+0000","last_fullsized":"2024-09-19T05:34:06.833632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:15.697350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.819493+0000","last_change":"2024-09-19T05:34:06.819493+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.819493+0000","last_undegraded":"2024-09-19T05:34:06.819493+0000","last_fullsized":"2024-09-19T05:34:06.819493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.833978+0000","last_change":"2024-09-19T05:34:06.832694+0000","last_active":"2024-09-19T05:34:06.833978+0000","last_peered":"2024-09-19T05:34:06.833978+0000","last_clean":"2024-09-19T05:34:06.833978+0000","last_became_active":"2024-09-19T05:34:06.832147+0000","last_became_peered":"2024-09-19T05:34:06.832147+0000","last_unstale":"2024-09-19T05:34:06.833978+0000","last_undegraded":"2024-09-19T05:34:06.833978+0000","last_fullsized":"2024-09-19T05:34:06.833978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:28.098709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821025+0000","last_change":"2024-09-19T05:34:06.821025+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821025+0000","last_undegraded":"2024-09-19T05:34:06.821025+0000","last_fullsized":"2024-09-19T05:34:06.821025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.863501+0000","last_change":"2024-09-19T05:34:06.857960+0000","last_active":"2024-09-19T05:34:06.863501+0000","last_peered":"2024-09-19T05:34:06.863501+0000","last_clean":"2024-09-19T05:34:06.863501+0000","last_became_active":"2024-09-19T05:34:06.857184+0000","last_became_peered":"2024-09-19T05:34:06.857184+0000","last_unstale":"2024-09-19T05:34:06.863501+0000","last_undegraded":"2024-09-19T05:34:06.863501+0000","last_fullsized":"2024-09-19T05:34:06.863501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:45.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824342+0000","last_change":"2024-09-19T05:34:06.824342+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824342+0000","last_undegraded":"2024-09-19T05:34:06.824342+0000","last_fullsized":"2024-09-19T05:34:06.824342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.826810+0000","last_change":"2024-09-19T05:34:06.826244+0000","last_active":"2024-09-19T05:34:06.826810+0000","last_peered":"2024-09-19T05:34:06.826810+0000","last_clean":"2024-09-19T05:34:06.826810+0000","last_became_active":"2024-09-19T05:34:06.825918+0000","last_became_peered":"2024-09-19T05:34:06.825918+0000","last_unstale":"2024-09-19T05:34:06.826810+0000","last_undegraded":"2024-09-19T05:34:06.826810+0000","last_fullsized":"2024-09-19T05:34:06.826810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:13.779353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.821762+0000","last_change":"2024-09-19T05:34:06.821762+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.821762+0000","last_undegraded":"2024-09-19T05:34:06.821762+0000","last_fullsized":"2024-09-19T05:34:06.821762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.859669+0000","last_change":"2024-09-19T05:34:06.855068+0000","last_active":"2024-09-19T05:34:06.859669+0000","last_peered":"2024-09-19T05:34:06.859669+0000","last_clean":"2024-09-19T05:34:06.859669+0000","last_became_active":"2024-09-19T05:34:06.847302+0000","last_became_peered":"2024-09-19T05:34:06.847302+0000","last_unstale":"2024-09-19T05:34:06.859669+0000","last_undegraded":"2024-09-19T05:34:06.859669+0000","last_fullsized":"2024-09-19T05:34:06.859669+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:30.860434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.830904+0000","last_change":"2024-09-19T05:34:06.830904+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.830904+0000","last_undegraded":"2024-09-19T05:34:06.830904+0000","last_fullsized":"2024-09-19T05:34:06.830904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.854852+0000","last_change":"2024-09-19T05:34:06.850006+0000","last_active":"2024-09-19T05:34:06.854852+0000","last_peered":"2024-09-19T05:34:06.854852+0000","last_clean":"2024-09-19T05:34:06.854852+0000","last_became_active":"2024-09-19T05:34:06.849652+0000","last_became_peered":"2024-09-19T05:34:06.849652+0000","last_unstale":"2024-09-19T05:34:06.854852+0000","last_undegraded":"2024-09-19T05:34:06.854852+0000","last_fullsized":"2024-09-19T05:34:06.854852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:28.809771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829745+0000","last_change":"2024-09-19T05:34:06.829745+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829745+0000","last_undegraded":"2024-09-19T05:34:06.829745+0000","last_fullsized":"2024-09-19T05:34:06.829745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.834948+0000","last_change":"2024-09-19T05:34:06.831923+0000","last_active":"2024-09-19T05:34:06.834948+0000","last_peered":"2024-09-19T05:34:06.834948+0000","last_clean":"2024-09-19T05:34:06.834948+0000","last_became_active":"2024-09-19T05:34:06.831515+0000","last_became_peered":"2024-09-19T05:34:06.831515+0000","last_unstale":"2024-09-19T05:34:06.834948+0000","last_undegraded":"2024-09-19T05:34:06.834948+0000","last_fullsized":"2024-09-19T05:34:06.834948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:03.879574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820860+0000","last_change":"2024-09-19T05:34:06.820860+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820860+0000","last_undegraded":"2024-09-19T05:34:06.820860+0000","last_fullsized":"2024-09-19T05:34:06.820860+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850246+0000","last_change":"2024-09-19T05:34:06.842780+0000","last_active":"2024-09-19T05:34:06.850246+0000","last_peered":"2024-09-19T05:34:06.850246+0000","last_clean":"2024-09-19T05:34:06.850246+0000","last_became_active":"2024-09-19T05:34:06.838570+0000","last_became_peered":"2024-09-19T05:34:06.838570+0000","last_unstale":"2024-09-19T05:34:06.850246+0000","last_undegraded":"2024-09-19T05:34:06.850246+0000","last_fullsized":"2024-09-19T05:34:06.850246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:45.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.820223+0000","last_change":"2024-09-19T05:34:06.820223+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.820223+0000","last_undegraded":"2024-09-19T05:34:06.820223+0000","last_fullsized":"2024-09-19T05:34:06.820223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850634+0000","last_change":"2024-09-19T05:34:06.842616+0000","last_active":"2024-09-19T05:34:06.850634+0000","last_peered":"2024-09-19T05:34:06.850634+0000","last_clean":"2024-09-19T05:34:06.850634+0000","last_became_active":"2024-09-19T05:34:06.841906+0000","last_became_peered":"2024-09-19T05:34:06.841906+0000","last_unstale":"2024-09-19T05:34:06.850634+0000","last_undegraded":"2024-09-19T05:34:06.850634+0000","last_fullsized":"2024-09-19T05:34:06.850634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:50.764872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.816968+0000","last_change":"2024-09-19T05:34:06.816968+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.816968+0000","last_undegraded":"2024-09-19T05:34:06.816968+0000","last_fullsized":"2024-09-19T05:34:06.816968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.850808+0000","last_change":"2024-09-19T05:34:06.840695+0000","last_active":"2024-09-19T05:34:06.850808+0000","last_peered":"2024-09-19T05:34:06.850808+0000","last_clean":"2024-09-19T05:34:06.850808+0000","last_became_active":"2024-09-19T05:34:06.837229+0000","last_became_peered":"2024-09-19T05:34:06.837229+0000","last_unstale":"2024-09-19T05:34:06.850808+0000","last_undegraded":"2024-09-19T05:34:06.850808+0000","last_fullsized":"2024-09-19T05:34:06.850808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:17.675046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.829424+0000","last_change":"2024-09-19T05:34:06.829424+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.829424+0000","last_undegraded":"2024-09-19T05:34:06.829424+0000","last_fullsized":"2024-09-19T05:34:06.829424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.849102+0000","last_change":"2024-09-19T05:34:06.844825+0000","last_active":"2024-09-19T05:34:06.849102+0000","last_peered":"2024-09-19T05:34:06.849102+0000","last_clean":"2024-09-19T05:34:06.849102+0000","last_became_active":"2024-09-19T05:34:06.844291+0000","last_became_peered":"2024-09-19T05:34:06.844291+0000","last_unstale":"2024-09-19T05:34:06.849102+0000","last_undegraded":"2024-09-19T05:34:06.849102+0000","last_fullsized":"2024-09-19T05:34:06.849102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:02.484585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T05:34:06.824647+0000","last_change":"2024-09-19T05:34:06.824647+0000","last_active":"2024-09-19T05:34:06.803087+0000","last_peered":"2024-09-19T05:34:06.803087+0000","last_clean":"2024-09-19T05:34:06.803087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:34:06.824647+0000","last_undegraded":"2024-09-19T05:34:06.824647+0000","last_fullsized":"2024-09-19T05:34:06.824647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.864224+0000","last_change":"2024-09-19T05:34:06.859069+0000","last_active":"2024-09-19T05:34:06.864224+0000","last_peered":"2024-09-19T05:34:06.864224+0000","last_clean":"2024-09-19T05:34:06.864224+0000","last_became_active":"2024-09-19T05:34:06.858269+0000","last_became_peered":"2024-09-19T05:34:06.858269+0000","last_unstale":"2024-09-19T05:34:06.864224+0000","last_undegraded":"2024-09-19T05:34:06.864224+0000","last_fullsized":"2024-09-19T05:34:06.864224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:14.356013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T05:34:06.826217+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:34:06.826217+0000","last_peered":"2024-09-19T05:34:06.826217+0000","last_clean":"2024-09-19T05:34:06.826217+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:34:06.826217+0000","last_undegraded":"2024-09-19T05:34:06.826217+0000","last_fullsized":"2024-09-19T05:34:06.826217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":769758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":179390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":769758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:34:15.416 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:34:15.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faeaad57640 1 Processor -- start 2024-09-19T05:34:15.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faeaad57640 1 -- start start 2024-09-19T05:34:15.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faeaad57640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faea4162630 0x7faea4071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faeaad57640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea4162a10 0x7faea4072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faeaad57640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faea40cc3c0 0x7faea4166380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faeaad57640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7faea406ecc0 con 0x7faea40cc3c0 2024-09-19T05:34:15.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faeaad57640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7faea40cfe80 con 0x7faea4162630 2024-09-19T05:34:15.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faeaad57640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faea406ef50 con 0x7faea4162a10 2024-09-19T05:34:15.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea92f4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faea40cc3c0 0x7faea4166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea92f4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faea40cc3c0 0x7faea4166380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36696/0 (socket says 172.21.15.67:36696) 2024-09-19T05:34:15.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea92f4640 1 -- 172.21.15.67:0/2179891595 learned_addr learned my addr 172.21.15.67:0/2179891595 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:15.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea3fff640 1 --2- 172.21.15.67:0/2179891595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea4162a10 0x7faea4072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea8af3640 1 --2- 172.21.15.67:0/2179891595 >> v2:172.21.15.97:3300/0 conn(0x7faea4162630 0x7faea4071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea92f4640 1 -- 172.21.15.67:0/2179891595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea4162a10 msgr2=0x7faea4072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:15.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea92f4640 1 --2- 172.21.15.67:0/2179891595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea4162a10 0x7faea4072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea92f4640 1 -- 172.21.15.67:0/2179891595 >> v2:172.21.15.97:3300/0 conn(0x7faea4162630 msgr2=0x7faea4071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:15.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea92f4640 1 --2- 172.21.15.67:0/2179891595 >> v2:172.21.15.97:3300/0 conn(0x7faea4162630 0x7faea4071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea92f4640 1 -- 172.21.15.67:0/2179891595 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea406f230 con 0x7faea40cc3c0 2024-09-19T05:34:15.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.548+0000 7faea3fff640 1 --2- 172.21.15.67:0/2179891595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea4162a10 0x7faea4072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:34:15.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faea92f4640 1 --2- 172.21.15.67:0/2179891595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea40cc3c0 0x7faea4166380 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faea40744a0 tx=0x7fae9401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4e4246f88ad578 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:15.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faea37fe640 1 -- 172.21.15.67:0/2179891595 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae940ab620 con 0x7faea40cc3c0 2024-09-19T05:34:15.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faea37fe640 1 -- 172.21.15.67:0/2179891595 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae940b0070 con 0x7faea40cc3c0 2024-09-19T05:34:15.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faea37fe640 1 -- 172.21.15.67:0/2179891595 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae940ab9e0 con 0x7faea40cc3c0 2024-09-19T05:34:15.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 -- 172.21.15.67:0/2179891595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea40cc3c0 msgr2=0x7faea4166380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:15.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 --2- 172.21.15.67:0/2179891595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea40cc3c0 0x7faea4166380 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faea40744a0 tx=0x7fae9401c460 comp rx=0 tx=0).stop 2024-09-19T05:34:15.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 -- 172.21.15.67:0/2179891595 shutdown_connections 2024-09-19T05:34:15.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 --2- 172.21.15.67:0/2179891595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea40cc3c0 0x7faea4166380 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 --2- 172.21.15.67:0/2179891595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea4162a10 0x7faea4072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 --2- 172.21.15.67:0/2179891595 >> v2:172.21.15.97:3300/0 conn(0x7faea4162630 0x7faea4071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 -- 172.21.15.67:0/2179891595 >> 172.21.15.67:0/2179891595 conn(0x7faea40d0080 msgr2=0x7faea40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:15.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 -- 172.21.15.67:0/2179891595 shutdown_connections 2024-09-19T05:34:15.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 -- 172.21.15.67:0/2179891595 wait complete. 2024-09-19T05:34:15.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 Processor -- start 2024-09-19T05:34:15.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 -- start start 2024-09-19T05:34:15.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea40cc3c0 0x7faea414c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faea4162630 0x7faea415b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea4162a10 0x7faea409c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faea40b3710 con 0x7faea4162a10 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faea40b3590 con 0x7faea4162630 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.552+0000 7faeaad57640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faea40b3890 con 0x7faea40cc3c0 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea92f4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea4162a10 0x7faea409c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea92f4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea4162a10 0x7faea409c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36708/0 (socket says 172.21.15.67:36708) 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea92f4640 1 -- 172.21.15.67:0/884216466 learned_addr learned my addr 172.21.15.67:0/884216466 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea8af3640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea40cc3c0 0x7faea414c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea3fff640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faea4162630 0x7faea415b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea92f4640 1 -- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea40cc3c0 msgr2=0x7faea414c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea92f4640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea40cc3c0 0x7faea414c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea92f4640 1 -- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faea4162630 msgr2=0x7faea415b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea92f4640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faea4162630 0x7faea415b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea92f4640 1 -- 172.21.15.67:0/884216466 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea4165ff0 con 0x7faea4162a10 2024-09-19T05:34:15.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea3fff640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faea4162630 0x7faea415b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:34:15.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea92f4640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea4162a10 0x7faea409c110 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae940ad040 tx=0x7fae9401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:15.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea17fa640 1 -- 172.21.15.67:0/884216466 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae940abd50 con 0x7faea4162a10 2024-09-19T05:34:15.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea17fa640 1 -- 172.21.15.67:0/884216466 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae940be3f0 con 0x7faea4162a10 2024-09-19T05:34:15.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faeaad57640 1 -- 172.21.15.67:0/884216466 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea4165ab0 con 0x7faea4162a10 2024-09-19T05:34:15.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea17fa640 1 -- 172.21.15.67:0/884216466 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae940be7e0 con 0x7faea4162a10 2024-09-19T05:34:15.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faeaad57640 1 -- 172.21.15.67:0/884216466 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea409a5b0 con 0x7faea4162a10 2024-09-19T05:34:15.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faeaad57640 1 -- 172.21.15.67:0/884216466 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea4166380 con 0x7faea4162a10 2024-09-19T05:34:15.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea17fa640 1 -- 172.21.15.67:0/884216466 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae940c7440 con 0x7faea4162a10 2024-09-19T05:34:15.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea17fa640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fae880678c0 0x7fae88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea17fa640 1 -- 172.21.15.67:0/884216466 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fae941202b0 con 0x7faea4162a10 2024-09-19T05:34:15.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.556+0000 7faea8af3640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fae880678c0 0x7fae88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.560+0000 7faea8af3640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fae880678c0 0x7fae88069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00ba30 tx=0x7fae9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:15.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.560+0000 7faea17fa640 1 -- 172.21.15.67:0/884216466 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fae94016110 con 0x7faea4162a10 2024-09-19T05:34:15.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.720+0000 7faeaad57640 1 -- 172.21.15.67:0/884216466 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faea414c7d0 con 0x7fae880678c0 2024-09-19T05:34:15.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.736+0000 7faea17fa640 1 -- 172.21.15.67:0/884216466 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251971 (secure 0 0 0) 0x7fae9c00b620 con 0x7fae880678c0 2024-09-19T05:34:15.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:15.747 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 -- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fae880678c0 msgr2=0x7fae88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fae880678c0 0x7fae88069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00ba30 tx=0x7fae9c008040 comp rx=0 tx=0).stop 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 -- 172.21.15.67:0/884216466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea4162a10 msgr2=0x7faea409c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea4162a10 0x7faea409c110 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae940ad040 tx=0x7fae9401aca0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 -- 172.21.15.67:0/884216466 shutdown_connections 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faea4162a10 0x7faea409c110 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faea4162630 0x7faea415b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fae880678c0 0x7fae88069d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 --2- 172.21.15.67:0/884216466 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faea40cc3c0 0x7faea414c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 -- 172.21.15.67:0/884216466 >> 172.21.15.67:0/884216466 conn(0x7faea40d0080 msgr2=0x7faea40cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 -- 172.21.15.67:0/884216466 shutdown_connections 2024-09-19T05:34:15.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.740+0000 7faeaad57640 1 -- 172.21.15.67:0/884216466 wait complete. 2024-09-19T05:34:15.763 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-19T05:34:15.127129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220968,"kb_used_data":4712,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753752,"statfs":{"total":773094113280,"available":772867842048,"internally_reserved":0,"allocated":4825088,"data_stored":2731548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":74,"apply_latency_ms":74,"commit_latency_ns":74000000,"apply_latency_ns":74000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002668"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.834040+0000","last_change":"2024-09-19T05:34:07.852249+0000","last_active":"2024-09-19T05:34:08.834040+0000","last_peered":"2024-09-19T05:34:08.834040+0000","last_clean":"2024-09-19T05:34:08.834040+0000","last_became_active":"2024-09-19T05:34:07.851971+0000","last_became_peered":"2024-09-19T05:34:07.851971+0000","last_unstale":"2024-09-19T05:34:08.834040+0000","last_undegraded":"2024-09-19T05:34:08.834040+0000","last_fullsized":"2024-09-19T05:34:08.834040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:25.115869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.833531+0000","last_change":"2024-09-19T05:34:07.845387+0000","last_active":"2024-09-19T05:34:08.833531+0000","last_peered":"2024-09-19T05:34:08.833531+0000","last_clean":"2024-09-19T05:34:08.833531+0000","last_became_active":"2024-09-19T05:34:07.845110+0000","last_became_peered":"2024-09-19T05:34:07.845110+0000","last_unstale":"2024-09-19T05:34:08.833531+0000","last_undegraded":"2024-09-19T05:34:08.833531+0000","last_fullsized":"2024-09-19T05:34:08.833531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:16.561899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.331323+0000","last_change":"2024-09-19T05:34:07.882701+0000","last_active":"2024-09-19T05:34:09.331323+0000","last_peered":"2024-09-19T05:34:09.331323+0000","last_clean":"2024-09-19T05:34:09.331323+0000","last_became_active":"2024-09-19T05:34:07.882471+0000","last_became_peered":"2024-09-19T05:34:07.882471+0000","last_unstale":"2024-09-19T05:34:09.331323+0000","last_undegraded":"2024-09-19T05:34:09.331323+0000","last_fullsized":"2024-09-19T05:34:09.331323+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:58.742591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.832290+0000","last_change":"2024-09-19T05:34:07.898529+0000","last_active":"2024-09-19T05:34:08.832290+0000","last_peered":"2024-09-19T05:34:08.832290+0000","last_clean":"2024-09-19T05:34:08.832290+0000","last_became_active":"2024-09-19T05:34:07.897993+0000","last_became_peered":"2024-09-19T05:34:07.897993+0000","last_unstale":"2024-09-19T05:34:08.832290+0000","last_undegraded":"2024-09-19T05:34:08.832290+0000","last_fullsized":"2024-09-19T05:34:08.832290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:31.869298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.831887+0000","last_change":"2024-09-19T05:34:07.888889+0000","last_active":"2024-09-19T05:34:08.831887+0000","last_peered":"2024-09-19T05:34:08.831887+0000","last_clean":"2024-09-19T05:34:08.831887+0000","last_became_active":"2024-09-19T05:34:07.888613+0000","last_became_peered":"2024-09-19T05:34:07.888613+0000","last_unstale":"2024-09-19T05:34:08.831887+0000","last_undegraded":"2024-09-19T05:34:08.831887+0000","last_fullsized":"2024-09-19T05:34:08.831887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:33.074473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723993+0000","last_change":"2024-09-19T05:34:07.849683+0000","last_active":"2024-09-19T05:34:09.723993+0000","last_peered":"2024-09-19T05:34:09.723993+0000","last_clean":"2024-09-19T05:34:09.723993+0000","last_became_active":"2024-09-19T05:34:07.849365+0000","last_became_peered":"2024-09-19T05:34:07.849365+0000","last_unstale":"2024-09-19T05:34:09.723993+0000","last_undegraded":"2024-09-19T05:34:09.723993+0000","last_fullsized":"2024-09-19T05:34:09.723993+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:29.488715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723381+0000","last_change":"2024-09-19T05:34:07.873790+0000","last_active":"2024-09-19T05:34:09.723381+0000","last_peered":"2024-09-19T05:34:09.723381+0000","last_clean":"2024-09-19T05:34:09.723381+0000","last_became_active":"2024-09-19T05:34:07.866757+0000","last_became_peered":"2024-09-19T05:34:07.866757+0000","last_unstale":"2024-09-19T05:34:09.723381+0000","last_undegraded":"2024-09-19T05:34:09.723381+0000","last_fullsized":"2024-09-19T05:34:09.723381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:34.657909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.832879+0000","last_change":"2024-09-19T05:34:07.865257+0000","last_active":"2024-09-19T05:34:08.832879+0000","last_peered":"2024-09-19T05:34:08.832879+0000","last_clean":"2024-09-19T05:34:08.832879+0000","last_became_active":"2024-09-19T05:34:07.865031+0000","last_became_peered":"2024-09-19T05:34:07.865031+0000","last_unstale":"2024-09-19T05:34:08.832879+0000","last_undegraded":"2024-09-19T05:34:08.832879+0000","last_fullsized":"2024-09-19T05:34:08.832879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:34.210191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.331667+0000","last_change":"2024-09-19T05:34:07.881646+0000","last_active":"2024-09-19T05:34:09.331667+0000","last_peered":"2024-09-19T05:34:09.331667+0000","last_clean":"2024-09-19T05:34:09.331667+0000","last_became_active":"2024-09-19T05:34:07.881404+0000","last_became_peered":"2024-09-19T05:34:07.881404+0000","last_unstale":"2024-09-19T05:34:09.331667+0000","last_undegraded":"2024-09-19T05:34:09.331667+0000","last_fullsized":"2024-09-19T05:34:09.331667+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:51.285598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724398+0000","last_change":"2024-09-19T05:34:07.896126+0000","last_active":"2024-09-19T05:34:09.724398+0000","last_peered":"2024-09-19T05:34:09.724398+0000","last_clean":"2024-09-19T05:34:09.724398+0000","last_became_active":"2024-09-19T05:34:07.895478+0000","last_became_peered":"2024-09-19T05:34:07.895478+0000","last_unstale":"2024-09-19T05:34:09.724398+0000","last_undegraded":"2024-09-19T05:34:09.724398+0000","last_fullsized":"2024-09-19T05:34:09.724398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:35.988604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724324+0000","last_change":"2024-09-19T05:34:07.902415+0000","last_active":"2024-09-19T05:34:09.724324+0000","last_peered":"2024-09-19T05:34:09.724324+0000","last_clean":"2024-09-19T05:34:09.724324+0000","last_became_active":"2024-09-19T05:34:07.901927+0000","last_became_peered":"2024-09-19T05:34:07.901927+0000","last_unstale":"2024-09-19T05:34:09.724324+0000","last_undegraded":"2024-09-19T05:34:09.724324+0000","last_fullsized":"2024-09-19T05:34:09.724324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:10.207500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.331860+0000","last_change":"2024-09-19T05:34:07.853699+0000","last_active":"2024-09-19T05:34:09.331860+0000","last_peered":"2024-09-19T05:34:09.331860+0000","last_clean":"2024-09-19T05:34:09.331860+0000","last_became_active":"2024-09-19T05:34:07.853421+0000","last_became_peered":"2024-09-19T05:34:07.853421+0000","last_unstale":"2024-09-19T05:34:09.331860+0000","last_undegraded":"2024-09-19T05:34:09.331860+0000","last_fullsized":"2024-09-19T05:34:09.331860+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:02.686747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723760+0000","last_change":"2024-09-19T05:34:07.889805+0000","last_active":"2024-09-19T05:34:09.723760+0000","last_peered":"2024-09-19T05:34:09.723760+0000","last_clean":"2024-09-19T05:34:09.723760+0000","last_became_active":"2024-09-19T05:34:07.889066+0000","last_became_peered":"2024-09-19T05:34:07.889066+0000","last_unstale":"2024-09-19T05:34:09.723760+0000","last_undegraded":"2024-09-19T05:34:09.723760+0000","last_fullsized":"2024-09-19T05:34:09.723760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:23.593406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.834673+0000","last_change":"2024-09-19T05:34:07.894564+0000","last_active":"2024-09-19T05:34:08.834673+0000","last_peered":"2024-09-19T05:34:08.834673+0000","last_clean":"2024-09-19T05:34:08.834673+0000","last_became_active":"2024-09-19T05:34:07.891354+0000","last_became_peered":"2024-09-19T05:34:07.891354+0000","last_unstale":"2024-09-19T05:34:08.834673+0000","last_undegraded":"2024-09-19T05:34:08.834673+0000","last_fullsized":"2024-09-19T05:34:08.834673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:11.256031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723682+0000","last_change":"2024-09-19T05:34:07.874422+0000","last_active":"2024-09-19T05:34:09.723682+0000","last_peered":"2024-09-19T05:34:09.723682+0000","last_clean":"2024-09-19T05:34:09.723682+0000","last_became_active":"2024-09-19T05:34:07.866267+0000","last_became_peered":"2024-09-19T05:34:07.866267+0000","last_unstale":"2024-09-19T05:34:09.723682+0000","last_undegraded":"2024-09-19T05:34:09.723682+0000","last_fullsized":"2024-09-19T05:34:09.723682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:30.882311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.624652+0000","last_change":"2024-09-19T05:34:07.899580+0000","last_active":"2024-09-19T05:34:09.624652+0000","last_peered":"2024-09-19T05:34:09.624652+0000","last_clean":"2024-09-19T05:34:09.624652+0000","last_became_active":"2024-09-19T05:34:07.893116+0000","last_became_peered":"2024-09-19T05:34:07.893116+0000","last_unstale":"2024-09-19T05:34:09.624652+0000","last_undegraded":"2024-09-19T05:34:09.624652+0000","last_fullsized":"2024-09-19T05:34:09.624652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:58.742591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625427+0000","last_change":"2024-09-19T05:34:07.894591+0000","last_active":"2024-09-19T05:34:09.625427+0000","last_peered":"2024-09-19T05:34:09.625427+0000","last_clean":"2024-09-19T05:34:09.625427+0000","last_became_active":"2024-09-19T05:34:07.893966+0000","last_became_peered":"2024-09-19T05:34:07.893966+0000","last_unstale":"2024-09-19T05:34:09.625427+0000","last_undegraded":"2024-09-19T05:34:09.625427+0000","last_fullsized":"2024-09-19T05:34:09.625427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:46.555576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.097577+0000","last_change":"2024-09-19T05:34:07.893760+0000","last_active":"2024-09-19T05:34:09.097577+0000","last_peered":"2024-09-19T05:34:09.097577+0000","last_clean":"2024-09-19T05:34:09.097577+0000","last_became_active":"2024-09-19T05:34:07.892988+0000","last_became_peered":"2024-09-19T05:34:07.892988+0000","last_unstale":"2024-09-19T05:34:09.097577+0000","last_undegraded":"2024-09-19T05:34:09.097577+0000","last_fullsized":"2024-09-19T05:34:09.097577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:11.256031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.832226+0000","last_change":"2024-09-19T05:34:07.855831+0000","last_active":"2024-09-19T05:34:08.832226+0000","last_peered":"2024-09-19T05:34:08.832226+0000","last_clean":"2024-09-19T05:34:08.832226+0000","last_became_active":"2024-09-19T05:34:07.853677+0000","last_became_peered":"2024-09-19T05:34:07.853677+0000","last_unstale":"2024-09-19T05:34:08.832226+0000","last_undegraded":"2024-09-19T05:34:08.832226+0000","last_fullsized":"2024-09-19T05:34:08.832226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:48.353454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.097413+0000","last_change":"2024-09-19T05:34:07.892913+0000","last_active":"2024-09-19T05:34:09.097413+0000","last_peered":"2024-09-19T05:34:09.097413+0000","last_clean":"2024-09-19T05:34:09.097413+0000","last_became_active":"2024-09-19T05:34:07.892334+0000","last_became_peered":"2024-09-19T05:34:07.892334+0000","last_unstale":"2024-09-19T05:34:09.097413+0000","last_undegraded":"2024-09-19T05:34:09.097413+0000","last_fullsized":"2024-09-19T05:34:09.097413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:22.847239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723706+0000","last_change":"2024-09-19T05:34:07.865070+0000","last_active":"2024-09-19T05:34:09.723706+0000","last_peered":"2024-09-19T05:34:09.723706+0000","last_clean":"2024-09-19T05:34:09.723706+0000","last_became_active":"2024-09-19T05:34:07.864278+0000","last_became_peered":"2024-09-19T05:34:07.864278+0000","last_unstale":"2024-09-19T05:34:09.723706+0000","last_undegraded":"2024-09-19T05:34:09.723706+0000","last_fullsized":"2024-09-19T05:34:09.723706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:26.403264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.835372+0000","last_change":"2024-09-19T05:34:07.884882+0000","last_active":"2024-09-19T05:34:08.835372+0000","last_peered":"2024-09-19T05:34:08.835372+0000","last_clean":"2024-09-19T05:34:08.835372+0000","last_became_active":"2024-09-19T05:34:07.884070+0000","last_became_peered":"2024-09-19T05:34:07.884070+0000","last_unstale":"2024-09-19T05:34:08.835372+0000","last_undegraded":"2024-09-19T05:34:08.835372+0000","last_fullsized":"2024-09-19T05:34:08.835372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:03.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.624880+0000","last_change":"2024-09-19T05:34:07.878286+0000","last_active":"2024-09-19T05:34:09.624880+0000","last_peered":"2024-09-19T05:34:09.624880+0000","last_clean":"2024-09-19T05:34:09.624880+0000","last_became_active":"2024-09-19T05:34:07.877478+0000","last_became_peered":"2024-09-19T05:34:07.877478+0000","last_unstale":"2024-09-19T05:34:09.624880+0000","last_undegraded":"2024-09-19T05:34:09.624880+0000","last_fullsized":"2024-09-19T05:34:09.624880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:09.804846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.831792+0000","last_change":"2024-09-19T05:34:07.887096+0000","last_active":"2024-09-19T05:34:08.831792+0000","last_peered":"2024-09-19T05:34:08.831792+0000","last_clean":"2024-09-19T05:34:08.831792+0000","last_became_active":"2024-09-19T05:34:07.886820+0000","last_became_peered":"2024-09-19T05:34:07.886820+0000","last_unstale":"2024-09-19T05:34:08.831792+0000","last_undegraded":"2024-09-19T05:34:08.831792+0000","last_fullsized":"2024-09-19T05:34:08.831792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:38.538438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.097656+0000","last_change":"2024-09-19T05:34:07.855400+0000","last_active":"2024-09-19T05:34:09.097656+0000","last_peered":"2024-09-19T05:34:09.097656+0000","last_clean":"2024-09-19T05:34:09.097656+0000","last_became_active":"2024-09-19T05:34:07.853093+0000","last_became_peered":"2024-09-19T05:34:07.853093+0000","last_unstale":"2024-09-19T05:34:09.097656+0000","last_undegraded":"2024-09-19T05:34:09.097656+0000","last_fullsized":"2024-09-19T05:34:09.097656+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:03.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724714+0000","last_change":"2024-09-19T05:34:07.868314+0000","last_active":"2024-09-19T05:34:09.724714+0000","last_peered":"2024-09-19T05:34:09.724714+0000","last_clean":"2024-09-19T05:34:09.724714+0000","last_became_active":"2024-09-19T05:34:07.868037+0000","last_became_peered":"2024-09-19T05:34:07.868037+0000","last_unstale":"2024-09-19T05:34:09.724714+0000","last_undegraded":"2024-09-19T05:34:09.724714+0000","last_fullsized":"2024-09-19T05:34:09.724714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:02.686747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.097772+0000","last_change":"2024-09-19T05:34:07.848619+0000","last_active":"2024-09-19T05:34:09.097772+0000","last_peered":"2024-09-19T05:34:09.097772+0000","last_clean":"2024-09-19T05:34:09.097772+0000","last_became_active":"2024-09-19T05:34:07.847900+0000","last_became_peered":"2024-09-19T05:34:07.847900+0000","last_unstale":"2024-09-19T05:34:09.097772+0000","last_undegraded":"2024-09-19T05:34:09.097772+0000","last_fullsized":"2024-09-19T05:34:09.097772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:03.264340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724031+0000","last_change":"2024-09-19T05:34:07.872884+0000","last_active":"2024-09-19T05:34:09.724031+0000","last_peered":"2024-09-19T05:34:09.724031+0000","last_clean":"2024-09-19T05:34:09.724031+0000","last_became_active":"2024-09-19T05:34:07.864336+0000","last_became_peered":"2024-09-19T05:34:07.864336+0000","last_unstale":"2024-09-19T05:34:09.724031+0000","last_undegraded":"2024-09-19T05:34:09.724031+0000","last_fullsized":"2024-09-19T05:34:09.724031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:46.362863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.097299+0000","last_change":"2024-09-19T05:34:07.850817+0000","last_active":"2024-09-19T05:34:09.097299+0000","last_peered":"2024-09-19T05:34:09.097299+0000","last_clean":"2024-09-19T05:34:09.097299+0000","last_became_active":"2024-09-19T05:34:07.849929+0000","last_became_peered":"2024-09-19T05:34:07.849929+0000","last_unstale":"2024-09-19T05:34:09.097299+0000","last_undegraded":"2024-09-19T05:34:09.097299+0000","last_fullsized":"2024-09-19T05:34:09.097299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:38.527359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.097139+0000","last_change":"2024-09-19T05:34:07.853994+0000","last_active":"2024-09-19T05:34:09.097139+0000","last_peered":"2024-09-19T05:34:09.097139+0000","last_clean":"2024-09-19T05:34:09.097139+0000","last_became_active":"2024-09-19T05:34:07.850047+0000","last_became_peered":"2024-09-19T05:34:07.850047+0000","last_unstale":"2024-09-19T05:34:09.097139+0000","last_undegraded":"2024-09-19T05:34:09.097139+0000","last_fullsized":"2024-09-19T05:34:09.097139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:41.071547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.624998+0000","last_change":"2024-09-19T05:34:07.886165+0000","last_active":"2024-09-19T05:34:09.624998+0000","last_peered":"2024-09-19T05:34:09.624998+0000","last_clean":"2024-09-19T05:34:09.624998+0000","last_became_active":"2024-09-19T05:34:07.885554+0000","last_became_peered":"2024-09-19T05:34:07.885554+0000","last_unstale":"2024-09-19T05:34:09.624998+0000","last_undegraded":"2024-09-19T05:34:09.624998+0000","last_fullsized":"2024-09-19T05:34:09.624998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:51.285598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724021+0000","last_change":"2024-09-19T05:34:07.850880+0000","last_active":"2024-09-19T05:34:09.724021+0000","last_peered":"2024-09-19T05:34:09.724021+0000","last_clean":"2024-09-19T05:34:09.724021+0000","last_became_active":"2024-09-19T05:34:07.848952+0000","last_became_peered":"2024-09-19T05:34:07.848952+0000","last_unstale":"2024-09-19T05:34:09.724021+0000","last_undegraded":"2024-09-19T05:34:09.724021+0000","last_fullsized":"2024-09-19T05:34:09.724021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:58.742591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625704+0000","last_change":"2024-09-19T05:34:07.893232+0000","last_active":"2024-09-19T05:34:09.625704+0000","last_peered":"2024-09-19T05:34:09.625704+0000","last_clean":"2024-09-19T05:34:09.625704+0000","last_became_active":"2024-09-19T05:34:07.892285+0000","last_became_peered":"2024-09-19T05:34:07.892285+0000","last_unstale":"2024-09-19T05:34:09.625704+0000","last_undegraded":"2024-09-19T05:34:09.625704+0000","last_fullsized":"2024-09-19T05:34:09.625704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:31.526226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.097724+0000","last_change":"2024-09-19T05:34:06.852439+0000","last_active":"2024-09-19T05:34:09.097724+0000","last_peered":"2024-09-19T05:34:09.097724+0000","last_clean":"2024-09-19T05:34:09.097724+0000","last_became_active":"2024-09-19T05:34:06.851717+0000","last_became_peered":"2024-09-19T05:34:06.851717+0000","last_unstale":"2024-09-19T05:34:09.097724+0000","last_undegraded":"2024-09-19T05:34:09.097724+0000","last_fullsized":"2024-09-19T05:34:09.097724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:03.879574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724350+0000","last_change":"2024-09-19T05:34:07.882752+0000","last_active":"2024-09-19T05:34:09.724350+0000","last_peered":"2024-09-19T05:34:09.724350+0000","last_clean":"2024-09-19T05:34:09.724350+0000","last_became_active":"2024-09-19T05:34:07.882413+0000","last_became_peered":"2024-09-19T05:34:07.882413+0000","last_unstale":"2024-09-19T05:34:09.724350+0000","last_undegraded":"2024-09-19T05:34:09.724350+0000","last_fullsized":"2024-09-19T05:34:09.724350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:51.285598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.331388+0000","last_change":"2024-09-19T05:34:06.845116+0000","last_active":"2024-09-19T05:34:09.331388+0000","last_peered":"2024-09-19T05:34:09.331388+0000","last_clean":"2024-09-19T05:34:09.331388+0000","last_became_active":"2024-09-19T05:34:06.844043+0000","last_became_peered":"2024-09-19T05:34:06.844043+0000","last_unstale":"2024-09-19T05:34:09.331388+0000","last_undegraded":"2024-09-19T05:34:09.331388+0000","last_fullsized":"2024-09-19T05:34:09.331388+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:14.356013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.835885+0000","last_change":"2024-09-19T05:34:07.885858+0000","last_active":"2024-09-19T05:34:08.835885+0000","last_peered":"2024-09-19T05:34:08.835885+0000","last_clean":"2024-09-19T05:34:08.835885+0000","last_became_active":"2024-09-19T05:34:07.884998+0000","last_became_peered":"2024-09-19T05:34:07.884998+0000","last_unstale":"2024-09-19T05:34:08.835885+0000","last_undegraded":"2024-09-19T05:34:08.835885+0000","last_fullsized":"2024-09-19T05:34:08.835885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:13.252916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724702+0000","last_change":"2024-09-19T05:34:06.845387+0000","last_active":"2024-09-19T05:34:09.724702+0000","last_peered":"2024-09-19T05:34:09.724702+0000","last_clean":"2024-09-19T05:34:09.724702+0000","last_became_active":"2024-09-19T05:34:06.845018+0000","last_became_peered":"2024-09-19T05:34:06.845018+0000","last_unstale":"2024-09-19T05:34:09.724702+0000","last_undegraded":"2024-09-19T05:34:09.724702+0000","last_fullsized":"2024-09-19T05:34:09.724702+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:40.062683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.833463+0000","last_change":"2024-09-19T05:34:07.872562+0000","last_active":"2024-09-19T05:34:08.833463+0000","last_peered":"2024-09-19T05:34:08.833463+0000","last_clean":"2024-09-19T05:34:08.833463+0000","last_became_active":"2024-09-19T05:34:07.872235+0000","last_became_peered":"2024-09-19T05:34:07.872235+0000","last_unstale":"2024-09-19T05:34:08.833463+0000","last_undegraded":"2024-09-19T05:34:08.833463+0000","last_fullsized":"2024-09-19T05:34:08.833463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:15.287204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.834774+0000","last_change":"2024-09-19T05:34:06.849848+0000","last_active":"2024-09-19T05:34:08.834774+0000","last_peered":"2024-09-19T05:34:08.834774+0000","last_clean":"2024-09-19T05:34:08.834774+0000","last_became_active":"2024-09-19T05:34:06.849061+0000","last_became_peered":"2024-09-19T05:34:06.849061+0000","last_unstale":"2024-09-19T05:34:08.834774+0000","last_undegraded":"2024-09-19T05:34:08.834774+0000","last_fullsized":"2024-09-19T05:34:08.834774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:03.879574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.330824+0000","last_change":"2024-09-19T05:34:07.857306+0000","last_active":"2024-09-19T05:34:09.330824+0000","last_peered":"2024-09-19T05:34:09.330824+0000","last_clean":"2024-09-19T05:34:09.330824+0000","last_became_active":"2024-09-19T05:34:07.856995+0000","last_became_peered":"2024-09-19T05:34:07.856995+0000","last_unstale":"2024-09-19T05:34:09.330824+0000","last_undegraded":"2024-09-19T05:34:09.330824+0000","last_fullsized":"2024-09-19T05:34:09.330824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:43.698125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723981+0000","last_change":"2024-09-19T05:34:06.838559+0000","last_active":"2024-09-19T05:34:09.723981+0000","last_peered":"2024-09-19T05:34:09.723981+0000","last_clean":"2024-09-19T05:34:09.723981+0000","last_became_active":"2024-09-19T05:34:06.837817+0000","last_became_peered":"2024-09-19T05:34:06.837817+0000","last_unstale":"2024-09-19T05:34:09.723981+0000","last_undegraded":"2024-09-19T05:34:09.723981+0000","last_fullsized":"2024-09-19T05:34:09.723981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:23.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723874+0000","last_change":"2024-09-19T05:34:07.865508+0000","last_active":"2024-09-19T05:34:09.723874+0000","last_peered":"2024-09-19T05:34:09.723874+0000","last_clean":"2024-09-19T05:34:09.723874+0000","last_became_active":"2024-09-19T05:34:07.864543+0000","last_became_peered":"2024-09-19T05:34:07.864543+0000","last_unstale":"2024-09-19T05:34:09.723874+0000","last_undegraded":"2024-09-19T05:34:09.723874+0000","last_fullsized":"2024-09-19T05:34:09.723874+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:11.852337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625317+0000","last_change":"2024-09-19T05:34:06.859044+0000","last_active":"2024-09-19T05:34:09.625317+0000","last_peered":"2024-09-19T05:34:09.625317+0000","last_clean":"2024-09-19T05:34:09.625317+0000","last_became_active":"2024-09-19T05:34:06.858309+0000","last_became_peered":"2024-09-19T05:34:06.858309+0000","last_unstale":"2024-09-19T05:34:09.625317+0000","last_undegraded":"2024-09-19T05:34:09.625317+0000","last_fullsized":"2024-09-19T05:34:09.625317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:49.609195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.834674+0000","last_change":"2024-09-19T05:34:07.894534+0000","last_active":"2024-09-19T05:34:08.834674+0000","last_peered":"2024-09-19T05:34:08.834674+0000","last_clean":"2024-09-19T05:34:08.834674+0000","last_became_active":"2024-09-19T05:34:07.891248+0000","last_became_peered":"2024-09-19T05:34:07.891248+0000","last_unstale":"2024-09-19T05:34:08.834674+0000","last_undegraded":"2024-09-19T05:34:08.834674+0000","last_fullsized":"2024-09-19T05:34:08.834674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:41.681796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723937+0000","last_change":"2024-09-19T05:34:06.857190+0000","last_active":"2024-09-19T05:34:09.723937+0000","last_peered":"2024-09-19T05:34:09.723937+0000","last_clean":"2024-09-19T05:34:09.723937+0000","last_became_active":"2024-09-19T05:34:06.856825+0000","last_became_peered":"2024-09-19T05:34:06.856825+0000","last_unstale":"2024-09-19T05:34:09.723937+0000","last_undegraded":"2024-09-19T05:34:09.723937+0000","last_fullsized":"2024-09-19T05:34:09.723937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:37.518495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.833260+0000","last_change":"2024-09-19T05:34:07.888063+0000","last_active":"2024-09-19T05:34:08.833260+0000","last_peered":"2024-09-19T05:34:08.833260+0000","last_clean":"2024-09-19T05:34:08.833260+0000","last_became_active":"2024-09-19T05:34:07.887761+0000","last_became_peered":"2024-09-19T05:34:07.887761+0000","last_unstale":"2024-09-19T05:34:08.833260+0000","last_undegraded":"2024-09-19T05:34:08.833260+0000","last_fullsized":"2024-09-19T05:34:08.833260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:08.000129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.833969+0000","last_change":"2024-09-19T05:34:06.842643+0000","last_active":"2024-09-19T05:34:08.833969+0000","last_peered":"2024-09-19T05:34:08.833969+0000","last_clean":"2024-09-19T05:34:08.833969+0000","last_became_active":"2024-09-19T05:34:06.841913+0000","last_became_peered":"2024-09-19T05:34:06.841913+0000","last_unstale":"2024-09-19T05:34:08.833969+0000","last_undegraded":"2024-09-19T05:34:08.833969+0000","last_fullsized":"2024-09-19T05:34:08.833969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:22.661486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.832450+0000","last_change":"2024-09-19T05:34:07.898260+0000","last_active":"2024-09-19T05:34:08.832450+0000","last_peered":"2024-09-19T05:34:08.832450+0000","last_clean":"2024-09-19T05:34:08.832450+0000","last_became_active":"2024-09-19T05:34:07.897626+0000","last_became_peered":"2024-09-19T05:34:07.897626+0000","last_unstale":"2024-09-19T05:34:08.832450+0000","last_undegraded":"2024-09-19T05:34:08.832450+0000","last_fullsized":"2024-09-19T05:34:08.832450+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:24.463766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.833963+0000","last_change":"2024-09-19T05:34:06.841162+0000","last_active":"2024-09-19T05:34:08.833963+0000","last_peered":"2024-09-19T05:34:08.833963+0000","last_clean":"2024-09-19T05:34:08.833963+0000","last_became_active":"2024-09-19T05:34:06.840853+0000","last_became_peered":"2024-09-19T05:34:06.840853+0000","last_unstale":"2024-09-19T05:34:08.833963+0000","last_undegraded":"2024-09-19T05:34:08.833963+0000","last_fullsized":"2024-09-19T05:34:08.833963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:10.378721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625484+0000","last_change":"2024-09-19T05:34:07.887258+0000","last_active":"2024-09-19T05:34:09.625484+0000","last_peered":"2024-09-19T05:34:09.625484+0000","last_clean":"2024-09-19T05:34:09.625484+0000","last_became_active":"2024-09-19T05:34:07.886477+0000","last_became_peered":"2024-09-19T05:34:07.886477+0000","last_unstale":"2024-09-19T05:34:09.625484+0000","last_undegraded":"2024-09-19T05:34:09.625484+0000","last_fullsized":"2024-09-19T05:34:09.625484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:18.873997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724582+0000","last_change":"2024-09-19T05:34:06.853535+0000","last_active":"2024-09-19T05:34:09.724582+0000","last_peered":"2024-09-19T05:34:09.724582+0000","last_clean":"2024-09-19T05:34:09.724582+0000","last_became_active":"2024-09-19T05:34:06.847562+0000","last_became_peered":"2024-09-19T05:34:06.847562+0000","last_unstale":"2024-09-19T05:34:09.724582+0000","last_undegraded":"2024-09-19T05:34:09.724582+0000","last_fullsized":"2024-09-19T05:34:09.724582+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:34.250137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.331367+0000","last_change":"2024-09-19T05:34:07.892653+0000","last_active":"2024-09-19T05:34:09.331367+0000","last_peered":"2024-09-19T05:34:09.331367+0000","last_clean":"2024-09-19T05:34:09.331367+0000","last_became_active":"2024-09-19T05:34:07.892418+0000","last_became_peered":"2024-09-19T05:34:07.892418+0000","last_unstale":"2024-09-19T05:34:09.331367+0000","last_undegraded":"2024-09-19T05:34:09.331367+0000","last_fullsized":"2024-09-19T05:34:09.331367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:09.804846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724610+0000","last_change":"2024-09-19T05:34:06.848198+0000","last_active":"2024-09-19T05:34:09.724610+0000","last_peered":"2024-09-19T05:34:09.724610+0000","last_clean":"2024-09-19T05:34:09.724610+0000","last_became_active":"2024-09-19T05:34:06.847343+0000","last_became_peered":"2024-09-19T05:34:06.847343+0000","last_unstale":"2024-09-19T05:34:09.724610+0000","last_undegraded":"2024-09-19T05:34:09.724610+0000","last_fullsized":"2024-09-19T05:34:09.724610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:24.436429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.835411+0000","last_change":"2024-09-19T05:34:07.885924+0000","last_active":"2024-09-19T05:34:08.835411+0000","last_peered":"2024-09-19T05:34:08.835411+0000","last_clean":"2024-09-19T05:34:08.835411+0000","last_became_active":"2024-09-19T05:34:07.885102+0000","last_became_peered":"2024-09-19T05:34:07.885102+0000","last_unstale":"2024-09-19T05:34:08.835411+0000","last_undegraded":"2024-09-19T05:34:08.835411+0000","last_fullsized":"2024-09-19T05:34:08.835411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:03.264340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.834877+0000","last_change":"2024-09-19T05:34:06.860750+0000","last_active":"2024-09-19T05:34:08.834877+0000","last_peered":"2024-09-19T05:34:08.834877+0000","last_clean":"2024-09-19T05:34:08.834877+0000","last_became_active":"2024-09-19T05:34:06.860241+0000","last_became_peered":"2024-09-19T05:34:06.860241+0000","last_unstale":"2024-09-19T05:34:08.834877+0000","last_undegraded":"2024-09-19T05:34:08.834877+0000","last_fullsized":"2024-09-19T05:34:08.834877+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:42.689261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.330854+0000","last_change":"2024-09-19T05:34:07.881765+0000","last_active":"2024-09-19T05:34:09.330854+0000","last_peered":"2024-09-19T05:34:09.330854+0000","last_clean":"2024-09-19T05:34:09.330854+0000","last_became_active":"2024-09-19T05:34:07.881461+0000","last_became_peered":"2024-09-19T05:34:07.881461+0000","last_unstale":"2024-09-19T05:34:09.330854+0000","last_undegraded":"2024-09-19T05:34:09.330854+0000","last_fullsized":"2024-09-19T05:34:09.330854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:13.252916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.833844+0000","last_change":"2024-09-19T05:34:06.843826+0000","last_active":"2024-09-19T05:34:08.833844+0000","last_peered":"2024-09-19T05:34:08.833844+0000","last_clean":"2024-09-19T05:34:08.833844+0000","last_became_active":"2024-09-19T05:34:06.843513+0000","last_became_peered":"2024-09-19T05:34:06.843513+0000","last_unstale":"2024-09-19T05:34:08.833844+0000","last_undegraded":"2024-09-19T05:34:08.833844+0000","last_fullsized":"2024-09-19T05:34:08.833844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:12.244052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.832975+0000","last_change":"2024-09-19T05:34:07.851781+0000","last_active":"2024-09-19T05:34:08.832975+0000","last_peered":"2024-09-19T05:34:08.832975+0000","last_clean":"2024-09-19T05:34:08.832975+0000","last_became_active":"2024-09-19T05:34:07.851476+0000","last_became_peered":"2024-09-19T05:34:07.851476+0000","last_unstale":"2024-09-19T05:34:08.832975+0000","last_undegraded":"2024-09-19T05:34:08.832975+0000","last_fullsized":"2024-09-19T05:34:08.832975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:48.393489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724300+0000","last_change":"2024-09-19T05:34:06.848974+0000","last_active":"2024-09-19T05:34:09.724300+0000","last_peered":"2024-09-19T05:34:09.724300+0000","last_clean":"2024-09-19T05:34:09.724300+0000","last_became_active":"2024-09-19T05:34:06.848530+0000","last_became_peered":"2024-09-19T05:34:06.848530+0000","last_unstale":"2024-09-19T05:34:09.724300+0000","last_undegraded":"2024-09-19T05:34:09.724300+0000","last_fullsized":"2024-09-19T05:34:09.724300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:21.838375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625035+0000","last_change":"2024-09-19T05:34:07.877390+0000","last_active":"2024-09-19T05:34:09.625035+0000","last_peered":"2024-09-19T05:34:09.625035+0000","last_clean":"2024-09-19T05:34:09.625035+0000","last_became_active":"2024-09-19T05:34:07.876679+0000","last_became_peered":"2024-09-19T05:34:07.876679+0000","last_unstale":"2024-09-19T05:34:09.625035+0000","last_undegraded":"2024-09-19T05:34:09.625035+0000","last_fullsized":"2024-09-19T05:34:09.625035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:02.686747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.096763+0000","last_change":"2024-09-19T05:34:06.834851+0000","last_active":"2024-09-19T05:34:09.096763+0000","last_peered":"2024-09-19T05:34:09.096763+0000","last_clean":"2024-09-19T05:34:09.096763+0000","last_became_active":"2024-09-19T05:34:06.833971+0000","last_became_peered":"2024-09-19T05:34:06.833971+0000","last_unstale":"2024-09-19T05:34:09.096763+0000","last_undegraded":"2024-09-19T05:34:09.096763+0000","last_fullsized":"2024-09-19T05:34:09.096763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:34.095147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.833375+0000","last_change":"2024-09-19T05:34:07.854272+0000","last_active":"2024-09-19T05:34:08.833375+0000","last_peered":"2024-09-19T05:34:08.833375+0000","last_clean":"2024-09-19T05:34:08.833375+0000","last_became_active":"2024-09-19T05:34:07.853990+0000","last_became_peered":"2024-09-19T05:34:07.853990+0000","last_unstale":"2024-09-19T05:34:08.833375+0000","last_undegraded":"2024-09-19T05:34:08.833375+0000","last_fullsized":"2024-09-19T05:34:08.833375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:13.629543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.624741+0000","last_change":"2024-09-19T05:34:06.845734+0000","last_active":"2024-09-19T05:34:09.624741+0000","last_peered":"2024-09-19T05:34:09.624741+0000","last_clean":"2024-09-19T05:34:09.624741+0000","last_became_active":"2024-09-19T05:34:06.845025+0000","last_became_peered":"2024-09-19T05:34:06.845025+0000","last_unstale":"2024-09-19T05:34:09.624741+0000","last_undegraded":"2024-09-19T05:34:09.624741+0000","last_fullsized":"2024-09-19T05:34:09.624741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:06.614893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.834541+0000","last_change":"2024-09-19T05:34:07.850018+0000","last_active":"2024-09-19T05:34:08.834541+0000","last_peered":"2024-09-19T05:34:08.834541+0000","last_clean":"2024-09-19T05:34:08.834541+0000","last_became_active":"2024-09-19T05:34:07.849777+0000","last_became_peered":"2024-09-19T05:34:07.849777+0000","last_unstale":"2024-09-19T05:34:08.834541+0000","last_undegraded":"2024-09-19T05:34:08.834541+0000","last_fullsized":"2024-09-19T05:34:08.834541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:58.265166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724550+0000","last_change":"2024-09-19T05:34:06.854395+0000","last_active":"2024-09-19T05:34:09.724550+0000","last_peered":"2024-09-19T05:34:09.724550+0000","last_clean":"2024-09-19T05:34:09.724550+0000","last_became_active":"2024-09-19T05:34:06.847844+0000","last_became_peered":"2024-09-19T05:34:06.847844+0000","last_unstale":"2024-09-19T05:34:09.724550+0000","last_undegraded":"2024-09-19T05:34:09.724550+0000","last_fullsized":"2024-09-19T05:34:09.724550+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:55.415736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724395+0000","last_change":"2024-09-19T05:34:07.880457+0000","last_active":"2024-09-19T05:34:09.724395+0000","last_peered":"2024-09-19T05:34:09.724395+0000","last_clean":"2024-09-19T05:34:09.724395+0000","last_became_active":"2024-09-19T05:34:07.864689+0000","last_became_peered":"2024-09-19T05:34:07.864689+0000","last_unstale":"2024-09-19T05:34:09.724395+0000","last_undegraded":"2024-09-19T05:34:09.724395+0000","last_fullsized":"2024-09-19T05:34:09.724395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:18.098195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.836034+0000","last_change":"2024-09-19T05:34:06.849562+0000","last_active":"2024-09-19T05:34:08.836034+0000","last_peered":"2024-09-19T05:34:08.836034+0000","last_clean":"2024-09-19T05:34:08.836034+0000","last_became_active":"2024-09-19T05:34:06.848829+0000","last_became_peered":"2024-09-19T05:34:06.848829+0000","last_unstale":"2024-09-19T05:34:08.836034+0000","last_undegraded":"2024-09-19T05:34:08.836034+0000","last_fullsized":"2024-09-19T05:34:08.836034+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:45.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.835471+0000","last_change":"2024-09-19T05:34:07.890666+0000","last_active":"2024-09-19T05:34:08.835471+0000","last_peered":"2024-09-19T05:34:08.835471+0000","last_clean":"2024-09-19T05:34:08.835471+0000","last_became_active":"2024-09-19T05:34:07.886253+0000","last_became_peered":"2024-09-19T05:34:07.886253+0000","last_unstale":"2024-09-19T05:34:08.835471+0000","last_undegraded":"2024-09-19T05:34:08.835471+0000","last_fullsized":"2024-09-19T05:34:08.835471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:43.698125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.832286+0000","last_change":"2024-09-19T05:34:06.859213+0000","last_active":"2024-09-19T05:34:08.832286+0000","last_peered":"2024-09-19T05:34:08.832286+0000","last_clean":"2024-09-19T05:34:08.832286+0000","last_became_active":"2024-09-19T05:34:06.858840+0000","last_became_peered":"2024-09-19T05:34:06.858840+0000","last_unstale":"2024-09-19T05:34:08.832286+0000","last_undegraded":"2024-09-19T05:34:08.832286+0000","last_fullsized":"2024-09-19T05:34:08.832286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:06.524699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.832410+0000","last_change":"2024-09-19T05:34:07.845603+0000","last_active":"2024-09-19T05:34:08.832410+0000","last_peered":"2024-09-19T05:34:08.832410+0000","last_clean":"2024-09-19T05:34:08.832410+0000","last_became_active":"2024-09-19T05:34:07.845181+0000","last_became_peered":"2024-09-19T05:34:07.845181+0000","last_unstale":"2024-09-19T05:34:08.832410+0000","last_undegraded":"2024-09-19T05:34:08.832410+0000","last_fullsized":"2024-09-19T05:34:08.832410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:19.245322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723943+0000","last_change":"2024-09-19T05:34:06.832278+0000","last_active":"2024-09-19T05:34:09.723943+0000","last_peered":"2024-09-19T05:34:09.723943+0000","last_clean":"2024-09-19T05:34:09.723943+0000","last_became_active":"2024-09-19T05:34:06.831901+0000","last_became_peered":"2024-09-19T05:34:06.831901+0000","last_unstale":"2024-09-19T05:34:09.723943+0000","last_undegraded":"2024-09-19T05:34:09.723943+0000","last_fullsized":"2024-09-19T05:34:09.723943+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:06.614893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625041+0000","last_change":"2024-09-19T05:34:07.886784+0000","last_active":"2024-09-19T05:34:09.625041+0000","last_peered":"2024-09-19T05:34:09.625041+0000","last_clean":"2024-09-19T05:34:09.625041+0000","last_became_active":"2024-09-19T05:34:07.886213+0000","last_became_peered":"2024-09-19T05:34:07.886213+0000","last_unstale":"2024-09-19T05:34:09.625041+0000","last_undegraded":"2024-09-19T05:34:09.625041+0000","last_fullsized":"2024-09-19T05:34:09.625041+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:50:54.028443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.831953+0000","last_change":"2024-09-19T05:34:06.830513+0000","last_active":"2024-09-19T05:34:08.831953+0000","last_peered":"2024-09-19T05:34:08.831953+0000","last_clean":"2024-09-19T05:34:08.831953+0000","last_became_active":"2024-09-19T05:34:06.830201+0000","last_became_peered":"2024-09-19T05:34:06.830201+0000","last_unstale":"2024-09-19T05:34:08.831953+0000","last_undegraded":"2024-09-19T05:34:08.831953+0000","last_fullsized":"2024-09-19T05:34:08.831953+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:51.079713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.331083+0000","last_change":"2024-09-19T05:34:07.888120+0000","last_active":"2024-09-19T05:34:09.331083+0000","last_peered":"2024-09-19T05:34:09.331083+0000","last_clean":"2024-09-19T05:34:09.331083+0000","last_became_active":"2024-09-19T05:34:07.887784+0000","last_became_peered":"2024-09-19T05:34:07.887784+0000","last_unstale":"2024-09-19T05:34:09.331083+0000","last_undegraded":"2024-09-19T05:34:09.331083+0000","last_fullsized":"2024-09-19T05:34:09.331083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:11.387585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.832281+0000","last_change":"2024-09-19T05:34:06.832694+0000","last_active":"2024-09-19T05:34:08.832281+0000","last_peered":"2024-09-19T05:34:08.832281+0000","last_clean":"2024-09-19T05:34:08.832281+0000","last_became_active":"2024-09-19T05:34:06.832147+0000","last_became_peered":"2024-09-19T05:34:06.832147+0000","last_unstale":"2024-09-19T05:34:08.832281+0000","last_undegraded":"2024-09-19T05:34:08.832281+0000","last_fullsized":"2024-09-19T05:34:08.832281+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:29.923373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723731+0000","last_change":"2024-09-19T05:34:07.881722+0000","last_active":"2024-09-19T05:34:09.723731+0000","last_peered":"2024-09-19T05:34:09.723731+0000","last_clean":"2024-09-19T05:34:09.723731+0000","last_became_active":"2024-09-19T05:34:07.880964+0000","last_became_peered":"2024-09-19T05:34:07.880964+0000","last_unstale":"2024-09-19T05:34:09.723731+0000","last_undegraded":"2024-09-19T05:34:09.723731+0000","last_fullsized":"2024-09-19T05:34:09.723731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:58.020526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625151+0000","last_change":"2024-09-19T05:34:06.857960+0000","last_active":"2024-09-19T05:34:09.625151+0000","last_peered":"2024-09-19T05:34:09.625151+0000","last_clean":"2024-09-19T05:34:09.625151+0000","last_became_active":"2024-09-19T05:34:06.857184+0000","last_became_peered":"2024-09-19T05:34:06.857184+0000","last_unstale":"2024-09-19T05:34:09.625151+0000","last_undegraded":"2024-09-19T05:34:09.625151+0000","last_fullsized":"2024-09-19T05:34:09.625151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:14.348193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.833719+0000","last_change":"2024-09-19T05:34:07.877971+0000","last_active":"2024-09-19T05:34:08.833719+0000","last_peered":"2024-09-19T05:34:08.833719+0000","last_clean":"2024-09-19T05:34:08.833719+0000","last_became_active":"2024-09-19T05:34:07.877696+0000","last_became_peered":"2024-09-19T05:34:07.877696+0000","last_unstale":"2024-09-19T05:34:08.833719+0000","last_undegraded":"2024-09-19T05:34:08.833719+0000","last_fullsized":"2024-09-19T05:34:08.833719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.444495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.831895+0000","last_change":"2024-09-19T05:34:06.826244+0000","last_active":"2024-09-19T05:34:08.831895+0000","last_peered":"2024-09-19T05:34:08.831895+0000","last_clean":"2024-09-19T05:34:08.831895+0000","last_became_active":"2024-09-19T05:34:06.825918+0000","last_became_peered":"2024-09-19T05:34:06.825918+0000","last_unstale":"2024-09-19T05:34:08.831895+0000","last_undegraded":"2024-09-19T05:34:08.831895+0000","last_fullsized":"2024-09-19T05:34:08.831895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:37.649933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724223+0000","last_change":"2024-09-19T05:34:07.876363+0000","last_active":"2024-09-19T05:34:09.724223+0000","last_peered":"2024-09-19T05:34:09.724223+0000","last_clean":"2024-09-19T05:34:09.724223+0000","last_became_active":"2024-09-19T05:34:07.876024+0000","last_became_peered":"2024-09-19T05:34:07.876024+0000","last_unstale":"2024-09-19T05:34:09.724223+0000","last_undegraded":"2024-09-19T05:34:09.724223+0000","last_fullsized":"2024-09-19T05:34:09.724223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:09.804846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724764+0000","last_change":"2024-09-19T05:34:06.855068+0000","last_active":"2024-09-19T05:34:09.724764+0000","last_peered":"2024-09-19T05:34:09.724764+0000","last_clean":"2024-09-19T05:34:09.724764+0000","last_became_active":"2024-09-19T05:34:06.847302+0000","last_became_peered":"2024-09-19T05:34:06.847302+0000","last_unstale":"2024-09-19T05:34:09.724764+0000","last_undegraded":"2024-09-19T05:34:09.724764+0000","last_fullsized":"2024-09-19T05:34:09.724764+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:07.236229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625619+0000","last_change":"2024-09-19T05:34:07.891741+0000","last_active":"2024-09-19T05:34:09.625619+0000","last_peered":"2024-09-19T05:34:09.625619+0000","last_clean":"2024-09-19T05:34:09.625619+0000","last_became_active":"2024-09-19T05:34:07.887269+0000","last_became_peered":"2024-09-19T05:34:07.887269+0000","last_unstale":"2024-09-19T05:34:09.625619+0000","last_undegraded":"2024-09-19T05:34:09.625619+0000","last_fullsized":"2024-09-19T05:34:09.625619+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:05.909286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.833025+0000","last_change":"2024-09-19T05:34:06.850006+0000","last_active":"2024-09-19T05:34:08.833025+0000","last_peered":"2024-09-19T05:34:08.833025+0000","last_clean":"2024-09-19T05:34:08.833025+0000","last_became_active":"2024-09-19T05:34:06.849652+0000","last_became_peered":"2024-09-19T05:34:06.849652+0000","last_unstale":"2024-09-19T05:34:08.833025+0000","last_undegraded":"2024-09-19T05:34:08.833025+0000","last_fullsized":"2024-09-19T05:34:08.833025+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:30.679123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.833948+0000","last_change":"2024-09-19T05:34:07.897832+0000","last_active":"2024-09-19T05:34:08.833948+0000","last_peered":"2024-09-19T05:34:08.833948+0000","last_clean":"2024-09-19T05:34:08.833948+0000","last_became_active":"2024-09-19T05:34:07.897553+0000","last_became_peered":"2024-09-19T05:34:07.897553+0000","last_unstale":"2024-09-19T05:34:08.833948+0000","last_undegraded":"2024-09-19T05:34:08.833948+0000","last_fullsized":"2024-09-19T05:34:08.833948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:42.329177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.331582+0000","last_change":"2024-09-19T05:34:06.831923+0000","last_active":"2024-09-19T05:34:09.331582+0000","last_peered":"2024-09-19T05:34:09.331582+0000","last_clean":"2024-09-19T05:34:09.331582+0000","last_became_active":"2024-09-19T05:34:06.831515+0000","last_became_peered":"2024-09-19T05:34:06.831515+0000","last_unstale":"2024-09-19T05:34:09.331582+0000","last_undegraded":"2024-09-19T05:34:09.331582+0000","last_fullsized":"2024-09-19T05:34:09.331582+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:49.609195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.331298+0000","last_change":"2024-09-19T05:34:07.849967+0000","last_active":"2024-09-19T05:34:09.331298+0000","last_peered":"2024-09-19T05:34:09.331298+0000","last_clean":"2024-09-19T05:34:09.331298+0000","last_became_active":"2024-09-19T05:34:07.849674+0000","last_became_peered":"2024-09-19T05:34:07.849674+0000","last_unstale":"2024-09-19T05:34:09.331298+0000","last_undegraded":"2024-09-19T05:34:09.331298+0000","last_fullsized":"2024-09-19T05:34:09.331298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:29.488715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.331665+0000","last_change":"2024-09-19T05:34:06.842780+0000","last_active":"2024-09-19T05:34:09.331665+0000","last_peered":"2024-09-19T05:34:09.331665+0000","last_clean":"2024-09-19T05:34:09.331665+0000","last_became_active":"2024-09-19T05:34:06.838570+0000","last_became_peered":"2024-09-19T05:34:06.838570+0000","last_unstale":"2024-09-19T05:34:09.331665+0000","last_undegraded":"2024-09-19T05:34:09.331665+0000","last_fullsized":"2024-09-19T05:34:09.331665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:32.836196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.723951+0000","last_change":"2024-09-19T05:34:07.872611+0000","last_active":"2024-09-19T05:34:09.723951+0000","last_peered":"2024-09-19T05:34:09.723951+0000","last_clean":"2024-09-19T05:34:09.723951+0000","last_became_active":"2024-09-19T05:34:07.872274+0000","last_became_peered":"2024-09-19T05:34:07.872274+0000","last_unstale":"2024-09-19T05:34:09.723951+0000","last_undegraded":"2024-09-19T05:34:09.723951+0000","last_fullsized":"2024-09-19T05:34:09.723951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:11.387585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.097011+0000","last_change":"2024-09-19T05:34:06.842616+0000","last_active":"2024-09-19T05:34:09.097011+0000","last_peered":"2024-09-19T05:34:09.097011+0000","last_clean":"2024-09-19T05:34:09.097011+0000","last_became_active":"2024-09-19T05:34:06.841906+0000","last_became_peered":"2024-09-19T05:34:06.841906+0000","last_unstale":"2024-09-19T05:34:09.097011+0000","last_undegraded":"2024-09-19T05:34:09.097011+0000","last_fullsized":"2024-09-19T05:34:09.097011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:22.661486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.834240+0000","last_change":"2024-09-19T05:34:07.895029+0000","last_active":"2024-09-19T05:34:08.834240+0000","last_peered":"2024-09-19T05:34:08.834240+0000","last_clean":"2024-09-19T05:34:08.834240+0000","last_became_active":"2024-09-19T05:34:07.891967+0000","last_became_peered":"2024-09-19T05:34:07.891967+0000","last_unstale":"2024-09-19T05:34:08.834240+0000","last_undegraded":"2024-09-19T05:34:08.834240+0000","last_fullsized":"2024-09-19T05:34:08.834240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:22.847239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.834225+0000","last_change":"2024-09-19T05:34:06.840695+0000","last_active":"2024-09-19T05:34:08.834225+0000","last_peered":"2024-09-19T05:34:08.834225+0000","last_clean":"2024-09-19T05:34:08.834225+0000","last_became_active":"2024-09-19T05:34:06.837229+0000","last_became_peered":"2024-09-19T05:34:06.837229+0000","last_unstale":"2024-09-19T05:34:08.834225+0000","last_undegraded":"2024-09-19T05:34:08.834225+0000","last_fullsized":"2024-09-19T05:34:08.834225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:32.687958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625939+0000","last_change":"2024-09-19T05:34:07.891176+0000","last_active":"2024-09-19T05:34:09.625939+0000","last_peered":"2024-09-19T05:34:09.625939+0000","last_clean":"2024-09-19T05:34:09.625939+0000","last_became_active":"2024-09-19T05:34:07.887110+0000","last_became_peered":"2024-09-19T05:34:07.887110+0000","last_unstale":"2024-09-19T05:34:09.625939+0000","last_undegraded":"2024-09-19T05:34:09.625939+0000","last_fullsized":"2024-09-19T05:34:09.625939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:09.914798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:08.832988+0000","last_change":"2024-09-19T05:34:06.844825+0000","last_active":"2024-09-19T05:34:08.832988+0000","last_peered":"2024-09-19T05:34:08.832988+0000","last_clean":"2024-09-19T05:34:08.832988+0000","last_became_active":"2024-09-19T05:34:06.844291+0000","last_became_peered":"2024-09-19T05:34:06.844291+0000","last_unstale":"2024-09-19T05:34:08.832988+0000","last_undegraded":"2024-09-19T05:34:08.832988+0000","last_fullsized":"2024-09-19T05:34:08.832988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:40.672932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.724495+0000","last_change":"2024-09-19T05:34:07.873273+0000","last_active":"2024-09-19T05:34:09.724495+0000","last_peered":"2024-09-19T05:34:09.724495+0000","last_clean":"2024-09-19T05:34:09.724495+0000","last_became_active":"2024-09-19T05:34:07.865738+0000","last_became_peered":"2024-09-19T05:34:07.865738+0000","last_unstale":"2024-09-19T05:34:09.724495+0000","last_undegraded":"2024-09-19T05:34:09.724495+0000","last_fullsized":"2024-09-19T05:34:09.724495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:06.803087+0000","last_clean_scrub_stamp":"2024-09-19T05:34:06.803087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:36.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625675+0000","last_change":"2024-09-19T05:34:06.859069+0000","last_active":"2024-09-19T05:34:09.625675+0000","last_peered":"2024-09-19T05:34:09.625675+0000","last_clean":"2024-09-19T05:34:09.625675+0000","last_became_active":"2024-09-19T05:34:06.858269+0000","last_became_peered":"2024-09-19T05:34:06.858269+0000","last_unstale":"2024-09-19T05:34:09.625675+0000","last_undegraded":"2024-09-19T05:34:09.625675+0000","last_fullsized":"2024-09-19T05:34:09.625675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:34:05.794223+0000","last_clean_scrub_stamp":"2024-09-19T05:34:05.794223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:32.836196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T05:34:09.625050+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:34:09.625050+0000","last_peered":"2024-09-19T05:34:09.625050+0000","last_clean":"2024-09-19T05:34:09.625050+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:34:09.625050+0000","last_undegraded":"2024-09-19T05:34:09.625050+0000","last_fullsized":"2024-09-19T05:34:09.625050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1056768,"data_stored":785299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":193831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":454656,"data_stored":193361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":454656,"data_stored":193853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":194895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":450560,"data_stored":193319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":193339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1044480,"data_stored":783651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:34:15.767 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:34:15.767 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:34:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b96f7640 1 Processor -- start 2024-09-19T05:34:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b96f7640 1 -- start start 2024-09-19T05:34:15.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b96f7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b40cd110 0x7f97b409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b96f7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97b40cd590 con 0x7f97b415e4b0 2024-09-19T05:34:15.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b96f7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97b40cd870 con 0x7f97b409af70 2024-09-19T05:34:15.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b96f7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f97b415e890 con 0x7f97b40cd110 2024-09-19T05:34:15.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b2ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f97b415e4b0 0x7f97b415f420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34794/0 (socket says 172.21.15.67:34794) 2024-09-19T05:34:15.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b2ffd640 1 -- 172.21.15.67:0/3110409812 learned_addr learned my addr 172.21.15.67:0/3110409812 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:15.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340897328 0 0) 0x7f97b40cd590 con 0x7f97b415e4b0 2024-09-19T05:34:15.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f979c003530 con 0x7f97b415e4b0 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b27fc640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b40cd110 0x7f97b409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1809452040 0 0) 0x7f979c003530 con 0x7f97b415e4b0 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b40cd110 msgr2=0x7f97b409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b40cd110 0x7f97b409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 >> v1:172.21.15.97:6789/0 conn(0x7f97b409af70 legacy=0x7f97b40cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b40cdb50 con 0x7f97b415e4b0 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f97a4001680 con 0x7f97b415e4b0 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 >> v1:172.21.15.67:6789/0 conn(0x7f97b415e4b0 legacy=0x7f97b415f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f979c0039f0 0x7f979c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b40cd110 0x7f979c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f979c004d50 0x7f979c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97b415e890 con 0x7f979c004d50 2024-09-19T05:34:15.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f979c00bab0 con 0x7f979c0039f0 2024-09-19T05:34:15.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f979c00bcb0 con 0x7f97b40cd110 2024-09-19T05:34:15.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b37fe640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f979c004d50 0x7f979c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b27fc640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b40cd110 0x7f979c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b2ffd640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f979c0039f0 0x7f979c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b37fe640 1 -- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b40cd110 msgr2=0x7f979c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:15.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b37fe640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b40cd110 0x7f979c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b37fe640 1 -- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f979c0039f0 msgr2=0x7f979c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:15.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b37fe640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f979c0039f0 0x7f979c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.932+0000 7f97b37fe640 1 -- 172.21.15.67:0/3110409812 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c003530 con 0x7f979c004d50 2024-09-19T05:34:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b37fe640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f979c004d50 0x7f979c0051d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f97ac001e40 tx=0x7f97ac01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf60c7787828977 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac001a90 con 0x7f979c004d50 2024-09-19T05:34:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ac003b80 con 0x7f979c004d50 2024-09-19T05:34:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b1ffb640 1 -- 172.21.15.67:0/3110409812 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac005080 con 0x7f979c004d50 2024-09-19T05:34:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b96f7640 1 -- 172.21.15.67:0/3110409812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f979c004d50 msgr2=0x7f979c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b96f7640 1 --2- 172.21.15.67:0/3110409812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f979c004d50 0x7f979c0051d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f97ac001e40 tx=0x7f97ac01c760 comp rx=0 tx=0).stop 2024-09-19T05:34:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b37fe640 1 -- 172.21.15.67:0/3110409812 reap_dead start 2024-09-19T05:34:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b96f7640 1 -- 172.21.15.67:0/3110409812 shutdown_connections 2024-09-19T05:34:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b96f7640 1 -- 172.21.15.67:0/3110409812 >> 172.21.15.67:0/3110409812 conn(0x7f97b40d2320 msgr2=0x7f97b40d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b96f7640 1 -- 172.21.15.67:0/3110409812 shutdown_connections 2024-09-19T05:34:15.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b96f7640 1 -- 172.21.15.67:0/3110409812 wait complete. 2024-09-19T05:34:15.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b96f7640 1 Processor -- start 2024-09-19T05:34:15.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.936+0000 7f97b96f7640 1 -- start start 2024-09-19T05:34:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b96f7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b414fdf0 0x7f97b40b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b96f7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97b41501d0 0x7f97b40c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b96f7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b414ce80 0x7f97b414d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b96f7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97b40ce110 con 0x7f97b414ce80 2024-09-19T05:34:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b96f7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f97b409b3c0 con 0x7f97b41501d0 2024-09-19T05:34:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b96f7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f97b409b7d0 con 0x7f97b414fdf0 2024-09-19T05:34:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b414ce80 0x7f97b414d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b414ce80 0x7f97b414d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46540/0 (socket says 172.21.15.67:46540) 2024-09-19T05:34:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b37fe640 1 -- 172.21.15.67:0/1237762796 learned_addr learned my addr 172.21.15.67:0/1237762796 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b2ffd640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b414fdf0 0x7f97b40b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b27fc640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97b41501d0 0x7f97b40c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b37fe640 1 -- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b414fdf0 msgr2=0x7f97b40b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b37fe640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b414fdf0 0x7f97b40b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b37fe640 1 -- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97b41501d0 msgr2=0x7f97b40c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b37fe640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97b41501d0 0x7f97b40c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b37fe640 1 -- 172.21.15.67:0/1237762796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b40b14d0 con 0x7f97b414ce80 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b27fc640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97b41501d0 0x7f97b40c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b37fe640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b414ce80 0x7f97b414d300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f97ac01ccd0 tx=0x7f979c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f979b7fe640 1 -- 172.21.15.67:0/1237762796 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac0b7070 con 0x7f97b414ce80 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f979b7fe640 1 -- 172.21.15.67:0/1237762796 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ac0012e0 con 0x7f97b414ce80 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b96f7640 1 -- 172.21.15.67:0/1237762796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b40b7b90 con 0x7f97b414ce80 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f979b7fe640 1 -- 172.21.15.67:0/1237762796 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac001a90 con 0x7f97b414ce80 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b96f7640 1 -- 172.21.15.67:0/1237762796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b40c6610 con 0x7f97b414ce80 2024-09-19T05:34:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b96f7640 1 -- 172.21.15.67:0/1237762796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b409aac0 con 0x7f97b414ce80 2024-09-19T05:34:15.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f979b7fe640 1 -- 172.21.15.67:0/1237762796 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97ac0ba070 con 0x7f97b414ce80 2024-09-19T05:34:15.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f979b7fe640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97a00678c0 0x7f97a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:15.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f979b7fe640 1 -- 172.21.15.67:0/1237762796 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f97ac11ece0 con 0x7f97b414ce80 2024-09-19T05:34:15.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.940+0000 7f97b2ffd640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97a00678c0 0x7f97a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:15.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.944+0000 7f97b2ffd640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97a00678c0 0x7f97a0069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f97a4004850 tx=0x7f97a4007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:15.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:15.944+0000 7f979b7fe640 1 -- 172.21.15.67:0/1237762796 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f97ac0ac020 con 0x7f97b414ce80 2024-09-19T05:34:16.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.168+0000 7f97b96f7640 1 -- 172.21.15.67:0/1237762796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f97b40b72f0 con 0x7f97b414ce80 2024-09-19T05:34:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f979b7fe640 1 -- 172.21.15.67:0/1237762796 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f97ac016470 con 0x7f97b414ce80 2024-09-19T05:34:16.177 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:34:16.178 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:34:16.178 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:34:16.178 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:34:16.178 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:34:16.178 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:34:16.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 -- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97a00678c0 msgr2=0x7f97a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:16.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97a00678c0 0x7f97a0069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f97a4004850 tx=0x7f97a4007040 comp rx=0 tx=0).stop 2024-09-19T05:34:16.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 -- 172.21.15.67:0/1237762796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b414ce80 msgr2=0x7f97b414d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:16.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b414ce80 0x7f97b414d300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f97ac01ccd0 tx=0x7f979c005840 comp rx=0 tx=0).stop 2024-09-19T05:34:16.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 -- 172.21.15.67:0/1237762796 shutdown_connections 2024-09-19T05:34:16.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b414ce80 0x7f97b414d300 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97b41501d0 0x7f97b40c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97a00678c0 0x7f97a0069d80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 --2- 172.21.15.67:0/1237762796 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97b414fdf0 0x7f97b40b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 -- 172.21.15.67:0/1237762796 >> 172.21.15.67:0/1237762796 conn(0x7f97b40d2320 msgr2=0x7f97b40d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:16.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.172+0000 7f97b96f7640 1 -- 172.21.15.67:0/1237762796 shutdown_connections 2024-09-19T05:34:16.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.176+0000 7f97b96f7640 1 -- 172.21.15.67:0/1237762796 wait complete. 2024-09-19T05:34:16.197 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:34:16.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd878cac640 1 Processor -- start 2024-09-19T05:34:16.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd878cac640 1 -- start start 2024-09-19T05:34:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd878cac640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd8740b2fd0 0x7fd8740b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd878cac640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd87406de80 con 0x7fd874159d60 2024-09-19T05:34:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd878cac640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd87406e160 con 0x7fd8740acfb0 2024-09-19T05:34:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd878cac640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd87406e440 con 0x7fd8740b2fd0 2024-09-19T05:34:16.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd871d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd8740b2fd0 0x7fd8740b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:16.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd871d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd8740b2fd0 0x7fd8740b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46544/0 (socket says 172.21.15.67:46544) 2024-09-19T05:34:16.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd871d9b640 1 -- 172.21.15.67:0/769725271 learned_addr learned my addr 172.21.15.67:0/769725271 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:16.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd871d9b640 1 -- 172.21.15.67:0/769725271 >> v1:172.21.15.97:6789/0 conn(0x7fd8740acfb0 legacy=0x7fd8740ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:16.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd871d9b640 1 -- 172.21.15.67:0/769725271 >> v1:172.21.15.67:6789/0 conn(0x7fd874159d60 legacy=0x7fd87406ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:16.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.304+0000 7fd871d9b640 1 -- 172.21.15.67:0/769725271 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87406e720 con 0x7fd8740b2fd0 2024-09-19T05:34:16.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd871d9b640 1 --2- 172.21.15.67:0/769725271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8740b2fd0 0x7fd8740b3420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd868009870 tx=0x7fd86801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb30b477e8a4e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:16.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd87159a640 1 -- 172.21.15.67:0/769725271 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8680b1070 con 0x7fd8740b2fd0 2024-09-19T05:34:16.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd87159a640 1 -- 172.21.15.67:0/769725271 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8680ac410 con 0x7fd8740b2fd0 2024-09-19T05:34:16.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd87159a640 1 -- 172.21.15.67:0/769725271 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8680ac7e0 con 0x7fd8740b2fd0 2024-09-19T05:34:16.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- 172.21.15.67:0/769725271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8740b2fd0 msgr2=0x7fd8740b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:16.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 --2- 172.21.15.67:0/769725271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8740b2fd0 0x7fd8740b3420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd868009870 tx=0x7fd86801c520 comp rx=0 tx=0).stop 2024-09-19T05:34:16.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- 172.21.15.67:0/769725271 shutdown_connections 2024-09-19T05:34:16.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 --2- 172.21.15.67:0/769725271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8740b2fd0 0x7fd8740b3420 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- 172.21.15.67:0/769725271 >> 172.21.15.67:0/769725271 conn(0x7fd8740d0080 msgr2=0x7fd8740d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:16.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- 172.21.15.67:0/769725271 shutdown_connections 2024-09-19T05:34:16.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- 172.21.15.67:0/769725271 wait complete. 2024-09-19T05:34:16.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 Processor -- start 2024-09-19T05:34:16.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- start start 2024-09-19T05:34:16.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8740acfb0 0x7fd8741458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:16.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8740b2fd0 0x7fd8740992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:16.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd874159d60 0x7fd8741583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:16.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd8740af830 con 0x7fd874159d60 2024-09-19T05:34:16.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd8740af6b0 con 0x7fd8740acfb0 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd8740af9b0 con 0x7fd8740b2fd0 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd872d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd874159d60 0x7fd8741583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd872d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd874159d60 0x7fd8741583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46554/0 (socket says 172.21.15.67:46554) 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd872d9d640 1 -- 172.21.15.67:0/1326259403 learned_addr learned my addr 172.21.15.67:0/1326259403 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd871d9b640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8740b2fd0 0x7fd8740992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd87259c640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8740acfb0 0x7fd8741458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd872d9d640 1 -- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8740b2fd0 msgr2=0x7fd8740992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd872d9d640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8740b2fd0 0x7fd8740992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd872d9d640 1 -- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8740acfb0 msgr2=0x7fd8741458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd872d9d640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8740acfb0 0x7fd8741458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd872d9d640 1 -- 172.21.15.67:0/1326259403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87415a950 con 0x7fd874159d60 2024-09-19T05:34:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd872d9d640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd874159d60 0x7fd8741583b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00b990 tx=0x7fd86c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd862ffd640 1 -- 172.21.15.67:0/1326259403 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c019070 con 0x7fd874159d60 2024-09-19T05:34:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd862ffd640 1 -- 172.21.15.67:0/1326259403 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86c00cba0 con 0x7fd874159d60 2024-09-19T05:34:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- 172.21.15.67:0/1326259403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd874098800 con 0x7fd874159d60 2024-09-19T05:34:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd862ffd640 1 -- 172.21.15.67:0/1326259403 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c014440 con 0x7fd874159d60 2024-09-19T05:34:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.308+0000 7fd878cac640 1 -- 172.21.15.67:0/1326259403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd874099820 con 0x7fd874159d60 2024-09-19T05:34:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.312+0000 7fd878cac640 1 -- 172.21.15.67:0/1326259403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8740b3420 con 0x7fd874159d60 2024-09-19T05:34:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.312+0000 7fd862ffd640 1 -- 172.21.15.67:0/1326259403 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd86c01c070 con 0x7fd874159d60 2024-09-19T05:34:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.312+0000 7fd862ffd640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8540678f0 0x7fd854069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.312+0000 7fd862ffd640 1 -- 172.21.15.67:0/1326259403 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd86c085b50 con 0x7fd874159d60 2024-09-19T05:34:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.312+0000 7fd87259c640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8540678f0 0x7fd854069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.312+0000 7fd87259c640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8540678f0 0x7fd854069db0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd87415e450 tx=0x7fd864009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:16.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.316+0000 7fd862ffd640 1 -- 172.21.15.67:0/1326259403 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd86c0564f0 con 0x7fd874159d60 2024-09-19T05:34:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.512+0000 7fd878cac640 1 -- 172.21.15.67:0/1326259403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8740d0f20 con 0x7fd874159d60 2024-09-19T05:34:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd862ffd640 1 -- 172.21.15.67:0/1326259403 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5220 (secure 0 0 0) 0x7fd86c055df0 con 0x7fd874159d60 2024-09-19T05:34:16.521 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:34:16.521 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":15,"btime":"2024-09-19T05:34:09:865438+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2848495891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2848495891},{"type":"v1","addr":"172.21.15.97:6835","nonce":2848495891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4741,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2818377677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2818377677},{"type":"v1","addr":"172.21.15.97:6837","nonce":2818377677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4887,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/244834094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":244834094},{"type":"v1","addr":"172.21.15.67:6834","nonce":244834094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:34:07.193697+0000","modified":"2024-09-19T05:34:09.207710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3857596366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3857596366},{"type":"v1","addr":"172.21.15.67:6835","nonce":3857596366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-19T05:34:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-09-19T05:34:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 -- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8540678f0 msgr2=0x7fd854069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8540678f0 0x7fd854069db0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd87415e450 tx=0x7fd864009040 comp rx=0 tx=0).stop 2024-09-19T05:34:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 -- 172.21.15.67:0/1326259403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd874159d60 msgr2=0x7fd8741583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd874159d60 0x7fd8741583b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00b990 tx=0x7fd86c00be50 comp rx=0 tx=0).stop 2024-09-19T05:34:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 -- 172.21.15.67:0/1326259403 shutdown_connections 2024-09-19T05:34:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd874159d60 0x7fd8741583b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8540678f0 0x7fd854069db0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8740b2fd0 0x7fd8740992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 --2- 172.21.15.67:0/1326259403 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8740acfb0 0x7fd8741458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:16.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 -- 172.21.15.67:0/1326259403 >> 172.21.15.67:0/1326259403 conn(0x7fd8740d0080 msgr2=0x7fd87406ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:16.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 -- 172.21.15.67:0/1326259403 shutdown_connections 2024-09-19T05:34:16.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:16.516+0000 7fd878cac640 1 -- 172.21.15.67:0/1326259403 wait complete. 2024-09-19T05:34:16.943 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:34:07.193697+0000', 'modified': '2024-09-19T05:34:09.207710+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4890}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4890': {'gid': 4890, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/3857596366', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6833', 'nonce': 3857596366}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 3857596366}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4890, 'qdb_cluster': [4890]} 2024-09-19T05:34:16.944 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:34:16.944 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T05:34:17.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd4a0445640 1 Processor -- start 2024-09-19T05:34:17.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd4a0445640 1 -- start start 2024-09-19T05:34:17.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd4a0445640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49806f460 0x7fd49806f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd4a0445640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49806e3c0 con 0x7fd49806dde0 2024-09-19T05:34:17.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd4a0445640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49806e6a0 con 0x7fd49815c030 2024-09-19T05:34:17.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd4a0445640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd49806e980 con 0x7fd49806f460 2024-09-19T05:34:17.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd49d9e0640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd49806dde0 0x7fd4980b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34800/0 (socket says 172.21.15.67:34800) 2024-09-19T05:34:17.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd49d9e0640 1 -- 172.21.15.67:0/299750028 learned_addr learned my addr 172.21.15.67:0/299750028 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:17.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49806f460 0x7fd49806f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228310771 0 0) 0x7fd49806e3c0 con 0x7fd49806dde0 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd484003530 con 0x7fd49806dde0 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.080+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2862559395 0 0) 0x7fd484003530 con 0x7fd49806dde0 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49806f460 msgr2=0x7fd49806f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49806f460 0x7fd49806f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 >> v1:172.21.15.97:6789/0 conn(0x7fd49815c030 legacy=0x7fd49815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49806ec60 con 0x7fd49806dde0 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fd488001680 con 0x7fd49806dde0 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 >> v1:172.21.15.67:6789/0 conn(0x7fd49806dde0 legacy=0x7fd4980b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd4840039f0 0x7fd484003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49806f460 0x7fd484004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd484004d50 0x7fd4840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd49806e980 con 0x7fd484004d50 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd48400ba80 con 0x7fd4840039f0 2024-09-19T05:34:17.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd48400bc80 con 0x7fd49806f460 2024-09-19T05:34:17.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd484004d50 0x7fd4840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd4840039f0 0x7fd484003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49806f460 0x7fd484004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49e9e2640 1 -- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49806f460 msgr2=0x7fd484004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49806f460 0x7fd484004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49e9e2640 1 -- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd4840039f0 msgr2=0x7fd484003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd4840039f0 0x7fd484003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49e9e2640 1 -- 172.21.15.67:0/299750028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd484003530 con 0x7fd484004d50 2024-09-19T05:34:17.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd484004d50 0x7fd4840051d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd490009f70 tx=0x7fd49001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14350a6efbe2c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:17.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4900b2070 con 0x7fd484004d50 2024-09-19T05:34:17.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4900a5cf0 con 0x7fd484004d50 2024-09-19T05:34:17.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49d1df640 1 -- 172.21.15.67:0/299750028 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490009bf0 con 0x7fd484004d50 2024-09-19T05:34:17.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd4a0445640 1 -- 172.21.15.67:0/299750028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd484004d50 msgr2=0x7fd4840051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd4a0445640 1 --2- 172.21.15.67:0/299750028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd484004d50 0x7fd4840051d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd490009f70 tx=0x7fd49001cc20 comp rx=0 tx=0).stop 2024-09-19T05:34:17.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd49e9e2640 1 -- 172.21.15.67:0/299750028 reap_dead start 2024-09-19T05:34:17.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd4a0445640 1 -- 172.21.15.67:0/299750028 shutdown_connections 2024-09-19T05:34:17.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd4a0445640 1 -- 172.21.15.67:0/299750028 >> 172.21.15.67:0/299750028 conn(0x7fd4980d0080 msgr2=0x7fd4980d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:17.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd4a0445640 1 -- 172.21.15.67:0/299750028 shutdown_connections 2024-09-19T05:34:17.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.084+0000 7fd4a0445640 1 -- 172.21.15.67:0/299750028 wait complete. 2024-09-19T05:34:17.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd4a0445640 1 Processor -- start 2024-09-19T05:34:17.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd4a0445640 1 -- start start 2024-09-19T05:34:17.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd4a0445640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd484004d50 0x7fd498099740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd4a0445640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd498142f20 0x7fd498143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd4a0445640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd498154500 0x7fd498154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd4a0445640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd4980b36e0 con 0x7fd498142f20 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd4a0445640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd49815c410 con 0x7fd498154500 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd4a0445640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd498144590 con 0x7fd484004d50 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49d9e0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd498142f20 0x7fd498143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49d9e0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd498142f20 0x7fd498143380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46574/0 (socket says 172.21.15.67:46574) 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49d9e0640 1 -- 172.21.15.67:0/1946555893 learned_addr learned my addr 172.21.15.67:0/1946555893 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd484004d50 0x7fd498099740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49d9e0640 1 -- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd484004d50 msgr2=0x7fd498099740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd484004d50 0x7fd498099740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49d9e0640 1 -- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd498154500 msgr2=0x7fd498154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd498154500 0x7fd498154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd498154500 0x7fd498154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49d9e0640 1 -- 172.21.15.67:0/1946555893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd498099c80 con 0x7fd498142f20 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd498142f20 0x7fd498143380 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd48800e7b0 tx=0x7fd48800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd48effd640 1 -- 172.21.15.67:0/1946555893 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48800c8d0 con 0x7fd498142f20 2024-09-19T05:34:17.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd48effd640 1 -- 172.21.15.67:0/1946555893 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd488018070 con 0x7fd498142f20 2024-09-19T05:34:17.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd4a0445640 1 -- 172.21.15.67:0/1946555893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd498143980 con 0x7fd498142f20 2024-09-19T05:34:17.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd48effd640 1 -- 172.21.15.67:0/1946555893 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48800ccb0 con 0x7fd498142f20 2024-09-19T05:34:17.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd4a0445640 1 -- 172.21.15.67:0/1946555893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd498143f40 con 0x7fd498142f20 2024-09-19T05:34:17.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.088+0000 7fd48effd640 1 -- 172.21.15.67:0/1946555893 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd48801d460 con 0x7fd498142f20 2024-09-19T05:34:17.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd48effd640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0678c0 0x7fd47c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd48effd640 1 -- 172.21.15.67:0/1946555893 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd488085e40 con 0x7fd498142f20 2024-09-19T05:34:17.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0678c0 0x7fd47c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 Processor -- start 2024-09-19T05:34:17.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 -- start start 2024-09-19T05:34:17.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0678c0 0x7fd47c069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd494005510 tx=0x7fd494009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab7e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7e690 0x555c0ab34160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab346a0 0x555c0ab34a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x555c0aa17b60 con 0x555c0ab7dd70 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x555c0a97ec70 con 0x555c0ab7e690 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x555c0a924ed0 con 0x555c0ab346a0 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab7e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab7e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46582/0 (socket says 172.21.15.67:46582) 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 -- 172.21.15.67:0/3501516204 learned_addr learned my addr 172.21.15.67:0/3501516204 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/3501516204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7e690 0x555c0ab34160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/3501516204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab346a0 0x555c0ab34a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 -- 172.21.15.67:0/3501516204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab346a0 msgr2=0x555c0ab34a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/3501516204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab346a0 0x555c0ab34a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 -- 172.21.15.67:0/3501516204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7e690 msgr2=0x555c0ab34160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/3501516204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7e690 0x555c0ab34160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 -- 172.21.15.67:0/3501516204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0a936e50 con 0x555c0ab7dd70 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/3501516204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7e690 0x555c0ab34160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/3501516204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab7e150 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd4940015b0 tx=0x7fd494013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce142583e10e6c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd47bfff640 1 -- 172.21.15.67:0/3501516204 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd494027070 con 0x555c0ab7dd70 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd47bfff640 1 -- 172.21.15.67:0/3501516204 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd494014740 con 0x555c0ab7dd70 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd47bfff640 1 -- 172.21.15.67:0/3501516204 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd494014af0 con 0x555c0ab7dd70 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 -- 172.21.15.67:0/3501516204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 msgr2=0x555c0ab7e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 --2- 172.21.15.67:0/3501516204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab7e150 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd4940015b0 tx=0x7fd494013000 comp rx=0 tx=0).stop 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 -- 172.21.15.67:0/3501516204 shutdown_connections 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 --2- 172.21.15.67:0/3501516204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab346a0 0x555c0ab34a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 --2- 172.21.15.67:0/3501516204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7e690 0x555c0ab34160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 --2- 172.21.15.67:0/3501516204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab7e150 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 -- 172.21.15.67:0/3501516204 >> 172.21.15.67:0/3501516204 conn(0x555c0ab36600 msgr2=0x555c0ab2e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:17.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 -- 172.21.15.67:0/3501516204 shutdown_connections 2024-09-19T05:34:17.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.092+0000 7fd4a3501000 1 -- 172.21.15.67:0/3501516204 wait complete. 2024-09-19T05:34:17.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 -- start start 2024-09-19T05:34:17.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 Processor -- start 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7dd70 0x555c0ab83eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7e690 0x555c0ab843f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab6a490 0x555c0ab6a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x555c0a9e0b00 con 0x555c0ab6a490 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x555c0a959360 con 0x555c0ab7dd70 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x555c0a9562d0 con 0x555c0ab7e690 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 10 client.0 _ll_register_callbacks cb 0x555c0ab1b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e9e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab6a490 0x555c0ab6a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e9e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab6a490 0x555c0ab6a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46596/0 (socket says 172.21.15.67:46596) 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e9e2640 1 -- 172.21.15.67:0/392755761 learned_addr learned my addr 172.21.15.67:0/392755761 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7dd70 0x555c0ab83eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7e690 0x555c0ab843f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e9e2640 1 -- 172.21.15.67:0/392755761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7e690 msgr2=0x555c0ab843f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7e690 0x555c0ab843f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e9e2640 1 -- 172.21.15.67:0/392755761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7dd70 msgr2=0x555c0ab83eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7dd70 0x555c0ab83eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e9e2640 1 -- 172.21.15.67:0/392755761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c0a925120 con 0x555c0ab6a490 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7e690 0x555c0ab843f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7dd70 0x555c0ab83eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab6a490 0x555c0ab6a870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd4900b0040 tx=0x7fd4900199c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8bc39f1981ee10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4797fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4797fa640 1 -- 172.21.15.67:0/392755761 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4900b2070 con 0x555c0ab6a490 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4797fa640 1 -- 172.21.15.67:0/392755761 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd4900bacc0 con 0x555c0ab6a490 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 -- 172.21.15.67:0/392755761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd494014740 con 0x555c0ab6a490 2024-09-19T05:34:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4797fa640 1 -- 172.21.15.67:0/392755761 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd4900ad440 con 0x555c0ab6a490 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 10 client.5091 fetch_fsmap learned FSMap version 15 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 -- 172.21.15.67:0/392755761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x555c0a91e450 con 0x555c0ab6a490 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4797fa640 1 -- 172.21.15.67:0/392755761 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd494014740 con 0x555c0ab6a490 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4797fa640 1 -- 172.21.15.67:0/392755761 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7fd4900b9480 con 0x555c0ab6a490 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 10 client.5091 fetch_fsmap finished waiting for FSMap version 15 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 10 client.5091 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 20 client.5091 populate_metadata read hostname 'smithi067' 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x555c0ab6b280 0x555c0ab6b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 4 client.5091 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 -- 172.21.15.67:0/392755761 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c0a918c00 con 0x555c0ab6b280 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x555c0ab6b280 0x555c0ab6b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4797fa640 10 client.5091 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:34:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x555c0ab6b280 0x555c0ab6b660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=530d61d8daf1af84 server_cookie=2a982d502f2db81d in_seq=0 out_seq=0 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4797fa640 1 -- 172.21.15.67:0/392755761 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c0a918c00 con 0x555c0ab6b280 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4797fa640 10 client.5091 handle_command_reply: tid=0 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 client.5091 shutdown 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 -- 172.21.15.67:0/392755761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab6a490 msgr2=0x555c0ab6a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab6a490 0x555c0ab6a870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd4900b0040 tx=0x7fd4900199c0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 -- 172.21.15.67:0/392755761 shutdown_connections 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x555c0ab6b280 0x555c0ab6b660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab6a490 0x555c0ab6a870 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7e690 0x555c0ab843f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4797fa640 0 client.5091 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.096+0000 7fd4a3501000 1 --2- 172.21.15.67:0/392755761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7dd70 0x555c0ab83eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.100+0000 7fd4a3501000 1 -- 172.21.15.67:0/392755761 >> 172.21.15.67:0/392755761 conn(0x555c0ab346a0 msgr2=0x555c0ab359b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.100+0000 7fd4a3501000 1 -- 172.21.15.67:0/392755761 shutdown_connections 2024-09-19T05:34:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.100+0000 7fd4a3501000 1 -- 172.21.15.67:0/392755761 wait complete. 2024-09-19T05:34:17.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.100+0000 7fd4a3501000 20 client.5091 trim_cache size 0 max 16384 2024-09-19T05:34:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd4a3501000 1 Processor -- start 2024-09-19T05:34:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd4a3501000 1 -- start start 2024-09-19T05:34:17.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab6a490 0x555c0ab94260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab947a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7e690 0x555c0ab82ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd4a3501000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd4980737b0 con 0x555c0ab7dd70 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd4a3501000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd498145950 con 0x555c0ab7e690 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd4a3501000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd498073160 con 0x555c0ab6a490 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd49d9e0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd49d9e0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab947a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46602/0 (socket says 172.21.15.67:46602) 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.116+0000 7fd49d9e0640 1 -- 172.21.15.67:0/3294052155 learned_addr learned my addr 172.21.15.67:0/3294052155 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49d9e0640 1 -- 172.21.15.67:0/3294052155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab6a490 msgr2=0x555c0ab94260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/3294052155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab6a490 0x555c0ab94260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49d9e0640 1 -- 172.21.15.67:0/3294052155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7e690 msgr2=0x555c0ab82ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/3294052155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7e690 0x555c0ab82ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49d9e0640 1 -- 172.21.15.67:0/3294052155 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0a905fd0 con 0x555c0ab7dd70 2024-09-19T05:34:17.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/3294052155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab947a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd48805e700 tx=0x7fd4880559b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a5f3a44fa7fd05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd47b7fe640 1 -- 172.21.15.67:0/3294052155 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488056050 con 0x555c0ab7dd70 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd47b7fe640 1 -- 172.21.15.67:0/3294052155 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48805a400 con 0x555c0ab7dd70 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd47b7fe640 1 -- 172.21.15.67:0/3294052155 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48805ec30 con 0x555c0ab7dd70 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- 172.21.15.67:0/3294052155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 msgr2=0x555c0ab947a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 --2- 172.21.15.67:0/3294052155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab947a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd48805e700 tx=0x7fd4880559b0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- 172.21.15.67:0/3294052155 shutdown_connections 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 --2- 172.21.15.67:0/3294052155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab7e690 0x555c0ab82ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 --2- 172.21.15.67:0/3294052155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7dd70 0x555c0ab947a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 --2- 172.21.15.67:0/3294052155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab6a490 0x555c0ab94260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- 172.21.15.67:0/3294052155 >> 172.21.15.67:0/3294052155 conn(0x555c0ab346a0 msgr2=0x555c0ab2eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- 172.21.15.67:0/3294052155 shutdown_connections 2024-09-19T05:34:17.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- 172.21.15.67:0/3294052155 wait complete. 2024-09-19T05:34:17.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- start start 2024-09-19T05:34:17.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 Processor -- start 2024-09-19T05:34:17.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab6a490 0x555c0abf1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7dd70 0x555c0abf1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7e690 0x555c0ab87cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x555c0a97df80 con 0x555c0ab7e690 2024-09-19T05:34:17.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x555c0a936ca0 con 0x555c0ab6a490 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x555c0a9832a0 con 0x555c0ab7dd70 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 10 client.0 _ll_register_callbacks cb 0x7fd4900b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49e9e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7e690 0x555c0ab87cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49e9e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7e690 0x555c0ab87cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46612/0 (socket says 172.21.15.67:46612) 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49e9e2640 1 -- 172.21.15.67:0/4044994281 learned_addr learned my addr 172.21.15.67:0/4044994281 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49d9e0640 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7dd70 0x555c0abf1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab6a490 0x555c0abf1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49e9e2640 1 -- 172.21.15.67:0/4044994281 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7dd70 msgr2=0x555c0abf1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7dd70 0x555c0abf1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49e9e2640 1 -- 172.21.15.67:0/4044994281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab6a490 msgr2=0x555c0abf1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab6a490 0x555c0abf1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49e9e2640 1 -- 172.21.15.67:0/4044994281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c0aa01750 con 0x555c0ab7e690 2024-09-19T05:34:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd49e9e2640 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7e690 0x555c0ab87cf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd49001d4c0 tx=0x7fd490009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933c6e9f7c15fb2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4797fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4797fa640 1 -- 172.21.15.67:0/4044994281 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4900b2040 con 0x555c0ab7e690 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4797fa640 1 -- 172.21.15.67:0/4044994281 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd4900ad5e0 con 0x555c0ab7e690 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- 172.21.15.67:0/4044994281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd48805a400 con 0x555c0ab7e690 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4797fa640 1 -- 172.21.15.67:0/4044994281 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd4900d5050 con 0x555c0ab7e690 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 10 client.5097 fetch_fsmap learned FSMap version 15 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4a3501000 1 -- 172.21.15.67:0/4044994281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x555c0a90ca30 con 0x555c0ab7e690 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4797fa640 1 -- 172.21.15.67:0/4044994281 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48805a400 con 0x555c0ab7e690 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.120+0000 7fd4797fa640 1 -- 172.21.15.67:0/4044994281 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7fd4900d8020 con 0x555c0ab7e690 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 10 client.5097 fetch_fsmap finished waiting for FSMap version 15 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 10 client.5097 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 20 client.5097 populate_metadata read hostname 'smithi067' 2024-09-19T05:34:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x555c0ab88230 0x555c0ab88610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 4 client.5097 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 -- 172.21.15.67:0/4044994281 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "status"}) -- 0x555c0a98c3a0 con 0x555c0ab88230 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x555c0ab88230 0x555c0ab88610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4797fa640 10 client.5097 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd49e1e1640 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x555c0ab88230 0x555c0ab88610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ec14690aafbaea6 server_cookie=3e8716b9b3ae8334 in_seq=0 out_seq=0 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4797fa640 1 -- 172.21.15.67:0/4044994281 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x555c0a98c3a0 con 0x555c0ab88230 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4797fa640 10 client.5097 handle_command_reply: tid=0 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 client.5097 shutdown 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 -- 172.21.15.67:0/4044994281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7e690 msgr2=0x555c0ab87cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7e690 0x555c0ab87cf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd49001d4c0 tx=0x7fd490009750 comp rx=0 tx=0).stop 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 -- 172.21.15.67:0/4044994281 shutdown_connections 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x555c0ab88230 0x555c0ab88610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555c0ab7e690 0x555c0ab87cf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555c0ab7dd70 0x555c0abf1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 --2- 172.21.15.67:0/4044994281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555c0ab6a490 0x555c0abf1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4797fa640 0 client.5097 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:34:17.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 -- 172.21.15.67:0/4044994281 >> 172.21.15.67:0/4044994281 conn(0x555c0ab346a0 msgr2=0x555c0ab93250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:17.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 -- 172.21.15.67:0/4044994281 shutdown_connections 2024-09-19T05:34:17.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 1 -- 172.21.15.67:0/4044994281 wait complete. 2024-09-19T05:34:17.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a3501000 20 client.5097 trim_cache size 0 max 16384 2024-09-19T05:34:17.131 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:34:17.131 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:34:17.131 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:34:17.131 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4890, 2024-09-19T05:34:17.132 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:34:17.132 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:34:17.132 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:34:17.132 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 9.2959368040000001, 2024-09-19T05:34:17.132 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 15, 2024-09-19T05:34:17.132 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 39, 2024-09-19T05:34:17.132 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 39, 2024-09-19T05:34:17.132 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 16.381045736000001 2024-09-19T05:34:17.132 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:34:17.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 -- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0678c0 msgr2=0x7fd47c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0678c0 0x7fd47c069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd494005510 tx=0x7fd494009040 comp rx=0 tx=0).stop 2024-09-19T05:34:17.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 -- 172.21.15.67:0/1946555893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd498142f20 msgr2=0x7fd498143380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd498142f20 0x7fd498143380 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd48800e7b0 tx=0x7fd48800ec70 comp rx=0 tx=0).stop 2024-09-19T05:34:17.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 -- 172.21.15.67:0/1946555893 shutdown_connections 2024-09-19T05:34:17.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd498154500 0x7fd498154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd498142f20 0x7fd498143380 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0678c0 0x7fd47c069d80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 --2- 172.21.15.67:0/1946555893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd484004d50 0x7fd498099740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 -- 172.21.15.67:0/1946555893 >> 172.21.15.67:0/1946555893 conn(0x7fd4980d0080 msgr2=0x7fd4980acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:17.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 -- 172.21.15.67:0/1946555893 shutdown_connections 2024-09-19T05:34:17.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.124+0000 7fd4a0445640 1 -- 172.21.15.67:0/1946555893 wait complete. 2024-09-19T05:34:17.142 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:34:17.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.248+0000 7f08c73b8640 1 Processor -- start 2024-09-19T05:34:17.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.248+0000 7f08c73b8640 1 -- start start 2024-09-19T05:34:17.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c73b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f08c00726b0 0x7f08c006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c73b8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c00b4420 con 0x7f08c00b2fd0 2024-09-19T05:34:17.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c73b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c00b4140 con 0x7f08c015e330 2024-09-19T05:34:17.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c73b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f08c00acfb0 con 0x7f08c00726b0 2024-09-19T05:34:17.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c4953640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f08c00b2fd0 0x7f08c006e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34804/0 (socket says 172.21.15.67:34804) 2024-09-19T05:34:17.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c4953640 1 -- 172.21.15.67:0/245169984 learned_addr learned my addr 172.21.15.67:0/245169984 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:34:17.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c5955640 1 --2- 172.21.15.67:0/245169984 >> v2:172.21.15.97:3300/0 conn(0x7f08c00726b0 0x7f08c006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065458387 0 0) 0x7f08c00b4420 con 0x7f08c00b2fd0 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08ac003530 con 0x7f08c00b2fd0 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1290224890 0 0) 0x7f08ac003530 con 0x7f08c00b2fd0 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 >> v2:172.21.15.97:3300/0 conn(0x7f08c00726b0 msgr2=0x7f08c006ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 --2- 172.21.15.67:0/245169984 >> v2:172.21.15.97:3300/0 conn(0x7f08c00726b0 0x7f08c006ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 >> v1:172.21.15.97:6789/0 conn(0x7f08c015e330 legacy=0x7f08c0071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c006def0 con 0x7f08c00b2fd0 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f08bc001680 con 0x7f08c00b2fd0 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 >> v1:172.21.15.67:6789/0 conn(0x7f08c00b2fd0 legacy=0x7f08c006e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08ac0039c0 0x7f08ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08ac004810 0x7f08ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08ac0051d0 0x7f08ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac00c040 con 0x7f08ac0039c0 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac00c1f0 con 0x7f08ac004810 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f08ac00c3f0 con 0x7f08ac0051d0 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c5154640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08ac0039c0 0x7f08ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c4953640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08ac004810 0x7f08ac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c5955640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08ac0051d0 0x7f08ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c5154640 1 -- 172.21.15.67:0/245169984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08ac0051d0 msgr2=0x7f08ac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c5154640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08ac0051d0 0x7f08ac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c5154640 1 -- 172.21.15.67:0/245169984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08ac004810 msgr2=0x7f08ac004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c5154640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08ac004810 0x7f08ac004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c5154640 1 -- 172.21.15.67:0/245169984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ac003530 con 0x7f08ac0039c0 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c5955640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08ac0051d0 0x7f08ac00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:17.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.252+0000 7f08c5955640 1 -- 172.21.15.67:0/245169984 reap_dead start 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5154640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08ac0039c0 0x7f08ac003de0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f08b0001780 tx=0x7f08b001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db96926c067708f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b00013a0 con 0x7f08ac0039c0 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b00052f0 con 0x7f08ac0039c0 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08b7fff640 1 -- 172.21.15.67:0/245169984 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b0003840 con 0x7f08ac0039c0 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 -- 172.21.15.67:0/245169984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08ac0039c0 msgr2=0x7f08ac003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08ac0039c0 0x7f08ac003de0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f08b0001780 tx=0x7f08b001c400 comp rx=0 tx=0).stop 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 -- 172.21.15.67:0/245169984 shutdown_connections 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 --2- 172.21.15.67:0/245169984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08ac0039c0 0x7f08ac003de0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 -- 172.21.15.67:0/245169984 >> 172.21.15.67:0/245169984 conn(0x7f08c00d0080 msgr2=0x7f08c00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 -- 172.21.15.67:0/245169984 shutdown_connections 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 -- 172.21.15.67:0/245169984 wait complete. 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 Processor -- start 2024-09-19T05:34:17.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 -- start start 2024-09-19T05:34:17.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08ac0039c0 0x7f08c01400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08c014e150 0x7f08c0152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08c0153080 0x7f08c0154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f08c00cfe40 con 0x7f08c0153080 2024-09-19T05:34:17.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f08c00cfcc0 con 0x7f08c014e150 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c73b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f08c0162780 con 0x7f08ac0039c0 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5955640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08c0153080 0x7f08c0154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5955640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08c0153080 0x7f08c0154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46628/0 (socket says 172.21.15.67:46628) 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5955640 1 -- 172.21.15.67:0/4144647639 learned_addr learned my addr 172.21.15.67:0/4144647639 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c4953640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08c014e150 0x7f08c0152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5154640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08ac0039c0 0x7f08c01400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5955640 1 -- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08ac0039c0 msgr2=0x7f08c01400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5955640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08ac0039c0 0x7f08c01400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5955640 1 -- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08c014e150 msgr2=0x7f08c0152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5955640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08c014e150 0x7f08c0152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5955640 1 -- 172.21.15.67:0/4144647639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c01405e0 con 0x7f08c0153080 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.256+0000 7f08c5955640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08c0153080 0x7f08c0154fa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f08c00d0bc0 tx=0x7f08b800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:17.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08b5ffb640 1 -- 172.21.15.67:0/4144647639 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8016420 con 0x7f08c0153080 2024-09-19T05:34:17.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08b5ffb640 1 -- 172.21.15.67:0/4144647639 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b801b070 con 0x7f08c0153080 2024-09-19T05:34:17.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08c73b8640 1 -- 172.21.15.67:0/4144647639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c014e9c0 con 0x7f08c0153080 2024-09-19T05:34:17.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08b5ffb640 1 -- 172.21.15.67:0/4144647639 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b80167e0 con 0x7f08c0153080 2024-09-19T05:34:17.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08c73b8640 1 -- 172.21.15.67:0/4144647639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c0158600 con 0x7f08c0153080 2024-09-19T05:34:17.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08c73b8640 1 -- 172.21.15.67:0/4144647639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c0162b10 con 0x7f08c0153080 2024-09-19T05:34:17.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08b5ffb640 1 -- 172.21.15.67:0/4144647639 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f08b8016980 con 0x7f08c0153080 2024-09-19T05:34:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08b5ffb640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08a40678c0 0x7f08a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08b5ffb640 1 -- 172.21.15.67:0/4144647639 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f08b80869b0 con 0x7f08c0153080 2024-09-19T05:34:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08c5154640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08a40678c0 0x7f08a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.260+0000 7f08c5154640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08a40678c0 0x7f08a4069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f08b0001750 tx=0x7f08b00011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:17.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.264+0000 7f08b5ffb640 1 -- 172.21.15.67:0/4144647639 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f08b8016c70 con 0x7f08c0153080 2024-09-19T05:34:17.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.456+0000 7f08c73b8640 1 -- 172.21.15.67:0/4144647639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f08c0161ce0 con 0x7f08c0153080 2024-09-19T05:34:17.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.456+0000 7f08b5ffb640 1 -- 172.21.15.67:0/4144647639 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7f08b8057360 con 0x7f08c0153080 2024-09-19T05:34:17.460 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:34:17.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 -- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08a40678c0 msgr2=0x7f08a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08a40678c0 0x7f08a4069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f08b0001750 tx=0x7f08b00011a0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 -- 172.21.15.67:0/4144647639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08c0153080 msgr2=0x7f08c0154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:17.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08c0153080 0x7f08c0154fa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f08c00d0bc0 tx=0x7f08b800f520 comp rx=0 tx=0).stop 2024-09-19T05:34:17.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 -- 172.21.15.67:0/4144647639 shutdown_connections 2024-09-19T05:34:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08c0153080 0x7f08c0154fa0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08c014e150 0x7f08c0152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08a40678c0 0x7f08a4069d80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 --2- 172.21.15.67:0/4144647639 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08ac0039c0 0x7f08c01400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 -- 172.21.15.67:0/4144647639 >> 172.21.15.67:0/4144647639 conn(0x7f08c00d0080 msgr2=0x7f08c006e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 -- 172.21.15.67:0/4144647639 shutdown_connections 2024-09-19T05:34:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17.460+0000 7f08c73b8640 1 -- 172.21.15.67:0/4144647639 wait complete. 2024-09-19T05:34:17.477 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:34:17.477 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:34:17.477 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:34:17.477 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:34:17.477 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:34:17.477 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:34:17.478 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:34:17.478 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:34:17.478 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:34:17.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:17.478 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:34:17.484 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:34:17.484 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:34:17.484 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:34:17.484 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:34:17.484 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:34:17.484 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42447sec preferred_lft 42447sec 2024-09-19T05:34:17.485 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:34:17.486 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:34:17.487 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:34:17.487 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:34:17.487 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:34:17.487 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:34:17.487 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:34:17.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:17.487 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:34:17.539 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:34:17.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:17.541 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:34:17.591 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:34:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:34:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:34:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:34:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:34:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:34:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:34:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:34:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:34:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:34:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:34:17.593 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:34:17.593 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:34:17.593 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:34:17.593 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:34:17.593 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:34:17.593 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:34:17.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:34:17.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:34:17.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:17.717 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:34:17.723 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:34:17.723 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:34:17.723 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:34:17.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:17.723 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:34:17.777 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:34:17.777 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:34:17.778 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:34:17.825 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:34:17.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:34:17.825 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:34:17.873 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:34:17.932 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:34:17.982 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:34:17.982 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:34:17.982 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:34:17.982 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:34:17.982 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:34:17.982 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:34:17.982 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:34:17.982 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:34:17.983 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:34:17.984 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:34:17.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:17.985 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:34:18.033 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:34:18.034 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:34:18.078 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:34:18.093 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:34:18.141 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:34:18.141 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:34:18.141 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:34:18.142 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:34:18.143 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:34:18.143 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:34:18.143 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:34:18.143 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:34:18.143 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:34:18.143 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:34:18.143 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:34:18.143 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:34:18.143 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:34:18.144 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:34:18.144 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:34:18.144 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:34:18.144 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:34:18.144 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:34:18.144 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:34:18.144 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:34:18.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:18.145 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:34:18.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:34:18.156+0000 7f0d7e8b2580 -1 init, newargv = 0x55dc2ed7c420 newargc=15 2024-09-19T05:34:18.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[37956]: starting ceph client 2024-09-19T05:34:18.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[37956]: starting fuse 2024-09-19T05:34:19.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:34:19.279 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:34:19.327 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:34:19.327 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:34:19.327 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:34:19.327 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:34:19.327 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:34:19.327 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:34:19.327 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:34:19.327 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:34:19.327 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:34:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:34:19.329 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:34:19.330 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:34:19.330 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:34:19.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:19.330 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:34:19.373 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:34:19.373 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:34:19.373 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:34:19.373 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:34:19.374 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:34:19.375 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:34:19.375 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:34:19.375 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:34:19.375 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:34:19.375 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:34:19.375 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:34:19.375 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:34:19.375 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:34:19.375 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:34:19.375 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:34:19.501 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.37956.asok 2024-09-19T05:34:19.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:34:19.513 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37956.asok 2024-09-19T05:34:19.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:19.514 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37956.asok status 2024-09-19T05:34:19.675 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:34:19.675 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:34:19.675 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:34:19.675 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "37956", 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 5112, 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 5112 2024-09-19T05:34:19.676 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 2047425368 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 2047425368 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.5112 192.168.0.1:0/2047425368", 2024-09-19T05:34:19.677 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/2047425368", 2024-09-19T05:34:19.678 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:34:19.678 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 15, 2024-09-19T05:34:19.678 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 39, 2024-09-19T05:34:19.678 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:34:19.678 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:34:19.678 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:34:19.678 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:34:19.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:19.689 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:34:19.690 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:34:19.695 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:34:19.696 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:34:19.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:19.696 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:34:19.748 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-19T05:34:19.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f1162c32640 1 Processor -- start 2024-09-19T05:34:19.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f1162c32640 1 -- start start 2024-09-19T05:34:19.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f1162c32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f115c15e6f0 0x7f115c0d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:19.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f1162c32640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f115c0b6680 0x7f115c0d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:19.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f1162c32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115c15ead0 con 0x7f115c0cfe30 2024-09-19T05:34:19.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f1162c32640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f115c0ceb40 con 0x7f115c0b6680 2024-09-19T05:34:19.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f1162c32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f115c0ced90 con 0x7f115c15e6f0 2024-09-19T05:34:19.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f11611cf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f115c0b6680 0x7f115c0d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:19.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f11611cf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f115c0b6680 0x7f115c0d35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46642/0 (socket says 172.21.15.67:46642) 2024-09-19T05:34:19.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f11611cf640 1 -- 172.21.15.67:0/3275657068 learned_addr learned my addr 172.21.15.67:0/3275657068 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:19.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f11609ce640 1 --2- 172.21.15.67:0/3275657068 >> v2:172.21.15.97:3300/0 conn(0x7f115c15e6f0 0x7f115c0d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:19.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f11611cf640 1 -- 172.21.15.67:0/3275657068 >> v2:172.21.15.97:3300/0 conn(0x7f115c15e6f0 msgr2=0x7f115c0d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:19.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f11611cf640 1 --2- 172.21.15.67:0/3275657068 >> v2:172.21.15.97:3300/0 conn(0x7f115c15e6f0 0x7f115c0d3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:19.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f11611cf640 1 -- 172.21.15.67:0/3275657068 >> v1:172.21.15.97:6789/0 conn(0x7f115c0cfe30 legacy=0x7f115c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:19.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f11611cf640 1 -- 172.21.15.67:0/3275657068 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c0cf070 con 0x7f115c0b6680 2024-09-19T05:34:19.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.932+0000 7f11611cf640 1 --2- 172.21.15.67:0/3275657068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0b6680 0x7f115c0d35d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f115c08dd40 tx=0x7f115401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963174a738ffd486 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:19.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f11537fe640 1 -- 172.21.15.67:0/3275657068 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11540a5610 con 0x7f115c0b6680 2024-09-19T05:34:19.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f11537fe640 1 -- 172.21.15.67:0/3275657068 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11540a57b0 con 0x7f115c0b6680 2024-09-19T05:34:19.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f11537fe640 1 -- 172.21.15.67:0/3275657068 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11540a5b80 con 0x7f115c0b6680 2024-09-19T05:34:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- 172.21.15.67:0/3275657068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0b6680 msgr2=0x7f115c0d35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 --2- 172.21.15.67:0/3275657068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0b6680 0x7f115c0d35d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f115c08dd40 tx=0x7f115401c860 comp rx=0 tx=0).stop 2024-09-19T05:34:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- 172.21.15.67:0/3275657068 shutdown_connections 2024-09-19T05:34:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 --2- 172.21.15.67:0/3275657068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0b6680 0x7f115c0d35d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 --2- 172.21.15.67:0/3275657068 >> v2:172.21.15.97:3300/0 conn(0x7f115c15e6f0 0x7f115c0d3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- 172.21.15.67:0/3275657068 >> 172.21.15.67:0/3275657068 conn(0x7f115c08bfc0 msgr2=0x7f115c0d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- 172.21.15.67:0/3275657068 shutdown_connections 2024-09-19T05:34:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- 172.21.15.67:0/3275657068 wait complete. 2024-09-19T05:34:19.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 Processor -- start 2024-09-19T05:34:19.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- start start 2024-09-19T05:34:19.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f115c0b6680 0x7f115c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:19.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0cfe30 0x7f115c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:19.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f115c15e6f0 0x7f115c151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:19.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f115c06d770 con 0x7f115c0cfe30 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f115c06d5f0 con 0x7f115c15e6f0 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f115c06d8f0 con 0x7f115c0b6680 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1153fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0cfe30 0x7f115c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1153fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0cfe30 0x7f115c15a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46652/0 (socket says 172.21.15.67:46652) 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1153fff640 1 -- 172.21.15.67:0/3721473061 learned_addr learned my addr 172.21.15.67:0/3721473061 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f11611cf640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f115c15e6f0 0x7f115c151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1153fff640 1 -- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f115c0b6680 msgr2=0x7f115c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1153fff640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f115c0b6680 0x7f115c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1153fff640 1 -- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f115c15e6f0 msgr2=0x7f115c151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1153fff640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f115c15e6f0 0x7f115c151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1153fff640 1 -- 172.21.15.67:0/3721473061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c158af0 con 0x7f115c0cfe30 2024-09-19T05:34:19.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1153fff640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0cfe30 0x7f115c15a4a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c440 tx=0x7f114c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:19.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f11517fa640 1 -- 172.21.15.67:0/3721473061 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c016020 con 0x7f115c0cfe30 2024-09-19T05:34:19.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f11517fa640 1 -- 172.21.15.67:0/3721473061 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f114c012830 con 0x7f115c0cfe30 2024-09-19T05:34:19.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- 172.21.15.67:0/3721473061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115c158dd0 con 0x7f115c0cfe30 2024-09-19T05:34:19.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f11517fa640 1 -- 172.21.15.67:0/3721473061 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c012c20 con 0x7f115c0cfe30 2024-09-19T05:34:19.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.936+0000 7f1162c32640 1 -- 172.21.15.67:0/3721473061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115c152220 con 0x7f115c0cfe30 2024-09-19T05:34:19.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.940+0000 7f1162c32640 1 -- 172.21.15.67:0/3721473061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f115c0b5f70 con 0x7f115c0cfe30 2024-09-19T05:34:19.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.940+0000 7f11517fa640 1 -- 172.21.15.67:0/3721473061 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f114c019020 con 0x7f115c0cfe30 2024-09-19T05:34:19.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.940+0000 7f11517fa640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11480678c0 0x7f1148069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:19.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.940+0000 7f11517fa640 1 -- 172.21.15.67:0/3721473061 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f114c085dd0 con 0x7f115c0cfe30 2024-09-19T05:34:19.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.940+0000 7f11609ce640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11480678c0 0x7f1148069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:19.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.940+0000 7f11609ce640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11480678c0 0x7f1148069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f115800b850 tx=0x7f1158008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:19.944+0000 7f11517fa640 1 -- 172.21.15.67:0/3721473061 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f114c020020 con 0x7f115c0cfe30 2024-09-19T05:34:20.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.148+0000 7f1162c32640 1 -- 172.21.15.67:0/3721473061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f115c0b6e20 con 0x7f115c0cfe30 2024-09-19T05:34:20.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.204+0000 7f11517fa640 1 -- 172.21.15.67:0/3721473061 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v16) ==== 167+0+0 (secure 0 0 0) 0x7f114c087020 con 0x7f115c0cfe30 2024-09-19T05:34:20.206 INFO:teuthology.orchestra.run.smithi067.stderr:enabled new snapshots 2024-09-19T05:34:20.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 -- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11480678c0 msgr2=0x7f1148069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11480678c0 0x7f1148069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f115800b850 tx=0x7f1158008040 comp rx=0 tx=0).stop 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 -- 172.21.15.67:0/3721473061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0cfe30 msgr2=0x7f115c15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0cfe30 0x7f115c15a4a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c440 tx=0x7f114c00c900 comp rx=0 tx=0).stop 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 -- 172.21.15.67:0/3721473061 shutdown_connections 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f115c15e6f0 0x7f115c151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115c0cfe30 0x7f115c15a4a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11480678c0 0x7f1148069d80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 --2- 172.21.15.67:0/3721473061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f115c0b6680 0x7f115c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 -- 172.21.15.67:0/3721473061 >> 172.21.15.67:0/3721473061 conn(0x7f115c08bfc0 msgr2=0x7f115c0d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 -- 172.21.15.67:0/3721473061 shutdown_connections 2024-09-19T05:34:20.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:20.208+0000 7f1162c32640 1 -- 172.21.15.67:0/3721473061 wait complete. 2024-09-19T05:34:20.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:20.229 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-19T05:34:20.243 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:34:20.243 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:34:20.290 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:34:20.290 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:34:20.290 DEBUG:teuthology.orchestra.run.smithi067:> import uuid 2024-09-19T05:34:20.290 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:34:20.290 DEBUG:teuthology.orchestra.run.smithi067:> n = 2000 2024-09-19T05:34:20.290 DEBUG:teuthology.orchestra.run.smithi067:> create_hard_links = False 2024-09-19T05:34:20.290 DEBUG:teuthology.orchestra.run.smithi067:> if 3 > 0: 2024-09-19T05:34:20.290 DEBUG:teuthology.orchestra.run.smithi067:> create_hard_links = True 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> dpath = os.path.dirname(path) 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> fnameprefix = os.path.basename(path) 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> os.makedirs(dpath, exist_ok=True) 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> try: 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> for i in range(n): 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> with open(fpath, '"'"'w'"'"') as f: 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> f.write(f"{i}") 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:34:20.291 DEBUG:teuthology.orchestra.run.smithi067:> f.flush() 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(f.fileno()) 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> os.unlink(fpath) 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(dirfd) 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> if create_hard_links: 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> for j in range(3): 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(dirfd) 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> finally: 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> os.close(dirfd) 2024-09-19T05:34:20.292 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:34:38.046 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:34:38.048 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:34:44.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:34:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:34:44.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:44.893 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-19T05:34:44.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:34:44.931 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-19T05:35:08.557 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:35:08.560 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:35:38.609 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:35:38.612 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:35:45.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:35:45.627 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-19T05:35:45.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-19T05:35:45.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.830+0000 7f889e4de640 1 Processor -- start 2024-09-19T05:35:45.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.830+0000 7f889e4de640 1 -- start start 2024-09-19T05:35:45.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f889e4de640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f889815c2b0 0x7f88980d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f889e4de640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8898067a00 0x7f889806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f889e4de640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8898067fa0 con 0x7f889806d210 2024-09-19T05:35:45.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f889e4de640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f88980b4200 con 0x7f8898067a00 2024-09-19T05:35:45.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f889e4de640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f88980b3bb0 con 0x7f889815c2b0 2024-09-19T05:35:45.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f889ca7b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f889806d210 0x7f889815fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50008/0 (socket says 172.21.15.67:50008) 2024-09-19T05:35:45.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f889ca7b640 1 -- 172.21.15.67:0/3497963784 learned_addr learned my addr 172.21.15.67:0/3497963784 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:35:45.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f88977fe640 1 --2- 172.21.15.67:0/3497963784 >> v2:172.21.15.97:3300/0 conn(0x7f8898067a00 0x7f889806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8897fff640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f889815c2b0 0x7f88980d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964029588 0 0) 0x7f8898067fa0 con 0x7f889806d210 2024-09-19T05:35:45.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8884003530 con 0x7f889806d210 2024-09-19T05:35:45.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1716120922 0 0) 0x7f8884003530 con 0x7f889806d210 2024-09-19T05:35:45.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f889815c2b0 msgr2=0x7f88980d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f889815c2b0 0x7f88980d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 >> v2:172.21.15.97:3300/0 conn(0x7f8898067a00 msgr2=0x7f889806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 --2- 172.21.15.67:0/3497963784 >> v2:172.21.15.97:3300/0 conn(0x7f8898067a00 0x7f889806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88980b3e90 con 0x7f889806d210 2024-09-19T05:35:45.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f8888001680 con 0x7f889806d210 2024-09-19T05:35:45.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 >> v1:172.21.15.67:6789/0 conn(0x7f889806d210 legacy=0x7f889815fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:45.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840039c0 0x7f8884003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8884004810 0x7f8884004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f889815c2b0 0x7f88840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f88980b4200 con 0x7f88840039c0 2024-09-19T05:35:45.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f88980b3bb0 con 0x7f8884004810 2024-09-19T05:35:45.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f888400b9d0 con 0x7f889815c2b0 2024-09-19T05:35:45.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8897fff640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840039c0 0x7f8884003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f88977fe640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8884004810 0x7f8884004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8897fff640 1 -- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f889815c2b0 msgr2=0x7f88840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f889ca7b640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f889815c2b0 0x7f88840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8897fff640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f889815c2b0 0x7f88840051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8897fff640 1 -- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8884004810 msgr2=0x7f8884004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8897fff640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8884004810 0x7f8884004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f8897fff640 1 -- 172.21.15.67:0/3497963784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8884003530 con 0x7f88840039c0 2024-09-19T05:35:45.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.834+0000 7f88977fe640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8884004810 0x7f8884004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:35:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f8897fff640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840039c0 0x7f8884003de0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8890009fc0 tx=0x7f889001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87e458eb21bb6e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88900b2070 con 0x7f88840039c0 2024-09-19T05:35:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88900a5bb0 con 0x7f88840039c0 2024-09-19T05:35:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f8896ffd640 1 -- 172.21.15.67:0/3497963784 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890009c10 con 0x7f88840039c0 2024-09-19T05:35:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 -- 172.21.15.67:0/3497963784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840039c0 msgr2=0x7f8884003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 --2- 172.21.15.67:0/3497963784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840039c0 0x7f8884003de0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8890009fc0 tx=0x7f889001cc80 comp rx=0 tx=0).stop 2024-09-19T05:35:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889ca7b640 1 -- 172.21.15.67:0/3497963784 reap_dead start 2024-09-19T05:35:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 -- 172.21.15.67:0/3497963784 shutdown_connections 2024-09-19T05:35:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 -- 172.21.15.67:0/3497963784 >> 172.21.15.67:0/3497963784 conn(0x7f88980727b0 msgr2=0x7f8898072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 -- 172.21.15.67:0/3497963784 shutdown_connections 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 -- 172.21.15.67:0/3497963784 wait complete. 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 Processor -- start 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 -- start start 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88840039c0 0x7f889806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88980a9490 0x7f8898141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8898142030 0x7f8898147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f88981670c0 con 0x7f88980a9490 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f889806d660 con 0x7f8898142030 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f889e4de640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8898167240 con 0x7f88840039c0 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.838+0000 7f88977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88980a9490 0x7f8898141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f88977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88980a9490 0x7f8898141af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44900/0 (socket says 172.21.15.67:44900) 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f88977fe640 1 -- 172.21.15.67:0/3818202854 learned_addr learned my addr 172.21.15.67:0/3818202854 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f8897fff640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88840039c0 0x7f889806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f889ca7b640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8898142030 0x7f8898147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f88977fe640 1 -- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88840039c0 msgr2=0x7f889806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f88977fe640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88840039c0 0x7f889806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f88977fe640 1 -- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8898142030 msgr2=0x7f8898147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f88977fe640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8898142030 0x7f8898147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f88977fe640 1 -- 172.21.15.67:0/3818202854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88980a9950 con 0x7f88980a9490 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f889ca7b640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8898142030 0x7f8898147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f88977fe640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88980a9490 0x7f8898141af0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8880010920 tx=0x7f8880010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f8894ff9640 1 -- 172.21.15.67:0/3818202854 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888000f040 con 0x7f88980a9490 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f8894ff9640 1 -- 172.21.15.67:0/3818202854 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888000ebc0 con 0x7f88980a9490 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f8894ff9640 1 -- 172.21.15.67:0/3818202854 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888001c400 con 0x7f88980a9490 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f889e4de640 1 -- 172.21.15.67:0/3818202854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8898166980 con 0x7f88980a9490 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f889e4de640 1 -- 172.21.15.67:0/3818202854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8898166c60 con 0x7f88980a9490 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f8894ff9640 1 -- 172.21.15.67:0/3818202854 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f888001c5a0 con 0x7f88980a9490 2024-09-19T05:35:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f8894ff9640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f88780678f0 0x7f8878069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f8894ff9640 1 -- 172.21.15.67:0/3818202854 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f8880086100 con 0x7f88980a9490 2024-09-19T05:35:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.842+0000 7f8897fff640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f88780678f0 0x7f8878069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 Processor -- start 2024-09-19T05:35:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 -- start start 2024-09-19T05:35:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f8897fff640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f88780678f0 0x7f8878069db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f88900af000 tx=0x7f8890004ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:45.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee84cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 0x5643ee800240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee800b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5643ee651cc0 con 0x5643ee800780 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5643ee60ca20 con 0x5643ee84cc10 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5643ee64dc80 con 0x5643ee84d530 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f889ca7b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee800b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f889ca7b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee800b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44906/0 (socket says 172.21.15.67:44906) 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f889ca7b640 1 -- 172.21.15.67:0/150819184 learned_addr learned my addr 172.21.15.67:0/150819184 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f8897fff640 1 --2- 172.21.15.67:0/150819184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee84cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88977fe640 1 --2- 172.21.15.67:0/150819184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 0x5643ee800240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f889ca7b640 1 -- 172.21.15.67:0/150819184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 msgr2=0x5643ee800240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f889ca7b640 1 --2- 172.21.15.67:0/150819184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 0x5643ee800240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f889ca7b640 1 -- 172.21.15.67:0/150819184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 msgr2=0x5643ee84cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f889ca7b640 1 --2- 172.21.15.67:0/150819184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee84cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f889ca7b640 1 -- 172.21.15.67:0/150819184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643ee5f4d40 con 0x5643ee800780 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f889ca7b640 1 --2- 172.21.15.67:0/150819184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee800b60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8888000f70 tx=0x7f8888001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f067d68fa0d33cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f888dffb640 1 -- 172.21.15.67:0/150819184 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888018070 con 0x5643ee800780 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f888dffb640 1 -- 172.21.15.67:0/150819184 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888007500 con 0x5643ee800780 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f888dffb640 1 -- 172.21.15.67:0/150819184 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888004a30 con 0x5643ee800780 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 -- 172.21.15.67:0/150819184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 msgr2=0x5643ee800b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 --2- 172.21.15.67:0/150819184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee800b60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8888000f70 tx=0x7f8888001e80 comp rx=0 tx=0).stop 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 -- 172.21.15.67:0/150819184 shutdown_connections 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 --2- 172.21.15.67:0/150819184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee800b60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 --2- 172.21.15.67:0/150819184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 0x5643ee800240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 --2- 172.21.15.67:0/150819184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee84cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 -- 172.21.15.67:0/150819184 >> 172.21.15.67:0/150819184 conn(0x5643ee82d9b0 msgr2=0x5643ee82fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 -- 172.21.15.67:0/150819184 shutdown_connections 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 -- 172.21.15.67:0/150819184 wait complete. 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 -- start start 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.846+0000 7f88a159a000 1 Processor -- start 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee853f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee8544b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 0x5643ee806450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5643ee5eb2c0 con 0x5643ee800780 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5643ee610370 con 0x5643ee84cc10 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5643ee65ff50 con 0x5643ee84d530 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 10 client.0 _ll_register_callbacks cb 0x5643ee6b2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8897fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee853f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8897fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee853f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44916/0 (socket says 172.21.15.67:44916) 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8897fff640 1 -- 172.21.15.67:0/1210018517 learned_addr learned my addr 172.21.15.67:0/1210018517 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88977fe640 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee8544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f889ca7b640 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 0x5643ee806450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8897fff640 1 -- 172.21.15.67:0/1210018517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 msgr2=0x5643ee806450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8897fff640 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 0x5643ee806450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8897fff640 1 -- 172.21.15.67:0/1210018517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 msgr2=0x5643ee8544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8897fff640 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee8544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8897fff640 1 -- 172.21.15.67:0/1210018517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643ee5f1770 con 0x5643ee800780 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f889ca7b640 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 0x5643ee806450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8897fff640 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee853f70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f889001c6f0 tx=0x7f8890019a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac59acbfb55d224 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8876ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8876ffd640 1 -- 172.21.15.67:0/1210018517 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88900b2040 con 0x5643ee800780 2024-09-19T05:35:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8876ffd640 1 -- 172.21.15.67:0/1210018517 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f88900045d0 con 0x5643ee800780 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- 172.21.15.67:0/1210018517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8888007500 con 0x5643ee800780 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8876ffd640 1 -- 172.21.15.67:0/1210018517 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f88900cf050 con 0x5643ee800780 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 10 client.5130 fetch_fsmap learned FSMap version 16 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- 172.21.15.67:0/1210018517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5643ee60f3f0 con 0x5643ee800780 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8876ffd640 1 -- 172.21.15.67:0/1210018517 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888007500 con 0x5643ee800780 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8876ffd640 1 -- 172.21.15.67:0/1210018517 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f88900d2020 con 0x5643ee800780 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 10 client.5130 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 10 client.5130 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 20 client.5130 populate_metadata read hostname 'smithi067' 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5643ee806e60 0x5643ee807270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 4 client.5130 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:35:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- 172.21.15.67:0/1210018517 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643ee5ebd90 con 0x5643ee806e60 2024-09-19T05:35:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88977fe640 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5643ee806e60 0x5643ee807270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88977fe640 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5643ee806e60 0x5643ee807270 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7e66131ec7faab server_cookie=773ff061b07f64e5 in_seq=0 out_seq=0 2024-09-19T05:35:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8876ffd640 10 client.5130 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8876ffd640 1 -- 172.21.15.67:0/1210018517 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643ee5ebd90 con 0x5643ee806e60 2024-09-19T05:35:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8876ffd640 10 client.5130 handle_command_reply: tid=0 2024-09-19T05:35:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 client.5130 shutdown 2024-09-19T05:35:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- 172.21.15.67:0/1210018517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 msgr2=0x5643ee853f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee853f70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f889001c6f0 tx=0x7f8890019a20 comp rx=0 tx=0).stop 2024-09-19T05:35:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- 172.21.15.67:0/1210018517 shutdown_connections 2024-09-19T05:35:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5643ee806e60 0x5643ee807270 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee84d530 0x5643ee806450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee8544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f8876ffd640 0 client.5130 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 --2- 172.21.15.67:0/1210018517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee800780 0x5643ee853f70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- 172.21.15.67:0/1210018517 >> 172.21.15.67:0/1210018517 conn(0x5643ee82d9b0 msgr2=0x5643ee7ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- 172.21.15.67:0/1210018517 shutdown_connections 2024-09-19T05:35:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 1 -- 172.21.15.67:0/1210018517 wait complete. 2024-09-19T05:35:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.850+0000 7f88a159a000 20 client.5130 trim_cache size 0 max 16384 2024-09-19T05:35:45.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 Processor -- start 2024-09-19T05:35:45.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 -- start start 2024-09-19T05:35:45.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee800780 0x5643ee85a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee808250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee808790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f88982042c0 con 0x5643ee84d530 2024-09-19T05:35:45.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f88981fb240 con 0x5643ee84cc10 2024-09-19T05:35:45.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f88981fb890 con 0x5643ee800780 2024-09-19T05:35:45.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f889ca7b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee808790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f889ca7b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee808790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44924/0 (socket says 172.21.15.67:44924) 2024-09-19T05:35:45.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f889ca7b640 1 -- 172.21.15.67:0/3482605768 learned_addr learned my addr 172.21.15.67:0/3482605768 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:45.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f8897fff640 1 --2- 172.21.15.67:0/3482605768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee800780 0x5643ee85a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88977fe640 1 --2- 172.21.15.67:0/3482605768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee808250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f889ca7b640 1 -- 172.21.15.67:0/3482605768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee800780 msgr2=0x5643ee85a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f889ca7b640 1 --2- 172.21.15.67:0/3482605768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee800780 0x5643ee85a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f889ca7b640 1 -- 172.21.15.67:0/3482605768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 msgr2=0x5643ee808250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f889ca7b640 1 --2- 172.21.15.67:0/3482605768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee808250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f889ca7b640 1 -- 172.21.15.67:0/3482605768 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643ee84d360 con 0x5643ee84d530 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88977fe640 1 --2- 172.21.15.67:0/3482605768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee808250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f889ca7b640 1 --2- 172.21.15.67:0/3482605768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee808790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f88980739b0 tx=0x7f8888006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20f1586f063b5fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f888d7fa640 1 -- 172.21.15.67:0/3482605768 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888024070 con 0x5643ee84d530 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f888d7fa640 1 -- 172.21.15.67:0/3482605768 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88880072e0 con 0x5643ee84d530 2024-09-19T05:35:45.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f888d7fa640 1 -- 172.21.15.67:0/3482605768 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888018030 con 0x5643ee84d530 2024-09-19T05:35:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 -- 172.21.15.67:0/3482605768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 msgr2=0x5643ee808790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 --2- 172.21.15.67:0/3482605768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee808790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f88980739b0 tx=0x7f8888006000 comp rx=0 tx=0).stop 2024-09-19T05:35:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 -- 172.21.15.67:0/3482605768 shutdown_connections 2024-09-19T05:35:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 --2- 172.21.15.67:0/3482605768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee808790 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 --2- 172.21.15.67:0/3482605768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee808250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 --2- 172.21.15.67:0/3482605768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee800780 0x5643ee85a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 -- 172.21.15.67:0/3482605768 >> 172.21.15.67:0/3482605768 conn(0x5643ee82d9b0 msgr2=0x5643ee7fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 -- 172.21.15.67:0/3482605768 shutdown_connections 2024-09-19T05:35:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 -- 172.21.15.67:0/3482605768 wait complete. 2024-09-19T05:35:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 -- start start 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.870+0000 7f88a159a000 1 Processor -- start 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee800780 0x5643ee864420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee857d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee8582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5643ee5f9120 con 0x5643ee84d530 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5643ee6d2e90 con 0x5643ee84cc10 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5643ee5fbb90 con 0x5643ee800780 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 10 client.0 _ll_register_callbacks cb 0x7f88900b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889ca7b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee8582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889ca7b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee8582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44934/0 (socket says 172.21.15.67:44934) 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889ca7b640 1 -- 172.21.15.67:0/3928706727 learned_addr learned my addr 172.21.15.67:0/3928706727 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88977fe640 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee857d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8897fff640 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee800780 0x5643ee864420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889ca7b640 1 -- 172.21.15.67:0/3928706727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee800780 msgr2=0x5643ee864420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889ca7b640 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee800780 0x5643ee864420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889ca7b640 1 -- 172.21.15.67:0/3928706727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 msgr2=0x5643ee857d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889ca7b640 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee857d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889ca7b640 1 -- 172.21.15.67:0/3928706727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643ee6d3320 con 0x5643ee84d530 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88977fe640 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee857d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889ca7b640 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee8582c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8888009010 tx=0x7f88980737f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8f4ec2d4bbe593 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8876ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8876ffd640 1 -- 172.21.15.67:0/3928706727 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888024040 con 0x5643ee84d530 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8876ffd640 1 -- 172.21.15.67:0/3928706727 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f8888004da0 con 0x5643ee84d530 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- 172.21.15.67:0/3928706727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88880072e0 con 0x5643ee84d530 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8876ffd640 1 -- 172.21.15.67:0/3928706727 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8888036050 con 0x5643ee84d530 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 10 client.5136 fetch_fsmap learned FSMap version 16 2024-09-19T05:35:45.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- 172.21.15.67:0/3928706727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5643ee5e55c0 con 0x5643ee84d530 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8876ffd640 1 -- 172.21.15.67:0/3928706727 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88880072e0 con 0x5643ee84d530 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8876ffd640 1 -- 172.21.15.67:0/3928706727 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f8888039020 con 0x5643ee84d530 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 10 client.5136 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 10 client.5136 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 20 client.5136 populate_metadata read hostname 'smithi067' 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5643ee858800 0x5643ee8c0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 4 client.5136 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- 172.21.15.67:0/3928706727 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "perf dump"}) -- 0x5643ee65f3f0 con 0x5643ee858800 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8897fff640 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5643ee858800 0x5643ee8c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8897fff640 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5643ee858800 0x5643ee8c0820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e5e8822c6fdf5fb server_cookie=2ca8ddecd2611e9e in_seq=0 out_seq=0 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8876ffd640 10 client.5136 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8876ffd640 1 -- 172.21.15.67:0/3928706727 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17995 (crc 0 0 0) 0x5643ee65f3f0 con 0x5643ee858800 2024-09-19T05:35:45.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8876ffd640 10 client.5136 handle_command_reply: tid=0 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 client.5136 shutdown 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- 172.21.15.67:0/3928706727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 msgr2=0x5643ee8582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee8582c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8888009010 tx=0x7f88980737f0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- 172.21.15.67:0/3928706727 shutdown_connections 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5643ee858800 0x5643ee8c0820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5643ee84d530 0x5643ee8582c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5643ee84cc10 0x5643ee857d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 --2- 172.21.15.67:0/3928706727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5643ee800780 0x5643ee864420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f8876ffd640 0 client.5136 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- 172.21.15.67:0/3928706727 >> 172.21.15.67:0/3928706727 conn(0x5643ee82d9b0 msgr2=0x5643ee863b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- 172.21.15.67:0/3928706727 shutdown_connections 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 1 -- 172.21.15.67:0/3928706727 wait complete. 2024-09-19T05:35:45.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f88a159a000 20 client.5136 trim_cache size 0 max 16384 2024-09-19T05:35:45.891 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:35:45.891 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:35:45.891 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 4109, 2024-09-19T05:35:45.891 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 4110, 2024-09-19T05:35:45.891 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 1022123, 2024-09-19T05:35:45.891 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 39208631, 2024-09-19T05:35:45.891 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 9, 2024-09-19T05:35:45.891 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 3, 2024-09-19T05:35:45.891 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.493400538, 2024-09-19T05:35:45.891 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.213144856, 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.096645193, 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.145508230, 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 4109, 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.550128534, 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000133883 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2, 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000269, 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000134 2024-09-19T05:35:45.892 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 2781, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 2804, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 689604, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 17800484, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 6, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.276215546, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.109107041, 2024-09-19T05:35:45.893 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.059109175, 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.089188396, 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2802, 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.382092132, 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000136364 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T05:35:45.894 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 122720 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 34265, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 60519, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 12490264, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 58739297, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 7, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 4.990178790, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 2.533594288, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 2.935312245, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.093201507, 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:35:45.895 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 60519, 2024-09-19T05:35:45.896 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 2.306895385, 2024-09-19T05:35:45.896 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000038118 2024-09-19T05:35:45.896 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.896 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:35:45.896 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 87468, 2024-09-19T05:35:45.896 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.021573283, 2024-09-19T05:35:45.896 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000246 2024-09-19T05:35:45.896 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.896 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 118736, 2024-09-19T05:35:45.896 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 25968 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 1, 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-MDSRank": { 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8955, 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 24.303662727, 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.002713976 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:45.897 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-PurgeQueue": { 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1874, 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 1.235354694, 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000659207 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "request": 26394, 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "reply": 26394, 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "reply_latency": { 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 26394, 2024-09-19T05:35:45.898 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 430.831659617, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.016323090 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_reply": 0, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "forward": 0, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_complete": 0, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_keys": 0, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_commit": 12, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_split": 0, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_merge": 0, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes": 19836, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_top": 0, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_bottom": 19836, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pin_tail": 0, 2024-09-19T05:35:45.899 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pinned": 19836, 2024-09-19T05:35:45.900 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_expired": 0, 2024-09-19T05:35:45.900 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_with_caps": 279, 2024-09-19T05:35:45.900 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": 279, 2024-09-19T05:35:45.900 INFO:teuthology.orchestra.run.smithi067.stdout: "subtrees": 2, 2024-09-19T05:35:45.900 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse": 41998, 2024-09-19T05:35:45.900 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_hit": 41474, 2024-09-19T05:35:45.900 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_forward": 0, 2024-09-19T05:35:45.900 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_discover": 0, 2024-09-19T05:35:45.900 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_dir_fetch": 0, 2024-09-19T05:35:45.900 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_remote_ino": 0, 2024-09-19T05:35:45.901 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_lock": 115, 2024-09-19T05:35:45.901 INFO:teuthology.orchestra.run.smithi067.stdout: "load_cent": 0, 2024-09-19T05:35:45.901 INFO:teuthology.orchestra.run.smithi067.stdout: "q": 0, 2024-09-19T05:35:45.901 INFO:teuthology.orchestra.run.smithi067.stdout: "exported": 0, 2024-09-19T05:35:45.901 INFO:teuthology.orchestra.run.smithi067.stdout: "exported_inodes": 0, 2024-09-19T05:35:45.901 INFO:teuthology.orchestra.run.smithi067.stdout: "imported": 0, 2024-09-19T05:35:45.901 INFO:teuthology.orchestra.run.smithi067.stdout: "imported_inodes": 0, 2024-09-19T05:35:45.901 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_dir_fetch": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_backtrace_fetch": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_peer_discover": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rfiles": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rbytes": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rsnaps": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_set_tag": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_inodes": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T05:35:45.902 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_file_inodes": 0, 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_inode_file_caps": 0, 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_revoke": 7721, 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_grant": 6391, 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps": 7721, 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps_dirty": 2000, 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_cap_release": 49, 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: "process_request_cap_release": 17979 2024-09-19T05:35:45.903 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.904 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_cache": { 2024-09-19T05:35:45.904 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update": 0, 2024-09-19T05:35:45.904 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update_receipt": 0, 2024-09-19T05:35:45.904 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_try_discover": 0, 2024-09-19T05:35:45.904 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_send_discover": 0, 2024-09-19T05:35:45.904 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_handle_discover": 0, 2024-09-19T05:35:45.904 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays": 2000, 2024-09-19T05:35:45.904 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_delayed": 85, 2024-09-19T05:35:45.904 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_created": 4087, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_enqueued": 1640, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_reintegrated": 2144, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_migrated": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_processing": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_started": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_completed": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_exportdir": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_flush": 0, 2024-09-19T05:35:45.905 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragmentdir": 0, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragstats": 0, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_inodestats": 0 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_log": { 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "evlrg": 0, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "evadd": 23756, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "evex": 0, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "evtrm": 0, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "ev": 23756, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "evexg": 0, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "evexd": 0, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "segadd": 31, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "segex": 0, 2024-09-19T05:35:45.906 INFO:teuthology.orchestra.run.smithi067.stdout: "segtrm": 0, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "seg": 31, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "segmjr": 3, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "segexg": 0, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "segexd": 0, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "expos": 4194304, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "wrpos": 85376740, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "rdpos": 0, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "jlat": { 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6888, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 113.958084779, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.016544437 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.907 INFO:teuthology.orchestra.run.smithi067.stdout: "replayed": 0 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_mem": { 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 2014, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "ino+": 2014, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "ino-": 0, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "dir": 13, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "dir+": 13, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "dir-": 0, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "dn": 19836, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "dn+": 19836, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "dn-": 0, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "cap": 279, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "cap+": 2002, 2024-09-19T05:35:45.908 INFO:teuthology.orchestra.run.smithi067.stdout: "cap-": 1723, 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "rss": 102180, 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "heap": 231732 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_server": { 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_client_request": 35266, 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_server_request": 0, 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_request": 26394, 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_session": 7, 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_peer_request": 0, 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "req_create_latency": { 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2000, 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 1.691374771, 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000845687 2024-09-19T05:35:45.909 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getattr_latency": { 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 268, 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.090428910, 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000337421 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getfilelock_latency": { 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "req_link_latency": { 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6000, 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 10.270894041, 2024-09-19T05:35:45.910 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001711815 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookup_latency": { 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7969, 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 8.483531645, 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001064566 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookuphash_latency": { 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupino_latency": { 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.911 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupname_latency": { 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupparent_latency": { 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupsnap_latency": { 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3, 2024-09-19T05:35:45.912 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.024818685, 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.008272895 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lssnap_latency": { 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mkdir_latency": { 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.004153608, 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.004153608 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mknod_latency": { 2024-09-19T05:35:45.913 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mksnap_latency": { 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.005662277, 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005662277 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "req_open_latency": { 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "req_readdir_latency": { 2024-09-19T05:35:45.914 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6, 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.171986435, 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.028664405 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rename_latency": { 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2144, 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 374.327927650, 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.174593249 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "req_renamesnap_latency": { 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.915 INFO:teuthology.orchestra.run.smithi067.stdout: "req_snapdiff_latency": { 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmdir_latency": { 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmsnap_latency": { 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.005294039, 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005294039 2024-09-19T05:35:45.916 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmxattr_latency": { 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setattr_latency": { 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000519393, 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000519393 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setdirlayout_latency": { 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.917 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.918 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.918 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setfilelock_latency": { 2024-09-19T05:35:45.918 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.918 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.918 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.918 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.918 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setlayout_latency": { 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setxattr_latency": { 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "req_symlink_latency": { 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.919 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: "req_unlink_latency": { 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8000, 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 35.755068163, 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.004469383 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getvxattr_latency": { 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.920 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_sessions": { 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "session_count": 1, 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "session_add": 1, 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "session_remove": 0, 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_open": 1, 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_stale": 0, 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "total_load": 15009, 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "average_load": 15009, 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "avg_session_uptime": 87, 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "mdthresh_evicted": 0 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.921 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:35:45.922 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:35:45.923 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 16299955, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 4096, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-19T05:35:45.924 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 5520, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 78, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 21081527, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 812701, 2024-09-19T05:35:45.925 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "objecter": { 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "op_active": 0, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "op_laggy": 0, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send": 8951, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send_bytes": 81481843, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "op_resend": 37, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "op_reply": 8951, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "op_latency": { 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8951, 2024-09-19T05:35:45.926 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 45.515070632, 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005084914 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "op_inflight": 0, 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "oplen_avg": { 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8951, 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 9108 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "op": 8951, 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "op_r": 110, 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "op_w": 8841, 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "op_rmw": 0, 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "op_pg": 0, 2024-09-19T05:35:45.927 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_stat": 0, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_create": 11, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_read": 110, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_write": 6998, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writefull": 62, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writesame": 0, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_append": 0, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_zero": 1640, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_truncate": 0, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_delete": 31, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_mapext": 0, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_sparse_read": 0, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_clonerange": 0, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_getxattr": 0, 2024-09-19T05:35:45.928 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_setxattr": 22, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_rmxattr": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_call": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_watch": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_notify": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_other": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_active": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_send": 0, 2024-09-19T05:35:45.929 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_resend": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_ping": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_active": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_send": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_resend": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_active": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_send": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_resend": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_active": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_send": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_resend": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "command_active": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "command_send": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "command_resend": 0, 2024-09-19T05:35:45.930 INFO:teuthology.orchestra.run.smithi067.stdout: "map_epoch": 41, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "map_full": 0, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "map_inc": 3, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_sessions": 8, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_open": 8, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_close": 0, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_laggy": 0, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_wr": 184, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_rd": 0, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_del": 50 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "oft": { 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_objs": 1, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:35:45.931 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_updates": 0, 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_removes": 0 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "osd-slow-ops": { 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_ops_count": 0 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "purge_queue": { 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops": 0, 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops_high_water": 32, 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing": 0, 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_high_water": 32, 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed_ops": 1640, 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed": 1640, 2024-09-19T05:35:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_item_in_journal": 0 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 41150, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 10492986, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 41150, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 41150, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 10492986, 2024-09-19T05:35:45.933 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_bytes": { 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-19T05:35:45.934 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 8951, 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 81660603, 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 8951, 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 81660603, 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_ops": { 2024-09-19T05:35:45.935 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 1024, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 8951, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 8951, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 8951, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 8951, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.936 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 1640, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 178760, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 1640, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:35:45.937 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 110, 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 178760, 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle-0x55abc1c10780": { 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 60, 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 23756, 2024-09-19T05:35:45.938 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 81182436, 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 23756, 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 6888, 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 81182376, 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:45.939 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 -- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f88780678f0 msgr2=0x7f8878069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f88780678f0 0x7f8878069db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f88900af000 tx=0x7f8890004ac0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 -- 172.21.15.67:0/3818202854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88980a9490 msgr2=0x7f8898141af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88980a9490 0x7f8898141af0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8880010920 tx=0x7f8880010de0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 -- 172.21.15.67:0/3818202854 shutdown_connections 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8898142030 0x7f8898147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88980a9490 0x7f8898141af0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f88780678f0 0x7f8878069db0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 --2- 172.21.15.67:0/3818202854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88840039c0 0x7f889806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 -- 172.21.15.67:0/3818202854 >> 172.21.15.67:0/3818202854 conn(0x7f88980727b0 msgr2=0x7f889815ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 -- 172.21.15.67:0/3818202854 shutdown_connections 2024-09-19T05:35:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:45.874+0000 7f889e4de640 1 -- 172.21.15.67:0/3818202854 wait complete. 2024-09-19T05:35:45.942 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-19T05:35:45.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:35:45.942 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-09-19T05:35:46.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.062+0000 7f2ed9f1b640 1 Processor -- start 2024-09-19T05:35:46.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.062+0000 7f2ed9f1b640 1 -- start start 2024-09-19T05:35:46.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed9f1b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2ed415e6f0 0x7f2ed40d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed9f1b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2ed40b6680 0x7f2ed40d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed9f1b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ed415ead0 con 0x7f2ed40cfe30 2024-09-19T05:35:46.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed9f1b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2ed40ceb40 con 0x7f2ed40b6680 2024-09-19T05:35:46.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed9f1b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2ed40ced90 con 0x7f2ed415e6f0 2024-09-19T05:35:46.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2ed40b6680 0x7f2ed40d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2ed40b6680 0x7f2ed40d35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53116/0 (socket says 172.21.15.67:53116) 2024-09-19T05:35:46.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed3fff640 1 -- 172.21.15.67:0/2612602132 learned_addr learned my addr 172.21.15.67:0/2612602132 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/2612602132 >> v2:172.21.15.97:3300/0 conn(0x7f2ed415e6f0 0x7f2ed40d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed3fff640 1 -- 172.21.15.67:0/2612602132 >> v2:172.21.15.97:3300/0 conn(0x7f2ed415e6f0 msgr2=0x7f2ed40d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/2612602132 >> v2:172.21.15.97:3300/0 conn(0x7f2ed415e6f0 0x7f2ed40d3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed3fff640 1 -- 172.21.15.67:0/2612602132 >> v1:172.21.15.97:6789/0 conn(0x7f2ed40cfe30 legacy=0x7f2ed40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed3fff640 1 -- 172.21.15.67:0/2612602132 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed40cf070 con 0x7f2ed40b6680 2024-09-19T05:35:46.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/2612602132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40b6680 0x7f2ed40d35d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2ed408dd40 tx=0x7f2ecc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f795baed30b0a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed27fc640 1 -- 172.21.15.67:0/2612602132 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0a5650 con 0x7f2ed40b6680 2024-09-19T05:35:46.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed27fc640 1 -- 172.21.15.67:0/2612602132 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc0a57f0 con 0x7f2ed40b6680 2024-09-19T05:35:46.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed27fc640 1 -- 172.21.15.67:0/2612602132 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0a5bc0 con 0x7f2ed40b6680 2024-09-19T05:35:46.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2612602132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40b6680 msgr2=0x7f2ed40d35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.066+0000 7f2ed9f1b640 1 --2- 172.21.15.67:0/2612602132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40b6680 0x7f2ed40d35d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2ed408dd40 tx=0x7f2ecc01c8a0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2612602132 shutdown_connections 2024-09-19T05:35:46.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 --2- 172.21.15.67:0/2612602132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40b6680 0x7f2ed40d35d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 --2- 172.21.15.67:0/2612602132 >> v2:172.21.15.97:3300/0 conn(0x7f2ed415e6f0 0x7f2ed40d3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2612602132 >> 172.21.15.67:0/2612602132 conn(0x7f2ed408bfc0 msgr2=0x7f2ed40d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2612602132 shutdown_connections 2024-09-19T05:35:46.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2612602132 wait complete. 2024-09-19T05:35:46.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 Processor -- start 2024-09-19T05:35:46.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 -- start start 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ed40b6680 0x7f2ed4159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cfe30 0x7f2ed4155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ed415e6f0 0x7f2ed4156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed406d770 con 0x7f2ed40cfe30 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed406d5f0 con 0x7f2ed40b6680 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed406d8f0 con 0x7f2ed415e6f0 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cfe30 0x7f2ed4155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cfe30 0x7f2ed4155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53130/0 (socket says 172.21.15.67:53130) 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed2ffd640 1 -- 172.21.15.67:0/2590037262 learned_addr learned my addr 172.21.15.67:0/2590037262 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ed40b6680 0x7f2ed4159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ed415e6f0 0x7f2ed4156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed2ffd640 1 -- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ed415e6f0 msgr2=0x7f2ed4156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed2ffd640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ed415e6f0 0x7f2ed4156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed2ffd640 1 -- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ed40b6680 msgr2=0x7f2ed4159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed2ffd640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ed40b6680 0x7f2ed4159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed2ffd640 1 -- 172.21.15.67:0/2590037262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed40b5740 con 0x7f2ed40cfe30 2024-09-19T05:35:46.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed2ffd640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cfe30 0x7f2ed4155e50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800c460 tx=0x7f2ec800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ebbfff640 1 -- 172.21.15.67:0/2590037262 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80052d0 con 0x7f2ed40cfe30 2024-09-19T05:35:46.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ebbfff640 1 -- 172.21.15.67:0/2590037262 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec8005470 con 0x7f2ed40cfe30 2024-09-19T05:35:46.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ebbfff640 1 -- 172.21.15.67:0/2590037262 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8007260 con 0x7f2ed40cfe30 2024-09-19T05:35:46.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2590037262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed4155370 con 0x7f2ed40cfe30 2024-09-19T05:35:46.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.070+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2590037262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed4155930 con 0x7f2ed40cfe30 2024-09-19T05:35:46.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ebbfff640 1 -- 172.21.15.67:0/2590037262 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ec8007400 con 0x7f2ed40cfe30 2024-09-19T05:35:46.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ebbfff640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2ec00678c0 0x7f2ec0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ebbfff640 1 -- 172.21.15.67:0/2590037262 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f2ec80852b0 con 0x7f2ed40cfe30 2024-09-19T05:35:46.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2ec00678c0 0x7f2ec0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2edcfd7000 1 Processor -- start 2024-09-19T05:35:46.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2edcfd7000 1 -- start start 2024-09-19T05:35:46.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2ec00678c0 0x7f2ec0069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009a50 tx=0x7f2ec4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61680 0x5556fcd61a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61fa0 0x5556fcd15110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd15a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5556fcb65b50 con 0x5556fcd61680 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5556fcb0b300 con 0x5556fcd15650 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5556fcb61b10 con 0x5556fcd61fa0 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61680 0x5556fcd61a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61680 0x5556fcd61a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53132/0 (socket says 172.21.15.67:53132) 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 -- 172.21.15.67:0/452569179 learned_addr learned my addr 172.21.15.67:0/452569179 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 -- 172.21.15.67:0/452569179 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61fa0 msgr2=0x5556fcd15110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/452569179 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61fa0 0x5556fcd15110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 -- 172.21.15.67:0/452569179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 msgr2=0x5556fcd15a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/452569179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd15a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 -- 172.21.15.67:0/452569179 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556fcb0eb80 con 0x5556fcd61680 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.074+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/452569179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61680 0x5556fcd61a60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4011ce0 tx=0x7f2ec4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706638e1cca9d2de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2eb97fa640 1 -- 172.21.15.67:0/452569179 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4011d10 con 0x5556fcd61680 2024-09-19T05:35:46.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2eb97fa640 1 -- 172.21.15.67:0/452569179 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec4026070 con 0x5556fcd61680 2024-09-19T05:35:46.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2eb97fa640 1 -- 172.21.15.67:0/452569179 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4021640 con 0x5556fcd61680 2024-09-19T05:35:46.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- 172.21.15.67:0/452569179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61680 msgr2=0x5556fcd61a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/452569179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61680 0x5556fcd61a60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4011ce0 tx=0x7f2ec4014000 comp rx=0 tx=0).stop 2024-09-19T05:35:46.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- 172.21.15.67:0/452569179 shutdown_connections 2024-09-19T05:35:46.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/452569179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd15a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/452569179 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61fa0 0x5556fcd15110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/452569179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61680 0x5556fcd61a60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- 172.21.15.67:0/452569179 >> 172.21.15.67:0/452569179 conn(0x5556fcd42420 msgr2=0x5556fcd44810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- 172.21.15.67:0/452569179 shutdown_connections 2024-09-19T05:35:46.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- 172.21.15.67:0/452569179 wait complete. 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- start start 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 Processor -- start 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd41c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 0x5556fcd1a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd1a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5556fcaff250 con 0x5556fcd61fa0 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5556fcb30fb0 con 0x5556fcd15650 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5556fcb0cde0 con 0x5556fcd61680 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 10 client.0 _ll_register_callbacks cb 0x5556fcd02b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd1a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd1a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53136/0 (socket says 172.21.15.67:53136) 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed3fff640 1 -- 172.21.15.67:0/3774811211 learned_addr learned my addr 172.21.15.67:0/3774811211 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd41c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed2ffd640 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 0x5556fcd1a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed3fff640 1 -- 172.21.15.67:0/3774811211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 msgr2=0x5556fcd1a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 0x5556fcd1a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed3fff640 1 -- 172.21.15.67:0/3774811211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 msgr2=0x5556fcd41c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd41c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed3fff640 1 -- 172.21.15.67:0/3774811211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556fcb6e7c0 con 0x5556fcd61fa0 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed2ffd640 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 0x5556fcd1a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd1a7f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc01a4d0 tx=0x7f2ecc019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447ff657480d0702 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2eb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2eb27fc640 1 -- 172.21.15.67:0/3774811211 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0bd030 con 0x5556fcd61fa0 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3774811211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ec4026070 con 0x5556fcd61fa0 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2eb27fc640 1 -- 172.21.15.67:0/3774811211 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f2ecc0a5650 con 0x5556fcd61fa0 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2eb27fc640 1 -- 172.21.15.67:0/3774811211 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f2ecc0c6050 con 0x5556fcd61fa0 2024-09-19T05:35:46.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 10 client.5148 fetch_fsmap learned FSMap version 16 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3774811211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5556fcb0f9a0 con 0x5556fcd61fa0 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2eb27fc640 1 -- 172.21.15.67:0/3774811211 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec4026070 con 0x5556fcd61fa0 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2eb27fc640 1 -- 172.21.15.67:0/3774811211 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f2ecc0c9020 con 0x5556fcd61fa0 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 10 client.5148 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 10 client.5148 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 20 client.5148 populate_metadata read hostname 'smithi067' 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5556fcd1b590 0x5556fcd72930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 4 client.5148 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3774811211 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556fcaffb80 con 0x5556fcd1b590 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.078+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5556fcd1b590 0x5556fcd72930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5556fcd1b590 0x5556fcd72930 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5253444c682dfe3 server_cookie=eebee367318f37cd in_seq=0 out_seq=0 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2eb27fc640 10 client.5148 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2eb27fc640 1 -- 172.21.15.67:0/3774811211 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556fcaffb80 con 0x5556fcd1b590 2024-09-19T05:35:46.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2eb27fc640 10 client.5148 handle_command_reply: tid=0 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 client.5148 shutdown 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3774811211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 msgr2=0x5556fcd1a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd1a7f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc01a4d0 tx=0x7f2ecc019640 comp rx=0 tx=0).stop 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3774811211 shutdown_connections 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5556fcd1b590 0x5556fcd72930 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd1a7f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 0x5556fcd1a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/3774811211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd41c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3774811211 >> 172.21.15.67:0/3774811211 conn(0x5556fcd42420 msgr2=0x5556fcd14810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2eb27fc640 0 client.5148 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3774811211 shutdown_connections 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3774811211 wait complete. 2024-09-19T05:35:46.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.082+0000 7f2edcfd7000 20 client.5148 trim_cache size 0 max 16384 2024-09-19T05:35:46.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.098+0000 7f2edcfd7000 1 Processor -- start 2024-09-19T05:35:46.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.098+0000 7f2edcfd7000 1 -- start start 2024-09-19T05:35:46.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd149a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 0x5556fcd14ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd73940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed4202e80 con 0x5556fcd61fa0 2024-09-19T05:35:46.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed4153fd0 con 0x5556fcd15650 2024-09-19T05:35:46.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed4154620 con 0x5556fcd61680 2024-09-19T05:35:46.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd73940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd73940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53142/0 (socket says 172.21.15.67:53142) 2024-09-19T05:35:46.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed3fff640 1 -- 172.21.15.67:0/3049458 learned_addr learned my addr 172.21.15.67:0/3049458 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed2ffd640 1 --2- 172.21.15.67:0/3049458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 0x5556fcd14ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/3049458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd149a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed3fff640 1 -- 172.21.15.67:0/3049458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 msgr2=0x5556fcd14ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/3049458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 0x5556fcd14ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed3fff640 1 -- 172.21.15.67:0/3049458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 msgr2=0x5556fcd149a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/3049458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd149a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed3fff640 1 -- 172.21.15.67:0/3049458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556fcb0b550 con 0x5556fcd61fa0 2024-09-19T05:35:46.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed2ffd640 1 --2- 172.21.15.67:0/3049458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 0x5556fcd14ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:35:46.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/3049458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd73940 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc01af50 tx=0x7f2ecc0ba000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd5e879abcec238 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2eb8ff9640 1 -- 172.21.15.67:0/3049458 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0bd070 con 0x5556fcd61fa0 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2eb8ff9640 1 -- 172.21.15.67:0/3049458 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc0a5650 con 0x5556fcd61fa0 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2eb8ff9640 1 -- 172.21.15.67:0/3049458 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0039a0 con 0x5556fcd61fa0 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3049458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 msgr2=0x5556fcd73940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/3049458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd73940 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc01af50 tx=0x7f2ecc0ba000 comp rx=0 tx=0).stop 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3049458 shutdown_connections 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/3049458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd73940 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/3049458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd61680 0x5556fcd14ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/3049458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd15650 0x5556fcd149a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3049458 >> 172.21.15.67:0/3049458 conn(0x5556fcd42420 msgr2=0x5556fcd75d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3049458 shutdown_connections 2024-09-19T05:35:46.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 -- 172.21.15.67:0/3049458 wait complete. 2024-09-19T05:35:46.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 -- start start 2024-09-19T05:35:46.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.102+0000 7f2edcfd7000 1 Processor -- start 2024-09-19T05:35:46.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd15650 0x5556fcdd4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd61680 0x5556fcdd5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd8fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5556fcaea8a0 con 0x5556fcd61fa0 2024-09-19T05:35:46.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5556fcb11bc0 con 0x5556fcd61680 2024-09-19T05:35:46.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5556fcafc880 con 0x5556fcd15650 2024-09-19T05:35:46.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 10 client.0 _ll_register_callbacks cb 0x7f2ed408ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:35:46.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd8fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd8fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53158/0 (socket says 172.21.15.67:53158) 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed3fff640 1 -- 172.21.15.67:0/4067682618 learned_addr learned my addr 172.21.15.67:0/4067682618 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed2ffd640 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd61680 0x5556fcdd5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd15650 0x5556fcdd4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed3fff640 1 -- 172.21.15.67:0/4067682618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd15650 msgr2=0x5556fcdd4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd15650 0x5556fcdd4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed3fff640 1 -- 172.21.15.67:0/4067682618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd61680 msgr2=0x5556fcdd5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd61680 0x5556fcdd5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed3fff640 1 -- 172.21.15.67:0/4067682618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556fcb05560 con 0x5556fcd61fa0 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd15650 0x5556fcdd4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed2ffd640 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd61680 0x5556fcdd5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed3fff640 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd8fc60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0093e0 tx=0x7f2ecc0a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fdee825476d75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2eb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2eb27fc640 1 -- 172.21.15.67:0/4067682618 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0cf060 con 0x5556fcd61fa0 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2eb27fc640 1 -- 172.21.15.67:0/4067682618 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f2ecc003c70 con 0x5556fcd61fa0 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 1 -- 172.21.15.67:0/4067682618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ecc0a5650 con 0x5556fcd61fa0 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2eb27fc640 1 -- 172.21.15.67:0/4067682618 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f2ecc0d5050 con 0x5556fcd61fa0 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 10 client.5154 fetch_fsmap learned FSMap version 16 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 1 -- 172.21.15.67:0/4067682618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5556fcafd2e0 con 0x5556fcd61fa0 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2eb27fc640 1 -- 172.21.15.67:0/4067682618 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc0a5650 con 0x5556fcd61fa0 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2eb27fc640 1 -- 172.21.15.67:0/4067682618 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f2ecc0d8020 con 0x5556fcd61fa0 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 10 client.5154 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 10 client.5154 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 20 client.5154 populate_metadata read hostname 'smithi067' 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5556fcd901a0 0x5556fcd90580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 4 client.5154 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-09-19T05:35:46.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2edcfd7000 1 -- 172.21.15.67:0/4067682618 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x5556fcb73280 con 0x5556fcd901a0 2024-09-19T05:35:46.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5556fcd901a0 0x5556fcd90580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2ed37fe640 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5556fcd901a0 0x5556fcd90580 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1120c918ba61fdcd server_cookie=1790eed8fa1e6f8d in_seq=0 out_seq=0 2024-09-19T05:35:46.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.106+0000 7f2eb27fc640 10 client.5154 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.114+0000 7f2eb27fc640 1 -- 172.21.15.67:0/4067682618 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5556fcb73280 con 0x5556fcd901a0 2024-09-19T05:35:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.114+0000 7f2eb27fc640 10 client.5154 handle_command_reply: tid=0 2024-09-19T05:35:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.114+0000 7f2edcfd7000 1 client.5154 shutdown 2024-09-19T05:35:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 1 -- 172.21.15.67:0/4067682618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 msgr2=0x5556fcd8fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd8fc60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0093e0 tx=0x7f2ecc0a7070 comp rx=0 tx=0).stop 2024-09-19T05:35:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 1 -- 172.21.15.67:0/4067682618 shutdown_connections 2024-09-19T05:35:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5556fcd901a0 0x5556fcd90580 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5556fcd61fa0 0x5556fcd8fc60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5556fcd61680 0x5556fcdd5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2eb27fc640 0 client.5154 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:46.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 1 --2- 172.21.15.67:0/4067682618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5556fcd15650 0x5556fcdd4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 1 -- 172.21.15.67:0/4067682618 >> 172.21.15.67:0/4067682618 conn(0x5556fcd42420 msgr2=0x5556fcd149a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 1 -- 172.21.15.67:0/4067682618 shutdown_connections 2024-09-19T05:35:46.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 1 -- 172.21.15.67:0/4067682618 wait complete. 2024-09-19T05:35:46.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2edcfd7000 20 client.5154 trim_cache size 0 max 16384 2024-09-19T05:35:46.122 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:35:46.122 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:35:46.122 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "1746dfac-9382-460a-9fc6-b5719152b273", 2024-09-19T05:35:46.122 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:35:46.122 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:35:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2ec00678c0 msgr2=0x7f2ec0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2ec00678c0 0x7f2ec0069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009a50 tx=0x7f2ec4008040 comp rx=0 tx=0).stop 2024-09-19T05:35:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2590037262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cfe30 msgr2=0x7f2ed4155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cfe30 0x7f2ed4155e50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800c460 tx=0x7f2ec800c920 comp rx=0 tx=0).stop 2024-09-19T05:35:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2590037262 shutdown_connections 2024-09-19T05:35:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2ec00678c0 0x7f2ec0069d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ed415e6f0 0x7f2ed4156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ed40cfe30 0x7f2ed4155e50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 --2- 172.21.15.67:0/2590037262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ed40b6680 0x7f2ed4159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2590037262 >> 172.21.15.67:0/2590037262 conn(0x7f2ed408bfc0 msgr2=0x7f2ed415b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2590037262 shutdown_connections 2024-09-19T05:35:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.118+0000 7f2ed9f1b640 1 -- 172.21.15.67:0/2590037262 wait complete. 2024-09-19T05:35:46.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:35:46.140 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-19T05:35:46.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.270+0000 7fc82a0eb640 1 Processor -- start 2024-09-19T05:35:46.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc82a0eb640 1 -- start start 2024-09-19T05:35:46.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc82a0eb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc82406ef70 0x7fc8240cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc82a0eb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc8240cf5e0 0x7fc82415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc82a0eb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8240d0e60 con 0x7fc82415b390 2024-09-19T05:35:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc82a0eb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc82406f4c0 con 0x7fc8240cf5e0 2024-09-19T05:35:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc82a0eb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc8240d0930 con 0x7fc82406ef70 2024-09-19T05:35:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc823fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc8240cf5e0 0x7fc82415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc823fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc8240cf5e0 0x7fc82415ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53168/0 (socket says 172.21.15.67:53168) 2024-09-19T05:35:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc823fff640 1 -- 172.21.15.67:0/3101468271 learned_addr learned my addr 172.21.15.67:0/3101468271 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc822ffd640 1 --2- 172.21.15.67:0/3101468271 >> v2:172.21.15.97:3300/0 conn(0x7fc82406ef70 0x7fc8240cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc823fff640 1 -- 172.21.15.67:0/3101468271 >> v2:172.21.15.97:3300/0 conn(0x7fc82406ef70 msgr2=0x7fc8240cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc823fff640 1 --2- 172.21.15.67:0/3101468271 >> v2:172.21.15.97:3300/0 conn(0x7fc82406ef70 0x7fc8240cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc823fff640 1 -- 172.21.15.67:0/3101468271 >> v1:172.21.15.97:6789/0 conn(0x7fc82415b390 legacy=0x7fc8240ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc823fff640 1 -- 172.21.15.67:0/3101468271 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8240d0b80 con 0x7fc8240cf5e0 2024-09-19T05:35:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc822ffd640 1 --2- 172.21.15.67:0/3101468271 >> v2:172.21.15.97:3300/0 conn(0x7fc82406ef70 0x7fc8240cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:35:46.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.274+0000 7fc823fff640 1 --2- 172.21.15.67:0/3101468271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 0x7fc82415ef80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc82415eee0 tx=0x7fc81c01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d53cdbd3c82858c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc8227fc640 1 -- 172.21.15.67:0/3101468271 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00b2d0 con 0x7fc8240cf5e0 2024-09-19T05:35:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc8227fc640 1 -- 172.21.15.67:0/3101468271 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c00b470 con 0x7fc8240cf5e0 2024-09-19T05:35:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc8227fc640 1 -- 172.21.15.67:0/3101468271 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0a7b30 con 0x7fc8240cf5e0 2024-09-19T05:35:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc82a0eb640 1 -- 172.21.15.67:0/3101468271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 msgr2=0x7fc82415ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc82a0eb640 1 --2- 172.21.15.67:0/3101468271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 0x7fc82415ef80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc82415eee0 tx=0x7fc81c01ebb0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc82a0eb640 1 -- 172.21.15.67:0/3101468271 shutdown_connections 2024-09-19T05:35:46.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc82a0eb640 1 --2- 172.21.15.67:0/3101468271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 0x7fc82415ef80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc82a0eb640 1 --2- 172.21.15.67:0/3101468271 >> v2:172.21.15.97:3300/0 conn(0x7fc82406ef70 0x7fc8240cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc82a0eb640 1 -- 172.21.15.67:0/3101468271 >> 172.21.15.67:0/3101468271 conn(0x7fc8240b6570 msgr2=0x7fc8240b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc82a0eb640 1 -- 172.21.15.67:0/3101468271 shutdown_connections 2024-09-19T05:35:46.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc82a0eb640 1 -- 172.21.15.67:0/3101468271 wait complete. 2024-09-19T05:35:46.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc82a0eb640 1 Processor -- start 2024-09-19T05:35:46.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.278+0000 7fc82a0eb640 1 -- start start 2024-09-19T05:35:46.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc82a0eb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82406ef70 0x7fc82414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc82a0eb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 0x7fc82409caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc82a0eb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc82415b390 0x7fc8241f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc82a0eb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc8240cfbb0 con 0x7fc8240cf5e0 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc82a0eb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc8240cfa30 con 0x7fc82406ef70 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc82a0eb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc82406bcc0 con 0x7fc82415b390 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc822ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 0x7fc82409caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc822ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 0x7fc82409caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53182/0 (socket says 172.21.15.67:53182) 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc822ffd640 1 -- 172.21.15.67:0/304481079 learned_addr learned my addr 172.21.15.67:0/304481079 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc8237fe640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82406ef70 0x7fc82414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc823fff640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc82415b390 0x7fc8241f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc822ffd640 1 -- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc82415b390 msgr2=0x7fc8241f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc822ffd640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc82415b390 0x7fc8241f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc822ffd640 1 -- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82406ef70 msgr2=0x7fc82414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc822ffd640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82406ef70 0x7fc82414ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc822ffd640 1 -- 172.21.15.67:0/304481079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82409d540 con 0x7fc8240cf5e0 2024-09-19T05:35:46.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc822ffd640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 0x7fc82409caf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc81800e810 tx=0x7fc81800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc80bfff640 1 -- 172.21.15.67:0/304481079 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818017070 con 0x7fc8240cf5e0 2024-09-19T05:35:46.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc82a0eb640 1 -- 172.21.15.67:0/304481079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82409d820 con 0x7fc8240cf5e0 2024-09-19T05:35:46.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc80bfff640 1 -- 172.21.15.67:0/304481079 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81800c8d0 con 0x7fc8240cf5e0 2024-09-19T05:35:46.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc80bfff640 1 -- 172.21.15.67:0/304481079 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81800f040 con 0x7fc8240cf5e0 2024-09-19T05:35:46.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc82a0eb640 1 -- 172.21.15.67:0/304481079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82409dde0 con 0x7fc8240cf5e0 2024-09-19T05:35:46.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.282+0000 7fc80bfff640 1 -- 172.21.15.67:0/304481079 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc81801a070 con 0x7fc8240cf5e0 2024-09-19T05:35:46.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc80bfff640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc8100678c0 0x7fc810069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc80bfff640 1 -- 172.21.15.67:0/304481079 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fc818085b20 con 0x7fc8240cf5e0 2024-09-19T05:35:46.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc8100678c0 0x7fc810069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc82d1a7000 1 Processor -- start 2024-09-19T05:35:46.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc82d1a7000 1 -- start start 2024-09-19T05:35:46.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc8100678c0 0x7fc810069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8140098e0 tx=0x7fc814009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a1d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 0x55bc449d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc449d0db0 0x55bc449d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55bc448ba960 con 0x55bc44a1cd70 2024-09-19T05:35:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55bc447fe900 con 0x55bc449d0db0 2024-09-19T05:35:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55bc44821d40 con 0x55bc44a1d690 2024-09-19T05:35:46.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a1d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a1d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53198/0 (socket says 172.21.15.67:53198) 2024-09-19T05:35:46.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 -- 172.21.15.67:0/1577244953 learned_addr learned my addr 172.21.15.67:0/1577244953 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc822ffd640 1 --2- 172.21.15.67:0/1577244953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 0x55bc449d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc823fff640 1 --2- 172.21.15.67:0/1577244953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc449d0db0 0x55bc449d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 -- 172.21.15.67:0/1577244953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 msgr2=0x55bc449d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 --2- 172.21.15.67:0/1577244953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 0x55bc449d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 -- 172.21.15.67:0/1577244953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc449d0db0 msgr2=0x55bc449d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 --2- 172.21.15.67:0/1577244953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc449d0db0 0x55bc449d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 -- 172.21.15.67:0/1577244953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc447c8580 con 0x55bc44a1cd70 2024-09-19T05:35:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8237fe640 1 --2- 172.21.15.67:0/1577244953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a1d150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc814006d10 tx=0x7fc814011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136592039514550f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8097fa640 1 -- 172.21.15.67:0/1577244953 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81401b040 con 0x55bc44a1cd70 2024-09-19T05:35:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.286+0000 7fc8097fa640 1 -- 172.21.15.67:0/1577244953 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc814015a40 con 0x55bc44a1cd70 2024-09-19T05:35:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc8097fa640 1 -- 172.21.15.67:0/1577244953 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814015c10 con 0x55bc44a1cd70 2024-09-19T05:35:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 -- 172.21.15.67:0/1577244953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 msgr2=0x55bc44a1d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/1577244953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a1d150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc814006d10 tx=0x7fc814011000 comp rx=0 tx=0).stop 2024-09-19T05:35:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 -- 172.21.15.67:0/1577244953 shutdown_connections 2024-09-19T05:35:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/1577244953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc449d0db0 0x55bc449d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/1577244953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 0x55bc449d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/1577244953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a1d150 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 -- 172.21.15.67:0/1577244953 >> 172.21.15.67:0/1577244953 conn(0x55bc449fe040 msgr2=0x55bc44a00430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 -- 172.21.15.67:0/1577244953 shutdown_connections 2024-09-19T05:35:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 -- 172.21.15.67:0/1577244953 wait complete. 2024-09-19T05:35:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 -- start start 2024-09-19T05:35:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 Processor -- start 2024-09-19T05:35:46.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc449d0db0 0x55bc44a23ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a24220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 0x55bc44a24760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55bc4481dd00 con 0x55bc44a1cd70 2024-09-19T05:35:46.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55bc447dcaa0 con 0x55bc449d0db0 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55bc447bb340 con 0x55bc44a1d690 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc82d1a7000 10 client.0 _ll_register_callbacks cb 0x55bc449be760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc822ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a24220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc822ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a24220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53200/0 (socket says 172.21.15.67:53200) 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc822ffd640 1 -- 172.21.15.67:0/290969560 learned_addr learned my addr 172.21.15.67:0/290969560 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc8237fe640 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc449d0db0 0x55bc44a23ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.290+0000 7fc823fff640 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 0x55bc44a24760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc822ffd640 1 -- 172.21.15.67:0/290969560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 msgr2=0x55bc44a24760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc822ffd640 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 0x55bc44a24760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc822ffd640 1 -- 172.21.15.67:0/290969560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc449d0db0 msgr2=0x55bc44a23ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc822ffd640 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc449d0db0 0x55bc44a23ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc822ffd640 1 -- 172.21.15.67:0/290969560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc447c4dc0 con 0x55bc44a1cd70 2024-09-19T05:35:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc823fff640 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 0x55bc44a24760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc822ffd640 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a24220 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc818083d70 tx=0x7fc818055cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6823afb7dd3d649b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8027fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8027fc640 1 -- 172.21.15.67:0/290969560 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818021040 con 0x55bc44a1cd70 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 -- 172.21.15.67:0/290969560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc814015a40 con 0x55bc44a1cd70 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8027fc640 1 -- 172.21.15.67:0/290969560 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fc818072a10 con 0x55bc44a1cd70 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8027fc640 1 -- 172.21.15.67:0/290969560 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fc81805e870 con 0x55bc44a1cd70 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 10 client.5166 fetch_fsmap learned FSMap version 16 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 -- 172.21.15.67:0/290969560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55bc447c17f0 con 0x55bc44a1cd70 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8027fc640 1 -- 172.21.15.67:0/290969560 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc814015a40 con 0x55bc44a1cd70 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8027fc640 1 -- 172.21.15.67:0/290969560 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fc818012050 con 0x55bc44a1cd70 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 10 client.5166 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T05:35:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 10 client.5166 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-19T05:35:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 20 client.5166 populate_metadata read hostname 'smithi067' 2024-09-19T05:35:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x55bc44a2c0b0 0x55bc44a2e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 4 client.5166 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:35:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 -- 172.21.15.67:0/290969560 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc447bbe10 con 0x55bc44a2c0b0 2024-09-19T05:35:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8237fe640 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x55bc44a2c0b0 0x55bc44a2e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8237fe640 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x55bc44a2c0b0 0x55bc44a2e4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=608bcfab73b17c0 server_cookie=399d9c874ea95411 in_seq=0 out_seq=0 2024-09-19T05:35:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8027fc640 10 client.5166 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8027fc640 1 -- 172.21.15.67:0/290969560 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc447bbe10 con 0x55bc44a2c0b0 2024-09-19T05:35:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8027fc640 10 client.5166 handle_command_reply: tid=0 2024-09-19T05:35:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 client.5166 shutdown 2024-09-19T05:35:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 -- 172.21.15.67:0/290969560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 msgr2=0x55bc44a24220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a24220 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc818083d70 tx=0x7fc818055cb0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 -- 172.21.15.67:0/290969560 shutdown_connections 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x55bc44a2c0b0 0x55bc44a2e4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1d690 0x55bc44a24760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc44a24220 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc8027fc640 0 client.5166 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/290969560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc449d0db0 0x55bc44a23ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 -- 172.21.15.67:0/290969560 >> 172.21.15.67:0/290969560 conn(0x55bc449fe040 msgr2=0x55bc449cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 -- 172.21.15.67:0/290969560 shutdown_connections 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 1 -- 172.21.15.67:0/290969560 wait complete. 2024-09-19T05:35:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.294+0000 7fc82d1a7000 20 client.5166 trim_cache size 0 max 16384 2024-09-19T05:35:46.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.322+0000 7fc82d1a7000 1 Processor -- start 2024-09-19T05:35:46.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.322+0000 7fc82d1a7000 1 -- start start 2024-09-19T05:35:46.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc449d0db0 0x55bc44a31d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc449d8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc44a1d690 0x55bc449d9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc824204180 con 0x55bc44a1cd70 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc822ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc449d8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc824203200 con 0x55bc44a1d690 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc82415e6d0 con 0x55bc449d0db0 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc822ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc449d8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53204/0 (socket says 172.21.15.67:53204) 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc822ffd640 1 -- 172.21.15.67:0/256553819 learned_addr learned my addr 172.21.15.67:0/256553819 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc8237fe640 1 --2- 172.21.15.67:0/256553819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc449d0db0 0x55bc44a31d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc823fff640 1 --2- 172.21.15.67:0/256553819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc44a1d690 0x55bc449d9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc822ffd640 1 -- 172.21.15.67:0/256553819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc449d0db0 msgr2=0x55bc44a31d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc822ffd640 1 --2- 172.21.15.67:0/256553819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc449d0db0 0x55bc44a31d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc822ffd640 1 -- 172.21.15.67:0/256553819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc44a1d690 msgr2=0x55bc449d9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc822ffd640 1 --2- 172.21.15.67:0/256553819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc44a1d690 0x55bc449d9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc822ffd640 1 -- 172.21.15.67:0/256553819 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc447df470 con 0x55bc44a1cd70 2024-09-19T05:35:46.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc822ffd640 1 --2- 172.21.15.67:0/256553819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc449d8c00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc8180559b0 tx=0x7fc818074050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaf0f663f7f07ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc808ff9640 1 -- 172.21.15.67:0/256553819 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818021040 con 0x55bc44a1cd70 2024-09-19T05:35:46.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc808ff9640 1 -- 172.21.15.67:0/256553819 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81806c070 con 0x55bc44a1cd70 2024-09-19T05:35:46.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc808ff9640 1 -- 172.21.15.67:0/256553819 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818055100 con 0x55bc44a1cd70 2024-09-19T05:35:46.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 -- 172.21.15.67:0/256553819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 msgr2=0x55bc449d8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/256553819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc449d8c00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc8180559b0 tx=0x7fc818074050 comp rx=0 tx=0).stop 2024-09-19T05:35:46.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 -- 172.21.15.67:0/256553819 shutdown_connections 2024-09-19T05:35:46.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/256553819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc44a1d690 0x55bc449d9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/256553819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc44a1cd70 0x55bc449d8c00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/256553819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc449d0db0 0x55bc44a31d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 -- 172.21.15.67:0/256553819 >> 172.21.15.67:0/256553819 conn(0x55bc449fe040 msgr2=0x55bc44a29ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 -- 172.21.15.67:0/256553819 shutdown_connections 2024-09-19T05:35:46.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.326+0000 7fc82d1a7000 1 -- 172.21.15.67:0/256553819 wait complete. 2024-09-19T05:35:46.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 -- start start 2024-09-19T05:35:46.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 Processor -- start 2024-09-19T05:35:46.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc449d0db0 0x55bc44a31330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1cd70 0x55bc44a4c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc44a1d690 0x55bc44a4ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55bc4482ffd0 con 0x55bc449d0db0 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc824202c80 con 0x55bc44a1d690 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55bc44861780 con 0x55bc44a1cd70 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 10 client.0 _ll_register_callbacks cb 0x7fc81800ef60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc449d0db0 0x55bc44a31330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc449d0db0 0x55bc44a31330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53210/0 (socket says 172.21.15.67:53210) 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8237fe640 1 -- 172.21.15.67:0/618120167 learned_addr learned my addr 172.21.15.67:0/618120167 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc822ffd640 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1cd70 0x55bc44a4c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc823fff640 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc44a1d690 0x55bc44a4ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8237fe640 1 -- 172.21.15.67:0/618120167 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1cd70 msgr2=0x55bc44a4c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8237fe640 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1cd70 0x55bc44a4c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8237fe640 1 -- 172.21.15.67:0/618120167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc44a1d690 msgr2=0x55bc44a4ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8237fe640 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc44a1d690 0x55bc44a4ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8237fe640 1 -- 172.21.15.67:0/618120167 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc447b5640 con 0x55bc449d0db0 2024-09-19T05:35:46.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8237fe640 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc449d0db0 0x55bc44a31330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc814006ce0 tx=0x7fc814004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf59e215aee3adc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8027fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8027fc640 1 -- 172.21.15.67:0/618120167 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814038060 con 0x55bc449d0db0 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8027fc640 1 -- 172.21.15.67:0/618120167 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fc814015b00 con 0x55bc449d0db0 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 -- 172.21.15.67:0/618120167 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc81806c070 con 0x55bc449d0db0 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8027fc640 1 -- 172.21.15.67:0/618120167 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fc81403e050 con 0x55bc449d0db0 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 10 client.5172 fetch_fsmap learned FSMap version 16 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 -- 172.21.15.67:0/618120167 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55bc447b93b0 con 0x55bc449d0db0 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8027fc640 1 -- 172.21.15.67:0/618120167 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81806c070 con 0x55bc449d0db0 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc8027fc640 1 -- 172.21.15.67:0/618120167 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fc814041020 con 0x55bc449d0db0 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 10 client.5172 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 10 client.5172 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-19T05:35:46.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 20 client.5172 populate_metadata read hostname 'smithi067' 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x55bc44a4d210 0x55bc44a908a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 4 client.5172 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc82d1a7000 1 -- 172.21.15.67:0/618120167 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bc4482f470 con 0x55bc44a4d210 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.330+0000 7fc822ffd640 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x55bc44a4d210 0x55bc44a908a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc8027fc640 10 client.5172 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc822ffd640 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x55bc44a4d210 0x55bc44a908a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9386b00e9133c78 server_cookie=bce1c838a2bbda6a in_seq=0 out_seq=0 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc8027fc640 1 -- 172.21.15.67:0/618120167 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+274 (crc 0 0 0) 0x55bc4482f470 con 0x55bc44a4d210 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc8027fc640 10 client.5172 handle_command_reply: tid=0 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 client.5172 shutdown 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 -- 172.21.15.67:0/618120167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc449d0db0 msgr2=0x55bc44a31330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc449d0db0 0x55bc44a31330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc814006ce0 tx=0x7fc814004690 comp rx=0 tx=0).stop 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 -- 172.21.15.67:0/618120167 shutdown_connections 2024-09-19T05:35:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x55bc44a4d210 0x55bc44a908a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc8027fc640 0 client.5172 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:35:46.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bc44a1d690 0x55bc44a4ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55bc44a1cd70 0x55bc44a4c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 --2- 172.21.15.67:0/618120167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc449d0db0 0x55bc44a31330 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 -- 172.21.15.67:0/618120167 >> 172.21.15.67:0/618120167 conn(0x55bc449fe040 msgr2=0x55bc44a2a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 -- 172.21.15.67:0/618120167 shutdown_connections 2024-09-19T05:35:46.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 1 -- 172.21.15.67:0/618120167 wait complete. 2024-09-19T05:35:46.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82d1a7000 20 client.5172 trim_cache size 0 max 16384 2024-09-19T05:35:46.342 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:35:46.343 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "scrub active (961 inodes in the stack)", 2024-09-19T05:35:46.343 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-19T05:35:46.343 INFO:teuthology.orchestra.run.smithi067.stdout: "1746dfac-9382-460a-9fc6-b5719152b273": { 2024-09-19T05:35:46.343 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-19T05:35:46.343 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "1746dfac-9382-460a-9fc6-b5719152b273", 2024-09-19T05:35:46.343 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,scrub_mdsdir" 2024-09-19T05:35:46.343 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:46.343 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:35:46.343 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:35:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 -- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc8100678c0 msgr2=0x7fc810069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc8100678c0 0x7fc810069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8140098e0 tx=0x7fc814009060 comp rx=0 tx=0).stop 2024-09-19T05:35:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 -- 172.21.15.67:0/304481079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 msgr2=0x7fc82409caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:35:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 0x7fc82409caf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc81800e810 tx=0x7fc81800ecd0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 -- 172.21.15.67:0/304481079 shutdown_connections 2024-09-19T05:35:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc8100678c0 0x7fc810069d80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc82415b390 0x7fc8241f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8240cf5e0 0x7fc82409caf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 --2- 172.21.15.67:0/304481079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82406ef70 0x7fc82414ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:35:46.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 -- 172.21.15.67:0/304481079 >> 172.21.15.67:0/304481079 conn(0x7fc8240b6570 msgr2=0x7fc8240b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:35:46.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 -- 172.21.15.67:0/304481079 shutdown_connections 2024-09-19T05:35:46.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:35:46.334+0000 7fc82a0eb640 1 -- 172.21.15.67:0/304481079 wait complete. 2024-09-19T05:35:46.359 INFO:tasks.cephfs.filesystem:scrub status for tag:1746dfac-9382-460a-9fc6-b5719152b273 - {'path': '/', 'tag': '1746dfac-9382-460a-9fc6-b5719152b273', 'options': 'recursive,scrub_mdsdir'} 2024-09-19T05:36:08.658 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:36:08.661 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:36:16.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:16.361 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-19T05:36:16.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f761b249640 1 Processor -- start 2024-09-19T05:36:16.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f761b249640 1 -- start start 2024-09-19T05:36:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f761b249640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f76140d4fb0 0x7f76140d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f761b249640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76140d13c0 0x7f761406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f761b249640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76140d35a0 con 0x7f761415e690 2024-09-19T05:36:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f761b249640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f76140d1830 con 0x7f76140d4fb0 2024-09-19T05:36:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f761b249640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f76140d32c0 con 0x7f76140d13c0 2024-09-19T05:36:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f760bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f76140d4fb0 0x7f76140d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f760bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f76140d4fb0 0x7f76140d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47172/0 (socket says 172.21.15.67:47172) 2024-09-19T05:36:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f760bfff640 1 -- 172.21.15.67:0/1956694369 learned_addr learned my addr 172.21.15.67:0/1956694369 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f76197e6640 1 --2- 172.21.15.67:0/1956694369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76140d13c0 0x7f761406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f760bfff640 1 -- 172.21.15.67:0/1956694369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76140d13c0 msgr2=0x7f761406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f760bfff640 1 --2- 172.21.15.67:0/1956694369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76140d13c0 0x7f761406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f760bfff640 1 -- 172.21.15.67:0/1956694369 >> v1:172.21.15.97:6789/0 conn(0x7f761415e690 legacy=0x7f76140d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f760bfff640 1 -- 172.21.15.67:0/1956694369 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761406d040 con 0x7f76140d4fb0 2024-09-19T05:36:16.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.498+0000 7f76197e6640 1 --2- 172.21.15.67:0/1956694369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76140d13c0 0x7f761406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:16.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f760bfff640 1 --2- 172.21.15.67:0/1956694369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 0x7f76140d0e80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7604009870 tx=0x7f760401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48185047c81d1bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f760b7fe640 1 -- 172.21.15.67:0/1956694369 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76040aa610 con 0x7f76140d4fb0 2024-09-19T05:36:16.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f760b7fe640 1 -- 172.21.15.67:0/1956694369 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76040af070 con 0x7f76140d4fb0 2024-09-19T05:36:16.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f760b7fe640 1 -- 172.21.15.67:0/1956694369 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76040aa9d0 con 0x7f76140d4fb0 2024-09-19T05:36:16.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 -- 172.21.15.67:0/1956694369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 msgr2=0x7f76140d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 --2- 172.21.15.67:0/1956694369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 0x7f76140d0e80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7604009870 tx=0x7f760401c4f0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 -- 172.21.15.67:0/1956694369 shutdown_connections 2024-09-19T05:36:16.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 --2- 172.21.15.67:0/1956694369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76140d13c0 0x7f761406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 --2- 172.21.15.67:0/1956694369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 0x7f76140d0e80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 -- 172.21.15.67:0/1956694369 >> 172.21.15.67:0/1956694369 conn(0x7f76140d4490 msgr2=0x7f76140d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 -- 172.21.15.67:0/1956694369 shutdown_connections 2024-09-19T05:36:16.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 -- 172.21.15.67:0/1956694369 wait complete. 2024-09-19T05:36:16.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 Processor -- start 2024-09-19T05:36:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 -- start start 2024-09-19T05:36:16.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76140d13c0 0x7f761415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 0x7f7614150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f761415e690 0x7f76140b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f761406e9f0 con 0x7f76140d4fb0 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f761406e870 con 0x7f76140d13c0 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f761b249640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f761406eb70 con 0x7f761415e690 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f760bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 0x7f7614150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f760bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 0x7f7614150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47186/0 (socket says 172.21.15.67:47186) 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.502+0000 7f760bfff640 1 -- 172.21.15.67:0/224208620 learned_addr learned my addr 172.21.15.67:0/224208620 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f7618fe5640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76140d13c0 0x7f761415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f76197e6640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f761415e690 0x7f76140b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f760bfff640 1 -- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f761415e690 msgr2=0x7f76140b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f760bfff640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f761415e690 0x7f76140b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f760bfff640 1 -- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76140d13c0 msgr2=0x7f761415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f760bfff640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76140d13c0 0x7f761415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f760bfff640 1 -- 172.21.15.67:0/224208620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7614151470 con 0x7f76140d4fb0 2024-09-19T05:36:16.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f760bfff640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 0x7f7614150f30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f760401c320 tx=0x7f760401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f76097fa640 1 -- 172.21.15.67:0/224208620 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76040b3800 con 0x7f76140d4fb0 2024-09-19T05:36:16.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f76097fa640 1 -- 172.21.15.67:0/224208620 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76040b39a0 con 0x7f76140d4fb0 2024-09-19T05:36:16.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f76097fa640 1 -- 172.21.15.67:0/224208620 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76040b3d90 con 0x7f76140d4fb0 2024-09-19T05:36:16.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f761b249640 1 -- 172.21.15.67:0/224208620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7614160e00 con 0x7f76140d4fb0 2024-09-19T05:36:16.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f761b249640 1 -- 172.21.15.67:0/224208620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7614151800 con 0x7f76140d4fb0 2024-09-19T05:36:16.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f76097fa640 1 -- 172.21.15.67:0/224208620 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f76040bc3e0 con 0x7f76140d4fb0 2024-09-19T05:36:16.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f76097fa640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76000678c0 0x7f7600069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f76097fa640 1 -- 172.21.15.67:0/224208620 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f760411fe20 con 0x7f76140d4fb0 2024-09-19T05:36:16.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f7618fe5640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76000678c0 0x7f7600069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f761e305000 1 Processor -- start 2024-09-19T05:36:16.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.506+0000 7f761e305000 1 -- start start 2024-09-19T05:36:16.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f7618fe5640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76000678c0 0x7f7600069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f761415a5b0 tx=0x7f7610009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cf9c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cf4f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cf50190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564f4ce39960 con 0x564f4cf4fdb0 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564f4cd7d900 con 0x564f4cf9bd70 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564f4cda0d40 con 0x564f4cf9c690 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f76197e6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cf50190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f76197e6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cf50190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47194/0 (socket says 172.21.15.67:47194) 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f76197e6640 1 -- 172.21.15.67:0/2219574309 learned_addr learned my addr 172.21.15.67:0/2219574309 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f760bfff640 1 --2- 172.21.15.67:0/2219574309 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cf4f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f7618fe5640 1 --2- 172.21.15.67:0/2219574309 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cf9c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f76197e6640 1 -- 172.21.15.67:0/2219574309 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 msgr2=0x564f4cf4f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f76197e6640 1 --2- 172.21.15.67:0/2219574309 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cf4f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f76197e6640 1 -- 172.21.15.67:0/2219574309 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 msgr2=0x564f4cf9c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f76197e6640 1 --2- 172.21.15.67:0/2219574309 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cf9c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f76197e6640 1 -- 172.21.15.67:0/2219574309 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4cd47580 con 0x564f4cf4fdb0 2024-09-19T05:36:16.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f760bfff640 1 --2- 172.21.15.67:0/2219574309 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cf4f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:16.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f76197e6640 1 --2- 172.21.15.67:0/2219574309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cf50190 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f760c00e3b0 tx=0x7f760c00e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd108fa0a04bb6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f75fa7fc640 1 -- 172.21.15.67:0/2219574309 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c00f6b0 con 0x564f4cf4fdb0 2024-09-19T05:36:16.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f75fa7fc640 1 -- 172.21.15.67:0/2219574309 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f760c00f850 con 0x564f4cf4fdb0 2024-09-19T05:36:16.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f75fa7fc640 1 -- 172.21.15.67:0/2219574309 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c00fc00 con 0x564f4cf4fdb0 2024-09-19T05:36:16.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- 172.21.15.67:0/2219574309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 msgr2=0x564f4cf50190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 --2- 172.21.15.67:0/2219574309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cf50190 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f760c00e3b0 tx=0x7f760c00e870 comp rx=0 tx=0).stop 2024-09-19T05:36:16.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- 172.21.15.67:0/2219574309 shutdown_connections 2024-09-19T05:36:16.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 --2- 172.21.15.67:0/2219574309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cf50190 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 --2- 172.21.15.67:0/2219574309 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cf4f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 --2- 172.21.15.67:0/2219574309 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cf9c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- 172.21.15.67:0/2219574309 >> 172.21.15.67:0/2219574309 conn(0x564f4cf7d040 msgr2=0x564f4cf7f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- 172.21.15.67:0/2219574309 shutdown_connections 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- 172.21.15.67:0/2219574309 wait complete. 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- start start 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 Processor -- start 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cfa3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cfa3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564f4cd9cd00 con 0x564f4cf4fdb0 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564f4cd5baa0 con 0x564f4cf9bd70 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564f4cd3a340 con 0x564f4cf9c690 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f761e305000 10 client.0 _ll_register_callbacks cb 0x564f4cf3d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f7618fe5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f7618fe5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47200/0 (socket says 172.21.15.67:47200) 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.510+0000 7f7618fe5640 1 -- 172.21.15.67:0/3384659072 learned_addr learned my addr 172.21.15.67:0/3384659072 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f760bfff640 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cfa3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f76197e6640 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cfa3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f7618fe5640 1 -- 172.21.15.67:0/3384659072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 msgr2=0x564f4cfa3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f7618fe5640 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cfa3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f7618fe5640 1 -- 172.21.15.67:0/3384659072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 msgr2=0x564f4cfa3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f7618fe5640 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cfa3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f7618fe5640 1 -- 172.21.15.67:0/3384659072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4cd43dc0 con 0x564f4cf4fdb0 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f760bfff640 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cfa3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f7618fe5640 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa2ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f761000ed60 tx=0x7f7610003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66c13460920406 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f75f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f75f37fe640 1 -- 172.21.15.67:0/3384659072 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610021420 con 0x564f4cf4fdb0 2024-09-19T05:36:16.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f75f37fe640 1 -- 172.21.15.67:0/3384659072 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f7610010040 con 0x564f4cf4fdb0 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 -- 172.21.15.67:0/3384659072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f760c00f850 con 0x564f4cf4fdb0 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f75f37fe640 1 -- 172.21.15.67:0/3384659072 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f761002e050 con 0x564f4cf4fdb0 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 10 client.5184 fetch_fsmap learned FSMap version 16 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 -- 172.21.15.67:0/3384659072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x564f4cd407f0 con 0x564f4cf4fdb0 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f75f37fe640 1 -- 172.21.15.67:0/3384659072 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f760c00f850 con 0x564f4cf4fdb0 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f75f37fe640 1 -- 172.21.15.67:0/3384659072 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f7610031020 con 0x564f4cf4fdb0 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 10 client.5184 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 10 client.5184 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 20 client.5184 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x564f4cfab0b0 0x564f4cfad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 4 client.5184 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 -- 172.21.15.67:0/3384659072 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f4cd3ae10 con 0x564f4cfab0b0 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f760bfff640 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x564f4cfab0b0 0x564f4cfad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f760bfff640 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x564f4cfab0b0 0x564f4cfad4a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2df7e59b24296f8 server_cookie=203f17be9b63fcf1 in_seq=0 out_seq=0 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f75f37fe640 10 client.5184 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f75f37fe640 1 -- 172.21.15.67:0/3384659072 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f4cd3ae10 con 0x564f4cfab0b0 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f75f37fe640 10 client.5184 handle_command_reply: tid=0 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 client.5184 shutdown 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 -- 172.21.15.67:0/3384659072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 msgr2=0x564f4cfa2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa2ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f761000ed60 tx=0x7f7610003700 comp rx=0 tx=0).stop 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 -- 172.21.15.67:0/3384659072 shutdown_connections 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x564f4cfab0b0 0x564f4cfad4a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cfa3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cfa3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f75f37fe640 0 client.5184 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:36:16.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 --2- 172.21.15.67:0/3384659072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa2ce0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 -- 172.21.15.67:0/3384659072 >> 172.21.15.67:0/3384659072 conn(0x564f4cf7d040 msgr2=0x564f4cf4ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 -- 172.21.15.67:0/3384659072 shutdown_connections 2024-09-19T05:36:16.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 1 -- 172.21.15.67:0/3384659072 wait complete. 2024-09-19T05:36:16.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.514+0000 7f761e305000 20 client.5184 trim_cache size 0 max 16384 2024-09-19T05:36:16.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 Processor -- start 2024-09-19T05:36:16.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 -- start start 2024-09-19T05:36:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf4fdb0 0x564f4cf57c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf9bd70 0x564f4cf58170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9c690 0x564f4cfa5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7614203e80 con 0x564f4cf9bd70 2024-09-19T05:36:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7614202e60 con 0x564f4cf9c690 2024-09-19T05:36:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7614159550 con 0x564f4cf4fdb0 2024-09-19T05:36:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f760bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf9bd70 0x564f4cf58170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f760bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf9bd70 0x564f4cf58170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47214/0 (socket says 172.21.15.67:47214) 2024-09-19T05:36:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f760bfff640 1 -- 172.21.15.67:0/2759134963 learned_addr learned my addr 172.21.15.67:0/2759134963 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f760bfff640 1 -- 172.21.15.67:0/2759134963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf4fdb0 msgr2=0x564f4cf57c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f760bfff640 1 --2- 172.21.15.67:0/2759134963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf4fdb0 0x564f4cf57c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f760bfff640 1 -- 172.21.15.67:0/2759134963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9c690 msgr2=0x564f4cfa5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f76197e6640 1 --2- 172.21.15.67:0/2759134963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9c690 0x564f4cfa5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f760bfff640 1 --2- 172.21.15.67:0/2759134963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9c690 0x564f4cfa5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f760bfff640 1 -- 172.21.15.67:0/2759134963 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4cd5e470 con 0x564f4cf9bd70 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f76197e6640 1 --2- 172.21.15.67:0/2759134963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9c690 0x564f4cfa5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f760bfff640 1 --2- 172.21.15.67:0/2759134963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf9bd70 0x564f4cf58170 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7604009630 tx=0x7f76040bf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef06553f558ae43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f75f9ffb640 1 -- 172.21.15.67:0/2759134963 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76040c2040 con 0x564f4cf9bd70 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f75f9ffb640 1 -- 172.21.15.67:0/2759134963 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76040af020 con 0x564f4cf9bd70 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f75f9ffb640 1 -- 172.21.15.67:0/2759134963 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604108100 con 0x564f4cf9bd70 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 -- 172.21.15.67:0/2759134963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf9bd70 msgr2=0x564f4cf58170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 --2- 172.21.15.67:0/2759134963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf9bd70 0x564f4cf58170 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7604009630 tx=0x7f76040bf040 comp rx=0 tx=0).stop 2024-09-19T05:36:16.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 -- 172.21.15.67:0/2759134963 shutdown_connections 2024-09-19T05:36:16.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 --2- 172.21.15.67:0/2759134963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9c690 0x564f4cfa5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 --2- 172.21.15.67:0/2759134963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf9bd70 0x564f4cf58170 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 --2- 172.21.15.67:0/2759134963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf4fdb0 0x564f4cf57c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 -- 172.21.15.67:0/2759134963 >> 172.21.15.67:0/2759134963 conn(0x564f4cf7d040 msgr2=0x564f4cfa2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 -- 172.21.15.67:0/2759134963 shutdown_connections 2024-09-19T05:36:16.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.534+0000 7f761e305000 1 -- 172.21.15.67:0/2759134963 wait complete. 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- start start 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 Processor -- start 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cfcb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cfcbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564f4cdaefd0 con 0x564f4cf4fdb0 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7614202810 con 0x564f4cf9bd70 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564f4ce5d0c0 con 0x564f4cf9c690 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 10 client.0 _ll_register_callbacks cb 0x7f7610005380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f7618fe5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f7618fe5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47216/0 (socket says 172.21.15.67:47216) 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f7618fe5640 1 -- 172.21.15.67:0/254952643 learned_addr learned my addr 172.21.15.67:0/254952643 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f760bfff640 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cfcb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f76197e6640 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cfcbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f7618fe5640 1 -- 172.21.15.67:0/254952643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 msgr2=0x564f4cfcbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f7618fe5640 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cfcbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f7618fe5640 1 -- 172.21.15.67:0/254952643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 msgr2=0x564f4cfcb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f7618fe5640 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cfcb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f7618fe5640 1 -- 172.21.15.67:0/254952643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4cd34640 con 0x564f4cf4fdb0 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f760bfff640 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cfcb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f7618fe5640 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa8700 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f761000e650 tx=0x7f7610003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8b29f5cab4cd28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f75f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f75f37fe640 1 -- 172.21.15.67:0/254952643 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610015c90 con 0x564f4cf4fdb0 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f75f37fe640 1 -- 172.21.15.67:0/254952643 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f7610021b20 con 0x564f4cf4fdb0 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- 172.21.15.67:0/254952643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76040af020 con 0x564f4cf4fdb0 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f75f37fe640 1 -- 172.21.15.67:0/254952643 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f761003f050 con 0x564f4cf4fdb0 2024-09-19T05:36:16.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 10 client.5190 fetch_fsmap learned FSMap version 16 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- 172.21.15.67:0/254952643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x564f4cd383b0 con 0x564f4cf4fdb0 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f75f37fe640 1 -- 172.21.15.67:0/254952643 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76040af020 con 0x564f4cf4fdb0 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f75f37fe640 1 -- 172.21.15.67:0/254952643 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f7610042020 con 0x564f4cf4fdb0 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 10 client.5190 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 10 client.5190 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 20 client.5190 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x564f4cfcc210 0x564f4d00f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 4 client.5190 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- 172.21.15.67:0/254952643 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564f4cdae470 con 0x564f4cfcc210 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f760bfff640 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x564f4cfcc210 0x564f4d00f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f75f37fe640 10 client.5190 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f760bfff640 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x564f4cfcc210 0x564f4d00f9c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be8e859f83960f42 server_cookie=e9aa1e1d18994d33 in_seq=0 out_seq=0 2024-09-19T05:36:16.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f75f37fe640 1 -- 172.21.15.67:0/254952643 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564f4cdae470 con 0x564f4cfcc210 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f75f37fe640 10 client.5190 handle_command_reply: tid=0 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 client.5190 shutdown 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- 172.21.15.67:0/254952643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 msgr2=0x564f4cfa8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa8700 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f761000e650 tx=0x7f7610003770 comp rx=0 tx=0).stop 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- 172.21.15.67:0/254952643 shutdown_connections 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x564f4cfcc210 0x564f4d00f9c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564f4cf9c690 0x564f4cfcbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564f4cf9bd70 0x564f4cfcb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f75f37fe640 0 client.5190 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 --2- 172.21.15.67:0/254952643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f4cf4fdb0 0x564f4cfa8700 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- 172.21.15.67:0/254952643 >> 172.21.15.67:0/254952643 conn(0x564f4cf7d040 msgr2=0x564f4cf56c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- 172.21.15.67:0/254952643 shutdown_connections 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 1 -- 172.21.15.67:0/254952643 wait complete. 2024-09-19T05:36:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761e305000 20 client.5190 trim_cache size 0 max 16384 2024-09-19T05:36:16.549 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:16.549 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-19T05:36:16.549 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {} 2024-09-19T05:36:16.549 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 -- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76000678c0 msgr2=0x7f7600069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76000678c0 0x7f7600069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f761415a5b0 tx=0x7f7610009040 comp rx=0 tx=0).stop 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 -- 172.21.15.67:0/224208620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 msgr2=0x7f7614150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 0x7f7614150f30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f760401c320 tx=0x7f760401ad30 comp rx=0 tx=0).stop 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 -- 172.21.15.67:0/224208620 shutdown_connections 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76000678c0 0x7f7600069d80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f761415e690 0x7f76140b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76140d4fb0 0x7f7614150f30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 --2- 172.21.15.67:0/224208620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76140d13c0 0x7f761415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 -- 172.21.15.67:0/224208620 >> 172.21.15.67:0/224208620 conn(0x7f76140d4490 msgr2=0x7f76140d2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.538+0000 7f761b249640 1 -- 172.21.15.67:0/224208620 shutdown_connections 2024-09-19T05:36:16.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.542+0000 7f761b249640 1 -- 172.21.15.67:0/224208620 wait complete. 2024-09-19T05:36:16.560 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:36:16.560 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-19T05:36:16.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e8f9f640 1 Processor -- start 2024-09-19T05:36:16.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e8f9f640 1 -- start start 2024-09-19T05:36:16.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e8f9f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e4159c60 0x7f93e40ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e8f9f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f93e40af3a0 0x7f93e415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e8f9f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e415a040 con 0x7f93e406ffd0 2024-09-19T05:36:16.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e8f9f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f93e415d460 con 0x7f93e40af3a0 2024-09-19T05:36:16.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e8f9f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f93e415c850 con 0x7f93e4159c60 2024-09-19T05:36:16.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e2d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f93e40af3a0 0x7f93e415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e2d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f93e40af3a0 0x7f93e415fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:48502/0 (socket says 172.21.15.67:48502) 2024-09-19T05:36:16.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e259c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e4159c60 0x7f93e40ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e2d9d640 1 -- 172.21.15.67:0/1633743274 learned_addr learned my addr 172.21.15.67:0/1633743274 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e2d9d640 1 -- 172.21.15.67:0/1633743274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e4159c60 msgr2=0x7f93e40ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e2d9d640 1 --2- 172.21.15.67:0/1633743274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e4159c60 0x7f93e40ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e2d9d640 1 -- 172.21.15.67:0/1633743274 >> v1:172.21.15.97:6789/0 conn(0x7f93e406ffd0 legacy=0x7f93e40aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.674+0000 7f93e2d9d640 1 -- 172.21.15.67:0/1633743274 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e415cb30 con 0x7f93e40af3a0 2024-09-19T05:36:16.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e2d9d640 1 --2- 172.21.15.67:0/1633743274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93e40af3a0 0x7f93e415fdc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009870 tx=0x7f93d401c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33d54aefa100f032 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e159a640 1 -- 172.21.15.67:0/1633743274 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40a95f0 con 0x7f93e40af3a0 2024-09-19T05:36:16.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e159a640 1 -- 172.21.15.67:0/1633743274 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d40a9790 con 0x7f93e40af3a0 2024-09-19T05:36:16.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e159a640 1 -- 172.21.15.67:0/1633743274 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40a9b60 con 0x7f93e40af3a0 2024-09-19T05:36:16.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e8f9f640 1 -- 172.21.15.67:0/1633743274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93e40af3a0 msgr2=0x7f93e415fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e8f9f640 1 --2- 172.21.15.67:0/1633743274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93e40af3a0 0x7f93e415fdc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009870 tx=0x7f93d401c530 comp rx=0 tx=0).stop 2024-09-19T05:36:16.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e8f9f640 1 -- 172.21.15.67:0/1633743274 shutdown_connections 2024-09-19T05:36:16.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e8f9f640 1 --2- 172.21.15.67:0/1633743274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93e40af3a0 0x7f93e415fdc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e8f9f640 1 --2- 172.21.15.67:0/1633743274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e4159c60 0x7f93e40ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e8f9f640 1 -- 172.21.15.67:0/1633743274 >> 172.21.15.67:0/1633743274 conn(0x7f93e40b1e50 msgr2=0x7f93e40b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e8f9f640 1 -- 172.21.15.67:0/1633743274 shutdown_connections 2024-09-19T05:36:16.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.678+0000 7f93e8f9f640 1 -- 172.21.15.67:0/1633743274 wait complete. 2024-09-19T05:36:16.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e8f9f640 1 Processor -- start 2024-09-19T05:36:16.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e8f9f640 1 -- start start 2024-09-19T05:36:16.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e8f9f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e406ffd0 0x7f93e409cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e8f9f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e40af3a0 0x7f93e40b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e8f9f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93e4159c60 0x7f93e409a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e8f9f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4168e30 con 0x7f93e40af3a0 2024-09-19T05:36:16.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e8f9f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4168fb0 con 0x7f93e4159c60 2024-09-19T05:36:16.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e8f9f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f93e4169130 con 0x7f93e406ffd0 2024-09-19T05:36:16.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e40af3a0 0x7f93e40b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e40af3a0 0x7f93e40b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47220/0 (socket says 172.21.15.67:47220) 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e1d9b640 1 -- 172.21.15.67:0/2960703994 learned_addr learned my addr 172.21.15.67:0/2960703994 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e2d9d640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93e4159c60 0x7f93e409a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e259c640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e406ffd0 0x7f93e409cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e1d9b640 1 -- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e406ffd0 msgr2=0x7f93e409cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e406ffd0 0x7f93e409cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e1d9b640 1 -- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93e4159c60 msgr2=0x7f93e409a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93e4159c60 0x7f93e409a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e1d9b640 1 -- 172.21.15.67:0/2960703994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e4153b80 con 0x7f93e40af3a0 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e259c640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e406ffd0 0x7f93e409cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e40af3a0 0x7f93e40b3850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00c770 tx=0x7f93cc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93daffd640 1 -- 172.21.15.67:0/2960703994 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc016020 con 0x7f93e40af3a0 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93daffd640 1 -- 172.21.15.67:0/2960703994 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93cc006d80 con 0x7f93e40af3a0 2024-09-19T05:36:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e8f9f640 1 -- 172.21.15.67:0/2960703994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e409c160 con 0x7f93e40af3a0 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93daffd640 1 -- 172.21.15.67:0/2960703994 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc003bc0 con 0x7f93e40af3a0 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.682+0000 7f93e8f9f640 1 -- 172.21.15.67:0/2960703994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e409be10 con 0x7f93e40af3a0 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93daffd640 1 -- 172.21.15.67:0/2960703994 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93cc00a7f0 con 0x7f93e40af3a0 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93daffd640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93c80678c0 0x7f93c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93daffd640 1 -- 172.21.15.67:0/2960703994 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f93cc085af0 con 0x7f93e40af3a0 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e259c640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93c80678c0 0x7f93c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93ec05b000 1 Processor -- start 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93ec05b000 1 -- start start 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e259c640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93c80678c0 0x7f93c8069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009b10 tx=0x7f93dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c7c10 0x5641cf3c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c8530 0x5641cf37b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf37bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93ec05b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5641cf1cccc0 con 0x5641cf3c8530 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93ec05b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5641cf187a20 con 0x5641cf3c7c10 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93ec05b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5641cf1c8c80 con 0x5641cf37b780 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c8530 0x5641cf37b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c8530 0x5641cf37b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47234/0 (socket says 172.21.15.67:47234) 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e1d9b640 1 -- 172.21.15.67:0/2808276626 learned_addr learned my addr 172.21.15.67:0/2808276626 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e259c640 1 --2- 172.21.15.67:0/2808276626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c7c10 0x5641cf3c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e2d9d640 1 --2- 172.21.15.67:0/2808276626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf37bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e1d9b640 1 -- 172.21.15.67:0/2808276626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 msgr2=0x5641cf37bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/2808276626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf37bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e1d9b640 1 -- 172.21.15.67:0/2808276626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c7c10 msgr2=0x5641cf3c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/2808276626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c7c10 0x5641cf3c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e1d9b640 1 -- 172.21.15.67:0/2808276626 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641cf16fd40 con 0x5641cf3c8530 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e259c640 1 --2- 172.21.15.67:0/2808276626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c7c10 0x5641cf3c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/2808276626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c8530 0x5641cf37b240 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f93cc083dc0 tx=0x7f93cc056520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bfb91553238ead server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93d3fff640 1 -- 172.21.15.67:0/2808276626 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc072070 con 0x5641cf3c8530 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93d3fff640 1 -- 172.21.15.67:0/2808276626 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93cc05e8c0 con 0x5641cf3c8530 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.686+0000 7f93d3fff640 1 -- 172.21.15.67:0/2808276626 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc06b070 con 0x5641cf3c8530 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- 172.21.15.67:0/2808276626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c8530 msgr2=0x5641cf37b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 --2- 172.21.15.67:0/2808276626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c8530 0x5641cf37b240 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f93cc083dc0 tx=0x7f93cc056520 comp rx=0 tx=0).stop 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- 172.21.15.67:0/2808276626 shutdown_connections 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 --2- 172.21.15.67:0/2808276626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf37bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 --2- 172.21.15.67:0/2808276626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c8530 0x5641cf37b240 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 --2- 172.21.15.67:0/2808276626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c7c10 0x5641cf3c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- 172.21.15.67:0/2808276626 >> 172.21.15.67:0/2808276626 conn(0x5641cf3a89b0 msgr2=0x5641cf3aada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- 172.21.15.67:0/2808276626 shutdown_connections 2024-09-19T05:36:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- 172.21.15.67:0/2808276626 wait complete. 2024-09-19T05:36:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- start start 2024-09-19T05:36:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 Processor -- start 2024-09-19T05:36:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf382000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf382540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf382a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5641cf1662c0 con 0x5641cf3c7c10 2024-09-19T05:36:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5641cf18b370 con 0x5641cf3c8530 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5641cf1daf50 con 0x5641cf37b780 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 10 client.0 _ll_register_callbacks cb 0x5641cf22ddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf382540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf382540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47240/0 (socket says 172.21.15.67:47240) 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e1d9b640 1 -- 172.21.15.67:0/856656476 learned_addr learned my addr 172.21.15.67:0/856656476 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e2d9d640 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf382a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e259c640 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf382000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e1d9b640 1 -- 172.21.15.67:0/856656476 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 msgr2=0x5641cf382000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf382000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e1d9b640 1 -- 172.21.15.67:0/856656476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 msgr2=0x5641cf382a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf382a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e1d9b640 1 -- 172.21.15.67:0/856656476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641cf16c770 con 0x5641cf3c7c10 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e2d9d640 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf382a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf382540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f93cc055ea0 tx=0x7f93cc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10d34334f8ae8b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93d17fa640 1 -- 172.21.15.67:0/856656476 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc072040 con 0x5641cf3c7c10 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- 172.21.15.67:0/856656476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93cc05e8c0 con 0x5641cf3c7c10 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93d17fa640 1 -- 172.21.15.67:0/856656476 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f93cc0740c0 con 0x5641cf3c7c10 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93d17fa640 1 -- 172.21.15.67:0/856656476 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f93cc0742c0 con 0x5641cf3c7c10 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 10 client.5199 fetch_fsmap learned FSMap version 16 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- 172.21.15.67:0/856656476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5641cf18a3f0 con 0x5641cf3c7c10 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93d17fa640 1 -- 172.21.15.67:0/856656476 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93cc05e8c0 con 0x5641cf3c7c10 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93d17fa640 1 -- 172.21.15.67:0/856656476 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f93cc07d340 con 0x5641cf3c7c10 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 10 client.5199 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 10 client.5199 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 20 client.5199 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5641cf3d7cb0 0x5641cf3da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 4 client.5199 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93ec05b000 1 -- 172.21.15.67:0/856656476 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641cf166d90 con 0x5641cf3d7cb0 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e259c640 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5641cf3d7cb0 0x5641cf3da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93e259c640 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5641cf3d7cb0 0x5641cf3da0a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc37f4be4a6dacf2 server_cookie=af059920f4fce742 in_seq=0 out_seq=0 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.690+0000 7f93d17fa640 10 client.5199 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93d17fa640 1 -- 172.21.15.67:0/856656476 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641cf166d90 con 0x5641cf3d7cb0 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93d17fa640 10 client.5199 handle_command_reply: tid=0 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 client.5199 shutdown 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 -- 172.21.15.67:0/856656476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 msgr2=0x5641cf382540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf382540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f93cc055ea0 tx=0x7f93cc000f50 comp rx=0 tx=0).stop 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 -- 172.21.15.67:0/856656476 shutdown_connections 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5641cf3d7cb0 0x5641cf3da0a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf382a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf382540 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93d17fa640 0 client.5199 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:36:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 --2- 172.21.15.67:0/856656476 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf382000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 -- 172.21.15.67:0/856656476 >> 172.21.15.67:0/856656476 conn(0x5641cf3a89b0 msgr2=0x5641cf37a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 -- 172.21.15.67:0/856656476 shutdown_connections 2024-09-19T05:36:16.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 1 -- 172.21.15.67:0/856656476 wait complete. 2024-09-19T05:36:16.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.694+0000 7f93ec05b000 20 client.5199 trim_cache size 0 max 16384 2024-09-19T05:36:16.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 Processor -- start 2024-09-19T05:36:16.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 -- start start 2024-09-19T05:36:16.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf43afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf43b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf43ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4201330 con 0x5641cf3c7c10 2024-09-19T05:36:16.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4153290 con 0x5641cf3c8530 2024-09-19T05:36:16.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f93e414f850 con 0x5641cf37b780 2024-09-19T05:36:16.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf43b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf43b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47252/0 (socket says 172.21.15.67:47252) 2024-09-19T05:36:16.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e1d9b640 1 -- 172.21.15.67:0/3727113708 learned_addr learned my addr 172.21.15.67:0/3727113708 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e2d9d640 1 --2- 172.21.15.67:0/3727113708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf43ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e259c640 1 --2- 172.21.15.67:0/3727113708 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf43afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e1d9b640 1 -- 172.21.15.67:0/3727113708 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 msgr2=0x5641cf43afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/3727113708 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf43afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e1d9b640 1 -- 172.21.15.67:0/3727113708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 msgr2=0x5641cf43ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/3727113708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf43ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e1d9b640 1 -- 172.21.15.67:0/3727113708 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641cf24e320 con 0x5641cf3c7c10 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/3727113708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf43b4f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f93cc052140 tx=0x7f93cc07f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e962d9d20c0d2e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93d37fe640 1 -- 172.21.15.67:0/3727113708 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc05c2c0 con 0x5641cf3c7c10 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93d37fe640 1 -- 172.21.15.67:0/3727113708 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93cc074070 con 0x5641cf3c7c10 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93d37fe640 1 -- 172.21.15.67:0/3727113708 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc052350 con 0x5641cf3c7c10 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 -- 172.21.15.67:0/3727113708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 msgr2=0x5641cf43b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 --2- 172.21.15.67:0/3727113708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf43b4f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f93cc052140 tx=0x7f93cc07f040 comp rx=0 tx=0).stop 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 -- 172.21.15.67:0/3727113708 shutdown_connections 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 --2- 172.21.15.67:0/3727113708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf43ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 --2- 172.21.15.67:0/3727113708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf3c7c10 0x5641cf43b4f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 --2- 172.21.15.67:0/3727113708 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf37b780 0x5641cf43afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 -- 172.21.15.67:0/3727113708 >> 172.21.15.67:0/3727113708 conn(0x5641cf3a89b0 msgr2=0x5641cf379a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 -- 172.21.15.67:0/3727113708 shutdown_connections 2024-09-19T05:36:16.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.710+0000 7f93ec05b000 1 -- 172.21.15.67:0/3727113708 wait complete. 2024-09-19T05:36:16.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- start start 2024-09-19T05:36:16.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 Processor -- start 2024-09-19T05:36:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf37b780 0x5641cf43ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf3c7c10 0x5641cf43f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf3fa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5641cf174120 con 0x5641cf37b780 2024-09-19T05:36:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5641cf24de90 con 0x5641cf3c8530 2024-09-19T05:36:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5641cf176b90 con 0x5641cf3c7c10 2024-09-19T05:36:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 10 client.0 _ll_register_callbacks cb 0x7f93cc070070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf37b780 0x5641cf43ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf37b780 0x5641cf43ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47258/0 (socket says 172.21.15.67:47258) 2024-09-19T05:36:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e259c640 1 -- 172.21.15.67:0/446484514 learned_addr learned my addr 172.21.15.67:0/446484514 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf3c7c10 0x5641cf43f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e259c640 1 -- 172.21.15.67:0/446484514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf3c7c10 msgr2=0x5641cf43f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e259c640 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf3c7c10 0x5641cf43f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e259c640 1 -- 172.21.15.67:0/446484514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 msgr2=0x5641cf3fa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e2d9d640 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf3fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e259c640 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf3fa790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e259c640 1 -- 172.21.15.67:0/446484514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641cf1605c0 con 0x5641cf37b780 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf3c7c10 0x5641cf43f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e259c640 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf37b780 0x5641cf43ef70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f93dc004630 tx=0x7f93dc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f2bc4b7c86598b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93d17fa640 1 -- 172.21.15.67:0/446484514 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc011e60 con 0x5641cf37b780 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- 172.21.15.67:0/446484514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93cc074070 con 0x5641cf37b780 2024-09-19T05:36:16.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93d17fa640 1 -- 172.21.15.67:0/446484514 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f93dc00f050 con 0x5641cf37b780 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93d17fa640 1 -- 172.21.15.67:0/446484514 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f93dc039050 con 0x5641cf37b780 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 10 client.5205 fetch_fsmap learned FSMap version 16 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- 172.21.15.67:0/446484514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5641cf164330 con 0x5641cf37b780 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93d17fa640 1 -- 172.21.15.67:0/446484514 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93cc074070 con 0x5641cf37b780 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93d17fa640 1 -- 172.21.15.67:0/446484514 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f93dc03c020 con 0x5641cf37b780 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 10 client.5205 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 10 client.5205 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 20 client.5205 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5641cf3facd0 0x5641cf3fb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 4 client.5205 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- 172.21.15.67:0/446484514 --> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] -- command(tid 0: {"prefix": "perf dump"}) -- 0x5641cf1da3f0 con 0x5641cf3facd0 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5641cf3facd0 0x5641cf3fb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93d17fa640 10 client.5205 ms_handle_connect on v2:172.21.15.67:6833/3857596366 2024-09-19T05:36:16.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93e1d9b640 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5641cf3facd0 0x5641cf3fb0b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=388cfb88fd788de8 server_cookie=2ba099ee4b31f8d8 in_seq=0 out_seq=0 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93d17fa640 1 -- 172.21.15.67:0/446484514 <== mds.0 v2:172.21.15.67:6833/3857596366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18018 (crc 0 0 0) 0x5641cf1da3f0 con 0x5641cf3facd0 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93d17fa640 10 client.5205 handle_command_reply: tid=0 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 client.5205 shutdown 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- 172.21.15.67:0/446484514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf37b780 msgr2=0x5641cf43ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf37b780 0x5641cf43ef70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f93dc004630 tx=0x7f93dc0046d0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- 172.21.15.67:0/446484514 shutdown_connections 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.67:6833/3857596366,v1:172.21.15.67:6835/3857596366] conn(0x5641cf3facd0 0x5641cf3fb0b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5641cf3c8530 0x5641cf3fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5641cf3c7c10 0x5641cf43f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93d17fa640 0 client.5205 ms_handle_reset on v2:172.21.15.67:6833/3857596366 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 --2- 172.21.15.67:0/446484514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5641cf37b780 0x5641cf43ef70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- 172.21.15.67:0/446484514 >> 172.21.15.67:0/446484514 conn(0x5641cf3a89b0 msgr2=0x5641cf37a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- 172.21.15.67:0/446484514 shutdown_connections 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.714+0000 7f93ec05b000 1 -- 172.21.15.67:0/446484514 wait complete. 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93ec05b000 20 client.5205 trim_cache size 0 max 16384 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 5727, 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 5728, 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 1433301, 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 39856859, 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 17, 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 6, 2024-09-19T05:36:16.726 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.659345702, 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.296399083, 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.128098194, 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.189720466, 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 5727, 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.790415979, 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000138015 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 10, 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000001460, 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000146 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.727 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 4384, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 4414, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 1096912, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 18340718, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 6, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.444651505, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.191203111, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.091252285, 2024-09-19T05:36:16.728 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.135637355, 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 4412, 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.610734427, 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000138425 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 135424 2024-09-19T05:36:16.729 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 35140, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 61361, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 12926886, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 60432206, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 7, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 5.073377875, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 2.564963308, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 2.952739803, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.118166685, 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:36:16.730 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 61361, 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 2.363172626, 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000038512 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 87503, 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.021581677, 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000246 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 123056, 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 33120 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 1, 2024-09-19T05:36:16.731 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-MDSRank": { 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 10520, 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 24.932014461, 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.002369963 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-PurgeQueue": { 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-19T05:36:16.732 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3645, 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 1.619844051, 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000444401 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: "request": 26394, 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: "reply": 26394, 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: "reply_latency": { 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 26394, 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 430.831659617, 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.016323090 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.733 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_reply": 0, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "forward": 0, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_complete": 0, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_keys": 0, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_commit": 12, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_split": 0, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_merge": 0, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes": 17836, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_top": 0, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_bottom": 17836, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pin_tail": 0, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pinned": 17836, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_expired": 0, 2024-09-19T05:36:16.734 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_with_caps": 2, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": 2, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "subtrees": 2, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse": 41999, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_hit": 41475, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_forward": 0, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_discover": 0, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_dir_fetch": 0, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_remote_ino": 0, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_lock": 115, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "load_cent": 0, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "q": 0, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "exported": 0, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "exported_inodes": 0, 2024-09-19T05:36:16.735 INFO:teuthology.orchestra.run.smithi067.stdout: "imported": 0, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "imported_inodes": 0, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_dir_fetch": 0, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_backtrace_fetch": 2013, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_peer_discover": 0, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rfiles": 0, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rbytes": 0, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rsnaps": 0, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_fetch": 2013, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_set_tag": 0, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_inodes": 13, 2024-09-19T05:36:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_base_inodes": 2, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dirfrag_rstats": 11, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_file_inodes": 2000, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_inode_file_caps": 0, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_revoke": 7721, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_grant": 6391, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps": 7721, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps_dirty": 2000, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_cap_release": 51, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "process_request_cap_release": 17979 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_cache": { 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update": 0, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update_receipt": 0, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_try_discover": 0, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_send_discover": 0, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_handle_discover": 0, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays": 0, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_delayed": 0, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_created": 4087, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_enqueued": 3640, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_reintegrated": 2144, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_migrated": 0, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_processing": 0, 2024-09-19T05:36:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_started": 0, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_completed": 0, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_enqueue_scrub": 1, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_exportdir": 0, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_flush": 0, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragmentdir": 0, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragstats": 0, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_inodestats": 0 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_log": { 2024-09-19T05:36:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "evlrg": 0, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "evadd": 25763, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "evex": 0, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "evtrm": 0, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "ev": 25763, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "evexg": 0, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "evexd": 0, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "segadd": 34, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "segex": 0, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "segtrm": 0, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "seg": 34, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "segmjr": 4, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "segexg": 0, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "segexd": 0, 2024-09-19T05:36:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "expos": 4194304, 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "wrpos": 86588760, 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "rdpos": 0, 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "jlat": { 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6891, 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 113.990481072, 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.016541936 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "replayed": 0 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_mem": { 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 14, 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "ino+": 2016, 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "ino-": 2002, 2024-09-19T05:36:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "dir": 13, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "dir+": 13, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "dir-": 0, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "dn": 17836, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "dn+": 19836, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "dn-": 2000, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "cap": 2, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "cap+": 2002, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "cap-": 2000, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "rss": 93608, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "heap": 231732 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_server": { 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_client_request": 35266, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_server_request": 0, 2024-09-19T05:36:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_request": 26394, 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_session": 8, 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_peer_request": 0, 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "req_create_latency": { 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2000, 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 1.691374771, 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000845687 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getattr_latency": { 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 268, 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.090428910, 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000337421 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getfilelock_latency": { 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "req_link_latency": { 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6000, 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 10.270894041, 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001711815 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookup_latency": { 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7969, 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 8.483531645, 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001064566 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookuphash_latency": { 2024-09-19T05:36:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupino_latency": { 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupname_latency": { 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupparent_latency": { 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupsnap_latency": { 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3, 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.024818685, 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.008272895 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lssnap_latency": { 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mkdir_latency": { 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.004153608, 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.004153608 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mknod_latency": { 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mksnap_latency": { 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.005662277, 2024-09-19T05:36:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005662277 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "req_open_latency": { 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "req_readdir_latency": { 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6, 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.171986435, 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.028664405 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rename_latency": { 2024-09-19T05:36:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2144, 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 374.327927650, 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.174593249 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "req_renamesnap_latency": { 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "req_snapdiff_latency": { 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmdir_latency": { 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmsnap_latency": { 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.005294039, 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005294039 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmxattr_latency": { 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setattr_latency": { 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000519393, 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000519393 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setdirlayout_latency": { 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setfilelock_latency": { 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setlayout_latency": { 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setxattr_latency": { 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "req_symlink_latency": { 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "req_unlink_latency": { 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8000, 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 35.755068163, 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.004469383 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getvxattr_latency": { 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_sessions": { 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "session_count": 1, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "session_add": 1, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "session_remove": 0, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_open": 1, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_stale": 0, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "total_load": 15009, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "average_load": 15009, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "avg_session_uptime": 117, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mdthresh_evicted": 0 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:36:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:36:16.755 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:36:16.756 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 251571, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 86, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:36:16.757 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 5624, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 80, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 13432052, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 660999, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-19T05:36:16.758 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "objecter": { 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "op_active": 0, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "op_laggy": 0, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send": 12990, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send_bytes": 82910708, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "op_resend": 37, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "op_reply": 12990, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "op_latency": { 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 12990, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 59.094924773, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.004549262 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "op_inflight": 0, 2024-09-19T05:36:16.759 INFO:teuthology.orchestra.run.smithi067.stdout: "oplen_avg": { 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 12990, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 13152 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "op": 12990, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "op_r": 2133, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "op_w": 10857, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "op_rmw": 0, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "op_pg": 0, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_stat": 0, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_create": 11, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_read": 118, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_write": 7007, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writefull": 65, 2024-09-19T05:36:16.760 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writesame": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_append": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_zero": 1640, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_truncate": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_delete": 2031, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_mapext": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_sparse_read": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_clonerange": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_getxattr": 2015, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_setxattr": 22, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_rmxattr": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_call": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_watch": 0, 2024-09-19T05:36:16.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_notify": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_other": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_active": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_send": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_resend": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_ping": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_active": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_send": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_resend": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_active": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_send": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_resend": 0, 2024-09-19T05:36:16.762 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_active": 0, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_send": 0, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_resend": 0, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "command_active": 0, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "command_send": 0, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "command_resend": 0, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "map_epoch": 43, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "map_full": 0, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "map_inc": 5, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_sessions": 8, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_open": 8, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_close": 0, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_laggy": 0, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_wr": 191, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_rd": 0, 2024-09-19T05:36:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_del": 52 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "oft": { 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_objs": 1, 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_updates": 0, 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_removes": 0 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "osd-slow-ops": { 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_ops_count": 0 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "purge_queue": { 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops": 0, 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops_high_water": 32, 2024-09-19T05:36:16.764 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing": 0, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_high_water": 32, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed_ops": 3640, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed": 3640, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_item_in_journal": 0 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 45246, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 11378741, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 45246, 2024-09-19T05:36:16.765 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 45246, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 11378741, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_bytes": { 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-19T05:36:16.766 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 12990, 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 83291468, 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 12990, 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 83291468, 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_ops": { 2024-09-19T05:36:16.767 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 1024, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 12990, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 12990, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 12990, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 12990, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.768 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 3640, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 380760, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 3640, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 116, 2024-09-19T05:36:16.769 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 380760, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle-0x55abc1c10780": { 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 25763, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 82394456, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 25763, 2024-09-19T05:36:16.770 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 6891, 2024-09-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 82394456, 2024-09-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:16.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 -- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93c80678c0 msgr2=0x7f93c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93c80678c0 0x7f93c8069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009b10 tx=0x7f93dc008040 comp rx=0 tx=0).stop 2024-09-19T05:36:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 -- 172.21.15.67:0/2960703994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e40af3a0 msgr2=0x7f93e40b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e40af3a0 0x7f93e40b3850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00c770 tx=0x7f93cc00cc30 comp rx=0 tx=0).stop 2024-09-19T05:36:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 -- 172.21.15.67:0/2960703994 shutdown_connections 2024-09-19T05:36:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93e4159c60 0x7f93e409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e40af3a0 0x7f93e40b3850 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93c80678c0 0x7f93c8069d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 --2- 172.21.15.67:0/2960703994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93e406ffd0 0x7f93e409cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 -- 172.21.15.67:0/2960703994 >> 172.21.15.67:0/2960703994 conn(0x7f93e40b1e50 msgr2=0x7f93e406f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 -- 172.21.15.67:0/2960703994 shutdown_connections 2024-09-19T05:36:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:16.718+0000 7f93e8f9f640 1 -- 172.21.15.67:0/2960703994 wait complete. 2024-09-19T05:36:16.774 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:36:16.774 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:36:16.845 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:36:16.925 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:36:16.925 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:36:16.925 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:36:16.925 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:36:16.932 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:36:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccf2a3640 1 Processor -- start 2024-09-19T05:36:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccf2a3640 1 -- start start 2024-09-19T05:36:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccf2a3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80d1590 0x7fbcc80d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccf2a3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbcc80b51d0 0x7fbcc80cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccf2a3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc80d4d40 con 0x7fbcc8161da0 2024-09-19T05:36:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccf2a3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbcc80d0840 con 0x7fbcc80b51d0 2024-09-19T05:36:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccf2a3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc80d5020 con 0x7fbcc80d1590 2024-09-19T05:36:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccd840640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbcc80b51d0 0x7fbcc80cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccd840640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbcc80b51d0 0x7fbcc80cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47272/0 (socket says 172.21.15.67:47272) 2024-09-19T05:36:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccd840640 1 -- 172.21.15.67:0/3479488737 learned_addr learned my addr 172.21.15.67:0/3479488737 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccc83e640 1 --2- 172.21.15.67:0/3479488737 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80d1590 0x7fbcc80d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.106+0000 7fbccd840640 1 -- 172.21.15.67:0/3479488737 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80d1590 msgr2=0x7fbcc80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:17.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccd840640 1 --2- 172.21.15.67:0/3479488737 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80d1590 0x7fbcc80d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccd840640 1 -- 172.21.15.67:0/3479488737 >> v1:172.21.15.67:6789/0 conn(0x7fbcc8161da0 legacy=0x7fbcc80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:17.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccd840640 1 -- 172.21.15.67:0/3479488737 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc80d5300 con 0x7fbcc80b51d0 2024-09-19T05:36:17.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbcc7fff640 1 -- 172.21.15.67:0/3479488737 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313646148 0 0) 0x7fbcc80d4d40 con 0x7fbcc8161da0 2024-09-19T05:36:17.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccc83e640 1 --2- 172.21.15.67:0/3479488737 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80d1590 0x7fbcc80d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:17.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccd840640 1 --2- 172.21.15.67:0/3479488737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc80b51d0 0x7fbcc80cf150 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009870 tx=0x7fbcc001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f7f989f2606c30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:17.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbcc7fff640 1 -- 172.21.15.67:0/3479488737 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00b0070 con 0x7fbcc80b51d0 2024-09-19T05:36:17.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbcc7fff640 1 -- 172.21.15.67:0/3479488737 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc00ab600 con 0x7fbcc80b51d0 2024-09-19T05:36:17.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbcc7fff640 1 -- 172.21.15.67:0/3479488737 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00ab9d0 con 0x7fbcc80b51d0 2024-09-19T05:36:17.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3479488737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc80b51d0 msgr2=0x7fbcc80cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:17.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccf2a3640 1 --2- 172.21.15.67:0/3479488737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc80b51d0 0x7fbcc80cf150 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009870 tx=0x7fbcc001c560 comp rx=0 tx=0).stop 2024-09-19T05:36:17.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3479488737 shutdown_connections 2024-09-19T05:36:17.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccf2a3640 1 --2- 172.21.15.67:0/3479488737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc80b51d0 0x7fbcc80cf150 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccf2a3640 1 --2- 172.21.15.67:0/3479488737 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80d1590 0x7fbcc80d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3479488737 >> 172.21.15.67:0/3479488737 conn(0x7fbcc808bfc0 msgr2=0x7fbcc80d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3479488737 shutdown_connections 2024-09-19T05:36:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.110+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3479488737 wait complete. 2024-09-19T05:36:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 Processor -- start 2024-09-19T05:36:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 -- start start 2024-09-19T05:36:17.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80b51d0 0x7fbcc80b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc80d1590 0x7fbcc815a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc8161da0 0x7fbcc8150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc80d0020 con 0x7fbcc8161da0 2024-09-19T05:36:17.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc80cfea0 con 0x7fbcc80d1590 2024-09-19T05:36:17.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc80d01a0 con 0x7fbcc80b51d0 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd840640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc8161da0 0x7fbcc8150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd840640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc8161da0 0x7fbcc8150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47284/0 (socket says 172.21.15.67:47284) 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd840640 1 -- 172.21.15.67:0/3996025549 learned_addr learned my addr 172.21.15.67:0/3996025549 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccc83e640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc80d1590 0x7fbcc815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd03f640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80b51d0 0x7fbcc80b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd840640 1 -- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80b51d0 msgr2=0x7fbcc80b9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd840640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80b51d0 0x7fbcc80b9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd840640 1 -- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc80d1590 msgr2=0x7fbcc815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd840640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc80d1590 0x7fbcc815a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd840640 1 -- 172.21.15.67:0/3996025549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc80ba240 con 0x7fbcc8161da0 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd03f640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80b51d0 0x7fbcc80b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccd840640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc8161da0 0x7fbcc8150930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009870 tx=0x7fbcc0019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbcc5ffb640 1 -- 172.21.15.67:0/3996025549 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00bb070 con 0x7fbcc8161da0 2024-09-19T05:36:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbcc5ffb640 1 -- 172.21.15.67:0/3996025549 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc0004030 con 0x7fbcc8161da0 2024-09-19T05:36:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3996025549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc80b1f10 con 0x7fbcc8161da0 2024-09-19T05:36:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbcc5ffb640 1 -- 172.21.15.67:0/3996025549 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00b0040 con 0x7fbcc8161da0 2024-09-19T05:36:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3996025549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc80b1430 con 0x7fbcc8161da0 2024-09-19T05:36:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3996025549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc80cf150 con 0x7fbcc8161da0 2024-09-19T05:36:17.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.114+0000 7fbcc5ffb640 1 -- 172.21.15.67:0/3996025549 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbcc0003620 con 0x7fbcc8161da0 2024-09-19T05:36:17.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.118+0000 7fbcc5ffb640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbcb40678f0 0x7fbcb4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.118+0000 7fbcc5ffb640 1 -- 172.21.15.67:0/3996025549 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7fbcc011f6c0 con 0x7fbcc8161da0 2024-09-19T05:36:17.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.118+0000 7fbccd03f640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbcb40678f0 0x7fbcb4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.118+0000 7fbccd03f640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbcb40678f0 0x7fbcb4069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8007fd0 tx=0x7fbcb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:17.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.122+0000 7fbcc5ffb640 1 -- 172.21.15.67:0/3996025549 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fbcc0016150 con 0x7fbcc8161da0 2024-09-19T05:36:17.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.298+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3996025549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbcc815c170 con 0x7fbcc8161da0 2024-09-19T05:36:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.298+0000 7fbcc5ffb640 1 -- 172.21.15.67:0/3996025549 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) ==== 80+0+0 (secure 0 0 0) 0x7fbcc00eff30 con 0x7fbcc8161da0 2024-09-19T05:36:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:36:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbcb40678f0 msgr2=0x7fbcb4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbcb40678f0 0x7fbcb4069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8007fd0 tx=0x7fbcb8009040 comp rx=0 tx=0).stop 2024-09-19T05:36:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3996025549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc8161da0 msgr2=0x7fbcc8150930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc8161da0 0x7fbcc8150930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009870 tx=0x7fbcc0019300 comp rx=0 tx=0).stop 2024-09-19T05:36:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3996025549 shutdown_connections 2024-09-19T05:36:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcc8161da0 0x7fbcc8150930 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc80d1590 0x7fbcc815a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbcb40678f0 0x7fbcb4069db0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 --2- 172.21.15.67:0/3996025549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc80b51d0 0x7fbcc80b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3996025549 >> 172.21.15.67:0/3996025549 conn(0x7fbcc808bfc0 msgr2=0x7fbcc81520b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:17.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3996025549 shutdown_connections 2024-09-19T05:36:17.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.302+0000 7fbccf2a3640 1 -- 172.21.15.67:0/3996025549 wait complete. 2024-09-19T05:36:17.322 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:36:17.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:17.323 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:36:17.334 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[37956]: fuse finished with error 0 and tester_r 0 2024-09-19T05:36:17.340 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:36:17.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:17.340 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:36:17.554 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:36:17.554 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:36:17.554 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:36:17.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:36:17.562 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:36:17.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:17.562 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:36:17.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:36:17.608 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:36:17.608 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:36:17.608 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:36:17.609 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:36:17.614 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:36:17.615 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:36:17.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:17.615 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:36:17.660 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:36:17.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:36:17.661 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:36:17.661 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:36:17.661 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:36:17.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:36:17.667 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:36:17.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:17.667 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:36:17.715 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:36:17.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:36:17.717 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:36:17.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f52900bc640 1 Processor -- start 2024-09-19T05:36:17.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f52900bc640 1 -- start start 2024-09-19T05:36:17.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f52900bc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f528815c030 0x7f528806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f52900bc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f528815d1d0 0x7f52880b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f52900bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52880b3510 0x7f528806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f52900bc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f528806e3c0 con 0x7f528815d1d0 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f52900bc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f528806e6a0 con 0x7f528815c030 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f52900bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f528806e980 con 0x7f52880b3510 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f528d657640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f528815d1d0 0x7f52880b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f528d657640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f528815d1d0 0x7f52880b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47296/0 (socket says 172.21.15.67:47296) 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f528d657640 1 -- 172.21.15.67:0/1495461993 learned_addr learned my addr 172.21.15.67:0/1495461993 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f528e659640 1 --2- 172.21.15.67:0/1495461993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52880b3510 0x7f528806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f528de58640 1 --2- 172.21.15.67:0/1495461993 >> v2:172.21.15.97:3300/0 conn(0x7f528815c030 0x7f528806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f528d657640 1 -- 172.21.15.67:0/1495461993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52880b3510 msgr2=0x7f528806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f528d657640 1 --2- 172.21.15.67:0/1495461993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52880b3510 0x7f528806f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f528d657640 1 -- 172.21.15.67:0/1495461993 >> v2:172.21.15.97:3300/0 conn(0x7f528815c030 msgr2=0x7f528806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:17.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f528d657640 1 --2- 172.21.15.67:0/1495461993 >> v2:172.21.15.97:3300/0 conn(0x7f528815c030 0x7f528806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.846+0000 7f528d657640 1 -- 172.21.15.67:0/1495461993 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528806ec60 con 0x7f528815d1d0 2024-09-19T05:36:17.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f528d657640 1 --2- 172.21.15.67:0/1495461993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f528815d1d0 0x7f52880b2fd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5288070390 tx=0x7f528401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7dbf8f756229a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:17.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f528ce56640 1 -- 172.21.15.67:0/1495461993 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52840b1070 con 0x7f528815d1d0 2024-09-19T05:36:17.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f528ce56640 1 -- 172.21.15.67:0/1495461993 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52840ac620 con 0x7f528815d1d0 2024-09-19T05:36:17.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f528ce56640 1 -- 172.21.15.67:0/1495461993 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52840ac9f0 con 0x7f528815d1d0 2024-09-19T05:36:17.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 -- 172.21.15.67:0/1495461993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f528815d1d0 msgr2=0x7f52880b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:17.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 --2- 172.21.15.67:0/1495461993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f528815d1d0 0x7f52880b2fd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5288070390 tx=0x7f528401c4f0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 -- 172.21.15.67:0/1495461993 shutdown_connections 2024-09-19T05:36:17.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 --2- 172.21.15.67:0/1495461993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52880b3510 0x7f528806f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 --2- 172.21.15.67:0/1495461993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f528815d1d0 0x7f52880b2fd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 --2- 172.21.15.67:0/1495461993 >> v2:172.21.15.97:3300/0 conn(0x7f528815c030 0x7f528806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 -- 172.21.15.67:0/1495461993 >> 172.21.15.67:0/1495461993 conn(0x7f52880d0080 msgr2=0x7f52880d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:17.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 -- 172.21.15.67:0/1495461993 shutdown_connections 2024-09-19T05:36:17.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 -- 172.21.15.67:0/1495461993 wait complete. 2024-09-19T05:36:17.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 Processor -- start 2024-09-19T05:36:17.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 -- start start 2024-09-19T05:36:17.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52880b3510 0x7f5288156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f528815c030 0x7f52881658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f528815d1d0 0x7f5288165e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f528815fd40 con 0x7f52880b3510 2024-09-19T05:36:17.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f528815c620 con 0x7f528815d1d0 2024-09-19T05:36:17.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.850+0000 7f52900bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f528815fec0 con 0x7f528815c030 2024-09-19T05:36:17.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528de58640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52880b3510 0x7f5288156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528de58640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52880b3510 0x7f5288156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47304/0 (socket says 172.21.15.67:47304) 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528de58640 1 -- 172.21.15.67:0/2643252734 learned_addr learned my addr 172.21.15.67:0/2643252734 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528d657640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f528815c030 0x7f52881658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528e659640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f528815d1d0 0x7f5288165e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528de58640 1 -- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f528815c030 msgr2=0x7f52881658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528de58640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f528815c030 0x7f52881658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528de58640 1 -- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f528815d1d0 msgr2=0x7f5288165e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528de58640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f528815d1d0 0x7f5288165e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528de58640 1 -- 172.21.15.67:0/2643252734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5288150120 con 0x7f52880b3510 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528de58640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52880b3510 0x7f5288156680 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f527800d800 tx=0x7f527800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f527e7fc640 1 -- 172.21.15.67:0/2643252734 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527800b6c0 con 0x7f52880b3510 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f527e7fc640 1 -- 172.21.15.67:0/2643252734 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5278019070 con 0x7f52880b3510 2024-09-19T05:36:17.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f52900bc640 1 -- 172.21.15.67:0/2643252734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528815b830 con 0x7f52880b3510 2024-09-19T05:36:17.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f527e7fc640 1 -- 172.21.15.67:0/2643252734 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527800ba60 con 0x7f52880b3510 2024-09-19T05:36:17.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f52900bc640 1 -- 172.21.15.67:0/2643252734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528815b550 con 0x7f52880b3510 2024-09-19T05:36:17.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f52900bc640 1 -- 172.21.15.67:0/2643252734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528815f8b0 con 0x7f52880b3510 2024-09-19T05:36:17.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f527e7fc640 1 -- 172.21.15.67:0/2643252734 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f527800bc00 con 0x7f52880b3510 2024-09-19T05:36:17.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f527e7fc640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f526c0678c0 0x7f526c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:17.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f527e7fc640 1 -- 172.21.15.67:0/2643252734 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f52780862e0 con 0x7f52880b3510 2024-09-19T05:36:17.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528d657640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f526c0678c0 0x7f526c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:17.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.854+0000 7f528d657640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f526c0678c0 0x7f526c069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f52840ae000 tx=0x7f5284008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:17.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:17.858+0000 7f527e7fc640 1 -- 172.21.15.67:0/2643252734 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5278056c50 con 0x7f52880b3510 2024-09-19T05:36:18.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.062+0000 7f52900bc640 1 -- 172.21.15.67:0/2643252734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f528806dde0 con 0x7f52880b3510 2024-09-19T05:36:18.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.062+0000 7f527e7fc640 1 -- 172.21.15.67:0/2643252734 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5220 (secure 0 0 0) 0x7f5278056550 con 0x7f52880b3510 2024-09-19T05:36:18.067 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:18.067 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"btime":"2024-09-19T05:34:20:197437+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2848495891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2848495891},{"type":"v1","addr":"172.21.15.97:6835","nonce":2848495891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4741,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2818377677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2818377677},{"type":"v1","addr":"172.21.15.97:6837","nonce":2818377677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4887,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/244834094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":244834094},{"type":"v1","addr":"172.21.15.67:6834","nonce":244834094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-19T05:34:07.193697+0000","modified":"2024-09-19T05:34:20.150102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3857596366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3857596366},{"type":"v1","addr":"172.21.15.67:6835","nonce":3857596366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-19T05:36:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 16 2024-09-19T05:36:18.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 -- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f526c0678c0 msgr2=0x7f526c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f526c0678c0 0x7f526c069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f52840ae000 tx=0x7f5284008040 comp rx=0 tx=0).stop 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 -- 172.21.15.67:0/2643252734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52880b3510 msgr2=0x7f5288156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52880b3510 0x7f5288156680 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f527800d800 tx=0x7f527800dcc0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 -- 172.21.15.67:0/2643252734 shutdown_connections 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f528815d1d0 0x7f5288165e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f526c0678c0 0x7f526c069d80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f528815c030 0x7f52881658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 --2- 172.21.15.67:0/2643252734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52880b3510 0x7f5288156680 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 -- 172.21.15.67:0/2643252734 >> 172.21.15.67:0/2643252734 conn(0x7f52880d0080 msgr2=0x7f5288151420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 -- 172.21.15.67:0/2643252734 shutdown_connections 2024-09-19T05:36:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.066+0000 7f52900bc640 1 -- 172.21.15.67:0/2643252734 wait complete. 2024-09-19T05:36:18.087 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:36:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc0a5a5640 1 Processor -- start 2024-09-19T05:36:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc0a5a5640 1 -- start start 2024-09-19T05:36:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc0a5a5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc04161da0 0x7fcc040d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc0a5a5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc040d4d40 con 0x7fcc040d0e80 2024-09-19T05:36:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc0a5a5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc040d5020 con 0x7fcc040d0160 2024-09-19T05:36:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc0a5a5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcc040d0610 con 0x7fcc04161da0 2024-09-19T05:36:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc037fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcc040d0e80 0x7fcc040b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56802/0 (socket says 172.21.15.67:56802) 2024-09-19T05:36:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc037fe640 1 -- 172.21.15.67:0/4056192707 learned_addr learned my addr 172.21.15.67:0/4056192707 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc03fff640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc04161da0 0x7fcc040d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1276824162 0 0) 0x7fcc040d4d40 con 0x7fcc040d0e80 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbec003530 con 0x7fcc040d0e80 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 957363902 0 0) 0x7fcbec003530 con 0x7fcc040d0e80 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc04161da0 msgr2=0x7fcc040d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc04161da0 0x7fcc040d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 >> v1:172.21.15.97:6789/0 conn(0x7fcc040d0160 legacy=0x7fcc040b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc040d5300 con 0x7fcc040d0e80 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fcbf8001680 con 0x7fcc040d0e80 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 >> v1:172.21.15.67:6789/0 conn(0x7fcc040d0e80 legacy=0x7fcc040b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbec0039f0 0x7fcbec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec0043a0 0x7fcbec004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc04161da0 0x7fcbec0050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec00b9d0 con 0x7fcbec0043a0 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec00bb50 con 0x7fcbec0039f0 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcbec00bd50 con 0x7fcc04161da0 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc037fe640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec0043a0 0x7fcbec004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc03fff640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbec0039f0 0x7fcbec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc08b42640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc04161da0 0x7fcbec0050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc037fe640 1 -- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc04161da0 msgr2=0x7fcbec0050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc037fe640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc04161da0 0x7fcbec0050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc037fe640 1 -- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbec0039f0 msgr2=0x7fcbec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc037fe640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbec0039f0 0x7fcbec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.202+0000 7fcc037fe640 1 -- 172.21.15.67:0/4056192707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec003530 con 0x7fcbec0043a0 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc037fe640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec0043a0 0x7fcbec004870 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800c210 tx=0x7fcbf801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fb71cbefee0809 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8007d40 con 0x7fcbec0043a0 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf80a9070 con 0x7fcbec0043a0 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc02ffd640 1 -- 172.21.15.67:0/4056192707 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8005d40 con 0x7fcbec0043a0 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/4056192707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec0043a0 msgr2=0x7fcbec004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc0a5a5640 1 --2- 172.21.15.67:0/4056192707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec0043a0 0x7fcbec004870 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800c210 tx=0x7fcbf801cc60 comp rx=0 tx=0).stop 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc08b42640 1 -- 172.21.15.67:0/4056192707 reap_dead start 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/4056192707 shutdown_connections 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/4056192707 >> 172.21.15.67:0/4056192707 conn(0x7fcc0408bfc0 msgr2=0x7fcc040d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/4056192707 shutdown_connections 2024-09-19T05:36:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/4056192707 wait complete. 2024-09-19T05:36:18.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc0a5a5640 1 Processor -- start 2024-09-19T05:36:18.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.206+0000 7fcc0a5a5640 1 -- start start 2024-09-19T05:36:18.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc0a5a5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbec0043a0 0x7fcc040cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc0a5a5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc0415c650 0x7fcc04157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc0a5a5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0406de60 0x7fcc0406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc0a5a5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04162180 con 0x7fcc0406de60 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc0a5a5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcc040d0840 con 0x7fcc0415c650 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc0a5a5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcc040d12a0 con 0x7fcbec0043a0 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc08b42640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0406de60 0x7fcc0406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc08b42640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0406de60 0x7fcc0406e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47312/0 (socket says 172.21.15.67:47312) 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc08b42640 1 -- 172.21.15.67:0/505641611 learned_addr learned my addr 172.21.15.67:0/505641611 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc03fff640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbec0043a0 0x7fcc040cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc037fe640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc0415c650 0x7fcc04157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc08b42640 1 -- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbec0043a0 msgr2=0x7fcc040cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc08b42640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbec0043a0 0x7fcc040cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc08b42640 1 -- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc0415c650 msgr2=0x7fcc04157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc08b42640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc0415c650 0x7fcc04157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc08b42640 1 -- 172.21.15.67:0/505641611 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc040cdbf0 con 0x7fcc0406de60 2024-09-19T05:36:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc08b42640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0406de60 0x7fcc0406e2e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcc0406cad0 tx=0x7fcbfc00e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc00ff9640 1 -- 172.21.15.67:0/505641611 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc019070 con 0x7fcc0406de60 2024-09-19T05:36:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc00ff9640 1 -- 172.21.15.67:0/505641611 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0052e0 con 0x7fcc0406de60 2024-09-19T05:36:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/505641611 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc040cded0 con 0x7fcc0406de60 2024-09-19T05:36:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc00ff9640 1 -- 172.21.15.67:0/505641611 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc003840 con 0x7fcc0406de60 2024-09-19T05:36:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/505641611 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc04158120 con 0x7fcc0406de60 2024-09-19T05:36:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/505641611 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0406e820 con 0x7fcc0406de60 2024-09-19T05:36:18.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc00ff9640 1 -- 172.21.15.67:0/505641611 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcbfc01c070 con 0x7fcc0406de60 2024-09-19T05:36:18.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc00ff9640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678f0 0x7fcbf0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc00ff9640 1 -- 172.21.15.67:0/505641611 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7fcbfc085320 con 0x7fcc0406de60 2024-09-19T05:36:18.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.210+0000 7fcc03fff640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678f0 0x7fcbf0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.214+0000 7fcc03fff640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678f0 0x7fcbf0069db0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcc0415b630 tx=0x7fcbf400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:18.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.218+0000 7fcc00ff9640 1 -- 172.21.15.67:0/505641611 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fcbfc055ca0 con 0x7fcc0406de60 2024-09-19T05:36:18.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.418+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/505641611 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc04159840 con 0x7fcc0406de60 2024-09-19T05:36:18.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.418+0000 7fcc00ff9640 1 -- 172.21.15.67:0/505641611 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5220 (secure 0 0 0) 0x7fcbfc0555a0 con 0x7fcc0406de60 2024-09-19T05:36:18.424 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:18.424 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"btime":"2024-09-19T05:34:20:197437+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2848495891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2848495891},{"type":"v1","addr":"172.21.15.97:6835","nonce":2848495891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4741,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2818377677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2818377677},{"type":"v1","addr":"172.21.15.97:6837","nonce":2818377677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4887,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/244834094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":244834094},{"type":"v1","addr":"172.21.15.67:6834","nonce":244834094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-19T05:34:07.193697+0000","modified":"2024-09-19T05:34:20.150102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3857596366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3857596366},{"type":"v1","addr":"172.21.15.67:6835","nonce":3857596366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-19T05:36:18.425 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 16 2024-09-19T05:36:18.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678f0 msgr2=0x7fcbf0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678f0 0x7fcbf0069db0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcc0415b630 tx=0x7fcbf400b040 comp rx=0 tx=0).stop 2024-09-19T05:36:18.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/505641611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0406de60 msgr2=0x7fcc0406e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0406de60 0x7fcc0406e2e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcc0406cad0 tx=0x7fcbfc00e820 comp rx=0 tx=0).stop 2024-09-19T05:36:18.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/505641611 shutdown_connections 2024-09-19T05:36:18.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0406de60 0x7fcc0406e2e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc0415c650 0x7fcc04157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678f0 0x7fcbf0069db0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 --2- 172.21.15.67:0/505641611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbec0043a0 0x7fcc040cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/505641611 >> 172.21.15.67:0/505641611 conn(0x7fcc0408bfc0 msgr2=0x7fcc04159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:18.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/505641611 shutdown_connections 2024-09-19T05:36:18.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.422+0000 7fcc0a5a5640 1 -- 172.21.15.67:0/505641611 wait complete. 2024-09-19T05:36:18.444 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:36:18.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957f234640 1 Processor -- start 2024-09-19T05:36:18.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957f234640 1 -- start start 2024-09-19T05:36:18.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957f234640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f957815e330 0x7f9578071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957f234640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95780b4420 con 0x7f95780b2fd0 2024-09-19T05:36:18.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957f234640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9578162d90 con 0x7f95780b4bc0 2024-09-19T05:36:18.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957f234640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f95780acfb0 con 0x7f957815e330 2024-09-19T05:36:18.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f9577fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f95780b2fd0 0x7f9578161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56818/0 (socket says 172.21.15.67:56818) 2024-09-19T05:36:18.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f9577fff640 1 -- 172.21.15.67:0/1014916140 learned_addr learned my addr 172.21.15.67:0/1014916140 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:18.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957cfd0640 1 --2- 172.21.15.67:0/1014916140 >> v2:172.21.15.97:3300/0 conn(0x7f957815e330 0x7f9578071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 162023393 0 0) 0x7f95780b4420 con 0x7f95780b2fd0 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9560003530 con 0x7f95780b2fd0 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3277300715 0 0) 0x7f9560003530 con 0x7f95780b2fd0 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 >> v2:172.21.15.97:3300/0 conn(0x7f957815e330 msgr2=0x7f9578071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 --2- 172.21.15.67:0/1014916140 >> v2:172.21.15.97:3300/0 conn(0x7f957815e330 0x7f9578071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 >> v1:172.21.15.97:6789/0 conn(0x7f95780b4bc0 legacy=0x7f9578162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95780b4140 con 0x7f95780b2fd0 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f956c001680 con 0x7f95780b2fd0 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 >> v1:172.21.15.67:6789/0 conn(0x7f95780b2fd0 legacy=0x7f9578161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95600039c0 0x7f9560003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9560004810 0x7f9560004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95600051d0 0x7f956000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f956000c040 con 0x7f95600051d0 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f956000c1f0 con 0x7f9560004810 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f956000c3f0 con 0x7f95600039c0 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957d7d1640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95600051d0 0x7f956000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f9577fff640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9560004810 0x7f9560004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957cfd0640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95600039c0 0x7f9560003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957d7d1640 1 -- 172.21.15.67:0/1014916140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95600039c0 msgr2=0x7f9560003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957d7d1640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95600039c0 0x7f9560003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957d7d1640 1 -- 172.21.15.67:0/1014916140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9560004810 msgr2=0x7f9560004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957d7d1640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9560004810 0x7f9560004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957d7d1640 1 -- 172.21.15.67:0/1014916140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9560003530 con 0x7f95600051d0 2024-09-19T05:36:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.566+0000 7f957cfd0640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95600039c0 0x7f9560003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:18.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957d7d1640 1 -- 172.21.15.67:0/1014916140 reap_dead start 2024-09-19T05:36:18.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957d7d1640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95600051d0 0x7f956000b9d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9570001e40 tx=0x7f957001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8205bb1704672a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:18.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9570001a90 con 0x7f95600051d0 2024-09-19T05:36:18.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9570003b80 con 0x7f95600051d0 2024-09-19T05:36:18.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f95777fe640 1 -- 172.21.15.67:0/1014916140 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9570005020 con 0x7f95600051d0 2024-09-19T05:36:18.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957f234640 1 -- 172.21.15.67:0/1014916140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95600051d0 msgr2=0x7f956000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957f234640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95600051d0 0x7f956000b9d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9570001e40 tx=0x7f957001c760 comp rx=0 tx=0).stop 2024-09-19T05:36:18.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957f234640 1 -- 172.21.15.67:0/1014916140 shutdown_connections 2024-09-19T05:36:18.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957f234640 1 --2- 172.21.15.67:0/1014916140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95600051d0 0x7f956000b9d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957f234640 1 -- 172.21.15.67:0/1014916140 >> 172.21.15.67:0/1014916140 conn(0x7f95780d0080 msgr2=0x7f95780d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:18.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957f234640 1 -- 172.21.15.67:0/1014916140 shutdown_connections 2024-09-19T05:36:18.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957f234640 1 -- 172.21.15.67:0/1014916140 wait complete. 2024-09-19T05:36:18.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957f234640 1 Processor -- start 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.570+0000 7f957f234640 1 -- start start 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957f234640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95600051d0 0x7f95781f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957f234640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95781f49e0 0x7f95781503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957f234640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f957806e9b0 0x7f957806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957f234640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f957806e1d0 con 0x7f95781f49e0 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957f234640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f95780b3ef0 con 0x7f957806e9b0 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957f234640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f957815e710 con 0x7f95600051d0 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f9577fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95781f49e0 0x7f95781503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f9577fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95781f49e0 0x7f95781503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47326/0 (socket says 172.21.15.67:47326) 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f9577fff640 1 -- 172.21.15.67:0/3027063378 learned_addr learned my addr 172.21.15.67:0/3027063378 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957cfd0640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95600051d0 0x7f95781f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957d7d1640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f957806e9b0 0x7f957806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f9577fff640 1 -- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95600051d0 msgr2=0x7f95781f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f9577fff640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95600051d0 0x7f95781f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f9577fff640 1 -- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f957806e9b0 msgr2=0x7f957806ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f9577fff640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f957806e9b0 0x7f957806ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f9577fff640 1 -- 172.21.15.67:0/3027063378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95780cf5c0 con 0x7f95781f49e0 2024-09-19T05:36:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f9577fff640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95781f49e0 0x7f95781503e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f956c00e800 tx=0x7f956c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f95757fa640 1 -- 172.21.15.67:0/3027063378 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c00c6c0 con 0x7f95781f49e0 2024-09-19T05:36:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f95757fa640 1 -- 172.21.15.67:0/3027063378 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f956c018070 con 0x7f95781f49e0 2024-09-19T05:36:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f95757fa640 1 -- 172.21.15.67:0/3027063378 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c00caa0 con 0x7f95781f49e0 2024-09-19T05:36:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957f234640 1 -- 172.21.15.67:0/3027063378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95781f8f60 con 0x7f95781f49e0 2024-09-19T05:36:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957f234640 1 -- 172.21.15.67:0/3027063378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95781f5270 con 0x7f95781f49e0 2024-09-19T05:36:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f95757fa640 1 -- 172.21.15.67:0/3027063378 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f956c00cc40 con 0x7f95781f49e0 2024-09-19T05:36:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957f234640 1 -- 172.21.15.67:0/3027063378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95780cfcc0 con 0x7f95781f49e0 2024-09-19T05:36:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f95757fa640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95640678c0 0x7f9564069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f95757fa640 1 -- 172.21.15.67:0/3027063378 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f956c085c30 con 0x7f95781f49e0 2024-09-19T05:36:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.574+0000 7f957cfd0640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95640678c0 0x7f9564069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.578+0000 7f957cfd0640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95640678c0 0x7f9564069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f95781f7f70 tx=0x7f9568008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:18.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.582+0000 7f95757fa640 1 -- 172.21.15.67:0/3027063378 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f95781f8f60 con 0x7f95781f49e0 2024-09-19T05:36:18.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.750+0000 7f957f234640 1 -- 172.21.15.67:0/3027063378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9578161ce0 con 0x7f95781f49e0 2024-09-19T05:36:18.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.750+0000 7f95757fa640 1 -- 172.21.15.67:0/3027063378 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+17079 (secure 0 0 0) 0x7f956c0565a0 con 0x7f95781f49e0 2024-09-19T05:36:18.755 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:18.755 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":43,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:35:55.057380+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:34:04.937667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-19T05:34:06.182518+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.4","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:36:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 -- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95640678c0 msgr2=0x7f9564069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95640678c0 0x7f9564069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f95781f7f70 tx=0x7f9568008040 comp rx=0 tx=0).stop 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 -- 172.21.15.67:0/3027063378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95781f49e0 msgr2=0x7f95781503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95781f49e0 0x7f95781503e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f956c00e800 tx=0x7f956c00ecc0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 -- 172.21.15.67:0/3027063378 shutdown_connections 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f957806e9b0 0x7f957806ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95781f49e0 0x7f95781503e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95640678c0 0x7f9564069d80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 --2- 172.21.15.67:0/3027063378 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95600051d0 0x7f95781f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 -- 172.21.15.67:0/3027063378 >> 172.21.15.67:0/3027063378 conn(0x7f95780d0080 msgr2=0x7f95780ad260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 -- 172.21.15.67:0/3027063378 shutdown_connections 2024-09-19T05:36:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.754+0000 7f957f234640 1 -- 172.21.15.67:0/3027063378 wait complete. 2024-09-19T05:36:18.775 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:36:18.776 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:36:18.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4d6288640 1 Processor -- start 2024-09-19T05:36:18.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4d6288640 1 -- start start 2024-09-19T05:36:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4d6288640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb4d015c030 0x7fb4d006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4d6288640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d006e3c0 con 0x7fb4d006f460 2024-09-19T05:36:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4d6288640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d006e6a0 con 0x7fb4d015d1d0 2024-09-19T05:36:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4d6288640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb4d006e980 con 0x7fb4d015c030 2024-09-19T05:36:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4cffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb4d015c030 0x7fb4d006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4d4825640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb4d006f460 0x7fb4d00acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56826/0 (socket says 172.21.15.67:56826) 2024-09-19T05:36:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4d4825640 1 -- 172.21.15.67:0/2073631702 learned_addr learned my addr 172.21.15.67:0/2073631702 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4cffff640 1 -- 172.21.15.67:0/2073631702 >> v1:172.21.15.97:6789/0 conn(0x7fb4d015d1d0 legacy=0x7fb4d00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4cffff640 1 -- 172.21.15.67:0/2073631702 >> v1:172.21.15.67:6789/0 conn(0x7fb4d006f460 legacy=0x7fb4d00acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4ceffd640 1 -- 172.21.15.67:0/2073631702 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869075316 0 0) 0x7fb4d006e3c0 con 0x7fb4d006f460 2024-09-19T05:36:18.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.898+0000 7fb4cffff640 1 -- 172.21.15.67:0/2073631702 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d006ec60 con 0x7fb4d015c030 2024-09-19T05:36:18.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4cffff640 1 --2- 172.21.15.67:0/2073631702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015c030 0x7fb4d006dde0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00097c0 tx=0x7fb4c001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb1b5515b28d5cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:18.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4ceffd640 1 -- 172.21.15.67:0/2073631702 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c00b1070 con 0x7fb4d015c030 2024-09-19T05:36:18.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4ceffd640 1 -- 172.21.15.67:0/2073631702 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c00ac630 con 0x7fb4d015c030 2024-09-19T05:36:18.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4ceffd640 1 -- 172.21.15.67:0/2073631702 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c00a8050 con 0x7fb4d015c030 2024-09-19T05:36:18.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 -- 172.21.15.67:0/2073631702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015c030 msgr2=0x7fb4d006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 --2- 172.21.15.67:0/2073631702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015c030 0x7fb4d006dde0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00097c0 tx=0x7fb4c001c430 comp rx=0 tx=0).stop 2024-09-19T05:36:18.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 -- 172.21.15.67:0/2073631702 shutdown_connections 2024-09-19T05:36:18.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 --2- 172.21.15.67:0/2073631702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015c030 0x7fb4d006dde0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 -- 172.21.15.67:0/2073631702 >> 172.21.15.67:0/2073631702 conn(0x7fb4d00d0080 msgr2=0x7fb4d00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:18.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 -- 172.21.15.67:0/2073631702 shutdown_connections 2024-09-19T05:36:18.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 -- 172.21.15.67:0/2073631702 wait complete. 2024-09-19T05:36:18.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 Processor -- start 2024-09-19T05:36:18.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 -- start start 2024-09-19T05:36:18.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d006f460 0x7fb4d01487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4d015c030 0x7fb4d015b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015d1d0 0x7fb4d014b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d015c590 con 0x7fb4d015d1d0 2024-09-19T05:36:18.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d015c410 con 0x7fb4d006f460 2024-09-19T05:36:18.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d6288640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d00ad6c0 con 0x7fb4d015c030 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d4825640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015d1d0 0x7fb4d014b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d4825640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015d1d0 0x7fb4d014b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47352/0 (socket says 172.21.15.67:47352) 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d4825640 1 -- 172.21.15.67:0/78875284 learned_addr learned my addr 172.21.15.67:0/78875284 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4cffff640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d006f460 0x7fb4d01487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4cf7fe640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4d015c030 0x7fb4d015b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d4825640 1 -- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4d015c030 msgr2=0x7fb4d015b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d4825640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4d015c030 0x7fb4d015b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d4825640 1 -- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d006f460 msgr2=0x7fb4d01487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d4825640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d006f460 0x7fb4d01487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d4825640 1 -- 172.21.15.67:0/78875284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d0147720 con 0x7fb4d015d1d0 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4d4825640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015d1d0 0x7fb4d014b1f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8001570 tx=0x7fb4c800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.902+0000 7fb4ccff9640 1 -- 172.21.15.67:0/78875284 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8018070 con 0x7fb4d015d1d0 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.906+0000 7fb4ccff9640 1 -- 172.21.15.67:0/78875284 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c800a640 con 0x7fb4d015d1d0 2024-09-19T05:36:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.906+0000 7fb4d6288640 1 -- 172.21.15.67:0/78875284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d0147a00 con 0x7fb4d015d1d0 2024-09-19T05:36:18.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.906+0000 7fb4ccff9640 1 -- 172.21.15.67:0/78875284 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800aa30 con 0x7fb4d015d1d0 2024-09-19T05:36:18.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.906+0000 7fb4d6288640 1 -- 172.21.15.67:0/78875284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d0147fc0 con 0x7fb4d015d1d0 2024-09-19T05:36:18.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.906+0000 7fb4d6288640 1 -- 172.21.15.67:0/78875284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d006dde0 con 0x7fb4d015d1d0 2024-09-19T05:36:18.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.906+0000 7fb4ccff9640 1 -- 172.21.15.67:0/78875284 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb4c801b070 con 0x7fb4d015d1d0 2024-09-19T05:36:18.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.906+0000 7fb4ccff9640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4bc0678c0 0x7fb4bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:18.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.906+0000 7fb4ccff9640 1 -- 172.21.15.67:0/78875284 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7fb4c8085500 con 0x7fb4d015d1d0 2024-09-19T05:36:18.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.906+0000 7fb4cffff640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4bc0678c0 0x7fb4bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:18.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.906+0000 7fb4cffff640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4bc0678c0 0x7fb4bc069d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00ae000 tx=0x7fb4c00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:18.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:18.910+0000 7fb4ccff9640 1 -- 172.21.15.67:0/78875284 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb4c8055e70 con 0x7fb4d015d1d0 2024-09-19T05:36:19.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.110+0000 7fb4d6288640 1 -- 172.21.15.67:0/78875284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4d015e710 con 0x7fb4d015d1d0 2024-09-19T05:36:19.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.110+0000 7fb4ccff9640 1 -- 172.21.15.67:0/78875284 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5220 (secure 0 0 0) 0x7fb4c8055770 con 0x7fb4d015d1d0 2024-09-19T05:36:19.114 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:19.114 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"btime":"2024-09-19T05:34:20:197437+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2848495891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2848495891},{"type":"v1","addr":"172.21.15.97:6835","nonce":2848495891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4741,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2818377677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2818377677},{"type":"v1","addr":"172.21.15.97:6837","nonce":2818377677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4887,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/244834094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":244834094},{"type":"v1","addr":"172.21.15.67:6834","nonce":244834094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-19T05:34:07.193697+0000","modified":"2024-09-19T05:34:20.150102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3857596366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3857596366},{"type":"v1","addr":"172.21.15.67:6835","nonce":3857596366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-19T05:36:19.114 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 16 2024-09-19T05:36:19.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 -- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4bc0678c0 msgr2=0x7fb4bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4bc0678c0 0x7fb4bc069d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00ae000 tx=0x7fb4c00a7000 comp rx=0 tx=0).stop 2024-09-19T05:36:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 -- 172.21.15.67:0/78875284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015d1d0 msgr2=0x7fb4d014b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015d1d0 0x7fb4d014b1f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8001570 tx=0x7fb4c800cca0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 -- 172.21.15.67:0/78875284 shutdown_connections 2024-09-19T05:36:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4d015d1d0 0x7fb4d014b1f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4bc0678c0 0x7fb4bc069d80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4d015c030 0x7fb4d015b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 --2- 172.21.15.67:0/78875284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d006f460 0x7fb4d01487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 -- 172.21.15.67:0/78875284 >> 172.21.15.67:0/78875284 conn(0x7fb4d00d0080 msgr2=0x7fb4d00b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 -- 172.21.15.67:0/78875284 shutdown_connections 2024-09-19T05:36:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.114+0000 7fb4d6288640 1 -- 172.21.15.67:0/78875284 wait complete. 2024-09-19T05:36:19.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:36:19.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.254+0000 7f1ff7974640 1 Processor -- start 2024-09-19T05:36:19.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.254+0000 7f1ff7974640 1 -- start start 2024-09-19T05:36:19.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff7974640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ff00726e0 0x7f1ff00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff7974640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1ff0162a10 0x7f1ff00b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff7974640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff006ecc0 con 0x7f1ff0162630 2024-09-19T05:36:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff7974640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff00cfe80 con 0x7f1ff00726e0 2024-09-19T05:36:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff7974640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff006ef50 con 0x7f1ff0162a10 2024-09-19T05:36:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff4f0f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ff00726e0 0x7f1ff00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff4f0f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ff00726e0 0x7f1ff00b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47368/0 (socket says 172.21.15.67:47368) 2024-09-19T05:36:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff4f0f640 1 -- 172.21.15.67:0/313716329 learned_addr learned my addr 172.21.15.67:0/313716329 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff5f11640 1 --2- 172.21.15.67:0/313716329 >> v2:172.21.15.97:3300/0 conn(0x7f1ff0162a10 0x7f1ff00b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff4f0f640 1 -- 172.21.15.67:0/313716329 >> v2:172.21.15.97:3300/0 conn(0x7f1ff0162a10 msgr2=0x7f1ff00b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff4f0f640 1 --2- 172.21.15.67:0/313716329 >> v2:172.21.15.97:3300/0 conn(0x7f1ff0162a10 0x7f1ff00b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff4f0f640 1 -- 172.21.15.67:0/313716329 >> v1:172.21.15.97:6789/0 conn(0x7f1ff0162630 legacy=0x7f1ff0071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff4f0f640 1 -- 172.21.15.67:0/313716329 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff006f230 con 0x7f1ff00726e0 2024-09-19T05:36:19.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.258+0000 7f1ff4f0f640 1 --2- 172.21.15.67:0/313716329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 0x7f1ff00b3590 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0072dd0 tx=0x7f1fe401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baa7a48dbdc6ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:19.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1fe3fff640 1 -- 172.21.15.67:0/313716329 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40ab620 con 0x7f1ff00726e0 2024-09-19T05:36:19.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1fe3fff640 1 -- 172.21.15.67:0/313716329 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe40b0070 con 0x7f1ff00726e0 2024-09-19T05:36:19.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1fe3fff640 1 -- 172.21.15.67:0/313716329 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40ab9e0 con 0x7f1ff00726e0 2024-09-19T05:36:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 -- 172.21.15.67:0/313716329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 msgr2=0x7f1ff00b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 --2- 172.21.15.67:0/313716329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 0x7f1ff00b3590 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0072dd0 tx=0x7f1fe401c420 comp rx=0 tx=0).stop 2024-09-19T05:36:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 -- 172.21.15.67:0/313716329 shutdown_connections 2024-09-19T05:36:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 --2- 172.21.15.67:0/313716329 >> v2:172.21.15.97:3300/0 conn(0x7f1ff0162a10 0x7f1ff00b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 --2- 172.21.15.67:0/313716329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 0x7f1ff00b3590 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 -- 172.21.15.67:0/313716329 >> 172.21.15.67:0/313716329 conn(0x7f1ff00d0080 msgr2=0x7f1ff00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 -- 172.21.15.67:0/313716329 shutdown_connections 2024-09-19T05:36:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 -- 172.21.15.67:0/313716329 wait complete. 2024-09-19T05:36:19.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 Processor -- start 2024-09-19T05:36:19.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 -- start start 2024-09-19T05:36:19.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 0x7f1ff01526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ff0162630 0x7f1ff0159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ff0162a10 0x7f1ff015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff016f700 con 0x7f1ff00726e0 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff00b4820 con 0x7f1ff0162630 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff7974640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff016f880 con 0x7f1ff0162a10 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.262+0000 7f1ff5710640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 0x7f1ff01526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.266+0000 7f1ff5710640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 0x7f1ff01526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47376/0 (socket says 172.21.15.67:47376) 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.266+0000 7f1ff5710640 1 -- 172.21.15.67:0/1111984679 learned_addr learned my addr 172.21.15.67:0/1111984679 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.266+0000 7f1ff4f0f640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ff0162630 0x7f1ff0159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.266+0000 7f1ff5f11640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ff0162a10 0x7f1ff015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.266+0000 7f1ff5710640 1 -- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ff0162a10 msgr2=0x7f1ff015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.266+0000 7f1ff5710640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ff0162a10 0x7f1ff015a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.266+0000 7f1ff5710640 1 -- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ff0162630 msgr2=0x7f1ff0159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.266+0000 7f1ff5710640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ff0162630 0x7f1ff0159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.266+0000 7f1ff5710640 1 -- 172.21.15.67:0/1111984679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff0157510 con 0x7f1ff00726e0 2024-09-19T05:36:19.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.266+0000 7f1ff5710640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 0x7f1ff01526c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00c490 tx=0x7f1fec001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:19.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1fe1ffb640 1 -- 172.21.15.67:0/1111984679 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec017070 con 0x7f1ff00726e0 2024-09-19T05:36:19.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1fe1ffb640 1 -- 172.21.15.67:0/1111984679 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fec003600 con 0x7f1ff00726e0 2024-09-19T05:36:19.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1ff7974640 1 -- 172.21.15.67:0/1111984679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff01577f0 con 0x7f1ff00726e0 2024-09-19T05:36:19.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1fe1ffb640 1 -- 172.21.15.67:0/1111984679 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0039f0 con 0x7f1ff00726e0 2024-09-19T05:36:19.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1ff7974640 1 -- 172.21.15.67:0/1111984679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff0156930 con 0x7f1ff00726e0 2024-09-19T05:36:19.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1ff7974640 1 -- 172.21.15.67:0/1111984679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff00701a0 con 0x7f1ff00726e0 2024-09-19T05:36:19.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1fe1ffb640 1 -- 172.21.15.67:0/1111984679 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1fec01a070 con 0x7f1ff00726e0 2024-09-19T05:36:19.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1fe1ffb640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1fd40678c0 0x7f1fd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1fe1ffb640 1 -- 172.21.15.67:0/1111984679 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f1fec085260 con 0x7f1ff00726e0 2024-09-19T05:36:19.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1ff4f0f640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1fd40678c0 0x7f1fd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.270+0000 7f1ff4f0f640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1fd40678c0 0x7f1fd4069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40af000 tx=0x7f1fe40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:19.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.274+0000 7f1fe1ffb640 1 -- 172.21.15.67:0/1111984679 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1fec055bd0 con 0x7f1ff00726e0 2024-09-19T05:36:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.474+0000 7f1ff7974640 1 -- 172.21.15.67:0/1111984679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ff0165d30 con 0x7f1ff00726e0 2024-09-19T05:36:19.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.474+0000 7f1fe1ffb640 1 -- 172.21.15.67:0/1111984679 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5220 (secure 0 0 0) 0x7f1fec0554d0 con 0x7f1ff00726e0 2024-09-19T05:36:19.480 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:19.480 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"btime":"2024-09-19T05:34:20:197437+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2848495891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2848495891},{"type":"v1","addr":"172.21.15.97:6835","nonce":2848495891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4741,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2818377677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2818377677},{"type":"v1","addr":"172.21.15.97:6837","nonce":2818377677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4887,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/244834094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":244834094},{"type":"v1","addr":"172.21.15.67:6834","nonce":244834094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-19T05:34:07.193697+0000","modified":"2024-09-19T05:34:20.150102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3857596366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3857596366},{"type":"v1","addr":"172.21.15.67:6835","nonce":3857596366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-19T05:36:19.481 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 16 2024-09-19T05:36:19.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 -- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1fd40678c0 msgr2=0x7f1fd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1fd40678c0 0x7f1fd4069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40af000 tx=0x7f1fe40a7000 comp rx=0 tx=0).stop 2024-09-19T05:36:19.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 -- 172.21.15.67:0/1111984679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 msgr2=0x7f1ff01526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 0x7f1ff01526c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00c490 tx=0x7f1fec001e80 comp rx=0 tx=0).stop 2024-09-19T05:36:19.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 -- 172.21.15.67:0/1111984679 shutdown_connections 2024-09-19T05:36:19.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1fd40678c0 0x7f1fd4069d80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ff0162a10 0x7f1ff015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ff0162630 0x7f1ff0159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 --2- 172.21.15.67:0/1111984679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ff00726e0 0x7f1ff01526c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 -- 172.21.15.67:0/1111984679 >> 172.21.15.67:0/1111984679 conn(0x7f1ff00d0080 msgr2=0x7f1ff00d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:19.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 -- 172.21.15.67:0/1111984679 shutdown_connections 2024-09-19T05:36:19.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.478+0000 7f1ff7974640 1 -- 172.21.15.67:0/1111984679 wait complete. 2024-09-19T05:36:19.500 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:36:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a3e53b640 1 Processor -- start 2024-09-19T05:36:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a3e53b640 1 -- start start 2024-09-19T05:36:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a3e53b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a380d1590 0x7f6a380d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a3e53b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a380d4d40 con 0x7f6a380b51d0 2024-09-19T05:36:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a3e53b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a380d5020 con 0x7f6a38161da0 2024-09-19T05:36:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a3e53b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6a380d0840 con 0x7f6a380d1590 2024-09-19T05:36:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a3cad8640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6a380b51d0 0x7f6a380cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56842/0 (socket says 172.21.15.67:56842) 2024-09-19T05:36:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a3cad8640 1 -- 172.21.15.67:0/893752827 learned_addr learned my addr 172.21.15.67:0/893752827 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a377fe640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a380d1590 0x7f6a380d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219196800 0 0) 0x7f6a380d4d40 con 0x7f6a380b51d0 2024-09-19T05:36:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a20003530 con 0x7f6a380b51d0 2024-09-19T05:36:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2171141088 0 0) 0x7f6a20003530 con 0x7f6a380b51d0 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a380d1590 msgr2=0x7f6a380d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a380d1590 0x7f6a380d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 >> v1:172.21.15.97:6789/0 conn(0x7f6a38161da0 legacy=0x7f6a380d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a380d5300 con 0x7f6a380b51d0 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6a30001a00 con 0x7f6a380b51d0 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 >> v1:172.21.15.67:6789/0 conn(0x7f6a380b51d0 legacy=0x7f6a380cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a200039f0 0x7f6a20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a200043a0 0x7f6a20004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a380d1590 0x7f6a200050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a380d0840 con 0x7f6a200043a0 2024-09-19T05:36:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2000ba00 con 0x7f6a200039f0 2024-09-19T05:36:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2000bc00 con 0x7f6a380d1590 2024-09-19T05:36:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a377fe640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a200043a0 0x7f6a20004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a37fff640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a200039f0 0x7f6a20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a3cad8640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a380d1590 0x7f6a200050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a377fe640 1 -- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a380d1590 msgr2=0x7f6a200050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a377fe640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a380d1590 0x7f6a200050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a377fe640 1 -- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a200039f0 msgr2=0x7f6a20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a377fe640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a200039f0 0x7f6a20003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a377fe640 1 -- 172.21.15.67:0/893752827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a20003530 con 0x7f6a200043a0 2024-09-19T05:36:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.618+0000 7f6a3cad8640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a380d1590 0x7f6a200050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a377fe640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a200043a0 0x7f6a20004870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009ae0 tx=0x7f6a2c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531f667e18877648 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0b2070 con 0x7f6a200043a0 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0a5660 con 0x7f6a200043a0 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a36ffd640 1 -- 172.21.15.67:0/893752827 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0096b0 con 0x7f6a200043a0 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a3e53b640 1 -- 172.21.15.67:0/893752827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a200043a0 msgr2=0x7f6a20004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a3e53b640 1 --2- 172.21.15.67:0/893752827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a200043a0 0x7f6a20004870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009ae0 tx=0x7f6a2c01ca70 comp rx=0 tx=0).stop 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a3cad8640 1 -- 172.21.15.67:0/893752827 reap_dead start 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a3e53b640 1 -- 172.21.15.67:0/893752827 shutdown_connections 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a3e53b640 1 -- 172.21.15.67:0/893752827 >> 172.21.15.67:0/893752827 conn(0x7f6a3808bfc0 msgr2=0x7f6a380d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a3e53b640 1 -- 172.21.15.67:0/893752827 shutdown_connections 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a3e53b640 1 -- 172.21.15.67:0/893752827 wait complete. 2024-09-19T05:36:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a3e53b640 1 Processor -- start 2024-09-19T05:36:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.622+0000 7f6a3e53b640 1 -- start start 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3e53b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a200043a0 0x7f6a3815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3e53b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a380b7c40 0x7f6a380b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3e53b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a380cd250 0x7f6a380cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3e53b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a38162180 con 0x7f6a380b7c40 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3e53b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6a380b5d00 con 0x7f6a380cd250 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3e53b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6a380d1af0 con 0x7f6a200043a0 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a377fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a380b7c40 0x7f6a380b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a377fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a380b7c40 0x7f6a380b80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47382/0 (socket says 172.21.15.67:47382) 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a377fe640 1 -- 172.21.15.67:0/2784955902 learned_addr learned my addr 172.21.15.67:0/2784955902 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3cad8640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a380cd250 0x7f6a380cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a37fff640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a200043a0 0x7f6a3815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a377fe640 1 -- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a200043a0 msgr2=0x7f6a3815e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a377fe640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a200043a0 0x7f6a3815e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a377fe640 1 -- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a380cd250 msgr2=0x7f6a380cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a377fe640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a380cd250 0x7f6a380cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a377fe640 1 -- 172.21.15.67:0/2784955902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a380cdf40 con 0x7f6a380b7c40 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3cad8640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a380cd250 0x7f6a380cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a377fe640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a380b7c40 0x7f6a380b80c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c01c8a0 tx=0x7f6a20005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a34ff9640 1 -- 172.21.15.67:0/2784955902 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0bc020 con 0x7f6a380b7c40 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a34ff9640 1 -- 172.21.15.67:0/2784955902 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0a5e10 con 0x7f6a380b7c40 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3e53b640 1 -- 172.21.15.67:0/2784955902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a380c9170 con 0x7f6a380b7c40 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a34ff9640 1 -- 172.21.15.67:0/2784955902 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0b2040 con 0x7f6a380b7c40 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3e53b640 1 -- 172.21.15.67:0/2784955902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a380c9730 con 0x7f6a380b7c40 2024-09-19T05:36:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a3e53b640 1 -- 172.21.15.67:0/2784955902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a380d0e80 con 0x7f6a380b7c40 2024-09-19T05:36:19.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a34ff9640 1 -- 172.21.15.67:0/2784955902 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a2c004220 con 0x7f6a380b7c40 2024-09-19T05:36:19.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a34ff9640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6a240678c0 0x7f6a24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a34ff9640 1 -- 172.21.15.67:0/2784955902 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f6a2c1201e0 con 0x7f6a380b7c40 2024-09-19T05:36:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.626+0000 7f6a37fff640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6a240678c0 0x7f6a24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.630+0000 7f6a37fff640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6a240678c0 0x7f6a24069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a28007ad0 tx=0x7f6a2800a8a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:19.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.634+0000 7f6a34ff9640 1 -- 172.21.15.67:0/2784955902 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6a2c0c6020 con 0x7f6a380b7c40 2024-09-19T05:36:19.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.794+0000 7f6a3e53b640 1 -- 172.21.15.67:0/2784955902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a380d09c0 con 0x7f6a380b7c40 2024-09-19T05:36:19.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.798+0000 7f6a34ff9640 1 -- 172.21.15.67:0/2784955902 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+17079 (secure 0 0 0) 0x7f6a2c016780 con 0x7f6a380b7c40 2024-09-19T05:36:19.802 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:19.802 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":43,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:35:55.057380+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:34:04.937667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-19T05:34:06.182518+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.4","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:36:19.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 -- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6a240678c0 msgr2=0x7f6a24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6a240678c0 0x7f6a24069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a28007ad0 tx=0x7f6a2800a8a0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 -- 172.21.15.67:0/2784955902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a380b7c40 msgr2=0x7f6a380b80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a380b7c40 0x7f6a380b80c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c01c8a0 tx=0x7f6a20005840 comp rx=0 tx=0).stop 2024-09-19T05:36:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 -- 172.21.15.67:0/2784955902 shutdown_connections 2024-09-19T05:36:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a380cd250 0x7f6a380cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a380b7c40 0x7f6a380b80c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6a240678c0 0x7f6a24069d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 --2- 172.21.15.67:0/2784955902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a200043a0 0x7f6a3815e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 -- 172.21.15.67:0/2784955902 >> 172.21.15.67:0/2784955902 conn(0x7f6a3808bfc0 msgr2=0x7f6a3815f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 -- 172.21.15.67:0/2784955902 shutdown_connections 2024-09-19T05:36:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.802+0000 7f6a3e53b640 1 -- 172.21.15.67:0/2784955902 wait complete. 2024-09-19T05:36:19.820 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:36:19.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.930+0000 7f3553453640 1 Processor -- start 2024-09-19T05:36:19.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.930+0000 7f3553453640 1 -- start start 2024-09-19T05:36:19.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f3553453640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354c15b1e0 0x7f354c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f3553453640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f354c072590 0x7f354c0ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f3553453640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f354c0b3860 con 0x7f354c0b4900 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f3553453640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f354c15b5c0 con 0x7f354c072590 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f3553453640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f354c0b3b40 con 0x7f354c15b1e0 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f35519f0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f354c072590 0x7f354c0ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f35519f0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f354c072590 0x7f354c0ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47394/0 (socket says 172.21.15.67:47394) 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f35519f0640 1 -- 172.21.15.67:0/1766759974 learned_addr learned my addr 172.21.15.67:0/1766759974 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f35511ef640 1 --2- 172.21.15.67:0/1766759974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354c15b1e0 0x7f354c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f35519f0640 1 -- 172.21.15.67:0/1766759974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354c15b1e0 msgr2=0x7f354c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f35519f0640 1 --2- 172.21.15.67:0/1766759974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354c15b1e0 0x7f354c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f35519f0640 1 -- 172.21.15.67:0/1766759974 >> v1:172.21.15.97:6789/0 conn(0x7f354c0b4900 legacy=0x7f354c071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:19.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f35519f0640 1 -- 172.21.15.67:0/1766759974 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354c0b3e20 con 0x7f354c072590 2024-09-19T05:36:19.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f35519f0640 1 --2- 172.21.15.67:0/1766759974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c072590 0x7f354c0ade10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3544009e80 tx=0x7f354401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372f15620b8e103b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:19.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f3543fff640 1 -- 172.21.15.67:0/1766759974 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440a58d0 con 0x7f354c072590 2024-09-19T05:36:19.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f3543fff640 1 -- 172.21.15.67:0/1766759974 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35440a5a70 con 0x7f354c072590 2024-09-19T05:36:19.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.934+0000 7f3543fff640 1 -- 172.21.15.67:0/1766759974 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440a5e40 con 0x7f354c072590 2024-09-19T05:36:19.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- 172.21.15.67:0/1766759974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c072590 msgr2=0x7f354c0ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 --2- 172.21.15.67:0/1766759974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c072590 0x7f354c0ade10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3544009e80 tx=0x7f354401c9e0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- 172.21.15.67:0/1766759974 shutdown_connections 2024-09-19T05:36:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 --2- 172.21.15.67:0/1766759974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c072590 0x7f354c0ade10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 --2- 172.21.15.67:0/1766759974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354c15b1e0 0x7f354c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- 172.21.15.67:0/1766759974 >> 172.21.15.67:0/1766759974 conn(0x7f354c0d0080 msgr2=0x7f354c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- 172.21.15.67:0/1766759974 shutdown_connections 2024-09-19T05:36:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- 172.21.15.67:0/1766759974 wait complete. 2024-09-19T05:36:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 Processor -- start 2024-09-19T05:36:19.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- start start 2024-09-19T05:36:19.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f354c072590 0x7f354c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c0b4900 0x7f354c15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354c15b1e0 0x7f354c147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f354c1681e0 con 0x7f354c0b4900 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f354c168060 con 0x7f354c072590 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f354c168360 con 0x7f354c15b1e0 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35509ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c0b4900 0x7f354c15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35509ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c0b4900 0x7f354c15ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47410/0 (socket says 172.21.15.67:47410) 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35509ee640 1 -- 172.21.15.67:0/180173844 learned_addr learned my addr 172.21.15.67:0/180173844 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35511ef640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f354c072590 0x7f354c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35519f0640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354c15b1e0 0x7f354c147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35509ee640 1 -- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354c15b1e0 msgr2=0x7f354c147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35509ee640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354c15b1e0 0x7f354c147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35509ee640 1 -- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f354c072590 msgr2=0x7f354c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:19.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35509ee640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f354c072590 0x7f354c15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:19.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35509ee640 1 -- 172.21.15.67:0/180173844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354c099ca0 con 0x7f354c0b4900 2024-09-19T05:36:19.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f35509ee640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c0b4900 0x7f354c15ddb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f353c00c4d0 tx=0x7f353c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:19.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3541ffb640 1 -- 172.21.15.67:0/180173844 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c0052d0 con 0x7f354c0b4900 2024-09-19T05:36:19.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3541ffb640 1 -- 172.21.15.67:0/180173844 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353c005470 con 0x7f354c0b4900 2024-09-19T05:36:19.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3541ffb640 1 -- 172.21.15.67:0/180173844 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c012830 con 0x7f354c0b4900 2024-09-19T05:36:19.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- 172.21.15.67:0/180173844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f354c145c20 con 0x7f354c0b4900 2024-09-19T05:36:19.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.938+0000 7f3553453640 1 -- 172.21.15.67:0/180173844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f354c15cd90 con 0x7f354c0b4900 2024-09-19T05:36:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.942+0000 7f3553453640 1 -- 172.21.15.67:0/180173844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f354c0ade10 con 0x7f354c0b4900 2024-09-19T05:36:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.942+0000 7f3541ffb640 1 -- 172.21.15.67:0/180173844 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f353c0129d0 con 0x7f354c0b4900 2024-09-19T05:36:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.942+0000 7f3541ffb640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35300678f0 0x7f3530069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.942+0000 7f3541ffb640 1 -- 172.21.15.67:0/180173844 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f353c085960 con 0x7f354c0b4900 2024-09-19T05:36:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.942+0000 7f35511ef640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35300678f0 0x7f3530069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.942+0000 7f35511ef640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35300678f0 0x7f3530069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f354c1586e0 tx=0x7f3548008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:19.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:19.946+0000 7f3541ffb640 1 -- 172.21.15.67:0/180173844 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f354c099ca0 con 0x7f354c0b4900 2024-09-19T05:36:20.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.138+0000 7f3553453640 1 -- 172.21.15.67:0/180173844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f354c099e80 con 0x7f354c0b4900 2024-09-19T05:36:20.143 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:36:20.138+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:36:20.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.142+0000 7f3541ffb640 1 -- 172.21.15.67:0/180173844 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f353c0562e0 con 0x7f354c0b4900 2024-09-19T05:36:20.146 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:36:20.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 -- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35300678f0 msgr2=0x7f3530069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:20.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35300678f0 0x7f3530069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f354c1586e0 tx=0x7f3548008040 comp rx=0 tx=0).stop 2024-09-19T05:36:20.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 -- 172.21.15.67:0/180173844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c0b4900 msgr2=0x7f354c15ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:20.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c0b4900 0x7f354c15ddb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f353c00c4d0 tx=0x7f353c00c990 comp rx=0 tx=0).stop 2024-09-19T05:36:20.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 -- 172.21.15.67:0/180173844 shutdown_connections 2024-09-19T05:36:20.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35300678f0 0x7f3530069db0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:20.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354c15b1e0 0x7f354c147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:20.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f354c0b4900 0x7f354c15ddb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:20.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 --2- 172.21.15.67:0/180173844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f354c072590 0x7f354c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:20.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 -- 172.21.15.67:0/180173844 >> 172.21.15.67:0/180173844 conn(0x7f354c0d0080 msgr2=0x7f354c14a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:20.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 -- 172.21.15.67:0/180173844 shutdown_connections 2024-09-19T05:36:20.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.146+0000 7f3553453640 1 -- 172.21.15.67:0/180173844 wait complete. 2024-09-19T05:36:20.167 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:36:20.205 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:36:20.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f40a308f640 1 Processor -- start 2024-09-19T05:36:20.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f40a308f640 1 -- start start 2024-09-19T05:36:20.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f40a308f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f409c06ffd0 0x7f409c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:20.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f40a308f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f409c0ad840 con 0x7f409c159c60 2024-09-19T05:36:20.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f40a308f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f409c15a040 con 0x7f409c0b3150 2024-09-19T05:36:20.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f40a308f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f409c15d460 con 0x7f409c06ffd0 2024-09-19T05:36:20.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f409bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f409c06ffd0 0x7f409c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:20.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f40a0e2b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f409c159c60 0x7f409c0ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56868/0 (socket says 172.21.15.67:56868) 2024-09-19T05:36:20.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f40a0e2b640 1 -- 172.21.15.67:0/3737710124 learned_addr learned my addr 172.21.15.67:0/3737710124 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:20.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f409bfff640 1 -- 172.21.15.67:0/3737710124 >> v1:172.21.15.97:6789/0 conn(0x7f409c0b3150 legacy=0x7f409c15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:20.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f409bfff640 1 -- 172.21.15.67:0/3737710124 >> v1:172.21.15.67:6789/0 conn(0x7f409c159c60 legacy=0x7f409c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:20.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f409b7fe640 1 -- 172.21.15.67:0/3737710124 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631387140 0 0) 0x7f409c0ad840 con 0x7f409c159c60 2024-09-19T05:36:20.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.286+0000 7f409bfff640 1 -- 172.21.15.67:0/3737710124 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c15c850 con 0x7f409c06ffd0 2024-09-19T05:36:20.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409bfff640 1 --2- 172.21.15.67:0/3737710124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c06ffd0 0x7f409c0aec90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f40900097c0 tx=0x7f409001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17c238db416623c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:20.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409b7fe640 1 -- 172.21.15.67:0/3737710124 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40900ab430 con 0x7f409c06ffd0 2024-09-19T05:36:20.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409b7fe640 1 -- 172.21.15.67:0/3737710124 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40900b0070 con 0x7f409c06ffd0 2024-09-19T05:36:20.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409b7fe640 1 -- 172.21.15.67:0/3737710124 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40900ab7f0 con 0x7f409c06ffd0 2024-09-19T05:36:20.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 -- 172.21.15.67:0/3737710124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c06ffd0 msgr2=0x7f409c0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:20.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 --2- 172.21.15.67:0/3737710124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c06ffd0 0x7f409c0aec90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f40900097c0 tx=0x7f409001c430 comp rx=0 tx=0).stop 2024-09-19T05:36:20.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 -- 172.21.15.67:0/3737710124 shutdown_connections 2024-09-19T05:36:20.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 --2- 172.21.15.67:0/3737710124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c06ffd0 0x7f409c0aec90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:20.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 -- 172.21.15.67:0/3737710124 >> 172.21.15.67:0/3737710124 conn(0x7f409c0b1e50 msgr2=0x7f409c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:20.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 -- 172.21.15.67:0/3737710124 shutdown_connections 2024-09-19T05:36:20.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 -- 172.21.15.67:0/3737710124 wait complete. 2024-09-19T05:36:20.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 Processor -- start 2024-09-19T05:36:20.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 -- start start 2024-09-19T05:36:20.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f409c06ffd0 0x7f409c14dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c0b3150 0x7f409c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f409c159c60 0x7f409c1501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f409c169e40 con 0x7f409c0b3150 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f409c0af5e0 con 0x7f409c06ffd0 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a308f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f409c169fc0 con 0x7f409c159c60 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c0b3150 0x7f409c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c0b3150 0x7f409c158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47458/0 (socket says 172.21.15.67:47458) 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409bfff640 1 -- 172.21.15.67:0/3112549343 learned_addr learned my addr 172.21.15.67:0/3112549343 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f40a0e2b640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f409c06ffd0 0x7f409c14dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409bfff640 1 -- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f409c159c60 msgr2=0x7f409c1501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409bfff640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f409c159c60 0x7f409c1501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409bfff640 1 -- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f409c06ffd0 msgr2=0x7f409c14dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:20.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409bfff640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f409c06ffd0 0x7f409c14dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:20.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.290+0000 7f409bfff640 1 -- 172.21.15.67:0/3112549343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c151240 con 0x7f409c0b3150 2024-09-19T05:36:20.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f409bfff640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c0b3150 0x7f409c158fd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f40900097c0 tx=0x7f409001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:20.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40997fa640 1 -- 172.21.15.67:0/3112549343 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40900bf610 con 0x7f409c0b3150 2024-09-19T05:36:20.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40997fa640 1 -- 172.21.15.67:0/3112549343 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40900bf7d0 con 0x7f409c0b3150 2024-09-19T05:36:20.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40997fa640 1 -- 172.21.15.67:0/3112549343 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40900bfbc0 con 0x7f409c0b3150 2024-09-19T05:36:20.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40a308f640 1 -- 172.21.15.67:0/3112549343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409c151520 con 0x7f409c0b3150 2024-09-19T05:36:20.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40a308f640 1 -- 172.21.15.67:0/3112549343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f409c14f9f0 con 0x7f409c0b3150 2024-09-19T05:36:20.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40a308f640 1 -- 172.21.15.67:0/3112549343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409c0aec90 con 0x7f409c0b3150 2024-09-19T05:36:20.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40997fa640 1 -- 172.21.15.67:0/3112549343 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40900bd020 con 0x7f409c0b3150 2024-09-19T05:36:20.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40997fa640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40880678f0 0x7f4088069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:20.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40997fa640 1 -- 172.21.15.67:0/3112549343 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f40900a8030 con 0x7f409c0b3150 2024-09-19T05:36:20.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40a0e2b640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40880678f0 0x7f4088069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:20.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.294+0000 7f40a0e2b640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40880678f0 0x7f4088069db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f408c000f70 tx=0x7f408c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:20.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.298+0000 7f40997fa640 1 -- 172.21.15.67:0/3112549343 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f40900c7060 con 0x7f409c0b3150 2024-09-19T05:36:20.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:20.502+0000 7f40a308f640 1 -- 172.21.15.67:0/3112549343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f409c0b38f0 con 0x7f409c0b3150 2024-09-19T05:36:21.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40997fa640 1 -- 172.21.15.67:0/3112549343 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7f4090016050 con 0x7f409c0b3150 2024-09-19T05:36:21.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40a308f640 1 -- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40880678f0 msgr2=0x7f4088069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:21.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40a308f640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40880678f0 0x7f4088069db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f408c000f70 tx=0x7f408c009040 comp rx=0 tx=0).stop 2024-09-19T05:36:21.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40a308f640 1 -- 172.21.15.67:0/3112549343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c0b3150 msgr2=0x7f409c158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:21.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40a308f640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c0b3150 0x7f409c158fd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f40900097c0 tx=0x7f409001ac70 comp rx=0 tx=0).stop 2024-09-19T05:36:21.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40a308f640 1 -- 172.21.15.67:0/3112549343 shutdown_connections 2024-09-19T05:36:21.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40a308f640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40880678f0 0x7f4088069db0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:21.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40a308f640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f409c159c60 0x7f409c1501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:21.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40a308f640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f409c0b3150 0x7f409c158fd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:21.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40a308f640 1 --2- 172.21.15.67:0/3112549343 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f409c06ffd0 0x7f409c14dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:21.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.146+0000 7f40a308f640 1 -- 172.21.15.67:0/3112549343 >> 172.21.15.67:0/3112549343 conn(0x7f409c0b1e50 msgr2=0x7f409c06e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:21.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.150+0000 7f40a308f640 1 -- 172.21.15.67:0/3112549343 shutdown_connections 2024-09-19T05:36:21.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.150+0000 7f40a308f640 1 -- 172.21.15.67:0/3112549343 wait complete. 2024-09-19T05:36:21.178 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:36:21.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f791a288640 1 Processor -- start 2024-09-19T05:36:21.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f791a288640 1 -- start start 2024-09-19T05:36:21.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f791a288640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f79140d0520 0x7f79140d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f791a288640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79140addf0 0x7f79140ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f791a288640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79140b4e00 con 0x7f79140738b0 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f791a288640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f79140d0ed0 con 0x7f79140addf0 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f791a288640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f79140b3500 con 0x7f79140d0520 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f7918825640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79140addf0 0x7f79140ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f7918825640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79140addf0 0x7f79140ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47460/0 (socket says 172.21.15.67:47460) 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f7918825640 1 -- 172.21.15.67:0/3792200886 learned_addr learned my addr 172.21.15.67:0/3792200886 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f79137fe640 1 --2- 172.21.15.67:0/3792200886 >> v2:172.21.15.97:3300/0 conn(0x7f79140d0520 0x7f79140d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f7918825640 1 -- 172.21.15.67:0/3792200886 >> v2:172.21.15.97:3300/0 conn(0x7f79140d0520 msgr2=0x7f79140d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f7918825640 1 --2- 172.21.15.67:0/3792200886 >> v2:172.21.15.97:3300/0 conn(0x7f79140d0520 0x7f79140d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f7918825640 1 -- 172.21.15.67:0/3792200886 >> v1:172.21.15.97:6789/0 conn(0x7f79140738b0 legacy=0x7f791415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:21.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.354+0000 7f7918825640 1 -- 172.21.15.67:0/3792200886 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79140b37e0 con 0x7f79140addf0 2024-09-19T05:36:21.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f7918825640 1 --2- 172.21.15.67:0/3792200886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140addf0 0x7f79140ae1d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f791406fea0 tx=0x7f790c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcaf08949c1af93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:21.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f7912ffd640 1 -- 172.21.15.67:0/3792200886 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c0a5620 con 0x7f79140addf0 2024-09-19T05:36:21.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f7912ffd640 1 -- 172.21.15.67:0/3792200886 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790c0a57c0 con 0x7f79140addf0 2024-09-19T05:36:21.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f7912ffd640 1 -- 172.21.15.67:0/3792200886 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c0a5b90 con 0x7f79140addf0 2024-09-19T05:36:21.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f791a288640 1 -- 172.21.15.67:0/3792200886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140addf0 msgr2=0x7f79140ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:21.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f791a288640 1 --2- 172.21.15.67:0/3792200886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140addf0 0x7f79140ae1d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f791406fea0 tx=0x7f790c01c960 comp rx=0 tx=0).stop 2024-09-19T05:36:21.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f791a288640 1 -- 172.21.15.67:0/3792200886 shutdown_connections 2024-09-19T05:36:21.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f791a288640 1 --2- 172.21.15.67:0/3792200886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140addf0 0x7f79140ae1d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:21.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f791a288640 1 --2- 172.21.15.67:0/3792200886 >> v2:172.21.15.97:3300/0 conn(0x7f79140d0520 0x7f79140d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:21.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f791a288640 1 -- 172.21.15.67:0/3792200886 >> 172.21.15.67:0/3792200886 conn(0x7f791406c0c0 msgr2=0x7f791406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:21.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f791a288640 1 -- 172.21.15.67:0/3792200886 shutdown_connections 2024-09-19T05:36:21.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f791a288640 1 -- 172.21.15.67:0/3792200886 wait complete. 2024-09-19T05:36:21.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f791a288640 1 Processor -- start 2024-09-19T05:36:21.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.358+0000 7f791a288640 1 -- start start 2024-09-19T05:36:21.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f791a288640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79140738b0 0x7f791414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:21.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f791a288640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79140addf0 0x7f79141580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:21.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f791a288640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140d0520 0x7f7914158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:21.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f791a288640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f79140b30b0 con 0x7f79140d0520 2024-09-19T05:36:21.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f791a288640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7914073c90 con 0x7f79140addf0 2024-09-19T05:36:21.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f791a288640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f79140b3230 con 0x7f79140738b0 2024-09-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7918825640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140d0520 0x7f7914158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7918825640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140d0520 0x7f7914158630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47468/0 (socket says 172.21.15.67:47468) 2024-09-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f79137fe640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79140addf0 0x7f79141580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7918825640 1 -- 172.21.15.67:0/10916119 learned_addr learned my addr 172.21.15.67:0/10916119 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7913fff640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79140738b0 0x7f791414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7918825640 1 -- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79140738b0 msgr2=0x7f791414f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7918825640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79140738b0 0x7f791414f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7918825640 1 -- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79140addf0 msgr2=0x7f79141580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7918825640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79140addf0 0x7f79141580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7918825640 1 -- 172.21.15.67:0/10916119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791415c760 con 0x7f79140d0520 2024-09-19T05:36:21.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7918825640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140d0520 0x7f7914158630 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f790c019570 tx=0x7f790c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:21.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7910ff9640 1 -- 172.21.15.67:0/10916119 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c0bc020 con 0x7f79140d0520 2024-09-19T05:36:21.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7910ff9640 1 -- 172.21.15.67:0/10916119 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790c0b8670 con 0x7f79140d0520 2024-09-19T05:36:21.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7910ff9640 1 -- 172.21.15.67:0/10916119 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c0b8a40 con 0x7f79140d0520 2024-09-19T05:36:21.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f791a288640 1 -- 172.21.15.67:0/10916119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791415ca00 con 0x7f79140d0520 2024-09-19T05:36:21.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f791a288640 1 -- 172.21.15.67:0/10916119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f791414fe00 con 0x7f79140d0520 2024-09-19T05:36:21.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f791a288640 1 -- 172.21.15.67:0/10916119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79140ae1d0 con 0x7f79140d0520 2024-09-19T05:36:21.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.362+0000 7f7910ff9640 1 -- 172.21.15.67:0/10916119 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f790c0bf020 con 0x7f79140d0520 2024-09-19T05:36:21.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.366+0000 7f7910ff9640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79000678c0 0x7f7900069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:21.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.366+0000 7f7910ff9640 1 -- 172.21.15.67:0/10916119 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f790c120dd0 con 0x7f79140d0520 2024-09-19T05:36:21.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.366+0000 7f7913fff640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79000678c0 0x7f7900069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:21.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.366+0000 7f7913fff640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79000678c0 0x7f7900069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7904001650 tx=0x7f7904009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:21.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.370+0000 7f7910ff9640 1 -- 172.21.15.67:0/10916119 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f790c0c6030 con 0x7f79140d0520 2024-09-19T05:36:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:21.538+0000 7f791a288640 1 -- 172.21.15.67:0/10916119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f79140b5390 con 0x7f79140d0520 2024-09-19T05:36:22.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.278+0000 7f7910ff9640 1 -- 172.21.15.67:0/10916119 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) ==== 181+0+0 (secure 0 0 0) 0x7f790c0165e0 con 0x7f79140d0520 2024-09-19T05:36:22.282 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:36:22.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.282+0000 7f791a288640 1 -- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79000678c0 msgr2=0x7f7900069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:22.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.282+0000 7f791a288640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79000678c0 0x7f7900069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7904001650 tx=0x7f7904009040 comp rx=0 tx=0).stop 2024-09-19T05:36:22.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.282+0000 7f791a288640 1 -- 172.21.15.67:0/10916119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140d0520 msgr2=0x7f7914158630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:22.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.282+0000 7f791a288640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140d0520 0x7f7914158630 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f790c019570 tx=0x7f790c019700 comp rx=0 tx=0).stop 2024-09-19T05:36:22.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.282+0000 7f791a288640 1 -- 172.21.15.67:0/10916119 shutdown_connections 2024-09-19T05:36:22.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.282+0000 7f791a288640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79140d0520 0x7f7914158630 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:22.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.282+0000 7f791a288640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79140addf0 0x7f79141580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:22.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.282+0000 7f791a288640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79000678c0 0x7f7900069d80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:22.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.282+0000 7f791a288640 1 --2- 172.21.15.67:0/10916119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79140738b0 0x7f791414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:22.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.282+0000 7f791a288640 1 -- 172.21.15.67:0/10916119 >> 172.21.15.67:0/10916119 conn(0x7f791406c0c0 msgr2=0x7f791406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:22.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.286+0000 7f791a288640 1 -- 172.21.15.67:0/10916119 shutdown_connections 2024-09-19T05:36:22.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.286+0000 7f791a288640 1 -- 172.21.15.67:0/10916119 wait complete. 2024-09-19T05:36:22.314 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:36:22.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.442+0000 7f21f2abf640 1 Processor -- start 2024-09-19T05:36:22.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.442+0000 7f21f2abf640 1 -- start start 2024-09-19T05:36:22.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.442+0000 7f21f2abf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec0cf5e0 0x7f21ec0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:22.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.442+0000 7f21f2abf640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ec15d030 con 0x7f21ec15c850 2024-09-19T05:36:22.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.442+0000 7f21f2abf640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ec15d310 con 0x7f21ec15d8d0 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.442+0000 7f21f2abf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f21ec06de90 con 0x7f21ec0cf5e0 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.442+0000 7f21ebfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f21ec15c850 0x7f21ec06e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56872/0 (socket says 172.21.15.67:56872) 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.442+0000 7f21ebfff640 1 -- 172.21.15.67:0/3510037723 learned_addr learned my addr 172.21.15.67:0/3510037723 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21f085b640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec0cf5e0 0x7f21ec0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033113646 0 0) 0x7f21ec15d030 con 0x7f21ec15c850 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21d8003530 con 0x7f21ec15c850 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3123289219 0 0) 0x7f21d8003530 con 0x7f21ec15c850 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec0cf5e0 msgr2=0x7f21ec0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec0cf5e0 0x7f21ec0d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 >> v1:172.21.15.97:6789/0 conn(0x7f21ec15d8d0 legacy=0x7f21ec0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ec15d5f0 con 0x7f21ec15c850 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f21d4001680 con 0x7f21ec15c850 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 >> v1:172.21.15.67:6789/0 conn(0x7f21ec15c850 legacy=0x7f21ec06e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:22.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21d80039f0 0x7f21d8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec0cf5e0 0x7f21d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d8004d50 0x7f21d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec06de90 con 0x7f21d80039f0 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f21d800ba80 con 0x7f21d8004d50 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f21d800bc80 con 0x7f21ec0cf5e0 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21f085b640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21d80039f0 0x7f21d8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21ebfff640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec0cf5e0 0x7f21d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21f105c640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d8004d50 0x7f21d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21f085b640 1 -- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec0cf5e0 msgr2=0x7f21d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21f085b640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec0cf5e0 0x7f21d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21f085b640 1 -- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d8004d50 msgr2=0x7f21d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21f085b640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d8004d50 0x7f21d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.446+0000 7f21f085b640 1 -- 172.21.15.67:0/3510037723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d8003530 con 0x7f21d80039f0 2024-09-19T05:36:22.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f085b640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21d80039f0 0x7f21d8003e10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009f90 tx=0x7f21e401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6127ea0b864df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:22.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e40b2070 con 0x7f21d80039f0 2024-09-19T05:36:22.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e40a5b40 con 0x7f21d80039f0 2024-09-19T05:36:22.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21eb7fe640 1 -- 172.21.15.67:0/3510037723 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e4009c10 con 0x7f21d80039f0 2024-09-19T05:36:22.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 -- 172.21.15.67:0/3510037723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21d80039f0 msgr2=0x7f21d8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:22.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 --2- 172.21.15.67:0/3510037723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21d80039f0 0x7f21d8003e10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009f90 tx=0x7f21e401cc40 comp rx=0 tx=0).stop 2024-09-19T05:36:22.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f105c640 1 -- 172.21.15.67:0/3510037723 reap_dead start 2024-09-19T05:36:22.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 -- 172.21.15.67:0/3510037723 shutdown_connections 2024-09-19T05:36:22.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 -- 172.21.15.67:0/3510037723 >> 172.21.15.67:0/3510037723 conn(0x7f21ec06c0c0 msgr2=0x7f21ec06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:22.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 -- 172.21.15.67:0/3510037723 shutdown_connections 2024-09-19T05:36:22.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 -- 172.21.15.67:0/3510037723 wait complete. 2024-09-19T05:36:22.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 Processor -- start 2024-09-19T05:36:22.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 -- start start 2024-09-19T05:36:22.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21ec099a70 0x7f21ec0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:22.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21ec0b36f0 0x7f21ec073040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:22.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec073580 0x7f21ec1fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec0ad920 con 0x7f21ec099a70 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec0ad7a0 con 0x7f21ec0b36f0 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f2abf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f21ec0d0aa0 con 0x7f21ec073580 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f085b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21ec099a70 0x7f21ec0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f085b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21ec099a70 0x7f21ec0b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47484/0 (socket says 172.21.15.67:47484) 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.450+0000 7f21f085b640 1 -- 172.21.15.67:0/3396706038 learned_addr learned my addr 172.21.15.67:0/3396706038 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21ebfff640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21ec0b36f0 0x7f21ec073040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21f105c640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec073580 0x7f21ec1fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21f085b640 1 -- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec073580 msgr2=0x7f21ec1fa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21f085b640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec073580 0x7f21ec1fa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21f085b640 1 -- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21ec0b36f0 msgr2=0x7f21ec073040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21f085b640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21ec0b36f0 0x7f21ec073040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21f085b640 1 -- 172.21.15.67:0/3396706038 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ec0b3c70 con 0x7f21ec099a70 2024-09-19T05:36:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21ebfff640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21ec0b36f0 0x7f21ec073040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21f085b640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21ec099a70 0x7f21ec0b31b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f21e40b0040 tx=0x7f21e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21e97fa640 1 -- 172.21.15.67:0/3396706038 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e40ba070 con 0x7f21ec099a70 2024-09-19T05:36:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21e97fa640 1 -- 172.21.15.67:0/3396706038 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e40ada20 con 0x7f21ec099a70 2024-09-19T05:36:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21f2abf640 1 -- 172.21.15.67:0/3396706038 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ec0b3f50 con 0x7f21ec099a70 2024-09-19T05:36:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21e97fa640 1 -- 172.21.15.67:0/3396706038 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e40b2040 con 0x7f21ec099a70 2024-09-19T05:36:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21f2abf640 1 -- 172.21.15.67:0/3396706038 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ec099e50 con 0x7f21ec099a70 2024-09-19T05:36:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21f2abf640 1 -- 172.21.15.67:0/3396706038 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ec0b4470 con 0x7f21ec099a70 2024-09-19T05:36:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21e97fa640 1 -- 172.21.15.67:0/3396706038 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21e40b6410 con 0x7f21ec099a70 2024-09-19T05:36:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21e97fa640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21cc0678c0 0x7f21cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21e97fa640 1 -- 172.21.15.67:0/3396706038 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5778+0+0 (secure 0 0 0) 0x7f21e4120300 con 0x7f21ec099a70 2024-09-19T05:36:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.454+0000 7f21ebfff640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21cc0678c0 0x7f21cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.458+0000 7f21ebfff640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21cc0678c0 0x7f21cc069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f21d4004850 tx=0x7f21d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:22.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.462+0000 7f21e97fa640 1 -- 172.21.15.67:0/3396706038 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f21e4016950 con 0x7f21ec099a70 2024-09-19T05:36:22.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:22.650+0000 7f21f2abf640 1 -- 172.21.15.67:0/3396706038 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f21ec0d0e60 con 0x7f21ec099a70 2024-09-19T05:36:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.286+0000 7f21e97fa640 1 -- 172.21.15.67:0/3396706038 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) ==== 169+0+0 (secure 0 0 0) 0x7f21e40f0830 con 0x7f21ec099a70 2024-09-19T05:36:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:36:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 -- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21cc0678c0 msgr2=0x7f21cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21cc0678c0 0x7f21cc069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f21d4004850 tx=0x7f21d4009040 comp rx=0 tx=0).stop 2024-09-19T05:36:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 -- 172.21.15.67:0/3396706038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21ec099a70 msgr2=0x7f21ec0b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21ec099a70 0x7f21ec0b31b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f21e40b0040 tx=0x7f21e4009750 comp rx=0 tx=0).stop 2024-09-19T05:36:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 -- 172.21.15.67:0/3396706038 shutdown_connections 2024-09-19T05:36:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21cc0678c0 0x7f21cc069d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21ec073580 0x7f21ec1fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21ec0b36f0 0x7f21ec073040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 --2- 172.21.15.67:0/3396706038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21ec099a70 0x7f21ec0b31b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 -- 172.21.15.67:0/3396706038 >> 172.21.15.67:0/3396706038 conn(0x7f21ec06c0c0 msgr2=0x7f21ec157e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 -- 172.21.15.67:0/3396706038 shutdown_connections 2024-09-19T05:36:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.290+0000 7f21f2abf640 1 -- 172.21.15.67:0/3396706038 wait complete. 2024-09-19T05:36:23.325 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:36:23.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.446+0000 7f47e0617640 1 Processor -- start 2024-09-19T05:36:23.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.446+0000 7f47e0617640 1 -- start start 2024-09-19T05:36:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.446+0000 7f47e0617640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47d815b1d0 0x7f47d80adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.446+0000 7f47e0617640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f47d8070070 0x7f47d80b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.446+0000 7f47e0617640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d80aef30 con 0x7f47d806dfc0 2024-09-19T05:36:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.446+0000 7f47e0617640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f47d8072210 con 0x7f47d815b1d0 2024-09-19T05:36:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.446+0000 7f47e0617640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f47d80ae0f0 con 0x7f47d8070070 2024-09-19T05:36:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47de3b3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47d815b1d0 0x7f47d80adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47de3b3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47d815b1d0 0x7f47d80adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47496/0 (socket says 172.21.15.67:47496) 2024-09-19T05:36:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47de3b3640 1 -- 172.21.15.67:0/1275909191 learned_addr learned my addr 172.21.15.67:0/1275909191 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47de3b3640 1 -- 172.21.15.67:0/1275909191 >> v2:172.21.15.97:3300/0 conn(0x7f47d8070070 msgr2=0x7f47d80b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47debb4640 1 --2- 172.21.15.67:0/1275909191 >> v2:172.21.15.97:3300/0 conn(0x7f47d8070070 0x7f47d80b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47de3b3640 1 --2- 172.21.15.67:0/1275909191 >> v2:172.21.15.97:3300/0 conn(0x7f47d8070070 0x7f47d80b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47de3b3640 1 -- 172.21.15.67:0/1275909191 >> v1:172.21.15.97:6789/0 conn(0x7f47d806dfc0 legacy=0x7f47d806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47de3b3640 1 -- 172.21.15.67:0/1275909191 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d80ae3b0 con 0x7f47d815b1d0 2024-09-19T05:36:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47debb4640 1 --2- 172.21.15.67:0/1275909191 >> v2:172.21.15.97:3300/0 conn(0x7f47d8070070 0x7f47d80b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:23.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47de3b3640 1 --2- 172.21.15.67:0/1275909191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d815b1d0 0x7f47d80adbb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f47d80b52f0 tx=0x7f47d401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2206e2145bae3bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:23.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47dd3b1640 1 -- 172.21.15.67:0/1275909191 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40b1070 con 0x7f47d815b1d0 2024-09-19T05:36:23.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47dd3b1640 1 -- 172.21.15.67:0/1275909191 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d40ac630 con 0x7f47d815b1d0 2024-09-19T05:36:23.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47dd3b1640 1 -- 172.21.15.67:0/1275909191 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40a8050 con 0x7f47d815b1d0 2024-09-19T05:36:23.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47e0617640 1 -- 172.21.15.67:0/1275909191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d815b1d0 msgr2=0x7f47d80adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47e0617640 1 --2- 172.21.15.67:0/1275909191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d815b1d0 0x7f47d80adbb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f47d80b52f0 tx=0x7f47d401c4e0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47e0617640 1 -- 172.21.15.67:0/1275909191 shutdown_connections 2024-09-19T05:36:23.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47e0617640 1 --2- 172.21.15.67:0/1275909191 >> v2:172.21.15.97:3300/0 conn(0x7f47d8070070 0x7f47d80b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47e0617640 1 --2- 172.21.15.67:0/1275909191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d815b1d0 0x7f47d80adbb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.450+0000 7f47e0617640 1 -- 172.21.15.67:0/1275909191 >> 172.21.15.67:0/1275909191 conn(0x7f47d80b1e50 msgr2=0x7f47d80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:23.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 -- 172.21.15.67:0/1275909191 shutdown_connections 2024-09-19T05:36:23.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 -- 172.21.15.67:0/1275909191 wait complete. 2024-09-19T05:36:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 Processor -- start 2024-09-19T05:36:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 -- start start 2024-09-19T05:36:23.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d806dfc0 0x7f47d813ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47d8070070 0x7f47d809dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47d815b1d0 0x7f47d806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47d80b4180 con 0x7f47d806dfc0 2024-09-19T05:36:23.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f47d8072420 con 0x7f47d815b1d0 2024-09-19T05:36:23.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f47d80b4300 con 0x7f47d8070070 2024-09-19T05:36:23.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47de3b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d806dfc0 0x7f47d813ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47de3b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d806dfc0 0x7f47d813ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47506/0 (socket says 172.21.15.67:47506) 2024-09-19T05:36:23.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47de3b3640 1 -- 172.21.15.67:0/3915994965 learned_addr learned my addr 172.21.15.67:0/3915994965 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:23.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47debb4640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47d815b1d0 0x7f47d806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47de3b3640 1 -- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47d8070070 msgr2=0x7f47d809dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47ddbb2640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47d8070070 0x7f47d809dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47de3b3640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47d8070070 0x7f47d809dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47de3b3640 1 -- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47d815b1d0 msgr2=0x7f47d806eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47de3b3640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47d815b1d0 0x7f47d806eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47de3b3640 1 -- 172.21.15.67:0/3915994965 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d8140520 con 0x7f47d806dfc0 2024-09-19T05:36:23.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47debb4640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47d815b1d0 0x7f47d806eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:23.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47de3b3640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d806dfc0 0x7f47d813ffe0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f47d40af040 tx=0x7f47d4019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:23.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47ceffd640 1 -- 172.21.15.67:0/3915994965 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40bc070 con 0x7f47d806dfc0 2024-09-19T05:36:23.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47ceffd640 1 -- 172.21.15.67:0/3915994965 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d40b7650 con 0x7f47d806dfc0 2024-09-19T05:36:23.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 -- 172.21.15.67:0/3915994965 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d809b3a0 con 0x7f47d806dfc0 2024-09-19T05:36:23.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47ceffd640 1 -- 172.21.15.67:0/3915994965 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40b1040 con 0x7f47d806dfc0 2024-09-19T05:36:23.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 -- 172.21.15.67:0/3915994965 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d809a820 con 0x7f47d806dfc0 2024-09-19T05:36:23.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.454+0000 7f47e0617640 1 -- 172.21.15.67:0/3915994965 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d80b3430 con 0x7f47d806dfc0 2024-09-19T05:36:23.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.458+0000 7f47ceffd640 1 -- 172.21.15.67:0/3915994965 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47d40bf070 con 0x7f47d806dfc0 2024-09-19T05:36:23.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.458+0000 7f47ceffd640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47bc0678f0 0x7f47bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.458+0000 7f47ceffd640 1 -- 172.21.15.67:0/3915994965 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f47d411f760 con 0x7f47d806dfc0 2024-09-19T05:36:23.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.458+0000 7f47ddbb2640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47bc0678f0 0x7f47bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.458+0000 7f47ddbb2640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47bc0678f0 0x7f47bc069db0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f47d815f900 tx=0x7f47c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:23.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.462+0000 7f47ceffd640 1 -- 172.21.15.67:0/3915994965 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f47d8140520 con 0x7f47d806dfc0 2024-09-19T05:36:23.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.626+0000 7f47e0617640 1 -- 172.21.15.67:0/3915994965 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f47d80725a0 con 0x7f47d806dfc0 2024-09-19T05:36:23.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.630+0000 7f47ceffd640 1 -- 172.21.15.67:0/3915994965 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f47d40160d0 con 0x7f47d806dfc0 2024-09-19T05:36:23.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 -- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47bc0678f0 msgr2=0x7f47bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47bc0678f0 0x7f47bc069db0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f47d815f900 tx=0x7f47c8008040 comp rx=0 tx=0).stop 2024-09-19T05:36:23.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 -- 172.21.15.67:0/3915994965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d806dfc0 msgr2=0x7f47d813ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d806dfc0 0x7f47d813ffe0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f47d40af040 tx=0x7f47d4019280 comp rx=0 tx=0).stop 2024-09-19T05:36:23.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 -- 172.21.15.67:0/3915994965 shutdown_connections 2024-09-19T05:36:23.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47d815b1d0 0x7f47d806eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47bc0678f0 0x7f47bc069db0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47d8070070 0x7f47d809dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 --2- 172.21.15.67:0/3915994965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d806dfc0 0x7f47d813ffe0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 -- 172.21.15.67:0/3915994965 >> 172.21.15.67:0/3915994965 conn(0x7f47d80b1e50 msgr2=0x7f47d80af100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:23.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 -- 172.21.15.67:0/3915994965 shutdown_connections 2024-09-19T05:36:23.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.634+0000 7f47e0617640 1 -- 172.21.15.67:0/3915994965 wait complete. 2024-09-19T05:36:23.656 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-19T05:36:23.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f503aab4640 1 Processor -- start 2024-09-19T05:36:23.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f503aab4640 1 -- start start 2024-09-19T05:36:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f503aab4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50340cf070 0x7f503415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f503aab4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f503415ef30 0x7f50340d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f503aab4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50340cf510 con 0x7f503415e610 2024-09-19T05:36:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f503aab4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f50340d0120 con 0x7f50340cf070 2024-09-19T05:36:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f503aab4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f50340cf7f0 con 0x7f503415ef30 2024-09-19T05:36:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f502bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50340cf070 0x7f503415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f5039051640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f503415ef30 0x7f50340d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f502bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50340cf070 0x7f503415e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47520/0 (socket says 172.21.15.67:47520) 2024-09-19T05:36:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f502bfff640 1 -- 172.21.15.67:0/1291916479 learned_addr learned my addr 172.21.15.67:0/1291916479 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f502bfff640 1 -- 172.21.15.67:0/1291916479 >> v2:172.21.15.97:3300/0 conn(0x7f503415ef30 msgr2=0x7f50340d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f502bfff640 1 --2- 172.21.15.67:0/1291916479 >> v2:172.21.15.97:3300/0 conn(0x7f503415ef30 0x7f50340d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f502bfff640 1 -- 172.21.15.67:0/1291916479 >> v1:172.21.15.97:6789/0 conn(0x7f503415e610 legacy=0x7f5034162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.774+0000 7f502bfff640 1 -- 172.21.15.67:0/1291916479 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50340cfad0 con 0x7f50340cf070 2024-09-19T05:36:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f502bfff640 1 --2- 172.21.15.67:0/1291916479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50340cf070 0x7f503415e9f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f503408d410 tx=0x7f502401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c224cc21f31b7dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f502b7fe640 1 -- 172.21.15.67:0/1291916479 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50240aa670 con 0x7f50340cf070 2024-09-19T05:36:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f502b7fe640 1 -- 172.21.15.67:0/1291916479 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50240af070 con 0x7f50340cf070 2024-09-19T05:36:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f502b7fe640 1 -- 172.21.15.67:0/1291916479 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50240aaa30 con 0x7f50340cf070 2024-09-19T05:36:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f503aab4640 1 -- 172.21.15.67:0/1291916479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50340cf070 msgr2=0x7f503415e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f503aab4640 1 --2- 172.21.15.67:0/1291916479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50340cf070 0x7f503415e9f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f503408d410 tx=0x7f502401c4f0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f503aab4640 1 -- 172.21.15.67:0/1291916479 shutdown_connections 2024-09-19T05:36:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f503aab4640 1 --2- 172.21.15.67:0/1291916479 >> v2:172.21.15.97:3300/0 conn(0x7f503415ef30 0x7f50340d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f503aab4640 1 --2- 172.21.15.67:0/1291916479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50340cf070 0x7f503415e9f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f503aab4640 1 -- 172.21.15.67:0/1291916479 >> 172.21.15.67:0/1291916479 conn(0x7f503408bfc0 msgr2=0x7f50340d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f503aab4640 1 -- 172.21.15.67:0/1291916479 shutdown_connections 2024-09-19T05:36:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f503aab4640 1 -- 172.21.15.67:0/1291916479 wait complete. 2024-09-19T05:36:23.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f503aab4640 1 Processor -- start 2024-09-19T05:36:23.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.778+0000 7f503aab4640 1 -- start start 2024-09-19T05:36:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f503aab4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50340cf070 0x7f5034153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f503aab4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503415e610 0x7f5034156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f503aab4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503415ef30 0x7f5034157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f503aab4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f50340d2f40 con 0x7f503415e610 2024-09-19T05:36:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f503aab4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f50340d2dc0 con 0x7f503415ef30 2024-09-19T05:36:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f503aab4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f50340d30c0 con 0x7f50340cf070 2024-09-19T05:36:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f502bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503415e610 0x7f5034156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f502bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503415e610 0x7f5034156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47528/0 (socket says 172.21.15.67:47528) 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f502bfff640 1 -- 172.21.15.67:0/1686619423 learned_addr learned my addr 172.21.15.67:0/1686619423 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f5039051640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503415ef30 0x7f5034157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f5038850640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50340cf070 0x7f5034153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f502bfff640 1 -- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50340cf070 msgr2=0x7f5034153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f502bfff640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50340cf070 0x7f5034153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f502bfff640 1 -- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503415ef30 msgr2=0x7f5034157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f502bfff640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503415ef30 0x7f5034157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f502bfff640 1 -- 172.21.15.67:0/1686619423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50340b72d0 con 0x7f503415e610 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f5038850640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50340cf070 0x7f5034153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f5039051640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503415ef30 0x7f5034157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f502bfff640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503415e610 0x7f5034156cb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5024019100 tx=0x7f502401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f50297fa640 1 -- 172.21.15.67:0/1686619423 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50240bd5f0 con 0x7f503415e610 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f50297fa640 1 -- 172.21.15.67:0/1686619423 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50240bd790 con 0x7f503415e610 2024-09-19T05:36:23.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f503aab4640 1 -- 172.21.15.67:0/1686619423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50341571f0 con 0x7f503415e610 2024-09-19T05:36:23.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f50297fa640 1 -- 172.21.15.67:0/1686619423 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50240bdb60 con 0x7f503415e610 2024-09-19T05:36:23.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f503aab4640 1 -- 172.21.15.67:0/1686619423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50340b63c0 con 0x7f503415e610 2024-09-19T05:36:23.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f503aab4640 1 -- 172.21.15.67:0/1686619423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50340b6d60 con 0x7f503415e610 2024-09-19T05:36:23.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f50297fa640 1 -- 172.21.15.67:0/1686619423 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f50240b33f0 con 0x7f503415e610 2024-09-19T05:36:23.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f50297fa640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f50200678c0 0x7f5020069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:23.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f50297fa640 1 -- 172.21.15.67:0/1686619423 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f50241208c0 con 0x7f503415e610 2024-09-19T05:36:23.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.782+0000 7f5038850640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f50200678c0 0x7f5020069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:23.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.786+0000 7f5038850640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f50200678c0 0x7f5020069d80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f50300016f0 tx=0x7f5030009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:23.786+0000 7f50297fa640 1 -- 172.21.15.67:0/1686619423 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f50340b6d60 con 0x7f503415e610 2024-09-19T05:36:24.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.014+0000 7f503aab4640 1 -- 172.21.15.67:0/1686619423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f503415e9f0 con 0x7f503415e610 2024-09-19T05:36:24.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.290+0000 7f50297fa640 1 -- 172.21.15.67:0/1686619423 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v148) ==== 148+0+0 (secure 0 0 0) 0x7f50240c3060 con 0x7f503415e610 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 -- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f50200678c0 msgr2=0x7f5020069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f50200678c0 0x7f5020069d80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f50300016f0 tx=0x7f5030009040 comp rx=0 tx=0).stop 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 -- 172.21.15.67:0/1686619423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503415e610 msgr2=0x7f5034156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503415e610 0x7f5034156cb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5024019100 tx=0x7f502401ad30 comp rx=0 tx=0).stop 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 -- 172.21.15.67:0/1686619423 shutdown_connections 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503415ef30 0x7f5034157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503415e610 0x7f5034156cb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f50200678c0 0x7f5020069d80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 --2- 172.21.15.67:0/1686619423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50340cf070 0x7f5034153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 -- 172.21.15.67:0/1686619423 >> 172.21.15.67:0/1686619423 conn(0x7f503408bfc0 msgr2=0x7f503406e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 -- 172.21.15.67:0/1686619423 shutdown_connections 2024-09-19T05:36:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.294+0000 7f503aab4640 1 -- 172.21.15.67:0/1686619423 wait complete. 2024-09-19T05:36:24.318 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-09-19T05:36:24.318 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-19T05:36:24.319 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:36:24.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bffba3640 1 Processor -- start 2024-09-19T05:36:24.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bffba3640 1 -- start start 2024-09-19T05:36:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bffba3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf8161da0 0x7f1bf80d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bffba3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1bf80d0160 0x7f1bf80d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bffba3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bf80d4d40 con 0x7f1bf80d0e80 2024-09-19T05:36:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bffba3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1bf80d0610 con 0x7f1bf80d0160 2024-09-19T05:36:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bffba3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf80d0840 con 0x7f1bf8161da0 2024-09-19T05:36:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfd13e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1bf80d0e80 0x7f1bf80b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56880/0 (socket says 172.21.15.67:56880) 2024-09-19T05:36:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfd13e640 1 -- 172.21.15.67:0/1670881596 learned_addr learned my addr 172.21.15.67:0/1670881596 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfd93f640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf8161da0 0x7f1bf80d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfe140640 1 --2- 172.21.15.67:0/1670881596 >> v2:172.21.15.97:3300/0 conn(0x7f1bf80d0160 0x7f1bf80d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851702978 0 0) 0x7f1bf80d4d40 con 0x7f1bf80d0e80 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1be4003530 con 0x7f1bf80d0e80 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 930988778 0 0) 0x7f1be4003530 con 0x7f1bf80d0e80 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf8161da0 msgr2=0x7f1bf80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf8161da0 0x7f1bf80d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 >> v2:172.21.15.97:3300/0 conn(0x7f1bf80d0160 msgr2=0x7f1bf80d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 --2- 172.21.15.67:0/1670881596 >> v2:172.21.15.97:3300/0 conn(0x7f1bf80d0160 0x7f1bf80d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf80d5020 con 0x7f1bf80d0e80 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1bf4001680 con 0x7f1bf80d0e80 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 >> v1:172.21.15.67:6789/0 conn(0x7f1bf80d0e80 legacy=0x7f1bf80b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf8161da0 0x7f1be40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 0x7f1be4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1be4004d50 0x7f1be40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf80d0840 con 0x7f1be4003f40 2024-09-19T05:36:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1be400b9d0 con 0x7f1be4004d50 2024-09-19T05:36:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1be400bb50 con 0x7f1bf8161da0 2024-09-19T05:36:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfd13e640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 0x7f1be4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfd93f640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf8161da0 0x7f1be40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfe140640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1be4004d50 0x7f1be40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfd13e640 1 -- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf8161da0 msgr2=0x7f1be40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfd13e640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf8161da0 0x7f1be40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfd13e640 1 -- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1be4004d50 msgr2=0x7f1be40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfd13e640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1be4004d50 0x7f1be40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.438+0000 7f1bfd13e640 1 -- 172.21.15.67:0/1670881596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be4003530 con 0x7f1be4003f40 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bfd13e640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 0x7f1be4004810 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400c210 tx=0x7f1bf401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad248dfec13d05db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4007d40 con 0x7f1be4003f40 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf4005b00 con 0x7f1be4003f40 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bfc93d640 1 -- 172.21.15.67:0/1670881596 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4007070 con 0x7f1be4003f40 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bffba3640 1 -- 172.21.15.67:0/1670881596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 msgr2=0x7f1be4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bffba3640 1 --2- 172.21.15.67:0/1670881596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 0x7f1be4004810 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400c210 tx=0x7f1bf401f370 comp rx=0 tx=0).stop 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bfe140640 1 -- 172.21.15.67:0/1670881596 reap_dead start 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bffba3640 1 -- 172.21.15.67:0/1670881596 shutdown_connections 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bffba3640 1 -- 172.21.15.67:0/1670881596 >> 172.21.15.67:0/1670881596 conn(0x7f1bf808bfc0 msgr2=0x7f1bf80d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bffba3640 1 -- 172.21.15.67:0/1670881596 shutdown_connections 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bffba3640 1 -- 172.21.15.67:0/1670881596 wait complete. 2024-09-19T05:36:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.442+0000 7f1bffba3640 1 Processor -- start 2024-09-19T05:36:24.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bffba3640 1 -- start start 2024-09-19T05:36:24.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bffba3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 0x7f1bf80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bffba3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf80ccd70 0x7f1bf8159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bffba3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf80b9600 0x7f1bf80cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bffba3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf80b3ca0 con 0x7f1be4003f40 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bffba3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf80d1800 con 0x7f1bf80ccd70 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bffba3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf80b5d00 con 0x7f1bf80b9600 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd93f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 0x7f1bf80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd93f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 0x7f1bf80cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47550/0 (socket says 172.21.15.67:47550) 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd93f640 1 -- 172.21.15.67:0/2542879844 learned_addr learned my addr 172.21.15.67:0/2542879844 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd13e640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf80ccd70 0x7f1bf8159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfe140640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf80b9600 0x7f1bf80cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd93f640 1 -- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf80b9600 msgr2=0x7f1bf80cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd93f640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf80b9600 0x7f1bf80cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd93f640 1 -- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf80ccd70 msgr2=0x7f1bf8159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd93f640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf80ccd70 0x7f1bf8159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd93f640 1 -- 172.21.15.67:0/2542879844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf80cbcd0 con 0x7f1be4003f40 2024-09-19T05:36:24.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd13e640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf80ccd70 0x7f1bf8159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:24.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bfd93f640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 0x7f1bf80cb560 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1be80119d0 tx=0x7f1be8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:24.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bee7fc640 1 -- 172.21.15.67:0/2542879844 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be800fb50 con 0x7f1be4003f40 2024-09-19T05:36:24.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bee7fc640 1 -- 172.21.15.67:0/2542879844 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be800fcf0 con 0x7f1be4003f40 2024-09-19T05:36:24.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bee7fc640 1 -- 172.21.15.67:0/2542879844 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be800fea0 con 0x7f1be4003f40 2024-09-19T05:36:24.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bffba3640 1 -- 172.21.15.67:0/2542879844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf80cbfb0 con 0x7f1be4003f40 2024-09-19T05:36:24.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bffba3640 1 -- 172.21.15.67:0/2542879844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf80cc570 con 0x7f1be4003f40 2024-09-19T05:36:24.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bffba3640 1 -- 172.21.15.67:0/2542879844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf8162180 con 0x7f1be4003f40 2024-09-19T05:36:24.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bee7fc640 1 -- 172.21.15.67:0/2542879844 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1be8012040 con 0x7f1be4003f40 2024-09-19T05:36:24.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bee7fc640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bdc0678c0 0x7f1bdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.446+0000 7f1bee7fc640 1 -- 172.21.15.67:0/2542879844 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f1be80860c0 con 0x7f1be4003f40 2024-09-19T05:36:24.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.450+0000 7f1bfd13e640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bdc0678c0 0x7f1bdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.450+0000 7f1bfd13e640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bdc0678c0 0x7f1bdc069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40ae000 tx=0x7f1bf80b3b90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.454+0000 7f1bee7fc640 1 -- 172.21.15.67:0/2542879844 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1be8019030 con 0x7f1be4003f40 2024-09-19T05:36:24.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.634+0000 7f1bffba3640 1 -- 172.21.15.67:0/2542879844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bf80cc950 con 0x7f1be4003f40 2024-09-19T05:36:24.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bee7fc640 1 -- 172.21.15.67:0/2542879844 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+13269 (secure 0 0 0) 0x7f1be8056ec0 con 0x7f1be4003f40 2024-09-19T05:36:24.642 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:24.642 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":46,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:36:23.282734+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/3857596366":"2024-09-20T05:36:20.143546+0000","172.21.15.67:6833/3857596366":"2024-09-20T05:36:20.143546+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:36:24.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 -- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bdc0678c0 msgr2=0x7f1bdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bdc0678c0 0x7f1bdc069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40ae000 tx=0x7f1bf80b3b90 comp rx=0 tx=0).stop 2024-09-19T05:36:24.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 -- 172.21.15.67:0/2542879844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 msgr2=0x7f1bf80cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 0x7f1bf80cb560 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1be80119d0 tx=0x7f1be8011e90 comp rx=0 tx=0).stop 2024-09-19T05:36:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 -- 172.21.15.67:0/2542879844 shutdown_connections 2024-09-19T05:36:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bdc0678c0 0x7f1bdc069d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bf80b9600 0x7f1bf80cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bf80ccd70 0x7f1bf8159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 --2- 172.21.15.67:0/2542879844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be4003f40 0x7f1bf80cb560 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 -- 172.21.15.67:0/2542879844 >> 172.21.15.67:0/2542879844 conn(0x7f1bf808bfc0 msgr2=0x7f1bf80b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 -- 172.21.15.67:0/2542879844 shutdown_connections 2024-09-19T05:36:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.638+0000 7f1bffba3640 1 -- 172.21.15.67:0/2542879844 wait complete. 2024-09-19T05:36:24.660 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:36:24.660 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:36:24.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.786+0000 7fe3c137d640 1 Processor -- start 2024-09-19T05:36:24.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.786+0000 7fe3c137d640 1 -- start start 2024-09-19T05:36:24.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3c137d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3bc06dfc0 0x7fe3bc06f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3c137d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe3bc06fea0 0x7fe3bc0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3c137d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3bc0aef30 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3c137d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe3bc072210 con 0x7fe3bc06fea0 2024-09-19T05:36:24.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3c137d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe3bc0ae3b0 con 0x7fe3bc06dfc0 2024-09-19T05:36:24.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3bb7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe3bc06fea0 0x7fe3bc0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3baffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe3bc15b1d0 0x7fe3bc0adbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56886/0 (socket says 172.21.15.67:56886) 2024-09-19T05:36:24.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3baffd640 1 -- 172.21.15.67:0/1428245440 learned_addr learned my addr 172.21.15.67:0/1428245440 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:24.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3b9ffb640 1 -- 172.21.15.67:0/1428245440 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335008498 0 0) 0x7fe3bc0aef30 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3ba7fc640 1 --2- 172.21.15.67:0/1428245440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3bc06dfc0 0x7fe3bc06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3bb7fe640 1 -- 172.21.15.67:0/1428245440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3bc06dfc0 msgr2=0x7fe3bc06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:24.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3bb7fe640 1 --2- 172.21.15.67:0/1428245440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3bc06dfc0 0x7fe3bc06f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3bb7fe640 1 -- 172.21.15.67:0/1428245440 >> v1:172.21.15.67:6789/0 conn(0x7fe3bc15b1d0 legacy=0x7fe3bc0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3bb7fe640 1 -- 172.21.15.67:0/1428245440 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc0ae690 con 0x7fe3bc06fea0 2024-09-19T05:36:24.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3bb7fe640 1 --2- 172.21.15.67:0/1428245440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc06fea0 0x7fe3bc0b3430 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009d90 tx=0x7fe3b401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec36b4e2467fa77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:24.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3b9ffb640 1 -- 172.21.15.67:0/1428245440 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40b2070 con 0x7fe3bc06fea0 2024-09-19T05:36:24.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3b9ffb640 1 -- 172.21.15.67:0/1428245440 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b40a5830 con 0x7fe3bc06fea0 2024-09-19T05:36:24.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.790+0000 7fe3b9ffb640 1 -- 172.21.15.67:0/1428245440 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40a5c00 con 0x7fe3bc06fea0 2024-09-19T05:36:24.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- 172.21.15.67:0/1428245440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc06fea0 msgr2=0x7fe3bc0b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 --2- 172.21.15.67:0/1428245440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc06fea0 0x7fe3bc0b3430 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009d90 tx=0x7fe3b401c970 comp rx=0 tx=0).stop 2024-09-19T05:36:24.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- 172.21.15.67:0/1428245440 shutdown_connections 2024-09-19T05:36:24.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 --2- 172.21.15.67:0/1428245440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc06fea0 0x7fe3bc0b3430 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 --2- 172.21.15.67:0/1428245440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3bc06dfc0 0x7fe3bc06f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- 172.21.15.67:0/1428245440 >> 172.21.15.67:0/1428245440 conn(0x7fe3bc0b1e50 msgr2=0x7fe3bc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:24.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- 172.21.15.67:0/1428245440 shutdown_connections 2024-09-19T05:36:24.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- 172.21.15.67:0/1428245440 wait complete. 2024-09-19T05:36:24.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 Processor -- start 2024-09-19T05:36:24.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- start start 2024-09-19T05:36:24.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3bc06dfc0 0x7fe3bc150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3bc06fea0 0x7fe3bc09c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc15b1d0 0x7fe3bc09ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc0b4300 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc0b4180 con 0x7fe3bc06dfc0 2024-09-19T05:36:24.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe3bc0b4480 con 0x7fe3bc06fea0 2024-09-19T05:36:24.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3bb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc15b1d0 0x7fe3bc09ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3bb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc15b1d0 0x7fe3bc09ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47574/0 (socket says 172.21.15.67:47574) 2024-09-19T05:36:24.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3bb7fe640 1 -- 172.21.15.67:0/759299439 learned_addr learned my addr 172.21.15.67:0/759299439 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:24.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3ba7fc640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3bc06fea0 0x7fe3bc09c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3baffd640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3bc06dfc0 0x7fe3bc150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3bb7fe640 1 -- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3bc06fea0 msgr2=0x7fe3bc09c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3bb7fe640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3bc06fea0 0x7fe3bc09c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3bb7fe640 1 -- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3bc06dfc0 msgr2=0x7fe3bc150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3bb7fe640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3bc06dfc0 0x7fe3bc150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3bb7fe640 1 -- 172.21.15.67:0/759299439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc15e870 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3baffd640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3bc06dfc0 0x7fe3bc150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:24.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3bb7fe640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc15b1d0 0x7fe3bc09ce00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40b0040 tx=0x7fe3b4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:24.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3a37fe640 1 -- 172.21.15.67:0/759299439 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40b2050 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3a37fe640 1 -- 172.21.15.67:0/759299439 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b40be070 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- 172.21.15.67:0/759299439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3bc09d440 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3a37fe640 1 -- 172.21.15.67:0/759299439 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40ada70 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.794+0000 7fe3c137d640 1 -- 172.21.15.67:0/759299439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3bc09da00 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.798+0000 7fe3c137d640 1 -- 172.21.15.67:0/759299439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3bc09e1e0 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.798+0000 7fe3a37fe640 1 -- 172.21.15.67:0/759299439 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3b40adc10 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.798+0000 7fe3a37fe640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3a80678c0 0x7fe3a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:24.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.798+0000 7fe3a37fe640 1 -- 172.21.15.67:0/759299439 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7fe3b4120ce0 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.798+0000 7fe3baffd640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3a80678c0 0x7fe3a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:24.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.798+0000 7fe3baffd640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3a80678c0 0x7fe3a8069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0000f70 tx=0x7fe3b0007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:24.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.802+0000 7fe3a37fe640 1 -- 172.21.15.67:0/759299439 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe3b4016560 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.962+0000 7fe3c137d640 1 -- 172.21.15.67:0/759299439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe3bc165810 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.962+0000 7fe3a37fe640 1 -- 172.21.15.67:0/759299439 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7fe3b40f1a20 con 0x7fe3bc15b1d0 2024-09-19T05:36:24.968 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:36:24.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 -- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3a80678c0 msgr2=0x7fe3a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3a80678c0 0x7fe3a8069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0000f70 tx=0x7fe3b0007c40 comp rx=0 tx=0).stop 2024-09-19T05:36:24.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 -- 172.21.15.67:0/759299439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc15b1d0 msgr2=0x7fe3bc09ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:24.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc15b1d0 0x7fe3bc09ce00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40b0040 tx=0x7fe3b4019710 comp rx=0 tx=0).stop 2024-09-19T05:36:24.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 -- 172.21.15.67:0/759299439 shutdown_connections 2024-09-19T05:36:24.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3bc15b1d0 0x7fe3bc09ce00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3a80678c0 0x7fe3a8069d80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3bc06fea0 0x7fe3bc09c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 --2- 172.21.15.67:0/759299439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3bc06dfc0 0x7fe3bc150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:24.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 -- 172.21.15.67:0/759299439 >> 172.21.15.67:0/759299439 conn(0x7fe3bc0b1e50 msgr2=0x7fe3bc06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:24.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 -- 172.21.15.67:0/759299439 shutdown_connections 2024-09-19T05:36:24.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:24.966+0000 7fe3c137d640 1 -- 172.21.15.67:0/759299439 wait complete. 2024-09-19T05:36:24.984 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-19T05:36:25.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.094+0000 7f95d7a2c640 1 Processor -- start 2024-09-19T05:36:25.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.094+0000 7f95d7a2c640 1 -- start start 2024-09-19T05:36:25.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.094+0000 7f95d7a2c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d0159d60 0x7f95d006ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:25.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.094+0000 7f95d7a2c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f95d006f460 0x7f95d00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:25.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.094+0000 7f95d7a2c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d006de80 con 0x7f95d00b3510 2024-09-19T05:36:25.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.094+0000 7f95d7a2c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f95d006e160 con 0x7f95d006f460 2024-09-19T05:36:25.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.094+0000 7f95d7a2c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f95d006e440 con 0x7f95d0159d60 2024-09-19T05:36:25.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.094+0000 7f95d4fc7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f95d006f460 0x7f95d00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:25.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.094+0000 7f95d5fc9640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f95d00b3510 0x7f95d00acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56896/0 (socket says 172.21.15.67:56896) 2024-09-19T05:36:25.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.094+0000 7f95d5fc9640 1 -- 172.21.15.67:0/81013268 learned_addr learned my addr 172.21.15.67:0/81013268 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:25.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d57c8640 1 --2- 172.21.15.67:0/81013268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d0159d60 0x7f95d006ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:25.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d4fc7640 1 -- 172.21.15.67:0/81013268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d0159d60 msgr2=0x7f95d006ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:25.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d4fc7640 1 --2- 172.21.15.67:0/81013268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d0159d60 0x7f95d006ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:25.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d4fc7640 1 -- 172.21.15.67:0/81013268 >> v1:172.21.15.67:6789/0 conn(0x7f95d00b3510 legacy=0x7f95d00acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:25.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95c7fff640 1 -- 172.21.15.67:0/81013268 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 84110151 0 0) 0x7f95d006de80 con 0x7f95d00b3510 2024-09-19T05:36:25.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d4fc7640 1 -- 172.21.15.67:0/81013268 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d006e720 con 0x7f95d006f460 2024-09-19T05:36:25.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d57c8640 1 --2- 172.21.15.67:0/81013268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d0159d60 0x7f95d006ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:25.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d4fc7640 1 --2- 172.21.15.67:0/81013268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d006f460 0x7f95d00b2fd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f95c00097c0 tx=0x7f95c001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b8585fdc836627 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:25.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95c7fff640 1 -- 172.21.15.67:0/81013268 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c00b0070 con 0x7f95d006f460 2024-09-19T05:36:25.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95c7fff640 1 -- 172.21.15.67:0/81013268 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c00ab600 con 0x7f95d006f460 2024-09-19T05:36:25.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95c7fff640 1 -- 172.21.15.67:0/81013268 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c00ab9d0 con 0x7f95d006f460 2024-09-19T05:36:25.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d7a2c640 1 -- 172.21.15.67:0/81013268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d006f460 msgr2=0x7f95d00b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d7a2c640 1 --2- 172.21.15.67:0/81013268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d006f460 0x7f95d00b2fd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f95c00097c0 tx=0x7f95c001c4a0 comp rx=0 tx=0).stop 2024-09-19T05:36:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d7a2c640 1 -- 172.21.15.67:0/81013268 shutdown_connections 2024-09-19T05:36:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d7a2c640 1 --2- 172.21.15.67:0/81013268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d006f460 0x7f95d00b2fd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d7a2c640 1 --2- 172.21.15.67:0/81013268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d0159d60 0x7f95d006ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d7a2c640 1 -- 172.21.15.67:0/81013268 >> 172.21.15.67:0/81013268 conn(0x7f95d00d0080 msgr2=0x7f95d00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d7a2c640 1 -- 172.21.15.67:0/81013268 shutdown_connections 2024-09-19T05:36:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.098+0000 7f95d7a2c640 1 -- 172.21.15.67:0/81013268 wait complete. 2024-09-19T05:36:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 Processor -- start 2024-09-19T05:36:25.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 -- start start 2024-09-19T05:36:25.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d006f460 0x7f95d014ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d00b3510 0x7f95d01586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95d0159d60 0x7f95d014a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f95d00af6b0 con 0x7f95d00b3510 2024-09-19T05:36:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f95d00ad8d0 con 0x7f95d0159d60 2024-09-19T05:36:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f95d00af830 con 0x7f95d006f460 2024-09-19T05:36:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d4fc7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d00b3510 0x7f95d01586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d4fc7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d00b3510 0x7f95d01586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47592/0 (socket says 172.21.15.67:47592) 2024-09-19T05:36:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d4fc7640 1 -- 172.21.15.67:0/1912845442 learned_addr learned my addr 172.21.15.67:0/1912845442 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d4fc7640 1 -- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d006f460 msgr2=0x7f95d014ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d57c8640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d006f460 0x7f95d014ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d5fc9640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95d0159d60 0x7f95d014a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d4fc7640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d006f460 0x7f95d014ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d4fc7640 1 -- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95d0159d60 msgr2=0x7f95d014a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d4fc7640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95d0159d60 0x7f95d014a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d4fc7640 1 -- 172.21.15.67:0/1912845442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d0158c30 con 0x7f95d00b3510 2024-09-19T05:36:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d4fc7640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d00b3510 0x7f95d01586f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f95c00097c0 tx=0x7f95c0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95c5ffb640 1 -- 172.21.15.67:0/1912845442 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c00b0040 con 0x7f95d00b3510 2024-09-19T05:36:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95c5ffb640 1 -- 172.21.15.67:0/1912845442 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c0004020 con 0x7f95d00b3510 2024-09-19T05:36:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 -- 172.21.15.67:0/1912845442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d014f270 con 0x7f95d00b3510 2024-09-19T05:36:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95c5ffb640 1 -- 172.21.15.67:0/1912845442 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0004430 con 0x7f95d00b3510 2024-09-19T05:36:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 -- 172.21.15.67:0/1912845442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d014f830 con 0x7f95d00b3510 2024-09-19T05:36:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.102+0000 7f95d7a2c640 1 -- 172.21.15.67:0/1912845442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d00b2fd0 con 0x7f95d00b3510 2024-09-19T05:36:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.106+0000 7f95c5ffb640 1 -- 172.21.15.67:0/1912845442 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f95c0003620 con 0x7f95d00b3510 2024-09-19T05:36:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.106+0000 7f95c5ffb640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95b40678c0 0x7f95b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.106+0000 7f95c5ffb640 1 -- 172.21.15.67:0/1912845442 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f95c011fb10 con 0x7f95d00b3510 2024-09-19T05:36:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.106+0000 7f95d57c8640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95b40678c0 0x7f95b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.106+0000 7f95d57c8640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95b40678c0 0x7f95b4069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f95cc006fd0 tx=0x7f95cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:25.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.110+0000 7f95c5ffb640 1 -- 172.21.15.67:0/1912845442 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f95c00c1030 con 0x7f95d00b3510 2024-09-19T05:36:25.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:25.334+0000 7f95d7a2c640 1 -- 172.21.15.67:0/1912845442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f95d014df60 con 0x7f95d00b3510 2024-09-19T05:36:26.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95c5ffb640 1 -- 172.21.15.67:0/1912845442 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v150) ==== 146+0+0 (secure 0 0 0) 0x7f95c00b8030 con 0x7f95d00b3510 2024-09-19T05:36:26.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 -- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95b40678c0 msgr2=0x7f95b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:26.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95b40678c0 0x7f95b4069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f95cc006fd0 tx=0x7f95cc008040 comp rx=0 tx=0).stop 2024-09-19T05:36:26.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 -- 172.21.15.67:0/1912845442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d00b3510 msgr2=0x7f95d01586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:26.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d00b3510 0x7f95d01586f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f95c00097c0 tx=0x7f95c0019240 comp rx=0 tx=0).stop 2024-09-19T05:36:26.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 -- 172.21.15.67:0/1912845442 shutdown_connections 2024-09-19T05:36:26.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95d0159d60 0x7f95d014a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95d00b3510 0x7f95d01586f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95b40678c0 0x7f95b4069d80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 --2- 172.21.15.67:0/1912845442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95d006f460 0x7f95d014ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 -- 172.21.15.67:0/1912845442 >> 172.21.15.67:0/1912845442 conn(0x7f95d00d0080 msgr2=0x7f95d00adc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:26.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 -- 172.21.15.67:0/1912845442 shutdown_connections 2024-09-19T05:36:26.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.302+0000 7f95d7a2c640 1 -- 172.21.15.67:0/1912845442 wait complete. 2024-09-19T05:36:26.328 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:36:26.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d1dba7640 1 Processor -- start 2024-09-19T05:36:26.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d1dba7640 1 -- start start 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d1dba7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d1806ffd0 0x7f7d180aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d1dba7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d180ad840 con 0x7f7d18159c60 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d1dba7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d1815a040 con 0x7f7d180b3150 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d1dba7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1815d460 con 0x7f7d1806ffd0 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d177fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7d18159c60 0x7f7d180ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46034/0 (socket says 172.21.15.67:46034) 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d177fe640 1 -- 172.21.15.67:0/3407137078 learned_addr learned my addr 172.21.15.67:0/3407137078 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d16ffd640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d1806ffd0 0x7f7d180aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2426832372 0 0) 0x7f7d180ad840 con 0x7f7d18159c60 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d00003530 con 0x7f7d18159c60 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2800232500 0 0) 0x7f7d00003530 con 0x7f7d18159c60 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d1806ffd0 msgr2=0x7f7d180aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d1806ffd0 0x7f7d180aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 >> v1:172.21.15.97:6789/0 conn(0x7f7d180b3150 legacy=0x7f7d1815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1815c850 con 0x7f7d18159c60 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7d08001a00 con 0x7f7d18159c60 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 >> v1:172.21.15.67:6789/0 conn(0x7f7d18159c60 legacy=0x7f7d180ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d000039f0 0x7f7d00003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 0x7f7d00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d1806ffd0 0x7f7d000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1815d460 con 0x7f7d00004810 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0000bae0 con 0x7f7d000039f0 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0000bce0 con 0x7f7d1806ffd0 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d16ffd640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 0x7f7d00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d177fe640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d000039f0 0x7f7d00003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d17fff640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d1806ffd0 0x7f7d000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d16ffd640 1 -- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d1806ffd0 msgr2=0x7f7d000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d16ffd640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d1806ffd0 0x7f7d000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d16ffd640 1 -- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d000039f0 msgr2=0x7f7d00003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d16ffd640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d000039f0 0x7f7d00003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.458+0000 7f7d16ffd640 1 -- 172.21.15.67:0/3407137078 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d00003530 con 0x7f7d00004810 2024-09-19T05:36:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d16ffd640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 0x7f7d00004c90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7d180adba0 tx=0x7f7d0c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b952316aa2d2ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c0b2070 con 0x7f7d00004810 2024-09-19T05:36:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0a5590 con 0x7f7d00004810 2024-09-19T05:36:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d167fc640 1 -- 172.21.15.67:0/3407137078 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c009690 con 0x7f7d00004810 2024-09-19T05:36:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d1dba7640 1 -- 172.21.15.67:0/3407137078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 msgr2=0x7f7d00004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d1dba7640 1 --2- 172.21.15.67:0/3407137078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 0x7f7d00004c90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7d180adba0 tx=0x7f7d0c01c9a0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d17fff640 1 -- 172.21.15.67:0/3407137078 reap_dead start 2024-09-19T05:36:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d1dba7640 1 -- 172.21.15.67:0/3407137078 shutdown_connections 2024-09-19T05:36:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d1dba7640 1 -- 172.21.15.67:0/3407137078 >> 172.21.15.67:0/3407137078 conn(0x7f7d180b1e50 msgr2=0x7f7d180b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d1dba7640 1 -- 172.21.15.67:0/3407137078 shutdown_connections 2024-09-19T05:36:26.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d1dba7640 1 -- 172.21.15.67:0/3407137078 wait complete. 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d1dba7640 1 Processor -- start 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.462+0000 7f7d1dba7640 1 -- start start 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d1dba7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d1814b540 0x7f7d1815e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d1dba7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d181f5a20 0x7f7d181f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d1dba7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d18153220 0x7f7d181536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d1dba7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1815d0f0 con 0x7f7d181f5a20 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d1dba7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1815ce10 con 0x7f7d1814b540 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d1dba7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d181604d0 con 0x7f7d18153220 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d16ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d181f5a20 0x7f7d181f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d16ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d181f5a20 0x7f7d181f5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45378/0 (socket says 172.21.15.67:45378) 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d16ffd640 1 -- 172.21.15.67:0/586639946 learned_addr learned my addr 172.21.15.67:0/586639946 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d177fe640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d1814b540 0x7f7d1815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d17fff640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d18153220 0x7f7d181536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d16ffd640 1 -- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d18153220 msgr2=0x7f7d181536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d16ffd640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d18153220 0x7f7d181536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d16ffd640 1 -- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d1814b540 msgr2=0x7f7d1815e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d16ffd640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d1814b540 0x7f7d1815e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d16ffd640 1 -- 172.21.15.67:0/586639946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1814b920 con 0x7f7d181f5a20 2024-09-19T05:36:26.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d17fff640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d18153220 0x7f7d181536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:26.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d177fe640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d1814b540 0x7f7d1815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:26.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d16ffd640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d181f5a20 0x7f7d181f5e80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c01c7d0 tx=0x7f7d0c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:26.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7cfffff640 1 -- 172.21.15.67:0/586639946 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c0b2040 con 0x7f7d181f5a20 2024-09-19T05:36:26.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7cfffff640 1 -- 172.21.15.67:0/586639946 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0b8440 con 0x7f7d181f5a20 2024-09-19T05:36:26.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d1dba7640 1 -- 172.21.15.67:0/586639946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1815ecc0 con 0x7f7d181f5a20 2024-09-19T05:36:26.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7cfffff640 1 -- 172.21.15.67:0/586639946 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c009690 con 0x7f7d181f5a20 2024-09-19T05:36:26.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d1dba7640 1 -- 172.21.15.67:0/586639946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1815f270 con 0x7f7d181f5a20 2024-09-19T05:36:26.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d1dba7640 1 -- 172.21.15.67:0/586639946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d18160860 con 0x7f7d181f5a20 2024-09-19T05:36:26.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7cfffff640 1 -- 172.21.15.67:0/586639946 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d0c0bf060 con 0x7f7d181f5a20 2024-09-19T05:36:26.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7cfffff640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d040678f0 0x7f7d04069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:26.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7cfffff640 1 -- 172.21.15.67:0/586639946 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f7d0c11f200 con 0x7f7d181f5a20 2024-09-19T05:36:26.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.466+0000 7f7d177fe640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d040678f0 0x7f7d04069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:26.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.470+0000 7f7d177fe640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d040678f0 0x7f7d04069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7d08000f90 tx=0x7f7d08001260 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:26.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.470+0000 7f7cfffff640 1 -- 172.21.15.67:0/586639946 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7d0c0166e0 con 0x7f7d181f5a20 2024-09-19T05:36:26.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.634+0000 7f7d1dba7640 1 -- 172.21.15.67:0/586639946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7d1814bb50 con 0x7f7d181f5a20 2024-09-19T05:36:26.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.638+0000 7f7cfffff640 1 -- 172.21.15.67:0/586639946 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f7d0c0efe90 con 0x7f7d181f5a20 2024-09-19T05:36:26.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 -- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d040678f0 msgr2=0x7f7d04069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:26.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d040678f0 0x7f7d04069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7d08000f90 tx=0x7f7d08001260 comp rx=0 tx=0).stop 2024-09-19T05:36:26.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 -- 172.21.15.67:0/586639946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d181f5a20 msgr2=0x7f7d181f5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:26.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d181f5a20 0x7f7d181f5e80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c01c7d0 tx=0x7f7d0c019740 comp rx=0 tx=0).stop 2024-09-19T05:36:26.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 -- 172.21.15.67:0/586639946 shutdown_connections 2024-09-19T05:36:26.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d040678f0 0x7f7d04069db0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d18153220 0x7f7d181536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d181f5a20 0x7f7d181f5e80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 --2- 172.21.15.67:0/586639946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d1814b540 0x7f7d1815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:26.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 -- 172.21.15.67:0/586639946 >> 172.21.15.67:0/586639946 conn(0x7f7d180b1e50 msgr2=0x7f7d1806f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:26.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 -- 172.21.15.67:0/586639946 shutdown_connections 2024-09-19T05:36:26.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:26.642+0000 7f7d1dba7640 1 -- 172.21.15.67:0/586639946 wait complete. 2024-09-19T05:36:26.664 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:36:26.664 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:36:26.749 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:36:26.828 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:36:26.829 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:36:26.829 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:36:26.835 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:36:26.835 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:36:26.835 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:36:26.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:36:26.840 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:36:26.840 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:36:26.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:36:26.881 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:36:26.882 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:36:26.887 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:36:26.887 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:36:26.887 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:36:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f7e42640 1 Processor -- start 2024-09-19T05:36:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f7e42640 1 -- start start 2024-09-19T05:36:27.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f7e42640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f59f006dde0 0x7f59f00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f7e42640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59f00b3510 0x7f59f006f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f7e42640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f006e3c0 con 0x7f59f015c030 2024-09-19T05:36:27.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f7e42640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f59f006e6a0 con 0x7f59f006dde0 2024-09-19T05:36:27.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f7e42640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f59f006e980 con 0x7f59f00b3510 2024-09-19T05:36:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f53dd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f59f006dde0 0x7f59f00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f53dd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f59f006dde0 0x7f59f00b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45392/0 (socket says 172.21.15.67:45392) 2024-09-19T05:36:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f53dd640 1 -- 172.21.15.67:0/2581197625 learned_addr learned my addr 172.21.15.67:0/2581197625 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:27.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f63df640 1 --2- 172.21.15.67:0/2581197625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59f00b3510 0x7f59f006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f53dd640 1 -- 172.21.15.67:0/2581197625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59f00b3510 msgr2=0x7f59f006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:27.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f53dd640 1 --2- 172.21.15.67:0/2581197625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59f00b3510 0x7f59f006f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f53dd640 1 -- 172.21.15.67:0/2581197625 >> v1:172.21.15.97:6789/0 conn(0x7f59f015c030 legacy=0x7f59f015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:27.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.050+0000 7f59f53dd640 1 -- 172.21.15.67:0/2581197625 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f006ec60 con 0x7f59f006dde0 2024-09-19T05:36:27.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f53dd640 1 --2- 172.21.15.67:0/2581197625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f006dde0 0x7f59f00b2fd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009870 tx=0x7f59e001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61672217ee7e055 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:27.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f4bdc640 1 -- 172.21.15.67:0/2581197625 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e00ab640 con 0x7f59f006dde0 2024-09-19T05:36:27.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f4bdc640 1 -- 172.21.15.67:0/2581197625 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e00b0070 con 0x7f59f006dde0 2024-09-19T05:36:27.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f4bdc640 1 -- 172.21.15.67:0/2581197625 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e00aba00 con 0x7f59f006dde0 2024-09-19T05:36:27.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 -- 172.21.15.67:0/2581197625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f006dde0 msgr2=0x7f59f00b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 --2- 172.21.15.67:0/2581197625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f006dde0 0x7f59f00b2fd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009870 tx=0x7f59e001c530 comp rx=0 tx=0).stop 2024-09-19T05:36:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 -- 172.21.15.67:0/2581197625 shutdown_connections 2024-09-19T05:36:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 --2- 172.21.15.67:0/2581197625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59f00b3510 0x7f59f006f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 --2- 172.21.15.67:0/2581197625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f006dde0 0x7f59f00b2fd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 -- 172.21.15.67:0/2581197625 >> 172.21.15.67:0/2581197625 conn(0x7f59f00d0080 msgr2=0x7f59f00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 -- 172.21.15.67:0/2581197625 shutdown_connections 2024-09-19T05:36:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 -- 172.21.15.67:0/2581197625 wait complete. 2024-09-19T05:36:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 Processor -- start 2024-09-19T05:36:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 -- start start 2024-09-19T05:36:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59f006dde0 0x7f59f014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f00b3510 0x7f59f0151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59f015c030 0x7f59f0152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f59f01692f0 con 0x7f59f00b3510 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f59f015c620 con 0x7f59f015c030 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f7e42640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f59f0169470 con 0x7f59f006dde0 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f53dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f00b3510 0x7f59f0151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f53dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f00b3510 0x7f59f0151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45402/0 (socket says 172.21.15.67:45402) 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f53dd640 1 -- 172.21.15.67:0/3336218112 learned_addr learned my addr 172.21.15.67:0/3336218112 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f63df640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59f015c030 0x7f59f0152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f53dd640 1 -- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59f006dde0 msgr2=0x7f59f014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f5bde640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59f006dde0 0x7f59f014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f53dd640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59f006dde0 0x7f59f014f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f53dd640 1 -- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59f015c030 msgr2=0x7f59f0152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:27.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f53dd640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59f015c030 0x7f59f0152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f53dd640 1 -- 172.21.15.67:0/3336218112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f00cfb70 con 0x7f59f00b3510 2024-09-19T05:36:27.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.054+0000 7f59f63df640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59f015c030 0x7f59f0152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:27.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59f53dd640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f00b3510 0x7f59f0151e00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f59e00ad040 tx=0x7f59e001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:27.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59e67fc640 1 -- 172.21.15.67:0/3336218112 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e00be3f0 con 0x7f59f00b3510 2024-09-19T05:36:27.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59e67fc640 1 -- 172.21.15.67:0/3336218112 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e00be590 con 0x7f59f00b3510 2024-09-19T05:36:27.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59f7e42640 1 -- 172.21.15.67:0/3336218112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f01505e0 con 0x7f59f00b3510 2024-09-19T05:36:27.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59e67fc640 1 -- 172.21.15.67:0/3336218112 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e00be980 con 0x7f59f00b3510 2024-09-19T05:36:27.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59f7e42640 1 -- 172.21.15.67:0/3336218112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f0150020 con 0x7f59f00b3510 2024-09-19T05:36:27.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59f7e42640 1 -- 172.21.15.67:0/3336218112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f00b2fd0 con 0x7f59f00b3510 2024-09-19T05:36:27.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59e67fc640 1 -- 172.21.15.67:0/3336218112 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59e00b43f0 con 0x7f59f00b3510 2024-09-19T05:36:27.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59e67fc640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59d40678c0 0x7f59d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59e67fc640 1 -- 172.21.15.67:0/3336218112 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f59e011ffe0 con 0x7f59f00b3510 2024-09-19T05:36:27.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59f5bde640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59d40678c0 0x7f59d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.058+0000 7f59f5bde640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59d40678c0 0x7f59d4069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f59ec007fd0 tx=0x7f59ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:27.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.062+0000 7f59e67fc640 1 -- 172.21.15.67:0/3336218112 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f59e00c4060 con 0x7f59f00b3510 2024-09-19T05:36:27.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.262+0000 7f59f7e42640 1 -- 172.21.15.67:0/3336218112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59f00d0f20 con 0x7f59f00b3510 2024-09-19T05:36:27.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59e67fc640 1 -- 172.21.15.67:0/3336218112 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3908 (secure 0 0 0) 0x7f59e0016150 con 0x7f59f00b3510 2024-09-19T05:36:27.268 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":18,"btime":"2024-09-19T05:36:21:146525+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2848495891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2848495891},{"type":"v1","addr":"172.21.15.97:6835","nonce":2848495891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4741,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2818377677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2818377677},{"type":"v1","addr":"172.21.15.97:6837","nonce":2818377677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4887,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/244834094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":244834094},{"type":"v1","addr":"172.21.15.67:6834","nonce":244834094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1956717091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1956717091},{"type":"v1","addr":"172.21.15.67:6835","nonce":1956717091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-09-19T05:36:27.269 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 18 2024-09-19T05:36:27.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 -- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59d40678c0 msgr2=0x7f59d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:27.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59d40678c0 0x7f59d4069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f59ec007fd0 tx=0x7f59ec009040 comp rx=0 tx=0).stop 2024-09-19T05:36:27.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 -- 172.21.15.67:0/3336218112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f00b3510 msgr2=0x7f59f0151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:27.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f00b3510 0x7f59f0151e00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f59e00ad040 tx=0x7f59e001ad70 comp rx=0 tx=0).stop 2024-09-19T05:36:27.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 -- 172.21.15.67:0/3336218112 shutdown_connections 2024-09-19T05:36:27.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59f015c030 0x7f59f0152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59f00b3510 0x7f59f0151e00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59d40678c0 0x7f59d4069d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 --2- 172.21.15.67:0/3336218112 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59f006dde0 0x7f59f014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 -- 172.21.15.67:0/3336218112 >> 172.21.15.67:0/3336218112 conn(0x7f59f00d0080 msgr2=0x7f59f00b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:27.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 -- 172.21.15.67:0/3336218112 shutdown_connections 2024-09-19T05:36:27.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.266+0000 7f59f7e42640 1 -- 172.21.15.67:0/3336218112 wait complete. 2024-09-19T05:36:27.289 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:36:27.289 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:36:27.289 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:36:27.290 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:36:27.290 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:36:27.290 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:36:27.290 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:36:27.290 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:36:27.290 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:36:27.290 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:36:27.291 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:36:27.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:36:27.291 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:36:27.291 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:36:27.291 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:36:27.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:36:27.300 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:36:27.300 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:36:27.301 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:36:27.301 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:36:27.304 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:36:27.304 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:36:27.305 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:36:27.305 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:36:27.348 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:36:27.349 DEBUG:teuthology.parallel:result is None 2024-09-19T05:36:27.350 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:36:27.350 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:36:27.350 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:36:27.350 DEBUG:teuthology.parallel:result is None 2024-09-19T05:36:27.350 DEBUG:teuthology.parallel:result is None 2024-09-19T05:36:27.351 DEBUG:teuthology.parallel:result is None 2024-09-19T05:36:27.351 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:36:27.412 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:36:27.418 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:36:27.419 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:36:27.419 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:36:27.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8af0523640 1 Processor -- start 2024-09-19T05:36:27.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8af0523640 1 -- start start 2024-09-19T05:36:27.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8af0523640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ae8161da0 0x7f8ae80d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8af0523640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8ae80d0e80 0x7f8ae80d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8af0523640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8ae80b41c0 0x7f8ae80b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8af0523640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8ae80d0840 con 0x7f8ae80b41c0 2024-09-19T05:36:27.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8af0523640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8ae80d1800 con 0x7f8ae80d0e80 2024-09-19T05:36:27.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8af0523640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae80d4d40 con 0x7f8ae8161da0 2024-09-19T05:36:27.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aeeac0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8ae80b41c0 0x7f8ae80b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aeeac0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8ae80b41c0 0x7f8ae80b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45440/0 (socket says 172.21.15.67:45440) 2024-09-19T05:36:27.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aeeac0640 1 -- 172.21.15.67:0/329907928 learned_addr learned my addr 172.21.15.67:0/329907928 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:27.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aee2bf640 1 --2- 172.21.15.67:0/329907928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ae8161da0 0x7f8ae80d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aedabe640 1 --2- 172.21.15.67:0/329907928 >> v2:172.21.15.97:3300/0 conn(0x7f8ae80d0e80 0x7f8ae80d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aeeac0640 1 -- 172.21.15.67:0/329907928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ae8161da0 msgr2=0x7f8ae80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:27.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aeeac0640 1 --2- 172.21.15.67:0/329907928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ae8161da0 0x7f8ae80d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aeeac0640 1 -- 172.21.15.67:0/329907928 >> v2:172.21.15.97:3300/0 conn(0x7f8ae80d0e80 msgr2=0x7f8ae80d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:27.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aeeac0640 1 --2- 172.21.15.67:0/329907928 >> v2:172.21.15.97:3300/0 conn(0x7f8ae80d0e80 0x7f8ae80d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aeeac0640 1 -- 172.21.15.67:0/329907928 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae80d5020 con 0x7f8ae80b41c0 2024-09-19T05:36:27.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.470+0000 7f8aedabe640 1 --2- 172.21.15.67:0/329907928 >> v2:172.21.15.97:3300/0 conn(0x7f8ae80d0e80 0x7f8ae80d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8aeeac0640 1 --2- 172.21.15.67:0/329907928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae80b41c0 0x7f8ae80b4670 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8ae808d460 tx=0x7f8ae001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321869b8f928f129 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8aed2bd640 1 -- 172.21.15.67:0/329907928 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00a5760 con 0x7f8ae80b41c0 2024-09-19T05:36:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8aed2bd640 1 -- 172.21.15.67:0/329907928 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae00a5900 con 0x7f8ae80b41c0 2024-09-19T05:36:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8aed2bd640 1 -- 172.21.15.67:0/329907928 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00a5cd0 con 0x7f8ae80b41c0 2024-09-19T05:36:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 -- 172.21.15.67:0/329907928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae80b41c0 msgr2=0x7f8ae80b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 --2- 172.21.15.67:0/329907928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae80b41c0 0x7f8ae80b4670 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8ae808d460 tx=0x7f8ae001c9f0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 -- 172.21.15.67:0/329907928 shutdown_connections 2024-09-19T05:36:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 --2- 172.21.15.67:0/329907928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae80b41c0 0x7f8ae80b4670 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 --2- 172.21.15.67:0/329907928 >> v2:172.21.15.97:3300/0 conn(0x7f8ae80d0e80 0x7f8ae80d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 --2- 172.21.15.67:0/329907928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ae8161da0 0x7f8ae80d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 -- 172.21.15.67:0/329907928 >> 172.21.15.67:0/329907928 conn(0x7f8ae808bfc0 msgr2=0x7f8ae80d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 -- 172.21.15.67:0/329907928 shutdown_connections 2024-09-19T05:36:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 -- 172.21.15.67:0/329907928 wait complete. 2024-09-19T05:36:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 Processor -- start 2024-09-19T05:36:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 -- start start 2024-09-19T05:36:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ae80b41c0 0x7f8ae8153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae80d0e80 0x7f8ae80cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae8161da0 0x7f8ae81575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae80cf150 con 0x7f8ae8161da0 2024-09-19T05:36:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae8162180 con 0x7f8ae80d0e80 2024-09-19T05:36:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8af0523640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae80cf2d0 con 0x7f8ae80b41c0 2024-09-19T05:36:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8aeeac0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae8161da0 0x7f8ae81575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8aeeac0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae8161da0 0x7f8ae81575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45454/0 (socket says 172.21.15.67:45454) 2024-09-19T05:36:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.474+0000 7f8aeeac0640 1 -- 172.21.15.67:0/3024229578 learned_addr learned my addr 172.21.15.67:0/3024229578 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8aedabe640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae80d0e80 0x7f8ae80cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8aee2bf640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ae80b41c0 0x7f8ae8153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8aeeac0640 1 -- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ae80b41c0 msgr2=0x7f8ae8153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8aeeac0640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ae80b41c0 0x7f8ae8153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8aeeac0640 1 -- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae80d0e80 msgr2=0x7f8ae80cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8aeeac0640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae80d0e80 0x7f8ae80cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8aeeac0640 1 -- 172.21.15.67:0/3024229578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae80b2050 con 0x7f8ae8161da0 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8aeeac0640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae8161da0 0x7f8ae81575a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8ae001d290 tx=0x7f8ae0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8adeffd640 1 -- 172.21.15.67:0/3024229578 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00bc020 con 0x7f8ae8161da0 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8adeffd640 1 -- 172.21.15.67:0/3024229578 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae00b8670 con 0x7f8ae8161da0 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8af0523640 1 -- 172.21.15.67:0/3024229578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae80b1d70 con 0x7f8ae8161da0 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8adeffd640 1 -- 172.21.15.67:0/3024229578 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00b8a60 con 0x7f8ae8161da0 2024-09-19T05:36:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8af0523640 1 -- 172.21.15.67:0/3024229578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae80cd050 con 0x7f8ae8161da0 2024-09-19T05:36:27.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8af0523640 1 -- 172.21.15.67:0/3024229578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae80b4670 con 0x7f8ae8161da0 2024-09-19T05:36:27.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8adeffd640 1 -- 172.21.15.67:0/3024229578 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ae00bf020 con 0x7f8ae8161da0 2024-09-19T05:36:27.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8adeffd640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8acc0678c0 0x7f8acc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:27.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8adeffd640 1 -- 172.21.15.67:0/3024229578 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f8ae0120b70 con 0x7f8ae8161da0 2024-09-19T05:36:27.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8aee2bf640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8acc0678c0 0x7f8acc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:27.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.478+0000 7f8aee2bf640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8acc0678c0 0x7f8acc069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80b25a0 tx=0x7f8ae4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.482+0000 7f8adeffd640 1 -- 172.21.15.67:0/3024229578 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8ae00c6030 con 0x7f8ae8161da0 2024-09-19T05:36:27.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:27.662+0000 7f8af0523640 1 -- 172.21.15.67:0/3024229578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8ae80b2220 con 0x7f8ae8161da0 2024-09-19T05:36:28.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.662+0000 7f8adeffd640 1 -- 172.21.15.67:0/3024229578 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) ==== 97+0+0 (secure 0 0 0) 0x7f8ae00165e0 con 0x7f8ae8161da0 2024-09-19T05:36:28.666 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:36:28.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 -- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8acc0678c0 msgr2=0x7f8acc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:28.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8acc0678c0 0x7f8acc069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80b25a0 tx=0x7f8ae4008040 comp rx=0 tx=0).stop 2024-09-19T05:36:28.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 -- 172.21.15.67:0/3024229578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae8161da0 msgr2=0x7f8ae81575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae8161da0 0x7f8ae81575a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8ae001d290 tx=0x7f8ae0019790 comp rx=0 tx=0).stop 2024-09-19T05:36:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 -- 172.21.15.67:0/3024229578 shutdown_connections 2024-09-19T05:36:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae8161da0 0x7f8ae81575a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae80d0e80 0x7f8ae80cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8acc0678c0 0x7f8acc069d80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 --2- 172.21.15.67:0/3024229578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ae80b41c0 0x7f8ae8153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:28.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 -- 172.21.15.67:0/3024229578 >> 172.21.15.67:0/3024229578 conn(0x7f8ae808bfc0 msgr2=0x7f8ae806ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:28.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 -- 172.21.15.67:0/3024229578 shutdown_connections 2024-09-19T05:36:28.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.666+0000 7f8af0523640 1 -- 172.21.15.67:0/3024229578 wait complete. 2024-09-19T05:36:28.692 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:36:28.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.814+0000 7ff747e44640 1 Processor -- start 2024-09-19T05:36:28.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.814+0000 7ff747e44640 1 -- start start 2024-09-19T05:36:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff747e44640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff74015fcf0 0x7ff7400b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff747e44640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff7401609b0 0x7ff7401600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff747e44640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff740160610 con 0x7ff7400afee0 2024-09-19T05:36:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff747e44640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff7400b5cf0 con 0x7ff74015fcf0 2024-09-19T05:36:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff747e44640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff7400b4710 con 0x7ff7401609b0 2024-09-19T05:36:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff745be0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff74015fcf0 0x7ff7400b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff745be0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff74015fcf0 0x7ff7400b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45466/0 (socket says 172.21.15.67:45466) 2024-09-19T05:36:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff745be0640 1 -- 172.21.15.67:0/1038171240 learned_addr learned my addr 172.21.15.67:0/1038171240 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff7453df640 1 --2- 172.21.15.67:0/1038171240 >> v2:172.21.15.97:3300/0 conn(0x7ff7401609b0 0x7ff7401600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff745be0640 1 -- 172.21.15.67:0/1038171240 >> v2:172.21.15.97:3300/0 conn(0x7ff7401609b0 msgr2=0x7ff7401600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff745be0640 1 --2- 172.21.15.67:0/1038171240 >> v2:172.21.15.97:3300/0 conn(0x7ff7401609b0 0x7ff7401600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff745be0640 1 -- 172.21.15.67:0/1038171240 >> v1:172.21.15.97:6789/0 conn(0x7ff7400afee0 legacy=0x7ff74015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.818+0000 7ff745be0640 1 -- 172.21.15.67:0/1038171240 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7400b49f0 con 0x7ff74015fcf0 2024-09-19T05:36:28.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff745be0640 1 --2- 172.21.15.67:0/1038171240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff74015fcf0 0x7ff7400b57b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff7400b60b0 tx=0x7ff73001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6cecbf12a53f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff744bde640 1 -- 172.21.15.67:0/1038171240 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7300a57f0 con 0x7ff74015fcf0 2024-09-19T05:36:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff744bde640 1 -- 172.21.15.67:0/1038171240 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7300a5990 con 0x7ff74015fcf0 2024-09-19T05:36:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff744bde640 1 -- 172.21.15.67:0/1038171240 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7300a5d60 con 0x7ff74015fcf0 2024-09-19T05:36:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff747e44640 1 -- 172.21.15.67:0/1038171240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff74015fcf0 msgr2=0x7ff7400b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff747e44640 1 --2- 172.21.15.67:0/1038171240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff74015fcf0 0x7ff7400b57b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff7400b60b0 tx=0x7ff73001c930 comp rx=0 tx=0).stop 2024-09-19T05:36:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff747e44640 1 -- 172.21.15.67:0/1038171240 shutdown_connections 2024-09-19T05:36:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff747e44640 1 --2- 172.21.15.67:0/1038171240 >> v2:172.21.15.97:3300/0 conn(0x7ff7401609b0 0x7ff7401600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff747e44640 1 --2- 172.21.15.67:0/1038171240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff74015fcf0 0x7ff7400b57b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff747e44640 1 -- 172.21.15.67:0/1038171240 >> 172.21.15.67:0/1038171240 conn(0x7ff740073500 msgr2=0x7ff74006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff747e44640 1 -- 172.21.15.67:0/1038171240 shutdown_connections 2024-09-19T05:36:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.822+0000 7ff747e44640 1 -- 172.21.15.67:0/1038171240 wait complete. 2024-09-19T05:36:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 Processor -- start 2024-09-19T05:36:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 -- start start 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7400afee0 0x7ff74006e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff74015fcf0 0x7ff740070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7401609b0 0x7ff74014aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff7400b02f0 con 0x7ff7401609b0 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff74015e3e0 con 0x7ff7400afee0 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff7400b0470 con 0x7ff74015fcf0 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff7463e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7401609b0 0x7ff74014aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff7463e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7401609b0 0x7ff74014aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45478/0 (socket says 172.21.15.67:45478) 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff7463e1640 1 -- 172.21.15.67:0/3683670318 learned_addr learned my addr 172.21.15.67:0/3683670318 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff7453df640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff74015fcf0 0x7ff740070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff745be0640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7400afee0 0x7ff74006e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff7463e1640 1 -- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff74015fcf0 msgr2=0x7ff740070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff7463e1640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff74015fcf0 0x7ff740070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff7463e1640 1 -- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7400afee0 msgr2=0x7ff74006e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff7463e1640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7400afee0 0x7ff74006e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff7463e1640 1 -- 172.21.15.67:0/3683670318 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74006efe0 con 0x7ff7401609b0 2024-09-19T05:36:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff7463e1640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7401609b0 0x7ff74014aeb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff73800c3c0 tx=0x7ff73800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff73e7fc640 1 -- 172.21.15.67:0/3683670318 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738017070 con 0x7ff7401609b0 2024-09-19T05:36:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff73e7fc640 1 -- 172.21.15.67:0/3683670318 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7380052d0 con 0x7ff7401609b0 2024-09-19T05:36:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff73e7fc640 1 -- 172.21.15.67:0/3683670318 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738003840 con 0x7ff7401609b0 2024-09-19T05:36:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 -- 172.21.15.67:0/3683670318 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74006f2c0 con 0x7ff7401609b0 2024-09-19T05:36:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 -- 172.21.15.67:0/3683670318 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74006f880 con 0x7ff7401609b0 2024-09-19T05:36:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff747e44640 1 -- 172.21.15.67:0/3683670318 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7400b57b0 con 0x7ff7401609b0 2024-09-19T05:36:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff73e7fc640 1 -- 172.21.15.67:0/3683670318 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff73801a070 con 0x7ff7401609b0 2024-09-19T05:36:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.826+0000 7ff73e7fc640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff72c0678c0 0x7ff72c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.830+0000 7ff73e7fc640 1 -- 172.21.15.67:0/3683670318 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5249+0+0 (secure 0 0 0) 0x7ff738084c70 con 0x7ff7401609b0 2024-09-19T05:36:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.830+0000 7ff745be0640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff72c0678c0 0x7ff72c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:28.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.830+0000 7ff745be0640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff72c0678c0 0x7ff72c069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff7300ae000 tx=0x7ff7300a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:28.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:28.834+0000 7ff73e7fc640 1 -- 172.21.15.67:0/3683670318 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff738005480 con 0x7ff7401609b0 2024-09-19T05:36:29.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.054+0000 7ff747e44640 1 -- 172.21.15.67:0/3683670318 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff74015d8a0 con 0x7ff7401609b0 2024-09-19T05:36:29.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.054+0000 7ff73e7fc640 1 -- 172.21.15.67:0/3683670318 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+5304 (secure 0 0 0) 0x7ff738055a00 con 0x7ff7401609b0 2024-09-19T05:36:29.059 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:29.059 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:29.059 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:36:29.060 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:36:29.061 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.062 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:36:29.063 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:36:29.064 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:36:29.068 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.070 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:29.071 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.072 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:36:29.072 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:36:29.072 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:36:29.072 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:36:29.072 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:36:29.072 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:36:29.072 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.072 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.072 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:36:29.072 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:29.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 -- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff72c0678c0 msgr2=0x7ff72c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff72c0678c0 0x7ff72c069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff7300ae000 tx=0x7ff7300a7070 comp rx=0 tx=0).stop 2024-09-19T05:36:29.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 -- 172.21.15.67:0/3683670318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7401609b0 msgr2=0x7ff74014aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7401609b0 0x7ff74014aeb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff73800c3c0 tx=0x7ff73800c880 comp rx=0 tx=0).stop 2024-09-19T05:36:29.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 -- 172.21.15.67:0/3683670318 shutdown_connections 2024-09-19T05:36:29.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7401609b0 0x7ff74014aeb0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff72c0678c0 0x7ff72c069d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff74015fcf0 0x7ff740070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 --2- 172.21.15.67:0/3683670318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7400afee0 0x7ff74006e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 -- 172.21.15.67:0/3683670318 >> 172.21.15.67:0/3683670318 conn(0x7ff740073500 msgr2=0x7ff7400b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:29.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 -- 172.21.15.67:0/3683670318 shutdown_connections 2024-09-19T05:36:29.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.058+0000 7ff747e44640 1 -- 172.21.15.67:0/3683670318 wait complete. 2024-09-19T05:36:29.079 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:36:29.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15cc886640 1 Processor -- start 2024-09-19T05:36:29.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15cc886640 1 -- start start 2024-09-19T05:36:29.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15cc886640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15c815b710 0x7f15c8071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15cc886640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f15c80aef40 0x7f15c80af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15cc886640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c80b3070 con 0x7f15c815baf0 2024-09-19T05:36:29.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15cc886640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f15c80b32e0 con 0x7f15c80aef40 2024-09-19T05:36:29.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15cc886640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f15c80b35c0 con 0x7f15c815b710 2024-09-19T05:36:29.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15c5d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f15c815baf0 0x7f15c815bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46070/0 (socket says 172.21.15.67:46070) 2024-09-19T05:36:29.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15c5d9b640 1 -- 172.21.15.67:0/3126784366 learned_addr learned my addr 172.21.15.67:0/3126784366 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:29.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15c6d9d640 1 --2- 172.21.15.67:0/3126784366 >> v2:172.21.15.67:3300/0 conn(0x7f15c80aef40 0x7f15c80af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15c659c640 1 --2- 172.21.15.67:0/3126784366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15c815b710 0x7f15c8071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15c559a640 1 -- 172.21.15.67:0/3126784366 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 632890546 0 0) 0x7f15c80b3070 con 0x7f15c815baf0 2024-09-19T05:36:29.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15c559a640 1 -- 172.21.15.67:0/3126784366 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15b0003530 con 0x7f15c815baf0 2024-09-19T05:36:29.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15c6d9d640 1 -- 172.21.15.67:0/3126784366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15c815b710 msgr2=0x7f15c8071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:29.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15c6d9d640 1 --2- 172.21.15.67:0/3126784366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15c815b710 0x7f15c8071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15c6d9d640 1 -- 172.21.15.67:0/3126784366 >> v1:172.21.15.67:6789/0 conn(0x7f15c815baf0 legacy=0x7f15c815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.194+0000 7f15c6d9d640 1 -- 172.21.15.67:0/3126784366 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c80b38a0 con 0x7f15c80aef40 2024-09-19T05:36:29.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c6d9d640 1 --2- 172.21.15.67:0/3126784366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 0x7f15c80af360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009d90 tx=0x7f15c001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1c18afaac34d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:29.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c559a640 1 -- 172.21.15.67:0/3126784366 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c00b2070 con 0x7f15c80aef40 2024-09-19T05:36:29.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c559a640 1 -- 172.21.15.67:0/3126784366 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c00a5a20 con 0x7f15c80aef40 2024-09-19T05:36:29.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c559a640 1 -- 172.21.15.67:0/3126784366 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c00a5dd0 con 0x7f15c80aef40 2024-09-19T05:36:29.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 -- 172.21.15.67:0/3126784366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 msgr2=0x7f15c80af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 --2- 172.21.15.67:0/3126784366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 0x7f15c80af360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009d90 tx=0x7f15c001c940 comp rx=0 tx=0).stop 2024-09-19T05:36:29.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 -- 172.21.15.67:0/3126784366 shutdown_connections 2024-09-19T05:36:29.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 --2- 172.21.15.67:0/3126784366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 0x7f15c80af360 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 --2- 172.21.15.67:0/3126784366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15c815b710 0x7f15c8071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 -- 172.21.15.67:0/3126784366 >> 172.21.15.67:0/3126784366 conn(0x7f15c80d0080 msgr2=0x7f15c80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:29.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 -- 172.21.15.67:0/3126784366 shutdown_connections 2024-09-19T05:36:29.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 -- 172.21.15.67:0/3126784366 wait complete. 2024-09-19T05:36:29.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 Processor -- start 2024-09-19T05:36:29.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 -- start start 2024-09-19T05:36:29.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 0x7f15c814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c815b710 0x7f15c8099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15c815baf0 0x7f15c8148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f15c80b4c40 con 0x7f15c80aef40 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f15c80b4ac0 con 0x7f15c815b710 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15cc886640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f15c80b4dc0 con 0x7f15c815baf0 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 0x7f15c814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 0x7f15c814e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45492/0 (socket says 172.21.15.67:45492) 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c659c640 1 -- 172.21.15.67:0/848778137 learned_addr learned my addr 172.21.15.67:0/848778137 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c5d9b640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c815b710 0x7f15c8099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c6d9d640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15c815baf0 0x7f15c8148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c659c640 1 -- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15c815baf0 msgr2=0x7f15c8148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c659c640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15c815baf0 0x7f15c8148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c659c640 1 -- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c815b710 msgr2=0x7f15c8099840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.198+0000 7f15c659c640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c815b710 0x7f15c8099840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15c659c640 1 -- 172.21.15.67:0/848778137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c81473e0 con 0x7f15c80aef40 2024-09-19T05:36:29.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15c5d9b640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c815b710 0x7f15c8099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:29.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15c659c640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 0x7f15c814e370 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f15b800e9b0 tx=0x7f15b800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:29.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15b6ffd640 1 -- 172.21.15.67:0/848778137 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8017070 con 0x7f15c80aef40 2024-09-19T05:36:29.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15b6ffd640 1 -- 172.21.15.67:0/848778137 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b800c9a0 con 0x7f15c80aef40 2024-09-19T05:36:29.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15cc886640 1 -- 172.21.15.67:0/848778137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c81476c0 con 0x7f15c80aef40 2024-09-19T05:36:29.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15b6ffd640 1 -- 172.21.15.67:0/848778137 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b800cd70 con 0x7f15c80aef40 2024-09-19T05:36:29.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15cc886640 1 -- 172.21.15.67:0/848778137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c814e8b0 con 0x7f15c80aef40 2024-09-19T05:36:29.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15cc886640 1 -- 172.21.15.67:0/848778137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c81471d0 con 0x7f15c80aef40 2024-09-19T05:36:29.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15b6ffd640 1 -- 172.21.15.67:0/848778137 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15b801a070 con 0x7f15c80aef40 2024-09-19T05:36:29.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15b6ffd640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15a80678c0 0x7f15a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15b6ffd640 1 -- 172.21.15.67:0/848778137 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5249+0+0 (secure 0 0 0) 0x7f15b8085e80 con 0x7f15c80aef40 2024-09-19T05:36:29.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15c5d9b640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15a80678c0 0x7f15a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.202+0000 7f15c5d9b640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15a80678c0 0x7f15a8069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15c80ae410 tx=0x7f15bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:29.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.206+0000 7f15b6ffd640 1 -- 172.21.15.67:0/848778137 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f15b8056c10 con 0x7f15c80aef40 2024-09-19T05:36:29.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.374+0000 7f15cc886640 1 -- 172.21.15.67:0/848778137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f15c80af360 con 0x7f15c80aef40 2024-09-19T05:36:29.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.374+0000 7f15b6ffd640 1 -- 172.21.15.67:0/848778137 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) ==== 84+0+65 (secure 0 0 0) 0x7f15b8056510 con 0x7f15c80aef40 2024-09-19T05:36:29.378 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:29.378 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:36:29.378 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:36:29.378 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:36:29.378 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:36:29.378 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:29.378 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:36:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 -- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15a80678c0 msgr2=0x7f15a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15a80678c0 0x7f15a8069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15c80ae410 tx=0x7f15bc009040 comp rx=0 tx=0).stop 2024-09-19T05:36:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 -- 172.21.15.67:0/848778137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 msgr2=0x7f15c814e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 0x7f15c814e370 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f15b800e9b0 tx=0x7f15b800ee70 comp rx=0 tx=0).stop 2024-09-19T05:36:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 -- 172.21.15.67:0/848778137 shutdown_connections 2024-09-19T05:36:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15a80678c0 0x7f15a8069d80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15c815baf0 0x7f15c8148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c815b710 0x7f15c8099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 --2- 172.21.15.67:0/848778137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15c80aef40 0x7f15c814e370 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 -- 172.21.15.67:0/848778137 >> 172.21.15.67:0/848778137 conn(0x7f15c80d0080 msgr2=0x7f15c80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 -- 172.21.15.67:0/848778137 shutdown_connections 2024-09-19T05:36:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.378+0000 7f15cc886640 1 -- 172.21.15.67:0/848778137 wait complete. 2024-09-19T05:36:29.398 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:36:29.399 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:36:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.526+0000 7f416fb14640 1 Processor -- start 2024-09-19T05:36:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.526+0000 7f416fb14640 1 -- start start 2024-09-19T05:36:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f416815e690 0x7f416806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41680703b0 con 0x7f41680b6f40 2024-09-19T05:36:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4168070690 con 0x7f416806db00 2024-09-19T05:36:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f416806df70 con 0x7f416815e690 2024-09-19T05:36:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416d8b0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f416815e690 0x7f416806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416e0b1640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f41680b6f40 0x7f4168071170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46078/0 (socket says 172.21.15.67:46078) 2024-09-19T05:36:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416d8b0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f416815e690 0x7f416806d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45504/0 (socket says 172.21.15.67:45504) 2024-09-19T05:36:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416e0b1640 1 -- 172.21.15.67:0/2550067467 learned_addr learned my addr 172.21.15.67:0/2550067467 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416d8b0640 1 -- 172.21.15.67:0/2550067467 >> v1:172.21.15.97:6789/0 conn(0x7f416806db00 legacy=0x7f41680b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416d8b0640 1 -- 172.21.15.67:0/2550067467 >> v1:172.21.15.67:6789/0 conn(0x7f41680b6f40 legacy=0x7f4168071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416d8b0640 1 -- 172.21.15.67:0/2550067467 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4168070970 con 0x7f416815e690 2024-09-19T05:36:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416c8ae640 1 -- 172.21.15.67:0/2550067467 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424073035 0 0) 0x7f41680703b0 con 0x7f41680b6f40 2024-09-19T05:36:29.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416d8b0640 1 --2- 172.21.15.67:0/2550067467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416815e690 0x7f416806d5c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f41640097f0 tx=0x7f416401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b663c11bc4af0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:29.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416c8ae640 1 -- 172.21.15.67:0/2550067467 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640b0070 con 0x7f416815e690 2024-09-19T05:36:29.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416c8ae640 1 -- 172.21.15.67:0/2550067467 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41640ab600 con 0x7f416815e690 2024-09-19T05:36:29.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416c8ae640 1 -- 172.21.15.67:0/2550067467 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640ab9d0 con 0x7f416815e690 2024-09-19T05:36:29.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 -- 172.21.15.67:0/2550067467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416815e690 msgr2=0x7f416806d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 --2- 172.21.15.67:0/2550067467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416815e690 0x7f416806d5c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f41640097f0 tx=0x7f416401c460 comp rx=0 tx=0).stop 2024-09-19T05:36:29.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 -- 172.21.15.67:0/2550067467 shutdown_connections 2024-09-19T05:36:29.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 --2- 172.21.15.67:0/2550067467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416815e690 0x7f416806d5c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 -- 172.21.15.67:0/2550067467 >> 172.21.15.67:0/2550067467 conn(0x7f41680b3ed0 msgr2=0x7f41680b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:29.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 -- 172.21.15.67:0/2550067467 shutdown_connections 2024-09-19T05:36:29.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.530+0000 7f416fb14640 1 -- 172.21.15.67:0/2550067467 wait complete. 2024-09-19T05:36:29.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 Processor -- start 2024-09-19T05:36:29.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 -- start start 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416806db00 0x7f4168153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680b6f40 0x7f4168156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416815e690 0x7f41681fa340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f41680722a0 con 0x7f416806db00 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f416816c0c0 con 0x7f416815e690 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f416814bb20 con 0x7f41680b6f40 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416d8b0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416806db00 0x7f4168153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416d8b0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416806db00 0x7f4168153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45512/0 (socket says 172.21.15.67:45512) 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416d8b0640 1 -- 172.21.15.67:0/3768385622 learned_addr learned my addr 172.21.15.67:0/3768385622 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416d0af640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680b6f40 0x7f4168156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416d8b0640 1 -- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680b6f40 msgr2=0x7f4168156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416e0b1640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416815e690 0x7f41681fa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416d8b0640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680b6f40 0x7f4168156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416d8b0640 1 -- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416815e690 msgr2=0x7f41681fa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416d8b0640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416815e690 0x7f41681fa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416d8b0640 1 -- 172.21.15.67:0/3768385622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416814c7d0 con 0x7f416806db00 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416e0b1640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416815e690 0x7f41681fa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416d8b0640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416806db00 0x7f4168153520 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f41640ae040 tx=0x7f416401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f415e7fc640 1 -- 172.21.15.67:0/3768385622 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640b0050 con 0x7f416806db00 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f415e7fc640 1 -- 172.21.15.67:0/3768385622 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41640bc070 con 0x7f416806db00 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 -- 172.21.15.67:0/3768385622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416814cab0 con 0x7f416806db00 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 -- 172.21.15.67:0/3768385622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4168146d30 con 0x7f416806db00 2024-09-19T05:36:29.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f415e7fc640 1 -- 172.21.15.67:0/3768385622 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640b5af0 con 0x7f416806db00 2024-09-19T05:36:29.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.534+0000 7f416fb14640 1 -- 172.21.15.67:0/3768385622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41500052a0 con 0x7f416806db00 2024-09-19T05:36:29.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.538+0000 7f415e7fc640 1 -- 172.21.15.67:0/3768385622 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f41640b5c90 con 0x7f416806db00 2024-09-19T05:36:29.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.538+0000 7f415e7fc640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 0x7f414c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:29.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.538+0000 7f415e7fc640 1 -- 172.21.15.67:0/3768385622 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5249+0+0 (secure 0 0 0) 0x7f4164120590 con 0x7f416806db00 2024-09-19T05:36:29.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.538+0000 7f416d0af640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 0x7f414c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:29.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.538+0000 7f416d0af640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 0x7f414c069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4168157a00 tx=0x7f4158009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:29.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.542+0000 7f415e7fc640 1 -- 172.21.15.67:0/3768385622 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4164016050 con 0x7f416806db00 2024-09-19T05:36:29.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:29.710+0000 7f416fb14640 1 -- 172.21.15.67:0/3768385622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4150005860 con 0x7f416806db00 2024-09-19T05:36:30.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.669+0000 7f415e7fc640 1 -- 172.21.15.67:0/3768385622 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) ==== 138+0+0 (secure 0 0 0) 0x7f41640f1290 con 0x7f416806db00 2024-09-19T05:36:30.673 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:36:30.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 -- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 msgr2=0x7f414c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 0x7f414c069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4168157a00 tx=0x7f4158009040 comp rx=0 tx=0).stop 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 -- 172.21.15.67:0/3768385622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416806db00 msgr2=0x7f4168153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416806db00 0x7f4168153520 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f41640ae040 tx=0x7f416401aca0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 -- 172.21.15.67:0/3768385622 shutdown_connections 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416815e690 0x7f41681fa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 0x7f414c069d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680b6f40 0x7f4168156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 --2- 172.21.15.67:0/3768385622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416806db00 0x7f4168153520 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 -- 172.21.15.67:0/3768385622 >> 172.21.15.67:0/3768385622 conn(0x7f41680b3ed0 msgr2=0x7f416809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 -- 172.21.15.67:0/3768385622 shutdown_connections 2024-09-19T05:36:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.673+0000 7f416fb14640 1 -- 172.21.15.67:0/3768385622 wait complete. 2024-09-19T05:36:30.705 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:36:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.837+0000 7f0b0aa14640 1 Processor -- start 2024-09-19T05:36:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.837+0000 7f0b0aa14640 1 -- start start 2024-09-19T05:36:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.837+0000 7f0b0aa14640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b04159c60 0x7f0b040ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0b040af3a0 0x7f0b0415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0415a040 con 0x7f0b0406ffd0 2024-09-19T05:36:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0b0415d460 con 0x7f0b04159c60 2024-09-19T05:36:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0b0415c850 con 0x7f0b040af3a0 2024-09-19T05:36:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b03fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b04159c60 0x7f0b040ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b037fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0b0406ffd0 0x7f0b040aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46094/0 (socket says 172.21.15.67:46094) 2024-09-19T05:36:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b037fe640 1 -- 172.21.15.67:0/1672955968 learned_addr learned my addr 172.21.15.67:0/1672955968 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b08fb1640 1 --2- 172.21.15.67:0/1672955968 >> v2:172.21.15.97:3300/0 conn(0x7f0b040af3a0 0x7f0b0415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b03fff640 1 -- 172.21.15.67:0/1672955968 >> v2:172.21.15.97:3300/0 conn(0x7f0b040af3a0 msgr2=0x7f0b0415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b03fff640 1 --2- 172.21.15.67:0/1672955968 >> v2:172.21.15.97:3300/0 conn(0x7f0b040af3a0 0x7f0b0415fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b03fff640 1 -- 172.21.15.67:0/1672955968 >> v1:172.21.15.67:6789/0 conn(0x7f0b0406ffd0 legacy=0x7f0b040aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b03fff640 1 -- 172.21.15.67:0/1672955968 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0415cb30 con 0x7f0b04159c60 2024-09-19T05:36:30.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b03fff640 1 --2- 172.21.15.67:0/1672955968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 0x7f0b040ad130 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0b04071950 tx=0x7f0aec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675a05a670eb87e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:30.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b02ffd640 1 -- 172.21.15.67:0/1672955968 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0ab650 con 0x7f0b04159c60 2024-09-19T05:36:30.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b02ffd640 1 -- 172.21.15.67:0/1672955968 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aec0b0070 con 0x7f0b04159c60 2024-09-19T05:36:30.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b02ffd640 1 -- 172.21.15.67:0/1672955968 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0aba10 con 0x7f0b04159c60 2024-09-19T05:36:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 -- 172.21.15.67:0/1672955968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 msgr2=0x7f0b040ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 --2- 172.21.15.67:0/1672955968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 0x7f0b040ad130 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0b04071950 tx=0x7f0aec01c450 comp rx=0 tx=0).stop 2024-09-19T05:36:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 -- 172.21.15.67:0/1672955968 shutdown_connections 2024-09-19T05:36:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 --2- 172.21.15.67:0/1672955968 >> v2:172.21.15.97:3300/0 conn(0x7f0b040af3a0 0x7f0b0415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 --2- 172.21.15.67:0/1672955968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 0x7f0b040ad130 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 -- 172.21.15.67:0/1672955968 >> 172.21.15.67:0/1672955968 conn(0x7f0b040b1e50 msgr2=0x7f0b040b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 -- 172.21.15.67:0/1672955968 shutdown_connections 2024-09-19T05:36:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.841+0000 7f0b0aa14640 1 -- 172.21.15.67:0/1672955968 wait complete. 2024-09-19T05:36:30.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b0aa14640 1 Processor -- start 2024-09-19T05:36:30.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b0aa14640 1 -- start start 2024-09-19T05:36:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b0aa14640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b0406ffd0 0x7f0b04150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b0aa14640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b040af3a0 0x7f0b0414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b0aa14640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 0x7f0b0415e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b0aa14640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0b04168e30 con 0x7f0b04159c60 2024-09-19T05:36:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b0aa14640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0b04168fb0 con 0x7f0b040af3a0 2024-09-19T05:36:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b0aa14640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0b04169130 con 0x7f0b0406ffd0 2024-09-19T05:36:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b08fb1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 0x7f0b0415e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b08fb1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 0x7f0b0415e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45518/0 (socket says 172.21.15.67:45518) 2024-09-19T05:36:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b08fb1640 1 -- 172.21.15.67:0/2929607724 learned_addr learned my addr 172.21.15.67:0/2929607724 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b037fe640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b040af3a0 0x7f0b0414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b03fff640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b0406ffd0 0x7f0b04150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b08fb1640 1 -- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b0406ffd0 msgr2=0x7f0b04150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b08fb1640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b0406ffd0 0x7f0b04150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b08fb1640 1 -- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b040af3a0 msgr2=0x7f0b0414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b08fb1640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b040af3a0 0x7f0b0414f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b08fb1640 1 -- 172.21.15.67:0/2929607724 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b041533d0 con 0x7f0b04159c60 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b03fff640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b0406ffd0 0x7f0b04150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b08fb1640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 0x7f0b0415e850 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0afc007e40 tx=0x7f0afc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b00ff9640 1 -- 172.21.15.67:0/2929607724 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc014620 con 0x7f0b04159c60 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b00ff9640 1 -- 172.21.15.67:0/2929607724 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc019070 con 0x7f0b04159c60 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b0aa14640 1 -- 172.21.15.67:0/2929607724 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b041536b0 con 0x7f0b04159c60 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b00ff9640 1 -- 172.21.15.67:0/2929607724 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc014a20 con 0x7f0b04159c60 2024-09-19T05:36:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.845+0000 7f0b0aa14640 1 -- 172.21.15.67:0/2929607724 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b04153f50 con 0x7f0b04159c60 2024-09-19T05:36:30.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.849+0000 7f0b0aa14640 1 -- 172.21.15.67:0/2929607724 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b04153880 con 0x7f0b04159c60 2024-09-19T05:36:30.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.849+0000 7f0b00ff9640 1 -- 172.21.15.67:0/2929607724 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0afc014bc0 con 0x7f0b04159c60 2024-09-19T05:36:30.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.849+0000 7f0b00ff9640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae40678f0 0x7f0ae4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:30.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.849+0000 7f0b00ff9640 1 -- 172.21.15.67:0/2929607724 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5619+0+0 (secure 0 0 0) 0x7f0afc086390 con 0x7f0b04159c60 2024-09-19T05:36:30.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.849+0000 7f0b03fff640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae40678f0 0x7f0ae4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:30.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.849+0000 7f0b03fff640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae40678f0 0x7f0ae4069db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0af000 tx=0x7f0aec0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:30.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:30.853+0000 7f0b00ff9640 1 -- 172.21.15.67:0/2929607724 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0afc056fb0 con 0x7f0b04159c60 2024-09-19T05:36:31.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.021+0000 7f0b0aa14640 1 -- 172.21.15.67:0/2929607724 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0b0406fcb0 con 0x7f0b04159c60 2024-09-19T05:36:31.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.677+0000 7f0b00ff9640 1 -- 172.21.15.67:0/2929607724 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) ==== 170+0+0 (secure 0 0 0) 0x7f0afc0568b0 con 0x7f0b04159c60 2024-09-19T05:36:31.683 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:36:31.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 -- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae40678f0 msgr2=0x7f0ae4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:31.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae40678f0 0x7f0ae4069db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0af000 tx=0x7f0aec0a7000 comp rx=0 tx=0).stop 2024-09-19T05:36:31.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 -- 172.21.15.67:0/2929607724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 msgr2=0x7f0b0415e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:31.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 0x7f0b0415e850 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0afc007e40 tx=0x7f0afc00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:36:31.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 -- 172.21.15.67:0/2929607724 shutdown_connections 2024-09-19T05:36:31.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b04159c60 0x7f0b0415e850 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:31.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b040af3a0 0x7f0b0414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:31.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae40678f0 0x7f0ae4069db0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:31.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 --2- 172.21.15.67:0/2929607724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b0406ffd0 0x7f0b04150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:31.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 -- 172.21.15.67:0/2929607724 >> 172.21.15.67:0/2929607724 conn(0x7f0b040b1e50 msgr2=0x7f0b04152700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:31.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 -- 172.21.15.67:0/2929607724 shutdown_connections 2024-09-19T05:36:31.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.681+0000 7f0b0aa14640 1 -- 172.21.15.67:0/2929607724 wait complete. 2024-09-19T05:36:31.729 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:36:31.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faece53a640 1 Processor -- start 2024-09-19T05:36:31.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faece53a640 1 -- start start 2024-09-19T05:36:31.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faece53a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faec815b1d0 0x7faec80adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:31.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faece53a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faec806dfc0 0x7faec806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:31.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faece53a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec80aef30 con 0x7faec806fea0 2024-09-19T05:36:31.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faece53a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7faec8072210 con 0x7faec815b1d0 2024-09-19T05:36:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faece53a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7faec80ae0f0 con 0x7faec806dfc0 2024-09-19T05:36:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faec7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faec815b1d0 0x7faec80adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faeccad7640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7faec806fea0 0x7faec815ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46106/0 (socket says 172.21.15.67:46106) 2024-09-19T05:36:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faeccad7640 1 -- 172.21.15.67:0/3085414267 learned_addr learned my addr 172.21.15.67:0/3085414267 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faec77fe640 1 --2- 172.21.15.67:0/3085414267 >> v2:172.21.15.97:3300/0 conn(0x7faec806dfc0 0x7faec806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faec7fff640 1 -- 172.21.15.67:0/3085414267 >> v2:172.21.15.97:3300/0 conn(0x7faec806dfc0 msgr2=0x7faec806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faec7fff640 1 --2- 172.21.15.67:0/3085414267 >> v2:172.21.15.97:3300/0 conn(0x7faec806dfc0 0x7faec806f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faec7fff640 1 -- 172.21.15.67:0/3085414267 >> v1:172.21.15.67:6789/0 conn(0x7faec806fea0 legacy=0x7faec815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faec7fff640 1 -- 172.21.15.67:0/3085414267 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec80ae3b0 con 0x7faec815b1d0 2024-09-19T05:36:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.849+0000 7faec77fe640 1 --2- 172.21.15.67:0/3085414267 >> v2:172.21.15.97:3300/0 conn(0x7faec806dfc0 0x7faec806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:31.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faec7fff640 1 --2- 172.21.15.67:0/3085414267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 0x7faec80adbb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faec8071970 tx=0x7faeb801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c263736d172fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:31.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faec6ffd640 1 -- 172.21.15.67:0/3085414267 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb80b0070 con 0x7faec815b1d0 2024-09-19T05:36:31.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faec6ffd640 1 -- 172.21.15.67:0/3085414267 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb80ab600 con 0x7faec815b1d0 2024-09-19T05:36:31.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faec6ffd640 1 -- 172.21.15.67:0/3085414267 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb80ab9d0 con 0x7faec815b1d0 2024-09-19T05:36:31.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faece53a640 1 -- 172.21.15.67:0/3085414267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 msgr2=0x7faec80adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:31.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faece53a640 1 --2- 172.21.15.67:0/3085414267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 0x7faec80adbb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faec8071970 tx=0x7faeb801c480 comp rx=0 tx=0).stop 2024-09-19T05:36:31.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faece53a640 1 -- 172.21.15.67:0/3085414267 shutdown_connections 2024-09-19T05:36:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faece53a640 1 --2- 172.21.15.67:0/3085414267 >> v2:172.21.15.97:3300/0 conn(0x7faec806dfc0 0x7faec806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faece53a640 1 --2- 172.21.15.67:0/3085414267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 0x7faec80adbb0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faece53a640 1 -- 172.21.15.67:0/3085414267 >> 172.21.15.67:0/3085414267 conn(0x7faec80b1e50 msgr2=0x7faec80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faece53a640 1 -- 172.21.15.67:0/3085414267 shutdown_connections 2024-09-19T05:36:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faece53a640 1 -- 172.21.15.67:0/3085414267 wait complete. 2024-09-19T05:36:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faece53a640 1 Processor -- start 2024-09-19T05:36:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.853+0000 7faece53a640 1 -- start start 2024-09-19T05:36:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faece53a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faec806dfc0 0x7faec81564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faece53a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faec806fea0 0x7faec80999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faece53a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 0x7faec80afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faece53a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faec80b4440 con 0x7faec815b1d0 2024-09-19T05:36:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faece53a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faec8072420 con 0x7faec806fea0 2024-09-19T05:36:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faece53a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faec8167df0 con 0x7faec806dfc0 2024-09-19T05:36:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faeccad7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 0x7faec80afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faeccad7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 0x7faec80afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45546/0 (socket says 172.21.15.67:45546) 2024-09-19T05:36:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faeccad7640 1 -- 172.21.15.67:0/1740485326 learned_addr learned my addr 172.21.15.67:0/1740485326 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faec77fe640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faec806fea0 0x7faec80999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faec7fff640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faec806dfc0 0x7faec81564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faeccad7640 1 -- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faec806dfc0 msgr2=0x7faec81564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faeccad7640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faec806dfc0 0x7faec81564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faeccad7640 1 -- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faec806fea0 msgr2=0x7faec80999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faeccad7640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faec806fea0 0x7faec80999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faeccad7640 1 -- 172.21.15.67:0/1740485326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec81548b0 con 0x7faec815b1d0 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faec7fff640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faec806dfc0 0x7faec81564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faeccad7640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 0x7faec80afa60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faec000cbc0 tx=0x7faec000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faec4ff9640 1 -- 172.21.15.67:0/1740485326 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0017070 con 0x7faec815b1d0 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faec4ff9640 1 -- 172.21.15.67:0/1740485326 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec000ad40 con 0x7faec815b1d0 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faece53a640 1 -- 172.21.15.67:0/1740485326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec8156b60 con 0x7faec815b1d0 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faec4ff9640 1 -- 172.21.15.67:0/1740485326 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0012600 con 0x7faec815b1d0 2024-09-19T05:36:31.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faece53a640 1 -- 172.21.15.67:0/1740485326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec8157120 con 0x7faec815b1d0 2024-09-19T05:36:31.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faece53a640 1 -- 172.21.15.67:0/1740485326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec806f960 con 0x7faec815b1d0 2024-09-19T05:36:31.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faec4ff9640 1 -- 172.21.15.67:0/1740485326 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faec001a070 con 0x7faec815b1d0 2024-09-19T05:36:31.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faec4ff9640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faeb40678c0 0x7faeb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:31.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.857+0000 7faec4ff9640 1 -- 172.21.15.67:0/1740485326 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6001+0+0 (secure 0 0 0) 0x7faec0085a20 con 0x7faec815b1d0 2024-09-19T05:36:31.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.861+0000 7faec7fff640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faeb40678c0 0x7faeb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:31.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.861+0000 7faec7fff640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faeb40678c0 0x7faeb4069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faeb80ad000 tx=0x7faeb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:31.865+0000 7faec4ff9640 1 -- 172.21.15.67:0/1740485326 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7faec0055e70 con 0x7faec815b1d0 2024-09-19T05:36:32.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.065+0000 7faece53a640 1 -- 172.21.15.67:0/1740485326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7faec80d02d0 con 0x7faec815b1d0 2024-09-19T05:36:32.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.681+0000 7faec4ff9640 1 -- 172.21.15.67:0/1740485326 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) ==== 172+0+0 (secure 0 0 0) 0x7faec005a170 con 0x7faec815b1d0 2024-09-19T05:36:32.686 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 7 and data pool 8 2024-09-19T05:36:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.685+0000 7faece53a640 1 -- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faeb40678c0 msgr2=0x7faeb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.685+0000 7faece53a640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faeb40678c0 0x7faeb4069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faeb80ad000 tx=0x7faeb8008040 comp rx=0 tx=0).stop 2024-09-19T05:36:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.685+0000 7faece53a640 1 -- 172.21.15.67:0/1740485326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 msgr2=0x7faec80afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.685+0000 7faece53a640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 0x7faec80afa60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faec000cbc0 tx=0x7faec000a430 comp rx=0 tx=0).stop 2024-09-19T05:36:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.689+0000 7faece53a640 1 -- 172.21.15.67:0/1740485326 shutdown_connections 2024-09-19T05:36:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.689+0000 7faece53a640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec815b1d0 0x7faec80afa60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.689+0000 7faece53a640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faec806fea0 0x7faec80999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.689+0000 7faece53a640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faeb40678c0 0x7faeb4069d80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.689+0000 7faece53a640 1 --2- 172.21.15.67:0/1740485326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faec806dfc0 0x7faec81564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.689+0000 7faece53a640 1 -- 172.21.15.67:0/1740485326 >> 172.21.15.67:0/1740485326 conn(0x7faec80b1e50 msgr2=0x7faec80cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:32.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.689+0000 7faece53a640 1 -- 172.21.15.67:0/1740485326 shutdown_connections 2024-09-19T05:36:32.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.689+0000 7faece53a640 1 -- 172.21.15.67:0/1740485326 wait complete. 2024-09-19T05:36:32.735 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:36:32.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f24934a1640 1 Processor -- start 2024-09-19T05:36:32.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f24934a1640 1 -- start start 2024-09-19T05:36:32.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f24934a1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f248c06d3e0 0x7f248c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f24934a1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f248c0b5320 con 0x7f248c0b5a10 2024-09-19T05:36:32.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f24934a1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f248c0b4990 con 0x7f248c15e340 2024-09-19T05:36:32.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f24934a1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f248c0b40f0 con 0x7f248c06d3e0 2024-09-19T05:36:32.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f2491a3e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f248c0b5a10 0x7f248c06ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46118/0 (socket says 172.21.15.67:46118) 2024-09-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f2490a3c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f248c06d3e0 0x7f248c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f2491a3e640 1 -- 172.21.15.67:0/1422536608 learned_addr learned my addr 172.21.15.67:0/1422536608 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f2483fff640 1 -- 172.21.15.67:0/1422536608 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093712210 0 0) 0x7f248c0b5320 con 0x7f248c0b5a10 2024-09-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f2483fff640 1 -- 172.21.15.67:0/1422536608 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2478003530 con 0x7f248c0b5a10 2024-09-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f2490a3c640 1 -- 172.21.15.67:0/1422536608 >> v1:172.21.15.97:6789/0 conn(0x7f248c15e340 legacy=0x7f248c06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f2490a3c640 1 -- 172.21.15.67:0/1422536608 >> v1:172.21.15.67:6789/0 conn(0x7f248c0b5a10 legacy=0x7f248c06ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.849+0000 7f2490a3c640 1 -- 172.21.15.67:0/1422536608 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c0b43d0 con 0x7f248c06d3e0 2024-09-19T05:36:32.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f2490a3c640 1 --2- 172.21.15.67:0/1422536608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 0x7f248c0b39f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f247c0097c0 tx=0x7f247c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e046a455fa86f966 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:32.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f2483fff640 1 -- 172.21.15.67:0/1422536608 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c0aa600 con 0x7f248c06d3e0 2024-09-19T05:36:32.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f2483fff640 1 -- 172.21.15.67:0/1422536608 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c0af070 con 0x7f248c06d3e0 2024-09-19T05:36:32.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f2483fff640 1 -- 172.21.15.67:0/1422536608 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c0aa9a0 con 0x7f248c06d3e0 2024-09-19T05:36:32.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 -- 172.21.15.67:0/1422536608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 msgr2=0x7f248c0b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 --2- 172.21.15.67:0/1422536608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 0x7f248c0b39f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f247c0097c0 tx=0x7f247c01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 -- 172.21.15.67:0/1422536608 shutdown_connections 2024-09-19T05:36:32.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 --2- 172.21.15.67:0/1422536608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 0x7f248c0b39f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 -- 172.21.15.67:0/1422536608 >> 172.21.15.67:0/1422536608 conn(0x7f248c072800 msgr2=0x7f248c072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:32.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 -- 172.21.15.67:0/1422536608 shutdown_connections 2024-09-19T05:36:32.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 -- 172.21.15.67:0/1422536608 wait complete. 2024-09-19T05:36:32.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 Processor -- start 2024-09-19T05:36:32.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 -- start start 2024-09-19T05:36:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 0x7f248c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f248c0b5a10 0x7f248c146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248c15e340 0x7f248c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f248c15e8a0 con 0x7f248c06d3e0 2024-09-19T05:36:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f248c15e720 con 0x7f248c15e340 2024-09-19T05:36:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f24934a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f248c06f880 con 0x7f248c0b5a10 2024-09-19T05:36:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f249123d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 0x7f248c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f249123d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 0x7f248c0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45554/0 (socket says 172.21.15.67:45554) 2024-09-19T05:36:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f249123d640 1 -- 172.21.15.67:0/1000762736 learned_addr learned my addr 172.21.15.67:0/1000762736 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f2491a3e640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248c15e340 0x7f248c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f249123d640 1 -- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f248c0b5a10 msgr2=0x7f248c146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f249123d640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f248c0b5a10 0x7f248c146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f249123d640 1 -- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248c15e340 msgr2=0x7f248c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f249123d640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248c15e340 0x7f248c15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f249123d640 1 -- 172.21.15.67:0/1000762736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c1528e0 con 0x7f248c06d3e0 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f2491a3e640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248c15e340 0x7f248c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.853+0000 7f249123d640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 0x7f248c0b1940 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f248800c390 tx=0x7f248800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f2481ffb640 1 -- 172.21.15.67:0/1000762736 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488017070 con 0x7f248c06d3e0 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f2481ffb640 1 -- 172.21.15.67:0/1000762736 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24880052f0 con 0x7f248c06d3e0 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f24934a1640 1 -- 172.21.15.67:0/1000762736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c160050 con 0x7f248c06d3e0 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f2481ffb640 1 -- 172.21.15.67:0/1000762736 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488003840 con 0x7f248c06d3e0 2024-09-19T05:36:32.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f24934a1640 1 -- 172.21.15.67:0/1000762736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c160610 con 0x7f248c06d3e0 2024-09-19T05:36:32.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f24934a1640 1 -- 172.21.15.67:0/1000762736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248c0b39f0 con 0x7f248c06d3e0 2024-09-19T05:36:32.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f2481ffb640 1 -- 172.21.15.67:0/1000762736 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f248801a070 con 0x7f248c06d3e0 2024-09-19T05:36:32.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f2481ffb640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24700678f0 0x7f2470069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f2481ffb640 1 -- 172.21.15.67:0/1000762736 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2488085090 con 0x7f248c06d3e0 2024-09-19T05:36:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f2490a3c640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24700678f0 0x7f2470069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.857+0000 7f2490a3c640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24700678f0 0x7f2470069db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f247c0ae000 tx=0x7f247c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:32.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:32.861+0000 7f2481ffb640 1 -- 172.21.15.67:0/1000762736 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2488055ab0 con 0x7f248c06d3e0 2024-09-19T05:36:33.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.025+0000 7f24934a1640 1 -- 172.21.15.67:0/1000762736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f248c161830 con 0x7f248c06d3e0 2024-09-19T05:36:33.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.029+0000 7f2481ffb640 1 -- 172.21.15.67:0/1000762736 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16979 (secure 0 0 0) 0x7f24880553b0 con 0x7f248c06d3e0 2024-09-19T05:36:33.034 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:33.034 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":54,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:36:32.069502+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:36:29.754631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-19T05:36:31.068405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:36:33.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 -- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24700678f0 msgr2=0x7f2470069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24700678f0 0x7f2470069db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f247c0ae000 tx=0x7f247c008040 comp rx=0 tx=0).stop 2024-09-19T05:36:33.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 -- 172.21.15.67:0/1000762736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 msgr2=0x7f248c0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 0x7f248c0b1940 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f248800c390 tx=0x7f248800c850 comp rx=0 tx=0).stop 2024-09-19T05:36:33.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 -- 172.21.15.67:0/1000762736 shutdown_connections 2024-09-19T05:36:33.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248c15e340 0x7f248c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24700678f0 0x7f2470069db0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f248c0b5a10 0x7f248c146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 --2- 172.21.15.67:0/1000762736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f248c06d3e0 0x7f248c0b1940 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 -- 172.21.15.67:0/1000762736 >> 172.21.15.67:0/1000762736 conn(0x7f248c072800 msgr2=0x7f248c161120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:33.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 -- 172.21.15.67:0/1000762736 shutdown_connections 2024-09-19T05:36:33.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.033+0000 7f24934a1640 1 -- 172.21.15.67:0/1000762736 wait complete. 2024-09-19T05:36:33.054 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:36:33.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.169+0000 7f8308bd2640 1 Processor -- start 2024-09-19T05:36:33.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.169+0000 7f8308bd2640 1 -- start start 2024-09-19T05:36:33.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.169+0000 7f8308bd2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f830406dde0 0x7f83040b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.169+0000 7f8308bd2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83040b3510 0x7f830406f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.169+0000 7f8308bd2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f830406e3c0 con 0x7f830415c030 2024-09-19T05:36:33.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.169+0000 7f8308bd2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f830406e6a0 con 0x7f830406dde0 2024-09-19T05:36:33.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.169+0000 7f8308bd2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f830406e980 con 0x7f83040b3510 2024-09-19T05:36:33.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f8301d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f830406dde0 0x7f83040b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f8302d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83040b3510 0x7f830406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f8301d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f830406dde0 0x7f83040b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:57248/0 (socket says 172.21.15.67:57248) 2024-09-19T05:36:33.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f8301d9b640 1 -- 172.21.15.67:0/683116523 learned_addr learned my addr 172.21.15.67:0/683116523 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:33.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f830259c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f830415c030 0x7f830415d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:52902/0 (socket says 172.21.15.67:52902) 2024-09-19T05:36:33.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f8301d9b640 1 -- 172.21.15.67:0/683116523 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83040b3510 msgr2=0x7f830406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:33.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f8301d9b640 1 --2- 172.21.15.67:0/683116523 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83040b3510 0x7f830406f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f8301d9b640 1 -- 172.21.15.67:0/683116523 >> v1:172.21.15.97:6789/0 conn(0x7f830415c030 legacy=0x7f830415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f8301d9b640 1 -- 172.21.15.67:0/683116523 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830406ec60 con 0x7f830406dde0 2024-09-19T05:36:33.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f8302d9d640 1 --2- 172.21.15.67:0/683116523 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83040b3510 0x7f830406f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:36:33.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f8301d9b640 1 --2- 172.21.15.67:0/683116523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830406dde0 0x7f83040b2fd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009870 tx=0x7f82ec01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=809a358a15fb6759 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f830159a640 1 -- 172.21.15.67:0/683116523 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0ab640 con 0x7f830406dde0 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f830159a640 1 -- 172.21.15.67:0/683116523 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ec0b0070 con 0x7f830406dde0 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.173+0000 7f830159a640 1 -- 172.21.15.67:0/683116523 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0aba00 con 0x7f830406dde0 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- 172.21.15.67:0/683116523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830406dde0 msgr2=0x7f83040b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 --2- 172.21.15.67:0/683116523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830406dde0 0x7f83040b2fd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009870 tx=0x7f82ec01c530 comp rx=0 tx=0).stop 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- 172.21.15.67:0/683116523 shutdown_connections 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 --2- 172.21.15.67:0/683116523 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83040b3510 0x7f830406f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 --2- 172.21.15.67:0/683116523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830406dde0 0x7f83040b2fd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- 172.21.15.67:0/683116523 >> 172.21.15.67:0/683116523 conn(0x7f83040d0080 msgr2=0x7f83040d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- 172.21.15.67:0/683116523 shutdown_connections 2024-09-19T05:36:33.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- 172.21.15.67:0/683116523 wait complete. 2024-09-19T05:36:33.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 Processor -- start 2024-09-19T05:36:33.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- start start 2024-09-19T05:36:33.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830406dde0 0x7f830414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83040b3510 0x7f8304146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830415c030 0x7f830414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f83041692f0 con 0x7f83040b3510 2024-09-19T05:36:33.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f830415c620 con 0x7f830406dde0 2024-09-19T05:36:33.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8304169470 con 0x7f830415c030 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8301d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83040b3510 0x7f8304146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8301d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83040b3510 0x7f8304146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45566/0 (socket says 172.21.15.67:45566) 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8301d9b640 1 -- 172.21.15.67:0/1937272067 learned_addr learned my addr 172.21.15.67:0/1937272067 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f830259c640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830406dde0 0x7f830414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8302d9d640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830415c030 0x7f830414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8301d9b640 1 -- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830415c030 msgr2=0x7f830414c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8301d9b640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830415c030 0x7f830414c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8301d9b640 1 -- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830406dde0 msgr2=0x7f830414ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8301d9b640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830406dde0 0x7f830414ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8301d9b640 1 -- 172.21.15.67:0/1937272067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830414dda0 con 0x7f83040b3510 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8301d9b640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83040b3510 0x7f8304146930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f82ec01cdd0 tx=0x7f82ec01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:33.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f82faffd640 1 -- 172.21.15.67:0/1937272067 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0be440 con 0x7f83040b3510 2024-09-19T05:36:33.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f82faffd640 1 -- 172.21.15.67:0/1937272067 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ec0be5e0 con 0x7f83040b3510 2024-09-19T05:36:33.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f82faffd640 1 -- 172.21.15.67:0/1937272067 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0be9d0 con 0x7f83040b3510 2024-09-19T05:36:33.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- 172.21.15.67:0/1937272067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8304147ae0 con 0x7f83040b3510 2024-09-19T05:36:33.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.177+0000 7f8308bd2640 1 -- 172.21.15.67:0/1937272067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83041480a0 con 0x7f83040b3510 2024-09-19T05:36:33.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.181+0000 7f8308bd2640 1 -- 172.21.15.67:0/1937272067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83040b2fd0 con 0x7f83040b3510 2024-09-19T05:36:33.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.181+0000 7f82faffd640 1 -- 172.21.15.67:0/1937272067 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f82ec0beb70 con 0x7f83040b3510 2024-09-19T05:36:33.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.181+0000 7f82faffd640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82e40678c0 0x7f82e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.181+0000 7f82faffd640 1 -- 172.21.15.67:0/1937272067 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f82ec1202c0 con 0x7f83040b3510 2024-09-19T05:36:33.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.181+0000 7f830259c640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82e40678c0 0x7f82e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.181+0000 7f830259c640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82e40678c0 0x7f82e4069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f830415ba10 tx=0x7f82fc001640 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:33.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.185+0000 7f82faffd640 1 -- 172.21.15.67:0/1937272067 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f830414dda0 con 0x7f83040b3510 2024-09-19T05:36:33.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.353+0000 7f8308bd2640 1 -- 172.21.15.67:0/1937272067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83040d0f20 con 0x7f83040b3510 2024-09-19T05:36:33.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.353+0000 7f82faffd640 1 -- 172.21.15.67:0/1937272067 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16979 (secure 0 0 0) 0x7f82ec016150 con 0x7f83040b3510 2024-09-19T05:36:33.359 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:33.359 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":54,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:36:32.069502+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:36:29.754631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-19T05:36:31.068405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:36:33.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 -- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82e40678c0 msgr2=0x7f82e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82e40678c0 0x7f82e4069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f830415ba10 tx=0x7f82fc001640 comp rx=0 tx=0).stop 2024-09-19T05:36:33.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 -- 172.21.15.67:0/1937272067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83040b3510 msgr2=0x7f8304146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83040b3510 0x7f8304146930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f82ec01cdd0 tx=0x7f82ec01ad70 comp rx=0 tx=0).stop 2024-09-19T05:36:33.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 -- 172.21.15.67:0/1937272067 shutdown_connections 2024-09-19T05:36:33.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82e40678c0 0x7f82e4069d80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f830415c030 0x7f830414c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83040b3510 0x7f8304146930 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 --2- 172.21.15.67:0/1937272067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f830406dde0 0x7f830414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 -- 172.21.15.67:0/1937272067 >> 172.21.15.67:0/1937272067 conn(0x7f83040d0080 msgr2=0x7f830415c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:33.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 -- 172.21.15.67:0/1937272067 shutdown_connections 2024-09-19T05:36:33.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.357+0000 7f8308bd2640 1 -- 172.21.15.67:0/1937272067 wait complete. 2024-09-19T05:36:33.380 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:36:33.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c88ad4640 1 Processor -- start 2024-09-19T05:36:33.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c88ad4640 1 -- start start 2024-09-19T05:36:33.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c88ad4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d4fb0 0x7f2c840d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c88ad4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2c840d13c0 0x7f2c8406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c88ad4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c840d35a0 con 0x7f2c8415e690 2024-09-19T05:36:33.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c88ad4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2c840d32c0 con 0x7f2c840d13c0 2024-09-19T05:36:33.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c88ad4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8406d040 con 0x7f2c840d4fb0 2024-09-19T05:36:33.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c81d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d4fb0 0x7f2c840d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c82d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2c840d13c0 0x7f2c8406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c81d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d4fb0 0x7f2c840d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:54450/0 (socket says 172.21.15.67:54450) 2024-09-19T05:36:33.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c81d9b640 1 -- 172.21.15.67:0/947416588 learned_addr learned my addr 172.21.15.67:0/947416588 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:33.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c82d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2c840d13c0 0x7f2c8406db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:57264/0 (socket says 172.21.15.67:57264) 2024-09-19T05:36:33.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c82d9d640 1 -- 172.21.15.67:0/947416588 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d4fb0 msgr2=0x7f2c840d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:33.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c82d9d640 1 --2- 172.21.15.67:0/947416588 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d4fb0 0x7f2c840d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c82d9d640 1 -- 172.21.15.67:0/947416588 >> v1:172.21.15.97:6789/0 conn(0x7f2c8415e690 legacy=0x7f2c840d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c82d9d640 1 -- 172.21.15.67:0/947416588 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8406d320 con 0x7f2c840d13c0 2024-09-19T05:36:33.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.497+0000 7f2c81d9b640 1 --2- 172.21.15.67:0/947416588 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d4fb0 0x7f2c840d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:36:33.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c82d9d640 1 --2- 172.21.15.67:0/947416588 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c840d13c0 0x7f2c8406db20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009d90 tx=0x7f2c7c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=910274012c146b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:33.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c8159a640 1 -- 172.21.15.67:0/947416588 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c0b2070 con 0x7f2c840d13c0 2024-09-19T05:36:33.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c8159a640 1 -- 172.21.15.67:0/947416588 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7c0a58c0 con 0x7f2c840d13c0 2024-09-19T05:36:33.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c8159a640 1 -- 172.21.15.67:0/947416588 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c0a5c90 con 0x7f2c840d13c0 2024-09-19T05:36:33.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c88ad4640 1 -- 172.21.15.67:0/947416588 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c840d13c0 msgr2=0x7f2c8406db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c88ad4640 1 --2- 172.21.15.67:0/947416588 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c840d13c0 0x7f2c8406db20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009d90 tx=0x7f2c7c01c970 comp rx=0 tx=0).stop 2024-09-19T05:36:33.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c88ad4640 1 -- 172.21.15.67:0/947416588 shutdown_connections 2024-09-19T05:36:33.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c88ad4640 1 --2- 172.21.15.67:0/947416588 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c840d13c0 0x7f2c8406db20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c88ad4640 1 --2- 172.21.15.67:0/947416588 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d4fb0 0x7f2c840d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c88ad4640 1 -- 172.21.15.67:0/947416588 >> 172.21.15.67:0/947416588 conn(0x7f2c840d4490 msgr2=0x7f2c840d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:33.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c88ad4640 1 -- 172.21.15.67:0/947416588 shutdown_connections 2024-09-19T05:36:33.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.501+0000 7f2c88ad4640 1 -- 172.21.15.67:0/947416588 wait complete. 2024-09-19T05:36:33.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 Processor -- start 2024-09-19T05:36:33.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 -- start start 2024-09-19T05:36:33.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d13c0 0x7f2c840cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c840d4fb0 0x7f2c84154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c8415e690 0x7f2c840b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8406ec00 con 0x7f2c840d4fb0 2024-09-19T05:36:33.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8406ea80 con 0x7f2c8415e690 2024-09-19T05:36:33.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8416b250 con 0x7f2c840d13c0 2024-09-19T05:36:33.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c81d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c840d4fb0 0x7f2c84154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c81d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c840d4fb0 0x7f2c84154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45580/0 (socket says 172.21.15.67:45580) 2024-09-19T05:36:33.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c81d9b640 1 -- 172.21.15.67:0/1540708722 learned_addr learned my addr 172.21.15.67:0/1540708722 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c82d9d640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c8415e690 0x7f2c840b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c8259c640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d13c0 0x7f2c840cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c81d9b640 1 -- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d13c0 msgr2=0x7f2c840cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c81d9b640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d13c0 0x7f2c840cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c81d9b640 1 -- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c8415e690 msgr2=0x7f2c840b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c81d9b640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c8415e690 0x7f2c840b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c81d9b640 1 -- 172.21.15.67:0/1540708722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c841609a0 con 0x7f2c840d4fb0 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c81d9b640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c840d4fb0 0x7f2c84154520 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800ea00 tx=0x7f2c7800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c72ffd640 1 -- 172.21.15.67:0/1540708722 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78017070 con 0x7f2c840d4fb0 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 -- 172.21.15.67:0/1540708722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c84160c50 con 0x7f2c840d4fb0 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c72ffd640 1 -- 172.21.15.67:0/1540708722 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7800ca60 con 0x7f2c840d4fb0 2024-09-19T05:36:33.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c72ffd640 1 -- 172.21.15.67:0/1540708722 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800ce10 con 0x7f2c840d4fb0 2024-09-19T05:36:33.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 -- 172.21.15.67:0/1540708722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c84161210 con 0x7f2c840d4fb0 2024-09-19T05:36:33.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.505+0000 7f2c88ad4640 1 -- 172.21.15.67:0/1540708722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8406db20 con 0x7f2c840d4fb0 2024-09-19T05:36:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.509+0000 7f2c72ffd640 1 -- 172.21.15.67:0/1540708722 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c7801a070 con 0x7f2c840d4fb0 2024-09-19T05:36:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.509+0000 7f2c72ffd640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c640678c0 0x7f2c64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.509+0000 7f2c72ffd640 1 -- 172.21.15.67:0/1540708722 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2c78085d30 con 0x7f2c840d4fb0 2024-09-19T05:36:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.509+0000 7f2c8259c640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c640678c0 0x7f2c64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.509+0000 7f2c8259c640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c640678c0 0x7f2c64069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2c740015b0 tx=0x7f2c74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:33.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.513+0000 7f2c72ffd640 1 -- 172.21.15.67:0/1540708722 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2c78056010 con 0x7f2c840d4fb0 2024-09-19T05:36:33.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:33.709+0000 7f2c88ad4640 1 -- 172.21.15.67:0/1540708722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2c840b6550 con 0x7f2c840d4fb0 2024-09-19T05:36:34.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.717+0000 7f2c72ffd640 1 -- 172.21.15.67:0/1540708722 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7f2c7805a310 con 0x7f2c840d4fb0 2024-09-19T05:36:34.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 -- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c640678c0 msgr2=0x7f2c64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c640678c0 0x7f2c64069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2c740015b0 tx=0x7f2c74009040 comp rx=0 tx=0).stop 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 -- 172.21.15.67:0/1540708722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c840d4fb0 msgr2=0x7f2c84154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c840d4fb0 0x7f2c84154520 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800ea00 tx=0x7f2c7800eec0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 -- 172.21.15.67:0/1540708722 shutdown_connections 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c8415e690 0x7f2c840b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c840d4fb0 0x7f2c84154520 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c640678c0 0x7f2c64069d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 --2- 172.21.15.67:0/1540708722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c840d13c0 0x7f2c840cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 -- 172.21.15.67:0/1540708722 >> 172.21.15.67:0/1540708722 conn(0x7f2c840d4490 msgr2=0x7f2c840b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 -- 172.21.15.67:0/1540708722 shutdown_connections 2024-09-19T05:36:34.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.721+0000 7f2c88ad4640 1 -- 172.21.15.67:0/1540708722 wait complete. 2024-09-19T05:36:34.747 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:36:34.747 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:36:34.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe710482640 1 Processor -- start 2024-09-19T05:36:34.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe710482640 1 -- start start 2024-09-19T05:36:34.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe710482640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe70815ea60 0x7fe70806d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:34.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe710482640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 0x7fe7080b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:34.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe710482640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7080cf1a0 con 0x7fe7080b3600 2024-09-19T05:36:34.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe710482640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe7080cf480 con 0x7fe70815ea60 2024-09-19T05:36:34.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe710482640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe7080cf760 con 0x7fe7080cff60 2024-09-19T05:36:34.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe70e21e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe70815ea60 0x7fe70806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:34.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe70da1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 0x7fe7080b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:34.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe70e21e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe70815ea60 0x7fe70806d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:57274/0 (socket says 172.21.15.67:57274) 2024-09-19T05:36:34.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe70ea1f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe7080b3600 0x7fe7081625d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:52928/0 (socket says 172.21.15.67:52928) 2024-09-19T05:36:34.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe70e21e640 1 -- 172.21.15.67:0/2369901389 learned_addr learned my addr 172.21.15.67:0/2369901389 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:34.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe70da1d640 1 -- 172.21.15.67:0/2369901389 >> v2:172.21.15.97:3300/0 conn(0x7fe70815ea60 msgr2=0x7fe70806d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:34.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe70da1d640 1 --2- 172.21.15.67:0/2369901389 >> v2:172.21.15.97:3300/0 conn(0x7fe70815ea60 0x7fe70806d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe70da1d640 1 -- 172.21.15.67:0/2369901389 >> v1:172.21.15.97:6789/0 conn(0x7fe7080b3600 legacy=0x7fe7081625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.869+0000 7fe70da1d640 1 -- 172.21.15.67:0/2369901389 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7080b3340 con 0x7fe7080cff60 2024-09-19T05:36:34.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe70da1d640 1 --2- 172.21.15.67:0/2369901389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 0x7fe7080b6560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80097c0 tx=0x7fe6f801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a972a53725b1a1e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:34.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe70d21c640 1 -- 172.21.15.67:0/2369901389 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80b0070 con 0x7fe7080cff60 2024-09-19T05:36:34.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe70d21c640 1 -- 172.21.15.67:0/2369901389 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f80ab600 con 0x7fe7080cff60 2024-09-19T05:36:34.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe70d21c640 1 -- 172.21.15.67:0/2369901389 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80ab9d0 con 0x7fe7080cff60 2024-09-19T05:36:34.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe710482640 1 -- 172.21.15.67:0/2369901389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 msgr2=0x7fe7080b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe710482640 1 --2- 172.21.15.67:0/2369901389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 0x7fe7080b6560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80097c0 tx=0x7fe6f801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe710482640 1 -- 172.21.15.67:0/2369901389 shutdown_connections 2024-09-19T05:36:34.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe710482640 1 --2- 172.21.15.67:0/2369901389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 0x7fe7080b6560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe710482640 1 --2- 172.21.15.67:0/2369901389 >> v2:172.21.15.97:3300/0 conn(0x7fe70815ea60 0x7fe70806d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe710482640 1 -- 172.21.15.67:0/2369901389 >> 172.21.15.67:0/2369901389 conn(0x7fe7080d1620 msgr2=0x7fe7080d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:34.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe710482640 1 -- 172.21.15.67:0/2369901389 shutdown_connections 2024-09-19T05:36:34.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.873+0000 7fe710482640 1 -- 172.21.15.67:0/2369901389 wait complete. 2024-09-19T05:36:34.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 Processor -- start 2024-09-19T05:36:34.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 -- start start 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7080b3600 0x7fe70815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 0x7fe708153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70815ea60 0x7fe7081569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe70816bca0 con 0x7fe7080b3600 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe70816bb20 con 0x7fe70815ea60 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe70816be20 con 0x7fe7080cff60 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70e21e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7080b3600 0x7fe70815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70e21e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7080b3600 0x7fe70815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45586/0 (socket says 172.21.15.67:45586) 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70e21e640 1 -- 172.21.15.67:0/583518426 learned_addr learned my addr 172.21.15.67:0/583518426 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70da1d640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 0x7fe708153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70ea1f640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70815ea60 0x7fe7081569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70e21e640 1 -- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 msgr2=0x7fe708153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70e21e640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 0x7fe708153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70e21e640 1 -- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70815ea60 msgr2=0x7fe7081569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70e21e640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70815ea60 0x7fe7081569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70e21e640 1 -- 172.21.15.67:0/583518426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe708161c30 con 0x7fe7080b3600 2024-09-19T05:36:34.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70da1d640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 0x7fe708153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:34.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe70e21e640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7080b3600 0x7fe70815b200 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe70400e8c0 tx=0x7fe70400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:34.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe6feffd640 1 -- 172.21.15.67:0/583518426 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704017070 con 0x7fe7080b3600 2024-09-19T05:36:34.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe6feffd640 1 -- 172.21.15.67:0/583518426 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70400c940 con 0x7fe7080b3600 2024-09-19T05:36:34.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 -- 172.21.15.67:0/583518426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe708161f10 con 0x7fe7080b3600 2024-09-19T05:36:34.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe6feffd640 1 -- 172.21.15.67:0/583518426 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70400cd30 con 0x7fe7080b3600 2024-09-19T05:36:34.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 -- 172.21.15.67:0/583518426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe708161930 con 0x7fe7080b3600 2024-09-19T05:36:34.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.877+0000 7fe710482640 1 -- 172.21.15.67:0/583518426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7080b6560 con 0x7fe7080b3600 2024-09-19T05:36:34.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.881+0000 7fe6feffd640 1 -- 172.21.15.67:0/583518426 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe70401a070 con 0x7fe7080b3600 2024-09-19T05:36:34.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.881+0000 7fe6feffd640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6ec0678c0 0x7fe6ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:34.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.881+0000 7fe6feffd640 1 -- 172.21.15.67:0/583518426 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fe7040860a0 con 0x7fe7080b3600 2024-09-19T05:36:34.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.881+0000 7fe70da1d640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6ec0678c0 0x7fe6ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:34.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.881+0000 7fe70da1d640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6ec0678c0 0x7fe6ec069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80ad000 tx=0x7fe6f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:34.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:34.885+0000 7fe6feffd640 1 -- 172.21.15.67:0/583518426 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe704056ae0 con 0x7fe7080b3600 2024-09-19T05:36:35.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.077+0000 7fe710482640 1 -- 172.21.15.67:0/583518426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe7080b9e20 con 0x7fe7080b3600 2024-09-19T05:36:35.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.721+0000 7fe6feffd640 1 -- 172.21.15.67:0/583518426 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7fe7040563e0 con 0x7fe7080b3600 2024-09-19T05:36:35.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 -- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6ec0678c0 msgr2=0x7fe6ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:35.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6ec0678c0 0x7fe6ec069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80ad000 tx=0x7fe6f8008040 comp rx=0 tx=0).stop 2024-09-19T05:36:35.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 -- 172.21.15.67:0/583518426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7080b3600 msgr2=0x7fe70815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7080b3600 0x7fe70815b200 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe70400e8c0 tx=0x7fe70400ed80 comp rx=0 tx=0).stop 2024-09-19T05:36:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 -- 172.21.15.67:0/583518426 shutdown_connections 2024-09-19T05:36:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70815ea60 0x7fe7081569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6ec0678c0 0x7fe6ec069d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7080cff60 0x7fe708153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 --2- 172.21.15.67:0/583518426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7080b3600 0x7fe70815b200 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 -- 172.21.15.67:0/583518426 >> 172.21.15.67:0/583518426 conn(0x7fe7080d1620 msgr2=0x7fe7080b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 -- 172.21.15.67:0/583518426 shutdown_connections 2024-09-19T05:36:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.725+0000 7fe710482640 1 -- 172.21.15.67:0/583518426 wait complete. 2024-09-19T05:36:35.749 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:36:35.750 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:36:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf5a2d7640 1 Processor -- start 2024-09-19T05:36:35.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf5a2d7640 1 -- start start 2024-09-19T05:36:35.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf5a2d7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54072590 0x7fdf54166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:35.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf5a2d7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf540b3860 con 0x7fdf540b4900 2024-09-19T05:36:35.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf5a2d7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf540b3b40 con 0x7fdf5415b1e0 2024-09-19T05:36:35.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf5a2d7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdf5415b5c0 con 0x7fdf54072590 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf537fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdf540b4900 0x7fdf54071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46134/0 (socket says 172.21.15.67:46134) 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf537fe640 1 -- 172.21.15.67:0/3983503740 learned_addr learned my addr 172.21.15.67:0/3983503740 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf58874640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54072590 0x7fdf54166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193865889 0 0) 0x7fdf540b3860 con 0x7fdf540b4900 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf3c003530 con 0x7fdf540b4900 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2483075898 0 0) 0x7fdf3c003530 con 0x7fdf540b4900 2024-09-19T05:36:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54072590 msgr2=0x7fdf54166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54072590 0x7fdf54166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 >> v1:172.21.15.97:6789/0 conn(0x7fdf5415b1e0 legacy=0x7fdf540b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf540b3e20 con 0x7fdf540b4900 2024-09-19T05:36:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fdf48001680 con 0x7fdf540b4900 2024-09-19T05:36:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 >> v1:172.21.15.67:6789/0 conn(0x7fdf540b4900 legacy=0x7fdf54071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 0x7fdf3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c004810 0x7fdf3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54072590 0x7fdf3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5415b5c0 con 0x7fdf3c0039f0 2024-09-19T05:36:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c00bab0 con 0x7fdf3c004810 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3c00bcb0 con 0x7fdf54072590 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf53fff640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 0x7fdf3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf58874640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54072590 0x7fdf3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf537fe640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c004810 0x7fdf3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf53fff640 1 -- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54072590 msgr2=0x7fdf3c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf53fff640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54072590 0x7fdf3c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf53fff640 1 -- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c004810 msgr2=0x7fdf3c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf53fff640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c004810 0x7fdf3c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.873+0000 7fdf53fff640 1 -- 172.21.15.67:0/3983503740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c003530 con 0x7fdf3c0039f0 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf53fff640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 0x7fdf3c003e10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdf44001750 tx=0x7fdf4401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589aab534262a21f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf440013a0 con 0x7fdf3c0039f0 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf440052f0 con 0x7fdf3c0039f0 2024-09-19T05:36:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf52ffd640 1 -- 172.21.15.67:0/3983503740 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf440a4e60 con 0x7fdf3c0039f0 2024-09-19T05:36:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/3983503740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 msgr2=0x7fdf3c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf5a2d7640 1 --2- 172.21.15.67:0/3983503740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 0x7fdf3c003e10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdf44001750 tx=0x7fdf4401c390 comp rx=0 tx=0).stop 2024-09-19T05:36:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf58874640 1 -- 172.21.15.67:0/3983503740 reap_dead start 2024-09-19T05:36:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/3983503740 shutdown_connections 2024-09-19T05:36:35.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/3983503740 >> 172.21.15.67:0/3983503740 conn(0x7fdf540d0080 msgr2=0x7fdf540d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:35.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/3983503740 shutdown_connections 2024-09-19T05:36:35.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/3983503740 wait complete. 2024-09-19T05:36:35.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf5a2d7640 1 Processor -- start 2024-09-19T05:36:35.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.877+0000 7fdf5a2d7640 1 -- start start 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf5a2d7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 0x7fdf5409d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf5a2d7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf54159b00 0x7fdf54149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf5a2d7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54149cc0 0x7fdf54158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf5a2d7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5406f210 con 0x7fdf3c0039f0 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf5a2d7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5406f090 con 0x7fdf54159b00 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf5a2d7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdf5406f390 con 0x7fdf54149cc0 2024-09-19T05:36:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 0x7fdf5409d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 0x7fdf5409d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45592/0 (socket says 172.21.15.67:45592) 2024-09-19T05:36:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf53fff640 1 -- 172.21.15.67:0/1896179298 learned_addr learned my addr 172.21.15.67:0/1896179298 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf537fe640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf54159b00 0x7fdf54149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf58874640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54149cc0 0x7fdf54158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf53fff640 1 -- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54149cc0 msgr2=0x7fdf54158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf53fff640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54149cc0 0x7fdf54158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf53fff640 1 -- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf54159b00 msgr2=0x7fdf54149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf53fff640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf54159b00 0x7fdf54149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf53fff640 1 -- 172.21.15.67:0/1896179298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5409daa0 con 0x7fdf3c0039f0 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf58874640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54149cc0 0x7fdf54158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:35.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf53fff640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 0x7fdf5409d560 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdf44005040 tx=0x7fdf3c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:35.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf50ff9640 1 -- 172.21.15.67:0/1896179298 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf440ba020 con 0x7fdf3c0039f0 2024-09-19T05:36:35.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf50ff9640 1 -- 172.21.15.67:0/1896179298 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf44000ee0 con 0x7fdf3c0039f0 2024-09-19T05:36:35.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/1896179298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5414a1f0 con 0x7fdf3c0039f0 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf50ff9640 1 -- 172.21.15.67:0/1896179298 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44007a40 con 0x7fdf3c0039f0 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/1896179298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5414a7b0 con 0x7fdf3c0039f0 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/1896179298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf54071e80 con 0x7fdf3c0039f0 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf50ff9640 1 -- 172.21.15.67:0/1896179298 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf440bd020 con 0x7fdf3c0039f0 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf50ff9640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf400678f0 0x7fdf40069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf50ff9640 1 -- 172.21.15.67:0/1896179298 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fdf4411fc40 con 0x7fdf3c0039f0 2024-09-19T05:36:35.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.881+0000 7fdf537fe640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf400678f0 0x7fdf40069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:35.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.885+0000 7fdf537fe640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf400678f0 0x7fdf40069db0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdf48001ec0 tx=0x7fdf48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:35.885+0000 7fdf50ff9640 1 -- 172.21.15.67:0/1896179298 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fdf440c4030 con 0x7fdf3c0039f0 2024-09-19T05:36:36.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.081+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/1896179298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf540b4e30 con 0x7fdf3c0039f0 2024-09-19T05:36:36.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.081+0000 7fdf50ff9640 1 -- 172.21.15.67:0/1896179298 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5217 (secure 0 0 0) 0x7fdf440160d0 con 0x7fdf3c0039f0 2024-09-19T05:36:36.087 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:36.087 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":24,"btime":"2024-09-19T05:36:35:721412+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/872634022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":872634022},{"type":"v1","addr":"172.21.15.97:6836","nonce":872634022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2340749382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2340749382},{"type":"v1","addr":"172.21.15.97:6837","nonce":2340749382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1455090407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1455090407},{"type":"v1","addr":"172.21.15.67:6833","nonce":1455090407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:36:32.070002+0000","modified":"2024-09-19T05:36:35.084581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5364":{"gid":5364,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/985983096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":985983096},{"type":"v1","addr":"172.21.15.67:6835","nonce":985983096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5364,"qdb_cluster":[5364]},"id":3}]} 2024-09-19T05:36:36.087 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf400678f0 msgr2=0x7fdf40069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf400678f0 0x7fdf40069db0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdf48001ec0 tx=0x7fdf48009040 comp rx=0 tx=0).stop 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/1896179298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 msgr2=0x7fdf5409d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 0x7fdf5409d560 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdf44005040 tx=0x7fdf3c005840 comp rx=0 tx=0).stop 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/1896179298 shutdown_connections 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf400678f0 0x7fdf40069db0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf54149cc0 0x7fdf54158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf54159b00 0x7fdf54149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 --2- 172.21.15.67:0/1896179298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf3c0039f0 0x7fdf5409d560 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/1896179298 >> 172.21.15.67:0/1896179298 conn(0x7fdf540d0080 msgr2=0x7fdf5406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/1896179298 shutdown_connections 2024-09-19T05:36:36.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.085+0000 7fdf5a2d7640 1 -- 172.21.15.67:0/1896179298 wait complete. 2024-09-19T05:36:36.104 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:36:36.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb3a6340640 1 Processor -- start 2024-09-19T05:36:36.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb3a6340640 1 -- start start 2024-09-19T05:36:36.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb3a6340640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb3a006f460 0x7fb3a006f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb3a6340640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a006e3c0 con 0x7fb3a006dde0 2024-09-19T05:36:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb3a6340640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a006e6a0 con 0x7fb3a015c030 2024-09-19T05:36:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb3a6340640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a006e980 con 0x7fb3a006f460 2024-09-19T05:36:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39f7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb3a006dde0 0x7fb3a00b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46240/0 (socket says 172.21.15.67:46240) 2024-09-19T05:36:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39f7fe640 1 -- 172.21.15.67:0/1338198258 learned_addr learned my addr 172.21.15.67:0/1338198258 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb3a48dd640 1 --2- 172.21.15.67:0/1338198258 >> v2:172.21.15.97:3300/0 conn(0x7fb3a006f460 0x7fb3a006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437186589 0 0) 0x7fb3a006e3c0 con 0x7fb3a006dde0 2024-09-19T05:36:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb380003530 con 0x7fb3a006dde0 2024-09-19T05:36:36.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 349974556 0 0) 0x7fb380003530 con 0x7fb3a006dde0 2024-09-19T05:36:36.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 >> v2:172.21.15.97:3300/0 conn(0x7fb3a006f460 msgr2=0x7fb3a006f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 --2- 172.21.15.67:0/1338198258 >> v2:172.21.15.97:3300/0 conn(0x7fb3a006f460 0x7fb3a006f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 >> v1:172.21.15.97:6789/0 conn(0x7fb3a015c030 legacy=0x7fb3a015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a006ec60 con 0x7fb3a006dde0 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fb398001a00 con 0x7fb3a006dde0 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 >> v1:172.21.15.67:6789/0 conn(0x7fb3a006dde0 legacy=0x7fb3a00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3800039c0 0x7fb380003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb380004810 0x7fb380004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3800051d0 0x7fb38000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a006e980 con 0x7fb380004810 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb38000c070 con 0x7fb3800039c0 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb38000c270 con 0x7fb3800051d0 2024-09-19T05:36:36.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39f7fe640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb380004810 0x7fb380004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39ffff640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3800039c0 0x7fb380003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb3a48dd640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3800051d0 0x7fb38000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39f7fe640 1 -- 172.21.15.67:0/1338198258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3800051d0 msgr2=0x7fb38000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39f7fe640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3800051d0 0x7fb38000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39f7fe640 1 -- 172.21.15.67:0/1338198258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3800039c0 msgr2=0x7fb380003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39f7fe640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3800039c0 0x7fb380003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb39f7fe640 1 -- 172.21.15.67:0/1338198258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb380003530 con 0x7fb380004810 2024-09-19T05:36:36.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.225+0000 7fb3a48dd640 1 -- 172.21.15.67:0/1338198258 reap_dead start 2024-09-19T05:36:36.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb39f7fe640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb380004810 0x7fb380004c90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb39800a840 tx=0x7fb39801fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e9551cc6012d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39800a460 con 0x7fb380004810 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3980aa690 con 0x7fb380004810 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb39effd640 1 -- 172.21.15.67:0/1338198258 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3980aaac0 con 0x7fb380004810 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 -- 172.21.15.67:0/1338198258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb380004810 msgr2=0x7fb380004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb380004810 0x7fb380004c90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb39800a840 tx=0x7fb39801fa40 comp rx=0 tx=0).stop 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 -- 172.21.15.67:0/1338198258 shutdown_connections 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 --2- 172.21.15.67:0/1338198258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb380004810 0x7fb380004c90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 -- 172.21.15.67:0/1338198258 >> 172.21.15.67:0/1338198258 conn(0x7fb3a00d0080 msgr2=0x7fb3a00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 -- 172.21.15.67:0/1338198258 shutdown_connections 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 -- 172.21.15.67:0/1338198258 wait complete. 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 Processor -- start 2024-09-19T05:36:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 -- start start 2024-09-19T05:36:36.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb380004810 0x7fb3a00af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a0099a10 0x7fb3a015c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a014c3b0 0x7fb3a00b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a015c590 con 0x7fb3a014c3b0 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a015c410 con 0x7fb3a0099a10 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a6340640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a006f870 con 0x7fb380004810 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a48dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a014c3b0 0x7fb3a00b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a48dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a014c3b0 0x7fb3a00b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58260/0 (socket says 172.21.15.67:58260) 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.229+0000 7fb3a48dd640 1 -- 172.21.15.67:0/2879494208 learned_addr learned my addr 172.21.15.67:0/2879494208 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb39f7fe640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a0099a10 0x7fb3a015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb39ffff640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb380004810 0x7fb3a00af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb3a48dd640 1 -- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb380004810 msgr2=0x7fb3a00af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb3a48dd640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb380004810 0x7fb3a00af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb3a48dd640 1 -- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a0099a10 msgr2=0x7fb3a015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb3a48dd640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a0099a10 0x7fb3a015c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb3a48dd640 1 -- 172.21.15.67:0/2879494208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a01f0450 con 0x7fb3a014c3b0 2024-09-19T05:36:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb3a48dd640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a014c3b0 0x7fb3a00b0da0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb390011490 tx=0x7fb390011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb39cff9640 1 -- 172.21.15.67:0/2879494208 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390019020 con 0x7fb3a014c3b0 2024-09-19T05:36:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb39cff9640 1 -- 172.21.15.67:0/2879494208 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb390003620 con 0x7fb3a014c3b0 2024-09-19T05:36:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb39cff9640 1 -- 172.21.15.67:0/2879494208 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390003a50 con 0x7fb3a014c3b0 2024-09-19T05:36:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb3a6340640 1 -- 172.21.15.67:0/2879494208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a01f0730 con 0x7fb3a014c3b0 2024-09-19T05:36:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb3a6340640 1 -- 172.21.15.67:0/2879494208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a01f0cf0 con 0x7fb3a014c3b0 2024-09-19T05:36:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb3a6340640 1 -- 172.21.15.67:0/2879494208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a006fc00 con 0x7fb3a014c3b0 2024-09-19T05:36:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb39cff9640 1 -- 172.21.15.67:0/2879494208 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb39001c020 con 0x7fb3a014c3b0 2024-09-19T05:36:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb39cff9640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 0x7fb384069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb39cff9640 1 -- 172.21.15.67:0/2879494208 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fb390086420 con 0x7fb3a014c3b0 2024-09-19T05:36:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.233+0000 7fb39ffff640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 0x7fb384069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.237+0000 7fb39ffff640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 0x7fb384069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb3a006a420 tx=0x7fb388009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.237+0000 7fb39cff9640 1 -- 172.21.15.67:0/2879494208 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb390023020 con 0x7fb3a014c3b0 2024-09-19T05:36:36.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.401+0000 7fb3a6340640 1 -- 172.21.15.67:0/2879494208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3a00d0f20 con 0x7fb3a014c3b0 2024-09-19T05:36:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.405+0000 7fb39cff9640 1 -- 172.21.15.67:0/2879494208 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+16966 (secure 0 0 0) 0x7fb390056dd0 con 0x7fb3a014c3b0 2024-09-19T05:36:36.410 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:36.410 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":55,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:36:33.701186+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:36:29.754631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-19T05:36:31.068405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:36:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 -- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 msgr2=0x7fb384069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 0x7fb384069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb3a006a420 tx=0x7fb388009040 comp rx=0 tx=0).stop 2024-09-19T05:36:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 -- 172.21.15.67:0/2879494208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a014c3b0 msgr2=0x7fb3a00b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a014c3b0 0x7fb3a00b0da0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb390011490 tx=0x7fb390011950 comp rx=0 tx=0).stop 2024-09-19T05:36:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 -- 172.21.15.67:0/2879494208 shutdown_connections 2024-09-19T05:36:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a014c3b0 0x7fb3a00b0da0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a0099a10 0x7fb3a015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 0x7fb384069d80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 --2- 172.21.15.67:0/2879494208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb380004810 0x7fb3a00af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 -- 172.21.15.67:0/2879494208 >> 172.21.15.67:0/2879494208 conn(0x7fb3a00d0080 msgr2=0x7fb3a013e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 -- 172.21.15.67:0/2879494208 shutdown_connections 2024-09-19T05:36:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.409+0000 7fb3a6340640 1 -- 172.21.15.67:0/2879494208 wait complete. 2024-09-19T05:36:36.429 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:36:36.430 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:36:36.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52f0c0a640 1 Processor -- start 2024-09-19T05:36:36.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52f0c0a640 1 -- start start 2024-09-19T05:36:36.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52f0c0a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f52ec15c030 0x7f52ec06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52f0c0a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec06f460 0x7f52ec06f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52f0c0a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52ec06e3c0 con 0x7f52ec15d1d0 2024-09-19T05:36:36.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52f0c0a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f52ec06e6a0 con 0x7f52ec15c030 2024-09-19T05:36:36.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52f0c0a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f52ec06e980 con 0x7f52ec06f460 2024-09-19T05:36:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52ea59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f52ec15c030 0x7f52ec06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52ead9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec06f460 0x7f52ec06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52ead9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec06f460 0x7f52ec06f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:41272/0 (socket says 172.21.15.67:41272) 2024-09-19T05:36:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52e9d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f52ec15d1d0 0x7f52ec0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:41866/0 (socket says 172.21.15.67:41866) 2024-09-19T05:36:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52ead9d640 1 -- 172.21.15.67:0/1486810072 learned_addr learned my addr 172.21.15.67:0/1486810072 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52ead9d640 1 -- 172.21.15.67:0/1486810072 >> v2:172.21.15.97:3300/0 conn(0x7f52ec15c030 msgr2=0x7f52ec06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52ead9d640 1 --2- 172.21.15.67:0/1486810072 >> v2:172.21.15.97:3300/0 conn(0x7f52ec15c030 0x7f52ec06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52ead9d640 1 -- 172.21.15.67:0/1486810072 >> v1:172.21.15.97:6789/0 conn(0x7f52ec15d1d0 legacy=0x7f52ec0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.549+0000 7f52ead9d640 1 -- 172.21.15.67:0/1486810072 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec06ec60 con 0x7f52ec06f460 2024-09-19T05:36:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52ead9d640 1 --2- 172.21.15.67:0/1486810072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec06f460 0x7f52ec06f890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009e50 tx=0x7f52e401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f21f7a9e1910a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52e959a640 1 -- 172.21.15.67:0/1486810072 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e40a5710 con 0x7f52ec06f460 2024-09-19T05:36:36.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52e959a640 1 -- 172.21.15.67:0/1486810072 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e40a58b0 con 0x7f52ec06f460 2024-09-19T05:36:36.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52e959a640 1 -- 172.21.15.67:0/1486810072 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e40a5c80 con 0x7f52ec06f460 2024-09-19T05:36:36.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52f0c0a640 1 -- 172.21.15.67:0/1486810072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec06f460 msgr2=0x7f52ec06f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52f0c0a640 1 --2- 172.21.15.67:0/1486810072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec06f460 0x7f52ec06f890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009e50 tx=0x7f52e401ca30 comp rx=0 tx=0).stop 2024-09-19T05:36:36.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52f0c0a640 1 -- 172.21.15.67:0/1486810072 shutdown_connections 2024-09-19T05:36:36.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52f0c0a640 1 --2- 172.21.15.67:0/1486810072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec06f460 0x7f52ec06f890 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52f0c0a640 1 --2- 172.21.15.67:0/1486810072 >> v2:172.21.15.97:3300/0 conn(0x7f52ec15c030 0x7f52ec06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52f0c0a640 1 -- 172.21.15.67:0/1486810072 >> 172.21.15.67:0/1486810072 conn(0x7f52ec0d0080 msgr2=0x7f52ec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:36.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52f0c0a640 1 -- 172.21.15.67:0/1486810072 shutdown_connections 2024-09-19T05:36:36.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.553+0000 7f52f0c0a640 1 -- 172.21.15.67:0/1486810072 wait complete. 2024-09-19T05:36:36.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 Processor -- start 2024-09-19T05:36:36.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 -- start start 2024-09-19T05:36:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52ec06f460 0x7f52ec09d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec15c030 0x7f52ec14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52ec15d1d0 0x7f52ec09a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec15c590 con 0x7f52ec06f460 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec15c410 con 0x7f52ec15d1d0 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f52ec1690e0 con 0x7f52ec15c030 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52ea59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52ec06f460 0x7f52ec09d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52ea59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52ec06f460 0x7f52ec09d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58262/0 (socket says 172.21.15.67:58262) 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52ea59c640 1 -- 172.21.15.67:0/2115636265 learned_addr learned my addr 172.21.15.67:0/2115636265 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52e9d9b640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec15c030 0x7f52ec14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52ead9d640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52ec15d1d0 0x7f52ec09a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52ea59c640 1 -- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec15c030 msgr2=0x7f52ec14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52ea59c640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec15c030 0x7f52ec14f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52ea59c640 1 -- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52ec15d1d0 msgr2=0x7f52ec09a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52ea59c640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52ec15d1d0 0x7f52ec09a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52ea59c640 1 -- 172.21.15.67:0/2115636265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec14fb20 con 0x7f52ec06f460 2024-09-19T05:36:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52ea59c640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52ec06f460 0x7f52ec09d2d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00e930 tx=0x7f52dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52daffd640 1 -- 172.21.15.67:0/2115636265 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc017070 con 0x7f52ec06f460 2024-09-19T05:36:36.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52daffd640 1 -- 172.21.15.67:0/2115636265 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52dc00c9a0 con 0x7f52ec06f460 2024-09-19T05:36:36.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52daffd640 1 -- 172.21.15.67:0/2115636265 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc00cd50 con 0x7f52ec06f460 2024-09-19T05:36:36.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 -- 172.21.15.67:0/2115636265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec09ad30 con 0x7f52ec06f460 2024-09-19T05:36:36.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 -- 172.21.15.67:0/2115636265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec09b2b0 con 0x7f52ec06f460 2024-09-19T05:36:36.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.557+0000 7f52f0c0a640 1 -- 172.21.15.67:0/2115636265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec06f890 con 0x7f52ec06f460 2024-09-19T05:36:36.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.561+0000 7f52daffd640 1 -- 172.21.15.67:0/2115636265 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f52dc01a070 con 0x7f52ec06f460 2024-09-19T05:36:36.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.561+0000 7f52daffd640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52cc0678c0 0x7f52cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.561+0000 7f52daffd640 1 -- 172.21.15.67:0/2115636265 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f52dc085e50 con 0x7f52ec06f460 2024-09-19T05:36:36.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.561+0000 7f52e9d9b640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52cc0678c0 0x7f52cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.561+0000 7f52e9d9b640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52cc0678c0 0x7f52cc069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0afcf0 tx=0x7f52e0007cf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.565+0000 7f52daffd640 1 -- 172.21.15.67:0/2115636265 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f52dc0568c0 con 0x7f52ec06f460 2024-09-19T05:36:36.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.721+0000 7f52f0c0a640 1 -- 172.21.15.67:0/2115636265 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52ec152540 con 0x7f52cc0678c0 2024-09-19T05:36:36.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.745+0000 7f52daffd640 1 -- 172.21.15.67:0/2115636265 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7f52ec152540 con 0x7f52cc0678c0 2024-09-19T05:36:36.751 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:36.753 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:36:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 -- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52cc0678c0 msgr2=0x7f52cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52cc0678c0 0x7f52cc069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0afcf0 tx=0x7f52e0007cf0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 -- 172.21.15.67:0/2115636265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52ec06f460 msgr2=0x7f52ec09d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52ec06f460 0x7f52ec09d2d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00e930 tx=0x7f52dc00edf0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 -- 172.21.15.67:0/2115636265 shutdown_connections 2024-09-19T05:36:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52ec15d1d0 0x7f52ec09a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52cc0678c0 0x7f52cc069d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52ec15c030 0x7f52ec14f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 --2- 172.21.15.67:0/2115636265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52ec06f460 0x7f52ec09d2d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 -- 172.21.15.67:0/2115636265 >> 172.21.15.67:0/2115636265 conn(0x7f52ec0d0080 msgr2=0x7f52ec158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:36.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 -- 172.21.15.67:0/2115636265 shutdown_connections 2024-09-19T05:36:36.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.749+0000 7f52f0c0a640 1 -- 172.21.15.67:0/2115636265 wait complete. 2024-09-19T05:36:36.769 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-19T05:36:35.177374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":342980,"kb_used_data":6032,"kb_used_omap":12,"kb_used_meta":336755,"kb_avail":754631740,"statfs":{"total":773094113280,"available":772742901760,"internally_reserved":0,"allocated":6176768,"data_stored":3395978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":344837681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.499838"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695243+0000","last_change":"2024-09-19T05:36:31.695243+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695243+0000","last_undegraded":"2024-09-19T05:36:31.695243+0000","last_fullsized":"2024-09-19T05:36:31.695243+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.696564+0000","last_change":"2024-09-19T05:36:31.696564+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.696564+0000","last_undegraded":"2024-09-19T05:36:31.696564+0000","last_fullsized":"2024-09-19T05:36:31.696564+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704128+0000","last_change":"2024-09-19T05:36:31.704128+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704128+0000","last_undegraded":"2024-09-19T05:36:31.704128+0000","last_fullsized":"2024-09-19T05:36:31.704128+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695310+0000","last_change":"2024-09-19T05:36:31.695310+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695310+0000","last_undegraded":"2024-09-19T05:36:31.695310+0000","last_fullsized":"2024-09-19T05:36:31.695310+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.698377+0000","last_change":"2024-09-19T05:36:31.698377+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.698377+0000","last_undegraded":"2024-09-19T05:36:31.698377+0000","last_fullsized":"2024-09-19T05:36:31.698377+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694310+0000","last_change":"2024-09-19T05:36:31.694310+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694310+0000","last_undegraded":"2024-09-19T05:36:31.694310+0000","last_fullsized":"2024-09-19T05:36:31.694310+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702973+0000","last_change":"2024-09-19T05:36:31.702973+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702973+0000","last_undegraded":"2024-09-19T05:36:31.702973+0000","last_fullsized":"2024-09-19T05:36:31.702973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703561+0000","last_change":"2024-09-19T05:36:31.703561+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703561+0000","last_undegraded":"2024-09-19T05:36:31.703561+0000","last_fullsized":"2024-09-19T05:36:31.703561+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702176+0000","last_change":"2024-09-19T05:36:31.702176+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702176+0000","last_undegraded":"2024-09-19T05:36:31.702176+0000","last_fullsized":"2024-09-19T05:36:31.702176+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694587+0000","last_change":"2024-09-19T05:36:31.694587+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694587+0000","last_undegraded":"2024-09-19T05:36:31.694587+0000","last_fullsized":"2024-09-19T05:36:31.694587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695869+0000","last_change":"2024-09-19T05:36:31.695869+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695869+0000","last_undegraded":"2024-09-19T05:36:31.695869+0000","last_fullsized":"2024-09-19T05:36:31.695869+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702307+0000","last_change":"2024-09-19T05:36:31.702307+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702307+0000","last_undegraded":"2024-09-19T05:36:31.702307+0000","last_fullsized":"2024-09-19T05:36:31.702307+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693048+0000","last_change":"2024-09-19T05:36:31.693048+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693048+0000","last_undegraded":"2024-09-19T05:36:31.693048+0000","last_fullsized":"2024-09-19T05:36:31.693048+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.712302+0000","last_change":"2024-09-19T05:36:31.712302+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.712302+0000","last_undegraded":"2024-09-19T05:36:31.712302+0000","last_fullsized":"2024-09-19T05:36:31.712302+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695497+0000","last_change":"2024-09-19T05:36:31.695497+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695497+0000","last_undegraded":"2024-09-19T05:36:31.695497+0000","last_fullsized":"2024-09-19T05:36:31.695497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693291+0000","last_change":"2024-09-19T05:36:31.693291+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693291+0000","last_undegraded":"2024-09-19T05:36:31.693291+0000","last_fullsized":"2024-09-19T05:36:31.693291+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704335+0000","last_change":"2024-09-19T05:36:31.704335+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704335+0000","last_undegraded":"2024-09-19T05:36:31.704335+0000","last_fullsized":"2024-09-19T05:36:31.704335+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695472+0000","last_change":"2024-09-19T05:36:31.695472+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695472+0000","last_undegraded":"2024-09-19T05:36:31.695472+0000","last_fullsized":"2024-09-19T05:36:31.695472+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703533+0000","last_change":"2024-09-19T05:36:31.703533+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703533+0000","last_undegraded":"2024-09-19T05:36:31.703533+0000","last_fullsized":"2024-09-19T05:36:31.703533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.710477+0000","last_change":"2024-09-19T05:36:31.710477+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.710477+0000","last_undegraded":"2024-09-19T05:36:31.710477+0000","last_fullsized":"2024-09-19T05:36:31.710477+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.708401+0000","last_change":"2024-09-19T05:36:31.708401+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.708401+0000","last_undegraded":"2024-09-19T05:36:31.708401+0000","last_fullsized":"2024-09-19T05:36:31.708401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701714+0000","last_change":"2024-09-19T05:36:31.701714+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701714+0000","last_undegraded":"2024-09-19T05:36:31.701714+0000","last_fullsized":"2024-09-19T05:36:31.701714+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695345+0000","last_change":"2024-09-19T05:36:31.695345+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695345+0000","last_undegraded":"2024-09-19T05:36:31.695345+0000","last_fullsized":"2024-09-19T05:36:31.695345+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704065+0000","last_change":"2024-09-19T05:36:31.704065+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704065+0000","last_undegraded":"2024-09-19T05:36:31.704065+0000","last_fullsized":"2024-09-19T05:36:31.704065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703131+0000","last_change":"2024-09-19T05:36:31.703131+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703131+0000","last_undegraded":"2024-09-19T05:36:31.703131+0000","last_fullsized":"2024-09-19T05:36:31.703131+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702998+0000","last_change":"2024-09-19T05:36:31.702998+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702998+0000","last_undegraded":"2024-09-19T05:36:31.702998+0000","last_fullsized":"2024-09-19T05:36:31.702998+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692405+0000","last_change":"2024-09-19T05:36:31.692405+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692405+0000","last_undegraded":"2024-09-19T05:36:31.692405+0000","last_fullsized":"2024-09-19T05:36:31.692405+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.709378+0000","last_change":"2024-09-19T05:36:31.709378+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.709378+0000","last_undegraded":"2024-09-19T05:36:31.709378+0000","last_fullsized":"2024-09-19T05:36:31.709378+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704693+0000","last_change":"2024-09-19T05:36:31.704693+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704693+0000","last_undegraded":"2024-09-19T05:36:31.704693+0000","last_fullsized":"2024-09-19T05:36:31.704693+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695357+0000","last_change":"2024-09-19T05:36:31.695357+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695357+0000","last_undegraded":"2024-09-19T05:36:31.695357+0000","last_fullsized":"2024-09-19T05:36:31.695357+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.700741+0000","last_change":"2024-09-19T05:36:31.700741+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.700741+0000","last_undegraded":"2024-09-19T05:36:31.700741+0000","last_fullsized":"2024-09-19T05:36:31.700741+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690577+0000","last_change":"2024-09-19T05:36:31.690577+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690577+0000","last_undegraded":"2024-09-19T05:36:31.690577+0000","last_fullsized":"2024-09-19T05:36:31.690577+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703100+0000","last_change":"2024-09-19T05:36:31.703100+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703100+0000","last_undegraded":"2024-09-19T05:36:31.703100+0000","last_fullsized":"2024-09-19T05:36:31.703100+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728234+0000","last_change":"2024-09-19T05:36:31.720380+0000","last_active":"2024-09-19T05:36:31.728234+0000","last_peered":"2024-09-19T05:36:31.728234+0000","last_clean":"2024-09-19T05:36:31.728234+0000","last_became_active":"2024-09-19T05:36:31.719637+0000","last_became_peered":"2024-09-19T05:36:31.719637+0000","last_unstale":"2024-09-19T05:36:31.728234+0000","last_undegraded":"2024-09-19T05:36:31.728234+0000","last_fullsized":"2024-09-19T05:36:31.728234+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:30.048643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689230+0000","last_change":"2024-09-19T05:36:31.689230+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689230+0000","last_undegraded":"2024-09-19T05:36:31.689230+0000","last_fullsized":"2024-09-19T05:36:31.689230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.716018+0000","last_change":"2024-09-19T05:36:31.713644+0000","last_active":"2024-09-19T05:36:31.716018+0000","last_peered":"2024-09-19T05:36:31.716018+0000","last_clean":"2024-09-19T05:36:31.716018+0000","last_became_active":"2024-09-19T05:36:31.713286+0000","last_became_peered":"2024-09-19T05:36:31.713286+0000","last_unstale":"2024-09-19T05:36:31.716018+0000","last_undegraded":"2024-09-19T05:36:31.716018+0000","last_fullsized":"2024-09-19T05:36:31.716018+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:44.702540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703745+0000","last_change":"2024-09-19T05:36:31.703745+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703745+0000","last_undegraded":"2024-09-19T05:36:31.703745+0000","last_fullsized":"2024-09-19T05:36:31.703745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.724666+0000","last_change":"2024-09-19T05:36:31.723946+0000","last_active":"2024-09-19T05:36:31.724666+0000","last_peered":"2024-09-19T05:36:31.724666+0000","last_clean":"2024-09-19T05:36:31.724666+0000","last_became_active":"2024-09-19T05:36:31.720000+0000","last_became_peered":"2024-09-19T05:36:31.720000+0000","last_unstale":"2024-09-19T05:36:31.724666+0000","last_undegraded":"2024-09-19T05:36:31.724666+0000","last_fullsized":"2024-09-19T05:36:31.724666+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:13.746162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.697485+0000","last_change":"2024-09-19T05:36:31.697485+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.697485+0000","last_undegraded":"2024-09-19T05:36:31.697485+0000","last_fullsized":"2024-09-19T05:36:31.697485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.712577+0000","last_change":"2024-09-19T05:36:31.711293+0000","last_active":"2024-09-19T05:36:31.712577+0000","last_peered":"2024-09-19T05:36:31.712577+0000","last_clean":"2024-09-19T05:36:31.712577+0000","last_became_active":"2024-09-19T05:36:31.710502+0000","last_became_peered":"2024-09-19T05:36:31.710502+0000","last_unstale":"2024-09-19T05:36:31.712577+0000","last_undegraded":"2024-09-19T05:36:31.712577+0000","last_fullsized":"2024-09-19T05:36:31.712577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:53.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695798+0000","last_change":"2024-09-19T05:36:31.695798+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695798+0000","last_undegraded":"2024-09-19T05:36:31.695798+0000","last_fullsized":"2024-09-19T05:36:31.695798+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726178+0000","last_change":"2024-09-19T05:36:31.722407+0000","last_active":"2024-09-19T05:36:31.726178+0000","last_peered":"2024-09-19T05:36:31.726178+0000","last_clean":"2024-09-19T05:36:31.726178+0000","last_became_active":"2024-09-19T05:36:31.721773+0000","last_became_peered":"2024-09-19T05:36:31.721773+0000","last_unstale":"2024-09-19T05:36:31.726178+0000","last_undegraded":"2024-09-19T05:36:31.726178+0000","last_fullsized":"2024-09-19T05:36:31.726178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:00.054246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695555+0000","last_change":"2024-09-19T05:36:31.695555+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695555+0000","last_undegraded":"2024-09-19T05:36:31.695555+0000","last_fullsized":"2024-09-19T05:36:31.695555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.724377+0000","last_change":"2024-09-19T05:36:31.722915+0000","last_active":"2024-09-19T05:36:31.724377+0000","last_peered":"2024-09-19T05:36:31.724377+0000","last_clean":"2024-09-19T05:36:31.724377+0000","last_became_active":"2024-09-19T05:36:31.722202+0000","last_became_peered":"2024-09-19T05:36:31.722202+0000","last_unstale":"2024-09-19T05:36:31.724377+0000","last_undegraded":"2024-09-19T05:36:31.724377+0000","last_fullsized":"2024-09-19T05:36:31.724377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:37.554854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701775+0000","last_change":"2024-09-19T05:36:31.701775+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701775+0000","last_undegraded":"2024-09-19T05:36:31.701775+0000","last_fullsized":"2024-09-19T05:36:31.701775+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728164+0000","last_change":"2024-09-19T05:36:31.718437+0000","last_active":"2024-09-19T05:36:31.728164+0000","last_peered":"2024-09-19T05:36:31.728164+0000","last_clean":"2024-09-19T05:36:31.728164+0000","last_became_active":"2024-09-19T05:36:31.717715+0000","last_became_peered":"2024-09-19T05:36:31.717715+0000","last_unstale":"2024-09-19T05:36:31.728164+0000","last_undegraded":"2024-09-19T05:36:31.728164+0000","last_fullsized":"2024-09-19T05:36:31.728164+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:13.359294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701973+0000","last_change":"2024-09-19T05:36:31.701973+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701973+0000","last_undegraded":"2024-09-19T05:36:31.701973+0000","last_fullsized":"2024-09-19T05:36:31.701973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726034+0000","last_change":"2024-09-19T05:36:31.722496+0000","last_active":"2024-09-19T05:36:31.726034+0000","last_peered":"2024-09-19T05:36:31.726034+0000","last_clean":"2024-09-19T05:36:31.726034+0000","last_became_active":"2024-09-19T05:36:31.722059+0000","last_became_peered":"2024-09-19T05:36:31.722059+0000","last_unstale":"2024-09-19T05:36:31.726034+0000","last_undegraded":"2024-09-19T05:36:31.726034+0000","last_fullsized":"2024-09-19T05:36:31.726034+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.296474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694532+0000","last_change":"2024-09-19T05:36:31.694532+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694532+0000","last_undegraded":"2024-09-19T05:36:31.694532+0000","last_fullsized":"2024-09-19T05:36:31.694532+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726259+0000","last_change":"2024-09-19T05:36:31.722252+0000","last_active":"2024-09-19T05:36:31.726259+0000","last_peered":"2024-09-19T05:36:31.726259+0000","last_clean":"2024-09-19T05:36:31.726259+0000","last_became_active":"2024-09-19T05:36:31.721596+0000","last_became_peered":"2024-09-19T05:36:31.721596+0000","last_unstale":"2024-09-19T05:36:31.726259+0000","last_undegraded":"2024-09-19T05:36:31.726259+0000","last_fullsized":"2024-09-19T05:36:31.726259+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:41.387886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690490+0000","last_change":"2024-09-19T05:36:31.690490+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690490+0000","last_undegraded":"2024-09-19T05:36:31.690490+0000","last_fullsized":"2024-09-19T05:36:31.690490+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.718878+0000","last_change":"2024-09-19T05:36:31.716615+0000","last_active":"2024-09-19T05:36:31.718878+0000","last_peered":"2024-09-19T05:36:31.718878+0000","last_clean":"2024-09-19T05:36:31.718878+0000","last_became_active":"2024-09-19T05:36:31.715826+0000","last_became_peered":"2024-09-19T05:36:31.715826+0000","last_unstale":"2024-09-19T05:36:31.718878+0000","last_undegraded":"2024-09-19T05:36:31.718878+0000","last_fullsized":"2024-09-19T05:36:31.718878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:03.396329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.709107+0000","last_change":"2024-09-19T05:36:31.709107+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.709107+0000","last_undegraded":"2024-09-19T05:36:31.709107+0000","last_fullsized":"2024-09-19T05:36:31.709107+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726958+0000","last_change":"2024-09-19T05:36:31.726088+0000","last_active":"2024-09-19T05:36:31.726958+0000","last_peered":"2024-09-19T05:36:31.726958+0000","last_clean":"2024-09-19T05:36:31.726958+0000","last_became_active":"2024-09-19T05:36:31.725457+0000","last_became_peered":"2024-09-19T05:36:31.725457+0000","last_unstale":"2024-09-19T05:36:31.726958+0000","last_undegraded":"2024-09-19T05:36:31.726958+0000","last_fullsized":"2024-09-19T05:36:31.726958+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:02.848303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.697211+0000","last_change":"2024-09-19T05:36:31.697211+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.697211+0000","last_undegraded":"2024-09-19T05:36:31.697211+0000","last_fullsized":"2024-09-19T05:36:31.697211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.717247+0000","last_change":"2024-09-19T05:36:31.711849+0000","last_active":"2024-09-19T05:36:31.717247+0000","last_peered":"2024-09-19T05:36:31.717247+0000","last_clean":"2024-09-19T05:36:31.717247+0000","last_became_active":"2024-09-19T05:36:31.706778+0000","last_became_peered":"2024-09-19T05:36:31.706778+0000","last_unstale":"2024-09-19T05:36:31.717247+0000","last_undegraded":"2024-09-19T05:36:31.717247+0000","last_fullsized":"2024-09-19T05:36:31.717247+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:37.962059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.691652+0000","last_change":"2024-09-19T05:36:31.691652+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.691652+0000","last_undegraded":"2024-09-19T05:36:31.691652+0000","last_fullsized":"2024-09-19T05:36:31.691652+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.723174+0000","last_change":"2024-09-19T05:36:31.718931+0000","last_active":"2024-09-19T05:36:31.723174+0000","last_peered":"2024-09-19T05:36:31.723174+0000","last_clean":"2024-09-19T05:36:31.723174+0000","last_became_active":"2024-09-19T05:36:31.718531+0000","last_became_peered":"2024-09-19T05:36:31.718531+0000","last_unstale":"2024-09-19T05:36:31.723174+0000","last_undegraded":"2024-09-19T05:36:31.723174+0000","last_fullsized":"2024-09-19T05:36:31.723174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:51.939635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702894+0000","last_change":"2024-09-19T05:36:31.702894+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702894+0000","last_undegraded":"2024-09-19T05:36:31.702894+0000","last_fullsized":"2024-09-19T05:36:31.702894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728979+0000","last_change":"2024-09-19T05:36:31.725430+0000","last_active":"2024-09-19T05:36:31.728979+0000","last_peered":"2024-09-19T05:36:31.728979+0000","last_clean":"2024-09-19T05:36:31.728979+0000","last_became_active":"2024-09-19T05:36:31.724751+0000","last_became_peered":"2024-09-19T05:36:31.724751+0000","last_unstale":"2024-09-19T05:36:31.728979+0000","last_undegraded":"2024-09-19T05:36:31.728979+0000","last_fullsized":"2024-09-19T05:36:31.728979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:41.328921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702422+0000","last_change":"2024-09-19T05:36:31.702422+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702422+0000","last_undegraded":"2024-09-19T05:36:31.702422+0000","last_fullsized":"2024-09-19T05:36:31.702422+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.730192+0000","last_change":"2024-09-19T05:36:31.729413+0000","last_active":"2024-09-19T05:36:31.730192+0000","last_peered":"2024-09-19T05:36:31.730192+0000","last_clean":"2024-09-19T05:36:31.730192+0000","last_became_active":"2024-09-19T05:36:31.728706+0000","last_became_peered":"2024-09-19T05:36:31.728706+0000","last_unstale":"2024-09-19T05:36:31.730192+0000","last_undegraded":"2024-09-19T05:36:31.730192+0000","last_fullsized":"2024-09-19T05:36:31.730192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:42:02.107320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.712535+0000","last_change":"2024-09-19T05:36:31.712535+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.712535+0000","last_undegraded":"2024-09-19T05:36:31.712535+0000","last_fullsized":"2024-09-19T05:36:31.712535+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.713195+0000","last_change":"2024-09-19T05:36:31.706868+0000","last_active":"2024-09-19T05:36:31.713195+0000","last_peered":"2024-09-19T05:36:31.713195+0000","last_clean":"2024-09-19T05:36:31.713195+0000","last_became_active":"2024-09-19T05:36:31.706503+0000","last_became_peered":"2024-09-19T05:36:31.706503+0000","last_unstale":"2024-09-19T05:36:31.713195+0000","last_undegraded":"2024-09-19T05:36:31.713195+0000","last_fullsized":"2024-09-19T05:36:31.713195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:55.270382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693510+0000","last_change":"2024-09-19T05:36:31.693510+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693510+0000","last_undegraded":"2024-09-19T05:36:31.693510+0000","last_fullsized":"2024-09-19T05:36:31.693510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.723287+0000","last_change":"2024-09-19T05:36:31.720065+0000","last_active":"2024-09-19T05:36:31.723287+0000","last_peered":"2024-09-19T05:36:31.723287+0000","last_clean":"2024-09-19T05:36:31.723287+0000","last_became_active":"2024-09-19T05:36:31.719280+0000","last_became_peered":"2024-09-19T05:36:31.719280+0000","last_unstale":"2024-09-19T05:36:31.723287+0000","last_undegraded":"2024-09-19T05:36:31.723287+0000","last_fullsized":"2024-09-19T05:36:31.723287+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:38.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692011+0000","last_change":"2024-09-19T05:36:31.692011+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692011+0000","last_undegraded":"2024-09-19T05:36:31.692011+0000","last_fullsized":"2024-09-19T05:36:31.692011+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.709674+0000","last_change":"2024-09-19T05:36:31.705115+0000","last_active":"2024-09-19T05:36:31.709674+0000","last_peered":"2024-09-19T05:36:31.709674+0000","last_clean":"2024-09-19T05:36:31.709674+0000","last_became_active":"2024-09-19T05:36:31.702064+0000","last_became_peered":"2024-09-19T05:36:31.702064+0000","last_unstale":"2024-09-19T05:36:31.709674+0000","last_undegraded":"2024-09-19T05:36:31.709674+0000","last_fullsized":"2024-09-19T05:36:31.709674+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:26.652533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.696480+0000","last_change":"2024-09-19T05:36:31.696480+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.696480+0000","last_undegraded":"2024-09-19T05:36:31.696480+0000","last_fullsized":"2024-09-19T05:36:31.696480+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728092+0000","last_change":"2024-09-19T05:36:31.717880+0000","last_active":"2024-09-19T05:36:31.728092+0000","last_peered":"2024-09-19T05:36:31.728092+0000","last_clean":"2024-09-19T05:36:31.728092+0000","last_became_active":"2024-09-19T05:36:31.717112+0000","last_became_peered":"2024-09-19T05:36:31.717112+0000","last_unstale":"2024-09-19T05:36:31.728092+0000","last_undegraded":"2024-09-19T05:36:31.728092+0000","last_fullsized":"2024-09-19T05:36:31.728092+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:38.586563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692007+0000","last_change":"2024-09-19T05:36:31.692007+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692007+0000","last_undegraded":"2024-09-19T05:36:31.692007+0000","last_fullsized":"2024-09-19T05:36:31.692007+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728152+0000","last_change":"2024-09-19T05:36:31.717969+0000","last_active":"2024-09-19T05:36:31.728152+0000","last_peered":"2024-09-19T05:36:31.728152+0000","last_clean":"2024-09-19T05:36:31.728152+0000","last_became_active":"2024-09-19T05:36:31.717083+0000","last_became_peered":"2024-09-19T05:36:31.717083+0000","last_unstale":"2024-09-19T05:36:31.728152+0000","last_undegraded":"2024-09-19T05:36:31.728152+0000","last_fullsized":"2024-09-19T05:36:31.728152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:31.534391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690595+0000","last_change":"2024-09-19T05:36:31.690595+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690595+0000","last_undegraded":"2024-09-19T05:36:31.690595+0000","last_fullsized":"2024-09-19T05:36:31.690595+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.710013+0000","last_change":"2024-09-19T05:36:31.699706+0000","last_active":"2024-09-19T05:36:31.710013+0000","last_peered":"2024-09-19T05:36:31.710013+0000","last_clean":"2024-09-19T05:36:31.710013+0000","last_became_active":"2024-09-19T05:36:31.699290+0000","last_became_peered":"2024-09-19T05:36:31.699290+0000","last_unstale":"2024-09-19T05:36:31.710013+0000","last_undegraded":"2024-09-19T05:36:31.710013+0000","last_fullsized":"2024-09-19T05:36:31.710013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:41.522320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.705696+0000","last_change":"2024-09-19T05:36:31.705696+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.705696+0000","last_undegraded":"2024-09-19T05:36:31.705696+0000","last_fullsized":"2024-09-19T05:36:31.705696+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.715829+0000","last_change":"2024-09-19T05:36:31.710829+0000","last_active":"2024-09-19T05:36:31.715829+0000","last_peered":"2024-09-19T05:36:31.715829+0000","last_clean":"2024-09-19T05:36:31.715829+0000","last_became_active":"2024-09-19T05:36:31.706452+0000","last_became_peered":"2024-09-19T05:36:31.706452+0000","last_unstale":"2024-09-19T05:36:31.715829+0000","last_undegraded":"2024-09-19T05:36:31.715829+0000","last_fullsized":"2024-09-19T05:36:31.715829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:37.754866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703976+0000","last_change":"2024-09-19T05:36:31.703976+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703976+0000","last_undegraded":"2024-09-19T05:36:31.703976+0000","last_fullsized":"2024-09-19T05:36:31.703976+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.722865+0000","last_change":"2024-09-19T05:36:31.717756+0000","last_active":"2024-09-19T05:36:31.722865+0000","last_peered":"2024-09-19T05:36:31.722865+0000","last_clean":"2024-09-19T05:36:31.722865+0000","last_became_active":"2024-09-19T05:36:31.717340+0000","last_became_peered":"2024-09-19T05:36:31.717340+0000","last_unstale":"2024-09-19T05:36:31.722865+0000","last_undegraded":"2024-09-19T05:36:31.722865+0000","last_fullsized":"2024-09-19T05:36:31.722865+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:13.746162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692501+0000","last_change":"2024-09-19T05:36:31.692501+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692501+0000","last_undegraded":"2024-09-19T05:36:31.692501+0000","last_fullsized":"2024-09-19T05:36:31.692501+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.720258+0000","last_change":"2024-09-19T05:36:31.718263+0000","last_active":"2024-09-19T05:36:31.720258+0000","last_peered":"2024-09-19T05:36:31.720258+0000","last_clean":"2024-09-19T05:36:31.720258+0000","last_became_active":"2024-09-19T05:36:31.717602+0000","last_became_peered":"2024-09-19T05:36:31.717602+0000","last_unstale":"2024-09-19T05:36:31.720258+0000","last_undegraded":"2024-09-19T05:36:31.720258+0000","last_fullsized":"2024-09-19T05:36:31.720258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:39.756352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689200+0000","last_change":"2024-09-19T05:36:31.689200+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689200+0000","last_undegraded":"2024-09-19T05:36:31.689200+0000","last_fullsized":"2024-09-19T05:36:31.689200+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.729102+0000","last_change":"2024-09-19T05:36:31.725301+0000","last_active":"2024-09-19T05:36:31.729102+0000","last_peered":"2024-09-19T05:36:31.729102+0000","last_clean":"2024-09-19T05:36:31.729102+0000","last_became_active":"2024-09-19T05:36:31.724624+0000","last_became_peered":"2024-09-19T05:36:31.724624+0000","last_unstale":"2024-09-19T05:36:31.729102+0000","last_undegraded":"2024-09-19T05:36:31.729102+0000","last_fullsized":"2024-09-19T05:36:31.729102+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:03.396329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693273+0000","last_change":"2024-09-19T05:36:31.693273+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693273+0000","last_undegraded":"2024-09-19T05:36:31.693273+0000","last_fullsized":"2024-09-19T05:36:31.693273+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.725945+0000","last_change":"2024-09-19T05:36:31.720578+0000","last_active":"2024-09-19T05:36:31.725945+0000","last_peered":"2024-09-19T05:36:31.725945+0000","last_clean":"2024-09-19T05:36:31.725945+0000","last_became_active":"2024-09-19T05:36:31.720005+0000","last_became_peered":"2024-09-19T05:36:31.720005+0000","last_unstale":"2024-09-19T05:36:31.725945+0000","last_undegraded":"2024-09-19T05:36:31.725945+0000","last_fullsized":"2024-09-19T05:36:31.725945+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:19.063363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692349+0000","last_change":"2024-09-19T05:36:31.692349+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692349+0000","last_undegraded":"2024-09-19T05:36:31.692349+0000","last_fullsized":"2024-09-19T05:36:31.692349+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.722012+0000","last_change":"2024-09-19T05:36:31.717531+0000","last_active":"2024-09-19T05:36:31.722012+0000","last_peered":"2024-09-19T05:36:31.722012+0000","last_clean":"2024-09-19T05:36:31.722012+0000","last_became_active":"2024-09-19T05:36:31.714356+0000","last_became_peered":"2024-09-19T05:36:31.714356+0000","last_unstale":"2024-09-19T05:36:31.722012+0000","last_undegraded":"2024-09-19T05:36:31.722012+0000","last_fullsized":"2024-09-19T05:36:31.722012+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:44.702540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.707869+0000","last_change":"2024-09-19T05:36:31.707869+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.707869+0000","last_undegraded":"2024-09-19T05:36:31.707869+0000","last_fullsized":"2024-09-19T05:36:31.707869+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.715815+0000","last_change":"2024-09-19T05:36:31.711105+0000","last_active":"2024-09-19T05:36:31.715815+0000","last_peered":"2024-09-19T05:36:31.715815+0000","last_clean":"2024-09-19T05:36:31.715815+0000","last_became_active":"2024-09-19T05:36:31.706046+0000","last_became_peered":"2024-09-19T05:36:31.706046+0000","last_unstale":"2024-09-19T05:36:31.715815+0000","last_undegraded":"2024-09-19T05:36:31.715815+0000","last_fullsized":"2024-09-19T05:36:31.715815+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:59.718173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689231+0000","last_change":"2024-09-19T05:36:31.689231+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689231+0000","last_undegraded":"2024-09-19T05:36:31.689231+0000","last_fullsized":"2024-09-19T05:36:31.689231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.717195+0000","last_change":"2024-09-19T05:36:31.712372+0000","last_active":"2024-09-19T05:36:31.717195+0000","last_peered":"2024-09-19T05:36:31.717195+0000","last_clean":"2024-09-19T05:36:31.717195+0000","last_became_active":"2024-09-19T05:36:31.711992+0000","last_became_peered":"2024-09-19T05:36:31.711992+0000","last_unstale":"2024-09-19T05:36:31.717195+0000","last_undegraded":"2024-09-19T05:36:31.717195+0000","last_fullsized":"2024-09-19T05:36:31.717195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:37.135871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.708667+0000","last_change":"2024-09-19T05:36:31.708667+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.708667+0000","last_undegraded":"2024-09-19T05:36:31.708667+0000","last_fullsized":"2024-09-19T05:36:31.708667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.719640+0000","last_change":"2024-09-19T05:36:31.715645+0000","last_active":"2024-09-19T05:36:31.719640+0000","last_peered":"2024-09-19T05:36:31.719640+0000","last_clean":"2024-09-19T05:36:31.719640+0000","last_became_active":"2024-09-19T05:36:31.714877+0000","last_became_peered":"2024-09-19T05:36:31.714877+0000","last_unstale":"2024-09-19T05:36:31.719640+0000","last_undegraded":"2024-09-19T05:36:31.719640+0000","last_fullsized":"2024-09-19T05:36:31.719640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:41.328921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692778+0000","last_change":"2024-09-19T05:36:31.692778+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692778+0000","last_undegraded":"2024-09-19T05:36:31.692778+0000","last_fullsized":"2024-09-19T05:36:31.692778+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.712602+0000","last_change":"2024-09-19T05:36:31.699877+0000","last_active":"2024-09-19T05:36:31.712602+0000","last_peered":"2024-09-19T05:36:31.712602+0000","last_clean":"2024-09-19T05:36:31.712602+0000","last_became_active":"2024-09-19T05:36:31.699104+0000","last_became_peered":"2024-09-19T05:36:31.699104+0000","last_unstale":"2024-09-19T05:36:31.712602+0000","last_undegraded":"2024-09-19T05:36:31.712602+0000","last_fullsized":"2024-09-19T05:36:31.712602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:06.528586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703172+0000","last_change":"2024-09-19T05:36:31.703172+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703172+0000","last_undegraded":"2024-09-19T05:36:31.703172+0000","last_fullsized":"2024-09-19T05:36:31.703172+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726081+0000","last_change":"2024-09-19T05:36:31.723461+0000","last_active":"2024-09-19T05:36:31.726081+0000","last_peered":"2024-09-19T05:36:31.726081+0000","last_clean":"2024-09-19T05:36:31.726081+0000","last_became_active":"2024-09-19T05:36:31.723023+0000","last_became_peered":"2024-09-19T05:36:31.723023+0000","last_unstale":"2024-09-19T05:36:31.726081+0000","last_undegraded":"2024-09-19T05:36:31.726081+0000","last_fullsized":"2024-09-19T05:36:31.726081+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:35.125585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":230,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.705361+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:36:31.705361+0000","last_peered":"2024-09-19T05:36:31.705361+0000","last_clean":"2024-09-19T05:36:31.705361+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:36:31.705361+0000","last_undegraded":"2024-09-19T05:36:31.705361+0000","last_fullsized":"2024-09-19T05:36:31.705361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46268,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325572,"statfs":{"total":96636764160,"available":96589385728,"internally_reserved":0,"allocated":1220608,"data_stored":868940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40108,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331732,"statfs":{"total":96636764160,"available":96595693568,"internally_reserved":0,"allocated":614400,"data_stored":271905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45680,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326160,"statfs":{"total":96636764160,"available":96589987840,"internally_reserved":0,"allocated":614400,"data_stored":271905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40120,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331720,"statfs":{"total":96636764160,"available":96595681280,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40124,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331716,"statfs":{"total":96636764160,"available":96595677184,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542191,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40120,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331720,"statfs":{"total":96636764160,"available":96595681280,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50428,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321412,"statfs":{"total":96636764160,"available":96585125888,"internally_reserved":0,"allocated":1220608,"data_stored":868940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:36:36.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:36:36.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.917+0000 7f7937f86640 1 Processor -- start 2024-09-19T05:36:36.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.917+0000 7f7937f86640 1 -- start start 2024-09-19T05:36:36.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 0x7f79300d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79300d0e80 0x7f79300d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f79300b41c0 0x7f79300b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f79300d0840 con 0x7f79300d0e80 2024-09-19T05:36:36.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f79300d1800 con 0x7f79300b41c0 2024-09-19T05:36:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f79300d4d40 con 0x7f7930161da0 2024-09-19T05:36:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935521640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79300d0e80 0x7f79300d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935521640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79300d0e80 0x7f79300d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58276/0 (socket says 172.21.15.67:58276) 2024-09-19T05:36:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935521640 1 -- 172.21.15.67:0/4100294105 learned_addr learned my addr 172.21.15.67:0/4100294105 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935d22640 1 --2- 172.21.15.67:0/4100294105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 0x7f79300d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7936523640 1 --2- 172.21.15.67:0/4100294105 >> v2:172.21.15.97:3300/0 conn(0x7f79300b41c0 0x7f79300b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935521640 1 -- 172.21.15.67:0/4100294105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 msgr2=0x7f79300d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935521640 1 --2- 172.21.15.67:0/4100294105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 0x7f79300d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935521640 1 -- 172.21.15.67:0/4100294105 >> v2:172.21.15.97:3300/0 conn(0x7f79300b41c0 msgr2=0x7f79300b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935521640 1 --2- 172.21.15.67:0/4100294105 >> v2:172.21.15.97:3300/0 conn(0x7f79300b41c0 0x7f79300b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935521640 1 -- 172.21.15.67:0/4100294105 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300d5020 con 0x7f79300d0e80 2024-09-19T05:36:36.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935d22640 1 --2- 172.21.15.67:0/4100294105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 0x7f79300d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:36.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7935521640 1 --2- 172.21.15.67:0/4100294105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300d0e80 0x7f79300d12c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f793008e7c0 tx=0x7f792401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14428d83e9a7ca97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7934d20640 1 -- 172.21.15.67:0/4100294105 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79240a5760 con 0x7f79300d0e80 2024-09-19T05:36:36.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7934d20640 1 -- 172.21.15.67:0/4100294105 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79240a5900 con 0x7f79300d0e80 2024-09-19T05:36:36.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7934d20640 1 -- 172.21.15.67:0/4100294105 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79240a5cd0 con 0x7f79300d0e80 2024-09-19T05:36:36.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 -- 172.21.15.67:0/4100294105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300d0e80 msgr2=0x7f79300d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 --2- 172.21.15.67:0/4100294105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300d0e80 0x7f79300d12c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f793008e7c0 tx=0x7f792401c9f0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 -- 172.21.15.67:0/4100294105 shutdown_connections 2024-09-19T05:36:36.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 --2- 172.21.15.67:0/4100294105 >> v2:172.21.15.97:3300/0 conn(0x7f79300b41c0 0x7f79300b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 --2- 172.21.15.67:0/4100294105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300d0e80 0x7f79300d12c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.921+0000 7f7937f86640 1 --2- 172.21.15.67:0/4100294105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 0x7f79300d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 -- 172.21.15.67:0/4100294105 >> 172.21.15.67:0/4100294105 conn(0x7f793008bfc0 msgr2=0x7f79300d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:36.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 -- 172.21.15.67:0/4100294105 shutdown_connections 2024-09-19T05:36:36.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 -- 172.21.15.67:0/4100294105 wait complete. 2024-09-19T05:36:36.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 Processor -- start 2024-09-19T05:36:36.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 -- start start 2024-09-19T05:36:36.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300b41c0 0x7f79300cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79300d0e80 0x7f79301535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 0x7f7930155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f79300cf150 con 0x7f79300b41c0 2024-09-19T05:36:36.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7930162180 con 0x7f79300d0e80 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f79300cf2d0 con 0x7f7930161da0 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7935d22640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300b41c0 0x7f79300cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7935d22640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300b41c0 0x7f79300cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58282/0 (socket says 172.21.15.67:58282) 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7935d22640 1 -- 172.21.15.67:0/506068558 learned_addr learned my addr 172.21.15.67:0/506068558 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7935521640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79300d0e80 0x7f79301535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7936523640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 0x7f7930155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7935d22640 1 -- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 msgr2=0x7f7930155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7935d22640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 0x7f7930155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7935d22640 1 -- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79300d0e80 msgr2=0x7f79301535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7935d22640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79300d0e80 0x7f79301535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7935d22640 1 -- 172.21.15.67:0/506068558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79301599a0 con 0x7f79300b41c0 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7935d22640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300b41c0 0x7f79300cb560 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f792000c7f0 tx=0x7f792000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f792e7fc640 1 -- 172.21.15.67:0/506068558 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920015070 con 0x7f79300b41c0 2024-09-19T05:36:36.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f792e7fc640 1 -- 172.21.15.67:0/506068558 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7920007820 con 0x7f79300b41c0 2024-09-19T05:36:36.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f792e7fc640 1 -- 172.21.15.67:0/506068558 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920007c10 con 0x7f79300b41c0 2024-09-19T05:36:36.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 -- 172.21.15.67:0/506068558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79300cbe60 con 0x7f79300b41c0 2024-09-19T05:36:36.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 -- 172.21.15.67:0/506068558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79300cbaa0 con 0x7f79300b41c0 2024-09-19T05:36:36.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.925+0000 7f7937f86640 1 -- 172.21.15.67:0/506068558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79300d12c0 con 0x7f79300b41c0 2024-09-19T05:36:36.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.929+0000 7f792e7fc640 1 -- 172.21.15.67:0/506068558 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7920018070 con 0x7f79300b41c0 2024-09-19T05:36:36.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.929+0000 7f792e7fc640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f791c0678c0 0x7f791c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.929+0000 7f792e7fc640 1 -- 172.21.15.67:0/506068558 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f7920085ec0 con 0x7f79300b41c0 2024-09-19T05:36:36.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.929+0000 7f7935521640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f791c0678c0 0x7f791c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.929+0000 7f7935521640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f791c0678c0 0x7f791c069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f79240ae000 tx=0x7f79240a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:36.933+0000 7f792e7fc640 1 -- 172.21.15.67:0/506068558 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7920056900 con 0x7f79300b41c0 2024-09-19T05:36:37.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.093+0000 7f7937f86640 1 -- 172.21.15.67:0/506068558 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79300d1c60 con 0x7f791c0678c0 2024-09-19T05:36:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.113+0000 7f792e7fc640 1 -- 172.21.15.67:0/506068558 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7f79300d1c60 con 0x7f791c0678c0 2024-09-19T05:36:37.119 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:37.120 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:36:37.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 -- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f791c0678c0 msgr2=0x7f791c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f791c0678c0 0x7f791c069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f79240ae000 tx=0x7f79240a7070 comp rx=0 tx=0).stop 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 -- 172.21.15.67:0/506068558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300b41c0 msgr2=0x7f79300cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300b41c0 0x7f79300cb560 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f792000c7f0 tx=0x7f792000ccb0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 -- 172.21.15.67:0/506068558 shutdown_connections 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f791c0678c0 0x7f791c069d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7930161da0 0x7f7930155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79300d0e80 0x7f79301535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 --2- 172.21.15.67:0/506068558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79300b41c0 0x7f79300cb560 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 -- 172.21.15.67:0/506068558 >> 172.21.15.67:0/506068558 conn(0x7f793008bfc0 msgr2=0x7f793006d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 -- 172.21.15.67:0/506068558 shutdown_connections 2024-09-19T05:36:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.117+0000 7f7937f86640 1 -- 172.21.15.67:0/506068558 wait complete. 2024-09-19T05:36:37.138 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-19T05:36:35.177374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":342980,"kb_used_data":6032,"kb_used_omap":12,"kb_used_meta":336755,"kb_avail":754631740,"statfs":{"total":773094113280,"available":772742901760,"internally_reserved":0,"allocated":6176768,"data_stored":3395978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":344837681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.499838"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695243+0000","last_change":"2024-09-19T05:36:31.695243+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695243+0000","last_undegraded":"2024-09-19T05:36:31.695243+0000","last_fullsized":"2024-09-19T05:36:31.695243+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.696564+0000","last_change":"2024-09-19T05:36:31.696564+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.696564+0000","last_undegraded":"2024-09-19T05:36:31.696564+0000","last_fullsized":"2024-09-19T05:36:31.696564+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704128+0000","last_change":"2024-09-19T05:36:31.704128+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704128+0000","last_undegraded":"2024-09-19T05:36:31.704128+0000","last_fullsized":"2024-09-19T05:36:31.704128+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695310+0000","last_change":"2024-09-19T05:36:31.695310+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695310+0000","last_undegraded":"2024-09-19T05:36:31.695310+0000","last_fullsized":"2024-09-19T05:36:31.695310+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.698377+0000","last_change":"2024-09-19T05:36:31.698377+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.698377+0000","last_undegraded":"2024-09-19T05:36:31.698377+0000","last_fullsized":"2024-09-19T05:36:31.698377+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694310+0000","last_change":"2024-09-19T05:36:31.694310+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694310+0000","last_undegraded":"2024-09-19T05:36:31.694310+0000","last_fullsized":"2024-09-19T05:36:31.694310+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702973+0000","last_change":"2024-09-19T05:36:31.702973+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702973+0000","last_undegraded":"2024-09-19T05:36:31.702973+0000","last_fullsized":"2024-09-19T05:36:31.702973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703561+0000","last_change":"2024-09-19T05:36:31.703561+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703561+0000","last_undegraded":"2024-09-19T05:36:31.703561+0000","last_fullsized":"2024-09-19T05:36:31.703561+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702176+0000","last_change":"2024-09-19T05:36:31.702176+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702176+0000","last_undegraded":"2024-09-19T05:36:31.702176+0000","last_fullsized":"2024-09-19T05:36:31.702176+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694587+0000","last_change":"2024-09-19T05:36:31.694587+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694587+0000","last_undegraded":"2024-09-19T05:36:31.694587+0000","last_fullsized":"2024-09-19T05:36:31.694587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695869+0000","last_change":"2024-09-19T05:36:31.695869+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695869+0000","last_undegraded":"2024-09-19T05:36:31.695869+0000","last_fullsized":"2024-09-19T05:36:31.695869+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702307+0000","last_change":"2024-09-19T05:36:31.702307+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702307+0000","last_undegraded":"2024-09-19T05:36:31.702307+0000","last_fullsized":"2024-09-19T05:36:31.702307+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693048+0000","last_change":"2024-09-19T05:36:31.693048+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693048+0000","last_undegraded":"2024-09-19T05:36:31.693048+0000","last_fullsized":"2024-09-19T05:36:31.693048+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.712302+0000","last_change":"2024-09-19T05:36:31.712302+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.712302+0000","last_undegraded":"2024-09-19T05:36:31.712302+0000","last_fullsized":"2024-09-19T05:36:31.712302+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695497+0000","last_change":"2024-09-19T05:36:31.695497+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695497+0000","last_undegraded":"2024-09-19T05:36:31.695497+0000","last_fullsized":"2024-09-19T05:36:31.695497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693291+0000","last_change":"2024-09-19T05:36:31.693291+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693291+0000","last_undegraded":"2024-09-19T05:36:31.693291+0000","last_fullsized":"2024-09-19T05:36:31.693291+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704335+0000","last_change":"2024-09-19T05:36:31.704335+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704335+0000","last_undegraded":"2024-09-19T05:36:31.704335+0000","last_fullsized":"2024-09-19T05:36:31.704335+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695472+0000","last_change":"2024-09-19T05:36:31.695472+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695472+0000","last_undegraded":"2024-09-19T05:36:31.695472+0000","last_fullsized":"2024-09-19T05:36:31.695472+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703533+0000","last_change":"2024-09-19T05:36:31.703533+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703533+0000","last_undegraded":"2024-09-19T05:36:31.703533+0000","last_fullsized":"2024-09-19T05:36:31.703533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.710477+0000","last_change":"2024-09-19T05:36:31.710477+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.710477+0000","last_undegraded":"2024-09-19T05:36:31.710477+0000","last_fullsized":"2024-09-19T05:36:31.710477+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.708401+0000","last_change":"2024-09-19T05:36:31.708401+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.708401+0000","last_undegraded":"2024-09-19T05:36:31.708401+0000","last_fullsized":"2024-09-19T05:36:31.708401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701714+0000","last_change":"2024-09-19T05:36:31.701714+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701714+0000","last_undegraded":"2024-09-19T05:36:31.701714+0000","last_fullsized":"2024-09-19T05:36:31.701714+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695345+0000","last_change":"2024-09-19T05:36:31.695345+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695345+0000","last_undegraded":"2024-09-19T05:36:31.695345+0000","last_fullsized":"2024-09-19T05:36:31.695345+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704065+0000","last_change":"2024-09-19T05:36:31.704065+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704065+0000","last_undegraded":"2024-09-19T05:36:31.704065+0000","last_fullsized":"2024-09-19T05:36:31.704065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703131+0000","last_change":"2024-09-19T05:36:31.703131+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703131+0000","last_undegraded":"2024-09-19T05:36:31.703131+0000","last_fullsized":"2024-09-19T05:36:31.703131+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702998+0000","last_change":"2024-09-19T05:36:31.702998+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702998+0000","last_undegraded":"2024-09-19T05:36:31.702998+0000","last_fullsized":"2024-09-19T05:36:31.702998+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692405+0000","last_change":"2024-09-19T05:36:31.692405+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692405+0000","last_undegraded":"2024-09-19T05:36:31.692405+0000","last_fullsized":"2024-09-19T05:36:31.692405+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.709378+0000","last_change":"2024-09-19T05:36:31.709378+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.709378+0000","last_undegraded":"2024-09-19T05:36:31.709378+0000","last_fullsized":"2024-09-19T05:36:31.709378+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704693+0000","last_change":"2024-09-19T05:36:31.704693+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704693+0000","last_undegraded":"2024-09-19T05:36:31.704693+0000","last_fullsized":"2024-09-19T05:36:31.704693+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695357+0000","last_change":"2024-09-19T05:36:31.695357+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695357+0000","last_undegraded":"2024-09-19T05:36:31.695357+0000","last_fullsized":"2024-09-19T05:36:31.695357+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.700741+0000","last_change":"2024-09-19T05:36:31.700741+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.700741+0000","last_undegraded":"2024-09-19T05:36:31.700741+0000","last_fullsized":"2024-09-19T05:36:31.700741+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690577+0000","last_change":"2024-09-19T05:36:31.690577+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690577+0000","last_undegraded":"2024-09-19T05:36:31.690577+0000","last_fullsized":"2024-09-19T05:36:31.690577+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703100+0000","last_change":"2024-09-19T05:36:31.703100+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703100+0000","last_undegraded":"2024-09-19T05:36:31.703100+0000","last_fullsized":"2024-09-19T05:36:31.703100+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728234+0000","last_change":"2024-09-19T05:36:31.720380+0000","last_active":"2024-09-19T05:36:31.728234+0000","last_peered":"2024-09-19T05:36:31.728234+0000","last_clean":"2024-09-19T05:36:31.728234+0000","last_became_active":"2024-09-19T05:36:31.719637+0000","last_became_peered":"2024-09-19T05:36:31.719637+0000","last_unstale":"2024-09-19T05:36:31.728234+0000","last_undegraded":"2024-09-19T05:36:31.728234+0000","last_fullsized":"2024-09-19T05:36:31.728234+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:30.048643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689230+0000","last_change":"2024-09-19T05:36:31.689230+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689230+0000","last_undegraded":"2024-09-19T05:36:31.689230+0000","last_fullsized":"2024-09-19T05:36:31.689230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.716018+0000","last_change":"2024-09-19T05:36:31.713644+0000","last_active":"2024-09-19T05:36:31.716018+0000","last_peered":"2024-09-19T05:36:31.716018+0000","last_clean":"2024-09-19T05:36:31.716018+0000","last_became_active":"2024-09-19T05:36:31.713286+0000","last_became_peered":"2024-09-19T05:36:31.713286+0000","last_unstale":"2024-09-19T05:36:31.716018+0000","last_undegraded":"2024-09-19T05:36:31.716018+0000","last_fullsized":"2024-09-19T05:36:31.716018+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:44.702540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703745+0000","last_change":"2024-09-19T05:36:31.703745+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703745+0000","last_undegraded":"2024-09-19T05:36:31.703745+0000","last_fullsized":"2024-09-19T05:36:31.703745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.724666+0000","last_change":"2024-09-19T05:36:31.723946+0000","last_active":"2024-09-19T05:36:31.724666+0000","last_peered":"2024-09-19T05:36:31.724666+0000","last_clean":"2024-09-19T05:36:31.724666+0000","last_became_active":"2024-09-19T05:36:31.720000+0000","last_became_peered":"2024-09-19T05:36:31.720000+0000","last_unstale":"2024-09-19T05:36:31.724666+0000","last_undegraded":"2024-09-19T05:36:31.724666+0000","last_fullsized":"2024-09-19T05:36:31.724666+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:13.746162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.697485+0000","last_change":"2024-09-19T05:36:31.697485+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.697485+0000","last_undegraded":"2024-09-19T05:36:31.697485+0000","last_fullsized":"2024-09-19T05:36:31.697485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.712577+0000","last_change":"2024-09-19T05:36:31.711293+0000","last_active":"2024-09-19T05:36:31.712577+0000","last_peered":"2024-09-19T05:36:31.712577+0000","last_clean":"2024-09-19T05:36:31.712577+0000","last_became_active":"2024-09-19T05:36:31.710502+0000","last_became_peered":"2024-09-19T05:36:31.710502+0000","last_unstale":"2024-09-19T05:36:31.712577+0000","last_undegraded":"2024-09-19T05:36:31.712577+0000","last_fullsized":"2024-09-19T05:36:31.712577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:53.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695798+0000","last_change":"2024-09-19T05:36:31.695798+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695798+0000","last_undegraded":"2024-09-19T05:36:31.695798+0000","last_fullsized":"2024-09-19T05:36:31.695798+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726178+0000","last_change":"2024-09-19T05:36:31.722407+0000","last_active":"2024-09-19T05:36:31.726178+0000","last_peered":"2024-09-19T05:36:31.726178+0000","last_clean":"2024-09-19T05:36:31.726178+0000","last_became_active":"2024-09-19T05:36:31.721773+0000","last_became_peered":"2024-09-19T05:36:31.721773+0000","last_unstale":"2024-09-19T05:36:31.726178+0000","last_undegraded":"2024-09-19T05:36:31.726178+0000","last_fullsized":"2024-09-19T05:36:31.726178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:00.054246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695555+0000","last_change":"2024-09-19T05:36:31.695555+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695555+0000","last_undegraded":"2024-09-19T05:36:31.695555+0000","last_fullsized":"2024-09-19T05:36:31.695555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.724377+0000","last_change":"2024-09-19T05:36:31.722915+0000","last_active":"2024-09-19T05:36:31.724377+0000","last_peered":"2024-09-19T05:36:31.724377+0000","last_clean":"2024-09-19T05:36:31.724377+0000","last_became_active":"2024-09-19T05:36:31.722202+0000","last_became_peered":"2024-09-19T05:36:31.722202+0000","last_unstale":"2024-09-19T05:36:31.724377+0000","last_undegraded":"2024-09-19T05:36:31.724377+0000","last_fullsized":"2024-09-19T05:36:31.724377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:37.554854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701775+0000","last_change":"2024-09-19T05:36:31.701775+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701775+0000","last_undegraded":"2024-09-19T05:36:31.701775+0000","last_fullsized":"2024-09-19T05:36:31.701775+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728164+0000","last_change":"2024-09-19T05:36:31.718437+0000","last_active":"2024-09-19T05:36:31.728164+0000","last_peered":"2024-09-19T05:36:31.728164+0000","last_clean":"2024-09-19T05:36:31.728164+0000","last_became_active":"2024-09-19T05:36:31.717715+0000","last_became_peered":"2024-09-19T05:36:31.717715+0000","last_unstale":"2024-09-19T05:36:31.728164+0000","last_undegraded":"2024-09-19T05:36:31.728164+0000","last_fullsized":"2024-09-19T05:36:31.728164+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:13.359294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701973+0000","last_change":"2024-09-19T05:36:31.701973+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701973+0000","last_undegraded":"2024-09-19T05:36:31.701973+0000","last_fullsized":"2024-09-19T05:36:31.701973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726034+0000","last_change":"2024-09-19T05:36:31.722496+0000","last_active":"2024-09-19T05:36:31.726034+0000","last_peered":"2024-09-19T05:36:31.726034+0000","last_clean":"2024-09-19T05:36:31.726034+0000","last_became_active":"2024-09-19T05:36:31.722059+0000","last_became_peered":"2024-09-19T05:36:31.722059+0000","last_unstale":"2024-09-19T05:36:31.726034+0000","last_undegraded":"2024-09-19T05:36:31.726034+0000","last_fullsized":"2024-09-19T05:36:31.726034+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.296474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694532+0000","last_change":"2024-09-19T05:36:31.694532+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694532+0000","last_undegraded":"2024-09-19T05:36:31.694532+0000","last_fullsized":"2024-09-19T05:36:31.694532+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726259+0000","last_change":"2024-09-19T05:36:31.722252+0000","last_active":"2024-09-19T05:36:31.726259+0000","last_peered":"2024-09-19T05:36:31.726259+0000","last_clean":"2024-09-19T05:36:31.726259+0000","last_became_active":"2024-09-19T05:36:31.721596+0000","last_became_peered":"2024-09-19T05:36:31.721596+0000","last_unstale":"2024-09-19T05:36:31.726259+0000","last_undegraded":"2024-09-19T05:36:31.726259+0000","last_fullsized":"2024-09-19T05:36:31.726259+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:41.387886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690490+0000","last_change":"2024-09-19T05:36:31.690490+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690490+0000","last_undegraded":"2024-09-19T05:36:31.690490+0000","last_fullsized":"2024-09-19T05:36:31.690490+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.718878+0000","last_change":"2024-09-19T05:36:31.716615+0000","last_active":"2024-09-19T05:36:31.718878+0000","last_peered":"2024-09-19T05:36:31.718878+0000","last_clean":"2024-09-19T05:36:31.718878+0000","last_became_active":"2024-09-19T05:36:31.715826+0000","last_became_peered":"2024-09-19T05:36:31.715826+0000","last_unstale":"2024-09-19T05:36:31.718878+0000","last_undegraded":"2024-09-19T05:36:31.718878+0000","last_fullsized":"2024-09-19T05:36:31.718878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:03.396329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.709107+0000","last_change":"2024-09-19T05:36:31.709107+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.709107+0000","last_undegraded":"2024-09-19T05:36:31.709107+0000","last_fullsized":"2024-09-19T05:36:31.709107+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726958+0000","last_change":"2024-09-19T05:36:31.726088+0000","last_active":"2024-09-19T05:36:31.726958+0000","last_peered":"2024-09-19T05:36:31.726958+0000","last_clean":"2024-09-19T05:36:31.726958+0000","last_became_active":"2024-09-19T05:36:31.725457+0000","last_became_peered":"2024-09-19T05:36:31.725457+0000","last_unstale":"2024-09-19T05:36:31.726958+0000","last_undegraded":"2024-09-19T05:36:31.726958+0000","last_fullsized":"2024-09-19T05:36:31.726958+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:02.848303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.697211+0000","last_change":"2024-09-19T05:36:31.697211+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.697211+0000","last_undegraded":"2024-09-19T05:36:31.697211+0000","last_fullsized":"2024-09-19T05:36:31.697211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.717247+0000","last_change":"2024-09-19T05:36:31.711849+0000","last_active":"2024-09-19T05:36:31.717247+0000","last_peered":"2024-09-19T05:36:31.717247+0000","last_clean":"2024-09-19T05:36:31.717247+0000","last_became_active":"2024-09-19T05:36:31.706778+0000","last_became_peered":"2024-09-19T05:36:31.706778+0000","last_unstale":"2024-09-19T05:36:31.717247+0000","last_undegraded":"2024-09-19T05:36:31.717247+0000","last_fullsized":"2024-09-19T05:36:31.717247+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:37.962059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.691652+0000","last_change":"2024-09-19T05:36:31.691652+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.691652+0000","last_undegraded":"2024-09-19T05:36:31.691652+0000","last_fullsized":"2024-09-19T05:36:31.691652+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.723174+0000","last_change":"2024-09-19T05:36:31.718931+0000","last_active":"2024-09-19T05:36:31.723174+0000","last_peered":"2024-09-19T05:36:31.723174+0000","last_clean":"2024-09-19T05:36:31.723174+0000","last_became_active":"2024-09-19T05:36:31.718531+0000","last_became_peered":"2024-09-19T05:36:31.718531+0000","last_unstale":"2024-09-19T05:36:31.723174+0000","last_undegraded":"2024-09-19T05:36:31.723174+0000","last_fullsized":"2024-09-19T05:36:31.723174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:51.939635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702894+0000","last_change":"2024-09-19T05:36:31.702894+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702894+0000","last_undegraded":"2024-09-19T05:36:31.702894+0000","last_fullsized":"2024-09-19T05:36:31.702894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728979+0000","last_change":"2024-09-19T05:36:31.725430+0000","last_active":"2024-09-19T05:36:31.728979+0000","last_peered":"2024-09-19T05:36:31.728979+0000","last_clean":"2024-09-19T05:36:31.728979+0000","last_became_active":"2024-09-19T05:36:31.724751+0000","last_became_peered":"2024-09-19T05:36:31.724751+0000","last_unstale":"2024-09-19T05:36:31.728979+0000","last_undegraded":"2024-09-19T05:36:31.728979+0000","last_fullsized":"2024-09-19T05:36:31.728979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:41.328921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702422+0000","last_change":"2024-09-19T05:36:31.702422+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702422+0000","last_undegraded":"2024-09-19T05:36:31.702422+0000","last_fullsized":"2024-09-19T05:36:31.702422+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.730192+0000","last_change":"2024-09-19T05:36:31.729413+0000","last_active":"2024-09-19T05:36:31.730192+0000","last_peered":"2024-09-19T05:36:31.730192+0000","last_clean":"2024-09-19T05:36:31.730192+0000","last_became_active":"2024-09-19T05:36:31.728706+0000","last_became_peered":"2024-09-19T05:36:31.728706+0000","last_unstale":"2024-09-19T05:36:31.730192+0000","last_undegraded":"2024-09-19T05:36:31.730192+0000","last_fullsized":"2024-09-19T05:36:31.730192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:42:02.107320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.712535+0000","last_change":"2024-09-19T05:36:31.712535+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.712535+0000","last_undegraded":"2024-09-19T05:36:31.712535+0000","last_fullsized":"2024-09-19T05:36:31.712535+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.713195+0000","last_change":"2024-09-19T05:36:31.706868+0000","last_active":"2024-09-19T05:36:31.713195+0000","last_peered":"2024-09-19T05:36:31.713195+0000","last_clean":"2024-09-19T05:36:31.713195+0000","last_became_active":"2024-09-19T05:36:31.706503+0000","last_became_peered":"2024-09-19T05:36:31.706503+0000","last_unstale":"2024-09-19T05:36:31.713195+0000","last_undegraded":"2024-09-19T05:36:31.713195+0000","last_fullsized":"2024-09-19T05:36:31.713195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:55.270382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693510+0000","last_change":"2024-09-19T05:36:31.693510+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693510+0000","last_undegraded":"2024-09-19T05:36:31.693510+0000","last_fullsized":"2024-09-19T05:36:31.693510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.723287+0000","last_change":"2024-09-19T05:36:31.720065+0000","last_active":"2024-09-19T05:36:31.723287+0000","last_peered":"2024-09-19T05:36:31.723287+0000","last_clean":"2024-09-19T05:36:31.723287+0000","last_became_active":"2024-09-19T05:36:31.719280+0000","last_became_peered":"2024-09-19T05:36:31.719280+0000","last_unstale":"2024-09-19T05:36:31.723287+0000","last_undegraded":"2024-09-19T05:36:31.723287+0000","last_fullsized":"2024-09-19T05:36:31.723287+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:38.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692011+0000","last_change":"2024-09-19T05:36:31.692011+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692011+0000","last_undegraded":"2024-09-19T05:36:31.692011+0000","last_fullsized":"2024-09-19T05:36:31.692011+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.709674+0000","last_change":"2024-09-19T05:36:31.705115+0000","last_active":"2024-09-19T05:36:31.709674+0000","last_peered":"2024-09-19T05:36:31.709674+0000","last_clean":"2024-09-19T05:36:31.709674+0000","last_became_active":"2024-09-19T05:36:31.702064+0000","last_became_peered":"2024-09-19T05:36:31.702064+0000","last_unstale":"2024-09-19T05:36:31.709674+0000","last_undegraded":"2024-09-19T05:36:31.709674+0000","last_fullsized":"2024-09-19T05:36:31.709674+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:26.652533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.696480+0000","last_change":"2024-09-19T05:36:31.696480+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.696480+0000","last_undegraded":"2024-09-19T05:36:31.696480+0000","last_fullsized":"2024-09-19T05:36:31.696480+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728092+0000","last_change":"2024-09-19T05:36:31.717880+0000","last_active":"2024-09-19T05:36:31.728092+0000","last_peered":"2024-09-19T05:36:31.728092+0000","last_clean":"2024-09-19T05:36:31.728092+0000","last_became_active":"2024-09-19T05:36:31.717112+0000","last_became_peered":"2024-09-19T05:36:31.717112+0000","last_unstale":"2024-09-19T05:36:31.728092+0000","last_undegraded":"2024-09-19T05:36:31.728092+0000","last_fullsized":"2024-09-19T05:36:31.728092+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:38.586563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692007+0000","last_change":"2024-09-19T05:36:31.692007+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692007+0000","last_undegraded":"2024-09-19T05:36:31.692007+0000","last_fullsized":"2024-09-19T05:36:31.692007+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728152+0000","last_change":"2024-09-19T05:36:31.717969+0000","last_active":"2024-09-19T05:36:31.728152+0000","last_peered":"2024-09-19T05:36:31.728152+0000","last_clean":"2024-09-19T05:36:31.728152+0000","last_became_active":"2024-09-19T05:36:31.717083+0000","last_became_peered":"2024-09-19T05:36:31.717083+0000","last_unstale":"2024-09-19T05:36:31.728152+0000","last_undegraded":"2024-09-19T05:36:31.728152+0000","last_fullsized":"2024-09-19T05:36:31.728152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:31.534391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690595+0000","last_change":"2024-09-19T05:36:31.690595+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690595+0000","last_undegraded":"2024-09-19T05:36:31.690595+0000","last_fullsized":"2024-09-19T05:36:31.690595+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.710013+0000","last_change":"2024-09-19T05:36:31.699706+0000","last_active":"2024-09-19T05:36:31.710013+0000","last_peered":"2024-09-19T05:36:31.710013+0000","last_clean":"2024-09-19T05:36:31.710013+0000","last_became_active":"2024-09-19T05:36:31.699290+0000","last_became_peered":"2024-09-19T05:36:31.699290+0000","last_unstale":"2024-09-19T05:36:31.710013+0000","last_undegraded":"2024-09-19T05:36:31.710013+0000","last_fullsized":"2024-09-19T05:36:31.710013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:41.522320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.705696+0000","last_change":"2024-09-19T05:36:31.705696+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.705696+0000","last_undegraded":"2024-09-19T05:36:31.705696+0000","last_fullsized":"2024-09-19T05:36:31.705696+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.715829+0000","last_change":"2024-09-19T05:36:31.710829+0000","last_active":"2024-09-19T05:36:31.715829+0000","last_peered":"2024-09-19T05:36:31.715829+0000","last_clean":"2024-09-19T05:36:31.715829+0000","last_became_active":"2024-09-19T05:36:31.706452+0000","last_became_peered":"2024-09-19T05:36:31.706452+0000","last_unstale":"2024-09-19T05:36:31.715829+0000","last_undegraded":"2024-09-19T05:36:31.715829+0000","last_fullsized":"2024-09-19T05:36:31.715829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:37.754866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703976+0000","last_change":"2024-09-19T05:36:31.703976+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703976+0000","last_undegraded":"2024-09-19T05:36:31.703976+0000","last_fullsized":"2024-09-19T05:36:31.703976+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.722865+0000","last_change":"2024-09-19T05:36:31.717756+0000","last_active":"2024-09-19T05:36:31.722865+0000","last_peered":"2024-09-19T05:36:31.722865+0000","last_clean":"2024-09-19T05:36:31.722865+0000","last_became_active":"2024-09-19T05:36:31.717340+0000","last_became_peered":"2024-09-19T05:36:31.717340+0000","last_unstale":"2024-09-19T05:36:31.722865+0000","last_undegraded":"2024-09-19T05:36:31.722865+0000","last_fullsized":"2024-09-19T05:36:31.722865+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:13.746162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692501+0000","last_change":"2024-09-19T05:36:31.692501+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692501+0000","last_undegraded":"2024-09-19T05:36:31.692501+0000","last_fullsized":"2024-09-19T05:36:31.692501+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.720258+0000","last_change":"2024-09-19T05:36:31.718263+0000","last_active":"2024-09-19T05:36:31.720258+0000","last_peered":"2024-09-19T05:36:31.720258+0000","last_clean":"2024-09-19T05:36:31.720258+0000","last_became_active":"2024-09-19T05:36:31.717602+0000","last_became_peered":"2024-09-19T05:36:31.717602+0000","last_unstale":"2024-09-19T05:36:31.720258+0000","last_undegraded":"2024-09-19T05:36:31.720258+0000","last_fullsized":"2024-09-19T05:36:31.720258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:39.756352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689200+0000","last_change":"2024-09-19T05:36:31.689200+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689200+0000","last_undegraded":"2024-09-19T05:36:31.689200+0000","last_fullsized":"2024-09-19T05:36:31.689200+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.729102+0000","last_change":"2024-09-19T05:36:31.725301+0000","last_active":"2024-09-19T05:36:31.729102+0000","last_peered":"2024-09-19T05:36:31.729102+0000","last_clean":"2024-09-19T05:36:31.729102+0000","last_became_active":"2024-09-19T05:36:31.724624+0000","last_became_peered":"2024-09-19T05:36:31.724624+0000","last_unstale":"2024-09-19T05:36:31.729102+0000","last_undegraded":"2024-09-19T05:36:31.729102+0000","last_fullsized":"2024-09-19T05:36:31.729102+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:03.396329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693273+0000","last_change":"2024-09-19T05:36:31.693273+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693273+0000","last_undegraded":"2024-09-19T05:36:31.693273+0000","last_fullsized":"2024-09-19T05:36:31.693273+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.725945+0000","last_change":"2024-09-19T05:36:31.720578+0000","last_active":"2024-09-19T05:36:31.725945+0000","last_peered":"2024-09-19T05:36:31.725945+0000","last_clean":"2024-09-19T05:36:31.725945+0000","last_became_active":"2024-09-19T05:36:31.720005+0000","last_became_peered":"2024-09-19T05:36:31.720005+0000","last_unstale":"2024-09-19T05:36:31.725945+0000","last_undegraded":"2024-09-19T05:36:31.725945+0000","last_fullsized":"2024-09-19T05:36:31.725945+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:19.063363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692349+0000","last_change":"2024-09-19T05:36:31.692349+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692349+0000","last_undegraded":"2024-09-19T05:36:31.692349+0000","last_fullsized":"2024-09-19T05:36:31.692349+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.722012+0000","last_change":"2024-09-19T05:36:31.717531+0000","last_active":"2024-09-19T05:36:31.722012+0000","last_peered":"2024-09-19T05:36:31.722012+0000","last_clean":"2024-09-19T05:36:31.722012+0000","last_became_active":"2024-09-19T05:36:31.714356+0000","last_became_peered":"2024-09-19T05:36:31.714356+0000","last_unstale":"2024-09-19T05:36:31.722012+0000","last_undegraded":"2024-09-19T05:36:31.722012+0000","last_fullsized":"2024-09-19T05:36:31.722012+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:44.702540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.707869+0000","last_change":"2024-09-19T05:36:31.707869+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.707869+0000","last_undegraded":"2024-09-19T05:36:31.707869+0000","last_fullsized":"2024-09-19T05:36:31.707869+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.715815+0000","last_change":"2024-09-19T05:36:31.711105+0000","last_active":"2024-09-19T05:36:31.715815+0000","last_peered":"2024-09-19T05:36:31.715815+0000","last_clean":"2024-09-19T05:36:31.715815+0000","last_became_active":"2024-09-19T05:36:31.706046+0000","last_became_peered":"2024-09-19T05:36:31.706046+0000","last_unstale":"2024-09-19T05:36:31.715815+0000","last_undegraded":"2024-09-19T05:36:31.715815+0000","last_fullsized":"2024-09-19T05:36:31.715815+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:59.718173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689231+0000","last_change":"2024-09-19T05:36:31.689231+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689231+0000","last_undegraded":"2024-09-19T05:36:31.689231+0000","last_fullsized":"2024-09-19T05:36:31.689231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.717195+0000","last_change":"2024-09-19T05:36:31.712372+0000","last_active":"2024-09-19T05:36:31.717195+0000","last_peered":"2024-09-19T05:36:31.717195+0000","last_clean":"2024-09-19T05:36:31.717195+0000","last_became_active":"2024-09-19T05:36:31.711992+0000","last_became_peered":"2024-09-19T05:36:31.711992+0000","last_unstale":"2024-09-19T05:36:31.717195+0000","last_undegraded":"2024-09-19T05:36:31.717195+0000","last_fullsized":"2024-09-19T05:36:31.717195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:37.135871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.708667+0000","last_change":"2024-09-19T05:36:31.708667+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.708667+0000","last_undegraded":"2024-09-19T05:36:31.708667+0000","last_fullsized":"2024-09-19T05:36:31.708667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.719640+0000","last_change":"2024-09-19T05:36:31.715645+0000","last_active":"2024-09-19T05:36:31.719640+0000","last_peered":"2024-09-19T05:36:31.719640+0000","last_clean":"2024-09-19T05:36:31.719640+0000","last_became_active":"2024-09-19T05:36:31.714877+0000","last_became_peered":"2024-09-19T05:36:31.714877+0000","last_unstale":"2024-09-19T05:36:31.719640+0000","last_undegraded":"2024-09-19T05:36:31.719640+0000","last_fullsized":"2024-09-19T05:36:31.719640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:41.328921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692778+0000","last_change":"2024-09-19T05:36:31.692778+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692778+0000","last_undegraded":"2024-09-19T05:36:31.692778+0000","last_fullsized":"2024-09-19T05:36:31.692778+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.712602+0000","last_change":"2024-09-19T05:36:31.699877+0000","last_active":"2024-09-19T05:36:31.712602+0000","last_peered":"2024-09-19T05:36:31.712602+0000","last_clean":"2024-09-19T05:36:31.712602+0000","last_became_active":"2024-09-19T05:36:31.699104+0000","last_became_peered":"2024-09-19T05:36:31.699104+0000","last_unstale":"2024-09-19T05:36:31.712602+0000","last_undegraded":"2024-09-19T05:36:31.712602+0000","last_fullsized":"2024-09-19T05:36:31.712602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:06.528586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703172+0000","last_change":"2024-09-19T05:36:31.703172+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703172+0000","last_undegraded":"2024-09-19T05:36:31.703172+0000","last_fullsized":"2024-09-19T05:36:31.703172+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726081+0000","last_change":"2024-09-19T05:36:31.723461+0000","last_active":"2024-09-19T05:36:31.726081+0000","last_peered":"2024-09-19T05:36:31.726081+0000","last_clean":"2024-09-19T05:36:31.726081+0000","last_became_active":"2024-09-19T05:36:31.723023+0000","last_became_peered":"2024-09-19T05:36:31.723023+0000","last_unstale":"2024-09-19T05:36:31.726081+0000","last_undegraded":"2024-09-19T05:36:31.726081+0000","last_fullsized":"2024-09-19T05:36:31.726081+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:35.125585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":230,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.705361+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:36:31.705361+0000","last_peered":"2024-09-19T05:36:31.705361+0000","last_clean":"2024-09-19T05:36:31.705361+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:36:31.705361+0000","last_undegraded":"2024-09-19T05:36:31.705361+0000","last_fullsized":"2024-09-19T05:36:31.705361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46268,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325572,"statfs":{"total":96636764160,"available":96589385728,"internally_reserved":0,"allocated":1220608,"data_stored":868940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40108,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331732,"statfs":{"total":96636764160,"available":96595693568,"internally_reserved":0,"allocated":614400,"data_stored":271905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45680,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326160,"statfs":{"total":96636764160,"available":96589987840,"internally_reserved":0,"allocated":614400,"data_stored":271905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40120,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331720,"statfs":{"total":96636764160,"available":96595681280,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40124,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331716,"statfs":{"total":96636764160,"available":96595677184,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542191,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40120,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331720,"statfs":{"total":96636764160,"available":96595681280,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50428,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321412,"statfs":{"total":96636764160,"available":96585125888,"internally_reserved":0,"allocated":1220608,"data_stored":868940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:36:37.142 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:36:37.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.297+0000 7fcb476b0640 1 Processor -- start 2024-09-19T05:36:37.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.297+0000 7fcb476b0640 1 -- start start 2024-09-19T05:36:37.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb476b0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb4015c030 0x7fcb4006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb476b0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb4006e3c0 con 0x7fcb4015d1d0 2024-09-19T05:36:37.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb476b0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb4006e6a0 con 0x7fcb4006f460 2024-09-19T05:36:37.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb476b0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4006e980 con 0x7fcb4015c030 2024-09-19T05:36:37.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb44c4b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcb4015d1d0 0x7fcb400b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46252/0 (socket says 172.21.15.67:46252) 2024-09-19T05:36:37.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb44c4b640 1 -- 172.21.15.67:0/1754679035 learned_addr learned my addr 172.21.15.67:0/1754679035 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb4544c640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb4015c030 0x7fcb4006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574329407 0 0) 0x7fcb4006e3c0 con 0x7fcb4015d1d0 2024-09-19T05:36:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb2c003530 con 0x7fcb4015d1d0 2024-09-19T05:36:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 729491314 0 0) 0x7fcb2c003530 con 0x7fcb4015d1d0 2024-09-19T05:36:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb4015c030 msgr2=0x7fcb4006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb4015c030 0x7fcb4006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 >> v1:172.21.15.97:6789/0 conn(0x7fcb4006f460 legacy=0x7fcb400acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4006ec60 con 0x7fcb4015d1d0 2024-09-19T05:36:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fcb30001680 con 0x7fcb4015d1d0 2024-09-19T05:36:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 >> v1:172.21.15.67:6789/0 conn(0x7fcb4015d1d0 legacy=0x7fcb400b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb2c0039f0 0x7fcb2c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb4015c030 0x7fcb2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb2c004d50 0x7fcb2c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4006e980 con 0x7fcb2c004d50 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c00ba80 con 0x7fcb2c0039f0 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2c00bc80 con 0x7fcb4015c030 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb45c4d640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb2c004d50 0x7fcb2c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb44c4b640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb4015c030 0x7fcb2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb45c4d640 1 -- 172.21.15.67:0/1754679035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb4015c030 msgr2=0x7fcb2c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb45c4d640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb4015c030 0x7fcb2c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb45c4d640 1 -- 172.21.15.67:0/1754679035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb2c0039f0 msgr2=0x7fcb2c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:37.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb45c4d640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb2c0039f0 0x7fcb2c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.301+0000 7fcb45c4d640 1 -- 172.21.15.67:0/1754679035 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c003530 con 0x7fcb2c004d50 2024-09-19T05:36:37.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb45c4d640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb2c004d50 0x7fcb2c0051d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcb38001e40 tx=0x7fcb3801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf4a125232dd834 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:37.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38001a90 con 0x7fcb2c004d50 2024-09-19T05:36:37.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb38003b80 con 0x7fcb2c004d50 2024-09-19T05:36:37.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb37fff640 1 -- 172.21.15.67:0/1754679035 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38005080 con 0x7fcb2c004d50 2024-09-19T05:36:37.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 -- 172.21.15.67:0/1754679035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb2c004d50 msgr2=0x7fcb2c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 --2- 172.21.15.67:0/1754679035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb2c004d50 0x7fcb2c0051d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcb38001e40 tx=0x7fcb3801c760 comp rx=0 tx=0).stop 2024-09-19T05:36:37.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb45c4d640 1 -- 172.21.15.67:0/1754679035 reap_dead start 2024-09-19T05:36:37.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 -- 172.21.15.67:0/1754679035 shutdown_connections 2024-09-19T05:36:37.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 -- 172.21.15.67:0/1754679035 >> 172.21.15.67:0/1754679035 conn(0x7fcb400d0080 msgr2=0x7fcb400d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:37.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 -- 172.21.15.67:0/1754679035 shutdown_connections 2024-09-19T05:36:37.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 -- 172.21.15.67:0/1754679035 wait complete. 2024-09-19T05:36:37.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 Processor -- start 2024-09-19T05:36:37.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 -- start start 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb2c004d50 0x7fcb401ef9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4013ec20 0x7fcb401552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb4015e430 0x7fcb4015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcb400b36e0 con 0x7fcb4013ec20 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4015d630 con 0x7fcb4015e430 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb476b0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcb40159a30 con 0x7fcb2c004d50 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb44c4b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4013ec20 0x7fcb401552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb44c4b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4013ec20 0x7fcb401552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58300/0 (socket says 172.21.15.67:58300) 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb44c4b640 1 -- 172.21.15.67:0/2697164628 learned_addr learned my addr 172.21.15.67:0/2697164628 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb4544c640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb2c004d50 0x7fcb401ef9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb45c4d640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb4015e430 0x7fcb4015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb44c4b640 1 -- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb2c004d50 msgr2=0x7fcb401ef9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb44c4b640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb2c004d50 0x7fcb401ef9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb44c4b640 1 -- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb4015e430 msgr2=0x7fcb4015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb44c4b640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb4015e430 0x7fcb4015e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.305+0000 7fcb44c4b640 1 -- 172.21.15.67:0/2697164628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb40154bc0 con 0x7fcb4013ec20 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb44c4b640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4013ec20 0x7fcb401552c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcb30001cb0 tx=0x7fcb3000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb35ffb640 1 -- 172.21.15.67:0/2697164628 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000c8d0 con 0x7fcb4013ec20 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb35ffb640 1 -- 172.21.15.67:0/2697164628 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb30018070 con 0x7fcb4013ec20 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb35ffb640 1 -- 172.21.15.67:0/2697164628 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000ccd0 con 0x7fcb4013ec20 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb476b0640 1 -- 172.21.15.67:0/2697164628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb401eff00 con 0x7fcb4013ec20 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb476b0640 1 -- 172.21.15.67:0/2697164628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb40154600 con 0x7fcb4013ec20 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb476b0640 1 -- 172.21.15.67:0/2697164628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb40159e20 con 0x7fcb4013ec20 2024-09-19T05:36:37.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb35ffb640 1 -- 172.21.15.67:0/2697164628 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcb30013420 con 0x7fcb4013ec20 2024-09-19T05:36:37.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb35ffb640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcb240678f0 0x7fcb24069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb35ffb640 1 -- 172.21.15.67:0/2697164628 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fcb30085930 con 0x7fcb4013ec20 2024-09-19T05:36:37.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb4544c640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcb240678f0 0x7fcb24069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.309+0000 7fcb4544c640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcb240678f0 0x7fcb24069db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcb401f3550 tx=0x7fcb3c009320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:37.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.313+0000 7fcb35ffb640 1 -- 172.21.15.67:0/2697164628 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fcb40159e20 con 0x7fcb4013ec20 2024-09-19T05:36:37.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.477+0000 7fcb476b0640 1 -- 172.21.15.67:0/2697164628 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb4015c410 con 0x7fcb240678f0 2024-09-19T05:36:37.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.493+0000 7fcb35ffb640 1 -- 172.21.15.67:0/2697164628 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7fcb4015c410 con 0x7fcb240678f0 2024-09-19T05:36:37.501 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:37.503 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:36:37.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 -- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcb240678f0 msgr2=0x7fcb24069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcb240678f0 0x7fcb24069db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcb401f3550 tx=0x7fcb3c009320 comp rx=0 tx=0).stop 2024-09-19T05:36:37.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 -- 172.21.15.67:0/2697164628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4013ec20 msgr2=0x7fcb401552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4013ec20 0x7fcb401552c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcb30001cb0 tx=0x7fcb3000ec30 comp rx=0 tx=0).stop 2024-09-19T05:36:37.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 -- 172.21.15.67:0/2697164628 shutdown_connections 2024-09-19T05:36:37.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb4015e430 0x7fcb4015e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4013ec20 0x7fcb401552c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcb240678f0 0x7fcb24069db0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 --2- 172.21.15.67:0/2697164628 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb2c004d50 0x7fcb401ef9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 -- 172.21.15.67:0/2697164628 >> 172.21.15.67:0/2697164628 conn(0x7fcb400d0080 msgr2=0x7fcb4015d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:37.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 -- 172.21.15.67:0/2697164628 shutdown_connections 2024-09-19T05:36:37.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.497+0000 7fcb476b0640 1 -- 172.21.15.67:0/2697164628 wait complete. 2024-09-19T05:36:37.520 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-19T05:36:37.177966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":342980,"kb_used_data":6032,"kb_used_omap":12,"kb_used_meta":336755,"kb_avail":754631740,"statfs":{"total":773094113280,"available":772742901760,"internally_reserved":0,"allocated":6176768,"data_stored":3395978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":344837681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001926"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695243+0000","last_change":"2024-09-19T05:36:31.695243+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695243+0000","last_undegraded":"2024-09-19T05:36:31.695243+0000","last_fullsized":"2024-09-19T05:36:31.695243+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.696564+0000","last_change":"2024-09-19T05:36:31.696564+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.696564+0000","last_undegraded":"2024-09-19T05:36:31.696564+0000","last_fullsized":"2024-09-19T05:36:31.696564+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704128+0000","last_change":"2024-09-19T05:36:31.704128+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704128+0000","last_undegraded":"2024-09-19T05:36:31.704128+0000","last_fullsized":"2024-09-19T05:36:31.704128+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695310+0000","last_change":"2024-09-19T05:36:31.695310+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695310+0000","last_undegraded":"2024-09-19T05:36:31.695310+0000","last_fullsized":"2024-09-19T05:36:31.695310+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.698377+0000","last_change":"2024-09-19T05:36:31.698377+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.698377+0000","last_undegraded":"2024-09-19T05:36:31.698377+0000","last_fullsized":"2024-09-19T05:36:31.698377+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694310+0000","last_change":"2024-09-19T05:36:31.694310+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694310+0000","last_undegraded":"2024-09-19T05:36:31.694310+0000","last_fullsized":"2024-09-19T05:36:31.694310+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702973+0000","last_change":"2024-09-19T05:36:31.702973+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702973+0000","last_undegraded":"2024-09-19T05:36:31.702973+0000","last_fullsized":"2024-09-19T05:36:31.702973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703561+0000","last_change":"2024-09-19T05:36:31.703561+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703561+0000","last_undegraded":"2024-09-19T05:36:31.703561+0000","last_fullsized":"2024-09-19T05:36:31.703561+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702176+0000","last_change":"2024-09-19T05:36:31.702176+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702176+0000","last_undegraded":"2024-09-19T05:36:31.702176+0000","last_fullsized":"2024-09-19T05:36:31.702176+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694587+0000","last_change":"2024-09-19T05:36:31.694587+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694587+0000","last_undegraded":"2024-09-19T05:36:31.694587+0000","last_fullsized":"2024-09-19T05:36:31.694587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695869+0000","last_change":"2024-09-19T05:36:31.695869+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695869+0000","last_undegraded":"2024-09-19T05:36:31.695869+0000","last_fullsized":"2024-09-19T05:36:31.695869+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702307+0000","last_change":"2024-09-19T05:36:31.702307+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702307+0000","last_undegraded":"2024-09-19T05:36:31.702307+0000","last_fullsized":"2024-09-19T05:36:31.702307+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693048+0000","last_change":"2024-09-19T05:36:31.693048+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693048+0000","last_undegraded":"2024-09-19T05:36:31.693048+0000","last_fullsized":"2024-09-19T05:36:31.693048+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.712302+0000","last_change":"2024-09-19T05:36:31.712302+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.712302+0000","last_undegraded":"2024-09-19T05:36:31.712302+0000","last_fullsized":"2024-09-19T05:36:31.712302+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695497+0000","last_change":"2024-09-19T05:36:31.695497+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695497+0000","last_undegraded":"2024-09-19T05:36:31.695497+0000","last_fullsized":"2024-09-19T05:36:31.695497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693291+0000","last_change":"2024-09-19T05:36:31.693291+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693291+0000","last_undegraded":"2024-09-19T05:36:31.693291+0000","last_fullsized":"2024-09-19T05:36:31.693291+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704335+0000","last_change":"2024-09-19T05:36:31.704335+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704335+0000","last_undegraded":"2024-09-19T05:36:31.704335+0000","last_fullsized":"2024-09-19T05:36:31.704335+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695472+0000","last_change":"2024-09-19T05:36:31.695472+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695472+0000","last_undegraded":"2024-09-19T05:36:31.695472+0000","last_fullsized":"2024-09-19T05:36:31.695472+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703533+0000","last_change":"2024-09-19T05:36:31.703533+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703533+0000","last_undegraded":"2024-09-19T05:36:31.703533+0000","last_fullsized":"2024-09-19T05:36:31.703533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.710477+0000","last_change":"2024-09-19T05:36:31.710477+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.710477+0000","last_undegraded":"2024-09-19T05:36:31.710477+0000","last_fullsized":"2024-09-19T05:36:31.710477+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.708401+0000","last_change":"2024-09-19T05:36:31.708401+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.708401+0000","last_undegraded":"2024-09-19T05:36:31.708401+0000","last_fullsized":"2024-09-19T05:36:31.708401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701714+0000","last_change":"2024-09-19T05:36:31.701714+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701714+0000","last_undegraded":"2024-09-19T05:36:31.701714+0000","last_fullsized":"2024-09-19T05:36:31.701714+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695345+0000","last_change":"2024-09-19T05:36:31.695345+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695345+0000","last_undegraded":"2024-09-19T05:36:31.695345+0000","last_fullsized":"2024-09-19T05:36:31.695345+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704065+0000","last_change":"2024-09-19T05:36:31.704065+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704065+0000","last_undegraded":"2024-09-19T05:36:31.704065+0000","last_fullsized":"2024-09-19T05:36:31.704065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703131+0000","last_change":"2024-09-19T05:36:31.703131+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703131+0000","last_undegraded":"2024-09-19T05:36:31.703131+0000","last_fullsized":"2024-09-19T05:36:31.703131+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702998+0000","last_change":"2024-09-19T05:36:31.702998+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702998+0000","last_undegraded":"2024-09-19T05:36:31.702998+0000","last_fullsized":"2024-09-19T05:36:31.702998+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692405+0000","last_change":"2024-09-19T05:36:31.692405+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692405+0000","last_undegraded":"2024-09-19T05:36:31.692405+0000","last_fullsized":"2024-09-19T05:36:31.692405+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.709378+0000","last_change":"2024-09-19T05:36:31.709378+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.709378+0000","last_undegraded":"2024-09-19T05:36:31.709378+0000","last_fullsized":"2024-09-19T05:36:31.709378+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704693+0000","last_change":"2024-09-19T05:36:31.704693+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704693+0000","last_undegraded":"2024-09-19T05:36:31.704693+0000","last_fullsized":"2024-09-19T05:36:31.704693+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695357+0000","last_change":"2024-09-19T05:36:31.695357+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695357+0000","last_undegraded":"2024-09-19T05:36:31.695357+0000","last_fullsized":"2024-09-19T05:36:31.695357+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.700741+0000","last_change":"2024-09-19T05:36:31.700741+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.700741+0000","last_undegraded":"2024-09-19T05:36:31.700741+0000","last_fullsized":"2024-09-19T05:36:31.700741+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690577+0000","last_change":"2024-09-19T05:36:31.690577+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690577+0000","last_undegraded":"2024-09-19T05:36:31.690577+0000","last_fullsized":"2024-09-19T05:36:31.690577+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703100+0000","last_change":"2024-09-19T05:36:31.703100+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703100+0000","last_undegraded":"2024-09-19T05:36:31.703100+0000","last_fullsized":"2024-09-19T05:36:31.703100+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728234+0000","last_change":"2024-09-19T05:36:31.720380+0000","last_active":"2024-09-19T05:36:31.728234+0000","last_peered":"2024-09-19T05:36:31.728234+0000","last_clean":"2024-09-19T05:36:31.728234+0000","last_became_active":"2024-09-19T05:36:31.719637+0000","last_became_peered":"2024-09-19T05:36:31.719637+0000","last_unstale":"2024-09-19T05:36:31.728234+0000","last_undegraded":"2024-09-19T05:36:31.728234+0000","last_fullsized":"2024-09-19T05:36:31.728234+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:30.048643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689230+0000","last_change":"2024-09-19T05:36:31.689230+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689230+0000","last_undegraded":"2024-09-19T05:36:31.689230+0000","last_fullsized":"2024-09-19T05:36:31.689230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.716018+0000","last_change":"2024-09-19T05:36:31.713644+0000","last_active":"2024-09-19T05:36:31.716018+0000","last_peered":"2024-09-19T05:36:31.716018+0000","last_clean":"2024-09-19T05:36:31.716018+0000","last_became_active":"2024-09-19T05:36:31.713286+0000","last_became_peered":"2024-09-19T05:36:31.713286+0000","last_unstale":"2024-09-19T05:36:31.716018+0000","last_undegraded":"2024-09-19T05:36:31.716018+0000","last_fullsized":"2024-09-19T05:36:31.716018+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:44.702540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703745+0000","last_change":"2024-09-19T05:36:31.703745+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703745+0000","last_undegraded":"2024-09-19T05:36:31.703745+0000","last_fullsized":"2024-09-19T05:36:31.703745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.724666+0000","last_change":"2024-09-19T05:36:31.723946+0000","last_active":"2024-09-19T05:36:31.724666+0000","last_peered":"2024-09-19T05:36:31.724666+0000","last_clean":"2024-09-19T05:36:31.724666+0000","last_became_active":"2024-09-19T05:36:31.720000+0000","last_became_peered":"2024-09-19T05:36:31.720000+0000","last_unstale":"2024-09-19T05:36:31.724666+0000","last_undegraded":"2024-09-19T05:36:31.724666+0000","last_fullsized":"2024-09-19T05:36:31.724666+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:13.746162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.697485+0000","last_change":"2024-09-19T05:36:31.697485+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.697485+0000","last_undegraded":"2024-09-19T05:36:31.697485+0000","last_fullsized":"2024-09-19T05:36:31.697485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.712577+0000","last_change":"2024-09-19T05:36:31.711293+0000","last_active":"2024-09-19T05:36:31.712577+0000","last_peered":"2024-09-19T05:36:31.712577+0000","last_clean":"2024-09-19T05:36:31.712577+0000","last_became_active":"2024-09-19T05:36:31.710502+0000","last_became_peered":"2024-09-19T05:36:31.710502+0000","last_unstale":"2024-09-19T05:36:31.712577+0000","last_undegraded":"2024-09-19T05:36:31.712577+0000","last_fullsized":"2024-09-19T05:36:31.712577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:53.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695798+0000","last_change":"2024-09-19T05:36:31.695798+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695798+0000","last_undegraded":"2024-09-19T05:36:31.695798+0000","last_fullsized":"2024-09-19T05:36:31.695798+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726178+0000","last_change":"2024-09-19T05:36:31.722407+0000","last_active":"2024-09-19T05:36:31.726178+0000","last_peered":"2024-09-19T05:36:31.726178+0000","last_clean":"2024-09-19T05:36:31.726178+0000","last_became_active":"2024-09-19T05:36:31.721773+0000","last_became_peered":"2024-09-19T05:36:31.721773+0000","last_unstale":"2024-09-19T05:36:31.726178+0000","last_undegraded":"2024-09-19T05:36:31.726178+0000","last_fullsized":"2024-09-19T05:36:31.726178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:00.054246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695555+0000","last_change":"2024-09-19T05:36:31.695555+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695555+0000","last_undegraded":"2024-09-19T05:36:31.695555+0000","last_fullsized":"2024-09-19T05:36:31.695555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.724377+0000","last_change":"2024-09-19T05:36:31.722915+0000","last_active":"2024-09-19T05:36:31.724377+0000","last_peered":"2024-09-19T05:36:31.724377+0000","last_clean":"2024-09-19T05:36:31.724377+0000","last_became_active":"2024-09-19T05:36:31.722202+0000","last_became_peered":"2024-09-19T05:36:31.722202+0000","last_unstale":"2024-09-19T05:36:31.724377+0000","last_undegraded":"2024-09-19T05:36:31.724377+0000","last_fullsized":"2024-09-19T05:36:31.724377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:37.554854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701775+0000","last_change":"2024-09-19T05:36:31.701775+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701775+0000","last_undegraded":"2024-09-19T05:36:31.701775+0000","last_fullsized":"2024-09-19T05:36:31.701775+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728164+0000","last_change":"2024-09-19T05:36:31.718437+0000","last_active":"2024-09-19T05:36:31.728164+0000","last_peered":"2024-09-19T05:36:31.728164+0000","last_clean":"2024-09-19T05:36:31.728164+0000","last_became_active":"2024-09-19T05:36:31.717715+0000","last_became_peered":"2024-09-19T05:36:31.717715+0000","last_unstale":"2024-09-19T05:36:31.728164+0000","last_undegraded":"2024-09-19T05:36:31.728164+0000","last_fullsized":"2024-09-19T05:36:31.728164+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:13.359294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701973+0000","last_change":"2024-09-19T05:36:31.701973+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701973+0000","last_undegraded":"2024-09-19T05:36:31.701973+0000","last_fullsized":"2024-09-19T05:36:31.701973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726034+0000","last_change":"2024-09-19T05:36:31.722496+0000","last_active":"2024-09-19T05:36:31.726034+0000","last_peered":"2024-09-19T05:36:31.726034+0000","last_clean":"2024-09-19T05:36:31.726034+0000","last_became_active":"2024-09-19T05:36:31.722059+0000","last_became_peered":"2024-09-19T05:36:31.722059+0000","last_unstale":"2024-09-19T05:36:31.726034+0000","last_undegraded":"2024-09-19T05:36:31.726034+0000","last_fullsized":"2024-09-19T05:36:31.726034+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.296474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694532+0000","last_change":"2024-09-19T05:36:31.694532+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694532+0000","last_undegraded":"2024-09-19T05:36:31.694532+0000","last_fullsized":"2024-09-19T05:36:31.694532+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726259+0000","last_change":"2024-09-19T05:36:31.722252+0000","last_active":"2024-09-19T05:36:31.726259+0000","last_peered":"2024-09-19T05:36:31.726259+0000","last_clean":"2024-09-19T05:36:31.726259+0000","last_became_active":"2024-09-19T05:36:31.721596+0000","last_became_peered":"2024-09-19T05:36:31.721596+0000","last_unstale":"2024-09-19T05:36:31.726259+0000","last_undegraded":"2024-09-19T05:36:31.726259+0000","last_fullsized":"2024-09-19T05:36:31.726259+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:41.387886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690490+0000","last_change":"2024-09-19T05:36:31.690490+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690490+0000","last_undegraded":"2024-09-19T05:36:31.690490+0000","last_fullsized":"2024-09-19T05:36:31.690490+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.718878+0000","last_change":"2024-09-19T05:36:31.716615+0000","last_active":"2024-09-19T05:36:31.718878+0000","last_peered":"2024-09-19T05:36:31.718878+0000","last_clean":"2024-09-19T05:36:31.718878+0000","last_became_active":"2024-09-19T05:36:31.715826+0000","last_became_peered":"2024-09-19T05:36:31.715826+0000","last_unstale":"2024-09-19T05:36:31.718878+0000","last_undegraded":"2024-09-19T05:36:31.718878+0000","last_fullsized":"2024-09-19T05:36:31.718878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:03.396329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.709107+0000","last_change":"2024-09-19T05:36:31.709107+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.709107+0000","last_undegraded":"2024-09-19T05:36:31.709107+0000","last_fullsized":"2024-09-19T05:36:31.709107+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726958+0000","last_change":"2024-09-19T05:36:31.726088+0000","last_active":"2024-09-19T05:36:31.726958+0000","last_peered":"2024-09-19T05:36:31.726958+0000","last_clean":"2024-09-19T05:36:31.726958+0000","last_became_active":"2024-09-19T05:36:31.725457+0000","last_became_peered":"2024-09-19T05:36:31.725457+0000","last_unstale":"2024-09-19T05:36:31.726958+0000","last_undegraded":"2024-09-19T05:36:31.726958+0000","last_fullsized":"2024-09-19T05:36:31.726958+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:02.848303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.697211+0000","last_change":"2024-09-19T05:36:31.697211+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.697211+0000","last_undegraded":"2024-09-19T05:36:31.697211+0000","last_fullsized":"2024-09-19T05:36:31.697211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.717247+0000","last_change":"2024-09-19T05:36:31.711849+0000","last_active":"2024-09-19T05:36:31.717247+0000","last_peered":"2024-09-19T05:36:31.717247+0000","last_clean":"2024-09-19T05:36:31.717247+0000","last_became_active":"2024-09-19T05:36:31.706778+0000","last_became_peered":"2024-09-19T05:36:31.706778+0000","last_unstale":"2024-09-19T05:36:31.717247+0000","last_undegraded":"2024-09-19T05:36:31.717247+0000","last_fullsized":"2024-09-19T05:36:31.717247+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:37.962059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.691652+0000","last_change":"2024-09-19T05:36:31.691652+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.691652+0000","last_undegraded":"2024-09-19T05:36:31.691652+0000","last_fullsized":"2024-09-19T05:36:31.691652+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.723174+0000","last_change":"2024-09-19T05:36:31.718931+0000","last_active":"2024-09-19T05:36:31.723174+0000","last_peered":"2024-09-19T05:36:31.723174+0000","last_clean":"2024-09-19T05:36:31.723174+0000","last_became_active":"2024-09-19T05:36:31.718531+0000","last_became_peered":"2024-09-19T05:36:31.718531+0000","last_unstale":"2024-09-19T05:36:31.723174+0000","last_undegraded":"2024-09-19T05:36:31.723174+0000","last_fullsized":"2024-09-19T05:36:31.723174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:51.939635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702894+0000","last_change":"2024-09-19T05:36:31.702894+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702894+0000","last_undegraded":"2024-09-19T05:36:31.702894+0000","last_fullsized":"2024-09-19T05:36:31.702894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728979+0000","last_change":"2024-09-19T05:36:31.725430+0000","last_active":"2024-09-19T05:36:31.728979+0000","last_peered":"2024-09-19T05:36:31.728979+0000","last_clean":"2024-09-19T05:36:31.728979+0000","last_became_active":"2024-09-19T05:36:31.724751+0000","last_became_peered":"2024-09-19T05:36:31.724751+0000","last_unstale":"2024-09-19T05:36:31.728979+0000","last_undegraded":"2024-09-19T05:36:31.728979+0000","last_fullsized":"2024-09-19T05:36:31.728979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:41.328921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702422+0000","last_change":"2024-09-19T05:36:31.702422+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702422+0000","last_undegraded":"2024-09-19T05:36:31.702422+0000","last_fullsized":"2024-09-19T05:36:31.702422+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.730192+0000","last_change":"2024-09-19T05:36:31.729413+0000","last_active":"2024-09-19T05:36:31.730192+0000","last_peered":"2024-09-19T05:36:31.730192+0000","last_clean":"2024-09-19T05:36:31.730192+0000","last_became_active":"2024-09-19T05:36:31.728706+0000","last_became_peered":"2024-09-19T05:36:31.728706+0000","last_unstale":"2024-09-19T05:36:31.730192+0000","last_undegraded":"2024-09-19T05:36:31.730192+0000","last_fullsized":"2024-09-19T05:36:31.730192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:42:02.107320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.712535+0000","last_change":"2024-09-19T05:36:31.712535+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.712535+0000","last_undegraded":"2024-09-19T05:36:31.712535+0000","last_fullsized":"2024-09-19T05:36:31.712535+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.713195+0000","last_change":"2024-09-19T05:36:31.706868+0000","last_active":"2024-09-19T05:36:31.713195+0000","last_peered":"2024-09-19T05:36:31.713195+0000","last_clean":"2024-09-19T05:36:31.713195+0000","last_became_active":"2024-09-19T05:36:31.706503+0000","last_became_peered":"2024-09-19T05:36:31.706503+0000","last_unstale":"2024-09-19T05:36:31.713195+0000","last_undegraded":"2024-09-19T05:36:31.713195+0000","last_fullsized":"2024-09-19T05:36:31.713195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:55.270382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693510+0000","last_change":"2024-09-19T05:36:31.693510+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693510+0000","last_undegraded":"2024-09-19T05:36:31.693510+0000","last_fullsized":"2024-09-19T05:36:31.693510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.723287+0000","last_change":"2024-09-19T05:36:31.720065+0000","last_active":"2024-09-19T05:36:31.723287+0000","last_peered":"2024-09-19T05:36:31.723287+0000","last_clean":"2024-09-19T05:36:31.723287+0000","last_became_active":"2024-09-19T05:36:31.719280+0000","last_became_peered":"2024-09-19T05:36:31.719280+0000","last_unstale":"2024-09-19T05:36:31.723287+0000","last_undegraded":"2024-09-19T05:36:31.723287+0000","last_fullsized":"2024-09-19T05:36:31.723287+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:38.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692011+0000","last_change":"2024-09-19T05:36:31.692011+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692011+0000","last_undegraded":"2024-09-19T05:36:31.692011+0000","last_fullsized":"2024-09-19T05:36:31.692011+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.709674+0000","last_change":"2024-09-19T05:36:31.705115+0000","last_active":"2024-09-19T05:36:31.709674+0000","last_peered":"2024-09-19T05:36:31.709674+0000","last_clean":"2024-09-19T05:36:31.709674+0000","last_became_active":"2024-09-19T05:36:31.702064+0000","last_became_peered":"2024-09-19T05:36:31.702064+0000","last_unstale":"2024-09-19T05:36:31.709674+0000","last_undegraded":"2024-09-19T05:36:31.709674+0000","last_fullsized":"2024-09-19T05:36:31.709674+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:26.652533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.696480+0000","last_change":"2024-09-19T05:36:31.696480+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.696480+0000","last_undegraded":"2024-09-19T05:36:31.696480+0000","last_fullsized":"2024-09-19T05:36:31.696480+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728092+0000","last_change":"2024-09-19T05:36:31.717880+0000","last_active":"2024-09-19T05:36:31.728092+0000","last_peered":"2024-09-19T05:36:31.728092+0000","last_clean":"2024-09-19T05:36:31.728092+0000","last_became_active":"2024-09-19T05:36:31.717112+0000","last_became_peered":"2024-09-19T05:36:31.717112+0000","last_unstale":"2024-09-19T05:36:31.728092+0000","last_undegraded":"2024-09-19T05:36:31.728092+0000","last_fullsized":"2024-09-19T05:36:31.728092+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:38.586563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692007+0000","last_change":"2024-09-19T05:36:31.692007+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692007+0000","last_undegraded":"2024-09-19T05:36:31.692007+0000","last_fullsized":"2024-09-19T05:36:31.692007+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728152+0000","last_change":"2024-09-19T05:36:31.717969+0000","last_active":"2024-09-19T05:36:31.728152+0000","last_peered":"2024-09-19T05:36:31.728152+0000","last_clean":"2024-09-19T05:36:31.728152+0000","last_became_active":"2024-09-19T05:36:31.717083+0000","last_became_peered":"2024-09-19T05:36:31.717083+0000","last_unstale":"2024-09-19T05:36:31.728152+0000","last_undegraded":"2024-09-19T05:36:31.728152+0000","last_fullsized":"2024-09-19T05:36:31.728152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:31.534391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690595+0000","last_change":"2024-09-19T05:36:31.690595+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690595+0000","last_undegraded":"2024-09-19T05:36:31.690595+0000","last_fullsized":"2024-09-19T05:36:31.690595+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.710013+0000","last_change":"2024-09-19T05:36:31.699706+0000","last_active":"2024-09-19T05:36:31.710013+0000","last_peered":"2024-09-19T05:36:31.710013+0000","last_clean":"2024-09-19T05:36:31.710013+0000","last_became_active":"2024-09-19T05:36:31.699290+0000","last_became_peered":"2024-09-19T05:36:31.699290+0000","last_unstale":"2024-09-19T05:36:31.710013+0000","last_undegraded":"2024-09-19T05:36:31.710013+0000","last_fullsized":"2024-09-19T05:36:31.710013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:41.522320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.705696+0000","last_change":"2024-09-19T05:36:31.705696+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.705696+0000","last_undegraded":"2024-09-19T05:36:31.705696+0000","last_fullsized":"2024-09-19T05:36:31.705696+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.715829+0000","last_change":"2024-09-19T05:36:31.710829+0000","last_active":"2024-09-19T05:36:31.715829+0000","last_peered":"2024-09-19T05:36:31.715829+0000","last_clean":"2024-09-19T05:36:31.715829+0000","last_became_active":"2024-09-19T05:36:31.706452+0000","last_became_peered":"2024-09-19T05:36:31.706452+0000","last_unstale":"2024-09-19T05:36:31.715829+0000","last_undegraded":"2024-09-19T05:36:31.715829+0000","last_fullsized":"2024-09-19T05:36:31.715829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:37.754866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703976+0000","last_change":"2024-09-19T05:36:31.703976+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703976+0000","last_undegraded":"2024-09-19T05:36:31.703976+0000","last_fullsized":"2024-09-19T05:36:31.703976+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.722865+0000","last_change":"2024-09-19T05:36:31.717756+0000","last_active":"2024-09-19T05:36:31.722865+0000","last_peered":"2024-09-19T05:36:31.722865+0000","last_clean":"2024-09-19T05:36:31.722865+0000","last_became_active":"2024-09-19T05:36:31.717340+0000","last_became_peered":"2024-09-19T05:36:31.717340+0000","last_unstale":"2024-09-19T05:36:31.722865+0000","last_undegraded":"2024-09-19T05:36:31.722865+0000","last_fullsized":"2024-09-19T05:36:31.722865+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:13.746162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692501+0000","last_change":"2024-09-19T05:36:31.692501+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692501+0000","last_undegraded":"2024-09-19T05:36:31.692501+0000","last_fullsized":"2024-09-19T05:36:31.692501+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.720258+0000","last_change":"2024-09-19T05:36:31.718263+0000","last_active":"2024-09-19T05:36:31.720258+0000","last_peered":"2024-09-19T05:36:31.720258+0000","last_clean":"2024-09-19T05:36:31.720258+0000","last_became_active":"2024-09-19T05:36:31.717602+0000","last_became_peered":"2024-09-19T05:36:31.717602+0000","last_unstale":"2024-09-19T05:36:31.720258+0000","last_undegraded":"2024-09-19T05:36:31.720258+0000","last_fullsized":"2024-09-19T05:36:31.720258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:39.756352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689200+0000","last_change":"2024-09-19T05:36:31.689200+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689200+0000","last_undegraded":"2024-09-19T05:36:31.689200+0000","last_fullsized":"2024-09-19T05:36:31.689200+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.729102+0000","last_change":"2024-09-19T05:36:31.725301+0000","last_active":"2024-09-19T05:36:31.729102+0000","last_peered":"2024-09-19T05:36:31.729102+0000","last_clean":"2024-09-19T05:36:31.729102+0000","last_became_active":"2024-09-19T05:36:31.724624+0000","last_became_peered":"2024-09-19T05:36:31.724624+0000","last_unstale":"2024-09-19T05:36:31.729102+0000","last_undegraded":"2024-09-19T05:36:31.729102+0000","last_fullsized":"2024-09-19T05:36:31.729102+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:03.396329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693273+0000","last_change":"2024-09-19T05:36:31.693273+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693273+0000","last_undegraded":"2024-09-19T05:36:31.693273+0000","last_fullsized":"2024-09-19T05:36:31.693273+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.725945+0000","last_change":"2024-09-19T05:36:31.720578+0000","last_active":"2024-09-19T05:36:31.725945+0000","last_peered":"2024-09-19T05:36:31.725945+0000","last_clean":"2024-09-19T05:36:31.725945+0000","last_became_active":"2024-09-19T05:36:31.720005+0000","last_became_peered":"2024-09-19T05:36:31.720005+0000","last_unstale":"2024-09-19T05:36:31.725945+0000","last_undegraded":"2024-09-19T05:36:31.725945+0000","last_fullsized":"2024-09-19T05:36:31.725945+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:19.063363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692349+0000","last_change":"2024-09-19T05:36:31.692349+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692349+0000","last_undegraded":"2024-09-19T05:36:31.692349+0000","last_fullsized":"2024-09-19T05:36:31.692349+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.722012+0000","last_change":"2024-09-19T05:36:31.717531+0000","last_active":"2024-09-19T05:36:31.722012+0000","last_peered":"2024-09-19T05:36:31.722012+0000","last_clean":"2024-09-19T05:36:31.722012+0000","last_became_active":"2024-09-19T05:36:31.714356+0000","last_became_peered":"2024-09-19T05:36:31.714356+0000","last_unstale":"2024-09-19T05:36:31.722012+0000","last_undegraded":"2024-09-19T05:36:31.722012+0000","last_fullsized":"2024-09-19T05:36:31.722012+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:44.702540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.707869+0000","last_change":"2024-09-19T05:36:31.707869+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.707869+0000","last_undegraded":"2024-09-19T05:36:31.707869+0000","last_fullsized":"2024-09-19T05:36:31.707869+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.715815+0000","last_change":"2024-09-19T05:36:31.711105+0000","last_active":"2024-09-19T05:36:31.715815+0000","last_peered":"2024-09-19T05:36:31.715815+0000","last_clean":"2024-09-19T05:36:31.715815+0000","last_became_active":"2024-09-19T05:36:31.706046+0000","last_became_peered":"2024-09-19T05:36:31.706046+0000","last_unstale":"2024-09-19T05:36:31.715815+0000","last_undegraded":"2024-09-19T05:36:31.715815+0000","last_fullsized":"2024-09-19T05:36:31.715815+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:59.718173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689231+0000","last_change":"2024-09-19T05:36:31.689231+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689231+0000","last_undegraded":"2024-09-19T05:36:31.689231+0000","last_fullsized":"2024-09-19T05:36:31.689231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.717195+0000","last_change":"2024-09-19T05:36:31.712372+0000","last_active":"2024-09-19T05:36:31.717195+0000","last_peered":"2024-09-19T05:36:31.717195+0000","last_clean":"2024-09-19T05:36:31.717195+0000","last_became_active":"2024-09-19T05:36:31.711992+0000","last_became_peered":"2024-09-19T05:36:31.711992+0000","last_unstale":"2024-09-19T05:36:31.717195+0000","last_undegraded":"2024-09-19T05:36:31.717195+0000","last_fullsized":"2024-09-19T05:36:31.717195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:37.135871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.708667+0000","last_change":"2024-09-19T05:36:31.708667+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.708667+0000","last_undegraded":"2024-09-19T05:36:31.708667+0000","last_fullsized":"2024-09-19T05:36:31.708667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.719640+0000","last_change":"2024-09-19T05:36:31.715645+0000","last_active":"2024-09-19T05:36:31.719640+0000","last_peered":"2024-09-19T05:36:31.719640+0000","last_clean":"2024-09-19T05:36:31.719640+0000","last_became_active":"2024-09-19T05:36:31.714877+0000","last_became_peered":"2024-09-19T05:36:31.714877+0000","last_unstale":"2024-09-19T05:36:31.719640+0000","last_undegraded":"2024-09-19T05:36:31.719640+0000","last_fullsized":"2024-09-19T05:36:31.719640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:41.328921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692778+0000","last_change":"2024-09-19T05:36:31.692778+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692778+0000","last_undegraded":"2024-09-19T05:36:31.692778+0000","last_fullsized":"2024-09-19T05:36:31.692778+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.712602+0000","last_change":"2024-09-19T05:36:31.699877+0000","last_active":"2024-09-19T05:36:31.712602+0000","last_peered":"2024-09-19T05:36:31.712602+0000","last_clean":"2024-09-19T05:36:31.712602+0000","last_became_active":"2024-09-19T05:36:31.699104+0000","last_became_peered":"2024-09-19T05:36:31.699104+0000","last_unstale":"2024-09-19T05:36:31.712602+0000","last_undegraded":"2024-09-19T05:36:31.712602+0000","last_fullsized":"2024-09-19T05:36:31.712602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:06.528586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703172+0000","last_change":"2024-09-19T05:36:31.703172+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703172+0000","last_undegraded":"2024-09-19T05:36:31.703172+0000","last_fullsized":"2024-09-19T05:36:31.703172+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726081+0000","last_change":"2024-09-19T05:36:31.723461+0000","last_active":"2024-09-19T05:36:31.726081+0000","last_peered":"2024-09-19T05:36:31.726081+0000","last_clean":"2024-09-19T05:36:31.726081+0000","last_became_active":"2024-09-19T05:36:31.723023+0000","last_became_peered":"2024-09-19T05:36:31.723023+0000","last_unstale":"2024-09-19T05:36:31.726081+0000","last_undegraded":"2024-09-19T05:36:31.726081+0000","last_fullsized":"2024-09-19T05:36:31.726081+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:35.125585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":230,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.705361+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:36:31.705361+0000","last_peered":"2024-09-19T05:36:31.705361+0000","last_clean":"2024-09-19T05:36:31.705361+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:36:31.705361+0000","last_undegraded":"2024-09-19T05:36:31.705361+0000","last_fullsized":"2024-09-19T05:36:31.705361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46268,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325572,"statfs":{"total":96636764160,"available":96589385728,"internally_reserved":0,"allocated":1220608,"data_stored":868940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40108,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331732,"statfs":{"total":96636764160,"available":96595693568,"internally_reserved":0,"allocated":614400,"data_stored":271905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45680,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326160,"statfs":{"total":96636764160,"available":96589987840,"internally_reserved":0,"allocated":614400,"data_stored":271905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40120,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331720,"statfs":{"total":96636764160,"available":96595681280,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40124,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331716,"statfs":{"total":96636764160,"available":96595677184,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542191,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40120,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331720,"statfs":{"total":96636764160,"available":96595681280,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50428,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321412,"statfs":{"total":96636764160,"available":96585125888,"internally_reserved":0,"allocated":1220608,"data_stored":868940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:36:37.524 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3f is not active+clean 2024-09-19T05:36:37.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.695243+0000', 'last_change': '2024-09-19T05:36:31.695243+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.695243+0000', 'last_undegraded': '2024-09-19T05:36:31.695243+0000', 'last_fullsized': '2024-09-19T05:36:31.695243+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:36:37.524 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-09-19T05:36:37.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.696564+0000', 'last_change': '2024-09-19T05:36:31.696564+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.696564+0000', 'last_undegraded': '2024-09-19T05:36:31.696564+0000', 'last_fullsized': '2024-09-19T05:36:31.696564+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3d is not active+clean 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.704128+0000', 'last_change': '2024-09-19T05:36:31.704128+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.704128+0000', 'last_undegraded': '2024-09-19T05:36:31.704128+0000', 'last_fullsized': '2024-09-19T05:36:31.704128+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.695310+0000', 'last_change': '2024-09-19T05:36:31.695310+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.695310+0000', 'last_undegraded': '2024-09-19T05:36:31.695310+0000', 'last_fullsized': '2024-09-19T05:36:31.695310+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.698377+0000', 'last_change': '2024-09-19T05:36:31.698377+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.698377+0000', 'last_undegraded': '2024-09-19T05:36:31.698377+0000', 'last_fullsized': '2024-09-19T05:36:31.698377+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3a is not active+clean 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.694310+0000', 'last_change': '2024-09-19T05:36:31.694310+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.694310+0000', 'last_undegraded': '2024-09-19T05:36:31.694310+0000', 'last_fullsized': '2024-09-19T05:36:31.694310+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:PG 8.39 is not active+clean 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.702973+0000', 'last_change': '2024-09-19T05:36:31.702973+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.702973+0000', 'last_undegraded': '2024-09-19T05:36:31.702973+0000', 'last_fullsized': '2024-09-19T05:36:31.702973+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.525 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.703561+0000', 'last_change': '2024-09-19T05:36:31.703561+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.703561+0000', 'last_undegraded': '2024-09-19T05:36:31.703561+0000', 'last_fullsized': '2024-09-19T05:36:31.703561+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.702176+0000', 'last_change': '2024-09-19T05:36:31.702176+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.702176+0000', 'last_undegraded': '2024-09-19T05:36:31.702176+0000', 'last_fullsized': '2024-09-19T05:36:31.702176+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:PG 8.36 is not active+clean 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.694587+0000', 'last_change': '2024-09-19T05:36:31.694587+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.694587+0000', 'last_undegraded': '2024-09-19T05:36:31.694587+0000', 'last_fullsized': '2024-09-19T05:36:31.694587+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.695869+0000', 'last_change': '2024-09-19T05:36:31.695869+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.695869+0000', 'last_undegraded': '2024-09-19T05:36:31.695869+0000', 'last_fullsized': '2024-09-19T05:36:31.695869+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.702307+0000', 'last_change': '2024-09-19T05:36:31.702307+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.702307+0000', 'last_undegraded': '2024-09-19T05:36:31.702307+0000', 'last_fullsized': '2024-09-19T05:36:31.702307+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:PG 8.33 is not active+clean 2024-09-19T05:36:37.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.693048+0000', 'last_change': '2024-09-19T05:36:31.693048+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.693048+0000', 'last_undegraded': '2024-09-19T05:36:31.693048+0000', 'last_fullsized': '2024-09-19T05:36:31.693048+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:PG 8.32 is not active+clean 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.712302+0000', 'last_change': '2024-09-19T05:36:31.712302+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.712302+0000', 'last_undegraded': '2024-09-19T05:36:31.712302+0000', 'last_fullsized': '2024-09-19T05:36:31.712302+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.695497+0000', 'last_change': '2024-09-19T05:36:31.695497+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.695497+0000', 'last_undegraded': '2024-09-19T05:36:31.695497+0000', 'last_fullsized': '2024-09-19T05:36:31.695497+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:PG 8.30 is not active+clean 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.693291+0000', 'last_change': '2024-09-19T05:36:31.693291+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.693291+0000', 'last_undegraded': '2024-09-19T05:36:31.693291+0000', 'last_fullsized': '2024-09-19T05:36:31.693291+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2f is not active+clean 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.704335+0000', 'last_change': '2024-09-19T05:36:31.704335+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.704335+0000', 'last_undegraded': '2024-09-19T05:36:31.704335+0000', 'last_fullsized': '2024-09-19T05:36:31.704335+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.695472+0000', 'last_change': '2024-09-19T05:36:31.695472+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.695472+0000', 'last_undegraded': '2024-09-19T05:36:31.695472+0000', 'last_fullsized': '2024-09-19T05:36:31.695472+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:36:37.527 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-09-19T05:36:37.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.703533+0000', 'last_change': '2024-09-19T05:36:31.703533+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.703533+0000', 'last_undegraded': '2024-09-19T05:36:31.703533+0000', 'last_fullsized': '2024-09-19T05:36:31.703533+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.528 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-09-19T05:36:37.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.710477+0000', 'last_change': '2024-09-19T05:36:31.710477+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.710477+0000', 'last_undegraded': '2024-09-19T05:36:31.710477+0000', 'last_fullsized': '2024-09-19T05:36:31.710477+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:36:37.528 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-09-19T05:36:37.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.708401+0000', 'last_change': '2024-09-19T05:36:31.708401+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.708401+0000', 'last_undegraded': '2024-09-19T05:36:31.708401+0000', 'last_fullsized': '2024-09-19T05:36:31.708401+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:36:37.528 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-09-19T05:36:37.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.701714+0000', 'last_change': '2024-09-19T05:36:31.701714+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.701714+0000', 'last_undegraded': '2024-09-19T05:36:31.701714+0000', 'last_fullsized': '2024-09-19T05:36:31.701714+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.528 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-09-19T05:36:37.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.695345+0000', 'last_change': '2024-09-19T05:36:31.695345+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.695345+0000', 'last_undegraded': '2024-09-19T05:36:31.695345+0000', 'last_fullsized': '2024-09-19T05:36:31.695345+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:36:37.528 INFO:tasks.ceph.ceph_manager.ceph:PG 8.28 is not active+clean 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.704065+0000', 'last_change': '2024-09-19T05:36:31.704065+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.704065+0000', 'last_undegraded': '2024-09-19T05:36:31.704065+0000', 'last_fullsized': '2024-09-19T05:36:31.704065+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:PG 8.27 is not active+clean 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.703131+0000', 'last_change': '2024-09-19T05:36:31.703131+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.703131+0000', 'last_undegraded': '2024-09-19T05:36:31.703131+0000', 'last_fullsized': '2024-09-19T05:36:31.703131+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.702998+0000', 'last_change': '2024-09-19T05:36:31.702998+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.702998+0000', 'last_undegraded': '2024-09-19T05:36:31.702998+0000', 'last_fullsized': '2024-09-19T05:36:31.702998+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:PG 8.25 is not active+clean 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.692405+0000', 'last_change': '2024-09-19T05:36:31.692405+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.692405+0000', 'last_undegraded': '2024-09-19T05:36:31.692405+0000', 'last_fullsized': '2024-09-19T05:36:31.692405+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.709378+0000', 'last_change': '2024-09-19T05:36:31.709378+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.709378+0000', 'last_undegraded': '2024-09-19T05:36:31.709378+0000', 'last_fullsized': '2024-09-19T05:36:31.709378+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:PG 8.23 is not active+clean 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.704693+0000', 'last_change': '2024-09-19T05:36:31.704693+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.704693+0000', 'last_undegraded': '2024-09-19T05:36:31.704693+0000', 'last_fullsized': '2024-09-19T05:36:31.704693+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.529 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.695357+0000', 'last_change': '2024-09-19T05:36:31.695357+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.695357+0000', 'last_undegraded': '2024-09-19T05:36:31.695357+0000', 'last_fullsized': '2024-09-19T05:36:31.695357+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:PG 8.21 is not active+clean 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.700741+0000', 'last_change': '2024-09-19T05:36:31.700741+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.700741+0000', 'last_undegraded': '2024-09-19T05:36:31.700741+0000', 'last_fullsized': '2024-09-19T05:36:31.700741+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.690577+0000', 'last_change': '2024-09-19T05:36:31.690577+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.690577+0000', 'last_undegraded': '2024-09-19T05:36:31.690577+0000', 'last_fullsized': '2024-09-19T05:36:31.690577+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.703100+0000', 'last_change': '2024-09-19T05:36:31.703100+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.703100+0000', 'last_undegraded': '2024-09-19T05:36:31.703100+0000', 'last_fullsized': '2024-09-19T05:36:31.703100+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.689230+0000', 'last_change': '2024-09-19T05:36:31.689230+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.689230+0000', 'last_undegraded': '2024-09-19T05:36:31.689230+0000', 'last_fullsized': '2024-09-19T05:36:31.689230+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.703745+0000', 'last_change': '2024-09-19T05:36:31.703745+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.703745+0000', 'last_undegraded': '2024-09-19T05:36:31.703745+0000', 'last_fullsized': '2024-09-19T05:36:31.703745+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:36:37.530 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.697485+0000', 'last_change': '2024-09-19T05:36:31.697485+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.697485+0000', 'last_undegraded': '2024-09-19T05:36:31.697485+0000', 'last_fullsized': '2024-09-19T05:36:31.697485+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.695798+0000', 'last_change': '2024-09-19T05:36:31.695798+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.695798+0000', 'last_undegraded': '2024-09-19T05:36:31.695798+0000', 'last_fullsized': '2024-09-19T05:36:31.695798+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.695555+0000', 'last_change': '2024-09-19T05:36:31.695555+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.695555+0000', 'last_undegraded': '2024-09-19T05:36:31.695555+0000', 'last_fullsized': '2024-09-19T05:36:31.695555+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.701775+0000', 'last_change': '2024-09-19T05:36:31.701775+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.701775+0000', 'last_undegraded': '2024-09-19T05:36:31.701775+0000', 'last_fullsized': '2024-09-19T05:36:31.701775+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.701973+0000', 'last_change': '2024-09-19T05:36:31.701973+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.701973+0000', 'last_undegraded': '2024-09-19T05:36:31.701973+0000', 'last_fullsized': '2024-09-19T05:36:31.701973+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-19T05:36:37.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.694532+0000', 'last_change': '2024-09-19T05:36:31.694532+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.694532+0000', 'last_undegraded': '2024-09-19T05:36:31.694532+0000', 'last_fullsized': '2024-09-19T05:36:31.694532+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.690490+0000', 'last_change': '2024-09-19T05:36:31.690490+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.690490+0000', 'last_undegraded': '2024-09-19T05:36:31.690490+0000', 'last_fullsized': '2024-09-19T05:36:31.690490+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.709107+0000', 'last_change': '2024-09-19T05:36:31.709107+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.709107+0000', 'last_undegraded': '2024-09-19T05:36:31.709107+0000', 'last_fullsized': '2024-09-19T05:36:31.709107+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.697211+0000', 'last_change': '2024-09-19T05:36:31.697211+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.697211+0000', 'last_undegraded': '2024-09-19T05:36:31.697211+0000', 'last_fullsized': '2024-09-19T05:36:31.697211+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.691652+0000', 'last_change': '2024-09-19T05:36:31.691652+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.691652+0000', 'last_undegraded': '2024-09-19T05:36:31.691652+0000', 'last_fullsized': '2024-09-19T05:36:31.691652+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.702894+0000', 'last_change': '2024-09-19T05:36:31.702894+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.702894+0000', 'last_undegraded': '2024-09-19T05:36:31.702894+0000', 'last_fullsized': '2024-09-19T05:36:31.702894+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.532 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.702422+0000', 'last_change': '2024-09-19T05:36:31.702422+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.702422+0000', 'last_undegraded': '2024-09-19T05:36:31.702422+0000', 'last_fullsized': '2024-09-19T05:36:31.702422+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.712535+0000', 'last_change': '2024-09-19T05:36:31.712535+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.712535+0000', 'last_undegraded': '2024-09-19T05:36:31.712535+0000', 'last_fullsized': '2024-09-19T05:36:31.712535+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.693510+0000', 'last_change': '2024-09-19T05:36:31.693510+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.693510+0000', 'last_undegraded': '2024-09-19T05:36:31.693510+0000', 'last_fullsized': '2024-09-19T05:36:31.693510+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.692011+0000', 'last_change': '2024-09-19T05:36:31.692011+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.692011+0000', 'last_undegraded': '2024-09-19T05:36:31.692011+0000', 'last_fullsized': '2024-09-19T05:36:31.692011+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.696480+0000', 'last_change': '2024-09-19T05:36:31.696480+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.696480+0000', 'last_undegraded': '2024-09-19T05:36:31.696480+0000', 'last_fullsized': '2024-09-19T05:36:31.696480+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-09-19T05:36:37.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.692007+0000', 'last_change': '2024-09-19T05:36:31.692007+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.692007+0000', 'last_undegraded': '2024-09-19T05:36:31.692007+0000', 'last_fullsized': '2024-09-19T05:36:31.692007+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:36:37.534 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-19T05:36:37.534 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.690595+0000', 'last_change': '2024-09-19T05:36:31.690595+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.690595+0000', 'last_undegraded': '2024-09-19T05:36:31.690595+0000', 'last_fullsized': '2024-09-19T05:36:31.690595+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:36:37.534 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-09-19T05:36:37.534 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.705696+0000', 'last_change': '2024-09-19T05:36:31.705696+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.705696+0000', 'last_undegraded': '2024-09-19T05:36:31.705696+0000', 'last_fullsized': '2024-09-19T05:36:31.705696+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:36:37.534 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-09-19T05:36:37.534 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.703976+0000', 'last_change': '2024-09-19T05:36:31.703976+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.703976+0000', 'last_undegraded': '2024-09-19T05:36:31.703976+0000', 'last_fullsized': '2024-09-19T05:36:31.703976+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.534 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-09-19T05:36:37.534 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.692501+0000', 'last_change': '2024-09-19T05:36:31.692501+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.692501+0000', 'last_undegraded': '2024-09-19T05:36:31.692501+0000', 'last_fullsized': '2024-09-19T05:36:31.692501+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:36:37.534 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-19T05:36:37.534 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.689200+0000', 'last_change': '2024-09-19T05:36:31.689200+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.689200+0000', 'last_undegraded': '2024-09-19T05:36:31.689200+0000', 'last_fullsized': '2024-09-19T05:36:31.689200+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.693273+0000', 'last_change': '2024-09-19T05:36:31.693273+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.693273+0000', 'last_undegraded': '2024-09-19T05:36:31.693273+0000', 'last_fullsized': '2024-09-19T05:36:31.693273+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.692349+0000', 'last_change': '2024-09-19T05:36:31.692349+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.692349+0000', 'last_undegraded': '2024-09-19T05:36:31.692349+0000', 'last_fullsized': '2024-09-19T05:36:31.692349+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:PG 8.c is not active+clean 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.707869+0000', 'last_change': '2024-09-19T05:36:31.707869+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.707869+0000', 'last_undegraded': '2024-09-19T05:36:31.707869+0000', 'last_fullsized': '2024-09-19T05:36:31.707869+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.689231+0000', 'last_change': '2024-09-19T05:36:31.689231+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.689231+0000', 'last_undegraded': '2024-09-19T05:36:31.689231+0000', 'last_fullsized': '2024-09-19T05:36:31.689231+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:PG 8.e is not active+clean 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.708667+0000', 'last_change': '2024-09-19T05:36:31.708667+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.708667+0000', 'last_undegraded': '2024-09-19T05:36:31.708667+0000', 'last_fullsized': '2024-09-19T05:36:31.708667+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-19T05:36:37.535 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.692778+0000', 'last_change': '2024-09-19T05:36:31.692778+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.692778+0000', 'last_undegraded': '2024-09-19T05:36:31.692778+0000', 'last_fullsized': '2024-09-19T05:36:31.692778+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:36:37.536 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-09-19T05:36:37.536 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:36:31.703172+0000', 'last_change': '2024-09-19T05:36:31.703172+0000', 'last_active': '2024-09-19T05:36:31.673958+0000', 'last_peered': '2024-09-19T05:36:31.673958+0000', 'last_clean': '2024-09-19T05:36:31.673958+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:36:31.703172+0000', 'last_undegraded': '2024-09-19T05:36:31.703172+0000', 'last_fullsized': '2024-09-19T05:36:31.703172+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'last_clean_scrub_stamp': '2024-09-19T05:36:31.673958+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:36:37.536 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:36:37.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c779d640 1 Processor -- start 2024-09-19T05:36:37.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c779d640 1 -- start start 2024-09-19T05:36:37.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c779d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84c0161da0 0x7f84c00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c779d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f84c00d0e80 0x7f84c00d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c779d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c00d4d40 con 0x7f84c00b41c0 2024-09-19T05:36:37.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c779d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f84c00d1830 con 0x7f84c0161da0 2024-09-19T05:36:37.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c779d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f84c00d0840 con 0x7f84c00d0e80 2024-09-19T05:36:37.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c5539640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84c0161da0 0x7f84c00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c5d3a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f84c00b41c0 0x7f84c00b4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46268/0 (socket says 172.21.15.67:46268) 2024-09-19T05:36:37.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c5d3a640 1 -- 172.21.15.67:0/3646006652 learned_addr learned my addr 172.21.15.67:0/3646006652 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:37.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c5539640 1 -- 172.21.15.67:0/3646006652 >> v2:172.21.15.97:3300/0 conn(0x7f84c00d0e80 msgr2=0x7f84c00d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:37.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c5539640 1 --2- 172.21.15.67:0/3646006652 >> v2:172.21.15.97:3300/0 conn(0x7f84c00d0e80 0x7f84c00d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c5539640 1 -- 172.21.15.67:0/3646006652 >> v1:172.21.15.67:6789/0 conn(0x7f84c00b41c0 legacy=0x7f84c00b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84c5539640 1 -- 172.21.15.67:0/3646006652 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c00d5020 con 0x7f84c0161da0 2024-09-19T05:36:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.677+0000 7f84b7fff640 1 -- 172.21.15.67:0/3646006652 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864858279 0 0) 0x7f84c00d4d40 con 0x7f84c00b41c0 2024-09-19T05:36:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84c5539640 1 --2- 172.21.15.67:0/3646006652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c0161da0 0x7f84c00d1af0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f84c00d4440 tx=0x7f84b001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa9db77006ab5c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84b7fff640 1 -- 172.21.15.67:0/3646006652 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00b0070 con 0x7f84c0161da0 2024-09-19T05:36:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84b7fff640 1 -- 172.21.15.67:0/3646006652 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b00ab600 con 0x7f84c0161da0 2024-09-19T05:36:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84b7fff640 1 -- 172.21.15.67:0/3646006652 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00ab9d0 con 0x7f84c0161da0 2024-09-19T05:36:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84c779d640 1 -- 172.21.15.67:0/3646006652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c0161da0 msgr2=0x7f84c00d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84c779d640 1 --2- 172.21.15.67:0/3646006652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c0161da0 0x7f84c00d1af0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f84c00d4440 tx=0x7f84b001c480 comp rx=0 tx=0).stop 2024-09-19T05:36:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84c779d640 1 -- 172.21.15.67:0/3646006652 shutdown_connections 2024-09-19T05:36:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84c779d640 1 --2- 172.21.15.67:0/3646006652 >> v2:172.21.15.97:3300/0 conn(0x7f84c00d0e80 0x7f84c00d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84c779d640 1 --2- 172.21.15.67:0/3646006652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c0161da0 0x7f84c00d1af0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84c779d640 1 -- 172.21.15.67:0/3646006652 >> 172.21.15.67:0/3646006652 conn(0x7f84c008bfc0 msgr2=0x7f84c00d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84c779d640 1 -- 172.21.15.67:0/3646006652 shutdown_connections 2024-09-19T05:36:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.681+0000 7f84c779d640 1 -- 172.21.15.67:0/3646006652 wait complete. 2024-09-19T05:36:37.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 Processor -- start 2024-09-19T05:36:37.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 -- start start 2024-09-19T05:36:37.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84c00b41c0 0x7f84c014f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c00d0e80 0x7f84c01567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84c0161da0 0x7f84c00b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0162180 con 0x7f84c00d0e80 2024-09-19T05:36:37.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f84c00b5d00 con 0x7f84c0161da0 2024-09-19T05:36:37.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f84c016b4f0 con 0x7f84c00b41c0 2024-09-19T05:36:37.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c4d38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c00d0e80 0x7f84c01567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c4d38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c00d0e80 0x7f84c01567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58322/0 (socket says 172.21.15.67:58322) 2024-09-19T05:36:37.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c4d38640 1 -- 172.21.15.67:0/3217969349 learned_addr learned my addr 172.21.15.67:0/3217969349 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:37.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c5539640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84c00b41c0 0x7f84c014f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c5d3a640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84c0161da0 0x7f84c00b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c4d38640 1 -- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84c00b41c0 msgr2=0x7f84c014f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c4d38640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84c00b41c0 0x7f84c014f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c4d38640 1 -- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84c0161da0 msgr2=0x7f84c00b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c4d38640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84c0161da0 0x7f84c00b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c4d38640 1 -- 172.21.15.67:0/3217969349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c014f6e0 con 0x7f84c00d0e80 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c5d3a640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84c0161da0 0x7f84c00b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c5539640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84c00b41c0 0x7f84c014f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c4d38640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c00d0e80 0x7f84c01567a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00b580 tx=0x7f84bc00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84b5ffb640 1 -- 172.21.15.67:0/3217969349 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc014070 con 0x7f84c00d0e80 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84b5ffb640 1 -- 172.21.15.67:0/3217969349 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc010890 con 0x7f84c00d0e80 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 -- 172.21.15.67:0/3217969349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c0157110 con 0x7f84c00d0e80 2024-09-19T05:36:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84b5ffb640 1 -- 172.21.15.67:0/3217969349 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc010c80 con 0x7f84c00d0e80 2024-09-19T05:36:37.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 -- 172.21.15.67:0/3217969349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c01576d0 con 0x7f84c00d0e80 2024-09-19T05:36:37.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84c779d640 1 -- 172.21.15.67:0/3217969349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c00d12f0 con 0x7f84c00d0e80 2024-09-19T05:36:37.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.685+0000 7f84b5ffb640 1 -- 172.21.15.67:0/3217969349 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84bc017070 con 0x7f84c00d0e80 2024-09-19T05:36:37.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.689+0000 7f84b5ffb640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84a40678c0 0x7f84a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:37.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.689+0000 7f84b5ffb640 1 -- 172.21.15.67:0/3217969349 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f84bc085ff0 con 0x7f84c00d0e80 2024-09-19T05:36:37.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.689+0000 7f84c5539640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84a40678c0 0x7f84a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:37.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.689+0000 7f84c5539640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84a40678c0 0x7f84a4069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84b00ad000 tx=0x7f84b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:37.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.689+0000 7f84b5ffb640 1 -- 172.21.15.67:0/3217969349 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f84bc056a30 con 0x7f84c00d0e80 2024-09-19T05:36:37.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 -- 172.21.15.67:0/3217969349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f84c006bd70 con 0x7f84c00d0e80 2024-09-19T05:36:37.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84b5ffb640 1 -- 172.21.15.67:0/3217969349 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1237 (secure 0 0 0) 0x7f84bc010e20 con 0x7f84c00d0e80 2024-09-19T05:36:37.921 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:37.921 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":227,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":55,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":351211520,"bytes_avail":772742901760,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":24,"btime":"2024-09-19T05:36:35:721412+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5364}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-19T05:35:57.163919+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:36:37.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 -- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84a40678c0 msgr2=0x7f84a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84a40678c0 0x7f84a4069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84b00ad000 tx=0x7f84b0008040 comp rx=0 tx=0).stop 2024-09-19T05:36:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 -- 172.21.15.67:0/3217969349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c00d0e80 msgr2=0x7f84c01567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c00d0e80 0x7f84c01567a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00b580 tx=0x7f84bc00ba40 comp rx=0 tx=0).stop 2024-09-19T05:36:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 -- 172.21.15.67:0/3217969349 shutdown_connections 2024-09-19T05:36:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84c0161da0 0x7f84c00b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84c00d0e80 0x7f84c01567a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84a40678c0 0x7f84a4069d80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 --2- 172.21.15.67:0/3217969349 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84c00b41c0 0x7f84c014f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 -- 172.21.15.67:0/3217969349 >> 172.21.15.67:0/3217969349 conn(0x7f84c008bfc0 msgr2=0x7f84c00b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 -- 172.21.15.67:0/3217969349 shutdown_connections 2024-09-19T05:36:37.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:37.917+0000 7f84c779d640 1 -- 172.21.15.67:0/3217969349 wait complete. 2024-09-19T05:36:37.941 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T05:36:37.942 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:36:38.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a8841640 1 Processor -- start 2024-09-19T05:36:38.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a8841640 1 -- start start 2024-09-19T05:36:38.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a8841640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f44a4072590 0x7f44a4166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:38.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a8841640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a40b3860 con 0x7f44a40b4900 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a8841640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a40b3b40 con 0x7f44a415b1e0 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a8841640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f44a415b5c0 con 0x7f44a4072590 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a1d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f44a40b4900 0x7f44a4071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46272/0 (socket says 172.21.15.67:46272) 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a1d9b640 1 -- 172.21.15.67:0/2789863099 learned_addr learned my addr 172.21.15.67:0/2789863099 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a2d9d640 1 --2- 172.21.15.67:0/2789863099 >> v2:172.21.15.97:3300/0 conn(0x7f44a4072590 0x7f44a4166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584587728 0 0) 0x7f44a40b3860 con 0x7f44a40b4900 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4490003530 con 0x7f44a40b4900 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3332761658 0 0) 0x7f4490003530 con 0x7f44a40b4900 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 >> v2:172.21.15.97:3300/0 conn(0x7f44a4072590 msgr2=0x7f44a4166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 --2- 172.21.15.67:0/2789863099 >> v2:172.21.15.97:3300/0 conn(0x7f44a4072590 0x7f44a4166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 >> v1:172.21.15.97:6789/0 conn(0x7f44a415b1e0 legacy=0x7f44a40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a40b3e20 con 0x7f44a40b4900 2024-09-19T05:36:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f4494001680 con 0x7f44a40b4900 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 >> v1:172.21.15.67:6789/0 conn(0x7f44a40b4900 legacy=0x7f44a4071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 --2- 172.21.15.67:0/2789863099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f4490003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 --2- 172.21.15.67:0/2789863099 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4490004810 0x7f4490004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 --2- 172.21.15.67:0/2789863099 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44900051d0 0x7f449000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f44a415b5c0 con 0x7f44900039c0 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f449000c070 con 0x7f44900051d0 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f449000c270 con 0x7f4490004810 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a259c640 1 --2- 172.21.15.67:0/2789863099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f4490003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a2d9d640 1 --2- 172.21.15.67:0/2789863099 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44900051d0 0x7f449000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a259c640 1 -- 172.21.15.67:0/2789863099 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4490004810 msgr2=0x7f4490004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a259c640 1 --2- 172.21.15.67:0/2789863099 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4490004810 0x7f4490004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a259c640 1 -- 172.21.15.67:0/2789863099 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44900051d0 msgr2=0x7f449000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a259c640 1 --2- 172.21.15.67:0/2789863099 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44900051d0 0x7f449000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a259c640 1 -- 172.21.15.67:0/2789863099 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4490003530 con 0x7f44900039c0 2024-09-19T05:36:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.057+0000 7f44a2d9d640 1 -- 172.21.15.67:0/2789863099 reap_dead start 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a259c640 1 --2- 172.21.15.67:0/2789863099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f4490003de0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f448c001780 tx=0x7f448c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41eeaed4b2769127 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0013a0 con 0x7f44900039c0 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c0052f0 con 0x7f44900039c0 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a159a640 1 -- 172.21.15.67:0/2789863099 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c003840 con 0x7f44900039c0 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a8841640 1 -- 172.21.15.67:0/2789863099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 msgr2=0x7f4490003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a8841640 1 --2- 172.21.15.67:0/2789863099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f4490003de0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f448c001780 tx=0x7f448c01c3d0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a8841640 1 -- 172.21.15.67:0/2789863099 shutdown_connections 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a8841640 1 --2- 172.21.15.67:0/2789863099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f4490003de0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a8841640 1 -- 172.21.15.67:0/2789863099 >> 172.21.15.67:0/2789863099 conn(0x7f44a40d0080 msgr2=0x7f44a40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a8841640 1 -- 172.21.15.67:0/2789863099 shutdown_connections 2024-09-19T05:36:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a8841640 1 -- 172.21.15.67:0/2789863099 wait complete. 2024-09-19T05:36:38.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a8841640 1 Processor -- start 2024-09-19T05:36:38.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.061+0000 7f44a8841640 1 -- start start 2024-09-19T05:36:38.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a8841640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f44a406ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:38.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a8841640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a4097200 0x7f44a414bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:38.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a8841640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44a414c4d0 0x7f44a4098eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:38.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a8841640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4072000 con 0x7f44900039c0 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a8841640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4071e80 con 0x7f44a4097200 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a8841640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f44a4072180 con 0x7f44a414c4d0 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f44a406ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f44a406ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58340/0 (socket says 172.21.15.67:58340) 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a259c640 1 -- 172.21.15.67:0/3147886864 learned_addr learned my addr 172.21.15.67:0/3147886864 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a2d9d640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44a414c4d0 0x7f44a4098eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a1d9b640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a4097200 0x7f44a414bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a259c640 1 -- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44a414c4d0 msgr2=0x7f44a4098eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a259c640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44a414c4d0 0x7f44a4098eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a259c640 1 -- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a4097200 msgr2=0x7f44a414bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a259c640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a4097200 0x7f44a414bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a259c640 1 -- 172.21.15.67:0/3147886864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a41482a0 con 0x7f44900039c0 2024-09-19T05:36:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a2d9d640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44a414c4d0 0x7f44a4098eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a1d9b640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a4097200 0x7f44a414bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a259c640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f44a406ee20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f448c01c8b0 tx=0x7f4490005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f449affd640 1 -- 172.21.15.67:0/3147886864 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c007a40 con 0x7f44900039c0 2024-09-19T05:36:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f449affd640 1 -- 172.21.15.67:0/3147886864 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c0ba070 con 0x7f44900039c0 2024-09-19T05:36:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a8841640 1 -- 172.21.15.67:0/3147886864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a414fac0 con 0x7f44900039c0 2024-09-19T05:36:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f449affd640 1 -- 172.21.15.67:0/3147886864 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0013a0 con 0x7f44900039c0 2024-09-19T05:36:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a8841640 1 -- 172.21.15.67:0/3147886864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a4151290 con 0x7f44900039c0 2024-09-19T05:36:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a8841640 1 -- 172.21.15.67:0/3147886864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a40b2fd0 con 0x7f44900039c0 2024-09-19T05:36:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f449affd640 1 -- 172.21.15.67:0/3147886864 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f448c0052f0 con 0x7f44900039c0 2024-09-19T05:36:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f449affd640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f44840678f0 0x7f4484069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f449affd640 1 -- 172.21.15.67:0/3147886864 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f448c11ff10 con 0x7f44900039c0 2024-09-19T05:36:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.065+0000 7f44a1d9b640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f44840678f0 0x7f4484069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.069+0000 7f44a1d9b640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f44840678f0 0x7f4484069db0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f44a40b3680 tx=0x7f4494009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.069+0000 7f449affd640 1 -- 172.21.15.67:0/3147886864 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f44a414fac0 con 0x7f44900039c0 2024-09-19T05:36:38.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.233+0000 7f44a8841640 1 -- 172.21.15.67:0/3147886864 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44a414c8b0 con 0x7f44840678f0 2024-09-19T05:36:38.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.249+0000 7f449affd640 1 -- 172.21.15.67:0/3147886864 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7f44a414c8b0 con 0x7f44840678f0 2024-09-19T05:36:38.256 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:38.258 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:36:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 -- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f44840678f0 msgr2=0x7f4484069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f44840678f0 0x7f4484069db0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f44a40b3680 tx=0x7f4494009040 comp rx=0 tx=0).stop 2024-09-19T05:36:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 -- 172.21.15.67:0/3147886864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 msgr2=0x7f44a406ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f44a406ee20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f448c01c8b0 tx=0x7f4490005840 comp rx=0 tx=0).stop 2024-09-19T05:36:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 -- 172.21.15.67:0/3147886864 shutdown_connections 2024-09-19T05:36:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f44840678f0 0x7f4484069db0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44a414c4d0 0x7f44a4098eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a4097200 0x7f44a414bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 --2- 172.21.15.67:0/3147886864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44900039c0 0x7f44a406ee20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 -- 172.21.15.67:0/3147886864 >> 172.21.15.67:0/3147886864 conn(0x7f44a40d0080 msgr2=0x7f44a40af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 -- 172.21.15.67:0/3147886864 shutdown_connections 2024-09-19T05:36:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:38.253+0000 7f44a8841640 1 -- 172.21.15.67:0/3147886864 wait complete. 2024-09-19T05:36:38.275 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-19T05:36:37.177966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":342980,"kb_used_data":6032,"kb_used_omap":12,"kb_used_meta":336755,"kb_avail":754631740,"statfs":{"total":773094113280,"available":772742901760,"internally_reserved":0,"allocated":6176768,"data_stored":3395978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":344837681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001926"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695243+0000","last_change":"2024-09-19T05:36:31.695243+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695243+0000","last_undegraded":"2024-09-19T05:36:31.695243+0000","last_fullsized":"2024-09-19T05:36:31.695243+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.696564+0000","last_change":"2024-09-19T05:36:31.696564+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.696564+0000","last_undegraded":"2024-09-19T05:36:31.696564+0000","last_fullsized":"2024-09-19T05:36:31.696564+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704128+0000","last_change":"2024-09-19T05:36:31.704128+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704128+0000","last_undegraded":"2024-09-19T05:36:31.704128+0000","last_fullsized":"2024-09-19T05:36:31.704128+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695310+0000","last_change":"2024-09-19T05:36:31.695310+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695310+0000","last_undegraded":"2024-09-19T05:36:31.695310+0000","last_fullsized":"2024-09-19T05:36:31.695310+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.698377+0000","last_change":"2024-09-19T05:36:31.698377+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.698377+0000","last_undegraded":"2024-09-19T05:36:31.698377+0000","last_fullsized":"2024-09-19T05:36:31.698377+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694310+0000","last_change":"2024-09-19T05:36:31.694310+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694310+0000","last_undegraded":"2024-09-19T05:36:31.694310+0000","last_fullsized":"2024-09-19T05:36:31.694310+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702973+0000","last_change":"2024-09-19T05:36:31.702973+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702973+0000","last_undegraded":"2024-09-19T05:36:31.702973+0000","last_fullsized":"2024-09-19T05:36:31.702973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703561+0000","last_change":"2024-09-19T05:36:31.703561+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703561+0000","last_undegraded":"2024-09-19T05:36:31.703561+0000","last_fullsized":"2024-09-19T05:36:31.703561+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702176+0000","last_change":"2024-09-19T05:36:31.702176+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702176+0000","last_undegraded":"2024-09-19T05:36:31.702176+0000","last_fullsized":"2024-09-19T05:36:31.702176+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694587+0000","last_change":"2024-09-19T05:36:31.694587+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694587+0000","last_undegraded":"2024-09-19T05:36:31.694587+0000","last_fullsized":"2024-09-19T05:36:31.694587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695869+0000","last_change":"2024-09-19T05:36:31.695869+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695869+0000","last_undegraded":"2024-09-19T05:36:31.695869+0000","last_fullsized":"2024-09-19T05:36:31.695869+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702307+0000","last_change":"2024-09-19T05:36:31.702307+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702307+0000","last_undegraded":"2024-09-19T05:36:31.702307+0000","last_fullsized":"2024-09-19T05:36:31.702307+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693048+0000","last_change":"2024-09-19T05:36:31.693048+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693048+0000","last_undegraded":"2024-09-19T05:36:31.693048+0000","last_fullsized":"2024-09-19T05:36:31.693048+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.712302+0000","last_change":"2024-09-19T05:36:31.712302+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.712302+0000","last_undegraded":"2024-09-19T05:36:31.712302+0000","last_fullsized":"2024-09-19T05:36:31.712302+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695497+0000","last_change":"2024-09-19T05:36:31.695497+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695497+0000","last_undegraded":"2024-09-19T05:36:31.695497+0000","last_fullsized":"2024-09-19T05:36:31.695497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693291+0000","last_change":"2024-09-19T05:36:31.693291+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693291+0000","last_undegraded":"2024-09-19T05:36:31.693291+0000","last_fullsized":"2024-09-19T05:36:31.693291+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704335+0000","last_change":"2024-09-19T05:36:31.704335+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704335+0000","last_undegraded":"2024-09-19T05:36:31.704335+0000","last_fullsized":"2024-09-19T05:36:31.704335+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695472+0000","last_change":"2024-09-19T05:36:31.695472+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695472+0000","last_undegraded":"2024-09-19T05:36:31.695472+0000","last_fullsized":"2024-09-19T05:36:31.695472+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703533+0000","last_change":"2024-09-19T05:36:31.703533+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703533+0000","last_undegraded":"2024-09-19T05:36:31.703533+0000","last_fullsized":"2024-09-19T05:36:31.703533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.710477+0000","last_change":"2024-09-19T05:36:31.710477+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.710477+0000","last_undegraded":"2024-09-19T05:36:31.710477+0000","last_fullsized":"2024-09-19T05:36:31.710477+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.708401+0000","last_change":"2024-09-19T05:36:31.708401+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.708401+0000","last_undegraded":"2024-09-19T05:36:31.708401+0000","last_fullsized":"2024-09-19T05:36:31.708401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701714+0000","last_change":"2024-09-19T05:36:31.701714+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701714+0000","last_undegraded":"2024-09-19T05:36:31.701714+0000","last_fullsized":"2024-09-19T05:36:31.701714+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695345+0000","last_change":"2024-09-19T05:36:31.695345+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695345+0000","last_undegraded":"2024-09-19T05:36:31.695345+0000","last_fullsized":"2024-09-19T05:36:31.695345+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704065+0000","last_change":"2024-09-19T05:36:31.704065+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704065+0000","last_undegraded":"2024-09-19T05:36:31.704065+0000","last_fullsized":"2024-09-19T05:36:31.704065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703131+0000","last_change":"2024-09-19T05:36:31.703131+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703131+0000","last_undegraded":"2024-09-19T05:36:31.703131+0000","last_fullsized":"2024-09-19T05:36:31.703131+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702998+0000","last_change":"2024-09-19T05:36:31.702998+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702998+0000","last_undegraded":"2024-09-19T05:36:31.702998+0000","last_fullsized":"2024-09-19T05:36:31.702998+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692405+0000","last_change":"2024-09-19T05:36:31.692405+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692405+0000","last_undegraded":"2024-09-19T05:36:31.692405+0000","last_fullsized":"2024-09-19T05:36:31.692405+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.709378+0000","last_change":"2024-09-19T05:36:31.709378+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.709378+0000","last_undegraded":"2024-09-19T05:36:31.709378+0000","last_fullsized":"2024-09-19T05:36:31.709378+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.704693+0000","last_change":"2024-09-19T05:36:31.704693+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.704693+0000","last_undegraded":"2024-09-19T05:36:31.704693+0000","last_fullsized":"2024-09-19T05:36:31.704693+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695357+0000","last_change":"2024-09-19T05:36:31.695357+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695357+0000","last_undegraded":"2024-09-19T05:36:31.695357+0000","last_fullsized":"2024-09-19T05:36:31.695357+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.700741+0000","last_change":"2024-09-19T05:36:31.700741+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.700741+0000","last_undegraded":"2024-09-19T05:36:31.700741+0000","last_fullsized":"2024-09-19T05:36:31.700741+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690577+0000","last_change":"2024-09-19T05:36:31.690577+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690577+0000","last_undegraded":"2024-09-19T05:36:31.690577+0000","last_fullsized":"2024-09-19T05:36:31.690577+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703100+0000","last_change":"2024-09-19T05:36:31.703100+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703100+0000","last_undegraded":"2024-09-19T05:36:31.703100+0000","last_fullsized":"2024-09-19T05:36:31.703100+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728234+0000","last_change":"2024-09-19T05:36:31.720380+0000","last_active":"2024-09-19T05:36:31.728234+0000","last_peered":"2024-09-19T05:36:31.728234+0000","last_clean":"2024-09-19T05:36:31.728234+0000","last_became_active":"2024-09-19T05:36:31.719637+0000","last_became_peered":"2024-09-19T05:36:31.719637+0000","last_unstale":"2024-09-19T05:36:31.728234+0000","last_undegraded":"2024-09-19T05:36:31.728234+0000","last_fullsized":"2024-09-19T05:36:31.728234+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:30.048643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689230+0000","last_change":"2024-09-19T05:36:31.689230+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689230+0000","last_undegraded":"2024-09-19T05:36:31.689230+0000","last_fullsized":"2024-09-19T05:36:31.689230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.716018+0000","last_change":"2024-09-19T05:36:31.713644+0000","last_active":"2024-09-19T05:36:31.716018+0000","last_peered":"2024-09-19T05:36:31.716018+0000","last_clean":"2024-09-19T05:36:31.716018+0000","last_became_active":"2024-09-19T05:36:31.713286+0000","last_became_peered":"2024-09-19T05:36:31.713286+0000","last_unstale":"2024-09-19T05:36:31.716018+0000","last_undegraded":"2024-09-19T05:36:31.716018+0000","last_fullsized":"2024-09-19T05:36:31.716018+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:44.702540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703745+0000","last_change":"2024-09-19T05:36:31.703745+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703745+0000","last_undegraded":"2024-09-19T05:36:31.703745+0000","last_fullsized":"2024-09-19T05:36:31.703745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.724666+0000","last_change":"2024-09-19T05:36:31.723946+0000","last_active":"2024-09-19T05:36:31.724666+0000","last_peered":"2024-09-19T05:36:31.724666+0000","last_clean":"2024-09-19T05:36:31.724666+0000","last_became_active":"2024-09-19T05:36:31.720000+0000","last_became_peered":"2024-09-19T05:36:31.720000+0000","last_unstale":"2024-09-19T05:36:31.724666+0000","last_undegraded":"2024-09-19T05:36:31.724666+0000","last_fullsized":"2024-09-19T05:36:31.724666+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:13.746162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.697485+0000","last_change":"2024-09-19T05:36:31.697485+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.697485+0000","last_undegraded":"2024-09-19T05:36:31.697485+0000","last_fullsized":"2024-09-19T05:36:31.697485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.712577+0000","last_change":"2024-09-19T05:36:31.711293+0000","last_active":"2024-09-19T05:36:31.712577+0000","last_peered":"2024-09-19T05:36:31.712577+0000","last_clean":"2024-09-19T05:36:31.712577+0000","last_became_active":"2024-09-19T05:36:31.710502+0000","last_became_peered":"2024-09-19T05:36:31.710502+0000","last_unstale":"2024-09-19T05:36:31.712577+0000","last_undegraded":"2024-09-19T05:36:31.712577+0000","last_fullsized":"2024-09-19T05:36:31.712577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:53.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695798+0000","last_change":"2024-09-19T05:36:31.695798+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695798+0000","last_undegraded":"2024-09-19T05:36:31.695798+0000","last_fullsized":"2024-09-19T05:36:31.695798+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726178+0000","last_change":"2024-09-19T05:36:31.722407+0000","last_active":"2024-09-19T05:36:31.726178+0000","last_peered":"2024-09-19T05:36:31.726178+0000","last_clean":"2024-09-19T05:36:31.726178+0000","last_became_active":"2024-09-19T05:36:31.721773+0000","last_became_peered":"2024-09-19T05:36:31.721773+0000","last_unstale":"2024-09-19T05:36:31.726178+0000","last_undegraded":"2024-09-19T05:36:31.726178+0000","last_fullsized":"2024-09-19T05:36:31.726178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:00.054246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.695555+0000","last_change":"2024-09-19T05:36:31.695555+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.695555+0000","last_undegraded":"2024-09-19T05:36:31.695555+0000","last_fullsized":"2024-09-19T05:36:31.695555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.724377+0000","last_change":"2024-09-19T05:36:31.722915+0000","last_active":"2024-09-19T05:36:31.724377+0000","last_peered":"2024-09-19T05:36:31.724377+0000","last_clean":"2024-09-19T05:36:31.724377+0000","last_became_active":"2024-09-19T05:36:31.722202+0000","last_became_peered":"2024-09-19T05:36:31.722202+0000","last_unstale":"2024-09-19T05:36:31.724377+0000","last_undegraded":"2024-09-19T05:36:31.724377+0000","last_fullsized":"2024-09-19T05:36:31.724377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:37.554854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701775+0000","last_change":"2024-09-19T05:36:31.701775+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701775+0000","last_undegraded":"2024-09-19T05:36:31.701775+0000","last_fullsized":"2024-09-19T05:36:31.701775+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728164+0000","last_change":"2024-09-19T05:36:31.718437+0000","last_active":"2024-09-19T05:36:31.728164+0000","last_peered":"2024-09-19T05:36:31.728164+0000","last_clean":"2024-09-19T05:36:31.728164+0000","last_became_active":"2024-09-19T05:36:31.717715+0000","last_became_peered":"2024-09-19T05:36:31.717715+0000","last_unstale":"2024-09-19T05:36:31.728164+0000","last_undegraded":"2024-09-19T05:36:31.728164+0000","last_fullsized":"2024-09-19T05:36:31.728164+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:13.359294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.701973+0000","last_change":"2024-09-19T05:36:31.701973+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.701973+0000","last_undegraded":"2024-09-19T05:36:31.701973+0000","last_fullsized":"2024-09-19T05:36:31.701973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726034+0000","last_change":"2024-09-19T05:36:31.722496+0000","last_active":"2024-09-19T05:36:31.726034+0000","last_peered":"2024-09-19T05:36:31.726034+0000","last_clean":"2024-09-19T05:36:31.726034+0000","last_became_active":"2024-09-19T05:36:31.722059+0000","last_became_peered":"2024-09-19T05:36:31.722059+0000","last_unstale":"2024-09-19T05:36:31.726034+0000","last_undegraded":"2024-09-19T05:36:31.726034+0000","last_fullsized":"2024-09-19T05:36:31.726034+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.296474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.694532+0000","last_change":"2024-09-19T05:36:31.694532+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.694532+0000","last_undegraded":"2024-09-19T05:36:31.694532+0000","last_fullsized":"2024-09-19T05:36:31.694532+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726259+0000","last_change":"2024-09-19T05:36:31.722252+0000","last_active":"2024-09-19T05:36:31.726259+0000","last_peered":"2024-09-19T05:36:31.726259+0000","last_clean":"2024-09-19T05:36:31.726259+0000","last_became_active":"2024-09-19T05:36:31.721596+0000","last_became_peered":"2024-09-19T05:36:31.721596+0000","last_unstale":"2024-09-19T05:36:31.726259+0000","last_undegraded":"2024-09-19T05:36:31.726259+0000","last_fullsized":"2024-09-19T05:36:31.726259+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:41.387886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690490+0000","last_change":"2024-09-19T05:36:31.690490+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690490+0000","last_undegraded":"2024-09-19T05:36:31.690490+0000","last_fullsized":"2024-09-19T05:36:31.690490+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.718878+0000","last_change":"2024-09-19T05:36:31.716615+0000","last_active":"2024-09-19T05:36:31.718878+0000","last_peered":"2024-09-19T05:36:31.718878+0000","last_clean":"2024-09-19T05:36:31.718878+0000","last_became_active":"2024-09-19T05:36:31.715826+0000","last_became_peered":"2024-09-19T05:36:31.715826+0000","last_unstale":"2024-09-19T05:36:31.718878+0000","last_undegraded":"2024-09-19T05:36:31.718878+0000","last_fullsized":"2024-09-19T05:36:31.718878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:03.396329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.709107+0000","last_change":"2024-09-19T05:36:31.709107+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.709107+0000","last_undegraded":"2024-09-19T05:36:31.709107+0000","last_fullsized":"2024-09-19T05:36:31.709107+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726958+0000","last_change":"2024-09-19T05:36:31.726088+0000","last_active":"2024-09-19T05:36:31.726958+0000","last_peered":"2024-09-19T05:36:31.726958+0000","last_clean":"2024-09-19T05:36:31.726958+0000","last_became_active":"2024-09-19T05:36:31.725457+0000","last_became_peered":"2024-09-19T05:36:31.725457+0000","last_unstale":"2024-09-19T05:36:31.726958+0000","last_undegraded":"2024-09-19T05:36:31.726958+0000","last_fullsized":"2024-09-19T05:36:31.726958+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:02.848303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.697211+0000","last_change":"2024-09-19T05:36:31.697211+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.697211+0000","last_undegraded":"2024-09-19T05:36:31.697211+0000","last_fullsized":"2024-09-19T05:36:31.697211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.717247+0000","last_change":"2024-09-19T05:36:31.711849+0000","last_active":"2024-09-19T05:36:31.717247+0000","last_peered":"2024-09-19T05:36:31.717247+0000","last_clean":"2024-09-19T05:36:31.717247+0000","last_became_active":"2024-09-19T05:36:31.706778+0000","last_became_peered":"2024-09-19T05:36:31.706778+0000","last_unstale":"2024-09-19T05:36:31.717247+0000","last_undegraded":"2024-09-19T05:36:31.717247+0000","last_fullsized":"2024-09-19T05:36:31.717247+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:37.962059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.691652+0000","last_change":"2024-09-19T05:36:31.691652+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.691652+0000","last_undegraded":"2024-09-19T05:36:31.691652+0000","last_fullsized":"2024-09-19T05:36:31.691652+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.723174+0000","last_change":"2024-09-19T05:36:31.718931+0000","last_active":"2024-09-19T05:36:31.723174+0000","last_peered":"2024-09-19T05:36:31.723174+0000","last_clean":"2024-09-19T05:36:31.723174+0000","last_became_active":"2024-09-19T05:36:31.718531+0000","last_became_peered":"2024-09-19T05:36:31.718531+0000","last_unstale":"2024-09-19T05:36:31.723174+0000","last_undegraded":"2024-09-19T05:36:31.723174+0000","last_fullsized":"2024-09-19T05:36:31.723174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:51.939635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702894+0000","last_change":"2024-09-19T05:36:31.702894+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702894+0000","last_undegraded":"2024-09-19T05:36:31.702894+0000","last_fullsized":"2024-09-19T05:36:31.702894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728979+0000","last_change":"2024-09-19T05:36:31.725430+0000","last_active":"2024-09-19T05:36:31.728979+0000","last_peered":"2024-09-19T05:36:31.728979+0000","last_clean":"2024-09-19T05:36:31.728979+0000","last_became_active":"2024-09-19T05:36:31.724751+0000","last_became_peered":"2024-09-19T05:36:31.724751+0000","last_unstale":"2024-09-19T05:36:31.728979+0000","last_undegraded":"2024-09-19T05:36:31.728979+0000","last_fullsized":"2024-09-19T05:36:31.728979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:41.328921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.702422+0000","last_change":"2024-09-19T05:36:31.702422+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.702422+0000","last_undegraded":"2024-09-19T05:36:31.702422+0000","last_fullsized":"2024-09-19T05:36:31.702422+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.730192+0000","last_change":"2024-09-19T05:36:31.729413+0000","last_active":"2024-09-19T05:36:31.730192+0000","last_peered":"2024-09-19T05:36:31.730192+0000","last_clean":"2024-09-19T05:36:31.730192+0000","last_became_active":"2024-09-19T05:36:31.728706+0000","last_became_peered":"2024-09-19T05:36:31.728706+0000","last_unstale":"2024-09-19T05:36:31.730192+0000","last_undegraded":"2024-09-19T05:36:31.730192+0000","last_fullsized":"2024-09-19T05:36:31.730192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:42:02.107320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.712535+0000","last_change":"2024-09-19T05:36:31.712535+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.712535+0000","last_undegraded":"2024-09-19T05:36:31.712535+0000","last_fullsized":"2024-09-19T05:36:31.712535+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.713195+0000","last_change":"2024-09-19T05:36:31.706868+0000","last_active":"2024-09-19T05:36:31.713195+0000","last_peered":"2024-09-19T05:36:31.713195+0000","last_clean":"2024-09-19T05:36:31.713195+0000","last_became_active":"2024-09-19T05:36:31.706503+0000","last_became_peered":"2024-09-19T05:36:31.706503+0000","last_unstale":"2024-09-19T05:36:31.713195+0000","last_undegraded":"2024-09-19T05:36:31.713195+0000","last_fullsized":"2024-09-19T05:36:31.713195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:55.270382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693510+0000","last_change":"2024-09-19T05:36:31.693510+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693510+0000","last_undegraded":"2024-09-19T05:36:31.693510+0000","last_fullsized":"2024-09-19T05:36:31.693510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.723287+0000","last_change":"2024-09-19T05:36:31.720065+0000","last_active":"2024-09-19T05:36:31.723287+0000","last_peered":"2024-09-19T05:36:31.723287+0000","last_clean":"2024-09-19T05:36:31.723287+0000","last_became_active":"2024-09-19T05:36:31.719280+0000","last_became_peered":"2024-09-19T05:36:31.719280+0000","last_unstale":"2024-09-19T05:36:31.723287+0000","last_undegraded":"2024-09-19T05:36:31.723287+0000","last_fullsized":"2024-09-19T05:36:31.723287+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:38.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692011+0000","last_change":"2024-09-19T05:36:31.692011+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692011+0000","last_undegraded":"2024-09-19T05:36:31.692011+0000","last_fullsized":"2024-09-19T05:36:31.692011+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.709674+0000","last_change":"2024-09-19T05:36:31.705115+0000","last_active":"2024-09-19T05:36:31.709674+0000","last_peered":"2024-09-19T05:36:31.709674+0000","last_clean":"2024-09-19T05:36:31.709674+0000","last_became_active":"2024-09-19T05:36:31.702064+0000","last_became_peered":"2024-09-19T05:36:31.702064+0000","last_unstale":"2024-09-19T05:36:31.709674+0000","last_undegraded":"2024-09-19T05:36:31.709674+0000","last_fullsized":"2024-09-19T05:36:31.709674+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:26.652533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.696480+0000","last_change":"2024-09-19T05:36:31.696480+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.696480+0000","last_undegraded":"2024-09-19T05:36:31.696480+0000","last_fullsized":"2024-09-19T05:36:31.696480+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728092+0000","last_change":"2024-09-19T05:36:31.717880+0000","last_active":"2024-09-19T05:36:31.728092+0000","last_peered":"2024-09-19T05:36:31.728092+0000","last_clean":"2024-09-19T05:36:31.728092+0000","last_became_active":"2024-09-19T05:36:31.717112+0000","last_became_peered":"2024-09-19T05:36:31.717112+0000","last_unstale":"2024-09-19T05:36:31.728092+0000","last_undegraded":"2024-09-19T05:36:31.728092+0000","last_fullsized":"2024-09-19T05:36:31.728092+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:38.586563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692007+0000","last_change":"2024-09-19T05:36:31.692007+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692007+0000","last_undegraded":"2024-09-19T05:36:31.692007+0000","last_fullsized":"2024-09-19T05:36:31.692007+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.728152+0000","last_change":"2024-09-19T05:36:31.717969+0000","last_active":"2024-09-19T05:36:31.728152+0000","last_peered":"2024-09-19T05:36:31.728152+0000","last_clean":"2024-09-19T05:36:31.728152+0000","last_became_active":"2024-09-19T05:36:31.717083+0000","last_became_peered":"2024-09-19T05:36:31.717083+0000","last_unstale":"2024-09-19T05:36:31.728152+0000","last_undegraded":"2024-09-19T05:36:31.728152+0000","last_fullsized":"2024-09-19T05:36:31.728152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:31.534391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.690595+0000","last_change":"2024-09-19T05:36:31.690595+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.690595+0000","last_undegraded":"2024-09-19T05:36:31.690595+0000","last_fullsized":"2024-09-19T05:36:31.690595+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.710013+0000","last_change":"2024-09-19T05:36:31.699706+0000","last_active":"2024-09-19T05:36:31.710013+0000","last_peered":"2024-09-19T05:36:31.710013+0000","last_clean":"2024-09-19T05:36:31.710013+0000","last_became_active":"2024-09-19T05:36:31.699290+0000","last_became_peered":"2024-09-19T05:36:31.699290+0000","last_unstale":"2024-09-19T05:36:31.710013+0000","last_undegraded":"2024-09-19T05:36:31.710013+0000","last_fullsized":"2024-09-19T05:36:31.710013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:41.522320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.705696+0000","last_change":"2024-09-19T05:36:31.705696+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.705696+0000","last_undegraded":"2024-09-19T05:36:31.705696+0000","last_fullsized":"2024-09-19T05:36:31.705696+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.715829+0000","last_change":"2024-09-19T05:36:31.710829+0000","last_active":"2024-09-19T05:36:31.715829+0000","last_peered":"2024-09-19T05:36:31.715829+0000","last_clean":"2024-09-19T05:36:31.715829+0000","last_became_active":"2024-09-19T05:36:31.706452+0000","last_became_peered":"2024-09-19T05:36:31.706452+0000","last_unstale":"2024-09-19T05:36:31.715829+0000","last_undegraded":"2024-09-19T05:36:31.715829+0000","last_fullsized":"2024-09-19T05:36:31.715829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:37.754866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703976+0000","last_change":"2024-09-19T05:36:31.703976+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703976+0000","last_undegraded":"2024-09-19T05:36:31.703976+0000","last_fullsized":"2024-09-19T05:36:31.703976+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.722865+0000","last_change":"2024-09-19T05:36:31.717756+0000","last_active":"2024-09-19T05:36:31.722865+0000","last_peered":"2024-09-19T05:36:31.722865+0000","last_clean":"2024-09-19T05:36:31.722865+0000","last_became_active":"2024-09-19T05:36:31.717340+0000","last_became_peered":"2024-09-19T05:36:31.717340+0000","last_unstale":"2024-09-19T05:36:31.722865+0000","last_undegraded":"2024-09-19T05:36:31.722865+0000","last_fullsized":"2024-09-19T05:36:31.722865+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:13.746162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692501+0000","last_change":"2024-09-19T05:36:31.692501+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692501+0000","last_undegraded":"2024-09-19T05:36:31.692501+0000","last_fullsized":"2024-09-19T05:36:31.692501+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.720258+0000","last_change":"2024-09-19T05:36:31.718263+0000","last_active":"2024-09-19T05:36:31.720258+0000","last_peered":"2024-09-19T05:36:31.720258+0000","last_clean":"2024-09-19T05:36:31.720258+0000","last_became_active":"2024-09-19T05:36:31.717602+0000","last_became_peered":"2024-09-19T05:36:31.717602+0000","last_unstale":"2024-09-19T05:36:31.720258+0000","last_undegraded":"2024-09-19T05:36:31.720258+0000","last_fullsized":"2024-09-19T05:36:31.720258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:39.756352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689200+0000","last_change":"2024-09-19T05:36:31.689200+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689200+0000","last_undegraded":"2024-09-19T05:36:31.689200+0000","last_fullsized":"2024-09-19T05:36:31.689200+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.729102+0000","last_change":"2024-09-19T05:36:31.725301+0000","last_active":"2024-09-19T05:36:31.729102+0000","last_peered":"2024-09-19T05:36:31.729102+0000","last_clean":"2024-09-19T05:36:31.729102+0000","last_became_active":"2024-09-19T05:36:31.724624+0000","last_became_peered":"2024-09-19T05:36:31.724624+0000","last_unstale":"2024-09-19T05:36:31.729102+0000","last_undegraded":"2024-09-19T05:36:31.729102+0000","last_fullsized":"2024-09-19T05:36:31.729102+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:03.396329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.693273+0000","last_change":"2024-09-19T05:36:31.693273+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.693273+0000","last_undegraded":"2024-09-19T05:36:31.693273+0000","last_fullsized":"2024-09-19T05:36:31.693273+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.725945+0000","last_change":"2024-09-19T05:36:31.720578+0000","last_active":"2024-09-19T05:36:31.725945+0000","last_peered":"2024-09-19T05:36:31.725945+0000","last_clean":"2024-09-19T05:36:31.725945+0000","last_became_active":"2024-09-19T05:36:31.720005+0000","last_became_peered":"2024-09-19T05:36:31.720005+0000","last_unstale":"2024-09-19T05:36:31.725945+0000","last_undegraded":"2024-09-19T05:36:31.725945+0000","last_fullsized":"2024-09-19T05:36:31.725945+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:19.063363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692349+0000","last_change":"2024-09-19T05:36:31.692349+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692349+0000","last_undegraded":"2024-09-19T05:36:31.692349+0000","last_fullsized":"2024-09-19T05:36:31.692349+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.722012+0000","last_change":"2024-09-19T05:36:31.717531+0000","last_active":"2024-09-19T05:36:31.722012+0000","last_peered":"2024-09-19T05:36:31.722012+0000","last_clean":"2024-09-19T05:36:31.722012+0000","last_became_active":"2024-09-19T05:36:31.714356+0000","last_became_peered":"2024-09-19T05:36:31.714356+0000","last_unstale":"2024-09-19T05:36:31.722012+0000","last_undegraded":"2024-09-19T05:36:31.722012+0000","last_fullsized":"2024-09-19T05:36:31.722012+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:44.702540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.707869+0000","last_change":"2024-09-19T05:36:31.707869+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.707869+0000","last_undegraded":"2024-09-19T05:36:31.707869+0000","last_fullsized":"2024-09-19T05:36:31.707869+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.715815+0000","last_change":"2024-09-19T05:36:31.711105+0000","last_active":"2024-09-19T05:36:31.715815+0000","last_peered":"2024-09-19T05:36:31.715815+0000","last_clean":"2024-09-19T05:36:31.715815+0000","last_became_active":"2024-09-19T05:36:31.706046+0000","last_became_peered":"2024-09-19T05:36:31.706046+0000","last_unstale":"2024-09-19T05:36:31.715815+0000","last_undegraded":"2024-09-19T05:36:31.715815+0000","last_fullsized":"2024-09-19T05:36:31.715815+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:59.718173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.689231+0000","last_change":"2024-09-19T05:36:31.689231+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.689231+0000","last_undegraded":"2024-09-19T05:36:31.689231+0000","last_fullsized":"2024-09-19T05:36:31.689231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.717195+0000","last_change":"2024-09-19T05:36:31.712372+0000","last_active":"2024-09-19T05:36:31.717195+0000","last_peered":"2024-09-19T05:36:31.717195+0000","last_clean":"2024-09-19T05:36:31.717195+0000","last_became_active":"2024-09-19T05:36:31.711992+0000","last_became_peered":"2024-09-19T05:36:31.711992+0000","last_unstale":"2024-09-19T05:36:31.717195+0000","last_undegraded":"2024-09-19T05:36:31.717195+0000","last_fullsized":"2024-09-19T05:36:31.717195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:37.135871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.708667+0000","last_change":"2024-09-19T05:36:31.708667+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.708667+0000","last_undegraded":"2024-09-19T05:36:31.708667+0000","last_fullsized":"2024-09-19T05:36:31.708667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.719640+0000","last_change":"2024-09-19T05:36:31.715645+0000","last_active":"2024-09-19T05:36:31.719640+0000","last_peered":"2024-09-19T05:36:31.719640+0000","last_clean":"2024-09-19T05:36:31.719640+0000","last_became_active":"2024-09-19T05:36:31.714877+0000","last_became_peered":"2024-09-19T05:36:31.714877+0000","last_unstale":"2024-09-19T05:36:31.719640+0000","last_undegraded":"2024-09-19T05:36:31.719640+0000","last_fullsized":"2024-09-19T05:36:31.719640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:41.328921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.692778+0000","last_change":"2024-09-19T05:36:31.692778+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.692778+0000","last_undegraded":"2024-09-19T05:36:31.692778+0000","last_fullsized":"2024-09-19T05:36:31.692778+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.712602+0000","last_change":"2024-09-19T05:36:31.699877+0000","last_active":"2024-09-19T05:36:31.712602+0000","last_peered":"2024-09-19T05:36:31.712602+0000","last_clean":"2024-09-19T05:36:31.712602+0000","last_became_active":"2024-09-19T05:36:31.699104+0000","last_became_peered":"2024-09-19T05:36:31.699104+0000","last_unstale":"2024-09-19T05:36:31.712602+0000","last_undegraded":"2024-09-19T05:36:31.712602+0000","last_fullsized":"2024-09-19T05:36:31.712602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:06.528586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-09-19T05:36:31.703172+0000","last_change":"2024-09-19T05:36:31.703172+0000","last_active":"2024-09-19T05:36:31.673958+0000","last_peered":"2024-09-19T05:36:31.673958+0000","last_clean":"2024-09-19T05:36:31.673958+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:36:31.703172+0000","last_undegraded":"2024-09-19T05:36:31.703172+0000","last_fullsized":"2024-09-19T05:36:31.703172+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.726081+0000","last_change":"2024-09-19T05:36:31.723461+0000","last_active":"2024-09-19T05:36:31.726081+0000","last_peered":"2024-09-19T05:36:31.726081+0000","last_clean":"2024-09-19T05:36:31.726081+0000","last_became_active":"2024-09-19T05:36:31.723023+0000","last_became_peered":"2024-09-19T05:36:31.723023+0000","last_unstale":"2024-09-19T05:36:31.726081+0000","last_undegraded":"2024-09-19T05:36:31.726081+0000","last_fullsized":"2024-09-19T05:36:31.726081+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:35.125585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":230,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-19T05:36:31.705361+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:36:31.705361+0000","last_peered":"2024-09-19T05:36:31.705361+0000","last_clean":"2024-09-19T05:36:31.705361+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:36:31.705361+0000","last_undegraded":"2024-09-19T05:36:31.705361+0000","last_fullsized":"2024-09-19T05:36:31.705361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46268,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325572,"statfs":{"total":96636764160,"available":96589385728,"internally_reserved":0,"allocated":1220608,"data_stored":868940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40108,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331732,"statfs":{"total":96636764160,"available":96595693568,"internally_reserved":0,"allocated":614400,"data_stored":271905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45680,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326160,"statfs":{"total":96636764160,"available":96589987840,"internally_reserved":0,"allocated":614400,"data_stored":271905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40120,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331720,"statfs":{"total":96636764160,"available":96595681280,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40124,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331716,"statfs":{"total":96636764160,"available":96595677184,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542191,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40120,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331720,"statfs":{"total":96636764160,"available":96595681280,"internally_reserved":0,"allocated":626688,"data_stored":278572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50428,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321412,"statfs":{"total":96636764160,"available":96585125888,"internally_reserved":0,"allocated":1220608,"data_stored":868940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:36:38.322 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:36:38.317+0000 7f5fde2cb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:36:38.763 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:36:38.766 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:36:41.280 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:36:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facdd929640 1 Processor -- start 2024-09-19T05:36:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facdd929640 1 -- start start 2024-09-19T05:36:41.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facdd929640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd815c030 0x7facd806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facdd929640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd806e3c0 con 0x7facd815d1d0 2024-09-19T05:36:41.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facdd929640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd806e6a0 con 0x7facd806f460 2024-09-19T05:36:41.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facdd929640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7facd806e980 con 0x7facd815c030 2024-09-19T05:36:41.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd67fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7facd815d1d0 0x7facd80b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46286/0 (socket says 172.21.15.67:46286) 2024-09-19T05:36:41.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd67fc640 1 -- 172.21.15.67:0/1128069040 learned_addr learned my addr 172.21.15.67:0/1128069040 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:41.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd6ffd640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd815c030 0x7facd806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440470030 0 0) 0x7facd806e3c0 con 0x7facd815d1d0 2024-09-19T05:36:41.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facc0003530 con 0x7facd815d1d0 2024-09-19T05:36:41.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 93400059 0 0) 0x7facc0003530 con 0x7facd815d1d0 2024-09-19T05:36:41.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd815c030 msgr2=0x7facd806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:41.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd815c030 0x7facd806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 >> v1:172.21.15.97:6789/0 conn(0x7facd806f460 legacy=0x7facd80acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd806ec60 con 0x7facd815d1d0 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7facc8001680 con 0x7facd815d1d0 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 >> v1:172.21.15.67:6789/0 conn(0x7facd815d1d0 legacy=0x7facd80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00039f0 0x7facc0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facc00043a0 0x7facc0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd815c030 0x7facc00050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7facd806e980 con 0x7facc00039f0 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7facc000b9d0 con 0x7facc00043a0 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7facc000bbd0 con 0x7facd815c030 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd6ffd640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00039f0 0x7facc0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd67fc640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facc00043a0 0x7facc0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd77fe640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd815c030 0x7facc00050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd6ffd640 1 -- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd815c030 msgr2=0x7facc00050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:41.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd6ffd640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd815c030 0x7facc00050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd6ffd640 1 -- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facc00043a0 msgr2=0x7facc0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:41.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd6ffd640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facc00043a0 0x7facc0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd6ffd640 1 -- 172.21.15.67:0/1128069040 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc0003530 con 0x7facc00039f0 2024-09-19T05:36:41.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd67fc640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facc00043a0 0x7facc0004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:41.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.413+0000 7facd77fe640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd815c030 0x7facc00050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:41.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facd6ffd640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00039f0 0x7facc0003dd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7faccc009ac0 tx=0x7faccc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0d2c118d5f77e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:41.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0b2070 con 0x7facc00039f0 2024-09-19T05:36:41.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faccc0a5640 con 0x7facc00039f0 2024-09-19T05:36:41.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facd5ffb640 1 -- 172.21.15.67:0/1128069040 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc009690 con 0x7facc00039f0 2024-09-19T05:36:41.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facdd929640 1 -- 172.21.15.67:0/1128069040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00039f0 msgr2=0x7facc0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facdd929640 1 --2- 172.21.15.67:0/1128069040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00039f0 0x7facc0003dd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7faccc009ac0 tx=0x7faccc01ca50 comp rx=0 tx=0).stop 2024-09-19T05:36:41.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facd77fe640 1 -- 172.21.15.67:0/1128069040 reap_dead start 2024-09-19T05:36:41.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facdd929640 1 -- 172.21.15.67:0/1128069040 shutdown_connections 2024-09-19T05:36:41.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facdd929640 1 -- 172.21.15.67:0/1128069040 >> 172.21.15.67:0/1128069040 conn(0x7facd80d0080 msgr2=0x7facd80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:41.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facdd929640 1 -- 172.21.15.67:0/1128069040 shutdown_connections 2024-09-19T05:36:41.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.417+0000 7facdd929640 1 -- 172.21.15.67:0/1128069040 wait complete. 2024-09-19T05:36:41.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 Processor -- start 2024-09-19T05:36:41.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 -- start start 2024-09-19T05:36:41.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facd8154e60 0x7facd81f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd814c500 0x7facd81f8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd814bf40 0x7facd8152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7facd80b36e0 con 0x7facd8154e60 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7facd815d630 con 0x7facd814bf40 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7facd814bda0 con 0x7facd814c500 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facd8154e60 0x7facd81f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facd8154e60 0x7facd81f7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58354/0 (socket says 172.21.15.67:58354) 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd6ffd640 1 -- 172.21.15.67:0/4115075140 learned_addr learned my addr 172.21.15.67:0/4115075140 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd77fe640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd814bf40 0x7facd8152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd67fc640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd814c500 0x7facd81f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd6ffd640 1 -- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd814c500 msgr2=0x7facd81f8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd6ffd640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd814c500 0x7facd81f8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd6ffd640 1 -- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd814bf40 msgr2=0x7facd8152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd6ffd640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd814bf40 0x7facd8152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd6ffd640 1 -- 172.21.15.67:0/4115075140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd81f89d0 con 0x7facd8154e60 2024-09-19T05:36:41.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facd6ffd640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facd8154e60 0x7facd81f7b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faccc01d2f0 tx=0x7faccc0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:41.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facbffff640 1 -- 172.21.15.67:0/4115075140 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0b2040 con 0x7facd8154e60 2024-09-19T05:36:41.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facbffff640 1 -- 172.21.15.67:0/4115075140 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faccc0b8440 con 0x7facd8154e60 2024-09-19T05:36:41.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 -- 172.21.15.67:0/4115075140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd8150de0 con 0x7facd8154e60 2024-09-19T05:36:41.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facbffff640 1 -- 172.21.15.67:0/4115075140 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc009690 con 0x7facd8154e60 2024-09-19T05:36:41.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 -- 172.21.15.67:0/4115075140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd81513a0 con 0x7facd8154e60 2024-09-19T05:36:41.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facdd929640 1 -- 172.21.15.67:0/4115075140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd815c410 con 0x7facd8154e60 2024-09-19T05:36:41.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.421+0000 7facbffff640 1 -- 172.21.15.67:0/4115075140 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faccc0b8810 con 0x7facd8154e60 2024-09-19T05:36:41.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.425+0000 7facbffff640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facc40678f0 0x7facc4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.425+0000 7facbffff640 1 -- 172.21.15.67:0/4115075140 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7faccc11fc20 con 0x7facd8154e60 2024-09-19T05:36:41.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.425+0000 7facd67fc640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facc40678f0 0x7facc4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.425+0000 7facd67fc640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facc40678f0 0x7facc4069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7facc8000f70 tx=0x7facc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:41.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.429+0000 7facbffff640 1 -- 172.21.15.67:0/4115075140 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7faccc016760 con 0x7facd8154e60 2024-09-19T05:36:41.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.589+0000 7facdd929640 1 -- 172.21.15.67:0/4115075140 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7facd8155240 con 0x7facc40678f0 2024-09-19T05:36:41.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.605+0000 7facbffff640 1 -- 172.21.15.67:0/4115075140 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251961 (secure 0 0 0) 0x7facd8155240 con 0x7facc40678f0 2024-09-19T05:36:41.614 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:36:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 -- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facc40678f0 msgr2=0x7facc4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facc40678f0 0x7facc4069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7facc8000f70 tx=0x7facc8009040 comp rx=0 tx=0).stop 2024-09-19T05:36:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 -- 172.21.15.67:0/4115075140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facd8154e60 msgr2=0x7facd81f7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facd8154e60 0x7facd81f7b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faccc01d2f0 tx=0x7faccc0197f0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 -- 172.21.15.67:0/4115075140 shutdown_connections 2024-09-19T05:36:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd814bf40 0x7facd8152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facc40678f0 0x7facc4069db0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facd814c500 0x7facd81f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 --2- 172.21.15.67:0/4115075140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facd8154e60 0x7facd81f7b50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 -- 172.21.15.67:0/4115075140 >> 172.21.15.67:0/4115075140 conn(0x7facd80d0080 msgr2=0x7facd80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 -- 172.21.15.67:0/4115075140 shutdown_connections 2024-09-19T05:36:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.609+0000 7facdd929640 1 -- 172.21.15.67:0/4115075140 wait complete. 2024-09-19T05:36:41.634 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-19T05:36:41.179582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":343264,"kb_used_data":6312,"kb_used_omap":12,"kb_used_meta":336755,"kb_avail":754631456,"statfs":{"total":773094113280,"available":772742610944,"internally_reserved":0,"allocated":6463488,"data_stored":3525004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":344837681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.489822"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713786+0000","last_change":"2024-09-19T05:36:32.701727+0000","last_active":"2024-09-19T05:36:33.713786+0000","last_peered":"2024-09-19T05:36:33.713786+0000","last_clean":"2024-09-19T05:36:33.713786+0000","last_became_active":"2024-09-19T05:36:32.701014+0000","last_became_peered":"2024-09-19T05:36:32.701014+0000","last_unstale":"2024-09-19T05:36:33.713786+0000","last_undegraded":"2024-09-19T05:36:33.713786+0000","last_fullsized":"2024-09-19T05:36:33.713786+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:38.761207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.716109+0000","last_change":"2024-09-19T05:36:32.747565+0000","last_active":"2024-09-19T05:36:33.716109+0000","last_peered":"2024-09-19T05:36:33.716109+0000","last_clean":"2024-09-19T05:36:33.716109+0000","last_became_active":"2024-09-19T05:36:32.741247+0000","last_became_peered":"2024-09-19T05:36:32.741247+0000","last_unstale":"2024-09-19T05:36:33.716109+0000","last_undegraded":"2024-09-19T05:36:33.716109+0000","last_fullsized":"2024-09-19T05:36:33.716109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:50.329461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696690+0000","last_change":"2024-09-19T05:36:32.720221+0000","last_active":"2024-09-19T05:36:34.696690+0000","last_peered":"2024-09-19T05:36:34.696690+0000","last_clean":"2024-09-19T05:36:34.696690+0000","last_became_active":"2024-09-19T05:36:32.719828+0000","last_became_peered":"2024-09-19T05:36:32.719828+0000","last_unstale":"2024-09-19T05:36:34.696690+0000","last_undegraded":"2024-09-19T05:36:34.696690+0000","last_fullsized":"2024-09-19T05:36:34.696690+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:17.156171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.715414+0000","last_change":"2024-09-19T05:36:32.722672+0000","last_active":"2024-09-19T05:36:33.715414+0000","last_peered":"2024-09-19T05:36:33.715414+0000","last_clean":"2024-09-19T05:36:33.715414+0000","last_became_active":"2024-09-19T05:36:32.721861+0000","last_became_peered":"2024-09-19T05:36:32.721861+0000","last_unstale":"2024-09-19T05:36:33.715414+0000","last_undegraded":"2024-09-19T05:36:33.715414+0000","last_fullsized":"2024-09-19T05:36:33.715414+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:31.153222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.551557+0000","last_change":"2024-09-19T05:36:32.742705+0000","last_active":"2024-09-19T05:36:34.551557+0000","last_peered":"2024-09-19T05:36:34.551557+0000","last_clean":"2024-09-19T05:36:34.551557+0000","last_became_active":"2024-09-19T05:36:32.742061+0000","last_became_peered":"2024-09-19T05:36:32.742061+0000","last_unstale":"2024-09-19T05:36:34.551557+0000","last_undegraded":"2024-09-19T05:36:34.551557+0000","last_fullsized":"2024-09-19T05:36:34.551557+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:53.543275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713579+0000","last_change":"2024-09-19T05:36:32.739777+0000","last_active":"2024-09-19T05:36:33.713579+0000","last_peered":"2024-09-19T05:36:33.713579+0000","last_clean":"2024-09-19T05:36:33.713579+0000","last_became_active":"2024-09-19T05:36:32.739465+0000","last_became_peered":"2024-09-19T05:36:32.739465+0000","last_unstale":"2024-09-19T05:36:33.713579+0000","last_undegraded":"2024-09-19T05:36:33.713579+0000","last_fullsized":"2024-09-19T05:36:33.713579+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:34.517018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696008+0000","last_change":"2024-09-19T05:36:32.714164+0000","last_active":"2024-09-19T05:36:34.696008+0000","last_peered":"2024-09-19T05:36:34.696008+0000","last_clean":"2024-09-19T05:36:34.696008+0000","last_became_active":"2024-09-19T05:36:32.713652+0000","last_became_peered":"2024-09-19T05:36:32.713652+0000","last_unstale":"2024-09-19T05:36:34.696008+0000","last_undegraded":"2024-09-19T05:36:34.696008+0000","last_fullsized":"2024-09-19T05:36:34.696008+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:50.329461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.856321+0000","last_change":"2024-09-19T05:36:32.731676+0000","last_active":"2024-09-19T05:36:35.856321+0000","last_peered":"2024-09-19T05:36:35.856321+0000","last_clean":"2024-09-19T05:36:35.856321+0000","last_became_active":"2024-09-19T05:36:32.728783+0000","last_became_peered":"2024-09-19T05:36:32.728783+0000","last_unstale":"2024-09-19T05:36:35.856321+0000","last_undegraded":"2024-09-19T05:36:35.856321+0000","last_fullsized":"2024-09-19T05:36:35.856321+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:34.835011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857040+0000","last_change":"2024-09-19T05:36:32.727114+0000","last_active":"2024-09-19T05:36:35.857040+0000","last_peered":"2024-09-19T05:36:35.857040+0000","last_clean":"2024-09-19T05:36:35.857040+0000","last_became_active":"2024-09-19T05:36:32.720200+0000","last_became_peered":"2024-09-19T05:36:32.720200+0000","last_unstale":"2024-09-19T05:36:35.857040+0000","last_undegraded":"2024-09-19T05:36:35.857040+0000","last_fullsized":"2024-09-19T05:36:35.857040+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:03.427511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713760+0000","last_change":"2024-09-19T05:36:32.722801+0000","last_active":"2024-09-19T05:36:33.713760+0000","last_peered":"2024-09-19T05:36:33.713760+0000","last_clean":"2024-09-19T05:36:33.713760+0000","last_became_active":"2024-09-19T05:36:32.722431+0000","last_became_peered":"2024-09-19T05:36:32.722431+0000","last_unstale":"2024-09-19T05:36:33.713760+0000","last_undegraded":"2024-09-19T05:36:33.713760+0000","last_fullsized":"2024-09-19T05:36:33.713760+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:56.276723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.153866+0000","last_change":"2024-09-19T05:36:32.740300+0000","last_active":"2024-09-19T05:36:34.153866+0000","last_peered":"2024-09-19T05:36:34.153866+0000","last_clean":"2024-09-19T05:36:34.153866+0000","last_became_active":"2024-09-19T05:36:32.739987+0000","last_became_peered":"2024-09-19T05:36:32.739987+0000","last_unstale":"2024-09-19T05:36:34.153866+0000","last_undegraded":"2024-09-19T05:36:34.153866+0000","last_fullsized":"2024-09-19T05:36:34.153866+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:42.147893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857026+0000","last_change":"2024-09-19T05:36:32.727915+0000","last_active":"2024-09-19T05:36:35.857026+0000","last_peered":"2024-09-19T05:36:35.857026+0000","last_clean":"2024-09-19T05:36:35.857026+0000","last_became_active":"2024-09-19T05:36:32.727541+0000","last_became_peered":"2024-09-19T05:36:32.727541+0000","last_unstale":"2024-09-19T05:36:35.857026+0000","last_undegraded":"2024-09-19T05:36:35.857026+0000","last_fullsized":"2024-09-19T05:36:35.857026+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:20.662629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.714105+0000","last_change":"2024-09-19T05:36:32.723340+0000","last_active":"2024-09-19T05:36:33.714105+0000","last_peered":"2024-09-19T05:36:33.714105+0000","last_clean":"2024-09-19T05:36:33.714105+0000","last_became_active":"2024-09-19T05:36:32.722980+0000","last_became_peered":"2024-09-19T05:36:32.722980+0000","last_unstale":"2024-09-19T05:36:33.714105+0000","last_undegraded":"2024-09-19T05:36:33.714105+0000","last_fullsized":"2024-09-19T05:36:33.714105+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:38.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.697138+0000","last_change":"2024-09-19T05:36:32.719628+0000","last_active":"2024-09-19T05:36:34.697138+0000","last_peered":"2024-09-19T05:36:34.697138+0000","last_clean":"2024-09-19T05:36:34.697138+0000","last_became_active":"2024-09-19T05:36:32.719313+0000","last_became_peered":"2024-09-19T05:36:32.719313+0000","last_unstale":"2024-09-19T05:36:34.697138+0000","last_undegraded":"2024-09-19T05:36:34.697138+0000","last_fullsized":"2024-09-19T05:36:34.697138+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:43.795620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.714348+0000","last_change":"2024-09-19T05:36:32.748347+0000","last_active":"2024-09-19T05:36:33.714348+0000","last_peered":"2024-09-19T05:36:33.714348+0000","last_clean":"2024-09-19T05:36:33.714348+0000","last_became_active":"2024-09-19T05:36:32.747854+0000","last_became_peered":"2024-09-19T05:36:32.747854+0000","last_unstale":"2024-09-19T05:36:33.714348+0000","last_undegraded":"2024-09-19T05:36:33.714348+0000","last_fullsized":"2024-09-19T05:36:33.714348+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:45.029450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713532+0000","last_change":"2024-09-19T05:36:32.719878+0000","last_active":"2024-09-19T05:36:33.713532+0000","last_peered":"2024-09-19T05:36:33.713532+0000","last_clean":"2024-09-19T05:36:33.713532+0000","last_became_active":"2024-09-19T05:36:32.719493+0000","last_became_peered":"2024-09-19T05:36:32.719493+0000","last_unstale":"2024-09-19T05:36:33.713532+0000","last_undegraded":"2024-09-19T05:36:33.713532+0000","last_fullsized":"2024-09-19T05:36:33.713532+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:13.564743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.697563+0000","last_change":"2024-09-19T05:36:32.723768+0000","last_active":"2024-09-19T05:36:34.697563+0000","last_peered":"2024-09-19T05:36:34.697563+0000","last_clean":"2024-09-19T05:36:34.697563+0000","last_became_active":"2024-09-19T05:36:32.723429+0000","last_became_peered":"2024-09-19T05:36:32.723429+0000","last_unstale":"2024-09-19T05:36:34.697563+0000","last_undegraded":"2024-09-19T05:36:34.697563+0000","last_fullsized":"2024-09-19T05:36:34.697563+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:34.835011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.716198+0000","last_change":"2024-09-19T05:36:32.740769+0000","last_active":"2024-09-19T05:36:33.716198+0000","last_peered":"2024-09-19T05:36:33.716198+0000","last_clean":"2024-09-19T05:36:33.716198+0000","last_became_active":"2024-09-19T05:36:32.739995+0000","last_became_peered":"2024-09-19T05:36:32.739995+0000","last_unstale":"2024-09-19T05:36:33.716198+0000","last_undegraded":"2024-09-19T05:36:33.716198+0000","last_fullsized":"2024-09-19T05:36:33.716198+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:17.156171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.697252+0000","last_change":"2024-09-19T05:36:32.730375+0000","last_active":"2024-09-19T05:36:34.697252+0000","last_peered":"2024-09-19T05:36:34.697252+0000","last_clean":"2024-09-19T05:36:34.697252+0000","last_became_active":"2024-09-19T05:36:32.730043+0000","last_became_peered":"2024-09-19T05:36:32.730043+0000","last_unstale":"2024-09-19T05:36:34.697252+0000","last_undegraded":"2024-09-19T05:36:34.697252+0000","last_fullsized":"2024-09-19T05:36:34.697252+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:02.654325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.325670+0000","last_change":"2024-09-19T05:36:32.737297+0000","last_active":"2024-09-19T05:36:34.325670+0000","last_peered":"2024-09-19T05:36:34.325670+0000","last_clean":"2024-09-19T05:36:34.325670+0000","last_became_active":"2024-09-19T05:36:32.736259+0000","last_became_peered":"2024-09-19T05:36:32.736259+0000","last_unstale":"2024-09-19T05:36:34.325670+0000","last_undegraded":"2024-09-19T05:36:34.325670+0000","last_fullsized":"2024-09-19T05:36:34.325670+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:17.660452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.325556+0000","last_change":"2024-09-19T05:36:32.745763+0000","last_active":"2024-09-19T05:36:34.325556+0000","last_peered":"2024-09-19T05:36:34.325556+0000","last_clean":"2024-09-19T05:36:34.325556+0000","last_became_active":"2024-09-19T05:36:32.745195+0000","last_became_peered":"2024-09-19T05:36:32.745195+0000","last_unstale":"2024-09-19T05:36:34.325556+0000","last_undegraded":"2024-09-19T05:36:34.325556+0000","last_fullsized":"2024-09-19T05:36:34.325556+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:42.394228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857435+0000","last_change":"2024-09-19T05:36:32.719870+0000","last_active":"2024-09-19T05:36:35.857435+0000","last_peered":"2024-09-19T05:36:35.857435+0000","last_clean":"2024-09-19T05:36:35.857435+0000","last_became_active":"2024-09-19T05:36:32.719557+0000","last_became_peered":"2024-09-19T05:36:32.719557+0000","last_unstale":"2024-09-19T05:36:35.857435+0000","last_undegraded":"2024-09-19T05:36:35.857435+0000","last_fullsized":"2024-09-19T05:36:35.857435+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:45.265414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.153292+0000","last_change":"2024-09-19T05:36:32.724862+0000","last_active":"2024-09-19T05:36:34.153292+0000","last_peered":"2024-09-19T05:36:34.153292+0000","last_clean":"2024-09-19T05:36:34.153292+0000","last_became_active":"2024-09-19T05:36:32.724578+0000","last_became_peered":"2024-09-19T05:36:32.724578+0000","last_unstale":"2024-09-19T05:36:34.153292+0000","last_undegraded":"2024-09-19T05:36:34.153292+0000","last_fullsized":"2024-09-19T05:36:34.153292+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:00.957426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696001+0000","last_change":"2024-09-19T05:36:32.721608+0000","last_active":"2024-09-19T05:36:34.696001+0000","last_peered":"2024-09-19T05:36:34.696001+0000","last_clean":"2024-09-19T05:36:34.696001+0000","last_became_active":"2024-09-19T05:36:32.721352+0000","last_became_peered":"2024-09-19T05:36:32.721352+0000","last_unstale":"2024-09-19T05:36:34.696001+0000","last_undegraded":"2024-09-19T05:36:34.696001+0000","last_fullsized":"2024-09-19T05:36:34.696001+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:55.884153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.697782+0000","last_change":"2024-09-19T05:36:32.708949+0000","last_active":"2024-09-19T05:36:34.697782+0000","last_peered":"2024-09-19T05:36:34.697782+0000","last_clean":"2024-09-19T05:36:34.697782+0000","last_became_active":"2024-09-19T05:36:32.708720+0000","last_became_peered":"2024-09-19T05:36:32.708720+0000","last_unstale":"2024-09-19T05:36:34.697782+0000","last_undegraded":"2024-09-19T05:36:34.697782+0000","last_fullsized":"2024-09-19T05:36:34.697782+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:40.502362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.856641+0000","last_change":"2024-09-19T05:36:32.713829+0000","last_active":"2024-09-19T05:36:35.856641+0000","last_peered":"2024-09-19T05:36:35.856641+0000","last_clean":"2024-09-19T05:36:35.856641+0000","last_became_active":"2024-09-19T05:36:32.713557+0000","last_became_peered":"2024-09-19T05:36:32.713557+0000","last_unstale":"2024-09-19T05:36:35.856641+0000","last_undegraded":"2024-09-19T05:36:35.856641+0000","last_fullsized":"2024-09-19T05:36:35.856641+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:40.502362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.714019+0000","last_change":"2024-09-19T05:36:32.714850+0000","last_active":"2024-09-19T05:36:33.714019+0000","last_peered":"2024-09-19T05:36:33.714019+0000","last_clean":"2024-09-19T05:36:33.714019+0000","last_became_active":"2024-09-19T05:36:32.714583+0000","last_became_peered":"2024-09-19T05:36:32.714583+0000","last_unstale":"2024-09-19T05:36:33.714019+0000","last_undegraded":"2024-09-19T05:36:33.714019+0000","last_fullsized":"2024-09-19T05:36:33.714019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:38.968401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.325826+0000","last_change":"2024-09-19T05:36:32.724223+0000","last_active":"2024-09-19T05:36:34.325826+0000","last_peered":"2024-09-19T05:36:34.325826+0000","last_clean":"2024-09-19T05:36:34.325826+0000","last_became_active":"2024-09-19T05:36:32.723030+0000","last_became_peered":"2024-09-19T05:36:32.723030+0000","last_unstale":"2024-09-19T05:36:34.325826+0000","last_undegraded":"2024-09-19T05:36:34.325826+0000","last_fullsized":"2024-09-19T05:36:34.325826+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:13.564743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696291+0000","last_change":"2024-09-19T05:36:32.724845+0000","last_active":"2024-09-19T05:36:34.696291+0000","last_peered":"2024-09-19T05:36:34.696291+0000","last_clean":"2024-09-19T05:36:34.696291+0000","last_became_active":"2024-09-19T05:36:32.724569+0000","last_became_peered":"2024-09-19T05:36:32.724569+0000","last_unstale":"2024-09-19T05:36:34.696291+0000","last_undegraded":"2024-09-19T05:36:34.696291+0000","last_fullsized":"2024-09-19T05:36:34.696291+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:02.532975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.714965+0000","last_change":"2024-09-19T05:36:32.740290+0000","last_active":"2024-09-19T05:36:33.714965+0000","last_peered":"2024-09-19T05:36:33.714965+0000","last_clean":"2024-09-19T05:36:33.714965+0000","last_became_active":"2024-09-19T05:36:32.739254+0000","last_became_peered":"2024-09-19T05:36:32.739254+0000","last_unstale":"2024-09-19T05:36:33.714965+0000","last_undegraded":"2024-09-19T05:36:33.714965+0000","last_fullsized":"2024-09-19T05:36:33.714965+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:36.294558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696259+0000","last_change":"2024-09-19T05:36:32.708412+0000","last_active":"2024-09-19T05:36:34.696259+0000","last_peered":"2024-09-19T05:36:34.696259+0000","last_clean":"2024-09-19T05:36:34.696259+0000","last_became_active":"2024-09-19T05:36:32.708147+0000","last_became_peered":"2024-09-19T05:36:32.708147+0000","last_unstale":"2024-09-19T05:36:34.696259+0000","last_undegraded":"2024-09-19T05:36:34.696259+0000","last_fullsized":"2024-09-19T05:36:34.696259+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:14.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857596+0000","last_change":"2024-09-19T05:36:32.706519+0000","last_active":"2024-09-19T05:36:35.857596+0000","last_peered":"2024-09-19T05:36:35.857596+0000","last_clean":"2024-09-19T05:36:35.857596+0000","last_became_active":"2024-09-19T05:36:32.703371+0000","last_became_peered":"2024-09-19T05:36:32.703371+0000","last_unstale":"2024-09-19T05:36:35.857596+0000","last_undegraded":"2024-09-19T05:36:35.857596+0000","last_fullsized":"2024-09-19T05:36:35.857596+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:09.959911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.714096+0000","last_change":"2024-09-19T05:36:32.746994+0000","last_active":"2024-09-19T05:36:33.714096+0000","last_peered":"2024-09-19T05:36:33.714096+0000","last_clean":"2024-09-19T05:36:33.714096+0000","last_became_active":"2024-09-19T05:36:32.740663+0000","last_became_peered":"2024-09-19T05:36:32.740663+0000","last_unstale":"2024-09-19T05:36:33.714096+0000","last_undegraded":"2024-09-19T05:36:33.714096+0000","last_fullsized":"2024-09-19T05:36:33.714096+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:11.697113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.326190+0000","last_change":"2024-09-19T05:36:31.720380+0000","last_active":"2024-09-19T05:36:34.326190+0000","last_peered":"2024-09-19T05:36:34.326190+0000","last_clean":"2024-09-19T05:36:34.326190+0000","last_became_active":"2024-09-19T05:36:31.719637+0000","last_became_peered":"2024-09-19T05:36:31.719637+0000","last_unstale":"2024-09-19T05:36:34.326190+0000","last_undegraded":"2024-09-19T05:36:34.326190+0000","last_fullsized":"2024-09-19T05:36:34.326190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:44.702540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857713+0000","last_change":"2024-09-19T05:36:32.713727+0000","last_active":"2024-09-19T05:36:35.857713+0000","last_peered":"2024-09-19T05:36:35.857713+0000","last_clean":"2024-09-19T05:36:35.857713+0000","last_became_active":"2024-09-19T05:36:32.712992+0000","last_became_peered":"2024-09-19T05:36:32.712992+0000","last_unstale":"2024-09-19T05:36:35.857713+0000","last_undegraded":"2024-09-19T05:36:35.857713+0000","last_fullsized":"2024-09-19T05:36:35.857713+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:47.327502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713866+0000","last_change":"2024-09-19T05:36:31.713644+0000","last_active":"2024-09-19T05:36:33.713866+0000","last_peered":"2024-09-19T05:36:33.713866+0000","last_clean":"2024-09-19T05:36:33.713866+0000","last_became_active":"2024-09-19T05:36:31.713286+0000","last_became_peered":"2024-09-19T05:36:31.713286+0000","last_unstale":"2024-09-19T05:36:33.713866+0000","last_undegraded":"2024-09-19T05:36:33.713866+0000","last_fullsized":"2024-09-19T05:36:33.713866+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:51.939635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.325387+0000","last_change":"2024-09-19T05:36:32.750309+0000","last_active":"2024-09-19T05:36:34.325387+0000","last_peered":"2024-09-19T05:36:34.325387+0000","last_clean":"2024-09-19T05:36:34.325387+0000","last_became_active":"2024-09-19T05:36:32.749386+0000","last_became_peered":"2024-09-19T05:36:32.749386+0000","last_unstale":"2024-09-19T05:36:34.325387+0000","last_undegraded":"2024-09-19T05:36:34.325387+0000","last_fullsized":"2024-09-19T05:36:34.325387+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:03.854645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713987+0000","last_change":"2024-09-19T05:36:31.723946+0000","last_active":"2024-09-19T05:36:33.713987+0000","last_peered":"2024-09-19T05:36:33.713987+0000","last_clean":"2024-09-19T05:36:33.713987+0000","last_became_active":"2024-09-19T05:36:31.720000+0000","last_became_peered":"2024-09-19T05:36:31.720000+0000","last_unstale":"2024-09-19T05:36:33.713987+0000","last_undegraded":"2024-09-19T05:36:33.713987+0000","last_fullsized":"2024-09-19T05:36:33.713987+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:38.413183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.856749+0000","last_change":"2024-09-19T05:36:32.714176+0000","last_active":"2024-09-19T05:36:35.856749+0000","last_peered":"2024-09-19T05:36:35.856749+0000","last_clean":"2024-09-19T05:36:35.856749+0000","last_became_active":"2024-09-19T05:36:32.713553+0000","last_became_peered":"2024-09-19T05:36:32.713553+0000","last_unstale":"2024-09-19T05:36:35.856749+0000","last_undegraded":"2024-09-19T05:36:35.856749+0000","last_fullsized":"2024-09-19T05:36:35.856749+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:04.259188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857925+0000","last_change":"2024-09-19T05:36:31.711293+0000","last_active":"2024-09-19T05:36:35.857925+0000","last_peered":"2024-09-19T05:36:35.857925+0000","last_clean":"2024-09-19T05:36:35.857925+0000","last_became_active":"2024-09-19T05:36:31.710502+0000","last_became_peered":"2024-09-19T05:36:31.710502+0000","last_unstale":"2024-09-19T05:36:35.857925+0000","last_undegraded":"2024-09-19T05:36:35.857925+0000","last_fullsized":"2024-09-19T05:36:35.857925+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:02.513482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.551898+0000","last_change":"2024-09-19T05:36:32.729960+0000","last_active":"2024-09-19T05:36:34.551898+0000","last_peered":"2024-09-19T05:36:34.551898+0000","last_clean":"2024-09-19T05:36:34.551898+0000","last_became_active":"2024-09-19T05:36:32.718755+0000","last_became_peered":"2024-09-19T05:36:32.718755+0000","last_unstale":"2024-09-19T05:36:34.551898+0000","last_undegraded":"2024-09-19T05:36:34.551898+0000","last_fullsized":"2024-09-19T05:36:34.551898+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:42.394228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696253+0000","last_change":"2024-09-19T05:36:31.722407+0000","last_active":"2024-09-19T05:36:34.696253+0000","last_peered":"2024-09-19T05:36:34.696253+0000","last_clean":"2024-09-19T05:36:34.696253+0000","last_became_active":"2024-09-19T05:36:31.721773+0000","last_became_peered":"2024-09-19T05:36:31.721773+0000","last_unstale":"2024-09-19T05:36:34.696253+0000","last_undegraded":"2024-09-19T05:36:34.696253+0000","last_fullsized":"2024-09-19T05:36:34.696253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:12.558402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.715808+0000","last_change":"2024-09-19T05:36:32.733613+0000","last_active":"2024-09-19T05:36:33.715808+0000","last_peered":"2024-09-19T05:36:33.715808+0000","last_clean":"2024-09-19T05:36:33.715808+0000","last_became_active":"2024-09-19T05:36:32.732016+0000","last_became_peered":"2024-09-19T05:36:32.732016+0000","last_unstale":"2024-09-19T05:36:33.715808+0000","last_undegraded":"2024-09-19T05:36:33.715808+0000","last_fullsized":"2024-09-19T05:36:33.715808+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:55.884153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.551072+0000","last_change":"2024-09-19T05:36:31.722915+0000","last_active":"2024-09-19T05:36:34.551072+0000","last_peered":"2024-09-19T05:36:34.551072+0000","last_clean":"2024-09-19T05:36:34.551072+0000","last_became_active":"2024-09-19T05:36:31.722202+0000","last_became_peered":"2024-09-19T05:36:31.722202+0000","last_unstale":"2024-09-19T05:36:34.551072+0000","last_undegraded":"2024-09-19T05:36:34.551072+0000","last_fullsized":"2024-09-19T05:36:34.551072+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:55.576356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.856901+0000","last_change":"2024-09-19T05:36:32.713776+0000","last_active":"2024-09-19T05:36:35.856901+0000","last_peered":"2024-09-19T05:36:35.856901+0000","last_clean":"2024-09-19T05:36:35.856901+0000","last_became_active":"2024-09-19T05:36:32.713197+0000","last_became_peered":"2024-09-19T05:36:32.713197+0000","last_unstale":"2024-09-19T05:36:35.856901+0000","last_undegraded":"2024-09-19T05:36:35.856901+0000","last_fullsized":"2024-09-19T05:36:35.856901+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:43.345442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.325377+0000","last_change":"2024-09-19T05:36:31.718437+0000","last_active":"2024-09-19T05:36:34.325377+0000","last_peered":"2024-09-19T05:36:34.325377+0000","last_clean":"2024-09-19T05:36:34.325377+0000","last_became_active":"2024-09-19T05:36:31.717715+0000","last_became_peered":"2024-09-19T05:36:31.717715+0000","last_unstale":"2024-09-19T05:36:34.325377+0000","last_undegraded":"2024-09-19T05:36:34.325377+0000","last_fullsized":"2024-09-19T05:36:34.325377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:55.576356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.716059+0000","last_change":"2024-09-19T05:36:32.739041+0000","last_active":"2024-09-19T05:36:33.716059+0000","last_peered":"2024-09-19T05:36:33.716059+0000","last_clean":"2024-09-19T05:36:33.716059+0000","last_became_active":"2024-09-19T05:36:32.731879+0000","last_became_peered":"2024-09-19T05:36:32.731879+0000","last_unstale":"2024-09-19T05:36:33.716059+0000","last_undegraded":"2024-09-19T05:36:33.716059+0000","last_fullsized":"2024-09-19T05:36:33.716059+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:14.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696901+0000","last_change":"2024-09-19T05:36:31.722496+0000","last_active":"2024-09-19T05:36:34.696901+0000","last_peered":"2024-09-19T05:36:34.696901+0000","last_clean":"2024-09-19T05:36:34.696901+0000","last_became_active":"2024-09-19T05:36:31.722059+0000","last_became_peered":"2024-09-19T05:36:31.722059+0000","last_unstale":"2024-09-19T05:36:34.696901+0000","last_undegraded":"2024-09-19T05:36:34.696901+0000","last_fullsized":"2024-09-19T05:36:34.696901+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:41.387886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.551131+0000","last_change":"2024-09-19T05:36:32.730678+0000","last_active":"2024-09-19T05:36:34.551131+0000","last_peered":"2024-09-19T05:36:34.551131+0000","last_clean":"2024-09-19T05:36:34.551131+0000","last_became_active":"2024-09-19T05:36:32.729851+0000","last_became_peered":"2024-09-19T05:36:32.729851+0000","last_unstale":"2024-09-19T05:36:34.551131+0000","last_undegraded":"2024-09-19T05:36:34.551131+0000","last_fullsized":"2024-09-19T05:36:34.551131+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:36.131926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.715970+0000","last_change":"2024-09-19T05:36:31.722252+0000","last_active":"2024-09-19T05:36:33.715970+0000","last_peered":"2024-09-19T05:36:33.715970+0000","last_clean":"2024-09-19T05:36:33.715970+0000","last_became_active":"2024-09-19T05:36:31.721596+0000","last_became_peered":"2024-09-19T05:36:31.721596+0000","last_unstale":"2024-09-19T05:36:33.715970+0000","last_undegraded":"2024-09-19T05:36:33.715970+0000","last_fullsized":"2024-09-19T05:36:33.715970+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:16.654110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857580+0000","last_change":"2024-09-19T05:36:32.706239+0000","last_active":"2024-09-19T05:36:35.857580+0000","last_peered":"2024-09-19T05:36:35.857580+0000","last_clean":"2024-09-19T05:36:35.857580+0000","last_became_active":"2024-09-19T05:36:32.704751+0000","last_became_peered":"2024-09-19T05:36:32.704751+0000","last_unstale":"2024-09-19T05:36:35.857580+0000","last_undegraded":"2024-09-19T05:36:35.857580+0000","last_fullsized":"2024-09-19T05:36:35.857580+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:55.541432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.551895+0000","last_change":"2024-09-19T05:36:31.716615+0000","last_active":"2024-09-19T05:36:34.551895+0000","last_peered":"2024-09-19T05:36:34.551895+0000","last_clean":"2024-09-19T05:36:34.551895+0000","last_became_active":"2024-09-19T05:36:31.715826+0000","last_became_peered":"2024-09-19T05:36:31.715826+0000","last_unstale":"2024-09-19T05:36:34.551895+0000","last_undegraded":"2024-09-19T05:36:34.551895+0000","last_fullsized":"2024-09-19T05:36:34.551895+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:41.522320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.697520+0000","last_change":"2024-09-19T05:36:32.722497+0000","last_active":"2024-09-19T05:36:34.697520+0000","last_peered":"2024-09-19T05:36:34.697520+0000","last_clean":"2024-09-19T05:36:34.697520+0000","last_became_active":"2024-09-19T05:36:32.722270+0000","last_became_peered":"2024-09-19T05:36:32.722270+0000","last_unstale":"2024-09-19T05:36:34.697520+0000","last_undegraded":"2024-09-19T05:36:34.697520+0000","last_fullsized":"2024-09-19T05:36:34.697520+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:54.515889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.715912+0000","last_change":"2024-09-19T05:36:31.726088+0000","last_active":"2024-09-19T05:36:33.715912+0000","last_peered":"2024-09-19T05:36:33.715912+0000","last_clean":"2024-09-19T05:36:33.715912+0000","last_became_active":"2024-09-19T05:36:31.725457+0000","last_became_peered":"2024-09-19T05:36:31.725457+0000","last_unstale":"2024-09-19T05:36:33.715912+0000","last_undegraded":"2024-09-19T05:36:33.715912+0000","last_fullsized":"2024-09-19T05:36:33.715912+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:12.558402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.551579+0000","last_change":"2024-09-19T05:36:32.718988+0000","last_active":"2024-09-19T05:36:34.551579+0000","last_peered":"2024-09-19T05:36:34.551579+0000","last_clean":"2024-09-19T05:36:34.551579+0000","last_became_active":"2024-09-19T05:36:32.717941+0000","last_became_peered":"2024-09-19T05:36:32.717941+0000","last_unstale":"2024-09-19T05:36:34.551579+0000","last_undegraded":"2024-09-19T05:36:34.551579+0000","last_fullsized":"2024-09-19T05:36:34.551579+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:20.069704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857271+0000","last_change":"2024-09-19T05:36:31.711849+0000","last_active":"2024-09-19T05:36:35.857271+0000","last_peered":"2024-09-19T05:36:35.857271+0000","last_clean":"2024-09-19T05:36:35.857271+0000","last_became_active":"2024-09-19T05:36:31.706778+0000","last_became_peered":"2024-09-19T05:36:31.706778+0000","last_unstale":"2024-09-19T05:36:35.857271+0000","last_undegraded":"2024-09-19T05:36:35.857271+0000","last_fullsized":"2024-09-19T05:36:35.857271+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:44.023109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857971+0000","last_change":"2024-09-19T05:36:32.726315+0000","last_active":"2024-09-19T05:36:35.857971+0000","last_peered":"2024-09-19T05:36:35.857971+0000","last_clean":"2024-09-19T05:36:35.857971+0000","last_became_active":"2024-09-19T05:36:32.725275+0000","last_became_peered":"2024-09-19T05:36:32.725275+0000","last_unstale":"2024-09-19T05:36:35.857971+0000","last_undegraded":"2024-09-19T05:36:35.857971+0000","last_fullsized":"2024-09-19T05:36:35.857971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:38.934512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696663+0000","last_change":"2024-09-19T05:36:31.718931+0000","last_active":"2024-09-19T05:36:34.696663+0000","last_peered":"2024-09-19T05:36:34.696663+0000","last_clean":"2024-09-19T05:36:34.696663+0000","last_became_active":"2024-09-19T05:36:31.718531+0000","last_became_peered":"2024-09-19T05:36:31.718531+0000","last_unstale":"2024-09-19T05:36:34.696663+0000","last_undegraded":"2024-09-19T05:36:34.696663+0000","last_fullsized":"2024-09-19T05:36:34.696663+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:02.848303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.697537+0000","last_change":"2024-09-19T05:36:32.716507+0000","last_active":"2024-09-19T05:36:34.697537+0000","last_peered":"2024-09-19T05:36:34.697537+0000","last_clean":"2024-09-19T05:36:34.697537+0000","last_became_active":"2024-09-19T05:36:32.716175+0000","last_became_peered":"2024-09-19T05:36:32.716175+0000","last_unstale":"2024-09-19T05:36:34.697537+0000","last_undegraded":"2024-09-19T05:36:34.697537+0000","last_fullsized":"2024-09-19T05:36:34.697537+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:22.368423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.325992+0000","last_change":"2024-09-19T05:36:31.725430+0000","last_active":"2024-09-19T05:36:34.325992+0000","last_peered":"2024-09-19T05:36:34.325992+0000","last_clean":"2024-09-19T05:36:34.325992+0000","last_became_active":"2024-09-19T05:36:31.724751+0000","last_became_peered":"2024-09-19T05:36:31.724751+0000","last_unstale":"2024-09-19T05:36:34.325992+0000","last_undegraded":"2024-09-19T05:36:34.325992+0000","last_fullsized":"2024-09-19T05:36:34.325992+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:51.939635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.856612+0000","last_change":"2024-09-19T05:36:32.731935+0000","last_active":"2024-09-19T05:36:35.856612+0000","last_peered":"2024-09-19T05:36:35.856612+0000","last_clean":"2024-09-19T05:36:35.856612+0000","last_became_active":"2024-09-19T05:36:32.731633+0000","last_became_peered":"2024-09-19T05:36:32.731633+0000","last_unstale":"2024-09-19T05:36:35.856612+0000","last_undegraded":"2024-09-19T05:36:35.856612+0000","last_fullsized":"2024-09-19T05:36:35.856612+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:22.368423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.714333+0000","last_change":"2024-09-19T05:36:31.729413+0000","last_active":"2024-09-19T05:36:33.714333+0000","last_peered":"2024-09-19T05:36:33.714333+0000","last_clean":"2024-09-19T05:36:33.714333+0000","last_became_active":"2024-09-19T05:36:31.728706+0000","last_became_peered":"2024-09-19T05:36:31.728706+0000","last_unstale":"2024-09-19T05:36:33.714333+0000","last_undegraded":"2024-09-19T05:36:33.714333+0000","last_fullsized":"2024-09-19T05:36:33.714333+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:16.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696966+0000","last_change":"2024-09-19T05:36:32.729239+0000","last_active":"2024-09-19T05:36:34.696966+0000","last_peered":"2024-09-19T05:36:34.696966+0000","last_clean":"2024-09-19T05:36:34.696966+0000","last_became_active":"2024-09-19T05:36:32.728909+0000","last_became_peered":"2024-09-19T05:36:32.728909+0000","last_unstale":"2024-09-19T05:36:34.696966+0000","last_undegraded":"2024-09-19T05:36:34.696966+0000","last_fullsized":"2024-09-19T05:36:34.696966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:40.785008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.856644+0000","last_change":"2024-09-19T05:36:31.706868+0000","last_active":"2024-09-19T05:36:35.856644+0000","last_peered":"2024-09-19T05:36:35.856644+0000","last_clean":"2024-09-19T05:36:35.856644+0000","last_became_active":"2024-09-19T05:36:31.706503+0000","last_became_peered":"2024-09-19T05:36:31.706503+0000","last_unstale":"2024-09-19T05:36:35.856644+0000","last_undegraded":"2024-09-19T05:36:35.856644+0000","last_fullsized":"2024-09-19T05:36:35.856644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:10.690771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.856338+0000","last_change":"2024-09-19T05:36:32.707875+0000","last_active":"2024-09-19T05:36:35.856338+0000","last_peered":"2024-09-19T05:36:35.856338+0000","last_clean":"2024-09-19T05:36:35.856338+0000","last_became_active":"2024-09-19T05:36:32.707534+0000","last_became_peered":"2024-09-19T05:36:32.707534+0000","last_unstale":"2024-09-19T05:36:35.856338+0000","last_undegraded":"2024-09-19T05:36:35.856338+0000","last_fullsized":"2024-09-19T05:36:35.856338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:54.515889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.697817+0000","last_change":"2024-09-19T05:36:31.720065+0000","last_active":"2024-09-19T05:36:34.697817+0000","last_peered":"2024-09-19T05:36:34.697817+0000","last_clean":"2024-09-19T05:36:34.697817+0000","last_became_active":"2024-09-19T05:36:31.719280+0000","last_became_peered":"2024-09-19T05:36:31.719280+0000","last_unstale":"2024-09-19T05:36:34.697817+0000","last_undegraded":"2024-09-19T05:36:34.697817+0000","last_fullsized":"2024-09-19T05:36:34.697817+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:30.891467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713584+0000","last_change":"2024-09-19T05:36:32.717284+0000","last_active":"2024-09-19T05:36:33.713584+0000","last_peered":"2024-09-19T05:36:33.713584+0000","last_clean":"2024-09-19T05:36:33.713584+0000","last_became_active":"2024-09-19T05:36:32.715922+0000","last_became_peered":"2024-09-19T05:36:32.715922+0000","last_unstale":"2024-09-19T05:36:33.713584+0000","last_undegraded":"2024-09-19T05:36:33.713584+0000","last_fullsized":"2024-09-19T05:36:33.713584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:31.897808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.154012+0000","last_change":"2024-09-19T05:36:31.705115+0000","last_active":"2024-09-19T05:36:34.154012+0000","last_peered":"2024-09-19T05:36:34.154012+0000","last_clean":"2024-09-19T05:36:34.154012+0000","last_became_active":"2024-09-19T05:36:31.702064+0000","last_became_peered":"2024-09-19T05:36:31.702064+0000","last_unstale":"2024-09-19T05:36:34.154012+0000","last_undegraded":"2024-09-19T05:36:34.154012+0000","last_fullsized":"2024-09-19T05:36:34.154012+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:17.869953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.551494+0000","last_change":"2024-09-19T05:36:32.729575+0000","last_active":"2024-09-19T05:36:34.551494+0000","last_peered":"2024-09-19T05:36:34.551494+0000","last_clean":"2024-09-19T05:36:34.551494+0000","last_became_active":"2024-09-19T05:36:32.728395+0000","last_became_peered":"2024-09-19T05:36:32.728395+0000","last_unstale":"2024-09-19T05:36:34.551494+0000","last_undegraded":"2024-09-19T05:36:34.551494+0000","last_fullsized":"2024-09-19T05:36:34.551494+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:31.851183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.326134+0000","last_change":"2024-09-19T05:36:31.717880+0000","last_active":"2024-09-19T05:36:34.326134+0000","last_peered":"2024-09-19T05:36:34.326134+0000","last_clean":"2024-09-19T05:36:34.326134+0000","last_became_active":"2024-09-19T05:36:31.717112+0000","last_became_peered":"2024-09-19T05:36:31.717112+0000","last_unstale":"2024-09-19T05:36:34.326134+0000","last_undegraded":"2024-09-19T05:36:34.326134+0000","last_fullsized":"2024-09-19T05:36:34.326134+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:50.123726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713690+0000","last_change":"2024-09-19T05:36:32.700583+0000","last_active":"2024-09-19T05:36:33.713690+0000","last_peered":"2024-09-19T05:36:33.713690+0000","last_clean":"2024-09-19T05:36:33.713690+0000","last_became_active":"2024-09-19T05:36:32.700263+0000","last_became_peered":"2024-09-19T05:36:32.700263+0000","last_unstale":"2024-09-19T05:36:33.713690+0000","last_undegraded":"2024-09-19T05:36:33.713690+0000","last_fullsized":"2024-09-19T05:36:33.713690+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:30.842261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.325956+0000","last_change":"2024-09-19T05:36:31.717969+0000","last_active":"2024-09-19T05:36:34.325956+0000","last_peered":"2024-09-19T05:36:34.325956+0000","last_clean":"2024-09-19T05:36:34.325956+0000","last_became_active":"2024-09-19T05:36:31.717083+0000","last_became_peered":"2024-09-19T05:36:31.717083+0000","last_unstale":"2024-09-19T05:36:34.325956+0000","last_undegraded":"2024-09-19T05:36:34.325956+0000","last_fullsized":"2024-09-19T05:36:34.325956+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:41.522320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857637+0000","last_change":"2024-09-19T05:36:32.734828+0000","last_active":"2024-09-19T05:36:35.857637+0000","last_peered":"2024-09-19T05:36:35.857637+0000","last_clean":"2024-09-19T05:36:35.857637+0000","last_became_active":"2024-09-19T05:36:32.734038+0000","last_became_peered":"2024-09-19T05:36:32.734038+0000","last_unstale":"2024-09-19T05:36:35.857637+0000","last_undegraded":"2024-09-19T05:36:35.857637+0000","last_fullsized":"2024-09-19T05:36:35.857637+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:57.857231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713803+0000","last_change":"2024-09-19T05:36:31.699706+0000","last_active":"2024-09-19T05:36:33.713803+0000","last_peered":"2024-09-19T05:36:33.713803+0000","last_clean":"2024-09-19T05:36:33.713803+0000","last_became_active":"2024-09-19T05:36:31.699290+0000","last_became_peered":"2024-09-19T05:36:31.699290+0000","last_unstale":"2024-09-19T05:36:33.713803+0000","last_undegraded":"2024-09-19T05:36:33.713803+0000","last_fullsized":"2024-09-19T05:36:33.713803+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:00.054246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.325769+0000","last_change":"2024-09-19T05:36:32.736058+0000","last_active":"2024-09-19T05:36:34.325769+0000","last_peered":"2024-09-19T05:36:34.325769+0000","last_clean":"2024-09-19T05:36:34.325769+0000","last_became_active":"2024-09-19T05:36:32.734426+0000","last_became_peered":"2024-09-19T05:36:32.734426+0000","last_unstale":"2024-09-19T05:36:34.325769+0000","last_undegraded":"2024-09-19T05:36:34.325769+0000","last_fullsized":"2024-09-19T05:36:34.325769+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:17.277726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.856298+0000","last_change":"2024-09-19T05:36:31.710829+0000","last_active":"2024-09-19T05:36:35.856298+0000","last_peered":"2024-09-19T05:36:35.856298+0000","last_clean":"2024-09-19T05:36:35.856298+0000","last_became_active":"2024-09-19T05:36:31.706452+0000","last_became_peered":"2024-09-19T05:36:31.706452+0000","last_unstale":"2024-09-19T05:36:35.856298+0000","last_undegraded":"2024-09-19T05:36:35.856298+0000","last_fullsized":"2024-09-19T05:36:35.856298+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:35.288217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.697448+0000","last_change":"2024-09-19T05:36:32.716307+0000","last_active":"2024-09-19T05:36:34.697448+0000","last_peered":"2024-09-19T05:36:34.697448+0000","last_clean":"2024-09-19T05:36:34.697448+0000","last_became_active":"2024-09-19T05:36:32.715960+0000","last_became_peered":"2024-09-19T05:36:32.715960+0000","last_unstale":"2024-09-19T05:36:34.697448+0000","last_undegraded":"2024-09-19T05:36:34.697448+0000","last_fullsized":"2024-09-19T05:36:34.697448+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:50.928720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696358+0000","last_change":"2024-09-19T05:36:31.717756+0000","last_active":"2024-09-19T05:36:34.696358+0000","last_peered":"2024-09-19T05:36:34.696358+0000","last_clean":"2024-09-19T05:36:34.696358+0000","last_became_active":"2024-09-19T05:36:31.717340+0000","last_became_peered":"2024-09-19T05:36:31.717340+0000","last_unstale":"2024-09-19T05:36:34.696358+0000","last_undegraded":"2024-09-19T05:36:34.696358+0000","last_fullsized":"2024-09-19T05:36:34.696358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:16.271384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713910+0000","last_change":"2024-09-19T05:36:32.701382+0000","last_active":"2024-09-19T05:36:33.713910+0000","last_peered":"2024-09-19T05:36:33.713910+0000","last_clean":"2024-09-19T05:36:33.713910+0000","last_became_active":"2024-09-19T05:36:32.700538+0000","last_became_peered":"2024-09-19T05:36:32.700538+0000","last_unstale":"2024-09-19T05:36:33.713910+0000","last_undegraded":"2024-09-19T05:36:33.713910+0000","last_fullsized":"2024-09-19T05:36:33.713910+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:00.724515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.152988+0000","last_change":"2024-09-19T05:36:31.718263+0000","last_active":"2024-09-19T05:36:34.152988+0000","last_peered":"2024-09-19T05:36:34.152988+0000","last_clean":"2024-09-19T05:36:34.152988+0000","last_became_active":"2024-09-19T05:36:31.717602+0000","last_became_peered":"2024-09-19T05:36:31.717602+0000","last_unstale":"2024-09-19T05:36:34.152988+0000","last_undegraded":"2024-09-19T05:36:34.152988+0000","last_fullsized":"2024-09-19T05:36:34.152988+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:06.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.858100+0000","last_change":"2024-09-19T05:36:32.705184+0000","last_active":"2024-09-19T05:36:35.858100+0000","last_peered":"2024-09-19T05:36:35.858100+0000","last_clean":"2024-09-19T05:36:35.858100+0000","last_became_active":"2024-09-19T05:36:32.702329+0000","last_became_peered":"2024-09-19T05:36:32.702329+0000","last_unstale":"2024-09-19T05:36:35.858100+0000","last_undegraded":"2024-09-19T05:36:35.858100+0000","last_fullsized":"2024-09-19T05:36:35.858100+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:19.381894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.326341+0000","last_change":"2024-09-19T05:36:31.725301+0000","last_active":"2024-09-19T05:36:34.326341+0000","last_peered":"2024-09-19T05:36:34.326341+0000","last_clean":"2024-09-19T05:36:34.326341+0000","last_became_active":"2024-09-19T05:36:31.724624+0000","last_became_peered":"2024-09-19T05:36:31.724624+0000","last_unstale":"2024-09-19T05:36:34.326341+0000","last_undegraded":"2024-09-19T05:36:34.326341+0000","last_fullsized":"2024-09-19T05:36:34.326341+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:13.746162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.713685+0000","last_change":"2024-09-19T05:36:32.709173+0000","last_active":"2024-09-19T05:36:33.713685+0000","last_peered":"2024-09-19T05:36:33.713685+0000","last_clean":"2024-09-19T05:36:33.713685+0000","last_became_active":"2024-09-19T05:36:32.708907+0000","last_became_peered":"2024-09-19T05:36:32.708907+0000","last_unstale":"2024-09-19T05:36:33.713685+0000","last_undegraded":"2024-09-19T05:36:33.713685+0000","last_fullsized":"2024-09-19T05:36:33.713685+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:59.857741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.716218+0000","last_change":"2024-09-19T05:36:31.720578+0000","last_active":"2024-09-19T05:36:33.716218+0000","last_peered":"2024-09-19T05:36:33.716218+0000","last_clean":"2024-09-19T05:36:33.716218+0000","last_became_active":"2024-09-19T05:36:31.720005+0000","last_became_peered":"2024-09-19T05:36:31.720005+0000","last_unstale":"2024-09-19T05:36:33.716218+0000","last_undegraded":"2024-09-19T05:36:33.716218+0000","last_fullsized":"2024-09-19T05:36:33.716218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:33.510676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.856651+0000","last_change":"2024-09-19T05:36:32.731480+0000","last_active":"2024-09-19T05:36:35.856651+0000","last_peered":"2024-09-19T05:36:35.856651+0000","last_clean":"2024-09-19T05:36:35.856651+0000","last_became_active":"2024-09-19T05:36:32.731177+0000","last_became_peered":"2024-09-19T05:36:32.731177+0000","last_unstale":"2024-09-19T05:36:35.856651+0000","last_undegraded":"2024-09-19T05:36:35.856651+0000","last_fullsized":"2024-09-19T05:36:35.856651+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:20.438779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696707+0000","last_change":"2024-09-19T05:36:31.717531+0000","last_active":"2024-09-19T05:36:34.696707+0000","last_peered":"2024-09-19T05:36:34.696707+0000","last_clean":"2024-09-19T05:36:34.696707+0000","last_became_active":"2024-09-19T05:36:31.714356+0000","last_became_peered":"2024-09-19T05:36:31.714356+0000","last_unstale":"2024-09-19T05:36:34.696707+0000","last_undegraded":"2024-09-19T05:36:34.696707+0000","last_fullsized":"2024-09-19T05:36:34.696707+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:16.654110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696718+0000","last_change":"2024-09-19T05:36:32.710200+0000","last_active":"2024-09-19T05:36:34.696718+0000","last_peered":"2024-09-19T05:36:34.696718+0000","last_clean":"2024-09-19T05:36:34.696718+0000","last_became_active":"2024-09-19T05:36:32.709824+0000","last_became_peered":"2024-09-19T05:36:32.709824+0000","last_unstale":"2024-09-19T05:36:34.696718+0000","last_undegraded":"2024-09-19T05:36:34.696718+0000","last_fullsized":"2024-09-19T05:36:34.696718+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:37:58.075007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.856915+0000","last_change":"2024-09-19T05:36:31.711105+0000","last_active":"2024-09-19T05:36:35.856915+0000","last_peered":"2024-09-19T05:36:35.856915+0000","last_clean":"2024-09-19T05:36:35.856915+0000","last_became_active":"2024-09-19T05:36:31.706046+0000","last_became_peered":"2024-09-19T05:36:31.706046+0000","last_unstale":"2024-09-19T05:36:35.856915+0000","last_undegraded":"2024-09-19T05:36:35.856915+0000","last_fullsized":"2024-09-19T05:36:35.856915+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:10.379458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857970+0000","last_change":"2024-09-19T05:36:32.725866+0000","last_active":"2024-09-19T05:36:35.857970+0000","last_peered":"2024-09-19T05:36:35.857970+0000","last_clean":"2024-09-19T05:36:35.857970+0000","last_became_active":"2024-09-19T05:36:32.725150+0000","last_became_peered":"2024-09-19T05:36:32.725150+0000","last_unstale":"2024-09-19T05:36:35.857970+0000","last_undegraded":"2024-09-19T05:36:35.857970+0000","last_fullsized":"2024-09-19T05:36:35.857970+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:36.933863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857342+0000","last_change":"2024-09-19T05:36:31.712372+0000","last_active":"2024-09-19T05:36:35.857342+0000","last_peered":"2024-09-19T05:36:35.857342+0000","last_clean":"2024-09-19T05:36:35.857342+0000","last_became_active":"2024-09-19T05:36:31.711992+0000","last_became_peered":"2024-09-19T05:36:31.711992+0000","last_unstale":"2024-09-19T05:36:35.857342+0000","last_undegraded":"2024-09-19T05:36:35.857342+0000","last_fullsized":"2024-09-19T05:36:35.857342+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:30.146880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.696762+0000","last_change":"2024-09-19T05:36:32.719808+0000","last_active":"2024-09-19T05:36:34.696762+0000","last_peered":"2024-09-19T05:36:34.696762+0000","last_clean":"2024-09-19T05:36:34.696762+0000","last_became_active":"2024-09-19T05:36:32.719495+0000","last_became_peered":"2024-09-19T05:36:32.719495+0000","last_unstale":"2024-09-19T05:36:34.696762+0000","last_undegraded":"2024-09-19T05:36:34.696762+0000","last_fullsized":"2024-09-19T05:36:34.696762+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:43.618415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.551089+0000","last_change":"2024-09-19T05:36:31.715645+0000","last_active":"2024-09-19T05:36:34.551089+0000","last_peered":"2024-09-19T05:36:34.551089+0000","last_clean":"2024-09-19T05:36:34.551089+0000","last_became_active":"2024-09-19T05:36:31.714877+0000","last_became_peered":"2024-09-19T05:36:31.714877+0000","last_unstale":"2024-09-19T05:36:34.551089+0000","last_undegraded":"2024-09-19T05:36:34.551089+0000","last_fullsized":"2024-09-19T05:36:34.551089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:50.123726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.857055+0000","last_change":"2024-09-19T05:36:32.718677+0000","last_active":"2024-09-19T05:36:35.857055+0000","last_peered":"2024-09-19T05:36:35.857055+0000","last_clean":"2024-09-19T05:36:35.857055+0000","last_became_active":"2024-09-19T05:36:32.714153+0000","last_became_peered":"2024-09-19T05:36:32.714153+0000","last_unstale":"2024-09-19T05:36:35.857055+0000","last_undegraded":"2024-09-19T05:36:35.857055+0000","last_fullsized":"2024-09-19T05:36:35.857055+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:11.529204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:35.858167+0000","last_change":"2024-09-19T05:36:31.699877+0000","last_active":"2024-09-19T05:36:35.858167+0000","last_peered":"2024-09-19T05:36:35.858167+0000","last_clean":"2024-09-19T05:36:35.858167+0000","last_became_active":"2024-09-19T05:36:31.699104+0000","last_became_peered":"2024-09-19T05:36:31.699104+0000","last_unstale":"2024-09-19T05:36:35.858167+0000","last_undegraded":"2024-09-19T05:36:35.858167+0000","last_fullsized":"2024-09-19T05:36:35.858167+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:08:57.109825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.325645+0000","last_change":"2024-09-19T05:36:32.735550+0000","last_active":"2024-09-19T05:36:34.325645+0000","last_peered":"2024-09-19T05:36:34.325645+0000","last_clean":"2024-09-19T05:36:34.325645+0000","last_became_active":"2024-09-19T05:36:32.734750+0000","last_became_peered":"2024-09-19T05:36:32.734750+0000","last_unstale":"2024-09-19T05:36:34.325645+0000","last_undegraded":"2024-09-19T05:36:34.325645+0000","last_fullsized":"2024-09-19T05:36:34.325645+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:31.673958+0000","last_clean_scrub_stamp":"2024-09-19T05:36:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:42:03.113662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"55'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:34.697834+0000","last_change":"2024-09-19T05:36:31.723461+0000","last_active":"2024-09-19T05:36:34.697834+0000","last_peered":"2024-09-19T05:36:34.697834+0000","last_clean":"2024-09-19T05:36:34.697834+0000","last_became_active":"2024-09-19T05:36:31.723023+0000","last_became_peered":"2024-09-19T05:36:31.723023+0000","last_unstale":"2024-09-19T05:36:34.697834+0000","last_undegraded":"2024-09-19T05:36:34.697834+0000","last_fullsized":"2024-09-19T05:36:34.697834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:36:30.667617+0000","last_clean_scrub_stamp":"2024-09-19T05:36:30.667617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:42:02.107320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":234,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T05:36:33.714099+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:36:33.714099+0000","last_peered":"2024-09-19T05:36:33.714099+0000","last_clean":"2024-09-19T05:36:33.714099+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:36:33.714099+0000","last_undegraded":"2024-09-19T05:36:33.714099+0000","last_fullsized":"2024-09-19T05:36:33.714099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46308,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325532,"statfs":{"total":96636764160,"available":96589344768,"internally_reserved":0,"allocated":1253376,"data_stored":882923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40152,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331688,"statfs":{"total":96636764160,"available":96595648512,"internally_reserved":0,"allocated":659456,"data_stored":293083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40144,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331696,"statfs":{"total":96636764160,"available":96595656704,"internally_reserved":0,"allocated":651264,"data_stored":292431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542189,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45724,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326116,"statfs":{"total":96636764160,"available":96589942784,"internally_reserved":0,"allocated":655360,"data_stored":293013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40160,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331680,"statfs":{"total":96636764160,"available":96595640320,"internally_reserved":0,"allocated":667648,"data_stored":294065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542190,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40156,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331684,"statfs":{"total":96636764160,"available":96595644416,"internally_reserved":0,"allocated":663552,"data_stored":294043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542192,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40160,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331680,"statfs":{"total":96636764160,"available":96595640320,"internally_reserved":0,"allocated":659456,"data_stored":292591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50460,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321380,"statfs":{"total":96636764160,"available":96585093120,"internally_reserved":0,"allocated":1253376,"data_stored":882855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:36:41.638 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:36:41.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:36:41.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.809+0000 7f456a629640 1 Processor -- start 2024-09-19T05:36:41.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.809+0000 7f456a629640 1 -- start start 2024-09-19T05:36:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f456a629640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45640b3940 0x7f4564072970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f456a629640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f45640ad9e0 0x7f456406f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f456a629640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f456406eaa0 con 0x7f4564072eb0 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f456a629640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f456406e850 con 0x7f45640ad9e0 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f456a629640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f456406f3d0 con 0x7f45640b3940 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f45637fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4564072eb0 0x7f45640ad2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46290/0 (socket says 172.21.15.67:46290) 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f4568bc6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f45640ad9e0 0x7f456406f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f45637fe640 1 -- 172.21.15.67:0/368910416 learned_addr learned my addr 172.21.15.67:0/368910416 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f4563fff640 1 --2- 172.21.15.67:0/368910416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45640b3940 0x7f4564072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f4568bc6640 1 -- 172.21.15.67:0/368910416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45640b3940 msgr2=0x7f4564072970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f4568bc6640 1 --2- 172.21.15.67:0/368910416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45640b3940 0x7f4564072970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f4568bc6640 1 -- 172.21.15.67:0/368910416 >> v1:172.21.15.67:6789/0 conn(0x7f4564072eb0 legacy=0x7f45640ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f4562ffd640 1 -- 172.21.15.67:0/368910416 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671905043 0 0) 0x7f456406eaa0 con 0x7f4564072eb0 2024-09-19T05:36:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f4568bc6640 1 -- 172.21.15.67:0/368910416 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456406ed80 con 0x7f45640ad9e0 2024-09-19T05:36:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f4568bc6640 1 --2- 172.21.15.67:0/368910416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640ad9e0 0x7f456406f860 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f455c009d90 tx=0x7f455c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f898accdfc957d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.813+0000 7f4562ffd640 1 -- 172.21.15.67:0/368910416 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0b2070 con 0x7f45640ad9e0 2024-09-19T05:36:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f4562ffd640 1 -- 172.21.15.67:0/368910416 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455c0a57b0 con 0x7f45640ad9e0 2024-09-19T05:36:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f4562ffd640 1 -- 172.21.15.67:0/368910416 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0a5b80 con 0x7f45640ad9e0 2024-09-19T05:36:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- 172.21.15.67:0/368910416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640ad9e0 msgr2=0x7f456406f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 --2- 172.21.15.67:0/368910416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640ad9e0 0x7f456406f860 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f455c009d90 tx=0x7f455c01c970 comp rx=0 tx=0).stop 2024-09-19T05:36:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- 172.21.15.67:0/368910416 shutdown_connections 2024-09-19T05:36:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 --2- 172.21.15.67:0/368910416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640ad9e0 0x7f456406f860 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 --2- 172.21.15.67:0/368910416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45640b3940 0x7f4564072970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- 172.21.15.67:0/368910416 >> 172.21.15.67:0/368910416 conn(0x7f45640b1e50 msgr2=0x7f45640b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- 172.21.15.67:0/368910416 shutdown_connections 2024-09-19T05:36:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- 172.21.15.67:0/368910416 wait complete. 2024-09-19T05:36:41.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 Processor -- start 2024-09-19T05:36:41.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- start start 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4564072eb0 0x7f456414e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640b3940 0x7f4564154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45640ceaa0 0x7f4564154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f45640b40b0 con 0x7f45640b3940 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f45640b3f30 con 0x7f45640ceaa0 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f45640b4230 con 0x7f4564072eb0 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f45637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640b3940 0x7f4564154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f45637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640b3940 0x7f4564154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58366/0 (socket says 172.21.15.67:58366) 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f45637fe640 1 -- 172.21.15.67:0/4171134458 learned_addr learned my addr 172.21.15.67:0/4171134458 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f4568bc6640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45640ceaa0 0x7f4564154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f4563fff640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4564072eb0 0x7f456414e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f45637fe640 1 -- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4564072eb0 msgr2=0x7f456414e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f45637fe640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4564072eb0 0x7f456414e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f45637fe640 1 -- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45640ceaa0 msgr2=0x7f4564154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f45637fe640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45640ceaa0 0x7f4564154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f45637fe640 1 -- 172.21.15.67:0/4171134458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45640cdce0 con 0x7f45640b3940 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f45637fe640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640b3940 0x7f4564154a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f455800c4b0 tx=0x7f455800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f4560ff9640 1 -- 172.21.15.67:0/4171134458 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558018070 con 0x7f45640b3940 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f4560ff9640 1 -- 172.21.15.67:0/4171134458 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4558007500 con 0x7f45640b3940 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- 172.21.15.67:0/4171134458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45640cdfc0 con 0x7f45640b3940 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f4560ff9640 1 -- 172.21.15.67:0/4171134458 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558004a30 con 0x7f45640b3940 2024-09-19T05:36:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.817+0000 7f456a629640 1 -- 172.21.15.67:0/4171134458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45640ce580 con 0x7f45640b3940 2024-09-19T05:36:41.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.821+0000 7f456a629640 1 -- 172.21.15.67:0/4171134458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45640b45f0 con 0x7f45640b3940 2024-09-19T05:36:41.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.821+0000 7f4560ff9640 1 -- 172.21.15.67:0/4171134458 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f455801b070 con 0x7f45640b3940 2024-09-19T05:36:41.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.821+0000 7f4560ff9640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f45500678f0 0x7f4550069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:41.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.821+0000 7f4560ff9640 1 -- 172.21.15.67:0/4171134458 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f4558085010 con 0x7f45640b3940 2024-09-19T05:36:41.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.821+0000 7f4563fff640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f45500678f0 0x7f4550069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:41.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.821+0000 7f4563fff640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f45500678f0 0x7f4550069db0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4554009790 tx=0x7f4554008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:41.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:41.825+0000 7f4560ff9640 1 -- 172.21.15.67:0/4171134458 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4558055a50 con 0x7f45640b3940 2024-09-19T05:36:42.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.049+0000 7f456a629640 1 -- 172.21.15.67:0/4171134458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4564074640 con 0x7f45640b3940 2024-09-19T05:36:42.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.053+0000 7f4560ff9640 1 -- 172.21.15.67:0/4171134458 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7f4558055350 con 0x7f45640b3940 2024-09-19T05:36:42.057 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:36:42.057 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:36:42.057 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:36:42.057 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:36:42.057 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:36:42.058 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:36:42.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.053+0000 7f456a629640 1 -- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f45500678f0 msgr2=0x7f4550069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.053+0000 7f456a629640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f45500678f0 0x7f4550069db0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4554009790 tx=0x7f4554008040 comp rx=0 tx=0).stop 2024-09-19T05:36:42.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.053+0000 7f456a629640 1 -- 172.21.15.67:0/4171134458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640b3940 msgr2=0x7f4564154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.053+0000 7f456a629640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640b3940 0x7f4564154a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f455800c4b0 tx=0x7f455800c970 comp rx=0 tx=0).stop 2024-09-19T05:36:42.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.053+0000 7f456a629640 1 -- 172.21.15.67:0/4171134458 shutdown_connections 2024-09-19T05:36:42.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.053+0000 7f456a629640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45640ceaa0 0x7f4564154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.053+0000 7f456a629640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45640b3940 0x7f4564154a40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.053+0000 7f456a629640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f45500678f0 0x7f4550069db0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.053+0000 7f456a629640 1 --2- 172.21.15.67:0/4171134458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4564072eb0 0x7f456414e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.057+0000 7f456a629640 1 -- 172.21.15.67:0/4171134458 >> 172.21.15.67:0/4171134458 conn(0x7f45640b1e50 msgr2=0x7f45640af010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:42.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.057+0000 7f456a629640 1 -- 172.21.15.67:0/4171134458 shutdown_connections 2024-09-19T05:36:42.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.057+0000 7f456a629640 1 -- 172.21.15.67:0/4171134458 wait complete. 2024-09-19T05:36:42.077 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:36:42.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.193+0000 7f2f77e54640 1 Processor -- start 2024-09-19T05:36:42.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.193+0000 7f2f77e54640 1 -- start start 2024-09-19T05:36:42.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f77e54640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f7006dde0 0x7f2f700b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f77e54640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f700b3510 0x7f2f7006f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f77e54640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f7006e3c0 con 0x7f2f7015c030 2024-09-19T05:36:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f77e54640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2f7006e6a0 con 0x7f2f7006dde0 2024-09-19T05:36:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f77e54640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7006e980 con 0x7f2f700b3510 2024-09-19T05:36:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f753ef640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f7006dde0 0x7f2f700b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f753ef640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f7006dde0 0x7f2f700b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58374/0 (socket says 172.21.15.67:58374) 2024-09-19T05:36:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f753ef640 1 -- 172.21.15.67:0/2468449606 learned_addr learned my addr 172.21.15.67:0/2468449606 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f763f1640 1 --2- 172.21.15.67:0/2468449606 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f700b3510 0x7f2f7006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f753ef640 1 -- 172.21.15.67:0/2468449606 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f700b3510 msgr2=0x7f2f7006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f753ef640 1 --2- 172.21.15.67:0/2468449606 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f700b3510 0x7f2f7006f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f753ef640 1 -- 172.21.15.67:0/2468449606 >> v1:172.21.15.97:6789/0 conn(0x7f2f7015c030 legacy=0x7f2f7015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f753ef640 1 -- 172.21.15.67:0/2468449606 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7006ec60 con 0x7f2f7006dde0 2024-09-19T05:36:42.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f753ef640 1 --2- 172.21.15.67:0/2468449606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 0x7f2f700b2fd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009870 tx=0x7f2f6c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b7a74e6fb4f1ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:42.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f74bee640 1 -- 172.21.15.67:0/2468449606 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c0ab640 con 0x7f2f7006dde0 2024-09-19T05:36:42.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f74bee640 1 -- 172.21.15.67:0/2468449606 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6c0b0070 con 0x7f2f7006dde0 2024-09-19T05:36:42.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.197+0000 7f2f74bee640 1 -- 172.21.15.67:0/2468449606 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c0aba00 con 0x7f2f7006dde0 2024-09-19T05:36:42.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- 172.21.15.67:0/2468449606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 msgr2=0x7f2f700b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 --2- 172.21.15.67:0/2468449606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 0x7f2f700b2fd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009870 tx=0x7f2f6c01c530 comp rx=0 tx=0).stop 2024-09-19T05:36:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- 172.21.15.67:0/2468449606 shutdown_connections 2024-09-19T05:36:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 --2- 172.21.15.67:0/2468449606 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f700b3510 0x7f2f7006f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 --2- 172.21.15.67:0/2468449606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 0x7f2f700b2fd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- 172.21.15.67:0/2468449606 >> 172.21.15.67:0/2468449606 conn(0x7f2f700d0080 msgr2=0x7f2f700d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- 172.21.15.67:0/2468449606 shutdown_connections 2024-09-19T05:36:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- 172.21.15.67:0/2468449606 wait complete. 2024-09-19T05:36:42.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 Processor -- start 2024-09-19T05:36:42.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- start start 2024-09-19T05:36:42.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 0x7f2f7015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f700b3510 0x7f2f70156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f7015c030 0x7f2f7014d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701692f0 con 0x7f2f7006dde0 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7015c620 con 0x7f2f700b3510 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2f70169470 con 0x7f2f7015c030 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f75bf0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 0x7f2f7015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f75bf0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 0x7f2f7015a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58390/0 (socket says 172.21.15.67:58390) 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f75bf0640 1 -- 172.21.15.67:0/1181989845 learned_addr learned my addr 172.21.15.67:0/1181989845 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f753ef640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f700b3510 0x7f2f70156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f763f1640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f7015c030 0x7f2f7014d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f75bf0640 1 -- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f7015c030 msgr2=0x7f2f7014d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f75bf0640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f7015c030 0x7f2f7014d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f75bf0640 1 -- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f700b3510 msgr2=0x7f2f70156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f75bf0640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f700b3510 0x7f2f70156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f75bf0640 1 -- 172.21.15.67:0/1181989845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7015a860 con 0x7f2f7006dde0 2024-09-19T05:36:42.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f75bf0640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 0x7f2f7015a250 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000c370 tx=0x7f2f6000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:42.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f667fc640 1 -- 172.21.15.67:0/1181989845 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f600052d0 con 0x7f2f7006dde0 2024-09-19T05:36:42.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f667fc640 1 -- 172.21.15.67:0/1181989845 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f60005470 con 0x7f2f7006dde0 2024-09-19T05:36:42.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- 172.21.15.67:0/1181989845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7015ab40 con 0x7f2f7006dde0 2024-09-19T05:36:42.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f667fc640 1 -- 172.21.15.67:0/1181989845 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60007260 con 0x7f2f7006dde0 2024-09-19T05:36:42.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.201+0000 7f2f77e54640 1 -- 172.21.15.67:0/1181989845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7015d270 con 0x7f2f7006dde0 2024-09-19T05:36:42.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.205+0000 7f2f77e54640 1 -- 172.21.15.67:0/1181989845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f700b2fd0 con 0x7f2f7006dde0 2024-09-19T05:36:42.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.205+0000 7f2f667fc640 1 -- 172.21.15.67:0/1181989845 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f60007400 con 0x7f2f7006dde0 2024-09-19T05:36:42.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.205+0000 7f2f667fc640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2f540678c0 0x7f2f54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.205+0000 7f2f667fc640 1 -- 172.21.15.67:0/1181989845 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f2f600852a0 con 0x7f2f7006dde0 2024-09-19T05:36:42.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.205+0000 7f2f753ef640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2f540678c0 0x7f2f54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.205+0000 7f2f753ef640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2f540678c0 0x7f2f54069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0af000 tx=0x7f2f6c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:42.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.209+0000 7f2f667fc640 1 -- 172.21.15.67:0/1181989845 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2f60055c50 con 0x7f2f7006dde0 2024-09-19T05:36:42.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.405+0000 7f2f77e54640 1 -- 172.21.15.67:0/1181989845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f7014f410 con 0x7f2f7006dde0 2024-09-19T05:36:42.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f667fc640 1 -- 172.21.15.67:0/1181989845 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5217 (secure 0 0 0) 0x7f2f600850c0 con 0x7f2f7006dde0 2024-09-19T05:36:42.412 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:36:42.412 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":24,"btime":"2024-09-19T05:36:35:721412+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/872634022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":872634022},{"type":"v1","addr":"172.21.15.97:6836","nonce":872634022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2340749382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2340749382},{"type":"v1","addr":"172.21.15.97:6837","nonce":2340749382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1455090407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1455090407},{"type":"v1","addr":"172.21.15.67:6833","nonce":1455090407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:36:32.070002+0000","modified":"2024-09-19T05:36:35.084581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5364":{"gid":5364,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/985983096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":985983096},{"type":"v1","addr":"172.21.15.67:6835","nonce":985983096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5364,"qdb_cluster":[5364]},"id":3}]} 2024-09-19T05:36:42.413 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-09-19T05:36:42.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 -- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2f540678c0 msgr2=0x7f2f54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2f540678c0 0x7f2f54069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0af000 tx=0x7f2f6c0a7000 comp rx=0 tx=0).stop 2024-09-19T05:36:42.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 -- 172.21.15.67:0/1181989845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 msgr2=0x7f2f7015a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 0x7f2f7015a250 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000c370 tx=0x7f2f6000c830 comp rx=0 tx=0).stop 2024-09-19T05:36:42.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 -- 172.21.15.67:0/1181989845 shutdown_connections 2024-09-19T05:36:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2f540678c0 0x7f2f54069d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f7015c030 0x7f2f7014d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f700b3510 0x7f2f70156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 --2- 172.21.15.67:0/1181989845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f7006dde0 0x7f2f7015a250 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 -- 172.21.15.67:0/1181989845 >> 172.21.15.67:0/1181989845 conn(0x7f2f700d0080 msgr2=0x7f2f700b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 -- 172.21.15.67:0/1181989845 shutdown_connections 2024-09-19T05:36:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.409+0000 7f2f77e54640 1 -- 172.21.15.67:0/1181989845 wait complete. 2024-09-19T05:36:42.833 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:36:32.070002+0000', 'modified': '2024-09-19T05:36:35.084581+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5364}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5364': {'gid': 5364, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/985983096', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 985983096}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 985983096}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5364, 'qdb_cluster': [5364]} 2024-09-19T05:36:42.834 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:36:42.834 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:36:42.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f35fb640 1 Processor -- start 2024-09-19T05:36:42.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f35fb640 1 -- start start 2024-09-19T05:36:42.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f35fb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1ec06dde0 0x7fe1ec0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f35fb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe1ec0b3510 0x7fe1ec06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f35fb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1ec06e3c0 con 0x7fe1ec15c030 2024-09-19T05:36:42.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f35fb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe1ec06e6a0 con 0x7fe1ec06dde0 2024-09-19T05:36:42.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f35fb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe1ec06e980 con 0x7fe1ec0b3510 2024-09-19T05:36:42.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f0b96640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1ec06dde0 0x7fe1ec0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f0b96640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1ec06dde0 0x7fe1ec0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58404/0 (socket says 172.21.15.67:58404) 2024-09-19T05:36:42.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f0b96640 1 -- 172.21.15.67:0/740214041 learned_addr learned my addr 172.21.15.67:0/740214041 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:42.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/740214041 >> v2:172.21.15.97:3300/0 conn(0x7fe1ec0b3510 0x7fe1ec06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f0b96640 1 -- 172.21.15.67:0/740214041 >> v2:172.21.15.97:3300/0 conn(0x7fe1ec0b3510 msgr2=0x7fe1ec06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:42.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f0b96640 1 --2- 172.21.15.67:0/740214041 >> v2:172.21.15.97:3300/0 conn(0x7fe1ec0b3510 0x7fe1ec06f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f0b96640 1 -- 172.21.15.67:0/740214041 >> v1:172.21.15.97:6789/0 conn(0x7fe1ec15c030 legacy=0x7fe1ec15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:42.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.961+0000 7fe1f0b96640 1 -- 172.21.15.67:0/740214041 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec06ec60 con 0x7fe1ec06dde0 2024-09-19T05:36:42.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f0b96640 1 --2- 172.21.15.67:0/740214041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec06dde0 0x7fe1ec0b2fd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0afbf0 tx=0x7fe1e801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a772291bd21216a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:42.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1e3fff640 1 -- 172.21.15.67:0/740214041 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e80b1070 con 0x7fe1ec06dde0 2024-09-19T05:36:42.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1e3fff640 1 -- 172.21.15.67:0/740214041 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e80ac620 con 0x7fe1ec06dde0 2024-09-19T05:36:42.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1e3fff640 1 -- 172.21.15.67:0/740214041 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e80ac9f0 con 0x7fe1ec06dde0 2024-09-19T05:36:42.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f35fb640 1 -- 172.21.15.67:0/740214041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec06dde0 msgr2=0x7fe1ec0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f35fb640 1 --2- 172.21.15.67:0/740214041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec06dde0 0x7fe1ec0b2fd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0afbf0 tx=0x7fe1e801c4b0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f35fb640 1 -- 172.21.15.67:0/740214041 shutdown_connections 2024-09-19T05:36:42.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f35fb640 1 --2- 172.21.15.67:0/740214041 >> v2:172.21.15.97:3300/0 conn(0x7fe1ec0b3510 0x7fe1ec06f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f35fb640 1 --2- 172.21.15.67:0/740214041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec06dde0 0x7fe1ec0b2fd0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f35fb640 1 -- 172.21.15.67:0/740214041 >> 172.21.15.67:0/740214041 conn(0x7fe1ec0d0080 msgr2=0x7fe1ec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:42.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f35fb640 1 -- 172.21.15.67:0/740214041 shutdown_connections 2024-09-19T05:36:42.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f35fb640 1 -- 172.21.15.67:0/740214041 wait complete. 2024-09-19T05:36:42.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f35fb640 1 Processor -- start 2024-09-19T05:36:42.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.965+0000 7fe1f35fb640 1 -- start start 2024-09-19T05:36:42.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f35fb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1ec06dde0 0x7fe1ec151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f35fb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1ec0b3510 0x7fe1ec15dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f35fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec15c030 0x7fe1ec15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f35fb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec1692f0 con 0x7fe1ec15c030 2024-09-19T05:36:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f35fb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec15c620 con 0x7fe1ec0b3510 2024-09-19T05:36:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f35fb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe1ec169470 con 0x7fe1ec06dde0 2024-09-19T05:36:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1b98640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec15c030 0x7fe1ec15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1b98640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec15c030 0x7fe1ec15e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58416/0 (socket says 172.21.15.67:58416) 2024-09-19T05:36:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1b98640 1 -- 172.21.15.67:0/258177677 learned_addr learned my addr 172.21.15.67:0/258177677 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f0b96640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1ec0b3510 0x7fe1ec15dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1397640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1ec06dde0 0x7fe1ec151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1b98640 1 -- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1ec06dde0 msgr2=0x7fe1ec151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1ec06dde0 0x7fe1ec151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1b98640 1 -- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1ec0b3510 msgr2=0x7fe1ec15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1ec0b3510 0x7fe1ec15dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1b98640 1 -- 172.21.15.67:0/258177677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec157180 con 0x7fe1ec15c030 2024-09-19T05:36:42.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec15c030 0x7fe1ec15e2e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4007e70 tx=0x7fe1e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:42.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1e1ffb640 1 -- 172.21.15.67:0/258177677 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4014620 con 0x7fe1ec15c030 2024-09-19T05:36:42.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1e1ffb640 1 -- 172.21.15.67:0/258177677 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e4019070 con 0x7fe1ec15c030 2024-09-19T05:36:42.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f35fb640 1 -- 172.21.15.67:0/258177677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ec157460 con 0x7fe1ec15c030 2024-09-19T05:36:42.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1e1ffb640 1 -- 172.21.15.67:0/258177677 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4014a20 con 0x7fe1ec15c030 2024-09-19T05:36:42.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f35fb640 1 -- 172.21.15.67:0/258177677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ec157a20 con 0x7fe1ec15c030 2024-09-19T05:36:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1e1ffb640 1 -- 172.21.15.67:0/258177677 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1e4014bc0 con 0x7fe1ec15c030 2024-09-19T05:36:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1e1ffb640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1d00678f0 0x7fe1d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1e1ffb640 1 -- 172.21.15.67:0/258177677 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fe1e40866f0 con 0x7fe1ec15c030 2024-09-19T05:36:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.969+0000 7fe1f1397640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1d00678f0 0x7fe1d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 Processor -- start 2024-09-19T05:36:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 -- start start 2024-09-19T05:36:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1397640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1d00678f0 0x7fe1d0069db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00a750 tx=0x7fe1dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f78b20 0x563e07f78f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 0x563e07f2ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f2f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563e07e16b60 con 0x563e07f2f290 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563e07d7dc70 con 0x563e07f78b20 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563e07d23ed0 con 0x563e07f79440 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1b98640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f2f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1b98640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f2f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58430/0 (socket says 172.21.15.67:58430) 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1b98640 1 -- 172.21.15.67:0/4254704534 learned_addr learned my addr 172.21.15.67:0/4254704534 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1397640 1 --2- 172.21.15.67:0/4254704534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f78b20 0x563e07f78f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f0b96640 1 --2- 172.21.15.67:0/4254704534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 0x563e07f2ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1b98640 1 -- 172.21.15.67:0/4254704534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 msgr2=0x563e07f2ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/4254704534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 0x563e07f2ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1b98640 1 -- 172.21.15.67:0/4254704534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f78b20 msgr2=0x563e07f78f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/4254704534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f78b20 0x563e07f78f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1b98640 1 -- 172.21.15.67:0/4254704534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e07d35e50 con 0x563e07f2f290 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/4254704534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f2f670 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe1e405f050 tx=0x7fe1e40570a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02a387ec720b7ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1d6ffd640 1 -- 172.21.15.67:0/4254704534 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e405f580 con 0x563e07f2f290 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1d6ffd640 1 -- 172.21.15.67:0/4254704534 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e4054ca0 con 0x563e07f2f290 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1d6ffd640 1 -- 172.21.15.67:0/4254704534 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e405d070 con 0x563e07f2f290 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 -- 172.21.15.67:0/4254704534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 msgr2=0x563e07f2f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/4254704534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f2f670 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe1e405f050 tx=0x7fe1e40570a0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 -- 172.21.15.67:0/4254704534 shutdown_connections 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/4254704534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f2f670 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/4254704534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 0x563e07f2ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/4254704534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f78b20 0x563e07f78f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 -- 172.21.15.67:0/4254704534 >> 172.21.15.67:0/4254704534 conn(0x563e07f35600 msgr2=0x563e07f2d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 -- 172.21.15.67:0/4254704534 shutdown_connections 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 -- 172.21.15.67:0/4254704534 wait complete. 2024-09-19T05:36:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 -- start start 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.973+0000 7fe1f66b7000 1 Processor -- start 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07f33df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 0x563e07f39cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f34330 0x563e07f3a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563e07ddfb00 con 0x563e07f78b20 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563e07d58360 con 0x563e07f34330 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563e07d552d0 con 0x563e07f79440 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 10 client.0 _ll_register_callbacks cb 0x563e07f1a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f1397640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07f33df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f1397640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07f33df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58432/0 (socket says 172.21.15.67:58432) 2024-09-19T05:36:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f1397640 1 -- 172.21.15.67:0/2604674608 learned_addr learned my addr 172.21.15.67:0/2604674608 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f0b96640 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 0x563e07f39cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f34330 0x563e07f3a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f1397640 1 -- 172.21.15.67:0/2604674608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 msgr2=0x563e07f39cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f1397640 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 0x563e07f39cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f1397640 1 -- 172.21.15.67:0/2604674608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f34330 msgr2=0x563e07f3a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f1397640 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f34330 0x563e07f3a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f1397640 1 -- 172.21.15.67:0/2604674608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e07d24120 con 0x563e07f78b20 2024-09-19T05:36:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f0b96640 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 0x563e07f39cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f1397640 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07f33df0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00cda0 tx=0x7fe1dc004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7197f363994fce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1cbfff640 1 -- 172.21.15.67:0/2604674608 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc023020 con 0x563e07f78b20 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2604674608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1e4054ca0 con 0x563e07f78b20 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1cbfff640 1 -- 172.21.15.67:0/2604674608 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fe1dc01f470 con 0x563e07f78b20 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1cbfff640 1 -- 172.21.15.67:0/2604674608 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe1dc02d050 con 0x563e07f78b20 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 10 client.5505 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2604674608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x563e07d1d450 con 0x563e07f78b20 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1cbfff640 1 -- 172.21.15.67:0/2604674608 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e4054ca0 con 0x563e07f78b20 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1cbfff640 1 -- 172.21.15.67:0/2604674608 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7fe1dc004020 con 0x563e07f78b20 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 10 client.5505 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 10 client.5505 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 20 client.5505 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e07f87280 0x563e07f89670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 4 client.5505 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2604674608 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e07d17c00 con 0x563e07f87280 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f0b96640 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e07f87280 0x563e07f89670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f0b96640 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e07f87280 0x563e07f89670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=110685c742581549 server_cookie=182d6c4c3b8cce11 in_seq=0 out_seq=0 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1cbfff640 10 client.5505 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1cbfff640 1 -- 172.21.15.67:0/2604674608 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e07d17c00 con 0x563e07f87280 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1cbfff640 10 client.5505 handle_command_reply: tid=0 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 client.5505 shutdown 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2604674608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 msgr2=0x563e07f33df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07f33df0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00cda0 tx=0x7fe1dc004690 comp rx=0 tx=0).stop 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2604674608 shutdown_connections 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e07f87280 0x563e07f89670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f34330 0x563e07f3a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f79440 0x563e07f39cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/2604674608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07f33df0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:42.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2604674608 >> 172.21.15.67:0/2604674608 conn(0x563e07f2f290 msgr2=0x563e07f2dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:42.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1cbfff640 0 client.5505 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:42.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2604674608 shutdown_connections 2024-09-19T05:36:42.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2604674608 wait complete. 2024-09-19T05:36:42.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.977+0000 7fe1f66b7000 20 client.5505 trim_cache size 0 max 16384 2024-09-19T05:36:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f66b7000 1 Processor -- start 2024-09-19T05:36:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f66b7000 1 -- start start 2024-09-19T05:36:43.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f8cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f34330 0x563e07f77c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f78b20 0x563e07f78170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec201410 con 0x563e07f2f290 2024-09-19T05:36:43.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec150260 con 0x563e07f34330 2024-09-19T05:36:43.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe1ec1508b0 con 0x563e07f78b20 2024-09-19T05:36:43.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f1397640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f8cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f1397640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f8cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58438/0 (socket says 172.21.15.67:58438) 2024-09-19T05:36:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f1397640 1 -- 172.21.15.67:0/2318001007 learned_addr learned my addr 172.21.15.67:0/2318001007 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f0b96640 1 --2- 172.21.15.67:0/2318001007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f34330 0x563e07f77c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f1397640 1 -- 172.21.15.67:0/2318001007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f78b20 msgr2=0x563e07f78170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f1397640 1 --2- 172.21.15.67:0/2318001007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f78b20 0x563e07f78170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f1397640 1 -- 172.21.15.67:0/2318001007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f34330 msgr2=0x563e07f77c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f1397640 1 --2- 172.21.15.67:0/2318001007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f34330 0x563e07f77c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f1397640 1 -- 172.21.15.67:0/2318001007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e07d04fd0 con 0x563e07f2f290 2024-09-19T05:36:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1f1397640 1 --2- 172.21.15.67:0/2318001007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f8cb00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00c150 tx=0x7fe1dc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f61c527fa27cd96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1d67fc640 1 -- 172.21.15.67:0/2318001007 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc036070 con 0x563e07f2f290 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1d67fc640 1 -- 172.21.15.67:0/2318001007 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1dc01f670 con 0x563e07f2f290 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:42.997+0000 7fe1d67fc640 1 -- 172.21.15.67:0/2318001007 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc023070 con 0x563e07f2f290 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2318001007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 msgr2=0x563e07f8cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/2318001007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f8cb00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00c150 tx=0x7fe1dc01d000 comp rx=0 tx=0).stop 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2318001007 shutdown_connections 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/2318001007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f78b20 0x563e07f78170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/2318001007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f34330 0x563e07f77c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/2318001007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f2f290 0x563e07f8cb00 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2318001007 >> 172.21.15.67:0/2318001007 conn(0x563e07f84040 msgr2=0x563e07f335f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2318001007 shutdown_connections 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/2318001007 wait complete. 2024-09-19T05:36:43.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- start start 2024-09-19T05:36:43.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 Processor -- start 2024-09-19T05:36:43.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f2f290 0x563e07f8c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f34330 0x563e07feac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07feb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563e07d7cf80 con 0x563e07f78b20 2024-09-19T05:36:43.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563e07d35ca0 con 0x563e07f2f290 2024-09-19T05:36:43.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563e07d822a0 con 0x563e07f34330 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 10 client.0 _ll_register_callbacks cb 0x7fe1dc00ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1b98640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07feb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1b98640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07feb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58446/0 (socket says 172.21.15.67:58446) 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1b98640 1 -- 172.21.15.67:0/877390184 learned_addr learned my addr 172.21.15.67:0/877390184 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1397640 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f2f290 0x563e07f8c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f0b96640 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f34330 0x563e07feac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1b98640 1 -- 172.21.15.67:0/877390184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f34330 msgr2=0x563e07feac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f34330 0x563e07feac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1b98640 1 -- 172.21.15.67:0/877390184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f2f290 msgr2=0x563e07f8c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f2f290 0x563e07f8c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1b98640 1 -- 172.21.15.67:0/877390184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e07e00750 con 0x563e07f78b20 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1b98640 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07feb1d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4052e00 tx=0x7fe1e4084960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394590b9272b802b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:43.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1cbfff640 1 -- 172.21.15.67:0/877390184 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4072020 con 0x563e07f78b20 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1cbfff640 1 -- 172.21.15.67:0/877390184 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fe1e405d070 con 0x563e07f78b20 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/877390184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1dc01f670 con 0x563e07f78b20 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1cbfff640 1 -- 172.21.15.67:0/877390184 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe1e407d050 con 0x563e07f78b20 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 10 client.5511 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/877390184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x563e07d0ba30 con 0x563e07f78b20 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1cbfff640 1 -- 172.21.15.67:0/877390184 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1dc01f670 con 0x563e07f78b20 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1cbfff640 1 -- 172.21.15.67:0/877390184 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7fe1e405f0f0 con 0x563e07f78b20 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 10 client.5511 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 10 client.5511 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:36:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 20 client.5511 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e07f79440 0x563e07fa7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 4 client.5511 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/877390184 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "status"}) -- 0x563e07d8b3a0 con 0x563e07f79440 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1397640 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e07f79440 0x563e07fa7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1cbfff640 10 client.5511 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f1397640 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e07f79440 0x563e07fa7960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a759956eb75f764a server_cookie=e0944c0ecdcd2030 in_seq=0 out_seq=0 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1cbfff640 1 -- 172.21.15.67:0/877390184 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x563e07d8b3a0 con 0x563e07f79440 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1cbfff640 10 client.5511 handle_command_reply: tid=0 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 client.5511 shutdown 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/877390184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 msgr2=0x563e07feb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:43.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07feb1d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4052e00 tx=0x7fe1e4084960 comp rx=0 tx=0).stop 2024-09-19T05:36:43.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/877390184 shutdown_connections 2024-09-19T05:36:43.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e07f78b20 0x563e07feb1d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e07f34330 0x563e07feac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e07f79440 0x563e07fa7960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 --2- 172.21.15.67:0/877390184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e07f2f290 0x563e07f8c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1cbfff640 0 client.5511 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:43.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.001+0000 7fe1f66b7000 1 -- 172.21.15.67:0/877390184 >> 172.21.15.67:0/877390184 conn(0x563e07f84040 msgr2=0x563e07f76c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:43.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f66b7000 1 -- 172.21.15.67:0/877390184 shutdown_connections 2024-09-19T05:36:43.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f66b7000 1 -- 172.21.15.67:0/877390184 wait complete. 2024-09-19T05:36:43.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f66b7000 20 client.5511 trim_cache size 0 max 16384 2024-09-19T05:36:43.016 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:43.016 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:36:43.016 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:36:43.016 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 5364, 2024-09-19T05:36:43.016 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:36:43.016 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:36:43.016 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:36:43.016 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 10.320534317, 2024-09-19T05:36:43.016 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 24, 2024-09-19T05:36:43.016 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 55, 2024-09-19T05:36:43.017 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 55, 2024-09-19T05:36:43.017 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 15.587143326 2024-09-19T05:36:43.017 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 -- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1d00678f0 msgr2=0x7fe1d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1d00678f0 0x7fe1d0069db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00a750 tx=0x7fe1dc008040 comp rx=0 tx=0).stop 2024-09-19T05:36:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 -- 172.21.15.67:0/258177677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec15c030 msgr2=0x7fe1ec15e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec15c030 0x7fe1ec15e2e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4007e70 tx=0x7fe1e400e4b0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 -- 172.21.15.67:0/258177677 shutdown_connections 2024-09-19T05:36:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1ec15c030 0x7fe1ec15e2e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1ec0b3510 0x7fe1ec15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1d00678f0 0x7fe1d0069db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 --2- 172.21.15.67:0/258177677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1ec06dde0 0x7fe1ec151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 -- 172.21.15.67:0/258177677 >> 172.21.15.67:0/258177677 conn(0x7fe1ec0d0080 msgr2=0x7fe1ec0b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:43.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 -- 172.21.15.67:0/258177677 shutdown_connections 2024-09-19T05:36:43.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.005+0000 7fe1f35fb640 1 -- 172.21.15.67:0/258177677 wait complete. 2024-09-19T05:36:43.025 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:36:43.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.129+0000 7fc7c916c640 1 Processor -- start 2024-09-19T05:36:43.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.129+0000 7fc7c916c640 1 -- start start 2024-09-19T05:36:43.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c916c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc7c415f830 0x7fc7c40ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c916c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7c40cdea0 0x7fc7c40d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c916c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c4071e50 con 0x7fc7c40d0720 2024-09-19T05:36:43.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c916c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c40d10d0 con 0x7fc7c40cdea0 2024-09-19T05:36:43.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c916c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c4072130 con 0x7fc7c415f830 2024-09-19T05:36:43.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c359e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7c40cdea0 0x7fc7c40d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c259c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc7c40d0720 0x7fc7c415ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46292/0 (socket says 172.21.15.67:46292) 2024-09-19T05:36:43.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c359e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7c40cdea0 0x7fc7c40d0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58452/0 (socket says 172.21.15.67:58452) 2024-09-19T05:36:43.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c259c640 1 -- 172.21.15.67:0/3171115389 learned_addr learned my addr 172.21.15.67:0/3171115389 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:43.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c2d9d640 1 --2- 172.21.15.67:0/3171115389 >> v2:172.21.15.97:3300/0 conn(0x7fc7c415f830 0x7fc7c40ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c359e640 1 -- 172.21.15.67:0/3171115389 >> v2:172.21.15.97:3300/0 conn(0x7fc7c415f830 msgr2=0x7fc7c40ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:43.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c359e640 1 --2- 172.21.15.67:0/3171115389 >> v2:172.21.15.97:3300/0 conn(0x7fc7c415f830 0x7fc7c40ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c359e640 1 -- 172.21.15.67:0/3171115389 >> v1:172.21.15.67:6789/0 conn(0x7fc7c40d0720 legacy=0x7fc7c415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:43.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c1d9b640 1 -- 172.21.15.67:0/3171115389 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411060184 0 0) 0x7fc7c4071e50 con 0x7fc7c40d0720 2024-09-19T05:36:43.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c359e640 1 -- 172.21.15.67:0/3171115389 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c4070bd0 con 0x7fc7c40cdea0 2024-09-19T05:36:43.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c359e640 1 --2- 172.21.15.67:0/3171115389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 0x7fc7c40d0b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40734d0 tx=0x7fc7b401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6633d01d0e7ab076 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:43.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c1d9b640 1 -- 172.21.15.67:0/3171115389 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40b0070 con 0x7fc7c40cdea0 2024-09-19T05:36:43.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c1d9b640 1 -- 172.21.15.67:0/3171115389 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b40ab600 con 0x7fc7c40cdea0 2024-09-19T05:36:43.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.133+0000 7fc7c1d9b640 1 -- 172.21.15.67:0/3171115389 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40ab9d0 con 0x7fc7c40cdea0 2024-09-19T05:36:43.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- 172.21.15.67:0/3171115389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 msgr2=0x7fc7c40d0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:43.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 --2- 172.21.15.67:0/3171115389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 0x7fc7c40d0b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40734d0 tx=0x7fc7b401c450 comp rx=0 tx=0).stop 2024-09-19T05:36:43.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- 172.21.15.67:0/3171115389 shutdown_connections 2024-09-19T05:36:43.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 --2- 172.21.15.67:0/3171115389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 0x7fc7c40d0b90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 --2- 172.21.15.67:0/3171115389 >> v2:172.21.15.97:3300/0 conn(0x7fc7c415f830 0x7fc7c40ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- 172.21.15.67:0/3171115389 >> 172.21.15.67:0/3171115389 conn(0x7fc7c40d22d0 msgr2=0x7fc7c40d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:43.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- 172.21.15.67:0/3171115389 shutdown_connections 2024-09-19T05:36:43.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- 172.21.15.67:0/3171115389 wait complete. 2024-09-19T05:36:43.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 Processor -- start 2024-09-19T05:36:43.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- start start 2024-09-19T05:36:43.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 0x7fc7c4156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7c40d0720 0x7fc7c4157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7c415f830 0x7fc7c40c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c40b18a0 con 0x7fc7c40cdea0 2024-09-19T05:36:43.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c40cea60 con 0x7fc7c415f830 2024-09-19T05:36:43.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c415fc10 con 0x7fc7c40d0720 2024-09-19T05:36:43.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 0x7fc7c4156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 0x7fc7c4156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58462/0 (socket says 172.21.15.67:58462) 2024-09-19T05:36:43.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c2d9d640 1 -- 172.21.15.67:0/2678367120 learned_addr learned my addr 172.21.15.67:0/2678367120 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:43.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c259c640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7c40d0720 0x7fc7c4157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c359e640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7c415f830 0x7fc7c40c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c2d9d640 1 -- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7c40d0720 msgr2=0x7fc7c4157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:43.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c2d9d640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7c40d0720 0x7fc7c4157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c2d9d640 1 -- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7c415f830 msgr2=0x7fc7c40c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:43.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c2d9d640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7c415f830 0x7fc7c40c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c2d9d640 1 -- 172.21.15.67:0/2678367120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c4158c00 con 0x7fc7c40cdea0 2024-09-19T05:36:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c2d9d640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 0x7fc7c4156600 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc007e70 tx=0x7fc7bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7ab7fe640 1 -- 172.21.15.67:0/2678367120 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc014620 con 0x7fc7c40cdea0 2024-09-19T05:36:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7ab7fe640 1 -- 172.21.15.67:0/2678367120 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc019070 con 0x7fc7c40cdea0 2024-09-19T05:36:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- 172.21.15.67:0/2678367120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c4158ee0 con 0x7fc7c40cdea0 2024-09-19T05:36:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7ab7fe640 1 -- 172.21.15.67:0/2678367120 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc014a00 con 0x7fc7c40cdea0 2024-09-19T05:36:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.137+0000 7fc7c916c640 1 -- 172.21.15.67:0/2678367120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c41594a0 con 0x7fc7c40cdea0 2024-09-19T05:36:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.141+0000 7fc7c916c640 1 -- 172.21.15.67:0/2678367120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c40d0b90 con 0x7fc7c40cdea0 2024-09-19T05:36:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.141+0000 7fc7ab7fe640 1 -- 172.21.15.67:0/2678367120 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7bc014ba0 con 0x7fc7c40cdea0 2024-09-19T05:36:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.141+0000 7fc7ab7fe640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7b00678c0 0x7fc7b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.141+0000 7fc7ab7fe640 1 -- 172.21.15.67:0/2678367120 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fc7bc0866d0 con 0x7fc7c40cdea0 2024-09-19T05:36:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.141+0000 7fc7c259c640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7b00678c0 0x7fc7b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.141+0000 7fc7c259c640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7b00678c0 0x7fc7b0069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40d01e0 tx=0x7fc7b8007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:43.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.145+0000 7fc7ab7fe640 1 -- 172.21.15.67:0/2678367120 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc7bc011260 con 0x7fc7c40cdea0 2024-09-19T05:36:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.345+0000 7fc7c916c640 1 -- 172.21.15.67:0/2678367120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc7c40b81f0 con 0x7fc7c40cdea0 2024-09-19T05:36:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.345+0000 7fc7ab7fe640 1 -- 172.21.15.67:0/2678367120 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fc7bc057080 con 0x7fc7c40cdea0 2024-09-19T05:36:43.350 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:36:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 -- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7b00678c0 msgr2=0x7fc7b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7b00678c0 0x7fc7b0069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40d01e0 tx=0x7fc7b8007c10 comp rx=0 tx=0).stop 2024-09-19T05:36:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 -- 172.21.15.67:0/2678367120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 msgr2=0x7fc7c4156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 0x7fc7c4156600 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc007e70 tx=0x7fc7bc00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 -- 172.21.15.67:0/2678367120 shutdown_connections 2024-09-19T05:36:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7c415f830 0x7fc7c40c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7b00678c0 0x7fc7b0069d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7c40d0720 0x7fc7c4157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 --2- 172.21.15.67:0/2678367120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40cdea0 0x7fc7c4156600 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 -- 172.21.15.67:0/2678367120 >> 172.21.15.67:0/2678367120 conn(0x7fc7c40d22d0 msgr2=0x7fc7c40cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 -- 172.21.15.67:0/2678367120 shutdown_connections 2024-09-19T05:36:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43.349+0000 7fc7c916c640 1 -- 172.21.15.67:0/2678367120 wait complete. 2024-09-19T05:36:43.368 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:36:43.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:36:43.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:36:43.368 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:36:43.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:36:43.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:36:43.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:36:43.368 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:36:43.368 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:36:43.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:43.369 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:36:43.375 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:36:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:36:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:36:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:36:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:36:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:36:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:36:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42301sec preferred_lft 42301sec 2024-09-19T05:36:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:36:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:36:43.377 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:36:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:36:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:36:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:36:43.377 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:36:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:36:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:36:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:36:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:36:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:36:43.378 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:36:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:36:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:36:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:36:43.378 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:36:43.379 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:36:43.379 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:36:43.379 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:36:43.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:43.379 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:36:43.430 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:36:43.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:43.432 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:36:43.483 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:36:43.483 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:36:43.483 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:36:43.483 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:36:43.484 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:36:43.484 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:36:43.484 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:36:43.484 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:36:43.484 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:36:43.484 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:36:43.484 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:36:43.484 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:36:43.484 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:36:43.485 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:36:43.485 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:36:43.485 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:36:43.485 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:36:43.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:36:43.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:36:43.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:43.610 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:36:43.615 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:36:43.615 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:36:43.615 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:36:43.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:43.615 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:36:43.666 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:36:43.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:36:43.666 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:36:43.720 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:36:43.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:36:43.720 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:36:43.768 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:36:43.826 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:36:43.873 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:36:43.873 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:36:43.874 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:36:43.875 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:36:43.876 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:36:43.876 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:36:43.876 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:36:43.876 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:36:43.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:43.877 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:36:43.925 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:36:43.925 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:36:43.969 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:36:43.984 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:36:44.034 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:36:44.035 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:36:44.035 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:36:44.035 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:36:44.035 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:36:44.035 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:36:44.035 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:36:44.035 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:36:44.035 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:36:44.035 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:36:44.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:44.037 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:36:44.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:36:44.041+0000 7fecd1e3d580 -1 init, newargv = 0x55c0d85ae500 newargc=15 2024-09-19T05:36:44.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[51512]: starting ceph client 2024-09-19T05:36:44.052 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[51512]: starting fuse 2024-09-19T05:36:45.154 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:36:45.170 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:36:45.219 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:36:45.219 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:36:45.219 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:36:45.219 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:36:45.219 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:36:45.219 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:36:45.219 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:36:45.220 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:36:45.221 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:36:45.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:45.222 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:36:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:36:45.270 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:36:45.270 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:36:45.271 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:36:45.272 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:36:45.400 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.51512.asok 2024-09-19T05:36:45.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:36:45.412 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51512.asok 2024-09-19T05:36:45.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:45.413 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51512.asok status 2024-09-19T05:36:45.567 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:45.568 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:36:45.568 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:36:45.568 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:36:45.568 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:36:45.568 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:36:45.568 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:36:45.568 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "51512", 2024-09-19T05:36:45.568 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:36:45.568 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:45.568 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 5529, 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 5529 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 1135616120 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:45.569 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 1135616120 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.5529 192.168.0.1:0/1135616120", 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/1135616120", 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 24, 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 55, 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:36:45.570 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:45.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:45.582 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:36:45.582 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:36:45.589 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:36:45.589 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:36:45.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:45.589 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:36:45.645 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-19T05:36:45.645 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-19T05:36:45.645 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-19T05:36:45.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:45.645 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-19T05:36:45.700 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> import stat 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> import json 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> import sys 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> try: 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> except OSError as e: 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> sys.exit(e.errno) 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> print(json.dumps( 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-19T05:36:45.701 DEBUG:teuthology.orchestra.run.smithi067:> indent=2)) 2024-09-19T05:36:45.702 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:36:45.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:45 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-19T05:36:45.828 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-19T05:36:45.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:45.829 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-09-19T05:36:45.886 INFO:teuthology.orchestra.run.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-09-19T05:36:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-19T05:36:58.342 INFO:teuthology.orchestra.run.smithi067.stderr:Updating files: 9% (126/1398) Updating files: 10% (140/1398) Updating files: 11% (154/1398) Updating files: 12% (168/1398) Updating files: 13% (182/1398) Updating files: 14% (196/1398) Updating files: 15% (210/1398) Updating files: 16% (224/1398) Updating files: 17% (238/1398) Updating files: 18% (252/1398) Updating files: 19% (266/1398) Updating files: 20% (280/1398) Updating files: 21% (294/1398) Updating files: 22% (308/1398) Updating files: 23% (322/1398) Updating files: 24% (336/1398) Updating files: 24% (337/1398) Updating files: 25% (350/1398) Updating files: 26% (364/1398) Updating files: 27% (378/1398) Updating files: 28% (392/1398) Updating files: 29% (406/1398) Updating files: 30% (420/1398) Updating files: 31% (434/1398) Updating files: 32% (448/1398) Updating files: 33% (462/1398) Updating files: 34% (476/1398) Updating files: 35% (490/1398) Updating files: 36% (504/1398) Updating files: 37% (518/1398) Updating files: 38% (532/1398) Updating files: 39% (546/1398) Updating files: 40% (560/1398) Updating files: 41% (574/1398) Updating files: 42% (588/1398) Updating files: 43% (602/1398) Updating files: 44% (616/1398) Updating files: 45% (630/1398) Updating files: 45% (643/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 57% (805/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 71% (994/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 84% (1180/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-19T05:36:58.351 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-09-19T05:36:58.351 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-19T05:36:58.352 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-19T05:36:58.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.513+0000 7f4e93d81640 1 Processor -- start 2024-09-19T05:36:58.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.513+0000 7f4e93d81640 1 -- start start 2024-09-19T05:36:58.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.513+0000 7f4e93d81640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4e8c159c60 0x7f4e8c0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.513+0000 7f4e93d81640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e8c06ffd0 0x7f4e8c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.513+0000 7f4e93d81640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e8c15a040 con 0x7f4e8c0b3150 2024-09-19T05:36:58.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.513+0000 7f4e93d81640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4e8c15d460 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.513+0000 7f4e93d81640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4e8c15c850 con 0x7f4e8c159c60 2024-09-19T05:36:58.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e9131c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e8c06ffd0 0x7f4e8c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e9131c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e8c06ffd0 0x7f4e8c0aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54702/0 (socket says 172.21.15.67:54702) 2024-09-19T05:36:58.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e9231e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4e8c0b3150 0x7f4e8c15fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46692/0 (socket says 172.21.15.67:46692) 2024-09-19T05:36:58.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e9131c640 1 -- 172.21.15.67:0/1688303595 learned_addr learned my addr 172.21.15.67:0/1688303595 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/1688303595 >> v2:172.21.15.97:3300/0 conn(0x7f4e8c159c60 0x7f4e8c0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e9131c640 1 -- 172.21.15.67:0/1688303595 >> v2:172.21.15.97:3300/0 conn(0x7f4e8c159c60 msgr2=0x7f4e8c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e9131c640 1 --2- 172.21.15.67:0/1688303595 >> v2:172.21.15.97:3300/0 conn(0x7f4e8c159c60 0x7f4e8c0ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e9131c640 1 -- 172.21.15.67:0/1688303595 >> v1:172.21.15.67:6789/0 conn(0x7f4e8c0b3150 legacy=0x7f4e8c15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e9131c640 1 -- 172.21.15.67:0/1688303595 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c15cb30 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e90b1b640 1 -- 172.21.15.67:0/1688303595 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3400886567 0 0) 0x7f4e8c15a040 con 0x7f4e8c0b3150 2024-09-19T05:36:58.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e9131c640 1 --2- 172.21.15.67:0/1688303595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e8c06ffd0 0x7f4e8c0aec90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0712f0 tx=0x7f4e8801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201cc933834827a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e90b1b640 1 -- 172.21.15.67:0/1688303595 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e880aa650 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e90b1b640 1 -- 172.21.15.67:0/1688303595 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e880af070 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e90b1b640 1 -- 172.21.15.67:0/1688303595 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e880aaa10 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e93d81640 1 -- 172.21.15.67:0/1688303595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e8c06ffd0 msgr2=0x7f4e8c0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e93d81640 1 --2- 172.21.15.67:0/1688303595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e8c06ffd0 0x7f4e8c0aec90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0712f0 tx=0x7f4e8801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e93d81640 1 -- 172.21.15.67:0/1688303595 shutdown_connections 2024-09-19T05:36:58.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e93d81640 1 --2- 172.21.15.67:0/1688303595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e8c06ffd0 0x7f4e8c0aec90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e93d81640 1 --2- 172.21.15.67:0/1688303595 >> v2:172.21.15.97:3300/0 conn(0x7f4e8c159c60 0x7f4e8c0ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e93d81640 1 -- 172.21.15.67:0/1688303595 >> 172.21.15.67:0/1688303595 conn(0x7f4e8c0b1e50 msgr2=0x7f4e8c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e93d81640 1 -- 172.21.15.67:0/1688303595 shutdown_connections 2024-09-19T05:36:58.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.517+0000 7f4e93d81640 1 -- 172.21.15.67:0/1688303595 wait complete. 2024-09-19T05:36:58.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e93d81640 1 Processor -- start 2024-09-19T05:36:58.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e93d81640 1 -- start start 2024-09-19T05:36:58.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e93d81640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e8c06ffd0 0x7f4e8c153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e93d81640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8c0b3150 0x7f4e8c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e93d81640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e8c159c60 0x7f4e8c155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e93d81640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c0ad7f0 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e93d81640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c0ad670 con 0x7f4e8c0b3150 2024-09-19T05:36:58.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e93d81640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c168e30 con 0x7f4e8c159c60 2024-09-19T05:36:58.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e91b1d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e8c06ffd0 0x7f4e8c153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e91b1d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e8c06ffd0 0x7f4e8c153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54708/0 (socket says 172.21.15.67:54708) 2024-09-19T05:36:58.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e91b1d640 1 -- 172.21.15.67:0/1918801164 learned_addr learned my addr 172.21.15.67:0/1918801164 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e9231e640 1 --2- 172.21.15.67:0/1918801164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e8c159c60 0x7f4e8c155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e9131c640 1 --2- 172.21.15.67:0/1918801164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8c0b3150 0x7f4e8c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e91b1d640 1 -- 172.21.15.67:0/1918801164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e8c159c60 msgr2=0x7f4e8c155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/1918801164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e8c159c60 0x7f4e8c155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e91b1d640 1 -- 172.21.15.67:0/1918801164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8c0b3150 msgr2=0x7f4e8c152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/1918801164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8c0b3150 0x7f4e8c152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e91b1d640 1 -- 172.21.15.67:0/1918801164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c1583f0 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e9231e640 1 --2- 172.21.15.67:0/1918801164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e8c159c60 0x7f4e8c155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:58.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/1918801164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e8c06ffd0 0x7f4e8c153550 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c007ef0 tx=0x7f4e7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e827fc640 1 -- 172.21.15.67:0/1918801164 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c014620 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e827fc640 1 -- 172.21.15.67:0/1918801164 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c019070 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e827fc640 1 -- 172.21.15.67:0/1918801164 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c014a00 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e93d81640 1 -- 172.21.15.67:0/1918801164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e8c1586d0 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.521+0000 7f4e93d81640 1 -- 172.21.15.67:0/1918801164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e8c158c90 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e827fc640 1 -- 172.21.15.67:0/1918801164 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4e7c014ba0 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e827fc640 1 --2- 172.21.15.67:0/1918801164 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4e780678c0 0x7f4e78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e827fc640 1 -- 172.21.15.67:0/1918801164 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f4e7c086820 con 0x7f4e8c06ffd0 2024-09-19T05:36:58.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9131c640 1 --2- 172.21.15.67:0/1918801164 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4e780678c0 0x7f4e78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e96e3d000 1 Processor -- start 2024-09-19T05:36:58.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e96e3d000 1 -- start start 2024-09-19T05:36:58.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9131c640 1 --2- 172.21.15.67:0/1918801164 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4e780678c0 0x7f4e78069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4e880ae000 tx=0x7f4e880a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac290950 0x560fac290d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac247300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac247c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560fac12a6a0 con 0x560fac247840 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x560fac090b80 con 0x560fac291270 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x560fac0376d0 con 0x560fac290950 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9231e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac247c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9231e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac247c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54720/0 (socket says 172.21.15.67:54720) 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9231e640 1 -- 172.21.15.67:0/1679162003 learned_addr learned my addr 172.21.15.67:0/1679162003 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/1679162003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac290950 0x560fac290d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9131c640 1 --2- 172.21.15.67:0/1679162003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac247300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9231e640 1 -- 172.21.15.67:0/1679162003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac290950 msgr2=0x560fac290d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9231e640 1 --2- 172.21.15.67:0/1679162003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac290950 0x560fac290d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9231e640 1 -- 172.21.15.67:0/1679162003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 msgr2=0x560fac247300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9231e640 1 --2- 172.21.15.67:0/1679162003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac247300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9231e640 1 -- 172.21.15.67:0/1679162003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fac049030 con 0x560fac247840 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9131c640 1 --2- 172.21.15.67:0/1679162003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac247300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e9231e640 1 --2- 172.21.15.67:0/1679162003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac247c20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4e840017a0 tx=0x7f4e84001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb725e6ef59efbf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.525+0000 7f4e737fe640 1 -- 172.21.15.67:0/1679162003 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e840074e0 con 0x560fac247840 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e737fe640 1 -- 172.21.15.67:0/1679162003 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e840047f0 con 0x560fac247840 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e737fe640 1 -- 172.21.15.67:0/1679162003 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84007680 con 0x560fac247840 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- 172.21.15.67:0/1679162003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 msgr2=0x560fac247c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/1679162003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac247c20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4e840017a0 tx=0x7f4e84001c60 comp rx=0 tx=0).stop 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- 172.21.15.67:0/1679162003 shutdown_connections 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/1679162003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac247c20 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/1679162003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac247300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/1679162003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac290950 0x560fac290d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- 172.21.15.67:0/1679162003 >> 172.21.15.67:0/1679162003 conn(0x560fac23a820 msgr2=0x560fac2417d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- 172.21.15.67:0/1679162003 shutdown_connections 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- 172.21.15.67:0/1679162003 wait complete. 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- start start 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 Processor -- start 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac247840 0x560fac27e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac27e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac291270 0x560fac27ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560fac04e8f0 con 0x560fac290950 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x560fac08cb40 con 0x560fac247840 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x560fac24c090 con 0x560fac291270 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 10 client.0 _ll_register_callbacks cb 0x560fac145270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e9131c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac27e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e9131c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac27e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54728/0 (socket says 172.21.15.67:54728) 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e9131c640 1 -- 172.21.15.67:0/3256542437 learned_addr learned my addr 172.21.15.67:0/3256542437 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac247840 0x560fac27e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e9231e640 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac291270 0x560fac27ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e9131c640 1 -- 172.21.15.67:0/3256542437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac291270 msgr2=0x560fac27ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e9131c640 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac291270 0x560fac27ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e9131c640 1 -- 172.21.15.67:0/3256542437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac247840 msgr2=0x560fac27e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e9131c640 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac247840 0x560fac27e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e9131c640 1 -- 172.21.15.67:0/3256542437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fac037920 con 0x560fac290950 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e9131c640 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac27e680 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4e8801c9d0 tx=0x7f4e8801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f33fcafbf7a7a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3256542437 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e880cb060 con 0x560fac290950 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3256542437 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f4e880bda10 con 0x560fac290950 2024-09-19T05:36:58.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3256542437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e840047f0 con 0x560fac290950 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3256542437 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e880d1050 con 0x560fac290950 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 10 client.5544 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3256542437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x560fac030b30 con 0x560fac290950 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3256542437 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e840047f0 con 0x560fac290950 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3256542437 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f4e880d4020 con 0x560fac290950 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 10 client.5544 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 10 client.5544 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 20 client.5544 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x560fac27f5d0 0x560fac2a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 4 client.5544 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3256542437 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fac02b150 con 0x560fac27f5d0 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.529+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x560fac27f5d0 0x560fac2a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x560fac27f5d0 0x560fac2a19f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5533b808186c91 server_cookie=8ab2c41692068bd1 in_seq=0 out_seq=0 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e70ff9640 10 client.5544 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3256542437 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560fac02b150 con 0x560fac27f5d0 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e70ff9640 10 client.5544 handle_command_reply: tid=0 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 client.5544 shutdown 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3256542437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 msgr2=0x560fac27e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac27e680 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4e8801c9d0 tx=0x7f4e8801ad30 comp rx=0 tx=0).stop 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3256542437 shutdown_connections 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac291270 0x560fac27ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac27e680 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x560fac27f5d0 0x560fac2a19f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3256542437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac247840 0x560fac27e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e70ff9640 0 client.5544 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3256542437 >> 172.21.15.67:0/3256542437 conn(0x560fac23a820 msgr2=0x560fac248dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3256542437 shutdown_connections 2024-09-19T05:36:58.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3256542437 wait complete. 2024-09-19T05:36:58.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.533+0000 7f4e96e3d000 20 client.5544 trim_cache size 0 max 16384 2024-09-19T05:36:58.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 Processor -- start 2024-09-19T05:36:58.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 -- start start 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac247840 0x560fac3004f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac300a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac300f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c1ffbb0 con 0x560fac290950 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c073b70 con 0x560fac291270 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c09cb90 con 0x560fac247840 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9131c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac300a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9131c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac300a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54736/0 (socket says 172.21.15.67:54736) 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9131c640 1 -- 172.21.15.67:0/1707529699 learned_addr learned my addr 172.21.15.67:0/1707529699 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9131c640 1 -- 172.21.15.67:0/1707529699 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac247840 msgr2=0x560fac3004f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9131c640 1 --2- 172.21.15.67:0/1707529699 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac247840 0x560fac3004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9131c640 1 -- 172.21.15.67:0/1707529699 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 msgr2=0x560fac300f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9231e640 1 --2- 172.21.15.67:0/1707529699 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac300f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9131c640 1 --2- 172.21.15.67:0/1707529699 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac300f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9131c640 1 -- 172.21.15.67:0/1707529699 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fac1136c0 con 0x560fac290950 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9231e640 1 --2- 172.21.15.67:0/1707529699 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac300f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e9131c640 1 --2- 172.21.15.67:0/1707529699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac300a30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4e8801c530 tx=0x7f4e880c4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ecf9f5086bf634 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e72ffd640 1 -- 172.21.15.67:0/1707529699 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e880da070 con 0x560fac290950 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e72ffd640 1 -- 172.21.15.67:0/1707529699 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e880af040 con 0x560fac290950 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e72ffd640 1 -- 172.21.15.67:0/1707529699 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e880b9070 con 0x560fac290950 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 -- 172.21.15.67:0/1707529699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 msgr2=0x560fac300a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/1707529699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac300a30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4e8801c530 tx=0x7f4e880c4000 comp rx=0 tx=0).stop 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 -- 172.21.15.67:0/1707529699 shutdown_connections 2024-09-19T05:36:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/1707529699 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac300f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/1707529699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac290950 0x560fac300a30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/1707529699 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac247840 0x560fac3004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 -- 172.21.15.67:0/1707529699 >> 172.21.15.67:0/1707529699 conn(0x560fac23a820 msgr2=0x560fac240fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 -- 172.21.15.67:0/1707529699 shutdown_connections 2024-09-19T05:36:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 -- 172.21.15.67:0/1707529699 wait complete. 2024-09-19T05:36:58.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.549+0000 7f4e96e3d000 1 -- start start 2024-09-19T05:36:58.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 Processor -- start 2024-09-19T05:36:58.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac303bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac290950 0x560fac2a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac2a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560fac0383b0 con 0x560fac247840 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c073520 con 0x560fac291270 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x560fac0563b0 con 0x560fac290950 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 10 client.0 _ll_register_callbacks cb 0x7f4e880096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e91b1d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac303bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e91b1d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac303bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54740/0 (socket says 172.21.15.67:54740) 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e91b1d640 1 -- 172.21.15.67:0/3597085013 learned_addr learned my addr 172.21.15.67:0/3597085013 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e91b1d640 1 -- 172.21.15.67:0/3597085013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac290950 msgr2=0x560fac2a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e9131c640 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac290950 0x560fac2a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e9231e640 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac2a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac290950 0x560fac2a3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e91b1d640 1 -- 172.21.15.67:0/3597085013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 msgr2=0x560fac2a36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac2a36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e91b1d640 1 -- 172.21.15.67:0/3597085013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fac0e9920 con 0x560fac247840 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e91b1d640 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac303bd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c056a10 tx=0x7f4e7c0566e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b049faa250a65c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3597085013 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c083060 con 0x560fac247840 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3597085013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e880af040 con 0x560fac247840 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3597085013 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f4e7c0530f0 con 0x560fac247840 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3597085013 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e7c05f660 con 0x560fac247840 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 10 client.5550 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3597085013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x560fac029970 con 0x560fac247840 2024-09-19T05:36:58.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3597085013 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e880af040 con 0x560fac247840 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3597085013 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f4e7c06ece0 con 0x560fac247840 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 10 client.5550 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 10 client.5550 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 20 client.5550 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x560fac2a3c10 0x560fac2a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 4 client.5550 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3597085013 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x560fac09e2b0 con 0x560fac2a3c10 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e9131c640 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x560fac2a3c10 0x560fac2a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e9131c640 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x560fac2a3c10 0x560fac2a4020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4506fb9686c3c8d server_cookie=c4accbf7c655f645 in_seq=0 out_seq=0 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e70ff9640 10 client.5550 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e70ff9640 1 -- 172.21.15.67:0/3597085013 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x560fac09e2b0 con 0x560fac2a3c10 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e70ff9640 10 client.5550 handle_command_reply: tid=0 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 client.5550 shutdown 2024-09-19T05:36:58.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3597085013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 msgr2=0x560fac303bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac303bd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c056a10 tx=0x7f4e7c0566e0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3597085013 shutdown_connections 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x560fac2a3c10 0x560fac2a4020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560fac291270 0x560fac2a36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560fac290950 0x560fac2a3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 --2- 172.21.15.67:0/3597085013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fac247840 0x560fac303bd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3597085013 >> 172.21.15.67:0/3597085013 conn(0x560fac23a820 msgr2=0x560fac2417d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e70ff9640 0 client.5550 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3597085013 shutdown_connections 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 1 -- 172.21.15.67:0/3597085013 wait complete. 2024-09-19T05:36:58.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.553+0000 7f4e96e3d000 20 client.5550 trim_cache size 0 max 16384 2024-09-19T05:36:58.565 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:58.565 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:36:58.565 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": -2 2024-09-19T05:36:58.565 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:58.565 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-19T05:36:58.566 INFO:teuthology.orchestra.run.smithi067.stderr:Error ENOENT: 2024-09-19T05:36:58.566 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-19T05:36:58.566 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-19T05:36:58.566 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-19T05:36:58.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358fcf3640 1 Processor -- start 2024-09-19T05:36:58.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358fcf3640 1 -- start start 2024-09-19T05:36:58.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358fcf3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f35880af3a0 0x7f358815fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358fcf3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35880ad840 con 0x7f358806ffd0 2024-09-19T05:36:58.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358fcf3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f358815a040 con 0x7f3588159c60 2024-09-19T05:36:58.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358fcf3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f358815d460 con 0x7f35880af3a0 2024-09-19T05:36:58.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358d28e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f358806ffd0 0x7f35880aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46706/0 (socket says 172.21.15.67:46706) 2024-09-19T05:36:58.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358d28e640 1 -- 172.21.15.67:0/78718627 learned_addr learned my addr 172.21.15.67:0/78718627 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:58.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358e290640 1 --2- 172.21.15.67:0/78718627 >> v2:172.21.15.97:3300/0 conn(0x7f35880af3a0 0x7f358815fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227974525 0 0) 0x7f35880ad840 con 0x7f358806ffd0 2024-09-19T05:36:58.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3574003530 con 0x7f358806ffd0 2024-09-19T05:36:58.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 116918644 0 0) 0x7f3574003530 con 0x7f358806ffd0 2024-09-19T05:36:58.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 >> v2:172.21.15.97:3300/0 conn(0x7f35880af3a0 msgr2=0x7f358815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358ca8d640 1 --2- 172.21.15.67:0/78718627 >> v2:172.21.15.97:3300/0 conn(0x7f35880af3a0 0x7f358815fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 >> v1:172.21.15.97:6789/0 conn(0x7f3588159c60 legacy=0x7f35880ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358815c850 con 0x7f358806ffd0 2024-09-19T05:36:58.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3578001680 con 0x7f358806ffd0 2024-09-19T05:36:58.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 >> v1:172.21.15.67:6789/0 conn(0x7f358806ffd0 legacy=0x7f35880aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.677+0000 7f358ca8d640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35740039c0 0x7f3574003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358ca8d640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35740043c0 0x7f3574004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358ca8d640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3574005090 0x7f357400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f358815d460 con 0x7f3574005090 2024-09-19T05:36:58.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f357400bff0 con 0x7f35740043c0 2024-09-19T05:36:58.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f357400c1f0 con 0x7f35740039c0 2024-09-19T05:36:58.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358e290640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3574005090 0x7f357400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358da8f640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35740039c0 0x7f3574003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358d28e640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35740043c0 0x7f3574004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358e290640 1 -- 172.21.15.67:0/78718627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35740039c0 msgr2=0x7f3574003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358e290640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35740039c0 0x7f3574003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358e290640 1 -- 172.21.15.67:0/78718627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35740043c0 msgr2=0x7f3574004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358e290640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35740043c0 0x7f3574004890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358e290640 1 -- 172.21.15.67:0/78718627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3574003530 con 0x7f3574005090 2024-09-19T05:36:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358e290640 1 -- 172.21.15.67:0/78718627 reap_dead start 2024-09-19T05:36:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358e290640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3574005090 0x7f357400b9d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3580009ac0 tx=0x7f358001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f09db78045dd2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580009690 con 0x7f3574005090 2024-09-19T05:36:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35800a5680 con 0x7f3574005090 2024-09-19T05:36:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358ca8d640 1 -- 172.21.15.67:0/78718627 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35800a5a50 con 0x7f3574005090 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358fcf3640 1 -- 172.21.15.67:0/78718627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3574005090 msgr2=0x7f357400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358fcf3640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3574005090 0x7f357400b9d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3580009ac0 tx=0x7f358001ca90 comp rx=0 tx=0).stop 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358fcf3640 1 -- 172.21.15.67:0/78718627 shutdown_connections 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358fcf3640 1 --2- 172.21.15.67:0/78718627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3574005090 0x7f357400b9d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358fcf3640 1 -- 172.21.15.67:0/78718627 >> 172.21.15.67:0/78718627 conn(0x7f35880b1e50 msgr2=0x7f35880b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358fcf3640 1 -- 172.21.15.67:0/78718627 shutdown_connections 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.681+0000 7f358fcf3640 1 -- 172.21.15.67:0/78718627 wait complete. 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358fcf3640 1 Processor -- start 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358fcf3640 1 -- start start 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358fcf3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3574005090 0x7f3588072e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358fcf3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f358814eaa0 0x7f35881f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358fcf3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3588073370 0x7f35881f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358fcf3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f358815ce10 con 0x7f358814eaa0 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358fcf3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f358815c6d0 con 0x7f3574005090 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358fcf3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f358815d0f0 con 0x7f3588073370 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358d28e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f358814eaa0 0x7f35881f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358d28e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f358814eaa0 0x7f35881f4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54760/0 (socket says 172.21.15.67:54760) 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358d28e640 1 -- 172.21.15.67:0/3782750183 learned_addr learned my addr 172.21.15.67:0/3782750183 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358e290640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3588073370 0x7f35881f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358da8f640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3574005090 0x7f3588072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358d28e640 1 -- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3588073370 msgr2=0x7f35881f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358d28e640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3588073370 0x7f35881f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358d28e640 1 -- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3574005090 msgr2=0x7f3588072e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358d28e640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3574005090 0x7f3588072e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358d28e640 1 -- 172.21.15.67:0/3782750183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3588153310 con 0x7f358814eaa0 2024-09-19T05:36:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358d28e640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f358814eaa0 0x7f35881f4100 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3578010bb0 tx=0x7f357800e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f357e7fc640 1 -- 172.21.15.67:0/3782750183 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357801b070 con 0x7f358814eaa0 2024-09-19T05:36:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f357e7fc640 1 -- 172.21.15.67:0/3782750183 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3578011040 con 0x7f358814eaa0 2024-09-19T05:36:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358fcf3640 1 -- 172.21.15.67:0/3782750183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35881535f0 con 0x7f358814eaa0 2024-09-19T05:36:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f357e7fc640 1 -- 172.21.15.67:0/3782750183 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35780143a0 con 0x7f358814eaa0 2024-09-19T05:36:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f358fcf3640 1 -- 172.21.15.67:0/3782750183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3588153bb0 con 0x7f358814eaa0 2024-09-19T05:36:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.685+0000 7f357e7fc640 1 -- 172.21.15.67:0/3782750183 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f357801e070 con 0x7f358814eaa0 2024-09-19T05:36:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f357e7fc640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 0x7f356c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f357e7fc640 1 -- 172.21.15.67:0/3782750183 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f3578088ab0 con 0x7f358814eaa0 2024-09-19T05:36:58.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358da8f640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 0x7f356c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 Processor -- start 2024-09-19T05:36:58.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 -- start start 2024-09-19T05:36:58.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358da8f640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 0x7f356c069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f35840012f0 tx=0x7f3584009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca4e60 0x561d65ca5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65ca5780 0x561d65c5b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65c5be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561d65aa8b70 con 0x561d65c5ba90 2024-09-19T05:36:58.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561d65a4ef10 con 0x561d65ca5780 2024-09-19T05:36:58.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561d65aa4b30 con 0x561d65ca4e60 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358e290640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65c5be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358e290640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65c5be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54762/0 (socket says 172.21.15.67:54762) 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358e290640 1 -- 172.21.15.67:0/2159232440 learned_addr learned my addr 172.21.15.67:0/2159232440 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358da8f640 1 --2- 172.21.15.67:0/2159232440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca4e60 0x561d65ca5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358d28e640 1 --2- 172.21.15.67:0/2159232440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65ca5780 0x561d65c5b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358e290640 1 -- 172.21.15.67:0/2159232440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca4e60 msgr2=0x561d65ca5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358e290640 1 --2- 172.21.15.67:0/2159232440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca4e60 0x561d65ca5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358e290640 1 -- 172.21.15.67:0/2159232440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65ca5780 msgr2=0x561d65c5b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358e290640 1 --2- 172.21.15.67:0/2159232440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65ca5780 0x561d65c5b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358e290640 1 -- 172.21.15.67:0/2159232440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d65a5cd60 con 0x561d65c5ba90 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f358e290640 1 --2- 172.21.15.67:0/2159232440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65c5be70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3580009030 tx=0x7f3580004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fda3bc1a1cdf61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f356b7fe640 1 -- 172.21.15.67:0/2159232440 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35800be070 con 0x561d65c5ba90 2024-09-19T05:36:58.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f356b7fe640 1 -- 172.21.15.67:0/2159232440 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358000f080 con 0x561d65c5ba90 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f356b7fe640 1 -- 172.21.15.67:0/2159232440 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35800b3070 con 0x561d65c5ba90 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 -- 172.21.15.67:0/2159232440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 msgr2=0x561d65c5be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 --2- 172.21.15.67:0/2159232440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65c5be70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3580009030 tx=0x7f3580004740 comp rx=0 tx=0).stop 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 -- 172.21.15.67:0/2159232440 shutdown_connections 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 --2- 172.21.15.67:0/2159232440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65c5be70 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 --2- 172.21.15.67:0/2159232440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65ca5780 0x561d65c5b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 --2- 172.21.15.67:0/2159232440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca4e60 0x561d65ca5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 -- 172.21.15.67:0/2159232440 >> 172.21.15.67:0/2159232440 conn(0x561d65c57a40 msgr2=0x561d65c59e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 -- 172.21.15.67:0/2159232440 shutdown_connections 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.689+0000 7f3592daf000 1 -- 172.21.15.67:0/2159232440 wait complete. 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- start start 2024-09-19T05:36:58.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 Processor -- start 2024-09-19T05:36:58.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65c5ba90 0x561d65c603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65c60900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca5780 0x561d65c66c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561d65aad1a0 con 0x561d65ca4e60 2024-09-19T05:36:58.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561d65a664d0 con 0x561d65c5ba90 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561d65a2db60 con 0x561d65ca5780 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 10 client.0 _ll_register_callbacks cb 0x561d65a7eef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358d28e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65c60900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358d28e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65c60900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54764/0 (socket says 172.21.15.67:54764) 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358d28e640 1 -- 172.21.15.67:0/2022270837 learned_addr learned my addr 172.21.15.67:0/2022270837 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358e290640 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca5780 0x561d65c66c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358da8f640 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65c5ba90 0x561d65c603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358d28e640 1 -- 172.21.15.67:0/2022270837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca5780 msgr2=0x561d65c66c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358d28e640 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca5780 0x561d65c66c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358d28e640 1 -- 172.21.15.67:0/2022270837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65c5ba90 msgr2=0x561d65c603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358d28e640 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65c5ba90 0x561d65c603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358d28e640 1 -- 172.21.15.67:0/2022270837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d65a6bce0 con 0x561d65ca4e60 2024-09-19T05:36:58.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358da8f640 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65c5ba90 0x561d65c603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358e290640 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca5780 0x561d65c66c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358d28e640 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65c60900 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3578058a30 tx=0x7f3578058e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6522b539fec6c0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3568ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3568ff9640 1 -- 172.21.15.67:0/2022270837 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578061680 con 0x561d65ca4e60 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3568ff9640 1 -- 172.21.15.67:0/2022270837 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f3578058180 con 0x561d65ca4e60 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- 172.21.15.67:0/2022270837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561d65a42cc0 con 0x561d65ca4e60 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3568ff9640 1 -- 172.21.15.67:0/2022270837 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3578077050 con 0x561d65ca4e60 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 10 client.5562 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- 172.21.15.67:0/2022270837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x561d65a4f160 con 0x561d65ca4e60 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3568ff9640 1 -- 172.21.15.67:0/2022270837 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561d65a42cc0 con 0x561d65ca4e60 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3568ff9640 1 -- 172.21.15.67:0/2022270837 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f35780771f0 con 0x561d65ca4e60 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 10 client.5562 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 10 client.5562 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:58.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 20 client.5562 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561d65cabfe0 0x561d65cac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 4 client.5562 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- 172.21.15.67:0/2022270837 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d65ab62a0 con 0x561d65cabfe0 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358da8f640 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561d65cabfe0 0x561d65cac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f358da8f640 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561d65cabfe0 0x561d65cac3c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e115e9c5c6f95c9b server_cookie=ebadc62d8ca85589 in_seq=0 out_seq=0 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3568ff9640 10 client.5562 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3568ff9640 1 -- 172.21.15.67:0/2022270837 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d65ab62a0 con 0x561d65cabfe0 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3568ff9640 10 client.5562 handle_command_reply: tid=0 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 client.5562 shutdown 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- 172.21.15.67:0/2022270837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 msgr2=0x561d65c60900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65c60900 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3578058a30 tx=0x7f3578058e70 comp rx=0 tx=0).stop 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- 172.21.15.67:0/2022270837 shutdown_connections 2024-09-19T05:36:58.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca5780 0x561d65c66c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65c60900 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561d65cabfe0 0x561d65cac3c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 --2- 172.21.15.67:0/2022270837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65c5ba90 0x561d65c603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3568ff9640 0 client.5562 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- 172.21.15.67:0/2022270837 >> 172.21.15.67:0/2022270837 conn(0x561d65c57a40 msgr2=0x561d65c5a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- 172.21.15.67:0/2022270837 shutdown_connections 2024-09-19T05:36:58.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 1 -- 172.21.15.67:0/2022270837 wait complete. 2024-09-19T05:36:58.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.693+0000 7f3592daf000 20 client.5562 trim_cache size 0 max 16384 2024-09-19T05:36:58.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f3592daf000 1 Processor -- start 2024-09-19T05:36:58.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f3592daf000 1 -- start start 2024-09-19T05:36:58.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f3592daf000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65c5ba90 0x561d65ca42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f3592daf000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65ca4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f3592daf000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca5780 0x561d65cbc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f3592daf000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f35882013d0 con 0x561d65ca4e60 2024-09-19T05:36:58.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f3592daf000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3588200410 con 0x561d65c5ba90 2024-09-19T05:36:58.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f3592daf000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f358814df50 con 0x561d65ca5780 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f358d28e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65ca4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f358d28e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65ca4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54774/0 (socket says 172.21.15.67:54774) 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f358d28e640 1 -- 172.21.15.67:0/2341162108 learned_addr learned my addr 172.21.15.67:0/2341162108 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f358d28e640 1 -- 172.21.15.67:0/2341162108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca5780 msgr2=0x561d65cbc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f358d28e640 1 --2- 172.21.15.67:0/2341162108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca5780 0x561d65cbc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f358d28e640 1 -- 172.21.15.67:0/2341162108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65c5ba90 msgr2=0x561d65ca42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f358d28e640 1 --2- 172.21.15.67:0/2341162108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65c5ba90 0x561d65ca42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f358d28e640 1 -- 172.21.15.67:0/2341162108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d65ca55b0 con 0x561d65ca4e60 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f358d28e640 1 --2- 172.21.15.67:0/2341162108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65ca4800 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3578058cc0 tx=0x7f3578070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85031e628b7583f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f356affd640 1 -- 172.21.15.67:0/2341162108 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578061480 con 0x561d65ca4e60 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f356affd640 1 -- 172.21.15.67:0/2341162108 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3578085070 con 0x561d65ca4e60 2024-09-19T05:36:58.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.713+0000 7f356affd640 1 -- 172.21.15.67:0/2341162108 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578058380 con 0x561d65ca4e60 2024-09-19T05:36:58.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- 172.21.15.67:0/2341162108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 msgr2=0x561d65ca4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 --2- 172.21.15.67:0/2341162108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65ca4800 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3578058cc0 tx=0x7f3578070000 comp rx=0 tx=0).stop 2024-09-19T05:36:58.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- 172.21.15.67:0/2341162108 shutdown_connections 2024-09-19T05:36:58.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 --2- 172.21.15.67:0/2341162108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca5780 0x561d65cbc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 --2- 172.21.15.67:0/2341162108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65ca4e60 0x561d65ca4800 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 --2- 172.21.15.67:0/2341162108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65c5ba90 0x561d65ca42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- 172.21.15.67:0/2341162108 >> 172.21.15.67:0/2341162108 conn(0x561d65c57a40 msgr2=0x561d65ca3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- 172.21.15.67:0/2341162108 shutdown_connections 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- 172.21.15.67:0/2341162108 wait complete. 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- start start 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 Processor -- start 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65ca8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca4e60 0x561d65ca9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65ca5780 0x561d65ca9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561d65aa7e80 con 0x561d65c5ba90 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f35881ffdf0 con 0x561d65ca5780 2024-09-19T05:36:58.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561d65aad1a0 con 0x561d65ca4e60 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 10 client.0 _ll_register_callbacks cb 0x7f3578054fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358da8f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65ca8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358da8f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65ca8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54784/0 (socket says 172.21.15.67:54784) 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358da8f640 1 -- 172.21.15.67:0/746612786 learned_addr learned my addr 172.21.15.67:0/746612786 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358da8f640 1 -- 172.21.15.67:0/746612786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca4e60 msgr2=0x561d65ca9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358e290640 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65ca5780 0x561d65ca9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358da8f640 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca4e60 0x561d65ca9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358da8f640 1 -- 172.21.15.67:0/746612786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65ca5780 msgr2=0x561d65ca9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358da8f640 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65ca5780 0x561d65ca9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358da8f640 1 -- 172.21.15.67:0/746612786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d65a48510 con 0x561d65c5ba90 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358da8f640 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65ca8bc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3584003bb0 tx=0x7f3584003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2405d77d671dea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3568ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3568ff9640 1 -- 172.21.15.67:0/746612786 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584003e60 con 0x561d65c5ba90 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3568ff9640 1 -- 172.21.15.67:0/746612786 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f35840055d0 con 0x561d65c5ba90 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- 172.21.15.67:0/746612786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3578085070 con 0x561d65c5ba90 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3568ff9640 1 -- 172.21.15.67:0/746612786 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3584035050 con 0x561d65c5ba90 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 10 client.5568 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- 172.21.15.67:0/746612786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x561d65b02ad0 con 0x561d65c5ba90 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3568ff9640 1 -- 172.21.15.67:0/746612786 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3578085070 con 0x561d65c5ba90 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3568ff9640 1 -- 172.21.15.67:0/746612786 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f3584038020 con 0x561d65c5ba90 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 10 client.5568 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 10 client.5568 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 20 client.5568 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:58.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561d65ca9b80 0x561d65ca9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 4 client.5568 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3592daf000 1 -- 172.21.15.67:0/746612786 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x561d65ab05f0 con 0x561d65ca9b80 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358d28e640 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561d65ca9b80 0x561d65ca9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f3568ff9640 10 client.5568 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.717+0000 7f358d28e640 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561d65ca9b80 0x561d65ca9f90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=377c8154c02c9dc9 server_cookie=e03ff6928dadf602 in_seq=0 out_seq=0 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3568ff9640 1 -- 172.21.15.67:0/746612786 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x561d65ab05f0 con 0x561d65ca9b80 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3568ff9640 10 client.5568 handle_command_reply: tid=0 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 client.5568 shutdown 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 -- 172.21.15.67:0/746612786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 msgr2=0x561d65ca8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65ca8bc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3584003bb0 tx=0x7f3584003be0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 -- 172.21.15.67:0/746612786 shutdown_connections 2024-09-19T05:36:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561d65ca9b80 0x561d65ca9f90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561d65ca5780 0x561d65ca9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561d65ca4e60 0x561d65ca9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 --2- 172.21.15.67:0/746612786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561d65c5ba90 0x561d65ca8bc0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 -- 172.21.15.67:0/746612786 >> 172.21.15.67:0/746612786 conn(0x561d65c57a40 msgr2=0x561d65ca43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3568ff9640 0 client.5568 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 -- 172.21.15.67:0/746612786 shutdown_connections 2024-09-19T05:36:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 1 -- 172.21.15.67:0/746612786 wait complete. 2024-09-19T05:36:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f3592daf000 20 client.5568 trim_cache size 0 max 16384 2024-09-19T05:36:58.730 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:58.730 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": -2 2024-09-19T05:36:58.731 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:58.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 -- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 msgr2=0x7f356c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 0x7f356c069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f35840012f0 tx=0x7f3584009040 comp rx=0 tx=0).stop 2024-09-19T05:36:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 -- 172.21.15.67:0/3782750183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f358814eaa0 msgr2=0x7f35881f4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f358814eaa0 0x7f35881f4100 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3578010bb0 tx=0x7f357800e4d0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 -- 172.21.15.67:0/3782750183 shutdown_connections 2024-09-19T05:36:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 0x7f356c069d80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3588073370 0x7f35881f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f358814eaa0 0x7f35881f4100 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 --2- 172.21.15.67:0/3782750183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3574005090 0x7f3588072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 -- 172.21.15.67:0/3782750183 >> 172.21.15.67:0/3782750183 conn(0x7f35880b1e50 msgr2=0x7f358815a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 -- 172.21.15.67:0/3782750183 shutdown_connections 2024-09-19T05:36:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.721+0000 7f358fcf3640 1 -- 172.21.15.67:0/3782750183 wait complete. 2024-09-19T05:36:58.741 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-19T05:36:58.741 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-09-19T05:36:58.741 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-09-19T05:36:58.741 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites 2024-09-19T05:36:58.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.853+0000 7f32431e1640 1 Processor -- start 2024-09-19T05:36:58.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.853+0000 7f32431e1640 1 -- start start 2024-09-19T05:36:58.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f32431e1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f323c0b7300 0x7f323c0d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f32431e1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f323c0d3300 0x7f323c0cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f32431e1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323c0d2aa0 con 0x7f323c0d4220 2024-09-19T05:36:58.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f32431e1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f323c0cf080 con 0x7f323c0b7300 2024-09-19T05:36:58.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f32431e1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f323c0cf620 con 0x7f323c0d3300 2024-09-19T05:36:58.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f323c0b7300 0x7f323c0d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f323c0b7300 0x7f323c0d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54792/0 (socket says 172.21.15.67:54792) 2024-09-19T05:36:58.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323bfff640 1 -- 172.21.15.67:0/3459421307 learned_addr learned my addr 172.21.15.67:0/3459421307 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f324177e640 1 --2- 172.21.15.67:0/3459421307 >> v2:172.21.15.97:3300/0 conn(0x7f323c0d3300 0x7f323c0cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323bfff640 1 -- 172.21.15.67:0/3459421307 >> v2:172.21.15.97:3300/0 conn(0x7f323c0d3300 msgr2=0x7f323c0cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323bfff640 1 --2- 172.21.15.67:0/3459421307 >> v2:172.21.15.97:3300/0 conn(0x7f323c0d3300 0x7f323c0cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323bfff640 1 -- 172.21.15.67:0/3459421307 >> v1:172.21.15.97:6789/0 conn(0x7f323c0d4220 legacy=0x7f323c0d4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323bfff640 1 -- 172.21.15.67:0/3459421307 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c0d24e0 con 0x7f323c0b7300 2024-09-19T05:36:58.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f324177e640 1 --2- 172.21.15.67:0/3459421307 >> v2:172.21.15.97:3300/0 conn(0x7f323c0d3300 0x7f323c0cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:58.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323bfff640 1 --2- 172.21.15.67:0/3459421307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0b7300 0x7f323c0d2dc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f323c0b5f10 tx=0x7f322801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17af820ea8499f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323b7fe640 1 -- 172.21.15.67:0/3459421307 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280ab620 con 0x7f323c0b7300 2024-09-19T05:36:58.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323b7fe640 1 -- 172.21.15.67:0/3459421307 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280b0070 con 0x7f323c0b7300 2024-09-19T05:36:58.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.857+0000 7f323b7fe640 1 -- 172.21.15.67:0/3459421307 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280ab9e0 con 0x7f323c0b7300 2024-09-19T05:36:58.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- 172.21.15.67:0/3459421307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0b7300 msgr2=0x7f323c0d2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 --2- 172.21.15.67:0/3459421307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0b7300 0x7f323c0d2dc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f323c0b5f10 tx=0x7f322801c420 comp rx=0 tx=0).stop 2024-09-19T05:36:58.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- 172.21.15.67:0/3459421307 shutdown_connections 2024-09-19T05:36:58.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 --2- 172.21.15.67:0/3459421307 >> v2:172.21.15.97:3300/0 conn(0x7f323c0d3300 0x7f323c0cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 --2- 172.21.15.67:0/3459421307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0b7300 0x7f323c0d2dc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- 172.21.15.67:0/3459421307 >> 172.21.15.67:0/3459421307 conn(0x7f323c09d7f0 msgr2=0x7f323c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- 172.21.15.67:0/3459421307 shutdown_connections 2024-09-19T05:36:58.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- 172.21.15.67:0/3459421307 wait complete. 2024-09-19T05:36:58.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 Processor -- start 2024-09-19T05:36:58.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- start start 2024-09-19T05:36:58.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f323c0b7300 0x7f323c160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0d3300 0x7f323c0ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f323c0d4220 0x7f323c153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f323c0b5af0 con 0x7f323c0d3300 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f323c15e9c0 con 0x7f323c0d4220 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f323c0b5c70 con 0x7f323c0b7300 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f323bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0d3300 0x7f323c0ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f323bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0d3300 0x7f323c0ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54800/0 (socket says 172.21.15.67:54800) 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f323bfff640 1 -- 172.21.15.67:0/4187632033 learned_addr learned my addr 172.21.15.67:0/4187632033 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f324177e640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f323c0d4220 0x7f323c153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f3240f7d640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f323c0b7300 0x7f323c160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f323bfff640 1 -- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f323c0b7300 msgr2=0x7f323c160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f323bfff640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f323c0b7300 0x7f323c160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f323bfff640 1 -- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f323c0d4220 msgr2=0x7f323c153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f323bfff640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f323c0d4220 0x7f323c153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f323bfff640 1 -- 172.21.15.67:0/4187632033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c0d3f90 con 0x7f323c0d3300 2024-09-19T05:36:58.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f3240f7d640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f323c0b7300 0x7f323c160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:58.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f323bfff640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0d3300 0x7f323c0ccfa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f32280ad040 tx=0x7f322801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32397fa640 1 -- 172.21.15.67:0/4187632033 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280abd90 con 0x7f323c0d3300 2024-09-19T05:36:58.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32397fa640 1 -- 172.21.15.67:0/4187632033 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280be3f0 con 0x7f323c0d3300 2024-09-19T05:36:58.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- 172.21.15.67:0/4187632033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f323c15fad0 con 0x7f323c0d3300 2024-09-19T05:36:58.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32397fa640 1 -- 172.21.15.67:0/4187632033 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280be7c0 con 0x7f323c0d3300 2024-09-19T05:36:58.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.861+0000 7f32431e1640 1 -- 172.21.15.67:0/4187632033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f323c160050 con 0x7f323c0d3300 2024-09-19T05:36:58.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f32397fa640 1 -- 172.21.15.67:0/4187632033 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32280b43f0 con 0x7f323c0d3300 2024-09-19T05:36:58.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f32397fa640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32200678f0 0x7f3220069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f32397fa640 1 -- 172.21.15.67:0/4187632033 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f322811feb0 con 0x7f323c0d3300 2024-09-19T05:36:58.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f3240f7d640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32200678f0 0x7f3220069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f3240f7d640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32200678f0 0x7f3220069db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f323c1545a0 tx=0x7f3230008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f324629d000 1 Processor -- start 2024-09-19T05:36:58.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f324629d000 1 -- start start 2024-09-19T05:36:58.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f324629d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f324629d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e73fe1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f324629d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e73fe2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f324629d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563e73ec7f20 con 0x563e7402b090 2024-09-19T05:36:58.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f324629d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563e73e2fb70 con 0x563e7402b9b0 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f324629d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563e73dd5a80 con 0x563e73fe2150 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f3240f7d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f3240f7d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54804/0 (socket says 172.21.15.67:54804) 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.865+0000 7f3240f7d640 1 -- 172.21.15.67:0/3622773514 learned_addr learned my addr 172.21.15.67:0/3622773514 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f323bfff640 1 --2- 172.21.15.67:0/3622773514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e73fe1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324177e640 1 --2- 172.21.15.67:0/3622773514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e73fe2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f3240f7d640 1 -- 172.21.15.67:0/3622773514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 msgr2=0x563e73fe2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f3240f7d640 1 --2- 172.21.15.67:0/3622773514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e73fe2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f3240f7d640 1 -- 172.21.15.67:0/3622773514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 msgr2=0x563e73fe1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f3240f7d640 1 --2- 172.21.15.67:0/3622773514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e73fe1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f3240f7d640 1 -- 172.21.15.67:0/3622773514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e73e387e0 con 0x563e7402b090 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f3240f7d640 1 --2- 172.21.15.67:0/3622773514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402b470 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3230006fa0 tx=0x7f323000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab688ec70d4bd789 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f32267fc640 1 -- 172.21.15.67:0/3622773514 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230023070 con 0x563e7402b090 2024-09-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f32267fc640 1 -- 172.21.15.67:0/3622773514 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3230013d80 con 0x563e7402b090 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f32267fc640 1 -- 172.21.15.67:0/3622773514 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323001e640 con 0x563e7402b090 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- 172.21.15.67:0/3622773514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 msgr2=0x563e7402b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 --2- 172.21.15.67:0/3622773514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402b470 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3230006fa0 tx=0x7f323000f000 comp rx=0 tx=0).stop 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- 172.21.15.67:0/3622773514 shutdown_connections 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 --2- 172.21.15.67:0/3622773514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e73fe2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 --2- 172.21.15.67:0/3622773514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e73fe1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 --2- 172.21.15.67:0/3622773514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402b470 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- 172.21.15.67:0/3622773514 >> 172.21.15.67:0/3622773514 conn(0x563e73fde0d0 msgr2=0x563e73fe04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- 172.21.15.67:0/3622773514 shutdown_connections 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- 172.21.15.67:0/3622773514 wait complete. 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- start start 2024-09-19T05:36:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 Processor -- start 2024-09-19T05:36:58.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e74031df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b090 0x563e74032330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b9b0 0x563e74032870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563e73dc9be0 con 0x563e7402b9b0 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563e73e2bb30 con 0x563e7402b090 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563e73e6f740 con 0x563e73fe2150 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 10 client.0 _ll_register_callbacks cb 0x563e73ee2a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324177e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b9b0 0x563e74032870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324177e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b9b0 0x563e74032870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54806/0 (socket says 172.21.15.67:54806) 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324177e640 1 -- 172.21.15.67:0/40344251 learned_addr learned my addr 172.21.15.67:0/40344251 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f3240f7d640 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e74031df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f323bfff640 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b090 0x563e74032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324177e640 1 -- 172.21.15.67:0/40344251 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 msgr2=0x563e74031df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324177e640 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e74031df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324177e640 1 -- 172.21.15.67:0/40344251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b090 msgr2=0x563e74032330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324177e640 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b090 0x563e74032330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324177e640 1 -- 172.21.15.67:0/40344251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e73dd5cd0 con 0x563e7402b9b0 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324177e640 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b9b0 0x563e74032870 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f323400fb60 tx=0x7f323400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725846c039bab2ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f321b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f321b7fe640 1 -- 172.21.15.67:0/40344251 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234003ba0 con 0x563e7402b9b0 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f321b7fe640 1 -- 172.21.15.67:0/40344251 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f3234003d40 con 0x563e7402b9b0 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- 172.21.15.67:0/40344251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3230013d80 con 0x563e7402b9b0 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f321b7fe640 1 -- 172.21.15.67:0/40344251 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3234004020 con 0x563e7402b9b0 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 10 client.5580 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.869+0000 7f324629d000 1 -- 172.21.15.67:0/40344251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x563e73dcfb90 con 0x563e7402b9b0 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f321b7fe640 1 -- 172.21.15.67:0/40344251 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3230013d80 con 0x563e7402b9b0 2024-09-19T05:36:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f321b7fe640 1 -- 172.21.15.67:0/40344251 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f323401f050 con 0x563e7402b9b0 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 10 client.5580 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 10 client.5580 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 20 client.5580 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e7403a1c0 0x563e7403c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 4 client.5580 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 -- 172.21.15.67:0/40344251 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e73dca1b0 con 0x563e7403a1c0 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f3240f7d640 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e7403a1c0 0x563e7403c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f321b7fe640 10 client.5580 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f3240f7d640 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e7403a1c0 0x563e7403c5b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c032d0190f3047dd server_cookie=bfffea0a74bfd8ab in_seq=0 out_seq=0 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f321b7fe640 1 -- 172.21.15.67:0/40344251 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e73dca1b0 con 0x563e7403a1c0 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f321b7fe640 10 client.5580 handle_command_reply: tid=0 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 client.5580 shutdown 2024-09-19T05:36:58.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 -- 172.21.15.67:0/40344251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b9b0 msgr2=0x563e74032870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b9b0 0x563e74032870 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f323400fb60 tx=0x7f323400a7d0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 -- 172.21.15.67:0/40344251 shutdown_connections 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b9b0 0x563e74032870 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e7403a1c0 0x563e7403c5b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b090 0x563e74032330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 --2- 172.21.15.67:0/40344251 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e74031df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 -- 172.21.15.67:0/40344251 >> 172.21.15.67:0/40344251 conn(0x563e73fde0d0 msgr2=0x563e73fe0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f321b7fe640 0 client.5580 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 -- 172.21.15.67:0/40344251 shutdown_connections 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 1 -- 172.21.15.67:0/40344251 wait complete. 2024-09-19T05:36:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.873+0000 7f324629d000 20 client.5580 trim_cache size 0 max 16384 2024-09-19T05:36:58.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 Processor -- start 2024-09-19T05:36:58.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 -- start start 2024-09-19T05:36:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e7403fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e7402aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f323c204590 con 0x563e7402b090 2024-09-19T05:36:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f323c2035e0 con 0x563e7402b9b0 2024-09-19T05:36:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f323c156540 con 0x563e73fe2150 2024-09-19T05:36:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f323bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f323bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54816/0 (socket says 172.21.15.67:54816) 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f323bfff640 1 -- 172.21.15.67:0/2865408353 learned_addr learned my addr 172.21.15.67:0/2865408353 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324177e640 1 --2- 172.21.15.67:0/2865408353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e7402aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f323bfff640 1 -- 172.21.15.67:0/2865408353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 msgr2=0x563e7403fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f323bfff640 1 --2- 172.21.15.67:0/2865408353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e7403fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f323bfff640 1 -- 172.21.15.67:0/2865408353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 msgr2=0x563e7402aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f323bfff640 1 --2- 172.21.15.67:0/2865408353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e7402aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f323bfff640 1 -- 172.21.15.67:0/2865408353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e73dedbe0 con 0x563e7402b090 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f323bfff640 1 --2- 172.21.15.67:0/2865408353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402a500 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f322801c900 tx=0x7f32280191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259d4ddfde528afc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f3225ffb640 1 -- 172.21.15.67:0/2865408353 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322811c070 con 0x563e7402b090 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f3225ffb640 1 -- 172.21.15.67:0/2865408353 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280b0040 con 0x563e7402b090 2024-09-19T05:36:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f3225ffb640 1 -- 172.21.15.67:0/2865408353 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280f44e0 con 0x563e7402b090 2024-09-19T05:36:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 -- 172.21.15.67:0/2865408353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 msgr2=0x563e7402a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 --2- 172.21.15.67:0/2865408353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402a500 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f322801c900 tx=0x7f32280191c0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 -- 172.21.15.67:0/2865408353 shutdown_connections 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 --2- 172.21.15.67:0/2865408353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e7402aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 --2- 172.21.15.67:0/2865408353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e7402b090 0x563e7402a500 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 --2- 172.21.15.67:0/2865408353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e73fe2150 0x563e7403fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 -- 172.21.15.67:0/2865408353 >> 172.21.15.67:0/2865408353 conn(0x563e73fde0d0 msgr2=0x563e74029df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 -- 172.21.15.67:0/2865408353 shutdown_connections 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.889+0000 7f324629d000 1 -- 172.21.15.67:0/2865408353 wait complete. 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 -- start start 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 Processor -- start 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e73fe2150 0x563e7403f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e7402b090 0x563e7405a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e7405ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563e73e2bb30 con 0x563e73fe2150 2024-09-19T05:36:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f323c0cc340 con 0x563e7402b9b0 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563e73eff940 con 0x563e7402b090 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 10 client.0 _ll_register_callbacks cb 0x7f323c08ec90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f3240f7d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e73fe2150 0x563e7403f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f3240f7d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e73fe2150 0x563e7403f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54826/0 (socket says 172.21.15.67:54826) 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f3240f7d640 1 -- 172.21.15.67:0/976728555 learned_addr learned my addr 172.21.15.67:0/976728555 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f323bfff640 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e7402b090 0x563e7405a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324177e640 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e7405ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f3240f7d640 1 -- 172.21.15.67:0/976728555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e7402b090 msgr2=0x563e7405a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f3240f7d640 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e7402b090 0x563e7405a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f3240f7d640 1 -- 172.21.15.67:0/976728555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 msgr2=0x563e7405ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f3240f7d640 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e7405ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f3240f7d640 1 -- 172.21.15.67:0/976728555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e73eac0f0 con 0x563e73fe2150 2024-09-19T05:36:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f3240f7d640 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e73fe2150 0x563e7403f580 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3230021040 tx=0x7f3230004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb58bd5d10bbfb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f321b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f321b7fe640 1 -- 172.21.15.67:0/976728555 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230023040 con 0x563e73fe2150 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f321b7fe640 1 -- 172.21.15.67:0/976728555 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f32300041c0 con 0x563e73fe2150 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 -- 172.21.15.67:0/976728555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32280b0040 con 0x563e73fe2150 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f321b7fe640 1 -- 172.21.15.67:0/976728555 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f323003d050 con 0x563e73fe2150 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 10 client.5586 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 -- 172.21.15.67:0/976728555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x563e73dc7ca0 con 0x563e73fe2150 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f321b7fe640 1 -- 172.21.15.67:0/976728555 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280b0040 con 0x563e73fe2150 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f321b7fe640 1 -- 172.21.15.67:0/976728555 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f3230040020 con 0x563e73fe2150 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 10 client.5586 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 10 client.5586 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 20 client.5586 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e7405b320 0x563e7409e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:58.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 4 client.5586 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-19T05:36:58.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f324629d000 1 -- 172.21.15.67:0/976728555 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x563e74038e90 con 0x563e7405b320 2024-09-19T05:36:58.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f323bfff640 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e7405b320 0x563e7409e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:58.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f323bfff640 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e7405b320 0x563e7409e490 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a8fb503d72c0e1d server_cookie=82a016f82e09dd38 in_seq=0 out_seq=0 2024-09-19T05:36:58.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.893+0000 7f321b7fe640 10 client.5586 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f321b7fe640 1 -- 172.21.15.67:0/976728555 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563e74038e90 con 0x563e7405b320 2024-09-19T05:36:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f321b7fe640 10 client.5586 handle_command_reply: tid=0 2024-09-19T05:36:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 client.5586 shutdown 2024-09-19T05:36:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 -- 172.21.15.67:0/976728555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e73fe2150 msgr2=0x563e7403f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e73fe2150 0x563e7403f580 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3230021040 tx=0x7f3230004700 comp rx=0 tx=0).stop 2024-09-19T05:36:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 -- 172.21.15.67:0/976728555 shutdown_connections 2024-09-19T05:36:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563e7405b320 0x563e7409e490 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563e7402b9b0 0x563e7405ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563e7402b090 0x563e7405a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f321b7fe640 0 client.5586 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:58.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 --2- 172.21.15.67:0/976728555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563e73fe2150 0x563e7403f580 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 -- 172.21.15.67:0/976728555 >> 172.21.15.67:0/976728555 conn(0x563e73fde0d0 msgr2=0x563e7402a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 -- 172.21.15.67:0/976728555 shutdown_connections 2024-09-19T05:36:58.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 1 -- 172.21.15.67:0/976728555 wait complete. 2024-09-19T05:36:58.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f324629d000 20 client.5586 trim_cache size 0 max 16384 2024-09-19T05:36:58.904 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:58.904 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:36:58.904 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:36:58.904 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:58.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 -- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32200678f0 msgr2=0x7f3220069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32200678f0 0x7f3220069db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f323c1545a0 tx=0x7f3230008040 comp rx=0 tx=0).stop 2024-09-19T05:36:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 -- 172.21.15.67:0/4187632033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0d3300 msgr2=0x7f323c0ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0d3300 0x7f323c0ccfa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f32280ad040 tx=0x7f322801ac60 comp rx=0 tx=0).stop 2024-09-19T05:36:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 -- 172.21.15.67:0/4187632033 shutdown_connections 2024-09-19T05:36:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f323c0d4220 0x7f323c153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f323c0d3300 0x7f323c0ccfa0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32200678f0 0x7f3220069db0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 --2- 172.21.15.67:0/4187632033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f323c0b7300 0x7f323c160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 -- 172.21.15.67:0/4187632033 >> 172.21.15.67:0/4187632033 conn(0x7f323c09d7f0 msgr2=0x7f323c0b92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 -- 172.21.15.67:0/4187632033 shutdown_connections 2024-09-19T05:36:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:58.897+0000 7f32431e1640 1 -- 172.21.15.67:0/4187632033 wait complete. 2024-09-19T05:36:58.920 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' returned '{'message': '', 'return_code': 0}' 2024-09-19T05:36:58.920 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-19T05:36:58.920 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-19T05:36:59.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4c07c640 1 Processor -- start 2024-09-19T05:36:59.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4c07c640 1 -- start start 2024-09-19T05:36:59.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4c07c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1c44067a00 0x7f1c4406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4c07c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c44067fa0 con 0x7f1c4406d210 2024-09-19T05:36:59.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4c07c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c440b3bb0 con 0x7f1c4415c2b0 2024-09-19T05:36:59.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4c07c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1c440b4200 con 0x7f1c44067a00 2024-09-19T05:36:59.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4a619640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1c4406d210 0x7f1c440b4690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46718/0 (socket says 172.21.15.67:46718) 2024-09-19T05:36:59.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4a619640 1 -- 172.21.15.67:0/3130767181 learned_addr learned my addr 172.21.15.67:0/3130767181 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:59.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c49617640 1 --2- 172.21.15.67:0/3130767181 >> v2:172.21.15.97:3300/0 conn(0x7f1c44067a00 0x7f1c4406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350602529 0 0) 0x7f1c44067fa0 con 0x7f1c4406d210 2024-09-19T05:36:59.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c30003530 con 0x7f1c4406d210 2024-09-19T05:36:59.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3177072145 0 0) 0x7f1c30003530 con 0x7f1c4406d210 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 >> v2:172.21.15.97:3300/0 conn(0x7f1c44067a00 msgr2=0x7f1c4406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 --2- 172.21.15.67:0/3130767181 >> v2:172.21.15.97:3300/0 conn(0x7f1c44067a00 0x7f1c4406ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 >> v1:172.21.15.97:6789/0 conn(0x7f1c4415c2b0 legacy=0x7f1c440d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c440b3e90 con 0x7f1c4406d210 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1c40001680 con 0x7f1c4406d210 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 >> v1:172.21.15.67:6789/0 conn(0x7f1c4406d210 legacy=0x7f1c440b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c30003a10 0x7f1c30003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c30004810 0x7f1c30004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c300051d0 0x7f1c3000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1c440b4200 con 0x7f1c300051d0 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3000c0d0 con 0x7f1c30004810 2024-09-19T05:36:59.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3000c2d0 con 0x7f1c30003a10 2024-09-19T05:36:59.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4a619640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c300051d0 0x7f1c3000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c49e18640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c30003a10 0x7f1c30003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c49617640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c30004810 0x7f1c30004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4a619640 1 -- 172.21.15.67:0/3130767181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c30003a10 msgr2=0x7f1c30003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4a619640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c30003a10 0x7f1c30003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4a619640 1 -- 172.21.15.67:0/3130767181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c30004810 msgr2=0x7f1c30004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4a619640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c30004810 0x7f1c30004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.037+0000 7f1c4a619640 1 -- 172.21.15.67:0/3130767181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c30003530 con 0x7f1c300051d0 2024-09-19T05:36:59.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4a619640 1 -- 172.21.15.67:0/3130767181 reap_dead start 2024-09-19T05:36:59.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4a619640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c300051d0 0x7f1c3000b9d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000c110 tx=0x7f1c4001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b0ea0ab8e79e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40007c30 con 0x7f1c300051d0 2024-09-19T05:36:59.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c400a9070 con 0x7f1c300051d0 2024-09-19T05:36:59.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c48e16640 1 -- 172.21.15.67:0/3130767181 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40005d40 con 0x7f1c300051d0 2024-09-19T05:36:59.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4c07c640 1 -- 172.21.15.67:0/3130767181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c300051d0 msgr2=0x7f1c3000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4c07c640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c300051d0 0x7f1c3000b9d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000c110 tx=0x7f1c4001cba0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4c07c640 1 -- 172.21.15.67:0/3130767181 shutdown_connections 2024-09-19T05:36:59.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4c07c640 1 --2- 172.21.15.67:0/3130767181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c300051d0 0x7f1c3000b9d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4c07c640 1 -- 172.21.15.67:0/3130767181 >> 172.21.15.67:0/3130767181 conn(0x7f1c440727b0 msgr2=0x7f1c44072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4c07c640 1 -- 172.21.15.67:0/3130767181 shutdown_connections 2024-09-19T05:36:59.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4c07c640 1 -- 172.21.15.67:0/3130767181 wait complete. 2024-09-19T05:36:59.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4c07c640 1 Processor -- start 2024-09-19T05:36:59.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.041+0000 7f1c4c07c640 1 -- start start 2024-09-19T05:36:59.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4c07c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c300051d0 0x7f1c441f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4c07c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c44150740 0x7f1c440aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4c07c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c44150bc0 0x7f1c440adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4c07c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4406d060 con 0x7f1c44150bc0 2024-09-19T05:36:59.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4c07c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4406cee0 con 0x7f1c44150740 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4c07c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1c440d0120 con 0x7f1c300051d0 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4a619640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c44150bc0 0x7f1c440adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4a619640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c44150bc0 0x7f1c440adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54834/0 (socket says 172.21.15.67:54834) 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4a619640 1 -- 172.21.15.67:0/2160218807 learned_addr learned my addr 172.21.15.67:0/2160218807 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c49e18640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c300051d0 0x7f1c441f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c49617640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c44150740 0x7f1c440aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4a619640 1 -- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c300051d0 msgr2=0x7f1c441f1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4a619640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c300051d0 0x7f1c441f1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4a619640 1 -- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c44150740 msgr2=0x7f1c440aa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4a619640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c44150740 0x7f1c440aa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4a619640 1 -- 172.21.15.67:0/2160218807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c440ab8d0 con 0x7f1c44150bc0 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4a619640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c44150bc0 0x7f1c440adec0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1c4001c9d0 tx=0x7f1c30005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c3a7fc640 1 -- 172.21.15.67:0/2160218807 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c400b3070 con 0x7f1c44150bc0 2024-09-19T05:36:59.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c3a7fc640 1 -- 172.21.15.67:0/2160218807 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c40000ee0 con 0x7f1c44150bc0 2024-09-19T05:36:59.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4c07c640 1 -- 172.21.15.67:0/2160218807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c440abb40 con 0x7f1c44150bc0 2024-09-19T05:36:59.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c3a7fc640 1 -- 172.21.15.67:0/2160218807 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40004a50 con 0x7f1c44150bc0 2024-09-19T05:36:59.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c4c07c640 1 -- 172.21.15.67:0/2160218807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c440ac100 con 0x7f1c44150bc0 2024-09-19T05:36:59.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c3a7fc640 1 -- 172.21.15.67:0/2160218807 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c400b6070 con 0x7f1c44150bc0 2024-09-19T05:36:59.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c3a7fc640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1c280678c0 0x7f1c28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c3a7fc640 1 -- 172.21.15.67:0/2160218807 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1c4011e800 con 0x7f1c44150bc0 2024-09-19T05:36:59.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.045+0000 7f1c49e18640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1c280678c0 0x7f1c28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 Processor -- start 2024-09-19T05:36:59.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 -- start start 2024-09-19T05:36:59.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49e18640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1c280678c0 0x7f1c28069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0051f0 tx=0x7f1c3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c2311e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c2311e3c30 0x55c2311995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c231199b10 0x55c231199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c231081200 con 0x55c2311e3c30 2024-09-19T05:36:59.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55c230f84620 con 0x55c2311e3310 2024-09-19T05:36:59.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55c230fe6b80 con 0x55c231199b10 2024-09-19T05:36:59.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49617640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c2311e3c30 0x55c2311995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49617640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c2311e3c30 0x55c2311995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54838/0 (socket says 172.21.15.67:54838) 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49617640 1 -- 172.21.15.67:0/1216554288 learned_addr learned my addr 172.21.15.67:0/1216554288 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4a619640 1 --2- 172.21.15.67:0/1216554288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c231199b10 0x55c231199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49e18640 1 --2- 172.21.15.67:0/1216554288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c2311e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49617640 1 -- 172.21.15.67:0/1216554288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c231199b10 msgr2=0x55c231199ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49617640 1 --2- 172.21.15.67:0/1216554288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c231199b10 0x55c231199ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49617640 1 -- 172.21.15.67:0/1216554288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 msgr2=0x55c2311e36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49617640 1 --2- 172.21.15.67:0/1216554288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c2311e36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49617640 1 -- 172.21.15.67:0/1216554288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c230fc3470 con 0x55c2311e3c30 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c49617640 1 --2- 172.21.15.67:0/1216554288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c2311e3c30 0x55c2311995d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1c340099c0 tx=0x7f1c34009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2dba1ad776797 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c277fe640 1 -- 172.21.15.67:0/1216554288 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3401a070 con 0x55c2311e3c30 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c277fe640 1 -- 172.21.15.67:0/1216554288 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c34004230 con 0x55c2311e3c30 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c277fe640 1 -- 172.21.15.67:0/1216554288 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34013980 con 0x55c2311e3c30 2024-09-19T05:36:59.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 -- 172.21.15.67:0/1216554288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c2311e3c30 msgr2=0x55c2311995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 --2- 172.21.15.67:0/1216554288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c2311e3c30 0x55c2311995d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1c340099c0 tx=0x7f1c34009190 comp rx=0 tx=0).stop 2024-09-19T05:36:59.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 -- 172.21.15.67:0/1216554288 shutdown_connections 2024-09-19T05:36:59.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 --2- 172.21.15.67:0/1216554288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c231199b10 0x55c231199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 --2- 172.21.15.67:0/1216554288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c2311e3c30 0x55c2311995d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 --2- 172.21.15.67:0/1216554288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c2311e36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 -- 172.21.15.67:0/1216554288 >> 172.21.15.67:0/1216554288 conn(0x55c23119fc70 msgr2=0x55c231197eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 -- 172.21.15.67:0/1216554288 shutdown_connections 2024-09-19T05:36:59.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 -- 172.21.15.67:0/1216554288 wait complete. 2024-09-19T05:36:59.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 -- start start 2024-09-19T05:36:59.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.049+0000 7f1c4f138000 1 Processor -- start 2024-09-19T05:36:59.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c2311e2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c23119d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3c30 0x55c23119df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c230fe2b40 con 0x55c231199b10 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55c230f8c350 con 0x55c2311e3310 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55c230f805b0 con 0x55c2311e3c30 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 10 client.0 _ll_register_callbacks cb 0x55c231049490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49e18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c2311e2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49e18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c2311e2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54846/0 (socket says 172.21.15.67:54846) 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49e18640 1 -- 172.21.15.67:0/2520103712 learned_addr learned my addr 172.21.15.67:0/2520103712 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4a619640 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3c30 0x55c23119df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49617640 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c23119d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49e18640 1 -- 172.21.15.67:0/2520103712 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3c30 msgr2=0x55c23119df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49e18640 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3c30 0x55c23119df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49e18640 1 -- 172.21.15.67:0/2520103712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 msgr2=0x55c23119d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49e18640 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c23119d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49e18640 1 -- 172.21.15.67:0/2520103712 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c23102d250 con 0x55c231199b10 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49e18640 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c2311e2d50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c014680 tx=0x7f1c3c0014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623313fc85ffa976 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c24ff9640 1 -- 172.21.15.67:0/2520103712 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c013570 con 0x55c231199b10 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c24ff9640 1 -- 172.21.15.67:0/2520103712 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1c3c0248e0 con 0x55c231199b10 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- 172.21.15.67:0/2520103712 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c34004230 con 0x55c231199b10 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c24ff9640 1 -- 172.21.15.67:0/2520103712 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1c3c024ae0 con 0x55c231199b10 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 10 client.5598 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- 172.21.15.67:0/2520103712 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55c230f8cca0 con 0x55c231199b10 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c24ff9640 1 -- 172.21.15.67:0/2520103712 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c34004230 con 0x55c231199b10 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c24ff9640 1 -- 172.21.15.67:0/2520103712 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f1c3c024c80 con 0x55c231199b10 2024-09-19T05:36:59.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 10 client.5598 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 10 client.5598 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 20 client.5598 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c23119ec90 0x55c2311f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 4 client.5598 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- 172.21.15.67:0/2520103712 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c230f80d60 con 0x55c23119ec90 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49617640 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c23119ec90 0x55c2311f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c49617640 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c23119ec90 0x55c2311f35b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a2ea7eaf16c34a0 server_cookie=bf74bcf5947352b0 in_seq=0 out_seq=0 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c24ff9640 10 client.5598 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c24ff9640 1 -- 172.21.15.67:0/2520103712 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c230f80d60 con 0x55c23119ec90 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c24ff9640 10 client.5598 handle_command_reply: tid=0 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 client.5598 shutdown 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- 172.21.15.67:0/2520103712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 msgr2=0x55c2311e2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c2311e2d50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c014680 tx=0x7f1c3c0014b0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- 172.21.15.67:0/2520103712 shutdown_connections 2024-09-19T05:36:59.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3c30 0x55c23119df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c23119ec90 0x55c2311f35b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c23119d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 --2- 172.21.15.67:0/2520103712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c2311e2d50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c24ff9640 0 client.5598 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- 172.21.15.67:0/2520103712 >> 172.21.15.67:0/2520103712 conn(0x55c23119fc70 msgr2=0x55c2311985c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- 172.21.15.67:0/2520103712 shutdown_connections 2024-09-19T05:36:59.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 1 -- 172.21.15.67:0/2520103712 wait complete. 2024-09-19T05:36:59.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.053+0000 7f1c4f138000 20 client.5598 trim_cache size 0 max 16384 2024-09-19T05:36:59.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 Processor -- start 2024-09-19T05:36:59.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 -- start start 2024-09-19T05:36:59.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231255b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c231256040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3c30 0x55c231256580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1c441ff390 con 0x55c231199b10 2024-09-19T05:36:59.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1c441fe3f0 con 0x55c2311e3310 2024-09-19T05:36:59.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1c441fd750 con 0x55c2311e3c30 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c49e18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231255b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c49e18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231255b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54858/0 (socket says 172.21.15.67:54858) 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c49e18640 1 -- 172.21.15.67:0/4206921939 learned_addr learned my addr 172.21.15.67:0/4206921939 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c49e18640 1 -- 172.21.15.67:0/4206921939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3c30 msgr2=0x55c231256580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c49e18640 1 --2- 172.21.15.67:0/4206921939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3c30 0x55c231256580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c49e18640 1 -- 172.21.15.67:0/4206921939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 msgr2=0x55c231256040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c49617640 1 --2- 172.21.15.67:0/4206921939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c231256040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c49e18640 1 --2- 172.21.15.67:0/4206921939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c231256040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c49e18640 1 -- 172.21.15.67:0/4206921939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c230f865b0 con 0x55c231199b10 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c49e18640 1 --2- 172.21.15.67:0/4206921939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231255b00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0050d0 tx=0x7f1c3c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a26d67bcefc84db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c26ffd640 1 -- 172.21.15.67:0/4206921939 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c013570 con 0x55c231199b10 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c26ffd640 1 -- 172.21.15.67:0/4206921939 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3c014e50 con 0x55c231199b10 2024-09-19T05:36:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c26ffd640 1 -- 172.21.15.67:0/4206921939 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c001fe0 con 0x55c231199b10 2024-09-19T05:36:59.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 -- 172.21.15.67:0/4206921939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 msgr2=0x55c231255b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 --2- 172.21.15.67:0/4206921939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231255b00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0050d0 tx=0x7f1c3c01c000 comp rx=0 tx=0).stop 2024-09-19T05:36:59.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 -- 172.21.15.67:0/4206921939 shutdown_connections 2024-09-19T05:36:59.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 --2- 172.21.15.67:0/4206921939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3c30 0x55c231256580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 --2- 172.21.15.67:0/4206921939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3310 0x55c231256040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 --2- 172.21.15.67:0/4206921939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231255b00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 -- 172.21.15.67:0/4206921939 >> 172.21.15.67:0/4206921939 conn(0x55c23119fc70 msgr2=0x55c23119d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 -- 172.21.15.67:0/4206921939 shutdown_connections 2024-09-19T05:36:59.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.073+0000 7f1c4f138000 1 -- 172.21.15.67:0/4206921939 wait complete. 2024-09-19T05:36:59.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 -- start start 2024-09-19T05:36:59.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 Processor -- start 2024-09-19T05:36:59.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231259f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3310 0x55c23125a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3c30 0x55c231256790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c230f92c10 con 0x55c231199b10 2024-09-19T05:36:59.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1c441fdda0 con 0x55c2311e3c30 2024-09-19T05:36:59.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55c2311996a0 con 0x55c2311e3310 2024-09-19T05:36:59.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 10 client.0 _ll_register_callbacks cb 0x7f1c3c005830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49e18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231259f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49e18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231259f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54874/0 (socket says 172.21.15.67:54874) 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49e18640 1 -- 172.21.15.67:0/1789646498 learned_addr learned my addr 172.21.15.67:0/1789646498 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4a619640 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3c30 0x55c231256790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49e18640 1 -- 172.21.15.67:0/1789646498 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3310 msgr2=0x55c23125a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49617640 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3310 0x55c23125a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49e18640 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3310 0x55c23125a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49e18640 1 -- 172.21.15.67:0/1789646498 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3c30 msgr2=0x55c231256790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49e18640 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3c30 0x55c231256790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49e18640 1 -- 172.21.15.67:0/1789646498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c230f7a4e0 con 0x55c231199b10 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4a619640 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3c30 0x55c231256790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49e18640 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231259f30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00b040 tx=0x7f1c3c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ad8166555f4788 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c24ff9640 1 -- 172.21.15.67:0/1789646498 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c045060 con 0x55c231199b10 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c24ff9640 1 -- 172.21.15.67:0/1789646498 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1c3c013b30 con 0x55c231199b10 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 -- 172.21.15.67:0/1789646498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c3c014e50 con 0x55c231199b10 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c24ff9640 1 -- 172.21.15.67:0/1789646498 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1c3c04b050 con 0x55c231199b10 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 10 client.5604 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 -- 172.21.15.67:0/1789646498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55c230f7e690 con 0x55c231199b10 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c24ff9640 1 -- 172.21.15.67:0/1789646498 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3c014e50 con 0x55c231199b10 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c24ff9640 1 -- 172.21.15.67:0/1789646498 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f1c3c04e020 con 0x55c231199b10 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 10 client.5604 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 10 client.5604 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 20 client.5604 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c231256cd0 0x55c2312570b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 4 client.5604 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-19T05:36:59.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c4f138000 1 -- 172.21.15.67:0/1789646498 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55c230ff42b0 con 0x55c231256cd0 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49617640 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c231256cd0 0x55c2312570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c24ff9640 10 client.5604 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.077+0000 7f1c49617640 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c231256cd0 0x55c2312570b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a5e5402a44397a2 server_cookie=a04c711173f71387 in_seq=0 out_seq=0 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c24ff9640 1 -- 172.21.15.67:0/1789646498 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c230ff42b0 con 0x55c231256cd0 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c24ff9640 10 client.5604 handle_command_reply: tid=0 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 client.5604 shutdown 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 -- 172.21.15.67:0/1789646498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 msgr2=0x55c231259f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231259f30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00b040 tx=0x7f1c3c015000 comp rx=0 tx=0).stop 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 -- 172.21.15.67:0/1789646498 shutdown_connections 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c231256cd0 0x55c2312570b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c2311e3c30 0x55c231256790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c2311e3310 0x55c23125a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 --2- 172.21.15.67:0/1789646498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c231199b10 0x55c231259f30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c24ff9640 0 client.5604 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 -- 172.21.15.67:0/1789646498 >> 172.21.15.67:0/1789646498 conn(0x55c23119fc70 msgr2=0x55c23119d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 -- 172.21.15.67:0/1789646498 shutdown_connections 2024-09-19T05:36:59.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 1 -- 172.21.15.67:0/1789646498 wait complete. 2024-09-19T05:36:59.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4f138000 20 client.5604 trim_cache size 0 max 16384 2024-09-19T05:36:59.089 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:59.089 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:36:59.089 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "c8692f94-2318-45ff-b788-df3d5a7df3b4", 2024-09-19T05:36:59.089 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:36:59.089 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:59.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 -- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1c280678c0 msgr2=0x7f1c28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1c280678c0 0x7f1c28069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0051f0 tx=0x7f1c3c009040 comp rx=0 tx=0).stop 2024-09-19T05:36:59.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 -- 172.21.15.67:0/2160218807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c44150bc0 msgr2=0x7f1c440adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c44150bc0 0x7f1c440adec0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1c4001c9d0 tx=0x7f1c30005840 comp rx=0 tx=0).stop 2024-09-19T05:36:59.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 -- 172.21.15.67:0/2160218807 shutdown_connections 2024-09-19T05:36:59.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c44150bc0 0x7f1c440adec0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c44150740 0x7f1c440aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1c280678c0 0x7f1c28069d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 --2- 172.21.15.67:0/2160218807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1c300051d0 0x7f1c441f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 -- 172.21.15.67:0/2160218807 >> 172.21.15.67:0/2160218807 conn(0x7f1c440727b0 msgr2=0x7f1c440b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 -- 172.21.15.67:0/2160218807 shutdown_connections 2024-09-19T05:36:59.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.081+0000 7f1c4c07c640 1 -- 172.21.15.67:0/2160218807 wait complete. 2024-09-19T05:36:59.102 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'c8692f94-2318-45ff-b788-df3d5a7df3b4', 'mode': 'asynchronous'}' 2024-09-19T05:36:59.102 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-19T05:36:59.102 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-19T05:36:59.103 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-19T05:36:59.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e69d37640 1 Processor -- start 2024-09-19T05:36:59.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e69d37640 1 -- start start 2024-09-19T05:36:59.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e69d37640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e6415e690 0x7f2e640d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e69d37640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2e640d1590 0x7f2e6406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e69d37640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e640d35a0 con 0x7f2e640d4fb0 2024-09-19T05:36:59.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e69d37640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2e640d32c0 con 0x7f2e640d1590 2024-09-19T05:36:59.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e69d37640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6406d040 con 0x7f2e6415e690 2024-09-19T05:36:59.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e63fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2e640d1590 0x7f2e6406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e62ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2e640d4fb0 0x7f2e640d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46722/0 (socket says 172.21.15.67:46722) 2024-09-19T05:36:59.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e62ffd640 1 -- 172.21.15.67:0/2184386909 learned_addr learned my addr 172.21.15.67:0/2184386909 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:59.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e637fe640 1 --2- 172.21.15.67:0/2184386909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e6415e690 0x7f2e640d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e63fff640 1 -- 172.21.15.67:0/2184386909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e6415e690 msgr2=0x7f2e640d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e63fff640 1 --2- 172.21.15.67:0/2184386909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e6415e690 0x7f2e640d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e63fff640 1 -- 172.21.15.67:0/2184386909 >> v1:172.21.15.67:6789/0 conn(0x7f2e640d4fb0 legacy=0x7f2e640d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e63fff640 1 -- 172.21.15.67:0/2184386909 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6406d320 con 0x7f2e640d1590 2024-09-19T05:36:59.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.217+0000 7f2e627fc640 1 -- 172.21.15.67:0/2184386909 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841287318 0 0) 0x7f2e640d35a0 con 0x7f2e640d4fb0 2024-09-19T05:36:59.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e63fff640 1 --2- 172.21.15.67:0/2184386909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d1590 0x7f2e6406db20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0097c0 tx=0x7f2e5c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39d4e3b0a842732 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e627fc640 1 -- 172.21.15.67:0/2184386909 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0ab610 con 0x7f2e640d1590 2024-09-19T05:36:59.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e627fc640 1 -- 172.21.15.67:0/2184386909 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0b0070 con 0x7f2e640d1590 2024-09-19T05:36:59.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e627fc640 1 -- 172.21.15.67:0/2184386909 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0ab9d0 con 0x7f2e640d1590 2024-09-19T05:36:59.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e69d37640 1 -- 172.21.15.67:0/2184386909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d1590 msgr2=0x7f2e6406db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e69d37640 1 --2- 172.21.15.67:0/2184386909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d1590 0x7f2e6406db20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0097c0 tx=0x7f2e5c01c470 comp rx=0 tx=0).stop 2024-09-19T05:36:59.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e69d37640 1 -- 172.21.15.67:0/2184386909 shutdown_connections 2024-09-19T05:36:59.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e69d37640 1 --2- 172.21.15.67:0/2184386909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d1590 0x7f2e6406db20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e69d37640 1 --2- 172.21.15.67:0/2184386909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e6415e690 0x7f2e640d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e69d37640 1 -- 172.21.15.67:0/2184386909 >> 172.21.15.67:0/2184386909 conn(0x7f2e640d4490 msgr2=0x7f2e640d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e69d37640 1 -- 172.21.15.67:0/2184386909 shutdown_connections 2024-09-19T05:36:59.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.221+0000 7f2e69d37640 1 -- 172.21.15.67:0/2184386909 wait complete. 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e69d37640 1 Processor -- start 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e69d37640 1 -- start start 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e69d37640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e640d1590 0x7f2e6415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e69d37640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d4fb0 0x7f2e6415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e69d37640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e6415e690 0x7f2e640b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e69d37640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6406e9f0 con 0x7f2e640d4fb0 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e69d37640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6406e870 con 0x7f2e6415e690 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e69d37640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6406eb70 con 0x7f2e640d1590 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d4fb0 0x7f2e6415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d4fb0 0x7f2e6415cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54890/0 (socket says 172.21.15.67:54890) 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e62ffd640 1 -- 172.21.15.67:0/749333866 learned_addr learned my addr 172.21.15.67:0/749333866 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e637fe640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e640d1590 0x7f2e6415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e63fff640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e6415e690 0x7f2e640b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e62ffd640 1 -- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e640d1590 msgr2=0x7f2e6415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e640d1590 0x7f2e6415a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e62ffd640 1 -- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e6415e690 msgr2=0x7f2e640b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e6415e690 0x7f2e640b7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e62ffd640 1 -- 172.21.15.67:0/749333866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e640b26d0 con 0x7f2e640d4fb0 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d4fb0 0x7f2e6415cfb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00c4b0 tx=0x7f2e4c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e5bfff640 1 -- 172.21.15.67:0/749333866 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c018070 con 0x7f2e640d4fb0 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e5bfff640 1 -- 172.21.15.67:0/749333866 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c007500 con 0x7f2e640d4fb0 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e69d37640 1 -- 172.21.15.67:0/749333866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e640b1e30 con 0x7f2e640d4fb0 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e5bfff640 1 -- 172.21.15.67:0/749333866 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c004a30 con 0x7f2e640d4fb0 2024-09-19T05:36:59.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e69d37640 1 -- 172.21.15.67:0/749333866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e640b23f0 con 0x7f2e640d4fb0 2024-09-19T05:36:59.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e5bfff640 1 -- 172.21.15.67:0/749333866 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e4c01b070 con 0x7f2e640d4fb0 2024-09-19T05:36:59.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.225+0000 7f2e5bfff640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e440678c0 0x7f2e44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e5bfff640 1 -- 172.21.15.67:0/749333866 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f2e4c0850c0 con 0x7f2e640d4fb0 2024-09-19T05:36:59.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e637fe640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e440678c0 0x7f2e44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 Processor -- start 2024-09-19T05:36:59.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e637fe640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e440678c0 0x7f2e44069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e54003fd0 tx=0x7f2e540039a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 -- start start 2024-09-19T05:36:59.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be742bad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be74270b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742710b0 0x55be74271490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55be740bef60 con 0x55be742bb240 2024-09-19T05:36:59.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55be740645a0 con 0x55be742ba920 2024-09-19T05:36:59.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55be740baf20 con 0x55be742710b0 2024-09-19T05:36:59.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be74270b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be74270b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54892/0 (socket says 172.21.15.67:54892) 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e62ffd640 1 -- 172.21.15.67:0/3004731429 learned_addr learned my addr 172.21.15.67:0/3004731429 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e637fe640 1 --2- 172.21.15.67:0/3004731429 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be742bad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e63fff640 1 --2- 172.21.15.67:0/3004731429 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742710b0 0x55be74271490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e62ffd640 1 -- 172.21.15.67:0/3004731429 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742710b0 msgr2=0x55be74271490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/3004731429 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742710b0 0x55be74271490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e62ffd640 1 -- 172.21.15.67:0/3004731429 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 msgr2=0x55be742bad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/3004731429 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be742bad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e62ffd640 1 -- 172.21.15.67:0/3004731429 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be741055a0 con 0x55be742bb240 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e637fe640 1 --2- 172.21.15.67:0/3004731429 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be742bad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/3004731429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be74270b70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c085090 tx=0x7f2e4c055490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae20704d6edadeb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e597fa640 1 -- 172.21.15.67:0/3004731429 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c05e070 con 0x55be742bb240 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e597fa640 1 -- 172.21.15.67:0/3004731429 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c053790 con 0x55be742bb240 2024-09-19T05:36:59.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e597fa640 1 -- 172.21.15.67:0/3004731429 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c05dbe0 con 0x55be742bb240 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3004731429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 msgr2=0x55be74270b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/3004731429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be74270b70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c085090 tx=0x7f2e4c055490 comp rx=0 tx=0).stop 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3004731429 shutdown_connections 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/3004731429 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742710b0 0x55be74271490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/3004731429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be74270b70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/3004731429 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be742bad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3004731429 >> 172.21.15.67:0/3004731429 conn(0x55be7426d060 msgr2=0x55be7426f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3004731429 shutdown_connections 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3004731429 wait complete. 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 -- start start 2024-09-19T05:36:59.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.229+0000 7f2e6cdf3000 1 Processor -- start 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be742a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be74276360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742bb240 0x55be742768a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55be74055f10 con 0x55be742710b0 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55be7407ca20 con 0x55be742ba920 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55be74086660 con 0x55be742bb240 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 10 client.0 _ll_register_callbacks cb 0x55be74095d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be742a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be742a53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54902/0 (socket says 172.21.15.67:54902) 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e637fe640 1 -- 172.21.15.67:0/4215584249 learned_addr learned my addr 172.21.15.67:0/4215584249 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be74276360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e63fff640 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742bb240 0x55be742768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e637fe640 1 -- 172.21.15.67:0/4215584249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742bb240 msgr2=0x55be742768a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e637fe640 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742bb240 0x55be742768a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e637fe640 1 -- 172.21.15.67:0/4215584249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 msgr2=0x55be74276360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e637fe640 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be74276360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e637fe640 1 -- 172.21.15.67:0/4215584249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be740647f0 con 0x55be742710b0 2024-09-19T05:36:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be74276360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e637fe640 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be742a53f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2e54003bc0 tx=0x7f2e54004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4f24096451a4e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e427fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e427fc640 1 -- 172.21.15.67:0/4215584249 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54014ae0 con 0x55be742710b0 2024-09-19T05:36:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e427fc640 1 -- 172.21.15.67:0/4215584249 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f2e54014c80 con 0x55be742710b0 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/4215584249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e4c053790 con 0x55be742710b0 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e427fc640 1 -- 172.21.15.67:0/4215584249 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2e54021410 con 0x55be742710b0 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 10 client.5619 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/4215584249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55be7405ea60 con 0x55be742710b0 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e427fc640 1 -- 172.21.15.67:0/4215584249 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c053790 con 0x55be742710b0 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e427fc640 1 -- 172.21.15.67:0/4215584249 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f2e54030080 con 0x55be742710b0 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 10 client.5619 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 10 client.5619 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 20 client.5619 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55be742a6090 0x55be742a6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 4 client.5619 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/4215584249 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be74059210 con 0x55be742a6090 2024-09-19T05:36:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55be742a6090 0x55be742a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e427fc640 10 client.5619 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55be742a6090 0x55be742a6470 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42caa8d482fad609 server_cookie=abe8515892ca8a9b in_seq=0 out_seq=0 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e427fc640 1 -- 172.21.15.67:0/4215584249 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be74059210 con 0x55be742a6090 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e427fc640 10 client.5619 handle_command_reply: tid=0 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 client.5619 shutdown 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/4215584249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 msgr2=0x55be742a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be742a53f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2e54003bc0 tx=0x7f2e54004ac0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/4215584249 shutdown_connections 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742bb240 0x55be742768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55be742a6090 0x55be742a6470 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be74276360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/4215584249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be742a53f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e427fc640 0 client.5619 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/4215584249 >> 172.21.15.67:0/4215584249 conn(0x55be7426d060 msgr2=0x55be7426fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/4215584249 shutdown_connections 2024-09-19T05:36:59.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/4215584249 wait complete. 2024-09-19T05:36:59.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.233+0000 7f2e6cdf3000 20 client.5619 trim_cache size 0 max 16384 2024-09-19T05:36:59.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.249+0000 7f2e6cdf3000 1 Processor -- start 2024-09-19T05:36:59.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.249+0000 7f2e6cdf3000 1 -- start start 2024-09-19T05:36:59.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be74270460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be742709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742bb240 0x55be742cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2e64203c70 con 0x55be742710b0 2024-09-19T05:36:59.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2e64202cb0 con 0x55be742ba920 2024-09-19T05:36:59.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2e64153c30 con 0x55be742bb240 2024-09-19T05:36:59.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be74270460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be74270460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54916/0 (socket says 172.21.15.67:54916) 2024-09-19T05:36:59.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e637fe640 1 -- 172.21.15.67:0/1371572713 learned_addr learned my addr 172.21.15.67:0/1371572713 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e637fe640 1 -- 172.21.15.67:0/1371572713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742bb240 msgr2=0x55be742cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e637fe640 1 --2- 172.21.15.67:0/1371572713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742bb240 0x55be742cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e637fe640 1 -- 172.21.15.67:0/1371572713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 msgr2=0x55be742709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e637fe640 1 --2- 172.21.15.67:0/1371572713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be742709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e637fe640 1 -- 172.21.15.67:0/1371572713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be74141650 con 0x55be742710b0 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e637fe640 1 --2- 172.21.15.67:0/1371572713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be74270460 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004410 tx=0x7f2e5401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bb7212018feb15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e58ff9640 1 -- 172.21.15.67:0/1371572713 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54014ae0 con 0x55be742710b0 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e58ff9640 1 -- 172.21.15.67:0/1371572713 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e54014c80 con 0x55be742710b0 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e58ff9640 1 -- 172.21.15.67:0/1371572713 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54021b60 con 0x55be742710b0 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/1371572713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 msgr2=0x55be74270460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/1371572713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be74270460 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004410 tx=0x7f2e5401f000 comp rx=0 tx=0).stop 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/1371572713 shutdown_connections 2024-09-19T05:36:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/1371572713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742bb240 0x55be742cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/1371572713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742ba920 0x55be742709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/1371572713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742710b0 0x55be74270460 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/1371572713 >> 172.21.15.67:0/1371572713 conn(0x55be7426d060 msgr2=0x55be742d1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/1371572713 shutdown_connections 2024-09-19T05:36:59.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/1371572713 wait complete. 2024-09-19T05:36:59.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- start start 2024-09-19T05:36:59.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 Processor -- start 2024-09-19T05:36:59.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742710b0 0x55be7432da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742ba920 0x55be7432df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be7432e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55be74277250 con 0x55be742bb240 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2e64154280 con 0x55be742710b0 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55be7406ae60 con 0x55be742ba920 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 10 client.0 _ll_register_callbacks cb 0x7f2e54003c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e63fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be7432e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e63fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be7432e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54926/0 (socket says 172.21.15.67:54926) 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e63fff640 1 -- 172.21.15.67:0/3190201587 learned_addr learned my addr 172.21.15.67:0/3190201587 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e637fe640 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742710b0 0x55be7432da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742ba920 0x55be7432df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e63fff640 1 -- 172.21.15.67:0/3190201587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742ba920 msgr2=0x55be7432df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e63fff640 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742ba920 0x55be7432df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e63fff640 1 -- 172.21.15.67:0/3190201587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742710b0 msgr2=0x55be7432da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e63fff640 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742710b0 0x55be7432da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e63fff640 1 -- 172.21.15.67:0/3190201587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be74084120 con 0x55be742bb240 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e62ffd640 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742ba920 0x55be7432df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e63fff640 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be7432e490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c01c950 tx=0x7f2e5c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dc84d11db8b4e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e427fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e427fc640 1 -- 172.21.15.67:0/3190201587 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c006e20 con 0x55be742bb240 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e427fc640 1 -- 172.21.15.67:0/3190201587 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f2e5c0ab9f0 con 0x55be742bb240 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.253+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3190201587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e54014c80 con 0x55be742bb240 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e427fc640 1 -- 172.21.15.67:0/3190201587 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2e5c0c9050 con 0x55be742bb240 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e6cdf3000 10 client.5625 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3190201587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55be74056a20 con 0x55be742bb240 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e427fc640 1 -- 172.21.15.67:0/3190201587 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e54014c80 con 0x55be742bb240 2024-09-19T05:36:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e427fc640 1 -- 172.21.15.67:0/3190201587 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f2e5c0cc020 con 0x55be742bb240 2024-09-19T05:36:59.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e6cdf3000 10 client.5625 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:59.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e6cdf3000 10 client.5625 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:59.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e6cdf3000 20 client.5625 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:59.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55be742d03d0 0x55be742d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e6cdf3000 4 client.5625 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-19T05:36:59.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3190201587 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55be740cc690 con 0x55be742d03d0 2024-09-19T05:36:59.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e637fe640 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55be742d03d0 0x55be742d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e637fe640 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55be742d03d0 0x55be742d07e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=115f5327cd1bd509 server_cookie=a99b88b19deb12f9 in_seq=0 out_seq=0 2024-09-19T05:36:59.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.257+0000 7f2e427fc640 10 client.5625 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e427fc640 1 -- 172.21.15.67:0/3190201587 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55be740cc690 con 0x55be742d03d0 2024-09-19T05:36:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e427fc640 10 client.5625 handle_command_reply: tid=0 2024-09-19T05:36:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 client.5625 shutdown 2024-09-19T05:36:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3190201587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 msgr2=0x55be7432e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be7432e490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c01c950 tx=0x7f2e5c019210 comp rx=0 tx=0).stop 2024-09-19T05:36:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3190201587 shutdown_connections 2024-09-19T05:36:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be742bb240 0x55be7432e490 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55be742ba920 0x55be7432df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55be742d03d0 0x55be742d07e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 --2- 172.21.15.67:0/3190201587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55be742710b0 0x55be7432da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3190201587 >> 172.21.15.67:0/3190201587 conn(0x55be7426d060 msgr2=0x55be7426f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e427fc640 0 client.5625 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3190201587 shutdown_connections 2024-09-19T05:36:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 1 -- 172.21.15.67:0/3190201587 wait complete. 2024-09-19T05:36:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e6cdf3000 20 client.5625 trim_cache size 0 max 16384 2024-09-19T05:36:59.268 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:59.268 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:36:59.268 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:36:59.268 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:59.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 -- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e440678c0 msgr2=0x7f2e44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e440678c0 0x7f2e44069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e54003fd0 tx=0x7f2e540039a0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 -- 172.21.15.67:0/749333866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d4fb0 msgr2=0x7f2e6415cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d4fb0 0x7f2e6415cfb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00c4b0 tx=0x7f2e4c00c970 comp rx=0 tx=0).stop 2024-09-19T05:36:59.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 -- 172.21.15.67:0/749333866 shutdown_connections 2024-09-19T05:36:59.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e6415e690 0x7f2e640b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e640d4fb0 0x7f2e6415cfb0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e440678c0 0x7f2e44069d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 --2- 172.21.15.67:0/749333866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e640d1590 0x7f2e6415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 -- 172.21.15.67:0/749333866 >> 172.21.15.67:0/749333866 conn(0x7f2e640d4490 msgr2=0x7f2e640b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 -- 172.21.15.67:0/749333866 shutdown_connections 2024-09-19T05:36:59.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.261+0000 7f2e69d37640 1 -- 172.21.15.67:0/749333866 wait complete. 2024-09-19T05:36:59.282 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'message': '', 'return_code': 0}' 2024-09-19T05:36:59.282 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-19T05:36:59.282 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-19T05:36:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f290adc8640 1 Processor -- start 2024-09-19T05:36:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f290adc8640 1 -- start start 2024-09-19T05:36:59.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f290adc8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f290406ffd0 0x7f29040aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f290adc8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29040ad840 con 0x7f2904159c60 2024-09-19T05:36:59.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f290adc8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f290415a040 con 0x7f29040b3150 2024-09-19T05:36:59.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f290adc8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f290415d460 con 0x7f290406ffd0 2024-09-19T05:36:59.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f2903fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f290406ffd0 0x7f29040aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f2908b64640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2904159c60 0x7f29040ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46730/0 (socket says 172.21.15.67:46730) 2024-09-19T05:36:59.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f2908b64640 1 -- 172.21.15.67:0/3489503939 learned_addr learned my addr 172.21.15.67:0/3489503939 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:59.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f2903fff640 1 -- 172.21.15.67:0/3489503939 >> v1:172.21.15.97:6789/0 conn(0x7f29040b3150 legacy=0x7f290415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f2903fff640 1 -- 172.21.15.67:0/3489503939 >> v1:172.21.15.67:6789/0 conn(0x7f2904159c60 legacy=0x7f29040ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.397+0000 7f2903fff640 1 -- 172.21.15.67:0/3489503939 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290415c850 con 0x7f290406ffd0 2024-09-19T05:36:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f2903fff640 1 --2- 172.21.15.67:0/3489503939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f290406ffd0 0x7f29040aec90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f28f40097c0 tx=0x7f28f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d572878f4e7ed50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f29037fe640 1 -- 172.21.15.67:0/3489503939 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40a7070 con 0x7f290406ffd0 2024-09-19T05:36:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f29037fe640 1 -- 172.21.15.67:0/3489503939 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f40b0070 con 0x7f290406ffd0 2024-09-19T05:36:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f29037fe640 1 -- 172.21.15.67:0/3489503939 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40ab890 con 0x7f290406ffd0 2024-09-19T05:36:59.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f290adc8640 1 -- 172.21.15.67:0/3489503939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f290406ffd0 msgr2=0x7f29040aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f290adc8640 1 --2- 172.21.15.67:0/3489503939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f290406ffd0 0x7f29040aec90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f28f40097c0 tx=0x7f28f401c470 comp rx=0 tx=0).stop 2024-09-19T05:36:59.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f290adc8640 1 -- 172.21.15.67:0/3489503939 shutdown_connections 2024-09-19T05:36:59.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f290adc8640 1 --2- 172.21.15.67:0/3489503939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f290406ffd0 0x7f29040aec90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f290adc8640 1 -- 172.21.15.67:0/3489503939 >> 172.21.15.67:0/3489503939 conn(0x7f29040b1e50 msgr2=0x7f29040b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f290adc8640 1 -- 172.21.15.67:0/3489503939 shutdown_connections 2024-09-19T05:36:59.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f290adc8640 1 -- 172.21.15.67:0/3489503939 wait complete. 2024-09-19T05:36:59.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f290adc8640 1 Processor -- start 2024-09-19T05:36:59.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.401+0000 7f290adc8640 1 -- start start 2024-09-19T05:36:59.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f290adc8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f290406ffd0 0x7f290409a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f290adc8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29040b3150 0x7f29040b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f290adc8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2904159c60 0x7f2904099430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f290adc8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2904169e40 con 0x7f2904159c60 2024-09-19T05:36:59.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f290adc8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f29040af5e0 con 0x7f29040b3150 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f290adc8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2904169fc0 con 0x7f290406ffd0 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2909365640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2904159c60 0x7f2904099430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2909365640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2904159c60 0x7f2904099430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54946/0 (socket says 172.21.15.67:54946) 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2909365640 1 -- 172.21.15.67:0/1803231976 learned_addr learned my addr 172.21.15.67:0/1803231976 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2903fff640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29040b3150 0x7f29040b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2908b64640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f290406ffd0 0x7f290409a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2909365640 1 -- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f290406ffd0 msgr2=0x7f290409a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2909365640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f290406ffd0 0x7f290409a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2909365640 1 -- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29040b3150 msgr2=0x7f29040b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2909365640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29040b3150 0x7f29040b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2909365640 1 -- 172.21.15.67:0/1803231976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290409a7f0 con 0x7f2904159c60 2024-09-19T05:36:59.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2908b64640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f290406ffd0 0x7f290409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:59.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f2909365640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2904159c60 0x7f2904099430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00c770 tx=0x7f28fc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f29017fa640 1 -- 172.21.15.67:0/1803231976 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc003b80 con 0x7f2904159c60 2024-09-19T05:36:59.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f29017fa640 1 -- 172.21.15.67:0/1803231976 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28fc003d20 con 0x7f2904159c60 2024-09-19T05:36:59.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f290adc8640 1 -- 172.21.15.67:0/1803231976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2904072620 con 0x7f2904159c60 2024-09-19T05:36:59.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f29017fa640 1 -- 172.21.15.67:0/1803231976 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc00aa90 con 0x7f2904159c60 2024-09-19T05:36:59.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f290adc8640 1 -- 172.21.15.67:0/1803231976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2904072be0 con 0x7f2904159c60 2024-09-19T05:36:59.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f29017fa640 1 -- 172.21.15.67:0/1803231976 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28fc00ac30 con 0x7f2904159c60 2024-09-19T05:36:59.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f29017fa640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f00678c0 0x7f28f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.405+0000 7f29017fa640 1 -- 172.21.15.67:0/1803231976 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f28fc085dd0 con 0x7f2904159c60 2024-09-19T05:36:59.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2908b64640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f00678c0 0x7f28f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 Processor -- start 2024-09-19T05:36:59.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 -- start start 2024-09-19T05:36:59.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2908b64640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f00678c0 0x7f28f0069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f28f8005890 tx=0x7f28f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905450 0x55c042905830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428b93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c0428b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c042709fd0 con 0x55c042905d70 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55c0426af6b0 con 0x55c0428b98e0 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55c042705f90 con 0x55c042905450 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2903fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428b93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2903fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428b93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54960/0 (socket says 172.21.15.67:54960) 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2903fff640 1 -- 172.21.15.67:0/1876160275 learned_addr learned my addr 172.21.15.67:0/1876160275 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2908b64640 1 --2- 172.21.15.67:0/1876160275 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905450 0x55c042905830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2909365640 1 --2- 172.21.15.67:0/1876160275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c0428b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2903fff640 1 -- 172.21.15.67:0/1876160275 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905450 msgr2=0x55c042905830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2903fff640 1 --2- 172.21.15.67:0/1876160275 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905450 0x55c042905830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2903fff640 1 -- 172.21.15.67:0/1876160275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 msgr2=0x55c0428b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2903fff640 1 --2- 172.21.15.67:0/1876160275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c0428b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2903fff640 1 -- 172.21.15.67:0/1876160275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0426af900 con 0x55c042905d70 2024-09-19T05:36:59.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f2903fff640 1 --2- 172.21.15.67:0/1876160275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428b93a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f28f4019080 tx=0x7f28f4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a7324a8710ffdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f28ea7fc640 1 -- 172.21.15.67:0/1876160275 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40ab9b0 con 0x55c042905d70 2024-09-19T05:36:59.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f28ea7fc640 1 -- 172.21.15.67:0/1876160275 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f40b0040 con 0x55c042905d70 2024-09-19T05:36:59.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f28ea7fc640 1 -- 172.21.15.67:0/1876160275 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40abd90 con 0x55c042905d70 2024-09-19T05:36:59.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 -- 172.21.15.67:0/1876160275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 msgr2=0x55c0428b93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 --2- 172.21.15.67:0/1876160275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428b93a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f28f4019080 tx=0x7f28f4004740 comp rx=0 tx=0).stop 2024-09-19T05:36:59.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 -- 172.21.15.67:0/1876160275 shutdown_connections 2024-09-19T05:36:59.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 --2- 172.21.15.67:0/1876160275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c0428b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 --2- 172.21.15.67:0/1876160275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428b93a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 --2- 172.21.15.67:0/1876160275 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905450 0x55c042905830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 -- 172.21.15.67:0/1876160275 >> 172.21.15.67:0/1876160275 conn(0x55c0423ccfc0 msgr2=0x55c0428e8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 -- 172.21.15.67:0/1876160275 shutdown_connections 2024-09-19T05:36:59.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 -- 172.21.15.67:0/1876160275 wait complete. 2024-09-19T05:36:59.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 -- start start 2024-09-19T05:36:59.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.409+0000 7f290de84000 1 Processor -- start 2024-09-19T05:36:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c0428e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905450 0x55c0428e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428e7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c04270e600 con 0x55c042905d70 2024-09-19T05:36:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55c0426c7aa0 con 0x55c0428b98e0 2024-09-19T05:36:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55c0426a0ed0 con 0x55c042905450 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 10 client.0 _ll_register_callbacks cb 0x55c0428a6e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2909365640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2909365640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428e7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54970/0 (socket says 172.21.15.67:54970) 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2909365640 1 -- 172.21.15.67:0/2567240187 learned_addr learned my addr 172.21.15.67:0/2567240187 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2903fff640 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905450 0x55c0428e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2908b64640 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c0428e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2909365640 1 -- 172.21.15.67:0/2567240187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905450 msgr2=0x55c0428e6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2909365640 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905450 0x55c0428e6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2909365640 1 -- 172.21.15.67:0/2567240187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 msgr2=0x55c0428e68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2909365640 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c0428e68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2909365640 1 -- 172.21.15.67:0/2567240187 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0426a9a20 con 0x55c042905d70 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2909365640 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428e7370 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f28fc084140 tx=0x7f28fc056890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9575af1a6cc9933 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f28e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f28e37fe640 1 -- 172.21.15.67:0/2567240187 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc05ec30 con 0x55c042905d70 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f28e37fe640 1 -- 172.21.15.67:0/2567240187 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f28fc0526c0 con 0x55c042905d70 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- 172.21.15.67:0/2567240187 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f40b0040 con 0x55c042905d70 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f28e37fe640 1 -- 172.21.15.67:0/2567240187 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f28fc05a050 con 0x55c042905d70 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 10 client.5640 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- 172.21.15.67:0/2567240187 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55c0426914a0 con 0x55c042905d70 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f28e37fe640 1 -- 172.21.15.67:0/2567240187 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f40b0040 con 0x55c042905d70 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f28e37fe640 1 -- 172.21.15.67:0/2567240187 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f28fc0554a0 con 0x55c042905d70 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 10 client.5640 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 10 client.5640 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 20 client.5640 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c0429144e0 0x55c0429168d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 4 client.5640 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:59.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- 172.21.15.67:0/2567240187 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0426a41d0 con 0x55c0429144e0 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2908b64640 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c0429144e0 0x55c0429168d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f28e37fe640 10 client.5640 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f2908b64640 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c0429144e0 0x55c0429168d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9286348007ab0ed7 server_cookie=8e975bc42bb83076 in_seq=0 out_seq=0 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f28e37fe640 1 -- 172.21.15.67:0/2567240187 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c0426a41d0 con 0x55c0429144e0 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f28e37fe640 10 client.5640 handle_command_reply: tid=0 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 client.5640 shutdown 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- 172.21.15.67:0/2567240187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 msgr2=0x55c0428e7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428e7370 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f28fc084140 tx=0x7f28fc056890 comp rx=0 tx=0).stop 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- 172.21.15.67:0/2567240187 shutdown_connections 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905d70 0x55c0428e7370 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905450 0x55c0428e6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c0429144e0 0x55c0429168d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 --2- 172.21.15.67:0/2567240187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c0428e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- 172.21.15.67:0/2567240187 >> 172.21.15.67:0/2567240187 conn(0x55c0423ccfc0 msgr2=0x55c0428b8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f28e37fe640 0 client.5640 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- 172.21.15.67:0/2567240187 shutdown_connections 2024-09-19T05:36:59.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 1 -- 172.21.15.67:0/2567240187 wait complete. 2024-09-19T05:36:59.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.413+0000 7f290de84000 20 client.5640 trim_cache size 0 max 16384 2024-09-19T05:36:59.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f290de84000 1 Processor -- start 2024-09-19T05:36:59.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f290de84000 1 -- start start 2024-09-19T05:36:59.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f290de84000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c0428b98e0 0x55c0428c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f290de84000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c042905450 0x55c0428c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f290de84000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905d70 0x55c0428c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f290de84000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2904204420 con 0x55c0428b98e0 2024-09-19T05:36:59.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f290de84000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2904203460 con 0x55c042905450 2024-09-19T05:36:59.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f290de84000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f290415e830 con 0x55c042905d70 2024-09-19T05:36:59.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f2908b64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c0428b98e0 0x55c0428c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f2908b64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c0428b98e0 0x55c0428c0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54976/0 (socket says 172.21.15.67:54976) 2024-09-19T05:36:59.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f2908b64640 1 -- 172.21.15.67:0/823251584 learned_addr learned my addr 172.21.15.67:0/823251584 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f2908b64640 1 -- 172.21.15.67:0/823251584 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905d70 msgr2=0x55c0428c0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f2908b64640 1 --2- 172.21.15.67:0/823251584 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905d70 0x55c0428c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f2908b64640 1 -- 172.21.15.67:0/823251584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c042905450 msgr2=0x55c0428c07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f2908b64640 1 --2- 172.21.15.67:0/823251584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c042905450 0x55c0428c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f2908b64640 1 -- 172.21.15.67:0/823251584 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0426ae590 con 0x55c0428b98e0 2024-09-19T05:36:59.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f2908b64640 1 --2- 172.21.15.67:0/823251584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c0428b98e0 0x55c0428c0290 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55c0426c2250 tx=0x7f28f8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebb35ef6eb9f690 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f28e9ffb640 1 -- 172.21.15.67:0/823251584 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8027040 con 0x55c0428b98e0 2024-09-19T05:36:59.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f28e9ffb640 1 -- 172.21.15.67:0/823251584 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f80075e0 con 0x55c0428b98e0 2024-09-19T05:36:59.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.433+0000 7f28e9ffb640 1 -- 172.21.15.67:0/823251584 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f800d9a0 con 0x55c0428b98e0 2024-09-19T05:36:59.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- 172.21.15.67:0/823251584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c0428b98e0 msgr2=0x55c0428c0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 --2- 172.21.15.67:0/823251584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c0428b98e0 0x55c0428c0290 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55c0426c2250 tx=0x7f28f8011000 comp rx=0 tx=0).stop 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- 172.21.15.67:0/823251584 shutdown_connections 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 --2- 172.21.15.67:0/823251584 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905d70 0x55c0428c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 --2- 172.21.15.67:0/823251584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c042905450 0x55c0428c07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 --2- 172.21.15.67:0/823251584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c0428b98e0 0x55c0428c0290 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- 172.21.15.67:0/823251584 >> 172.21.15.67:0/823251584 conn(0x55c0423ccfc0 msgr2=0x55c0428e63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- 172.21.15.67:0/823251584 shutdown_connections 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- 172.21.15.67:0/823251584 wait complete. 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- start start 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 Processor -- start 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c042978d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905450 0x55c042979240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905d70 0x55c042918c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c0427092e0 con 0x55c042905450 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2904202e90 con 0x55c0428b98e0 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55c04270e600 con 0x55c042905d70 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 10 client.0 _ll_register_callbacks cb 0x7f28fc00cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2903fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905450 0x55c042979240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2903fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905450 0x55c042979240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54990/0 (socket says 172.21.15.67:54990) 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2903fff640 1 -- 172.21.15.67:0/1712439875 learned_addr learned my addr 172.21.15.67:0/1712439875 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2909365640 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905d70 0x55c042918c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2903fff640 1 -- 172.21.15.67:0/1712439875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905d70 msgr2=0x55c042918c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2903fff640 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905d70 0x55c042918c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2908b64640 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c042978d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2903fff640 1 -- 172.21.15.67:0/1712439875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 msgr2=0x55c042978d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2903fff640 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c042978d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2903fff640 1 -- 172.21.15.67:0/1712439875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c04278e720 con 0x55c042905450 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2903fff640 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905450 0x55c042979240 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f28f4008010 tx=0x7f28f4019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bad6b8abe42f87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f28e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f28e37fe640 1 -- 172.21.15.67:0/1712439875 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40ab9b0 con 0x55c042905450 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f28e37fe640 1 -- 172.21.15.67:0/1712439875 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f28f40c9ca0 con 0x55c042905450 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- 172.21.15.67:0/1712439875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f80075e0 con 0x55c042905450 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f28e37fe640 1 -- 172.21.15.67:0/1712439875 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f28f40abb50 con 0x55c042905450 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 10 client.5646 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- 172.21.15.67:0/1712439875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55c0426a1e90 con 0x55c042905450 2024-09-19T05:36:59.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f28e37fe640 1 -- 172.21.15.67:0/1712439875 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f80075e0 con 0x55c042905450 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f28e37fe640 1 -- 172.21.15.67:0/1712439875 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f28f4003620 con 0x55c042905450 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 10 client.5646 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 10 client.5646 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 20 client.5646 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c042919150 0x55c042919560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 4 client.5646 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f290de84000 1 -- 172.21.15.67:0/1712439875 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55c042717700 con 0x55c042919150 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2908b64640 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c042919150 0x55c042919560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f28e37fe640 10 client.5646 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.437+0000 7f2908b64640 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c042919150 0x55c042919560 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a61eef1059490236 server_cookie=275177e30de67c3f in_seq=0 out_seq=0 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f28e37fe640 1 -- 172.21.15.67:0/1712439875 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c042717700 con 0x55c042919150 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f28e37fe640 10 client.5646 handle_command_reply: tid=0 2024-09-19T05:36:59.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 client.5646 shutdown 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 -- 172.21.15.67:0/1712439875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905450 msgr2=0x55c042979240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905450 0x55c042979240 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f28f4008010 tx=0x7f28f4019210 comp rx=0 tx=0).stop 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 -- 172.21.15.67:0/1712439875 shutdown_connections 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55c042905d70 0x55c042918c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c042905450 0x55c042979240 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55c042919150 0x55c042919560 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 --2- 172.21.15.67:0/1712439875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c0428b98e0 0x55c042978d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f28e37fe640 0 client.5646 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 -- 172.21.15.67:0/1712439875 >> 172.21.15.67:0/1712439875 conn(0x55c0423ccfc0 msgr2=0x55c0428e6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 -- 172.21.15.67:0/1712439875 shutdown_connections 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 1 -- 172.21.15.67:0/1712439875 wait complete. 2024-09-19T05:36:59.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290de84000 20 client.5646 trim_cache size 0 max 16384 2024-09-19T05:36:59.450 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:59.450 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:36:59.450 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "5cd580a2-1e62-4768-8799-fc39ea91f656", 2024-09-19T05:36:59.450 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:36:59.450 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:59.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 -- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f00678c0 msgr2=0x7f28f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f00678c0 0x7f28f0069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f28f8005890 tx=0x7f28f8009040 comp rx=0 tx=0).stop 2024-09-19T05:36:59.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 -- 172.21.15.67:0/1803231976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2904159c60 msgr2=0x7f2904099430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2904159c60 0x7f2904099430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00c770 tx=0x7f28fc00cc30 comp rx=0 tx=0).stop 2024-09-19T05:36:59.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 -- 172.21.15.67:0/1803231976 shutdown_connections 2024-09-19T05:36:59.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2904159c60 0x7f2904099430 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29040b3150 0x7f29040b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28f00678c0 0x7f28f0069d80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 --2- 172.21.15.67:0/1803231976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f290406ffd0 0x7f290409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 -- 172.21.15.67:0/1803231976 >> 172.21.15.67:0/1803231976 conn(0x7f29040b1e50 msgr2=0x7f29040afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 -- 172.21.15.67:0/1803231976 shutdown_connections 2024-09-19T05:36:59.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.441+0000 7f290adc8640 1 -- 172.21.15.67:0/1803231976 wait complete. 2024-09-19T05:36:59.461 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '5cd580a2-1e62-4768-8799-fc39ea91f656', 'mode': 'asynchronous'}' 2024-09-19T05:36:59.462 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-09-19T05:36:59.462 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-19T05:36:59.462 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-19T05:36:59.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d3e637640 1 Processor -- start 2024-09-19T05:36:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d3e637640 1 -- start start 2024-09-19T05:36:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d3e637640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9d3815b390 0x7f9d380ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d3e637640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3806ef70 0x7f9d380cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d3e637640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d380d0e60 con 0x7f9d380cf5e0 2024-09-19T05:36:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d3e637640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9d3806f4c0 con 0x7f9d3815b390 2024-09-19T05:36:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d3e637640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9d380d0930 con 0x7f9d3806ef70 2024-09-19T05:36:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d377fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3806ef70 0x7f9d380cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d37fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9d3815b390 0x7f9d380ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d377fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3806ef70 0x7f9d380cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:56226/0 (socket says 172.21.15.67:56226) 2024-09-19T05:36:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d3cbd4640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9d380cf5e0 0x7f9d380d1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:43254/0 (socket says 172.21.15.67:43254) 2024-09-19T05:36:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.573+0000 7f9d377fe640 1 -- 172.21.15.67:0/2512731320 learned_addr learned my addr 172.21.15.67:0/2512731320 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d377fe640 1 -- 172.21.15.67:0/2512731320 >> v2:172.21.15.97:3300/0 conn(0x7f9d3815b390 msgr2=0x7f9d380ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d377fe640 1 --2- 172.21.15.67:0/2512731320 >> v2:172.21.15.97:3300/0 conn(0x7f9d3815b390 0x7f9d380ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d377fe640 1 -- 172.21.15.67:0/2512731320 >> v1:172.21.15.97:6789/0 conn(0x7f9d380cf5e0 legacy=0x7f9d380d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d377fe640 1 -- 172.21.15.67:0/2512731320 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d380d0b80 con 0x7f9d3806ef70 2024-09-19T05:36:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d37fff640 1 --2- 172.21.15.67:0/2512731320 >> v2:172.21.15.97:3300/0 conn(0x7f9d3815b390 0x7f9d380ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:36:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d377fe640 1 --2- 172.21.15.67:0/2512731320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3806ef70 0x7f9d380cf0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009870 tx=0x7f9d2c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bae6f16fb450e748 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d36ffd640 1 -- 172.21.15.67:0/2512731320 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0b0070 con 0x7f9d3806ef70 2024-09-19T05:36:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d36ffd640 1 -- 172.21.15.67:0/2512731320 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0ab600 con 0x7f9d3806ef70 2024-09-19T05:36:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d36ffd640 1 -- 172.21.15.67:0/2512731320 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0ab9d0 con 0x7f9d3806ef70 2024-09-19T05:36:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d3e637640 1 -- 172.21.15.67:0/2512731320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3806ef70 msgr2=0x7f9d380cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d3e637640 1 --2- 172.21.15.67:0/2512731320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3806ef70 0x7f9d380cf0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009870 tx=0x7f9d2c01c4d0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d3e637640 1 -- 172.21.15.67:0/2512731320 shutdown_connections 2024-09-19T05:36:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d3e637640 1 --2- 172.21.15.67:0/2512731320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3806ef70 0x7f9d380cf0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d3e637640 1 --2- 172.21.15.67:0/2512731320 >> v2:172.21.15.97:3300/0 conn(0x7f9d3815b390 0x7f9d380ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d3e637640 1 -- 172.21.15.67:0/2512731320 >> 172.21.15.67:0/2512731320 conn(0x7f9d380b6570 msgr2=0x7f9d380b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d3e637640 1 -- 172.21.15.67:0/2512731320 shutdown_connections 2024-09-19T05:36:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.577+0000 7f9d3e637640 1 -- 172.21.15.67:0/2512731320 wait complete. 2024-09-19T05:36:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3e637640 1 Processor -- start 2024-09-19T05:36:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3e637640 1 -- start start 2024-09-19T05:36:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3e637640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3806ef70 0x7f9d3814dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3e637640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d380cf5e0 0x7f9d3814ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3e637640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3815b390 0x7f9d38156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3e637640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9d380cf9f0 con 0x7f9d3806ef70 2024-09-19T05:36:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3e637640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9d380cd680 con 0x7f9d380cf5e0 2024-09-19T05:36:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3e637640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9d380cfb70 con 0x7f9d3815b390 2024-09-19T05:36:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d37fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3806ef70 0x7f9d3814dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d37fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3806ef70 0x7f9d3814dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55006/0 (socket says 172.21.15.67:55006) 2024-09-19T05:36:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d37fff640 1 -- 172.21.15.67:0/3469753446 learned_addr learned my addr 172.21.15.67:0/3469753446 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d377fe640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d380cf5e0 0x7f9d3814ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3cbd4640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3815b390 0x7f9d38156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d37fff640 1 -- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3815b390 msgr2=0x7f9d38156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d37fff640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3815b390 0x7f9d38156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d37fff640 1 -- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d380cf5e0 msgr2=0x7f9d3814ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d37fff640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d380cf5e0 0x7f9d3814ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d37fff640 1 -- 172.21.15.67:0/3469753446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d381556d0 con 0x7f9d3806ef70 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d37fff640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3806ef70 0x7f9d3814dde0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800ed40 tx=0x7f9d2800d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d34ff9640 1 -- 172.21.15.67:0/3469753446 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28010850 con 0x7f9d3806ef70 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d34ff9640 1 -- 172.21.15.67:0/3469753446 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d280109f0 con 0x7f9d3806ef70 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3e637640 1 -- 172.21.15.67:0/3469753446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d381559b0 con 0x7f9d3806ef70 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d34ff9640 1 -- 172.21.15.67:0/3469753446 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28010da0 con 0x7f9d3806ef70 2024-09-19T05:36:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d3e637640 1 -- 172.21.15.67:0/3469753446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d38155f70 con 0x7f9d3806ef70 2024-09-19T05:36:59.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.581+0000 7f9d34ff9640 1 -- 172.21.15.67:0/3469753446 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d280213f0 con 0x7f9d3806ef70 2024-09-19T05:36:59.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d34ff9640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d240678c0 0x7f9d24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d34ff9640 1 -- 172.21.15.67:0/3469753446 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f9d280868d0 con 0x7f9d3806ef70 2024-09-19T05:36:59.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d240678c0 0x7f9d24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 Processor -- start 2024-09-19T05:36:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 -- start start 2024-09-19T05:36:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d240678c0 0x7f9d24069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0ad000 tx=0x7f9d2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e99672d0 0x55d3e99676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e9967bf0 0x55d3e991e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e991ed40 0x55d3e991f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d3e9805bd0 con 0x55d3e9967bf0 2024-09-19T05:36:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d3e976c9e0 con 0x55d3e99672d0 2024-09-19T05:36:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d3e97128f0 con 0x55d3e991ed40 2024-09-19T05:36:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e9967bf0 0x55d3e991e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e9967bf0 0x55d3e991e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55022/0 (socket says 172.21.15.67:55022) 2024-09-19T05:36:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 -- 172.21.15.67:0/201144241 learned_addr learned my addr 172.21.15.67:0/201144241 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d37fff640 1 --2- 172.21.15.67:0/201144241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e99672d0 0x55d3e99676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d3cbd4640 1 --2- 172.21.15.67:0/201144241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e991ed40 0x55d3e991f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 -- 172.21.15.67:0/201144241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e991ed40 msgr2=0x55d3e991f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 --2- 172.21.15.67:0/201144241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e991ed40 0x55d3e991f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 -- 172.21.15.67:0/201144241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e99672d0 msgr2=0x55d3e99676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 --2- 172.21.15.67:0/201144241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e99672d0 0x55d3e99676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 -- 172.21.15.67:0/201144241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3e970a970 con 0x55d3e9967bf0 2024-09-19T05:36:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d37fff640 1 --2- 172.21.15.67:0/201144241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e99672d0 0x55d3e99676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d377fe640 1 --2- 172.21.15.67:0/201144241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e9967bf0 0x55d3e991e800 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c008010 tx=0x7f9d2c0a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3463f15e49681b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d1dffb640 1 -- 172.21.15.67:0/201144241 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0c6070 con 0x55d3e9967bf0 2024-09-19T05:36:59.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d1dffb640 1 -- 172.21.15.67:0/201144241 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0b6420 con 0x55d3e9967bf0 2024-09-19T05:36:59.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d1dffb640 1 -- 172.21.15.67:0/201144241 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0b0040 con 0x55d3e9967bf0 2024-09-19T05:36:59.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 -- 172.21.15.67:0/201144241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e9967bf0 msgr2=0x55d3e991e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 --2- 172.21.15.67:0/201144241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e9967bf0 0x55d3e991e800 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c008010 tx=0x7f9d2c0a6000 comp rx=0 tx=0).stop 2024-09-19T05:36:59.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 -- 172.21.15.67:0/201144241 shutdown_connections 2024-09-19T05:36:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 --2- 172.21.15.67:0/201144241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e991ed40 0x55d3e991f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 --2- 172.21.15.67:0/201144241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e9967bf0 0x55d3e991e800 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 --2- 172.21.15.67:0/201144241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e99672d0 0x55d3e99676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 -- 172.21.15.67:0/201144241 >> 172.21.15.67:0/201144241 conn(0x55d3e9915ba0 msgr2=0x55d3e991d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 -- 172.21.15.67:0/201144241 shutdown_connections 2024-09-19T05:36:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.585+0000 7f9d416f3000 1 -- 172.21.15.67:0/201144241 wait complete. 2024-09-19T05:36:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- start start 2024-09-19T05:36:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 Processor -- start 2024-09-19T05:36:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e991ed40 0x55d3e9967fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e99672d0 0x55d3e9968510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e9967bf0 0x55d3e9968a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d3e9706a50 con 0x55d3e991ed40 2024-09-19T05:36:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d3e97689a0 con 0x55d3e9967bf0 2024-09-19T05:36:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d3e9737180 con 0x55d3e99672d0 2024-09-19T05:36:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 10 client.0 _ll_register_callbacks cb 0x55d3e97ce430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d37fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e991ed40 0x55d3e9967fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d37fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e991ed40 0x55d3e9967fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55028/0 (socket says 172.21.15.67:55028) 2024-09-19T05:36:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d37fff640 1 -- 172.21.15.67:0/3258312018 learned_addr learned my addr 172.21.15.67:0/3258312018 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d3cbd4640 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e9967bf0 0x55d3e9968a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d377fe640 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e99672d0 0x55d3e9968510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d37fff640 1 -- 172.21.15.67:0/3258312018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e99672d0 msgr2=0x55d3e9968510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d37fff640 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e99672d0 0x55d3e9968510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d37fff640 1 -- 172.21.15.67:0/3258312018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e9967bf0 msgr2=0x55d3e9968a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d37fff640 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e9967bf0 0x55d3e9968a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d37fff640 1 -- 172.21.15.67:0/3258312018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3e9775650 con 0x55d3e991ed40 2024-09-19T05:36:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d377fe640 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e99672d0 0x55d3e9968510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d37fff640 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e991ed40 0x55d3e9967fd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9d28004780 tx=0x7f9d280571b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c813476db3e3a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d16ffd640 1 -- 172.21.15.67:0/3258312018 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2805ae60 con 0x55d3e991ed40 2024-09-19T05:36:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d16ffd640 1 -- 172.21.15.67:0/3258312018 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f9d28053120 con 0x55d3e991ed40 2024-09-19T05:36:59.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- 172.21.15.67:0/3258312018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d2c0b6420 con 0x55d3e991ed40 2024-09-19T05:36:59.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d16ffd640 1 -- 172.21.15.67:0/3258312018 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9d2805f690 con 0x55d3e991ed40 2024-09-19T05:36:59.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 10 client.5655 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:59.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- 172.21.15.67:0/3258312018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55d3e9712b40 con 0x55d3e991ed40 2024-09-19T05:36:59.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d16ffd640 1 -- 172.21.15.67:0/3258312018 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0b6420 con 0x55d3e991ed40 2024-09-19T05:36:59.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d16ffd640 1 -- 172.21.15.67:0/3258312018 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f9d2800e040 con 0x55d3e991ed40 2024-09-19T05:36:59.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 10 client.5655 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:59.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 10 client.5655 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:59.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 20 client.5655 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:59.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d3e9969460 0x55d3e9978550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 4 client.5655 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:59.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- 172.21.15.67:0/3258312018 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3e9707020 con 0x55d3e9969460 2024-09-19T05:36:59.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d377fe640 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d3e9969460 0x55d3e9978550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d377fe640 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d3e9969460 0x55d3e9978550 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9421a3cc088d2075 server_cookie=ba96b0710bdd2a3 in_seq=0 out_seq=0 2024-09-19T05:36:59.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d16ffd640 10 client.5655 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d16ffd640 1 -- 172.21.15.67:0/3258312018 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3e9707020 con 0x55d3e9969460 2024-09-19T05:36:59.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d16ffd640 10 client.5655 handle_command_reply: tid=0 2024-09-19T05:36:59.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 client.5655 shutdown 2024-09-19T05:36:59.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- 172.21.15.67:0/3258312018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e991ed40 msgr2=0x55d3e9967fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e991ed40 0x55d3e9967fd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9d28004780 tx=0x7f9d280571b0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- 172.21.15.67:0/3258312018 shutdown_connections 2024-09-19T05:36:59.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d3e9969460 0x55d3e9978550 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e9967bf0 0x55d3e9968a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d16ffd640 0 client.5655 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e99672d0 0x55d3e9968510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 --2- 172.21.15.67:0/3258312018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e991ed40 0x55d3e9967fd0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- 172.21.15.67:0/3258312018 >> 172.21.15.67:0/3258312018 conn(0x55d3e9915ba0 msgr2=0x55d3e991d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- 172.21.15.67:0/3258312018 shutdown_connections 2024-09-19T05:36:59.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 1 -- 172.21.15.67:0/3258312018 wait complete. 2024-09-19T05:36:59.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.589+0000 7f9d416f3000 20 client.5655 trim_cache size 0 max 16384 2024-09-19T05:36:59.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d416f3000 1 Processor -- start 2024-09-19T05:36:59.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d416f3000 1 -- start start 2024-09-19T05:36:59.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e991ed40 0x55d3e99d5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e99d6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e9967bf0 0x55d3e99d66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d416f3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38203fe0 con 0x55d3e99672d0 2024-09-19T05:36:59.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d416f3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38203020 con 0x55d3e9967bf0 2024-09-19T05:36:59.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d416f3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9d38202510 con 0x55d3e991ed40 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d377fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e99d6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d377fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e99d6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55040/0 (socket says 172.21.15.67:55040) 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.605+0000 7f9d377fe640 1 -- 172.21.15.67:0/1945669444 learned_addr learned my addr 172.21.15.67:0/1945669444 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 -- 172.21.15.67:0/1945669444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e991ed40 msgr2=0x55d3e99d5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 --2- 172.21.15.67:0/1945669444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e991ed40 0x55d3e99d5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 -- 172.21.15.67:0/1945669444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e9967bf0 msgr2=0x55d3e99d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 --2- 172.21.15.67:0/1945669444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e9967bf0 0x55d3e99d66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 -- 172.21.15.67:0/1945669444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3e970ca00 con 0x55d3e99672d0 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 --2- 172.21.15.67:0/1945669444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e99d6170 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0abfd0 tx=0x7f9d2c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4912f7b3d43dc5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d1d7fa640 1 -- 172.21.15.67:0/1945669444 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0c6040 con 0x55d3e99672d0 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d1d7fa640 1 -- 172.21.15.67:0/1945669444 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0d2040 con 0x55d3e99672d0 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d1d7fa640 1 -- 172.21.15.67:0/1945669444 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0b0040 con 0x55d3e99672d0 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- 172.21.15.67:0/1945669444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 msgr2=0x55d3e99d6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 --2- 172.21.15.67:0/1945669444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e99d6170 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0abfd0 tx=0x7f9d2c004740 comp rx=0 tx=0).stop 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- 172.21.15.67:0/1945669444 shutdown_connections 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 --2- 172.21.15.67:0/1945669444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e9967bf0 0x55d3e99d66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 --2- 172.21.15.67:0/1945669444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e99d6170 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 --2- 172.21.15.67:0/1945669444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e991ed40 0x55d3e99d5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- 172.21.15.67:0/1945669444 >> 172.21.15.67:0/1945669444 conn(0x55d3e9915ba0 msgr2=0x55d3e9924d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- 172.21.15.67:0/1945669444 shutdown_connections 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- 172.21.15.67:0/1945669444 wait complete. 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- start start 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 Processor -- start 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e991ed40 0x55d3e997d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e9996840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e9967bf0 0x55d3e9996d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d3e9829330 con 0x55d3e99672d0 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38202a00 con 0x55d3e991ed40 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d3e9927e80 con 0x55d3e9967bf0 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 10 client.0 _ll_register_callbacks cb 0x7f9d2800b740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e9996840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e9996840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55056/0 (socket says 172.21.15.67:55056) 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 -- 172.21.15.67:0/1304468582 learned_addr learned my addr 172.21.15.67:0/1304468582 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d3cbd4640 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e9967bf0 0x55d3e9996d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 -- 172.21.15.67:0/1304468582 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e9967bf0 msgr2=0x55d3e9996d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d37fff640 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e991ed40 0x55d3e997d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e9967bf0 0x55d3e9996d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 -- 172.21.15.67:0/1304468582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e991ed40 msgr2=0x55d3e997d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e991ed40 0x55d3e997d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 -- 172.21.15.67:0/1304468582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3e972aa50 con 0x55d3e99672d0 2024-09-19T05:36:59.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d377fe640 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e9996840 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009870 tx=0x7f9d2c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60324be38b9e90d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:59.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d16ffd640 1 -- 172.21.15.67:0/1304468582 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0c6040 con 0x55d3e99672d0 2024-09-19T05:36:59.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d16ffd640 1 -- 172.21.15.67:0/1304468582 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f9d2c0b6650 con 0x55d3e99672d0 2024-09-19T05:36:59.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- 172.21.15.67:0/1304468582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d2c0d2040 con 0x55d3e99672d0 2024-09-19T05:36:59.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d16ffd640 1 -- 172.21.15.67:0/1304468582 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9d2c0e4050 con 0x55d3e99672d0 2024-09-19T05:36:59.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 10 client.5661 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:59.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- 172.21.15.67:0/1304468582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55d3e9704b10 con 0x55d3e99672d0 2024-09-19T05:36:59.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d16ffd640 1 -- 172.21.15.67:0/1304468582 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0d2040 con 0x55d3e99672d0 2024-09-19T05:36:59.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d16ffd640 1 -- 172.21.15.67:0/1304468582 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f9d2c0e7020 con 0x55d3e99672d0 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 10 client.5661 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 10 client.5661 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 20 client.5661 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d3e997db90 0x55d3e99972c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 4 client.5661 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d416f3000 1 -- 172.21.15.67:0/1304468582 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x55d3e9749cd0 con 0x55d3e997db90 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.609+0000 7f9d37fff640 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d3e997db90 0x55d3e99972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d16ffd640 10 client.5661 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d37fff640 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d3e997db90 0x55d3e99972c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a503c991a3406f03 server_cookie=51b10f9538291a76 in_seq=0 out_seq=0 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d16ffd640 1 -- 172.21.15.67:0/1304468582 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d3e9749cd0 con 0x55d3e997db90 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d16ffd640 10 client.5661 handle_command_reply: tid=0 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 client.5661 shutdown 2024-09-19T05:36:59.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 -- 172.21.15.67:0/1304468582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 msgr2=0x55d3e9996840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e9996840 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009870 tx=0x7f9d2c01ad10 comp rx=0 tx=0).stop 2024-09-19T05:36:59.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 -- 172.21.15.67:0/1304468582 shutdown_connections 2024-09-19T05:36:59.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d3e9967bf0 0x55d3e9996d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d3e99672d0 0x55d3e9996840 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d3e997db90 0x55d3e99972c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 --2- 172.21.15.67:0/1304468582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d3e991ed40 0x55d3e997d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 -- 172.21.15.67:0/1304468582 >> 172.21.15.67:0/1304468582 conn(0x55d3e9915ba0 msgr2=0x55d3e9978550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d16ffd640 0 client.5661 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 -- 172.21.15.67:0/1304468582 shutdown_connections 2024-09-19T05:36:59.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 1 -- 172.21.15.67:0/1304468582 wait complete. 2024-09-19T05:36:59.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.613+0000 7f9d416f3000 20 client.5661 trim_cache size 0 max 16384 2024-09-19T05:36:59.629 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:59.629 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:36:59.629 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:36:59.629 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:59.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 -- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d240678c0 msgr2=0x7f9d24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d240678c0 0x7f9d24069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0ad000 tx=0x7f9d2c008040 comp rx=0 tx=0).stop 2024-09-19T05:36:59.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 -- 172.21.15.67:0/3469753446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3806ef70 msgr2=0x7f9d3814dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3806ef70 0x7f9d3814dde0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800ed40 tx=0x7f9d2800d720 comp rx=0 tx=0).stop 2024-09-19T05:36:59.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 -- 172.21.15.67:0/3469753446 shutdown_connections 2024-09-19T05:36:59.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d240678c0 0x7f9d24069d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d3815b390 0x7f9d38156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d380cf5e0 0x7f9d3814ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 --2- 172.21.15.67:0/3469753446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3806ef70 0x7f9d3814dde0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 -- 172.21.15.67:0/3469753446 >> 172.21.15.67:0/3469753446 conn(0x7f9d380b6570 msgr2=0x7f9d380b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 -- 172.21.15.67:0/3469753446 shutdown_connections 2024-09-19T05:36:59.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.617+0000 7f9d3e637640 1 -- 172.21.15.67:0/3469753446 wait complete. 2024-09-19T05:36:59.635 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-19T05:36:59.635 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-19T05:36:59.635 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-19T05:36:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.749+0000 7f4b8d39c640 1 Processor -- start 2024-09-19T05:36:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.749+0000 7f4b8d39c640 1 -- start start 2024-09-19T05:36:59.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b8d39c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4b88067a00 0x7f4b8806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b8d39c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b88067fa0 con 0x7f4b8815c2b0 2024-09-19T05:36:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b8d39c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b880b3bb0 con 0x7f4b8806d210 2024-09-19T05:36:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b8d39c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4b880b4200 con 0x7f4b88067a00 2024-09-19T05:36:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b867fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4b88067a00 0x7f4b8806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b86ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4b8815c2b0 0x7f4b880d0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46738/0 (socket says 172.21.15.67:46738) 2024-09-19T05:36:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b86ffd640 1 -- 172.21.15.67:0/888263573 learned_addr learned my addr 172.21.15.67:0/888263573 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:36:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b867fc640 1 -- 172.21.15.67:0/888263573 >> v1:172.21.15.97:6789/0 conn(0x7f4b8806d210 legacy=0x7f4b880b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b867fc640 1 -- 172.21.15.67:0/888263573 >> v1:172.21.15.67:6789/0 conn(0x7f4b8815c2b0 legacy=0x7f4b880d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b867fc640 1 -- 172.21.15.67:0/888263573 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b880b3e90 con 0x7f4b88067a00 2024-09-19T05:36:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b867fc640 1 --2- 172.21.15.67:0/888263573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 0x7f4b8806ccd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0097c0 tx=0x7f4b7c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38238666e80c4ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b85ffb640 1 -- 172.21.15.67:0/888263573 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0b0070 con 0x7f4b88067a00 2024-09-19T05:36:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b85ffb640 1 -- 172.21.15.67:0/888263573 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0ab600 con 0x7f4b88067a00 2024-09-19T05:36:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.753+0000 7f4b85ffb640 1 -- 172.21.15.67:0/888263573 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0ab9d0 con 0x7f4b88067a00 2024-09-19T05:36:59.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- 172.21.15.67:0/888263573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 msgr2=0x7f4b8806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 --2- 172.21.15.67:0/888263573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 0x7f4b8806ccd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0097c0 tx=0x7f4b7c01c460 comp rx=0 tx=0).stop 2024-09-19T05:36:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- 172.21.15.67:0/888263573 shutdown_connections 2024-09-19T05:36:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 --2- 172.21.15.67:0/888263573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 0x7f4b8806ccd0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- 172.21.15.67:0/888263573 >> 172.21.15.67:0/888263573 conn(0x7f4b880727b0 msgr2=0x7f4b88072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- 172.21.15.67:0/888263573 shutdown_connections 2024-09-19T05:36:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- 172.21.15.67:0/888263573 wait complete. 2024-09-19T05:36:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 Processor -- start 2024-09-19T05:36:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- start start 2024-09-19T05:36:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 0x7f4b880b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b8806d210 0x7f4b8814cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b8815c2b0 0x7f4b8814d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4b880b5980 con 0x7f4b88067a00 2024-09-19T05:36:59.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4b880b5800 con 0x7f4b8806d210 2024-09-19T05:36:59.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4b88169ed0 con 0x7f4b8815c2b0 2024-09-19T05:36:59.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b86ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 0x7f4b880b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b86ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 0x7f4b880b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55074/0 (socket says 172.21.15.67:55074) 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b86ffd640 1 -- 172.21.15.67:0/1707257992 learned_addr learned my addr 172.21.15.67:0/1707257992 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b867fc640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b8806d210 0x7f4b8814cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b877fe640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b8815c2b0 0x7f4b8814d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b86ffd640 1 -- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b8815c2b0 msgr2=0x7f4b8814d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b8815c2b0 0x7f4b8814d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b86ffd640 1 -- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b8806d210 msgr2=0x7f4b8814cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b8806d210 0x7f4b8814cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b86ffd640 1 -- 172.21.15.67:0/1707257992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8815ba70 con 0x7f4b88067a00 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 0x7f4b880b1780 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c450 tx=0x7f4b7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b6f7fe640 1 -- 172.21.15.67:0/1707257992 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78017070 con 0x7f4b88067a00 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b6f7fe640 1 -- 172.21.15.67:0/1707257992 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b78005cf0 con 0x7f4b88067a00 2024-09-19T05:36:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b6f7fe640 1 -- 172.21.15.67:0/1707257992 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78007290 con 0x7f4b88067a00 2024-09-19T05:36:59.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- 172.21.15.67:0/1707257992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8814f8f0 con 0x7f4b88067a00 2024-09-19T05:36:59.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.757+0000 7f4b8d39c640 1 -- 172.21.15.67:0/1707257992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b88150190 con 0x7f4b88067a00 2024-09-19T05:36:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b6f7fe640 1 -- 172.21.15.67:0/1707257992 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b7801a070 con 0x7f4b88067a00 2024-09-19T05:36:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b6f7fe640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b740678c0 0x7f4b74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b6f7fe640 1 -- 172.21.15.67:0/1707257992 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f4b780851f0 con 0x7f4b88067a00 2024-09-19T05:36:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b867fc640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b740678c0 0x7f4b74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b90458000 1 Processor -- start 2024-09-19T05:36:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b90458000 1 -- start start 2024-09-19T05:36:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b867fc640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b740678c0 0x7f4b74069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0ad000 tx=0x7f4b7c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b90458000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab843130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b90458000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab843670 0x557eab7f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b90458000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab7f9500 0x557eab7f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b90458000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557eab6e0540 con 0x557eab842d50 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b90458000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557eab646d70 con 0x557eab7f9500 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b90458000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557eab601b20 con 0x557eab843670 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b86ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab843130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b86ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab843130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55082/0 (socket says 172.21.15.67:55082) 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b86ffd640 1 -- 172.21.15.67:0/3802287192 learned_addr learned my addr 172.21.15.67:0/3802287192 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b877fe640 1 --2- 172.21.15.67:0/3802287192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab7f9500 0x557eab7f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b867fc640 1 --2- 172.21.15.67:0/3802287192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab843670 0x557eab7f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b86ffd640 1 -- 172.21.15.67:0/3802287192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab843670 msgr2=0x557eab7f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/3802287192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab843670 0x557eab7f8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b86ffd640 1 -- 172.21.15.67:0/3802287192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab7f9500 msgr2=0x557eab7f98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/3802287192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab7f9500 0x557eab7f98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b86ffd640 1 -- 172.21.15.67:0/3802287192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eab68d3b0 con 0x557eab842d50 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/3802287192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab843130 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4b780518d0 tx=0x7f4b78055470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f335b77aca6ec62a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b6cff9640 1 -- 172.21.15.67:0/3802287192 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7805e050 con 0x557eab842d50 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b6cff9640 1 -- 172.21.15.67:0/3802287192 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b78053770 con 0x557eab842d50 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.761+0000 7f4b6cff9640 1 -- 172.21.15.67:0/3802287192 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7805dbc0 con 0x557eab842d50 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- 172.21.15.67:0/3802287192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 msgr2=0x557eab843130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 --2- 172.21.15.67:0/3802287192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab843130 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4b780518d0 tx=0x7f4b78055470 comp rx=0 tx=0).stop 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- 172.21.15.67:0/3802287192 shutdown_connections 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 --2- 172.21.15.67:0/3802287192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab7f9500 0x557eab7f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 --2- 172.21.15.67:0/3802287192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab843670 0x557eab7f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 --2- 172.21.15.67:0/3802287192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab843130 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- 172.21.15.67:0/3802287192 >> 172.21.15.67:0/3802287192 conn(0x557eab7f54b0 msgr2=0x557eab7f78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- 172.21.15.67:0/3802287192 shutdown_connections 2024-09-19T05:36:59.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- 172.21.15.67:0/3802287192 wait complete. 2024-09-19T05:36:59.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- start start 2024-09-19T05:36:59.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 Processor -- start 2024-09-19T05:36:59.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab7f9500 0x557eab7fe130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7fe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab843670 0x557eab82ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557eab5ee1d0 con 0x557eab842d50 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557eab600680 con 0x557eab7f9500 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557eab5ecd60 con 0x557eab843670 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 10 client.0 _ll_register_callbacks cb 0x557eab6a8f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b867fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b867fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7fe670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55092/0 (socket says 172.21.15.67:55092) 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b867fc640 1 -- 172.21.15.67:0/3649697876 learned_addr learned my addr 172.21.15.67:0/3649697876 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b877fe640 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab843670 0x557eab82ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab7f9500 0x557eab7fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b867fc640 1 -- 172.21.15.67:0/3649697876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab843670 msgr2=0x557eab82ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b867fc640 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab843670 0x557eab82ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b867fc640 1 -- 172.21.15.67:0/3649697876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab7f9500 msgr2=0x557eab7fe130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b867fc640 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab7f9500 0x557eab7fe130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b867fc640 1 -- 172.21.15.67:0/3649697876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eab619b90 con 0x557eab842d50 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b867fc640 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7fe670 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c01a090 tx=0x7f4b7c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef058400ea50322 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3649697876 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0b0040 con 0x557eab842d50 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- 172.21.15.67:0/3649697876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b78053770 con 0x557eab842d50 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3649697876 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f4b7c0b6850 con 0x557eab842d50 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3649697876 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b7c0b6a50 con 0x557eab842d50 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 10 client.5676 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- 172.21.15.67:0/3649697876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x557eab6008a0 con 0x557eab842d50 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3649697876 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b78053770 con 0x557eab842d50 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3649697876 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f4b7c0b6bf0 con 0x557eab842d50 2024-09-19T05:36:59.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 10 client.5676 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 10 client.5676 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 20 client.5676 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557eab848ec0 0x557eab8492a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 4 client.5676 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b90458000 1 -- 172.21.15.67:0/3649697876 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557eab5e0e40 con 0x557eab848ec0 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557eab848ec0 0x557eab8492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b65ffb640 10 client.5676 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.765+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557eab848ec0 0x557eab8492a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d473aac099d3478e server_cookie=383ab023c91a1362 in_seq=0 out_seq=0 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3649697876 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557eab5e0e40 con 0x557eab848ec0 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b65ffb640 10 client.5676 handle_command_reply: tid=0 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 client.5676 shutdown 2024-09-19T05:36:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 -- 172.21.15.67:0/3649697876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 msgr2=0x557eab7fe670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7fe670 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c01a090 tx=0x7f4b7c01aca0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 -- 172.21.15.67:0/3649697876 shutdown_connections 2024-09-19T05:36:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab843670 0x557eab82ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7fe670 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557eab848ec0 0x557eab8492a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 --2- 172.21.15.67:0/3649697876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab7f9500 0x557eab7fe130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 -- 172.21.15.67:0/3649697876 >> 172.21.15.67:0/3649697876 conn(0x557eab7f54b0 msgr2=0x557eab7f80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b65ffb640 0 client.5676 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 -- 172.21.15.67:0/3649697876 shutdown_connections 2024-09-19T05:36:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 1 -- 172.21.15.67:0/3649697876 wait complete. 2024-09-19T05:36:59.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.769+0000 7f4b90458000 20 client.5676 trim_cache size 0 max 16384 2024-09-19T05:36:59.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b90458000 1 Processor -- start 2024-09-19T05:36:59.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b90458000 1 -- start start 2024-09-19T05:36:59.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b90458000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab7f9500 0x557eab859a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b90458000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b90458000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 0x557eab7f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b90458000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4b88200aa0 con 0x557eab842d50 2024-09-19T05:36:59.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b90458000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4b880aa870 con 0x557eab843670 2024-09-19T05:36:59.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b90458000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4b88200450 con 0x557eab7f9500 2024-09-19T05:36:59.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b867fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b867fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7f87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55098/0 (socket says 172.21.15.67:55098) 2024-09-19T05:36:59.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.785+0000 7f4b867fc640 1 -- 172.21.15.67:0/2668661748 learned_addr learned my addr 172.21.15.67:0/2668661748 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 -- 172.21.15.67:0/2668661748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab7f9500 msgr2=0x557eab859a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 --2- 172.21.15.67:0/2668661748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab7f9500 0x557eab859a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 -- 172.21.15.67:0/2668661748 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 msgr2=0x557eab7f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b877fe640 1 --2- 172.21.15.67:0/2668661748 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 0x557eab7f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 --2- 172.21.15.67:0/2668661748 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 0x557eab7f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 -- 172.21.15.67:0/2668661748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eab5e6820 con 0x557eab842d50 2024-09-19T05:36:59.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 --2- 172.21.15.67:0/2668661748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7f87d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c000c10 tx=0x7f4b7c0bf000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9287a6bdc58f244 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b67fff640 1 -- 172.21.15.67:0/2668661748 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0b0070 con 0x557eab842d50 2024-09-19T05:36:59.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b67fff640 1 -- 172.21.15.67:0/2668661748 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0c7070 con 0x557eab842d50 2024-09-19T05:36:59.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b67fff640 1 -- 172.21.15.67:0/2668661748 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0b6850 con 0x557eab842d50 2024-09-19T05:36:59.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- 172.21.15.67:0/2668661748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 msgr2=0x557eab7f87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 --2- 172.21.15.67:0/2668661748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7f87d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c000c10 tx=0x7f4b7c0bf000 comp rx=0 tx=0).stop 2024-09-19T05:36:59.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- 172.21.15.67:0/2668661748 shutdown_connections 2024-09-19T05:36:59.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 --2- 172.21.15.67:0/2668661748 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 0x557eab7f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 --2- 172.21.15.67:0/2668661748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab7f87d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 --2- 172.21.15.67:0/2668661748 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab7f9500 0x557eab859a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- 172.21.15.67:0/2668661748 >> 172.21.15.67:0/2668661748 conn(0x557eab7f54b0 msgr2=0x557eab7f80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- 172.21.15.67:0/2668661748 shutdown_connections 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- 172.21.15.67:0/2668661748 wait complete. 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- start start 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 Processor -- start 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab7f9500 0x557eab841fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab8761f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 0x557eab876730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557eab64b3a0 con 0x557eab842d50 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557eab646080 con 0x557eab843670 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557eab5fdf10 con 0x557eab7f9500 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 10 client.0 _ll_register_callbacks cb 0x7f4b7c0ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab8761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab8761f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55102/0 (socket says 172.21.15.67:55102) 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 -- 172.21.15.67:0/3469135338 learned_addr learned my addr 172.21.15.67:0/3469135338 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b877fe640 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 0x557eab876730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab7f9500 0x557eab841fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 -- 172.21.15.67:0/3469135338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab7f9500 msgr2=0x557eab841fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab7f9500 0x557eab841fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 -- 172.21.15.67:0/3469135338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 msgr2=0x557eab876730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 0x557eab876730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 -- 172.21.15.67:0/3469135338 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eab6c9530 con 0x557eab842d50 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b877fe640 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 0x557eab876730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b867fc640 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab8761f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c097e40 tx=0x7f4b7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6c6213c18703d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:36:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3469135338 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0b0040 con 0x557eab842d50 2024-09-19T05:36:59.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3469135338 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f4b7c0d4c90 con 0x557eab842d50 2024-09-19T05:36:59.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- 172.21.15.67:0/3469135338 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b7c0c7070 con 0x557eab842d50 2024-09-19T05:36:59.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3469135338 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b7c0e3050 con 0x557eab842d50 2024-09-19T05:36:59.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 10 client.5682 fetch_fsmap learned FSMap version 24 2024-09-19T05:36:59.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b90458000 1 -- 172.21.15.67:0/3469135338 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x557eab5de420 con 0x557eab842d50 2024-09-19T05:36:59.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3469135338 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0c7070 con 0x557eab842d50 2024-09-19T05:36:59.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.789+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3469135338 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f4b7c0e6020 con 0x557eab842d50 2024-09-19T05:36:59.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 10 client.5682 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:36:59.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 10 client.5682 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 20 client.5682 populate_metadata read hostname 'smithi067' 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557eab876c70 0x557eab8b9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 4 client.5682 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 -- 172.21.15.67:0/3469135338 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x557eab6544a0 con 0x557eab876c70 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557eab876c70 0x557eab8b9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b86ffd640 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557eab876c70 0x557eab8b9a40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d07e8fba0825201e server_cookie=4d07df4ccb8c0739 in_seq=0 out_seq=0 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b65ffb640 10 client.5682 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b65ffb640 1 -- 172.21.15.67:0/3469135338 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557eab6544a0 con 0x557eab876c70 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b65ffb640 10 client.5682 handle_command_reply: tid=0 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 client.5682 shutdown 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 -- 172.21.15.67:0/3469135338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 msgr2=0x557eab8761f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab8761f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c097e40 tx=0x7f4b7c008040 comp rx=0 tx=0).stop 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 -- 172.21.15.67:0/3469135338 shutdown_connections 2024-09-19T05:36:59.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557eab876c70 0x557eab8b9a40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557eab843670 0x557eab876730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557eab842d50 0x557eab8761f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 --2- 172.21.15.67:0/3469135338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557eab7f9500 0x557eab841fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b65ffb640 0 client.5682 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 -- 172.21.15.67:0/3469135338 >> 172.21.15.67:0/3469135338 conn(0x557eab7f54b0 msgr2=0x557eab84e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 -- 172.21.15.67:0/3469135338 shutdown_connections 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 1 -- 172.21.15.67:0/3469135338 wait complete. 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b90458000 20 client.5682 trim_cache size 0 max 16384 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:36:59.807 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "b4960410-262f-4eea-9a6e-a2a141738257", 2024-09-19T05:36:59.808 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:36:59.808 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 -- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b740678c0 msgr2=0x7f4b74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b740678c0 0x7f4b74069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0ad000 tx=0x7f4b7c0a6000 comp rx=0 tx=0).stop 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 -- 172.21.15.67:0/1707257992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 msgr2=0x7f4b880b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 0x7f4b880b1780 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c450 tx=0x7f4b7800c910 comp rx=0 tx=0).stop 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 -- 172.21.15.67:0/1707257992 shutdown_connections 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b740678c0 0x7f4b74069d80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b8815c2b0 0x7f4b8814d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b8806d210 0x7f4b8814cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 --2- 172.21.15.67:0/1707257992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b88067a00 0x7f4b880b1780 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 -- 172.21.15.67:0/1707257992 >> 172.21.15.67:0/1707257992 conn(0x7f4b880727b0 msgr2=0x7f4b88153620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 -- 172.21.15.67:0/1707257992 shutdown_connections 2024-09-19T05:36:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:36:59.793+0000 7f4b8d39c640 1 -- 172.21.15.67:0/1707257992 wait complete. 2024-09-19T05:36:59.820 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'b4960410-262f-4eea-9a6e-a2a141738257', 'mode': 'asynchronous'}' 2024-09-19T05:36:59.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:36:59.820 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-09-19T05:36:59.827 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-09-19T05:36:59.827 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-09-19T05:37:00.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.001+0000 7f266a526640 1 Processor -- start 2024-09-19T05:37:00.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.001+0000 7f266a526640 1 -- start start 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f266a526640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f266415f950 0x7f26640ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f266a526640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26640d0de0 0x7f26640b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f266a526640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26640cea90 con 0x7f26640b3750 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f266a526640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f26640af1a0 con 0x7f26640d0de0 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f266a526640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f26640ce110 con 0x7f266415f950 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2668ac3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26640d0de0 0x7f26640b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2668ac3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26640d0de0 0x7f26640b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55112/0 (socket says 172.21.15.67:55112) 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2668ac3640 1 -- 172.21.15.67:0/3163847647 learned_addr learned my addr 172.21.15.67:0/3163847647 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2663fff640 1 --2- 172.21.15.67:0/3163847647 >> v2:172.21.15.97:3300/0 conn(0x7f266415f950 0x7f26640ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2668ac3640 1 -- 172.21.15.67:0/3163847647 >> v2:172.21.15.97:3300/0 conn(0x7f266415f950 msgr2=0x7f26640ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2668ac3640 1 --2- 172.21.15.67:0/3163847647 >> v2:172.21.15.97:3300/0 conn(0x7f266415f950 0x7f26640ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2668ac3640 1 -- 172.21.15.67:0/3163847647 >> v1:172.21.15.97:6789/0 conn(0x7f26640b3750 legacy=0x7f26640d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2668ac3640 1 -- 172.21.15.67:0/3163847647 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26640cd7e0 con 0x7f26640d0de0 2024-09-19T05:37:00.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2668ac3640 1 --2- 172.21.15.67:0/3163847647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 0x7f26640b1e40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2664073310 tx=0x7f265c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b237d954185d9247 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2662ffd640 1 -- 172.21.15.67:0/3163847647 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c0a5840 con 0x7f26640d0de0 2024-09-19T05:37:00.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2662ffd640 1 -- 172.21.15.67:0/3163847647 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c0a59e0 con 0x7f26640d0de0 2024-09-19T05:37:00.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.005+0000 7f2662ffd640 1 -- 172.21.15.67:0/3163847647 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c0a5db0 con 0x7f26640d0de0 2024-09-19T05:37:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- 172.21.15.67:0/3163847647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 msgr2=0x7f26640b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 --2- 172.21.15.67:0/3163847647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 0x7f26640b1e40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2664073310 tx=0x7f265c01c980 comp rx=0 tx=0).stop 2024-09-19T05:37:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- 172.21.15.67:0/3163847647 shutdown_connections 2024-09-19T05:37:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 --2- 172.21.15.67:0/3163847647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 0x7f26640b1e40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 --2- 172.21.15.67:0/3163847647 >> v2:172.21.15.97:3300/0 conn(0x7f266415f950 0x7f26640ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- 172.21.15.67:0/3163847647 >> 172.21.15.67:0/3163847647 conn(0x7f26640d22f0 msgr2=0x7f26640d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- 172.21.15.67:0/3163847647 shutdown_connections 2024-09-19T05:37:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- 172.21.15.67:0/3163847647 wait complete. 2024-09-19T05:37:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 Processor -- start 2024-09-19T05:37:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- start start 2024-09-19T05:37:00.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26640b3750 0x7f2664154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 0x7f266406de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f266415f950 0x7f266406e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f266415feb0 con 0x7f26640d0de0 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f266415fd30 con 0x7f266415f950 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f26640b2b90 con 0x7f26640b3750 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f26637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 0x7f266406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f26637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 0x7f266406de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55126/0 (socket says 172.21.15.67:55126) 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f26637fe640 1 -- 172.21.15.67:0/282135404 learned_addr learned my addr 172.21.15.67:0/282135404 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f2668ac3640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f266415f950 0x7f266406e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f2663fff640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26640b3750 0x7f2664154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f26637fe640 1 -- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26640b3750 msgr2=0x7f2664154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f26637fe640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26640b3750 0x7f2664154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f26637fe640 1 -- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f266415f950 msgr2=0x7f266406e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f26637fe640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f266415f950 0x7f266406e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f26637fe640 1 -- 172.21.15.67:0/282135404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2664154e50 con 0x7f26640d0de0 2024-09-19T05:37:00.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f26637fe640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 0x7f266406de60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f265800c450 tx=0x7f265800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f2660ff9640 1 -- 172.21.15.67:0/282135404 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658012830 con 0x7f26640d0de0 2024-09-19T05:37:00.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f2660ff9640 1 -- 172.21.15.67:0/282135404 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2658017070 con 0x7f26640d0de0 2024-09-19T05:37:00.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- 172.21.15.67:0/282135404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266406ebe0 con 0x7f26640d0de0 2024-09-19T05:37:00.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f2660ff9640 1 -- 172.21.15.67:0/282135404 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658012c30 con 0x7f26640d0de0 2024-09-19T05:37:00.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.009+0000 7f266a526640 1 -- 172.21.15.67:0/282135404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f266406e8e0 con 0x7f26640d0de0 2024-09-19T05:37:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f2660ff9640 1 -- 172.21.15.67:0/282135404 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f265801c460 con 0x7f26640d0de0 2024-09-19T05:37:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f2660ff9640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26500678c0 0x7f2650069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f2660ff9640 1 -- 172.21.15.67:0/282135404 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f2658085b70 con 0x7f26640d0de0 2024-09-19T05:37:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f2663fff640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26500678c0 0x7f2650069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f266d5e2000 1 Processor -- start 2024-09-19T05:37:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f266d5e2000 1 -- start start 2024-09-19T05:37:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f2663fff640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26500678c0 0x7f2650069d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f265400a8d0 tx=0x7f2654008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563202137d40 0x563202138120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202138660 0x5632020eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 0x5632020ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f266d5e2000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563201fd6a20 con 0x563202138660 2024-09-19T05:37:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f266d5e2000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563201f3bba0 con 0x5632020ef400 2024-09-19T05:37:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f266d5e2000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563201ee1bb0 con 0x563202137d40 2024-09-19T05:37:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f26637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202138660 0x5632020eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f26637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202138660 0x5632020eeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55142/0 (socket says 172.21.15.67:55142) 2024-09-19T05:37:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f26637fe640 1 -- 172.21.15.67:0/1287296518 learned_addr learned my addr 172.21.15.67:0/1287296518 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f2663fff640 1 --2- 172.21.15.67:0/1287296518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563202137d40 0x563202138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f2668ac3640 1 --2- 172.21.15.67:0/1287296518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 0x5632020ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f26637fe640 1 -- 172.21.15.67:0/1287296518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563202137d40 msgr2=0x563202138120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f26637fe640 1 --2- 172.21.15.67:0/1287296518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563202137d40 0x563202138120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f26637fe640 1 -- 172.21.15.67:0/1287296518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 msgr2=0x5632020ef7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f26637fe640 1 --2- 172.21.15.67:0/1287296518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 0x5632020ef7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f26637fe640 1 -- 172.21.15.67:0/1287296518 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563201f82ee0 con 0x563202138660 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f26637fe640 1 --2- 172.21.15.67:0/1287296518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202138660 0x5632020eeec0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f265805e530 tx=0x7f2658055f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13fb6507eb5ea276 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f2649ffb640 1 -- 172.21.15.67:0/1287296518 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658054180 con 0x563202138660 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.013+0000 7f2649ffb640 1 -- 172.21.15.67:0/1287296518 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26580524f0 con 0x563202138660 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f2649ffb640 1 -- 172.21.15.67:0/1287296518 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265805e7f0 con 0x563202138660 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- 172.21.15.67:0/1287296518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202138660 msgr2=0x5632020eeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 --2- 172.21.15.67:0/1287296518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202138660 0x5632020eeec0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f265805e530 tx=0x7f2658055f40 comp rx=0 tx=0).stop 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- 172.21.15.67:0/1287296518 shutdown_connections 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 --2- 172.21.15.67:0/1287296518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 0x5632020ef7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 --2- 172.21.15.67:0/1287296518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202138660 0x5632020eeec0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 --2- 172.21.15.67:0/1287296518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563202137d40 0x563202138120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- 172.21.15.67:0/1287296518 >> 172.21.15.67:0/1287296518 conn(0x5632020eb3b0 msgr2=0x5632020ed7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- 172.21.15.67:0/1287296518 shutdown_connections 2024-09-19T05:37:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- 172.21.15.67:0/1287296518 wait complete. 2024-09-19T05:37:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- start start 2024-09-19T05:37:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 Processor -- start 2024-09-19T05:37:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5632020ef400 0x5632020f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 0x5632020f9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563201ed5d20 con 0x563202137d40 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563201f37b60 con 0x563202138660 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563201f401d0 con 0x5632020ef400 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 10 client.0 _ll_register_callbacks cb 0x563201f9f120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f26637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f26637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55158/0 (socket says 172.21.15.67:55158) 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f26637fe640 1 -- 172.21.15.67:0/3051714294 learned_addr learned my addr 172.21.15.67:0/3051714294 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f2663fff640 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5632020ef400 0x5632020f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f2668ac3640 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 0x5632020f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f26637fe640 1 -- 172.21.15.67:0/3051714294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5632020ef400 msgr2=0x5632020f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f26637fe640 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5632020ef400 0x5632020f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f26637fe640 1 -- 172.21.15.67:0/3051714294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 msgr2=0x5632020f9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f26637fe640 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 0x5632020f9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f26637fe640 1 -- 172.21.15.67:0/3051714294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563201f16e20 con 0x563202137d40 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f26637fe640 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f42c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2658083fc0 tx=0x7f2658014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd0d83ab1083889 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f2642ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f2642ffd640 1 -- 172.21.15.67:0/3051714294 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26580742e0 con 0x563202137d40 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- 172.21.15.67:0/3051714294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26580524f0 con 0x563202137d40 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f2642ffd640 1 -- 172.21.15.67:0/3051714294 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f265805e5d0 con 0x563202137d40 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f2642ffd640 1 -- 172.21.15.67:0/3051714294 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2658074480 con 0x563202137d40 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 10 client.5694 fetch_fsmap learned FSMap version 24 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- 172.21.15.67:0/3051714294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x563201f0e9c0 con 0x563202137d40 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f2642ffd640 1 -- 172.21.15.67:0/3051714294 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26580524f0 con 0x563202137d40 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f2642ffd640 1 -- 172.21.15.67:0/3051714294 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f265807d3d0 con 0x563202137d40 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 10 client.5694 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 10 client.5694 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 20 client.5694 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56320213deb0 0x56320213e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 4 client.5694 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f266d5e2000 1 -- 172.21.15.67:0/3051714294 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563201ed61e0 con 0x56320213deb0 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.017+0000 7f2663fff640 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56320213deb0 0x56320213e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f2642ffd640 10 client.5694 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f2663fff640 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56320213deb0 0x56320213e290 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ea17e913e74d4b2 server_cookie=e106f8451d12cbe7 in_seq=0 out_seq=0 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f2642ffd640 1 -- 172.21.15.67:0/3051714294 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563201ed61e0 con 0x56320213deb0 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f2642ffd640 10 client.5694 handle_command_reply: tid=0 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 client.5694 shutdown 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 -- 172.21.15.67:0/3051714294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 msgr2=0x5632020f42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f42c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2658083fc0 tx=0x7f2658014040 comp rx=0 tx=0).stop 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 -- 172.21.15.67:0/3051714294 shutdown_connections 2024-09-19T05:37:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56320213deb0 0x56320213e290 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 0x5632020f9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f2642ffd640 0 client.5694 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f42c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 --2- 172.21.15.67:0/3051714294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5632020ef400 0x5632020f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 -- 172.21.15.67:0/3051714294 >> 172.21.15.67:0/3051714294 conn(0x5632020eb3b0 msgr2=0x5632020edfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 -- 172.21.15.67:0/3051714294 shutdown_connections 2024-09-19T05:37:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 1 -- 172.21.15.67:0/3051714294 wait complete. 2024-09-19T05:37:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.021+0000 7f266d5e2000 20 client.5694 trim_cache size 0 max 16384 2024-09-19T05:37:00.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.033+0000 7f266d5e2000 1 Processor -- start 2024-09-19T05:37:00.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.033+0000 7f266d5e2000 1 -- start start 2024-09-19T05:37:00.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 0x563202144700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563202138660 0x5632020f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2664203da0 con 0x563202137d40 2024-09-19T05:37:00.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2664202df0 con 0x5632020ef400 2024-09-19T05:37:00.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f266415b0a0 con 0x563202138660 2024-09-19T05:37:00.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55164/0 (socket says 172.21.15.67:55164) 2024-09-19T05:37:00.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 -- 172.21.15.67:0/2786992446 learned_addr learned my addr 172.21.15.67:0/2786992446 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 -- 172.21.15.67:0/2786992446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563202138660 msgr2=0x5632020f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f2668ac3640 1 --2- 172.21.15.67:0/2786992446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563202138660 0x5632020f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f2663fff640 1 --2- 172.21.15.67:0/2786992446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 0x563202144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 --2- 172.21.15.67:0/2786992446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563202138660 0x5632020f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 -- 172.21.15.67:0/2786992446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 msgr2=0x563202144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 --2- 172.21.15.67:0/2786992446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 0x563202144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 -- 172.21.15.67:0/2786992446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563202138490 con 0x563202137d40 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f2663fff640 1 --2- 172.21.15.67:0/2786992446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 0x563202144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 --2- 172.21.15.67:0/2786992446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f38e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2658055950 tx=0x7f265800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e97401a1d872cba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26497fa640 1 -- 172.21.15.67:0/2786992446 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26580742e0 con 0x563202137d40 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26497fa640 1 -- 172.21.15.67:0/2786992446 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2658062070 con 0x563202137d40 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26497fa640 1 -- 172.21.15.67:0/2786992446 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658052120 con 0x563202137d40 2024-09-19T05:37:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- 172.21.15.67:0/2786992446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 msgr2=0x5632020f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 --2- 172.21.15.67:0/2786992446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f38e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2658055950 tx=0x7f265800a000 comp rx=0 tx=0).stop 2024-09-19T05:37:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- 172.21.15.67:0/2786992446 shutdown_connections 2024-09-19T05:37:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 --2- 172.21.15.67:0/2786992446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563202138660 0x5632020f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 --2- 172.21.15.67:0/2786992446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x5632020f38e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 --2- 172.21.15.67:0/2786992446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5632020ef400 0x563202144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- 172.21.15.67:0/2786992446 >> 172.21.15.67:0/2786992446 conn(0x5632020eb3b0 msgr2=0x5632020ed7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- 172.21.15.67:0/2786992446 shutdown_connections 2024-09-19T05:37:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- 172.21.15.67:0/2786992446 wait complete. 2024-09-19T05:37:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- start start 2024-09-19T05:37:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 Processor -- start 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5632020ef400 0x56320214e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x563202144530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 0x563202144a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563202137bc0 con 0x563202137d40 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5632020f7d00 con 0x563202138660 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563201f3bba0 con 0x5632020ef400 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f266d5e2000 10 client.0 _ll_register_callbacks cb 0x7f2658056580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x563202144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x563202144530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55166/0 (socket says 172.21.15.67:55166) 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 -- 172.21.15.67:0/198711939 learned_addr learned my addr 172.21.15.67:0/198711939 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f2663fff640 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5632020ef400 0x56320214e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f2668ac3640 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 0x563202144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 -- 172.21.15.67:0/198711939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5632020ef400 msgr2=0x56320214e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5632020ef400 0x56320214e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 -- 172.21.15.67:0/198711939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 msgr2=0x563202144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 0x563202144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f26637fe640 1 -- 172.21.15.67:0/198711939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632020f98b0 con 0x563202137d40 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.037+0000 7f2668ac3640 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 0x563202144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f26637fe640 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x563202144530 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2658055950 tx=0x7f2658007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49f394af05b5b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f2642ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f2642ffd640 1 -- 172.21.15.67:0/198711939 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26580742e0 con 0x563202137d40 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f266d5e2000 1 -- 172.21.15.67:0/198711939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2658062070 con 0x563202137d40 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f2642ffd640 1 -- 172.21.15.67:0/198711939 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f265805c430 con 0x563202137d40 2024-09-19T05:37:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f2642ffd640 1 -- 172.21.15.67:0/198711939 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f26580524f0 con 0x563202137d40 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f266d5e2000 10 client.5700 fetch_fsmap learned FSMap version 24 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f266d5e2000 1 -- 172.21.15.67:0/198711939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x563201ee1e00 con 0x563202137d40 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f2642ffd640 1 -- 172.21.15.67:0/198711939 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2658062070 con 0x563202137d40 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f2642ffd640 1 -- 172.21.15.67:0/198711939 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f2658051bd0 con 0x563202137d40 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f266d5e2000 10 client.5700 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f266d5e2000 10 client.5700 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f266d5e2000 20 client.5700 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f266d5e2000 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5632021412f0 0x563202141700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f266d5e2000 4 client.5700 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}] 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f266d5e2000 1 -- 172.21.15.67:0/198711939 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}) -- 0x563201f492d0 con 0x5632021412f0 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f2663fff640 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5632021412f0 0x563202141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f2663fff640 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5632021412f0 0x563202141700 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f36a903ee4a1bb08 server_cookie=492cf282a71832e1 in_seq=0 out_seq=0 2024-09-19T05:37:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.041+0000 7f2642ffd640 10 client.5700 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f2642ffd640 1 -- 172.21.15.67:0/198711939 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563201f492d0 con 0x5632021412f0 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f2642ffd640 10 client.5700 handle_command_reply: tid=0 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 client.5700 shutdown 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 -- 172.21.15.67:0/198711939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 msgr2=0x563202144530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x563202144530 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2658055950 tx=0x7f2658007f90 comp rx=0 tx=0).stop 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 -- 172.21.15.67:0/198711939 shutdown_connections 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5632021412f0 0x563202141700 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563202138660 0x563202144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563202137d40 0x563202144530 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f2642ffd640 0 client.5700 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 --2- 172.21.15.67:0/198711939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5632020ef400 0x56320214e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 -- 172.21.15.67:0/198711939 >> 172.21.15.67:0/198711939 conn(0x5632020eb3b0 msgr2=0x5632020edfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 -- 172.21.15.67:0/198711939 shutdown_connections 2024-09-19T05:37:00.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 1 -- 172.21.15.67:0/198711939 wait complete. 2024-09-19T05:37:00.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266d5e2000 20 client.5700 trim_cache size 0 max 16384 2024-09-19T05:37:00.052 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:00.052 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:37:00.052 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:37:00.052 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:00.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 -- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26500678c0 msgr2=0x7f2650069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26500678c0 0x7f2650069d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f265400a8d0 tx=0x7f2654008040 comp rx=0 tx=0).stop 2024-09-19T05:37:00.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 -- 172.21.15.67:0/282135404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 msgr2=0x7f266406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 0x7f266406de60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f265800c450 tx=0x7f265800c910 comp rx=0 tx=0).stop 2024-09-19T05:37:00.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 -- 172.21.15.67:0/282135404 shutdown_connections 2024-09-19T05:37:00.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f266415f950 0x7f266406e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26640d0de0 0x7f266406de60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26500678c0 0x7f2650069d80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 --2- 172.21.15.67:0/282135404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26640b3750 0x7f2664154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 -- 172.21.15.67:0/282135404 >> 172.21.15.67:0/282135404 conn(0x7f26640d22f0 msgr2=0x7f26640afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 -- 172.21.15.67:0/282135404 shutdown_connections 2024-09-19T05:37:00.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.045+0000 7f266a526640 1 -- 172.21.15.67:0/282135404 wait complete. 2024-09-19T05:37:00.070 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' returned '{'message': '', 'return_code': 0}' 2024-09-19T05:37:00.070 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:37:00.070 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:00.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:00.075 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-19T05:37:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:37:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:37:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175495 s, 59.7 MB/s 2024-09-19T05:37:00.205 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-19T05:37:00.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-19T05:37:00.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f7340266640 1 Processor -- start 2024-09-19T05:37:00.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f7340266640 1 -- start start 2024-09-19T05:37:00.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f7340266640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 0x7f733806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f7340266640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f733806d850 0x7f73380afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f7340266640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73380b1130 con 0x7f733815c6d0 2024-09-19T05:37:00.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f7340266640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f733806cc10 con 0x7f733806d850 2024-09-19T05:37:00.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f7340266640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f73380b1410 con 0x7f73380b2a30 2024-09-19T05:37:00.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f733d801640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 0x7f733806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f733e803640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f733806d850 0x7f73380afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f733e002640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f733815c6d0 0x7f73380b2320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:43288/0 (socket says 172.21.15.67:43288) 2024-09-19T05:37:00.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.333+0000 7f733e002640 1 -- 172.21.15.67:0/1082119237 learned_addr learned my addr 172.21.15.67:0/1082119237 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:00.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.337+0000 7f733d801640 1 -- 172.21.15.67:0/1082119237 >> v2:172.21.15.97:3300/0 conn(0x7f733806d850 msgr2=0x7f73380afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.337+0000 7f733d801640 1 --2- 172.21.15.67:0/1082119237 >> v2:172.21.15.97:3300/0 conn(0x7f733806d850 0x7f73380afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.337+0000 7f733d801640 1 -- 172.21.15.67:0/1082119237 >> v1:172.21.15.97:6789/0 conn(0x7f733815c6d0 legacy=0x7f73380b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.337+0000 7f733d801640 1 -- 172.21.15.67:0/1082119237 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73380b16f0 con 0x7f73380b2a30 2024-09-19T05:37:00.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.337+0000 7f733d801640 1 --2- 172.21.15.67:0/1082119237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 0x7f733806c6d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f732c0097c0 tx=0x7f732c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc9a4a6378c3061 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.337+0000 7f733d000640 1 -- 172.21.15.67:0/1082119237 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c0b2070 con 0x7f73380b2a30 2024-09-19T05:37:00.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.337+0000 7f733d000640 1 -- 172.21.15.67:0/1082119237 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f732c0ad640 con 0x7f73380b2a30 2024-09-19T05:37:00.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.337+0000 7f733d000640 1 -- 172.21.15.67:0/1082119237 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c0ada10 con 0x7f73380b2a30 2024-09-19T05:37:00.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- 172.21.15.67:0/1082119237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 msgr2=0x7f733806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 --2- 172.21.15.67:0/1082119237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 0x7f733806c6d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f732c0097c0 tx=0x7f732c01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- 172.21.15.67:0/1082119237 shutdown_connections 2024-09-19T05:37:00.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 --2- 172.21.15.67:0/1082119237 >> v2:172.21.15.97:3300/0 conn(0x7f733806d850 0x7f73380afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 --2- 172.21.15.67:0/1082119237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 0x7f733806c6d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- 172.21.15.67:0/1082119237 >> 172.21.15.67:0/1082119237 conn(0x7f7338073760 msgr2=0x7f733809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- 172.21.15.67:0/1082119237 shutdown_connections 2024-09-19T05:37:00.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- 172.21.15.67:0/1082119237 wait complete. 2024-09-19T05:37:00.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 Processor -- start 2024-09-19T05:37:00.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- start start 2024-09-19T05:37:00.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f733806d850 0x7f73380b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 0x7f733814f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733814f5b0 0x7f73380b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73380b0c20 con 0x7f733814f5b0 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f73380b0aa0 con 0x7f733806d850 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f73380b0da0 con 0x7f73380b2a30 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e803640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733814f5b0 0x7f73380b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e803640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733814f5b0 0x7f73380b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55172/0 (socket says 172.21.15.67:55172) 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e803640 1 -- 172.21.15.67:0/318587813 learned_addr learned my addr 172.21.15.67:0/318587813 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e002640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f733806d850 0x7f73380b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733d801640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 0x7f733814f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e803640 1 -- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 msgr2=0x7f733814f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e803640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 0x7f733814f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e803640 1 -- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f733806d850 msgr2=0x7f73380b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e803640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f733806d850 0x7f73380b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e803640 1 -- 172.21.15.67:0/318587813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733814fac0 con 0x7f733814f5b0 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733d801640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 0x7f733814f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e002640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f733806d850 0x7f73380b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f733e803640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733814f5b0 0x7f73380b55c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f732800e930 tx=0x7f732800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f73367fc640 1 -- 172.21.15.67:0/318587813 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328017070 con 0x7f733814f5b0 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f73367fc640 1 -- 172.21.15.67:0/318587813 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f732800c9a0 con 0x7f733814f5b0 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- 172.21.15.67:0/318587813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7338150080 con 0x7f733814f5b0 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f73367fc640 1 -- 172.21.15.67:0/318587813 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732800cd70 con 0x7f733814f5b0 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.341+0000 7f7340266640 1 -- 172.21.15.67:0/318587813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7338150640 con 0x7f733814f5b0 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f73367fc640 1 -- 172.21.15.67:0/318587813 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f732801a070 con 0x7f733814f5b0 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f73367fc640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73240678c0 0x7f7324069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f73367fc640 1 -- 172.21.15.67:0/318587813 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f7328086270 con 0x7f733814f5b0 2024-09-19T05:37:00.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e002640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73240678c0 0x7f7324069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f7343322000 1 Processor -- start 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f7343322000 1 -- start start 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e002640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73240678c0 0x7f7324069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7330005c10 tx=0x7f7330009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f7343322000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614545d40 0x563614546120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f7343322000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 0x5636144fcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f7343322000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x5636144fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f7343322000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5636143e4a20 con 0x5636144fd400 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f7343322000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563614349ba0 con 0x563614545d40 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f7343322000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5636142efbb0 con 0x563614546660 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e803640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x5636144fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e803640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x5636144fd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55178/0 (socket says 172.21.15.67:55178) 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e803640 1 -- 172.21.15.67:0/1101846371 learned_addr learned my addr 172.21.15.67:0/1101846371 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e002640 1 --2- 172.21.15.67:0/1101846371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614545d40 0x563614546120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733d801640 1 --2- 172.21.15.67:0/1101846371 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 0x5636144fcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e803640 1 -- 172.21.15.67:0/1101846371 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 msgr2=0x5636144fcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e803640 1 --2- 172.21.15.67:0/1101846371 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 0x5636144fcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e803640 1 -- 172.21.15.67:0/1101846371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614545d40 msgr2=0x563614546120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e803640 1 --2- 172.21.15.67:0/1101846371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614545d40 0x563614546120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e803640 1 -- 172.21.15.67:0/1101846371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563614390ee0 con 0x5636144fd400 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.345+0000 7f733e002640 1 --2- 172.21.15.67:0/1101846371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614545d40 0x563614546120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e803640 1 --2- 172.21.15.67:0/1101846371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x5636144fd7e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f73280564a0 tx=0x7f7328056d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fe1c31fbe48038 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f731f7fe640 1 -- 172.21.15.67:0/1101846371 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328021040 con 0x5636144fd400 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f731f7fe640 1 -- 172.21.15.67:0/1101846371 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7328054810 con 0x5636144fd400 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f731f7fe640 1 -- 172.21.15.67:0/1101846371 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328086070 con 0x5636144fd400 2024-09-19T05:37:00.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- 172.21.15.67:0/1101846371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 msgr2=0x5636144fd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 --2- 172.21.15.67:0/1101846371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x5636144fd7e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f73280564a0 tx=0x7f7328056d40 comp rx=0 tx=0).stop 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- 172.21.15.67:0/1101846371 shutdown_connections 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 --2- 172.21.15.67:0/1101846371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x5636144fd7e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 --2- 172.21.15.67:0/1101846371 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 0x5636144fcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 --2- 172.21.15.67:0/1101846371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614545d40 0x563614546120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- 172.21.15.67:0/1101846371 >> 172.21.15.67:0/1101846371 conn(0x5636144f93b0 msgr2=0x5636144fb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- 172.21.15.67:0/1101846371 shutdown_connections 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- 172.21.15.67:0/1101846371 wait complete. 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- start start 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 Processor -- start 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x563614507540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614545d40 0x563614507a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 0x563614507fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5636142e3d20 con 0x5636144fd400 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563614345b60 con 0x563614546660 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56361434e1d0 con 0x563614545d40 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 10 client.0 _ll_register_callbacks cb 0x5636143ad120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e002640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x563614507540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e002640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x563614507540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55192/0 (socket says 172.21.15.67:55192) 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e002640 1 -- 172.21.15.67:0/1267892834 learned_addr learned my addr 172.21.15.67:0/1267892834 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e803640 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 0x563614507fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e002640 1 -- 172.21.15.67:0/1267892834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614545d40 msgr2=0x563614507a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733d801640 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614545d40 0x563614507a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e002640 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614545d40 0x563614507a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e002640 1 -- 172.21.15.67:0/1267892834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 msgr2=0x563614507fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e002640 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 0x563614507fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e002640 1 -- 172.21.15.67:0/1267892834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563614324e20 con 0x5636144fd400 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733e002640 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x563614507540 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7330007450 tx=0x7f7330001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853979a8ebe0fa0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f731cff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f731cff9640 1 -- 172.21.15.67:0/1267892834 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330015110 con 0x5636144fd400 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f731cff9640 1 -- 172.21.15.67:0/1267892834 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f7330021c40 con 0x5636144fd400 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- 172.21.15.67:0/1267892834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7328054810 con 0x5636144fd400 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f731cff9640 1 -- 172.21.15.67:0/1267892834 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7330021e40 con 0x5636144fd400 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 10 client.5709 fetch_fsmap learned FSMap version 24 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- 172.21.15.67:0/1267892834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x56361431c9c0 con 0x5636144fd400 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f731cff9640 1 -- 172.21.15.67:0/1267892834 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7328054810 con 0x5636144fd400 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f731cff9640 1 -- 172.21.15.67:0/1267892834 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f73300159c0 con 0x5636144fd400 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 10 client.5709 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:37:00.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 10 client.5709 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 20 client.5709 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563614554dd0 0x5636145571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 4 client.5709 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f7343322000 1 -- 172.21.15.67:0/1267892834 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636142e41e0 con 0x563614554dd0 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.349+0000 7f733d801640 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563614554dd0 0x5636145571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f731cff9640 10 client.5709 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f733d801640 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563614554dd0 0x5636145571c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=725c3a8bc0a04e05 server_cookie=be0ccf41fdc57f36 in_seq=0 out_seq=0 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f731cff9640 1 -- 172.21.15.67:0/1267892834 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636142e41e0 con 0x563614554dd0 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f731cff9640 10 client.5709 handle_command_reply: tid=0 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 client.5709 shutdown 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 -- 172.21.15.67:0/1267892834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 msgr2=0x563614507540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x563614507540 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7330007450 tx=0x7f7330001260 comp rx=0 tx=0).stop 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 -- 172.21.15.67:0/1267892834 shutdown_connections 2024-09-19T05:37:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563614554dd0 0x5636145571c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 0x563614507fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614545d40 0x563614507a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f731cff9640 0 client.5709 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 --2- 172.21.15.67:0/1267892834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636144fd400 0x563614507540 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 -- 172.21.15.67:0/1267892834 >> 172.21.15.67:0/1267892834 conn(0x5636144f93b0 msgr2=0x5636144fbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 -- 172.21.15.67:0/1267892834 shutdown_connections 2024-09-19T05:37:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 1 -- 172.21.15.67:0/1267892834 wait complete. 2024-09-19T05:37:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.353+0000 7f7343322000 20 client.5709 trim_cache size 0 max 16384 2024-09-19T05:37:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 Processor -- start 2024-09-19T05:37:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- start start 2024-09-19T05:37:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636144fd400 0x563614502b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 0x563614557700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7338203fd0 con 0x563614545d40 2024-09-19T05:37:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7338203040 con 0x5636144fd400 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f733814d0a0 con 0x563614546660 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733d801640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733d801640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55202/0 (socket says 172.21.15.67:55202) 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733d801640 1 -- 172.21.15.67:0/3838177260 learned_addr learned my addr 172.21.15.67:0/3838177260 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733e002640 1 --2- 172.21.15.67:0/3838177260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636144fd400 0x563614502b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733e803640 1 --2- 172.21.15.67:0/3838177260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 0x563614557700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733d801640 1 -- 172.21.15.67:0/3838177260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 msgr2=0x563614557700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733d801640 1 --2- 172.21.15.67:0/3838177260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 0x563614557700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733d801640 1 -- 172.21.15.67:0/3838177260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636144fd400 msgr2=0x563614502b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733d801640 1 --2- 172.21.15.67:0/3838177260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636144fd400 0x563614502b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733d801640 1 -- 172.21.15.67:0/3838177260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636142efe00 con 0x563614545d40 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733e803640 1 --2- 172.21.15.67:0/3838177260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 0x563614557700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f733d801640 1 --2- 172.21.15.67:0/3838177260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145571c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f732c000c10 tx=0x7f732c0a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82561f4c3eeb4134 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f731effd640 1 -- 172.21.15.67:0/3838177260 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c0b2040 con 0x563614545d40 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f731effd640 1 -- 172.21.15.67:0/3838177260 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f732c0ad680 con 0x563614545d40 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f731effd640 1 -- 172.21.15.67:0/3838177260 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c0ada30 con 0x563614545d40 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- 172.21.15.67:0/3838177260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 msgr2=0x5636145571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 --2- 172.21.15.67:0/3838177260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145571c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f732c000c10 tx=0x7f732c0a7070 comp rx=0 tx=0).stop 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- 172.21.15.67:0/3838177260 shutdown_connections 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 --2- 172.21.15.67:0/3838177260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563614546660 0x563614557700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 --2- 172.21.15.67:0/3838177260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145571c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 --2- 172.21.15.67:0/3838177260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636144fd400 0x563614502b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- 172.21.15.67:0/3838177260 >> 172.21.15.67:0/3838177260 conn(0x5636144f93b0 msgr2=0x563614501470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- 172.21.15.67:0/3838177260 shutdown_connections 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- 172.21.15.67:0/3838177260 wait complete. 2024-09-19T05:37:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- start start 2024-09-19T05:37:00.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 Processor -- start 2024-09-19T05:37:00.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636144fd400 0x56361455a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 0x5636145759f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56361430f9a0 con 0x563614545d40 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f733814d6f0 con 0x563614546660 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563614348eb0 con 0x5636144fd400 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.381+0000 7f7343322000 10 client.0 _ll_register_callbacks cb 0x7f73300014e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733d801640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733d801640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55206/0 (socket says 172.21.15.67:55206) 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733d801640 1 -- 172.21.15.67:0/2349915475 learned_addr learned my addr 172.21.15.67:0/2349915475 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733e803640 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 0x5636145759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733e002640 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636144fd400 0x56361455a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733d801640 1 -- 172.21.15.67:0/2349915475 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636144fd400 msgr2=0x56361455a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733d801640 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636144fd400 0x56361455a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733d801640 1 -- 172.21.15.67:0/2349915475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 msgr2=0x5636145759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733d801640 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 0x5636145759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733d801640 1 -- 172.21.15.67:0/2349915475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636142ddce0 con 0x563614545d40 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733e803640 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 0x5636145759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733d801640 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145754b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f732c0190b0 tx=0x7f732c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b458fac02a0b81ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f731cff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f731cff9640 1 -- 172.21.15.67:0/2349915475 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c0b2040 con 0x563614545d40 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f731cff9640 1 -- 172.21.15.67:0/2349915475 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f732c0ceca0 con 0x563614545d40 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f7343322000 1 -- 172.21.15.67:0/2349915475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f732c0ad680 con 0x563614545d40 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f731cff9640 1 -- 172.21.15.67:0/2349915475 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f732c0ad8f0 con 0x563614545d40 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f7343322000 10 client.5715 fetch_fsmap learned FSMap version 24 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f7343322000 1 -- 172.21.15.67:0/2349915475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5636142e1c40 con 0x563614545d40 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f731cff9640 1 -- 172.21.15.67:0/2349915475 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f732c0ad680 con 0x563614545d40 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f731cff9640 1 -- 172.21.15.67:0/2349915475 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f732c0cc070 con 0x563614545d40 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f7343322000 10 client.5715 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:37:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f7343322000 10 client.5715 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:00.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f7343322000 20 client.5715 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:00.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f7343322000 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563614575f30 0x5636145b9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f7343322000 4 client.5715 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-19T05:37:00.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f7343322000 1 -- 172.21.15.67:0/2349915475 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x5636143572d0 con 0x563614575f30 2024-09-19T05:37:00.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733e002640 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563614575f30 0x5636145b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f731cff9640 10 client.5715 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.385+0000 7f733e002640 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563614575f30 0x5636145b9110 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a71d08ce29ecc89 server_cookie=6ec30cbbd3e79c34 in_seq=0 out_seq=0 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f731cff9640 1 -- 172.21.15.67:0/2349915475 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5636143572d0 con 0x563614575f30 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f731cff9640 10 client.5715 handle_command_reply: tid=0 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 client.5715 shutdown 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 -- 172.21.15.67:0/2349915475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 msgr2=0x5636145754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145754b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f732c0190b0 tx=0x7f732c0046d0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 -- 172.21.15.67:0/2349915475 shutdown_connections 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x563614575f30 0x5636145b9110 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563614546660 0x5636145759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f731cff9640 0 client.5715 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563614545d40 0x5636145754b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 --2- 172.21.15.67:0/2349915475 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636144fd400 0x56361455a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 -- 172.21.15.67:0/2349915475 >> 172.21.15.67:0/2349915475 conn(0x5636144f93b0 msgr2=0x5636144fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 -- 172.21.15.67:0/2349915475 shutdown_connections 2024-09-19T05:37:00.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 1 -- 172.21.15.67:0/2349915475 wait complete. 2024-09-19T05:37:00.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7343322000 20 client.5715 trim_cache size 0 max 16384 2024-09-19T05:37:00.428 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:00.428 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:37:00.428 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:37:00.428 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:00.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 -- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73240678c0 msgr2=0x7f7324069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73240678c0 0x7f7324069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7330005c10 tx=0x7f7330009040 comp rx=0 tx=0).stop 2024-09-19T05:37:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 -- 172.21.15.67:0/318587813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733814f5b0 msgr2=0x7f73380b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733814f5b0 0x7f73380b55c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f732800e930 tx=0x7f732800edf0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 -- 172.21.15.67:0/318587813 shutdown_connections 2024-09-19T05:37:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f733814f5b0 0x7f73380b55c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73240678c0 0x7f7324069d80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73380b2a30 0x7f733814f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 --2- 172.21.15.67:0/318587813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f733806d850 0x7f73380b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 -- 172.21.15.67:0/318587813 >> 172.21.15.67:0/318587813 conn(0x7f7338073760 msgr2=0x7f733806f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 -- 172.21.15.67:0/318587813 shutdown_connections 2024-09-19T05:37:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.421+0000 7f7340266640 1 -- 172.21.15.67:0/318587813 wait complete. 2024-09-19T05:37:00.448 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'message': '', 'return_code': 0}' 2024-09-19T05:37:00.448 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:37:00.449 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:37:00.449 DEBUG:teuthology.orchestra.run.smithi067:> import stat 2024-09-19T05:37:00.449 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:00.449 DEBUG:teuthology.orchestra.run.smithi067:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-09-19T05:37:00.449 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:37:00.498 INFO:teuthology.orchestra.run.smithi067.stdout:1099511630409 2024-09-19T05:37:00.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:00.506 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-19T05:37:00.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.657+0000 7f7c9ef67640 1 Processor -- start 2024-09-19T05:37:00.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.657+0000 7f7c9ef67640 1 -- start start 2024-09-19T05:37:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.657+0000 7f7c9ef67640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7c980b3940 0x7f7c98072970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.657+0000 7f7c9ef67640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c98072eb0 0x7f7c980ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.657+0000 7f7c9ef67640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9806eaa0 con 0x7f7c980ad810 2024-09-19T05:37:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.657+0000 7f7c9ef67640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7c980adc40 con 0x7f7c980b3940 2024-09-19T05:37:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.657+0000 7f7c9ef67640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9806e850 con 0x7f7c98072eb0 2024-09-19T05:37:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.657+0000 7f7c9d504640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7c980ad810 0x7f7c9806f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46754/0 (socket says 172.21.15.67:46754) 2024-09-19T05:37:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.657+0000 7f7c9d504640 1 -- 172.21.15.67:0/129338889 learned_addr learned my addr 172.21.15.67:0/129338889 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:00.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c97fff640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c98072eb0 0x7f7c980ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/129338889 >> v2:172.21.15.97:3300/0 conn(0x7f7c980b3940 0x7f7c98072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107226651 0 0) 0x7f7c9806eaa0 con 0x7f7c980ad810 2024-09-19T05:37:00.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c88003530 con 0x7f7c980ad810 2024-09-19T05:37:00.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2679616412 0 0) 0x7f7c88003530 con 0x7f7c980ad810 2024-09-19T05:37:00.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c98072eb0 msgr2=0x7f7c980ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c98072eb0 0x7f7c980ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 >> v2:172.21.15.97:3300/0 conn(0x7f7c980b3940 msgr2=0x7f7c98072970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 --2- 172.21.15.67:0/129338889 >> v2:172.21.15.97:3300/0 conn(0x7f7c980b3940 0x7f7c98072970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9806ed80 con 0x7f7c980ad810 2024-09-19T05:37:00.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7c90001a00 con 0x7f7c980ad810 2024-09-19T05:37:00.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 >> v1:172.21.15.67:6789/0 conn(0x7f7c980ad810 legacy=0x7f7c9806f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c880039c0 0x7f7c88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c98072eb0 0x7f7c88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c88004d50 0x7f7c880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9806e850 con 0x7f7c88004d50 2024-09-19T05:37:00.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8800b9d0 con 0x7f7c880039c0 2024-09-19T05:37:00.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7c8800bb50 con 0x7f7c98072eb0 2024-09-19T05:37:00.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9d504640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c88004d50 0x7f7c880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c880039c0 0x7f7c88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c97fff640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c98072eb0 0x7f7c88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9d504640 1 -- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c98072eb0 msgr2=0x7f7c88004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9d504640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c98072eb0 0x7f7c88004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9d504640 1 -- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c880039c0 msgr2=0x7f7c88003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9d504640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c880039c0 0x7f7c88003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9d504640 1 -- 172.21.15.67:0/129338889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c88003530 con 0x7f7c88004d50 2024-09-19T05:37:00.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c880039c0 0x7f7c88003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:00.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9d504640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c88004d50 0x7f7c880051d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000b8b0 tx=0x7f7c9001e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31a6b744aa27215 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000c040 con 0x7f7c88004d50 2024-09-19T05:37:00.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900af070 con 0x7f7c88004d50 2024-09-19T05:37:00.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c977fe640 1 -- 172.21.15.67:0/129338889 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900aa8c0 con 0x7f7c88004d50 2024-09-19T05:37:00.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9ef67640 1 -- 172.21.15.67:0/129338889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c88004d50 msgr2=0x7f7c880051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9ef67640 1 --2- 172.21.15.67:0/129338889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c88004d50 0x7f7c880051d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000b8b0 tx=0x7f7c9001e5d0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9d504640 1 -- 172.21.15.67:0/129338889 reap_dead start 2024-09-19T05:37:00.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9ef67640 1 -- 172.21.15.67:0/129338889 shutdown_connections 2024-09-19T05:37:00.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.661+0000 7f7c9ef67640 1 -- 172.21.15.67:0/129338889 >> 172.21.15.67:0/129338889 conn(0x7f7c980b1e50 msgr2=0x7f7c980b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 -- 172.21.15.67:0/129338889 shutdown_connections 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 -- 172.21.15.67:0/129338889 wait complete. 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 Processor -- start 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 -- start start 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c88004d50 0x7f7c98154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c9809d820 0x7f7c9809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c9815d150 0x7f7c9815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7c980b3310 con 0x7f7c9809d820 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9806f3d0 con 0x7f7c88004d50 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7c980b3490 con 0x7f7c9815d150 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c9809d820 0x7f7c9809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c9809d820 0x7f7c9809dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55234/0 (socket says 172.21.15.67:55234) 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c97fff640 1 -- 172.21.15.67:0/2350946440 learned_addr learned my addr 172.21.15.67:0/2350946440 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c88004d50 0x7f7c98154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9d504640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c9815d150 0x7f7c9815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c97fff640 1 -- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c9815d150 msgr2=0x7f7c9815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c97fff640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c9815d150 0x7f7c9815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c97fff640 1 -- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c88004d50 msgr2=0x7f7c98154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c97fff640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c88004d50 0x7f7c98154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c97fff640 1 -- 172.21.15.67:0/2350946440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9809b6a0 con 0x7f7c9809d820 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c97fff640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c9809d820 0x7f7c9809dca0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7c84011640 tx=0x7f7c84011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c957fa640 1 -- 172.21.15.67:0/2350946440 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400f920 con 0x7f7c9809d820 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c957fa640 1 -- 172.21.15.67:0/2350946440 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8400fac0 con 0x7f7c9809d820 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 -- 172.21.15.67:0/2350946440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9809b980 con 0x7f7c9809d820 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c957fa640 1 -- 172.21.15.67:0/2350946440 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400fe70 con 0x7f7c9809d820 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.665+0000 7f7c9ef67640 1 -- 172.21.15.67:0/2350946440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c981598c0 con 0x7f7c9809d820 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c957fa640 1 -- 172.21.15.67:0/2350946440 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7c84015460 con 0x7f7c9809d820 2024-09-19T05:37:00.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c957fa640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c7c0678f0 0x7f7c7c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c957fa640 1 -- 172.21.15.67:0/2350946440 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f7c84086740 con 0x7f7c9809d820 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 Processor -- start 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 -- start start 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c7c0678f0 0x7f7c7c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 0x5576246c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9ca0 0x55762467f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x55762467fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557624566c40 con 0x55762467f7d0 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5576244cdd50 con 0x5576246c9380 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557624488ab0 con 0x5576246c9ca0 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9d504640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x55762467fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9d504640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x55762467fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55244/0 (socket says 172.21.15.67:55244) 2024-09-19T05:37:00.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9d504640 1 -- 172.21.15.67:0/20791295 learned_addr learned my addr 172.21.15.67:0/20791295 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c7c0678f0 0x7f7c7c069db0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7c98159300 tx=0x7f7c8c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 0x5576246c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9d504640 1 -- 172.21.15.67:0/20791295 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9ca0 msgr2=0x55762467f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c97fff640 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9ca0 0x55762467f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9d504640 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9ca0 0x55762467f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9d504640 1 -- 172.21.15.67:0/20791295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 msgr2=0x5576246c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9d504640 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 0x5576246c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9d504640 1 -- 172.21.15.67:0/20791295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557624474590 con 0x55762467f7d0 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c97fff640 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9ca0 0x55762467f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 0x5576246c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c9d504640 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x55762467fbb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000b7d0 tx=0x7f7c980b2ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632f2045c92492a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c827fc640 1 -- 172.21.15.67:0/20791295 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900019c0 con 0x55762467f7d0 2024-09-19T05:37:00.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c827fc640 1 -- 172.21.15.67:0/20791295 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900af070 con 0x55762467f7d0 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7c827fc640 1 -- 172.21.15.67:0/20791295 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900aa660 con 0x55762467f7d0 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 -- 172.21.15.67:0/20791295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 msgr2=0x55762467fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x55762467fbb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000b7d0 tx=0x7f7c980b2ed0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 -- 172.21.15.67:0/20791295 shutdown_connections 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x55762467fbb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9ca0 0x55762467f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 --2- 172.21.15.67:0/20791295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 0x5576246c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 -- 172.21.15.67:0/20791295 >> 172.21.15.67:0/20791295 conn(0x557624676bc0 msgr2=0x55762467db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 -- 172.21.15.67:0/20791295 shutdown_connections 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.669+0000 7f7ca2023000 1 -- 172.21.15.67:0/20791295 wait complete. 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 -- start start 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 Processor -- start 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 0x5576246d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 0x5576246d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9ca0 0x55762468a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55762448c400 con 0x5576246c9ca0 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55762458a3a0 con 0x5576246c9380 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55762450d260 con 0x55762467f7d0 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 10 client.0 _ll_register_callbacks cb 0x55762452f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9d504640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9ca0 0x55762468a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9d504640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9ca0 0x55762468a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55252/0 (socket says 172.21.15.67:55252) 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9d504640 1 -- 172.21.15.67:0/3535007921 learned_addr learned my addr 172.21.15.67:0/3535007921 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c97fff640 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 0x5576246d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 0x5576246d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9d504640 1 -- 172.21.15.67:0/3535007921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 msgr2=0x5576246d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9d504640 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 0x5576246d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9d504640 1 -- 172.21.15.67:0/3535007921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 msgr2=0x5576246d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9d504640 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 0x5576246d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9d504640 1 -- 172.21.15.67:0/3535007921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557624470dd0 con 0x5576246c9ca0 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 0x5576246d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9d504640 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9ca0 0x55762468a130 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7c90001d00 tx=0x7f7c9001b370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764a1b2f9d56ebcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c777fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c777fe640 1 -- 172.21.15.67:0/3535007921 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900aa870 con 0x5576246c9ca0 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c777fe640 1 -- 172.21.15.67:0/3535007921 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f7c900aaa10 con 0x5576246c9ca0 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 -- 172.21.15.67:0/3535007921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c900af070 con 0x5576246c9ca0 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c777fe640 1 -- 172.21.15.67:0/3535007921 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7c900aac10 con 0x5576246c9ca0 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 10 client.5727 fetch_fsmap learned FSMap version 24 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 -- 172.21.15.67:0/3535007921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55762446d800 con 0x5576246c9ca0 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c777fe640 1 -- 172.21.15.67:0/3535007921 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900af070 con 0x5576246c9ca0 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c777fe640 1 -- 172.21.15.67:0/3535007921 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f7c900070b0 con 0x5576246c9ca0 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 10 client.5727 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:37:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 10 client.5727 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 20 client.5727 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55762468ab40 0x55762468af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 4 client.5727 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 -- 172.21.15.67:0/3535007921 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557624467e20 con 0x55762468ab40 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55762468ab40 0x55762468af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c777fe640 10 client.5727 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55762468ab40 0x55762468af20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=226c9a480658176c server_cookie=4fc485759f1b0ce2 in_seq=0 out_seq=0 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c777fe640 1 -- 172.21.15.67:0/3535007921 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557624467e20 con 0x55762468ab40 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c777fe640 10 client.5727 handle_command_reply: tid=0 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 client.5727 shutdown 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 -- 172.21.15.67:0/3535007921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9ca0 msgr2=0x55762468a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9ca0 0x55762468a130 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7c90001d00 tx=0x7f7c9001b370 comp rx=0 tx=0).stop 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 -- 172.21.15.67:0/3535007921 shutdown_connections 2024-09-19T05:37:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9ca0 0x55762468a130 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55762468ab40 0x55762468af20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9380 0x5576246d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 --2- 172.21.15.67:0/3535007921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 0x5576246d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7c777fe640 0 client.5727 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.673+0000 7f7ca2023000 1 -- 172.21.15.67:0/3535007921 >> 172.21.15.67:0/3535007921 conn(0x557624676bc0 msgr2=0x55762467e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.677+0000 7f7ca2023000 1 -- 172.21.15.67:0/3535007921 shutdown_connections 2024-09-19T05:37:00.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.677+0000 7f7ca2023000 1 -- 172.21.15.67:0/3535007921 wait complete. 2024-09-19T05:37:00.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.677+0000 7f7ca2023000 20 client.5727 trim_cache size 0 max 16384 2024-09-19T05:37:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 Processor -- start 2024-09-19T05:37:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 -- start start 2024-09-19T05:37:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 0x5576246e0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9380 0x5576246e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 0x5576246d40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7c981fe360 con 0x5576246c9380 2024-09-19T05:37:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7c980b50f0 con 0x5576246c9ca0 2024-09-19T05:37:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7c981fdda0 con 0x55762467f7d0 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9380 0x5576246e0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9380 0x5576246e0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55264/0 (socket says 172.21.15.67:55264) 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c97fff640 1 -- 172.21.15.67:0/506314938 learned_addr learned my addr 172.21.15.67:0/506314938 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c97fff640 1 -- 172.21.15.67:0/506314938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 msgr2=0x5576246e0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c9d504640 1 --2- 172.21.15.67:0/506314938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 0x5576246d40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/506314938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 0x5576246e0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c97fff640 1 --2- 172.21.15.67:0/506314938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 0x5576246e0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c97fff640 1 -- 172.21.15.67:0/506314938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 msgr2=0x5576246d40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c97fff640 1 --2- 172.21.15.67:0/506314938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 0x5576246d40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c97fff640 1 -- 172.21.15.67:0/506314938 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55762448b480 con 0x5576246c9380 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c97fff640 1 --2- 172.21.15.67:0/506314938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9380 0x5576246e0ad0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7c84008010 tx=0x7f7c8405bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4e7f83edf3d615 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c81ffb640 1 -- 172.21.15.67:0/506314938 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8405f630 con 0x5576246c9380 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c81ffb640 1 -- 172.21.15.67:0/506314938 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c84054d50 con 0x5576246c9380 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7c81ffb640 1 -- 172.21.15.67:0/506314938 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8405f1a0 con 0x5576246c9380 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 -- 172.21.15.67:0/506314938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9380 msgr2=0x5576246e0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 --2- 172.21.15.67:0/506314938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9380 0x5576246e0ad0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7c84008010 tx=0x7f7c8405bf90 comp rx=0 tx=0).stop 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 -- 172.21.15.67:0/506314938 shutdown_connections 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 --2- 172.21.15.67:0/506314938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 0x5576246d40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 --2- 172.21.15.67:0/506314938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5576246c9380 0x5576246e0ad0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 --2- 172.21.15.67:0/506314938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55762467f7d0 0x5576246e0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 -- 172.21.15.67:0/506314938 >> 172.21.15.67:0/506314938 conn(0x557624676bc0 msgr2=0x5576246dfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 -- 172.21.15.67:0/506314938 shutdown_connections 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.689+0000 7f7ca2023000 1 -- 172.21.15.67:0/506314938 wait complete. 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- start start 2024-09-19T05:37:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 Processor -- start 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x5576247237f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9380 0x557624739950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 0x557624739e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557624473f30 con 0x55762467f7d0 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55762448c7d0 con 0x5576246c9ca0 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5576244cd060 con 0x5576246c9380 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 10 client.0 _ll_register_callbacks cb 0x7f7c8c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9cd03640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x5576247237f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9cd03640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x5576247237f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55274/0 (socket says 172.21.15.67:55274) 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9cd03640 1 -- 172.21.15.67:0/4260325398 learned_addr learned my addr 172.21.15.67:0/4260325398 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9d504640 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 0x557624739e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c97fff640 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9380 0x557624739950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9cd03640 1 -- 172.21.15.67:0/4260325398 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9380 msgr2=0x557624739950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9380 0x557624739950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9cd03640 1 -- 172.21.15.67:0/4260325398 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 msgr2=0x557624739e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 0x557624739e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9cd03640 1 -- 172.21.15.67:0/4260325398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557624461650 con 0x55762467f7d0 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9d504640 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 0x557624739e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9cd03640 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x5576247237f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c013d00 tx=0x7f7c8c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817a4cb1829b502a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c777fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c777fe640 1 -- 172.21.15.67:0/4260325398 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c013af0 con 0x55762467f7d0 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c777fe640 1 -- 172.21.15.67:0/4260325398 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f7c8c016670 con 0x55762467f7d0 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- 172.21.15.67:0/4260325398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c84054d50 con 0x55762467f7d0 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c777fe640 1 -- 172.21.15.67:0/4260325398 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7c8c03a050 con 0x55762467f7d0 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 10 client.5733 fetch_fsmap learned FSMap version 24 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- 172.21.15.67:0/4260325398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5576244653c0 con 0x55762467f7d0 2024-09-19T05:37:00.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c777fe640 1 -- 172.21.15.67:0/4260325398 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c84054d50 con 0x55762467f7d0 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c777fe640 1 -- 172.21.15.67:0/4260325398 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f7c8c03d020 con 0x55762467f7d0 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 10 client.5733 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 10 client.5733 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 20 client.5733 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55762473a3d0 0x55762473a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 4 client.5733 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- 172.21.15.67:0/4260325398 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576244db480 con 0x55762473a3d0 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c97fff640 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55762473a3d0 0x55762473a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c97fff640 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55762473a3d0 0x55762473a7e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c4d500dfe5215cb server_cookie=dbf3c70cd356a2dd in_seq=0 out_seq=0 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c777fe640 10 client.5733 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c777fe640 1 -- 172.21.15.67:0/4260325398 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576244db480 con 0x55762473a3d0 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c777fe640 10 client.5733 handle_command_reply: tid=0 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 client.5733 shutdown 2024-09-19T05:37:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- 172.21.15.67:0/4260325398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 msgr2=0x5576247237f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x5576247237f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c013d00 tx=0x7f7c8c004740 comp rx=0 tx=0).stop 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- 172.21.15.67:0/4260325398 shutdown_connections 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55762473a3d0 0x55762473a7e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5576246c9ca0 0x557624739e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5576246c9380 0x557624739950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c777fe640 0 client.5733 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 --2- 172.21.15.67:0/4260325398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55762467f7d0 0x5576247237f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- 172.21.15.67:0/4260325398 >> 172.21.15.67:0/4260325398 conn(0x557624676bc0 msgr2=0x5576246e0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- 172.21.15.67:0/4260325398 shutdown_connections 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 1 -- 172.21.15.67:0/4260325398 wait complete. 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7ca2023000 20 client.5733 trim_cache size 0 max 16384 2024-09-19T05:37:00.706 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-19T05:37:00.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9ef67640 1 -- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c7c0678f0 msgr2=0x7f7c7c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9ef67640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c7c0678f0 0x7f7c7c069db0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7c98159300 tx=0x7f7c8c008040 comp rx=0 tx=0).stop 2024-09-19T05:37:00.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9ef67640 1 -- 172.21.15.67:0/2350946440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c9809d820 msgr2=0x7f7c9809dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9ef67640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c9809d820 0x7f7c9809dca0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7c84011640 tx=0x7f7c84011b00 comp rx=0 tx=0).stop 2024-09-19T05:37:00.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9ef67640 1 -- 172.21.15.67:0/2350946440 shutdown_connections 2024-09-19T05:37:00.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9ef67640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c7c0678f0 0x7f7c7c069db0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9ef67640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c9815d150 0x7f7c9815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9ef67640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c9809d820 0x7f7c9809dca0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9ef67640 1 --2- 172.21.15.67:0/2350946440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c88004d50 0x7f7c98154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.693+0000 7f7c9ef67640 1 -- 172.21.15.67:0/2350946440 >> 172.21.15.67:0/2350946440 conn(0x7f7c980b1e50 msgr2=0x7f7c9806df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.697+0000 7f7c9ef67640 1 -- 172.21.15.67:0/2350946440 shutdown_connections 2024-09-19T05:37:00.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.697+0000 7f7c9ef67640 1 -- 172.21.15.67:0/2350946440 wait complete. 2024-09-19T05:37:00.715 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a49.00000000 parent 2024-09-19T05:37:00.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 Processor -- start 2024-09-19T05:37:00.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 -- start start 2024-09-19T05:37:00.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efecc0022b0 0x55de6bb0f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6baec7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55de6bba0f70 0x55de6bb9e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55de6bafa260 con 0x55de6bb9f930 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55de6ba1a1b0 con 0x55de6bba0f70 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55de6bafa500 con 0x7efecc0022b0 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efedf3f8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6baec7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efedf3f8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6baec7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55288/0 (socket says 172.21.15.67:55288) 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efedf3f8640 1 -- 172.21.15.67:0/2748276996 learned_addr learned my addr 172.21.15.67:0/2748276996 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee03fa640 1 --2- 172.21.15.67:0/2748276996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55de6bba0f70 0x55de6bb9e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efedfbf9640 1 --2- 172.21.15.67:0/2748276996 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efecc0022b0 0x55de6bb0f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efedf3f8640 1 -- 172.21.15.67:0/2748276996 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efecc0022b0 msgr2=0x55de6bb0f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efedf3f8640 1 --2- 172.21.15.67:0/2748276996 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efecc0022b0 0x55de6bb0f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efedf3f8640 1 -- 172.21.15.67:0/2748276996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55de6bba0f70 msgr2=0x55de6bb9e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efedf3f8640 1 --2- 172.21.15.67:0/2748276996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55de6bba0f70 0x55de6bb9e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efedf3f8640 1 -- 172.21.15.67:0/2748276996 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6bb109b0 con 0x55de6bb9f930 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efedf3f8640 1 --2- 172.21.15.67:0/2748276996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6baec7c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efec800b7c0 tx=0x7efec800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ca1414dcb1efc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efede3f6640 1 -- 172.21.15.67:0/2748276996 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec80079e0 con 0x55de6bb9f930 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efede3f6640 1 -- 172.21.15.67:0/2748276996 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec8007b80 con 0x55de6bb9f930 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efede3f6640 1 -- 172.21.15.67:0/2748276996 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8015420 con 0x55de6bb9f930 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 -- 172.21.15.67:0/2748276996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 msgr2=0x55de6baec7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 --2- 172.21.15.67:0/2748276996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6baec7c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efec800b7c0 tx=0x7efec800bc80 comp rx=0 tx=0).stop 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 -- 172.21.15.67:0/2748276996 shutdown_connections 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 --2- 172.21.15.67:0/2748276996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55de6bba0f70 0x55de6bb9e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 --2- 172.21.15.67:0/2748276996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6baec7c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 --2- 172.21.15.67:0/2748276996 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efecc0022b0 0x55de6bb0f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 -- 172.21.15.67:0/2748276996 >> 172.21.15.67:0/2748276996 conn(0x55de6baf7130 msgr2=0x55de6baf6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 -- 172.21.15.67:0/2748276996 shutdown_connections 2024-09-19T05:37:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.741+0000 7efee20e6080 1 -- 172.21.15.67:0/2748276996 wait complete. 2024-09-19T05:37:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 Processor -- start 2024-09-19T05:37:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 -- start start 2024-09-19T05:37:00.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6bb9ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55de6bba0f70 0x55de6bb987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efecc0022b0 0x55de6bb0f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55de6baf6890 con 0x55de6bb9f930 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55de6bb10c50 con 0x55de6bba0f70 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55de6baf6b30 con 0x7efecc0022b0 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedfbf9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6bb9ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedfbf9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6bb9ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55302/0 (socket says 172.21.15.67:55302) 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedfbf9640 1 -- 172.21.15.67:0/3243014081 learned_addr learned my addr 172.21.15.67:0/3243014081 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedfbf9640 1 -- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efecc0022b0 msgr2=0x55de6bb0f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee03fa640 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efecc0022b0 0x55de6bb0f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedf3f8640 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55de6bba0f70 0x55de6bb987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedfbf9640 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efecc0022b0 0x55de6bb0f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedfbf9640 1 -- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55de6bba0f70 msgr2=0x55de6bb987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedfbf9640 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55de6bba0f70 0x55de6bb987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedfbf9640 1 -- 172.21.15.67:0/3243014081 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6bb9df90 con 0x55de6bb9f930 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedfbf9640 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6bb9ae10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7efed0006040 tx=0x7efecc004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedd3f4640 1 -- 172.21.15.67:0/3243014081 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed00062d0 con 0x55de6bb9f930 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedd3f4640 1 -- 172.21.15.67:0/3243014081 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed00a7a50 con 0x55de6bb9f930 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 -- 172.21.15.67:0/3243014081 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de6bb9e230 con 0x55de6bb9f930 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedd3f4640 1 -- 172.21.15.67:0/3243014081 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed00a7e20 con 0x55de6bb9f930 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 -- 172.21.15.67:0/3243014081 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6bb9e770 con 0x55de6bb9f930 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedd3f4640 1 -- 172.21.15.67:0/3243014081 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efed0003460 con 0x55de6bb9f930 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedd3f4640 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efec00662a0 0x7efec0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedd3f4640 1 -- 172.21.15.67:0/3243014081 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7efed01218e0 con 0x55de6bb9f930 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x55de6baed020 0x55de6baed400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee20e6080 1 -- 172.21.15.67:0/3243014081 --> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] -- osd_op(unknown.0.0:1 8.1f 8:f95eeb57:::10000000a49.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55de6baed940 con 0x55de6baed020 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efedf3f8640 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efec00662a0 0x7efec0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.745+0000 7efee03fa640 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x55de6baed020 0x55de6baed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee03fa640 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x55de6baed020 0x55de6baed400 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efedf3f8640 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efec00662a0 0x7efec0068760 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efec800bcc0 tx=0x7efec800b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee03fa640 1 -- 172.21.15.67:0/3243014081 <== osd.0 v2:172.21.15.67:6816/1029707859 1 ==== osd_op_reply(1 10000000a49.00000000 [rmxattr] v57'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7efed8007400 con 0x55de6baed020 2024-09-19T05:37:00.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee20e6080 1 -- 172.21.15.67:0/3243014081 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x55de6baed020 msgr2=0x55de6baed400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee20e6080 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x55de6baed020 0x55de6baed400 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee20e6080 1 -- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efec00662a0 msgr2=0x7efec0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee20e6080 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efec00662a0 0x7efec0068760 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efec800bcc0 tx=0x7efec800b000 comp rx=0 tx=0).stop 2024-09-19T05:37:00.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee20e6080 1 -- 172.21.15.67:0/3243014081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 msgr2=0x55de6bb9ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee20e6080 1 --2- 172.21.15.67:0/3243014081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55de6bb9f930 0x55de6bb9ae10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7efed0006040 tx=0x7efecc004130 comp rx=0 tx=0).stop 2024-09-19T05:37:00.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee03fa640 1 -- 172.21.15.67:0/3243014081 reap_dead start 2024-09-19T05:37:00.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee20e6080 1 -- 172.21.15.67:0/3243014081 shutdown_connections 2024-09-19T05:37:00.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee20e6080 1 -- 172.21.15.67:0/3243014081 >> 172.21.15.67:0/3243014081 conn(0x55de6baf7130 msgr2=0x55de6bab4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee20e6080 1 -- 172.21.15.67:0/3243014081 shutdown_connections 2024-09-19T05:37:00.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.749+0000 7efee20e6080 1 -- 172.21.15.67:0/3243014081 wait complete. 2024-09-19T05:37:00.757 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-19T05:37:00.757 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-19T05:37:00.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.917+0000 7f1ce10ff640 1 Processor -- start 2024-09-19T05:37:00.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1ce10ff640 1 -- start start 2024-09-19T05:37:00.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1ce10ff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1cdc15b1d0 0x7f1cdc0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1ce10ff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc070070 0x7f1cdc0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1ce10ff640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc0aef30 con 0x7f1cdc06dfc0 2024-09-19T05:37:00.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1ce10ff640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1cdc072210 con 0x7f1cdc15b1d0 2024-09-19T05:37:00.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1ce10ff640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1cdc0ae0f0 con 0x7f1cdc070070 2024-09-19T05:37:00.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cdad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1cdc15b1d0 0x7f1cdc0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cdad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1cdc15b1d0 0x7f1cdc0adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55306/0 (socket says 172.21.15.67:55306) 2024-09-19T05:37:00.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1034293593 learned_addr learned my addr 172.21.15.67:0/1034293593 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cdb59e640 1 --2- 172.21.15.67:0/1034293593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc070070 0x7f1cdc0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1034293593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc070070 msgr2=0x7f1cdc0b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/1034293593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc070070 0x7f1cdc0b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1034293593 >> v1:172.21.15.67:6789/0 conn(0x7f1cdc06dfc0 legacy=0x7f1cdc06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1034293593 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc0ae3b0 con 0x7f1cdc15b1d0 2024-09-19T05:37:00.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/1034293593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc15b1d0 0x7f1cdc0adbb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009870 tx=0x7f1cd001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8bf886f4a660ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cd9d9b640 1 -- 172.21.15.67:0/1034293593 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00ab650 con 0x7f1cdc15b1d0 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cd9d9b640 1 -- 172.21.15.67:0/1034293593 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00b0070 con 0x7f1cdc15b1d0 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.921+0000 7f1cd9d9b640 1 -- 172.21.15.67:0/1034293593 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00aba10 con 0x7f1cdc15b1d0 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- 172.21.15.67:0/1034293593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc15b1d0 msgr2=0x7f1cdc0adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 --2- 172.21.15.67:0/1034293593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc15b1d0 0x7f1cdc0adbb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009870 tx=0x7f1cd001c560 comp rx=0 tx=0).stop 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- 172.21.15.67:0/1034293593 shutdown_connections 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 --2- 172.21.15.67:0/1034293593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc070070 0x7f1cdc0b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 --2- 172.21.15.67:0/1034293593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc15b1d0 0x7f1cdc0adbb0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- 172.21.15.67:0/1034293593 >> 172.21.15.67:0/1034293593 conn(0x7f1cdc0b1e50 msgr2=0x7f1cdc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- 172.21.15.67:0/1034293593 shutdown_connections 2024-09-19T05:37:00.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- 172.21.15.67:0/1034293593 wait complete. 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 Processor -- start 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- start start 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc06dfc0 0x7f1cdc152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc070070 0x7f1cdc1f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cdc15b1d0 0x7f1cdc15cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc0b4180 con 0x7f1cdc070070 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc072420 con 0x7f1cdc15b1d0 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1cdc0b4300 con 0x7f1cdc06dfc0 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cda59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc070070 0x7f1cdc1f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cda59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc070070 0x7f1cdc1f7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55314/0 (socket says 172.21.15.67:55314) 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cda59c640 1 -- 172.21.15.67:0/3332637659 learned_addr learned my addr 172.21.15.67:0/3332637659 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc06dfc0 0x7f1cdc152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cdb59e640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cdc15b1d0 0x7f1cdc15cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cda59c640 1 -- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc06dfc0 msgr2=0x7f1cdc152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cda59c640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc06dfc0 0x7f1cdc152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cda59c640 1 -- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cdc15b1d0 msgr2=0x7f1cdc15cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cda59c640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cdc15b1d0 0x7f1cdc15cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cda59c640 1 -- 172.21.15.67:0/3332637659 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc1652b0 con 0x7f1cdc070070 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc06dfc0 0x7f1cdc152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cda59c640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc070070 0x7f1cdc1f7bb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00c370 tx=0x7f1ccc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cc37fe640 1 -- 172.21.15.67:0/3332637659 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc0052d0 con 0x7f1cdc070070 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cc37fe640 1 -- 172.21.15.67:0/3332637659 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc005470 con 0x7f1cdc070070 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- 172.21.15.67:0/3332637659 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cdc165590 con 0x7f1cdc070070 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1cc37fe640 1 -- 172.21.15.67:0/3332637659 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc007260 con 0x7f1cdc070070 2024-09-19T05:37:00.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.925+0000 7f1ce10ff640 1 -- 172.21.15.67:0/3332637659 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cdc150e10 con 0x7f1cdc070070 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cc37fe640 1 -- 172.21.15.67:0/3332637659 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ccc007400 con 0x7f1cdc070070 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cc37fe640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1cc80678c0 0x7f1cc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cc37fe640 1 -- 172.21.15.67:0/3332637659 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1ccc085370 con 0x7f1cdc070070 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1cc80678c0 0x7f1cc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1ce41bb000 1 Processor -- start 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1ce41bb000 1 -- start start 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1cc80678c0 0x7f1cc8069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00af000 tx=0x7f1cd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e32fd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 0x5635e32b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32b0c00 0x5635e32b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5635e3100b50 con 0x5635e32fce40 2024-09-19T05:37:00.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5635e30a6370 con 0x5635e32fd760 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5635e30fcb10 con 0x5635e32b0c00 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e32fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e32fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55320/0 (socket says 172.21.15.67:55320) 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1333057714 learned_addr learned my addr 172.21.15.67:0/1333057714 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdb59e640 1 --2- 172.21.15.67:0/1333057714 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32b0c00 0x5635e32b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1333057714 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32b0c00 msgr2=0x5635e32b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/1333057714 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32b0c00 0x5635e32b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cda59c640 1 --2- 172.21.15.67:0/1333057714 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 0x5635e32b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1333057714 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 msgr2=0x5635e32b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/1333057714 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 0x5635e32b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1333057714 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635e31097c0 con 0x5635e32fce40 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/1333057714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e32fd220 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0097f20 tx=0x7f1cd0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2303eeafa2477472 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cc0ff9640 1 -- 172.21.15.67:0/1333057714 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00b4a40 con 0x5635e32fce40 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cc0ff9640 1 -- 172.21.15.67:0/1333057714 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00c4070 con 0x5635e32fce40 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.929+0000 7f1cc0ff9640 1 -- 172.21.15.67:0/1333057714 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00b4de0 con 0x5635e32fce40 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1333057714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 msgr2=0x5635e32fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/1333057714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e32fd220 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0097f20 tx=0x7f1cd0004740 comp rx=0 tx=0).stop 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1333057714 shutdown_connections 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/1333057714 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32b0c00 0x5635e32b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/1333057714 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 0x5635e32b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/1333057714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e32fd220 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1333057714 >> 172.21.15.67:0/1333057714 conn(0x5635e32ddbe0 msgr2=0x5635e32dffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1333057714 shutdown_connections 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1333057714 wait complete. 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- start start 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 Processor -- start 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32b0c00 0x5635e32b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32fce40 0x5635e32c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fd760 0x5635e32c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5635e30ffe60 con 0x5635e32fd760 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5635e309a650 con 0x5635e32b0c00 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5635e317df10 con 0x5635e32fce40 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 10 client.0 _ll_register_callbacks cb 0x5635e329e0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdb59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fd760 0x5635e32c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdb59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fd760 0x5635e32c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55336/0 (socket says 172.21.15.67:55336) 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdb59e640 1 -- 172.21.15.67:0/4156435782 learned_addr learned my addr 172.21.15.67:0/4156435782 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cda59c640 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32fce40 0x5635e32c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32b0c00 0x5635e32b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdb59e640 1 -- 172.21.15.67:0/4156435782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32fce40 msgr2=0x5635e32c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdb59e640 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32fce40 0x5635e32c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdb59e640 1 -- 172.21.15.67:0/4156435782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32b0c00 msgr2=0x5635e32b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdb59e640 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32b0c00 0x5635e32b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdb59e640 1 -- 172.21.15.67:0/4156435782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635e30c3eb0 con 0x5635e32fd760 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdb59e640 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fd760 0x5635e32c7fc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40079a0 tx=0x7f1cd4007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685f8c2a1059b572 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/4156435782 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4019020 con 0x5635e32fd760 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- 172.21.15.67:0/4156435782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd00c4070 con 0x5635e32fd760 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/4156435782 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1cd4010bb0 con 0x5635e32fd760 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/4156435782 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1cd4023050 con 0x5635e32fd760 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 10 client.5757 fetch_fsmap learned FSMap version 24 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- 172.21.15.67:0/4156435782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5635e30a6590 con 0x5635e32fd760 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/4156435782 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00c4070 con 0x5635e32fd760 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/4156435782 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f1cd4026020 con 0x5635e32fd760 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 10 client.5757 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:37:00.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 10 client.5757 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 20 client.5757 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5635e32c89d0 0x5635e32c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 4 client.5757 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1ce41bb000 1 -- 172.21.15.67:0/4156435782 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635e309ad30 con 0x5635e32c89d0 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5635e32c89d0 0x5635e32c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5635e32c89d0 0x5635e32c8de0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd549b81860c0dec server_cookie=ef744b14ba0cf92e in_seq=0 out_seq=0 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.933+0000 7f1cb9ffb640 10 client.5757 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/4156435782 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635e309ad30 con 0x5635e32c89d0 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1cb9ffb640 10 client.5757 handle_command_reply: tid=0 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 client.5757 shutdown 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 -- 172.21.15.67:0/4156435782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fd760 msgr2=0x5635e32c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fd760 0x5635e32c7fc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40079a0 tx=0x7f1cd4007e60 comp rx=0 tx=0).stop 2024-09-19T05:37:00.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 -- 172.21.15.67:0/4156435782 shutdown_connections 2024-09-19T05:37:00.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fd760 0x5635e32c7fc0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32fce40 0x5635e32c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5635e32c89d0 0x5635e32c8de0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/4156435782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32b0c00 0x5635e32b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1cb9ffb640 0 client.5757 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 -- 172.21.15.67:0/4156435782 >> 172.21.15.67:0/4156435782 conn(0x5635e32ddbe0 msgr2=0x5635e32afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 -- 172.21.15.67:0/4156435782 shutdown_connections 2024-09-19T05:37:00.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 1 -- 172.21.15.67:0/4156435782 wait complete. 2024-09-19T05:37:00.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.937+0000 7f1ce41bb000 20 client.5757 trim_cache size 0 max 16384 2024-09-19T05:37:00.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 Processor -- start 2024-09-19T05:37:00.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 -- start start 2024-09-19T05:37:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32b0c00 0x5635e336c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e336ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 0x5635e336d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc203e90 con 0x5635e32fce40 2024-09-19T05:37:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc202e90 con 0x5635e32fd760 2024-09-19T05:37:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1cdc1fb620 con 0x5635e32b0c00 2024-09-19T05:37:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cda59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e336ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cda59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e336ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55338/0 (socket says 172.21.15.67:55338) 2024-09-19T05:37:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cda59c640 1 -- 172.21.15.67:0/3854929294 learned_addr learned my addr 172.21.15.67:0/3854929294 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cda59c640 1 -- 172.21.15.67:0/3854929294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32b0c00 msgr2=0x5635e336c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cda59c640 1 --2- 172.21.15.67:0/3854929294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32b0c00 0x5635e336c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cda59c640 1 -- 172.21.15.67:0/3854929294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 msgr2=0x5635e336d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cda59c640 1 --2- 172.21.15.67:0/3854929294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 0x5635e336d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cda59c640 1 -- 172.21.15.67:0/3854929294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635e317e3a0 con 0x5635e32fce40 2024-09-19T05:37:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cda59c640 1 --2- 172.21.15.67:0/3854929294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e336ce10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00a040 tx=0x7f1ccc055d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842111b01d9e7ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cbbfff640 1 -- 172.21.15.67:0/3854929294 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc05e130 con 0x5635e32fce40 2024-09-19T05:37:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cbbfff640 1 -- 172.21.15.67:0/3854929294 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc0850b0 con 0x5635e32fce40 2024-09-19T05:37:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1cbbfff640 1 -- 172.21.15.67:0/3854929294 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc051bc0 con 0x5635e32fce40 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 -- 172.21.15.67:0/3854929294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 msgr2=0x5635e336ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/3854929294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e336ce10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00a040 tx=0x7f1ccc055d10 comp rx=0 tx=0).stop 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 -- 172.21.15.67:0/3854929294 shutdown_connections 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/3854929294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 0x5635e336d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/3854929294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32fce40 0x5635e336ce10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/3854929294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32b0c00 0x5635e336c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 -- 172.21.15.67:0/3854929294 >> 172.21.15.67:0/3854929294 conn(0x5635e32ddbe0 msgr2=0x5635e330e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 -- 172.21.15.67:0/3854929294 shutdown_connections 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.953+0000 7f1ce41bb000 1 -- 172.21.15.67:0/3854929294 wait complete. 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- start start 2024-09-19T05:37:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 Processor -- start 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32b0c00 0x5635e3370640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32fce40 0x5635e3370b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 0x5635e33710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5635e30acbe0 con 0x5635e32b0c00 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc164f50 con 0x5635e32fd760 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5635e3085dc0 con 0x5635e32fce40 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 10 client.0 _ll_register_callbacks cb 0x7f1cd4009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cdad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32b0c00 0x5635e3370640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cdad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32b0c00 0x5635e3370640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55354/0 (socket says 172.21.15.67:55354) 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1928144263 learned_addr learned my addr 172.21.15.67:0/1928144263 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1928144263 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32fce40 msgr2=0x5635e3370b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32fce40 0x5635e3370b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1928144263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 msgr2=0x5635e33710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 0x5635e33710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cdad9d640 1 -- 172.21.15.67:0/1928144263 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635e3159e20 con 0x5635e32b0c00 2024-09-19T05:37:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cdad9d640 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32b0c00 0x5635e3370640 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0008010 tx=0x7f1cd0019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f927348f953e71af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/1928144263 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00cf020 con 0x5635e32b0c00 2024-09-19T05:37:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/1928144263 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1cd00c18b0 con 0x5635e32b0c00 2024-09-19T05:37:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1928144263 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ccc0850b0 con 0x5635e32b0c00 2024-09-19T05:37:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/1928144263 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1cd00c1ab0 con 0x5635e32b0c00 2024-09-19T05:37:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 10 client.5763 fetch_fsmap learned FSMap version 24 2024-09-19T05:37:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1928144263 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5635e3098910 con 0x5635e32b0c00 2024-09-19T05:37:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/1928144263 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc0850b0 con 0x5635e32b0c00 2024-09-19T05:37:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/1928144263 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f1cd00c1c50 con 0x5635e32b0c00 2024-09-19T05:37:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 10 client.5763 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:37:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 10 client.5763 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 20 client.5763 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5635e332c380 0x5635e332c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 4 client.5763 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-19T05:37:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1928144263 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x5635e310e280 con 0x5635e332c380 2024-09-19T05:37:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cda59c640 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5635e332c380 0x5635e332c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cda59c640 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5635e332c380 0x5635e332c790 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9432b120474d3874 server_cookie=8df4fc4d660710 in_seq=0 out_seq=0 2024-09-19T05:37:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cb9ffb640 10 client.5763 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cb9ffb640 1 -- 172.21.15.67:0/1928144263 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5635e310e280 con 0x5635e332c380 2024-09-19T05:37:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cb9ffb640 10 client.5763 handle_command_reply: tid=0 2024-09-19T05:37:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 client.5763 shutdown 2024-09-19T05:37:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1928144263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32b0c00 msgr2=0x5635e3370640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32b0c00 0x5635e3370640 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0008010 tx=0x7f1cd0019300 comp rx=0 tx=0).stop 2024-09-19T05:37:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1928144263 shutdown_connections 2024-09-19T05:37:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5635e332c380 0x5635e332c790 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635e32fd760 0x5635e33710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5635e32fce40 0x5635e3370b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1cb9ffb640 0 client.5763 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 --2- 172.21.15.67:0/1928144263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5635e32b0c00 0x5635e3370640 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1928144263 >> 172.21.15.67:0/1928144263 conn(0x5635e32ddbe0 msgr2=0x5635e330e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1928144263 shutdown_connections 2024-09-19T05:37:00.971 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f5fda2c3640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a49 [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v550 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5529=0-4194304@1} caps={5529=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5529 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55936a61fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a49:[<0x10000000001/new_file_0 v550>,<0x10000000000/ceph-qa-suite v69>,<0x1/scrub_test_path v31>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-19T05:37:00.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 1 -- 172.21.15.67:0/1928144263 wait complete. 2024-09-19T05:37:00.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.957+0000 7f1ce41bb000 20 client.5763 trim_cache size 0 max 16384 2024-09-19T05:37:00.971 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:00.971 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:37:00.972 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "2fd36d98-5686-4f0e-9883-077bc81cfefb", 2024-09-19T05:37:00.972 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:37:00.972 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 -- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1cc80678c0 msgr2=0x7f1cc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1cc80678c0 0x7f1cc8069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00af000 tx=0x7f1cd0008040 comp rx=0 tx=0).stop 2024-09-19T05:37:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 -- 172.21.15.67:0/3332637659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc070070 msgr2=0x7f1cdc1f7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc070070 0x7f1cdc1f7bb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00c370 tx=0x7f1ccc00c830 comp rx=0 tx=0).stop 2024-09-19T05:37:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 -- 172.21.15.67:0/3332637659 shutdown_connections 2024-09-19T05:37:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cdc15b1d0 0x7f1cdc15cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cdc070070 0x7f1cdc1f7bb0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1cc80678c0 0x7f1cc8069d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 --2- 172.21.15.67:0/3332637659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cdc06dfc0 0x7f1cdc152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:00.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 -- 172.21.15.67:0/3332637659 >> 172.21.15.67:0/3332637659 conn(0x7f1cdc0b1e50 msgr2=0x7f1cdc0afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:00.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 -- 172.21.15.67:0/3332637659 shutdown_connections 2024-09-19T05:37:00.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:00.961+0000 7f1ce10ff640 1 -- 172.21.15.67:0/3332637659 wait complete. 2024-09-19T05:37:00.978 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': '2fd36d98-5686-4f0e-9883-077bc81cfefb', 'mode': 'asynchronous'}' 2024-09-19T05:37:00.978 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-19T05:37:00.978 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-19T05:37:01.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.081+0000 7fc6774f5640 1 Processor -- start 2024-09-19T05:37:01.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.081+0000 7fc6774f5640 1 -- start start 2024-09-19T05:37:01.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc6774f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc670070070 0x7fc670165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc6774f5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6700aef30 con 0x7fc67006dfc0 2024-09-19T05:37:01.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc6774f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6700ae3b0 con 0x7fc67015b1d0 2024-09-19T05:37:01.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc6774f5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc670072210 con 0x7fc670070070 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc674a90640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc67006dfc0 0x7fc67006f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46770/0 (socket says 172.21.15.67:46770) 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc674a90640 1 -- 172.21.15.67:0/959362172 learned_addr learned my addr 172.21.15.67:0/959362172 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178582798 0 0) 0x7fc6700aef30 con 0x7fc67006dfc0 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc675a92640 1 --2- 172.21.15.67:0/959362172 >> v2:172.21.15.97:3300/0 conn(0x7fc670070070 0x7fc670165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc658003530 con 0x7fc67006dfc0 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 283485390 0 0) 0x7fc658003530 con 0x7fc67006dfc0 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 >> v2:172.21.15.97:3300/0 conn(0x7fc670070070 msgr2=0x7fc670165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 --2- 172.21.15.67:0/959362172 >> v2:172.21.15.97:3300/0 conn(0x7fc670070070 0x7fc670165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 >> v1:172.21.15.97:6789/0 conn(0x7fc67015b1d0 legacy=0x7fc6700adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6700ae690 con 0x7fc67006dfc0 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fc664001a00 con 0x7fc67006dfc0 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 >> v1:172.21.15.67:6789/0 conn(0x7fc67006dfc0 legacy=0x7fc67006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 --2- 172.21.15.67:0/959362172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6580039c0 0x7fc658003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 --2- 172.21.15.67:0/959362172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc658004810 0x7fc658004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 --2- 172.21.15.67:0/959362172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc65800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc670072210 con 0x7fc6580051d0 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc65800c070 con 0x7fc658004810 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc65800c270 con 0x7fc6580039c0 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc675a92640 1 --2- 172.21.15.67:0/959362172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc65800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc675a92640 1 -- 172.21.15.67:0/959362172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6580039c0 msgr2=0x7fc658003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc674a90640 1 --2- 172.21.15.67:0/959362172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc658004810 0x7fc658004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc675a92640 1 --2- 172.21.15.67:0/959362172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6580039c0 0x7fc658003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc675a92640 1 -- 172.21.15.67:0/959362172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc658004810 msgr2=0x7fc658004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc675a92640 1 --2- 172.21.15.67:0/959362172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc658004810 0x7fc658004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc675a92640 1 -- 172.21.15.67:0/959362172 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc658003530 con 0x7fc6580051d0 2024-09-19T05:37:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc675a92640 1 -- 172.21.15.67:0/959362172 reap_dead start 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.085+0000 7fc675a92640 1 --2- 172.21.15.67:0/959362172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc65800b9d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc6700d1160 tx=0x7fc66001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989986232c0758d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660009690 con 0x7fc6580051d0 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6600a5620 con 0x7fc6580051d0 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc66ffff640 1 -- 172.21.15.67:0/959362172 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6600a59f0 con 0x7fc6580051d0 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- 172.21.15.67:0/959362172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 msgr2=0x7fc65800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 --2- 172.21.15.67:0/959362172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc65800b9d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc6700d1160 tx=0x7fc66001ca30 comp rx=0 tx=0).stop 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- 172.21.15.67:0/959362172 shutdown_connections 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 --2- 172.21.15.67:0/959362172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc65800b9d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- 172.21.15.67:0/959362172 >> 172.21.15.67:0/959362172 conn(0x7fc6700b1e50 msgr2=0x7fc6700b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- 172.21.15.67:0/959362172 shutdown_connections 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- 172.21.15.67:0/959362172 wait complete. 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 Processor -- start 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- start start 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc670150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc67014e5e0 0x7fc6701e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6701e8050 0x7fc670150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc670072420 con 0x7fc6580051d0 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc6700aec50 con 0x7fc67014e5e0 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc67006f960 con 0x7fc6701e8050 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc675291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc670150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc675291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc670150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55380/0 (socket says 172.21.15.67:55380) 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc675291640 1 -- 172.21.15.67:0/1067970192 learned_addr learned my addr 172.21.15.67:0/1067970192 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc674a90640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc67014e5e0 0x7fc6701e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc675a92640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6701e8050 0x7fc670150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc675291640 1 -- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6701e8050 msgr2=0x7fc670150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc675291640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6701e8050 0x7fc670150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc675291640 1 -- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc67014e5e0 msgr2=0x7fc6701e7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc675291640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc67014e5e0 0x7fc6701e7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc675291640 1 -- 172.21.15.67:0/1067970192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67014f490 con 0x7fc6580051d0 2024-09-19T05:37:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc674a90640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc67014e5e0 0x7fc6701e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc675291640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc670150530 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc66800c420 tx=0x7fc66800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc66dffb640 1 -- 172.21.15.67:0/1067970192 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6680052d0 con 0x7fc6580051d0 2024-09-19T05:37:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc66dffb640 1 -- 172.21.15.67:0/1067970192 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc668005470 con 0x7fc6580051d0 2024-09-19T05:37:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- 172.21.15.67:0/1067970192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc67014f770 con 0x7fc6580051d0 2024-09-19T05:37:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc66dffb640 1 -- 172.21.15.67:0/1067970192 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668007260 con 0x7fc6580051d0 2024-09-19T05:37:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.089+0000 7fc6774f5640 1 -- 172.21.15.67:0/1067970192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc67014fd30 con 0x7fc6580051d0 2024-09-19T05:37:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc66dffb640 1 -- 172.21.15.67:0/1067970192 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc668007400 con 0x7fc6580051d0 2024-09-19T05:37:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc66dffb640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc65c0678f0 0x7fc65c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc66dffb640 1 -- 172.21.15.67:0/1067970192 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fc668085340 con 0x7fc6580051d0 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc674a90640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc65c0678f0 0x7fc65c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc67a5b1000 1 Processor -- start 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc67a5b1000 1 -- start start 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc674a90640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc65c0678f0 0x7fc65c069db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc664001b70 tx=0x7fc664009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e85d70 0x55b2d2e86150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e86690 0x55b2d2e39870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e3a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b2d2d23960 con 0x55b2d2e39db0 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b2d2c67900 con 0x55b2d2e86690 2024-09-19T05:37:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b2d2c8ad40 con 0x55b2d2e85d70 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc675a92640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e3a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc675a92640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e3a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55388/0 (socket says 172.21.15.67:55388) 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc675a92640 1 -- 172.21.15.67:0/4267137210 learned_addr learned my addr 172.21.15.67:0/4267137210 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc674a90640 1 --2- 172.21.15.67:0/4267137210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e86690 0x55b2d2e39870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc675291640 1 --2- 172.21.15.67:0/4267137210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e85d70 0x55b2d2e86150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc675a92640 1 -- 172.21.15.67:0/4267137210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e85d70 msgr2=0x55b2d2e86150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc675a92640 1 --2- 172.21.15.67:0/4267137210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e85d70 0x55b2d2e86150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc675a92640 1 -- 172.21.15.67:0/4267137210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e86690 msgr2=0x55b2d2e39870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc675a92640 1 --2- 172.21.15.67:0/4267137210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e86690 0x55b2d2e39870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc675a92640 1 -- 172.21.15.67:0/4267137210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2d2c31580 con 0x55b2d2e39db0 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc674a90640 1 --2- 172.21.15.67:0/4267137210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e86690 0x55b2d2e39870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc675a92640 1 --2- 172.21.15.67:0/4267137210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e3a190 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc66001d2d0 tx=0x7fc660004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e81c5d379c033a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc656ffd640 1 -- 172.21.15.67:0/4267137210 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6600b3070 con 0x55b2d2e39db0 2024-09-19T05:37:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc656ffd640 1 -- 172.21.15.67:0/4267137210 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6600a5620 con 0x55b2d2e39db0 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.093+0000 7fc656ffd640 1 -- 172.21.15.67:0/4267137210 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6600a59f0 con 0x55b2d2e39db0 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/4267137210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 msgr2=0x55b2d2e3a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/4267137210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e3a190 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc66001d2d0 tx=0x7fc660004740 comp rx=0 tx=0).stop 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/4267137210 shutdown_connections 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/4267137210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e3a190 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/4267137210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e86690 0x55b2d2e39870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/4267137210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e85d70 0x55b2d2e86150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/4267137210 >> 172.21.15.67:0/4267137210 conn(0x55b2d2e67040 msgr2=0x55b2d2e69430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/4267137210 shutdown_connections 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/4267137210 wait complete. 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- start start 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 Processor -- start 2024-09-19T05:37:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e39db0 0x55b2d2e8cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2e8d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2e8d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b2d2c86d00 con 0x55b2d2e85d70 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b2d2c45aa0 con 0x55b2d2e39db0 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b2d2c24340 con 0x55b2d2e86690 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 10 client.0 _ll_register_callbacks cb 0x55b2d2e27760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc674a90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2e8d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc674a90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2e8d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55404/0 (socket says 172.21.15.67:55404) 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc674a90640 1 -- 172.21.15.67:0/2460262924 learned_addr learned my addr 172.21.15.67:0/2460262924 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc675291640 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e39db0 0x55b2d2e8cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc674a90640 1 -- 172.21.15.67:0/2460262924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 msgr2=0x55b2d2e8d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc674a90640 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2e8d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc674a90640 1 -- 172.21.15.67:0/2460262924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e39db0 msgr2=0x55b2d2e8cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc674a90640 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e39db0 0x55b2d2e8cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc674a90640 1 -- 172.21.15.67:0/2460262924 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2d2c2ddc0 con 0x55b2d2e85d70 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc674a90640 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2e8d220 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc664007650 tx=0x7fc6700ae580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c015415a6699cae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc64ffff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc64ffff640 1 -- 172.21.15.67:0/2460262924 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664015c20 con 0x55b2d2e85d70 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc64ffff640 1 -- 172.21.15.67:0/2460262924 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fc664015dc0 con 0x55b2d2e85d70 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/2460262924 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6600a5620 con 0x55b2d2e85d70 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc64ffff640 1 -- 172.21.15.67:0/2460262924 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc664013480 con 0x55b2d2e85d70 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 10 client.5775 fetch_fsmap learned FSMap version 24 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/2460262924 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55b2d2c2a7f0 con 0x55b2d2e85d70 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc64ffff640 1 -- 172.21.15.67:0/2460262924 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6600a5620 con 0x55b2d2e85d70 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc64ffff640 1 -- 172.21.15.67:0/2460262924 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7fc664013620 con 0x55b2d2e85d70 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 10 client.5775 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:37:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 10 client.5775 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 20 client.5775 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55b2d2e950b0 0x55b2d2e974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 4 client.5775 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/2460262924 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2d2c24e10 con 0x55b2d2e950b0 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc675291640 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55b2d2e950b0 0x55b2d2e974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc675291640 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55b2d2e950b0 0x55b2d2e974a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e72864e67d52dd60 server_cookie=29d91378adb6f88e in_seq=0 out_seq=0 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc64ffff640 10 client.5775 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc64ffff640 1 -- 172.21.15.67:0/2460262924 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2d2c24e10 con 0x55b2d2e950b0 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc64ffff640 10 client.5775 handle_command_reply: tid=0 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 client.5775 shutdown 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/2460262924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 msgr2=0x55b2d2e8d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2e8d220 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc664007650 tx=0x7fc6700ae580 comp rx=0 tx=0).stop 2024-09-19T05:37:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/2460262924 shutdown_connections 2024-09-19T05:37:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2e8d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2e8d220 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55b2d2e950b0 0x55b2d2e974a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/2460262924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e39db0 0x55b2d2e8cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc64ffff640 0 client.5775 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.097+0000 7fc67a5b1000 1 -- 172.21.15.67:0/2460262924 >> 172.21.15.67:0/2460262924 conn(0x55b2d2e67040 msgr2=0x55b2d2e38f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.101+0000 7fc67a5b1000 1 -- 172.21.15.67:0/2460262924 shutdown_connections 2024-09-19T05:37:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.101+0000 7fc67a5b1000 1 -- 172.21.15.67:0/2460262924 wait complete. 2024-09-19T05:37:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.101+0000 7fc67a5b1000 20 client.5775 trim_cache size 0 max 16384 2024-09-19T05:37:01.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 Processor -- start 2024-09-19T05:37:01.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 -- start start 2024-09-19T05:37:01.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e41c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e85d70 0x55b2d2e42140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2e8fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc670201640 con 0x55b2d2e39db0 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc670200680 con 0x55b2d2e85d70 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc6701535b0 con 0x55b2d2e86690 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc675291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e41c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc675291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e41c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55410/0 (socket says 172.21.15.67:55410) 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc675291640 1 -- 172.21.15.67:0/3854819137 learned_addr learned my addr 172.21.15.67:0/3854819137 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc675a92640 1 --2- 172.21.15.67:0/3854819137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2e8fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc674a90640 1 --2- 172.21.15.67:0/3854819137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e85d70 0x55b2d2e42140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc675291640 1 -- 172.21.15.67:0/3854819137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 msgr2=0x55b2d2e8fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc675291640 1 --2- 172.21.15.67:0/3854819137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2e8fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc675291640 1 -- 172.21.15.67:0/3854819137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e85d70 msgr2=0x55b2d2e42140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc675291640 1 --2- 172.21.15.67:0/3854819137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e85d70 0x55b2d2e42140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc675291640 1 -- 172.21.15.67:0/3854819137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2d2c48470 con 0x55b2d2e39db0 2024-09-19T05:37:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc674a90640 1 --2- 172.21.15.67:0/3854819137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e85d70 0x55b2d2e42140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc675291640 1 --2- 172.21.15.67:0/3854819137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e41c00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc668055270 tx=0x7fc668085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf9cc51e9c5713d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc6567fc640 1 -- 172.21.15.67:0/3854819137 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6680538c0 con 0x55b2d2e39db0 2024-09-19T05:37:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc6567fc640 1 -- 172.21.15.67:0/3854819137 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6680850b0 con 0x55b2d2e39db0 2024-09-19T05:37:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc6567fc640 1 -- 172.21.15.67:0/3854819137 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668054a10 con 0x55b2d2e39db0 2024-09-19T05:37:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 -- 172.21.15.67:0/3854819137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 msgr2=0x55b2d2e41c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/3854819137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e41c00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc668055270 tx=0x7fc668085040 comp rx=0 tx=0).stop 2024-09-19T05:37:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 -- 172.21.15.67:0/3854819137 shutdown_connections 2024-09-19T05:37:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/3854819137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2e8fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/3854819137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e85d70 0x55b2d2e42140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/3854819137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e39db0 0x55b2d2e41c00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.121+0000 7fc67a5b1000 1 -- 172.21.15.67:0/3854819137 >> 172.21.15.67:0/3854819137 conn(0x55b2d2e67040 msgr2=0x55b2d2e8caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 -- 172.21.15.67:0/3854819137 shutdown_connections 2024-09-19T05:37:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 -- 172.21.15.67:0/3854819137 wait complete. 2024-09-19T05:37:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 -- start start 2024-09-19T05:37:01.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 Processor -- start 2024-09-19T05:37:01.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e39db0 0x55b2d2e92680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2eb5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2eb5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b2d2c8a050 con 0x55b2d2e85d70 2024-09-19T05:37:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b2d2e39bc0 con 0x55b2d2e39db0 2024-09-19T05:37:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b2d2e453f0 con 0x55b2d2e86690 2024-09-19T05:37:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 10 client.0 _ll_register_callbacks cb 0x7fc664001fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc674a90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2eb5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc674a90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2eb5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55418/0 (socket says 172.21.15.67:55418) 2024-09-19T05:37:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc674a90640 1 -- 172.21.15.67:0/1990244415 learned_addr learned my addr 172.21.15.67:0/1990244415 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:01.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc675291640 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e39db0 0x55b2d2e92680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc675a92640 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2eb5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc674a90640 1 -- 172.21.15.67:0/1990244415 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 msgr2=0x55b2d2eb5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc674a90640 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2eb5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc674a90640 1 -- 172.21.15.67:0/1990244415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e39db0 msgr2=0x55b2d2e92680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:01.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc674a90640 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e39db0 0x55b2d2e92680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc674a90640 1 -- 172.21.15.67:0/1990244415 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2d2c1e640 con 0x55b2d2e85d70 2024-09-19T05:37:01.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc675a92640 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2eb5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:01.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc674a90640 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2eb5790 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc664007c50 tx=0x7fc664007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c95c28765e0744 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:01.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc64ffff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:01.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc64ffff640 1 -- 172.21.15.67:0/1990244415 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664030070 con 0x55b2d2e85d70 2024-09-19T05:37:01.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc64ffff640 1 -- 172.21.15.67:0/1990244415 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fc664015c80 con 0x55b2d2e85d70 2024-09-19T05:37:01.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 -- 172.21.15.67:0/1990244415 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6680850b0 con 0x55b2d2e85d70 2024-09-19T05:37:01.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc64ffff640 1 -- 172.21.15.67:0/1990244415 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc66403e050 con 0x55b2d2e85d70 2024-09-19T05:37:01.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 10 client.5781 fetch_fsmap learned FSMap version 24 2024-09-19T05:37:01.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 -- 172.21.15.67:0/1990244415 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55b2d2c223b0 con 0x55b2d2e85d70 2024-09-19T05:37:01.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc64ffff640 1 -- 172.21.15.67:0/1990244415 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6680850b0 con 0x55b2d2e85d70 2024-09-19T05:37:01.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc64ffff640 1 -- 172.21.15.67:0/1990244415 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7fc664041020 con 0x55b2d2e85d70 2024-09-19T05:37:01.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 10 client.5781 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:37:01.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 10 client.5781 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 20 client.5781 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55b2d2eb6210 0x55b2d2ef9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 4 client.5781 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc67a5b1000 1 -- 172.21.15.67:0/1990244415 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2d2c98470 con 0x55b2d2eb6210 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.125+0000 7fc675291640 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55b2d2eb6210 0x55b2d2ef9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc64ffff640 10 client.5781 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc675291640 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55b2d2eb6210 0x55b2d2ef9d90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3015175cb146773 server_cookie=c3b4d19d998b8943 in_seq=0 out_seq=0 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc64ffff640 1 -- 172.21.15.67:0/1990244415 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+903 (crc 0 0 0) 0x55b2d2c98470 con 0x55b2d2eb6210 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc64ffff640 10 client.5781 handle_command_reply: tid=0 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 client.5781 shutdown 2024-09-19T05:37:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 -- 172.21.15.67:0/1990244415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 msgr2=0x55b2d2eb5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2eb5790 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc664007c50 tx=0x7fc664007000 comp rx=0 tx=0).stop 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 -- 172.21.15.67:0/1990244415 shutdown_connections 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b2d2e86690 0x55b2d2eb5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b2d2e85d70 0x55b2d2eb5790 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55b2d2eb6210 0x55b2d2ef9d90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 --2- 172.21.15.67:0/1990244415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b2d2e39db0 0x55b2d2e92680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 -- 172.21.15.67:0/1990244415 >> 172.21.15.67:0/1990244415 conn(0x55b2d2e67040 msgr2=0x55b2d2e8d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc64ffff640 0 client.5781 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 -- 172.21.15.67:0/1990244415 shutdown_connections 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 1 -- 172.21.15.67:0/1990244415 wait complete. 2024-09-19T05:37:01.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc67a5b1000 20 client.5781 trim_cache size 0 max 16384 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: "2fd36d98-5686-4f0e-9883-077bc81cfefb": { 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "2fd36d98-5686-4f0e-9883-077bc81cfefb", 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "" 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: "5cd580a2-1e62-4768-8799-fc39ea91f656": { 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "5cd580a2-1e62-4768-8799-fc39ea91f656", 2024-09-19T05:37:01.139 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "" 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: "b4960410-262f-4eea-9a6e-a2a141738257": { 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "b4960410-262f-4eea-9a6e-a2a141738257", 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "" 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: "c8692f94-2318-45ff-b788-df3d5a7df3b4": { 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "c8692f94-2318-45ff-b788-df3d5a7df3b4", 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "" 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:01.140 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:01.141 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:01.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 -- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc65c0678f0 msgr2=0x7fc65c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc65c0678f0 0x7fc65c069db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc664001b70 tx=0x7fc664009040 comp rx=0 tx=0).stop 2024-09-19T05:37:01.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 -- 172.21.15.67:0/1067970192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 msgr2=0x7fc670150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc670150530 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc66800c420 tx=0x7fc66800c8e0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 -- 172.21.15.67:0/1067970192 shutdown_connections 2024-09-19T05:37:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc65c0678f0 0x7fc65c069db0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6701e8050 0x7fc670150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc67014e5e0 0x7fc6701e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 --2- 172.21.15.67:0/1067970192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6580051d0 0x7fc670150530 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 -- 172.21.15.67:0/1067970192 >> 172.21.15.67:0/1067970192 conn(0x7fc6700b1e50 msgr2=0x7fc67015dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 -- 172.21.15.67:0/1067970192 shutdown_connections 2024-09-19T05:37:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:01.129+0000 7fc6774f5640 1 -- 172.21.15.67:0/1067970192 wait complete. 2024-09-19T05:37:05.315 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:37:05.309+0000 7fcbf1c5f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T05:37:06.156 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-19T05:37:06.156 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-19T05:37:06.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.289+0000 7f6343928640 1 Processor -- start 2024-09-19T05:37:06.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.289+0000 7f6343928640 1 -- start start 2024-09-19T05:37:06.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6343928640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c15cc30 0x7f633c0aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6343928640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f633c071f60 0x7f633c0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6343928640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f633c0ada80 con 0x7f633c1639f0 2024-09-19T05:37:06.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6343928640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f633c0ad840 con 0x7f633c071f60 2024-09-19T05:37:06.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6343928640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f633c0add60 con 0x7f633c15cc30 2024-09-19T05:37:06.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6340ec3640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f633c1639f0 0x7f633c0ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58526/0 (socket says 172.21.15.67:58526) 2024-09-19T05:37:06.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6340ec3640 1 -- 172.21.15.67:0/140846315 learned_addr learned my addr 172.21.15.67:0/140846315 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:06.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6341ec5640 1 --2- 172.21.15.67:0/140846315 >> v2:172.21.15.97:3300/0 conn(0x7f633c071f60 0x7f633c0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f63416c4640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c15cc30 0x7f633c0aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818930363 0 0) 0x7f633c0ada80 con 0x7f633c1639f0 2024-09-19T05:37:06.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6328003530 con 0x7f633c1639f0 2024-09-19T05:37:06.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 969627197 0 0) 0x7f6328003530 con 0x7f633c1639f0 2024-09-19T05:37:06.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c15cc30 msgr2=0x7f633c0aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c15cc30 0x7f633c0aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 >> v2:172.21.15.97:3300/0 conn(0x7f633c071f60 msgr2=0x7f633c0723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 --2- 172.21.15.67:0/140846315 >> v2:172.21.15.97:3300/0 conn(0x7f633c071f60 0x7f633c0723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c0ae040 con 0x7f633c1639f0 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6338001a00 con 0x7f633c1639f0 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f63416c4640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c15cc30 0x7f633c0aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6341ec5640 1 --2- 172.21.15.67:0/140846315 >> v2:172.21.15.97:3300/0 conn(0x7f633c071f60 0x7f633c0723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 >> v1:172.21.15.67:6789/0 conn(0x7f633c1639f0 legacy=0x7f633c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c15cc30 0x7f63280039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6328003f00 0x7f6328004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6328004d50 0x7f63280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f633c0ad840 con 0x7f6328004d50 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f633c0add60 con 0x7f6328003f00 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f632800b9d0 con 0x7f633c15cc30 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6341ec5640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6328004d50 0x7f63280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6340ec3640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6328003f00 0x7f6328004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f63416c4640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c15cc30 0x7f63280039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6341ec5640 1 -- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c15cc30 msgr2=0x7f63280039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6341ec5640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c15cc30 0x7f63280039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6341ec5640 1 -- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6328003f00 msgr2=0x7f6328004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6341ec5640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6328003f00 0x7f6328004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6341ec5640 1 -- 172.21.15.67:0/140846315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6328003530 con 0x7f6328004d50 2024-09-19T05:37:06.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6340ec3640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6328003f00 0x7f6328004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:06.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.293+0000 7f6341ec5640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6328004d50 0x7f63280051d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6334009cb0 tx=0x7f633401cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b618b3554a1808 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63340b2070 con 0x7f6328004d50 2024-09-19T05:37:06.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63340a5950 con 0x7f6328004d50 2024-09-19T05:37:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f632ffff640 1 -- 172.21.15.67:0/140846315 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334009880 con 0x7f6328004d50 2024-09-19T05:37:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 -- 172.21.15.67:0/140846315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6328004d50 msgr2=0x7f63280051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 --2- 172.21.15.67:0/140846315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6328004d50 0x7f63280051d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6334009cb0 tx=0x7f633401cc90 comp rx=0 tx=0).stop 2024-09-19T05:37:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6341ec5640 1 -- 172.21.15.67:0/140846315 reap_dead start 2024-09-19T05:37:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 -- 172.21.15.67:0/140846315 shutdown_connections 2024-09-19T05:37:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 -- 172.21.15.67:0/140846315 >> 172.21.15.67:0/140846315 conn(0x7f633c0b1e50 msgr2=0x7f633c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 -- 172.21.15.67:0/140846315 shutdown_connections 2024-09-19T05:37:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 -- 172.21.15.67:0/140846315 wait complete. 2024-09-19T05:37:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 Processor -- start 2024-09-19T05:37:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 -- start start 2024-09-19T05:37:06.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633c1f8810 0x7f633c1f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c09dea0 0x7f633c1f9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f633c0b07e0 0x7f633c0b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f633c15d190 con 0x7f633c1f8810 2024-09-19T05:37:06.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f633c15d010 con 0x7f633c0b07e0 2024-09-19T05:37:06.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6343928640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f633c0aeb20 con 0x7f633c09dea0 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f63416c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633c1f8810 0x7f633c1f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f63416c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633c1f8810 0x7f633c1f8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52190/0 (socket says 172.21.15.67:52190) 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f63416c4640 1 -- 172.21.15.67:0/1437750871 learned_addr learned my addr 172.21.15.67:0/1437750871 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6340ec3640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c09dea0 0x7f633c1f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f6341ec5640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f633c0b07e0 0x7f633c0b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f63416c4640 1 -- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c09dea0 msgr2=0x7f633c1f9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f63416c4640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c09dea0 0x7f633c1f9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f63416c4640 1 -- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f633c0b07e0 msgr2=0x7f633c0b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f63416c4640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f633c0b07e0 0x7f633c0b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.297+0000 7f63416c4640 1 -- 172.21.15.67:0/1437750871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c1f9760 con 0x7f633c1f8810 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f63416c4640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633c1f8810 0x7f633c1f8bf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6330011640 tx=0x7f6330011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f632dffb640 1 -- 172.21.15.67:0/1437750871 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633000f8c0 con 0x7f633c1f8810 2024-09-19T05:37:06.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f632dffb640 1 -- 172.21.15.67:0/1437750871 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633000fa60 con 0x7f633c1f8810 2024-09-19T05:37:06.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f6343928640 1 -- 172.21.15.67:0/1437750871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633c1f9a40 con 0x7f633c1f8810 2024-09-19T05:37:06.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f632dffb640 1 -- 172.21.15.67:0/1437750871 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633000fe10 con 0x7f633c1f8810 2024-09-19T05:37:06.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f6343928640 1 -- 172.21.15.67:0/1437750871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633c1fa000 con 0x7f633c1f8810 2024-09-19T05:37:06.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f632dffb640 1 -- 172.21.15.67:0/1437750871 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6330015460 con 0x7f633c1f8810 2024-09-19T05:37:06.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f632dffb640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63200678c0 0x7f6320069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f632dffb640 1 -- 172.21.15.67:0/1437750871 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f6330086830 con 0x7f633c1f8810 2024-09-19T05:37:06.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f6340ec3640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63200678c0 0x7f6320069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f63469e4000 1 Processor -- start 2024-09-19T05:37:06.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f63469e4000 1 -- start start 2024-09-19T05:37:06.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.301+0000 7f6340ec3640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63200678c0 0x7f6320069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f633c165230 tx=0x7f6338009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e87d70 0x5636e4e88150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e88690 0x5636e4e3b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e3bdb0 0x5636e4e3c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5636e4d25960 con 0x5636e4e87d70 2024-09-19T05:37:06.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5636e4c69900 con 0x5636e4e88690 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5636e4c8cd40 con 0x5636e4e3bdb0 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e87d70 0x5636e4e88150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e87d70 0x5636e4e88150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52196/0 (socket says 172.21.15.67:52196) 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 -- 172.21.15.67:0/181882660 learned_addr learned my addr 172.21.15.67:0/181882660 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6340ec3640 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e88690 0x5636e4e3b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6341ec5640 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e3bdb0 0x5636e4e3c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 -- 172.21.15.67:0/181882660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e3bdb0 msgr2=0x5636e4e3c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e3bdb0 0x5636e4e3c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 -- 172.21.15.67:0/181882660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e88690 msgr2=0x5636e4e3b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e88690 0x5636e4e3b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 -- 172.21.15.67:0/181882660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636e4c33580 con 0x5636e4e87d70 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6340ec3640 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e88690 0x5636e4e3b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6341ec5640 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e3bdb0 0x5636e4e3c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e87d70 0x5636e4e88150 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6330084ba0 tx=0x7f6330017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4e36cfc0a9bbc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6326ffd640 1 -- 172.21.15.67:0/181882660 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330054db0 con 0x5636e4e87d70 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6326ffd640 1 -- 172.21.15.67:0/181882660 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6330053120 con 0x5636e4e87d70 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6326ffd640 1 -- 172.21.15.67:0/181882660 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633005f420 con 0x5636e4e87d70 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- 172.21.15.67:0/181882660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e87d70 msgr2=0x5636e4e88150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e87d70 0x5636e4e88150 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6330084ba0 tx=0x7f6330017000 comp rx=0 tx=0).stop 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- 172.21.15.67:0/181882660 shutdown_connections 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e3bdb0 0x5636e4e3c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e88690 0x5636e4e3b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 --2- 172.21.15.67:0/181882660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e87d70 0x5636e4e88150 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- 172.21.15.67:0/181882660 >> 172.21.15.67:0/181882660 conn(0x5636e4e69040 msgr2=0x5636e4e6b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- 172.21.15.67:0/181882660 shutdown_connections 2024-09-19T05:37:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- 172.21.15.67:0/181882660 wait complete. 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- start start 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 Processor -- start 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e3bdb0 0x5636e4e8ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e87d70 0x5636e4e8f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e88690 0x5636e4e8f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5636e4c88d00 con 0x5636e4e88690 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5636e4c47aa0 con 0x5636e4e3bdb0 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5636e4c26340 con 0x5636e4e87d70 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63469e4000 10 client.0 _ll_register_callbacks cb 0x5636e4e29760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6341ec5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e88690 0x5636e4e8f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6341ec5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e88690 0x5636e4e8f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52200/0 (socket says 172.21.15.67:52200) 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6341ec5640 1 -- 172.21.15.67:0/2909703897 learned_addr learned my addr 172.21.15.67:0/2909703897 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e3bdb0 0x5636e4e8ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6340ec3640 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e87d70 0x5636e4e8f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6341ec5640 1 -- 172.21.15.67:0/2909703897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e87d70 msgr2=0x5636e4e8f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6341ec5640 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e87d70 0x5636e4e8f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6341ec5640 1 -- 172.21.15.67:0/2909703897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e3bdb0 msgr2=0x5636e4e8ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6341ec5640 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e3bdb0 0x5636e4e8ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f6341ec5640 1 -- 172.21.15.67:0/2909703897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636e4c2fdc0 con 0x5636e4e88690 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.305+0000 7f63416c4640 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e3bdb0 0x5636e4e8ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f6341ec5640 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e88690 0x5636e4e8f760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6334009cb0 tx=0x7f633401b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ea6b9db4d665d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f631bfff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f631bfff640 1 -- 172.21.15.67:0/2909703897 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63340b2040 con 0x5636e4e88690 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f631bfff640 1 -- 172.21.15.67:0/2909703897 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f6334009880 con 0x5636e4e88690 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 -- 172.21.15.67:0/2909703897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6330053120 con 0x5636e4e88690 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f631bfff640 1 -- 172.21.15.67:0/2909703897 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f63340059a0 con 0x5636e4e88690 2024-09-19T05:37:06.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 10 client.5793 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 -- 172.21.15.67:0/2909703897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5636e4c2c7f0 con 0x5636e4e88690 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f631bfff640 1 -- 172.21.15.67:0/2909703897 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6330053120 con 0x5636e4e88690 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f631bfff640 1 -- 172.21.15.67:0/2909703897 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f63340b8470 con 0x5636e4e88690 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 10 client.5793 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 10 client.5793 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 20 client.5793 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5636e4e970b0 0x5636e4e994a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 4 client.5793 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 -- 172.21.15.67:0/2909703897 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636e4c26e10 con 0x5636e4e970b0 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63416c4640 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5636e4e970b0 0x5636e4e994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f631bfff640 10 client.5793 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63416c4640 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5636e4e970b0 0x5636e4e994a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6992c47c9efa3606 server_cookie=c40081646a5eec71 in_seq=0 out_seq=0 2024-09-19T05:37:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f631bfff640 1 -- 172.21.15.67:0/2909703897 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636e4c26e10 con 0x5636e4e970b0 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f631bfff640 10 client.5793 handle_command_reply: tid=0 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 client.5793 shutdown 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 -- 172.21.15.67:0/2909703897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e88690 msgr2=0x5636e4e8f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e88690 0x5636e4e8f760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6334009cb0 tx=0x7f633401b4d0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 -- 172.21.15.67:0/2909703897 shutdown_connections 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e88690 0x5636e4e8f760 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e87d70 0x5636e4e8f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5636e4e970b0 0x5636e4e994a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 --2- 172.21.15.67:0/2909703897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e3bdb0 0x5636e4e8ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f631bfff640 0 client.5793 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 -- 172.21.15.67:0/2909703897 >> 172.21.15.67:0/2909703897 conn(0x5636e4e69040 msgr2=0x5636e4e3af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 -- 172.21.15.67:0/2909703897 shutdown_connections 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 1 -- 172.21.15.67:0/2909703897 wait complete. 2024-09-19T05:37:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.309+0000 7f63469e4000 20 client.5793 trim_cache size 0 max 16384 2024-09-19T05:37:06.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 Processor -- start 2024-09-19T05:37:06.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 -- start start 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e69040 0x5636e4e43f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e951e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e87d70 0x5636e4e95720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f633c205fd0 con 0x5636e4e3bdb0 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f633c204fe0 con 0x5636e4e69040 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f633c1fb850 con 0x5636e4e87d70 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f6340ec3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f6340ec3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e951e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52210/0 (socket says 172.21.15.67:52210) 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f6340ec3640 1 -- 172.21.15.67:0/2257428035 learned_addr learned my addr 172.21.15.67:0/2257428035 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f6341ec5640 1 --2- 172.21.15.67:0/2257428035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e87d70 0x5636e4e95720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63416c4640 1 --2- 172.21.15.67:0/2257428035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e69040 0x5636e4e43f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f6340ec3640 1 -- 172.21.15.67:0/2257428035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e87d70 msgr2=0x5636e4e95720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f6340ec3640 1 --2- 172.21.15.67:0/2257428035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e87d70 0x5636e4e95720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f6340ec3640 1 -- 172.21.15.67:0/2257428035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e69040 msgr2=0x5636e4e43f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f6340ec3640 1 --2- 172.21.15.67:0/2257428035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e69040 0x5636e4e43f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f6340ec3640 1 -- 172.21.15.67:0/2257428035 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636e4c4a470 con 0x5636e4e3bdb0 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f6340ec3640 1 --2- 172.21.15.67:0/2257428035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e951e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6338013cb0 tx=0x7f6338016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76af40d7fcd9086c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63267fc640 1 -- 172.21.15.67:0/2257428035 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338010040 con 0x5636e4e3bdb0 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63267fc640 1 -- 172.21.15.67:0/2257428035 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6338029020 con 0x5636e4e3bdb0 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63267fc640 1 -- 172.21.15.67:0/2257428035 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338024410 con 0x5636e4e3bdb0 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 -- 172.21.15.67:0/2257428035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 msgr2=0x5636e4e951e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 --2- 172.21.15.67:0/2257428035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e951e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6338013cb0 tx=0x7f6338016000 comp rx=0 tx=0).stop 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 -- 172.21.15.67:0/2257428035 shutdown_connections 2024-09-19T05:37:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 --2- 172.21.15.67:0/2257428035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e87d70 0x5636e4e95720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 --2- 172.21.15.67:0/2257428035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e951e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 --2- 172.21.15.67:0/2257428035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e69040 0x5636e4e43f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 -- 172.21.15.67:0/2257428035 >> 172.21.15.67:0/2257428035 conn(0x5636e4e40890 msgr2=0x5636e4e94ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 -- 172.21.15.67:0/2257428035 shutdown_connections 2024-09-19T05:37:06.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 -- 172.21.15.67:0/2257428035 wait complete. 2024-09-19T05:37:06.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 -- start start 2024-09-19T05:37:06.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.329+0000 7f63469e4000 1 Processor -- start 2024-09-19T05:37:06.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e9be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e69040 0x5636e4eb7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e87d70 0x5636e4eb7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5636e4c9afd0 con 0x5636e4e3bdb0 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5636e4c32f20 con 0x5636e4e87d70 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5636e4e473f0 con 0x5636e4e69040 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 10 client.0 _ll_register_callbacks cb 0x7f63340b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63416c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e9be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63416c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e9be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52212/0 (socket says 172.21.15.67:52212) 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63416c4640 1 -- 172.21.15.67:0/3068836790 learned_addr learned my addr 172.21.15.67:0/3068836790 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6340ec3640 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e69040 0x5636e4eb7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63416c4640 1 -- 172.21.15.67:0/3068836790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e69040 msgr2=0x5636e4eb7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63416c4640 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e69040 0x5636e4eb7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6341ec5640 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e87d70 0x5636e4eb7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63416c4640 1 -- 172.21.15.67:0/3068836790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e87d70 msgr2=0x5636e4eb7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63416c4640 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e87d70 0x5636e4eb7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63416c4640 1 -- 172.21.15.67:0/3068836790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636e4c20640 con 0x5636e4e3bdb0 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63416c4640 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e9be20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6330053430 tx=0x7f6330000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c156b857437b9bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f631bfff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f631bfff640 1 -- 172.21.15.67:0/3068836790 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330056880 con 0x5636e4e3bdb0 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f631bfff640 1 -- 172.21.15.67:0/3068836790 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f633005f200 con 0x5636e4e3bdb0 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- 172.21.15.67:0/3068836790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6338029020 con 0x5636e4e3bdb0 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f631bfff640 1 -- 172.21.15.67:0/3068836790 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6330053120 con 0x5636e4e3bdb0 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 10 client.5799 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- 172.21.15.67:0/3068836790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5636e4c243b0 con 0x5636e4e3bdb0 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f631bfff640 1 -- 172.21.15.67:0/3068836790 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6338029020 con 0x5636e4e3bdb0 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f631bfff640 1 -- 172.21.15.67:0/3068836790 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f633001cbf0 con 0x5636e4e3bdb0 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 10 client.5799 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 10 client.5799 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 20 client.5799 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5636e4e88690 0x5636e4eb8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 4 client.5799 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- 172.21.15.67:0/3068836790 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5636e4c9a470 con 0x5636e4e88690 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6340ec3640 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5636e4e88690 0x5636e4eb8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f631bfff640 10 client.5799 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6340ec3640 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5636e4e88690 0x5636e4eb8210 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=800006aa036d39fb server_cookie=76492c40a2cd8db8 in_seq=0 out_seq=0 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f631bfff640 1 -- 172.21.15.67:0/3068836790 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5636e4c9a470 con 0x5636e4e88690 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f631bfff640 10 client.5799 handle_command_reply: tid=0 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 client.5799 shutdown 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- 172.21.15.67:0/3068836790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 msgr2=0x5636e4e9be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e9be20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6330053430 tx=0x7f6330000bd0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- 172.21.15.67:0/3068836790 shutdown_connections 2024-09-19T05:37:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5636e4e88690 0x5636e4eb8210 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5636e4e87d70 0x5636e4eb7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5636e4e69040 0x5636e4eb7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f631bfff640 0 client.5799 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 --2- 172.21.15.67:0/3068836790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5636e4e3bdb0 0x5636e4e9be20 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- 172.21.15.67:0/3068836790 >> 172.21.15.67:0/3068836790 conn(0x5636e4e40890 msgr2=0x5636e4e952f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- 172.21.15.67:0/3068836790 shutdown_connections 2024-09-19T05:37:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 1 -- 172.21.15.67:0/3068836790 wait complete. 2024-09-19T05:37:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f63469e4000 20 client.5799 trim_cache size 0 max 16384 2024-09-19T05:37:06.344 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:06.345 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-19T05:37:06.345 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {} 2024-09-19T05:37:06.345 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:06.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 -- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63200678c0 msgr2=0x7f6320069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63200678c0 0x7f6320069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f633c165230 tx=0x7f6338009040 comp rx=0 tx=0).stop 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 -- 172.21.15.67:0/1437750871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633c1f8810 msgr2=0x7f633c1f8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633c1f8810 0x7f633c1f8bf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6330011640 tx=0x7f6330011b00 comp rx=0 tx=0).stop 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 -- 172.21.15.67:0/1437750871 shutdown_connections 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f633c0b07e0 0x7f633c0b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63200678c0 0x7f6320069d80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f633c09dea0 0x7f633c1f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 --2- 172.21.15.67:0/1437750871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f633c1f8810 0x7f633c1f8bf0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 -- 172.21.15.67:0/1437750871 >> 172.21.15.67:0/1437750871 conn(0x7f633c0b1e50 msgr2=0x7f633c0b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 -- 172.21.15.67:0/1437750871 shutdown_connections 2024-09-19T05:37:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.333+0000 7f6343928640 1 -- 172.21.15.67:0/1437750871 wait complete. 2024-09-19T05:37:06.355 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:37:06.356 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-19T05:37:06.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1809399640 1 Processor -- start 2024-09-19T05:37:06.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1809399640 1 -- start start 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1809399640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1804159c60 0x7f18040ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1809399640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f180406ffd0 0x7f18040aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1809399640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f180415a040 con 0x7f18040b3150 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1809399640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f180415d460 con 0x7f1804159c60 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1809399640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f180415c850 con 0x7f180406ffd0 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1802ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1804159c60 0x7f18040ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1802ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1804159c60 0x7f18040ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52220/0 (socket says 172.21.15.67:52220) 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1802ffd640 1 -- 172.21.15.67:0/2240943070 learned_addr learned my addr 172.21.15.67:0/2240943070 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f18027fc640 1 --2- 172.21.15.67:0/2240943070 >> v2:172.21.15.97:3300/0 conn(0x7f180406ffd0 0x7f18040aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1802ffd640 1 -- 172.21.15.67:0/2240943070 >> v2:172.21.15.97:3300/0 conn(0x7f180406ffd0 msgr2=0x7f18040aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1802ffd640 1 --2- 172.21.15.67:0/2240943070 >> v2:172.21.15.97:3300/0 conn(0x7f180406ffd0 0x7f18040aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1802ffd640 1 -- 172.21.15.67:0/2240943070 >> v1:172.21.15.97:6789/0 conn(0x7f18040b3150 legacy=0x7f180415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.473+0000 7f1802ffd640 1 -- 172.21.15.67:0/2240943070 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180415cb30 con 0x7f1804159c60 2024-09-19T05:37:06.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1802ffd640 1 --2- 172.21.15.67:0/2240943070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 0x7f18040ad130 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f18040adba0 tx=0x7f17f801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676b6b45dcf344ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1801ffb640 1 -- 172.21.15.67:0/2240943070 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f80aa610 con 0x7f1804159c60 2024-09-19T05:37:06.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1801ffb640 1 -- 172.21.15.67:0/2240943070 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f80af070 con 0x7f1804159c60 2024-09-19T05:37:06.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1801ffb640 1 -- 172.21.15.67:0/2240943070 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f80aa9d0 con 0x7f1804159c60 2024-09-19T05:37:06.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 -- 172.21.15.67:0/2240943070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 msgr2=0x7f18040ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 --2- 172.21.15.67:0/2240943070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 0x7f18040ad130 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f18040adba0 tx=0x7f17f801c4b0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 -- 172.21.15.67:0/2240943070 shutdown_connections 2024-09-19T05:37:06.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 --2- 172.21.15.67:0/2240943070 >> v2:172.21.15.97:3300/0 conn(0x7f180406ffd0 0x7f18040aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 --2- 172.21.15.67:0/2240943070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 0x7f18040ad130 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 -- 172.21.15.67:0/2240943070 >> 172.21.15.67:0/2240943070 conn(0x7f18040b1e50 msgr2=0x7f18040b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 -- 172.21.15.67:0/2240943070 shutdown_connections 2024-09-19T05:37:06.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 -- 172.21.15.67:0/2240943070 wait complete. 2024-09-19T05:37:06.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 Processor -- start 2024-09-19T05:37:06.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 -- start start 2024-09-19T05:37:06.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f180406ffd0 0x7f1804155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18040b3150 0x7f180414a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 0x7f180414a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f18040ad7f0 con 0x7f1804159c60 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f18040ad670 con 0x7f18040b3150 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f1809399640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1804168e30 con 0x7f180406ffd0 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f18037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 0x7f180414a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f18037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 0x7f180414a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52230/0 (socket says 172.21.15.67:52230) 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.477+0000 7f18037fe640 1 -- 172.21.15.67:0/4068289599 learned_addr learned my addr 172.21.15.67:0/4068289599 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f1802ffd640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f180406ffd0 0x7f1804155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f18027fc640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18040b3150 0x7f180414a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f18037fe640 1 -- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f180406ffd0 msgr2=0x7f1804155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f18037fe640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f180406ffd0 0x7f1804155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f18037fe640 1 -- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18040b3150 msgr2=0x7f180414a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f18037fe640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18040b3150 0x7f180414a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f18037fe640 1 -- 172.21.15.67:0/4068289599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180414ffe0 con 0x7f1804159c60 2024-09-19T05:37:06.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f18037fe640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 0x7f180414a810 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c780 tx=0x7f17fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f17eb7fe640 1 -- 172.21.15.67:0/4068289599 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc017070 con 0x7f1804159c60 2024-09-19T05:37:06.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f17eb7fe640 1 -- 172.21.15.67:0/4068289599 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc003db0 con 0x7f1804159c60 2024-09-19T05:37:06.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f1809399640 1 -- 172.21.15.67:0/4068289599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180414ef40 con 0x7f1804159c60 2024-09-19T05:37:06.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f17eb7fe640 1 -- 172.21.15.67:0/4068289599 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0052b0 con 0x7f1804159c60 2024-09-19T05:37:06.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f1809399640 1 -- 172.21.15.67:0/4068289599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f180414f500 con 0x7f1804159c60 2024-09-19T05:37:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f17eb7fe640 1 -- 172.21.15.67:0/4068289599 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17fc01a070 con 0x7f1804159c60 2024-09-19T05:37:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f17eb7fe640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17f00678c0 0x7f17f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f17eb7fe640 1 -- 172.21.15.67:0/4068289599 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f17fc085450 con 0x7f1804159c60 2024-09-19T05:37:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f1802ffd640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17f00678c0 0x7f17f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f180c455000 1 Processor -- start 2024-09-19T05:37:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.481+0000 7f180c455000 1 -- start start 2024-09-19T05:37:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f1802ffd640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17f00678c0 0x7f17f0069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f17f80ae000 tx=0x7f17f80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x55662185b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x556621811290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566218117d0 0x556621811bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5566216f8c40 con 0x55662185bca0 2024-09-19T05:37:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55662165fd50 con 0x55662185b380 2024-09-19T05:37:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55662161aab0 con 0x5566218117d0 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18027fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x556621811290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18027fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x556621811290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52238/0 (socket says 172.21.15.67:52238) 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18027fc640 1 -- 172.21.15.67:0/2441964715 learned_addr learned my addr 172.21.15.67:0/2441964715 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f1802ffd640 1 --2- 172.21.15.67:0/2441964715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x55662185b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18037fe640 1 --2- 172.21.15.67:0/2441964715 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566218117d0 0x556621811bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18027fc640 1 -- 172.21.15.67:0/2441964715 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566218117d0 msgr2=0x556621811bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18027fc640 1 --2- 172.21.15.67:0/2441964715 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566218117d0 0x556621811bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18027fc640 1 -- 172.21.15.67:0/2441964715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 msgr2=0x55662185b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18027fc640 1 --2- 172.21.15.67:0/2441964715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x55662185b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18027fc640 1 -- 172.21.15.67:0/2441964715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556621606590 con 0x55662185bca0 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18027fc640 1 --2- 172.21.15.67:0/2441964715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x556621811290 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f17f400ca10 tx=0x7f17f400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b1b3d10862a9d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f17e8ff9640 1 -- 172.21.15.67:0/2441964715 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f4018030 con 0x55662185bca0 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f17e8ff9640 1 -- 172.21.15.67:0/2441964715 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f400ea80 con 0x55662185bca0 2024-09-19T05:37:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f17e8ff9640 1 -- 172.21.15.67:0/2441964715 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f400ec50 con 0x55662185bca0 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- 172.21.15.67:0/2441964715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 msgr2=0x556621811290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 --2- 172.21.15.67:0/2441964715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x556621811290 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f17f400ca10 tx=0x7f17f400ced0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- 172.21.15.67:0/2441964715 shutdown_connections 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 --2- 172.21.15.67:0/2441964715 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566218117d0 0x556621811bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 --2- 172.21.15.67:0/2441964715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x556621811290 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 --2- 172.21.15.67:0/2441964715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x55662185b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- 172.21.15.67:0/2441964715 >> 172.21.15.67:0/2441964715 conn(0x556621808bc0 msgr2=0x55662180fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- 172.21.15.67:0/2441964715 shutdown_connections 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- 172.21.15.67:0/2441964715 wait complete. 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- start start 2024-09-19T05:37:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 Processor -- start 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566218117d0 0x556621816860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x5566218455d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185bca0 0x556621845b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55662161e400 con 0x5566218117d0 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55662171c3a0 con 0x55662185b380 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55662169f260 con 0x55662185bca0 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f180c455000 10 client.0 _ll_register_callbacks cb 0x5566216c1020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f1802ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566218117d0 0x556621816860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f1802ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566218117d0 0x556621816860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52246/0 (socket says 172.21.15.67:52246) 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f1802ffd640 1 -- 172.21.15.67:0/4294240422 learned_addr learned my addr 172.21.15.67:0/4294240422 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18027fc640 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x5566218455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.485+0000 7f18037fe640 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185bca0 0x556621845b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f1802ffd640 1 -- 172.21.15.67:0/4294240422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185bca0 msgr2=0x556621845b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f1802ffd640 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185bca0 0x556621845b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f1802ffd640 1 -- 172.21.15.67:0/4294240422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 msgr2=0x5566218455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f1802ffd640 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x5566218455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f1802ffd640 1 -- 172.21.15.67:0/4294240422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556621602dd0 con 0x5566218117d0 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f1802ffd640 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566218117d0 0x556621816860 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f17f80ac040 tx=0x7f17f801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9c297dcc6350c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f17e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f17e1ffb640 1 -- 172.21.15.67:0/4294240422 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f80cb060 con 0x5566218117d0 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 -- 172.21.15.67:0/4294240422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17f400ea80 con 0x5566218117d0 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f17e1ffb640 1 -- 172.21.15.67:0/4294240422 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f17f80c63f0 con 0x5566218117d0 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f17e1ffb640 1 -- 172.21.15.67:0/4294240422 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f17f80d1050 con 0x5566218117d0 2024-09-19T05:37:06.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 10 client.5811 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 -- 172.21.15.67:0/4294240422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5566215ff800 con 0x5566218117d0 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f17e1ffb640 1 -- 172.21.15.67:0/4294240422 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f400ea80 con 0x5566218117d0 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f17e1ffb640 1 -- 172.21.15.67:0/4294240422 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f17f80d4020 con 0x5566218117d0 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 10 client.5811 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 10 client.5811 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 20 client.5811 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x556621816da0 0x5566218621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 4 client.5811 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 -- 172.21.15.67:0/4294240422 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566215f9e20 con 0x556621816da0 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f18027fc640 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x556621816da0 0x5566218621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f17e1ffb640 10 client.5811 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f18027fc640 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x556621816da0 0x5566218621c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91132ae73e813dc6 server_cookie=cb09264f5f43223c in_seq=0 out_seq=0 2024-09-19T05:37:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f17e1ffb640 1 -- 172.21.15.67:0/4294240422 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5566215f9e20 con 0x556621816da0 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f17e1ffb640 10 client.5811 handle_command_reply: tid=0 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 client.5811 shutdown 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 -- 172.21.15.67:0/4294240422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566218117d0 msgr2=0x556621816860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566218117d0 0x556621816860 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f17f80ac040 tx=0x7f17f801acf0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 -- 172.21.15.67:0/4294240422 shutdown_connections 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185bca0 0x556621845b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x556621816da0 0x5566218621c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x5566218455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 --2- 172.21.15.67:0/4294240422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566218117d0 0x556621816860 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f17e1ffb640 0 client.5811 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 -- 172.21.15.67:0/4294240422 >> 172.21.15.67:0/4294240422 conn(0x556621808bc0 msgr2=0x556621810280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 -- 172.21.15.67:0/4294240422 shutdown_connections 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 1 -- 172.21.15.67:0/4294240422 wait complete. 2024-09-19T05:37:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.489+0000 7f180c455000 20 client.5811 trim_cache size 0 max 16384 2024-09-19T05:37:06.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 Processor -- start 2024-09-19T05:37:06.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 -- start start 2024-09-19T05:37:06.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566218117d0 0x556621871ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185b380 0x5566218720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x55662188b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1804201060 con 0x55662185bca0 2024-09-19T05:37:06.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f18042004f0 con 0x5566218117d0 2024-09-19T05:37:06.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1804200a40 con 0x55662185b380 2024-09-19T05:37:06.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x55662188b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x55662188b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52252/0 (socket says 172.21.15.67:52252) 2024-09-19T05:37:06.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18037fe640 1 -- 172.21.15.67:0/819113592 learned_addr learned my addr 172.21.15.67:0/819113592 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f1802ffd640 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566218117d0 0x556621871ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18037fe640 1 -- 172.21.15.67:0/819113592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185b380 msgr2=0x5566218720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18027fc640 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185b380 0x5566218720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18037fe640 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185b380 0x5566218720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18037fe640 1 -- 172.21.15.67:0/819113592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566218117d0 msgr2=0x556621871ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18037fe640 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566218117d0 0x556621871ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18037fe640 1 -- 172.21.15.67:0/819113592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662161d480 con 0x55662185bca0 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f1802ffd640 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566218117d0 0x556621871ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18027fc640 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185b380 0x5566218720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f18037fe640 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x55662188b540 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f17fc000f90 tx=0x7f17fc05c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19801801eb8b8f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f17e3fff640 1 -- 172.21.15.67:0/819113592 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc059b10 con 0x55662185bca0 2024-09-19T05:37:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f17e3fff640 1 -- 172.21.15.67:0/819113592 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc05e340 con 0x55662185bca0 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f17e3fff640 1 -- 172.21.15.67:0/819113592 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc051dd0 con 0x55662185bca0 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 -- 172.21.15.67:0/819113592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 msgr2=0x55662188b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x55662188b540 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f17fc000f90 tx=0x7f17fc05c040 comp rx=0 tx=0).stop 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 -- 172.21.15.67:0/819113592 shutdown_connections 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x55662188b540 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55662185b380 0x5566218720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 --2- 172.21.15.67:0/819113592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566218117d0 0x556621871ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 -- 172.21.15.67:0/819113592 >> 172.21.15.67:0/819113592 conn(0x556621808bc0 msgr2=0x556621844270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 -- 172.21.15.67:0/819113592 shutdown_connections 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 -- 172.21.15.67:0/819113592 wait complete. 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 -- start start 2024-09-19T05:37:06.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.505+0000 7f180c455000 1 Processor -- start 2024-09-19T05:37:06.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566218117d0 0x5566218b9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x5566218cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x5566218d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556621605f30 con 0x55662185bca0 2024-09-19T05:37:06.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55662161e7d0 con 0x55662185b380 2024-09-19T05:37:06.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55662165f060 con 0x5566218117d0 2024-09-19T05:37:06.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 10 client.0 _ll_register_callbacks cb 0x7f17f80096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:06.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f18037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x5566218d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f18037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x5566218d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52256/0 (socket says 172.21.15.67:52256) 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f18037fe640 1 -- 172.21.15.67:0/88986937 learned_addr learned my addr 172.21.15.67:0/88986937 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1802ffd640 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566218117d0 0x5566218b9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f18037fe640 1 -- 172.21.15.67:0/88986937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566218117d0 msgr2=0x5566218b9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f18037fe640 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566218117d0 0x5566218b9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f18037fe640 1 -- 172.21.15.67:0/88986937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 msgr2=0x5566218cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f18037fe640 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x5566218cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f18037fe640 1 -- 172.21.15.67:0/88986937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566215f3650 con 0x55662185bca0 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f18037fe640 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x5566218d0330 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f17fc05de10 tx=0x7f17fc014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48140faf99d4a7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f17e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f17e1ffb640 1 -- 172.21.15.67:0/88986937 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc071060 con 0x55662185bca0 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f17e1ffb640 1 -- 172.21.15.67:0/88986937 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f17fc0559c0 con 0x55662185bca0 2024-09-19T05:37:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- 172.21.15.67:0/88986937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17fc05e340 con 0x55662185bca0 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f17e1ffb640 1 -- 172.21.15.67:0/88986937 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f17fc0852b0 con 0x55662185bca0 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 10 client.5817 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- 172.21.15.67:0/88986937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5566215f73c0 con 0x55662185bca0 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f17e1ffb640 1 -- 172.21.15.67:0/88986937 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc05e340 con 0x55662185bca0 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f17e1ffb640 1 -- 172.21.15.67:0/88986937 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f17fc080070 con 0x55662185bca0 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 10 client.5817 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 10 client.5817 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 20 client.5817 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5566218ba260 0x5566218d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 4 client.5817 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- 172.21.15.67:0/88986937 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55662166d480 con 0x5566218ba260 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1802ffd640 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5566218ba260 0x5566218d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f17e1ffb640 10 client.5817 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1802ffd640 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5566218ba260 0x5566218d0870 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5567f40761edbedf server_cookie=b053f99cf1044071 in_seq=0 out_seq=0 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f17e1ffb640 1 -- 172.21.15.67:0/88986937 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+167 (crc 0 0 0) 0x55662166d480 con 0x5566218ba260 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f17e1ffb640 10 client.5817 handle_command_reply: tid=0 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 client.5817 shutdown 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- 172.21.15.67:0/88986937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 msgr2=0x5566218d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x5566218d0330 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f17fc05de10 tx=0x7f17fc014040 comp rx=0 tx=0).stop 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- 172.21.15.67:0/88986937 shutdown_connections 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55662185bca0 0x5566218d0330 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5566218ba260 0x5566218d0870 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55662185b380 0x5566218cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 --2- 172.21.15.67:0/88986937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566218117d0 0x5566218b9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f17e1ffb640 0 client.5817 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- 172.21.15.67:0/88986937 >> 172.21.15.67:0/88986937 conn(0x556621808bc0 msgr2=0x5566218723c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- 172.21.15.67:0/88986937 shutdown_connections 2024-09-19T05:37:06.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 1 -- 172.21.15.67:0/88986937 wait complete. 2024-09-19T05:37:06.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f180c455000 20 client.5817 trim_cache size 0 max 16384 2024-09-19T05:37:06.521 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:37:06.521 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:06.521 INFO:teuthology.orchestra.run.smithi067.stdout: "damage_type": "backtrace", 2024-09-19T05:37:06.521 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 389106025, 2024-09-19T05:37:06.521 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 1099511630409, 2024-09-19T05:37:06.521 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-09-19T05:37:06.521 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:06.522 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:37:06.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 -- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17f00678c0 msgr2=0x7f17f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17f00678c0 0x7f17f0069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f17f80ae000 tx=0x7f17f80a7000 comp rx=0 tx=0).stop 2024-09-19T05:37:06.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 -- 172.21.15.67:0/4068289599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 msgr2=0x7f180414a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 0x7f180414a810 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c780 tx=0x7f17fc00cc40 comp rx=0 tx=0).stop 2024-09-19T05:37:06.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 -- 172.21.15.67:0/4068289599 shutdown_connections 2024-09-19T05:37:06.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1804159c60 0x7f180414a810 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18040b3150 0x7f180414a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17f00678c0 0x7f17f0069d80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 --2- 172.21.15.67:0/4068289599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f180406ffd0 0x7f1804155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 -- 172.21.15.67:0/4068289599 >> 172.21.15.67:0/4068289599 conn(0x7f18040b1e50 msgr2=0x7f1804166140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 -- 172.21.15.67:0/4068289599 shutdown_connections 2024-09-19T05:37:06.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.509+0000 7f1809399640 1 -- 172.21.15.67:0/4068289599 wait complete. 2024-09-19T05:37:06.531 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:06.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.641+0000 7fbe3b318640 1 Processor -- start 2024-09-19T05:37:06.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.641+0000 7fbe3b318640 1 -- start start 2024-09-19T05:37:06.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.641+0000 7fbe3b318640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 0x7fbe340b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.641+0000 7fbe3b318640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbe3406bcc0 0x7fbe3406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.641+0000 7fbe3b318640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe340b1140 con 0x7fbe34145e10 2024-09-19T05:37:06.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.641+0000 7fbe3b318640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fbe341461f0 con 0x7fbe3406bcc0 2024-09-19T05:37:06.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.641+0000 7fbe3b318640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbe340b1420 con 0x7fbe340b03a0 2024-09-19T05:37:06.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe388b3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 0x7fbe340b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe398b5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbe3406bcc0 0x7fbe3406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe388b3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 0x7fbe340b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:51084/0 (socket says 172.21.15.67:51084) 2024-09-19T05:37:06.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe388b3640 1 -- 172.21.15.67:0/2483847987 learned_addr learned my addr 172.21.15.67:0/2483847987 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe398b5640 1 -- 172.21.15.67:0/2483847987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 msgr2=0x7fbe340b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe398b5640 1 --2- 172.21.15.67:0/2483847987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 0x7fbe340b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe398b5640 1 -- 172.21.15.67:0/2483847987 >> v1:172.21.15.97:6789/0 conn(0x7fbe34145e10 legacy=0x7fbe3415c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe398b5640 1 -- 172.21.15.67:0/2483847987 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe340b1700 con 0x7fbe3406bcc0 2024-09-19T05:37:06.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe398b5640 1 --2- 172.21.15.67:0/2483847987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe3406bcc0 0x7fbe3406c150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009d90 tx=0x7fbe2c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8948ae4ee0372833 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe2bfff640 1 -- 172.21.15.67:0/2483847987 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c0b2070 con 0x7fbe3406bcc0 2024-09-19T05:37:06.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe2bfff640 1 -- 172.21.15.67:0/2483847987 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe2c0a5830 con 0x7fbe3406bcc0 2024-09-19T05:37:06.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe2bfff640 1 -- 172.21.15.67:0/2483847987 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c0a5c00 con 0x7fbe3406bcc0 2024-09-19T05:37:06.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe3b318640 1 -- 172.21.15.67:0/2483847987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe3406bcc0 msgr2=0x7fbe3406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe3b318640 1 --2- 172.21.15.67:0/2483847987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe3406bcc0 0x7fbe3406c150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009d90 tx=0x7fbe2c01c970 comp rx=0 tx=0).stop 2024-09-19T05:37:06.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe3b318640 1 -- 172.21.15.67:0/2483847987 shutdown_connections 2024-09-19T05:37:06.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe3b318640 1 --2- 172.21.15.67:0/2483847987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe3406bcc0 0x7fbe3406c150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe3b318640 1 --2- 172.21.15.67:0/2483847987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 0x7fbe340b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe3b318640 1 -- 172.21.15.67:0/2483847987 >> 172.21.15.67:0/2483847987 conn(0x7fbe3409aa30 msgr2=0x7fbe340b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe3b318640 1 -- 172.21.15.67:0/2483847987 shutdown_connections 2024-09-19T05:37:06.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.645+0000 7fbe3b318640 1 -- 172.21.15.67:0/2483847987 wait complete. 2024-09-19T05:37:06.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 Processor -- start 2024-09-19T05:37:06.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 -- start start 2024-09-19T05:37:06.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe3406bcc0 0x7fbe340d1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 0x7fbe3413c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe34145e10 0x7fbe341f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbe340b2d60 con 0x7fbe3406bcc0 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbe340b2be0 con 0x7fbe34145e10 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbe34168fa0 con 0x7fbe340b03a0 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe390b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe3406bcc0 0x7fbe340d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe390b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe3406bcc0 0x7fbe340d1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52268/0 (socket says 172.21.15.67:52268) 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe390b4640 1 -- 172.21.15.67:0/4272223427 learned_addr learned my addr 172.21.15.67:0/4272223427 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe398b5640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe34145e10 0x7fbe341f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe388b3640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 0x7fbe3413c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe390b4640 1 -- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 msgr2=0x7fbe3413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe390b4640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 0x7fbe3413c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe390b4640 1 -- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe34145e10 msgr2=0x7fbe341f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe390b4640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe34145e10 0x7fbe341f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe390b4640 1 -- 172.21.15.67:0/4272223427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3413d7b0 con 0x7fbe3406bcc0 2024-09-19T05:37:06.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe398b5640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe34145e10 0x7fbe341f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:06.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe390b4640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe3406bcc0 0x7fbe340d1940 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c500 tx=0x7fbe2400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe29ffb640 1 -- 172.21.15.67:0/4272223427 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe24016020 con 0x7fbe3406bcc0 2024-09-19T05:37:06.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe29ffb640 1 -- 172.21.15.67:0/4272223427 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe24005220 con 0x7fbe3406bcc0 2024-09-19T05:37:06.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe29ffb640 1 -- 172.21.15.67:0/4272223427 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe24007030 con 0x7fbe3406bcc0 2024-09-19T05:37:06.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 -- 172.21.15.67:0/4272223427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3413da90 con 0x7fbe3406bcc0 2024-09-19T05:37:06.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 -- 172.21.15.67:0/4272223427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe3413a7f0 con 0x7fbe3406bcc0 2024-09-19T05:37:06.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.649+0000 7fbe3b318640 1 -- 172.21.15.67:0/4272223427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe3406c150 con 0x7fbe3406bcc0 2024-09-19T05:37:06.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.653+0000 7fbe29ffb640 1 -- 172.21.15.67:0/4272223427 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbe240071f0 con 0x7fbe3406bcc0 2024-09-19T05:37:06.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.653+0000 7fbe29ffb640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbe180678f0 0x7fbe18069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.653+0000 7fbe29ffb640 1 -- 172.21.15.67:0/4272223427 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fbe24085800 con 0x7fbe3406bcc0 2024-09-19T05:37:06.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.653+0000 7fbe388b3640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbe180678f0 0x7fbe18069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.653+0000 7fbe388b3640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbe180678f0 0x7fbe18069db0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbe3413bd20 tx=0x7fbe30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.657+0000 7fbe29ffb640 1 -- 172.21.15.67:0/4272223427 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fbe24020020 con 0x7fbe3406bcc0 2024-09-19T05:37:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.845+0000 7fbe3b318640 1 -- 172.21.15.67:0/4272223427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe34166390 con 0x7fbe3406bcc0 2024-09-19T05:37:06.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe29ffb640 1 -- 172.21.15.67:0/4272223427 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5218 (secure 0 0 0) 0x7fbe24056190 con 0x7fbe3406bcc0 2024-09-19T05:37:06.852 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:06.852 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"btime":"2024-09-19T05:37:05:315740+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/872634022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":872634022},{"type":"v1","addr":"172.21.15.97:6836","nonce":872634022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2340749382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2340749382},{"type":"v1","addr":"172.21.15.97:6837","nonce":2340749382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1455090407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1455090407},{"type":"v1","addr":"172.21.15.67:6833","nonce":1455090407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:36:32.070002+0000","modified":"2024-09-19T05:37:04.760308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5364":{"gid":5364,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.67:6835/985983096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":985983096},{"type":"v1","addr":"172.21.15.67:6835","nonce":985983096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5364,"qdb_cluster":[5364]},"id":3}]} 2024-09-19T05:37:06.852 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 25 2024-09-19T05:37:06.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 -- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbe180678f0 msgr2=0x7fbe18069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbe180678f0 0x7fbe18069db0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbe3413bd20 tx=0x7fbe30008040 comp rx=0 tx=0).stop 2024-09-19T05:37:06.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 -- 172.21.15.67:0/4272223427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe3406bcc0 msgr2=0x7fbe340d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe3406bcc0 0x7fbe340d1940 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c500 tx=0x7fbe2400c9c0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 -- 172.21.15.67:0/4272223427 shutdown_connections 2024-09-19T05:37:06.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe34145e10 0x7fbe341f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbe180678f0 0x7fbe18069db0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe340b03a0 0x7fbe3413c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 --2- 172.21.15.67:0/4272223427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe3406bcc0 0x7fbe340d1940 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 -- 172.21.15.67:0/4272223427 >> 172.21.15.67:0/4272223427 conn(0x7fbe3409aa30 msgr2=0x7fbe3409cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 -- 172.21.15.67:0/4272223427 shutdown_connections 2024-09-19T05:37:06.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.849+0000 7fbe3b318640 1 -- 172.21.15.67:0/4272223427 wait complete. 2024-09-19T05:37:06.869 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 389106025 2024-09-19T05:37:06.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faafb9ea640 1 Processor -- start 2024-09-19T05:37:06.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faafb9ea640 1 -- start start 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faafb9ea640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faaf406dfc0 0x7faaf406f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faafb9ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faaf406fea0 0x7faaf40b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faafb9ea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf40aef30 con 0x7faaf415b1d0 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faafb9ea640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7faaf4072210 con 0x7faaf406dfc0 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faafb9ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faaf40ae3b0 con 0x7faaf406fea0 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faaf8f85640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faaf406dfc0 0x7faaf406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faaf8f85640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faaf406dfc0 0x7faaf406f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52282/0 (socket says 172.21.15.67:52282) 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faaf8f85640 1 -- 172.21.15.67:0/679618138 learned_addr learned my addr 172.21.15.67:0/679618138 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faaf9f87640 1 --2- 172.21.15.67:0/679618138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faaf406fea0 0x7faaf40b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faaf8f85640 1 -- 172.21.15.67:0/679618138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faaf406fea0 msgr2=0x7faaf40b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faaf8f85640 1 --2- 172.21.15.67:0/679618138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faaf406fea0 0x7faaf40b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faaf8f85640 1 -- 172.21.15.67:0/679618138 >> v1:172.21.15.97:6789/0 conn(0x7faaf415b1d0 legacy=0x7faaf40adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.989+0000 7faaf8f85640 1 -- 172.21.15.67:0/679618138 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf40ae690 con 0x7faaf406dfc0 2024-09-19T05:37:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faaf8f85640 1 --2- 172.21.15.67:0/679618138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf406dfc0 0x7faaf406f960 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7faae400bb10 tx=0x7faae401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c712f38c41e00d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faaebfff640 1 -- 172.21.15.67:0/679618138 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae40b4070 con 0x7faaf406dfc0 2024-09-19T05:37:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faaebfff640 1 -- 172.21.15.67:0/679618138 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae40a7b00 con 0x7faaf406dfc0 2024-09-19T05:37:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faaebfff640 1 -- 172.21.15.67:0/679618138 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae40af440 con 0x7faaf406dfc0 2024-09-19T05:37:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faafb9ea640 1 -- 172.21.15.67:0/679618138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf406dfc0 msgr2=0x7faaf406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faafb9ea640 1 --2- 172.21.15.67:0/679618138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf406dfc0 0x7faaf406f960 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7faae400bb10 tx=0x7faae401ec30 comp rx=0 tx=0).stop 2024-09-19T05:37:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faafb9ea640 1 -- 172.21.15.67:0/679618138 shutdown_connections 2024-09-19T05:37:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faafb9ea640 1 --2- 172.21.15.67:0/679618138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faaf406fea0 0x7faaf40b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faafb9ea640 1 --2- 172.21.15.67:0/679618138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf406dfc0 0x7faaf406f960 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faafb9ea640 1 -- 172.21.15.67:0/679618138 >> 172.21.15.67:0/679618138 conn(0x7faaf40b1e50 msgr2=0x7faaf40b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faafb9ea640 1 -- 172.21.15.67:0/679618138 shutdown_connections 2024-09-19T05:37:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faafb9ea640 1 -- 172.21.15.67:0/679618138 wait complete. 2024-09-19T05:37:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faafb9ea640 1 Processor -- start 2024-09-19T05:37:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.993+0000 7faafb9ea640 1 -- start start 2024-09-19T05:37:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faafb9ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faaf406dfc0 0x7faaf4099b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faafb9ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faaf406fea0 0x7faaf409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faafb9ea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf415b1d0 0x7faaf409bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faafb9ea640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faaf40b4300 con 0x7faaf415b1d0 2024-09-19T05:37:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faafb9ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faaf40b4180 con 0x7faaf406fea0 2024-09-19T05:37:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faafb9ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faaf40b4480 con 0x7faaf406dfc0 2024-09-19T05:37:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf9f87640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf415b1d0 0x7faaf409bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf9f87640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf415b1d0 0x7faaf409bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52298/0 (socket says 172.21.15.67:52298) 2024-09-19T05:37:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf9f87640 1 -- 172.21.15.67:0/1715836695 learned_addr learned my addr 172.21.15.67:0/1715836695 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf8f85640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faaf406fea0 0x7faaf409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf9786640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faaf406dfc0 0x7faaf4099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf9f87640 1 -- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faaf406dfc0 msgr2=0x7faaf4099b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf9f87640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faaf406dfc0 0x7faaf4099b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf9f87640 1 -- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faaf406fea0 msgr2=0x7faaf409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf9f87640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faaf406fea0 0x7faaf409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf9f87640 1 -- 172.21.15.67:0/1715836695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf409a670 con 0x7faaf415b1d0 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faaf9f87640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf415b1d0 0x7faaf409bd40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7faaec007e90 tx=0x7faaec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faae9ffb640 1 -- 172.21.15.67:0/1715836695 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec014420 con 0x7faaf415b1d0 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faae9ffb640 1 -- 172.21.15.67:0/1715836695 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaec019070 con 0x7faaf415b1d0 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faafb9ea640 1 -- 172.21.15.67:0/1715836695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf409a950 con 0x7faaf415b1d0 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faae9ffb640 1 -- 172.21.15.67:0/1715836695 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec014800 con 0x7faaf415b1d0 2024-09-19T05:37:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faafb9ea640 1 -- 172.21.15.67:0/1715836695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf409af10 con 0x7faaf415b1d0 2024-09-19T05:37:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faae9ffb640 1 -- 172.21.15.67:0/1715836695 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faaec0149a0 con 0x7faaf415b1d0 2024-09-19T05:37:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:06.997+0000 7faae9ffb640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faad80678c0 0x7faad8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faae9ffb640 1 -- 172.21.15.67:0/1715836695 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7faaec0866b0 con 0x7faaf415b1d0 2024-09-19T05:37:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faad80678c0 0x7faad8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 Processor -- start 2024-09-19T05:37:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 -- start start 2024-09-19T05:37:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faad80678c0 0x7faad8069d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faaf415a740 tx=0x7faaf0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d48aee40 0x55d6d4864cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d4865200 0x55d6d48655e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d6d474b800 con 0x55d6d48ae520 2024-09-19T05:37:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d6d46b2a30 con 0x55d6d4865200 2024-09-19T05:37:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d6d46581e0 con 0x55d6d48aee40 2024-09-19T05:37:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48ae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52304/0 (socket says 172.21.15.67:52304) 2024-09-19T05:37:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 -- 172.21.15.67:0/2670164910 learned_addr learned my addr 172.21.15.67:0/2670164910 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf8f85640 1 --2- 172.21.15.67:0/2670164910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d48aee40 0x55d6d4864cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9f87640 1 --2- 172.21.15.67:0/2670164910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d4865200 0x55d6d48655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 -- 172.21.15.67:0/2670164910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d48aee40 msgr2=0x55d6d4864cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 --2- 172.21.15.67:0/2670164910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d48aee40 0x55d6d4864cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 -- 172.21.15.67:0/2670164910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d4865200 msgr2=0x55d6d48655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 --2- 172.21.15.67:0/2670164910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d4865200 0x55d6d48655e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 -- 172.21.15.67:0/2670164910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6d466ac90 con 0x55d6d48ae520 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faaf9786640 1 --2- 172.21.15.67:0/2670164910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48ae900 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faaf0001ea0 tx=0x7faaf0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e3a019a6bbb50f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faadeffd640 1 -- 172.21.15.67:0/2670164910 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0003600 con 0x55d6d48ae520 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faadeffd640 1 -- 172.21.15.67:0/2670164910 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf00037a0 con 0x55d6d48ae520 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faadeffd640 1 -- 172.21.15.67:0/2670164910 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0003b50 con 0x55d6d48ae520 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 -- 172.21.15.67:0/2670164910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 msgr2=0x55d6d48ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 --2- 172.21.15.67:0/2670164910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48ae900 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faaf0001ea0 tx=0x7faaf0011000 comp rx=0 tx=0).stop 2024-09-19T05:37:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 -- 172.21.15.67:0/2670164910 shutdown_connections 2024-09-19T05:37:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 --2- 172.21.15.67:0/2670164910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d4865200 0x55d6d48655e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 --2- 172.21.15.67:0/2670164910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d48aee40 0x55d6d4864cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 --2- 172.21.15.67:0/2670164910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48ae900 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 -- 172.21.15.67:0/2670164910 >> 172.21.15.67:0/2670164910 conn(0x55d6d4861180 msgr2=0x55d6d48635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 -- 172.21.15.67:0/2670164910 shutdown_connections 2024-09-19T05:37:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 -- 172.21.15.67:0/2670164910 wait complete. 2024-09-19T05:37:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 -- start start 2024-09-19T05:37:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.001+0000 7faafeaa6000 1 Processor -- start 2024-09-19T05:37:07.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d4865200 0x55d6d4870110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d48ae520 0x55d6d4870650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d4870b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d6d464c4c0 con 0x55d6d4865200 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d6d46ae9f0 con 0x55d6d48aee40 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d6d46b1d40 con 0x55d6d48ae520 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 10 client.0 _ll_register_callbacks cb 0x55d6d47663d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf9786640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d4865200 0x55d6d4870110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf9786640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d4865200 0x55d6d4870110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52314/0 (socket says 172.21.15.67:52314) 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf9786640 1 -- 172.21.15.67:0/1338335985 learned_addr learned my addr 172.21.15.67:0/1338335985 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf9786640 1 -- 172.21.15.67:0/1338335985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d48ae520 msgr2=0x55d6d4870650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf9786640 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d48ae520 0x55d6d4870650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf9f87640 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d4870b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf9786640 1 -- 172.21.15.67:0/1338335985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 msgr2=0x55d6d4870b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf9786640 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d4870b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf9786640 1 -- 172.21.15.67:0/1338335985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6d4658410 con 0x55d6d4865200 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf9786640 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d4865200 0x55d6d4870110 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7faaf0008fd0 tx=0x7faaf0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db74ddf33d5f347c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faad3fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faad3fff640 1 -- 172.21.15.67:0/1338335985 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0021450 con 0x55d6d4865200 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- 172.21.15.67:0/1338335985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaf00037a0 con 0x55d6d4865200 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faad3fff640 1 -- 172.21.15.67:0/1338335985 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7faaf00215f0 con 0x55d6d4865200 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faad3fff640 1 -- 172.21.15.67:0/1338335985 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faaf0034050 con 0x55d6d4865200 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 10 client.5832 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- 172.21.15.67:0/1338335985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55d6d4652440 con 0x55d6d4865200 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faad3fff640 1 -- 172.21.15.67:0/1338335985 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf00037a0 con 0x55d6d4865200 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faad3fff640 1 -- 172.21.15.67:0/1338335985 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7faaf0037020 con 0x55d6d4865200 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 10 client.5832 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:07.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 10 client.5832 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 20 client.5832 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d6d48715a0 0x55d6d48c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 4 client.5832 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- 172.21.15.67:0/1338335985 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6d464cbf0 con 0x55d6d48715a0 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf8f85640 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d6d48715a0 0x55d6d48c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faaf8f85640 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d6d48715a0 0x55d6d48c05d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea8afc4aeb812d4 server_cookie=7a39c6d9e576cea2 in_seq=0 out_seq=0 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faad3fff640 10 client.5832 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faad3fff640 1 -- 172.21.15.67:0/1338335985 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6d464cbf0 con 0x55d6d48715a0 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faad3fff640 10 client.5832 handle_command_reply: tid=0 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 client.5832 shutdown 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- 172.21.15.67:0/1338335985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d4865200 msgr2=0x55d6d4870110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d4865200 0x55d6d4870110 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7faaf0008fd0 tx=0x7faaf0000ee0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- 172.21.15.67:0/1338335985 shutdown_connections 2024-09-19T05:37:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d6d48715a0 0x55d6d48c05d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d4870b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d48ae520 0x55d6d4870650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 --2- 172.21.15.67:0/1338335985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d4865200 0x55d6d4870110 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faad3fff640 0 client.5832 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- 172.21.15.67:0/1338335985 >> 172.21.15.67:0/1338335985 conn(0x55d6d4861180 msgr2=0x55d6d4863d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- 172.21.15.67:0/1338335985 shutdown_connections 2024-09-19T05:37:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 1 -- 172.21.15.67:0/1338335985 wait complete. 2024-09-19T05:37:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.005+0000 7faafeaa6000 20 client.5832 trim_cache size 0 max 16384 2024-09-19T05:37:07.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 Processor -- start 2024-09-19T05:37:07.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 -- start start 2024-09-19T05:37:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d4865200 0x55d6d48c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d48c1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faaf4203f80 con 0x55d6d48ae520 2024-09-19T05:37:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faaf4202fb0 con 0x55d6d48aee40 2024-09-19T05:37:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faaf4159280 con 0x55d6d4865200 2024-09-19T05:37:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faaf8f85640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faaf8f85640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52318/0 (socket says 172.21.15.67:52318) 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faaf8f85640 1 -- 172.21.15.67:0/3473555294 learned_addr learned my addr 172.21.15.67:0/3473555294 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faaf8f85640 1 -- 172.21.15.67:0/3473555294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d4865200 msgr2=0x55d6d48c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faaf8f85640 1 --2- 172.21.15.67:0/3473555294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d4865200 0x55d6d48c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faaf8f85640 1 -- 172.21.15.67:0/3473555294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 msgr2=0x55d6d48c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faaf8f85640 1 --2- 172.21.15.67:0/3473555294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d48c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faaf8f85640 1 -- 172.21.15.67:0/3473555294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6d4734810 con 0x55d6d48ae520 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faaf8f85640 1 --2- 172.21.15.67:0/3473555294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c0b10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7faae400bb10 tx=0x7faae4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f82cb9c6a3308c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faade7fc640 1 -- 172.21.15.67:0/3473555294 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae40b4040 con 0x55d6d48ae520 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faade7fc640 1 -- 172.21.15.67:0/3473555294 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae40af440 con 0x55d6d48ae520 2024-09-19T05:37:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faade7fc640 1 -- 172.21.15.67:0/3473555294 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae40af830 con 0x55d6d48ae520 2024-09-19T05:37:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 -- 172.21.15.67:0/3473555294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 msgr2=0x55d6d48c0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 --2- 172.21.15.67:0/3473555294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c0b10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7faae400bb10 tx=0x7faae4004740 comp rx=0 tx=0).stop 2024-09-19T05:37:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 -- 172.21.15.67:0/3473555294 shutdown_connections 2024-09-19T05:37:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 --2- 172.21.15.67:0/3473555294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d48c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 --2- 172.21.15.67:0/3473555294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c0b10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 --2- 172.21.15.67:0/3473555294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d4865200 0x55d6d48c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 -- 172.21.15.67:0/3473555294 >> 172.21.15.67:0/3473555294 conn(0x55d6d4861180 msgr2=0x55d6d4870190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 -- 172.21.15.67:0/3473555294 shutdown_connections 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.021+0000 7faafeaa6000 1 -- 172.21.15.67:0/3473555294 wait complete. 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- start start 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 Processor -- start 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d4865200 0x55d6d48c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d48de8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d6d466c800 con 0x55d6d48ae520 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faaf41598d0 con 0x55d6d48aee40 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d6d46ae9f0 con 0x55d6d4865200 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 10 client.0 _ll_register_callbacks cb 0x7faaf0001da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf8f85640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf8f85640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52320/0 (socket says 172.21.15.67:52320) 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf8f85640 1 -- 172.21.15.67:0/984663039 learned_addr learned my addr 172.21.15.67:0/984663039 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf9786640 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d4865200 0x55d6d48c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf9f87640 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d48de8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf8f85640 1 -- 172.21.15.67:0/984663039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d4865200 msgr2=0x55d6d48c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf8f85640 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d4865200 0x55d6d48c33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf8f85640 1 -- 172.21.15.67:0/984663039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 msgr2=0x55d6d48de8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf8f85640 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d48de8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf8f85640 1 -- 172.21.15.67:0/984663039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6d4646380 con 0x55d6d48ae520 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf8f85640 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c3900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7faae401f4d0 tx=0x7faae401d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b837a09eb748951d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faad3fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faad3fff640 1 -- 172.21.15.67:0/984663039 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae40b4040 con 0x55d6d48ae520 2024-09-19T05:37:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faad3fff640 1 -- 172.21.15.67:0/984663039 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7faae40c7ce0 con 0x55d6d48ae520 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- 172.21.15.67:0/984663039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faae40af440 con 0x55d6d48ae520 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faad3fff640 1 -- 172.21.15.67:0/984663039 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faae4004300 con 0x55d6d48ae520 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 10 client.5838 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- 172.21.15.67:0/984663039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55d6d464a560 con 0x55d6d48ae520 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faad3fff640 1 -- 172.21.15.67:0/984663039 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae40af440 con 0x55d6d48ae520 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faad3fff640 1 -- 172.21.15.67:0/984663039 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7faae400e040 con 0x55d6d48ae520 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 10 client.5838 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 10 client.5838 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 20 client.5838 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d6d48df130 0x55d6d4922740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 4 client.5838 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 389106025}] 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- 172.21.15.67:0/984663039 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "damage rm", "damage_id": 389106025}) -- 0x55d6d46c0160 con 0x55d6d48df130 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf9786640 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d6d48df130 0x55d6d4922740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faad3fff640 10 client.5838 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faaf9786640 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d6d48df130 0x55d6d4922740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da92d8e053724b6 server_cookie=1d146771d8d86ea in_seq=0 out_seq=0 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faad3fff640 1 -- 172.21.15.67:0/984663039 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55d6d46c0160 con 0x55d6d48df130 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faad3fff640 10 client.5838 handle_command_reply: tid=0 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 client.5838 shutdown 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- 172.21.15.67:0/984663039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 msgr2=0x55d6d48c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c3900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7faae401f4d0 tx=0x7faae401d470 comp rx=0 tx=0).stop 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- 172.21.15.67:0/984663039 shutdown_connections 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d6d48df130 0x55d6d4922740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6d48aee40 0x55d6d48de8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faad3fff640 0 client.5838 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d6d48ae520 0x55d6d48c3900 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 --2- 172.21.15.67:0/984663039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d6d4865200 0x55d6d48c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- 172.21.15.67:0/984663039 >> 172.21.15.67:0/984663039 conn(0x55d6d4861180 msgr2=0x55d6d48708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- 172.21.15.67:0/984663039 shutdown_connections 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 1 -- 172.21.15.67:0/984663039 wait complete. 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.025+0000 7faafeaa6000 20 client.5838 trim_cache size 0 max 16384 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 -- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faad80678c0 msgr2=0x7faad8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faad80678c0 0x7faad8069d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faaf415a740 tx=0x7faaf0009040 comp rx=0 tx=0).stop 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 -- 172.21.15.67:0/1715836695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf415b1d0 msgr2=0x7faaf409bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf415b1d0 0x7faaf409bd40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7faaec007e90 tx=0x7faaec00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 -- 172.21.15.67:0/1715836695 shutdown_connections 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf415b1d0 0x7faaf409bd40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faaf406fea0 0x7faaf409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faad80678c0 0x7faad8069d80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 --2- 172.21.15.67:0/1715836695 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faaf406dfc0 0x7faaf4099b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 -- 172.21.15.67:0/1715836695 >> 172.21.15.67:0/1715836695 conn(0x7faaf40b1e50 msgr2=0x7faaf4165120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 -- 172.21.15.67:0/1715836695 shutdown_connections 2024-09-19T05:37:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.029+0000 7faafb9ea640 1 -- 172.21.15.67:0/1715836695 wait complete. 2024-09-19T05:37:07.047 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-19T05:37:07.047 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-19T05:37:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.161+0000 7f3e1fa18640 1 Processor -- start 2024-09-19T05:37:07.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.161+0000 7f3e1fa18640 1 -- start start 2024-09-19T05:37:07.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.161+0000 7f3e1fa18640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3e18070070 0x7f3e18165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.161+0000 7f3e1fa18640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e180aef30 con 0x7f3e1806dfc0 2024-09-19T05:37:07.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.161+0000 7f3e1fa18640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e180ae3b0 con 0x7f3e1815b1d0 2024-09-19T05:37:07.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.161+0000 7f3e1fa18640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3e18072210 con 0x7f3e18070070 2024-09-19T05:37:07.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1cfb3640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3e1806dfc0 0x7f3e1806f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58538/0 (socket says 172.21.15.67:58538) 2024-09-19T05:37:07.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/1914857338 learned_addr learned my addr 172.21.15.67:0/1914857338 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:07.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1dfb5640 1 --2- 172.21.15.67:0/1914857338 >> v2:172.21.15.67:3300/0 conn(0x7f3e18070070 0x7f3e18165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e17fff640 1 -- 172.21.15.67:0/1914857338 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928527881 0 0) 0x7f3e180aef30 con 0x7f3e1806dfc0 2024-09-19T05:37:07.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e17fff640 1 -- 172.21.15.67:0/1914857338 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e00003530 con 0x7f3e1806dfc0 2024-09-19T05:37:07.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1dfb5640 1 -- 172.21.15.67:0/1914857338 >> v1:172.21.15.97:6789/0 conn(0x7f3e1815b1d0 legacy=0x7f3e180adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1dfb5640 1 -- 172.21.15.67:0/1914857338 >> v1:172.21.15.67:6789/0 conn(0x7f3e1806dfc0 legacy=0x7f3e1806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1dfb5640 1 -- 172.21.15.67:0/1914857338 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e180ae690 con 0x7f3e18070070 2024-09-19T05:37:07.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1dfb5640 1 --2- 172.21.15.67:0/1914857338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 0x7f3e18165de0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3e080097c0 tx=0x7f3e0801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9338931c81cb78e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e17fff640 1 -- 172.21.15.67:0/1914857338 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080b1070 con 0x7f3e18070070 2024-09-19T05:37:07.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e17fff640 1 -- 172.21.15.67:0/1914857338 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e080ac5f0 con 0x7f3e18070070 2024-09-19T05:37:07.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e17fff640 1 -- 172.21.15.67:0/1914857338 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080ac9c0 con 0x7f3e18070070 2024-09-19T05:37:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1fa18640 1 -- 172.21.15.67:0/1914857338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 msgr2=0x7f3e18165de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1fa18640 1 --2- 172.21.15.67:0/1914857338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 0x7f3e18165de0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3e080097c0 tx=0x7f3e0801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1fa18640 1 -- 172.21.15.67:0/1914857338 shutdown_connections 2024-09-19T05:37:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1fa18640 1 --2- 172.21.15.67:0/1914857338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 0x7f3e18165de0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1fa18640 1 -- 172.21.15.67:0/1914857338 >> 172.21.15.67:0/1914857338 conn(0x7f3e180b1e50 msgr2=0x7f3e180b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1fa18640 1 -- 172.21.15.67:0/1914857338 shutdown_connections 2024-09-19T05:37:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.165+0000 7f3e1fa18640 1 -- 172.21.15.67:0/1914857338 wait complete. 2024-09-19T05:37:07.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1fa18640 1 Processor -- start 2024-09-19T05:37:07.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1fa18640 1 -- start start 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1fa18640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e1806dfc0 0x7f3e181527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1fa18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 0x7f3e1815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1fa18640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e1815b1d0 0x7f3e1814c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1fa18640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18168b40 con 0x7f3e18070070 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1fa18640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e180b4440 con 0x7f3e1815b1d0 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1fa18640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e18168cc0 con 0x7f3e1806dfc0 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1cfb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 0x7f3e1815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1cfb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 0x7f3e1815dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52340/0 (socket says 172.21.15.67:52340) 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/651507272 learned_addr learned my addr 172.21.15.67:0/651507272 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e1806dfc0 0x7f3e181527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1dfb5640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e1815b1d0 0x7f3e1814c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e1806dfc0 msgr2=0x7f3e181527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e1806dfc0 0x7f3e181527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e1815b1d0 msgr2=0x7f3e1814c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e1815b1d0 0x7f3e1814c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/651507272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1815c0e0 con 0x7f3e18070070 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e1806dfc0 0x7f3e181527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 0x7f3e1815dff0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00c500 tx=0x7f3e0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e15ffb640 1 -- 172.21.15.67:0/651507272 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c017070 con 0x7f3e18070070 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e15ffb640 1 -- 172.21.15.67:0/651507272 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0c005cf0 con 0x7f3e18070070 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e15ffb640 1 -- 172.21.15.67:0/651507272 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0072f0 con 0x7f3e18070070 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1fa18640 1 -- 172.21.15.67:0/651507272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1815c3c0 con 0x7f3e18070070 2024-09-19T05:37:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e1fa18640 1 -- 172.21.15.67:0/651507272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1814f210 con 0x7f3e18070070 2024-09-19T05:37:07.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.169+0000 7f3e15ffb640 1 -- 172.21.15.67:0/651507272 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e0c01a070 con 0x7f3e18070070 2024-09-19T05:37:07.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e15ffb640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e040678c0 0x7f3e04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e15ffb640 1 -- 172.21.15.67:0/651507272 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f3e0c085170 con 0x7f3e18070070 2024-09-19T05:37:07.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e040678c0 0x7f3e04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 Processor -- start 2024-09-19T05:37:07.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 -- start start 2024-09-19T05:37:07.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e040678c0 0x7f3e04069d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e10007fd0 tx=0x7f3e10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e0c10 0x5654359e0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e1530 0x5654359e1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x565435a2fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5654358c3bd0 con 0x5654359e0c10 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56543582a9e0 con 0x5654359e1e50 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5654357d08f0 con 0x5654359e1530 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e0c10 0x5654359e0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e0c10 0x5654359e0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52350/0 (socket says 172.21.15.67:52350) 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 -- 172.21.15.67:0/1534351805 learned_addr learned my addr 172.21.15.67:0/1534351805 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/1534351805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e1530 0x5654359e1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1dfb5640 1 --2- 172.21.15.67:0/1534351805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x565435a2fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 -- 172.21.15.67:0/1534351805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e1530 msgr2=0x5654359e1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/1534351805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e1530 0x5654359e1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 -- 172.21.15.67:0/1534351805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 msgr2=0x565435a2fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/1534351805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x565435a2fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 -- 172.21.15.67:0/1534351805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654357c8970 con 0x5654359e0c10 2024-09-19T05:37:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/1534351805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e0c10 0x5654359e0ff0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3e10001440 tx=0x7f3e10010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5829c6e75cdd5673 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3dfeffd640 1 -- 172.21.15.67:0/1534351805 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10024070 con 0x5654359e0c10 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3dfeffd640 1 -- 172.21.15.67:0/1534351805 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1001f400 con 0x5654359e0c10 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3dfeffd640 1 -- 172.21.15.67:0/1534351805 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1001f7d0 con 0x5654359e0c10 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1534351805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e0c10 msgr2=0x5654359e0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/1534351805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e0c10 0x5654359e0ff0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3e10001440 tx=0x7f3e10010000 comp rx=0 tx=0).stop 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1534351805 shutdown_connections 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/1534351805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x565435a2fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/1534351805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e1530 0x5654359e1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/1534351805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e0c10 0x5654359e0ff0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1534351805 >> 172.21.15.67:0/1534351805 conn(0x5654359d3ba0 msgr2=0x5654359db0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1534351805 shutdown_connections 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.173+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1534351805 wait complete. 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- start start 2024-09-19T05:37:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 Processor -- start 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e0c10 0x565435a2de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a32e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e1e50 0x565435a35350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5654357c4a50 con 0x5654359e1530 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5654358269a0 con 0x5654359e0c10 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5654358e7330 con 0x5654359e1e50 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 10 client.0 _ll_register_callbacks cb 0x56543588c430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1cfb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a32e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1cfb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a32e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52366/0 (socket says 172.21.15.67:52366) 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/1430003469 learned_addr learned my addr 172.21.15.67:0/1430003469 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e0c10 0x565435a2de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1dfb5640 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e1e50 0x565435a35350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/1430003469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e1e50 msgr2=0x565435a35350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e1e50 0x565435a35350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/1430003469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e0c10 msgr2=0x565435a2de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e0c10 0x565435a2de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/1430003469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565435833650 con 0x5654359e1530 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a32e00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c083570 tx=0x7f3e0c05e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839a1e0de7efeaef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3df3fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3df3fff640 1 -- 172.21.15.67:0/1430003469 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c007490 con 0x5654359e1530 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3df3fff640 1 -- 172.21.15.67:0/1430003469 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f3e0c007630 con 0x5654359e1530 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1430003469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e1001f400 con 0x5654359e1530 2024-09-19T05:37:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3df3fff640 1 -- 172.21.15.67:0/1430003469 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e0c083050 con 0x5654359e1530 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 10 client.5853 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1430003469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5654357d0b40 con 0x5654359e1530 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3df3fff640 1 -- 172.21.15.67:0/1430003469 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1001f400 con 0x5654359e1530 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3df3fff640 1 -- 172.21.15.67:0/1430003469 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f3e0c06d1d0 con 0x5654359e1530 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 10 client.5853 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 10 client.5853 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 20 client.5853 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565435a38270 0x565435a3a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 4 client.5853 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1430003469 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654357c5020 con 0x565435a38270 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565435a38270 0x565435a3a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565435a38270 0x565435a3a660 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9096d5e07b0e1440 server_cookie=168915cb29c7c818 in_seq=0 out_seq=0 2024-09-19T05:37:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3df3fff640 10 client.5853 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3df3fff640 1 -- 172.21.15.67:0/1430003469 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654357c5020 con 0x565435a38270 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3df3fff640 10 client.5853 handle_command_reply: tid=0 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 client.5853 shutdown 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1430003469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 msgr2=0x565435a32e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a32e00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c083570 tx=0x7f3e0c05e060 comp rx=0 tx=0).stop 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1430003469 shutdown_connections 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e1e50 0x565435a35350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a32e00 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565435a38270 0x565435a3a660 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/1430003469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e0c10 0x565435a2de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3df3fff640 0 client.5853 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1430003469 >> 172.21.15.67:0/1430003469 conn(0x5654359d3ba0 msgr2=0x5654359da8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1430003469 shutdown_connections 2024-09-19T05:37:07.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 1 -- 172.21.15.67:0/1430003469 wait complete. 2024-09-19T05:37:07.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.177+0000 7f3e22ad4000 20 client.5853 trim_cache size 0 max 16384 2024-09-19T05:37:07.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.193+0000 7f3e22ad4000 1 Processor -- start 2024-09-19T05:37:07.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.193+0000 7f3e22ad4000 1 -- start start 2024-09-19T05:37:07.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.193+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 0x565435a34da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.193+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a352e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.193+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x5654359da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181ff8f0 con 0x5654359e1530 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181fe9a0 con 0x5654359e1e50 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1815a130 con 0x5654359e0c10 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a352e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52370/0 (socket says 172.21.15.67:52370) 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/2910453889 learned_addr learned my addr 172.21.15.67:0/2910453889 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 0x565435a34da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1dfb5640 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x5654359da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/2910453889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 msgr2=0x565435a34da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 0x565435a34da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/2910453889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 msgr2=0x5654359da8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x5654359da8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/2910453889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654357caa00 con 0x5654359e1530 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 0x565435a34da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1dfb5640 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x5654359da8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a352e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0554c0 tx=0x7f3e0c01e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b38ba03a5969134 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3dfe7fc640 1 -- 172.21.15.67:0/2910453889 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c055070 con 0x5654359e1530 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3dfe7fc640 1 -- 172.21.15.67:0/2910453889 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0c06d1d0 con 0x5654359e1530 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3dfe7fc640 1 -- 172.21.15.67:0/2910453889 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c054980 con 0x5654359e1530 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- 172.21.15.67:0/2910453889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 msgr2=0x565435a352e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a352e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0554c0 tx=0x7f3e0c01e070 comp rx=0 tx=0).stop 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- 172.21.15.67:0/2910453889 shutdown_connections 2024-09-19T05:37:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x5654359da8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a352e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/2910453889 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 0x565435a34da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- 172.21.15.67:0/2910453889 >> 172.21.15.67:0/2910453889 conn(0x5654359d3ba0 msgr2=0x565435a2f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- 172.21.15.67:0/2910453889 shutdown_connections 2024-09-19T05:37:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- 172.21.15.67:0/2910453889 wait complete. 2024-09-19T05:37:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- start start 2024-09-19T05:37:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 Processor -- start 2024-09-19T05:37:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 0x565435a9dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a9e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x565435a3bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5654359e5e80 con 0x5654359e1530 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1815a780 con 0x5654359e1e50 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5654358269a0 con 0x5654359e0c10 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e22ad4000 10 client.0 _ll_register_callbacks cb 0x7f3e0c0518c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a9e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a9e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52382/0 (socket says 172.21.15.67:52382) 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/4194374791 learned_addr learned my addr 172.21.15.67:0/4194374791 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 0x565435a9dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1dfb5640 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x565435a3bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/4194374791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 msgr2=0x565435a9dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 0x565435a9dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/4194374791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 msgr2=0x565435a3bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x565435a3bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 -- 172.21.15.67:0/4194374791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654357e8a50 con 0x5654359e1530 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1dfb5640 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x565435a3bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.197+0000 7f3e1cfb3640 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a9e520 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0554c0 tx=0x7f3e0c083440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cf2a74c49f409e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3df3fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3df3fff640 1 -- 172.21.15.67:0/4194374791 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c055070 con 0x5654359e1530 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 -- 172.21.15.67:0/4194374791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e0c06d1d0 con 0x5654359e1530 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3df3fff640 1 -- 172.21.15.67:0/4194374791 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f3e0c054b90 con 0x5654359e1530 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3df3fff640 1 -- 172.21.15.67:0/4194374791 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e0c051280 con 0x5654359e1530 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 10 client.5859 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 -- 172.21.15.67:0/4194374791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5654357c2b10 con 0x5654359e1530 2024-09-19T05:37:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3df3fff640 1 -- 172.21.15.67:0/4194374791 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0c06d1d0 con 0x5654359e1530 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3df3fff640 1 -- 172.21.15.67:0/4194374791 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f3e0c07a020 con 0x5654359e1530 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 10 client.5859 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 10 client.5859 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 20 client.5859 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565435a3c050 0x565435a3c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 4 client.5859 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 -- 172.21.15.67:0/4194374791 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x565435807cd0 con 0x565435a3c050 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565435a3c050 0x565435a3c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3df3fff640 10 client.5859 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1d7b4640 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565435a3c050 0x565435a3c460 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=facd198df360e071 server_cookie=1ab3b0afab5b7feb in_seq=0 out_seq=0 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3df3fff640 1 -- 172.21.15.67:0/4194374791 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565435807cd0 con 0x565435a3c050 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3df3fff640 10 client.5859 handle_command_reply: tid=0 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 client.5859 shutdown 2024-09-19T05:37:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 -- 172.21.15.67:0/4194374791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 msgr2=0x565435a9e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a9e520 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0554c0 tx=0x7f3e0c083440 comp rx=0 tx=0).stop 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 -- 172.21.15.67:0/4194374791 shutdown_connections 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565435a3c050 0x565435a3c460 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5654359e1e50 0x565435a3bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654359e1530 0x565435a9e520 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3df3fff640 0 client.5859 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 --2- 172.21.15.67:0/4194374791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5654359e0c10 0x565435a9dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 -- 172.21.15.67:0/4194374791 >> 172.21.15.67:0/4194374791 conn(0x5654359d3ba0 msgr2=0x565435a33d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 -- 172.21.15.67:0/4194374791 shutdown_connections 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 1 -- 172.21.15.67:0/4194374791 wait complete. 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e22ad4000 20 client.5859 trim_cache size 0 max 16384 2024-09-19T05:37:07.211 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:07.212 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:37:07.212 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:37:07.212 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:07.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1fa18640 1 -- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e040678c0 msgr2=0x7f3e04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1fa18640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e040678c0 0x7f3e04069d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e10007fd0 tx=0x7f3e10009040 comp rx=0 tx=0).stop 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1fa18640 1 -- 172.21.15.67:0/651507272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 msgr2=0x7f3e1815dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1fa18640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 0x7f3e1815dff0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00c500 tx=0x7f3e0c00c9c0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1fa18640 1 -- 172.21.15.67:0/651507272 shutdown_connections 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1fa18640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e1815b1d0 0x7f3e1814c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1fa18640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e18070070 0x7f3e1815dff0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1fa18640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e040678c0 0x7f3e04069d80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1fa18640 1 --2- 172.21.15.67:0/651507272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e1806dfc0 0x7f3e181527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.201+0000 7f3e1fa18640 1 -- 172.21.15.67:0/651507272 >> 172.21.15.67:0/651507272 conn(0x7f3e180b1e50 msgr2=0x7f3e180729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.205+0000 7f3e1fa18640 1 -- 172.21.15.67:0/651507272 shutdown_connections 2024-09-19T05:37:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.205+0000 7f3e1fa18640 1 -- 172.21.15.67:0/651507272 wait complete. 2024-09-19T05:37:07.223 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-19T05:37:07.223 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-19T05:37:07.223 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-19T05:37:07.224 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-19T05:37:07.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:07.224 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-19T05:37:07.229 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:37:07.229 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> import stat 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> import json 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> import sys 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> try: 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> except OSError as e: 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> sys.exit(e.errno) 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> print(json.dumps( 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> indent=2)) 2024-09-19T05:37:07.230 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:37:07.333 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:07.333 INFO:teuthology.orchestra.run.smithi067.stdout: "st_mode": 16893, 2024-09-19T05:37:07.333 INFO:teuthology.orchestra.run.smithi067.stdout: "st_ino": 1099511627777, 2024-09-19T05:37:07.333 INFO:teuthology.orchestra.run.smithi067.stdout: "st_dev": 45, 2024-09-19T05:37:07.333 INFO:teuthology.orchestra.run.smithi067.stdout: "st_nlink": 16, 2024-09-19T05:37:07.334 INFO:teuthology.orchestra.run.smithi067.stdout: "st_uid": 1000, 2024-09-19T05:37:07.334 INFO:teuthology.orchestra.run.smithi067.stdout: "st_gid": 1271, 2024-09-19T05:37:07.334 INFO:teuthology.orchestra.run.smithi067.stdout: "st_size": 9176001, 2024-09-19T05:37:07.334 INFO:teuthology.orchestra.run.smithi067.stdout: "st_atime": 1726724205.8843908, 2024-09-19T05:37:07.334 INFO:teuthology.orchestra.run.smithi067.stdout: "st_mtime": 1726724220.1203356, 2024-09-19T05:37:07.334 INFO:teuthology.orchestra.run.smithi067.stdout: "st_ctime": 1726724220.1203356 2024-09-19T05:37:07.334 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:07.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:07.343 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-09-19T05:37:07.343 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-19T05:37:07.343 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-19T05:37:07.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332eff3640 1 Processor -- start 2024-09-19T05:37:07.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332eff3640 1 -- start start 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332eff3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f332815c3a0 0x7f33280cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332eff3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f33280cfa40 0x7f33280cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332eff3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33280ced80 con 0x7f33280d1130 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332eff3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f33280d03d0 con 0x7f332815c3a0 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332eff3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f33280cdce0 con 0x7f33280cfa40 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332cd8f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f332815c3a0 0x7f33280cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332d590640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f33280d1130 0x7f33280d1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58554/0 (socket says 172.21.15.67:58554) 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332cd8f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f332815c3a0 0x7f33280cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52386/0 (socket says 172.21.15.67:52386) 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332cd8f640 1 -- 172.21.15.67:0/213350277 learned_addr learned my addr 172.21.15.67:0/213350277 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f3327fff640 1 --2- 172.21.15.67:0/213350277 >> v2:172.21.15.97:3300/0 conn(0x7f33280cfa40 0x7f33280cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332cd8f640 1 -- 172.21.15.67:0/213350277 >> v2:172.21.15.97:3300/0 conn(0x7f33280cfa40 msgr2=0x7f33280cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332cd8f640 1 --2- 172.21.15.67:0/213350277 >> v2:172.21.15.97:3300/0 conn(0x7f33280cfa40 0x7f33280cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332cd8f640 1 -- 172.21.15.67:0/213350277 >> v1:172.21.15.67:6789/0 conn(0x7f33280d1130 legacy=0x7f33280d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f332cd8f640 1 -- 172.21.15.67:0/213350277 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33280cdfc0 con 0x7f332815c3a0 2024-09-19T05:37:07.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.525+0000 7f33277fe640 1 -- 172.21.15.67:0/213350277 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310958120 0 0) 0x7f33280ced80 con 0x7f33280d1130 2024-09-19T05:37:07.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332cd8f640 1 --2- 172.21.15.67:0/213350277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f332815c3a0 0x7f33280cf0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3328073cb0 tx=0x7f331801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dc898dcc23d589 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f33277fe640 1 -- 172.21.15.67:0/213350277 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33180aa650 con 0x7f332815c3a0 2024-09-19T05:37:07.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f33277fe640 1 -- 172.21.15.67:0/213350277 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33180af070 con 0x7f332815c3a0 2024-09-19T05:37:07.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f33277fe640 1 -- 172.21.15.67:0/213350277 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33180aaa10 con 0x7f332815c3a0 2024-09-19T05:37:07.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 -- 172.21.15.67:0/213350277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f332815c3a0 msgr2=0x7f33280cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 --2- 172.21.15.67:0/213350277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f332815c3a0 0x7f33280cf0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3328073cb0 tx=0x7f331801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 -- 172.21.15.67:0/213350277 shutdown_connections 2024-09-19T05:37:07.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 --2- 172.21.15.67:0/213350277 >> v2:172.21.15.97:3300/0 conn(0x7f33280cfa40 0x7f33280cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 --2- 172.21.15.67:0/213350277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f332815c3a0 0x7f33280cf0a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 -- 172.21.15.67:0/213350277 >> 172.21.15.67:0/213350277 conn(0x7f33280b6570 msgr2=0x7f33280b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 -- 172.21.15.67:0/213350277 shutdown_connections 2024-09-19T05:37:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 -- 172.21.15.67:0/213350277 wait complete. 2024-09-19T05:37:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 Processor -- start 2024-09-19T05:37:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 -- start start 2024-09-19T05:37:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33280cfa40 0x7f332814b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33280d1130 0x7f332814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f332815c3a0 0x7f332815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f332806ca80 con 0x7f33280d1130 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f332815c780 con 0x7f332815c3a0 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332eff3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f332806cc00 con 0x7f33280cfa40 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f3327fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33280d1130 0x7f332814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f3327fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33280d1130 0x7f332814c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52396/0 (socket says 172.21.15.67:52396) 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f3327fff640 1 -- 172.21.15.67:0/3763329764 learned_addr learned my addr 172.21.15.67:0/3763329764 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332cd8f640 1 --2- 172.21.15.67:0/3763329764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33280cfa40 0x7f332814b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332d590640 1 --2- 172.21.15.67:0/3763329764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f332815c3a0 0x7f332815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f3327fff640 1 -- 172.21.15.67:0/3763329764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33280cfa40 msgr2=0x7f332814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f3327fff640 1 --2- 172.21.15.67:0/3763329764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33280cfa40 0x7f332814b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f3327fff640 1 -- 172.21.15.67:0/3763329764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f332815c3a0 msgr2=0x7f332815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f3327fff640 1 --2- 172.21.15.67:0/3763329764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f332815c3a0 0x7f332815edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f3327fff640 1 -- 172.21.15.67:0/3763329764 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33280b0ca0 con 0x7f33280d1130 2024-09-19T05:37:07.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f332d590640 1 --2- 172.21.15.67:0/3763329764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f332815c3a0 0x7f332815edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.529+0000 7f3327fff640 1 --2- 172.21.15.67:0/3763329764 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33280d1130 0x7f332814c680 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f331c00d800 tx=0x7f331c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f33257fa640 1 -- 172.21.15.67:0/3763329764 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c00b6c0 con 0x7f33280d1130 2024-09-19T05:37:07.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f33257fa640 1 -- 172.21.15.67:0/3763329764 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331c019070 con 0x7f33280d1130 2024-09-19T05:37:07.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f332eff3640 1 -- 172.21.15.67:0/3763329764 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332814bbf0 con 0x7f33280d1130 2024-09-19T05:37:07.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f33257fa640 1 -- 172.21.15.67:0/3763329764 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c00ba60 con 0x7f33280d1130 2024-09-19T05:37:07.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f332eff3640 1 -- 172.21.15.67:0/3763329764 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33280b0f60 con 0x7f33280d1130 2024-09-19T05:37:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f33257fa640 1 -- 172.21.15.67:0/3763329764 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f331c00bc00 con 0x7f33280d1130 2024-09-19T05:37:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f33257fa640 1 --2- 172.21.15.67:0/3763329764 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33140678c0 0x7f3314069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f33257fa640 1 -- 172.21.15.67:0/3763329764 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f331c0863b0 con 0x7f33280d1130 2024-09-19T05:37:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f332cd8f640 1 --2- 172.21.15.67:0/3763329764 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33140678c0 0x7f3314069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f33320af000 1 Processor -- start 2024-09-19T05:37:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f33320af000 1 -- start start 2024-09-19T05:37:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.533+0000 7f332cd8f640 1 --2- 172.21.15.67:0/3763329764 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33140678c0 0x7f3314069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f33180ae000 tx=0x7f3318008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d4c84f0 0x55805d4c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 0x55805d47eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d47f430 0x55805d47f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55805d3666a0 con 0x55805d47f430 2024-09-19T05:37:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55805d2ccb80 con 0x55805d4c8e10 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55805d2736d0 con 0x55805d4c84f0 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d47f430 0x55805d47f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d47f430 0x55805d47f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52408/0 (socket says 172.21.15.67:52408) 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 -- 172.21.15.67:0/810933444 learned_addr learned my addr 172.21.15.67:0/810933444 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f3327fff640 1 --2- 172.21.15.67:0/810933444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 0x55805d47eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332cd8f640 1 --2- 172.21.15.67:0/810933444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d4c84f0 0x55805d4c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 -- 172.21.15.67:0/810933444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d4c84f0 msgr2=0x55805d4c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 --2- 172.21.15.67:0/810933444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d4c84f0 0x55805d4c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 -- 172.21.15.67:0/810933444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 msgr2=0x55805d47eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 --2- 172.21.15.67:0/810933444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 0x55805d47eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 -- 172.21.15.67:0/810933444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805d285030 con 0x55805d47f430 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 --2- 172.21.15.67:0/810933444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d47f430 0x55805d47f810 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3320001ea0 tx=0x7f332000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b039e67494c6ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f330e7fc640 1 -- 172.21.15.67:0/810933444 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320018070 con 0x55805d47f430 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f330e7fc640 1 -- 172.21.15.67:0/810933444 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3320005da0 con 0x55805d47f430 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f330e7fc640 1 -- 172.21.15.67:0/810933444 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200072d0 con 0x55805d47f430 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- 172.21.15.67:0/810933444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d47f430 msgr2=0x55805d47f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 --2- 172.21.15.67:0/810933444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d47f430 0x55805d47f810 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3320001ea0 tx=0x7f332000d520 comp rx=0 tx=0).stop 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- 172.21.15.67:0/810933444 shutdown_connections 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 --2- 172.21.15.67:0/810933444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d47f430 0x55805d47f810 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 --2- 172.21.15.67:0/810933444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 0x55805d47eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 --2- 172.21.15.67:0/810933444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d4c84f0 0x55805d4c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- 172.21.15.67:0/810933444 >> 172.21.15.67:0/810933444 conn(0x55805d476820 msgr2=0x55805d47d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- 172.21.15.67:0/810933444 shutdown_connections 2024-09-19T05:37:07.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- 172.21.15.67:0/810933444 wait complete. 2024-09-19T05:37:07.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- start start 2024-09-19T05:37:07.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 Processor -- start 2024-09-19T05:37:07.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d47f430 0x55805d4cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 0x55805d4d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55805d28a8f0 con 0x55805d4c84f0 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55805d2c8b40 con 0x55805d4c8e10 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55805d2d11b0 con 0x55805d47f430 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33320af000 10 client.0 _ll_register_callbacks cb 0x55805d381270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f3327fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f3327fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52422/0 (socket says 172.21.15.67:52422) 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f3327fff640 1 -- 172.21.15.67:0/3477810172 learned_addr learned my addr 172.21.15.67:0/3477810172 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332cd8f640 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d47f430 0x55805d4cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 0x55805d4d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f3327fff640 1 -- 172.21.15.67:0/3477810172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d47f430 msgr2=0x55805d4cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f3327fff640 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d47f430 0x55805d4cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f3327fff640 1 -- 172.21.15.67:0/3477810172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 msgr2=0x55805d4d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f3327fff640 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 0x55805d4d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f3327fff640 1 -- 172.21.15.67:0/3477810172 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805d273920 con 0x55805d4c84f0 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f332d590640 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 0x55805d4d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f3327fff640 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4cfbb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f331c084680 tx=0x7f331c056590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d3d7b8eca26aae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33077fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.537+0000 7f33077fe640 1 -- 172.21.15.67:0/3477810172 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c082060 con 0x55805d4c84f0 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33077fe640 1 -- 172.21.15.67:0/3477810172 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f331c052c00 con 0x55805d4c84f0 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 -- 172.21.15.67:0/3477810172 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3320005da0 con 0x55805d4c84f0 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33077fe640 1 -- 172.21.15.67:0/3477810172 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f331c073050 con 0x55805d4c84f0 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 10 client.5874 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 -- 172.21.15.67:0/3477810172 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55805d26cb30 con 0x55805d4c84f0 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33077fe640 1 -- 172.21.15.67:0/3477810172 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3320005da0 con 0x55805d4c84f0 2024-09-19T05:37:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33077fe640 1 -- 172.21.15.67:0/3477810172 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f331c013070 con 0x55805d4c84f0 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 10 client.5874 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 10 client.5874 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 20 client.5874 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55805d4d7a40 0x55805d4d9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 4 client.5874 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 -- 172.21.15.67:0/3477810172 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55805d267150 con 0x55805d4d7a40 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f332cd8f640 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55805d4d7a40 0x55805d4d9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33077fe640 10 client.5874 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f332cd8f640 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55805d4d7a40 0x55805d4d9e30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25d59361ba2828ca server_cookie=6f5ff112ca1a22fb in_seq=0 out_seq=0 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33077fe640 1 -- 172.21.15.67:0/3477810172 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55805d267150 con 0x55805d4d7a40 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33077fe640 10 client.5874 handle_command_reply: tid=0 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 client.5874 shutdown 2024-09-19T05:37:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 -- 172.21.15.67:0/3477810172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 msgr2=0x55805d4cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4cfbb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f331c084680 tx=0x7f331c056590 comp rx=0 tx=0).stop 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 -- 172.21.15.67:0/3477810172 shutdown_connections 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55805d4d7a40 0x55805d4d9e30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c8e10 0x55805d4d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4cfbb0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 --2- 172.21.15.67:0/3477810172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d47f430 0x55805d4cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33077fe640 0 client.5874 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 -- 172.21.15.67:0/3477810172 >> 172.21.15.67:0/3477810172 conn(0x55805d476820 msgr2=0x55805d47d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 -- 172.21.15.67:0/3477810172 shutdown_connections 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 1 -- 172.21.15.67:0/3477810172 wait complete. 2024-09-19T05:37:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.541+0000 7f33320af000 20 client.5874 trim_cache size 0 max 16384 2024-09-19T05:37:07.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 Processor -- start 2024-09-19T05:37:07.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 -- start start 2024-09-19T05:37:07.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d47f430 0x55805d4d5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c84f0 0x55805d480820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c8e10 0x55805d480d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55805d47f2b0 con 0x55805d4c8e10 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3328201de0 con 0x55805d4c84f0 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3328200e00 con 0x55805d47f430 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f332d590640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c8e10 0x55805d480d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f332d590640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c8e10 0x55805d480d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52432/0 (socket says 172.21.15.67:52432) 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f332d590640 1 -- 172.21.15.67:0/1078855744 learned_addr learned my addr 172.21.15.67:0/1078855744 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f332d590640 1 -- 172.21.15.67:0/1078855744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d47f430 msgr2=0x55805d4d5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f332d590640 1 --2- 172.21.15.67:0/1078855744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d47f430 0x55805d4d5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f332d590640 1 -- 172.21.15.67:0/1078855744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c84f0 msgr2=0x55805d480820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f332d590640 1 --2- 172.21.15.67:0/1078855744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c84f0 0x55805d480820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f332d590640 1 -- 172.21.15.67:0/1078855744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805d34f6c0 con 0x55805d4c8e10 2024-09-19T05:37:07.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f332d590640 1 --2- 172.21.15.67:0/1078855744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c8e10 0x55805d480d60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3320000f90 tx=0x7f332000b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25225749ce988122 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f330dffb640 1 -- 172.21.15.67:0/1078855744 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320018070 con 0x55805d4c8e10 2024-09-19T05:37:07.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f330dffb640 1 -- 172.21.15.67:0/1078855744 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3320019040 con 0x55805d4c8e10 2024-09-19T05:37:07.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f330dffb640 1 -- 172.21.15.67:0/1078855744 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320004db0 con 0x55805d4c8e10 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 -- 172.21.15.67:0/1078855744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c8e10 msgr2=0x55805d480d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 --2- 172.21.15.67:0/1078855744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c8e10 0x55805d480d60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3320000f90 tx=0x7f332000b000 comp rx=0 tx=0).stop 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 -- 172.21.15.67:0/1078855744 shutdown_connections 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 --2- 172.21.15.67:0/1078855744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c8e10 0x55805d480d60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 --2- 172.21.15.67:0/1078855744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d4c84f0 0x55805d480820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 --2- 172.21.15.67:0/1078855744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d47f430 0x55805d4d5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 -- 172.21.15.67:0/1078855744 >> 172.21.15.67:0/1078855744 conn(0x55805d476820 msgr2=0x55805d4d5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 -- 172.21.15.67:0/1078855744 shutdown_connections 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.557+0000 7f33320af000 1 -- 172.21.15.67:0/1078855744 wait complete. 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- start start 2024-09-19T05:37:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 Processor -- start 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d47f430 0x55805d4dc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4f8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d4c8e10 0x55805d4f8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33282007b0 con 0x55805d4c84f0 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33280b25c0 con 0x55805d47f430 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55805d484b00 con 0x55805d4c8e10 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 10 client.0 _ll_register_callbacks cb 0x7f331c052830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f3327fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f3327fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4f8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52444/0 (socket says 172.21.15.67:52444) 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f3327fff640 1 -- 172.21.15.67:0/3678644757 learned_addr learned my addr 172.21.15.67:0/3678644757 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f3327fff640 1 -- 172.21.15.67:0/3678644757 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d4c8e10 msgr2=0x55805d4f8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f332d590640 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d4c8e10 0x55805d4f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f332cd8f640 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d47f430 0x55805d4dc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f3327fff640 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d4c8e10 0x55805d4f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f3327fff640 1 -- 172.21.15.67:0/3678644757 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d47f430 msgr2=0x55805d4dc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f3327fff640 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d47f430 0x55805d4dc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f3327fff640 1 -- 172.21.15.67:0/3678644757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805d325920 con 0x55805d4c84f0 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f3327fff640 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4f8120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f331c00bfd0 tx=0x7f331c084550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8385fbd994d7606 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33077fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33077fe640 1 -- 172.21.15.67:0/3678644757 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c06e070 con 0x55805d4c84f0 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33077fe640 1 -- 172.21.15.67:0/3678644757 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f331c084350 con 0x55805d4c84f0 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- 172.21.15.67:0/3678644757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3320019040 con 0x55805d4c84f0 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33077fe640 1 -- 172.21.15.67:0/3678644757 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f331c055ef0 con 0x55805d4c84f0 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 10 client.5880 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- 172.21.15.67:0/3678644757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55805d265970 con 0x55805d4c84f0 2024-09-19T05:37:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33077fe640 1 -- 172.21.15.67:0/3678644757 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3320019040 con 0x55805d4c84f0 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33077fe640 1 -- 172.21.15.67:0/3678644757 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f331c05bad0 con 0x55805d4c84f0 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 10 client.5880 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 10 client.5880 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 20 client.5880 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55805d4f8ba0 0x55805d53bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 4 client.5880 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- 172.21.15.67:0/3678644757 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55805d2da2b0 con 0x55805d4f8ba0 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f332cd8f640 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55805d4f8ba0 0x55805d53bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33077fe640 10 client.5880 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f332cd8f640 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55805d4f8ba0 0x55805d53bbc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9101572b9a2d743 server_cookie=18d41399b355d3a3 in_seq=0 out_seq=0 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33077fe640 1 -- 172.21.15.67:0/3678644757 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x55805d2da2b0 con 0x55805d4f8ba0 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33077fe640 10 client.5880 handle_command_reply: tid=0 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 client.5880 shutdown 2024-09-19T05:37:07.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- 172.21.15.67:0/3678644757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 msgr2=0x55805d4f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4f8120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f331c00bfd0 tx=0x7f331c084550 comp rx=0 tx=0).stop 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- 172.21.15.67:0/3678644757 shutdown_connections 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55805d4c8e10 0x55805d4f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55805d4c84f0 0x55805d4f8120 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55805d4f8ba0 0x55805d53bbc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 --2- 172.21.15.67:0/3678644757 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55805d47f430 0x55805d4dc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33077fe640 0 client.5880 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- 172.21.15.67:0/3678644757 >> 172.21.15.67:0/3678644757 conn(0x55805d476820 msgr2=0x55805d4d5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- 172.21.15.67:0/3678644757 shutdown_connections 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 1 -- 172.21.15.67:0/3678644757 wait complete. 2024-09-19T05:37:07.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.561+0000 7f33320af000 20 client.5880 trim_cache size 0 max 16384 2024-09-19T05:37:07.573 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:07.573 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:37:07.573 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": -2 2024-09-19T05:37:07.573 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:07.573 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-19T05:37:07.574 INFO:teuthology.orchestra.run.smithi067.stderr:Error ENOENT: 2024-09-19T05:37:07.574 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-19T05:37:07.574 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-19T05:37:07.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-19T05:37:07.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.689+0000 7f1b4fe72640 1 Processor -- start 2024-09-19T05:37:07.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.689+0000 7f1b4fe72640 1 -- start start 2024-09-19T05:37:07.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.689+0000 7f1b4fe72640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b4806dfc0 0x7f1b4806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.689+0000 7f1b4fe72640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b480aef30 con 0x7f1b4806fea0 2024-09-19T05:37:07.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.689+0000 7f1b4fe72640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b480ae3b0 con 0x7f1b4815b1d0 2024-09-19T05:37:07.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.689+0000 7f1b4fe72640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1b48072210 con 0x7f1b4806dfc0 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4e40f640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1b4806fea0 0x7f1b480b3430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58568/0 (socket says 172.21.15.67:58568) 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4e40f640 1 -- 172.21.15.67:0/225469083 learned_addr learned my addr 172.21.15.67:0/225469083 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/225469083 >> v2:172.21.15.97:3300/0 conn(0x7f1b4806dfc0 0x7f1b4806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404500019 0 0) 0x7f1b480aef30 con 0x7f1b4806fea0 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b34003530 con 0x7f1b4806fea0 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 561703317 0 0) 0x7f1b34003530 con 0x7f1b4806fea0 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 >> v2:172.21.15.97:3300/0 conn(0x7f1b4806dfc0 msgr2=0x7f1b4806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 --2- 172.21.15.67:0/225469083 >> v2:172.21.15.97:3300/0 conn(0x7f1b4806dfc0 0x7f1b4806f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 >> v1:172.21.15.97:6789/0 conn(0x7f1b4815b1d0 legacy=0x7f1b480adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b480ae690 con 0x7f1b4806fea0 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1b40001a00 con 0x7f1b4806fea0 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 >> v1:172.21.15.67:6789/0 conn(0x7f1b4806fea0 legacy=0x7f1b480b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b340039c0 0x7f1b34003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b34004810 0x7f1b34004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b340051d0 0x7f1b3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b48072210 con 0x7f1b340039c0 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3400c070 con 0x7f1b34004810 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3400c270 con 0x7f1b340051d0 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b340039c0 0x7f1b34003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4dc0e640 1 -- 172.21.15.67:0/225469083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b340051d0 msgr2=0x7f1b3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b340051d0 0x7f1b3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b34004810 0x7f1b34004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b340051d0 0x7f1b3400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4dc0e640 1 -- 172.21.15.67:0/225469083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b34004810 msgr2=0x7f1b34004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b34004810 0x7f1b34004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4dc0e640 1 -- 172.21.15.67:0/225469083 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b34003530 con 0x7f1b340039c0 2024-09-19T05:37:07.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4e40f640 1 -- 172.21.15.67:0/225469083 reap_dead start 2024-09-19T05:37:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b340039c0 0x7f1b34003de0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1b44001780 tx=0x7f1b4401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a729fc8ad0b034 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b440013a0 con 0x7f1b340039c0 2024-09-19T05:37:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b440052f0 con 0x7f1b340039c0 2024-09-19T05:37:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.693+0000 7f1b4cc0c640 1 -- 172.21.15.67:0/225469083 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44003840 con 0x7f1b340039c0 2024-09-19T05:37:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- 172.21.15.67:0/225469083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b340039c0 msgr2=0x7f1b34003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b340039c0 0x7f1b34003de0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1b44001780 tx=0x7f1b4401c420 comp rx=0 tx=0).stop 2024-09-19T05:37:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- 172.21.15.67:0/225469083 shutdown_connections 2024-09-19T05:37:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 --2- 172.21.15.67:0/225469083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b340039c0 0x7f1b34003de0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- 172.21.15.67:0/225469083 >> 172.21.15.67:0/225469083 conn(0x7f1b480b1e50 msgr2=0x7f1b480b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- 172.21.15.67:0/225469083 shutdown_connections 2024-09-19T05:37:07.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- 172.21.15.67:0/225469083 wait complete. 2024-09-19T05:37:07.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 Processor -- start 2024-09-19T05:37:07.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- start start 2024-09-19T05:37:07.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b340039c0 0x7f1b4814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b4815a670 0x7f1b4815e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b481e7910 0x7f1b48153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b480ae100 con 0x7f1b481e7910 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b480adf80 con 0x7f1b4815a670 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4815f490 con 0x7f1b340039c0 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4e40f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b481e7910 0x7f1b48153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4e40f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b481e7910 0x7f1b48153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52468/0 (socket says 172.21.15.67:52468) 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4e40f640 1 -- 172.21.15.67:0/2802006152 learned_addr learned my addr 172.21.15.67:0/2802006152 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b4815a670 0x7f1b4815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b340039c0 0x7f1b4814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4e40f640 1 -- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b340039c0 msgr2=0x7f1b4814a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b340039c0 0x7f1b4814a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4e40f640 1 -- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b4815a670 msgr2=0x7f1b4815e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b4815a670 0x7f1b4815e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4e40f640 1 -- 172.21.15.67:0/2802006152 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b481e8160 con 0x7f1b481e7910 2024-09-19T05:37:07.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b481e7910 0x7f1b48153400 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1b40000f90 tx=0x7f1b4000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b3e7fc640 1 -- 172.21.15.67:0/2802006152 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40004d70 con 0x7f1b481e7910 2024-09-19T05:37:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b3e7fc640 1 -- 172.21.15.67:0/2802006152 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4000bb20 con 0x7f1b481e7910 2024-09-19T05:37:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- 172.21.15.67:0/2802006152 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4815d800 con 0x7f1b481e7910 2024-09-19T05:37:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b3e7fc640 1 -- 172.21.15.67:0/2802006152 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40007070 con 0x7f1b481e7910 2024-09-19T05:37:07.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.697+0000 7f1b4fe72640 1 -- 172.21.15.67:0/2802006152 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4815ddc0 con 0x7f1b481e7910 2024-09-19T05:37:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b3e7fc640 1 -- 172.21.15.67:0/2802006152 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b4001b020 con 0x7f1b481e7910 2024-09-19T05:37:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b3e7fc640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 0x7f1b2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b3e7fc640 1 -- 172.21.15.67:0/2802006152 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1b40085d60 con 0x7f1b481e7910 2024-09-19T05:37:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 0x7f1b2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b52f2e000 1 Processor -- start 2024-09-19T05:37:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b52f2e000 1 -- start start 2024-09-19T05:37:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 0x7f1b2c069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1b44001750 tx=0x7f1b440011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f4e60 0x564fa67f5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f5780 0x564fa67ab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67abe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564fa65f8b70 con 0x564fa67aba90 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564fa659ef10 con 0x564fa67f4e60 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564fa65f4b30 con 0x564fa67f5780 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4e40f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4e40f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67abe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52482/0 (socket says 172.21.15.67:52482) 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4e40f640 1 -- 172.21.15.67:0/3233205129 learned_addr learned my addr 172.21.15.67:0/3233205129 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/3233205129 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f5780 0x564fa67ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/3233205129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f4e60 0x564fa67f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4e40f640 1 -- 172.21.15.67:0/3233205129 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f5780 msgr2=0x564fa67ab550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/3233205129 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f5780 0x564fa67ab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4e40f640 1 -- 172.21.15.67:0/3233205129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f4e60 msgr2=0x564fa67f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.701+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/3233205129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f4e60 0x564fa67f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4e40f640 1 -- 172.21.15.67:0/3233205129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa65acd60 con 0x564fa67aba90 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/3233205129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f4e60 0x564fa67f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/3233205129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67abe70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1b40001830 tx=0x7f1b40056150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de51e2102a64aea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b2b7fe640 1 -- 172.21.15.67:0/3233205129 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40054390 con 0x564fa67aba90 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b2b7fe640 1 -- 172.21.15.67:0/3233205129 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b40052700 con 0x564fa67aba90 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b2b7fe640 1 -- 172.21.15.67:0/3233205129 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4005e930 con 0x564fa67aba90 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- 172.21.15.67:0/3233205129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 msgr2=0x564fa67abe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/3233205129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67abe70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1b40001830 tx=0x7f1b40056150 comp rx=0 tx=0).stop 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- 172.21.15.67:0/3233205129 shutdown_connections 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/3233205129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67abe70 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/3233205129 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f5780 0x564fa67ab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/3233205129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f4e60 0x564fa67f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- 172.21.15.67:0/3233205129 >> 172.21.15.67:0/3233205129 conn(0x564fa67a7a40 msgr2=0x564fa67a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- 172.21.15.67:0/3233205129 shutdown_connections 2024-09-19T05:37:07.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- 172.21.15.67:0/3233205129 wait complete. 2024-09-19T05:37:07.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- start start 2024-09-19T05:37:07.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 Processor -- start 2024-09-19T05:37:07.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67de6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f4e60 0x564fa67b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f5780 0x564fa67b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564fa65fd1a0 con 0x564fa67aba90 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564fa65b64d0 con 0x564fa67f5780 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564fa657db60 con 0x564fa67f4e60 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 10 client.0 _ll_register_callbacks cb 0x564fa65ceef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4dc0e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67de6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4dc0e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67de6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52498/0 (socket says 172.21.15.67:52498) 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4dc0e640 1 -- 172.21.15.67:0/1903957148 learned_addr learned my addr 172.21.15.67:0/1903957148 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f4e60 0x564fa67b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f5780 0x564fa67b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4dc0e640 1 -- 172.21.15.67:0/1903957148 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f4e60 msgr2=0x564fa67b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f4e60 0x564fa67b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4dc0e640 1 -- 172.21.15.67:0/1903957148 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f5780 msgr2=0x564fa67b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f5780 0x564fa67b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4dc0e640 1 -- 172.21.15.67:0/1903957148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fa65bbce0 con 0x564fa67aba90 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f5780 0x564fa67b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67de6d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1b440b8040 tx=0x7f1b440191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4990db30643552e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b28ff9640 1 -- 172.21.15.67:0/1903957148 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b440069e0 con 0x564fa67aba90 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b28ff9640 1 -- 172.21.15.67:0/1903957148 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1b44006b80 con 0x564fa67aba90 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- 172.21.15.67:0/1903957148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b40052700 con 0x564fa67aba90 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b28ff9640 1 -- 172.21.15.67:0/1903957148 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1b44006d80 con 0x564fa67aba90 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 10 client.5892 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 1 -- 172.21.15.67:0/1903957148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x564fa659f160 con 0x564fa67aba90 2024-09-19T05:37:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b28ff9640 1 -- 172.21.15.67:0/1903957148 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b40052700 con 0x564fa67aba90 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b28ff9640 1 -- 172.21.15.67:0/1903957148 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f1b44003600 con 0x564fa67aba90 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 10 client.5892 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.705+0000 7f1b52f2e000 10 client.5892 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 20 client.5892 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564fa67df580 0x564fa67df990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 4 client.5892 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 -- 172.21.15.67:0/1903957148 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fa6592cc0 con 0x564fa67df580 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564fa67df580 0x564fa67df990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b28ff9640 10 client.5892 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564fa67df580 0x564fa67df990 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c2cf6a42737e4cb server_cookie=cd82352088d6602f in_seq=0 out_seq=0 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b28ff9640 1 -- 172.21.15.67:0/1903957148 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fa6592cc0 con 0x564fa67df580 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b28ff9640 10 client.5892 handle_command_reply: tid=0 2024-09-19T05:37:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 client.5892 shutdown 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 -- 172.21.15.67:0/1903957148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 msgr2=0x564fa67de6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67de6d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1b440b8040 tx=0x7f1b440191c0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 -- 172.21.15.67:0/1903957148 shutdown_connections 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564fa67df580 0x564fa67df990 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67f5780 0x564fa67b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f4e60 0x564fa67b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b28ff9640 0 client.5892 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/1903957148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa67de6d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 -- 172.21.15.67:0/1903957148 >> 172.21.15.67:0/1903957148 conn(0x564fa67a7a40 msgr2=0x564fa67aa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 -- 172.21.15.67:0/1903957148 shutdown_connections 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 1 -- 172.21.15.67:0/1903957148 wait complete. 2024-09-19T05:37:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.709+0000 7f1b52f2e000 20 client.5892 trim_cache size 0 max 16384 2024-09-19T05:37:07.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.725+0000 7f1b52f2e000 1 Processor -- start 2024-09-19T05:37:07.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.725+0000 7f1b52f2e000 1 -- start start 2024-09-19T05:37:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 0x564fa6864d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa6865240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f4e60 0x564fa6865780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b482006e0 con 0x564fa67aba90 2024-09-19T05:37:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481ff740 con 0x564fa67a7a40 2024-09-19T05:37:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b481feb00 con 0x564fa67f4e60 2024-09-19T05:37:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4d40d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa6865240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4d40d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa6865240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52502/0 (socket says 172.21.15.67:52502) 2024-09-19T05:37:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4d40d640 1 -- 172.21.15.67:0/4280494542 learned_addr learned my addr 172.21.15.67:0/4280494542 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4d40d640 1 -- 172.21.15.67:0/4280494542 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f4e60 msgr2=0x564fa6865780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/4280494542 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f4e60 0x564fa6865780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/4280494542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 0x564fa6864d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/4280494542 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f4e60 0x564fa6865780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4d40d640 1 -- 172.21.15.67:0/4280494542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 msgr2=0x564fa6864d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/4280494542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 0x564fa6864d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4d40d640 1 -- 172.21.15.67:0/4280494542 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa6598510 con 0x564fa67aba90 2024-09-19T05:37:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/4280494542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa6865240 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x564fa66c4dd0 tx=0x7f1b38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afabcaf9b0b0564 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b2affd640 1 -- 172.21.15.67:0/4280494542 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800f040 con 0x564fa67aba90 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b2affd640 1 -- 172.21.15.67:0/4280494542 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3801f250 con 0x564fa67aba90 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b2affd640 1 -- 172.21.15.67:0/4280494542 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38006be0 con 0x564fa67aba90 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- 172.21.15.67:0/4280494542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 msgr2=0x564fa6865240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/4280494542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa6865240 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x564fa66c4dd0 tx=0x7f1b38008040 comp rx=0 tx=0).stop 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- 172.21.15.67:0/4280494542 shutdown_connections 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/4280494542 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67f4e60 0x564fa6865780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/4280494542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67aba90 0x564fa6865240 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/4280494542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 0x564fa6864d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- 172.21.15.67:0/4280494542 >> 172.21.15.67:0/4280494542 conn(0x564fa67b0880 msgr2=0x564fa67a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- 172.21.15.67:0/4280494542 shutdown_connections 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- 172.21.15.67:0/4280494542 wait complete. 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- start start 2024-09-19T05:37:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 Processor -- start 2024-09-19T05:37:07.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 0x564fa6868b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67aba90 0x564fa6869070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67f4e60 0x564fa68695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564fa65f7e80 con 0x564fa67f4e60 2024-09-19T05:37:07.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481ff0f0 con 0x564fa67a7a40 2024-09-19T05:37:07.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564fa67b43d0 con 0x564fa67aba90 2024-09-19T05:37:07.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b52f2e000 10 client.0 _ll_register_callbacks cb 0x7f1b440b9050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:07.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4e40f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67f4e60 0x564fa68695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4e40f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67f4e60 0x564fa68695b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52516/0 (socket says 172.21.15.67:52516) 2024-09-19T05:37:07.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4e40f640 1 -- 172.21.15.67:0/2733218273 learned_addr learned my addr 172.21.15.67:0/2733218273 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 0x564fa6868b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4d40d640 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67aba90 0x564fa6869070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4e40f640 1 -- 172.21.15.67:0/2733218273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67aba90 msgr2=0x564fa6869070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67aba90 0x564fa6869070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4e40f640 1 -- 172.21.15.67:0/2733218273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 msgr2=0x564fa6868b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 0x564fa6868b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.729+0000 7f1b4e40f640 1 -- 172.21.15.67:0/2733218273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fa6652ad0 con 0x564fa67f4e60 2024-09-19T05:37:07.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 0x564fa6868b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4e40f640 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67f4e60 0x564fa68695b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1b4006c040 tx=0x7f1b4001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f9e1194e6d302b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:07.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b28ff9640 1 -- 172.21.15.67:0/2733218273 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4005e930 con 0x564fa67f4e60 2024-09-19T05:37:07.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b28ff9640 1 -- 172.21.15.67:0/2733218273 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1b40073ca0 con 0x564fa67f4e60 2024-09-19T05:37:07.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 -- 172.21.15.67:0/2733218273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b3801f250 con 0x564fa67f4e60 2024-09-19T05:37:07.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b28ff9640 1 -- 172.21.15.67:0/2733218273 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1b40073ec0 con 0x564fa67f4e60 2024-09-19T05:37:07.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 10 client.5898 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:07.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 -- 172.21.15.67:0/2733218273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x564fa6586af0 con 0x564fa67f4e60 2024-09-19T05:37:07.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b28ff9640 1 -- 172.21.15.67:0/2733218273 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3801f250 con 0x564fa67f4e60 2024-09-19T05:37:07.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b28ff9640 1 -- 172.21.15.67:0/2733218273 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f1b400554e0 con 0x564fa67f4e60 2024-09-19T05:37:07.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 10 client.5898 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 10 client.5898 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 20 client.5898 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564fa67f5780 0x564fa6809d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 4 client.5898 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 -- 172.21.15.67:0/2733218273 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x564fa66062a0 con 0x564fa67f5780 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564fa67f5780 0x564fa6809d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4dc0e640 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564fa67f5780 0x564fa6809d90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13a85138d072b4d server_cookie=582b4c4f24921e85 in_seq=0 out_seq=0 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b28ff9640 10 client.5898 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b28ff9640 1 -- 172.21.15.67:0/2733218273 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x564fa66062a0 con 0x564fa67f5780 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b28ff9640 10 client.5898 handle_command_reply: tid=0 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 client.5898 shutdown 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 -- 172.21.15.67:0/2733218273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67f4e60 msgr2=0x564fa68695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67f4e60 0x564fa68695b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1b4006c040 tx=0x7f1b4001f040 comp rx=0 tx=0).stop 2024-09-19T05:37:07.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 -- 172.21.15.67:0/2733218273 shutdown_connections 2024-09-19T05:37:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564fa67f4e60 0x564fa68695b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564fa67aba90 0x564fa6869070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564fa67f5780 0x564fa6809d90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 --2- 172.21.15.67:0/2733218273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564fa67a7a40 0x564fa6868b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b28ff9640 0 client.5898 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 -- 172.21.15.67:0/2733218273 >> 172.21.15.67:0/2733218273 conn(0x564fa67b0880 msgr2=0x564fa67aa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 -- 172.21.15.67:0/2733218273 shutdown_connections 2024-09-19T05:37:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 1 -- 172.21.15.67:0/2733218273 wait complete. 2024-09-19T05:37:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b52f2e000 20 client.5898 trim_cache size 0 max 16384 2024-09-19T05:37:07.744 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:07.745 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": -2 2024-09-19T05:37:07.745 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:07.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 -- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 msgr2=0x7f1b2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 0x7f1b2c069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1b44001750 tx=0x7f1b440011a0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 -- 172.21.15.67:0/2802006152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b481e7910 msgr2=0x7f1b48153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b481e7910 0x7f1b48153400 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1b40000f90 tx=0x7f1b4000b4a0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 -- 172.21.15.67:0/2802006152 shutdown_connections 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b481e7910 0x7f1b48153400 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b4815a670 0x7f1b4815e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 0x7f1b2c069d80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 --2- 172.21.15.67:0/2802006152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b340039c0 0x7f1b4814a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 -- 172.21.15.67:0/2802006152 >> 172.21.15.67:0/2802006152 conn(0x7f1b480b1e50 msgr2=0x7f1b481546e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 -- 172.21.15.67:0/2802006152 shutdown_connections 2024-09-19T05:37:07.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.733+0000 7f1b4fe72640 1 -- 172.21.15.67:0/2802006152 wait complete. 2024-09-19T05:37:07.754 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-19T05:37:07.754 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-19T05:37:07.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-19T05:37:07.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.865+0000 7fc48199e640 1 Processor -- start 2024-09-19T05:37:07.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.865+0000 7fc48199e640 1 -- start start 2024-09-19T05:37:07.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc48199e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c0d1590 0x7fc47c169240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc48199e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47c0d35a0 con 0x7fc47c0d4fb0 2024-09-19T05:37:07.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc48199e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47c0d32c0 con 0x7fc47c15e690 2024-09-19T05:37:07.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc48199e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc47c06d040 con 0x7fc47c0d1590 2024-09-19T05:37:07.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47a7fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc47c0d4fb0 0x7fc47c0d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58576/0 (socket says 172.21.15.67:58576) 2024-09-19T05:37:07.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47a7fc640 1 -- 172.21.15.67:0/3566585631 learned_addr learned my addr 172.21.15.67:0/3566585631 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:07.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47b7fe640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c0d1590 0x7fc47c169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090615459 0 0) 0x7fc47c0d35a0 con 0x7fc47c0d4fb0 2024-09-19T05:37:07.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc464003530 con 0x7fc47c0d4fb0 2024-09-19T05:37:07.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 181671308 0 0) 0x7fc464003530 con 0x7fc47c0d4fb0 2024-09-19T05:37:07.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c0d1590 msgr2=0x7fc47c169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c0d1590 0x7fc47c169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 >> v1:172.21.15.97:6789/0 conn(0x7fc47c15e690 legacy=0x7fc47c0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c06d320 con 0x7fc47c0d4fb0 2024-09-19T05:37:07.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fc46c001680 con 0x7fc47c0d4fb0 2024-09-19T05:37:07.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 >> v1:172.21.15.67:6789/0 conn(0x7fc47c0d4fb0 legacy=0x7fc47c0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4640039f0 0x7fc464003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640043a0 0x7fc464004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c0d1590 0x7fc4640050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c06d040 con 0x7fc4640043a0 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc46400ba00 con 0x7fc4640039f0 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc46400bc00 con 0x7fc47c0d1590 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640043a0 0x7fc464004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47affd640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4640039f0 0x7fc464003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47b7fe640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c0d1590 0x7fc4640050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47a7fc640 1 -- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c0d1590 msgr2=0x7fc4640050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c0d1590 0x7fc4640050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47a7fc640 1 -- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4640039f0 msgr2=0x7fc464003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4640039f0 0x7fc464003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47a7fc640 1 -- 172.21.15.67:0/3566585631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc464003530 con 0x7fc4640043a0 2024-09-19T05:37:07.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47affd640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4640039f0 0x7fc464003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:07.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.869+0000 7fc47b7fe640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c0d1590 0x7fc4640050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640043a0 0x7fc464004870 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00c2c0 tx=0x7fc46c01cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5857f64a8cafe1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c007d60 con 0x7fc4640043a0 2024-09-19T05:37:07.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc46c0a9070 con 0x7fc4640043a0 2024-09-19T05:37:07.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc479ffb640 1 -- 172.21.15.67:0/3566585631 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0a5df0 con 0x7fc4640043a0 2024-09-19T05:37:07.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 -- 172.21.15.67:0/3566585631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640043a0 msgr2=0x7fc464004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 --2- 172.21.15.67:0/3566585631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640043a0 0x7fc464004870 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00c2c0 tx=0x7fc46c01cd20 comp rx=0 tx=0).stop 2024-09-19T05:37:07.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47b7fe640 1 -- 172.21.15.67:0/3566585631 reap_dead start 2024-09-19T05:37:07.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 -- 172.21.15.67:0/3566585631 shutdown_connections 2024-09-19T05:37:07.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 -- 172.21.15.67:0/3566585631 >> 172.21.15.67:0/3566585631 conn(0x7fc47c0d4490 msgr2=0x7fc47c0d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 -- 172.21.15.67:0/3566585631 shutdown_connections 2024-09-19T05:37:07.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 -- 172.21.15.67:0/3566585631 wait complete. 2024-09-19T05:37:07.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 Processor -- start 2024-09-19T05:37:07.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 -- start start 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc47c15bcb0 0x7fc47c161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c15ebf0 0x7fc47c0b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c1f7ea0 0x7fc47c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c06eb30 con 0x7fc47c15ebf0 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c15ea70 con 0x7fc47c15bcb0 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc48199e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc47c06ecb0 con 0x7fc47c1f7ea0 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c15ebf0 0x7fc47c0b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c15ebf0 0x7fc47c0b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52540/0 (socket says 172.21.15.67:52540) 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47a7fc640 1 -- 172.21.15.67:0/631652247 learned_addr learned my addr 172.21.15.67:0/631652247 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47affd640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc47c15bcb0 0x7fc47c161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47b7fe640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c1f7ea0 0x7fc47c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47a7fc640 1 -- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c1f7ea0 msgr2=0x7fc47c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c1f7ea0 0x7fc47c0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47a7fc640 1 -- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc47c15bcb0 msgr2=0x7fc47c161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc47c15bcb0 0x7fc47c161740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.873+0000 7fc47a7fc640 1 -- 172.21.15.67:0/631652247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c15f3d0 con 0x7fc47c15ebf0 2024-09-19T05:37:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c15ebf0 0x7fc47c0b1600 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0986b0 tx=0x7fc464005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc463fff640 1 -- 172.21.15.67:0/631652247 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0a5ba0 con 0x7fc47c15ebf0 2024-09-19T05:37:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc463fff640 1 -- 172.21.15.67:0/631652247 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc46c0a5d40 con 0x7fc47c15ebf0 2024-09-19T05:37:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc48199e640 1 -- 172.21.15.67:0/631652247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc47c1f7400 con 0x7fc47c15ebf0 2024-09-19T05:37:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc463fff640 1 -- 172.21.15.67:0/631652247 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0073b0 con 0x7fc47c15ebf0 2024-09-19T05:37:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc48199e640 1 -- 172.21.15.67:0/631652247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47c1f76a0 con 0x7fc47c15ebf0 2024-09-19T05:37:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc463fff640 1 -- 172.21.15.67:0/631652247 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc46c007550 con 0x7fc47c15ebf0 2024-09-19T05:37:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc463fff640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4680678f0 0x7fc468069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc463fff640 1 -- 172.21.15.67:0/631652247 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fc46c11f540 con 0x7fc47c15ebf0 2024-09-19T05:37:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc47affd640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4680678f0 0x7fc468069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc484a5a000 1 Processor -- start 2024-09-19T05:37:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc484a5a000 1 -- start start 2024-09-19T05:37:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.877+0000 7fc47affd640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4680678f0 0x7fc468069db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc470007bd0 tx=0x7fc47000a9e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29310 0x561792d296f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 0x561792cdf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792cdfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561792bc7200 con 0x561792cdfb10 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561792aca620 con 0x561792d29c30 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561792b2cb80 con 0x561792d29310 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792cdfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792cdfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52546/0 (socket says 172.21.15.67:52546) 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 -- 172.21.15.67:0/2706895328 learned_addr learned my addr 172.21.15.67:0/2706895328 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/2706895328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 0x561792cdf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47affd640 1 --2- 172.21.15.67:0/2706895328 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29310 0x561792d296f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 -- 172.21.15.67:0/2706895328 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29310 msgr2=0x561792d296f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 --2- 172.21.15.67:0/2706895328 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29310 0x561792d296f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 -- 172.21.15.67:0/2706895328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 msgr2=0x561792cdf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 --2- 172.21.15.67:0/2706895328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 0x561792cdf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 -- 172.21.15.67:0/2706895328 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561792b09470 con 0x561792cdfb10 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/2706895328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 0x561792cdf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 --2- 172.21.15.67:0/2706895328 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792cdfef0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0d4460 tx=0x7fc474009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeda1426a35f5b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc4617fa640 1 -- 172.21.15.67:0/2706895328 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474017680 con 0x561792cdfb10 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc4617fa640 1 -- 172.21.15.67:0/2706895328 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47401c070 con 0x561792cdfb10 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc4617fa640 1 -- 172.21.15.67:0/2706895328 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474017a60 con 0x561792cdfb10 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- 172.21.15.67:0/2706895328 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 msgr2=0x561792cdfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 --2- 172.21.15.67:0/2706895328 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792cdfef0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0d4460 tx=0x7fc474009750 comp rx=0 tx=0).stop 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- 172.21.15.67:0/2706895328 shutdown_connections 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 --2- 172.21.15.67:0/2706895328 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792cdfef0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 --2- 172.21.15.67:0/2706895328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 0x561792cdf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 --2- 172.21.15.67:0/2706895328 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29310 0x561792d296f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- 172.21.15.67:0/2706895328 >> 172.21.15.67:0/2706895328 conn(0x561792ce5c70 msgr2=0x561792cddeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- 172.21.15.67:0/2706895328 shutdown_connections 2024-09-19T05:37:07.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- 172.21.15.67:0/2706895328 wait complete. 2024-09-19T05:37:07.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- start start 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 Processor -- start 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792d28d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29310 0x561792ce39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 0x561792ce3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561792b28b40 con 0x561792cdfb10 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561792ad2350 con 0x561792d29c30 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561792ac65b0 con 0x561792d29310 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc484a5a000 10 client.0 _ll_register_callbacks cb 0x561792b8f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792d28d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792d28d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52558/0 (socket says 172.21.15.67:52558) 2024-09-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47affd640 1 -- 172.21.15.67:0/370296818 learned_addr learned my addr 172.21.15.67:0/370296818 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 0x561792ce3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29310 0x561792ce39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47affd640 1 -- 172.21.15.67:0/370296818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29310 msgr2=0x561792ce39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47affd640 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29310 0x561792ce39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47affd640 1 -- 172.21.15.67:0/370296818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 msgr2=0x561792ce3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47affd640 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 0x561792ce3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47affd640 1 -- 172.21.15.67:0/370296818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561792b73250 con 0x561792cdfb10 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47b7fe640 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 0x561792ce3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc47affd640 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792d28d50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc470014010 tx=0x7fc470007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb8d6bce15491aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.881+0000 7fc45a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc45a7fc640 1 -- 172.21.15.67:0/370296818 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470027020 con 0x561792cdfb10 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc45a7fc640 1 -- 172.21.15.67:0/370296818 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fc470016d30 con 0x561792cdfb10 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 -- 172.21.15.67:0/370296818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc47401c070 con 0x561792cdfb10 2024-09-19T05:37:07.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc45a7fc640 1 -- 172.21.15.67:0/370296818 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc470031050 con 0x561792cdfb10 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 10 client.5910 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 -- 172.21.15.67:0/370296818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x561792ad2ca0 con 0x561792cdfb10 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc45a7fc640 1 -- 172.21.15.67:0/370296818 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47401c070 con 0x561792cdfb10 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc45a7fc640 1 -- 172.21.15.67:0/370296818 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fc470034020 con 0x561792cdfb10 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 10 client.5910 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 10 client.5910 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 20 client.5910 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561792ce4c90 0x561792d395b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 4 client.5910 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 -- 172.21.15.67:0/370296818 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561792ac6d60 con 0x561792ce4c90 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561792ce4c90 0x561792d395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc45a7fc640 10 client.5910 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561792ce4c90 0x561792d395b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5894d3f5c37d88a server_cookie=6a1dc365e7996294 in_seq=0 out_seq=0 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc45a7fc640 1 -- 172.21.15.67:0/370296818 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561792ac6d60 con 0x561792ce4c90 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc45a7fc640 10 client.5910 handle_command_reply: tid=0 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 client.5910 shutdown 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 -- 172.21.15.67:0/370296818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 msgr2=0x561792d28d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792d28d50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc470014010 tx=0x7fc470007a40 comp rx=0 tx=0).stop 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 -- 172.21.15.67:0/370296818 shutdown_connections 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561792ce4c90 0x561792d395b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792d29c30 0x561792ce3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29310 0x561792ce39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 --2- 172.21.15.67:0/370296818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792cdfb10 0x561792d28d50 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc45a7fc640 0 client.5910 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 -- 172.21.15.67:0/370296818 >> 172.21.15.67:0/370296818 conn(0x561792ce5c70 msgr2=0x561792cde5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 -- 172.21.15.67:0/370296818 shutdown_connections 2024-09-19T05:37:07.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 1 -- 172.21.15.67:0/370296818 wait complete. 2024-09-19T05:37:07.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.885+0000 7fc484a5a000 20 client.5910 trim_cache size 0 max 16384 2024-09-19T05:37:07.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 Processor -- start 2024-09-19T05:37:07.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 -- start start 2024-09-19T05:37:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792cdfb10 0x561792d976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d97c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29c30 0x561792d98170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c201bc0 con 0x561792d29310 2024-09-19T05:37:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c200ba0 con 0x561792cdfb10 2024-09-19T05:37:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc47c1ffff0 con 0x561792d29c30 2024-09-19T05:37:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc47a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d97c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc47a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d97c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52564/0 (socket says 172.21.15.67:52564) 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc47a7fc640 1 -- 172.21.15.67:0/2064751702 learned_addr learned my addr 172.21.15.67:0/2064751702 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc47a7fc640 1 -- 172.21.15.67:0/2064751702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29c30 msgr2=0x561792d98170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/2064751702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29c30 0x561792d98170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc47a7fc640 1 -- 172.21.15.67:0/2064751702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792cdfb10 msgr2=0x561792d976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/2064751702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792cdfb10 0x561792d976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc47a7fc640 1 -- 172.21.15.67:0/2064751702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561792acc5b0 con 0x561792d29310 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/2064751702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d97c30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0ebd60 tx=0x7fc46c11d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bfc163a16621e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc460ff9640 1 -- 172.21.15.67:0/2064751702 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0bd040 con 0x561792d29310 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc460ff9640 1 -- 172.21.15.67:0/2064751702 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc46c0a9040 con 0x561792d29310 2024-09-19T05:37:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc460ff9640 1 -- 172.21.15.67:0/2064751702 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0ef900 con 0x561792d29310 2024-09-19T05:37:07.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 -- 172.21.15.67:0/2064751702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 msgr2=0x561792d97c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 --2- 172.21.15.67:0/2064751702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d97c30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0ebd60 tx=0x7fc46c11d810 comp rx=0 tx=0).stop 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 -- 172.21.15.67:0/2064751702 shutdown_connections 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 --2- 172.21.15.67:0/2064751702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29c30 0x561792d98170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 --2- 172.21.15.67:0/2064751702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d97c30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 --2- 172.21.15.67:0/2064751702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792cdfb10 0x561792d976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 -- 172.21.15.67:0/2064751702 >> 172.21.15.67:0/2064751702 conn(0x561792ce5c70 msgr2=0x561792ce33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 -- 172.21.15.67:0/2064751702 shutdown_connections 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 -- 172.21.15.67:0/2064751702 wait complete. 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 -- start start 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 Processor -- start 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792cdfb10 0x561792d9ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d9bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.905+0000 7fc484a5a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29c30 0x561792d568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561792aecb20 con 0x561792d29310 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561792b28b40 con 0x561792cdfb10 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561792ae6970 con 0x561792d29c30 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 10 client.0 _ll_register_callbacks cb 0x7fc47000ab70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d9bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d9bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52572/0 (socket says 172.21.15.67:52572) 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47a7fc640 1 -- 172.21.15.67:0/1140834772 learned_addr learned my addr 172.21.15.67:0/1140834772 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47a7fc640 1 -- 172.21.15.67:0/1140834772 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29c30 msgr2=0x561792d568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29c30 0x561792d568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47a7fc640 1 -- 172.21.15.67:0/1140834772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792cdfb10 msgr2=0x561792d9ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47affd640 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792cdfb10 0x561792d9ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792cdfb10 0x561792d9ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47a7fc640 1 -- 172.21.15.67:0/1140834772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561792ac04e0 con 0x561792d29310 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47affd640 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792cdfb10 0x561792d9ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47a7fc640 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d9bf90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc46c01c790 tx=0x7fc470016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9153b3845711126a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc45a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc45a7fc640 1 -- 172.21.15.67:0/1140834772 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0bd040 con 0x561792d29310 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc45a7fc640 1 -- 172.21.15.67:0/1140834772 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fc46c0f60b0 con 0x561792d29310 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- 172.21.15.67:0/1140834772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc46c0a9040 con 0x561792d29310 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc45a7fc640 1 -- 172.21.15.67:0/1140834772 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc46c11d050 con 0x561792d29310 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 10 client.5916 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- 172.21.15.67:0/1140834772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x561792ac4690 con 0x561792d29310 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc45a7fc640 1 -- 172.21.15.67:0/1140834772 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc46c0a9040 con 0x561792d29310 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc45a7fc640 1 -- 172.21.15.67:0/1140834772 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fc46c103ce0 con 0x561792d29310 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 10 client.5916 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:07.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 10 client.5916 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 20 client.5916 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561792d56e20 0x561792d57200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 4 client.5916 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- 172.21.15.67:0/1140834772 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x561792b3a2b0 con 0x561792d56e20 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47affd640 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561792d56e20 0x561792d57200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc47affd640 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561792d56e20 0x561792d57200 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e24d7e6f123fb1f server_cookie=6266f1f99f964bcd in_seq=0 out_seq=0 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc45a7fc640 10 client.5916 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc45a7fc640 1 -- 172.21.15.67:0/1140834772 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561792b3a2b0 con 0x561792d56e20 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc45a7fc640 10 client.5916 handle_command_reply: tid=0 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 client.5916 shutdown 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- 172.21.15.67:0/1140834772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 msgr2=0x561792d9bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d9bf90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc46c01c790 tx=0x7fc470016000 comp rx=0 tx=0).stop 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- 172.21.15.67:0/1140834772 shutdown_connections 2024-09-19T05:37:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561792d29c30 0x561792d568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561792d29310 0x561792d9bf90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x561792d56e20 0x561792d57200 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 --2- 172.21.15.67:0/1140834772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561792cdfb10 0x561792d9ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- 172.21.15.67:0/1140834772 >> 172.21.15.67:0/1140834772 conn(0x561792ce5c70 msgr2=0x561792ce33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc45a7fc640 0 client.5916 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:07.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- 172.21.15.67:0/1140834772 shutdown_connections 2024-09-19T05:37:07.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 1 -- 172.21.15.67:0/1140834772 wait complete. 2024-09-19T05:37:07.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc484a5a000 20 client.5916 trim_cache size 0 max 16384 2024-09-19T05:37:07.919 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:07.919 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:37:07.920 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "e2d7cc2e-187b-4d8c-9fb8-20b9d9d306b5", 2024-09-19T05:37:07.920 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:37:07.920 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:07.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 -- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4680678f0 msgr2=0x7fc468069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4680678f0 0x7fc468069db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc470007bd0 tx=0x7fc47000a9e0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 -- 172.21.15.67:0/631652247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c15ebf0 msgr2=0x7fc47c0b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c15ebf0 0x7fc47c0b1600 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0986b0 tx=0x7fc464005840 comp rx=0 tx=0).stop 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 -- 172.21.15.67:0/631652247 shutdown_connections 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4680678f0 0x7fc468069db0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc47c1f7ea0 0x7fc47c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc47c15ebf0 0x7fc47c0b1600 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 --2- 172.21.15.67:0/631652247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc47c15bcb0 0x7fc47c161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 -- 172.21.15.67:0/631652247 >> 172.21.15.67:0/631652247 conn(0x7fc47c0d4490 msgr2=0x7fc47c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 -- 172.21.15.67:0/631652247 shutdown_connections 2024-09-19T05:37:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:07.909+0000 7fc48199e640 1 -- 172.21.15.67:0/631652247 wait complete. 2024-09-19T05:37:07.931 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'e2d7cc2e-187b-4d8c-9fb8-20b9d9d306b5', 'mode': 'asynchronous'}' 2024-09-19T05:37:07.931 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-19T05:37:07.931 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-19T05:37:08.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd8918f2640 1 Processor -- start 2024-09-19T05:37:08.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd8918f2640 1 -- start start 2024-09-19T05:37:08.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd8918f2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd88c0b6c70 0x7fd88c06d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd8918f2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd88c0cff60 0x7fd88c0d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd8918f2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88c0cf1a0 con 0x7fd88c15ea60 2024-09-19T05:37:08.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd8918f2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd88c0cf480 con 0x7fd88c0b6c70 2024-09-19T05:37:08.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd8918f2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd88c0cf760 con 0x7fd88c0cff60 2024-09-19T05:37:08.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd88a7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd88c0b6c70 0x7fd88c06d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd88b7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd88c0cff60 0x7fd88c0d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd88a7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd88c0b6c70 0x7fd88c06d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:45720/0 (socket says 172.21.15.67:45720) 2024-09-19T05:37:08.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd88a7fc640 1 -- 172.21.15.67:0/1474300578 learned_addr learned my addr 172.21.15.67:0/1474300578 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd88affd640 1 --1- 172.21.15.67:0/1474300578 >> v1:172.21.15.97:6789/0 conn(0x7fd88c15ea60 0x7fd88c0b6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:33358/0 (socket says 172.21.15.67:33358) 2024-09-19T05:37:08.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd88a7fc640 1 -- 172.21.15.67:0/1474300578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd88c0cff60 msgr2=0x7fd88c0d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/1474300578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd88c0cff60 0x7fd88c0d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd88a7fc640 1 -- 172.21.15.67:0/1474300578 >> v1:172.21.15.97:6789/0 conn(0x7fd88c15ea60 legacy=0x7fd88c0b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.049+0000 7fd88a7fc640 1 -- 172.21.15.67:0/1474300578 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88c0b3340 con 0x7fd88c0b6c70 2024-09-19T05:37:08.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/1474300578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd88c0b6c70 0x7fd88c06d640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009e50 tx=0x7fd87c01ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a1391e6cd8ea5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd889ffb640 1 -- 172.21.15.67:0/1474300578 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0a5810 con 0x7fd88c0b6c70 2024-09-19T05:37:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd889ffb640 1 -- 172.21.15.67:0/1474300578 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c0a59b0 con 0x7fd88c0b6c70 2024-09-19T05:37:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd889ffb640 1 -- 172.21.15.67:0/1474300578 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0a5d80 con 0x7fd88c0b6c70 2024-09-19T05:37:08.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd8918f2640 1 -- 172.21.15.67:0/1474300578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd88c0b6c70 msgr2=0x7fd88c06d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd8918f2640 1 --2- 172.21.15.67:0/1474300578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd88c0b6c70 0x7fd88c06d640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009e50 tx=0x7fd87c01ca30 comp rx=0 tx=0).stop 2024-09-19T05:37:08.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd8918f2640 1 -- 172.21.15.67:0/1474300578 shutdown_connections 2024-09-19T05:37:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd8918f2640 1 --2- 172.21.15.67:0/1474300578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd88c0cff60 0x7fd88c0d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd8918f2640 1 --2- 172.21.15.67:0/1474300578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd88c0b6c70 0x7fd88c06d640 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd8918f2640 1 -- 172.21.15.67:0/1474300578 >> 172.21.15.67:0/1474300578 conn(0x7fd88c0d1620 msgr2=0x7fd88c0d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd8918f2640 1 -- 172.21.15.67:0/1474300578 shutdown_connections 2024-09-19T05:37:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd8918f2640 1 -- 172.21.15.67:0/1474300578 wait complete. 2024-09-19T05:37:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd8918f2640 1 Processor -- start 2024-09-19T05:37:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.053+0000 7fd8918f2640 1 -- start start 2024-09-19T05:37:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd8918f2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd88c0b6c70 0x7fd88c15c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd8918f2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88c0cff60 0x7fd88c15a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd8918f2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd88c15ea60 0x7fd88c156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd8918f2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c16bca0 con 0x7fd88c0cff60 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd8918f2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c16bb20 con 0x7fd88c0b6c70 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd8918f2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd88c16be20 con 0x7fd88c15ea60 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88c0cff60 0x7fd88c15a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88c0cff60 0x7fd88c15a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52582/0 (socket says 172.21.15.67:52582) 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88a7fc640 1 -- 172.21.15.67:0/3738346132 learned_addr learned my addr 172.21.15.67:0/3738346132 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88b7fe640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd88c15ea60 0x7fd88c156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88affd640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd88c0b6c70 0x7fd88c15c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88a7fc640 1 -- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd88c15ea60 msgr2=0x7fd88c156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd88c15ea60 0x7fd88c156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88a7fc640 1 -- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd88c0b6c70 msgr2=0x7fd88c15c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd88c0b6c70 0x7fd88c15c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88a7fc640 1 -- 172.21.15.67:0/3738346132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88c15cd90 con 0x7fd88c0cff60 2024-09-19T05:37:08.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88c0cff60 0x7fd88c15a090 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0af040 tx=0x7fd87c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd883fff640 1 -- 172.21.15.67:0/3738346132 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0b8880 con 0x7fd88c0cff60 2024-09-19T05:37:08.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd883fff640 1 -- 172.21.15.67:0/3738346132 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c0be070 con 0x7fd88c0cff60 2024-09-19T05:37:08.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd883fff640 1 -- 172.21.15.67:0/3738346132 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0b8c80 con 0x7fd88c0cff60 2024-09-19T05:37:08.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd8918f2640 1 -- 172.21.15.67:0/3738346132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88c15d070 con 0x7fd88c0cff60 2024-09-19T05:37:08.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd8918f2640 1 -- 172.21.15.67:0/3738346132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd88c159890 con 0x7fd88c0cff60 2024-09-19T05:37:08.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.057+0000 7fd883fff640 1 -- 172.21.15.67:0/3738346132 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd87c0c3460 con 0x7fd88c0cff60 2024-09-19T05:37:08.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd883fff640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd86c0678c0 0x7fd86c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd883fff640 1 -- 172.21.15.67:0/3738346132 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd87c121330 con 0x7fd88c0cff60 2024-09-19T05:37:08.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd86c0678c0 0x7fd86c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd86c0678c0 0x7fd86c069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0b8380 tx=0x7fd874007cf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 Processor -- start 2024-09-19T05:37:08.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 -- start start 2024-09-19T05:37:08.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014450 0x565137014830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014d70 0x565136fc83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 0x565136fc8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x565136e18fd0 con 0x565137014450 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x565136dbe6b0 con 0x565136fc88e0 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x565136e14f90 con 0x565137014d70 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014450 0x565137014830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014450 0x565137014830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52592/0 (socket says 172.21.15.67:52592) 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 -- 172.21.15.67:0/836279732 learned_addr learned my addr 172.21.15.67:0/836279732 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/836279732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014d70 0x565136fc83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88b7fe640 1 --2- 172.21.15.67:0/836279732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 0x565136fc8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 -- 172.21.15.67:0/836279732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014d70 msgr2=0x565136fc83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 --2- 172.21.15.67:0/836279732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014d70 0x565136fc83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 -- 172.21.15.67:0/836279732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 msgr2=0x565136fc8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 --2- 172.21.15.67:0/836279732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 0x565136fc8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 -- 172.21.15.67:0/836279732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565136dbe900 con 0x565137014450 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88b7fe640 1 --2- 172.21.15.67:0/836279732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 0x565136fc8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd88affd640 1 --2- 172.21.15.67:0/836279732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014450 0x565137014830 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd8740076c0 tx=0x7fd874011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a86fad1dd5fac38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8817fa640 1 -- 172.21.15.67:0/836279732 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874001c10 con 0x565137014450 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8817fa640 1 -- 172.21.15.67:0/836279732 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd874005050 con 0x565137014450 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8817fa640 1 -- 172.21.15.67:0/836279732 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874005400 con 0x565137014450 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 -- 172.21.15.67:0/836279732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014450 msgr2=0x565137014830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 --2- 172.21.15.67:0/836279732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014450 0x565137014830 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd8740076c0 tx=0x7fd874011000 comp rx=0 tx=0).stop 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 -- 172.21.15.67:0/836279732 shutdown_connections 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 --2- 172.21.15.67:0/836279732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 0x565136fc8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 --2- 172.21.15.67:0/836279732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014d70 0x565136fc83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 --2- 172.21.15.67:0/836279732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014450 0x565137014830 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 -- 172.21.15.67:0/836279732 >> 172.21.15.67:0/836279732 conn(0x565136adbfc0 msgr2=0x565136ff7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 -- 172.21.15.67:0/836279732 shutdown_connections 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.061+0000 7fd8949ae000 1 -- 172.21.15.67:0/836279732 wait complete. 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 -- start start 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 Processor -- start 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565136fc88e0 0x565136ff58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 0x565136ff5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565136ff6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x565136e1d600 con 0x565137014d70 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x565136dd6aa0 con 0x565137014450 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x565136dafed0 con 0x565136fc88e0 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 10 client.0 _ll_register_callbacks cb 0x565136fb5e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565136ff6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565136ff6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52608/0 (socket says 172.21.15.67:52608) 2024-09-19T05:37:08.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88b7fe640 1 -- 172.21.15.67:0/1278730235 learned_addr learned my addr 172.21.15.67:0/1278730235 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 0x565136ff5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88affd640 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565136fc88e0 0x565136ff58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88b7fe640 1 -- 172.21.15.67:0/1278730235 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565136fc88e0 msgr2=0x565136ff58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88b7fe640 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565136fc88e0 0x565136ff58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88b7fe640 1 -- 172.21.15.67:0/1278730235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 msgr2=0x565136ff5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88b7fe640 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 0x565136ff5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88b7fe640 1 -- 172.21.15.67:0/1278730235 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565136db8a20 con 0x565137014d70 2024-09-19T05:37:08.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88b7fe640 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565136ff6370 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd884012580 tx=0x7fd884012a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abcec18476dda32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd86a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:08.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd86a7fc640 1 -- 172.21.15.67:0/1278730235 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884004440 con 0x565137014d70 2024-09-19T05:37:08.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd86a7fc640 1 -- 172.21.15.67:0/1278730235 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd884003620 con 0x565137014d70 2024-09-19T05:37:08.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 -- 172.21.15.67:0/1278730235 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd874005050 con 0x565137014d70 2024-09-19T05:37:08.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd86a7fc640 1 -- 172.21.15.67:0/1278730235 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd884025050 con 0x565137014d70 2024-09-19T05:37:08.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 10 client.5925 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:08.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 -- 172.21.15.67:0/1278730235 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x565136da04a0 con 0x565137014d70 2024-09-19T05:37:08.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd86a7fc640 1 -- 172.21.15.67:0/1278730235 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd874005050 con 0x565137014d70 2024-09-19T05:37:08.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd86a7fc640 1 -- 172.21.15.67:0/1278730235 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fd884028020 con 0x565137014d70 2024-09-19T05:37:08.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 10 client.5925 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:08.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 10 client.5925 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:08.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 20 client.5925 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:08.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5651370234e0 0x5651370258d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 4 client.5925 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:08.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 -- 172.21.15.67:0/1278730235 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565136db31d0 con 0x5651370234e0 2024-09-19T05:37:08.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88affd640 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5651370234e0 0x5651370258d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd86a7fc640 10 client.5925 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd88affd640 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5651370234e0 0x5651370258d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b56fd10caa6f2bd server_cookie=1956d827c3b74f35 in_seq=0 out_seq=0 2024-09-19T05:37:08.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd86a7fc640 1 -- 172.21.15.67:0/1278730235 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565136db31d0 con 0x5651370234e0 2024-09-19T05:37:08.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd86a7fc640 10 client.5925 handle_command_reply: tid=0 2024-09-19T05:37:08.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 client.5925 shutdown 2024-09-19T05:37:08.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 -- 172.21.15.67:0/1278730235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 msgr2=0x565136ff6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565136ff6370 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd884012580 tx=0x7fd884012a40 comp rx=0 tx=0).stop 2024-09-19T05:37:08.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 -- 172.21.15.67:0/1278730235 shutdown_connections 2024-09-19T05:37:08.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565136ff6370 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5651370234e0 0x5651370258d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 0x565136ff5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 --2- 172.21.15.67:0/1278730235 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565136fc88e0 0x565136ff58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd8949ae000 1 -- 172.21.15.67:0/1278730235 >> 172.21.15.67:0/1278730235 conn(0x565136adbfc0 msgr2=0x565136fc7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.065+0000 7fd86a7fc640 0 client.5925 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.069+0000 7fd8949ae000 1 -- 172.21.15.67:0/1278730235 shutdown_connections 2024-09-19T05:37:08.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.069+0000 7fd8949ae000 1 -- 172.21.15.67:0/1278730235 wait complete. 2024-09-19T05:37:08.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.069+0000 7fd8949ae000 20 client.5925 trim_cache size 0 max 16384 2024-09-19T05:37:08.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd8949ae000 1 Processor -- start 2024-09-19T05:37:08.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd8949ae000 1 -- start start 2024-09-19T05:37:08.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 0x5651370833d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014450 0x565137083910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565137083e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd8949ae000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c204350 con 0x565137014d70 2024-09-19T05:37:08.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd8949ae000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c203550 con 0x565136fc88e0 2024-09-19T05:37:08.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd8949ae000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd88c157910 con 0x565137014450 2024-09-19T05:37:08.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565137083e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565137083e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52616/0 (socket says 172.21.15.67:52616) 2024-09-19T05:37:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88b7fe640 1 -- 172.21.15.67:0/1420887579 learned_addr learned my addr 172.21.15.67:0/1420887579 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88affd640 1 --2- 172.21.15.67:0/1420887579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 0x5651370833d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88b7fe640 1 -- 172.21.15.67:0/1420887579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014450 msgr2=0x565137083910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88b7fe640 1 --2- 172.21.15.67:0/1420887579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014450 0x565137083910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88b7fe640 1 -- 172.21.15.67:0/1420887579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 msgr2=0x5651370833d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88b7fe640 1 --2- 172.21.15.67:0/1420887579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 0x5651370833d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88b7fe640 1 -- 172.21.15.67:0/1420887579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565136dbd590 con 0x565137014d70 2024-09-19T05:37:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88affd640 1 --2- 172.21.15.67:0/1420887579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 0x5651370833d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:08.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd88b7fe640 1 --2- 172.21.15.67:0/1420887579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565137083e50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd884008010 tx=0x7fd884017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359fec8dd647c55a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd880ff9640 1 -- 172.21.15.67:0/1420887579 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884003cc0 con 0x565137014d70 2024-09-19T05:37:08.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd880ff9640 1 -- 172.21.15.67:0/1420887579 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd884000e50 con 0x565137014d70 2024-09-19T05:37:08.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.085+0000 7fd880ff9640 1 -- 172.21.15.67:0/1420887579 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884003e60 con 0x565137014d70 2024-09-19T05:37:08.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- 172.21.15.67:0/1420887579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 msgr2=0x565137083e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 --2- 172.21.15.67:0/1420887579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565137083e50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd884008010 tx=0x7fd884017000 comp rx=0 tx=0).stop 2024-09-19T05:37:08.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- 172.21.15.67:0/1420887579 shutdown_connections 2024-09-19T05:37:08.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 --2- 172.21.15.67:0/1420887579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565137014d70 0x565137083e50 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 --2- 172.21.15.67:0/1420887579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014450 0x565137083910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 --2- 172.21.15.67:0/1420887579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565136fc88e0 0x5651370833d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- 172.21.15.67:0/1420887579 >> 172.21.15.67:0/1420887579 conn(0x565136adbfc0 msgr2=0x565136ff53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- 172.21.15.67:0/1420887579 shutdown_connections 2024-09-19T05:37:08.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- 172.21.15.67:0/1420887579 wait complete. 2024-09-19T05:37:08.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- start start 2024-09-19T05:37:08.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 Processor -- start 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565136fc88e0 0x565137027df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 0x565137087db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014d70 0x5651370882f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x565136e182e0 con 0x565136fc88e0 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c157f60 con 0x565137014450 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x565136e1d600 con 0x565137014d70 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 10 client.0 _ll_register_callbacks cb 0x7fd88c08cb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565136fc88e0 0x565137027df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565136fc88e0 0x565137027df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52622/0 (socket says 172.21.15.67:52622) 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88affd640 1 -- 172.21.15.67:0/3434118200 learned_addr learned my addr 172.21.15.67:0/3434118200 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 0x565137087db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88b7fe640 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014d70 0x5651370882f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88affd640 1 -- 172.21.15.67:0/3434118200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014d70 msgr2=0x5651370882f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88affd640 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014d70 0x5651370882f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88affd640 1 -- 172.21.15.67:0/3434118200 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 msgr2=0x565137087db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88affd640 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 0x565137087db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88affd640 1 -- 172.21.15.67:0/3434118200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565136e9d720 con 0x565136fc88e0 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 0x565137087db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88affd640 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565136fc88e0 0x565137027df0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd874000f70 tx=0x7fd874000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b09462def9d82f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd86a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd86a7fc640 1 -- 172.21.15.67:0/3434118200 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874005250 con 0x565136fc88e0 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd86a7fc640 1 -- 172.21.15.67:0/3434118200 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd8740053f0 con 0x565136fc88e0 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- 172.21.15.67:0/3434118200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd884000e50 con 0x565136fc88e0 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd86a7fc640 1 -- 172.21.15.67:0/3434118200 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd874035050 con 0x565136fc88e0 2024-09-19T05:37:08.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 10 client.5931 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- 172.21.15.67:0/3434118200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x565136db0e90 con 0x565136fc88e0 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd86a7fc640 1 -- 172.21.15.67:0/3434118200 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd884000e50 con 0x565136fc88e0 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd86a7fc640 1 -- 172.21.15.67:0/3434118200 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fd874038020 con 0x565136fc88e0 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 10 client.5931 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 10 client.5931 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 20 client.5931 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565137088830 0x565137084710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 4 client.5931 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd8949ae000 1 -- 172.21.15.67:0/3434118200 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x565136e26700 con 0x565137088830 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.089+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565137088830 0x565137084710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd88a7fc640 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565137088830 0x565137084710 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=472ad1b37bb0c7fc server_cookie=1bf16ed29f80604f in_seq=0 out_seq=0 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd86a7fc640 10 client.5931 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd86a7fc640 1 -- 172.21.15.67:0/3434118200 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x565136e26700 con 0x565137088830 2024-09-19T05:37:08.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd86a7fc640 10 client.5931 handle_command_reply: tid=0 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 client.5931 shutdown 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 -- 172.21.15.67:0/3434118200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565136fc88e0 msgr2=0x565137027df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565136fc88e0 0x565137027df0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd874000f70 tx=0x7fd874000bd0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 -- 172.21.15.67:0/3434118200 shutdown_connections 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565137014d70 0x5651370882f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x565137088830 0x565137084710 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565137014450 0x565137087db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 --2- 172.21.15.67:0/3434118200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565136fc88e0 0x565137027df0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd86a7fc640 0 client.5931 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 -- 172.21.15.67:0/3434118200 >> 172.21.15.67:0/3434118200 conn(0x565136adbfc0 msgr2=0x565136ff5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 -- 172.21.15.67:0/3434118200 shutdown_connections 2024-09-19T05:37:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 1 -- 172.21.15.67:0/3434118200 wait complete. 2024-09-19T05:37:08.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8949ae000 20 client.5931 trim_cache size 0 max 16384 2024-09-19T05:37:08.104 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:08.104 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:37:08.104 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "f90df012-6ae8-4ad4-8c00-1da258f82d0f", 2024-09-19T05:37:08.104 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:37:08.104 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:08.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 -- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd86c0678c0 msgr2=0x7fd86c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd86c0678c0 0x7fd86c069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0b8380 tx=0x7fd874007cf0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 -- 172.21.15.67:0/3738346132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88c0cff60 msgr2=0x7fd88c15a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88c0cff60 0x7fd88c15a090 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0af040 tx=0x7fd87c0197d0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 -- 172.21.15.67:0/3738346132 shutdown_connections 2024-09-19T05:37:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd86c0678c0 0x7fd86c069d80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd88c15ea60 0x7fd88c156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88c0cff60 0x7fd88c15a090 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 --2- 172.21.15.67:0/3738346132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd88c0b6c70 0x7fd88c15c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 -- 172.21.15.67:0/3738346132 >> 172.21.15.67:0/3738346132 conn(0x7fd88c0d1620 msgr2=0x7fd88c15aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 -- 172.21.15.67:0/3738346132 shutdown_connections 2024-09-19T05:37:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.093+0000 7fd8918f2640 1 -- 172.21.15.67:0/3738346132 wait complete. 2024-09-19T05:37:08.113 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': 'f90df012-6ae8-4ad4-8c00-1da258f82d0f', 'mode': 'asynchronous'}' 2024-09-19T05:37:08.114 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-19T05:37:08.114 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-19T05:37:08.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.229+0000 7f16502bc640 1 Processor -- start 2024-09-19T05:37:08.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.229+0000 7f16502bc640 1 -- start start 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.229+0000 7f16502bc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f16480b7300 0x7f16480d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.229+0000 7f16502bc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f16480d3300 0x7f16480cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.229+0000 7f16502bc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16480d2aa0 con 0x7f16480d4220 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.229+0000 7f16502bc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f16480cf080 con 0x7f16480d3300 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.229+0000 7f16502bc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f16480cf620 con 0x7f16480b7300 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164e859640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f16480d3300 0x7f16480cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164e859640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f16480d3300 0x7f16480cfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52638/0 (socket says 172.21.15.67:52638) 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164e859640 1 -- 172.21.15.67:0/2448006603 learned_addr learned my addr 172.21.15.67:0/2448006603 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164d857640 1 --2- 172.21.15.67:0/2448006603 >> v2:172.21.15.97:3300/0 conn(0x7f16480b7300 0x7f16480d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164e859640 1 -- 172.21.15.67:0/2448006603 >> v2:172.21.15.97:3300/0 conn(0x7f16480b7300 msgr2=0x7f16480d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164e859640 1 --2- 172.21.15.67:0/2448006603 >> v2:172.21.15.97:3300/0 conn(0x7f16480b7300 0x7f16480d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164e859640 1 -- 172.21.15.67:0/2448006603 >> v1:172.21.15.97:6789/0 conn(0x7f16480d4220 legacy=0x7f16480d4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164e859640 1 -- 172.21.15.67:0/2448006603 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16480d24e0 con 0x7f16480d3300 2024-09-19T05:37:08.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164e859640 1 --2- 172.21.15.67:0/2448006603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480d3300 0x7f16480cfab0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f16480cb530 tx=0x7f164001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3d0c7ca70b5ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164d056640 1 -- 172.21.15.67:0/2448006603 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16400a56c0 con 0x7f16480d3300 2024-09-19T05:37:08.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164d056640 1 -- 172.21.15.67:0/2448006603 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16400a5860 con 0x7f16480d3300 2024-09-19T05:37:08.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f164d056640 1 -- 172.21.15.67:0/2448006603 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16400a5c30 con 0x7f16480d3300 2024-09-19T05:37:08.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f16502bc640 1 -- 172.21.15.67:0/2448006603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480d3300 msgr2=0x7f16480cfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f16502bc640 1 --2- 172.21.15.67:0/2448006603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480d3300 0x7f16480cfab0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f16480cb530 tx=0x7f164001c8f0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f16502bc640 1 -- 172.21.15.67:0/2448006603 shutdown_connections 2024-09-19T05:37:08.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f16502bc640 1 --2- 172.21.15.67:0/2448006603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480d3300 0x7f16480cfab0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f16502bc640 1 --2- 172.21.15.67:0/2448006603 >> v2:172.21.15.97:3300/0 conn(0x7f16480b7300 0x7f16480d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f16502bc640 1 -- 172.21.15.67:0/2448006603 >> 172.21.15.67:0/2448006603 conn(0x7f164809d7f0 msgr2=0x7f164808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f16502bc640 1 -- 172.21.15.67:0/2448006603 shutdown_connections 2024-09-19T05:37:08.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.233+0000 7f16502bc640 1 -- 172.21.15.67:0/2448006603 wait complete. 2024-09-19T05:37:08.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f16502bc640 1 Processor -- start 2024-09-19T05:37:08.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f16502bc640 1 -- start start 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f16502bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480b7300 0x7f164815eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f16502bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480d3300 0x7f1648152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f16502bc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480d4220 0x7f16480c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f16502bc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f16480b5af0 con 0x7f16480b7300 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f16502bc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f164815e9c0 con 0x7f16480d4220 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f16502bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f16480b5c70 con 0x7f16480d3300 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164e058640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480b7300 0x7f164815eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164e058640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480b7300 0x7f164815eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52640/0 (socket says 172.21.15.67:52640) 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164e058640 1 -- 172.21.15.67:0/3187237575 learned_addr learned my addr 172.21.15.67:0/3187237575 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164e859640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480d4220 0x7f16480c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164d857640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480d3300 0x7f1648152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164e058640 1 -- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480d3300 msgr2=0x7f1648152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164e058640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480d3300 0x7f1648152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164e058640 1 -- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480d4220 msgr2=0x7f16480c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164e058640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480d4220 0x7f16480c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164e058640 1 -- 172.21.15.67:0/3187237575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1648156cb0 con 0x7f16480b7300 2024-09-19T05:37:08.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f164e058640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480b7300 0x7f164815eb40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f164400c450 tx=0x7f164400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f163effd640 1 -- 172.21.15.67:0/3187237575 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644012830 con 0x7f16480b7300 2024-09-19T05:37:08.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f163effd640 1 -- 172.21.15.67:0/3187237575 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1644017070 con 0x7f16480b7300 2024-09-19T05:37:08.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f16502bc640 1 -- 172.21.15.67:0/3187237575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1648156f90 con 0x7f16480b7300 2024-09-19T05:37:08.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f163effd640 1 -- 172.21.15.67:0/3187237575 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644012c30 con 0x7f16480b7300 2024-09-19T05:37:08.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.237+0000 7f16502bc640 1 -- 172.21.15.67:0/3187237575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1648157550 con 0x7f16480b7300 2024-09-19T05:37:08.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f163effd640 1 -- 172.21.15.67:0/3187237575 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f164401c460 con 0x7f16480b7300 2024-09-19T05:37:08.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f163effd640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f162c0678c0 0x7f162c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f163effd640 1 -- 172.21.15.67:0/3187237575 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1644085d20 con 0x7f16480b7300 2024-09-19T05:37:08.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f162c0678c0 0x7f162c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f1653378000 1 Processor -- start 2024-09-19T05:37:08.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f1653378000 1 -- start start 2024-09-19T05:37:08.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f162c0678c0 0x7f162c069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f16480ca550 tx=0x7f1638008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f1653378000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f65d50 0x559ef5f66130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f1653378000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f66670 0x559ef5f1bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f1653378000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5f1c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f1653378000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559ef5e03540 con 0x559ef5f66670 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f1653378000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559ef5d69d70 con 0x559ef5f1c500 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f1653378000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559ef5d24b20 con 0x559ef5f65d50 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f66670 0x559ef5f1bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f66670 0x559ef5f1bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52650/0 (socket says 172.21.15.67:52650) 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 -- 172.21.15.67:0/957557051 learned_addr learned my addr 172.21.15.67:0/957557051 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164e058640 1 --2- 172.21.15.67:0/957557051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f65d50 0x559ef5f66130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164e859640 1 --2- 172.21.15.67:0/957557051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5f1c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 -- 172.21.15.67:0/957557051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f65d50 msgr2=0x559ef5f66130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 --2- 172.21.15.67:0/957557051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f65d50 0x559ef5f66130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 -- 172.21.15.67:0/957557051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 msgr2=0x559ef5f1c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 --2- 172.21.15.67:0/957557051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5f1c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 -- 172.21.15.67:0/957557051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef5db03b0 con 0x559ef5f66670 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f164d857640 1 --2- 172.21.15.67:0/957557051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f66670 0x559ef5f1bfc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f16380157a0 tx=0x7f1638011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a2b871536e27af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.241+0000 7f162bfff640 1 -- 172.21.15.67:0/957557051 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638025070 con 0x559ef5f66670 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f162bfff640 1 -- 172.21.15.67:0/957557051 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163800e660 con 0x559ef5f66670 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f162bfff640 1 -- 172.21.15.67:0/957557051 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163800f040 con 0x559ef5f66670 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- 172.21.15.67:0/957557051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f66670 msgr2=0x559ef5f1bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 --2- 172.21.15.67:0/957557051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f66670 0x559ef5f1bfc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f16380157a0 tx=0x7f1638011000 comp rx=0 tx=0).stop 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- 172.21.15.67:0/957557051 shutdown_connections 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 --2- 172.21.15.67:0/957557051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5f1c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 --2- 172.21.15.67:0/957557051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f66670 0x559ef5f1bfc0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 --2- 172.21.15.67:0/957557051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f65d50 0x559ef5f66130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- 172.21.15.67:0/957557051 >> 172.21.15.67:0/957557051 conn(0x559ef5f184b0 msgr2=0x559ef5f1a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- 172.21.15.67:0/957557051 shutdown_connections 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- 172.21.15.67:0/957557051 wait complete. 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- start start 2024-09-19T05:37:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 Processor -- start 2024-09-19T05:37:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5f26b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5f27040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 0x559ef5f27580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559ef5d111d0 con 0x559ef5f65d50 2024-09-19T05:37:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559ef5d23680 con 0x559ef5f1c500 2024-09-19T05:37:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559ef5d0fd60 con 0x559ef5f66670 2024-09-19T05:37:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 10 client.0 _ll_register_callbacks cb 0x559ef5dcbf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164d857640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5f27040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164d857640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5f27040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52666/0 (socket says 172.21.15.67:52666) 2024-09-19T05:37:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164d857640 1 -- 172.21.15.67:0/468391267 learned_addr learned my addr 172.21.15.67:0/468391267 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164e859640 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 0x559ef5f27580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164d857640 1 -- 172.21.15.67:0/468391267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 msgr2=0x559ef5f27580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164e058640 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5f26b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164d857640 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 0x559ef5f27580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164d857640 1 -- 172.21.15.67:0/468391267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 msgr2=0x559ef5f26b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164d857640 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5f26b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164d857640 1 -- 172.21.15.67:0/468391267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef5d3cb90 con 0x559ef5f65d50 2024-09-19T05:37:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164e859640 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 0x559ef5f27580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164d857640 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5f27040 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1638023040 tx=0x7f1638015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a238a8cfe655d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f16297fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f16297fa640 1 -- 172.21.15.67:0/468391267 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638025040 con 0x559ef5f65d50 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f16297fa640 1 -- 172.21.15.67:0/468391267 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f163802b620 con 0x559ef5f65d50 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- 172.21.15.67:0/468391267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f163800e660 con 0x559ef5f65d50 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f16297fa640 1 -- 172.21.15.67:0/468391267 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1638038050 con 0x559ef5f65d50 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 10 client.5943 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- 172.21.15.67:0/468391267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x559ef5d238a0 con 0x559ef5f65d50 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f16297fa640 1 -- 172.21.15.67:0/468391267 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163800e660 con 0x559ef5f65d50 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f16297fa640 1 -- 172.21.15.67:0/468391267 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f163803b020 con 0x559ef5f65d50 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 10 client.5943 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 10 client.5943 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 20 client.5943 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:08.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x559ef5f27f90 0x559ef5f77000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 4 client.5943 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f1653378000 1 -- 172.21.15.67:0/468391267 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ef5d03e40 con 0x559ef5f27f90 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.245+0000 7f164e058640 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x559ef5f27f90 0x559ef5f77000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f164e058640 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x559ef5f27f90 0x559ef5f77000 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d58d0eaee9504af server_cookie=846ab74a62a62cc2 in_seq=0 out_seq=0 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f16297fa640 10 client.5943 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f16297fa640 1 -- 172.21.15.67:0/468391267 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ef5d03e40 con 0x559ef5f27f90 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f16297fa640 10 client.5943 handle_command_reply: tid=0 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 client.5943 shutdown 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 -- 172.21.15.67:0/468391267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 msgr2=0x559ef5f27040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5f27040 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1638023040 tx=0x7f1638015000 comp rx=0 tx=0).stop 2024-09-19T05:37:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 -- 172.21.15.67:0/468391267 shutdown_connections 2024-09-19T05:37:08.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 0x559ef5f27580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5f27040 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x559ef5f27f90 0x559ef5f77000 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 --2- 172.21.15.67:0/468391267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5f26b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f16297fa640 0 client.5943 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 -- 172.21.15.67:0/468391267 >> 172.21.15.67:0/468391267 conn(0x559ef5f184b0 msgr2=0x559ef5f1b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 -- 172.21.15.67:0/468391267 shutdown_connections 2024-09-19T05:37:08.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 1 -- 172.21.15.67:0/468391267 wait complete. 2024-09-19T05:37:08.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.249+0000 7f1653378000 20 client.5943 trim_cache size 0 max 16384 2024-09-19T05:37:08.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.265+0000 7f1653378000 1 Processor -- start 2024-09-19T05:37:08.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.265+0000 7f1653378000 1 -- start start 2024-09-19T05:37:08.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f1c500 0x559ef5fd46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f66670 0x559ef5fd5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1648203730 con 0x559ef5f65d50 2024-09-19T05:37:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1648158910 con 0x559ef5f66670 2024-09-19T05:37:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f164806d900 con 0x559ef5f1c500 2024-09-19T05:37:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52682/0 (socket says 172.21.15.67:52682) 2024-09-19T05:37:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 -- 172.21.15.67:0/1939642215 learned_addr learned my addr 172.21.15.67:0/1939642215 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 -- 172.21.15.67:0/1939642215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f1c500 msgr2=0x559ef5fd46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164e058640 1 --2- 172.21.15.67:0/1939642215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f1c500 0x559ef5fd46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 --2- 172.21.15.67:0/1939642215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f1c500 0x559ef5fd46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164e859640 1 --2- 172.21.15.67:0/1939642215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f66670 0x559ef5fd5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 -- 172.21.15.67:0/1939642215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f66670 msgr2=0x559ef5fd5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 --2- 172.21.15.67:0/1939642215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f66670 0x559ef5fd5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 -- 172.21.15.67:0/1939642215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef5d09820 con 0x559ef5f65d50 2024-09-19T05:37:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 --2- 172.21.15.67:0/1939642215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd4c20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f16380094a0 tx=0x7f163801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ec21026927239f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f162b7fe640 1 -- 172.21.15.67:0/1939642215 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638025040 con 0x559ef5f65d50 2024-09-19T05:37:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f162b7fe640 1 -- 172.21.15.67:0/1939642215 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1638030070 con 0x559ef5f65d50 2024-09-19T05:37:08.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f162b7fe640 1 -- 172.21.15.67:0/1939642215 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163800fe30 con 0x559ef5f65d50 2024-09-19T05:37:08.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- 172.21.15.67:0/1939642215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 msgr2=0x559ef5fd4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 --2- 172.21.15.67:0/1939642215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd4c20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f16380094a0 tx=0x7f163801e000 comp rx=0 tx=0).stop 2024-09-19T05:37:08.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- 172.21.15.67:0/1939642215 shutdown_connections 2024-09-19T05:37:08.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 --2- 172.21.15.67:0/1939642215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f66670 0x559ef5fd5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 --2- 172.21.15.67:0/1939642215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd4c20 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 --2- 172.21.15.67:0/1939642215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f1c500 0x559ef5fd46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- 172.21.15.67:0/1939642215 >> 172.21.15.67:0/1939642215 conn(0x559ef5f184b0 msgr2=0x559ef5f20780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- 172.21.15.67:0/1939642215 shutdown_connections 2024-09-19T05:37:08.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- 172.21.15.67:0/1939642215 wait complete. 2024-09-19T05:37:08.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- start start 2024-09-19T05:37:08.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 Processor -- start 2024-09-19T05:37:08.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5fd8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 0x559ef5fd8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559ef5d6e3a0 con 0x559ef5f65d50 2024-09-19T05:37:08.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559ef5d69080 con 0x559ef5f1c500 2024-09-19T05:37:08.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559ef5d20f10 con 0x559ef5f66670 2024-09-19T05:37:08.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f1653378000 10 client.0 _ll_register_callbacks cb 0x7f1638023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:08.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52696/0 (socket says 172.21.15.67:52696) 2024-09-19T05:37:08.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 -- 172.21.15.67:0/2785183793 learned_addr learned my addr 172.21.15.67:0/2785183793 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164e058640 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5fd8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164e859640 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 0x559ef5fd8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 -- 172.21.15.67:0/2785183793 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 msgr2=0x559ef5fd8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 0x559ef5fd8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 -- 172.21.15.67:0/2785183793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 msgr2=0x559ef5fd8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5fd8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.269+0000 7f164d857640 1 -- 172.21.15.67:0/2785183793 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef5dec530 con 0x559ef5f65d50 2024-09-19T05:37:08.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f164d857640 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd88b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1638008010 tx=0x7f1638004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f98d49e3701cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16297fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16297fa640 1 -- 172.21.15.67:0/2785183793 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638025040 con 0x559ef5f65d50 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16297fa640 1 -- 172.21.15.67:0/2785183793 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f163800f480 con 0x559ef5f65d50 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 -- 172.21.15.67:0/2785183793 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1638030070 con 0x559ef5f65d50 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16297fa640 1 -- 172.21.15.67:0/2785183793 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f163800fe30 con 0x559ef5f65d50 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 10 client.5949 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 -- 172.21.15.67:0/2785183793 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x559ef5d01420 con 0x559ef5f65d50 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16297fa640 1 -- 172.21.15.67:0/2785183793 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1638030070 con 0x559ef5f65d50 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16297fa640 1 -- 172.21.15.67:0/2785183793 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f163803b040 con 0x559ef5f65d50 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 10 client.5949 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 10 client.5949 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 20 client.5949 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:08.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x559ef5f797f0 0x559ef5f79bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 4 client.5949 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 -- 172.21.15.67:0/2785183793 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x559ef5d774a0 con 0x559ef5f797f0 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f164e058640 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x559ef5f797f0 0x559ef5f79bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16297fa640 10 client.5949 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f164e058640 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x559ef5f797f0 0x559ef5f79bd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2c8ae785f6f7b8 server_cookie=b99b1be88620d648 in_seq=0 out_seq=0 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16297fa640 1 -- 172.21.15.67:0/2785183793 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559ef5d774a0 con 0x559ef5f797f0 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16297fa640 10 client.5949 handle_command_reply: tid=0 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 client.5949 shutdown 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 -- 172.21.15.67:0/2785183793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 msgr2=0x559ef5fd88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd88b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1638008010 tx=0x7f1638004740 comp rx=0 tx=0).stop 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 -- 172.21.15.67:0/2785183793 shutdown_connections 2024-09-19T05:37:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ef5f66670 0x559ef5fd8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559ef5f65d50 0x559ef5fd88b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x559ef5f797f0 0x559ef5f79bd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 --2- 172.21.15.67:0/2785183793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ef5f1c500 0x559ef5fd8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16297fa640 0 client.5949 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 -- 172.21.15.67:0/2785183793 >> 172.21.15.67:0/2785183793 conn(0x559ef5f184b0 msgr2=0x559ef5f20fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 -- 172.21.15.67:0/2785183793 shutdown_connections 2024-09-19T05:37:08.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 1 -- 172.21.15.67:0/2785183793 wait complete. 2024-09-19T05:37:08.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f1653378000 20 client.5949 trim_cache size 0 max 16384 2024-09-19T05:37:08.288 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:08.289 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:37:08.289 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "ae527f3a-fb23-4d9c-bb5a-69154b0cc5c1", 2024-09-19T05:37:08.289 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:37:08.289 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 -- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f162c0678c0 msgr2=0x7f162c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f162c0678c0 0x7f162c069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f16480ca550 tx=0x7f1638008040 comp rx=0 tx=0).stop 2024-09-19T05:37:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 -- 172.21.15.67:0/3187237575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480b7300 msgr2=0x7f164815eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480b7300 0x7f164815eb40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f164400c450 tx=0x7f164400c910 comp rx=0 tx=0).stop 2024-09-19T05:37:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 -- 172.21.15.67:0/3187237575 shutdown_connections 2024-09-19T05:37:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16480d4220 0x7f16480c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f162c0678c0 0x7f162c069d80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16480d3300 0x7f1648152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 --2- 172.21.15.67:0/3187237575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16480b7300 0x7f164815eb40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 -- 172.21.15.67:0/3187237575 >> 172.21.15.67:0/3187237575 conn(0x7f164809d7f0 msgr2=0x7f16480cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 -- 172.21.15.67:0/3187237575 shutdown_connections 2024-09-19T05:37:08.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.273+0000 7f16502bc640 1 -- 172.21.15.67:0/3187237575 wait complete. 2024-09-19T05:37:08.295 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'ae527f3a-fb23-4d9c-bb5a-69154b0cc5c1', 'mode': 'asynchronous'}' 2024-09-19T05:37:08.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:08.295 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-09-19T05:37:08.302 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-09-19T05:37:08.302 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-09-19T05:37:08.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.457+0000 7f6527d4a640 1 Processor -- start 2024-09-19T05:37:08.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.457+0000 7f6527d4a640 1 -- start start 2024-09-19T05:37:08.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6527d4a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f652006ffd0 0x7f65200aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6527d4a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65200b3150 0x7f65200af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6527d4a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65200ad840 con 0x7f6520159c60 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6527d4a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f65200af710 con 0x7f652006ffd0 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6527d4a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f652015d460 con 0x7f65200b3150 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6525ae6640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6520159c60 0x7f65200ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58580/0 (socket says 172.21.15.67:58580) 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6525ae6640 1 -- 172.21.15.67:0/1781153713 learned_addr learned my addr 172.21.15.67:0/1781153713 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65252e5640 1 --2- 172.21.15.67:0/1781153713 >> v2:172.21.15.97:3300/0 conn(0x7f652006ffd0 0x7f65200aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65262e7640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65200b3150 0x7f65200af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262631701 0 0) 0x7f65200ad840 con 0x7f6520159c60 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f650c003530 con 0x7f6520159c60 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4176649584 0 0) 0x7f650c003530 con 0x7f6520159c60 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65200b3150 msgr2=0x7f65200af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65200b3150 0x7f65200af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 >> v2:172.21.15.97:3300/0 conn(0x7f652006ffd0 msgr2=0x7f65200aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 --2- 172.21.15.67:0/1781153713 >> v2:172.21.15.97:3300/0 conn(0x7f652006ffd0 0x7f65200aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652015a040 con 0x7f6520159c60 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6514001680 con 0x7f6520159c60 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 >> v1:172.21.15.67:6789/0 conn(0x7f6520159c60 legacy=0x7f65200ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65200b3150 0x7f650c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f650c003f40 0x7f650c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f650c004d50 0x7f650c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f652015d460 con 0x7f650c003f40 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f650c00b9d0 con 0x7f650c004d50 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f650c00bb50 con 0x7f65200b3150 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65252e5640 1 --2- 172.21.15.67:0/1781153713 >> v2:172.21.15.97:3300/0 conn(0x7f652006ffd0 0x7f65200aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65252e5640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f650c003f40 0x7f650c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65262e7640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f650c004d50 0x7f650c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f6525ae6640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65200b3150 0x7f650c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65252e5640 1 -- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65200b3150 msgr2=0x7f650c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65252e5640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65200b3150 0x7f650c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65252e5640 1 -- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f650c004d50 msgr2=0x7f650c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65252e5640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f650c004d50 0x7f650c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65252e5640 1 -- 172.21.15.67:0/1781153713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c003530 con 0x7f650c003f40 2024-09-19T05:37:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.461+0000 7f65262e7640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f650c004d50 0x7f650c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:08.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65252e5640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f650c003f40 0x7f650c004810 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f651c00e350 tx=0x7f651c01ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac8d6c6e3f94b05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c009dc0 con 0x7f650c003f40 2024-09-19T05:37:08.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c0a5d60 con 0x7f650c003f40 2024-09-19T05:37:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6524ae4640 1 -- 172.21.15.67:0/1781153713 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c003ba0 con 0x7f650c003f40 2024-09-19T05:37:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 -- 172.21.15.67:0/1781153713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f650c003f40 msgr2=0x7f650c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 --2- 172.21.15.67:0/1781153713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f650c003f40 0x7f650c004810 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f651c00e350 tx=0x7f651c01ce00 comp rx=0 tx=0).stop 2024-09-19T05:37:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65262e7640 1 -- 172.21.15.67:0/1781153713 reap_dead start 2024-09-19T05:37:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 -- 172.21.15.67:0/1781153713 shutdown_connections 2024-09-19T05:37:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 -- 172.21.15.67:0/1781153713 >> 172.21.15.67:0/1781153713 conn(0x7f65200b1e50 msgr2=0x7f65200b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 -- 172.21.15.67:0/1781153713 shutdown_connections 2024-09-19T05:37:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 -- 172.21.15.67:0/1781153713 wait complete. 2024-09-19T05:37:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 Processor -- start 2024-09-19T05:37:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 -- start start 2024-09-19T05:37:08.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f650c003f40 0x7f652014a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652014ad80 0x7f65201f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200b1210 0x7f65200b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f652015ce10 con 0x7f652014ad80 2024-09-19T05:37:08.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f652015cb30 con 0x7f65200b1210 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6527d4a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f652015d0f0 con 0x7f650c003f40 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65252e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652014ad80 0x7f65201f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65252e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652014ad80 0x7f65201f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52712/0 (socket says 172.21.15.67:52712) 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65252e5640 1 -- 172.21.15.67:0/1983048203 learned_addr learned my addr 172.21.15.67:0/1983048203 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65262e7640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200b1210 0x7f65200b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f6525ae6640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f650c003f40 0x7f652014a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65252e5640 1 -- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f650c003f40 msgr2=0x7f652014a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65252e5640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f650c003f40 0x7f652014a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65252e5640 1 -- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200b1210 msgr2=0x7f65200b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65252e5640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200b1210 0x7f65200b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65252e5640 1 -- 172.21.15.67:0/1983048203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652014ab90 con 0x7f652014ad80 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.465+0000 7f65252e5640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652014ad80 0x7f65201f6390 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f651c01cc30 tx=0x7f651c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f65127fc640 1 -- 172.21.15.67:0/1983048203 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c0bc030 con 0x7f652014ad80 2024-09-19T05:37:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f65127fc640 1 -- 172.21.15.67:0/1983048203 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c0a5b60 con 0x7f652014ad80 2024-09-19T05:37:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f6527d4a640 1 -- 172.21.15.67:0/1983048203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65201f68d0 con 0x7f652014ad80 2024-09-19T05:37:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f65127fc640 1 -- 172.21.15.67:0/1983048203 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c0b8670 con 0x7f652014ad80 2024-09-19T05:37:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f6527d4a640 1 -- 172.21.15.67:0/1983048203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652014de50 con 0x7f652014ad80 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f65127fc640 1 -- 172.21.15.67:0/1983048203 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f651c0bf070 con 0x7f652014ad80 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f65127fc640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65040678f0 0x7f6504069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f65127fc640 1 -- 172.21.15.67:0/1983048203 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f651c1213c0 con 0x7f652014ad80 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f6525ae6640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65040678f0 0x7f6504069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f652ae06000 1 Processor -- start 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f652ae06000 1 -- start start 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f6525ae6640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65040678f0 0x7f6504069db0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6514000c10 tx=0x7f6514009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f652ae06000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9742d40 0x557ea9743120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f652ae06000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9743660 0x557ea96f9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f652ae06000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea96fa400 0x557ea96fa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.469+0000 7f652ae06000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557ea95e1a20 con 0x557ea9743660 2024-09-19T05:37:08.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557ea9546ba0 con 0x557ea96fa400 2024-09-19T05:37:08.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557ea94ecbb0 con 0x557ea9742d40 2024-09-19T05:37:08.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65252e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9743660 0x557ea96f9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65252e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9743660 0x557ea96f9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52716/0 (socket says 172.21.15.67:52716) 2024-09-19T05:37:08.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65252e5640 1 -- 172.21.15.67:0/639250948 learned_addr learned my addr 172.21.15.67:0/639250948 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65262e7640 1 --2- 172.21.15.67:0/639250948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea96fa400 0x557ea96fa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 --2- 172.21.15.67:0/639250948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9742d40 0x557ea9743120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65252e5640 1 -- 172.21.15.67:0/639250948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9742d40 msgr2=0x557ea9743120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65252e5640 1 --2- 172.21.15.67:0/639250948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9742d40 0x557ea9743120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65252e5640 1 -- 172.21.15.67:0/639250948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea96fa400 msgr2=0x557ea96fa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65252e5640 1 --2- 172.21.15.67:0/639250948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea96fa400 0x557ea96fa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65252e5640 1 -- 172.21.15.67:0/639250948 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ea958dee0 con 0x557ea9743660 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 --2- 172.21.15.67:0/639250948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9742d40 0x557ea9743120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65252e5640 1 --2- 172.21.15.67:0/639250948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9743660 0x557ea96f9ec0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f651c0f12a0 tx=0x7f651c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7615579b8e01a6d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65037fe640 1 -- 172.21.15.67:0/639250948 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c0f15a0 con 0x557ea9743660 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65037fe640 1 -- 172.21.15.67:0/639250948 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c0f5950 con 0x557ea9743660 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65037fe640 1 -- 172.21.15.67:0/639250948 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c0fa180 con 0x557ea9743660 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- 172.21.15.67:0/639250948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9743660 msgr2=0x557ea96f9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 --2- 172.21.15.67:0/639250948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9743660 0x557ea96f9ec0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f651c0f12a0 tx=0x7f651c00b040 comp rx=0 tx=0).stop 2024-09-19T05:37:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- 172.21.15.67:0/639250948 shutdown_connections 2024-09-19T05:37:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 --2- 172.21.15.67:0/639250948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea96fa400 0x557ea96fa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 --2- 172.21.15.67:0/639250948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9743660 0x557ea96f9ec0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 --2- 172.21.15.67:0/639250948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9742d40 0x557ea9743120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- 172.21.15.67:0/639250948 >> 172.21.15.67:0/639250948 conn(0x557ea96f63b0 msgr2=0x557ea96f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- 172.21.15.67:0/639250948 shutdown_connections 2024-09-19T05:37:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- 172.21.15.67:0/639250948 wait complete. 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- start start 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 Processor -- start 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9704540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9742d40 0x557ea9704a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea9743660 0x557ea9704fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557ea94e0d20 con 0x557ea96fa400 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557ea9542b60 con 0x557ea9743660 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557ea954b1d0 con 0x557ea9742d40 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 10 client.0 _ll_register_callbacks cb 0x557ea95aa120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9704540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9704540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52726/0 (socket says 172.21.15.67:52726) 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 -- 172.21.15.67:0/3755935639 learned_addr learned my addr 172.21.15.67:0/3755935639 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f65262e7640 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea9743660 0x557ea9704fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 -- 172.21.15.67:0/3755935639 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9742d40 msgr2=0x557ea9704a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9742d40 0x557ea9704a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 -- 172.21.15.67:0/3755935639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea9743660 msgr2=0x557ea9704fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea9743660 0x557ea9704fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 -- 172.21.15.67:0/3755935639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ea9521e20 con 0x557ea96fa400 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6525ae6640 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9704540 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6514013ed0 tx=0x7f652015d3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea09084345da6e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6500ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6500ff9640 1 -- 172.21.15.67:0/3755935639 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514010040 con 0x557ea96fa400 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f6500ff9640 1 -- 172.21.15.67:0/3755935639 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f651401da80 con 0x557ea96fa400 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.473+0000 7f652ae06000 1 -- 172.21.15.67:0/3755935639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f651c0f5950 con 0x557ea96fa400 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f6500ff9640 1 -- 172.21.15.67:0/3755935639 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f651401dcc0 con 0x557ea96fa400 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 10 client.5961 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 -- 172.21.15.67:0/3755935639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x557ea95199c0 con 0x557ea96fa400 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f6500ff9640 1 -- 172.21.15.67:0/3755935639 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c0f5950 con 0x557ea96fa400 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f6500ff9640 1 -- 172.21.15.67:0/3755935639 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f65140225a0 con 0x557ea96fa400 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 10 client.5961 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 10 client.5961 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 20 client.5961 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557ea9751dd0 0x557ea97541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 4 client.5961 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 -- 172.21.15.67:0/3755935639 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ea94e11e0 con 0x557ea9751dd0 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f65252e5640 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557ea9751dd0 0x557ea97541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f6500ff9640 10 client.5961 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f65252e5640 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557ea9751dd0 0x557ea97541c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea20e09600716fa7 server_cookie=7d8bbccc4c0301a3 in_seq=0 out_seq=0 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f6500ff9640 1 -- 172.21.15.67:0/3755935639 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ea94e11e0 con 0x557ea9751dd0 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f6500ff9640 10 client.5961 handle_command_reply: tid=0 2024-09-19T05:37:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 client.5961 shutdown 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 -- 172.21.15.67:0/3755935639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 msgr2=0x557ea9704540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9704540 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6514013ed0 tx=0x7f652015d3d0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 -- 172.21.15.67:0/3755935639 shutdown_connections 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557ea9751dd0 0x557ea97541c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea9743660 0x557ea9704fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9742d40 0x557ea9704a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 --2- 172.21.15.67:0/3755935639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9704540 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f6500ff9640 0 client.5961 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 -- 172.21.15.67:0/3755935639 >> 172.21.15.67:0/3755935639 conn(0x557ea96f63b0 msgr2=0x557ea96f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 -- 172.21.15.67:0/3755935639 shutdown_connections 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 1 -- 172.21.15.67:0/3755935639 wait complete. 2024-09-19T05:37:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.477+0000 7f652ae06000 20 client.5961 trim_cache size 0 max 16384 2024-09-19T05:37:08.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 Processor -- start 2024-09-19T05:37:08.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 -- start start 2024-09-19T05:37:08.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea96fa400 0x557ea96ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9742d40 0x557ea97541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9743660 0x557ea9754700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f65201ff5b0 con 0x557ea9742d40 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f65201fe5d0 con 0x557ea96fa400 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6520151180 con 0x557ea9743660 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f65252e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9742d40 0x557ea97541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f65252e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9742d40 0x557ea97541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52736/0 (socket says 172.21.15.67:52736) 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f65252e5640 1 -- 172.21.15.67:0/727448205 learned_addr learned my addr 172.21.15.67:0/727448205 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f6525ae6640 1 --2- 172.21.15.67:0/727448205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea96fa400 0x557ea96ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f65252e5640 1 -- 172.21.15.67:0/727448205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9743660 msgr2=0x557ea9754700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f65252e5640 1 --2- 172.21.15.67:0/727448205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9743660 0x557ea9754700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f65252e5640 1 -- 172.21.15.67:0/727448205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea96fa400 msgr2=0x557ea96ffb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f65252e5640 1 --2- 172.21.15.67:0/727448205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea96fa400 0x557ea96ffb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f65252e5640 1 -- 172.21.15.67:0/727448205 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ea94ece00 con 0x557ea9742d40 2024-09-19T05:37:08.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f65252e5640 1 --2- 172.21.15.67:0/727448205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9742d40 0x557ea97541c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f651c0f12a0 tx=0x7f651c120000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8ed9c5d0be12d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f6502ffd640 1 -- 172.21.15.67:0/727448205 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c0f5950 con 0x557ea9742d40 2024-09-19T05:37:08.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f6502ffd640 1 -- 172.21.15.67:0/727448205 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c0f15a0 con 0x557ea9742d40 2024-09-19T05:37:08.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f6502ffd640 1 -- 172.21.15.67:0/727448205 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c0ef8a0 con 0x557ea9742d40 2024-09-19T05:37:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 -- 172.21.15.67:0/727448205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9742d40 msgr2=0x557ea97541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 --2- 172.21.15.67:0/727448205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9742d40 0x557ea97541c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f651c0f12a0 tx=0x7f651c120000 comp rx=0 tx=0).stop 2024-09-19T05:37:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 -- 172.21.15.67:0/727448205 shutdown_connections 2024-09-19T05:37:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 --2- 172.21.15.67:0/727448205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9743660 0x557ea9754700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 --2- 172.21.15.67:0/727448205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea9742d40 0x557ea97541c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 --2- 172.21.15.67:0/727448205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea96fa400 0x557ea96ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 -- 172.21.15.67:0/727448205 >> 172.21.15.67:0/727448205 conn(0x557ea96f63b0 msgr2=0x557ea96fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 -- 172.21.15.67:0/727448205 shutdown_connections 2024-09-19T05:37:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.493+0000 7f652ae06000 1 -- 172.21.15.67:0/727448205 wait complete. 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 -- start start 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 Processor -- start 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9757050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea9742d40 0x557ea97724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9743660 0x557ea97729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557ea9523150 con 0x557ea96fa400 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557ea950d980 con 0x557ea9742d40 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557ea954b1d0 con 0x557ea9743660 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 10 client.0 _ll_register_callbacks cb 0x7f6514001740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6525ae6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9757050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6525ae6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9757050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52750/0 (socket says 172.21.15.67:52750) 2024-09-19T05:37:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6525ae6640 1 -- 172.21.15.67:0/16245798 learned_addr learned my addr 172.21.15.67:0/16245798 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f65252e5640 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea9742d40 0x557ea97724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f65262e7640 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9743660 0x557ea97729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6525ae6640 1 -- 172.21.15.67:0/16245798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9743660 msgr2=0x557ea97729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6525ae6640 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9743660 0x557ea97729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6525ae6640 1 -- 172.21.15.67:0/16245798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea9742d40 msgr2=0x557ea97724b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6525ae6640 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea9742d40 0x557ea97724b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6525ae6640 1 -- 172.21.15.67:0/16245798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ea94dace0 con 0x557ea96fa400 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f65262e7640 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9743660 0x557ea97729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6525ae6640 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9757050 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6514001060 tx=0x7f6514018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0db7e0d711b4a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6500ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6500ff9640 1 -- 172.21.15.67:0/16245798 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651401de60 con 0x557ea96fa400 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6500ff9640 1 -- 172.21.15.67:0/16245798 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f651401d290 con 0x557ea96fa400 2024-09-19T05:37:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 -- 172.21.15.67:0/16245798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f651c0f15a0 con 0x557ea96fa400 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6500ff9640 1 -- 172.21.15.67:0/16245798 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6514046050 con 0x557ea96fa400 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 10 client.5967 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 -- 172.21.15.67:0/16245798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x557ea94dec40 con 0x557ea96fa400 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6500ff9640 1 -- 172.21.15.67:0/16245798 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c0f15a0 con 0x557ea96fa400 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6500ff9640 1 -- 172.21.15.67:0/16245798 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f6514049020 con 0x557ea96fa400 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 10 client.5967 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 10 client.5967 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 20 client.5967 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557ea9772f30 0x557ea97b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 4 client.5967 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}] 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f652ae06000 1 -- 172.21.15.67:0/16245798 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}) -- 0x557ea95542d0 con 0x557ea9772f30 2024-09-19T05:37:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f65252e5640 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557ea9772f30 0x557ea97b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f6500ff9640 10 client.5967 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.497+0000 7f65252e5640 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557ea9772f30 0x557ea97b5d00 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57d0bbd93277fa0c server_cookie=c524145cf2dcd497 in_seq=0 out_seq=0 2024-09-19T05:37:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6500ff9640 1 -- 172.21.15.67:0/16245798 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557ea95542d0 con 0x557ea9772f30 2024-09-19T05:37:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6500ff9640 10 client.5967 handle_command_reply: tid=0 2024-09-19T05:37:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 client.5967 shutdown 2024-09-19T05:37:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 -- 172.21.15.67:0/16245798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 msgr2=0x557ea9757050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9757050 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6514001060 tx=0x7f6514018000 comp rx=0 tx=0).stop 2024-09-19T05:37:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 -- 172.21.15.67:0/16245798 shutdown_connections 2024-09-19T05:37:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557ea9743660 0x557ea97729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557ea9772f30 0x557ea97b5d00 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557ea9742d40 0x557ea97724b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 --2- 172.21.15.67:0/16245798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ea96fa400 0x557ea9757050 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6500ff9640 0 client.5967 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 -- 172.21.15.67:0/16245798 >> 172.21.15.67:0/16245798 conn(0x557ea96f63b0 msgr2=0x557ea96f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 -- 172.21.15.67:0/16245798 shutdown_connections 2024-09-19T05:37:08.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 1 -- 172.21.15.67:0/16245798 wait complete. 2024-09-19T05:37:08.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f652ae06000 20 client.5967 trim_cache size 0 max 16384 2024-09-19T05:37:08.510 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:08.511 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:37:08.511 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:37:08.511 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:08.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 -- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65040678f0 msgr2=0x7f6504069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65040678f0 0x7f6504069db0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6514000c10 tx=0x7f6514009040 comp rx=0 tx=0).stop 2024-09-19T05:37:08.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 -- 172.21.15.67:0/1983048203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652014ad80 msgr2=0x7f65201f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652014ad80 0x7f65201f6390 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f651c01cc30 tx=0x7f651c009750 comp rx=0 tx=0).stop 2024-09-19T05:37:08.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 -- 172.21.15.67:0/1983048203 shutdown_connections 2024-09-19T05:37:08.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65200b1210 0x7f65200b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f652014ad80 0x7f65201f6390 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65040678f0 0x7f6504069db0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 --2- 172.21.15.67:0/1983048203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f650c003f40 0x7f652014a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 -- 172.21.15.67:0/1983048203 >> 172.21.15.67:0/1983048203 conn(0x7f65200b1e50 msgr2=0x7f652015fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 -- 172.21.15.67:0/1983048203 shutdown_connections 2024-09-19T05:37:08.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.505+0000 7f6527d4a640 1 -- 172.21.15.67:0/1983048203 wait complete. 2024-09-19T05:37:08.526 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' returned '{'message': '', 'return_code': 0}' 2024-09-19T05:37:08.526 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:37:08.526 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:08.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:08.531 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-19T05:37:08.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:37:08.594 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:37:08.594 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130282 s, 80.5 MB/s 2024-09-19T05:37:08.595 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-19T05:37:08.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-19T05:37:08.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f1700757640 1 Processor -- start 2024-09-19T05:37:08.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f1700757640 1 -- start start 2024-09-19T05:37:08.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f1700757640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f80d4fb0 0x7f16f80d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f1700757640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f16f80d13c0 0x7f16f806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f1700757640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f80d35a0 con 0x7f16f815e690 2024-09-19T05:37:08.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f1700757640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f16f80d32c0 con 0x7f16f80d13c0 2024-09-19T05:37:08.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f1700757640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f16f806d040 con 0x7f16f80d4fb0 2024-09-19T05:37:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fe4f3640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f16f815e690 0x7f16f80d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58590/0 (socket says 172.21.15.67:58590) 2024-09-19T05:37:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fe4f3640 1 -- 172.21.15.67:0/3977273778 learned_addr learned my addr 172.21.15.67:0/3977273778 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944474608 0 0) 0x7f16f80d35a0 con 0x7f16f815e690 2024-09-19T05:37:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16e4003530 con 0x7f16f815e690 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fecf4640 1 --2- 172.21.15.67:0/3977273778 >> v2:172.21.15.97:3300/0 conn(0x7f16f80d13c0 0x7f16f806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f80d4fb0 0x7f16f80d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3943394047 0 0) 0x7f16e4003530 con 0x7f16f815e690 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f80d4fb0 msgr2=0x7f16f80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f80d4fb0 0x7f16f80d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 >> v2:172.21.15.97:3300/0 conn(0x7f16f80d13c0 msgr2=0x7f16f806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 --2- 172.21.15.67:0/3977273778 >> v2:172.21.15.97:3300/0 conn(0x7f16f80d13c0 0x7f16f806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f806d320 con 0x7f16f815e690 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f16f4001680 con 0x7f16f815e690 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fecf4640 1 --2- 172.21.15.67:0/3977273778 >> v2:172.21.15.97:3300/0 conn(0x7f16f80d13c0 0x7f16f806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 >> v1:172.21.15.67:6789/0 conn(0x7f16f815e690 legacy=0x7f16f80d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 0x7f16e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16e4004810 0x7f16e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f80d4fb0 0x7f16e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80d32c0 con 0x7f16e40039c0 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f16f806d040 con 0x7f16e4004810 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f16e400bab0 con 0x7f16f80d4fb0 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 0x7f16e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16e4004810 0x7f16e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fecf4640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f80d4fb0 0x7f16e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fe4f3640 1 -- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f80d4fb0 msgr2=0x7f16e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f80d4fb0 0x7f16e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fe4f3640 1 -- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16e4004810 msgr2=0x7f16e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16e4004810 0x7f16e4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.761+0000 7f16fe4f3640 1 -- 172.21.15.67:0/3977273778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e4003530 con 0x7f16e40039c0 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 0x7f16e4003de0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c210 tx=0x7f16f401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3aa65660161f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4007d60 con 0x7f16e40039c0 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f40a9020 con 0x7f16e40039c0 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f16fd4f1640 1 -- 172.21.15.67:0/3977273778 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4005b00 con 0x7f16e40039c0 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f1700757640 1 -- 172.21.15.67:0/3977273778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 msgr2=0x7f16e4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f1700757640 1 --2- 172.21.15.67:0/3977273778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 0x7f16e4003de0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c210 tx=0x7f16f401cc80 comp rx=0 tx=0).stop 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f16fecf4640 1 -- 172.21.15.67:0/3977273778 reap_dead start 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f1700757640 1 -- 172.21.15.67:0/3977273778 shutdown_connections 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f1700757640 1 -- 172.21.15.67:0/3977273778 >> 172.21.15.67:0/3977273778 conn(0x7f16f80d4490 msgr2=0x7f16f80d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f1700757640 1 -- 172.21.15.67:0/3977273778 shutdown_connections 2024-09-19T05:37:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f1700757640 1 -- 172.21.15.67:0/3977273778 wait complete. 2024-09-19T05:37:08.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f1700757640 1 Processor -- start 2024-09-19T05:37:08.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.765+0000 7f1700757640 1 -- start start 2024-09-19T05:37:08.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f1700757640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 0x7f16f81f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f1700757640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16f8160f80 0x7f16f80b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f1700757640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f8168930 0x7f16f8163950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f1700757640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f16f806ec00 con 0x7f16e40039c0 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f1700757640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f16f806ea80 con 0x7f16f8160f80 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f1700757640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f16f8169240 con 0x7f16f8168930 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fe4f3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 0x7f16f81f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fe4f3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 0x7f16f81f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52770/0 (socket says 172.21.15.67:52770) 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fe4f3640 1 -- 172.21.15.67:0/2612910120 learned_addr learned my addr 172.21.15.67:0/2612910120 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fecf4640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f8168930 0x7f16f8163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16f8160f80 0x7f16f80b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fe4f3640 1 -- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f8168930 msgr2=0x7f16f8163950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f8168930 0x7f16f8163950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fe4f3640 1 -- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16f8160f80 msgr2=0x7f16f80b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16f8160f80 0x7f16f80b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fe4f3640 1 -- 172.21.15.67:0/2612910120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f80b6c10 con 0x7f16e40039c0 2024-09-19T05:37:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 0x7f16f81f7ba0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f16f40ab040 tx=0x7f16e4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16eeffd640 1 -- 172.21.15.67:0/2612910120 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f40049f0 con 0x7f16e40039c0 2024-09-19T05:37:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16eeffd640 1 -- 172.21.15.67:0/2612910120 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f4004b90 con 0x7f16e40039c0 2024-09-19T05:37:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f1700757640 1 -- 172.21.15.67:0/2612910120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f81601c0 con 0x7f16e40039c0 2024-09-19T05:37:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16eeffd640 1 -- 172.21.15.67:0/2612910120 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f40070d0 con 0x7f16e40039c0 2024-09-19T05:37:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f1700757640 1 -- 172.21.15.67:0/2612910120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f8160780 con 0x7f16e40039c0 2024-09-19T05:37:08.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16eeffd640 1 -- 172.21.15.67:0/2612910120 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16f4007270 con 0x7f16e40039c0 2024-09-19T05:37:08.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16eeffd640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16dc0678f0 0x7f16dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16eeffd640 1 -- 172.21.15.67:0/2612910120 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f16f411f450 con 0x7f16e40039c0 2024-09-19T05:37:08.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16dc0678f0 0x7f16dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.769+0000 7f1703813000 1 Processor -- start 2024-09-19T05:37:08.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- start start 2024-09-19T05:37:08.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16dc0678f0 0x7f16dc069db0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f16f8165130 tx=0x7f16e8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7873d40 0x55a7c7874120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7874660 0x55a7c782aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c782b400 0x55a7c782b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7712a20 con 0x55a7c782b400 2024-09-19T05:37:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7677ba0 con 0x55a7c7873d40 2024-09-19T05:37:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a7c761dbb0 con 0x55a7c7874660 2024-09-19T05:37:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fecf4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c782b400 0x55a7c782b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fecf4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c782b400 0x55a7c782b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52782/0 (socket says 172.21.15.67:52782) 2024-09-19T05:37:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fecf4640 1 -- 172.21.15.67:0/2718265622 learned_addr learned my addr 172.21.15.67:0/2718265622 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/2718265622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7874660 0x55a7c782aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/2718265622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7873d40 0x55a7c7874120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fecf4640 1 -- 172.21.15.67:0/2718265622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7874660 msgr2=0x55a7c782aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fecf4640 1 --2- 172.21.15.67:0/2718265622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7874660 0x55a7c782aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fecf4640 1 -- 172.21.15.67:0/2718265622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7873d40 msgr2=0x55a7c7874120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fecf4640 1 --2- 172.21.15.67:0/2718265622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7873d40 0x55a7c7874120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fecf4640 1 -- 172.21.15.67:0/2718265622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c76beee0 con 0x55a7c782b400 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/2718265622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7873d40 0x55a7c7874120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16fecf4640 1 --2- 172.21.15.67:0/2718265622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c782b400 0x55a7c782b7e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f16f80d5590 tx=0x7f16f0009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4156d987d46c8149 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16dbfff640 1 -- 172.21.15.67:0/2718265622 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0019020 con 0x55a7c782b400 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16dbfff640 1 -- 172.21.15.67:0/2718265622 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f0004720 con 0x55a7c782b400 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f16dbfff640 1 -- 172.21.15.67:0/2718265622 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0015610 con 0x55a7c782b400 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- 172.21.15.67:0/2718265622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c782b400 msgr2=0x55a7c782b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 --2- 172.21.15.67:0/2718265622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c782b400 0x55a7c782b7e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f16f80d5590 tx=0x7f16f0009c60 comp rx=0 tx=0).stop 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- 172.21.15.67:0/2718265622 shutdown_connections 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 --2- 172.21.15.67:0/2718265622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c782b400 0x55a7c782b7e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 --2- 172.21.15.67:0/2718265622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7874660 0x55a7c782aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 --2- 172.21.15.67:0/2718265622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7873d40 0x55a7c7874120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- 172.21.15.67:0/2718265622 >> 172.21.15.67:0/2718265622 conn(0x55a7c78273b0 msgr2=0x55a7c78297a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- 172.21.15.67:0/2718265622 shutdown_connections 2024-09-19T05:37:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- 172.21.15.67:0/2718265622 wait complete. 2024-09-19T05:37:08.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- start start 2024-09-19T05:37:08.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 Processor -- start 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c782b400 0x55a7c7835540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c7835a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7874660 0x55a7c7835fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7611d20 con 0x55a7c7873d40 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7673b60 con 0x55a7c7874660 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a7c767c1d0 con 0x55a7c782b400 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.773+0000 7f1703813000 10 client.0 _ll_register_callbacks cb 0x55a7c76db120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fdcf2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c7835a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fdcf2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c7835a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52792/0 (socket says 172.21.15.67:52792) 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fdcf2640 1 -- 172.21.15.67:0/3461274980 learned_addr learned my addr 172.21.15.67:0/3461274980 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fecf4640 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7874660 0x55a7c7835fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c782b400 0x55a7c7835540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fdcf2640 1 -- 172.21.15.67:0/3461274980 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c782b400 msgr2=0x55a7c7835540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c782b400 0x55a7c7835540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fdcf2640 1 -- 172.21.15.67:0/3461274980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7874660 msgr2=0x55a7c7835fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7874660 0x55a7c7835fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fdcf2640 1 -- 172.21.15.67:0/3461274980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c7652e20 con 0x55a7c7873d40 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c7835a80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f16e8011c90 tx=0x7f16e8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75df016d306990d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16d97fa640 1 -- 172.21.15.67:0/3461274980 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8015480 con 0x55a7c7873d40 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16d97fa640 1 -- 172.21.15.67:0/3461274980 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f16e8015620 con 0x55a7c7873d40 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 -- 172.21.15.67:0/3461274980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16f0004720 con 0x55a7c7873d40 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16d97fa640 1 -- 172.21.15.67:0/3461274980 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16e8030050 con 0x55a7c7873d40 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 10 client.5979 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 -- 172.21.15.67:0/3461274980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55a7c764a9c0 con 0x55a7c7873d40 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16d97fa640 1 -- 172.21.15.67:0/3461274980 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f0004720 con 0x55a7c7873d40 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16d97fa640 1 -- 172.21.15.67:0/3461274980 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f16e8033020 con 0x55a7c7873d40 2024-09-19T05:37:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 10 client.5979 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 10 client.5979 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 20 client.5979 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55a7c7882dd0 0x55a7c78851c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 4 client.5979 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 -- 172.21.15.67:0/3461274980 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7c76121e0 con 0x55a7c7882dd0 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55a7c7882dd0 0x55a7c78851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16d97fa640 10 client.5979 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55a7c7882dd0 0x55a7c78851c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20c4436e673d6cb4 server_cookie=4b1227fffdf984 in_seq=0 out_seq=0 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16d97fa640 1 -- 172.21.15.67:0/3461274980 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7c76121e0 con 0x55a7c7882dd0 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16d97fa640 10 client.5979 handle_command_reply: tid=0 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 client.5979 shutdown 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 -- 172.21.15.67:0/3461274980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 msgr2=0x55a7c7835a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c7835a80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f16e8011c90 tx=0x7f16e8004740 comp rx=0 tx=0).stop 2024-09-19T05:37:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 -- 172.21.15.67:0/3461274980 shutdown_connections 2024-09-19T05:37:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55a7c7882dd0 0x55a7c78851c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c7874660 0x55a7c7835fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c7835a80 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f16d97fa640 0 client.5979 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 --2- 172.21.15.67:0/3461274980 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c782b400 0x55a7c7835540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 -- 172.21.15.67:0/3461274980 >> 172.21.15.67:0/3461274980 conn(0x55a7c78273b0 msgr2=0x55a7c7829fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 -- 172.21.15.67:0/3461274980 shutdown_connections 2024-09-19T05:37:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 1 -- 172.21.15.67:0/3461274980 wait complete. 2024-09-19T05:37:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.777+0000 7f1703813000 20 client.5979 trim_cache size 0 max 16384 2024-09-19T05:37:08.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f1703813000 1 Processor -- start 2024-09-19T05:37:08.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f1703813000 1 -- start start 2024-09-19T05:37:08.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f1703813000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 0x55a7c7830b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f1703813000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7873d40 0x55a7c78851c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f1703813000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7874660 0x55a7c7885700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f1703813000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8204a20 con 0x55a7c7874660 2024-09-19T05:37:08.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f1703813000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8203a80 con 0x55a7c782b400 2024-09-19T05:37:08.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f1703813000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f16f8167f60 con 0x55a7c7873d40 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fecf4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7874660 0x55a7c7885700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fecf4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7874660 0x55a7c7885700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52800/0 (socket says 172.21.15.67:52800) 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fecf4640 1 -- 172.21.15.67:0/2960997781 learned_addr learned my addr 172.21.15.67:0/2960997781 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/2960997781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 0x55a7c7830b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/2960997781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7873d40 0x55a7c78851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fecf4640 1 -- 172.21.15.67:0/2960997781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7873d40 msgr2=0x55a7c78851c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fecf4640 1 --2- 172.21.15.67:0/2960997781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7873d40 0x55a7c78851c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fecf4640 1 -- 172.21.15.67:0/2960997781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 msgr2=0x55a7c7830b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fecf4640 1 --2- 172.21.15.67:0/2960997781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 0x55a7c7830b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fecf4640 1 -- 172.21.15.67:0/2960997781 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c761de00 con 0x55a7c7874660 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/2960997781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 0x55a7c7830b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.793+0000 7f16fecf4640 1 --2- 172.21.15.67:0/2960997781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7874660 0x55a7c7885700 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55a7c7739ce0 tx=0x7f16f000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a089bec8e64c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16db7fe640 1 -- 172.21.15.67:0/2960997781 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0019050 con 0x55a7c7874660 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16db7fe640 1 -- 172.21.15.67:0/2960997781 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f001e420 con 0x55a7c7874660 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16db7fe640 1 -- 172.21.15.67:0/2960997781 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f001e810 con 0x55a7c7874660 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- 172.21.15.67:0/2960997781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7874660 msgr2=0x55a7c7885700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 --2- 172.21.15.67:0/2960997781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7874660 0x55a7c7885700 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55a7c7739ce0 tx=0x7f16f000f000 comp rx=0 tx=0).stop 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- 172.21.15.67:0/2960997781 shutdown_connections 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 --2- 172.21.15.67:0/2960997781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7874660 0x55a7c7885700 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 --2- 172.21.15.67:0/2960997781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7873d40 0x55a7c78851c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 --2- 172.21.15.67:0/2960997781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 0x55a7c7830b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- 172.21.15.67:0/2960997781 >> 172.21.15.67:0/2960997781 conn(0x55a7c78273b0 msgr2=0x55a7c782f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- 172.21.15.67:0/2960997781 shutdown_connections 2024-09-19T05:37:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- 172.21.15.67:0/2960997781 wait complete. 2024-09-19T05:37:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- start start 2024-09-19T05:37:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 Processor -- start 2024-09-19T05:37:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 0x55a7c7887e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c78883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7874660 0x55a7c78a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a7c761f440 con 0x55a7c7873d40 2024-09-19T05:37:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8203430 con 0x55a7c782b400 2024-09-19T05:37:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a7c7654150 con 0x55a7c7874660 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 10 client.0 _ll_register_callbacks cb 0x7f16e8019040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fdcf2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c78883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fdcf2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c78883b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52814/0 (socket says 172.21.15.67:52814) 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fdcf2640 1 -- 172.21.15.67:0/3090789198 learned_addr learned my addr 172.21.15.67:0/3090789198 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 0x55a7c7887e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fecf4640 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7874660 0x55a7c78a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fdcf2640 1 -- 172.21.15.67:0/3090789198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7874660 msgr2=0x55a7c78a34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7874660 0x55a7c78a34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fdcf2640 1 -- 172.21.15.67:0/3090789198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 msgr2=0x55a7c7887e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 0x55a7c7887e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fdcf2640 1 -- 172.21.15.67:0/3090789198 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c760bce0 con 0x55a7c7873d40 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fdcf2640 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c78883b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f16e8011980 tx=0x7f16e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fab82e56b91b62a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:08.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16d97fa640 1 -- 172.21.15.67:0/3090789198 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8004580 con 0x55a7c7873d40 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16d97fa640 1 -- 172.21.15.67:0/3090789198 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f16e8015480 con 0x55a7c7873d40 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- 172.21.15.67:0/3090789198 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16f001e420 con 0x55a7c7873d40 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16d97fa640 1 -- 172.21.15.67:0/3090789198 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16e8044050 con 0x55a7c7873d40 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 10 client.5985 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- 172.21.15.67:0/3090789198 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55a7c760fc40 con 0x55a7c7873d40 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16d97fa640 1 -- 172.21.15.67:0/3090789198 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f001e420 con 0x55a7c7873d40 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16d97fa640 1 -- 172.21.15.67:0/3090789198 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f16e8047020 con 0x55a7c7873d40 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 10 client.5985 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 10 client.5985 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 20 client.5985 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55a7c78e6d00 0x55a7c78e7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 4 client.5985 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-19T05:37:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f1703813000 1 -- 172.21.15.67:0/3090789198 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x55a7c76852d0 con 0x55a7c78e6d00 2024-09-19T05:37:08.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.797+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55a7c78e6d00 0x55a7c78e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:08.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.801+0000 7f16fe4f3640 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55a7c78e6d00 0x55a7c78e7110 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90c6f47da8a144d3 server_cookie=4c02aadc56358dce in_seq=0 out_seq=0 2024-09-19T05:37:08.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.801+0000 7f16d97fa640 10 client.5985 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f16d97fa640 1 -- 172.21.15.67:0/3090789198 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7c76852d0 con 0x55a7c78e6d00 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f16d97fa640 10 client.5985 handle_command_reply: tid=0 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 client.5985 shutdown 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 -- 172.21.15.67:0/3090789198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 msgr2=0x55a7c78883b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c78883b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f16e8011980 tx=0x7f16e8016000 comp rx=0 tx=0).stop 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 -- 172.21.15.67:0/3090789198 shutdown_connections 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a7c7874660 0x55a7c78a34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a7c7873d40 0x55a7c78883b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55a7c78e6d00 0x55a7c78e7110 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 --2- 172.21.15.67:0/3090789198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a7c782b400 0x55a7c7887e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 -- 172.21.15.67:0/3090789198 >> 172.21.15.67:0/3090789198 conn(0x55a7c78273b0 msgr2=0x55a7c782acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f16d97fa640 0 client.5985 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 -- 172.21.15.67:0/3090789198 shutdown_connections 2024-09-19T05:37:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 1 -- 172.21.15.67:0/3090789198 wait complete. 2024-09-19T05:37:08.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1703813000 20 client.5985 trim_cache size 0 max 16384 2024-09-19T05:37:08.811 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:08.811 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:37:08.811 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:37:08.811 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 -- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16dc0678f0 msgr2=0x7f16dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16dc0678f0 0x7f16dc069db0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f16f8165130 tx=0x7f16e8008040 comp rx=0 tx=0).stop 2024-09-19T05:37:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 -- 172.21.15.67:0/2612910120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 msgr2=0x7f16f81f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 0x7f16f81f7ba0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f16f40ab040 tx=0x7f16e4005840 comp rx=0 tx=0).stop 2024-09-19T05:37:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 -- 172.21.15.67:0/2612910120 shutdown_connections 2024-09-19T05:37:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16dc0678f0 0x7f16dc069db0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16f8168930 0x7f16f8163950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16f8160f80 0x7f16f80b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 --2- 172.21.15.67:0/2612910120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e40039c0 0x7f16f81f7ba0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:08.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 -- 172.21.15.67:0/2612910120 >> 172.21.15.67:0/2612910120 conn(0x7f16f80d4490 msgr2=0x7f16f8162190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:08.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 -- 172.21.15.67:0/2612910120 shutdown_connections 2024-09-19T05:37:08.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08.805+0000 7f1700757640 1 -- 172.21.15.67:0/2612910120 wait complete. 2024-09-19T05:37:08.827 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'message': '', 'return_code': 0}' 2024-09-19T05:37:08.827 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:37:08.827 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:37:08.827 DEBUG:teuthology.orchestra.run.smithi067:> import stat 2024-09-19T05:37:08.827 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:08.828 DEBUG:teuthology.orchestra.run.smithi067:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-09-19T05:37:08.828 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:37:08.828 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:37:08.830 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:37:08.881 INFO:teuthology.orchestra.run.smithi067.stdout:1099511630411 2024-09-19T05:37:08.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:08.893 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-19T05:37:09.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.057+0000 7fd84e1b5640 1 Processor -- start 2024-09-19T05:37:09.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.057+0000 7fd84e1b5640 1 -- start start 2024-09-19T05:37:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd84e1b5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84815b1d0 0x7fd8480adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd84e1b5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8480aef30 con 0x7fd84806dfc0 2024-09-19T05:37:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd84e1b5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8480ae0f0 con 0x7fd848070070 2024-09-19T05:37:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd84e1b5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd848072210 con 0x7fd84815b1d0 2024-09-19T05:37:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd846ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd84806dfc0 0x7fd84806f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58592/0 (socket says 172.21.15.67:58592) 2024-09-19T05:37:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd846ffd640 1 -- 172.21.15.67:0/4046744269 learned_addr learned my addr 172.21.15.67:0/4046744269 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109786745 0 0) 0x7fd8480aef30 con 0x7fd84806dfc0 2024-09-19T05:37:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd830003530 con 0x7fd84806dfc0 2024-09-19T05:37:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8477fe640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84815b1d0 0x7fd8480adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 183629117 0 0) 0x7fd830003530 con 0x7fd84806dfc0 2024-09-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84815b1d0 msgr2=0x7fd8480adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84815b1d0 0x7fd8480adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 >> v1:172.21.15.97:6789/0 conn(0x7fd848070070 legacy=0x7fd8480b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8480ae3b0 con 0x7fd84806dfc0 2024-09-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fd83c001680 con 0x7fd84806dfc0 2024-09-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 >> v1:172.21.15.67:6789/0 conn(0x7fd84806dfc0 legacy=0x7fd84806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8300039f0 0x7fd830003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd830004810 0x7fd830004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8300051d0 0x7fd83000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd848072210 con 0x7fd8300051d0 2024-09-19T05:37:09.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd83000c0a0 con 0x7fd8300039f0 2024-09-19T05:37:09.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd83000c2a0 con 0x7fd830004810 2024-09-19T05:37:09.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8477fe640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84815b1d0 0x7fd8480adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:09.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd847fff640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8300051d0 0x7fd83000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd846ffd640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd830004810 0x7fd830004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8477fe640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8300039f0 0x7fd830003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd847fff640 1 -- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd830004810 msgr2=0x7fd830004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd847fff640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd830004810 0x7fd830004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd847fff640 1 -- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8300039f0 msgr2=0x7fd830003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd847fff640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8300039f0 0x7fd830003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd847fff640 1 -- 172.21.15.67:0/4046744269 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd830003530 con 0x7fd8300051d0 2024-09-19T05:37:09.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8477fe640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8300039f0 0x7fd830003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:09.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd847fff640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8300051d0 0x7fd83000b9d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd840001e40 tx=0x7fd84001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0a8c0f76ba316f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840001a90 con 0x7fd8300051d0 2024-09-19T05:37:09.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.061+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd840003b80 con 0x7fd8300051d0 2024-09-19T05:37:09.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd8467fc640 1 -- 172.21.15.67:0/4046744269 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840005080 con 0x7fd8300051d0 2024-09-19T05:37:09.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- 172.21.15.67:0/4046744269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8300051d0 msgr2=0x7fd83000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 --2- 172.21.15.67:0/4046744269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8300051d0 0x7fd83000b9d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd840001e40 tx=0x7fd84001c760 comp rx=0 tx=0).stop 2024-09-19T05:37:09.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd847fff640 1 -- 172.21.15.67:0/4046744269 reap_dead start 2024-09-19T05:37:09.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- 172.21.15.67:0/4046744269 shutdown_connections 2024-09-19T05:37:09.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- 172.21.15.67:0/4046744269 >> 172.21.15.67:0/4046744269 conn(0x7fd8480b1e50 msgr2=0x7fd8480b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- 172.21.15.67:0/4046744269 shutdown_connections 2024-09-19T05:37:09.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- 172.21.15.67:0/4046744269 wait complete. 2024-09-19T05:37:09.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 Processor -- start 2024-09-19T05:37:09.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- start start 2024-09-19T05:37:09.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8300051d0 0x7fd848155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8481592f0 0x7fd848159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84809ce90 0x7fd84809d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd8480aec50 con 0x7fd8481592f0 2024-09-19T05:37:09.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd8480ae970 con 0x7fd8300051d0 2024-09-19T05:37:09.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd848072420 con 0x7fd84809ce90 2024-09-19T05:37:09.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8481592f0 0x7fd848159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8481592f0 0x7fd848159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52830/0 (socket says 172.21.15.67:52830) 2024-09-19T05:37:09.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd846ffd640 1 -- 172.21.15.67:0/325097561 learned_addr learned my addr 172.21.15.67:0/325097561 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd8477fe640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8300051d0 0x7fd848155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd847fff640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84809ce90 0x7fd84809d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd846ffd640 1 -- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84809ce90 msgr2=0x7fd84809d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd846ffd640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84809ce90 0x7fd84809d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd846ffd640 1 -- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8300051d0 msgr2=0x7fd848155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd846ffd640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8300051d0 0x7fd848155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd846ffd640 1 -- 172.21.15.67:0/325097561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84809b170 con 0x7fd8481592f0 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd847fff640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84809ce90 0x7fd84809d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd846ffd640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8481592f0 0x7fd848159770 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00e7f0 tx=0x7fd83c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd82ffff640 1 -- 172.21.15.67:0/325097561 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00c8d0 con 0x7fd8481592f0 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd82ffff640 1 -- 172.21.15.67:0/325097561 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd83c018070 con 0x7fd8481592f0 2024-09-19T05:37:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd82ffff640 1 -- 172.21.15.67:0/325097561 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00ccd0 con 0x7fd8481592f0 2024-09-19T05:37:09.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- 172.21.15.67:0/325097561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd84809b450 con 0x7fd8481592f0 2024-09-19T05:37:09.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.065+0000 7fd84e1b5640 1 -- 172.21.15.67:0/325097561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd84809ba10 con 0x7fd8481592f0 2024-09-19T05:37:09.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd82ffff640 1 -- 172.21.15.67:0/325097561 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd83c01d460 con 0x7fd8481592f0 2024-09-19T05:37:09.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd82ffff640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8340678c0 0x7fd834069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd82ffff640 1 -- 172.21.15.67:0/325097561 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd83c085cd0 con 0x7fd8481592f0 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd8477fe640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8340678c0 0x7fd834069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd851271000 1 Processor -- start 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd851271000 1 -- start start 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd8477fe640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8340678c0 0x7fd834069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd84809c5f0 tx=0x7fd838008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd851271000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 0x564504abe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd851271000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504a74880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd851271000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 0x564504a751a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd851271000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564504959c40 con 0x564504abecc0 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd851271000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5645048c0d50 con 0x564504a74dc0 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd851271000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56450487bab0 con 0x564504abe3a0 2024-09-19T05:37:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504a74880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504a74880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52842/0 (socket says 172.21.15.67:52842) 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.069+0000 7fd846ffd640 1 -- 172.21.15.67:0/3949988456 learned_addr learned my addr 172.21.15.67:0/3949988456 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd847fff640 1 --2- 172.21.15.67:0/3949988456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 0x564504a751a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd8477fe640 1 --2- 172.21.15.67:0/3949988456 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 0x564504abe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 -- 172.21.15.67:0/3949988456 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 msgr2=0x564504abe780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 --2- 172.21.15.67:0/3949988456 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 0x564504abe780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 -- 172.21.15.67:0/3949988456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 msgr2=0x564504a751a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 --2- 172.21.15.67:0/3949988456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 0x564504a751a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 -- 172.21.15.67:0/3949988456 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564504867590 con 0x564504abecc0 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd8477fe640 1 --2- 172.21.15.67:0/3949988456 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 0x564504abe780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 --2- 172.21.15.67:0/3949988456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504a74880 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0523b0 tx=0x7fd83c0558b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fb5586856be60b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd82d7fa640 1 -- 172.21.15.67:0/3949988456 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c05a300 con 0x564504abecc0 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd82d7fa640 1 -- 172.21.15.67:0/3949988456 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd83c05eb30 con 0x564504abecc0 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd82d7fa640 1 -- 172.21.15.67:0/3949988456 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0525c0 con 0x564504abecc0 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- 172.21.15.67:0/3949988456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 msgr2=0x564504a74880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 --2- 172.21.15.67:0/3949988456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504a74880 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0523b0 tx=0x7fd83c0558b0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- 172.21.15.67:0/3949988456 shutdown_connections 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 --2- 172.21.15.67:0/3949988456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 0x564504a751a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 --2- 172.21.15.67:0/3949988456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504a74880 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 --2- 172.21.15.67:0/3949988456 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 0x564504abe780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- 172.21.15.67:0/3949988456 >> 172.21.15.67:0/3949988456 conn(0x564504a70d70 msgr2=0x564504a73160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- 172.21.15.67:0/3949988456 shutdown_connections 2024-09-19T05:37:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- 172.21.15.67:0/3949988456 wait complete. 2024-09-19T05:37:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- start start 2024-09-19T05:37:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 Processor -- start 2024-09-19T05:37:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504a74dc0 0x564504aa81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504aa86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504abecc0 0x564504aa8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5645048c5380 con 0x564504abe3a0 2024-09-19T05:37:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56450487f400 con 0x564504abecc0 2024-09-19T05:37:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56450497d3a0 con 0x564504a74dc0 2024-09-19T05:37:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 10 client.0 _ll_register_callbacks cb 0x564504922020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504aa86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504aa86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52846/0 (socket says 172.21.15.67:52846) 2024-09-19T05:37:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 -- 172.21.15.67:0/3497095510 learned_addr learned my addr 172.21.15.67:0/3497095510 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd8477fe640 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504a74dc0 0x564504aa81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd847fff640 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504abecc0 0x564504aa8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 -- 172.21.15.67:0/3497095510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504a74dc0 msgr2=0x564504aa81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504a74dc0 0x564504aa81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 -- 172.21.15.67:0/3497095510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504abecc0 msgr2=0x564504aa8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504abecc0 0x564504aa8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 -- 172.21.15.67:0/3497095510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564504863dd0 con 0x564504abe3a0 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd846ffd640 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504aa86f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0523b0 tx=0x7fd83c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1f608a0f79da92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd8267fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd8267fc640 1 -- 172.21.15.67:0/3497095510 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c05a300 con 0x564504abe3a0 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd8267fc640 1 -- 172.21.15.67:0/3497095510 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd83c0553a0 con 0x564504abe3a0 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- 172.21.15.67:0/3497095510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd83c05eb30 con 0x564504abe3a0 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd8267fc640 1 -- 172.21.15.67:0/3497095510 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd83c0555a0 con 0x564504abe3a0 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 10 client.5997 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 1 -- 172.21.15.67:0/3497095510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x564504860800 con 0x564504abe3a0 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd8267fc640 1 -- 172.21.15.67:0/3497095510 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd83c05eb30 con 0x564504abe3a0 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd8267fc640 1 -- 172.21.15.67:0/3497095510 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fd83c051ca0 con 0x564504abe3a0 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 10 client.5997 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 10 client.5997 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.073+0000 7fd851271000 20 client.5997 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564504aa9bf0 0x564504aa9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 4 client.5997 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 -- 172.21.15.67:0/3497095510 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56450485ae20 con 0x564504aa9bf0 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd8477fe640 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564504aa9bf0 0x564504aa9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd8267fc640 10 client.5997 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd8477fe640 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564504aa9bf0 0x564504aa9fd0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d79f007231342643 server_cookie=c78ce730490bc10d in_seq=0 out_seq=0 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd8267fc640 1 -- 172.21.15.67:0/3497095510 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56450485ae20 con 0x564504aa9bf0 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd8267fc640 10 client.5997 handle_command_reply: tid=0 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 client.5997 shutdown 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 -- 172.21.15.67:0/3497095510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 msgr2=0x564504aa86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504aa86f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0523b0 tx=0x7fd83c000bd0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 -- 172.21.15.67:0/3497095510 shutdown_connections 2024-09-19T05:37:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564504aa9bf0 0x564504aa9fd0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504abecc0 0x564504aa8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504aa86f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd8267fc640 0 client.5997 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 --2- 172.21.15.67:0/3497095510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504a74dc0 0x564504aa81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 -- 172.21.15.67:0/3497095510 >> 172.21.15.67:0/3497095510 conn(0x564504a70d70 msgr2=0x564504a78720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 -- 172.21.15.67:0/3497095510 shutdown_connections 2024-09-19T05:37:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 1 -- 172.21.15.67:0/3497095510 wait complete. 2024-09-19T05:37:09.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.077+0000 7fd851271000 20 client.5997 trim_cache size 0 max 16384 2024-09-19T05:37:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.089+0000 7fd851271000 1 Processor -- start 2024-09-19T05:37:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.089+0000 7fd851271000 1 -- start start 2024-09-19T05:37:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504a74dc0 0x564504b2d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504b2dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504abecc0 0x564504b2e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd8481f21a0 con 0x564504abe3a0 2024-09-19T05:37:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd84806f5a0 con 0x564504abecc0 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd8481f1b50 con 0x564504a74dc0 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504b2dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504b2dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52852/0 (socket says 172.21.15.67:52852) 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd846ffd640 1 -- 172.21.15.67:0/2247818620 learned_addr learned my addr 172.21.15.67:0/2247818620 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd846ffd640 1 -- 172.21.15.67:0/2247818620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504a74dc0 msgr2=0x564504b2d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd846ffd640 1 --2- 172.21.15.67:0/2247818620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504a74dc0 0x564504b2d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd846ffd640 1 -- 172.21.15.67:0/2247818620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504abecc0 msgr2=0x564504b2e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd846ffd640 1 --2- 172.21.15.67:0/2247818620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504abecc0 0x564504b2e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd846ffd640 1 -- 172.21.15.67:0/2247818620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56450487e480 con 0x564504abe3a0 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd846ffd640 1 --2- 172.21.15.67:0/2247818620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504b2dd10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd83c001060 tx=0x7fd83c082000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ad960ccdf97167 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd82cff9640 1 -- 172.21.15.67:0/2247818620 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0521f0 con 0x564504abe3a0 2024-09-19T05:37:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd82cff9640 1 -- 172.21.15.67:0/2247818620 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd83c056650 con 0x564504abe3a0 2024-09-19T05:37:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd82cff9640 1 -- 172.21.15.67:0/2247818620 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c05a300 con 0x564504abe3a0 2024-09-19T05:37:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- 172.21.15.67:0/2247818620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 msgr2=0x564504b2dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 --2- 172.21.15.67:0/2247818620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504b2dd10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd83c001060 tx=0x7fd83c082000 comp rx=0 tx=0).stop 2024-09-19T05:37:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- 172.21.15.67:0/2247818620 shutdown_connections 2024-09-19T05:37:09.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 --2- 172.21.15.67:0/2247818620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504abecc0 0x564504b2e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 --2- 172.21.15.67:0/2247818620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abe3a0 0x564504b2dd10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 --2- 172.21.15.67:0/2247818620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504a74dc0 0x564504b2d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- 172.21.15.67:0/2247818620 >> 172.21.15.67:0/2247818620 conn(0x564504a70d70 msgr2=0x564504aa83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- 172.21.15.67:0/2247818620 shutdown_connections 2024-09-19T05:37:09.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- 172.21.15.67:0/2247818620 wait complete. 2024-09-19T05:37:09.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- start start 2024-09-19T05:37:09.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 Processor -- start 2024-09-19T05:37:09.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 0x564504b32020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 0x564504b32560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504ad43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56450487f7d0 con 0x564504abecc0 2024-09-19T05:37:09.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564504900260 con 0x564504a74dc0 2024-09-19T05:37:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564504866f30 con 0x564504abe3a0 2024-09-19T05:37:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 10 client.0 _ll_register_callbacks cb 0x7fd83c055df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd847fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504ad43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd847fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504ad43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52864/0 (socket says 172.21.15.67:52864) 2024-09-19T05:37:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd847fff640 1 -- 172.21.15.67:0/2292359404 learned_addr learned my addr 172.21.15.67:0/2292359404 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd8477fe640 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 0x564504b32020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd846ffd640 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 0x564504b32560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd847fff640 1 -- 172.21.15.67:0/2292359404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 msgr2=0x564504b32560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd847fff640 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 0x564504b32560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd847fff640 1 -- 172.21.15.67:0/2292359404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 msgr2=0x564504b32020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd847fff640 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 0x564504b32020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd847fff640 1 -- 172.21.15.67:0/2292359404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564504854650 con 0x564504abecc0 2024-09-19T05:37:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd8477fe640 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 0x564504b32020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd847fff640 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504ad43c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd84001d000 tx=0x7fd830005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f04dc6f74362ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd8267fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd8267fc640 1 -- 172.21.15.67:0/2292359404 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840003b80 con 0x564504abecc0 2024-09-19T05:37:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd8267fc640 1 -- 172.21.15.67:0/2292359404 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd840003d20 con 0x564504abecc0 2024-09-19T05:37:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.093+0000 7fd851271000 1 -- 172.21.15.67:0/2292359404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd83c056650 con 0x564504abecc0 2024-09-19T05:37:09.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd8267fc640 1 -- 172.21.15.67:0/2292359404 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd8400c4050 con 0x564504abecc0 2024-09-19T05:37:09.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 10 client.6003 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:09.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 -- 172.21.15.67:0/2292359404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5645048583c0 con 0x564504abecc0 2024-09-19T05:37:09.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd8267fc640 1 -- 172.21.15.67:0/2292359404 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd83c056650 con 0x564504abecc0 2024-09-19T05:37:09.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd8267fc640 1 -- 172.21.15.67:0/2292359404 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fd8400c7020 con 0x564504abecc0 2024-09-19T05:37:09.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 10 client.6003 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:09.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 10 client.6003 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:09.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 20 client.6003 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:09.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564504ad4900 0x564504ad4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 4 client.6003 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:37:09.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 -- 172.21.15.67:0/2292359404 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5645048ce480 con 0x564504ad4900 2024-09-19T05:37:09.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd8477fe640 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564504ad4900 0x564504ad4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd8267fc640 10 client.6003 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd8477fe640 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564504ad4900 0x564504ad4d10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afd361687df56340 server_cookie=ce49a8bed2a7e84d in_seq=0 out_seq=0 2024-09-19T05:37:09.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd8267fc640 1 -- 172.21.15.67:0/2292359404 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5645048ce480 con 0x564504ad4900 2024-09-19T05:37:09.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd8267fc640 10 client.6003 handle_command_reply: tid=0 2024-09-19T05:37:09.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 client.6003 shutdown 2024-09-19T05:37:09.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 -- 172.21.15.67:0/2292359404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 msgr2=0x564504ad43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504ad43c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd84001d000 tx=0x7fd830005840 comp rx=0 tx=0).stop 2024-09-19T05:37:09.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 -- 172.21.15.67:0/2292359404 shutdown_connections 2024-09-19T05:37:09.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564504abecc0 0x564504ad43c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564504abe3a0 0x564504b32560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x564504ad4900 0x564504ad4d10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 --2- 172.21.15.67:0/2292359404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564504a74dc0 0x564504b32020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd8267fc640 0 client.6003 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 -- 172.21.15.67:0/2292359404 >> 172.21.15.67:0/2292359404 conn(0x564504a70d70 msgr2=0x564504acb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 -- 172.21.15.67:0/2292359404 shutdown_connections 2024-09-19T05:37:09.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 1 -- 172.21.15.67:0/2292359404 wait complete. 2024-09-19T05:37:09.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd851271000 20 client.6003 trim_cache size 0 max 16384 2024-09-19T05:37:09.115 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-19T05:37:09.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 -- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8340678c0 msgr2=0x7fd834069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8340678c0 0x7fd834069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd84809c5f0 tx=0x7fd838008040 comp rx=0 tx=0).stop 2024-09-19T05:37:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 -- 172.21.15.67:0/325097561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8481592f0 msgr2=0x7fd848159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8481592f0 0x7fd848159770 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00e7f0 tx=0x7fd83c00ecb0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 -- 172.21.15.67:0/325097561 shutdown_connections 2024-09-19T05:37:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd8340678c0 0x7fd834069d80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84809ce90 0x7fd84809d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8481592f0 0x7fd848159770 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 --2- 172.21.15.67:0/325097561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8300051d0 0x7fd848155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 -- 172.21.15.67:0/325097561 >> 172.21.15.67:0/325097561 conn(0x7fd8480b1e50 msgr2=0x7fd848073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 -- 172.21.15.67:0/325097561 shutdown_connections 2024-09-19T05:37:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.097+0000 7fd84e1b5640 1 -- 172.21.15.67:0/325097561 wait complete. 2024-09-19T05:37:09.120 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4b.00000000 parent 2024-09-19T05:37:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 Processor -- start 2024-09-19T05:37:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- start start 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556baa801050 0x556baa8c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2170 0x556baa8ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556baa8d2a90 0x556baa8ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556baa846fb0 con 0x556baa8d2170 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556baa74e1b0 con 0x556baa8d2a90 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x556baa847130 con 0x556baa801050 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c1e53640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2170 0x556baa8ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c1e53640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2170 0x556baa8ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52892/0 (socket says 172.21.15.67:52892) 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c1e53640 1 -- 172.21.15.67:0/3459378319 learned_addr learned my addr 172.21.15.67:0/3459378319 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c2e55640 1 --2- 172.21.15.67:0/3459378319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556baa8d2a90 0x556baa8ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c1e53640 1 -- 172.21.15.67:0/3459378319 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556baa801050 msgr2=0x556baa8c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c1e53640 1 --2- 172.21.15.67:0/3459378319 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556baa801050 0x556baa8c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c1e53640 1 -- 172.21.15.67:0/3459378319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556baa8d2a90 msgr2=0x556baa8ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c1e53640 1 --2- 172.21.15.67:0/3459378319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556baa8d2a90 0x556baa8ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c1e53640 1 -- 172.21.15.67:0/3459378319 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556baa8d13d0 con 0x556baa8d2170 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c2e55640 1 --2- 172.21.15.67:0/3459378319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556baa8d2a90 0x556baa8ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c1e53640 1 --2- 172.21.15.67:0/3459378319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2170 0x556baa8ca440 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400a7e0 tx=0x7fc1b400aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8410055e6334c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c0e51640 1 -- 172.21.15.67:0/3459378319 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4008c00 con 0x556baa8d2170 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c0e51640 1 -- 172.21.15.67:0/3459378319 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b4008dc0 con 0x556baa8d2170 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c0e51640 1 -- 172.21.15.67:0/3459378319 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4013630 con 0x556baa8d2170 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- 172.21.15.67:0/3459378319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2170 msgr2=0x556baa8ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 --2- 172.21.15.67:0/3459378319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2170 0x556baa8ca440 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400a7e0 tx=0x7fc1b400aca0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- 172.21.15.67:0/3459378319 shutdown_connections 2024-09-19T05:37:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 --2- 172.21.15.67:0/3459378319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556baa8d2a90 0x556baa8ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 --2- 172.21.15.67:0/3459378319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2170 0x556baa8ca440 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 --2- 172.21.15.67:0/3459378319 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556baa801050 0x556baa8c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- 172.21.15.67:0/3459378319 >> 172.21.15.67:0/3459378319 conn(0x556baa82b130 msgr2=0x556baa82e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- 172.21.15.67:0/3459378319 shutdown_connections 2024-09-19T05:37:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- 172.21.15.67:0/3459378319 wait complete. 2024-09-19T05:37:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 Processor -- start 2024-09-19T05:37:09.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- start start 2024-09-19T05:37:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556baa801050 0x556baa829280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556baa8d2170 0x556baa8b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2a90 0x556baa8b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556baa8cf2e0 con 0x556baa8d2a90 2024-09-19T05:37:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.149+0000 7fc1c4b41080 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556baa8d1660 con 0x556baa8d2170 2024-09-19T05:37:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c4b41080 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x556baa8ca980 con 0x556baa801050 2024-09-19T05:37:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2e55640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2a90 0x556baa8b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2e55640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2a90 0x556baa8b7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52896/0 (socket says 172.21.15.67:52896) 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2e55640 1 -- 172.21.15.67:0/2267080181 learned_addr learned my addr 172.21.15.67:0/2267080181 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c1e53640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556baa8d2170 0x556baa8b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2654640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556baa801050 0x556baa829280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2e55640 1 -- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556baa801050 msgr2=0x556baa829280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2e55640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556baa801050 0x556baa829280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2e55640 1 -- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556baa8d2170 msgr2=0x556baa8b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2e55640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556baa8d2170 0x556baa8b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2e55640 1 -- 172.21.15.67:0/2267080181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556baa8b9f70 con 0x556baa8d2a90 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2654640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556baa801050 0x556baa829280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2e55640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2a90 0x556baa8b7be0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00c150 tx=0x7fc1bc00c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1bb7fe640 1 -- 172.21.15.67:0/2267080181 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc017070 con 0x556baa8d2a90 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1bb7fe640 1 -- 172.21.15.67:0/2267080181 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1bc0062e0 con 0x556baa8d2a90 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c4b41080 1 -- 172.21.15.67:0/2267080181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556baa8ba210 con 0x556baa8d2a90 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1bb7fe640 1 -- 172.21.15.67:0/2267080181 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc004730 con 0x556baa8d2a90 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c4b41080 1 -- 172.21.15.67:0/2267080181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556baa8ba750 con 0x556baa8d2a90 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1bb7fe640 1 -- 172.21.15.67:0/2267080181 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1bc01a070 con 0x556baa8d2a90 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1bb7fe640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1a40662d0 0x7fc1a4068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1bb7fe640 1 -- 172.21.15.67:0/2267080181 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fc1bc084190 con 0x556baa8d2a90 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c4b41080 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x556baa8297c0 0x556baa8b9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c4b41080 1 -- 172.21.15.67:0/2267080181 --> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] -- osd_op(unknown.0.0:1 8.24 8:256cebcc:::10000000a4b.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x556baa96b260 con 0x556baa8297c0 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2654640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1a40662d0 0x7fc1a4068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c1e53640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x556baa8297c0 0x556baa8b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.153+0000 7fc1c2654640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1a40662d0 0x7fc1a4068790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0ac000 tx=0x7fc1ac003030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c1e53640 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x556baa8297c0 0x556baa8b9770 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c1e53640 1 -- 172.21.15.67:0/2267080181 <== osd.6 v2:172.21.15.97:6800/2892447445 1 ==== osd_op_reply(1 10000000a4b.00000000 [rmxattr] v57'22 uv22 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc1b400a310 con 0x556baa8297c0 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c4b41080 1 -- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x556baa8297c0 msgr2=0x556baa8b9770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c4b41080 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x556baa8297c0 0x556baa8b9770 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c4b41080 1 -- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1a40662d0 msgr2=0x7fc1a4068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c4b41080 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1a40662d0 0x7fc1a4068790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0ac000 tx=0x7fc1ac003030 comp rx=0 tx=0).stop 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c4b41080 1 -- 172.21.15.67:0/2267080181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2a90 msgr2=0x556baa8b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c4b41080 1 --2- 172.21.15.67:0/2267080181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556baa8d2a90 0x556baa8b7be0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00c150 tx=0x7fc1bc00c610 comp rx=0 tx=0).stop 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c2e55640 1 -- 172.21.15.67:0/2267080181 reap_dead start 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c4b41080 1 -- 172.21.15.67:0/2267080181 shutdown_connections 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c4b41080 1 -- 172.21.15.67:0/2267080181 >> 172.21.15.67:0/2267080181 conn(0x556baa82b130 msgr2=0x556baa82f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c4b41080 1 -- 172.21.15.67:0/2267080181 shutdown_connections 2024-09-19T05:37:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.157+0000 7fc1c4b41080 1 -- 172.21.15.67:0/2267080181 wait complete. 2024-09-19T05:37:09.165 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-19T05:37:09.165 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-19T05:37:09.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f68687ad640 1 Processor -- start 2024-09-19T05:37:09.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f68687ad640 1 -- start start 2024-09-19T05:37:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f68687ad640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6860159c60 0x7f68600ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f68687ad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68600af3a0 0x7f686015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f68687ad640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686015a040 con 0x7f686006ffd0 2024-09-19T05:37:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f68687ad640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f686015d460 con 0x7f6860159c60 2024-09-19T05:37:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f68687ad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f686015c850 con 0x7f68600af3a0 2024-09-19T05:37:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f6866549640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6860159c60 0x7f68600ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f6865d48640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f686006ffd0 0x7f68600aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58618/0 (socket says 172.21.15.67:58618) 2024-09-19T05:37:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f6865d48640 1 -- 172.21.15.67:0/500747596 learned_addr learned my addr 172.21.15.67:0/500747596 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f6866d4a640 1 --2- 172.21.15.67:0/500747596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68600af3a0 0x7f686015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f6866549640 1 -- 172.21.15.67:0/500747596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68600af3a0 msgr2=0x7f686015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f6866549640 1 --2- 172.21.15.67:0/500747596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68600af3a0 0x7f686015fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f6866549640 1 -- 172.21.15.67:0/500747596 >> v1:172.21.15.67:6789/0 conn(0x7f686006ffd0 legacy=0x7f68600aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f6865547640 1 -- 172.21.15.67:0/500747596 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668615567 0 0) 0x7f686015a040 con 0x7f686006ffd0 2024-09-19T05:37:09.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.325+0000 7f6866549640 1 -- 172.21.15.67:0/500747596 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686015cb30 con 0x7f6860159c60 2024-09-19T05:37:09.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f6866549640 1 --2- 172.21.15.67:0/500747596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6860159c60 0x7f68600ad130 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f685c0097c0 tx=0x7f685c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f21b6d48066345 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f6865547640 1 -- 172.21.15.67:0/500747596 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b1070 con 0x7f6860159c60 2024-09-19T05:37:09.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f6865547640 1 -- 172.21.15.67:0/500747596 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c0a8050 con 0x7f6860159c60 2024-09-19T05:37:09.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f6865547640 1 -- 172.21.15.67:0/500747596 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0ac860 con 0x7f6860159c60 2024-09-19T05:37:09.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f68687ad640 1 -- 172.21.15.67:0/500747596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6860159c60 msgr2=0x7f68600ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f68687ad640 1 --2- 172.21.15.67:0/500747596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6860159c60 0x7f68600ad130 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f685c0097c0 tx=0x7f685c01c3e0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f68687ad640 1 -- 172.21.15.67:0/500747596 shutdown_connections 2024-09-19T05:37:09.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f68687ad640 1 --2- 172.21.15.67:0/500747596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68600af3a0 0x7f686015fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f68687ad640 1 --2- 172.21.15.67:0/500747596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6860159c60 0x7f68600ad130 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f68687ad640 1 -- 172.21.15.67:0/500747596 >> 172.21.15.67:0/500747596 conn(0x7f68600b1e50 msgr2=0x7f68600b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f68687ad640 1 -- 172.21.15.67:0/500747596 shutdown_connections 2024-09-19T05:37:09.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.329+0000 7f68687ad640 1 -- 172.21.15.67:0/500747596 wait complete. 2024-09-19T05:37:09.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f68687ad640 1 Processor -- start 2024-09-19T05:37:09.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f68687ad640 1 -- start start 2024-09-19T05:37:09.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f68687ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f686006ffd0 0x7f6860165a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f68687ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68600af3a0 0x7f6860072920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f68687ad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6860159c60 0x7f686014a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f68687ad640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6860168fb0 con 0x7f68600af3a0 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f68687ad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6860168e30 con 0x7f686006ffd0 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f68687ad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6860169130 con 0x7f6860159c60 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6865d48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68600af3a0 0x7f6860072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6865d48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68600af3a0 0x7f6860072920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52920/0 (socket says 172.21.15.67:52920) 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6865d48640 1 -- 172.21.15.67:0/2368154111 learned_addr learned my addr 172.21.15.67:0/2368154111 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6865d48640 1 -- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6860159c60 msgr2=0x7f686014a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6865d48640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6860159c60 0x7f686014a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6865d48640 1 -- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f686006ffd0 msgr2=0x7f6860165a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6865d48640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f686006ffd0 0x7f6860165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6865d48640 1 -- 172.21.15.67:0/2368154111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6860072e60 con 0x7f68600af3a0 2024-09-19T05:37:09.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6865d48640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68600af3a0 0x7f6860072920 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f68500011f0 tx=0x7f685000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6856ffd640 1 -- 172.21.15.67:0/2368154111 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6850018070 con 0x7f68600af3a0 2024-09-19T05:37:09.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6856ffd640 1 -- 172.21.15.67:0/2368154111 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68500074e0 con 0x7f68600af3a0 2024-09-19T05:37:09.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f68687ad640 1 -- 172.21.15.67:0/2368154111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68601fa890 con 0x7f68600af3a0 2024-09-19T05:37:09.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6856ffd640 1 -- 172.21.15.67:0/2368154111 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6850004a10 con 0x7f68600af3a0 2024-09-19T05:37:09.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f68687ad640 1 -- 172.21.15.67:0/2368154111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68601fae10 con 0x7f68600af3a0 2024-09-19T05:37:09.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.333+0000 7f6856ffd640 1 -- 172.21.15.67:0/2368154111 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f685001b070 con 0x7f68600af3a0 2024-09-19T05:37:09.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6856ffd640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f68440678c0 0x7f6844069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6856ffd640 1 -- 172.21.15.67:0/2368154111 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f68500850f0 con 0x7f68600af3a0 2024-09-19T05:37:09.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866549640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f68440678c0 0x7f6844069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 Processor -- start 2024-09-19T05:37:09.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 -- start start 2024-09-19T05:37:09.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866549640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f68440678c0 0x7f6844069d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f685c0ae000 tx=0x7f685c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f46ee40 0x56434f46f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46f760 0x56434f4226c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f422fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56434f272b50 con 0x56434f422c00 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56434f218370 con 0x56434f46ee40 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56434f26eb10 con 0x56434f46f760 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866d4a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f422fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866d4a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f422fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52926/0 (socket says 172.21.15.67:52926) 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866d4a640 1 -- 172.21.15.67:0/553716029 learned_addr learned my addr 172.21.15.67:0/553716029 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866549640 1 --2- 172.21.15.67:0/553716029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f46ee40 0x56434f46f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6865d48640 1 --2- 172.21.15.67:0/553716029 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46f760 0x56434f4226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866d4a640 1 -- 172.21.15.67:0/553716029 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46f760 msgr2=0x56434f4226c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866d4a640 1 --2- 172.21.15.67:0/553716029 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46f760 0x56434f4226c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866d4a640 1 -- 172.21.15.67:0/553716029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f46ee40 msgr2=0x56434f46f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866d4a640 1 --2- 172.21.15.67:0/553716029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f46ee40 0x56434f46f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866d4a640 1 -- 172.21.15.67:0/553716029 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56434f27b7c0 con 0x56434f422c00 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866549640 1 --2- 172.21.15.67:0/553716029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f46ee40 0x56434f46f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6866d4a640 1 --2- 172.21.15.67:0/553716029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f422fe0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f685800e270 tx=0x7f685800e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f453efd79415619 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6843fff640 1 -- 172.21.15.67:0/553716029 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858018020 con 0x56434f422c00 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6843fff640 1 -- 172.21.15.67:0/553716029 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6858014890 con 0x56434f422c00 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f6843fff640 1 -- 172.21.15.67:0/553716029 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858014c80 con 0x56434f422c00 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 -- 172.21.15.67:0/553716029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 msgr2=0x56434f422fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 --2- 172.21.15.67:0/553716029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f422fe0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f685800e270 tx=0x7f685800e730 comp rx=0 tx=0).stop 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 -- 172.21.15.67:0/553716029 shutdown_connections 2024-09-19T05:37:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 --2- 172.21.15.67:0/553716029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f422fe0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 --2- 172.21.15.67:0/553716029 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46f760 0x56434f4226c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 --2- 172.21.15.67:0/553716029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f46ee40 0x56434f46f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 -- 172.21.15.67:0/553716029 >> 172.21.15.67:0/553716029 conn(0x56434f44fbe0 msgr2=0x56434f451fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 -- 172.21.15.67:0/553716029 shutdown_connections 2024-09-19T05:37:09.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.337+0000 7f686b869000 1 -- 172.21.15.67:0/553716029 wait complete. 2024-09-19T05:37:09.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- start start 2024-09-19T05:37:09.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 Processor -- start 2024-09-19T05:37:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f422c00 0x56434f44ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 0x56434f44f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46f760 0x56434f439870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56434f271e60 con 0x56434f46f760 2024-09-19T05:37:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56434f20c650 con 0x56434f422c00 2024-09-19T05:37:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56434f2eff10 con 0x56434f46ee40 2024-09-19T05:37:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 10 client.0 _ll_register_callbacks cb 0x56434f4100f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866d4a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46f760 0x56434f439870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866d4a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46f760 0x56434f439870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52938/0 (socket says 172.21.15.67:52938) 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866d4a640 1 -- 172.21.15.67:0/2181053345 learned_addr learned my addr 172.21.15.67:0/2181053345 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6865d48640 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 0x56434f44f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866549640 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f422c00 0x56434f44ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866d4a640 1 -- 172.21.15.67:0/2181053345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 msgr2=0x56434f44f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866d4a640 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 0x56434f44f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866d4a640 1 -- 172.21.15.67:0/2181053345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f422c00 msgr2=0x56434f44ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866d4a640 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f422c00 0x56434f44ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866d4a640 1 -- 172.21.15.67:0/2181053345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56434f235eb0 con 0x56434f46f760 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866d4a640 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46f760 0x56434f439870 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f685800e770 tx=0x7f6858009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26980a78754f5b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f68417fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f68417fa640 1 -- 172.21.15.67:0/2181053345 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858004040 con 0x56434f46f760 2024-09-19T05:37:09.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f68417fa640 1 -- 172.21.15.67:0/2181053345 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f68580041e0 con 0x56434f46f760 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- 172.21.15.67:0/2181053345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6858014890 con 0x56434f46f760 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f68417fa640 1 -- 172.21.15.67:0/2181053345 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6858031050 con 0x56434f46f760 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 10 client.6030 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- 172.21.15.67:0/2181053345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x56434f218590 con 0x56434f46f760 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f68417fa640 1 -- 172.21.15.67:0/2181053345 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6858014890 con 0x56434f46f760 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f68417fa640 1 -- 172.21.15.67:0/2181053345 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f6858034020 con 0x56434f46f760 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 10 client.6030 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 10 client.6030 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 20 client.6030 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56434f43a610 0x56434f43a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 4 client.6030 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- 172.21.15.67:0/2181053345 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56434f20cd30 con 0x56434f43a610 2024-09-19T05:37:09.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866549640 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56434f43a610 0x56434f43a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f6866549640 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56434f43a610 0x56434f43a9f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ae1ab2cbfd5ec6c server_cookie=59cf009563240e6f in_seq=0 out_seq=0 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f68417fa640 10 client.6030 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f68417fa640 1 -- 172.21.15.67:0/2181053345 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56434f20cd30 con 0x56434f43a610 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f68417fa640 10 client.6030 handle_command_reply: tid=0 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 client.6030 shutdown 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- 172.21.15.67:0/2181053345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46f760 msgr2=0x56434f439870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46f760 0x56434f439870 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f685800e770 tx=0x7f6858009750 comp rx=0 tx=0).stop 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- 172.21.15.67:0/2181053345 shutdown_connections 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46f760 0x56434f439870 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 0x56434f44f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56434f43a610 0x56434f43a9f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 --2- 172.21.15.67:0/2181053345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f422c00 0x56434f44ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- 172.21.15.67:0/2181053345 >> 172.21.15.67:0/2181053345 conn(0x56434f44fbe0 msgr2=0x56434f451fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f68417fa640 0 client.6030 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- 172.21.15.67:0/2181053345 shutdown_connections 2024-09-19T05:37:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.341+0000 7f686b869000 1 -- 172.21.15.67:0/2181053345 wait complete. 2024-09-19T05:37:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.345+0000 7f686b869000 20 client.6030 trim_cache size 0 max 16384 2024-09-19T05:37:09.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f686b869000 1 Processor -- start 2024-09-19T05:37:09.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f686b869000 1 -- start start 2024-09-19T05:37:09.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f686b869000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f44fbe0 0x56434f4de6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f686b869000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f422c00 0x56434f4dec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f686b869000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46ee40 0x56434f4df140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f686b869000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6860204270 con 0x56434f46ee40 2024-09-19T05:37:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f686b869000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f68602032b0 con 0x56434f422c00 2024-09-19T05:37:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f686b869000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f686015ea80 con 0x56434f44fbe0 2024-09-19T05:37:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f6866d4a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46ee40 0x56434f4df140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f6866d4a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46ee40 0x56434f4df140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52942/0 (socket says 172.21.15.67:52942) 2024-09-19T05:37:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f6866d4a640 1 -- 172.21.15.67:0/4069063734 learned_addr learned my addr 172.21.15.67:0/4069063734 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f6866d4a640 1 -- 172.21.15.67:0/4069063734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f44fbe0 msgr2=0x56434f4de6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f6866d4a640 1 --2- 172.21.15.67:0/4069063734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f44fbe0 0x56434f4de6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f6865d48640 1 --2- 172.21.15.67:0/4069063734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f422c00 0x56434f4dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f6866d4a640 1 -- 172.21.15.67:0/4069063734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f422c00 msgr2=0x56434f4dec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f6866d4a640 1 --2- 172.21.15.67:0/4069063734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f422c00 0x56434f4dec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f6866d4a640 1 -- 172.21.15.67:0/4069063734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56434f2f03a0 con 0x56434f46ee40 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f6866d4a640 1 --2- 172.21.15.67:0/4069063734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46ee40 0x56434f4df140 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f68580095c0 tx=0x7f6858020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fff94926912cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f68437fe640 1 -- 172.21.15.67:0/4069063734 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685802e070 con 0x56434f46ee40 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f68437fe640 1 -- 172.21.15.67:0/4069063734 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6858014890 con 0x56434f46ee40 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.361+0000 7f68437fe640 1 -- 172.21.15.67:0/4069063734 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858018040 con 0x56434f46ee40 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- 172.21.15.67:0/4069063734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46ee40 msgr2=0x56434f4df140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 --2- 172.21.15.67:0/4069063734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46ee40 0x56434f4df140 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f68580095c0 tx=0x7f6858020070 comp rx=0 tx=0).stop 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- 172.21.15.67:0/4069063734 shutdown_connections 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 --2- 172.21.15.67:0/4069063734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f46ee40 0x56434f4df140 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 --2- 172.21.15.67:0/4069063734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f422c00 0x56434f4dec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 --2- 172.21.15.67:0/4069063734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f44fbe0 0x56434f4de6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- 172.21.15.67:0/4069063734 >> 172.21.15.67:0/4069063734 conn(0x56434f42aee0 msgr2=0x56434f4800f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- 172.21.15.67:0/4069063734 shutdown_connections 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- 172.21.15.67:0/4069063734 wait complete. 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- start start 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 Processor -- start 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f485120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f44fbe0 0x56434f485660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 0x56434f49dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56434f21ebe0 con 0x56434f422c00 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6860202c60 con 0x56434f44fbe0 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56434f1f7dc0 con 0x56434f46ee40 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 10 client.0 _ll_register_callbacks cb 0x7f685800e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866549640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f485120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866549640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f485120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52946/0 (socket says 172.21.15.67:52946) 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866549640 1 -- 172.21.15.67:0/1490205728 learned_addr learned my addr 172.21.15.67:0/1490205728 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6865d48640 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f44fbe0 0x56434f485660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866d4a640 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 0x56434f49dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866549640 1 -- 172.21.15.67:0/1490205728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 msgr2=0x56434f49dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866549640 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 0x56434f49dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866549640 1 -- 172.21.15.67:0/1490205728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f44fbe0 msgr2=0x56434f485660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866549640 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f44fbe0 0x56434f485660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866549640 1 -- 172.21.15.67:0/1490205728 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56434f2cbe20 con 0x56434f422c00 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866d4a640 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 0x56434f49dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6865d48640 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f44fbe0 0x56434f485660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6866549640 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f485120 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f685c01a010 tx=0x7f685c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df21b39e3eab7caf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f68417fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f68417fa640 1 -- 172.21.15.67:0/1490205728 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0d3060 con 0x56434f422c00 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f68417fa640 1 -- 172.21.15.67:0/1490205728 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f685c0b77a0 con 0x56434f422c00 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- 172.21.15.67:0/1490205728 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6858014890 con 0x56434f422c00 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f68417fa640 1 -- 172.21.15.67:0/1490205728 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f685c0d9050 con 0x56434f422c00 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 10 client.6036 fetch_fsmap learned FSMap version 25 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- 172.21.15.67:0/1490205728 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x56434f20a910 con 0x56434f422c00 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f68417fa640 1 -- 172.21.15.67:0/1490205728 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6858014890 con 0x56434f422c00 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f68417fa640 1 -- 172.21.15.67:0/1490205728 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f685c0dc020 con 0x56434f422c00 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 10 client.6036 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 10 client.6036 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 20 client.6036 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56434f46f760 0x56434f4e2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 4 client.6036 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f686b869000 1 -- 172.21.15.67:0/1490205728 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x56434f280280 con 0x56434f46f760 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.365+0000 7f6865d48640 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56434f46f760 0x56434f4e2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68417fa640 10 client.6036 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f6865d48640 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56434f46f760 0x56434f4e2140 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=536350b06d0100a7 server_cookie=5f62f3bc3555526e in_seq=0 out_seq=0 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68417fa640 1 -- 172.21.15.67:0/1490205728 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56434f280280 con 0x56434f46f760 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68417fa640 10 client.6036 handle_command_reply: tid=0 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 client.6036 shutdown 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 -- 172.21.15.67:0/1490205728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 msgr2=0x56434f485120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f485120 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f685c01a010 tx=0x7f685c019180 comp rx=0 tx=0).stop 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 -- 172.21.15.67:0/1490205728 shutdown_connections 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56434f46ee40 0x56434f49dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x56434f46f760 0x56434f4e2140 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56434f44fbe0 0x56434f485660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 --2- 172.21.15.67:0/1490205728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56434f422c00 0x56434f485120 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 -- 172.21.15.67:0/1490205728 >> 172.21.15.67:0/1490205728 conn(0x56434f42aee0 msgr2=0x56434f421e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68417fa640 0 client.6036 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 -- 172.21.15.67:0/1490205728 shutdown_connections 2024-09-19T05:37:09.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 1 -- 172.21.15.67:0/1490205728 wait complete. 2024-09-19T05:37:09.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f686b869000 20 client.6036 trim_cache size 0 max 16384 2024-09-19T05:37:09.383 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:09.383 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:37:09.383 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "cca21e90-bd59-41cc-8ecb-f8e999371c2b", 2024-09-19T05:37:09.383 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:37:09.384 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:09.384 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f5fda2c3640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4b [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v791 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5529=0-4194304@1} caps={5529=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5529 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x5593690c6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a4b:[<0x10000000001/new_file_1 v791>,<0x10000000000/ceph-qa-suite v98>,<0x1/scrub_test_path v47>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-19T05:37:09.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 -- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f68440678c0 msgr2=0x7f6844069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f68440678c0 0x7f6844069d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f685c0ae000 tx=0x7f685c008040 comp rx=0 tx=0).stop 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 -- 172.21.15.67:0/2368154111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68600af3a0 msgr2=0x7f6860072920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68600af3a0 0x7f6860072920 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f68500011f0 tx=0x7f685000c9b0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 -- 172.21.15.67:0/2368154111 shutdown_connections 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f68440678c0 0x7f6844069d80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6860159c60 0x7f686014a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68600af3a0 0x7f6860072920 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 --2- 172.21.15.67:0/2368154111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f686006ffd0 0x7f6860165a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 -- 172.21.15.67:0/2368154111 >> 172.21.15.67:0/2368154111 conn(0x7f68600b1e50 msgr2=0x7f686006eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 -- 172.21.15.67:0/2368154111 shutdown_connections 2024-09-19T05:37:09.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.369+0000 7f68687ad640 1 -- 172.21.15.67:0/2368154111 wait complete. 2024-09-19T05:37:09.391 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': 'cca21e90-bd59-41cc-8ecb-f8e999371c2b', 'mode': 'asynchronous'}' 2024-09-19T05:37:09.391 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-19T05:37:09.391 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-19T05:37:09.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.505+0000 7fd9f0ff8640 1 Processor -- start 2024-09-19T05:37:09.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.505+0000 7fd9f0ff8640 1 -- start start 2024-09-19T05:37:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9f0ff8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9ec070070 0x7fd9ec165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9f0ff8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9ec0aef30 con 0x7fd9ec15b1d0 2024-09-19T05:37:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9f0ff8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9ec0ae3b0 con 0x7fd9ec06dfc0 2024-09-19T05:37:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9f0ff8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ec072210 con 0x7fd9ec070070 2024-09-19T05:37:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9ea59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd9ec15b1d0 0x7fd9ec0adbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58620/0 (socket says 172.21.15.67:58620) 2024-09-19T05:37:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9ea59c640 1 -- 172.21.15.67:0/818706618 learned_addr learned my addr 172.21.15.67:0/818706618 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:09.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9ec070070 0x7fd9ec165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720862565 0 0) 0x7fd9ec0aef30 con 0x7fd9ec15b1d0 2024-09-19T05:37:09.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9d8003430 con 0x7fd9ec15b1d0 2024-09-19T05:37:09.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1111653629 0 0) 0x7fd9d8003430 con 0x7fd9ec15b1d0 2024-09-19T05:37:09.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9ec070070 msgr2=0x7fd9ec165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9ec070070 0x7fd9ec165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 >> v1:172.21.15.97:6789/0 conn(0x7fd9ec06dfc0 legacy=0x7fd9ec06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ec0ae690 con 0x7fd9ec15b1d0 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fd9dc001680 con 0x7fd9ec15b1d0 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 >> v1:172.21.15.67:6789/0 conn(0x7fd9ec15b1d0 legacy=0x7fd9ec0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9d8004ad0 0x7fd9d8004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9d80036b0 0x7fd9d8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9ec070070 0x7fd9d800fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec072210 con 0x7fd9d80036b0 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d80044e0 con 0x7fd9d8004ad0 2024-09-19T05:37:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d80100f0 con 0x7fd9ec070070 2024-09-19T05:37:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9d80036b0 0x7fd9d8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9d8004ad0 0x7fd9d8004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9ec070070 0x7fd9d800fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e3fff640 1 -- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9ec070070 msgr2=0x7fd9d800fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9ec070070 0x7fd9d800fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e3fff640 1 -- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9d8004ad0 msgr2=0x7fd9d8004ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9d8004ad0 0x7fd9d8004ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.509+0000 7fd9e3fff640 1 -- 172.21.15.67:0/818706618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d8003430 con 0x7fd9d80036b0 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9d80036b0 0x7fd9d8003b30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4001780 tx=0x7fd9d401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58188932054d9f6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40013a0 con 0x7fd9d80036b0 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d40a9070 con 0x7fd9d80036b0 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9e9d9b640 1 -- 172.21.15.67:0/818706618 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4003600 con 0x7fd9d80036b0 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/818706618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9d80036b0 msgr2=0x7fd9d8003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 --2- 172.21.15.67:0/818706618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9d80036b0 0x7fd9d8003b30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4001780 tx=0x7fd9d401c3c0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9ead9d640 1 -- 172.21.15.67:0/818706618 reap_dead start 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/818706618 shutdown_connections 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/818706618 >> 172.21.15.67:0/818706618 conn(0x7fd9ec0b1e50 msgr2=0x7fd9ec0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/818706618 shutdown_connections 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/818706618 wait complete. 2024-09-19T05:37:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 Processor -- start 2024-09-19T05:37:09.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 -- start start 2024-09-19T05:37:09.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9d80036b0 0x7fd9ec1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ec14eef0 0x7fd9ec14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9ec14e2e0 0x7fd9ec14e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec072420 con 0x7fd9ec14e2e0 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec0aec50 con 0x7fd9ec14eef0 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9f0ff8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ec0b4440 con 0x7fd9d80036b0 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9ead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9ec14e2e0 0x7fd9ec14e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9ead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9ec14e2e0 0x7fd9ec14e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52964/0 (socket says 172.21.15.67:52964) 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9ead9d640 1 -- 172.21.15.67:0/2682387805 learned_addr learned my addr 172.21.15.67:0/2682387805 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9d80036b0 0x7fd9ec1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ec14eef0 0x7fd9ec14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9ead9d640 1 -- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9d80036b0 msgr2=0x7fd9ec1548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9d80036b0 0x7fd9ec1548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9ead9d640 1 -- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ec14eef0 msgr2=0x7fd9ec14b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ec14eef0 0x7fd9ec14b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.513+0000 7fd9ead9d640 1 -- 172.21.15.67:0/2682387805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ec14f3b0 con 0x7fd9ec14e2e0 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9ec14e2e0 0x7fd9ec14e770 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0741b0 tx=0x7fd9e40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9e2ffd640 1 -- 172.21.15.67:0/2682387805 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e40039a0 con 0x7fd9ec14e2e0 2024-09-19T05:37:09.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9e2ffd640 1 -- 172.21.15.67:0/2682387805 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e401b070 con 0x7fd9ec14e2e0 2024-09-19T05:37:09.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9e2ffd640 1 -- 172.21.15.67:0/2682387805 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4003b80 con 0x7fd9ec14e2e0 2024-09-19T05:37:09.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/2682387805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ec151ae0 con 0x7fd9ec14e2e0 2024-09-19T05:37:09.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/2682387805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ec1520a0 con 0x7fd9ec14e2e0 2024-09-19T05:37:09.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9e2ffd640 1 -- 172.21.15.67:0/2682387805 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd9e4004030 con 0x7fd9ec14e2e0 2024-09-19T05:37:09.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9e2ffd640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd9cc0678f0 0x7fd9cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9e2ffd640 1 -- 172.21.15.67:0/2682387805 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd9e40867d0 con 0x7fd9ec14e2e0 2024-09-19T05:37:09.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd9cc0678f0 0x7fd9cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9f40b4000 1 Processor -- start 2024-09-19T05:37:09.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9f40b4000 1 -- start start 2024-09-19T05:37:09.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.517+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd9cc0678f0 0x7fd9cc069db0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0017c0 tx=0x7fd9dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb4fd70 0x5620feb50150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb03870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb03db0 0x5620feb04190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5620fe9ed960 con 0x5620feb50690 2024-09-19T05:37:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5620fe931900 con 0x5620feb03db0 2024-09-19T05:37:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5620fe954d40 con 0x5620feb4fd70 2024-09-19T05:37:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb03870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb03870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52972/0 (socket says 172.21.15.67:52972) 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 -- 172.21.15.67:0/2908702022 learned_addr learned my addr 172.21.15.67:0/2908702022 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/2908702022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb4fd70 0x5620feb50150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/2908702022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb03db0 0x5620feb04190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 -- 172.21.15.67:0/2908702022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb4fd70 msgr2=0x5620feb50150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/2908702022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb4fd70 0x5620feb50150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 -- 172.21.15.67:0/2908702022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb03db0 msgr2=0x5620feb04190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/2908702022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb03db0 0x5620feb04190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 -- 172.21.15.67:0/2908702022 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620fe8fb580 con 0x5620feb50690 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/2908702022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb03870 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd9d401c1f0 tx=0x7fd9d4001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47d14882dac4da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9cbfff640 1 -- 172.21.15.67:0/2908702022 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40b2040 con 0x5620feb50690 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9cbfff640 1 -- 172.21.15.67:0/2908702022 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d40bd070 con 0x5620feb50690 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9cbfff640 1 -- 172.21.15.67:0/2908702022 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4007040 con 0x5620feb50690 2024-09-19T05:37:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- 172.21.15.67:0/2908702022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 msgr2=0x5620feb03870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/2908702022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb03870 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd9d401c1f0 tx=0x7fd9d4001130 comp rx=0 tx=0).stop 2024-09-19T05:37:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- 172.21.15.67:0/2908702022 shutdown_connections 2024-09-19T05:37:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/2908702022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb03db0 0x5620feb04190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/2908702022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb03870 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/2908702022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb4fd70 0x5620feb50150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- 172.21.15.67:0/2908702022 >> 172.21.15.67:0/2908702022 conn(0x5620feb31040 msgr2=0x5620feb33430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- 172.21.15.67:0/2908702022 shutdown_connections 2024-09-19T05:37:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- 172.21.15.67:0/2908702022 wait complete. 2024-09-19T05:37:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- start start 2024-09-19T05:37:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 Processor -- start 2024-09-19T05:37:09.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb03db0 0x5620feb56ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 0x5620feb57220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb50690 0x5620feb57760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5620fe950d00 con 0x5620feb03db0 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5620fe90faa0 con 0x5620feb4fd70 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5620fe8ee340 con 0x5620feb50690 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9f40b4000 10 client.0 _ll_register_callbacks cb 0x5620feaf1760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ea59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb03db0 0x5620feb56ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ea59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb03db0 0x5620feb56ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52988/0 (socket says 172.21.15.67:52988) 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ea59c640 1 -- 172.21.15.67:0/934994551 learned_addr learned my addr 172.21.15.67:0/934994551 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb50690 0x5620feb57760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 0x5620feb57220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ea59c640 1 -- 172.21.15.67:0/934994551 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb50690 msgr2=0x5620feb57760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb50690 0x5620feb57760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ea59c640 1 -- 172.21.15.67:0/934994551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 msgr2=0x5620feb57220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 0x5620feb57220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ea59c640 1 -- 172.21.15.67:0/934994551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620fe8f7dc0 con 0x5620feb03db0 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 0x5620feb57220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.521+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb50690 0x5620feb57760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb03db0 0x5620feb56ce0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc014de0 tx=0x7fd9ec0ae860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a23947c8345606c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9c97fa640 1 -- 172.21.15.67:0/934994551 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc025440 con 0x5620feb03db0 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9c97fa640 1 -- 172.21.15.67:0/934994551 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd9dc00fa30 con 0x5620feb03db0 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 -- 172.21.15.67:0/934994551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9d40bd070 con 0x5620feb03db0 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9c97fa640 1 -- 172.21.15.67:0/934994551 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd9dc00fc30 con 0x5620feb03db0 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 10 client.6048 fetch_fsmap learned FSMap version 26 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 -- 172.21.15.67:0/934994551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5620fe8f47f0 con 0x5620feb03db0 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9c97fa640 1 -- 172.21.15.67:0/934994551 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d40bd070 con 0x5620feb03db0 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9c97fa640 1 -- 172.21.15.67:0/934994551 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fd9dc00f210 con 0x5620feb03db0 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 10 client.6048 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T05:37:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 10 client.6048 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 20 client.6048 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5620feb5f0b0 0x5620feb614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 4 client.6048 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 -- 172.21.15.67:0/934994551 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620fe8eee10 con 0x5620feb5f0b0 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5620feb5f0b0 0x5620feb614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9c97fa640 10 client.6048 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5620feb5f0b0 0x5620feb614a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4948a3155aaa10 server_cookie=cbe5318ab89d932b in_seq=0 out_seq=0 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9c97fa640 1 -- 172.21.15.67:0/934994551 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620fe8eee10 con 0x5620feb5f0b0 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9c97fa640 10 client.6048 handle_command_reply: tid=0 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 client.6048 shutdown 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 -- 172.21.15.67:0/934994551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb03db0 msgr2=0x5620feb56ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb03db0 0x5620feb56ce0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc014de0 tx=0x7fd9ec0ae860 comp rx=0 tx=0).stop 2024-09-19T05:37:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 -- 172.21.15.67:0/934994551 shutdown_connections 2024-09-19T05:37:09.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb50690 0x5620feb57760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5620feb5f0b0 0x5620feb614a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 0x5620feb57220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/934994551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb03db0 0x5620feb56ce0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 -- 172.21.15.67:0/934994551 >> 172.21.15.67:0/934994551 conn(0x5620feb31040 msgr2=0x5620feb02f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9c97fa640 0 client.6048 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 -- 172.21.15.67:0/934994551 shutdown_connections 2024-09-19T05:37:09.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 1 -- 172.21.15.67:0/934994551 wait complete. 2024-09-19T05:37:09.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.525+0000 7fd9f40b4000 20 client.6048 trim_cache size 0 max 16384 2024-09-19T05:37:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 Processor -- start 2024-09-19T05:37:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- start start 2024-09-19T05:37:09.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb03db0 0x5620feb64510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb4fd70 0x5620feb0bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb0c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1fd4e0 con 0x5620feb50690 2024-09-19T05:37:09.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1fc520 con 0x5620feb03db0 2024-09-19T05:37:09.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ec1fb8b0 con 0x5620feb4fd70 2024-09-19T05:37:09.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9ead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb0c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9ead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb0c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53004/0 (socket says 172.21.15.67:53004) 2024-09-19T05:37:09.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9ead9d640 1 -- 172.21.15.67:0/1015674388 learned_addr learned my addr 172.21.15.67:0/1015674388 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9ead9d640 1 -- 172.21.15.67:0/1015674388 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb4fd70 msgr2=0x5620feb0bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/1015674388 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb4fd70 0x5620feb0bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9ead9d640 1 -- 172.21.15.67:0/1015674388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb03db0 msgr2=0x5620feb64510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/1015674388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb03db0 0x5620feb64510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9ead9d640 1 -- 172.21.15.67:0/1015674388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620fe912470 con 0x5620feb50690 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/1015674388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb0c140 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd9e405f060 tx=0x7fd9e4086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e635f6c9a8e63105 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9cb7fe640 1 -- 172.21.15.67:0/1015674388 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4083070 con 0x5620feb50690 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9cb7fe640 1 -- 172.21.15.67:0/1015674388 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e405ad60 con 0x5620feb50690 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9cb7fe640 1 -- 172.21.15.67:0/1015674388 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e405f590 con 0x5620feb50690 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1015674388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 msgr2=0x5620feb0c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/1015674388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb0c140 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd9e405f060 tx=0x7fd9e4086040 comp rx=0 tx=0).stop 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1015674388 shutdown_connections 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/1015674388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb0c140 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/1015674388 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb4fd70 0x5620feb0bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/1015674388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb03db0 0x5620feb64510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1015674388 >> 172.21.15.67:0/1015674388 conn(0x5620feb31040 msgr2=0x5620feb5cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1015674388 shutdown_connections 2024-09-19T05:37:09.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1015674388 wait complete. 2024-09-19T05:37:09.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- start start 2024-09-19T05:37:09.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 Processor -- start 2024-09-19T05:37:09.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb03db0 0x5620febc3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 0x5620febc3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb63400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5620fe950d00 con 0x5620feb50690 2024-09-19T05:37:09.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1fbf00 con 0x5620feb4fd70 2024-09-19T05:37:09.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5620fe959370 con 0x5620feb03db0 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.545+0000 7fd9f40b4000 10 client.0 _ll_register_callbacks cb 0x7fd9dc014a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb63400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb63400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53012/0 (socket says 172.21.15.67:53012) 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ead9d640 1 -- 172.21.15.67:0/1361354246 learned_addr learned my addr 172.21.15.67:0/1361354246 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb03db0 0x5620febc3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 0x5620febc3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ead9d640 1 -- 172.21.15.67:0/1361354246 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb03db0 msgr2=0x5620febc3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb03db0 0x5620febc3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ead9d640 1 -- 172.21.15.67:0/1361354246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 msgr2=0x5620febc3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 0x5620febc3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ead9d640 1 -- 172.21.15.67:0/1361354246 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620fe8e8640 con 0x5620feb50690 2024-09-19T05:37:09.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb03db0 0x5620febc3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:09.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9e3fff640 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 0x5620febc3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:09.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ead9d640 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb63400 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd9e405d010 tx=0x7fd9e4059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9739b1904047a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:09.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:09.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9c97fa640 1 -- 172.21.15.67:0/1361354246 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4083070 con 0x5620feb50690 2024-09-19T05:37:09.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9c97fa640 1 -- 172.21.15.67:0/1361354246 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd9e405d0b0 con 0x5620feb50690 2024-09-19T05:37:09.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1361354246 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9e405ad60 con 0x5620feb50690 2024-09-19T05:37:09.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9c97fa640 1 -- 172.21.15.67:0/1361354246 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd9e4056c10 con 0x5620feb50690 2024-09-19T05:37:09.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 10 client.6054 fetch_fsmap learned FSMap version 26 2024-09-19T05:37:09.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1361354246 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5620fe8ec3b0 con 0x5620feb50690 2024-09-19T05:37:09.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9c97fa640 1 -- 172.21.15.67:0/1361354246 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e405ad60 con 0x5620feb50690 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9c97fa640 1 -- 172.21.15.67:0/1361354246 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fd9e4057ce0 con 0x5620feb50690 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 10 client.6054 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 10 client.6054 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 20 client.6054 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5620feb63940 0x5620feb63d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 4 client.6054 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1361354246 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5620fe962470 con 0x5620feb63940 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5620feb63940 0x5620feb63d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9ea59c640 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5620feb63940 0x5620feb63d50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1191cd20301cfeec server_cookie=aa3866cd90eb9bb2 in_seq=0 out_seq=0 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9c97fa640 10 client.6054 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9c97fa640 1 -- 172.21.15.67:0/1361354246 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+903 (crc 0 0 0) 0x5620fe962470 con 0x5620feb63940 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9c97fa640 10 client.6054 handle_command_reply: tid=0 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 client.6054 shutdown 2024-09-19T05:37:09.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1361354246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 msgr2=0x5620feb63400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb63400 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd9e405d010 tx=0x7fd9e4059040 comp rx=0 tx=0).stop 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1361354246 shutdown_connections 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5620feb50690 0x5620feb63400 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5620feb63940 0x5620feb63d50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5620feb4fd70 0x5620febc3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 --2- 172.21.15.67:0/1361354246 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5620feb03db0 0x5620febc3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1361354246 >> 172.21.15.67:0/1361354246 conn(0x5620feb31040 msgr2=0x5620feb5d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9c97fa640 0 client.6054 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1361354246 shutdown_connections 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 1 -- 172.21.15.67:0/1361354246 wait complete. 2024-09-19T05:37:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f40b4000 20 client.6054 trim_cache size 0 max 16384 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout: "ae527f3a-fb23-4d9c-bb5a-69154b0cc5c1": { 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "ae527f3a-fb23-4d9c-bb5a-69154b0cc5c1", 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "" 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout: "cca21e90-bd59-41cc-8ecb-f8e999371c2b": { 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-19T05:37:09.561 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "cca21e90-bd59-41cc-8ecb-f8e999371c2b", 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "" 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: "e2d7cc2e-187b-4d8c-9fb8-20b9d9d306b5": { 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "e2d7cc2e-187b-4d8c-9fb8-20b9d9d306b5", 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "" 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: "f90df012-6ae8-4ad4-8c00-1da258f82d0f": { 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "f90df012-6ae8-4ad4-8c00-1da258f82d0f", 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "" 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:09.562 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:09.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd9cc0678f0 msgr2=0x7fd9cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd9cc0678f0 0x7fd9cc069db0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0017c0 tx=0x7fd9dc009040 comp rx=0 tx=0).stop 2024-09-19T05:37:09.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/2682387805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9ec14e2e0 msgr2=0x7fd9ec14e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:09.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9ec14e2e0 0x7fd9ec14e770 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0741b0 tx=0x7fd9e40115a0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/2682387805 shutdown_connections 2024-09-19T05:37:09.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9ec14e2e0 0x7fd9ec14e770 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ec14eef0 0x7fd9ec14b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd9cc0678f0 0x7fd9cc069db0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 --2- 172.21.15.67:0/2682387805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9d80036b0 0x7fd9ec1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:09.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/2682387805 >> 172.21.15.67:0/2682387805 conn(0x7fd9ec0b1e50 msgr2=0x7fd9ec0b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:09.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/2682387805 shutdown_connections 2024-09-19T05:37:09.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:09.549+0000 7fd9f0ff8640 1 -- 172.21.15.67:0/2682387805 wait complete. 2024-09-19T05:37:13.393 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:37:13.389+0000 7fcbf1c5f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T05:37:14.572 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-19T05:37:14.572 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-19T05:37:14.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.705+0000 7f0fbe104640 1 Processor -- start 2024-09-19T05:37:14.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fbe104640 1 -- start start 2024-09-19T05:37:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fbe104640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb815b1d0 0x7f0fb80adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fbe104640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0fb806dfc0 0x7f0fb806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fbe104640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0fb806fea0 0x7f0fb815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fbe104640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0fb8072210 con 0x7f0fb806dfc0 2024-09-19T05:37:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fbe104640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0fb80aef30 con 0x7f0fb806fea0 2024-09-19T05:37:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fbe104640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb80ae0f0 con 0x7f0fb815b1d0 2024-09-19T05:37:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb6ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0fb806dfc0 0x7f0fb806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb6ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0fb806dfc0 0x7f0fb806f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53024/0 (socket says 172.21.15.67:53024) 2024-09-19T05:37:14.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb6ffd640 1 -- 172.21.15.67:0/2620666622 learned_addr learned my addr 172.21.15.67:0/2620666622 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/2620666622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb815b1d0 0x7f0fb80adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/2620666622 >> v2:172.21.15.97:3300/0 conn(0x7f0fb806fea0 0x7f0fb815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb6ffd640 1 -- 172.21.15.67:0/2620666622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb815b1d0 msgr2=0x7f0fb80adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/2620666622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb815b1d0 0x7f0fb80adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb6ffd640 1 -- 172.21.15.67:0/2620666622 >> v2:172.21.15.97:3300/0 conn(0x7f0fb806fea0 msgr2=0x7f0fb815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/2620666622 >> v2:172.21.15.97:3300/0 conn(0x7f0fb806fea0 0x7f0fb815ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb6ffd640 1 -- 172.21.15.67:0/2620666622 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb80ae3b0 con 0x7f0fb806dfc0 2024-09-19T05:37:14.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.709+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/2620666622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb806dfc0 0x7f0fb806f960 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8071a40 tx=0x7f0fac01e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3560ba44ed47e0ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb67fc640 1 -- 172.21.15.67:0/2620666622 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0b4070 con 0x7f0fb806dfc0 2024-09-19T05:37:14.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb67fc640 1 -- 172.21.15.67:0/2620666622 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fac0a77c0 con 0x7f0fb806dfc0 2024-09-19T05:37:14.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb67fc640 1 -- 172.21.15.67:0/2620666622 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0a7b90 con 0x7f0fb806dfc0 2024-09-19T05:37:14.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- 172.21.15.67:0/2620666622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb806dfc0 msgr2=0x7f0fb806f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 --2- 172.21.15.67:0/2620666622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb806dfc0 0x7f0fb806f960 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8071a40 tx=0x7f0fac01e930 comp rx=0 tx=0).stop 2024-09-19T05:37:14.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- 172.21.15.67:0/2620666622 shutdown_connections 2024-09-19T05:37:14.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 --2- 172.21.15.67:0/2620666622 >> v2:172.21.15.97:3300/0 conn(0x7f0fb806fea0 0x7f0fb815ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 --2- 172.21.15.67:0/2620666622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb806dfc0 0x7f0fb806f960 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 --2- 172.21.15.67:0/2620666622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb815b1d0 0x7f0fb80adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- 172.21.15.67:0/2620666622 >> 172.21.15.67:0/2620666622 conn(0x7f0fb80b1e50 msgr2=0x7f0fb80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- 172.21.15.67:0/2620666622 shutdown_connections 2024-09-19T05:37:14.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- 172.21.15.67:0/2620666622 wait complete. 2024-09-19T05:37:14.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 Processor -- start 2024-09-19T05:37:14.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- start start 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fb806dfc0 0x7f0fb814d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb806fea0 0x7f0fb815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb815b1d0 0x7f0fb81641c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb806e850 con 0x7f0fb815b1d0 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8072420 con 0x7f0fb806dfc0 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb806e9d0 con 0x7f0fb806fea0 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb815b1d0 0x7f0fb81641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb815b1d0 0x7f0fb81641c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53034/0 (socket says 172.21.15.67:53034) 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb7fff640 1 -- 172.21.15.67:0/3706612906 learned_addr learned my addr 172.21.15.67:0/3706612906 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fb806dfc0 0x7f0fb814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb806fea0 0x7f0fb815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb7fff640 1 -- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb806fea0 msgr2=0x7f0fb815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb806fea0 0x7f0fb815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb7fff640 1 -- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fb806dfc0 msgr2=0x7f0fb814d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fb806dfc0 0x7f0fb814d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb7fff640 1 -- 172.21.15.67:0/3706612906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb815b720 con 0x7f0fb815b1d0 2024-09-19T05:37:14.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb806fea0 0x7f0fb815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:14.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fb806dfc0 0x7f0fb814d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:14.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb815b1d0 0x7f0fb81641c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0007e90 tx=0x7f0fb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0f9ffff640 1 -- 172.21.15.67:0/3706612906 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0014420 con 0x7f0fb815b1d0 2024-09-19T05:37:14.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0f9ffff640 1 -- 172.21.15.67:0/3706612906 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb0019070 con 0x7f0fb815b1d0 2024-09-19T05:37:14.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0f9ffff640 1 -- 172.21.15.67:0/3706612906 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0014820 con 0x7f0fb815b1d0 2024-09-19T05:37:14.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- 172.21.15.67:0/3706612906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb815ba00 con 0x7f0fb815b1d0 2024-09-19T05:37:14.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.713+0000 7f0fbe104640 1 -- 172.21.15.67:0/3706612906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb815bfc0 con 0x7f0fb815b1d0 2024-09-19T05:37:14.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0f9ffff640 1 -- 172.21.15.67:0/3706612906 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0fb00149c0 con 0x7f0fb815b1d0 2024-09-19T05:37:14.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0f9ffff640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fa40678c0 0x7f0fa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0f9ffff640 1 -- 172.21.15.67:0/3706612906 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f0fb0086800 con 0x7f0fb815b1d0 2024-09-19T05:37:14.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fa40678c0 0x7f0fa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fc11c0000 1 Processor -- start 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fc11c0000 1 -- start start 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fa40678c0 0x7f0fa4069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800b9f0 tx=0x7f0fa8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 0x5646ffdc8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffd7b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd7c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5646ffc65960 con 0x5646ffd7bdb0 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5646ffba9900 con 0x5646ffdc8690 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5646ffbccd40 con 0x5646ffdc7d70 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd7c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd7c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53042/0 (socket says 172.21.15.67:53042) 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.717+0000 7f0fb7fff640 1 -- 172.21.15.67:0/1060295561 learned_addr learned my addr 172.21.15.67:0/1060295561 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb7fff640 1 -- 172.21.15.67:0/1060295561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 msgr2=0x5646ffdc8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/1060295561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 0x5646ffdc8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb7fff640 1 -- 172.21.15.67:0/1060295561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 msgr2=0x5646ffd7b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/1060295561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffd7b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb7fff640 1 -- 172.21.15.67:0/1060295561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646ffb73580 con 0x5646ffd7bdb0 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/1060295561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd7c190 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0004b00 tx=0x7f0fb0056470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85507832b6c6ea63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0f9d7fa640 1 -- 172.21.15.67:0/1060295561 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb005f5c0 con 0x5646ffd7bdb0 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0f9d7fa640 1 -- 172.21.15.67:0/1060295561 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb0054ce0 con 0x5646ffd7bdb0 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0f9d7fa640 1 -- 172.21.15.67:0/1060295561 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0053050 con 0x5646ffd7bdb0 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1060295561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 msgr2=0x5646ffd7c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/1060295561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd7c190 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0004b00 tx=0x7f0fb0056470 comp rx=0 tx=0).stop 2024-09-19T05:37:14.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1060295561 shutdown_connections 2024-09-19T05:37:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/1060295561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd7c190 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/1060295561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffd7b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/1060295561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 0x5646ffdc8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1060295561 >> 172.21.15.67:0/1060295561 conn(0x5646ffda9040 msgr2=0x5646ffdab430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1060295561 shutdown_connections 2024-09-19T05:37:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1060295561 wait complete. 2024-09-19T05:37:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- start start 2024-09-19T05:37:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 Processor -- start 2024-09-19T05:37:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffd7bdb0 0x5646ffdcece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffdc7d70 0x5646ffdcf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc8690 0x5646ffdcf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5646ffbc8d00 con 0x5646ffdc7d70 2024-09-19T05:37:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5646ffb87aa0 con 0x5646ffd7bdb0 2024-09-19T05:37:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5646ffb66340 con 0x5646ffdc8690 2024-09-19T05:37:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 10 client.0 _ll_register_callbacks cb 0x5646ffd69760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffdc7d70 0x5646ffdcf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffdc7d70 0x5646ffdcf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53054/0 (socket says 172.21.15.67:53054) 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb6ffd640 1 -- 172.21.15.67:0/458148239 learned_addr learned my addr 172.21.15.67:0/458148239 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc8690 0x5646ffdcf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb6ffd640 1 -- 172.21.15.67:0/458148239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc8690 msgr2=0x5646ffdcf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc8690 0x5646ffdcf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb6ffd640 1 -- 172.21.15.67:0/458148239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffd7bdb0 msgr2=0x5646ffdcece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffd7bdb0 0x5646ffdcece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb6ffd640 1 -- 172.21.15.67:0/458148239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646ffb6fdc0 con 0x5646ffdc7d70 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc8690 0x5646ffdcf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffdc7d70 0x5646ffdcf220 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00b2c0 tx=0x7f0fac01d170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a385272f678d1581 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0f967fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0f967fc640 1 -- 172.21.15.67:0/458148239 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0be020 con 0x5646ffdc7d70 2024-09-19T05:37:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0f967fc640 1 -- 172.21.15.67:0/458148239 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f0fac0a7d90 con 0x5646ffdc7d70 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- 172.21.15.67:0/458148239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fb0054ce0 con 0x5646ffdc7d70 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0f967fc640 1 -- 172.21.15.67:0/458148239 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0fac0c8050 con 0x5646ffdc7d70 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 10 client.6066 fetch_fsmap learned FSMap version 27 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0fc11c0000 1 -- 172.21.15.67:0/458148239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5646ffb6c7f0 con 0x5646ffdc7d70 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.721+0000 7f0f967fc640 1 -- 172.21.15.67:0/458148239 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb0054ce0 con 0x5646ffdc7d70 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0f967fc640 1 -- 172.21.15.67:0/458148239 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f0fac0cb020 con 0x5646ffdc7d70 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 10 client.6066 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 10 client.6066 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 20 client.6066 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5646ffdd70b0 0x5646ffdd94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 4 client.6066 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 -- 172.21.15.67:0/458148239 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646ffb66e10 con 0x5646ffdd70b0 2024-09-19T05:37:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5646ffdd70b0 0x5646ffdd94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5646ffdd70b0 0x5646ffdd94a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c8f825df1328a97 server_cookie=ff44f92b1575210e in_seq=0 out_seq=0 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0f967fc640 10 client.6066 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0f967fc640 1 -- 172.21.15.67:0/458148239 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646ffb66e10 con 0x5646ffdd70b0 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0f967fc640 10 client.6066 handle_command_reply: tid=0 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 client.6066 shutdown 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 -- 172.21.15.67:0/458148239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffdc7d70 msgr2=0x5646ffdcf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffdc7d70 0x5646ffdcf220 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00b2c0 tx=0x7f0fac01d170 comp rx=0 tx=0).stop 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 -- 172.21.15.67:0/458148239 shutdown_connections 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc8690 0x5646ffdcf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffdc7d70 0x5646ffdcf220 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5646ffdd70b0 0x5646ffdd94a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/458148239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffd7bdb0 0x5646ffdcece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0f967fc640 0 client.6066 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 -- 172.21.15.67:0/458148239 >> 172.21.15.67:0/458148239 conn(0x5646ffda9040 msgr2=0x5646ffd7af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 -- 172.21.15.67:0/458148239 shutdown_connections 2024-09-19T05:37:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 1 -- 172.21.15.67:0/458148239 wait complete. 2024-09-19T05:37:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.725+0000 7f0fc11c0000 20 client.6066 trim_cache size 0 max 16384 2024-09-19T05:37:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.741+0000 7f0fc11c0000 1 Processor -- start 2024-09-19T05:37:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.741+0000 7f0fc11c0000 1 -- start start 2024-09-19T05:37:14.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd83fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 0x5646ffdd51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffdd5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8204240 con 0x5646ffd7bdb0 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8203240 con 0x5646ffdc8690 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb809bf50 con 0x5646ffdc7d70 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd83fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd83fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53066/0 (socket says 172.21.15.67:53066) 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 -- 172.21.15.67:0/2596415443 learned_addr learned my addr 172.21.15.67:0/2596415443 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 -- 172.21.15.67:0/2596415443 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 msgr2=0x5646ffdd51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/2596415443 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 0x5646ffdd51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 -- 172.21.15.67:0/2596415443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 msgr2=0x5646ffdd5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/2596415443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffdd5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 -- 172.21.15.67:0/2596415443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646ffb8a470 con 0x5646ffd7bdb0 2024-09-19T05:37:14.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/2596415443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd83fc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800f5b0 tx=0x7f0fa80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1baab7aedb58039e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0f9cff9640 1 -- 172.21.15.67:0/2596415443 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8017930 con 0x5646ffd7bdb0 2024-09-19T05:37:14.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0f9cff9640 1 -- 172.21.15.67:0/2596415443 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa8017ad0 con 0x5646ffd7bdb0 2024-09-19T05:37:14.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0f9cff9640 1 -- 172.21.15.67:0/2596415443 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa802b410 con 0x5646ffd7bdb0 2024-09-19T05:37:14.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- 172.21.15.67:0/2596415443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 msgr2=0x5646ffd83fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/2596415443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd83fc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800f5b0 tx=0x7f0fa80046d0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- 172.21.15.67:0/2596415443 shutdown_connections 2024-09-19T05:37:14.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/2596415443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffdd5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/2596415443 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 0x5646ffdd51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/2596415443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffd83fc0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- 172.21.15.67:0/2596415443 >> 172.21.15.67:0/2596415443 conn(0x5646ffda9040 msgr2=0x5646ffdd4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- 172.21.15.67:0/2596415443 shutdown_connections 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- 172.21.15.67:0/2596415443 wait complete. 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- start start 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 Processor -- start 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffddbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 0x5646ffdf7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffdf7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5646ffbd1370 con 0x5646ffd7bdb0 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb809c5a0 con 0x5646ffdc8690 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5646ffc890c0 con 0x5646ffdc7d70 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fc11c0000 10 client.0 _ll_register_callbacks cb 0x7f0fac0b2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:14.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffddbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffddbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53070/0 (socket says 172.21.15.67:53070) 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.745+0000 7f0fb77fe640 1 -- 172.21.15.67:0/1029215097 learned_addr learned my addr 172.21.15.67:0/1029215097 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 0x5646ffdf7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffdf7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb77fe640 1 -- 172.21.15.67:0/1029215097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 msgr2=0x5646ffdf7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 0x5646ffdf7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb77fe640 1 -- 172.21.15.67:0/1029215097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 msgr2=0x5646ffdf7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffdf7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb77fe640 1 -- 172.21.15.67:0/1029215097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646ffb60640 con 0x5646ffd7bdb0 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb7fff640 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffdf7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb77fe640 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffddbe20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800fa90 tx=0x7f0fa8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f6c78eed76f430 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0f967fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0f967fc640 1 -- 172.21.15.67:0/1029215097 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8017190 con 0x5646ffd7bdb0 2024-09-19T05:37:14.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0f967fc640 1 -- 172.21.15.67:0/1029215097 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f0fa8017c80 con 0x5646ffd7bdb0 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1029215097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fa8017ad0 con 0x5646ffd7bdb0 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0f967fc640 1 -- 172.21.15.67:0/1029215097 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0fa8041050 con 0x5646ffd7bdb0 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 10 client.6072 fetch_fsmap learned FSMap version 27 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1029215097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5646ffb643b0 con 0x5646ffd7bdb0 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0f967fc640 1 -- 172.21.15.67:0/1029215097 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa8017ad0 con 0x5646ffd7bdb0 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0f967fc640 1 -- 172.21.15.67:0/1029215097 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f0fa8044020 con 0x5646ffd7bdb0 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 10 client.6072 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 10 client.6072 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 20 client.6072 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5646ffddc360 0x5646ffdf8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 4 client.6072 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1029215097 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5646ffbda470 con 0x5646ffddc360 2024-09-19T05:37:14.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5646ffddc360 0x5646ffdf8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fb6ffd640 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5646ffddc360 0x5646ffdf8210 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b33800caf69ae0b4 server_cookie=fbcd2eb9483c428b in_seq=0 out_seq=0 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0f967fc640 10 client.6072 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0f967fc640 1 -- 172.21.15.67:0/1029215097 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5646ffbda470 con 0x5646ffddc360 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0f967fc640 10 client.6072 handle_command_reply: tid=0 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 client.6072 shutdown 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1029215097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 msgr2=0x5646ffddbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffddbe20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800fa90 tx=0x7f0fa8012000 comp rx=0 tx=0).stop 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1029215097 shutdown_connections 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x5646ffddc360 0x5646ffdf8210 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5646ffdc8690 0x5646ffdf7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0f967fc640 0 client.6072 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5646ffdc7d70 0x5646ffdf7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 --2- 172.21.15.67:0/1029215097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646ffd7bdb0 0x5646ffddbe20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1029215097 >> 172.21.15.67:0/1029215097 conn(0x5646ffda9040 msgr2=0x5646ffdd52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1029215097 shutdown_connections 2024-09-19T05:37:14.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 1 -- 172.21.15.67:0/1029215097 wait complete. 2024-09-19T05:37:14.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fc11c0000 20 client.6072 trim_cache size 0 max 16384 2024-09-19T05:37:14.760 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:14.760 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-19T05:37:14.760 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {} 2024-09-19T05:37:14.760 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:14.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 -- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fa40678c0 msgr2=0x7f0fa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fa40678c0 0x7f0fa4069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800b9f0 tx=0x7f0fa8008040 comp rx=0 tx=0).stop 2024-09-19T05:37:14.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 -- 172.21.15.67:0/3706612906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb815b1d0 msgr2=0x7f0fb81641c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb815b1d0 0x7f0fb81641c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0007e90 tx=0x7f0fb000e4b0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 -- 172.21.15.67:0/3706612906 shutdown_connections 2024-09-19T05:37:14.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fb815b1d0 0x7f0fb81641c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fa40678c0 0x7f0fa4069d80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fb806fea0 0x7f0fb815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 --2- 172.21.15.67:0/3706612906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fb806dfc0 0x7f0fb814d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 -- 172.21.15.67:0/3706612906 >> 172.21.15.67:0/3706612906 conn(0x7f0fb80b1e50 msgr2=0x7f0fb80b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 -- 172.21.15.67:0/3706612906 shutdown_connections 2024-09-19T05:37:14.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.749+0000 7f0fbe104640 1 -- 172.21.15.67:0/3706612906 wait complete. 2024-09-19T05:37:14.770 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:37:14.771 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-19T05:37:14.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.885+0000 7f1d4a0de640 1 Processor -- start 2024-09-19T05:37:14.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.885+0000 7f1d4a0de640 1 -- start start 2024-09-19T05:37:14.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.885+0000 7f1d4a0de640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d44159c60 0x7f1d440ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.885+0000 7f1d4a0de640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d4406ffd0 0x7f1d440aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.885+0000 7f1d4a0de640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4415a040 con 0x7f1d440b3150 2024-09-19T05:37:14.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.885+0000 7f1d4a0de640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1d4415d460 con 0x7f1d4406ffd0 2024-09-19T05:37:14.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.885+0000 7f1d4a0de640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4415c850 con 0x7f1d44159c60 2024-09-19T05:37:14.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d437fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d44159c60 0x7f1d440ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d42ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d4406ffd0 0x7f1d440aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d437fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d44159c60 0x7f1d440ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:51854/0 (socket says 172.21.15.67:51854) 2024-09-19T05:37:14.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d437fe640 1 -- 172.21.15.67:0/3660226342 learned_addr learned my addr 172.21.15.67:0/3660226342 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d437fe640 1 -- 172.21.15.67:0/3660226342 >> v2:172.21.15.97:3300/0 conn(0x7f1d4406ffd0 msgr2=0x7f1d440aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d437fe640 1 --2- 172.21.15.67:0/3660226342 >> v2:172.21.15.97:3300/0 conn(0x7f1d4406ffd0 0x7f1d440aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d437fe640 1 -- 172.21.15.67:0/3660226342 >> v1:172.21.15.97:6789/0 conn(0x7f1d440b3150 legacy=0x7f1d4415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d437fe640 1 -- 172.21.15.67:0/3660226342 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4415cb30 con 0x7f1d44159c60 2024-09-19T05:37:14.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d437fe640 1 --2- 172.21.15.67:0/3660226342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d44159c60 0x7f1d440ad130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009e50 tx=0x7f1d3c01ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ddea72391e41cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d427fc640 1 -- 172.21.15.67:0/3660226342 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0a58d0 con 0x7f1d44159c60 2024-09-19T05:37:14.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d427fc640 1 -- 172.21.15.67:0/3660226342 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c0a5a70 con 0x7f1d44159c60 2024-09-19T05:37:14.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.889+0000 7f1d427fc640 1 -- 172.21.15.67:0/3660226342 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0a5e40 con 0x7f1d44159c60 2024-09-19T05:37:14.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- 172.21.15.67:0/3660226342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d44159c60 msgr2=0x7f1d440ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 --2- 172.21.15.67:0/3660226342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d44159c60 0x7f1d440ad130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009e50 tx=0x7f1d3c01ca00 comp rx=0 tx=0).stop 2024-09-19T05:37:14.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- 172.21.15.67:0/3660226342 shutdown_connections 2024-09-19T05:37:14.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 --2- 172.21.15.67:0/3660226342 >> v2:172.21.15.97:3300/0 conn(0x7f1d4406ffd0 0x7f1d440aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 --2- 172.21.15.67:0/3660226342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d44159c60 0x7f1d440ad130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- 172.21.15.67:0/3660226342 >> 172.21.15.67:0/3660226342 conn(0x7f1d440b1e50 msgr2=0x7f1d440b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- 172.21.15.67:0/3660226342 shutdown_connections 2024-09-19T05:37:14.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- 172.21.15.67:0/3660226342 wait complete. 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 Processor -- start 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- start start 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d4406ffd0 0x7f1d4414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d440b3150 0x7f1d441463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d44159c60 0x7f1d44146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440ad7f0 con 0x7f1d44159c60 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440ad670 con 0x7f1d440b3150 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1d44168e30 con 0x7f1d4406ffd0 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d44159c60 0x7f1d44146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d44159c60 0x7f1d44146900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53076/0 (socket says 172.21.15.67:53076) 2024-09-19T05:37:14.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d43fff640 1 -- 172.21.15.67:0/877924178 learned_addr learned my addr 172.21.15.67:0/877924178 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d42ffd640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d440b3150 0x7f1d441463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d437fe640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d4406ffd0 0x7f1d4414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d43fff640 1 -- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d4406ffd0 msgr2=0x7f1d4414cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d43fff640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d4406ffd0 0x7f1d4414cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d43fff640 1 -- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d440b3150 msgr2=0x7f1d441463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d43fff640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d440b3150 0x7f1d441463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d43fff640 1 -- 172.21.15.67:0/877924178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d441521f0 con 0x7f1d44159c60 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d43fff640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d44159c60 0x7f1d44146900 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400c460 tx=0x7f1d3400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d3bfff640 1 -- 172.21.15.67:0/877924178 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34016020 con 0x7f1d44159c60 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d3bfff640 1 -- 172.21.15.67:0/877924178 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d34005220 con 0x7f1d44159c60 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- 172.21.15.67:0/877924178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d441524d0 con 0x7f1d44159c60 2024-09-19T05:37:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d3bfff640 1 -- 172.21.15.67:0/877924178 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34007030 con 0x7f1d44159c60 2024-09-19T05:37:14.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.893+0000 7f1d4a0de640 1 -- 172.21.15.67:0/877924178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d44152a90 con 0x7f1d44159c60 2024-09-19T05:37:14.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d3bfff640 1 -- 172.21.15.67:0/877924178 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d340071d0 con 0x7f1d44159c60 2024-09-19T05:37:14.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d4d19a000 1 Processor -- start 2024-09-19T05:37:14.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d4d19a000 1 -- start start 2024-09-19T05:37:14.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d3bfff640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 0x7f1d28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d3bfff640 1 -- 172.21.15.67:0/877924178 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1d34085730 con 0x7f1d44159c60 2024-09-19T05:37:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d42ffd640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 0x7f1d28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050cd69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050cd6ef0 0x562050c8c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050c8cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562050b6fc40 con 0x562050c8cbe0 2024-09-19T05:37:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562050ad6d50 con 0x562050cd65d0 2024-09-19T05:37:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x562050a91ab0 con 0x562050cd6ef0 2024-09-19T05:37:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050c8cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050c8cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53078/0 (socket says 172.21.15.67:53078) 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d43fff640 1 -- 172.21.15.67:0/408290536 learned_addr learned my addr 172.21.15.67:0/408290536 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d437fe640 1 --2- 172.21.15.67:0/408290536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050cd69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d42ffd640 1 --2- 172.21.15.67:0/408290536 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050cd6ef0 0x562050c8c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d43fff640 1 -- 172.21.15.67:0/408290536 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050cd6ef0 msgr2=0x562050c8c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d43fff640 1 --2- 172.21.15.67:0/408290536 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050cd6ef0 0x562050c8c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d43fff640 1 -- 172.21.15.67:0/408290536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 msgr2=0x562050cd69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d43fff640 1 --2- 172.21.15.67:0/408290536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050cd69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d43fff640 1 -- 172.21.15.67:0/408290536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562050a7d590 con 0x562050c8cbe0 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.897+0000 7f1d437fe640 1 --2- 172.21.15.67:0/408290536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050cd69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d43fff640 1 --2- 172.21.15.67:0/408290536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050c8cfc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1d34005630 tx=0x7f1d34055b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f1c72226cd5055 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d42ffd640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 0x7f1d28069d80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1d4414f910 tx=0x7f1d2c018760 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d397fa640 1 -- 172.21.15.67:0/408290536 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34053d40 con 0x562050c8cbe0 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d397fa640 1 -- 172.21.15.67:0/408290536 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d34010d70 con 0x562050c8cbe0 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d397fa640 1 -- 172.21.15.67:0/408290536 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d340074c0 con 0x562050c8cbe0 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- 172.21.15.67:0/408290536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 msgr2=0x562050c8cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/408290536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050c8cfc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1d34005630 tx=0x7f1d34055b80 comp rx=0 tx=0).stop 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- 172.21.15.67:0/408290536 shutdown_connections 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/408290536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050c8cfc0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/408290536 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050cd6ef0 0x562050c8c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/408290536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050cd69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- 172.21.15.67:0/408290536 >> 172.21.15.67:0/408290536 conn(0x562050c7fbc0 msgr2=0x562050c86b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- 172.21.15.67:0/408290536 shutdown_connections 2024-09-19T05:37:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- 172.21.15.67:0/408290536 wait complete. 2024-09-19T05:37:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- start start 2024-09-19T05:37:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 Processor -- start 2024-09-19T05:37:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 0x562050cc2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd65d0 0x562050cc31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd6ef0 0x562050cd72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562050a95400 con 0x562050cd65d0 2024-09-19T05:37:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562050b933a0 con 0x562050cd6ef0 2024-09-19T05:37:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x562050b16260 con 0x562050c8cbe0 2024-09-19T05:37:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 10 client.0 _ll_register_callbacks cb 0x562050b38020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d42ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd65d0 0x562050cc31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d42ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd65d0 0x562050cc31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53094/0 (socket says 172.21.15.67:53094) 2024-09-19T05:37:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d42ffd640 1 -- 172.21.15.67:0/1057103488 learned_addr learned my addr 172.21.15.67:0/1057103488 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d437fe640 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 0x562050cc2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d43fff640 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd6ef0 0x562050cd72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d42ffd640 1 -- 172.21.15.67:0/1057103488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 msgr2=0x562050cc2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d42ffd640 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 0x562050cc2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d42ffd640 1 -- 172.21.15.67:0/1057103488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd6ef0 msgr2=0x562050cd72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d42ffd640 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd6ef0 0x562050cd72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d42ffd640 1 -- 172.21.15.67:0/1057103488 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562050a79dd0 con 0x562050cd65d0 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d43fff640 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd6ef0 0x562050cd72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d42ffd640 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd65d0 0x562050cc31f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c019b10 tx=0x7f1d2c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cc98102af4dd0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d327fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d327fc640 1 -- 172.21.15.67:0/1057103488 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c029020 con 0x562050cd65d0 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d327fc640 1 -- 172.21.15.67:0/1057103488 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1d2c015ab0 con 0x562050cd65d0 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- 172.21.15.67:0/1057103488 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d34010d70 con 0x562050cd65d0 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d327fc640 1 -- 172.21.15.67:0/1057103488 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1d2c033050 con 0x562050cd65d0 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 10 client.6081 fetch_fsmap learned FSMap version 27 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d4d19a000 1 -- 172.21.15.67:0/1057103488 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562050a76800 con 0x562050cd65d0 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d327fc640 1 -- 172.21.15.67:0/1057103488 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d34010d70 con 0x562050cd65d0 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.901+0000 7f1d327fc640 1 -- 172.21.15.67:0/1057103488 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f1d2c036020 con 0x562050cd65d0 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 10 client.6081 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 10 client.6081 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 20 client.6081 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x562050cd8040 0x562050cd8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 4 client.6081 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 -- 172.21.15.67:0/1057103488 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562050a70e20 con 0x562050cd8040 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d437fe640 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x562050cd8040 0x562050cd8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d437fe640 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x562050cd8040 0x562050cd8450 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5facf78eaaaf2513 server_cookie=d5212a509440d7e0 in_seq=0 out_seq=0 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d327fc640 10 client.6081 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d327fc640 1 -- 172.21.15.67:0/1057103488 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562050a70e20 con 0x562050cd8040 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d327fc640 10 client.6081 handle_command_reply: tid=0 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 client.6081 shutdown 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 -- 172.21.15.67:0/1057103488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd65d0 msgr2=0x562050cc31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd65d0 0x562050cc31f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c019b10 tx=0x7f1d2c004740 comp rx=0 tx=0).stop 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 -- 172.21.15.67:0/1057103488 shutdown_connections 2024-09-19T05:37:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x562050cd8040 0x562050cd8450 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd6ef0 0x562050cd72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd65d0 0x562050cc31f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/1057103488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 0x562050cc2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d327fc640 0 client.6081 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 -- 172.21.15.67:0/1057103488 >> 172.21.15.67:0/1057103488 conn(0x562050c7fbc0 msgr2=0x562050c8def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 -- 172.21.15.67:0/1057103488 shutdown_connections 2024-09-19T05:37:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 1 -- 172.21.15.67:0/1057103488 wait complete. 2024-09-19T05:37:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.905+0000 7f1d4d19a000 20 client.6081 trim_cache size 0 max 16384 2024-09-19T05:37:14.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.917+0000 7f1d4d19a000 1 Processor -- start 2024-09-19T05:37:14.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.917+0000 7f1d4d19a000 1 -- start start 2024-09-19T05:37:14.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050cc2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050c94140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050cd6ef0 0x562050c94680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440737c0 con 0x562050c8cbe0 2024-09-19T05:37:14.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1d44151a30 con 0x562050cd65d0 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1d44073170 con 0x562050cd6ef0 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050cc2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050cc2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53096/0 (socket says 172.21.15.67:53096) 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 -- 172.21.15.67:0/3787999572 learned_addr learned my addr 172.21.15.67:0/3787999572 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 -- 172.21.15.67:0/3787999572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050cd6ef0 msgr2=0x562050c94680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 --2- 172.21.15.67:0/3787999572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050cd6ef0 0x562050c94680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d42ffd640 1 --2- 172.21.15.67:0/3787999572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050c94140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 -- 172.21.15.67:0/3787999572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 msgr2=0x562050c94140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 --2- 172.21.15.67:0/3787999572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050c94140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 -- 172.21.15.67:0/3787999572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562050cd7640 con 0x562050c8cbe0 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 --2- 172.21.15.67:0/3787999572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050cc2f10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009e50 tx=0x7f1d3c0a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484bd9113601c2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d38ff9640 1 -- 172.21.15.67:0/3787999572 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c009510 con 0x562050c8cbe0 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d38ff9640 1 -- 172.21.15.67:0/3787999572 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c009250 con 0x562050c8cbe0 2024-09-19T05:37:14.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d38ff9640 1 -- 172.21.15.67:0/3787999572 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0c3680 con 0x562050c8cbe0 2024-09-19T05:37:14.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- 172.21.15.67:0/3787999572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 msgr2=0x562050cc2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/3787999572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050cc2f10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009e50 tx=0x7f1d3c0a7070 comp rx=0 tx=0).stop 2024-09-19T05:37:14.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- 172.21.15.67:0/3787999572 shutdown_connections 2024-09-19T05:37:14.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/3787999572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050cd6ef0 0x562050c94680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/3787999572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050c94140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/3787999572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050c8cbe0 0x562050cc2f10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- 172.21.15.67:0/3787999572 >> 172.21.15.67:0/3787999572 conn(0x562050c7fbc0 msgr2=0x562050c871e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- 172.21.15.67:0/3787999572 shutdown_connections 2024-09-19T05:37:14.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- 172.21.15.67:0/3787999572 wait complete. 2024-09-19T05:37:14.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- start start 2024-09-19T05:37:14.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 Processor -- start 2024-09-19T05:37:14.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 0x562050d4ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050d4d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd6ef0 0x562050d4f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562050a7cf30 con 0x562050cd6ef0 2024-09-19T05:37:14.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562050a957d0 con 0x562050cd65d0 2024-09-19T05:37:14.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x562050ad6060 con 0x562050c8cbe0 2024-09-19T05:37:14.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d4d19a000 10 client.0 _ll_register_callbacks cb 0x7f1d2c009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd6ef0 0x562050d4f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd6ef0 0x562050d4f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53110/0 (socket says 172.21.15.67:53110) 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d43fff640 1 -- 172.21.15.67:0/18133574 learned_addr learned my addr 172.21.15.67:0/18133574 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d42ffd640 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050d4d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 0x562050d4ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d43fff640 1 -- 172.21.15.67:0/18133574 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 msgr2=0x562050d4ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d43fff640 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 0x562050d4ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d43fff640 1 -- 172.21.15.67:0/18133574 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 msgr2=0x562050d4d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d43fff640 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050d4d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d43fff640 1 -- 172.21.15.67:0/18133574 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562050a94480 con 0x562050cd6ef0 2024-09-19T05:37:14.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d42ffd640 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050d4d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.921+0000 7f1d437fe640 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 0x562050d4ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d43fff640 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd6ef0 0x562050d4f620 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1d340559d0 tx=0x7f1d34000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad79d169fb6285c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d327fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d327fc640 1 -- 172.21.15.67:0/18133574 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34051ce0 con 0x562050cd6ef0 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d327fc640 1 -- 172.21.15.67:0/18133574 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f1d340520b0 con 0x562050cd6ef0 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 -- 172.21.15.67:0/18133574 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562050ae4480 con 0x562050cd6ef0 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d327fc640 1 -- 172.21.15.67:0/18133574 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1d340074c0 con 0x562050cd6ef0 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 10 client.6087 fetch_fsmap learned FSMap version 27 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 -- 172.21.15.67:0/18133574 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562050a6a650 con 0x562050cd6ef0 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d327fc640 1 -- 172.21.15.67:0/18133574 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562050ae4480 con 0x562050cd6ef0 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d327fc640 1 -- 172.21.15.67:0/18133574 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f1d3405c0c0 con 0x562050cd6ef0 2024-09-19T05:37:14.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 10 client.6087 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 10 client.6087 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 20 client.6087 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x562050d47d20 0x562050d51b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 4 client.6087 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 -- 172.21.15.67:0/18133574 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562050ade7d0 con 0x562050d47d20 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d437fe640 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x562050d47d20 0x562050d51b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d437fe640 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x562050d47d20 0x562050d51b70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c15965f42306ab59 server_cookie=18297443327a8073 in_seq=0 out_seq=0 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d327fc640 10 client.6087 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d327fc640 1 -- 172.21.15.67:0/18133574 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+166 (crc 0 0 0) 0x562050ade7d0 con 0x562050d47d20 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d327fc640 10 client.6087 handle_command_reply: tid=0 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 client.6087 shutdown 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 -- 172.21.15.67:0/18133574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd6ef0 msgr2=0x562050d4f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd6ef0 0x562050d4f620 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1d340559d0 tx=0x7f1d34000ee0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 -- 172.21.15.67:0/18133574 shutdown_connections 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562050cd6ef0 0x562050d4f620 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x562050d47d20 0x562050d51b70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562050cd65d0 0x562050d4d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 --2- 172.21.15.67:0/18133574 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562050c8cbe0 0x562050d4ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d327fc640 0 client.6087 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 -- 172.21.15.67:0/18133574 >> 172.21.15.67:0/18133574 conn(0x562050c7fbc0 msgr2=0x562050c93130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 -- 172.21.15.67:0/18133574 shutdown_connections 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 1 -- 172.21.15.67:0/18133574 wait complete. 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4d19a000 20 client.6087 trim_cache size 0 max 16384 2024-09-19T05:37:14.935 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:37:14.936 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:14.936 INFO:teuthology.orchestra.run.smithi067.stdout: "damage_type": "backtrace", 2024-09-19T05:37:14.936 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 28384011, 2024-09-19T05:37:14.936 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 1099511630411, 2024-09-19T05:37:14.936 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-09-19T05:37:14.936 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:14.936 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:37:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 -- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 msgr2=0x7f1d28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 0x7f1d28069d80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1d4414f910 tx=0x7f1d2c018760 comp rx=0 tx=0).stop 2024-09-19T05:37:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 -- 172.21.15.67:0/877924178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d44159c60 msgr2=0x7f1d44146900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d44159c60 0x7f1d44146900 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400c460 tx=0x7f1d3400c920 comp rx=0 tx=0).stop 2024-09-19T05:37:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 -- 172.21.15.67:0/877924178 shutdown_connections 2024-09-19T05:37:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d44159c60 0x7f1d44146900 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d440b3150 0x7f1d441463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d280678c0 0x7f1d28069d80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 --2- 172.21.15.67:0/877924178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d4406ffd0 0x7f1d4414cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:14.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 -- 172.21.15.67:0/877924178 >> 172.21.15.67:0/877924178 conn(0x7f1d440b1e50 msgr2=0x7f1d4415ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:14.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 -- 172.21.15.67:0/877924178 shutdown_connections 2024-09-19T05:37:14.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:14.925+0000 7f1d4a0de640 1 -- 172.21.15.67:0/877924178 wait complete. 2024-09-19T05:37:14.946 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:15.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3bd18a640 1 Processor -- start 2024-09-19T05:37:15.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3bd18a640 1 -- start start 2024-09-19T05:37:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3bd18a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3b80b2fd0 0x7fd3b80b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3bd18a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b806de80 con 0x7fd3b80acfb0 2024-09-19T05:37:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3bd18a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b806e160 con 0x7fd3b8159d60 2024-09-19T05:37:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3bd18a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b806e440 con 0x7fd3b80b2fd0 2024-09-19T05:37:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3affff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3b80b2fd0 0x7fd3b80b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3b759e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd3b80acfb0 0x7fd3b80ad390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58632/0 (socket says 172.21.15.67:58632) 2024-09-19T05:37:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3b759e640 1 -- 172.21.15.67:0/1875116810 learned_addr learned my addr 172.21.15.67:0/1875116810 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:15.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3affff640 1 -- 172.21.15.67:0/1875116810 >> v1:172.21.15.97:6789/0 conn(0x7fd3b8159d60 legacy=0x7fd3b806ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3affff640 1 -- 172.21.15.67:0/1875116810 >> v1:172.21.15.67:6789/0 conn(0x7fd3b80acfb0 legacy=0x7fd3b80ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.057+0000 7fd3affff640 1 -- 172.21.15.67:0/1875116810 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b806e720 con 0x7fd3b80b2fd0 2024-09-19T05:37:15.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3affff640 1 --2- 172.21.15.67:0/1875116810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b2fd0 0x7fd3b80b3420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00097c0 tx=0x7fd3a001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ae10cfb4edb448 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b659c640 1 -- 172.21.15.67:0/1875116810 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00b0070 con 0x7fd3b80b2fd0 2024-09-19T05:37:15.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b659c640 1 -- 172.21.15.67:0/1875116810 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a00ab600 con 0x7fd3b80b2fd0 2024-09-19T05:37:15.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b659c640 1 -- 172.21.15.67:0/1875116810 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00ab9d0 con 0x7fd3b80b2fd0 2024-09-19T05:37:15.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 -- 172.21.15.67:0/1875116810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b2fd0 msgr2=0x7fd3b80b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 --2- 172.21.15.67:0/1875116810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b2fd0 0x7fd3b80b3420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00097c0 tx=0x7fd3a001c460 comp rx=0 tx=0).stop 2024-09-19T05:37:15.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 -- 172.21.15.67:0/1875116810 shutdown_connections 2024-09-19T05:37:15.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 --2- 172.21.15.67:0/1875116810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b2fd0 0x7fd3b80b3420 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 -- 172.21.15.67:0/1875116810 >> 172.21.15.67:0/1875116810 conn(0x7fd3b80d0080 msgr2=0x7fd3b80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 -- 172.21.15.67:0/1875116810 shutdown_connections 2024-09-19T05:37:15.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 -- 172.21.15.67:0/1875116810 wait complete. 2024-09-19T05:37:15.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 Processor -- start 2024-09-19T05:37:15.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 -- start start 2024-09-19T05:37:15.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b80acfb0 0x7fd3b8099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3b80b2fd0 0x7fd3b81584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b8159d60 0x7fd3b8158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b80af830 con 0x7fd3b8159d60 2024-09-19T05:37:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b80af6b0 con 0x7fd3b80acfb0 2024-09-19T05:37:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b80af9b0 con 0x7fd3b80b2fd0 2024-09-19T05:37:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b8159d60 0x7fd3b8158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b8159d60 0x7fd3b8158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53126/0 (socket says 172.21.15.67:53126) 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b759e640 1 -- 172.21.15.67:0/3902664307 learned_addr learned my addr 172.21.15.67:0/3902664307 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b6d9d640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b80acfb0 0x7fd3b8099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3affff640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3b80b2fd0 0x7fd3b81584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b759e640 1 -- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3b80b2fd0 msgr2=0x7fd3b81584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b759e640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3b80b2fd0 0x7fd3b81584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b759e640 1 -- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b80acfb0 msgr2=0x7fd3b8099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b759e640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b80acfb0 0x7fd3b8099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b759e640 1 -- 172.21.15.67:0/3902664307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b81504a0 con 0x7fd3b8159d60 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b6d9d640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b80acfb0 0x7fd3b8099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3b759e640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b8159d60 0x7fd3b8158a20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000ca80 tx=0x7fd3b000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3af7fe640 1 -- 172.21.15.67:0/3902664307 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0017070 con 0x7fd3b8159d60 2024-09-19T05:37:15.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3af7fe640 1 -- 172.21.15.67:0/3902664307 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b000ac30 con 0x7fd3b8159d60 2024-09-19T05:37:15.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3bd18a640 1 -- 172.21.15.67:0/3902664307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b80cf230 con 0x7fd3b8159d60 2024-09-19T05:37:15.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.061+0000 7fd3af7fe640 1 -- 172.21.15.67:0/3902664307 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0012600 con 0x7fd3b8159d60 2024-09-19T05:37:15.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.065+0000 7fd3bd18a640 1 -- 172.21.15.67:0/3902664307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b8156bf0 con 0x7fd3b8159d60 2024-09-19T05:37:15.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.065+0000 7fd3bd18a640 1 -- 172.21.15.67:0/3902664307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b80d0f20 con 0x7fd3b8159d60 2024-09-19T05:37:15.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.065+0000 7fd3af7fe640 1 -- 172.21.15.67:0/3902664307 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3b001a070 con 0x7fd3b8159d60 2024-09-19T05:37:15.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.065+0000 7fd3af7fe640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3980678f0 0x7fd398069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.065+0000 7fd3af7fe640 1 -- 172.21.15.67:0/3902664307 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd3b0085a50 con 0x7fd3b8159d60 2024-09-19T05:37:15.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.065+0000 7fd3b6d9d640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3980678f0 0x7fd398069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.065+0000 7fd3b6d9d640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3980678f0 0x7fd398069db0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800a850 tx=0x7fd3a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.069+0000 7fd3af7fe640 1 -- 172.21.15.67:0/3902664307 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd3b000ae20 con 0x7fd3b8159d60 2024-09-19T05:37:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.265+0000 7fd3bd18a640 1 -- 172.21.15.67:0/3902664307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3b81569a0 con 0x7fd3b8159d60 2024-09-19T05:37:15.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3af7fe640 1 -- 172.21.15.67:0/3902664307 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5218 (secure 0 0 0) 0x7fd3b0055cf0 con 0x7fd3b8159d60 2024-09-19T05:37:15.272 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:15.272 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"btime":"2024-09-19T05:37:13:394111+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/872634022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":872634022},{"type":"v1","addr":"172.21.15.97:6836","nonce":872634022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2340749382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2340749382},{"type":"v1","addr":"172.21.15.97:6837","nonce":2340749382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1455090407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1455090407},{"type":"v1","addr":"172.21.15.67:6833","nonce":1455090407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:36:32.070002+0000","modified":"2024-09-19T05:37:12.758185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5364":{"gid":5364,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.67:6835/985983096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":985983096},{"type":"v1","addr":"172.21.15.67:6835","nonce":985983096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5364,"qdb_cluster":[5364]},"id":3}]} 2024-09-19T05:37:15.272 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 27 2024-09-19T05:37:15.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 -- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3980678f0 msgr2=0x7fd398069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3980678f0 0x7fd398069db0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800a850 tx=0x7fd3a8008040 comp rx=0 tx=0).stop 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 -- 172.21.15.67:0/3902664307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b8159d60 msgr2=0x7fd3b8158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b8159d60 0x7fd3b8158a20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000ca80 tx=0x7fd3b000cf40 comp rx=0 tx=0).stop 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 -- 172.21.15.67:0/3902664307 shutdown_connections 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b8159d60 0x7fd3b8158a20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3980678f0 0x7fd398069db0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3b80b2fd0 0x7fd3b81584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 --2- 172.21.15.67:0/3902664307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b80acfb0 0x7fd3b8099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 -- 172.21.15.67:0/3902664307 >> 172.21.15.67:0/3902664307 conn(0x7fd3b80d0080 msgr2=0x7fd3b815d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 -- 172.21.15.67:0/3902664307 shutdown_connections 2024-09-19T05:37:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.269+0000 7fd3bd18a640 1 -- 172.21.15.67:0/3902664307 wait complete. 2024-09-19T05:37:15.289 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 28384011 2024-09-19T05:37:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fb54d3640 1 Processor -- start 2024-09-19T05:37:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fb54d3640 1 -- start start 2024-09-19T05:37:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fb54d3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6fb015e690 0x7f6fb00d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fb54d3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fb00d1590 0x7f6fb006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fb54d3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb00d35a0 con 0x7f6fb00d4fb0 2024-09-19T05:37:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fb54d3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb00d32c0 con 0x7f6fb015e690 2024-09-19T05:37:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fb54d3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb006d040 con 0x7f6fb00d1590 2024-09-19T05:37:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fae7fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6fb00d4fb0 0x7f6fb00d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58648/0 (socket says 172.21.15.67:58648) 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fae7fc640 1 -- 172.21.15.67:0/2487792744 learned_addr learned my addr 172.21.15.67:0/2487792744 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6faeffd640 1 --2- 172.21.15.67:0/2487792744 >> v2:172.21.15.97:3300/0 conn(0x7f6fb015e690 0x7f6fb00d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fb00d1590 0x7f6fb006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 533475454 0 0) 0x7f6fb00d35a0 con 0x7f6fb00d4fb0 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f98003530 con 0x7f6fb00d4fb0 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3934195240 0 0) 0x7f6f98003530 con 0x7f6fb00d4fb0 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fb00d1590 msgr2=0x7f6fb006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fb00d1590 0x7f6fb006db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 >> v2:172.21.15.97:3300/0 conn(0x7f6fb015e690 msgr2=0x7f6fb00d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 --2- 172.21.15.67:0/2487792744 >> v2:172.21.15.97:3300/0 conn(0x7f6fb015e690 0x7f6fb00d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb006d320 con 0x7f6fb00d4fb0 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6fa4001a00 con 0x7f6fb00d4fb0 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 >> v1:172.21.15.67:6789/0 conn(0x7f6fb00d4fb0 legacy=0x7f6fb00d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f980039c0 0x7f6f98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f98004810 0x7f6f98004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fb00d1590 0x7f6f980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb00d32c0 con 0x7f6f98004810 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb006d040 con 0x7f6f980039c0 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9800b9d0 con 0x7f6fb00d1590 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fae7fc640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f98004810 0x7f6f98004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6faeffd640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f980039c0 0x7f6f98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fae7fc640 1 -- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fb00d1590 msgr2=0x7f6f980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fb00d1590 0x7f6f980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fae7fc640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fb00d1590 0x7f6f980051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fae7fc640 1 -- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f980039c0 msgr2=0x7f6f98003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fae7fc640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f980039c0 0x7f6f98003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.409+0000 7f6fae7fc640 1 -- 172.21.15.67:0/2487792744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f98003530 con 0x7f6f98004810 2024-09-19T05:37:15.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6fae7fc640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f98004810 0x7f6f98004c90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400a8a0 tx=0x7f6fa401fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519a3569ffea08f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa400a4c0 con 0x7f6f98004810 2024-09-19T05:37:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa40aa670 con 0x7f6f98004810 2024-09-19T05:37:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6fadffb640 1 -- 172.21.15.67:0/2487792744 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa40aaa60 con 0x7f6f98004810 2024-09-19T05:37:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6fb54d3640 1 -- 172.21.15.67:0/2487792744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f98004810 msgr2=0x7f6f98004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6fb54d3640 1 --2- 172.21.15.67:0/2487792744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f98004810 0x7f6f98004c90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400a8a0 tx=0x7f6fa401fb20 comp rx=0 tx=0).stop 2024-09-19T05:37:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6faf7fe640 1 -- 172.21.15.67:0/2487792744 reap_dead start 2024-09-19T05:37:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6fb54d3640 1 -- 172.21.15.67:0/2487792744 shutdown_connections 2024-09-19T05:37:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6fb54d3640 1 -- 172.21.15.67:0/2487792744 >> 172.21.15.67:0/2487792744 conn(0x7f6fb00d4490 msgr2=0x7f6fb00d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6fb54d3640 1 -- 172.21.15.67:0/2487792744 shutdown_connections 2024-09-19T05:37:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.413+0000 7f6fb54d3640 1 -- 172.21.15.67:0/2487792744 wait complete. 2024-09-19T05:37:15.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fb54d3640 1 Processor -- start 2024-09-19T05:37:15.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fb54d3640 1 -- start start 2024-09-19T05:37:15.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fb54d3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f98004810 0x7f6fb01f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fb54d3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fb00cabd0 0x7f6fb015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fb54d3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fb00ccb50 0x7f6fb00cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fb54d3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb00d2f80 con 0x7f6fb00cabd0 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fb54d3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb015ea70 con 0x7f6fb00ccb50 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fb54d3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb006db20 con 0x7f6f98004810 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fae7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fb00cabd0 0x7f6fb015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fae7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fb00cabd0 0x7f6fb015bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53138/0 (socket says 172.21.15.67:53138) 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fae7fc640 1 -- 172.21.15.67:0/34743293 learned_addr learned my addr 172.21.15.67:0/34743293 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6faeffd640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f98004810 0x7f6fb01f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fb00ccb50 0x7f6fb00cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fae7fc640 1 -- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f98004810 msgr2=0x7f6fb01f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fae7fc640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f98004810 0x7f6fb01f3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fae7fc640 1 -- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fb00ccb50 msgr2=0x7f6fb00cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fae7fc640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fb00ccb50 0x7f6fb00cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fae7fc640 1 -- 172.21.15.67:0/34743293 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb01f4440 con 0x7f6fb00cabd0 2024-09-19T05:37:15.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fb00ccb50 0x7f6fb00cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:15.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fae7fc640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fb00cabd0 0x7f6fb015bcb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6fa401f950 tx=0x7f6fa401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6f977fe640 1 -- 172.21.15.67:0/34743293 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4004b70 con 0x7f6fb00cabd0 2024-09-19T05:37:15.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6f977fe640 1 -- 172.21.15.67:0/34743293 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa4004d10 con 0x7f6fb00cabd0 2024-09-19T05:37:15.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fb54d3640 1 -- 172.21.15.67:0/34743293 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb01f4720 con 0x7f6fb00cabd0 2024-09-19T05:37:15.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6f977fe640 1 -- 172.21.15.67:0/34743293 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa40aaa20 con 0x7f6fb00cabd0 2024-09-19T05:37:15.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6fb54d3640 1 -- 172.21.15.67:0/34743293 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb00cb050 con 0x7f6fb00cabd0 2024-09-19T05:37:15.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6f977fe640 1 -- 172.21.15.67:0/34743293 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6fa40ba070 con 0x7f6fb00cabd0 2024-09-19T05:37:15.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6f977fe640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f9c0678c0 0x7f6f9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.417+0000 7f6f977fe640 1 -- 172.21.15.67:0/34743293 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f6fa4123b70 con 0x7f6fb00cabd0 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f9c0678c0 0x7f6f9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 Processor -- start 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 -- start start 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f9c0678c0 0x7f6f9c069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00b6750 tx=0x7f6fa0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fe520 0x557f6d1fe900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1fee40 0x557f6d1b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1b5200 0x557f6d1b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557f6d09b800 con 0x557f6d1fe520 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557f6d002a30 con 0x557f6d1b5200 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557f6cfa81e0 con 0x557f6d1fee40 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fe520 0x557f6d1fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fe520 0x557f6d1fe900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53144/0 (socket says 172.21.15.67:53144) 2024-09-19T05:37:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 -- 172.21.15.67:0/697105591 learned_addr learned my addr 172.21.15.67:0/697105591 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/697105591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1b5200 0x557f6d1b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fae7fc640 1 --2- 172.21.15.67:0/697105591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1fee40 0x557f6d1b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 -- 172.21.15.67:0/697105591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1fee40 msgr2=0x557f6d1b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 --2- 172.21.15.67:0/697105591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1fee40 0x557f6d1b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 -- 172.21.15.67:0/697105591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1b5200 msgr2=0x557f6d1b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 --2- 172.21.15.67:0/697105591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1b5200 0x557f6d1b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 -- 172.21.15.67:0/697105591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f6cfbac90 con 0x557f6d1fe520 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6faeffd640 1 --2- 172.21.15.67:0/697105591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fe520 0x557f6d1fe900 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00043b0 tx=0x7f6fa0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3357069cdf8af858 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6f94ff9640 1 -- 172.21.15.67:0/697105591 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0029070 con 0x557f6d1fe520 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6f94ff9640 1 -- 172.21.15.67:0/697105591 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa001f050 con 0x557f6d1fe520 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6f94ff9640 1 -- 172.21.15.67:0/697105591 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00096a0 con 0x557f6d1fe520 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 -- 172.21.15.67:0/697105591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fe520 msgr2=0x557f6d1fe900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 --2- 172.21.15.67:0/697105591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fe520 0x557f6d1fe900 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00043b0 tx=0x7f6fa0016000 comp rx=0 tx=0).stop 2024-09-19T05:37:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 -- 172.21.15.67:0/697105591 shutdown_connections 2024-09-19T05:37:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 --2- 172.21.15.67:0/697105591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1b5200 0x557f6d1b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 --2- 172.21.15.67:0/697105591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1fee40 0x557f6d1b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 --2- 172.21.15.67:0/697105591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fe520 0x557f6d1fe900 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 -- 172.21.15.67:0/697105591 >> 172.21.15.67:0/697105591 conn(0x557f6d1b1180 msgr2=0x557f6d1b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 -- 172.21.15.67:0/697105591 shutdown_connections 2024-09-19T05:37:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 -- 172.21.15.67:0/697105591 wait complete. 2024-09-19T05:37:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 -- start start 2024-09-19T05:37:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.421+0000 7f6fb858f000 1 Processor -- start 2024-09-19T05:37:15.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1b5200 0x557f6d1c0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1fe520 0x557f6d1c0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1c0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557f6cf9c4c0 con 0x557f6d1fee40 2024-09-19T05:37:15.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557f6cffe9f0 con 0x557f6d1fe520 2024-09-19T05:37:15.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557f6d001d40 con 0x557f6d1b5200 2024-09-19T05:37:15.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 10 client.0 _ll_register_callbacks cb 0x557f6d0b63d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:15.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1c0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1c0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53158/0 (socket says 172.21.15.67:53158) 2024-09-19T05:37:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faf7fe640 1 -- 172.21.15.67:0/2534682288 learned_addr learned my addr 172.21.15.67:0/2534682288 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faeffd640 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1b5200 0x557f6d1c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fae7fc640 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1fe520 0x557f6d1c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faf7fe640 1 -- 172.21.15.67:0/2534682288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1b5200 msgr2=0x557f6d1c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1b5200 0x557f6d1c0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faf7fe640 1 -- 172.21.15.67:0/2534682288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1fe520 msgr2=0x557f6d1c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1fe520 0x557f6d1c0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faf7fe640 1 -- 172.21.15.67:0/2534682288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f6cfa8410 con 0x557f6d1fee40 2024-09-19T05:37:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1c0b90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00ba500 tx=0x7f6fa80146c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441006e9e02cc868 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6f8dffb640 1 -- 172.21.15.67:0/2534682288 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa801b030 con 0x557f6d1fee40 2024-09-19T05:37:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6f8dffb640 1 -- 172.21.15.67:0/2534682288 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f6fa8004020 con 0x557f6d1fee40 2024-09-19T05:37:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- 172.21.15.67:0/2534682288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fa001f050 con 0x557f6d1fee40 2024-09-19T05:37:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6f8dffb640 1 -- 172.21.15.67:0/2534682288 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6fa800f040 con 0x557f6d1fee40 2024-09-19T05:37:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 10 client.6108 fetch_fsmap learned FSMap version 27 2024-09-19T05:37:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- 172.21.15.67:0/2534682288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x557f6cfa2440 con 0x557f6d1fee40 2024-09-19T05:37:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6f8dffb640 1 -- 172.21.15.67:0/2534682288 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa001f050 con 0x557f6d1fee40 2024-09-19T05:37:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6f8dffb640 1 -- 172.21.15.67:0/2534682288 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f6fa8029080 con 0x557f6d1fee40 2024-09-19T05:37:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 10 client.6108 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:37:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 10 client.6108 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:37:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 20 client.6108 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557f6d1c15a0 0x557f6d2105d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 4 client.6108 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- 172.21.15.67:0/2534682288 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f6cf9cbf0 con 0x557f6d1c15a0 2024-09-19T05:37:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faeffd640 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557f6d1c15a0 0x557f6d2105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6f8dffb640 10 client.6108 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6faeffd640 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557f6d1c15a0 0x557f6d2105d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f847aa8671116c8 server_cookie=441f00b98e566e98 in_seq=0 out_seq=0 2024-09-19T05:37:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6f8dffb640 1 -- 172.21.15.67:0/2534682288 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f6cf9cbf0 con 0x557f6d1c15a0 2024-09-19T05:37:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6f8dffb640 10 client.6108 handle_command_reply: tid=0 2024-09-19T05:37:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 client.6108 shutdown 2024-09-19T05:37:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- 172.21.15.67:0/2534682288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 msgr2=0x557f6d1c0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1c0b90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00ba500 tx=0x7f6fa80146c0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- 172.21.15.67:0/2534682288 shutdown_connections 2024-09-19T05:37:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1c0b90 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557f6d1c15a0 0x557f6d2105d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1fe520 0x557f6d1c0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6f8dffb640 0 client.6108 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 --2- 172.21.15.67:0/2534682288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1b5200 0x557f6d1c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- 172.21.15.67:0/2534682288 >> 172.21.15.67:0/2534682288 conn(0x557f6d1b1180 msgr2=0x557f6d1b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- 172.21.15.67:0/2534682288 shutdown_connections 2024-09-19T05:37:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 1 -- 172.21.15.67:0/2534682288 wait complete. 2024-09-19T05:37:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.425+0000 7f6fb858f000 20 client.6108 trim_cache size 0 max 16384 2024-09-19T05:37:15.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 Processor -- start 2024-09-19T05:37:15.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 -- start start 2024-09-19T05:37:15.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1b5200 0x557f6d1b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1fe520 0x557f6d1b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0201870 con 0x557f6d1fee40 2024-09-19T05:37:15.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0200850 con 0x557f6d1fe520 2024-09-19T05:37:15.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb01f6690 con 0x557f6d1b5200 2024-09-19T05:37:15.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6faf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6faf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53166/0 (socket says 172.21.15.67:53166) 2024-09-19T05:37:15.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6faf7fe640 1 -- 172.21.15.67:0/3333333075 learned_addr learned my addr 172.21.15.67:0/3333333075 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6faf7fe640 1 -- 172.21.15.67:0/3333333075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1b5200 msgr2=0x557f6d1b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/3333333075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1b5200 0x557f6d1b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6faf7fe640 1 -- 172.21.15.67:0/3333333075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1fe520 msgr2=0x557f6d1b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fae7fc640 1 --2- 172.21.15.67:0/3333333075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1fe520 0x557f6d1b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/3333333075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1fe520 0x557f6d1b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6faf7fe640 1 -- 172.21.15.67:0/3333333075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f6d084810 con 0x557f6d1fee40 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/3333333075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1b42b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8004460 tx=0x7f6fa800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe9e0126746ac6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6f8ffff640 1 -- 172.21.15.67:0/3333333075 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa801b040 con 0x557f6d1fee40 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6f8ffff640 1 -- 172.21.15.67:0/3333333075 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa8017670 con 0x557f6d1fee40 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6f8ffff640 1 -- 172.21.15.67:0/3333333075 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8017a60 con 0x557f6d1fee40 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 -- 172.21.15.67:0/3333333075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 msgr2=0x557f6d1b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 --2- 172.21.15.67:0/3333333075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1b42b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8004460 tx=0x7f6fa800e000 comp rx=0 tx=0).stop 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 -- 172.21.15.67:0/3333333075 shutdown_connections 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 --2- 172.21.15.67:0/3333333075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d1b42b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 --2- 172.21.15.67:0/3333333075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1fe520 0x557f6d1b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 --2- 172.21.15.67:0/3333333075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1b5200 0x557f6d1b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 -- 172.21.15.67:0/3333333075 >> 172.21.15.67:0/3333333075 conn(0x557f6d1b1180 msgr2=0x557f6d1bf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 -- 172.21.15.67:0/3333333075 shutdown_connections 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 -- 172.21.15.67:0/3333333075 wait complete. 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 -- start start 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.441+0000 7f6fb858f000 1 Processor -- start 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1b5200 0x557f6d271940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1fe520 0x557f6d271e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d2723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557f6cfbc800 con 0x557f6d1fee40 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0200200 con 0x557f6d1b5200 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557f6cffe9f0 con 0x557f6d1fe520 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 10 client.0 _ll_register_callbacks cb 0x7f6fa80094c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d2723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d2723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53178/0 (socket says 172.21.15.67:53178) 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faf7fe640 1 -- 172.21.15.67:0/206833969 learned_addr learned my addr 172.21.15.67:0/206833969 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faf7fe640 1 -- 172.21.15.67:0/206833969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1fe520 msgr2=0x557f6d271e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1fe520 0x557f6d271e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faf7fe640 1 -- 172.21.15.67:0/206833969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1b5200 msgr2=0x557f6d271940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1b5200 0x557f6d271940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faf7fe640 1 -- 172.21.15.67:0/206833969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f6cf96380 con 0x557f6d1fee40 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faf7fe640 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d2723c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80046a0 tx=0x7f6fa8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672a6347030fb997 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6f8dffb640 1 -- 172.21.15.67:0/206833969 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa801b040 con 0x557f6d1fee40 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6f8dffb640 1 -- 172.21.15.67:0/206833969 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f6fa8017dc0 con 0x557f6d1fee40 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- 172.21.15.67:0/206833969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fa8017670 con 0x557f6d1fee40 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6f8dffb640 1 -- 172.21.15.67:0/206833969 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6fa803d050 con 0x557f6d1fee40 2024-09-19T05:37:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 10 client.6114 fetch_fsmap learned FSMap version 27 2024-09-19T05:37:15.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- 172.21.15.67:0/206833969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x557f6cf9a560 con 0x557f6d1fee40 2024-09-19T05:37:15.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6f8dffb640 1 -- 172.21.15.67:0/206833969 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa8017670 con 0x557f6d1fee40 2024-09-19T05:37:15.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6f8dffb640 1 -- 172.21.15.67:0/206833969 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f6fa8040020 con 0x557f6d1fee40 2024-09-19T05:37:15.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 10 client.6114 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:37:15.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 10 client.6114 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:37:15.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 20 client.6114 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:15.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557f6d212d60 0x557f6d213140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 4 client.6114 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 28384011}] 2024-09-19T05:37:15.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- 172.21.15.67:0/206833969 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "damage rm", "damage_id": 28384011}) -- 0x557f6d010160 con 0x557f6d212d60 2024-09-19T05:37:15.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faeffd640 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557f6d212d60 0x557f6d213140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6faeffd640 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557f6d212d60 0x557f6d213140 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c474e34a9dac55 server_cookie=1c4719cc0ec137a0 in_seq=0 out_seq=0 2024-09-19T05:37:15.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6f8dffb640 10 client.6114 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:15.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6f8dffb640 1 -- 172.21.15.67:0/206833969 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x557f6d010160 con 0x557f6d212d60 2024-09-19T05:37:15.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6f8dffb640 10 client.6114 handle_command_reply: tid=0 2024-09-19T05:37:15.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 client.6114 shutdown 2024-09-19T05:37:15.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- 172.21.15.67:0/206833969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 msgr2=0x557f6d2723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d2723c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80046a0 tx=0x7f6fa8004740 comp rx=0 tx=0).stop 2024-09-19T05:37:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- 172.21.15.67:0/206833969 shutdown_connections 2024-09-19T05:37:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557f6d1fee40 0x557f6d2723c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557f6d1fe520 0x557f6d271e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x557f6d212d60 0x557f6d213140 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 --2- 172.21.15.67:0/206833969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557f6d1b5200 0x557f6d271940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- 172.21.15.67:0/206833969 >> 172.21.15.67:0/206833969 conn(0x557f6d1b1180 msgr2=0x557f6d1c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6f8dffb640 0 client.6114 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- 172.21.15.67:0/206833969 shutdown_connections 2024-09-19T05:37:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 1 -- 172.21.15.67:0/206833969 wait complete. 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb858f000 20 client.6114 trim_cache size 0 max 16384 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 -- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f9c0678c0 msgr2=0x7f6f9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f9c0678c0 0x7f6f9c069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00b6750 tx=0x7f6fa0008040 comp rx=0 tx=0).stop 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 -- 172.21.15.67:0/34743293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fb00cabd0 msgr2=0x7f6fb015bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fb00cabd0 0x7f6fb015bcb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6fa401f950 tx=0x7f6fa401c8c0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 -- 172.21.15.67:0/34743293 shutdown_connections 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fb00ccb50 0x7f6fb00cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fb00cabd0 0x7f6fb015bcb0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f9c0678c0 0x7f6f9c069d80 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00b6750 tx=0x7f6fa0008040 comp rx=0 tx=0).stop 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 --2- 172.21.15.67:0/34743293 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f98004810 0x7f6fb01f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 -- 172.21.15.67:0/34743293 >> 172.21.15.67:0/34743293 conn(0x7f6fb00d4490 msgr2=0x7f6fb00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 -- 172.21.15.67:0/34743293 shutdown_connections 2024-09-19T05:37:15.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.445+0000 7f6fb54d3640 1 -- 172.21.15.67:0/34743293 wait complete. 2024-09-19T05:37:15.467 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-19T05:37:15.467 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-19T05:37:15.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113c12d640 1 Processor -- start 2024-09-19T05:37:15.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113c12d640 1 -- start start 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113c12d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f113415b1d0 0x7f11340adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113c12d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11340aef30 con 0x7f1134070070 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113c12d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11340ae0f0 con 0x7f113406dfc0 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113c12d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1134072210 con 0x7f113415b1d0 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113a6ca640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1134070070 0x7f11340b3430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58658/0 (socket says 172.21.15.67:58658) 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113a6ca640 1 -- 172.21.15.67:0/665623486 learned_addr learned my addr 172.21.15.67:0/665623486 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1139ec9640 1 --2- 172.21.15.67:0/665623486 >> v2:172.21.15.67:3300/0 conn(0x7f113415b1d0 0x7f11340adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315155470 0 0) 0x7f11340aef30 con 0x7f1134070070 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1120003530 con 0x7f1134070070 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 71057966 0 0) 0x7f1120003530 con 0x7f1134070070 2024-09-19T05:37:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 >> v2:172.21.15.67:3300/0 conn(0x7f113415b1d0 msgr2=0x7f11340adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 --2- 172.21.15.67:0/665623486 >> v2:172.21.15.67:3300/0 conn(0x7f113415b1d0 0x7f11340adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 >> v1:172.21.15.97:6789/0 conn(0x7f113406dfc0 legacy=0x7f113406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11340ae3b0 con 0x7f1134070070 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f112c001a00 con 0x7f1134070070 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1139ec9640 1 --2- 172.21.15.67:0/665623486 >> v2:172.21.15.67:3300/0 conn(0x7f113415b1d0 0x7f11340adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 >> v1:172.21.15.67:6789/0 conn(0x7f1134070070 legacy=0x7f11340b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200039c0 0x7f1120003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1120004810 0x7f1120004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200051d0 0x7f112000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1134072210 con 0x7f11200051d0 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f112000c070 con 0x7f11200039c0 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f112000c270 con 0x7f1120004810 2024-09-19T05:37:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113a6ca640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200051d0 0x7f112000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1139ec9640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200039c0 0x7f1120003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113a6ca640 1 -- 172.21.15.67:0/665623486 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1120004810 msgr2=0x7f1120004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113a6ca640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1120004810 0x7f1120004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113a6ca640 1 -- 172.21.15.67:0/665623486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200039c0 msgr2=0x7f1120003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113a6ca640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200039c0 0x7f1120003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f113a6ca640 1 -- 172.21.15.67:0/665623486 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1120003530 con 0x7f11200051d0 2024-09-19T05:37:15.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.573+0000 7f1139ec9640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200039c0 0x7f1120003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113a6ca640 1 -- 172.21.15.67:0/665623486 reap_dead start 2024-09-19T05:37:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113a6ca640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200051d0 0x7f112000b9d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f11340d1160 tx=0x7f112c01d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ffaf8c32c1101d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c00a480 con 0x7f11200051d0 2024-09-19T05:37:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112c0ac620 con 0x7f11200051d0 2024-09-19T05:37:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f1138ec7640 1 -- 172.21.15.67:0/665623486 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c0ac9f0 con 0x7f11200051d0 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 -- 172.21.15.67:0/665623486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200051d0 msgr2=0x7f112000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200051d0 0x7f112000b9d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f11340d1160 tx=0x7f112c01d320 comp rx=0 tx=0).stop 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 -- 172.21.15.67:0/665623486 shutdown_connections 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 --2- 172.21.15.67:0/665623486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11200051d0 0x7f112000b9d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 -- 172.21.15.67:0/665623486 >> 172.21.15.67:0/665623486 conn(0x7f11340b1e50 msgr2=0x7f11340b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 -- 172.21.15.67:0/665623486 shutdown_connections 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 -- 172.21.15.67:0/665623486 wait complete. 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 Processor -- start 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 -- start start 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200051d0 0x7f11340b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11341f3a60 0x7f11340b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1134151770 0x7f1134151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f11340aec50 con 0x7f1134151770 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f11340ae970 con 0x7f11200051d0 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113c12d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1134072420 con 0x7f11341f3a60 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113a6ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1134151770 0x7f1134151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113a6ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1134151770 0x7f1134151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53206/0 (socket says 172.21.15.67:53206) 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.577+0000 7f113a6ca640 1 -- 172.21.15.67:0/2192874324 learned_addr learned my addr 172.21.15.67:0/2192874324 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f11396c8640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11341f3a60 0x7f11340b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f1139ec9640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200051d0 0x7f11340b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113a6ca640 1 -- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11341f3a60 msgr2=0x7f11340b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113a6ca640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11341f3a60 0x7f11340b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113a6ca640 1 -- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200051d0 msgr2=0x7f11340b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113a6ca640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200051d0 0x7f11340b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113a6ca640 1 -- 172.21.15.67:0/2192874324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11341460e0 con 0x7f1134151770 2024-09-19T05:37:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f1139ec9640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200051d0 0x7f11340b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:15.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113a6ca640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1134151770 0x7f1134151bf0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f112c01d150 tx=0x7f1120005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f112a7fc640 1 -- 172.21.15.67:0/2192874324 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c00a480 con 0x7f1134151770 2024-09-19T05:37:15.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f112a7fc640 1 -- 172.21.15.67:0/2192874324 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112c001950 con 0x7f1134151770 2024-09-19T05:37:15.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113c12d640 1 -- 172.21.15.67:0/2192874324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11341463c0 con 0x7f1134151770 2024-09-19T05:37:15.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f112a7fc640 1 -- 172.21.15.67:0/2192874324 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c0ac7d0 con 0x7f1134151770 2024-09-19T05:37:15.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113c12d640 1 -- 172.21.15.67:0/2192874324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1134146980 con 0x7f1134151770 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113f1e9000 1 Processor -- start 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113f1e9000 1 -- start start 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 0x55d8b7ff46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fab800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b7fac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113f1e9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d8b7e92bd0 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113f1e9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d8b7df99e0 con 0x55d8b7ff42d0 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f113f1e9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d8b7d9f8f0 con 0x55d8b7fabd40 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.581+0000 7f1139ec9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1139ec9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53216/0 (socket says 172.21.15.67:53216) 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1139ec9640 1 -- 172.21.15.67:0/3209792035 learned_addr learned my addr 172.21.15.67:0/3209792035 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f112a7fc640 1 -- 172.21.15.67:0/2192874324 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f112c0ac970 con 0x7f1134151770 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f11396c8640 1 --2- 172.21.15.67:0/3209792035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b7fac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1139ec9640 1 -- 172.21.15.67:0/3209792035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 msgr2=0x55d8b7fac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f11396c8640 1 --2- 172.21.15.67:0/3209792035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 0x55d8b7ff46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1139ec9640 1 --2- 172.21.15.67:0/3209792035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b7fac120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1139ec9640 1 -- 172.21.15.67:0/3209792035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 msgr2=0x55d8b7ff46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1139ec9640 1 --2- 172.21.15.67:0/3209792035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 0x55d8b7ff46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1139ec9640 1 -- 172.21.15.67:0/3209792035 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b7d97970 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f11396c8640 1 --2- 172.21.15.67:0/3209792035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 0x55d8b7ff46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f112a7fc640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11180678f0 0x7f1118069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1139ec9640 1 --2- 172.21.15.67:0/3209792035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fab800 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1124009d20 tx=0x7f1124009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1688ea0e13592ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f112a7fc640 1 -- 172.21.15.67:0/2192874324 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f112c11fe20 con 0x7f1134151770 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f11177fe640 1 -- 172.21.15.67:0/3209792035 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124019070 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f11177fe640 1 -- 172.21.15.67:0/3209792035 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1124015460 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f11177fe640 1 -- 172.21.15.67:0/3209792035 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124015810 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f11396c8640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11180678f0 0x7f1118069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- 172.21.15.67:0/3209792035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 msgr2=0x55d8b7fab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 --2- 172.21.15.67:0/3209792035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fab800 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1124009d20 tx=0x7f1124009190 comp rx=0 tx=0).stop 2024-09-19T05:37:15.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- 172.21.15.67:0/3209792035 shutdown_connections 2024-09-19T05:37:15.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 --2- 172.21.15.67:0/3209792035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b7fac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 --2- 172.21.15.67:0/3209792035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fab800 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 --2- 172.21.15.67:0/3209792035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 0x55d8b7ff46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- 172.21.15.67:0/3209792035 >> 172.21.15.67:0/3209792035 conn(0x55d8b7fa2ba0 msgr2=0x55d8b7faa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- 172.21.15.67:0/3209792035 shutdown_connections 2024-09-19T05:37:15.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f11396c8640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11180678f0 0x7f1118069db0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f113415c6b0 tx=0x7f1130009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- 172.21.15.67:0/3209792035 wait complete. 2024-09-19T05:37:15.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- start start 2024-09-19T05:37:15.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 Processor -- start 2024-09-19T05:37:15.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b7ffac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 0x55d8b7ffb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fb0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d8b7d93a50 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d8b7df59a0 con 0x55d8b7ff42d0 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d8b7eb6330 con 0x55d8b7fabd40 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 10 client.0 _ll_register_callbacks cb 0x55d8b7e5b430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113a6ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fb0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113a6ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fb0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53218/0 (socket says 172.21.15.67:53218) 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113a6ca640 1 -- 172.21.15.67:0/3212612170 learned_addr learned my addr 172.21.15.67:0/3212612170 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1139ec9640 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b7ffac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f11396c8640 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 0x55d8b7ffb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113a6ca640 1 -- 172.21.15.67:0/3212612170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 msgr2=0x55d8b7ffac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113a6ca640 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b7ffac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113a6ca640 1 -- 172.21.15.67:0/3212612170 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 msgr2=0x55d8b7ffb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113a6ca640 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 0x55d8b7ffb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113a6ca640 1 -- 172.21.15.67:0/3212612170 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b7e02650 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1139ec9640 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b7ffac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113a6ca640 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fb0330 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f112c0f8760 tx=0x7f112c0f07b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca185f3ce3de9bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1114ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1114ff9640 1 -- 172.21.15.67:0/3212612170 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c0ace60 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1114ff9640 1 -- 172.21.15.67:0/3212612170 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f112c0f4050 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- 172.21.15.67:0/3212612170 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1124015460 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f1114ff9640 1 -- 172.21.15.67:0/3212612170 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f112c0f4250 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 10 client.6129 fetch_fsmap learned FSMap version 27 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.585+0000 7f113f1e9000 1 -- 172.21.15.67:0/3212612170 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55d8b7d9fb40 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f1114ff9640 1 -- 172.21.15.67:0/3212612170 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1124015460 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f1114ff9640 1 -- 172.21.15.67:0/3212612170 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f112c0c0030 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 10 client.6129 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 10 client.6129 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 20 client.6129 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d8b7fb0d40 0x55d8b7fb1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 4 client.6129 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 -- 172.21.15.67:0/3212612170 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8b7d94020 con 0x55d8b7fb0d40 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f1139ec9640 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d8b7fb0d40 0x55d8b7fb1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f1114ff9640 10 client.6129 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f1139ec9640 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d8b7fb0d40 0x55d8b7fb1120 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68b4a9ff3738545b server_cookie=7427ab84e03e62d6 in_seq=0 out_seq=0 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f1114ff9640 1 -- 172.21.15.67:0/3212612170 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8b7d94020 con 0x55d8b7fb0d40 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f1114ff9640 10 client.6129 handle_command_reply: tid=0 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 client.6129 shutdown 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 -- 172.21.15.67:0/3212612170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 msgr2=0x55d8b7fb0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fb0330 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f112c0f8760 tx=0x7f112c0f07b0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 -- 172.21.15.67:0/3212612170 shutdown_connections 2024-09-19T05:37:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff4bf0 0x55d8b7fb0330 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d8b7fb0d40 0x55d8b7fb1120 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7ff42d0 0x55d8b7ffb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 --2- 172.21.15.67:0/3212612170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b7ffac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f1114ff9640 0 client.6129 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 -- 172.21.15.67:0/3212612170 >> 172.21.15.67:0/3212612170 conn(0x55d8b7fa2ba0 msgr2=0x55d8b7faa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 -- 172.21.15.67:0/3212612170 shutdown_connections 2024-09-19T05:37:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 1 -- 172.21.15.67:0/3212612170 wait complete. 2024-09-19T05:37:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.589+0000 7f113f1e9000 20 client.6129 trim_cache size 0 max 16384 2024-09-19T05:37:15.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 Processor -- start 2024-09-19T05:37:15.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 -- start start 2024-09-19T05:37:15.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7fa2ba0 0x55d8b800b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7fabd40 0x55d8b800b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7ff42d0 0x55d8b7ffda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1134201610 con 0x55d8b7fabd40 2024-09-19T05:37:15.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1134200650 con 0x55d8b7fa2ba0 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f11341ff9e0 con 0x55d8b7ff42d0 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f11396c8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7fabd40 0x55d8b800b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f11396c8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7fabd40 0x55d8b800b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53234/0 (socket says 172.21.15.67:53234) 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f11396c8640 1 -- 172.21.15.67:0/1574687469 learned_addr learned my addr 172.21.15.67:0/1574687469 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f11396c8640 1 -- 172.21.15.67:0/1574687469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7ff42d0 msgr2=0x55d8b7ffda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f11396c8640 1 --2- 172.21.15.67:0/1574687469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7ff42d0 0x55d8b7ffda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f11396c8640 1 -- 172.21.15.67:0/1574687469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7fa2ba0 msgr2=0x55d8b800b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f11396c8640 1 --2- 172.21.15.67:0/1574687469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7fa2ba0 0x55d8b800b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f11396c8640 1 -- 172.21.15.67:0/1574687469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b7d99a00 con 0x55d8b7fabd40 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f11396c8640 1 --2- 172.21.15.67:0/1574687469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7fabd40 0x55d8b800b570 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1130010a50 tx=0x7f1130001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c3cf563bb8dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f1116ffd640 1 -- 172.21.15.67:0/1574687469 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130014d30 con 0x55d8b7fabd40 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f1116ffd640 1 -- 172.21.15.67:0/1574687469 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1130025070 con 0x55d8b7fabd40 2024-09-19T05:37:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f1116ffd640 1 -- 172.21.15.67:0/1574687469 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130020650 con 0x55d8b7fabd40 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 -- 172.21.15.67:0/1574687469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7fabd40 msgr2=0x55d8b800b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 --2- 172.21.15.67:0/1574687469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7fabd40 0x55d8b800b570 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1130010a50 tx=0x7f1130001130 comp rx=0 tx=0).stop 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 -- 172.21.15.67:0/1574687469 shutdown_connections 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 --2- 172.21.15.67:0/1574687469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7ff42d0 0x55d8b7ffda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 --2- 172.21.15.67:0/1574687469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7fabd40 0x55d8b800b570 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 --2- 172.21.15.67:0/1574687469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7fa2ba0 0x55d8b800b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 -- 172.21.15.67:0/1574687469 >> 172.21.15.67:0/1574687469 conn(0x55d8b7fb1fd0 msgr2=0x55d8b7ff3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 -- 172.21.15.67:0/1574687469 shutdown_connections 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 -- 172.21.15.67:0/1574687469 wait complete. 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 -- start start 2024-09-19T05:37:15.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.605+0000 7f113f1e9000 1 Processor -- start 2024-09-19T05:37:15.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7fa2ba0 0x55d8b8000c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b8001190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff42d0 0x55d8b8064080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d8b7fb4e80 con 0x55d8b7ff42d0 2024-09-19T05:37:15.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1134200030 con 0x55d8b7fa2ba0 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d8b7dc4180 con 0x55d8b7fabd40 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 10 client.0 _ll_register_callbacks cb 0x7f112c00a040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113a6ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff42d0 0x55d8b8064080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113a6ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff42d0 0x55d8b8064080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53244/0 (socket says 172.21.15.67:53244) 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113a6ca640 1 -- 172.21.15.67:0/2369555870 learned_addr learned my addr 172.21.15.67:0/2369555870 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113a6ca640 1 -- 172.21.15.67:0/2369555870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 msgr2=0x55d8b8001190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f11396c8640 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b8001190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113a6ca640 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b8001190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113a6ca640 1 -- 172.21.15.67:0/2369555870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7fa2ba0 msgr2=0x55d8b8000c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113a6ca640 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7fa2ba0 0x55d8b8000c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113a6ca640 1 -- 172.21.15.67:0/2369555870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b7db7a50 con 0x55d8b7ff42d0 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113a6ca640 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff42d0 0x55d8b8064080 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f112c0ec4c0 tx=0x7f112c11e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf940ab0c2732c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1114ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1114ff9640 1 -- 172.21.15.67:0/2369555870 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c0efa10 con 0x55d8b7ff42d0 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1114ff9640 1 -- 172.21.15.67:0/2369555870 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f112c117b80 con 0x55d8b7ff42d0 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- 172.21.15.67:0/2369555870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1130025070 con 0x55d8b7ff42d0 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1114ff9640 1 -- 172.21.15.67:0/2369555870 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f112c0f8c90 con 0x55d8b7ff42d0 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 10 client.6135 fetch_fsmap learned FSMap version 27 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- 172.21.15.67:0/2369555870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55d8b7d91b10 con 0x55d8b7ff42d0 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1114ff9640 1 -- 172.21.15.67:0/2369555870 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1130025070 con 0x55d8b7ff42d0 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1114ff9640 1 -- 172.21.15.67:0/2369555870 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f112c0c0040 con 0x55d8b7ff42d0 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 10 client.6135 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 10 client.6135 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 20 client.6135 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d8b7ff4bf0 0x55d8b8064a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 4 client.6135 mds_command: new command op to 5364 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-19T05:37:15.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- 172.21.15.67:0/2369555870 --> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x55d8b7dd6cd0 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1139ec9640 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d8b7ff4bf0 0x55d8b8064a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1114ff9640 10 client.6135 ms_handle_connect on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1139ec9640 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d8b7ff4bf0 0x55d8b8064a70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98d5c76192d678f server_cookie=22805e12293f0de4 in_seq=0 out_seq=0 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1114ff9640 1 -- 172.21.15.67:0/2369555870 <== mds.0 v2:172.21.15.67:6834/985983096 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8b7dd6cd0 con 0x55d8b7ff4bf0 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1114ff9640 10 client.6135 handle_command_reply: tid=0 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 client.6135 shutdown 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- 172.21.15.67:0/2369555870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff42d0 msgr2=0x55d8b8064080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff42d0 0x55d8b8064080 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f112c0ec4c0 tx=0x7f112c11e0f0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- 172.21.15.67:0/2369555870 shutdown_connections 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d8b7ff42d0 0x55d8b8064080 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d8b7fabd40 0x55d8b8001190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.67:6834/985983096,v1:172.21.15.67:6835/985983096] conn(0x55d8b7ff4bf0 0x55d8b8064a70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 --2- 172.21.15.67:0/2369555870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d8b7fa2ba0 0x55d8b8000c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f1114ff9640 0 client.6135 ms_handle_reset on v2:172.21.15.67:6834/985983096 2024-09-19T05:37:15.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- 172.21.15.67:0/2369555870 >> 172.21.15.67:0/2369555870 conn(0x55d8b7fb1fd0 msgr2=0x55d8b800a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- 172.21.15.67:0/2369555870 shutdown_connections 2024-09-19T05:37:15.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 1 -- 172.21.15.67:0/2369555870 wait complete. 2024-09-19T05:37:15.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.609+0000 7f113f1e9000 20 client.6135 trim_cache size 0 max 16384 2024-09-19T05:37:15.620 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:15.620 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:37:15.620 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:37:15.620 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:15.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 -- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11180678f0 msgr2=0x7f1118069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11180678f0 0x7f1118069db0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f113415c6b0 tx=0x7f1130009040 comp rx=0 tx=0).stop 2024-09-19T05:37:15.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 -- 172.21.15.67:0/2192874324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1134151770 msgr2=0x7f1134151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1134151770 0x7f1134151bf0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f112c01d150 tx=0x7f1120005840 comp rx=0 tx=0).stop 2024-09-19T05:37:15.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 -- 172.21.15.67:0/2192874324 shutdown_connections 2024-09-19T05:37:15.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1134151770 0x7f1134151bf0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11180678f0 0x7f1118069db0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11341f3a60 0x7f11340b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 --2- 172.21.15.67:0/2192874324 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11200051d0 0x7f11340b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 -- 172.21.15.67:0/2192874324 >> 172.21.15.67:0/2192874324 conn(0x7f11340b1e50 msgr2=0x7f11341568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 -- 172.21.15.67:0/2192874324 shutdown_connections 2024-09-19T05:37:15.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.613+0000 7f113c12d640 1 -- 172.21.15.67:0/2192874324 wait complete. 2024-09-19T05:37:15.630 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-19T05:37:15.631 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:37:15.631 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:37:15.712 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:37:15.801 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:37:15.801 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:37:15.801 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:37:15.801 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:15.807 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:37:15.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2fa4ab640 1 Processor -- start 2024-09-19T05:37:15.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2fa4ab640 1 -- start start 2024-09-19T05:37:15.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2fa4ab640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f415e330 0x7fb2f4071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2fa4ab640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb2f40b2fd0 0x7fb2f40724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2fa4ab640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb2f40b4bc0 0x7fb2f4161f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2fa4ab640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb2f40acfb0 con 0x7fb2f40b2fd0 2024-09-19T05:37:15.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2fa4ab640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb2f40b3ef0 con 0x7fb2f40b4bc0 2024-09-19T05:37:15.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2fa4ab640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f40b4420 con 0x7fb2f415e330 2024-09-19T05:37:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2f37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb2f40b2fd0 0x7fb2f40724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2f37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb2f40b2fd0 0x7fb2f40724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36026/0 (socket says 172.21.15.67:36026) 2024-09-19T05:37:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2f37fe640 1 -- 172.21.15.67:0/590431087 learned_addr learned my addr 172.21.15.67:0/590431087 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2f8a48640 1 --2- 172.21.15.67:0/590431087 >> v2:172.21.15.97:3300/0 conn(0x7fb2f40b4bc0 0x7fb2f4161f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2f3fff640 1 --2- 172.21.15.67:0/590431087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f415e330 0x7fb2f4071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2f37fe640 1 -- 172.21.15.67:0/590431087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f415e330 msgr2=0x7fb2f4071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2f37fe640 1 --2- 172.21.15.67:0/590431087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f415e330 0x7fb2f4071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2f37fe640 1 -- 172.21.15.67:0/590431087 >> v2:172.21.15.97:3300/0 conn(0x7fb2f40b4bc0 msgr2=0x7fb2f4161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2f37fe640 1 --2- 172.21.15.67:0/590431087 >> v2:172.21.15.97:3300/0 conn(0x7fb2f40b4bc0 0x7fb2f4161f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.977+0000 7fb2f37fe640 1 -- 172.21.15.67:0/590431087 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f40b4140 con 0x7fb2f40b2fd0 2024-09-19T05:37:15.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2f37fe640 1 --2- 172.21.15.67:0/590431087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f40b2fd0 0x7fb2f40724e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40afbf0 tx=0x7fb2e801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d44bd4f42dfaaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2f2ffd640 1 -- 172.21.15.67:0/590431087 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80b0070 con 0x7fb2f40b2fd0 2024-09-19T05:37:15.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2f2ffd640 1 -- 172.21.15.67:0/590431087 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2e80ab600 con 0x7fb2f40b2fd0 2024-09-19T05:37:15.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2f2ffd640 1 -- 172.21.15.67:0/590431087 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80ab9d0 con 0x7fb2f40b2fd0 2024-09-19T05:37:15.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/590431087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f40b2fd0 msgr2=0x7fb2f40724e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 --2- 172.21.15.67:0/590431087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f40b2fd0 0x7fb2f40724e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40afbf0 tx=0x7fb2e801c230 comp rx=0 tx=0).stop 2024-09-19T05:37:15.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/590431087 shutdown_connections 2024-09-19T05:37:15.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 --2- 172.21.15.67:0/590431087 >> v2:172.21.15.97:3300/0 conn(0x7fb2f40b4bc0 0x7fb2f4161f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 --2- 172.21.15.67:0/590431087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f40b2fd0 0x7fb2f40724e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 --2- 172.21.15.67:0/590431087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f415e330 0x7fb2f4071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/590431087 >> 172.21.15.67:0/590431087 conn(0x7fb2f40d0080 msgr2=0x7fb2f40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:15.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/590431087 shutdown_connections 2024-09-19T05:37:15.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/590431087 wait complete. 2024-09-19T05:37:15.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 Processor -- start 2024-09-19T05:37:15.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.981+0000 7fb2fa4ab640 1 -- start start 2024-09-19T05:37:15.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2fa4ab640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f40b4bc0 0x7fb2f41466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2fa4ab640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f415e330 0x7fb2f4099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2fa4ab640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f414cd80 0x7fb2f414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2fa4ab640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f40cfe40 con 0x7fb2f414cd80 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2fa4ab640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f40cfcc0 con 0x7fb2f415e330 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2fa4ab640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f406e6f0 con 0x7fb2f40b4bc0 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f8a48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f414cd80 0x7fb2f414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f8a48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f414cd80 0x7fb2f414d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36040/0 (socket says 172.21.15.67:36040) 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f8a48640 1 -- 172.21.15.67:0/462542321 learned_addr learned my addr 172.21.15.67:0/462542321 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f37fe640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f415e330 0x7fb2f4099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f3fff640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f40b4bc0 0x7fb2f41466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f8a48640 1 -- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f40b4bc0 msgr2=0x7fb2f41466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f8a48640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f40b4bc0 0x7fb2f41466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f8a48640 1 -- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f415e330 msgr2=0x7fb2f4099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f8a48640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f415e330 0x7fb2f4099a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f8a48640 1 -- 172.21.15.67:0/462542321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f4145970 con 0x7fb2f414cd80 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f3fff640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f40b4bc0 0x7fb2f41466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f8a48640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f414cd80 0x7fb2f414d210 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec007e40 tx=0x7fb2ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f0ff9640 1 -- 172.21.15.67:0/462542321 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec014620 con 0x7fb2f414cd80 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f0ff9640 1 -- 172.21.15.67:0/462542321 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ec019070 con 0x7fb2f414cd80 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/462542321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f4145c10 con 0x7fb2f414cd80 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f0ff9640 1 -- 172.21.15.67:0/462542321 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec014a20 con 0x7fb2f414cd80 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/462542321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f41461d0 con 0x7fb2f414cd80 2024-09-19T05:37:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/462542321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f4161f70 con 0x7fb2f414cd80 2024-09-19T05:37:15.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f0ff9640 1 -- 172.21.15.67:0/462542321 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb2ec014bc0 con 0x7fb2f414cd80 2024-09-19T05:37:15.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f0ff9640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2e00678f0 0x7fb2e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:15.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.985+0000 7fb2f0ff9640 1 -- 172.21.15.67:0/462542321 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fb2ec087510 con 0x7fb2f414cd80 2024-09-19T05:37:15.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.989+0000 7fb2f3fff640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2e00678f0 0x7fb2e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:15.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.989+0000 7fb2f3fff640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2e00678f0 0x7fb2e0069db0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009720 tx=0x7fb2e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:15.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:15.989+0000 7fb2f0ff9640 1 -- 172.21.15.67:0/462542321 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb2ec058000 con 0x7fb2f414cd80 2024-09-19T05:37:16.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.169+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/462542321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb2f40cf3b0 con 0x7fb2f414cd80 2024-09-19T05:37:16.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.169+0000 7fb2f0ff9640 1 -- 172.21.15.67:0/462542321 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7fb2ec057900 con 0x7fb2f414cd80 2024-09-19T05:37:16.173 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:37:16.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2e00678f0 msgr2=0x7fb2e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:16.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2e00678f0 0x7fb2e0069db0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009720 tx=0x7fb2e4008040 comp rx=0 tx=0).stop 2024-09-19T05:37:16.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/462542321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f414cd80 msgr2=0x7fb2f414d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:16.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f414cd80 0x7fb2f414d210 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec007e40 tx=0x7fb2ec00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/462542321 shutdown_connections 2024-09-19T05:37:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2f414cd80 0x7fb2f414d210 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f415e330 0x7fb2f4099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2e00678f0 0x7fb2e0069db0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 --2- 172.21.15.67:0/462542321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2f40b4bc0 0x7fb2f41466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/462542321 >> 172.21.15.67:0/462542321 conn(0x7fb2f40d0080 msgr2=0x7fb2f4071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/462542321 shutdown_connections 2024-09-19T05:37:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.173+0000 7fb2fa4ab640 1 -- 172.21.15.67:0/462542321 wait complete. 2024-09-19T05:37:16.194 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:37:16.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:16.194 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:37:16.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[51512]: fuse finished with error 0 and tester_r 0 2024-09-19T05:37:16.212 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:37:16.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:16.213 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:37:16.384 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:37:16.385 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:37:16.385 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:16.391 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:37:16.392 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:37:16.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:16.392 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:37:16.440 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:37:16.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:37:16.441 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:37:16.441 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:37:16.441 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:16.448 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:37:16.448 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:37:16.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:16.448 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:37:16.496 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:37:16.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:37:16.497 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:37:16.497 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:37:16.497 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:16.503 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:37:16.503 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:37:16.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:16.503 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:37:16.551 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:37:16.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:37:16.553 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:16.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71fed5a640 1 Processor -- start 2024-09-19T05:37:16.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71fed5a640 1 -- start start 2024-09-19T05:37:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71fed5a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f71f806f460 0x7f71f806f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71fed5a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f806e3c0 con 0x7f71f806dde0 2024-09-19T05:37:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71fed5a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f806e6a0 con 0x7f71f815c030 2024-09-19T05:37:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71fed5a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f71f806e980 con 0x7f71f806f460 2024-09-19T05:37:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71f7fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f71f806dde0 0x7f71f80b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36936/0 (socket says 172.21.15.67:36936) 2024-09-19T05:37:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71f7fff640 1 -- 172.21.15.67:0/1920316891 learned_addr learned my addr 172.21.15.67:0/1920316891 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:16.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71fd2f7640 1 --2- 172.21.15.67:0/1920316891 >> v2:172.21.15.97:3300/0 conn(0x7f71f806f460 0x7f71f806f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71f77fe640 1 -- 172.21.15.67:0/1920316891 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526140651 0 0) 0x7f71f806e3c0 con 0x7f71f806dde0 2024-09-19T05:37:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71f77fe640 1 -- 172.21.15.67:0/1920316891 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71e8003530 con 0x7f71f806dde0 2024-09-19T05:37:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71f77fe640 1 -- 172.21.15.67:0/1920316891 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2976872100 0 0) 0x7f71e8003530 con 0x7f71f806dde0 2024-09-19T05:37:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71fd2f7640 1 -- 172.21.15.67:0/1920316891 >> v1:172.21.15.97:6789/0 conn(0x7f71f815c030 legacy=0x7f71f815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71fd2f7640 1 -- 172.21.15.67:0/1920316891 >> v1:172.21.15.67:6789/0 conn(0x7f71f806dde0 legacy=0x7f71f80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:16.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.689+0000 7f71fd2f7640 1 -- 172.21.15.67:0/1920316891 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f806ec60 con 0x7f71f806f460 2024-09-19T05:37:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fd2f7640 1 --2- 172.21.15.67:0/1920316891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f806f460 0x7f71f806f870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009d90 tx=0x7f71f001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6989d13c87ea257d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71f77fe640 1 -- 172.21.15.67:0/1920316891 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4001680 con 0x7f71f806f460 2024-09-19T05:37:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71f77fe640 1 -- 172.21.15.67:0/1920316891 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f00a64f0 con 0x7f71f806f460 2024-09-19T05:37:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71f77fe640 1 -- 172.21.15.67:0/1920316891 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f00a68a0 con 0x7f71f806f460 2024-09-19T05:37:16.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 -- 172.21.15.67:0/1920316891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f806f460 msgr2=0x7f71f806f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:16.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 --2- 172.21.15.67:0/1920316891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f806f460 0x7f71f806f870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009d90 tx=0x7f71f001c890 comp rx=0 tx=0).stop 2024-09-19T05:37:16.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 -- 172.21.15.67:0/1920316891 shutdown_connections 2024-09-19T05:37:16.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 --2- 172.21.15.67:0/1920316891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f806f460 0x7f71f806f870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 -- 172.21.15.67:0/1920316891 >> 172.21.15.67:0/1920316891 conn(0x7f71f80d0080 msgr2=0x7f71f80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:16.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 -- 172.21.15.67:0/1920316891 shutdown_connections 2024-09-19T05:37:16.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 -- 172.21.15.67:0/1920316891 wait complete. 2024-09-19T05:37:16.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 Processor -- start 2024-09-19T05:37:16.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 -- start start 2024-09-19T05:37:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71f806dde0 0x7f71f81677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f806f460 0x7f71f8152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f815c030 0x7f71f81533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f71f816a270 con 0x7f71f806dde0 2024-09-19T05:37:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f71f816a0f0 con 0x7f71f806f460 2024-09-19T05:37:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fed5a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f71f816a3f0 con 0x7f71f815c030 2024-09-19T05:37:16.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.693+0000 7f71fcaf6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71f806dde0 0x7f71f81677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fcaf6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71f806dde0 0x7f71f81677c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36054/0 (socket says 172.21.15.67:36054) 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fcaf6640 1 -- 172.21.15.67:0/1255346530 learned_addr learned my addr 172.21.15.67:0/1255346530 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fcaf6640 1 -- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f815c030 msgr2=0x7f71f81533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fd2f7640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f815c030 0x7f71f81533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fcaf6640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f815c030 0x7f71f81533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fcaf6640 1 -- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f806f460 msgr2=0x7f71f8152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71f7fff640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f806f460 0x7f71f8152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fcaf6640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f806f460 0x7f71f8152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fcaf6640 1 -- 172.21.15.67:0/1255346530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f8072a70 con 0x7f71f806dde0 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71f7fff640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f806f460 0x7f71f8152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fcaf6640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71f806dde0 0x7f71f81677c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00c3f0 tx=0x7f71ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:16.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71f57fa640 1 -- 172.21.15.67:0/1255346530 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec017070 con 0x7f71f806dde0 2024-09-19T05:37:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71f57fa640 1 -- 172.21.15.67:0/1255346530 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ec0052d0 con 0x7f71f806dde0 2024-09-19T05:37:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fed5a640 1 -- 172.21.15.67:0/1255346530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f8072d50 con 0x7f71f806dde0 2024-09-19T05:37:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71f57fa640 1 -- 172.21.15.67:0/1255346530 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec003840 con 0x7f71f806dde0 2024-09-19T05:37:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fed5a640 1 -- 172.21.15.67:0/1255346530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f8073310 con 0x7f71f806dde0 2024-09-19T05:37:16.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71fed5a640 1 -- 172.21.15.67:0/1255346530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f806f870 con 0x7f71f806dde0 2024-09-19T05:37:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71f57fa640 1 -- 172.21.15.67:0/1255346530 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f71ec01a070 con 0x7f71f806dde0 2024-09-19T05:37:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71f57fa640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f71dc0678c0 0x7f71dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71f57fa640 1 -- 172.21.15.67:0/1255346530 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f71ec085680 con 0x7f71f806dde0 2024-09-19T05:37:16.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.697+0000 7f71f7fff640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f71dc0678c0 0x7f71dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:16.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.701+0000 7f71f7fff640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f71dc0678c0 0x7f71dc069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f71f81fabc0 tx=0x7f71e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:16.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.701+0000 7f71f57fa640 1 -- 172.21.15.67:0/1255346530 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f71ec021020 con 0x7f71f806dde0 2024-09-19T05:37:16.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.901+0000 7f71fed5a640 1 -- 172.21.15.67:0/1255346530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71f80d0f20 con 0x7f71f806dde0 2024-09-19T05:37:16.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71f57fa640 1 -- 172.21.15.67:0/1255346530 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5218 (secure 0 0 0) 0x7f71ec05ae20 con 0x7f71f806dde0 2024-09-19T05:37:16.907 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:16.907 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"btime":"2024-09-19T05:37:13:394111+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/872634022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":872634022},{"type":"v1","addr":"172.21.15.97:6836","nonce":872634022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2340749382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2340749382},{"type":"v1","addr":"172.21.15.97:6837","nonce":2340749382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1455090407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1455090407},{"type":"v1","addr":"172.21.15.67:6833","nonce":1455090407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:36:32.070002+0000","modified":"2024-09-19T05:37:12.758185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5364":{"gid":5364,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.67:6835/985983096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":985983096},{"type":"v1","addr":"172.21.15.67:6835","nonce":985983096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5364,"qdb_cluster":[5364]},"id":3}]} 2024-09-19T05:37:16.908 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 27 2024-09-19T05:37:16.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 -- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f71dc0678c0 msgr2=0x7f71dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:16.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f71dc0678c0 0x7f71dc069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f71f81fabc0 tx=0x7f71e4009040 comp rx=0 tx=0).stop 2024-09-19T05:37:16.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 -- 172.21.15.67:0/1255346530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71f806dde0 msgr2=0x7f71f81677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:16.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71f806dde0 0x7f71f81677c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00c3f0 tx=0x7f71ec00c8b0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 -- 172.21.15.67:0/1255346530 shutdown_connections 2024-09-19T05:37:16.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f71dc0678c0 0x7f71dc069d80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f815c030 0x7f71f81533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f806f460 0x7f71f8152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 --2- 172.21.15.67:0/1255346530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71f806dde0 0x7f71f81677c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:16.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 -- 172.21.15.67:0/1255346530 >> 172.21.15.67:0/1255346530 conn(0x7f71f80d0080 msgr2=0x7f71f8159630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:16.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 -- 172.21.15.67:0/1255346530 shutdown_connections 2024-09-19T05:37:16.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:16.905+0000 7f71fed5a640 1 -- 172.21.15.67:0/1255346530 wait complete. 2024-09-19T05:37:16.928 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.049+0000 7fc0c4bd8640 1 Processor -- start 2024-09-19T05:37:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.049+0000 7fc0c4bd8640 1 -- start start 2024-09-19T05:37:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0c4bd8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc0c0162630 0x7fc0c0071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0c4bd8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc0c0162a10 0x7fc0c0072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0c4bd8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc0c00cc3c0 0x7fc0c0166380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0c4bd8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc0c006ecc0 con 0x7fc0c0162630 2024-09-19T05:37:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0c4bd8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc0c00cfe80 con 0x7fc0c0162a10 2024-09-19T05:37:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0c4bd8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c006ef50 con 0x7fc0c00cc3c0 2024-09-19T05:37:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0be59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc0c0162630 0x7fc0c0071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0be59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc0c0162630 0x7fc0c0071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36056/0 (socket says 172.21.15.67:36056) 2024-09-19T05:37:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0be59c640 1 -- 172.21.15.67:0/2903082974 learned_addr learned my addr 172.21.15.67:0/2903082974 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0bed9d640 1 --2- 172.21.15.67:0/2903082974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc0c00cc3c0 0x7fc0c0166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0bdd9b640 1 --2- 172.21.15.67:0/2903082974 >> v2:172.21.15.97:3300/0 conn(0x7fc0c0162a10 0x7fc0c0072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0be59c640 1 -- 172.21.15.67:0/2903082974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc0c00cc3c0 msgr2=0x7fc0c0166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0be59c640 1 --2- 172.21.15.67:0/2903082974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc0c00cc3c0 0x7fc0c0166380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0be59c640 1 -- 172.21.15.67:0/2903082974 >> v2:172.21.15.97:3300/0 conn(0x7fc0c0162a10 msgr2=0x7fc0c0072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0be59c640 1 --2- 172.21.15.67:0/2903082974 >> v2:172.21.15.97:3300/0 conn(0x7fc0c0162a10 0x7fc0c0072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0be59c640 1 -- 172.21.15.67:0/2903082974 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c006f230 con 0x7fc0c0162630 2024-09-19T05:37:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.053+0000 7fc0bdd9b640 1 --2- 172.21.15.67:0/2903082974 >> v2:172.21.15.97:3300/0 conn(0x7fc0c0162a10 0x7fc0c0072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:17.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0be59c640 1 --2- 172.21.15.67:0/2903082974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162630 0x7fc0c0071fd0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0073990 tx=0x7fc0b001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2f89ddaf4bd84e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:17.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0bd59a640 1 -- 172.21.15.67:0/2903082974 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00ab620 con 0x7fc0c0162630 2024-09-19T05:37:17.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0bd59a640 1 -- 172.21.15.67:0/2903082974 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b00b0070 con 0x7fc0c0162630 2024-09-19T05:37:17.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0bd59a640 1 -- 172.21.15.67:0/2903082974 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00ab9e0 con 0x7fc0c0162630 2024-09-19T05:37:17.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/2903082974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162630 msgr2=0x7fc0c0071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0c4bd8640 1 --2- 172.21.15.67:0/2903082974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162630 0x7fc0c0071fd0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0073990 tx=0x7fc0b001c460 comp rx=0 tx=0).stop 2024-09-19T05:37:17.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/2903082974 shutdown_connections 2024-09-19T05:37:17.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0c4bd8640 1 --2- 172.21.15.67:0/2903082974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc0c00cc3c0 0x7fc0c0166380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0c4bd8640 1 --2- 172.21.15.67:0/2903082974 >> v2:172.21.15.97:3300/0 conn(0x7fc0c0162a10 0x7fc0c0072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0c4bd8640 1 --2- 172.21.15.67:0/2903082974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162630 0x7fc0c0071fd0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/2903082974 >> 172.21.15.67:0/2903082974 conn(0x7fc0c00d0080 msgr2=0x7fc0c00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:17.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/2903082974 shutdown_connections 2024-09-19T05:37:17.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.057+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/2903082974 wait complete. 2024-09-19T05:37:17.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 Processor -- start 2024-09-19T05:37:17.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 -- start start 2024-09-19T05:37:17.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc0c00cc3c0 0x7fc0c0155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0c0162630 0x7fc0c01513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162a10 0x7fc0c0152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c00b3710 con 0x7fc0c0162a10 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c00b3590 con 0x7fc0c0162630 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c00b3890 con 0x7fc0c00cc3c0 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162a10 0x7fc0c0152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162a10 0x7fc0c0152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36058/0 (socket says 172.21.15.67:36058) 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bed9d640 1 -- 172.21.15.67:0/3423315367 learned_addr learned my addr 172.21.15.67:0/3423315367 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bdd9b640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0c0162630 0x7fc0c01513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0be59c640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc0c00cc3c0 0x7fc0c0155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bed9d640 1 -- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc0c00cc3c0 msgr2=0x7fc0c0155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bed9d640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc0c00cc3c0 0x7fc0c0155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bed9d640 1 -- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0c0162630 msgr2=0x7fc0c01513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bed9d640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0c0162630 0x7fc0c01513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bed9d640 1 -- 172.21.15.67:0/3423315367 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c01532f0 con 0x7fc0c0162a10 2024-09-19T05:37:17.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bdd9b640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0c0162630 0x7fc0c01513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:17.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0bed9d640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162a10 0x7fc0c0152db0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800e880 tx=0x7fc0b800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:17.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0b6ffd640 1 -- 172.21.15.67:0/3423315367 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8017070 con 0x7fc0c0162a10 2024-09-19T05:37:17.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0b6ffd640 1 -- 172.21.15.67:0/3423315367 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b800c940 con 0x7fc0c0162a10 2024-09-19T05:37:17.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0b6ffd640 1 -- 172.21.15.67:0/3423315367 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b800cd10 con 0x7fc0c0162a10 2024-09-19T05:37:17.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/3423315367 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c0151b30 con 0x7fc0c0162a10 2024-09-19T05:37:17.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/3423315367 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c015f7e0 con 0x7fc0c0162a10 2024-09-19T05:37:17.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.061+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/3423315367 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c0166380 con 0x7fc0c0162a10 2024-09-19T05:37:17.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.065+0000 7fc0b6ffd640 1 -- 172.21.15.67:0/3423315367 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc0b801a070 con 0x7fc0c0162a10 2024-09-19T05:37:17.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.065+0000 7fc0b6ffd640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0a00678c0 0x7fc0a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.065+0000 7fc0b6ffd640 1 -- 172.21.15.67:0/3423315367 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fc0b8085d10 con 0x7fc0c0162a10 2024-09-19T05:37:17.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.065+0000 7fc0be59c640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0a00678c0 0x7fc0a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.065+0000 7fc0be59c640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0a00678c0 0x7fc0a0069d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00af000 tx=0x7fc0b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:17.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.069+0000 7fc0b6ffd640 1 -- 172.21.15.67:0/3423315367 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc0b8056720 con 0x7fc0c0162a10 2024-09-19T05:37:17.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.269+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/3423315367 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0c00701a0 con 0x7fc0c0162a10 2024-09-19T05:37:17.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.269+0000 7fc0b6ffd640 1 -- 172.21.15.67:0/3423315367 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5218 (secure 0 0 0) 0x7fc0b8056020 con 0x7fc0c0162a10 2024-09-19T05:37:17.274 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:17.274 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"btime":"2024-09-19T05:37:13:394111+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/872634022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":872634022},{"type":"v1","addr":"172.21.15.97:6836","nonce":872634022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2340749382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2340749382},{"type":"v1","addr":"172.21.15.97:6837","nonce":2340749382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1455090407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1455090407},{"type":"v1","addr":"172.21.15.67:6833","nonce":1455090407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:36:32.070002+0000","modified":"2024-09-19T05:37:12.758185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5364":{"gid":5364,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.67:6835/985983096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":985983096},{"type":"v1","addr":"172.21.15.67:6835","nonce":985983096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5364,"qdb_cluster":[5364]},"id":3}]} 2024-09-19T05:37:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 27 2024-09-19T05:37:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0a00678c0 msgr2=0x7fc0a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0a00678c0 0x7fc0a0069d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00af000 tx=0x7fc0b0008040 comp rx=0 tx=0).stop 2024-09-19T05:37:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/3423315367 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162a10 msgr2=0x7fc0c0152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162a10 0x7fc0c0152db0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800e880 tx=0x7fc0b800ed40 comp rx=0 tx=0).stop 2024-09-19T05:37:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/3423315367 shutdown_connections 2024-09-19T05:37:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c0162a10 0x7fc0c0152db0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0c0162630 0x7fc0c01513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0a00678c0 0x7fc0a0069d80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 --2- 172.21.15.67:0/3423315367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc0c00cc3c0 0x7fc0c0155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/3423315367 >> 172.21.15.67:0/3423315367 conn(0x7fc0c00d0080 msgr2=0x7fc0c00d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/3423315367 shutdown_connections 2024-09-19T05:37:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.273+0000 7fc0c4bd8640 1 -- 172.21.15.67:0/3423315367 wait complete. 2024-09-19T05:37:17.294 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:17.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.413+0000 7f2a0068e640 1 Processor -- start 2024-09-19T05:37:17.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.413+0000 7f2a0068e640 1 -- start start 2024-09-19T05:37:17.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.413+0000 7f2a0068e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29f815c030 0x7f29f806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.413+0000 7f2a0068e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f29f815d1d0 0x7f29f80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.413+0000 7f2a0068e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f806e3c0 con 0x7f29f80b3510 2024-09-19T05:37:17.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.413+0000 7f2a0068e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f29f806e6a0 con 0x7f29f815d1d0 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.413+0000 7f2a0068e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f29f806e980 con 0x7f29f815c030 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fec2b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f29f80b3510 0x7f29f806f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36950/0 (socket says 172.21.15.67:36950) 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fec2b640 1 -- 172.21.15.67:0/2531335161 learned_addr learned my addr 172.21.15.67:0/2531335161 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fdc29640 1 --2- 172.21.15.67:0/2531335161 >> v2:172.21.15.97:3300/0 conn(0x7f29f815d1d0 0x7f29f80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fe42a640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29f815c030 0x7f29f806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528604893 0 0) 0x7f29f806e3c0 con 0x7f29f80b3510 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29e4003530 con 0x7f29f80b3510 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2402336110 0 0) 0x7f29e4003530 con 0x7f29f80b3510 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29f815c030 msgr2=0x7f29f806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29f815c030 0x7f29f806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 >> v2:172.21.15.97:3300/0 conn(0x7f29f815d1d0 msgr2=0x7f29f80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:17.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 --2- 172.21.15.67:0/2531335161 >> v2:172.21.15.97:3300/0 conn(0x7f29f815d1d0 0x7f29f80b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f806ec60 con 0x7f29f80b3510 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f29f0001680 con 0x7f29f80b3510 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 >> v1:172.21.15.67:6789/0 conn(0x7f29f80b3510 legacy=0x7f29f806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e40039c0 0x7f29e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29f815c030 0x7f29e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29e4004d50 0x7f29e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f29f806e6a0 con 0x7f29e40039c0 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f29f806e980 con 0x7f29e4004d50 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f29e400b9d0 con 0x7f29f815c030 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fe42a640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e40039c0 0x7f29e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fdc29640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29f815c030 0x7f29e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fec2b640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29e4004d50 0x7f29e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fe42a640 1 -- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29f815c030 msgr2=0x7f29e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:17.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fe42a640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29f815c030 0x7f29e4004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fe42a640 1 -- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29e4004d50 msgr2=0x7f29e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:17.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fe42a640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29e4004d50 0x7f29e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fe42a640 1 -- 172.21.15.67:0/2531335161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e4003530 con 0x7f29e40039c0 2024-09-19T05:37:17.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fec2b640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29e4004d50 0x7f29e40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:17.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fe42a640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e40039c0 0x7f29e4003de0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009ae0 tx=0x7f29e801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b32e92c2a0b34b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:17.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e80b2070 con 0x7f29e40039c0 2024-09-19T05:37:17.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e80a5520 con 0x7f29e40039c0 2024-09-19T05:37:17.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.417+0000 7f29fd428640 1 -- 172.21.15.67:0/2531335161 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e80096b0 con 0x7f29e40039c0 2024-09-19T05:37:17.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 -- 172.21.15.67:0/2531335161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e40039c0 msgr2=0x7f29e4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 --2- 172.21.15.67:0/2531335161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e40039c0 0x7f29e4003de0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009ae0 tx=0x7f29e801ca40 comp rx=0 tx=0).stop 2024-09-19T05:37:17.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fec2b640 1 -- 172.21.15.67:0/2531335161 reap_dead start 2024-09-19T05:37:17.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 -- 172.21.15.67:0/2531335161 shutdown_connections 2024-09-19T05:37:17.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 -- 172.21.15.67:0/2531335161 >> 172.21.15.67:0/2531335161 conn(0x7f29f80d0080 msgr2=0x7f29f80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:17.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 -- 172.21.15.67:0/2531335161 shutdown_connections 2024-09-19T05:37:17.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 -- 172.21.15.67:0/2531335161 wait complete. 2024-09-19T05:37:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 Processor -- start 2024-09-19T05:37:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 -- start start 2024-09-19T05:37:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29e40039c0 0x7f29f81659d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29f8157470 0x7f29f814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f81651a0 0x7f29f80b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f29f815c590 con 0x7f29f81651a0 2024-09-19T05:37:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f29f815c410 con 0x7f29f8157470 2024-09-19T05:37:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f2a0068e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f29f81670d0 con 0x7f29e40039c0 2024-09-19T05:37:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fec2b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f81651a0 0x7f29f80b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fec2b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f81651a0 0x7f29f80b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36078/0 (socket says 172.21.15.67:36078) 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fec2b640 1 -- 172.21.15.67:0/2861622458 learned_addr learned my addr 172.21.15.67:0/2861622458 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fe42a640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29e40039c0 0x7f29f81659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fdc29640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29f8157470 0x7f29f814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fec2b640 1 -- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29e40039c0 msgr2=0x7f29f81659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fec2b640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29e40039c0 0x7f29f81659d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fec2b640 1 -- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29f8157470 msgr2=0x7f29f814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fec2b640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29f8157470 0x7f29f814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.421+0000 7f29fec2b640 1 -- 172.21.15.67:0/2861622458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f814ca10 con 0x7f29f81651a0 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f29fec2b640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f81651a0 0x7f29f80b4370 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f29f815fca0 tx=0x7f29f000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f29eeffd640 1 -- 172.21.15.67:0/2861622458 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0007230 con 0x7f29f81651a0 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f29eeffd640 1 -- 172.21.15.67:0/2861622458 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f00073d0 con 0x7f29f81651a0 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f2a0068e640 1 -- 172.21.15.67:0/2861622458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f8164100 con 0x7f29f81651a0 2024-09-19T05:37:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f29eeffd640 1 -- 172.21.15.67:0/2861622458 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00047f0 con 0x7f29f81651a0 2024-09-19T05:37:17.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f2a0068e640 1 -- 172.21.15.67:0/2861622458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f81646c0 con 0x7f29f81651a0 2024-09-19T05:37:17.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f2a0068e640 1 -- 172.21.15.67:0/2861622458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f80b2fd0 con 0x7f29f81651a0 2024-09-19T05:37:17.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f29eeffd640 1 -- 172.21.15.67:0/2861622458 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29f0004990 con 0x7f29f81651a0 2024-09-19T05:37:17.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f29eeffd640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29dc0678f0 0x7f29dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f29eeffd640 1 -- 172.21.15.67:0/2861622458 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f29f00859b0 con 0x7f29f81651a0 2024-09-19T05:37:17.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f29fe42a640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29dc0678f0 0x7f29dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.425+0000 7f29fe42a640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29dc0678f0 0x7f29dc069db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f29e80af000 tx=0x7f29e80046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:17.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.429+0000 7f29eeffd640 1 -- 172.21.15.67:0/2861622458 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f29f0056330 con 0x7f29f81651a0 2024-09-19T05:37:17.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.597+0000 7f2a0068e640 1 -- 172.21.15.67:0/2861622458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29f80d0f20 con 0x7f29f81651a0 2024-09-19T05:37:17.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.597+0000 7f29eeffd640 1 -- 172.21.15.67:0/2861622458 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+17005 (secure 0 0 0) 0x7f29f0055c30 con 0x7f29f81651a0 2024-09-19T05:37:17.603 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:17.603 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":57,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:36:58.278864+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:36:29.754631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-19T05:36:31.068405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1","mappings":[{"from":0,"to":6}]},{"pgid":"8.1d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:17.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 -- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29dc0678f0 msgr2=0x7f29dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29dc0678f0 0x7f29dc069db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f29e80af000 tx=0x7f29e80046d0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 -- 172.21.15.67:0/2861622458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f81651a0 msgr2=0x7f29f80b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f81651a0 0x7f29f80b4370 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f29f815fca0 tx=0x7f29f000dc00 comp rx=0 tx=0).stop 2024-09-19T05:37:17.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 -- 172.21.15.67:0/2861622458 shutdown_connections 2024-09-19T05:37:17.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29f81651a0 0x7f29f80b4370 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29f8157470 0x7f29f814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29dc0678f0 0x7f29dc069db0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 --2- 172.21.15.67:0/2861622458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29e40039c0 0x7f29f81659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 -- 172.21.15.67:0/2861622458 >> 172.21.15.67:0/2861622458 conn(0x7f29f80d0080 msgr2=0x7f29f815fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:17.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 -- 172.21.15.67:0/2861622458 shutdown_connections 2024-09-19T05:37:17.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.601+0000 7f2a0068e640 1 -- 172.21.15.67:0/2861622458 wait complete. 2024-09-19T05:37:17.623 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:37:17.623 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:17.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5ac231e640 1 Processor -- start 2024-09-19T05:37:17.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5ac231e640 1 -- start start 2024-09-19T05:37:17.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5ac231e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5abc161da0 0x7f5abc0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5ac231e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5abc0d0e80 0x7f5abc0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5ac231e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0b41c0 0x7f5abc0b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5ac231e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5abc0d1830 con 0x7f5abc161da0 2024-09-19T05:37:17.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5ac231e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5abc0d0840 con 0x7f5abc0d0e80 2024-09-19T05:37:17.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5ac231e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5abc0d4d40 con 0x7f5abc0b41c0 2024-09-19T05:37:17.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5abbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5abc161da0 0x7f5abc0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5abbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5abc161da0 0x7f5abc0d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36084/0 (socket says 172.21.15.67:36084) 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5abbfff640 1 -- 172.21.15.67:0/3335501564 learned_addr learned my addr 172.21.15.67:0/3335501564 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5abb7fe640 1 --2- 172.21.15.67:0/3335501564 >> v2:172.21.15.97:3300/0 conn(0x7f5abc0d0e80 0x7f5abc0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5ac08bb640 1 --2- 172.21.15.67:0/3335501564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0b41c0 0x7f5abc0b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5abbfff640 1 -- 172.21.15.67:0/3335501564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0b41c0 msgr2=0x7f5abc0b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5abbfff640 1 --2- 172.21.15.67:0/3335501564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0b41c0 0x7f5abc0b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5abbfff640 1 -- 172.21.15.67:0/3335501564 >> v2:172.21.15.97:3300/0 conn(0x7f5abc0d0e80 msgr2=0x7f5abc0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5abbfff640 1 --2- 172.21.15.67:0/3335501564 >> v2:172.21.15.97:3300/0 conn(0x7f5abc0d0e80 0x7f5abc0d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5abbfff640 1 -- 172.21.15.67:0/3335501564 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc0d5020 con 0x7f5abc161da0 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5ac08bb640 1 --2- 172.21.15.67:0/3335501564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0b41c0 0x7f5abc0b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:17.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.741+0000 7f5abb7fe640 1 --2- 172.21.15.67:0/3335501564 >> v2:172.21.15.97:3300/0 conn(0x7f5abc0d0e80 0x7f5abc0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:17.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5abbfff640 1 --2- 172.21.15.67:0/3335501564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc161da0 0x7f5abc0d1af0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0d4440 tx=0x7f5ab401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b34fad5d9ad579a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5abaffd640 1 -- 172.21.15.67:0/3335501564 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40a5760 con 0x7f5abc161da0 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5abaffd640 1 -- 172.21.15.67:0/3335501564 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab40a5900 con 0x7f5abc161da0 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5abaffd640 1 -- 172.21.15.67:0/3335501564 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40a5cd0 con 0x7f5abc161da0 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 -- 172.21.15.67:0/3335501564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc161da0 msgr2=0x7f5abc0d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 --2- 172.21.15.67:0/3335501564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc161da0 0x7f5abc0d1af0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0d4440 tx=0x7f5ab401c9f0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 -- 172.21.15.67:0/3335501564 shutdown_connections 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 --2- 172.21.15.67:0/3335501564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0b41c0 0x7f5abc0b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 --2- 172.21.15.67:0/3335501564 >> v2:172.21.15.97:3300/0 conn(0x7f5abc0d0e80 0x7f5abc0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 --2- 172.21.15.67:0/3335501564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc161da0 0x7f5abc0d1af0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 -- 172.21.15.67:0/3335501564 >> 172.21.15.67:0/3335501564 conn(0x7f5abc08bfc0 msgr2=0x7f5abc0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 -- 172.21.15.67:0/3335501564 shutdown_connections 2024-09-19T05:37:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 -- 172.21.15.67:0/3335501564 wait complete. 2024-09-19T05:37:17.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 Processor -- start 2024-09-19T05:37:17.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.745+0000 7f5ac231e640 1 -- start start 2024-09-19T05:37:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac231e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc0b41c0 0x7f5abc14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac231e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0d0e80 0x7f5abc0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac231e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5abc161da0 0x7f5abc0cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac231e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc0cf150 con 0x7f5abc0b41c0 2024-09-19T05:37:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac231e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc162180 con 0x7f5abc161da0 2024-09-19T05:37:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac231e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5abc0cf2d0 con 0x7f5abc0d0e80 2024-09-19T05:37:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc0b41c0 0x7f5abc14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc0b41c0 0x7f5abc14eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36086/0 (socket says 172.21.15.67:36086) 2024-09-19T05:37:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abbfff640 1 -- 172.21.15.67:0/1463384010 learned_addr learned my addr 172.21.15.67:0/1463384010 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abb7fe640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0d0e80 0x7f5abc0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac08bb640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5abc161da0 0x7f5abc0cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abbfff640 1 -- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0d0e80 msgr2=0x7f5abc0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abbfff640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0d0e80 0x7f5abc0cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abbfff640 1 -- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5abc161da0 msgr2=0x7f5abc0cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abbfff640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5abc161da0 0x7f5abc0cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abbfff640 1 -- 172.21.15.67:0/1463384010 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc15a150 con 0x7f5abc0b41c0 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac08bb640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5abc161da0 0x7f5abc0cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abb7fe640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0d0e80 0x7f5abc0cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abbfff640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc0b41c0 0x7f5abc14eff0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40af040 tx=0x7f5ab4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ab8ff9640 1 -- 172.21.15.67:0/1463384010 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40b8670 con 0x7f5abc0b41c0 2024-09-19T05:37:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ab8ff9640 1 -- 172.21.15.67:0/1463384010 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab40be070 con 0x7f5abc0b41c0 2024-09-19T05:37:17.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ab8ff9640 1 -- 172.21.15.67:0/1463384010 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40b8a70 con 0x7f5abc0b41c0 2024-09-19T05:37:17.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac231e640 1 -- 172.21.15.67:0/1463384010 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5abc15a430 con 0x7f5abc0b41c0 2024-09-19T05:37:17.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac231e640 1 -- 172.21.15.67:0/1463384010 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5abc15a9f0 con 0x7f5abc0b41c0 2024-09-19T05:37:17.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ac231e640 1 -- 172.21.15.67:0/1463384010 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5abc0b4630 con 0x7f5abc0b41c0 2024-09-19T05:37:17.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ab8ff9640 1 -- 172.21.15.67:0/1463384010 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ab40b8c10 con 0x7f5abc0b41c0 2024-09-19T05:37:17.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ab8ff9640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a9c0678c0 0x7f5a9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:17.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5ab8ff9640 1 -- 172.21.15.67:0/1463384010 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f5ab4121210 con 0x7f5abc0b41c0 2024-09-19T05:37:17.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.749+0000 7f5abb7fe640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a9c0678c0 0x7f5a9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:17.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.753+0000 7f5abb7fe640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a9c0678c0 0x7f5a9c069d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5abc1fab30 tx=0x7f5aa4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:17.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.757+0000 7f5ab8ff9640 1 -- 172.21.15.67:0/1463384010 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5ab40165e0 con 0x7f5abc0b41c0 2024-09-19T05:37:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 -- 172.21.15.67:0/1463384010 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5abc15c7a0 con 0x7f5abc0b41c0 2024-09-19T05:37:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ab8ff9640 1 -- 172.21.15.67:0/1463384010 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5218 (secure 0 0 0) 0x7f5ab40f1cb0 con 0x7f5abc0b41c0 2024-09-19T05:37:17.957 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:17.957 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"btime":"2024-09-19T05:37:13:394111+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/872634022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":872634022},{"type":"v1","addr":"172.21.15.97:6836","nonce":872634022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2340749382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2340749382},{"type":"v1","addr":"172.21.15.97:6837","nonce":2340749382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1455090407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1455090407},{"type":"v1","addr":"172.21.15.67:6833","nonce":1455090407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:36:32.070002+0000","modified":"2024-09-19T05:37:12.758185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5364":{"gid":5364,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.67:6835/985983096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":985983096},{"type":"v1","addr":"172.21.15.67:6835","nonce":985983096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5364,"qdb_cluster":[5364]},"id":3}]} 2024-09-19T05:37:17.957 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 27 2024-09-19T05:37:17.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 -- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a9c0678c0 msgr2=0x7f5a9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a9c0678c0 0x7f5a9c069d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5abc1fab30 tx=0x7f5aa4008040 comp rx=0 tx=0).stop 2024-09-19T05:37:17.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 -- 172.21.15.67:0/1463384010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc0b41c0 msgr2=0x7f5abc14eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:17.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc0b41c0 0x7f5abc14eff0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40af040 tx=0x7f5ab4019790 comp rx=0 tx=0).stop 2024-09-19T05:37:17.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 -- 172.21.15.67:0/1463384010 shutdown_connections 2024-09-19T05:37:17.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5abc161da0 0x7f5abc0cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a9c0678c0 0x7f5a9c069d80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5abc0d0e80 0x7f5abc0cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 --2- 172.21.15.67:0/1463384010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5abc0b41c0 0x7f5abc14eff0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:17.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 -- 172.21.15.67:0/1463384010 >> 172.21.15.67:0/1463384010 conn(0x7f5abc08bfc0 msgr2=0x7f5abc15f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:17.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 -- 172.21.15.67:0/1463384010 shutdown_connections 2024-09-19T05:37:17.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:17.953+0000 7f5ac231e640 1 -- 172.21.15.67:0/1463384010 wait complete. 2024-09-19T05:37:17.975 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:18.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.089+0000 7fb7a74b0640 1 Processor -- start 2024-09-19T05:37:18.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.089+0000 7fb7a74b0640 1 -- start start 2024-09-19T05:37:18.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb7a74b0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 0x7fb7a00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb7a74b0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a00d4d40 con 0x7fb7a0161da0 2024-09-19T05:37:18.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb7a74b0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a00d5020 con 0x7fb7a00d1590 2024-09-19T05:37:18.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb7a74b0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a00d0840 con 0x7fb7a00b51d0 2024-09-19T05:37:18.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb7a524c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb7a0161da0 0x7fb7a00d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36952/0 (socket says 172.21.15.67:36952) 2024-09-19T05:37:18.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb7a524c640 1 -- 172.21.15.67:0/3597891554 learned_addr learned my addr 172.21.15.67:0/3597891554 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:18.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb7a5a4d640 1 --2- 172.21.15.67:0/3597891554 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 0x7fb7a00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb797fff640 1 -- 172.21.15.67:0/3597891554 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707295464 0 0) 0x7fb7a00d4d40 con 0x7fb7a0161da0 2024-09-19T05:37:18.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb797fff640 1 -- 172.21.15.67:0/3597891554 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb78c003530 con 0x7fb7a0161da0 2024-09-19T05:37:18.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb7a5a4d640 1 -- 172.21.15.67:0/3597891554 >> v1:172.21.15.97:6789/0 conn(0x7fb7a00d1590 legacy=0x7fb7a00cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb797fff640 1 -- 172.21.15.67:0/3597891554 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1221680083 0 0) 0x7fb78c003530 con 0x7fb7a0161da0 2024-09-19T05:37:18.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb7a5a4d640 1 -- 172.21.15.67:0/3597891554 >> v1:172.21.15.67:6789/0 conn(0x7fb7a0161da0 legacy=0x7fb7a00d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.093+0000 7fb7a5a4d640 1 -- 172.21.15.67:0/3597891554 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a00d5300 con 0x7fb7a00b51d0 2024-09-19T05:37:18.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a5a4d640 1 --2- 172.21.15.67:0/3597891554 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 0x7fb7a00d1af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb798009dc0 tx=0x7fb79801c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=842b9dd7866339e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:18.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb797fff640 1 -- 172.21.15.67:0/3597891554 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c0016a0 con 0x7fb7a00b51d0 2024-09-19T05:37:18.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb797fff640 1 -- 172.21.15.67:0/3597891554 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7980a8460 con 0x7fb7a00b51d0 2024-09-19T05:37:18.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb797fff640 1 -- 172.21.15.67:0/3597891554 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7980a8830 con 0x7fb7a00b51d0 2024-09-19T05:37:18.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3597891554 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 msgr2=0x7fb7a00d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 --2- 172.21.15.67:0/3597891554 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 0x7fb7a00d1af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb798009dc0 tx=0x7fb79801c760 comp rx=0 tx=0).stop 2024-09-19T05:37:18.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3597891554 shutdown_connections 2024-09-19T05:37:18.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 --2- 172.21.15.67:0/3597891554 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 0x7fb7a00d1af0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3597891554 >> 172.21.15.67:0/3597891554 conn(0x7fb7a008bfc0 msgr2=0x7fb7a00d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:18.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3597891554 shutdown_connections 2024-09-19T05:37:18.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3597891554 wait complete. 2024-09-19T05:37:18.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 Processor -- start 2024-09-19T05:37:18.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 -- start start 2024-09-19T05:37:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 0x7fb7a00cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a00d1590 0x7fb7a006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a0161da0 0x7fb7a014dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a00d01f0 con 0x7fb7a00d1590 2024-09-19T05:37:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a00d0070 con 0x7fb7a0161da0 2024-09-19T05:37:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a74b0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a00d0370 con 0x7fb7a00b51d0 2024-09-19T05:37:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a4a4b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a00d1590 0x7fb7a006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a4a4b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a00d1590 0x7fb7a006e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36098/0 (socket says 172.21.15.67:36098) 2024-09-19T05:37:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.097+0000 7fb7a4a4b640 1 -- 172.21.15.67:0/3947324517 learned_addr learned my addr 172.21.15.67:0/3947324517 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a5a4d640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a0161da0 0x7fb7a014dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a524c640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 0x7fb7a00cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a4a4b640 1 -- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 msgr2=0x7fb7a00cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a4a4b640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 0x7fb7a00cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a4a4b640 1 -- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a0161da0 msgr2=0x7fb7a014dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a4a4b640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a0161da0 0x7fb7a014dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a4a4b640 1 -- 172.21.15.67:0/3947324517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a006d390 con 0x7fb7a00d1590 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a5a4d640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a0161da0 0x7fb7a014dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a4a4b640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a00d1590 0x7fb7a006e0e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb79000c780 tx=0x7fb79000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb795ffb640 1 -- 172.21.15.67:0/3947324517 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790017070 con 0x7fb7a00d1590 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb795ffb640 1 -- 172.21.15.67:0/3947324517 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb790005270 con 0x7fb7a00d1590 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3947324517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a00cc2e0 con 0x7fb7a00d1590 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb795ffb640 1 -- 172.21.15.67:0/3947324517 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79000a640 con 0x7fb7a00d1590 2024-09-19T05:37:18.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3947324517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a00ccb80 con 0x7fb7a00d1590 2024-09-19T05:37:18.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3947324517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a00d1af0 con 0x7fb7a00d1590 2024-09-19T05:37:18.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb795ffb640 1 -- 172.21.15.67:0/3947324517 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb79001a070 con 0x7fb7a00d1590 2024-09-19T05:37:18.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb795ffb640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7840678f0 0x7fb784069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb795ffb640 1 -- 172.21.15.67:0/3947324517 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fb7900853f0 con 0x7fb7a00d1590 2024-09-19T05:37:18.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a524c640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7840678f0 0x7fb784069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.101+0000 7fb7a524c640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7840678f0 0x7fb784069db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb79c001ec0 tx=0x7fb79c001c30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:18.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.105+0000 7fb795ffb640 1 -- 172.21.15.67:0/3947324517 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb7a006d390 con 0x7fb7a00d1590 2024-09-19T05:37:18.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.305+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3947324517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7a0157960 con 0x7fb7a00d1590 2024-09-19T05:37:18.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.305+0000 7fb795ffb640 1 -- 172.21.15.67:0/3947324517 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5218 (secure 0 0 0) 0x7fb790055ce0 con 0x7fb7a00d1590 2024-09-19T05:37:18.311 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:18.311 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"btime":"2024-09-19T05:37:13:394111+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/872634022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":872634022},{"type":"v1","addr":"172.21.15.97:6836","nonce":872634022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2340749382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2340749382},{"type":"v1","addr":"172.21.15.97:6837","nonce":2340749382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1455090407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1455090407},{"type":"v1","addr":"172.21.15.67:6833","nonce":1455090407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:36:32.070002+0000","modified":"2024-09-19T05:37:12.758185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5364":{"gid":5364,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.67:6835/985983096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":985983096},{"type":"v1","addr":"172.21.15.67:6835","nonce":985983096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5364,"qdb_cluster":[5364]},"id":3}]} 2024-09-19T05:37:18.311 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 27 2024-09-19T05:37:18.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7840678f0 msgr2=0x7fb784069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7840678f0 0x7fb784069db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb79c001ec0 tx=0x7fb79c001c30 comp rx=0 tx=0).stop 2024-09-19T05:37:18.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3947324517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a00d1590 msgr2=0x7fb7a006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a00d1590 0x7fb7a006e0e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb79000c780 tx=0x7fb79000cc40 comp rx=0 tx=0).stop 2024-09-19T05:37:18.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3947324517 shutdown_connections 2024-09-19T05:37:18.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a0161da0 0x7fb7a014dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a00d1590 0x7fb7a006e0e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7840678f0 0x7fb784069db0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 --2- 172.21.15.67:0/3947324517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7a00b51d0 0x7fb7a00cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3947324517 >> 172.21.15.67:0/3947324517 conn(0x7fb7a008bfc0 msgr2=0x7fb7a0157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:18.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3947324517 shutdown_connections 2024-09-19T05:37:18.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.309+0000 7fb7a74b0640 1 -- 172.21.15.67:0/3947324517 wait complete. 2024-09-19T05:37:18.330 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:18.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.449+0000 7f7ff3d9d640 1 Processor -- start 2024-09-19T05:37:18.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.449+0000 7f7ff3d9d640 1 -- start start 2024-09-19T05:37:18.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff3d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7fec15c030 0x7f7fec06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff3d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7fec15d1d0 0x7f7fec0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff3d9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fec06e3c0 con 0x7f7fec0b3510 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff3d9d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7fec06e6a0 con 0x7f7fec15d1d0 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff3d9d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7fec06e980 con 0x7f7fec15c030 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff1338640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7fec15d1d0 0x7f7fec0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff1338640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7fec15d1d0 0x7f7fec0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36112/0 (socket says 172.21.15.67:36112) 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff1338640 1 -- 172.21.15.67:0/410054297 learned_addr learned my addr 172.21.15.67:0/410054297 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff1b39640 1 --2- 172.21.15.67:0/410054297 >> v2:172.21.15.97:3300/0 conn(0x7f7fec15c030 0x7f7fec06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff1338640 1 -- 172.21.15.67:0/410054297 >> v2:172.21.15.97:3300/0 conn(0x7f7fec15c030 msgr2=0x7f7fec06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff1338640 1 --2- 172.21.15.67:0/410054297 >> v2:172.21.15.97:3300/0 conn(0x7f7fec15c030 0x7f7fec06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff1338640 1 -- 172.21.15.67:0/410054297 >> v1:172.21.15.97:6789/0 conn(0x7f7fec0b3510 legacy=0x7f7fec06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:18.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff1338640 1 -- 172.21.15.67:0/410054297 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fec06ec60 con 0x7f7fec15d1d0 2024-09-19T05:37:18.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff1338640 1 --2- 172.21.15.67:0/410054297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15d1d0 0x7f7fec0b2fd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7fec070390 tx=0x7f7fe801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d376a8f6d8ceda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:18.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff0b37640 1 -- 172.21.15.67:0/410054297 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80ab650 con 0x7f7fec15d1d0 2024-09-19T05:37:18.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff0b37640 1 -- 172.21.15.67:0/410054297 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe80b0070 con 0x7f7fec15d1d0 2024-09-19T05:37:18.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.453+0000 7f7ff0b37640 1 -- 172.21.15.67:0/410054297 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80aba10 con 0x7f7fec15d1d0 2024-09-19T05:37:18.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/410054297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15d1d0 msgr2=0x7f7fec0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 --2- 172.21.15.67:0/410054297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15d1d0 0x7f7fec0b2fd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7fec070390 tx=0x7f7fe801c4b0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/410054297 shutdown_connections 2024-09-19T05:37:18.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 --2- 172.21.15.67:0/410054297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15d1d0 0x7f7fec0b2fd0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 --2- 172.21.15.67:0/410054297 >> v2:172.21.15.97:3300/0 conn(0x7f7fec15c030 0x7f7fec06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/410054297 >> 172.21.15.67:0/410054297 conn(0x7f7fec0d0080 msgr2=0x7f7fec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:18.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/410054297 shutdown_connections 2024-09-19T05:37:18.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/410054297 wait complete. 2024-09-19T05:37:18.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 Processor -- start 2024-09-19T05:37:18.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- start start 2024-09-19T05:37:18.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fec0b3510 0x7f7fec149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15c030 0x7f7fec14b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fec15d1d0 0x7f7fec14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec15c590 con 0x7f7fec15c030 2024-09-19T05:37:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec15c410 con 0x7f7fec15d1d0 2024-09-19T05:37:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7fec1690e0 con 0x7f7fec0b3510 2024-09-19T05:37:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1338640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15c030 0x7f7fec14b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1338640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15c030 0x7f7fec14b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36126/0 (socket says 172.21.15.67:36126) 2024-09-19T05:37:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1338640 1 -- 172.21.15.67:0/3752079591 learned_addr learned my addr 172.21.15.67:0/3752079591 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff233a640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fec15d1d0 0x7f7fec14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1b39640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fec0b3510 0x7f7fec149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1338640 1 -- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fec0b3510 msgr2=0x7f7fec149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1338640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fec0b3510 0x7f7fec149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1338640 1 -- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fec15d1d0 msgr2=0x7f7fec14b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1338640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fec15d1d0 0x7f7fec14b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1338640 1 -- 172.21.15.67:0/3752079591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fec154060 con 0x7f7fec15c030 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1b39640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fec0b3510 0x7f7fec149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff1338640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15c030 0x7f7fec14b030 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7fe801ab60 tx=0x7f7fe801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7fe27fc640 1 -- 172.21.15.67:0/3752079591 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80be5f0 con 0x7f7fec15c030 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7fe27fc640 1 -- 172.21.15.67:0/3752079591 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe80be7b0 con 0x7f7fec15c030 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/3752079591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fec154340 con 0x7f7fec15c030 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7fe27fc640 1 -- 172.21.15.67:0/3752079591 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80beba0 con 0x7f7fec15c030 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/3752079591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fec154900 con 0x7f7fec15c030 2024-09-19T05:37:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.457+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/3752079591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fec06dde0 con 0x7f7fec15c030 2024-09-19T05:37:18.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.461+0000 7f7fe27fc640 1 -- 172.21.15.67:0/3752079591 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7fe80b43f0 con 0x7f7fec15c030 2024-09-19T05:37:18.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.461+0000 7f7fe27fc640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fd00678c0 0x7f7fd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.461+0000 7f7fe27fc640 1 -- 172.21.15.67:0/3752079591 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f7fe81203b0 con 0x7f7fec15c030 2024-09-19T05:37:18.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.461+0000 7f7ff1b39640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fd00678c0 0x7f7fd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.461+0000 7f7ff1b39640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fd00678c0 0x7f7fd0069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009840 tx=0x7f7fdc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.465+0000 7f7fe27fc640 1 -- 172.21.15.67:0/3752079591 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7fe80c4060 con 0x7f7fec15c030 2024-09-19T05:37:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.625+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/3752079591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fec0d0f20 con 0x7f7fec15c030 2024-09-19T05:37:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7fe27fc640 1 -- 172.21.15.67:0/3752079591 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+17005 (secure 0 0 0) 0x7f7fe80160d0 con 0x7f7fec15c030 2024-09-19T05:37:18.632 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:18.632 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":57,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:36:58.278864+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:36:29.754631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-19T05:36:31.068405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1","mappings":[{"from":0,"to":6}]},{"pgid":"8.1d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fd00678c0 msgr2=0x7f7fd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fd00678c0 0x7f7fd0069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009840 tx=0x7f7fdc008040 comp rx=0 tx=0).stop 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/3752079591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15c030 msgr2=0x7f7fec14b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15c030 0x7f7fec14b030 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7fe801ab60 tx=0x7f7fe801acf0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/3752079591 shutdown_connections 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fec15d1d0 0x7f7fec14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fec15c030 0x7f7fec14b030 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fd00678c0 0x7f7fd0069d80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 --2- 172.21.15.67:0/3752079591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fec0b3510 0x7f7fec149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/3752079591 >> 172.21.15.67:0/3752079591 conn(0x7f7fec0d0080 msgr2=0x7f7fec154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/3752079591 shutdown_connections 2024-09-19T05:37:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.629+0000 7f7ff3d9d640 1 -- 172.21.15.67:0/3752079591 wait complete. 2024-09-19T05:37:18.650 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:37:18.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a4731640 1 Processor -- start 2024-09-19T05:37:18.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a4731640 1 -- start start 2024-09-19T05:37:18.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a4731640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c161af0 0x7f779c15e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a4731640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c0d0bc0 con 0x7f779c15e550 2024-09-19T05:37:18.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a4731640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c0d0ea0 con 0x7f779c0d0430 2024-09-19T05:37:18.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a4731640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f779c0d1180 con 0x7f779c161af0 2024-09-19T05:37:18.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a24cd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f779c15e550 0x7f779c09b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36968/0 (socket says 172.21.15.67:36968) 2024-09-19T05:37:18.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a24cd640 1 -- 172.21.15.67:0/1904225085 learned_addr learned my addr 172.21.15.67:0/1904225085 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:18.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747090575 0 0) 0x7f779c0d0bc0 con 0x7f779c15e550 2024-09-19T05:37:18.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7788003530 con 0x7f779c15e550 2024-09-19T05:37:18.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.761+0000 7f77a2cce640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c161af0 0x7f779c15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 361253179 0 0) 0x7f7788003530 con 0x7f779c15e550 2024-09-19T05:37:18.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c161af0 msgr2=0x7f779c15e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:18.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c161af0 0x7f779c15e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 >> v1:172.21.15.97:6789/0 conn(0x7f779c0d0430 legacy=0x7f779c1613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c0d1460 con 0x7f779c15e550 2024-09-19T05:37:18.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f778c0016a0 con 0x7f779c15e550 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 >> v1:172.21.15.67:6789/0 conn(0x7f779c15e550 legacy=0x7f779c09b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c161af0 0x7f77880039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7788004020 0x7f7788004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7788004d50 0x7f77880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f779c0d1180 con 0x7f7788004d50 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f778800bb90 con 0x7f7788004020 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f778800bd90 con 0x7f779c161af0 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a2cce640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7788004d50 0x7f77880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a24cd640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c161af0 0x7f77880039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a1ccc640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7788004020 0x7f7788004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a2cce640 1 -- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c161af0 msgr2=0x7f77880039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a2cce640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c161af0 0x7f77880039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a2cce640 1 -- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7788004020 msgr2=0x7f7788004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:18.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a2cce640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7788004020 0x7f7788004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a2cce640 1 -- 172.21.15.67:0/1904225085 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7788003530 con 0x7f7788004d50 2024-09-19T05:37:18.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a2cce640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7788004d50 0x7f77880051d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7794007360 tx=0x7f779401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b12e2eb9dac61c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:18.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77940b2070 con 0x7f7788004d50 2024-09-19T05:37:18.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77940a5d40 con 0x7f7788004d50 2024-09-19T05:37:18.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a14cb640 1 -- 172.21.15.67:0/1904225085 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794009be0 con 0x7f7788004d50 2024-09-19T05:37:18.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a4731640 1 -- 172.21.15.67:0/1904225085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7788004d50 msgr2=0x7f77880051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a4731640 1 --2- 172.21.15.67:0/1904225085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7788004d50 0x7f77880051d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7794007360 tx=0x7f779401ce40 comp rx=0 tx=0).stop 2024-09-19T05:37:18.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a2cce640 1 -- 172.21.15.67:0/1904225085 reap_dead start 2024-09-19T05:37:18.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a4731640 1 -- 172.21.15.67:0/1904225085 shutdown_connections 2024-09-19T05:37:18.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a4731640 1 -- 172.21.15.67:0/1904225085 >> 172.21.15.67:0/1904225085 conn(0x7f779c0b3d90 msgr2=0x7f779c0b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:18.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.765+0000 7f77a4731640 1 -- 172.21.15.67:0/1904225085 shutdown_connections 2024-09-19T05:37:18.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 -- 172.21.15.67:0/1904225085 wait complete. 2024-09-19T05:37:18.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 Processor -- start 2024-09-19T05:37:18.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 -- start start 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f779c1f4b60 0x7f779c0c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f779c1f4f40 0x7f779c0b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c0cf3c0 0x7f779c0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f779c0d08a0 con 0x7f779c1f4b60 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f779c15fe50 con 0x7f779c1f4f40 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f779c071440 con 0x7f779c0cf3c0 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a24cd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f779c1f4b60 0x7f779c0c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a24cd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f779c1f4b60 0x7f779c0c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36138/0 (socket says 172.21.15.67:36138) 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a24cd640 1 -- 172.21.15.67:0/2277235352 learned_addr learned my addr 172.21.15.67:0/2277235352 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a1ccc640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f779c1f4f40 0x7f779c0b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a2cce640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c0cf3c0 0x7f779c0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a24cd640 1 -- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c0cf3c0 msgr2=0x7f779c0c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a24cd640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c0cf3c0 0x7f779c0c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a24cd640 1 -- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f779c1f4f40 msgr2=0x7f779c0b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a24cd640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f779c1f4f40 0x7f779c0b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a24cd640 1 -- 172.21.15.67:0/2277235352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c0b7e00 con 0x7f779c1f4b60 2024-09-19T05:37:18.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a24cd640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f779c1f4b60 0x7f779c0c67a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f778c00eb80 tx=0x7f778c00c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:18.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f7792ffd640 1 -- 172.21.15.67:0/2277235352 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c00ee80 con 0x7f779c1f4b60 2024-09-19T05:37:18.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f7792ffd640 1 -- 172.21.15.67:0/2277235352 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c018070 con 0x7f779c1f4b60 2024-09-19T05:37:18.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 -- 172.21.15.67:0/2277235352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779c0b15c0 con 0x7f779c1f4b60 2024-09-19T05:37:18.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f7792ffd640 1 -- 172.21.15.67:0/2277235352 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c00ce00 con 0x7f779c1f4b60 2024-09-19T05:37:18.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.769+0000 7f77a4731640 1 -- 172.21.15.67:0/2277235352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f779c0b1860 con 0x7f779c1f4b60 2024-09-19T05:37:18.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.773+0000 7f77a4731640 1 -- 172.21.15.67:0/2277235352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f779c0d0a20 con 0x7f779c1f4b60 2024-09-19T05:37:18.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.773+0000 7f7792ffd640 1 -- 172.21.15.67:0/2277235352 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f778c013420 con 0x7f779c1f4b60 2024-09-19T05:37:18.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.773+0000 7f7792ffd640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77800678f0 0x7f7780069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:18.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.773+0000 7f7792ffd640 1 -- 172.21.15.67:0/2277235352 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f778c085aa0 con 0x7f779c1f4b60 2024-09-19T05:37:18.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.773+0000 7f77a1ccc640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77800678f0 0x7f7780069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:18.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.773+0000 7f77a1ccc640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77800678f0 0x7f7780069db0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f779c15fc40 tx=0x7f7798009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:18.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.777+0000 7f7792ffd640 1 -- 172.21.15.67:0/2277235352 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f778c0564b0 con 0x7f779c1f4b60 2024-09-19T05:37:18.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.977+0000 7f77a4731640 1 -- 172.21.15.67:0/2277235352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f779c06e830 con 0x7f779c1f4b60 2024-09-19T05:37:18.980 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:37:18.977+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:37:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.977+0000 7f7792ffd640 1 -- 172.21.15.67:0/2277235352 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f778c055db0 con 0x7f779c1f4b60 2024-09-19T05:37:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:37:18.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.981+0000 7f77a4731640 1 -- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77800678f0 msgr2=0x7f7780069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.981+0000 7f77a4731640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77800678f0 0x7f7780069db0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f779c15fc40 tx=0x7f7798009040 comp rx=0 tx=0).stop 2024-09-19T05:37:18.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.981+0000 7f77a4731640 1 -- 172.21.15.67:0/2277235352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f779c1f4b60 msgr2=0x7f779c0c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:18.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.981+0000 7f77a4731640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f779c1f4b60 0x7f779c0c67a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f778c00eb80 tx=0x7f778c00c4b0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.981+0000 7f77a4731640 1 -- 172.21.15.67:0/2277235352 shutdown_connections 2024-09-19T05:37:18.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.981+0000 7f77a4731640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77800678f0 0x7f7780069db0 secure :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f779c15fc40 tx=0x7f7798009040 comp rx=0 tx=0).stop 2024-09-19T05:37:18.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.981+0000 7f77a4731640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f779c0cf3c0 0x7f779c0c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.981+0000 7f77a4731640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f779c1f4f40 0x7f779c0b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.981+0000 7f77a4731640 1 --2- 172.21.15.67:0/2277235352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f779c1f4b60 0x7f779c0c67a0 secure :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f778c00eb80 tx=0x7f778c00c4b0 comp rx=0 tx=0).stop 2024-09-19T05:37:18.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.981+0000 7f77a4731640 1 -- 172.21.15.67:0/2277235352 >> 172.21.15.67:0/2277235352 conn(0x7f779c0b3d90 msgr2=0x7f779c161f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:18.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.985+0000 7f77a4731640 1 -- 172.21.15.67:0/2277235352 shutdown_connections 2024-09-19T05:37:18.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:18.985+0000 7f77a4731640 1 -- 172.21.15.67:0/2277235352 wait complete. 2024-09-19T05:37:18.999 INFO:tasks.ceph.mds.c.smithi067.stderr: -3608> 2024-09-19T05:37:09.369+0000 7f5fda2c3640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4b [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v791 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5529=0-4194304@1} caps={5529=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5529 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x5593690c6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a4b:[<0x10000000001/new_file_1 v791>,<0x10000000000/ceph-qa-suite v98>,<0x1/scrub_test_path v47>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-19T05:37:19.004 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:37:19.037 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:37:19.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.133+0000 7f8406a68640 1 Processor -- start 2024-09-19T05:37:19.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.133+0000 7f8406a68640 1 -- start start 2024-09-19T05:37:19.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8406a68640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84000d4fb0 0x7f84000d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:19.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8406a68640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84000d35a0 con 0x7f84000d13c0 2024-09-19T05:37:19.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8406a68640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84000d32c0 con 0x7f840015e690 2024-09-19T05:37:19.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8406a68640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f840006d040 con 0x7f84000d4fb0 2024-09-19T05:37:19.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8405005640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f84000d13c0 0x7f840006db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36978/0 (socket says 172.21.15.67:36978) 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8405005640 1 -- 172.21.15.67:0/2443678227 learned_addr learned my addr 172.21.15.67:0/2443678227 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83fffff640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84000d4fb0 0x7f84000d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194358003 0 0) 0x7f84000d35a0 con 0x7f84000d13c0 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83f0003530 con 0x7f84000d13c0 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1456572277 0 0) 0x7f83f0003530 con 0x7f84000d13c0 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84000d4fb0 msgr2=0x7f84000d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84000d4fb0 0x7f84000d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 >> v1:172.21.15.97:6789/0 conn(0x7f840015e690 legacy=0x7f84000d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840006d320 con 0x7f84000d13c0 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f83f8001a00 con 0x7f84000d13c0 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 >> v1:172.21.15.67:6789/0 conn(0x7f84000d13c0 legacy=0x7f840006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84000d4fb0 0x7f83f00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:19.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83f0003f70 0x7f83f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83f0004d50 0x7f83f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f840006d040 con 0x7f83f0004d50 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f83f000bab0 con 0x7f83f0003f70 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f83f000bcb0 con 0x7f84000d4fb0 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8405005640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83f0004d50 0x7f83f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8404804640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84000d4fb0 0x7f83f00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f83fffff640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83f0003f70 0x7f83f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8405005640 1 -- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84000d4fb0 msgr2=0x7f83f00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8405005640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84000d4fb0 0x7f83f00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8405005640 1 -- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83f0003f70 msgr2=0x7f83f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8405005640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83f0003f70 0x7f83f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:19.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8405005640 1 -- 172.21.15.67:0/2443678227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f0003530 con 0x7f83f0004d50 2024-09-19T05:37:19.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.137+0000 7f8405005640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83f0004d50 0x7f83f00051d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f83f800a850 tx=0x7f83f801d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333ec369ee247281 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:19.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f800a4a0 con 0x7f83f0004d50 2024-09-19T05:37:19.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f80ad650 con 0x7f83f0004d50 2024-09-19T05:37:19.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f83ff7fe640 1 -- 172.21.15.67:0/2443678227 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f80ada80 con 0x7f83f0004d50 2024-09-19T05:37:19.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- 172.21.15.67:0/2443678227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83f0004d50 msgr2=0x7f83f00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:19.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 --2- 172.21.15.67:0/2443678227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83f0004d50 0x7f83f00051d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f83f800a850 tx=0x7f83f801d3a0 comp rx=0 tx=0).stop 2024-09-19T05:37:19.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8405005640 1 -- 172.21.15.67:0/2443678227 reap_dead start 2024-09-19T05:37:19.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- 172.21.15.67:0/2443678227 shutdown_connections 2024-09-19T05:37:19.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- 172.21.15.67:0/2443678227 >> 172.21.15.67:0/2443678227 conn(0x7f84000d4490 msgr2=0x7f84000d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:19.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- 172.21.15.67:0/2443678227 shutdown_connections 2024-09-19T05:37:19.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- 172.21.15.67:0/2443678227 wait complete. 2024-09-19T05:37:19.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 Processor -- start 2024-09-19T05:37:19.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- start start 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84001588d0 0x7f84000b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8400158cb0 0x7f84000b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84000b24d0 0x7f84001f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f84000d0e80 con 0x7f84000b24d0 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f840015ea70 con 0x7f84001588d0 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f84000d1000 con 0x7f8400158cb0 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8405005640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84000b24d0 0x7f84001f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8405005640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84000b24d0 0x7f84001f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36182/0 (socket says 172.21.15.67:36182) 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8405005640 1 -- 172.21.15.67:0/3511654744 learned_addr learned my addr 172.21.15.67:0/3511654744 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f83fffff640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8400158cb0 0x7f84000b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8404804640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84001588d0 0x7f84000b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8405005640 1 -- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8400158cb0 msgr2=0x7f84000b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8405005640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8400158cb0 0x7f84000b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8405005640 1 -- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84001588d0 msgr2=0x7f84000b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8405005640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84001588d0 0x7f84000b7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8405005640 1 -- 172.21.15.67:0/3511654744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84000b81e0 con 0x7f84000b24d0 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8404804640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84001588d0 0x7f84000b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8405005640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84000b24d0 0x7f84001f7650 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f83f801d1d0 tx=0x7f83f0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f83fd7fa640 1 -- 172.21.15.67:0/3511654744 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f800a480 con 0x7f84000b24d0 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f83fd7fa640 1 -- 172.21.15.67:0/3511654744 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f80ad430 con 0x7f84000b24d0 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- 172.21.15.67:0/3511654744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84000cb720 con 0x7f84000b24d0 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f83fd7fa640 1 -- 172.21.15.67:0/3511654744 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8001800 con 0x7f84000b24d0 2024-09-19T05:37:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.141+0000 7f8406a68640 1 -- 172.21.15.67:0/3511654744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84000ccc50 con 0x7f84000b24d0 2024-09-19T05:37:19.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.145+0000 7f8406a68640 1 -- 172.21.15.67:0/3511654744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84000d2a40 con 0x7f84000b24d0 2024-09-19T05:37:19.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.145+0000 7f83fd7fa640 1 -- 172.21.15.67:0/3511654744 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83f80bd060 con 0x7f84000b24d0 2024-09-19T05:37:19.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.145+0000 7f83fd7fa640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83e40678c0 0x7f83e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:19.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.145+0000 7f83fd7fa640 1 -- 172.21.15.67:0/3511654744 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6245+0+0 (secure 0 0 0) 0x7f83f811f780 con 0x7f84000b24d0 2024-09-19T05:37:19.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.145+0000 7f8404804640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83e40678c0 0x7f83e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:19.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.145+0000 7f8404804640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83e40678c0 0x7f83e4069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f83f40016e0 tx=0x7f83f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:19.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.149+0000 7f83fd7fa640 1 -- 172.21.15.67:0/3511654744 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f83f80170b0 con 0x7f84000b24d0 2024-09-19T05:37:19.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.349+0000 7f8406a68640 1 -- 172.21.15.67:0/3511654744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f84000d4250 con 0x7f84000b24d0 2024-09-19T05:37:19.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.981+0000 7f83fd7fa640 1 -- 172.21.15.67:0/3511654744 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f83f80be3b0 con 0x7f84000b24d0 2024-09-19T05:37:19.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 -- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83e40678c0 msgr2=0x7f83e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:19.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83e40678c0 0x7f83e4069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f83f40016e0 tx=0x7f83f4009040 comp rx=0 tx=0).stop 2024-09-19T05:37:19.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 -- 172.21.15.67:0/3511654744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84000b24d0 msgr2=0x7f84001f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:19.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84000b24d0 0x7f84001f7650 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f83f801d1d0 tx=0x7f83f0005840 comp rx=0 tx=0).stop 2024-09-19T05:37:19.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 -- 172.21.15.67:0/3511654744 shutdown_connections 2024-09-19T05:37:19.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84000b24d0 0x7f84001f7650 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:19.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83e40678c0 0x7f83e4069d80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:19.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8400158cb0 0x7f84000b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:19.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 --2- 172.21.15.67:0/3511654744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84001588d0 0x7f84000b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:19.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 -- 172.21.15.67:0/3511654744 >> 172.21.15.67:0/3511654744 conn(0x7f84000d4490 msgr2=0x7f84000b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:19.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 -- 172.21.15.67:0/3511654744 shutdown_connections 2024-09-19T05:37:19.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:19.985+0000 7f8406a68640 1 -- 172.21.15.67:0/3511654744 wait complete. 2024-09-19T05:37:20.016 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:37:20.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.189+0000 7f790dfe1640 1 Processor -- start 2024-09-19T05:37:20.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.189+0000 7f790dfe1640 1 -- start start 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79080738b0 0x7f790815c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79080d0990 0x7f790815f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79080b4e00 con 0x7f79080d0520 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f790815c5c0 con 0x7f79080738b0 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f79080b3500 con 0x7f79080d0990 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f79077fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79080738b0 0x7f790815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f7906ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f79080d0520 0x7f790815ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36988/0 (socket says 172.21.15.67:36988) 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f7906ffd640 1 -- 172.21.15.67:0/502107387 learned_addr learned my addr 172.21.15.67:0/502107387 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f7907fff640 1 --2- 172.21.15.67:0/502107387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79080d0990 0x7f790815f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f79077fe640 1 -- 172.21.15.67:0/502107387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79080d0990 msgr2=0x7f790815f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f79077fe640 1 --2- 172.21.15.67:0/502107387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79080d0990 0x7f790815f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f79077fe640 1 -- 172.21.15.67:0/502107387 >> v1:172.21.15.67:6789/0 conn(0x7f79080d0520 legacy=0x7f790815ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f79077fe640 1 -- 172.21.15.67:0/502107387 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79080b37e0 con 0x7f79080738b0 2024-09-19T05:37:20.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f79067fc640 1 -- 172.21.15.67:0/502107387 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444157652 0 0) 0x7f79080b4e00 con 0x7f79080d0520 2024-09-19T05:37:20.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f79077fe640 1 --2- 172.21.15.67:0/502107387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080738b0 0x7f790815c080 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f78f80097c0 tx=0x7f78f801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df179dcc1296b7f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:20.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f79067fc640 1 -- 172.21.15.67:0/502107387 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80b0070 con 0x7f79080738b0 2024-09-19T05:37:20.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f79067fc640 1 -- 172.21.15.67:0/502107387 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f80ab600 con 0x7f79080738b0 2024-09-19T05:37:20.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f79067fc640 1 -- 172.21.15.67:0/502107387 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80ab9d0 con 0x7f79080738b0 2024-09-19T05:37:20.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 -- 172.21.15.67:0/502107387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080738b0 msgr2=0x7f790815c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 --2- 172.21.15.67:0/502107387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080738b0 0x7f790815c080 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f78f80097c0 tx=0x7f78f801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 -- 172.21.15.67:0/502107387 shutdown_connections 2024-09-19T05:37:20.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 --2- 172.21.15.67:0/502107387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79080d0990 0x7f790815f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 --2- 172.21.15.67:0/502107387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080738b0 0x7f790815c080 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 -- 172.21.15.67:0/502107387 >> 172.21.15.67:0/502107387 conn(0x7f790806c0c0 msgr2=0x7f790806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:20.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 -- 172.21.15.67:0/502107387 shutdown_connections 2024-09-19T05:37:20.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.193+0000 7f790dfe1640 1 -- 172.21.15.67:0/502107387 wait complete. 2024-09-19T05:37:20.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f790dfe1640 1 Processor -- start 2024-09-19T05:37:20.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f790dfe1640 1 -- start start 2024-09-19T05:37:20.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f790dfe1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79080738b0 0x7f79080cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f790dfe1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080d0520 0x7f79080af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f790dfe1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79080d0990 0x7f79080b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f790dfe1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f79080d0da0 con 0x7f79080d0520 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f790dfe1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7908073c90 con 0x7f79080d0990 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f790dfe1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f79080b30b0 con 0x7f79080738b0 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f7906ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080d0520 0x7f79080af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f7906ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080d0520 0x7f79080af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36210/0 (socket says 172.21.15.67:36210) 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f7906ffd640 1 -- 172.21.15.67:0/1842393262 learned_addr learned my addr 172.21.15.67:0/1842393262 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f7907fff640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79080d0990 0x7f79080b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f79077fe640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79080738b0 0x7f79080cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f7906ffd640 1 -- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79080738b0 msgr2=0x7f79080cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f7906ffd640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79080738b0 0x7f79080cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f7906ffd640 1 -- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79080d0990 msgr2=0x7f79080b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f7906ffd640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79080d0990 0x7f79080b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f7906ffd640 1 -- 172.21.15.67:0/1842393262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79080b01e0 con 0x7f79080d0520 2024-09-19T05:37:20.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f7906ffd640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080d0520 0x7f79080af9b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c520 tx=0x7f78f000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:20.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f78fffff640 1 -- 172.21.15.67:0/1842393262 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0018070 con 0x7f79080d0520 2024-09-19T05:37:20.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f78fffff640 1 -- 172.21.15.67:0/1842393262 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f00074e0 con 0x7f79080d0520 2024-09-19T05:37:20.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f78fffff640 1 -- 172.21.15.67:0/1842393262 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f00049f0 con 0x7f79080d0520 2024-09-19T05:37:20.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f790dfe1640 1 -- 172.21.15.67:0/1842393262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79080b04c0 con 0x7f79080d0520 2024-09-19T05:37:20.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.197+0000 7f790dfe1640 1 -- 172.21.15.67:0/1842393262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79080b0a80 con 0x7f79080d0520 2024-09-19T05:37:20.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.201+0000 7f790dfe1640 1 -- 172.21.15.67:0/1842393262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79080b5390 con 0x7f79080d0520 2024-09-19T05:37:20.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.201+0000 7f78fffff640 1 -- 172.21.15.67:0/1842393262 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78f0004b90 con 0x7f79080d0520 2024-09-19T05:37:20.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.201+0000 7f78fffff640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78e80678c0 0x7f78e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.201+0000 7f78fffff640 1 -- 172.21.15.67:0/1842393262 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6245+0+0 (secure 0 0 0) 0x7f78f00850b0 con 0x7f79080d0520 2024-09-19T05:37:20.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.201+0000 7f79077fe640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78e80678c0 0x7f78e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.201+0000 7f79077fe640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78e80678c0 0x7f78e8069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f78f80ad000 tx=0x7f78f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:20.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.205+0000 7f78fffff640 1 -- 172.21.15.67:0/1842393262 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f78f0055410 con 0x7f79080d0520 2024-09-19T05:37:20.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:20.369+0000 7f790dfe1640 1 -- 172.21.15.67:0/1842393262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7908156be0 con 0x7f79080d0520 2024-09-19T05:37:21.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.269+0000 7f78fffff640 1 -- 172.21.15.67:0/1842393262 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) ==== 181+0+0 (secure 0 0 0) 0x7f78f0059710 con 0x7f79080d0520 2024-09-19T05:37:21.273 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:37:21.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 -- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78e80678c0 msgr2=0x7f78e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78e80678c0 0x7f78e8069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f78f80ad000 tx=0x7f78f8008040 comp rx=0 tx=0).stop 2024-09-19T05:37:21.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 -- 172.21.15.67:0/1842393262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080d0520 msgr2=0x7f79080af9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080d0520 0x7f79080af9b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c520 tx=0x7f78f000c9e0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 -- 172.21.15.67:0/1842393262 shutdown_connections 2024-09-19T05:37:21.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79080d0990 0x7f79080b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79080d0520 0x7f79080af9b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78e80678c0 0x7f78e8069d80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 --2- 172.21.15.67:0/1842393262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79080738b0 0x7f79080cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 -- 172.21.15.67:0/1842393262 >> 172.21.15.67:0/1842393262 conn(0x7f790806c0c0 msgr2=0x7f790815d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 -- 172.21.15.67:0/1842393262 shutdown_connections 2024-09-19T05:37:21.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.273+0000 7f790dfe1640 1 -- 172.21.15.67:0/1842393262 wait complete. 2024-09-19T05:37:21.300 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:37:21.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.425+0000 7f58ea1bc640 1 Processor -- start 2024-09-19T05:37:21.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.425+0000 7f58ea1bc640 1 -- start start 2024-09-19T05:37:21.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.425+0000 7f58ea1bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58e40b24c0 0x7f58e40ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.425+0000 7f58ea1bc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f58e406c3d0 0x7f58e40b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.425+0000 7f58ea1bc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e40b2c30 con 0x7f58e4145e20 2024-09-19T05:37:21.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.425+0000 7f58ea1bc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f58e40b0c30 con 0x7f58e406c3d0 2024-09-19T05:37:21.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.425+0000 7f58ea1bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f58e40b2950 con 0x7f58e40b24c0 2024-09-19T05:37:21.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f58e4145e20 0x7f58e406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36990/0 (socket says 172.21.15.67:36990) 2024-09-19T05:37:21.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e37fe640 1 -- 172.21.15.67:0/3586689702 learned_addr learned my addr 172.21.15.67:0/3586689702 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:21.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067389115 0 0) 0x7f58e40b2c30 con 0x7f58e4145e20 2024-09-19T05:37:21.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e2ffd640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58e40b24c0 0x7f58e40ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e3fff640 1 --2- 172.21.15.67:0/3586689702 >> v2:172.21.15.97:3300/0 conn(0x7f58e406c3d0 0x7f58e40b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d0003530 con 0x7f58e4145e20 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 782995161 0 0) 0x7f58d0003530 con 0x7f58e4145e20 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58e40b24c0 msgr2=0x7f58e40ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58e40b24c0 0x7f58e40ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 >> v2:172.21.15.97:3300/0 conn(0x7f58e406c3d0 msgr2=0x7f58e40b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 --2- 172.21.15.67:0/3586689702 >> v2:172.21.15.97:3300/0 conn(0x7f58e406c3d0 0x7f58e40b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e40b05e0 con 0x7f58e4145e20 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f58d4001a00 con 0x7f58e4145e20 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 >> v1:172.21.15.67:6789/0 conn(0x7f58e4145e20 legacy=0x7f58e406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58d00039c0 0x7f58d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58d0004320 0x7f58d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d0004e60 0x7f58d00052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f58e40b0c30 con 0x7f58d0004320 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f58e40b2950 con 0x7f58d0004e60 2024-09-19T05:37:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f58d000bdf0 con 0x7f58d00039c0 2024-09-19T05:37:21.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e2ffd640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58d0004320 0x7f58d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e37fe640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58d00039c0 0x7f58d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e3fff640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d0004e60 0x7f58d00052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e2ffd640 1 -- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58d00039c0 msgr2=0x7f58d0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:21.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e2ffd640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58d00039c0 0x7f58d0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e2ffd640 1 -- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d0004e60 msgr2=0x7f58d00052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:21.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e2ffd640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d0004e60 0x7f58d00052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e2ffd640 1 -- 172.21.15.67:0/3586689702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d0003530 con 0x7f58d0004320 2024-09-19T05:37:21.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e3fff640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d0004e60 0x7f58d00052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:21.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e2ffd640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58d0004320 0x7f58d0004810 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f58e40b3f20 tx=0x7f58cc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c20a93ef80cd9c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0096b0 con 0x7f58d0004320 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc0b0400 con 0x7f58d0004320 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.429+0000 7f58e27fc640 1 -- 172.21.15.67:0/3586689702 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0b07f0 con 0x7f58d0004320 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- 172.21.15.67:0/3586689702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58d0004320 msgr2=0x7f58d0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 --2- 172.21.15.67:0/3586689702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58d0004320 0x7f58d0004810 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f58e40b3f20 tx=0x7f58cc01c9f0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e3fff640 1 -- 172.21.15.67:0/3586689702 reap_dead start 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- 172.21.15.67:0/3586689702 shutdown_connections 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- 172.21.15.67:0/3586689702 >> 172.21.15.67:0/3586689702 conn(0x7f58e40b6680 msgr2=0x7f58e40b6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- 172.21.15.67:0/3586689702 shutdown_connections 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- 172.21.15.67:0/3586689702 wait complete. 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 Processor -- start 2024-09-19T05:37:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- start start 2024-09-19T05:37:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d0004320 0x7f58e415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58e415bbf0 0x7f58e41625a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58e41f5fe0 0x7f58e41f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f58e406cb30 con 0x7f58e415bbf0 2024-09-19T05:37:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f58e406c9b0 con 0x7f58d0004320 2024-09-19T05:37:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f58e40b1e10 con 0x7f58e41f5fe0 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58e415bbf0 0x7f58e41625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58e415bbf0 0x7f58e41625a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36222/0 (socket says 172.21.15.67:36222) 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e2ffd640 1 -- 172.21.15.67:0/1200954206 learned_addr learned my addr 172.21.15.67:0/1200954206 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e37fe640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d0004320 0x7f58e415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e3fff640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58e41f5fe0 0x7f58e41f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e2ffd640 1 -- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58e41f5fe0 msgr2=0x7f58e41f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e2ffd640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58e41f5fe0 0x7f58e41f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e2ffd640 1 -- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d0004320 msgr2=0x7f58e415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e2ffd640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d0004320 0x7f58e415f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e2ffd640 1 -- 172.21.15.67:0/1200954206 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e41381a0 con 0x7f58e415bbf0 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58e2ffd640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58e415bbf0 0x7f58e41625a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f58cc01c820 tx=0x7f58cc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58dbfff640 1 -- 172.21.15.67:0/1200954206 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0be070 con 0x7f58e415bbf0 2024-09-19T05:37:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58dbfff640 1 -- 172.21.15.67:0/1200954206 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc0b05b0 con 0x7f58e415bbf0 2024-09-19T05:37:21.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- 172.21.15.67:0/1200954206 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e415f850 con 0x7f58e415bbf0 2024-09-19T05:37:21.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58dbfff640 1 -- 172.21.15.67:0/1200954206 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0b09a0 con 0x7f58e415bbf0 2024-09-19T05:37:21.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.433+0000 7f58ea1bc640 1 -- 172.21.15.67:0/1200954206 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e4138720 con 0x7f58e415bbf0 2024-09-19T05:37:21.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.437+0000 7f58ea1bc640 1 -- 172.21.15.67:0/1200954206 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e40b24c0 con 0x7f58e415bbf0 2024-09-19T05:37:21.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.437+0000 7f58dbfff640 1 -- 172.21.15.67:0/1200954206 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58cc0c1070 con 0x7f58e415bbf0 2024-09-19T05:37:21.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.437+0000 7f58dbfff640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58c40678c0 0x7f58c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.437+0000 7f58dbfff640 1 -- 172.21.15.67:0/1200954206 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5807+0+0 (secure 0 0 0) 0x7f58cc11f2c0 con 0x7f58e415bbf0 2024-09-19T05:37:21.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.437+0000 7f58e37fe640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58c40678c0 0x7f58c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.437+0000 7f58e37fe640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58c40678c0 0x7f58c4069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f58d4000f90 tx=0x7f58d40017c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.441+0000 7f58dbfff640 1 -- 172.21.15.67:0/1200954206 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f58cc0ac030 con 0x7f58e415bbf0 2024-09-19T05:37:21.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:21.605+0000 7f58ea1bc640 1 -- 172.21.15.67:0/1200954206 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f58e4142370 con 0x7f58e415bbf0 2024-09-19T05:37:22.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.281+0000 7f58dbfff640 1 -- 172.21.15.67:0/1200954206 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) ==== 169+0+0 (secure 0 0 0) 0x7f58cc016700 con 0x7f58e415bbf0 2024-09-19T05:37:22.285 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:37:22.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.285+0000 7f58ea1bc640 1 -- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58c40678c0 msgr2=0x7f58c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.285+0000 7f58ea1bc640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58c40678c0 0x7f58c4069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f58d4000f90 tx=0x7f58d40017c0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.285+0000 7f58ea1bc640 1 -- 172.21.15.67:0/1200954206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58e415bbf0 msgr2=0x7f58e41625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.285+0000 7f58ea1bc640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58e415bbf0 0x7f58e41625a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f58cc01c820 tx=0x7f58cc019790 comp rx=0 tx=0).stop 2024-09-19T05:37:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.285+0000 7f58ea1bc640 1 -- 172.21.15.67:0/1200954206 shutdown_connections 2024-09-19T05:37:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.285+0000 7f58ea1bc640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58c40678c0 0x7f58c4069d80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.289+0000 7f58ea1bc640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58e41f5fe0 0x7f58e41f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.289+0000 7f58ea1bc640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58e415bbf0 0x7f58e41625a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.289+0000 7f58ea1bc640 1 --2- 172.21.15.67:0/1200954206 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d0004320 0x7f58e415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.289+0000 7f58ea1bc640 1 -- 172.21.15.67:0/1200954206 >> 172.21.15.67:0/1200954206 conn(0x7f58e40b6680 msgr2=0x7f58e4142f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:22.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.289+0000 7f58ea1bc640 1 -- 172.21.15.67:0/1200954206 shutdown_connections 2024-09-19T05:37:22.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.289+0000 7f58ea1bc640 1 -- 172.21.15.67:0/1200954206 wait complete. 2024-09-19T05:37:22.319 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:37:22.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe14093640 1 Processor -- start 2024-09-19T05:37:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe14093640 1 -- start start 2024-09-19T05:37:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe14093640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c06ffd0 0x7fbe0c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe14093640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbe0c0b3150 0x7fbe0c0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe14093640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c0ad840 con 0x7fbe0c159c60 2024-09-19T05:37:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe14093640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0c0af710 con 0x7fbe0c0b3150 2024-09-19T05:37:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe14093640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c15d460 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe12630640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbe0c0b3150 0x7fbe0c0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe1162e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c06ffd0 0x7fbe0c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe11e2f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fbe0c159c60 0x7fbe0c0ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:35640/0 (socket says 172.21.15.67:35640) 2024-09-19T05:37:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.453+0000 7fbe11e2f640 1 -- 172.21.15.67:0/1707812256 learned_addr learned my addr 172.21.15.67:0/1707812256 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe12630640 1 -- 172.21.15.67:0/1707812256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c06ffd0 msgr2=0x7fbe0c0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe12630640 1 --2- 172.21.15.67:0/1707812256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c06ffd0 0x7fbe0c0aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe12630640 1 -- 172.21.15.67:0/1707812256 >> v1:172.21.15.97:6789/0 conn(0x7fbe0c159c60 legacy=0x7fbe0c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe12630640 1 -- 172.21.15.67:0/1707812256 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c15a040 con 0x7fbe0c0b3150 2024-09-19T05:37:22.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe12630640 1 --2- 172.21.15.67:0/1707812256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c0b3150 0x7fbe0c0af1d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbe040097c0 tx=0x7fbe0401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8d5b19fa7acb0fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:22.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe10e2d640 1 -- 172.21.15.67:0/1707812256 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe040a7070 con 0x7fbe0c0b3150 2024-09-19T05:37:22.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe10e2d640 1 -- 172.21.15.67:0/1707812256 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe040b0070 con 0x7fbe0c0b3150 2024-09-19T05:37:22.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe10e2d640 1 -- 172.21.15.67:0/1707812256 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe040ab890 con 0x7fbe0c0b3150 2024-09-19T05:37:22.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe14093640 1 -- 172.21.15.67:0/1707812256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c0b3150 msgr2=0x7fbe0c0af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe14093640 1 --2- 172.21.15.67:0/1707812256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c0b3150 0x7fbe0c0af1d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbe040097c0 tx=0x7fbe0401c470 comp rx=0 tx=0).stop 2024-09-19T05:37:22.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe14093640 1 -- 172.21.15.67:0/1707812256 shutdown_connections 2024-09-19T05:37:22.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe14093640 1 --2- 172.21.15.67:0/1707812256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c0b3150 0x7fbe0c0af1d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe14093640 1 --2- 172.21.15.67:0/1707812256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c06ffd0 0x7fbe0c0aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe14093640 1 -- 172.21.15.67:0/1707812256 >> 172.21.15.67:0/1707812256 conn(0x7fbe0c0b1e50 msgr2=0x7fbe0c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:22.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe14093640 1 -- 172.21.15.67:0/1707812256 shutdown_connections 2024-09-19T05:37:22.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.457+0000 7fbe14093640 1 -- 172.21.15.67:0/1707812256 wait complete. 2024-09-19T05:37:22.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 Processor -- start 2024-09-19T05:37:22.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 -- start start 2024-09-19T05:37:22.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe0c06ffd0 0x7fbe0c14b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c0b3150 0x7fbe0c165440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c159c60 0x7fbe0c148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1605b0 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c15d0f0 con 0x7fbe0c0b3150 2024-09-19T05:37:22.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c160730 con 0x7fbe0c159c60 2024-09-19T05:37:22.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe11e2f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe0c06ffd0 0x7fbe0c14b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe11e2f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe0c06ffd0 0x7fbe0c14b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36236/0 (socket says 172.21.15.67:36236) 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe11e2f640 1 -- 172.21.15.67:0/2406550461 learned_addr learned my addr 172.21.15.67:0/2406550461 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe12630640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c159c60 0x7fbe0c148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe1162e640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c0b3150 0x7fbe0c165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe11e2f640 1 -- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c159c60 msgr2=0x7fbe0c148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe11e2f640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c159c60 0x7fbe0c148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe11e2f640 1 -- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c0b3150 msgr2=0x7fbe0c165440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe11e2f640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c0b3150 0x7fbe0c165440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe11e2f640 1 -- 172.21.15.67:0/2406550461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c14bf10 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe1162e640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c0b3150 0x7fbe0c165440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe11e2f640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe0c06ffd0 0x7fbe0c14b5c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00caa0 tx=0x7fbdfc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:22.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe0a7fc640 1 -- 172.21.15.67:0/2406550461 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc017070 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe0a7fc640 1 -- 172.21.15.67:0/2406550461 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdfc00ac00 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe0a7fc640 1 -- 172.21.15.67:0/2406550461 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc012400 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 -- 172.21.15.67:0/2406550461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c14c1f0 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 -- 172.21.15.67:0/2406550461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c14c7b0 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.461+0000 7fbe14093640 1 -- 172.21.15.67:0/2406550461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0c068530 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.465+0000 7fbe0a7fc640 1 -- 172.21.15.67:0/2406550461 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbdfc01a070 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.465+0000 7fbe0a7fc640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdf80678c0 0x7fbdf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.465+0000 7fbe0a7fc640 1 -- 172.21.15.67:0/2406550461 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5335+0+0 (secure 0 0 0) 0x7fbdfc0856f0 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.465+0000 7fbe1162e640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdf80678c0 0x7fbdf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.465+0000 7fbe1162e640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdf80678c0 0x7fbdf8069d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c165e60 tx=0x7fbe00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:22.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.469+0000 7fbe0a7fc640 1 -- 172.21.15.67:0/2406550461 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fbdfc055de0 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.637+0000 7fbe14093640 1 -- 172.21.15.67:0/2406550461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbe0c160b60 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe0a7fc640 1 -- 172.21.15.67:0/2406550461 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fbdfc085070 con 0x7fbe0c06ffd0 2024-09-19T05:37:22.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 -- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdf80678c0 msgr2=0x7fbdf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdf80678c0 0x7fbdf8069d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c165e60 tx=0x7fbe00008040 comp rx=0 tx=0).stop 2024-09-19T05:37:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 -- 172.21.15.67:0/2406550461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe0c06ffd0 msgr2=0x7fbe0c14b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe0c06ffd0 0x7fbe0c14b5c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00caa0 tx=0x7fbdfc00cf60 comp rx=0 tx=0).stop 2024-09-19T05:37:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 -- 172.21.15.67:0/2406550461 shutdown_connections 2024-09-19T05:37:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdf80678c0 0x7fbdf8069d80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c159c60 0x7fbe0c148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c0b3150 0x7fbe0c165440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 --2- 172.21.15.67:0/2406550461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe0c06ffd0 0x7fbe0c14b5c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 -- 172.21.15.67:0/2406550461 >> 172.21.15.67:0/2406550461 conn(0x7fbe0c0b1e50 msgr2=0x7fbe0c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 -- 172.21.15.67:0/2406550461 shutdown_connections 2024-09-19T05:37:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.645+0000 7fbe14093640 1 -- 172.21.15.67:0/2406550461 wait complete. 2024-09-19T05:37:22.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-19T05:37:22.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bf05fa640 1 Processor -- start 2024-09-19T05:37:22.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bf05fa640 1 -- start start 2024-09-19T05:37:22.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bf05fa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1be80b4b60 0x7f1be80b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bf05fa640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1be815c240 0x7f1be815c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bf05fa640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be815cee0 con 0x7f1be815b180 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bf05fa640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1be815daf0 con 0x7f1be815c240 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bf05fa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1be80b54e0 con 0x7f1be80b4b60 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bee396640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1be815b180 0x7f1be809b1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36998/0 (socket says 172.21.15.67:36998) 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bee396640 1 -- 172.21.15.67:0/2602816388 learned_addr learned my addr 172.21.15.67:0/2602816388 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1beeb97640 1 --2- 172.21.15.67:0/2602816388 >> v2:172.21.15.67:3300/0 conn(0x7f1be815c240 0x7f1be815c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bed394640 1 -- 172.21.15.67:0/2602816388 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1549312570 0 0) 0x7f1be815cee0 con 0x7f1be815b180 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bed394640 1 -- 172.21.15.67:0/2602816388 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bd4003530 con 0x7f1be815b180 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1bedb95640 1 --2- 172.21.15.67:0/2602816388 >> v2:172.21.15.97:3300/0 conn(0x7f1be80b4b60 0x7f1be80b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1beeb97640 1 -- 172.21.15.67:0/2602816388 >> v2:172.21.15.97:3300/0 conn(0x7f1be80b4b60 msgr2=0x7f1be80b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1beeb97640 1 --2- 172.21.15.67:0/2602816388 >> v2:172.21.15.97:3300/0 conn(0x7f1be80b4b60 0x7f1be80b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1beeb97640 1 -- 172.21.15.67:0/2602816388 >> v1:172.21.15.67:6789/0 conn(0x7f1be815b180 legacy=0x7f1be809b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.793+0000 7f1beeb97640 1 -- 172.21.15.67:0/2602816388 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be815d1c0 con 0x7f1be815c240 2024-09-19T05:37:22.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1beeb97640 1 --2- 172.21.15.67:0/2602816388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815c240 0x7f1be815c6b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1be80d21f0 tx=0x7f1be001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0db98977ed033 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:22.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bed394640 1 -- 172.21.15.67:0/2602816388 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be00b2070 con 0x7f1be815c240 2024-09-19T05:37:22.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bed394640 1 -- 172.21.15.67:0/2602816388 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be00a59c0 con 0x7f1be815c240 2024-09-19T05:37:22.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bed394640 1 -- 172.21.15.67:0/2602816388 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be00a5d90 con 0x7f1be815c240 2024-09-19T05:37:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 -- 172.21.15.67:0/2602816388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815c240 msgr2=0x7f1be815c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 --2- 172.21.15.67:0/2602816388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815c240 0x7f1be815c6b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1be80d21f0 tx=0x7f1be001c900 comp rx=0 tx=0).stop 2024-09-19T05:37:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 -- 172.21.15.67:0/2602816388 shutdown_connections 2024-09-19T05:37:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 --2- 172.21.15.67:0/2602816388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815c240 0x7f1be815c6b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 --2- 172.21.15.67:0/2602816388 >> v2:172.21.15.97:3300/0 conn(0x7f1be80b4b60 0x7f1be80b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 -- 172.21.15.67:0/2602816388 >> 172.21.15.67:0/2602816388 conn(0x7f1be809aa30 msgr2=0x7f1be80b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 -- 172.21.15.67:0/2602816388 shutdown_connections 2024-09-19T05:37:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 -- 172.21.15.67:0/2602816388 wait complete. 2024-09-19T05:37:22.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 Processor -- start 2024-09-19T05:37:22.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 -- start start 2024-09-19T05:37:22.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1be80b4b60 0x7f1be814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815b180 0x7f1be813da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1be815c240 0x7f1be814d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1be815e770 con 0x7f1be815b180 2024-09-19T05:37:22.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1be815b560 con 0x7f1be80b4b60 2024-09-19T05:37:22.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bf05fa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1be815e8f0 con 0x7f1be815c240 2024-09-19T05:37:22.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bedb95640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815b180 0x7f1be813da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bedb95640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815b180 0x7f1be813da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36244/0 (socket says 172.21.15.67:36244) 2024-09-19T05:37:22.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bedb95640 1 -- 172.21.15.67:0/4204863122 learned_addr learned my addr 172.21.15.67:0/4204863122 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bee396640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1be80b4b60 0x7f1be814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1beeb97640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1be815c240 0x7f1be814d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.797+0000 7f1bedb95640 1 -- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1be815c240 msgr2=0x7f1be814d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bedb95640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1be815c240 0x7f1be814d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bedb95640 1 -- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1be80b4b60 msgr2=0x7f1be814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bedb95640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1be80b4b60 0x7f1be814b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bedb95640 1 -- 172.21.15.67:0/4204863122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be813dfc0 con 0x7f1be815b180 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1beeb97640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1be815c240 0x7f1be814d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bee396640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1be80b4b60 0x7f1be814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bedb95640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815b180 0x7f1be813da80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800d830 tx=0x7f1bd800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bdeffd640 1 -- 172.21.15.67:0/4204863122 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800b6c0 con 0x7f1be815b180 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bdeffd640 1 -- 172.21.15.67:0/4204863122 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd8019070 con 0x7f1be815b180 2024-09-19T05:37:22.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bdeffd640 1 -- 172.21.15.67:0/4204863122 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800ba60 con 0x7f1be815b180 2024-09-19T05:37:22.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bf05fa640 1 -- 172.21.15.67:0/4204863122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be814dbf0 con 0x7f1be815b180 2024-09-19T05:37:22.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bf05fa640 1 -- 172.21.15.67:0/4204863122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be814bd20 con 0x7f1be815b180 2024-09-19T05:37:22.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bf05fa640 1 -- 172.21.15.67:0/4204863122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be80b4fa0 con 0x7f1be815b180 2024-09-19T05:37:22.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bdeffd640 1 -- 172.21.15.67:0/4204863122 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1bd801e460 con 0x7f1be815b180 2024-09-19T05:37:22.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bdeffd640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bcc0678f0 0x7f1bcc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bdeffd640 1 -- 172.21.15.67:0/4204863122 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5335+0+0 (secure 0 0 0) 0x7f1bd8086260 con 0x7f1be815b180 2024-09-19T05:37:22.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.801+0000 7f1bee396640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bcc0678f0 0x7f1bcc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.805+0000 7f1bee396640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bcc0678f0 0x7f1bcc069db0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1be4005890 tx=0x7f1be4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:22.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:22.809+0000 7f1bdeffd640 1 -- 172.21.15.67:0/4204863122 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1bd8056e90 con 0x7f1be815b180 2024-09-19T05:37:23.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.033+0000 7f1bf05fa640 1 -- 172.21.15.67:0/4204863122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f1be8154490 con 0x7f1be815b180 2024-09-19T05:37:23.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bdeffd640 1 -- 172.21.15.67:0/4204863122 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v195) ==== 143+0+0 (secure 0 0 0) 0x7f1bd8056790 con 0x7f1be815b180 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 -- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bcc0678f0 msgr2=0x7f1bcc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bcc0678f0 0x7f1bcc069db0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1be4005890 tx=0x7f1be4009040 comp rx=0 tx=0).stop 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 -- 172.21.15.67:0/4204863122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815b180 msgr2=0x7f1be813da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815b180 0x7f1be813da80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800d830 tx=0x7f1bd800dcf0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 -- 172.21.15.67:0/4204863122 shutdown_connections 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1bcc0678f0 0x7f1bcc069db0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1be815c240 0x7f1be814d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1be815b180 0x7f1be813da80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 --2- 172.21.15.67:0/4204863122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1be80b4b60 0x7f1be814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 -- 172.21.15.67:0/4204863122 >> 172.21.15.67:0/4204863122 conn(0x7f1be809aa30 msgr2=0x7f1be815a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 -- 172.21.15.67:0/4204863122 shutdown_connections 2024-09-19T05:37:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.285+0000 7f1bf05fa640 1 -- 172.21.15.67:0/4204863122 wait complete. 2024-09-19T05:37:23.313 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-19T05:37:23.314 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is merged during scrub. 2024-09-19T05:37:23.314 INFO:tasks.cephfs_test_runner:test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-19T05:37:23.314 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:23.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.437+0000 7f76d021d640 1 Processor -- start 2024-09-19T05:37:23.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.437+0000 7f76d021d640 1 -- start start 2024-09-19T05:37:23.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76d021d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c815e640 0x7f76c80b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76d021d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f76c80ae0a0 0x7f76c80b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76d021d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c80b5b90 con 0x7f76c80b2430 2024-09-19T05:37:23.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76d021d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f76c80b4780 con 0x7f76c80ae0a0 2024-09-19T05:37:23.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76d021d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f76c80b15f0 con 0x7f76c815e640 2024-09-19T05:37:23.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76cdfb9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c815e640 0x7f76c80b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76cd7b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f76c80ae0a0 0x7f76c80b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76ce7ba640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f76c80b2430 0x7f76c806bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:35642/0 (socket says 172.21.15.67:35642) 2024-09-19T05:37:23.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76ce7ba640 1 -- 172.21.15.67:0/3127937550 learned_addr learned my addr 172.21.15.67:0/3127937550 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:23.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76ccfb7640 1 -- 172.21.15.67:0/3127937550 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947777746 0 0) 0x7f76c00014a0 con 0x7f76c80b2430 2024-09-19T05:37:23.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76ccfb7640 1 -- 172.21.15.67:0/3127937550 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76b4003530 con 0x7f76c80b2430 2024-09-19T05:37:23.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76cdfb9640 1 -- 172.21.15.67:0/3127937550 >> v2:172.21.15.97:3300/0 conn(0x7f76c80ae0a0 msgr2=0x7f76c80b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:23.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76cdfb9640 1 --2- 172.21.15.67:0/3127937550 >> v2:172.21.15.97:3300/0 conn(0x7f76c80ae0a0 0x7f76c80b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76cdfb9640 1 -- 172.21.15.67:0/3127937550 >> v1:172.21.15.97:6789/0 conn(0x7f76c80b2430 legacy=0x7f76c806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76cdfb9640 1 -- 172.21.15.67:0/3127937550 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c80ae4e0 con 0x7f76c815e640 2024-09-19T05:37:23.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.441+0000 7f76cdfb9640 1 --2- 172.21.15.67:0/3127937550 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c815e640 0x7f76c80b6050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f76c40097c0 tx=0x7f76c401c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db7187b90748580f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:23.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76ccfb7640 1 -- 172.21.15.67:0/3127937550 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c40b0070 con 0x7f76c815e640 2024-09-19T05:37:23.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76ccfb7640 1 -- 172.21.15.67:0/3127937550 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c40ab600 con 0x7f76c815e640 2024-09-19T05:37:23.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76ccfb7640 1 -- 172.21.15.67:0/3127937550 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c40ab9b0 con 0x7f76c815e640 2024-09-19T05:37:23.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 -- 172.21.15.67:0/3127937550 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c815e640 msgr2=0x7f76c80b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 --2- 172.21.15.67:0/3127937550 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c815e640 0x7f76c80b6050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f76c40097c0 tx=0x7f76c401c380 comp rx=0 tx=0).stop 2024-09-19T05:37:23.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 -- 172.21.15.67:0/3127937550 shutdown_connections 2024-09-19T05:37:23.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 --2- 172.21.15.67:0/3127937550 >> v2:172.21.15.97:3300/0 conn(0x7f76c80ae0a0 0x7f76c80b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 --2- 172.21.15.67:0/3127937550 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c815e640 0x7f76c80b6050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 -- 172.21.15.67:0/3127937550 >> 172.21.15.67:0/3127937550 conn(0x7f76c809aa30 msgr2=0x7f76c80b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:23.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 -- 172.21.15.67:0/3127937550 shutdown_connections 2024-09-19T05:37:23.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 -- 172.21.15.67:0/3127937550 wait complete. 2024-09-19T05:37:23.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 Processor -- start 2024-09-19T05:37:23.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 -- start start 2024-09-19T05:37:23.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c80ae0a0 0x7f76c80ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c80b2430 0x7f76c806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76c815e640 0x7f76c806c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f76c80b0910 con 0x7f76c80ae0a0 2024-09-19T05:37:23.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f76c80b0790 con 0x7f76c815e640 2024-09-19T05:37:23.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76d021d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f76c80b40c0 con 0x7f76c80b2430 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76cdfb9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c80ae0a0 0x7f76c80ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76cdfb9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c80ae0a0 0x7f76c80ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36252/0 (socket says 172.21.15.67:36252) 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76cdfb9640 1 -- 172.21.15.67:0/2834206771 learned_addr learned my addr 172.21.15.67:0/2834206771 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76cd7b8640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c80b2430 0x7f76c806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76ce7ba640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76c815e640 0x7f76c806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76cdfb9640 1 -- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c80b2430 msgr2=0x7f76c806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76cdfb9640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c80b2430 0x7f76c806bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76cdfb9640 1 -- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76c815e640 msgr2=0x7f76c806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76cdfb9640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76c815e640 0x7f76c806c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76cdfb9640 1 -- 172.21.15.67:0/2834206771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c80ca5e0 con 0x7f76c80ae0a0 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76ce7ba640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76c815e640 0x7f76c806c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76cdfb9640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c80ae0a0 0x7f76c80ccc60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f76c4019fb0 tx=0x7f76c4019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76be7fc640 1 -- 172.21.15.67:0/2834206771 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c40ba070 con 0x7f76c80ae0a0 2024-09-19T05:37:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76be7fc640 1 -- 172.21.15.67:0/2834206771 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c40b5460 con 0x7f76c80ae0a0 2024-09-19T05:37:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.445+0000 7f76be7fc640 1 -- 172.21.15.67:0/2834206771 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c40b0040 con 0x7f76c80ae0a0 2024-09-19T05:37:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.449+0000 7f76d021d640 1 -- 172.21.15.67:0/2834206771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c80ca8c0 con 0x7f76c80ae0a0 2024-09-19T05:37:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.449+0000 7f76d021d640 1 -- 172.21.15.67:0/2834206771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c80cb3a0 con 0x7f76c80ae0a0 2024-09-19T05:37:23.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.449+0000 7f76d021d640 1 -- 172.21.15.67:0/2834206771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c80b6cf0 con 0x7f76c80ae0a0 2024-09-19T05:37:23.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.449+0000 7f76be7fc640 1 -- 172.21.15.67:0/2834206771 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f76c40bd070 con 0x7f76c80ae0a0 2024-09-19T05:37:23.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.449+0000 7f76be7fc640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76ac0678c0 0x7f76ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.449+0000 7f76be7fc640 1 -- 172.21.15.67:0/2834206771 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5335+0+0 (secure 0 0 0) 0x7f76c411fe70 con 0x7f76c80ae0a0 2024-09-19T05:37:23.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.449+0000 7f76cd7b8640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76ac0678c0 0x7f76ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.449+0000 7f76cd7b8640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76ac0678c0 0x7f76ac069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f76c80cd4d0 tx=0x7f76b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.453+0000 7f76be7fc640 1 -- 172.21.15.67:0/2834206771 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f76c4016090 con 0x7f76c80ae0a0 2024-09-19T05:37:23.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.621+0000 7f76d021d640 1 -- 172.21.15.67:0/2834206771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76c80cc490 con 0x7f76c80ae0a0 2024-09-19T05:37:23.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.621+0000 7f76be7fc640 1 -- 172.21.15.67:0/2834206771 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13267 (secure 0 0 0) 0x7f76c40f0c40 con 0x7f76c80ae0a0 2024-09-19T05:37:23.628 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:23.628 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":60,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:37:22.274437+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/985983096":"2024-09-20T05:37:18.980956+0000","172.21.15.67:6834/985983096":"2024-09-20T05:37:18.980956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:23.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 -- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76ac0678c0 msgr2=0x7f76ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76ac0678c0 0x7f76ac069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f76c80cd4d0 tx=0x7f76b8008040 comp rx=0 tx=0).stop 2024-09-19T05:37:23.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 -- 172.21.15.67:0/2834206771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c80ae0a0 msgr2=0x7f76c80ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c80ae0a0 0x7f76c80ccc60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f76c4019fb0 tx=0x7f76c4019120 comp rx=0 tx=0).stop 2024-09-19T05:37:23.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 -- 172.21.15.67:0/2834206771 shutdown_connections 2024-09-19T05:37:23.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76c815e640 0x7f76c806c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76ac0678c0 0x7f76ac069d80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76c80b2430 0x7f76c806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 --2- 172.21.15.67:0/2834206771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76c80ae0a0 0x7f76c80ccc60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 -- 172.21.15.67:0/2834206771 >> 172.21.15.67:0/2834206771 conn(0x7f76c809aa30 msgr2=0x7f76c80b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:23.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 -- 172.21.15.67:0/2834206771 shutdown_connections 2024-09-19T05:37:23.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.625+0000 7f76d021d640 1 -- 172.21.15.67:0/2834206771 wait complete. 2024-09-19T05:37:23.646 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:37:23.646 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:37:23.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f115ea3c640 1 Processor -- start 2024-09-19T05:37:23.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f115ea3c640 1 -- start start 2024-09-19T05:37:23.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f115ea3c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f115815e5c0 0x7f11580d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f115ea3c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f115806d920 0x7f11580b7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f115ea3c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11580cf410 con 0x7f11580b7aa0 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f115ea3c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f115815e9a0 con 0x7f115806d920 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f115ea3c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f11580cfd40 con 0x7f115815e5c0 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f115cfd9640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f11580b7aa0 0x7f11580b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37012/0 (socket says 172.21.15.67:37012) 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f11577fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f115806d920 0x7f11580b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f115cfd9640 1 -- 172.21.15.67:0/329493251 learned_addr learned my addr 172.21.15.67:0/329493251 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f1157fff640 1 --2- 172.21.15.67:0/329493251 >> v2:172.21.15.97:3300/0 conn(0x7f115815e5c0 0x7f11580d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f11577fe640 1 -- 172.21.15.67:0/329493251 >> v2:172.21.15.97:3300/0 conn(0x7f115815e5c0 msgr2=0x7f11580d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f11577fe640 1 --2- 172.21.15.67:0/329493251 >> v2:172.21.15.97:3300/0 conn(0x7f115815e5c0 0x7f11580d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f11577fe640 1 -- 172.21.15.67:0/329493251 >> v1:172.21.15.67:6789/0 conn(0x7f11580b7aa0 legacy=0x7f11580b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f11577fe640 1 -- 172.21.15.67:0/329493251 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11580cf6f0 con 0x7f115806d920 2024-09-19T05:37:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.769+0000 7f1156ffd640 1 -- 172.21.15.67:0/329493251 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355255480 0 0) 0x7f11580cf410 con 0x7f11580b7aa0 2024-09-19T05:37:23.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f11577fe640 1 --2- 172.21.15.67:0/329493251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115806d920 0x7f11580b7560 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f11580689e0 tx=0x7f114801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d5364dec6daca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:23.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f1156ffd640 1 -- 172.21.15.67:0/329493251 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11480b5070 con 0x7f115806d920 2024-09-19T05:37:23.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f1156ffd640 1 -- 172.21.15.67:0/329493251 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11480a8970 con 0x7f115806d920 2024-09-19T05:37:23.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f1156ffd640 1 -- 172.21.15.67:0/329493251 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11480a8d40 con 0x7f115806d920 2024-09-19T05:37:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 -- 172.21.15.67:0/329493251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115806d920 msgr2=0x7f11580b7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 --2- 172.21.15.67:0/329493251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115806d920 0x7f11580b7560 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f11580689e0 tx=0x7f114801ec70 comp rx=0 tx=0).stop 2024-09-19T05:37:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 -- 172.21.15.67:0/329493251 shutdown_connections 2024-09-19T05:37:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 --2- 172.21.15.67:0/329493251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115806d920 0x7f11580b7560 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 --2- 172.21.15.67:0/329493251 >> v2:172.21.15.97:3300/0 conn(0x7f115815e5c0 0x7f11580d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 -- 172.21.15.67:0/329493251 >> 172.21.15.67:0/329493251 conn(0x7f11580d46b0 msgr2=0x7f11580d4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 -- 172.21.15.67:0/329493251 shutdown_connections 2024-09-19T05:37:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 -- 172.21.15.67:0/329493251 wait complete. 2024-09-19T05:37:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 Processor -- start 2024-09-19T05:37:23.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 -- start start 2024-09-19T05:37:23.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f115806d920 0x7f11580c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11580b7aa0 0x7f11580c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115815e5c0 0x7f11580c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f11580d2f60 con 0x7f115815e5c0 2024-09-19T05:37:23.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f11580d2de0 con 0x7f11580b7aa0 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115ea3c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f11580b6690 con 0x7f115806d920 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115cfd9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115815e5c0 0x7f11580c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115cfd9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115815e5c0 0x7f11580c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36266/0 (socket says 172.21.15.67:36266) 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.773+0000 7f115cfd9640 1 -- 172.21.15.67:0/1227787939 learned_addr learned my addr 172.21.15.67:0/1227787939 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f11577fe640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11580b7aa0 0x7f11580c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f1157fff640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f115806d920 0x7f11580c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f115cfd9640 1 -- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f115806d920 msgr2=0x7f11580c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f115cfd9640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f115806d920 0x7f11580c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f115cfd9640 1 -- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11580b7aa0 msgr2=0x7f11580c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f115cfd9640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11580b7aa0 0x7f11580c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f115cfd9640 1 -- 172.21.15.67:0/1227787939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11580cdd50 con 0x7f115815e5c0 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f11577fe640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11580b7aa0 0x7f11580c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:23.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f115cfd9640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115815e5c0 0x7f11580c8f10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f115000c7a0 tx=0x7f115000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f1154ff9640 1 -- 172.21.15.67:0/1227787939 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150018070 con 0x7f115815e5c0 2024-09-19T05:37:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f1154ff9640 1 -- 172.21.15.67:0/1227787939 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115000a640 con 0x7f115815e5c0 2024-09-19T05:37:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f1154ff9640 1 -- 172.21.15.67:0/1227787939 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115000aa70 con 0x7f115815e5c0 2024-09-19T05:37:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f115ea3c640 1 -- 172.21.15.67:0/1227787939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11580ce030 con 0x7f115815e5c0 2024-09-19T05:37:23.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f115ea3c640 1 -- 172.21.15.67:0/1227787939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11580c7f70 con 0x7f115815e5c0 2024-09-19T05:37:23.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f115ea3c640 1 -- 172.21.15.67:0/1227787939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11580b7560 con 0x7f115815e5c0 2024-09-19T05:37:23.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f1154ff9640 1 -- 172.21.15.67:0/1227787939 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f115000ac10 con 0x7f115815e5c0 2024-09-19T05:37:23.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f1154ff9640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11440678c0 0x7f1144069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f1154ff9640 1 -- 172.21.15.67:0/1227787939 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5335+0+0 (secure 0 0 0) 0x7f1150085120 con 0x7f115815e5c0 2024-09-19T05:37:23.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f1157fff640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11440678c0 0x7f1144069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.777+0000 7f1157fff640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11440678c0 0x7f1144069d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f114c0096f0 tx=0x7f114c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.781+0000 7f1154ff9640 1 -- 172.21.15.67:0/1227787939 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1150055e60 con 0x7f115815e5c0 2024-09-19T05:37:23.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.945+0000 7f115ea3c640 1 -- 172.21.15.67:0/1227787939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f11580cec00 con 0x7f115815e5c0 2024-09-19T05:37:23.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.945+0000 7f1154ff9640 1 -- 172.21.15.67:0/1227787939 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f1150055760 con 0x7f115815e5c0 2024-09-19T05:37:23.950 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:37:23.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 -- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11440678c0 msgr2=0x7f1144069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11440678c0 0x7f1144069d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f114c0096f0 tx=0x7f114c008040 comp rx=0 tx=0).stop 2024-09-19T05:37:23.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 -- 172.21.15.67:0/1227787939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115815e5c0 msgr2=0x7f11580c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115815e5c0 0x7f11580c8f10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f115000c7a0 tx=0x7f115000cc60 comp rx=0 tx=0).stop 2024-09-19T05:37:23.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 -- 172.21.15.67:0/1227787939 shutdown_connections 2024-09-19T05:37:23.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f115815e5c0 0x7f11580c8f10 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11580b7aa0 0x7f11580c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f11440678c0 0x7f1144069d80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 --2- 172.21.15.67:0/1227787939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f115806d920 0x7f11580c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 -- 172.21.15.67:0/1227787939 >> 172.21.15.67:0/1227787939 conn(0x7f11580d46b0 msgr2=0x7f11580b9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:23.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 -- 172.21.15.67:0/1227787939 shutdown_connections 2024-09-19T05:37:23.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:23.949+0000 7f115ea3c640 1 -- 172.21.15.67:0/1227787939 wait complete. 2024-09-19T05:37:23.970 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-19T05:37:24.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24f17c1640 1 Processor -- start 2024-09-19T05:37:24.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24f17c1640 1 -- start start 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24f17c1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec0d1590 0x7f24ec0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24f17c1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f24ec0b51d0 0x7f24ec0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24f17c1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ec0d4d40 con 0x7f24ec161da0 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24f17c1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f24ec0d0840 con 0x7f24ec0b51d0 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24f17c1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f24ec0d5020 con 0x7f24ec0d1590 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24eaffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f24ec161da0 0x7f24ec0d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37028/0 (socket says 172.21.15.67:37028) 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24eaffd640 1 -- 172.21.15.67:0/4189052600 learned_addr learned my addr 172.21.15.67:0/4189052600 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24eb7fe640 1 --2- 172.21.15.67:0/4189052600 >> v2:172.21.15.97:3300/0 conn(0x7f24ec0b51d0 0x7f24ec0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24ea7fc640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec0d1590 0x7f24ec0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196639206 0 0) 0x7f24ec0d4d40 con 0x7f24ec161da0 2024-09-19T05:37:24.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d8003530 con 0x7f24ec161da0 2024-09-19T05:37:24.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2258314440 0 0) 0x7f24d8003530 con 0x7f24ec161da0 2024-09-19T05:37:24.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec0d1590 msgr2=0x7f24ec0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:24.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec0d1590 0x7f24ec0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:24.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 >> v2:172.21.15.97:3300/0 conn(0x7f24ec0b51d0 msgr2=0x7f24ec0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:24.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 --2- 172.21.15.67:0/4189052600 >> v2:172.21.15.97:3300/0 conn(0x7f24ec0b51d0 0x7f24ec0cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:24.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec0d5300 con 0x7f24ec161da0 2024-09-19T05:37:24.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f24dc001680 con 0x7f24ec161da0 2024-09-19T05:37:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 >> v1:172.21.15.67:6789/0 conn(0x7f24ec161da0 legacy=0x7f24ec0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24d80039c0 0x7f24d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d8004810 0x7f24d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec0d1590 0x7f24d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec0d0840 con 0x7f24d8004810 2024-09-19T05:37:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec0d5020 con 0x7f24d80039c0 2024-09-19T05:37:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f24d800b9d0 con 0x7f24ec0d1590 2024-09-19T05:37:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24ea7fc640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d8004810 0x7f24d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24eaffd640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24d80039c0 0x7f24d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:24.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24eb7fe640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec0d1590 0x7f24d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:24.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24ea7fc640 1 -- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec0d1590 msgr2=0x7f24d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:24.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24ea7fc640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec0d1590 0x7f24d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:24.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24ea7fc640 1 -- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24d80039c0 msgr2=0x7f24d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:24.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.093+0000 7f24ea7fc640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24d80039c0 0x7f24d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:24.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24ea7fc640 1 -- 172.21.15.67:0/4189052600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d8003530 con 0x7f24d8004810 2024-09-19T05:37:24.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24eb7fe640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec0d1590 0x7f24d80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24ea7fc640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d8004810 0x7f24d8004c90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009ae0 tx=0x7f24d401c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8592aec4ac0ecaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d40b1070 con 0x7f24d8004810 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d40a4ab0 con 0x7f24d8004810 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24e9ffb640 1 -- 172.21.15.67:0/4189052600 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d40096b0 con 0x7f24d8004810 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24f17c1640 1 -- 172.21.15.67:0/4189052600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d8004810 msgr2=0x7f24d8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24f17c1640 1 --2- 172.21.15.67:0/4189052600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d8004810 0x7f24d8004c90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009ae0 tx=0x7f24d401c750 comp rx=0 tx=0).stop 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24eb7fe640 1 -- 172.21.15.67:0/4189052600 reap_dead start 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24f17c1640 1 -- 172.21.15.67:0/4189052600 shutdown_connections 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24f17c1640 1 -- 172.21.15.67:0/4189052600 >> 172.21.15.67:0/4189052600 conn(0x7f24ec08bfc0 msgr2=0x7f24ec0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24f17c1640 1 -- 172.21.15.67:0/4189052600 shutdown_connections 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.097+0000 7f24f17c1640 1 -- 172.21.15.67:0/4189052600 wait complete. 2024-09-19T05:37:24.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 Processor -- start 2024-09-19T05:37:24.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 -- start start 2024-09-19T05:37:24.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24ec15dbd0 0x7f24ec0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:24.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec15dfb0 0x7f24ec0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24ec0b72c0 0x7f24ec0b7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec162180 con 0x7f24ec0b72c0 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec0b5d00 con 0x7f24ec15dbd0 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f24ec0d1af0 con 0x7f24ec15dfb0 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24eb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24ec0b72c0 0x7f24ec0b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24eb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24ec0b72c0 0x7f24ec0b7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36276/0 (socket says 172.21.15.67:36276) 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24eb7fe640 1 -- 172.21.15.67:0/388397795 learned_addr learned my addr 172.21.15.67:0/388397795 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24ea7fc640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec15dfb0 0x7f24ec0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24eaffd640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24ec15dbd0 0x7f24ec0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24eb7fe640 1 -- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec15dfb0 msgr2=0x7f24ec0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24eb7fe640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec15dfb0 0x7f24ec0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24eb7fe640 1 -- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24ec15dbd0 msgr2=0x7f24ec0cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24eb7fe640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24ec15dbd0 0x7f24ec0cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24eb7fe640 1 -- 172.21.15.67:0/388397795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec0b7c80 con 0x7f24ec0b72c0 2024-09-19T05:37:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24eb7fe640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24ec0b72c0 0x7f24ec0b7740 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f24ec06cad0 tx=0x7f24e4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24e37fe640 1 -- 172.21.15.67:0/388397795 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4010e00 con 0x7f24ec0b72c0 2024-09-19T05:37:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24e37fe640 1 -- 172.21.15.67:0/388397795 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e40039a0 con 0x7f24ec0b72c0 2024-09-19T05:37:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 -- 172.21.15.67:0/388397795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ec0b7f10 con 0x7f24ec0b72c0 2024-09-19T05:37:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24e37fe640 1 -- 172.21.15.67:0/388397795 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4003d90 con 0x7f24ec0b72c0 2024-09-19T05:37:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 -- 172.21.15.67:0/388397795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ec0b84d0 con 0x7f24ec0b72c0 2024-09-19T05:37:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24f17c1640 1 -- 172.21.15.67:0/388397795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ec0d0e80 con 0x7f24ec0b72c0 2024-09-19T05:37:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.101+0000 7f24e37fe640 1 -- 172.21.15.67:0/388397795 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24e401e020 con 0x7f24ec0b72c0 2024-09-19T05:37:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.105+0000 7f24e37fe640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24cc0678f0 0x7f24cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.105+0000 7f24e37fe640 1 -- 172.21.15.67:0/388397795 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5335+0+0 (secure 0 0 0) 0x7f24e4086170 con 0x7f24ec0b72c0 2024-09-19T05:37:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.105+0000 7f24eaffd640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24cc0678f0 0x7f24cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.105+0000 7f24eaffd640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24cc0678f0 0x7f24cc069db0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f24dc004850 tx=0x7f24dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:24.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.109+0000 7f24e37fe640 1 -- 172.21.15.67:0/388397795 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f24e4056e20 con 0x7f24ec0b72c0 2024-09-19T05:37:24.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:24.333+0000 7f24f17c1640 1 -- 172.21.15.67:0/388397795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f24ec0c9410 con 0x7f24ec0b72c0 2024-09-19T05:37:25.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.297+0000 7f24e37fe640 1 -- 172.21.15.67:0/388397795 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v197) ==== 154+0+0 (secure 0 0 0) 0x7f24e4056720 con 0x7f24ec0b72c0 2024-09-19T05:37:25.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 -- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24cc0678f0 msgr2=0x7f24cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24cc0678f0 0x7f24cc069db0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f24dc004850 tx=0x7f24dc009040 comp rx=0 tx=0).stop 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 -- 172.21.15.67:0/388397795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24ec0b72c0 msgr2=0x7f24ec0b7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24ec0b72c0 0x7f24ec0b7740 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f24ec06cad0 tx=0x7f24e4010590 comp rx=0 tx=0).stop 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 -- 172.21.15.67:0/388397795 shutdown_connections 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24ec0b72c0 0x7f24ec0b7740 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24cc0678f0 0x7f24cc069db0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24ec15dfb0 0x7f24ec0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 --2- 172.21.15.67:0/388397795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24ec15dbd0 0x7f24ec0cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 -- 172.21.15.67:0/388397795 >> 172.21.15.67:0/388397795 conn(0x7f24ec08bfc0 msgr2=0x7f24ec1608c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 -- 172.21.15.67:0/388397795 shutdown_connections 2024-09-19T05:37:25.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.301+0000 7f24f17c1640 1 -- 172.21.15.67:0/388397795 wait complete. 2024-09-19T05:37:25.325 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:37:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.453+0000 7f0f82643640 1 Processor -- start 2024-09-19T05:37:25.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.453+0000 7f0f82643640 1 -- start start 2024-09-19T05:37:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.453+0000 7f0f82643640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f7c0b32d0 0x7f0f7c0d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.453+0000 7f0f82643640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 0x7f0f7c0cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.453+0000 7f0f82643640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7c06d850 con 0x7f0f7c0d1130 2024-09-19T05:37:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.453+0000 7f0f82643640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0f7c0d39e0 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.453+0000 7f0f82643640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7c0d33d0 con 0x7f0f7c0d1510 2024-09-19T05:37:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.453+0000 7f0f7b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f7c0b32d0 0x7f0f7c0d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f7b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f7c0b32d0 0x7f0f7c0d3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:60770/0 (socket says 172.21.15.67:60770) 2024-09-19T05:37:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f7b7fe640 1 -- 172.21.15.67:0/3652214213 learned_addr learned my addr 172.21.15.67:0/3652214213 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f80be0640 1 --2- 172.21.15.67:0/3652214213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 0x7f0f7c0cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f80be0640 1 -- 172.21.15.67:0/3652214213 >> v2:172.21.15.97:3300/0 conn(0x7f0f7c0b32d0 msgr2=0x7f0f7c0d3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f80be0640 1 --2- 172.21.15.67:0/3652214213 >> v2:172.21.15.97:3300/0 conn(0x7f0f7c0b32d0 0x7f0f7c0d3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f80be0640 1 -- 172.21.15.67:0/3652214213 >> v1:172.21.15.97:6789/0 conn(0x7f0f7c0d1130 legacy=0x7f0f7c06d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f80be0640 1 -- 172.21.15.67:0/3652214213 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c06db20 con 0x7f0f7c0d1510 2024-09-19T05:37:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f7b7fe640 1 --2- 172.21.15.67:0/3652214213 >> v2:172.21.15.97:3300/0 conn(0x7f0f7c0b32d0 0x7f0f7c0d3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:25.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f80be0640 1 --2- 172.21.15.67:0/3652214213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 0x7f0f7c0cf110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009d90 tx=0x7f0f7401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d8c2c29c51fa8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f7affd640 1 -- 172.21.15.67:0/3652214213 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f740b2070 con 0x7f0f7c0d1510 2024-09-19T05:37:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f7affd640 1 -- 172.21.15.67:0/3652214213 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f740a5970 con 0x7f0f7c0d1510 2024-09-19T05:37:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f7affd640 1 -- 172.21.15.67:0/3652214213 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f740a5d40 con 0x7f0f7c0d1510 2024-09-19T05:37:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f82643640 1 -- 172.21.15.67:0/3652214213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 msgr2=0x7f0f7c0cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f82643640 1 --2- 172.21.15.67:0/3652214213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 0x7f0f7c0cf110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009d90 tx=0x7f0f7401c8b0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f82643640 1 -- 172.21.15.67:0/3652214213 shutdown_connections 2024-09-19T05:37:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f82643640 1 --2- 172.21.15.67:0/3652214213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 0x7f0f7c0cf110 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f82643640 1 --2- 172.21.15.67:0/3652214213 >> v2:172.21.15.97:3300/0 conn(0x7f0f7c0b32d0 0x7f0f7c0d3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f82643640 1 -- 172.21.15.67:0/3652214213 >> 172.21.15.67:0/3652214213 conn(0x7f0f7c08bfc0 msgr2=0x7f0f7c0d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f82643640 1 -- 172.21.15.67:0/3652214213 shutdown_connections 2024-09-19T05:37:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.457+0000 7f0f82643640 1 -- 172.21.15.67:0/3652214213 wait complete. 2024-09-19T05:37:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 Processor -- start 2024-09-19T05:37:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 -- start start 2024-09-19T05:37:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f7c0b32d0 0x7f0f7c155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f7c0d1130 0x7f0f7c15a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 0x7f0f7c15ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c0d2750 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c0d25d0 con 0x7f0f7c0d1130 2024-09-19T05:37:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7c0d28d0 con 0x7f0f7c0d1510 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f7bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f7c0b32d0 0x7f0f7c155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f7bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f7c0b32d0 0x7f0f7c155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36282/0 (socket says 172.21.15.67:36282) 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f7bfff640 1 -- 172.21.15.67:0/202512302 learned_addr learned my addr 172.21.15.67:0/202512302 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f7b7fe640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f7c0d1130 0x7f0f7c15a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f80be0640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 0x7f0f7c15ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f7bfff640 1 -- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 msgr2=0x7f0f7c15ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f7bfff640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 0x7f0f7c15ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f7bfff640 1 -- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f7c0d1130 msgr2=0x7f0f7c15a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f7bfff640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f7c0d1130 0x7f0f7c15a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f7bfff640 1 -- 172.21.15.67:0/202512302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c1693d0 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f7bfff640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f7c0b32d0 0x7f0f7c155b60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c450 tx=0x7f0f6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f78ff9640 1 -- 172.21.15.67:0/202512302 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c016020 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f78ff9640 1 -- 172.21.15.67:0/202512302 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c0052d0 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 -- 172.21.15.67:0/202512302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7c1696b0 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f78ff9640 1 -- 172.21.15.67:0/202512302 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c007260 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 -- 172.21.15.67:0/202512302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7c0a06a0 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.461+0000 7f0f82643640 1 -- 172.21.15.67:0/202512302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7c0d3e70 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.465+0000 7f0f78ff9640 1 -- 172.21.15.67:0/202512302 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f6c007400 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.465+0000 7f0f78ff9640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f680678c0 0x7f0f68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:25.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.465+0000 7f0f78ff9640 1 -- 172.21.15.67:0/202512302 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5335+0+0 (secure 0 0 0) 0x7f0f6c0853c0 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.465+0000 7f0f7b7fe640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f680678c0 0x7f0f68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.465+0000 7f0f7b7fe640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f680678c0 0x7f0f68069d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0b56a0 tx=0x7f0f70009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.469+0000 7f0f78ff9640 1 -- 172.21.15.67:0/202512302 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0f6c020020 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.633+0000 7f0f82643640 1 -- 172.21.15.67:0/202512302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0f7c0d53d0 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.637+0000 7f0f78ff9640 1 -- 172.21.15.67:0/202512302 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f0f6c005480 con 0x7f0f7c0b32d0 2024-09-19T05:37:25.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 -- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f680678c0 msgr2=0x7f0f68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:25.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f680678c0 0x7f0f68069d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0b56a0 tx=0x7f0f70009240 comp rx=0 tx=0).stop 2024-09-19T05:37:25.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 -- 172.21.15.67:0/202512302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f7c0b32d0 msgr2=0x7f0f7c155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:25.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f7c0b32d0 0x7f0f7c155b60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c450 tx=0x7f0f6c00c910 comp rx=0 tx=0).stop 2024-09-19T05:37:25.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 -- 172.21.15.67:0/202512302 shutdown_connections 2024-09-19T05:37:25.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f680678c0 0x7f0f68069d80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f7c0d1510 0x7f0f7c15ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f7c0d1130 0x7f0f7c15a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 --2- 172.21.15.67:0/202512302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f7c0b32d0 0x7f0f7c155b60 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:25.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 -- 172.21.15.67:0/202512302 >> 172.21.15.67:0/202512302 conn(0x7f0f7c08bfc0 msgr2=0x7f0f7c0d2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:25.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 -- 172.21.15.67:0/202512302 shutdown_connections 2024-09-19T05:37:25.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:25.641+0000 7f0f82643640 1 -- 172.21.15.67:0/202512302 wait complete. 2024-09-19T05:37:25.661 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:37:25.662 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:37:25.737 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:37:25.816 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:37:25.816 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:37:25.817 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:25.823 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:37:25.823 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:37:25.823 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:25.828 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:37:25.828 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:37:25.828 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:25.876 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:37:25.877 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:37:25.880 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:25.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:37:25.885 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:37:25.886 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:26.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53de7cc640 1 Processor -- start 2024-09-19T05:37:26.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53de7cc640 1 -- start start 2024-09-19T05:37:26.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53de7cc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53d806dde0 0x7f53d80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53de7cc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d80b3510 0x7f53d806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53de7cc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d806e3c0 con 0x7f53d815c030 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53de7cc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f53d806e6a0 con 0x7f53d806dde0 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53de7cc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f53d806e980 con 0x7f53d80b3510 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53d77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53d806dde0 0x7f53d80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53d77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53d806dde0 0x7f53d80b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41340/0 (socket says 172.21.15.67:41340) 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53d77fe640 1 -- 172.21.15.67:0/2965470820 learned_addr learned my addr 172.21.15.67:0/2965470820 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53dcd69640 1 --2- 172.21.15.67:0/2965470820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d80b3510 0x7f53d806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53d77fe640 1 -- 172.21.15.67:0/2965470820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d80b3510 msgr2=0x7f53d806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53d77fe640 1 --2- 172.21.15.67:0/2965470820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d80b3510 0x7f53d806f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53d77fe640 1 -- 172.21.15.67:0/2965470820 >> v1:172.21.15.97:6789/0 conn(0x7f53d815c030 legacy=0x7f53d815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:26.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.049+0000 7f53d77fe640 1 -- 172.21.15.67:0/2965470820 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d806ec60 con 0x7f53d806dde0 2024-09-19T05:37:26.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53d77fe640 1 --2- 172.21.15.67:0/2965470820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d806dde0 0x7f53d80b2fd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009870 tx=0x7f53cc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d6e4f59b4a993a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:26.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53d6ffd640 1 -- 172.21.15.67:0/2965470820 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0b1070 con 0x7f53d806dde0 2024-09-19T05:37:26.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53d6ffd640 1 -- 172.21.15.67:0/2965470820 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc0ac620 con 0x7f53d806dde0 2024-09-19T05:37:26.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53d6ffd640 1 -- 172.21.15.67:0/2965470820 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0ac9f0 con 0x7f53d806dde0 2024-09-19T05:37:26.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 -- 172.21.15.67:0/2965470820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d806dde0 msgr2=0x7f53d80b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:26.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 --2- 172.21.15.67:0/2965470820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d806dde0 0x7f53d80b2fd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009870 tx=0x7f53cc01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 -- 172.21.15.67:0/2965470820 shutdown_connections 2024-09-19T05:37:26.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 --2- 172.21.15.67:0/2965470820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d80b3510 0x7f53d806f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 --2- 172.21.15.67:0/2965470820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d806dde0 0x7f53d80b2fd0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 -- 172.21.15.67:0/2965470820 >> 172.21.15.67:0/2965470820 conn(0x7f53d80d0080 msgr2=0x7f53d80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:26.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 -- 172.21.15.67:0/2965470820 shutdown_connections 2024-09-19T05:37:26.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 -- 172.21.15.67:0/2965470820 wait complete. 2024-09-19T05:37:26.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 Processor -- start 2024-09-19T05:37:26.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 -- start start 2024-09-19T05:37:26.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d806dde0 0x7f53d813eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d80b3510 0x7f53d81640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d815c030 0x7f53d8164620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f53d81692f0 con 0x7f53d815c030 2024-09-19T05:37:26.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f53d815c620 con 0x7f53d80b3510 2024-09-19T05:37:26.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53de7cc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f53d8169470 con 0x7f53d806dde0 2024-09-19T05:37:26.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.053+0000 7f53dcd69640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d815c030 0x7f53d8164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53dcd69640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d815c030 0x7f53d8164620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41352/0 (socket says 172.21.15.67:41352) 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53dcd69640 1 -- 172.21.15.67:0/250895088 learned_addr learned my addr 172.21.15.67:0/250895088 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d77fe640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d80b3510 0x7f53d81640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d7fff640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d806dde0 0x7f53d813eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53dcd69640 1 -- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d806dde0 msgr2=0x7f53d813eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53dcd69640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d806dde0 0x7f53d813eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53dcd69640 1 -- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d80b3510 msgr2=0x7f53d81640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53dcd69640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d80b3510 0x7f53d81640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53dcd69640 1 -- 172.21.15.67:0/250895088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d8164c50 con 0x7f53d815c030 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d7fff640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d806dde0 0x7f53d813eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d77fe640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d80b3510 0x7f53d81640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53dcd69640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d815c030 0x7f53d8164620 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f53d000cd70 tx=0x7f53d000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d4ff9640 1 -- 172.21.15.67:0/250895088 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d0003ba0 con 0x7f53d815c030 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d4ff9640 1 -- 172.21.15.67:0/250895088 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d0003d40 con 0x7f53d815c030 2024-09-19T05:37:26.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53de7cc640 1 -- 172.21.15.67:0/250895088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d8150650 con 0x7f53d815c030 2024-09-19T05:37:26.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d4ff9640 1 -- 172.21.15.67:0/250895088 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d0004240 con 0x7f53d815c030 2024-09-19T05:37:26.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53de7cc640 1 -- 172.21.15.67:0/250895088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d813f7b0 con 0x7f53d815c030 2024-09-19T05:37:26.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53de7cc640 1 -- 172.21.15.67:0/250895088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d80b2fd0 con 0x7f53d815c030 2024-09-19T05:37:26.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d4ff9640 1 -- 172.21.15.67:0/250895088 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53d00043e0 con 0x7f53d815c030 2024-09-19T05:37:26.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d4ff9640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53c40678c0 0x7f53c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d4ff9640 1 -- 172.21.15.67:0/250895088 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5335+0+0 (secure 0 0 0) 0x7f53d0086630 con 0x7f53d815c030 2024-09-19T05:37:26.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d7fff640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53c40678c0 0x7f53c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.057+0000 7f53d7fff640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53c40678c0 0x7f53c4069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f53c800a850 tx=0x7f53c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:26.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.061+0000 7f53d4ff9640 1 -- 172.21.15.67:0/250895088 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f53d001d340 con 0x7f53d815c030 2024-09-19T05:37:26.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 -- 172.21.15.67:0/250895088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53d80d0f20 con 0x7f53d815c030 2024-09-19T05:37:26.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53d4ff9640 1 -- 172.21.15.67:0/250895088 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3908 (secure 0 0 0) 0x7f53d0057240 con 0x7f53d815c030 2024-09-19T05:37:26.265 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:26.265 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"btime":"2024-09-19T05:37:19:983184+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/872634022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":872634022},{"type":"v1","addr":"172.21.15.97:6836","nonce":872634022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2340749382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2340749382},{"type":"v1","addr":"172.21.15.97:6837","nonce":2340749382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1455090407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1455090407},{"type":"v1","addr":"172.21.15.67:6833","nonce":1455090407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":6189,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1531708533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1531708533},{"type":"v1","addr":"172.21.15.67:6835","nonce":1531708533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-09-19T05:37:26.265 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 29 2024-09-19T05:37:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 -- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53c40678c0 msgr2=0x7f53c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53c40678c0 0x7f53c4069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f53c800a850 tx=0x7f53c8008040 comp rx=0 tx=0).stop 2024-09-19T05:37:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 -- 172.21.15.67:0/250895088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d815c030 msgr2=0x7f53d8164620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d815c030 0x7f53d8164620 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f53d000cd70 tx=0x7f53d000a660 comp rx=0 tx=0).stop 2024-09-19T05:37:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 -- 172.21.15.67:0/250895088 shutdown_connections 2024-09-19T05:37:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53d815c030 0x7f53d8164620 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53d80b3510 0x7f53d81640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f53c40678c0 0x7f53c4069d80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 --2- 172.21.15.67:0/250895088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53d806dde0 0x7f53d813eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 -- 172.21.15.67:0/250895088 >> 172.21.15.67:0/250895088 conn(0x7f53d80d0080 msgr2=0x7f53d80afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:26.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 -- 172.21.15.67:0/250895088 shutdown_connections 2024-09-19T05:37:26.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.261+0000 7f53de7cc640 1 -- 172.21.15.67:0/250895088 wait complete. 2024-09-19T05:37:26.283 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:37:26.283 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:37:26.283 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:37:26.283 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:37:26.284 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:37:26.284 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:37:26.284 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:37:26.284 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:37:26.284 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:37:26.284 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:37:26.285 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:37:26.285 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:37:26.285 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:37:26.285 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:37:26.285 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:37:26.285 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:37:26.293 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:37:26.294 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:37:26.294 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:37:26.295 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:37:26.298 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:37:26.298 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:37:26.305 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:37:26.305 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:37:26.337 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:37:26.337 DEBUG:teuthology.parallel:result is None 2024-09-19T05:37:26.337 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:37:26.338 DEBUG:teuthology.parallel:result is None 2024-09-19T05:37:26.347 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:37:26.348 DEBUG:teuthology.parallel:result is None 2024-09-19T05:37:26.349 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:37:26.349 DEBUG:teuthology.parallel:result is None 2024-09-19T05:37:26.349 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:37:26.397 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:37:26.397 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:37:26.417 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:37:26.424 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:37:26.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f5260ed6640 1 Processor -- start 2024-09-19T05:37:26.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f5260ed6640 1 -- start start 2024-09-19T05:37:26.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f5260ed6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f525c161da0 0x7f525c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f5260ed6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f525c0d0e80 0x7f525c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f5260ed6640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f525c0d4d40 con 0x7f525c0b41c0 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f5260ed6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f525c0d1830 con 0x7f525c161da0 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f5260ed6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f525c0d0840 con 0x7f525c0d0e80 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f525a59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f525c161da0 0x7f525c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f525ad9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f525c0b41c0 0x7f525c0b4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:60978/0 (socket says 172.21.15.67:60978) 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f525ad9d640 1 -- 172.21.15.67:0/3239243861 learned_addr learned my addr 172.21.15.67:0/3239243861 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f5259d9b640 1 --2- 172.21.15.67:0/3239243861 >> v2:172.21.15.97:3300/0 conn(0x7f525c0d0e80 0x7f525c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f525a59c640 1 -- 172.21.15.67:0/3239243861 >> v2:172.21.15.97:3300/0 conn(0x7f525c0d0e80 msgr2=0x7f525c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f525a59c640 1 --2- 172.21.15.67:0/3239243861 >> v2:172.21.15.97:3300/0 conn(0x7f525c0d0e80 0x7f525c0d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f525a59c640 1 -- 172.21.15.67:0/3239243861 >> v1:172.21.15.67:6789/0 conn(0x7f525c0b41c0 legacy=0x7f525c0b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:26.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.457+0000 7f525a59c640 1 -- 172.21.15.67:0/3239243861 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c0d5020 con 0x7f525c161da0 2024-09-19T05:37:26.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f525a59c640 1 --2- 172.21.15.67:0/3239243861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c161da0 0x7f525c0d1af0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f525c0d4440 tx=0x7f524c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a273878a172b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f525959a640 1 -- 172.21.15.67:0/3239243861 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0b0070 con 0x7f525c161da0 2024-09-19T05:37:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f525959a640 1 -- 172.21.15.67:0/3239243861 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524c0ab600 con 0x7f525c161da0 2024-09-19T05:37:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f525959a640 1 -- 172.21.15.67:0/3239243861 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0ab9d0 con 0x7f525c161da0 2024-09-19T05:37:26.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f5260ed6640 1 -- 172.21.15.67:0/3239243861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c161da0 msgr2=0x7f525c0d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f5260ed6640 1 --2- 172.21.15.67:0/3239243861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c161da0 0x7f525c0d1af0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f525c0d4440 tx=0x7f524c01c310 comp rx=0 tx=0).stop 2024-09-19T05:37:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f5260ed6640 1 -- 172.21.15.67:0/3239243861 shutdown_connections 2024-09-19T05:37:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f5260ed6640 1 --2- 172.21.15.67:0/3239243861 >> v2:172.21.15.97:3300/0 conn(0x7f525c0d0e80 0x7f525c0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f5260ed6640 1 --2- 172.21.15.67:0/3239243861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c161da0 0x7f525c0d1af0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f5260ed6640 1 -- 172.21.15.67:0/3239243861 >> 172.21.15.67:0/3239243861 conn(0x7f525c08bfc0 msgr2=0x7f525c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f5260ed6640 1 -- 172.21.15.67:0/3239243861 shutdown_connections 2024-09-19T05:37:26.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f5260ed6640 1 -- 172.21.15.67:0/3239243861 wait complete. 2024-09-19T05:37:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f5260ed6640 1 Processor -- start 2024-09-19T05:37:26.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.461+0000 7f5260ed6640 1 -- start start 2024-09-19T05:37:26.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5260ed6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c0b41c0 0x7f525c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5260ed6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f525c0d0e80 0x7f525c0b9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5260ed6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f525c161da0 0x7f525c0b9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5260ed6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0b5d00 con 0x7f525c0b41c0 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5260ed6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0b3ca0 con 0x7f525c161da0 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5260ed6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f525c162180 con 0x7f525c0d0e80 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f525a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c0b41c0 0x7f525c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f525a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c0b41c0 0x7f525c153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41372/0 (socket says 172.21.15.67:41372) 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f525a59c640 1 -- 172.21.15.67:0/4230437932 learned_addr learned my addr 172.21.15.67:0/4230437932 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5259d9b640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f525c0d0e80 0x7f525c0b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f525ad9d640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f525c161da0 0x7f525c0b9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f525a59c640 1 -- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f525c0d0e80 msgr2=0x7f525c0b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f525a59c640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f525c0d0e80 0x7f525c0b9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f525a59c640 1 -- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f525c161da0 msgr2=0x7f525c0b9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f525a59c640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f525c161da0 0x7f525c0b9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f525a59c640 1 -- 172.21.15.67:0/4230437932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c0cdef0 con 0x7f525c0b41c0 2024-09-19T05:37:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5259d9b640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f525c0d0e80 0x7f525c0b9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f525a59c640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c0b41c0 0x7f525c153aa0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f524c0ae040 tx=0x7f524c0190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f524affd640 1 -- 172.21.15.67:0/4230437932 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0b0040 con 0x7f525c0b41c0 2024-09-19T05:37:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f524affd640 1 -- 172.21.15.67:0/4230437932 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524c0b9070 con 0x7f525c0b41c0 2024-09-19T05:37:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5260ed6640 1 -- 172.21.15.67:0/4230437932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c0cd370 con 0x7f525c0b41c0 2024-09-19T05:37:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f524affd640 1 -- 172.21.15.67:0/4230437932 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0aa9b0 con 0x7f525c0b41c0 2024-09-19T05:37:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5260ed6640 1 -- 172.21.15.67:0/4230437932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c0cd930 con 0x7f525c0b41c0 2024-09-19T05:37:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5260ed6640 1 -- 172.21.15.67:0/4230437932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c0d12f0 con 0x7f525c0b41c0 2024-09-19T05:37:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f524affd640 1 -- 172.21.15.67:0/4230437932 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f524c0aab50 con 0x7f525c0b41c0 2024-09-19T05:37:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f524affd640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f523c0678c0 0x7f523c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f524affd640 1 -- 172.21.15.67:0/4230437932 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5335+0+0 (secure 0 0 0) 0x7f524c11fc50 con 0x7f525c0b41c0 2024-09-19T05:37:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5259d9b640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f523c0678c0 0x7f523c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.465+0000 7f5259d9b640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f523c0678c0 0x7f523c069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f525c0d03d0 tx=0x7f5250008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:26.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.469+0000 7f524affd640 1 -- 172.21.15.67:0/4230437932 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f524c125020 con 0x7f525c0b41c0 2024-09-19T05:37:26.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-19T05:37:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:26.645+0000 7f5260ed6640 1 -- 172.21.15.67:0/4230437932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f525c0d1d30 con 0x7f525c0b41c0 2024-09-19T05:37:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.313+0000 7f524affd640 1 -- 172.21.15.67:0/4230437932 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) ==== 97+0+0 (secure 0 0 0) 0x7f524c015f90 con 0x7f525c0b41c0 2024-09-19T05:37:27.319 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:37:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 -- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f523c0678c0 msgr2=0x7f523c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f523c0678c0 0x7f523c069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f525c0d03d0 tx=0x7f5250008040 comp rx=0 tx=0).stop 2024-09-19T05:37:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 -- 172.21.15.67:0/4230437932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c0b41c0 msgr2=0x7f525c153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c0b41c0 0x7f525c153aa0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f524c0ae040 tx=0x7f524c0190b0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 -- 172.21.15.67:0/4230437932 shutdown_connections 2024-09-19T05:37:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f525c161da0 0x7f525c0b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f523c0678c0 0x7f523c069d80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f525c0d0e80 0x7f525c0b9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 --2- 172.21.15.67:0/4230437932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f525c0b41c0 0x7f525c153aa0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 -- 172.21.15.67:0/4230437932 >> 172.21.15.67:0/4230437932 conn(0x7f525c08bfc0 msgr2=0x7f525c0b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 -- 172.21.15.67:0/4230437932 shutdown_connections 2024-09-19T05:37:27.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.317+0000 7f5260ed6640 1 -- 172.21.15.67:0/4230437932 wait complete. 2024-09-19T05:37:27.347 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:37:27.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34b12a1640 1 Processor -- start 2024-09-19T05:37:27.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34b12a1640 1 -- start start 2024-09-19T05:37:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34b12a1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f34ac06dde0 0x7f34ac0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34b12a1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ac06e3c0 con 0x7f34ac15c030 2024-09-19T05:37:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34b12a1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ac06e6a0 con 0x7f34ac0b3510 2024-09-19T05:37:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34b12a1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f34ac06e980 con 0x7f34ac06dde0 2024-09-19T05:37:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34aaffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f34ac15c030 0x7f34ac15d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:60994/0 (socket says 172.21.15.67:60994) 2024-09-19T05:37:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34aaffd640 1 -- 172.21.15.67:0/735480850 learned_addr learned my addr 172.21.15.67:0/735480850 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445673532 0 0) 0x7f34ac06e3c0 con 0x7f34ac15c030 2024-09-19T05:37:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34aa7fc640 1 --2- 172.21.15.67:0/735480850 >> v2:172.21.15.97:3300/0 conn(0x7f34ac06dde0 0x7f34ac0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3494003530 con 0x7f34ac15c030 2024-09-19T05:37:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2174560173 0 0) 0x7f3494003530 con 0x7f34ac15c030 2024-09-19T05:37:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 >> v2:172.21.15.97:3300/0 conn(0x7f34ac06dde0 msgr2=0x7f34ac0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 --2- 172.21.15.67:0/735480850 >> v2:172.21.15.97:3300/0 conn(0x7f34ac06dde0 0x7f34ac0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 >> v1:172.21.15.97:6789/0 conn(0x7f34ac0b3510 legacy=0x7f34ac06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ac06ec60 con 0x7f34ac15c030 2024-09-19T05:37:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f34a0001680 con 0x7f34ac15c030 2024-09-19T05:37:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 >> v1:172.21.15.67:6789/0 conn(0x7f34ac15c030 legacy=0x7f34ac15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 --2- 172.21.15.67:0/735480850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34940039c0 0x7f3494003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 --2- 172.21.15.67:0/735480850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f3494004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 --2- 172.21.15.67:0/735480850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34940051d0 0x7f349400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f34ac06e980 con 0x7f3494004810 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f349400c070 con 0x7f34940039c0 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f349400c270 con 0x7f34940051d0 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34aa7fc640 1 --2- 172.21.15.67:0/735480850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f3494004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34aaffd640 1 --2- 172.21.15.67:0/735480850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34940039c0 0x7f3494003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34aa7fc640 1 -- 172.21.15.67:0/735480850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34940051d0 msgr2=0x7f349400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34aa7fc640 1 --2- 172.21.15.67:0/735480850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34940051d0 0x7f349400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34aa7fc640 1 -- 172.21.15.67:0/735480850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34940039c0 msgr2=0x7f3494003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34aa7fc640 1 --2- 172.21.15.67:0/735480850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34940039c0 0x7f3494003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34aa7fc640 1 -- 172.21.15.67:0/735480850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3494003530 con 0x7f3494004810 2024-09-19T05:37:27.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.473+0000 7f34ab7fe640 1 -- 172.21.15.67:0/735480850 reap_dead start 2024-09-19T05:37:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34aa7fc640 1 --2- 172.21.15.67:0/735480850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f3494004c90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f349c009ae0 tx=0x7f349c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554cd9377b5f8ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c0b2070 con 0x7f3494004810 2024-09-19T05:37:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f349c0a5550 con 0x7f3494004810 2024-09-19T05:37:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34a9ffb640 1 -- 172.21.15.67:0/735480850 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c0096b0 con 0x7f3494004810 2024-09-19T05:37:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34b12a1640 1 -- 172.21.15.67:0/735480850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 msgr2=0x7f3494004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34b12a1640 1 --2- 172.21.15.67:0/735480850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f3494004c90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f349c009ae0 tx=0x7f349c01ca70 comp rx=0 tx=0).stop 2024-09-19T05:37:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34b12a1640 1 -- 172.21.15.67:0/735480850 shutdown_connections 2024-09-19T05:37:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34b12a1640 1 --2- 172.21.15.67:0/735480850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f3494004c90 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34b12a1640 1 -- 172.21.15.67:0/735480850 >> 172.21.15.67:0/735480850 conn(0x7f34ac0d0080 msgr2=0x7f34ac0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34b12a1640 1 -- 172.21.15.67:0/735480850 shutdown_connections 2024-09-19T05:37:27.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34b12a1640 1 -- 172.21.15.67:0/735480850 wait complete. 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34b12a1640 1 Processor -- start 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.477+0000 7f34b12a1640 1 -- start start 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34b12a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f34ac1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34b12a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34ac155710 0x7f34ac1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34b12a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34ac1508e0 0x7f34ac15ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34b12a1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f34ac15c590 con 0x7f3494004810 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34b12a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f34ac15c410 con 0x7f34ac155710 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34b12a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f34ac0b2fd0 con 0x7f34ac1508e0 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aaffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f34ac1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aaffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f34ac1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41382/0 (socket says 172.21.15.67:41382) 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aaffd640 1 -- 172.21.15.67:0/116076632 learned_addr learned my addr 172.21.15.67:0/116076632 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aa7fc640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34ac155710 0x7f34ac1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34ab7fe640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34ac1508e0 0x7f34ac15ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aaffd640 1 -- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34ac1508e0 msgr2=0x7f34ac15ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aaffd640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34ac1508e0 0x7f34ac15ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aaffd640 1 -- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34ac155710 msgr2=0x7f34ac1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aaffd640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34ac155710 0x7f34ac1503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aaffd640 1 -- 172.21.15.67:0/116076632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ac154130 con 0x7f3494004810 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aa7fc640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34ac155710 0x7f34ac1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aaffd640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f34ac1551d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f34a0011810 tx=0x7f34a0011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34937fe640 1 -- 172.21.15.67:0/116076632 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0010040 con 0x7f3494004810 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34937fe640 1 -- 172.21.15.67:0/116076632 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a001a070 con 0x7f3494004810 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34b12a1640 1 -- 172.21.15.67:0/116076632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34ac154410 con 0x7f3494004810 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34937fe640 1 -- 172.21.15.67:0/116076632 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a000fdc0 con 0x7f3494004810 2024-09-19T05:37:27.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34b12a1640 1 -- 172.21.15.67:0/116076632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34ac1549d0 con 0x7f3494004810 2024-09-19T05:37:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34937fe640 1 -- 172.21.15.67:0/116076632 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34a001f460 con 0x7f3494004810 2024-09-19T05:37:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34b12a1640 1 -- 172.21.15.67:0/116076632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34ac15d1d0 con 0x7f3494004810 2024-09-19T05:37:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34937fe640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34980678c0 0x7f3498069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34937fe640 1 -- 172.21.15.67:0/116076632 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7f34a0088c40 con 0x7f3494004810 2024-09-19T05:37:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aa7fc640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34980678c0 0x7f3498069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.481+0000 7f34aa7fc640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34980678c0 0x7f3498069d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f349c0af000 tx=0x7f349c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:27.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.485+0000 7f34937fe640 1 -- 172.21.15.67:0/116076632 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f34a00599d0 con 0x7f3494004810 2024-09-19T05:37:27.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.705+0000 7f34b12a1640 1 -- 172.21.15.67:0/116076632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f34ac0d0f20 con 0x7f3494004810 2024-09-19T05:37:27.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.705+0000 7f34937fe640 1 -- 172.21.15.67:0/116076632 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+5304 (secure 0 0 0) 0x7f34a00592d0 con 0x7f3494004810 2024-09-19T05:37:27.710 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:27.710 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:27.710 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:37:27.710 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.710 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:37:27.710 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:37:27.710 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.710 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.711 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.712 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:37:27.713 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.714 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:37:27.714 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:37:27.714 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.714 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.714 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.714 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.714 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:37:27.714 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:37:27.714 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.715 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:37:27.715 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:37:27.715 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.715 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.715 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.715 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.715 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:37:27.715 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:37:27.715 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.715 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:37:27.716 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.717 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.717 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.717 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.717 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:37:27.717 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:37:27.717 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.717 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:37:27.720 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:37:27.720 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.720 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.720 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.720 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.720 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:37:27.720 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:37:27.720 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.721 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:37:27.722 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:37:27.723 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:37:27.724 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.724 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.724 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.724 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:37:27.724 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:37:27.724 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.724 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:37:27.724 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:37:27.724 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:37:27.725 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:37:27.725 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.725 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.725 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.725 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:37:27.725 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:37:27.725 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.725 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:37:27.725 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:37:27.725 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.726 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:37:27.727 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:37:27.728 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:37:27.728 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.728 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:27.728 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:37:27.728 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:27.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 -- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34980678c0 msgr2=0x7f3498069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34980678c0 0x7f3498069d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f349c0af000 tx=0x7f349c008040 comp rx=0 tx=0).stop 2024-09-19T05:37:27.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 -- 172.21.15.67:0/116076632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 msgr2=0x7f34ac1551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f34ac1551d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f34a0011810 tx=0x7f34a0011cd0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 -- 172.21.15.67:0/116076632 shutdown_connections 2024-09-19T05:37:27.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34980678c0 0x7f3498069d80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34ac1508e0 0x7f34ac15ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34ac155710 0x7f34ac1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 --2- 172.21.15.67:0/116076632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3494004810 0x7f34ac1551d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 -- 172.21.15.67:0/116076632 >> 172.21.15.67:0/116076632 conn(0x7f34ac0d0080 msgr2=0x7f34ac15c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:27.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 -- 172.21.15.67:0/116076632 shutdown_connections 2024-09-19T05:37:27.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.709+0000 7f34b12a1640 1 -- 172.21.15.67:0/116076632 wait complete. 2024-09-19T05:37:27.731 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:37:27.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a549a7640 1 Processor -- start 2024-09-19T05:37:27.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a549a7640 1 -- start start 2024-09-19T05:37:27.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a549a7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3a500d16b0 0x7f3a5006ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a549a7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a500d1a90 0x7f3a5009b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a549a7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a501631f0 con 0x7f3a5006e100 2024-09-19T05:37:27.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a549a7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3a50070bd0 con 0x7f3a500d16b0 2024-09-19T05:37:27.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a549a7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3a50070eb0 con 0x7f3a500d1a90 2024-09-19T05:37:27.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4ed9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3a5006e100 0x7f3a501623e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32776/0 (socket says 172.21.15.67:32776) 2024-09-19T05:37:27.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4ed9d640 1 -- 172.21.15.67:0/999335945 learned_addr learned my addr 172.21.15.67:0/999335945 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:27.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4e59c640 1 --2- 172.21.15.67:0/999335945 >> v2:172.21.15.97:3300/0 conn(0x7f3a500d16b0 0x7f3a5006ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4dd9b640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a500d1a90 0x7f3a5009b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058717629 0 0) 0x7f3a501631f0 con 0x7f3a5006e100 2024-09-19T05:37:27.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a3c003530 con 0x7f3a5006e100 2024-09-19T05:37:27.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2572560071 0 0) 0x7f3a3c003530 con 0x7f3a5006e100 2024-09-19T05:37:27.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a500d1a90 msgr2=0x7f3a5009b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:27.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a500d1a90 0x7f3a5009b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 >> v2:172.21.15.97:3300/0 conn(0x7f3a500d16b0 msgr2=0x7f3a5006ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:27.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 --2- 172.21.15.67:0/999335945 >> v2:172.21.15.97:3300/0 conn(0x7f3a500d16b0 0x7f3a5006ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a50071190 con 0x7f3a5006e100 2024-09-19T05:37:27.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3a40001a00 con 0x7f3a5006e100 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 >> v1:172.21.15.67:6789/0 conn(0x7f3a5006e100 legacy=0x7f3a501623e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c0039c0 0x7f3a3c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a3c004320 0x7f3a3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c004f00 0x7f3a3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a50070bd0 con 0x7f3a3c004f00 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3a50070eb0 con 0x7f3a3c004320 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3c00bf10 con 0x7f3a3c0039c0 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4ed9d640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c004f00 0x7f3a3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4dd9b640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a3c004320 0x7f3a3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4e59c640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c0039c0 0x7f3a3c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4ed9d640 1 -- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c0039c0 msgr2=0x7f3a3c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4ed9d640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c0039c0 0x7f3a3c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4ed9d640 1 -- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a3c004320 msgr2=0x7f3a3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:27.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4ed9d640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a3c004320 0x7f3a3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4ed9d640 1 -- 172.21.15.67:0/999335945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c003530 con 0x7f3a3c004f00 2024-09-19T05:37:27.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.841+0000 7f3a4e59c640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c0039c0 0x7f3a3c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:27.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a4ed9d640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c004f00 0x7f3a3c00b9d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3a400013e0 tx=0x7f3a4001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c514a3b507c04bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:27.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4000a4e0 con 0x7f3a3c004f00 2024-09-19T05:37:27.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a400ad650 con 0x7f3a3c004f00 2024-09-19T05:37:27.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a4d59a640 1 -- 172.21.15.67:0/999335945 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a400ada40 con 0x7f3a3c004f00 2024-09-19T05:37:27.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a549a7640 1 -- 172.21.15.67:0/999335945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c004f00 msgr2=0x7f3a3c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a549a7640 1 --2- 172.21.15.67:0/999335945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a3c004f00 0x7f3a3c00b9d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3a400013e0 tx=0x7f3a4001d3a0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a4ed9d640 1 -- 172.21.15.67:0/999335945 reap_dead start 2024-09-19T05:37:27.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a549a7640 1 -- 172.21.15.67:0/999335945 shutdown_connections 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a549a7640 1 -- 172.21.15.67:0/999335945 >> 172.21.15.67:0/999335945 conn(0x7f3a500d22d0 msgr2=0x7f3a500d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a549a7640 1 -- 172.21.15.67:0/999335945 shutdown_connections 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a549a7640 1 -- 172.21.15.67:0/999335945 wait complete. 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a549a7640 1 Processor -- start 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.845+0000 7f3a549a7640 1 -- start start 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a549a7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c004f00 0x7f3a500b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a549a7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a5014a0c0 0x7f3a50161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a549a7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a50161a60 0x7f3a5015e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a549a7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a500d0f00 con 0x7f3a50161a60 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a549a7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3a500d0d80 con 0x7f3a5014a0c0 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a549a7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3a50169710 con 0x7f3a3c004f00 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a50161a60 0x7f3a5015e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a50161a60 0x7f3a5015e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41410/0 (socket says 172.21.15.67:41410) 2024-09-19T05:37:27.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4ed9d640 1 -- 172.21.15.67:0/411441462 learned_addr learned my addr 172.21.15.67:0/411441462 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4e59c640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c004f00 0x7f3a500b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4dd9b640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a5014a0c0 0x7f3a50161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4ed9d640 1 -- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c004f00 msgr2=0x7f3a500b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4ed9d640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c004f00 0x7f3a500b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4ed9d640 1 -- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a5014a0c0 msgr2=0x7f3a50161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4ed9d640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a5014a0c0 0x7f3a50161520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4ed9d640 1 -- 172.21.15.67:0/411441462 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a500b6680 con 0x7f3a50161a60 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4e59c640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c004f00 0x7f3a500b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4ed9d640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a50161a60 0x7f3a5015e580 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3a4001d3e0 tx=0x7f3a3c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a46ffd640 1 -- 172.21.15.67:0/411441462 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a400bc070 con 0x7f3a50161a60 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a46ffd640 1 -- 172.21.15.67:0/411441462 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4000a4c0 con 0x7f3a50161a60 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a549a7640 1 -- 172.21.15.67:0/411441462 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a500b6960 con 0x7f3a50161a60 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a46ffd640 1 -- 172.21.15.67:0/411441462 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40002050 con 0x7f3a50161a60 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a549a7640 1 -- 172.21.15.67:0/411441462 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a500b6f20 con 0x7f3a50161a60 2024-09-19T05:37:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a549a7640 1 -- 172.21.15.67:0/411441462 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a50163150 con 0x7f3a50161a60 2024-09-19T05:37:27.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a46ffd640 1 -- 172.21.15.67:0/411441462 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a400bf070 con 0x7f3a50161a60 2024-09-19T05:37:27.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a46ffd640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a300678c0 0x7f3a30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:27.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a46ffd640 1 -- 172.21.15.67:0/411441462 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7f3a4011f990 con 0x7f3a50161a60 2024-09-19T05:37:27.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4e59c640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a300678c0 0x7f3a30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:27.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.849+0000 7f3a4e59c640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a300678c0 0x7f3a30069d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009be0 tx=0x7f3a48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:27.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:27.853+0000 7f3a46ffd640 1 -- 172.21.15.67:0/411441462 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3a400170b0 con 0x7f3a50161a60 2024-09-19T05:37:28.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 -- 172.21.15.67:0/411441462 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3a500b81f0 con 0x7f3a50161a60 2024-09-19T05:37:28.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a46ffd640 1 -- 172.21.15.67:0/411441462 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) ==== 84+0+65 (secure 0 0 0) 0x7f3a400f00d0 con 0x7f3a50161a60 2024-09-19T05:37:28.021 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:28.021 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:37:28.021 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:37:28.021 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:37:28.021 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:37:28.021 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:28.021 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:37:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 -- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a300678c0 msgr2=0x7f3a30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a300678c0 0x7f3a30069d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009be0 tx=0x7f3a48008040 comp rx=0 tx=0).stop 2024-09-19T05:37:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 -- 172.21.15.67:0/411441462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a50161a60 msgr2=0x7f3a5015e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a50161a60 0x7f3a5015e580 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3a4001d3e0 tx=0x7f3a3c005840 comp rx=0 tx=0).stop 2024-09-19T05:37:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 -- 172.21.15.67:0/411441462 shutdown_connections 2024-09-19T05:37:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a50161a60 0x7f3a5015e580 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a5014a0c0 0x7f3a50161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a300678c0 0x7f3a30069d80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 --2- 172.21.15.67:0/411441462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a3c004f00 0x7f3a500b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 -- 172.21.15.67:0/411441462 >> 172.21.15.67:0/411441462 conn(0x7f3a500d22d0 msgr2=0x7f3a500b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 -- 172.21.15.67:0/411441462 shutdown_connections 2024-09-19T05:37:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.017+0000 7f3a549a7640 1 -- 172.21.15.67:0/411441462 wait complete. 2024-09-19T05:37:28.040 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:37:28.040 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:37:28.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.153+0000 7fe1bd879640 1 Processor -- start 2024-09-19T05:37:28.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.153+0000 7fe1bd879640 1 -- start start 2024-09-19T05:37:28.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1b806d3e0 0x7fe1b80cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:28.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe1b80732b0 0x7fe1b815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:28.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b815a130 con 0x7fe1b8159d50 2024-09-19T05:37:28.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe1b80737c0 con 0x7fe1b806d3e0 2024-09-19T05:37:28.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe1b815fe00 con 0x7fe1b80732b0 2024-09-19T05:37:28.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1affff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1b806d3e0 0x7fe1b80cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:28.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1affff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1b806d3e0 0x7fe1b80cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41416/0 (socket says 172.21.15.67:41416) 2024-09-19T05:37:28.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1affff640 1 -- 172.21.15.67:0/362396141 learned_addr learned my addr 172.21.15.67:0/362396141 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:28.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1b77fe640 1 --2- 172.21.15.67:0/362396141 >> v2:172.21.15.97:3300/0 conn(0x7fe1b80732b0 0x7fe1b815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:28.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1affff640 1 -- 172.21.15.67:0/362396141 >> v2:172.21.15.97:3300/0 conn(0x7fe1b80732b0 msgr2=0x7fe1b815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:28.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1affff640 1 --2- 172.21.15.67:0/362396141 >> v2:172.21.15.97:3300/0 conn(0x7fe1b80732b0 0x7fe1b815c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:28.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1affff640 1 -- 172.21.15.67:0/362396141 >> v1:172.21.15.97:6789/0 conn(0x7fe1b8159d50 legacy=0x7fe1b806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:28.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1affff640 1 -- 172.21.15.67:0/362396141 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b81600e0 con 0x7fe1b806d3e0 2024-09-19T05:37:28.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1affff640 1 --2- 172.21.15.67:0/362396141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b806d3e0 0x7fe1b80cde00 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80cd370 tx=0x7fe1a001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25dd45e32ced508 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:28.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1b67fc640 1 -- 172.21.15.67:0/362396141 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00b0070 con 0x7fe1b806d3e0 2024-09-19T05:37:28.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1b67fc640 1 -- 172.21.15.67:0/362396141 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a00ab600 con 0x7fe1b806d3e0 2024-09-19T05:37:28.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1b67fc640 1 -- 172.21.15.67:0/362396141 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00ab9d0 con 0x7fe1b806d3e0 2024-09-19T05:37:28.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 -- 172.21.15.67:0/362396141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b806d3e0 msgr2=0x7fe1b80cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:28.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 --2- 172.21.15.67:0/362396141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b806d3e0 0x7fe1b80cde00 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80cd370 tx=0x7fe1a001c450 comp rx=0 tx=0).stop 2024-09-19T05:37:28.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 -- 172.21.15.67:0/362396141 shutdown_connections 2024-09-19T05:37:28.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 --2- 172.21.15.67:0/362396141 >> v2:172.21.15.97:3300/0 conn(0x7fe1b80732b0 0x7fe1b815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:28.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 --2- 172.21.15.67:0/362396141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b806d3e0 0x7fe1b80cde00 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:28.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 -- 172.21.15.67:0/362396141 >> 172.21.15.67:0/362396141 conn(0x7fe1b8072790 msgr2=0x7fe1b8072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:28.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 -- 172.21.15.67:0/362396141 shutdown_connections 2024-09-19T05:37:28.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.157+0000 7fe1bd879640 1 -- 172.21.15.67:0/362396141 wait complete. 2024-09-19T05:37:28.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 Processor -- start 2024-09-19T05:37:28.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 -- start start 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1b806d3e0 0x7fe1b814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b80732b0 0x7fe1b814d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b8159d50 0x7fe1b8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b81691f0 con 0x7fe1b80732b0 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8169070 con 0x7fe1b8159d50 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b8169370 con 0x7fe1b806d3e0 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1affff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b80732b0 0x7fe1b814d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1affff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b80732b0 0x7fe1b814d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41430/0 (socket says 172.21.15.67:41430) 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1affff640 1 -- 172.21.15.67:0/1177812882 learned_addr learned my addr 172.21.15.67:0/1177812882 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1affff640 1 -- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1b806d3e0 msgr2=0x7fe1b814df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1b6ffd640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1b806d3e0 0x7fe1b814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1b77fe640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b8159d50 0x7fe1b8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:28.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1affff640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1b806d3e0 0x7fe1b814df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:28.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1affff640 1 -- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b8159d50 msgr2=0x7fe1b8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:28.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1affff640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b8159d50 0x7fe1b8153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:28.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1affff640 1 -- 172.21.15.67:0/1177812882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b81557c0 con 0x7fe1b80732b0 2024-09-19T05:37:28.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1affff640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b80732b0 0x7fe1b814d5b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00ae040 tx=0x7fe1a001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:28.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1b4ff9640 1 -- 172.21.15.67:0/1177812882 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00ba020 con 0x7fe1b80732b0 2024-09-19T05:37:28.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1b4ff9640 1 -- 172.21.15.67:0/1177812882 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a00b6620 con 0x7fe1b80732b0 2024-09-19T05:37:28.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1b4ff9640 1 -- 172.21.15.67:0/1177812882 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00b0040 con 0x7fe1b80732b0 2024-09-19T05:37:28.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 -- 172.21.15.67:0/1177812882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b8155aa0 con 0x7fe1b80732b0 2024-09-19T05:37:28.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 -- 172.21.15.67:0/1177812882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b81f5510 con 0x7fe1b80732b0 2024-09-19T05:37:28.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.161+0000 7fe1bd879640 1 -- 172.21.15.67:0/1177812882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b80cde00 con 0x7fe1b80732b0 2024-09-19T05:37:28.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.165+0000 7fe1b4ff9640 1 -- 172.21.15.67:0/1177812882 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1a00bd020 con 0x7fe1b80732b0 2024-09-19T05:37:28.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.165+0000 7fe1b4ff9640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1980678c0 0x7fe198069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:28.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.165+0000 7fe1b4ff9640 1 -- 172.21.15.67:0/1177812882 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7fe1a0120290 con 0x7fe1b80732b0 2024-09-19T05:37:28.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.165+0000 7fe1b6ffd640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1980678c0 0x7fe198069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:28.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.165+0000 7fe1b6ffd640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1980678c0 0x7fe198069d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800a750 tx=0x7fe1a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:28.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.169+0000 7fe1b4ff9640 1 -- 172.21.15.67:0/1177812882 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe1a00c4030 con 0x7fe1b80732b0 2024-09-19T05:37:28.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:28.337+0000 7fe1bd879640 1 -- 172.21.15.67:0/1177812882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe1b815f260 con 0x7fe1b80732b0 2024-09-19T05:37:29.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.329+0000 7fe1b4ff9640 1 -- 172.21.15.67:0/1177812882 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) ==== 138+0+0 (secure 0 0 0) 0x7fe1a00160d0 con 0x7fe1b80732b0 2024-09-19T05:37:29.332 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:37:29.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 -- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1980678c0 msgr2=0x7fe198069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:29.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1980678c0 0x7fe198069d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800a750 tx=0x7fe1a8008040 comp rx=0 tx=0).stop 2024-09-19T05:37:29.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 -- 172.21.15.67:0/1177812882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b80732b0 msgr2=0x7fe1b814d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:29.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b80732b0 0x7fe1b814d5b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00ae040 tx=0x7fe1a001ac90 comp rx=0 tx=0).stop 2024-09-19T05:37:29.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 -- 172.21.15.67:0/1177812882 shutdown_connections 2024-09-19T05:37:29.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b8159d50 0x7fe1b8153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:29.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b80732b0 0x7fe1b814d5b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:29.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1980678c0 0x7fe198069d80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:29.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 --2- 172.21.15.67:0/1177812882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1b806d3e0 0x7fe1b814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:29.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 -- 172.21.15.67:0/1177812882 >> 172.21.15.67:0/1177812882 conn(0x7fe1b8072790 msgr2=0x7fe1b8072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:29.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 -- 172.21.15.67:0/1177812882 shutdown_connections 2024-09-19T05:37:29.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.333+0000 7fe1bd879640 1 -- 172.21.15.67:0/1177812882 wait complete. 2024-09-19T05:37:29.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:37:29.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.493+0000 7f17c282a640 1 Processor -- start 2024-09-19T05:37:29.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.493+0000 7f17c282a640 1 -- start start 2024-09-19T05:37:29.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.493+0000 7f17c282a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc159c60 0x7f17bc0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:29.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.493+0000 7f17c282a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17bc15a040 con 0x7f17bc06ffd0 2024-09-19T05:37:29.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.493+0000 7f17c282a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17bc15c850 con 0x7f17bc0af3a0 2024-09-19T05:37:29.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.493+0000 7f17c282a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f17bc15d460 con 0x7f17bc159c60 2024-09-19T05:37:29.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.493+0000 7f17bb7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f17bc06ffd0 0x7f17bc0aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32786/0 (socket says 172.21.15.67:32786) 2024-09-19T05:37:29.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.493+0000 7f17bb7fe640 1 -- 172.21.15.67:0/4205255813 learned_addr learned my addr 172.21.15.67:0/4205255813 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:29.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.493+0000 7f17bbfff640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc159c60 0x7f17bc0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:29.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.493+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047887859 0 0) 0x7f17bc15a040 con 0x7f17bc06ffd0 2024-09-19T05:37:29.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17a8003530 con 0x7f17bc06ffd0 2024-09-19T05:37:29.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3137438168 0 0) 0x7f17a8003530 con 0x7f17bc06ffd0 2024-09-19T05:37:29.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc159c60 msgr2=0x7f17bc0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:29.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc159c60 0x7f17bc0ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:29.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 >> v1:172.21.15.97:6789/0 conn(0x7f17bc0af3a0 legacy=0x7f17bc15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:29.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc15cb30 con 0x7f17bc06ffd0 2024-09-19T05:37:29.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f17ac001680 con 0x7f17bc06ffd0 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 >> v1:172.21.15.67:6789/0 conn(0x7f17bc06ffd0 legacy=0x7f17bc0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 0x7f17a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a8004810 0x7f17a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc159c60 0x7f17a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc15d460 con 0x7f17a80039f0 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f17a800bab0 con 0x7f17a8004810 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f17a800bcb0 con 0x7f17bc159c60 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17bbfff640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 0x7f17a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17c0dc7640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc159c60 0x7f17a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17bb7fe640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a8004810 0x7f17a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17bbfff640 1 -- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc159c60 msgr2=0x7f17a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17bbfff640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc159c60 0x7f17a80051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:29.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17bbfff640 1 -- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a8004810 msgr2=0x7f17a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:29.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17bbfff640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a8004810 0x7f17a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:29.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17bbfff640 1 -- 172.21.15.67:0/4205255813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a8003530 con 0x7f17a80039f0 2024-09-19T05:37:29.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17bb7fe640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a8004810 0x7f17a8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:29.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17bbfff640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 0x7f17a8003e10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009ab0 tx=0x7f17a401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4cf17f37d42831 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:29.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40b2070 con 0x7f17a80039f0 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a40a55d0 con 0x7f17a80039f0 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17baffd640 1 -- 172.21.15.67:0/4205255813 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40096b0 con 0x7f17a80039f0 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17c282a640 1 -- 172.21.15.67:0/4205255813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 msgr2=0x7f17a8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17c282a640 1 --2- 172.21.15.67:0/4205255813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 0x7f17a8003e10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009ab0 tx=0x7f17a401ca00 comp rx=0 tx=0).stop 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17c0dc7640 1 -- 172.21.15.67:0/4205255813 reap_dead start 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17c282a640 1 -- 172.21.15.67:0/4205255813 shutdown_connections 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.497+0000 7f17c282a640 1 -- 172.21.15.67:0/4205255813 >> 172.21.15.67:0/4205255813 conn(0x7f17bc0b1e50 msgr2=0x7f17bc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 -- 172.21.15.67:0/4205255813 shutdown_connections 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 -- 172.21.15.67:0/4205255813 wait complete. 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 Processor -- start 2024-09-19T05:37:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 -- start start 2024-09-19T05:37:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 0x7f17bc14d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc1588f0 0x7f17bc158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17bc150510 0x7f17bc1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc0ad4c0 con 0x7f17a80039f0 2024-09-19T05:37:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc0ad340 con 0x7f17bc150510 2024-09-19T05:37:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f17bc0ad640 con 0x7f17bc1588f0 2024-09-19T05:37:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 0x7f17bc14d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 0x7f17bc14d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41450/0 (socket says 172.21.15.67:41450) 2024-09-19T05:37:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bbfff640 1 -- 172.21.15.67:0/2636219652 learned_addr learned my addr 172.21.15.67:0/2636219652 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c0dc7640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17bc150510 0x7f17bc1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bb7fe640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc1588f0 0x7f17bc158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bbfff640 1 -- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc1588f0 msgr2=0x7f17bc158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bbfff640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc1588f0 0x7f17bc158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bbfff640 1 -- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17bc150510 msgr2=0x7f17bc1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bbfff640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17bc150510 0x7f17bc1509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bbfff640 1 -- 172.21.15.67:0/2636219652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc14dd10 con 0x7f17a80039f0 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bb7fe640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc1588f0 0x7f17bc158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17bbfff640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 0x7f17bc14d7d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f17a40b0040 tx=0x7f17a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17b8ff9640 1 -- 172.21.15.67:0/2636219652 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40b2040 con 0x7f17a80039f0 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17b8ff9640 1 -- 172.21.15.67:0/2636219652 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a400f000 con 0x7f17a80039f0 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 -- 172.21.15.67:0/2636219652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc14f020 con 0x7f17a80039f0 2024-09-19T05:37:29.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17b8ff9640 1 -- 172.21.15.67:0/2636219652 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4004020 con 0x7f17a80039f0 2024-09-19T05:37:29.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.501+0000 7f17c282a640 1 -- 172.21.15.67:0/2636219652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc14f5e0 con 0x7f17a80039f0 2024-09-19T05:37:29.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.505+0000 7f17c282a640 1 -- 172.21.15.67:0/2636219652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17bc0aec90 con 0x7f17a80039f0 2024-09-19T05:37:29.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.505+0000 7f17b8ff9640 1 -- 172.21.15.67:0/2636219652 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17a40c0030 con 0x7f17a80039f0 2024-09-19T05:37:29.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.505+0000 7f17b8ff9640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f179c0678c0 0x7f179c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:29.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.505+0000 7f17b8ff9640 1 -- 172.21.15.67:0/2636219652 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5619+0+0 (secure 0 0 0) 0x7f17a411ffe0 con 0x7f17a80039f0 2024-09-19T05:37:29.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.505+0000 7f17bb7fe640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f179c0678c0 0x7f179c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:29.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.505+0000 7f17bb7fe640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f179c0678c0 0x7f179c069d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0017f0 tx=0x7f17ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:29.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.509+0000 7f17b8ff9640 1 -- 172.21.15.67:0/2636219652 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f17a40c7060 con 0x7f17a80039f0 2024-09-19T05:37:29.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:29.673+0000 7f17c282a640 1 -- 172.21.15.67:0/2636219652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f17bc14e350 con 0x7f17a80039f0 2024-09-19T05:37:30.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.333+0000 7f17b8ff9640 1 -- 172.21.15.67:0/2636219652 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) ==== 170+0+0 (secure 0 0 0) 0x7f17a4016740 con 0x7f17a80039f0 2024-09-19T05:37:30.337 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:37:30.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 -- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f179c0678c0 msgr2=0x7f179c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f179c0678c0 0x7f179c069d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0017f0 tx=0x7f17ac009040 comp rx=0 tx=0).stop 2024-09-19T05:37:30.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 -- 172.21.15.67:0/2636219652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 msgr2=0x7f17bc14d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 0x7f17bc14d7d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f17a40b0040 tx=0x7f17a8005840 comp rx=0 tx=0).stop 2024-09-19T05:37:30.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 -- 172.21.15.67:0/2636219652 shutdown_connections 2024-09-19T05:37:30.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17bc150510 0x7f17bc1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f179c0678c0 0x7f179c069d80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17bc1588f0 0x7f17bc158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 --2- 172.21.15.67:0/2636219652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a80039f0 0x7f17bc14d7d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 -- 172.21.15.67:0/2636219652 >> 172.21.15.67:0/2636219652 conn(0x7f17bc0b1e50 msgr2=0x7f17bc06eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:30.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 -- 172.21.15.67:0/2636219652 shutdown_connections 2024-09-19T05:37:30.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.337+0000 7f17c282a640 1 -- 172.21.15.67:0/2636219652 wait complete. 2024-09-19T05:37:30.374 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:37:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa4028bd640 1 Processor -- start 2024-09-19T05:37:30.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa4028bd640 1 -- start start 2024-09-19T05:37:30.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa4028bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3fc0af120 0x7fa3fc0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa4028bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3fc0b3a60 0x7fa3fc0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa4028bd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3fc071110 con 0x7fa3fc15e660 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa4028bd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa3fc15ea40 con 0x7fa3fc0b3a60 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa4028bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa3fc070610 con 0x7fa3fc0af120 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa400e5a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3fc0b3a60 0x7fa3fc0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa400e5a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3fc0b3a60 0x7fa3fc0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41454/0 (socket says 172.21.15.67:41454) 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa400e5a640 1 -- 172.21.15.67:0/1779038891 learned_addr learned my addr 172.21.15.67:0/1779038891 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa3fb7fe640 1 --2- 172.21.15.67:0/1779038891 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3fc0af120 0x7fa3fc0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa400e5a640 1 -- 172.21.15.67:0/1779038891 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3fc0af120 msgr2=0x7fa3fc0b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa400e5a640 1 --2- 172.21.15.67:0/1779038891 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3fc0af120 0x7fa3fc0b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa400e5a640 1 -- 172.21.15.67:0/1779038891 >> v1:172.21.15.97:6789/0 conn(0x7fa3fc15e660 legacy=0x7fa3fc0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa400e5a640 1 -- 172.21.15.67:0/1779038891 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3fc0b4240 con 0x7fa3fc0b3a60 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.501+0000 7fa3fb7fe640 1 --2- 172.21.15.67:0/1779038891 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3fc0af120 0x7fa3fc0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa400e5a640 1 --2- 172.21.15.67:0/1779038891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc0b3a60 0x7fa3fc0b4740 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009e50 tx=0x7fa3ec01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b261a62f0846dac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa3faffd640 1 -- 172.21.15.67:0/1779038891 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0a56d0 con 0x7fa3fc0b3a60 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa3faffd640 1 -- 172.21.15.67:0/1779038891 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ec0a5870 con 0x7fa3fc0b3a60 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa3faffd640 1 -- 172.21.15.67:0/1779038891 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0a5c40 con 0x7fa3fc0b3a60 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa4028bd640 1 -- 172.21.15.67:0/1779038891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc0b3a60 msgr2=0x7fa3fc0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa4028bd640 1 --2- 172.21.15.67:0/1779038891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc0b3a60 0x7fa3fc0b4740 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009e50 tx=0x7fa3ec01c960 comp rx=0 tx=0).stop 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa4028bd640 1 -- 172.21.15.67:0/1779038891 shutdown_connections 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa4028bd640 1 --2- 172.21.15.67:0/1779038891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc0b3a60 0x7fa3fc0b4740 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa4028bd640 1 --2- 172.21.15.67:0/1779038891 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3fc0af120 0x7fa3fc0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa4028bd640 1 -- 172.21.15.67:0/1779038891 >> 172.21.15.67:0/1779038891 conn(0x7fa3fc0b2f40 msgr2=0x7fa3fc0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa4028bd640 1 -- 172.21.15.67:0/1779038891 shutdown_connections 2024-09-19T05:37:30.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa4028bd640 1 -- 172.21.15.67:0/1779038891 wait complete. 2024-09-19T05:37:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa4028bd640 1 Processor -- start 2024-09-19T05:37:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.505+0000 7fa4028bd640 1 -- start start 2024-09-19T05:37:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa4028bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3fc0af120 0x7fa3fc160690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa4028bd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3fc0b3a60 0x7fa3fc14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa4028bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc15e660 0x7fa3fc15f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa4028bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc0b5610 con 0x7fa3fc15e660 2024-09-19T05:37:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa4028bd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc0b5490 con 0x7fa3fc0b3a60 2024-09-19T05:37:30.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa4028bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa3fc0b5790 con 0x7fa3fc0af120 2024-09-19T05:37:30.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa400e5a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc15e660 0x7fa3fc15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:30.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa400e5a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc15e660 0x7fa3fc15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41460/0 (socket says 172.21.15.67:41460) 2024-09-19T05:37:30.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa400e5a640 1 -- 172.21.15.67:0/3754097604 learned_addr learned my addr 172.21.15.67:0/3754097604 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa3fb7fe640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3fc0b3a60 0x7fa3fc14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa400e5a640 1 -- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3fc0af120 msgr2=0x7fa3fc160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa400e5a640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3fc0af120 0x7fa3fc160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa400e5a640 1 -- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3fc0b3a60 msgr2=0x7fa3fc14ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa400e5a640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3fc0b3a60 0x7fa3fc14ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa400e5a640 1 -- 172.21.15.67:0/3754097604 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3fc161230 con 0x7fa3fc15e660 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa3fb7fe640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3fc0b3a60 0x7fa3fc14ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa400e5a640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc15e660 0x7fa3fc15f500 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0af040 tx=0x7fa3ec019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa3f8ff9640 1 -- 172.21.15.67:0/3754097604 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0bc020 con 0x7fa3fc15e660 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa3f8ff9640 1 -- 172.21.15.67:0/3754097604 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ec0b8670 con 0x7fa3fc15e660 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa4028bd640 1 -- 172.21.15.67:0/3754097604 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3fc160c70 con 0x7fa3fc15e660 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa3f8ff9640 1 -- 172.21.15.67:0/3754097604 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0b8a60 con 0x7fa3fc15e660 2024-09-19T05:37:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa4028bd640 1 -- 172.21.15.67:0/3754097604 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3fc15ed00 con 0x7fa3fc15e660 2024-09-19T05:37:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa4028bd640 1 -- 172.21.15.67:0/3754097604 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3fc0b0910 con 0x7fa3fc15e660 2024-09-19T05:37:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa3f8ff9640 1 -- 172.21.15.67:0/3754097604 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3ec0bf020 con 0x7fa3fc15e660 2024-09-19T05:37:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa3f8ff9640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3dc0678c0 0x7fa3dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa3f8ff9640 1 -- 172.21.15.67:0/3754097604 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6001+0+0 (secure 0 0 0) 0x7fa3ec120e50 con 0x7fa3fc15e660 2024-09-19T05:37:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.509+0000 7fa3fbfff640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3dc0678c0 0x7fa3dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.513+0000 7fa3fbfff640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3dc0678c0 0x7fa3dc069d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4009670 tx=0x7fa3f4006bd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.513+0000 7fa3f8ff9640 1 -- 172.21.15.67:0/3754097604 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa3ec0c6030 con 0x7fa3fc15e660 2024-09-19T05:37:30.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:30.717+0000 7fa4028bd640 1 -- 172.21.15.67:0/3754097604 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa3fc1504b0 con 0x7fa3fc15e660 2024-09-19T05:37:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.381+0000 7fa3f8ff9640 1 -- 172.21.15.67:0/3754097604 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v32) ==== 173+0+0 (secure 0 0 0) 0x7fa3ec0165e0 con 0x7fa3fc15e660 2024-09-19T05:37:31.389 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 9 and data pool 10 2024-09-19T05:37:31.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 -- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3dc0678c0 msgr2=0x7fa3dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3dc0678c0 0x7fa3dc069d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4009670 tx=0x7fa3f4006bd0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 -- 172.21.15.67:0/3754097604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc15e660 msgr2=0x7fa3fc15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc15e660 0x7fa3fc15f500 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0af040 tx=0x7fa3ec019700 comp rx=0 tx=0).stop 2024-09-19T05:37:31.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 -- 172.21.15.67:0/3754097604 shutdown_connections 2024-09-19T05:37:31.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc15e660 0x7fa3fc15f500 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3fc0b3a60 0x7fa3fc14ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3dc0678c0 0x7fa3dc069d80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 --2- 172.21.15.67:0/3754097604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3fc0af120 0x7fa3fc160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 -- 172.21.15.67:0/3754097604 >> 172.21.15.67:0/3754097604 conn(0x7fa3fc0b2f40 msgr2=0x7fa3fc15cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:31.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 -- 172.21.15.67:0/3754097604 shutdown_connections 2024-09-19T05:37:31.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.393+0000 7fa4028bd640 1 -- 172.21.15.67:0/3754097604 wait complete. 2024-09-19T05:37:31.428 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f0791fe5640 1 Processor -- start 2024-09-19T05:37:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f0791fe5640 1 -- start start 2024-09-19T05:37:31.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f0791fe5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078c15e610 0x7f078c162a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f0791fe5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078c162fb0 con 0x7f078c15f100 2024-09-19T05:37:31.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f0791fe5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078c0cf510 con 0x7f078c0cf070 2024-09-19T05:37:31.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f0791fe5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f078c0d0120 con 0x7f078c15e610 2024-09-19T05:37:31.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f078c15f100 0x7f078c0d2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32790/0 (socket says 172.21.15.67:32790) 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078bfff640 1 -- 172.21.15.67:0/2508425665 learned_addr learned my addr 172.21.15.67:0/2508425665 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2691722753 0 0) 0x7f07840014a0 con 0x7f078c15f100 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0778003530 con 0x7f078c15f100 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078b7fe640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078c15e610 0x7f078c162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 81454054 0 0) 0x7f0778003530 con 0x7f078c15f100 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078c15e610 msgr2=0x7f078c162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078c15e610 0x7f078c162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 >> v1:172.21.15.97:6789/0 conn(0x7f078c0cf070 legacy=0x7f078c15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c0cf7f0 con 0x7f078c15f100 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078b7fe640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078c15e610 0x7f078c162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f0784001bd0 con 0x7f078c15f100 2024-09-19T05:37:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 >> v1:172.21.15.67:6789/0 conn(0x7f078c15f100 legacy=0x7f078c0d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07780039f0 0x7f0778003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078c15e610 0x7f0778004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0778004d50 0x7f07780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f078c0d0120 con 0x7f0778004d50 2024-09-19T05:37:31.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f077800bae0 con 0x7f07780039f0 2024-09-19T05:37:31.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f077800bce0 con 0x7f078c15e610 2024-09-19T05:37:31.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078bfff640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0778004d50 0x7f07780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078b7fe640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07780039f0 0x7f0778003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f0783fff640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078c15e610 0x7f0778004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078bfff640 1 -- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078c15e610 msgr2=0x7f0778004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:31.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078bfff640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078c15e610 0x7f0778004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078bfff640 1 -- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07780039f0 msgr2=0x7f0778003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:31.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078bfff640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07780039f0 0x7f0778003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.545+0000 7f078bfff640 1 -- 172.21.15.67:0/2508425665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0778003530 con 0x7f0778004d50 2024-09-19T05:37:31.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f078bfff640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0778004d50 0x7f07780051d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f078400aa20 tx=0x7f078401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211a4a6c85afae1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078400a670 con 0x7f0778004d50 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07840ad650 con 0x7f0778004d50 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f078affd640 1 -- 172.21.15.67:0/2508425665 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07840ada40 con 0x7f0778004d50 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 -- 172.21.15.67:0/2508425665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0778004d50 msgr2=0x7f07780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 --2- 172.21.15.67:0/2508425665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0778004d50 0x7f07780051d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f078400aa20 tx=0x7f078401d360 comp rx=0 tx=0).stop 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f078bfff640 1 -- 172.21.15.67:0/2508425665 reap_dead start 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 -- 172.21.15.67:0/2508425665 shutdown_connections 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 -- 172.21.15.67:0/2508425665 >> 172.21.15.67:0/2508425665 conn(0x7f078c08bfc0 msgr2=0x7f078c0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 -- 172.21.15.67:0/2508425665 shutdown_connections 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 -- 172.21.15.67:0/2508425665 wait complete. 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 Processor -- start 2024-09-19T05:37:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 -- start start 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0778004d50 0x7f078c0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078c155580 0x7f078c0c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0c9ed0 0x7f078c1f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f078c15f830 con 0x7f078c0c9ed0 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f078c0cfdb0 con 0x7f078c155580 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0791fe5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f078c162a70 con 0x7f0778004d50 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f078bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0c9ed0 0x7f078c1f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f078bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0c9ed0 0x7f078c1f8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41486/0 (socket says 172.21.15.67:41486) 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f078bfff640 1 -- 172.21.15.67:0/3206100622 learned_addr learned my addr 172.21.15.67:0/3206100622 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f078b7fe640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0778004d50 0x7f078c0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.549+0000 7f0783fff640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078c155580 0x7f078c0c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f078bfff640 1 -- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0778004d50 msgr2=0x7f078c0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f078bfff640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0778004d50 0x7f078c0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f078bfff640 1 -- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078c155580 msgr2=0x7f078c0c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f078bfff640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078c155580 0x7f078c0c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f078bfff640 1 -- 172.21.15.67:0/3206100622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c0c9380 con 0x7f078c0c9ed0 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f078bfff640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0c9ed0 0x7f078c1f8220 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f078400aa20 tx=0x7f0778005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f0788ff9640 1 -- 172.21.15.67:0/3206100622 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07840bc070 con 0x7f078c0c9ed0 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f0788ff9640 1 -- 172.21.15.67:0/3206100622 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07840011d0 con 0x7f078c0c9ed0 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f0791fe5640 1 -- 172.21.15.67:0/3206100622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078c0c9660 con 0x7f078c0c9ed0 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f0788ff9640 1 -- 172.21.15.67:0/3206100622 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07840b2040 con 0x7f078c0c9ed0 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f0791fe5640 1 -- 172.21.15.67:0/3206100622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f078c0b75b0 con 0x7f078c0c9ed0 2024-09-19T05:37:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f0791fe5640 1 -- 172.21.15.67:0/3206100622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078c15e9f0 con 0x7f078c0c9ed0 2024-09-19T05:37:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f0788ff9640 1 -- 172.21.15.67:0/3206100622 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07840bf070 con 0x7f078c0c9ed0 2024-09-19T05:37:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f0788ff9640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f076c0678f0 0x7f076c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f0788ff9640 1 -- 172.21.15.67:0/3206100622 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f078411fa90 con 0x7f078c0c9ed0 2024-09-19T05:37:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f078b7fe640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f076c0678f0 0x7f076c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.553+0000 7f078b7fe640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f076c0678f0 0x7f076c069db0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f078c1e9930 tx=0x7f077c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.557+0000 7f0788ff9640 1 -- 172.21.15.67:0/3206100622 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f078c162fb0 con 0x7f078c0c9ed0 2024-09-19T05:37:31.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.721+0000 7f0791fe5640 1 -- 172.21.15.67:0/3206100622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f078c0cec70 con 0x7f078c0c9ed0 2024-09-19T05:37:31.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0788ff9640 1 -- 172.21.15.67:0/3206100622 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16921 (secure 0 0 0) 0x7f0784001b90 con 0x7f078c0c9ed0 2024-09-19T05:37:31.728 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:31.728 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":67,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:37:30.723284+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:28.384593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:29.717693+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:31.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 -- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f076c0678f0 msgr2=0x7f076c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f076c0678f0 0x7f076c069db0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f078c1e9930 tx=0x7f077c008040 comp rx=0 tx=0).stop 2024-09-19T05:37:31.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 -- 172.21.15.67:0/3206100622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0c9ed0 msgr2=0x7f078c1f8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0c9ed0 0x7f078c1f8220 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f078400aa20 tx=0x7f0778005840 comp rx=0 tx=0).stop 2024-09-19T05:37:31.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 -- 172.21.15.67:0/3206100622 shutdown_connections 2024-09-19T05:37:31.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f078c0c9ed0 0x7f078c1f8220 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078c155580 0x7f078c0c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f076c0678f0 0x7f076c069db0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 --2- 172.21.15.67:0/3206100622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0778004d50 0x7f078c0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 -- 172.21.15.67:0/3206100622 >> 172.21.15.67:0/3206100622 conn(0x7f078c08bfc0 msgr2=0x7f078c1600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:31.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 -- 172.21.15.67:0/3206100622 shutdown_connections 2024-09-19T05:37:31.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.725+0000 7f0791fe5640 1 -- 172.21.15.67:0/3206100622 wait complete. 2024-09-19T05:37:31.749 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.865+0000 7f20fed30640 1 Processor -- start 2024-09-19T05:37:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.865+0000 7f20fed30640 1 -- start start 2024-09-19T05:37:31.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.865+0000 7f20fed30640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f20f8072590 0x7f20f8166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.865+0000 7f20fed30640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f80b3860 con 0x7f20f815b1e0 2024-09-19T05:37:31.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.865+0000 7f20fed30640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f80b3b40 con 0x7f20f80b4900 2024-09-19T05:37:31.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.865+0000 7f20fed30640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f20f815b5c0 con 0x7f20f8072590 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.865+0000 7f20fcacc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f20f815b1e0 0x7f20f80b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32804/0 (socket says 172.21.15.67:32804) 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.865+0000 7f20fcacc640 1 -- 172.21.15.67:0/1456677957 learned_addr learned my addr 172.21.15.67:0/1456677957 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.865+0000 7f20fd2cd640 1 --2- 172.21.15.67:0/1456677957 >> v2:172.21.15.97:3300/0 conn(0x7f20f8072590 0x7f20f8166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461031933 0 0) 0x7f20f80b3860 con 0x7f20f815b1e0 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20e4003530 con 0x7f20f815b1e0 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 935144636 0 0) 0x7f20e4003530 con 0x7f20f815b1e0 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 >> v2:172.21.15.97:3300/0 conn(0x7f20f8072590 msgr2=0x7f20f8166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 --2- 172.21.15.67:0/1456677957 >> v2:172.21.15.97:3300/0 conn(0x7f20f8072590 0x7f20f8166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 >> v1:172.21.15.97:6789/0 conn(0x7f20f80b4900 legacy=0x7f20f8071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f80b3e20 con 0x7f20f815b1e0 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f20e0001680 con 0x7f20f815b1e0 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 >> v1:172.21.15.67:6789/0 conn(0x7f20f815b1e0 legacy=0x7f20f80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e40039c0 0x7f20e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e4004810 0x7f20e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e40051d0 0x7f20e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f20f815b5c0 con 0x7f20e4004810 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f20e400c070 con 0x7f20e40051d0 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f20e400c270 con 0x7f20e40039c0 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f7fff640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e4004810 0x7f20e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20fd2cd640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e40051d0 0x7f20e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20fcacc640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e40039c0 0x7f20e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f7fff640 1 -- 172.21.15.67:0/1456677957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e40039c0 msgr2=0x7f20e4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f7fff640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e40039c0 0x7f20e4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f7fff640 1 -- 172.21.15.67:0/1456677957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e40051d0 msgr2=0x7f20e400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f7fff640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e40051d0 0x7f20e400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f7fff640 1 -- 172.21.15.67:0/1456677957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e4003530 con 0x7f20e4004810 2024-09-19T05:37:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20fd2cd640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e40051d0 0x7f20e400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20fd2cd640 1 -- 172.21.15.67:0/1456677957 reap_dead start 2024-09-19T05:37:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20fcacc640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e40039c0 0x7f20e4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f7fff640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e4004810 0x7f20e4004c90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f20e8001780 tx=0x7f20e801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fb7749eabd1794 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e80013a0 con 0x7f20e4004810 2024-09-19T05:37:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e80052f0 con 0x7f20e4004810 2024-09-19T05:37:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20f77fe640 1 -- 172.21.15.67:0/1456677957 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0001d50 con 0x7f20e4004810 2024-09-19T05:37:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20fed30640 1 -- 172.21.15.67:0/1456677957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e4004810 msgr2=0x7f20e4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.869+0000 7f20fed30640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e4004810 0x7f20e4004c90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f20e8001780 tx=0x7f20e801c400 comp rx=0 tx=0).stop 2024-09-19T05:37:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 -- 172.21.15.67:0/1456677957 shutdown_connections 2024-09-19T05:37:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 --2- 172.21.15.67:0/1456677957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e4004810 0x7f20e4004c90 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 -- 172.21.15.67:0/1456677957 >> 172.21.15.67:0/1456677957 conn(0x7f20f80d0080 msgr2=0x7f20f80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:31.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 -- 172.21.15.67:0/1456677957 shutdown_connections 2024-09-19T05:37:31.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 -- 172.21.15.67:0/1456677957 wait complete. 2024-09-19T05:37:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 Processor -- start 2024-09-19T05:37:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 -- start start 2024-09-19T05:37:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e4004810 0x7f20f80b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20f8156c00 0x7f20f809dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20f815b740 0x7f20f815bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8072a20 con 0x7f20f815b740 2024-09-19T05:37:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f20f80b43e0 con 0x7f20f8156c00 2024-09-19T05:37:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f20f8072ba0 con 0x7f20e4004810 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fd2cd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20f815b740 0x7f20f815bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fd2cd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20f815b740 0x7f20f815bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41494/0 (socket says 172.21.15.67:41494) 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fd2cd640 1 -- 172.21.15.67:0/3220701113 learned_addr learned my addr 172.21.15.67:0/3220701113 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fcacc640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e4004810 0x7f20f80b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20f7fff640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20f8156c00 0x7f20f809dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fd2cd640 1 -- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e4004810 msgr2=0x7f20f80b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fd2cd640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e4004810 0x7f20f80b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fd2cd640 1 -- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20f8156c00 msgr2=0x7f20f809dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fd2cd640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20f8156c00 0x7f20f809dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fd2cd640 1 -- 172.21.15.67:0/3220701113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f806fa10 con 0x7f20f815b740 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20f7fff640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20f8156c00 0x7f20f809dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fd2cd640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20f815b740 0x7f20f815bbc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f20f0007cf0 tx=0x7f20f0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20f57fa640 1 -- 172.21.15.67:0/3220701113 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f001a030 con 0x7f20f815b740 2024-09-19T05:37:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20f57fa640 1 -- 172.21.15.67:0/3220701113 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f0010e30 con 0x7f20f815b740 2024-09-19T05:37:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20f57fa640 1 -- 172.21.15.67:0/3220701113 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0003be0 con 0x7f20f815b740 2024-09-19T05:37:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 -- 172.21.15.67:0/3220701113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f8068f70 con 0x7f20f815b740 2024-09-19T05:37:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.873+0000 7f20fed30640 1 -- 172.21.15.67:0/3220701113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f814d3e0 con 0x7f20f815b740 2024-09-19T05:37:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.877+0000 7f20fed30640 1 -- 172.21.15.67:0/3220701113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f8071e80 con 0x7f20f815b740 2024-09-19T05:37:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.877+0000 7f20f57fa640 1 -- 172.21.15.67:0/3220701113 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20f001d070 con 0x7f20f815b740 2024-09-19T05:37:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.877+0000 7f20f57fa640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20d80678c0 0x7f20d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.877+0000 7f20f57fa640 1 -- 172.21.15.67:0/3220701113 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f20f00864d0 con 0x7f20f815b740 2024-09-19T05:37:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.877+0000 7f20fcacc640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20d80678c0 0x7f20d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.877+0000 7f20fcacc640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20d80678c0 0x7f20d8069d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f20e0001ec0 tx=0x7f20e0001d70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:31.881+0000 7f20f57fa640 1 -- 172.21.15.67:0/3220701113 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f20f001d360 con 0x7f20f815b740 2024-09-19T05:37:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.045+0000 7f20fed30640 1 -- 172.21.15.67:0/3220701113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20f80b4e30 con 0x7f20f815b740 2024-09-19T05:37:32.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20f57fa640 1 -- 172.21.15.67:0/3220701113 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16921 (secure 0 0 0) 0x7f20f0056e80 con 0x7f20f815b740 2024-09-19T05:37:32.052 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:32.052 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":67,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:37:30.723284+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:28.384593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:29.717693+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 -- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20d80678c0 msgr2=0x7f20d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20d80678c0 0x7f20d8069d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f20e0001ec0 tx=0x7f20e0001d70 comp rx=0 tx=0).stop 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 -- 172.21.15.67:0/3220701113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20f815b740 msgr2=0x7f20f815bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20f815b740 0x7f20f815bbc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f20f0007cf0 tx=0x7f20f0010590 comp rx=0 tx=0).stop 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 -- 172.21.15.67:0/3220701113 shutdown_connections 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20f815b740 0x7f20f815bbc0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20f8156c00 0x7f20f809dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20d80678c0 0x7f20d8069d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 --2- 172.21.15.67:0/3220701113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e4004810 0x7f20f80b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 -- 172.21.15.67:0/3220701113 >> 172.21.15.67:0/3220701113 conn(0x7f20f80d0080 msgr2=0x7f20f80addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:32.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 -- 172.21.15.67:0/3220701113 shutdown_connections 2024-09-19T05:37:32.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.049+0000 7f20fed30640 1 -- 172.21.15.67:0/3220701113 wait complete. 2024-09-19T05:37:32.072 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:37:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e78c5b640 1 Processor -- start 2024-09-19T05:37:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e78c5b640 1 -- start start 2024-09-19T05:37:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e78c5b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e740cf9c0 0x7f4e7415f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e78c5b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4e7406dfc0 0x7f4e74071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e78c5b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7415f910 con 0x7f4e740724a0 2024-09-19T05:37:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e78c5b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4e740728a0 con 0x7f4e740cf9c0 2024-09-19T05:37:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e78c5b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7406e540 con 0x7f4e7406dfc0 2024-09-19T05:37:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e7259c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e740cf9c0 0x7f4e7415f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e7259c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e740cf9c0 0x7f4e7415f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41506/0 (socket says 172.21.15.67:41506) 2024-09-19T05:37:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e7259c640 1 -- 172.21.15.67:0/4141523859 learned_addr learned my addr 172.21.15.67:0/4141523859 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e71d9b640 1 --2- 172.21.15.67:0/4141523859 >> v2:172.21.15.97:3300/0 conn(0x7f4e7406dfc0 0x7f4e74071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e7259c640 1 -- 172.21.15.67:0/4141523859 >> v2:172.21.15.97:3300/0 conn(0x7f4e7406dfc0 msgr2=0x7f4e74071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e7259c640 1 --2- 172.21.15.67:0/4141523859 >> v2:172.21.15.97:3300/0 conn(0x7f4e7406dfc0 0x7f4e74071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e7259c640 1 -- 172.21.15.67:0/4141523859 >> v1:172.21.15.97:6789/0 conn(0x7f4e740724a0 legacy=0x7f4e74161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.193+0000 7f4e7259c640 1 -- 172.21.15.67:0/4141523859 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7406e820 con 0x7f4e740cf9c0 2024-09-19T05:37:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e7259c640 1 --2- 172.21.15.67:0/4141523859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 0x7f4e7415f3d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4e740b2e60 tx=0x7f4e5c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a055143be21b330 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e7159a640 1 -- 172.21.15.67:0/4141523859 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0aa650 con 0x7f4e740cf9c0 2024-09-19T05:37:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e7159a640 1 -- 172.21.15.67:0/4141523859 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c0af070 con 0x7f4e740cf9c0 2024-09-19T05:37:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e7159a640 1 -- 172.21.15.67:0/4141523859 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0aaa10 con 0x7f4e740cf9c0 2024-09-19T05:37:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e78c5b640 1 -- 172.21.15.67:0/4141523859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 msgr2=0x7f4e7415f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e78c5b640 1 --2- 172.21.15.67:0/4141523859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 0x7f4e7415f3d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4e740b2e60 tx=0x7f4e5c01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:37:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e78c5b640 1 -- 172.21.15.67:0/4141523859 shutdown_connections 2024-09-19T05:37:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e78c5b640 1 --2- 172.21.15.67:0/4141523859 >> v2:172.21.15.97:3300/0 conn(0x7f4e7406dfc0 0x7f4e74071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e78c5b640 1 --2- 172.21.15.67:0/4141523859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 0x7f4e7415f3d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e78c5b640 1 -- 172.21.15.67:0/4141523859 >> 172.21.15.67:0/4141523859 conn(0x7f4e740b1e50 msgr2=0x7f4e740b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e78c5b640 1 -- 172.21.15.67:0/4141523859 shutdown_connections 2024-09-19T05:37:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.197+0000 7f4e78c5b640 1 -- 172.21.15.67:0/4141523859 wait complete. 2024-09-19T05:37:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 Processor -- start 2024-09-19T05:37:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 -- start start 2024-09-19T05:37:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e7406dfc0 0x7f4e7414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e740724a0 0x7f4e7414b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 0x7f4e740afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4e740cff20 con 0x7f4e740cf9c0 2024-09-19T05:37:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4e740cfda0 con 0x7f4e7406dfc0 2024-09-19T05:37:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7416b2e0 con 0x7f4e740724a0 2024-09-19T05:37:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e72d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 0x7f4e740afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e72d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 0x7f4e740afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41518/0 (socket says 172.21.15.67:41518) 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e72d9d640 1 -- 172.21.15.67:0/1221650002 learned_addr learned my addr 172.21.15.67:0/1221650002 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e7259c640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e7406dfc0 0x7f4e7414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e71d9b640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e740724a0 0x7f4e7414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e72d9d640 1 -- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e740724a0 msgr2=0x7f4e7414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e72d9d640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e740724a0 0x7f4e7414b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e72d9d640 1 -- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e7406dfc0 msgr2=0x7f4e7414c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e72d9d640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e7406dfc0 0x7f4e7414c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e72d9d640 1 -- 172.21.15.67:0/1221650002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7414faa0 con 0x7f4e740cf9c0 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e72d9d640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 0x7f4e740afdc0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00c760 tx=0x7f4e6c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e6affd640 1 -- 172.21.15.67:0/1221650002 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c003b80 con 0x7f4e740cf9c0 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e6affd640 1 -- 172.21.15.67:0/1221650002 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6c003d20 con 0x7f4e740cf9c0 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 -- 172.21.15.67:0/1221650002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7414fd80 con 0x7f4e740cf9c0 2024-09-19T05:37:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e6affd640 1 -- 172.21.15.67:0/1221650002 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c00aa30 con 0x7f4e740cf9c0 2024-09-19T05:37:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 -- 172.21.15.67:0/1221650002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e740ad5b0 con 0x7f4e740cf9c0 2024-09-19T05:37:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e78c5b640 1 -- 172.21.15.67:0/1221650002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e74071f60 con 0x7f4e740cf9c0 2024-09-19T05:37:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e6affd640 1 -- 172.21.15.67:0/1221650002 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4e6c00abd0 con 0x7f4e740cf9c0 2024-09-19T05:37:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.201+0000 7f4e6affd640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4e540678c0 0x7f4e54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.205+0000 7f4e6affd640 1 -- 172.21.15.67:0/1221650002 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f4e6c086640 con 0x7f4e740cf9c0 2024-09-19T05:37:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.205+0000 7f4e7259c640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4e540678c0 0x7f4e54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.205+0000 7f4e7259c640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4e540678c0 0x7f4e54069d80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0ae000 tx=0x7f4e5c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.205+0000 7f4e6affd640 1 -- 172.21.15.67:0/1221650002 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4e7415f910 con 0x7f4e740cf9c0 2024-09-19T05:37:32.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:32.409+0000 7f4e78c5b640 1 -- 172.21.15.67:0/1221650002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4e740b49b0 con 0x7f4e740cf9c0 2024-09-19T05:37:33.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-19T05:37:33.327 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:37:33.325+0000 7f2a7f914640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:37:33.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.397+0000 7f4e6affd640 1 -- 172.21.15.67:0/1221650002 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) ==== 118+0+0 (secure 0 0 0) 0x7f4e6c057160 con 0x7f4e740cf9c0 2024-09-19T05:37:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 -- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4e540678c0 msgr2=0x7f4e54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4e540678c0 0x7f4e54069d80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0ae000 tx=0x7f4e5c0a7000 comp rx=0 tx=0).stop 2024-09-19T05:37:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 -- 172.21.15.67:0/1221650002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 msgr2=0x7f4e740afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 0x7f4e740afdc0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00c760 tx=0x7f4e6c00cc20 comp rx=0 tx=0).stop 2024-09-19T05:37:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 -- 172.21.15.67:0/1221650002 shutdown_connections 2024-09-19T05:37:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e740cf9c0 0x7f4e740afdc0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4e540678c0 0x7f4e54069d80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e740724a0 0x7f4e7414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 --2- 172.21.15.67:0/1221650002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e7406dfc0 0x7f4e7414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:33.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 -- 172.21.15.67:0/1221650002 >> 172.21.15.67:0/1221650002 conn(0x7f4e740b1e50 msgr2=0x7f4e7415fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:33.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 -- 172.21.15.67:0/1221650002 shutdown_connections 2024-09-19T05:37:33.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.401+0000 7f4e78c5b640 1 -- 172.21.15.67:0/1221650002 wait complete. 2024-09-19T05:37:33.430 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:37:33.431 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:37:33.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f562a164640 1 Processor -- start 2024-09-19T05:37:33.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f562a164640 1 -- start start 2024-09-19T05:37:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f562a164640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5624159c60 0x7f56240ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f562a164640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56240af3a0 0x7f562415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f562a164640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f562415a040 con 0x7f562406ffd0 2024-09-19T05:37:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f562a164640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f562415d460 con 0x7f5624159c60 2024-09-19T05:37:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f562a164640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f562415c850 con 0x7f56240af3a0 2024-09-19T05:37:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f56237fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5624159c60 0x7f56240ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f5622ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f562406ffd0 0x7f56240aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32806/0 (socket says 172.21.15.67:32806) 2024-09-19T05:37:33.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f5622ffd640 1 -- 172.21.15.67:0/1731094202 learned_addr learned my addr 172.21.15.67:0/1731094202 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:33.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f5623fff640 1 --2- 172.21.15.67:0/1731094202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56240af3a0 0x7f562415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:33.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f56237fe640 1 -- 172.21.15.67:0/1731094202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56240af3a0 msgr2=0x7f562415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:33.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f56237fe640 1 --2- 172.21.15.67:0/1731094202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56240af3a0 0x7f562415fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:33.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f56237fe640 1 -- 172.21.15.67:0/1731094202 >> v1:172.21.15.67:6789/0 conn(0x7f562406ffd0 legacy=0x7f56240aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:33.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f56227fc640 1 -- 172.21.15.67:0/1731094202 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479894586 0 0) 0x7f562415a040 con 0x7f562406ffd0 2024-09-19T05:37:33.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f56237fe640 1 -- 172.21.15.67:0/1731094202 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562415cb30 con 0x7f5624159c60 2024-09-19T05:37:33.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.557+0000 7f5623fff640 1 --2- 172.21.15.67:0/1731094202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56240af3a0 0x7f562415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:33.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f56237fe640 1 --2- 172.21.15.67:0/1731094202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5624159c60 0x7f56240ad130 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f561c009d90 tx=0x7f561c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aca83a8dfe9e6fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:33.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f56227fc640 1 -- 172.21.15.67:0/1731094202 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0b2070 con 0x7f5624159c60 2024-09-19T05:37:33.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f56227fc640 1 -- 172.21.15.67:0/1731094202 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c0a5970 con 0x7f5624159c60 2024-09-19T05:37:33.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f56227fc640 1 -- 172.21.15.67:0/1731094202 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0a5d40 con 0x7f5624159c60 2024-09-19T05:37:33.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 -- 172.21.15.67:0/1731094202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5624159c60 msgr2=0x7f56240ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:33.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 --2- 172.21.15.67:0/1731094202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5624159c60 0x7f56240ad130 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f561c009d90 tx=0x7f561c01c8b0 comp rx=0 tx=0).stop 2024-09-19T05:37:33.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 -- 172.21.15.67:0/1731094202 shutdown_connections 2024-09-19T05:37:33.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 --2- 172.21.15.67:0/1731094202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56240af3a0 0x7f562415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:33.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 --2- 172.21.15.67:0/1731094202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5624159c60 0x7f56240ad130 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:33.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 -- 172.21.15.67:0/1731094202 >> 172.21.15.67:0/1731094202 conn(0x7f56240b1e50 msgr2=0x7f56240b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:33.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 -- 172.21.15.67:0/1731094202 shutdown_connections 2024-09-19T05:37:33.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 -- 172.21.15.67:0/1731094202 wait complete. 2024-09-19T05:37:33.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 Processor -- start 2024-09-19T05:37:33.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 -- start start 2024-09-19T05:37:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562406ffd0 0x7f5624150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56240af3a0 0x7f5624158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5624159c60 0x7f562414cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5624168fb0 con 0x7f562406ffd0 2024-09-19T05:37:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5624168e30 con 0x7f56240af3a0 2024-09-19T05:37:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.561+0000 7f562a164640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5624169130 con 0x7f5624159c60 2024-09-19T05:37:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f56237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562406ffd0 0x7f5624150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f56237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562406ffd0 0x7f5624150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41534/0 (socket says 172.21.15.67:41534) 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f56237fe640 1 -- 172.21.15.67:0/4167203600 learned_addr learned my addr 172.21.15.67:0/4167203600 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f56237fe640 1 -- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5624159c60 msgr2=0x7f562414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f56237fe640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5624159c60 0x7f562414cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f56237fe640 1 -- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56240af3a0 msgr2=0x7f5624158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f56237fe640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56240af3a0 0x7f5624158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f56237fe640 1 -- 172.21.15.67:0/4167203600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5624151240 con 0x7f562406ffd0 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f56237fe640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562406ffd0 0x7f5624150a10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f561c0b0040 tx=0x7f561c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f560bfff640 1 -- 172.21.15.67:0/4167203600 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0bd020 con 0x7f562406ffd0 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f560bfff640 1 -- 172.21.15.67:0/4167203600 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c0ad6c0 con 0x7f562406ffd0 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f562a164640 1 -- 172.21.15.67:0/4167203600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5624154da0 con 0x7f562406ffd0 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f560bfff640 1 -- 172.21.15.67:0/4167203600 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0b2040 con 0x7f562406ffd0 2024-09-19T05:37:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f562a164640 1 -- 172.21.15.67:0/4167203600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5624150f50 con 0x7f562406ffd0 2024-09-19T05:37:33.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f562a164640 1 -- 172.21.15.67:0/4167203600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562415fdc0 con 0x7f562406ffd0 2024-09-19T05:37:33.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f560bfff640 1 -- 172.21.15.67:0/4167203600 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f561c0c0020 con 0x7f562406ffd0 2024-09-19T05:37:33.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f560bfff640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56100678c0 0x7f5610069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:33.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f560bfff640 1 -- 172.21.15.67:0/4167203600 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f561c121040 con 0x7f562406ffd0 2024-09-19T05:37:33.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f5622ffd640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56100678c0 0x7f5610069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:33.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.565+0000 7f5622ffd640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56100678c0 0x7f5610069d80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f56180011f0 tx=0x7f5618007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:33.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.569+0000 7f560bfff640 1 -- 172.21.15.67:0/4167203600 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f561c0c7030 con 0x7f562406ffd0 2024-09-19T05:37:33.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:33.761+0000 7f562a164640 1 -- 172.21.15.67:0/4167203600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f56240b2c30 con 0x7f562406ffd0 2024-09-19T05:37:34.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f560bfff640 1 -- 172.21.15.67:0/4167203600 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f561c016560 con 0x7f562406ffd0 2024-09-19T05:37:34.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 -- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56100678c0 msgr2=0x7f5610069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56100678c0 0x7f5610069d80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f56180011f0 tx=0x7f5618007930 comp rx=0 tx=0).stop 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 -- 172.21.15.67:0/4167203600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562406ffd0 msgr2=0x7f5624150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562406ffd0 0x7f5624150a10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f561c0b0040 tx=0x7f561c019650 comp rx=0 tx=0).stop 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 -- 172.21.15.67:0/4167203600 shutdown_connections 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56100678c0 0x7f5610069d80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5624159c60 0x7f562414cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56240af3a0 0x7f5624158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 --2- 172.21.15.67:0/4167203600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f562406ffd0 0x7f5624150a10 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 -- 172.21.15.67:0/4167203600 >> 172.21.15.67:0/4167203600 conn(0x7f56240b1e50 msgr2=0x7f562406f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 -- 172.21.15.67:0/4167203600 shutdown_connections 2024-09-19T05:37:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.409+0000 7f562a164640 1 -- 172.21.15.67:0/4167203600 wait complete. 2024-09-19T05:37:34.438 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:37:34.438 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:34.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.561+0000 7fcc39fb4640 1 Processor -- start 2024-09-19T05:37:34.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.561+0000 7fcc39fb4640 1 -- start start 2024-09-19T05:37:34.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc39fb4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc3415b1e0 0x7fcc340b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc39fb4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc34072590 0x7fcc340ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc39fb4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc340b3860 con 0x7fcc340b4900 2024-09-19T05:37:34.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc39fb4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fcc3415b5c0 con 0x7fcc3415b1e0 2024-09-19T05:37:34.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc39fb4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcc340b3b40 con 0x7fcc34072590 2024-09-19T05:37:34.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc337fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc3415b1e0 0x7fcc340b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc33fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc34072590 0x7fcc340ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc32ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcc340b4900 0x7fcc34071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:60338/0 (socket says 172.21.15.67:60338) 2024-09-19T05:37:34.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc32ffd640 1 -- 172.21.15.67:0/2117245164 learned_addr learned my addr 172.21.15.67:0/2117245164 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:34.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc33fff640 1 -- 172.21.15.67:0/2117245164 >> v2:172.21.15.97:3300/0 conn(0x7fcc3415b1e0 msgr2=0x7fcc340b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:34.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc33fff640 1 --2- 172.21.15.67:0/2117245164 >> v2:172.21.15.97:3300/0 conn(0x7fcc3415b1e0 0x7fcc340b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc33fff640 1 -- 172.21.15.67:0/2117245164 >> v1:172.21.15.97:6789/0 conn(0x7fcc340b4900 legacy=0x7fcc34071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc33fff640 1 -- 172.21.15.67:0/2117245164 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc340b3e20 con 0x7fcc34072590 2024-09-19T05:37:34.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.565+0000 7fcc337fe640 1 --2- 172.21.15.67:0/2117245164 >> v2:172.21.15.97:3300/0 conn(0x7fcc3415b1e0 0x7fcc340b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:34.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc33fff640 1 --2- 172.21.15.67:0/2117245164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc34072590 0x7fcc340ade10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009d90 tx=0x7fcc2c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6a000a82a9932ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:34.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc327fc640 1 -- 172.21.15.67:0/2117245164 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0b2070 con 0x7fcc34072590 2024-09-19T05:37:34.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc327fc640 1 -- 172.21.15.67:0/2117245164 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2c0a5a20 con 0x7fcc34072590 2024-09-19T05:37:34.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc327fc640 1 -- 172.21.15.67:0/2117245164 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0a5df0 con 0x7fcc34072590 2024-09-19T05:37:34.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2117245164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc34072590 msgr2=0x7fcc340ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 --2- 172.21.15.67:0/2117245164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc34072590 0x7fcc340ade10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009d90 tx=0x7fcc2c01c940 comp rx=0 tx=0).stop 2024-09-19T05:37:34.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2117245164 shutdown_connections 2024-09-19T05:37:34.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 --2- 172.21.15.67:0/2117245164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc34072590 0x7fcc340ade10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 --2- 172.21.15.67:0/2117245164 >> v2:172.21.15.97:3300/0 conn(0x7fcc3415b1e0 0x7fcc340b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2117245164 >> 172.21.15.67:0/2117245164 conn(0x7fcc340d0080 msgr2=0x7fcc340d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:34.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2117245164 shutdown_connections 2024-09-19T05:37:34.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2117245164 wait complete. 2024-09-19T05:37:34.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 Processor -- start 2024-09-19T05:37:34.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 -- start start 2024-09-19T05:37:34.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc34072590 0x7fcc340af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc340b4900 0x7fcc341656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc3415b1e0 0x7fcc34149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3406e7f0 con 0x7fcc340b4900 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3406e670 con 0x7fcc34072590 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc39fb4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3406e970 con 0x7fcc3415b1e0 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc340b4900 0x7fcc341656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc340b4900 0x7fcc341656c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41548/0 (socket says 172.21.15.67:41548) 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc32ffd640 1 -- 172.21.15.67:0/2192277391 learned_addr learned my addr 172.21.15.67:0/2192277391 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc337fe640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc34072590 0x7fcc340af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc33fff640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc3415b1e0 0x7fcc34149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc32ffd640 1 -- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc3415b1e0 msgr2=0x7fcc34149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc32ffd640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc3415b1e0 0x7fcc34149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc32ffd640 1 -- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc34072590 msgr2=0x7fcc340af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc32ffd640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc34072590 0x7fcc340af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.569+0000 7fcc32ffd640 1 -- 172.21.15.67:0/2192277391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc341faff0 con 0x7fcc340b4900 2024-09-19T05:37:34.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc32ffd640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc340b4900 0x7fcc341656c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800c450 tx=0x7fcc2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:34.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc1bfff640 1 -- 172.21.15.67:0/2192277391 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28017070 con 0x7fcc340b4900 2024-09-19T05:37:34.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc1bfff640 1 -- 172.21.15.67:0/2192277391 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc28005cf0 con 0x7fcc340b4900 2024-09-19T05:37:34.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2192277391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc341fb2b0 con 0x7fcc340b4900 2024-09-19T05:37:34.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc1bfff640 1 -- 172.21.15.67:0/2192277391 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28007290 con 0x7fcc340b4900 2024-09-19T05:37:34.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2192277391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc341fb870 con 0x7fcc340b4900 2024-09-19T05:37:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2192277391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc340ade10 con 0x7fcc340b4900 2024-09-19T05:37:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc1bfff640 1 -- 172.21.15.67:0/2192277391 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc2801a070 con 0x7fcc340b4900 2024-09-19T05:37:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc1bfff640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc200678c0 0x7fcc20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc1bfff640 1 -- 172.21.15.67:0/2192277391 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fcc28085430 con 0x7fcc340b4900 2024-09-19T05:37:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc337fe640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc200678c0 0x7fcc20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.573+0000 7fcc337fe640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc200678c0 0x7fcc20069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009a50 tx=0x7fcc24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:34.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.577+0000 7fcc1bfff640 1 -- 172.21.15.67:0/2192277391 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fcc28021020 con 0x7fcc340b4900 2024-09-19T05:37:34.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.773+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2192277391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc3414ad80 con 0x7fcc340b4900 2024-09-19T05:37:34.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.773+0000 7fcc1bfff640 1 -- 172.21.15.67:0/2192277391 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5218 (secure 0 0 0) 0x7fcc28055f50 con 0x7fcc340b4900 2024-09-19T05:37:34.779 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:34.779 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":36,"btime":"2024-09-19T05:37:34:410317+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/547145733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":547145733},{"type":"v1","addr":"172.21.15.97:6835","nonce":547145733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4281263473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4281263473},{"type":"v1","addr":"172.21.15.97:6837","nonce":4281263473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/403505114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":403505114},{"type":"v1","addr":"172.21.15.67:6834","nonce":403505114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:33.766722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6261":{"gid":6261,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3283833069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3283833069},{"type":"v1","addr":"172.21.15.67:6835","nonce":3283833069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6261,"qdb_cluster":[6261]},"id":4}]} 2024-09-19T05:37:34.779 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 36 2024-09-19T05:37:34.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc200678c0 msgr2=0x7fcc20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc200678c0 0x7fcc20069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009a50 tx=0x7fcc24008040 comp rx=0 tx=0).stop 2024-09-19T05:37:34.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2192277391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc340b4900 msgr2=0x7fcc341656c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc340b4900 0x7fcc341656c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800c450 tx=0x7fcc2800c910 comp rx=0 tx=0).stop 2024-09-19T05:37:34.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2192277391 shutdown_connections 2024-09-19T05:37:34.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc200678c0 0x7fcc20069d80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc3415b1e0 0x7fcc34149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc340b4900 0x7fcc341656c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 --2- 172.21.15.67:0/2192277391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc34072590 0x7fcc340af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2192277391 >> 172.21.15.67:0/2192277391 conn(0x7fcc340d0080 msgr2=0x7fcc340b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:34.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2192277391 shutdown_connections 2024-09-19T05:37:34.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.777+0000 7fcc39fb4640 1 -- 172.21.15.67:0/2192277391 wait complete. 2024-09-19T05:37:34.798 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:34.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.909+0000 7f9650c90640 1 Processor -- start 2024-09-19T05:37:34.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.909+0000 7f9650c90640 1 -- start start 2024-09-19T05:37:34.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f964c06f460 0x7f964c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f964c06e3c0 con 0x7f964c15c030 2024-09-19T05:37:34.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f964c06e6a0 con 0x7f964c06dde0 2024-09-19T05:37:34.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f964c06e980 con 0x7f964c06f460 2024-09-19T05:37:34.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f964c06f460 0x7f964c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964a59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f964c15c030 0x7f964c15d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32814/0 (socket says 172.21.15.67:32814) 2024-09-19T05:37:34.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f964c06f460 0x7f964c06f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41562/0 (socket says 172.21.15.67:41562) 2024-09-19T05:37:34.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964a59c640 1 -- 172.21.15.67:0/1702825411 learned_addr learned my addr 172.21.15.67:0/1702825411 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:34.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964ad9d640 1 -- 172.21.15.67:0/1702825411 >> v1:172.21.15.97:6789/0 conn(0x7f964c06dde0 legacy=0x7f964c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:34.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964ad9d640 1 -- 172.21.15.67:0/1702825411 >> v1:172.21.15.67:6789/0 conn(0x7f964c15c030 legacy=0x7f964c15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964ad9d640 1 -- 172.21.15.67:0/1702825411 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c06ec60 con 0x7f964c06f460 2024-09-19T05:37:34.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964ad9d640 1 --2- 172.21.15.67:0/1702825411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c06f460 0x7f964c06f870 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f963c0097c0 tx=0x7f963c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5b3c240e29a158 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:34.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964959a640 1 -- 172.21.15.67:0/1702825411 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c0b0070 con 0x7f964c06f460 2024-09-19T05:37:34.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964959a640 1 -- 172.21.15.67:0/1702825411 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963c0ab600 con 0x7f964c06f460 2024-09-19T05:37:34.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f964959a640 1 -- 172.21.15.67:0/1702825411 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c0ab9d0 con 0x7f964c06f460 2024-09-19T05:37:34.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 -- 172.21.15.67:0/1702825411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c06f460 msgr2=0x7f964c06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 --2- 172.21.15.67:0/1702825411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c06f460 0x7f964c06f870 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f963c0097c0 tx=0x7f963c01c460 comp rx=0 tx=0).stop 2024-09-19T05:37:34.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 -- 172.21.15.67:0/1702825411 shutdown_connections 2024-09-19T05:37:34.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 --2- 172.21.15.67:0/1702825411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c06f460 0x7f964c06f870 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 -- 172.21.15.67:0/1702825411 >> 172.21.15.67:0/1702825411 conn(0x7f964c0d0080 msgr2=0x7f964c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:34.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 -- 172.21.15.67:0/1702825411 shutdown_connections 2024-09-19T05:37:34.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.913+0000 7f9650c90640 1 -- 172.21.15.67:0/1702825411 wait complete. 2024-09-19T05:37:34.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 Processor -- start 2024-09-19T05:37:34.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 -- start start 2024-09-19T05:37:34.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f964c06dde0 0x7f964c14d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f964c06f460 0x7f964c146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c15c030 0x7f964c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f964c16a270 con 0x7f964c15c030 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f964c16a0f0 con 0x7f964c06dde0 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f964c16a3f0 con 0x7f964c06f460 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c15c030 0x7f964c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c15c030 0x7f964c1531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41576/0 (socket says 172.21.15.67:41576) 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964ad9d640 1 -- 172.21.15.67:0/2214716256 learned_addr learned my addr 172.21.15.67:0/2214716256 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9649d9b640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f964c06f460 0x7f964c146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964a59c640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f964c06dde0 0x7f964c14d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964ad9d640 1 -- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f964c06f460 msgr2=0x7f964c146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964ad9d640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f964c06f460 0x7f964c146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964ad9d640 1 -- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f964c06dde0 msgr2=0x7f964c14d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964ad9d640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f964c06dde0 0x7f964c14d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964ad9d640 1 -- 172.21.15.67:0/2214716256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c146bb0 con 0x7f964c15c030 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964a59c640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f964c06dde0 0x7f964c14d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f964ad9d640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c15c030 0x7f964c1531d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f963c0ae040 tx=0x7f963c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f963affd640 1 -- 172.21.15.67:0/2214716256 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c0b8020 con 0x7f964c15c030 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f963affd640 1 -- 172.21.15.67:0/2214716256 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963c0b4410 con 0x7f964c15c030 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 -- 172.21.15.67:0/2214716256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964c14ca90 con 0x7f964c15c030 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f963affd640 1 -- 172.21.15.67:0/2214716256 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c0b0040 con 0x7f964c15c030 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 -- 172.21.15.67:0/2214716256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964c14d050 con 0x7f964c15c030 2024-09-19T05:37:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.917+0000 7f9650c90640 1 -- 172.21.15.67:0/2214716256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964c06f870 con 0x7f964c15c030 2024-09-19T05:37:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.921+0000 7f963affd640 1 -- 172.21.15.67:0/2214716256 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f963c0bb020 con 0x7f964c15c030 2024-09-19T05:37:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.921+0000 7f963affd640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f962c0678f0 0x7f962c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.921+0000 7f963affd640 1 -- 172.21.15.67:0/2214716256 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f963c11ff60 con 0x7f964c15c030 2024-09-19T05:37:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.921+0000 7f964a59c640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f962c0678f0 0x7f962c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.921+0000 7f964a59c640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f962c0678f0 0x7f962c069db0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9644007fd0 tx=0x7f9644009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:34.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:34.925+0000 7f963affd640 1 -- 172.21.15.67:0/2214716256 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f963c0c2030 con 0x7f964c15c030 2024-09-19T05:37:35.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.085+0000 7f9650c90640 1 -- 172.21.15.67:0/2214716256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f964c0d0f20 con 0x7f964c15c030 2024-09-19T05:37:35.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.089+0000 7f963affd640 1 -- 172.21.15.67:0/2214716256 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16908 (secure 0 0 0) 0x7f963c016050 con 0x7f964c15c030 2024-09-19T05:37:35.094 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:35.094 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":68,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:37:32.383963+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:28.384593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:29.717693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:35.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 -- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f962c0678f0 msgr2=0x7f962c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f962c0678f0 0x7f962c069db0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9644007fd0 tx=0x7f9644009040 comp rx=0 tx=0).stop 2024-09-19T05:37:35.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 -- 172.21.15.67:0/2214716256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c15c030 msgr2=0x7f964c1531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c15c030 0x7f964c1531d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f963c0ae040 tx=0x7f963c019200 comp rx=0 tx=0).stop 2024-09-19T05:37:35.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 -- 172.21.15.67:0/2214716256 shutdown_connections 2024-09-19T05:37:35.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f964c15c030 0x7f964c1531d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f962c0678f0 0x7f962c069db0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f964c06f460 0x7f964c146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 --2- 172.21.15.67:0/2214716256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f964c06dde0 0x7f964c14d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 -- 172.21.15.67:0/2214716256 >> 172.21.15.67:0/2214716256 conn(0x7f964c0d0080 msgr2=0x7f964c0b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:35.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 -- 172.21.15.67:0/2214716256 shutdown_connections 2024-09-19T05:37:35.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.093+0000 7f9650c90640 1 -- 172.21.15.67:0/2214716256 wait complete. 2024-09-19T05:37:35.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:37:35.113 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:37:35.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c7ccc9640 1 Processor -- start 2024-09-19T05:37:35.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c7ccc9640 1 -- start start 2024-09-19T05:37:35.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c7ccc9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c78161da0 0x7f6c780d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c7ccc9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6c780d0160 0x7f6c780d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c7ccc9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c780d4d40 con 0x7f6c780d0e80 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c7ccc9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6c780d0610 con 0x7f6c780d0160 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c7ccc9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6c780d0840 con 0x7f6c78161da0 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c76d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6c780d0160 0x7f6c780d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c75d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6c780d0e80 0x7f6c780b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32830/0 (socket says 172.21.15.67:32830) 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c75d9b640 1 -- 172.21.15.67:0/4170204238 learned_addr learned my addr 172.21.15.67:0/4170204238 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c7659c640 1 --2- 172.21.15.67:0/4170204238 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c78161da0 0x7f6c780d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c76d9d640 1 -- 172.21.15.67:0/4170204238 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c78161da0 msgr2=0x7f6c780d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c76d9d640 1 --2- 172.21.15.67:0/4170204238 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c78161da0 0x7f6c780d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c76d9d640 1 -- 172.21.15.67:0/4170204238 >> v1:172.21.15.67:6789/0 conn(0x7f6c780d0e80 legacy=0x7f6c780b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c76d9d640 1 -- 172.21.15.67:0/4170204238 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c780d5020 con 0x7f6c780d0160 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c7559a640 1 -- 172.21.15.67:0/4170204238 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1804956969 0 0) 0x7f6c780d4d40 con 0x7f6c780d0e80 2024-09-19T05:37:35.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.221+0000 7f6c7659c640 1 --2- 172.21.15.67:0/4170204238 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c78161da0 0x7f6c780d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:35.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.225+0000 7f6c76d9d640 1 --2- 172.21.15.67:0/4170204238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0160 0x7f6c780d12c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6c600097c0 tx=0x7f6c6001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c23802cad18b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:35.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.225+0000 7f6c7559a640 1 -- 172.21.15.67:0/4170204238 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c600b0070 con 0x7f6c780d0160 2024-09-19T05:37:35.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.225+0000 7f6c7559a640 1 -- 172.21.15.67:0/4170204238 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c600ab600 con 0x7f6c780d0160 2024-09-19T05:37:35.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.225+0000 7f6c7559a640 1 -- 172.21.15.67:0/4170204238 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c600ab9d0 con 0x7f6c780d0160 2024-09-19T05:37:35.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/4170204238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0160 msgr2=0x7f6c780d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 --2- 172.21.15.67:0/4170204238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0160 0x7f6c780d12c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6c600097c0 tx=0x7f6c6001c4a0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/4170204238 shutdown_connections 2024-09-19T05:37:35.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 --2- 172.21.15.67:0/4170204238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0160 0x7f6c780d12c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 --2- 172.21.15.67:0/4170204238 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c78161da0 0x7f6c780d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/4170204238 >> 172.21.15.67:0/4170204238 conn(0x7f6c7808bfc0 msgr2=0x7f6c780d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:35.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/4170204238 shutdown_connections 2024-09-19T05:37:35.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/4170204238 wait complete. 2024-09-19T05:37:35.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 Processor -- start 2024-09-19T05:37:35.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- start start 2024-09-19T05:37:35.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c780d0160 0x7f6c780b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0e80 0x7f6c78154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c78161da0 0x7f6c7815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6c780b50e0 con 0x7f6c780d0e80 2024-09-19T05:37:35.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78162180 con 0x7f6c78161da0 2024-09-19T05:37:35.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6c780b5260 con 0x7f6c780d0160 2024-09-19T05:37:35.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c75d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0e80 0x7f6c78154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c75d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0e80 0x7f6c78154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41598/0 (socket says 172.21.15.67:41598) 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c75d9b640 1 -- 172.21.15.67:0/1205649905 learned_addr learned my addr 172.21.15.67:0/1205649905 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7659c640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c780d0160 0x7f6c780b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c76d9d640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c78161da0 0x7f6c7815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c75d9b640 1 -- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c780d0160 msgr2=0x7f6c780b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c75d9b640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c780d0160 0x7f6c780b7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c75d9b640 1 -- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c78161da0 msgr2=0x7f6c7815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c75d9b640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c78161da0 0x7f6c7815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c75d9b640 1 -- 172.21.15.67:0/1205649905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7815f950 con 0x7f6c780d0e80 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c75d9b640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0e80 0x7f6c78154b40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c4e0 tx=0x7f6c7000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c6effd640 1 -- 172.21.15.67:0/1205649905 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70018070 con 0x7f6c780d0e80 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c6effd640 1 -- 172.21.15.67:0/1205649905 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c70007500 con 0x7f6c780d0e80 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/1205649905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7815df20 con 0x7f6c780d0e80 2024-09-19T05:37:35.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c6effd640 1 -- 172.21.15.67:0/1205649905 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70004a30 con 0x7f6c780d0e80 2024-09-19T05:37:35.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.229+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/1205649905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7815f600 con 0x7f6c780d0e80 2024-09-19T05:37:35.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.233+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/1205649905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c780d1af0 con 0x7f6c780d0e80 2024-09-19T05:37:35.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.233+0000 7f6c6effd640 1 -- 172.21.15.67:0/1205649905 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c7001b070 con 0x7f6c780d0e80 2024-09-19T05:37:35.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.233+0000 7f6c6effd640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c5c0678f0 0x7f6c5c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.233+0000 7f6c6effd640 1 -- 172.21.15.67:0/1205649905 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f6c700850d0 con 0x7f6c780d0e80 2024-09-19T05:37:35.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.233+0000 7f6c7659c640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c5c0678f0 0x7f6c5c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.233+0000 7f6c7659c640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c5c0678f0 0x7f6c5c069db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6c68007510 tx=0x7f6c680074a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:35.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.237+0000 7f6c6effd640 1 -- 172.21.15.67:0/1205649905 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6c70055bd0 con 0x7f6c780d0e80 2024-09-19T05:37:35.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.389+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/1205649905 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c7806dbe0 con 0x7f6c5c0678f0 2024-09-19T05:37:35.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.409+0000 7f6c6effd640 1 -- 172.21.15.67:0/1205649905 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251972 (secure 0 0 0) 0x7f6c7806dbe0 con 0x7f6c5c0678f0 2024-09-19T05:37:35.414 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:35.416 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:37:35.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c5c0678f0 msgr2=0x7f6c5c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c5c0678f0 0x7f6c5c069db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6c68007510 tx=0x7f6c680074a0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/1205649905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0e80 msgr2=0x7f6c78154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0e80 0x7f6c78154b40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c4e0 tx=0x7f6c7000c9a0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/1205649905 shutdown_connections 2024-09-19T05:37:35.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c78161da0 0x7f6c7815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c780d0e80 0x7f6c78154b40 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c5c0678f0 0x7f6c5c069db0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 --2- 172.21.15.67:0/1205649905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c780d0160 0x7f6c780b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/1205649905 >> 172.21.15.67:0/1205649905 conn(0x7f6c7808bfc0 msgr2=0x7f6c7806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:35.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/1205649905 shutdown_connections 2024-09-19T05:37:35.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.413+0000 7f6c7ccc9640 1 -- 172.21.15.67:0/1205649905 wait complete. 2024-09-19T05:37:35.433 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-09-19T05:37:35.198103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":354212,"kb_used_data":7528,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754620508,"statfs":{"total":773094113280,"available":772731400192,"internally_reserved":0,"allocated":7708672,"data_stored":4115036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.861586"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391610+0000","last_change":"2024-09-19T05:37:31.411276+0000","last_active":"2024-09-19T05:37:32.391610+0000","last_peered":"2024-09-19T05:37:32.391610+0000","last_clean":"2024-09-19T05:37:32.391610+0000","last_became_active":"2024-09-19T05:37:31.410981+0000","last_became_peered":"2024-09-19T05:37:31.410981+0000","last_unstale":"2024-09-19T05:37:32.391610+0000","last_undegraded":"2024-09-19T05:37:32.391610+0000","last_fullsized":"2024-09-19T05:37:32.391610+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:08.627419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.390772+0000","last_change":"2024-09-19T05:37:31.389237+0000","last_active":"2024-09-19T05:37:32.390772+0000","last_peered":"2024-09-19T05:37:32.390772+0000","last_clean":"2024-09-19T05:37:32.390772+0000","last_became_active":"2024-09-19T05:37:31.387614+0000","last_became_peered":"2024-09-19T05:37:31.387614+0000","last_unstale":"2024-09-19T05:37:32.390772+0000","last_undegraded":"2024-09-19T05:37:32.390772+0000","last_fullsized":"2024-09-19T05:37:32.390772+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:42.226370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.429497+0000","last_change":"2024-09-19T05:37:31.395559+0000","last_active":"2024-09-19T05:37:31.429497+0000","last_peered":"2024-09-19T05:37:31.429497+0000","last_clean":"2024-09-19T05:37:31.429497+0000","last_became_active":"2024-09-19T05:37:31.394788+0000","last_became_peered":"2024-09-19T05:37:31.394788+0000","last_unstale":"2024-09-19T05:37:31.429497+0000","last_undegraded":"2024-09-19T05:37:31.429497+0000","last_fullsized":"2024-09-19T05:37:31.429497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:25.223185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.399131+0000","last_change":"2024-09-19T05:37:31.384834+0000","last_active":"2024-09-19T05:37:31.399131+0000","last_peered":"2024-09-19T05:37:31.399131+0000","last_clean":"2024-09-19T05:37:31.399131+0000","last_became_active":"2024-09-19T05:37:31.384062+0000","last_became_peered":"2024-09-19T05:37:31.384062+0000","last_unstale":"2024-09-19T05:37:31.399131+0000","last_undegraded":"2024-09-19T05:37:31.399131+0000","last_fullsized":"2024-09-19T05:37:31.399131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:48.988147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391772+0000","last_change":"2024-09-19T05:37:31.433319+0000","last_active":"2024-09-19T05:37:32.391772+0000","last_peered":"2024-09-19T05:37:32.391772+0000","last_clean":"2024-09-19T05:37:32.391772+0000","last_became_active":"2024-09-19T05:37:31.433030+0000","last_became_peered":"2024-09-19T05:37:31.433030+0000","last_unstale":"2024-09-19T05:37:32.391772+0000","last_undegraded":"2024-09-19T05:37:32.391772+0000","last_fullsized":"2024-09-19T05:37:32.391772+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:10.187890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.422659+0000","last_change":"2024-09-19T05:37:31.422045+0000","last_active":"2024-09-19T05:37:31.422659+0000","last_peered":"2024-09-19T05:37:31.422659+0000","last_clean":"2024-09-19T05:37:31.422659+0000","last_became_active":"2024-09-19T05:37:31.421498+0000","last_became_peered":"2024-09-19T05:37:31.421498+0000","last_unstale":"2024-09-19T05:37:31.422659+0000","last_undegraded":"2024-09-19T05:37:31.422659+0000","last_fullsized":"2024-09-19T05:37:31.422659+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:53.774423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.431427+0000","last_change":"2024-09-19T05:37:31.430904+0000","last_active":"2024-09-19T05:37:31.431427+0000","last_peered":"2024-09-19T05:37:31.431427+0000","last_clean":"2024-09-19T05:37:31.431427+0000","last_became_active":"2024-09-19T05:37:31.430596+0000","last_became_peered":"2024-09-19T05:37:31.430596+0000","last_unstale":"2024-09-19T05:37:31.431427+0000","last_undegraded":"2024-09-19T05:37:31.431427+0000","last_fullsized":"2024-09-19T05:37:31.431427+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:53.305455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.425664+0000","last_change":"2024-09-19T05:37:31.423857+0000","last_active":"2024-09-19T05:37:31.425664+0000","last_peered":"2024-09-19T05:37:31.425664+0000","last_clean":"2024-09-19T05:37:31.425664+0000","last_became_active":"2024-09-19T05:37:31.423298+0000","last_became_peered":"2024-09-19T05:37:31.423298+0000","last_unstale":"2024-09-19T05:37:31.425664+0000","last_undegraded":"2024-09-19T05:37:31.425664+0000","last_fullsized":"2024-09-19T05:37:31.425664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:09.116902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.436023+0000","last_change":"2024-09-19T05:37:31.405426+0000","last_active":"2024-09-19T05:37:31.436023+0000","last_peered":"2024-09-19T05:37:31.436023+0000","last_clean":"2024-09-19T05:37:31.436023+0000","last_became_active":"2024-09-19T05:37:31.404650+0000","last_became_peered":"2024-09-19T05:37:31.404650+0000","last_unstale":"2024-09-19T05:37:31.436023+0000","last_undegraded":"2024-09-19T05:37:31.436023+0000","last_fullsized":"2024-09-19T05:37:31.436023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:00.186736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.429673+0000","last_change":"2024-09-19T05:37:31.414439+0000","last_active":"2024-09-19T05:37:31.429673+0000","last_peered":"2024-09-19T05:37:31.429673+0000","last_clean":"2024-09-19T05:37:31.429673+0000","last_became_active":"2024-09-19T05:37:31.405640+0000","last_became_peered":"2024-09-19T05:37:31.405640+0000","last_unstale":"2024-09-19T05:37:31.429673+0000","last_undegraded":"2024-09-19T05:37:31.429673+0000","last_fullsized":"2024-09-19T05:37:31.429673+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:37.344826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.412785+0000","last_change":"2024-09-19T05:37:31.395373+0000","last_active":"2024-09-19T05:37:31.412785+0000","last_peered":"2024-09-19T05:37:31.412785+0000","last_clean":"2024-09-19T05:37:31.412785+0000","last_became_active":"2024-09-19T05:37:31.394646+0000","last_became_peered":"2024-09-19T05:37:31.394646+0000","last_unstale":"2024-09-19T05:37:31.412785+0000","last_undegraded":"2024-09-19T05:37:31.412785+0000","last_fullsized":"2024-09-19T05:37:31.412785+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:39.443694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.426233+0000","last_change":"2024-09-19T05:37:31.425503+0000","last_active":"2024-09-19T05:37:31.426233+0000","last_peered":"2024-09-19T05:37:31.426233+0000","last_clean":"2024-09-19T05:37:31.426233+0000","last_became_active":"2024-09-19T05:37:31.424929+0000","last_became_peered":"2024-09-19T05:37:31.424929+0000","last_unstale":"2024-09-19T05:37:31.426233+0000","last_undegraded":"2024-09-19T05:37:31.426233+0000","last_fullsized":"2024-09-19T05:37:31.426233+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:58.697351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.418949+0000","last_change":"2024-09-19T05:37:31.410462+0000","last_active":"2024-09-19T05:37:31.418949+0000","last_peered":"2024-09-19T05:37:31.418949+0000","last_clean":"2024-09-19T05:37:31.418949+0000","last_became_active":"2024-09-19T05:37:31.408862+0000","last_became_peered":"2024-09-19T05:37:31.408862+0000","last_unstale":"2024-09-19T05:37:31.418949+0000","last_undegraded":"2024-09-19T05:37:31.418949+0000","last_fullsized":"2024-09-19T05:37:31.418949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.589463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.435431+0000","last_change":"2024-09-19T05:37:31.421708+0000","last_active":"2024-09-19T05:37:31.435431+0000","last_peered":"2024-09-19T05:37:31.435431+0000","last_clean":"2024-09-19T05:37:31.435431+0000","last_became_active":"2024-09-19T05:37:31.420994+0000","last_became_peered":"2024-09-19T05:37:31.420994+0000","last_unstale":"2024-09-19T05:37:31.435431+0000","last_undegraded":"2024-09-19T05:37:31.435431+0000","last_fullsized":"2024-09-19T05:37:31.435431+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:21.942029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.429849+0000","last_change":"2024-09-19T05:37:31.414670+0000","last_active":"2024-09-19T05:37:31.429849+0000","last_peered":"2024-09-19T05:37:31.429849+0000","last_clean":"2024-09-19T05:37:31.429849+0000","last_became_active":"2024-09-19T05:37:31.413675+0000","last_became_peered":"2024-09-19T05:37:31.413675+0000","last_unstale":"2024-09-19T05:37:31.429849+0000","last_undegraded":"2024-09-19T05:37:31.429849+0000","last_fullsized":"2024-09-19T05:37:31.429849+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:18.780955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.413839+0000","last_change":"2024-09-19T05:37:31.412825+0000","last_active":"2024-09-19T05:37:31.413839+0000","last_peered":"2024-09-19T05:37:31.413839+0000","last_clean":"2024-09-19T05:37:31.413839+0000","last_became_active":"2024-09-19T05:37:31.412482+0000","last_became_peered":"2024-09-19T05:37:31.412482+0000","last_unstale":"2024-09-19T05:37:31.413839+0000","last_undegraded":"2024-09-19T05:37:31.413839+0000","last_fullsized":"2024-09-19T05:37:31.413839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:40.135863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391956+0000","last_change":"2024-09-19T05:37:31.413156+0000","last_active":"2024-09-19T05:37:32.391956+0000","last_peered":"2024-09-19T05:37:32.391956+0000","last_clean":"2024-09-19T05:37:32.391956+0000","last_became_active":"2024-09-19T05:37:31.412820+0000","last_became_peered":"2024-09-19T05:37:31.412820+0000","last_unstale":"2024-09-19T05:37:32.391956+0000","last_undegraded":"2024-09-19T05:37:32.391956+0000","last_fullsized":"2024-09-19T05:37:32.391956+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:25.223185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.399256+0000","last_change":"2024-09-19T05:37:31.384911+0000","last_active":"2024-09-19T05:37:31.399256+0000","last_peered":"2024-09-19T05:37:31.399256+0000","last_clean":"2024-09-19T05:37:31.399256+0000","last_became_active":"2024-09-19T05:37:31.384239+0000","last_became_peered":"2024-09-19T05:37:31.384239+0000","last_unstale":"2024-09-19T05:37:31.399256+0000","last_undegraded":"2024-09-19T05:37:31.399256+0000","last_fullsized":"2024-09-19T05:37:31.399256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:12.890473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392061+0000","last_change":"2024-09-19T05:37:31.432416+0000","last_active":"2024-09-19T05:37:32.392061+0000","last_peered":"2024-09-19T05:37:32.392061+0000","last_clean":"2024-09-19T05:37:32.392061+0000","last_became_active":"2024-09-19T05:37:31.426492+0000","last_became_peered":"2024-09-19T05:37:31.426492+0000","last_unstale":"2024-09-19T05:37:32.392061+0000","last_undegraded":"2024-09-19T05:37:32.392061+0000","last_fullsized":"2024-09-19T05:37:32.392061+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:39.238427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.434604+0000","last_change":"2024-09-19T05:37:31.434146+0000","last_active":"2024-09-19T05:37:31.434604+0000","last_peered":"2024-09-19T05:37:31.434604+0000","last_clean":"2024-09-19T05:37:31.434604+0000","last_became_active":"2024-09-19T05:37:31.433777+0000","last_became_peered":"2024-09-19T05:37:31.433777+0000","last_unstale":"2024-09-19T05:37:31.434604+0000","last_undegraded":"2024-09-19T05:37:31.434604+0000","last_fullsized":"2024-09-19T05:37:31.434604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:34:51.303478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.411903+0000","last_change":"2024-09-19T05:37:31.398068+0000","last_active":"2024-09-19T05:37:31.411903+0000","last_peered":"2024-09-19T05:37:31.411903+0000","last_clean":"2024-09-19T05:37:31.411903+0000","last_became_active":"2024-09-19T05:37:31.397240+0000","last_became_peered":"2024-09-19T05:37:31.397240+0000","last_unstale":"2024-09-19T05:37:31.411903+0000","last_undegraded":"2024-09-19T05:37:31.411903+0000","last_fullsized":"2024-09-19T05:37:31.411903+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:15.213142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.423904+0000","last_change":"2024-09-19T05:37:31.423466+0000","last_active":"2024-09-19T05:37:31.423904+0000","last_peered":"2024-09-19T05:37:31.423904+0000","last_clean":"2024-09-19T05:37:31.423904+0000","last_became_active":"2024-09-19T05:37:31.423122+0000","last_became_peered":"2024-09-19T05:37:31.423122+0000","last_unstale":"2024-09-19T05:37:31.423904+0000","last_undegraded":"2024-09-19T05:37:31.423904+0000","last_fullsized":"2024-09-19T05:37:31.423904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:16.588747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.422744+0000","last_change":"2024-09-19T05:37:31.422332+0000","last_active":"2024-09-19T05:37:31.422744+0000","last_peered":"2024-09-19T05:37:31.422744+0000","last_clean":"2024-09-19T05:37:31.422744+0000","last_became_active":"2024-09-19T05:37:31.421967+0000","last_became_peered":"2024-09-19T05:37:31.421967+0000","last_unstale":"2024-09-19T05:37:31.422744+0000","last_undegraded":"2024-09-19T05:37:31.422744+0000","last_fullsized":"2024-09-19T05:37:31.422744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:11:35.081844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.435244+0000","last_change":"2024-09-19T05:37:31.422613+0000","last_active":"2024-09-19T05:37:31.435244+0000","last_peered":"2024-09-19T05:37:31.435244+0000","last_clean":"2024-09-19T05:37:31.435244+0000","last_became_active":"2024-09-19T05:37:31.422057+0000","last_became_peered":"2024-09-19T05:37:31.422057+0000","last_unstale":"2024-09-19T05:37:31.435244+0000","last_undegraded":"2024-09-19T05:37:31.435244+0000","last_fullsized":"2024-09-19T05:37:31.435244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:49.435662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.411943+0000","last_change":"2024-09-19T05:37:31.398151+0000","last_active":"2024-09-19T05:37:31.411943+0000","last_peered":"2024-09-19T05:37:31.411943+0000","last_clean":"2024-09-19T05:37:31.411943+0000","last_became_active":"2024-09-19T05:37:31.397466+0000","last_became_peered":"2024-09-19T05:37:31.397466+0000","last_unstale":"2024-09-19T05:37:31.411943+0000","last_undegraded":"2024-09-19T05:37:31.411943+0000","last_fullsized":"2024-09-19T05:37:31.411943+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:12.672017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.419237+0000","last_change":"2024-09-19T05:37:31.397383+0000","last_active":"2024-09-19T05:37:31.419237+0000","last_peered":"2024-09-19T05:37:31.419237+0000","last_clean":"2024-09-19T05:37:31.419237+0000","last_became_active":"2024-09-19T05:37:31.396695+0000","last_became_peered":"2024-09-19T05:37:31.396695+0000","last_unstale":"2024-09-19T05:37:31.419237+0000","last_undegraded":"2024-09-19T05:37:31.419237+0000","last_fullsized":"2024-09-19T05:37:31.419237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:45.056920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.417940+0000","last_change":"2024-09-19T05:37:31.399893+0000","last_active":"2024-09-19T05:37:31.417940+0000","last_peered":"2024-09-19T05:37:31.417940+0000","last_clean":"2024-09-19T05:37:31.417940+0000","last_became_active":"2024-09-19T05:37:31.399108+0000","last_became_peered":"2024-09-19T05:37:31.399108+0000","last_unstale":"2024-09-19T05:37:31.417940+0000","last_undegraded":"2024-09-19T05:37:31.417940+0000","last_fullsized":"2024-09-19T05:37:31.417940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:01.191661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.390638+0000","last_change":"2024-09-19T05:37:31.433997+0000","last_active":"2024-09-19T05:37:32.390638+0000","last_peered":"2024-09-19T05:37:32.390638+0000","last_clean":"2024-09-19T05:37:32.390638+0000","last_became_active":"2024-09-19T05:37:31.433706+0000","last_became_peered":"2024-09-19T05:37:31.433706+0000","last_unstale":"2024-09-19T05:37:32.390638+0000","last_undegraded":"2024-09-19T05:37:32.390638+0000","last_fullsized":"2024-09-19T05:37:32.390638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:53.207347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.433781+0000","last_change":"2024-09-19T05:37:31.405355+0000","last_active":"2024-09-19T05:37:31.433781+0000","last_peered":"2024-09-19T05:37:31.433781+0000","last_clean":"2024-09-19T05:37:31.433781+0000","last_became_active":"2024-09-19T05:37:31.403761+0000","last_became_peered":"2024-09-19T05:37:31.403761+0000","last_unstale":"2024-09-19T05:37:31.433781+0000","last_undegraded":"2024-09-19T05:37:31.433781+0000","last_fullsized":"2024-09-19T05:37:31.433781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:58.741197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.432915+0000","last_change":"2024-09-19T05:37:31.431770+0000","last_active":"2024-09-19T05:37:31.432915+0000","last_peered":"2024-09-19T05:37:31.432915+0000","last_clean":"2024-09-19T05:37:31.432915+0000","last_became_active":"2024-09-19T05:37:31.431448+0000","last_became_peered":"2024-09-19T05:37:31.431448+0000","last_unstale":"2024-09-19T05:37:31.432915+0000","last_undegraded":"2024-09-19T05:37:31.432915+0000","last_fullsized":"2024-09-19T05:37:31.432915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:28.367857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.412247+0000","last_change":"2024-09-19T05:37:31.394386+0000","last_active":"2024-09-19T05:37:31.412247+0000","last_peered":"2024-09-19T05:37:31.412247+0000","last_clean":"2024-09-19T05:37:31.412247+0000","last_became_active":"2024-09-19T05:37:31.393700+0000","last_became_peered":"2024-09-19T05:37:31.393700+0000","last_unstale":"2024-09-19T05:37:31.412247+0000","last_undegraded":"2024-09-19T05:37:31.412247+0000","last_fullsized":"2024-09-19T05:37:31.412247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:42.277101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.399985+0000","last_change":"2024-09-19T05:37:31.393591+0000","last_active":"2024-09-19T05:37:31.399985+0000","last_peered":"2024-09-19T05:37:31.399985+0000","last_clean":"2024-09-19T05:37:31.399985+0000","last_became_active":"2024-09-19T05:37:31.393273+0000","last_became_peered":"2024-09-19T05:37:31.393273+0000","last_unstale":"2024-09-19T05:37:31.399985+0000","last_undegraded":"2024-09-19T05:37:31.399985+0000","last_fullsized":"2024-09-19T05:37:31.399985+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:22.020891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392062+0000","last_change":"2024-09-19T05:37:31.428345+0000","last_active":"2024-09-19T05:37:32.392062+0000","last_peered":"2024-09-19T05:37:32.392062+0000","last_clean":"2024-09-19T05:37:32.392062+0000","last_became_active":"2024-09-19T05:37:31.416105+0000","last_became_peered":"2024-09-19T05:37:31.416105+0000","last_unstale":"2024-09-19T05:37:32.392062+0000","last_undegraded":"2024-09-19T05:37:32.392062+0000","last_fullsized":"2024-09-19T05:37:32.392062+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:09.173425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"67'4","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391911+0000","last_change":"2024-09-19T05:37:30.383112+0000","last_active":"2024-09-19T05:37:32.391911+0000","last_peered":"2024-09-19T05:37:32.391911+0000","last_clean":"2024-09-19T05:37:32.391911+0000","last_became_active":"2024-09-19T05:37:30.382747+0000","last_became_peered":"2024-09-19T05:37:30.382747+0000","last_unstale":"2024-09-19T05:37:32.391911+0000","last_undegraded":"2024-09-19T05:37:32.391911+0000","last_fullsized":"2024-09-19T05:37:32.391911+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:40.991616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.437182+0000","last_change":"2024-09-19T05:37:31.436023+0000","last_active":"2024-09-19T05:37:31.437182+0000","last_peered":"2024-09-19T05:37:31.437182+0000","last_clean":"2024-09-19T05:37:31.437182+0000","last_became_active":"2024-09-19T05:37:31.435403+0000","last_became_peered":"2024-09-19T05:37:31.435403+0000","last_unstale":"2024-09-19T05:37:31.437182+0000","last_undegraded":"2024-09-19T05:37:31.437182+0000","last_fullsized":"2024-09-19T05:37:31.437182+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:49.587406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.436725+0000","last_change":"2024-09-19T05:37:30.369992+0000","last_active":"2024-09-19T05:37:31.436725+0000","last_peered":"2024-09-19T05:37:31.436725+0000","last_clean":"2024-09-19T05:37:31.436725+0000","last_became_active":"2024-09-19T05:37:30.369599+0000","last_became_peered":"2024-09-19T05:37:30.369599+0000","last_unstale":"2024-09-19T05:37:31.436725+0000","last_undegraded":"2024-09-19T05:37:31.436725+0000","last_fullsized":"2024-09-19T05:37:31.436725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:59.174225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.399912+0000","last_change":"2024-09-19T05:37:31.395076+0000","last_active":"2024-09-19T05:37:31.399912+0000","last_peered":"2024-09-19T05:37:31.399912+0000","last_clean":"2024-09-19T05:37:31.399912+0000","last_became_active":"2024-09-19T05:37:31.392658+0000","last_became_peered":"2024-09-19T05:37:31.392658+0000","last_unstale":"2024-09-19T05:37:31.399912+0000","last_undegraded":"2024-09-19T05:37:31.399912+0000","last_fullsized":"2024-09-19T05:37:31.399912+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:59.695499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.413291+0000","last_change":"2024-09-19T05:37:30.386122+0000","last_active":"2024-09-19T05:37:31.413291+0000","last_peered":"2024-09-19T05:37:31.413291+0000","last_clean":"2024-09-19T05:37:31.413291+0000","last_became_active":"2024-09-19T05:37:30.385867+0000","last_became_peered":"2024-09-19T05:37:30.385867+0000","last_unstale":"2024-09-19T05:37:31.413291+0000","last_undegraded":"2024-09-19T05:37:31.413291+0000","last_fullsized":"2024-09-19T05:37:31.413291+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:57.728685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.428659+0000","last_change":"2024-09-19T05:37:31.404751+0000","last_active":"2024-09-19T05:37:31.428659+0000","last_peered":"2024-09-19T05:37:31.428659+0000","last_clean":"2024-09-19T05:37:31.428659+0000","last_became_active":"2024-09-19T05:37:31.403462+0000","last_became_peered":"2024-09-19T05:37:31.403462+0000","last_unstale":"2024-09-19T05:37:31.428659+0000","last_undegraded":"2024-09-19T05:37:31.428659+0000","last_fullsized":"2024-09-19T05:37:31.428659+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:47.800609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.407290+0000","last_change":"2024-09-19T05:37:30.363647+0000","last_active":"2024-09-19T05:37:31.407290+0000","last_peered":"2024-09-19T05:37:31.407290+0000","last_clean":"2024-09-19T05:37:31.407290+0000","last_became_active":"2024-09-19T05:37:30.363242+0000","last_became_peered":"2024-09-19T05:37:30.363242+0000","last_unstale":"2024-09-19T05:37:31.407290+0000","last_undegraded":"2024-09-19T05:37:31.407290+0000","last_fullsized":"2024-09-19T05:37:31.407290+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:48.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.397761+0000","last_change":"2024-09-19T05:37:31.396864+0000","last_active":"2024-09-19T05:37:31.397761+0000","last_peered":"2024-09-19T05:37:31.397761+0000","last_clean":"2024-09-19T05:37:31.397761+0000","last_became_active":"2024-09-19T05:37:31.396393+0000","last_became_peered":"2024-09-19T05:37:31.396393+0000","last_unstale":"2024-09-19T05:37:31.397761+0000","last_undegraded":"2024-09-19T05:37:31.397761+0000","last_fullsized":"2024-09-19T05:37:31.397761+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:08.295964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.406849+0000","last_change":"2024-09-19T05:37:30.351790+0000","last_active":"2024-09-19T05:37:31.406849+0000","last_peered":"2024-09-19T05:37:31.406849+0000","last_clean":"2024-09-19T05:37:31.406849+0000","last_became_active":"2024-09-19T05:37:30.351391+0000","last_became_peered":"2024-09-19T05:37:30.351391+0000","last_unstale":"2024-09-19T05:37:31.406849+0000","last_undegraded":"2024-09-19T05:37:31.406849+0000","last_fullsized":"2024-09-19T05:37:31.406849+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:31.602693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.390201+0000","last_change":"2024-09-19T05:37:31.401655+0000","last_active":"2024-09-19T05:37:32.390201+0000","last_peered":"2024-09-19T05:37:32.390201+0000","last_clean":"2024-09-19T05:37:32.390201+0000","last_became_active":"2024-09-19T05:37:31.401347+0000","last_became_peered":"2024-09-19T05:37:31.401347+0000","last_unstale":"2024-09-19T05:37:32.390201+0000","last_undegraded":"2024-09-19T05:37:32.390201+0000","last_fullsized":"2024-09-19T05:37:32.390201+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:23.570887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.406089+0000","last_change":"2024-09-19T05:37:30.358619+0000","last_active":"2024-09-19T05:37:31.406089+0000","last_peered":"2024-09-19T05:37:31.406089+0000","last_clean":"2024-09-19T05:37:31.406089+0000","last_became_active":"2024-09-19T05:37:30.357838+0000","last_became_peered":"2024-09-19T05:37:30.357838+0000","last_unstale":"2024-09-19T05:37:31.406089+0000","last_undegraded":"2024-09-19T05:37:31.406089+0000","last_fullsized":"2024-09-19T05:37:31.406089+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:12.274443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391229+0000","last_change":"2024-09-19T05:37:31.436843+0000","last_active":"2024-09-19T05:37:32.391229+0000","last_peered":"2024-09-19T05:37:32.391229+0000","last_clean":"2024-09-19T05:37:32.391229+0000","last_became_active":"2024-09-19T05:37:31.433571+0000","last_became_peered":"2024-09-19T05:37:31.433571+0000","last_unstale":"2024-09-19T05:37:32.391229+0000","last_undegraded":"2024-09-19T05:37:32.391229+0000","last_fullsized":"2024-09-19T05:37:32.391229+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:42.004128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.377966+0000","last_change":"2024-09-19T05:37:30.371839+0000","last_active":"2024-09-19T05:37:31.377966+0000","last_peered":"2024-09-19T05:37:31.377966+0000","last_clean":"2024-09-19T05:37:31.377966+0000","last_became_active":"2024-09-19T05:37:30.371416+0000","last_became_peered":"2024-09-19T05:37:30.371416+0000","last_unstale":"2024-09-19T05:37:31.377966+0000","last_undegraded":"2024-09-19T05:37:31.377966+0000","last_fullsized":"2024-09-19T05:37:31.377966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:52.761912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.402307+0000","last_change":"2024-09-19T05:37:31.400763+0000","last_active":"2024-09-19T05:37:31.402307+0000","last_peered":"2024-09-19T05:37:31.402307+0000","last_clean":"2024-09-19T05:37:31.402307+0000","last_became_active":"2024-09-19T05:37:31.400418+0000","last_became_peered":"2024-09-19T05:37:31.400418+0000","last_unstale":"2024-09-19T05:37:31.402307+0000","last_undegraded":"2024-09-19T05:37:31.402307+0000","last_fullsized":"2024-09-19T05:37:31.402307+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:17.924240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391062+0000","last_change":"2024-09-19T05:37:30.378938+0000","last_active":"2024-09-19T05:37:32.391062+0000","last_peered":"2024-09-19T05:37:32.391062+0000","last_clean":"2024-09-19T05:37:32.391062+0000","last_became_active":"2024-09-19T05:37:30.372545+0000","last_became_peered":"2024-09-19T05:37:30.372545+0000","last_unstale":"2024-09-19T05:37:32.391062+0000","last_undegraded":"2024-09-19T05:37:32.391062+0000","last_fullsized":"2024-09-19T05:37:32.391062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:14.802345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391051+0000","last_change":"2024-09-19T05:37:31.393639+0000","last_active":"2024-09-19T05:37:32.391051+0000","last_peered":"2024-09-19T05:37:32.391051+0000","last_clean":"2024-09-19T05:37:32.391051+0000","last_became_active":"2024-09-19T05:37:31.393262+0000","last_became_peered":"2024-09-19T05:37:31.393262+0000","last_unstale":"2024-09-19T05:37:32.391051+0000","last_undegraded":"2024-09-19T05:37:32.391051+0000","last_fullsized":"2024-09-19T05:37:32.391051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:38.689559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.379447+0000","last_change":"2024-09-19T05:37:30.390106+0000","last_active":"2024-09-19T05:37:31.379447+0000","last_peered":"2024-09-19T05:37:31.379447+0000","last_clean":"2024-09-19T05:37:31.379447+0000","last_became_active":"2024-09-19T05:37:30.386482+0000","last_became_peered":"2024-09-19T05:37:30.386482+0000","last_unstale":"2024-09-19T05:37:31.379447+0000","last_undegraded":"2024-09-19T05:37:31.379447+0000","last_fullsized":"2024-09-19T05:37:31.379447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:52.194835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.402271+0000","last_change":"2024-09-19T05:37:31.401366+0000","last_active":"2024-09-19T05:37:31.402271+0000","last_peered":"2024-09-19T05:37:31.402271+0000","last_clean":"2024-09-19T05:37:31.402271+0000","last_became_active":"2024-09-19T05:37:31.400061+0000","last_became_peered":"2024-09-19T05:37:31.400061+0000","last_unstale":"2024-09-19T05:37:31.402271+0000","last_undegraded":"2024-09-19T05:37:31.402271+0000","last_fullsized":"2024-09-19T05:37:31.402271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:58.065255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.373225+0000","last_change":"2024-09-19T05:37:30.373005+0000","last_active":"2024-09-19T05:37:31.373225+0000","last_peered":"2024-09-19T05:37:31.373225+0000","last_clean":"2024-09-19T05:37:31.373225+0000","last_became_active":"2024-09-19T05:37:30.370608+0000","last_became_peered":"2024-09-19T05:37:30.370608+0000","last_unstale":"2024-09-19T05:37:31.373225+0000","last_undegraded":"2024-09-19T05:37:31.373225+0000","last_fullsized":"2024-09-19T05:37:31.373225+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:53.530327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392811+0000","last_change":"2024-09-19T05:37:31.432418+0000","last_active":"2024-09-19T05:37:32.392811+0000","last_peered":"2024-09-19T05:37:32.392811+0000","last_clean":"2024-09-19T05:37:32.392811+0000","last_became_active":"2024-09-19T05:37:31.426534+0000","last_became_peered":"2024-09-19T05:37:31.426534+0000","last_unstale":"2024-09-19T05:37:32.392811+0000","last_undegraded":"2024-09-19T05:37:32.392811+0000","last_fullsized":"2024-09-19T05:37:32.392811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:15.641680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"67'3","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.436728+0000","last_change":"2024-09-19T05:37:30.379336+0000","last_active":"2024-09-19T05:37:31.436728+0000","last_peered":"2024-09-19T05:37:31.436728+0000","last_clean":"2024-09-19T05:37:31.436728+0000","last_became_active":"2024-09-19T05:37:30.378196+0000","last_became_peered":"2024-09-19T05:37:30.378196+0000","last_unstale":"2024-09-19T05:37:31.436728+0000","last_undegraded":"2024-09-19T05:37:31.436728+0000","last_fullsized":"2024-09-19T05:37:31.436728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:22.558376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.412235+0000","last_change":"2024-09-19T05:37:31.392579+0000","last_active":"2024-09-19T05:37:31.412235+0000","last_peered":"2024-09-19T05:37:31.412235+0000","last_clean":"2024-09-19T05:37:31.412235+0000","last_became_active":"2024-09-19T05:37:31.391896+0000","last_became_peered":"2024-09-19T05:37:31.391896+0000","last_unstale":"2024-09-19T05:37:31.412235+0000","last_undegraded":"2024-09-19T05:37:31.412235+0000","last_fullsized":"2024-09-19T05:37:31.412235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:56.733693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"67'6","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391499+0000","last_change":"2024-09-19T05:37:30.377494+0000","last_active":"2024-09-19T05:37:32.391499+0000","last_peered":"2024-09-19T05:37:32.391499+0000","last_clean":"2024-09-19T05:37:32.391499+0000","last_became_active":"2024-09-19T05:37:30.377030+0000","last_became_peered":"2024-09-19T05:37:30.377030+0000","last_unstale":"2024-09-19T05:37:32.391499+0000","last_undegraded":"2024-09-19T05:37:32.391499+0000","last_fullsized":"2024-09-19T05:37:32.391499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:18.308803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.423152+0000","last_change":"2024-09-19T05:37:31.417536+0000","last_active":"2024-09-19T05:37:31.423152+0000","last_peered":"2024-09-19T05:37:31.423152+0000","last_clean":"2024-09-19T05:37:31.423152+0000","last_became_active":"2024-09-19T05:37:31.416810+0000","last_became_peered":"2024-09-19T05:37:31.416810+0000","last_unstale":"2024-09-19T05:37:31.423152+0000","last_undegraded":"2024-09-19T05:37:31.423152+0000","last_fullsized":"2024-09-19T05:37:31.423152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:01.313011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.435660+0000","last_change":"2024-09-19T05:37:30.383867+0000","last_active":"2024-09-19T05:37:31.435660+0000","last_peered":"2024-09-19T05:37:31.435660+0000","last_clean":"2024-09-19T05:37:31.435660+0000","last_became_active":"2024-09-19T05:37:30.383137+0000","last_became_peered":"2024-09-19T05:37:30.383137+0000","last_unstale":"2024-09-19T05:37:31.435660+0000","last_undegraded":"2024-09-19T05:37:31.435660+0000","last_fullsized":"2024-09-19T05:37:31.435660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:29.708428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.419079+0000","last_change":"2024-09-19T05:37:31.407839+0000","last_active":"2024-09-19T05:37:31.419079+0000","last_peered":"2024-09-19T05:37:31.419079+0000","last_clean":"2024-09-19T05:37:31.419079+0000","last_became_active":"2024-09-19T05:37:31.395091+0000","last_became_peered":"2024-09-19T05:37:31.395091+0000","last_unstale":"2024-09-19T05:37:31.419079+0000","last_undegraded":"2024-09-19T05:37:31.419079+0000","last_fullsized":"2024-09-19T05:37:31.419079+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:08.105251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.382977+0000","last_change":"2024-09-19T05:37:30.375892+0000","last_active":"2024-09-19T05:37:31.382977+0000","last_peered":"2024-09-19T05:37:31.382977+0000","last_clean":"2024-09-19T05:37:31.382977+0000","last_became_active":"2024-09-19T05:37:30.373898+0000","last_became_peered":"2024-09-19T05:37:30.373898+0000","last_unstale":"2024-09-19T05:37:31.382977+0000","last_undegraded":"2024-09-19T05:37:31.382977+0000","last_fullsized":"2024-09-19T05:37:31.382977+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:51.664270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391241+0000","last_change":"2024-09-19T05:37:31.434079+0000","last_active":"2024-09-19T05:37:32.391241+0000","last_peered":"2024-09-19T05:37:32.391241+0000","last_clean":"2024-09-19T05:37:32.391241+0000","last_became_active":"2024-09-19T05:37:31.432978+0000","last_became_peered":"2024-09-19T05:37:31.432978+0000","last_unstale":"2024-09-19T05:37:32.391241+0000","last_undegraded":"2024-09-19T05:37:32.391241+0000","last_fullsized":"2024-09-19T05:37:32.391241+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:19.321315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.393176+0000","last_change":"2024-09-19T05:37:30.389864+0000","last_active":"2024-09-19T05:37:31.393176+0000","last_peered":"2024-09-19T05:37:31.393176+0000","last_clean":"2024-09-19T05:37:31.393176+0000","last_became_active":"2024-09-19T05:37:30.386910+0000","last_became_peered":"2024-09-19T05:37:30.386910+0000","last_unstale":"2024-09-19T05:37:31.393176+0000","last_undegraded":"2024-09-19T05:37:31.393176+0000","last_fullsized":"2024-09-19T05:37:31.393176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:37.677047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391046+0000","last_change":"2024-09-19T05:37:31.431021+0000","last_active":"2024-09-19T05:37:32.391046+0000","last_peered":"2024-09-19T05:37:32.391046+0000","last_clean":"2024-09-19T05:37:32.391046+0000","last_became_active":"2024-09-19T05:37:31.430697+0000","last_became_peered":"2024-09-19T05:37:31.430697+0000","last_unstale":"2024-09-19T05:37:32.391046+0000","last_undegraded":"2024-09-19T05:37:32.391046+0000","last_fullsized":"2024-09-19T05:37:32.391046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:13.278748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"67'8","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.440460+0000","last_change":"2024-09-19T05:37:30.368079+0000","last_active":"2024-09-19T05:37:31.440460+0000","last_peered":"2024-09-19T05:37:31.440460+0000","last_clean":"2024-09-19T05:37:31.440460+0000","last_became_active":"2024-09-19T05:37:30.367222+0000","last_became_peered":"2024-09-19T05:37:30.367222+0000","last_unstale":"2024-09-19T05:37:31.440460+0000","last_undegraded":"2024-09-19T05:37:31.440460+0000","last_fullsized":"2024-09-19T05:37:31.440460+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:28.799396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.429625+0000","last_change":"2024-09-19T05:37:31.405096+0000","last_active":"2024-09-19T05:37:31.429625+0000","last_peered":"2024-09-19T05:37:31.429625+0000","last_clean":"2024-09-19T05:37:31.429625+0000","last_became_active":"2024-09-19T05:37:31.403488+0000","last_became_peered":"2024-09-19T05:37:31.403488+0000","last_unstale":"2024-09-19T05:37:31.429625+0000","last_undegraded":"2024-09-19T05:37:31.429625+0000","last_fullsized":"2024-09-19T05:37:31.429625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:39.486455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.424629+0000","last_change":"2024-09-19T05:37:30.374685+0000","last_active":"2024-09-19T05:37:31.424629+0000","last_peered":"2024-09-19T05:37:31.424629+0000","last_clean":"2024-09-19T05:37:31.424629+0000","last_became_active":"2024-09-19T05:37:30.373926+0000","last_became_peered":"2024-09-19T05:37:30.373926+0000","last_unstale":"2024-09-19T05:37:31.424629+0000","last_undegraded":"2024-09-19T05:37:31.424629+0000","last_fullsized":"2024-09-19T05:37:31.424629+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:37.298634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392588+0000","last_change":"2024-09-19T05:37:31.432800+0000","last_active":"2024-09-19T05:37:32.392588+0000","last_peered":"2024-09-19T05:37:32.392588+0000","last_clean":"2024-09-19T05:37:32.392588+0000","last_became_active":"2024-09-19T05:37:31.427845+0000","last_became_peered":"2024-09-19T05:37:31.427845+0000","last_unstale":"2024-09-19T05:37:32.392588+0000","last_undegraded":"2024-09-19T05:37:32.392588+0000","last_fullsized":"2024-09-19T05:37:32.392588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:51.218522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.435376+0000","last_change":"2024-09-19T05:37:30.387297+0000","last_active":"2024-09-19T05:37:31.435376+0000","last_peered":"2024-09-19T05:37:31.435376+0000","last_clean":"2024-09-19T05:37:31.435376+0000","last_became_active":"2024-09-19T05:37:30.386543+0000","last_became_peered":"2024-09-19T05:37:30.386543+0000","last_unstale":"2024-09-19T05:37:31.435376+0000","last_undegraded":"2024-09-19T05:37:31.435376+0000","last_fullsized":"2024-09-19T05:37:31.435376+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:07.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.416375+0000","last_change":"2024-09-19T05:37:31.391628+0000","last_active":"2024-09-19T05:37:31.416375+0000","last_peered":"2024-09-19T05:37:31.416375+0000","last_clean":"2024-09-19T05:37:31.416375+0000","last_became_active":"2024-09-19T05:37:31.390822+0000","last_became_peered":"2024-09-19T05:37:31.390822+0000","last_unstale":"2024-09-19T05:37:31.416375+0000","last_undegraded":"2024-09-19T05:37:31.416375+0000","last_fullsized":"2024-09-19T05:37:31.416375+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:15.814857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.436491+0000","last_change":"2024-09-19T05:37:30.378691+0000","last_active":"2024-09-19T05:37:31.436491+0000","last_peered":"2024-09-19T05:37:31.436491+0000","last_clean":"2024-09-19T05:37:31.436491+0000","last_became_active":"2024-09-19T05:37:30.377967+0000","last_became_peered":"2024-09-19T05:37:30.377967+0000","last_unstale":"2024-09-19T05:37:31.436491+0000","last_undegraded":"2024-09-19T05:37:31.436491+0000","last_fullsized":"2024-09-19T05:37:31.436491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:41.213858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392869+0000","last_change":"2024-09-19T05:37:31.416017+0000","last_active":"2024-09-19T05:37:32.392869+0000","last_peered":"2024-09-19T05:37:32.392869+0000","last_clean":"2024-09-19T05:37:32.392869+0000","last_became_active":"2024-09-19T05:37:31.415232+0000","last_became_peered":"2024-09-19T05:37:31.415232+0000","last_unstale":"2024-09-19T05:37:32.392869+0000","last_undegraded":"2024-09-19T05:37:32.392869+0000","last_fullsized":"2024-09-19T05:37:32.392869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:18.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.380809+0000","last_change":"2024-09-19T05:37:30.368770+0000","last_active":"2024-09-19T05:37:31.380809+0000","last_peered":"2024-09-19T05:37:31.380809+0000","last_clean":"2024-09-19T05:37:31.380809+0000","last_became_active":"2024-09-19T05:37:30.368353+0000","last_became_peered":"2024-09-19T05:37:30.368353+0000","last_unstale":"2024-09-19T05:37:31.380809+0000","last_undegraded":"2024-09-19T05:37:31.380809+0000","last_fullsized":"2024-09-19T05:37:31.380809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:33.160321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.399958+0000","last_change":"2024-09-19T05:37:31.393052+0000","last_active":"2024-09-19T05:37:31.399958+0000","last_peered":"2024-09-19T05:37:31.399958+0000","last_clean":"2024-09-19T05:37:31.399958+0000","last_became_active":"2024-09-19T05:37:31.392720+0000","last_became_peered":"2024-09-19T05:37:31.392720+0000","last_unstale":"2024-09-19T05:37:31.399958+0000","last_undegraded":"2024-09-19T05:37:31.399958+0000","last_fullsized":"2024-09-19T05:37:31.399958+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:10.706829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.438282+0000","last_change":"2024-09-19T05:37:30.360013+0000","last_active":"2024-09-19T05:37:31.438282+0000","last_peered":"2024-09-19T05:37:31.438282+0000","last_clean":"2024-09-19T05:37:31.438282+0000","last_became_active":"2024-09-19T05:37:30.359574+0000","last_became_peered":"2024-09-19T05:37:30.359574+0000","last_unstale":"2024-09-19T05:37:31.438282+0000","last_undegraded":"2024-09-19T05:37:31.438282+0000","last_fullsized":"2024-09-19T05:37:31.438282+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:17.768444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.419130+0000","last_change":"2024-09-19T05:37:31.409512+0000","last_active":"2024-09-19T05:37:31.419130+0000","last_peered":"2024-09-19T05:37:31.419130+0000","last_clean":"2024-09-19T05:37:31.419130+0000","last_became_active":"2024-09-19T05:37:31.408735+0000","last_became_peered":"2024-09-19T05:37:31.408735+0000","last_unstale":"2024-09-19T05:37:31.419130+0000","last_undegraded":"2024-09-19T05:37:31.419130+0000","last_fullsized":"2024-09-19T05:37:31.419130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:32.053658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.383360+0000","last_change":"2024-09-19T05:37:30.381592+0000","last_active":"2024-09-19T05:37:31.383360+0000","last_peered":"2024-09-19T05:37:31.383360+0000","last_clean":"2024-09-19T05:37:31.383360+0000","last_became_active":"2024-09-19T05:37:30.375027+0000","last_became_peered":"2024-09-19T05:37:30.375027+0000","last_unstale":"2024-09-19T05:37:31.383360+0000","last_undegraded":"2024-09-19T05:37:31.383360+0000","last_fullsized":"2024-09-19T05:37:31.383360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:41:22.886317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391613+0000","last_change":"2024-09-19T05:37:31.428549+0000","last_active":"2024-09-19T05:37:32.391613+0000","last_peered":"2024-09-19T05:37:32.391613+0000","last_clean":"2024-09-19T05:37:32.391613+0000","last_became_active":"2024-09-19T05:37:31.427283+0000","last_became_peered":"2024-09-19T05:37:31.427283+0000","last_unstale":"2024-09-19T05:37:32.391613+0000","last_undegraded":"2024-09-19T05:37:32.391613+0000","last_fullsized":"2024-09-19T05:37:32.391613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:02.086197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.370614+0000","last_change":"2024-09-19T05:37:30.370064+0000","last_active":"2024-09-19T05:37:31.370614+0000","last_peered":"2024-09-19T05:37:31.370614+0000","last_clean":"2024-09-19T05:37:31.370614+0000","last_became_active":"2024-09-19T05:37:30.369705+0000","last_became_peered":"2024-09-19T05:37:30.369705+0000","last_unstale":"2024-09-19T05:37:31.370614+0000","last_undegraded":"2024-09-19T05:37:31.370614+0000","last_fullsized":"2024-09-19T05:37:31.370614+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:08.002648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.398869+0000","last_change":"2024-09-19T05:37:31.393917+0000","last_active":"2024-09-19T05:37:31.398869+0000","last_peered":"2024-09-19T05:37:31.398869+0000","last_clean":"2024-09-19T05:37:31.398869+0000","last_became_active":"2024-09-19T05:37:31.393492+0000","last_became_peered":"2024-09-19T05:37:31.393492+0000","last_unstale":"2024-09-19T05:37:31.398869+0000","last_undegraded":"2024-09-19T05:37:31.398869+0000","last_fullsized":"2024-09-19T05:37:31.398869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:20.686623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.441252+0000","last_change":"2024-09-19T05:37:30.386931+0000","last_active":"2024-09-19T05:37:31.441252+0000","last_peered":"2024-09-19T05:37:31.441252+0000","last_clean":"2024-09-19T05:37:31.441252+0000","last_became_active":"2024-09-19T05:37:30.386242+0000","last_became_peered":"2024-09-19T05:37:30.386242+0000","last_unstale":"2024-09-19T05:37:31.441252+0000","last_undegraded":"2024-09-19T05:37:31.441252+0000","last_fullsized":"2024-09-19T05:37:31.441252+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:45.239661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.397755+0000","last_change":"2024-09-19T05:37:31.396764+0000","last_active":"2024-09-19T05:37:31.397755+0000","last_peered":"2024-09-19T05:37:31.397755+0000","last_clean":"2024-09-19T05:37:31.397755+0000","last_became_active":"2024-09-19T05:37:31.396354+0000","last_became_peered":"2024-09-19T05:37:31.396354+0000","last_unstale":"2024-09-19T05:37:31.397755+0000","last_undegraded":"2024-09-19T05:37:31.397755+0000","last_fullsized":"2024-09-19T05:37:31.397755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:38.063560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.382387+0000","last_change":"2024-09-19T05:37:30.373333+0000","last_active":"2024-09-19T05:37:31.382387+0000","last_peered":"2024-09-19T05:37:31.382387+0000","last_clean":"2024-09-19T05:37:31.382387+0000","last_became_active":"2024-09-19T05:37:30.372644+0000","last_became_peered":"2024-09-19T05:37:30.372644+0000","last_unstale":"2024-09-19T05:37:31.382387+0000","last_undegraded":"2024-09-19T05:37:31.382387+0000","last_fullsized":"2024-09-19T05:37:31.382387+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:24.414312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.419175+0000","last_change":"2024-09-19T05:37:31.397130+0000","last_active":"2024-09-19T05:37:31.419175+0000","last_peered":"2024-09-19T05:37:31.419175+0000","last_clean":"2024-09-19T05:37:31.419175+0000","last_became_active":"2024-09-19T05:37:31.396396+0000","last_became_peered":"2024-09-19T05:37:31.396396+0000","last_unstale":"2024-09-19T05:37:31.419175+0000","last_undegraded":"2024-09-19T05:37:31.419175+0000","last_fullsized":"2024-09-19T05:37:31.419175+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:00.485466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.370415+0000","last_change":"2024-09-19T05:37:30.376432+0000","last_active":"2024-09-19T05:37:31.370415+0000","last_peered":"2024-09-19T05:37:31.370415+0000","last_clean":"2024-09-19T05:37:31.370415+0000","last_became_active":"2024-09-19T05:37:30.376021+0000","last_became_peered":"2024-09-19T05:37:30.376021+0000","last_unstale":"2024-09-19T05:37:31.370415+0000","last_undegraded":"2024-09-19T05:37:31.370415+0000","last_fullsized":"2024-09-19T05:37:31.370415+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:20.929517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392885+0000","last_change":"2024-09-19T05:37:31.414375+0000","last_active":"2024-09-19T05:37:32.392885+0000","last_peered":"2024-09-19T05:37:32.392885+0000","last_clean":"2024-09-19T05:37:32.392885+0000","last_became_active":"2024-09-19T05:37:31.413456+0000","last_became_peered":"2024-09-19T05:37:31.413456+0000","last_unstale":"2024-09-19T05:37:32.392885+0000","last_undegraded":"2024-09-19T05:37:32.392885+0000","last_fullsized":"2024-09-19T05:37:32.392885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:31.241676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391854+0000","last_change":"2024-09-19T05:37:30.376949+0000","last_active":"2024-09-19T05:37:32.391854+0000","last_peered":"2024-09-19T05:37:32.391854+0000","last_clean":"2024-09-19T05:37:32.391854+0000","last_became_active":"2024-09-19T05:37:30.376594+0000","last_became_peered":"2024-09-19T05:37:30.376594+0000","last_unstale":"2024-09-19T05:37:32.391854+0000","last_undegraded":"2024-09-19T05:37:32.391854+0000","last_fullsized":"2024-09-19T05:37:32.391854+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:01.073685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391068+0000","last_change":"2024-09-19T05:37:31.415887+0000","last_active":"2024-09-19T05:37:32.391068+0000","last_peered":"2024-09-19T05:37:32.391068+0000","last_clean":"2024-09-19T05:37:32.391068+0000","last_became_active":"2024-09-19T05:37:31.414262+0000","last_became_peered":"2024-09-19T05:37:31.414262+0000","last_unstale":"2024-09-19T05:37:32.391068+0000","last_undegraded":"2024-09-19T05:37:32.391068+0000","last_fullsized":"2024-09-19T05:37:32.391068+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:02.917874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.379700+0000","last_change":"2024-09-19T05:37:30.366685+0000","last_active":"2024-09-19T05:37:31.379700+0000","last_peered":"2024-09-19T05:37:31.379700+0000","last_clean":"2024-09-19T05:37:31.379700+0000","last_became_active":"2024-09-19T05:37:30.365966+0000","last_became_peered":"2024-09-19T05:37:30.365966+0000","last_unstale":"2024-09-19T05:37:31.379700+0000","last_undegraded":"2024-09-19T05:37:31.379700+0000","last_fullsized":"2024-09-19T05:37:31.379700+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:12.266236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.419939+0000","last_change":"2024-09-19T05:37:31.410600+0000","last_active":"2024-09-19T05:37:31.419939+0000","last_peered":"2024-09-19T05:37:31.419939+0000","last_clean":"2024-09-19T05:37:31.419939+0000","last_became_active":"2024-09-19T05:37:31.409860+0000","last_became_peered":"2024-09-19T05:37:31.409860+0000","last_unstale":"2024-09-19T05:37:31.419939+0000","last_undegraded":"2024-09-19T05:37:31.419939+0000","last_fullsized":"2024-09-19T05:37:31.419939+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.454306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.379586+0000","last_change":"2024-09-19T05:37:30.360892+0000","last_active":"2024-09-19T05:37:31.379586+0000","last_peered":"2024-09-19T05:37:31.379586+0000","last_clean":"2024-09-19T05:37:31.379586+0000","last_became_active":"2024-09-19T05:37:30.360416+0000","last_became_peered":"2024-09-19T05:37:30.360416+0000","last_unstale":"2024-09-19T05:37:31.379586+0000","last_undegraded":"2024-09-19T05:37:31.379586+0000","last_fullsized":"2024-09-19T05:37:31.379586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:08.435120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.390595+0000","last_change":"2024-09-19T05:37:31.401737+0000","last_active":"2024-09-19T05:37:32.390595+0000","last_peered":"2024-09-19T05:37:32.390595+0000","last_clean":"2024-09-19T05:37:32.390595+0000","last_became_active":"2024-09-19T05:37:31.401381+0000","last_became_peered":"2024-09-19T05:37:31.401381+0000","last_unstale":"2024-09-19T05:37:32.390595+0000","last_undegraded":"2024-09-19T05:37:32.390595+0000","last_fullsized":"2024-09-19T05:37:32.390595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.720940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.378341+0000","last_change":"2024-09-19T05:37:30.371451+0000","last_active":"2024-09-19T05:37:31.378341+0000","last_peered":"2024-09-19T05:37:31.378341+0000","last_clean":"2024-09-19T05:37:31.378341+0000","last_became_active":"2024-09-19T05:37:30.370955+0000","last_became_peered":"2024-09-19T05:37:30.370955+0000","last_unstale":"2024-09-19T05:37:31.378341+0000","last_undegraded":"2024-09-19T05:37:31.378341+0000","last_fullsized":"2024-09-19T05:37:31.378341+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:59.529338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.414031+0000","last_change":"2024-09-19T05:37:31.413282+0000","last_active":"2024-09-19T05:37:31.414031+0000","last_peered":"2024-09-19T05:37:31.414031+0000","last_clean":"2024-09-19T05:37:31.414031+0000","last_became_active":"2024-09-19T05:37:31.413008+0000","last_became_peered":"2024-09-19T05:37:31.413008+0000","last_unstale":"2024-09-19T05:37:31.414031+0000","last_undegraded":"2024-09-19T05:37:31.414031+0000","last_fullsized":"2024-09-19T05:37:31.414031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:06.193614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.390824+0000","last_change":"2024-09-19T05:37:30.380876+0000","last_active":"2024-09-19T05:37:32.390824+0000","last_peered":"2024-09-19T05:37:32.390824+0000","last_clean":"2024-09-19T05:37:32.390824+0000","last_became_active":"2024-09-19T05:37:30.380482+0000","last_became_peered":"2024-09-19T05:37:30.380482+0000","last_unstale":"2024-09-19T05:37:32.390824+0000","last_undegraded":"2024-09-19T05:37:32.390824+0000","last_fullsized":"2024-09-19T05:37:32.390824+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:01.905362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391801+0000","last_change":"2024-09-19T05:37:31.415037+0000","last_active":"2024-09-19T05:37:32.391801+0000","last_peered":"2024-09-19T05:37:32.391801+0000","last_clean":"2024-09-19T05:37:32.391801+0000","last_became_active":"2024-09-19T05:37:31.414541+0000","last_became_peered":"2024-09-19T05:37:31.414541+0000","last_unstale":"2024-09-19T05:37:32.391801+0000","last_undegraded":"2024-09-19T05:37:32.391801+0000","last_fullsized":"2024-09-19T05:37:32.391801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:43.924100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.377477+0000","last_change":"2024-09-19T05:37:30.360732+0000","last_active":"2024-09-19T05:37:31.377477+0000","last_peered":"2024-09-19T05:37:31.377477+0000","last_clean":"2024-09-19T05:37:31.377477+0000","last_became_active":"2024-09-19T05:37:30.358778+0000","last_became_peered":"2024-09-19T05:37:30.358778+0000","last_unstale":"2024-09-19T05:37:31.377477+0000","last_undegraded":"2024-09-19T05:37:31.377477+0000","last_fullsized":"2024-09-19T05:37:31.377477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:58.682987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":257,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.382782+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:37:31.382782+0000","last_peered":"2024-09-19T05:37:31.382782+0000","last_clean":"2024-09-19T05:37:31.382782+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:37:31.382782+0000","last_undegraded":"2024-09-19T05:37:31.382782+0000","last_fullsized":"2024-09-19T05:37:31.382782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542200,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46460,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325380,"statfs":{"total":96636764160,"available":96589189120,"internally_reserved":0,"allocated":1417216,"data_stored":957329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542200,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40300,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331540,"statfs":{"total":96636764160,"available":96595496960,"internally_reserved":0,"allocated":811008,"data_stored":366219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542202,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40308,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331532,"statfs":{"total":96636764160,"available":96595488768,"internally_reserved":0,"allocated":811008,"data_stored":366207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45884,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325956,"statfs":{"total":96636764160,"available":96589778944,"internally_reserved":0,"allocated":819200,"data_stored":367797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542201,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45872,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325968,"statfs":{"total":96636764160,"available":96589791232,"internally_reserved":0,"allocated":806912,"data_stored":366185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44452,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327388,"statfs":{"total":96636764160,"available":96591245312,"internally_reserved":0,"allocated":806912,"data_stored":366185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40332,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331508,"statfs":{"total":96636764160,"available":96595464192,"internally_reserved":0,"allocated":835584,"data_stored":368561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50604,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321236,"statfs":{"total":96636764160,"available":96584945664,"internally_reserved":0,"allocated":1400832,"data_stored":956553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:37:35.438 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:37:35.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf03d69640 1 Processor -- start 2024-09-19T05:37:35.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf03d69640 1 -- start start 2024-09-19T05:37:35.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf03d69640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdefc0d1590 0x7fdefc0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf03d69640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdefc0b51d0 0x7fdefc0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf03d69640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdefc0d4d40 con 0x7fdefc161da0 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf03d69640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdefc0d0840 con 0x7fdefc0b51d0 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf03d69640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fdefc0d5020 con 0x7fdefc0d1590 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf02306640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdefc0b51d0 0x7fdefc0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf01b05640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdefc161da0 0x7fdefc0d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:32840/0 (socket says 172.21.15.67:32840) 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf01b05640 1 -- 172.21.15.67:0/3253631144 learned_addr learned my addr 172.21.15.67:0/3253631144 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf01304640 1 --2- 172.21.15.67:0/3253631144 >> v2:172.21.15.97:3300/0 conn(0x7fdefc0d1590 0x7fdefc0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf02306640 1 -- 172.21.15.67:0/3253631144 >> v2:172.21.15.97:3300/0 conn(0x7fdefc0d1590 msgr2=0x7fdefc0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf02306640 1 --2- 172.21.15.67:0/3253631144 >> v2:172.21.15.97:3300/0 conn(0x7fdefc0d1590 0x7fdefc0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf02306640 1 -- 172.21.15.67:0/3253631144 >> v1:172.21.15.67:6789/0 conn(0x7fdefc161da0 legacy=0x7fdefc0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf02306640 1 -- 172.21.15.67:0/3253631144 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc0d5300 con 0x7fdefc0b51d0 2024-09-19T05:37:35.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.593+0000 7fdf00b03640 1 -- 172.21.15.67:0/3253631144 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780021717 0 0) 0x7fdefc0d4d40 con 0x7fdefc161da0 2024-09-19T05:37:35.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf02306640 1 --2- 172.21.15.67:0/3253631144 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0b51d0 0x7fdefc0cf150 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fdefc06caa0 tx=0x7fdef401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2324b97df3d839 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:35.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf00b03640 1 -- 172.21.15.67:0/3253631144 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef40b2070 con 0x7fdefc0b51d0 2024-09-19T05:37:35.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf00b03640 1 -- 172.21.15.67:0/3253631144 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef40a57c0 con 0x7fdefc0b51d0 2024-09-19T05:37:35.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf00b03640 1 -- 172.21.15.67:0/3253631144 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef40a5b90 con 0x7fdefc0b51d0 2024-09-19T05:37:35.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 -- 172.21.15.67:0/3253631144 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0b51d0 msgr2=0x7fdefc0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 --2- 172.21.15.67:0/3253631144 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0b51d0 0x7fdefc0cf150 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fdefc06caa0 tx=0x7fdef401c930 comp rx=0 tx=0).stop 2024-09-19T05:37:35.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 -- 172.21.15.67:0/3253631144 shutdown_connections 2024-09-19T05:37:35.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 --2- 172.21.15.67:0/3253631144 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0b51d0 0x7fdefc0cf150 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 --2- 172.21.15.67:0/3253631144 >> v2:172.21.15.97:3300/0 conn(0x7fdefc0d1590 0x7fdefc0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 -- 172.21.15.67:0/3253631144 >> 172.21.15.67:0/3253631144 conn(0x7fdefc08bfc0 msgr2=0x7fdefc0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:35.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 -- 172.21.15.67:0/3253631144 shutdown_connections 2024-09-19T05:37:35.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 -- 172.21.15.67:0/3253631144 wait complete. 2024-09-19T05:37:35.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 Processor -- start 2024-09-19T05:37:35.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 -- start start 2024-09-19T05:37:35.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdefc0b51d0 0x7fdefc0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0d1590 0x7fdefc157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdefc161da0 0x7fdefc0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc0d0020 con 0x7fdefc0d1590 2024-09-19T05:37:35.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc0cfea0 con 0x7fdefc0b51d0 2024-09-19T05:37:35.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf03d69640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdefc0d01a0 con 0x7fdefc161da0 2024-09-19T05:37:35.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf01304640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0d1590 0x7fdefc157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf01304640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0d1590 0x7fdefc157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41606/0 (socket says 172.21.15.67:41606) 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf01304640 1 -- 172.21.15.67:0/1238405066 learned_addr learned my addr 172.21.15.67:0/1238405066 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf01b05640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdefc0b51d0 0x7fdefc0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf02306640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdefc161da0 0x7fdefc0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf01304640 1 -- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdefc161da0 msgr2=0x7fdefc0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf01304640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdefc161da0 0x7fdefc0b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf01304640 1 -- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdefc0b51d0 msgr2=0x7fdefc0b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf01304640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdefc0b51d0 0x7fdefc0b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf01304640 1 -- 172.21.15.67:0/1238405066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc160090 con 0x7fdefc0d1590 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.597+0000 7fdf01304640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0d1590 0x7fdefc157890 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00d800 tx=0x7fdeec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdef27fc640 1 -- 172.21.15.67:0/1238405066 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec00b6c0 con 0x7fdefc0d1590 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdef27fc640 1 -- 172.21.15.67:0/1238405066 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeec019070 con 0x7fdefc0d1590 2024-09-19T05:37:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdf03d69640 1 -- 172.21.15.67:0/1238405066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdefc0b1bb0 con 0x7fdefc0d1590 2024-09-19T05:37:35.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdef27fc640 1 -- 172.21.15.67:0/1238405066 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec00ba60 con 0x7fdefc0d1590 2024-09-19T05:37:35.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdf03d69640 1 -- 172.21.15.67:0/1238405066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdefc0b2950 con 0x7fdefc0d1590 2024-09-19T05:37:35.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdf03d69640 1 -- 172.21.15.67:0/1238405066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdefc0cf150 con 0x7fdefc0d1590 2024-09-19T05:37:35.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdef27fc640 1 -- 172.21.15.67:0/1238405066 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdeec00bc00 con 0x7fdefc0d1590 2024-09-19T05:37:35.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdef27fc640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdee00678c0 0x7fdee0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdef27fc640 1 -- 172.21.15.67:0/1238405066 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fdeec086250 con 0x7fdefc0d1590 2024-09-19T05:37:35.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdf01b05640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdee00678c0 0x7fdee0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.601+0000 7fdf01b05640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdee00678c0 0x7fdee0069d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdef8000f70 tx=0x7fdef8007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:35.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.605+0000 7fdef27fc640 1 -- 172.21.15.67:0/1238405066 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fdeec056c90 con 0x7fdefc0d1590 2024-09-19T05:37:35.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.765+0000 7fdf03d69640 1 -- 172.21.15.67:0/1238405066 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdefc15c070 con 0x7fdee00678c0 2024-09-19T05:37:35.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdef27fc640 1 -- 172.21.15.67:0/1238405066 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251972 (secure 0 0 0) 0x7fdefc15c070 con 0x7fdee00678c0 2024-09-19T05:37:35.788 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:35.790 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:37:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 -- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdee00678c0 msgr2=0x7fdee0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdee00678c0 0x7fdee0069d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdef8000f70 tx=0x7fdef8007c10 comp rx=0 tx=0).stop 2024-09-19T05:37:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 -- 172.21.15.67:0/1238405066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0d1590 msgr2=0x7fdefc157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0d1590 0x7fdefc157890 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00d800 tx=0x7fdeec00dcc0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 -- 172.21.15.67:0/1238405066 shutdown_connections 2024-09-19T05:37:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdee00678c0 0x7fdee0069d80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdefc161da0 0x7fdefc0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdefc0d1590 0x7fdefc157890 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 --2- 172.21.15.67:0/1238405066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdefc0b51d0 0x7fdefc0b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 -- 172.21.15.67:0/1238405066 >> 172.21.15.67:0/1238405066 conn(0x7fdefc08bfc0 msgr2=0x7fdefc0d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 -- 172.21.15.67:0/1238405066 shutdown_connections 2024-09-19T05:37:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.785+0000 7fdf03d69640 1 -- 172.21.15.67:0/1238405066 wait complete. 2024-09-19T05:37:35.807 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-09-19T05:37:35.198103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":354212,"kb_used_data":7528,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754620508,"statfs":{"total":773094113280,"available":772731400192,"internally_reserved":0,"allocated":7708672,"data_stored":4115036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.861586"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391610+0000","last_change":"2024-09-19T05:37:31.411276+0000","last_active":"2024-09-19T05:37:32.391610+0000","last_peered":"2024-09-19T05:37:32.391610+0000","last_clean":"2024-09-19T05:37:32.391610+0000","last_became_active":"2024-09-19T05:37:31.410981+0000","last_became_peered":"2024-09-19T05:37:31.410981+0000","last_unstale":"2024-09-19T05:37:32.391610+0000","last_undegraded":"2024-09-19T05:37:32.391610+0000","last_fullsized":"2024-09-19T05:37:32.391610+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:08.627419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.390772+0000","last_change":"2024-09-19T05:37:31.389237+0000","last_active":"2024-09-19T05:37:32.390772+0000","last_peered":"2024-09-19T05:37:32.390772+0000","last_clean":"2024-09-19T05:37:32.390772+0000","last_became_active":"2024-09-19T05:37:31.387614+0000","last_became_peered":"2024-09-19T05:37:31.387614+0000","last_unstale":"2024-09-19T05:37:32.390772+0000","last_undegraded":"2024-09-19T05:37:32.390772+0000","last_fullsized":"2024-09-19T05:37:32.390772+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:42.226370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.429497+0000","last_change":"2024-09-19T05:37:31.395559+0000","last_active":"2024-09-19T05:37:31.429497+0000","last_peered":"2024-09-19T05:37:31.429497+0000","last_clean":"2024-09-19T05:37:31.429497+0000","last_became_active":"2024-09-19T05:37:31.394788+0000","last_became_peered":"2024-09-19T05:37:31.394788+0000","last_unstale":"2024-09-19T05:37:31.429497+0000","last_undegraded":"2024-09-19T05:37:31.429497+0000","last_fullsized":"2024-09-19T05:37:31.429497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:25.223185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.399131+0000","last_change":"2024-09-19T05:37:31.384834+0000","last_active":"2024-09-19T05:37:31.399131+0000","last_peered":"2024-09-19T05:37:31.399131+0000","last_clean":"2024-09-19T05:37:31.399131+0000","last_became_active":"2024-09-19T05:37:31.384062+0000","last_became_peered":"2024-09-19T05:37:31.384062+0000","last_unstale":"2024-09-19T05:37:31.399131+0000","last_undegraded":"2024-09-19T05:37:31.399131+0000","last_fullsized":"2024-09-19T05:37:31.399131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:48.988147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391772+0000","last_change":"2024-09-19T05:37:31.433319+0000","last_active":"2024-09-19T05:37:32.391772+0000","last_peered":"2024-09-19T05:37:32.391772+0000","last_clean":"2024-09-19T05:37:32.391772+0000","last_became_active":"2024-09-19T05:37:31.433030+0000","last_became_peered":"2024-09-19T05:37:31.433030+0000","last_unstale":"2024-09-19T05:37:32.391772+0000","last_undegraded":"2024-09-19T05:37:32.391772+0000","last_fullsized":"2024-09-19T05:37:32.391772+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:10.187890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.422659+0000","last_change":"2024-09-19T05:37:31.422045+0000","last_active":"2024-09-19T05:37:31.422659+0000","last_peered":"2024-09-19T05:37:31.422659+0000","last_clean":"2024-09-19T05:37:31.422659+0000","last_became_active":"2024-09-19T05:37:31.421498+0000","last_became_peered":"2024-09-19T05:37:31.421498+0000","last_unstale":"2024-09-19T05:37:31.422659+0000","last_undegraded":"2024-09-19T05:37:31.422659+0000","last_fullsized":"2024-09-19T05:37:31.422659+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:53.774423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.431427+0000","last_change":"2024-09-19T05:37:31.430904+0000","last_active":"2024-09-19T05:37:31.431427+0000","last_peered":"2024-09-19T05:37:31.431427+0000","last_clean":"2024-09-19T05:37:31.431427+0000","last_became_active":"2024-09-19T05:37:31.430596+0000","last_became_peered":"2024-09-19T05:37:31.430596+0000","last_unstale":"2024-09-19T05:37:31.431427+0000","last_undegraded":"2024-09-19T05:37:31.431427+0000","last_fullsized":"2024-09-19T05:37:31.431427+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:53.305455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.425664+0000","last_change":"2024-09-19T05:37:31.423857+0000","last_active":"2024-09-19T05:37:31.425664+0000","last_peered":"2024-09-19T05:37:31.425664+0000","last_clean":"2024-09-19T05:37:31.425664+0000","last_became_active":"2024-09-19T05:37:31.423298+0000","last_became_peered":"2024-09-19T05:37:31.423298+0000","last_unstale":"2024-09-19T05:37:31.425664+0000","last_undegraded":"2024-09-19T05:37:31.425664+0000","last_fullsized":"2024-09-19T05:37:31.425664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:09.116902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.436023+0000","last_change":"2024-09-19T05:37:31.405426+0000","last_active":"2024-09-19T05:37:31.436023+0000","last_peered":"2024-09-19T05:37:31.436023+0000","last_clean":"2024-09-19T05:37:31.436023+0000","last_became_active":"2024-09-19T05:37:31.404650+0000","last_became_peered":"2024-09-19T05:37:31.404650+0000","last_unstale":"2024-09-19T05:37:31.436023+0000","last_undegraded":"2024-09-19T05:37:31.436023+0000","last_fullsized":"2024-09-19T05:37:31.436023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:00.186736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.429673+0000","last_change":"2024-09-19T05:37:31.414439+0000","last_active":"2024-09-19T05:37:31.429673+0000","last_peered":"2024-09-19T05:37:31.429673+0000","last_clean":"2024-09-19T05:37:31.429673+0000","last_became_active":"2024-09-19T05:37:31.405640+0000","last_became_peered":"2024-09-19T05:37:31.405640+0000","last_unstale":"2024-09-19T05:37:31.429673+0000","last_undegraded":"2024-09-19T05:37:31.429673+0000","last_fullsized":"2024-09-19T05:37:31.429673+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:37.344826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.412785+0000","last_change":"2024-09-19T05:37:31.395373+0000","last_active":"2024-09-19T05:37:31.412785+0000","last_peered":"2024-09-19T05:37:31.412785+0000","last_clean":"2024-09-19T05:37:31.412785+0000","last_became_active":"2024-09-19T05:37:31.394646+0000","last_became_peered":"2024-09-19T05:37:31.394646+0000","last_unstale":"2024-09-19T05:37:31.412785+0000","last_undegraded":"2024-09-19T05:37:31.412785+0000","last_fullsized":"2024-09-19T05:37:31.412785+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:39.443694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.426233+0000","last_change":"2024-09-19T05:37:31.425503+0000","last_active":"2024-09-19T05:37:31.426233+0000","last_peered":"2024-09-19T05:37:31.426233+0000","last_clean":"2024-09-19T05:37:31.426233+0000","last_became_active":"2024-09-19T05:37:31.424929+0000","last_became_peered":"2024-09-19T05:37:31.424929+0000","last_unstale":"2024-09-19T05:37:31.426233+0000","last_undegraded":"2024-09-19T05:37:31.426233+0000","last_fullsized":"2024-09-19T05:37:31.426233+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:58.697351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.418949+0000","last_change":"2024-09-19T05:37:31.410462+0000","last_active":"2024-09-19T05:37:31.418949+0000","last_peered":"2024-09-19T05:37:31.418949+0000","last_clean":"2024-09-19T05:37:31.418949+0000","last_became_active":"2024-09-19T05:37:31.408862+0000","last_became_peered":"2024-09-19T05:37:31.408862+0000","last_unstale":"2024-09-19T05:37:31.418949+0000","last_undegraded":"2024-09-19T05:37:31.418949+0000","last_fullsized":"2024-09-19T05:37:31.418949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.589463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.435431+0000","last_change":"2024-09-19T05:37:31.421708+0000","last_active":"2024-09-19T05:37:31.435431+0000","last_peered":"2024-09-19T05:37:31.435431+0000","last_clean":"2024-09-19T05:37:31.435431+0000","last_became_active":"2024-09-19T05:37:31.420994+0000","last_became_peered":"2024-09-19T05:37:31.420994+0000","last_unstale":"2024-09-19T05:37:31.435431+0000","last_undegraded":"2024-09-19T05:37:31.435431+0000","last_fullsized":"2024-09-19T05:37:31.435431+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:21.942029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.429849+0000","last_change":"2024-09-19T05:37:31.414670+0000","last_active":"2024-09-19T05:37:31.429849+0000","last_peered":"2024-09-19T05:37:31.429849+0000","last_clean":"2024-09-19T05:37:31.429849+0000","last_became_active":"2024-09-19T05:37:31.413675+0000","last_became_peered":"2024-09-19T05:37:31.413675+0000","last_unstale":"2024-09-19T05:37:31.429849+0000","last_undegraded":"2024-09-19T05:37:31.429849+0000","last_fullsized":"2024-09-19T05:37:31.429849+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:18.780955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.413839+0000","last_change":"2024-09-19T05:37:31.412825+0000","last_active":"2024-09-19T05:37:31.413839+0000","last_peered":"2024-09-19T05:37:31.413839+0000","last_clean":"2024-09-19T05:37:31.413839+0000","last_became_active":"2024-09-19T05:37:31.412482+0000","last_became_peered":"2024-09-19T05:37:31.412482+0000","last_unstale":"2024-09-19T05:37:31.413839+0000","last_undegraded":"2024-09-19T05:37:31.413839+0000","last_fullsized":"2024-09-19T05:37:31.413839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:40.135863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391956+0000","last_change":"2024-09-19T05:37:31.413156+0000","last_active":"2024-09-19T05:37:32.391956+0000","last_peered":"2024-09-19T05:37:32.391956+0000","last_clean":"2024-09-19T05:37:32.391956+0000","last_became_active":"2024-09-19T05:37:31.412820+0000","last_became_peered":"2024-09-19T05:37:31.412820+0000","last_unstale":"2024-09-19T05:37:32.391956+0000","last_undegraded":"2024-09-19T05:37:32.391956+0000","last_fullsized":"2024-09-19T05:37:32.391956+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:25.223185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.399256+0000","last_change":"2024-09-19T05:37:31.384911+0000","last_active":"2024-09-19T05:37:31.399256+0000","last_peered":"2024-09-19T05:37:31.399256+0000","last_clean":"2024-09-19T05:37:31.399256+0000","last_became_active":"2024-09-19T05:37:31.384239+0000","last_became_peered":"2024-09-19T05:37:31.384239+0000","last_unstale":"2024-09-19T05:37:31.399256+0000","last_undegraded":"2024-09-19T05:37:31.399256+0000","last_fullsized":"2024-09-19T05:37:31.399256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:12.890473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392061+0000","last_change":"2024-09-19T05:37:31.432416+0000","last_active":"2024-09-19T05:37:32.392061+0000","last_peered":"2024-09-19T05:37:32.392061+0000","last_clean":"2024-09-19T05:37:32.392061+0000","last_became_active":"2024-09-19T05:37:31.426492+0000","last_became_peered":"2024-09-19T05:37:31.426492+0000","last_unstale":"2024-09-19T05:37:32.392061+0000","last_undegraded":"2024-09-19T05:37:32.392061+0000","last_fullsized":"2024-09-19T05:37:32.392061+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:39.238427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.434604+0000","last_change":"2024-09-19T05:37:31.434146+0000","last_active":"2024-09-19T05:37:31.434604+0000","last_peered":"2024-09-19T05:37:31.434604+0000","last_clean":"2024-09-19T05:37:31.434604+0000","last_became_active":"2024-09-19T05:37:31.433777+0000","last_became_peered":"2024-09-19T05:37:31.433777+0000","last_unstale":"2024-09-19T05:37:31.434604+0000","last_undegraded":"2024-09-19T05:37:31.434604+0000","last_fullsized":"2024-09-19T05:37:31.434604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:34:51.303478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.411903+0000","last_change":"2024-09-19T05:37:31.398068+0000","last_active":"2024-09-19T05:37:31.411903+0000","last_peered":"2024-09-19T05:37:31.411903+0000","last_clean":"2024-09-19T05:37:31.411903+0000","last_became_active":"2024-09-19T05:37:31.397240+0000","last_became_peered":"2024-09-19T05:37:31.397240+0000","last_unstale":"2024-09-19T05:37:31.411903+0000","last_undegraded":"2024-09-19T05:37:31.411903+0000","last_fullsized":"2024-09-19T05:37:31.411903+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:15.213142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.423904+0000","last_change":"2024-09-19T05:37:31.423466+0000","last_active":"2024-09-19T05:37:31.423904+0000","last_peered":"2024-09-19T05:37:31.423904+0000","last_clean":"2024-09-19T05:37:31.423904+0000","last_became_active":"2024-09-19T05:37:31.423122+0000","last_became_peered":"2024-09-19T05:37:31.423122+0000","last_unstale":"2024-09-19T05:37:31.423904+0000","last_undegraded":"2024-09-19T05:37:31.423904+0000","last_fullsized":"2024-09-19T05:37:31.423904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:16.588747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.422744+0000","last_change":"2024-09-19T05:37:31.422332+0000","last_active":"2024-09-19T05:37:31.422744+0000","last_peered":"2024-09-19T05:37:31.422744+0000","last_clean":"2024-09-19T05:37:31.422744+0000","last_became_active":"2024-09-19T05:37:31.421967+0000","last_became_peered":"2024-09-19T05:37:31.421967+0000","last_unstale":"2024-09-19T05:37:31.422744+0000","last_undegraded":"2024-09-19T05:37:31.422744+0000","last_fullsized":"2024-09-19T05:37:31.422744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:11:35.081844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.435244+0000","last_change":"2024-09-19T05:37:31.422613+0000","last_active":"2024-09-19T05:37:31.435244+0000","last_peered":"2024-09-19T05:37:31.435244+0000","last_clean":"2024-09-19T05:37:31.435244+0000","last_became_active":"2024-09-19T05:37:31.422057+0000","last_became_peered":"2024-09-19T05:37:31.422057+0000","last_unstale":"2024-09-19T05:37:31.435244+0000","last_undegraded":"2024-09-19T05:37:31.435244+0000","last_fullsized":"2024-09-19T05:37:31.435244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:49.435662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.411943+0000","last_change":"2024-09-19T05:37:31.398151+0000","last_active":"2024-09-19T05:37:31.411943+0000","last_peered":"2024-09-19T05:37:31.411943+0000","last_clean":"2024-09-19T05:37:31.411943+0000","last_became_active":"2024-09-19T05:37:31.397466+0000","last_became_peered":"2024-09-19T05:37:31.397466+0000","last_unstale":"2024-09-19T05:37:31.411943+0000","last_undegraded":"2024-09-19T05:37:31.411943+0000","last_fullsized":"2024-09-19T05:37:31.411943+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:12.672017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.419237+0000","last_change":"2024-09-19T05:37:31.397383+0000","last_active":"2024-09-19T05:37:31.419237+0000","last_peered":"2024-09-19T05:37:31.419237+0000","last_clean":"2024-09-19T05:37:31.419237+0000","last_became_active":"2024-09-19T05:37:31.396695+0000","last_became_peered":"2024-09-19T05:37:31.396695+0000","last_unstale":"2024-09-19T05:37:31.419237+0000","last_undegraded":"2024-09-19T05:37:31.419237+0000","last_fullsized":"2024-09-19T05:37:31.419237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:45.056920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.417940+0000","last_change":"2024-09-19T05:37:31.399893+0000","last_active":"2024-09-19T05:37:31.417940+0000","last_peered":"2024-09-19T05:37:31.417940+0000","last_clean":"2024-09-19T05:37:31.417940+0000","last_became_active":"2024-09-19T05:37:31.399108+0000","last_became_peered":"2024-09-19T05:37:31.399108+0000","last_unstale":"2024-09-19T05:37:31.417940+0000","last_undegraded":"2024-09-19T05:37:31.417940+0000","last_fullsized":"2024-09-19T05:37:31.417940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:01.191661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.390638+0000","last_change":"2024-09-19T05:37:31.433997+0000","last_active":"2024-09-19T05:37:32.390638+0000","last_peered":"2024-09-19T05:37:32.390638+0000","last_clean":"2024-09-19T05:37:32.390638+0000","last_became_active":"2024-09-19T05:37:31.433706+0000","last_became_peered":"2024-09-19T05:37:31.433706+0000","last_unstale":"2024-09-19T05:37:32.390638+0000","last_undegraded":"2024-09-19T05:37:32.390638+0000","last_fullsized":"2024-09-19T05:37:32.390638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:53.207347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.433781+0000","last_change":"2024-09-19T05:37:31.405355+0000","last_active":"2024-09-19T05:37:31.433781+0000","last_peered":"2024-09-19T05:37:31.433781+0000","last_clean":"2024-09-19T05:37:31.433781+0000","last_became_active":"2024-09-19T05:37:31.403761+0000","last_became_peered":"2024-09-19T05:37:31.403761+0000","last_unstale":"2024-09-19T05:37:31.433781+0000","last_undegraded":"2024-09-19T05:37:31.433781+0000","last_fullsized":"2024-09-19T05:37:31.433781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:58.741197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.432915+0000","last_change":"2024-09-19T05:37:31.431770+0000","last_active":"2024-09-19T05:37:31.432915+0000","last_peered":"2024-09-19T05:37:31.432915+0000","last_clean":"2024-09-19T05:37:31.432915+0000","last_became_active":"2024-09-19T05:37:31.431448+0000","last_became_peered":"2024-09-19T05:37:31.431448+0000","last_unstale":"2024-09-19T05:37:31.432915+0000","last_undegraded":"2024-09-19T05:37:31.432915+0000","last_fullsized":"2024-09-19T05:37:31.432915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:28.367857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.412247+0000","last_change":"2024-09-19T05:37:31.394386+0000","last_active":"2024-09-19T05:37:31.412247+0000","last_peered":"2024-09-19T05:37:31.412247+0000","last_clean":"2024-09-19T05:37:31.412247+0000","last_became_active":"2024-09-19T05:37:31.393700+0000","last_became_peered":"2024-09-19T05:37:31.393700+0000","last_unstale":"2024-09-19T05:37:31.412247+0000","last_undegraded":"2024-09-19T05:37:31.412247+0000","last_fullsized":"2024-09-19T05:37:31.412247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:42.277101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.399985+0000","last_change":"2024-09-19T05:37:31.393591+0000","last_active":"2024-09-19T05:37:31.399985+0000","last_peered":"2024-09-19T05:37:31.399985+0000","last_clean":"2024-09-19T05:37:31.399985+0000","last_became_active":"2024-09-19T05:37:31.393273+0000","last_became_peered":"2024-09-19T05:37:31.393273+0000","last_unstale":"2024-09-19T05:37:31.399985+0000","last_undegraded":"2024-09-19T05:37:31.399985+0000","last_fullsized":"2024-09-19T05:37:31.399985+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:22.020891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392062+0000","last_change":"2024-09-19T05:37:31.428345+0000","last_active":"2024-09-19T05:37:32.392062+0000","last_peered":"2024-09-19T05:37:32.392062+0000","last_clean":"2024-09-19T05:37:32.392062+0000","last_became_active":"2024-09-19T05:37:31.416105+0000","last_became_peered":"2024-09-19T05:37:31.416105+0000","last_unstale":"2024-09-19T05:37:32.392062+0000","last_undegraded":"2024-09-19T05:37:32.392062+0000","last_fullsized":"2024-09-19T05:37:32.392062+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:09.173425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"67'4","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391911+0000","last_change":"2024-09-19T05:37:30.383112+0000","last_active":"2024-09-19T05:37:32.391911+0000","last_peered":"2024-09-19T05:37:32.391911+0000","last_clean":"2024-09-19T05:37:32.391911+0000","last_became_active":"2024-09-19T05:37:30.382747+0000","last_became_peered":"2024-09-19T05:37:30.382747+0000","last_unstale":"2024-09-19T05:37:32.391911+0000","last_undegraded":"2024-09-19T05:37:32.391911+0000","last_fullsized":"2024-09-19T05:37:32.391911+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:40.991616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.437182+0000","last_change":"2024-09-19T05:37:31.436023+0000","last_active":"2024-09-19T05:37:31.437182+0000","last_peered":"2024-09-19T05:37:31.437182+0000","last_clean":"2024-09-19T05:37:31.437182+0000","last_became_active":"2024-09-19T05:37:31.435403+0000","last_became_peered":"2024-09-19T05:37:31.435403+0000","last_unstale":"2024-09-19T05:37:31.437182+0000","last_undegraded":"2024-09-19T05:37:31.437182+0000","last_fullsized":"2024-09-19T05:37:31.437182+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:49.587406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.436725+0000","last_change":"2024-09-19T05:37:30.369992+0000","last_active":"2024-09-19T05:37:31.436725+0000","last_peered":"2024-09-19T05:37:31.436725+0000","last_clean":"2024-09-19T05:37:31.436725+0000","last_became_active":"2024-09-19T05:37:30.369599+0000","last_became_peered":"2024-09-19T05:37:30.369599+0000","last_unstale":"2024-09-19T05:37:31.436725+0000","last_undegraded":"2024-09-19T05:37:31.436725+0000","last_fullsized":"2024-09-19T05:37:31.436725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:59.174225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.399912+0000","last_change":"2024-09-19T05:37:31.395076+0000","last_active":"2024-09-19T05:37:31.399912+0000","last_peered":"2024-09-19T05:37:31.399912+0000","last_clean":"2024-09-19T05:37:31.399912+0000","last_became_active":"2024-09-19T05:37:31.392658+0000","last_became_peered":"2024-09-19T05:37:31.392658+0000","last_unstale":"2024-09-19T05:37:31.399912+0000","last_undegraded":"2024-09-19T05:37:31.399912+0000","last_fullsized":"2024-09-19T05:37:31.399912+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:59.695499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.413291+0000","last_change":"2024-09-19T05:37:30.386122+0000","last_active":"2024-09-19T05:37:31.413291+0000","last_peered":"2024-09-19T05:37:31.413291+0000","last_clean":"2024-09-19T05:37:31.413291+0000","last_became_active":"2024-09-19T05:37:30.385867+0000","last_became_peered":"2024-09-19T05:37:30.385867+0000","last_unstale":"2024-09-19T05:37:31.413291+0000","last_undegraded":"2024-09-19T05:37:31.413291+0000","last_fullsized":"2024-09-19T05:37:31.413291+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:57.728685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.428659+0000","last_change":"2024-09-19T05:37:31.404751+0000","last_active":"2024-09-19T05:37:31.428659+0000","last_peered":"2024-09-19T05:37:31.428659+0000","last_clean":"2024-09-19T05:37:31.428659+0000","last_became_active":"2024-09-19T05:37:31.403462+0000","last_became_peered":"2024-09-19T05:37:31.403462+0000","last_unstale":"2024-09-19T05:37:31.428659+0000","last_undegraded":"2024-09-19T05:37:31.428659+0000","last_fullsized":"2024-09-19T05:37:31.428659+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:47.800609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.407290+0000","last_change":"2024-09-19T05:37:30.363647+0000","last_active":"2024-09-19T05:37:31.407290+0000","last_peered":"2024-09-19T05:37:31.407290+0000","last_clean":"2024-09-19T05:37:31.407290+0000","last_became_active":"2024-09-19T05:37:30.363242+0000","last_became_peered":"2024-09-19T05:37:30.363242+0000","last_unstale":"2024-09-19T05:37:31.407290+0000","last_undegraded":"2024-09-19T05:37:31.407290+0000","last_fullsized":"2024-09-19T05:37:31.407290+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:48.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.397761+0000","last_change":"2024-09-19T05:37:31.396864+0000","last_active":"2024-09-19T05:37:31.397761+0000","last_peered":"2024-09-19T05:37:31.397761+0000","last_clean":"2024-09-19T05:37:31.397761+0000","last_became_active":"2024-09-19T05:37:31.396393+0000","last_became_peered":"2024-09-19T05:37:31.396393+0000","last_unstale":"2024-09-19T05:37:31.397761+0000","last_undegraded":"2024-09-19T05:37:31.397761+0000","last_fullsized":"2024-09-19T05:37:31.397761+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:08.295964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.406849+0000","last_change":"2024-09-19T05:37:30.351790+0000","last_active":"2024-09-19T05:37:31.406849+0000","last_peered":"2024-09-19T05:37:31.406849+0000","last_clean":"2024-09-19T05:37:31.406849+0000","last_became_active":"2024-09-19T05:37:30.351391+0000","last_became_peered":"2024-09-19T05:37:30.351391+0000","last_unstale":"2024-09-19T05:37:31.406849+0000","last_undegraded":"2024-09-19T05:37:31.406849+0000","last_fullsized":"2024-09-19T05:37:31.406849+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:31.602693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.390201+0000","last_change":"2024-09-19T05:37:31.401655+0000","last_active":"2024-09-19T05:37:32.390201+0000","last_peered":"2024-09-19T05:37:32.390201+0000","last_clean":"2024-09-19T05:37:32.390201+0000","last_became_active":"2024-09-19T05:37:31.401347+0000","last_became_peered":"2024-09-19T05:37:31.401347+0000","last_unstale":"2024-09-19T05:37:32.390201+0000","last_undegraded":"2024-09-19T05:37:32.390201+0000","last_fullsized":"2024-09-19T05:37:32.390201+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:23.570887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.406089+0000","last_change":"2024-09-19T05:37:30.358619+0000","last_active":"2024-09-19T05:37:31.406089+0000","last_peered":"2024-09-19T05:37:31.406089+0000","last_clean":"2024-09-19T05:37:31.406089+0000","last_became_active":"2024-09-19T05:37:30.357838+0000","last_became_peered":"2024-09-19T05:37:30.357838+0000","last_unstale":"2024-09-19T05:37:31.406089+0000","last_undegraded":"2024-09-19T05:37:31.406089+0000","last_fullsized":"2024-09-19T05:37:31.406089+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:12.274443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391229+0000","last_change":"2024-09-19T05:37:31.436843+0000","last_active":"2024-09-19T05:37:32.391229+0000","last_peered":"2024-09-19T05:37:32.391229+0000","last_clean":"2024-09-19T05:37:32.391229+0000","last_became_active":"2024-09-19T05:37:31.433571+0000","last_became_peered":"2024-09-19T05:37:31.433571+0000","last_unstale":"2024-09-19T05:37:32.391229+0000","last_undegraded":"2024-09-19T05:37:32.391229+0000","last_fullsized":"2024-09-19T05:37:32.391229+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:42.004128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.377966+0000","last_change":"2024-09-19T05:37:30.371839+0000","last_active":"2024-09-19T05:37:31.377966+0000","last_peered":"2024-09-19T05:37:31.377966+0000","last_clean":"2024-09-19T05:37:31.377966+0000","last_became_active":"2024-09-19T05:37:30.371416+0000","last_became_peered":"2024-09-19T05:37:30.371416+0000","last_unstale":"2024-09-19T05:37:31.377966+0000","last_undegraded":"2024-09-19T05:37:31.377966+0000","last_fullsized":"2024-09-19T05:37:31.377966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:52.761912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.402307+0000","last_change":"2024-09-19T05:37:31.400763+0000","last_active":"2024-09-19T05:37:31.402307+0000","last_peered":"2024-09-19T05:37:31.402307+0000","last_clean":"2024-09-19T05:37:31.402307+0000","last_became_active":"2024-09-19T05:37:31.400418+0000","last_became_peered":"2024-09-19T05:37:31.400418+0000","last_unstale":"2024-09-19T05:37:31.402307+0000","last_undegraded":"2024-09-19T05:37:31.402307+0000","last_fullsized":"2024-09-19T05:37:31.402307+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:17.924240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391062+0000","last_change":"2024-09-19T05:37:30.378938+0000","last_active":"2024-09-19T05:37:32.391062+0000","last_peered":"2024-09-19T05:37:32.391062+0000","last_clean":"2024-09-19T05:37:32.391062+0000","last_became_active":"2024-09-19T05:37:30.372545+0000","last_became_peered":"2024-09-19T05:37:30.372545+0000","last_unstale":"2024-09-19T05:37:32.391062+0000","last_undegraded":"2024-09-19T05:37:32.391062+0000","last_fullsized":"2024-09-19T05:37:32.391062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:14.802345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391051+0000","last_change":"2024-09-19T05:37:31.393639+0000","last_active":"2024-09-19T05:37:32.391051+0000","last_peered":"2024-09-19T05:37:32.391051+0000","last_clean":"2024-09-19T05:37:32.391051+0000","last_became_active":"2024-09-19T05:37:31.393262+0000","last_became_peered":"2024-09-19T05:37:31.393262+0000","last_unstale":"2024-09-19T05:37:32.391051+0000","last_undegraded":"2024-09-19T05:37:32.391051+0000","last_fullsized":"2024-09-19T05:37:32.391051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:38.689559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.379447+0000","last_change":"2024-09-19T05:37:30.390106+0000","last_active":"2024-09-19T05:37:31.379447+0000","last_peered":"2024-09-19T05:37:31.379447+0000","last_clean":"2024-09-19T05:37:31.379447+0000","last_became_active":"2024-09-19T05:37:30.386482+0000","last_became_peered":"2024-09-19T05:37:30.386482+0000","last_unstale":"2024-09-19T05:37:31.379447+0000","last_undegraded":"2024-09-19T05:37:31.379447+0000","last_fullsized":"2024-09-19T05:37:31.379447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:52.194835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.402271+0000","last_change":"2024-09-19T05:37:31.401366+0000","last_active":"2024-09-19T05:37:31.402271+0000","last_peered":"2024-09-19T05:37:31.402271+0000","last_clean":"2024-09-19T05:37:31.402271+0000","last_became_active":"2024-09-19T05:37:31.400061+0000","last_became_peered":"2024-09-19T05:37:31.400061+0000","last_unstale":"2024-09-19T05:37:31.402271+0000","last_undegraded":"2024-09-19T05:37:31.402271+0000","last_fullsized":"2024-09-19T05:37:31.402271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:58.065255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.373225+0000","last_change":"2024-09-19T05:37:30.373005+0000","last_active":"2024-09-19T05:37:31.373225+0000","last_peered":"2024-09-19T05:37:31.373225+0000","last_clean":"2024-09-19T05:37:31.373225+0000","last_became_active":"2024-09-19T05:37:30.370608+0000","last_became_peered":"2024-09-19T05:37:30.370608+0000","last_unstale":"2024-09-19T05:37:31.373225+0000","last_undegraded":"2024-09-19T05:37:31.373225+0000","last_fullsized":"2024-09-19T05:37:31.373225+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:53.530327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392811+0000","last_change":"2024-09-19T05:37:31.432418+0000","last_active":"2024-09-19T05:37:32.392811+0000","last_peered":"2024-09-19T05:37:32.392811+0000","last_clean":"2024-09-19T05:37:32.392811+0000","last_became_active":"2024-09-19T05:37:31.426534+0000","last_became_peered":"2024-09-19T05:37:31.426534+0000","last_unstale":"2024-09-19T05:37:32.392811+0000","last_undegraded":"2024-09-19T05:37:32.392811+0000","last_fullsized":"2024-09-19T05:37:32.392811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:15.641680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"67'3","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.436728+0000","last_change":"2024-09-19T05:37:30.379336+0000","last_active":"2024-09-19T05:37:31.436728+0000","last_peered":"2024-09-19T05:37:31.436728+0000","last_clean":"2024-09-19T05:37:31.436728+0000","last_became_active":"2024-09-19T05:37:30.378196+0000","last_became_peered":"2024-09-19T05:37:30.378196+0000","last_unstale":"2024-09-19T05:37:31.436728+0000","last_undegraded":"2024-09-19T05:37:31.436728+0000","last_fullsized":"2024-09-19T05:37:31.436728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:22.558376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.412235+0000","last_change":"2024-09-19T05:37:31.392579+0000","last_active":"2024-09-19T05:37:31.412235+0000","last_peered":"2024-09-19T05:37:31.412235+0000","last_clean":"2024-09-19T05:37:31.412235+0000","last_became_active":"2024-09-19T05:37:31.391896+0000","last_became_peered":"2024-09-19T05:37:31.391896+0000","last_unstale":"2024-09-19T05:37:31.412235+0000","last_undegraded":"2024-09-19T05:37:31.412235+0000","last_fullsized":"2024-09-19T05:37:31.412235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:56.733693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"67'6","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391499+0000","last_change":"2024-09-19T05:37:30.377494+0000","last_active":"2024-09-19T05:37:32.391499+0000","last_peered":"2024-09-19T05:37:32.391499+0000","last_clean":"2024-09-19T05:37:32.391499+0000","last_became_active":"2024-09-19T05:37:30.377030+0000","last_became_peered":"2024-09-19T05:37:30.377030+0000","last_unstale":"2024-09-19T05:37:32.391499+0000","last_undegraded":"2024-09-19T05:37:32.391499+0000","last_fullsized":"2024-09-19T05:37:32.391499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:18.308803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.423152+0000","last_change":"2024-09-19T05:37:31.417536+0000","last_active":"2024-09-19T05:37:31.423152+0000","last_peered":"2024-09-19T05:37:31.423152+0000","last_clean":"2024-09-19T05:37:31.423152+0000","last_became_active":"2024-09-19T05:37:31.416810+0000","last_became_peered":"2024-09-19T05:37:31.416810+0000","last_unstale":"2024-09-19T05:37:31.423152+0000","last_undegraded":"2024-09-19T05:37:31.423152+0000","last_fullsized":"2024-09-19T05:37:31.423152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:01.313011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.435660+0000","last_change":"2024-09-19T05:37:30.383867+0000","last_active":"2024-09-19T05:37:31.435660+0000","last_peered":"2024-09-19T05:37:31.435660+0000","last_clean":"2024-09-19T05:37:31.435660+0000","last_became_active":"2024-09-19T05:37:30.383137+0000","last_became_peered":"2024-09-19T05:37:30.383137+0000","last_unstale":"2024-09-19T05:37:31.435660+0000","last_undegraded":"2024-09-19T05:37:31.435660+0000","last_fullsized":"2024-09-19T05:37:31.435660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:29.708428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.419079+0000","last_change":"2024-09-19T05:37:31.407839+0000","last_active":"2024-09-19T05:37:31.419079+0000","last_peered":"2024-09-19T05:37:31.419079+0000","last_clean":"2024-09-19T05:37:31.419079+0000","last_became_active":"2024-09-19T05:37:31.395091+0000","last_became_peered":"2024-09-19T05:37:31.395091+0000","last_unstale":"2024-09-19T05:37:31.419079+0000","last_undegraded":"2024-09-19T05:37:31.419079+0000","last_fullsized":"2024-09-19T05:37:31.419079+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:08.105251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.382977+0000","last_change":"2024-09-19T05:37:30.375892+0000","last_active":"2024-09-19T05:37:31.382977+0000","last_peered":"2024-09-19T05:37:31.382977+0000","last_clean":"2024-09-19T05:37:31.382977+0000","last_became_active":"2024-09-19T05:37:30.373898+0000","last_became_peered":"2024-09-19T05:37:30.373898+0000","last_unstale":"2024-09-19T05:37:31.382977+0000","last_undegraded":"2024-09-19T05:37:31.382977+0000","last_fullsized":"2024-09-19T05:37:31.382977+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:51.664270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391241+0000","last_change":"2024-09-19T05:37:31.434079+0000","last_active":"2024-09-19T05:37:32.391241+0000","last_peered":"2024-09-19T05:37:32.391241+0000","last_clean":"2024-09-19T05:37:32.391241+0000","last_became_active":"2024-09-19T05:37:31.432978+0000","last_became_peered":"2024-09-19T05:37:31.432978+0000","last_unstale":"2024-09-19T05:37:32.391241+0000","last_undegraded":"2024-09-19T05:37:32.391241+0000","last_fullsized":"2024-09-19T05:37:32.391241+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:19.321315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.393176+0000","last_change":"2024-09-19T05:37:30.389864+0000","last_active":"2024-09-19T05:37:31.393176+0000","last_peered":"2024-09-19T05:37:31.393176+0000","last_clean":"2024-09-19T05:37:31.393176+0000","last_became_active":"2024-09-19T05:37:30.386910+0000","last_became_peered":"2024-09-19T05:37:30.386910+0000","last_unstale":"2024-09-19T05:37:31.393176+0000","last_undegraded":"2024-09-19T05:37:31.393176+0000","last_fullsized":"2024-09-19T05:37:31.393176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:37.677047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391046+0000","last_change":"2024-09-19T05:37:31.431021+0000","last_active":"2024-09-19T05:37:32.391046+0000","last_peered":"2024-09-19T05:37:32.391046+0000","last_clean":"2024-09-19T05:37:32.391046+0000","last_became_active":"2024-09-19T05:37:31.430697+0000","last_became_peered":"2024-09-19T05:37:31.430697+0000","last_unstale":"2024-09-19T05:37:32.391046+0000","last_undegraded":"2024-09-19T05:37:32.391046+0000","last_fullsized":"2024-09-19T05:37:32.391046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:13.278748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"67'8","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.440460+0000","last_change":"2024-09-19T05:37:30.368079+0000","last_active":"2024-09-19T05:37:31.440460+0000","last_peered":"2024-09-19T05:37:31.440460+0000","last_clean":"2024-09-19T05:37:31.440460+0000","last_became_active":"2024-09-19T05:37:30.367222+0000","last_became_peered":"2024-09-19T05:37:30.367222+0000","last_unstale":"2024-09-19T05:37:31.440460+0000","last_undegraded":"2024-09-19T05:37:31.440460+0000","last_fullsized":"2024-09-19T05:37:31.440460+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:28.799396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.429625+0000","last_change":"2024-09-19T05:37:31.405096+0000","last_active":"2024-09-19T05:37:31.429625+0000","last_peered":"2024-09-19T05:37:31.429625+0000","last_clean":"2024-09-19T05:37:31.429625+0000","last_became_active":"2024-09-19T05:37:31.403488+0000","last_became_peered":"2024-09-19T05:37:31.403488+0000","last_unstale":"2024-09-19T05:37:31.429625+0000","last_undegraded":"2024-09-19T05:37:31.429625+0000","last_fullsized":"2024-09-19T05:37:31.429625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:39.486455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.424629+0000","last_change":"2024-09-19T05:37:30.374685+0000","last_active":"2024-09-19T05:37:31.424629+0000","last_peered":"2024-09-19T05:37:31.424629+0000","last_clean":"2024-09-19T05:37:31.424629+0000","last_became_active":"2024-09-19T05:37:30.373926+0000","last_became_peered":"2024-09-19T05:37:30.373926+0000","last_unstale":"2024-09-19T05:37:31.424629+0000","last_undegraded":"2024-09-19T05:37:31.424629+0000","last_fullsized":"2024-09-19T05:37:31.424629+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:37.298634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392588+0000","last_change":"2024-09-19T05:37:31.432800+0000","last_active":"2024-09-19T05:37:32.392588+0000","last_peered":"2024-09-19T05:37:32.392588+0000","last_clean":"2024-09-19T05:37:32.392588+0000","last_became_active":"2024-09-19T05:37:31.427845+0000","last_became_peered":"2024-09-19T05:37:31.427845+0000","last_unstale":"2024-09-19T05:37:32.392588+0000","last_undegraded":"2024-09-19T05:37:32.392588+0000","last_fullsized":"2024-09-19T05:37:32.392588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:51.218522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.435376+0000","last_change":"2024-09-19T05:37:30.387297+0000","last_active":"2024-09-19T05:37:31.435376+0000","last_peered":"2024-09-19T05:37:31.435376+0000","last_clean":"2024-09-19T05:37:31.435376+0000","last_became_active":"2024-09-19T05:37:30.386543+0000","last_became_peered":"2024-09-19T05:37:30.386543+0000","last_unstale":"2024-09-19T05:37:31.435376+0000","last_undegraded":"2024-09-19T05:37:31.435376+0000","last_fullsized":"2024-09-19T05:37:31.435376+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:07.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.416375+0000","last_change":"2024-09-19T05:37:31.391628+0000","last_active":"2024-09-19T05:37:31.416375+0000","last_peered":"2024-09-19T05:37:31.416375+0000","last_clean":"2024-09-19T05:37:31.416375+0000","last_became_active":"2024-09-19T05:37:31.390822+0000","last_became_peered":"2024-09-19T05:37:31.390822+0000","last_unstale":"2024-09-19T05:37:31.416375+0000","last_undegraded":"2024-09-19T05:37:31.416375+0000","last_fullsized":"2024-09-19T05:37:31.416375+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:15.814857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.436491+0000","last_change":"2024-09-19T05:37:30.378691+0000","last_active":"2024-09-19T05:37:31.436491+0000","last_peered":"2024-09-19T05:37:31.436491+0000","last_clean":"2024-09-19T05:37:31.436491+0000","last_became_active":"2024-09-19T05:37:30.377967+0000","last_became_peered":"2024-09-19T05:37:30.377967+0000","last_unstale":"2024-09-19T05:37:31.436491+0000","last_undegraded":"2024-09-19T05:37:31.436491+0000","last_fullsized":"2024-09-19T05:37:31.436491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:41.213858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392869+0000","last_change":"2024-09-19T05:37:31.416017+0000","last_active":"2024-09-19T05:37:32.392869+0000","last_peered":"2024-09-19T05:37:32.392869+0000","last_clean":"2024-09-19T05:37:32.392869+0000","last_became_active":"2024-09-19T05:37:31.415232+0000","last_became_peered":"2024-09-19T05:37:31.415232+0000","last_unstale":"2024-09-19T05:37:32.392869+0000","last_undegraded":"2024-09-19T05:37:32.392869+0000","last_fullsized":"2024-09-19T05:37:32.392869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:18.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.380809+0000","last_change":"2024-09-19T05:37:30.368770+0000","last_active":"2024-09-19T05:37:31.380809+0000","last_peered":"2024-09-19T05:37:31.380809+0000","last_clean":"2024-09-19T05:37:31.380809+0000","last_became_active":"2024-09-19T05:37:30.368353+0000","last_became_peered":"2024-09-19T05:37:30.368353+0000","last_unstale":"2024-09-19T05:37:31.380809+0000","last_undegraded":"2024-09-19T05:37:31.380809+0000","last_fullsized":"2024-09-19T05:37:31.380809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:33.160321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.399958+0000","last_change":"2024-09-19T05:37:31.393052+0000","last_active":"2024-09-19T05:37:31.399958+0000","last_peered":"2024-09-19T05:37:31.399958+0000","last_clean":"2024-09-19T05:37:31.399958+0000","last_became_active":"2024-09-19T05:37:31.392720+0000","last_became_peered":"2024-09-19T05:37:31.392720+0000","last_unstale":"2024-09-19T05:37:31.399958+0000","last_undegraded":"2024-09-19T05:37:31.399958+0000","last_fullsized":"2024-09-19T05:37:31.399958+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:10.706829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.438282+0000","last_change":"2024-09-19T05:37:30.360013+0000","last_active":"2024-09-19T05:37:31.438282+0000","last_peered":"2024-09-19T05:37:31.438282+0000","last_clean":"2024-09-19T05:37:31.438282+0000","last_became_active":"2024-09-19T05:37:30.359574+0000","last_became_peered":"2024-09-19T05:37:30.359574+0000","last_unstale":"2024-09-19T05:37:31.438282+0000","last_undegraded":"2024-09-19T05:37:31.438282+0000","last_fullsized":"2024-09-19T05:37:31.438282+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:17.768444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.419130+0000","last_change":"2024-09-19T05:37:31.409512+0000","last_active":"2024-09-19T05:37:31.419130+0000","last_peered":"2024-09-19T05:37:31.419130+0000","last_clean":"2024-09-19T05:37:31.419130+0000","last_became_active":"2024-09-19T05:37:31.408735+0000","last_became_peered":"2024-09-19T05:37:31.408735+0000","last_unstale":"2024-09-19T05:37:31.419130+0000","last_undegraded":"2024-09-19T05:37:31.419130+0000","last_fullsized":"2024-09-19T05:37:31.419130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:32.053658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.383360+0000","last_change":"2024-09-19T05:37:30.381592+0000","last_active":"2024-09-19T05:37:31.383360+0000","last_peered":"2024-09-19T05:37:31.383360+0000","last_clean":"2024-09-19T05:37:31.383360+0000","last_became_active":"2024-09-19T05:37:30.375027+0000","last_became_peered":"2024-09-19T05:37:30.375027+0000","last_unstale":"2024-09-19T05:37:31.383360+0000","last_undegraded":"2024-09-19T05:37:31.383360+0000","last_fullsized":"2024-09-19T05:37:31.383360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:41:22.886317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391613+0000","last_change":"2024-09-19T05:37:31.428549+0000","last_active":"2024-09-19T05:37:32.391613+0000","last_peered":"2024-09-19T05:37:32.391613+0000","last_clean":"2024-09-19T05:37:32.391613+0000","last_became_active":"2024-09-19T05:37:31.427283+0000","last_became_peered":"2024-09-19T05:37:31.427283+0000","last_unstale":"2024-09-19T05:37:32.391613+0000","last_undegraded":"2024-09-19T05:37:32.391613+0000","last_fullsized":"2024-09-19T05:37:32.391613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:02.086197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.370614+0000","last_change":"2024-09-19T05:37:30.370064+0000","last_active":"2024-09-19T05:37:31.370614+0000","last_peered":"2024-09-19T05:37:31.370614+0000","last_clean":"2024-09-19T05:37:31.370614+0000","last_became_active":"2024-09-19T05:37:30.369705+0000","last_became_peered":"2024-09-19T05:37:30.369705+0000","last_unstale":"2024-09-19T05:37:31.370614+0000","last_undegraded":"2024-09-19T05:37:31.370614+0000","last_fullsized":"2024-09-19T05:37:31.370614+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:08.002648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.398869+0000","last_change":"2024-09-19T05:37:31.393917+0000","last_active":"2024-09-19T05:37:31.398869+0000","last_peered":"2024-09-19T05:37:31.398869+0000","last_clean":"2024-09-19T05:37:31.398869+0000","last_became_active":"2024-09-19T05:37:31.393492+0000","last_became_peered":"2024-09-19T05:37:31.393492+0000","last_unstale":"2024-09-19T05:37:31.398869+0000","last_undegraded":"2024-09-19T05:37:31.398869+0000","last_fullsized":"2024-09-19T05:37:31.398869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:20.686623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.441252+0000","last_change":"2024-09-19T05:37:30.386931+0000","last_active":"2024-09-19T05:37:31.441252+0000","last_peered":"2024-09-19T05:37:31.441252+0000","last_clean":"2024-09-19T05:37:31.441252+0000","last_became_active":"2024-09-19T05:37:30.386242+0000","last_became_peered":"2024-09-19T05:37:30.386242+0000","last_unstale":"2024-09-19T05:37:31.441252+0000","last_undegraded":"2024-09-19T05:37:31.441252+0000","last_fullsized":"2024-09-19T05:37:31.441252+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:45.239661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.397755+0000","last_change":"2024-09-19T05:37:31.396764+0000","last_active":"2024-09-19T05:37:31.397755+0000","last_peered":"2024-09-19T05:37:31.397755+0000","last_clean":"2024-09-19T05:37:31.397755+0000","last_became_active":"2024-09-19T05:37:31.396354+0000","last_became_peered":"2024-09-19T05:37:31.396354+0000","last_unstale":"2024-09-19T05:37:31.397755+0000","last_undegraded":"2024-09-19T05:37:31.397755+0000","last_fullsized":"2024-09-19T05:37:31.397755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:38.063560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.382387+0000","last_change":"2024-09-19T05:37:30.373333+0000","last_active":"2024-09-19T05:37:31.382387+0000","last_peered":"2024-09-19T05:37:31.382387+0000","last_clean":"2024-09-19T05:37:31.382387+0000","last_became_active":"2024-09-19T05:37:30.372644+0000","last_became_peered":"2024-09-19T05:37:30.372644+0000","last_unstale":"2024-09-19T05:37:31.382387+0000","last_undegraded":"2024-09-19T05:37:31.382387+0000","last_fullsized":"2024-09-19T05:37:31.382387+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:24.414312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.419175+0000","last_change":"2024-09-19T05:37:31.397130+0000","last_active":"2024-09-19T05:37:31.419175+0000","last_peered":"2024-09-19T05:37:31.419175+0000","last_clean":"2024-09-19T05:37:31.419175+0000","last_became_active":"2024-09-19T05:37:31.396396+0000","last_became_peered":"2024-09-19T05:37:31.396396+0000","last_unstale":"2024-09-19T05:37:31.419175+0000","last_undegraded":"2024-09-19T05:37:31.419175+0000","last_fullsized":"2024-09-19T05:37:31.419175+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:00.485466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.370415+0000","last_change":"2024-09-19T05:37:30.376432+0000","last_active":"2024-09-19T05:37:31.370415+0000","last_peered":"2024-09-19T05:37:31.370415+0000","last_clean":"2024-09-19T05:37:31.370415+0000","last_became_active":"2024-09-19T05:37:30.376021+0000","last_became_peered":"2024-09-19T05:37:30.376021+0000","last_unstale":"2024-09-19T05:37:31.370415+0000","last_undegraded":"2024-09-19T05:37:31.370415+0000","last_fullsized":"2024-09-19T05:37:31.370415+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:20.929517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.392885+0000","last_change":"2024-09-19T05:37:31.414375+0000","last_active":"2024-09-19T05:37:32.392885+0000","last_peered":"2024-09-19T05:37:32.392885+0000","last_clean":"2024-09-19T05:37:32.392885+0000","last_became_active":"2024-09-19T05:37:31.413456+0000","last_became_peered":"2024-09-19T05:37:31.413456+0000","last_unstale":"2024-09-19T05:37:32.392885+0000","last_undegraded":"2024-09-19T05:37:32.392885+0000","last_fullsized":"2024-09-19T05:37:32.392885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:31.241676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391854+0000","last_change":"2024-09-19T05:37:30.376949+0000","last_active":"2024-09-19T05:37:32.391854+0000","last_peered":"2024-09-19T05:37:32.391854+0000","last_clean":"2024-09-19T05:37:32.391854+0000","last_became_active":"2024-09-19T05:37:30.376594+0000","last_became_peered":"2024-09-19T05:37:30.376594+0000","last_unstale":"2024-09-19T05:37:32.391854+0000","last_undegraded":"2024-09-19T05:37:32.391854+0000","last_fullsized":"2024-09-19T05:37:32.391854+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:01.073685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391068+0000","last_change":"2024-09-19T05:37:31.415887+0000","last_active":"2024-09-19T05:37:32.391068+0000","last_peered":"2024-09-19T05:37:32.391068+0000","last_clean":"2024-09-19T05:37:32.391068+0000","last_became_active":"2024-09-19T05:37:31.414262+0000","last_became_peered":"2024-09-19T05:37:31.414262+0000","last_unstale":"2024-09-19T05:37:32.391068+0000","last_undegraded":"2024-09-19T05:37:32.391068+0000","last_fullsized":"2024-09-19T05:37:32.391068+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:02.917874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.379700+0000","last_change":"2024-09-19T05:37:30.366685+0000","last_active":"2024-09-19T05:37:31.379700+0000","last_peered":"2024-09-19T05:37:31.379700+0000","last_clean":"2024-09-19T05:37:31.379700+0000","last_became_active":"2024-09-19T05:37:30.365966+0000","last_became_peered":"2024-09-19T05:37:30.365966+0000","last_unstale":"2024-09-19T05:37:31.379700+0000","last_undegraded":"2024-09-19T05:37:31.379700+0000","last_fullsized":"2024-09-19T05:37:31.379700+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:12.266236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.419939+0000","last_change":"2024-09-19T05:37:31.410600+0000","last_active":"2024-09-19T05:37:31.419939+0000","last_peered":"2024-09-19T05:37:31.419939+0000","last_clean":"2024-09-19T05:37:31.419939+0000","last_became_active":"2024-09-19T05:37:31.409860+0000","last_became_peered":"2024-09-19T05:37:31.409860+0000","last_unstale":"2024-09-19T05:37:31.419939+0000","last_undegraded":"2024-09-19T05:37:31.419939+0000","last_fullsized":"2024-09-19T05:37:31.419939+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.454306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.379586+0000","last_change":"2024-09-19T05:37:30.360892+0000","last_active":"2024-09-19T05:37:31.379586+0000","last_peered":"2024-09-19T05:37:31.379586+0000","last_clean":"2024-09-19T05:37:31.379586+0000","last_became_active":"2024-09-19T05:37:30.360416+0000","last_became_peered":"2024-09-19T05:37:30.360416+0000","last_unstale":"2024-09-19T05:37:31.379586+0000","last_undegraded":"2024-09-19T05:37:31.379586+0000","last_fullsized":"2024-09-19T05:37:31.379586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:08.435120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.390595+0000","last_change":"2024-09-19T05:37:31.401737+0000","last_active":"2024-09-19T05:37:32.390595+0000","last_peered":"2024-09-19T05:37:32.390595+0000","last_clean":"2024-09-19T05:37:32.390595+0000","last_became_active":"2024-09-19T05:37:31.401381+0000","last_became_peered":"2024-09-19T05:37:31.401381+0000","last_unstale":"2024-09-19T05:37:32.390595+0000","last_undegraded":"2024-09-19T05:37:32.390595+0000","last_fullsized":"2024-09-19T05:37:32.390595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.720940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.378341+0000","last_change":"2024-09-19T05:37:30.371451+0000","last_active":"2024-09-19T05:37:31.378341+0000","last_peered":"2024-09-19T05:37:31.378341+0000","last_clean":"2024-09-19T05:37:31.378341+0000","last_became_active":"2024-09-19T05:37:30.370955+0000","last_became_peered":"2024-09-19T05:37:30.370955+0000","last_unstale":"2024-09-19T05:37:31.378341+0000","last_undegraded":"2024-09-19T05:37:31.378341+0000","last_fullsized":"2024-09-19T05:37:31.378341+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:59.529338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.414031+0000","last_change":"2024-09-19T05:37:31.413282+0000","last_active":"2024-09-19T05:37:31.414031+0000","last_peered":"2024-09-19T05:37:31.414031+0000","last_clean":"2024-09-19T05:37:31.414031+0000","last_became_active":"2024-09-19T05:37:31.413008+0000","last_became_peered":"2024-09-19T05:37:31.413008+0000","last_unstale":"2024-09-19T05:37:31.414031+0000","last_undegraded":"2024-09-19T05:37:31.414031+0000","last_fullsized":"2024-09-19T05:37:31.414031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:06.193614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.390824+0000","last_change":"2024-09-19T05:37:30.380876+0000","last_active":"2024-09-19T05:37:32.390824+0000","last_peered":"2024-09-19T05:37:32.390824+0000","last_clean":"2024-09-19T05:37:32.390824+0000","last_became_active":"2024-09-19T05:37:30.380482+0000","last_became_peered":"2024-09-19T05:37:30.380482+0000","last_unstale":"2024-09-19T05:37:32.390824+0000","last_undegraded":"2024-09-19T05:37:32.390824+0000","last_fullsized":"2024-09-19T05:37:32.390824+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:01.905362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T05:37:32.391801+0000","last_change":"2024-09-19T05:37:31.415037+0000","last_active":"2024-09-19T05:37:32.391801+0000","last_peered":"2024-09-19T05:37:32.391801+0000","last_clean":"2024-09-19T05:37:32.391801+0000","last_became_active":"2024-09-19T05:37:31.414541+0000","last_became_peered":"2024-09-19T05:37:31.414541+0000","last_unstale":"2024-09-19T05:37:32.391801+0000","last_undegraded":"2024-09-19T05:37:32.391801+0000","last_fullsized":"2024-09-19T05:37:32.391801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:30.332644+0000","last_clean_scrub_stamp":"2024-09-19T05:37:30.332644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:43.924100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.377477+0000","last_change":"2024-09-19T05:37:30.360732+0000","last_active":"2024-09-19T05:37:31.377477+0000","last_peered":"2024-09-19T05:37:31.377477+0000","last_clean":"2024-09-19T05:37:31.377477+0000","last_became_active":"2024-09-19T05:37:30.358778+0000","last_became_peered":"2024-09-19T05:37:30.358778+0000","last_unstale":"2024-09-19T05:37:31.377477+0000","last_undegraded":"2024-09-19T05:37:31.377477+0000","last_fullsized":"2024-09-19T05:37:31.377477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:29.320133+0000","last_clean_scrub_stamp":"2024-09-19T05:37:29.320133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:58.682987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":257,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-19T05:37:31.382782+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:37:31.382782+0000","last_peered":"2024-09-19T05:37:31.382782+0000","last_clean":"2024-09-19T05:37:31.382782+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:37:31.382782+0000","last_undegraded":"2024-09-19T05:37:31.382782+0000","last_fullsized":"2024-09-19T05:37:31.382782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542200,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46460,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325380,"statfs":{"total":96636764160,"available":96589189120,"internally_reserved":0,"allocated":1417216,"data_stored":957329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542200,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40300,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331540,"statfs":{"total":96636764160,"available":96595496960,"internally_reserved":0,"allocated":811008,"data_stored":366219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542202,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40308,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331532,"statfs":{"total":96636764160,"available":96595488768,"internally_reserved":0,"allocated":811008,"data_stored":366207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45884,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325956,"statfs":{"total":96636764160,"available":96589778944,"internally_reserved":0,"allocated":819200,"data_stored":367797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542201,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45872,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325968,"statfs":{"total":96636764160,"available":96589791232,"internally_reserved":0,"allocated":806912,"data_stored":366185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44452,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327388,"statfs":{"total":96636764160,"available":96591245312,"internally_reserved":0,"allocated":806912,"data_stored":366185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40332,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331508,"statfs":{"total":96636764160,"available":96595464192,"internally_reserved":0,"allocated":835584,"data_stored":368561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50604,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321236,"statfs":{"total":96636764160,"available":96584945664,"internally_reserved":0,"allocated":1400832,"data_stored":956553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:37:35.811 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:37:35.811 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:37:35.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f7705546640 1 Processor -- start 2024-09-19T05:37:35.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f7705546640 1 -- start start 2024-09-19T05:37:35.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f7705546640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7700159c60 0x7f77000ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f7705546640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f77000af3a0 0x7f770015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f7705546640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f770015a040 con 0x7f770006ffd0 2024-09-19T05:37:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f7705546640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f770015d460 con 0x7f7700159c60 2024-09-19T05:37:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f7705546640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f770015c850 con 0x7f77000af3a0 2024-09-19T05:37:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f76feffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7700159c60 0x7f77000ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f76feffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7700159c60 0x7f77000ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33542/0 (socket says 172.21.15.67:33542) 2024-09-19T05:37:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f76feffd640 1 -- 172.21.15.67:0/1102014541 learned_addr learned my addr 172.21.15.67:0/1102014541 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f76feffd640 1 -- 172.21.15.67:0/1102014541 >> v2:172.21.15.97:3300/0 conn(0x7f77000af3a0 msgr2=0x7f770015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f76feffd640 1 --2- 172.21.15.67:0/1102014541 >> v2:172.21.15.97:3300/0 conn(0x7f77000af3a0 0x7f770015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f76feffd640 1 -- 172.21.15.67:0/1102014541 >> v1:172.21.15.97:6789/0 conn(0x7f770006ffd0 legacy=0x7f77000aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.969+0000 7f76feffd640 1 -- 172.21.15.67:0/1102014541 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770015cb30 con 0x7f7700159c60 2024-09-19T05:37:35.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f76feffd640 1 --2- 172.21.15.67:0/1102014541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7700159c60 0x7f77000ad130 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7700071950 tx=0x7f76f001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867f81069fe3f4e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:35.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f76fdffb640 1 -- 172.21.15.67:0/1102014541 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f00aa610 con 0x7f7700159c60 2024-09-19T05:37:35.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f76fdffb640 1 -- 172.21.15.67:0/1102014541 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f00af070 con 0x7f7700159c60 2024-09-19T05:37:35.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f76fdffb640 1 -- 172.21.15.67:0/1102014541 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f00aa9d0 con 0x7f7700159c60 2024-09-19T05:37:35.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f7705546640 1 -- 172.21.15.67:0/1102014541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7700159c60 msgr2=0x7f77000ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f7705546640 1 --2- 172.21.15.67:0/1102014541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7700159c60 0x7f77000ad130 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7700071950 tx=0x7f76f001c4b0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f7705546640 1 -- 172.21.15.67:0/1102014541 shutdown_connections 2024-09-19T05:37:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f7705546640 1 --2- 172.21.15.67:0/1102014541 >> v2:172.21.15.97:3300/0 conn(0x7f77000af3a0 0x7f770015fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f7705546640 1 --2- 172.21.15.67:0/1102014541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7700159c60 0x7f77000ad130 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f7705546640 1 -- 172.21.15.67:0/1102014541 >> 172.21.15.67:0/1102014541 conn(0x7f77000b1e50 msgr2=0x7f77000b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f7705546640 1 -- 172.21.15.67:0/1102014541 shutdown_connections 2024-09-19T05:37:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f7705546640 1 -- 172.21.15.67:0/1102014541 wait complete. 2024-09-19T05:37:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f7705546640 1 Processor -- start 2024-09-19T05:37:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.973+0000 7f7705546640 1 -- start start 2024-09-19T05:37:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f7705546640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f770006ffd0 0x7f77001521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f7705546640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77000af3a0 0x7f770009cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f7705546640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f770009d420 0x7f77001543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f7705546640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7700168fb0 con 0x7f77000af3a0 2024-09-19T05:37:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f7705546640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7700168e30 con 0x7f770009d420 2024-09-19T05:37:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f7705546640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7700169130 con 0x7f770006ffd0 2024-09-19T05:37:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76fe7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77000af3a0 0x7f770009cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76fe7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77000af3a0 0x7f770009cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33558/0 (socket says 172.21.15.67:33558) 2024-09-19T05:37:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76fe7fc640 1 -- 172.21.15.67:0/3350743077 learned_addr learned my addr 172.21.15.67:0/3350743077 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76fe7fc640 1 -- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f770006ffd0 msgr2=0x7f77001521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76fe7fc640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f770006ffd0 0x7f77001521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76ff7fe640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f770009d420 0x7f77001543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76fe7fc640 1 -- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f770009d420 msgr2=0x7f77001543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76fe7fc640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f770009d420 0x7f77001543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76fe7fc640 1 -- 172.21.15.67:0/3350743077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770009e260 con 0x7f77000af3a0 2024-09-19T05:37:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76fe7fc640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77000af3a0 0x7f770009cee0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f76e800c490 tx=0x7f76e8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76f77fe640 1 -- 172.21.15.67:0/3350743077 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8017070 con 0x7f77000af3a0 2024-09-19T05:37:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76f77fe640 1 -- 172.21.15.67:0/3350743077 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e8003600 con 0x7f77000af3a0 2024-09-19T05:37:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76f77fe640 1 -- 172.21.15.67:0/3350743077 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8003a30 con 0x7f77000af3a0 2024-09-19T05:37:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f7705546640 1 -- 172.21.15.67:0/3350743077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770009d9c0 con 0x7f77000af3a0 2024-09-19T05:37:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f7705546640 1 -- 172.21.15.67:0/3350743077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770009df80 con 0x7f77000af3a0 2024-09-19T05:37:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f7705546640 1 -- 172.21.15.67:0/3350743077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77000ad130 con 0x7f77000af3a0 2024-09-19T05:37:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76f77fe640 1 -- 172.21.15.67:0/3350743077 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f76e8003bd0 con 0x7f77000af3a0 2024-09-19T05:37:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76f77fe640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76e00678f0 0x7f76e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76f77fe640 1 -- 172.21.15.67:0/3350743077 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f76e8085090 con 0x7f77000af3a0 2024-09-19T05:37:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.977+0000 7f76feffd640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76e00678f0 0x7f76e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.981+0000 7f76feffd640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76e00678f0 0x7f76e0069db0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f76f00ae000 tx=0x7f76f0004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:35.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:35.981+0000 7f76f77fe640 1 -- 172.21.15.67:0/3350743077 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f76e8055a40 con 0x7f77000af3a0 2024-09-19T05:37:36.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.197+0000 7f7705546640 1 -- 172.21.15.67:0/3350743077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f770006cf40 con 0x7f77000af3a0 2024-09-19T05:37:36.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.201+0000 7f76f77fe640 1 -- 172.21.15.67:0/3350743077 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f76e8055340 con 0x7f77000af3a0 2024-09-19T05:37:36.206 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:37:36.206 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:37:36.206 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:37:36.206 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:37:36.206 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:37:36.207 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:37:36.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 -- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76e00678f0 msgr2=0x7f76e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:36.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76e00678f0 0x7f76e0069db0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f76f00ae000 tx=0x7f76f0004740 comp rx=0 tx=0).stop 2024-09-19T05:37:36.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 -- 172.21.15.67:0/3350743077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77000af3a0 msgr2=0x7f770009cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:36.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77000af3a0 0x7f770009cee0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f76e800c490 tx=0x7f76e8001e80 comp rx=0 tx=0).stop 2024-09-19T05:37:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 -- 172.21.15.67:0/3350743077 shutdown_connections 2024-09-19T05:37:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f770009d420 0x7f77001543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77000af3a0 0x7f770009cee0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76e00678f0 0x7f76e0069db0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 --2- 172.21.15.67:0/3350743077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f770006ffd0 0x7f77001521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 -- 172.21.15.67:0/3350743077 >> 172.21.15.67:0/3350743077 conn(0x7f77000b1e50 msgr2=0x7f770015a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 -- 172.21.15.67:0/3350743077 shutdown_connections 2024-09-19T05:37:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.205+0000 7f7705546640 1 -- 172.21.15.67:0/3350743077 wait complete. 2024-09-19T05:37:36.224 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.337+0000 7f9c3e25f640 1 Processor -- start 2024-09-19T05:37:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.337+0000 7f9c3e25f640 1 -- start start 2024-09-19T05:37:36.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c3e25f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c380d1d70 0x7f9c380d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:36.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c3e25f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9c380d1420 0x7f9c380ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:36.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c3e25f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c380cdae0 con 0x7f9c3815b210 2024-09-19T05:37:36.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c3e25f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9c380cd890 con 0x7f9c380d1420 2024-09-19T05:37:36.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c3e25f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9c380cddc0 con 0x7f9c380d1d70 2024-09-19T05:37:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c37fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9c380d1420 0x7f9c380ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c377fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9c3815b210 0x7f9c380b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:59678/0 (socket says 172.21.15.67:59678) 2024-09-19T05:37:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c380d1d70 0x7f9c380d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c377fe640 1 -- 172.21.15.67:0/2833074723 learned_addr learned my addr 172.21.15.67:0/2833074723 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c37fff640 1 -- 172.21.15.67:0/2833074723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c380d1d70 msgr2=0x7f9c380d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:36.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c37fff640 1 --2- 172.21.15.67:0/2833074723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c380d1d70 0x7f9c380d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c37fff640 1 -- 172.21.15.67:0/2833074723 >> v1:172.21.15.97:6789/0 conn(0x7f9c3815b210 legacy=0x7f9c380b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:36.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.341+0000 7f9c37fff640 1 -- 172.21.15.67:0/2833074723 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c380ce0a0 con 0x7f9c380d1420 2024-09-19T05:37:36.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c37fff640 1 --2- 172.21.15.67:0/2833074723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380d1420 0x7f9c380ce8a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009d90 tx=0x7f9c2801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e982b5c362cf56ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c367fc640 1 -- 172.21.15.67:0/2833074723 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c280b2070 con 0x7f9c380d1420 2024-09-19T05:37:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c367fc640 1 -- 172.21.15.67:0/2833074723 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c280a5940 con 0x7f9c380d1420 2024-09-19T05:37:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c367fc640 1 -- 172.21.15.67:0/2833074723 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c280a5d10 con 0x7f9c380d1420 2024-09-19T05:37:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c3e25f640 1 -- 172.21.15.67:0/2833074723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380d1420 msgr2=0x7f9c380ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c3e25f640 1 --2- 172.21.15.67:0/2833074723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380d1420 0x7f9c380ce8a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009d90 tx=0x7f9c2801c970 comp rx=0 tx=0).stop 2024-09-19T05:37:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c3e25f640 1 -- 172.21.15.67:0/2833074723 shutdown_connections 2024-09-19T05:37:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c3e25f640 1 --2- 172.21.15.67:0/2833074723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380d1420 0x7f9c380ce8a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c3e25f640 1 --2- 172.21.15.67:0/2833074723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c380d1d70 0x7f9c380d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c3e25f640 1 -- 172.21.15.67:0/2833074723 >> 172.21.15.67:0/2833074723 conn(0x7f9c3809aa30 msgr2=0x7f9c380b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c3e25f640 1 -- 172.21.15.67:0/2833074723 shutdown_connections 2024-09-19T05:37:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c3e25f640 1 -- 172.21.15.67:0/2833074723 wait complete. 2024-09-19T05:37:36.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c3e25f640 1 Processor -- start 2024-09-19T05:37:36.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.345+0000 7f9c3e25f640 1 -- start start 2024-09-19T05:37:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c3e25f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380d1420 0x7f9c3814b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c3e25f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c380d1d70 0x7f9c380b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c3e25f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c3815b210 0x7f9c3814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c3e25f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c380cf980 con 0x7f9c380d1d70 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c3e25f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c380cf800 con 0x7f9c380d1420 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c3e25f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9c380cfb00 con 0x7f9c3815b210 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c380d1d70 0x7f9c380b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c36ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c380d1d70 0x7f9c380b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33566/0 (socket says 172.21.15.67:33566) 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c36ffd640 1 -- 172.21.15.67:0/3405441479 learned_addr learned my addr 172.21.15.67:0/3405441479 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c377fe640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380d1420 0x7f9c3814b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c37fff640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c3815b210 0x7f9c3814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c36ffd640 1 -- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c3815b210 msgr2=0x7f9c3814bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c36ffd640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c3815b210 0x7f9c3814bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c36ffd640 1 -- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380d1420 msgr2=0x7f9c3814b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c36ffd640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380d1420 0x7f9c3814b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c36ffd640 1 -- 172.21.15.67:0/3405441479 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c380b1200 con 0x7f9c380d1d70 2024-09-19T05:37:36.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c36ffd640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c380d1d70 0x7f9c380b22a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000e870 tx=0x7f9c2000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:36.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c2ffff640 1 -- 172.21.15.67:0/3405441479 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20017070 con 0x7f9c380d1d70 2024-09-19T05:37:36.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c2ffff640 1 -- 172.21.15.67:0/3405441479 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2000c940 con 0x7f9c380d1d70 2024-09-19T05:37:36.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c2ffff640 1 -- 172.21.15.67:0/3405441479 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000ccf0 con 0x7f9c380d1d70 2024-09-19T05:37:36.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c3e25f640 1 -- 172.21.15.67:0/3405441479 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c380b14e0 con 0x7f9c380d1d70 2024-09-19T05:37:36.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c3e25f640 1 -- 172.21.15.67:0/3405441479 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c380b1aa0 con 0x7f9c380d1d70 2024-09-19T05:37:36.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c3e25f640 1 -- 172.21.15.67:0/3405441479 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c380ce8a0 con 0x7f9c380d1d70 2024-09-19T05:37:36.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c2ffff640 1 -- 172.21.15.67:0/3405441479 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c2001a070 con 0x7f9c380d1d70 2024-09-19T05:37:36.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c2ffff640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c180678c0 0x7f9c18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:36.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.349+0000 7f9c2ffff640 1 -- 172.21.15.67:0/3405441479 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f9c200860a0 con 0x7f9c380d1d70 2024-09-19T05:37:36.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.353+0000 7f9c377fe640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c180678c0 0x7f9c18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:36.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.353+0000 7f9c377fe640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c180678c0 0x7f9c18069d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c30000f70 tx=0x7f9c30009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:36.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.357+0000 7f9c2ffff640 1 -- 172.21.15.67:0/3405441479 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9c20056a50 con 0x7f9c380d1d70 2024-09-19T05:37:36.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.549+0000 7f9c3e25f640 1 -- 172.21.15.67:0/3405441479 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c381592c0 con 0x7f9c380d1d70 2024-09-19T05:37:36.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.549+0000 7f9c2ffff640 1 -- 172.21.15.67:0/3405441479 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5218 (secure 0 0 0) 0x7f9c20056350 con 0x7f9c380d1d70 2024-09-19T05:37:36.554 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:36.554 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":36,"btime":"2024-09-19T05:37:34:410317+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/547145733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":547145733},{"type":"v1","addr":"172.21.15.97:6835","nonce":547145733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4281263473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4281263473},{"type":"v1","addr":"172.21.15.97:6837","nonce":4281263473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/403505114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":403505114},{"type":"v1","addr":"172.21.15.67:6834","nonce":403505114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:33.766722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6261":{"gid":6261,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3283833069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3283833069},{"type":"v1","addr":"172.21.15.67:6835","nonce":3283833069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6261,"qdb_cluster":[6261]},"id":4}]} 2024-09-19T05:37:36.554 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 36 2024-09-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 -- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c180678c0 msgr2=0x7f9c18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c180678c0 0x7f9c18069d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c30000f70 tx=0x7f9c30009040 comp rx=0 tx=0).stop 2024-09-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 -- 172.21.15.67:0/3405441479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c380d1d70 msgr2=0x7f9c380b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c380d1d70 0x7f9c380b22a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000e870 tx=0x7f9c2000ec70 comp rx=0 tx=0).stop 2024-09-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 -- 172.21.15.67:0/3405441479 shutdown_connections 2024-09-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c180678c0 0x7f9c18069d80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c3815b210 0x7f9c3814bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c380d1d70 0x7f9c380b22a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 --2- 172.21.15.67:0/3405441479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380d1420 0x7f9c3814b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 -- 172.21.15.67:0/3405441479 >> 172.21.15.67:0/3405441479 conn(0x7f9c3809aa30 msgr2=0x7f9c3806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 -- 172.21.15.67:0/3405441479 shutdown_connections 2024-09-19T05:37:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:36.553+0000 7f9c3e25f640 1 -- 172.21.15.67:0/3405441479 wait complete. 2024-09-19T05:37:36.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:37:30.724054+0000', 'modified': '2024-09-19T05:37:33.766722+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6261}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6261': {'gid': 6261, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/3283833069', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6833', 'nonce': 3283833069}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 3283833069}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6261, 'qdb_cluster': [6261]} 2024-09-19T05:37:36.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:37:36.974 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:37:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3456cb9640 1 Processor -- start 2024-09-19T05:37:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3456cb9640 1 -- start start 2024-09-19T05:37:37.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3456cb9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f345015c030 0x7f345006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3456cb9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f345006f460 0x7f345006f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3456cb9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345006e3c0 con 0x7f345015d1d0 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3456cb9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f345006e6a0 con 0x7f345015c030 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3456cb9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f345006e980 con 0x7f345006f460 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3454a55640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f345015c030 0x7f345006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3454a55640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f345015c030 0x7f345006dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33570/0 (socket says 172.21.15.67:33570) 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3454a55640 1 -- 172.21.15.67:0/1197374133 learned_addr learned my addr 172.21.15.67:0/1197374133 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3454a55640 1 -- 172.21.15.67:0/1197374133 >> v2:172.21.15.97:3300/0 conn(0x7f345006f460 msgr2=0x7f345006f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3455256640 1 --2- 172.21.15.67:0/1197374133 >> v2:172.21.15.97:3300/0 conn(0x7f345006f460 0x7f345006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3454a55640 1 --2- 172.21.15.67:0/1197374133 >> v2:172.21.15.97:3300/0 conn(0x7f345006f460 0x7f345006f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3454a55640 1 -- 172.21.15.67:0/1197374133 >> v1:172.21.15.97:6789/0 conn(0x7f345015d1d0 legacy=0x7f34500b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3454a55640 1 -- 172.21.15.67:0/1197374133 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345006ec60 con 0x7f345015c030 2024-09-19T05:37:37.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.105+0000 7f3455256640 1 --2- 172.21.15.67:0/1197374133 >> v2:172.21.15.97:3300/0 conn(0x7f345006f460 0x7f345006f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:37.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3454a55640 1 --2- 172.21.15.67:0/1197374133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015c030 0x7f345006dde0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f34500afbf0 tx=0x7f343801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f1d10603ddc6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f344f7fe640 1 -- 172.21.15.67:0/1197374133 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380b0070 con 0x7f345015c030 2024-09-19T05:37:37.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f344f7fe640 1 -- 172.21.15.67:0/1197374133 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34380ab600 con 0x7f345015c030 2024-09-19T05:37:37.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f344f7fe640 1 -- 172.21.15.67:0/1197374133 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380ab9d0 con 0x7f345015c030 2024-09-19T05:37:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 -- 172.21.15.67:0/1197374133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015c030 msgr2=0x7f345006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 --2- 172.21.15.67:0/1197374133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015c030 0x7f345006dde0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f34500afbf0 tx=0x7f343801c4e0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 -- 172.21.15.67:0/1197374133 shutdown_connections 2024-09-19T05:37:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 --2- 172.21.15.67:0/1197374133 >> v2:172.21.15.97:3300/0 conn(0x7f345006f460 0x7f345006f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 --2- 172.21.15.67:0/1197374133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015c030 0x7f345006dde0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 -- 172.21.15.67:0/1197374133 >> 172.21.15.67:0/1197374133 conn(0x7f34500d0080 msgr2=0x7f34500d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 -- 172.21.15.67:0/1197374133 shutdown_connections 2024-09-19T05:37:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 -- 172.21.15.67:0/1197374133 wait complete. 2024-09-19T05:37:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 Processor -- start 2024-09-19T05:37:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 -- start start 2024-09-19T05:37:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f345006f460 0x7f34500999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345015c030 0x7f345014ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015d1d0 0x7f345014b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f345015c590 con 0x7f345015d1d0 2024-09-19T05:37:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f345015c410 con 0x7f345015c030 2024-09-19T05:37:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3456cb9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f34501690e0 con 0x7f345006f460 2024-09-19T05:37:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3455256640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015d1d0 0x7f345014b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3455256640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015d1d0 0x7f345014b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33582/0 (socket says 172.21.15.67:33582) 2024-09-19T05:37:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f3455256640 1 -- 172.21.15.67:0/1084679936 learned_addr learned my addr 172.21.15.67:0/1084679936 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.109+0000 7f344ffff640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345015c030 0x7f345014ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3454a55640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f345006f460 0x7f34500999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3455256640 1 -- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f345006f460 msgr2=0x7f34500999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3455256640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f345006f460 0x7f34500999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3455256640 1 -- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345015c030 msgr2=0x7f345014ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3455256640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345015c030 0x7f345014ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3455256640 1 -- 172.21.15.67:0/1084679936 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3450073030 con 0x7f345015d1d0 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f344ffff640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345015c030 0x7f345014ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3455256640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015d1d0 0x7f345014b260 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f344800cef0 tx=0x7f344800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f344d7fa640 1 -- 172.21.15.67:0/1084679936 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344801a070 con 0x7f345015d1d0 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f344d7fa640 1 -- 172.21.15.67:0/1084679936 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f344800d860 con 0x7f345015d1d0 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3456cb9640 1 -- 172.21.15.67:0/1084679936 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3450073310 con 0x7f345015d1d0 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f344d7fa640 1 -- 172.21.15.67:0/1084679936 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344800dc50 con 0x7f345015d1d0 2024-09-19T05:37:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3456cb9640 1 -- 172.21.15.67:0/1084679936 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34500738d0 con 0x7f345015d1d0 2024-09-19T05:37:37.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f344d7fa640 1 -- 172.21.15.67:0/1084679936 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f344801d070 con 0x7f345015d1d0 2024-09-19T05:37:37.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f344d7fa640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 0x7f3430069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f344d7fa640 1 -- 172.21.15.67:0/1084679936 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f3448086780 con 0x7f345015d1d0 2024-09-19T05:37:37.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3454a55640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 0x7f3430069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3459d75000 1 Processor -- start 2024-09-19T05:37:37.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3459d75000 1 -- start start 2024-09-19T05:37:37.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.113+0000 7f3454a55640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 0x7f3430069d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f34380ad000 tx=0x7f3438008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8cb20 0x565065b8cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b8d440 0x565065b42d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b43290 0x565065b43670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x565065a2ab60 con 0x565065b8cb20 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x565065991c70 con 0x565065b8d440 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x565065937ed0 con 0x565065b43290 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3454a55640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8cb20 0x565065b8cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3454a55640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8cb20 0x565065b8cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33596/0 (socket says 172.21.15.67:33596) 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3454a55640 1 -- 172.21.15.67:0/1664241235 learned_addr learned my addr 172.21.15.67:0/1664241235 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f344ffff640 1 --2- 172.21.15.67:0/1664241235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b8d440 0x565065b42d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3455256640 1 --2- 172.21.15.67:0/1664241235 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b43290 0x565065b43670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3454a55640 1 -- 172.21.15.67:0/1664241235 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b43290 msgr2=0x565065b43670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3454a55640 1 --2- 172.21.15.67:0/1664241235 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b43290 0x565065b43670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3454a55640 1 -- 172.21.15.67:0/1664241235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b8d440 msgr2=0x565065b42d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3454a55640 1 --2- 172.21.15.67:0/1664241235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b8d440 0x565065b42d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3454a55640 1 -- 172.21.15.67:0/1664241235 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565065949e50 con 0x565065b8cb20 2024-09-19T05:37:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3455256640 1 --2- 172.21.15.67:0/1664241235 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b43290 0x565065b43670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3454a55640 1 --2- 172.21.15.67:0/1664241235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8cb20 0x565065b8cf00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f343801ab90 tx=0x7f34380a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd547e4b770ff3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f34467fc640 1 -- 172.21.15.67:0/1664241235 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380c6070 con 0x565065b8cb20 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f34467fc640 1 -- 172.21.15.67:0/1664241235 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34380b6620 con 0x565065b8cb20 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f34467fc640 1 -- 172.21.15.67:0/1664241235 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380b0040 con 0x565065b8cb20 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- 172.21.15.67:0/1664241235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8cb20 msgr2=0x565065b8cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 --2- 172.21.15.67:0/1664241235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8cb20 0x565065b8cf00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f343801ab90 tx=0x7f34380a6000 comp rx=0 tx=0).stop 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- 172.21.15.67:0/1664241235 shutdown_connections 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 --2- 172.21.15.67:0/1664241235 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b43290 0x565065b43670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 --2- 172.21.15.67:0/1664241235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b8d440 0x565065b42d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 --2- 172.21.15.67:0/1664241235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8cb20 0x565065b8cf00 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- 172.21.15.67:0/1664241235 >> 172.21.15.67:0/1664241235 conn(0x565065b49600 msgr2=0x565065b41630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- 172.21.15.67:0/1664241235 shutdown_connections 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- 172.21.15.67:0/1664241235 wait complete. 2024-09-19T05:37:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- start start 2024-09-19T05:37:37.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 Processor -- start 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065b47e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b4dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b48390 0x565065b4e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5650659f3b00 con 0x565065b8d440 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56506596c360 con 0x565065b48390 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5650659692d0 con 0x565065b8cb20 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3459d75000 10 client.0 _ll_register_callbacks cb 0x565065b2e820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f344ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b4dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f344ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b4dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33602/0 (socket says 172.21.15.67:33602) 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f344ffff640 1 -- 172.21.15.67:0/2204138117 learned_addr learned my addr 172.21.15.67:0/2204138117 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3454a55640 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065b47e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f3455256640 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b48390 0x565065b4e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f344ffff640 1 -- 172.21.15.67:0/2204138117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 msgr2=0x565065b47e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f344ffff640 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065b47e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f344ffff640 1 -- 172.21.15.67:0/2204138117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b48390 msgr2=0x565065b4e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.117+0000 7f344ffff640 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b48390 0x565065b4e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f344ffff640 1 -- 172.21.15.67:0/2204138117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565065938120 con 0x565065b8d440 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3454a55640 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065b47e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f344ffff640 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b4dcf0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f344000bfc0 tx=0x7f344000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf27e6154c7cf66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f342f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f342f7fe640 1 -- 172.21.15.67:0/2204138117 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440018020 con 0x565065b8d440 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f342f7fe640 1 -- 172.21.15.67:0/2204138117 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f3440014870 con 0x565065b8d440 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 -- 172.21.15.67:0/2204138117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34380b6620 con 0x565065b8d440 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f342f7fe640 1 -- 172.21.15.67:0/2204138117 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3440022050 con 0x565065b8d440 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 10 client.6396 fetch_fsmap learned FSMap version 36 2024-09-19T05:37:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 -- 172.21.15.67:0/2204138117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x565065931450 con 0x565065b8d440 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f342f7fe640 1 -- 172.21.15.67:0/2204138117 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34380b6620 con 0x565065b8d440 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f342f7fe640 1 -- 172.21.15.67:0/2204138117 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f3440025020 con 0x565065b8d440 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 10 client.6396 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 10 client.6396 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 20 client.6396 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x565065b92f50 0x565065b93330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 4 client.6396 mds_command: new command op to 6261 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 -- 172.21.15.67:0/2204138117 --> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56506592bc00 con 0x565065b92f50 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3454a55640 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x565065b92f50 0x565065b93330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3454a55640 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x565065b92f50 0x565065b93330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6008962e27ed26 server_cookie=c970c8e17168d4cd in_seq=0 out_seq=0 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f342f7fe640 10 client.6396 ms_handle_connect on v2:172.21.15.67:6833/3283833069 2024-09-19T05:37:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f342f7fe640 1 -- 172.21.15.67:0/2204138117 <== mds.0 v2:172.21.15.67:6833/3283833069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56506592bc00 con 0x565065b92f50 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f342f7fe640 10 client.6396 handle_command_reply: tid=0 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 client.6396 shutdown 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 -- 172.21.15.67:0/2204138117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 msgr2=0x565065b4dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b4dcf0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f344000bfc0 tx=0x7f344000f670 comp rx=0 tx=0).stop 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 -- 172.21.15.67:0/2204138117 shutdown_connections 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x565065b92f50 0x565065b93330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b48390 0x565065b4e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b4dcf0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 --2- 172.21.15.67:0/2204138117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065b47e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f342f7fe640 0 client.6396 ms_handle_reset on v2:172.21.15.67:6833/3283833069 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 -- 172.21.15.67:0/2204138117 >> 172.21.15.67:0/2204138117 conn(0x565065b43290 msgr2=0x565065b41d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 -- 172.21.15.67:0/2204138117 shutdown_connections 2024-09-19T05:37:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 1 -- 172.21.15.67:0/2204138117 wait complete. 2024-09-19T05:37:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.121+0000 7f3459d75000 20 client.6396 trim_cache size 0 max 16384 2024-09-19T05:37:37.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 Processor -- start 2024-09-19T05:37:37.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 -- start start 2024-09-19T05:37:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b48390 0x565065b8c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065ba3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b8d440 0x565065ba3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3450202f10 con 0x565065b48390 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f34501f7d50 con 0x565065b8d440 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f34501f83a0 con 0x565065b8cb20 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3454a55640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b48390 0x565065b8c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3454a55640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b48390 0x565065b8c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33604/0 (socket says 172.21.15.67:33604) 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3454a55640 1 -- 172.21.15.67:0/3177554965 learned_addr learned my addr 172.21.15.67:0/3177554965 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3454a55640 1 -- 172.21.15.67:0/3177554965 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 msgr2=0x565065ba3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3454a55640 1 --2- 172.21.15.67:0/3177554965 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065ba3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3454a55640 1 -- 172.21.15.67:0/3177554965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b8d440 msgr2=0x565065ba3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3454a55640 1 --2- 172.21.15.67:0/3177554965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b8d440 0x565065ba3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3454a55640 1 -- 172.21.15.67:0/3177554965 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565065918fd0 con 0x565065b48390 2024-09-19T05:37:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3454a55640 1 --2- 172.21.15.67:0/3177554965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b48390 0x565065b8c4d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f343801c9c0 tx=0x7f3438004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f54a61b7f78ca4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3445ffb640 1 -- 172.21.15.67:0/3177554965 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380c6040 con 0x565065b48390 2024-09-19T05:37:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3445ffb640 1 -- 172.21.15.67:0/3177554965 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34380b6b70 con 0x565065b48390 2024-09-19T05:37:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3445ffb640 1 -- 172.21.15.67:0/3177554965 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380b0040 con 0x565065b48390 2024-09-19T05:37:37.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 -- 172.21.15.67:0/3177554965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b48390 msgr2=0x565065b8c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 --2- 172.21.15.67:0/3177554965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b48390 0x565065b8c4d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f343801c9c0 tx=0x7f3438004740 comp rx=0 tx=0).stop 2024-09-19T05:37:37.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 -- 172.21.15.67:0/3177554965 shutdown_connections 2024-09-19T05:37:37.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 --2- 172.21.15.67:0/3177554965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b8d440 0x565065ba3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 --2- 172.21.15.67:0/3177554965 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065ba3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 --2- 172.21.15.67:0/3177554965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b48390 0x565065b8c4d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 -- 172.21.15.67:0/3177554965 >> 172.21.15.67:0/3177554965 conn(0x565065b43290 msgr2=0x565065b478a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 -- 172.21.15.67:0/3177554965 shutdown_connections 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 -- 172.21.15.67:0/3177554965 wait complete. 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.141+0000 7f3459d75000 1 -- start start 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 Processor -- start 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b48390 0x565065bffe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065c00360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b967f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x565065990f80 con 0x565065b8d440 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x565065949ca0 con 0x565065b48390 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5650659962a0 con 0x565065b8cb20 2024-09-19T05:37:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 10 client.0 _ll_register_callbacks cb 0x7f344000b2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3455256640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3455256640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b967f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33606/0 (socket says 172.21.15.67:33606) 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3455256640 1 -- 172.21.15.67:0/3409389283 learned_addr learned my addr 172.21.15.67:0/3409389283 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3454a55640 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b48390 0x565065bffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f344ffff640 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065c00360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3455256640 1 -- 172.21.15.67:0/3409389283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 msgr2=0x565065c00360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3455256640 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065c00360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3455256640 1 -- 172.21.15.67:0/3409389283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b48390 msgr2=0x565065bffe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3455256640 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b48390 0x565065bffe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3455256640 1 -- 172.21.15.67:0/3409389283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565065a14750 con 0x565065b8d440 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3455256640 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b967f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f344805f100 tx=0x7f3448056a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1dc16706956f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f342f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f342f7fe640 1 -- 172.21.15.67:0/3409389283 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448073060 con 0x565065b8d440 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f342f7fe640 1 -- 172.21.15.67:0/3409389283 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f344805f1a0 con 0x565065b8d440 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- 172.21.15.67:0/3409389283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34380b6b70 con 0x565065b8d440 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f342f7fe640 1 -- 172.21.15.67:0/3409389283 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f344805f3c0 con 0x565065b8d440 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 10 client.6402 fetch_fsmap learned FSMap version 36 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- 172.21.15.67:0/3409389283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x56506591fa30 con 0x565065b8d440 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f342f7fe640 1 -- 172.21.15.67:0/3409389283 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34380b6b70 con 0x565065b8d440 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f342f7fe640 1 -- 172.21.15.67:0/3409389283 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f3448077080 con 0x565065b8d440 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 10 client.6402 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 10 client.6402 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 20 client.6402 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x565065b96d30 0x565065b97110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 4 client.6402 mds_command: new command op to 6261 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:37:37.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- 172.21.15.67:0/3409389283 --> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] -- command(tid 0: {"prefix": "status"}) -- 0x56506599f3a0 con 0x565065b96d30 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3454a55640 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x565065b96d30 0x565065b97110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f342f7fe640 10 client.6402 ms_handle_connect on v2:172.21.15.67:6833/3283833069 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3454a55640 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x565065b96d30 0x565065b97110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=907edba92f15599c server_cookie=ac904f4fba4f59ad in_seq=0 out_seq=0 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f342f7fe640 1 -- 172.21.15.67:0/3409389283 <== mds.0 v2:172.21.15.67:6833/3283833069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56506599f3a0 con 0x565065b96d30 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f342f7fe640 10 client.6402 handle_command_reply: tid=0 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 client.6402 shutdown 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- 172.21.15.67:0/3409389283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 msgr2=0x565065b967f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b967f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f344805f100 tx=0x7f3448056a50 comp rx=0 tx=0).stop 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- 172.21.15.67:0/3409389283 shutdown_connections 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x565065b96d30 0x565065b97110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565065b8d440 0x565065b967f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565065b8cb20 0x565065c00360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 --2- 172.21.15.67:0/3409389283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565065b48390 0x565065bffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- 172.21.15.67:0/3409389283 >> 172.21.15.67:0/3409389283 conn(0x565065b43290 msgr2=0x565065ba2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f342f7fe640 0 client.6402 ms_handle_reset on v2:172.21.15.67:6833/3283833069 2024-09-19T05:37:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- 172.21.15.67:0/3409389283 shutdown_connections 2024-09-19T05:37:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 1 -- 172.21.15.67:0/3409389283 wait complete. 2024-09-19T05:37:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3459d75000 20 client.6402 trim_cache size 0 max 16384 2024-09-19T05:37:37.156 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:37.156 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:37:37.156 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:37:37.156 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 6261, 2024-09-19T05:37:37.156 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:37:37.157 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:37:37.157 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:37:37.157 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 5.7627154129999996, 2024-09-19T05:37:37.157 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 36, 2024-09-19T05:37:37.157 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 68, 2024-09-19T05:37:37.157 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 68, 2024-09-19T05:37:37.157 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 10.750579365 2024-09-19T05:37:37.157 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:37.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 -- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 msgr2=0x7f3430069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 0x7f3430069d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f34380ad000 tx=0x7f3438008040 comp rx=0 tx=0).stop 2024-09-19T05:37:37.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 -- 172.21.15.67:0/1084679936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015d1d0 msgr2=0x7f345014b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015d1d0 0x7f345014b260 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f344800cef0 tx=0x7f344800a710 comp rx=0 tx=0).stop 2024-09-19T05:37:37.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 -- 172.21.15.67:0/1084679936 shutdown_connections 2024-09-19T05:37:37.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345015d1d0 0x7f345014b260 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345015c030 0x7f345014ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 0x7f3430069d80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 --2- 172.21.15.67:0/1084679936 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f345006f460 0x7f34500999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 -- 172.21.15.67:0/1084679936 >> 172.21.15.67:0/1084679936 conn(0x7f34500d0080 msgr2=0x7f345015efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 -- 172.21.15.67:0/1084679936 shutdown_connections 2024-09-19T05:37:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.145+0000 7f3456cb9640 1 -- 172.21.15.67:0/1084679936 wait complete. 2024-09-19T05:37:37.167 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:37:37.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb89a9640 1 Processor -- start 2024-09-19T05:37:37.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb89a9640 1 -- start start 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb89a9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fabb415c030 0x7fabb406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb89a9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fabb406f460 0x7fabb406f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb89a9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb406e3c0 con 0x7fabb415d1d0 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb89a9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fabb406e6a0 con 0x7fabb415c030 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb89a9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fabb406e980 con 0x7fabb406f460 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb259c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fabb415c030 0x7fabb406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb259c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fabb415c030 0x7fabb406dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33616/0 (socket says 172.21.15.67:33616) 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb259c640 1 -- 172.21.15.67:0/4168345723 learned_addr learned my addr 172.21.15.67:0/4168345723 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb2d9d640 1 --2- 172.21.15.67:0/4168345723 >> v2:172.21.15.97:3300/0 conn(0x7fabb406f460 0x7fabb406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb259c640 1 -- 172.21.15.67:0/4168345723 >> v2:172.21.15.97:3300/0 conn(0x7fabb406f460 msgr2=0x7fabb406f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb259c640 1 --2- 172.21.15.67:0/4168345723 >> v2:172.21.15.97:3300/0 conn(0x7fabb406f460 0x7fabb406f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb259c640 1 -- 172.21.15.67:0/4168345723 >> v1:172.21.15.97:6789/0 conn(0x7fabb415d1d0 legacy=0x7fabb40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb259c640 1 -- 172.21.15.67:0/4168345723 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb406ec60 con 0x7fabb415c030 2024-09-19T05:37:37.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.277+0000 7fabb2d9d640 1 --2- 172.21.15.67:0/4168345723 >> v2:172.21.15.97:3300/0 conn(0x7fabb406f460 0x7fabb406f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:37.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb259c640 1 --2- 172.21.15.67:0/4168345723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb415c030 0x7fabb406dde0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fabb40afbf0 tx=0x7faba401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550ea6a71584ff1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb1d9b640 1 -- 172.21.15.67:0/4168345723 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba40b0070 con 0x7fabb415c030 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb1d9b640 1 -- 172.21.15.67:0/4168345723 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba40ab600 con 0x7fabb415c030 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb1d9b640 1 -- 172.21.15.67:0/4168345723 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba40ab9d0 con 0x7fabb415c030 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 -- 172.21.15.67:0/4168345723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb415c030 msgr2=0x7fabb406dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 --2- 172.21.15.67:0/4168345723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb415c030 0x7fabb406dde0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fabb40afbf0 tx=0x7faba401c4e0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 -- 172.21.15.67:0/4168345723 shutdown_connections 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 --2- 172.21.15.67:0/4168345723 >> v2:172.21.15.97:3300/0 conn(0x7fabb406f460 0x7fabb406f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 --2- 172.21.15.67:0/4168345723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb415c030 0x7fabb406dde0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 -- 172.21.15.67:0/4168345723 >> 172.21.15.67:0/4168345723 conn(0x7fabb40d0080 msgr2=0x7fabb40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 -- 172.21.15.67:0/4168345723 shutdown_connections 2024-09-19T05:37:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 -- 172.21.15.67:0/4168345723 wait complete. 2024-09-19T05:37:37.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 Processor -- start 2024-09-19T05:37:37.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 -- start start 2024-09-19T05:37:37.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb406f460 0x7fabb40999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabb415c030 0x7fabb414ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabb415d1d0 0x7fabb414b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fabb415c590 con 0x7fabb406f460 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fabb415c410 con 0x7fabb415c030 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb89a9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fabb41690e0 con 0x7fabb415d1d0 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb406f460 0x7fabb40999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb406f460 0x7fabb40999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33630/0 (socket says 172.21.15.67:33630) 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.281+0000 7fabb259c640 1 -- 172.21.15.67:0/54293631 learned_addr learned my addr 172.21.15.67:0/54293631 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabb2d9d640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabb415d1d0 0x7fabb414b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabb259c640 1 -- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabb415d1d0 msgr2=0x7fabb414b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7faba9d9b640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabb415c030 0x7fabb414ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabb259c640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabb415d1d0 0x7fabb414b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabb259c640 1 -- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabb415c030 msgr2=0x7fabb414ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabb259c640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabb415c030 0x7fabb414ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabb259c640 1 -- 172.21.15.67:0/54293631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb4073030 con 0x7fabb406f460 2024-09-19T05:37:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabb259c640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb406f460 0x7fabb40999e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7faba401a110 tx=0x7faba4019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabab7fe640 1 -- 172.21.15.67:0/54293631 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba40b9070 con 0x7fabb406f460 2024-09-19T05:37:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabab7fe640 1 -- 172.21.15.67:0/54293631 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba40b4600 con 0x7fabb406f460 2024-09-19T05:37:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabb89a9640 1 -- 172.21.15.67:0/54293631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb4073310 con 0x7fabb406f460 2024-09-19T05:37:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabab7fe640 1 -- 172.21.15.67:0/54293631 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba40b0040 con 0x7fabb406f460 2024-09-19T05:37:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabb89a9640 1 -- 172.21.15.67:0/54293631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb40738d0 con 0x7fabb406f460 2024-09-19T05:37:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabb89a9640 1 -- 172.21.15.67:0/54293631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb406f870 con 0x7fabb406f460 2024-09-19T05:37:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabab7fe640 1 -- 172.21.15.67:0/54293631 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faba40bc070 con 0x7fabb406f460 2024-09-19T05:37:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabab7fe640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab940678c0 0x7fab94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7fabab7fe640 1 -- 172.21.15.67:0/54293631 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7faba411ef40 con 0x7fabb406f460 2024-09-19T05:37:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7faba9d9b640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab940678c0 0x7fab94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.285+0000 7faba9d9b640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab940678c0 0x7fab94069d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fabb414a4f0 tx=0x7fab9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.289+0000 7fabab7fe640 1 -- 172.21.15.67:0/54293631 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7faba40160d0 con 0x7fabb406f460 2024-09-19T05:37:37.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 -- 172.21.15.67:0/54293631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fabb40d0f20 con 0x7fabb406f460 2024-09-19T05:37:37.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabab7fe640 1 -- 172.21.15.67:0/54293631 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7faba40ef8f0 con 0x7fabb406f460 2024-09-19T05:37:37.489 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:37:37.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 -- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab940678c0 msgr2=0x7fab94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab940678c0 0x7fab94069d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fabb414a4f0 tx=0x7fab9c008040 comp rx=0 tx=0).stop 2024-09-19T05:37:37.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 -- 172.21.15.67:0/54293631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb406f460 msgr2=0x7fabb40999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb406f460 0x7fabb40999e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7faba401a110 tx=0x7faba4019280 comp rx=0 tx=0).stop 2024-09-19T05:37:37.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 -- 172.21.15.67:0/54293631 shutdown_connections 2024-09-19T05:37:37.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab940678c0 0x7fab94069d80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabb415d1d0 0x7fabb414b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabb415c030 0x7fabb414ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 --2- 172.21.15.67:0/54293631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabb406f460 0x7fabb40999e0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.485+0000 7fabb89a9640 1 -- 172.21.15.67:0/54293631 >> 172.21.15.67:0/54293631 conn(0x7fabb40d0080 msgr2=0x7fabb415efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.489+0000 7fabb89a9640 1 -- 172.21.15.67:0/54293631 shutdown_connections 2024-09-19T05:37:37.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37.489+0000 7fabb89a9640 1 -- 172.21.15.67:0/54293631 wait complete. 2024-09-19T05:37:37.506 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:37:37.507 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:37:37.507 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:37:37.507 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:37:37.507 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:37:37.507 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:37:37.507 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:37:37.507 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:37:37.507 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:37:37.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:37.507 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:37:37.514 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42247sec preferred_lft 42247sec 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:37:37.515 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:37:37.516 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:37.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:37.517 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:37:37.566 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:37:37.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:37.567 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:37:37.618 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:37:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:37:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:37:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:37:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:37:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:37:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:37:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:37:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:37:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:37:37.619 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:37:37.620 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:37:37.620 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:37:37.620 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:37:37.620 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:37:37.620 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:37:37.620 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:37:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:37:37.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:37.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:37.742 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:37:37.747 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:37:37.747 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:37:37.748 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:37:37.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:37.748 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:37:37.802 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:37:37.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:37:37.802 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:37:37.848 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:37:37.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:37:37.848 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:37:37.896 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:37:37.954 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:37:38.002 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:37:38.005 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:37:38.005 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:37:38.005 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:37:38.005 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:37:38.005 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:37:38.005 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:37:38.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:38.006 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:37:38.052 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:37:38.052 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:37:38.097 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:37:38.111 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:37:38.160 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:37:38.160 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:37:38.160 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:37:38.160 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:37:38.160 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:37:38.160 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:37:38.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:37:38.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:37:38.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:38.163 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:37:38.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:37:38.173+0000 7fc61665c580 -1 init, newargv = 0x555f64ad7b20 newargc=15 2024-09-19T05:37:38.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[54343]: starting ceph client 2024-09-19T05:37:38.181 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[54343]: starting fuse 2024-09-19T05:37:38.935 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:37:38.938 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:37:39.281 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:37:39.297 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:37:39.345 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:37:39.345 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:37:39.345 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:37:39.345 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:37:39.345 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:37:39.345 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:37:39.345 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:37:39.346 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:37:39.347 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:37:39.348 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:37:39.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:39.349 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:37:39.400 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:37:39.400 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:37:39.400 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:37:39.400 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:37:39.400 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:37:39.401 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:37:39.402 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:37:39.402 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:37:39.402 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:37:39.402 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:37:39.402 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:37:39.402 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:37:39.402 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:39.402 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:37:39.402 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:37:39.527 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.54343.asok 2024-09-19T05:37:39.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:39.539 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54343.asok 2024-09-19T05:37:39.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:39.540 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54343.asok status 2024-09-19T05:37:39.702 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "54343", 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 6414, 2024-09-19T05:37:39.703 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 6414 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 986704615 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:37:39.704 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 986704615 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.6414 192.168.0.1:0/986704615", 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/986704615", 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 36, 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 68, 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:37:39.705 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:39.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:39.719 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:37:39.719 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:37:39.725 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:37:39.725 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:37:39.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:39.726 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:37:39.785 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-19T05:37:39.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a833a7640 1 Processor -- start 2024-09-19T05:37:39.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a833a7640 1 -- start start 2024-09-19T05:37:39.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a833a7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a7c0b56b0 0x7f3a7c0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:39.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a833a7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a7c15b570 0x7f3a7c0b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:39.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a833a7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7c0b2e70 con 0x7f3a7c15b190 2024-09-19T05:37:39.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a833a7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3a7c0aecd0 con 0x7f3a7c0b56b0 2024-09-19T05:37:39.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a833a7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7c0b2600 con 0x7f3a7c15b570 2024-09-19T05:37:39.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a80942640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a7c0b56b0 0x7f3a7c0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:39.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a81143640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3a7c15b190 0x7f3a7c0b4fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48870/0 (socket says 172.21.15.67:48870) 2024-09-19T05:37:39.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a81143640 1 -- 172.21.15.67:0/1261274876 learned_addr learned my addr 172.21.15.67:0/1261274876 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:39.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a81944640 1 --2- 172.21.15.67:0/1261274876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a7c15b570 0x7f3a7c0b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:39.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a80942640 1 -- 172.21.15.67:0/1261274876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a7c15b570 msgr2=0x7f3a7c0b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:39.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a80942640 1 --2- 172.21.15.67:0/1261274876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a7c15b570 0x7f3a7c0b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:39.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a80942640 1 -- 172.21.15.67:0/1261274876 >> v1:172.21.15.67:6789/0 conn(0x7f3a7c15b190 legacy=0x7f3a7c0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:39.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a80942640 1 -- 172.21.15.67:0/1261274876 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c0b28b0 con 0x7f3a7c0b56b0 2024-09-19T05:37:39.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.957+0000 7f3a73fff640 1 -- 172.21.15.67:0/1261274876 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1737113674 0 0) 0x7f3a7c0b2e70 con 0x7f3a7c15b190 2024-09-19T05:37:39.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a80942640 1 --2- 172.21.15.67:0/1261274876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c0b56b0 0x7f3a7c0b1b80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0097c0 tx=0x7f3a6c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67d69b7ed5d8629 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:39.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a73fff640 1 -- 172.21.15.67:0/1261274876 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0b0070 con 0x7f3a7c0b56b0 2024-09-19T05:37:39.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a73fff640 1 -- 172.21.15.67:0/1261274876 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6c0ab600 con 0x7f3a7c0b56b0 2024-09-19T05:37:39.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a73fff640 1 -- 172.21.15.67:0/1261274876 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0ab9d0 con 0x7f3a7c0b56b0 2024-09-19T05:37:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a833a7640 1 -- 172.21.15.67:0/1261274876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c0b56b0 msgr2=0x7f3a7c0b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a833a7640 1 --2- 172.21.15.67:0/1261274876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c0b56b0 0x7f3a7c0b1b80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0097c0 tx=0x7f3a6c01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:37:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a833a7640 1 -- 172.21.15.67:0/1261274876 shutdown_connections 2024-09-19T05:37:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a833a7640 1 --2- 172.21.15.67:0/1261274876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a7c15b570 0x7f3a7c0b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a833a7640 1 --2- 172.21.15.67:0/1261274876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c0b56b0 0x7f3a7c0b1b80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a833a7640 1 -- 172.21.15.67:0/1261274876 >> 172.21.15.67:0/1261274876 conn(0x7f3a7c073760 msgr2=0x7f3a7c09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a833a7640 1 -- 172.21.15.67:0/1261274876 shutdown_connections 2024-09-19T05:37:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.961+0000 7f3a833a7640 1 -- 172.21.15.67:0/1261274876 wait complete. 2024-09-19T05:37:39.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 Processor -- start 2024-09-19T05:37:39.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 -- start start 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a7c0b56b0 0x7f3a7c0afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a7c15b190 0x7f3a7c1348f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c15b570 0x7f3a7c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c06c860 con 0x7f3a7c15b570 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c06c6e0 con 0x7f3a7c0b56b0 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7c06c9e0 con 0x7f3a7c15b190 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a81944640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c15b570 0x7f3a7c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a81944640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c15b570 0x7f3a7c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33660/0 (socket says 172.21.15.67:33660) 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a81944640 1 -- 172.21.15.67:0/3099799625 learned_addr learned my addr 172.21.15.67:0/3099799625 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a80942640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a7c15b190 0x7f3a7c1348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:39.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a81143640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a7c0b56b0 0x7f3a7c0afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a81944640 1 -- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a7c15b190 msgr2=0x7f3a7c1348f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a81944640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a7c15b190 0x7f3a7c1348f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a81944640 1 -- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a7c0b56b0 msgr2=0x7f3a7c0afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a81944640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a7c0b56b0 0x7f3a7c0afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a81944640 1 -- 172.21.15.67:0/3099799625 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c135340 con 0x7f3a7c15b570 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a81944640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c15b570 0x7f3a7c154440 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c5e0 tx=0x7f3a7800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a71ffb640 1 -- 172.21.15.67:0/3099799625 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78015070 con 0x7f3a7c15b570 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a71ffb640 1 -- 172.21.15.67:0/3099799625 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a78004220 con 0x7f3a7c15b570 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a71ffb640 1 -- 172.21.15.67:0/3099799625 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78003620 con 0x7f3a7c15b570 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 -- 172.21.15.67:0/3099799625 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a7c135620 con 0x7f3a7c15b570 2024-09-19T05:37:39.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 -- 172.21.15.67:0/3099799625 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a7c147060 con 0x7f3a7c15b570 2024-09-19T05:37:39.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.965+0000 7f3a833a7640 1 -- 172.21.15.67:0/3099799625 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a7c0b4fa0 con 0x7f3a7c15b570 2024-09-19T05:37:39.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.969+0000 7f3a71ffb640 1 -- 172.21.15.67:0/3099799625 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a780037c0 con 0x7f3a7c15b570 2024-09-19T05:37:39.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.969+0000 7f3a71ffb640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a600678c0 0x7f3a60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:39.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.969+0000 7f3a71ffb640 1 -- 172.21.15.67:0/3099799625 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f3a78085bd0 con 0x7f3a7c15b570 2024-09-19T05:37:39.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.969+0000 7f3a81143640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a600678c0 0x7f3a60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:39.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.969+0000 7f3a81143640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a600678c0 0x7f3a60069d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3a740012f0 tx=0x7f3a74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:39.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:39.973+0000 7f3a71ffb640 1 -- 172.21.15.67:0/3099799625 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3a78056610 con 0x7f3a7c15b570 2024-09-19T05:37:40.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.137+0000 7f3a833a7640 1 -- 172.21.15.67:0/3099799625 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f3a7c1357f0 con 0x7f3a7c15b570 2024-09-19T05:37:40.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.141+0000 7f3a71ffb640 1 -- 172.21.15.67:0/3099799625 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f3a78055f10 con 0x7f3a7c15b570 2024-09-19T05:37:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 -- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a600678c0 msgr2=0x7f3a60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a600678c0 0x7f3a60069d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3a740012f0 tx=0x7f3a74009040 comp rx=0 tx=0).stop 2024-09-19T05:37:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 -- 172.21.15.67:0/3099799625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c15b570 msgr2=0x7f3a7c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c15b570 0x7f3a7c154440 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c5e0 tx=0x7f3a7800caa0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 -- 172.21.15.67:0/3099799625 shutdown_connections 2024-09-19T05:37:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a7c15b570 0x7f3a7c154440 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a600678c0 0x7f3a60069d80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a7c15b190 0x7f3a7c1348f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 --2- 172.21.15.67:0/3099799625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a7c0b56b0 0x7f3a7c0afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 -- 172.21.15.67:0/3099799625 >> 172.21.15.67:0/3099799625 conn(0x7f3a7c073760 msgr2=0x7f3a7c155140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 -- 172.21.15.67:0/3099799625 shutdown_connections 2024-09-19T05:37:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.145+0000 7f3a833a7640 1 -- 172.21.15.67:0/3099799625 wait complete. 2024-09-19T05:37:40.167 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-19T05:37:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.289+0000 7f9811b28640 1 Processor -- start 2024-09-19T05:37:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.289+0000 7f9811b28640 1 -- start start 2024-09-19T05:37:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.289+0000 7f9811b28640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980c159c60 0x7f980c0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.289+0000 7f9811b28640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f980c15a040 con 0x7f980c0af3a0 2024-09-19T05:37:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.289+0000 7f9811b28640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f980c15c850 con 0x7f980c06ffd0 2024-09-19T05:37:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.289+0000 7f9811b28640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f980c15d460 con 0x7f980c159c60 2024-09-19T05:37:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f980c0af3a0 0x7f980c15fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48884/0 (socket says 172.21.15.67:48884) 2024-09-19T05:37:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980bfff640 1 -- 172.21.15.67:0/1132335974 learned_addr learned my addr 172.21.15.67:0/1132335974 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980b7fe640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980c159c60 0x7f980c0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038908899 0 0) 0x7f980c15a040 con 0x7f980c0af3a0 2024-09-19T05:37:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97f8003530 con 0x7f980c0af3a0 2024-09-19T05:37:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2685134973 0 0) 0x7f97f8003530 con 0x7f980c0af3a0 2024-09-19T05:37:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980c159c60 msgr2=0x7f980c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980c159c60 0x7f980c0ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 >> v1:172.21.15.97:6789/0 conn(0x7f980c06ffd0 legacy=0x7f980c0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980c15cb30 con 0x7f980c0af3a0 2024-09-19T05:37:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9804001680 con 0x7f980c0af3a0 2024-09-19T05:37:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 >> v1:172.21.15.67:6789/0 conn(0x7f980c0af3a0 legacy=0x7f980c15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97f80039f0 0x7f97f8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980c159c60 0x7f97f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f8004d50 0x7f97f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f980c15d460 con 0x7f97f8004d50 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f97f800ba80 con 0x7f97f80039f0 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f97f800bc80 con 0x7f980c159c60 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980bfff640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f8004d50 0x7f97f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980affd640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980c159c60 0x7f97f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980b7fe640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97f80039f0 0x7f97f8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980bfff640 1 -- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980c159c60 msgr2=0x7f97f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980bfff640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980c159c60 0x7f97f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980bfff640 1 -- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97f80039f0 msgr2=0x7f97f8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980bfff640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97f80039f0 0x7f97f8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980bfff640 1 -- 172.21.15.67:0/1132335974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f8003530 con 0x7f97f8004d50 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980bfff640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f8004d50 0x7f97f80051d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f980400c190 tx=0x7f980401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3000c7764817cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804007d00 con 0x7f97f8004d50 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98040a9020 con 0x7f97f8004d50 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.293+0000 7f980a7fc640 1 -- 172.21.15.67:0/1132335974 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98040a5b60 con 0x7f97f8004d50 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- 172.21.15.67:0/1132335974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f8004d50 msgr2=0x7f97f80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 --2- 172.21.15.67:0/1132335974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f8004d50 0x7f97f80051d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f980400c190 tx=0x7f980401cc40 comp rx=0 tx=0).stop 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980bfff640 1 -- 172.21.15.67:0/1132335974 reap_dead start 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- 172.21.15.67:0/1132335974 shutdown_connections 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- 172.21.15.67:0/1132335974 >> 172.21.15.67:0/1132335974 conn(0x7f980c0b1e50 msgr2=0x7f980c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- 172.21.15.67:0/1132335974 shutdown_connections 2024-09-19T05:37:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- 172.21.15.67:0/1132335974 wait complete. 2024-09-19T05:37:40.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 Processor -- start 2024-09-19T05:37:40.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- start start 2024-09-19T05:37:40.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97f8004d50 0x7f980c099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f980c150810 0x7f980c14be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f980c150c90 0x7f980c14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f980c0b3150 con 0x7f980c150810 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f980c15d0f0 con 0x7f980c150c90 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f980c0b32d0 con 0x7f97f8004d50 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f980c150810 0x7f980c14be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f980c150810 0x7f980c14be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33676/0 (socket says 172.21.15.67:33676) 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980affd640 1 -- 172.21.15.67:0/57040798 learned_addr learned my addr 172.21.15.67:0/57040798 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980bfff640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f980c150c90 0x7f980c14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980b7fe640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97f8004d50 0x7f980c099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980affd640 1 -- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97f8004d50 msgr2=0x7f980c099840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980affd640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97f8004d50 0x7f980c099840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980affd640 1 -- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f980c150c90 msgr2=0x7f980c14c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980affd640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f980c150c90 0x7f980c14c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980affd640 1 -- 172.21.15.67:0/57040798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980c14da00 con 0x7f980c150810 2024-09-19T05:37:40.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980b7fe640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97f8004d50 0x7f980c099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:40.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f980affd640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f980c150810 0x7f980c14be40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f97f400e8a0 tx=0x7f97f400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9803fff640 1 -- 172.21.15.67:0/57040798 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4003b90 con 0x7f980c150810 2024-09-19T05:37:40.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9803fff640 1 -- 172.21.15.67:0/57040798 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f4018070 con 0x7f980c150810 2024-09-19T05:37:40.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- 172.21.15.67:0/57040798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980c14dce0 con 0x7f980c150810 2024-09-19T05:37:40.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9803fff640 1 -- 172.21.15.67:0/57040798 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f40050d0 con 0x7f980c150810 2024-09-19T05:37:40.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.297+0000 7f9811b28640 1 -- 172.21.15.67:0/57040798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f980c14e2a0 con 0x7f980c150810 2024-09-19T05:37:40.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.301+0000 7f9811b28640 1 -- 172.21.15.67:0/57040798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f980c0aec90 con 0x7f980c150810 2024-09-19T05:37:40.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.301+0000 7f9803fff640 1 -- 172.21.15.67:0/57040798 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97f4005270 con 0x7f980c150810 2024-09-19T05:37:40.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.301+0000 7f9803fff640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97ec0678f0 0x7f97ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.301+0000 7f9803fff640 1 -- 172.21.15.67:0/57040798 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f97f4085cb0 con 0x7f980c150810 2024-09-19T05:37:40.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.301+0000 7f980b7fe640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97ec0678f0 0x7f97ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.301+0000 7f980b7fe640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97ec0678f0 0x7f97ec069db0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f980c1f59f0 tx=0x7f97fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.305+0000 7f9803fff640 1 -- 172.21.15.67:0/57040798 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f97f40566f0 con 0x7f980c150810 2024-09-19T05:37:40.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.473+0000 7f9811b28640 1 -- 172.21.15.67:0/57040798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f980c0b4a40 con 0x7f980c150810 2024-09-19T05:37:40.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.477+0000 7f9803fff640 1 -- 172.21.15.67:0/57040798 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f97f4055ff0 con 0x7f980c150810 2024-09-19T05:37:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 -- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97ec0678f0 msgr2=0x7f97ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97ec0678f0 0x7f97ec069db0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f980c1f59f0 tx=0x7f97fc008040 comp rx=0 tx=0).stop 2024-09-19T05:37:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 -- 172.21.15.67:0/57040798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f980c150810 msgr2=0x7f980c14be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f980c150810 0x7f980c14be40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f97f400e8a0 tx=0x7f97f400ed60 comp rx=0 tx=0).stop 2024-09-19T05:37:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 -- 172.21.15.67:0/57040798 shutdown_connections 2024-09-19T05:37:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f980c150c90 0x7f980c14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f980c150810 0x7f980c14be40 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97ec0678f0 0x7f97ec069db0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 --2- 172.21.15.67:0/57040798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97f8004d50 0x7f980c099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 -- 172.21.15.67:0/57040798 >> 172.21.15.67:0/57040798 conn(0x7f980c0b1e50 msgr2=0x7f980c06eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 -- 172.21.15.67:0/57040798 shutdown_connections 2024-09-19T05:37:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.481+0000 7f9811b28640 1 -- 172.21.15.67:0/57040798 wait complete. 2024-09-19T05:37:40.503 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-19T05:37:40.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.625+0000 7f7e00461640 1 Processor -- start 2024-09-19T05:37:40.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7e00461640 1 -- start start 2024-09-19T05:37:40.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7e00461640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df80b0010 0x7f7df80b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7e00461640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7df80b7340 con 0x7f7df8070220 2024-09-19T05:37:40.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7e00461640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7df80aed60 con 0x7f7df815b2a0 2024-09-19T05:37:40.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7e00461640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7df80b7060 con 0x7f7df80b0010 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfe9fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7df8070220 0x7f7df80b5500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48888/0 (socket says 172.21.15.67:48888) 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfe9fe640 1 -- 172.21.15.67:0/3898628753 learned_addr learned my addr 172.21.15.67:0/3898628753 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd9fc640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df80b0010 0x7f7df80b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589683349 0 0) 0x7f7df80b7340 con 0x7f7df8070220 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7de4005740 con 0x7f7df8070220 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452071322 0 0) 0x7f7df80aed60 con 0x7f7df815b2a0 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7df80b7340 con 0x7f7df815b2a0 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3952323862 0 0) 0x7f7de4005740 con 0x7f7df8070220 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df80b0010 msgr2=0x7f7df80b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df80b0010 0x7f7df80b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 >> v1:172.21.15.97:6789/0 conn(0x7f7df815b2a0 legacy=0x7f7df80af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df80af000 con 0x7f7df8070220 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7de0001600 con 0x7f7df8070220 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 >> v1:172.21.15.67:6789/0 conn(0x7f7df8070220 legacy=0x7f7df80b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df80b0010 0x7f7de4005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7de4006340 0x7f7de4006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7de4006f60 0x7f7de40073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7df80b7060 con 0x7f7de4006340 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7de400de40 con 0x7f7de4006f60 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7de400e040 con 0x7f7df80b0010 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd9fc640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7de4006340 0x7f7de4006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfe1fd640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df80b0010 0x7f7de4005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfe9fe640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7de4006f60 0x7f7de40073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd9fc640 1 -- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df80b0010 msgr2=0x7f7de4005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd9fc640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df80b0010 0x7f7de4005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd9fc640 1 -- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7de4006f60 msgr2=0x7f7de40073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd9fc640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7de4006f60 0x7f7de40073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.629+0000 7f7dfd9fc640 1 -- 172.21.15.67:0/3898628753 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de4005740 con 0x7f7de4006340 2024-09-19T05:37:40.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7dfd9fc640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7de4006340 0x7f7de4006a20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009ae0 tx=0x7f7de801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a76a52a5cd2e7c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de80b2070 con 0x7f7de4006340 2024-09-19T05:37:40.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de80a55e0 con 0x7f7de4006340 2024-09-19T05:37:40.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7dfd1fb640 1 -- 172.21.15.67:0/3898628753 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de80096b0 con 0x7f7de4006340 2024-09-19T05:37:40.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 -- 172.21.15.67:0/3898628753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7de4006340 msgr2=0x7f7de4006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 --2- 172.21.15.67:0/3898628753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7de4006340 0x7f7de4006a20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009ae0 tx=0x7f7de801ca70 comp rx=0 tx=0).stop 2024-09-19T05:37:40.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7dfe9fe640 1 -- 172.21.15.67:0/3898628753 reap_dead start 2024-09-19T05:37:40.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 -- 172.21.15.67:0/3898628753 shutdown_connections 2024-09-19T05:37:40.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 -- 172.21.15.67:0/3898628753 >> 172.21.15.67:0/3898628753 conn(0x7f7df80b2f40 msgr2=0x7f7df80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:40.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 -- 172.21.15.67:0/3898628753 shutdown_connections 2024-09-19T05:37:40.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 -- 172.21.15.67:0/3898628753 wait complete. 2024-09-19T05:37:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 Processor -- start 2024-09-19T05:37:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 -- start start 2024-09-19T05:37:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7de4006340 0x7f7df8156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df806fc90 0x7f7df80ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df81555d0 0x7f7df81589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7df806bcc0 con 0x7f7df806fc90 2024-09-19T05:37:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7df80b6cd0 con 0x7f7de4006340 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7e00461640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7df806be40 con 0x7f7df81555d0 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7dfd9fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df806fc90 0x7f7df80ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7dfd9fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df806fc90 0x7f7df80ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33704/0 (socket says 172.21.15.67:33704) 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.633+0000 7f7dfd9fc640 1 -- 172.21.15.67:0/2114290080 learned_addr learned my addr 172.21.15.67:0/2114290080 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7dfe1fd640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7de4006340 0x7f7df8156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7dfe9fe640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df81555d0 0x7f7df81589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7dfd9fc640 1 -- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df81555d0 msgr2=0x7f7df81589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7dfd9fc640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df81555d0 0x7f7df81589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7dfd9fc640 1 -- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7de4006340 msgr2=0x7f7df8156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7dfd9fc640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7de4006340 0x7f7df8156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7dfd9fc640 1 -- 172.21.15.67:0/2114290080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df80cafd0 con 0x7f7df806fc90 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7dfd9fc640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df806fc90 0x7f7df80ca860 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7de801c8a0 tx=0x7f7de4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7df6ffd640 1 -- 172.21.15.67:0/2114290080 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de80bc020 con 0x7f7df806fc90 2024-09-19T05:37:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7df6ffd640 1 -- 172.21.15.67:0/2114290080 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de80a5e10 con 0x7f7df806fc90 2024-09-19T05:37:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7e00461640 1 -- 172.21.15.67:0/2114290080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df806f1b0 con 0x7f7df806fc90 2024-09-19T05:37:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7df6ffd640 1 -- 172.21.15.67:0/2114290080 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de80b2040 con 0x7f7df806fc90 2024-09-19T05:37:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7e00461640 1 -- 172.21.15.67:0/2114290080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df806f770 con 0x7f7df806fc90 2024-09-19T05:37:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7e00461640 1 -- 172.21.15.67:0/2114290080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df80b5500 con 0x7f7df806fc90 2024-09-19T05:37:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7df6ffd640 1 -- 172.21.15.67:0/2114290080 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7de8004220 con 0x7f7df806fc90 2024-09-19T05:37:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7df6ffd640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7dd80678f0 0x7f7dd8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7df6ffd640 1 -- 172.21.15.67:0/2114290080 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f7de811fdf0 con 0x7f7df806fc90 2024-09-19T05:37:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7dfe1fd640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7dd80678f0 0x7f7dd8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.637+0000 7f7dfe1fd640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7dd80678f0 0x7f7dd8069db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7df0001470 tx=0x7f7df0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.641+0000 7f7df6ffd640 1 -- 172.21.15.67:0/2114290080 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7de80c6020 con 0x7f7df806fc90 2024-09-19T05:37:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.805+0000 7f7e00461640 1 -- 172.21.15.67:0/2114290080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f7df80afc80 con 0x7f7df806fc90 2024-09-19T05:37:40.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7df6ffd640 1 -- 172.21.15.67:0/2114290080 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v17)=0 v17) ==== 116+0+0 (secure 0 0 0) 0x7f7de8016780 con 0x7f7df806fc90 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 -- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7dd80678f0 msgr2=0x7f7dd8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7dd80678f0 0x7f7dd8069db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7df0001470 tx=0x7f7df0009040 comp rx=0 tx=0).stop 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 -- 172.21.15.67:0/2114290080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df806fc90 msgr2=0x7f7df80ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df806fc90 0x7f7df80ca860 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7de801c8a0 tx=0x7f7de4007a50 comp rx=0 tx=0).stop 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 -- 172.21.15.67:0/2114290080 shutdown_connections 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7dd80678f0 0x7f7dd8069db0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df81555d0 0x7f7df81589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df806fc90 0x7f7df80ca860 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 --2- 172.21.15.67:0/2114290080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7de4006340 0x7f7df8156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 -- 172.21.15.67:0/2114290080 >> 172.21.15.67:0/2114290080 conn(0x7f7df80b2f40 msgr2=0x7f7df80b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 -- 172.21.15.67:0/2114290080 shutdown_connections 2024-09-19T05:37:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40.813+0000 7f7e00461640 1 -- 172.21.15.67:0/2114290080 wait complete. 2024-09-19T05:37:40.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:40.835 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-19T05:37:40.847 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:37:40.847 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:37:40.848 DEBUG:teuthology.orchestra.run.smithi067:> import stat 2024-09-19T05:37:40.848 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:40.848 DEBUG:teuthology.orchestra.run.smithi067:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-19T05:37:40.848 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:37:40.962 INFO:teuthology.orchestra.run.smithi067.stdout:1099511627776 2024-09-19T05:37:40.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:40.972 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:41.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb604096640 1 Processor -- start 2024-09-19T05:37:41.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb604096640 1 -- start start 2024-09-19T05:37:41.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb604096640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5fc158ce0 0x7fb5fc15ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb604096640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc0cd810 con 0x7fb5fc0cd030 2024-09-19T05:37:41.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb604096640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc0cdaf0 con 0x7fb5fc0722b0 2024-09-19T05:37:41.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb604096640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb5fc0ce420 con 0x7fb5fc158ce0 2024-09-19T05:37:41.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb601631640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb5fc0cd030 0x7fb5fc0ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48904/0 (socket says 172.21.15.67:48904) 2024-09-19T05:37:41.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb601631640 1 -- 172.21.15.67:0/3390951911 learned_addr learned my addr 172.21.15.67:0/3390951911 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:41.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb601e32640 1 --2- 172.21.15.67:0/3390951911 >> v2:172.21.15.97:3300/0 conn(0x7fb5fc158ce0 0x7fb5fc15ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 15886167 0 0) 0x7fb5fc0cd810 con 0x7fb5fc0cd030 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e8003530 con 0x7fb5fc0cd030 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2225809157 0 0) 0x7fb5e8003530 con 0x7fb5fc0cd030 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 >> v2:172.21.15.97:3300/0 conn(0x7fb5fc158ce0 msgr2=0x7fb5fc15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 --2- 172.21.15.67:0/3390951911 >> v2:172.21.15.97:3300/0 conn(0x7fb5fc158ce0 0x7fb5fc15ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 >> v1:172.21.15.97:6789/0 conn(0x7fb5fc0722b0 legacy=0x7fb5fc0726c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc0cddd0 con 0x7fb5fc0cd030 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fb5ec001680 con 0x7fb5fc0cd030 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 >> v1:172.21.15.67:6789/0 conn(0x7fb5fc0cd030 legacy=0x7fb5fc0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5e80039c0 0x7fb5e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5e80043c0 0x7fb5e8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc0ce420 con 0x7fb5e8005090 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e800bff0 con 0x7fb5e80039c0 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e800c1f0 con 0x7fb5e80043c0 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb602633640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb601631640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5e80043c0 0x7fb5e8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb601e32640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5e80039c0 0x7fb5e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb602633640 1 -- 172.21.15.67:0/3390951911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5e80043c0 msgr2=0x7fb5e8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb602633640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5e80043c0 0x7fb5e8004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb602633640 1 -- 172.21.15.67:0/3390951911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5e80039c0 msgr2=0x7fb5e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb602633640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5e80039c0 0x7fb5e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb602633640 1 -- 172.21.15.67:0/3390951911 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e8003530 con 0x7fb5e8005090 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb601e32640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5e80039c0 0x7fb5e8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:41.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.137+0000 7fb601631640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5e80043c0 0x7fb5e8004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.141+0000 7fb602633640 1 -- 172.21.15.67:0/3390951911 reap_dead start 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.141+0000 7fb602633640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5e800b9d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4001910 tx=0x7fb5f401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4895c12d1d252f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.141+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4001510 con 0x7fb5e8005090 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.141+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f40052f0 con 0x7fb5e8005090 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.141+0000 7fb600e30640 1 -- 172.21.15.67:0/3390951911 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4003840 con 0x7fb5e8005090 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- 172.21.15.67:0/3390951911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 msgr2=0x7fb5e800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5e800b9d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4001910 tx=0x7fb5f401c560 comp rx=0 tx=0).stop 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- 172.21.15.67:0/3390951911 shutdown_connections 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 --2- 172.21.15.67:0/3390951911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5e800b9d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- 172.21.15.67:0/3390951911 >> 172.21.15.67:0/3390951911 conn(0x7fb5fc06bcc0 msgr2=0x7fb5fc06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- 172.21.15.67:0/3390951911 shutdown_connections 2024-09-19T05:37:41.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- 172.21.15.67:0/3390951911 wait complete. 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 Processor -- start 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- start start 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5fc154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5fc0c9b20 0x7fb5fc0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5fc0cb390 0x7fb5fc0cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc0cd620 con 0x7fb5e8005090 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc0cd4a0 con 0x7fb5fc0cb390 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb5fc15ea90 con 0x7fb5fc0c9b20 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601e32640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5fc154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601e32640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5fc154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33726/0 (socket says 172.21.15.67:33726) 2024-09-19T05:37:41.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601e32640 1 -- 172.21.15.67:0/4133774614 learned_addr learned my addr 172.21.15.67:0/4133774614 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601631640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5fc0c9b20 0x7fb5fc0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb602633640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5fc0cb390 0x7fb5fc0cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601e32640 1 -- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5fc0c9b20 msgr2=0x7fb5fc0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601e32640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5fc0c9b20 0x7fb5fc0c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601e32640 1 -- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5fc0cb390 msgr2=0x7fb5fc0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601e32640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5fc0cb390 0x7fb5fc0cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601e32640 1 -- 172.21.15.67:0/4133774614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc158270 con 0x7fb5e8005090 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601631640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5fc0c9b20 0x7fb5fc0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb601e32640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5fc154190 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800f380 tx=0x7fb5f800f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb5f27fc640 1 -- 172.21.15.67:0/4133774614 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8003ba0 con 0x7fb5e8005090 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb5f27fc640 1 -- 172.21.15.67:0/4133774614 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f8003d40 con 0x7fb5e8005090 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb5f27fc640 1 -- 172.21.15.67:0/4133774614 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8004220 con 0x7fb5e8005090 2024-09-19T05:37:41.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- 172.21.15.67:0/4133774614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5fc154d10 con 0x7fb5e8005090 2024-09-19T05:37:41.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.145+0000 7fb604096640 1 -- 172.21.15.67:0/4133774614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5fc0ca950 con 0x7fb5e8005090 2024-09-19T05:37:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.149+0000 7fb604096640 1 -- 172.21.15.67:0/4133774614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5fc06cc50 con 0x7fb5e8005090 2024-09-19T05:37:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.149+0000 7fb5f27fc640 1 -- 172.21.15.67:0/4133774614 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5f80043c0 con 0x7fb5e8005090 2024-09-19T05:37:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.149+0000 7fb5f27fc640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5e00678c0 0x7fb5e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.149+0000 7fb5f27fc640 1 -- 172.21.15.67:0/4133774614 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fb5f80867f0 con 0x7fb5e8005090 2024-09-19T05:37:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.149+0000 7fb601631640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5e00678c0 0x7fb5e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.149+0000 7fb601631640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5e00678c0 0x7fb5e0069d80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec000fe0 tx=0x7fb5ec001500 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:41.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.153+0000 7fb5f27fc640 1 -- 172.21.15.67:0/4133774614 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb5f8012070 con 0x7fb5e8005090 2024-09-19T05:37:41.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.349+0000 7fb604096640 1 -- 172.21.15.67:0/4133774614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5fc0cd7a0 con 0x7fb5e8005090 2024-09-19T05:37:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.349+0000 7fb5f27fc640 1 -- 172.21.15.67:0/4133774614 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5218 (secure 0 0 0) 0x7fb5f80571a0 con 0x7fb5e8005090 2024-09-19T05:37:41.354 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:41.354 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":36,"btime":"2024-09-19T05:37:34:410317+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/547145733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":547145733},{"type":"v1","addr":"172.21.15.97:6835","nonce":547145733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4281263473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4281263473},{"type":"v1","addr":"172.21.15.97:6837","nonce":4281263473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/403505114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":403505114},{"type":"v1","addr":"172.21.15.67:6834","nonce":403505114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:33.766722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6261":{"gid":6261,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/3283833069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3283833069},{"type":"v1","addr":"172.21.15.67:6835","nonce":3283833069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6261,"qdb_cluster":[6261]},"id":4}]} 2024-09-19T05:37:41.354 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 36 2024-09-19T05:37:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 -- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5e00678c0 msgr2=0x7fb5e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5e00678c0 0x7fb5e0069d80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec000fe0 tx=0x7fb5ec001500 comp rx=0 tx=0).stop 2024-09-19T05:37:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 -- 172.21.15.67:0/4133774614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 msgr2=0x7fb5fc154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5fc154190 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800f380 tx=0x7fb5f800f840 comp rx=0 tx=0).stop 2024-09-19T05:37:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 -- 172.21.15.67:0/4133774614 shutdown_connections 2024-09-19T05:37:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5fc0cb390 0x7fb5fc0cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5e00678c0 0x7fb5e0069d80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5fc0c9b20 0x7fb5fc0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 --2- 172.21.15.67:0/4133774614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5e8005090 0x7fb5fc154190 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 -- 172.21.15.67:0/4133774614 >> 172.21.15.67:0/4133774614 conn(0x7fb5fc06bcc0 msgr2=0x7fb5fc06f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:41.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 -- 172.21.15.67:0/4133774614 shutdown_connections 2024-09-19T05:37:41.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.353+0000 7fb604096640 1 -- 172.21.15.67:0/4133774614 wait complete. 2024-09-19T05:37:41.372 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-19T05:37:41.509 INFO:teuthology.orchestra.run.smithi067.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-19T05:37:40.843892+0000","btime":"2024-09-19T05:37:40.843892+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-19T05:37:40.843892+0000","atime":"2024-09-19T05:37:40.843892+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6414,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6414,"want_loner":6414,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-19T05:37:41.510 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-19T05:37:40.843892+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-19T05:37:40.843892+0000", "change_attr": 0, "client_caps": [ { "client_id": 6414, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-19T05:37:40.843892+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6414, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-19T05:37:40.843892+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6414, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [] } 2024-09-19T05:37:41.510 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:37:41.510 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:41.516 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> import uuid 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> n = 40 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> create_hard_links = False 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> if 0 > 0: 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> create_hard_links = True 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> dpath = os.path.dirname(path) 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> fnameprefix = os.path.basename(path) 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> os.makedirs(dpath, exist_ok=True) 2024-09-19T05:37:41.517 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> try: 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> for i in range(n): 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> with open(fpath, '"'"'w'"'"') as f: 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> f.write(f"{i}") 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> f.flush() 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(f.fileno()) 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> os.unlink(fpath) 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:37:41.518 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(dirfd) 2024-09-19T05:37:41.519 DEBUG:teuthology.orchestra.run.smithi067:> if create_hard_links: 2024-09-19T05:37:41.519 DEBUG:teuthology.orchestra.run.smithi067:> for j in range(0): 2024-09-19T05:37:41.519 DEBUG:teuthology.orchestra.run.smithi067:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-19T05:37:41.519 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:37:41.519 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(dirfd) 2024-09-19T05:37:41.519 DEBUG:teuthology.orchestra.run.smithi067:> finally: 2024-09-19T05:37:41.519 DEBUG:teuthology.orchestra.run.smithi067:> os.close(dirfd) 2024-09-19T05:37:41.519 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:37:41.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:41.749 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:37:41.749 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:41.799 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:37:41.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.973+0000 7ff08dad1640 1 Processor -- start 2024-09-19T05:37:41.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.973+0000 7ff08dad1640 1 -- start start 2024-09-19T05:37:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff08dad1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff08815c030 0x7ff08806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff08dad1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff08806e3c0 con 0x7ff08815d1d0 2024-09-19T05:37:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff08dad1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff08806e6a0 con 0x7ff08806f460 2024-09-19T05:37:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff08dad1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff08806e980 con 0x7ff08815c030 2024-09-19T05:37:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff07ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff08815d1d0 0x7ff0880b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48914/0 (socket says 172.21.15.67:48914) 2024-09-19T05:37:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff07ffff640 1 -- 172.21.15.67:0/1625351759 learned_addr learned my addr 172.21.15.67:0/1625351759 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff0877fe640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff08815c030 0x7ff08806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1474576601 0 0) 0x7ff08806e3c0 con 0x7ff08815d1d0 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff074003530 con 0x7ff08815d1d0 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 363407932 0 0) 0x7ff074003530 con 0x7ff08815d1d0 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff08815c030 msgr2=0x7ff08806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff08815c030 0x7ff08806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 >> v1:172.21.15.97:6789/0 conn(0x7ff08806f460 legacy=0x7ff0880acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08806ec60 con 0x7ff08815d1d0 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7ff070001680 con 0x7ff08815d1d0 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 >> v1:172.21.15.67:6789/0 conn(0x7ff08815d1d0 legacy=0x7ff0880b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 0x7ff074003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff08815c030 0x7ff074004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff074004d50 0x7ff0740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff08806e980 con 0x7ff0740039f0 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff07400ba80 con 0x7ff074004d50 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff07400bc80 con 0x7ff08815c030 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff0877fe640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 0x7ff074003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff07ffff640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff08815c030 0x7ff074004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff087fff640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff074004d50 0x7ff0740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff0877fe640 1 -- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff08815c030 msgr2=0x7ff074004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff0877fe640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff08815c030 0x7ff074004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff0877fe640 1 -- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff074004d50 msgr2=0x7ff0740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff0877fe640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff074004d50 0x7ff0740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.977+0000 7ff0877fe640 1 -- 172.21.15.67:0/1625351759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff074003530 con 0x7ff0740039f0 2024-09-19T05:37:41.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff0877fe640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 0x7ff074003e10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff078009ab0 tx=0x7ff07801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853f9b3610d1d3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:41.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0780b2070 con 0x7ff0740039f0 2024-09-19T05:37:41.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0780a5510 con 0x7ff0740039f0 2024-09-19T05:37:41.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff086ffd640 1 -- 172.21.15.67:0/1625351759 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0780096b0 con 0x7ff0740039f0 2024-09-19T05:37:41.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 -- 172.21.15.67:0/1625351759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 msgr2=0x7ff074003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 --2- 172.21.15.67:0/1625351759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 0x7ff074003e10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff078009ab0 tx=0x7ff07801ca20 comp rx=0 tx=0).stop 2024-09-19T05:37:41.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff087fff640 1 -- 172.21.15.67:0/1625351759 reap_dead start 2024-09-19T05:37:41.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 -- 172.21.15.67:0/1625351759 shutdown_connections 2024-09-19T05:37:41.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 -- 172.21.15.67:0/1625351759 >> 172.21.15.67:0/1625351759 conn(0x7ff0880d0080 msgr2=0x7ff0880d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:41.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 -- 172.21.15.67:0/1625351759 shutdown_connections 2024-09-19T05:37:41.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 -- 172.21.15.67:0/1625351759 wait complete. 2024-09-19T05:37:41.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 Processor -- start 2024-09-19T05:37:41.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 -- start start 2024-09-19T05:37:41.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 0x7ff088148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0881560d0 0x7ff088145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0881630b0 0x7ff088163560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff08815c590 con 0x7ff0740039f0 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff08815c410 con 0x7ff0881560d0 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff08dad1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff0880ad6c0 con 0x7ff0881630b0 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff0877fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 0x7ff088148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff0877fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 0x7ff088148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33746/0 (socket says 172.21.15.67:33746) 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff0877fe640 1 -- 172.21.15.67:0/4211182127 learned_addr learned my addr 172.21.15.67:0/4211182127 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff07ffff640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0881560d0 0x7ff088145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff087fff640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0881630b0 0x7ff088163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff0877fe640 1 -- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0881630b0 msgr2=0x7ff088163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff0877fe640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0881630b0 0x7ff088163560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff0877fe640 1 -- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0881560d0 msgr2=0x7ff088145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff0877fe640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0881560d0 0x7ff088145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff0877fe640 1 -- 172.21.15.67:0/4211182127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff088157150 con 0x7ff0740039f0 2024-09-19T05:37:41.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff07ffff640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0881560d0 0x7ff088145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:41.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff087fff640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0881630b0 0x7ff088163560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:41.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.981+0000 7ff0877fe640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 0x7ff088148970 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff078009ab0 tx=0x7ff074005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:41.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff084ff9640 1 -- 172.21.15.67:0/4211182127 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0780bc030 con 0x7ff0740039f0 2024-09-19T05:37:41.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff084ff9640 1 -- 172.21.15.67:0/4211182127 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07800f000 con 0x7ff0740039f0 2024-09-19T05:37:41.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff08dad1640 1 -- 172.21.15.67:0/4211182127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff088145f40 con 0x7ff0740039f0 2024-09-19T05:37:41.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff084ff9640 1 -- 172.21.15.67:0/4211182127 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0780b2040 con 0x7ff0740039f0 2024-09-19T05:37:41.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff08dad1640 1 -- 172.21.15.67:0/4211182127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0881568b0 con 0x7ff0740039f0 2024-09-19T05:37:41.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff08dad1640 1 -- 172.21.15.67:0/4211182127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08806dde0 con 0x7ff0740039f0 2024-09-19T05:37:41.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff084ff9640 1 -- 172.21.15.67:0/4211182127 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0780bf070 con 0x7ff0740039f0 2024-09-19T05:37:41.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff084ff9640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0680678f0 0x7ff068069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff084ff9640 1 -- 172.21.15.67:0/4211182127 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7ff07811fbe0 con 0x7ff0740039f0 2024-09-19T05:37:41.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff07ffff640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0680678f0 0x7ff068069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.985+0000 7ff07ffff640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0680678f0 0x7ff068069db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff070000f70 tx=0x7ff070000ee0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:41.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:41.989+0000 7ff084ff9640 1 -- 172.21.15.67:0/4211182127 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff078016760 con 0x7ff0740039f0 2024-09-19T05:37:42.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.165+0000 7ff08dad1640 1 -- 172.21.15.67:0/4211182127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff0880d0f20 con 0x7ff0740039f0 2024-09-19T05:37:42.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.165+0000 7ff084ff9640 1 -- 172.21.15.67:0/4211182127 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) ==== 80+0+0 (secure 0 0 0) 0x7ff0780f0620 con 0x7ff0740039f0 2024-09-19T05:37:42.171 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:37:42.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 -- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0680678f0 msgr2=0x7ff068069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0680678f0 0x7ff068069db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff070000f70 tx=0x7ff070000ee0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 -- 172.21.15.67:0/4211182127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 msgr2=0x7ff088148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 0x7ff088148970 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff078009ab0 tx=0x7ff074005840 comp rx=0 tx=0).stop 2024-09-19T05:37:42.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 -- 172.21.15.67:0/4211182127 shutdown_connections 2024-09-19T05:37:42.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0680678f0 0x7ff068069db0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0881630b0 0x7ff088163560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0881560d0 0x7ff088145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 --2- 172.21.15.67:0/4211182127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0740039f0 0x7ff088148970 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 -- 172.21.15.67:0/4211182127 >> 172.21.15.67:0/4211182127 conn(0x7ff0880d0080 msgr2=0x7ff08815c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:42.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 -- 172.21.15.67:0/4211182127 shutdown_connections 2024-09-19T05:37:42.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.169+0000 7ff08dad1640 1 -- 172.21.15.67:0/4211182127 wait complete. 2024-09-19T05:37:42.190 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:37:42.190 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:42.197 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:37:42.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.361+0000 7ff76fbfc640 1 Processor -- start 2024-09-19T05:37:42.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.361+0000 7ff76fbfc640 1 -- start start 2024-09-19T05:37:42.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.361+0000 7ff76fbfc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff7680d1590 0x7ff7680d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.361+0000 7ff76fbfc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7680b51d0 0x7ff7680cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.361+0000 7ff76fbfc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7680d4d40 con 0x7ff768161da0 2024-09-19T05:37:42.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.361+0000 7ff76fbfc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff7680d0840 con 0x7ff7680d1590 2024-09-19T05:37:42.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.361+0000 7ff76fbfc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff7680d5020 con 0x7ff7680b51d0 2024-09-19T05:37:42.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.361+0000 7ff76d197640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff7680d1590 0x7ff7680d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.361+0000 7ff76d197640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff7680d1590 0x7ff7680d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33748/0 (socket says 172.21.15.67:33748) 2024-09-19T05:37:42.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.361+0000 7ff76d197640 1 -- 172.21.15.67:0/771822553 learned_addr learned my addr 172.21.15.67:0/771822553 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:42.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76d197640 1 -- 172.21.15.67:0/771822553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7680b51d0 msgr2=0x7ff7680cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:42.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76e199640 1 --2- 172.21.15.67:0/771822553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7680b51d0 0x7ff7680cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76d197640 1 --2- 172.21.15.67:0/771822553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7680b51d0 0x7ff7680cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76d197640 1 -- 172.21.15.67:0/771822553 >> v1:172.21.15.97:6789/0 conn(0x7ff768161da0 legacy=0x7ff7680d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:42.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76d197640 1 -- 172.21.15.67:0/771822553 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7680d5300 con 0x7ff7680d1590 2024-09-19T05:37:42.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76e199640 1 --2- 172.21.15.67:0/771822553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7680b51d0 0x7ff7680cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:42.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76d197640 1 --2- 172.21.15.67:0/771822553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 0x7ff7680d1af0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff76806caa0 tx=0x7ff75801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bb8d1c836d06aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:42.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76c996640 1 -- 172.21.15.67:0/771822553 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7580b0070 con 0x7ff7680d1590 2024-09-19T05:37:42.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76c996640 1 -- 172.21.15.67:0/771822553 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7580ab600 con 0x7ff7680d1590 2024-09-19T05:37:42.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76c996640 1 -- 172.21.15.67:0/771822553 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7580ab9d0 con 0x7ff7680d1590 2024-09-19T05:37:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76fbfc640 1 -- 172.21.15.67:0/771822553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 msgr2=0x7ff7680d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76fbfc640 1 --2- 172.21.15.67:0/771822553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 0x7ff7680d1af0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff76806caa0 tx=0x7ff75801c4e0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76fbfc640 1 -- 172.21.15.67:0/771822553 shutdown_connections 2024-09-19T05:37:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76fbfc640 1 --2- 172.21.15.67:0/771822553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7680b51d0 0x7ff7680cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76fbfc640 1 --2- 172.21.15.67:0/771822553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 0x7ff7680d1af0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76fbfc640 1 -- 172.21.15.67:0/771822553 >> 172.21.15.67:0/771822553 conn(0x7ff76808bfc0 msgr2=0x7ff7680d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76fbfc640 1 -- 172.21.15.67:0/771822553 shutdown_connections 2024-09-19T05:37:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.365+0000 7ff76fbfc640 1 -- 172.21.15.67:0/771822553 wait complete. 2024-09-19T05:37:42.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 Processor -- start 2024-09-19T05:37:42.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 -- start start 2024-09-19T05:37:42.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7680b51d0 0x7ff768153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 0x7ff768153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff768161da0 0x7ff7681548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff7680d0020 con 0x7ff7680d1590 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff7680cfea0 con 0x7ff7680b51d0 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff7680d01a0 con 0x7ff768161da0 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76d197640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 0x7ff768153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76d197640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 0x7ff768153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33760/0 (socket says 172.21.15.67:33760) 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76d197640 1 -- 172.21.15.67:0/2798871666 learned_addr learned my addr 172.21.15.67:0/2798871666 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76d998640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7680b51d0 0x7ff768153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76e199640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff768161da0 0x7ff7681548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76d197640 1 -- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff768161da0 msgr2=0x7ff7681548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76d197640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff768161da0 0x7ff7681548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76d197640 1 -- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7680b51d0 msgr2=0x7ff768153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76d197640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7680b51d0 0x7ff768153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76d197640 1 -- 172.21.15.67:0/2798871666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff768153a70 con 0x7ff7680d1590 2024-09-19T05:37:42.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76d197640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 0x7ff768153c60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff7580ae040 tx=0x7ff75801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:42.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff75e7fc640 1 -- 172.21.15.67:0/2798871666 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7580ba020 con 0x7ff7680d1590 2024-09-19T05:37:42.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff75e7fc640 1 -- 172.21.15.67:0/2798871666 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7580b6640 con 0x7ff7680d1590 2024-09-19T05:37:42.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff75e7fc640 1 -- 172.21.15.67:0/2798871666 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7580b0040 con 0x7ff7680d1590 2024-09-19T05:37:42.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 -- 172.21.15.67:0/2798871666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7680cb7b0 con 0x7ff7680d1590 2024-09-19T05:37:42.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 -- 172.21.15.67:0/2798871666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7680cde80 con 0x7ff7680d1590 2024-09-19T05:37:42.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff76fbfc640 1 -- 172.21.15.67:0/2798871666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7680cbcd0 con 0x7ff7680d1590 2024-09-19T05:37:42.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.369+0000 7ff75e7fc640 1 -- 172.21.15.67:0/2798871666 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7580bd020 con 0x7ff7680d1590 2024-09-19T05:37:42.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.373+0000 7ff75e7fc640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff74c0678c0 0x7ff74c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.373+0000 7ff75e7fc640 1 -- 172.21.15.67:0/2798871666 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7ff7581201f0 con 0x7ff7680d1590 2024-09-19T05:37:42.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.373+0000 7ff76d998640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff74c0678c0 0x7ff74c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.373+0000 7ff76d998640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff74c0678c0 0x7ff74c069d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff76400b810 tx=0x7ff764008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:42.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.377+0000 7ff75e7fc640 1 -- 172.21.15.67:0/2798871666 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff7580c4030 con 0x7ff7680d1590 2024-09-19T05:37:42.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.553+0000 7ff76fbfc640 1 -- 172.21.15.67:0/2798871666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff7680cb540 con 0x7ff7680d1590 2024-09-19T05:37:42.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.553+0000 7ff75e7fc640 1 -- 172.21.15.67:0/2798871666 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) ==== 80+0+0 (secure 0 0 0) 0x7ff7580160d0 con 0x7ff7680d1590 2024-09-19T05:37:42.558 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 -- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff74c0678c0 msgr2=0x7ff74c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff74c0678c0 0x7ff74c069d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff76400b810 tx=0x7ff764008040 comp rx=0 tx=0).stop 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 -- 172.21.15.67:0/2798871666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 msgr2=0x7ff768153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 0x7ff768153c60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff7580ae040 tx=0x7ff75801ad20 comp rx=0 tx=0).stop 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 -- 172.21.15.67:0/2798871666 shutdown_connections 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff74c0678c0 0x7ff74c069d80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff768161da0 0x7ff7681548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7680d1590 0x7ff768153c60 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 --2- 172.21.15.67:0/2798871666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7680b51d0 0x7ff768153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 -- 172.21.15.67:0/2798871666 >> 172.21.15.67:0/2798871666 conn(0x7ff76808bfc0 msgr2=0x7ff7680b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:42.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 -- 172.21.15.67:0/2798871666 shutdown_connections 2024-09-19T05:37:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:42.557+0000 7ff76fbfc640 1 -- 172.21.15.67:0/2798871666 wait complete. 2024-09-19T05:37:42.578 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:37:42.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:42.579 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:37:42.589 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[54343]: fuse finished with error 0 and tester_r 0 2024-09-19T05:37:42.591 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:37:48.692 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:37:48.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:48.693 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:37:48.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-19T05:37:48.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.873+0000 7fe4202c7640 1 Processor -- start 2024-09-19T05:37:48.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.873+0000 7fe4202c7640 1 -- start start 2024-09-19T05:37:48.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe4202c7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe418159c60 0x7fe4180ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe4202c7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4180af3a0 0x7fe41815fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe4202c7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe41815a040 con 0x7fe41806ffd0 2024-09-19T05:37:48.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe4202c7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe41815d460 con 0x7fe418159c60 2024-09-19T05:37:48.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe4202c7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe41815c850 con 0x7fe4180af3a0 2024-09-19T05:37:48.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41e063640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe418159c60 0x7fe4180ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41e063640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe418159c60 0x7fe4180ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35372/0 (socket says 172.21.15.67:35372) 2024-09-19T05:37:48.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41e063640 1 -- 172.21.15.67:0/3148186028 learned_addr learned my addr 172.21.15.67:0/3148186028 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:48.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41e864640 1 --2- 172.21.15.67:0/3148186028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4180af3a0 0x7fe41815fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41e063640 1 -- 172.21.15.67:0/3148186028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4180af3a0 msgr2=0x7fe41815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41e063640 1 --2- 172.21.15.67:0/3148186028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4180af3a0 0x7fe41815fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41e063640 1 -- 172.21.15.67:0/3148186028 >> v1:172.21.15.97:6789/0 conn(0x7fe41806ffd0 legacy=0x7fe4180aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41e063640 1 -- 172.21.15.67:0/3148186028 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41815cb30 con 0x7fe418159c60 2024-09-19T05:37:48.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41e063640 1 --2- 172.21.15.67:0/3148186028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 0x7fe4180ad130 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009870 tx=0x7fe40c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f118318b1277ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:48.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41d061640 1 -- 172.21.15.67:0/3148186028 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0ab620 con 0x7fe418159c60 2024-09-19T05:37:48.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41d061640 1 -- 172.21.15.67:0/3148186028 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe40c0b0070 con 0x7fe418159c60 2024-09-19T05:37:48.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.877+0000 7fe41d061640 1 -- 172.21.15.67:0/3148186028 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0ab9e0 con 0x7fe418159c60 2024-09-19T05:37:48.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- 172.21.15.67:0/3148186028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 msgr2=0x7fe4180ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 --2- 172.21.15.67:0/3148186028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 0x7fe4180ad130 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009870 tx=0x7fe40c01c460 comp rx=0 tx=0).stop 2024-09-19T05:37:48.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- 172.21.15.67:0/3148186028 shutdown_connections 2024-09-19T05:37:48.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 --2- 172.21.15.67:0/3148186028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4180af3a0 0x7fe41815fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 --2- 172.21.15.67:0/3148186028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 0x7fe4180ad130 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- 172.21.15.67:0/3148186028 >> 172.21.15.67:0/3148186028 conn(0x7fe4180b1e50 msgr2=0x7fe4180b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:48.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- 172.21.15.67:0/3148186028 shutdown_connections 2024-09-19T05:37:48.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- 172.21.15.67:0/3148186028 wait complete. 2024-09-19T05:37:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 Processor -- start 2024-09-19T05:37:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- start start 2024-09-19T05:37:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe41806ffd0 0x7fe41815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4180af3a0 0x7fe4181484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 0x7fe4181489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe418168fb0 con 0x7fe418159c60 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe418168e30 con 0x7fe4180af3a0 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe418169130 con 0x7fe41806ffd0 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41e864640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 0x7fe4181489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41e864640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 0x7fe4181489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35388/0 (socket says 172.21.15.67:35388) 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41e864640 1 -- 172.21.15.67:0/3710002719 learned_addr learned my addr 172.21.15.67:0/3710002719 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41e063640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe41806ffd0 0x7fe41815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41d862640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4180af3a0 0x7fe4181484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41e864640 1 -- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe41806ffd0 msgr2=0x7fe41815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41e864640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe41806ffd0 0x7fe41815a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41e864640 1 -- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4180af3a0 msgr2=0x7fe4181484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41e864640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4180af3a0 0x7fe4181484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41e864640 1 -- 172.21.15.67:0/3710002719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41815acb0 con 0x7fe418159c60 2024-09-19T05:37:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe41e864640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 0x7fe4181489e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe41000c7f0 tx=0x7fe41000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe40affd640 1 -- 172.21.15.67:0/3710002719 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410015070 con 0x7fe418159c60 2024-09-19T05:37:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe40affd640 1 -- 172.21.15.67:0/3710002719 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe410004220 con 0x7fe418159c60 2024-09-19T05:37:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- 172.21.15.67:0/3710002719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41815af90 con 0x7fe418159c60 2024-09-19T05:37:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe40affd640 1 -- 172.21.15.67:0/3710002719 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410003620 con 0x7fe418159c60 2024-09-19T05:37:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.881+0000 7fe4202c7640 1 -- 172.21.15.67:0/3710002719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe41815b550 con 0x7fe418159c60 2024-09-19T05:37:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe40affd640 1 -- 172.21.15.67:0/3710002719 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4100039d0 con 0x7fe418159c60 2024-09-19T05:37:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe40affd640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3fc0678c0 0x7fe3fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe40affd640 1 -- 172.21.15.67:0/3710002719 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fe410085e60 con 0x7fe418159c60 2024-09-19T05:37:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e063640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3fc0678c0 0x7fe3fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe423383000 1 Processor -- start 2024-09-19T05:37:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe423383000 1 -- start start 2024-09-19T05:37:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e063640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3fc0678c0 0x7fe3fc069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0af000 tx=0x7fe40c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:48.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe423383000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 0x55666fbe1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe423383000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe1690 0x55666fb94870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe423383000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fb95190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe423383000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55666fa7e960 con 0x55666fb94db0 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe423383000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55666f9c2900 con 0x55666fbe1690 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe423383000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55666f9e5d40 con 0x55666fbe0d70 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e864640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fb95190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e864640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fb95190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35390/0 (socket says 172.21.15.67:35390) 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e864640 1 -- 172.21.15.67:0/1177281871 learned_addr learned my addr 172.21.15.67:0/1177281871 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41d862640 1 --2- 172.21.15.67:0/1177281871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe1690 0x55666fb94870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e063640 1 --2- 172.21.15.67:0/1177281871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 0x55666fbe1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e864640 1 -- 172.21.15.67:0/1177281871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 msgr2=0x55666fbe1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e864640 1 --2- 172.21.15.67:0/1177281871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 0x55666fbe1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e864640 1 -- 172.21.15.67:0/1177281871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe1690 msgr2=0x55666fb94870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e864640 1 --2- 172.21.15.67:0/1177281871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe1690 0x55666fb94870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e864640 1 -- 172.21.15.67:0/1177281871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55666f98c580 con 0x55666fb94db0 2024-09-19T05:37:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e063640 1 --2- 172.21.15.67:0/1177281871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 0x55666fbe1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.885+0000 7fe41e864640 1 --2- 172.21.15.67:0/1177281871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fb95190 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe41005e910 tx=0x7fe4100563a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ac36d7a1d971ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe3fbfff640 1 -- 172.21.15.67:0/1177281871 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410081070 con 0x55666fb94db0 2024-09-19T05:37:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe3fbfff640 1 -- 172.21.15.67:0/1177281871 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe410054560 con 0x55666fb94db0 2024-09-19T05:37:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe3fbfff640 1 -- 172.21.15.67:0/1177281871 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41001e040 con 0x55666fb94db0 2024-09-19T05:37:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- 172.21.15.67:0/1177281871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 msgr2=0x55666fb95190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 --2- 172.21.15.67:0/1177281871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fb95190 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe41005e910 tx=0x7fe4100563a0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- 172.21.15.67:0/1177281871 shutdown_connections 2024-09-19T05:37:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 --2- 172.21.15.67:0/1177281871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fb95190 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 --2- 172.21.15.67:0/1177281871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe1690 0x55666fb94870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 --2- 172.21.15.67:0/1177281871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 0x55666fbe1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- 172.21.15.67:0/1177281871 >> 172.21.15.67:0/1177281871 conn(0x55666fbc2040 msgr2=0x55666fbc4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- 172.21.15.67:0/1177281871 shutdown_connections 2024-09-19T05:37:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- 172.21.15.67:0/1177281871 wait complete. 2024-09-19T05:37:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- start start 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 Processor -- start 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fb94db0 0x55666fbe7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 0x55666fbe8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbe1690 0x55666fbe8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55666f9e1d00 con 0x55666fbe1690 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55666f9a0aa0 con 0x55666fb94db0 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55666f97f340 con 0x55666fbe0d70 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 10 client.0 _ll_register_callbacks cb 0x55666fb82760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e864640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbe1690 0x55666fbe8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e864640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbe1690 0x55666fbe8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35396/0 (socket says 172.21.15.67:35396) 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e864640 1 -- 172.21.15.67:0/1397751248 learned_addr learned my addr 172.21.15.67:0/1397751248 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e063640 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fb94db0 0x55666fbe7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41d862640 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 0x55666fbe8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e864640 1 -- 172.21.15.67:0/1397751248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 msgr2=0x55666fbe8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e864640 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 0x55666fbe8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e864640 1 -- 172.21.15.67:0/1397751248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fb94db0 msgr2=0x55666fbe7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e864640 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fb94db0 0x55666fbe7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e864640 1 -- 172.21.15.67:0/1397751248 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55666f988dc0 con 0x55666fbe1690 2024-09-19T05:37:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e063640 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fb94db0 0x55666fbe7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e864640 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbe1690 0x55666fbe8760 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe41005a7d0 tx=0x7fe41001b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d042a12e4bc0c90e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe3f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1397751248 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410079060 con 0x55666fbe1690 2024-09-19T05:37:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1397751248 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fe41005a370 con 0x55666fbe1690 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- 172.21.15.67:0/1397751248 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe410054560 con 0x55666fbe1690 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1397751248 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe410074070 con 0x55666fbe1690 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 10 client.6465 fetch_fsmap learned FSMap version 36 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- 172.21.15.67:0/1397751248 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55666f9857f0 con 0x55666fbe1690 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1397751248 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe410054560 con 0x55666fbe1690 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1397751248 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7fe410051fb0 con 0x55666fbe1690 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 10 client.6465 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 10 client.6465 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 20 client.6465 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x55666fbf00b0 0x55666fbf24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 4 client.6465 mds_command: new command op to 6261 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe423383000 1 -- 172.21.15.67:0/1397751248 --> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55666f97fe10 con 0x55666fbf00b0 2024-09-19T05:37:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.889+0000 7fe41e063640 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x55666fbf00b0 0x55666fbf24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe41e063640 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x55666fbf00b0 0x55666fbf24a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=759364fae9496267 server_cookie=1808e34cfee27590 in_seq=0 out_seq=0 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe3f97fa640 10 client.6465 ms_handle_connect on v2:172.21.15.67:6833/3283833069 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1397751248 <== mds.0 v2:172.21.15.67:6833/3283833069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55666f97fe10 con 0x55666fbf00b0 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe3f97fa640 10 client.6465 handle_command_reply: tid=0 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 client.6465 shutdown 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 -- 172.21.15.67:0/1397751248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbe1690 msgr2=0x55666fbe8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbe1690 0x55666fbe8760 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe41005a7d0 tx=0x7fe41001b070 comp rx=0 tx=0).stop 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 -- 172.21.15.67:0/1397751248 shutdown_connections 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x55666fbf00b0 0x55666fbf24a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbe1690 0x55666fbe8760 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbe0d70 0x55666fbe8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 --2- 172.21.15.67:0/1397751248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fb94db0 0x55666fbe7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe3f97fa640 0 client.6465 ms_handle_reset on v2:172.21.15.67:6833/3283833069 2024-09-19T05:37:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 -- 172.21.15.67:0/1397751248 >> 172.21.15.67:0/1397751248 conn(0x55666fbc2040 msgr2=0x55666fb93f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 -- 172.21.15.67:0/1397751248 shutdown_connections 2024-09-19T05:37:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 1 -- 172.21.15.67:0/1397751248 wait complete. 2024-09-19T05:37:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.893+0000 7fe423383000 20 client.6465 trim_cache size 0 max 16384 2024-09-19T05:37:48.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 Processor -- start 2024-09-19T05:37:48.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 -- start start 2024-09-19T05:37:48.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbc2040 0x55666fb9cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fb94db0 0x55666fb9d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 0x55666fbead00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe418202290 con 0x55666fbc2040 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4182012f0 con 0x55666fbe0d70 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe418200650 con 0x55666fb94db0 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e063640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbc2040 0x55666fb9cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e063640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbc2040 0x55666fb9cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35400/0 (socket says 172.21.15.67:35400) 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e063640 1 -- 172.21.15.67:0/1977483143 learned_addr learned my addr 172.21.15.67:0/1977483143 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e864640 1 --2- 172.21.15.67:0/1977483143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 0x55666fbead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41d862640 1 --2- 172.21.15.67:0/1977483143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fb94db0 0x55666fb9d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e063640 1 -- 172.21.15.67:0/1977483143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fb94db0 msgr2=0x55666fb9d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e063640 1 --2- 172.21.15.67:0/1977483143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fb94db0 0x55666fb9d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e063640 1 -- 172.21.15.67:0/1977483143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 msgr2=0x55666fbead00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e063640 1 --2- 172.21.15.67:0/1977483143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 0x55666fbead00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e063640 1 -- 172.21.15.67:0/1977483143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55666f9a3470 con 0x55666fbc2040 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e864640 1 --2- 172.21.15.67:0/1977483143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 0x55666fbead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe41e063640 1 --2- 172.21.15.67:0/1977483143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbc2040 0x55666fb9cc30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe40c01c940 tx=0x7fe40c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66007bb3bb9a4e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe3fb7fe640 1 -- 172.21.15.67:0/1977483143 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0ba070 con 0x55666fbc2040 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe3fb7fe640 1 -- 172.21.15.67:0/1977483143 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe40c0b0040 con 0x55666fbc2040 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe3fb7fe640 1 -- 172.21.15.67:0/1977483143 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0bedd0 con 0x55666fbc2040 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 -- 172.21.15.67:0/1977483143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbc2040 msgr2=0x55666fb9cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 --2- 172.21.15.67:0/1977483143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbc2040 0x55666fb9cc30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe40c01c940 tx=0x7fe40c009240 comp rx=0 tx=0).stop 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 -- 172.21.15.67:0/1977483143 shutdown_connections 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 --2- 172.21.15.67:0/1977483143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 0x55666fbead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 --2- 172.21.15.67:0/1977483143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fb94db0 0x55666fb9d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 --2- 172.21.15.67:0/1977483143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fbc2040 0x55666fb9cc30 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 -- 172.21.15.67:0/1977483143 >> 172.21.15.67:0/1977483143 conn(0x55666fb99890 msgr2=0x55666fbe7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 -- 172.21.15.67:0/1977483143 shutdown_connections 2024-09-19T05:37:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 -- 172.21.15.67:0/1977483143 wait complete. 2024-09-19T05:37:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 -- start start 2024-09-19T05:37:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.909+0000 7fe423383000 1 Processor -- start 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fbed950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbc2040 0x55666fc54e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 0x55666fc55370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55666fb94bc0 con 0x55666fb94db0 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55666faa20c0 con 0x55666fbe0d70 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55666fa25780 con 0x55666fbc2040 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 10 client.0 _ll_register_callbacks cb 0x7fe410055cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41e063640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fbed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41e063640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fbed950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35404/0 (socket says 172.21.15.67:35404) 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41e063640 1 -- 172.21.15.67:0/1864295061 learned_addr learned my addr 172.21.15.67:0/1864295061 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41d862640 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbc2040 0x55666fc54e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41e063640 1 -- 172.21.15.67:0/1864295061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbc2040 msgr2=0x55666fc54e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41e063640 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbc2040 0x55666fc54e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41e864640 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 0x55666fc55370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41e063640 1 -- 172.21.15.67:0/1864295061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 msgr2=0x55666fc55370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41e063640 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 0x55666fc55370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41e063640 1 -- 172.21.15.67:0/1864295061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55666f979640 con 0x55666fb94db0 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41e063640 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fbed950 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe40c01c4a0 tx=0x7fe40c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8869dc239a7f2c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe3f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1864295061 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0ba030 con 0x55666fb94db0 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1864295061 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fe40c0becd0 con 0x55666fb94db0 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 1 -- 172.21.15.67:0/1864295061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe40c0b0040 con 0x55666fb94db0 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1864295061 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe40c0cd040 con 0x55666fb94db0 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 10 client.6471 fetch_fsmap learned FSMap version 36 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 1 -- 172.21.15.67:0/1864295061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55666f97d3b0 con 0x55666fb94db0 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1864295061 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe40c0b0040 con 0x55666fb94db0 2024-09-19T05:37:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1864295061 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7fe40c0c8420 con 0x55666fb94db0 2024-09-19T05:37:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 10 client.6471 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T05:37:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 10 client.6471 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-19T05:37:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 20 client.6471 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x55666fbe1690 0x55666fc558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 4 client.6471 mds_command: new command op to 6261 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:37:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe423383000 1 -- 172.21.15.67:0/1864295061 --> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55666f9f3470 con 0x55666fbe1690 2024-09-19T05:37:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41d862640 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x55666fbe1690 0x55666fc558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe41d862640 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x55666fbe1690 0x55666fc558b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b8abf3cf5f9a82 server_cookie=36d06653fc9b4bce in_seq=0 out_seq=0 2024-09-19T05:37:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.913+0000 7fe3f97fa640 10 client.6471 ms_handle_connect on v2:172.21.15.67:6833/3283833069 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe3f97fa640 1 -- 172.21.15.67:0/1864295061 <== mds.0 v2:172.21.15.67:6833/3283833069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55666f9f3470 con 0x55666fbe1690 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe3f97fa640 10 client.6471 handle_command_reply: tid=0 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 client.6471 shutdown 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 -- 172.21.15.67:0/1864295061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 msgr2=0x55666fbed950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fbed950 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe40c01c4a0 tx=0x7fe40c0046d0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 -- 172.21.15.67:0/1864295061 shutdown_connections 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.67:6833/3283833069,v1:172.21.15.67:6835/3283833069] conn(0x55666fbe1690 0x55666fc558b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55666fbe0d70 0x55666fc55370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55666fbc2040 0x55666fc54e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe3f97fa640 0 client.6471 ms_handle_reset on v2:172.21.15.67:6833/3283833069 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 --2- 172.21.15.67:0/1864295061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55666fb94db0 0x55666fbed950 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 -- 172.21.15.67:0/1864295061 >> 172.21.15.67:0/1864295061 conn(0x55666fb99890 msgr2=0x55666fb9c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 -- 172.21.15.67:0/1864295061 shutdown_connections 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 1 -- 172.21.15.67:0/1864295061 wait complete. 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe423383000 20 client.6471 trim_cache size 0 max 16384 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 -- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3fc0678c0 msgr2=0x7fe3fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3fc0678c0 0x7fe3fc069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0af000 tx=0x7fe40c0a7000 comp rx=0 tx=0).stop 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 -- 172.21.15.67:0/3710002719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 msgr2=0x7fe4181489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 0x7fe4181489e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe41000c7f0 tx=0x7fe41000ccb0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 -- 172.21.15.67:0/3710002719 shutdown_connections 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe418159c60 0x7fe4181489e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4180af3a0 0x7fe4181484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3fc0678c0 0x7fe3fc069d80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 --2- 172.21.15.67:0/3710002719 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe41806ffd0 0x7fe41815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 -- 172.21.15.67:0/3710002719 >> 172.21.15.67:0/3710002719 conn(0x7fe4180b1e50 msgr2=0x7fe4180b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 -- 172.21.15.67:0/3710002719 shutdown_connections 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:48.937+0000 7fe4202c7640 1 -- 172.21.15.67:0/3710002719 wait complete. 2024-09-19T05:37:48.960 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:37:48.960 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:37:48.960 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:37:48.960 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:37:48.961 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:37:48.961 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:37:48.961 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:37:48.961 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:37:48.970 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:37:48.970 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-19T05:37:48.972 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:37:48.972 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-19T05:37:48.974 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:37:48.974 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-19T05:37:48.976 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:37:48.976 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-19T05:37:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46e013f640 1 Processor -- start 2024-09-19T05:37:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fb52378e640 1 Processor -- start 2024-09-19T05:37:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46e013f640 1 -- start start 2024-09-19T05:37:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fb52378e640 1 -- start start 2024-09-19T05:37:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fee0425d640 1 Processor -- start 2024-09-19T05:37:49.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fee0425d640 1 -- start start 2024-09-19T05:37:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f0481a91640 1 Processor -- start 2024-09-19T05:37:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f0481a91640 1 -- start start 2024-09-19T05:37:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fb52378e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 0x7fb51c06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46e013f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f46d80d1d70 0x7f46d80d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46e013f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f46d80d1420 0x7f46d80ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46e013f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d80cdae0 con 0x7f46d815b210 2024-09-19T05:37:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46e013f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f46d80cd890 con 0x7f46d80d1d70 2024-09-19T05:37:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46e013f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f46d80cddc0 con 0x7f46d80d1420 2024-09-19T05:37:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fb52378e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c0ae3d0 con 0x7fb51c15cd50 2024-09-19T05:37:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fb52378e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c0b25c0 con 0x7fb51c06c200 2024-09-19T05:37:49.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fb52378e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c15da20 con 0x7fb51c0b6cf0 2024-09-19T05:37:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fee0425d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc15b210 0x7fedfc0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46dd6da640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f46d80d1d70 0x7f46d80d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46dd6da640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f46d80d1d70 0x7f46d80d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35410/0 (socket says 172.21.15.67:35410) 2024-09-19T05:37:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46dd6da640 1 -- 172.21.15.67:0/1020178923 learned_addr learned my addr 172.21.15.67:0/1020178923 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46de6dc640 1 --2- 172.21.15.67:0/1020178923 >> v2:172.21.15.97:3300/0 conn(0x7f46d80d1420 0x7f46d80ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46dd6da640 1 -- 172.21.15.67:0/1020178923 >> v2:172.21.15.97:3300/0 conn(0x7f46d80d1420 msgr2=0x7f46d80ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:49.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46dd6da640 1 --2- 172.21.15.67:0/1020178923 >> v2:172.21.15.97:3300/0 conn(0x7f46d80d1420 0x7f46d80ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46dd6da640 1 -- 172.21.15.67:0/1020178923 >> v1:172.21.15.97:6789/0 conn(0x7f46d815b210 legacy=0x7f46d80b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7f46dd6da640 1 -- 172.21.15.67:0/1020178923 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d80ce0a0 con 0x7f46d80d1d70 2024-09-19T05:37:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fb52152a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb51c15cd50 0x7fb51c15d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42230/0 (socket says 172.21.15.67:42230) 2024-09-19T05:37:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fb52152a640 1 -- 172.21.15.67:0/350915625 learned_addr learned my addr 172.21.15.67:0/350915625 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fb520d29640 1 --2- 172.21.15.67:0/350915625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 0x7fb51c06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fb513fff640 1 -- 172.21.15.67:0/350915625 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102753665 0 0) 0x7fb518001120 con 0x7fb51c15cd50 2024-09-19T05:37:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7fb513fff640 1 -- 172.21.15.67:0/350915625 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb508003530 con 0x7fb51c15cd50 2024-09-19T05:37:49.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fee0425d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedfc0cdae0 con 0x7fedfc0d1d70 2024-09-19T05:37:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fee0425d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedfc0cddc0 con 0x7fedfc0d15f0 2024-09-19T05:37:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fee0425d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fedfc0cd890 con 0x7fedfc15b210 2024-09-19T05:37:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fee017f8640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fedfc0d1d70 0x7fedfc0d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42232/0 (socket says 172.21.15.67:42232) 2024-09-19T05:37:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fee017f8640 1 -- 172.21.15.67:0/3149042116 learned_addr learned my addr 172.21.15.67:0/3149042116 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fee01ff9640 1 --2- 172.21.15.67:0/3149042116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc15b210 0x7fedfc0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.125+0000 7fee00ff7640 1 -- 172.21.15.67:0/3149042116 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158952341 0 0) 0x7fedfc0cdae0 con 0x7fedfc0d1d70 2024-09-19T05:37:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7fee00ff7640 1 -- 172.21.15.67:0/3149042116 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede8003530 con 0x7fedfc0d1d70 2024-09-19T05:37:49.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f0481a91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f047c0cf070 0x7f047c15e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f0481a91640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f047c15ef30 0x7f047c0d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f0481a91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f047c0cf510 con 0x7f047c15e610 2024-09-19T05:37:49.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f0481a91640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f047c0d0120 con 0x7f047c15ef30 2024-09-19T05:37:49.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f0481a91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f047c0cf7f0 con 0x7f047c0cf070 2024-09-19T05:37:49.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7fb520d29640 1 -- 172.21.15.67:0/350915625 >> v1:172.21.15.97:6789/0 conn(0x7fb51c06c200 legacy=0x7fb51c15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7fb520d29640 1 -- 172.21.15.67:0/350915625 >> v1:172.21.15.67:6789/0 conn(0x7fb51c15cd50 legacy=0x7fb51c15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7fb520d29640 1 -- 172.21.15.67:0/350915625 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c0b28a0 con 0x7fb51c0b6cf0 2024-09-19T05:37:49.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f047c15ef30 0x7f047c0d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7fee01ff9640 1 -- 172.21.15.67:0/3149042116 >> v1:172.21.15.97:6789/0 conn(0x7fedfc0d15f0 legacy=0x7fedfc0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047b7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f047c15e610 0x7f047c162a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:45976/0 (socket says 172.21.15.67:45976) 2024-09-19T05:37:49.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047b7fe640 1 -- 172.21.15.67:0/898411783 learned_addr learned my addr 172.21.15.67:0/898411783 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:49.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7fee01ff9640 1 -- 172.21.15.67:0/3149042116 >> v1:172.21.15.67:6789/0 conn(0x7fedfc0d1d70 legacy=0x7fedfc0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7fee01ff9640 1 -- 172.21.15.67:0/3149042116 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc0ce0a0 con 0x7fedfc15b210 2024-09-19T05:37:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047affd640 1 --2- 172.21.15.67:0/898411783 >> v2:172.21.15.97:3300/0 conn(0x7f047c0cf070 0x7f047c15e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047a7fc640 1 -- 172.21.15.67:0/898411783 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873723405 0 0) 0x7f047c0cf510 con 0x7f047c15e610 2024-09-19T05:37:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047a7fc640 1 -- 172.21.15.67:0/898411783 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0464003530 con 0x7f047c15e610 2024-09-19T05:37:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047bfff640 1 -- 172.21.15.67:0/898411783 >> v2:172.21.15.97:3300/0 conn(0x7f047c0cf070 msgr2=0x7f047c15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047bfff640 1 --2- 172.21.15.67:0/898411783 >> v2:172.21.15.97:3300/0 conn(0x7f047c0cf070 0x7f047c15e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047bfff640 1 -- 172.21.15.67:0/898411783 >> v1:172.21.15.97:6789/0 conn(0x7f047c15e610 legacy=0x7f047c162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047bfff640 1 -- 172.21.15.67:0/898411783 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c0cfad0 con 0x7f047c15ef30 2024-09-19T05:37:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46dd6da640 1 --2- 172.21.15.67:0/1020178923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 0x7f46d80d0ee0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f46d8074020 tx=0x7f46c801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba472be0442bfb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46dced9640 1 -- 172.21.15.67:0/1020178923 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c80b2070 con 0x7f46d80d1d70 2024-09-19T05:37:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46dced9640 1 -- 172.21.15.67:0/1020178923 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c80a9070 con 0x7f46d80d1d70 2024-09-19T05:37:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46dced9640 1 -- 172.21.15.67:0/1020178923 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c80ad880 con 0x7f46d80d1d70 2024-09-19T05:37:49.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46e013f640 1 -- 172.21.15.67:0/1020178923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 msgr2=0x7f46d80d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46e013f640 1 --2- 172.21.15.67:0/1020178923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 0x7f46d80d0ee0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f46d8074020 tx=0x7f46c801c450 comp rx=0 tx=0).stop 2024-09-19T05:37:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047bfff640 1 --2- 172.21.15.67:0/898411783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c15ef30 0x7f047c0d2070 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f047c0d0860 tx=0x7f047401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546a299439f85f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047a7fc640 1 -- 172.21.15.67:0/898411783 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04740b2070 con 0x7f047c15ef30 2024-09-19T05:37:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46e013f640 1 -- 172.21.15.67:0/1020178923 shutdown_connections 2024-09-19T05:37:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46e013f640 1 --2- 172.21.15.67:0/1020178923 >> v2:172.21.15.97:3300/0 conn(0x7f46d80d1420 0x7f46d80ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46e013f640 1 --2- 172.21.15.67:0/1020178923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 0x7f46d80d0ee0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047a7fc640 1 -- 172.21.15.67:0/898411783 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04740a59e0 con 0x7f047c15ef30 2024-09-19T05:37:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46e013f640 1 -- 172.21.15.67:0/1020178923 >> 172.21.15.67:0/1020178923 conn(0x7f46d809aa30 msgr2=0x7f46d80b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f047a7fc640 1 -- 172.21.15.67:0/898411783 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04740a5d90 con 0x7f047c15ef30 2024-09-19T05:37:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46e013f640 1 -- 172.21.15.67:0/1020178923 shutdown_connections 2024-09-19T05:37:49.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7f46e013f640 1 -- 172.21.15.67:0/1020178923 wait complete. 2024-09-19T05:37:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7fb520d29640 1 --2- 172.21.15.67:0/350915625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 0x7fb51c06bcc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0097f0 tx=0x7fb50c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b67ba58a058dd7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.129+0000 7fee01ff9640 1 --2- 172.21.15.67:0/3149042116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc15b210 0x7fedfc0b40c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fedec0097f0 tx=0x7fedec01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf6a623445041236 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb513fff640 1 -- 172.21.15.67:0/350915625 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0b0070 con 0x7fb51c0b6cf0 2024-09-19T05:37:49.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb513fff640 1 -- 172.21.15.67:0/350915625 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50c0ab600 con 0x7fb51c0b6cf0 2024-09-19T05:37:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb513fff640 1 -- 172.21.15.67:0/350915625 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0ab9b0 con 0x7fb51c0b6cf0 2024-09-19T05:37:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fee00ff7640 1 -- 172.21.15.67:0/3149042116 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0ab610 con 0x7fedfc15b210 2024-09-19T05:37:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fee00ff7640 1 -- 172.21.15.67:0/3149042116 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedec0b0070 con 0x7fedfc15b210 2024-09-19T05:37:49.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fee00ff7640 1 -- 172.21.15.67:0/3149042116 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0ab9d0 con 0x7fedfc15b210 2024-09-19T05:37:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 -- 172.21.15.67:0/898411783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c15ef30 msgr2=0x7f047c0d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 --2- 172.21.15.67:0/898411783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c15ef30 0x7f047c0d2070 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f047c0d0860 tx=0x7f047401c900 comp rx=0 tx=0).stop 2024-09-19T05:37:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 -- 172.21.15.67:0/898411783 shutdown_connections 2024-09-19T05:37:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 --2- 172.21.15.67:0/898411783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c15ef30 0x7f047c0d2070 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 --2- 172.21.15.67:0/898411783 >> v2:172.21.15.97:3300/0 conn(0x7f047c0cf070 0x7f047c15e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 -- 172.21.15.67:0/898411783 >> 172.21.15.67:0/898411783 conn(0x7f047c08bfc0 msgr2=0x7f047c0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 -- 172.21.15.67:0/898411783 shutdown_connections 2024-09-19T05:37:49.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 -- 172.21.15.67:0/898411783 wait complete. 2024-09-19T05:37:49.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 -- 172.21.15.67:0/350915625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 msgr2=0x7fb51c06bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 --2- 172.21.15.67:0/350915625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 0x7fb51c06bcc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0097f0 tx=0x7fb50c01c4e0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 -- 172.21.15.67:0/350915625 shutdown_connections 2024-09-19T05:37:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 --2- 172.21.15.67:0/350915625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 0x7fb51c06bcc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 -- 172.21.15.67:0/350915625 >> 172.21.15.67:0/350915625 conn(0x7fb51c09aa30 msgr2=0x7fb51c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 -- 172.21.15.67:0/350915625 shutdown_connections 2024-09-19T05:37:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 -- 172.21.15.67:0/350915625 wait complete. 2024-09-19T05:37:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fee0425d640 1 -- 172.21.15.67:0/3149042116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc15b210 msgr2=0x7fedfc0b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fee0425d640 1 --2- 172.21.15.67:0/3149042116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc15b210 0x7fedfc0b40c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fedec0097f0 tx=0x7fedec01c500 comp rx=0 tx=0).stop 2024-09-19T05:37:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46e013f640 1 Processor -- start 2024-09-19T05:37:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46e013f640 1 -- start start 2024-09-19T05:37:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 Processor -- start 2024-09-19T05:37:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 -- start start 2024-09-19T05:37:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46e013f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46d80d1420 0x7f46d814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46e013f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 0x7f46d809b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46e013f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46d815b210 0x7f46d80b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46e013f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f46d80cf980 con 0x7f46d80d1d70 2024-09-19T05:37:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46e013f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f46d80cf800 con 0x7f46d80d1420 2024-09-19T05:37:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46e013f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f46d80cfb00 con 0x7f46d815b210 2024-09-19T05:37:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46dd6da640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 0x7f46d809b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46dd6da640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 0x7f46d809b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35440/0 (socket says 172.21.15.67:35440) 2024-09-19T05:37:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46dd6da640 1 -- 172.21.15.67:0/2692823751 learned_addr learned my addr 172.21.15.67:0/2692823751 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 Processor -- start 2024-09-19T05:37:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46de6dc640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46d815b210 0x7f46d80b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fee0425d640 1 -- 172.21.15.67:0/3149042116 shutdown_connections 2024-09-19T05:37:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fee0425d640 1 --2- 172.21.15.67:0/3149042116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc15b210 0x7fedfc0b40c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fee0425d640 1 -- 172.21.15.67:0/3149042116 >> 172.21.15.67:0/3149042116 conn(0x7fedfc09aa30 msgr2=0x7fedfc0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46ddedb640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46d80d1420 0x7f46d814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fee0425d640 1 -- 172.21.15.67:0/3149042116 shutdown_connections 2024-09-19T05:37:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fee0425d640 1 -- 172.21.15.67:0/3149042116 wait complete. 2024-09-19T05:37:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c0cf070 0x7f047c0b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f047c15e610 0x7f047c0b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f047c15ef30 0x7f047c1ff230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f047c0d2f40 con 0x7f047c0cf070 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f047c0d2dc0 con 0x7f047c15ef30 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f0481a91640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f047c0d30c0 con 0x7f047c15e610 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f047b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c0cf070 0x7f047c0b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f047b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c0cf070 0x7f047c0b9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35442/0 (socket says 172.21.15.67:35442) 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f047b7fe640 1 -- 172.21.15.67:0/432666532 learned_addr learned my addr 172.21.15.67:0/432666532 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 -- start start 2024-09-19T05:37:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51c06c200 0x7fb51c145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 0x7fb51c14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb51c15cd50 0x7fb51c15ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c15f160 con 0x7fb51c06c200 2024-09-19T05:37:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c15efe0 con 0x7fb51c15cd50 2024-09-19T05:37:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52378e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c169f30 con 0x7fb51c0b6cf0 2024-09-19T05:37:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52152a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51c06c200 0x7fb51c145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f047affd640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f047c15e610 0x7f047c0b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f047bfff640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f047c15ef30 0x7f047c1ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52152a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51c06c200 0x7fb51c145870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35446/0 (socket says 172.21.15.67:35446) 2024-09-19T05:37:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb52152a640 1 -- 172.21.15.67:0/2867627767 learned_addr learned my addr 172.21.15.67:0/2867627767 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f047b7fe640 1 -- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f047c15e610 msgr2=0x7f047c0b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f047b7fe640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f047c15e610 0x7f047c0b79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f047b7fe640 1 -- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f047c15ef30 msgr2=0x7f047c1ff230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f047b7fe640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f047c15ef30 0x7f047c1ff230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f047b7fe640 1 -- 172.21.15.67:0/432666532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c0cdad0 con 0x7f047c0cf070 2024-09-19T05:37:49.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7fb521d2b640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb51c15cd50 0x7fb51c15ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb520d29640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 0x7fb51c14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb52152a640 1 -- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 msgr2=0x7fb51c14bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb52152a640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 0x7fb51c14bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb52152a640 1 -- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb51c15cd50 msgr2=0x7fb51c15ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb52152a640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb51c15cd50 0x7fb51c15ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb52152a640 1 -- 172.21.15.67:0/2867627767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c12f8a0 con 0x7fb51c06c200 2024-09-19T05:37:49.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f047b7fe640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c0cf070 0x7f047c0b9d00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f046c00c4d0 tx=0x7f046c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb52152a640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51c06c200 0x7fb51c145870 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c730 tx=0x7fb51800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee0425d640 1 Processor -- start 2024-09-19T05:37:49.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46dd6da640 1 -- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46d815b210 msgr2=0x7f46d80b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46dd6da640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46d815b210 0x7f46d80b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46dd6da640 1 -- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46d80d1420 msgr2=0x7f46d814cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46dd6da640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46d80d1420 0x7f46d814cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f0463fff640 1 -- 172.21.15.67:0/432666532 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c017070 con 0x7f047c0cf070 2024-09-19T05:37:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46dd6da640 1 -- 172.21.15.67:0/2692823751 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d815c8f0 con 0x7f46d80d1d70 2024-09-19T05:37:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46ddedb640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46d80d1420 0x7f46d814cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46dd6da640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 0x7f46d809b1b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f46c80b0040 tx=0x7f46c801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46ce7fc640 1 -- 172.21.15.67:0/2692823751 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c80bc020 con 0x7f46d80d1d70 2024-09-19T05:37:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46ce7fc640 1 -- 172.21.15.67:0/2692823751 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c80b8640 con 0x7f46d80d1d70 2024-09-19T05:37:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46ce7fc640 1 -- 172.21.15.67:0/2692823751 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c80b2040 con 0x7f46d80d1d70 2024-09-19T05:37:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.133+0000 7f46e013f640 1 -- 172.21.15.67:0/2692823751 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d80b2f40 con 0x7f46d80d1d70 2024-09-19T05:37:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f0481a91640 1 -- 172.21.15.67:0/432666532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047c0cddb0 con 0x7f047c0cf070 2024-09-19T05:37:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f0481a91640 1 -- 172.21.15.67:0/432666532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047c1fed10 con 0x7f047c0cf070 2024-09-19T05:37:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb511ffb640 1 -- 172.21.15.67:0/2867627767 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518017070 con 0x7fb51c06c200 2024-09-19T05:37:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb511ffb640 1 -- 172.21.15.67:0/2867627767 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb518005ac0 con 0x7fb51c06c200 2024-09-19T05:37:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb511ffb640 1 -- 172.21.15.67:0/2867627767 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518007070 con 0x7fb51c06c200 2024-09-19T05:37:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb52378e640 1 -- 172.21.15.67:0/2867627767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c14c7f0 con 0x7fb51c06c200 2024-09-19T05:37:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb52378e640 1 -- 172.21.15.67:0/2867627767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51c14cdb0 con 0x7fb51c06c200 2024-09-19T05:37:49.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f0463fff640 1 -- 172.21.15.67:0/432666532 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046c005cf0 con 0x7f047c0cf070 2024-09-19T05:37:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f0463fff640 1 -- 172.21.15.67:0/432666532 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c007270 con 0x7f047c0cf070 2024-09-19T05:37:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee0425d640 1 -- start start 2024-09-19T05:37:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee0425d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d15f0 0x7fedfc0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee0425d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc0d1d70 0x7fedfc203850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee0425d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc15b210 0x7fedfc1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee0425d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc0cfb50 con 0x7fedfc0d1d70 2024-09-19T05:37:49.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee0425d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc0cf9d0 con 0x7fedfc15b210 2024-09-19T05:37:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f46ce7fc640 1 -- 172.21.15.67:0/2692823751 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46c80bf020 con 0x7f46d80d1d70 2024-09-19T05:37:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f46ce7fc640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46bc067910 0x7f46bc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f46e013f640 1 -- 172.21.15.67:0/2692823751 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d815cb90 con 0x7f46d80d1d70 2024-09-19T05:37:49.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee0425d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fedfc06bcc0 con 0x7fedfc0d15f0 2024-09-19T05:37:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f0481a91640 1 -- 172.21.15.67:0/432666532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047c15e9f0 con 0x7f047c0cf070 2024-09-19T05:37:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f46ddedb640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46bc067910 0x7f46bc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f46ce7fc640 1 -- 172.21.15.67:0/2692823751 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f46c80edec0 con 0x7f46d80d1d70 2024-09-19T05:37:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fb52378e640 1 -- 172.21.15.67:0/2867627767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb51c06bcc0 con 0x7fb51c06c200 2024-09-19T05:37:49.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee027fa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc15b210 0x7fedfc1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee027fa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc15b210 0x7fedfc1526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:59400/0 (socket says 172.21.15.67:59400) 2024-09-19T05:37:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee027fa640 1 -- 172.21.15.67:0/2383397566 learned_addr learned my addr 172.21.15.67:0/2383397566 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f46e013f640 1 -- 172.21.15.67:0/2692823751 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d80ce8a0 con 0x7f46d80d1d70 2024-09-19T05:37:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee01ff9640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d15f0 0x7fedfc0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee027fa640 1 -- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d15f0 msgr2=0x7fedfc0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee027fa640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d15f0 0x7fedfc0b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee027fa640 1 -- 172.21.15.67:0/2383397566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc0d1d70 msgr2=0x7fedfc203850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee027fa640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc0d1d70 0x7fedfc203850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee027fa640 1 -- 172.21.15.67:0/2383397566 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc0b2640 con 0x7fedfc15b210 2024-09-19T05:37:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee027fa640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc15b210 0x7fedfc1526f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fedf400c730 tx=0x7fedf400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f0463fff640 1 -- 172.21.15.67:0/432666532 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f046c01a070 con 0x7f047c0cf070 2024-09-19T05:37:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fedf27fc640 1 -- 172.21.15.67:0/2383397566 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4016020 con 0x7fedfc15b210 2024-09-19T05:37:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7f0463fff640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04680678c0 0x7f0468069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee0425d640 1 -- 172.21.15.67:0/2383397566 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedfc152120 con 0x7fedfc15b210 2024-09-19T05:37:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.137+0000 7fee0425d640 1 -- 172.21.15.67:0/2383397566 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedfc15bb10 con 0x7fedfc15b210 2024-09-19T05:37:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fedf27fc640 1 -- 172.21.15.67:0/2383397566 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf4006d80 con 0x7fedfc15b210 2024-09-19T05:37:49.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fedf27fc640 1 -- 172.21.15.67:0/2383397566 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4003bc0 con 0x7fedfc15b210 2024-09-19T05:37:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fb511ffb640 1 -- 172.21.15.67:0/2867627767 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb51801a070 con 0x7fb51c06c200 2024-09-19T05:37:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7f0463fff640 1 -- 172.21.15.67:0/432666532 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f046c085190 con 0x7f047c0cf070 2024-09-19T05:37:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7f047affd640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04680678c0 0x7f0468069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fb511ffb640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb500067910 0x7fb500069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fee0425d640 1 -- 172.21.15.67:0/2383397566 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede40052a0 con 0x7fedfc15b210 2024-09-19T05:37:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fb520d29640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb500067910 0x7fb500069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7f46ddedb640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46bc067910 0x7f46bc069dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f46d40098b0 tx=0x7f46d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7f047affd640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04680678c0 0x7f0468069d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f047c15e0f0 tx=0x7f0470009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fb520d29640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb500067910 0x7fb500069dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0ad000 tx=0x7fb50c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fedf27fc640 1 -- 172.21.15.67:0/2383397566 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fedf400a850 con 0x7fedfc15b210 2024-09-19T05:37:49.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fedf27fc640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 0x7fede0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fedf27fc640 1 -- 172.21.15.67:0/2383397566 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fedf40866d0 con 0x7fedfc15b210 2024-09-19T05:37:49.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fee01ff9640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 0x7fede0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.141+0000 7fee01ff9640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 0x7fede0069d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fedec0af000 tx=0x7fedec0b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.145+0000 7fb511ffb640 1 -- 172.21.15.67:0/2867627767 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fb518053a60 con 0x7fb51c06c200 2024-09-19T05:37:49.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.145+0000 7f46ce7fc640 1 -- 172.21.15.67:0/2692823751 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f46c80160d0 con 0x7f46d80d1d70 2024-09-19T05:37:49.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.149+0000 7f0463fff640 1 -- 172.21.15.67:0/432666532 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f046c0554e0 con 0x7f047c0cf070 2024-09-19T05:37:49.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.153+0000 7fb511ffb640 1 -- 172.21.15.67:0/2867627767 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb518021020 con 0x7fb51c06c200 2024-09-19T05:37:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.157+0000 7fedf27fc640 1 -- 172.21.15.67:0/2383397566 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fedf4020020 con 0x7fedfc15b210 2024-09-19T05:37:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.365+0000 7f46e013f640 1 -- 172.21.15.67:0/2692823751 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f46d80af190 con 0x7f46d80d1d70 2024-09-19T05:37:49.368 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:37:49.365+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:37:49.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.369+0000 7f46ce7fc640 1 -- 172.21.15.67:0/2692823751 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6261 v37) ==== 95+0+0 (secure 0 0 0) 0x7f46c80ade20 con 0x7f46d80d1d70 2024-09-19T05:37:49.373 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 6261 2024-09-19T05:37:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 -- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46bc067910 msgr2=0x7f46bc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46bc067910 0x7f46bc069dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f46d40098b0 tx=0x7f46d4008040 comp rx=0 tx=0).stop 2024-09-19T05:37:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 -- 172.21.15.67:0/2692823751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 msgr2=0x7f46d809b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 0x7f46d809b1b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f46c80b0040 tx=0x7f46c801ac90 comp rx=0 tx=0).stop 2024-09-19T05:37:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 -- 172.21.15.67:0/2692823751 shutdown_connections 2024-09-19T05:37:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46bc067910 0x7f46bc069dd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46d815b210 0x7f46d80b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d80d1d70 0x7f46d809b1b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 --2- 172.21.15.67:0/2692823751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46d80d1420 0x7f46d814cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 -- 172.21.15.67:0/2692823751 >> 172.21.15.67:0/2692823751 conn(0x7f46d809aa30 msgr2=0x7f46d80ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 -- 172.21.15.67:0/2692823751 shutdown_connections 2024-09-19T05:37:49.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.373+0000 7f46e013f640 1 -- 172.21.15.67:0/2692823751 wait complete. 2024-09-19T05:37:49.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.377+0000 7f0481a91640 1 -- 172.21.15.67:0/432666532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f047c0cec70 con 0x7f047c0cf070 2024-09-19T05:37:49.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.381+0000 7fb52378e640 1 -- 172.21.15.67:0/2867627767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fb51c1500e0 con 0x7fb51c06c200 2024-09-19T05:37:49.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.381+0000 7fee0425d640 1 -- 172.21.15.67:0/2383397566 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fede4005860 con 0x7fedfc15b210 2024-09-19T05:37:49.393 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:37:49.389+0000 7fcbecc55640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:37:49.395 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:37:49.395 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:37:49.397 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:37:49.397 DEBUG:teuthology.parallel:result is None 2024-09-19T05:37:49.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.393+0000 7f0463fff640 1 -- 172.21.15.67:0/432666532 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5171 v39) ==== 95+0+0 (secure 0 0 0) 0x7f046c0597e0 con 0x7f047c0cf070 2024-09-19T05:37:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.393+0000 7fb511ffb640 1 -- 172.21.15.67:0/2867627767 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6258 v39) ==== 95+0+0 (secure 0 0 0) 0x7fb51c0ae3d0 con 0x7fb51c06c200 2024-09-19T05:37:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 5171 2024-09-19T05:37:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 6258 2024-09-19T05:37:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 -- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb500067910 msgr2=0x7fb500069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb500067910 0x7fb500069dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0ad000 tx=0x7fb50c0a6000 comp rx=0 tx=0).stop 2024-09-19T05:37:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 -- 172.21.15.67:0/2867627767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51c06c200 msgr2=0x7fb51c145870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51c06c200 0x7fb51c145870 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c730 tx=0x7fb51800cbf0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 -- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04680678c0 msgr2=0x7f0468069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04680678c0 0x7f0468069d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f047c15e0f0 tx=0x7f0470009190 comp rx=0 tx=0).stop 2024-09-19T05:37:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 -- 172.21.15.67:0/432666532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c0cf070 msgr2=0x7f047c0b9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c0cf070 0x7f047c0b9d00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f046c00c4d0 tx=0x7f046c00c990 comp rx=0 tx=0).stop 2024-09-19T05:37:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 -- 172.21.15.67:0/432666532 shutdown_connections 2024-09-19T05:37:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f047c15ef30 0x7f047c1ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04680678c0 0x7f0468069d80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f047c15e610 0x7f047c0b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 --2- 172.21.15.67:0/432666532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f047c0cf070 0x7f047c0b9d00 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 -- 172.21.15.67:0/432666532 >> 172.21.15.67:0/432666532 conn(0x7f047c08bfc0 msgr2=0x7f047c0b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 -- 172.21.15.67:0/2867627767 shutdown_connections 2024-09-19T05:37:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb51c15cd50 0x7fb51c15ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb500067910 0x7fb500069dd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb51c0b6cf0 0x7fb51c14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 --2- 172.21.15.67:0/2867627767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51c06c200 0x7fb51c145870 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 -- 172.21.15.67:0/2867627767 >> 172.21.15.67:0/2867627767 conn(0x7fb51c09aa30 msgr2=0x7fb51c15deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 -- 172.21.15.67:0/2867627767 shutdown_connections 2024-09-19T05:37:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7fb52378e640 1 -- 172.21.15.67:0/2867627767 wait complete. 2024-09-19T05:37:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 -- 172.21.15.67:0/432666532 shutdown_connections 2024-09-19T05:37:49.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:49.397+0000 7f0481a91640 1 -- 172.21.15.67:0/432666532 wait complete. 2024-09-19T05:37:49.428 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:37:49.428 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:37:49.429 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:37:49.429 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:37:49.431 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:37:49.431 DEBUG:teuthology.parallel:result is None 2024-09-19T05:37:49.454 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:37:49.456 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:37:49.456 DEBUG:teuthology.parallel:result is None 2024-09-19T05:37:49.508 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:37:49.509 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:37:50.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.085+0000 7fedf27fc640 1 -- 172.21.15.67:0/2383397566 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5168 v40) ==== 95+0+0 (secure 0 0 0) 0x7fedf40571f0 con 0x7fedfc15b210 2024-09-19T05:37:50.088 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 5168 2024-09-19T05:37:50.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.085+0000 7fee0425d640 1 -- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 msgr2=0x7fede0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.085+0000 7fee0425d640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 0x7fede0069d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fedec0af000 tx=0x7fedec0b6040 comp rx=0 tx=0).stop 2024-09-19T05:37:50.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.085+0000 7fee0425d640 1 -- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc15b210 msgr2=0x7fedfc1526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.085+0000 7fee0425d640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc15b210 0x7fedfc1526f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fedf400c730 tx=0x7fedf400cbf0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.089+0000 7fee0425d640 1 -- 172.21.15.67:0/2383397566 shutdown_connections 2024-09-19T05:37:50.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.089+0000 7fee0425d640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc15b210 0x7fedfc1526f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.089+0000 7fee0425d640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc0d1d70 0x7fedfc203850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.089+0000 7fee0425d640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 0x7fede0069d80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.089+0000 7fee0425d640 1 --2- 172.21.15.67:0/2383397566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d15f0 0x7fedfc0b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.089+0000 7fee0425d640 1 -- 172.21.15.67:0/2383397566 >> 172.21.15.67:0/2383397566 conn(0x7fedfc09aa30 msgr2=0x7fedfc06f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:50.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.089+0000 7fee0425d640 1 -- 172.21.15.67:0/2383397566 shutdown_connections 2024-09-19T05:37:50.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.089+0000 7fee0425d640 1 -- 172.21.15.67:0/2383397566 wait complete. 2024-09-19T05:37:50.113 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:37:50.113 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:37:50.116 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:37:50.116 DEBUG:teuthology.parallel:result is None 2024-09-19T05:37:50.116 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:50.190 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:37:50.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5ea4fc6640 1 Processor -- start 2024-09-19T05:37:50.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5ea4fc6640 1 -- start start 2024-09-19T05:37:50.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5ea4fc6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ea015a920 0x7f5ea0072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5ea4fc6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5ea00af730 0x7f5ea006e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5ea4fc6640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea00730e0 con 0x7f5ea006ebb0 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5ea4fc6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea006e4f0 con 0x7f5ea015a920 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5ea4fc6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea006efe0 con 0x7f5ea00af730 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5e9e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ea015a920 0x7f5ea0072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5e9e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ea015a920 0x7f5ea0072840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35486/0 (socket says 172.21.15.67:35486) 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5e9ed9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5ea006ebb0 0x7f5ea006dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42248/0 (socket says 172.21.15.67:42248) 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5e9e59c640 1 -- 172.21.15.67:0/2760927559 learned_addr learned my addr 172.21.15.67:0/2760927559 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5e9dd9b640 1 --2- 172.21.15.67:0/2760927559 >> v2:172.21.15.97:3300/0 conn(0x7f5ea00af730 0x7f5ea006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5e9e59c640 1 -- 172.21.15.67:0/2760927559 >> v2:172.21.15.97:3300/0 conn(0x7f5ea00af730 msgr2=0x7f5ea006e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5e9e59c640 1 --2- 172.21.15.67:0/2760927559 >> v2:172.21.15.97:3300/0 conn(0x7f5ea00af730 0x7f5ea006e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5e9e59c640 1 -- 172.21.15.67:0/2760927559 >> v1:172.21.15.67:6789/0 conn(0x7f5ea006ebb0 legacy=0x7f5ea006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.273+0000 7f5e9e59c640 1 -- 172.21.15.67:0/2760927559 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea00733c0 con 0x7f5ea015a920 2024-09-19T05:37:50.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5e9e59c640 1 --2- 172.21.15.67:0/2760927559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 0x7f5ea0072840 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5ea015f5b0 tx=0x7f5e8801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2ac2238fb759a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:50.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5e9d59a640 1 -- 172.21.15.67:0/2760927559 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e880b4070 con 0x7f5ea015a920 2024-09-19T05:37:50.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5e9d59a640 1 -- 172.21.15.67:0/2760927559 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e880a7bb0 con 0x7f5ea015a920 2024-09-19T05:37:50.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5e9d59a640 1 -- 172.21.15.67:0/2760927559 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e880af440 con 0x7f5ea015a920 2024-09-19T05:37:50.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2760927559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 msgr2=0x7f5ea0072840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 --2- 172.21.15.67:0/2760927559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 0x7f5ea0072840 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5ea015f5b0 tx=0x7f5e8801ebf0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2760927559 shutdown_connections 2024-09-19T05:37:50.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 --2- 172.21.15.67:0/2760927559 >> v2:172.21.15.97:3300/0 conn(0x7f5ea00af730 0x7f5ea006e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 --2- 172.21.15.67:0/2760927559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 0x7f5ea0072840 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2760927559 >> 172.21.15.67:0/2760927559 conn(0x7f5ea00d0080 msgr2=0x7f5ea00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:50.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2760927559 shutdown_connections 2024-09-19T05:37:50.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2760927559 wait complete. 2024-09-19T05:37:50.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 Processor -- start 2024-09-19T05:37:50.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 -- start start 2024-09-19T05:37:50.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ea006ebb0 0x7f5ea00999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ea00af730 0x7f5ea0150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 0x7f5ea006c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea015ad00 con 0x7f5ea015a920 2024-09-19T05:37:50.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea0072d80 con 0x7f5ea00af730 2024-09-19T05:37:50.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.277+0000 7f5ea4fc6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea014d060 con 0x7f5ea006ebb0 2024-09-19T05:37:50.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 0x7f5ea006c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 0x7f5ea006c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35488/0 (socket says 172.21.15.67:35488) 2024-09-19T05:37:50.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9ed9d640 1 -- 172.21.15.67:0/2095689511 learned_addr learned my addr 172.21.15.67:0/2095689511 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:50.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9e59c640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ea006ebb0 0x7f5ea00999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9dd9b640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ea00af730 0x7f5ea0150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9ed9d640 1 -- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ea006ebb0 msgr2=0x7f5ea00999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9ed9d640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ea006ebb0 0x7f5ea00999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9ed9d640 1 -- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ea00af730 msgr2=0x7f5ea0150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9ed9d640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ea00af730 0x7f5ea0150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9ed9d640 1 -- 172.21.15.67:0/2095689511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea014c490 con 0x7f5ea015a920 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9ed9d640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 0x7f5ea006c720 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c700 tx=0x7f5e9800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e96ffd640 1 -- 172.21.15.67:0/2095689511 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e98017070 con 0x7f5ea015a920 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e96ffd640 1 -- 172.21.15.67:0/2095689511 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9800ce10 con 0x7f5ea015a920 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2095689511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea014c730 con 0x7f5ea015a920 2024-09-19T05:37:50.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e96ffd640 1 -- 172.21.15.67:0/2095689511 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800a7e0 con 0x7f5ea015a920 2024-09-19T05:37:50.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2095689511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea014ccf0 con 0x7f5ea015a920 2024-09-19T05:37:50.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2095689511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea006e670 con 0x7f5ea015a920 2024-09-19T05:37:50.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e96ffd640 1 -- 172.21.15.67:0/2095689511 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e9801a070 con 0x7f5ea015a920 2024-09-19T05:37:50.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e96ffd640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e800678c0 0x7f5e80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e96ffd640 1 -- 172.21.15.67:0/2095689511 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7f5e980853b0 con 0x7f5ea015a920 2024-09-19T05:37:50.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9e59c640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e800678c0 0x7f5e80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.281+0000 7f5e9e59c640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e800678c0 0x7f5e80069d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5e880b1000 tx=0x7f5e880a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:50.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.285+0000 7f5e96ffd640 1 -- 172.21.15.67:0/2095689511 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5e980555c0 con 0x7f5ea015a920 2024-09-19T05:37:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.477+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2095689511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ea014db40 con 0x7f5ea015a920 2024-09-19T05:37:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.477+0000 7f5e96ffd640 1 -- 172.21.15.67:0/2095689511 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+4390 (secure 0 0 0) 0x7f5e980598c0 con 0x7f5ea015a920 2024-09-19T05:37:50.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:50.483 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":40,"btime":"2024-09-19T05:37:50:082218+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:50.082180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":40,"state":"up:replay","state_seq":1,"addr":"172.21.15.67:6835/223294608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":223294608},{"type":"v1","addr":"172.21.15.67:6835","nonce":223294608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-19T05:37:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 40 2024-09-19T05:37:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e800678c0 msgr2=0x7f5e80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e800678c0 0x7f5e80069d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5e880b1000 tx=0x7f5e880a9070 comp rx=0 tx=0).stop 2024-09-19T05:37:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2095689511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 msgr2=0x7f5ea006c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 0x7f5ea006c720 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c700 tx=0x7f5e9800cbc0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2095689511 shutdown_connections 2024-09-19T05:37:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea015a920 0x7f5ea006c720 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ea00af730 0x7f5ea0150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e800678c0 0x7f5e80069d80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 --2- 172.21.15.67:0/2095689511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ea006ebb0 0x7f5ea00999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2095689511 >> 172.21.15.67:0/2095689511 conn(0x7f5ea00d0080 msgr2=0x7f5ea0159650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2095689511 shutdown_connections 2024-09-19T05:37:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:50.481+0000 7f5ea4fc6640 1 -- 172.21.15.67:0/2095689511 wait complete. 2024-09-19T05:37:50.902 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:37:30.724054+0000', 'modified': '2024-09-19T05:37:50.082180+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 71, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6510}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6510': {'gid': 6510, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.67:6835/223294608', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 223294608}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 223294608}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-19T05:37:50.903 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6510:up:replay 2024-09-19T05:37:51.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:52.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f8429d5d640 1 Processor -- start 2024-09-19T05:37:52.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f8429d5d640 1 -- start start 2024-09-19T05:37:52.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f8429d5d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f842406fbf0 0x7f84240b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:52.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f8429d5d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f84240d0850 0x7f842406e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:52.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f8429d5d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84240cf340 con 0x7f84240d03e0 2024-09-19T05:37:52.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f8429d5d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f84240cf0e0 con 0x7f842406fbf0 2024-09-19T05:37:52.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f8429d5d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f84240cf620 con 0x7f84240d0850 2024-09-19T05:37:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f84237fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f842406fbf0 0x7f84240b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f84237fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f842406fbf0 0x7f84240b67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35504/0 (socket says 172.21.15.67:35504) 2024-09-19T05:37:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f84237fe640 1 -- 172.21.15.67:0/3490432276 learned_addr learned my addr 172.21.15.67:0/3490432276 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f8423fff640 1 --2- 172.21.15.67:0/3490432276 >> v2:172.21.15.97:3300/0 conn(0x7f84240d0850 0x7f842406e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f84237fe640 1 -- 172.21.15.67:0/3490432276 >> v2:172.21.15.97:3300/0 conn(0x7f84240d0850 msgr2=0x7f842406e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f84237fe640 1 --2- 172.21.15.67:0/3490432276 >> v2:172.21.15.97:3300/0 conn(0x7f84240d0850 0x7f842406e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f84237fe640 1 -- 172.21.15.67:0/3490432276 >> v1:172.21.15.97:6789/0 conn(0x7f84240d03e0 legacy=0x7f842415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.037+0000 7f84237fe640 1 -- 172.21.15.67:0/3490432276 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84240cf900 con 0x7f842406fbf0 2024-09-19T05:37:52.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f84237fe640 1 --2- 172.21.15.67:0/3490432276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 0x7f84240b67d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f84240ce940 tx=0x7f841c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d9c491748af954 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:52.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f84227fc640 1 -- 172.21.15.67:0/3490432276 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c0a5760 con 0x7f842406fbf0 2024-09-19T05:37:52.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f84227fc640 1 -- 172.21.15.67:0/3490432276 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841c0a5900 con 0x7f842406fbf0 2024-09-19T05:37:52.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f84227fc640 1 -- 172.21.15.67:0/3490432276 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c0a5cd0 con 0x7f842406fbf0 2024-09-19T05:37:52.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 -- 172.21.15.67:0/3490432276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 msgr2=0x7f84240b67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:52.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 --2- 172.21.15.67:0/3490432276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 0x7f84240b67d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f84240ce940 tx=0x7f841c01c9b0 comp rx=0 tx=0).stop 2024-09-19T05:37:52.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 -- 172.21.15.67:0/3490432276 shutdown_connections 2024-09-19T05:37:52.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 --2- 172.21.15.67:0/3490432276 >> v2:172.21.15.97:3300/0 conn(0x7f84240d0850 0x7f842406e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:52.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 --2- 172.21.15.67:0/3490432276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 0x7f84240b67d0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:52.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 -- 172.21.15.67:0/3490432276 >> 172.21.15.67:0/3490432276 conn(0x7f8424073610 msgr2=0x7f842406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:52.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 -- 172.21.15.67:0/3490432276 shutdown_connections 2024-09-19T05:37:52.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 -- 172.21.15.67:0/3490432276 wait complete. 2024-09-19T05:37:52.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 Processor -- start 2024-09-19T05:37:52.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 -- start start 2024-09-19T05:37:52.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 0x7f84241549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84240d03e0 0x7f8424157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84240d0850 0x7f84241581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f842415f2a0 con 0x7f842406fbf0 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f842415f120 con 0x7f84240d0850 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8429d5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f842406ffd0 con 0x7f84240d03e0 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f84237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 0x7f84241549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f84237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 0x7f84241549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35514/0 (socket says 172.21.15.67:35514) 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f84237fe640 1 -- 172.21.15.67:0/515626245 learned_addr learned my addr 172.21.15.67:0/515626245 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8423fff640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84240d0850 0x7f84241581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.041+0000 7f8422ffd640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84240d03e0 0x7f8424157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f84237fe640 1 -- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84240d03e0 msgr2=0x7f8424157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f84237fe640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84240d03e0 0x7f8424157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f84237fe640 1 -- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84240d0850 msgr2=0x7f84241581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f84237fe640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84240d0850 0x7f84241581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f84237fe640 1 -- 172.21.15.67:0/515626245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8424139d30 con 0x7f842406fbf0 2024-09-19T05:37:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f84237fe640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 0x7f84241549d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f841c01b060 tx=0x7f841c019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f841bfff640 1 -- 172.21.15.67:0/515626245 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c0b8670 con 0x7f842406fbf0 2024-09-19T05:37:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f841bfff640 1 -- 172.21.15.67:0/515626245 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841c0be070 con 0x7f842406fbf0 2024-09-19T05:37:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f8429d5d640 1 -- 172.21.15.67:0/515626245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842413a010 con 0x7f842406fbf0 2024-09-19T05:37:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f841bfff640 1 -- 172.21.15.67:0/515626245 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c0b8a70 con 0x7f842406fbf0 2024-09-19T05:37:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f8429d5d640 1 -- 172.21.15.67:0/515626245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842413a5d0 con 0x7f842406fbf0 2024-09-19T05:37:52.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f8429d5d640 1 -- 172.21.15.67:0/515626245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84240b67d0 con 0x7f842406fbf0 2024-09-19T05:37:52.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f841bfff640 1 -- 172.21.15.67:0/515626245 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f841c0b8c10 con 0x7f842406fbf0 2024-09-19T05:37:52.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f841bfff640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84040678c0 0x7f8404069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:52.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f841bfff640 1 -- 172.21.15.67:0/515626245 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7f841c1210f0 con 0x7f842406fbf0 2024-09-19T05:37:52.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f8422ffd640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84040678c0 0x7f8404069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:52.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.045+0000 7f8422ffd640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84040678c0 0x7f8404069d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f842406d1e0 tx=0x7f840c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:52.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.049+0000 7f841bfff640 1 -- 172.21.15.67:0/515626245 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f841c0165a0 con 0x7f842406fbf0 2024-09-19T05:37:52.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.249+0000 7f8429d5d640 1 -- 172.21.15.67:0/515626245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f842406cb70 con 0x7f842406fbf0 2024-09-19T05:37:52.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f841bfff640 1 -- 172.21.15.67:0/515626245 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5215 (secure 0 0 0) 0x7f841c0f19f0 con 0x7f842406fbf0 2024-09-19T05:37:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:52.255 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":42,"btime":"2024-09-19T05:37:52:087285+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3435299141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3435299141},{"type":"v1","addr":"172.21.15.97:6837","nonce":3435299141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:51.091554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":40,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.67:6835/223294608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":223294608},{"type":"v1","addr":"172.21.15.67:6835","nonce":223294608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-19T05:37:52.255 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 42 2024-09-19T05:37:52.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 -- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84040678c0 msgr2=0x7f8404069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:52.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84040678c0 0x7f8404069d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f842406d1e0 tx=0x7f840c009040 comp rx=0 tx=0).stop 2024-09-19T05:37:52.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 -- 172.21.15.67:0/515626245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 msgr2=0x7f84241549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:52.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 0x7f84241549d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f841c01b060 tx=0x7f841c019750 comp rx=0 tx=0).stop 2024-09-19T05:37:52.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 -- 172.21.15.67:0/515626245 shutdown_connections 2024-09-19T05:37:52.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84240d0850 0x7f84241581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:52.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84040678c0 0x7f8404069d80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:52.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84240d03e0 0x7f8424157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:52.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 --2- 172.21.15.67:0/515626245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f842406fbf0 0x7f84241549d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:52.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 -- 172.21.15.67:0/515626245 >> 172.21.15.67:0/515626245 conn(0x7f8424073610 msgr2=0x7f842415da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:52.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 -- 172.21.15.67:0/515626245 shutdown_connections 2024-09-19T05:37:52.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:52.253+0000 7f8429d5d640 1 -- 172.21.15.67:0/515626245 wait complete. 2024-09-19T05:37:52.677 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:37:30.724054+0000', 'modified': '2024-09-19T05:37:51.091554+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 71, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6510}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6510': {'gid': 6510, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.67:6835/223294608', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 223294608}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 223294608}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-19T05:37:52.678 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6510:up:rejoin 2024-09-19T05:37:53.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:53.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b4e618640 1 Processor -- start 2024-09-19T05:37:53.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b4e618640 1 -- start start 2024-09-19T05:37:53.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b4e618640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0b48159d60 0x7f0b4806ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b4e618640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b4806f460 0x7f0b480b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b4e618640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4806de80 con 0x7f0b480b3510 2024-09-19T05:37:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b4e618640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0b480b3920 con 0x7f0b4806f460 2024-09-19T05:37:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b4e618640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0b4806e160 con 0x7f0b48159d60 2024-09-19T05:37:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b4cbb5640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0b480b3510 0x7f0b480acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42252/0 (socket says 172.21.15.67:42252) 2024-09-19T05:37:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b4cbb5640 1 -- 172.21.15.67:0/3616408746 learned_addr learned my addr 172.21.15.67:0/3616408746 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b477fe640 1 --2- 172.21.15.67:0/3616408746 >> v2:172.21.15.67:3300/0 conn(0x7f0b4806f460 0x7f0b480b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b47fff640 1 --2- 172.21.15.67:0/3616408746 >> v2:172.21.15.97:3300/0 conn(0x7f0b48159d60 0x7f0b4806ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b477fe640 1 -- 172.21.15.67:0/3616408746 >> v2:172.21.15.97:3300/0 conn(0x7f0b48159d60 msgr2=0x7f0b4806ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:53.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b477fe640 1 --2- 172.21.15.67:0/3616408746 >> v2:172.21.15.97:3300/0 conn(0x7f0b48159d60 0x7f0b4806ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b477fe640 1 -- 172.21.15.67:0/3616408746 >> v1:172.21.15.67:6789/0 conn(0x7f0b480b3510 legacy=0x7f0b480acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:53.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b477fe640 1 -- 172.21.15.67:0/3616408746 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4806e440 con 0x7f0b4806f460 2024-09-19T05:37:53.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b47fff640 1 --2- 172.21.15.67:0/3616408746 >> v2:172.21.15.97:3300/0 conn(0x7f0b48159d60 0x7f0b4806ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:53.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.813+0000 7f0b46ffd640 1 -- 172.21.15.67:0/3616408746 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 323606931 0 0) 0x7f0b4806de80 con 0x7f0b480b3510 2024-09-19T05:37:53.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b477fe640 1 --2- 172.21.15.67:0/3616408746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b4806f460 0x7f0b480b2fd0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0b480d1180 tx=0x7f0b3001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83f55502afbb23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:53.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b46ffd640 1 -- 172.21.15.67:0/3616408746 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b300ab650 con 0x7f0b4806f460 2024-09-19T05:37:53.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b46ffd640 1 -- 172.21.15.67:0/3616408746 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b300b0070 con 0x7f0b4806f460 2024-09-19T05:37:53.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b46ffd640 1 -- 172.21.15.67:0/3616408746 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b300aba10 con 0x7f0b4806f460 2024-09-19T05:37:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b4e618640 1 -- 172.21.15.67:0/3616408746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b4806f460 msgr2=0x7f0b480b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b4e618640 1 --2- 172.21.15.67:0/3616408746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b4806f460 0x7f0b480b2fd0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0b480d1180 tx=0x7f0b3001c450 comp rx=0 tx=0).stop 2024-09-19T05:37:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b4e618640 1 -- 172.21.15.67:0/3616408746 shutdown_connections 2024-09-19T05:37:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b4e618640 1 --2- 172.21.15.67:0/3616408746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b4806f460 0x7f0b480b2fd0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b4e618640 1 --2- 172.21.15.67:0/3616408746 >> v2:172.21.15.97:3300/0 conn(0x7f0b48159d60 0x7f0b4806ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b4e618640 1 -- 172.21.15.67:0/3616408746 >> 172.21.15.67:0/3616408746 conn(0x7f0b480d0080 msgr2=0x7f0b480d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b4e618640 1 -- 172.21.15.67:0/3616408746 shutdown_connections 2024-09-19T05:37:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b4e618640 1 -- 172.21.15.67:0/3616408746 wait complete. 2024-09-19T05:37:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b4e618640 1 Processor -- start 2024-09-19T05:37:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.817+0000 7f0b4e618640 1 -- start start 2024-09-19T05:37:53.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4e618640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b4806f460 0x7f0b48157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4e618640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b480b3510 0x7f0b4814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4e618640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b48159d60 0x7f0b480b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4e618640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0b480ad840 con 0x7f0b480b3510 2024-09-19T05:37:53.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4e618640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0b480ad6c0 con 0x7f0b4806f460 2024-09-19T05:37:53.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4e618640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0b480af6b0 con 0x7f0b48159d60 2024-09-19T05:37:53.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b480b3510 0x7f0b4814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b480b3510 0x7f0b4814c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35538/0 (socket says 172.21.15.67:35538) 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b477fe640 1 -- 172.21.15.67:0/2360487326 learned_addr learned my addr 172.21.15.67:0/2360487326 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b47fff640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b4806f460 0x7f0b48157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4cbb5640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b48159d60 0x7f0b480b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b477fe640 1 -- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b48159d60 msgr2=0x7f0b480b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b477fe640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b48159d60 0x7f0b480b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b477fe640 1 -- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b4806f460 msgr2=0x7f0b48157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b477fe640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b4806f460 0x7f0b48157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b477fe640 1 -- 172.21.15.67:0/2360487326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b48166c10 con 0x7f0b480b3510 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b47fff640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b4806f460 0x7f0b48157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4cbb5640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b48159d60 0x7f0b480b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b477fe640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b480b3510 0x7f0b4814c6c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0b3001a080 tx=0x7f0b3001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:53.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b44ff9640 1 -- 172.21.15.67:0/2360487326 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30004220 con 0x7f0b480b3510 2024-09-19T05:37:53.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b44ff9640 1 -- 172.21.15.67:0/2360487326 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b300043c0 con 0x7f0b480b3510 2024-09-19T05:37:53.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4e618640 1 -- 172.21.15.67:0/2360487326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b48164140 con 0x7f0b480b3510 2024-09-19T05:37:53.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b44ff9640 1 -- 172.21.15.67:0/2360487326 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30003820 con 0x7f0b480b3510 2024-09-19T05:37:53.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4e618640 1 -- 172.21.15.67:0/2360487326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b48164700 con 0x7f0b480b3510 2024-09-19T05:37:53.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b4e618640 1 -- 172.21.15.67:0/2360487326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b480b2fd0 con 0x7f0b480b3510 2024-09-19T05:37:53.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b44ff9640 1 -- 172.21.15.67:0/2360487326 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0b300039c0 con 0x7f0b480b3510 2024-09-19T05:37:53.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b44ff9640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b280678f0 0x7f0b28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b44ff9640 1 -- 172.21.15.67:0/2360487326 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7f0b30120730 con 0x7f0b480b3510 2024-09-19T05:37:53.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.821+0000 7f0b47fff640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b280678f0 0x7f0b28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.825+0000 7f0b47fff640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b280678f0 0x7f0b28069db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0b400094c0 tx=0x7f0b4000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:53.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:53.825+0000 7f0b44ff9640 1 -- 172.21.15.67:0/2360487326 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0b30016070 con 0x7f0b480b3510 2024-09-19T05:37:54.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 -- 172.21.15.67:0/2360487326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b480d0f20 con 0x7f0b480b3510 2024-09-19T05:37:54.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b44ff9640 1 -- 172.21.15.67:0/2360487326 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f0b300f10c0 con 0x7f0b480b3510 2024-09-19T05:37:54.032 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":43,"btime":"2024-09-19T05:37:53:094115+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3435299141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3435299141},{"type":"v1","addr":"172.21.15.97:6837","nonce":3435299141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:53.094106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/223294608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":223294608},{"type":"v1","addr":"172.21.15.67:6835","nonce":223294608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6510,"qdb_cluster":[6510]},"id":4}]} 2024-09-19T05:37:54.033 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 43 2024-09-19T05:37:54.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 -- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b280678f0 msgr2=0x7f0b28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b280678f0 0x7f0b28069db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0b400094c0 tx=0x7f0b4000b040 comp rx=0 tx=0).stop 2024-09-19T05:37:54.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 -- 172.21.15.67:0/2360487326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b480b3510 msgr2=0x7f0b4814c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b480b3510 0x7f0b4814c6c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0b3001a080 tx=0x7f0b3001ac90 comp rx=0 tx=0).stop 2024-09-19T05:37:54.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 -- 172.21.15.67:0/2360487326 shutdown_connections 2024-09-19T05:37:54.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b280678f0 0x7f0b28069db0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0b48159d60 0x7f0b480b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b480b3510 0x7f0b4814c6c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 --2- 172.21.15.67:0/2360487326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b4806f460 0x7f0b48157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 -- 172.21.15.67:0/2360487326 >> 172.21.15.67:0/2360487326 conn(0x7f0b480d0080 msgr2=0x7f0b480acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 -- 172.21.15.67:0/2360487326 shutdown_connections 2024-09-19T05:37:54.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.029+0000 7f0b4e618640 1 -- 172.21.15.67:0/2360487326 wait complete. 2024-09-19T05:37:54.454 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:37:30.724054+0000', 'modified': '2024-09-19T05:37:53.094106+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 71, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6510}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6510': {'gid': 6510, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.67:6835/223294608', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 223294608}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 223294608}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6510, 'qdb_cluster': [6510]} 2024-09-19T05:37:54.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:37:54.455 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T05:37:54.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb551934640 1 Processor -- start 2024-09-19T05:37:54.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb551934640 1 -- start start 2024-09-19T05:37:54.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb551934640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb54c15c200 0x7fb54c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb551934640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c0aef40 0x7fb54c0af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb551934640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54c0b3070 con 0x7fb54c15b710 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb551934640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb54c0b32e0 con 0x7fb54c15c200 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb551934640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb54c0b35c0 con 0x7fb54c0aef40 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54affd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb54c15b710 0x7fb54c15baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42268/0 (socket says 172.21.15.67:42268) 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54affd640 1 -- 172.21.15.67:0/3220061618 learned_addr learned my addr 172.21.15.67:0/3220061618 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c0aef40 0x7fb54c0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb543fff640 1 --2- 172.21.15.67:0/3220061618 >> v2:172.21.15.97:3300/0 conn(0x7fb54c15c200 0x7fb54c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3973430304 0 0) 0x7fb54c0b3070 con 0x7fb54c15b710 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb538003530 con 0x7fb54c15b710 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2955301925 0 0) 0x7fb538003530 con 0x7fb54c15b710 2024-09-19T05:37:54.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c0aef40 msgr2=0x7fb54c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c0aef40 0x7fb54c0af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 >> v2:172.21.15.97:3300/0 conn(0x7fb54c15c200 msgr2=0x7fb54c071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 --2- 172.21.15.67:0/3220061618 >> v2:172.21.15.97:3300/0 conn(0x7fb54c15c200 0x7fb54c071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54c0b38a0 con 0x7fb54c15b710 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fb53c001680 con 0x7fb54c15b710 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 >> v1:172.21.15.67:6789/0 conn(0x7fb54c15b710 legacy=0x7fb54c15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5380039c0 0x7fb538003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb538004810 0x7fb538004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c0aef40 0x7fb5380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0b32e0 con 0x7fb538004810 2024-09-19T05:37:54.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0b35c0 con 0x7fb5380039c0 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb53800b9d0 con 0x7fb54c0aef40 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.589+0000 7fb543fff640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb538004810 0x7fb538004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb54affd640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5380039c0 0x7fb538003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c0aef40 0x7fb5380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb543fff640 1 -- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c0aef40 msgr2=0x7fb5380051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb543fff640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c0aef40 0x7fb5380051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb543fff640 1 -- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5380039c0 msgr2=0x7fb538003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb543fff640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5380039c0 0x7fb538003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb543fff640 1 -- 172.21.15.67:0/3220061618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb538003530 con 0x7fb538004810 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb54affd640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5380039c0 0x7fb538003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:54.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c0aef40 0x7fb5380051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:54.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb543fff640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb538004810 0x7fb538004c90 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb534009ae0 tx=0x7fb53401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9498aa95139eecf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340b2070 con 0x7fb538004810 2024-09-19T05:37:54.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5340a55c0 con 0x7fb538004810 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb54a7fc640 1 -- 172.21.15.67:0/3220061618 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340096b0 con 0x7fb538004810 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb551934640 1 -- 172.21.15.67:0/3220061618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb538004810 msgr2=0x7fb538004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb551934640 1 --2- 172.21.15.67:0/3220061618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb538004810 0x7fb538004c90 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb534009ae0 tx=0x7fb53401cab0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb54b7fe640 1 -- 172.21.15.67:0/3220061618 reap_dead start 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb551934640 1 -- 172.21.15.67:0/3220061618 shutdown_connections 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb551934640 1 -- 172.21.15.67:0/3220061618 >> 172.21.15.67:0/3220061618 conn(0x7fb54c0d0080 msgr2=0x7fb54c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb551934640 1 -- 172.21.15.67:0/3220061618 shutdown_connections 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.593+0000 7fb551934640 1 -- 172.21.15.67:0/3220061618 wait complete. 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb551934640 1 Processor -- start 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb551934640 1 -- start start 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb551934640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb538004810 0x7fb54c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb551934640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1512b0 0x7fb54c1f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb551934640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c072c50 0x7fb54c073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb551934640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0af4e0 con 0x7fb54c1512b0 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb551934640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0af360 con 0x7fb538004810 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb551934640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb54c0af660 con 0x7fb54c072c50 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb543fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1512b0 0x7fb54c1f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb543fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1512b0 0x7fb54c1f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35552/0 (socket says 172.21.15.67:35552) 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb543fff640 1 -- 172.21.15.67:0/2292466180 learned_addr learned my addr 172.21.15.67:0/2292466180 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb54affd640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb538004810 0x7fb54c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c072c50 0x7fb54c073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb543fff640 1 -- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c072c50 msgr2=0x7fb54c073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb543fff640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c072c50 0x7fb54c073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb543fff640 1 -- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb538004810 msgr2=0x7fb54c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb543fff640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb538004810 0x7fb54c154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb543fff640 1 -- 172.21.15.67:0/2292466180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54c1f4230 con 0x7fb54c1512b0 2024-09-19T05:37:54.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c072c50 0x7fb54c073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:54.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb543fff640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1512b0 0x7fb54c1f3cf0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb534009ae0 tx=0x7fb538005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb548ff9640 1 -- 172.21.15.67:0/2292466180 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340b2040 con 0x7fb54c1512b0 2024-09-19T05:37:54.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb548ff9640 1 -- 172.21.15.67:0/2292466180 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53400f000 con 0x7fb54c1512b0 2024-09-19T05:37:54.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb551934640 1 -- 172.21.15.67:0/2292466180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54c150cc0 con 0x7fb54c1512b0 2024-09-19T05:37:54.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb548ff9640 1 -- 172.21.15.67:0/2292466180 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534004220 con 0x7fb54c1512b0 2024-09-19T05:37:54.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb551934640 1 -- 172.21.15.67:0/2292466180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb54c1501e0 con 0x7fb54c1512b0 2024-09-19T05:37:54.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.597+0000 7fb548ff9640 1 -- 172.21.15.67:0/2292466180 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5340c0020 con 0x7fb54c1512b0 2024-09-19T05:37:54.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb548ff9640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb52c0678c0 0x7fb52c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb548ff9640 1 -- 172.21.15.67:0/2292466180 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7fb534120160 con 0x7fb54c1512b0 2024-09-19T05:37:54.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb54affd640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb52c0678c0 0x7fb52c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 Processor -- start 2024-09-19T05:37:54.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 -- start start 2024-09-19T05:37:54.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb54affd640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb52c0678c0 0x7fb52c069d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005260 tx=0x7fb53c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 0x55b97b08bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b041d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b042290 0x55b97b042670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b97af29b60 con 0x55b97b08c440 2024-09-19T05:37:54.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b97ae90c70 con 0x55b97b08bb20 2024-09-19T05:37:54.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b97ae36ed0 con 0x55b97b042290 2024-09-19T05:37:54.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb543fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b041d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb543fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b041d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35558/0 (socket says 172.21.15.67:35558) 2024-09-19T05:37:54.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb543fff640 1 -- 172.21.15.67:0/3216025851 learned_addr learned my addr 172.21.15.67:0/3216025851 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:54.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb54affd640 1 --2- 172.21.15.67:0/3216025851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 0x55b97b08bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/3216025851 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b042290 0x55b97b042670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb543fff640 1 -- 172.21.15.67:0/3216025851 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b042290 msgr2=0x55b97b042670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb543fff640 1 --2- 172.21.15.67:0/3216025851 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b042290 0x55b97b042670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb543fff640 1 -- 172.21.15.67:0/3216025851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 msgr2=0x55b97b08bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb543fff640 1 --2- 172.21.15.67:0/3216025851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 0x55b97b08bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb543fff640 1 -- 172.21.15.67:0/3216025851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b97ae48e50 con 0x55b97b08c440 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb543fff640 1 --2- 172.21.15.67:0/3216025851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b041d50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb5340f8a10 tx=0x7fb534009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14715699e8142d23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5417fa640 1 -- 172.21.15.67:0/3216025851 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340f4710 con 0x55b97b08c440 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5417fa640 1 -- 172.21.15.67:0/3216025851 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5340f8f40 con 0x55b97b08c440 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5417fa640 1 -- 172.21.15.67:0/3216025851 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340043c0 con 0x55b97b08c440 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 -- 172.21.15.67:0/3216025851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 msgr2=0x55b97b041d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 --2- 172.21.15.67:0/3216025851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b041d50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb5340f8a10 tx=0x7fb534009770 comp rx=0 tx=0).stop 2024-09-19T05:37:54.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 -- 172.21.15.67:0/3216025851 shutdown_connections 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 --2- 172.21.15.67:0/3216025851 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b042290 0x55b97b042670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 --2- 172.21.15.67:0/3216025851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b041d50 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 --2- 172.21.15.67:0/3216025851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 0x55b97b08bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 -- 172.21.15.67:0/3216025851 >> 172.21.15.67:0/3216025851 conn(0x55b97b048600 msgr2=0x55b97b040630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 -- 172.21.15.67:0/3216025851 shutdown_connections 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.601+0000 7fb5549f0000 1 -- 172.21.15.67:0/3216025851 wait complete. 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 -- start start 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 Processor -- start 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08bb20 0x55b97b046c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08c440 0x55b97b0471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b04ccf0 0x55b97b04d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b97aef2b00 con 0x55b97b04ccf0 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b97ae6b360 con 0x55b97b08c440 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b97ae682d0 con 0x55b97b08bb20 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 10 client.0 _ll_register_callbacks cb 0x55b97b02d820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b04ccf0 0x55b97b04d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b04ccf0 0x55b97b04d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35572/0 (socket says 172.21.15.67:35572) 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54b7fe640 1 -- 172.21.15.67:0/2240198406 learned_addr learned my addr 172.21.15.67:0/2240198406 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54affd640 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08bb20 0x55b97b046c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb543fff640 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08c440 0x55b97b0471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54b7fe640 1 -- 172.21.15.67:0/2240198406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08bb20 msgr2=0x55b97b046c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08bb20 0x55b97b046c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54b7fe640 1 -- 172.21.15.67:0/2240198406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08c440 msgr2=0x55b97b0471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08c440 0x55b97b0471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54b7fe640 1 -- 172.21.15.67:0/2240198406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b97ae37120 con 0x55b97b04ccf0 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54affd640 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08bb20 0x55b97b046c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b04ccf0 0x55b97b04d0d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb54c071860 tx=0x7fb544004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8d8832a39d3eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb52a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb52a7fc640 1 -- 172.21.15.67:0/2240198406 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54401b070 con 0x55b97b04ccf0 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb52a7fc640 1 -- 172.21.15.67:0/2240198406 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7fb544013990 con 0x55b97b04ccf0 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 -- 172.21.15.67:0/2240198406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5340f8f40 con 0x55b97b04ccf0 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb52a7fc640 1 -- 172.21.15.67:0/2240198406 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb544026050 con 0x55b97b04ccf0 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 10 client.6552 fetch_fsmap learned FSMap version 43 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 -- 172.21.15.67:0/2240198406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55b97ae30450 con 0x55b97b04ccf0 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb52a7fc640 1 -- 172.21.15.67:0/2240198406 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5340f8f40 con 0x55b97b04ccf0 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb52a7fc640 1 -- 172.21.15.67:0/2240198406 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 43) ==== 3502+0+0 (secure 0 0 0) 0x7fb544029020 con 0x55b97b04ccf0 2024-09-19T05:37:54.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 10 client.6552 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T05:37:54.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 10 client.6552 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:37:54.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 20 client.6552 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:54.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55b97b09a280 0x55b97b09c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 4 client.6552 mds_command: new command op to 6510 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:54.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb5549f0000 1 -- 172.21.15.67:0/2240198406 --> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b97ae2ac00 con 0x55b97b09a280 2024-09-19T05:37:54.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54affd640 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55b97b09a280 0x55b97b09c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb52a7fc640 10 client.6552 ms_handle_connect on v2:172.21.15.67:6834/223294608 2024-09-19T05:37:54.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.605+0000 7fb54affd640 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55b97b09a280 0x55b97b09c670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=babe1022bd355fdc server_cookie=ecfed4f1e8a52930 in_seq=0 out_seq=0 2024-09-19T05:37:54.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb52a7fc640 1 -- 172.21.15.67:0/2240198406 <== mds.0 v2:172.21.15.67:6834/223294608 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b97ae2ac00 con 0x55b97b09a280 2024-09-19T05:37:54.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb52a7fc640 10 client.6552 handle_command_reply: tid=0 2024-09-19T05:37:54.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 client.6552 shutdown 2024-09-19T05:37:54.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 -- 172.21.15.67:0/2240198406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b04ccf0 msgr2=0x55b97b04d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b04ccf0 0x55b97b04d0d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb54c071860 tx=0x7fb544004700 comp rx=0 tx=0).stop 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 -- 172.21.15.67:0/2240198406 shutdown_connections 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55b97b09a280 0x55b97b09c670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b04ccf0 0x55b97b04d0d0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08c440 0x55b97b0471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 --2- 172.21.15.67:0/2240198406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08bb20 0x55b97b046c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb52a7fc640 0 client.6552 ms_handle_reset on v2:172.21.15.67:6834/223294608 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 -- 172.21.15.67:0/2240198406 >> 172.21.15.67:0/2240198406 conn(0x55b97b042290 msgr2=0x55b97b040d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 -- 172.21.15.67:0/2240198406 shutdown_connections 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 1 -- 172.21.15.67:0/2240198406 wait complete. 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.609+0000 7fb5549f0000 20 client.6552 trim_cache size 0 max 16384 2024-09-19T05:37:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.625+0000 7fb5549f0000 1 Processor -- start 2024-09-19T05:37:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.625+0000 7fb5549f0000 1 -- start start 2024-09-19T05:37:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b04ccf0 0x55b97b08ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08bb20 0x55b97b08b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08c440 0x55b97b09c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c200880 con 0x55b97b08bb20 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c1ffc10 con 0x55b97b04ccf0 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb54c200230 con 0x55b97b08c440 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08bb20 0x55b97b08b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08bb20 0x55b97b08b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35574/0 (socket says 172.21.15.67:35574) 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 -- 172.21.15.67:0/2208164007 learned_addr learned my addr 172.21.15.67:0/2208164007 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54affd640 1 --2- 172.21.15.67:0/2208164007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b04ccf0 0x55b97b08ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/2208164007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08c440 0x55b97b09c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 -- 172.21.15.67:0/2208164007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08c440 msgr2=0x55b97b09c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 --2- 172.21.15.67:0/2208164007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08c440 0x55b97b09c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 -- 172.21.15.67:0/2208164007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b04ccf0 msgr2=0x55b97b08ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 --2- 172.21.15.67:0/2208164007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b04ccf0 0x55b97b08ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 -- 172.21.15.67:0/2208164007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b97ae17fd0 con 0x55b97b08bb20 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54affd640 1 --2- 172.21.15.67:0/2208164007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b04ccf0 0x55b97b08ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 --2- 172.21.15.67:0/2208164007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08bb20 0x55b97b08b0d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fb53411e420 tx=0x7fb5340c3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1949650dde2b05a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb540ff9640 1 -- 172.21.15.67:0/2208164007 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340f0130 con 0x55b97b08bb20 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb540ff9640 1 -- 172.21.15.67:0/2208164007 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53411b070 con 0x55b97b08bb20 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb540ff9640 1 -- 172.21.15.67:0/2208164007 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340f8f40 con 0x55b97b08bb20 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- 172.21.15.67:0/2208164007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08bb20 msgr2=0x55b97b08b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 --2- 172.21.15.67:0/2208164007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08bb20 0x55b97b08b0d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fb53411e420 tx=0x7fb5340c3000 comp rx=0 tx=0).stop 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- 172.21.15.67:0/2208164007 shutdown_connections 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 --2- 172.21.15.67:0/2208164007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b08c440 0x55b97b09c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 --2- 172.21.15.67:0/2208164007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08bb20 0x55b97b08b0d0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 --2- 172.21.15.67:0/2208164007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b04ccf0 0x55b97b08ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- 172.21.15.67:0/2208164007 >> 172.21.15.67:0/2208164007 conn(0x55b97b042290 msgr2=0x55b97b043db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- 172.21.15.67:0/2208164007 shutdown_connections 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- 172.21.15.67:0/2208164007 wait complete. 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- start start 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 Processor -- start 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b04ccf0 0x55b97b09f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 0x55b97b0ba960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b0baea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b97ae8ff80 con 0x55b97b08c440 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b97ae48ca0 con 0x55b97b08bb20 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b97ae952a0 con 0x55b97b04ccf0 2024-09-19T05:37:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb5549f0000 10 client.0 _ll_register_callbacks cb 0x7fb544009bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b0baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b0baea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35590/0 (socket says 172.21.15.67:35590) 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54b7fe640 1 -- 172.21.15.67:0/3081807986 learned_addr learned my addr 172.21.15.67:0/3081807986 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54affd640 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b04ccf0 0x55b97b09f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 0x55b97b0ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54b7fe640 1 -- 172.21.15.67:0/3081807986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b04ccf0 msgr2=0x55b97b09f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b04ccf0 0x55b97b09f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54b7fe640 1 -- 172.21.15.67:0/3081807986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 msgr2=0x55b97b0ba960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 0x55b97b0ba960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54b7fe640 1 -- 172.21.15.67:0/3081807986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b97af13750 con 0x55b97b08c440 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb543fff640 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 0x55b97b0ba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb54b7fe640 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b0baea0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fb5440206a0 tx=0x7fb544004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f2b2ecffbacce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.629+0000 7fb52a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb52a7fc640 1 -- 172.21.15.67:0/3081807986 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54401b040 con 0x55b97b08c440 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb52a7fc640 1 -- 172.21.15.67:0/3081807986 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7fb544020c90 con 0x55b97b08c440 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 -- 172.21.15.67:0/3081807986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb53411b070 con 0x55b97b08c440 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb52a7fc640 1 -- 172.21.15.67:0/3081807986 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb544033050 con 0x55b97b08c440 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 10 client.6558 fetch_fsmap learned FSMap version 43 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 -- 172.21.15.67:0/3081807986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55b97ae1ea30 con 0x55b97b08c440 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb52a7fc640 1 -- 172.21.15.67:0/3081807986 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53411b070 con 0x55b97b08c440 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb52a7fc640 1 -- 172.21.15.67:0/3081807986 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 43) ==== 3502+0+0 (secure 0 0 0) 0x7fb544036020 con 0x55b97b08c440 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 10 client.6558 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 10 client.6558 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 20 client.6558 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55b97b0bb3e0 0x55b97b0fec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 4 client.6558 mds_command: new command op to 6510 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:37:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 -- 172.21.15.67:0/3081807986 --> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] -- command(tid 0: {"prefix": "status"}) -- 0x55b97ae9e3a0 con 0x55b97b0bb3e0 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb54affd640 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55b97b0bb3e0 0x55b97b0fec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb52a7fc640 10 client.6558 ms_handle_connect on v2:172.21.15.67:6834/223294608 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb54affd640 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55b97b0bb3e0 0x55b97b0fec00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6f1690eea8dd42e server_cookie=c348009fcb252567 in_seq=0 out_seq=0 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb52a7fc640 1 -- 172.21.15.67:0/3081807986 <== mds.0 v2:172.21.15.67:6834/223294608 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b97ae9e3a0 con 0x55b97b0bb3e0 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb52a7fc640 10 client.6558 handle_command_reply: tid=0 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 client.6558 shutdown 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 -- 172.21.15.67:0/3081807986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 msgr2=0x55b97b0baea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b0baea0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fb5440206a0 tx=0x7fb544004ac0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 -- 172.21.15.67:0/3081807986 shutdown_connections 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55b97b0bb3e0 0x55b97b0fec00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b97b08c440 0x55b97b0baea0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b97b08bb20 0x55b97b0ba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 --2- 172.21.15.67:0/3081807986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b97b04ccf0 0x55b97b09f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb52a7fc640 0 client.6558 ms_handle_reset on v2:172.21.15.67:6834/223294608 2024-09-19T05:37:54.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 -- 172.21.15.67:0/3081807986 >> 172.21.15.67:0/3081807986 conn(0x55b97b042290 msgr2=0x55b97b089b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 -- 172.21.15.67:0/3081807986 shutdown_connections 2024-09-19T05:37:54.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 1 -- 172.21.15.67:0/3081807986 wait complete. 2024-09-19T05:37:54.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb5549f0000 20 client.6558 trim_cache size 0 max 16384 2024-09-19T05:37:54.645 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:54.645 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:37:54.645 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:37:54.645 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 6510, 2024-09-19T05:37:54.646 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:37:54.646 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:37:54.646 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:37:54.646 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 4.5514724390000003, 2024-09-19T05:37:54.646 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 43, 2024-09-19T05:37:54.646 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 72, 2024-09-19T05:37:54.646 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 72, 2024-09-19T05:37:54.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 5.1252256660000004 2024-09-19T05:37:54.646 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:54.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 -- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb52c0678c0 msgr2=0x7fb52c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb52c0678c0 0x7fb52c069d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005260 tx=0x7fb53c009040 comp rx=0 tx=0).stop 2024-09-19T05:37:54.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 -- 172.21.15.67:0/2292466180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1512b0 msgr2=0x7fb54c1f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1512b0 0x7fb54c1f3cf0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb534009ae0 tx=0x7fb538005840 comp rx=0 tx=0).stop 2024-09-19T05:37:54.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 -- 172.21.15.67:0/2292466180 shutdown_connections 2024-09-19T05:37:54.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb52c0678c0 0x7fb52c069d80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54c072c50 0x7fb54c073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1512b0 0x7fb54c1f3cf0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 --2- 172.21.15.67:0/2292466180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb538004810 0x7fb54c154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 -- 172.21.15.67:0/2292466180 >> 172.21.15.67:0/2292466180 conn(0x7fb54c0d0080 msgr2=0x7fb54c06e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 -- 172.21.15.67:0/2292466180 shutdown_connections 2024-09-19T05:37:54.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.633+0000 7fb551934640 1 -- 172.21.15.67:0/2292466180 wait complete. 2024-09-19T05:37:54.654 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-19T05:37:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bcde6e640 1 Processor -- start 2024-09-19T05:37:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bcde6e640 1 -- start start 2024-09-19T05:37:54.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bcde6e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bc80d1a50 0x7f5bc80b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bcde6e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5bc80b1570 0x7f5bc80cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bcde6e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc815c7d0 con 0x7f5bc815c3f0 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bcde6e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5bc80b2680 con 0x7f5bc80b1570 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bcde6e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc80cfc10 con 0x7f5bc80d1a50 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bc77fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5bc815c3f0 0x7f5bc80b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42272/0 (socket says 172.21.15.67:42272) 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bc77fe640 1 -- 172.21.15.67:0/3528019904 learned_addr learned my addr 172.21.15.67:0/3528019904 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bc7fff640 1 --2- 172.21.15.67:0/3528019904 >> v2:172.21.15.67:3300/0 conn(0x7f5bc80b1570 0x7f5bc80cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bc6ffd640 1 --2- 172.21.15.67:0/3528019904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bc80d1a50 0x7f5bc80b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bc7fff640 1 -- 172.21.15.67:0/3528019904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bc80d1a50 msgr2=0x7f5bc80b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bc7fff640 1 --2- 172.21.15.67:0/3528019904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bc80d1a50 0x7f5bc80b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bc7fff640 1 -- 172.21.15.67:0/3528019904 >> v1:172.21.15.67:6789/0 conn(0x7f5bc815c3f0 legacy=0x7f5bc80b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bc7fff640 1 -- 172.21.15.67:0/3528019904 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc80d1f30 con 0x7f5bc80b1570 2024-09-19T05:37:54.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.769+0000 7f5bc67fc640 1 -- 172.21.15.67:0/3528019904 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267688768 0 0) 0x7f5bc815c7d0 con 0x7f5bc815c3f0 2024-09-19T05:37:54.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc7fff640 1 --2- 172.21.15.67:0/3528019904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80b1570 0x7f5bc80cf6d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009dc0 tx=0x7f5bc001c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d618cf4a95b07b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc67fc640 1 -- 172.21.15.67:0/3528019904 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00a66e0 con 0x7f5bc80b1570 2024-09-19T05:37:54.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc67fc640 1 -- 172.21.15.67:0/3528019904 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc00a6880 con 0x7f5bc80b1570 2024-09-19T05:37:54.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc67fc640 1 -- 172.21.15.67:0/3528019904 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00a6c50 con 0x7f5bc80b1570 2024-09-19T05:37:54.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 -- 172.21.15.67:0/3528019904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80b1570 msgr2=0x7f5bc80cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 --2- 172.21.15.67:0/3528019904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80b1570 0x7f5bc80cf6d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009dc0 tx=0x7f5bc001c800 comp rx=0 tx=0).stop 2024-09-19T05:37:54.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 -- 172.21.15.67:0/3528019904 shutdown_connections 2024-09-19T05:37:54.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 --2- 172.21.15.67:0/3528019904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80b1570 0x7f5bc80cf6d0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 --2- 172.21.15.67:0/3528019904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bc80d1a50 0x7f5bc80b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 -- 172.21.15.67:0/3528019904 >> 172.21.15.67:0/3528019904 conn(0x7f5bc80b3f30 msgr2=0x7f5bc80b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 -- 172.21.15.67:0/3528019904 shutdown_connections 2024-09-19T05:37:54.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 -- 172.21.15.67:0/3528019904 wait complete. 2024-09-19T05:37:54.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 Processor -- start 2024-09-19T05:37:54.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 -- start start 2024-09-19T05:37:54.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bc80b1570 0x7f5bc814ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80d1a50 0x7f5bc814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bc815c3f0 0x7f5bc814ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc8160870 con 0x7f5bc80d1a50 2024-09-19T05:37:54.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc81606f0 con 0x7f5bc815c3f0 2024-09-19T05:37:54.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bcde6e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc81609f0 con 0x7f5bc80b1570 2024-09-19T05:37:54.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80d1a50 0x7f5bc814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80d1a50 0x7f5bc814c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35608/0 (socket says 172.21.15.67:35608) 2024-09-19T05:37:54.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc6ffd640 1 -- 172.21.15.67:0/1634663593 learned_addr learned my addr 172.21.15.67:0/1634663593 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:54.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc77fe640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bc80b1570 0x7f5bc814ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc6ffd640 1 -- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bc80b1570 msgr2=0x7f5bc814ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc6ffd640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bc80b1570 0x7f5bc814ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc6ffd640 1 -- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bc815c3f0 msgr2=0x7f5bc814ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc7fff640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bc815c3f0 0x7f5bc814ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc6ffd640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bc815c3f0 0x7f5bc814ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.773+0000 7f5bc6ffd640 1 -- 172.21.15.67:0/1634663593 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc80b5dc0 con 0x7f5bc80d1a50 2024-09-19T05:37:54.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5bc6ffd640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80d1a50 0x7f5bc814c990 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00d800 tx=0x7f5bbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5baffff640 1 -- 172.21.15.67:0/1634663593 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00b660 con 0x7f5bc80d1a50 2024-09-19T05:37:54.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5baffff640 1 -- 172.21.15.67:0/1634663593 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bbc019070 con 0x7f5bc80d1a50 2024-09-19T05:37:54.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5bcde6e640 1 -- 172.21.15.67:0/1634663593 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc80b60a0 con 0x7f5bc80d1a50 2024-09-19T05:37:54.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5baffff640 1 -- 172.21.15.67:0/1634663593 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00ba00 con 0x7f5bc80d1a50 2024-09-19T05:37:54.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5bcde6e640 1 -- 172.21.15.67:0/1634663593 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc80b6660 con 0x7f5bc80d1a50 2024-09-19T05:37:54.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5bcde6e640 1 -- 172.21.15.67:0/1634663593 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc80b6bc0 con 0x7f5bc80d1a50 2024-09-19T05:37:54.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5baffff640 1 -- 172.21.15.67:0/1634663593 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5bbc00bba0 con 0x7f5bc80d1a50 2024-09-19T05:37:54.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5baffff640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bb40678c0 0x7f5bb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5baffff640 1 -- 172.21.15.67:0/1634663593 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7f5bbc086290 con 0x7f5bc80d1a50 2024-09-19T05:37:54.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5bc77fe640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bb40678c0 0x7f5bb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.777+0000 7f5bc77fe640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bb40678c0 0x7f5bb4069d80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8000f70 tx=0x7f5bb8007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.781+0000 7f5baffff640 1 -- 172.21.15.67:0/1634663593 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5bbc056c20 con 0x7f5bc80d1a50 2024-09-19T05:37:54.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.945+0000 7f5bcde6e640 1 -- 172.21.15.67:0/1634663593 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f5bc80cf6d0 con 0x7f5bc80d1a50 2024-09-19T05:37:54.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.949+0000 7f5baffff640 1 -- 172.21.15.67:0/1634663593 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v18)=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f5bbc056520 con 0x7f5bc80d1a50 2024-09-19T05:37:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 -- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bb40678c0 msgr2=0x7f5bb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bb40678c0 0x7f5bb4069d80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8000f70 tx=0x7f5bb8007c10 comp rx=0 tx=0).stop 2024-09-19T05:37:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 -- 172.21.15.67:0/1634663593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80d1a50 msgr2=0x7f5bc814c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80d1a50 0x7f5bc814c990 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00d800 tx=0x7f5bbc00dcc0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 -- 172.21.15.67:0/1634663593 shutdown_connections 2024-09-19T05:37:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bc815c3f0 0x7f5bc814ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc80d1a50 0x7f5bc814c990 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bb40678c0 0x7f5bb4069d80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 --2- 172.21.15.67:0/1634663593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bc80b1570 0x7f5bc814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 -- 172.21.15.67:0/1634663593 >> 172.21.15.67:0/1634663593 conn(0x7f5bc80b3f30 msgr2=0x7f5bc80af430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 -- 172.21.15.67:0/1634663593 shutdown_connections 2024-09-19T05:37:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:54.953+0000 7f5bcde6e640 1 -- 172.21.15.67:0/1634663593 wait complete. 2024-09-19T05:37:54.973 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 30 2024-09-19T05:37:55.094 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-09-19T05:37:55.089+0000 7fc0ee6fc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:37:55.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f245d5e0640 1 Processor -- start 2024-09-19T05:37:55.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f245d5e0640 1 -- start start 2024-09-19T05:37:55.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f245d5e0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f24580d4fb0 0x7f24580d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f245d5e0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f24580d13c0 0x7f245806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f245d5e0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24580d35a0 con 0x7f245815e690 2024-09-19T05:37:55.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f245d5e0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f24580d17f0 con 0x7f24580d13c0 2024-09-19T05:37:55.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f245d5e0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f24580d32c0 con 0x7f24580d4fb0 2024-09-19T05:37:55.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f24577fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f24580d13c0 0x7f245806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f24577fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f24580d13c0 0x7f245806db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35622/0 (socket says 172.21.15.67:35622) 2024-09-19T05:37:55.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f24577fe640 1 -- 172.21.15.67:0/1556994634 learned_addr learned my addr 172.21.15.67:0/1556994634 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:55.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f24567fc640 1 --2- 172.21.15.67:0/1556994634 >> v2:172.21.15.97:3300/0 conn(0x7f24580d4fb0 0x7f24580d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f24577fe640 1 -- 172.21.15.67:0/1556994634 >> v2:172.21.15.97:3300/0 conn(0x7f24580d4fb0 msgr2=0x7f24580d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f24577fe640 1 --2- 172.21.15.67:0/1556994634 >> v2:172.21.15.97:3300/0 conn(0x7f24580d4fb0 0x7f24580d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f24577fe640 1 -- 172.21.15.67:0/1556994634 >> v1:172.21.15.97:6789/0 conn(0x7f245815e690 legacy=0x7f24580d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.097+0000 7f24577fe640 1 -- 172.21.15.67:0/1556994634 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245806d040 con 0x7f24580d13c0 2024-09-19T05:37:55.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f24577fe640 1 --2- 172.21.15.67:0/1556994634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 0x7f245806db20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f24580d3770 tx=0x7f245001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53693ffc782c10a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2455ffb640 1 -- 172.21.15.67:0/1556994634 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500a5840 con 0x7f24580d13c0 2024-09-19T05:37:55.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2455ffb640 1 -- 172.21.15.67:0/1556994634 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24500a59e0 con 0x7f24580d13c0 2024-09-19T05:37:55.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2455ffb640 1 -- 172.21.15.67:0/1556994634 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500a5db0 con 0x7f24580d13c0 2024-09-19T05:37:55.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 -- 172.21.15.67:0/1556994634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 msgr2=0x7f245806db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 --2- 172.21.15.67:0/1556994634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 0x7f245806db20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f24580d3770 tx=0x7f245001c980 comp rx=0 tx=0).stop 2024-09-19T05:37:55.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 -- 172.21.15.67:0/1556994634 shutdown_connections 2024-09-19T05:37:55.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 --2- 172.21.15.67:0/1556994634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 0x7f245806db20 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 --2- 172.21.15.67:0/1556994634 >> v2:172.21.15.97:3300/0 conn(0x7f24580d4fb0 0x7f24580d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 -- 172.21.15.67:0/1556994634 >> 172.21.15.67:0/1556994634 conn(0x7f24580d4490 msgr2=0x7f24580d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:55.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 -- 172.21.15.67:0/1556994634 shutdown_connections 2024-09-19T05:37:55.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 -- 172.21.15.67:0/1556994634 wait complete. 2024-09-19T05:37:55.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 Processor -- start 2024-09-19T05:37:55.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 -- start start 2024-09-19T05:37:55.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 0x7f2458153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24580d4fb0 0x7f2458154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f245815e690 0x7f24581548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f245806e9f0 con 0x7f24580d13c0 2024-09-19T05:37:55.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f245806e870 con 0x7f245815e690 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f245d5e0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f245806eb70 con 0x7f24580d4fb0 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2456ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 0x7f2458153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2456ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 0x7f2458153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35626/0 (socket says 172.21.15.67:35626) 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2456ffd640 1 -- 172.21.15.67:0/3796427457 learned_addr learned my addr 172.21.15.67:0/3796427457 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f24567fc640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24580d4fb0 0x7f2458154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2456ffd640 1 -- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24580d4fb0 msgr2=0x7f2458154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2456ffd640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24580d4fb0 0x7f2458154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f24577fe640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f245815e690 0x7f24581548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2456ffd640 1 -- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f245815e690 msgr2=0x7f24581548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2456ffd640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f245815e690 0x7f24581548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2456ffd640 1 -- 172.21.15.67:0/3796427457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24581619b0 con 0x7f24580d13c0 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.101+0000 7f2456ffd640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 0x7f2458153370 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f244800b410 tx=0x7f244800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f243f7fe640 1 -- 172.21.15.67:0/3796427457 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448015030 con 0x7f24580d13c0 2024-09-19T05:37:55.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f243f7fe640 1 -- 172.21.15.67:0/3796427457 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2448004020 con 0x7f24580d13c0 2024-09-19T05:37:55.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f245d5e0640 1 -- 172.21.15.67:0/3796427457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2458158ed0 con 0x7f24580d13c0 2024-09-19T05:37:55.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f243f7fe640 1 -- 172.21.15.67:0/3796427457 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448004450 con 0x7f24580d13c0 2024-09-19T05:37:55.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f245d5e0640 1 -- 172.21.15.67:0/3796427457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2458159490 con 0x7f24580d13c0 2024-09-19T05:37:55.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f245d5e0640 1 -- 172.21.15.67:0/3796427457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f245806db20 con 0x7f24580d13c0 2024-09-19T05:37:55.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f243f7fe640 1 -- 172.21.15.67:0/3796427457 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2448018070 con 0x7f24580d13c0 2024-09-19T05:37:55.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f243f7fe640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24440678f0 0x7f2444069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f243f7fe640 1 -- 172.21.15.67:0/3796427457 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7f2448085a10 con 0x7f24580d13c0 2024-09-19T05:37:55.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f24567fc640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24440678f0 0x7f2444069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.105+0000 7f24567fc640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24440678f0 0x7f2444069db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2458154f20 tx=0x7f244c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.109+0000 7f243f7fe640 1 -- 172.21.15.67:0/3796427457 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2448056310 con 0x7f24580d13c0 2024-09-19T05:37:55.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.273+0000 7f245d5e0640 1 -- 172.21.15.67:0/3796427457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f2458159660 con 0x7f24580d13c0 2024-09-19T05:37:55.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.277+0000 7f243f7fe640 1 -- 172.21.15.67:0/3796427457 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f2448055c10 con 0x7f24580d13c0 2024-09-19T05:37:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 -- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24440678f0 msgr2=0x7f2444069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24440678f0 0x7f2444069db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2458154f20 tx=0x7f244c008040 comp rx=0 tx=0).stop 2024-09-19T05:37:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 -- 172.21.15.67:0/3796427457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 msgr2=0x7f2458153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 0x7f2458153370 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f244800b410 tx=0x7f244800b8d0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 -- 172.21.15.67:0/3796427457 shutdown_connections 2024-09-19T05:37:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f245815e690 0x7f24581548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f24440678f0 0x7f2444069db0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24580d4fb0 0x7f2458154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 --2- 172.21.15.67:0/3796427457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24580d13c0 0x7f2458153370 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 -- 172.21.15.67:0/3796427457 >> 172.21.15.67:0/3796427457 conn(0x7f24580d4490 msgr2=0x7f24580b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 -- 172.21.15.67:0/3796427457 shutdown_connections 2024-09-19T05:37:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.281+0000 7f245d5e0640 1 -- 172.21.15.67:0/3796427457 wait complete. 2024-09-19T05:37:55.302 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:55.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f6412ae3640 1 Processor -- start 2024-09-19T05:37:55.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f6412ae3640 1 -- start start 2024-09-19T05:37:55.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f6412ae3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f640c09b440 0x7f640c1602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f6412ae3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640c1607f0 con 0x7f640c15fed0 2024-09-19T05:37:55.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f6412ae3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640c09b8d0 con 0x7f640c0cd920 2024-09-19T05:37:55.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f6412ae3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f640c160d50 con 0x7f640c09b440 2024-09-19T05:37:55.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f641087f640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f640c15fed0 0x7f640c0b1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42288/0 (socket says 172.21.15.67:42288) 2024-09-19T05:37:55.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f641087f640 1 -- 172.21.15.67:0/2069361511 learned_addr learned my addr 172.21.15.67:0/2069361511 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:55.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640bfff640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f640c09b440 0x7f640c1602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163511825 0 0) 0x7f640c1607f0 con 0x7f640c15fed0 2024-09-19T05:37:55.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63fc003530 con 0x7f640c15fed0 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1736074712 0 0) 0x7f63fc003530 con 0x7f640c15fed0 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f640c09b440 msgr2=0x7f640c1602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f640c09b440 0x7f640c1602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 >> v1:172.21.15.97:6789/0 conn(0x7f640c0cd920 legacy=0x7f640c0cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640c09bbb0 con 0x7f640c15fed0 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6400001680 con 0x7f640c15fed0 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 >> v1:172.21.15.67:6789/0 conn(0x7f640c15fed0 legacy=0x7f640c0b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 0x7f63fc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63fc004810 0x7f63fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63fc0051d0 0x7f63fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc00bf10 con 0x7f63fc0039f0 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc00c090 con 0x7f63fc004810 2024-09-19T05:37:55.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f63fc00c260 con 0x7f63fc0051d0 2024-09-19T05:37:55.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f641087f640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 0x7f63fc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f640bfff640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63fc004810 0x7f63fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f641087f640 1 -- 172.21.15.67:0/2069361511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63fc0051d0 msgr2=0x7f63fc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f641087f640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63fc0051d0 0x7f63fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f641087f640 1 -- 172.21.15.67:0/2069361511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63fc004810 msgr2=0x7f63fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f641087f640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63fc004810 0x7f63fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.425+0000 7f641087f640 1 -- 172.21.15.67:0/2069361511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc003530 con 0x7f63fc0039f0 2024-09-19T05:37:55.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f641087f640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 0x7f63fc003e10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f640000c190 tx=0x7f640001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a24c3951eb7cf40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400007c70 con 0x7f63fc0039f0 2024-09-19T05:37:55.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64000a9070 con 0x7f63fc0039f0 2024-09-19T05:37:55.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f640b7fe640 1 -- 172.21.15.67:0/2069361511 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400005d20 con 0x7f63fc0039f0 2024-09-19T05:37:55.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 -- 172.21.15.67:0/2069361511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 msgr2=0x7f63fc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 --2- 172.21.15.67:0/2069361511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 0x7f63fc003e10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f640000c190 tx=0x7f640001cbb0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6411080640 1 -- 172.21.15.67:0/2069361511 reap_dead start 2024-09-19T05:37:55.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 -- 172.21.15.67:0/2069361511 shutdown_connections 2024-09-19T05:37:55.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 -- 172.21.15.67:0/2069361511 >> 172.21.15.67:0/2069361511 conn(0x7f640c0b3d90 msgr2=0x7f640c0b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:55.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 -- 172.21.15.67:0/2069361511 shutdown_connections 2024-09-19T05:37:55.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 -- 172.21.15.67:0/2069361511 wait complete. 2024-09-19T05:37:55.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 Processor -- start 2024-09-19T05:37:55.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 -- start start 2024-09-19T05:37:55.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 0x7f640c0c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f640c167430 0x7f640c0711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f640c0716e0 0x7f640c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f640c0d0580 con 0x7f63fc0039f0 2024-09-19T05:37:55.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f640c0ce140 con 0x7f640c167430 2024-09-19T05:37:55.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6412ae3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f640c0d0700 con 0x7f640c0716e0 2024-09-19T05:37:55.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f641087f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 0x7f640c0c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f641087f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 0x7f640c0c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35636/0 (socket says 172.21.15.67:35636) 2024-09-19T05:37:55.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f641087f640 1 -- 172.21.15.67:0/4129774197 learned_addr learned my addr 172.21.15.67:0/4129774197 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:55.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f640bfff640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f640c167430 0x7f640c0711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6411080640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f640c0716e0 0x7f640c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f641087f640 1 -- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f640c0716e0 msgr2=0x7f640c06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f641087f640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f640c0716e0 0x7f640c06ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f641087f640 1 -- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f640c167430 msgr2=0x7f640c0711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f641087f640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f640c167430 0x7f640c0711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f641087f640 1 -- 172.21.15.67:0/4129774197 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640c06db70 con 0x7f63fc0039f0 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f6411080640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f640c0716e0 0x7f640c06ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.429+0000 7f641087f640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 0x7f640c0c5090 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f640000c190 tx=0x7f63fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f64097fa640 1 -- 172.21.15.67:0/4129774197 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400005d00 con 0x7f63fc0039f0 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f64097fa640 1 -- 172.21.15.67:0/4129774197 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64000a5830 con 0x7f63fc0039f0 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f6412ae3640 1 -- 172.21.15.67:0/4129774197 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640c166950 con 0x7f63fc0039f0 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f64097fa640 1 -- 172.21.15.67:0/4129774197 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64000a5be0 con 0x7f63fc0039f0 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f6412ae3640 1 -- 172.21.15.67:0/4129774197 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640c166f10 con 0x7f63fc0039f0 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f6412ae3640 1 -- 172.21.15.67:0/4129774197 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f640c1606c0 con 0x7f63fc0039f0 2024-09-19T05:37:55.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f64097fa640 1 -- 172.21.15.67:0/4129774197 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f64000047f0 con 0x7f63fc0039f0 2024-09-19T05:37:55.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f64097fa640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63f00678c0 0x7f63f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f64097fa640 1 -- 172.21.15.67:0/4129774197 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7f640011f660 con 0x7f63fc0039f0 2024-09-19T05:37:55.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f640bfff640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63f00678c0 0x7f63f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.433+0000 7f640bfff640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63f00678c0 0x7f63f0069d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f640c161ca0 tx=0x7f63f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.437+0000 7f64097fa640 1 -- 172.21.15.67:0/4129774197 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f64000168f0 con 0x7f63fc0039f0 2024-09-19T05:37:55.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.637+0000 7f6412ae3640 1 -- 172.21.15.67:0/4129774197 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f640c0b4ca0 con 0x7f63fc0039f0 2024-09-19T05:37:55.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.637+0000 7f64097fa640 1 -- 172.21.15.67:0/4129774197 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f64000eff70 con 0x7f63fc0039f0 2024-09-19T05:37:55.641 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:55.641 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":43,"btime":"2024-09-19T05:37:53:094115+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3435299141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3435299141},{"type":"v1","addr":"172.21.15.97:6837","nonce":3435299141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:53.094106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/223294608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":223294608},{"type":"v1","addr":"172.21.15.67:6835","nonce":223294608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6510,"qdb_cluster":[6510]},"id":4}]} 2024-09-19T05:37:55.642 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 43 2024-09-19T05:37:55.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 -- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63f00678c0 msgr2=0x7f63f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63f00678c0 0x7f63f0069d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f640c161ca0 tx=0x7f63f8008040 comp rx=0 tx=0).stop 2024-09-19T05:37:55.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 -- 172.21.15.67:0/4129774197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 msgr2=0x7f640c0c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 0x7f640c0c5090 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f640000c190 tx=0x7f63fc005840 comp rx=0 tx=0).stop 2024-09-19T05:37:55.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 -- 172.21.15.67:0/4129774197 shutdown_connections 2024-09-19T05:37:55.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f63f00678c0 0x7f63f0069d80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f640c0716e0 0x7f640c06ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f640c167430 0x7f640c0711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 --2- 172.21.15.67:0/4129774197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc0039f0 0x7f640c0c5090 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 -- 172.21.15.67:0/4129774197 >> 172.21.15.67:0/4129774197 conn(0x7f640c0b3d90 msgr2=0x7f640c15ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:55.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 -- 172.21.15.67:0/4129774197 shutdown_connections 2024-09-19T05:37:55.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.641+0000 7f6412ae3640 1 -- 172.21.15.67:0/4129774197 wait complete. 2024-09-19T05:37:55.661 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-19T05:37:55.802 INFO:teuthology.orchestra.run.smithi067.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-19T05:37:41.739342+0000","btime":"2024-09-19T05:37:40.843892+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-19T05:37:41.739342+0000","atime":"2024-09-19T05:37:40.843892+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-19T05:37:41.739342+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:37:41.740822+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:37:41.740822+0000"},"version":166,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1},{"frag":"1*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-19T05:37:55.803 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-19T05:37:41.740822+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-19T05:37:40.843892+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-19T05:37:40.843892+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-19T05:37:41.739342+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" }, { "children": 1, "frag": "1*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-19T05:37:41.739342+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-19T05:37:41.739342+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-19T05:37:41.740822+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 166, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-19T05:37:55.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:55.803 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /testdir recursive 2024-09-19T05:37:55.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b94ba6640 1 Processor -- start 2024-09-19T05:37:55.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b94ba6640 1 -- start start 2024-09-19T05:37:55.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b94ba6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b9015b020 0x7f6b90070030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b94ba6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6b900b5440 0x7f6b900af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b94ba6640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b90070570 con 0x7f6b9015b400 2024-09-19T05:37:55.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b94ba6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6b900aebc0 con 0x7f6b900b5440 2024-09-19T05:37:55.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b94ba6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b90070810 con 0x7f6b9015b020 2024-09-19T05:37:55.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8dd9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6b9015b400 0x7f6b900b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:54010/0 (socket says 172.21.15.67:54010) 2024-09-19T05:37:55.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/959578934 learned_addr learned my addr 172.21.15.67:0/959578934 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:55.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8ed9d640 1 --2- 172.21.15.67:0/959578934 >> v2:172.21.15.97:3300/0 conn(0x7f6b900b5440 0x7f6b900af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/959578934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b9015b020 0x7f6b90070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8d59a640 1 -- 172.21.15.67:0/959578934 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2644536024 0 0) 0x7f6b90070570 con 0x7f6b9015b400 2024-09-19T05:37:55.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8d59a640 1 -- 172.21.15.67:0/959578934 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b7c003530 con 0x7f6b9015b400 2024-09-19T05:37:55.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8d59a640 1 -- 172.21.15.67:0/959578934 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1260021384 0 0) 0x7f6b7c003530 con 0x7f6b9015b400 2024-09-19T05:37:55.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8ed9d640 1 -- 172.21.15.67:0/959578934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b9015b020 msgr2=0x7f6b90070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8ed9d640 1 --2- 172.21.15.67:0/959578934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b9015b020 0x7f6b90070030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8ed9d640 1 -- 172.21.15.67:0/959578934 >> v1:172.21.15.67:6789/0 conn(0x7f6b9015b400 legacy=0x7f6b900b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.933+0000 7f6b8ed9d640 1 -- 172.21.15.67:0/959578934 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b90070af0 con 0x7f6b900b5440 2024-09-19T05:37:55.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b8ed9d640 1 --2- 172.21.15.67:0/959578934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b900b5440 0x7f6b900af050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b780097c0 tx=0x7f6b7801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c001b9cf6297f846 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b8d59a640 1 -- 172.21.15.67:0/959578934 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b780b0070 con 0x7f6b900b5440 2024-09-19T05:37:55.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b8d59a640 1 -- 172.21.15.67:0/959578934 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b780ab400 con 0x7f6b900b5440 2024-09-19T05:37:55.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b8d59a640 1 -- 172.21.15.67:0/959578934 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88001a20 con 0x7f6b900b5440 2024-09-19T05:37:55.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 -- 172.21.15.67:0/959578934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b900b5440 msgr2=0x7f6b900af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 --2- 172.21.15.67:0/959578934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b900b5440 0x7f6b900af050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b780097c0 tx=0x7f6b7801c390 comp rx=0 tx=0).stop 2024-09-19T05:37:55.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 -- 172.21.15.67:0/959578934 shutdown_connections 2024-09-19T05:37:55.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 --2- 172.21.15.67:0/959578934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b900b5440 0x7f6b900af050 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 --2- 172.21.15.67:0/959578934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b9015b020 0x7f6b90070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 -- 172.21.15.67:0/959578934 >> 172.21.15.67:0/959578934 conn(0x7f6b900b6760 msgr2=0x7f6b900b6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:55.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 -- 172.21.15.67:0/959578934 shutdown_connections 2024-09-19T05:37:55.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 -- 172.21.15.67:0/959578934 wait complete. 2024-09-19T05:37:55.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 Processor -- start 2024-09-19T05:37:55.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 -- start start 2024-09-19T05:37:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b900b5440 0x7f6b90154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b9015b020 0x7f6b9014cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b9015b400 0x7f6b9014d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b900b0130 con 0x7f6b9015b020 2024-09-19T05:37:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b900affb0 con 0x7f6b9015b400 2024-09-19T05:37:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.937+0000 7f6b94ba6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b900b02b0 con 0x7f6b900b5440 2024-09-19T05:37:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b9015b020 0x7f6b9014cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b9015b020 0x7f6b9014cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43904/0 (socket says 172.21.15.67:43904) 2024-09-19T05:37:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/2234635635 learned_addr learned my addr 172.21.15.67:0/2234635635 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b900b5440 0x7f6b90154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8ed9d640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b9015b400 0x7f6b9014d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b900b5440 msgr2=0x7f6b90154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b900b5440 0x7f6b90154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b9015b400 msgr2=0x7f6b9014d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b9015b400 0x7f6b9014d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/2234635635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b90155d70 con 0x7f6b9015b020 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b9015b020 0x7f6b9014cb20 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800cc30 tx=0x7f6b8800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b86ffd640 1 -- 172.21.15.67:0/2234635635 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88017070 con 0x7f6b9015b020 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b86ffd640 1 -- 172.21.15.67:0/2234635635 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8800ce40 con 0x7f6b9015b020 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b94ba6640 1 -- 172.21.15.67:0/2234635635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b90156050 con 0x7f6b9015b020 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b86ffd640 1 -- 172.21.15.67:0/2234635635 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88012620 con 0x7f6b9015b020 2024-09-19T05:37:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b94ba6640 1 -- 172.21.15.67:0/2234635635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b90156610 con 0x7f6b9015b020 2024-09-19T05:37:55.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b86ffd640 1 -- 172.21.15.67:0/2234635635 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b8801a070 con 0x7f6b9015b020 2024-09-19T05:37:55.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b86ffd640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b700678c0 0x7f6b70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b86ffd640 1 -- 172.21.15.67:0/2234635635 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7f6b88085d40 con 0x7f6b9015b020 2024-09-19T05:37:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b700678c0 0x7f6b70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b97c62000 1 Processor -- start 2024-09-19T05:37:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.941+0000 7f6b97c62000 1 -- start start 2024-09-19T05:37:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b700678c0 0x7f6b70069d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6b900b7010 tx=0x7f6b80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7c840 0x55f04ef7cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7d160 0x55f04ef32ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04ef333e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f04ed80b20 con 0x55f04ef7d160 2024-09-19T05:37:55.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f04ed3b870 con 0x55f04ef7c840 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f04ed7cae0 con 0x55f04ef33000 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7d160 0x55f04ef32ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7d160 0x55f04ef32ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43912/0 (socket says 172.21.15.67:43912) 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/488743237 learned_addr learned my addr 172.21.15.67:0/488743237 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8ed9d640 1 --2- 172.21.15.67:0/488743237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04ef333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/488743237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7c840 0x55f04ef7cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/488743237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 msgr2=0x55f04ef333e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/488743237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04ef333e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/488743237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7c840 msgr2=0x55f04ef7cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/488743237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7c840 0x55f04ef7cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/488743237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f04ed53940 con 0x55f04ef7d160 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/488743237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7c840 0x55f04ef7cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/488743237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7d160 0x55f04ef32ac0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6b8805e5f0 tx=0x7f6b8805a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1a40560c855ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b6ffff640 1 -- 172.21.15.67:0/488743237 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88052660 con 0x55f04ef7d160 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b6ffff640 1 -- 172.21.15.67:0/488743237 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8805e690 con 0x55f04ef7d160 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b6ffff640 1 -- 172.21.15.67:0/488743237 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88052800 con 0x55f04ef7d160 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- 172.21.15.67:0/488743237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7d160 msgr2=0x55f04ef32ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 --2- 172.21.15.67:0/488743237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7d160 0x55f04ef32ac0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6b8805e5f0 tx=0x7f6b8805a2f0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- 172.21.15.67:0/488743237 shutdown_connections 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 --2- 172.21.15.67:0/488743237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04ef333e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 --2- 172.21.15.67:0/488743237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7d160 0x55f04ef32ac0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 --2- 172.21.15.67:0/488743237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7c840 0x55f04ef7cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- 172.21.15.67:0/488743237 >> 172.21.15.67:0/488743237 conn(0x55f04ef39160 msgr2=0x55f04ef313a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- 172.21.15.67:0/488743237 shutdown_connections 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- 172.21.15.67:0/488743237 wait complete. 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- start start 2024-09-19T05:37:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 Processor -- start 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04ef69710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04ef37980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04ef37ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f04ed4d8e0 con 0x55f04ef7c840 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f04ed249b0 con 0x55f04ef7d160 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f04ed48260 con 0x55f04ef33000 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b97c62000 10 client.0 _ll_register_callbacks cb 0x55f04ef1e540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04ef37980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04ef37980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43920/0 (socket says 172.21.15.67:43920) 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.945+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/860090022 learned_addr learned my addr 172.21.15.67:0/860090022 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b8ed9d640 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04ef37ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04ef69710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/860090022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 msgr2=0x55f04ef69710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04ef69710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/860090022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 msgr2=0x55f04ef37ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04ef37ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/860090022 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f04ed3bac0 con 0x55f04ef7c840 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04ef37980 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6b8805e5f0 tx=0x7f6b88002200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c208e848a5f724 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/860090022 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88051d40 con 0x55f04ef7c840 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/860090022 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7f6b88051ee0 con 0x55f04ef7c840 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b97c62000 1 -- 172.21.15.67:0/860090022 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b8805e690 con 0x55f04ef7c840 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/860090022 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f6b88054eb0 con 0x55f04ef7c840 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b97c62000 10 client.6591 fetch_fsmap learned FSMap version 43 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b97c62000 1 -- 172.21.15.67:0/860090022 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55f04ed20810 con 0x55f04ef7c840 2024-09-19T05:37:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/860090022 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8805e690 con 0x55f04ef7c840 2024-09-19T05:37:55.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/860090022 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 43) ==== 3502+0+0 (secure 0 0 0) 0x7f6b88055050 con 0x55f04ef7c840 2024-09-19T05:37:55.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b97c62000 10 client.6591 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T05:37:55.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b97c62000 10 client.6591 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-19T05:37:55.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b97c62000 20 client.6591 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:55.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b97c62000 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55f04ef6a710 0x55f04ef8d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b97c62000 4 client.6591 mds_command: new command op to 6510 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:55.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b97c62000 1 -- 172.21.15.67:0/860090022 --> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f04ed1ae30 con 0x55f04ef6a710 2024-09-19T05:37:55.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55f04ef6a710 0x55f04ef8d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b6d7fa640 10 client.6591 ms_handle_connect on v2:172.21.15.67:6834/223294608 2024-09-19T05:37:55.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.949+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55f04ef6a710 0x55f04ef8d8e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa9506ac1180ade2 server_cookie=619cca8ef2fb250f in_seq=0 out_seq=0 2024-09-19T05:37:55.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/860090022 <== mds.0 v2:172.21.15.67:6834/223294608 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f04ed1ae30 con 0x55f04ef6a710 2024-09-19T05:37:55.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b6d7fa640 10 client.6591 handle_command_reply: tid=0 2024-09-19T05:37:55.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 client.6591 shutdown 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 -- 172.21.15.67:0/860090022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 msgr2=0x55f04ef37980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04ef37980 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6b8805e5f0 tx=0x7f6b88002200 comp rx=0 tx=0).stop 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 -- 172.21.15.67:0/860090022 shutdown_connections 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55f04ef6a710 0x55f04ef8d8e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04ef37ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04ef37980 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b6d7fa640 0 client.6591 ms_handle_reset on v2:172.21.15.67:6834/223294608 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 --2- 172.21.15.67:0/860090022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04ef69710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 -- 172.21.15.67:0/860090022 >> 172.21.15.67:0/860090022 conn(0x55f04ef39160 msgr2=0x55f04ef313a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 -- 172.21.15.67:0/860090022 shutdown_connections 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 1 -- 172.21.15.67:0/860090022 wait complete. 2024-09-19T05:37:55.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.953+0000 7f6b97c62000 20 client.6591 trim_cache size 0 max 16384 2024-09-19T05:37:55.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b97c62000 1 Processor -- start 2024-09-19T05:37:55.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b97c62000 1 -- start start 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04efeba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04efebf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04efec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b97c62000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90204260 con 0x55f04ef7c840 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b97c62000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b902032c0 con 0x55f04ef7d160 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b97c62000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b90202650 con 0x55f04ef33000 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04efebf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04efebf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43922/0 (socket says 172.21.15.67:43922) 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/884798930 learned_addr learned my addr 172.21.15.67:0/884798930 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/884798930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04efeba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8ed9d640 1 --2- 172.21.15.67:0/884798930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04efec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/884798930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 msgr2=0x55f04efeba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/884798930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04efeba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/884798930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 msgr2=0x55f04efec4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/884798930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04efec4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8dd9b640 1 -- 172.21.15.67:0/884798930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f04ed3e240 con 0x55f04ef7c840 2024-09-19T05:37:55.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.969+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/884798930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04efeba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:55.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/884798930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04efebf60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6b880560c0 tx=0x7f6b88007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4557f3058cc95dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b6f7fe640 1 -- 172.21.15.67:0/884798930 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88055050 con 0x55f04ef7c840 2024-09-19T05:37:55.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b6f7fe640 1 -- 172.21.15.67:0/884798930 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88051d40 con 0x55f04ef7c840 2024-09-19T05:37:55.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b6f7fe640 1 -- 172.21.15.67:0/884798930 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8807d990 con 0x55f04ef7c840 2024-09-19T05:37:55.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- 172.21.15.67:0/884798930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 msgr2=0x55f04efebf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 --2- 172.21.15.67:0/884798930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04efebf60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6b880560c0 tx=0x7f6b88007000 comp rx=0 tx=0).stop 2024-09-19T05:37:55.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- 172.21.15.67:0/884798930 shutdown_connections 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 --2- 172.21.15.67:0/884798930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04efec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 --2- 172.21.15.67:0/884798930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef7c840 0x55f04efebf60 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 --2- 172.21.15.67:0/884798930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef33000 0x55f04efeba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- 172.21.15.67:0/884798930 >> 172.21.15.67:0/884798930 conn(0x55f04ef39160 msgr2=0x55f04ef7bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- 172.21.15.67:0/884798930 shutdown_connections 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- 172.21.15.67:0/884798930 wait complete. 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- start start 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 Processor -- start 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef33000 0x55f04efef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef7c840 0x55f04efefef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04efaac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f04ed4d520 con 0x55f04ef33000 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90202ca0 con 0x55f04ef7d160 2024-09-19T05:37:55.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f04ed7fe30 con 0x55f04ef7c840 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 10 client.0 _ll_register_callbacks cb 0x7f6b88055ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef33000 0x55f04efef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef33000 0x55f04efef9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43924/0 (socket says 172.21.15.67:43924) 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8e59c640 1 -- 172.21.15.67:0/2772902612 learned_addr learned my addr 172.21.15.67:0/2772902612 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef7c840 0x55f04efefef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8ed9d640 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04efaac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8e59c640 1 -- 172.21.15.67:0/2772902612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef7c840 msgr2=0x55f04efefef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef7c840 0x55f04efefef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8e59c640 1 -- 172.21.15.67:0/2772902612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 msgr2=0x55f04efaac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04efaac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8e59c640 1 -- 172.21.15.67:0/2772902612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f04ee03330 con 0x55f04ef33000 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8ed9d640 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04efaac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8e59c640 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef33000 0x55f04efef9b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6b80011c80 tx=0x7f6b800046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3998d581db6ffbf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:55.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/2772902612 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b800223f0 con 0x55f04ef33000 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/2772902612 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7f6b8000f050 con 0x55f04ef33000 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- 172.21.15.67:0/2772902612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b88051d40 con 0x55f04ef33000 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/2772902612 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f6b80037050 con 0x55f04ef33000 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 10 client.6597 fetch_fsmap learned FSMap version 43 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- 172.21.15.67:0/2772902612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55f04ea3b400 con 0x55f04ef33000 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/2772902612 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88051d40 con 0x55f04ef33000 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/2772902612 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 43) ==== 3502+0+0 (secure 0 0 0) 0x7f6b8003a020 con 0x55f04ef33000 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 10 client.6597 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 10 client.6597 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 20 client.6597 populate_metadata read hostname 'smithi067' 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55f04efab150 0x55f04efab560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 4 client.6597 mds_command: new command op to 6510 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b97c62000 1 -- 172.21.15.67:0/2772902612 --> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x55f04ed8e250 con 0x55f04efab150 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.973+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55f04efab150 0x55f04efab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b6d7fa640 10 client.6597 ms_handle_connect on v2:172.21.15.67:6834/223294608 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b8dd9b640 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55f04efab150 0x55f04efab560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d9802fdd77b449e server_cookie=8d69cacb835d1dec in_seq=0 out_seq=0 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b6d7fa640 1 -- 172.21.15.67:0/2772902612 <== mds.0 v2:172.21.15.67:6834/223294608 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f04ed8e250 con 0x55f04efab150 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b6d7fa640 10 client.6597 handle_command_reply: tid=0 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 client.6597 shutdown 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 -- 172.21.15.67:0/2772902612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef33000 msgr2=0x55f04efef9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef33000 0x55f04efef9b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6b80011c80 tx=0x7f6b800046d0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 -- 172.21.15.67:0/2772902612 shutdown_connections 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.67:6834/223294608,v1:172.21.15.67:6835/223294608] conn(0x55f04efab150 0x55f04efab560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f04ef7d160 0x55f04efaac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f04ef7c840 0x55f04efefef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b6d7fa640 0 client.6597 ms_handle_reset on v2:172.21.15.67:6834/223294608 2024-09-19T05:37:55.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 --2- 172.21.15.67:0/2772902612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f04ef33000 0x55f04efef9b0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 -- 172.21.15.67:0/2772902612 >> 172.21.15.67:0/2772902612 conn(0x55f04ef39160 msgr2=0x55f04ef8d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:55.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 -- 172.21.15.67:0/2772902612 shutdown_connections 2024-09-19T05:37:55.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 1 -- 172.21.15.67:0/2772902612 wait complete. 2024-09-19T05:37:55.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b97c62000 20 client.6597 trim_cache size 0 max 16384 2024-09-19T05:37:55.985 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:37:55.985 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:37:55.985 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "72efd2e3-c021-489f-b65f-24096941051a", 2024-09-19T05:37:55.986 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:37:55.986 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:37:55.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 -- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b700678c0 msgr2=0x7f6b70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b700678c0 0x7f6b70069d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6b900b7010 tx=0x7f6b80008040 comp rx=0 tx=0).stop 2024-09-19T05:37:55.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 -- 172.21.15.67:0/2234635635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b9015b020 msgr2=0x7f6b9014cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:55.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b9015b020 0x7f6b9014cb20 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800cc30 tx=0x7f6b8800a430 comp rx=0 tx=0).stop 2024-09-19T05:37:55.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 -- 172.21.15.67:0/2234635635 shutdown_connections 2024-09-19T05:37:55.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b9015b400 0x7f6b9014d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b9015b020 0x7f6b9014cb20 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b700678c0 0x7f6b70069d80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 --2- 172.21.15.67:0/2234635635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b900b5440 0x7f6b90154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:55.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 -- 172.21.15.67:0/2234635635 >> 172.21.15.67:0/2234635635 conn(0x7f6b900b6760 msgr2=0x7f6b900d1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:55.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 -- 172.21.15.67:0/2234635635 shutdown_connections 2024-09-19T05:37:55.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:55.977+0000 7f6b94ba6640 1 -- 172.21.15.67:0/2234635635 wait complete. 2024-09-19T05:37:55.999 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:56.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.105+0000 7f5c0c1b7640 1 Processor -- start 2024-09-19T05:37:56.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.105+0000 7f5c0c1b7640 1 -- start start 2024-09-19T05:37:56.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0c1b7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0406f460 0x7f5c0406f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0c1b7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0406e3c0 con 0x7f5c0415c030 2024-09-19T05:37:56.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0c1b7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0406e6a0 con 0x7f5c0406dde0 2024-09-19T05:37:56.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0c1b7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0406e980 con 0x7f5c0406f460 2024-09-19T05:37:56.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c09f53640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5c0415c030 0x7f5c0415d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:54024/0 (socket says 172.21.15.67:54024) 2024-09-19T05:37:56.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c09f53640 1 -- 172.21.15.67:0/256970741 learned_addr learned my addr 172.21.15.67:0/256970741 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:37:56.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0a754640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0406f460 0x7f5c0406f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777032425 0 0) 0x7f5c0406e3c0 con 0x7f5c0415c030 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bf0003530 con 0x7f5c0415c030 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3679489465 0 0) 0x7f5bf0003530 con 0x7f5c0415c030 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0406f460 msgr2=0x7f5c0406f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0406f460 0x7f5c0406f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 >> v1:172.21.15.97:6789/0 conn(0x7f5c0406dde0 legacy=0x7f5c040b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0406ec60 con 0x7f5c0415c030 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f5bf4001680 con 0x7f5c0415c030 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 >> v1:172.21.15.67:6789/0 conn(0x7f5c0415c030 legacy=0x7f5c0415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf00039f0 0x7f5bf0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0406f460 0x7f5bf0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bf0004d50 0x7f5bf00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0406e980 con 0x7f5bf0004d50 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf000ba80 con 0x7f5bf00039f0 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf000bc80 con 0x7f5c0406f460 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0a754640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bf0004d50 0x7f5bf00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c09f53640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf00039f0 0x7f5bf0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c09752640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0406f460 0x7f5bf0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0a754640 1 -- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0406f460 msgr2=0x7f5bf0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0a754640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0406f460 0x7f5bf0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0a754640 1 -- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf00039f0 msgr2=0x7f5bf0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0a754640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf00039f0 0x7f5bf0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0a754640 1 -- 172.21.15.67:0/256970741 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf0003530 con 0x7f5bf0004d50 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c09f53640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf00039f0 0x7f5bf0003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c09752640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c0406f460 0x7f5bf0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.109+0000 7f5c0a754640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bf0004d50 0x7f5bf00051d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009f90 tx=0x7f5bfc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73381b6d044272f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc0b2070 con 0x7f5bf0004d50 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc0a5c50 con 0x7f5bf0004d50 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c08f51640 1 -- 172.21.15.67:0/256970741 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc009c10 con 0x7f5bf0004d50 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/256970741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bf0004d50 msgr2=0x7f5bf00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 --2- 172.21.15.67:0/256970741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bf0004d50 0x7f5bf00051d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009f90 tx=0x7f5bfc01cc40 comp rx=0 tx=0).stop 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0a754640 1 -- 172.21.15.67:0/256970741 reap_dead start 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/256970741 shutdown_connections 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/256970741 >> 172.21.15.67:0/256970741 conn(0x7f5c040d0080 msgr2=0x7f5c040d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/256970741 shutdown_connections 2024-09-19T05:37:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/256970741 wait complete. 2024-09-19T05:37:56.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 Processor -- start 2024-09-19T05:37:56.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- start start 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf0004d50 0x7f5c04153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c041f5d20 0x7f5c04099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c04143010 0x7f5c04156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5c040b36e0 con 0x7f5c041f5d20 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0415c410 con 0x7f5c04143010 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5c04152710 con 0x7f5bf0004d50 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c09752640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c041f5d20 0x7f5c04099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c09752640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c041f5d20 0x7f5c04099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43938/0 (socket says 172.21.15.67:43938) 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c09752640 1 -- 172.21.15.67:0/2082043230 learned_addr learned my addr 172.21.15.67:0/2082043230 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c09f53640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf0004d50 0x7f5c04153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0a754640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c04143010 0x7f5c04156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c09752640 1 -- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf0004d50 msgr2=0x7f5c04153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c09752640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf0004d50 0x7f5c04153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c09752640 1 -- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c04143010 msgr2=0x7f5c04156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c09752640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c04143010 0x7f5c04156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c09752640 1 -- 172.21.15.67:0/2082043230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c041f5240 con 0x7f5c041f5d20 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c09752640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c041f5d20 0x7f5c04099a50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000d770 tx=0x7f5c0000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5bfa7fc640 1 -- 172.21.15.67:0/2082043230 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00005270 con 0x7f5c041f5d20 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5bfa7fc640 1 -- 172.21.15.67:0/2082043230 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c00017070 con 0x7f5c041f5d20 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/2082043230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c041f5520 con 0x7f5c041f5d20 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5bfa7fc640 1 -- 172.21.15.67:0/2082043230 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0000b650 con 0x7f5c041f5d20 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.113+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/2082043230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c04152330 con 0x7f5c041f5d20 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.117+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/2082043230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0406f890 con 0x7f5c041f5d20 2024-09-19T05:37:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.117+0000 7f5bfa7fc640 1 -- 172.21.15.67:0/2082043230 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c0000b7f0 con 0x7f5c041f5d20 2024-09-19T05:37:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.117+0000 7f5bfa7fc640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5be80678c0 0x7f5be8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.117+0000 7f5bfa7fc640 1 -- 172.21.15.67:0/2082043230 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7f5c00085dc0 con 0x7f5c041f5d20 2024-09-19T05:37:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.117+0000 7f5c09f53640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5be80678c0 0x7f5be8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.117+0000 7f5c09f53640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5be80678c0 0x7f5be8069d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4001ec0 tx=0x7f5bf4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:56.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.121+0000 7f5bfa7fc640 1 -- 172.21.15.67:0/2082043230 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5c000566c0 con 0x7f5c041f5d20 2024-09-19T05:37:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.313+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/2082043230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c040b4780 con 0x7f5c041f5d20 2024-09-19T05:37:56.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.313+0000 7f5bfa7fc640 1 -- 172.21.15.67:0/2082043230 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f5c00055fc0 con 0x7f5c041f5d20 2024-09-19T05:37:56.318 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:37:56.318 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":43,"btime":"2024-09-19T05:37:53:094115+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3435299141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3435299141},{"type":"v1","addr":"172.21.15.97:6837","nonce":3435299141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:53.094106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/223294608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":223294608},{"type":"v1","addr":"172.21.15.67:6835","nonce":223294608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6510,"qdb_cluster":[6510]},"id":4}]} 2024-09-19T05:37:56.318 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 43 2024-09-19T05:37:56.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5be80678c0 msgr2=0x7f5be8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5be80678c0 0x7f5be8069d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4001ec0 tx=0x7f5bf4009040 comp rx=0 tx=0).stop 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/2082043230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c041f5d20 msgr2=0x7f5c04099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c041f5d20 0x7f5c04099a50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000d770 tx=0x7f5c0000dc30 comp rx=0 tx=0).stop 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/2082043230 shutdown_connections 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c04143010 0x7f5c04156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c041f5d20 0x7f5c04099a50 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5be80678c0 0x7f5be8069d80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 --2- 172.21.15.67:0/2082043230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf0004d50 0x7f5c04153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/2082043230 >> 172.21.15.67:0/2082043230 conn(0x7f5c040d0080 msgr2=0x7f5c040b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/2082043230 shutdown_connections 2024-09-19T05:37:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:37:56.317+0000 7f5c0c1b7640 1 -- 172.21.15.67:0/2082043230 wait complete. 2024-09-19T05:37:56.336 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-19T05:37:56.463 INFO:teuthology.orchestra.run.smithi067.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-19T05:37:41.739342+0000","btime":"2024-09-19T05:37:40.843892+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-19T05:37:41.739342+0000","atime":"2024-09-19T05:37:40.843892+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-19T05:37:41.739342+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:37:41.740822+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:37:41.740822+0000"},"version":166,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1},{"frag":"1*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":3,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-19T05:37:56.463 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-19T05:37:41.740822+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-19T05:37:40.843892+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-19T05:37:40.843892+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-19T05:37:41.739342+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" }, { "children": 1, "frag": "1*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-19T05:37:41.739342+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-19T05:37:41.739342+0000", "nestlock": {}, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 3, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-19T05:37:41.740822+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 166, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-19T05:37:56.464 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-19T05:38:01.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:01.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3fd307640 1 Processor -- start 2024-09-19T05:38:01.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3fd307640 1 -- start start 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3fd307640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3f806dde0 0x7fc3f80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3fd307640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3f80b3510 0x7fc3f806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3fd307640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f806e3c0 con 0x7fc3f815c030 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3fd307640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc3f806e6a0 con 0x7fc3f80b3510 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3fd307640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f806e980 con 0x7fc3f806dde0 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3f77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3f80b3510 0x7fc3f806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3f6ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc3f815c030 0x7fc3f815d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:54026/0 (socket says 172.21.15.67:54026) 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3f6ffd640 1 -- 172.21.15.67:0/3977414907 learned_addr learned my addr 172.21.15.67:0/3977414907 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3f77fe640 1 --2- 172.21.15.67:0/3977414907 >> v2:172.21.15.67:3300/0 conn(0x7fc3f80b3510 0x7fc3f806f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43942/0 (socket says 172.21.15.67:43942) 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3f67fc640 1 --2- 172.21.15.67:0/3977414907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3f806dde0 0x7fc3f80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3f77fe640 1 -- 172.21.15.67:0/3977414907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3f806dde0 msgr2=0x7fc3f80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3f77fe640 1 --2- 172.21.15.67:0/3977414907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3f806dde0 0x7fc3f80b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3f77fe640 1 -- 172.21.15.67:0/3977414907 >> v1:172.21.15.67:6789/0 conn(0x7fc3f815c030 legacy=0x7fc3f815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.597+0000 7fc3f77fe640 1 -- 172.21.15.67:0/3977414907 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f806ec60 con 0x7fc3f80b3510 2024-09-19T05:38:01.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3f77fe640 1 --2- 172.21.15.67:0/3977414907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f80b3510 0x7fc3f806f460 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009d90 tx=0x7fc3f001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b57058dcf00daa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:01.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3f5ffb640 1 -- 172.21.15.67:0/3977414907 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00b2070 con 0x7fc3f80b3510 2024-09-19T05:38:01.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3f5ffb640 1 -- 172.21.15.67:0/3977414907 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f00a5880 con 0x7fc3f80b3510 2024-09-19T05:38:01.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3f5ffb640 1 -- 172.21.15.67:0/3977414907 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00a5c50 con 0x7fc3f80b3510 2024-09-19T05:38:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 -- 172.21.15.67:0/3977414907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f80b3510 msgr2=0x7fc3f806f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 --2- 172.21.15.67:0/3977414907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f80b3510 0x7fc3f806f460 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009d90 tx=0x7fc3f001c8b0 comp rx=0 tx=0).stop 2024-09-19T05:38:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 -- 172.21.15.67:0/3977414907 shutdown_connections 2024-09-19T05:38:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 --2- 172.21.15.67:0/3977414907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f80b3510 0x7fc3f806f460 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 --2- 172.21.15.67:0/3977414907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3f806dde0 0x7fc3f80b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 -- 172.21.15.67:0/3977414907 >> 172.21.15.67:0/3977414907 conn(0x7fc3f80d0080 msgr2=0x7fc3f80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 -- 172.21.15.67:0/3977414907 shutdown_connections 2024-09-19T05:38:01.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 -- 172.21.15.67:0/3977414907 wait complete. 2024-09-19T05:38:01.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 Processor -- start 2024-09-19T05:38:01.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 -- start start 2024-09-19T05:38:01.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3f806dde0 0x7fc3f8156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:01.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3f80b3510 0x7fc3f80992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:01.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f815c030 0x7fc3f80b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:01.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f81692f0 con 0x7fc3f815c030 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f815c620 con 0x7fc3f80b3510 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3fd307640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f8169470 con 0x7fc3f806dde0 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f815c030 0x7fc3f80b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f815c030 0x7fc3f80b0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43944/0 (socket says 172.21.15.67:43944) 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3f77fe640 1 -- 172.21.15.67:0/3856563833 learned_addr learned my addr 172.21.15.67:0/3856563833 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3f67fc640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3f80b3510 0x7fc3f80992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.601+0000 7fc3f6ffd640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3f806dde0 0x7fc3f8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3f77fe640 1 -- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3f806dde0 msgr2=0x7fc3f8156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3f77fe640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3f806dde0 0x7fc3f8156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3f77fe640 1 -- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3f80b3510 msgr2=0x7fc3f80992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3f77fe640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3f80b3510 0x7fc3f80992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3f77fe640 1 -- 172.21.15.67:0/3856563833 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f8152e90 con 0x7fc3f815c030 2024-09-19T05:38:01.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3f77fe640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f815c030 0x7fc3f80b0720 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00b0040 tx=0x7fc3f0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:01.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3df7fe640 1 -- 172.21.15.67:0/3856563833 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00b2050 con 0x7fc3f815c030 2024-09-19T05:38:01.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3df7fe640 1 -- 172.21.15.67:0/3856563833 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f00be070 con 0x7fc3f815c030 2024-09-19T05:38:01.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3fd307640 1 -- 172.21.15.67:0/3856563833 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f8153170 con 0x7fc3f815c030 2024-09-19T05:38:01.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3df7fe640 1 -- 172.21.15.67:0/3856563833 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00ada90 con 0x7fc3f815c030 2024-09-19T05:38:01.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3fd307640 1 -- 172.21.15.67:0/3856563833 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f8153730 con 0x7fc3f815c030 2024-09-19T05:38:01.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3fd307640 1 -- 172.21.15.67:0/3856563833 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f80afa00 con 0x7fc3f815c030 2024-09-19T05:38:01.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3df7fe640 1 -- 172.21.15.67:0/3856563833 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3f00adc30 con 0x7fc3f815c030 2024-09-19T05:38:01.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3df7fe640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678f0 0x7fc3e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:01.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3df7fe640 1 -- 172.21.15.67:0/3856563833 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6418+0+0 (secure 0 0 0) 0x7fc3f01211a0 con 0x7fc3f815c030 2024-09-19T05:38:01.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3f6ffd640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678f0 0x7fc3e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:01.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.605+0000 7fc3f6ffd640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678f0 0x7fc3e4069db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec000f70 tx=0x7fc3ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.609+0000 7fc3df7fe640 1 -- 172.21.15.67:0/3856563833 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc3f0016560 con 0x7fc3f815c030 2024-09-19T05:38:01.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.817+0000 7fc3fd307640 1 -- 172.21.15.67:0/3856563833 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3f80b2fd0 con 0x7fc3f815c030 2024-09-19T05:38:01.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3df7fe640 1 -- 172.21.15.67:0/3856563833 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7fc3f00f1a10 con 0x7fc3f815c030 2024-09-19T05:38:01.823 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:01.823 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":43,"btime":"2024-09-19T05:37:53:094115+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3435299141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3435299141},{"type":"v1","addr":"172.21.15.97:6837","nonce":3435299141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:53.094106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/223294608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":223294608},{"type":"v1","addr":"172.21.15.67:6835","nonce":223294608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6510,"qdb_cluster":[6510]},"id":4}]} 2024-09-19T05:38:01.824 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 43 2024-09-19T05:38:01.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 -- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678f0 msgr2=0x7fc3e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:01.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678f0 0x7fc3e4069db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec000f70 tx=0x7fc3ec009040 comp rx=0 tx=0).stop 2024-09-19T05:38:01.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 -- 172.21.15.67:0/3856563833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f815c030 msgr2=0x7fc3f80b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:01.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f815c030 0x7fc3f80b0720 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00b0040 tx=0x7fc3f0019650 comp rx=0 tx=0).stop 2024-09-19T05:38:01.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 -- 172.21.15.67:0/3856563833 shutdown_connections 2024-09-19T05:38:01.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3f815c030 0x7fc3f80b0720 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:01.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3f80b3510 0x7fc3f80992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:01.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678f0 0x7fc3e4069db0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:01.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 --2- 172.21.15.67:0/3856563833 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3f806dde0 0x7fc3f8156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:01.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 -- 172.21.15.67:0/3856563833 >> 172.21.15.67:0/3856563833 conn(0x7fc3f80d0080 msgr2=0x7fc3f80afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:01.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 -- 172.21.15.67:0/3856563833 shutdown_connections 2024-09-19T05:38:01.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:01.821+0000 7fc3fd307640 1 -- 172.21.15.67:0/3856563833 wait complete. 2024-09-19T05:38:01.844 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-19T05:38:01.985 INFO:teuthology.orchestra.run.smithi067.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-19T05:37:41.739342+0000","btime":"2024-09-19T05:37:40.843892+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-19T05:37:41.739342+0000","atime":"2024-09-19T05:37:40.843892+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-19T05:37:41.739342+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:37:41.740822+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:37:41.740822+0000"},"version":169,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-19T05:37:55.984117+0000","last_scrub_version":166,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-19T05:38:01.985 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-19T05:37:41.740822+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-19T05:37:40.843892+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-19T05:37:40.843892+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-19T05:37:41.739342+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-19T05:37:41.739342+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-19T05:37:55.984117+0000", "last_scrub_version": 166, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-19T05:37:41.739342+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-19T05:37:41.740822+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 169, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-19T05:38:01.985 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-19T05:38:01.986 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:38:01.986 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:38:02.040 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:38:02.112 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:38:02.112 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:38:02.112 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:38:02.112 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:02.118 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:38:02.119 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:38:02.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:02.119 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:38:02.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:38:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T05:38:02.170 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:38:02.170 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:38:02.170 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:02.177 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:38:02.177 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:38:02.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:02.177 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:38:02.223 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:38:02.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:38:02.224 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:38:02.224 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:38:02.224 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:02.230 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:38:02.230 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:38:02.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:02.230 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:38:02.275 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:38:02.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:38:02.276 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:38:02.276 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:38:02.276 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:02.282 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:38:02.283 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:38:02.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:02.283 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:38:02.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:38:02.332 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:38:02.332 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2096db640 1 Processor -- start 2024-09-19T05:38:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2096db640 1 -- start start 2024-09-19T05:38:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2096db640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc204161da0 0x7fc2040d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2096db640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2040d0160 0x7fc2040d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2096db640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2040d05d0 con 0x7fc2040d0e80 2024-09-19T05:38:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2096db640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc2040d1830 con 0x7fc2040d0160 2024-09-19T05:38:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2096db640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc2040d0840 con 0x7fc204161da0 2024-09-19T05:38:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2037fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2040d0160 0x7fc2040d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2037fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2040d0160 0x7fc2040d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43948/0 (socket says 172.21.15.67:43948) 2024-09-19T05:38:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2037fe640 1 -- 172.21.15.67:0/1104573864 learned_addr learned my addr 172.21.15.67:0/1104573864 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc202ffd640 1 --2- 172.21.15.67:0/1104573864 >> v2:172.21.15.97:3300/0 conn(0x7fc204161da0 0x7fc2040d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2037fe640 1 -- 172.21.15.67:0/1104573864 >> v2:172.21.15.97:3300/0 conn(0x7fc204161da0 msgr2=0x7fc2040d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2037fe640 1 --2- 172.21.15.67:0/1104573864 >> v2:172.21.15.97:3300/0 conn(0x7fc204161da0 0x7fc2040d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2037fe640 1 -- 172.21.15.67:0/1104573864 >> v1:172.21.15.97:6789/0 conn(0x7fc2040d0e80 legacy=0x7fc2040b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.465+0000 7fc2037fe640 1 -- 172.21.15.67:0/1104573864 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2040d4d40 con 0x7fc2040d0160 2024-09-19T05:38:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2037fe640 1 --2- 172.21.15.67:0/1104573864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2040d0160 0x7fc2040d12f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc2040b5f50 tx=0x7fc1fc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760a802f7ea31d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc201ffb640 1 -- 172.21.15.67:0/1104573864 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0b1070 con 0x7fc2040d0160 2024-09-19T05:38:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc201ffb640 1 -- 172.21.15.67:0/1104573864 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc0ac630 con 0x7fc2040d0160 2024-09-19T05:38:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc201ffb640 1 -- 172.21.15.67:0/1104573864 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0a8050 con 0x7fc2040d0160 2024-09-19T05:38:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2096db640 1 -- 172.21.15.67:0/1104573864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2040d0160 msgr2=0x7fc2040d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2096db640 1 --2- 172.21.15.67:0/1104573864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2040d0160 0x7fc2040d12f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc2040b5f50 tx=0x7fc1fc01c4e0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2096db640 1 -- 172.21.15.67:0/1104573864 shutdown_connections 2024-09-19T05:38:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2096db640 1 --2- 172.21.15.67:0/1104573864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2040d0160 0x7fc2040d12f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2096db640 1 --2- 172.21.15.67:0/1104573864 >> v2:172.21.15.97:3300/0 conn(0x7fc204161da0 0x7fc2040d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2096db640 1 -- 172.21.15.67:0/1104573864 >> 172.21.15.67:0/1104573864 conn(0x7fc20408bfc0 msgr2=0x7fc2040d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2096db640 1 -- 172.21.15.67:0/1104573864 shutdown_connections 2024-09-19T05:38:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2096db640 1 -- 172.21.15.67:0/1104573864 wait complete. 2024-09-19T05:38:02.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2096db640 1 Processor -- start 2024-09-19T05:38:02.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.469+0000 7fc2096db640 1 -- start start 2024-09-19T05:38:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2096db640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2040d0160 0x7fc20415ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2096db640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2040d0e80 0x7fc2040cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2096db640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204161da0 0x7fc2040b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2096db640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc204162180 con 0x7fc204161da0 2024-09-19T05:38:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2096db640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc2040b5d00 con 0x7fc2040d0160 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2096db640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc2040b50e0 con 0x7fc2040d0e80 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204161da0 0x7fc2040b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204161da0 0x7fc2040b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43958/0 (socket says 172.21.15.67:43958) 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2037fe640 1 -- 172.21.15.67:0/4047410044 learned_addr learned my addr 172.21.15.67:0/4047410044 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc202ffd640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2040d0160 0x7fc20415ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2027fc640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2040d0e80 0x7fc2040cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2037fe640 1 -- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2040d0e80 msgr2=0x7fc2040cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2037fe640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2040d0e80 0x7fc2040cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2037fe640 1 -- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2040d0160 msgr2=0x7fc20415ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2037fe640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2040d0160 0x7fc20415ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2037fe640 1 -- 172.21.15.67:0/4047410044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2040b15e0 con 0x7fc204161da0 2024-09-19T05:38:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2037fe640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204161da0 0x7fc2040b2680 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0af040 tx=0x7fc1fc019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc1fb7fe640 1 -- 172.21.15.67:0/4047410044 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0bc070 con 0x7fc204161da0 2024-09-19T05:38:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc1fb7fe640 1 -- 172.21.15.67:0/4047410044 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc0ab5e0 con 0x7fc204161da0 2024-09-19T05:38:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc1fb7fe640 1 -- 172.21.15.67:0/4047410044 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0b1070 con 0x7fc204161da0 2024-09-19T05:38:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2096db640 1 -- 172.21.15.67:0/4047410044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2040b18c0 con 0x7fc204161da0 2024-09-19T05:38:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2096db640 1 -- 172.21.15.67:0/4047410044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2040b2160 con 0x7fc204161da0 2024-09-19T05:38:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc2096db640 1 -- 172.21.15.67:0/4047410044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2040b1a90 con 0x7fc204161da0 2024-09-19T05:38:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc1fb7fe640 1 -- 172.21.15.67:0/4047410044 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1fc0ab9d0 con 0x7fc204161da0 2024-09-19T05:38:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc1fb7fe640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1e40678c0 0x7fc1e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.473+0000 7fc1fb7fe640 1 -- 172.21.15.67:0/4047410044 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6418+0+0 (secure 0 0 0) 0x7fc1fc11f900 con 0x7fc204161da0 2024-09-19T05:38:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.477+0000 7fc202ffd640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1e40678c0 0x7fc1e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.477+0000 7fc202ffd640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1e40678c0 0x7fc1e4069d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc204156340 tx=0x7fc1ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:02.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.481+0000 7fc1fb7fe640 1 -- 172.21.15.67:0/4047410044 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc1fc0160d0 con 0x7fc204161da0 2024-09-19T05:38:02.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.673+0000 7fc2096db640 1 -- 172.21.15.67:0/4047410044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc204068ea0 con 0x7fc204161da0 2024-09-19T05:38:02.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc1fb7fe640 1 -- 172.21.15.67:0/4047410044 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7fc1fc0f0200 con 0x7fc204161da0 2024-09-19T05:38:02.679 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:02.680 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":43,"btime":"2024-09-19T05:37:53:094115+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3435299141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3435299141},{"type":"v1","addr":"172.21.15.97:6837","nonce":3435299141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:53.094106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/223294608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":223294608},{"type":"v1","addr":"172.21.15.67:6835","nonce":223294608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6510,"qdb_cluster":[6510]},"id":4}]} 2024-09-19T05:38:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 43 2024-09-19T05:38:02.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 -- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1e40678c0 msgr2=0x7fc1e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1e40678c0 0x7fc1e4069d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc204156340 tx=0x7fc1ec008040 comp rx=0 tx=0).stop 2024-09-19T05:38:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 -- 172.21.15.67:0/4047410044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204161da0 msgr2=0x7fc2040b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204161da0 0x7fc2040b2680 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0af040 tx=0x7fc1fc019280 comp rx=0 tx=0).stop 2024-09-19T05:38:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 -- 172.21.15.67:0/4047410044 shutdown_connections 2024-09-19T05:38:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204161da0 0x7fc2040b2680 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1e40678c0 0x7fc1e4069d80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2040d0e80 0x7fc2040cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 --2- 172.21.15.67:0/4047410044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2040d0160 0x7fc20415ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 -- 172.21.15.67:0/4047410044 >> 172.21.15.67:0/4047410044 conn(0x7fc20408bfc0 msgr2=0x7fc2040d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:02.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 -- 172.21.15.67:0/4047410044 shutdown_connections 2024-09-19T05:38:02.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.677+0000 7fc2096db640 1 -- 172.21.15.67:0/4047410044 wait complete. 2024-09-19T05:38:02.698 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:02.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f67a6916640 1 Processor -- start 2024-09-19T05:38:02.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f67a6916640 1 -- start start 2024-09-19T05:38:02.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f67a6916640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67a015b1e0 0x7f67a00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f67a6916640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f67a00b4900 0x7f67a0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f67a6916640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a00b3860 con 0x7f67a00723c0 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f67a6916640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f67a015b5c0 con 0x7f67a015b1e0 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f67a6916640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f67a00b3b40 con 0x7f67a00b4900 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f679ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67a015b1e0 0x7f67a00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f679ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67a015b1e0 0x7f67a00b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43970/0 (socket says 172.21.15.67:43970) 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f679ffff640 1 -- 172.21.15.67:0/1815642903 learned_addr learned my addr 172.21.15.67:0/1815642903 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f6797fff640 1 --2- 172.21.15.67:0/1815642903 >> v2:172.21.15.97:3300/0 conn(0x7f67a00b4900 0x7f67a0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f679ffff640 1 -- 172.21.15.67:0/1815642903 >> v2:172.21.15.97:3300/0 conn(0x7f67a00b4900 msgr2=0x7f67a0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f679ffff640 1 --2- 172.21.15.67:0/1815642903 >> v2:172.21.15.97:3300/0 conn(0x7f67a00b4900 0x7f67a0071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f679ffff640 1 -- 172.21.15.67:0/1815642903 >> v1:172.21.15.97:6789/0 conn(0x7f67a00723c0 legacy=0x7f67a015ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:02.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.817+0000 7f679ffff640 1 -- 172.21.15.67:0/1815642903 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a00b3e20 con 0x7f67a015b1e0 2024-09-19T05:38:02.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f679ffff640 1 --2- 172.21.15.67:0/1815642903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a015b1e0 0x7f67a00b2fd0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f67a00ad2e0 tx=0x7f679001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568601659574b730 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:02.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f679f7fe640 1 -- 172.21.15.67:0/1815642903 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900aa430 con 0x7f67a015b1e0 2024-09-19T05:38:02.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f679f7fe640 1 -- 172.21.15.67:0/1815642903 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67900af070 con 0x7f67a015b1e0 2024-09-19T05:38:02.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f679f7fe640 1 -- 172.21.15.67:0/1815642903 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900aa7f0 con 0x7f67a015b1e0 2024-09-19T05:38:02.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f67a6916640 1 -- 172.21.15.67:0/1815642903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a015b1e0 msgr2=0x7f67a00b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:02.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f67a6916640 1 --2- 172.21.15.67:0/1815642903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a015b1e0 0x7f67a00b2fd0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f67a00ad2e0 tx=0x7f679001c4b0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f67a6916640 1 -- 172.21.15.67:0/1815642903 shutdown_connections 2024-09-19T05:38:02.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f67a6916640 1 --2- 172.21.15.67:0/1815642903 >> v2:172.21.15.97:3300/0 conn(0x7f67a00b4900 0x7f67a0071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f67a6916640 1 --2- 172.21.15.67:0/1815642903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a015b1e0 0x7f67a00b2fd0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f67a6916640 1 -- 172.21.15.67:0/1815642903 >> 172.21.15.67:0/1815642903 conn(0x7f67a00d0080 msgr2=0x7f67a00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:02.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f67a6916640 1 -- 172.21.15.67:0/1815642903 shutdown_connections 2024-09-19T05:38:02.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.821+0000 7f67a6916640 1 -- 172.21.15.67:0/1815642903 wait complete. 2024-09-19T05:38:02.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 Processor -- start 2024-09-19T05:38:02.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 -- start start 2024-09-19T05:38:02.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a00723c0 0x7f67a0145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a00b4900 0x7f67a0150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a015b1e0 0x7f67a01571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0168060 con 0x7f67a00723c0 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0072c60 con 0x7f67a00b4900 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67a01681e0 con 0x7f67a015b1e0 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a00723c0 0x7f67a0145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a00723c0 0x7f67a0145560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43986/0 (socket says 172.21.15.67:43986) 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679ffff640 1 -- 172.21.15.67:0/4209109662 learned_addr learned my addr 172.21.15.67:0/4209109662 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f6797fff640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a00b4900 0x7f67a0150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a4eb3640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a015b1e0 0x7f67a01571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679ffff640 1 -- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a015b1e0 msgr2=0x7f67a01571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:02.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679ffff640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a015b1e0 0x7f67a01571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679ffff640 1 -- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a00b4900 msgr2=0x7f67a0150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679ffff640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a00b4900 0x7f67a0150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679ffff640 1 -- 172.21.15.67:0/4209109662 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a0099950 con 0x7f67a00723c0 2024-09-19T05:38:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679ffff640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a00723c0 0x7f67a0145560 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f67900ac040 tx=0x7f679001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679d7fa640 1 -- 172.21.15.67:0/4209109662 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900aa840 con 0x7f67a00723c0 2024-09-19T05:38:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679d7fa640 1 -- 172.21.15.67:0/4209109662 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67900aaa00 con 0x7f67a00723c0 2024-09-19T05:38:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f679d7fa640 1 -- 172.21.15.67:0/4209109662 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900aadf0 con 0x7f67a00723c0 2024-09-19T05:38:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 -- 172.21.15.67:0/4209109662 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a0099c30 con 0x7f67a00723c0 2024-09-19T05:38:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 -- 172.21.15.67:0/4209109662 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a0150e80 con 0x7f67a00723c0 2024-09-19T05:38:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.825+0000 7f67a6916640 1 -- 172.21.15.67:0/4209109662 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a0071e80 con 0x7f67a00723c0 2024-09-19T05:38:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.829+0000 7f679d7fa640 1 -- 172.21.15.67:0/4209109662 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67900c4060 con 0x7f67a00723c0 2024-09-19T05:38:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.829+0000 7f679d7fa640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67800678f0 0x7f6780069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.829+0000 7f679d7fa640 1 -- 172.21.15.67:0/4209109662 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6418+0+0 (secure 0 0 0) 0x7f6790121dc0 con 0x7f67a00723c0 2024-09-19T05:38:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.829+0000 7f6797fff640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67800678f0 0x7f6780069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.829+0000 7f6797fff640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67800678f0 0x7f6780069db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f67a015cd60 tx=0x7f6788008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:02.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:02.833+0000 7f679d7fa640 1 -- 172.21.15.67:0/4209109662 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f67900b8070 con 0x7f67a00723c0 2024-09-19T05:38:03.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.033+0000 7f67a6916640 1 -- 172.21.15.67:0/4209109662 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67a0099e00 con 0x7f67a00723c0 2024-09-19T05:38:03.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.033+0000 7f679d7fa640 1 -- 172.21.15.67:0/4209109662 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f67900160d0 con 0x7f67a00723c0 2024-09-19T05:38:03.037 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:03.037 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":43,"btime":"2024-09-19T05:37:53:094115+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3435299141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3435299141},{"type":"v1","addr":"172.21.15.97:6837","nonce":3435299141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:53.094106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/223294608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":223294608},{"type":"v1","addr":"172.21.15.67:6835","nonce":223294608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6510,"qdb_cluster":[6510]},"id":4}]} 2024-09-19T05:38:03.037 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 43 2024-09-19T05:38:03.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 -- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67800678f0 msgr2=0x7f6780069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67800678f0 0x7f6780069db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f67a015cd60 tx=0x7f6788008040 comp rx=0 tx=0).stop 2024-09-19T05:38:03.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 -- 172.21.15.67:0/4209109662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a00723c0 msgr2=0x7f67a0145560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a00723c0 0x7f67a0145560 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f67900ac040 tx=0x7f679001acf0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 -- 172.21.15.67:0/4209109662 shutdown_connections 2024-09-19T05:38:03.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67800678f0 0x7f6780069db0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a015b1e0 0x7f67a01571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a00b4900 0x7f67a0150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 --2- 172.21.15.67:0/4209109662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67a00723c0 0x7f67a0145560 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 -- 172.21.15.67:0/4209109662 >> 172.21.15.67:0/4209109662 conn(0x7f67a00d0080 msgr2=0x7f67a014bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 -- 172.21.15.67:0/4209109662 shutdown_connections 2024-09-19T05:38:03.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.037+0000 7f67a6916640 1 -- 172.21.15.67:0/4209109662 wait complete. 2024-09-19T05:38:03.057 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:03.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf997e4640 1 Processor -- start 2024-09-19T05:38:03.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf997e4640 1 -- start start 2024-09-19T05:38:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf997e4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf940af730 0x7fdf9406e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf997e4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdf9406ebb0 0x7fdf940ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf997e4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf940730e0 con 0x7fdf9415a920 2024-09-19T05:38:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf997e4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fdf940733c0 con 0x7fdf9406ebb0 2024-09-19T05:38:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf997e4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdf940ad8c0 con 0x7fdf940af730 2024-09-19T05:38:03.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf8bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf940af730 0x7fdf9406e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf8bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf940af730 0x7fdf9406e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:33436/0 (socket says 172.21.15.67:33436) 2024-09-19T05:38:03.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf8bfff640 1 -- 172.21.15.67:0/2138038487 learned_addr learned my addr 172.21.15.67:0/2138038487 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:03.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf937fe640 1 --2- 172.21.15.67:0/2138038487 >> v2:172.21.15.97:3300/0 conn(0x7fdf9406ebb0 0x7fdf940ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf8bfff640 1 -- 172.21.15.67:0/2138038487 >> v2:172.21.15.97:3300/0 conn(0x7fdf9406ebb0 msgr2=0x7fdf940ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf8bfff640 1 --2- 172.21.15.67:0/2138038487 >> v2:172.21.15.97:3300/0 conn(0x7fdf9406ebb0 0x7fdf940ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf8bfff640 1 -- 172.21.15.67:0/2138038487 >> v1:172.21.15.97:6789/0 conn(0x7fdf9415a920 legacy=0x7fdf94072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.181+0000 7fdf8bfff640 1 -- 172.21.15.67:0/2138038487 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf940adba0 con 0x7fdf940af730 2024-09-19T05:38:03.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf8bfff640 1 --2- 172.21.15.67:0/2138038487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf940af730 0x7fdf9406e670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009870 tx=0x7fdf7c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab32cfd07d0a8091 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf927fc640 1 -- 172.21.15.67:0/2138038487 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0b0070 con 0x7fdf940af730 2024-09-19T05:38:03.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf927fc640 1 -- 172.21.15.67:0/2138038487 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0ab600 con 0x7fdf940af730 2024-09-19T05:38:03.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf927fc640 1 -- 172.21.15.67:0/2138038487 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0ab9d0 con 0x7fdf940af730 2024-09-19T05:38:03.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf997e4640 1 -- 172.21.15.67:0/2138038487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf940af730 msgr2=0x7fdf9406e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf997e4640 1 --2- 172.21.15.67:0/2138038487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf940af730 0x7fdf9406e670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009870 tx=0x7fdf7c01c560 comp rx=0 tx=0).stop 2024-09-19T05:38:03.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf997e4640 1 -- 172.21.15.67:0/2138038487 shutdown_connections 2024-09-19T05:38:03.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf997e4640 1 --2- 172.21.15.67:0/2138038487 >> v2:172.21.15.97:3300/0 conn(0x7fdf9406ebb0 0x7fdf940ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf997e4640 1 --2- 172.21.15.67:0/2138038487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf940af730 0x7fdf9406e670 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf997e4640 1 -- 172.21.15.67:0/2138038487 >> 172.21.15.67:0/2138038487 conn(0x7fdf940d0080 msgr2=0x7fdf940d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf997e4640 1 -- 172.21.15.67:0/2138038487 shutdown_connections 2024-09-19T05:38:03.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf997e4640 1 -- 172.21.15.67:0/2138038487 wait complete. 2024-09-19T05:38:03.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf997e4640 1 Processor -- start 2024-09-19T05:38:03.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.185+0000 7fdf997e4640 1 -- start start 2024-09-19T05:38:03.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf997e4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf9406ebb0 0x7fdf9414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf997e4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf940af730 0x7fdf940723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf997e4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf9415a920 0x7fdf940728e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf997e4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940ae990 con 0x7fdf9415a920 2024-09-19T05:38:03.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf997e4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940ae810 con 0x7fdf940af730 2024-09-19T05:38:03.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf997e4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdf940aeb10 con 0x7fdf9406ebb0 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf937fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf9415a920 0x7fdf940728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf937fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf9415a920 0x7fdf940728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43988/0 (socket says 172.21.15.67:43988) 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf937fe640 1 -- 172.21.15.67:0/2842851141 learned_addr learned my addr 172.21.15.67:0/2842851141 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf92ffd640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf9406ebb0 0x7fdf9414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf8bfff640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf940af730 0x7fdf940723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf937fe640 1 -- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf9406ebb0 msgr2=0x7fdf9414c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf937fe640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf9406ebb0 0x7fdf9414c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf937fe640 1 -- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf940af730 msgr2=0x7fdf940723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf937fe640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf940af730 0x7fdf940723a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf937fe640 1 -- 172.21.15.67:0/2842851141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf94153790 con 0x7fdf9415a920 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf937fe640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf9415a920 0x7fdf940728e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009dd0 tx=0x7fdf8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf8b7fe640 1 -- 172.21.15.67:0/2842851141 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c018020 con 0x7fdf9415a920 2024-09-19T05:38:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf997e4640 1 -- 172.21.15.67:0/2842851141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf940cecb0 con 0x7fdf9415a920 2024-09-19T05:38:03.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf8b7fe640 1 -- 172.21.15.67:0/2842851141 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8c014480 con 0x7fdf9415a920 2024-09-19T05:38:03.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf8b7fe640 1 -- 172.21.15.67:0/2842851141 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c014870 con 0x7fdf9415a920 2024-09-19T05:38:03.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf997e4640 1 -- 172.21.15.67:0/2842851141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf940cf680 con 0x7fdf9415a920 2024-09-19T05:38:03.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf997e4640 1 -- 172.21.15.67:0/2842851141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf940ae0c0 con 0x7fdf9415a920 2024-09-19T05:38:03.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf8b7fe640 1 -- 172.21.15.67:0/2842851141 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf8c01b020 con 0x7fdf9415a920 2024-09-19T05:38:03.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf8b7fe640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf740678f0 0x7fdf74069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf8b7fe640 1 -- 172.21.15.67:0/2842851141 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6418+0+0 (secure 0 0 0) 0x7fdf8c086ac0 con 0x7fdf9415a920 2024-09-19T05:38:03.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.189+0000 7fdf92ffd640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf740678f0 0x7fdf74069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.193+0000 7fdf92ffd640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf740678f0 0x7fdf74069db0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf940b06d0 tx=0x7fdf84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.193+0000 7fdf8b7fe640 1 -- 172.21.15.67:0/2842851141 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fdf8c022070 con 0x7fdf9415a920 2024-09-19T05:38:03.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.357+0000 7fdf997e4640 1 -- 172.21.15.67:0/2842851141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf940cea70 con 0x7fdf9415a920 2024-09-19T05:38:03.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.357+0000 7fdf8b7fe640 1 -- 172.21.15.67:0/2842851141 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+17405 (secure 0 0 0) 0x7fdf8c010040 con 0x7fdf9415a920 2024-09-19T05:38:03.362 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:03.362 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":74,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:37:58.975061+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:28.384593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:29.717693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":1,"to":3}]},{"pgid":"10.23","mappings":[{"from":7,"to":3}]},{"pgid":"10.2f","mappings":[{"from":4,"to":5}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6834/403505114":"2024-09-20T05:37:49.394619+0000","172.21.15.67:6832/403505114":"2024-09-20T05:37:49.394619+0000","172.21.15.67:6835/3283833069":"2024-09-20T05:37:49.369581+0000","172.21.15.67:6833/3283833069":"2024-09-20T05:37:49.369581+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:03.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 -- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf740678f0 msgr2=0x7fdf74069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf740678f0 0x7fdf74069db0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf940b06d0 tx=0x7fdf84009040 comp rx=0 tx=0).stop 2024-09-19T05:38:03.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 -- 172.21.15.67:0/2842851141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf9415a920 msgr2=0x7fdf940728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf9415a920 0x7fdf940728e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009dd0 tx=0x7fdf8c00c490 comp rx=0 tx=0).stop 2024-09-19T05:38:03.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 -- 172.21.15.67:0/2842851141 shutdown_connections 2024-09-19T05:38:03.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf9415a920 0x7fdf940728e0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf940af730 0x7fdf940723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdf740678f0 0x7fdf74069db0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 --2- 172.21.15.67:0/2842851141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdf9406ebb0 0x7fdf9414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 -- 172.21.15.67:0/2842851141 >> 172.21.15.67:0/2842851141 conn(0x7fdf940d0080 msgr2=0x7fdf940b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 -- 172.21.15.67:0/2842851141 shutdown_connections 2024-09-19T05:38:03.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.361+0000 7fdf997e4640 1 -- 172.21.15.67:0/2842851141 wait complete. 2024-09-19T05:38:03.380 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:38:03.380 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:03.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f27708ac640 1 Processor -- start 2024-09-19T05:38:03.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f27708ac640 1 -- start start 2024-09-19T05:38:03.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f27708ac640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f276c15c200 0x7f276c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f27708ac640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f276c0aef40 0x7f276c0af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f27708ac640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276c0b3070 con 0x7f276c15b710 2024-09-19T05:38:03.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f27708ac640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f276c0b32e0 con 0x7f276c15c200 2024-09-19T05:38:03.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f27708ac640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f276c0b35c0 con 0x7f276c0aef40 2024-09-19T05:38:03.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f2769d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f276c15c200 0x7f276c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f2769d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f276c15c200 0x7f276c071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44004/0 (socket says 172.21.15.67:44004) 2024-09-19T05:38:03.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f2769d9b640 1 -- 172.21.15.67:0/4192088376 learned_addr learned my addr 172.21.15.67:0/4192088376 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:03.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f276ad9d640 1 --2- 172.21.15.67:0/4192088376 >> v2:172.21.15.97:3300/0 conn(0x7f276c0aef40 0x7f276c0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f2769d9b640 1 -- 172.21.15.67:0/4192088376 >> v2:172.21.15.97:3300/0 conn(0x7f276c0aef40 msgr2=0x7f276c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f2769d9b640 1 --2- 172.21.15.67:0/4192088376 >> v2:172.21.15.97:3300/0 conn(0x7f276c0aef40 0x7f276c0af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f2769d9b640 1 -- 172.21.15.67:0/4192088376 >> v1:172.21.15.97:6789/0 conn(0x7f276c15b710 legacy=0x7f276c15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.493+0000 7f2769d9b640 1 -- 172.21.15.67:0/4192088376 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c0b38a0 con 0x7f276c15c200 2024-09-19T05:38:03.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f2769d9b640 1 --2- 172.21.15.67:0/4192088376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c15c200 0x7f276c071e80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f276c074470 tx=0x7f275401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6b6b2a7ae50cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276959a640 1 -- 172.21.15.67:0/4192088376 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540aa430 con 0x7f276c15c200 2024-09-19T05:38:03.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276959a640 1 -- 172.21.15.67:0/4192088376 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27540af070 con 0x7f276c15c200 2024-09-19T05:38:03.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276959a640 1 -- 172.21.15.67:0/4192088376 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540aa7f0 con 0x7f276c15c200 2024-09-19T05:38:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- 172.21.15.67:0/4192088376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c15c200 msgr2=0x7f276c071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 --2- 172.21.15.67:0/4192088376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c15c200 0x7f276c071e80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f276c074470 tx=0x7f275401c4b0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- 172.21.15.67:0/4192088376 shutdown_connections 2024-09-19T05:38:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 --2- 172.21.15.67:0/4192088376 >> v2:172.21.15.97:3300/0 conn(0x7f276c0aef40 0x7f276c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 --2- 172.21.15.67:0/4192088376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c15c200 0x7f276c071e80 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- 172.21.15.67:0/4192088376 >> 172.21.15.67:0/4192088376 conn(0x7f276c0d0080 msgr2=0x7f276c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- 172.21.15.67:0/4192088376 shutdown_connections 2024-09-19T05:38:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- 172.21.15.67:0/4192088376 wait complete. 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 Processor -- start 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- start start 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c0aef40 0x7f276c146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276c15b710 0x7f276c14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f276c15c200 0x7f276c14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0b4c40 con 0x7f276c0aef40 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0b4ac0 con 0x7f276c15b710 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f276c0b4dc0 con 0x7f276c15c200 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c0aef40 0x7f276c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c0aef40 0x7f276c146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44008/0 (socket says 172.21.15.67:44008) 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276a59c640 1 -- 172.21.15.67:0/3759637484 learned_addr learned my addr 172.21.15.67:0/3759637484 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f2769d9b640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276c15b710 0x7f276c14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276ad9d640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f276c15c200 0x7f276c14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276a59c640 1 -- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f276c15c200 msgr2=0x7f276c14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276a59c640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f276c15c200 0x7f276c14f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276a59c640 1 -- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276c15b710 msgr2=0x7f276c14efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276a59c640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276c15b710 0x7f276c14efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276a59c640 1 -- 172.21.15.67:0/3759637484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c0ce900 con 0x7f276c0aef40 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f2769d9b640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276c15b710 0x7f276c14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f276a59c640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c0aef40 0x7f276c146700 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f276400c7f0 tx=0x7f276400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f2762ffd640 1 -- 172.21.15.67:0/3759637484 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2764016020 con 0x7f276c0aef40 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f2762ffd640 1 -- 172.21.15.67:0/3759637484 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276400aa50 con 0x7f276c0aef40 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- 172.21.15.67:0/3759637484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c0cebe0 con 0x7f276c0aef40 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f2762ffd640 1 -- 172.21.15.67:0/3759637484 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276400ae40 con 0x7f276c0aef40 2024-09-19T05:38:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.497+0000 7f27708ac640 1 -- 172.21.15.67:0/3759637484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c0cf1a0 con 0x7f276c0aef40 2024-09-19T05:38:03.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.501+0000 7f27708ac640 1 -- 172.21.15.67:0/3759637484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f276c0af360 con 0x7f276c0aef40 2024-09-19T05:38:03.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.501+0000 7f2762ffd640 1 -- 172.21.15.67:0/3759637484 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2764019020 con 0x7f276c0aef40 2024-09-19T05:38:03.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.501+0000 7f2762ffd640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f274c0678c0 0x7f274c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.501+0000 7f2762ffd640 1 -- 172.21.15.67:0/3759637484 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6418+0+0 (secure 0 0 0) 0x7f27640860c0 con 0x7f276c0aef40 2024-09-19T05:38:03.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.501+0000 7f2769d9b640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f274c0678c0 0x7f274c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.501+0000 7f2769d9b640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f274c0678c0 0x7f274c069d80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f27540ae000 tx=0x7f2754008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.505+0000 7f2762ffd640 1 -- 172.21.15.67:0/3759637484 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2764020030 con 0x7f276c0aef40 2024-09-19T05:38:03.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.693+0000 7f27708ac640 1 -- 172.21.15.67:0/3759637484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f276c0b5020 con 0x7f276c0aef40 2024-09-19T05:38:03.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.693+0000 7f2762ffd640 1 -- 172.21.15.67:0/3759637484 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f2764056880 con 0x7f276c0aef40 2024-09-19T05:38:03.698 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:03.699 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":43,"btime":"2024-09-19T05:37:53:094115+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3435299141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3435299141},{"type":"v1","addr":"172.21.15.97:6837","nonce":3435299141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:53.094106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/223294608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":223294608},{"type":"v1","addr":"172.21.15.67:6835","nonce":223294608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6510,"qdb_cluster":[6510]},"id":4}]} 2024-09-19T05:38:03.699 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 43 2024-09-19T05:38:03.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 -- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f274c0678c0 msgr2=0x7f274c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f274c0678c0 0x7f274c069d80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f27540ae000 tx=0x7f2754008040 comp rx=0 tx=0).stop 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 -- 172.21.15.67:0/3759637484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c0aef40 msgr2=0x7f276c146700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c0aef40 0x7f276c146700 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f276400c7f0 tx=0x7f276400ccb0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 -- 172.21.15.67:0/3759637484 shutdown_connections 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f274c0678c0 0x7f274c069d80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f276c15c200 0x7f276c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276c15b710 0x7f276c14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 --2- 172.21.15.67:0/3759637484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276c0aef40 0x7f276c146700 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 -- 172.21.15.67:0/3759637484 >> 172.21.15.67:0/3759637484 conn(0x7f276c0d0080 msgr2=0x7f276c152680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 -- 172.21.15.67:0/3759637484 shutdown_connections 2024-09-19T05:38:03.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.697+0000 7f27708ac640 1 -- 172.21.15.67:0/3759637484 wait complete. 2024-09-19T05:38:03.716 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:03.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b3b14640 1 Processor -- start 2024-09-19T05:38:03.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b3b14640 1 -- start start 2024-09-19T05:38:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b3b14640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40ac15e550 0x7f40ac0d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b3b14640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40ac09b5d0 0x7f40ac1613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b3b14640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40ac161920 0x7f40ac15e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b3b14640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f40ac0d0970 con 0x7f40ac15e550 2024-09-19T05:38:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b3b14640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f40ac0d0bc0 con 0x7f40ac161920 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b3b14640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f40ac0d0ea0 con 0x7f40ac09b5d0 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b18b0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40ac15e550 0x7f40ac0d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b18b0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40ac15e550 0x7f40ac0d0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44022/0 (socket says 172.21.15.67:44022) 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b18b0640 1 -- 172.21.15.67:0/1816552306 learned_addr learned my addr 172.21.15.67:0/1816552306 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b20b1640 1 --2- 172.21.15.67:0/1816552306 >> v2:172.21.15.97:3300/0 conn(0x7f40ac161920 0x7f40ac15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b10af640 1 --2- 172.21.15.67:0/1816552306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40ac09b5d0 0x7f40ac1613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b18b0640 1 -- 172.21.15.67:0/1816552306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40ac09b5d0 msgr2=0x7f40ac1613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b18b0640 1 --2- 172.21.15.67:0/1816552306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40ac09b5d0 0x7f40ac1613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b18b0640 1 -- 172.21.15.67:0/1816552306 >> v2:172.21.15.97:3300/0 conn(0x7f40ac161920 msgr2=0x7f40ac15e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b18b0640 1 --2- 172.21.15.67:0/1816552306 >> v2:172.21.15.97:3300/0 conn(0x7f40ac161920 0x7f40ac15e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.821+0000 7f40b18b0640 1 -- 172.21.15.67:0/1816552306 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ac0d1180 con 0x7f40ac15e550 2024-09-19T05:38:03.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b18b0640 1 --2- 172.21.15.67:0/1816552306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac15e550 0x7f40ac0d0430 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f40ac163110 tx=0x7f409c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae57c91d5187b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b08ae640 1 -- 172.21.15.67:0/1816552306 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c0a5840 con 0x7f40ac15e550 2024-09-19T05:38:03.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b08ae640 1 -- 172.21.15.67:0/1816552306 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f409c0a59e0 con 0x7f40ac15e550 2024-09-19T05:38:03.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b08ae640 1 -- 172.21.15.67:0/1816552306 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c0a5db0 con 0x7f40ac15e550 2024-09-19T05:38:03.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 -- 172.21.15.67:0/1816552306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac15e550 msgr2=0x7f40ac0d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 --2- 172.21.15.67:0/1816552306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac15e550 0x7f40ac0d0430 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f40ac163110 tx=0x7f409c01c9c0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 -- 172.21.15.67:0/1816552306 shutdown_connections 2024-09-19T05:38:03.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 --2- 172.21.15.67:0/1816552306 >> v2:172.21.15.97:3300/0 conn(0x7f40ac161920 0x7f40ac15e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 --2- 172.21.15.67:0/1816552306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40ac09b5d0 0x7f40ac1613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 --2- 172.21.15.67:0/1816552306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac15e550 0x7f40ac0d0430 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 -- 172.21.15.67:0/1816552306 >> 172.21.15.67:0/1816552306 conn(0x7f40ac0b3d90 msgr2=0x7f40ac0b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 -- 172.21.15.67:0/1816552306 shutdown_connections 2024-09-19T05:38:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 -- 172.21.15.67:0/1816552306 wait complete. 2024-09-19T05:38:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 Processor -- start 2024-09-19T05:38:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.825+0000 7f40b3b14640 1 -- start start 2024-09-19T05:38:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b3b14640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac09b5d0 0x7f40ac0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b3b14640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40ac15e550 0x7f40ac0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b3b14640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40ac161920 0x7f40ac156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b3b14640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac09b9e0 con 0x7f40ac09b5d0 2024-09-19T05:38:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b3b14640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac161d30 con 0x7f40ac161920 2024-09-19T05:38:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b3b14640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f40ac09bb60 con 0x7f40ac15e550 2024-09-19T05:38:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b18b0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac09b5d0 0x7f40ac0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b18b0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac09b5d0 0x7f40ac0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44038/0 (socket says 172.21.15.67:44038) 2024-09-19T05:38:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b18b0640 1 -- 172.21.15.67:0/2560755341 learned_addr learned my addr 172.21.15.67:0/2560755341 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b10af640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40ac15e550 0x7f40ac0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b20b1640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40ac161920 0x7f40ac156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b18b0640 1 -- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40ac15e550 msgr2=0x7f40ac0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b18b0640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40ac15e550 0x7f40ac0b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b18b0640 1 -- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40ac161920 msgr2=0x7f40ac156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b18b0640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40ac161920 0x7f40ac156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b18b0640 1 -- 172.21.15.67:0/2560755341 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ac0b7b10 con 0x7f40ac09b5d0 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b20b1640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40ac161920 0x7f40ac156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b18b0640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac09b5d0 0x7f40ac0b5f80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f409c01d260 tx=0x7f409c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40aa7fc640 1 -- 172.21.15.67:0/2560755341 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c0b8880 con 0x7f40ac09b5d0 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40aa7fc640 1 -- 172.21.15.67:0/2560755341 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f409c0be070 con 0x7f40ac09b5d0 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b3b14640 1 -- 172.21.15.67:0/2560755341 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ac0b7df0 con 0x7f40ac09b5d0 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40aa7fc640 1 -- 172.21.15.67:0/2560755341 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c0b8ca0 con 0x7f40ac09b5d0 2024-09-19T05:38:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b3b14640 1 -- 172.21.15.67:0/2560755341 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ac0b23a0 con 0x7f40ac09b5d0 2024-09-19T05:38:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b3b14640 1 -- 172.21.15.67:0/2560755341 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ac15f280 con 0x7f40ac09b5d0 2024-09-19T05:38:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40aa7fc640 1 -- 172.21.15.67:0/2560755341 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f409c0039a0 con 0x7f40ac09b5d0 2024-09-19T05:38:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40aa7fc640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40980678f0 0x7f4098069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40aa7fc640 1 -- 172.21.15.67:0/2560755341 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6418+0+0 (secure 0 0 0) 0x7f409c120e60 con 0x7f40ac09b5d0 2024-09-19T05:38:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.829+0000 7f40b10af640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40980678f0 0x7f4098069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.833+0000 7f40b10af640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40980678f0 0x7f4098069db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0cc850 tx=0x7f40a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:03.833+0000 7f40aa7fc640 1 -- 172.21.15.67:0/2560755341 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f409c0165e0 con 0x7f40ac09b5d0 2024-09-19T05:38:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.029+0000 7f40b3b14640 1 -- 172.21.15.67:0/2560755341 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40ac0cc8b0 con 0x7f40ac09b5d0 2024-09-19T05:38:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40aa7fc640 1 -- 172.21.15.67:0/2560755341 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f409c0f16e0 con 0x7f40ac09b5d0 2024-09-19T05:38:04.035 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:04.036 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":43,"btime":"2024-09-19T05:37:53:094115+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3435299141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3435299141},{"type":"v1","addr":"172.21.15.97:6837","nonce":3435299141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:30.724054+0000","modified":"2024-09-19T05:37:53.094106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/223294608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":223294608},{"type":"v1","addr":"172.21.15.67:6835","nonce":223294608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6510,"qdb_cluster":[6510]},"id":4}]} 2024-09-19T05:38:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 43 2024-09-19T05:38:04.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 -- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40980678f0 msgr2=0x7f4098069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40980678f0 0x7f4098069db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0cc850 tx=0x7f40a0008040 comp rx=0 tx=0).stop 2024-09-19T05:38:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 -- 172.21.15.67:0/2560755341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac09b5d0 msgr2=0x7f40ac0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac09b5d0 0x7f40ac0b5f80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f409c01d260 tx=0x7f409c019760 comp rx=0 tx=0).stop 2024-09-19T05:38:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 -- 172.21.15.67:0/2560755341 shutdown_connections 2024-09-19T05:38:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40ac161920 0x7f40ac156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40980678f0 0x7f4098069db0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40ac15e550 0x7f40ac0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 --2- 172.21.15.67:0/2560755341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac09b5d0 0x7f40ac0b5f80 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 -- 172.21.15.67:0/2560755341 >> 172.21.15.67:0/2560755341 conn(0x7f40ac0b3d90 msgr2=0x7f40ac0b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 -- 172.21.15.67:0/2560755341 shutdown_connections 2024-09-19T05:38:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.033+0000 7f40b3b14640 1 -- 172.21.15.67:0/2560755341 wait complete. 2024-09-19T05:38:04.056 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:04.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.177+0000 7f73b821f640 1 Processor -- start 2024-09-19T05:38:04.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.177+0000 7f73b821f640 1 -- start start 2024-09-19T05:38:04.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.177+0000 7f73b821f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f73b015c030 0x7f73b006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.177+0000 7f73b821f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73b006e3c0 con 0x7f73b006f460 2024-09-19T05:38:04.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.177+0000 7f73b821f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73b006e6a0 con 0x7f73b015d1d0 2024-09-19T05:38:04.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.177+0000 7f73b821f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f73b006e980 con 0x7f73b015c030 2024-09-19T05:38:04.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.177+0000 7f73b67bc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f73b006f460 0x7f73b00acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:54038/0 (socket says 172.21.15.67:54038) 2024-09-19T05:38:04.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.177+0000 7f73b67bc640 1 -- 172.21.15.67:0/1788176192 learned_addr learned my addr 172.21.15.67:0/1788176192 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417430903 0 0) 0x7f73b006e3c0 con 0x7f73b006f460 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b5fbb640 1 --2- 172.21.15.67:0/1788176192 >> v2:172.21.15.97:3300/0 conn(0x7f73b015c030 0x7f73b006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f739c003530 con 0x7f73b006f460 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1834009657 0 0) 0x7f739c003530 con 0x7f73b006f460 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 >> v2:172.21.15.97:3300/0 conn(0x7f73b015c030 msgr2=0x7f73b006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 --2- 172.21.15.67:0/1788176192 >> v2:172.21.15.97:3300/0 conn(0x7f73b015c030 0x7f73b006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 >> v1:172.21.15.97:6789/0 conn(0x7f73b015d1d0 legacy=0x7f73b00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b006ec60 con 0x7f73b006f460 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f73a8001a00 con 0x7f73b006f460 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b5fbb640 1 --2- 172.21.15.67:0/1788176192 >> v2:172.21.15.97:3300/0 conn(0x7f73b015c030 0x7f73b006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 >> v1:172.21.15.67:6789/0 conn(0x7f73b006f460 legacy=0x7f73b00acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f739c0039c0 0x7f739c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c004810 0x7f739c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f739c0051d0 0x7f739c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73b006e980 con 0x7f739c0039c0 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f739c00c120 con 0x7f739c0051d0 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f739c00c320 con 0x7f739c004810 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b5fbb640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f739c0039c0 0x7f739c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b67bc640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f739c0051d0 0x7f739c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b57ba640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c004810 0x7f739c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b5fbb640 1 -- 172.21.15.67:0/1788176192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c004810 msgr2=0x7f739c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b5fbb640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c004810 0x7f739c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b5fbb640 1 -- 172.21.15.67:0/1788176192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f739c0051d0 msgr2=0x7f739c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:04.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b5fbb640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f739c0051d0 0x7f739c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b5fbb640 1 -- 172.21.15.67:0/1788176192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739c003530 con 0x7f739c0039c0 2024-09-19T05:38:04.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b67bc640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f739c0051d0 0x7f739c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:04.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b57ba640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c004810 0x7f739c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:04.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b67bc640 1 -- 172.21.15.67:0/1788176192 reap_dead start 2024-09-19T05:38:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b5fbb640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f739c0039c0 0x7f739c003de0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0098d0 tx=0x7f73ac01c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8bee24655253ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac00f040 con 0x7f739c0039c0 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac0af070 con 0x7f739c0039c0 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b4fb9640 1 -- 172.21.15.67:0/1788176192 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0aa810 con 0x7f739c0039c0 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b821f640 1 -- 172.21.15.67:0/1788176192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f739c0039c0 msgr2=0x7f739c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b821f640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f739c0039c0 0x7f739c003de0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0098d0 tx=0x7f73ac01c5a0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.181+0000 7f73b821f640 1 -- 172.21.15.67:0/1788176192 shutdown_connections 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 --2- 172.21.15.67:0/1788176192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f739c0039c0 0x7f739c003de0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 -- 172.21.15.67:0/1788176192 >> 172.21.15.67:0/1788176192 conn(0x7f73b00d0080 msgr2=0x7f73b00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 -- 172.21.15.67:0/1788176192 shutdown_connections 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 -- 172.21.15.67:0/1788176192 wait complete. 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 Processor -- start 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 -- start start 2024-09-19T05:38:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c0039c0 0x7f73b0159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73b0099900 0x7f73b015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b015f060 0x7f73b015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73b015c410 con 0x7f73b015f060 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f73b006fc50 con 0x7f73b0099900 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f73b015c590 con 0x7f739c0039c0 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b67bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b015f060 0x7f73b015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b67bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b015f060 0x7f73b015a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44056/0 (socket says 172.21.15.67:44056) 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b67bc640 1 -- 172.21.15.67:0/2547853959 learned_addr learned my addr 172.21.15.67:0/2547853959 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b5fbb640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c0039c0 0x7f73b0159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b57ba640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73b0099900 0x7f73b015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b67bc640 1 -- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c0039c0 msgr2=0x7f73b0159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b67bc640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c0039c0 0x7f73b0159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b67bc640 1 -- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73b0099900 msgr2=0x7f73b015eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b67bc640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73b0099900 0x7f73b015eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b67bc640 1 -- 172.21.15.67:0/2547853959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b0144000 con 0x7f73b015f060 2024-09-19T05:38:04.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b67bc640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b015f060 0x7f73b015a5a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f73b015fca0 tx=0x7f73a8007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:04.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73a67fc640 1 -- 172.21.15.67:0/2547853959 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a800ea20 con 0x7f73b015f060 2024-09-19T05:38:04.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73a67fc640 1 -- 172.21.15.67:0/2547853959 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a800ebc0 con 0x7f73b015f060 2024-09-19T05:38:04.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73a67fc640 1 -- 172.21.15.67:0/2547853959 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8014430 con 0x7f73b015f060 2024-09-19T05:38:04.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 -- 172.21.15.67:0/2547853959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b01442e0 con 0x7f73b015f060 2024-09-19T05:38:04.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 -- 172.21.15.67:0/2547853959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b01448a0 con 0x7f73b015f060 2024-09-19T05:38:04.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.185+0000 7f73b821f640 1 -- 172.21.15.67:0/2547853959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b00acfb0 con 0x7f73b015f060 2024-09-19T05:38:04.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.189+0000 7f73a67fc640 1 -- 172.21.15.67:0/2547853959 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73a80145d0 con 0x7f73b015f060 2024-09-19T05:38:04.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.189+0000 7f73a67fc640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73940678c0 0x7f7394069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.189+0000 7f73a67fc640 1 -- 172.21.15.67:0/2547853959 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6418+0+0 (secure 0 0 0) 0x7f73a8085c70 con 0x7f73b015f060 2024-09-19T05:38:04.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.189+0000 7f73b5fbb640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73940678c0 0x7f7394069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.189+0000 7f73b5fbb640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73940678c0 0x7f7394069d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0ae000 tx=0x7f73ac0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:04.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.193+0000 7f73a67fc640 1 -- 172.21.15.67:0/2547853959 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f73a80564e0 con 0x7f73b015f060 2024-09-19T05:38:04.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.349+0000 7f73b821f640 1 -- 172.21.15.67:0/2547853959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73b015cf90 con 0x7f73b015f060 2024-09-19T05:38:04.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.349+0000 7f73a67fc640 1 -- 172.21.15.67:0/2547853959 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+17405 (secure 0 0 0) 0x7f73a8055de0 con 0x7f73b015f060 2024-09-19T05:38:04.355 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:04.355 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":74,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:37:58.975061+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:28.384593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:29.717693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":1,"to":3}]},{"pgid":"10.23","mappings":[{"from":7,"to":3}]},{"pgid":"10.2f","mappings":[{"from":4,"to":5}]},{"pgid":"10.35","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6834/403505114":"2024-09-20T05:37:49.394619+0000","172.21.15.67:6832/403505114":"2024-09-20T05:37:49.394619+0000","172.21.15.67:6835/3283833069":"2024-09-20T05:37:49.369581+0000","172.21.15.67:6833/3283833069":"2024-09-20T05:37:49.369581+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 -- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73940678c0 msgr2=0x7f7394069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73940678c0 0x7f7394069d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0ae000 tx=0x7f73ac0046d0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 -- 172.21.15.67:0/2547853959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b015f060 msgr2=0x7f73b015a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b015f060 0x7f73b015a5a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f73b015fca0 tx=0x7f73a8007bc0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 -- 172.21.15.67:0/2547853959 shutdown_connections 2024-09-19T05:38:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b015f060 0x7f73b015a5a0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73b0099900 0x7f73b015eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73940678c0 0x7f7394069d80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 --2- 172.21.15.67:0/2547853959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c0039c0 0x7f73b0159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 -- 172.21.15.67:0/2547853959 >> 172.21.15.67:0/2547853959 conn(0x7f73b00d0080 msgr2=0x7f73b0155440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 -- 172.21.15.67:0/2547853959 shutdown_connections 2024-09-19T05:38:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.353+0000 7f73b821f640 1 -- 172.21.15.67:0/2547853959 wait complete. 2024-09-19T05:38:04.373 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:38:04.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab42ea640 1 Processor -- start 2024-09-19T05:38:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab42ea640 1 -- start start 2024-09-19T05:38:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab42ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac06dde0 0x7feaac0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab42ea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7feaac0b3510 0x7feaac06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab42ea640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaac06e3c0 con 0x7feaac15c030 2024-09-19T05:38:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab42ea640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7feaac06e6a0 con 0x7feaac0b3510 2024-09-19T05:38:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab42ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7feaac06e980 con 0x7feaac06dde0 2024-09-19T05:38:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab2086640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7feaac15c030 0x7feaac15d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:54044/0 (socket says 172.21.15.67:54044) 2024-09-19T05:38:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab2086640 1 -- 172.21.15.67:0/498844294 learned_addr learned my addr 172.21.15.67:0/498844294 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab2887640 1 --2- 172.21.15.67:0/498844294 >> v2:172.21.15.97:3300/0 conn(0x7feaac0b3510 0x7feaac06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1885640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac06dde0 0x7feaac0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961977976 0 0) 0x7feaac06e3c0 con 0x7feaac15c030 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea94003530 con 0x7feaac15c030 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3842114923 0 0) 0x7fea94003530 con 0x7feaac15c030 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac06dde0 msgr2=0x7feaac0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac06dde0 0x7feaac0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 >> v2:172.21.15.97:3300/0 conn(0x7feaac0b3510 msgr2=0x7feaac06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 --2- 172.21.15.67:0/498844294 >> v2:172.21.15.97:3300/0 conn(0x7feaac0b3510 0x7feaac06f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac06ec60 con 0x7feaac15c030 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fea9c001680 con 0x7feaac15c030 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 >> v1:172.21.15.67:6789/0 conn(0x7feaac15c030 legacy=0x7feaac15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac06dde0 0x7fea940039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 0x7fea94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea94004d50 0x7fea940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feaac06e6a0 con 0x7fea94003f40 2024-09-19T05:38:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7feaac06e980 con 0x7fea94004d50 2024-09-19T05:38:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fea9400ba20 con 0x7feaac06dde0 2024-09-19T05:38:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1885640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 0x7fea94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab2086640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac06dde0 0x7fea940039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1885640 1 -- 172.21.15.67:0/498844294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac06dde0 msgr2=0x7fea940039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1885640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac06dde0 0x7fea940039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1885640 1 -- 172.21.15.67:0/498844294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea94004d50 msgr2=0x7fea940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1885640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea94004d50 0x7fea940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.493+0000 7feab1885640 1 -- 172.21.15.67:0/498844294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea94003530 con 0x7fea94003f40 2024-09-19T05:38:04.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab1885640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 0x7fea94004810 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7feaa000e170 tx=0x7feaa001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a9f212a4012266 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:04.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa00b2070 con 0x7fea94003f40 2024-09-19T05:38:04.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa00a5b30 con 0x7fea94003f40 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab1084640 1 -- 172.21.15.67:0/498844294 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa0009c10 con 0x7fea94003f40 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 -- 172.21.15.67:0/498844294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 msgr2=0x7fea94004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 --2- 172.21.15.67:0/498844294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 0x7fea94004810 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7feaa000e170 tx=0x7feaa001cc30 comp rx=0 tx=0).stop 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab2887640 1 -- 172.21.15.67:0/498844294 reap_dead start 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 -- 172.21.15.67:0/498844294 shutdown_connections 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 -- 172.21.15.67:0/498844294 >> 172.21.15.67:0/498844294 conn(0x7feaac0d0080 msgr2=0x7feaac0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 -- 172.21.15.67:0/498844294 shutdown_connections 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 -- 172.21.15.67:0/498844294 wait complete. 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 Processor -- start 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 -- start start 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 0x7feaac1622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaac1f5430 0x7feaac152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac15d760 0x7feaac0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feaac1670d0 con 0x7fea94003f40 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7feaac15c620 con 0x7feaac1f5430 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab42ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7feaac167250 con 0x7feaac15d760 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab2086640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 0x7feaac1622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab2086640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 0x7feaac1622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44072/0 (socket says 172.21.15.67:44072) 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.497+0000 7feab2086640 1 -- 172.21.15.67:0/2612629720 learned_addr learned my addr 172.21.15.67:0/2612629720 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab1885640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaac1f5430 0x7feaac152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab2086640 1 -- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac15d760 msgr2=0x7feaac0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab2887640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac15d760 0x7feaac0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab2086640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac15d760 0x7feaac0b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab2086640 1 -- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaac1f5430 msgr2=0x7feaac152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab2086640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaac1f5430 0x7feaac152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab2086640 1 -- 172.21.15.67:0/2612629720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac162930 con 0x7fea94003f40 2024-09-19T05:38:04.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab2086640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 0x7feaac1622e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fea9c000fc0 tx=0x7fea9c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:04.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feaaaffd640 1 -- 172.21.15.67:0/2612629720 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00c6c0 con 0x7fea94003f40 2024-09-19T05:38:04.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feaaaffd640 1 -- 172.21.15.67:0/2612629720 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9c018070 con 0x7fea94003f40 2024-09-19T05:38:04.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab42ea640 1 -- 172.21.15.67:0/2612629720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaac162c10 con 0x7fea94003f40 2024-09-19T05:38:04.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feaaaffd640 1 -- 172.21.15.67:0/2612629720 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00cac0 con 0x7fea94003f40 2024-09-19T05:38:04.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab42ea640 1 -- 172.21.15.67:0/2612629720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaac15dc10 con 0x7fea94003f40 2024-09-19T05:38:04.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab42ea640 1 -- 172.21.15.67:0/2612629720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaac06f460 con 0x7fea94003f40 2024-09-19T05:38:04.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feaaaffd640 1 -- 172.21.15.67:0/2612629720 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fea9c00cc60 con 0x7fea94003f40 2024-09-19T05:38:04.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feaaaffd640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea980678f0 0x7fea98069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feaaaffd640 1 -- 172.21.15.67:0/2612629720 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6418+0+0 (secure 0 0 0) 0x7fea9c0859e0 con 0x7fea94003f40 2024-09-19T05:38:04.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab1885640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea980678f0 0x7fea98069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.501+0000 7feab1885640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea980678f0 0x7fea98069db0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7feaa00af000 tx=0x7feaa00a7040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:04.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.505+0000 7feaaaffd640 1 -- 172.21.15.67:0/2612629720 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fea9c0562e0 con 0x7fea94003f40 2024-09-19T05:38:04.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.705+0000 7feab42ea640 1 -- 172.21.15.67:0/2612629720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feaac0d0f20 con 0x7fea94003f40 2024-09-19T05:38:04.710 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:38:04.705+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:38:04.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.709+0000 7feaaaffd640 1 -- 172.21.15.67:0/2612629720 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) ==== 161+0+0 (secure 0 0 0) 0x7fea9c055be0 con 0x7fea94003f40 2024-09-19T05:38:04.712 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:38:04.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 -- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea980678f0 msgr2=0x7fea98069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea980678f0 0x7fea98069db0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7feaa00af000 tx=0x7feaa00a7040 comp rx=0 tx=0).stop 2024-09-19T05:38:04.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 -- 172.21.15.67:0/2612629720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 msgr2=0x7feaac1622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 0x7feaac1622e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fea9c000fc0 tx=0x7fea9c00eba0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 -- 172.21.15.67:0/2612629720 shutdown_connections 2024-09-19T05:38:04.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fea980678f0 0x7fea98069db0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feaac15d760 0x7feaac0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaac1f5430 0x7feaac152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 --2- 172.21.15.67:0/2612629720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea94003f40 0x7feaac1622e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 -- 172.21.15.67:0/2612629720 >> 172.21.15.67:0/2612629720 conn(0x7feaac0d0080 msgr2=0x7feaac1666a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:04.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 -- 172.21.15.67:0/2612629720 shutdown_connections 2024-09-19T05:38:04.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.713+0000 7feab42ea640 1 -- 172.21.15.67:0/2612629720 wait complete. 2024-09-19T05:38:04.722 INFO:tasks.ceph.mds.a.smithi067.stderr: -2204> 2024-09-19T05:37:55.089+0000 7fc0ee6fc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:38:04.734 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:38:04.779 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:38:04.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.849+0000 7f4934f17640 1 Processor -- start 2024-09-19T05:38:04.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.849+0000 7f4934f17640 1 -- start start 2024-09-19T05:38:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.849+0000 7f4934f17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f493015e690 0x7f49300d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.849+0000 7f4934f17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f49300d1590 0x7f493006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.849+0000 7f4934f17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49300d35a0 con 0x7f49300d4fb0 2024-09-19T05:38:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.849+0000 7f4934f17640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f49300d32c0 con 0x7f49300d1590 2024-09-19T05:38:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.849+0000 7f4934f17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f493006d040 con 0x7f493015e690 2024-09-19T05:38:04.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492e59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f493015e690 0x7f49300d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492ed9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f49300d1590 0x7f493006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492e59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f493015e690 0x7f49300d2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:33542/0 (socket says 172.21.15.67:33542) 2024-09-19T05:38:04.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492e59c640 1 -- 172.21.15.67:0/2781748552 learned_addr learned my addr 172.21.15.67:0/2781748552 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:04.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492ed9d640 1 -- 172.21.15.67:0/2781748552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f493015e690 msgr2=0x7f49300d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:04.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492ed9d640 1 --2- 172.21.15.67:0/2781748552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f493015e690 0x7f49300d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492ed9d640 1 -- 172.21.15.67:0/2781748552 >> v1:172.21.15.97:6789/0 conn(0x7f49300d4fb0 legacy=0x7f49300d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492ed9d640 1 -- 172.21.15.67:0/2781748552 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493006d320 con 0x7f49300d1590 2024-09-19T05:38:04.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492e59c640 1 --2- 172.21.15.67:0/2781748552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f493015e690 0x7f49300d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:04.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492ed9d640 1 --2- 172.21.15.67:0/2781748552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49300d1590 0x7f493006db20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4928009d90 tx=0x7f492801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73f08641183bd0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:04.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492d59a640 1 -- 172.21.15.67:0/2781748552 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280b2070 con 0x7f49300d1590 2024-09-19T05:38:04.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492d59a640 1 -- 172.21.15.67:0/2781748552 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49280a59a0 con 0x7f49300d1590 2024-09-19T05:38:04.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.853+0000 7f492d59a640 1 -- 172.21.15.67:0/2781748552 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280a5d70 con 0x7f49300d1590 2024-09-19T05:38:04.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- 172.21.15.67:0/2781748552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49300d1590 msgr2=0x7f493006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 --2- 172.21.15.67:0/2781748552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49300d1590 0x7f493006db20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4928009d90 tx=0x7f492801c940 comp rx=0 tx=0).stop 2024-09-19T05:38:04.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- 172.21.15.67:0/2781748552 shutdown_connections 2024-09-19T05:38:04.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 --2- 172.21.15.67:0/2781748552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49300d1590 0x7f493006db20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 --2- 172.21.15.67:0/2781748552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f493015e690 0x7f49300d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- 172.21.15.67:0/2781748552 >> 172.21.15.67:0/2781748552 conn(0x7f49300d4490 msgr2=0x7f49300d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:04.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- 172.21.15.67:0/2781748552 shutdown_connections 2024-09-19T05:38:04.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- 172.21.15.67:0/2781748552 wait complete. 2024-09-19T05:38:04.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 Processor -- start 2024-09-19T05:38:04.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- start start 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49300d1590 0x7f49301f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49300d4fb0 0x7f49301560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f493015e690 0x7f4930156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f493006e9f0 con 0x7f49300d1590 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f493006e870 con 0x7f493015e690 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f493006eb70 con 0x7f49300d4fb0 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49300d1590 0x7f49301f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49300d1590 0x7f49301f7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44102/0 (socket says 172.21.15.67:44102) 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492e59c640 1 -- 172.21.15.67:0/2981386990 learned_addr learned my addr 172.21.15.67:0/2981386990 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492dd9b640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49300d4fb0 0x7f49301560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492ed9d640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f493015e690 0x7f4930156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492e59c640 1 -- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49300d4fb0 msgr2=0x7f49301560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492e59c640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49300d4fb0 0x7f49301560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492e59c640 1 -- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f493015e690 msgr2=0x7f4930156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492e59c640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f493015e690 0x7f4930156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492e59c640 1 -- 172.21.15.67:0/2981386990 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4930154490 con 0x7f49300d1590 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f492e59c640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49300d1590 0x7f49301f7ab0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f492000e930 tx=0x7f492000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f491effd640 1 -- 172.21.15.67:0/2981386990 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920017070 con 0x7f49300d1590 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f491effd640 1 -- 172.21.15.67:0/2981386990 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492000ca00 con 0x7f49300d1590 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f491effd640 1 -- 172.21.15.67:0/2981386990 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492000cdd0 con 0x7f49300d1590 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- 172.21.15.67:0/2981386990 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4930154770 con 0x7f49300d1590 2024-09-19T05:38:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- 172.21.15.67:0/2981386990 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4930154d30 con 0x7f49300d1590 2024-09-19T05:38:04.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.857+0000 7f4934f17640 1 -- 172.21.15.67:0/2981386990 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4930155110 con 0x7f49300d1590 2024-09-19T05:38:04.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.861+0000 7f491effd640 1 -- 172.21.15.67:0/2981386990 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f492001a070 con 0x7f49300d1590 2024-09-19T05:38:04.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.861+0000 7f491effd640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49100678c0 0x7f4910069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.861+0000 7f491effd640 1 -- 172.21.15.67:0/2981386990 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6504+0+0 (secure 0 0 0) 0x7f49200861a0 con 0x7f49300d1590 2024-09-19T05:38:04.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.861+0000 7f492dd9b640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49100678c0 0x7f4910069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.861+0000 7f492dd9b640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49100678c0 0x7f4910069d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f49300b49c0 tx=0x7f4924009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:04.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:04.865+0000 7f491effd640 1 -- 172.21.15.67:0/2981386990 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4930155110 con 0x7f49300d1590 2024-09-19T05:38:05.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.065+0000 7f4934f17640 1 -- 172.21.15.67:0/2981386990 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f493006bde0 con 0x7f49300d1590 2024-09-19T05:38:05.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.713+0000 7f491effd640 1 -- 172.21.15.67:0/2981386990 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7f4920056a50 con 0x7f49300d1590 2024-09-19T05:38:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 -- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49100678c0 msgr2=0x7f4910069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49100678c0 0x7f4910069d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f49300b49c0 tx=0x7f4924009040 comp rx=0 tx=0).stop 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 -- 172.21.15.67:0/2981386990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49300d1590 msgr2=0x7f49301f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49300d1590 0x7f49301f7ab0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f492000e930 tx=0x7f492000edf0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 -- 172.21.15.67:0/2981386990 shutdown_connections 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f493015e690 0x7f4930156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49100678c0 0x7f4910069d80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49300d4fb0 0x7f49301560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 --2- 172.21.15.67:0/2981386990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49300d1590 0x7f49301f7ab0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 -- 172.21.15.67:0/2981386990 >> 172.21.15.67:0/2981386990 conn(0x7f49300d4490 msgr2=0x7f49300d4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 -- 172.21.15.67:0/2981386990 shutdown_connections 2024-09-19T05:38:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.717+0000 7f4934f17640 1 -- 172.21.15.67:0/2981386990 wait complete. 2024-09-19T05:38:05.743 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:38:05.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95fd80e640 1 Processor -- start 2024-09-19T05:38:05.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95fd80e640 1 -- start start 2024-09-19T05:38:05.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95fd80e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f80d0aa0 0x7f95f806e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95fd80e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95f815d030 con 0x7f95f80cf5e0 2024-09-19T05:38:05.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95fd80e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95f815d310 con 0x7f95f806eb40 2024-09-19T05:38:05.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95fd80e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f95f80d0f00 con 0x7f95f80d0aa0 2024-09-19T05:38:05.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f6ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f95f80cf5e0 0x7f95f815c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:54048/0 (socket says 172.21.15.67:54048) 2024-09-19T05:38:05.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f6ffd640 1 -- 172.21.15.67:0/3502171804 learned_addr learned my addr 172.21.15.67:0/3502171804 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:05.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f67fc640 1 --2- 172.21.15.67:0/3502171804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f80d0aa0 0x7f95f806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f5ffb640 1 -- 172.21.15.67:0/3502171804 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3901072508 0 0) 0x7f95f815d030 con 0x7f95f80cf5e0 2024-09-19T05:38:05.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f5ffb640 1 -- 172.21.15.67:0/3502171804 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95e0003530 con 0x7f95f80cf5e0 2024-09-19T05:38:05.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f5ffb640 1 -- 172.21.15.67:0/3502171804 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 651216446 0 0) 0x7f95f815d310 con 0x7f95f806eb40 2024-09-19T05:38:05.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f5ffb640 1 -- 172.21.15.67:0/3502171804 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95f815d030 con 0x7f95f806eb40 2024-09-19T05:38:05.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f67fc640 1 -- 172.21.15.67:0/3502171804 >> v1:172.21.15.97:6789/0 conn(0x7f95f806eb40 legacy=0x7f95f815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f5ffb640 1 -- 172.21.15.67:0/3502171804 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 516871271 0 0) 0x7f95e0003530 con 0x7f95f80cf5e0 2024-09-19T05:38:05.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f67fc640 1 -- 172.21.15.67:0/3502171804 >> v1:172.21.15.67:6789/0 conn(0x7f95f80cf5e0 legacy=0x7f95f815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.877+0000 7f95f67fc640 1 -- 172.21.15.67:0/3502171804 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f815d5f0 con 0x7f95f80d0aa0 2024-09-19T05:38:05.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95f67fc640 1 --2- 172.21.15.67:0/3502171804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f80d0aa0 0x7f95f806e600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0097f0 tx=0x7f95ec01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbd83b3cf2d42481 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:05.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95f5ffb640 1 -- 172.21.15.67:0/3502171804 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec0b0070 con 0x7f95f80d0aa0 2024-09-19T05:38:05.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95f5ffb640 1 -- 172.21.15.67:0/3502171804 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ec0ab400 con 0x7f95f80d0aa0 2024-09-19T05:38:05.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95f5ffb640 1 -- 172.21.15.67:0/3502171804 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8001680 con 0x7f95f80d0aa0 2024-09-19T05:38:05.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95fd80e640 1 -- 172.21.15.67:0/3502171804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f80d0aa0 msgr2=0x7f95f806e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95fd80e640 1 --2- 172.21.15.67:0/3502171804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f80d0aa0 0x7f95f806e600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0097f0 tx=0x7f95ec01c400 comp rx=0 tx=0).stop 2024-09-19T05:38:05.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95fd80e640 1 -- 172.21.15.67:0/3502171804 shutdown_connections 2024-09-19T05:38:05.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95fd80e640 1 --2- 172.21.15.67:0/3502171804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f80d0aa0 0x7f95f806e600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95fd80e640 1 -- 172.21.15.67:0/3502171804 >> 172.21.15.67:0/3502171804 conn(0x7f95f806c0c0 msgr2=0x7f95f806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:05.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95fd80e640 1 -- 172.21.15.67:0/3502171804 shutdown_connections 2024-09-19T05:38:05.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95fd80e640 1 -- 172.21.15.67:0/3502171804 wait complete. 2024-09-19T05:38:05.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95fd80e640 1 Processor -- start 2024-09-19T05:38:05.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.881+0000 7f95fd80e640 1 -- start start 2024-09-19T05:38:05.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95fd80e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f806eb40 0x7f95f8158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95fd80e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95f80cf5e0 0x7f95f814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95fd80e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f80d0aa0 0x7f95f81549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95fd80e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f95f816a1d0 con 0x7f95f80d0aa0 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95fd80e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f95f806e170 con 0x7f95f80cf5e0 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95fd80e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f95f816a350 con 0x7f95f806eb40 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f80d0aa0 0x7f95f81549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f80d0aa0 0x7f95f81549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44202/0 (socket says 172.21.15.67:44202) 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f77fe640 1 -- 172.21.15.67:0/593815508 learned_addr learned my addr 172.21.15.67:0/593815508 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f67fc640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95f80cf5e0 0x7f95f814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f6ffd640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f806eb40 0x7f95f8158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f77fe640 1 -- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f806eb40 msgr2=0x7f95f8158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f77fe640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f806eb40 0x7f95f8158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f77fe640 1 -- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95f80cf5e0 msgr2=0x7f95f814f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f77fe640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95f80cf5e0 0x7f95f814f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f77fe640 1 -- 172.21.15.67:0/593815508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f8159950 con 0x7f95f80d0aa0 2024-09-19T05:38:05.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f6ffd640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f806eb40 0x7f95f8158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:05.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f77fe640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f80d0aa0 0x7f95f81549f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c790 tx=0x7f95f000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:05.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95dffff640 1 -- 172.21.15.67:0/593815508 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0003b80 con 0x7f95f80d0aa0 2024-09-19T05:38:05.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95dffff640 1 -- 172.21.15.67:0/593815508 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f0003d20 con 0x7f95f80d0aa0 2024-09-19T05:38:05.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95fd80e640 1 -- 172.21.15.67:0/593815508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f8159c30 con 0x7f95f80d0aa0 2024-09-19T05:38:05.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95dffff640 1 -- 172.21.15.67:0/593815508 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f000aa50 con 0x7f95f80d0aa0 2024-09-19T05:38:05.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95fd80e640 1 -- 172.21.15.67:0/593815508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f8073720 con 0x7f95f80d0aa0 2024-09-19T05:38:05.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95fd80e640 1 -- 172.21.15.67:0/593815508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f806e600 con 0x7f95f80d0aa0 2024-09-19T05:38:05.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95dffff640 1 -- 172.21.15.67:0/593815508 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f95f000abf0 con 0x7f95f80d0aa0 2024-09-19T05:38:05.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95dffff640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95e40678f0 0x7f95e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95dffff640 1 -- 172.21.15.67:0/593815508 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6504+0+0 (secure 0 0 0) 0x7f95f0085f40 con 0x7f95f80d0aa0 2024-09-19T05:38:05.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.885+0000 7f95f6ffd640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95e40678f0 0x7f95e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.889+0000 7f95f6ffd640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95e40678f0 0x7f95e4069db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f95e80010f0 tx=0x7f95e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:05.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:05.893+0000 7f95dffff640 1 -- 172.21.15.67:0/593815508 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f95f0056770 con 0x7f95f80d0aa0 2024-09-19T05:38:06.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:06.057+0000 7f95fd80e640 1 -- 172.21.15.67:0/593815508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f95f8167d90 con 0x7f95f80d0aa0 2024-09-19T05:38:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.041+0000 7f95dffff640 1 -- 172.21.15.67:0/593815508 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) ==== 181+0+0 (secure 0 0 0) 0x7f95f0056070 con 0x7f95f80d0aa0 2024-09-19T05:38:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:38:07.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.045+0000 7f95fd80e640 1 -- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95e40678f0 msgr2=0x7f95e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.045+0000 7f95fd80e640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95e40678f0 0x7f95e4069db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f95e80010f0 tx=0x7f95e8009040 comp rx=0 tx=0).stop 2024-09-19T05:38:07.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.045+0000 7f95fd80e640 1 -- 172.21.15.67:0/593815508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f80d0aa0 msgr2=0x7f95f81549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.045+0000 7f95fd80e640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f80d0aa0 0x7f95f81549f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c790 tx=0x7f95f000cc50 comp rx=0 tx=0).stop 2024-09-19T05:38:07.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.045+0000 7f95fd80e640 1 -- 172.21.15.67:0/593815508 shutdown_connections 2024-09-19T05:38:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.045+0000 7f95fd80e640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f80d0aa0 0x7f95f81549f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.045+0000 7f95fd80e640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95f80cf5e0 0x7f95f814f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.045+0000 7f95fd80e640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f95e40678f0 0x7f95e4069db0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.045+0000 7f95fd80e640 1 --2- 172.21.15.67:0/593815508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95f806eb40 0x7f95f8158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.045+0000 7f95fd80e640 1 -- 172.21.15.67:0/593815508 >> 172.21.15.67:0/593815508 conn(0x7f95f806c0c0 msgr2=0x7f95f8160400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.049+0000 7f95fd80e640 1 -- 172.21.15.67:0/593815508 shutdown_connections 2024-09-19T05:38:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.049+0000 7f95fd80e640 1 -- 172.21.15.67:0/593815508 wait complete. 2024-09-19T05:38:07.072 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:38:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e81ad640 1 Processor -- start 2024-09-19T05:38:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e81ad640 1 -- start start 2024-09-19T05:38:07.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e81ad640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1e00d0520 0x7fb1e00d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:07.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e81ad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00addf0 0x7fb1e00ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:07.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e81ad640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e00b4e00 con 0x7fb1e00738b0 2024-09-19T05:38:07.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e81ad640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e00d0ed0 con 0x7fb1e00d0520 2024-09-19T05:38:07.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e81ad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e00b3500 con 0x7fb1e00addf0 2024-09-19T05:38:07.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e674a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00addf0 0x7fb1e00ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e5748640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1e00d0520 0x7fb1e00d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e5f49640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb1e00738b0 0x7fb1e015c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:50692/0 (socket says 172.21.15.67:50692) 2024-09-19T05:38:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e674a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00addf0 0x7fb1e00ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:54358/0 (socket says 172.21.15.67:54358) 2024-09-19T05:38:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e5748640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1e00d0520 0x7fb1e00d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:45090/0 (socket says 172.21.15.67:45090) 2024-09-19T05:38:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e5f49640 1 -- 172.21.15.67:0/2066411753 learned_addr learned my addr 172.21.15.67:0/2066411753 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e674a640 1 -- 172.21.15.67:0/2066411753 >> v2:172.21.15.97:3300/0 conn(0x7fb1e00d0520 msgr2=0x7fb1e00d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e674a640 1 --2- 172.21.15.67:0/2066411753 >> v2:172.21.15.97:3300/0 conn(0x7fb1e00d0520 0x7fb1e00d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e674a640 1 -- 172.21.15.67:0/2066411753 >> v1:172.21.15.97:6789/0 conn(0x7fb1e00738b0 legacy=0x7fb1e015c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e674a640 1 -- 172.21.15.67:0/2066411753 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e00b37e0 con 0x7fb1e00addf0 2024-09-19T05:38:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.201+0000 7fb1e5748640 1 --2- 172.21.15.67:0/2066411753 >> v2:172.21.15.97:3300/0 conn(0x7fb1e00d0520 0x7fb1e00d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e674a640 1 --2- 172.21.15.67:0/2066411753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00addf0 0x7fb1e00ae220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009d90 tx=0x7fb1d801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7ac7a5a9a7b1b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e4f47640 1 -- 172.21.15.67:0/2066411753 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80b2070 con 0x7fb1e00addf0 2024-09-19T05:38:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e4f47640 1 -- 172.21.15.67:0/2066411753 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d80a5830 con 0x7fb1e00addf0 2024-09-19T05:38:07.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e4f47640 1 -- 172.21.15.67:0/2066411753 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80a5c00 con 0x7fb1e00addf0 2024-09-19T05:38:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e81ad640 1 -- 172.21.15.67:0/2066411753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00addf0 msgr2=0x7fb1e00ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e81ad640 1 --2- 172.21.15.67:0/2066411753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00addf0 0x7fb1e00ae220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009d90 tx=0x7fb1d801c970 comp rx=0 tx=0).stop 2024-09-19T05:38:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e81ad640 1 -- 172.21.15.67:0/2066411753 shutdown_connections 2024-09-19T05:38:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e81ad640 1 --2- 172.21.15.67:0/2066411753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00addf0 0x7fb1e00ae220 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e81ad640 1 --2- 172.21.15.67:0/2066411753 >> v2:172.21.15.97:3300/0 conn(0x7fb1e00d0520 0x7fb1e00d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e81ad640 1 -- 172.21.15.67:0/2066411753 >> 172.21.15.67:0/2066411753 conn(0x7fb1e006c0c0 msgr2=0x7fb1e006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e81ad640 1 -- 172.21.15.67:0/2066411753 shutdown_connections 2024-09-19T05:38:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.205+0000 7fb1e81ad640 1 -- 172.21.15.67:0/2066411753 wait complete. 2024-09-19T05:38:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 Processor -- start 2024-09-19T05:38:07.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 -- start start 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1e00738b0 0x7fb1e00cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00addf0 0x7fb1e0150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00d0520 0x7fb1e0157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00b30b0 con 0x7fb1e00addf0 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e0073c90 con 0x7fb1e00738b0 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e00b3230 con 0x7fb1e00d0520 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e5748640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00addf0 0x7fb1e0150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e5748640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00addf0 0x7fb1e0150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44218/0 (socket says 172.21.15.67:44218) 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e5748640 1 -- 172.21.15.67:0/217990802 learned_addr learned my addr 172.21.15.67:0/217990802 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e674a640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00d0520 0x7fb1e0157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:07.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e5f49640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1e00738b0 0x7fb1e00cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e5748640 1 -- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00d0520 msgr2=0x7fb1e0157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e5748640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00d0520 0x7fb1e0157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e5748640 1 -- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1e00738b0 msgr2=0x7fb1e00cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e5748640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1e00738b0 0x7fb1e00cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e5748640 1 -- 172.21.15.67:0/217990802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e01f90c0 con 0x7fb1e00addf0 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e5748640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00addf0 0x7fb1e0150740 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00e9b0 tx=0x7fb1dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1d67fc640 1 -- 172.21.15.67:0/217990802 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc017070 con 0x7fb1e00addf0 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1d67fc640 1 -- 172.21.15.67:0/217990802 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc00ca00 con 0x7fb1e00addf0 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 -- 172.21.15.67:0/217990802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e01f93a0 con 0x7fb1e00addf0 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1d67fc640 1 -- 172.21.15.67:0/217990802 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00cdd0 con 0x7fb1e00addf0 2024-09-19T05:38:07.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 -- 172.21.15.67:0/217990802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e01f9960 con 0x7fb1e00addf0 2024-09-19T05:38:07.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.209+0000 7fb1e81ad640 1 -- 172.21.15.67:0/217990802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e00ae220 con 0x7fb1e00addf0 2024-09-19T05:38:07.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.213+0000 7fb1d67fc640 1 -- 172.21.15.67:0/217990802 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1dc01a070 con 0x7fb1e00addf0 2024-09-19T05:38:07.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.213+0000 7fb1d67fc640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1c40678c0 0x7fb1c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:07.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.213+0000 7fb1d67fc640 1 -- 172.21.15.67:0/217990802 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6037+0+0 (secure 0 0 0) 0x7fb1dc085fd0 con 0x7fb1e00addf0 2024-09-19T05:38:07.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.213+0000 7fb1e5f49640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1c40678c0 0x7fb1c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:07.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.213+0000 7fb1e5f49640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1c40678c0 0x7fb1c4069d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0000f70 tx=0x7fb1d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:07.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.217+0000 7fb1d67fc640 1 -- 172.21.15.67:0/217990802 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb1dc056360 con 0x7fb1e00addf0 2024-09-19T05:38:07.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:07.377+0000 7fb1e81ad640 1 -- 172.21.15.67:0/217990802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb1e009e400 con 0x7fb1e00addf0 2024-09-19T05:38:08.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.052+0000 7fb1d67fc640 1 -- 172.21.15.67:0/217990802 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) ==== 169+0+0 (secure 0 0 0) 0x7fb1dc05a660 con 0x7fb1e00addf0 2024-09-19T05:38:08.055 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:38:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 -- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1c40678c0 msgr2=0x7fb1c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1c40678c0 0x7fb1c4069d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0000f70 tx=0x7fb1d0009040 comp rx=0 tx=0).stop 2024-09-19T05:38:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 -- 172.21.15.67:0/217990802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00addf0 msgr2=0x7fb1e0150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00addf0 0x7fb1e0150740 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00e9b0 tx=0x7fb1dc00ee70 comp rx=0 tx=0).stop 2024-09-19T05:38:08.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 -- 172.21.15.67:0/217990802 shutdown_connections 2024-09-19T05:38:08.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1c40678c0 0x7fb1c4069d80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1e00d0520 0x7fb1e0157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00addf0 0x7fb1e0150740 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 --2- 172.21.15.67:0/217990802 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1e00738b0 0x7fb1e00cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 -- 172.21.15.67:0/217990802 >> 172.21.15.67:0/217990802 conn(0x7fb1e006c0c0 msgr2=0x7fb1e015df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.056+0000 7fb1e81ad640 1 -- 172.21.15.67:0/217990802 shutdown_connections 2024-09-19T05:38:08.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.060+0000 7fb1e81ad640 1 -- 172.21.15.67:0/217990802 wait complete. 2024-09-19T05:38:08.087 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-09-19T05:38:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.204+0000 7f2823880640 1 Processor -- start 2024-09-19T05:38:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.204+0000 7f2823880640 1 -- start start 2024-09-19T05:38:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f2823880640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f281c15e660 0x7f281c0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f2823880640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0b3a60 0x7f281c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f2823880640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f281c071110 con 0x7f281c0aef50 2024-09-19T05:38:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f2823880640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f281c15ea40 con 0x7f281c15e660 2024-09-19T05:38:08.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f2823880640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f281c070610 con 0x7f281c0b3a60 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f2820e1b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0b3a60 0x7f281c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f282161c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f281c15e660 0x7f281c0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f2820e1b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0b3a60 0x7f281c0aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:54370/0 (socket says 172.21.15.67:54370) 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f2820e1b640 1 -- 172.21.15.67:0/2997157377 learned_addr learned my addr 172.21.15.67:0/2997157377 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f2821e1d640 1 --1- 172.21.15.67:0/2997157377 >> v1:172.21.15.97:6789/0 conn(0x7f281c0aef50 0x7f281c06f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:50700/0 (socket says 172.21.15.67:50700) 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f282161c640 1 -- 172.21.15.67:0/2997157377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0b3a60 msgr2=0x7f281c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f282161c640 1 --2- 172.21.15.67:0/2997157377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0b3a60 0x7f281c0aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f282161c640 1 -- 172.21.15.67:0/2997157377 >> v1:172.21.15.97:6789/0 conn(0x7f281c0aef50 legacy=0x7f281c06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f282161c640 1 -- 172.21.15.67:0/2997157377 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281c0b4240 con 0x7f281c15e660 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f2820e1b640 1 --2- 172.21.15.67:0/2997157377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0b3a60 0x7f281c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:08.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.208+0000 7f282161c640 1 --2- 172.21.15.67:0/2997157377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f281c15e660 0x7f281c0b0910 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f28100097c0 tx=0x7f281001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1d61eb4799e0148 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f280ffff640 1 -- 172.21.15.67:0/2997157377 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28100b0070 con 0x7f281c15e660 2024-09-19T05:38:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f280ffff640 1 -- 172.21.15.67:0/2997157377 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28100ab600 con 0x7f281c15e660 2024-09-19T05:38:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f280ffff640 1 -- 172.21.15.67:0/2997157377 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28100ab9d0 con 0x7f281c15e660 2024-09-19T05:38:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 -- 172.21.15.67:0/2997157377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f281c15e660 msgr2=0x7f281c0b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 --2- 172.21.15.67:0/2997157377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f281c15e660 0x7f281c0b0910 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f28100097c0 tx=0x7f281001c410 comp rx=0 tx=0).stop 2024-09-19T05:38:08.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 -- 172.21.15.67:0/2997157377 shutdown_connections 2024-09-19T05:38:08.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 --2- 172.21.15.67:0/2997157377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0b3a60 0x7f281c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 --2- 172.21.15.67:0/2997157377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f281c15e660 0x7f281c0b0910 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 -- 172.21.15.67:0/2997157377 >> 172.21.15.67:0/2997157377 conn(0x7f281c0b2f40 msgr2=0x7f281c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 -- 172.21.15.67:0/2997157377 shutdown_connections 2024-09-19T05:38:08.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 -- 172.21.15.67:0/2997157377 wait complete. 2024-09-19T05:38:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 Processor -- start 2024-09-19T05:38:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 -- start start 2024-09-19T05:38:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0aef50 0x7f281c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f281c0b3a60 0x7f281c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f281c15e660 0x7f281c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f281c16b2a0 con 0x7f281c0b3a60 2024-09-19T05:38:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f281c16b120 con 0x7f281c15e660 2024-09-19T05:38:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2823880640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f281c16b420 con 0x7f281c0aef50 2024-09-19T05:38:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2820e1b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f281c0b3a60 0x7f281c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2820e1b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f281c0b3a60 0x7f281c15adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44232/0 (socket says 172.21.15.67:44232) 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2820e1b640 1 -- 172.21.15.67:0/13088972 learned_addr learned my addr 172.21.15.67:0/13088972 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2821e1d640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f281c15e660 0x7f281c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f282161c640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0aef50 0x7f281c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2820e1b640 1 -- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0aef50 msgr2=0x7f281c1530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2820e1b640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0aef50 0x7f281c1530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2820e1b640 1 -- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f281c15e660 msgr2=0x7f281c15ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2820e1b640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f281c15e660 0x7f281c15ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.212+0000 7f2820e1b640 1 -- 172.21.15.67:0/13088972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281c1538f0 con 0x7f281c0b3a60 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f2820e1b640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f281c0b3a60 0x7f281c15adb0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f281800e9b0 tx=0x7f281800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f280dffb640 1 -- 172.21.15.67:0/13088972 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818017070 con 0x7f281c0b3a60 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f280dffb640 1 -- 172.21.15.67:0/13088972 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281800c9a0 con 0x7f281c0b3a60 2024-09-19T05:38:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f2823880640 1 -- 172.21.15.67:0/13088972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f281c15b640 con 0x7f281c0b3a60 2024-09-19T05:38:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f280dffb640 1 -- 172.21.15.67:0/13088972 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281800cd90 con 0x7f281c0b3a60 2024-09-19T05:38:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f2823880640 1 -- 172.21.15.67:0/13088972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f281c153b90 con 0x7f281c0b3a60 2024-09-19T05:38:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f2823880640 1 -- 172.21.15.67:0/13088972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f281c0aea10 con 0x7f281c0b3a60 2024-09-19T05:38:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f280dffb640 1 -- 172.21.15.67:0/13088972 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f281801a070 con 0x7f281c0b3a60 2024-09-19T05:38:08.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f280dffb640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28000678f0 0x7f2800069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f280dffb640 1 -- 172.21.15.67:0/13088972 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7f2818085ce0 con 0x7f281c0b3a60 2024-09-19T05:38:08.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f282161c640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28000678f0 0x7f2800069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.216+0000 7f282161c640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28000678f0 0x7f2800069db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f28100ad000 tx=0x7f28100a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.220+0000 7f280dffb640 1 -- 172.21.15.67:0/13088972 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f28180562a0 con 0x7f281c0b3a60 2024-09-19T05:38:08.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.380+0000 7f2823880640 1 -- 172.21.15.67:0/13088972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7f281c0b33c0 con 0x7f281c0b3a60 2024-09-19T05:38:08.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.384+0000 7f280dffb640 1 -- 172.21.15.67:0/13088972 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v20) ==== 101+0+0 (secure 0 0 0) 0x7f281805a5a0 con 0x7f281c0b3a60 2024-09-19T05:38:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 -- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28000678f0 msgr2=0x7f2800069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28000678f0 0x7f2800069db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f28100ad000 tx=0x7f28100a6000 comp rx=0 tx=0).stop 2024-09-19T05:38:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 -- 172.21.15.67:0/13088972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f281c0b3a60 msgr2=0x7f281c15adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f281c0b3a60 0x7f281c15adb0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f281800e9b0 tx=0x7f281800ee70 comp rx=0 tx=0).stop 2024-09-19T05:38:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 -- 172.21.15.67:0/13088972 shutdown_connections 2024-09-19T05:38:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f281c15e660 0x7f281c15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f281c0b3a60 0x7f281c15adb0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28000678f0 0x7f2800069db0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 --2- 172.21.15.67:0/13088972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f281c0aef50 0x7f281c1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 -- 172.21.15.67:0/13088972 >> 172.21.15.67:0/13088972 conn(0x7f281c0b2f40 msgr2=0x7f281c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 -- 172.21.15.67:0/13088972 shutdown_connections 2024-09-19T05:38:08.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.388+0000 7f2823880640 1 -- 172.21.15.67:0/13088972 wait complete. 2024-09-19T05:38:08.407 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-19T05:38:08.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.528+0000 7fd5bcd88640 1 Processor -- start 2024-09-19T05:38:08.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.528+0000 7fd5bcd88640 1 -- start start 2024-09-19T05:38:08.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.528+0000 7fd5bcd88640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5b8159c60 0x7fd5b80ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.528+0000 7fd5bcd88640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b806ffd0 0x7fd5b80aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.528+0000 7fd5bcd88640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b815a040 con 0x7fd5b80b3150 2024-09-19T05:38:08.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.528+0000 7fd5bcd88640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b815d460 con 0x7fd5b8159c60 2024-09-19T05:38:08.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.528+0000 7fd5bcd88640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b815c850 con 0x7fd5b806ffd0 2024-09-19T05:38:08.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.528+0000 7fd5b6d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd5b80b3150 0x7fd5b815fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36742/0 (socket says 172.21.15.67:36742) 2024-09-19T05:38:08.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.528+0000 7fd5b6d9d640 1 -- 172.21.15.67:0/974993335 learned_addr learned my addr 172.21.15.67:0/974993335 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b659c640 1 --2- 172.21.15.67:0/974993335 >> v2:172.21.15.97:3300/0 conn(0x7fd5b8159c60 0x7fd5b80ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b5d9b640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b806ffd0 0x7fd5b80aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068862262 0 0) 0x7fd5b815a040 con 0x7fd5b80b3150 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd598003530 con 0x7fd5b80b3150 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2145063410 0 0) 0x7fd598003530 con 0x7fd5b80b3150 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b806ffd0 msgr2=0x7fd5b80aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b806ffd0 0x7fd5b80aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 >> v2:172.21.15.97:3300/0 conn(0x7fd5b8159c60 msgr2=0x7fd5b80ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 --2- 172.21.15.67:0/974993335 >> v2:172.21.15.97:3300/0 conn(0x7fd5b8159c60 0x7fd5b80ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b815cb30 con 0x7fd5b80b3150 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fd5a8001680 con 0x7fd5b80b3150 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 >> v1:172.21.15.67:6789/0 conn(0x7fd5b80b3150 legacy=0x7fd5b815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5980039c0 0x7fd598003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b806ffd0 0x7fd598004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd598004d50 0x7fd5980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b815d460 con 0x7fd598004d50 2024-09-19T05:38:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b815c850 con 0x7fd5980039c0 2024-09-19T05:38:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd59800b9d0 con 0x7fd5b806ffd0 2024-09-19T05:38:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b6d9d640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd598004d50 0x7fd5980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b659c640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5980039c0 0x7fd598003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b5d9b640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b806ffd0 0x7fd598004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b6d9d640 1 -- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b806ffd0 msgr2=0x7fd598004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b6d9d640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b806ffd0 0x7fd598004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b6d9d640 1 -- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5980039c0 msgr2=0x7fd598003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b6d9d640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5980039c0 0x7fd598003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b6d9d640 1 -- 172.21.15.67:0/974993335 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd598003530 con 0x7fd598004d50 2024-09-19T05:38:08.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b6d9d640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd598004d50 0x7fd5980051d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800c2f0 tx=0x7fd5a801cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0ca92502393d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8007d60 con 0x7fd598004d50 2024-09-19T05:38:08.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a80a9020 con 0x7fd598004d50 2024-09-19T05:38:08.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b559a640 1 -- 172.21.15.67:0/974993335 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80a5bb0 con 0x7fd598004d50 2024-09-19T05:38:08.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5bcd88640 1 -- 172.21.15.67:0/974993335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd598004d50 msgr2=0x7fd5980051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5bcd88640 1 --2- 172.21.15.67:0/974993335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd598004d50 0x7fd5980051d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800c2f0 tx=0x7fd5a801cd40 comp rx=0 tx=0).stop 2024-09-19T05:38:08.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5b6d9d640 1 -- 172.21.15.67:0/974993335 reap_dead start 2024-09-19T05:38:08.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5bcd88640 1 -- 172.21.15.67:0/974993335 shutdown_connections 2024-09-19T05:38:08.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.532+0000 7fd5bcd88640 1 -- 172.21.15.67:0/974993335 >> 172.21.15.67:0/974993335 conn(0x7fd5b80b1e50 msgr2=0x7fd5b80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 -- 172.21.15.67:0/974993335 shutdown_connections 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 -- 172.21.15.67:0/974993335 wait complete. 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 Processor -- start 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 -- start start 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd598004d50 0x7fd5b8156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b8152d50 0x7fd5b8099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b8157e80 0x7fd5b8158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b80ad670 con 0x7fd5b8157e80 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b815d0f0 con 0x7fd5b8152d50 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b80ad7f0 con 0x7fd598004d50 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b8157e80 0x7fd5b8158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b8157e80 0x7fd5b8158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44244/0 (socket says 172.21.15.67:44244) 2024-09-19T05:38:08.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b6d9d640 1 -- 172.21.15.67:0/3699659118 learned_addr learned my addr 172.21.15.67:0/3699659118 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b5d9b640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b8152d50 0x7fd5b8099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b659c640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd598004d50 0x7fd5b8156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b6d9d640 1 -- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd598004d50 msgr2=0x7fd5b8156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b6d9d640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd598004d50 0x7fd5b8156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b6d9d640 1 -- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b8152d50 msgr2=0x7fd5b8099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b6d9d640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b8152d50 0x7fd5b8099900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b6d9d640 1 -- 172.21.15.67:0/3699659118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b8157440 con 0x7fd5b8157e80 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b5d9b640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b8152d50 0x7fd5b8099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5b6d9d640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b8157e80 0x7fd5b8158300 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80ab040 tx=0x7fd598005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5aeffd640 1 -- 172.21.15.67:0/3699659118 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8007d60 con 0x7fd5b8157e80 2024-09-19T05:38:08.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5aeffd640 1 -- 172.21.15.67:0/3699659118 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a80047f0 con 0x7fd5b8157e80 2024-09-19T05:38:08.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 -- 172.21.15.67:0/3699659118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b8153310 con 0x7fd5b8157e80 2024-09-19T05:38:08.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5aeffd640 1 -- 172.21.15.67:0/3699659118 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8001c90 con 0x7fd5b8157e80 2024-09-19T05:38:08.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 -- 172.21.15.67:0/3699659118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b81538d0 con 0x7fd5b8157e80 2024-09-19T05:38:08.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.536+0000 7fd5bcd88640 1 -- 172.21.15.67:0/3699659118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b80ad130 con 0x7fd5b8157e80 2024-09-19T05:38:08.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.540+0000 7fd5aeffd640 1 -- 172.21.15.67:0/3699659118 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5a8004bc0 con 0x7fd5b8157e80 2024-09-19T05:38:08.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.540+0000 7fd5aeffd640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd59c0678c0 0x7fd59c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.540+0000 7fd5aeffd640 1 -- 172.21.15.67:0/3699659118 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7fd5a811f7a0 con 0x7fd5b8157e80 2024-09-19T05:38:08.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.540+0000 7fd5b659c640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd59c0678c0 0x7fd59c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.540+0000 7fd5b659c640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd59c0678c0 0x7fd59c069d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009fd0 tx=0x7fd5b000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.544+0000 7fd5aeffd640 1 -- 172.21.15.67:0/3699659118 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd5a8016a50 con 0x7fd5b8157e80 2024-09-19T05:38:08.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.704+0000 7fd5bcd88640 1 -- 172.21.15.67:0/3699659118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7fd5b80b3b90 con 0x7fd5b8157e80 2024-09-19T05:38:08.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.708+0000 7fd5aeffd640 1 -- 172.21.15.67:0/3699659118 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v21) ==== 101+0+0 (secure 0 0 0) 0x7fd5a811f030 con 0x7fd5b8157e80 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 -- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd59c0678c0 msgr2=0x7fd59c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd59c0678c0 0x7fd59c069d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009fd0 tx=0x7fd5b000b040 comp rx=0 tx=0).stop 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 -- 172.21.15.67:0/3699659118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b8157e80 msgr2=0x7fd5b8158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b8157e80 0x7fd5b8158300 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80ab040 tx=0x7fd598005840 comp rx=0 tx=0).stop 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 -- 172.21.15.67:0/3699659118 shutdown_connections 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b8157e80 0x7fd5b8158300 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b8152d50 0x7fd5b8099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd59c0678c0 0x7fd59c069d80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 --2- 172.21.15.67:0/3699659118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd598004d50 0x7fd5b8156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 -- 172.21.15.67:0/3699659118 >> 172.21.15.67:0/3699659118 conn(0x7fd5b80b1e50 msgr2=0x7fd5b80b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 -- 172.21.15.67:0/3699659118 shutdown_connections 2024-09-19T05:38:08.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.712+0000 7fd5bcd88640 1 -- 172.21.15.67:0/3699659118 wait complete. 2024-09-19T05:38:08.731 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:38:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.844+0000 7f8c6178b640 1 Processor -- start 2024-09-19T05:38:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.844+0000 7f8c6178b640 1 -- start start 2024-09-19T05:38:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c6178b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c159c60 0x7f8c5c0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c6178b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8c5c06ffd0 0x7f8c5c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c6178b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c5c15a040 con 0x7f8c5c0b3150 2024-09-19T05:38:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c6178b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8c5c15d460 con 0x7f8c5c06ffd0 2024-09-19T05:38:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c6178b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5c15c850 con 0x7f8c5c159c60 2024-09-19T05:38:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5b7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8c5c0b3150 0x7f8c5c15fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36748/0 (socket says 172.21.15.67:36748) 2024-09-19T05:38:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5b7fe640 1 -- 172.21.15.67:0/1586670036 learned_addr learned my addr 172.21.15.67:0/1586670036 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5a7fc640 1 --2- 172.21.15.67:0/1586670036 >> v2:172.21.15.97:3300/0 conn(0x7f8c5c06ffd0 0x7f8c5c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5affd640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c159c60 0x7f8c5c0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3351776998 0 0) 0x7f8c5c15a040 con 0x7f8c5c0b3150 2024-09-19T05:38:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c44003530 con 0x7f8c5c0b3150 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4167697530 0 0) 0x7f8c44003530 con 0x7f8c5c0b3150 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c159c60 msgr2=0x7f8c5c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c159c60 0x7f8c5c0ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 >> v2:172.21.15.97:3300/0 conn(0x7f8c5c06ffd0 msgr2=0x7f8c5c0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 --2- 172.21.15.67:0/1586670036 >> v2:172.21.15.97:3300/0 conn(0x7f8c5c06ffd0 0x7f8c5c0aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c15cb30 con 0x7f8c5c0b3150 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f8c54001a00 con 0x7f8c5c0b3150 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 >> v1:172.21.15.67:6789/0 conn(0x7f8c5c0b3150 legacy=0x7f8c5c15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c440039c0 0x7f8c44003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c159c60 0x7f8c44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c44004d50 0x7f8c440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c15d460 con 0x7f8c44004d50 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c15c850 con 0x7f8c440039c0 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4400b9d0 con 0x7f8c5c159c60 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5b7fe640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c44004d50 0x7f8c440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5a7fc640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c159c60 0x7f8c44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5affd640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c440039c0 0x7f8c44003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5b7fe640 1 -- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c159c60 msgr2=0x7f8c44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5b7fe640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c159c60 0x7f8c44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5b7fe640 1 -- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c440039c0 msgr2=0x7f8c44003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5b7fe640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c440039c0 0x7f8c44003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5b7fe640 1 -- 172.21.15.67:0/1586670036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c44003530 con 0x7f8c44004d50 2024-09-19T05:38:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5affd640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c440039c0 0x7f8c44003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:08.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.848+0000 7f8c5b7fe640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c44004d50 0x7f8c440051d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400a870 tx=0x7f8c5401d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e3c2c9ae8733f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400a4c0 con 0x7f8c44004d50 2024-09-19T05:38:08.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c540072d0 con 0x7f8c44004d50 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c59ffb640 1 -- 172.21.15.67:0/1586670036 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c540076c0 con 0x7f8c44004d50 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- 172.21.15.67:0/1586670036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c44004d50 msgr2=0x7f8c440051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 --2- 172.21.15.67:0/1586670036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c44004d50 0x7f8c440051d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400a870 tx=0x7f8c5401d3a0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5b7fe640 1 -- 172.21.15.67:0/1586670036 reap_dead start 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- 172.21.15.67:0/1586670036 shutdown_connections 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- 172.21.15.67:0/1586670036 >> 172.21.15.67:0/1586670036 conn(0x7f8c5c0b1e50 msgr2=0x7f8c5c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- 172.21.15.67:0/1586670036 shutdown_connections 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- 172.21.15.67:0/1586670036 wait complete. 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 Processor -- start 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- start start 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c5c0cebe0 0x7f8c5c155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c5c0cefc0 0x7f8c5c0726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c14dfb0 0x7f8c5c0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c0af1d0 con 0x7f8c5c0cebe0 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c15d0f0 con 0x7f8c5c0cefc0 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5c0af350 con 0x7f8c5c14dfb0 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c5c0cebe0 0x7f8c5c155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c5c0cebe0 0x7f8c5c155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44270/0 (socket says 172.21.15.67:44270) 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5affd640 1 -- 172.21.15.67:0/457267459 learned_addr learned my addr 172.21.15.67:0/457267459 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5a7fc640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c5c0cefc0 0x7f8c5c0726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5b7fe640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c14dfb0 0x7f8c5c0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5affd640 1 -- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c14dfb0 msgr2=0x7f8c5c0b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5affd640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c14dfb0 0x7f8c5c0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5affd640 1 -- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c5c0cefc0 msgr2=0x7f8c5c0726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5affd640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c5c0cefc0 0x7f8c5c0726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5affd640 1 -- 172.21.15.67:0/457267459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c153f00 con 0x7f8c5c0cebe0 2024-09-19T05:38:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5a7fc640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c5c0cefc0 0x7f8c5c0726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c5affd640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c5c0cebe0 0x7f8c5c155f30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0108c0 tx=0x7f8c4c010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c437fe640 1 -- 172.21.15.67:0/457267459 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c00f040 con 0x7f8c5c0cebe0 2024-09-19T05:38:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c437fe640 1 -- 172.21.15.67:0/457267459 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4c004220 con 0x7f8c5c0cebe0 2024-09-19T05:38:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- 172.21.15.67:0/457267459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c5c1541e0 con 0x7f8c5c0cebe0 2024-09-19T05:38:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c437fe640 1 -- 172.21.15.67:0/457267459 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c00e900 con 0x7f8c5c0cebe0 2024-09-19T05:38:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.852+0000 7f8c6178b640 1 -- 172.21.15.67:0/457267459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c5c14e790 con 0x7f8c5c0cebe0 2024-09-19T05:38:08.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.856+0000 7f8c6178b640 1 -- 172.21.15.67:0/457267459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c5c0aec90 con 0x7f8c5c0cebe0 2024-09-19T05:38:08.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.856+0000 7f8c437fe640 1 -- 172.21.15.67:0/457267459 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c4c00eaa0 con 0x7f8c5c0cebe0 2024-09-19T05:38:08.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.856+0000 7f8c437fe640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8c480678f0 0x7f8c48069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.856+0000 7f8c437fe640 1 -- 172.21.15.67:0/457267459 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7f8c4c085e90 con 0x7f8c5c0cebe0 2024-09-19T05:38:08.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.856+0000 7f8c5a7fc640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8c480678f0 0x7f8c48069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.856+0000 7f8c5a7fc640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8c480678f0 0x7f8c48069db0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c06f800 tx=0x7f8c50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:08.860+0000 7f8c437fe640 1 -- 172.21.15.67:0/457267459 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8c4c018030 con 0x7f8c5c0cebe0 2024-09-19T05:38:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.016+0000 7f8c6178b640 1 -- 172.21.15.67:0/457267459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8c5c06f270 con 0x7f8c5c0cebe0 2024-09-19T05:38:09.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.020+0000 7f8c437fe640 1 -- 172.21.15.67:0/457267459 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7f8c4c056a90 con 0x7f8c5c0cebe0 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 -- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8c480678f0 msgr2=0x7f8c48069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8c480678f0 0x7f8c48069db0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c06f800 tx=0x7f8c50008040 comp rx=0 tx=0).stop 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 -- 172.21.15.67:0/457267459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c5c0cebe0 msgr2=0x7f8c5c155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c5c0cebe0 0x7f8c5c155f30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0108c0 tx=0x7f8c4c010d80 comp rx=0 tx=0).stop 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 -- 172.21.15.67:0/457267459 shutdown_connections 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8c480678f0 0x7f8c48069db0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8c5c14dfb0 0x7f8c5c0b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8c5c0cefc0 0x7f8c5c0726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 --2- 172.21.15.67:0/457267459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c5c0cebe0 0x7f8c5c155f30 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 -- 172.21.15.67:0/457267459 >> 172.21.15.67:0/457267459 conn(0x7f8c5c0b1e50 msgr2=0x7f8c5c15b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 -- 172.21.15.67:0/457267459 shutdown_connections 2024-09-19T05:38:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.024+0000 7f8c6178b640 1 -- 172.21.15.67:0/457267459 wait complete. 2024-09-19T05:38:09.044 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-09-19T05:38:09.100 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:38:09.103 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:38:09.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1257809640 1 Processor -- start 2024-09-19T05:38:09.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1257809640 1 -- start start 2024-09-19T05:38:09.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1257809640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12500ad9e0 0x7f125006f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1257809640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f125006eaa0 con 0x7f1250072970 2024-09-19T05:38:09.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1257809640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f125006ed80 con 0x7f1250072d50 2024-09-19T05:38:09.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1257809640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f125006f3d0 con 0x7f12500ad9e0 2024-09-19T05:38:09.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f12555a5640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1250072970 0x7f125006dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36760/0 (socket says 172.21.15.67:36760) 2024-09-19T05:38:09.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f12555a5640 1 -- 172.21.15.67:0/3551145659 learned_addr learned my addr 172.21.15.67:0/3551145659 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:09.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231705742 0 0) 0x7f125006eaa0 con 0x7f1250072970 2024-09-19T05:38:09.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1255da6640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12500ad9e0 0x7f125006f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1238003530 con 0x7f1250072970 2024-09-19T05:38:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3083085042 0 0) 0x7f1238003530 con 0x7f1250072970 2024-09-19T05:38:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12500ad9e0 msgr2=0x7f125006f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12500ad9e0 0x7f125006f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 >> v1:172.21.15.97:6789/0 conn(0x7f1250072d50 legacy=0x7f12500ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125006f060 con 0x7f1250072970 2024-09-19T05:38:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1240001a00 con 0x7f1250072970 2024-09-19T05:38:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 >> v1:172.21.15.67:6789/0 conn(0x7f1250072970 legacy=0x7f125006dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12380039f0 0x7f1238003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1238004810 0x7f1238004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1238005190 0x7f123800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f125006f3d0 con 0x7f1238005190 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f123800bf10 con 0x7f12380039f0 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f123800e2a0 con 0x7f1238004810 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1255da6640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1238005190 0x7f123800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1254da4640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1238004810 0x7f1238004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f12555a5640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12380039f0 0x7f1238003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1255da6640 1 -- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1238004810 msgr2=0x7f1238004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1255da6640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1238004810 0x7f1238004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1255da6640 1 -- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12380039f0 msgr2=0x7f1238003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1255da6640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12380039f0 0x7f1238003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f1255da6640 1 -- 172.21.15.67:0/3551145659 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1238003530 con 0x7f1238005190 2024-09-19T05:38:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.164+0000 7f12555a5640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12380039f0 0x7f1238003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f1255da6640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1238005190 0x7f123800b9d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1248009b10 tx=0x7f124801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e0b216f618afa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12480b2070 con 0x7f1238005190 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12480a5660 con 0x7f1238005190 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f124ffff640 1 -- 172.21.15.67:0/3551145659 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12480096b0 con 0x7f1238005190 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f1257809640 1 -- 172.21.15.67:0/3551145659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1238005190 msgr2=0x7f123800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f1257809640 1 --2- 172.21.15.67:0/3551145659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1238005190 0x7f123800b9d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1248009b10 tx=0x7f124801ca70 comp rx=0 tx=0).stop 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f1255da6640 1 -- 172.21.15.67:0/3551145659 reap_dead start 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f1257809640 1 -- 172.21.15.67:0/3551145659 shutdown_connections 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f1257809640 1 -- 172.21.15.67:0/3551145659 >> 172.21.15.67:0/3551145659 conn(0x7f12500b1e50 msgr2=0x7f12500b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f1257809640 1 -- 172.21.15.67:0/3551145659 shutdown_connections 2024-09-19T05:38:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f1257809640 1 -- 172.21.15.67:0/3551145659 wait complete. 2024-09-19T05:38:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f1257809640 1 Processor -- start 2024-09-19T05:38:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.168+0000 7f1257809640 1 -- start start 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1257809640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1238005190 0x7f1250155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1257809640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12501e7590 0x7f1250158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1257809640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1250159460 0x7f1250159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1257809640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12500b3490 con 0x7f12501e7590 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1257809640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f12500b3310 con 0x7f1238005190 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1257809640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f125006f860 con 0x7f1250159460 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1254da4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12501e7590 0x7f1250158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1254da4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12501e7590 0x7f1250158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44286/0 (socket says 172.21.15.67:44286) 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1254da4640 1 -- 172.21.15.67:0/684999941 learned_addr learned my addr 172.21.15.67:0/684999941 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1255da6640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1250159460 0x7f1250159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f12555a5640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1238005190 0x7f1250155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1254da4640 1 -- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1250159460 msgr2=0x7f1250159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1254da4640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1250159460 0x7f1250159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1254da4640 1 -- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1238005190 msgr2=0x7f1250155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1254da4640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1238005190 0x7f1250155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1254da4640 1 -- 172.21.15.67:0/684999941 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12501e64f0 con 0x7f12501e7590 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1254da4640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12501e7590 0x7f1250158f20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f124400f7f0 tx=0x7f124400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f124dffb640 1 -- 172.21.15.67:0/684999941 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12440050d0 con 0x7f12501e7590 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f124dffb640 1 -- 172.21.15.67:0/684999941 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1244018070 con 0x7f12501e7590 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1257809640 1 -- 172.21.15.67:0/684999941 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12501e67d0 con 0x7f12501e7590 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f124dffb640 1 -- 172.21.15.67:0/684999941 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124400d730 con 0x7f12501e7590 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1257809640 1 -- 172.21.15.67:0/684999941 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12501e6d90 con 0x7f12501e7590 2024-09-19T05:38:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f1257809640 1 -- 172.21.15.67:0/684999941 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f125006dfc0 con 0x7f12501e7590 2024-09-19T05:38:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f124dffb640 1 -- 172.21.15.67:0/684999941 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f124400d8d0 con 0x7f12501e7590 2024-09-19T05:38:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f124dffb640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f123c0678f0 0x7f123c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f124dffb640 1 -- 172.21.15.67:0/684999941 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7f12440859f0 con 0x7f12501e7590 2024-09-19T05:38:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.172+0000 7f12555a5640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f123c0678f0 0x7f123c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.176+0000 7f12555a5640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f123c0678f0 0x7f123c069db0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1240001ef0 tx=0x7f1240001e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.176+0000 7f124dffb640 1 -- 172.21.15.67:0/684999941 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1244056680 con 0x7f12501e7590 2024-09-19T05:38:09.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.344+0000 7f1257809640 1 -- 172.21.15.67:0/684999941 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7f12500ad4b0 con 0x7f12501e7590 2024-09-19T05:38:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.348+0000 7f124dffb640 1 -- 172.21.15.67:0/684999941 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v23) ==== 101+0+0 (secure 0 0 0) 0x7f1244055f80 con 0x7f12501e7590 2024-09-19T05:38:09.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 -- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f123c0678f0 msgr2=0x7f123c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f123c0678f0 0x7f123c069db0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1240001ef0 tx=0x7f1240001e80 comp rx=0 tx=0).stop 2024-09-19T05:38:09.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 -- 172.21.15.67:0/684999941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12501e7590 msgr2=0x7f1250158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12501e7590 0x7f1250158f20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f124400f7f0 tx=0x7f124400fcb0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 -- 172.21.15.67:0/684999941 shutdown_connections 2024-09-19T05:38:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f123c0678f0 0x7f123c069db0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1250159460 0x7f1250159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12501e7590 0x7f1250158f20 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 --2- 172.21.15.67:0/684999941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1238005190 0x7f1250155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 -- 172.21.15.67:0/684999941 >> 172.21.15.67:0/684999941 conn(0x7f12500b1e50 msgr2=0x7f12500afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 -- 172.21.15.67:0/684999941 shutdown_connections 2024-09-19T05:38:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.352+0000 7f1257809640 1 -- 172.21.15.67:0/684999941 wait complete. 2024-09-19T05:38:09.373 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-19T05:38:09.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfe59d640 1 Processor -- start 2024-09-19T05:38:09.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfe59d640 1 -- start start 2024-09-19T05:38:09.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfe59d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf815c030 0x7f5cf806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfe59d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5cf815d1d0 0x7f5cf80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfe59d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf806e3c0 con 0x7f5cf80b3510 2024-09-19T05:38:09.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfe59d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf806e6a0 con 0x7f5cf815d1d0 2024-09-19T05:38:09.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfe59d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf806e980 con 0x7f5cf815c030 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfcb3a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5cf80b3510 0x7f5cf806f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36774/0 (socket says 172.21.15.67:36774) 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfcb3a640 1 -- 172.21.15.67:0/3176483570 learned_addr learned my addr 172.21.15.67:0/3176483570 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf77fe640 1 --2- 172.21.15.67:0/3176483570 >> v2:172.21.15.97:3300/0 conn(0x7f5cf815d1d0 0x7f5cf80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf7fff640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf815c030 0x7f5cf806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1771705793 0 0) 0x7f5cf806e3c0 con 0x7f5cf80b3510 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ce0003530 con 0x7f5cf80b3510 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1646286271 0 0) 0x7f5ce0003530 con 0x7f5cf80b3510 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf815c030 msgr2=0x7f5cf806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf815c030 0x7f5cf806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 >> v2:172.21.15.97:3300/0 conn(0x7f5cf815d1d0 msgr2=0x7f5cf80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 --2- 172.21.15.67:0/3176483570 >> v2:172.21.15.97:3300/0 conn(0x7f5cf815d1d0 0x7f5cf80b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf806ec60 con 0x7f5cf80b3510 2024-09-19T05:38:09.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f5cf0001a00 con 0x7f5cf80b3510 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 >> v1:172.21.15.67:6789/0 conn(0x7f5cf80b3510 legacy=0x7f5cf806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ce00039c0 0x7f5ce0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf815c030 0x7f5ce0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ce0004d50 0x7f5ce00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf806e6a0 con 0x7f5ce0004d50 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf806e980 con 0x7f5ce00039c0 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce000b9d0 con 0x7f5cf815c030 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfcb3a640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ce0004d50 0x7f5ce00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf7fff640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ce00039c0 0x7f5ce0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf77fe640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf815c030 0x7f5ce0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfcb3a640 1 -- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf815c030 msgr2=0x7f5ce0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfcb3a640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf815c030 0x7f5ce0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfcb3a640 1 -- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ce00039c0 msgr2=0x7f5ce0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfcb3a640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ce00039c0 0x7f5ce0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cfcb3a640 1 -- 172.21.15.67:0/3176483570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce0003530 con 0x7f5ce0004d50 2024-09-19T05:38:09.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.532+0000 7f5cf7fff640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ce00039c0 0x7f5ce0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:09.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cfcb3a640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ce0004d50 0x7f5ce00051d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000a7a0 tx=0x7f5cf001d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b876c9621edd6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000a3f0 con 0x7f5ce0004d50 2024-09-19T05:38:09.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf00ad630 con 0x7f5ce0004d50 2024-09-19T05:38:09.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cf6ffd640 1 -- 172.21.15.67:0/3176483570 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00ada40 con 0x7f5ce0004d50 2024-09-19T05:38:09.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cfe59d640 1 -- 172.21.15.67:0/3176483570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ce0004d50 msgr2=0x7f5ce00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cfe59d640 1 --2- 172.21.15.67:0/3176483570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ce0004d50 0x7f5ce00051d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000a7a0 tx=0x7f5cf001d2e0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cfcb3a640 1 -- 172.21.15.67:0/3176483570 reap_dead start 2024-09-19T05:38:09.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cfe59d640 1 -- 172.21.15.67:0/3176483570 shutdown_connections 2024-09-19T05:38:09.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cfe59d640 1 -- 172.21.15.67:0/3176483570 >> 172.21.15.67:0/3176483570 conn(0x7f5cf80d0080 msgr2=0x7f5cf80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:09.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cfe59d640 1 -- 172.21.15.67:0/3176483570 shutdown_connections 2024-09-19T05:38:09.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cfe59d640 1 -- 172.21.15.67:0/3176483570 wait complete. 2024-09-19T05:38:09.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cfe59d640 1 Processor -- start 2024-09-19T05:38:09.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.536+0000 7f5cfe59d640 1 -- start start 2024-09-19T05:38:09.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfe59d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf8099840 0x7f5cf80b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfe59d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf8158500 0x7f5cf8072ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfe59d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf8099c20 0x7f5cf8073410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfe59d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf806fb70 con 0x7f5cf8099c20 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfe59d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf815d630 con 0x7f5cf8099840 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfe59d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf806fcf0 con 0x7f5cf8158500 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfcb3a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf8099c20 0x7f5cf8073410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfcb3a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf8099c20 0x7f5cf8073410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44310/0 (socket says 172.21.15.67:44310) 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfcb3a640 1 -- 172.21.15.67:0/622374094 learned_addr learned my addr 172.21.15.67:0/622374094 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cf77fe640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf8158500 0x7f5cf8072ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cf7fff640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf8099840 0x7f5cf80b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfcb3a640 1 -- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf8158500 msgr2=0x7f5cf8072ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfcb3a640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf8158500 0x7f5cf8072ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfcb3a640 1 -- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf8099840 msgr2=0x7f5cf80b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfcb3a640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf8099840 0x7f5cf80b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfcb3a640 1 -- 172.21.15.67:0/622374094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf80b1b00 con 0x7f5cf8099c20 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfcb3a640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf8099c20 0x7f5cf8073410 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0098d00 tx=0x7f5ce0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cf4ff9640 1 -- 172.21.15.67:0/622374094 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0001f40 con 0x7f5cf8099c20 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cf4ff9640 1 -- 172.21.15.67:0/622374094 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf000a3d0 con 0x7f5cf8099c20 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfe59d640 1 -- 172.21.15.67:0/622374094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf81f1070 con 0x7f5cf8099c20 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cf4ff9640 1 -- 172.21.15.67:0/622374094 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00019d0 con 0x7f5cf8099c20 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfe59d640 1 -- 172.21.15.67:0/622374094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf81f1630 con 0x7f5cf8099c20 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cfe59d640 1 -- 172.21.15.67:0/622374094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf815c410 con 0x7f5cf8099c20 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cf4ff9640 1 -- 172.21.15.67:0/622374094 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5cf00ad630 con 0x7f5cf8099c20 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cf4ff9640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce40678c0 0x7f5ce4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cf4ff9640 1 -- 172.21.15.67:0/622374094 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7f5cf011f9e0 con 0x7f5cf8099c20 2024-09-19T05:38:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.540+0000 7f5cf7fff640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce40678c0 0x7f5ce4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.544+0000 7f5cf7fff640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce40678c0 0x7f5ce4069d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80099b0 tx=0x7f5ce8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.544+0000 7f5cf4ff9640 1 -- 172.21.15.67:0/622374094 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5cf0016ff0 con 0x7f5cf8099c20 2024-09-19T05:38:09.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:09.764+0000 7f5cfe59d640 1 -- 172.21.15.67:0/622374094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f5cf80d0f20 con 0x7f5cf8099c20 2024-09-19T05:38:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.060+0000 7f5cf4ff9640 1 -- 172.21.15.67:0/622374094 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v237) ==== 151+0+0 (secure 0 0 0) 0x7f5cf00f05e0 con 0x7f5cf8099c20 2024-09-19T05:38:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 -- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce40678c0 msgr2=0x7f5ce4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce40678c0 0x7f5ce4069d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80099b0 tx=0x7f5ce8008040 comp rx=0 tx=0).stop 2024-09-19T05:38:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 -- 172.21.15.67:0/622374094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf8099c20 msgr2=0x7f5cf8073410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf8099c20 0x7f5cf8073410 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0098d00 tx=0x7f5ce0005840 comp rx=0 tx=0).stop 2024-09-19T05:38:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 -- 172.21.15.67:0/622374094 shutdown_connections 2024-09-19T05:38:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cf8099c20 0x7f5cf8073410 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce40678c0 0x7f5ce4069d80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf8158500 0x7f5cf8072ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 --2- 172.21.15.67:0/622374094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf8099840 0x7f5cf80b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 -- 172.21.15.67:0/622374094 >> 172.21.15.67:0/622374094 conn(0x7f5cf80d0080 msgr2=0x7f5cf80b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 -- 172.21.15.67:0/622374094 shutdown_connections 2024-09-19T05:38:10.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.064+0000 7f5cfe59d640 1 -- 172.21.15.67:0/622374094 wait complete. 2024-09-19T05:38:10.089 INFO:tasks.cephfs_test_runner:That a directory is merged during scrub. ... ok 2024-09-19T05:38:10.089 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-19T05:38:10.090 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:10.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f870b471640 1 Processor -- start 2024-09-19T05:38:10.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f870b471640 1 -- start start 2024-09-19T05:38:10.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f870b471640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87040b51d0 0x7f87040d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f870b471640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87040d4d40 con 0x7f87040d1590 2024-09-19T05:38:10.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f870b471640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87040d5020 con 0x7f8704161da0 2024-09-19T05:38:10.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f870b471640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f87040d0840 con 0x7f87040b51d0 2024-09-19T05:38:10.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8708a0c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f87040d1590 0x7f87040cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36782/0 (socket says 172.21.15.67:36782) 2024-09-19T05:38:10.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8708a0c640 1 -- 172.21.15.67:0/3999815888 learned_addr learned my addr 172.21.15.67:0/3999815888 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:10.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748636182 0 0) 0x7f87040d4d40 con 0x7f87040d1590 2024-09-19T05:38:10.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f0003530 con 0x7f87040d1590 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8709a0e640 1 --2- 172.21.15.67:0/3999815888 >> v2:172.21.15.97:3300/0 conn(0x7f87040b51d0 0x7f87040d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 571098592 0 0) 0x7f86f0003530 con 0x7f87040d1590 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 >> v2:172.21.15.97:3300/0 conn(0x7f87040b51d0 msgr2=0x7f87040d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 --2- 172.21.15.67:0/3999815888 >> v2:172.21.15.97:3300/0 conn(0x7f87040b51d0 0x7f87040d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 >> v1:172.21.15.97:6789/0 conn(0x7f8704161da0 legacy=0x7f87040d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87040d5300 con 0x7f87040d1590 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f86f4001680 con 0x7f87040d1590 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8709a0e640 1 --2- 172.21.15.67:0/3999815888 >> v2:172.21.15.97:3300/0 conn(0x7f87040b51d0 0x7f87040d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 >> v1:172.21.15.67:6789/0 conn(0x7f87040d1590 legacy=0x7f87040cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86f00039c0 0x7f86f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f0004810 0x7f86f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f00051d0 0x7f86f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f87040d0840 con 0x7f86f00051d0 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f86f000c120 con 0x7f86f0004810 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f86f000c320 con 0x7f86f00039c0 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8709a0e640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f00051d0 0x7f86f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8708a0c640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f0004810 0x7f86f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f870920d640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86f00039c0 0x7f86f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8709a0e640 1 -- 172.21.15.67:0/3999815888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86f00039c0 msgr2=0x7f86f0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8709a0e640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86f00039c0 0x7f86f0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8709a0e640 1 -- 172.21.15.67:0/3999815888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f0004810 msgr2=0x7f86f0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8709a0e640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f0004810 0x7f86f0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.216+0000 7f8709a0e640 1 -- 172.21.15.67:0/3999815888 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f0003530 con 0x7f86f00051d0 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f8709a0e640 1 -- 172.21.15.67:0/3999815888 reap_dead start 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f8709a0e640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f00051d0 0x7f86f000b9d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0098d0 tx=0x7f86fc01c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b1e05e893e952b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00f040 con 0x7f86f00051d0 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86fc0a6660 con 0x7f86f00051d0 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f86fbfff640 1 -- 172.21.15.67:0/3999815888 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc006e40 con 0x7f86f00051d0 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 -- 172.21.15.67:0/3999815888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f00051d0 msgr2=0x7f86f000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f00051d0 0x7f86f000b9d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0098d0 tx=0x7f86fc01c650 comp rx=0 tx=0).stop 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 -- 172.21.15.67:0/3999815888 shutdown_connections 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 --2- 172.21.15.67:0/3999815888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f00051d0 0x7f86f000b9d0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 -- 172.21.15.67:0/3999815888 >> 172.21.15.67:0/3999815888 conn(0x7f870408bfc0 msgr2=0x7f87040d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 -- 172.21.15.67:0/3999815888 shutdown_connections 2024-09-19T05:38:10.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 -- 172.21.15.67:0/3999815888 wait complete. 2024-09-19T05:38:10.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 Processor -- start 2024-09-19T05:38:10.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 -- start start 2024-09-19T05:38:10.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f00051d0 0x7f870415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87040b7c30 0x7f870406df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f870406e4d0 0x7f87040b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8704162180 con 0x7f87040b7c30 2024-09-19T05:38:10.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f87040b5d00 con 0x7f86f00051d0 2024-09-19T05:38:10.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.220+0000 7f870b471640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f87040d1af0 con 0x7f870406e4d0 2024-09-19T05:38:10.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8708a0c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87040b7c30 0x7f870406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8708a0c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87040b7c30 0x7f870406df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44314/0 (socket says 172.21.15.67:44314) 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8708a0c640 1 -- 172.21.15.67:0/3599168644 learned_addr learned my addr 172.21.15.67:0/3599168644 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f870920d640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f00051d0 0x7f870415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8709a0e640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f870406e4d0 0x7f87040b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8708a0c640 1 -- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f870406e4d0 msgr2=0x7f87040b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8708a0c640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f870406e4d0 0x7f87040b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8708a0c640 1 -- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f00051d0 msgr2=0x7f870415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8708a0c640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f00051d0 0x7f870415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8708a0c640 1 -- 172.21.15.67:0/3599168644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87040cbff0 con 0x7f87040b7c30 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8709a0e640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f870406e4d0 0x7f87040b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f8708a0c640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87040b7c30 0x7f870406df90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f86f4001060 tx=0x7f86f400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f86f9ffb640 1 -- 172.21.15.67:0/3599168644 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f400c870 con 0x7f87040b7c30 2024-09-19T05:38:10.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f86f9ffb640 1 -- 172.21.15.67:0/3599168644 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f4018070 con 0x7f87040b7c30 2024-09-19T05:38:10.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f86f9ffb640 1 -- 172.21.15.67:0/3599168644 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f400cc50 con 0x7f87040b7c30 2024-09-19T05:38:10.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f870b471640 1 -- 172.21.15.67:0/3599168644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87040cc2d0 con 0x7f87040b7c30 2024-09-19T05:38:10.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f870b471640 1 -- 172.21.15.67:0/3599168644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87040cc890 con 0x7f87040b7c30 2024-09-19T05:38:10.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f870b471640 1 -- 172.21.15.67:0/3599168644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87040cd060 con 0x7f87040b7c30 2024-09-19T05:38:10.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f86f9ffb640 1 -- 172.21.15.67:0/3599168644 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86f401d460 con 0x7f87040b7c30 2024-09-19T05:38:10.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f86f9ffb640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86e80678c0 0x7f86e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f86f9ffb640 1 -- 172.21.15.67:0/3599168644 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7f86f40859a0 con 0x7f87040b7c30 2024-09-19T05:38:10.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.224+0000 7f870920d640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86e80678c0 0x7f86e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.228+0000 7f870920d640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86e80678c0 0x7f86e8069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8700000f90 tx=0x7f8700009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.228+0000 7f86f9ffb640 1 -- 172.21.15.67:0/3599168644 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f86f4056610 con 0x7f87040b7c30 2024-09-19T05:38:10.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.388+0000 7f870b471640 1 -- 172.21.15.67:0/3599168644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8704161120 con 0x7f87040b7c30 2024-09-19T05:38:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f86f9ffb640 1 -- 172.21.15.67:0/3599168644 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+13526 (secure 0 0 0) 0x7f86f4055f10 con 0x7f87040b7c30 2024-09-19T05:38:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:10.396 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":77,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:38:08.046108+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/223294608":"2024-09-20T05:38:04.711053+0000","172.21.15.67:6834/223294608":"2024-09-20T05:38:04.711053+0000","172.21.15.67:6834/403505114":"2024-09-20T05:37:49.394619+0000","172.21.15.67:6832/403505114":"2024-09-20T05:37:49.394619+0000","172.21.15.67:6835/3283833069":"2024-09-20T05:37:49.369581+0000","172.21.15.67:6833/3283833069":"2024-09-20T05:37:49.369581+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 -- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86e80678c0 msgr2=0x7f86e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86e80678c0 0x7f86e8069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8700000f90 tx=0x7f8700009040 comp rx=0 tx=0).stop 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 -- 172.21.15.67:0/3599168644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87040b7c30 msgr2=0x7f870406df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87040b7c30 0x7f870406df90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f86f4001060 tx=0x7f86f400ec80 comp rx=0 tx=0).stop 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 -- 172.21.15.67:0/3599168644 shutdown_connections 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86e80678c0 0x7f86e8069d80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f870406e4d0 0x7f87040b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87040b7c30 0x7f870406df90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 --2- 172.21.15.67:0/3599168644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f00051d0 0x7f870415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 -- 172.21.15.67:0/3599168644 >> 172.21.15.67:0/3599168644 conn(0x7f870408bfc0 msgr2=0x7f87040b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 -- 172.21.15.67:0/3599168644 shutdown_connections 2024-09-19T05:38:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.392+0000 7f870b471640 1 -- 172.21.15.67:0/3599168644 wait complete. 2024-09-19T05:38:10.414 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:38:10.414 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:38:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9adaf5640 1 Processor -- start 2024-09-19T05:38:10.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9adaf5640 1 -- start start 2024-09-19T05:38:10.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9adaf5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9a8159c60 0x7fc9a80ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9adaf5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9a806ffd0 0x7fc9a80aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9adaf5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a815a040 con 0x7fc9a80b3150 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9adaf5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a815d460 con 0x7fc9a806ffd0 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9adaf5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a815c850 con 0x7fc9a8159c60 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9a6ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9a806ffd0 0x7fc9a80aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9a6ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9a806ffd0 0x7fc9a80aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44318/0 (socket says 172.21.15.67:44318) 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9a6ffd640 1 -- 172.21.15.67:0/3724510040 learned_addr learned my addr 172.21.15.67:0/3724510040 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9a77fe640 1 --2- 172.21.15.67:0/3724510040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9a8159c60 0x7fc9a80ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9a6ffd640 1 -- 172.21.15.67:0/3724510040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9a8159c60 msgr2=0x7fc9a80ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9a6ffd640 1 --2- 172.21.15.67:0/3724510040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9a8159c60 0x7fc9a80ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9a6ffd640 1 -- 172.21.15.67:0/3724510040 >> v1:172.21.15.97:6789/0 conn(0x7fc9a80b3150 legacy=0x7fc9a815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.536+0000 7fc9a6ffd640 1 -- 172.21.15.67:0/3724510040 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a815cb30 con 0x7fc9a806ffd0 2024-09-19T05:38:10.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9a6ffd640 1 --2- 172.21.15.67:0/3724510040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a806ffd0 0x7fc9a80aec90 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009870 tx=0x7fc99c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fece59d3421b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9a67fc640 1 -- 172.21.15.67:0/3724510040 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0a95f0 con 0x7fc9a806ffd0 2024-09-19T05:38:10.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9a67fc640 1 -- 172.21.15.67:0/3724510040 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99c0a9790 con 0x7fc9a806ffd0 2024-09-19T05:38:10.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9a67fc640 1 -- 172.21.15.67:0/3724510040 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0a9b60 con 0x7fc9a806ffd0 2024-09-19T05:38:10.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3724510040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a806ffd0 msgr2=0x7fc9a80aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9adaf5640 1 --2- 172.21.15.67:0/3724510040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a806ffd0 0x7fc9a80aec90 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009870 tx=0x7fc99c01c530 comp rx=0 tx=0).stop 2024-09-19T05:38:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3724510040 shutdown_connections 2024-09-19T05:38:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9adaf5640 1 --2- 172.21.15.67:0/3724510040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a806ffd0 0x7fc9a80aec90 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9adaf5640 1 --2- 172.21.15.67:0/3724510040 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9a8159c60 0x7fc9a80ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3724510040 >> 172.21.15.67:0/3724510040 conn(0x7fc9a80b1e50 msgr2=0x7fc9a80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3724510040 shutdown_connections 2024-09-19T05:38:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3724510040 wait complete. 2024-09-19T05:38:10.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.540+0000 7fc9adaf5640 1 Processor -- start 2024-09-19T05:38:10.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9adaf5640 1 -- start start 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9adaf5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9a806ffd0 0x7fc9a80999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9adaf5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9a80b3150 0x7fc9a815d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9adaf5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a8159c60 0x7fc9a8071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9adaf5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80ad7f0 con 0x7fc9a8159c60 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9adaf5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80ad670 con 0x7fc9a806ffd0 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9adaf5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a8168e30 con 0x7fc9a80b3150 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a8159c60 0x7fc9a8071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a8159c60 0x7fc9a8071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44328/0 (socket says 172.21.15.67:44328) 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a7fff640 1 -- 172.21.15.67:0/3180804579 learned_addr learned my addr 172.21.15.67:0/3180804579 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a6ffd640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9a80b3150 0x7fc9a815d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a77fe640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9a806ffd0 0x7fc9a80999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a7fff640 1 -- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9a80b3150 msgr2=0x7fc9a815d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a7fff640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9a80b3150 0x7fc9a815d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a7fff640 1 -- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9a806ffd0 msgr2=0x7fc9a80999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a7fff640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9a806ffd0 0x7fc9a80999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a7fff640 1 -- 172.21.15.67:0/3180804579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a815dc80 con 0x7fc9a8159c60 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9a7fff640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a8159c60 0x7fc9a8071f60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc99800c3c0 tx=0x7fc99800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc98ffff640 1 -- 172.21.15.67:0/3180804579 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9980052d0 con 0x7fc9a8159c60 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc98ffff640 1 -- 172.21.15.67:0/3180804579 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc998005470 con 0x7fc9a8159c60 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc98ffff640 1 -- 172.21.15.67:0/3180804579 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998007240 con 0x7fc9a8159c60 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3180804579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a814f8c0 con 0x7fc9a8159c60 2024-09-19T05:38:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3180804579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a8072ce0 con 0x7fc9a8159c60 2024-09-19T05:38:10.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3180804579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a8072eb0 con 0x7fc9a8159c60 2024-09-19T05:38:10.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc98ffff640 1 -- 172.21.15.67:0/3180804579 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc9980073e0 con 0x7fc9a8159c60 2024-09-19T05:38:10.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc98ffff640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9940678c0 0x7fc994069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.544+0000 7fc98ffff640 1 -- 172.21.15.67:0/3180804579 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7fc998085040 con 0x7fc9a8159c60 2024-09-19T05:38:10.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.548+0000 7fc9a77fe640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9940678c0 0x7fc994069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.548+0000 7fc9a77fe640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9940678c0 0x7fc994069d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80735b0 tx=0x7fc9a000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.552+0000 7fc98ffff640 1 -- 172.21.15.67:0/3180804579 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc998055c40 con 0x7fc9a8159c60 2024-09-19T05:38:10.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.716+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3180804579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc9a80aec90 con 0x7fc9a8159c60 2024-09-19T05:38:10.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc98ffff640 1 -- 172.21.15.67:0/3180804579 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7fc998055540 con 0x7fc9a8159c60 2024-09-19T05:38:10.723 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:38:10.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9940678c0 msgr2=0x7fc994069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9940678c0 0x7fc994069d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80735b0 tx=0x7fc9a000b040 comp rx=0 tx=0).stop 2024-09-19T05:38:10.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3180804579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a8159c60 msgr2=0x7fc9a8071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a8159c60 0x7fc9a8071f60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc99800c3c0 tx=0x7fc99800c880 comp rx=0 tx=0).stop 2024-09-19T05:38:10.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3180804579 shutdown_connections 2024-09-19T05:38:10.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9a8159c60 0x7fc9a8071f60 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9940678c0 0x7fc994069d80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9a80b3150 0x7fc9a815d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 --2- 172.21.15.67:0/3180804579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9a806ffd0 0x7fc9a80999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3180804579 >> 172.21.15.67:0/3180804579 conn(0x7fc9a80b1e50 msgr2=0x7fc9a815bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3180804579 shutdown_connections 2024-09-19T05:38:10.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.720+0000 7fc9adaf5640 1 -- 172.21.15.67:0/3180804579 wait complete. 2024-09-19T05:38:10.744 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-19T05:38:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.868+0000 7f0afa035640 1 Processor -- start 2024-09-19T05:38:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.868+0000 7f0afa035640 1 -- start start 2024-09-19T05:38:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.868+0000 7f0afa035640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0af406f460 0x7f0af406f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0afa035640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0af406e3c0 con 0x7f0af415c030 2024-09-19T05:38:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0afa035640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0af406e6a0 con 0x7f0af406dde0 2024-09-19T05:38:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0afa035640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0af406e980 con 0x7f0af406f460 2024-09-19T05:38:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0af415c030 0x7f0af415d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36786/0 (socket says 172.21.15.67:36786) 2024-09-19T05:38:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af37fe640 1 -- 172.21.15.67:0/2313421493 learned_addr learned my addr 172.21.15.67:0/2313421493 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af3fff640 1 --2- 172.21.15.67:0/2313421493 >> v2:172.21.15.67:3300/0 conn(0x7f0af406f460 0x7f0af406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af27fc640 1 -- 172.21.15.67:0/2313421493 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340157222 0 0) 0x7f0af406e3c0 con 0x7f0af415c030 2024-09-19T05:38:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af27fc640 1 -- 172.21.15.67:0/2313421493 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0adc003530 con 0x7f0af415c030 2024-09-19T05:38:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af3fff640 1 -- 172.21.15.67:0/2313421493 >> v1:172.21.15.97:6789/0 conn(0x7f0af406dde0 legacy=0x7f0af40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af3fff640 1 -- 172.21.15.67:0/2313421493 >> v1:172.21.15.67:6789/0 conn(0x7f0af415c030 legacy=0x7f0af415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af3fff640 1 -- 172.21.15.67:0/2313421493 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af406ec60 con 0x7f0af406f460 2024-09-19T05:38:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af3fff640 1 --2- 172.21.15.67:0/2313421493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 0x7f0af406f870 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40097c0 tx=0x7f0ae401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa46be256bf87bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af27fc640 1 -- 172.21.15.67:0/2313421493 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40b0070 con 0x7f0af406f460 2024-09-19T05:38:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af27fc640 1 -- 172.21.15.67:0/2313421493 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae40ab600 con 0x7f0af406f460 2024-09-19T05:38:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0af27fc640 1 -- 172.21.15.67:0/2313421493 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40ab9d0 con 0x7f0af406f460 2024-09-19T05:38:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0afa035640 1 -- 172.21.15.67:0/2313421493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 msgr2=0x7f0af406f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0afa035640 1 --2- 172.21.15.67:0/2313421493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 0x7f0af406f870 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40097c0 tx=0x7f0ae401c4a0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0afa035640 1 -- 172.21.15.67:0/2313421493 shutdown_connections 2024-09-19T05:38:10.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0afa035640 1 --2- 172.21.15.67:0/2313421493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 0x7f0af406f870 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0afa035640 1 -- 172.21.15.67:0/2313421493 >> 172.21.15.67:0/2313421493 conn(0x7f0af40d0080 msgr2=0x7f0af40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0afa035640 1 -- 172.21.15.67:0/2313421493 shutdown_connections 2024-09-19T05:38:10.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.872+0000 7f0afa035640 1 -- 172.21.15.67:0/2313421493 wait complete. 2024-09-19T05:38:10.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 Processor -- start 2024-09-19T05:38:10.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 -- start start 2024-09-19T05:38:10.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af406dde0 0x7f0af40998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 0x7f0af414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0af415c030 0x7f0af4148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0af416a270 con 0x7f0af406f460 2024-09-19T05:38:10.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0af416a0f0 con 0x7f0af406dde0 2024-09-19T05:38:10.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0af416a3f0 con 0x7f0af415c030 2024-09-19T05:38:10.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 0x7f0af414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 0x7f0af414fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44344/0 (socket says 172.21.15.67:44344) 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af2ffd640 1 -- 172.21.15.67:0/648416703 learned_addr learned my addr 172.21.15.67:0/648416703 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af3fff640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0af415c030 0x7f0af4148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af37fe640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af406dde0 0x7f0af40998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af2ffd640 1 -- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0af415c030 msgr2=0x7f0af4148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af2ffd640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0af415c030 0x7f0af4148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af2ffd640 1 -- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af406dde0 msgr2=0x7f0af40998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af2ffd640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af406dde0 0x7f0af40998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af2ffd640 1 -- 172.21.15.67:0/648416703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af414eaf0 con 0x7f0af406f460 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af37fe640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af406dde0 0x7f0af40998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0af2ffd640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 0x7f0af414fb90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800c820 tx=0x7f0ae800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0adbfff640 1 -- 172.21.15.67:0/648416703 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8003b80 con 0x7f0af406f460 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0adbfff640 1 -- 172.21.15.67:0/648416703 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae8003d20 con 0x7f0af406f460 2024-09-19T05:38:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0adbfff640 1 -- 172.21.15.67:0/648416703 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800aa90 con 0x7f0af406f460 2024-09-19T05:38:10.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 -- 172.21.15.67:0/648416703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af414edd0 con 0x7f0af406f460 2024-09-19T05:38:10.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 -- 172.21.15.67:0/648416703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af414f390 con 0x7f0af406f460 2024-09-19T05:38:10.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.876+0000 7f0afa035640 1 -- 172.21.15.67:0/648416703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af406f870 con 0x7f0af406f460 2024-09-19T05:38:10.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.880+0000 7f0adbfff640 1 -- 172.21.15.67:0/648416703 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ae800ac30 con 0x7f0af406f460 2024-09-19T05:38:10.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.880+0000 7f0adbfff640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae00678c0 0x7f0ae0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.880+0000 7f0adbfff640 1 -- 172.21.15.67:0/648416703 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7f0ae8085c40 con 0x7f0af406f460 2024-09-19T05:38:10.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.880+0000 7f0af37fe640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae00678c0 0x7f0ae0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.880+0000 7f0af37fe640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae00678c0 0x7f0ae0069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0011f0 tx=0x7f0aec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:10.884+0000 7f0adbfff640 1 -- 172.21.15.67:0/648416703 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0ae8056840 con 0x7f0af406f460 2024-09-19T05:38:11.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:11.108+0000 7f0afa035640 1 -- 172.21.15.67:0/648416703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f0af40d0f20 con 0x7f0af406f460 2024-09-19T05:38:12.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.072+0000 7f0adbfff640 1 -- 172.21.15.67:0/648416703 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v239) ==== 146+0+0 (secure 0 0 0) 0x7f0ae8056140 con 0x7f0af406f460 2024-09-19T05:38:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.072+0000 7f0afa035640 1 -- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae00678c0 msgr2=0x7f0ae0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae00678c0 0x7f0ae0069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0011f0 tx=0x7f0aec009040 comp rx=0 tx=0).stop 2024-09-19T05:38:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 -- 172.21.15.67:0/648416703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 msgr2=0x7f0af414fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 0x7f0af414fb90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800c820 tx=0x7f0ae800cce0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 -- 172.21.15.67:0/648416703 shutdown_connections 2024-09-19T05:38:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ae00678c0 0x7f0ae0069d80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0af415c030 0x7f0af4148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af406f460 0x7f0af414fb90 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 --2- 172.21.15.67:0/648416703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af406dde0 0x7f0af40998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 -- 172.21.15.67:0/648416703 >> 172.21.15.67:0/648416703 conn(0x7f0af40d0080 msgr2=0x7f0af40b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 -- 172.21.15.67:0/648416703 shutdown_connections 2024-09-19T05:38:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.076+0000 7f0afa035640 1 -- 172.21.15.67:0/648416703 wait complete. 2024-09-19T05:38:12.101 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:38:12.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f1240524640 1 Processor -- start 2024-09-19T05:38:12.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f1240524640 1 -- start start 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f1240524640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1238159c60 0x7f12380ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f1240524640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123815a040 con 0x7f123806ffd0 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f1240524640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123815c850 con 0x7f12380af3a0 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f1240524640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f123815d460 con 0x7f1238159c60 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f123e2c0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1238159c60 0x7f12380ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f123dabf640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f123806ffd0 0x7f12380aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36802/0 (socket says 172.21.15.67:36802) 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f123dabf640 1 -- 172.21.15.67:0/24101501 learned_addr learned my addr 172.21.15.67:0/24101501 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f123d2be640 1 -- 172.21.15.67:0/24101501 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976284641 0 0) 0x7f123815a040 con 0x7f123806ffd0 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f123d2be640 1 -- 172.21.15.67:0/24101501 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1224003530 con 0x7f123806ffd0 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f123e2c0640 1 -- 172.21.15.67:0/24101501 >> v1:172.21.15.97:6789/0 conn(0x7f12380af3a0 legacy=0x7f123815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f123e2c0640 1 -- 172.21.15.67:0/24101501 >> v1:172.21.15.67:6789/0 conn(0x7f123806ffd0 legacy=0x7f12380aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.232+0000 7f123e2c0640 1 -- 172.21.15.67:0/24101501 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123815cb30 con 0x7f1238159c60 2024-09-19T05:38:12.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f123e2c0640 1 --2- 172.21.15.67:0/24101501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1238159c60 0x7f12380ad130 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f12340097c0 tx=0x7f123401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad07f23f95454388 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f123d2be640 1 -- 172.21.15.67:0/24101501 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12340a7070 con 0x7f1238159c60 2024-09-19T05:38:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f123d2be640 1 -- 172.21.15.67:0/24101501 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12340b0070 con 0x7f1238159c60 2024-09-19T05:38:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f123d2be640 1 -- 172.21.15.67:0/24101501 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12340ab890 con 0x7f1238159c60 2024-09-19T05:38:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f1240524640 1 -- 172.21.15.67:0/24101501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1238159c60 msgr2=0x7f12380ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f1240524640 1 --2- 172.21.15.67:0/24101501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1238159c60 0x7f12380ad130 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f12340097c0 tx=0x7f123401c470 comp rx=0 tx=0).stop 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f1240524640 1 -- 172.21.15.67:0/24101501 shutdown_connections 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f1240524640 1 --2- 172.21.15.67:0/24101501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1238159c60 0x7f12380ad130 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f1240524640 1 -- 172.21.15.67:0/24101501 >> 172.21.15.67:0/24101501 conn(0x7f12380b1e50 msgr2=0x7f12380b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f1240524640 1 -- 172.21.15.67:0/24101501 shutdown_connections 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f1240524640 1 -- 172.21.15.67:0/24101501 wait complete. 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f1240524640 1 Processor -- start 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.236+0000 7f1240524640 1 -- start start 2024-09-19T05:38:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f1240524640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f123806ffd0 0x7f123809c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f1240524640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12380af3a0 0x7f12381581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f1240524640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1238159c60 0x7f12381586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f1240524640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1238169fc0 con 0x7f12380af3a0 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f1240524640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1238169e40 con 0x7f1238159c60 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f1240524640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f123816a140 con 0x7f123806ffd0 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123dabf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12380af3a0 0x7f12381581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123dabf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12380af3a0 0x7f12381581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44358/0 (socket says 172.21.15.67:44358) 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123dabf640 1 -- 172.21.15.67:0/3972875697 learned_addr learned my addr 172.21.15.67:0/3972875697 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123e2c0640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f123806ffd0 0x7f123809c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123eac1640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1238159c60 0x7f12381586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123dabf640 1 -- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f123806ffd0 msgr2=0x7f123809c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123dabf640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f123806ffd0 0x7f123809c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123dabf640 1 -- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1238159c60 msgr2=0x7f12381586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123dabf640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1238159c60 0x7f12381586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123dabf640 1 -- 172.21.15.67:0/3972875697 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123809b870 con 0x7f12380af3a0 2024-09-19T05:38:12.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123e2c0640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f123806ffd0 0x7f123809c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:12.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123dabf640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12380af3a0 0x7f12381581a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f122800c4d0 tx=0x7f122800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f122effd640 1 -- 172.21.15.67:0/3972875697 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228017070 con 0x7f12380af3a0 2024-09-19T05:38:12.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f122effd640 1 -- 172.21.15.67:0/3972875697 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1228005cf0 con 0x7f12380af3a0 2024-09-19T05:38:12.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f122effd640 1 -- 172.21.15.67:0/3972875697 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228007270 con 0x7f12380af3a0 2024-09-19T05:38:12.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f1240524640 1 -- 172.21.15.67:0/3972875697 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123809bb50 con 0x7f12380af3a0 2024-09-19T05:38:12.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f1240524640 1 -- 172.21.15.67:0/3972875697 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123809c110 con 0x7f12380af3a0 2024-09-19T05:38:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f1240524640 1 -- 172.21.15.67:0/3972875697 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12380ad130 con 0x7f12380af3a0 2024-09-19T05:38:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f122effd640 1 -- 172.21.15.67:0/3972875697 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f122801a070 con 0x7f12380af3a0 2024-09-19T05:38:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f122effd640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678c0 0x7f121c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f122effd640 1 -- 172.21.15.67:0/3972875697 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7f1228084db0 con 0x7f12380af3a0 2024-09-19T05:38:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.240+0000 7f123e2c0640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678c0 0x7f121c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.244+0000 7f123e2c0640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678c0 0x7f121c069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f12340af000 tx=0x7f12340a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.244+0000 7f122effd640 1 -- 172.21.15.67:0/3972875697 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f12280553f0 con 0x7f12380af3a0 2024-09-19T05:38:12.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.412+0000 7f1240524640 1 -- 172.21.15.67:0/3972875697 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f123806e080 con 0x7f12380af3a0 2024-09-19T05:38:12.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.416+0000 7f122effd640 1 -- 172.21.15.67:0/3972875697 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f12280596f0 con 0x7f12380af3a0 2024-09-19T05:38:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 -- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678c0 msgr2=0x7f121c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678c0 0x7f121c069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f12340af000 tx=0x7f12340a7000 comp rx=0 tx=0).stop 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 -- 172.21.15.67:0/3972875697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12380af3a0 msgr2=0x7f12381581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12380af3a0 0x7f12381581a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f122800c4d0 tx=0x7f122800c990 comp rx=0 tx=0).stop 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 -- 172.21.15.67:0/3972875697 shutdown_connections 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1238159c60 0x7f12381586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12380af3a0 0x7f12381581a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678c0 0x7f121c069d80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 --2- 172.21.15.67:0/3972875697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f123806ffd0 0x7f123809c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 -- 172.21.15.67:0/3972875697 >> 172.21.15.67:0/3972875697 conn(0x7f12380b1e50 msgr2=0x7f123815a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 -- 172.21.15.67:0/3972875697 shutdown_connections 2024-09-19T05:38:12.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.420+0000 7f1240524640 1 -- 172.21.15.67:0/3972875697 wait complete. 2024-09-19T05:38:12.441 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:38:12.441 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:38:12.504 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:38:12.580 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:38:12.580 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:38:12.580 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:12.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:38:12.586 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:38:12.586 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:12.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:38:12.592 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:38:12.592 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:12.635 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:38:12.636 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:38:12.636 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:12.642 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:38:12.642 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:38:12.642 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:12.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f03a1f68640 1 Processor -- start 2024-09-19T05:38:12.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f03a1f68640 1 -- start start 2024-09-19T05:38:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f03a1f68640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f039c15c030 0x7f039c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f03a1f68640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f039c15d1d0 0x7f039c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f03a1f68640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f039c06e3c0 con 0x7f039c0b3510 2024-09-19T05:38:12.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f03a1f68640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f039c06e6a0 con 0x7f039c15c030 2024-09-19T05:38:12.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f03a1f68640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f039c06e980 con 0x7f039c15d1d0 2024-09-19T05:38:12.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f039b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f039c15c030 0x7f039c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f039bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f039c0b3510 0x7f039c06f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36808/0 (socket says 172.21.15.67:36808) 2024-09-19T05:38:12.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f039bfff640 1 -- 172.21.15.67:0/944586343 learned_addr learned my addr 172.21.15.67:0/944586343 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:12.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f039affd640 1 --2- 172.21.15.67:0/944586343 >> v2:172.21.15.97:3300/0 conn(0x7f039c15d1d0 0x7f039c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f039a7fc640 1 -- 172.21.15.67:0/944586343 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199747691 0 0) 0x7f039c06e3c0 con 0x7f039c0b3510 2024-09-19T05:38:12.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f039b7fe640 1 -- 172.21.15.67:0/944586343 >> v2:172.21.15.97:3300/0 conn(0x7f039c15d1d0 msgr2=0x7f039c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f039b7fe640 1 --2- 172.21.15.67:0/944586343 >> v2:172.21.15.97:3300/0 conn(0x7f039c15d1d0 0x7f039c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f039b7fe640 1 -- 172.21.15.67:0/944586343 >> v1:172.21.15.67:6789/0 conn(0x7f039c0b3510 legacy=0x7f039c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f039b7fe640 1 -- 172.21.15.67:0/944586343 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039c06ec60 con 0x7f039c15c030 2024-09-19T05:38:12.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.804+0000 7f039affd640 1 --2- 172.21.15.67:0/944586343 >> v2:172.21.15.97:3300/0 conn(0x7f039c15d1d0 0x7f039c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f039b7fe640 1 --2- 172.21.15.67:0/944586343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 0x7f039c06dde0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f039c0add20 tx=0x7f038401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fed82558470c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f039a7fc640 1 -- 172.21.15.67:0/944586343 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03840b0070 con 0x7f039c15c030 2024-09-19T05:38:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f039a7fc640 1 -- 172.21.15.67:0/944586343 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03840ab600 con 0x7f039c15c030 2024-09-19T05:38:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f039a7fc640 1 -- 172.21.15.67:0/944586343 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03840ab9d0 con 0x7f039c15c030 2024-09-19T05:38:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f03a1f68640 1 -- 172.21.15.67:0/944586343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 msgr2=0x7f039c06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f03a1f68640 1 --2- 172.21.15.67:0/944586343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 0x7f039c06dde0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f039c0add20 tx=0x7f038401c450 comp rx=0 tx=0).stop 2024-09-19T05:38:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f03a1f68640 1 -- 172.21.15.67:0/944586343 shutdown_connections 2024-09-19T05:38:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f03a1f68640 1 --2- 172.21.15.67:0/944586343 >> v2:172.21.15.97:3300/0 conn(0x7f039c15d1d0 0x7f039c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f03a1f68640 1 --2- 172.21.15.67:0/944586343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 0x7f039c06dde0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f03a1f68640 1 -- 172.21.15.67:0/944586343 >> 172.21.15.67:0/944586343 conn(0x7f039c0d0080 msgr2=0x7f039c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f03a1f68640 1 -- 172.21.15.67:0/944586343 shutdown_connections 2024-09-19T05:38:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f03a1f68640 1 -- 172.21.15.67:0/944586343 wait complete. 2024-09-19T05:38:12.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f03a1f68640 1 Processor -- start 2024-09-19T05:38:12.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.808+0000 7f03a1f68640 1 -- start start 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f03a1f68640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f039c0b3510 0x7f039c14af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f03a1f68640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 0x7f039c14bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f03a1f68640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f039c15d1d0 0x7f039c15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f03a1f68640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f039c15c590 con 0x7f039c15c030 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f03a1f68640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f039c15c410 con 0x7f039c15d1d0 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f03a1f68640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f039c1690e0 con 0x7f039c0b3510 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 0x7f039c14bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 0x7f039c14bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44376/0 (socket says 172.21.15.67:44376) 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039affd640 1 -- 172.21.15.67:0/3258664259 learned_addr learned my addr 172.21.15.67:0/3258664259 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039bfff640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f039c15d1d0 0x7f039c15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039b7fe640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f039c0b3510 0x7f039c14af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039affd640 1 -- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f039c0b3510 msgr2=0x7f039c14af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039affd640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f039c0b3510 0x7f039c14af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039affd640 1 -- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f039c15d1d0 msgr2=0x7f039c15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039affd640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f039c15d1d0 0x7f039c15a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039affd640 1 -- 172.21.15.67:0/3258664259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039c152d40 con 0x7f039c15c030 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039affd640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 0x7f039c14bea0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c7f0 tx=0x7f038c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f0393fff640 1 -- 172.21.15.67:0/3258664259 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c015070 con 0x7f039c15c030 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f0393fff640 1 -- 172.21.15.67:0/3258664259 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f038c007820 con 0x7f039c15c030 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f03a1f68640 1 -- 172.21.15.67:0/3258664259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f039c153020 con 0x7f039c15c030 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f0393fff640 1 -- 172.21.15.67:0/3258664259 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c007c10 con 0x7f039c15c030 2024-09-19T05:38:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f03a1f68640 1 -- 172.21.15.67:0/3258664259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f039c1535e0 con 0x7f039c15c030 2024-09-19T05:38:12.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f03a1f68640 1 -- 172.21.15.67:0/3258664259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f039c06dde0 con 0x7f039c15c030 2024-09-19T05:38:12.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f0393fff640 1 -- 172.21.15.67:0/3258664259 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f038c018070 con 0x7f039c15c030 2024-09-19T05:38:12.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f0393fff640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f037c0678c0 0x7f037c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f0393fff640 1 -- 172.21.15.67:0/3258664259 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7f038c085d70 con 0x7f039c15c030 2024-09-19T05:38:12.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.812+0000 7f039b7fe640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f037c0678c0 0x7f037c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.816+0000 7f039b7fe640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f037c0678c0 0x7f037c069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f03840ad000 tx=0x7f03840a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:12.820+0000 7f0393fff640 1 -- 172.21.15.67:0/3258664259 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f038c056970 con 0x7f039c15c030 2024-09-19T05:38:13.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.016+0000 7f03a1f68640 1 -- 172.21.15.67:0/3258664259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f039c0d0f20 con 0x7f039c15c030 2024-09-19T05:38:13.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.016+0000 7f0393fff640 1 -- 172.21.15.67:0/3258664259 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+3908 (secure 0 0 0) 0x7f038c056270 con 0x7f039c15c030 2024-09-19T05:38:13.022 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:13.022 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":45,"btime":"2024-09-19T05:38:05:713961+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1914909638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1914909638},{"type":"v1","addr":"172.21.15.97:6835","nonce":1914909638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3435299141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3435299141},{"type":"v1","addr":"172.21.15.97:6837","nonce":3435299141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1446292571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1446292571},{"type":"v1","addr":"172.21.15.67:6833","nonce":1446292571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6657,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/350324276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":350324276},{"type":"v1","addr":"172.21.15.67:6835","nonce":350324276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[]} 2024-09-19T05:38:13.022 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 45 2024-09-19T05:38:13.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 -- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f037c0678c0 msgr2=0x7f037c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f037c0678c0 0x7f037c069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f03840ad000 tx=0x7f03840a6000 comp rx=0 tx=0).stop 2024-09-19T05:38:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 -- 172.21.15.67:0/3258664259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 msgr2=0x7f039c14bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 0x7f039c14bea0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c7f0 tx=0x7f038c00ccb0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 -- 172.21.15.67:0/3258664259 shutdown_connections 2024-09-19T05:38:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f039c15d1d0 0x7f039c15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f039c15c030 0x7f039c14bea0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f037c0678c0 0x7f037c069d80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 --2- 172.21.15.67:0/3258664259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f039c0b3510 0x7f039c14af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 -- 172.21.15.67:0/3258664259 >> 172.21.15.67:0/3258664259 conn(0x7f039c0d0080 msgr2=0x7f039c155610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 -- 172.21.15.67:0/3258664259 shutdown_connections 2024-09-19T05:38:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.020+0000 7f03a1f68640 1 -- 172.21.15.67:0/3258664259 wait complete. 2024-09-19T05:38:13.041 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:38:13.041 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:38:13.042 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:38:13.042 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:38:13.042 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:38:13.042 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:38:13.042 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:38:13.042 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:38:13.043 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:38:13.043 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:38:13.043 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:38:13.043 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:38:13.044 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:38:13.044 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:38:13.044 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:38:13.044 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:38:13.051 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:38:13.051 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:38:13.052 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:38:13.052 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:38:13.059 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:38:13.059 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:38:13.062 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:38:13.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:38:13.096 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:38:13.096 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:13.097 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:38:13.097 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:13.111 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:38:13.111 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:13.113 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:38:13.114 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:13.114 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:38:13.162 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:38:13.162 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:38:13.181 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:38:13.184 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:38:13.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec9664a640 1 Processor -- start 2024-09-19T05:38:13.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec9664a640 1 -- start start 2024-09-19T05:38:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec9664a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fec90161da0 0x7fec900d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec9664a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fec900d0e80 0x7fec900d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec9664a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec900d4d40 con 0x7fec900b41c0 2024-09-19T05:38:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec9664a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fec900d1830 con 0x7fec90161da0 2024-09-19T05:38:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec9664a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fec900d0840 con 0x7fec900d0e80 2024-09-19T05:38:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec8ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fec90161da0 0x7fec900d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec8ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fec90161da0 0x7fec900d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44410/0 (socket says 172.21.15.67:44410) 2024-09-19T05:38:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec8ffff640 1 -- 172.21.15.67:0/4291893905 learned_addr learned my addr 172.21.15.67:0/4291893905 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:13.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec8f7fe640 1 --2- 172.21.15.67:0/4291893905 >> v2:172.21.15.97:3300/0 conn(0x7fec900d0e80 0x7fec900d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec8ffff640 1 -- 172.21.15.67:0/4291893905 >> v2:172.21.15.97:3300/0 conn(0x7fec900d0e80 msgr2=0x7fec900d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec8ffff640 1 --2- 172.21.15.67:0/4291893905 >> v2:172.21.15.97:3300/0 conn(0x7fec900d0e80 0x7fec900d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec8ffff640 1 -- 172.21.15.67:0/4291893905 >> v1:172.21.15.97:6789/0 conn(0x7fec900b41c0 legacy=0x7fec900b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec8ffff640 1 -- 172.21.15.67:0/4291893905 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec900d5020 con 0x7fec90161da0 2024-09-19T05:38:13.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec8f7fe640 1 --2- 172.21.15.67:0/4291893905 >> v2:172.21.15.97:3300/0 conn(0x7fec900d0e80 0x7fec900d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:13.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.228+0000 7fec8ffff640 1 --2- 172.21.15.67:0/4291893905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec90161da0 0x7fec900d1af0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fec900d4440 tx=0x7fec8001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c218a684be333 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8effd640 1 -- 172.21.15.67:0/4291893905 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec800b1070 con 0x7fec90161da0 2024-09-19T05:38:13.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8effd640 1 -- 172.21.15.67:0/4291893905 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec800ac630 con 0x7fec90161da0 2024-09-19T05:38:13.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8effd640 1 -- 172.21.15.67:0/4291893905 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec800a8050 con 0x7fec90161da0 2024-09-19T05:38:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- 172.21.15.67:0/4291893905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec90161da0 msgr2=0x7fec900d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 --2- 172.21.15.67:0/4291893905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec90161da0 0x7fec900d1af0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fec900d4440 tx=0x7fec8001c4e0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- 172.21.15.67:0/4291893905 shutdown_connections 2024-09-19T05:38:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 --2- 172.21.15.67:0/4291893905 >> v2:172.21.15.97:3300/0 conn(0x7fec900d0e80 0x7fec900d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 --2- 172.21.15.67:0/4291893905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec90161da0 0x7fec900d1af0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- 172.21.15.67:0/4291893905 >> 172.21.15.67:0/4291893905 conn(0x7fec9008bfc0 msgr2=0x7fec900d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- 172.21.15.67:0/4291893905 shutdown_connections 2024-09-19T05:38:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- 172.21.15.67:0/4291893905 wait complete. 2024-09-19T05:38:13.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 Processor -- start 2024-09-19T05:38:13.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- start start 2024-09-19T05:38:13.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec900b41c0 0x7fec90155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec900d0e80 0x7fec900cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec90161da0 0x7fec900b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fec90162180 con 0x7fec900b41c0 2024-09-19T05:38:13.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fec900b5d00 con 0x7fec90161da0 2024-09-19T05:38:13.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fec9016b4f0 con 0x7fec900d0e80 2024-09-19T05:38:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec900b41c0 0x7fec90155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec900b41c0 0x7fec90155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44424/0 (socket says 172.21.15.67:44424) 2024-09-19T05:38:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8ffff640 1 -- 172.21.15.67:0/2715933024 learned_addr learned my addr 172.21.15.67:0/2715933024 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8ffff640 1 -- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec900d0e80 msgr2=0x7fec900cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8ffff640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec900d0e80 0x7fec900cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8ffff640 1 -- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec90161da0 msgr2=0x7fec900b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8ffff640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec90161da0 0x7fec900b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8ffff640 1 -- 172.21.15.67:0/2715933024 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec900b9ae0 con 0x7fec900b41c0 2024-09-19T05:38:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8ffff640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec900b41c0 0x7fec90155090 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fec800af040 tx=0x7fec80019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8cff9640 1 -- 172.21.15.67:0/2715933024 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec800b1040 con 0x7fec900b41c0 2024-09-19T05:38:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8cff9640 1 -- 172.21.15.67:0/2715933024 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec800bb070 con 0x7fec900b41c0 2024-09-19T05:38:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec8cff9640 1 -- 172.21.15.67:0/2715933024 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec800a8040 con 0x7fec900b41c0 2024-09-19T05:38:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- 172.21.15.67:0/2715933024 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec900b7360 con 0x7fec900b41c0 2024-09-19T05:38:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.232+0000 7fec9664a640 1 -- 172.21.15.67:0/2715933024 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901555d0 con 0x7fec900b41c0 2024-09-19T05:38:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.236+0000 7fec9664a640 1 -- 172.21.15.67:0/2715933024 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec900d12f0 con 0x7fec900b41c0 2024-09-19T05:38:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.236+0000 7fec8cff9640 1 -- 172.21.15.67:0/2715933024 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec800ac4f0 con 0x7fec900b41c0 2024-09-19T05:38:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.236+0000 7fec8cff9640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec7c0678c0 0x7fec7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.236+0000 7fec8cff9640 1 -- 172.21.15.67:0/2715933024 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5507+0+0 (secure 0 0 0) 0x7fec8011f9c0 con 0x7fec900b41c0 2024-09-19T05:38:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.236+0000 7fec8f7fe640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec7c0678c0 0x7fec7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.236+0000 7fec8f7fe640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec7c0678c0 0x7fec7c069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fec900c7af0 tx=0x7fec84008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.240+0000 7fec8cff9640 1 -- 172.21.15.67:0/2715933024 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fec80121e20 con 0x7fec900b41c0 2024-09-19T05:38:13.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-19T05:38:13.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-19T05:38:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:13.416+0000 7fec9664a640 1 -- 172.21.15.67:0/2715933024 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fec900b7a20 con 0x7fec900b41c0 2024-09-19T05:38:14.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.088+0000 7fec8cff9640 1 -- 172.21.15.67:0/2715933024 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v79) ==== 97+0+0 (secure 0 0 0) 0x7fec800160d0 con 0x7fec900b41c0 2024-09-19T05:38:14.095 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:38:14.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 -- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec7c0678c0 msgr2=0x7fec7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec7c0678c0 0x7fec7c069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fec900c7af0 tx=0x7fec84008040 comp rx=0 tx=0).stop 2024-09-19T05:38:14.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 -- 172.21.15.67:0/2715933024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec900b41c0 msgr2=0x7fec90155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec900b41c0 0x7fec90155090 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fec800af040 tx=0x7fec80019280 comp rx=0 tx=0).stop 2024-09-19T05:38:14.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 -- 172.21.15.67:0/2715933024 shutdown_connections 2024-09-19T05:38:14.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec90161da0 0x7fec900b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec7c0678c0 0x7fec7c069d80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec900d0e80 0x7fec900cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 --2- 172.21.15.67:0/2715933024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec900b41c0 0x7fec90155090 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 -- 172.21.15.67:0/2715933024 >> 172.21.15.67:0/2715933024 conn(0x7fec9008bfc0 msgr2=0x7fec9006e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 -- 172.21.15.67:0/2715933024 shutdown_connections 2024-09-19T05:38:14.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.096+0000 7fec9664a640 1 -- 172.21.15.67:0/2715933024 wait complete. 2024-09-19T05:38:14.121 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:38:14.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6fa78640 1 Processor -- start 2024-09-19T05:38:14.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6fa78640 1 -- start start 2024-09-19T05:38:14.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6fa78640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fee6815b1e0 0x7fee680b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6fa78640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee680b4900 0x7fee68071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6fa78640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee680b3860 con 0x7fee680723c0 2024-09-19T05:38:14.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6fa78640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fee6815b5c0 con 0x7fee6815b1e0 2024-09-19T05:38:14.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6fa78640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fee680b3b40 con 0x7fee680b4900 2024-09-19T05:38:14.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6e015640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fee680723c0 0x7fee6815ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36810/0 (socket says 172.21.15.67:36810) 2024-09-19T05:38:14.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6e015640 1 -- 172.21.15.67:0/1163453462 learned_addr learned my addr 172.21.15.67:0/1163453462 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6d814640 1 --2- 172.21.15.67:0/1163453462 >> v2:172.21.15.97:3300/0 conn(0x7fee6815b1e0 0x7fee680b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6d013640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee680b4900 0x7fee68071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4105879909 0 0) 0x7fee680b3860 con 0x7fee680723c0 2024-09-19T05:38:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee54003530 con 0x7fee680723c0 2024-09-19T05:38:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1073929081 0 0) 0x7fee54003530 con 0x7fee680723c0 2024-09-19T05:38:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee680b4900 msgr2=0x7fee68071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee680b4900 0x7fee68071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 >> v2:172.21.15.97:3300/0 conn(0x7fee6815b1e0 msgr2=0x7fee680b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 --2- 172.21.15.67:0/1163453462 >> v2:172.21.15.97:3300/0 conn(0x7fee6815b1e0 0x7fee680b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee680b3e20 con 0x7fee680723c0 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fee60001a00 con 0x7fee680723c0 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 >> v1:172.21.15.67:6789/0 conn(0x7fee680723c0 legacy=0x7fee6815ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee680b4900 0x7fee540039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 0x7fee54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee54004d50 0x7fee540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fee6815b5c0 con 0x7fee54003f40 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fee680b3b40 con 0x7fee54004d50 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fee5400b9d0 con 0x7fee680b4900 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6d013640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 0x7fee54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6e015640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee54004d50 0x7fee540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6d814640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee680b4900 0x7fee540039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6d013640 1 -- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee680b4900 msgr2=0x7fee540039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6d013640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee680b4900 0x7fee540039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6d013640 1 -- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee54004d50 msgr2=0x7fee540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6d013640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee54004d50 0x7fee540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.244+0000 7fee6d013640 1 -- 172.21.15.67:0/1163453462 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee54003530 con 0x7fee54003f40 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6d013640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 0x7fee54004810 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fee64009670 tx=0x7fee6401ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cd5bfb016ec51e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee640b4070 con 0x7fee54003f40 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee640a7790 con 0x7fee54003f40 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6c812640 1 -- 172.21.15.67:0/1163453462 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee640096b0 con 0x7fee54003f40 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6fa78640 1 -- 172.21.15.67:0/1163453462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 msgr2=0x7fee54004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6fa78640 1 --2- 172.21.15.67:0/1163453462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 0x7fee54004810 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fee64009670 tx=0x7fee6401ec40 comp rx=0 tx=0).stop 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6e015640 1 -- 172.21.15.67:0/1163453462 reap_dead start 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6fa78640 1 -- 172.21.15.67:0/1163453462 shutdown_connections 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6fa78640 1 -- 172.21.15.67:0/1163453462 >> 172.21.15.67:0/1163453462 conn(0x7fee680d0080 msgr2=0x7fee680d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6fa78640 1 -- 172.21.15.67:0/1163453462 shutdown_connections 2024-09-19T05:38:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6fa78640 1 -- 172.21.15.67:0/1163453462 wait complete. 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6fa78640 1 Processor -- start 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.248+0000 7fee6fa78640 1 -- start start 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6fa78640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 0x7fee68099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6fa78640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee6814a780 0x7fee681e5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6fa78640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6814c080 0x7fee6814c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6fa78640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fee680b3510 con 0x7fee54003f40 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6fa78640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fee680b43e0 con 0x7fee6814c080 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6fa78640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fee68071e80 con 0x7fee6814a780 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d814640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 0x7fee68099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d814640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 0x7fee68099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44450/0 (socket says 172.21.15.67:44450) 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d814640 1 -- 172.21.15.67:0/3081558155 learned_addr learned my addr 172.21.15.67:0/3081558155 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6e015640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6814c080 0x7fee6814c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d013640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee6814a780 0x7fee681e5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d814640 1 -- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee6814a780 msgr2=0x7fee681e5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d814640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee6814a780 0x7fee681e5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d814640 1 -- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6814c080 msgr2=0x7fee6814c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d814640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6814c080 0x7fee6814c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d814640 1 -- 172.21.15.67:0/3081558155 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee68099eb0 con 0x7fee54003f40 2024-09-19T05:38:14.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d814640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 0x7fee68099970 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fee58011660 tx=0x7fee58011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee5e7fc640 1 -- 172.21.15.67:0/3081558155 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5800f9c0 con 0x7fee54003f40 2024-09-19T05:38:14.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee5e7fc640 1 -- 172.21.15.67:0/3081558155 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5800fb60 con 0x7fee54003f40 2024-09-19T05:38:14.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6fa78640 1 -- 172.21.15.67:0/3081558155 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee681e6410 con 0x7fee54003f40 2024-09-19T05:38:14.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee5e7fc640 1 -- 172.21.15.67:0/3081558155 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58015460 con 0x7fee54003f40 2024-09-19T05:38:14.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6fa78640 1 -- 172.21.15.67:0/3081558155 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee681e6130 con 0x7fee54003f40 2024-09-19T05:38:14.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6fa78640 1 -- 172.21.15.67:0/3081558155 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee680b2fd0 con 0x7fee54003f40 2024-09-19T05:38:14.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee5e7fc640 1 -- 172.21.15.67:0/3081558155 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee58015600 con 0x7fee54003f40 2024-09-19T05:38:14.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee5e7fc640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee4c0678f0 0x7fee4c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee5e7fc640 1 -- 172.21.15.67:0/3081558155 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5249+0+0 (secure 0 0 0) 0x7fee580864c0 con 0x7fee54003f40 2024-09-19T05:38:14.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.252+0000 7fee6d013640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee4c0678f0 0x7fee4c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.256+0000 7fee6d013640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee4c0678f0 0x7fee4c069db0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee640b1000 tx=0x7fee640046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.256+0000 7fee5e7fc640 1 -- 172.21.15.67:0/3081558155 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fee58019030 con 0x7fee54003f40 2024-09-19T05:38:14.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.480+0000 7fee6fa78640 1 -- 172.21.15.67:0/3081558155 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fee680b4e30 con 0x7fee54003f40 2024-09-19T05:38:14.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.480+0000 7fee5e7fc640 1 -- 172.21.15.67:0/3081558155 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7fee580571a0 con 0x7fee54003f40 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:38:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:38:14.489 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:38:14.489 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:38:14.489 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.489 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.489 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.489 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.489 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:38:14.489 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:38:14.489 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.489 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:38:14.490 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:38:14.490 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.490 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.490 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.490 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.490 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:38:14.490 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:38:14.490 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.490 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:38:14.490 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.491 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.492 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.492 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.492 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:38:14.492 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:38:14.492 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.493 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:38:14.493 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:38:14.493 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.493 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.493 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.493 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.493 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:38:14.493 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:38:14.493 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.494 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:38:14.494 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:38:14.494 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.494 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.494 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.494 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.494 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:38:14.494 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:38:14.495 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.495 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:38:14.495 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:38:14.495 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.495 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.495 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.495 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.495 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:38:14.496 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:38:14.496 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.496 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:38:14.496 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:38:14.496 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.496 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.496 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.496 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.497 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:38:14.498 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:38:14.499 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.501 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:38:14.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 -- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee4c0678f0 msgr2=0x7fee4c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee4c0678f0 0x7fee4c069db0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee640b1000 tx=0x7fee640046d0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 -- 172.21.15.67:0/3081558155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 msgr2=0x7fee68099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 0x7fee68099970 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fee58011660 tx=0x7fee58011b20 comp rx=0 tx=0).stop 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 -- 172.21.15.67:0/3081558155 shutdown_connections 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6814c080 0x7fee6814c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee4c0678f0 0x7fee4c069db0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee6814a780 0x7fee681e5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 --2- 172.21.15.67:0/3081558155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54003f40 0x7fee68099970 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 -- 172.21.15.67:0/3081558155 >> 172.21.15.67:0/3081558155 conn(0x7fee680d0080 msgr2=0x7fee6815f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 -- 172.21.15.67:0/3081558155 shutdown_connections 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.484+0000 7fee6fa78640 1 -- 172.21.15.67:0/3081558155 wait complete. 2024-09-19T05:38:14.506 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:38:14.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f128b465640 1 Processor -- start 2024-09-19T05:38:14.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f128b465640 1 -- start start 2024-09-19T05:38:14.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f128b465640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12840722b0 0x7f1284072740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f128b465640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12840cd810 con 0x7f128415ea90 2024-09-19T05:38:14.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f128b465640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12840cdaf0 con 0x7f1284158ce0 2024-09-19T05:38:14.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f128b465640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f12840ce420 con 0x7f12840722b0 2024-09-19T05:38:14.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f1288a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f128415ea90 0x7f12840ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36818/0 (socket says 172.21.15.67:36818) 2024-09-19T05:38:14.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f1288a00640 1 -- 172.21.15.67:0/40234686 learned_addr learned my addr 172.21.15.67:0/40234686 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:14.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f1289a02640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12840722b0 0x7f1284072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432921095 0 0) 0x7f12840cd810 con 0x7f128415ea90 2024-09-19T05:38:14.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1270003530 con 0x7f128415ea90 2024-09-19T05:38:14.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 470175881 0 0) 0x7f1270003530 con 0x7f128415ea90 2024-09-19T05:38:14.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12840722b0 msgr2=0x7f1284072740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12840722b0 0x7f1284072740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 >> v1:172.21.15.97:6789/0 conn(0x7f1284158ce0 legacy=0x7f12840cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12840cddd0 con 0x7f128415ea90 2024-09-19T05:38:14.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1274001680 con 0x7f128415ea90 2024-09-19T05:38:14.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 >> v1:172.21.15.67:6789/0 conn(0x7f128415ea90 legacy=0x7f12840ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12840722b0 0x7f1270003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.612+0000 7f127bfff640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1270003f90 0x7f1270004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f127bfff640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 0x7f12700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12840ce420 con 0x7f1270004d50 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f127000bae0 con 0x7f1270003f90 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f127000bce0 con 0x7f12840722b0 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f1289a02640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 0x7f12700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f1288a00640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1270003f90 0x7f1270004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f1289a02640 1 -- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12840722b0 msgr2=0x7f1270003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f1289a02640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12840722b0 0x7f1270003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f1289a02640 1 -- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1270003f90 msgr2=0x7f1270004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f1289a02640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1270003f90 0x7f1270004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f1289a02640 1 -- 172.21.15.67:0/40234686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1270003530 con 0x7f1270004d50 2024-09-19T05:38:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f1288a00640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1270003f90 0x7f1270004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:14.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f1289a02640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 0x7f12700051d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f127c009f70 tx=0x7f127c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24de64ac7606b4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c0b2070 con 0x7f1270004d50 2024-09-19T05:38:14.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127c0a5d50 con 0x7f1270004d50 2024-09-19T05:38:14.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f127bfff640 1 -- 172.21.15.67:0/40234686 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c009bf0 con 0x7f1270004d50 2024-09-19T05:38:14.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f128b465640 1 -- 172.21.15.67:0/40234686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 msgr2=0x7f12700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f128b465640 1 --2- 172.21.15.67:0/40234686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 0x7f12700051d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f127c009f70 tx=0x7f127c01cc80 comp rx=0 tx=0).stop 2024-09-19T05:38:14.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f1289a02640 1 -- 172.21.15.67:0/40234686 reap_dead start 2024-09-19T05:38:14.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f128b465640 1 -- 172.21.15.67:0/40234686 shutdown_connections 2024-09-19T05:38:14.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f128b465640 1 -- 172.21.15.67:0/40234686 >> 172.21.15.67:0/40234686 conn(0x7f128406bcc0 msgr2=0x7f128406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f128b465640 1 -- 172.21.15.67:0/40234686 shutdown_connections 2024-09-19T05:38:14.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.616+0000 7f128b465640 1 -- 172.21.15.67:0/40234686 wait complete. 2024-09-19T05:38:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 Processor -- start 2024-09-19T05:38:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 -- start start 2024-09-19T05:38:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 0x7f12841523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1284158360 0x7f1284146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1284156aa0 0x7f1284160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12840728c0 con 0x7f1270004d50 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1284072740 con 0x7f1284158360 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1284072a40 con 0x7f1284156aa0 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1289201640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 0x7f12841523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1289201640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 0x7f12841523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44464/0 (socket says 172.21.15.67:44464) 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1289201640 1 -- 172.21.15.67:0/119350279 learned_addr learned my addr 172.21.15.67:0/119350279 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1289201640 1 -- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1284156aa0 msgr2=0x7f1284160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1289201640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1284156aa0 0x7f1284160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1289201640 1 -- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1284158360 msgr2=0x7f1284146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1289201640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1284158360 0x7f1284146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1289201640 1 -- 172.21.15.67:0/119350279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1284146560 con 0x7f1270004d50 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1289201640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 0x7f12841523b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f128000c500 tx=0x7f128000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1279ffb640 1 -- 172.21.15.67:0/119350279 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12800052d0 con 0x7f1270004d50 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1279ffb640 1 -- 172.21.15.67:0/119350279 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1280005470 con 0x7f1270004d50 2024-09-19T05:38:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 -- 172.21.15.67:0/119350279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12841575a0 con 0x7f1270004d50 2024-09-19T05:38:14.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1279ffb640 1 -- 172.21.15.67:0/119350279 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280012870 con 0x7f1270004d50 2024-09-19T05:38:14.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 -- 172.21.15.67:0/119350279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1284157b60 con 0x7f1270004d50 2024-09-19T05:38:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f128b465640 1 -- 172.21.15.67:0/119350279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128406cc50 con 0x7f1270004d50 2024-09-19T05:38:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.620+0000 7f1279ffb640 1 -- 172.21.15.67:0/119350279 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1280012a10 con 0x7f1270004d50 2024-09-19T05:38:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.624+0000 7f1279ffb640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f12680678f0 0x7f1268069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.624+0000 7f1279ffb640 1 -- 172.21.15.67:0/119350279 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5249+0+0 (secure 0 0 0) 0x7f1280085600 con 0x7f1270004d50 2024-09-19T05:38:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.624+0000 7f1288a00640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f12680678f0 0x7f1268069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.624+0000 7f1288a00640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f12680678f0 0x7f1268069db0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1274001210 tx=0x7f1274009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.628+0000 7f1279ffb640 1 -- 172.21.15.67:0/119350279 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1280056390 con 0x7f1270004d50 2024-09-19T05:38:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.792+0000 7f128b465640 1 -- 172.21.15.67:0/119350279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f12841547a0 con 0x7f1270004d50 2024-09-19T05:38:14.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f1279ffb640 1 -- 172.21.15.67:0/119350279 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f1280055c90 con 0x7f1270004d50 2024-09-19T05:38:14.799 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:14.799 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:38:14.799 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:38:14.799 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:38:14.800 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:38:14.800 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:14.800 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:38:14.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 -- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f12680678f0 msgr2=0x7f1268069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f12680678f0 0x7f1268069db0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1274001210 tx=0x7f1274009040 comp rx=0 tx=0).stop 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 -- 172.21.15.67:0/119350279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 msgr2=0x7f12841523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 0x7f12841523b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f128000c500 tx=0x7f128000c9c0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 -- 172.21.15.67:0/119350279 shutdown_connections 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f12680678f0 0x7f1268069db0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1284156aa0 0x7f1284160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1284158360 0x7f1284146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 --2- 172.21.15.67:0/119350279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1270004d50 0x7f12841523b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 -- 172.21.15.67:0/119350279 >> 172.21.15.67:0/119350279 conn(0x7f128406bcc0 msgr2=0x7f12840b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 -- 172.21.15.67:0/119350279 shutdown_connections 2024-09-19T05:38:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.796+0000 7f128b465640 1 -- 172.21.15.67:0/119350279 wait complete. 2024-09-19T05:38:14.819 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:38:14.819 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:38:14.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a35a0c640 1 Processor -- start 2024-09-19T05:38:14.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a35a0c640 1 -- start start 2024-09-19T05:38:14.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a35a0c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a300738b0 0x7f4a3015c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a35a0c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4a300aee00 0x7f4a300d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a35a0c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a300b4e00 con 0x7f4a300d0520 2024-09-19T05:38:14.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a35a0c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4a300d0ea0 con 0x7f4a300aee00 2024-09-19T05:38:14.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a35a0c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3015c5c0 con 0x7f4a300738b0 2024-09-19T05:38:14.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2e7fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4a300d0520 0x7f4a3015ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36826/0 (socket says 172.21.15.67:36826) 2024-09-19T05:38:14.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2e7fc640 1 -- 172.21.15.67:0/892869722 learned_addr learned my addr 172.21.15.67:0/892869722 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:14.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2effd640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a300738b0 0x7f4a3015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89981611 0 0) 0x7f4a300b4e00 con 0x7f4a300d0520 2024-09-19T05:38:14.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2f7fe640 1 --2- 172.21.15.67:0/892869722 >> v2:172.21.15.97:3300/0 conn(0x7f4a300aee00 0x7f4a300d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a18005740 con 0x7f4a300d0520 2024-09-19T05:38:14.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 823116766 0 0) 0x7f4a18005740 con 0x7f4a300d0520 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a300738b0 msgr2=0x7f4a3015c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a300738b0 0x7f4a3015c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 >> v2:172.21.15.97:3300/0 conn(0x7f4a300aee00 msgr2=0x7f4a300d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 --2- 172.21.15.67:0/892869722 >> v2:172.21.15.97:3300/0 conn(0x7f4a300aee00 0x7f4a300d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a300b3500 con 0x7f4a300d0520 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f4a20001680 con 0x7f4a300d0520 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 >> v1:172.21.15.67:6789/0 conn(0x7f4a300d0520 legacy=0x7f4a3015ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a18005bd0 0x7f4a18005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a18006a20 0x7f4a18006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a300738b0 0x7f4a180073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300d0ea0 con 0x7f4a18006a20 2024-09-19T05:38:14.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3015c5c0 con 0x7f4a18005bd0 2024-09-19T05:38:14.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1800dbe0 con 0x7f4a300738b0 2024-09-19T05:38:14.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2e7fc640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a18006a20 0x7f4a18006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2effd640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a18005bd0 0x7f4a18005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2f7fe640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a300738b0 0x7f4a180073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2e7fc640 1 -- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a300738b0 msgr2=0x7f4a180073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2e7fc640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a300738b0 0x7f4a180073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2e7fc640 1 -- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a18005bd0 msgr2=0x7f4a18005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2e7fc640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a18005bd0 0x7f4a18005ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2e7fc640 1 -- 172.21.15.67:0/892869722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a18005740 con 0x7f4a18006a20 2024-09-19T05:38:14.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.936+0000 7f4a2f7fe640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a300738b0 0x7f4a180073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a2e7fc640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a18006a20 0x7f4a18006ea0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000c210 tx=0x7f4a2001f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804425d2730fb3d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20007d60 con 0x7f4a18006a20 2024-09-19T05:38:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a20005ae0 con 0x7f4a18006a20 2024-09-19T05:38:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a2dffb640 1 -- 172.21.15.67:0/892869722 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20007070 con 0x7f4a18006a20 2024-09-19T05:38:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a35a0c640 1 -- 172.21.15.67:0/892869722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a18006a20 msgr2=0x7f4a18006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a35a0c640 1 --2- 172.21.15.67:0/892869722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a18006a20 0x7f4a18006ea0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000c210 tx=0x7f4a2001f3f0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a2f7fe640 1 -- 172.21.15.67:0/892869722 reap_dead start 2024-09-19T05:38:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a35a0c640 1 -- 172.21.15.67:0/892869722 shutdown_connections 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a35a0c640 1 -- 172.21.15.67:0/892869722 >> 172.21.15.67:0/892869722 conn(0x7f4a3006c0c0 msgr2=0x7f4a3006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a35a0c640 1 -- 172.21.15.67:0/892869722 shutdown_connections 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a35a0c640 1 -- 172.21.15.67:0/892869722 wait complete. 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a35a0c640 1 Processor -- start 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.940+0000 7f4a35a0c640 1 -- start start 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a35a0c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a18006a20 0x7f4a300cf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a35a0c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a301f42b0 0x7f4a3015cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a35a0c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a30157290 0x7f4a30157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a35a0c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300b3da0 con 0x7f4a301f42b0 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a35a0c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300b3ac0 con 0x7f4a18006a20 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a35a0c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4a300b4080 con 0x7f4a30157290 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a301f42b0 0x7f4a3015cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a301f42b0 0x7f4a3015cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44482/0 (socket says 172.21.15.67:44482) 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2e7fc640 1 -- 172.21.15.67:0/1510075684 learned_addr learned my addr 172.21.15.67:0/1510075684 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2effd640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a18006a20 0x7f4a300cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2f7fe640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a30157290 0x7f4a30157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2e7fc640 1 -- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a30157290 msgr2=0x7f4a30157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2e7fc640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a30157290 0x7f4a30157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2e7fc640 1 -- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a18006a20 msgr2=0x7f4a300cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2e7fc640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a18006a20 0x7f4a300cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2e7fc640 1 -- 172.21.15.67:0/1510075684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a301f11f0 con 0x7f4a301f42b0 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2e7fc640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a301f42b0 0x7f4a3015cb10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4a20001980 tx=0x7f4a18007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a17fff640 1 -- 172.21.15.67:0/1510075684 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20005d50 con 0x7f4a301f42b0 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a17fff640 1 -- 172.21.15.67:0/1510075684 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a200047f0 con 0x7f4a301f42b0 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a35a0c640 1 -- 172.21.15.67:0/1510075684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a30157c50 con 0x7f4a301f42b0 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a17fff640 1 -- 172.21.15.67:0/1510075684 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20004be0 con 0x7f4a301f42b0 2024-09-19T05:38:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a35a0c640 1 -- 172.21.15.67:0/1510075684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a301f0430 con 0x7f4a301f42b0 2024-09-19T05:38:14.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a35a0c640 1 -- 172.21.15.67:0/1510075684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a30073c90 con 0x7f4a301f42b0 2024-09-19T05:38:14.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a17fff640 1 -- 172.21.15.67:0/1510075684 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a200ba030 con 0x7f4a301f42b0 2024-09-19T05:38:14.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a17fff640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a1c0678f0 0x7f4a1c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a17fff640 1 -- 172.21.15.67:0/1510075684 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5249+0+0 (secure 0 0 0) 0x7f4a20122900 con 0x7f4a301f42b0 2024-09-19T05:38:14.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.944+0000 7f4a2effd640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a1c0678f0 0x7f4a1c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.948+0000 7f4a2effd640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a1c0678f0 0x7f4a1c069db0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4a24009950 tx=0x7f4a24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:14.948+0000 7f4a17fff640 1 -- 172.21.15.67:0/1510075684 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4a200c1030 con 0x7f4a301f42b0 2024-09-19T05:38:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:15.120+0000 7f4a35a0c640 1 -- 172.21.15.67:0/1510075684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4a30073100 con 0x7f4a301f42b0 2024-09-19T05:38:16.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.096+0000 7f4a17fff640 1 -- 172.21.15.67:0/1510075684 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f4a30157c50 con 0x7f4a301f42b0 2024-09-19T05:38:16.099 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:38:16.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 -- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a1c0678f0 msgr2=0x7f4a1c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:16.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a1c0678f0 0x7f4a1c069db0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4a24009950 tx=0x7f4a24008040 comp rx=0 tx=0).stop 2024-09-19T05:38:16.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 -- 172.21.15.67:0/1510075684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a301f42b0 msgr2=0x7f4a3015cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:16.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a301f42b0 0x7f4a3015cb10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4a20001980 tx=0x7f4a18007a50 comp rx=0 tx=0).stop 2024-09-19T05:38:16.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 -- 172.21.15.67:0/1510075684 shutdown_connections 2024-09-19T05:38:16.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4a1c0678f0 0x7f4a1c069db0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:16.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a30157290 0x7f4a30157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:16.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a301f42b0 0x7f4a3015cb10 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:16.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 --2- 172.21.15.67:0/1510075684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a18006a20 0x7f4a300cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:16.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 -- 172.21.15.67:0/1510075684 >> 172.21.15.67:0/1510075684 conn(0x7f4a3006c0c0 msgr2=0x7f4a301582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:16.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 -- 172.21.15.67:0/1510075684 shutdown_connections 2024-09-19T05:38:16.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.100+0000 7f4a35a0c640 1 -- 172.21.15.67:0/1510075684 wait complete. 2024-09-19T05:38:16.129 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:38:16.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.260+0000 7f6055067640 1 Processor -- start 2024-09-19T05:38:16.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.260+0000 7f6055067640 1 -- start start 2024-09-19T05:38:16.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.260+0000 7f6055067640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f605006ffd0 0x7f60500aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:16.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.260+0000 7f6055067640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60500b3150 0x7f60500af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:16.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.260+0000 7f6055067640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60500ad840 con 0x7f6050159c60 2024-09-19T05:38:16.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.260+0000 7f6055067640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f60500af710 con 0x7f605006ffd0 2024-09-19T05:38:16.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.260+0000 7f6055067640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f605015d460 con 0x7f60500b3150 2024-09-19T05:38:16.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.260+0000 7f604ed9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6050159c60 0x7f60500ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44680/0 (socket says 172.21.15.67:44680) 2024-09-19T05:38:16.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.260+0000 7f604ed9d640 1 -- 172.21.15.67:0/2243648327 learned_addr learned my addr 172.21.15.67:0/2243648327 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:16.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604e59c640 1 --2- 172.21.15.67:0/2243648327 >> v2:172.21.15.97:3300/0 conn(0x7f605006ffd0 0x7f60500aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:16.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604f59e640 1 --2- 172.21.15.67:0/2243648327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60500b3150 0x7f60500af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:16.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604dd9b640 1 -- 172.21.15.67:0/2243648327 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3541247233 0 0) 0x7f60500ad840 con 0x7f6050159c60 2024-09-19T05:38:16.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604dd9b640 1 -- 172.21.15.67:0/2243648327 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6038003530 con 0x7f6050159c60 2024-09-19T05:38:16.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604dd9b640 1 -- 172.21.15.67:0/2243648327 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1424467133 0 0) 0x7f6038003530 con 0x7f6050159c60 2024-09-19T05:38:16.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604e59c640 1 -- 172.21.15.67:0/2243648327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60500b3150 msgr2=0x7f60500af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:16.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604e59c640 1 --2- 172.21.15.67:0/2243648327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60500b3150 0x7f60500af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:16.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604e59c640 1 -- 172.21.15.67:0/2243648327 >> v1:172.21.15.67:6789/0 conn(0x7f6050159c60 legacy=0x7f60500ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:16.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604e59c640 1 -- 172.21.15.67:0/2243648327 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605015a040 con 0x7f605006ffd0 2024-09-19T05:38:16.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604e59c640 1 --2- 172.21.15.67:0/2243648327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f605006ffd0 0x7f60500aec90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f60440097c0 tx=0x7f604401c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b035c75c75fe9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:16.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604dd9b640 1 -- 172.21.15.67:0/2243648327 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60440b0070 con 0x7f605006ffd0 2024-09-19T05:38:16.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604dd9b640 1 -- 172.21.15.67:0/2243648327 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60440ab400 con 0x7f605006ffd0 2024-09-19T05:38:16.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.264+0000 7f604dd9b640 1 -- 172.21.15.67:0/2243648327 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040001680 con 0x7f605006ffd0 2024-09-19T05:38:16.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- 172.21.15.67:0/2243648327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f605006ffd0 msgr2=0x7f60500aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:16.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 --2- 172.21.15.67:0/2243648327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f605006ffd0 0x7f60500aec90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f60440097c0 tx=0x7f604401c390 comp rx=0 tx=0).stop 2024-09-19T05:38:16.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- 172.21.15.67:0/2243648327 shutdown_connections 2024-09-19T05:38:16.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 --2- 172.21.15.67:0/2243648327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f60500b3150 0x7f60500af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:16.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 --2- 172.21.15.67:0/2243648327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f605006ffd0 0x7f60500aec90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:16.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- 172.21.15.67:0/2243648327 >> 172.21.15.67:0/2243648327 conn(0x7f60500b1e50 msgr2=0x7f60500b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:16.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- 172.21.15.67:0/2243648327 shutdown_connections 2024-09-19T05:38:16.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- 172.21.15.67:0/2243648327 wait complete. 2024-09-19T05:38:16.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 Processor -- start 2024-09-19T05:38:16.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- start start 2024-09-19T05:38:16.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f605006ffd0 0x7f605015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60500b3150 0x7f605015e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6050159c60 0x7f605014c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f60501605d0 con 0x7f60500b3150 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f605015d0f0 con 0x7f6050159c60 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6050160750 con 0x7f605006ffd0 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60500b3150 0x7f605015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60500b3150 0x7f605015e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56676/0 (socket says 172.21.15.67:56676) 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604e59c640 1 -- 172.21.15.67:0/3754588056 learned_addr learned my addr 172.21.15.67:0/3754588056 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604f59e640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6050159c60 0x7f605014c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604e59c640 1 -- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f605006ffd0 msgr2=0x7f605015ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604ed9d640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f605006ffd0 0x7f605015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604e59c640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f605006ffd0 0x7f605015ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:16.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604e59c640 1 -- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6050159c60 msgr2=0x7f605014c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604e59c640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6050159c60 0x7f605014c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604e59c640 1 -- 172.21.15.67:0/3754588056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605015f890 con 0x7f60500b3150 2024-09-19T05:38:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604f59e640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6050159c60 0x7f605014c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f604e59c640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60500b3150 0x7f605015e050 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6044000c10 tx=0x7f6044019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f60377fe640 1 -- 172.21.15.67:0/3754588056 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60440b0040 con 0x7f60500b3150 2024-09-19T05:38:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f60377fe640 1 -- 172.21.15.67:0/3754588056 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60440036a0 con 0x7f60500b3150 2024-09-19T05:38:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- 172.21.15.67:0/3754588056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605015f2d0 con 0x7f60500b3150 2024-09-19T05:38:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f60377fe640 1 -- 172.21.15.67:0/3754588056 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044003a50 con 0x7f60500b3150 2024-09-19T05:38:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.268+0000 7f6055067640 1 -- 172.21.15.67:0/3754588056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605015d850 con 0x7f60500b3150 2024-09-19T05:38:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.272+0000 7f6055067640 1 -- 172.21.15.67:0/3754588056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6050160b50 con 0x7f60500b3150 2024-09-19T05:38:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.272+0000 7f60377fe640 1 -- 172.21.15.67:0/3754588056 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f60440bd020 con 0x7f60500b3150 2024-09-19T05:38:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.272+0000 7f60377fe640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f603c0678f0 0x7f603c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.272+0000 7f60377fe640 1 -- 172.21.15.67:0/3754588056 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5619+0+0 (secure 0 0 0) 0x7f604411f4d0 con 0x7f60500b3150 2024-09-19T05:38:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.272+0000 7f604ed9d640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f603c0678f0 0x7f603c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.272+0000 7f604ed9d640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f603c0678f0 0x7f603c069db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f605006ea80 tx=0x7f6040009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:16.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.276+0000 7f60377fe640 1 -- 172.21.15.67:0/3754588056 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6044015fb0 con 0x7f60500b3150 2024-09-19T05:38:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:16.444+0000 7f6055067640 1 -- 172.21.15.67:0/3754588056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f605006fb10 con 0x7f60500b3150 2024-09-19T05:38:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.100+0000 7f60377fe640 1 -- 172.21.15.67:0/3754588056 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) ==== 170+0+0 (secure 0 0 0) 0x7f60440f00f0 con 0x7f60500b3150 2024-09-19T05:38:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:38:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 -- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f603c0678f0 msgr2=0x7f603c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f603c0678f0 0x7f603c069db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f605006ea80 tx=0x7f6040009040 comp rx=0 tx=0).stop 2024-09-19T05:38:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 -- 172.21.15.67:0/3754588056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60500b3150 msgr2=0x7f605015e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60500b3150 0x7f605015e050 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6044000c10 tx=0x7f6044019130 comp rx=0 tx=0).stop 2024-09-19T05:38:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 -- 172.21.15.67:0/3754588056 shutdown_connections 2024-09-19T05:38:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6050159c60 0x7f605014c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60500b3150 0x7f605015e050 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f603c0678f0 0x7f603c069db0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 --2- 172.21.15.67:0/3754588056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f605006ffd0 0x7f605015ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 -- 172.21.15.67:0/3754588056 >> 172.21.15.67:0/3754588056 conn(0x7f60500b1e50 msgr2=0x7f60500b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 -- 172.21.15.67:0/3754588056 shutdown_connections 2024-09-19T05:38:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.104+0000 7f6055067640 1 -- 172.21.15.67:0/3754588056 wait complete. 2024-09-19T05:38:17.149 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:38:17.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d36b3640 1 Processor -- start 2024-09-19T05:38:17.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d36b3640 1 -- start start 2024-09-19T05:38:17.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d36b3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc15b1d0 0x7f89cc0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:17.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d36b3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f89cc070070 0x7f89cc0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:17.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d36b3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc0aef30 con 0x7f89cc06dfc0 2024-09-19T05:38:17.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d36b3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f89cc072210 con 0x7f89cc070070 2024-09-19T05:38:17.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d36b3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc0ae0f0 con 0x7f89cc15b1d0 2024-09-19T05:38:17.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d0c4e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f89cc06dfc0 0x7f89cc06f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44682/0 (socket says 172.21.15.67:44682) 2024-09-19T05:38:17.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d0c4e640 1 -- 172.21.15.67:0/3030613681 learned_addr learned my addr 172.21.15.67:0/3030613681 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d1c50640 1 --2- 172.21.15.67:0/3030613681 >> v2:172.21.15.97:3300/0 conn(0x7f89cc070070 0x7f89cc0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d144f640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc15b1d0 0x7f89cc0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547742253 0 0) 0x7f89cc0aef30 con 0x7f89cc06dfc0 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b8005740 con 0x7f89cc06dfc0 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1286380 0 0) 0x7f89b8005740 con 0x7f89cc06dfc0 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc15b1d0 msgr2=0x7f89cc0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc15b1d0 0x7f89cc0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 >> v2:172.21.15.97:3300/0 conn(0x7f89cc070070 msgr2=0x7f89cc0b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 --2- 172.21.15.67:0/3030613681 >> v2:172.21.15.97:3300/0 conn(0x7f89cc070070 0x7f89cc0b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc0ae3b0 con 0x7f89cc06dfc0 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f89bc001680 con 0x7f89cc06dfc0 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 >> v1:172.21.15.67:6789/0 conn(0x7f89cc06dfc0 legacy=0x7f89cc06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89b8005bd0 0x7f89b8005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:17.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc15b1d0 0x7f89b8006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b8006f60 0x7f89b80073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc072210 con 0x7f89b8006f60 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc0ae0f0 con 0x7f89b8005bd0 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f89b800dbe0 con 0x7f89cc15b1d0 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d1c50640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b8006f60 0x7f89b80073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d0c4e640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc15b1d0 0x7f89b8006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d144f640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89b8005bd0 0x7f89b8005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d1c50640 1 -- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc15b1d0 msgr2=0x7f89b8006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d1c50640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc15b1d0 0x7f89b8006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d1c50640 1 -- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89b8005bd0 msgr2=0x7f89b8005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d1c50640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89b8005bd0 0x7f89b8005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.268+0000 7f89d1c50640 1 -- 172.21.15.67:0/3030613681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b8005740 con 0x7f89b8006f60 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89d1c50640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b8006f60 0x7f89b80073e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009f90 tx=0x7f89c401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e3607b0c1a3654 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c40b2070 con 0x7f89b8006f60 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c40a5c90 con 0x7f89b8006f60 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89c3fff640 1 -- 172.21.15.67:0/3030613681 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4009c10 con 0x7f89b8006f60 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89d36b3640 1 -- 172.21.15.67:0/3030613681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b8006f60 msgr2=0x7f89b80073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89d36b3640 1 --2- 172.21.15.67:0/3030613681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b8006f60 0x7f89b80073e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009f90 tx=0x7f89c401cc80 comp rx=0 tx=0).stop 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89d1c50640 1 -- 172.21.15.67:0/3030613681 reap_dead start 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89d36b3640 1 -- 172.21.15.67:0/3030613681 shutdown_connections 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89d36b3640 1 -- 172.21.15.67:0/3030613681 >> 172.21.15.67:0/3030613681 conn(0x7f89cc0b1e50 msgr2=0x7f89cc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89d36b3640 1 -- 172.21.15.67:0/3030613681 shutdown_connections 2024-09-19T05:38:17.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89d36b3640 1 -- 172.21.15.67:0/3030613681 wait complete. 2024-09-19T05:38:17.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89d36b3640 1 Processor -- start 2024-09-19T05:38:17.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.272+0000 7f89d36b3640 1 -- start start 2024-09-19T05:38:17.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d36b3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89b8006f60 0x7f89cc15d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:17.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d36b3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc14c7a0 0x7f89cc072e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:17.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d36b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89cc14abd0 0x7f89cc14b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:17.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d36b3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc0aec50 con 0x7f89cc14abd0 2024-09-19T05:38:17.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d36b3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc0ae970 con 0x7f89b8006f60 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d36b3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc072420 con 0x7f89cc14c7a0 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d1c50640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89cc14abd0 0x7f89cc14b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d1c50640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89cc14abd0 0x7f89cc14b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56686/0 (socket says 172.21.15.67:56686) 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d1c50640 1 -- 172.21.15.67:0/489104813 learned_addr learned my addr 172.21.15.67:0/489104813 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d1c50640 1 -- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc14c7a0 msgr2=0x7f89cc072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d1c50640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc14c7a0 0x7f89cc072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d1c50640 1 -- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89b8006f60 msgr2=0x7f89cc15d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d144f640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89b8006f60 0x7f89cc15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d1c50640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89b8006f60 0x7f89cc15d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d1c50640 1 -- 172.21.15.67:0/489104813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc14ddb0 con 0x7f89cc14abd0 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d1c50640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89cc14abd0 0x7f89cc14b050 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f89c4002240 tx=0x7f89c4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89c1ffb640 1 -- 172.21.15.67:0/489104813 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c40b2040 con 0x7f89cc14abd0 2024-09-19T05:38:17.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89c1ffb640 1 -- 172.21.15.67:0/489104813 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c40bc070 con 0x7f89cc14abd0 2024-09-19T05:38:17.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d36b3640 1 -- 172.21.15.67:0/489104813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc14cd10 con 0x7f89cc14abd0 2024-09-19T05:38:17.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89c1ffb640 1 -- 172.21.15.67:0/489104813 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c40aeb60 con 0x7f89cc14abd0 2024-09-19T05:38:17.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d36b3640 1 -- 172.21.15.67:0/489104813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89cc14d2d0 con 0x7f89cc14abd0 2024-09-19T05:38:17.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d36b3640 1 -- 172.21.15.67:0/489104813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89cc068530 con 0x7f89cc14abd0 2024-09-19T05:38:17.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89c1ffb640 1 -- 172.21.15.67:0/489104813 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f89c40aed00 con 0x7f89cc14abd0 2024-09-19T05:38:17.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89c1ffb640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89b00678f0 0x7f89b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:17.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89c1ffb640 1 -- 172.21.15.67:0/489104813 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6001+0+0 (secure 0 0 0) 0x7f89c4120890 con 0x7f89cc14abd0 2024-09-19T05:38:17.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.276+0000 7f89d144f640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89b00678f0 0x7f89b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:17.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.280+0000 7f89d144f640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89b00678f0 0x7f89b0069db0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f89c80098f0 tx=0x7f89c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:17.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.284+0000 7f89c1ffb640 1 -- 172.21.15.67:0/489104813 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f89c4016990 con 0x7f89cc14abd0 2024-09-19T05:38:17.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:17.476+0000 7f89d36b3640 1 -- 172.21.15.67:0/489104813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f89cc0aef30 con 0x7f89cc14abd0 2024-09-19T05:38:18.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.152+0000 7f89c1ffb640 1 -- 172.21.15.67:0/489104813 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v48) ==== 174+0+0 (secure 0 0 0) 0x7f89c40f1330 con 0x7f89cc14abd0 2024-09-19T05:38:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 11 and data pool 12 2024-09-19T05:38:18.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 -- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89b00678f0 msgr2=0x7f89b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89b00678f0 0x7f89b0069db0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f89c80098f0 tx=0x7f89c8008040 comp rx=0 tx=0).stop 2024-09-19T05:38:18.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 -- 172.21.15.67:0/489104813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89cc14abd0 msgr2=0x7f89cc14b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89cc14abd0 0x7f89cc14b050 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f89c4002240 tx=0x7f89c4009750 comp rx=0 tx=0).stop 2024-09-19T05:38:18.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 -- 172.21.15.67:0/489104813 shutdown_connections 2024-09-19T05:38:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89cc14abd0 0x7f89cc14b050 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89b00678f0 0x7f89b0069db0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89cc14c7a0 0x7f89cc072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 --2- 172.21.15.67:0/489104813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89b8006f60 0x7f89cc15d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 -- 172.21.15.67:0/489104813 >> 172.21.15.67:0/489104813 conn(0x7f89cc0b1e50 msgr2=0x7f89cc15ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 -- 172.21.15.67:0/489104813 shutdown_connections 2024-09-19T05:38:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.184+0000 7f89d36b3640 1 -- 172.21.15.67:0/489104813 wait complete. 2024-09-19T05:38:18.211 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:18.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.320+0000 7ff8223f2640 1 Processor -- start 2024-09-19T05:38:18.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.320+0000 7ff8223f2640 1 -- start start 2024-09-19T05:38:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff8223f2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff81c15c030 0x7ff81c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff8223f2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff81c15d1d0 0x7ff81c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff8223f2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81c06e3c0 con 0x7ff81c0b3510 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff8223f2640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff81c06e6a0 con 0x7ff81c15c030 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff8223f2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff81c06e980 con 0x7ff81c15d1d0 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff82098f640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff81c0b3510 0x7ff81c06f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44686/0 (socket says 172.21.15.67:44686) 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff81c15c030 0x7ff81c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff82098f640 1 -- 172.21.15.67:0/1503259197 learned_addr learned my addr 172.21.15.67:0/1503259197 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81b7fe640 1 --2- 172.21.15.67:0/1503259197 >> v2:172.21.15.97:3300/0 conn(0x7ff81c15d1d0 0x7ff81c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81affd640 1 -- 172.21.15.67:0/1503259197 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613649881 0 0) 0x7ff81c06e3c0 con 0x7ff81c0b3510 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81affd640 1 -- 172.21.15.67:0/1503259197 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff804003530 con 0x7ff81c0b3510 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81bfff640 1 -- 172.21.15.67:0/1503259197 >> v2:172.21.15.97:3300/0 conn(0x7ff81c15d1d0 msgr2=0x7ff81c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81bfff640 1 --2- 172.21.15.67:0/1503259197 >> v2:172.21.15.97:3300/0 conn(0x7ff81c15d1d0 0x7ff81c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81bfff640 1 -- 172.21.15.67:0/1503259197 >> v1:172.21.15.67:6789/0 conn(0x7ff81c0b3510 legacy=0x7ff81c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81bfff640 1 -- 172.21.15.67:0/1503259197 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c06ec60 con 0x7ff81c15c030 2024-09-19T05:38:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81bfff640 1 --2- 172.21.15.67:0/1503259197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15c030 0x7ff81c06dde0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0add20 tx=0x7ff80c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7578d1fac861e44c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81affd640 1 -- 172.21.15.67:0/1503259197 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0b0070 con 0x7ff81c15c030 2024-09-19T05:38:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81affd640 1 -- 172.21.15.67:0/1503259197 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80c0ab600 con 0x7ff81c15c030 2024-09-19T05:38:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.324+0000 7ff81affd640 1 -- 172.21.15.67:0/1503259197 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0ab9d0 con 0x7ff81c15c030 2024-09-19T05:38:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- 172.21.15.67:0/1503259197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15c030 msgr2=0x7ff81c06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 --2- 172.21.15.67:0/1503259197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15c030 0x7ff81c06dde0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0add20 tx=0x7ff80c01c450 comp rx=0 tx=0).stop 2024-09-19T05:38:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- 172.21.15.67:0/1503259197 shutdown_connections 2024-09-19T05:38:18.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 --2- 172.21.15.67:0/1503259197 >> v2:172.21.15.97:3300/0 conn(0x7ff81c15d1d0 0x7ff81c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 --2- 172.21.15.67:0/1503259197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15c030 0x7ff81c06dde0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- 172.21.15.67:0/1503259197 >> 172.21.15.67:0/1503259197 conn(0x7ff81c0d0080 msgr2=0x7ff81c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:18.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- 172.21.15.67:0/1503259197 shutdown_connections 2024-09-19T05:38:18.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- 172.21.15.67:0/1503259197 wait complete. 2024-09-19T05:38:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 Processor -- start 2024-09-19T05:38:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- start start 2024-09-19T05:38:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff81c0b3510 0x7ff81c14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff81c15c030 0x7ff81c09db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15d1d0 0x7ff81c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c15c590 con 0x7ff81c15d1d0 2024-09-19T05:38:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c15c410 con 0x7ff81c15c030 2024-09-19T05:38:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff81c1690e0 con 0x7ff81c0b3510 2024-09-19T05:38:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff82098f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15d1d0 0x7ff81c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff82098f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15d1d0 0x7ff81c15a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56714/0 (socket says 172.21.15.67:56714) 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff82098f640 1 -- 172.21.15.67:0/1232981560 learned_addr learned my addr 172.21.15.67:0/1232981560 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff81b7fe640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff81c15c030 0x7ff81c09db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff81bfff640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff81c0b3510 0x7ff81c14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff82098f640 1 -- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff81c0b3510 msgr2=0x7ff81c14ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff82098f640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff81c0b3510 0x7ff81c14ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff82098f640 1 -- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff81c15c030 msgr2=0x7ff81c09db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff82098f640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff81c15c030 0x7ff81c09db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff82098f640 1 -- 172.21.15.67:0/1232981560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c14f130 con 0x7ff81c15d1d0 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff81b7fe640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff81c15c030 0x7ff81c09db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff81bfff640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff81c0b3510 0x7ff81c14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff82098f640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15d1d0 0x7ff81c15a230 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff81400cb40 tx=0x7ff81400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff818ff9640 1 -- 172.21.15.67:0/1232981560 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814017070 con 0x7ff81c15d1d0 2024-09-19T05:38:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff818ff9640 1 -- 172.21.15.67:0/1232981560 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81400aca0 con 0x7ff81c15d1d0 2024-09-19T05:38:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- 172.21.15.67:0/1232981560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c14e4b0 con 0x7ff81c15d1d0 2024-09-19T05:38:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff818ff9640 1 -- 172.21.15.67:0/1232981560 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814012620 con 0x7ff81c15d1d0 2024-09-19T05:38:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.328+0000 7ff8223f2640 1 -- 172.21.15.67:0/1232981560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c14ea70 con 0x7ff81c15d1d0 2024-09-19T05:38:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.332+0000 7ff8223f2640 1 -- 172.21.15.67:0/1232981560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c06dde0 con 0x7ff81c15d1d0 2024-09-19T05:38:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.332+0000 7ff818ff9640 1 -- 172.21.15.67:0/1232981560 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff81401a070 con 0x7ff81c15d1d0 2024-09-19T05:38:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.332+0000 7ff818ff9640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8080678c0 0x7ff808069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.332+0000 7ff818ff9640 1 -- 172.21.15.67:0/1232981560 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7ff814085c60 con 0x7ff81c15d1d0 2024-09-19T05:38:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.332+0000 7ff81bfff640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8080678c0 0x7ff808069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.332+0000 7ff81bfff640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8080678c0 0x7ff808069d80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0ad000 tx=0x7ff80c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.336+0000 7ff818ff9640 1 -- 172.21.15.67:0/1232981560 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff814056610 con 0x7ff81c15d1d0 2024-09-19T05:38:18.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.500+0000 7ff8223f2640 1 -- 172.21.15.67:0/1232981560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff81c0d0f20 con 0x7ff81c15d1d0 2024-09-19T05:38:18.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff818ff9640 1 -- 172.21.15.67:0/1232981560 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16982 (secure 0 0 0) 0x7ff814055f10 con 0x7ff81c15d1d0 2024-09-19T05:38:18.508 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:18.508 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":84,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:38:17.482314+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:38:15.164842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-19T05:38:16.488698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:18.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 -- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8080678c0 msgr2=0x7ff808069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8080678c0 0x7ff808069d80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0ad000 tx=0x7ff80c008040 comp rx=0 tx=0).stop 2024-09-19T05:38:18.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 -- 172.21.15.67:0/1232981560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15d1d0 msgr2=0x7ff81c15a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15d1d0 0x7ff81c15a230 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff81400cb40 tx=0x7ff81400a060 comp rx=0 tx=0).stop 2024-09-19T05:38:18.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 -- 172.21.15.67:0/1232981560 shutdown_connections 2024-09-19T05:38:18.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff81c15d1d0 0x7ff81c15a230 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff81c15c030 0x7ff81c09db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff8080678c0 0x7ff808069d80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 --2- 172.21.15.67:0/1232981560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff81c0b3510 0x7ff81c14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 -- 172.21.15.67:0/1232981560 >> 172.21.15.67:0/1232981560 conn(0x7ff81c0d0080 msgr2=0x7ff81c15efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:18.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 -- 172.21.15.67:0/1232981560 shutdown_connections 2024-09-19T05:38:18.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.504+0000 7ff8223f2640 1 -- 172.21.15.67:0/1232981560 wait complete. 2024-09-19T05:38:18.528 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:18.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21c6bfe640 1 Processor -- start 2024-09-19T05:38:18.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21c6bfe640 1 -- start start 2024-09-19T05:38:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21c6bfe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f21c01609b0 0x7f21c00b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21c6bfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21c00afee0 0x7f21c015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21c6bfe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c00b4710 con 0x7f21c015fcf0 2024-09-19T05:38:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21c6bfe640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f21c00b5cf0 con 0x7f21c01609b0 2024-09-19T05:38:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21c6bfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f21c00b49f0 con 0x7f21c00afee0 2024-09-19T05:38:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21bffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f21c01609b0 0x7f21c00b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21bffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f21c01609b0 0x7f21c00b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56716/0 (socket says 172.21.15.67:56716) 2024-09-19T05:38:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21bffff640 1 -- 172.21.15.67:0/3636168314 learned_addr learned my addr 172.21.15.67:0/3636168314 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21c519b640 1 --2- 172.21.15.67:0/3636168314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21c00afee0 0x7f21c015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21bffff640 1 -- 172.21.15.67:0/3636168314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21c00afee0 msgr2=0x7f21c015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:18.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21bffff640 1 --2- 172.21.15.67:0/3636168314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21c00afee0 0x7f21c015d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21bffff640 1 -- 172.21.15.67:0/3636168314 >> v1:172.21.15.97:6789/0 conn(0x7f21c015fcf0 legacy=0x7f21c01600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:18.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.644+0000 7f21bffff640 1 -- 172.21.15.67:0/3636168314 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c00b4cd0 con 0x7f21c01609b0 2024-09-19T05:38:18.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21bffff640 1 --2- 172.21.15.67:0/3636168314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c01609b0 0x7f21c00b57b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009870 tx=0x7f21b401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4135c2bedc33100d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21bf7fe640 1 -- 172.21.15.67:0/3636168314 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b40b1070 con 0x7f21c01609b0 2024-09-19T05:38:18.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21bf7fe640 1 -- 172.21.15.67:0/3636168314 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b40ac600 con 0x7f21c01609b0 2024-09-19T05:38:18.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21bf7fe640 1 -- 172.21.15.67:0/3636168314 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b40ac9d0 con 0x7f21c01609b0 2024-09-19T05:38:18.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 -- 172.21.15.67:0/3636168314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c01609b0 msgr2=0x7f21c00b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 --2- 172.21.15.67:0/3636168314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c01609b0 0x7f21c00b57b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009870 tx=0x7f21b401c460 comp rx=0 tx=0).stop 2024-09-19T05:38:18.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 -- 172.21.15.67:0/3636168314 shutdown_connections 2024-09-19T05:38:18.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 --2- 172.21.15.67:0/3636168314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21c00afee0 0x7f21c015d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 --2- 172.21.15.67:0/3636168314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c01609b0 0x7f21c00b57b0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 -- 172.21.15.67:0/3636168314 >> 172.21.15.67:0/3636168314 conn(0x7f21c0073500 msgr2=0x7f21c006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:18.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 -- 172.21.15.67:0/3636168314 shutdown_connections 2024-09-19T05:38:18.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 -- 172.21.15.67:0/3636168314 wait complete. 2024-09-19T05:38:18.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 Processor -- start 2024-09-19T05:38:18.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 -- start start 2024-09-19T05:38:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21c00afee0 0x7f21c014dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c015fcf0 0x7f21c01544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c01609b0 0x7f21c0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f21c015d580 con 0x7f21c015fcf0 2024-09-19T05:38:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f21c015d400 con 0x7f21c01609b0 2024-09-19T05:38:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21c6bfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f21c0168e80 con 0x7f21c00afee0 2024-09-19T05:38:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21bffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c015fcf0 0x7f21c01544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21bffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c015fcf0 0x7f21c01544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56720/0 (socket says 172.21.15.67:56720) 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.648+0000 7f21bffff640 1 -- 172.21.15.67:0/785239418 learned_addr learned my addr 172.21.15.67:0/785239418 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21c519b640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c01609b0 0x7f21c0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bffff640 1 -- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21c00afee0 msgr2=0x7f21c014dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21c499a640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21c00afee0 0x7f21c014dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bffff640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21c00afee0 0x7f21c014dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bffff640 1 -- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c01609b0 msgr2=0x7f21c0154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bffff640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c01609b0 0x7f21c0154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bffff640 1 -- 172.21.15.67:0/785239418 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c014e1e0 con 0x7f21c015fcf0 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21c519b640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c01609b0 0x7f21c0154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bffff640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c015fcf0 0x7f21c01544d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f21b401ab10 tx=0x7f21b4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bd7fa640 1 -- 172.21.15.67:0/785239418 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b40bb020 con 0x7f21c015fcf0 2024-09-19T05:38:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bd7fa640 1 -- 172.21.15.67:0/785239418 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b40b7640 con 0x7f21c015fcf0 2024-09-19T05:38:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21c6bfe640 1 -- 172.21.15.67:0/785239418 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c0155090 con 0x7f21c015fcf0 2024-09-19T05:38:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bd7fa640 1 -- 172.21.15.67:0/785239418 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b40b1040 con 0x7f21c015fcf0 2024-09-19T05:38:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21c6bfe640 1 -- 172.21.15.67:0/785239418 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c0151020 con 0x7f21c015fcf0 2024-09-19T05:38:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21c6bfe640 1 -- 172.21.15.67:0/785239418 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c015d8c0 con 0x7f21c015fcf0 2024-09-19T05:38:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bd7fa640 1 -- 172.21.15.67:0/785239418 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21b40be020 con 0x7f21c015fcf0 2024-09-19T05:38:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bd7fa640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21ac0678c0 0x7f21ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21bd7fa640 1 -- 172.21.15.67:0/785239418 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f21b411fd80 con 0x7f21c015fcf0 2024-09-19T05:38:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21c499a640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21ac0678c0 0x7f21ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.652+0000 7f21c499a640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21ac0678c0 0x7f21ac069d80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f21b0004450 tx=0x7f21b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.656+0000 7f21bd7fa640 1 -- 172.21.15.67:0/785239418 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f21b40c5070 con 0x7f21c015fcf0 2024-09-19T05:38:18.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.820+0000 7f21c6bfe640 1 -- 172.21.15.67:0/785239418 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21c006d220 con 0x7f21c015fcf0 2024-09-19T05:38:18.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21bd7fa640 1 -- 172.21.15.67:0/785239418 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16982 (secure 0 0 0) 0x7f21b4016110 con 0x7f21c015fcf0 2024-09-19T05:38:18.828 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:18.828 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":84,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:38:17.482314+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:38:15.164842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-19T05:38:16.488698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 -- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21ac0678c0 msgr2=0x7f21ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21ac0678c0 0x7f21ac069d80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f21b0004450 tx=0x7f21b0009040 comp rx=0 tx=0).stop 2024-09-19T05:38:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 -- 172.21.15.67:0/785239418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c015fcf0 msgr2=0x7f21c01544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c015fcf0 0x7f21c01544d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f21b401ab10 tx=0x7f21b4019200 comp rx=0 tx=0).stop 2024-09-19T05:38:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 -- 172.21.15.67:0/785239418 shutdown_connections 2024-09-19T05:38:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c01609b0 0x7f21c0154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21c015fcf0 0x7f21c01544d0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f21ac0678c0 0x7f21ac069d80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 --2- 172.21.15.67:0/785239418 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21c00afee0 0x7f21c014dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 -- 172.21.15.67:0/785239418 >> 172.21.15.67:0/785239418 conn(0x7f21c0073500 msgr2=0x7f21c00b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:18.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 -- 172.21.15.67:0/785239418 shutdown_connections 2024-09-19T05:38:18.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.824+0000 7f21c6bfe640 1 -- 172.21.15.67:0/785239418 wait complete. 2024-09-19T05:38:18.845 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:38:18.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f7689f55640 1 Processor -- start 2024-09-19T05:38:18.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f7689f55640 1 -- start start 2024-09-19T05:38:18.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f7689f55640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d4fb0 0x7f76840d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f7689f55640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f76840d13c0 0x7f768406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f7689f55640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76840d35a0 con 0x7f768415e690 2024-09-19T05:38:18.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f7689f55640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f76840d32c0 con 0x7f76840d13c0 2024-09-19T05:38:18.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f7689f55640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f768406d040 con 0x7f76840d4fb0 2024-09-19T05:38:18.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f767bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d4fb0 0x7f76840d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f7683fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f76840d13c0 0x7f768406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f76837fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f768415e690 0x7f76840d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:60504/0 (socket says 172.21.15.67:60504) 2024-09-19T05:38:18.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f76837fe640 1 -- 172.21.15.67:0/1625126301 learned_addr learned my addr 172.21.15.67:0/1625126301 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:18.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f7682ffd640 1 -- 172.21.15.67:0/1625126301 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808931760 0 0) 0x7f76840d35a0 con 0x7f768415e690 2024-09-19T05:38:18.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f7682ffd640 1 -- 172.21.15.67:0/1625126301 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7670003530 con 0x7f768415e690 2024-09-19T05:38:18.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f767bfff640 1 -- 172.21.15.67:0/1625126301 >> v2:172.21.15.97:3300/0 conn(0x7f76840d13c0 msgr2=0x7f768406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:18.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f767bfff640 1 --2- 172.21.15.67:0/1625126301 >> v2:172.21.15.97:3300/0 conn(0x7f76840d13c0 0x7f768406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f767bfff640 1 -- 172.21.15.67:0/1625126301 >> v1:172.21.15.97:6789/0 conn(0x7f768415e690 legacy=0x7f76840d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.968+0000 7f767bfff640 1 -- 172.21.15.67:0/1625126301 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768406d320 con 0x7f76840d4fb0 2024-09-19T05:38:18.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f767bfff640 1 --2- 172.21.15.67:0/1625126301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d4fb0 0x7f76840d0e80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f766c0097c0 tx=0x7f766c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212bb87cf60baecf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7682ffd640 1 -- 172.21.15.67:0/1625126301 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c0b0070 con 0x7f76840d4fb0 2024-09-19T05:38:18.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7682ffd640 1 -- 172.21.15.67:0/1625126301 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c0ab600 con 0x7f76840d4fb0 2024-09-19T05:38:18.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7682ffd640 1 -- 172.21.15.67:0/1625126301 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c0ab9b0 con 0x7f76840d4fb0 2024-09-19T05:38:18.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7689f55640 1 -- 172.21.15.67:0/1625126301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d4fb0 msgr2=0x7f76840d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7689f55640 1 --2- 172.21.15.67:0/1625126301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d4fb0 0x7f76840d0e80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f766c0097c0 tx=0x7f766c01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7689f55640 1 -- 172.21.15.67:0/1625126301 shutdown_connections 2024-09-19T05:38:18.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7689f55640 1 --2- 172.21.15.67:0/1625126301 >> v2:172.21.15.97:3300/0 conn(0x7f76840d13c0 0x7f768406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7689f55640 1 --2- 172.21.15.67:0/1625126301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d4fb0 0x7f76840d0e80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7689f55640 1 -- 172.21.15.67:0/1625126301 >> 172.21.15.67:0/1625126301 conn(0x7f76840d4490 msgr2=0x7f76840d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:18.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7689f55640 1 -- 172.21.15.67:0/1625126301 shutdown_connections 2024-09-19T05:38:18.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7689f55640 1 -- 172.21.15.67:0/1625126301 wait complete. 2024-09-19T05:38:18.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7689f55640 1 Processor -- start 2024-09-19T05:38:18.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.972+0000 7f7689f55640 1 -- start start 2024-09-19T05:38:18.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7689f55640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d13c0 0x7f76840b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7689f55640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76840d4fb0 0x7f768415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7689f55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768415e690 0x7f768415d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7689f55640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f768406ec00 con 0x7f76840d4fb0 2024-09-19T05:38:18.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7689f55640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f768406ea80 con 0x7f768415e690 2024-09-19T05:38:18.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7689f55640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f768416b250 con 0x7f76840d13c0 2024-09-19T05:38:18.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f767bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76840d4fb0 0x7f768415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f767bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76840d4fb0 0x7f768415cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56722/0 (socket says 172.21.15.67:56722) 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f767bfff640 1 -- 172.21.15.67:0/2020025595 learned_addr learned my addr 172.21.15.67:0/2020025595 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f76837fe640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d13c0 0x7f76840b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7683fff640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768415e690 0x7f768415d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f767bfff640 1 -- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d13c0 msgr2=0x7f76840b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f767bfff640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d13c0 0x7f76840b7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f767bfff640 1 -- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768415e690 msgr2=0x7f768415d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f767bfff640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768415e690 0x7f768415d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f767bfff640 1 -- 172.21.15.67:0/2020025595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76840d34d0 con 0x7f76840d4fb0 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f767bfff640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76840d4fb0 0x7f768415cba0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f766c0097c0 tx=0x7f766c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7680ff9640 1 -- 172.21.15.67:0/2020025595 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c0b0040 con 0x7f76840d4fb0 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7680ff9640 1 -- 172.21.15.67:0/2020025595 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c004020 con 0x7f76840d4fb0 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7689f55640 1 -- 172.21.15.67:0/2020025595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76840b9280 con 0x7f76840d4fb0 2024-09-19T05:38:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7680ff9640 1 -- 172.21.15.67:0/2020025595 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c006e20 con 0x7f76840d4fb0 2024-09-19T05:38:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7689f55640 1 -- 172.21.15.67:0/2020025595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76840b9840 con 0x7f76840d4fb0 2024-09-19T05:38:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7689f55640 1 -- 172.21.15.67:0/2020025595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76840d4910 con 0x7f76840d4fb0 2024-09-19T05:38:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7680ff9640 1 -- 172.21.15.67:0/2020025595 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f766c003620 con 0x7f76840d4fb0 2024-09-19T05:38:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7680ff9640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76640678c0 0x7f7664069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f7680ff9640 1 -- 172.21.15.67:0/2020025595 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f766c11fae0 con 0x7f76840d4fb0 2024-09-19T05:38:18.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.976+0000 7f76837fe640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76640678c0 0x7f7664069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.980+0000 7f76837fe640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76640678c0 0x7f7664069d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7674005890 tx=0x7f7674009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:18.980+0000 7f7680ff9640 1 -- 172.21.15.67:0/2020025595 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f766c0c1030 con 0x7f76840d4fb0 2024-09-19T05:38:19.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:19.188+0000 7f7689f55640 1 -- 172.21.15.67:0/2020025595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f768406db20 con 0x7f76840d4fb0 2024-09-19T05:38:19.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-19T05:38:19.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-19T05:38:20.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.168+0000 7f7680ff9640 1 -- 172.21.15.67:0/2020025595 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) ==== 118+0+0 (secure 0 0 0) 0x7f766c0b8030 con 0x7f76840d4fb0 2024-09-19T05:38:20.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 -- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76640678c0 msgr2=0x7f7664069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:20.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76640678c0 0x7f7664069d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7674005890 tx=0x7f7674009040 comp rx=0 tx=0).stop 2024-09-19T05:38:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 -- 172.21.15.67:0/2020025595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76840d4fb0 msgr2=0x7f768415cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76840d4fb0 0x7f768415cba0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f766c0097c0 tx=0x7f766c019240 comp rx=0 tx=0).stop 2024-09-19T05:38:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 -- 172.21.15.67:0/2020025595 shutdown_connections 2024-09-19T05:38:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768415e690 0x7f768415d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76840d4fb0 0x7f768415cba0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76640678c0 0x7f7664069d80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 --2- 172.21.15.67:0/2020025595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76840d13c0 0x7f76840b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 -- 172.21.15.67:0/2020025595 >> 172.21.15.67:0/2020025595 conn(0x7f76840d4490 msgr2=0x7f76840b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 -- 172.21.15.67:0/2020025595 shutdown_connections 2024-09-19T05:38:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.172+0000 7f7689f55640 1 -- 172.21.15.67:0/2020025595 wait complete. 2024-09-19T05:38:20.197 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:38:20.197 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:38:20.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bde4b7640 1 Processor -- start 2024-09-19T05:38:20.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bde4b7640 1 -- start start 2024-09-19T05:38:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bde4b7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3bd80cd110 0x7f3bd809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bde4b7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd809af70 0x7f3bd80cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bde4b7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd80cd590 con 0x7f3bd815e4b0 2024-09-19T05:38:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bde4b7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd815e890 con 0x7f3bd80cd110 2024-09-19T05:38:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bde4b7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd809b3b0 con 0x7f3bd809af70 2024-09-19T05:38:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd7fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3bd815e4b0 0x7f3bd815f420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44700/0 (socket says 172.21.15.67:44700) 2024-09-19T05:38:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd7fff640 1 -- 172.21.15.67:0/2539741611 learned_addr learned my addr 172.21.15.67:0/2539741611 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd77fe640 1 --2- 172.21.15.67:0/2539741611 >> v2:172.21.15.97:3300/0 conn(0x7f3bd80cd110 0x7f3bd809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bdca54640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd809af70 0x7f3bd80cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222936358 0 0) 0x7f3bd80cd590 con 0x7f3bd815e4b0 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bc0003530 con 0x7f3bd815e4b0 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3324861465 0 0) 0x7f3bc0003530 con 0x7f3bd815e4b0 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd809af70 msgr2=0x7f3bd80cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd809af70 0x7f3bd80cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 >> v2:172.21.15.97:3300/0 conn(0x7f3bd80cd110 msgr2=0x7f3bd809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 --2- 172.21.15.67:0/2539741611 >> v2:172.21.15.97:3300/0 conn(0x7f3bd80cd110 0x7f3bd809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd80cd870 con 0x7f3bd815e4b0 2024-09-19T05:38:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3bc8001680 con 0x7f3bd815e4b0 2024-09-19T05:38:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 >> v1:172.21.15.67:6789/0 conn(0x7f3bd815e4b0 legacy=0x7f3bd815f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd809af70 0x7f3bc00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3bc0003f40 0x7f3bc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0004d50 0x7f3bc00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd815e890 con 0x7f3bc0004d50 2024-09-19T05:38:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd809b3b0 con 0x7f3bc0003f40 2024-09-19T05:38:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc000b9d0 con 0x7f3bd809af70 2024-09-19T05:38:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd77fe640 1 --2- 172.21.15.67:0/2539741611 >> v2:172.21.15.97:3300/0 conn(0x7f3bd80cd110 0x7f3bd809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bdca54640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0004d50 0x7f3bc00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd7fff640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd809af70 0x7f3bc00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:20.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.324+0000 7f3bd77fe640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3bc0003f40 0x7f3bc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:20.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bdca54640 1 -- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd809af70 msgr2=0x7f3bc00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:20.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bdca54640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd809af70 0x7f3bc00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:20.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bdca54640 1 -- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3bc0003f40 msgr2=0x7f3bc0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:20.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bdca54640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3bc0003f40 0x7f3bc0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:20.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bdca54640 1 -- 172.21.15.67:0/2539741611 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc0003530 con 0x7f3bc0004d50 2024-09-19T05:38:20.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bdca54640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0004d50 0x7f3bc00051d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009fc0 tx=0x7f3bd001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e542f41388542bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:20.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00b2070 con 0x7f3bc0004d50 2024-09-19T05:38:20.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd00a5c90 con 0x7f3bc0004d50 2024-09-19T05:38:20.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bd6ffd640 1 -- 172.21.15.67:0/2539741611 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0009c10 con 0x7f3bc0004d50 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bde4b7640 1 -- 172.21.15.67:0/2539741611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0004d50 msgr2=0x7f3bc00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bde4b7640 1 --2- 172.21.15.67:0/2539741611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc0004d50 0x7f3bc00051d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009fc0 tx=0x7f3bd001cc20 comp rx=0 tx=0).stop 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bdca54640 1 -- 172.21.15.67:0/2539741611 reap_dead start 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bde4b7640 1 -- 172.21.15.67:0/2539741611 shutdown_connections 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bde4b7640 1 -- 172.21.15.67:0/2539741611 >> 172.21.15.67:0/2539741611 conn(0x7f3bd80d2320 msgr2=0x7f3bd80d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bde4b7640 1 -- 172.21.15.67:0/2539741611 shutdown_connections 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.328+0000 7f3bde4b7640 1 -- 172.21.15.67:0/2539741611 wait complete. 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 Processor -- start 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 -- start start 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3bd815d6a0 0x7f3bd81e9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd815da80 0x7f3bd81e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:20.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80b5360 0x7f3bd80b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80ce110 con 0x7f3bd80b5360 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80cde30 con 0x7f3bd815d6a0 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd809b7d0 con 0x7f3bd815da80 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bdca54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80b5360 0x7f3bd80b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bdca54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80b5360 0x7f3bd80b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56748/0 (socket says 172.21.15.67:56748) 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bdca54640 1 -- 172.21.15.67:0/3636362482 learned_addr learned my addr 172.21.15.67:0/3636362482 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bd7fff640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3bd815d6a0 0x7f3bd81e9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bd77fe640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd815da80 0x7f3bd81e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bdca54640 1 -- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd815da80 msgr2=0x7f3bd81e9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bdca54640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd815da80 0x7f3bd81e9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bdca54640 1 -- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3bd815d6a0 msgr2=0x7f3bd81e9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bdca54640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3bd815d6a0 0x7f3bd81e9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:20.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bdca54640 1 -- 172.21.15.67:0/3636362482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd80b6100 con 0x7f3bd80b5360 2024-09-19T05:38:20.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bdca54640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80b5360 0x7f3bd80b5810 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0002240 tx=0x7f3bd0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:20.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bd4ff9640 1 -- 172.21.15.67:0/3636362482 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00bd070 con 0x7f3bd80b5360 2024-09-19T05:38:20.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bd4ff9640 1 -- 172.21.15.67:0/3636362482 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd00a5a90 con 0x7f3bd80b5360 2024-09-19T05:38:20.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 -- 172.21.15.67:0/3636362482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd80b63e0 con 0x7f3bd80b5360 2024-09-19T05:38:20.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bd4ff9640 1 -- 172.21.15.67:0/3636362482 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00b2040 con 0x7f3bd80b5360 2024-09-19T05:38:20.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 -- 172.21.15.67:0/3636362482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd80b69a0 con 0x7f3bd80b5360 2024-09-19T05:38:20.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.332+0000 7f3bde4b7640 1 -- 172.21.15.67:0/3636362482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd80cd4f0 con 0x7f3bd80b5360 2024-09-19T05:38:20.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.336+0000 7f3bd4ff9640 1 -- 172.21.15.67:0/3636362482 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3bd00c0070 con 0x7f3bd80b5360 2024-09-19T05:38:20.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.336+0000 7f3bd4ff9640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3bc40678f0 0x7f3bc4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:20.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.336+0000 7f3bd4ff9640 1 -- 172.21.15.67:0/3636362482 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f3bd011f960 con 0x7f3bd80b5360 2024-09-19T05:38:20.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.336+0000 7f3bd7fff640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3bc40678f0 0x7f3bc4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:20.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.336+0000 7f3bd7fff640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3bc40678f0 0x7f3bc4069db0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8000c10 tx=0x7f3bc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:20.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.340+0000 7f3bd4ff9640 1 -- 172.21.15.67:0/3636362482 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3bd0016990 con 0x7f3bd80b5360 2024-09-19T05:38:20.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:20.532+0000 7f3bde4b7640 1 -- 172.21.15.67:0/3636362482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3bd80cf510 con 0x7f3bd80b5360 2024-09-19T05:38:21.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.172+0000 7f3bd4ff9640 1 -- 172.21.15.67:0/3636362482 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7f3bd00a5c60 con 0x7f3bd80b5360 2024-09-19T05:38:21.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 -- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3bc40678f0 msgr2=0x7f3bc4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3bc40678f0 0x7f3bc4069db0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8000c10 tx=0x7f3bc8009040 comp rx=0 tx=0).stop 2024-09-19T05:38:21.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 -- 172.21.15.67:0/3636362482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80b5360 msgr2=0x7f3bd80b5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80b5360 0x7f3bd80b5810 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0002240 tx=0x7f3bd0009750 comp rx=0 tx=0).stop 2024-09-19T05:38:21.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 -- 172.21.15.67:0/3636362482 shutdown_connections 2024-09-19T05:38:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80b5360 0x7f3bd80b5810 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3bc40678f0 0x7f3bc4069db0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3bd815da80 0x7f3bd81e9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 --2- 172.21.15.67:0/3636362482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3bd815d6a0 0x7f3bd81e9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 -- 172.21.15.67:0/3636362482 >> 172.21.15.67:0/3636362482 conn(0x7f3bd80d2320 msgr2=0x7f3bd80b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 -- 172.21.15.67:0/3636362482 shutdown_connections 2024-09-19T05:38:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.176+0000 7f3bde4b7640 1 -- 172.21.15.67:0/3636362482 wait complete. 2024-09-19T05:38:21.202 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:38:21.202 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:21.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a9dad640 1 Processor -- start 2024-09-19T05:38:21.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a9dad640 1 -- start start 2024-09-19T05:38:21.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a9dad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 0x7fb9a40705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a9dad640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a40c7130 con 0x7fb9a415d290 2024-09-19T05:38:21.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a9dad640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a4070b90 con 0x7fb9a409b140 2024-09-19T05:38:21.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a9dad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a4070e70 con 0x7fb9a40c8c40 2024-09-19T05:38:21.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a2ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb9a415d290 0x7fb9a409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44708/0 (socket says 172.21.15.67:44708) 2024-09-19T05:38:21.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a2ffd640 1 -- 172.21.15.67:0/3516478145 learned_addr learned my addr 172.21.15.67:0/3516478145 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:21.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a37fe640 1 --2- 172.21.15.67:0/3516478145 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 0x7fb9a40705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a27fc640 1 -- 172.21.15.67:0/3516478145 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444033543 0 0) 0x7fb9a40c7130 con 0x7fb9a415d290 2024-09-19T05:38:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a27fc640 1 -- 172.21.15.67:0/3516478145 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb98c003530 con 0x7fb9a415d290 2024-09-19T05:38:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a27fc640 1 -- 172.21.15.67:0/3516478145 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1956417876 0 0) 0x7fb9a4070b90 con 0x7fb9a409b140 2024-09-19T05:38:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a27fc640 1 -- 172.21.15.67:0/3516478145 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9a40c7130 con 0x7fb9a409b140 2024-09-19T05:38:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a27fc640 1 -- 172.21.15.67:0/3516478145 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2300995792 0 0) 0x7fb98c003530 con 0x7fb9a415d290 2024-09-19T05:38:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a37fe640 1 -- 172.21.15.67:0/3516478145 >> v1:172.21.15.97:6789/0 conn(0x7fb9a409b140 legacy=0x7fb9a4159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a37fe640 1 -- 172.21.15.67:0/3516478145 >> v1:172.21.15.67:6789/0 conn(0x7fb9a415d290 legacy=0x7fb9a409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.324+0000 7fb9a37fe640 1 -- 172.21.15.67:0/3516478145 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a4071150 con 0x7fb9a40c8c40 2024-09-19T05:38:21.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a37fe640 1 --2- 172.21.15.67:0/3516478145 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 0x7fb9a40705b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9940097f0 tx=0x7fb99401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf3b3d5fd7b3d7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:21.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a27fc640 1 -- 172.21.15.67:0/3516478145 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9940b0070 con 0x7fb9a40c8c40 2024-09-19T05:38:21.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a27fc640 1 -- 172.21.15.67:0/3516478145 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9940ab400 con 0x7fb9a40c8c40 2024-09-19T05:38:21.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a27fc640 1 -- 172.21.15.67:0/3516478145 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998001600 con 0x7fb9a40c8c40 2024-09-19T05:38:21.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a9dad640 1 -- 172.21.15.67:0/3516478145 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 msgr2=0x7fb9a40705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a9dad640 1 --2- 172.21.15.67:0/3516478145 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 0x7fb9a40705b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9940097f0 tx=0x7fb99401c400 comp rx=0 tx=0).stop 2024-09-19T05:38:21.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a9dad640 1 -- 172.21.15.67:0/3516478145 shutdown_connections 2024-09-19T05:38:21.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a9dad640 1 --2- 172.21.15.67:0/3516478145 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 0x7fb9a40705b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a9dad640 1 -- 172.21.15.67:0/3516478145 >> 172.21.15.67:0/3516478145 conn(0x7fb9a40d22b0 msgr2=0x7fb9a40d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:21.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a9dad640 1 -- 172.21.15.67:0/3516478145 shutdown_connections 2024-09-19T05:38:21.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.328+0000 7fb9a9dad640 1 -- 172.21.15.67:0/3516478145 wait complete. 2024-09-19T05:38:21.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 Processor -- start 2024-09-19T05:38:21.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 -- start start 2024-09-19T05:38:21.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a409b140 0x7fb9a4156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 0x7fb9a40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a415d290 0x7fb9a40b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a415a070 con 0x7fb9a415d290 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a40d04f0 con 0x7fb9a409b140 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a415a1f0 con 0x7fb9a40c8c40 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a415d290 0x7fb9a40b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a415d290 0x7fb9a40b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56762/0 (socket says 172.21.15.67:56762) 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a3fff640 1 -- 172.21.15.67:0/881408774 learned_addr learned my addr 172.21.15.67:0/881408774 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a2ffd640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 0x7fb9a40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a37fe640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a409b140 0x7fb9a4156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a3fff640 1 -- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 msgr2=0x7fb9a40b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a3fff640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 0x7fb9a40b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a3fff640 1 -- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a409b140 msgr2=0x7fb9a4156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a3fff640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a409b140 0x7fb9a4156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a3fff640 1 -- 172.21.15.67:0/881408774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a40b7870 con 0x7fb9a415d290 2024-09-19T05:38:21.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a37fe640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a409b140 0x7fb9a4156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:21.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a2ffd640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 0x7fb9a40b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:21.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a3fff640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a415d290 0x7fb9a40b01f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00c7d0 tx=0x7fb99c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:21.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb98bfff640 1 -- 172.21.15.67:0/881408774 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c003b80 con 0x7fb9a415d290 2024-09-19T05:38:21.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb98bfff640 1 -- 172.21.15.67:0/881408774 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c003d20 con 0x7fb9a415d290 2024-09-19T05:38:21.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 -- 172.21.15.67:0/881408774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a40b7b50 con 0x7fb9a415d290 2024-09-19T05:38:21.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb98bfff640 1 -- 172.21.15.67:0/881408774 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c00aa30 con 0x7fb9a415d290 2024-09-19T05:38:21.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 -- 172.21.15.67:0/881408774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a40b7580 con 0x7fb9a415d290 2024-09-19T05:38:21.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb9a9dad640 1 -- 172.21.15.67:0/881408774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a40705b0 con 0x7fb9a415d290 2024-09-19T05:38:21.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb98bfff640 1 -- 172.21.15.67:0/881408774 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb99c00abd0 con 0x7fb9a415d290 2024-09-19T05:38:21.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb98bfff640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9900678c0 0x7fb990069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.332+0000 7fb98bfff640 1 -- 172.21.15.67:0/881408774 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7fb99c085de0 con 0x7fb9a415d290 2024-09-19T05:38:21.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.336+0000 7fb9a37fe640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9900678c0 0x7fb990069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.336+0000 7fb9a37fe640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9900678c0 0x7fb990069d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb9940ad000 tx=0x7fb994008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:21.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.340+0000 7fb98bfff640 1 -- 172.21.15.67:0/881408774 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb99c056710 con 0x7fb9a415d290 2024-09-19T05:38:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.536+0000 7fb9a9dad640 1 -- 172.21.15.67:0/881408774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9a415f250 con 0x7fb9a415d290 2024-09-19T05:38:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.536+0000 7fb98bfff640 1 -- 172.21.15.67:0/881408774 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5222 (secure 0 0 0) 0x7fb99c056010 con 0x7fb9a415d290 2024-09-19T05:38:21.542 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:21.542 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":52,"btime":"2024-09-19T05:38:21:175684+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/3972177199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3972177199},{"type":"v1","addr":"172.21.15.67:6835","nonce":3972177199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5441,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/600959636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":600959636},{"type":"v1","addr":"172.21.15.97:6835","nonce":600959636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2657621121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2657621121},{"type":"v1","addr":"172.21.15.97:6837","nonce":2657621121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:38:17.483070+0000","modified":"2024-09-19T05:38:20.537492+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6834/3597291023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3597291023},{"type":"v1","addr":"172.21.15.67:6834","nonce":3597291023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6741,"qdb_cluster":[6741]},"id":5}]} 2024-09-19T05:38:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 52 2024-09-19T05:38:21.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 -- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9900678c0 msgr2=0x7fb990069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9900678c0 0x7fb990069d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb9940ad000 tx=0x7fb994008040 comp rx=0 tx=0).stop 2024-09-19T05:38:21.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 -- 172.21.15.67:0/881408774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a415d290 msgr2=0x7fb9a40b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a415d290 0x7fb9a40b01f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00c7d0 tx=0x7fb99c00cc90 comp rx=0 tx=0).stop 2024-09-19T05:38:21.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 -- 172.21.15.67:0/881408774 shutdown_connections 2024-09-19T05:38:21.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9a415d290 0x7fb9a40b01f0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9900678c0 0x7fb990069d80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9a40c8c40 0x7fb9a40b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 --2- 172.21.15.67:0/881408774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a409b140 0x7fb9a4156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 -- 172.21.15.67:0/881408774 >> 172.21.15.67:0/881408774 conn(0x7fb9a40d22b0 msgr2=0x7fb9a40b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:21.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 -- 172.21.15.67:0/881408774 shutdown_connections 2024-09-19T05:38:21.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.540+0000 7fb9a9dad640 1 -- 172.21.15.67:0/881408774 wait complete. 2024-09-19T05:38:21.561 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:21.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.676+0000 7fed702c6640 1 Processor -- start 2024-09-19T05:38:21.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed702c6640 1 -- start start 2024-09-19T05:38:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed702c6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fed68161da0 0x7fed680d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed702c6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed680d0160 0x7fed680d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed702c6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed680d05d0 con 0x7fed680d0e80 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed702c6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fed680d1830 con 0x7fed68161da0 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed702c6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fed680d0840 con 0x7fed680d0160 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed6e062640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fed68161da0 0x7fed680d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed6e062640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fed68161da0 0x7fed680d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56770/0 (socket says 172.21.15.67:56770) 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed6e062640 1 -- 172.21.15.67:0/3513389838 learned_addr learned my addr 172.21.15.67:0/3513389838 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed6e863640 1 --2- 172.21.15.67:0/3513389838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed680d0160 0x7fed680d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed6e062640 1 -- 172.21.15.67:0/3513389838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed680d0160 msgr2=0x7fed680d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed6e062640 1 --2- 172.21.15.67:0/3513389838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed680d0160 0x7fed680d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed6e062640 1 -- 172.21.15.67:0/3513389838 >> v1:172.21.15.97:6789/0 conn(0x7fed680d0e80 legacy=0x7fed680b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.680+0000 7fed6e062640 1 -- 172.21.15.67:0/3513389838 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed680d4d40 con 0x7fed68161da0 2024-09-19T05:38:21.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed6e062640 1 --2- 172.21.15.67:0/3513389838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed68161da0 0x7fed680d1af0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fed640098a0 tx=0x7fed6401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc8acf9f888bc13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:21.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed6d060640 1 -- 172.21.15.67:0/3513389838 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed640ab430 con 0x7fed68161da0 2024-09-19T05:38:21.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed6d060640 1 -- 172.21.15.67:0/3513389838 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed640b0070 con 0x7fed68161da0 2024-09-19T05:38:21.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed6d060640 1 -- 172.21.15.67:0/3513389838 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed640ab7f0 con 0x7fed68161da0 2024-09-19T05:38:21.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 -- 172.21.15.67:0/3513389838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed68161da0 msgr2=0x7fed680d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 --2- 172.21.15.67:0/3513389838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed68161da0 0x7fed680d1af0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fed640098a0 tx=0x7fed6401c540 comp rx=0 tx=0).stop 2024-09-19T05:38:21.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 -- 172.21.15.67:0/3513389838 shutdown_connections 2024-09-19T05:38:21.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 --2- 172.21.15.67:0/3513389838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed680d0160 0x7fed680d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 --2- 172.21.15.67:0/3513389838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed68161da0 0x7fed680d1af0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 -- 172.21.15.67:0/3513389838 >> 172.21.15.67:0/3513389838 conn(0x7fed6808bfc0 msgr2=0x7fed680d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:21.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 -- 172.21.15.67:0/3513389838 shutdown_connections 2024-09-19T05:38:21.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 -- 172.21.15.67:0/3513389838 wait complete. 2024-09-19T05:38:21.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 Processor -- start 2024-09-19T05:38:21.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 -- start start 2024-09-19T05:38:21.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed680d0160 0x7fed68153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed680d0e80 0x7fed68154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed68161da0 0x7fed6806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed68162180 con 0x7fed680d0e80 2024-09-19T05:38:21.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fed680b5d00 con 0x7fed68161da0 2024-09-19T05:38:21.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed702c6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fed680b50e0 con 0x7fed680d0160 2024-09-19T05:38:21.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed6d861640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed680d0e80 0x7fed68154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed6d861640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed680d0e80 0x7fed68154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56780/0 (socket says 172.21.15.67:56780) 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed6d861640 1 -- 172.21.15.67:0/583964434 learned_addr learned my addr 172.21.15.67:0/583964434 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed6e863640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed68161da0 0x7fed6806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.684+0000 7fed6e062640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed680d0160 0x7fed68153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed6d861640 1 -- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed680d0160 msgr2=0x7fed68153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed6d861640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed680d0160 0x7fed68153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed6d861640 1 -- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed68161da0 msgr2=0x7fed6806d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed6d861640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed68161da0 0x7fed6806d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed6d861640 1 -- 172.21.15.67:0/583964434 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed680b1e30 con 0x7fed680d0e80 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed6d861640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed680d0e80 0x7fed68154f00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fed5800c400 tx=0x7fed5800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed5effd640 1 -- 172.21.15.67:0/583964434 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58017070 con 0x7fed680d0e80 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed5effd640 1 -- 172.21.15.67:0/583964434 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed58005310 con 0x7fed680d0e80 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed5effd640 1 -- 172.21.15.67:0/583964434 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed580054c0 con 0x7fed680d0e80 2024-09-19T05:38:21.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed702c6640 1 -- 172.21.15.67:0/583964434 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed68154420 con 0x7fed680d0e80 2024-09-19T05:38:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed702c6640 1 -- 172.21.15.67:0/583964434 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed681549e0 con 0x7fed680d0e80 2024-09-19T05:38:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed702c6640 1 -- 172.21.15.67:0/583964434 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed68154240 con 0x7fed680d0e80 2024-09-19T05:38:21.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed5effd640 1 -- 172.21.15.67:0/583964434 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed5801a070 con 0x7fed680d0e80 2024-09-19T05:38:21.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed5effd640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed4c0678c0 0x7fed4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed5effd640 1 -- 172.21.15.67:0/583964434 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7fed58085020 con 0x7fed680d0e80 2024-09-19T05:38:21.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed6e062640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed4c0678c0 0x7fed4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.688+0000 7fed6e062640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed4c0678c0 0x7fed4c069d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fed640af000 tx=0x7fed64008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:21.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.692+0000 7fed5effd640 1 -- 172.21.15.67:0/583964434 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fed68154240 con 0x7fed680d0e80 2024-09-19T05:38:21.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.856+0000 7fed702c6640 1 -- 172.21.15.67:0/583964434 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed68154bb0 con 0x7fed680d0e80 2024-09-19T05:38:21.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed5effd640 1 -- 172.21.15.67:0/583964434 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16969 (secure 0 0 0) 0x7fed58055380 con 0x7fed680d0e80 2024-09-19T05:38:21.864 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:21.864 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":85,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:38:19.156105+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:38:15.164842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-19T05:38:16.488698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 -- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed4c0678c0 msgr2=0x7fed4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed4c0678c0 0x7fed4c069d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fed640af000 tx=0x7fed64008040 comp rx=0 tx=0).stop 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 -- 172.21.15.67:0/583964434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed680d0e80 msgr2=0x7fed68154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed680d0e80 0x7fed68154f00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fed5800c400 tx=0x7fed5800c8c0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 -- 172.21.15.67:0/583964434 shutdown_connections 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed68161da0 0x7fed6806d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed680d0e80 0x7fed68154f00 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed4c0678c0 0x7fed4c069d80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 --2- 172.21.15.67:0/583964434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed680d0160 0x7fed68153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 -- 172.21.15.67:0/583964434 >> 172.21.15.67:0/583964434 conn(0x7fed6808bfc0 msgr2=0x7fed680b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 -- 172.21.15.67:0/583964434 shutdown_connections 2024-09-19T05:38:21.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.860+0000 7fed702c6640 1 -- 172.21.15.67:0/583964434 wait complete. 2024-09-19T05:38:21.882 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:38:21.882 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:21.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.988+0000 7f33d4520640 1 Processor -- start 2024-09-19T05:38:21.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.988+0000 7f33d4520640 1 -- start start 2024-09-19T05:38:21.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d4520640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33cc15b710 0x7f33cc071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d4520640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33cc0aef40 0x7f33cc0af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d4520640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33cc0b3070 con 0x7f33cc15baf0 2024-09-19T05:38:21.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d4520640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f33cc0b32e0 con 0x7f33cc0aef40 2024-09-19T05:38:21.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d4520640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f33cc0b35c0 con 0x7f33cc15b710 2024-09-19T05:38:21.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d2abd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33cc0aef40 0x7f33cc0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d2abd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33cc0aef40 0x7f33cc0af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56796/0 (socket says 172.21.15.67:56796) 2024-09-19T05:38:21.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d2abd640 1 -- 172.21.15.67:0/2801205552 learned_addr learned my addr 172.21.15.67:0/2801205552 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:21.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d22bc640 1 --2- 172.21.15.67:0/2801205552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33cc15b710 0x7f33cc071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d2abd640 1 -- 172.21.15.67:0/2801205552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33cc15b710 msgr2=0x7f33cc071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:21.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d2abd640 1 --2- 172.21.15.67:0/2801205552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33cc15b710 0x7f33cc071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d2abd640 1 -- 172.21.15.67:0/2801205552 >> v1:172.21.15.97:6789/0 conn(0x7f33cc15baf0 legacy=0x7f33cc15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:21.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d2abd640 1 -- 172.21.15.67:0/2801205552 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc0b38a0 con 0x7f33cc0aef40 2024-09-19T05:38:21.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d2abd640 1 --2- 172.21.15.67:0/2801205552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 0x7f33cc0af360 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009e50 tx=0x7f33c401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e99d1672e9ff677 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:21.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d12ba640 1 -- 172.21.15.67:0/2801205552 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c40a5860 con 0x7f33cc0aef40 2024-09-19T05:38:21.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d12ba640 1 -- 172.21.15.67:0/2801205552 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c40a5a00 con 0x7f33cc0aef40 2024-09-19T05:38:21.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.992+0000 7f33d12ba640 1 -- 172.21.15.67:0/2801205552 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c40a5dd0 con 0x7f33cc0aef40 2024-09-19T05:38:21.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 -- 172.21.15.67:0/2801205552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 msgr2=0x7f33cc0af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 --2- 172.21.15.67:0/2801205552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 0x7f33cc0af360 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009e50 tx=0x7f33c401c9c0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 -- 172.21.15.67:0/2801205552 shutdown_connections 2024-09-19T05:38:21.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 --2- 172.21.15.67:0/2801205552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 0x7f33cc0af360 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 --2- 172.21.15.67:0/2801205552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33cc15b710 0x7f33cc071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 -- 172.21.15.67:0/2801205552 >> 172.21.15.67:0/2801205552 conn(0x7f33cc0d0080 msgr2=0x7f33cc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:21.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 -- 172.21.15.67:0/2801205552 shutdown_connections 2024-09-19T05:38:22.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 -- 172.21.15.67:0/2801205552 wait complete. 2024-09-19T05:38:22.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 Processor -- start 2024-09-19T05:38:22.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 -- start start 2024-09-19T05:38:22.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 0x7f33cc099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33cc15b710 0x7f33cc146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33cc15baf0 0x7f33cc14a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc0b4c40 con 0x7f33cc0aef40 2024-09-19T05:38:22.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc0b4ac0 con 0x7f33cc15b710 2024-09-19T05:38:22.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d4520640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f33cc0b4dc0 con 0x7f33cc15baf0 2024-09-19T05:38:22.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d22bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 0x7f33cc099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d22bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 0x7f33cc099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56810/0 (socket says 172.21.15.67:56810) 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d22bc640 1 -- 172.21.15.67:0/1078532692 learned_addr learned my addr 172.21.15.67:0/1078532692 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d1abb640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33cc15b710 0x7f33cc146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d2abd640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33cc15baf0 0x7f33cc14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d22bc640 1 -- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33cc15baf0 msgr2=0x7f33cc14a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d22bc640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33cc15baf0 0x7f33cc14a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d22bc640 1 -- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33cc15b710 msgr2=0x7f33cc146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d22bc640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33cc15b710 0x7f33cc146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d22bc640 1 -- 172.21.15.67:0/1078532692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc099eb0 con 0x7f33cc0aef40 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d1abb640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33cc15b710 0x7f33cc146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:21.996+0000 7f33d22bc640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 0x7f33cc099970 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f33c800c820 tx=0x7f33c800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33c2ffd640 1 -- 172.21.15.67:0/1078532692 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8015070 con 0x7f33cc0aef40 2024-09-19T05:38:22.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33c2ffd640 1 -- 172.21.15.67:0/1078532692 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c8004240 con 0x7f33cc0aef40 2024-09-19T05:38:22.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33d4520640 1 -- 172.21.15.67:0/1078532692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33cc147680 con 0x7f33cc0aef40 2024-09-19T05:38:22.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33c2ffd640 1 -- 172.21.15.67:0/1078532692 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c800ce10 con 0x7f33cc0aef40 2024-09-19T05:38:22.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33d4520640 1 -- 172.21.15.67:0/1078532692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33cc147c40 con 0x7f33cc0aef40 2024-09-19T05:38:22.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33d4520640 1 -- 172.21.15.67:0/1078532692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33cc0af360 con 0x7f33cc0aef40 2024-09-19T05:38:22.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33c2ffd640 1 -- 172.21.15.67:0/1078532692 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33c8007830 con 0x7f33cc0aef40 2024-09-19T05:38:22.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33c2ffd640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33b00678c0 0x7f33b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33c2ffd640 1 -- 172.21.15.67:0/1078532692 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f33c8085d30 con 0x7f33cc0aef40 2024-09-19T05:38:22.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33d1abb640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33b00678c0 0x7f33b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.000+0000 7f33d1abb640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33b00678c0 0x7f33b0069d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0aead0 tx=0x7f33bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:22.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.004+0000 7f33c2ffd640 1 -- 172.21.15.67:0/1078532692 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f33c8056650 con 0x7f33cc0aef40 2024-09-19T05:38:22.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.160+0000 7f33d4520640 1 -- 172.21.15.67:0/1078532692 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33cc1554d0 con 0x7f33b00678c0 2024-09-19T05:38:22.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.176+0000 7f33c2ffd640 1 -- 172.21.15.67:0/1078532692 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246753 (secure 0 0 0) 0x7f33cc1554d0 con 0x7f33b00678c0 2024-09-19T05:38:22.183 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:38:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 -- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33b00678c0 msgr2=0x7f33b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33b00678c0 0x7f33b0069d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0aead0 tx=0x7f33bc008040 comp rx=0 tx=0).stop 2024-09-19T05:38:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 -- 172.21.15.67:0/1078532692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 msgr2=0x7f33cc099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 0x7f33cc099970 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f33c800c820 tx=0x7f33c800cce0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 -- 172.21.15.67:0/1078532692 shutdown_connections 2024-09-19T05:38:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33b00678c0 0x7f33b0069d80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33cc15baf0 0x7f33cc14a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33cc15b710 0x7f33cc146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 --2- 172.21.15.67:0/1078532692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33cc0aef40 0x7f33cc099970 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 -- 172.21.15.67:0/1078532692 >> 172.21.15.67:0/1078532692 conn(0x7f33cc0d0080 msgr2=0x7f33cc0add60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:22.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 -- 172.21.15.67:0/1078532692 shutdown_connections 2024-09-19T05:38:22.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.180+0000 7f33d4520640 1 -- 172.21.15.67:0/1078532692 wait complete. 2024-09-19T05:38:22.201 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-09-19T05:38:21.212746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":343212,"kb_used_data":8992,"kb_used_omap":12,"kb_used_meta":334003,"kb_avail":754631508,"statfs":{"total":773094113280,"available":772742664192,"internally_reserved":0,"allocated":9207808,"data_stored":4876742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":342019633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.111346"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.113069+0000","last_change":"2024-09-19T05:38:17.113069+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.113069+0000","last_undegraded":"2024-09-19T05:38:17.113069+0000","last_fullsized":"2024-09-19T05:38:17.113069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125176+0000","last_change":"2024-09-19T05:38:17.125176+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125176+0000","last_undegraded":"2024-09-19T05:38:17.125176+0000","last_fullsized":"2024-09-19T05:38:17.125176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.118953+0000","last_change":"2024-09-19T05:38:17.118953+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.118953+0000","last_undegraded":"2024-09-19T05:38:17.118953+0000","last_fullsized":"2024-09-19T05:38:17.118953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125286+0000","last_change":"2024-09-19T05:38:17.125286+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125286+0000","last_undegraded":"2024-09-19T05:38:17.125286+0000","last_fullsized":"2024-09-19T05:38:17.125286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129675+0000","last_change":"2024-09-19T05:38:17.129675+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129675+0000","last_undegraded":"2024-09-19T05:38:17.129675+0000","last_fullsized":"2024-09-19T05:38:17.129675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129863+0000","last_change":"2024-09-19T05:38:17.129863+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129863+0000","last_undegraded":"2024-09-19T05:38:17.129863+0000","last_fullsized":"2024-09-19T05:38:17.129863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128301+0000","last_change":"2024-09-19T05:38:17.128301+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128301+0000","last_undegraded":"2024-09-19T05:38:17.128301+0000","last_fullsized":"2024-09-19T05:38:17.128301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128631+0000","last_change":"2024-09-19T05:38:17.128631+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128631+0000","last_undegraded":"2024-09-19T05:38:17.128631+0000","last_fullsized":"2024-09-19T05:38:17.128631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.117959+0000","last_change":"2024-09-19T05:38:17.117959+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.117959+0000","last_undegraded":"2024-09-19T05:38:17.117959+0000","last_fullsized":"2024-09-19T05:38:17.117959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.137607+0000","last_change":"2024-09-19T05:38:17.137607+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.137607+0000","last_undegraded":"2024-09-19T05:38:17.137607+0000","last_fullsized":"2024-09-19T05:38:17.137607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.126744+0000","last_change":"2024-09-19T05:38:17.126744+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.126744+0000","last_undegraded":"2024-09-19T05:38:17.126744+0000","last_fullsized":"2024-09-19T05:38:17.126744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.124288+0000","last_change":"2024-09-19T05:38:17.124288+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.124288+0000","last_undegraded":"2024-09-19T05:38:17.124288+0000","last_fullsized":"2024-09-19T05:38:17.124288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128547+0000","last_change":"2024-09-19T05:38:17.128547+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128547+0000","last_undegraded":"2024-09-19T05:38:17.128547+0000","last_fullsized":"2024-09-19T05:38:17.128547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129179+0000","last_change":"2024-09-19T05:38:17.129179+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129179+0000","last_undegraded":"2024-09-19T05:38:17.129179+0000","last_fullsized":"2024-09-19T05:38:17.129179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.126195+0000","last_change":"2024-09-19T05:38:17.126195+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.126195+0000","last_undegraded":"2024-09-19T05:38:17.126195+0000","last_fullsized":"2024-09-19T05:38:17.126195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.113414+0000","last_change":"2024-09-19T05:38:17.113414+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.113414+0000","last_undegraded":"2024-09-19T05:38:17.113414+0000","last_fullsized":"2024-09-19T05:38:17.113414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128874+0000","last_change":"2024-09-19T05:38:17.128874+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128874+0000","last_undegraded":"2024-09-19T05:38:17.128874+0000","last_fullsized":"2024-09-19T05:38:17.128874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.117053+0000","last_change":"2024-09-19T05:38:17.117053+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.117053+0000","last_undegraded":"2024-09-19T05:38:17.117053+0000","last_fullsized":"2024-09-19T05:38:17.117053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127487+0000","last_change":"2024-09-19T05:38:17.127487+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127487+0000","last_undegraded":"2024-09-19T05:38:17.127487+0000","last_fullsized":"2024-09-19T05:38:17.127487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129383+0000","last_change":"2024-09-19T05:38:17.129383+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129383+0000","last_undegraded":"2024-09-19T05:38:17.129383+0000","last_fullsized":"2024-09-19T05:38:17.129383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.123062+0000","last_change":"2024-09-19T05:38:17.123062+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.123062+0000","last_undegraded":"2024-09-19T05:38:17.123062+0000","last_fullsized":"2024-09-19T05:38:17.123062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128314+0000","last_change":"2024-09-19T05:38:17.128314+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128314+0000","last_undegraded":"2024-09-19T05:38:17.128314+0000","last_fullsized":"2024-09-19T05:38:17.128314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.119065+0000","last_change":"2024-09-19T05:38:17.119065+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.119065+0000","last_undegraded":"2024-09-19T05:38:17.119065+0000","last_fullsized":"2024-09-19T05:38:17.119065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125744+0000","last_change":"2024-09-19T05:38:17.125744+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125744+0000","last_undegraded":"2024-09-19T05:38:17.125744+0000","last_fullsized":"2024-09-19T05:38:17.125744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125399+0000","last_change":"2024-09-19T05:38:17.125399+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125399+0000","last_undegraded":"2024-09-19T05:38:17.125399+0000","last_fullsized":"2024-09-19T05:38:17.125399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.123051+0000","last_change":"2024-09-19T05:38:17.123051+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.123051+0000","last_undegraded":"2024-09-19T05:38:17.123051+0000","last_fullsized":"2024-09-19T05:38:17.123051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.113418+0000","last_change":"2024-09-19T05:38:17.113418+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.113418+0000","last_undegraded":"2024-09-19T05:38:17.113418+0000","last_fullsized":"2024-09-19T05:38:17.113418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127810+0000","last_change":"2024-09-19T05:38:17.127810+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127810+0000","last_undegraded":"2024-09-19T05:38:17.127810+0000","last_fullsized":"2024-09-19T05:38:17.127810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.124900+0000","last_change":"2024-09-19T05:38:17.124900+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.124900+0000","last_undegraded":"2024-09-19T05:38:17.124900+0000","last_fullsized":"2024-09-19T05:38:17.124900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.112073+0000","last_change":"2024-09-19T05:38:17.112073+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.112073+0000","last_undegraded":"2024-09-19T05:38:17.112073+0000","last_fullsized":"2024-09-19T05:38:17.112073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.115782+0000","last_change":"2024-09-19T05:38:17.115782+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.115782+0000","last_undegraded":"2024-09-19T05:38:17.115782+0000","last_fullsized":"2024-09-19T05:38:17.115782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.111923+0000","last_change":"2024-09-19T05:38:17.111923+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.111923+0000","last_undegraded":"2024-09-19T05:38:17.111923+0000","last_fullsized":"2024-09-19T05:38:17.111923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.118698+0000","last_change":"2024-09-19T05:38:17.118698+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.118698+0000","last_undegraded":"2024-09-19T05:38:17.118698+0000","last_fullsized":"2024-09-19T05:38:17.118698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.129960+0000","last_change":"2024-09-19T05:38:17.125550+0000","last_active":"2024-09-19T05:38:17.129960+0000","last_peered":"2024-09-19T05:38:17.129960+0000","last_clean":"2024-09-19T05:38:17.129960+0000","last_became_active":"2024-09-19T05:38:17.125194+0000","last_became_peered":"2024-09-19T05:38:17.125194+0000","last_unstale":"2024-09-19T05:38:17.129960+0000","last_undegraded":"2024-09-19T05:38:17.129960+0000","last_fullsized":"2024-09-19T05:38:17.129960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:15.003301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122580+0000","last_change":"2024-09-19T05:38:17.122580+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122580+0000","last_undegraded":"2024-09-19T05:38:17.122580+0000","last_fullsized":"2024-09-19T05:38:17.122580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152123+0000","last_change":"2024-09-19T05:38:17.151155+0000","last_active":"2024-09-19T05:38:17.152123+0000","last_peered":"2024-09-19T05:38:17.152123+0000","last_clean":"2024-09-19T05:38:17.152123+0000","last_became_active":"2024-09-19T05:38:17.150121+0000","last_became_peered":"2024-09-19T05:38:17.150121+0000","last_unstale":"2024-09-19T05:38:17.152123+0000","last_undegraded":"2024-09-19T05:38:17.152123+0000","last_fullsized":"2024-09-19T05:38:17.152123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:23.916230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.121152+0000","last_change":"2024-09-19T05:38:17.121152+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.121152+0000","last_undegraded":"2024-09-19T05:38:17.121152+0000","last_fullsized":"2024-09-19T05:38:17.121152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.134394+0000","last_change":"2024-09-19T05:38:17.127521+0000","last_active":"2024-09-19T05:38:17.134394+0000","last_peered":"2024-09-19T05:38:17.134394+0000","last_clean":"2024-09-19T05:38:17.134394+0000","last_became_active":"2024-09-19T05:38:17.125524+0000","last_became_peered":"2024-09-19T05:38:17.125524+0000","last_unstale":"2024-09-19T05:38:17.134394+0000","last_undegraded":"2024-09-19T05:38:17.134394+0000","last_fullsized":"2024-09-19T05:38:17.134394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:36.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122053+0000","last_change":"2024-09-19T05:38:17.122053+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122053+0000","last_undegraded":"2024-09-19T05:38:17.122053+0000","last_fullsized":"2024-09-19T05:38:17.122053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152965+0000","last_change":"2024-09-19T05:38:17.146072+0000","last_active":"2024-09-19T05:38:17.152965+0000","last_peered":"2024-09-19T05:38:17.152965+0000","last_clean":"2024-09-19T05:38:17.152965+0000","last_became_active":"2024-09-19T05:38:17.145049+0000","last_became_peered":"2024-09-19T05:38:17.145049+0000","last_unstale":"2024-09-19T05:38:17.152965+0000","last_undegraded":"2024-09-19T05:38:17.152965+0000","last_fullsized":"2024-09-19T05:38:17.152965+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:54.774053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125023+0000","last_change":"2024-09-19T05:38:17.125023+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125023+0000","last_undegraded":"2024-09-19T05:38:17.125023+0000","last_fullsized":"2024-09-19T05:38:17.125023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146366+0000","last_change":"2024-09-19T05:38:17.142355+0000","last_active":"2024-09-19T05:38:17.146366+0000","last_peered":"2024-09-19T05:38:17.146366+0000","last_clean":"2024-09-19T05:38:17.146366+0000","last_became_active":"2024-09-19T05:38:17.140750+0000","last_became_peered":"2024-09-19T05:38:17.140750+0000","last_unstale":"2024-09-19T05:38:17.146366+0000","last_undegraded":"2024-09-19T05:38:17.146366+0000","last_fullsized":"2024-09-19T05:38:17.146366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:23.103718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125195+0000","last_change":"2024-09-19T05:38:17.125195+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125195+0000","last_undegraded":"2024-09-19T05:38:17.125195+0000","last_fullsized":"2024-09-19T05:38:17.125195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.145238+0000","last_change":"2024-09-19T05:38:17.141855+0000","last_active":"2024-09-19T05:38:17.145238+0000","last_peered":"2024-09-19T05:38:17.145238+0000","last_clean":"2024-09-19T05:38:17.145238+0000","last_became_active":"2024-09-19T05:38:17.140748+0000","last_became_peered":"2024-09-19T05:38:17.140748+0000","last_unstale":"2024-09-19T05:38:17.145238+0000","last_undegraded":"2024-09-19T05:38:17.145238+0000","last_fullsized":"2024-09-19T05:38:17.145238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:32.631014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.117911+0000","last_change":"2024-09-19T05:38:17.117911+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.117911+0000","last_undegraded":"2024-09-19T05:38:17.117911+0000","last_fullsized":"2024-09-19T05:38:17.117911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.139125+0000","last_change":"2024-09-19T05:38:17.138271+0000","last_active":"2024-09-19T05:38:17.139125+0000","last_peered":"2024-09-19T05:38:17.139125+0000","last_clean":"2024-09-19T05:38:17.139125+0000","last_became_active":"2024-09-19T05:38:17.137963+0000","last_became_peered":"2024-09-19T05:38:17.137963+0000","last_unstale":"2024-09-19T05:38:17.139125+0000","last_undegraded":"2024-09-19T05:38:17.139125+0000","last_fullsized":"2024-09-19T05:38:17.139125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:06.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.132834+0000","last_change":"2024-09-19T05:38:17.132834+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.132834+0000","last_undegraded":"2024-09-19T05:38:17.132834+0000","last_fullsized":"2024-09-19T05:38:17.132834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.136394+0000","last_change":"2024-09-19T05:38:17.132639+0000","last_active":"2024-09-19T05:38:17.136394+0000","last_peered":"2024-09-19T05:38:17.136394+0000","last_clean":"2024-09-19T05:38:17.136394+0000","last_became_active":"2024-09-19T05:38:17.132240+0000","last_became_peered":"2024-09-19T05:38:17.132240+0000","last_unstale":"2024-09-19T05:38:17.136394+0000","last_undegraded":"2024-09-19T05:38:17.136394+0000","last_fullsized":"2024-09-19T05:38:17.136394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:09.666947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122116+0000","last_change":"2024-09-19T05:38:17.122116+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122116+0000","last_undegraded":"2024-09-19T05:38:17.122116+0000","last_fullsized":"2024-09-19T05:38:17.122116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.140936+0000","last_change":"2024-09-19T05:38:17.137642+0000","last_active":"2024-09-19T05:38:17.140936+0000","last_peered":"2024-09-19T05:38:17.140936+0000","last_clean":"2024-09-19T05:38:17.140936+0000","last_became_active":"2024-09-19T05:38:17.136920+0000","last_became_peered":"2024-09-19T05:38:17.136920+0000","last_unstale":"2024-09-19T05:38:17.140936+0000","last_undegraded":"2024-09-19T05:38:17.140936+0000","last_fullsized":"2024-09-19T05:38:17.140936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:39.495532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.120956+0000","last_change":"2024-09-19T05:38:17.120956+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.120956+0000","last_undegraded":"2024-09-19T05:38:17.120956+0000","last_fullsized":"2024-09-19T05:38:17.120956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.151145+0000","last_change":"2024-09-19T05:38:17.149660+0000","last_active":"2024-09-19T05:38:17.151145+0000","last_peered":"2024-09-19T05:38:17.151145+0000","last_clean":"2024-09-19T05:38:17.151145+0000","last_became_active":"2024-09-19T05:38:17.147750+0000","last_became_peered":"2024-09-19T05:38:17.147750+0000","last_unstale":"2024-09-19T05:38:17.151145+0000","last_undegraded":"2024-09-19T05:38:17.151145+0000","last_fullsized":"2024-09-19T05:38:17.151145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:11.415272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127487+0000","last_change":"2024-09-19T05:38:17.127487+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127487+0000","last_undegraded":"2024-09-19T05:38:17.127487+0000","last_fullsized":"2024-09-19T05:38:17.127487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.134224+0000","last_change":"2024-09-19T05:38:17.132043+0000","last_active":"2024-09-19T05:38:17.134224+0000","last_peered":"2024-09-19T05:38:17.134224+0000","last_clean":"2024-09-19T05:38:17.134224+0000","last_became_active":"2024-09-19T05:38:17.130901+0000","last_became_peered":"2024-09-19T05:38:17.130901+0000","last_unstale":"2024-09-19T05:38:17.134224+0000","last_undegraded":"2024-09-19T05:38:17.134224+0000","last_fullsized":"2024-09-19T05:38:17.134224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:28.975858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.116219+0000","last_change":"2024-09-19T05:38:17.116219+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.116219+0000","last_undegraded":"2024-09-19T05:38:17.116219+0000","last_fullsized":"2024-09-19T05:38:17.116219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.154193+0000","last_change":"2024-09-19T05:38:17.152541+0000","last_active":"2024-09-19T05:38:17.154193+0000","last_peered":"2024-09-19T05:38:17.154193+0000","last_clean":"2024-09-19T05:38:17.154193+0000","last_became_active":"2024-09-19T05:38:17.152060+0000","last_became_peered":"2024-09-19T05:38:17.152060+0000","last_unstale":"2024-09-19T05:38:17.154193+0000","last_undegraded":"2024-09-19T05:38:17.154193+0000","last_fullsized":"2024-09-19T05:38:17.154193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:56.465721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122901+0000","last_change":"2024-09-19T05:38:17.122901+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122901+0000","last_undegraded":"2024-09-19T05:38:17.122901+0000","last_fullsized":"2024-09-19T05:38:17.122901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.150691+0000","last_change":"2024-09-19T05:38:17.148263+0000","last_active":"2024-09-19T05:38:17.150691+0000","last_peered":"2024-09-19T05:38:17.150691+0000","last_clean":"2024-09-19T05:38:17.150691+0000","last_became_active":"2024-09-19T05:38:17.147503+0000","last_became_peered":"2024-09-19T05:38:17.147503+0000","last_unstale":"2024-09-19T05:38:17.150691+0000","last_undegraded":"2024-09-19T05:38:17.150691+0000","last_fullsized":"2024-09-19T05:38:17.150691+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:20.466988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.126638+0000","last_change":"2024-09-19T05:38:17.126638+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.126638+0000","last_undegraded":"2024-09-19T05:38:17.126638+0000","last_fullsized":"2024-09-19T05:38:17.126638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.144153+0000","last_change":"2024-09-19T05:38:17.128306+0000","last_active":"2024-09-19T05:38:17.144153+0000","last_peered":"2024-09-19T05:38:17.144153+0000","last_clean":"2024-09-19T05:38:17.144153+0000","last_became_active":"2024-09-19T05:38:17.127570+0000","last_became_peered":"2024-09-19T05:38:17.127570+0000","last_unstale":"2024-09-19T05:38:17.144153+0000","last_undegraded":"2024-09-19T05:38:17.144153+0000","last_fullsized":"2024-09-19T05:38:17.144153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:06.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127620+0000","last_change":"2024-09-19T05:38:17.127620+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127620+0000","last_undegraded":"2024-09-19T05:38:17.127620+0000","last_fullsized":"2024-09-19T05:38:17.127620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.128581+0000","last_change":"2024-09-19T05:38:17.124389+0000","last_active":"2024-09-19T05:38:17.128581+0000","last_peered":"2024-09-19T05:38:17.128581+0000","last_clean":"2024-09-19T05:38:17.128581+0000","last_became_active":"2024-09-19T05:38:17.124116+0000","last_became_peered":"2024-09-19T05:38:17.124116+0000","last_unstale":"2024-09-19T05:38:17.128581+0000","last_undegraded":"2024-09-19T05:38:17.128581+0000","last_fullsized":"2024-09-19T05:38:17.128581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.799473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.131865+0000","last_change":"2024-09-19T05:38:17.131865+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.131865+0000","last_undegraded":"2024-09-19T05:38:17.131865+0000","last_fullsized":"2024-09-19T05:38:17.131865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.153342+0000","last_change":"2024-09-19T05:38:17.152926+0000","last_active":"2024-09-19T05:38:17.153342+0000","last_peered":"2024-09-19T05:38:17.153342+0000","last_clean":"2024-09-19T05:38:17.153342+0000","last_became_active":"2024-09-19T05:38:17.152633+0000","last_became_peered":"2024-09-19T05:38:17.152633+0000","last_unstale":"2024-09-19T05:38:17.153342+0000","last_undegraded":"2024-09-19T05:38:17.153342+0000","last_fullsized":"2024-09-19T05:38:17.153342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:39.495532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127062+0000","last_change":"2024-09-19T05:38:17.127062+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127062+0000","last_undegraded":"2024-09-19T05:38:17.127062+0000","last_fullsized":"2024-09-19T05:38:17.127062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.153463+0000","last_change":"2024-09-19T05:38:17.148055+0000","last_active":"2024-09-19T05:38:17.153463+0000","last_peered":"2024-09-19T05:38:17.153463+0000","last_clean":"2024-09-19T05:38:17.153463+0000","last_became_active":"2024-09-19T05:38:17.147402+0000","last_became_peered":"2024-09-19T05:38:17.147402+0000","last_unstale":"2024-09-19T05:38:17.153463+0000","last_undegraded":"2024-09-19T05:38:17.153463+0000","last_fullsized":"2024-09-19T05:38:17.153463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:35.931949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127540+0000","last_change":"2024-09-19T05:38:17.127540+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127540+0000","last_undegraded":"2024-09-19T05:38:17.127540+0000","last_fullsized":"2024-09-19T05:38:17.127540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.145234+0000","last_change":"2024-09-19T05:38:17.132750+0000","last_active":"2024-09-19T05:38:17.145234+0000","last_peered":"2024-09-19T05:38:17.145234+0000","last_clean":"2024-09-19T05:38:17.145234+0000","last_became_active":"2024-09-19T05:38:17.132035+0000","last_became_peered":"2024-09-19T05:38:17.132035+0000","last_unstale":"2024-09-19T05:38:17.145234+0000","last_undegraded":"2024-09-19T05:38:17.145234+0000","last_fullsized":"2024-09-19T05:38:17.145234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:25.245347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127631+0000","last_change":"2024-09-19T05:38:17.127631+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127631+0000","last_undegraded":"2024-09-19T05:38:17.127631+0000","last_fullsized":"2024-09-19T05:38:17.127631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.138909+0000","last_change":"2024-09-19T05:38:17.137253+0000","last_active":"2024-09-19T05:38:17.138909+0000","last_peered":"2024-09-19T05:38:17.138909+0000","last_clean":"2024-09-19T05:38:17.138909+0000","last_became_active":"2024-09-19T05:38:17.136921+0000","last_became_peered":"2024-09-19T05:38:17.136921+0000","last_unstale":"2024-09-19T05:38:17.138909+0000","last_undegraded":"2024-09-19T05:38:17.138909+0000","last_fullsized":"2024-09-19T05:38:17.138909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:22.837311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128271+0000","last_change":"2024-09-19T05:38:17.128271+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128271+0000","last_undegraded":"2024-09-19T05:38:17.128271+0000","last_fullsized":"2024-09-19T05:38:17.128271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.140639+0000","last_change":"2024-09-19T05:38:17.133484+0000","last_active":"2024-09-19T05:38:17.140639+0000","last_peered":"2024-09-19T05:38:17.140639+0000","last_clean":"2024-09-19T05:38:17.140639+0000","last_became_active":"2024-09-19T05:38:17.133155+0000","last_became_peered":"2024-09-19T05:38:17.133155+0000","last_unstale":"2024-09-19T05:38:17.140639+0000","last_undegraded":"2024-09-19T05:38:17.140639+0000","last_fullsized":"2024-09-19T05:38:17.140639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:18.374097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122399+0000","last_change":"2024-09-19T05:38:17.122399+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122399+0000","last_undegraded":"2024-09-19T05:38:17.122399+0000","last_fullsized":"2024-09-19T05:38:17.122399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.129796+0000","last_change":"2024-09-19T05:38:17.122267+0000","last_active":"2024-09-19T05:38:17.129796+0000","last_peered":"2024-09-19T05:38:17.129796+0000","last_clean":"2024-09-19T05:38:17.129796+0000","last_became_active":"2024-09-19T05:38:17.121874+0000","last_became_peered":"2024-09-19T05:38:17.121874+0000","last_unstale":"2024-09-19T05:38:17.129796+0000","last_undegraded":"2024-09-19T05:38:17.129796+0000","last_fullsized":"2024-09-19T05:38:17.129796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:35.177608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.123069+0000","last_change":"2024-09-19T05:38:17.123069+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.123069+0000","last_undegraded":"2024-09-19T05:38:17.123069+0000","last_fullsized":"2024-09-19T05:38:17.123069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.147031+0000","last_change":"2024-09-19T05:38:17.146511+0000","last_active":"2024-09-19T05:38:17.147031+0000","last_peered":"2024-09-19T05:38:17.147031+0000","last_clean":"2024-09-19T05:38:17.147031+0000","last_became_active":"2024-09-19T05:38:17.145962+0000","last_became_peered":"2024-09-19T05:38:17.145962+0000","last_unstale":"2024-09-19T05:38:17.147031+0000","last_undegraded":"2024-09-19T05:38:17.147031+0000","last_fullsized":"2024-09-19T05:38:17.147031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:14.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.130810+0000","last_change":"2024-09-19T05:38:17.130810+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.130810+0000","last_undegraded":"2024-09-19T05:38:17.130810+0000","last_fullsized":"2024-09-19T05:38:17.130810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146515+0000","last_change":"2024-09-19T05:38:17.145847+0000","last_active":"2024-09-19T05:38:17.146515+0000","last_peered":"2024-09-19T05:38:17.146515+0000","last_clean":"2024-09-19T05:38:17.146515+0000","last_became_active":"2024-09-19T05:38:17.145601+0000","last_became_peered":"2024-09-19T05:38:17.145601+0000","last_unstale":"2024-09-19T05:38:17.146515+0000","last_undegraded":"2024-09-19T05:38:17.146515+0000","last_fullsized":"2024-09-19T05:38:17.146515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:23.796246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.118006+0000","last_change":"2024-09-19T05:38:17.118006+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.118006+0000","last_undegraded":"2024-09-19T05:38:17.118006+0000","last_fullsized":"2024-09-19T05:38:17.118006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.145600+0000","last_change":"2024-09-19T05:38:17.143027+0000","last_active":"2024-09-19T05:38:17.145600+0000","last_peered":"2024-09-19T05:38:17.145600+0000","last_clean":"2024-09-19T05:38:17.145600+0000","last_became_active":"2024-09-19T05:38:17.142268+0000","last_became_peered":"2024-09-19T05:38:17.142268+0000","last_unstale":"2024-09-19T05:38:17.145600+0000","last_undegraded":"2024-09-19T05:38:17.145600+0000","last_fullsized":"2024-09-19T05:38:17.145600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:56.757853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127199+0000","last_change":"2024-09-19T05:38:17.127199+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127199+0000","last_undegraded":"2024-09-19T05:38:17.127199+0000","last_fullsized":"2024-09-19T05:38:17.127199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.130921+0000","last_change":"2024-09-19T05:38:17.126066+0000","last_active":"2024-09-19T05:38:17.130921+0000","last_peered":"2024-09-19T05:38:17.130921+0000","last_clean":"2024-09-19T05:38:17.130921+0000","last_became_active":"2024-09-19T05:38:17.125791+0000","last_became_peered":"2024-09-19T05:38:17.125791+0000","last_unstale":"2024-09-19T05:38:17.130921+0000","last_undegraded":"2024-09-19T05:38:17.130921+0000","last_fullsized":"2024-09-19T05:38:17.130921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:36.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.119687+0000","last_change":"2024-09-19T05:38:17.119687+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.119687+0000","last_undegraded":"2024-09-19T05:38:17.119687+0000","last_fullsized":"2024-09-19T05:38:17.119687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146906+0000","last_change":"2024-09-19T05:38:17.144370+0000","last_active":"2024-09-19T05:38:17.146906+0000","last_peered":"2024-09-19T05:38:17.146906+0000","last_clean":"2024-09-19T05:38:17.146906+0000","last_became_active":"2024-09-19T05:38:17.143606+0000","last_became_peered":"2024-09-19T05:38:17.143606+0000","last_unstale":"2024-09-19T05:38:17.146906+0000","last_undegraded":"2024-09-19T05:38:17.146906+0000","last_fullsized":"2024-09-19T05:38:17.146906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:04.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122090+0000","last_change":"2024-09-19T05:38:17.122090+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122090+0000","last_undegraded":"2024-09-19T05:38:17.122090+0000","last_fullsized":"2024-09-19T05:38:17.122090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152105+0000","last_change":"2024-09-19T05:38:17.150784+0000","last_active":"2024-09-19T05:38:17.152105+0000","last_peered":"2024-09-19T05:38:17.152105+0000","last_clean":"2024-09-19T05:38:17.152105+0000","last_became_active":"2024-09-19T05:38:17.149985+0000","last_became_peered":"2024-09-19T05:38:17.149985+0000","last_unstale":"2024-09-19T05:38:17.152105+0000","last_undegraded":"2024-09-19T05:38:17.152105+0000","last_fullsized":"2024-09-19T05:38:17.152105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:31.104896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.133830+0000","last_change":"2024-09-19T05:38:17.133830+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.133830+0000","last_undegraded":"2024-09-19T05:38:17.133830+0000","last_fullsized":"2024-09-19T05:38:17.133830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.148702+0000","last_change":"2024-09-19T05:38:17.137447+0000","last_active":"2024-09-19T05:38:17.148702+0000","last_peered":"2024-09-19T05:38:17.148702+0000","last_clean":"2024-09-19T05:38:17.148702+0000","last_became_active":"2024-09-19T05:38:17.136760+0000","last_became_peered":"2024-09-19T05:38:17.136760+0000","last_unstale":"2024-09-19T05:38:17.148702+0000","last_undegraded":"2024-09-19T05:38:17.148702+0000","last_fullsized":"2024-09-19T05:38:17.148702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:07.700921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125393+0000","last_change":"2024-09-19T05:38:17.125393+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125393+0000","last_undegraded":"2024-09-19T05:38:17.125393+0000","last_fullsized":"2024-09-19T05:38:17.125393+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.138822+0000","last_change":"2024-09-19T05:38:17.136157+0000","last_active":"2024-09-19T05:38:17.138822+0000","last_peered":"2024-09-19T05:38:17.138822+0000","last_clean":"2024-09-19T05:38:17.138822+0000","last_became_active":"2024-09-19T05:38:17.135724+0000","last_became_peered":"2024-09-19T05:38:17.135724+0000","last_unstale":"2024-09-19T05:38:17.138822+0000","last_undegraded":"2024-09-19T05:38:17.138822+0000","last_fullsized":"2024-09-19T05:38:17.138822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:52.678154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.116563+0000","last_change":"2024-09-19T05:38:17.116563+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.116563+0000","last_undegraded":"2024-09-19T05:38:17.116563+0000","last_fullsized":"2024-09-19T05:38:17.116563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152654+0000","last_change":"2024-09-19T05:38:17.145925+0000","last_active":"2024-09-19T05:38:17.152654+0000","last_peered":"2024-09-19T05:38:17.152654+0000","last_clean":"2024-09-19T05:38:17.152654+0000","last_became_active":"2024-09-19T05:38:17.145324+0000","last_became_peered":"2024-09-19T05:38:17.145324+0000","last_unstale":"2024-09-19T05:38:17.152654+0000","last_undegraded":"2024-09-19T05:38:17.152654+0000","last_fullsized":"2024-09-19T05:38:17.152654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:35.194554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.119391+0000","last_change":"2024-09-19T05:38:17.119391+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.119391+0000","last_undegraded":"2024-09-19T05:38:17.119391+0000","last_fullsized":"2024-09-19T05:38:17.119391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.130041+0000","last_change":"2024-09-19T05:38:17.123000+0000","last_active":"2024-09-19T05:38:17.130041+0000","last_peered":"2024-09-19T05:38:17.130041+0000","last_clean":"2024-09-19T05:38:17.130041+0000","last_became_active":"2024-09-19T05:38:17.121818+0000","last_became_peered":"2024-09-19T05:38:17.121818+0000","last_unstale":"2024-09-19T05:38:17.130041+0000","last_undegraded":"2024-09-19T05:38:17.130041+0000","last_fullsized":"2024-09-19T05:38:17.130041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:59.045847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.112050+0000","last_change":"2024-09-19T05:38:17.112050+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.112050+0000","last_undegraded":"2024-09-19T05:38:17.112050+0000","last_fullsized":"2024-09-19T05:38:17.112050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146769+0000","last_change":"2024-09-19T05:38:17.146047+0000","last_active":"2024-09-19T05:38:17.146769+0000","last_peered":"2024-09-19T05:38:17.146769+0000","last_clean":"2024-09-19T05:38:17.146769+0000","last_became_active":"2024-09-19T05:38:17.145623+0000","last_became_peered":"2024-09-19T05:38:17.145623+0000","last_unstale":"2024-09-19T05:38:17.146769+0000","last_undegraded":"2024-09-19T05:38:17.146769+0000","last_fullsized":"2024-09-19T05:38:17.146769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:41.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.114263+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:38:17.114263+0000","last_peered":"2024-09-19T05:38:17.114263+0000","last_clean":"2024-09-19T05:38:17.114263+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:38:17.114263+0000","last_undegraded":"2024-09-19T05:38:17.114263+0000","last_fullsized":"2024-09-19T05:38:17.114263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542209,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50804,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321036,"statfs":{"total":96636764160,"available":96584740864,"internally_reserved":0,"allocated":1605632,"data_stored":1057369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542211,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46064,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325776,"statfs":{"total":96636764160,"available":96589594624,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46056,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325784,"statfs":{"total":96636764160,"available":96589602816,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542212,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542209,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":1057369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:22.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:22.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc7611640 1 Processor -- start 2024-09-19T05:38:22.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc7611640 1 -- start start 2024-09-19T05:38:22.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc7611640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc0159d60 0x7f5dc006ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc7611640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5dc006f460 0x7f5dc00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc7611640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5dc00b3510 0x7f5dc00acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc7611640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc006de80 con 0x7f5dc006f460 2024-09-19T05:38:22.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc7611640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc006e160 con 0x7f5dc00b3510 2024-09-19T05:38:22.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc7611640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc006e440 con 0x7f5dc0159d60 2024-09-19T05:38:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc4bac640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5dc006f460 0x7f5dc00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc4bac640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5dc006f460 0x7f5dc00b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56818/0 (socket says 172.21.15.67:56818) 2024-09-19T05:38:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.352+0000 7f5dc4bac640 1 -- 172.21.15.67:0/308336978 learned_addr learned my addr 172.21.15.67:0/308336978 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc5bae640 1 --2- 172.21.15.67:0/308336978 >> v2:172.21.15.97:3300/0 conn(0x7f5dc00b3510 0x7f5dc00acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc53ad640 1 --2- 172.21.15.67:0/308336978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc0159d60 0x7f5dc006ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc4bac640 1 -- 172.21.15.67:0/308336978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc0159d60 msgr2=0x7f5dc006ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc4bac640 1 --2- 172.21.15.67:0/308336978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc0159d60 0x7f5dc006ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc4bac640 1 -- 172.21.15.67:0/308336978 >> v2:172.21.15.97:3300/0 conn(0x7f5dc00b3510 msgr2=0x7f5dc00acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc4bac640 1 --2- 172.21.15.67:0/308336978 >> v2:172.21.15.97:3300/0 conn(0x7f5dc00b3510 0x7f5dc00acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc4bac640 1 -- 172.21.15.67:0/308336978 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc006e720 con 0x7f5dc006f460 2024-09-19T05:38:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc5bae640 1 --2- 172.21.15.67:0/308336978 >> v2:172.21.15.97:3300/0 conn(0x7f5dc00b3510 0x7f5dc00acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc53ad640 1 --2- 172.21.15.67:0/308336978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc0159d60 0x7f5dc006ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:22.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc4bac640 1 --2- 172.21.15.67:0/308336978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc006f460 0x7f5dc00b2fd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0071e10 tx=0x7f5db001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71307e2888cee22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:22.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5db7fff640 1 -- 172.21.15.67:0/308336978 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db00b0070 con 0x7f5dc006f460 2024-09-19T05:38:22.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5db7fff640 1 -- 172.21.15.67:0/308336978 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db00ab600 con 0x7f5dc006f460 2024-09-19T05:38:22.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5db7fff640 1 -- 172.21.15.67:0/308336978 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db00ab9d0 con 0x7f5dc006f460 2024-09-19T05:38:22.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc7611640 1 -- 172.21.15.67:0/308336978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc006f460 msgr2=0x7f5dc00b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc7611640 1 --2- 172.21.15.67:0/308336978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc006f460 0x7f5dc00b2fd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0071e10 tx=0x7f5db001c520 comp rx=0 tx=0).stop 2024-09-19T05:38:22.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc7611640 1 -- 172.21.15.67:0/308336978 shutdown_connections 2024-09-19T05:38:22.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc7611640 1 --2- 172.21.15.67:0/308336978 >> v2:172.21.15.97:3300/0 conn(0x7f5dc00b3510 0x7f5dc00acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc7611640 1 --2- 172.21.15.67:0/308336978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc006f460 0x7f5dc00b2fd0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc7611640 1 --2- 172.21.15.67:0/308336978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc0159d60 0x7f5dc006ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc7611640 1 -- 172.21.15.67:0/308336978 >> 172.21.15.67:0/308336978 conn(0x7f5dc00d0080 msgr2=0x7f5dc00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc7611640 1 -- 172.21.15.67:0/308336978 shutdown_connections 2024-09-19T05:38:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.356+0000 7f5dc7611640 1 -- 172.21.15.67:0/308336978 wait complete. 2024-09-19T05:38:22.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 Processor -- start 2024-09-19T05:38:22.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 -- start start 2024-09-19T05:38:22.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc006f460 0x7f5dc00ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc00b3510 0x7f5dc01454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc0159d60 0x7f5dc00b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc00af900 con 0x7f5dc0159d60 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc015fda0 con 0x7f5dc006f460 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc01547f0 con 0x7f5dc00b3510 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc5bae640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc0159d60 0x7f5dc00b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc5bae640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc0159d60 0x7f5dc00b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56826/0 (socket says 172.21.15.67:56826) 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc5bae640 1 -- 172.21.15.67:0/2504334575 learned_addr learned my addr 172.21.15.67:0/2504334575 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc4bac640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc00b3510 0x7f5dc01454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc53ad640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc006f460 0x7f5dc00ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc5bae640 1 -- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc00b3510 msgr2=0x7f5dc01454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc5bae640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc00b3510 0x7f5dc01454f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc5bae640 1 -- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc006f460 msgr2=0x7f5dc00ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc5bae640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc006f460 0x7f5dc00ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc5bae640 1 -- 172.21.15.67:0/2504334575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc0154a40 con 0x7f5dc0159d60 2024-09-19T05:38:22.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc5bae640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc0159d60 0x7f5dc00b05c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f5db800cf20 tx=0x7f5db800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:22.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5db5ffb640 1 -- 172.21.15.67:0/2504334575 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db801a070 con 0x7f5dc0159d60 2024-09-19T05:38:22.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5db5ffb640 1 -- 172.21.15.67:0/2504334575 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db800d840 con 0x7f5dc0159d60 2024-09-19T05:38:22.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5db5ffb640 1 -- 172.21.15.67:0/2504334575 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db800dc30 con 0x7f5dc0159d60 2024-09-19T05:38:22.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 -- 172.21.15.67:0/2504334575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc0154d20 con 0x7f5dc0159d60 2024-09-19T05:38:22.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 -- 172.21.15.67:0/2504334575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc01575b0 con 0x7f5dc0159d60 2024-09-19T05:38:22.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc7611640 1 -- 172.21.15.67:0/2504334575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc00acfb0 con 0x7f5dc0159d60 2024-09-19T05:38:22.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5db5ffb640 1 -- 172.21.15.67:0/2504334575 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5db801d070 con 0x7f5dc0159d60 2024-09-19T05:38:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5db5ffb640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5da40678c0 0x7f5da4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5db5ffb640 1 -- 172.21.15.67:0/2504334575 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f5db8086640 con 0x7f5dc0159d60 2024-09-19T05:38:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.360+0000 7f5dc53ad640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5da40678c0 0x7f5da4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.364+0000 7f5dc53ad640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5da40678c0 0x7f5da4069d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc006fd0 tx=0x7f5dbc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:22.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.364+0000 7f5db5ffb640 1 -- 172.21.15.67:0/2504334575 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5db8057080 con 0x7f5dc0159d60 2024-09-19T05:38:22.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.524+0000 7f5dc7611640 1 -- 172.21.15.67:0/2504334575 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5dc00d0f20 con 0x7f5da40678c0 2024-09-19T05:38:22.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.540+0000 7f5db5ffb640 1 -- 172.21.15.67:0/2504334575 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246753 (secure 0 0 0) 0x7f5dc00d0f20 con 0x7f5da40678c0 2024-09-19T05:38:22.547 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:22.549 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:38:22.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 -- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5da40678c0 msgr2=0x7f5da4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5da40678c0 0x7f5da4069d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc006fd0 tx=0x7f5dbc008040 comp rx=0 tx=0).stop 2024-09-19T05:38:22.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 -- 172.21.15.67:0/2504334575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc0159d60 msgr2=0x7f5dc00b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc0159d60 0x7f5dc00b05c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f5db800cf20 tx=0x7f5db800a7d0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 -- 172.21.15.67:0/2504334575 shutdown_connections 2024-09-19T05:38:22.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc0159d60 0x7f5dc00b05c0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5da40678c0 0x7f5da4069d80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5dc00b3510 0x7f5dc01454f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 --2- 172.21.15.67:0/2504334575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc006f460 0x7f5dc00ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 -- 172.21.15.67:0/2504334575 >> 172.21.15.67:0/2504334575 conn(0x7f5dc00d0080 msgr2=0x7f5dc015d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:22.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 -- 172.21.15.67:0/2504334575 shutdown_connections 2024-09-19T05:38:22.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.544+0000 7f5dc7611640 1 -- 172.21.15.67:0/2504334575 wait complete. 2024-09-19T05:38:22.564 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-09-19T05:38:21.212746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":343212,"kb_used_data":8992,"kb_used_omap":12,"kb_used_meta":334003,"kb_avail":754631508,"statfs":{"total":773094113280,"available":772742664192,"internally_reserved":0,"allocated":9207808,"data_stored":4876742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":342019633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.111346"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.113069+0000","last_change":"2024-09-19T05:38:17.113069+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.113069+0000","last_undegraded":"2024-09-19T05:38:17.113069+0000","last_fullsized":"2024-09-19T05:38:17.113069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125176+0000","last_change":"2024-09-19T05:38:17.125176+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125176+0000","last_undegraded":"2024-09-19T05:38:17.125176+0000","last_fullsized":"2024-09-19T05:38:17.125176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.118953+0000","last_change":"2024-09-19T05:38:17.118953+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.118953+0000","last_undegraded":"2024-09-19T05:38:17.118953+0000","last_fullsized":"2024-09-19T05:38:17.118953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125286+0000","last_change":"2024-09-19T05:38:17.125286+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125286+0000","last_undegraded":"2024-09-19T05:38:17.125286+0000","last_fullsized":"2024-09-19T05:38:17.125286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129675+0000","last_change":"2024-09-19T05:38:17.129675+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129675+0000","last_undegraded":"2024-09-19T05:38:17.129675+0000","last_fullsized":"2024-09-19T05:38:17.129675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129863+0000","last_change":"2024-09-19T05:38:17.129863+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129863+0000","last_undegraded":"2024-09-19T05:38:17.129863+0000","last_fullsized":"2024-09-19T05:38:17.129863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128301+0000","last_change":"2024-09-19T05:38:17.128301+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128301+0000","last_undegraded":"2024-09-19T05:38:17.128301+0000","last_fullsized":"2024-09-19T05:38:17.128301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128631+0000","last_change":"2024-09-19T05:38:17.128631+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128631+0000","last_undegraded":"2024-09-19T05:38:17.128631+0000","last_fullsized":"2024-09-19T05:38:17.128631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.117959+0000","last_change":"2024-09-19T05:38:17.117959+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.117959+0000","last_undegraded":"2024-09-19T05:38:17.117959+0000","last_fullsized":"2024-09-19T05:38:17.117959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.137607+0000","last_change":"2024-09-19T05:38:17.137607+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.137607+0000","last_undegraded":"2024-09-19T05:38:17.137607+0000","last_fullsized":"2024-09-19T05:38:17.137607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.126744+0000","last_change":"2024-09-19T05:38:17.126744+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.126744+0000","last_undegraded":"2024-09-19T05:38:17.126744+0000","last_fullsized":"2024-09-19T05:38:17.126744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.124288+0000","last_change":"2024-09-19T05:38:17.124288+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.124288+0000","last_undegraded":"2024-09-19T05:38:17.124288+0000","last_fullsized":"2024-09-19T05:38:17.124288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128547+0000","last_change":"2024-09-19T05:38:17.128547+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128547+0000","last_undegraded":"2024-09-19T05:38:17.128547+0000","last_fullsized":"2024-09-19T05:38:17.128547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129179+0000","last_change":"2024-09-19T05:38:17.129179+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129179+0000","last_undegraded":"2024-09-19T05:38:17.129179+0000","last_fullsized":"2024-09-19T05:38:17.129179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.126195+0000","last_change":"2024-09-19T05:38:17.126195+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.126195+0000","last_undegraded":"2024-09-19T05:38:17.126195+0000","last_fullsized":"2024-09-19T05:38:17.126195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.113414+0000","last_change":"2024-09-19T05:38:17.113414+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.113414+0000","last_undegraded":"2024-09-19T05:38:17.113414+0000","last_fullsized":"2024-09-19T05:38:17.113414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128874+0000","last_change":"2024-09-19T05:38:17.128874+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128874+0000","last_undegraded":"2024-09-19T05:38:17.128874+0000","last_fullsized":"2024-09-19T05:38:17.128874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.117053+0000","last_change":"2024-09-19T05:38:17.117053+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.117053+0000","last_undegraded":"2024-09-19T05:38:17.117053+0000","last_fullsized":"2024-09-19T05:38:17.117053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127487+0000","last_change":"2024-09-19T05:38:17.127487+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127487+0000","last_undegraded":"2024-09-19T05:38:17.127487+0000","last_fullsized":"2024-09-19T05:38:17.127487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129383+0000","last_change":"2024-09-19T05:38:17.129383+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129383+0000","last_undegraded":"2024-09-19T05:38:17.129383+0000","last_fullsized":"2024-09-19T05:38:17.129383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.123062+0000","last_change":"2024-09-19T05:38:17.123062+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.123062+0000","last_undegraded":"2024-09-19T05:38:17.123062+0000","last_fullsized":"2024-09-19T05:38:17.123062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128314+0000","last_change":"2024-09-19T05:38:17.128314+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128314+0000","last_undegraded":"2024-09-19T05:38:17.128314+0000","last_fullsized":"2024-09-19T05:38:17.128314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.119065+0000","last_change":"2024-09-19T05:38:17.119065+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.119065+0000","last_undegraded":"2024-09-19T05:38:17.119065+0000","last_fullsized":"2024-09-19T05:38:17.119065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125744+0000","last_change":"2024-09-19T05:38:17.125744+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125744+0000","last_undegraded":"2024-09-19T05:38:17.125744+0000","last_fullsized":"2024-09-19T05:38:17.125744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125399+0000","last_change":"2024-09-19T05:38:17.125399+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125399+0000","last_undegraded":"2024-09-19T05:38:17.125399+0000","last_fullsized":"2024-09-19T05:38:17.125399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.123051+0000","last_change":"2024-09-19T05:38:17.123051+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.123051+0000","last_undegraded":"2024-09-19T05:38:17.123051+0000","last_fullsized":"2024-09-19T05:38:17.123051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.113418+0000","last_change":"2024-09-19T05:38:17.113418+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.113418+0000","last_undegraded":"2024-09-19T05:38:17.113418+0000","last_fullsized":"2024-09-19T05:38:17.113418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127810+0000","last_change":"2024-09-19T05:38:17.127810+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127810+0000","last_undegraded":"2024-09-19T05:38:17.127810+0000","last_fullsized":"2024-09-19T05:38:17.127810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.124900+0000","last_change":"2024-09-19T05:38:17.124900+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.124900+0000","last_undegraded":"2024-09-19T05:38:17.124900+0000","last_fullsized":"2024-09-19T05:38:17.124900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.112073+0000","last_change":"2024-09-19T05:38:17.112073+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.112073+0000","last_undegraded":"2024-09-19T05:38:17.112073+0000","last_fullsized":"2024-09-19T05:38:17.112073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.115782+0000","last_change":"2024-09-19T05:38:17.115782+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.115782+0000","last_undegraded":"2024-09-19T05:38:17.115782+0000","last_fullsized":"2024-09-19T05:38:17.115782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.111923+0000","last_change":"2024-09-19T05:38:17.111923+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.111923+0000","last_undegraded":"2024-09-19T05:38:17.111923+0000","last_fullsized":"2024-09-19T05:38:17.111923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.118698+0000","last_change":"2024-09-19T05:38:17.118698+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.118698+0000","last_undegraded":"2024-09-19T05:38:17.118698+0000","last_fullsized":"2024-09-19T05:38:17.118698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.129960+0000","last_change":"2024-09-19T05:38:17.125550+0000","last_active":"2024-09-19T05:38:17.129960+0000","last_peered":"2024-09-19T05:38:17.129960+0000","last_clean":"2024-09-19T05:38:17.129960+0000","last_became_active":"2024-09-19T05:38:17.125194+0000","last_became_peered":"2024-09-19T05:38:17.125194+0000","last_unstale":"2024-09-19T05:38:17.129960+0000","last_undegraded":"2024-09-19T05:38:17.129960+0000","last_fullsized":"2024-09-19T05:38:17.129960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:15.003301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122580+0000","last_change":"2024-09-19T05:38:17.122580+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122580+0000","last_undegraded":"2024-09-19T05:38:17.122580+0000","last_fullsized":"2024-09-19T05:38:17.122580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152123+0000","last_change":"2024-09-19T05:38:17.151155+0000","last_active":"2024-09-19T05:38:17.152123+0000","last_peered":"2024-09-19T05:38:17.152123+0000","last_clean":"2024-09-19T05:38:17.152123+0000","last_became_active":"2024-09-19T05:38:17.150121+0000","last_became_peered":"2024-09-19T05:38:17.150121+0000","last_unstale":"2024-09-19T05:38:17.152123+0000","last_undegraded":"2024-09-19T05:38:17.152123+0000","last_fullsized":"2024-09-19T05:38:17.152123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:23.916230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.121152+0000","last_change":"2024-09-19T05:38:17.121152+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.121152+0000","last_undegraded":"2024-09-19T05:38:17.121152+0000","last_fullsized":"2024-09-19T05:38:17.121152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.134394+0000","last_change":"2024-09-19T05:38:17.127521+0000","last_active":"2024-09-19T05:38:17.134394+0000","last_peered":"2024-09-19T05:38:17.134394+0000","last_clean":"2024-09-19T05:38:17.134394+0000","last_became_active":"2024-09-19T05:38:17.125524+0000","last_became_peered":"2024-09-19T05:38:17.125524+0000","last_unstale":"2024-09-19T05:38:17.134394+0000","last_undegraded":"2024-09-19T05:38:17.134394+0000","last_fullsized":"2024-09-19T05:38:17.134394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:36.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122053+0000","last_change":"2024-09-19T05:38:17.122053+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122053+0000","last_undegraded":"2024-09-19T05:38:17.122053+0000","last_fullsized":"2024-09-19T05:38:17.122053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152965+0000","last_change":"2024-09-19T05:38:17.146072+0000","last_active":"2024-09-19T05:38:17.152965+0000","last_peered":"2024-09-19T05:38:17.152965+0000","last_clean":"2024-09-19T05:38:17.152965+0000","last_became_active":"2024-09-19T05:38:17.145049+0000","last_became_peered":"2024-09-19T05:38:17.145049+0000","last_unstale":"2024-09-19T05:38:17.152965+0000","last_undegraded":"2024-09-19T05:38:17.152965+0000","last_fullsized":"2024-09-19T05:38:17.152965+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:54.774053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125023+0000","last_change":"2024-09-19T05:38:17.125023+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125023+0000","last_undegraded":"2024-09-19T05:38:17.125023+0000","last_fullsized":"2024-09-19T05:38:17.125023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146366+0000","last_change":"2024-09-19T05:38:17.142355+0000","last_active":"2024-09-19T05:38:17.146366+0000","last_peered":"2024-09-19T05:38:17.146366+0000","last_clean":"2024-09-19T05:38:17.146366+0000","last_became_active":"2024-09-19T05:38:17.140750+0000","last_became_peered":"2024-09-19T05:38:17.140750+0000","last_unstale":"2024-09-19T05:38:17.146366+0000","last_undegraded":"2024-09-19T05:38:17.146366+0000","last_fullsized":"2024-09-19T05:38:17.146366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:23.103718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125195+0000","last_change":"2024-09-19T05:38:17.125195+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125195+0000","last_undegraded":"2024-09-19T05:38:17.125195+0000","last_fullsized":"2024-09-19T05:38:17.125195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.145238+0000","last_change":"2024-09-19T05:38:17.141855+0000","last_active":"2024-09-19T05:38:17.145238+0000","last_peered":"2024-09-19T05:38:17.145238+0000","last_clean":"2024-09-19T05:38:17.145238+0000","last_became_active":"2024-09-19T05:38:17.140748+0000","last_became_peered":"2024-09-19T05:38:17.140748+0000","last_unstale":"2024-09-19T05:38:17.145238+0000","last_undegraded":"2024-09-19T05:38:17.145238+0000","last_fullsized":"2024-09-19T05:38:17.145238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:32.631014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.117911+0000","last_change":"2024-09-19T05:38:17.117911+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.117911+0000","last_undegraded":"2024-09-19T05:38:17.117911+0000","last_fullsized":"2024-09-19T05:38:17.117911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.139125+0000","last_change":"2024-09-19T05:38:17.138271+0000","last_active":"2024-09-19T05:38:17.139125+0000","last_peered":"2024-09-19T05:38:17.139125+0000","last_clean":"2024-09-19T05:38:17.139125+0000","last_became_active":"2024-09-19T05:38:17.137963+0000","last_became_peered":"2024-09-19T05:38:17.137963+0000","last_unstale":"2024-09-19T05:38:17.139125+0000","last_undegraded":"2024-09-19T05:38:17.139125+0000","last_fullsized":"2024-09-19T05:38:17.139125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:06.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.132834+0000","last_change":"2024-09-19T05:38:17.132834+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.132834+0000","last_undegraded":"2024-09-19T05:38:17.132834+0000","last_fullsized":"2024-09-19T05:38:17.132834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.136394+0000","last_change":"2024-09-19T05:38:17.132639+0000","last_active":"2024-09-19T05:38:17.136394+0000","last_peered":"2024-09-19T05:38:17.136394+0000","last_clean":"2024-09-19T05:38:17.136394+0000","last_became_active":"2024-09-19T05:38:17.132240+0000","last_became_peered":"2024-09-19T05:38:17.132240+0000","last_unstale":"2024-09-19T05:38:17.136394+0000","last_undegraded":"2024-09-19T05:38:17.136394+0000","last_fullsized":"2024-09-19T05:38:17.136394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:09.666947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122116+0000","last_change":"2024-09-19T05:38:17.122116+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122116+0000","last_undegraded":"2024-09-19T05:38:17.122116+0000","last_fullsized":"2024-09-19T05:38:17.122116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.140936+0000","last_change":"2024-09-19T05:38:17.137642+0000","last_active":"2024-09-19T05:38:17.140936+0000","last_peered":"2024-09-19T05:38:17.140936+0000","last_clean":"2024-09-19T05:38:17.140936+0000","last_became_active":"2024-09-19T05:38:17.136920+0000","last_became_peered":"2024-09-19T05:38:17.136920+0000","last_unstale":"2024-09-19T05:38:17.140936+0000","last_undegraded":"2024-09-19T05:38:17.140936+0000","last_fullsized":"2024-09-19T05:38:17.140936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:39.495532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.120956+0000","last_change":"2024-09-19T05:38:17.120956+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.120956+0000","last_undegraded":"2024-09-19T05:38:17.120956+0000","last_fullsized":"2024-09-19T05:38:17.120956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.151145+0000","last_change":"2024-09-19T05:38:17.149660+0000","last_active":"2024-09-19T05:38:17.151145+0000","last_peered":"2024-09-19T05:38:17.151145+0000","last_clean":"2024-09-19T05:38:17.151145+0000","last_became_active":"2024-09-19T05:38:17.147750+0000","last_became_peered":"2024-09-19T05:38:17.147750+0000","last_unstale":"2024-09-19T05:38:17.151145+0000","last_undegraded":"2024-09-19T05:38:17.151145+0000","last_fullsized":"2024-09-19T05:38:17.151145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:11.415272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127487+0000","last_change":"2024-09-19T05:38:17.127487+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127487+0000","last_undegraded":"2024-09-19T05:38:17.127487+0000","last_fullsized":"2024-09-19T05:38:17.127487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.134224+0000","last_change":"2024-09-19T05:38:17.132043+0000","last_active":"2024-09-19T05:38:17.134224+0000","last_peered":"2024-09-19T05:38:17.134224+0000","last_clean":"2024-09-19T05:38:17.134224+0000","last_became_active":"2024-09-19T05:38:17.130901+0000","last_became_peered":"2024-09-19T05:38:17.130901+0000","last_unstale":"2024-09-19T05:38:17.134224+0000","last_undegraded":"2024-09-19T05:38:17.134224+0000","last_fullsized":"2024-09-19T05:38:17.134224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:28.975858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.116219+0000","last_change":"2024-09-19T05:38:17.116219+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.116219+0000","last_undegraded":"2024-09-19T05:38:17.116219+0000","last_fullsized":"2024-09-19T05:38:17.116219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.154193+0000","last_change":"2024-09-19T05:38:17.152541+0000","last_active":"2024-09-19T05:38:17.154193+0000","last_peered":"2024-09-19T05:38:17.154193+0000","last_clean":"2024-09-19T05:38:17.154193+0000","last_became_active":"2024-09-19T05:38:17.152060+0000","last_became_peered":"2024-09-19T05:38:17.152060+0000","last_unstale":"2024-09-19T05:38:17.154193+0000","last_undegraded":"2024-09-19T05:38:17.154193+0000","last_fullsized":"2024-09-19T05:38:17.154193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:56.465721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122901+0000","last_change":"2024-09-19T05:38:17.122901+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122901+0000","last_undegraded":"2024-09-19T05:38:17.122901+0000","last_fullsized":"2024-09-19T05:38:17.122901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.150691+0000","last_change":"2024-09-19T05:38:17.148263+0000","last_active":"2024-09-19T05:38:17.150691+0000","last_peered":"2024-09-19T05:38:17.150691+0000","last_clean":"2024-09-19T05:38:17.150691+0000","last_became_active":"2024-09-19T05:38:17.147503+0000","last_became_peered":"2024-09-19T05:38:17.147503+0000","last_unstale":"2024-09-19T05:38:17.150691+0000","last_undegraded":"2024-09-19T05:38:17.150691+0000","last_fullsized":"2024-09-19T05:38:17.150691+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:20.466988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.126638+0000","last_change":"2024-09-19T05:38:17.126638+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.126638+0000","last_undegraded":"2024-09-19T05:38:17.126638+0000","last_fullsized":"2024-09-19T05:38:17.126638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.144153+0000","last_change":"2024-09-19T05:38:17.128306+0000","last_active":"2024-09-19T05:38:17.144153+0000","last_peered":"2024-09-19T05:38:17.144153+0000","last_clean":"2024-09-19T05:38:17.144153+0000","last_became_active":"2024-09-19T05:38:17.127570+0000","last_became_peered":"2024-09-19T05:38:17.127570+0000","last_unstale":"2024-09-19T05:38:17.144153+0000","last_undegraded":"2024-09-19T05:38:17.144153+0000","last_fullsized":"2024-09-19T05:38:17.144153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:06.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127620+0000","last_change":"2024-09-19T05:38:17.127620+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127620+0000","last_undegraded":"2024-09-19T05:38:17.127620+0000","last_fullsized":"2024-09-19T05:38:17.127620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.128581+0000","last_change":"2024-09-19T05:38:17.124389+0000","last_active":"2024-09-19T05:38:17.128581+0000","last_peered":"2024-09-19T05:38:17.128581+0000","last_clean":"2024-09-19T05:38:17.128581+0000","last_became_active":"2024-09-19T05:38:17.124116+0000","last_became_peered":"2024-09-19T05:38:17.124116+0000","last_unstale":"2024-09-19T05:38:17.128581+0000","last_undegraded":"2024-09-19T05:38:17.128581+0000","last_fullsized":"2024-09-19T05:38:17.128581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.799473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.131865+0000","last_change":"2024-09-19T05:38:17.131865+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.131865+0000","last_undegraded":"2024-09-19T05:38:17.131865+0000","last_fullsized":"2024-09-19T05:38:17.131865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.153342+0000","last_change":"2024-09-19T05:38:17.152926+0000","last_active":"2024-09-19T05:38:17.153342+0000","last_peered":"2024-09-19T05:38:17.153342+0000","last_clean":"2024-09-19T05:38:17.153342+0000","last_became_active":"2024-09-19T05:38:17.152633+0000","last_became_peered":"2024-09-19T05:38:17.152633+0000","last_unstale":"2024-09-19T05:38:17.153342+0000","last_undegraded":"2024-09-19T05:38:17.153342+0000","last_fullsized":"2024-09-19T05:38:17.153342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:39.495532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127062+0000","last_change":"2024-09-19T05:38:17.127062+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127062+0000","last_undegraded":"2024-09-19T05:38:17.127062+0000","last_fullsized":"2024-09-19T05:38:17.127062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.153463+0000","last_change":"2024-09-19T05:38:17.148055+0000","last_active":"2024-09-19T05:38:17.153463+0000","last_peered":"2024-09-19T05:38:17.153463+0000","last_clean":"2024-09-19T05:38:17.153463+0000","last_became_active":"2024-09-19T05:38:17.147402+0000","last_became_peered":"2024-09-19T05:38:17.147402+0000","last_unstale":"2024-09-19T05:38:17.153463+0000","last_undegraded":"2024-09-19T05:38:17.153463+0000","last_fullsized":"2024-09-19T05:38:17.153463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:35.931949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127540+0000","last_change":"2024-09-19T05:38:17.127540+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127540+0000","last_undegraded":"2024-09-19T05:38:17.127540+0000","last_fullsized":"2024-09-19T05:38:17.127540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.145234+0000","last_change":"2024-09-19T05:38:17.132750+0000","last_active":"2024-09-19T05:38:17.145234+0000","last_peered":"2024-09-19T05:38:17.145234+0000","last_clean":"2024-09-19T05:38:17.145234+0000","last_became_active":"2024-09-19T05:38:17.132035+0000","last_became_peered":"2024-09-19T05:38:17.132035+0000","last_unstale":"2024-09-19T05:38:17.145234+0000","last_undegraded":"2024-09-19T05:38:17.145234+0000","last_fullsized":"2024-09-19T05:38:17.145234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:25.245347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127631+0000","last_change":"2024-09-19T05:38:17.127631+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127631+0000","last_undegraded":"2024-09-19T05:38:17.127631+0000","last_fullsized":"2024-09-19T05:38:17.127631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.138909+0000","last_change":"2024-09-19T05:38:17.137253+0000","last_active":"2024-09-19T05:38:17.138909+0000","last_peered":"2024-09-19T05:38:17.138909+0000","last_clean":"2024-09-19T05:38:17.138909+0000","last_became_active":"2024-09-19T05:38:17.136921+0000","last_became_peered":"2024-09-19T05:38:17.136921+0000","last_unstale":"2024-09-19T05:38:17.138909+0000","last_undegraded":"2024-09-19T05:38:17.138909+0000","last_fullsized":"2024-09-19T05:38:17.138909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:22.837311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128271+0000","last_change":"2024-09-19T05:38:17.128271+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128271+0000","last_undegraded":"2024-09-19T05:38:17.128271+0000","last_fullsized":"2024-09-19T05:38:17.128271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.140639+0000","last_change":"2024-09-19T05:38:17.133484+0000","last_active":"2024-09-19T05:38:17.140639+0000","last_peered":"2024-09-19T05:38:17.140639+0000","last_clean":"2024-09-19T05:38:17.140639+0000","last_became_active":"2024-09-19T05:38:17.133155+0000","last_became_peered":"2024-09-19T05:38:17.133155+0000","last_unstale":"2024-09-19T05:38:17.140639+0000","last_undegraded":"2024-09-19T05:38:17.140639+0000","last_fullsized":"2024-09-19T05:38:17.140639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:18.374097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122399+0000","last_change":"2024-09-19T05:38:17.122399+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122399+0000","last_undegraded":"2024-09-19T05:38:17.122399+0000","last_fullsized":"2024-09-19T05:38:17.122399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.129796+0000","last_change":"2024-09-19T05:38:17.122267+0000","last_active":"2024-09-19T05:38:17.129796+0000","last_peered":"2024-09-19T05:38:17.129796+0000","last_clean":"2024-09-19T05:38:17.129796+0000","last_became_active":"2024-09-19T05:38:17.121874+0000","last_became_peered":"2024-09-19T05:38:17.121874+0000","last_unstale":"2024-09-19T05:38:17.129796+0000","last_undegraded":"2024-09-19T05:38:17.129796+0000","last_fullsized":"2024-09-19T05:38:17.129796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:35.177608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.123069+0000","last_change":"2024-09-19T05:38:17.123069+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.123069+0000","last_undegraded":"2024-09-19T05:38:17.123069+0000","last_fullsized":"2024-09-19T05:38:17.123069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.147031+0000","last_change":"2024-09-19T05:38:17.146511+0000","last_active":"2024-09-19T05:38:17.147031+0000","last_peered":"2024-09-19T05:38:17.147031+0000","last_clean":"2024-09-19T05:38:17.147031+0000","last_became_active":"2024-09-19T05:38:17.145962+0000","last_became_peered":"2024-09-19T05:38:17.145962+0000","last_unstale":"2024-09-19T05:38:17.147031+0000","last_undegraded":"2024-09-19T05:38:17.147031+0000","last_fullsized":"2024-09-19T05:38:17.147031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:14.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.130810+0000","last_change":"2024-09-19T05:38:17.130810+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.130810+0000","last_undegraded":"2024-09-19T05:38:17.130810+0000","last_fullsized":"2024-09-19T05:38:17.130810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146515+0000","last_change":"2024-09-19T05:38:17.145847+0000","last_active":"2024-09-19T05:38:17.146515+0000","last_peered":"2024-09-19T05:38:17.146515+0000","last_clean":"2024-09-19T05:38:17.146515+0000","last_became_active":"2024-09-19T05:38:17.145601+0000","last_became_peered":"2024-09-19T05:38:17.145601+0000","last_unstale":"2024-09-19T05:38:17.146515+0000","last_undegraded":"2024-09-19T05:38:17.146515+0000","last_fullsized":"2024-09-19T05:38:17.146515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:23.796246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.118006+0000","last_change":"2024-09-19T05:38:17.118006+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.118006+0000","last_undegraded":"2024-09-19T05:38:17.118006+0000","last_fullsized":"2024-09-19T05:38:17.118006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.145600+0000","last_change":"2024-09-19T05:38:17.143027+0000","last_active":"2024-09-19T05:38:17.145600+0000","last_peered":"2024-09-19T05:38:17.145600+0000","last_clean":"2024-09-19T05:38:17.145600+0000","last_became_active":"2024-09-19T05:38:17.142268+0000","last_became_peered":"2024-09-19T05:38:17.142268+0000","last_unstale":"2024-09-19T05:38:17.145600+0000","last_undegraded":"2024-09-19T05:38:17.145600+0000","last_fullsized":"2024-09-19T05:38:17.145600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:56.757853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127199+0000","last_change":"2024-09-19T05:38:17.127199+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127199+0000","last_undegraded":"2024-09-19T05:38:17.127199+0000","last_fullsized":"2024-09-19T05:38:17.127199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.130921+0000","last_change":"2024-09-19T05:38:17.126066+0000","last_active":"2024-09-19T05:38:17.130921+0000","last_peered":"2024-09-19T05:38:17.130921+0000","last_clean":"2024-09-19T05:38:17.130921+0000","last_became_active":"2024-09-19T05:38:17.125791+0000","last_became_peered":"2024-09-19T05:38:17.125791+0000","last_unstale":"2024-09-19T05:38:17.130921+0000","last_undegraded":"2024-09-19T05:38:17.130921+0000","last_fullsized":"2024-09-19T05:38:17.130921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:36.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.119687+0000","last_change":"2024-09-19T05:38:17.119687+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.119687+0000","last_undegraded":"2024-09-19T05:38:17.119687+0000","last_fullsized":"2024-09-19T05:38:17.119687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146906+0000","last_change":"2024-09-19T05:38:17.144370+0000","last_active":"2024-09-19T05:38:17.146906+0000","last_peered":"2024-09-19T05:38:17.146906+0000","last_clean":"2024-09-19T05:38:17.146906+0000","last_became_active":"2024-09-19T05:38:17.143606+0000","last_became_peered":"2024-09-19T05:38:17.143606+0000","last_unstale":"2024-09-19T05:38:17.146906+0000","last_undegraded":"2024-09-19T05:38:17.146906+0000","last_fullsized":"2024-09-19T05:38:17.146906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:04.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122090+0000","last_change":"2024-09-19T05:38:17.122090+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122090+0000","last_undegraded":"2024-09-19T05:38:17.122090+0000","last_fullsized":"2024-09-19T05:38:17.122090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152105+0000","last_change":"2024-09-19T05:38:17.150784+0000","last_active":"2024-09-19T05:38:17.152105+0000","last_peered":"2024-09-19T05:38:17.152105+0000","last_clean":"2024-09-19T05:38:17.152105+0000","last_became_active":"2024-09-19T05:38:17.149985+0000","last_became_peered":"2024-09-19T05:38:17.149985+0000","last_unstale":"2024-09-19T05:38:17.152105+0000","last_undegraded":"2024-09-19T05:38:17.152105+0000","last_fullsized":"2024-09-19T05:38:17.152105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:31.104896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.133830+0000","last_change":"2024-09-19T05:38:17.133830+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.133830+0000","last_undegraded":"2024-09-19T05:38:17.133830+0000","last_fullsized":"2024-09-19T05:38:17.133830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.148702+0000","last_change":"2024-09-19T05:38:17.137447+0000","last_active":"2024-09-19T05:38:17.148702+0000","last_peered":"2024-09-19T05:38:17.148702+0000","last_clean":"2024-09-19T05:38:17.148702+0000","last_became_active":"2024-09-19T05:38:17.136760+0000","last_became_peered":"2024-09-19T05:38:17.136760+0000","last_unstale":"2024-09-19T05:38:17.148702+0000","last_undegraded":"2024-09-19T05:38:17.148702+0000","last_fullsized":"2024-09-19T05:38:17.148702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:07.700921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125393+0000","last_change":"2024-09-19T05:38:17.125393+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125393+0000","last_undegraded":"2024-09-19T05:38:17.125393+0000","last_fullsized":"2024-09-19T05:38:17.125393+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.138822+0000","last_change":"2024-09-19T05:38:17.136157+0000","last_active":"2024-09-19T05:38:17.138822+0000","last_peered":"2024-09-19T05:38:17.138822+0000","last_clean":"2024-09-19T05:38:17.138822+0000","last_became_active":"2024-09-19T05:38:17.135724+0000","last_became_peered":"2024-09-19T05:38:17.135724+0000","last_unstale":"2024-09-19T05:38:17.138822+0000","last_undegraded":"2024-09-19T05:38:17.138822+0000","last_fullsized":"2024-09-19T05:38:17.138822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:52.678154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.116563+0000","last_change":"2024-09-19T05:38:17.116563+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.116563+0000","last_undegraded":"2024-09-19T05:38:17.116563+0000","last_fullsized":"2024-09-19T05:38:17.116563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152654+0000","last_change":"2024-09-19T05:38:17.145925+0000","last_active":"2024-09-19T05:38:17.152654+0000","last_peered":"2024-09-19T05:38:17.152654+0000","last_clean":"2024-09-19T05:38:17.152654+0000","last_became_active":"2024-09-19T05:38:17.145324+0000","last_became_peered":"2024-09-19T05:38:17.145324+0000","last_unstale":"2024-09-19T05:38:17.152654+0000","last_undegraded":"2024-09-19T05:38:17.152654+0000","last_fullsized":"2024-09-19T05:38:17.152654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:35.194554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.119391+0000","last_change":"2024-09-19T05:38:17.119391+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.119391+0000","last_undegraded":"2024-09-19T05:38:17.119391+0000","last_fullsized":"2024-09-19T05:38:17.119391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.130041+0000","last_change":"2024-09-19T05:38:17.123000+0000","last_active":"2024-09-19T05:38:17.130041+0000","last_peered":"2024-09-19T05:38:17.130041+0000","last_clean":"2024-09-19T05:38:17.130041+0000","last_became_active":"2024-09-19T05:38:17.121818+0000","last_became_peered":"2024-09-19T05:38:17.121818+0000","last_unstale":"2024-09-19T05:38:17.130041+0000","last_undegraded":"2024-09-19T05:38:17.130041+0000","last_fullsized":"2024-09-19T05:38:17.130041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:59.045847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.112050+0000","last_change":"2024-09-19T05:38:17.112050+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.112050+0000","last_undegraded":"2024-09-19T05:38:17.112050+0000","last_fullsized":"2024-09-19T05:38:17.112050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146769+0000","last_change":"2024-09-19T05:38:17.146047+0000","last_active":"2024-09-19T05:38:17.146769+0000","last_peered":"2024-09-19T05:38:17.146769+0000","last_clean":"2024-09-19T05:38:17.146769+0000","last_became_active":"2024-09-19T05:38:17.145623+0000","last_became_peered":"2024-09-19T05:38:17.145623+0000","last_unstale":"2024-09-19T05:38:17.146769+0000","last_undegraded":"2024-09-19T05:38:17.146769+0000","last_fullsized":"2024-09-19T05:38:17.146769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:41.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.114263+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:38:17.114263+0000","last_peered":"2024-09-19T05:38:17.114263+0000","last_clean":"2024-09-19T05:38:17.114263+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:38:17.114263+0000","last_undegraded":"2024-09-19T05:38:17.114263+0000","last_fullsized":"2024-09-19T05:38:17.114263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542209,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50804,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321036,"statfs":{"total":96636764160,"available":96584740864,"internally_reserved":0,"allocated":1605632,"data_stored":1057369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542211,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46064,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325776,"statfs":{"total":96636764160,"available":96589594624,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46056,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325784,"statfs":{"total":96636764160,"available":96589602816,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542212,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542209,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":1057369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:22.568 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:22.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f7156149640 1 Processor -- start 2024-09-19T05:38:22.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f7156149640 1 -- start start 2024-09-19T05:38:22.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f7156149640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f715015b1e0 0x7f71500b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f7156149640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f71500b4900 0x7f7150071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f7156149640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71500b3860 con 0x7f71500723c0 2024-09-19T05:38:22.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f7156149640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f715015b5c0 con 0x7f715015b1e0 2024-09-19T05:38:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f7156149640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f71500b3b40 con 0x7f71500b4900 2024-09-19T05:38:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f714f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f715015b1e0 0x7f71500b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f714f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f715015b1e0 0x7f71500b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56828/0 (socket says 172.21.15.67:56828) 2024-09-19T05:38:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f714f7fe640 1 -- 172.21.15.67:0/2814725192 learned_addr learned my addr 172.21.15.67:0/2814725192 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f714effd640 1 --2- 172.21.15.67:0/2814725192 >> v2:172.21.15.97:3300/0 conn(0x7f71500b4900 0x7f7150071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f714f7fe640 1 -- 172.21.15.67:0/2814725192 >> v2:172.21.15.97:3300/0 conn(0x7f71500b4900 msgr2=0x7f7150071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f714f7fe640 1 --2- 172.21.15.67:0/2814725192 >> v2:172.21.15.97:3300/0 conn(0x7f71500b4900 0x7f7150071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f714f7fe640 1 -- 172.21.15.67:0/2814725192 >> v1:172.21.15.67:6789/0 conn(0x7f71500723c0 legacy=0x7f715015ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f714f7fe640 1 -- 172.21.15.67:0/2814725192 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71500b3e20 con 0x7f715015b1e0 2024-09-19T05:38:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.728+0000 7f714e7fc640 1 -- 172.21.15.67:0/2814725192 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124049906 0 0) 0x7f71500b3860 con 0x7f71500723c0 2024-09-19T05:38:22.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f714f7fe640 1 --2- 172.21.15.67:0/2814725192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 0x7f71500b2fd0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f71500ad2e0 tx=0x7f714001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2b4c22ec7daf81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:22.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f714e7fc640 1 -- 172.21.15.67:0/2814725192 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71400aa670 con 0x7f715015b1e0 2024-09-19T05:38:22.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f714e7fc640 1 -- 172.21.15.67:0/2814725192 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71400af070 con 0x7f715015b1e0 2024-09-19T05:38:22.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f714e7fc640 1 -- 172.21.15.67:0/2814725192 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71400aaa30 con 0x7f715015b1e0 2024-09-19T05:38:22.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f7156149640 1 -- 172.21.15.67:0/2814725192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 msgr2=0x7f71500b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f7156149640 1 --2- 172.21.15.67:0/2814725192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 0x7f71500b2fd0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f71500ad2e0 tx=0x7f714001c4f0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f7156149640 1 -- 172.21.15.67:0/2814725192 shutdown_connections 2024-09-19T05:38:22.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f7156149640 1 --2- 172.21.15.67:0/2814725192 >> v2:172.21.15.97:3300/0 conn(0x7f71500b4900 0x7f7150071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f7156149640 1 --2- 172.21.15.67:0/2814725192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 0x7f71500b2fd0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f7156149640 1 -- 172.21.15.67:0/2814725192 >> 172.21.15.67:0/2814725192 conn(0x7f71500d0080 msgr2=0x7f71500d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:22.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f7156149640 1 -- 172.21.15.67:0/2814725192 shutdown_connections 2024-09-19T05:38:22.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f7156149640 1 -- 172.21.15.67:0/2814725192 wait complete. 2024-09-19T05:38:22.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f7156149640 1 Processor -- start 2024-09-19T05:38:22.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.732+0000 7f7156149640 1 -- start start 2024-09-19T05:38:22.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7156149640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500723c0 0x7f715014ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7156149640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71500b4900 0x7f7150099950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7156149640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 0x7f715014e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7156149640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7150168060 con 0x7f715015b1e0 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7156149640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f71500b3510 con 0x7f71500723c0 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7156149640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f71501681e0 con 0x7f71500b4900 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 0x7f715014e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 0x7f715014e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56830/0 (socket says 172.21.15.67:56830) 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714ffff640 1 -- 172.21.15.67:0/2186086566 learned_addr learned my addr 172.21.15.67:0/2186086566 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714f7fe640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500723c0 0x7f715014ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714effd640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71500b4900 0x7f7150099950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714ffff640 1 -- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71500b4900 msgr2=0x7f7150099950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714ffff640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71500b4900 0x7f7150099950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714ffff640 1 -- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500723c0 msgr2=0x7f715014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714ffff640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500723c0 0x7f715014ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714ffff640 1 -- 172.21.15.67:0/2186086566 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7150072190 con 0x7f715015b1e0 2024-09-19T05:38:22.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f714ffff640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 0x7f715014e030 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f714800c780 tx=0x7f714800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:22.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7137fff640 1 -- 172.21.15.67:0/2186086566 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148003db0 con 0x7f715015b1e0 2024-09-19T05:38:22.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7137fff640 1 -- 172.21.15.67:0/2186086566 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714800ce30 con 0x7f715015b1e0 2024-09-19T05:38:22.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7156149640 1 -- 172.21.15.67:0/2186086566 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7150099e90 con 0x7f715015b1e0 2024-09-19T05:38:22.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7137fff640 1 -- 172.21.15.67:0/2186086566 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148005290 con 0x7f715015b1e0 2024-09-19T05:38:22.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7156149640 1 -- 172.21.15.67:0/2186086566 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7150149580 con 0x7f715015b1e0 2024-09-19T05:38:22.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7156149640 1 -- 172.21.15.67:0/2186086566 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7150071e80 con 0x7f715015b1e0 2024-09-19T05:38:22.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.736+0000 7f7137fff640 1 -- 172.21.15.67:0/2186086566 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7148005430 con 0x7f715015b1e0 2024-09-19T05:38:22.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.740+0000 7f7137fff640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f713c0678c0 0x7f713c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:22.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.740+0000 7f7137fff640 1 -- 172.21.15.67:0/2186086566 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f7148086800 con 0x7f715015b1e0 2024-09-19T05:38:22.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.740+0000 7f714f7fe640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f713c0678c0 0x7f713c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:22.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.740+0000 7f714f7fe640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f713c0678c0 0x7f713c069d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f71400ae000 tx=0x7f71400a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:22.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.740+0000 7f7137fff640 1 -- 172.21.15.67:0/2186086566 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7148057190 con 0x7f715015b1e0 2024-09-19T05:38:22.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.904+0000 7f7156149640 1 -- 172.21.15.67:0/2186086566 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71500b4e30 con 0x7f713c0678c0 2024-09-19T05:38:22.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.920+0000 7f7137fff640 1 -- 172.21.15.67:0/2186086566 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246753 (secure 0 0 0) 0x7f71500b4e30 con 0x7f713c0678c0 2024-09-19T05:38:22.928 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:22.929 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:38:22.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 -- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f713c0678c0 msgr2=0x7f713c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f713c0678c0 0x7f713c069d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f71400ae000 tx=0x7f71400a7000 comp rx=0 tx=0).stop 2024-09-19T05:38:22.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 -- 172.21.15.67:0/2186086566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 msgr2=0x7f715014e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 0x7f715014e030 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f714800c780 tx=0x7f714800cc40 comp rx=0 tx=0).stop 2024-09-19T05:38:22.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 -- 172.21.15.67:0/2186086566 shutdown_connections 2024-09-19T05:38:22.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f715015b1e0 0x7f715014e030 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f713c0678c0 0x7f713c069d80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71500b4900 0x7f7150099950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 --2- 172.21.15.67:0/2186086566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500723c0 0x7f715014ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 -- 172.21.15.67:0/2186086566 >> 172.21.15.67:0/2186086566 conn(0x7f71500d0080 msgr2=0x7f715015c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:22.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 -- 172.21.15.67:0/2186086566 shutdown_connections 2024-09-19T05:38:22.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:22.924+0000 7f7156149640 1 -- 172.21.15.67:0/2186086566 wait complete. 2024-09-19T05:38:22.946 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-09-19T05:38:21.212746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":343212,"kb_used_data":8992,"kb_used_omap":12,"kb_used_meta":334003,"kb_avail":754631508,"statfs":{"total":773094113280,"available":772742664192,"internally_reserved":0,"allocated":9207808,"data_stored":4876742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":342019633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.111346"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.113069+0000","last_change":"2024-09-19T05:38:17.113069+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.113069+0000","last_undegraded":"2024-09-19T05:38:17.113069+0000","last_fullsized":"2024-09-19T05:38:17.113069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125176+0000","last_change":"2024-09-19T05:38:17.125176+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125176+0000","last_undegraded":"2024-09-19T05:38:17.125176+0000","last_fullsized":"2024-09-19T05:38:17.125176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.118953+0000","last_change":"2024-09-19T05:38:17.118953+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.118953+0000","last_undegraded":"2024-09-19T05:38:17.118953+0000","last_fullsized":"2024-09-19T05:38:17.118953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125286+0000","last_change":"2024-09-19T05:38:17.125286+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125286+0000","last_undegraded":"2024-09-19T05:38:17.125286+0000","last_fullsized":"2024-09-19T05:38:17.125286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129675+0000","last_change":"2024-09-19T05:38:17.129675+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129675+0000","last_undegraded":"2024-09-19T05:38:17.129675+0000","last_fullsized":"2024-09-19T05:38:17.129675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129863+0000","last_change":"2024-09-19T05:38:17.129863+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129863+0000","last_undegraded":"2024-09-19T05:38:17.129863+0000","last_fullsized":"2024-09-19T05:38:17.129863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128301+0000","last_change":"2024-09-19T05:38:17.128301+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128301+0000","last_undegraded":"2024-09-19T05:38:17.128301+0000","last_fullsized":"2024-09-19T05:38:17.128301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128631+0000","last_change":"2024-09-19T05:38:17.128631+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128631+0000","last_undegraded":"2024-09-19T05:38:17.128631+0000","last_fullsized":"2024-09-19T05:38:17.128631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.117959+0000","last_change":"2024-09-19T05:38:17.117959+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.117959+0000","last_undegraded":"2024-09-19T05:38:17.117959+0000","last_fullsized":"2024-09-19T05:38:17.117959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.137607+0000","last_change":"2024-09-19T05:38:17.137607+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.137607+0000","last_undegraded":"2024-09-19T05:38:17.137607+0000","last_fullsized":"2024-09-19T05:38:17.137607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.126744+0000","last_change":"2024-09-19T05:38:17.126744+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.126744+0000","last_undegraded":"2024-09-19T05:38:17.126744+0000","last_fullsized":"2024-09-19T05:38:17.126744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.124288+0000","last_change":"2024-09-19T05:38:17.124288+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.124288+0000","last_undegraded":"2024-09-19T05:38:17.124288+0000","last_fullsized":"2024-09-19T05:38:17.124288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128547+0000","last_change":"2024-09-19T05:38:17.128547+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128547+0000","last_undegraded":"2024-09-19T05:38:17.128547+0000","last_fullsized":"2024-09-19T05:38:17.128547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129179+0000","last_change":"2024-09-19T05:38:17.129179+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129179+0000","last_undegraded":"2024-09-19T05:38:17.129179+0000","last_fullsized":"2024-09-19T05:38:17.129179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.126195+0000","last_change":"2024-09-19T05:38:17.126195+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.126195+0000","last_undegraded":"2024-09-19T05:38:17.126195+0000","last_fullsized":"2024-09-19T05:38:17.126195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.113414+0000","last_change":"2024-09-19T05:38:17.113414+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.113414+0000","last_undegraded":"2024-09-19T05:38:17.113414+0000","last_fullsized":"2024-09-19T05:38:17.113414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128874+0000","last_change":"2024-09-19T05:38:17.128874+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128874+0000","last_undegraded":"2024-09-19T05:38:17.128874+0000","last_fullsized":"2024-09-19T05:38:17.128874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.117053+0000","last_change":"2024-09-19T05:38:17.117053+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.117053+0000","last_undegraded":"2024-09-19T05:38:17.117053+0000","last_fullsized":"2024-09-19T05:38:17.117053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127487+0000","last_change":"2024-09-19T05:38:17.127487+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127487+0000","last_undegraded":"2024-09-19T05:38:17.127487+0000","last_fullsized":"2024-09-19T05:38:17.127487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.129383+0000","last_change":"2024-09-19T05:38:17.129383+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.129383+0000","last_undegraded":"2024-09-19T05:38:17.129383+0000","last_fullsized":"2024-09-19T05:38:17.129383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.123062+0000","last_change":"2024-09-19T05:38:17.123062+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.123062+0000","last_undegraded":"2024-09-19T05:38:17.123062+0000","last_fullsized":"2024-09-19T05:38:17.123062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128314+0000","last_change":"2024-09-19T05:38:17.128314+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128314+0000","last_undegraded":"2024-09-19T05:38:17.128314+0000","last_fullsized":"2024-09-19T05:38:17.128314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.119065+0000","last_change":"2024-09-19T05:38:17.119065+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.119065+0000","last_undegraded":"2024-09-19T05:38:17.119065+0000","last_fullsized":"2024-09-19T05:38:17.119065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125744+0000","last_change":"2024-09-19T05:38:17.125744+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125744+0000","last_undegraded":"2024-09-19T05:38:17.125744+0000","last_fullsized":"2024-09-19T05:38:17.125744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125399+0000","last_change":"2024-09-19T05:38:17.125399+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125399+0000","last_undegraded":"2024-09-19T05:38:17.125399+0000","last_fullsized":"2024-09-19T05:38:17.125399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.123051+0000","last_change":"2024-09-19T05:38:17.123051+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.123051+0000","last_undegraded":"2024-09-19T05:38:17.123051+0000","last_fullsized":"2024-09-19T05:38:17.123051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.113418+0000","last_change":"2024-09-19T05:38:17.113418+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.113418+0000","last_undegraded":"2024-09-19T05:38:17.113418+0000","last_fullsized":"2024-09-19T05:38:17.113418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127810+0000","last_change":"2024-09-19T05:38:17.127810+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127810+0000","last_undegraded":"2024-09-19T05:38:17.127810+0000","last_fullsized":"2024-09-19T05:38:17.127810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.124900+0000","last_change":"2024-09-19T05:38:17.124900+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.124900+0000","last_undegraded":"2024-09-19T05:38:17.124900+0000","last_fullsized":"2024-09-19T05:38:17.124900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.112073+0000","last_change":"2024-09-19T05:38:17.112073+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.112073+0000","last_undegraded":"2024-09-19T05:38:17.112073+0000","last_fullsized":"2024-09-19T05:38:17.112073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.115782+0000","last_change":"2024-09-19T05:38:17.115782+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.115782+0000","last_undegraded":"2024-09-19T05:38:17.115782+0000","last_fullsized":"2024-09-19T05:38:17.115782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.111923+0000","last_change":"2024-09-19T05:38:17.111923+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.111923+0000","last_undegraded":"2024-09-19T05:38:17.111923+0000","last_fullsized":"2024-09-19T05:38:17.111923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.118698+0000","last_change":"2024-09-19T05:38:17.118698+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.118698+0000","last_undegraded":"2024-09-19T05:38:17.118698+0000","last_fullsized":"2024-09-19T05:38:17.118698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.129960+0000","last_change":"2024-09-19T05:38:17.125550+0000","last_active":"2024-09-19T05:38:17.129960+0000","last_peered":"2024-09-19T05:38:17.129960+0000","last_clean":"2024-09-19T05:38:17.129960+0000","last_became_active":"2024-09-19T05:38:17.125194+0000","last_became_peered":"2024-09-19T05:38:17.125194+0000","last_unstale":"2024-09-19T05:38:17.129960+0000","last_undegraded":"2024-09-19T05:38:17.129960+0000","last_fullsized":"2024-09-19T05:38:17.129960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:15.003301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122580+0000","last_change":"2024-09-19T05:38:17.122580+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122580+0000","last_undegraded":"2024-09-19T05:38:17.122580+0000","last_fullsized":"2024-09-19T05:38:17.122580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152123+0000","last_change":"2024-09-19T05:38:17.151155+0000","last_active":"2024-09-19T05:38:17.152123+0000","last_peered":"2024-09-19T05:38:17.152123+0000","last_clean":"2024-09-19T05:38:17.152123+0000","last_became_active":"2024-09-19T05:38:17.150121+0000","last_became_peered":"2024-09-19T05:38:17.150121+0000","last_unstale":"2024-09-19T05:38:17.152123+0000","last_undegraded":"2024-09-19T05:38:17.152123+0000","last_fullsized":"2024-09-19T05:38:17.152123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:23.916230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.121152+0000","last_change":"2024-09-19T05:38:17.121152+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.121152+0000","last_undegraded":"2024-09-19T05:38:17.121152+0000","last_fullsized":"2024-09-19T05:38:17.121152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.134394+0000","last_change":"2024-09-19T05:38:17.127521+0000","last_active":"2024-09-19T05:38:17.134394+0000","last_peered":"2024-09-19T05:38:17.134394+0000","last_clean":"2024-09-19T05:38:17.134394+0000","last_became_active":"2024-09-19T05:38:17.125524+0000","last_became_peered":"2024-09-19T05:38:17.125524+0000","last_unstale":"2024-09-19T05:38:17.134394+0000","last_undegraded":"2024-09-19T05:38:17.134394+0000","last_fullsized":"2024-09-19T05:38:17.134394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:36.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122053+0000","last_change":"2024-09-19T05:38:17.122053+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122053+0000","last_undegraded":"2024-09-19T05:38:17.122053+0000","last_fullsized":"2024-09-19T05:38:17.122053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152965+0000","last_change":"2024-09-19T05:38:17.146072+0000","last_active":"2024-09-19T05:38:17.152965+0000","last_peered":"2024-09-19T05:38:17.152965+0000","last_clean":"2024-09-19T05:38:17.152965+0000","last_became_active":"2024-09-19T05:38:17.145049+0000","last_became_peered":"2024-09-19T05:38:17.145049+0000","last_unstale":"2024-09-19T05:38:17.152965+0000","last_undegraded":"2024-09-19T05:38:17.152965+0000","last_fullsized":"2024-09-19T05:38:17.152965+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:54.774053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125023+0000","last_change":"2024-09-19T05:38:17.125023+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125023+0000","last_undegraded":"2024-09-19T05:38:17.125023+0000","last_fullsized":"2024-09-19T05:38:17.125023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146366+0000","last_change":"2024-09-19T05:38:17.142355+0000","last_active":"2024-09-19T05:38:17.146366+0000","last_peered":"2024-09-19T05:38:17.146366+0000","last_clean":"2024-09-19T05:38:17.146366+0000","last_became_active":"2024-09-19T05:38:17.140750+0000","last_became_peered":"2024-09-19T05:38:17.140750+0000","last_unstale":"2024-09-19T05:38:17.146366+0000","last_undegraded":"2024-09-19T05:38:17.146366+0000","last_fullsized":"2024-09-19T05:38:17.146366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:23.103718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125195+0000","last_change":"2024-09-19T05:38:17.125195+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125195+0000","last_undegraded":"2024-09-19T05:38:17.125195+0000","last_fullsized":"2024-09-19T05:38:17.125195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.145238+0000","last_change":"2024-09-19T05:38:17.141855+0000","last_active":"2024-09-19T05:38:17.145238+0000","last_peered":"2024-09-19T05:38:17.145238+0000","last_clean":"2024-09-19T05:38:17.145238+0000","last_became_active":"2024-09-19T05:38:17.140748+0000","last_became_peered":"2024-09-19T05:38:17.140748+0000","last_unstale":"2024-09-19T05:38:17.145238+0000","last_undegraded":"2024-09-19T05:38:17.145238+0000","last_fullsized":"2024-09-19T05:38:17.145238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:32.631014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.117911+0000","last_change":"2024-09-19T05:38:17.117911+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.117911+0000","last_undegraded":"2024-09-19T05:38:17.117911+0000","last_fullsized":"2024-09-19T05:38:17.117911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.139125+0000","last_change":"2024-09-19T05:38:17.138271+0000","last_active":"2024-09-19T05:38:17.139125+0000","last_peered":"2024-09-19T05:38:17.139125+0000","last_clean":"2024-09-19T05:38:17.139125+0000","last_became_active":"2024-09-19T05:38:17.137963+0000","last_became_peered":"2024-09-19T05:38:17.137963+0000","last_unstale":"2024-09-19T05:38:17.139125+0000","last_undegraded":"2024-09-19T05:38:17.139125+0000","last_fullsized":"2024-09-19T05:38:17.139125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:06.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.132834+0000","last_change":"2024-09-19T05:38:17.132834+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.132834+0000","last_undegraded":"2024-09-19T05:38:17.132834+0000","last_fullsized":"2024-09-19T05:38:17.132834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.136394+0000","last_change":"2024-09-19T05:38:17.132639+0000","last_active":"2024-09-19T05:38:17.136394+0000","last_peered":"2024-09-19T05:38:17.136394+0000","last_clean":"2024-09-19T05:38:17.136394+0000","last_became_active":"2024-09-19T05:38:17.132240+0000","last_became_peered":"2024-09-19T05:38:17.132240+0000","last_unstale":"2024-09-19T05:38:17.136394+0000","last_undegraded":"2024-09-19T05:38:17.136394+0000","last_fullsized":"2024-09-19T05:38:17.136394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:09.666947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122116+0000","last_change":"2024-09-19T05:38:17.122116+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122116+0000","last_undegraded":"2024-09-19T05:38:17.122116+0000","last_fullsized":"2024-09-19T05:38:17.122116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.140936+0000","last_change":"2024-09-19T05:38:17.137642+0000","last_active":"2024-09-19T05:38:17.140936+0000","last_peered":"2024-09-19T05:38:17.140936+0000","last_clean":"2024-09-19T05:38:17.140936+0000","last_became_active":"2024-09-19T05:38:17.136920+0000","last_became_peered":"2024-09-19T05:38:17.136920+0000","last_unstale":"2024-09-19T05:38:17.140936+0000","last_undegraded":"2024-09-19T05:38:17.140936+0000","last_fullsized":"2024-09-19T05:38:17.140936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:39.495532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.120956+0000","last_change":"2024-09-19T05:38:17.120956+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.120956+0000","last_undegraded":"2024-09-19T05:38:17.120956+0000","last_fullsized":"2024-09-19T05:38:17.120956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.151145+0000","last_change":"2024-09-19T05:38:17.149660+0000","last_active":"2024-09-19T05:38:17.151145+0000","last_peered":"2024-09-19T05:38:17.151145+0000","last_clean":"2024-09-19T05:38:17.151145+0000","last_became_active":"2024-09-19T05:38:17.147750+0000","last_became_peered":"2024-09-19T05:38:17.147750+0000","last_unstale":"2024-09-19T05:38:17.151145+0000","last_undegraded":"2024-09-19T05:38:17.151145+0000","last_fullsized":"2024-09-19T05:38:17.151145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:11.415272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127487+0000","last_change":"2024-09-19T05:38:17.127487+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127487+0000","last_undegraded":"2024-09-19T05:38:17.127487+0000","last_fullsized":"2024-09-19T05:38:17.127487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.134224+0000","last_change":"2024-09-19T05:38:17.132043+0000","last_active":"2024-09-19T05:38:17.134224+0000","last_peered":"2024-09-19T05:38:17.134224+0000","last_clean":"2024-09-19T05:38:17.134224+0000","last_became_active":"2024-09-19T05:38:17.130901+0000","last_became_peered":"2024-09-19T05:38:17.130901+0000","last_unstale":"2024-09-19T05:38:17.134224+0000","last_undegraded":"2024-09-19T05:38:17.134224+0000","last_fullsized":"2024-09-19T05:38:17.134224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:28.975858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.116219+0000","last_change":"2024-09-19T05:38:17.116219+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.116219+0000","last_undegraded":"2024-09-19T05:38:17.116219+0000","last_fullsized":"2024-09-19T05:38:17.116219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.154193+0000","last_change":"2024-09-19T05:38:17.152541+0000","last_active":"2024-09-19T05:38:17.154193+0000","last_peered":"2024-09-19T05:38:17.154193+0000","last_clean":"2024-09-19T05:38:17.154193+0000","last_became_active":"2024-09-19T05:38:17.152060+0000","last_became_peered":"2024-09-19T05:38:17.152060+0000","last_unstale":"2024-09-19T05:38:17.154193+0000","last_undegraded":"2024-09-19T05:38:17.154193+0000","last_fullsized":"2024-09-19T05:38:17.154193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:56.465721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122901+0000","last_change":"2024-09-19T05:38:17.122901+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122901+0000","last_undegraded":"2024-09-19T05:38:17.122901+0000","last_fullsized":"2024-09-19T05:38:17.122901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.150691+0000","last_change":"2024-09-19T05:38:17.148263+0000","last_active":"2024-09-19T05:38:17.150691+0000","last_peered":"2024-09-19T05:38:17.150691+0000","last_clean":"2024-09-19T05:38:17.150691+0000","last_became_active":"2024-09-19T05:38:17.147503+0000","last_became_peered":"2024-09-19T05:38:17.147503+0000","last_unstale":"2024-09-19T05:38:17.150691+0000","last_undegraded":"2024-09-19T05:38:17.150691+0000","last_fullsized":"2024-09-19T05:38:17.150691+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:20.466988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.126638+0000","last_change":"2024-09-19T05:38:17.126638+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.126638+0000","last_undegraded":"2024-09-19T05:38:17.126638+0000","last_fullsized":"2024-09-19T05:38:17.126638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.144153+0000","last_change":"2024-09-19T05:38:17.128306+0000","last_active":"2024-09-19T05:38:17.144153+0000","last_peered":"2024-09-19T05:38:17.144153+0000","last_clean":"2024-09-19T05:38:17.144153+0000","last_became_active":"2024-09-19T05:38:17.127570+0000","last_became_peered":"2024-09-19T05:38:17.127570+0000","last_unstale":"2024-09-19T05:38:17.144153+0000","last_undegraded":"2024-09-19T05:38:17.144153+0000","last_fullsized":"2024-09-19T05:38:17.144153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:06.077837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127620+0000","last_change":"2024-09-19T05:38:17.127620+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127620+0000","last_undegraded":"2024-09-19T05:38:17.127620+0000","last_fullsized":"2024-09-19T05:38:17.127620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.128581+0000","last_change":"2024-09-19T05:38:17.124389+0000","last_active":"2024-09-19T05:38:17.128581+0000","last_peered":"2024-09-19T05:38:17.128581+0000","last_clean":"2024-09-19T05:38:17.128581+0000","last_became_active":"2024-09-19T05:38:17.124116+0000","last_became_peered":"2024-09-19T05:38:17.124116+0000","last_unstale":"2024-09-19T05:38:17.128581+0000","last_undegraded":"2024-09-19T05:38:17.128581+0000","last_fullsized":"2024-09-19T05:38:17.128581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:03.799473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.131865+0000","last_change":"2024-09-19T05:38:17.131865+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.131865+0000","last_undegraded":"2024-09-19T05:38:17.131865+0000","last_fullsized":"2024-09-19T05:38:17.131865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.153342+0000","last_change":"2024-09-19T05:38:17.152926+0000","last_active":"2024-09-19T05:38:17.153342+0000","last_peered":"2024-09-19T05:38:17.153342+0000","last_clean":"2024-09-19T05:38:17.153342+0000","last_became_active":"2024-09-19T05:38:17.152633+0000","last_became_peered":"2024-09-19T05:38:17.152633+0000","last_unstale":"2024-09-19T05:38:17.153342+0000","last_undegraded":"2024-09-19T05:38:17.153342+0000","last_fullsized":"2024-09-19T05:38:17.153342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:39.495532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127062+0000","last_change":"2024-09-19T05:38:17.127062+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127062+0000","last_undegraded":"2024-09-19T05:38:17.127062+0000","last_fullsized":"2024-09-19T05:38:17.127062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.153463+0000","last_change":"2024-09-19T05:38:17.148055+0000","last_active":"2024-09-19T05:38:17.153463+0000","last_peered":"2024-09-19T05:38:17.153463+0000","last_clean":"2024-09-19T05:38:17.153463+0000","last_became_active":"2024-09-19T05:38:17.147402+0000","last_became_peered":"2024-09-19T05:38:17.147402+0000","last_unstale":"2024-09-19T05:38:17.153463+0000","last_undegraded":"2024-09-19T05:38:17.153463+0000","last_fullsized":"2024-09-19T05:38:17.153463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:35.931949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127540+0000","last_change":"2024-09-19T05:38:17.127540+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127540+0000","last_undegraded":"2024-09-19T05:38:17.127540+0000","last_fullsized":"2024-09-19T05:38:17.127540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.145234+0000","last_change":"2024-09-19T05:38:17.132750+0000","last_active":"2024-09-19T05:38:17.145234+0000","last_peered":"2024-09-19T05:38:17.145234+0000","last_clean":"2024-09-19T05:38:17.145234+0000","last_became_active":"2024-09-19T05:38:17.132035+0000","last_became_peered":"2024-09-19T05:38:17.132035+0000","last_unstale":"2024-09-19T05:38:17.145234+0000","last_undegraded":"2024-09-19T05:38:17.145234+0000","last_fullsized":"2024-09-19T05:38:17.145234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:25.245347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127631+0000","last_change":"2024-09-19T05:38:17.127631+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127631+0000","last_undegraded":"2024-09-19T05:38:17.127631+0000","last_fullsized":"2024-09-19T05:38:17.127631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.138909+0000","last_change":"2024-09-19T05:38:17.137253+0000","last_active":"2024-09-19T05:38:17.138909+0000","last_peered":"2024-09-19T05:38:17.138909+0000","last_clean":"2024-09-19T05:38:17.138909+0000","last_became_active":"2024-09-19T05:38:17.136921+0000","last_became_peered":"2024-09-19T05:38:17.136921+0000","last_unstale":"2024-09-19T05:38:17.138909+0000","last_undegraded":"2024-09-19T05:38:17.138909+0000","last_fullsized":"2024-09-19T05:38:17.138909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:22.837311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.128271+0000","last_change":"2024-09-19T05:38:17.128271+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.128271+0000","last_undegraded":"2024-09-19T05:38:17.128271+0000","last_fullsized":"2024-09-19T05:38:17.128271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.140639+0000","last_change":"2024-09-19T05:38:17.133484+0000","last_active":"2024-09-19T05:38:17.140639+0000","last_peered":"2024-09-19T05:38:17.140639+0000","last_clean":"2024-09-19T05:38:17.140639+0000","last_became_active":"2024-09-19T05:38:17.133155+0000","last_became_peered":"2024-09-19T05:38:17.133155+0000","last_unstale":"2024-09-19T05:38:17.140639+0000","last_undegraded":"2024-09-19T05:38:17.140639+0000","last_fullsized":"2024-09-19T05:38:17.140639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:18.374097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122399+0000","last_change":"2024-09-19T05:38:17.122399+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122399+0000","last_undegraded":"2024-09-19T05:38:17.122399+0000","last_fullsized":"2024-09-19T05:38:17.122399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.129796+0000","last_change":"2024-09-19T05:38:17.122267+0000","last_active":"2024-09-19T05:38:17.129796+0000","last_peered":"2024-09-19T05:38:17.129796+0000","last_clean":"2024-09-19T05:38:17.129796+0000","last_became_active":"2024-09-19T05:38:17.121874+0000","last_became_peered":"2024-09-19T05:38:17.121874+0000","last_unstale":"2024-09-19T05:38:17.129796+0000","last_undegraded":"2024-09-19T05:38:17.129796+0000","last_fullsized":"2024-09-19T05:38:17.129796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:35.177608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.123069+0000","last_change":"2024-09-19T05:38:17.123069+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.123069+0000","last_undegraded":"2024-09-19T05:38:17.123069+0000","last_fullsized":"2024-09-19T05:38:17.123069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.147031+0000","last_change":"2024-09-19T05:38:17.146511+0000","last_active":"2024-09-19T05:38:17.147031+0000","last_peered":"2024-09-19T05:38:17.147031+0000","last_clean":"2024-09-19T05:38:17.147031+0000","last_became_active":"2024-09-19T05:38:17.145962+0000","last_became_peered":"2024-09-19T05:38:17.145962+0000","last_unstale":"2024-09-19T05:38:17.147031+0000","last_undegraded":"2024-09-19T05:38:17.147031+0000","last_fullsized":"2024-09-19T05:38:17.147031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:14.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.130810+0000","last_change":"2024-09-19T05:38:17.130810+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.130810+0000","last_undegraded":"2024-09-19T05:38:17.130810+0000","last_fullsized":"2024-09-19T05:38:17.130810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146515+0000","last_change":"2024-09-19T05:38:17.145847+0000","last_active":"2024-09-19T05:38:17.146515+0000","last_peered":"2024-09-19T05:38:17.146515+0000","last_clean":"2024-09-19T05:38:17.146515+0000","last_became_active":"2024-09-19T05:38:17.145601+0000","last_became_peered":"2024-09-19T05:38:17.145601+0000","last_unstale":"2024-09-19T05:38:17.146515+0000","last_undegraded":"2024-09-19T05:38:17.146515+0000","last_fullsized":"2024-09-19T05:38:17.146515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:23.796246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.118006+0000","last_change":"2024-09-19T05:38:17.118006+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.118006+0000","last_undegraded":"2024-09-19T05:38:17.118006+0000","last_fullsized":"2024-09-19T05:38:17.118006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.145600+0000","last_change":"2024-09-19T05:38:17.143027+0000","last_active":"2024-09-19T05:38:17.145600+0000","last_peered":"2024-09-19T05:38:17.145600+0000","last_clean":"2024-09-19T05:38:17.145600+0000","last_became_active":"2024-09-19T05:38:17.142268+0000","last_became_peered":"2024-09-19T05:38:17.142268+0000","last_unstale":"2024-09-19T05:38:17.145600+0000","last_undegraded":"2024-09-19T05:38:17.145600+0000","last_fullsized":"2024-09-19T05:38:17.145600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:56.757853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.127199+0000","last_change":"2024-09-19T05:38:17.127199+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.127199+0000","last_undegraded":"2024-09-19T05:38:17.127199+0000","last_fullsized":"2024-09-19T05:38:17.127199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.130921+0000","last_change":"2024-09-19T05:38:17.126066+0000","last_active":"2024-09-19T05:38:17.130921+0000","last_peered":"2024-09-19T05:38:17.130921+0000","last_clean":"2024-09-19T05:38:17.130921+0000","last_became_active":"2024-09-19T05:38:17.125791+0000","last_became_peered":"2024-09-19T05:38:17.125791+0000","last_unstale":"2024-09-19T05:38:17.130921+0000","last_undegraded":"2024-09-19T05:38:17.130921+0000","last_fullsized":"2024-09-19T05:38:17.130921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:36.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.119687+0000","last_change":"2024-09-19T05:38:17.119687+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.119687+0000","last_undegraded":"2024-09-19T05:38:17.119687+0000","last_fullsized":"2024-09-19T05:38:17.119687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146906+0000","last_change":"2024-09-19T05:38:17.144370+0000","last_active":"2024-09-19T05:38:17.146906+0000","last_peered":"2024-09-19T05:38:17.146906+0000","last_clean":"2024-09-19T05:38:17.146906+0000","last_became_active":"2024-09-19T05:38:17.143606+0000","last_became_peered":"2024-09-19T05:38:17.143606+0000","last_unstale":"2024-09-19T05:38:17.146906+0000","last_undegraded":"2024-09-19T05:38:17.146906+0000","last_fullsized":"2024-09-19T05:38:17.146906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:04.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.122090+0000","last_change":"2024-09-19T05:38:17.122090+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.122090+0000","last_undegraded":"2024-09-19T05:38:17.122090+0000","last_fullsized":"2024-09-19T05:38:17.122090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152105+0000","last_change":"2024-09-19T05:38:17.150784+0000","last_active":"2024-09-19T05:38:17.152105+0000","last_peered":"2024-09-19T05:38:17.152105+0000","last_clean":"2024-09-19T05:38:17.152105+0000","last_became_active":"2024-09-19T05:38:17.149985+0000","last_became_peered":"2024-09-19T05:38:17.149985+0000","last_unstale":"2024-09-19T05:38:17.152105+0000","last_undegraded":"2024-09-19T05:38:17.152105+0000","last_fullsized":"2024-09-19T05:38:17.152105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:31.104896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.133830+0000","last_change":"2024-09-19T05:38:17.133830+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.133830+0000","last_undegraded":"2024-09-19T05:38:17.133830+0000","last_fullsized":"2024-09-19T05:38:17.133830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.148702+0000","last_change":"2024-09-19T05:38:17.137447+0000","last_active":"2024-09-19T05:38:17.148702+0000","last_peered":"2024-09-19T05:38:17.148702+0000","last_clean":"2024-09-19T05:38:17.148702+0000","last_became_active":"2024-09-19T05:38:17.136760+0000","last_became_peered":"2024-09-19T05:38:17.136760+0000","last_unstale":"2024-09-19T05:38:17.148702+0000","last_undegraded":"2024-09-19T05:38:17.148702+0000","last_fullsized":"2024-09-19T05:38:17.148702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:07.700921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.125393+0000","last_change":"2024-09-19T05:38:17.125393+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.125393+0000","last_undegraded":"2024-09-19T05:38:17.125393+0000","last_fullsized":"2024-09-19T05:38:17.125393+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.138822+0000","last_change":"2024-09-19T05:38:17.136157+0000","last_active":"2024-09-19T05:38:17.138822+0000","last_peered":"2024-09-19T05:38:17.138822+0000","last_clean":"2024-09-19T05:38:17.138822+0000","last_became_active":"2024-09-19T05:38:17.135724+0000","last_became_peered":"2024-09-19T05:38:17.135724+0000","last_unstale":"2024-09-19T05:38:17.138822+0000","last_undegraded":"2024-09-19T05:38:17.138822+0000","last_fullsized":"2024-09-19T05:38:17.138822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:52.678154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.116563+0000","last_change":"2024-09-19T05:38:17.116563+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.116563+0000","last_undegraded":"2024-09-19T05:38:17.116563+0000","last_fullsized":"2024-09-19T05:38:17.116563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.152654+0000","last_change":"2024-09-19T05:38:17.145925+0000","last_active":"2024-09-19T05:38:17.152654+0000","last_peered":"2024-09-19T05:38:17.152654+0000","last_clean":"2024-09-19T05:38:17.152654+0000","last_became_active":"2024-09-19T05:38:17.145324+0000","last_became_peered":"2024-09-19T05:38:17.145324+0000","last_unstale":"2024-09-19T05:38:17.152654+0000","last_undegraded":"2024-09-19T05:38:17.152654+0000","last_fullsized":"2024-09-19T05:38:17.152654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:35.194554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.119391+0000","last_change":"2024-09-19T05:38:17.119391+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.119391+0000","last_undegraded":"2024-09-19T05:38:17.119391+0000","last_fullsized":"2024-09-19T05:38:17.119391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.130041+0000","last_change":"2024-09-19T05:38:17.123000+0000","last_active":"2024-09-19T05:38:17.130041+0000","last_peered":"2024-09-19T05:38:17.130041+0000","last_clean":"2024-09-19T05:38:17.130041+0000","last_became_active":"2024-09-19T05:38:17.121818+0000","last_became_peered":"2024-09-19T05:38:17.121818+0000","last_unstale":"2024-09-19T05:38:17.130041+0000","last_undegraded":"2024-09-19T05:38:17.130041+0000","last_fullsized":"2024-09-19T05:38:17.130041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:59.045847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-09-19T05:38:17.112050+0000","last_change":"2024-09-19T05:38:17.112050+0000","last_active":"2024-09-19T05:38:17.100227+0000","last_peered":"2024-09-19T05:38:17.100227+0000","last_clean":"2024-09-19T05:38:17.100227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:38:17.112050+0000","last_undegraded":"2024-09-19T05:38:17.112050+0000","last_fullsized":"2024-09-19T05:38:17.112050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.146769+0000","last_change":"2024-09-19T05:38:17.146047+0000","last_active":"2024-09-19T05:38:17.146769+0000","last_peered":"2024-09-19T05:38:17.146769+0000","last_clean":"2024-09-19T05:38:17.146769+0000","last_became_active":"2024-09-19T05:38:17.145623+0000","last_became_peered":"2024-09-19T05:38:17.145623+0000","last_unstale":"2024-09-19T05:38:17.146769+0000","last_undegraded":"2024-09-19T05:38:17.146769+0000","last_fullsized":"2024-09-19T05:38:17.146769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:41.328816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T05:38:17.114263+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:38:17.114263+0000","last_peered":"2024-09-19T05:38:17.114263+0000","last_clean":"2024-09-19T05:38:17.114263+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:38:17.114263+0000","last_undegraded":"2024-09-19T05:38:17.114263+0000","last_fullsized":"2024-09-19T05:38:17.114263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542209,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50804,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321036,"statfs":{"total":96636764160,"available":96584740864,"internally_reserved":0,"allocated":1605632,"data_stored":1057369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542211,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46064,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325776,"statfs":{"total":96636764160,"available":96589594624,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46056,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325784,"statfs":{"total":96636764160,"available":96589602816,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542212,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":999424,"data_stored":460334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542209,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":1057369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:22.950 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3f is not active+clean 2024-09-19T05:38:22.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.113069+0000', 'last_change': '2024-09-19T05:38:17.113069+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.113069+0000', 'last_undegraded': '2024-09-19T05:38:17.113069+0000', 'last_fullsized': '2024-09-19T05:38:17.113069+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:38:22.950 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3e is not active+clean 2024-09-19T05:38:22.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.125176+0000', 'last_change': '2024-09-19T05:38:17.125176+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.125176+0000', 'last_undegraded': '2024-09-19T05:38:17.125176+0000', 'last_fullsized': '2024-09-19T05:38:17.125176+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.950 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3d is not active+clean 2024-09-19T05:38:22.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.118953+0000', 'last_change': '2024-09-19T05:38:17.118953+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.118953+0000', 'last_undegraded': '2024-09-19T05:38:17.118953+0000', 'last_fullsized': '2024-09-19T05:38:17.118953+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:38:22.950 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3c is not active+clean 2024-09-19T05:38:22.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.125286+0000', 'last_change': '2024-09-19T05:38:17.125286+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.125286+0000', 'last_undegraded': '2024-09-19T05:38:17.125286+0000', 'last_fullsized': '2024-09-19T05:38:17.125286+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:38:22.951 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3b is not active+clean 2024-09-19T05:38:22.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.129675+0000', 'last_change': '2024-09-19T05:38:17.129675+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.129675+0000', 'last_undegraded': '2024-09-19T05:38:17.129675+0000', 'last_fullsized': '2024-09-19T05:38:17.129675+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:38:22.951 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3a is not active+clean 2024-09-19T05:38:22.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.129863+0000', 'last_change': '2024-09-19T05:38:17.129863+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.129863+0000', 'last_undegraded': '2024-09-19T05:38:17.129863+0000', 'last_fullsized': '2024-09-19T05:38:17.129863+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:38:22.951 INFO:tasks.ceph.ceph_manager.ceph:PG 12.39 is not active+clean 2024-09-19T05:38:22.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.128301+0000', 'last_change': '2024-09-19T05:38:17.128301+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.128301+0000', 'last_undegraded': '2024-09-19T05:38:17.128301+0000', 'last_fullsized': '2024-09-19T05:38:17.128301+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:38:22.951 INFO:tasks.ceph.ceph_manager.ceph:PG 12.38 is not active+clean 2024-09-19T05:38:22.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.128631+0000', 'last_change': '2024-09-19T05:38:17.128631+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.128631+0000', 'last_undegraded': '2024-09-19T05:38:17.128631+0000', 'last_fullsized': '2024-09-19T05:38:17.128631+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:38:22.951 INFO:tasks.ceph.ceph_manager.ceph:PG 12.37 is not active+clean 2024-09-19T05:38:22.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.117959+0000', 'last_change': '2024-09-19T05:38:17.117959+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.117959+0000', 'last_undegraded': '2024-09-19T05:38:17.117959+0000', 'last_fullsized': '2024-09-19T05:38:17.117959+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:38:22.952 INFO:tasks.ceph.ceph_manager.ceph:PG 12.36 is not active+clean 2024-09-19T05:38:22.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.137607+0000', 'last_change': '2024-09-19T05:38:17.137607+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.137607+0000', 'last_undegraded': '2024-09-19T05:38:17.137607+0000', 'last_fullsized': '2024-09-19T05:38:17.137607+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:38:22.952 INFO:tasks.ceph.ceph_manager.ceph:PG 12.35 is not active+clean 2024-09-19T05:38:22.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.126744+0000', 'last_change': '2024-09-19T05:38:17.126744+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.126744+0000', 'last_undegraded': '2024-09-19T05:38:17.126744+0000', 'last_fullsized': '2024-09-19T05:38:17.126744+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.952 INFO:tasks.ceph.ceph_manager.ceph:PG 12.34 is not active+clean 2024-09-19T05:38:22.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.124288+0000', 'last_change': '2024-09-19T05:38:17.124288+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.124288+0000', 'last_undegraded': '2024-09-19T05:38:17.124288+0000', 'last_fullsized': '2024-09-19T05:38:17.124288+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:38:22.952 INFO:tasks.ceph.ceph_manager.ceph:PG 12.33 is not active+clean 2024-09-19T05:38:22.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.128547+0000', 'last_change': '2024-09-19T05:38:17.128547+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.128547+0000', 'last_undegraded': '2024-09-19T05:38:17.128547+0000', 'last_fullsized': '2024-09-19T05:38:17.128547+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:38:22.952 INFO:tasks.ceph.ceph_manager.ceph:PG 12.32 is not active+clean 2024-09-19T05:38:22.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.129179+0000', 'last_change': '2024-09-19T05:38:17.129179+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.129179+0000', 'last_undegraded': '2024-09-19T05:38:17.129179+0000', 'last_fullsized': '2024-09-19T05:38:17.129179+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:38:22.953 INFO:tasks.ceph.ceph_manager.ceph:PG 12.31 is not active+clean 2024-09-19T05:38:22.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.126195+0000', 'last_change': '2024-09-19T05:38:17.126195+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.126195+0000', 'last_undegraded': '2024-09-19T05:38:17.126195+0000', 'last_fullsized': '2024-09-19T05:38:17.126195+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.953 INFO:tasks.ceph.ceph_manager.ceph:PG 12.30 is not active+clean 2024-09-19T05:38:22.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.113414+0000', 'last_change': '2024-09-19T05:38:17.113414+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.113414+0000', 'last_undegraded': '2024-09-19T05:38:17.113414+0000', 'last_fullsized': '2024-09-19T05:38:17.113414+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:38:22.953 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2f is not active+clean 2024-09-19T05:38:22.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.128874+0000', 'last_change': '2024-09-19T05:38:17.128874+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.128874+0000', 'last_undegraded': '2024-09-19T05:38:17.128874+0000', 'last_fullsized': '2024-09-19T05:38:17.128874+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:38:22.953 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2e is not active+clean 2024-09-19T05:38:22.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.117053+0000', 'last_change': '2024-09-19T05:38:17.117053+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.117053+0000', 'last_undegraded': '2024-09-19T05:38:17.117053+0000', 'last_fullsized': '2024-09-19T05:38:17.117053+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:38:22.954 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2d is not active+clean 2024-09-19T05:38:22.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.127487+0000', 'last_change': '2024-09-19T05:38:17.127487+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.127487+0000', 'last_undegraded': '2024-09-19T05:38:17.127487+0000', 'last_fullsized': '2024-09-19T05:38:17.127487+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:38:22.954 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2c is not active+clean 2024-09-19T05:38:22.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.129383+0000', 'last_change': '2024-09-19T05:38:17.129383+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.129383+0000', 'last_undegraded': '2024-09-19T05:38:17.129383+0000', 'last_fullsized': '2024-09-19T05:38:17.129383+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:38:22.954 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2b is not active+clean 2024-09-19T05:38:22.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.123062+0000', 'last_change': '2024-09-19T05:38:17.123062+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.123062+0000', 'last_undegraded': '2024-09-19T05:38:17.123062+0000', 'last_fullsized': '2024-09-19T05:38:17.123062+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:38:22.954 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2a is not active+clean 2024-09-19T05:38:22.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.128314+0000', 'last_change': '2024-09-19T05:38:17.128314+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.128314+0000', 'last_undegraded': '2024-09-19T05:38:17.128314+0000', 'last_fullsized': '2024-09-19T05:38:17.128314+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:38:22.954 INFO:tasks.ceph.ceph_manager.ceph:PG 12.29 is not active+clean 2024-09-19T05:38:22.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.119065+0000', 'last_change': '2024-09-19T05:38:17.119065+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.119065+0000', 'last_undegraded': '2024-09-19T05:38:17.119065+0000', 'last_fullsized': '2024-09-19T05:38:17.119065+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:38:22.955 INFO:tasks.ceph.ceph_manager.ceph:PG 12.28 is not active+clean 2024-09-19T05:38:22.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.125744+0000', 'last_change': '2024-09-19T05:38:17.125744+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.125744+0000', 'last_undegraded': '2024-09-19T05:38:17.125744+0000', 'last_fullsized': '2024-09-19T05:38:17.125744+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.955 INFO:tasks.ceph.ceph_manager.ceph:PG 12.27 is not active+clean 2024-09-19T05:38:22.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.125399+0000', 'last_change': '2024-09-19T05:38:17.125399+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.125399+0000', 'last_undegraded': '2024-09-19T05:38:17.125399+0000', 'last_fullsized': '2024-09-19T05:38:17.125399+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.955 INFO:tasks.ceph.ceph_manager.ceph:PG 12.26 is not active+clean 2024-09-19T05:38:22.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.123051+0000', 'last_change': '2024-09-19T05:38:17.123051+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.123051+0000', 'last_undegraded': '2024-09-19T05:38:17.123051+0000', 'last_fullsized': '2024-09-19T05:38:17.123051+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:38:22.955 INFO:tasks.ceph.ceph_manager.ceph:PG 12.25 is not active+clean 2024-09-19T05:38:22.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.113418+0000', 'last_change': '2024-09-19T05:38:17.113418+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.113418+0000', 'last_undegraded': '2024-09-19T05:38:17.113418+0000', 'last_fullsized': '2024-09-19T05:38:17.113418+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:38:22.955 INFO:tasks.ceph.ceph_manager.ceph:PG 12.24 is not active+clean 2024-09-19T05:38:22.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.127810+0000', 'last_change': '2024-09-19T05:38:17.127810+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.127810+0000', 'last_undegraded': '2024-09-19T05:38:17.127810+0000', 'last_fullsized': '2024-09-19T05:38:17.127810+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:38:22.956 INFO:tasks.ceph.ceph_manager.ceph:PG 12.23 is not active+clean 2024-09-19T05:38:22.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.124900+0000', 'last_change': '2024-09-19T05:38:17.124900+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.124900+0000', 'last_undegraded': '2024-09-19T05:38:17.124900+0000', 'last_fullsized': '2024-09-19T05:38:17.124900+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.956 INFO:tasks.ceph.ceph_manager.ceph:PG 12.22 is not active+clean 2024-09-19T05:38:22.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.112073+0000', 'last_change': '2024-09-19T05:38:17.112073+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.112073+0000', 'last_undegraded': '2024-09-19T05:38:17.112073+0000', 'last_fullsized': '2024-09-19T05:38:17.112073+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:38:22.956 INFO:tasks.ceph.ceph_manager.ceph:PG 12.21 is not active+clean 2024-09-19T05:38:22.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.115782+0000', 'last_change': '2024-09-19T05:38:17.115782+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.115782+0000', 'last_undegraded': '2024-09-19T05:38:17.115782+0000', 'last_fullsized': '2024-09-19T05:38:17.115782+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:38:22.956 INFO:tasks.ceph.ceph_manager.ceph:PG 12.20 is not active+clean 2024-09-19T05:38:22.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.111923+0000', 'last_change': '2024-09-19T05:38:17.111923+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.111923+0000', 'last_undegraded': '2024-09-19T05:38:17.111923+0000', 'last_fullsized': '2024-09-19T05:38:17.111923+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:38:22.956 INFO:tasks.ceph.ceph_manager.ceph:PG 12.18 is not active+clean 2024-09-19T05:38:22.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.118698+0000', 'last_change': '2024-09-19T05:38:17.118698+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.118698+0000', 'last_undegraded': '2024-09-19T05:38:17.118698+0000', 'last_fullsized': '2024-09-19T05:38:17.118698+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:38:22.957 INFO:tasks.ceph.ceph_manager.ceph:PG 12.19 is not active+clean 2024-09-19T05:38:22.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.122580+0000', 'last_change': '2024-09-19T05:38:17.122580+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.122580+0000', 'last_undegraded': '2024-09-19T05:38:17.122580+0000', 'last_fullsized': '2024-09-19T05:38:17.122580+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.957 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-09-19T05:38:22.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.121152+0000', 'last_change': '2024-09-19T05:38:17.121152+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.121152+0000', 'last_undegraded': '2024-09-19T05:38:17.121152+0000', 'last_fullsized': '2024-09-19T05:38:17.121152+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:38:22.957 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1b is not active+clean 2024-09-19T05:38:22.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.122053+0000', 'last_change': '2024-09-19T05:38:17.122053+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.122053+0000', 'last_undegraded': '2024-09-19T05:38:17.122053+0000', 'last_fullsized': '2024-09-19T05:38:17.122053+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:38:22.957 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1c is not active+clean 2024-09-19T05:38:22.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.125023+0000', 'last_change': '2024-09-19T05:38:17.125023+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.125023+0000', 'last_undegraded': '2024-09-19T05:38:17.125023+0000', 'last_fullsized': '2024-09-19T05:38:17.125023+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.957 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1d is not active+clean 2024-09-19T05:38:22.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.125195+0000', 'last_change': '2024-09-19T05:38:17.125195+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.125195+0000', 'last_undegraded': '2024-09-19T05:38:17.125195+0000', 'last_fullsized': '2024-09-19T05:38:17.125195+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.958 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-09-19T05:38:22.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.117911+0000', 'last_change': '2024-09-19T05:38:17.117911+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.117911+0000', 'last_undegraded': '2024-09-19T05:38:17.117911+0000', 'last_fullsized': '2024-09-19T05:38:17.117911+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:38:22.958 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-09-19T05:38:22.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.132834+0000', 'last_change': '2024-09-19T05:38:17.132834+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.132834+0000', 'last_undegraded': '2024-09-19T05:38:17.132834+0000', 'last_fullsized': '2024-09-19T05:38:17.132834+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:38:22.958 INFO:tasks.ceph.ceph_manager.ceph:PG 12.10 is not active+clean 2024-09-19T05:38:22.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.122116+0000', 'last_change': '2024-09-19T05:38:17.122116+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.122116+0000', 'last_undegraded': '2024-09-19T05:38:17.122116+0000', 'last_fullsized': '2024-09-19T05:38:17.122116+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.958 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-09-19T05:38:22.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.120956+0000', 'last_change': '2024-09-19T05:38:17.120956+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.120956+0000', 'last_undegraded': '2024-09-19T05:38:17.120956+0000', 'last_fullsized': '2024-09-19T05:38:17.120956+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:38:22.958 INFO:tasks.ceph.ceph_manager.ceph:PG 12.12 is not active+clean 2024-09-19T05:38:22.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.127487+0000', 'last_change': '2024-09-19T05:38:17.127487+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.127487+0000', 'last_undegraded': '2024-09-19T05:38:17.127487+0000', 'last_fullsized': '2024-09-19T05:38:17.127487+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:38:22.959 INFO:tasks.ceph.ceph_manager.ceph:PG 12.13 is not active+clean 2024-09-19T05:38:22.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.116219+0000', 'last_change': '2024-09-19T05:38:17.116219+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.116219+0000', 'last_undegraded': '2024-09-19T05:38:17.116219+0000', 'last_fullsized': '2024-09-19T05:38:17.116219+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:38:22.959 INFO:tasks.ceph.ceph_manager.ceph:PG 12.14 is not active+clean 2024-09-19T05:38:22.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.122901+0000', 'last_change': '2024-09-19T05:38:17.122901+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.122901+0000', 'last_undegraded': '2024-09-19T05:38:17.122901+0000', 'last_fullsized': '2024-09-19T05:38:17.122901+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:38:22.959 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-09-19T05:38:22.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.126638+0000', 'last_change': '2024-09-19T05:38:17.126638+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.126638+0000', 'last_undegraded': '2024-09-19T05:38:17.126638+0000', 'last_fullsized': '2024-09-19T05:38:17.126638+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:38:22.959 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-09-19T05:38:22.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.127620+0000', 'last_change': '2024-09-19T05:38:17.127620+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.127620+0000', 'last_undegraded': '2024-09-19T05:38:17.127620+0000', 'last_fullsized': '2024-09-19T05:38:17.127620+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:38:22.959 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-09-19T05:38:22.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.131865+0000', 'last_change': '2024-09-19T05:38:17.131865+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.131865+0000', 'last_undegraded': '2024-09-19T05:38:17.131865+0000', 'last_fullsized': '2024-09-19T05:38:17.131865+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:38:22.960 INFO:tasks.ceph.ceph_manager.ceph:PG 12.8 is not active+clean 2024-09-19T05:38:22.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.127062+0000', 'last_change': '2024-09-19T05:38:17.127062+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.127062+0000', 'last_undegraded': '2024-09-19T05:38:17.127062+0000', 'last_fullsized': '2024-09-19T05:38:17.127062+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:38:22.960 INFO:tasks.ceph.ceph_manager.ceph:PG 12.9 is not active+clean 2024-09-19T05:38:22.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.127540+0000', 'last_change': '2024-09-19T05:38:17.127540+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.127540+0000', 'last_undegraded': '2024-09-19T05:38:17.127540+0000', 'last_fullsized': '2024-09-19T05:38:17.127540+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:38:22.960 INFO:tasks.ceph.ceph_manager.ceph:PG 12.a is not active+clean 2024-09-19T05:38:22.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.127631+0000', 'last_change': '2024-09-19T05:38:17.127631+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.127631+0000', 'last_undegraded': '2024-09-19T05:38:17.127631+0000', 'last_fullsized': '2024-09-19T05:38:17.127631+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:38:22.960 INFO:tasks.ceph.ceph_manager.ceph:PG 12.b is not active+clean 2024-09-19T05:38:22.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.128271+0000', 'last_change': '2024-09-19T05:38:17.128271+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.128271+0000', 'last_undegraded': '2024-09-19T05:38:17.128271+0000', 'last_fullsized': '2024-09-19T05:38:17.128271+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:38:22.960 INFO:tasks.ceph.ceph_manager.ceph:PG 12.c is not active+clean 2024-09-19T05:38:22.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.122399+0000', 'last_change': '2024-09-19T05:38:17.122399+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.122399+0000', 'last_undegraded': '2024-09-19T05:38:17.122399+0000', 'last_fullsized': '2024-09-19T05:38:17.122399+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.961 INFO:tasks.ceph.ceph_manager.ceph:PG 12.e is not active+clean 2024-09-19T05:38:22.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.123069+0000', 'last_change': '2024-09-19T05:38:17.123069+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.123069+0000', 'last_undegraded': '2024-09-19T05:38:17.123069+0000', 'last_fullsized': '2024-09-19T05:38:17.123069+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.961 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-09-19T05:38:22.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.130810+0000', 'last_change': '2024-09-19T05:38:17.130810+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.130810+0000', 'last_undegraded': '2024-09-19T05:38:17.130810+0000', 'last_fullsized': '2024-09-19T05:38:17.130810+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:38:22.961 INFO:tasks.ceph.ceph_manager.ceph:PG 12.0 is not active+clean 2024-09-19T05:38:22.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.118006+0000', 'last_change': '2024-09-19T05:38:17.118006+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.118006+0000', 'last_undegraded': '2024-09-19T05:38:17.118006+0000', 'last_fullsized': '2024-09-19T05:38:17.118006+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:38:22.961 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-09-19T05:38:22.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.127199+0000', 'last_change': '2024-09-19T05:38:17.127199+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.127199+0000', 'last_undegraded': '2024-09-19T05:38:17.127199+0000', 'last_fullsized': '2024-09-19T05:38:17.127199+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:38:22.962 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-09-19T05:38:22.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.119687+0000', 'last_change': '2024-09-19T05:38:17.119687+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.119687+0000', 'last_undegraded': '2024-09-19T05:38:17.119687+0000', 'last_fullsized': '2024-09-19T05:38:17.119687+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:38:22.962 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3 is not active+clean 2024-09-19T05:38:22.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.122090+0000', 'last_change': '2024-09-19T05:38:17.122090+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.122090+0000', 'last_undegraded': '2024-09-19T05:38:17.122090+0000', 'last_fullsized': '2024-09-19T05:38:17.122090+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:38:22.962 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-09-19T05:38:22.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.133830+0000', 'last_change': '2024-09-19T05:38:17.133830+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.133830+0000', 'last_undegraded': '2024-09-19T05:38:17.133830+0000', 'last_fullsized': '2024-09-19T05:38:17.133830+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:38:22.962 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-09-19T05:38:22.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.125393+0000', 'last_change': '2024-09-19T05:38:17.125393+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.125393+0000', 'last_undegraded': '2024-09-19T05:38:17.125393+0000', 'last_fullsized': '2024-09-19T05:38:17.125393+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:38:22.962 INFO:tasks.ceph.ceph_manager.ceph:PG 12.6 is not active+clean 2024-09-19T05:38:22.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.116563+0000', 'last_change': '2024-09-19T05:38:17.116563+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.116563+0000', 'last_undegraded': '2024-09-19T05:38:17.116563+0000', 'last_fullsized': '2024-09-19T05:38:17.116563+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:38:22.963 INFO:tasks.ceph.ceph_manager.ceph:PG 12.7 is not active+clean 2024-09-19T05:38:22.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.119391+0000', 'last_change': '2024-09-19T05:38:17.119391+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.119391+0000', 'last_undegraded': '2024-09-19T05:38:17.119391+0000', 'last_fullsized': '2024-09-19T05:38:17.119391+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:38:22.963 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-19T05:38:22.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:38:17.112050+0000', 'last_change': '2024-09-19T05:38:17.112050+0000', 'last_active': '2024-09-19T05:38:17.100227+0000', 'last_peered': '2024-09-19T05:38:17.100227+0000', 'last_clean': '2024-09-19T05:38:17.100227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:38:17.112050+0000', 'last_undegraded': '2024-09-19T05:38:17.112050+0000', 'last_fullsized': '2024-09-19T05:38:17.112050+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'last_clean_scrub_stamp': '2024-09-19T05:38:17.100227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:38:22.963 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:38:23.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.104+0000 7f7633f4b640 1 Processor -- start 2024-09-19T05:38:23.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.104+0000 7f7633f4b640 1 -- start start 2024-09-19T05:38:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.104+0000 7f7633f4b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f762c15c0a0 0x7f762c15f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.104+0000 7f7633f4b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f762c0cf5b0 0x7f762c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.104+0000 7f7633f4b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762c06d210 0x7f762c0af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.104+0000 7f7633f4b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f762c06d660 con 0x7f762c15c0a0 2024-09-19T05:38:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.104+0000 7f7633f4b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f762c0d06a0 con 0x7f762c0cf5b0 2024-09-19T05:38:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.104+0000 7f7633f4b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f762c15fb60 con 0x7f762c06d210 2024-09-19T05:38:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.104+0000 7f7631ce7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f762c15c0a0 0x7f762c15f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7631ce7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f762c15c0a0 0x7f762c15f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56838/0 (socket says 172.21.15.67:56838) 2024-09-19T05:38:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7631ce7640 1 -- 172.21.15.67:0/3502006175 learned_addr learned my addr 172.21.15.67:0/3502006175 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f76324e8640 1 --2- 172.21.15.67:0/3502006175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762c06d210 0x7f762c0af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f76314e6640 1 --2- 172.21.15.67:0/3502006175 >> v2:172.21.15.97:3300/0 conn(0x7f762c0cf5b0 0x7f762c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7631ce7640 1 -- 172.21.15.67:0/3502006175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762c06d210 msgr2=0x7f762c0af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:23.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7631ce7640 1 --2- 172.21.15.67:0/3502006175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762c06d210 0x7f762c0af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7631ce7640 1 -- 172.21.15.67:0/3502006175 >> v2:172.21.15.97:3300/0 conn(0x7f762c0cf5b0 msgr2=0x7f762c06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:23.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7631ce7640 1 --2- 172.21.15.67:0/3502006175 >> v2:172.21.15.97:3300/0 conn(0x7f762c0cf5b0 0x7f762c06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7631ce7640 1 -- 172.21.15.67:0/3502006175 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c0cfe00 con 0x7f762c15c0a0 2024-09-19T05:38:23.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7631ce7640 1 --2- 172.21.15.67:0/3502006175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 0x7f762c15f620 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f762c15ebe0 tx=0x7f762801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f2423e6fedcbca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:23.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7630ce5640 1 -- 172.21.15.67:0/3502006175 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76280ab620 con 0x7f762c15c0a0 2024-09-19T05:38:23.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7630ce5640 1 -- 172.21.15.67:0/3502006175 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76280b0070 con 0x7f762c15c0a0 2024-09-19T05:38:23.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7630ce5640 1 -- 172.21.15.67:0/3502006175 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76280ab9e0 con 0x7f762c15c0a0 2024-09-19T05:38:23.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7633f4b640 1 -- 172.21.15.67:0/3502006175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 msgr2=0x7f762c15f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7633f4b640 1 --2- 172.21.15.67:0/3502006175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 0x7f762c15f620 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f762c15ebe0 tx=0x7f762801c460 comp rx=0 tx=0).stop 2024-09-19T05:38:23.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7633f4b640 1 -- 172.21.15.67:0/3502006175 shutdown_connections 2024-09-19T05:38:23.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7633f4b640 1 --2- 172.21.15.67:0/3502006175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762c06d210 0x7f762c0af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7633f4b640 1 --2- 172.21.15.67:0/3502006175 >> v2:172.21.15.97:3300/0 conn(0x7f762c0cf5b0 0x7f762c06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7633f4b640 1 --2- 172.21.15.67:0/3502006175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 0x7f762c15f620 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7633f4b640 1 -- 172.21.15.67:0/3502006175 >> 172.21.15.67:0/3502006175 conn(0x7f762c072800 msgr2=0x7f762c072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:23.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7633f4b640 1 -- 172.21.15.67:0/3502006175 shutdown_connections 2024-09-19T05:38:23.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.108+0000 7f7633f4b640 1 -- 172.21.15.67:0/3502006175 wait complete. 2024-09-19T05:38:23.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7633f4b640 1 Processor -- start 2024-09-19T05:38:23.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7633f4b640 1 -- start start 2024-09-19T05:38:23.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7633f4b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762c06d210 0x7f762c0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7633f4b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f762c0cf5b0 0x7f762c154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7633f4b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 0x7f762c158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7633f4b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f762c0cf9c0 con 0x7f762c15c0a0 2024-09-19T05:38:23.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7633f4b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f762c15c480 con 0x7f762c0cf5b0 2024-09-19T05:38:23.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7633f4b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f762c0cfb40 con 0x7f762c06d210 2024-09-19T05:38:23.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76324e8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 0x7f762c158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76324e8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 0x7f762c158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56844/0 (socket says 172.21.15.67:56844) 2024-09-19T05:38:23.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76324e8640 1 -- 172.21.15.67:0/1991652057 learned_addr learned my addr 172.21.15.67:0/1991652057 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:23.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76314e6640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f762c0cf5b0 0x7f762c154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7631ce7640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762c06d210 0x7f762c0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76324e8640 1 -- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762c06d210 msgr2=0x7f762c0a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76324e8640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762c06d210 0x7f762c0a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76324e8640 1 -- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f762c0cf5b0 msgr2=0x7f762c154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76324e8640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f762c0cf5b0 0x7f762c154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76324e8640 1 -- 172.21.15.67:0/1991652057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c137d60 con 0x7f762c15c0a0 2024-09-19T05:38:23.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76324e8640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 0x7f762c158260 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7624007de0 tx=0x7f76240106c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:23.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76227fc640 1 -- 172.21.15.67:0/1991652057 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7624018070 con 0x7f762c15c0a0 2024-09-19T05:38:23.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76227fc640 1 -- 172.21.15.67:0/1991652057 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7624013690 con 0x7f762c15c0a0 2024-09-19T05:38:23.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f76227fc640 1 -- 172.21.15.67:0/1991652057 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7624013a80 con 0x7f762c15c0a0 2024-09-19T05:38:23.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7633f4b640 1 -- 172.21.15.67:0/1991652057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762c138000 con 0x7f762c15c0a0 2024-09-19T05:38:23.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.112+0000 7f7633f4b640 1 -- 172.21.15.67:0/1991652057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762c1385c0 con 0x7f762c15c0a0 2024-09-19T05:38:23.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.116+0000 7f7633f4b640 1 -- 172.21.15.67:0/1991652057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762c06ccd0 con 0x7f762c15c0a0 2024-09-19T05:38:23.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.116+0000 7f76227fc640 1 -- 172.21.15.67:0/1991652057 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f762401b070 con 0x7f762c15c0a0 2024-09-19T05:38:23.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.116+0000 7f76227fc640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678f0 0x7f7610069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.116+0000 7f76227fc640 1 -- 172.21.15.67:0/1991652057 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f7624088d30 con 0x7f762c15c0a0 2024-09-19T05:38:23.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.116+0000 7f7631ce7640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678f0 0x7f7610069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.116+0000 7f7631ce7640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678f0 0x7f7610069db0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f76280af000 tx=0x7f7628008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:23.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.120+0000 7f76227fc640 1 -- 172.21.15.67:0/1991652057 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f76240596e0 con 0x7f762c15c0a0 2024-09-19T05:38:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.344+0000 7f7633f4b640 1 -- 172.21.15.67:0/1991652057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f762c070fc0 con 0x7f762c15c0a0 2024-09-19T05:38:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.344+0000 7f76227fc640 1 -- 172.21.15.67:0/1991652057 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1495 (secure 0 0 0) 0x7f7624058fe0 con 0x7f762c15c0a0 2024-09-19T05:38:23.350 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:23.350 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":333,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":85,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":351449088,"bytes_avail":772742664192,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":52,"btime":"2024-09-19T05:38:21:175684+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6741}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-09-19T05:38:05.208566+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:38:23.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 -- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678f0 msgr2=0x7f7610069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678f0 0x7f7610069db0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f76280af000 tx=0x7f7628008040 comp rx=0 tx=0).stop 2024-09-19T05:38:23.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 -- 172.21.15.67:0/1991652057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 msgr2=0x7f762c158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 0x7f762c158260 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7624007de0 tx=0x7f76240106c0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 -- 172.21.15.67:0/1991652057 shutdown_connections 2024-09-19T05:38:23.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f762c15c0a0 0x7f762c158260 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f762c0cf5b0 0x7f762c154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76100678f0 0x7f7610069db0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 --2- 172.21.15.67:0/1991652057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f762c06d210 0x7f762c0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 -- 172.21.15.67:0/1991652057 >> 172.21.15.67:0/1991652057 conn(0x7f762c072800 msgr2=0x7f762c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:23.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 -- 172.21.15.67:0/1991652057 shutdown_connections 2024-09-19T05:38:23.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.348+0000 7f7633f4b640 1 -- 172.21.15.67:0/1991652057 wait complete. 2024-09-19T05:38:23.368 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T05:38:23.369 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:23.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f40f0640 1 Processor -- start 2024-09-19T05:38:23.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f40f0640 1 -- start start 2024-09-19T05:38:23.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f40f0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1ec15b710 0x7fb1ec071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f40f0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec0aef40 0x7fb1ec0af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f40f0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ec0b3070 con 0x7fb1ec15baf0 2024-09-19T05:38:23.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f40f0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ec0b32e0 con 0x7fb1ec15b710 2024-09-19T05:38:23.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f40f0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec0b35c0 con 0x7fb1ec0aef40 2024-09-19T05:38:23.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f1e8c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1ec15b710 0x7fb1ec071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f168b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb1ec15baf0 0x7fb1ec15bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:60540/0 (socket says 172.21.15.67:60540) 2024-09-19T05:38:23.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f168b640 1 -- 172.21.15.67:0/1883180136 learned_addr learned my addr 172.21.15.67:0/1883180136 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:23.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f268d640 1 --2- 172.21.15.67:0/1883180136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec0aef40 0x7fb1ec0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f0e8a640 1 -- 172.21.15.67:0/1883180136 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891937428 0 0) 0x7fb1ec0b3070 con 0x7fb1ec15baf0 2024-09-19T05:38:23.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f0e8a640 1 -- 172.21.15.67:0/1883180136 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d8005740 con 0x7fb1ec15baf0 2024-09-19T05:38:23.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f268d640 1 -- 172.21.15.67:0/1883180136 >> v2:172.21.15.97:3300/0 conn(0x7fb1ec15b710 msgr2=0x7fb1ec071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:23.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f268d640 1 --2- 172.21.15.67:0/1883180136 >> v2:172.21.15.97:3300/0 conn(0x7fb1ec15b710 0x7fb1ec071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f268d640 1 -- 172.21.15.67:0/1883180136 >> v1:172.21.15.97:6789/0 conn(0x7fb1ec15baf0 legacy=0x7fb1ec15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f268d640 1 -- 172.21.15.67:0/1883180136 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec0b38a0 con 0x7fb1ec0aef40 2024-09-19T05:38:23.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.480+0000 7fb1f1e8c640 1 --2- 172.21.15.67:0/1883180136 >> v2:172.21.15.97:3300/0 conn(0x7fb1ec15b710 0x7fb1ec071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:23.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f268d640 1 --2- 172.21.15.67:0/1883180136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec0aef40 0x7fb1ec0af360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097c0 tx=0x7fb1e401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7274cc8fda728f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:23.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f0e8a640 1 -- 172.21.15.67:0/1883180136 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40aa5f0 con 0x7fb1ec0aef40 2024-09-19T05:38:23.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f0e8a640 1 -- 172.21.15.67:0/1883180136 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e40af070 con 0x7fb1ec0aef40 2024-09-19T05:38:23.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f0e8a640 1 -- 172.21.15.67:0/1883180136 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40aa990 con 0x7fb1ec0aef40 2024-09-19T05:38:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f40f0640 1 -- 172.21.15.67:0/1883180136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec0aef40 msgr2=0x7fb1ec0af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f40f0640 1 --2- 172.21.15.67:0/1883180136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec0aef40 0x7fb1ec0af360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097c0 tx=0x7fb1e401c470 comp rx=0 tx=0).stop 2024-09-19T05:38:23.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f40f0640 1 -- 172.21.15.67:0/1883180136 shutdown_connections 2024-09-19T05:38:23.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f40f0640 1 --2- 172.21.15.67:0/1883180136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec0aef40 0x7fb1ec0af360 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f40f0640 1 --2- 172.21.15.67:0/1883180136 >> v2:172.21.15.97:3300/0 conn(0x7fb1ec15b710 0x7fb1ec071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f40f0640 1 -- 172.21.15.67:0/1883180136 >> 172.21.15.67:0/1883180136 conn(0x7fb1ec0d0080 msgr2=0x7fb1ec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:23.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f40f0640 1 -- 172.21.15.67:0/1883180136 shutdown_connections 2024-09-19T05:38:23.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f40f0640 1 -- 172.21.15.67:0/1883180136 wait complete. 2024-09-19T05:38:23.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f40f0640 1 Processor -- start 2024-09-19T05:38:23.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.484+0000 7fb1f40f0640 1 -- start start 2024-09-19T05:38:23.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f40f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ec0aef40 0x7fb1ec144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f40f0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec15b710 0x7fb1ec147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f40f0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1ec15baf0 0x7fb1ec099550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f40f0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec0b4c40 con 0x7fb1ec0aef40 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f40f0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec0b4ac0 con 0x7fb1ec15baf0 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f40f0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec0b4dc0 con 0x7fb1ec15b710 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f1e8c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ec0aef40 0x7fb1ec144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f1e8c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ec0aef40 0x7fb1ec144fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56852/0 (socket says 172.21.15.67:56852) 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f1e8c640 1 -- 172.21.15.67:0/4085278075 learned_addr learned my addr 172.21.15.67:0/4085278075 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f268d640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1ec15baf0 0x7fb1ec099550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f168b640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec15b710 0x7fb1ec147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f1e8c640 1 -- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec15b710 msgr2=0x7fb1ec147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f1e8c640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec15b710 0x7fb1ec147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f1e8c640 1 -- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1ec15baf0 msgr2=0x7fb1ec099550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f1e8c640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1ec15baf0 0x7fb1ec099550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f1e8c640 1 -- 172.21.15.67:0/4085278075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec1468c0 con 0x7fb1ec0aef40 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f1e8c640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ec0aef40 0x7fb1ec144fb0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00ec10 tx=0x7fb1dc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1e27fc640 1 -- 172.21.15.67:0/4085278075 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc017070 con 0x7fb1ec0aef40 2024-09-19T05:38:23.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1e27fc640 1 -- 172.21.15.67:0/4085278075 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc00cc30 con 0x7fb1ec0aef40 2024-09-19T05:38:23.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f40f0640 1 -- 172.21.15.67:0/4085278075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ec146ba0 con 0x7fb1ec0aef40 2024-09-19T05:38:23.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1e27fc640 1 -- 172.21.15.67:0/4085278075 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc013470 con 0x7fb1ec0aef40 2024-09-19T05:38:23.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f40f0640 1 -- 172.21.15.67:0/4085278075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ec147160 con 0x7fb1ec0aef40 2024-09-19T05:38:23.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f40f0640 1 -- 172.21.15.67:0/4085278075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1ec15e9b0 con 0x7fb1ec0aef40 2024-09-19T05:38:23.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1e27fc640 1 -- 172.21.15.67:0/4085278075 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1dc01a070 con 0x7fb1ec0aef40 2024-09-19T05:38:23.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1e27fc640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1d00678f0 0x7fb1d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:23.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1e27fc640 1 -- 172.21.15.67:0/4085278075 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7fb1dc086110 con 0x7fb1ec0aef40 2024-09-19T05:38:23.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.488+0000 7fb1f168b640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1d00678f0 0x7fb1d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:23.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.492+0000 7fb1f168b640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1d00678f0 0x7fb1d0069db0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec153270 tx=0x7fb1e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:23.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.492+0000 7fb1e27fc640 1 -- 172.21.15.67:0/4085278075 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb1dc056ac0 con 0x7fb1ec0aef40 2024-09-19T05:38:23.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.648+0000 7fb1f40f0640 1 -- 172.21.15.67:0/4085278075 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1ec0b5020 con 0x7fb1d00678f0 2024-09-19T05:38:23.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.664+0000 7fb1e27fc640 1 -- 172.21.15.67:0/4085278075 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252089 (secure 0 0 0) 0x7fb1ec0b5020 con 0x7fb1d00678f0 2024-09-19T05:38:23.671 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:38:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 -- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1d00678f0 msgr2=0x7fb1d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1d00678f0 0x7fb1d0069db0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec153270 tx=0x7fb1e8009040 comp rx=0 tx=0).stop 2024-09-19T05:38:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 -- 172.21.15.67:0/4085278075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ec0aef40 msgr2=0x7fb1ec144fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ec0aef40 0x7fb1ec144fb0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00ec10 tx=0x7fb1dc00c520 comp rx=0 tx=0).stop 2024-09-19T05:38:23.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 -- 172.21.15.67:0/4085278075 shutdown_connections 2024-09-19T05:38:23.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1ec15baf0 0x7fb1ec099550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1d00678f0 0x7fb1d0069db0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1ec15b710 0x7fb1ec147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 --2- 172.21.15.67:0/4085278075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1ec0aef40 0x7fb1ec144fb0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:23.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 -- 172.21.15.67:0/4085278075 >> 172.21.15.67:0/4085278075 conn(0x7fb1ec0d0080 msgr2=0x7fb1ec073410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:23.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 -- 172.21.15.67:0/4085278075 shutdown_connections 2024-09-19T05:38:23.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:23.668+0000 7fb1f40f0640 1 -- 172.21.15.67:0/4085278075 wait complete. 2024-09-19T05:38:23.690 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-09-19T05:38:23.213300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":351852,"kb_used_data":9320,"kb_used_omap":12,"kb_used_meta":342323,"kb_avail":754622868,"statfs":{"total":773094113280,"available":772733816832,"internally_reserved":0,"allocated":9543680,"data_stored":5032436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":350539313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.105074"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368688+0000","last_change":"2024-09-19T05:38:18.193992+0000","last_active":"2024-09-19T05:38:19.368688+0000","last_peered":"2024-09-19T05:38:19.368688+0000","last_clean":"2024-09-19T05:38:19.368688+0000","last_became_active":"2024-09-19T05:38:18.193116+0000","last_became_peered":"2024-09-19T05:38:18.193116+0000","last_unstale":"2024-09-19T05:38:19.368688+0000","last_undegraded":"2024-09-19T05:38:19.368688+0000","last_fullsized":"2024-09-19T05:38:19.368688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:16.185184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170241+0000","last_change":"2024-09-19T05:38:18.169174+0000","last_active":"2024-09-19T05:38:19.170241+0000","last_peered":"2024-09-19T05:38:19.170241+0000","last_clean":"2024-09-19T05:38:19.170241+0000","last_became_active":"2024-09-19T05:38:18.168797+0000","last_became_peered":"2024-09-19T05:38:18.168797+0000","last_unstale":"2024-09-19T05:38:19.170241+0000","last_undegraded":"2024-09-19T05:38:19.170241+0000","last_fullsized":"2024-09-19T05:38:19.170241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:38.531819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369638+0000","last_change":"2024-09-19T05:38:18.178371+0000","last_active":"2024-09-19T05:38:19.369638+0000","last_peered":"2024-09-19T05:38:19.369638+0000","last_clean":"2024-09-19T05:38:19.369638+0000","last_became_active":"2024-09-19T05:38:18.175610+0000","last_became_peered":"2024-09-19T05:38:18.175610+0000","last_unstale":"2024-09-19T05:38:19.369638+0000","last_undegraded":"2024-09-19T05:38:19.369638+0000","last_fullsized":"2024-09-19T05:38:19.369638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:52.055892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369666+0000","last_change":"2024-09-19T05:38:18.176830+0000","last_active":"2024-09-19T05:38:19.369666+0000","last_peered":"2024-09-19T05:38:19.369666+0000","last_clean":"2024-09-19T05:38:19.369666+0000","last_became_active":"2024-09-19T05:38:18.170780+0000","last_became_peered":"2024-09-19T05:38:18.170780+0000","last_unstale":"2024-09-19T05:38:19.369666+0000","last_undegraded":"2024-09-19T05:38:19.369666+0000","last_fullsized":"2024-09-19T05:38:19.369666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:23.482048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168389+0000","last_change":"2024-09-19T05:38:18.179151+0000","last_active":"2024-09-19T05:38:19.168389+0000","last_peered":"2024-09-19T05:38:19.168389+0000","last_clean":"2024-09-19T05:38:19.168389+0000","last_became_active":"2024-09-19T05:38:18.178763+0000","last_became_peered":"2024-09-19T05:38:18.178763+0000","last_unstale":"2024-09-19T05:38:19.168389+0000","last_undegraded":"2024-09-19T05:38:19.168389+0000","last_fullsized":"2024-09-19T05:38:19.168389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:04.494134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369333+0000","last_change":"2024-09-19T05:38:18.168917+0000","last_active":"2024-09-19T05:38:19.369333+0000","last_peered":"2024-09-19T05:38:19.369333+0000","last_clean":"2024-09-19T05:38:19.369333+0000","last_became_active":"2024-09-19T05:38:18.168475+0000","last_became_peered":"2024-09-19T05:38:18.168475+0000","last_unstale":"2024-09-19T05:38:19.369333+0000","last_undegraded":"2024-09-19T05:38:19.369333+0000","last_fullsized":"2024-09-19T05:38:19.369333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:39:48.028622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370818+0000","last_change":"2024-09-19T05:38:18.173677+0000","last_active":"2024-09-19T05:38:19.370818+0000","last_peered":"2024-09-19T05:38:19.370818+0000","last_clean":"2024-09-19T05:38:19.370818+0000","last_became_active":"2024-09-19T05:38:18.172951+0000","last_became_peered":"2024-09-19T05:38:18.172951+0000","last_unstale":"2024-09-19T05:38:19.370818+0000","last_undegraded":"2024-09-19T05:38:19.370818+0000","last_fullsized":"2024-09-19T05:38:19.370818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:26.231032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.166977+0000","last_change":"2024-09-19T05:38:18.168523+0000","last_active":"2024-09-19T05:38:19.166977+0000","last_peered":"2024-09-19T05:38:19.166977+0000","last_clean":"2024-09-19T05:38:19.166977+0000","last_became_active":"2024-09-19T05:38:18.168157+0000","last_became_peered":"2024-09-19T05:38:18.168157+0000","last_unstale":"2024-09-19T05:38:19.166977+0000","last_undegraded":"2024-09-19T05:38:19.166977+0000","last_fullsized":"2024-09-19T05:38:19.166977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:56.837273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170477+0000","last_change":"2024-09-19T05:38:18.167604+0000","last_active":"2024-09-19T05:38:19.170477+0000","last_peered":"2024-09-19T05:38:19.170477+0000","last_clean":"2024-09-19T05:38:19.170477+0000","last_became_active":"2024-09-19T05:38:18.166856+0000","last_became_peered":"2024-09-19T05:38:18.166856+0000","last_unstale":"2024-09-19T05:38:19.170477+0000","last_undegraded":"2024-09-19T05:38:19.170477+0000","last_fullsized":"2024-09-19T05:38:19.170477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:44.832838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368797+0000","last_change":"2024-09-19T05:38:18.168536+0000","last_active":"2024-09-19T05:38:19.368797+0000","last_peered":"2024-09-19T05:38:19.368797+0000","last_clean":"2024-09-19T05:38:19.368797+0000","last_became_active":"2024-09-19T05:38:18.166782+0000","last_became_peered":"2024-09-19T05:38:18.166782+0000","last_unstale":"2024-09-19T05:38:19.368797+0000","last_undegraded":"2024-09-19T05:38:19.368797+0000","last_fullsized":"2024-09-19T05:38:19.368797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:42.317070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170478+0000","last_change":"2024-09-19T05:38:18.177455+0000","last_active":"2024-09-19T05:38:19.170478+0000","last_peered":"2024-09-19T05:38:19.170478+0000","last_clean":"2024-09-19T05:38:19.170478+0000","last_became_active":"2024-09-19T05:38:18.177132+0000","last_became_peered":"2024-09-19T05:38:18.177132+0000","last_unstale":"2024-09-19T05:38:19.170478+0000","last_undegraded":"2024-09-19T05:38:19.170478+0000","last_fullsized":"2024-09-19T05:38:19.170478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:39:48.028622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370052+0000","last_change":"2024-09-19T05:38:18.168595+0000","last_active":"2024-09-19T05:38:19.370052+0000","last_peered":"2024-09-19T05:38:19.370052+0000","last_clean":"2024-09-19T05:38:19.370052+0000","last_became_active":"2024-09-19T05:38:18.167829+0000","last_became_peered":"2024-09-19T05:38:18.167829+0000","last_unstale":"2024-09-19T05:38:19.370052+0000","last_undegraded":"2024-09-19T05:38:19.370052+0000","last_fullsized":"2024-09-19T05:38:19.370052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:22.226544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168755+0000","last_change":"2024-09-19T05:38:18.179109+0000","last_active":"2024-09-19T05:38:19.168755+0000","last_peered":"2024-09-19T05:38:19.168755+0000","last_clean":"2024-09-19T05:38:19.168755+0000","last_became_active":"2024-09-19T05:38:18.178694+0000","last_became_peered":"2024-09-19T05:38:18.178694+0000","last_unstale":"2024-09-19T05:38:19.168755+0000","last_undegraded":"2024-09-19T05:38:19.168755+0000","last_fullsized":"2024-09-19T05:38:19.168755+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:51.736428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369669+0000","last_change":"2024-09-19T05:38:18.168702+0000","last_active":"2024-09-19T05:38:19.369669+0000","last_peered":"2024-09-19T05:38:19.369669+0000","last_clean":"2024-09-19T05:38:19.369669+0000","last_became_active":"2024-09-19T05:38:18.168102+0000","last_became_peered":"2024-09-19T05:38:18.168102+0000","last_unstale":"2024-09-19T05:38:19.369669+0000","last_undegraded":"2024-09-19T05:38:19.369669+0000","last_fullsized":"2024-09-19T05:38:19.369669+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:09.589516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169855+0000","last_change":"2024-09-19T05:38:18.167727+0000","last_active":"2024-09-19T05:38:19.169855+0000","last_peered":"2024-09-19T05:38:19.169855+0000","last_clean":"2024-09-19T05:38:19.169855+0000","last_became_active":"2024-09-19T05:38:18.167371+0000","last_became_peered":"2024-09-19T05:38:18.167371+0000","last_unstale":"2024-09-19T05:38:19.169855+0000","last_undegraded":"2024-09-19T05:38:19.169855+0000","last_fullsized":"2024-09-19T05:38:19.169855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:16.185184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368363+0000","last_change":"2024-09-19T05:38:18.184678+0000","last_active":"2024-09-19T05:38:19.368363+0000","last_peered":"2024-09-19T05:38:19.368363+0000","last_clean":"2024-09-19T05:38:19.368363+0000","last_became_active":"2024-09-19T05:38:18.183961+0000","last_became_peered":"2024-09-19T05:38:18.183961+0000","last_unstale":"2024-09-19T05:38:19.368363+0000","last_undegraded":"2024-09-19T05:38:19.368363+0000","last_fullsized":"2024-09-19T05:38:19.368363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:33.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168979+0000","last_change":"2024-09-19T05:38:18.171951+0000","last_active":"2024-09-19T05:38:19.168979+0000","last_peered":"2024-09-19T05:38:19.168979+0000","last_clean":"2024-09-19T05:38:19.168979+0000","last_became_active":"2024-09-19T05:38:18.171562+0000","last_became_peered":"2024-09-19T05:38:18.171562+0000","last_unstale":"2024-09-19T05:38:19.168979+0000","last_undegraded":"2024-09-19T05:38:19.168979+0000","last_fullsized":"2024-09-19T05:38:19.168979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:11.754668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368804+0000","last_change":"2024-09-19T05:38:18.173648+0000","last_active":"2024-09-19T05:38:19.368804+0000","last_peered":"2024-09-19T05:38:19.368804+0000","last_clean":"2024-09-19T05:38:19.368804+0000","last_became_active":"2024-09-19T05:38:18.173369+0000","last_became_peered":"2024-09-19T05:38:18.173369+0000","last_unstale":"2024-09-19T05:38:19.368804+0000","last_undegraded":"2024-09-19T05:38:19.368804+0000","last_fullsized":"2024-09-19T05:38:19.368804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:34.587947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370257+0000","last_change":"2024-09-19T05:38:18.174462+0000","last_active":"2024-09-19T05:38:19.370257+0000","last_peered":"2024-09-19T05:38:19.370257+0000","last_clean":"2024-09-19T05:38:19.370257+0000","last_became_active":"2024-09-19T05:38:18.174006+0000","last_became_peered":"2024-09-19T05:38:18.174006+0000","last_unstale":"2024-09-19T05:38:19.370257+0000","last_undegraded":"2024-09-19T05:38:19.370257+0000","last_fullsized":"2024-09-19T05:38:19.370257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:08.341765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168659+0000","last_change":"2024-09-19T05:38:18.170038+0000","last_active":"2024-09-19T05:38:19.168659+0000","last_peered":"2024-09-19T05:38:19.168659+0000","last_clean":"2024-09-19T05:38:19.168659+0000","last_became_active":"2024-09-19T05:38:18.169668+0000","last_became_peered":"2024-09-19T05:38:18.169668+0000","last_unstale":"2024-09-19T05:38:19.168659+0000","last_undegraded":"2024-09-19T05:38:19.168659+0000","last_fullsized":"2024-09-19T05:38:19.168659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:06.934522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169860+0000","last_change":"2024-09-19T05:38:18.168271+0000","last_active":"2024-09-19T05:38:19.169860+0000","last_peered":"2024-09-19T05:38:19.169860+0000","last_clean":"2024-09-19T05:38:19.169860+0000","last_became_active":"2024-09-19T05:38:18.166487+0000","last_became_peered":"2024-09-19T05:38:18.166487+0000","last_unstale":"2024-09-19T05:38:19.169860+0000","last_undegraded":"2024-09-19T05:38:19.169860+0000","last_fullsized":"2024-09-19T05:38:19.169860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:56.215215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167853+0000","last_change":"2024-09-19T05:38:18.178835+0000","last_active":"2024-09-19T05:38:19.167853+0000","last_peered":"2024-09-19T05:38:19.167853+0000","last_clean":"2024-09-19T05:38:19.167853+0000","last_became_active":"2024-09-19T05:38:18.178525+0000","last_became_peered":"2024-09-19T05:38:18.178525+0000","last_unstale":"2024-09-19T05:38:19.167853+0000","last_undegraded":"2024-09-19T05:38:19.167853+0000","last_fullsized":"2024-09-19T05:38:19.167853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:51.280979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169351+0000","last_change":"2024-09-19T05:38:18.187822+0000","last_active":"2024-09-19T05:38:19.169351+0000","last_peered":"2024-09-19T05:38:19.169351+0000","last_clean":"2024-09-19T05:38:19.169351+0000","last_became_active":"2024-09-19T05:38:18.186994+0000","last_became_peered":"2024-09-19T05:38:18.186994+0000","last_unstale":"2024-09-19T05:38:19.169351+0000","last_undegraded":"2024-09-19T05:38:19.169351+0000","last_fullsized":"2024-09-19T05:38:19.169351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:47.309432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169770+0000","last_change":"2024-09-19T05:38:18.167629+0000","last_active":"2024-09-19T05:38:19.169770+0000","last_peered":"2024-09-19T05:38:19.169770+0000","last_clean":"2024-09-19T05:38:19.169770+0000","last_became_active":"2024-09-19T05:38:18.167336+0000","last_became_peered":"2024-09-19T05:38:18.167336+0000","last_unstale":"2024-09-19T05:38:19.169770+0000","last_undegraded":"2024-09-19T05:38:19.169770+0000","last_fullsized":"2024-09-19T05:38:19.169770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:33.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170789+0000","last_change":"2024-09-19T05:38:18.175804+0000","last_active":"2024-09-19T05:38:19.170789+0000","last_peered":"2024-09-19T05:38:19.170789+0000","last_clean":"2024-09-19T05:38:19.170789+0000","last_became_active":"2024-09-19T05:38:18.175373+0000","last_became_peered":"2024-09-19T05:38:18.175373+0000","last_unstale":"2024-09-19T05:38:19.170789+0000","last_undegraded":"2024-09-19T05:38:19.170789+0000","last_fullsized":"2024-09-19T05:38:19.170789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:08.341765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369019+0000","last_change":"2024-09-19T05:38:18.167495+0000","last_active":"2024-09-19T05:38:19.369019+0000","last_peered":"2024-09-19T05:38:19.369019+0000","last_clean":"2024-09-19T05:38:19.369019+0000","last_became_active":"2024-09-19T05:38:18.160453+0000","last_became_peered":"2024-09-19T05:38:18.160453+0000","last_unstale":"2024-09-19T05:38:19.369019+0000","last_undegraded":"2024-09-19T05:38:19.369019+0000","last_fullsized":"2024-09-19T05:38:19.369019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:32.890251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370248+0000","last_change":"2024-09-19T05:38:18.192257+0000","last_active":"2024-09-19T05:38:19.370248+0000","last_peered":"2024-09-19T05:38:19.370248+0000","last_clean":"2024-09-19T05:38:19.370248+0000","last_became_active":"2024-09-19T05:38:18.191632+0000","last_became_peered":"2024-09-19T05:38:18.191632+0000","last_unstale":"2024-09-19T05:38:19.370248+0000","last_undegraded":"2024-09-19T05:38:19.370248+0000","last_fullsized":"2024-09-19T05:38:19.370248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:25.315970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167743+0000","last_change":"2024-09-19T05:38:18.182567+0000","last_active":"2024-09-19T05:38:19.167743+0000","last_peered":"2024-09-19T05:38:19.167743+0000","last_clean":"2024-09-19T05:38:19.167743+0000","last_became_active":"2024-09-19T05:38:18.182203+0000","last_became_peered":"2024-09-19T05:38:18.182203+0000","last_unstale":"2024-09-19T05:38:19.167743+0000","last_undegraded":"2024-09-19T05:38:19.167743+0000","last_fullsized":"2024-09-19T05:38:19.167743+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:38.310841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170421+0000","last_change":"2024-09-19T05:38:18.172140+0000","last_active":"2024-09-19T05:38:19.170421+0000","last_peered":"2024-09-19T05:38:19.170421+0000","last_clean":"2024-09-19T05:38:19.170421+0000","last_became_active":"2024-09-19T05:38:18.171815+0000","last_became_peered":"2024-09-19T05:38:18.171815+0000","last_unstale":"2024-09-19T05:38:19.170421+0000","last_undegraded":"2024-09-19T05:38:19.170421+0000","last_fullsized":"2024-09-19T05:38:19.170421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:26.615398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369501+0000","last_change":"2024-09-19T05:38:18.171344+0000","last_active":"2024-09-19T05:38:19.369501+0000","last_peered":"2024-09-19T05:38:19.369501+0000","last_clean":"2024-09-19T05:38:19.369501+0000","last_became_active":"2024-09-19T05:38:18.170602+0000","last_became_peered":"2024-09-19T05:38:18.170602+0000","last_unstale":"2024-09-19T05:38:19.369501+0000","last_undegraded":"2024-09-19T05:38:19.369501+0000","last_fullsized":"2024-09-19T05:38:19.369501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:38.531819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368518+0000","last_change":"2024-09-19T05:38:18.174551+0000","last_active":"2024-09-19T05:38:19.368518+0000","last_peered":"2024-09-19T05:38:19.368518+0000","last_clean":"2024-09-19T05:38:19.368518+0000","last_became_active":"2024-09-19T05:38:18.174226+0000","last_became_peered":"2024-09-19T05:38:18.174226+0000","last_unstale":"2024-09-19T05:38:19.368518+0000","last_undegraded":"2024-09-19T05:38:19.368518+0000","last_fullsized":"2024-09-19T05:38:19.368518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:05.183826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368783+0000","last_change":"2024-09-19T05:38:18.191460+0000","last_active":"2024-09-19T05:38:19.368783+0000","last_peered":"2024-09-19T05:38:19.368783+0000","last_clean":"2024-09-19T05:38:19.368783+0000","last_became_active":"2024-09-19T05:38:18.190812+0000","last_became_peered":"2024-09-19T05:38:18.190812+0000","last_unstale":"2024-09-19T05:38:19.368783+0000","last_undegraded":"2024-09-19T05:38:19.368783+0000","last_fullsized":"2024-09-19T05:38:19.368783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:04.004730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368189+0000","last_change":"2024-09-19T05:38:18.184727+0000","last_active":"2024-09-19T05:38:19.368189+0000","last_peered":"2024-09-19T05:38:19.368189+0000","last_clean":"2024-09-19T05:38:19.368189+0000","last_became_active":"2024-09-19T05:38:18.184328+0000","last_became_peered":"2024-09-19T05:38:18.184328+0000","last_unstale":"2024-09-19T05:38:19.368189+0000","last_undegraded":"2024-09-19T05:38:19.368189+0000","last_fullsized":"2024-09-19T05:38:19.368189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.964786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168967+0000","last_change":"2024-09-19T05:38:17.125550+0000","last_active":"2024-09-19T05:38:19.168967+0000","last_peered":"2024-09-19T05:38:19.168967+0000","last_clean":"2024-09-19T05:38:19.168967+0000","last_became_active":"2024-09-19T05:38:17.125194+0000","last_became_peered":"2024-09-19T05:38:17.125194+0000","last_unstale":"2024-09-19T05:38:19.168967+0000","last_undegraded":"2024-09-19T05:38:19.168967+0000","last_fullsized":"2024-09-19T05:38:19.168967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:36.008982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170021+0000","last_change":"2024-09-19T05:38:18.163672+0000","last_active":"2024-09-19T05:38:19.170021+0000","last_peered":"2024-09-19T05:38:19.170021+0000","last_clean":"2024-09-19T05:38:19.170021+0000","last_became_active":"2024-09-19T05:38:18.163237+0000","last_became_peered":"2024-09-19T05:38:18.163237+0000","last_unstale":"2024-09-19T05:38:19.170021+0000","last_undegraded":"2024-09-19T05:38:19.170021+0000","last_fullsized":"2024-09-19T05:38:19.170021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:04.004730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369788+0000","last_change":"2024-09-19T05:38:17.151155+0000","last_active":"2024-09-19T05:38:19.369788+0000","last_peered":"2024-09-19T05:38:19.369788+0000","last_clean":"2024-09-19T05:38:19.369788+0000","last_became_active":"2024-09-19T05:38:17.150121+0000","last_became_peered":"2024-09-19T05:38:17.150121+0000","last_unstale":"2024-09-19T05:38:19.369788+0000","last_undegraded":"2024-09-19T05:38:19.369788+0000","last_fullsized":"2024-09-19T05:38:19.369788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:04.968403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169547+0000","last_change":"2024-09-19T05:38:18.182886+0000","last_active":"2024-09-19T05:38:19.169547+0000","last_peered":"2024-09-19T05:38:19.169547+0000","last_clean":"2024-09-19T05:38:19.169547+0000","last_became_active":"2024-09-19T05:38:18.181513+0000","last_became_peered":"2024-09-19T05:38:18.181513+0000","last_unstale":"2024-09-19T05:38:19.169547+0000","last_undegraded":"2024-09-19T05:38:19.169547+0000","last_fullsized":"2024-09-19T05:38:19.169547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:19.382787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370505+0000","last_change":"2024-09-19T05:38:17.127521+0000","last_active":"2024-09-19T05:38:19.370505+0000","last_peered":"2024-09-19T05:38:19.370505+0000","last_clean":"2024-09-19T05:38:19.370505+0000","last_became_active":"2024-09-19T05:38:17.125524+0000","last_became_peered":"2024-09-19T05:38:17.125524+0000","last_unstale":"2024-09-19T05:38:19.370505+0000","last_undegraded":"2024-09-19T05:38:19.370505+0000","last_fullsized":"2024-09-19T05:38:19.370505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:11.479081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169510+0000","last_change":"2024-09-19T05:38:18.168909+0000","last_active":"2024-09-19T05:38:19.169510+0000","last_peered":"2024-09-19T05:38:19.169510+0000","last_clean":"2024-09-19T05:38:19.169510+0000","last_became_active":"2024-09-19T05:38:18.167448+0000","last_became_peered":"2024-09-19T05:38:18.167448+0000","last_unstale":"2024-09-19T05:38:19.169510+0000","last_undegraded":"2024-09-19T05:38:19.169510+0000","last_fullsized":"2024-09-19T05:38:19.169510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:00.054538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371911+0000","last_change":"2024-09-19T05:38:17.146072+0000","last_active":"2024-09-19T05:38:19.371911+0000","last_peered":"2024-09-19T05:38:19.371911+0000","last_clean":"2024-09-19T05:38:19.371911+0000","last_became_active":"2024-09-19T05:38:17.145049+0000","last_became_peered":"2024-09-19T05:38:17.145049+0000","last_unstale":"2024-09-19T05:38:19.371911+0000","last_undegraded":"2024-09-19T05:38:19.371911+0000","last_fullsized":"2024-09-19T05:38:19.371911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:45.454392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170324+0000","last_change":"2024-09-19T05:38:18.171280+0000","last_active":"2024-09-19T05:38:19.170324+0000","last_peered":"2024-09-19T05:38:19.170324+0000","last_clean":"2024-09-19T05:38:19.170324+0000","last_became_active":"2024-09-19T05:38:18.170908+0000","last_became_peered":"2024-09-19T05:38:18.170908+0000","last_unstale":"2024-09-19T05:38:19.170324+0000","last_undegraded":"2024-09-19T05:38:19.170324+0000","last_fullsized":"2024-09-19T05:38:19.170324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:25.315970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169783+0000","last_change":"2024-09-19T05:38:17.142355+0000","last_active":"2024-09-19T05:38:19.169783+0000","last_peered":"2024-09-19T05:38:19.169783+0000","last_clean":"2024-09-19T05:38:19.169783+0000","last_became_active":"2024-09-19T05:38:17.140750+0000","last_became_peered":"2024-09-19T05:38:17.140750+0000","last_unstale":"2024-09-19T05:38:19.169783+0000","last_undegraded":"2024-09-19T05:38:19.169783+0000","last_fullsized":"2024-09-19T05:38:19.169783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:04.539848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170543+0000","last_change":"2024-09-19T05:38:18.171184+0000","last_active":"2024-09-19T05:38:19.170543+0000","last_peered":"2024-09-19T05:38:19.170543+0000","last_clean":"2024-09-19T05:38:19.170543+0000","last_became_active":"2024-09-19T05:38:18.170820+0000","last_became_peered":"2024-09-19T05:38:18.170820+0000","last_unstale":"2024-09-19T05:38:19.170543+0000","last_undegraded":"2024-09-19T05:38:19.170543+0000","last_fullsized":"2024-09-19T05:38:19.170543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:09.589516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368097+0000","last_change":"2024-09-19T05:38:17.141855+0000","last_active":"2024-09-19T05:38:19.368097+0000","last_peered":"2024-09-19T05:38:19.368097+0000","last_clean":"2024-09-19T05:38:19.368097+0000","last_became_active":"2024-09-19T05:38:17.140748+0000","last_became_peered":"2024-09-19T05:38:17.140748+0000","last_unstale":"2024-09-19T05:38:19.368097+0000","last_undegraded":"2024-09-19T05:38:19.368097+0000","last_fullsized":"2024-09-19T05:38:19.368097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:14.184011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170447+0000","last_change":"2024-09-19T05:38:18.168052+0000","last_active":"2024-09-19T05:38:19.170447+0000","last_peered":"2024-09-19T05:38:19.170447+0000","last_clean":"2024-09-19T05:38:19.170447+0000","last_became_active":"2024-09-19T05:38:18.167261+0000","last_became_peered":"2024-09-19T05:38:18.167261+0000","last_unstale":"2024-09-19T05:38:19.170447+0000","last_undegraded":"2024-09-19T05:38:19.170447+0000","last_fullsized":"2024-09-19T05:38:19.170447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:04.691823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170117+0000","last_change":"2024-09-19T05:38:17.138271+0000","last_active":"2024-09-19T05:38:19.170117+0000","last_peered":"2024-09-19T05:38:19.170117+0000","last_clean":"2024-09-19T05:38:19.170117+0000","last_became_active":"2024-09-19T05:38:17.137963+0000","last_became_peered":"2024-09-19T05:38:17.137963+0000","last_unstale":"2024-09-19T05:38:19.170117+0000","last_undegraded":"2024-09-19T05:38:19.170117+0000","last_fullsized":"2024-09-19T05:38:19.170117+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:35.931949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371194+0000","last_change":"2024-09-19T05:38:18.173554+0000","last_active":"2024-09-19T05:38:19.371194+0000","last_peered":"2024-09-19T05:38:19.371194+0000","last_clean":"2024-09-19T05:38:19.371194+0000","last_became_active":"2024-09-19T05:38:18.172907+0000","last_became_peered":"2024-09-19T05:38:18.172907+0000","last_unstale":"2024-09-19T05:38:19.371194+0000","last_undegraded":"2024-09-19T05:38:19.371194+0000","last_fullsized":"2024-09-19T05:38:19.371194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:05.183826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167008+0000","last_change":"2024-09-19T05:38:17.132639+0000","last_active":"2024-09-19T05:38:19.167008+0000","last_peered":"2024-09-19T05:38:19.167008+0000","last_clean":"2024-09-19T05:38:19.167008+0000","last_became_active":"2024-09-19T05:38:17.132240+0000","last_became_peered":"2024-09-19T05:38:17.132240+0000","last_unstale":"2024-09-19T05:38:19.167008+0000","last_undegraded":"2024-09-19T05:38:19.167008+0000","last_fullsized":"2024-09-19T05:38:19.167008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:40.076019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169770+0000","last_change":"2024-09-19T05:38:18.180060+0000","last_active":"2024-09-19T05:38:19.169770+0000","last_peered":"2024-09-19T05:38:19.169770+0000","last_clean":"2024-09-19T05:38:19.169770+0000","last_became_active":"2024-09-19T05:38:18.179581+0000","last_became_peered":"2024-09-19T05:38:18.179581+0000","last_unstale":"2024-09-19T05:38:19.169770+0000","last_undegraded":"2024-09-19T05:38:19.169770+0000","last_fullsized":"2024-09-19T05:38:19.169770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:43.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370083+0000","last_change":"2024-09-19T05:38:17.137642+0000","last_active":"2024-09-19T05:38:19.370083+0000","last_peered":"2024-09-19T05:38:19.370083+0000","last_clean":"2024-09-19T05:38:19.370083+0000","last_became_active":"2024-09-19T05:38:17.136920+0000","last_became_peered":"2024-09-19T05:38:17.136920+0000","last_unstale":"2024-09-19T05:38:19.370083+0000","last_undegraded":"2024-09-19T05:38:19.370083+0000","last_fullsized":"2024-09-19T05:38:19.370083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:39.046256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368803+0000","last_change":"2024-09-19T05:38:18.177230+0000","last_active":"2024-09-19T05:38:19.368803+0000","last_peered":"2024-09-19T05:38:19.368803+0000","last_clean":"2024-09-19T05:38:19.368803+0000","last_became_active":"2024-09-19T05:38:18.170724+0000","last_became_peered":"2024-09-19T05:38:18.170724+0000","last_unstale":"2024-09-19T05:38:19.368803+0000","last_undegraded":"2024-09-19T05:38:19.368803+0000","last_fullsized":"2024-09-19T05:38:19.368803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:20.820710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369053+0000","last_change":"2024-09-19T05:38:17.149660+0000","last_active":"2024-09-19T05:38:19.369053+0000","last_peered":"2024-09-19T05:38:19.369053+0000","last_clean":"2024-09-19T05:38:19.369053+0000","last_became_active":"2024-09-19T05:38:17.147750+0000","last_became_peered":"2024-09-19T05:38:17.147750+0000","last_unstale":"2024-09-19T05:38:19.369053+0000","last_undegraded":"2024-09-19T05:38:19.369053+0000","last_fullsized":"2024-09-19T05:38:19.369053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:46.573148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369920+0000","last_change":"2024-09-19T05:38:18.166273+0000","last_active":"2024-09-19T05:38:19.369920+0000","last_peered":"2024-09-19T05:38:19.369920+0000","last_clean":"2024-09-19T05:38:19.369920+0000","last_became_active":"2024-09-19T05:38:18.165620+0000","last_became_peered":"2024-09-19T05:38:18.165620+0000","last_unstale":"2024-09-19T05:38:19.369920+0000","last_undegraded":"2024-09-19T05:38:19.369920+0000","last_fullsized":"2024-09-19T05:38:19.369920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:17.759334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169405+0000","last_change":"2024-09-19T05:38:17.132043+0000","last_active":"2024-09-19T05:38:19.169405+0000","last_peered":"2024-09-19T05:38:19.169405+0000","last_clean":"2024-09-19T05:38:19.169405+0000","last_became_active":"2024-09-19T05:38:17.130901+0000","last_became_peered":"2024-09-19T05:38:17.130901+0000","last_unstale":"2024-09-19T05:38:19.169405+0000","last_undegraded":"2024-09-19T05:38:19.169405+0000","last_fullsized":"2024-09-19T05:38:19.169405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:17.103208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369166+0000","last_change":"2024-09-19T05:38:18.170430+0000","last_active":"2024-09-19T05:38:19.369166+0000","last_peered":"2024-09-19T05:38:19.369166+0000","last_clean":"2024-09-19T05:38:19.369166+0000","last_became_active":"2024-09-19T05:38:18.170105+0000","last_became_peered":"2024-09-19T05:38:18.170105+0000","last_unstale":"2024-09-19T05:38:19.369166+0000","last_undegraded":"2024-09-19T05:38:19.369166+0000","last_fullsized":"2024-09-19T05:38:19.369166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:28.259580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"84'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.372107+0000","last_change":"2024-09-19T05:38:17.152541+0000","last_active":"2024-09-19T05:38:19.372107+0000","last_peered":"2024-09-19T05:38:19.372107+0000","last_clean":"2024-09-19T05:38:19.372107+0000","last_became_active":"2024-09-19T05:38:17.152060+0000","last_became_peered":"2024-09-19T05:38:17.152060+0000","last_unstale":"2024-09-19T05:38:19.372107+0000","last_undegraded":"2024-09-19T05:38:19.372107+0000","last_fullsized":"2024-09-19T05:38:19.372107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:46.300742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370437+0000","last_change":"2024-09-19T05:38:18.169579+0000","last_active":"2024-09-19T05:38:19.370437+0000","last_peered":"2024-09-19T05:38:19.370437+0000","last_clean":"2024-09-19T05:38:19.370437+0000","last_became_active":"2024-09-19T05:38:18.168825+0000","last_became_peered":"2024-09-19T05:38:18.168825+0000","last_unstale":"2024-09-19T05:38:19.370437+0000","last_undegraded":"2024-09-19T05:38:19.370437+0000","last_fullsized":"2024-09-19T05:38:19.370437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:53.860167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368442+0000","last_change":"2024-09-19T05:38:17.148263+0000","last_active":"2024-09-19T05:38:19.368442+0000","last_peered":"2024-09-19T05:38:19.368442+0000","last_clean":"2024-09-19T05:38:19.368442+0000","last_became_active":"2024-09-19T05:38:17.147503+0000","last_became_peered":"2024-09-19T05:38:17.147503+0000","last_unstale":"2024-09-19T05:38:19.368442+0000","last_undegraded":"2024-09-19T05:38:19.368442+0000","last_fullsized":"2024-09-19T05:38:19.368442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:18.502201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370741+0000","last_change":"2024-09-19T05:38:18.166741+0000","last_active":"2024-09-19T05:38:19.370741+0000","last_peered":"2024-09-19T05:38:19.370741+0000","last_clean":"2024-09-19T05:38:19.370741+0000","last_became_active":"2024-09-19T05:38:18.165922+0000","last_became_peered":"2024-09-19T05:38:18.165922+0000","last_unstale":"2024-09-19T05:38:19.370741+0000","last_undegraded":"2024-09-19T05:38:19.370741+0000","last_fullsized":"2024-09-19T05:38:19.370741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:22.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369744+0000","last_change":"2024-09-19T05:38:17.128306+0000","last_active":"2024-09-19T05:38:19.369744+0000","last_peered":"2024-09-19T05:38:19.369744+0000","last_clean":"2024-09-19T05:38:19.369744+0000","last_became_active":"2024-09-19T05:38:17.127570+0000","last_became_peered":"2024-09-19T05:38:17.127570+0000","last_unstale":"2024-09-19T05:38:19.369744+0000","last_undegraded":"2024-09-19T05:38:19.369744+0000","last_fullsized":"2024-09-19T05:38:19.369744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:14.614444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371068+0000","last_change":"2024-09-19T05:38:18.162623+0000","last_active":"2024-09-19T05:38:19.371068+0000","last_peered":"2024-09-19T05:38:19.371068+0000","last_clean":"2024-09-19T05:38:19.371068+0000","last_became_active":"2024-09-19T05:38:18.161925+0000","last_became_peered":"2024-09-19T05:38:18.161925+0000","last_unstale":"2024-09-19T05:38:19.371068+0000","last_undegraded":"2024-09-19T05:38:19.371068+0000","last_fullsized":"2024-09-19T05:38:19.371068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.964786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167496+0000","last_change":"2024-09-19T05:38:17.124389+0000","last_active":"2024-09-19T05:38:19.167496+0000","last_peered":"2024-09-19T05:38:19.167496+0000","last_clean":"2024-09-19T05:38:19.167496+0000","last_became_active":"2024-09-19T05:38:17.124116+0000","last_became_peered":"2024-09-19T05:38:17.124116+0000","last_unstale":"2024-09-19T05:38:19.167496+0000","last_undegraded":"2024-09-19T05:38:19.167496+0000","last_fullsized":"2024-09-19T05:38:19.167496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:09.177438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371847+0000","last_change":"2024-09-19T05:38:18.171090+0000","last_active":"2024-09-19T05:38:19.371847+0000","last_peered":"2024-09-19T05:38:19.371847+0000","last_clean":"2024-09-19T05:38:19.371847+0000","last_became_active":"2024-09-19T05:38:18.169884+0000","last_became_peered":"2024-09-19T05:38:18.169884+0000","last_unstale":"2024-09-19T05:38:19.371847+0000","last_undegraded":"2024-09-19T05:38:19.371847+0000","last_fullsized":"2024-09-19T05:38:19.371847+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:00.074346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"84'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170039+0000","last_change":"2024-09-19T05:38:17.152926+0000","last_active":"2024-09-19T05:38:19.170039+0000","last_peered":"2024-09-19T05:38:19.170039+0000","last_clean":"2024-09-19T05:38:19.170039+0000","last_became_active":"2024-09-19T05:38:17.152633+0000","last_became_peered":"2024-09-19T05:38:17.152633+0000","last_unstale":"2024-09-19T05:38:19.170039+0000","last_undegraded":"2024-09-19T05:38:19.170039+0000","last_fullsized":"2024-09-19T05:38:19.170039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:04.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368815+0000","last_change":"2024-09-19T05:38:18.173374+0000","last_active":"2024-09-19T05:38:19.368815+0000","last_peered":"2024-09-19T05:38:19.368815+0000","last_clean":"2024-09-19T05:38:19.368815+0000","last_became_active":"2024-09-19T05:38:18.173012+0000","last_became_peered":"2024-09-19T05:38:18.173012+0000","last_unstale":"2024-09-19T05:38:19.368815+0000","last_undegraded":"2024-09-19T05:38:19.368815+0000","last_fullsized":"2024-09-19T05:38:19.368815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:42.803690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370338+0000","last_change":"2024-09-19T05:38:17.148055+0000","last_active":"2024-09-19T05:38:19.370338+0000","last_peered":"2024-09-19T05:38:19.370338+0000","last_clean":"2024-09-19T05:38:19.370338+0000","last_became_active":"2024-09-19T05:38:17.147402+0000","last_became_peered":"2024-09-19T05:38:17.147402+0000","last_unstale":"2024-09-19T05:38:19.370338+0000","last_undegraded":"2024-09-19T05:38:19.370338+0000","last_fullsized":"2024-09-19T05:38:19.370338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:35.177608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167224+0000","last_change":"2024-09-19T05:38:18.177104+0000","last_active":"2024-09-19T05:38:19.167224+0000","last_peered":"2024-09-19T05:38:19.167224+0000","last_clean":"2024-09-19T05:38:19.167224+0000","last_became_active":"2024-09-19T05:38:18.176760+0000","last_became_peered":"2024-09-19T05:38:18.176760+0000","last_unstale":"2024-09-19T05:38:19.167224+0000","last_undegraded":"2024-09-19T05:38:19.167224+0000","last_fullsized":"2024-09-19T05:38:19.167224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:49.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170412+0000","last_change":"2024-09-19T05:38:17.132750+0000","last_active":"2024-09-19T05:38:19.170412+0000","last_peered":"2024-09-19T05:38:19.170412+0000","last_clean":"2024-09-19T05:38:19.170412+0000","last_became_active":"2024-09-19T05:38:17.132035+0000","last_became_peered":"2024-09-19T05:38:17.132035+0000","last_unstale":"2024-09-19T05:38:19.170412+0000","last_undegraded":"2024-09-19T05:38:19.170412+0000","last_fullsized":"2024-09-19T05:38:19.170412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:44.500089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167910+0000","last_change":"2024-09-19T05:38:18.170606+0000","last_active":"2024-09-19T05:38:19.167910+0000","last_peered":"2024-09-19T05:38:19.167910+0000","last_clean":"2024-09-19T05:38:19.167910+0000","last_became_active":"2024-09-19T05:38:18.170320+0000","last_became_peered":"2024-09-19T05:38:18.170320+0000","last_unstale":"2024-09-19T05:38:19.167910+0000","last_undegraded":"2024-09-19T05:38:19.167910+0000","last_fullsized":"2024-09-19T05:38:19.167910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:13.450456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169712+0000","last_change":"2024-09-19T05:38:17.137253+0000","last_active":"2024-09-19T05:38:19.169712+0000","last_peered":"2024-09-19T05:38:19.169712+0000","last_clean":"2024-09-19T05:38:19.169712+0000","last_became_active":"2024-09-19T05:38:17.136921+0000","last_became_peered":"2024-09-19T05:38:17.136921+0000","last_unstale":"2024-09-19T05:38:19.169712+0000","last_undegraded":"2024-09-19T05:38:19.169712+0000","last_fullsized":"2024-09-19T05:38:19.169712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:42.735230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370483+0000","last_change":"2024-09-19T05:38:18.174368+0000","last_active":"2024-09-19T05:38:19.370483+0000","last_peered":"2024-09-19T05:38:19.370483+0000","last_clean":"2024-09-19T05:38:19.370483+0000","last_became_active":"2024-09-19T05:38:18.174023+0000","last_became_peered":"2024-09-19T05:38:18.174023+0000","last_unstale":"2024-09-19T05:38:19.370483+0000","last_undegraded":"2024-09-19T05:38:19.370483+0000","last_fullsized":"2024-09-19T05:38:19.370483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:59.575816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368607+0000","last_change":"2024-09-19T05:38:17.133484+0000","last_active":"2024-09-19T05:38:19.368607+0000","last_peered":"2024-09-19T05:38:19.368607+0000","last_clean":"2024-09-19T05:38:19.368607+0000","last_became_active":"2024-09-19T05:38:17.133155+0000","last_became_peered":"2024-09-19T05:38:17.133155+0000","last_unstale":"2024-09-19T05:38:19.368607+0000","last_undegraded":"2024-09-19T05:38:19.368607+0000","last_fullsized":"2024-09-19T05:38:19.368607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:55.206524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170485+0000","last_change":"2024-09-19T05:38:18.157525+0000","last_active":"2024-09-19T05:38:19.170485+0000","last_peered":"2024-09-19T05:38:19.170485+0000","last_clean":"2024-09-19T05:38:19.170485+0000","last_became_active":"2024-09-19T05:38:18.156768+0000","last_became_peered":"2024-09-19T05:38:18.156768+0000","last_unstale":"2024-09-19T05:38:19.170485+0000","last_undegraded":"2024-09-19T05:38:19.170485+0000","last_fullsized":"2024-09-19T05:38:19.170485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:42.803690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370623+0000","last_change":"2024-09-19T05:38:17.122267+0000","last_active":"2024-09-19T05:38:19.370623+0000","last_peered":"2024-09-19T05:38:19.370623+0000","last_clean":"2024-09-19T05:38:19.370623+0000","last_became_active":"2024-09-19T05:38:17.121874+0000","last_became_peered":"2024-09-19T05:38:17.121874+0000","last_unstale":"2024-09-19T05:38:19.370623+0000","last_undegraded":"2024-09-19T05:38:19.370623+0000","last_fullsized":"2024-09-19T05:38:19.370623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:28.920391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170331+0000","last_change":"2024-09-19T05:38:18.169865+0000","last_active":"2024-09-19T05:38:19.170331+0000","last_peered":"2024-09-19T05:38:19.170331+0000","last_clean":"2024-09-19T05:38:19.170331+0000","last_became_active":"2024-09-19T05:38:18.168430+0000","last_became_peered":"2024-09-19T05:38:18.168430+0000","last_unstale":"2024-09-19T05:38:19.170331+0000","last_undegraded":"2024-09-19T05:38:19.170331+0000","last_fullsized":"2024-09-19T05:38:19.170331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.869289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369376+0000","last_change":"2024-09-19T05:38:17.146511+0000","last_active":"2024-09-19T05:38:19.369376+0000","last_peered":"2024-09-19T05:38:19.369376+0000","last_clean":"2024-09-19T05:38:19.369376+0000","last_became_active":"2024-09-19T05:38:17.145962+0000","last_became_peered":"2024-09-19T05:38:17.145962+0000","last_unstale":"2024-09-19T05:38:19.369376+0000","last_undegraded":"2024-09-19T05:38:19.369376+0000","last_fullsized":"2024-09-19T05:38:19.369376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:27.636414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.372185+0000","last_change":"2024-09-19T05:38:18.155983+0000","last_active":"2024-09-19T05:38:19.372185+0000","last_peered":"2024-09-19T05:38:19.372185+0000","last_clean":"2024-09-19T05:38:19.372185+0000","last_became_active":"2024-09-19T05:38:18.155174+0000","last_became_peered":"2024-09-19T05:38:18.155174+0000","last_unstale":"2024-09-19T05:38:19.372185+0000","last_undegraded":"2024-09-19T05:38:19.372185+0000","last_fullsized":"2024-09-19T05:38:19.372185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:37.413371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369247+0000","last_change":"2024-09-19T05:38:17.145847+0000","last_active":"2024-09-19T05:38:19.369247+0000","last_peered":"2024-09-19T05:38:19.369247+0000","last_clean":"2024-09-19T05:38:19.369247+0000","last_became_active":"2024-09-19T05:38:17.145601+0000","last_became_peered":"2024-09-19T05:38:17.145601+0000","last_unstale":"2024-09-19T05:38:19.369247+0000","last_undegraded":"2024-09-19T05:38:19.369247+0000","last_fullsized":"2024-09-19T05:38:19.369247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:42.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169270+0000","last_change":"2024-09-19T05:38:18.179324+0000","last_active":"2024-09-19T05:38:19.169270+0000","last_peered":"2024-09-19T05:38:19.169270+0000","last_clean":"2024-09-19T05:38:19.169270+0000","last_became_active":"2024-09-19T05:38:18.178451+0000","last_became_peered":"2024-09-19T05:38:18.178451+0000","last_unstale":"2024-09-19T05:38:19.169270+0000","last_undegraded":"2024-09-19T05:38:19.169270+0000","last_fullsized":"2024-09-19T05:38:19.169270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:40.542006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368999+0000","last_change":"2024-09-19T05:38:17.143027+0000","last_active":"2024-09-19T05:38:19.368999+0000","last_peered":"2024-09-19T05:38:19.368999+0000","last_clean":"2024-09-19T05:38:19.368999+0000","last_became_active":"2024-09-19T05:38:17.142268+0000","last_became_peered":"2024-09-19T05:38:17.142268+0000","last_unstale":"2024-09-19T05:38:19.368999+0000","last_undegraded":"2024-09-19T05:38:19.368999+0000","last_fullsized":"2024-09-19T05:38:19.368999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:25.122540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371248+0000","last_change":"2024-09-19T05:38:18.147387+0000","last_active":"2024-09-19T05:38:19.371248+0000","last_peered":"2024-09-19T05:38:19.371248+0000","last_clean":"2024-09-19T05:38:19.371248+0000","last_became_active":"2024-09-19T05:38:18.146521+0000","last_became_peered":"2024-09-19T05:38:18.146521+0000","last_unstale":"2024-09-19T05:38:19.371248+0000","last_undegraded":"2024-09-19T05:38:19.371248+0000","last_fullsized":"2024-09-19T05:38:19.371248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:34.587947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"85'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170399+0000","last_change":"2024-09-19T05:38:17.126066+0000","last_active":"2024-09-19T05:38:19.170399+0000","last_peered":"2024-09-19T05:38:19.170399+0000","last_clean":"2024-09-19T05:38:19.170399+0000","last_became_active":"2024-09-19T05:38:17.125791+0000","last_became_peered":"2024-09-19T05:38:17.125791+0000","last_unstale":"2024-09-19T05:38:19.170399+0000","last_undegraded":"2024-09-19T05:38:19.170399+0000","last_fullsized":"2024-09-19T05:38:19.170399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:31.104896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169948+0000","last_change":"2024-09-19T05:38:18.168850+0000","last_active":"2024-09-19T05:38:19.169948+0000","last_peered":"2024-09-19T05:38:19.169948+0000","last_clean":"2024-09-19T05:38:19.169948+0000","last_became_active":"2024-09-19T05:38:18.168086+0000","last_became_peered":"2024-09-19T05:38:18.168086+0000","last_unstale":"2024-09-19T05:38:19.169948+0000","last_undegraded":"2024-09-19T05:38:19.169948+0000","last_fullsized":"2024-09-19T05:38:19.169948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:20.940415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370792+0000","last_change":"2024-09-19T05:38:17.144370+0000","last_active":"2024-09-19T05:38:19.370792+0000","last_peered":"2024-09-19T05:38:19.370792+0000","last_clean":"2024-09-19T05:38:19.370792+0000","last_became_active":"2024-09-19T05:38:17.143606+0000","last_became_peered":"2024-09-19T05:38:17.143606+0000","last_unstale":"2024-09-19T05:38:19.370792+0000","last_undegraded":"2024-09-19T05:38:19.370792+0000","last_fullsized":"2024-09-19T05:38:19.370792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:40.841916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170673+0000","last_change":"2024-09-19T05:38:18.180132+0000","last_active":"2024-09-19T05:38:19.170673+0000","last_peered":"2024-09-19T05:38:19.170673+0000","last_clean":"2024-09-19T05:38:19.170673+0000","last_became_active":"2024-09-19T05:38:18.179549+0000","last_became_peered":"2024-09-19T05:38:18.179549+0000","last_unstale":"2024-09-19T05:38:19.170673+0000","last_undegraded":"2024-09-19T05:38:19.170673+0000","last_fullsized":"2024-09-19T05:38:19.170673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:17.759334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368508+0000","last_change":"2024-09-19T05:38:17.150784+0000","last_active":"2024-09-19T05:38:19.368508+0000","last_peered":"2024-09-19T05:38:19.368508+0000","last_clean":"2024-09-19T05:38:19.368508+0000","last_became_active":"2024-09-19T05:38:17.149985+0000","last_became_peered":"2024-09-19T05:38:17.149985+0000","last_unstale":"2024-09-19T05:38:19.368508+0000","last_undegraded":"2024-09-19T05:38:19.368508+0000","last_fullsized":"2024-09-19T05:38:19.368508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:15.604497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371904+0000","last_change":"2024-09-19T05:38:18.147351+0000","last_active":"2024-09-19T05:38:19.371904+0000","last_peered":"2024-09-19T05:38:19.371904+0000","last_clean":"2024-09-19T05:38:19.371904+0000","last_became_active":"2024-09-19T05:38:18.146569+0000","last_became_peered":"2024-09-19T05:38:18.146569+0000","last_unstale":"2024-09-19T05:38:19.371904+0000","last_undegraded":"2024-09-19T05:38:19.371904+0000","last_fullsized":"2024-09-19T05:38:19.371904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:52.055892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370687+0000","last_change":"2024-09-19T05:38:17.137447+0000","last_active":"2024-09-19T05:38:19.370687+0000","last_peered":"2024-09-19T05:38:19.370687+0000","last_clean":"2024-09-19T05:38:19.370687+0000","last_became_active":"2024-09-19T05:38:17.136760+0000","last_became_peered":"2024-09-19T05:38:17.136760+0000","last_unstale":"2024-09-19T05:38:19.370687+0000","last_undegraded":"2024-09-19T05:38:19.370687+0000","last_fullsized":"2024-09-19T05:38:19.370687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:06.445516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371686+0000","last_change":"2024-09-19T05:38:18.172145+0000","last_active":"2024-09-19T05:38:19.371686+0000","last_peered":"2024-09-19T05:38:19.371686+0000","last_clean":"2024-09-19T05:38:19.371686+0000","last_became_active":"2024-09-19T05:38:18.171344+0000","last_became_peered":"2024-09-19T05:38:18.171344+0000","last_unstale":"2024-09-19T05:38:19.371686+0000","last_undegraded":"2024-09-19T05:38:19.371686+0000","last_fullsized":"2024-09-19T05:38:19.371686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:28.259580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168073+0000","last_change":"2024-09-19T05:38:17.136157+0000","last_active":"2024-09-19T05:38:19.168073+0000","last_peered":"2024-09-19T05:38:19.168073+0000","last_clean":"2024-09-19T05:38:19.168073+0000","last_became_active":"2024-09-19T05:38:17.135724+0000","last_became_peered":"2024-09-19T05:38:17.135724+0000","last_unstale":"2024-09-19T05:38:19.168073+0000","last_undegraded":"2024-09-19T05:38:19.168073+0000","last_fullsized":"2024-09-19T05:38:19.168073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:11.869952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369208+0000","last_change":"2024-09-19T05:38:18.173915+0000","last_active":"2024-09-19T05:38:19.369208+0000","last_peered":"2024-09-19T05:38:19.369208+0000","last_clean":"2024-09-19T05:38:19.369208+0000","last_became_active":"2024-09-19T05:38:18.173006+0000","last_became_peered":"2024-09-19T05:38:18.173006+0000","last_unstale":"2024-09-19T05:38:19.369208+0000","last_undegraded":"2024-09-19T05:38:19.369208+0000","last_fullsized":"2024-09-19T05:38:19.369208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:00.074346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371487+0000","last_change":"2024-09-19T05:38:17.145925+0000","last_active":"2024-09-19T05:38:19.371487+0000","last_peered":"2024-09-19T05:38:19.371487+0000","last_clean":"2024-09-19T05:38:19.371487+0000","last_became_active":"2024-09-19T05:38:17.145324+0000","last_became_peered":"2024-09-19T05:38:17.145324+0000","last_unstale":"2024-09-19T05:38:19.371487+0000","last_undegraded":"2024-09-19T05:38:19.371487+0000","last_fullsized":"2024-09-19T05:38:19.371487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:39.533316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369988+0000","last_change":"2024-09-19T05:38:18.173150+0000","last_active":"2024-09-19T05:38:19.369988+0000","last_peered":"2024-09-19T05:38:19.369988+0000","last_clean":"2024-09-19T05:38:19.369988+0000","last_became_active":"2024-09-19T05:38:18.172791+0000","last_became_peered":"2024-09-19T05:38:18.172791+0000","last_unstale":"2024-09-19T05:38:19.369988+0000","last_undegraded":"2024-09-19T05:38:19.369988+0000","last_fullsized":"2024-09-19T05:38:19.369988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:37.413371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368010+0000","last_change":"2024-09-19T05:38:17.123000+0000","last_active":"2024-09-19T05:38:19.368010+0000","last_peered":"2024-09-19T05:38:19.368010+0000","last_clean":"2024-09-19T05:38:19.368010+0000","last_became_active":"2024-09-19T05:38:17.121818+0000","last_became_peered":"2024-09-19T05:38:17.121818+0000","last_unstale":"2024-09-19T05:38:19.368010+0000","last_undegraded":"2024-09-19T05:38:19.368010+0000","last_fullsized":"2024-09-19T05:38:19.368010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:19.931725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371186+0000","last_change":"2024-09-19T05:38:18.180070+0000","last_active":"2024-09-19T05:38:19.371186+0000","last_peered":"2024-09-19T05:38:19.371186+0000","last_clean":"2024-09-19T05:38:19.371186+0000","last_became_active":"2024-09-19T05:38:18.177577+0000","last_became_peered":"2024-09-19T05:38:18.177577+0000","last_unstale":"2024-09-19T05:38:19.371186+0000","last_undegraded":"2024-09-19T05:38:19.371186+0000","last_fullsized":"2024-09-19T05:38:19.371186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.869289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370310+0000","last_change":"2024-09-19T05:38:17.146047+0000","last_active":"2024-09-19T05:38:19.370310+0000","last_peered":"2024-09-19T05:38:19.370310+0000","last_clean":"2024-09-19T05:38:19.370310+0000","last_became_active":"2024-09-19T05:38:17.145623+0000","last_became_peered":"2024-09-19T05:38:17.145623+0000","last_unstale":"2024-09-19T05:38:19.370310+0000","last_undegraded":"2024-09-19T05:38:19.370310+0000","last_fullsized":"2024-09-19T05:38:19.370310+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:32.385614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":286,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369035+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:38:19.369035+0000","last_peered":"2024-09-19T05:38:19.369035+0000","last_clean":"2024-09-19T05:38:19.369035+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:38:19.369035+0000","last_undegraded":"2024-09-19T05:38:19.369035+0000","last_fullsized":"2024-09-19T05:38:19.369035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1634304,"data_stored":1071250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542210,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40532,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331308,"statfs":{"total":96636764160,"available":96595259392,"internally_reserved":0,"allocated":1048576,"data_stored":482472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542212,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40528,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331312,"statfs":{"total":96636764160,"available":96595263488,"internally_reserved":0,"allocated":1040384,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50276,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321564,"statfs":{"total":96636764160,"available":96585281536,"internally_reserved":0,"allocated":1056768,"data_stored":482576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542211,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46100,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325740,"statfs":{"total":96636764160,"available":96589557760,"internally_reserved":0,"allocated":1040384,"data_stored":481442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542211,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1048576,"data_stored":481602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1044480,"data_stored":480972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542210,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54988,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316852,"statfs":{"total":96636764160,"available":96580456448,"internally_reserved":0,"allocated":1630208,"data_stored":1071228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:24.099 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:38:24.100+0000 7f1a54cae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:38:26.695 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:26.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea3227640 1 Processor -- start 2024-09-19T05:38:26.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea3227640 1 -- start start 2024-09-19T05:38:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea3227640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0e9c06c3d0 0x7f0e9c0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea3227640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e9c0b5b90 con 0x7f0e9c0b6050 2024-09-19T05:38:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea3227640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e9c0b15f0 con 0x7f0e9c15e640 2024-09-19T05:38:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea3227640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0e9c0b4780 con 0x7f0e9c06c3d0 2024-09-19T05:38:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea17c4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0e9c06c3d0 0x7f0e9c0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea17c4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0e9c06c3d0 0x7f0e9c0ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44650/0 (socket says 172.21.15.67:44650) 2024-09-19T05:38:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea17c4640 1 -- 172.21.15.67:0/1905552635 learned_addr learned my addr 172.21.15.67:0/1905552635 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:26.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0e9bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0e9c0b6050 0x7f0e9c06bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42500/0 (socket says 172.21.15.67:42500) 2024-09-19T05:38:26.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea17c4640 1 -- 172.21.15.67:0/1905552635 >> v1:172.21.15.97:6789/0 conn(0x7f0e9c15e640 legacy=0x7f0e9c0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:26.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea17c4640 1 -- 172.21.15.67:0/1905552635 >> v1:172.21.15.67:6789/0 conn(0x7f0e9c0b6050 legacy=0x7f0e9c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.828+0000 7f0ea17c4640 1 -- 172.21.15.67:0/1905552635 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c0b44a0 con 0x7f0e9c06c3d0 2024-09-19T05:38:26.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0ea17c4640 1 --2- 172.21.15.67:0/1905552635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c06c3d0 0x7f0e9c0ae0a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009870 tx=0x7f0e9401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9693337759e56d0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:26.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0e9b7fe640 1 -- 172.21.15.67:0/1905552635 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e940b1070 con 0x7f0e9c06c3d0 2024-09-19T05:38:26.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0e9b7fe640 1 -- 172.21.15.67:0/1905552635 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e940ac640 con 0x7f0e9c06c3d0 2024-09-19T05:38:26.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0e9b7fe640 1 -- 172.21.15.67:0/1905552635 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e940aca10 con 0x7f0e9c06c3d0 2024-09-19T05:38:26.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0ea3227640 1 -- 172.21.15.67:0/1905552635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c06c3d0 msgr2=0x7f0e9c0ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0ea3227640 1 --2- 172.21.15.67:0/1905552635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c06c3d0 0x7f0e9c0ae0a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009870 tx=0x7f0e9401c400 comp rx=0 tx=0).stop 2024-09-19T05:38:26.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0ea3227640 1 -- 172.21.15.67:0/1905552635 shutdown_connections 2024-09-19T05:38:26.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0ea3227640 1 --2- 172.21.15.67:0/1905552635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c06c3d0 0x7f0e9c0ae0a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0ea3227640 1 -- 172.21.15.67:0/1905552635 >> 172.21.15.67:0/1905552635 conn(0x7f0e9c09aa30 msgr2=0x7f0e9c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:26.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0ea3227640 1 -- 172.21.15.67:0/1905552635 shutdown_connections 2024-09-19T05:38:26.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0ea3227640 1 -- 172.21.15.67:0/1905552635 wait complete. 2024-09-19T05:38:26.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0ea3227640 1 Processor -- start 2024-09-19T05:38:26.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.832+0000 7f0ea3227640 1 -- start start 2024-09-19T05:38:26.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea3227640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e9c06c3d0 0x7f0e9c13cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea3227640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c0b6050 0x7f0e9c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea3227640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e9c15e640 0x7f0e9c06f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea3227640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c0b0790 con 0x7f0e9c0b6050 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea3227640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c0b2b40 con 0x7f0e9c06c3d0 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea3227640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9c0b0910 con 0x7f0e9c15e640 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e9bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c0b6050 0x7f0e9c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e9bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c0b6050 0x7f0e9c0cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44652/0 (socket says 172.21.15.67:44652) 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e9bfff640 1 -- 172.21.15.67:0/370905492 learned_addr learned my addr 172.21.15.67:0/370905492 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea17c4640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e9c15e640 0x7f0e9c06f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea0fc3640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e9c06c3d0 0x7f0e9c13cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e9bfff640 1 -- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e9c15e640 msgr2=0x7f0e9c06f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e9bfff640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e9c15e640 0x7f0e9c06f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e9bfff640 1 -- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e9c06c3d0 msgr2=0x7f0e9c13cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e9bfff640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e9c06c3d0 0x7f0e9c13cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e9bfff640 1 -- 172.21.15.67:0/370905492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c15dec0 con 0x7f0e9c0b6050 2024-09-19T05:38:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e9bfff640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c0b6050 0x7f0e9c0cd120 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c760 tx=0x7f0e8400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e997fa640 1 -- 172.21.15.67:0/370905492 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84017070 con 0x7f0e9c0b6050 2024-09-19T05:38:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e997fa640 1 -- 172.21.15.67:0/370905492 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8400a640 con 0x7f0e9c0b6050 2024-09-19T05:38:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e997fa640 1 -- 172.21.15.67:0/370905492 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400aa10 con 0x7f0e9c0b6050 2024-09-19T05:38:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea3227640 1 -- 172.21.15.67:0/370905492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9c0b1160 con 0x7f0e9c0b6050 2024-09-19T05:38:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea3227640 1 -- 172.21.15.67:0/370905492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9c155890 con 0x7f0e9c0b6050 2024-09-19T05:38:26.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea3227640 1 -- 172.21.15.67:0/370905492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e9c068f70 con 0x7f0e9c0b6050 2024-09-19T05:38:26.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e997fa640 1 -- 172.21.15.67:0/370905492 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e8401a070 con 0x7f0e9c0b6050 2024-09-19T05:38:26.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e997fa640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e800678c0 0x7f0e80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0e997fa640 1 -- 172.21.15.67:0/370905492 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f0e84085400 con 0x7f0e9c0b6050 2024-09-19T05:38:26.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.836+0000 7f0ea0fc3640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e800678c0 0x7f0e80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.840+0000 7f0ea0fc3640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e800678c0 0x7f0e80069d80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c004e30 tx=0x7f0e8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:26.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:26.844+0000 7f0e997fa640 1 -- 172.21.15.67:0/370905492 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0e9c0b5b90 con 0x7f0e9c0b6050 2024-09-19T05:38:27.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.000+0000 7f0ea3227640 1 -- 172.21.15.67:0/370905492 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e9c157180 con 0x7f0e800678c0 2024-09-19T05:38:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0e997fa640 1 -- 172.21.15.67:0/370905492 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252089 (secure 0 0 0) 0x7f0e9c157180 con 0x7f0e800678c0 2024-09-19T05:38:27.026 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:27.028 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:38:27.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 -- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e800678c0 msgr2=0x7f0e80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e800678c0 0x7f0e80069d80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c004e30 tx=0x7f0e8c009040 comp rx=0 tx=0).stop 2024-09-19T05:38:27.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 -- 172.21.15.67:0/370905492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c0b6050 msgr2=0x7f0e9c0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c0b6050 0x7f0e9c0cd120 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c760 tx=0x7f0e8400cc20 comp rx=0 tx=0).stop 2024-09-19T05:38:27.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 -- 172.21.15.67:0/370905492 shutdown_connections 2024-09-19T05:38:27.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e800678c0 0x7f0e80069d80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e9c15e640 0x7f0e9c06f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e9c0b6050 0x7f0e9c0cd120 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 --2- 172.21.15.67:0/370905492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e9c06c3d0 0x7f0e9c13cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 -- 172.21.15.67:0/370905492 >> 172.21.15.67:0/370905492 conn(0x7f0e9c09aa30 msgr2=0x7f0e9c0af810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:27.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 -- 172.21.15.67:0/370905492 shutdown_connections 2024-09-19T05:38:27.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.024+0000 7f0ea3227640 1 -- 172.21.15.67:0/370905492 wait complete. 2024-09-19T05:38:27.045 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-09-19T05:38:25.214297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":351852,"kb_used_data":9320,"kb_used_omap":12,"kb_used_meta":342323,"kb_avail":754622868,"statfs":{"total":773094113280,"available":772733816832,"internally_reserved":0,"allocated":9543680,"data_stored":5032436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":350539313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002685"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368688+0000","last_change":"2024-09-19T05:38:18.193992+0000","last_active":"2024-09-19T05:38:19.368688+0000","last_peered":"2024-09-19T05:38:19.368688+0000","last_clean":"2024-09-19T05:38:19.368688+0000","last_became_active":"2024-09-19T05:38:18.193116+0000","last_became_peered":"2024-09-19T05:38:18.193116+0000","last_unstale":"2024-09-19T05:38:19.368688+0000","last_undegraded":"2024-09-19T05:38:19.368688+0000","last_fullsized":"2024-09-19T05:38:19.368688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:16.185184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170241+0000","last_change":"2024-09-19T05:38:18.169174+0000","last_active":"2024-09-19T05:38:19.170241+0000","last_peered":"2024-09-19T05:38:19.170241+0000","last_clean":"2024-09-19T05:38:19.170241+0000","last_became_active":"2024-09-19T05:38:18.168797+0000","last_became_peered":"2024-09-19T05:38:18.168797+0000","last_unstale":"2024-09-19T05:38:19.170241+0000","last_undegraded":"2024-09-19T05:38:19.170241+0000","last_fullsized":"2024-09-19T05:38:19.170241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:38.531819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369638+0000","last_change":"2024-09-19T05:38:18.178371+0000","last_active":"2024-09-19T05:38:19.369638+0000","last_peered":"2024-09-19T05:38:19.369638+0000","last_clean":"2024-09-19T05:38:19.369638+0000","last_became_active":"2024-09-19T05:38:18.175610+0000","last_became_peered":"2024-09-19T05:38:18.175610+0000","last_unstale":"2024-09-19T05:38:19.369638+0000","last_undegraded":"2024-09-19T05:38:19.369638+0000","last_fullsized":"2024-09-19T05:38:19.369638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:52.055892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369666+0000","last_change":"2024-09-19T05:38:18.176830+0000","last_active":"2024-09-19T05:38:19.369666+0000","last_peered":"2024-09-19T05:38:19.369666+0000","last_clean":"2024-09-19T05:38:19.369666+0000","last_became_active":"2024-09-19T05:38:18.170780+0000","last_became_peered":"2024-09-19T05:38:18.170780+0000","last_unstale":"2024-09-19T05:38:19.369666+0000","last_undegraded":"2024-09-19T05:38:19.369666+0000","last_fullsized":"2024-09-19T05:38:19.369666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:23.482048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168389+0000","last_change":"2024-09-19T05:38:18.179151+0000","last_active":"2024-09-19T05:38:19.168389+0000","last_peered":"2024-09-19T05:38:19.168389+0000","last_clean":"2024-09-19T05:38:19.168389+0000","last_became_active":"2024-09-19T05:38:18.178763+0000","last_became_peered":"2024-09-19T05:38:18.178763+0000","last_unstale":"2024-09-19T05:38:19.168389+0000","last_undegraded":"2024-09-19T05:38:19.168389+0000","last_fullsized":"2024-09-19T05:38:19.168389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:04.494134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369333+0000","last_change":"2024-09-19T05:38:18.168917+0000","last_active":"2024-09-19T05:38:19.369333+0000","last_peered":"2024-09-19T05:38:19.369333+0000","last_clean":"2024-09-19T05:38:19.369333+0000","last_became_active":"2024-09-19T05:38:18.168475+0000","last_became_peered":"2024-09-19T05:38:18.168475+0000","last_unstale":"2024-09-19T05:38:19.369333+0000","last_undegraded":"2024-09-19T05:38:19.369333+0000","last_fullsized":"2024-09-19T05:38:19.369333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:39:48.028622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370818+0000","last_change":"2024-09-19T05:38:18.173677+0000","last_active":"2024-09-19T05:38:19.370818+0000","last_peered":"2024-09-19T05:38:19.370818+0000","last_clean":"2024-09-19T05:38:19.370818+0000","last_became_active":"2024-09-19T05:38:18.172951+0000","last_became_peered":"2024-09-19T05:38:18.172951+0000","last_unstale":"2024-09-19T05:38:19.370818+0000","last_undegraded":"2024-09-19T05:38:19.370818+0000","last_fullsized":"2024-09-19T05:38:19.370818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:26.231032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.166977+0000","last_change":"2024-09-19T05:38:18.168523+0000","last_active":"2024-09-19T05:38:19.166977+0000","last_peered":"2024-09-19T05:38:19.166977+0000","last_clean":"2024-09-19T05:38:19.166977+0000","last_became_active":"2024-09-19T05:38:18.168157+0000","last_became_peered":"2024-09-19T05:38:18.168157+0000","last_unstale":"2024-09-19T05:38:19.166977+0000","last_undegraded":"2024-09-19T05:38:19.166977+0000","last_fullsized":"2024-09-19T05:38:19.166977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:56.837273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170477+0000","last_change":"2024-09-19T05:38:18.167604+0000","last_active":"2024-09-19T05:38:19.170477+0000","last_peered":"2024-09-19T05:38:19.170477+0000","last_clean":"2024-09-19T05:38:19.170477+0000","last_became_active":"2024-09-19T05:38:18.166856+0000","last_became_peered":"2024-09-19T05:38:18.166856+0000","last_unstale":"2024-09-19T05:38:19.170477+0000","last_undegraded":"2024-09-19T05:38:19.170477+0000","last_fullsized":"2024-09-19T05:38:19.170477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:44.832838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368797+0000","last_change":"2024-09-19T05:38:18.168536+0000","last_active":"2024-09-19T05:38:19.368797+0000","last_peered":"2024-09-19T05:38:19.368797+0000","last_clean":"2024-09-19T05:38:19.368797+0000","last_became_active":"2024-09-19T05:38:18.166782+0000","last_became_peered":"2024-09-19T05:38:18.166782+0000","last_unstale":"2024-09-19T05:38:19.368797+0000","last_undegraded":"2024-09-19T05:38:19.368797+0000","last_fullsized":"2024-09-19T05:38:19.368797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:42.317070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170478+0000","last_change":"2024-09-19T05:38:18.177455+0000","last_active":"2024-09-19T05:38:19.170478+0000","last_peered":"2024-09-19T05:38:19.170478+0000","last_clean":"2024-09-19T05:38:19.170478+0000","last_became_active":"2024-09-19T05:38:18.177132+0000","last_became_peered":"2024-09-19T05:38:18.177132+0000","last_unstale":"2024-09-19T05:38:19.170478+0000","last_undegraded":"2024-09-19T05:38:19.170478+0000","last_fullsized":"2024-09-19T05:38:19.170478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:39:48.028622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370052+0000","last_change":"2024-09-19T05:38:18.168595+0000","last_active":"2024-09-19T05:38:19.370052+0000","last_peered":"2024-09-19T05:38:19.370052+0000","last_clean":"2024-09-19T05:38:19.370052+0000","last_became_active":"2024-09-19T05:38:18.167829+0000","last_became_peered":"2024-09-19T05:38:18.167829+0000","last_unstale":"2024-09-19T05:38:19.370052+0000","last_undegraded":"2024-09-19T05:38:19.370052+0000","last_fullsized":"2024-09-19T05:38:19.370052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:22.226544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168755+0000","last_change":"2024-09-19T05:38:18.179109+0000","last_active":"2024-09-19T05:38:19.168755+0000","last_peered":"2024-09-19T05:38:19.168755+0000","last_clean":"2024-09-19T05:38:19.168755+0000","last_became_active":"2024-09-19T05:38:18.178694+0000","last_became_peered":"2024-09-19T05:38:18.178694+0000","last_unstale":"2024-09-19T05:38:19.168755+0000","last_undegraded":"2024-09-19T05:38:19.168755+0000","last_fullsized":"2024-09-19T05:38:19.168755+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:51.736428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369669+0000","last_change":"2024-09-19T05:38:18.168702+0000","last_active":"2024-09-19T05:38:19.369669+0000","last_peered":"2024-09-19T05:38:19.369669+0000","last_clean":"2024-09-19T05:38:19.369669+0000","last_became_active":"2024-09-19T05:38:18.168102+0000","last_became_peered":"2024-09-19T05:38:18.168102+0000","last_unstale":"2024-09-19T05:38:19.369669+0000","last_undegraded":"2024-09-19T05:38:19.369669+0000","last_fullsized":"2024-09-19T05:38:19.369669+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:09.589516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169855+0000","last_change":"2024-09-19T05:38:18.167727+0000","last_active":"2024-09-19T05:38:19.169855+0000","last_peered":"2024-09-19T05:38:19.169855+0000","last_clean":"2024-09-19T05:38:19.169855+0000","last_became_active":"2024-09-19T05:38:18.167371+0000","last_became_peered":"2024-09-19T05:38:18.167371+0000","last_unstale":"2024-09-19T05:38:19.169855+0000","last_undegraded":"2024-09-19T05:38:19.169855+0000","last_fullsized":"2024-09-19T05:38:19.169855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:16.185184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368363+0000","last_change":"2024-09-19T05:38:18.184678+0000","last_active":"2024-09-19T05:38:19.368363+0000","last_peered":"2024-09-19T05:38:19.368363+0000","last_clean":"2024-09-19T05:38:19.368363+0000","last_became_active":"2024-09-19T05:38:18.183961+0000","last_became_peered":"2024-09-19T05:38:18.183961+0000","last_unstale":"2024-09-19T05:38:19.368363+0000","last_undegraded":"2024-09-19T05:38:19.368363+0000","last_fullsized":"2024-09-19T05:38:19.368363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:33.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168979+0000","last_change":"2024-09-19T05:38:18.171951+0000","last_active":"2024-09-19T05:38:19.168979+0000","last_peered":"2024-09-19T05:38:19.168979+0000","last_clean":"2024-09-19T05:38:19.168979+0000","last_became_active":"2024-09-19T05:38:18.171562+0000","last_became_peered":"2024-09-19T05:38:18.171562+0000","last_unstale":"2024-09-19T05:38:19.168979+0000","last_undegraded":"2024-09-19T05:38:19.168979+0000","last_fullsized":"2024-09-19T05:38:19.168979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:11.754668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368804+0000","last_change":"2024-09-19T05:38:18.173648+0000","last_active":"2024-09-19T05:38:19.368804+0000","last_peered":"2024-09-19T05:38:19.368804+0000","last_clean":"2024-09-19T05:38:19.368804+0000","last_became_active":"2024-09-19T05:38:18.173369+0000","last_became_peered":"2024-09-19T05:38:18.173369+0000","last_unstale":"2024-09-19T05:38:19.368804+0000","last_undegraded":"2024-09-19T05:38:19.368804+0000","last_fullsized":"2024-09-19T05:38:19.368804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:34.587947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370257+0000","last_change":"2024-09-19T05:38:18.174462+0000","last_active":"2024-09-19T05:38:19.370257+0000","last_peered":"2024-09-19T05:38:19.370257+0000","last_clean":"2024-09-19T05:38:19.370257+0000","last_became_active":"2024-09-19T05:38:18.174006+0000","last_became_peered":"2024-09-19T05:38:18.174006+0000","last_unstale":"2024-09-19T05:38:19.370257+0000","last_undegraded":"2024-09-19T05:38:19.370257+0000","last_fullsized":"2024-09-19T05:38:19.370257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:08.341765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168659+0000","last_change":"2024-09-19T05:38:18.170038+0000","last_active":"2024-09-19T05:38:19.168659+0000","last_peered":"2024-09-19T05:38:19.168659+0000","last_clean":"2024-09-19T05:38:19.168659+0000","last_became_active":"2024-09-19T05:38:18.169668+0000","last_became_peered":"2024-09-19T05:38:18.169668+0000","last_unstale":"2024-09-19T05:38:19.168659+0000","last_undegraded":"2024-09-19T05:38:19.168659+0000","last_fullsized":"2024-09-19T05:38:19.168659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:06.934522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169860+0000","last_change":"2024-09-19T05:38:18.168271+0000","last_active":"2024-09-19T05:38:19.169860+0000","last_peered":"2024-09-19T05:38:19.169860+0000","last_clean":"2024-09-19T05:38:19.169860+0000","last_became_active":"2024-09-19T05:38:18.166487+0000","last_became_peered":"2024-09-19T05:38:18.166487+0000","last_unstale":"2024-09-19T05:38:19.169860+0000","last_undegraded":"2024-09-19T05:38:19.169860+0000","last_fullsized":"2024-09-19T05:38:19.169860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:56.215215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167853+0000","last_change":"2024-09-19T05:38:18.178835+0000","last_active":"2024-09-19T05:38:19.167853+0000","last_peered":"2024-09-19T05:38:19.167853+0000","last_clean":"2024-09-19T05:38:19.167853+0000","last_became_active":"2024-09-19T05:38:18.178525+0000","last_became_peered":"2024-09-19T05:38:18.178525+0000","last_unstale":"2024-09-19T05:38:19.167853+0000","last_undegraded":"2024-09-19T05:38:19.167853+0000","last_fullsized":"2024-09-19T05:38:19.167853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:51.280979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169351+0000","last_change":"2024-09-19T05:38:18.187822+0000","last_active":"2024-09-19T05:38:19.169351+0000","last_peered":"2024-09-19T05:38:19.169351+0000","last_clean":"2024-09-19T05:38:19.169351+0000","last_became_active":"2024-09-19T05:38:18.186994+0000","last_became_peered":"2024-09-19T05:38:18.186994+0000","last_unstale":"2024-09-19T05:38:19.169351+0000","last_undegraded":"2024-09-19T05:38:19.169351+0000","last_fullsized":"2024-09-19T05:38:19.169351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:47.309432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169770+0000","last_change":"2024-09-19T05:38:18.167629+0000","last_active":"2024-09-19T05:38:19.169770+0000","last_peered":"2024-09-19T05:38:19.169770+0000","last_clean":"2024-09-19T05:38:19.169770+0000","last_became_active":"2024-09-19T05:38:18.167336+0000","last_became_peered":"2024-09-19T05:38:18.167336+0000","last_unstale":"2024-09-19T05:38:19.169770+0000","last_undegraded":"2024-09-19T05:38:19.169770+0000","last_fullsized":"2024-09-19T05:38:19.169770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:33.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170789+0000","last_change":"2024-09-19T05:38:18.175804+0000","last_active":"2024-09-19T05:38:19.170789+0000","last_peered":"2024-09-19T05:38:19.170789+0000","last_clean":"2024-09-19T05:38:19.170789+0000","last_became_active":"2024-09-19T05:38:18.175373+0000","last_became_peered":"2024-09-19T05:38:18.175373+0000","last_unstale":"2024-09-19T05:38:19.170789+0000","last_undegraded":"2024-09-19T05:38:19.170789+0000","last_fullsized":"2024-09-19T05:38:19.170789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:08.341765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369019+0000","last_change":"2024-09-19T05:38:18.167495+0000","last_active":"2024-09-19T05:38:19.369019+0000","last_peered":"2024-09-19T05:38:19.369019+0000","last_clean":"2024-09-19T05:38:19.369019+0000","last_became_active":"2024-09-19T05:38:18.160453+0000","last_became_peered":"2024-09-19T05:38:18.160453+0000","last_unstale":"2024-09-19T05:38:19.369019+0000","last_undegraded":"2024-09-19T05:38:19.369019+0000","last_fullsized":"2024-09-19T05:38:19.369019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:32.890251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370248+0000","last_change":"2024-09-19T05:38:18.192257+0000","last_active":"2024-09-19T05:38:19.370248+0000","last_peered":"2024-09-19T05:38:19.370248+0000","last_clean":"2024-09-19T05:38:19.370248+0000","last_became_active":"2024-09-19T05:38:18.191632+0000","last_became_peered":"2024-09-19T05:38:18.191632+0000","last_unstale":"2024-09-19T05:38:19.370248+0000","last_undegraded":"2024-09-19T05:38:19.370248+0000","last_fullsized":"2024-09-19T05:38:19.370248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:25.315970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167743+0000","last_change":"2024-09-19T05:38:18.182567+0000","last_active":"2024-09-19T05:38:19.167743+0000","last_peered":"2024-09-19T05:38:19.167743+0000","last_clean":"2024-09-19T05:38:19.167743+0000","last_became_active":"2024-09-19T05:38:18.182203+0000","last_became_peered":"2024-09-19T05:38:18.182203+0000","last_unstale":"2024-09-19T05:38:19.167743+0000","last_undegraded":"2024-09-19T05:38:19.167743+0000","last_fullsized":"2024-09-19T05:38:19.167743+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:38.310841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170421+0000","last_change":"2024-09-19T05:38:18.172140+0000","last_active":"2024-09-19T05:38:19.170421+0000","last_peered":"2024-09-19T05:38:19.170421+0000","last_clean":"2024-09-19T05:38:19.170421+0000","last_became_active":"2024-09-19T05:38:18.171815+0000","last_became_peered":"2024-09-19T05:38:18.171815+0000","last_unstale":"2024-09-19T05:38:19.170421+0000","last_undegraded":"2024-09-19T05:38:19.170421+0000","last_fullsized":"2024-09-19T05:38:19.170421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:26.615398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369501+0000","last_change":"2024-09-19T05:38:18.171344+0000","last_active":"2024-09-19T05:38:19.369501+0000","last_peered":"2024-09-19T05:38:19.369501+0000","last_clean":"2024-09-19T05:38:19.369501+0000","last_became_active":"2024-09-19T05:38:18.170602+0000","last_became_peered":"2024-09-19T05:38:18.170602+0000","last_unstale":"2024-09-19T05:38:19.369501+0000","last_undegraded":"2024-09-19T05:38:19.369501+0000","last_fullsized":"2024-09-19T05:38:19.369501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:38.531819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368518+0000","last_change":"2024-09-19T05:38:18.174551+0000","last_active":"2024-09-19T05:38:19.368518+0000","last_peered":"2024-09-19T05:38:19.368518+0000","last_clean":"2024-09-19T05:38:19.368518+0000","last_became_active":"2024-09-19T05:38:18.174226+0000","last_became_peered":"2024-09-19T05:38:18.174226+0000","last_unstale":"2024-09-19T05:38:19.368518+0000","last_undegraded":"2024-09-19T05:38:19.368518+0000","last_fullsized":"2024-09-19T05:38:19.368518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:05.183826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368783+0000","last_change":"2024-09-19T05:38:18.191460+0000","last_active":"2024-09-19T05:38:19.368783+0000","last_peered":"2024-09-19T05:38:19.368783+0000","last_clean":"2024-09-19T05:38:19.368783+0000","last_became_active":"2024-09-19T05:38:18.190812+0000","last_became_peered":"2024-09-19T05:38:18.190812+0000","last_unstale":"2024-09-19T05:38:19.368783+0000","last_undegraded":"2024-09-19T05:38:19.368783+0000","last_fullsized":"2024-09-19T05:38:19.368783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:04.004730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368189+0000","last_change":"2024-09-19T05:38:18.184727+0000","last_active":"2024-09-19T05:38:19.368189+0000","last_peered":"2024-09-19T05:38:19.368189+0000","last_clean":"2024-09-19T05:38:19.368189+0000","last_became_active":"2024-09-19T05:38:18.184328+0000","last_became_peered":"2024-09-19T05:38:18.184328+0000","last_unstale":"2024-09-19T05:38:19.368189+0000","last_undegraded":"2024-09-19T05:38:19.368189+0000","last_fullsized":"2024-09-19T05:38:19.368189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.964786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168967+0000","last_change":"2024-09-19T05:38:17.125550+0000","last_active":"2024-09-19T05:38:19.168967+0000","last_peered":"2024-09-19T05:38:19.168967+0000","last_clean":"2024-09-19T05:38:19.168967+0000","last_became_active":"2024-09-19T05:38:17.125194+0000","last_became_peered":"2024-09-19T05:38:17.125194+0000","last_unstale":"2024-09-19T05:38:19.168967+0000","last_undegraded":"2024-09-19T05:38:19.168967+0000","last_fullsized":"2024-09-19T05:38:19.168967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:36.008982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170021+0000","last_change":"2024-09-19T05:38:18.163672+0000","last_active":"2024-09-19T05:38:19.170021+0000","last_peered":"2024-09-19T05:38:19.170021+0000","last_clean":"2024-09-19T05:38:19.170021+0000","last_became_active":"2024-09-19T05:38:18.163237+0000","last_became_peered":"2024-09-19T05:38:18.163237+0000","last_unstale":"2024-09-19T05:38:19.170021+0000","last_undegraded":"2024-09-19T05:38:19.170021+0000","last_fullsized":"2024-09-19T05:38:19.170021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:04.004730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369788+0000","last_change":"2024-09-19T05:38:17.151155+0000","last_active":"2024-09-19T05:38:19.369788+0000","last_peered":"2024-09-19T05:38:19.369788+0000","last_clean":"2024-09-19T05:38:19.369788+0000","last_became_active":"2024-09-19T05:38:17.150121+0000","last_became_peered":"2024-09-19T05:38:17.150121+0000","last_unstale":"2024-09-19T05:38:19.369788+0000","last_undegraded":"2024-09-19T05:38:19.369788+0000","last_fullsized":"2024-09-19T05:38:19.369788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:04.968403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169547+0000","last_change":"2024-09-19T05:38:18.182886+0000","last_active":"2024-09-19T05:38:19.169547+0000","last_peered":"2024-09-19T05:38:19.169547+0000","last_clean":"2024-09-19T05:38:19.169547+0000","last_became_active":"2024-09-19T05:38:18.181513+0000","last_became_peered":"2024-09-19T05:38:18.181513+0000","last_unstale":"2024-09-19T05:38:19.169547+0000","last_undegraded":"2024-09-19T05:38:19.169547+0000","last_fullsized":"2024-09-19T05:38:19.169547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:19.382787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370505+0000","last_change":"2024-09-19T05:38:17.127521+0000","last_active":"2024-09-19T05:38:19.370505+0000","last_peered":"2024-09-19T05:38:19.370505+0000","last_clean":"2024-09-19T05:38:19.370505+0000","last_became_active":"2024-09-19T05:38:17.125524+0000","last_became_peered":"2024-09-19T05:38:17.125524+0000","last_unstale":"2024-09-19T05:38:19.370505+0000","last_undegraded":"2024-09-19T05:38:19.370505+0000","last_fullsized":"2024-09-19T05:38:19.370505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:11.479081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169510+0000","last_change":"2024-09-19T05:38:18.168909+0000","last_active":"2024-09-19T05:38:19.169510+0000","last_peered":"2024-09-19T05:38:19.169510+0000","last_clean":"2024-09-19T05:38:19.169510+0000","last_became_active":"2024-09-19T05:38:18.167448+0000","last_became_peered":"2024-09-19T05:38:18.167448+0000","last_unstale":"2024-09-19T05:38:19.169510+0000","last_undegraded":"2024-09-19T05:38:19.169510+0000","last_fullsized":"2024-09-19T05:38:19.169510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:00.054538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371911+0000","last_change":"2024-09-19T05:38:17.146072+0000","last_active":"2024-09-19T05:38:19.371911+0000","last_peered":"2024-09-19T05:38:19.371911+0000","last_clean":"2024-09-19T05:38:19.371911+0000","last_became_active":"2024-09-19T05:38:17.145049+0000","last_became_peered":"2024-09-19T05:38:17.145049+0000","last_unstale":"2024-09-19T05:38:19.371911+0000","last_undegraded":"2024-09-19T05:38:19.371911+0000","last_fullsized":"2024-09-19T05:38:19.371911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:45.454392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170324+0000","last_change":"2024-09-19T05:38:18.171280+0000","last_active":"2024-09-19T05:38:19.170324+0000","last_peered":"2024-09-19T05:38:19.170324+0000","last_clean":"2024-09-19T05:38:19.170324+0000","last_became_active":"2024-09-19T05:38:18.170908+0000","last_became_peered":"2024-09-19T05:38:18.170908+0000","last_unstale":"2024-09-19T05:38:19.170324+0000","last_undegraded":"2024-09-19T05:38:19.170324+0000","last_fullsized":"2024-09-19T05:38:19.170324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:25.315970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169783+0000","last_change":"2024-09-19T05:38:17.142355+0000","last_active":"2024-09-19T05:38:19.169783+0000","last_peered":"2024-09-19T05:38:19.169783+0000","last_clean":"2024-09-19T05:38:19.169783+0000","last_became_active":"2024-09-19T05:38:17.140750+0000","last_became_peered":"2024-09-19T05:38:17.140750+0000","last_unstale":"2024-09-19T05:38:19.169783+0000","last_undegraded":"2024-09-19T05:38:19.169783+0000","last_fullsized":"2024-09-19T05:38:19.169783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:04.539848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170543+0000","last_change":"2024-09-19T05:38:18.171184+0000","last_active":"2024-09-19T05:38:19.170543+0000","last_peered":"2024-09-19T05:38:19.170543+0000","last_clean":"2024-09-19T05:38:19.170543+0000","last_became_active":"2024-09-19T05:38:18.170820+0000","last_became_peered":"2024-09-19T05:38:18.170820+0000","last_unstale":"2024-09-19T05:38:19.170543+0000","last_undegraded":"2024-09-19T05:38:19.170543+0000","last_fullsized":"2024-09-19T05:38:19.170543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:09.589516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368097+0000","last_change":"2024-09-19T05:38:17.141855+0000","last_active":"2024-09-19T05:38:19.368097+0000","last_peered":"2024-09-19T05:38:19.368097+0000","last_clean":"2024-09-19T05:38:19.368097+0000","last_became_active":"2024-09-19T05:38:17.140748+0000","last_became_peered":"2024-09-19T05:38:17.140748+0000","last_unstale":"2024-09-19T05:38:19.368097+0000","last_undegraded":"2024-09-19T05:38:19.368097+0000","last_fullsized":"2024-09-19T05:38:19.368097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:14.184011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170447+0000","last_change":"2024-09-19T05:38:18.168052+0000","last_active":"2024-09-19T05:38:19.170447+0000","last_peered":"2024-09-19T05:38:19.170447+0000","last_clean":"2024-09-19T05:38:19.170447+0000","last_became_active":"2024-09-19T05:38:18.167261+0000","last_became_peered":"2024-09-19T05:38:18.167261+0000","last_unstale":"2024-09-19T05:38:19.170447+0000","last_undegraded":"2024-09-19T05:38:19.170447+0000","last_fullsized":"2024-09-19T05:38:19.170447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:04.691823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170117+0000","last_change":"2024-09-19T05:38:17.138271+0000","last_active":"2024-09-19T05:38:19.170117+0000","last_peered":"2024-09-19T05:38:19.170117+0000","last_clean":"2024-09-19T05:38:19.170117+0000","last_became_active":"2024-09-19T05:38:17.137963+0000","last_became_peered":"2024-09-19T05:38:17.137963+0000","last_unstale":"2024-09-19T05:38:19.170117+0000","last_undegraded":"2024-09-19T05:38:19.170117+0000","last_fullsized":"2024-09-19T05:38:19.170117+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:35.931949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371194+0000","last_change":"2024-09-19T05:38:18.173554+0000","last_active":"2024-09-19T05:38:19.371194+0000","last_peered":"2024-09-19T05:38:19.371194+0000","last_clean":"2024-09-19T05:38:19.371194+0000","last_became_active":"2024-09-19T05:38:18.172907+0000","last_became_peered":"2024-09-19T05:38:18.172907+0000","last_unstale":"2024-09-19T05:38:19.371194+0000","last_undegraded":"2024-09-19T05:38:19.371194+0000","last_fullsized":"2024-09-19T05:38:19.371194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:05.183826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167008+0000","last_change":"2024-09-19T05:38:17.132639+0000","last_active":"2024-09-19T05:38:19.167008+0000","last_peered":"2024-09-19T05:38:19.167008+0000","last_clean":"2024-09-19T05:38:19.167008+0000","last_became_active":"2024-09-19T05:38:17.132240+0000","last_became_peered":"2024-09-19T05:38:17.132240+0000","last_unstale":"2024-09-19T05:38:19.167008+0000","last_undegraded":"2024-09-19T05:38:19.167008+0000","last_fullsized":"2024-09-19T05:38:19.167008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:40.076019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169770+0000","last_change":"2024-09-19T05:38:18.180060+0000","last_active":"2024-09-19T05:38:19.169770+0000","last_peered":"2024-09-19T05:38:19.169770+0000","last_clean":"2024-09-19T05:38:19.169770+0000","last_became_active":"2024-09-19T05:38:18.179581+0000","last_became_peered":"2024-09-19T05:38:18.179581+0000","last_unstale":"2024-09-19T05:38:19.169770+0000","last_undegraded":"2024-09-19T05:38:19.169770+0000","last_fullsized":"2024-09-19T05:38:19.169770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:43.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370083+0000","last_change":"2024-09-19T05:38:17.137642+0000","last_active":"2024-09-19T05:38:19.370083+0000","last_peered":"2024-09-19T05:38:19.370083+0000","last_clean":"2024-09-19T05:38:19.370083+0000","last_became_active":"2024-09-19T05:38:17.136920+0000","last_became_peered":"2024-09-19T05:38:17.136920+0000","last_unstale":"2024-09-19T05:38:19.370083+0000","last_undegraded":"2024-09-19T05:38:19.370083+0000","last_fullsized":"2024-09-19T05:38:19.370083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:39.046256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368803+0000","last_change":"2024-09-19T05:38:18.177230+0000","last_active":"2024-09-19T05:38:19.368803+0000","last_peered":"2024-09-19T05:38:19.368803+0000","last_clean":"2024-09-19T05:38:19.368803+0000","last_became_active":"2024-09-19T05:38:18.170724+0000","last_became_peered":"2024-09-19T05:38:18.170724+0000","last_unstale":"2024-09-19T05:38:19.368803+0000","last_undegraded":"2024-09-19T05:38:19.368803+0000","last_fullsized":"2024-09-19T05:38:19.368803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:20.820710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369053+0000","last_change":"2024-09-19T05:38:17.149660+0000","last_active":"2024-09-19T05:38:19.369053+0000","last_peered":"2024-09-19T05:38:19.369053+0000","last_clean":"2024-09-19T05:38:19.369053+0000","last_became_active":"2024-09-19T05:38:17.147750+0000","last_became_peered":"2024-09-19T05:38:17.147750+0000","last_unstale":"2024-09-19T05:38:19.369053+0000","last_undegraded":"2024-09-19T05:38:19.369053+0000","last_fullsized":"2024-09-19T05:38:19.369053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:46.573148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369920+0000","last_change":"2024-09-19T05:38:18.166273+0000","last_active":"2024-09-19T05:38:19.369920+0000","last_peered":"2024-09-19T05:38:19.369920+0000","last_clean":"2024-09-19T05:38:19.369920+0000","last_became_active":"2024-09-19T05:38:18.165620+0000","last_became_peered":"2024-09-19T05:38:18.165620+0000","last_unstale":"2024-09-19T05:38:19.369920+0000","last_undegraded":"2024-09-19T05:38:19.369920+0000","last_fullsized":"2024-09-19T05:38:19.369920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:17.759334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169405+0000","last_change":"2024-09-19T05:38:17.132043+0000","last_active":"2024-09-19T05:38:19.169405+0000","last_peered":"2024-09-19T05:38:19.169405+0000","last_clean":"2024-09-19T05:38:19.169405+0000","last_became_active":"2024-09-19T05:38:17.130901+0000","last_became_peered":"2024-09-19T05:38:17.130901+0000","last_unstale":"2024-09-19T05:38:19.169405+0000","last_undegraded":"2024-09-19T05:38:19.169405+0000","last_fullsized":"2024-09-19T05:38:19.169405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:17.103208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369166+0000","last_change":"2024-09-19T05:38:18.170430+0000","last_active":"2024-09-19T05:38:19.369166+0000","last_peered":"2024-09-19T05:38:19.369166+0000","last_clean":"2024-09-19T05:38:19.369166+0000","last_became_active":"2024-09-19T05:38:18.170105+0000","last_became_peered":"2024-09-19T05:38:18.170105+0000","last_unstale":"2024-09-19T05:38:19.369166+0000","last_undegraded":"2024-09-19T05:38:19.369166+0000","last_fullsized":"2024-09-19T05:38:19.369166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:28.259580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"84'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.372107+0000","last_change":"2024-09-19T05:38:17.152541+0000","last_active":"2024-09-19T05:38:19.372107+0000","last_peered":"2024-09-19T05:38:19.372107+0000","last_clean":"2024-09-19T05:38:19.372107+0000","last_became_active":"2024-09-19T05:38:17.152060+0000","last_became_peered":"2024-09-19T05:38:17.152060+0000","last_unstale":"2024-09-19T05:38:19.372107+0000","last_undegraded":"2024-09-19T05:38:19.372107+0000","last_fullsized":"2024-09-19T05:38:19.372107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:46.300742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370437+0000","last_change":"2024-09-19T05:38:18.169579+0000","last_active":"2024-09-19T05:38:19.370437+0000","last_peered":"2024-09-19T05:38:19.370437+0000","last_clean":"2024-09-19T05:38:19.370437+0000","last_became_active":"2024-09-19T05:38:18.168825+0000","last_became_peered":"2024-09-19T05:38:18.168825+0000","last_unstale":"2024-09-19T05:38:19.370437+0000","last_undegraded":"2024-09-19T05:38:19.370437+0000","last_fullsized":"2024-09-19T05:38:19.370437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:53.860167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368442+0000","last_change":"2024-09-19T05:38:17.148263+0000","last_active":"2024-09-19T05:38:19.368442+0000","last_peered":"2024-09-19T05:38:19.368442+0000","last_clean":"2024-09-19T05:38:19.368442+0000","last_became_active":"2024-09-19T05:38:17.147503+0000","last_became_peered":"2024-09-19T05:38:17.147503+0000","last_unstale":"2024-09-19T05:38:19.368442+0000","last_undegraded":"2024-09-19T05:38:19.368442+0000","last_fullsized":"2024-09-19T05:38:19.368442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:18.502201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370741+0000","last_change":"2024-09-19T05:38:18.166741+0000","last_active":"2024-09-19T05:38:19.370741+0000","last_peered":"2024-09-19T05:38:19.370741+0000","last_clean":"2024-09-19T05:38:19.370741+0000","last_became_active":"2024-09-19T05:38:18.165922+0000","last_became_peered":"2024-09-19T05:38:18.165922+0000","last_unstale":"2024-09-19T05:38:19.370741+0000","last_undegraded":"2024-09-19T05:38:19.370741+0000","last_fullsized":"2024-09-19T05:38:19.370741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:22.237722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369744+0000","last_change":"2024-09-19T05:38:17.128306+0000","last_active":"2024-09-19T05:38:19.369744+0000","last_peered":"2024-09-19T05:38:19.369744+0000","last_clean":"2024-09-19T05:38:19.369744+0000","last_became_active":"2024-09-19T05:38:17.127570+0000","last_became_peered":"2024-09-19T05:38:17.127570+0000","last_unstale":"2024-09-19T05:38:19.369744+0000","last_undegraded":"2024-09-19T05:38:19.369744+0000","last_fullsized":"2024-09-19T05:38:19.369744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:14.614444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371068+0000","last_change":"2024-09-19T05:38:18.162623+0000","last_active":"2024-09-19T05:38:19.371068+0000","last_peered":"2024-09-19T05:38:19.371068+0000","last_clean":"2024-09-19T05:38:19.371068+0000","last_became_active":"2024-09-19T05:38:18.161925+0000","last_became_peered":"2024-09-19T05:38:18.161925+0000","last_unstale":"2024-09-19T05:38:19.371068+0000","last_undegraded":"2024-09-19T05:38:19.371068+0000","last_fullsized":"2024-09-19T05:38:19.371068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.964786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167496+0000","last_change":"2024-09-19T05:38:17.124389+0000","last_active":"2024-09-19T05:38:19.167496+0000","last_peered":"2024-09-19T05:38:19.167496+0000","last_clean":"2024-09-19T05:38:19.167496+0000","last_became_active":"2024-09-19T05:38:17.124116+0000","last_became_peered":"2024-09-19T05:38:17.124116+0000","last_unstale":"2024-09-19T05:38:19.167496+0000","last_undegraded":"2024-09-19T05:38:19.167496+0000","last_fullsized":"2024-09-19T05:38:19.167496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:09.177438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371847+0000","last_change":"2024-09-19T05:38:18.171090+0000","last_active":"2024-09-19T05:38:19.371847+0000","last_peered":"2024-09-19T05:38:19.371847+0000","last_clean":"2024-09-19T05:38:19.371847+0000","last_became_active":"2024-09-19T05:38:18.169884+0000","last_became_peered":"2024-09-19T05:38:18.169884+0000","last_unstale":"2024-09-19T05:38:19.371847+0000","last_undegraded":"2024-09-19T05:38:19.371847+0000","last_fullsized":"2024-09-19T05:38:19.371847+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:00.074346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"84'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170039+0000","last_change":"2024-09-19T05:38:17.152926+0000","last_active":"2024-09-19T05:38:19.170039+0000","last_peered":"2024-09-19T05:38:19.170039+0000","last_clean":"2024-09-19T05:38:19.170039+0000","last_became_active":"2024-09-19T05:38:17.152633+0000","last_became_peered":"2024-09-19T05:38:17.152633+0000","last_unstale":"2024-09-19T05:38:19.170039+0000","last_undegraded":"2024-09-19T05:38:19.170039+0000","last_fullsized":"2024-09-19T05:38:19.170039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:04.813232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368815+0000","last_change":"2024-09-19T05:38:18.173374+0000","last_active":"2024-09-19T05:38:19.368815+0000","last_peered":"2024-09-19T05:38:19.368815+0000","last_clean":"2024-09-19T05:38:19.368815+0000","last_became_active":"2024-09-19T05:38:18.173012+0000","last_became_peered":"2024-09-19T05:38:18.173012+0000","last_unstale":"2024-09-19T05:38:19.368815+0000","last_undegraded":"2024-09-19T05:38:19.368815+0000","last_fullsized":"2024-09-19T05:38:19.368815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:42.803690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370338+0000","last_change":"2024-09-19T05:38:17.148055+0000","last_active":"2024-09-19T05:38:19.370338+0000","last_peered":"2024-09-19T05:38:19.370338+0000","last_clean":"2024-09-19T05:38:19.370338+0000","last_became_active":"2024-09-19T05:38:17.147402+0000","last_became_peered":"2024-09-19T05:38:17.147402+0000","last_unstale":"2024-09-19T05:38:19.370338+0000","last_undegraded":"2024-09-19T05:38:19.370338+0000","last_fullsized":"2024-09-19T05:38:19.370338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:35.177608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167224+0000","last_change":"2024-09-19T05:38:18.177104+0000","last_active":"2024-09-19T05:38:19.167224+0000","last_peered":"2024-09-19T05:38:19.167224+0000","last_clean":"2024-09-19T05:38:19.167224+0000","last_became_active":"2024-09-19T05:38:18.176760+0000","last_became_peered":"2024-09-19T05:38:18.176760+0000","last_unstale":"2024-09-19T05:38:19.167224+0000","last_undegraded":"2024-09-19T05:38:19.167224+0000","last_fullsized":"2024-09-19T05:38:19.167224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:49.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170412+0000","last_change":"2024-09-19T05:38:17.132750+0000","last_active":"2024-09-19T05:38:19.170412+0000","last_peered":"2024-09-19T05:38:19.170412+0000","last_clean":"2024-09-19T05:38:19.170412+0000","last_became_active":"2024-09-19T05:38:17.132035+0000","last_became_peered":"2024-09-19T05:38:17.132035+0000","last_unstale":"2024-09-19T05:38:19.170412+0000","last_undegraded":"2024-09-19T05:38:19.170412+0000","last_fullsized":"2024-09-19T05:38:19.170412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:44.500089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.167910+0000","last_change":"2024-09-19T05:38:18.170606+0000","last_active":"2024-09-19T05:38:19.167910+0000","last_peered":"2024-09-19T05:38:19.167910+0000","last_clean":"2024-09-19T05:38:19.167910+0000","last_became_active":"2024-09-19T05:38:18.170320+0000","last_became_peered":"2024-09-19T05:38:18.170320+0000","last_unstale":"2024-09-19T05:38:19.167910+0000","last_undegraded":"2024-09-19T05:38:19.167910+0000","last_fullsized":"2024-09-19T05:38:19.167910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:13.450456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169712+0000","last_change":"2024-09-19T05:38:17.137253+0000","last_active":"2024-09-19T05:38:19.169712+0000","last_peered":"2024-09-19T05:38:19.169712+0000","last_clean":"2024-09-19T05:38:19.169712+0000","last_became_active":"2024-09-19T05:38:17.136921+0000","last_became_peered":"2024-09-19T05:38:17.136921+0000","last_unstale":"2024-09-19T05:38:19.169712+0000","last_undegraded":"2024-09-19T05:38:19.169712+0000","last_fullsized":"2024-09-19T05:38:19.169712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:42.735230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370483+0000","last_change":"2024-09-19T05:38:18.174368+0000","last_active":"2024-09-19T05:38:19.370483+0000","last_peered":"2024-09-19T05:38:19.370483+0000","last_clean":"2024-09-19T05:38:19.370483+0000","last_became_active":"2024-09-19T05:38:18.174023+0000","last_became_peered":"2024-09-19T05:38:18.174023+0000","last_unstale":"2024-09-19T05:38:19.370483+0000","last_undegraded":"2024-09-19T05:38:19.370483+0000","last_fullsized":"2024-09-19T05:38:19.370483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:59.575816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368607+0000","last_change":"2024-09-19T05:38:17.133484+0000","last_active":"2024-09-19T05:38:19.368607+0000","last_peered":"2024-09-19T05:38:19.368607+0000","last_clean":"2024-09-19T05:38:19.368607+0000","last_became_active":"2024-09-19T05:38:17.133155+0000","last_became_peered":"2024-09-19T05:38:17.133155+0000","last_unstale":"2024-09-19T05:38:19.368607+0000","last_undegraded":"2024-09-19T05:38:19.368607+0000","last_fullsized":"2024-09-19T05:38:19.368607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:55.206524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170485+0000","last_change":"2024-09-19T05:38:18.157525+0000","last_active":"2024-09-19T05:38:19.170485+0000","last_peered":"2024-09-19T05:38:19.170485+0000","last_clean":"2024-09-19T05:38:19.170485+0000","last_became_active":"2024-09-19T05:38:18.156768+0000","last_became_peered":"2024-09-19T05:38:18.156768+0000","last_unstale":"2024-09-19T05:38:19.170485+0000","last_undegraded":"2024-09-19T05:38:19.170485+0000","last_fullsized":"2024-09-19T05:38:19.170485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:42.803690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370623+0000","last_change":"2024-09-19T05:38:17.122267+0000","last_active":"2024-09-19T05:38:19.370623+0000","last_peered":"2024-09-19T05:38:19.370623+0000","last_clean":"2024-09-19T05:38:19.370623+0000","last_became_active":"2024-09-19T05:38:17.121874+0000","last_became_peered":"2024-09-19T05:38:17.121874+0000","last_unstale":"2024-09-19T05:38:19.370623+0000","last_undegraded":"2024-09-19T05:38:19.370623+0000","last_fullsized":"2024-09-19T05:38:19.370623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:28.920391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170331+0000","last_change":"2024-09-19T05:38:18.169865+0000","last_active":"2024-09-19T05:38:19.170331+0000","last_peered":"2024-09-19T05:38:19.170331+0000","last_clean":"2024-09-19T05:38:19.170331+0000","last_became_active":"2024-09-19T05:38:18.168430+0000","last_became_peered":"2024-09-19T05:38:18.168430+0000","last_unstale":"2024-09-19T05:38:19.170331+0000","last_undegraded":"2024-09-19T05:38:19.170331+0000","last_fullsized":"2024-09-19T05:38:19.170331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.869289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369376+0000","last_change":"2024-09-19T05:38:17.146511+0000","last_active":"2024-09-19T05:38:19.369376+0000","last_peered":"2024-09-19T05:38:19.369376+0000","last_clean":"2024-09-19T05:38:19.369376+0000","last_became_active":"2024-09-19T05:38:17.145962+0000","last_became_peered":"2024-09-19T05:38:17.145962+0000","last_unstale":"2024-09-19T05:38:19.369376+0000","last_undegraded":"2024-09-19T05:38:19.369376+0000","last_fullsized":"2024-09-19T05:38:19.369376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:27.636414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.372185+0000","last_change":"2024-09-19T05:38:18.155983+0000","last_active":"2024-09-19T05:38:19.372185+0000","last_peered":"2024-09-19T05:38:19.372185+0000","last_clean":"2024-09-19T05:38:19.372185+0000","last_became_active":"2024-09-19T05:38:18.155174+0000","last_became_peered":"2024-09-19T05:38:18.155174+0000","last_unstale":"2024-09-19T05:38:19.372185+0000","last_undegraded":"2024-09-19T05:38:19.372185+0000","last_fullsized":"2024-09-19T05:38:19.372185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:37.413371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369247+0000","last_change":"2024-09-19T05:38:17.145847+0000","last_active":"2024-09-19T05:38:19.369247+0000","last_peered":"2024-09-19T05:38:19.369247+0000","last_clean":"2024-09-19T05:38:19.369247+0000","last_became_active":"2024-09-19T05:38:17.145601+0000","last_became_peered":"2024-09-19T05:38:17.145601+0000","last_unstale":"2024-09-19T05:38:19.369247+0000","last_undegraded":"2024-09-19T05:38:19.369247+0000","last_fullsized":"2024-09-19T05:38:19.369247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:42.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169270+0000","last_change":"2024-09-19T05:38:18.179324+0000","last_active":"2024-09-19T05:38:19.169270+0000","last_peered":"2024-09-19T05:38:19.169270+0000","last_clean":"2024-09-19T05:38:19.169270+0000","last_became_active":"2024-09-19T05:38:18.178451+0000","last_became_peered":"2024-09-19T05:38:18.178451+0000","last_unstale":"2024-09-19T05:38:19.169270+0000","last_undegraded":"2024-09-19T05:38:19.169270+0000","last_fullsized":"2024-09-19T05:38:19.169270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:40.542006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368999+0000","last_change":"2024-09-19T05:38:17.143027+0000","last_active":"2024-09-19T05:38:19.368999+0000","last_peered":"2024-09-19T05:38:19.368999+0000","last_clean":"2024-09-19T05:38:19.368999+0000","last_became_active":"2024-09-19T05:38:17.142268+0000","last_became_peered":"2024-09-19T05:38:17.142268+0000","last_unstale":"2024-09-19T05:38:19.368999+0000","last_undegraded":"2024-09-19T05:38:19.368999+0000","last_fullsized":"2024-09-19T05:38:19.368999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:25.122540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371248+0000","last_change":"2024-09-19T05:38:18.147387+0000","last_active":"2024-09-19T05:38:19.371248+0000","last_peered":"2024-09-19T05:38:19.371248+0000","last_clean":"2024-09-19T05:38:19.371248+0000","last_became_active":"2024-09-19T05:38:18.146521+0000","last_became_peered":"2024-09-19T05:38:18.146521+0000","last_unstale":"2024-09-19T05:38:19.371248+0000","last_undegraded":"2024-09-19T05:38:19.371248+0000","last_fullsized":"2024-09-19T05:38:19.371248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:34.587947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"85'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170399+0000","last_change":"2024-09-19T05:38:17.126066+0000","last_active":"2024-09-19T05:38:19.170399+0000","last_peered":"2024-09-19T05:38:19.170399+0000","last_clean":"2024-09-19T05:38:19.170399+0000","last_became_active":"2024-09-19T05:38:17.125791+0000","last_became_peered":"2024-09-19T05:38:17.125791+0000","last_unstale":"2024-09-19T05:38:19.170399+0000","last_undegraded":"2024-09-19T05:38:19.170399+0000","last_fullsized":"2024-09-19T05:38:19.170399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:31.104896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.169948+0000","last_change":"2024-09-19T05:38:18.168850+0000","last_active":"2024-09-19T05:38:19.169948+0000","last_peered":"2024-09-19T05:38:19.169948+0000","last_clean":"2024-09-19T05:38:19.169948+0000","last_became_active":"2024-09-19T05:38:18.168086+0000","last_became_peered":"2024-09-19T05:38:18.168086+0000","last_unstale":"2024-09-19T05:38:19.169948+0000","last_undegraded":"2024-09-19T05:38:19.169948+0000","last_fullsized":"2024-09-19T05:38:19.169948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:20.940415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370792+0000","last_change":"2024-09-19T05:38:17.144370+0000","last_active":"2024-09-19T05:38:19.370792+0000","last_peered":"2024-09-19T05:38:19.370792+0000","last_clean":"2024-09-19T05:38:19.370792+0000","last_became_active":"2024-09-19T05:38:17.143606+0000","last_became_peered":"2024-09-19T05:38:17.143606+0000","last_unstale":"2024-09-19T05:38:19.370792+0000","last_undegraded":"2024-09-19T05:38:19.370792+0000","last_fullsized":"2024-09-19T05:38:19.370792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:40.841916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.170673+0000","last_change":"2024-09-19T05:38:18.180132+0000","last_active":"2024-09-19T05:38:19.170673+0000","last_peered":"2024-09-19T05:38:19.170673+0000","last_clean":"2024-09-19T05:38:19.170673+0000","last_became_active":"2024-09-19T05:38:18.179549+0000","last_became_peered":"2024-09-19T05:38:18.179549+0000","last_unstale":"2024-09-19T05:38:19.170673+0000","last_undegraded":"2024-09-19T05:38:19.170673+0000","last_fullsized":"2024-09-19T05:38:19.170673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:17.759334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368508+0000","last_change":"2024-09-19T05:38:17.150784+0000","last_active":"2024-09-19T05:38:19.368508+0000","last_peered":"2024-09-19T05:38:19.368508+0000","last_clean":"2024-09-19T05:38:19.368508+0000","last_became_active":"2024-09-19T05:38:17.149985+0000","last_became_peered":"2024-09-19T05:38:17.149985+0000","last_unstale":"2024-09-19T05:38:19.368508+0000","last_undegraded":"2024-09-19T05:38:19.368508+0000","last_fullsized":"2024-09-19T05:38:19.368508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:15.604497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371904+0000","last_change":"2024-09-19T05:38:18.147351+0000","last_active":"2024-09-19T05:38:19.371904+0000","last_peered":"2024-09-19T05:38:19.371904+0000","last_clean":"2024-09-19T05:38:19.371904+0000","last_became_active":"2024-09-19T05:38:18.146569+0000","last_became_peered":"2024-09-19T05:38:18.146569+0000","last_unstale":"2024-09-19T05:38:19.371904+0000","last_undegraded":"2024-09-19T05:38:19.371904+0000","last_fullsized":"2024-09-19T05:38:19.371904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:52.055892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370687+0000","last_change":"2024-09-19T05:38:17.137447+0000","last_active":"2024-09-19T05:38:19.370687+0000","last_peered":"2024-09-19T05:38:19.370687+0000","last_clean":"2024-09-19T05:38:19.370687+0000","last_became_active":"2024-09-19T05:38:17.136760+0000","last_became_peered":"2024-09-19T05:38:17.136760+0000","last_unstale":"2024-09-19T05:38:19.370687+0000","last_undegraded":"2024-09-19T05:38:19.370687+0000","last_fullsized":"2024-09-19T05:38:19.370687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:06.445516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371686+0000","last_change":"2024-09-19T05:38:18.172145+0000","last_active":"2024-09-19T05:38:19.371686+0000","last_peered":"2024-09-19T05:38:19.371686+0000","last_clean":"2024-09-19T05:38:19.371686+0000","last_became_active":"2024-09-19T05:38:18.171344+0000","last_became_peered":"2024-09-19T05:38:18.171344+0000","last_unstale":"2024-09-19T05:38:19.371686+0000","last_undegraded":"2024-09-19T05:38:19.371686+0000","last_fullsized":"2024-09-19T05:38:19.371686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:28.259580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.168073+0000","last_change":"2024-09-19T05:38:17.136157+0000","last_active":"2024-09-19T05:38:19.168073+0000","last_peered":"2024-09-19T05:38:19.168073+0000","last_clean":"2024-09-19T05:38:19.168073+0000","last_became_active":"2024-09-19T05:38:17.135724+0000","last_became_peered":"2024-09-19T05:38:17.135724+0000","last_unstale":"2024-09-19T05:38:19.168073+0000","last_undegraded":"2024-09-19T05:38:19.168073+0000","last_fullsized":"2024-09-19T05:38:19.168073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:11.869952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369208+0000","last_change":"2024-09-19T05:38:18.173915+0000","last_active":"2024-09-19T05:38:19.369208+0000","last_peered":"2024-09-19T05:38:19.369208+0000","last_clean":"2024-09-19T05:38:19.369208+0000","last_became_active":"2024-09-19T05:38:18.173006+0000","last_became_peered":"2024-09-19T05:38:18.173006+0000","last_unstale":"2024-09-19T05:38:19.369208+0000","last_undegraded":"2024-09-19T05:38:19.369208+0000","last_fullsized":"2024-09-19T05:38:19.369208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:00.074346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371487+0000","last_change":"2024-09-19T05:38:17.145925+0000","last_active":"2024-09-19T05:38:19.371487+0000","last_peered":"2024-09-19T05:38:19.371487+0000","last_clean":"2024-09-19T05:38:19.371487+0000","last_became_active":"2024-09-19T05:38:17.145324+0000","last_became_peered":"2024-09-19T05:38:17.145324+0000","last_unstale":"2024-09-19T05:38:19.371487+0000","last_undegraded":"2024-09-19T05:38:19.371487+0000","last_fullsized":"2024-09-19T05:38:19.371487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:39.533316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369988+0000","last_change":"2024-09-19T05:38:18.173150+0000","last_active":"2024-09-19T05:38:19.369988+0000","last_peered":"2024-09-19T05:38:19.369988+0000","last_clean":"2024-09-19T05:38:19.369988+0000","last_became_active":"2024-09-19T05:38:18.172791+0000","last_became_peered":"2024-09-19T05:38:18.172791+0000","last_unstale":"2024-09-19T05:38:19.369988+0000","last_undegraded":"2024-09-19T05:38:19.369988+0000","last_fullsized":"2024-09-19T05:38:19.369988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:37.413371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.368010+0000","last_change":"2024-09-19T05:38:17.123000+0000","last_active":"2024-09-19T05:38:19.368010+0000","last_peered":"2024-09-19T05:38:19.368010+0000","last_clean":"2024-09-19T05:38:19.368010+0000","last_became_active":"2024-09-19T05:38:17.121818+0000","last_became_peered":"2024-09-19T05:38:17.121818+0000","last_unstale":"2024-09-19T05:38:19.368010+0000","last_undegraded":"2024-09-19T05:38:19.368010+0000","last_fullsized":"2024-09-19T05:38:19.368010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:19.931725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.371186+0000","last_change":"2024-09-19T05:38:18.180070+0000","last_active":"2024-09-19T05:38:19.371186+0000","last_peered":"2024-09-19T05:38:19.371186+0000","last_clean":"2024-09-19T05:38:19.371186+0000","last_became_active":"2024-09-19T05:38:18.177577+0000","last_became_peered":"2024-09-19T05:38:18.177577+0000","last_unstale":"2024-09-19T05:38:19.371186+0000","last_undegraded":"2024-09-19T05:38:19.371186+0000","last_fullsized":"2024-09-19T05:38:19.371186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:17.100227+0000","last_clean_scrub_stamp":"2024-09-19T05:38:17.100227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.869289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.370310+0000","last_change":"2024-09-19T05:38:17.146047+0000","last_active":"2024-09-19T05:38:19.370310+0000","last_peered":"2024-09-19T05:38:19.370310+0000","last_clean":"2024-09-19T05:38:19.370310+0000","last_became_active":"2024-09-19T05:38:17.145623+0000","last_became_peered":"2024-09-19T05:38:17.145623+0000","last_unstale":"2024-09-19T05:38:19.370310+0000","last_undegraded":"2024-09-19T05:38:19.370310+0000","last_fullsized":"2024-09-19T05:38:19.370310+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:38:16.091537+0000","last_clean_scrub_stamp":"2024-09-19T05:38:16.091537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:32.385614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":286,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:38:19.369035+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:38:19.369035+0000","last_peered":"2024-09-19T05:38:19.369035+0000","last_clean":"2024-09-19T05:38:19.369035+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:38:19.369035+0000","last_undegraded":"2024-09-19T05:38:19.369035+0000","last_fullsized":"2024-09-19T05:38:19.369035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1634304,"data_stored":1071250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542210,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40532,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331308,"statfs":{"total":96636764160,"available":96595259392,"internally_reserved":0,"allocated":1048576,"data_stored":482472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542212,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40528,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331312,"statfs":{"total":96636764160,"available":96595263488,"internally_reserved":0,"allocated":1040384,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50276,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321564,"statfs":{"total":96636764160,"available":96585281536,"internally_reserved":0,"allocated":1056768,"data_stored":482576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542211,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46100,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325740,"statfs":{"total":96636764160,"available":96589557760,"internally_reserved":0,"allocated":1040384,"data_stored":481442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542211,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1048576,"data_stored":481602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1044480,"data_stored":480972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542210,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54988,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316852,"statfs":{"total":96636764160,"available":96580456448,"internally_reserved":0,"allocated":1630208,"data_stored":1071228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:27.103 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:38:27.103 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:38:27.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb727609640 1 Processor -- start 2024-09-19T05:38:27.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb727609640 1 -- start start 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb727609640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72006dfc0 0x7fb720071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb727609640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72006e540 con 0x7fb7200cf9c0 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb727609640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72006e820 con 0x7fb7200724a0 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb727609640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb7200728d0 con 0x7fb72006dfc0 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb7253a5640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb7200cf9c0 0x7fb72015f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42516/0 (socket says 172.21.15.67:42516) 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb7253a5640 1 -- 172.21.15.67:0/1641172200 learned_addr learned my addr 172.21.15.67:0/1641172200 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb724ba4640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72006dfc0 0x7fb720071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074352325 0 0) 0x7fb72006e540 con 0x7fb7200cf9c0 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb70c003530 con 0x7fb7200cf9c0 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1319598412 0 0) 0x7fb70c003530 con 0x7fb7200cf9c0 2024-09-19T05:38:27.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72006dfc0 msgr2=0x7fb720071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72006dfc0 0x7fb720071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 >> v1:172.21.15.97:6789/0 conn(0x7fb7200724a0 legacy=0x7fb7200b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72006eb00 con 0x7fb7200cf9c0 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fb71c001680 con 0x7fb7200cf9c0 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 >> v1:172.21.15.67:6789/0 conn(0x7fb7200cf9c0 legacy=0x7fb72015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72006dfc0 0x7fb70c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb70c003fc0 0x7fb70c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb70c004d50 0x7fb70c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb7200728d0 con 0x7fb70c003fc0 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c00bb10 con 0x7fb70c004d50 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb70c00bd10 con 0x7fb72006dfc0 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb724ba4640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb70c003fc0 0x7fb70c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb7253a5640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72006dfc0 0x7fb70c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb725ba6640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb70c004d50 0x7fb70c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb724ba4640 1 -- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72006dfc0 msgr2=0x7fb70c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb724ba4640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72006dfc0 0x7fb70c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb724ba4640 1 -- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb70c004d50 msgr2=0x7fb70c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb724ba4640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb70c004d50 0x7fb70c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.240+0000 7fb724ba4640 1 -- 172.21.15.67:0/1641172200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c003530 con 0x7fb70c003fc0 2024-09-19T05:38:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb724ba4640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb70c003fc0 0x7fb70c004810 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fb710009ae0 tx=0x7fb71001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3c5127b0f90855 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7100b2070 con 0x7fb70c003fc0 2024-09-19T05:38:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7100a55b0 con 0x7fb70c003fc0 2024-09-19T05:38:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb717fff640 1 -- 172.21.15.67:0/1641172200 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7100096b0 con 0x7fb70c003fc0 2024-09-19T05:38:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb727609640 1 -- 172.21.15.67:0/1641172200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb70c003fc0 msgr2=0x7fb70c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb727609640 1 --2- 172.21.15.67:0/1641172200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb70c003fc0 0x7fb70c004810 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fb710009ae0 tx=0x7fb71001c960 comp rx=0 tx=0).stop 2024-09-19T05:38:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb725ba6640 1 -- 172.21.15.67:0/1641172200 reap_dead start 2024-09-19T05:38:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb727609640 1 -- 172.21.15.67:0/1641172200 shutdown_connections 2024-09-19T05:38:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb727609640 1 -- 172.21.15.67:0/1641172200 >> 172.21.15.67:0/1641172200 conn(0x7fb7200b1e50 msgr2=0x7fb7200b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:27.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb727609640 1 -- 172.21.15.67:0/1641172200 shutdown_connections 2024-09-19T05:38:27.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb727609640 1 -- 172.21.15.67:0/1641172200 wait complete. 2024-09-19T05:38:27.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb727609640 1 Processor -- start 2024-09-19T05:38:27.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.244+0000 7fb727609640 1 -- start start 2024-09-19T05:38:27.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb727609640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72014da10 0x7fb72014e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb727609640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb72014e720 0x7fb72014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb727609640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb72014f650 0x7fb720153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb727609640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb7200cfda0 con 0x7fb72014f650 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb727609640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb72006f0c0 con 0x7fb72014e720 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb727609640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb7200cff20 con 0x7fb72014da10 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb725ba6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb72014f650 0x7fb720153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb725ba6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb72014f650 0x7fb720153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44664/0 (socket says 172.21.15.67:44664) 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb725ba6640 1 -- 172.21.15.67:0/864315556 learned_addr learned my addr 172.21.15.67:0/864315556 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb724ba4640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb72014e720 0x7fb72014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb7253a5640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72014da10 0x7fb72014e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb725ba6640 1 -- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72014da10 msgr2=0x7fb72014e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb725ba6640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72014da10 0x7fb72014e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb725ba6640 1 -- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb72014e720 msgr2=0x7fb72014f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb725ba6640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb72014e720 0x7fb72014f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb725ba6640 1 -- 172.21.15.67:0/864315556 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72014fad0 con 0x7fb72014f650 2024-09-19T05:38:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb724ba4640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb72014e720 0x7fb72014f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:27.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb725ba6640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb72014f650 0x7fb720153500 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fb7200711a0 tx=0x7fb71800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:27.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb715ffb640 1 -- 172.21.15.67:0/864315556 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71800ee90 con 0x7fb72014f650 2024-09-19T05:38:27.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb715ffb640 1 -- 172.21.15.67:0/864315556 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb718018070 con 0x7fb72014f650 2024-09-19T05:38:27.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb727609640 1 -- 172.21.15.67:0/864315556 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7201550a0 con 0x7fb72014f650 2024-09-19T05:38:27.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb715ffb640 1 -- 172.21.15.67:0/864315556 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718003ba0 con 0x7fb72014f650 2024-09-19T05:38:27.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb727609640 1 -- 172.21.15.67:0/864315556 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb720155660 con 0x7fb72014f650 2024-09-19T05:38:27.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb727609640 1 -- 172.21.15.67:0/864315556 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb720071f60 con 0x7fb72014f650 2024-09-19T05:38:27.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb715ffb640 1 -- 172.21.15.67:0/864315556 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7180050d0 con 0x7fb72014f650 2024-09-19T05:38:27.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb715ffb640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb704067a60 0x7fb704069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb715ffb640 1 -- 172.21.15.67:0/864315556 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7fb718085a80 con 0x7fb72014f650 2024-09-19T05:38:27.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.248+0000 7fb7253a5640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb704067a60 0x7fb704069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.252+0000 7fb7253a5640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb704067a60 0x7fb704069f20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb71c001060 tx=0x7fb71c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:27.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.256+0000 7fb715ffb640 1 -- 172.21.15.67:0/864315556 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb718056430 con 0x7fb72014f650 2024-09-19T05:38:27.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.476+0000 7fb727609640 1 -- 172.21.15.67:0/864315556 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb72015eaf0 con 0x7fb72014f650 2024-09-19T05:38:27.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.480+0000 7fb715ffb640 1 -- 172.21.15.67:0/864315556 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7fb718055d30 con 0x7fb72014f650 2024-09-19T05:38:27.485 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:38:27.485 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:38:27.485 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:38:27.485 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:38:27.485 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:38:27.485 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:38:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 -- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb704067a60 msgr2=0x7fb704069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb704067a60 0x7fb704069f20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb71c001060 tx=0x7fb71c009040 comp rx=0 tx=0).stop 2024-09-19T05:38:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 -- 172.21.15.67:0/864315556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb72014f650 msgr2=0x7fb720153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb72014f650 0x7fb720153500 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fb7200711a0 tx=0x7fb71800eb50 comp rx=0 tx=0).stop 2024-09-19T05:38:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 -- 172.21.15.67:0/864315556 shutdown_connections 2024-09-19T05:38:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb72014f650 0x7fb720153500 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb72014e720 0x7fb72014f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb704067a60 0x7fb704069f20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 --2- 172.21.15.67:0/864315556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb72014da10 0x7fb72014e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 -- 172.21.15.67:0/864315556 >> 172.21.15.67:0/864315556 conn(0x7fb7200b1e50 msgr2=0x7fb7200ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:27.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 -- 172.21.15.67:0/864315556 shutdown_connections 2024-09-19T05:38:27.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.484+0000 7fb727609640 1 -- 172.21.15.67:0/864315556 wait complete. 2024-09-19T05:38:27.503 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:27.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1003965640 1 Processor -- start 2024-09-19T05:38:27.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1003965640 1 -- start start 2024-09-19T05:38:27.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1003965640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ffc072590 0x7f0ffc166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1003965640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ffc0b3860 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1003965640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ffc0b3b40 con 0x7f0ffc0b4900 2024-09-19T05:38:27.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1003965640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0ffc15b5c0 con 0x7f0ffc072590 2024-09-19T05:38:27.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1001701640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0ffc15b1e0 0x7f0ffc0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42524/0 (socket says 172.21.15.67:42524) 2024-09-19T05:38:27.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1001701640 1 -- 172.21.15.67:0/2583018654 learned_addr learned my addr 172.21.15.67:0/2583018654 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:27.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1001f02640 1 --2- 172.21.15.67:0/2583018654 >> v2:172.21.15.67:3300/0 conn(0x7f0ffc072590 0x7f0ffc166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f0ff3fff640 1 -- 172.21.15.67:0/2583018654 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104422751 0 0) 0x7f0ffc0b3860 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f0ff3fff640 1 -- 172.21.15.67:0/2583018654 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fe8005740 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1001f02640 1 -- 172.21.15.67:0/2583018654 >> v1:172.21.15.97:6789/0 conn(0x7f0ffc0b4900 legacy=0x7f0ffc071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1001f02640 1 -- 172.21.15.67:0/2583018654 >> v1:172.21.15.67:6789/0 conn(0x7f0ffc15b1e0 legacy=0x7f0ffc0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.620+0000 7f1001f02640 1 -- 172.21.15.67:0/2583018654 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc0b3e20 con 0x7f0ffc072590 2024-09-19T05:38:27.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1001f02640 1 --2- 172.21.15.67:0/2583018654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc072590 0x7f0ffc166050 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009d90 tx=0x7f0ff401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7939d11820b7bf2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:27.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f0ff3fff640 1 -- 172.21.15.67:0/2583018654 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40b2070 con 0x7f0ffc072590 2024-09-19T05:38:27.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f0ff3fff640 1 -- 172.21.15.67:0/2583018654 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff40a5920 con 0x7f0ffc072590 2024-09-19T05:38:27.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f0ff3fff640 1 -- 172.21.15.67:0/2583018654 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40a5cd0 con 0x7f0ffc072590 2024-09-19T05:38:27.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 -- 172.21.15.67:0/2583018654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc072590 msgr2=0x7f0ffc166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 --2- 172.21.15.67:0/2583018654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc072590 0x7f0ffc166050 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009d90 tx=0x7f0ff401c940 comp rx=0 tx=0).stop 2024-09-19T05:38:27.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 -- 172.21.15.67:0/2583018654 shutdown_connections 2024-09-19T05:38:27.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 --2- 172.21.15.67:0/2583018654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc072590 0x7f0ffc166050 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 -- 172.21.15.67:0/2583018654 >> 172.21.15.67:0/2583018654 conn(0x7f0ffc0d0080 msgr2=0x7f0ffc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:27.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 -- 172.21.15.67:0/2583018654 shutdown_connections 2024-09-19T05:38:27.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 -- 172.21.15.67:0/2583018654 wait complete. 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 Processor -- start 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 -- start start 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ffc072590 0x7f0ffc14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ffc0b4900 0x7f0ffc0992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc15b1e0 0x7f0ffc15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc06f210 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc06f090 con 0x7f0ffc0b4900 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1003965640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0ffc06f390 con 0x7f0ffc072590 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1001f02640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc15b1e0 0x7f0ffc15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1001f02640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc15b1e0 0x7f0ffc15a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44678/0 (socket says 172.21.15.67:44678) 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1001f02640 1 -- 172.21.15.67:0/1675553518 learned_addr learned my addr 172.21.15.67:0/1675553518 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:27.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1000f00640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ffc0b4900 0x7f0ffc0992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.624+0000 7f1001701640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ffc072590 0x7f0ffc14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f1001f02640 1 -- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ffc072590 msgr2=0x7f0ffc14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f1001f02640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ffc072590 0x7f0ffc14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f1001f02640 1 -- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ffc0b4900 msgr2=0x7f0ffc0992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f1001f02640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ffc0b4900 0x7f0ffc0992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f1001f02640 1 -- 172.21.15.67:0/1675553518 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc14b370 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f1001f02640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc15b1e0 0x7f0ffc15a4b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40b0040 tx=0x7f0ff40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:27.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f0ff1ffb640 1 -- 172.21.15.67:0/1675553518 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40b2050 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f0ff1ffb640 1 -- 172.21.15.67:0/1675553518 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff40be070 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f0ff1ffb640 1 -- 172.21.15.67:0/1675553518 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4004040 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f1003965640 1 -- 172.21.15.67:0/1675553518 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ffc14f230 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f1003965640 1 -- 172.21.15.67:0/1675553518 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ffc14f7f0 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f1003965640 1 -- 172.21.15.67:0/1675553518 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ffc071e80 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f0ff1ffb640 1 -- 172.21.15.67:0/1675553518 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ff40041e0 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f0ff1ffb640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fe00678f0 0x7f0fe0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:27.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f0ff1ffb640 1 -- 172.21.15.67:0/1675553518 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f0ff4120e10 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.628+0000 7f1001701640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fe00678f0 0x7f0fe0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:27.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.632+0000 7f1001701640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fe00678f0 0x7f0fe0069db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0011f0 tx=0x7f0fec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:27.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.632+0000 7f0ff1ffb640 1 -- 172.21.15.67:0/1675553518 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0ff4016560 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.836+0000 7f1003965640 1 -- 172.21.15.67:0/1675553518 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ffc0aeef0 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.836+0000 7f0ff1ffb640 1 -- 172.21.15.67:0/1675553518 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5222 (secure 0 0 0) 0x7f0ff40f17d0 con 0x7f0ffc15b1e0 2024-09-19T05:38:27.840 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:27.841 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":52,"btime":"2024-09-19T05:38:21:175684+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/3972177199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3972177199},{"type":"v1","addr":"172.21.15.67:6835","nonce":3972177199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5441,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/600959636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":600959636},{"type":"v1","addr":"172.21.15.97:6835","nonce":600959636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2657621121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2657621121},{"type":"v1","addr":"172.21.15.97:6837","nonce":2657621121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:38:17.483070+0000","modified":"2024-09-19T05:38:20.537492+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6834/3597291023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3597291023},{"type":"v1","addr":"172.21.15.67:6834","nonce":3597291023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6741,"qdb_cluster":[6741]},"id":5}]} 2024-09-19T05:38:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 52 2024-09-19T05:38:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 -- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fe00678f0 msgr2=0x7f0fe0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fe00678f0 0x7f0fe0069db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0011f0 tx=0x7f0fec009040 comp rx=0 tx=0).stop 2024-09-19T05:38:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 -- 172.21.15.67:0/1675553518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc15b1e0 msgr2=0x7f0ffc15a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc15b1e0 0x7f0ffc15a4b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40b0040 tx=0x7f0ff40196e0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 -- 172.21.15.67:0/1675553518 shutdown_connections 2024-09-19T05:38:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ffc15b1e0 0x7f0ffc15a4b0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ffc0b4900 0x7f0ffc0992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fe00678f0 0x7f0fe0069db0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 --2- 172.21.15.67:0/1675553518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ffc072590 0x7f0ffc14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:27.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 -- 172.21.15.67:0/1675553518 >> 172.21.15.67:0/1675553518 conn(0x7f0ffc0d0080 msgr2=0x7f0ffc0afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:27.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 -- 172.21.15.67:0/1675553518 shutdown_connections 2024-09-19T05:38:27.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:27.840+0000 7f1003965640 1 -- 172.21.15.67:0/1675553518 wait complete. 2024-09-19T05:38:28.263 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:38:17.483070+0000', 'modified': '2024-09-19T05:38:20.537492+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6741}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6741': {'gid': 6741, 'name': 'c', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6834/3597291023', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 3597291023}, {'type': 'v1', 'addr': '172.21.15.67:6834', 'nonce': 3597291023}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6741, 'qdb_cluster': [6741]} 2024-09-19T05:38:28.263 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:38:28.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:38:28.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e20066640 1 Processor -- start 2024-09-19T05:38:28.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e20066640 1 -- start start 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e20066640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815c030 0x7f0e1806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e20066640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0e1815d1d0 0x7f0e180b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e20066640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1806e3c0 con 0x7f0e180b3510 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e20066640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1806e6a0 con 0x7f0e1815d1d0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e20066640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1806e980 con 0x7f0e1815c030 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1e603640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0e180b3510 0x7f0e1806f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42536/0 (socket says 172.21.15.67:42536) 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1e603640 1 -- 172.21.15.67:0/3804969452 learned_addr learned my addr 172.21.15.67:0/3804969452 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1de02640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815c030 0x7f0e1806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1d601640 1 --2- 172.21.15.67:0/3804969452 >> v2:172.21.15.97:3300/0 conn(0x7f0e1815d1d0 0x7f0e180b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603196356 0 0) 0x7f0e1806e3c0 con 0x7f0e180b3510 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e04003530 con 0x7f0e180b3510 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 691770346 0 0) 0x7f0e04003530 con 0x7f0e180b3510 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815c030 msgr2=0x7f0e1806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815c030 0x7f0e1806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 >> v2:172.21.15.97:3300/0 conn(0x7f0e1815d1d0 msgr2=0x7f0e180b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 --2- 172.21.15.67:0/3804969452 >> v2:172.21.15.97:3300/0 conn(0x7f0e1815d1d0 0x7f0e180b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1806ec60 con 0x7f0e180b3510 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f0e10001a00 con 0x7f0e180b3510 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 >> v1:172.21.15.67:6789/0 conn(0x7f0e180b3510 legacy=0x7f0e1806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e040039c0 0x7f0e04003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 0x7f0e04004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815c030 0x7f0e040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1806e6a0 con 0x7f0e04004810 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1806e980 con 0x7f0e040039c0 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0e0400b9d0 con 0x7f0e1815c030 2024-09-19T05:38:28.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.396+0000 7f0e1d601640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 0x7f0e04004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1de02640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e040039c0 0x7f0e04003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1e603640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815c030 0x7f0e040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1d601640 1 -- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815c030 msgr2=0x7f0e040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1d601640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815c030 0x7f0e040051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1d601640 1 -- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e040039c0 msgr2=0x7f0e04003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1d601640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e040039c0 0x7f0e04003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1d601640 1 -- 172.21.15.67:0/3804969452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e04003530 con 0x7f0e04004810 2024-09-19T05:38:28.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1d601640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 0x7f0e04004c90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009ab0 tx=0x7f0e0801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6786039400937737 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080096b0 con 0x7f0e04004810 2024-09-19T05:38:28.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e080a64a0 con 0x7f0e04004810 2024-09-19T05:38:28.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1ce00640 1 -- 172.21.15.67:0/3804969452 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080a6850 con 0x7f0e04004810 2024-09-19T05:38:28.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e20066640 1 -- 172.21.15.67:0/3804969452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 msgr2=0x7f0e04004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e20066640 1 --2- 172.21.15.67:0/3804969452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 0x7f0e04004c90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009ab0 tx=0x7f0e0801ca90 comp rx=0 tx=0).stop 2024-09-19T05:38:28.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e1e603640 1 -- 172.21.15.67:0/3804969452 reap_dead start 2024-09-19T05:38:28.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e20066640 1 -- 172.21.15.67:0/3804969452 shutdown_connections 2024-09-19T05:38:28.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e20066640 1 -- 172.21.15.67:0/3804969452 >> 172.21.15.67:0/3804969452 conn(0x7f0e180d0080 msgr2=0x7f0e180d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:28.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e20066640 1 -- 172.21.15.67:0/3804969452 shutdown_connections 2024-09-19T05:38:28.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.400+0000 7f0e20066640 1 -- 172.21.15.67:0/3804969452 wait complete. 2024-09-19T05:38:28.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e20066640 1 Processor -- start 2024-09-19T05:38:28.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e20066640 1 -- start start 2024-09-19T05:38:28.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e20066640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 0x7f0e18151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e20066640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e18145130 0x7f0e18072ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e20066640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18073410 0x7f0e1814ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e20066640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1815d730 con 0x7f0e04004810 2024-09-19T05:38:28.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e20066640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1815d5b0 con 0x7f0e18073410 2024-09-19T05:38:28.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e20066640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1806fb70 con 0x7f0e18145130 2024-09-19T05:38:28.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1de02640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 0x7f0e18151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1de02640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 0x7f0e18151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44682/0 (socket says 172.21.15.67:44682) 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1de02640 1 -- 172.21.15.67:0/1451433603 learned_addr learned my addr 172.21.15.67:0/1451433603 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1e603640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18073410 0x7f0e1814ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1d601640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e18145130 0x7f0e18072ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1de02640 1 -- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e18145130 msgr2=0x7f0e18072ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1de02640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e18145130 0x7f0e18072ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1de02640 1 -- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18073410 msgr2=0x7f0e1814ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1de02640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18073410 0x7f0e1814ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1de02640 1 -- 172.21.15.67:0/1451433603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1814c570 con 0x7f0e04004810 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e1de02640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 0x7f0e18151b50 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f0e14011610 tx=0x7f0e14011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e0e7fc640 1 -- 172.21.15.67:0/1451433603 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14015870 con 0x7f0e04004810 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e0e7fc640 1 -- 172.21.15.67:0/1451433603 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e14015a10 con 0x7f0e04004810 2024-09-19T05:38:28.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e0e7fc640 1 -- 172.21.15.67:0/1451433603 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14015dc0 con 0x7f0e04004810 2024-09-19T05:38:28.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e20066640 1 -- 172.21.15.67:0/1451433603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1815e320 con 0x7f0e04004810 2024-09-19T05:38:28.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.404+0000 7f0e20066640 1 -- 172.21.15.67:0/1451433603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1815b380 con 0x7f0e04004810 2024-09-19T05:38:28.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e0e7fc640 1 -- 172.21.15.67:0/1451433603 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e140143e0 con 0x7f0e04004810 2024-09-19T05:38:28.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e0e7fc640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0dfc0678f0 0x7f0dfc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e0e7fc640 1 -- 172.21.15.67:0/1451433603 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f0e140861e0 con 0x7f0e04004810 2024-09-19T05:38:28.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0dfc0678f0 0x7f0dfc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e23122000 1 Processor -- start 2024-09-19T05:38:28.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0dfc0678f0 0x7f0dfc069db0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0e080ad000 tx=0x7f0e080b2040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e23122000 1 -- start start 2024-09-19T05:38:28.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e23122000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58db20 0x5631eb58df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e23122000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb543d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e23122000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb544290 0x5631eb544670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e23122000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5631eb42bb60 con 0x5631eb58e440 2024-09-19T05:38:28.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e23122000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5631eb392c70 con 0x5631eb58db20 2024-09-19T05:38:28.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e23122000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5631eb338ed0 con 0x5631eb544290 2024-09-19T05:38:28.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb543d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb543d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44684/0 (socket says 172.21.15.67:44684) 2024-09-19T05:38:28.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 -- 172.21.15.67:0/3233136945 learned_addr learned my addr 172.21.15.67:0/3233136945 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:28.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1de02640 1 --2- 172.21.15.67:0/3233136945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58db20 0x5631eb58df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1e603640 1 --2- 172.21.15.67:0/3233136945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb544290 0x5631eb544670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 -- 172.21.15.67:0/3233136945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb544290 msgr2=0x5631eb544670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 --2- 172.21.15.67:0/3233136945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb544290 0x5631eb544670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 -- 172.21.15.67:0/3233136945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58db20 msgr2=0x5631eb58df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 --2- 172.21.15.67:0/3233136945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58db20 0x5631eb58df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 -- 172.21.15.67:0/3233136945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631eb34ae50 con 0x5631eb58e440 2024-09-19T05:38:28.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0e1d601640 1 --2- 172.21.15.67:0/3233136945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb543d50 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f0e08006f90 tx=0x7f0e08004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ffa2107fd50d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.408+0000 7f0dfb7fe640 1 -- 172.21.15.67:0/3233136945 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080ca070 con 0x5631eb58e440 2024-09-19T05:38:28.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0dfb7fe640 1 -- 172.21.15.67:0/3233136945 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e080a7600 con 0x5631eb58e440 2024-09-19T05:38:28.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0dfb7fe640 1 -- 172.21.15.67:0/3233136945 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080a79b0 con 0x5631eb58e440 2024-09-19T05:38:28.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- 172.21.15.67:0/3233136945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 msgr2=0x5631eb543d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 --2- 172.21.15.67:0/3233136945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb543d50 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f0e08006f90 tx=0x7f0e08004740 comp rx=0 tx=0).stop 2024-09-19T05:38:28.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- 172.21.15.67:0/3233136945 shutdown_connections 2024-09-19T05:38:28.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 --2- 172.21.15.67:0/3233136945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb544290 0x5631eb544670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 --2- 172.21.15.67:0/3233136945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb543d50 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 --2- 172.21.15.67:0/3233136945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58db20 0x5631eb58df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- 172.21.15.67:0/3233136945 >> 172.21.15.67:0/3233136945 conn(0x5631eb54a600 msgr2=0x5631eb542630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- 172.21.15.67:0/3233136945 shutdown_connections 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- 172.21.15.67:0/3233136945 wait complete. 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- start start 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 Processor -- start 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58db20 0x5631eb548df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58e440 0x5631eb54ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb549330 0x5631eb54f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5631eb3f4b00 con 0x5631eb549330 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5631eb36d360 con 0x5631eb58e440 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5631eb36a2d0 con 0x5631eb58db20 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 10 client.0 _ll_register_callbacks cb 0x5631eb52f820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1e603640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb549330 0x5631eb54f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1e603640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb549330 0x5631eb54f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44692/0 (socket says 172.21.15.67:44692) 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1e603640 1 -- 172.21.15.67:0/4257489084 learned_addr learned my addr 172.21.15.67:0/4257489084 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1de02640 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58db20 0x5631eb548df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1d601640 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58e440 0x5631eb54ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1e603640 1 -- 172.21.15.67:0/4257489084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58db20 msgr2=0x5631eb548df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1e603640 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58db20 0x5631eb548df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1e603640 1 -- 172.21.15.67:0/4257489084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58e440 msgr2=0x5631eb54ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1e603640 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58e440 0x5631eb54ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1e603640 1 -- 172.21.15.67:0/4257489084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631eb339120 con 0x5631eb549330 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1d601640 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58e440 0x5631eb54ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1e603640 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb549330 0x5631eb54f230 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f0e1806ff10 tx=0x7f0e100159b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d38976347d5c804 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0df8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4257489084 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10010040 con 0x5631eb549330 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4257489084 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f0e1001b910 con 0x5631eb549330 2024-09-19T05:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- 172.21.15.67:0/4257489084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e080a7600 con 0x5631eb549330 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4257489084 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f0e1001bb10 con 0x5631eb549330 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 10 client.6897 fetch_fsmap learned FSMap version 52 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- 172.21.15.67:0/4257489084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5631eb332450 con 0x5631eb549330 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4257489084 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e080a7600 con 0x5631eb549330 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4257489084 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7f0e10016040 con 0x5631eb549330 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 10 client.6897 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 10 client.6897 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 20 client.6897 populate_metadata read hostname 'smithi067' 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.67:6832/3597291023,v1:172.21.15.67:6834/3597291023] conn(0x5631eb59c280 0x5631eb59e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 4 client.6897 mds_command: new command op to 6741 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e23122000 1 -- 172.21.15.67:0/4257489084 --> [v2:172.21.15.67:6832/3597291023,v1:172.21.15.67:6834/3597291023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631eb32cc00 con 0x5631eb59c280 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.412+0000 7f0e1de02640 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.67:6832/3597291023,v1:172.21.15.67:6834/3597291023] conn(0x5631eb59c280 0x5631eb59e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0df8ff9640 10 client.6897 ms_handle_connect on v2:172.21.15.67:6832/3597291023 2024-09-19T05:38:28.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e1de02640 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.67:6832/3597291023,v1:172.21.15.67:6834/3597291023] conn(0x5631eb59c280 0x5631eb59e670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dba9754a360478d8 server_cookie=36f385c77fda7dd5 in_seq=0 out_seq=0 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4257489084 <== mds.0 v2:172.21.15.67:6832/3597291023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631eb32cc00 con 0x5631eb59c280 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0df8ff9640 10 client.6897 handle_command_reply: tid=0 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 client.6897 shutdown 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 -- 172.21.15.67:0/4257489084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb549330 msgr2=0x5631eb54f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb549330 0x5631eb54f230 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f0e1806ff10 tx=0x7f0e100159b0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 -- 172.21.15.67:0/4257489084 shutdown_connections 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb549330 0x5631eb54f230 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.67:6832/3597291023,v1:172.21.15.67:6834/3597291023] conn(0x5631eb59c280 0x5631eb59e670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb58e440 0x5631eb54ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 --2- 172.21.15.67:0/4257489084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58db20 0x5631eb548df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0df8ff9640 0 client.6897 ms_handle_reset on v2:172.21.15.67:6832/3597291023 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 -- 172.21.15.67:0/4257489084 >> 172.21.15.67:0/4257489084 conn(0x5631eb544290 msgr2=0x5631eb542d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:28.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 -- 172.21.15.67:0/4257489084 shutdown_connections 2024-09-19T05:38:28.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 1 -- 172.21.15.67:0/4257489084 wait complete. 2024-09-19T05:38:28.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.416+0000 7f0e23122000 20 client.6897 trim_cache size 0 max 16384 2024-09-19T05:38:28.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.432+0000 7f0e23122000 1 Processor -- start 2024-09-19T05:38:28.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.432+0000 7f0e23122000 1 -- start start 2024-09-19T05:38:28.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb549330 0x5631eb58ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58db20 0x5631eb58d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58e440 0x5631eb59e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0e18200820 con 0x5631eb58db20 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0e181ffbb0 con 0x5631eb549330 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0e182001d0 con 0x5631eb58e440 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1d601640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58db20 0x5631eb58d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1d601640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58db20 0x5631eb58d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44708/0 (socket says 172.21.15.67:44708) 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1d601640 1 -- 172.21.15.67:0/27518522 learned_addr learned my addr 172.21.15.67:0/27518522 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1d601640 1 -- 172.21.15.67:0/27518522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58e440 msgr2=0x5631eb59e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1d601640 1 --2- 172.21.15.67:0/27518522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58e440 0x5631eb59e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1d601640 1 -- 172.21.15.67:0/27518522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb549330 msgr2=0x5631eb58ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1d601640 1 --2- 172.21.15.67:0/27518522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb549330 0x5631eb58ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1d601640 1 -- 172.21.15.67:0/27518522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631eb319fd0 con 0x5631eb58db20 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1d601640 1 --2- 172.21.15.67:0/27518522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58db20 0x5631eb58d200 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f0e0801c8c0 tx=0x7f0e080a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facaf36dd93f7b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0dfaffd640 1 -- 172.21.15.67:0/27518522 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080ca070 con 0x5631eb58db20 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0dfaffd640 1 -- 172.21.15.67:0/27518522 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e080a7890 con 0x5631eb58db20 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0dfaffd640 1 -- 172.21.15.67:0/27518522 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080a7c40 con 0x5631eb58db20 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- 172.21.15.67:0/27518522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58db20 msgr2=0x5631eb58d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 --2- 172.21.15.67:0/27518522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58db20 0x5631eb58d200 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f0e0801c8c0 tx=0x7f0e080a7000 comp rx=0 tx=0).stop 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- 172.21.15.67:0/27518522 shutdown_connections 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 --2- 172.21.15.67:0/27518522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58e440 0x5631eb59e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 --2- 172.21.15.67:0/27518522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58db20 0x5631eb58d200 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 --2- 172.21.15.67:0/27518522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb549330 0x5631eb58ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- 172.21.15.67:0/27518522 >> 172.21.15.67:0/27518522 conn(0x5631eb544290 msgr2=0x5631eb5485f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- 172.21.15.67:0/27518522 shutdown_connections 2024-09-19T05:38:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- 172.21.15.67:0/27518522 wait complete. 2024-09-19T05:38:28.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- start start 2024-09-19T05:38:28.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 Processor -- start 2024-09-19T05:38:28.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb549330 0x5631eb5a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58db20 0x5631eb5bc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb5bcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5631eb391f80 con 0x5631eb58e440 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5631eb34aca0 con 0x5631eb549330 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5631eb3972a0 con 0x5631eb58db20 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e23122000 10 client.0 _ll_register_callbacks cb 0x7f0e10001340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1e603640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb5bcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1e603640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb5bcea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44716/0 (socket says 172.21.15.67:44716) 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1e603640 1 -- 172.21.15.67:0/4040905414 learned_addr learned my addr 172.21.15.67:0/4040905414 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1d601640 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58db20 0x5631eb5bc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.436+0000 7f0e1de02640 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb549330 0x5631eb5a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e1e603640 1 -- 172.21.15.67:0/4040905414 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58db20 msgr2=0x5631eb5bc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e1e603640 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58db20 0x5631eb5bc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e1e603640 1 -- 172.21.15.67:0/4040905414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb549330 msgr2=0x5631eb5a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e1e603640 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb549330 0x5631eb5a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e1e603640 1 -- 172.21.15.67:0/4040905414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631eb415750 con 0x5631eb58e440 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e1e603640 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb5bcea0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0e1001bee0 tx=0x7f0e10001dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6768233c2e5bbeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0df8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4040905414 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1001b350 con 0x5631eb58e440 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4040905414 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f0e1001b4f0 con 0x5631eb58e440 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 -- 172.21.15.67:0/4040905414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e080a7890 con 0x5631eb58e440 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4040905414 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f0e1003a050 con 0x5631eb58e440 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 10 client.6903 fetch_fsmap learned FSMap version 52 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 -- 172.21.15.67:0/4040905414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5631eb320a30 con 0x5631eb58e440 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4040905414 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e080a7890 con 0x5631eb58e440 2024-09-19T05:38:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4040905414 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7f0e1003d020 con 0x5631eb58e440 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 10 client.6903 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 10 client.6903 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 20 client.6903 populate_metadata read hostname 'smithi067' 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.67:6832/3597291023,v1:172.21.15.67:6834/3597291023] conn(0x5631eb5bd3e0 0x5631eb600e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 4 client.6903 mds_command: new command op to 6741 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 -- 172.21.15.67:0/4040905414 --> [v2:172.21.15.67:6832/3597291023,v1:172.21.15.67:6834/3597291023] -- command(tid 0: {"prefix": "status"}) -- 0x5631eb3a03a0 con 0x5631eb5bd3e0 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e1de02640 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.67:6832/3597291023,v1:172.21.15.67:6834/3597291023] conn(0x5631eb5bd3e0 0x5631eb600e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0df8ff9640 10 client.6903 ms_handle_connect on v2:172.21.15.67:6832/3597291023 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e1de02640 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.67:6832/3597291023,v1:172.21.15.67:6834/3597291023] conn(0x5631eb5bd3e0 0x5631eb600e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f44a7432b714c55 server_cookie=2e281ba75dbf6790 in_seq=0 out_seq=0 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0df8ff9640 1 -- 172.21.15.67:0/4040905414 <== mds.0 v2:172.21.15.67:6832/3597291023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5631eb3a03a0 con 0x5631eb5bd3e0 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0df8ff9640 10 client.6903 handle_command_reply: tid=0 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 client.6903 shutdown 2024-09-19T05:38:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 -- 172.21.15.67:0/4040905414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 msgr2=0x5631eb5bcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb5bcea0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0e1001bee0 tx=0x7f0e10001dd0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 -- 172.21.15.67:0/4040905414 shutdown_connections 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631eb58e440 0x5631eb5bcea0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631eb58db20 0x5631eb5bc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.67:6832/3597291023,v1:172.21.15.67:6834/3597291023] conn(0x5631eb5bd3e0 0x5631eb600e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 --2- 172.21.15.67:0/4040905414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631eb549330 0x5631eb5a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0df8ff9640 0 client.6903 ms_handle_reset on v2:172.21.15.67:6832/3597291023 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 -- 172.21.15.67:0/4040905414 >> 172.21.15.67:0/4040905414 conn(0x5631eb544290 msgr2=0x5631eb58bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 -- 172.21.15.67:0/4040905414 shutdown_connections 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 1 -- 172.21.15.67:0/4040905414 wait complete. 2024-09-19T05:38:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e23122000 20 client.6903 trim_cache size 0 max 16384 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 6741, 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 10.286157917000001, 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 52, 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 85, 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 85, 2024-09-19T05:38:28.451 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 15.280894833 2024-09-19T05:38:28.452 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:38:28.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 -- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0dfc0678f0 msgr2=0x7f0dfc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0dfc0678f0 0x7f0dfc069db0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0e080ad000 tx=0x7f0e080b2040 comp rx=0 tx=0).stop 2024-09-19T05:38:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 -- 172.21.15.67:0/1451433603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 msgr2=0x7f0e18151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 0x7f0e18151b50 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f0e14011610 tx=0x7f0e14011ad0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 -- 172.21.15.67:0/1451433603 shutdown_connections 2024-09-19T05:38:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18073410 0x7f0e1814ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0dfc0678f0 0x7f0dfc069db0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e18145130 0x7f0e18072ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 --2- 172.21.15.67:0/1451433603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e04004810 0x7f0e18151b50 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 -- 172.21.15.67:0/1451433603 >> 172.21.15.67:0/1451433603 conn(0x7f0e180d0080 msgr2=0x7f0e1815c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 -- 172.21.15.67:0/1451433603 shutdown_connections 2024-09-19T05:38:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.440+0000 7f0e20066640 1 -- 172.21.15.67:0/1451433603 wait complete. 2024-09-19T05:38:28.461 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:38:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b76a05640 1 Processor -- start 2024-09-19T05:38:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b76a05640 1 -- start start 2024-09-19T05:38:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b76a05640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b70072590 0x7f1b70166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b76a05640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b700b3860 con 0x7f1b7015b1e0 2024-09-19T05:38:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b76a05640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b700b3b40 con 0x7f1b700b4900 2024-09-19T05:38:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b76a05640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7015b5c0 con 0x7f1b70072590 2024-09-19T05:38:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1b7015b1e0 0x7f1b700b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42552/0 (socket says 172.21.15.67:42552) 2024-09-19T05:38:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6ffff640 1 -- 172.21.15.67:0/2206475390 learned_addr learned my addr 172.21.15.67:0/2206475390 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b74fa2640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b70072590 0x7f1b70166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489300721 0 0) 0x7f1b700b3860 con 0x7f1b7015b1e0 2024-09-19T05:38:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b58003530 con 0x7f1b7015b1e0 2024-09-19T05:38:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 524673197 0 0) 0x7f1b58003530 con 0x7f1b7015b1e0 2024-09-19T05:38:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b70072590 msgr2=0x7f1b70166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b70072590 0x7f1b70166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 >> v1:172.21.15.97:6789/0 conn(0x7f1b700b4900 legacy=0x7f1b70071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b700b3e20 con 0x7f1b7015b1e0 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1b60001680 con 0x7f1b7015b1e0 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 >> v1:172.21.15.67:6789/0 conn(0x7f1b7015b1e0 legacy=0x7f1b700b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b580039f0 0x7f1b58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b580043a0 0x7f1b58004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b70072590 0x7f1b580050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7015b5c0 con 0x7f1b580043a0 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5800ba00 con 0x7f1b580039f0 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5800bc00 con 0x7f1b70072590 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6f7fe640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b580043a0 0x7f1b58004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b74fa2640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b70072590 0x7f1b580050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6ffff640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b580039f0 0x7f1b58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6f7fe640 1 -- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b70072590 msgr2=0x7f1b580050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6f7fe640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b70072590 0x7f1b580050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6f7fe640 1 -- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b580039f0 msgr2=0x7f1b58003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6f7fe640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b580039f0 0x7f1b58003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.572+0000 7f1b6f7fe640 1 -- 172.21.15.67:0/2206475390 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b58003530 con 0x7f1b580043a0 2024-09-19T05:38:28.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b6f7fe640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b580043a0 0x7f1b58004870 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f1b64001860 tx=0x7f1b6401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e1989c30505453 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b640b5070 con 0x7f1b580043a0 2024-09-19T05:38:28.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b640a8890 con 0x7f1b580043a0 2024-09-19T05:38:28.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b6effd640 1 -- 172.21.15.67:0/2206475390 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64001460 con 0x7f1b580043a0 2024-09-19T05:38:28.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b76a05640 1 -- 172.21.15.67:0/2206475390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b580043a0 msgr2=0x7f1b58004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b76a05640 1 --2- 172.21.15.67:0/2206475390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b580043a0 0x7f1b58004870 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f1b64001860 tx=0x7f1b6401ec70 comp rx=0 tx=0).stop 2024-09-19T05:38:28.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b74fa2640 1 -- 172.21.15.67:0/2206475390 reap_dead start 2024-09-19T05:38:28.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b76a05640 1 -- 172.21.15.67:0/2206475390 shutdown_connections 2024-09-19T05:38:28.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b76a05640 1 -- 172.21.15.67:0/2206475390 >> 172.21.15.67:0/2206475390 conn(0x7f1b700d0080 msgr2=0x7f1b700d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:28.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b76a05640 1 -- 172.21.15.67:0/2206475390 shutdown_connections 2024-09-19T05:38:28.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b76a05640 1 -- 172.21.15.67:0/2206475390 wait complete. 2024-09-19T05:38:28.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b76a05640 1 Processor -- start 2024-09-19T05:38:28.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.576+0000 7f1b76a05640 1 -- start start 2024-09-19T05:38:28.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b76a05640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b580043a0 0x7f1b7015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b76a05640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b701f3e10 0x7f1b701560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b76a05640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b701f4270 0x7f1b70156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b76a05640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b70072a20 con 0x7f1b701f4270 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b76a05640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b700b43e0 con 0x7f1b580043a0 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b76a05640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b70072ba0 con 0x7f1b701f3e10 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b74fa2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b701f4270 0x7f1b70156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b74fa2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b701f4270 0x7f1b70156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44728/0 (socket says 172.21.15.67:44728) 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b74fa2640 1 -- 172.21.15.67:0/3050089017 learned_addr learned my addr 172.21.15.67:0/3050089017 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b6ffff640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b580043a0 0x7f1b7015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b6f7fe640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b701f3e10 0x7f1b701560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b74fa2640 1 -- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b701f3e10 msgr2=0x7f1b701560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b74fa2640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b701f3e10 0x7f1b701560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b74fa2640 1 -- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b580043a0 msgr2=0x7f1b7015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b74fa2640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b580043a0 0x7f1b7015d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b74fa2640 1 -- 172.21.15.67:0/3050089017 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7015c430 con 0x7f1b701f4270 2024-09-19T05:38:28.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b74fa2640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b701f4270 0x7f1b70156630 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1b700ad8a0 tx=0x7f1b680115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b6cff9640 1 -- 172.21.15.67:0/3050089017 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680039a0 con 0x7f1b701f4270 2024-09-19T05:38:28.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b6cff9640 1 -- 172.21.15.67:0/3050089017 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6801b070 con 0x7f1b701f4270 2024-09-19T05:38:28.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b6cff9640 1 -- 172.21.15.67:0/3050089017 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68003ba0 con 0x7f1b701f4270 2024-09-19T05:38:28.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b76a05640 1 -- 172.21.15.67:0/3050089017 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7015c770 con 0x7f1b701f4270 2024-09-19T05:38:28.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b76a05640 1 -- 172.21.15.67:0/3050089017 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7015cfb0 con 0x7f1b701f4270 2024-09-19T05:38:28.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b76a05640 1 -- 172.21.15.67:0/3050089017 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7015d1b0 con 0x7f1b701f4270 2024-09-19T05:38:28.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b6cff9640 1 -- 172.21.15.67:0/3050089017 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b68004030 con 0x7f1b701f4270 2024-09-19T05:38:28.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b6cff9640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b5c0678c0 0x7f1b5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b6cff9640 1 -- 172.21.15.67:0/3050089017 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f1b68086870 con 0x7f1b701f4270 2024-09-19T05:38:28.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.580+0000 7f1b6ffff640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b5c0678c0 0x7f1b5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.584+0000 7f1b6ffff640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b5c0678c0 0x7f1b5c069d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1b60001ec0 tx=0x7f1b60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.584+0000 7f1b6cff9640 1 -- 172.21.15.67:0/3050089017 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1b7015d1b0 con 0x7f1b701f4270 2024-09-19T05:38:28.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.776+0000 7f1b76a05640 1 -- 172.21.15.67:0/3050089017 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1b70071e80 con 0x7f1b701f4270 2024-09-19T05:38:28.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.776+0000 7f1b6cff9640 1 -- 172.21.15.67:0/3050089017 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7f1b68025020 con 0x7f1b701f4270 2024-09-19T05:38:28.782 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:38:28.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 -- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b5c0678c0 msgr2=0x7f1b5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b5c0678c0 0x7f1b5c069d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1b60001ec0 tx=0x7f1b60009040 comp rx=0 tx=0).stop 2024-09-19T05:38:28.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 -- 172.21.15.67:0/3050089017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b701f4270 msgr2=0x7f1b70156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b701f4270 0x7f1b70156630 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1b700ad8a0 tx=0x7f1b680115a0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 -- 172.21.15.67:0/3050089017 shutdown_connections 2024-09-19T05:38:28.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b701f4270 0x7f1b70156630 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b5c0678c0 0x7f1b5c069d80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b701f3e10 0x7f1b701560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 --2- 172.21.15.67:0/3050089017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b580043a0 0x7f1b7015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 -- 172.21.15.67:0/3050089017 >> 172.21.15.67:0/3050089017 conn(0x7f1b700d0080 msgr2=0x7f1b700ae180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:28.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 -- 172.21.15.67:0/3050089017 shutdown_connections 2024-09-19T05:38:28.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:28.780+0000 7f1b76a05640 1 -- 172.21.15.67:0/3050089017 wait complete. 2024-09-19T05:38:28.799 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:38:28.799 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:38:28.799 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:38:28.799 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:38:28.799 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:28.799 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:38:28.799 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:38:28.799 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:38:28.799 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:38:28.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:28.800 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:38:28.806 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:38:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:38:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:38:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:38:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:28.807 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42196sec preferred_lft 42196sec 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:38:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:38:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:28.810 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:38:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:38:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:28.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:28.810 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:38:28.860 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:38:28.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:28.862 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:38:28.911 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:38:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:38:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:38:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:38:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:38:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:38:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:38:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:38:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:38:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:38:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:38:28.913 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:38:28.913 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:38:28.913 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:38:28.913 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:38:28.913 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:38:28.913 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:38:28.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:38:29.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:29.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:29.040 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:38:29.046 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:38:29.046 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:38:29.046 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:38:29.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:29.047 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:38:29.103 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:38:29.103 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:38:29.103 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:29.151 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:38:29.151 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:38:29.152 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:29.199 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:38:29.257 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:38:29.308 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:38:29.308 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:38:29.308 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:38:29.308 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:38:29.309 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:38:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:29.311 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:29.311 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:29.311 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:29.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:29.312 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:38:29.360 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:38:29.361 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:38:29.404 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:38:29.419 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:38:29.467 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:38:29.467 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:38:29.468 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:38:29.469 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:38:29.470 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:38:29.470 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:38:29.470 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:29.470 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:29.470 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:29.470 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:29.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:29.471 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:38:29.483 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:38:29.480+0000 7fc69e4bb580 -1 init, newargv = 0x5641720e4600 newargc=15 2024-09-19T05:38:29.483 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[56359]: starting ceph client 2024-09-19T05:38:29.489 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[56359]: starting fuse 2024-09-19T05:38:30.587 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:38:30.604 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:38:30.652 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:38:30.652 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:38:30.652 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:38:30.652 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:38:30.652 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:38:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:30.654 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:30.655 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:30.655 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:30.655 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:30.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:30.656 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:38:30.703 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:38:30.703 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:38:30.703 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:38:30.704 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:38:30.705 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:38:30.831 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.56359.asok 2024-09-19T05:38:30.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:30.844 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.56359.asok 2024-09-19T05:38:30.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:30.845 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.56359.asok status 2024-09-19T05:38:31.005 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:38:31.005 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:38:31.005 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:38:31.005 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "56359", 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 6918, 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:38:31.006 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 6918 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3816298047 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3816298047 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:31.007 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.6918 192.168.0.1:0/3816298047", 2024-09-19T05:38:31.008 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/3816298047", 2024-09-19T05:38:31.008 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:38:31.008 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 52, 2024-09-19T05:38:31.008 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 85, 2024-09-19T05:38:31.008 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:38:31.008 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:38:31.008 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:38:31.008 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:38:31.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:31.020 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:38:31.020 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:31.027 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:38:31.027 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:31.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:31.027 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:31.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:31.084 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-09-19T05:38:31.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:31.142 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-09-19T05:38:31.197 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:38:31.197 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:38:31.197 DEBUG:teuthology.orchestra.run.smithi067:> import stat 2024-09-19T05:38:31.197 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:38:31.197 DEBUG:teuthology.orchestra.run.smithi067:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-09-19T05:38:31.197 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:38:31.303 INFO:teuthology.orchestra.run.smithi067.stdout:1099511627776 2024-09-19T05:38:31.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:31.313 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:38:31.313 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:31.361 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:38:31.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f7562f06640 1 Processor -- start 2024-09-19T05:38:31.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f7562f06640 1 -- start start 2024-09-19T05:38:31.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f7562f06640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f755c0b2fd0 0x7f755c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f7562f06640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f755c0726b0 0x7f755c06ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f7562f06640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f755c0b4420 con 0x7f755c15e330 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f7562f06640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f755c0acfb0 con 0x7f755c0726b0 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f7562f06640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f755c0b3ef0 con 0x7f755c0b2fd0 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f75614a3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f755c0726b0 0x7f755c06ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f7560ca2640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f755c15e330 0x7f755c071fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42556/0 (socket says 172.21.15.67:42556) 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f7560ca2640 1 -- 172.21.15.67:0/3297294324 learned_addr learned my addr 172.21.15.67:0/3297294324 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.532+0000 7f755bfff640 1 --2- 172.21.15.67:0/3297294324 >> v2:172.21.15.97:3300/0 conn(0x7f755c0b2fd0 0x7f755c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f755b7fe640 1 -- 172.21.15.67:0/3297294324 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3911437647 0 0) 0x7f755c0b4420 con 0x7f755c15e330 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f755b7fe640 1 -- 172.21.15.67:0/3297294324 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7548003530 con 0x7f755c15e330 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f75614a3640 1 -- 172.21.15.67:0/3297294324 >> v2:172.21.15.97:3300/0 conn(0x7f755c0b2fd0 msgr2=0x7f755c06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f75614a3640 1 --2- 172.21.15.67:0/3297294324 >> v2:172.21.15.97:3300/0 conn(0x7f755c0b2fd0 0x7f755c06e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f75614a3640 1 -- 172.21.15.67:0/3297294324 >> v1:172.21.15.67:6789/0 conn(0x7f755c15e330 legacy=0x7f755c071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f75614a3640 1 -- 172.21.15.67:0/3297294324 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755c0b4140 con 0x7f755c0726b0 2024-09-19T05:38:31.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f75614a3640 1 --2- 172.21.15.67:0/3297294324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 0x7f755c06ec30 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f755c0b2d60 tx=0x7f754c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e120eb7eec1d047 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f755b7fe640 1 -- 172.21.15.67:0/3297294324 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c0ab650 con 0x7f755c0726b0 2024-09-19T05:38:31.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f755b7fe640 1 -- 172.21.15.67:0/3297294324 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754c0b0070 con 0x7f755c0726b0 2024-09-19T05:38:31.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f755b7fe640 1 -- 172.21.15.67:0/3297294324 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c0aba10 con 0x7f755c0726b0 2024-09-19T05:38:31.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f7562f06640 1 -- 172.21.15.67:0/3297294324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 msgr2=0x7f755c06ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f7562f06640 1 --2- 172.21.15.67:0/3297294324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 0x7f755c06ec30 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f755c0b2d60 tx=0x7f754c01c450 comp rx=0 tx=0).stop 2024-09-19T05:38:31.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f7562f06640 1 -- 172.21.15.67:0/3297294324 shutdown_connections 2024-09-19T05:38:31.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f7562f06640 1 --2- 172.21.15.67:0/3297294324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 0x7f755c06ec30 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f7562f06640 1 --2- 172.21.15.67:0/3297294324 >> v2:172.21.15.97:3300/0 conn(0x7f755c0b2fd0 0x7f755c06e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.536+0000 7f7562f06640 1 -- 172.21.15.67:0/3297294324 >> 172.21.15.67:0/3297294324 conn(0x7f755c0d0080 msgr2=0x7f755c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:31.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 -- 172.21.15.67:0/3297294324 shutdown_connections 2024-09-19T05:38:31.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 -- 172.21.15.67:0/3297294324 wait complete. 2024-09-19T05:38:31.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 Processor -- start 2024-09-19T05:38:31.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 -- start start 2024-09-19T05:38:31.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 0x7f755c152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f755c15e330 0x7f755c15c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f755c14a730 0x7f755c14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f755c0cfe40 con 0x7f755c0726b0 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f755c0cfcc0 con 0x7f755c14a730 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f755c16b310 con 0x7f755c15e330 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7560ca2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 0x7f755c152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7560ca2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 0x7f755c152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44754/0 (socket says 172.21.15.67:44754) 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7560ca2640 1 -- 172.21.15.67:0/3846268444 learned_addr learned my addr 172.21.15.67:0/3846268444 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f755bfff640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f755c15e330 0x7f755c15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f75614a3640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f755c14a730 0x7f755c14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7560ca2640 1 -- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f755c15e330 msgr2=0x7f755c15c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7560ca2640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f755c15e330 0x7f755c15c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7560ca2640 1 -- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f755c14a730 msgr2=0x7f755c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7560ca2640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f755c14a730 0x7f755c14abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7560ca2640 1 -- 172.21.15.67:0/3846268444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755c14bf10 con 0x7f755c0726b0 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f755bfff640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f755c15e330 0x7f755c15c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f75614a3640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f755c14a730 0x7f755c14abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7560ca2640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 0x7f755c152480 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f755400cad0 tx=0x7f755400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f75597fa640 1 -- 172.21.15.67:0/3846268444 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554017070 con 0x7f755c0726b0 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f75597fa640 1 -- 172.21.15.67:0/3846268444 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755400ac30 con 0x7f755c0726b0 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 -- 172.21.15.67:0/3846268444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f755c14c1f0 con 0x7f755c0726b0 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f75597fa640 1 -- 172.21.15.67:0/3846268444 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554012400 con 0x7f755c0726b0 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 -- 172.21.15.67:0/3846268444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f755c1604c0 con 0x7f755c0726b0 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.540+0000 7f7562f06640 1 -- 172.21.15.67:0/3846268444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f755c071fa0 con 0x7f755c0726b0 2024-09-19T05:38:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.544+0000 7f75597fa640 1 -- 172.21.15.67:0/3846268444 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f755401a070 con 0x7f755c0726b0 2024-09-19T05:38:31.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.544+0000 7f75597fa640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f753c0678c0 0x7f753c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.544+0000 7f75597fa640 1 -- 172.21.15.67:0/3846268444 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f7554085c00 con 0x7f755c0726b0 2024-09-19T05:38:31.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.544+0000 7f755bfff640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f753c0678c0 0x7f753c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.544+0000 7f755bfff640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f753c0678c0 0x7f753c069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f755c0cf600 tx=0x7f7544008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.548+0000 7f75597fa640 1 -- 172.21.15.67:0/3846268444 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f755408c080 con 0x7f755c0726b0 2024-09-19T05:38:31.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.724+0000 7f7562f06640 1 -- 172.21.15.67:0/3846268444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f755c161ce0 con 0x7f755c0726b0 2024-09-19T05:38:31.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.724+0000 7f75597fa640 1 -- 172.21.15.67:0/3846268444 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v85) ==== 80+0+0 (secure 0 0 0) 0x7f75540565b0 con 0x7f755c0726b0 2024-09-19T05:38:31.729 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:38:31.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 -- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f753c0678c0 msgr2=0x7f753c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f753c0678c0 0x7f753c069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f755c0cf600 tx=0x7f7544008040 comp rx=0 tx=0).stop 2024-09-19T05:38:31.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 -- 172.21.15.67:0/3846268444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 msgr2=0x7f755c152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 0x7f755c152480 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f755400cad0 tx=0x7f755400cf90 comp rx=0 tx=0).stop 2024-09-19T05:38:31.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 -- 172.21.15.67:0/3846268444 shutdown_connections 2024-09-19T05:38:31.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f755c14a730 0x7f755c14abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f753c0678c0 0x7f753c069d80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f755c15e330 0x7f755c15c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 --2- 172.21.15.67:0/3846268444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c0726b0 0x7f755c152480 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 -- 172.21.15.67:0/3846268444 >> 172.21.15.67:0/3846268444 conn(0x7f755c0d0080 msgr2=0x7f755c0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:31.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 -- 172.21.15.67:0/3846268444 shutdown_connections 2024-09-19T05:38:31.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.728+0000 7f7562f06640 1 -- 172.21.15.67:0/3846268444 wait complete. 2024-09-19T05:38:31.748 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:38:31.749 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:31.755 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:38:31.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f5745740640 1 Processor -- start 2024-09-19T05:38:31.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f5745740640 1 -- start start 2024-09-19T05:38:31.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f5745740640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015c030 0x7f574006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f5745740640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f574015d1d0 0x7f57400b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f5745740640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f57400b3510 0x7f574006f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f5745740640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f574006e3c0 con 0x7f57400b3510 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f5745740640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f574006e6a0 con 0x7f574015d1d0 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f5745740640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f574006e980 con 0x7f574015c030 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f57400b3510 0x7f574006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f57400b3510 0x7f574006f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44770/0 (socket says 172.21.15.67:44770) 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573f7fe640 1 -- 172.21.15.67:0/2942831017 learned_addr learned my addr 172.21.15.67:0/2942831017 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573effd640 1 --2- 172.21.15.67:0/2942831017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015c030 0x7f574006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573e7fc640 1 --2- 172.21.15.67:0/2942831017 >> v2:172.21.15.97:3300/0 conn(0x7f574015d1d0 0x7f57400b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573f7fe640 1 -- 172.21.15.67:0/2942831017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015c030 msgr2=0x7f574006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573f7fe640 1 --2- 172.21.15.67:0/2942831017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015c030 0x7f574006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573f7fe640 1 -- 172.21.15.67:0/2942831017 >> v2:172.21.15.97:3300/0 conn(0x7f574015d1d0 msgr2=0x7f57400b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:31.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573f7fe640 1 --2- 172.21.15.67:0/2942831017 >> v2:172.21.15.97:3300/0 conn(0x7f574015d1d0 0x7f57400b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573f7fe640 1 -- 172.21.15.67:0/2942831017 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574006ec60 con 0x7f57400b3510 2024-09-19T05:38:31.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573effd640 1 --2- 172.21.15.67:0/2942831017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015c030 0x7f574006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:31.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.924+0000 7f573e7fc640 1 --2- 172.21.15.67:0/2942831017 >> v2:172.21.15.97:3300/0 conn(0x7f574015d1d0 0x7f57400b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:31.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f573f7fe640 1 --2- 172.21.15.67:0/2942831017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 0x7f574006f460 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f574006da30 tx=0x7f573001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db9e27bd6a2a4a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f573dffb640 1 -- 172.21.15.67:0/2942831017 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57300b1070 con 0x7f57400b3510 2024-09-19T05:38:31.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f573dffb640 1 -- 172.21.15.67:0/2942831017 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57300ac620 con 0x7f57400b3510 2024-09-19T05:38:31.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f573dffb640 1 -- 172.21.15.67:0/2942831017 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57300ac9f0 con 0x7f57400b3510 2024-09-19T05:38:31.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f5745740640 1 -- 172.21.15.67:0/2942831017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 msgr2=0x7f574006f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f5745740640 1 --2- 172.21.15.67:0/2942831017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 0x7f574006f460 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f574006da30 tx=0x7f573001c4f0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f5745740640 1 -- 172.21.15.67:0/2942831017 shutdown_connections 2024-09-19T05:38:31.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f5745740640 1 --2- 172.21.15.67:0/2942831017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 0x7f574006f460 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f5745740640 1 --2- 172.21.15.67:0/2942831017 >> v2:172.21.15.97:3300/0 conn(0x7f574015d1d0 0x7f57400b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f5745740640 1 --2- 172.21.15.67:0/2942831017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015c030 0x7f574006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f5745740640 1 -- 172.21.15.67:0/2942831017 >> 172.21.15.67:0/2942831017 conn(0x7f57400d0080 msgr2=0x7f57400d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:31.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f5745740640 1 -- 172.21.15.67:0/2942831017 shutdown_connections 2024-09-19T05:38:31.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.928+0000 7f5745740640 1 -- 172.21.15.67:0/2942831017 wait complete. 2024-09-19T05:38:31.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 Processor -- start 2024-09-19T05:38:31.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 -- start start 2024-09-19T05:38:31.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 0x7f5740166aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574015c030 0x7f5740073a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015d1d0 0x7f5740151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f574015fec0 con 0x7f57400b3510 2024-09-19T05:38:31.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f574015fd40 con 0x7f574015c030 2024-09-19T05:38:31.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5740160040 con 0x7f574015d1d0 2024-09-19T05:38:31.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 0x7f5740166aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 0x7f5740166aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44774/0 (socket says 172.21.15.67:44774) 2024-09-19T05:38:31.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573effd640 1 -- 172.21.15.67:0/2076327736 learned_addr learned my addr 172.21.15.67:0/2076327736 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:31.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573f7fe640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015d1d0 0x7f5740151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573e7fc640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574015c030 0x7f5740073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573effd640 1 -- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015d1d0 msgr2=0x7f5740151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573effd640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015d1d0 0x7f5740151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573effd640 1 -- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574015c030 msgr2=0x7f5740073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573effd640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574015c030 0x7f5740073a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573effd640 1 -- 172.21.15.67:0/2076327736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5740165ce0 con 0x7f57400b3510 2024-09-19T05:38:31.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573f7fe640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015d1d0 0x7f5740151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:31.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f573effd640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 0x7f5740166aa0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f573800cf60 tx=0x7f573800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f57377fe640 1 -- 172.21.15.67:0/2076327736 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573801a070 con 0x7f57400b3510 2024-09-19T05:38:31.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f57377fe640 1 -- 172.21.15.67:0/2076327736 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f573800d840 con 0x7f57400b3510 2024-09-19T05:38:31.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 -- 172.21.15.67:0/2076327736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5740165fc0 con 0x7f57400b3510 2024-09-19T05:38:31.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f57377fe640 1 -- 172.21.15.67:0/2076327736 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573800dc10 con 0x7f57400b3510 2024-09-19T05:38:31.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 -- 172.21.15.67:0/2076327736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57401516d0 con 0x7f57400b3510 2024-09-19T05:38:31.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f5745740640 1 -- 172.21.15.67:0/2076327736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f574006dde0 con 0x7f57400b3510 2024-09-19T05:38:31.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.932+0000 7f57377fe640 1 -- 172.21.15.67:0/2076327736 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f573801d070 con 0x7f57400b3510 2024-09-19T05:38:31.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.936+0000 7f57377fe640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57240678c0 0x7f5724069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.936+0000 7f57377fe640 1 -- 172.21.15.67:0/2076327736 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f5738086640 con 0x7f57400b3510 2024-09-19T05:38:31.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.936+0000 7f573e7fc640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57240678c0 0x7f5724069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.936+0000 7f573e7fc640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57240678c0 0x7f5724069d80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5728006fd0 tx=0x7f5728008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:31.940+0000 7f57377fe640 1 -- 172.21.15.67:0/2076327736 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5738056900 con 0x7f57400b3510 2024-09-19T05:38:32.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.116+0000 7f5745740640 1 -- 172.21.15.67:0/2076327736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f57400d0f20 con 0x7f57400b3510 2024-09-19T05:38:32.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f57377fe640 1 -- 172.21.15.67:0/2076327736 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v85) ==== 80+0+0 (secure 0 0 0) 0x7f573805ac00 con 0x7f57400b3510 2024-09-19T05:38:32.123 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:38:32.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 -- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57240678c0 msgr2=0x7f5724069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57240678c0 0x7f5724069d80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5728006fd0 tx=0x7f5728008040 comp rx=0 tx=0).stop 2024-09-19T05:38:32.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 -- 172.21.15.67:0/2076327736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 msgr2=0x7f5740166aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 0x7f5740166aa0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f573800cf60 tx=0x7f573800cf90 comp rx=0 tx=0).stop 2024-09-19T05:38:32.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 -- 172.21.15.67:0/2076327736 shutdown_connections 2024-09-19T05:38:32.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57240678c0 0x7f5724069d80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f574015d1d0 0x7f5740151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574015c030 0x7f5740073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 --2- 172.21.15.67:0/2076327736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57400b3510 0x7f5740166aa0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 -- 172.21.15.67:0/2076327736 >> 172.21.15.67:0/2076327736 conn(0x7f57400d0080 msgr2=0x7f57400b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:32.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 -- 172.21.15.67:0/2076327736 shutdown_connections 2024-09-19T05:38:32.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.120+0000 7f5745740640 1 -- 172.21.15.67:0/2076327736 wait complete. 2024-09-19T05:38:32.171 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:38:32.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:32.171 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:32.182 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[56359]: fuse finished with error 0 and tester_r 0 2024-09-19T05:38:32.184 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:38:32.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:38:32.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:32.269 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:38:32.274 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561bea4640 1 Processor -- start 2024-09-19T05:38:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561bea4640 1 -- start start 2024-09-19T05:38:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561bea4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f561415e550 0x7f56140d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561bea4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f561409b5d0 0x7f56141613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561bea4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5614161920 0x7f561415e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561bea4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f56140d0970 con 0x7f5614161920 2024-09-19T05:38:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561bea4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f56140d0bc0 con 0x7f561415e550 2024-09-19T05:38:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561bea4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f56140d0ea0 con 0x7f561409b5d0 2024-09-19T05:38:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561a441640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5614161920 0x7f561415e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561a441640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5614161920 0x7f561415e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44778/0 (socket says 172.21.15.67:44778) 2024-09-19T05:38:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561a441640 1 -- 172.21.15.67:0/2894804306 learned_addr learned my addr 172.21.15.67:0/2894804306 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561a441640 1 -- 172.21.15.67:0/2894804306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f561409b5d0 msgr2=0x7f56141613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f5619c40640 1 --2- 172.21.15.67:0/2894804306 >> v2:172.21.15.97:3300/0 conn(0x7f561415e550 0x7f56140d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561943f640 1 --2- 172.21.15.67:0/2894804306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f561409b5d0 0x7f56141613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561a441640 1 --2- 172.21.15.67:0/2894804306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f561409b5d0 0x7f56141613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561a441640 1 -- 172.21.15.67:0/2894804306 >> v2:172.21.15.97:3300/0 conn(0x7f561415e550 msgr2=0x7f56140d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561a441640 1 --2- 172.21.15.67:0/2894804306 >> v2:172.21.15.97:3300/0 conn(0x7f561415e550 0x7f56140d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f561a441640 1 -- 172.21.15.67:0/2894804306 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56140d1180 con 0x7f5614161920 2024-09-19T05:38:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.432+0000 7f5619c40640 1 --2- 172.21.15.67:0/2894804306 >> v2:172.21.15.97:3300/0 conn(0x7f561415e550 0x7f56140d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561a441640 1 --2- 172.21.15.67:0/2894804306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5614161920 0x7f561415e930 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f56140737a0 tx=0x7f560c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37083bb61ef0205b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f5618c3e640 1 -- 172.21.15.67:0/2894804306 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c0a5840 con 0x7f5614161920 2024-09-19T05:38:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f5618c3e640 1 -- 172.21.15.67:0/2894804306 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560c0a59e0 con 0x7f5614161920 2024-09-19T05:38:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f5618c3e640 1 -- 172.21.15.67:0/2894804306 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c0a5db0 con 0x7f5614161920 2024-09-19T05:38:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 -- 172.21.15.67:0/2894804306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5614161920 msgr2=0x7f561415e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 --2- 172.21.15.67:0/2894804306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5614161920 0x7f561415e930 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f56140737a0 tx=0x7f560c01c9c0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 -- 172.21.15.67:0/2894804306 shutdown_connections 2024-09-19T05:38:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 --2- 172.21.15.67:0/2894804306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5614161920 0x7f561415e930 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 --2- 172.21.15.67:0/2894804306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f561409b5d0 0x7f56141613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 --2- 172.21.15.67:0/2894804306 >> v2:172.21.15.97:3300/0 conn(0x7f561415e550 0x7f56140d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 -- 172.21.15.67:0/2894804306 >> 172.21.15.67:0/2894804306 conn(0x7f56140b3d90 msgr2=0x7f56140b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 -- 172.21.15.67:0/2894804306 shutdown_connections 2024-09-19T05:38:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 -- 172.21.15.67:0/2894804306 wait complete. 2024-09-19T05:38:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 Processor -- start 2024-09-19T05:38:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 -- start start 2024-09-19T05:38:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f561409b5d0 0x7f56140c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f561415e550 0x7f56140b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5614161920 0x7f561415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f561409b9e0 con 0x7f561415e550 2024-09-19T05:38:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5614161d90 con 0x7f5614161920 2024-09-19T05:38:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561bea4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f561409bb60 con 0x7f561409b5d0 2024-09-19T05:38:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561943f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f561415e550 0x7f56140b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561943f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f561415e550 0x7f56140b7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44794/0 (socket says 172.21.15.67:44794) 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561943f640 1 -- 172.21.15.67:0/3898732756 learned_addr learned my addr 172.21.15.67:0/3898732756 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f5619c40640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f561409b5d0 0x7f56140c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561a441640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5614161920 0x7f561415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561943f640 1 -- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f561409b5d0 msgr2=0x7f56140c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561943f640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f561409b5d0 0x7f56140c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561943f640 1 -- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5614161920 msgr2=0x7f561415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561943f640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5614161920 0x7f561415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561943f640 1 -- 172.21.15.67:0/3898732756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56140c6ef0 con 0x7f561415e550 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561a441640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5614161920 0x7f561415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f561943f640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f561415e550 0x7f56140b7870 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f560400c5a0 tx=0x7f560400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.436+0000 7f560a7fc640 1 -- 172.21.15.67:0/3898732756 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604015070 con 0x7f561415e550 2024-09-19T05:38:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.440+0000 7f560a7fc640 1 -- 172.21.15.67:0/3898732756 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5604004220 con 0x7f561415e550 2024-09-19T05:38:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.440+0000 7f561bea4640 1 -- 172.21.15.67:0/3898732756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56140c71d0 con 0x7f561415e550 2024-09-19T05:38:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.440+0000 7f560a7fc640 1 -- 172.21.15.67:0/3898732756 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604003620 con 0x7f561415e550 2024-09-19T05:38:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.440+0000 7f561bea4640 1 -- 172.21.15.67:0/3898732756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56140c7790 con 0x7f561415e550 2024-09-19T05:38:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.440+0000 7f561bea4640 1 -- 172.21.15.67:0/3898732756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f561415f280 con 0x7f561415e550 2024-09-19T05:38:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.440+0000 7f560a7fc640 1 -- 172.21.15.67:0/3898732756 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56040037c0 con 0x7f561415e550 2024-09-19T05:38:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.440+0000 7f560a7fc640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55f80678c0 0x7f55f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.440+0000 7f560a7fc640 1 -- 172.21.15.67:0/3898732756 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f5604085bf0 con 0x7f561415e550 2024-09-19T05:38:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.440+0000 7f5619c40640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55f80678c0 0x7f55f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.440+0000 7f5619c40640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55f80678c0 0x7f55f8069d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5610006fd0 tx=0x7f5610008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:32.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.444+0000 7f560a7fc640 1 -- 172.21.15.67:0/3898732756 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f56040565a0 con 0x7f561415e550 2024-09-19T05:38:32.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.640+0000 7f561bea4640 1 -- 172.21.15.67:0/3898732756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56140c8bc0 con 0x7f561415e550 2024-09-19T05:38:32.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.640+0000 7f560a7fc640 1 -- 172.21.15.67:0/3898732756 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5222 (secure 0 0 0) 0x7f5604055ea0 con 0x7f561415e550 2024-09-19T05:38:32.646 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:32.647 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":52,"btime":"2024-09-19T05:38:21:175684+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/3972177199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3972177199},{"type":"v1","addr":"172.21.15.67:6835","nonce":3972177199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5441,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/600959636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":600959636},{"type":"v1","addr":"172.21.15.97:6835","nonce":600959636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2657621121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2657621121},{"type":"v1","addr":"172.21.15.97:6837","nonce":2657621121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:38:17.483070+0000","modified":"2024-09-19T05:38:20.537492+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6834/3597291023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3597291023},{"type":"v1","addr":"172.21.15.67:6834","nonce":3597291023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6741,"qdb_cluster":[6741]},"id":5}]} 2024-09-19T05:38:32.647 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 52 2024-09-19T05:38:32.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 -- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55f80678c0 msgr2=0x7f55f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55f80678c0 0x7f55f8069d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5610006fd0 tx=0x7f5610008040 comp rx=0 tx=0).stop 2024-09-19T05:38:32.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 -- 172.21.15.67:0/3898732756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f561415e550 msgr2=0x7f56140b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f561415e550 0x7f56140b7870 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f560400c5a0 tx=0x7f560400ca60 comp rx=0 tx=0).stop 2024-09-19T05:38:32.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 -- 172.21.15.67:0/3898732756 shutdown_connections 2024-09-19T05:38:32.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5614161920 0x7f561415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f561415e550 0x7f56140b7870 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55f80678c0 0x7f55f8069d80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 --2- 172.21.15.67:0/3898732756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f561409b5d0 0x7f56140c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 -- 172.21.15.67:0/3898732756 >> 172.21.15.67:0/3898732756 conn(0x7f56140b3d90 msgr2=0x7f56140b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:32.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 -- 172.21.15.67:0/3898732756 shutdown_connections 2024-09-19T05:38:32.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.644+0000 7f561bea4640 1 -- 172.21.15.67:0/3898732756 wait complete. 2024-09-19T05:38:32.667 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-19T05:38:32.824 INFO:teuthology.orchestra.run.smithi067.stdout:{"message":"","return_code":0} 2024-09-19T05:38:32.825 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-19T05:38:32.825 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:38:32.825 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:38:32.826 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:38:32.826 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:38:32.826 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:38:32.826 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:38:32.826 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:38:32.826 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:38:32.841 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:38:32.841 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:32.842 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:38:32.842 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:32.844 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:38:32.845 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:32.863 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:38:32.863 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:32.863 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-09-19T05:38:32.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49b72c080 1 Processor -- start 2024-09-19T05:38:32.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49b72c080 1 -- start start 2024-09-19T05:38:32.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49b72c080 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a2057e0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49b72c080 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a2058734a0 0x55a2057cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49b72c080 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a205873880 0x55a2057cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49b72c080 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a2056ed1b0 con 0x55a20579b540 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49b72c080 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a2057467b0 con 0x55a2058734a0 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49b72c080 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a2057e65b0 con 0x55a205873880 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49923f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a2057e0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49923f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a2057e0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44810/0 (socket says 172.21.15.67:44810) 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49923f640 1 -- 172.21.15.67:0/3762873390 learned_addr learned my addr 172.21.15.67:0/3762873390 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd498a3e640 1 --2- 172.21.15.67:0/3762873390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a2058734a0 0x55a2057cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd499a40640 1 --2- 172.21.15.67:0/3762873390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a205873880 0x55a2057cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49923f640 1 -- 172.21.15.67:0/3762873390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a205873880 msgr2=0x55a2057cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49923f640 1 --2- 172.21.15.67:0/3762873390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a205873880 0x55a2057cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49923f640 1 -- 172.21.15.67:0/3762873390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a2058734a0 msgr2=0x55a2057cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:32.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49923f640 1 --2- 172.21.15.67:0/3762873390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a2058734a0 0x55a2057cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49923f640 1 -- 172.21.15.67:0/3762873390 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2057e2df0 con 0x55a20579b540 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd49923f640 1 --2- 172.21.15.67:0/3762873390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a2057e0740 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0ad040 tx=0x7fd48c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570d05cfd3be7e04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd48b7fe640 1 -- 172.21.15.67:0/3762873390 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0af040 con 0x55a20579b540 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd48b7fe640 1 -- 172.21.15.67:0/3762873390 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48c0b9070 con 0x55a20579b540 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.916+0000 7fd48b7fe640 1 -- 172.21.15.67:0/3762873390 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0b4410 con 0x55a20579b540 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- 172.21.15.67:0/3762873390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 msgr2=0x55a2057e0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 --2- 172.21.15.67:0/3762873390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a2057e0740 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0ad040 tx=0x7fd48c003030 comp rx=0 tx=0).stop 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- 172.21.15.67:0/3762873390 shutdown_connections 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 --2- 172.21.15.67:0/3762873390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a205873880 0x55a2057cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 --2- 172.21.15.67:0/3762873390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a2058734a0 0x55a2057cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 --2- 172.21.15.67:0/3762873390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a2057e0740 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- 172.21.15.67:0/3762873390 >> 172.21.15.67:0/3762873390 conn(0x55a2057c92a0 msgr2=0x55a205876960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:32.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- 172.21.15.67:0/3762873390 shutdown_connections 2024-09-19T05:38:32.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- 172.21.15.67:0/3762873390 wait complete. 2024-09-19T05:38:32.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 Processor -- start 2024-09-19T05:38:32.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- start start 2024-09-19T05:38:32.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a205876f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a2058734a0 0x55a2058696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a205873880 0x55a205874cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a2057c8b10 con 0x55a20579b540 2024-09-19T05:38:32.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a2058748d0 con 0x55a2058734a0 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a2057c8d70 con 0x55a205873880 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49923f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a205876f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49923f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a205876f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44822/0 (socket says 172.21.15.67:44822) 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49923f640 1 -- 172.21.15.67:0/1568855912 learned_addr learned my addr 172.21.15.67:0/1568855912 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd498a3e640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a2058734a0 0x55a2058696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd499a40640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a205873880 0x55a205874cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49923f640 1 -- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a205873880 msgr2=0x55a205874cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49923f640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a205873880 0x55a205874cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49923f640 1 -- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a2058734a0 msgr2=0x55a2058696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49923f640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a2058734a0 0x55a2058696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49923f640 1 -- 172.21.15.67:0/1568855912 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a205870ba0 con 0x55a20579b540 2024-09-19T05:38:32.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd499a40640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a205873880 0x55a205874cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:32.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49923f640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a205876f10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fd48c096d80 tx=0x7fd48c018140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:32.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd48a7fc640 1 -- 172.21.15.67:0/1568855912 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0af040 con 0x55a20579b540 2024-09-19T05:38:32.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd48a7fc640 1 -- 172.21.15.67:0/1568855912 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48c0c6680 con 0x55a20579b540 2024-09-19T05:38:32.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- 172.21.15.67:0/1568855912 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a205870e40 con 0x55a20579b540 2024-09-19T05:38:32.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd48a7fc640 1 -- 172.21.15.67:0/1568855912 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0c6a70 con 0x55a20579b540 2024-09-19T05:38:32.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.920+0000 7fd49b72c080 1 -- 172.21.15.67:0/1568855912 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a205871380 con 0x55a20579b540 2024-09-19T05:38:32.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd48a7fc640 1 -- 172.21.15.67:0/1568855912 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd48c0b4410 con 0x55a20579b540 2024-09-19T05:38:32.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd48a7fc640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0662d0 0x7fd47c068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd48a7fc640 1 -- 172.21.15.67:0/1568855912 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7fd48c1211e0 con 0x55a20579b540 2024-09-19T05:38:32.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd49b72c080 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x55a20590cd20 0x55a20590d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:32.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd49b72c080 1 -- 172.21.15.67:0/1568855912 --> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) -- 0x55a20590d640 con 0x55a20590cd20 2024-09-19T05:38:32.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd498a3e640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0662d0 0x7fd47c068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd499a40640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x55a20590cd20 0x55a20590d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:32.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd499a40640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x55a20590cd20 0x55a20590d100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:32.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd498a3e640 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0662d0 0x7fd47c068790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd490000c10 tx=0x7fd490003090 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:32.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd499a40640 1 -- 172.21.15.67:0/1568855912 <== osd.0 v2:172.21.15.67:6816/1029707859 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v85'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd494003720 con 0x55a20590cd20 2024-09-19T05:38:32.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd49b72c080 1 -- 172.21.15.67:0/1568855912 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x55a20590cd20 msgr2=0x55a20590d100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd49b72c080 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x55a20590cd20 0x55a20590d100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:32.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd49b72c080 1 -- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0662d0 msgr2=0x7fd47c068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd49b72c080 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd47c0662d0 0x7fd47c068790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd490000c10 tx=0x7fd490003090 comp rx=0 tx=0).stop 2024-09-19T05:38:32.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd49b72c080 1 -- 172.21.15.67:0/1568855912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 msgr2=0x55a205876f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:32.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd49b72c080 1 --2- 172.21.15.67:0/1568855912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a20579b540 0x55a205876f10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fd48c096d80 tx=0x7fd48c018140 comp rx=0 tx=0).stop 2024-09-19T05:38:32.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd499a40640 1 -- 172.21.15.67:0/1568855912 reap_dead start 2024-09-19T05:38:32.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd49b72c080 1 -- 172.21.15.67:0/1568855912 shutdown_connections 2024-09-19T05:38:32.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.924+0000 7fd49b72c080 1 -- 172.21.15.67:0/1568855912 >> 172.21.15.67:0/1568855912 conn(0x55a2057c92a0 msgr2=0x55a2058758d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:32.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.928+0000 7fd49b72c080 1 -- 172.21.15.67:0/1568855912 shutdown_connections 2024-09-19T05:38:32.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:32.928+0000 7fd49b72c080 1 -- 172.21.15.67:0/1568855912 wait complete. 2024-09-19T05:38:32.935 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-09-19T05:38:32.935 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-19T05:38:32.936 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-09-19T05:38:32.936 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-19T05:38:32.936 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-09-19T05:38:32.936 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-19T05:38:32.937 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-09-19T05:38:32.937 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-19T05:38:33.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-19T05:38:33.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-19T05:38:33.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-19T05:38:33.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-19T05:38:33.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.088+0000 7fa50b448640 1 Processor -- start 2024-09-19T05:38:33.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.088+0000 7fa50b448640 1 -- start start 2024-09-19T05:38:33.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.088+0000 7fe4f5d1f640 1 Processor -- start 2024-09-19T05:38:33.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.088+0000 7fe4f5d1f640 1 -- start start 2024-09-19T05:38:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.088+0000 7fa50b448640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa50415cd50 0x7fa50415d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa50b448640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5040ae3d0 con 0x7fa5040b6cf0 2024-09-19T05:38:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa50b448640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5040b25c0 con 0x7fa50406c3d0 2024-09-19T05:38:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa50b448640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa50415da20 con 0x7fa50415cd50 2024-09-19T05:38:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa5089e3640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa5040b6cf0 0x7fa50406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42566/0 (socket says 172.21.15.67:42566) 2024-09-19T05:38:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa5089e3640 1 -- 172.21.15.67:0/3618310209 learned_addr learned my addr 172.21.15.67:0/3618310209 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa5091e4640 1 --2- 172.21.15.67:0/3618310209 >> v2:172.21.15.97:3300/0 conn(0x7fa50415cd50 0x7fa50415d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa4fbfff640 1 -- 172.21.15.67:0/3618310209 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2842725153 0 0) 0x7fa4f4001120 con 0x7fa5040b6cf0 2024-09-19T05:38:33.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa4fbfff640 1 -- 172.21.15.67:0/3618310209 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4f0003530 con 0x7fa5040b6cf0 2024-09-19T05:38:33.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed9c8b640 1 Processor -- start 2024-09-19T05:38:33.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4f5d1f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe4f00d1d70 0x7fe4f00d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4f5d1f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4f00d1420 0x7fe4f00ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4f5d1f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f00cdae0 con 0x7fe4f015b210 2024-09-19T05:38:33.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4f5d1f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f00cd890 con 0x7fe4f00d1d70 2024-09-19T05:38:33.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed9c8b640 1 -- start start 2024-09-19T05:38:33.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4f5d1f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f00cddc0 con 0x7fe4f00d1420 2024-09-19T05:38:33.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa5091e4640 1 -- 172.21.15.67:0/3618310209 >> v1:172.21.15.97:6789/0 conn(0x7fa50406c3d0 legacy=0x7fa50415deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa4fbfff640 1 -- 172.21.15.67:0/3618310209 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1585734282 0 0) 0x7fa4f0003530 con 0x7fa5040b6cf0 2024-09-19T05:38:33.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa5091e4640 1 -- 172.21.15.67:0/3618310209 >> v1:172.21.15.67:6789/0 conn(0x7fa5040b6cf0 legacy=0x7fa50406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fa5091e4640 1 -- 172.21.15.67:0/3618310209 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5040b28a0 con 0x7fa50415cd50 2024-09-19T05:38:33.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4eeffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe4f00d1d70 0x7fe4f00d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4ef7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe4f015b210 0x7fe4f00b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:58268/0 (socket says 172.21.15.67:58268) 2024-09-19T05:38:33.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4ef7fe640 1 -- 172.21.15.67:0/4270114952 learned_addr learned my addr 172.21.15.67:0/4270114952 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:33.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4effff640 1 --2- 172.21.15.67:0/4270114952 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4f00d1420 0x7fe4f00ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd625171640 1 Processor -- start 2024-09-19T05:38:33.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd625171640 1 -- start start 2024-09-19T05:38:33.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4effff640 1 -- 172.21.15.67:0/4270114952 >> v2:172.21.15.97:3300/0 conn(0x7fe4f00d1d70 msgr2=0x7fe4f00d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:33.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4effff640 1 --2- 172.21.15.67:0/4270114952 >> v2:172.21.15.97:3300/0 conn(0x7fe4f00d1d70 0x7fe4f00d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4effff640 1 -- 172.21.15.67:0/4270114952 >> v1:172.21.15.97:6789/0 conn(0x7fe4f015b210 legacy=0x7fe4f00b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fe4effff640 1 -- 172.21.15.67:0/4270114952 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f00ce0a0 con 0x7fe4f00d1420 2024-09-19T05:38:33.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed9c8b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1ed415e640 0x7f1ed40b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed9c8b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ed40b6cf0 0x7f1ed406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed9c8b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed40b5b90 con 0x7f1ed40ae0a0 2024-09-19T05:38:33.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed9c8b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed40b4780 con 0x7f1ed40b6cf0 2024-09-19T05:38:33.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed9c8b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed40ae510 con 0x7f1ed415e640 2024-09-19T05:38:33.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed2ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1ed40ae0a0 0x7f1ed40b2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42580/0 (socket says 172.21.15.67:42580) 2024-09-19T05:38:33.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed2ffd640 1 -- 172.21.15.67:0/166731528 learned_addr learned my addr 172.21.15.67:0/166731528 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:33.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed37fe640 1 --2- 172.21.15.67:0/166731528 >> v2:172.21.15.97:3300/0 conn(0x7f1ed415e640 0x7f1ed40b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611284205 0 0) 0x7f1ec8001120 con 0x7f1ed40ae0a0 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ebc003530 con 0x7f1ed40ae0a0 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3201842500 0 0) 0x7f1ebc003530 con 0x7f1ed40ae0a0 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 >> v2:172.21.15.97:3300/0 conn(0x7f1ed415e640 msgr2=0x7f1ed40b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 --2- 172.21.15.67:0/166731528 >> v2:172.21.15.97:3300/0 conn(0x7f1ed415e640 0x7f1ed40b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 >> v2:172.21.15.67:3300/0 conn(0x7f1ed40b6cf0 msgr2=0x7f1ed406bcc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 --2- 172.21.15.67:0/166731528 >> v2:172.21.15.67:3300/0 conn(0x7f1ed40b6cf0 0x7f1ed406bcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed40b15f0 con 0x7f1ed40ae0a0 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1ec8001850 con 0x7f1ed40ae0a0 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 >> v1:172.21.15.67:6789/0 conn(0x7f1ed40ae0a0 legacy=0x7f1ed40b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc003a10 0x7f1ebc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc004810 0x7f1ebc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc0052f0 0x7f1ebc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed40ae510 con 0x7f1ebc004810 2024-09-19T05:38:33.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd625171640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6200b6cf0 0x7fd62006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd625171640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd62006c200 0x7fd62015deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc00c1f0 con 0x7f1ebc003a10 2024-09-19T05:38:33.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ebc00c3f0 con 0x7f1ebc0052f0 2024-09-19T05:38:33.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd625171640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6200ae3d0 con 0x7fd62015cd50 2024-09-19T05:38:33.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd625171640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd62015da20 con 0x7fd62006c200 2024-09-19T05:38:33.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd625171640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd6200b25c0 con 0x7fd6200b6cf0 2024-09-19T05:38:33.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed2ffd640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc004810 0x7f1ebc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd61f59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd62006c200 0x7fd62015deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd61ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd62015cd50 0x7fd62015d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:58284/0 (socket says 172.21.15.67:58284) 2024-09-19T05:38:33.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd61ed9d640 1 -- 172.21.15.67:0/719471322 learned_addr learned my addr 172.21.15.67:0/719471322 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:33.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd61f59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd62006c200 0x7fd62015deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44840/0 (socket says 172.21.15.67:44840) 2024-09-19T05:38:33.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed37fe640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc003a10 0x7f1ebc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd617fff640 1 --2- 172.21.15.67:0/719471322 >> v2:172.21.15.97:3300/0 conn(0x7fd6200b6cf0 0x7fd62006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed2ffd640 1 -- 172.21.15.67:0/166731528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc0052f0 msgr2=0x7f1ebc00b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:33.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed2ffd640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc0052f0 0x7f1ebc00b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed2ffd640 1 -- 172.21.15.67:0/166731528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc003a10 msgr2=0x7f1ebc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:33.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed2ffd640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc003a10 0x7f1ebc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed2ffd640 1 -- 172.21.15.67:0/166731528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc003530 con 0x7f1ebc004810 2024-09-19T05:38:33.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7f1ed37fe640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc003a10 0x7f1ebc003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:33.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd61f59e640 1 -- 172.21.15.67:0/719471322 >> v2:172.21.15.97:3300/0 conn(0x7fd6200b6cf0 msgr2=0x7fd62006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:33.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd61f59e640 1 --2- 172.21.15.67:0/719471322 >> v2:172.21.15.97:3300/0 conn(0x7fd6200b6cf0 0x7fd62006bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd61f59e640 1 -- 172.21.15.67:0/719471322 >> v1:172.21.15.97:6789/0 conn(0x7fd62015cd50 legacy=0x7fd62015d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd61f59e640 1 -- 172.21.15.67:0/719471322 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6200b28a0 con 0x7fd62006c200 2024-09-19T05:38:33.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.092+0000 7fd617fff640 1 --2- 172.21.15.67:0/719471322 >> v2:172.21.15.97:3300/0 conn(0x7fd6200b6cf0 0x7fd62006bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:33.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7f1ed3fff640 1 -- 172.21.15.67:0/166731528 reap_dead start 2024-09-19T05:38:33.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa5091e4640 1 --2- 172.21.15.67:0/3618310209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa50415cd50 0x7fa50415d130 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa5000097c0 tx=0x7fa50001ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=224ce458c313f190 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa4fbfff640 1 -- 172.21.15.67:0/3618310209 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5000b0070 con 0x7fa50415cd50 2024-09-19T05:38:33.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4effff640 1 --2- 172.21.15.67:0/4270114952 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4f00d1420 0x7fe4f00ce8a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800bfa0 tx=0x7fe4e801eae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=970557e563883f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa4fbfff640 1 -- 172.21.15.67:0/3618310209 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5000ab400 con 0x7fa50415cd50 2024-09-19T05:38:33.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa4fbfff640 1 -- 172.21.15.67:0/3618310209 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4001850 con 0x7fa50415cd50 2024-09-19T05:38:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4ee7fc640 1 -- 172.21.15.67:0/4270114952 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e800b2d0 con 0x7fe4f00d1420 2024-09-19T05:38:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4ee7fc640 1 -- 172.21.15.67:0/4270114952 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e80a78c0 con 0x7fe4f00d1420 2024-09-19T05:38:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4ee7fc640 1 -- 172.21.15.67:0/4270114952 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80a7c90 con 0x7fe4f00d1420 2024-09-19T05:38:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/4270114952 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4f00d1420 msgr2=0x7fe4f00ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4f5d1f640 1 --2- 172.21.15.67:0/4270114952 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4f00d1420 0x7fe4f00ce8a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800bfa0 tx=0x7fe4e801eae0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa50b448640 1 -- 172.21.15.67:0/3618310209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa50415cd50 msgr2=0x7fa50415d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa50b448640 1 --2- 172.21.15.67:0/3618310209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa50415cd50 0x7fa50415d130 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa5000097c0 tx=0x7fa50001ce20 comp rx=0 tx=0).stop 2024-09-19T05:38:33.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/4270114952 shutdown_connections 2024-09-19T05:38:33.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4f5d1f640 1 --2- 172.21.15.67:0/4270114952 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4f00d1420 0x7fe4f00ce8a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4f5d1f640 1 --2- 172.21.15.67:0/4270114952 >> v2:172.21.15.97:3300/0 conn(0x7fe4f00d1d70 0x7fe4f00d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/4270114952 >> 172.21.15.67:0/4270114952 conn(0x7fe4f009aa30 msgr2=0x7fe4f00b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:33.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa50b448640 1 -- 172.21.15.67:0/3618310209 shutdown_connections 2024-09-19T05:38:33.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa50b448640 1 --2- 172.21.15.67:0/3618310209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa50415cd50 0x7fa50415d130 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa50b448640 1 -- 172.21.15.67:0/3618310209 >> 172.21.15.67:0/3618310209 conn(0x7fa50409aa30 msgr2=0x7fa5040b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:33.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa50b448640 1 -- 172.21.15.67:0/3618310209 shutdown_connections 2024-09-19T05:38:33.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa50b448640 1 -- 172.21.15.67:0/3618310209 wait complete. 2024-09-19T05:38:33.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/4270114952 shutdown_connections 2024-09-19T05:38:33.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd61f59e640 1 --2- 172.21.15.67:0/719471322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62006c200 0x7fd62015deb0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd620073fd0 tx=0x7fd61801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfab558eb45b893 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7f1ed2ffd640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc004810 0x7f1ebc004c90 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800c4c0 tx=0x7f1ec801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5b591bc70414c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd61e59c640 1 -- 172.21.15.67:0/719471322 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6180b2070 con 0x7fd62006c200 2024-09-19T05:38:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd61e59c640 1 -- 172.21.15.67:0/719471322 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6180a57f0 con 0x7fd62006c200 2024-09-19T05:38:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800c0e0 con 0x7f1ebc004810 2024-09-19T05:38:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd61e59c640 1 -- 172.21.15.67:0/719471322 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6180a5bc0 con 0x7fd62006c200 2024-09-19T05:38:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec80a9020 con 0x7f1ebc004810 2024-09-19T05:38:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7f1ed27fc640 1 -- 172.21.15.67:0/166731528 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8005b00 con 0x7f1ebc004810 2024-09-19T05:38:33.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd625171640 1 -- 172.21.15.67:0/719471322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62006c200 msgr2=0x7fd62015deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd625171640 1 --2- 172.21.15.67:0/719471322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62006c200 0x7fd62015deb0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd620073fd0 tx=0x7fd61801c930 comp rx=0 tx=0).stop 2024-09-19T05:38:33.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd625171640 1 -- 172.21.15.67:0/719471322 shutdown_connections 2024-09-19T05:38:33.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd625171640 1 --2- 172.21.15.67:0/719471322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62006c200 0x7fd62015deb0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd625171640 1 --2- 172.21.15.67:0/719471322 >> v2:172.21.15.97:3300/0 conn(0x7fd6200b6cf0 0x7fd62006bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd625171640 1 -- 172.21.15.67:0/719471322 >> 172.21.15.67:0/719471322 conn(0x7fd62009aa30 msgr2=0x7fd6200b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:33.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa50b448640 1 Processor -- start 2024-09-19T05:38:33.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd625171640 1 -- 172.21.15.67:0/719471322 shutdown_connections 2024-09-19T05:38:33.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fd625171640 1 -- 172.21.15.67:0/719471322 wait complete. 2024-09-19T05:38:33.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.096+0000 7fa50b448640 1 -- start start 2024-09-19T05:38:33.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/4270114952 wait complete. 2024-09-19T05:38:33.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/166731528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc004810 msgr2=0x7f1ebc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7f1ed9c8b640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc004810 0x7f1ebc004c90 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800c4c0 tx=0x7f1ec801cbd0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa50b448640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa50406c3d0 0x7fa50409e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa50b448640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5040b6cf0 0x7fa50414dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa50b448640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50415cd50 0x7fa504155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa50b448640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa50415f160 con 0x7fa50415cd50 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa50b448640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa50415efe0 con 0x7fa50406c3d0 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa50b448640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa504169f30 con 0x7fa5040b6cf0 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5099e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50415cd50 0x7fa504155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5099e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50415cd50 0x7fa504155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44848/0 (socket says 172.21.15.67:44848) 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5099e5640 1 -- 172.21.15.67:0/2016365132 learned_addr learned my addr 172.21.15.67:0/2016365132 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5091e4640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa50406c3d0 0x7fa50409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5089e3640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5040b6cf0 0x7fa50414dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/166731528 shutdown_connections 2024-09-19T05:38:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7f1ed9c8b640 1 --2- 172.21.15.67:0/166731528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc004810 0x7f1ebc004c90 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/166731528 >> 172.21.15.67:0/166731528 conn(0x7f1ed409aa30 msgr2=0x7f1ed40b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/166731528 shutdown_connections 2024-09-19T05:38:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/166731528 wait complete. 2024-09-19T05:38:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5099e5640 1 -- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5040b6cf0 msgr2=0x7fa50414dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5099e5640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5040b6cf0 0x7fa50414dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5099e5640 1 -- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa50406c3d0 msgr2=0x7fa50409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5099e5640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa50406c3d0 0x7fa50409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5099e5640 1 -- 172.21.15.67:0/2016365132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50409e540 con 0x7fa50415cd50 2024-09-19T05:38:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd625171640 1 Processor -- start 2024-09-19T05:38:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd625171640 1 -- start start 2024-09-19T05:38:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa5099e5640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50415cd50 0x7fa504155f10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c730 tx=0x7fa4fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa4f9ffb640 1 -- 172.21.15.67:0/2016365132 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc003b80 con 0x7fa50415cd50 2024-09-19T05:38:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa4f9ffb640 1 -- 172.21.15.67:0/2016365132 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc003d20 con 0x7fa50415cd50 2024-09-19T05:38:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa4f9ffb640 1 -- 172.21.15.67:0/2016365132 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc005310 con 0x7fa50415cd50 2024-09-19T05:38:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4f5d1f640 1 Processor -- start 2024-09-19T05:38:33.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa50b448640 1 -- 172.21.15.67:0/2016365132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa504154e70 con 0x7fa50415cd50 2024-09-19T05:38:33.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4f5d1f640 1 -- start start 2024-09-19T05:38:33.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa50b448640 1 -- 172.21.15.67:0/2016365132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa504155430 con 0x7fa50415cd50 2024-09-19T05:38:33.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd625171640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd62006c200 0x7fd6200cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd625171640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6200b6cf0 0x7fd62009e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd625171640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62015cd50 0x7fd620157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd625171640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd62015ef90 con 0x7fd62015cd50 2024-09-19T05:38:33.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd625171640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd62015ee10 con 0x7fd62006c200 2024-09-19T05:38:33.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd625171640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd62015f110 con 0x7fd6200b6cf0 2024-09-19T05:38:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4f5d1f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4f00d1420 0x7fe4f01f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4f5d1f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f00d1d70 0x7fe4f0157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4f5d1f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f015b210 0x7fe4f00b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4f5d1f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f00cf980 con 0x7fe4f015b210 2024-09-19T05:38:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4f5d1f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f00cf800 con 0x7fe4f00d1d70 2024-09-19T05:38:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4f5d1f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f00cfb00 con 0x7fe4f00d1420 2024-09-19T05:38:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd61f59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62015cd50 0x7fd620157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd61f59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62015cd50 0x7fd620157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44854/0 (socket says 172.21.15.67:44854) 2024-09-19T05:38:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd61f59e640 1 -- 172.21.15.67:0/3299103036 learned_addr learned my addr 172.21.15.67:0/3299103036 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:33.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4effff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f015b210 0x7fe4f00b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd61ed9d640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd62006c200 0x7fd6200cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4effff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f015b210 0x7fe4f00b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44862/0 (socket says 172.21.15.67:44862) 2024-09-19T05:38:33.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4effff640 1 -- 172.21.15.67:0/3970639021 learned_addr learned my addr 172.21.15.67:0/3970639021 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:33.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7f1ed9c8b640 1 Processor -- start 2024-09-19T05:38:33.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7f1ed9c8b640 1 -- start start 2024-09-19T05:38:33.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4eeffd640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f00d1d70 0x7fe4f0157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fa50b448640 1 -- 172.21.15.67:0/2016365132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa50415d130 con 0x7fa50415cd50 2024-09-19T05:38:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd61f59e640 1 -- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6200b6cf0 msgr2=0x7fd62009e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd61f59e640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6200b6cf0 0x7fd62009e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd61f59e640 1 -- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd62006c200 msgr2=0x7fd6200cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd61f59e640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd62006c200 0x7fd6200cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd61f59e640 1 -- 172.21.15.67:0/3299103036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6201551d0 con 0x7fd62015cd50 2024-09-19T05:38:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4effff640 1 -- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4f00d1420 msgr2=0x7fe4f01f6dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:38:33.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4effff640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4f00d1420 0x7fe4f01f6dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4effff640 1 -- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f00d1d70 msgr2=0x7fe4f0157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4effff640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f00d1d70 0x7fe4f0157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4effff640 1 -- 172.21.15.67:0/3970639021 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f015cb10 con 0x7fe4f015b210 2024-09-19T05:38:33.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4eeffd640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f00d1d70 0x7fe4f0157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:33.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fd61f59e640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62015cd50 0x7fd620157390 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fd6180b0040 tx=0x7fd6180196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.100+0000 7fe4effff640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f015b210 0x7fe4f00b21e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe4e801c710 tx=0x7fe4e801b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fd6177fe640 1 -- 172.21.15.67:0/3299103036 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6180b2040 con 0x7fd62015cd50 2024-09-19T05:38:33.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fd6177fe640 1 -- 172.21.15.67:0/3299103036 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6180bf070 con 0x7fd62015cd50 2024-09-19T05:38:33.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fd6177fe640 1 -- 172.21.15.67:0/3299103036 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618009450 con 0x7fd62015cd50 2024-09-19T05:38:33.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fd625171640 1 -- 172.21.15.67:0/3299103036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62009c8a0 con 0x7fd62015cd50 2024-09-19T05:38:33.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fd625171640 1 -- 172.21.15.67:0/3299103036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd620155750 con 0x7fd62015cd50 2024-09-19T05:38:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fe4d7fff640 1 -- 172.21.15.67:0/3970639021 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8009740 con 0x7fe4f015b210 2024-09-19T05:38:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed9c8b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc004810 0x7f1ed4143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed9c8b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ed41531f0 0x7f1ed4147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed9c8b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ed4148370 0x7f1ed41445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed9c8b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed40b7120 con 0x7f1ed4148370 2024-09-19T05:38:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed9c8b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed40b2c40 con 0x7f1ed41531f0 2024-09-19T05:38:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed9c8b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed40b0790 con 0x7f1ebc004810 2024-09-19T05:38:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ed4148370 0x7f1ed41445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc004810 0x7f1ed4143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ed4148370 0x7f1ed41445f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44878/0 (socket says 172.21.15.67:44878) 2024-09-19T05:38:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed3fff640 1 -- 172.21.15.67:0/239747265 learned_addr learned my addr 172.21.15.67:0/239747265 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fa4f9ffb640 1 -- 172.21.15.67:0/2016365132 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4fc0054b0 con 0x7fa50415cd50 2024-09-19T05:38:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fa4f9ffb640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4e8067910 0x7fa4e8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fa4f9ffb640 1 -- 172.21.15.67:0/2016365132 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7fa4fc085b80 con 0x7fa50415cd50 2024-09-19T05:38:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed2ffd640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ed41531f0 0x7f1ed4147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fa5091e4640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4e8067910 0x7fa4e8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed3fff640 1 -- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc004810 msgr2=0x7f1ed4143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed3fff640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc004810 0x7f1ed4143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed3fff640 1 -- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ed41531f0 msgr2=0x7f1ed4147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed3fff640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ed41531f0 0x7f1ed4147e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed3fff640 1 -- 172.21.15.67:0/239747265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed4145590 con 0x7f1ed4148370 2024-09-19T05:38:33.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/3970639021 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f015cdf0 con 0x7fe4f015b210 2024-09-19T05:38:33.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/3970639021 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f015d3b0 con 0x7fe4f015b210 2024-09-19T05:38:33.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7f1ed3fff640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ed4148370 0x7f1ed41445f0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4072790 tx=0x7f1ecc00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fe4d7fff640 1 -- 172.21.15.67:0/3970639021 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e80be070 con 0x7fe4f015b210 2024-09-19T05:38:33.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fe4d7fff640 1 -- 172.21.15.67:0/3970639021 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8009ae0 con 0x7fe4f015b210 2024-09-19T05:38:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fd625171640 1 -- 172.21.15.67:0/3299103036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62006bcc0 con 0x7fd62015cd50 2024-09-19T05:38:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fa5091e4640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4e8067910 0x7fa4e8069dd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa5000ad000 tx=0x7fa500004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.104+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/3970639021 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f00ce8a0 con 0x7fe4f015b210 2024-09-19T05:38:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.108+0000 7fa4f9ffb640 1 -- 172.21.15.67:0/2016365132 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa4fc055ec0 con 0x7fa50415cd50 2024-09-19T05:38:33.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.108+0000 7f1ebbfff640 1 -- 172.21.15.67:0/239747265 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00cb50 con 0x7f1ed4148370 2024-09-19T05:38:33.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.108+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/239747265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed4144fd0 con 0x7f1ed4148370 2024-09-19T05:38:33.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.108+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/239747265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed4156e10 con 0x7f1ed4148370 2024-09-19T05:38:33.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.108+0000 7fe4d7fff640 1 -- 172.21.15.67:0/3970639021 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4e80b6070 con 0x7fe4f015b210 2024-09-19T05:38:33.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.108+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/239747265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed4156c40 con 0x7f1ed4148370 2024-09-19T05:38:33.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.108+0000 7fd6177fe640 1 -- 172.21.15.67:0/3299103036 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6180ad9f0 con 0x7fd62015cd50 2024-09-19T05:38:33.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.108+0000 7fe4d7fff640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4dc067910 0x7fe4dc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.108+0000 7fe4d7fff640 1 -- 172.21.15.67:0/3970639021 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7fe4e8121710 con 0x7fe4f015b210 2024-09-19T05:38:33.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.108+0000 7fe4ef7fe640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4dc067910 0x7fe4dc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.112+0000 7f1ebbfff640 1 -- 172.21.15.67:0/239747265 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc010030 con 0x7f1ed4148370 2024-09-19T05:38:33.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.112+0000 7f1ebbfff640 1 -- 172.21.15.67:0/239747265 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc01a060 con 0x7f1ed4148370 2024-09-19T05:38:33.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.112+0000 7fd6177fe640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6000678c0 0x7fd600069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.112+0000 7fd6177fe640 1 -- 172.21.15.67:0/3299103036 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7fd618121b10 con 0x7fd62015cd50 2024-09-19T05:38:33.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.112+0000 7fd61ed9d640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6000678c0 0x7fd600069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.112+0000 7fe4ef7fe640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4dc067910 0x7fe4dc069dd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00d04d0 tx=0x7fe4e0007a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.112+0000 7fd61ed9d640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6000678c0 0x7fd600069d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd62015c840 tx=0x7fd610007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.112+0000 7fe4d7fff640 1 -- 172.21.15.67:0/3970639021 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe4e8018760 con 0x7fe4f015b210 2024-09-19T05:38:33.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.116+0000 7f1ebbfff640 1 -- 172.21.15.67:0/239747265 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ecc005070 con 0x7f1ed4148370 2024-09-19T05:38:33.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.116+0000 7f1ebbfff640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ec00678f0 0x7f1ec0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.116+0000 7f1ed37fe640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ec00678f0 0x7f1ec0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.116+0000 7f1ed37fe640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ec00678f0 0x7f1ec0069db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009be0 tx=0x7f1ec4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:33.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.120+0000 7f1ebbfff640 1 -- 172.21.15.67:0/239747265 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f1ecc0543d0 con 0x7f1ed4148370 2024-09-19T05:38:33.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.120+0000 7fd6177fe640 1 -- 172.21.15.67:0/3299103036 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd618016520 con 0x7fd62015cd50 2024-09-19T05:38:33.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.124+0000 7f1ebbfff640 1 -- 172.21.15.67:0/239747265 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1ecc056330 con 0x7f1ed4148370 2024-09-19T05:38:33.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.352+0000 7fd625171640 1 -- 172.21.15.67:0/3299103036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7fd620070af0 con 0x7fd62015cd50 2024-09-19T05:38:33.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.356+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/239747265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f1ed40b40c0 con 0x7f1ed4148370 2024-09-19T05:38:33.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.452+0000 7fa50b448640 1 -- 172.21.15.67:0/2016365132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fa50406df70 con 0x7fa50415cd50 2024-09-19T05:38:33.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:33.464+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/3970639021 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7fe4f00d0ee0 con 0x7fe4f015b210 2024-09-19T05:38:34.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.296+0000 7fd6177fe640 1 -- 172.21.15.67:0/3299103036 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5441 v53) ==== 95+0+0 (secure 0 0 0) 0x7fd6180f24a0 con 0x7fd62015cd50 2024-09-19T05:38:34.301 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 5441 2024-09-19T05:38:34.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 -- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6000678c0 msgr2=0x7fd600069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6000678c0 0x7fd600069d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd62015c840 tx=0x7fd610007e90 comp rx=0 tx=0).stop 2024-09-19T05:38:34.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 -- 172.21.15.67:0/3299103036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62015cd50 msgr2=0x7fd620157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62015cd50 0x7fd620157390 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fd6180b0040 tx=0x7fd6180196d0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 -- 172.21.15.67:0/3299103036 shutdown_connections 2024-09-19T05:38:34.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd62015cd50 0x7fd620157390 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6000678c0 0x7fd600069d80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6200b6cf0 0x7fd62009e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 --2- 172.21.15.67:0/3299103036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd62006c200 0x7fd6200cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 -- 172.21.15.67:0/3299103036 >> 172.21.15.67:0/3299103036 conn(0x7fd62009aa30 msgr2=0x7fd6200af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 -- 172.21.15.67:0/3299103036 shutdown_connections 2024-09-19T05:38:34.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.300+0000 7fd625171640 1 -- 172.21.15.67:0/3299103036 wait complete. 2024-09-19T05:38:34.320 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:38:34.316+0000 7fcbecc55640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:38:34.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.316+0000 7f1ebbfff640 1 -- 172.21.15.67:0/239747265 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5444 v54) ==== 95+0+0 (secure 0 0 0) 0x7f1ecc05a630 con 0x7f1ed4148370 2024-09-19T05:38:34.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.316+0000 7fa4f9ffb640 1 -- 172.21.15.67:0/2016365132 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5432 v54) ==== 95+0+0 (secure 0 0 0) 0x7fa4fc05a1c0 con 0x7fa50415cd50 2024-09-19T05:38:34.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.316+0000 7fe4d7fff640 1 -- 172.21.15.67:0/3970639021 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6741 v54) ==== 95+0+0 (secure 0 0 0) 0x7fe4e80f2130 con 0x7fe4f015b210 2024-09-19T05:38:34.323 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 5444 2024-09-19T05:38:34.323 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 6741 2024-09-19T05:38:34.323 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 5432 2024-09-19T05:38:34.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ec00678f0 msgr2=0x7f1ec0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ec00678f0 0x7f1ec0069db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009be0 tx=0x7f1ec4008040 comp rx=0 tx=0).stop 2024-09-19T05:38:34.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/239747265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ed4148370 msgr2=0x7f1ed41445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ed4148370 0x7f1ed41445f0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4072790 tx=0x7f1ecc00bf40 comp rx=0 tx=0).stop 2024-09-19T05:38:34.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/239747265 shutdown_connections 2024-09-19T05:38:34.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ed4148370 0x7f1ed41445f0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ed41531f0 0x7f1ed4147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ec00678f0 0x7f1ec0069db0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 --2- 172.21.15.67:0/239747265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc004810 0x7f1ed4143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/239747265 >> 172.21.15.67:0/239747265 conn(0x7f1ed409aa30 msgr2=0x7f1ed414b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/239747265 shutdown_connections 2024-09-19T05:38:34.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4dc067910 msgr2=0x7fe4dc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4dc067910 0x7fe4dc069dd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00d04d0 tx=0x7fe4e0007a50 comp rx=0 tx=0).stop 2024-09-19T05:38:34.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/3970639021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f015b210 msgr2=0x7fe4f00b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f015b210 0x7fe4f00b21e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe4e801c710 tx=0x7fe4e801b880 comp rx=0 tx=0).stop 2024-09-19T05:38:34.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/3970639021 shutdown_connections 2024-09-19T05:38:34.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4f015b210 0x7fe4f00b21e0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f00d1d70 0x7fe4f0157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4dc067910 0x7fe4dc069dd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 --2- 172.21.15.67:0/3970639021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4f00d1420 0x7fe4f01f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/3970639021 >> 172.21.15.67:0/3970639021 conn(0x7fe4f009aa30 msgr2=0x7fe4f00b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7f1ed9c8b640 1 -- 172.21.15.67:0/239747265 wait complete. 2024-09-19T05:38:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/3970639021 shutdown_connections 2024-09-19T05:38:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fe4f5d1f640 1 -- 172.21.15.67:0/3970639021 wait complete. 2024-09-19T05:38:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 -- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4e8067910 msgr2=0x7fa4e8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4e8067910 0x7fa4e8069dd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa5000ad000 tx=0x7fa500004740 comp rx=0 tx=0).stop 2024-09-19T05:38:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 -- 172.21.15.67:0/2016365132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50415cd50 msgr2=0x7fa504155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50415cd50 0x7fa504155f10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c730 tx=0x7fa4fc00cbf0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 -- 172.21.15.67:0/2016365132 shutdown_connections 2024-09-19T05:38:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50415cd50 0x7fa504155f10 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4e8067910 0x7fa4e8069dd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5040b6cf0 0x7fa50414dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 --2- 172.21.15.67:0/2016365132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa50406c3d0 0x7fa50409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 -- 172.21.15.67:0/2016365132 >> 172.21.15.67:0/2016365132 conn(0x7fa50409aa30 msgr2=0x7fa5040b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 -- 172.21.15.67:0/2016365132 shutdown_connections 2024-09-19T05:38:34.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.324+0000 7fa50b448640 1 -- 172.21.15.67:0/2016365132 wait complete. 2024-09-19T05:38:34.334 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:38:34.334 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:38:34.337 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:38:34.337 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:34.353 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:38:34.354 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:38:34.355 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:38:34.355 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:38:34.357 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:38:34.357 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:38:34.359 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:38:34.359 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:34.399 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:38:34.399 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:34.400 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:38:34.400 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:34.401 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:34.408 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:38:34.428 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:38:34.461 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:38:34.462 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:38:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb6234bc640 1 Processor -- start 2024-09-19T05:38:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb6234bc640 1 -- start start 2024-09-19T05:38:34.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb6234bc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb61c06c3d0 0x7fb61c0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb6234bc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb61c0b5b90 con 0x7fb61c0b6050 2024-09-19T05:38:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb6234bc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb61c0b15f0 con 0x7fb61c15e640 2024-09-19T05:38:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb6234bc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb61c0b4780 con 0x7fb61c06c3d0 2024-09-19T05:38:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb621a59640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb61c06c3d0 0x7fb61c0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb620a57640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb61c0b6050 0x7fb61c06bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42600/0 (socket says 172.21.15.67:42600) 2024-09-19T05:38:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb620a57640 1 -- 172.21.15.67:0/3214173743 learned_addr learned my addr 172.21.15.67:0/3214173743 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb621a59640 1 -- 172.21.15.67:0/3214173743 >> v1:172.21.15.97:6789/0 conn(0x7fb61c15e640 legacy=0x7fb61c0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb621a59640 1 -- 172.21.15.67:0/3214173743 >> v1:172.21.15.67:6789/0 conn(0x7fb61c0b6050 legacy=0x7fb61c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb621a59640 1 -- 172.21.15.67:0/3214173743 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c0b44a0 con 0x7fb61c06c3d0 2024-09-19T05:38:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb613fff640 1 -- 172.21.15.67:0/3214173743 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891608719 0 0) 0x7fb60c001120 con 0x7fb61c0b6050 2024-09-19T05:38:34.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.508+0000 7fb621a59640 1 --2- 172.21.15.67:0/3214173743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c06c3d0 0x7fb61c0ae0a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb614009d90 tx=0x7fb61401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263ea9431ebae0e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb613fff640 1 -- 172.21.15.67:0/3214173743 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6140b2070 con 0x7fb61c06c3d0 2024-09-19T05:38:34.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb613fff640 1 -- 172.21.15.67:0/3214173743 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6140a57e0 con 0x7fb61c06c3d0 2024-09-19T05:38:34.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb613fff640 1 -- 172.21.15.67:0/3214173743 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6140a5bb0 con 0x7fb61c06c3d0 2024-09-19T05:38:34.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 -- 172.21.15.67:0/3214173743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c06c3d0 msgr2=0x7fb61c0ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 --2- 172.21.15.67:0/3214173743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c06c3d0 0x7fb61c0ae0a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb614009d90 tx=0x7fb61401c810 comp rx=0 tx=0).stop 2024-09-19T05:38:34.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 -- 172.21.15.67:0/3214173743 shutdown_connections 2024-09-19T05:38:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 --2- 172.21.15.67:0/3214173743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c06c3d0 0x7fb61c0ae0a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 -- 172.21.15.67:0/3214173743 >> 172.21.15.67:0/3214173743 conn(0x7fb61c09aa30 msgr2=0x7fb61c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 -- 172.21.15.67:0/3214173743 shutdown_connections 2024-09-19T05:38:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 -- 172.21.15.67:0/3214173743 wait complete. 2024-09-19T05:38:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 Processor -- start 2024-09-19T05:38:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 -- start start 2024-09-19T05:38:34.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb61c06c3d0 0x7fb61c0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c0b6050 0x7fb61c0ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61c15e640 0x7fb61c0cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c0b0790 con 0x7fb61c0b6050 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c0b2b40 con 0x7fb61c06c3d0 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb6234bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c0b0910 con 0x7fb61c15e640 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb620a57640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c0b6050 0x7fb61c0ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb620a57640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c0b6050 0x7fb61c0ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44928/0 (socket says 172.21.15.67:44928) 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb620a57640 1 -- 172.21.15.67:0/2869577380 learned_addr learned my addr 172.21.15.67:0/2869577380 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb621258640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb61c06c3d0 0x7fb61c0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb621a59640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61c15e640 0x7fb61c0cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb620a57640 1 -- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61c15e640 msgr2=0x7fb61c0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb620a57640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61c15e640 0x7fb61c0cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb620a57640 1 -- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb61c06c3d0 msgr2=0x7fb61c0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb620a57640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb61c06c3d0 0x7fb61c0cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb620a57640 1 -- 172.21.15.67:0/2869577380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c0cd810 con 0x7fb61c0b6050 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb620a57640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c0b6050 0x7fb61c0ccc50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00c7b0 tx=0x7fb60c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.512+0000 7fb611ffb640 1 -- 172.21.15.67:0/2869577380 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c018070 con 0x7fb61c0b6050 2024-09-19T05:38:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.516+0000 7fb611ffb640 1 -- 172.21.15.67:0/2869577380 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb60c0072f0 con 0x7fb61c0b6050 2024-09-19T05:38:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.516+0000 7fb611ffb640 1 -- 172.21.15.67:0/2869577380 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0047f0 con 0x7fb61c0b6050 2024-09-19T05:38:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.516+0000 7fb6234bc640 1 -- 172.21.15.67:0/2869577380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61c158c40 con 0x7fb61c0b6050 2024-09-19T05:38:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.516+0000 7fb6234bc640 1 -- 172.21.15.67:0/2869577380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb61c159200 con 0x7fb61c0b6050 2024-09-19T05:38:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.516+0000 7fb6234bc640 1 -- 172.21.15.67:0/2869577380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb61c0b4150 con 0x7fb61c0b6050 2024-09-19T05:38:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.516+0000 7fb611ffb640 1 -- 172.21.15.67:0/2869577380 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb60c00a640 con 0x7fb61c0b6050 2024-09-19T05:38:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.516+0000 7fb611ffb640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 0x7fb600069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.516+0000 7fb611ffb640 1 -- 172.21.15.67:0/2869577380 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fb60c0853f0 con 0x7fb61c0b6050 2024-09-19T05:38:34.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.516+0000 7fb621258640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 0x7fb600069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.520+0000 7fb621258640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 0x7fb600069d80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb6180098e0 tx=0x7fb618009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.520+0000 7fb611ffb640 1 -- 172.21.15.67:0/2869577380 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb61c0b5b90 con 0x7fb61c0b6050 2024-09-19T05:38:34.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 -- 172.21.15.67:0/2869577380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb61c1620d0 con 0x7fb61c0b6050 2024-09-19T05:38:34.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb611ffb640 1 -- 172.21.15.67:0/2869577380 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+1911 (secure 0 0 0) 0x7fb60c055750 con 0x7fb61c0b6050 2024-09-19T05:38:34.716 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:34.716 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":54,"btime":"2024-09-19T05:38:34:321829+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:38:17.483070+0000","modified":"2024-09-19T05:38:34.321825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-19T05:38:34.716 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 54 2024-09-19T05:38:34.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 -- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 msgr2=0x7fb600069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 0x7fb600069d80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb6180098e0 tx=0x7fb618009060 comp rx=0 tx=0).stop 2024-09-19T05:38:34.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 -- 172.21.15.67:0/2869577380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c0b6050 msgr2=0x7fb61c0ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c0b6050 0x7fb61c0ccc50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00c7b0 tx=0x7fb60c00cc70 comp rx=0 tx=0).stop 2024-09-19T05:38:34.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 -- 172.21.15.67:0/2869577380 shutdown_connections 2024-09-19T05:38:34.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb6000678c0 0x7fb600069d80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61c15e640 0x7fb61c0cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb61c0b6050 0x7fb61c0ccc50 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 --2- 172.21.15.67:0/2869577380 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb61c06c3d0 0x7fb61c0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 -- 172.21.15.67:0/2869577380 >> 172.21.15.67:0/2869577380 conn(0x7fb61c09aa30 msgr2=0x7fb61c162950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 -- 172.21.15.67:0/2869577380 shutdown_connections 2024-09-19T05:38:34.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:34.712+0000 7fb6234bc640 1 -- 172.21.15.67:0/2869577380 wait complete. 2024-09-19T05:38:35.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:38:17.483070+0000', 'modified': '2024-09-19T05:38:34.321825+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-19T05:38:35.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-19T05:38:36.138 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:36.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ffad15640 1 Processor -- start 2024-09-19T05:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ffad15640 1 -- start start 2024-09-19T05:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ffad15640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7ff4159d60 0x7f7ff406ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ffad15640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ff40b36e0 0x7f7ff40acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ffad15640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff406de80 con 0x7f7ff406f460 2024-09-19T05:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ffad15640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff406e160 con 0x7f7ff4159d60 2024-09-19T05:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ffad15640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff406e440 con 0x7f7ff40b36e0 2024-09-19T05:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ff8ab1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7ff4159d60 0x7f7ff406ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ff8ab1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7ff4159d60 0x7f7ff406ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55104/0 (socket says 172.21.15.67:55104) 2024-09-19T05:38:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ff8ab1640 1 -- 172.21.15.67:0/2742944843 learned_addr learned my addr 172.21.15.67:0/2742944843 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ff92b2640 1 --2- 172.21.15.67:0/2742944843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ff40b36e0 0x7f7ff40acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ff8ab1640 1 -- 172.21.15.67:0/2742944843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ff40b36e0 msgr2=0x7f7ff40acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ff8ab1640 1 --2- 172.21.15.67:0/2742944843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ff40b36e0 0x7f7ff40acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ff8ab1640 1 -- 172.21.15.67:0/2742944843 >> v1:172.21.15.67:6789/0 conn(0x7f7ff406f460 legacy=0x7f7ff40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ff37fe640 1 -- 172.21.15.67:0/2742944843 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916043652 0 0) 0x7f7ff406de80 con 0x7f7ff406f460 2024-09-19T05:38:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.272+0000 7f7ff8ab1640 1 -- 172.21.15.67:0/2742944843 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff406e720 con 0x7f7ff4159d60 2024-09-19T05:38:36.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff8ab1640 1 --2- 172.21.15.67:0/2742944843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 0x7f7ff406ef20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009e50 tx=0x7f7fe401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ef6eb692dfc891 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:36.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff37fe640 1 -- 172.21.15.67:0/2742944843 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe40a57e0 con 0x7f7ff4159d60 2024-09-19T05:38:36.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff37fe640 1 -- 172.21.15.67:0/2742944843 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe40a5980 con 0x7f7ff4159d60 2024-09-19T05:38:36.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff37fe640 1 -- 172.21.15.67:0/2742944843 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe40a5d50 con 0x7f7ff4159d60 2024-09-19T05:38:36.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- 172.21.15.67:0/2742944843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 msgr2=0x7f7ff406ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 --2- 172.21.15.67:0/2742944843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 0x7f7ff406ef20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009e50 tx=0x7f7fe401ca00 comp rx=0 tx=0).stop 2024-09-19T05:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- 172.21.15.67:0/2742944843 shutdown_connections 2024-09-19T05:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 --2- 172.21.15.67:0/2742944843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ff40b36e0 0x7f7ff40acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 --2- 172.21.15.67:0/2742944843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 0x7f7ff406ef20 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- 172.21.15.67:0/2742944843 >> 172.21.15.67:0/2742944843 conn(0x7f7ff40d0080 msgr2=0x7f7ff40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- 172.21.15.67:0/2742944843 shutdown_connections 2024-09-19T05:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- 172.21.15.67:0/2742944843 wait complete. 2024-09-19T05:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 Processor -- start 2024-09-19T05:38:36.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- start start 2024-09-19T05:38:36.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ff406f460 0x7f7ff41fa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 0x7f7ff4144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ff4144650 0x7f7ff40723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40afa40 con 0x7f7ff4159d60 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40af8c0 con 0x7f7ff4144650 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff4169140 con 0x7f7ff406f460 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 0x7f7ff4144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 0x7f7ff4144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55114/0 (socket says 172.21.15.67:55114) 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff3fff640 1 -- 172.21.15.67:0/998593670 learned_addr learned my addr 172.21.15.67:0/998593670 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff8ab1640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ff406f460 0x7f7ff41fa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff3fff640 1 -- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ff406f460 msgr2=0x7f7ff41fa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff3fff640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ff406f460 0x7f7ff41fa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff3fff640 1 -- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ff4144650 msgr2=0x7f7ff40723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff3fff640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ff4144650 0x7f7ff40723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff3fff640 1 -- 172.21.15.67:0/998593670 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff41457a0 con 0x7f7ff4159d60 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff3fff640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 0x7f7ff4144110 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800c3f0 tx=0x7f7fe800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:36.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff17fa640 1 -- 172.21.15.67:0/998593670 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8017070 con 0x7f7ff4159d60 2024-09-19T05:38:36.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff17fa640 1 -- 172.21.15.67:0/998593670 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe80052f0 con 0x7f7ff4159d60 2024-09-19T05:38:36.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- 172.21.15.67:0/998593670 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff4144b90 con 0x7f7ff4159d60 2024-09-19T05:38:36.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ff17fa640 1 -- 172.21.15.67:0/998593670 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8003860 con 0x7f7ff4159d60 2024-09-19T05:38:36.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.276+0000 7f7ffad15640 1 -- 172.21.15.67:0/998593670 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff4145150 con 0x7f7ff4159d60 2024-09-19T05:38:36.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.280+0000 7f7ffad15640 1 -- 172.21.15.67:0/998593670 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff40acfb0 con 0x7f7ff4159d60 2024-09-19T05:38:36.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.280+0000 7f7ff17fa640 1 -- 172.21.15.67:0/998593670 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7fe801a070 con 0x7f7ff4159d60 2024-09-19T05:38:36.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.280+0000 7f7ff17fa640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fe00678c0 0x7f7fe0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.280+0000 7f7ff17fa640 1 -- 172.21.15.67:0/998593670 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f7fe80851e0 con 0x7f7ff4159d60 2024-09-19T05:38:36.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.280+0000 7f7ff8ab1640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fe00678c0 0x7f7fe0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:36.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.280+0000 7f7ff8ab1640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fe00678c0 0x7f7fe0069d80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40ae000 tx=0x7f7fe40a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:36.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.284+0000 7f7ff17fa640 1 -- 172.21.15.67:0/998593670 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7fe8055bd0 con 0x7f7ff4159d60 2024-09-19T05:38:36.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.480+0000 7f7ffad15640 1 -- 172.21.15.67:0/998593670 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ff40d0f20 con 0x7f7ff4159d60 2024-09-19T05:38:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.480+0000 7f7ff17fa640 1 -- 172.21.15.67:0/998593670 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5219 (secure 0 0 0) 0x7f7fe80554d0 con 0x7f7ff4159d60 2024-09-19T05:38:36.485 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:36.485 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":56,"btime":"2024-09-19T05:38:36:095642+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1497173986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1497173986},{"type":"v1","addr":"172.21.15.97:6835","nonce":1497173986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4151620700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4151620700},{"type":"v1","addr":"172.21.15.97:6837","nonce":4151620700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/491214453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":491214453},{"type":"v1","addr":"172.21.15.67:6835","nonce":491214453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:38:17.483070+0000","modified":"2024-09-19T05:38:35.113410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"a","rank":0,"incarnation":55,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.67:6833/1473897687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1473897687},{"type":"v1","addr":"172.21.15.67:6833","nonce":1473897687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-19T05:38:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 56 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 -- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fe00678c0 msgr2=0x7f7fe0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fe00678c0 0x7f7fe0069d80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40ae000 tx=0x7f7fe40a7070 comp rx=0 tx=0).stop 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 -- 172.21.15.67:0/998593670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 msgr2=0x7f7ff4144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 0x7f7ff4144110 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800c3f0 tx=0x7f7fe800c8b0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 -- 172.21.15.67:0/998593670 shutdown_connections 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ff4144650 0x7f7ff40723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ff4159d60 0x7f7ff4144110 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7fe00678c0 0x7f7fe0069d80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 --2- 172.21.15.67:0/998593670 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ff406f460 0x7f7ff41fa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 -- 172.21.15.67:0/998593670 >> 172.21.15.67:0/998593670 conn(0x7f7ff40d0080 msgr2=0x7f7ff415b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 -- 172.21.15.67:0/998593670 shutdown_connections 2024-09-19T05:38:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:36.484+0000 7f7ffad15640 1 -- 172.21.15.67:0/998593670 wait complete. 2024-09-19T05:38:36.905 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:38:17.483070+0000', 'modified': '2024-09-19T05:38:35.113410+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6999}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6999': {'gid': 6999, 'name': 'a', 'rank': 0, 'incarnation': 55, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.67:6833/1473897687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 1473897687}, {'type': 'v1', 'addr': '172.21.15.67:6833', 'nonce': 1473897687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-19T05:38:36.906 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6999:up:reconnect 2024-09-19T05:38:37.907 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb8ea5640 1 Processor -- start 2024-09-19T05:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb8ea5640 1 -- start start 2024-09-19T05:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb8ea5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb406f460 0x7f3cb406f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb8ea5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb406e3c0 con 0x7f3cb406dde0 2024-09-19T05:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb8ea5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb406e6a0 con 0x7f3cb415c030 2024-09-19T05:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb8ea5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb406e980 con 0x7f3cb406f460 2024-09-19T05:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb1d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3cb406dde0 0x7f3cb40b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47824/0 (socket says 172.21.15.67:47824) 2024-09-19T05:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb1d9b640 1 -- 172.21.15.67:0/2276998998 learned_addr learned my addr 172.21.15.67:0/2276998998 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb2d9d640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb406f460 0x7f3cb406f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995588301 0 0) 0x7f3cb406e3c0 con 0x7f3cb406dde0 2024-09-19T05:38:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c9c003530 con 0x7f3cb406dde0 2024-09-19T05:38:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4118168977 0 0) 0x7f3c9c003530 con 0x7f3cb406dde0 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb406f460 msgr2=0x7f3cb406f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb406f460 0x7f3cb406f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 >> v1:172.21.15.97:6789/0 conn(0x7f3cb415c030 legacy=0x7f3cb415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb406ec60 con 0x7f3cb406dde0 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3ca8001680 con 0x7f3cb406dde0 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 >> v1:172.21.15.67:6789/0 conn(0x7f3cb406dde0 legacy=0x7f3cb40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c0039f0 0x7f3c9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c9c004810 0x7f3c9c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb406f460 0x7f3c9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb406e980 con 0x7f3c9c0039f0 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c00ba80 con 0x7f3c9c004810 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9c00bc80 con 0x7f3cb406f460 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb259c640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c0039f0 0x7f3c9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb1d9b640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c9c004810 0x7f3c9c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb2d9d640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb406f460 0x7f3c9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb259c640 1 -- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb406f460 msgr2=0x7f3c9c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb259c640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb406f460 0x7f3c9c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb259c640 1 -- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c9c004810 msgr2=0x7f3c9c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb259c640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c9c004810 0x7f3c9c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb259c640 1 -- 172.21.15.67:0/2276998998 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c003530 con 0x7f3c9c0039f0 2024-09-19T05:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb1d9b640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c9c004810 0x7f3c9c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.040+0000 7f3cb2d9d640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb406f460 0x7f3c9c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb259c640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c0039f0 0x7f3c9c003e10 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4001750 tx=0x7f3ca401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be273e410c5a7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40013a0 con 0x7f3c9c0039f0 2024-09-19T05:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca40a4e50 con 0x7f3c9c0039f0 2024-09-19T05:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb159a640 1 -- 172.21.15.67:0/2276998998 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4003600 con 0x7f3c9c0039f0 2024-09-19T05:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2276998998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c0039f0 msgr2=0x7f3c9c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb8ea5640 1 --2- 172.21.15.67:0/2276998998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c0039f0 0x7f3c9c003e10 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4001750 tx=0x7f3ca401c390 comp rx=0 tx=0).stop 2024-09-19T05:38:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb2d9d640 1 -- 172.21.15.67:0/2276998998 reap_dead start 2024-09-19T05:38:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2276998998 shutdown_connections 2024-09-19T05:38:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2276998998 >> 172.21.15.67:0/2276998998 conn(0x7f3cb40d0080 msgr2=0x7f3cb40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2276998998 shutdown_connections 2024-09-19T05:38:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2276998998 wait complete. 2024-09-19T05:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb8ea5640 1 Processor -- start 2024-09-19T05:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.044+0000 7f3cb8ea5640 1 -- start start 2024-09-19T05:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb8ea5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cb409d820 0x7f3cb40b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb8ea5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb4141990 0x7f3cb4155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb8ea5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb40b0aa0 0x7f3cb41556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb8ea5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb415c590 con 0x7f3cb4141990 2024-09-19T05:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb8ea5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb415c410 con 0x7f3cb409d820 2024-09-19T05:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb8ea5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb41680e0 con 0x7f3cb40b0aa0 2024-09-19T05:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb4141990 0x7f3cb4155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb4141990 0x7f3cb4155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55120/0 (socket says 172.21.15.67:55120) 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb1d9b640 1 -- 172.21.15.67:0/2483426799 learned_addr learned my addr 172.21.15.67:0/2483426799 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb2d9d640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb40b0aa0 0x7f3cb41556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb259c640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cb409d820 0x7f3cb40b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb1d9b640 1 -- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb40b0aa0 msgr2=0x7f3cb41556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb1d9b640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb40b0aa0 0x7f3cb41556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb1d9b640 1 -- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cb409d820 msgr2=0x7f3cb40b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb1d9b640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cb409d820 0x7f3cb40b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb1d9b640 1 -- 172.21.15.67:0/2483426799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb415cc70 con 0x7f3cb4141990 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb1d9b640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb4141990 0x7f3cb4155160 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800dae0 tx=0x7f3ca8001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3ca2ffd640 1 -- 172.21.15.67:0/2483426799 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8019070 con 0x7f3cb4141990 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3ca2ffd640 1 -- 172.21.15.67:0/2483426799 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca8004cc0 con 0x7f3cb4141990 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2483426799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb409a240 con 0x7f3cb4141990 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3ca2ffd640 1 -- 172.21.15.67:0/2483426799 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80072d0 con 0x7f3cb4141990 2024-09-19T05:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2483426799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb409a7c0 con 0x7f3cb4141990 2024-09-19T05:38:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2483426799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb40b4f70 con 0x7f3cb4141990 2024-09-19T05:38:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3ca2ffd640 1 -- 172.21.15.67:0/2483426799 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ca801c070 con 0x7f3cb4141990 2024-09-19T05:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3ca2ffd640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c940678c0 0x7f3c94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3ca2ffd640 1 -- 172.21.15.67:0/2483426799 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f3ca8085880 con 0x7f3cb4141990 2024-09-19T05:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.048+0000 7f3cb259c640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c940678c0 0x7f3c94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.052+0000 7f3cb259c640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c940678c0 0x7f3c94069d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0057f0 tx=0x7f3ca40011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.052+0000 7f3ca2ffd640 1 -- 172.21.15.67:0/2483426799 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3ca80561e0 con 0x7f3cb4141990 2024-09-19T05:38:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.252+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2483426799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cb40adfd0 con 0x7f3cb4141990 2024-09-19T05:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.252+0000 7f3ca2ffd640 1 -- 172.21.15.67:0/2483426799 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5223 (secure 0 0 0) 0x7f3ca8055ae0 con 0x7f3cb4141990 2024-09-19T05:38:38.258 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:38.258 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":58,"btime":"2024-09-19T05:38:38:100892+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1497173986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1497173986},{"type":"v1","addr":"172.21.15.97:6835","nonce":1497173986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4151620700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4151620700},{"type":"v1","addr":"172.21.15.97:6837","nonce":4151620700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/491214453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":491214453},{"type":"v1","addr":"172.21.15.67:6835","nonce":491214453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:38:17.483070+0000","modified":"2024-09-19T05:38:38.100875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6833/1473897687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1473897687},{"type":"v1","addr":"172.21.15.67:6833","nonce":1473897687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6999,"qdb_cluster":[6999]},"id":5}]} 2024-09-19T05:38:38.258 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 58 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c940678c0 msgr2=0x7f3c94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c940678c0 0x7f3c94069d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0057f0 tx=0x7f3ca40011a0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2483426799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb4141990 msgr2=0x7f3cb4155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb4141990 0x7f3cb4155160 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800dae0 tx=0x7f3ca8001d90 comp rx=0 tx=0).stop 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2483426799 shutdown_connections 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c940678c0 0x7f3c94069d80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3cb40b0aa0 0x7f3cb41556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb4141990 0x7f3cb4155160 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 --2- 172.21.15.67:0/2483426799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cb409d820 0x7f3cb40b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2483426799 >> 172.21.15.67:0/2483426799 conn(0x7f3cb40d0080 msgr2=0x7f3cb415e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2483426799 shutdown_connections 2024-09-19T05:38:38.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.256+0000 7f3cb8ea5640 1 -- 172.21.15.67:0/2483426799 wait complete. 2024-09-19T05:38:38.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:38:17.483070+0000', 'modified': '2024-09-19T05:38:38.100875+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6999}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6999': {'gid': 6999, 'name': 'a', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.67:6833/1473897687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 1473897687}, {'type': 'v1', 'addr': '172.21.15.67:6833', 'nonce': 1473897687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6999, 'qdb_cluster': [6999]} 2024-09-19T05:38:38.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:38:38.680 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T05:38:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.812+0000 7ff47c489640 1 Processor -- start 2024-09-19T05:38:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.812+0000 7ff47c489640 1 -- start start 2024-09-19T05:38:38.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.812+0000 7ff47c489640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff47415b710 0x7ff474071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.812+0000 7ff47c489640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4740b3070 con 0x7ff47415baf0 2024-09-19T05:38:38.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.812+0000 7ff47c489640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4740afa70 con 0x7ff4740aef40 2024-09-19T05:38:38.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.812+0000 7ff47c489640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff4740b32e0 con 0x7ff47415b710 2024-09-19T05:38:38.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff479a24640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff47415baf0 0x7ff47415bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47826/0 (socket says 172.21.15.67:47826) 2024-09-19T05:38:38.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff479a24640 1 -- 172.21.15.67:0/1839897698 learned_addr learned my addr 172.21.15.67:0/1839897698 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:38.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47a225640 1 --2- 172.21.15.67:0/1839897698 >> v2:172.21.15.67:3300/0 conn(0x7ff47415b710 0x7ff474071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff479223640 1 -- 172.21.15.67:0/1839897698 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360167660 0 0) 0x7ff4740b3070 con 0x7ff47415baf0 2024-09-19T05:38:38.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff479223640 1 -- 172.21.15.67:0/1839897698 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff460005740 con 0x7ff47415baf0 2024-09-19T05:38:38.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47a225640 1 -- 172.21.15.67:0/1839897698 >> v1:172.21.15.97:6789/0 conn(0x7ff4740aef40 legacy=0x7ff4740af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47a225640 1 -- 172.21.15.67:0/1839897698 >> v1:172.21.15.67:6789/0 conn(0x7ff47415baf0 legacy=0x7ff47415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47a225640 1 -- 172.21.15.67:0/1839897698 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4740b35c0 con 0x7ff47415b710 2024-09-19T05:38:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47a225640 1 --2- 172.21.15.67:0/1839897698 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff47415b710 0x7ff474071e80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7ff4700097c0 tx=0x7ff47001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75272adb6842765d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff479223640 1 -- 172.21.15.67:0/1839897698 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4700a7070 con 0x7ff47415b710 2024-09-19T05:38:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff479223640 1 -- 172.21.15.67:0/1839897698 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4700b0070 con 0x7ff47415b710 2024-09-19T05:38:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff479223640 1 -- 172.21.15.67:0/1839897698 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4700ab890 con 0x7ff47415b710 2024-09-19T05:38:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47c489640 1 -- 172.21.15.67:0/1839897698 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff47415b710 msgr2=0x7ff474071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47c489640 1 --2- 172.21.15.67:0/1839897698 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff47415b710 0x7ff474071e80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7ff4700097c0 tx=0x7ff47001c470 comp rx=0 tx=0).stop 2024-09-19T05:38:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47c489640 1 -- 172.21.15.67:0/1839897698 shutdown_connections 2024-09-19T05:38:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47c489640 1 --2- 172.21.15.67:0/1839897698 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff47415b710 0x7ff474071e80 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47c489640 1 -- 172.21.15.67:0/1839897698 >> 172.21.15.67:0/1839897698 conn(0x7ff4740d0080 msgr2=0x7ff4740d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47c489640 1 -- 172.21.15.67:0/1839897698 shutdown_connections 2024-09-19T05:38:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.816+0000 7ff47c489640 1 -- 172.21.15.67:0/1839897698 wait complete. 2024-09-19T05:38:38.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47c489640 1 Processor -- start 2024-09-19T05:38:38.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47c489640 1 -- start start 2024-09-19T05:38:38.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47c489640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4740aef40 0x7ff4740b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47c489640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff47415b710 0x7ff47414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47c489640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff47415baf0 0x7ff474099950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47c489640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff4740b4c40 con 0x7ff4740aef40 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47c489640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff4740b4ac0 con 0x7ff47415b710 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47c489640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff4740b4dc0 con 0x7ff47415baf0 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47a225640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4740aef40 0x7ff4740b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47a225640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4740aef40 0x7ff4740b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55126/0 (socket says 172.21.15.67:55126) 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47a225640 1 -- 172.21.15.67:0/3417787653 learned_addr learned my addr 172.21.15.67:0/3417787653 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47a225640 1 -- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff47415baf0 msgr2=0x7ff474099950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47a225640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff47415baf0 0x7ff474099950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47a225640 1 -- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff47415b710 msgr2=0x7ff47414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47a225640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff47415b710 0x7ff47414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47a225640 1 -- 172.21.15.67:0/3417787653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff474099e90 con 0x7ff4740aef40 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47a225640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4740aef40 0x7ff4740b0920 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7ff470019080 tx=0x7ff47001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff46affd640 1 -- 172.21.15.67:0/3417787653 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4700bf610 con 0x7ff4740aef40 2024-09-19T05:38:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff46affd640 1 -- 172.21.15.67:0/3417787653 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4700bf7d0 con 0x7ff4740aef40 2024-09-19T05:38:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff46affd640 1 -- 172.21.15.67:0/3417787653 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4700bfbc0 con 0x7ff4740aef40 2024-09-19T05:38:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47c489640 1 -- 172.21.15.67:0/3417787653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47414af20 con 0x7ff4740aef40 2024-09-19T05:38:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff47c489640 1 -- 172.21.15.67:0/3417787653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff47414b4e0 con 0x7ff4740aef40 2024-09-19T05:38:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.820+0000 7ff46affd640 1 -- 172.21.15.67:0/3417787653 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff4700bd020 con 0x7ff4740aef40 2024-09-19T05:38:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff46affd640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4580678f0 0x7ff458069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff46affd640 1 -- 172.21.15.67:0/3417787653 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7ff470120850 con 0x7ff4740aef40 2024-09-19T05:38:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff479a24640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4580678f0 0x7ff458069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 Processor -- start 2024-09-19T05:38:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 -- start start 2024-09-19T05:38:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff479a24640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4580678f0 0x7ff458069db0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff464007fd0 tx=0x7ff464007940 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x556306210f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 0x5563061c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x5563061c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5563060aeb60 con 0x5563061c7290 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556306015c70 con 0x556306210b20 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x556305fbbed0 con 0x556306211440 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47aa26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x5563061c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47aa26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x5563061c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55136/0 (socket says 172.21.15.67:55136) 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47aa26640 1 -- 172.21.15.67:0/3715038245 learned_addr learned my addr 172.21.15.67:0/3715038245 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47a225640 1 --2- 172.21.15.67:0/3715038245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x556306210f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff479a24640 1 --2- 172.21.15.67:0/3715038245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 0x5563061c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47aa26640 1 -- 172.21.15.67:0/3715038245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 msgr2=0x5563061c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47aa26640 1 --2- 172.21.15.67:0/3715038245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 0x5563061c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47aa26640 1 -- 172.21.15.67:0/3715038245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 msgr2=0x556306210f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47aa26640 1 --2- 172.21.15.67:0/3715038245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x556306210f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47aa26640 1 -- 172.21.15.67:0/3715038245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556305fcde50 con 0x5563061c7290 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff479a24640 1 --2- 172.21.15.67:0/3715038245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 0x5563061c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47aa26640 1 --2- 172.21.15.67:0/3715038245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x5563061c7670 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7ff46c001d50 tx=0x7ff46c00c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd0879ed3aef7ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff457fff640 1 -- 172.21.15.67:0/3715038245 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c006d60 con 0x5563061c7290 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff457fff640 1 -- 172.21.15.67:0/3715038245 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff46c00cac0 con 0x5563061c7290 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff457fff640 1 -- 172.21.15.67:0/3715038245 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c005020 con 0x5563061c7290 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 -- 172.21.15.67:0/3715038245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 msgr2=0x5563061c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 --2- 172.21.15.67:0/3715038245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x5563061c7670 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7ff46c001d50 tx=0x7ff46c00c0e0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 -- 172.21.15.67:0/3715038245 shutdown_connections 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 --2- 172.21.15.67:0/3715038245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x5563061c7670 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 --2- 172.21.15.67:0/3715038245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 0x5563061c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 --2- 172.21.15.67:0/3715038245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x556306210f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 -- 172.21.15.67:0/3715038245 >> 172.21.15.67:0/3715038245 conn(0x5563061cd600 msgr2=0x5563061c5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 -- 172.21.15.67:0/3715038245 shutdown_connections 2024-09-19T05:38:38.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 -- 172.21.15.67:0/3715038245 wait complete. 2024-09-19T05:38:38.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.824+0000 7ff47f545000 1 -- start start 2024-09-19T05:38:38.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 Processor -- start 2024-09-19T05:38:38.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x5563061cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 0x5563061d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x5563061d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556306077b00 con 0x5563061cc390 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556305ff0360 con 0x556306210b20 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x556305fed2d0 con 0x556306211440 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 10 client.0 _ll_register_callbacks cb 0x5563061b2820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47aa26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x5563061d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47aa26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x5563061d2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55140/0 (socket says 172.21.15.67:55140) 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47aa26640 1 -- 172.21.15.67:0/4274374296 learned_addr learned my addr 172.21.15.67:0/4274374296 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff479a24640 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 0x5563061d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47a225640 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x5563061cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47aa26640 1 -- 172.21.15.67:0/4274374296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 msgr2=0x5563061d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47aa26640 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 0x5563061d1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47aa26640 1 -- 172.21.15.67:0/4274374296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 msgr2=0x5563061cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47aa26640 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x5563061cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47aa26640 1 -- 172.21.15.67:0/4274374296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556305fbc120 con 0x5563061cc390 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47aa26640 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x5563061d2230 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00c120 tx=0x7ff46c001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb9b38d94925fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff4557fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff4557fa640 1 -- 172.21.15.67:0/4274374296 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c003980 con 0x5563061cc390 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- 172.21.15.67:0/4274374296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff46c00cac0 con 0x5563061cc390 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff4557fa640 1 -- 172.21.15.67:0/4274374296 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7ff46c003b20 con 0x5563061cc390 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff4557fa640 1 -- 172.21.15.67:0/4274374296 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7ff46c02b050 con 0x5563061cc390 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 10 client.7041 fetch_fsmap learned FSMap version 58 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- 172.21.15.67:0/4274374296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x556305fb5450 con 0x5563061cc390 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff4557fa640 1 -- 172.21.15.67:0/4274374296 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff46c00cac0 con 0x5563061cc390 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff4557fa640 1 -- 172.21.15.67:0/4274374296 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7ff46c005020 con 0x5563061cc390 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 10 client.7041 fetch_fsmap finished waiting for FSMap version 58 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 10 client.7041 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 20 client.7041 populate_metadata read hostname 'smithi067' 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55630621f280 0x556306221670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 4 client.7041 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- 172.21.15.67:0/4274374296 --> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556305fafc00 con 0x55630621f280 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47a225640 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55630621f280 0x556306221670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47a225640 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55630621f280 0x556306221670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3f560de3582f3aa server_cookie=77f3ebac7e1dac0 in_seq=0 out_seq=0 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff4557fa640 10 client.7041 ms_handle_connect on v2:172.21.15.67:6832/1473897687 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff4557fa640 1 -- 172.21.15.67:0/4274374296 <== mds.0 v2:172.21.15.67:6832/1473897687 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556305fafc00 con 0x55630621f280 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff4557fa640 10 client.7041 handle_command_reply: tid=0 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 client.7041 shutdown 2024-09-19T05:38:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- 172.21.15.67:0/4274374296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 msgr2=0x5563061d2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x5563061d2230 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00c120 tx=0x7ff46c001520 comp rx=0 tx=0).stop 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- 172.21.15.67:0/4274374296 shutdown_connections 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55630621f280 0x556306221670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x5563061d2230 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306211440 0x5563061d1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 --2- 172.21.15.67:0/4274374296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x5563061cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- 172.21.15.67:0/4274374296 >> 172.21.15.67:0/4274374296 conn(0x5563061c7290 msgr2=0x5563061c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff4557fa640 0 client.7041 ms_handle_reset on v2:172.21.15.67:6832/1473897687 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- 172.21.15.67:0/4274374296 shutdown_connections 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 1 -- 172.21.15.67:0/4274374296 wait complete. 2024-09-19T05:38:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.828+0000 7ff47f545000 20 client.7041 trim_cache size 0 max 16384 2024-09-19T05:38:38.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff47f545000 1 Processor -- start 2024-09-19T05:38:38.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff47f545000 1 -- start start 2024-09-19T05:38:38.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff47f545000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563061c7290 0x55630620fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff47f545000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x556306210200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff47f545000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306210b20 0x556306221290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff47f545000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff474202c40 con 0x5563061cc390 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff47f545000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff474145cb0 con 0x5563061c7290 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff47f545000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff474202640 con 0x556306210b20 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff479a24640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x556306210200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff479a24640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x556306210200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55150/0 (socket says 172.21.15.67:55150) 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff479a24640 1 -- 172.21.15.67:0/1717105981 learned_addr learned my addr 172.21.15.67:0/1717105981 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff47aa26640 1 --2- 172.21.15.67:0/1717105981 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306210b20 0x556306221290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff47a225640 1 --2- 172.21.15.67:0/1717105981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563061c7290 0x55630620fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff479a24640 1 -- 172.21.15.67:0/1717105981 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306210b20 msgr2=0x556306221290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff479a24640 1 --2- 172.21.15.67:0/1717105981 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306210b20 0x556306221290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff479a24640 1 -- 172.21.15.67:0/1717105981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563061c7290 msgr2=0x55630620fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff479a24640 1 --2- 172.21.15.67:0/1717105981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563061c7290 0x55630620fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.848+0000 7ff479a24640 1 -- 172.21.15.67:0/1717105981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556305f9cfd0 con 0x5563061cc390 2024-09-19T05:38:38.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff479a24640 1 --2- 172.21.15.67:0/1717105981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x556306210200 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff464005d00 tx=0x7ff464010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5791e36cf7b562d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff4577fe640 1 -- 172.21.15.67:0/1717105981 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464007760 con 0x5563061cc390 2024-09-19T05:38:38.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff4577fe640 1 -- 172.21.15.67:0/1717105981 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4640149b0 con 0x5563061cc390 2024-09-19T05:38:38.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff4577fe640 1 -- 172.21.15.67:0/1717105981 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464014d80 con 0x5563061cc390 2024-09-19T05:38:38.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- 172.21.15.67:0/1717105981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 msgr2=0x556306210200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 --2- 172.21.15.67:0/1717105981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x556306210200 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff464005d00 tx=0x7ff464010000 comp rx=0 tx=0).stop 2024-09-19T05:38:38.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- 172.21.15.67:0/1717105981 shutdown_connections 2024-09-19T05:38:38.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 --2- 172.21.15.67:0/1717105981 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556306210b20 0x556306221290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 --2- 172.21.15.67:0/1717105981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061cc390 0x556306210200 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 --2- 172.21.15.67:0/1717105981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563061c7290 0x55630620fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- 172.21.15.67:0/1717105981 >> 172.21.15.67:0/1717105981 conn(0x55630621c040 msgr2=0x5563061cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- 172.21.15.67:0/1717105981 shutdown_connections 2024-09-19T05:38:38.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- 172.21.15.67:0/1717105981 wait complete. 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- start start 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 Processor -- start 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x556306224120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5563061cc390 0x55630623f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x55630623fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556306014f80 con 0x5563061c7290 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556305fcdca0 con 0x556306210b20 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55630601a2a0 con 0x5563061cc390 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 10 client.0 _ll_register_callbacks cb 0x7ff46c001bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47a225640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x556306224120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47a225640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x556306224120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55166/0 (socket says 172.21.15.67:55166) 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47a225640 1 -- 172.21.15.67:0/3232634978 learned_addr learned my addr 172.21.15.67:0/3232634978 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47aa26640 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x55630623fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff479a24640 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5563061cc390 0x55630623f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47a225640 1 -- 172.21.15.67:0/3232634978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5563061cc390 msgr2=0x55630623f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47a225640 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5563061cc390 0x55630623f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47a225640 1 -- 172.21.15.67:0/3232634978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 msgr2=0x55630623fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47a225640 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x55630623fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47a225640 1 -- 172.21.15.67:0/3232634978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556306098750 con 0x5563061c7290 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47aa26640 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x55630623fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47a225640 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x556306224120 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff47001c950 tx=0x7ff4700abc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06f2af42320acd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff4557fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff4557fa640 1 -- 172.21.15.67:0/3232634978 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4700f11b0 con 0x5563061c7290 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff4557fa640 1 -- 172.21.15.67:0/3232634978 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7ff4700eedb0 con 0x5563061c7290 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- 172.21.15.67:0/3232634978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4640149b0 con 0x5563061c7290 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff4557fa640 1 -- 172.21.15.67:0/3232634978 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7ff47010f050 con 0x5563061c7290 2024-09-19T05:38:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 10 client.7047 fetch_fsmap learned FSMap version 58 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- 172.21.15.67:0/3232634978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x556305fa3a30 con 0x5563061c7290 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff4557fa640 1 -- 172.21.15.67:0/3232634978 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4640149b0 con 0x5563061c7290 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff4557fa640 1 -- 172.21.15.67:0/3232634978 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7ff4700ed120 con 0x5563061c7290 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 10 client.7047 fetch_fsmap finished waiting for FSMap version 58 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 10 client.7047 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 20 client.7047 populate_metadata read hostname 'smithi067' 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x556306211440 0x5563062403e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 4 client.7047 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff47f545000 1 -- 172.21.15.67:0/3232634978 --> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] -- command(tid 0: {"prefix": "status"}) -- 0x5563060233a0 con 0x556306211440 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.852+0000 7ff479a24640 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x556306211440 0x5563062403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff4557fa640 10 client.7047 ms_handle_connect on v2:172.21.15.67:6832/1473897687 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff479a24640 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x556306211440 0x5563062403e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cae35124f83ec44c server_cookie=1659019a018c9d17 in_seq=0 out_seq=0 2024-09-19T05:38:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff4557fa640 1 -- 172.21.15.67:0/3232634978 <== mds.0 v2:172.21.15.67:6832/1473897687 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5563060233a0 con 0x556306211440 2024-09-19T05:38:38.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff4557fa640 10 client.7047 handle_command_reply: tid=0 2024-09-19T05:38:38.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 client.7047 shutdown 2024-09-19T05:38:38.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 -- 172.21.15.67:0/3232634978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 msgr2=0x556306224120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x556306224120 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff47001c950 tx=0x7ff4700abc70 comp rx=0 tx=0).stop 2024-09-19T05:38:38.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 -- 172.21.15.67:0/3232634978 shutdown_connections 2024-09-19T05:38:38.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x556306211440 0x5563062403e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556306210b20 0x55630623fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff4557fa640 0 client.7047 ms_handle_reset on v2:172.21.15.67:6832/1473897687 2024-09-19T05:38:38.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5563061cc390 0x55630623f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 --2- 172.21.15.67:0/3232634978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563061c7290 0x556306224120 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 -- 172.21.15.67:0/3232634978 >> 172.21.15.67:0/3232634978 conn(0x55630621c040 msgr2=0x55630620ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 -- 172.21.15.67:0/3232634978 shutdown_connections 2024-09-19T05:38:38.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 1 -- 172.21.15.67:0/3232634978 wait complete. 2024-09-19T05:38:38.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47f545000 20 client.7047 trim_cache size 0 max 16384 2024-09-19T05:38:38.865 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:38:38.865 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:38:38.865 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:38:38.865 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 6999, 2024-09-19T05:38:38.865 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:38:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:38:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:38:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 3.7636915260000001, 2024-09-19T05:38:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 58, 2024-09-19T05:38:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 89, 2024-09-19T05:38:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 89, 2024-09-19T05:38:38.866 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 4.3961304099999996 2024-09-19T05:38:38.866 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:38:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 -- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4580678f0 msgr2=0x7ff458069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4580678f0 0x7ff458069db0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff464007fd0 tx=0x7ff464007940 comp rx=0 tx=0).stop 2024-09-19T05:38:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 -- 172.21.15.67:0/3417787653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4740aef40 msgr2=0x7ff4740b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4740aef40 0x7ff4740b0920 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7ff470019080 tx=0x7ff47001acb0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 -- 172.21.15.67:0/3417787653 shutdown_connections 2024-09-19T05:38:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4580678f0 0x7ff458069db0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff47415baf0 0x7ff474099950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff47415b710 0x7ff47414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 --2- 172.21.15.67:0/3417787653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4740aef40 0x7ff4740b0920 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 -- 172.21.15.67:0/3417787653 >> 172.21.15.67:0/3417787653 conn(0x7ff4740d0080 msgr2=0x7ff47406c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 -- 172.21.15.67:0/3417787653 shutdown_connections 2024-09-19T05:38:38.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.856+0000 7ff47c489640 1 -- 172.21.15.67:0/3417787653 wait complete. 2024-09-19T05:38:38.876 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d375c640 1 Processor -- start 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d375c640 1 -- start start 2024-09-19T05:38:38.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d375c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa0cc06dde0 0x7fa0cc0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d375c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0cc06e3c0 con 0x7fa0cc15c030 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d375c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0cc06e6a0 con 0x7fa0cc0b3510 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d375c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa0cc06e980 con 0x7fa0cc06dde0 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d14f8640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa0cc15c030 0x7fa0cc15d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47830/0 (socket says 172.21.15.67:47830) 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d14f8640 1 -- 172.21.15.67:0/2943420015 learned_addr learned my addr 172.21.15.67:0/2943420015 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d0cf7640 1 --2- 172.21.15.67:0/2943420015 >> v2:172.21.15.97:3300/0 conn(0x7fa0cc06dde0 0x7fa0cc0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725685878 0 0) 0x7fa0cc06e3c0 con 0x7fa0cc15c030 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0b8003530 con 0x7fa0cc15c030 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 140557291 0 0) 0x7fa0b8003530 con 0x7fa0cc15c030 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 >> v2:172.21.15.97:3300/0 conn(0x7fa0cc06dde0 msgr2=0x7fa0cc0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 --2- 172.21.15.67:0/2943420015 >> v2:172.21.15.97:3300/0 conn(0x7fa0cc06dde0 0x7fa0cc0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 >> v1:172.21.15.97:6789/0 conn(0x7fa0cc0b3510 legacy=0x7fa0cc06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0cc06ec60 con 0x7fa0cc15c030 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fa0c8001680 con 0x7fa0cc15c030 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 >> v1:172.21.15.67:6789/0 conn(0x7fa0cc15c030 legacy=0x7fa0cc15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b80039c0 0x7fa0b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0b8004810 0x7fa0b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0b80051d0 0x7fa0b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc06e980 con 0x7fa0b80039c0 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b800c070 con 0x7fa0b8004810 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b800c270 con 0x7fa0b80051d0 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d14f8640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b80039c0 0x7fa0b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d0cf7640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0b8004810 0x7fa0b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d1cf9640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0b80051d0 0x7fa0b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d14f8640 1 -- 172.21.15.67:0/2943420015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0b80051d0 msgr2=0x7fa0b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d14f8640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0b80051d0 0x7fa0b800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d14f8640 1 -- 172.21.15.67:0/2943420015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0b8004810 msgr2=0x7fa0b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d14f8640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0b8004810 0x7fa0b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d14f8640 1 -- 172.21.15.67:0/2943420015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b8003530 con 0x7fa0b80039c0 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d0cf7640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0b8004810 0x7fa0b8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.980+0000 7fa0d1cf9640 1 -- 172.21.15.67:0/2943420015 reap_dead start 2024-09-19T05:38:38.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d14f8640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b80039c0 0x7fa0b8003de0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800c1c0 tx=0x7fa0c801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc28dc6b0c9dea3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8007d00 con 0x7fa0b80039c0 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c80a9020 con 0x7fa0b80039c0 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0c3fff640 1 -- 172.21.15.67:0/2943420015 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8005ae0 con 0x7fa0b80039c0 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 -- 172.21.15.67:0/2943420015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b80039c0 msgr2=0x7fa0b8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b80039c0 0x7fa0b8003de0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800c1c0 tx=0x7fa0c801cc30 comp rx=0 tx=0).stop 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 -- 172.21.15.67:0/2943420015 shutdown_connections 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 --2- 172.21.15.67:0/2943420015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b80039c0 0x7fa0b8003de0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 -- 172.21.15.67:0/2943420015 >> 172.21.15.67:0/2943420015 conn(0x7fa0cc0d0080 msgr2=0x7fa0cc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 -- 172.21.15.67:0/2943420015 shutdown_connections 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 -- 172.21.15.67:0/2943420015 wait complete. 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 Processor -- start 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 -- start start 2024-09-19T05:38:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0b80039c0 0x7fa0cc14c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc1faeb0 0x7fa0cc0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc14e260 0x7fa0cc14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc15d5c0 con 0x7fa0cc1faeb0 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc15c620 con 0x7fa0cc14e260 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d375c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa0cc15d740 con 0x7fa0b80039c0 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d0cf7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc1faeb0 0x7fa0cc0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d0cf7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc1faeb0 0x7fa0cc0ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55186/0 (socket says 172.21.15.67:55186) 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d0cf7640 1 -- 172.21.15.67:0/3125243059 learned_addr learned my addr 172.21.15.67:0/3125243059 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d14f8640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0b80039c0 0x7fa0cc14c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d1cf9640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc14e260 0x7fa0cc14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d0cf7640 1 -- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0b80039c0 msgr2=0x7fa0cc14c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d0cf7640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0b80039c0 0x7fa0cc14c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d0cf7640 1 -- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc14e260 msgr2=0x7fa0cc14e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d0cf7640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc14e260 0x7fa0cc14e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d0cf7640 1 -- 172.21.15.67:0/3125243059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0cc1fb470 con 0x7fa0cc1faeb0 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.984+0000 7fa0d0cf7640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc1faeb0 0x7fa0cc0ce980 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0107f0 tx=0x7fa0bc010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0c1ffb640 1 -- 172.21.15.67:0/3125243059 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00f040 con 0x7fa0cc1faeb0 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0c1ffb640 1 -- 172.21.15.67:0/3125243059 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0bc004220 con 0x7fa0cc1faeb0 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0d375c640 1 -- 172.21.15.67:0/3125243059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0cc1fb750 con 0x7fa0cc1faeb0 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0c1ffb640 1 -- 172.21.15.67:0/3125243059 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00e960 con 0x7fa0cc1faeb0 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0d375c640 1 -- 172.21.15.67:0/3125243059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0cc1f79d0 con 0x7fa0cc1faeb0 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0d375c640 1 -- 172.21.15.67:0/3125243059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0cc14cc00 con 0x7fa0cc1faeb0 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0c1ffb640 1 -- 172.21.15.67:0/3125243059 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0bc00eb00 con 0x7fa0cc1faeb0 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0c1ffb640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 0x7fa0b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0c1ffb640 1 -- 172.21.15.67:0/3125243059 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fa0bc086090 con 0x7fa0cc1faeb0 2024-09-19T05:38:38.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0d14f8640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 0x7fa0b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.988+0000 7fa0d14f8640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 0x7fa0b0069d80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80aa000 tx=0x7fa0cc06e870 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:38.992+0000 7fa0c1ffb640 1 -- 172.21.15.67:0/3125243059 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa0bc018030 con 0x7fa0cc1faeb0 2024-09-19T05:38:39.190 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:38:39.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 -- 172.21.15.67:0/3125243059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa0cc0acfb0 con 0x7fa0cc1faeb0 2024-09-19T05:38:39.192 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:38:39.193 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:38:39.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0c1ffb640 1 -- 172.21.15.67:0/3125243059 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) ==== 53+0+73 (secure 0 0 0) 0x7fa0bc0569f0 con 0x7fa0cc1faeb0 2024-09-19T05:38:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 -- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 msgr2=0x7fa0b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 0x7fa0b0069d80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80aa000 tx=0x7fa0cc06e870 comp rx=0 tx=0).stop 2024-09-19T05:38:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 -- 172.21.15.67:0/3125243059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc1faeb0 msgr2=0x7fa0cc0ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc1faeb0 0x7fa0cc0ce980 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0107f0 tx=0x7fa0bc010cb0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 -- 172.21.15.67:0/3125243059 shutdown_connections 2024-09-19T05:38:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0cc14e260 0x7fa0cc14e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0cc1faeb0 0x7fa0cc0ce980 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa0b00678c0 0x7fa0b0069d80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 --2- 172.21.15.67:0/3125243059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0b80039c0 0x7fa0cc14c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 -- 172.21.15.67:0/3125243059 >> 172.21.15.67:0/3125243059 conn(0x7fa0cc0d0080 msgr2=0x7fa0cc15c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:39.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 -- 172.21.15.67:0/3125243059 shutdown_connections 2024-09-19T05:38:39.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39.188+0000 7fa0d375c640 1 -- 172.21.15.67:0/3125243059 wait complete. 2024-09-19T05:38:39.210 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:38:39.210 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:38:39.211 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:38:39.211 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:38:39.211 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:39.211 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:38:39.211 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:38:39.211 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:38:39.211 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:38:39.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:39.211 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:38:39.275 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:38:39.275 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:38:39.275 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:38:39.275 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:39.275 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:38:39.275 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:39.275 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:38:39.275 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:39.275 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42185sec preferred_lft 42185sec 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:39.276 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:38:39.277 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:39.278 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:38:39.278 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:39.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:39.278 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:38:39.334 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:38:39.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:39.336 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:38:39.390 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:38:39.390 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:38:39.390 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:38:39.390 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:38:39.390 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:38:39.390 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:38:39.391 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:38:39.391 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:38:39.391 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:38:39.391 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:38:39.391 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:38:39.391 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:38:39.391 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:38:39.391 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:38:39.391 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:38:39.391 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:38:39.392 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:38:39.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:38:39.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:39.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:39.517 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:38:39.523 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:38:39.523 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:38:39.524 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:38:39.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:39.524 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:38:39.579 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:38:39.579 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:38:39.579 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:39.628 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:38:39.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:38:39.629 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:39.675 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:38:39.736 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:38:39.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-19T05:38:39.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-19T05:38:39.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-19T05:38:39.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-19T05:38:39.789 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:38:39.790 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:38:39.790 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:38:39.790 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:38:39.792 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:38:39.792 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:38:39.792 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:38:39.793 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:39.794 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:39.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:39.796 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:38:39.843 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:38:39.844 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:38:39.888 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:38:39.902 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:38:39.951 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:38:39.951 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:38:39.952 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:38:39.953 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:38:39.954 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:38:39.954 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:38:39.954 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:39.954 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:39.954 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:39.954 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:39.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:39.955 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:38:39.970 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:38:39.968+0000 7f1787f42580 -1 init, newargv = 0x5624b98c8300 newargc=15 2024-09-19T05:38:39.971 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[56881]: starting ceph client 2024-09-19T05:38:39.977 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[56881]: starting fuse 2024-09-19T05:38:40.106 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-09-19T05:38:40.100+0000 7f1889850640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:38:41.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:38:41.093 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:38:41.141 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:38:41.142 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:38:41.143 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:38:41.144 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:38:41.144 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:38:41.144 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:38:41.144 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:41.144 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:41.144 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:41.144 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:38:41.144 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:41.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:41.145 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:38:41.191 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:38:41.191 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:38:41.192 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:38:41.193 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:38:41.319 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.56881.asok 2024-09-19T05:38:41.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:41.332 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.56881.asok 2024-09-19T05:38:41.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:41.332 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.56881.asok status 2024-09-19T05:38:41.490 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:38:41.490 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:38:41.490 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:38:41.490 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:38:41.490 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:38:41.490 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:38:41.490 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:38:41.490 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "56881", 2024-09-19T05:38:41.490 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 7059, 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 7059 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:38:41.491 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 29935216 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 29935216 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.7059 192.168.0.1:0/29935216", 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/29935216", 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 58, 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 89, 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:38:41.492 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:38:41.493 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:38:41.493 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:38:41.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:41.504 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:38:41.504 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:41.510 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:38:41.510 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:41.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:41.511 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:41.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:41.566 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-19T05:38:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-09-19T05:38:41.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:38:41.620 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-09-19T05:38:41.620 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /scrub_repair_path repair 2024-09-19T05:38:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.792+0000 7f416ffb6640 1 Processor -- start 2024-09-19T05:38:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416ffb6640 1 -- start start 2024-09-19T05:38:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416ffb6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680d0520 0x7f41680d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416ffb6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f41680addf0 0x7f41680ae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416ffb6640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41680b4e00 con 0x7f41680738b0 2024-09-19T05:38:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416ffb6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f41680d0ed0 con 0x7f41680addf0 2024-09-19T05:38:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416ffb6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f41680b3500 con 0x7f41680d0520 2024-09-19T05:38:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416dd52640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f41680738b0 0x7f416815c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47834/0 (socket says 172.21.15.67:47834) 2024-09-19T05:38:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416dd52640 1 -- 172.21.15.67:0/3326607664 learned_addr learned my addr 172.21.15.67:0/3326607664 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416e553640 1 --2- 172.21.15.67:0/3326607664 >> v2:172.21.15.67:3300/0 conn(0x7f41680addf0 0x7f41680ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416cd50640 1 -- 172.21.15.67:0/3326607664 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177878675 0 0) 0x7f41680b4e00 con 0x7f41680738b0 2024-09-19T05:38:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416cd50640 1 -- 172.21.15.67:0/3326607664 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4154003530 con 0x7f41680738b0 2024-09-19T05:38:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416d551640 1 --2- 172.21.15.67:0/3326607664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680d0520 0x7f41680d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416e553640 1 -- 172.21.15.67:0/3326607664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680d0520 msgr2=0x7f41680d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416e553640 1 --2- 172.21.15.67:0/3326607664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680d0520 0x7f41680d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416e553640 1 -- 172.21.15.67:0/3326607664 >> v1:172.21.15.67:6789/0 conn(0x7f41680738b0 legacy=0x7f416815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416e553640 1 -- 172.21.15.67:0/3326607664 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41680b37e0 con 0x7f41680addf0 2024-09-19T05:38:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416d551640 1 --2- 172.21.15.67:0/3326607664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680d0520 0x7f41680d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.796+0000 7f416e553640 1 --2- 172.21.15.67:0/3326607664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680addf0 0x7f41680ae280 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f4160009d90 tx=0x7f416001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451a44cceacdd617 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416cd50640 1 -- 172.21.15.67:0/3326607664 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600b2070 con 0x7f41680addf0 2024-09-19T05:38:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416cd50640 1 -- 172.21.15.67:0/3326607664 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41600a5830 con 0x7f41680addf0 2024-09-19T05:38:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416cd50640 1 -- 172.21.15.67:0/3326607664 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600a5c00 con 0x7f41680addf0 2024-09-19T05:38:41.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 -- 172.21.15.67:0/3326607664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680addf0 msgr2=0x7f41680ae280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:41.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 --2- 172.21.15.67:0/3326607664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680addf0 0x7f41680ae280 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f4160009d90 tx=0x7f416001c970 comp rx=0 tx=0).stop 2024-09-19T05:38:41.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 -- 172.21.15.67:0/3326607664 shutdown_connections 2024-09-19T05:38:41.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 --2- 172.21.15.67:0/3326607664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680addf0 0x7f41680ae280 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 --2- 172.21.15.67:0/3326607664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680d0520 0x7f41680d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 -- 172.21.15.67:0/3326607664 >> 172.21.15.67:0/3326607664 conn(0x7f416806c0c0 msgr2=0x7f416806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 -- 172.21.15.67:0/3326607664 shutdown_connections 2024-09-19T05:38:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 -- 172.21.15.67:0/3326607664 wait complete. 2024-09-19T05:38:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 Processor -- start 2024-09-19T05:38:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 -- start start 2024-09-19T05:38:41.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41680738b0 0x7f41680cf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680addf0 0x7f416814d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680d0520 0x7f416814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f41680b30b0 con 0x7f41680d0520 2024-09-19T05:38:41.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4168073c90 con 0x7f41680738b0 2024-09-19T05:38:41.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f41680b3230 con 0x7f41680addf0 2024-09-19T05:38:41.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416e553640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680d0520 0x7f416814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416e553640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680d0520 0x7f416814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55208/0 (socket says 172.21.15.67:55208) 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416e553640 1 -- 172.21.15.67:0/3663441685 learned_addr learned my addr 172.21.15.67:0/3663441685 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416d551640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680addf0 0x7f416814d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416dd52640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41680738b0 0x7f41680cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416e553640 1 -- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680addf0 msgr2=0x7f416814d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416e553640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680addf0 0x7f416814d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416e553640 1 -- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41680738b0 msgr2=0x7f41680cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416e553640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41680738b0 0x7f41680cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416e553640 1 -- 172.21.15.67:0/3663441685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4168156b40 con 0x7f41680d0520 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416dd52640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41680738b0 0x7f41680cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416e553640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680d0520 0x7f416814d580 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4160009d90 tx=0x7f4160019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f415e7fc640 1 -- 172.21.15.67:0/3663441685 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600b2050 con 0x7f41680d0520 2024-09-19T05:38:41.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f415e7fc640 1 -- 172.21.15.67:0/3663441685 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41600be070 con 0x7f41680d0520 2024-09-19T05:38:41.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f415e7fc640 1 -- 172.21.15.67:0/3663441685 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600ada90 con 0x7f41680d0520 2024-09-19T05:38:41.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.800+0000 7f416ffb6640 1 -- 172.21.15.67:0/3663441685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4168156e20 con 0x7f41680d0520 2024-09-19T05:38:41.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f416ffb6640 1 -- 172.21.15.67:0/3663441685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41681573e0 con 0x7f41680d0520 2024-09-19T05:38:41.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f415e7fc640 1 -- 172.21.15.67:0/3663441685 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f41600a56b0 con 0x7f41680d0520 2024-09-19T05:38:41.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f415e7fc640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 0x7f414c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f415e7fc640 1 -- 172.21.15.67:0/3663441685 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f4160120ff0 con 0x7f41680d0520 2024-09-19T05:38:41.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f416dd52640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 0x7f414c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f4173072000 1 Processor -- start 2024-09-19T05:38:41.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f4173072000 1 -- start start 2024-09-19T05:38:41.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f416dd52640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 0x7f414c069d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4164005890 tx=0x7f4164009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:41.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f4173072000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e5126b0 0x55621e512a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f4173072000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e512fd0 0x55621e4c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f4173072000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e4c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f4173072000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55621e2f3300 con 0x55621e4c6400 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f4173072000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55621e316d70 con 0x55621e5126b0 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f4173072000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55621e2d1ab0 con 0x55621e512fd0 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f416e553640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e4c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f416e553640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e4c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55220/0 (socket says 172.21.15.67:55220) 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f416e553640 1 -- 172.21.15.67:0/1919187701 learned_addr learned my addr 172.21.15.67:0/1919187701 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f416dd52640 1 --2- 172.21.15.67:0/1919187701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e5126b0 0x55621e512a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.804+0000 7f416d551640 1 --2- 172.21.15.67:0/1919187701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e512fd0 0x55621e4c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416e553640 1 -- 172.21.15.67:0/1919187701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e512fd0 msgr2=0x55621e4c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416e553640 1 --2- 172.21.15.67:0/1919187701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e512fd0 0x55621e4c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416e553640 1 -- 172.21.15.67:0/1919187701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e5126b0 msgr2=0x55621e512a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416e553640 1 --2- 172.21.15.67:0/1919187701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e5126b0 0x55621e512a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416e553640 1 -- 172.21.15.67:0/1919187701 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621e2d0b80 con 0x55621e4c6400 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416e553640 1 --2- 172.21.15.67:0/1919187701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e4c67e0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f41600f0ef0 tx=0x7f41600f0e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b32b7d6f0bcd8c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f414b7fe640 1 -- 172.21.15.67:0/1919187701 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600f11f0 con 0x55621e4c6400 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f414b7fe640 1 -- 172.21.15.67:0/1919187701 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41600b3040 con 0x55621e4c6400 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f414b7fe640 1 -- 172.21.15.67:0/1919187701 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600f55a0 con 0x55621e4c6400 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- 172.21.15.67:0/1919187701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 msgr2=0x55621e4c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 --2- 172.21.15.67:0/1919187701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e4c67e0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f41600f0ef0 tx=0x7f41600f0e60 comp rx=0 tx=0).stop 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- 172.21.15.67:0/1919187701 shutdown_connections 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 --2- 172.21.15.67:0/1919187701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e4c67e0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 --2- 172.21.15.67:0/1919187701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e512fd0 0x55621e4c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 --2- 172.21.15.67:0/1919187701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e5126b0 0x55621e512a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- 172.21.15.67:0/1919187701 >> 172.21.15.67:0/1919187701 conn(0x55621e4f3450 msgr2=0x55621e4f5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- 172.21.15.67:0/1919187701 shutdown_connections 2024-09-19T05:38:41.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- 172.21.15.67:0/1919187701 wait complete. 2024-09-19T05:38:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- start start 2024-09-19T05:38:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 Processor -- start 2024-09-19T05:38:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e4c6400 0x55621e519410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e5126b0 0x55621e519950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e512fd0 0x55621e519e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55621e2b04d0 con 0x55621e5126b0 2024-09-19T05:38:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55621e312d30 con 0x55621e512fd0 2024-09-19T05:38:41.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55621e2f3300 con 0x55621e4c6400 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416d551640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e5126b0 0x55621e519950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 10 client.0 _ll_register_callbacks cb 0x55621e3ca600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416d551640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e5126b0 0x55621e519950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55228/0 (socket says 172.21.15.67:55228) 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416d551640 1 -- 172.21.15.67:0/3555458653 learned_addr learned my addr 172.21.15.67:0/3555458653 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416dd52640 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e4c6400 0x55621e519410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416e553640 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e512fd0 0x55621e519e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416d551640 1 -- 172.21.15.67:0/3555458653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e4c6400 msgr2=0x55621e519410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416d551640 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e4c6400 0x55621e519410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416d551640 1 -- 172.21.15.67:0/3555458653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e512fd0 msgr2=0x55621e519e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416d551640 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e512fd0 0x55621e519e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416d551640 1 -- 172.21.15.67:0/3555458653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621e2d3720 con 0x55621e5126b0 2024-09-19T05:38:41.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f416d551640 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e5126b0 0x55621e519950 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f4158010580 tx=0x7f4158010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a915de691137ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4148ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4148ff9640 1 -- 172.21.15.67:0/3555458653 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415801a020 con 0x55621e5126b0 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4148ff9640 1 -- 172.21.15.67:0/3555458653 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f4158016690 con 0x55621e5126b0 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- 172.21.15.67:0/3555458653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41600b3040 con 0x55621e5126b0 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4148ff9640 1 -- 172.21.15.67:0/3555458653 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f4158024050 con 0x55621e5126b0 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 10 client.7074 fetch_fsmap learned FSMap version 58 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.808+0000 7f4173072000 1 -- 172.21.15.67:0/3555458653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x55621e2d7570 con 0x55621e5126b0 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4148ff9640 1 -- 172.21.15.67:0/3555458653 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41600b3040 con 0x55621e5126b0 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4148ff9640 1 -- 172.21.15.67:0/3555458653 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7f4158027020 con 0x55621e5126b0 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 10 client.7074 fetch_fsmap finished waiting for FSMap version 58 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 10 client.7074 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 20 client.7074 populate_metadata read hostname 'smithi067' 2024-09-19T05:38:41.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55621e5217e0 0x55621e523bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 4 client.7074 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 -- 172.21.15.67:0/3555458653 --> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55621e2b0f20 con 0x55621e5217e0 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f416dd52640 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55621e5217e0 0x55621e523bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4148ff9640 10 client.7074 ms_handle_connect on v2:172.21.15.67:6832/1473897687 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f416dd52640 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55621e5217e0 0x55621e523bd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70026cb01e533603 server_cookie=d92ebaf2312f90dd in_seq=0 out_seq=0 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4148ff9640 1 -- 172.21.15.67:0/3555458653 <== mds.0 v2:172.21.15.67:6832/1473897687 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55621e2b0f20 con 0x55621e5217e0 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4148ff9640 10 client.7074 handle_command_reply: tid=0 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 client.7074 shutdown 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 -- 172.21.15.67:0/3555458653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e5126b0 msgr2=0x55621e519950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e5126b0 0x55621e519950 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f4158010580 tx=0x7f4158010a40 comp rx=0 tx=0).stop 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 -- 172.21.15.67:0/3555458653 shutdown_connections 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55621e5217e0 0x55621e523bd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e512fd0 0x55621e519e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e5126b0 0x55621e519950 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 --2- 172.21.15.67:0/3555458653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e4c6400 0x55621e519410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 -- 172.21.15.67:0/3555458653 >> 172.21.15.67:0/3555458653 conn(0x55621e4f3450 msgr2=0x55621e4f5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4148ff9640 0 client.7074 ms_handle_reset on v2:172.21.15.67:6832/1473897687 2024-09-19T05:38:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 -- 172.21.15.67:0/3555458653 shutdown_connections 2024-09-19T05:38:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 1 -- 172.21.15.67:0/3555458653 wait complete. 2024-09-19T05:38:41.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.812+0000 7f4173072000 20 client.7074 trim_cache size 0 max 16384 2024-09-19T05:38:41.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 Processor -- start 2024-09-19T05:38:41.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 -- start start 2024-09-19T05:38:41.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e5237f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e5126b0 0x55621e523d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e512fd0 0x55621e524270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f41681ffbb0 con 0x55621e4c6400 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f41681febd0 con 0x55621e512fd0 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f41681584f0 con 0x55621e5126b0 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416dd52640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e5237f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416dd52640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e5237f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55234/0 (socket says 172.21.15.67:55234) 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416dd52640 1 -- 172.21.15.67:0/4260435707 learned_addr learned my addr 172.21.15.67:0/4260435707 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416d551640 1 --2- 172.21.15.67:0/4260435707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e5126b0 0x55621e523d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416dd52640 1 -- 172.21.15.67:0/4260435707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e5126b0 msgr2=0x55621e523d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416e553640 1 --2- 172.21.15.67:0/4260435707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e512fd0 0x55621e524270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416dd52640 1 --2- 172.21.15.67:0/4260435707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e5126b0 0x55621e523d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416dd52640 1 -- 172.21.15.67:0/4260435707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e512fd0 msgr2=0x55621e524270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416dd52640 1 --2- 172.21.15.67:0/4260435707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e512fd0 0x55621e524270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416dd52640 1 -- 172.21.15.67:0/4260435707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621e2b6770 con 0x55621e4c6400 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f416dd52640 1 --2- 172.21.15.67:0/4260435707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e5237f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f41640059e0 tx=0x7f4164011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2a73c7e7869872 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:41.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f414affd640 1 -- 172.21.15.67:0/4260435707 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4164027040 con 0x55621e4c6400 2024-09-19T05:38:41.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f414affd640 1 -- 172.21.15.67:0/4260435707 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4164007710 con 0x55621e4c6400 2024-09-19T05:38:41.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f414affd640 1 -- 172.21.15.67:0/4260435707 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416400d9a0 con 0x55621e4c6400 2024-09-19T05:38:41.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 -- 172.21.15.67:0/4260435707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 msgr2=0x55621e5237f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 --2- 172.21.15.67:0/4260435707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e5237f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f41640059e0 tx=0x7f4164011000 comp rx=0 tx=0).stop 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 -- 172.21.15.67:0/4260435707 shutdown_connections 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 --2- 172.21.15.67:0/4260435707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e512fd0 0x55621e524270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 --2- 172.21.15.67:0/4260435707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e5126b0 0x55621e523d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 --2- 172.21.15.67:0/4260435707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e4c6400 0x55621e5237f0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 -- 172.21.15.67:0/4260435707 >> 172.21.15.67:0/4260435707 conn(0x55621e4f3450 msgr2=0x55621e4cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 -- 172.21.15.67:0/4260435707 shutdown_connections 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 -- 172.21.15.67:0/4260435707 wait complete. 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 -- start start 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.832+0000 7f4173072000 1 Processor -- start 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e4c6400 0x55621e526c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e5126b0 0x55621e5820b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e512fd0 0x55621e5825f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f41681fe740 con 0x55621e512fd0 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55621e2cff50 con 0x55621e4c6400 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55621e2f0310 con 0x55621e5126b0 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 10 client.0 _ll_register_callbacks cb 0x7f415800c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416e553640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e512fd0 0x55621e5825f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416e553640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e512fd0 0x55621e5825f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55250/0 (socket says 172.21.15.67:55250) 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416e553640 1 -- 172.21.15.67:0/2268897848 learned_addr learned my addr 172.21.15.67:0/2268897848 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416d551640 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e5126b0 0x55621e5820b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416dd52640 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e4c6400 0x55621e526c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416e553640 1 -- 172.21.15.67:0/2268897848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e5126b0 msgr2=0x55621e5820b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416e553640 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e5126b0 0x55621e5820b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416e553640 1 -- 172.21.15.67:0/2268897848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e4c6400 msgr2=0x55621e526c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:41.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416e553640 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e4c6400 0x55621e526c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416e553640 1 -- 172.21.15.67:0/2268897848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621e399880 con 0x55621e512fd0 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416dd52640 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e4c6400 0x55621e526c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416e553640 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e512fd0 0x55621e5825f0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f41600b0040 tx=0x7f416001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b2f92ad93e796c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4148ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4148ff9640 1 -- 172.21.15.67:0/2268897848 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600ed490 con 0x55621e512fd0 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4148ff9640 1 -- 172.21.15.67:0/2268897848 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f41600f1450 con 0x55621e512fd0 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- 172.21.15.67:0/2268897848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4164007710 con 0x55621e512fd0 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4148ff9640 1 -- 172.21.15.67:0/2268897848 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f41600f9dd0 con 0x55621e512fd0 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 10 client.7080 fetch_fsmap learned FSMap version 58 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- 172.21.15.67:0/2268897848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x55621e370590 con 0x55621e512fd0 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4148ff9640 1 -- 172.21.15.67:0/2268897848 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4164007710 con 0x55621e512fd0 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4148ff9640 1 -- 172.21.15.67:0/2268897848 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7f41600f9940 con 0x55621e512fd0 2024-09-19T05:38:41.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 10 client.7080 fetch_fsmap finished waiting for FSMap version 58 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 10 client.7080 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 20 client.7080 populate_metadata read hostname 'smithi067' 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55621e582b30 0x55621e582f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 4 client.7080 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- 172.21.15.67:0/2268897848 --> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) -- 0x55621e3244a0 con 0x55621e582b30 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416dd52640 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55621e582b30 0x55621e582f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416dd52640 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55621e582b30 0x55621e582f40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efe3f298fd0c336e server_cookie=d941f8160f0867b3 in_seq=0 out_seq=0 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4148ff9640 10 client.7080 ms_handle_connect on v2:172.21.15.67:6832/1473897687 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4148ff9640 1 -- 172.21.15.67:0/2268897848 <== mds.0 v2:172.21.15.67:6832/1473897687 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55621e3244a0 con 0x55621e582b30 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4148ff9640 10 client.7080 handle_command_reply: tid=0 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 client.7080 shutdown 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- 172.21.15.67:0/2268897848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e512fd0 msgr2=0x55621e5825f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:41.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e512fd0 0x55621e5825f0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f41600b0040 tx=0x7f416001c970 comp rx=0 tx=0).stop 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- 172.21.15.67:0/2268897848 shutdown_connections 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.67:6832/1473897687,v1:172.21.15.67:6833/1473897687] conn(0x55621e582b30 0x55621e582f40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55621e512fd0 0x55621e5825f0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55621e5126b0 0x55621e5820b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 --2- 172.21.15.67:0/2268897848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55621e4c6400 0x55621e526c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4148ff9640 0 client.7080 ms_handle_reset on v2:172.21.15.67:6832/1473897687 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- 172.21.15.67:0/2268897848 >> 172.21.15.67:0/2268897848 conn(0x55621e4f3450 msgr2=0x55621e4c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- 172.21.15.67:0/2268897848 shutdown_connections 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 1 -- 172.21.15.67:0/2268897848 wait complete. 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f4173072000 20 client.7080 trim_cache size 0 max 16384 2024-09-19T05:38:41.846 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:38:41.847 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:38:41.847 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "3ad08d7e-500f-4b82-af9d-b65593d2e6e8", 2024-09-19T05:38:41.847 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:38:41.847 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416ffb6640 1 -- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 msgr2=0x7f414c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416ffb6640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 0x7f414c069d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4164005890 tx=0x7f4164009040 comp rx=0 tx=0).stop 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416ffb6640 1 -- 172.21.15.67:0/3663441685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680d0520 msgr2=0x7f416814d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416ffb6640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680d0520 0x7f416814d580 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4160009d90 tx=0x7f4160019710 comp rx=0 tx=0).stop 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416ffb6640 1 -- 172.21.15.67:0/3663441685 shutdown_connections 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416ffb6640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41680d0520 0x7f416814d580 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416ffb6640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f414c0678c0 0x7f414c069d80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416ffb6640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41680addf0 0x7f416814d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416ffb6640 1 --2- 172.21.15.67:0/3663441685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41680738b0 0x7f41680cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.836+0000 7f416ffb6640 1 -- 172.21.15.67:0/3663441685 >> 172.21.15.67:0/3663441685 conn(0x7f416806c0c0 msgr2=0x7f416815cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:41.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.840+0000 7f416ffb6640 1 -- 172.21.15.67:0/3663441685 shutdown_connections 2024-09-19T05:38:41.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:41.840+0000 7f416ffb6640 1 -- 172.21.15.67:0/3663441685 wait complete. 2024-09-19T05:38:41.859 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '3ad08d7e-500f-4b82-af9d-b65593d2e6e8', 'mode': 'asynchronous'}' 2024-09-19T05:38:51.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:51.860 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-19T05:38:51.874 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:38:51.874 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:38:51.988 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:38:52.072 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:38:52.072 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:38:52.072 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:38:52.072 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:52.079 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:38:52.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.252+0000 7fe4ad2dc640 1 Processor -- start 2024-09-19T05:38:52.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.252+0000 7fe4ad2dc640 1 -- start start 2024-09-19T05:38:52.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4ad2dc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe4a806f460 0x7fe4a806f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4ad2dc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a806e3c0 con 0x7fe4a806dde0 2024-09-19T05:38:52.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4ad2dc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a806e6a0 con 0x7fe4a815c030 2024-09-19T05:38:52.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4ad2dc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a806e980 con 0x7fe4a806f460 2024-09-19T05:38:52.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a67fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe4a806dde0 0x7fe4a80b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48736/0 (socket says 172.21.15.67:48736) 2024-09-19T05:38:52.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a67fc640 1 -- 172.21.15.67:0/158443825 learned_addr learned my addr 172.21.15.67:0/158443825 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:52.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a77fe640 1 --2- 172.21.15.67:0/158443825 >> v2:172.21.15.97:3300/0 conn(0x7fe4a806f460 0x7fe4a806f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392763490 0 0) 0x7fe4a806e3c0 con 0x7fe4a806dde0 2024-09-19T05:38:52.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe494003530 con 0x7fe4a806dde0 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 623327202 0 0) 0x7fe494003530 con 0x7fe4a806dde0 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 >> v2:172.21.15.97:3300/0 conn(0x7fe4a806f460 msgr2=0x7fe4a806f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 --2- 172.21.15.67:0/158443825 >> v2:172.21.15.97:3300/0 conn(0x7fe4a806f460 0x7fe4a806f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 >> v1:172.21.15.97:6789/0 conn(0x7fe4a815c030 legacy=0x7fe4a815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a806ec60 con 0x7fe4a806dde0 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fe490001680 con 0x7fe4a806dde0 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 >> v1:172.21.15.67:6789/0 conn(0x7fe4a806dde0 legacy=0x7fe4a80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4940039c0 0x7fe494003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe494004810 0x7fe494004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe49400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a806e980 con 0x7fe4940051d0 2024-09-19T05:38:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe49400c070 con 0x7fe4940039c0 2024-09-19T05:38:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe49400c270 con 0x7fe494004810 2024-09-19T05:38:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a77fe640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe49400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a6ffd640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4940039c0 0x7fe494003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a67fc640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe494004810 0x7fe494004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a77fe640 1 -- 172.21.15.67:0/158443825 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe494004810 msgr2=0x7fe494004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a77fe640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe494004810 0x7fe494004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a77fe640 1 -- 172.21.15.67:0/158443825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4940039c0 msgr2=0x7fe494003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a77fe640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4940039c0 0x7fe494003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.256+0000 7fe4a77fe640 1 -- 172.21.15.67:0/158443825 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe494003530 con 0x7fe4940051d0 2024-09-19T05:38:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a77fe640 1 -- 172.21.15.67:0/158443825 reap_dead start 2024-09-19T05:38:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a77fe640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe49400b9d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe498009ae0 tx=0x7fe49801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a454241a8ee60af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4980096b0 con 0x7fe4940051d0 2024-09-19T05:38:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe498004020 con 0x7fe4940051d0 2024-09-19T05:38:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a5ffb640 1 -- 172.21.15.67:0/158443825 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498004410 con 0x7fe4940051d0 2024-09-19T05:38:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/158443825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 msgr2=0x7fe49400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe49400b9d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe498009ae0 tx=0x7fe49801cab0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/158443825 shutdown_connections 2024-09-19T05:38:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 --2- 172.21.15.67:0/158443825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe49400b9d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/158443825 >> 172.21.15.67:0/158443825 conn(0x7fe4a80d0080 msgr2=0x7fe4a80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:52.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/158443825 shutdown_connections 2024-09-19T05:38:52.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/158443825 wait complete. 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 Processor -- start 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 -- start start 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe4a8152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4a8154680 0x7fe4a815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a8154b00 0x7fe4a8099550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a815c590 con 0x7fe4940051d0 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a815c410 con 0x7fe4a8154b00 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4ad2dc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a806f870 con 0x7fe4a8154680 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe4a8152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe4a8152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56372/0 (socket says 172.21.15.67:56372) 2024-09-19T05:38:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a6ffd640 1 -- 172.21.15.67:0/2517113890 learned_addr learned my addr 172.21.15.67:0/2517113890 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a67fc640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4a8154680 0x7fe4a815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a77fe640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a8154b00 0x7fe4a8099550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a6ffd640 1 -- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4a8154680 msgr2=0x7fe4a815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a6ffd640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4a8154680 0x7fe4a815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a6ffd640 1 -- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a8154b00 msgr2=0x7fe4a8099550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a6ffd640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a8154b00 0x7fe4a8099550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a6ffd640 1 -- 172.21.15.67:0/2517113890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a814ff10 con 0x7fe4940051d0 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.260+0000 7fe4a77fe640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a8154b00 0x7fe4a8099550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe4a6ffd640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe4a8152dd0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000f9b0 tx=0x7fe4a000fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe49f7fe640 1 -- 172.21.15.67:0/2517113890 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0003b90 con 0x7fe4940051d0 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe49f7fe640 1 -- 172.21.15.67:0/2517113890 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a0018070 con 0x7fe4940051d0 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/2517113890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a8154fd0 con 0x7fe4940051d0 2024-09-19T05:38:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe49f7fe640 1 -- 172.21.15.67:0/2517113890 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000d790 con 0x7fe4940051d0 2024-09-19T05:38:52.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/2517113890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a81501b0 con 0x7fe4940051d0 2024-09-19T05:38:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/2517113890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a806fc00 con 0x7fe4940051d0 2024-09-19T05:38:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe49f7fe640 1 -- 172.21.15.67:0/2517113890 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4a000d930 con 0x7fe4940051d0 2024-09-19T05:38:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe49f7fe640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4880678f0 0x7fe488069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe49f7fe640 1 -- 172.21.15.67:0/2517113890 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fe4a0085fb0 con 0x7fe4940051d0 2024-09-19T05:38:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe4a67fc640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4880678f0 0x7fe488069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.264+0000 7fe4a67fc640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4880678f0 0x7fe488069db0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe4a815ba50 tx=0x7fe490009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:52.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.268+0000 7fe49f7fe640 1 -- 172.21.15.67:0/2517113890 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe4a001a310 con 0x7fe4940051d0 2024-09-19T05:38:52.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.440+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/2517113890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe4a813ece0 con 0x7fe4940051d0 2024-09-19T05:38:52.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe49f7fe640 1 -- 172.21.15.67:0/2517113890 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v89) ==== 80+0+122 (secure 0 0 0) 0x7fe4a0056880 con 0x7fe4940051d0 2024-09-19T05:38:52.446 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6834/3597291023 2024-09-20T05:38:34.321559+0000 2024-09-19T05:38:52.446 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6832/3597291023 2024-09-20T05:38:34.321559+0000 2024-09-19T05:38:52.447 INFO:teuthology.orchestra.run.smithi067.stderr:listed 2 entries 2024-09-19T05:38:52.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4880678f0 msgr2=0x7fe488069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4880678f0 0x7fe488069db0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe4a815ba50 tx=0x7fe490009040 comp rx=0 tx=0).stop 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/2517113890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 msgr2=0x7fe4a8152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe4a8152dd0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000f9b0 tx=0x7fe4a000fe70 comp rx=0 tx=0).stop 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/2517113890 shutdown_connections 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a8154b00 0x7fe4a8099550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4880678f0 0x7fe488069db0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4a8154680 0x7fe4a815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 --2- 172.21.15.67:0/2517113890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4940051d0 0x7fe4a8152dd0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/2517113890 >> 172.21.15.67:0/2517113890 conn(0x7fe4a80d0080 msgr2=0x7fe4a8140250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/2517113890 shutdown_connections 2024-09-19T05:38:52.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.444+0000 7fe4ad2dc640 1 -- 172.21.15.67:0/2517113890 wait complete. 2024-09-19T05:38:52.464 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:38:52.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:52.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:52.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[56881]: fuse finished with error 0 and tester_r 0 2024-09-19T05:38:52.476 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:38:52.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:52.476 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:38:52.575 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:38:52.575 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:38:52.576 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:52.582 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:38:52.582 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:38:52.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:52.582 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:38:52.631 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:38:52.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:38:52.632 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:38:52.632 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:38:52.632 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:52.638 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:38:52.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:38:52.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:52.638 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:38:52.686 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:38:52.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:38:52.687 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:38:52.687 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:38:52.688 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:38:52.695 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:38:52.695 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:38:52.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:52.696 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:38:52.743 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:38:52.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:38:52.745 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f9322a74640 1 Processor -- start 2024-09-19T05:38:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f9322a74640 1 -- start start 2024-09-19T05:38:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f9322a74640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c161da0 0x7f931c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f9322a74640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931c0d4d40 con 0x7f931c0d0e80 2024-09-19T05:38:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f9322a74640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931c0d5020 con 0x7f931c0d0160 2024-09-19T05:38:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f9322a74640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f931c0d0610 con 0x7f931c161da0 2024-09-19T05:38:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f931c0d0e80 0x7f931c0b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48740/0 (socket says 172.21.15.67:48740) 2024-09-19T05:38:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931bfff640 1 -- 172.21.15.67:0/222959624 learned_addr learned my addr 172.21.15.67:0/222959624 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f9320810640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c161da0 0x7f931c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042673339 0 0) 0x7f931c0d4d40 con 0x7f931c0d0e80 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9304003530 con 0x7f931c0d0e80 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2690425574 0 0) 0x7f9304003530 con 0x7f931c0d0e80 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c161da0 msgr2=0x7f931c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c161da0 0x7f931c0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 >> v1:172.21.15.97:6789/0 conn(0x7f931c0d0160 legacy=0x7f931c0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c0d5300 con 0x7f931c0d0e80 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9310001680 con 0x7f931c0d0e80 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 >> v1:172.21.15.67:6789/0 conn(0x7f931c0d0e80 legacy=0x7f931c0b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c161da0 0x7f93040039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9304003f70 0x7f9304004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9304004d50 0x7f93040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f930400ba80 con 0x7f9304003f70 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f930400bc30 con 0x7f9304004d50 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f930400be30 con 0x7f931c161da0 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931bfff640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9304003f70 0x7f9304004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f9320810640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c161da0 0x7f93040039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f9321011640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9304004d50 0x7f93040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931bfff640 1 -- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c161da0 msgr2=0x7f93040039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931bfff640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c161da0 0x7f93040039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931bfff640 1 -- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9304004d50 msgr2=0x7f93040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931bfff640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9304004d50 0x7f93040051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f931bfff640 1 -- 172.21.15.67:0/222959624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9304003530 con 0x7f9304003f70 2024-09-19T05:38:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.872+0000 7f9321011640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9304004d50 0x7f93040051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:52.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f931bfff640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9304003f70 0x7f9304004810 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f931000c210 tx=0x7f931001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1662ec8417a042c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:52.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310007d20 con 0x7f9304003f70 2024-09-19T05:38:52.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9310005ae0 con 0x7f9304003f70 2024-09-19T05:38:52.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f931b7fe640 1 -- 172.21.15.67:0/222959624 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310007070 con 0x7f9304003f70 2024-09-19T05:38:52.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f9322a74640 1 -- 172.21.15.67:0/222959624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9304003f70 msgr2=0x7f9304004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f9322a74640 1 --2- 172.21.15.67:0/222959624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9304003f70 0x7f9304004810 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f931000c210 tx=0x7f931001f3b0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f9321011640 1 -- 172.21.15.67:0/222959624 reap_dead start 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f9322a74640 1 -- 172.21.15.67:0/222959624 shutdown_connections 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f9322a74640 1 -- 172.21.15.67:0/222959624 >> 172.21.15.67:0/222959624 conn(0x7f931c08bfc0 msgr2=0x7f931c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f9322a74640 1 -- 172.21.15.67:0/222959624 shutdown_connections 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f9322a74640 1 -- 172.21.15.67:0/222959624 wait complete. 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f9322a74640 1 Processor -- start 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.876+0000 7f9322a74640 1 -- start start 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9322a74640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9304003f70 0x7f931c1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9322a74640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f931c0b7c60 0x7f931c15f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9322a74640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c15fc30 0x7f931c1f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9322a74640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f931c0b5d00 con 0x7f931c15fc30 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9322a74640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f931c0d0840 con 0x7f931c0b7c60 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9322a74640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f931c162180 con 0x7f9304003f70 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9321011640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c15fc30 0x7f931c1f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9321011640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c15fc30 0x7f931c1f77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56382/0 (socket says 172.21.15.67:56382) 2024-09-19T05:38:52.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9321011640 1 -- 172.21.15.67:0/2137544097 learned_addr learned my addr 172.21.15.67:0/2137544097 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:52.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9320810640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9304003f70 0x7f931c1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f931bfff640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f931c0b7c60 0x7f931c15f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9321011640 1 -- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9304003f70 msgr2=0x7f931c1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9321011640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9304003f70 0x7f931c1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9321011640 1 -- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f931c0b7c60 msgr2=0x7f931c15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:52.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9321011640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f931c0b7c60 0x7f931c15f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:52.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9321011640 1 -- 172.21.15.67:0/2137544097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c159aa0 con 0x7f931c15fc30 2024-09-19T05:38:52.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f931bfff640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f931c0b7c60 0x7f931c15f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:52.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9321011640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c15fc30 0x7f931c1f77c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f931c0b6f90 tx=0x7f931400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:52.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f93197fa640 1 -- 172.21.15.67:0/2137544097 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314006d60 con 0x7f931c15fc30 2024-09-19T05:38:52.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f93197fa640 1 -- 172.21.15.67:0/2137544097 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9314003980 con 0x7f931c15fc30 2024-09-19T05:38:52.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9322a74640 1 -- 172.21.15.67:0/2137544097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c159810 con 0x7f931c15fc30 2024-09-19T05:38:52.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f93197fa640 1 -- 172.21.15.67:0/2137544097 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314003db0 con 0x7f931c15fc30 2024-09-19T05:38:52.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9322a74640 1 -- 172.21.15.67:0/2137544097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c0b7560 con 0x7f931c15fc30 2024-09-19T05:38:52.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f9322a74640 1 -- 172.21.15.67:0/2137544097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931c0d1af0 con 0x7f931c15fc30 2024-09-19T05:38:52.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.880+0000 7f93197fa640 1 -- 172.21.15.67:0/2137544097 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f931401b020 con 0x7f931c15fc30 2024-09-19T05:38:52.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.884+0000 7f93197fa640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93080678c0 0x7f9308069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:52.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.884+0000 7f93197fa640 1 -- 172.21.15.67:0/2137544097 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f93140860e0 con 0x7f931c15fc30 2024-09-19T05:38:52.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.884+0000 7f9320810640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93080678c0 0x7f9308069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:52.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.884+0000 7f9320810640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93080678c0 0x7f9308069d80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f930c009a30 tx=0x7f930c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:52.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:52.884+0000 7f93197fa640 1 -- 172.21.15.67:0/2137544097 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9314022070 con 0x7f931c15fc30 2024-09-19T05:38:53.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.084+0000 7f9322a74640 1 -- 172.21.15.67:0/2137544097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f931c0d0c10 con 0x7f931c15fc30 2024-09-19T05:38:53.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.084+0000 7f93197fa640 1 -- 172.21.15.67:0/2137544097 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5223 (secure 0 0 0) 0x7f9314056590 con 0x7f931c15fc30 2024-09-19T05:38:53.088 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:53.089 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":58,"btime":"2024-09-19T05:38:38:100892+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1497173986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1497173986},{"type":"v1","addr":"172.21.15.97:6835","nonce":1497173986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4151620700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4151620700},{"type":"v1","addr":"172.21.15.97:6837","nonce":4151620700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/491214453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":491214453},{"type":"v1","addr":"172.21.15.67:6835","nonce":491214453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:38:17.483070+0000","modified":"2024-09-19T05:38:38.100875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6833/1473897687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1473897687},{"type":"v1","addr":"172.21.15.67:6833","nonce":1473897687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6999,"qdb_cluster":[6999]},"id":5}]} 2024-09-19T05:38:53.089 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 58 2024-09-19T05:38:53.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 -- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93080678c0 msgr2=0x7f9308069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93080678c0 0x7f9308069d80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f930c009a30 tx=0x7f930c008040 comp rx=0 tx=0).stop 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 -- 172.21.15.67:0/2137544097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c15fc30 msgr2=0x7f931c1f77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c15fc30 0x7f931c1f77c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f931c0b6f90 tx=0x7f931400dc00 comp rx=0 tx=0).stop 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 -- 172.21.15.67:0/2137544097 shutdown_connections 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c15fc30 0x7f931c1f77c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f931c0b7c60 0x7f931c15f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93080678c0 0x7f9308069d80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 --2- 172.21.15.67:0/2137544097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9304003f70 0x7f931c1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 -- 172.21.15.67:0/2137544097 >> 172.21.15.67:0/2137544097 conn(0x7f931c08bfc0 msgr2=0x7f931c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 -- 172.21.15.67:0/2137544097 shutdown_connections 2024-09-19T05:38:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.088+0000 7f9322a74640 1 -- 172.21.15.67:0/2137544097 wait complete. 2024-09-19T05:38:53.108 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:53.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc140e2640 1 Processor -- start 2024-09-19T05:38:53.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc140e2640 1 -- start start 2024-09-19T05:38:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc140e2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc0c15c030 0x7fcc0c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc140e2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15d1d0 0x7fcc0c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc140e2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcc0c0b3510 0x7fcc0c06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc140e2640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fcc0c06e3c0 con 0x7fcc0c0b3510 2024-09-19T05:38:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc140e2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fcc0c06e6a0 con 0x7fcc0c15c030 2024-09-19T05:38:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc140e2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0c06e980 con 0x7fcc0c15d1d0 2024-09-19T05:38:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc1267f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcc0c0b3510 0x7fcc0c06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc1267f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcc0c0b3510 0x7fcc0c06f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56396/0 (socket says 172.21.15.67:56396) 2024-09-19T05:38:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc1267f640 1 -- 172.21.15.67:0/387890963 learned_addr learned my addr 172.21.15.67:0/387890963 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc11e7e640 1 --2- 172.21.15.67:0/387890963 >> v2:172.21.15.97:3300/0 conn(0x7fcc0c15c030 0x7fcc0c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc1167d640 1 --2- 172.21.15.67:0/387890963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15d1d0 0x7fcc0c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc1267f640 1 -- 172.21.15.67:0/387890963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15d1d0 msgr2=0x7fcc0c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc1267f640 1 --2- 172.21.15.67:0/387890963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15d1d0 0x7fcc0c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc1267f640 1 -- 172.21.15.67:0/387890963 >> v2:172.21.15.97:3300/0 conn(0x7fcc0c15c030 msgr2=0x7fcc0c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc1267f640 1 --2- 172.21.15.67:0/387890963 >> v2:172.21.15.97:3300/0 conn(0x7fcc0c15c030 0x7fcc0c06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc1267f640 1 -- 172.21.15.67:0/387890963 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c06ec60 con 0x7fcc0c0b3510 2024-09-19T05:38:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc11e7e640 1 --2- 172.21.15.67:0/387890963 >> v2:172.21.15.97:3300/0 conn(0x7fcc0c15c030 0x7fcc0c06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.232+0000 7fcc1167d640 1 --2- 172.21.15.67:0/387890963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15d1d0 0x7fcc0c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc1267f640 1 --2- 172.21.15.67:0/387890963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 0x7fcc0c06f460 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c070390 tx=0x7fcc0401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54128dc34be961d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc10e7c640 1 -- 172.21.15.67:0/387890963 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040a56c0 con 0x7fcc0c0b3510 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc10e7c640 1 -- 172.21.15.67:0/387890963 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc040a5860 con 0x7fcc0c0b3510 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc10e7c640 1 -- 172.21.15.67:0/387890963 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040a5c30 con 0x7fcc0c0b3510 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 -- 172.21.15.67:0/387890963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 msgr2=0x7fcc0c06f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 --2- 172.21.15.67:0/387890963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 0x7fcc0c06f460 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c070390 tx=0x7fcc0401c930 comp rx=0 tx=0).stop 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 -- 172.21.15.67:0/387890963 shutdown_connections 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 --2- 172.21.15.67:0/387890963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 0x7fcc0c06f460 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 --2- 172.21.15.67:0/387890963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15d1d0 0x7fcc0c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 --2- 172.21.15.67:0/387890963 >> v2:172.21.15.97:3300/0 conn(0x7fcc0c15c030 0x7fcc0c06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 -- 172.21.15.67:0/387890963 >> 172.21.15.67:0/387890963 conn(0x7fcc0c0d0080 msgr2=0x7fcc0c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 -- 172.21.15.67:0/387890963 shutdown_connections 2024-09-19T05:38:53.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 -- 172.21.15.67:0/387890963 wait complete. 2024-09-19T05:38:53.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 Processor -- start 2024-09-19T05:38:53.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 -- start start 2024-09-19T05:38:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 0x7fcc0c14c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15c030 0x7fcc0c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc0c15d1d0 0x7fcc0c15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c15fec0 con 0x7fcc0c0b3510 2024-09-19T05:38:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c15fd40 con 0x7fcc0c15d1d0 2024-09-19T05:38:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc140e2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0c160040 con 0x7fcc0c15c030 2024-09-19T05:38:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc11e7e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 0x7fcc0c14c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc11e7e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 0x7fcc0c14c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56410/0 (socket says 172.21.15.67:56410) 2024-09-19T05:38:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.236+0000 7fcc11e7e640 1 -- 172.21.15.67:0/1208917484 learned_addr learned my addr 172.21.15.67:0/1208917484 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc1267f640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc0c15d1d0 0x7fcc0c15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc1167d640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15c030 0x7fcc0c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc11e7e640 1 -- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15c030 msgr2=0x7fcc0c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc11e7e640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15c030 0x7fcc0c15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc11e7e640 1 -- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc0c15d1d0 msgr2=0x7fcc0c15f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc11e7e640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc0c15d1d0 0x7fcc0c15f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc11e7e640 1 -- 172.21.15.67:0/1208917484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c09a630 con 0x7fcc0c0b3510 2024-09-19T05:38:53.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc11e7e640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 0x7fcc0c14c5b0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c7f0 tx=0x7fcc0800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:53.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc027fc640 1 -- 172.21.15.67:0/1208917484 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08007a30 con 0x7fcc0c0b3510 2024-09-19T05:38:53.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc027fc640 1 -- 172.21.15.67:0/1208917484 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc08007bd0 con 0x7fcc0c0b3510 2024-09-19T05:38:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc140e2640 1 -- 172.21.15.67:0/1208917484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0c153da0 con 0x7fcc0c0b3510 2024-09-19T05:38:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc027fc640 1 -- 172.21.15.67:0/1208917484 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc080113f0 con 0x7fcc0c0b3510 2024-09-19T05:38:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc140e2640 1 -- 172.21.15.67:0/1208917484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc0c14caf0 con 0x7fcc0c0b3510 2024-09-19T05:38:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc140e2640 1 -- 172.21.15.67:0/1208917484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0c06dde0 con 0x7fcc0c0b3510 2024-09-19T05:38:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc027fc640 1 -- 172.21.15.67:0/1208917484 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc08011590 con 0x7fcc0c0b3510 2024-09-19T05:38:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc027fc640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678c0 0x7fcbf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc027fc640 1 -- 172.21.15.67:0/1208917484 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fcc08086070 con 0x7fcc0c0b3510 2024-09-19T05:38:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc1167d640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678c0 0x7fcbf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.240+0000 7fcc1167d640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678c0 0x7fcbf0069d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc006fd0 tx=0x7fcbfc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:53.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.244+0000 7fcc027fc640 1 -- 172.21.15.67:0/1208917484 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fcc08015020 con 0x7fcc0c0b3510 2024-09-19T05:38:53.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.444+0000 7fcc140e2640 1 -- 172.21.15.67:0/1208917484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc0c0d0f20 con 0x7fcc0c0b3510 2024-09-19T05:38:53.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc027fc640 1 -- 172.21.15.67:0/1208917484 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5223 (secure 0 0 0) 0x7fcc080569d0 con 0x7fcc0c0b3510 2024-09-19T05:38:53.451 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:53.451 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":58,"btime":"2024-09-19T05:38:38:100892+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1497173986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1497173986},{"type":"v1","addr":"172.21.15.97:6835","nonce":1497173986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4151620700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4151620700},{"type":"v1","addr":"172.21.15.97:6837","nonce":4151620700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/491214453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":491214453},{"type":"v1","addr":"172.21.15.67:6835","nonce":491214453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:38:17.483070+0000","modified":"2024-09-19T05:38:38.100875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6833/1473897687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1473897687},{"type":"v1","addr":"172.21.15.67:6833","nonce":1473897687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6999,"qdb_cluster":[6999]},"id":5}]} 2024-09-19T05:38:53.451 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 58 2024-09-19T05:38:53.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 -- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678c0 msgr2=0x7fcbf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678c0 0x7fcbf0069d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc006fd0 tx=0x7fcbfc008040 comp rx=0 tx=0).stop 2024-09-19T05:38:53.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 -- 172.21.15.67:0/1208917484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 msgr2=0x7fcc0c14c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 0x7fcc0c14c5b0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c7f0 tx=0x7fcc0800ccb0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 -- 172.21.15.67:0/1208917484 shutdown_connections 2024-09-19T05:38:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc0c15d1d0 0x7fcc0c15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcbf00678c0 0x7fcbf0069d80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc0c15c030 0x7fcc0c15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 --2- 172.21.15.67:0/1208917484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc0c0b3510 0x7fcc0c14c5b0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 -- 172.21.15.67:0/1208917484 >> 172.21.15.67:0/1208917484 conn(0x7fcc0c0d0080 msgr2=0x7fcc0c0b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 -- 172.21.15.67:0/1208917484 shutdown_connections 2024-09-19T05:38:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.448+0000 7fcc140e2640 1 -- 172.21.15.67:0/1208917484 wait complete. 2024-09-19T05:38:53.471 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.588+0000 7f1f5d578640 1 Processor -- start 2024-09-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.588+0000 7f1f5d578640 1 -- start start 2024-09-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f5d578640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f58162630 0x7f1f58071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f5d578640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f580cc3c0 0x7f1f58072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f5d578640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5806ecc0 con 0x7f1f58162a10 2024-09-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f5d578640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1f580cfe80 con 0x7f1f58162630 2024-09-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f5d578640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5806ef50 con 0x7f1f580cc3c0 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f567fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1f58162a10 0x7f1f58166380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48744/0 (socket says 172.21.15.67:48744) 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f567fc640 1 -- 172.21.15.67:0/3233403273 learned_addr learned my addr 172.21.15.67:0/3233403273 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f577fe640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f580cc3c0 0x7f1f58072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f56ffd640 1 --2- 172.21.15.67:0/3233403273 >> v2:172.21.15.97:3300/0 conn(0x7f1f58162630 0x7f1f58071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134759530 0 0) 0x7f1f5806ecc0 con 0x7f1f58162a10 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f44003530 con 0x7f1f58162a10 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 835009185 0 0) 0x7f1f44003530 con 0x7f1f58162a10 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f580cc3c0 msgr2=0x7f1f58072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f580cc3c0 0x7f1f58072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 >> v2:172.21.15.97:3300/0 conn(0x7f1f58162630 msgr2=0x7f1f58071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 --2- 172.21.15.67:0/3233403273 >> v2:172.21.15.97:3300/0 conn(0x7f1f58162630 0x7f1f58071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5806f230 con 0x7f1f58162a10 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1f40001a00 con 0x7f1f58162a10 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 >> v1:172.21.15.67:6789/0 conn(0x7f1f58162a10 legacy=0x7f1f58166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f580cc3c0 0x7f1f440039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f44003f40 0x7f1f44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f44004d50 0x7f1f440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1f580cfe80 con 0x7f1f44003f40 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5806ef50 con 0x7f1f44004d50 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4400ba20 con 0x7f1f580cc3c0 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f567fc640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f44003f40 0x7f1f44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f56ffd640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f580cc3c0 0x7f1f440039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f567fc640 1 -- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f580cc3c0 msgr2=0x7f1f440039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f567fc640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f580cc3c0 0x7f1f440039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f567fc640 1 -- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f44004d50 msgr2=0x7f1f440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f577fe640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f44004d50 0x7f1f440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f567fc640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f44004d50 0x7f1f440051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.592+0000 7f1f567fc640 1 -- 172.21.15.67:0/3233403273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f44003530 con 0x7f1f44003f40 2024-09-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f567fc640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f44003f40 0x7f1f44004810 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000a870 tx=0x7f1f4001d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed046caec6e87b32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4000a4c0 con 0x7f1f44003f40 2024-09-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f400ad630 con 0x7f1f44003f40 2024-09-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f55ffb640 1 -- 172.21.15.67:0/3233403273 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400ada20 con 0x7f1f44003f40 2024-09-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 -- 172.21.15.67:0/3233403273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f44003f40 msgr2=0x7f1f44004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 --2- 172.21.15.67:0/3233403273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f44003f40 0x7f1f44004810 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000a870 tx=0x7f1f4001d330 comp rx=0 tx=0).stop 2024-09-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f577fe640 1 -- 172.21.15.67:0/3233403273 reap_dead start 2024-09-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 -- 172.21.15.67:0/3233403273 shutdown_connections 2024-09-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 -- 172.21.15.67:0/3233403273 >> 172.21.15.67:0/3233403273 conn(0x7f1f580d0080 msgr2=0x7f1f580d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 -- 172.21.15.67:0/3233403273 shutdown_connections 2024-09-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 -- 172.21.15.67:0/3233403273 wait complete. 2024-09-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 Processor -- start 2024-09-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 -- start start 2024-09-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f44003f40 0x7f1f5809be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5815d190 0x7f1f58160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f58160bb0 0x7f1f5809a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58072690 con 0x7f1f58160bb0 2024-09-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58072510 con 0x7f1f44003f40 2024-09-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f5d578640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1f58072810 con 0x7f1f5815d190 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f58160bb0 0x7f1f5809a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f58160bb0 0x7f1f5809a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56420/0 (socket says 172.21.15.67:56420) 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f577fe640 1 -- 172.21.15.67:0/2846675899 learned_addr learned my addr 172.21.15.67:0/2846675899 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f56ffd640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f44003f40 0x7f1f5809be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f567fc640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5815d190 0x7f1f58160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f577fe640 1 -- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5815d190 msgr2=0x7f1f58160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f577fe640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5815d190 0x7f1f58160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f577fe640 1 -- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f44003f40 msgr2=0x7f1f5809be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f577fe640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f44003f40 0x7f1f5809be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f577fe640 1 -- 172.21.15.67:0/2846675899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5816a450 con 0x7f1f58160bb0 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f577fe640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f58160bb0 0x7f1f5809a1a0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1f580cfe50 tx=0x7f1f50010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.596+0000 7f1f4f7fe640 1 -- 172.21.15.67:0/2846675899 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000f040 con 0x7f1f58160bb0 2024-09-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.600+0000 7f1f4f7fe640 1 -- 172.21.15.67:0/2846675899 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5000e8d0 con 0x7f1f58160bb0 2024-09-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.600+0000 7f1f5d578640 1 -- 172.21.15.67:0/2846675899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5816a6f0 con 0x7f1f58160bb0 2024-09-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.600+0000 7f1f4f7fe640 1 -- 172.21.15.67:0/2846675899 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000ecc0 con 0x7f1f58160bb0 2024-09-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.600+0000 7f1f5d578640 1 -- 172.21.15.67:0/2846675899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5816acb0 con 0x7f1f58160bb0 2024-09-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.600+0000 7f1f5d578640 1 -- 172.21.15.67:0/2846675899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f58071fd0 con 0x7f1f58160bb0 2024-09-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.600+0000 7f1f4f7fe640 1 -- 172.21.15.67:0/2846675899 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f5001c400 con 0x7f1f58160bb0 2024-09-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.600+0000 7f1f4f7fe640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f380678c0 0x7f1f38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.600+0000 7f1f4f7fe640 1 -- 172.21.15.67:0/2846675899 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f1f50086180 con 0x7f1f58160bb0 2024-09-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.600+0000 7f1f56ffd640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f380678c0 0x7f1f38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.600+0000 7f1f56ffd640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f380678c0 0x7f1f38069d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1f581613d0 tx=0x7f1f48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.604+0000 7f1f4f7fe640 1 -- 172.21.15.67:0/2846675899 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1f50018030 con 0x7f1f58160bb0 2024-09-19T05:38:53.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.772+0000 7f1f5d578640 1 -- 172.21.15.67:0/2846675899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f580701a0 con 0x7f1f58160bb0 2024-09-19T05:38:53.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.772+0000 7f1f4f7fe640 1 -- 172.21.15.67:0/2846675899 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17098 (secure 0 0 0) 0x7f1f5000ee60 con 0x7f1f58160bb0 2024-09-19T05:38:53.777 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":89,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:38:34.321592+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:38:15.164842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-19T05:38:16.488698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6834/3597291023":"2024-09-20T05:38:34.321559+0000","172.21.15.67:6832/3597291023":"2024-09-20T05:38:34.321559+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:53.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 -- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f380678c0 msgr2=0x7f1f38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f380678c0 0x7f1f38069d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1f581613d0 tx=0x7f1f48008040 comp rx=0 tx=0).stop 2024-09-19T05:38:53.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 -- 172.21.15.67:0/2846675899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f58160bb0 msgr2=0x7f1f5809a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f58160bb0 0x7f1f5809a1a0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1f580cfe50 tx=0x7f1f50010c20 comp rx=0 tx=0).stop 2024-09-19T05:38:53.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 -- 172.21.15.67:0/2846675899 shutdown_connections 2024-09-19T05:38:53.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f58160bb0 0x7f1f5809a1a0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1f380678c0 0x7f1f38069d80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f5815d190 0x7f1f58160670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 --2- 172.21.15.67:0/2846675899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f44003f40 0x7f1f5809be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 -- 172.21.15.67:0/2846675899 >> 172.21.15.67:0/2846675899 conn(0x7f1f580d0080 msgr2=0x7f1f5815d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:53.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 -- 172.21.15.67:0/2846675899 shutdown_connections 2024-09-19T05:38:53.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.776+0000 7f1f5d578640 1 -- 172.21.15.67:0/2846675899 wait complete. 2024-09-19T05:38:53.797 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:38:53.798 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:53.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.912+0000 7ff0e4601640 1 Processor -- start 2024-09-19T05:38:53.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.912+0000 7ff0e4601640 1 -- start start 2024-09-19T05:38:53.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e4601640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0dc0d0b90 0x7ff0dc0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e4601640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0dc071e50 con 0x7ff0dc15f830 2024-09-19T05:38:53.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e4601640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0dc072130 con 0x7ff0dc0d0720 2024-09-19T05:38:53.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e4601640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff0dc070bd0 con 0x7ff0dc0d0b90 2024-09-19T05:38:53.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e2b9e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0dc0d0b90 0x7ff0dc0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e239d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff0dc15f830 0x7ff0dc0ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48746/0 (socket says 172.21.15.67:48746) 2024-09-19T05:38:53.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e239d640 1 -- 172.21.15.67:0/2499958287 learned_addr learned my addr 172.21.15.67:0/2499958287 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:53.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e2b9e640 1 -- 172.21.15.67:0/2499958287 >> v1:172.21.15.97:6789/0 conn(0x7ff0dc0d0720 legacy=0x7ff0dc0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:53.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e2b9e640 1 -- 172.21.15.67:0/2499958287 >> v1:172.21.15.67:6789/0 conn(0x7ff0dc15f830 legacy=0x7ff0dc0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e139b640 1 -- 172.21.15.67:0/2499958287 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339332361 0 0) 0x7ff0dc071e50 con 0x7ff0dc15f830 2024-09-19T05:38:53.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e2b9e640 1 -- 172.21.15.67:0/2499958287 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc070eb0 con 0x7ff0dc0d0b90 2024-09-19T05:38:53.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e2b9e640 1 --2- 172.21.15.67:0/2499958287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0b90 0x7ff0dc0cd5a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40097c0 tx=0x7ff0d401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79b040725e26e51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:53.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e139b640 1 -- 172.21.15.67:0/2499958287 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40ab650 con 0x7ff0dc0d0b90 2024-09-19T05:38:53.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e139b640 1 -- 172.21.15.67:0/2499958287 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d40b0070 con 0x7ff0dc0d0b90 2024-09-19T05:38:53.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.916+0000 7ff0e139b640 1 -- 172.21.15.67:0/2499958287 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40aba10 con 0x7ff0dc0d0b90 2024-09-19T05:38:53.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- 172.21.15.67:0/2499958287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0b90 msgr2=0x7ff0dc0cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 --2- 172.21.15.67:0/2499958287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0b90 0x7ff0dc0cd5a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40097c0 tx=0x7ff0d401c430 comp rx=0 tx=0).stop 2024-09-19T05:38:53.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- 172.21.15.67:0/2499958287 shutdown_connections 2024-09-19T05:38:53.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 --2- 172.21.15.67:0/2499958287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0b90 0x7ff0dc0cd5a0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- 172.21.15.67:0/2499958287 >> 172.21.15.67:0/2499958287 conn(0x7ff0dc0d22d0 msgr2=0x7ff0dc0d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:53.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- 172.21.15.67:0/2499958287 shutdown_connections 2024-09-19T05:38:53.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- 172.21.15.67:0/2499958287 wait complete. 2024-09-19T05:38:53.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 Processor -- start 2024-09-19T05:38:53.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- start start 2024-09-19T05:38:53.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0dc0d0720 0x7ff0dc1f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0dc0d0b90 0x7ff0dc146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15f830 0x7ff0dc0b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc15fc10 con 0x7ff0dc15f830 2024-09-19T05:38:53.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc0b18a0 con 0x7ff0dc0d0720 2024-09-19T05:38:53.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff0dc15fd90 con 0x7ff0dc0d0b90 2024-09-19T05:38:53.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e2b9e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15f830 0x7ff0dc0b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e2b9e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15f830 0x7ff0dc0b6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56446/0 (socket says 172.21.15.67:56446) 2024-09-19T05:38:53.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e2b9e640 1 -- 172.21.15.67:0/3508002787 learned_addr learned my addr 172.21.15.67:0/3508002787 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:53.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e239d640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0dc0d0720 0x7ff0dc1f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e1b9c640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0dc0d0b90 0x7ff0dc146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e2b9e640 1 -- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0dc0d0b90 msgr2=0x7ff0dc146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e2b9e640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0dc0d0b90 0x7ff0dc146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e2b9e640 1 -- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0dc0d0720 msgr2=0x7ff0dc1f73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e2b9e640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0dc0d0720 0x7ff0dc1f73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e2b9e640 1 -- 172.21.15.67:0/3508002787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc147e00 con 0x7ff0dc15f830 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e2b9e640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15f830 0x7ff0dc0b6210 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40ad040 tx=0x7ff0d401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0daffd640 1 -- 172.21.15.67:0/3508002787 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4004220 con 0x7ff0dc15f830 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0daffd640 1 -- 172.21.15.67:0/3508002787 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d40043c0 con 0x7ff0dc15f830 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- 172.21.15.67:0/3508002787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc1475c0 con 0x7ff0dc15f830 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0daffd640 1 -- 172.21.15.67:0/3508002787 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4003840 con 0x7ff0dc15f830 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.920+0000 7ff0e4601640 1 -- 172.21.15.67:0/3508002787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc0cb6a0 con 0x7ff0dc15f830 2024-09-19T05:38:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.924+0000 7ff0e4601640 1 -- 172.21.15.67:0/3508002787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0dc0ce520 con 0x7ff0dc15f830 2024-09-19T05:38:53.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.924+0000 7ff0daffd640 1 -- 172.21.15.67:0/3508002787 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0d40039e0 con 0x7ff0dc15f830 2024-09-19T05:38:53.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.924+0000 7ff0daffd640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0c80678c0 0x7ff0c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:53.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.924+0000 7ff0daffd640 1 -- 172.21.15.67:0/3508002787 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7ff0d41208e0 con 0x7ff0dc15f830 2024-09-19T05:38:53.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.924+0000 7ff0e239d640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0c80678c0 0x7ff0c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:53.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.924+0000 7ff0e239d640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0c80678c0 0x7ff0c8069d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0012f0 tx=0x7ff0cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:53.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:53.928+0000 7ff0daffd640 1 -- 172.21.15.67:0/3508002787 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff0dc1475c0 con 0x7ff0dc15f830 2024-09-19T05:38:54.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 -- 172.21.15.67:0/3508002787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0dc0b81f0 con 0x7ff0dc15f830 2024-09-19T05:38:54.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0daffd640 1 -- 172.21.15.67:0/3508002787 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5223 (secure 0 0 0) 0x7ff0d4016050 con 0x7ff0dc15f830 2024-09-19T05:38:54.133 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:54.133 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":58,"btime":"2024-09-19T05:38:38:100892+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1497173986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1497173986},{"type":"v1","addr":"172.21.15.97:6835","nonce":1497173986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4151620700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4151620700},{"type":"v1","addr":"172.21.15.97:6837","nonce":4151620700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/491214453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":491214453},{"type":"v1","addr":"172.21.15.67:6835","nonce":491214453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:38:17.483070+0000","modified":"2024-09-19T05:38:38.100875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6833/1473897687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1473897687},{"type":"v1","addr":"172.21.15.67:6833","nonce":1473897687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6999,"qdb_cluster":[6999]},"id":5}]} 2024-09-19T05:38:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 58 2024-09-19T05:38:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 -- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0c80678c0 msgr2=0x7ff0c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0c80678c0 0x7ff0c8069d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0012f0 tx=0x7ff0cc009040 comp rx=0 tx=0).stop 2024-09-19T05:38:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 -- 172.21.15.67:0/3508002787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15f830 msgr2=0x7ff0dc0b6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15f830 0x7ff0dc0b6210 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40ad040 tx=0x7ff0d401ac70 comp rx=0 tx=0).stop 2024-09-19T05:38:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 -- 172.21.15.67:0/3508002787 shutdown_connections 2024-09-19T05:38:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15f830 0x7ff0dc0b6210 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0c80678c0 0x7ff0c8069d80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0dc0d0b90 0x7ff0dc146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 --2- 172.21.15.67:0/3508002787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0dc0d0720 0x7ff0dc1f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 -- 172.21.15.67:0/3508002787 >> 172.21.15.67:0/3508002787 conn(0x7ff0dc0d22d0 msgr2=0x7ff0dc0cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 -- 172.21.15.67:0/3508002787 shutdown_connections 2024-09-19T05:38:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.128+0000 7ff0e4601640 1 -- 172.21.15.67:0/3508002787 wait complete. 2024-09-19T05:38:54.152 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:54.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.272+0000 7f740d112640 1 Processor -- start 2024-09-19T05:38:54.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.272+0000 7f740d112640 1 -- start start 2024-09-19T05:38:54.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f740d112640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74080705b0 0x7f740815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f740d112640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74080c7130 con 0x7f74080c8c40 2024-09-19T05:38:54.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f740d112640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7408070b90 con 0x7f740809b140 2024-09-19T05:38:54.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f740d112640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f740815d7d0 con 0x7f74080705b0 2024-09-19T05:38:54.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7406d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f74080c8c40 0x7f740809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48754/0 (socket says 172.21.15.67:48754) 2024-09-19T05:38:54.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7406d9d640 1 -- 172.21.15.67:0/4207327369 learned_addr learned my addr 172.21.15.67:0/4207327369 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:54.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970442491 0 0) 0x7f74080c7130 con 0x7f74080c8c40 2024-09-19T05:38:54.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f740759e640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74080705b0 0x7f740815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73f0003530 con 0x7f74080c8c40 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1951226312 0 0) 0x7f73f0003530 con 0x7f74080c8c40 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74080705b0 msgr2=0x7f740815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74080705b0 0x7f740815d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 >> v1:172.21.15.97:6789/0 conn(0x7f740809b140 legacy=0x7f7408159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7408070e70 con 0x7f74080c8c40 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f73f8001680 con 0x7f74080c8c40 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 >> v1:172.21.15.67:6789/0 conn(0x7f74080c8c40 legacy=0x7f740809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73f00039f0 0x7f73f0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73f0004810 0x7f73f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74080705b0 0x7f73f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73f000ba80 con 0x7f73f00039f0 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f73f000bc00 con 0x7f73f0004810 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f73f000be00 con 0x7f74080705b0 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7406d9d640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73f00039f0 0x7f73f0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f740659c640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73f0004810 0x7f73f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f740759e640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74080705b0 0x7f73f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7406d9d640 1 -- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74080705b0 msgr2=0x7f73f00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7406d9d640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74080705b0 0x7f73f00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7406d9d640 1 -- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73f0004810 msgr2=0x7f73f0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7406d9d640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73f0004810 0x7f73f0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f7406d9d640 1 -- 172.21.15.67:0/4207327369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f0003530 con 0x7f73f00039f0 2024-09-19T05:38:54.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.276+0000 7f740659c640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73f0004810 0x7f73f0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:54.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f7406d9d640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73f00039f0 0x7f73f0003e10 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f73f8001ec0 tx=0x7f73f801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5e5703b7cd4985 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:54.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8007d40 con 0x7f73f00039f0 2024-09-19T05:38:54.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f80a9070 con 0x7f73f00039f0 2024-09-19T05:38:54.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f7405d9b640 1 -- 172.21.15.67:0/4207327369 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8005d40 con 0x7f73f00039f0 2024-09-19T05:38:54.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 -- 172.21.15.67:0/4207327369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73f00039f0 msgr2=0x7f73f0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 --2- 172.21.15.67:0/4207327369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73f00039f0 0x7f73f0003e10 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f73f8001ec0 tx=0x7f73f801cc40 comp rx=0 tx=0).stop 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740759e640 1 -- 172.21.15.67:0/4207327369 reap_dead start 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 -- 172.21.15.67:0/4207327369 shutdown_connections 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 -- 172.21.15.67:0/4207327369 >> 172.21.15.67:0/4207327369 conn(0x7f74080d22b0 msgr2=0x7f74080d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 -- 172.21.15.67:0/4207327369 shutdown_connections 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 -- 172.21.15.67:0/4207327369 wait complete. 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 Processor -- start 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 -- start start 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408158350 0x7f740806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74081589f0 0x7f740815e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f740815e740 0x7f74080af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f740815a070 con 0x7f740815e740 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f74080d04f0 con 0x7f7408158350 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740d112640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f740815a1f0 con 0x7f74081589f0 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f740815e740 0x7f74080af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f740815e740 0x7f74080af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56468/0 (socket says 172.21.15.67:56468) 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740759e640 1 -- 172.21.15.67:0/299941932 learned_addr learned my addr 172.21.15.67:0/299941932 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740659c640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74081589f0 0x7f740815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f7406d9d640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408158350 0x7f740806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740759e640 1 -- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74081589f0 msgr2=0x7f740815e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740759e640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74081589f0 0x7f740815e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740759e640 1 -- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408158350 msgr2=0x7f740806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740759e640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408158350 0x7f740806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.280+0000 7f740759e640 1 -- 172.21.15.67:0/299941932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740806e390 con 0x7f740815e740 2024-09-19T05:38:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f740759e640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f740815e740 0x7f74080af1a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7400009fd0 tx=0x7f74000115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f73ef7fe640 1 -- 172.21.15.67:0/299941932 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7400011de0 con 0x7f740815e740 2024-09-19T05:38:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f73ef7fe640 1 -- 172.21.15.67:0/299941932 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740001b070 con 0x7f740815e740 2024-09-19T05:38:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f740d112640 1 -- 172.21.15.67:0/299941932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740806e670 con 0x7f740815e740 2024-09-19T05:38:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f73ef7fe640 1 -- 172.21.15.67:0/299941932 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74000039a0 con 0x7f740815e740 2024-09-19T05:38:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f740d112640 1 -- 172.21.15.67:0/299941932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74080caa60 con 0x7f740815e740 2024-09-19T05:38:54.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f740d112640 1 -- 172.21.15.67:0/299941932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f740815d6a0 con 0x7f740815e740 2024-09-19T05:38:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f73ef7fe640 1 -- 172.21.15.67:0/299941932 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7400003b40 con 0x7f740815e740 2024-09-19T05:38:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f73ef7fe640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73f40678f0 0x7f73f4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f73ef7fe640 1 -- 172.21.15.67:0/299941932 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f7400086280 con 0x7f740815e740 2024-09-19T05:38:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f7406d9d640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73f40678f0 0x7f73f4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.284+0000 7f7406d9d640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73f40678f0 0x7f73f4069db0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f73f80ab000 tx=0x7f73f80b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:54.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.288+0000 7f73ef7fe640 1 -- 172.21.15.67:0/299941932 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7400056c70 con 0x7f740815e740 2024-09-19T05:38:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 -- 172.21.15.67:0/299941932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74080cc6d0 con 0x7f740815e740 2024-09-19T05:38:54.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f73ef7fe640 1 -- 172.21.15.67:0/299941932 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5223 (secure 0 0 0) 0x7f7400056570 con 0x7f740815e740 2024-09-19T05:38:54.500 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:54.500 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":58,"btime":"2024-09-19T05:38:38:100892+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1497173986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1497173986},{"type":"v1","addr":"172.21.15.97:6835","nonce":1497173986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4151620700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4151620700},{"type":"v1","addr":"172.21.15.97:6837","nonce":4151620700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/491214453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":491214453},{"type":"v1","addr":"172.21.15.67:6835","nonce":491214453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:38:17.483070+0000","modified":"2024-09-19T05:38:38.100875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6833/1473897687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1473897687},{"type":"v1","addr":"172.21.15.67:6833","nonce":1473897687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6999,"qdb_cluster":[6999]},"id":5}]} 2024-09-19T05:38:54.500 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 58 2024-09-19T05:38:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 -- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73f40678f0 msgr2=0x7f73f4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73f40678f0 0x7f73f4069db0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f73f80ab000 tx=0x7f73f80b0040 comp rx=0 tx=0).stop 2024-09-19T05:38:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 -- 172.21.15.67:0/299941932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f740815e740 msgr2=0x7f74080af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f740815e740 0x7f74080af1a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7400009fd0 tx=0x7f74000115a0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 -- 172.21.15.67:0/299941932 shutdown_connections 2024-09-19T05:38:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f740815e740 0x7f74080af1a0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73f40678f0 0x7f73f4069db0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74081589f0 0x7f740815e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 --2- 172.21.15.67:0/299941932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408158350 0x7f740806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 -- 172.21.15.67:0/299941932 >> 172.21.15.67:0/299941932 conn(0x7f74080d22b0 msgr2=0x7f740815ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 -- 172.21.15.67:0/299941932 shutdown_connections 2024-09-19T05:38:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.496+0000 7f740d112640 1 -- 172.21.15.67:0/299941932 wait complete. 2024-09-19T05:38:54.520 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f693056c640 1 Processor -- start 2024-09-19T05:38:54.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f693056c640 1 -- start start 2024-09-19T05:38:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f693056c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f692815b710 0x7f6928071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f693056c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69280b3070 con 0x7f69280aef40 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f693056c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69280afa70 con 0x7f692815baf0 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f693056c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f69280b32e0 con 0x7f692815b710 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692eb09640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f69280aef40 0x7f69280af360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48764/0 (socket says 172.21.15.67:48764) 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692eb09640 1 -- 172.21.15.67:0/2789966653 learned_addr learned my addr 172.21.15.67:0/2789966653 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692e308640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f692815b710 0x7f6928071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 841079453 0 0) 0x7f69280b3070 con 0x7f69280aef40 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6914003530 con 0x7f69280aef40 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2540410034 0 0) 0x7f6914003530 con 0x7f69280aef40 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f692815b710 msgr2=0x7f6928071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f692815b710 0x7f6928071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 >> v1:172.21.15.97:6789/0 conn(0x7f692815baf0 legacy=0x7f692815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69280b35c0 con 0x7f69280aef40 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6920001680 con 0x7f69280aef40 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 >> v1:172.21.15.67:6789/0 conn(0x7f69280aef40 legacy=0x7f69280af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69140039f0 0x7f6914003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f692815b710 0x7f6914004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6914004d50 0x7f69140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f69280b32e0 con 0x7f6914004d50 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f691400ba80 con 0x7f69140039f0 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f691400bc80 con 0x7f692815b710 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692eb09640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6914004d50 0x7f69140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692e308640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69140039f0 0x7f6914003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692db07640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f692815b710 0x7f6914004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692eb09640 1 -- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f692815b710 msgr2=0x7f6914004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692eb09640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f692815b710 0x7f6914004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692eb09640 1 -- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69140039f0 msgr2=0x7f6914003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692eb09640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69140039f0 0x7f6914003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.636+0000 7f692eb09640 1 -- 172.21.15.67:0/2789966653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6914003530 con 0x7f6914004d50 2024-09-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f692eb09640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6914004d50 0x7f69140051d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f692000c210 tx=0x7f692001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e519af6c5e3f39f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920007d20 con 0x7f6914004d50 2024-09-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69200a9070 con 0x7f6914004d50 2024-09-19T05:38:54.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f692d306640 1 -- 172.21.15.67:0/2789966653 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69200a5dc0 con 0x7f6914004d50 2024-09-19T05:38:54.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 -- 172.21.15.67:0/2789966653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6914004d50 msgr2=0x7f69140051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 --2- 172.21.15.67:0/2789966653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6914004d50 0x7f69140051d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f692000c210 tx=0x7f692001cc60 comp rx=0 tx=0).stop 2024-09-19T05:38:54.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f692eb09640 1 -- 172.21.15.67:0/2789966653 reap_dead start 2024-09-19T05:38:54.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 -- 172.21.15.67:0/2789966653 shutdown_connections 2024-09-19T05:38:54.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 -- 172.21.15.67:0/2789966653 >> 172.21.15.67:0/2789966653 conn(0x7f69280d0080 msgr2=0x7f69280d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:54.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 -- 172.21.15.67:0/2789966653 shutdown_connections 2024-09-19T05:38:54.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 -- 172.21.15.67:0/2789966653 wait complete. 2024-09-19T05:38:54.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 Processor -- start 2024-09-19T05:38:54.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 -- start start 2024-09-19T05:38:54.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6914004d50 0x7f69281f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69281438d0 0x7f6928150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6928151420 0x7f692814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6928071e80 con 0x7f6928151420 2024-09-19T05:38:54.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f69280b3b80 con 0x7f6914004d50 2024-09-19T05:38:54.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.640+0000 7f693056c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6928072000 con 0x7f69281438d0 2024-09-19T05:38:54.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692eb09640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6928151420 0x7f692814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692eb09640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6928151420 0x7f692814dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56496/0 (socket says 172.21.15.67:56496) 2024-09-19T05:38:54.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692eb09640 1 -- 172.21.15.67:0/900619496 learned_addr learned my addr 172.21.15.67:0/900619496 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692e308640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6914004d50 0x7f69281f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692db07640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69281438d0 0x7f6928150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692eb09640 1 -- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69281438d0 msgr2=0x7f6928150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692eb09640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69281438d0 0x7f6928150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692eb09640 1 -- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6914004d50 msgr2=0x7f69281f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692eb09640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6914004d50 0x7f69281f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692eb09640 1 -- 172.21.15.67:0/900619496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69281f4180 con 0x7f6928151420 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692eb09640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6928151420 0x7f692814dc10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f692000c210 tx=0x7f6914005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f691effd640 1 -- 172.21.15.67:0/900619496 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920007d20 con 0x7f6928151420 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f691effd640 1 -- 172.21.15.67:0/900619496 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6920000e50 con 0x7f6928151420 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f691effd640 1 -- 172.21.15.67:0/900619496 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69200047f0 con 0x7f6928151420 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f693056c640 1 -- 172.21.15.67:0/900619496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692814fe40 con 0x7f6928151420 2024-09-19T05:38:54.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f693056c640 1 -- 172.21.15.67:0/900619496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6928150400 con 0x7f6928151420 2024-09-19T05:38:54.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f693056c640 1 -- 172.21.15.67:0/900619496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69280af360 con 0x7f6928151420 2024-09-19T05:38:54.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f691effd640 1 -- 172.21.15.67:0/900619496 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6920004990 con 0x7f6928151420 2024-09-19T05:38:54.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f691effd640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f690c0678c0 0x7f690c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f691effd640 1 -- 172.21.15.67:0/900619496 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7f692011f320 con 0x7f6928151420 2024-09-19T05:38:54.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.644+0000 7f692e308640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f690c0678c0 0x7f690c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.648+0000 7f692e308640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f690c0678c0 0x7f690c069d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6924007520 tx=0x7f692400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:54.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.648+0000 7f691effd640 1 -- 172.21.15.67:0/900619496 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6920016970 con 0x7f6928151420 2024-09-19T05:38:54.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.812+0000 7f693056c640 1 -- 172.21.15.67:0/900619496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f692806f340 con 0x7f6928151420 2024-09-19T05:38:54.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.812+0000 7f691effd640 1 -- 172.21.15.67:0/900619496 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17098 (secure 0 0 0) 0x7f69200efb50 con 0x7f6928151420 2024-09-19T05:38:54.817 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:54.818 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":89,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:38:34.321592+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:38:15.164842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-19T05:38:16.488698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6834/3597291023":"2024-09-20T05:38:34.321559+0000","172.21.15.67:6832/3597291023":"2024-09-20T05:38:34.321559+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:54.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 -- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f690c0678c0 msgr2=0x7f690c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f690c0678c0 0x7f690c069d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6924007520 tx=0x7f692400b040 comp rx=0 tx=0).stop 2024-09-19T05:38:54.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 -- 172.21.15.67:0/900619496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6928151420 msgr2=0x7f692814dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6928151420 0x7f692814dc10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f692000c210 tx=0x7f6914005840 comp rx=0 tx=0).stop 2024-09-19T05:38:54.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 -- 172.21.15.67:0/900619496 shutdown_connections 2024-09-19T05:38:54.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6928151420 0x7f692814dc10 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f690c0678c0 0x7f690c069d80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69281438d0 0x7f6928150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 --2- 172.21.15.67:0/900619496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6914004d50 0x7f69281f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 -- 172.21.15.67:0/900619496 >> 172.21.15.67:0/900619496 conn(0x7f69280d0080 msgr2=0x7f69280adda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:54.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 -- 172.21.15.67:0/900619496 shutdown_connections 2024-09-19T05:38:54.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.816+0000 7f693056c640 1 -- 172.21.15.67:0/900619496 wait complete. 2024-09-19T05:38:54.836 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:38:54.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.944+0000 7fa123829640 1 Processor -- start 2024-09-19T05:38:54.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.944+0000 7fa123829640 1 -- start start 2024-09-19T05:38:54.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.944+0000 7fa123829640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa11c06dde0 0x7fa11c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.944+0000 7fa123829640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11c0b3510 0x7fa11c06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.944+0000 7fa123829640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa11c06e3c0 con 0x7fa11c15c030 2024-09-19T05:38:54.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.944+0000 7fa123829640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa11c06e6a0 con 0x7fa11c06dde0 2024-09-19T05:38:54.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.944+0000 7fa123829640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa11c06e980 con 0x7fa11c0b3510 2024-09-19T05:38:54.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa120dc4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa11c06dde0 0x7fa11c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa120dc4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa11c06dde0 0x7fa11c0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56500/0 (socket says 172.21.15.67:56500) 2024-09-19T05:38:54.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa120dc4640 1 -- 172.21.15.67:0/2351845054 learned_addr learned my addr 172.21.15.67:0/2351845054 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:54.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa121dc6640 1 --2- 172.21.15.67:0/2351845054 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11c0b3510 0x7fa11c06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa120dc4640 1 -- 172.21.15.67:0/2351845054 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11c0b3510 msgr2=0x7fa11c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:54.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa120dc4640 1 --2- 172.21.15.67:0/2351845054 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11c0b3510 0x7fa11c06f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa120dc4640 1 -- 172.21.15.67:0/2351845054 >> v1:172.21.15.97:6789/0 conn(0x7fa11c15c030 legacy=0x7fa11c15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa120dc4640 1 -- 172.21.15.67:0/2351845054 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c06ec60 con 0x7fa11c06dde0 2024-09-19T05:38:54.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa120dc4640 1 --2- 172.21.15.67:0/2351845054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c06dde0 0x7fa11c0b2fd0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009870 tx=0x7fa10c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc17ac837c22fd3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:54.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa113fff640 1 -- 172.21.15.67:0/2351845054 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0ab640 con 0x7fa11c06dde0 2024-09-19T05:38:54.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa113fff640 1 -- 172.21.15.67:0/2351845054 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c0b0070 con 0x7fa11c06dde0 2024-09-19T05:38:54.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa113fff640 1 -- 172.21.15.67:0/2351845054 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0aba00 con 0x7fa11c06dde0 2024-09-19T05:38:54.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa123829640 1 -- 172.21.15.67:0/2351845054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c06dde0 msgr2=0x7fa11c0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa123829640 1 --2- 172.21.15.67:0/2351845054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c06dde0 0x7fa11c0b2fd0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009870 tx=0x7fa10c01c530 comp rx=0 tx=0).stop 2024-09-19T05:38:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa123829640 1 -- 172.21.15.67:0/2351845054 shutdown_connections 2024-09-19T05:38:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa123829640 1 --2- 172.21.15.67:0/2351845054 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11c0b3510 0x7fa11c06f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa123829640 1 --2- 172.21.15.67:0/2351845054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c06dde0 0x7fa11c0b2fd0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa123829640 1 -- 172.21.15.67:0/2351845054 >> 172.21.15.67:0/2351845054 conn(0x7fa11c0d0080 msgr2=0x7fa11c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa123829640 1 -- 172.21.15.67:0/2351845054 shutdown_connections 2024-09-19T05:38:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.948+0000 7fa123829640 1 -- 172.21.15.67:0/2351845054 wait complete. 2024-09-19T05:38:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 Processor -- start 2024-09-19T05:38:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 -- start start 2024-09-19T05:38:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11c06dde0 0x7fa11c073760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa11c0b3510 0x7fa11c0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c15c030 0x7fa11c0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c1692f0 con 0x7fa11c15c030 2024-09-19T05:38:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c15c620 con 0x7fa11c0b3510 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa11c169470 con 0x7fa11c06dde0 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa121dc6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c15c030 0x7fa11c0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa121dc6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c15c030 0x7fa11c0b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56506/0 (socket says 172.21.15.67:56506) 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa121dc6640 1 -- 172.21.15.67:0/1006754888 learned_addr learned my addr 172.21.15.67:0/1006754888 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa1215c5640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11c06dde0 0x7fa11c073760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa120dc4640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa11c0b3510 0x7fa11c0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa121dc6640 1 -- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11c06dde0 msgr2=0x7fa11c073760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa121dc6640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11c06dde0 0x7fa11c073760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa121dc6640 1 -- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa11c0b3510 msgr2=0x7fa11c0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa121dc6640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa11c0b3510 0x7fa11c0b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa121dc6640 1 -- 172.21.15.67:0/1006754888 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c15e670 con 0x7fa11c15c030 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa121dc6640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c15c030 0x7fa11c0b3ef0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa11400efc0 tx=0x7fa11400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa111ffb640 1 -- 172.21.15.67:0/1006754888 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114018020 con 0x7fa11c15c030 2024-09-19T05:38:54.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa111ffb640 1 -- 172.21.15.67:0/1006754888 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa114014480 con 0x7fa11c15c030 2024-09-19T05:38:54.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa111ffb640 1 -- 172.21.15.67:0/1006754888 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114014870 con 0x7fa11c15c030 2024-09-19T05:38:54.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 -- 172.21.15.67:0/1006754888 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11c0729a0 con 0x7fa11c15c030 2024-09-19T05:38:54.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 -- 172.21.15.67:0/1006754888 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa11c072f60 con 0x7fa11c15c030 2024-09-19T05:38:54.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa123829640 1 -- 172.21.15.67:0/1006754888 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11c1591e0 con 0x7fa11c15c030 2024-09-19T05:38:54.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa111ffb640 1 -- 172.21.15.67:0/1006754888 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa11401b020 con 0x7fa11c15c030 2024-09-19T05:38:54.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa111ffb640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1000678c0 0x7fa100069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:54.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.952+0000 7fa111ffb640 1 -- 172.21.15.67:0/1006754888 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6187+0+0 (secure 0 0 0) 0x7fa114086880 con 0x7fa11c15c030 2024-09-19T05:38:54.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.956+0000 7fa1215c5640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1000678c0 0x7fa100069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:54.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.956+0000 7fa1215c5640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1000678c0 0x7fa100069d80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa1180015b0 tx=0x7fa118009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:54.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:54.960+0000 7fa111ffb640 1 -- 172.21.15.67:0/1006754888 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa114022070 con 0x7fa11c15c030 2024-09-19T05:38:55.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.152+0000 7fa123829640 1 -- 172.21.15.67:0/1006754888 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa11c0d0f20 con 0x7fa11c15c030 2024-09-19T05:38:55.160 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:38:55.152+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:38:55.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.156+0000 7fa111ffb640 1 -- 172.21.15.67:0/1006754888 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) ==== 161+0+0 (secure 0 0 0) 0x7fa114010040 con 0x7fa11c15c030 2024-09-19T05:38:55.161 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:38:55.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 -- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1000678c0 msgr2=0x7fa100069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1000678c0 0x7fa100069d80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa1180015b0 tx=0x7fa118009040 comp rx=0 tx=0).stop 2024-09-19T05:38:55.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 -- 172.21.15.67:0/1006754888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c15c030 msgr2=0x7fa11c0b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c15c030 0x7fa11c0b3ef0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa11400efc0 tx=0x7fa11400c490 comp rx=0 tx=0).stop 2024-09-19T05:38:55.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 -- 172.21.15.67:0/1006754888 shutdown_connections 2024-09-19T05:38:55.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa11c15c030 0x7fa11c0b3ef0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa11c0b3510 0x7fa11c0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1000678c0 0x7fa100069d80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 --2- 172.21.15.67:0/1006754888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa11c06dde0 0x7fa11c073760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 -- 172.21.15.67:0/1006754888 >> 172.21.15.67:0/1006754888 conn(0x7fa11c0d0080 msgr2=0x7fa11c0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:55.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 -- 172.21.15.67:0/1006754888 shutdown_connections 2024-09-19T05:38:55.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.160+0000 7fa123829640 1 -- 172.21.15.67:0/1006754888 wait complete. 2024-09-19T05:38:55.165 INFO:tasks.ceph.mds.a.smithi067.stderr: -2183> 2024-09-19T05:38:40.100+0000 7f1889850640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:38:55.180 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:38:55.192 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf68379640 1 Processor -- start 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf68379640 1 -- start start 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf68379640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcf6015e690 0x7fcf600d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf68379640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcf600d1590 0x7fcf6006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf68379640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf600d35a0 con 0x7fcf600d4fb0 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf68379640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fcf600d32c0 con 0x7fcf600d1590 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf68379640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6006d040 con 0x7fcf6015e690 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf66916640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcf600d1590 0x7fcf6006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf66916640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcf600d1590 0x7fcf6006db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56526/0 (socket says 172.21.15.67:56526) 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf66916640 1 -- 172.21.15.67:0/3522847755 learned_addr learned my addr 172.21.15.67:0/3522847755 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf66115640 1 --2- 172.21.15.67:0/3522847755 >> v2:172.21.15.97:3300/0 conn(0x7fcf6015e690 0x7fcf600d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf66916640 1 -- 172.21.15.67:0/3522847755 >> v2:172.21.15.97:3300/0 conn(0x7fcf6015e690 msgr2=0x7fcf600d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf66916640 1 --2- 172.21.15.67:0/3522847755 >> v2:172.21.15.97:3300/0 conn(0x7fcf6015e690 0x7fcf600d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf66916640 1 -- 172.21.15.67:0/3522847755 >> v1:172.21.15.97:6789/0 conn(0x7fcf600d4fb0 legacy=0x7fcf600d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.288+0000 7fcf66916640 1 -- 172.21.15.67:0/3522847755 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6006d320 con 0x7fcf600d1590 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf66916640 1 --2- 172.21.15.67:0/3522847755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d1590 0x7fcf6006db20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fcf6008d730 tx=0x7fcf5c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ffb1f5c0005e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf65113640 1 -- 172.21.15.67:0/3522847755 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0aa5f0 con 0x7fcf600d1590 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf65113640 1 -- 172.21.15.67:0/3522847755 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5c0af070 con 0x7fcf600d1590 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf65113640 1 -- 172.21.15.67:0/3522847755 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0aa9b0 con 0x7fcf600d1590 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf68379640 1 -- 172.21.15.67:0/3522847755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d1590 msgr2=0x7fcf6006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf68379640 1 --2- 172.21.15.67:0/3522847755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d1590 0x7fcf6006db20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fcf6008d730 tx=0x7fcf5c01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf68379640 1 -- 172.21.15.67:0/3522847755 shutdown_connections 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf68379640 1 --2- 172.21.15.67:0/3522847755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d1590 0x7fcf6006db20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf68379640 1 --2- 172.21.15.67:0/3522847755 >> v2:172.21.15.97:3300/0 conn(0x7fcf6015e690 0x7fcf600d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf68379640 1 -- 172.21.15.67:0/3522847755 >> 172.21.15.67:0/3522847755 conn(0x7fcf600d4490 msgr2=0x7fcf600d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf68379640 1 -- 172.21.15.67:0/3522847755 shutdown_connections 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf68379640 1 -- 172.21.15.67:0/3522847755 wait complete. 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf68379640 1 Processor -- start 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.292+0000 7fcf68379640 1 -- start start 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf68379640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf600d1590 0x7fcf6015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf68379640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d4fb0 0x7fcf600b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf68379640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf6015e690 0x7fcf600b9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf68379640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6006e9f0 con 0x7fcf600d4fb0 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf68379640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6006e870 con 0x7fcf6015e690 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf68379640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6006eb70 con 0x7fcf600d1590 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf65914640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d4fb0 0x7fcf600b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf65914640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d4fb0 0x7fcf600b8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56536/0 (socket says 172.21.15.67:56536) 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf65914640 1 -- 172.21.15.67:0/1394073226 learned_addr learned my addr 172.21.15.67:0/1394073226 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf66115640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf600d1590 0x7fcf6015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf65914640 1 -- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf600d1590 msgr2=0x7fcf6015ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf66916640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf6015e690 0x7fcf600b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf65914640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf600d1590 0x7fcf6015ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf65914640 1 -- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf6015e690 msgr2=0x7fcf600b9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf65914640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf6015e690 0x7fcf600b9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf65914640 1 -- 172.21.15.67:0/1394073226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf600b7b60 con 0x7fcf600d4fb0 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf65914640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d4fb0 0x7fcf600b8fc0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c420 tx=0x7fcf5000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf56ffd640 1 -- 172.21.15.67:0/1394073226 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf500052d0 con 0x7fcf600d4fb0 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf56ffd640 1 -- 172.21.15.67:0/1394073226 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf50005470 con 0x7fcf600d4fb0 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf68379640 1 -- 172.21.15.67:0/1394073226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf600b72c0 con 0x7fcf600d4fb0 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf56ffd640 1 -- 172.21.15.67:0/1394073226 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50007260 con 0x7fcf600d4fb0 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf68379640 1 -- 172.21.15.67:0/1394073226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf600b7880 con 0x7fcf600d4fb0 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf68379640 1 -- 172.21.15.67:0/1394073226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf6006db20 con 0x7fcf600d4fb0 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf56ffd640 1 -- 172.21.15.67:0/1394073226 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf50007400 con 0x7fcf600d4fb0 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf56ffd640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf440678c0 0x7fcf44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf56ffd640 1 -- 172.21.15.67:0/1394073226 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6273+0+0 (secure 0 0 0) 0x7fcf50085410 con 0x7fcf600d4fb0 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf66115640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf440678c0 0x7fcf44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.296+0000 7fcf66115640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf440678c0 0x7fcf44069d80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009e90 tx=0x7fcf5800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.300+0000 7fcf56ffd640 1 -- 172.21.15.67:0/1394073226 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fcf600b7b60 con 0x7fcf600d4fb0 2024-09-19T05:38:55.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:55.500+0000 7fcf68379640 1 -- 172.21.15.67:0/1394073226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcf600d4a80 con 0x7fcf600d4fb0 2024-09-19T05:38:56.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf56ffd640 1 -- 172.21.15.67:0/1394073226 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) ==== 104+0+0 (secure 0 0 0) 0x7fcf50055d10 con 0x7fcf600d4fb0 2024-09-19T05:38:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 -- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf440678c0 msgr2=0x7fcf44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf440678c0 0x7fcf44069d80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009e90 tx=0x7fcf5800b040 comp rx=0 tx=0).stop 2024-09-19T05:38:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 -- 172.21.15.67:0/1394073226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d4fb0 msgr2=0x7fcf600b8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d4fb0 0x7fcf600b8fc0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c420 tx=0x7fcf5000c8e0 comp rx=0 tx=0).stop 2024-09-19T05:38:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 -- 172.21.15.67:0/1394073226 shutdown_connections 2024-09-19T05:38:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf6015e690 0x7fcf600b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf600d4fb0 0x7fcf600b8fc0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf440678c0 0x7fcf44069d80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 --2- 172.21.15.67:0/1394073226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf600d1590 0x7fcf6015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 -- 172.21.15.67:0/1394073226 >> 172.21.15.67:0/1394073226 conn(0x7fcf600d4490 msgr2=0x7fcf600b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 -- 172.21.15.67:0/1394073226 shutdown_connections 2024-09-19T05:38:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.168+0000 7fcf68379640 1 -- 172.21.15.67:0/1394073226 wait complete. 2024-09-19T05:38:56.197 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:38:56.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc409680640 1 Processor -- start 2024-09-19T05:38:56.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc409680640 1 -- start start 2024-09-19T05:38:56.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc409680640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 0x7fc40415c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc409680640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc4040aee00 0x7fc4040d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc409680640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4040b4e00 con 0x7fc4040d0520 2024-09-19T05:38:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc409680640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc4040d0ea0 con 0x7fc4040aee00 2024-09-19T05:38:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc409680640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc40415c5c0 con 0x7fc4040738b0 2024-09-19T05:38:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc4037fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc4040aee00 0x7fc4040d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc402ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 0x7fc40415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc4027fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc4040d0520 0x7fc40415ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:57748/0 (socket says 172.21.15.67:57748) 2024-09-19T05:38:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.372+0000 7fc4027fc640 1 -- 172.21.15.67:0/2436854908 learned_addr learned my addr 172.21.15.67:0/2436854908 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:56.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc4037fe640 1 -- 172.21.15.67:0/2436854908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 msgr2=0x7fc40415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:56.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc4037fe640 1 --2- 172.21.15.67:0/2436854908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 0x7fc40415c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:56.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc4037fe640 1 -- 172.21.15.67:0/2436854908 >> v1:172.21.15.97:6789/0 conn(0x7fc4040d0520 legacy=0x7fc40415ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:56.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc4037fe640 1 -- 172.21.15.67:0/2436854908 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4040b3500 con 0x7fc4040aee00 2024-09-19T05:38:56.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc402ffd640 1 --2- 172.21.15.67:0/2436854908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 0x7fc40415c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:56.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc4037fe640 1 --2- 172.21.15.67:0/2436854908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4040aee00 0x7fc4040d0960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009d90 tx=0x7fc3fc01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9da1bb0fd37bafdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:56.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc401ffb640 1 -- 172.21.15.67:0/2436854908 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0b2070 con 0x7fc4040aee00 2024-09-19T05:38:56.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc401ffb640 1 -- 172.21.15.67:0/2436854908 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3fc0a5750 con 0x7fc4040aee00 2024-09-19T05:38:56.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc401ffb640 1 -- 172.21.15.67:0/2436854908 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0a5b20 con 0x7fc4040aee00 2024-09-19T05:38:56.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc409680640 1 -- 172.21.15.67:0/2436854908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4040aee00 msgr2=0x7fc4040d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:56.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc409680640 1 --2- 172.21.15.67:0/2436854908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4040aee00 0x7fc4040d0960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009d90 tx=0x7fc3fc01c970 comp rx=0 tx=0).stop 2024-09-19T05:38:56.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc409680640 1 -- 172.21.15.67:0/2436854908 shutdown_connections 2024-09-19T05:38:56.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc409680640 1 --2- 172.21.15.67:0/2436854908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4040aee00 0x7fc4040d0960 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:56.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc409680640 1 --2- 172.21.15.67:0/2436854908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 0x7fc40415c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:56.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc409680640 1 -- 172.21.15.67:0/2436854908 >> 172.21.15.67:0/2436854908 conn(0x7fc40406c0c0 msgr2=0x7fc40406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:56.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc409680640 1 -- 172.21.15.67:0/2436854908 shutdown_connections 2024-09-19T05:38:56.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.376+0000 7fc409680640 1 -- 172.21.15.67:0/2436854908 wait complete. 2024-09-19T05:38:56.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc409680640 1 Processor -- start 2024-09-19T05:38:56.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc409680640 1 -- start start 2024-09-19T05:38:56.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc409680640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 0x7fc40409d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:56.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc409680640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4040aee00 0x7fc4040b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:56.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc409680640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4040d0520 0x7fc4040b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:56.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc409680640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc404073c90 con 0x7fc4040d0520 2024-09-19T05:38:56.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc409680640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc4040b4080 con 0x7fc4040aee00 2024-09-19T05:38:56.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc409680640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc4040b30b0 con 0x7fc4040738b0 2024-09-19T05:38:56.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc4037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4040d0520 0x7fc4040b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:56.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc4037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4040d0520 0x7fc4040b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51674/0 (socket says 172.21.15.67:51674) 2024-09-19T05:38:56.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc4037fe640 1 -- 172.21.15.67:0/1267508220 learned_addr learned my addr 172.21.15.67:0/1267508220 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:56.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc402ffd640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 0x7fc40409d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:56.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc4027fc640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4040aee00 0x7fc4040b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:56.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc4037fe640 1 -- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 msgr2=0x7fc40409d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:56.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc4037fe640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 0x7fc40409d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:56.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc4037fe640 1 -- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4040aee00 msgr2=0x7fc4040b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:56.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc4037fe640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4040aee00 0x7fc4040b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:56.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc4037fe640 1 -- 172.21.15.67:0/1267508220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc404151520 con 0x7fc4040d0520 2024-09-19T05:38:56.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc4037fe640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4040d0520 0x7fc4040b1170 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0b0040 tx=0x7fc3fc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:56.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc3fb7fe640 1 -- 172.21.15.67:0/1267508220 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0b2050 con 0x7fc4040d0520 2024-09-19T05:38:56.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc3fb7fe640 1 -- 172.21.15.67:0/1267508220 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3fc0be070 con 0x7fc4040d0520 2024-09-19T05:38:56.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc409680640 1 -- 172.21.15.67:0/1267508220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc404151800 con 0x7fc4040d0520 2024-09-19T05:38:56.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc3fb7fe640 1 -- 172.21.15.67:0/1267508220 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0ad890 con 0x7fc4040d0520 2024-09-19T05:38:56.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.380+0000 7fc409680640 1 -- 172.21.15.67:0/1267508220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc404151dc0 con 0x7fc4040d0520 2024-09-19T05:38:56.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.384+0000 7fc409680640 1 -- 172.21.15.67:0/1267508220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40415c080 con 0x7fc4040d0520 2024-09-19T05:38:56.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.384+0000 7fc3fb7fe640 1 -- 172.21.15.67:0/1267508220 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3fc0ada30 con 0x7fc4040d0520 2024-09-19T05:38:56.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.384+0000 7fc3fb7fe640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678c0 0x7fc3e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:56.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.384+0000 7fc3fb7fe640 1 -- 172.21.15.67:0/1267508220 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6273+0+0 (secure 0 0 0) 0x7fc3fc120e30 con 0x7fc4040d0520 2024-09-19T05:38:56.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.384+0000 7fc402ffd640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678c0 0x7fc3e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:56.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.384+0000 7fc402ffd640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678c0 0x7fc3e4069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc40413fef0 tx=0x7fc3ec009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:56.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.388+0000 7fc3fb7fe640 1 -- 172.21.15.67:0/1267508220 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc3fc016560 con 0x7fc4040d0520 2024-09-19T05:38:56.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:56.556+0000 7fc409680640 1 -- 172.21.15.67:0/1267508220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc40406c820 con 0x7fc4040d0520 2024-09-19T05:38:57.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.376+0000 7fc3fb7fe640 1 -- 172.21.15.67:0/1267508220 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7fc3fc0f11a0 con 0x7fc4040d0520 2024-09-19T05:38:57.380 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:38:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.380+0000 7fc409680640 1 -- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678c0 msgr2=0x7fc3e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.380+0000 7fc409680640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678c0 0x7fc3e4069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc40413fef0 tx=0x7fc3ec009190 comp rx=0 tx=0).stop 2024-09-19T05:38:57.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.380+0000 7fc409680640 1 -- 172.21.15.67:0/1267508220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4040d0520 msgr2=0x7fc4040b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.380+0000 7fc409680640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4040d0520 0x7fc4040b1170 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0b0040 tx=0x7fc3fc019710 comp rx=0 tx=0).stop 2024-09-19T05:38:57.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.380+0000 7fc409680640 1 -- 172.21.15.67:0/1267508220 shutdown_connections 2024-09-19T05:38:57.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.380+0000 7fc409680640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4040d0520 0x7fc4040b1170 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.380+0000 7fc409680640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4040aee00 0x7fc4040b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.380+0000 7fc409680640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3e40678c0 0x7fc3e4069d80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.380+0000 7fc409680640 1 --2- 172.21.15.67:0/1267508220 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4040738b0 0x7fc40409d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.380+0000 7fc409680640 1 -- 172.21.15.67:0/1267508220 >> 172.21.15.67:0/1267508220 conn(0x7fc40406c0c0 msgr2=0x7fc404157f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:57.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.384+0000 7fc409680640 1 -- 172.21.15.67:0/1267508220 shutdown_connections 2024-09-19T05:38:57.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.384+0000 7fc409680640 1 -- 172.21.15.67:0/1267508220 wait complete. 2024-09-19T05:38:57.408 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:38:57.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f909938a640 1 Processor -- start 2024-09-19T05:38:57.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f909938a640 1 -- start start 2024-09-19T05:38:57.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f909938a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f90940cf5e0 0x7f90940d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:57.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f909938a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f909415d8d0 0x7f909415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:57.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f909938a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909415d030 con 0x7f909415c850 2024-09-19T05:38:57.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f909938a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f909406de90 con 0x7f909415d8d0 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f909938a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f909406e170 con 0x7f90940cf5e0 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f90937fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f909415d8d0 0x7f909415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f90937fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f909415d8d0 0x7f909415dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51678/0 (socket says 172.21.15.67:51678) 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f90937fe640 1 -- 172.21.15.67:0/3837087478 learned_addr learned my addr 172.21.15.67:0/3837087478 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f908bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f909415c850 0x7f909406e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36132/0 (socket says 172.21.15.67:36132) 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f9092ffd640 1 --2- 172.21.15.67:0/3837087478 >> v2:172.21.15.97:3300/0 conn(0x7f90940cf5e0 0x7f90940d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f90937fe640 1 -- 172.21.15.67:0/3837087478 >> v2:172.21.15.97:3300/0 conn(0x7f90940cf5e0 msgr2=0x7f90940d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f90937fe640 1 --2- 172.21.15.67:0/3837087478 >> v2:172.21.15.97:3300/0 conn(0x7f90940cf5e0 0x7f90940d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f90937fe640 1 -- 172.21.15.67:0/3837087478 >> v1:172.21.15.67:6789/0 conn(0x7f909415c850 legacy=0x7f909406e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f90937fe640 1 -- 172.21.15.67:0/3837087478 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909415d310 con 0x7f909415d8d0 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f90927fc640 1 -- 172.21.15.67:0/3837087478 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092302710 0 0) 0x7f909415d030 con 0x7f909415c850 2024-09-19T05:38:57.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.536+0000 7f9092ffd640 1 --2- 172.21.15.67:0/3837087478 >> v2:172.21.15.97:3300/0 conn(0x7f90940cf5e0 0x7f90940d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:57.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90937fe640 1 --2- 172.21.15.67:0/3837087478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 0x7f909415dd40 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f90940b5450 tx=0x7f908c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c118c92183648a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:57.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90927fc640 1 -- 172.21.15.67:0/3837087478 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0a57d0 con 0x7f909415d8d0 2024-09-19T05:38:57.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90927fc640 1 -- 172.21.15.67:0/3837087478 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c0a5970 con 0x7f909415d8d0 2024-09-19T05:38:57.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90927fc640 1 -- 172.21.15.67:0/3837087478 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0a5d40 con 0x7f909415d8d0 2024-09-19T05:38:57.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 -- 172.21.15.67:0/3837087478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 msgr2=0x7f909415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 --2- 172.21.15.67:0/3837087478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 0x7f909415dd40 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f90940b5450 tx=0x7f908c01c9f0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 -- 172.21.15.67:0/3837087478 shutdown_connections 2024-09-19T05:38:57.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 --2- 172.21.15.67:0/3837087478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 0x7f909415dd40 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 --2- 172.21.15.67:0/3837087478 >> v2:172.21.15.97:3300/0 conn(0x7f90940cf5e0 0x7f90940d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 -- 172.21.15.67:0/3837087478 >> 172.21.15.67:0/3837087478 conn(0x7f909406c0c0 msgr2=0x7f909406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:57.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 -- 172.21.15.67:0/3837087478 shutdown_connections 2024-09-19T05:38:57.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 -- 172.21.15.67:0/3837087478 wait complete. 2024-09-19T05:38:57.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 Processor -- start 2024-09-19T05:38:57.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 -- start start 2024-09-19T05:38:57.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90940cf5e0 0x7f909409da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:57.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909415c850 0x7f90940b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:57.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 0x7f9094072a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:57.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f909406ee90 con 0x7f909415d8d0 2024-09-19T05:38:57.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f909406ed10 con 0x7f909415c850 2024-09-19T05:38:57.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f909938a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9094168fb0 con 0x7f90940cf5e0 2024-09-19T05:38:57.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90937fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 0x7f9094072a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:57.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90937fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 0x7f9094072a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51694/0 (socket says 172.21.15.67:51694) 2024-09-19T05:38:57.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90937fe640 1 -- 172.21.15.67:0/3898714074 learned_addr learned my addr 172.21.15.67:0/3898714074 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f9092ffd640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90940cf5e0 0x7f909409da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90937fe640 1 -- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90940cf5e0 msgr2=0x7f909409da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f908bfff640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909415c850 0x7f90940b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90937fe640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90940cf5e0 0x7f909409da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90937fe640 1 -- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909415c850 msgr2=0x7f90940b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90937fe640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909415c850 0x7f90940b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90937fe640 1 -- 172.21.15.67:0/3898714074 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909409dfd0 con 0x7f909415d8d0 2024-09-19T05:38:57.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.540+0000 7f90937fe640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 0x7f9094072a00 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f908c019600 tx=0x7f908c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:57.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f908b7fe640 1 -- 172.21.15.67:0/3898714074 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0b8670 con 0x7f909415d8d0 2024-09-19T05:38:57.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f908b7fe640 1 -- 172.21.15.67:0/3898714074 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c0be070 con 0x7f909415d8d0 2024-09-19T05:38:57.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f908b7fe640 1 -- 172.21.15.67:0/3898714074 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0b8a30 con 0x7f909415d8d0 2024-09-19T05:38:57.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f909938a640 1 -- 172.21.15.67:0/3898714074 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90940b4e40 con 0x7f909415d8d0 2024-09-19T05:38:57.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f909938a640 1 -- 172.21.15.67:0/3898714074 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90940b3b40 con 0x7f909415d8d0 2024-09-19T05:38:57.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f909938a640 1 -- 172.21.15.67:0/3898714074 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90940d0aa0 con 0x7f909415d8d0 2024-09-19T05:38:57.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f908b7fe640 1 -- 172.21.15.67:0/3898714074 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f908c0b8bd0 con 0x7f909415d8d0 2024-09-19T05:38:57.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f908b7fe640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90740678c0 0x7f9074069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:57.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f908b7fe640 1 -- 172.21.15.67:0/3898714074 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5835+0+0 (secure 0 0 0) 0x7f908c120eb0 con 0x7f909415d8d0 2024-09-19T05:38:57.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f9092ffd640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90740678c0 0x7f9074069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:57.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.544+0000 7f9092ffd640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90740678c0 0x7f9074069d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9084006fd0 tx=0x7f9084008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:57.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.548+0000 7f908b7fe640 1 -- 172.21.15.67:0/3898714074 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f908c0165e0 con 0x7f909415d8d0 2024-09-19T05:38:57.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:57.724+0000 7f909938a640 1 -- 172.21.15.67:0/3898714074 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f909414e9b0 con 0x7f909415d8d0 2024-09-19T05:38:58.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.380+0000 7f908b7fe640 1 -- 172.21.15.67:0/3898714074 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7f908c0f1970 con 0x7f909415d8d0 2024-09-19T05:38:58.383 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:38:58.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 -- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90740678c0 msgr2=0x7f9074069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90740678c0 0x7f9074069d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9084006fd0 tx=0x7f9084008040 comp rx=0 tx=0).stop 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 -- 172.21.15.67:0/3898714074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 msgr2=0x7f9094072a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 0x7f9094072a00 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f908c019600 tx=0x7f908c019790 comp rx=0 tx=0).stop 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 -- 172.21.15.67:0/3898714074 shutdown_connections 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909415d8d0 0x7f9094072a00 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909415c850 0x7f90940b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90740678c0 0x7f9074069d80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 --2- 172.21.15.67:0/3898714074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90940cf5e0 0x7f909409da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 -- 172.21.15.67:0/3898714074 >> 172.21.15.67:0/3898714074 conn(0x7f909406c0c0 msgr2=0x7f909414dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 -- 172.21.15.67:0/3898714074 shutdown_connections 2024-09-19T05:38:58.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.388+0000 7f909938a640 1 -- 172.21.15.67:0/3898714074 wait complete. 2024-09-19T05:38:58.416 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:38:58.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.540+0000 7f7576197640 1 Processor -- start 2024-09-19T05:38:58.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.540+0000 7f7576197640 1 -- start start 2024-09-19T05:38:58.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f7576197640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f757006dfc0 0x7f757006f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f7576197640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f757006fea0 0x7f75700b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f7576197640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75700aef30 con 0x7f757015b1d0 2024-09-19T05:38:58.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f7576197640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7570072210 con 0x7f757006fea0 2024-09-19T05:38:58.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f7576197640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f75700ae3b0 con 0x7f757006dfc0 2024-09-19T05:38:58.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f757006fea0 0x7f75700b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f757006fea0 0x7f75700b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51696/0 (socket says 172.21.15.67:51696) 2024-09-19T05:38:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756ffff640 1 -- 172.21.15.67:0/2483094863 learned_addr learned my addr 172.21.15.67:0/2483094863 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756f7fe640 1 --1- 172.21.15.67:0/2483094863 >> v1:172.21.15.67:6789/0 conn(0x7f757015b1d0 0x7f75700adbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36138/0 (socket says 172.21.15.67:36138) 2024-09-19T05:38:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756effd640 1 --2- 172.21.15.67:0/2483094863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f757006dfc0 0x7f757006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756ffff640 1 -- 172.21.15.67:0/2483094863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f757006dfc0 msgr2=0x7f757006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756ffff640 1 --2- 172.21.15.67:0/2483094863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f757006dfc0 0x7f757006f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756ffff640 1 -- 172.21.15.67:0/2483094863 >> v1:172.21.15.67:6789/0 conn(0x7f757015b1d0 legacy=0x7f75700adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756ffff640 1 -- 172.21.15.67:0/2483094863 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75700ae690 con 0x7f757006fea0 2024-09-19T05:38:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756e7fc640 1 -- 172.21.15.67:0/2483094863 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201706804 0 0) 0x7f75700aef30 con 0x7f757015b1d0 2024-09-19T05:38:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756ffff640 1 --2- 172.21.15.67:0/2483094863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 0x7f75700b3430 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f7560009870 tx=0x7f756001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa73530dc8d8a66e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756e7fc640 1 -- 172.21.15.67:0/2483094863 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75600b2070 con 0x7f757006fea0 2024-09-19T05:38:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756e7fc640 1 -- 172.21.15.67:0/2483094863 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75600a9070 con 0x7f757006fea0 2024-09-19T05:38:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.544+0000 7f756e7fc640 1 -- 172.21.15.67:0/2483094863 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75600ad880 con 0x7f757006fea0 2024-09-19T05:38:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- 172.21.15.67:0/2483094863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 msgr2=0x7f75700b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 --2- 172.21.15.67:0/2483094863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 0x7f75700b3430 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f7560009870 tx=0x7f756001c560 comp rx=0 tx=0).stop 2024-09-19T05:38:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- 172.21.15.67:0/2483094863 shutdown_connections 2024-09-19T05:38:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 --2- 172.21.15.67:0/2483094863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 0x7f75700b3430 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 --2- 172.21.15.67:0/2483094863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f757006dfc0 0x7f757006f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- 172.21.15.67:0/2483094863 >> 172.21.15.67:0/2483094863 conn(0x7f75700b1e50 msgr2=0x7f75700b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- 172.21.15.67:0/2483094863 shutdown_connections 2024-09-19T05:38:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- 172.21.15.67:0/2483094863 wait complete. 2024-09-19T05:38:58.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 Processor -- start 2024-09-19T05:38:58.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- start start 2024-09-19T05:38:58.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f757006dfc0 0x7f757015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 0x7f757015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f757015b1d0 0x7f75700998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f75700b4300 con 0x7f757006fea0 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f75700b4180 con 0x7f757015b1d0 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f75700b4480 con 0x7f757006dfc0 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 0x7f757015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 0x7f757015eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51706/0 (socket says 172.21.15.67:51706) 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756effd640 1 -- 172.21.15.67:0/3096443086 learned_addr learned my addr 172.21.15.67:0/3096443086 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756f7fe640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f757006dfc0 0x7f757015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756effd640 1 -- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f757006dfc0 msgr2=0x7f757015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756effd640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f757006dfc0 0x7f757015c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756effd640 1 -- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f757015b1d0 msgr2=0x7f75700998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756ffff640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f757015b1d0 0x7f75700998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756effd640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f757015b1d0 0x7f75700998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756effd640 1 -- 172.21.15.67:0/3096443086 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757015f250 con 0x7f757006fea0 2024-09-19T05:38:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f756effd640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 0x7f757015eab0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f756400d5d0 tx=0x7f756400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7557fff640 1 -- 172.21.15.67:0/3096443086 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564004240 con 0x7f757006fea0 2024-09-19T05:38:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7557fff640 1 -- 172.21.15.67:0/3096443086 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75640043e0 con 0x7f757006fea0 2024-09-19T05:38:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- 172.21.15.67:0/3096443086 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757015f530 con 0x7f757006fea0 2024-09-19T05:38:58.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7557fff640 1 -- 172.21.15.67:0/3096443086 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564003840 con 0x7f757006fea0 2024-09-19T05:38:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.548+0000 7f7576197640 1 -- 172.21.15.67:0/3096443086 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7570158e90 con 0x7f757006fea0 2024-09-19T05:38:58.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.552+0000 7f7576197640 1 -- 172.21.15.67:0/3096443086 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757006f960 con 0x7f757006fea0 2024-09-19T05:38:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.552+0000 7f7557fff640 1 -- 172.21.15.67:0/3096443086 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75640039e0 con 0x7f757006fea0 2024-09-19T05:38:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.552+0000 7f7557fff640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f755c0678f0 0x7f755c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.552+0000 7f7557fff640 1 -- 172.21.15.67:0/3096443086 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5421+0+0 (secure 0 0 0) 0x7f7564085dd0 con 0x7f757006fea0 2024-09-19T05:38:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.552+0000 7f756f7fe640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f755c0678f0 0x7f755c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.552+0000 7f756f7fe640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f755c0678f0 0x7f755c069db0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f75680012f0 tx=0x7f7568009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:58.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.556+0000 7f7557fff640 1 -- 172.21.15.67:0/3096443086 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f756401c360 con 0x7f757006fea0 2024-09-19T05:38:58.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.724+0000 7f7576197640 1 -- 172.21.15.67:0/3096443086 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f7570165bc0 con 0x7f757006fea0 2024-09-19T05:38:58.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.728+0000 7f7557fff640 1 -- 172.21.15.67:0/3096443086 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f75640870a0 con 0x7f757006fea0 2024-09-19T05:38:58.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 -- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f755c0678f0 msgr2=0x7f755c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f755c0678f0 0x7f755c069db0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f75680012f0 tx=0x7f7568009040 comp rx=0 tx=0).stop 2024-09-19T05:38:58.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 -- 172.21.15.67:0/3096443086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 msgr2=0x7f757015eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 0x7f757015eab0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f756400d5d0 tx=0x7f756400da90 comp rx=0 tx=0).stop 2024-09-19T05:38:58.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 -- 172.21.15.67:0/3096443086 shutdown_connections 2024-09-19T05:38:58.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f757015b1d0 0x7f75700998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757006fea0 0x7f757015eab0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f755c0678f0 0x7f755c069db0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 --2- 172.21.15.67:0/3096443086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f757006dfc0 0x7f757015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 -- 172.21.15.67:0/3096443086 >> 172.21.15.67:0/3096443086 conn(0x7f75700b1e50 msgr2=0x7f75700af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:58.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 -- 172.21.15.67:0/3096443086 shutdown_connections 2024-09-19T05:38:58.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.732+0000 7f7576197640 1 -- 172.21.15.67:0/3096443086 wait complete. 2024-09-19T05:38:58.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-19T05:38:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2e48e640 1 Processor -- start 2024-09-19T05:38:58.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2e48e640 1 -- start start 2024-09-19T05:38:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2e48e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2c28072590 0x7f2c28166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2e48e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c280b3860 con 0x7f2c2815b1e0 2024-09-19T05:38:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2e48e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c280b3b40 con 0x7f2c280b4900 2024-09-19T05:38:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2e48e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2c2815b5c0 con 0x7f2c28072590 2024-09-19T05:38:58.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2ca2b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2c28072590 0x7f2c28166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c27fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2c2815b1e0 0x7f2c280b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36152/0 (socket says 172.21.15.67:36152) 2024-09-19T05:38:58.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c27fff640 1 -- 172.21.15.67:0/2391236088 learned_addr learned my addr 172.21.15.67:0/2391236088 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:58.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2ca2b640 1 -- 172.21.15.67:0/2391236088 >> v1:172.21.15.97:6789/0 conn(0x7f2c280b4900 legacy=0x7f2c28071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:58.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2ca2b640 1 -- 172.21.15.67:0/2391236088 >> v1:172.21.15.67:6789/0 conn(0x7f2c2815b1e0 legacy=0x7f2c280b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2ca2b640 1 -- 172.21.15.67:0/2391236088 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c280b3e20 con 0x7f2c28072590 2024-09-19T05:38:58.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c26ffd640 1 -- 172.21.15.67:0/2391236088 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 920113740 0 0) 0x7f2c280b3860 con 0x7f2c2815b1e0 2024-09-19T05:38:58.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.872+0000 7f2c2ca2b640 1 --2- 172.21.15.67:0/2391236088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c28072590 0x7f2c28166050 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f2c200097c0 tx=0x7f2c2001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48cb70eb25d6452 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:58.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c26ffd640 1 -- 172.21.15.67:0/2391236088 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c200ab430 con 0x7f2c28072590 2024-09-19T05:38:58.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c26ffd640 1 -- 172.21.15.67:0/2391236088 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c200b0070 con 0x7f2c28072590 2024-09-19T05:38:58.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c26ffd640 1 -- 172.21.15.67:0/2391236088 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c200ab7f0 con 0x7f2c28072590 2024-09-19T05:38:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- 172.21.15.67:0/2391236088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c28072590 msgr2=0x7f2c28166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 --2- 172.21.15.67:0/2391236088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c28072590 0x7f2c28166050 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f2c200097c0 tx=0x7f2c2001c430 comp rx=0 tx=0).stop 2024-09-19T05:38:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- 172.21.15.67:0/2391236088 shutdown_connections 2024-09-19T05:38:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 --2- 172.21.15.67:0/2391236088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c28072590 0x7f2c28166050 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- 172.21.15.67:0/2391236088 >> 172.21.15.67:0/2391236088 conn(0x7f2c280d0080 msgr2=0x7f2c280d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- 172.21.15.67:0/2391236088 shutdown_connections 2024-09-19T05:38:58.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- 172.21.15.67:0/2391236088 wait complete. 2024-09-19T05:38:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 Processor -- start 2024-09-19T05:38:58.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- start start 2024-09-19T05:38:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c28072590 0x7f2c2815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c280b4900 0x7f2c28148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c2815b1e0 0x7f2c2815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2c28169140 con 0x7f2c2815b1e0 2024-09-19T05:38:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2c28168fc0 con 0x7f2c28072590 2024-09-19T05:38:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2c281692c0 con 0x7f2c280b4900 2024-09-19T05:38:58.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2ca2b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c2815b1e0 0x7f2c2815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2ca2b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c2815b1e0 0x7f2c2815ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51728/0 (socket says 172.21.15.67:51728) 2024-09-19T05:38:58.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2ca2b640 1 -- 172.21.15.67:0/298835927 learned_addr learned my addr 172.21.15.67:0/298835927 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:58.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c277fe640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c280b4900 0x7f2c28148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c27fff640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c28072590 0x7f2c2815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2ca2b640 1 -- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c280b4900 msgr2=0x7f2c28148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2ca2b640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c280b4900 0x7f2c28148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2ca2b640 1 -- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c28072590 msgr2=0x7f2c2815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:58.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2ca2b640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c28072590 0x7f2c2815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:58.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2ca2b640 1 -- 172.21.15.67:0/298835927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c28148a40 con 0x7f2c2815b1e0 2024-09-19T05:38:58.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c27fff640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c28072590 0x7f2c2815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:58.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2ca2b640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c2815b1e0 0x7f2c2815ddd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2c200ad040 tx=0x7f2c2001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:58.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c24ff9640 1 -- 172.21.15.67:0/298835927 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c20004230 con 0x7f2c2815b1e0 2024-09-19T05:38:58.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c24ff9640 1 -- 172.21.15.67:0/298835927 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c200043d0 con 0x7f2c2815b1e0 2024-09-19T05:38:58.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- 172.21.15.67:0/298835927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2815e310 con 0x7f2c2815b1e0 2024-09-19T05:38:58.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c24ff9640 1 -- 172.21.15.67:0/298835927 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c20003820 con 0x7f2c2815b1e0 2024-09-19T05:38:58.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.876+0000 7f2c2e48e640 1 -- 172.21.15.67:0/298835927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2814c770 con 0x7f2c2815b1e0 2024-09-19T05:38:58.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.880+0000 7f2c2e48e640 1 -- 172.21.15.67:0/298835927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c280b3860 con 0x7f2c2815b1e0 2024-09-19T05:38:58.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.880+0000 7f2c24ff9640 1 -- 172.21.15.67:0/298835927 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c200039c0 con 0x7f2c2815b1e0 2024-09-19T05:38:58.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.880+0000 7f2c24ff9640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c140678c0 0x7f2c14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:58.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.880+0000 7f2c24ff9640 1 -- 172.21.15.67:0/298835927 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5421+0+0 (secure 0 0 0) 0x7f2c200a8030 con 0x7f2c2815b1e0 2024-09-19T05:38:58.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.880+0000 7f2c27fff640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c140678c0 0x7f2c14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:58.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.880+0000 7f2c27fff640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c140678c0 0x7f2c14069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2c18007fd0 tx=0x7f2c18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:58.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:58.884+0000 7f2c24ff9640 1 -- 172.21.15.67:0/298835927 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2c200c4060 con 0x7f2c2815b1e0 2024-09-19T05:38:59.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.112+0000 7f2c2e48e640 1 -- 172.21.15.67:0/298835927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f2c280addd0 con 0x7f2c2815b1e0 2024-09-19T05:38:59.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c24ff9640 1 -- 172.21.15.67:0/298835927 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v280) ==== 143+0+0 (secure 0 0 0) 0x7f2c20016050 con 0x7f2c2815b1e0 2024-09-19T05:38:59.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 -- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c140678c0 msgr2=0x7f2c14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c140678c0 0x7f2c14069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2c18007fd0 tx=0x7f2c18009040 comp rx=0 tx=0).stop 2024-09-19T05:38:59.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 -- 172.21.15.67:0/298835927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c2815b1e0 msgr2=0x7f2c2815ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c2815b1e0 0x7f2c2815ddd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2c200ad040 tx=0x7f2c2001ac70 comp rx=0 tx=0).stop 2024-09-19T05:38:59.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 -- 172.21.15.67:0/298835927 shutdown_connections 2024-09-19T05:38:59.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c2815b1e0 0x7f2c2815ddd0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c140678c0 0x7f2c14069d80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c280b4900 0x7f2c28148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 --2- 172.21.15.67:0/298835927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c28072590 0x7f2c2815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 -- 172.21.15.67:0/298835927 >> 172.21.15.67:0/298835927 conn(0x7f2c280d0080 msgr2=0x7f2c2815eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:59.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 -- 172.21.15.67:0/298835927 shutdown_connections 2024-09-19T05:38:59.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.392+0000 7f2c2e48e640 1 -- 172.21.15.67:0/298835927 wait complete. 2024-09-19T05:38:59.420 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-19T05:38:59.420 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is split during scrub. 2024-09-19T05:38:59.420 INFO:tasks.cephfs_test_runner:test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-19T05:38:59.421 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:59.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.544+0000 7ffafa5c2640 1 Processor -- start 2024-09-19T05:38:59.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.544+0000 7ffafa5c2640 1 -- start start 2024-09-19T05:38:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffafa5c2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4070140 0x7ffaf415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffafa5c2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffaf40ae8c0 0x7ffaf40aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffafa5c2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf40cd320 con 0x7ffaf40ccee0 2024-09-19T05:38:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffafa5c2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ffaf406e790 con 0x7ffaf40ae8c0 2024-09-19T05:38:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffafa5c2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf406ea50 con 0x7ffaf4070140 2024-09-19T05:38:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ffaf40ccee0 0x7ffaf4070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36156/0 (socket says 172.21.15.67:36156) 2024-09-19T05:38:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf37fe640 1 -- 172.21.15.67:0/661307319 learned_addr learned my addr 172.21.15.67:0/661307319 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:38:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 529871786 0 0) 0x7ffaf40cd320 con 0x7ffaf40ccee0 2024-09-19T05:38:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf8b5f640 1 --2- 172.21.15.67:0/661307319 >> v2:172.21.15.97:3300/0 conn(0x7ffaf40ae8c0 0x7ffaf40aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf3fff640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4070140 0x7ffaf415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffadc003530 con 0x7ffaf40ccee0 2024-09-19T05:38:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3204244776 0 0) 0x7ffadc003530 con 0x7ffaf40ccee0 2024-09-19T05:38:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4070140 msgr2=0x7ffaf415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4070140 0x7ffaf415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 >> v2:172.21.15.97:3300/0 conn(0x7ffaf40ae8c0 msgr2=0x7ffaf40aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 --2- 172.21.15.67:0/661307319 >> v2:172.21.15.97:3300/0 conn(0x7ffaf40ae8c0 0x7ffaf40aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf406ed30 con 0x7ffaf40ccee0 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7ffae8001680 con 0x7ffaf40ccee0 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 >> v1:172.21.15.67:6789/0 conn(0x7ffaf40ccee0 legacy=0x7ffaf4070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffadc0039c0 0x7ffadc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffadc004810 0x7ffadc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4070140 0x7ffadc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf406e790 con 0x7ffadc004810 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf406ea50 con 0x7ffadc0039c0 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ffadc00ba20 con 0x7ffaf4070140 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf37fe640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffadc004810 0x7ffadc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf3fff640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffadc0039c0 0x7ffadc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf37fe640 1 -- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4070140 msgr2=0x7ffadc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf8b5f640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4070140 0x7ffadc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf37fe640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4070140 0x7ffadc0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf37fe640 1 -- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffadc0039c0 msgr2=0x7ffadc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:59.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf37fe640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffadc0039c0 0x7ffadc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.548+0000 7ffaf37fe640 1 -- 172.21.15.67:0/661307319 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffadc003530 con 0x7ffadc004810 2024-09-19T05:38:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf37fe640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffadc004810 0x7ffadc004c90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c190 tx=0x7ffae801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc048ec1ee68a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8007c90 con 0x7ffadc004810 2024-09-19T05:38:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae80a9020 con 0x7ffadc004810 2024-09-19T05:38:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf2ffd640 1 -- 172.21.15.67:0/661307319 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8005ae0 con 0x7ffadc004810 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 -- 172.21.15.67:0/661307319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffadc004810 msgr2=0x7ffadc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 --2- 172.21.15.67:0/661307319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffadc004810 0x7ffadc004c90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c190 tx=0x7ffae801cb90 comp rx=0 tx=0).stop 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf8b5f640 1 -- 172.21.15.67:0/661307319 reap_dead start 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 -- 172.21.15.67:0/661307319 shutdown_connections 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 -- 172.21.15.67:0/661307319 >> 172.21.15.67:0/661307319 conn(0x7ffaf4073500 msgr2=0x7ffaf406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 -- 172.21.15.67:0/661307319 shutdown_connections 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 -- 172.21.15.67:0/661307319 wait complete. 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 Processor -- start 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 -- start start 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffadc004810 0x7ffaf4159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4167e60 0x7ffaf40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaf40cfaa0 0x7ffaf40afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf415c2e0 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf415c160 con 0x7ffadc004810 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffafa5c2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf4168fb0 con 0x7ffaf4167e60 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf8b5f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaf40cfaa0 0x7ffaf40afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf8b5f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaf40cfaa0 0x7ffaf40afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51736/0 (socket says 172.21.15.67:51736) 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf8b5f640 1 -- 172.21.15.67:0/2763543876 learned_addr learned my addr 172.21.15.67:0/2763543876 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf3fff640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffadc004810 0x7ffaf4159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf37fe640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4167e60 0x7ffaf40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf8b5f640 1 -- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4167e60 msgr2=0x7ffaf40b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf8b5f640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4167e60 0x7ffaf40b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf8b5f640 1 -- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffadc004810 msgr2=0x7ffaf4159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf8b5f640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffadc004810 0x7ffaf4159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf8b5f640 1 -- 172.21.15.67:0/2763543876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf4165450 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.552+0000 7ffaf37fe640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4167e60 0x7ffaf40b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:59.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffaf8b5f640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaf40cfaa0 0x7ffaf40afc20 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4067cd0 tx=0x7ffaec00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:59.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffaf0ff9640 1 -- 172.21.15.67:0/2763543876 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00fe50 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffaf0ff9640 1 -- 172.21.15.67:0/2763543876 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaec0039a0 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffaf0ff9640 1 -- 172.21.15.67:0/2763543876 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec003d90 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffafa5c2640 1 -- 172.21.15.67:0/2763543876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf4168340 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffafa5c2640 1 -- 172.21.15.67:0/2763543876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf41659f0 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffafa5c2640 1 -- 172.21.15.67:0/2763543876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf40aecd0 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffaf0ff9640 1 -- 172.21.15.67:0/2763543876 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffaec01d020 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffaf0ff9640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffae00678f0 0x7ffae0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffaf0ff9640 1 -- 172.21.15.67:0/2763543876 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5421+0+0 (secure 0 0 0) 0x7ffaec0862b0 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffaf3fff640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffae00678f0 0x7ffae0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.556+0000 7ffaf3fff640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffae00678f0 0x7ffae0069db0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009810 tx=0x7ffae4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:59.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.560+0000 7ffaf0ff9640 1 -- 172.21.15.67:0/2763543876 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ffaec024020 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.728+0000 7ffafa5c2640 1 -- 172.21.15.67:0/2763543876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffaf40b5ac0 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.728+0000 7ffaf0ff9640 1 -- 172.21.15.67:0/2763543876 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+13400 (secure 0 0 0) 0x7ffaec056fa0 con 0x7ffaf40cfaa0 2024-09-19T05:38:59.733 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:38:59.733 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":92,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:38:58.381974+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6833/1473897687":"2024-09-20T05:38:55.159717+0000","172.21.15.67:6834/3597291023":"2024-09-20T05:38:34.321559+0000","172.21.15.67:6832/1473897687":"2024-09-20T05:38:55.159717+0000","172.21.15.67:6832/3597291023":"2024-09-20T05:38:34.321559+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:59.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 -- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffae00678f0 msgr2=0x7ffae0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffae00678f0 0x7ffae0069db0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009810 tx=0x7ffae4008040 comp rx=0 tx=0).stop 2024-09-19T05:38:59.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 -- 172.21.15.67:0/2763543876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaf40cfaa0 msgr2=0x7ffaf40afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaf40cfaa0 0x7ffaf40afc20 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4067cd0 tx=0x7ffaec00f520 comp rx=0 tx=0).stop 2024-09-19T05:38:59.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 -- 172.21.15.67:0/2763543876 shutdown_connections 2024-09-19T05:38:59.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaf40cfaa0 0x7ffaf40afc20 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffae00678f0 0x7ffae0069db0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffaf4167e60 0x7ffaf40b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 --2- 172.21.15.67:0/2763543876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffadc004810 0x7ffaf4159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 -- 172.21.15.67:0/2763543876 >> 172.21.15.67:0/2763543876 conn(0x7ffaf4073500 msgr2=0x7ffaf4161110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:59.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 -- 172.21.15.67:0/2763543876 shutdown_connections 2024-09-19T05:38:59.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.732+0000 7ffafa5c2640 1 -- 172.21.15.67:0/2763543876 wait complete. 2024-09-19T05:38:59.753 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:38:59.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:38:59.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c7a67640 1 Processor -- start 2024-09-19T05:38:59.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c7a67640 1 -- start start 2024-09-19T05:38:59.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c7a67640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d4fb0 0x7f73c00d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c7a67640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f73c00d13c0 0x7f73c006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c7a67640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73c00d35a0 con 0x7f73c015e690 2024-09-19T05:38:59.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c7a67640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f73c00d32c0 con 0x7f73c00d13c0 2024-09-19T05:38:59.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c7a67640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f73c006d040 con 0x7f73c00d4fb0 2024-09-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c5002640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d4fb0 0x7f73c00d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c6004640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f73c00d13c0 0x7f73c006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c5002640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d4fb0 0x7f73c00d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:42776/0 (socket says 172.21.15.67:42776) 2024-09-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c5803640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f73c015e690 0x7f73c00d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:57758/0 (socket says 172.21.15.67:57758) 2024-09-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c5002640 1 -- 172.21.15.67:0/460756328 learned_addr learned my addr 172.21.15.67:0/460756328 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c4801640 1 -- 172.21.15.67:0/460756328 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169428262 0 0) 0x7f73c00d35a0 con 0x7f73c015e690 2024-09-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c4801640 1 -- 172.21.15.67:0/460756328 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73ac003530 con 0x7f73c015e690 2024-09-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c6004640 1 -- 172.21.15.67:0/460756328 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d4fb0 msgr2=0x7f73c00d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c6004640 1 --2- 172.21.15.67:0/460756328 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d4fb0 0x7f73c00d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c6004640 1 -- 172.21.15.67:0/460756328 >> v1:172.21.15.97:6789/0 conn(0x7f73c015e690 legacy=0x7f73c00d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c6004640 1 -- 172.21.15.67:0/460756328 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c006d320 con 0x7f73c00d13c0 2024-09-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.880+0000 7f73c5002640 1 --2- 172.21.15.67:0/460756328 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d4fb0 0x7f73c00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c6004640 1 --2- 172.21.15.67:0/460756328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c00d13c0 0x7f73c006db20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009d90 tx=0x7f73b801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b782ea5909de2d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:59.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c4801640 1 -- 172.21.15.67:0/460756328 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80b2070 con 0x7f73c00d13c0 2024-09-19T05:38:59.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c4801640 1 -- 172.21.15.67:0/460756328 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b80a58c0 con 0x7f73c00d13c0 2024-09-19T05:38:59.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c4801640 1 -- 172.21.15.67:0/460756328 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80a5c70 con 0x7f73c00d13c0 2024-09-19T05:38:59.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c7a67640 1 -- 172.21.15.67:0/460756328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c00d13c0 msgr2=0x7f73c006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c7a67640 1 --2- 172.21.15.67:0/460756328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c00d13c0 0x7f73c006db20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009d90 tx=0x7f73b801c970 comp rx=0 tx=0).stop 2024-09-19T05:38:59.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c7a67640 1 -- 172.21.15.67:0/460756328 shutdown_connections 2024-09-19T05:38:59.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c7a67640 1 --2- 172.21.15.67:0/460756328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c00d13c0 0x7f73c006db20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c7a67640 1 --2- 172.21.15.67:0/460756328 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d4fb0 0x7f73c00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c7a67640 1 -- 172.21.15.67:0/460756328 >> 172.21.15.67:0/460756328 conn(0x7f73c00d4490 msgr2=0x7f73c00d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:59.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c7a67640 1 -- 172.21.15.67:0/460756328 shutdown_connections 2024-09-19T05:38:59.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c7a67640 1 -- 172.21.15.67:0/460756328 wait complete. 2024-09-19T05:38:59.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.884+0000 7f73c7a67640 1 Processor -- start 2024-09-19T05:38:59.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c7a67640 1 -- start start 2024-09-19T05:38:59.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c7a67640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d13c0 0x7f73c0154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c7a67640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00d4fb0 0x7f73c01547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c7a67640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c015e690 0x7f73c00b9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c7a67640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73c006ec00 con 0x7f73c00d4fb0 2024-09-19T05:38:59.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c7a67640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f73c006ea80 con 0x7f73c015e690 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c7a67640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f73c016b250 con 0x7f73c00d13c0 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c5002640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00d4fb0 0x7f73c01547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c5002640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00d4fb0 0x7f73c01547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51746/0 (socket says 172.21.15.67:51746) 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c5002640 1 -- 172.21.15.67:0/319351710 learned_addr learned my addr 172.21.15.67:0/319351710 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c6004640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c015e690 0x7f73c00b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c5803640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d13c0 0x7f73c0154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c5002640 1 -- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d13c0 msgr2=0x7f73c0154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c5002640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d13c0 0x7f73c0154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c5002640 1 -- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c015e690 msgr2=0x7f73c00b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c5002640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c015e690 0x7f73c00b9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c5002640 1 -- 172.21.15.67:0/319351710 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c0156500 con 0x7f73c00d4fb0 2024-09-19T05:38:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c5002640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00d4fb0 0x7f73c01547b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f73b000e9d0 tx=0x7f73b000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:59.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73b67fc640 1 -- 172.21.15.67:0/319351710 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0017070 con 0x7f73c00d4fb0 2024-09-19T05:38:59.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73b67fc640 1 -- 172.21.15.67:0/319351710 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b000ca60 con 0x7f73c00d4fb0 2024-09-19T05:38:59.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73b67fc640 1 -- 172.21.15.67:0/319351710 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b000ce10 con 0x7f73c00d4fb0 2024-09-19T05:38:59.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c7a67640 1 -- 172.21.15.67:0/319351710 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c0156770 con 0x7f73c00d4fb0 2024-09-19T05:38:59.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c7a67640 1 -- 172.21.15.67:0/319351710 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c00b7fb0 con 0x7f73c00d4fb0 2024-09-19T05:38:59.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73c7a67640 1 -- 172.21.15.67:0/319351710 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c006db20 con 0x7f73c00d4fb0 2024-09-19T05:38:59.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73b67fc640 1 -- 172.21.15.67:0/319351710 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73b001a070 con 0x7f73c00d4fb0 2024-09-19T05:38:59.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.888+0000 7f73b67fc640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73a40678c0 0x7f73a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:59.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.892+0000 7f73b67fc640 1 -- 172.21.15.67:0/319351710 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5421+0+0 (secure 0 0 0) 0x7f73b0085c00 con 0x7f73c00d4fb0 2024-09-19T05:38:59.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.892+0000 7f73c5803640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73a40678c0 0x7f73a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:59.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.892+0000 7f73c5803640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73a40678c0 0x7f73a4069d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f73bc007fd0 tx=0x7f73bc007b20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:59.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:38:59.896+0000 7f73b67fc640 1 -- 172.21.15.67:0/319351710 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f73b0056740 con 0x7f73c00d4fb0 2024-09-19T05:39:00.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.056+0000 7f73c7a67640 1 -- 172.21.15.67:0/319351710 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f73c015b3c0 con 0x7f73c00d4fb0 2024-09-19T05:39:00.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.056+0000 7f73b67fc640 1 -- 172.21.15.67:0/319351710 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f73b0056040 con 0x7f73c00d4fb0 2024-09-19T05:39:00.062 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:39:00.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 -- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73a40678c0 msgr2=0x7f73a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73a40678c0 0x7f73a4069d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f73bc007fd0 tx=0x7f73bc007b20 comp rx=0 tx=0).stop 2024-09-19T05:39:00.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 -- 172.21.15.67:0/319351710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00d4fb0 msgr2=0x7f73c01547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00d4fb0 0x7f73c01547b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f73b000e9d0 tx=0x7f73b000ee90 comp rx=0 tx=0).stop 2024-09-19T05:39:00.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 -- 172.21.15.67:0/319351710 shutdown_connections 2024-09-19T05:39:00.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c015e690 0x7f73c00b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c00d4fb0 0x7f73c01547b0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73a40678c0 0x7f73a4069d80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 --2- 172.21.15.67:0/319351710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73c00d13c0 0x7f73c0154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 -- 172.21.15.67:0/319351710 >> 172.21.15.67:0/319351710 conn(0x7f73c00d4490 msgr2=0x7f73c015d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:00.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 -- 172.21.15.67:0/319351710 shutdown_connections 2024-09-19T05:39:00.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.060+0000 7f73c7a67640 1 -- 172.21.15.67:0/319351710 wait complete. 2024-09-19T05:39:00.081 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-19T05:39:00.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55ffe61640 1 Processor -- start 2024-09-19T05:39:00.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55ffe61640 1 -- start start 2024-09-19T05:39:00.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55ffe61640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 0x7f55f80d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55ffe61640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f55f80d0160 0x7f55f80d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55ffe61640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f80d4d40 con 0x7f55f80d0e80 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55ffe61640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f55f80d0610 con 0x7f55f80d0160 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55ffe61640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f55f80d0840 con 0x7f55f8161da0 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55fd3fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f55f80d0e80 0x7f55f80b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36168/0 (socket says 172.21.15.67:36168) 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55fe3fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f55f80d0160 0x7f55f80d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55fd3fc640 1 -- 172.21.15.67:0/399537277 learned_addr learned my addr 172.21.15.67:0/399537277 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55fdbfd640 1 --2- 172.21.15.67:0/399537277 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 0x7f55f80d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55fe3fe640 1 -- 172.21.15.67:0/399537277 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 msgr2=0x7f55f80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55fe3fe640 1 --2- 172.21.15.67:0/399537277 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 0x7f55f80d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55fe3fe640 1 -- 172.21.15.67:0/399537277 >> v1:172.21.15.67:6789/0 conn(0x7f55f80d0e80 legacy=0x7f55f80b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55fe3fe640 1 -- 172.21.15.67:0/399537277 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f80d5020 con 0x7f55f80d0160 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55fdbfd640 1 --2- 172.21.15.67:0/399537277 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 0x7f55f80d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.192+0000 7f55fcbfb640 1 -- 172.21.15.67:0/399537277 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776870202 0 0) 0x7f55f80d4d40 con 0x7f55f80d0e80 2024-09-19T05:39:00.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fe3fe640 1 --2- 172.21.15.67:0/399537277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 0x7f55f80d12c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009d90 tx=0x7f55f001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9588978d1f0b5aaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:00.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fcbfb640 1 -- 172.21.15.67:0/399537277 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f00b2070 con 0x7f55f80d0160 2024-09-19T05:39:00.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fcbfb640 1 -- 172.21.15.67:0/399537277 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f00a5830 con 0x7f55f80d0160 2024-09-19T05:39:00.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fcbfb640 1 -- 172.21.15.67:0/399537277 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f00a5c00 con 0x7f55f80d0160 2024-09-19T05:39:00.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 -- 172.21.15.67:0/399537277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 msgr2=0x7f55f80d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 --2- 172.21.15.67:0/399537277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 0x7f55f80d12c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009d90 tx=0x7f55f001c970 comp rx=0 tx=0).stop 2024-09-19T05:39:00.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 -- 172.21.15.67:0/399537277 shutdown_connections 2024-09-19T05:39:00.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 --2- 172.21.15.67:0/399537277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 0x7f55f80d12c0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 --2- 172.21.15.67:0/399537277 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 0x7f55f80d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 -- 172.21.15.67:0/399537277 >> 172.21.15.67:0/399537277 conn(0x7f55f808bfc0 msgr2=0x7f55f80d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:00.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 -- 172.21.15.67:0/399537277 shutdown_connections 2024-09-19T05:39:00.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 -- 172.21.15.67:0/399537277 wait complete. 2024-09-19T05:39:00.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 Processor -- start 2024-09-19T05:39:00.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 -- start start 2024-09-19T05:39:00.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 0x7f55f8155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f80d0e80 0x7f55f80cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 0x7f55f80cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f55f80b50e0 con 0x7f55f80d0160 2024-09-19T05:39:00.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8162180 con 0x7f55f80d0e80 2024-09-19T05:39:00.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55ffe61640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f55f80b5260 con 0x7f55f8161da0 2024-09-19T05:39:00.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fdbfd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 0x7f55f8155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fdbfd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 0x7f55f8155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51758/0 (socket says 172.21.15.67:51758) 2024-09-19T05:39:00.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fdbfd640 1 -- 172.21.15.67:0/725928350 learned_addr learned my addr 172.21.15.67:0/725928350 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fd3fc640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f80d0e80 0x7f55f80cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fe3fe640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 0x7f55f80cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fdbfd640 1 -- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 msgr2=0x7f55f80cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fdbfd640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 0x7f55f80cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fdbfd640 1 -- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f80d0e80 msgr2=0x7f55f80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fdbfd640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f80d0e80 0x7f55f80cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fdbfd640 1 -- 172.21.15.67:0/725928350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f80ce290 con 0x7f55f80d0160 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.196+0000 7f55fd3fc640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f80d0e80 0x7f55f80cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55fdbfd640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 0x7f55f8155910 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c7f0 tx=0x7f55f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55ea7fc640 1 -- 172.21.15.67:0/725928350 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4015070 con 0x7f55f80d0160 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55ea7fc640 1 -- 172.21.15.67:0/725928350 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f4007820 con 0x7f55f80d0160 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55ffe61640 1 -- 172.21.15.67:0/725928350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f80b9280 con 0x7f55f80d0160 2024-09-19T05:39:00.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55ea7fc640 1 -- 172.21.15.67:0/725928350 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4007c10 con 0x7f55f80d0160 2024-09-19T05:39:00.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55ffe61640 1 -- 172.21.15.67:0/725928350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f80ccb70 con 0x7f55f80d0160 2024-09-19T05:39:00.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55ffe61640 1 -- 172.21.15.67:0/725928350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f80cce90 con 0x7f55f80d0160 2024-09-19T05:39:00.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55ea7fc640 1 -- 172.21.15.67:0/725928350 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55f4018070 con 0x7f55f80d0160 2024-09-19T05:39:00.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55ea7fc640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55dc0678c0 0x7f55dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55ea7fc640 1 -- 172.21.15.67:0/725928350 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5421+0+0 (secure 0 0 0) 0x7f55f4085c10 con 0x7f55f80d0160 2024-09-19T05:39:00.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55fd3fc640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55dc0678c0 0x7f55dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.200+0000 7f55fd3fc640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55dc0678c0 0x7f55dc069d80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f55f8159700 tx=0x7f55ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:00.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.204+0000 7f55ea7fc640 1 -- 172.21.15.67:0/725928350 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f55f80cce90 con 0x7f55f80d0160 2024-09-19T05:39:00.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:00.424+0000 7f55ffe61640 1 -- 172.21.15.67:0/725928350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f55f80d1af0 con 0x7f55f80d0160 2024-09-19T05:39:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.404+0000 7f55ea7fc640 1 -- 172.21.15.67:0/725928350 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v282) ==== 154+0+0 (secure 0 0 0) 0x7f55f80ce290 con 0x7f55f80d0160 2024-09-19T05:39:01.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 -- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55dc0678c0 msgr2=0x7f55dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55dc0678c0 0x7f55dc069d80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f55f8159700 tx=0x7f55ec009040 comp rx=0 tx=0).stop 2024-09-19T05:39:01.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 -- 172.21.15.67:0/725928350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 msgr2=0x7f55f8155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 0x7f55f8155910 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c7f0 tx=0x7f55f400ccb0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 -- 172.21.15.67:0/725928350 shutdown_connections 2024-09-19T05:39:01.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55dc0678c0 0x7f55dc069d80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55f8161da0 0x7f55f80cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f80d0e80 0x7f55f80cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 --2- 172.21.15.67:0/725928350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f80d0160 0x7f55f8155910 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 -- 172.21.15.67:0/725928350 >> 172.21.15.67:0/725928350 conn(0x7f55f808bfc0 msgr2=0x7f55f806e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:01.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 -- 172.21.15.67:0/725928350 shutdown_connections 2024-09-19T05:39:01.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.408+0000 7f55ffe61640 1 -- 172.21.15.67:0/725928350 wait complete. 2024-09-19T05:39:01.432 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:39:01.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85ab447640 1 Processor -- start 2024-09-19T05:39:01.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85ab447640 1 -- start start 2024-09-19T05:39:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85ab447640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a415e4b0 0x7f85a415f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85ab447640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85a415f960 con 0x7f85a409b140 2024-09-19T05:39:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85ab447640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85a40cd590 con 0x7f85a40cd110 2024-09-19T05:39:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85ab447640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f85a415e890 con 0x7f85a415e4b0 2024-09-19T05:39:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a99e4640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f85a409b140 0x7f85a40cfef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36184/0 (socket says 172.21.15.67:36184) 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a99e4640 1 -- 172.21.15.67:0/1206198268 learned_addr learned my addr 172.21.15.67:0/1206198268 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a91e3640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a415e4b0 0x7f85a415f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387403483 0 0) 0x7f859c0014a0 con 0x7f85a409b140 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8590003530 con 0x7f85a409b140 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109434483 0 0) 0x7f85a40cd590 con 0x7f85a40cd110 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f859c0014a0 con 0x7f85a40cd110 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1719503636 0 0) 0x7f8590003530 con 0x7f85a409b140 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a415e4b0 msgr2=0x7f85a415f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a415e4b0 0x7f85a415f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 >> v1:172.21.15.97:6789/0 conn(0x7f85a40cd110 legacy=0x7f85a409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a40cd870 con 0x7f85a409b140 2024-09-19T05:39:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f859c001b50 con 0x7f85a409b140 2024-09-19T05:39:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 >> v1:172.21.15.67:6789/0 conn(0x7f85a409b140 legacy=0x7f85a40cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8590003b80 0x7f8590003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8590004810 0x7f8590004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85900051d0 0x7f859000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f85a415e890 con 0x7f8590004810 2024-09-19T05:39:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f859000bff0 con 0x7f8590003b80 2024-09-19T05:39:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f859000c1f0 con 0x7f85900051d0 2024-09-19T05:39:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a91e3640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a415e4b0 0x7f85a415f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a89e2640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8590004810 0x7f8590004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a99e4640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85900051d0 0x7f859000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a89e2640 1 -- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85900051d0 msgr2=0x7f859000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a89e2640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85900051d0 0x7f859000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a91e3640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8590003b80 0x7f8590003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a89e2640 1 -- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8590003b80 msgr2=0x7f8590003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a89e2640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8590003b80 0x7f8590003f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a89e2640 1 -- 172.21.15.67:0/1206198268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8590003530 con 0x7f8590004810 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.556+0000 7f85a99e4640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85900051d0 0x7f859000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f85a89e2640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8590004810 0x7f8590004c90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f85a00018c0 tx=0x7f85a001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbf754f6662695b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0001510 con 0x7f8590004810 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a00052d0 con 0x7f8590004810 2024-09-19T05:39:01.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f859bfff640 1 -- 172.21.15.67:0/1206198268 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a00a8930 con 0x7f8590004810 2024-09-19T05:39:01.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f85ab447640 1 -- 172.21.15.67:0/1206198268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8590004810 msgr2=0x7f8590004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f85ab447640 1 --2- 172.21.15.67:0/1206198268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8590004810 0x7f8590004c90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f85a00018c0 tx=0x7f85a001ecf0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f85a99e4640 1 -- 172.21.15.67:0/1206198268 reap_dead start 2024-09-19T05:39:01.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f85ab447640 1 -- 172.21.15.67:0/1206198268 shutdown_connections 2024-09-19T05:39:01.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f85ab447640 1 -- 172.21.15.67:0/1206198268 >> 172.21.15.67:0/1206198268 conn(0x7f85a40d2320 msgr2=0x7f85a40d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:01.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f85ab447640 1 -- 172.21.15.67:0/1206198268 shutdown_connections 2024-09-19T05:39:01.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f85ab447640 1 -- 172.21.15.67:0/1206198268 wait complete. 2024-09-19T05:39:01.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f85ab447640 1 Processor -- start 2024-09-19T05:39:01.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.560+0000 7f85ab447640 1 -- start start 2024-09-19T05:39:01.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85ab447640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8590004810 0x7f85a41e8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:01.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85ab447640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85a41492d0 0x7f85a40c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:01.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85ab447640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a4149870 0x7f85a40c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:01.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85ab447640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f85a40ce110 con 0x7f85a4149870 2024-09-19T05:39:01.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85ab447640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f85a40cde30 con 0x7f85a41492d0 2024-09-19T05:39:01.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85ab447640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f85a409b7d0 con 0x7f8590004810 2024-09-19T05:39:01.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a99e4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a4149870 0x7f85a40c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:01.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a99e4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a4149870 0x7f85a40c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51788/0 (socket says 172.21.15.67:51788) 2024-09-19T05:39:01.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a99e4640 1 -- 172.21.15.67:0/3508974940 learned_addr learned my addr 172.21.15.67:0/3508974940 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:01.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a89e2640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85a41492d0 0x7f85a40c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a91e3640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8590004810 0x7f85a41e8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a99e4640 1 -- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8590004810 msgr2=0x7f85a41e8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a99e4640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8590004810 0x7f85a41e8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a99e4640 1 -- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85a41492d0 msgr2=0x7f85a40c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a99e4640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85a41492d0 0x7f85a40c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a99e4640 1 -- 172.21.15.67:0/3508974940 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a41607a0 con 0x7f85a4149870 2024-09-19T05:39:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85a99e4640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a4149870 0x7f85a40c5d80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f859c001a50 tx=0x7f859c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f8599ffb640 1 -- 172.21.15.67:0/3508974940 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c00bdb0 con 0x7f85a4149870 2024-09-19T05:39:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f8599ffb640 1 -- 172.21.15.67:0/3508974940 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859c004e40 con 0x7f85a4149870 2024-09-19T05:39:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f8599ffb640 1 -- 172.21.15.67:0/3508974940 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c007350 con 0x7f85a4149870 2024-09-19T05:39:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85ab447640 1 -- 172.21.15.67:0/3508974940 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a4160a80 con 0x7f85a4149870 2024-09-19T05:39:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85ab447640 1 -- 172.21.15.67:0/3508974940 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a40c8e30 con 0x7f85a4149870 2024-09-19T05:39:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f85ab447640 1 -- 172.21.15.67:0/3508974940 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a415f470 con 0x7f85a4149870 2024-09-19T05:39:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f8599ffb640 1 -- 172.21.15.67:0/3508974940 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f859c01b020 con 0x7f85a4149870 2024-09-19T05:39:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f8599ffb640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85880678c0 0x7f8588069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.564+0000 7f8599ffb640 1 -- 172.21.15.67:0/3508974940 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5421+0+0 (secure 0 0 0) 0x7f859c085e50 con 0x7f85a4149870 2024-09-19T05:39:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.568+0000 7f85a91e3640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85880678c0 0x7f8588069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.568+0000 7f85a91e3640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85880678c0 0x7f8588069d80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f85a4072be0 tx=0x7f8594008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.572+0000 7f8599ffb640 1 -- 172.21.15.67:0/3508974940 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f85a415f960 con 0x7f85a4149870 2024-09-19T05:39:01.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.728+0000 7f85ab447640 1 -- 172.21.15.67:0/3508974940 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f85a4162c00 con 0x7f85a4149870 2024-09-19T05:39:01.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.732+0000 7f8599ffb640 1 -- 172.21.15.67:0/3508974940 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f859c056b40 con 0x7f85a4149870 2024-09-19T05:39:01.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 -- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85880678c0 msgr2=0x7f8588069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85880678c0 0x7f8588069d80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f85a4072be0 tx=0x7f8594008040 comp rx=0 tx=0).stop 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 -- 172.21.15.67:0/3508974940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a4149870 msgr2=0x7f85a40c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a4149870 0x7f85a40c5d80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f859c001a50 tx=0x7f859c00b4a0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 -- 172.21.15.67:0/3508974940 shutdown_connections 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a4149870 0x7f85a40c5d80 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85a41492d0 0x7f85a40c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85880678c0 0x7f8588069d80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 --2- 172.21.15.67:0/3508974940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8590004810 0x7f85a41e8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 -- 172.21.15.67:0/3508974940 >> 172.21.15.67:0/3508974940 conn(0x7f85a40d2320 msgr2=0x7f85a40717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 -- 172.21.15.67:0/3508974940 shutdown_connections 2024-09-19T05:39:01.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:01.736+0000 7f85ab447640 1 -- 172.21.15.67:0/3508974940 wait complete. 2024-09-19T05:39:01.757 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:39:01.758 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:39:01.827 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:39:01.911 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:39:01.912 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:39:01.912 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:01.918 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:39:01.918 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:39:01.918 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:01.924 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:39:01.924 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:39:01.924 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:01.967 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:39:01.967 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:39:01.967 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:01.973 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:39:01.973 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:39:01.973 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 Processor -- start 2024-09-19T05:39:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 -- start start 2024-09-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f091015b1e0 0x7f09100b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09100b3860 con 0x7f09100b4900 2024-09-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09100b3b40 con 0x7f0910072590 2024-09-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f091015b5c0 con 0x7f091015b1e0 2024-09-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090f7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f09100b4900 0x7f0910071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36190/0 (socket says 172.21.15.67:36190) 2024-09-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090f7fe640 1 -- 172.21.15.67:0/982706483 learned_addr learned my addr 172.21.15.67:0/982706483 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090ffff640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f091015b1e0 0x7f09100b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572870046 0 0) 0x7f09100b3860 con 0x7f09100b4900 2024-09-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08fc005740 con 0x7f09100b4900 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2961833236 0 0) 0x7f08fc005740 con 0x7f09100b4900 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f091015b1e0 msgr2=0x7f09100b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f091015b1e0 0x7f09100b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 >> v1:172.21.15.97:6789/0 conn(0x7f0910072590 legacy=0x7f09100ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09100b3e20 con 0x7f09100b4900 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f08f8001680 con 0x7f09100b4900 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 >> v1:172.21.15.67:6789/0 conn(0x7f09100b4900 legacy=0x7f0910071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08fc005c00 0x7f08fc006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc006a20 0x7f08fc006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f091015b1e0 0x7f08fc0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f091015b5c0 con 0x7f08fc006a20 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc00dc90 con 0x7f08fc005c00 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f08fc00de90 con 0x7f091015b1e0 2024-09-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090f7fe640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc006a20 0x7f08fc006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090ffff640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08fc005c00 0x7f08fc006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0914bdd640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f091015b1e0 0x7f08fc0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090f7fe640 1 -- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f091015b1e0 msgr2=0x7f08fc0073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:02.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090f7fe640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f091015b1e0 0x7f08fc0073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090f7fe640 1 -- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08fc005c00 msgr2=0x7f08fc006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:02.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090f7fe640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08fc005c00 0x7f08fc006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090f7fe640 1 -- 172.21.15.67:0/982706483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08fc005740 con 0x7f08fc006a20 2024-09-19T05:39:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090f7fe640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc006a20 0x7f08fc006ea0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f09100b2d60 tx=0x7f08f801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f161d004d3bc7a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8007d20 con 0x7f08fc006a20 2024-09-19T05:39:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f8005ae0 con 0x7f08fc006a20 2024-09-19T05:39:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f090effd640 1 -- 172.21.15.67:0/982706483 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8007070 con 0x7f08fc006a20 2024-09-19T05:39:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 -- 172.21.15.67:0/982706483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc006a20 msgr2=0x7f08fc006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 --2- 172.21.15.67:0/982706483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08fc006a20 0x7f08fc006ea0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f09100b2d60 tx=0x7f08f801f370 comp rx=0 tx=0).stop 2024-09-19T05:39:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0914bdd640 1 -- 172.21.15.67:0/982706483 reap_dead start 2024-09-19T05:39:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 -- 172.21.15.67:0/982706483 shutdown_connections 2024-09-19T05:39:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 -- 172.21.15.67:0/982706483 >> 172.21.15.67:0/982706483 conn(0x7f09100d0080 msgr2=0x7f09100d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 -- 172.21.15.67:0/982706483 shutdown_connections 2024-09-19T05:39:02.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.140+0000 7f0916640640 1 -- 172.21.15.67:0/982706483 wait complete. 2024-09-19T05:39:02.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 Processor -- start 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 -- start start 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08fc006a20 0x7f091013fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910153be0 0x7f0910154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f091015bdf0 0x7f091015c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0910072a40 con 0x7f0910153be0 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f09100b43e0 con 0x7f091015bdf0 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0910072bc0 con 0x7f08fc006a20 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910153be0 0x7f0910154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910153be0 0x7f0910154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51802/0 (socket says 172.21.15.67:51802) 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090f7fe640 1 -- 172.21.15.67:0/1905878331 learned_addr learned my addr 172.21.15.67:0/1905878331 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090ffff640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08fc006a20 0x7f091013fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0914bdd640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f091015bdf0 0x7f091015c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090f7fe640 1 -- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08fc006a20 msgr2=0x7f091013fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090f7fe640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08fc006a20 0x7f091013fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090f7fe640 1 -- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f091015bdf0 msgr2=0x7f091015c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090f7fe640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f091015bdf0 0x7f091015c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090f7fe640 1 -- 172.21.15.67:0/1905878331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0910140280 con 0x7f0910153be0 2024-09-19T05:39:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090f7fe640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910153be0 0x7f0910154060 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f08f8025fe0 tx=0x7f08fc007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090cff9640 1 -- 172.21.15.67:0/1905878331 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f80047f0 con 0x7f0910153be0 2024-09-19T05:39:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090cff9640 1 -- 172.21.15.67:0/1905878331 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f8004990 con 0x7f0910153be0 2024-09-19T05:39:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f090cff9640 1 -- 172.21.15.67:0/1905878331 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8004d40 con 0x7f0910153be0 2024-09-19T05:39:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 -- 172.21.15.67:0/1905878331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f091015c7b0 con 0x7f0910153be0 2024-09-19T05:39:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 -- 172.21.15.67:0/1905878331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f091015cf30 con 0x7f0910153be0 2024-09-19T05:39:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.144+0000 7f0916640640 1 -- 172.21.15.67:0/1905878331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0910071e80 con 0x7f0910153be0 2024-09-19T05:39:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.148+0000 7f090cff9640 1 -- 172.21.15.67:0/1905878331 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f08f8007070 con 0x7f0910153be0 2024-09-19T05:39:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.148+0000 7f090cff9640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08f00678f0 0x7f08f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.148+0000 7f090cff9640 1 -- 172.21.15.67:0/1905878331 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5421+0+0 (secure 0 0 0) 0x7f08f8123210 con 0x7f0910153be0 2024-09-19T05:39:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.148+0000 7f090ffff640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08f00678f0 0x7f08f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.148+0000 7f090ffff640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08f00678f0 0x7f08f0069db0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f091014f530 tx=0x7f0900008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:02.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.152+0000 7f090cff9640 1 -- 172.21.15.67:0/1905878331 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f08f80b7070 con 0x7f0910153be0 2024-09-19T05:39:02.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.348+0000 7f0916640640 1 -- 172.21.15.67:0/1905878331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09100b4e30 con 0x7f0910153be0 2024-09-19T05:39:02.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.348+0000 7f090cff9640 1 -- 172.21.15.67:0/1905878331 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+3905 (secure 0 0 0) 0x7f08f8019080 con 0x7f0910153be0 2024-09-19T05:39:02.354 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:02.354 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":60,"btime":"2024-09-19T05:38:56:162912+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1497173986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1497173986},{"type":"v1","addr":"172.21.15.97:6835","nonce":1497173986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4151620700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4151620700},{"type":"v1","addr":"172.21.15.97:6837","nonce":4151620700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/491214453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":491214453},{"type":"v1","addr":"172.21.15.67:6835","nonce":491214453}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7137,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/856898184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":856898184},{"type":"v1","addr":"172.21.15.67:6833","nonce":856898184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[]} 2024-09-19T05:39:02.354 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 60 2024-09-19T05:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 -- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08f00678f0 msgr2=0x7f08f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08f00678f0 0x7f08f0069db0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f091014f530 tx=0x7f0900008040 comp rx=0 tx=0).stop 2024-09-19T05:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 -- 172.21.15.67:0/1905878331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910153be0 msgr2=0x7f0910154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910153be0 0x7f0910154060 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f08f8025fe0 tx=0x7f08fc007a50 comp rx=0 tx=0).stop 2024-09-19T05:39:02.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 -- 172.21.15.67:0/1905878331 shutdown_connections 2024-09-19T05:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f091015bdf0 0x7f091015c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0910153be0 0x7f0910154060 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f08f00678f0 0x7f08f0069db0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 --2- 172.21.15.67:0/1905878331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f08fc006a20 0x7f091013fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 -- 172.21.15.67:0/1905878331 >> 172.21.15.67:0/1905878331 conn(0x7f09100d0080 msgr2=0x7f09100af360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 -- 172.21.15.67:0/1905878331 shutdown_connections 2024-09-19T05:39:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.352+0000 7f0916640640 1 -- 172.21.15.67:0/1905878331 wait complete. 2024-09-19T05:39:02.374 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:39:02.375 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:39:02.375 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:39:02.375 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:02.375 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:39:02.375 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:39:02.376 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:39:02.376 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:02.376 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:39:02.376 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:39:02.376 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:39:02.376 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:02.376 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:39:02.376 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:39:02.377 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:39:02.377 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:02.385 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:39:02.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:39:02.386 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:39:02.387 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:39:02.390 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:39:02.390 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:39:02.392 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:39:02.392 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:39:02.435 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:39:02.435 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:02.436 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:39:02.436 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:02.438 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:39:02.439 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:02.440 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:39:02.440 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:02.440 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:39:02.499 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:39:02.499 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:39:02.509 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:39:02.512 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:39:02.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc6906a6640 1 Processor -- start 2024-09-19T05:39:02.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc6906a6640 1 -- start start 2024-09-19T05:39:02.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc6906a6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6881513d0 0x7fc6880722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc6906a6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc6880727f0 0x7fc68815dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc6906a6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc68815e520 0x7fc6880ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc6906a6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc68815bb00 con 0x7fc6881513d0 2024-09-19T05:39:02.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc6906a6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc68815ed10 con 0x7fc6880727f0 2024-09-19T05:39:02.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc6906a6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc68806e4c0 con 0x7fc68815e520 2024-09-19T05:39:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc68e442640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6881513d0 0x7fc6880722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc68e442640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6881513d0 0x7fc6880722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51854/0 (socket says 172.21.15.67:51854) 2024-09-19T05:39:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc68e442640 1 -- 172.21.15.67:0/607050372 learned_addr learned my addr 172.21.15.67:0/607050372 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc68ec43640 1 --2- 172.21.15.67:0/607050372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc68815e520 0x7fc6880ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.552+0000 7fc68dc41640 1 --2- 172.21.15.67:0/607050372 >> v2:172.21.15.97:3300/0 conn(0x7fc6880727f0 0x7fc68815dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc68e442640 1 -- 172.21.15.67:0/607050372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc68815e520 msgr2=0x7fc6880ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc68e442640 1 --2- 172.21.15.67:0/607050372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc68815e520 0x7fc6880ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc68e442640 1 -- 172.21.15.67:0/607050372 >> v2:172.21.15.97:3300/0 conn(0x7fc6880727f0 msgr2=0x7fc68815dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc68e442640 1 --2- 172.21.15.67:0/607050372 >> v2:172.21.15.97:3300/0 conn(0x7fc6880727f0 0x7fc68815dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc68e442640 1 -- 172.21.15.67:0/607050372 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6880700b0 con 0x7fc6881513d0 2024-09-19T05:39:02.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc68e442640 1 --2- 172.21.15.67:0/607050372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6881513d0 0x7fc6880722b0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fc6880b5ad0 tx=0x7fc67c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c05e4d19dcf0cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:02.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc68d440640 1 -- 172.21.15.67:0/607050372 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0b0070 con 0x7fc6881513d0 2024-09-19T05:39:02.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc68d440640 1 -- 172.21.15.67:0/607050372 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67c0ab600 con 0x7fc6881513d0 2024-09-19T05:39:02.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc68d440640 1 -- 172.21.15.67:0/607050372 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0ab9d0 con 0x7fc6881513d0 2024-09-19T05:39:02.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc6906a6640 1 -- 172.21.15.67:0/607050372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6881513d0 msgr2=0x7fc6880722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:02.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc6906a6640 1 --2- 172.21.15.67:0/607050372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6881513d0 0x7fc6880722b0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fc6880b5ad0 tx=0x7fc67c01c520 comp rx=0 tx=0).stop 2024-09-19T05:39:02.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc6906a6640 1 -- 172.21.15.67:0/607050372 shutdown_connections 2024-09-19T05:39:02.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc6906a6640 1 --2- 172.21.15.67:0/607050372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc68815e520 0x7fc6880ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc6906a6640 1 --2- 172.21.15.67:0/607050372 >> v2:172.21.15.97:3300/0 conn(0x7fc6880727f0 0x7fc68815dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc6906a6640 1 --2- 172.21.15.67:0/607050372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6881513d0 0x7fc6880722b0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc6906a6640 1 -- 172.21.15.67:0/607050372 >> 172.21.15.67:0/607050372 conn(0x7fc68806bcc0 msgr2=0x7fc68806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:02.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc6906a6640 1 -- 172.21.15.67:0/607050372 shutdown_connections 2024-09-19T05:39:02.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.556+0000 7fc6906a6640 1 -- 172.21.15.67:0/607050372 wait complete. 2024-09-19T05:39:02.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 Processor -- start 2024-09-19T05:39:02.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 -- start start 2024-09-19T05:39:02.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6880727f0 0x7fc688155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6881513d0 0x7fc6881527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc68815e520 0x7fc688140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc688151930 con 0x7fc68815e520 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc6881517b0 con 0x7fc6881513d0 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc68806efa0 con 0x7fc6880727f0 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68ec43640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc68815e520 0x7fc688140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68ec43640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc68815e520 0x7fc688140da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51866/0 (socket says 172.21.15.67:51866) 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68ec43640 1 -- 172.21.15.67:0/837610644 learned_addr learned my addr 172.21.15.67:0/837610644 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68e442640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6880727f0 0x7fc688155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68dc41640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6881513d0 0x7fc6881527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68ec43640 1 -- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6880727f0 msgr2=0x7fc688155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68ec43640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6880727f0 0x7fc688155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68ec43640 1 -- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6881513d0 msgr2=0x7fc6881527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68ec43640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6881513d0 0x7fc6881527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68ec43640 1 -- 172.21.15.67:0/837610644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc688154090 con 0x7fc68815e520 2024-09-19T05:39:02.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc68ec43640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc68815e520 0x7fc688140da0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc680007e60 tx=0x7fc68000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:02.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc67affd640 1 -- 172.21.15.67:0/837610644 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680014420 con 0x7fc68815e520 2024-09-19T05:39:02.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc67affd640 1 -- 172.21.15.67:0/837610644 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc680019070 con 0x7fc68815e520 2024-09-19T05:39:02.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 -- 172.21.15.67:0/837610644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc688152ff0 con 0x7fc68815e520 2024-09-19T05:39:02.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc67affd640 1 -- 172.21.15.67:0/837610644 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680014820 con 0x7fc68815e520 2024-09-19T05:39:02.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 -- 172.21.15.67:0/837610644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6881535b0 con 0x7fc68815e520 2024-09-19T05:39:02.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc6906a6640 1 -- 172.21.15.67:0/837610644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6880722b0 con 0x7fc68815e520 2024-09-19T05:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.560+0000 7fc67affd640 1 -- 172.21.15.67:0/837610644 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6800149c0 con 0x7fc68815e520 2024-09-19T05:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.564+0000 7fc67affd640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc66c0678c0 0x7fc66c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.564+0000 7fc67affd640 1 -- 172.21.15.67:0/837610644 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5421+0+0 (secure 0 0 0) 0x7fc680087140 con 0x7fc68815e520 2024-09-19T05:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.564+0000 7fc68e442640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc66c0678c0 0x7fc66c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:02.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.564+0000 7fc68e442640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc66c0678c0 0x7fc66c069d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0ad000 tx=0x7fc67c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:02.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.564+0000 7fc67affd640 1 -- 172.21.15.67:0/837610644 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc680057730 con 0x7fc68815e520 2024-09-19T05:39:02.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:02.740+0000 7fc6906a6640 1 -- 172.21.15.67:0/837610644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc68815d480 con 0x7fc68815e520 2024-09-19T05:39:03.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.424+0000 7fc67affd640 1 -- 172.21.15.67:0/837610644 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) ==== 97+0+0 (secure 0 0 0) 0x7fc68005ba30 con 0x7fc68815e520 2024-09-19T05:39:03.429 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:39:03.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 -- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc66c0678c0 msgr2=0x7fc66c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc66c0678c0 0x7fc66c069d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0ad000 tx=0x7fc67c0a6000 comp rx=0 tx=0).stop 2024-09-19T05:39:03.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 -- 172.21.15.67:0/837610644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc68815e520 msgr2=0x7fc688140da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc68815e520 0x7fc688140da0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc680007e60 tx=0x7fc68000e4b0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 -- 172.21.15.67:0/837610644 shutdown_connections 2024-09-19T05:39:03.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc68815e520 0x7fc688140da0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6881513d0 0x7fc6881527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc66c0678c0 0x7fc66c069d80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 --2- 172.21.15.67:0/837610644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6880727f0 0x7fc688155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 -- 172.21.15.67:0/837610644 >> 172.21.15.67:0/837610644 conn(0x7fc68806bcc0 msgr2=0x7fc6880b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:03.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 -- 172.21.15.67:0/837610644 shutdown_connections 2024-09-19T05:39:03.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.428+0000 7fc6906a6640 1 -- 172.21.15.67:0/837610644 wait complete. 2024-09-19T05:39:03.456 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:39:03.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db92f4640 1 Processor -- start 2024-09-19T05:39:03.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db92f4640 1 -- start start 2024-09-19T05:39:03.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db92f4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415c030 0x7f8db406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db92f4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8db415d1d0 0x7f8db40b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db92f4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8db40b3510 0x7f8db406f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db92f4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8db406e3c0 con 0x7f8db40b3510 2024-09-19T05:39:03.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db92f4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8db406e6a0 con 0x7f8db415d1d0 2024-09-19T05:39:03.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db92f4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8db406e980 con 0x7f8db415c030 2024-09-19T05:39:03.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8db40b3510 0x7f8db406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8db40b3510 0x7f8db406f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51872/0 (socket says 172.21.15.67:51872) 2024-09-19T05:39:03.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db37fe640 1 -- 172.21.15.67:0/3772095928 learned_addr learned my addr 172.21.15.67:0/3772095928 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:03.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db2ffd640 1 --2- 172.21.15.67:0/3772095928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415c030 0x7f8db406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8daa7fc640 1 --2- 172.21.15.67:0/3772095928 >> v2:172.21.15.97:3300/0 conn(0x7f8db415d1d0 0x7f8db40b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db37fe640 1 -- 172.21.15.67:0/3772095928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415c030 msgr2=0x7f8db406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:03.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db37fe640 1 --2- 172.21.15.67:0/3772095928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415c030 0x7f8db406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db37fe640 1 -- 172.21.15.67:0/3772095928 >> v2:172.21.15.97:3300/0 conn(0x7f8db415d1d0 msgr2=0x7f8db40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db37fe640 1 --2- 172.21.15.67:0/3772095928 >> v2:172.21.15.97:3300/0 conn(0x7f8db415d1d0 0x7f8db40b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db37fe640 1 -- 172.21.15.67:0/3772095928 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db406ec60 con 0x7f8db40b3510 2024-09-19T05:39:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db2ffd640 1 --2- 172.21.15.67:0/3772095928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415c030 0x7f8db406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db37fe640 1 --2- 172.21.15.67:0/3772095928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db40b3510 0x7f8db406f460 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f8db406da30 tx=0x7f8dac01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ceec81e4d6f3cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:03.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.580+0000 7f8db27fc640 1 -- 172.21.15.67:0/3772095928 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0a5750 con 0x7f8db40b3510 2024-09-19T05:39:03.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db27fc640 1 -- 172.21.15.67:0/3772095928 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac0a58f0 con 0x7f8db40b3510 2024-09-19T05:39:03.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db27fc640 1 -- 172.21.15.67:0/3772095928 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0a5cc0 con 0x7f8db40b3510 2024-09-19T05:39:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 -- 172.21.15.67:0/3772095928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db40b3510 msgr2=0x7f8db406f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 --2- 172.21.15.67:0/3772095928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db40b3510 0x7f8db406f460 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f8db406da30 tx=0x7f8dac01c9c0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 -- 172.21.15.67:0/3772095928 shutdown_connections 2024-09-19T05:39:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 --2- 172.21.15.67:0/3772095928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db40b3510 0x7f8db406f460 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 --2- 172.21.15.67:0/3772095928 >> v2:172.21.15.97:3300/0 conn(0x7f8db415d1d0 0x7f8db40b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 --2- 172.21.15.67:0/3772095928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415c030 0x7f8db406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 -- 172.21.15.67:0/3772095928 >> 172.21.15.67:0/3772095928 conn(0x7f8db40d0080 msgr2=0x7f8db40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 -- 172.21.15.67:0/3772095928 shutdown_connections 2024-09-19T05:39:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 -- 172.21.15.67:0/3772095928 wait complete. 2024-09-19T05:39:03.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 Processor -- start 2024-09-19T05:39:03.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 -- start start 2024-09-19T05:39:03.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8db40b3510 0x7f8db41475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415c030 0x7f8db414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415d1d0 0x7f8db4146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8db415fec0 con 0x7f8db415c030 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8db415fd40 con 0x7f8db40b3510 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db92f4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8db4160040 con 0x7f8db415d1d0 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8daa7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415c030 0x7f8db414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8daa7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415c030 0x7f8db414bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51884/0 (socket says 172.21.15.67:51884) 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8daa7fc640 1 -- 172.21.15.67:0/3635545995 learned_addr learned my addr 172.21.15.67:0/3635545995 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db2ffd640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8db40b3510 0x7f8db41475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8db37fe640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415d1d0 0x7f8db4146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8daa7fc640 1 -- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415d1d0 msgr2=0x7f8db4146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8daa7fc640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415d1d0 0x7f8db4146ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8daa7fc640 1 -- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8db40b3510 msgr2=0x7f8db41475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8daa7fc640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8db40b3510 0x7f8db41475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.584+0000 7f8daa7fc640 1 -- 172.21.15.67:0/3635545995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db4147bb0 con 0x7f8db415c030 2024-09-19T05:39:03.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8daa7fc640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415c030 0x7f8db414bad0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00c7f0 tx=0x7f8d9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:03.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8dabfff640 1 -- 172.21.15.67:0/3635545995 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c004230 con 0x7f8db415c030 2024-09-19T05:39:03.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8dabfff640 1 -- 172.21.15.67:0/3635545995 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9c0043d0 con 0x7f8db415c030 2024-09-19T05:39:03.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8db92f4640 1 -- 172.21.15.67:0/3635545995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db4147e90 con 0x7f8db415c030 2024-09-19T05:39:03.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8dabfff640 1 -- 172.21.15.67:0/3635545995 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c003860 con 0x7f8db415c030 2024-09-19T05:39:03.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8db92f4640 1 -- 172.21.15.67:0/3635545995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db4148450 con 0x7f8db415c030 2024-09-19T05:39:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8db92f4640 1 -- 172.21.15.67:0/3635545995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db406dde0 con 0x7f8db415c030 2024-09-19T05:39:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8dabfff640 1 -- 172.21.15.67:0/3635545995 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8d9c003c10 con 0x7f8db415c030 2024-09-19T05:39:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8dabfff640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8d940678c0 0x7f8d94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8dabfff640 1 -- 172.21.15.67:0/3635545995 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5249+0+0 (secure 0 0 0) 0x7f8d9c085c70 con 0x7f8db415c030 2024-09-19T05:39:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8db2ffd640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8d940678c0 0x7f8d94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.588+0000 7f8db2ffd640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8d940678c0 0x7f8d94069d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8da400a9a0 tx=0x7f8da4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:03.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.592+0000 7f8dabfff640 1 -- 172.21.15.67:0/3635545995 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8d9c015020 con 0x7f8db415c030 2024-09-19T05:39:03.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.816+0000 7f8db92f4640 1 -- 172.21.15.67:0/3635545995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8db40d0f20 con 0x7f8db415c030 2024-09-19T05:39:03.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8dabfff640 1 -- 172.21.15.67:0/3635545995 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f8d9c056970 con 0x7f8db415c030 2024-09-19T05:39:03.822 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:03.822 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.823 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:03.824 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.825 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:39:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.827 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:39:03.828 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.829 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:39:03.830 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.831 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:39:03.832 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:39:03.833 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.834 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:03.835 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:39:03.836 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:39:03.836 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:03.836 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.836 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:03.836 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:39:03.836 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:39:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 -- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8d940678c0 msgr2=0x7f8d94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8d940678c0 0x7f8d94069d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8da400a9a0 tx=0x7f8da4008040 comp rx=0 tx=0).stop 2024-09-19T05:39:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 -- 172.21.15.67:0/3635545995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415c030 msgr2=0x7f8db414bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415c030 0x7f8db414bad0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00c7f0 tx=0x7f8d9c00ccb0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 -- 172.21.15.67:0/3635545995 shutdown_connections 2024-09-19T05:39:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8d940678c0 0x7f8d94069d80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8db415d1d0 0x7f8db4146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8db415c030 0x7f8db414bad0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 --2- 172.21.15.67:0/3635545995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8db40b3510 0x7f8db41475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 -- 172.21.15.67:0/3635545995 >> 172.21.15.67:0/3635545995 conn(0x7f8db40d0080 msgr2=0x7f8db415d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 -- 172.21.15.67:0/3635545995 shutdown_connections 2024-09-19T05:39:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.820+0000 7f8db92f4640 1 -- 172.21.15.67:0/3635545995 wait complete. 2024-09-19T05:39:03.843 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:39:03.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f7a6f640 1 Processor -- start 2024-09-19T05:39:03.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f7a6f640 1 -- start start 2024-09-19T05:39:03.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f7a6f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f0161da0 0x7f52f00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f7a6f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f52f00d0e80 0x7f52f00d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f7a6f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f00d4d40 con 0x7f52f00b41c0 2024-09-19T05:39:03.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f7a6f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f52f00d0840 con 0x7f52f00d0e80 2024-09-19T05:39:03.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f7a6f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f52f00d1800 con 0x7f52f0161da0 2024-09-19T05:39:03.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f600c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f52f00b41c0 0x7f52f00b4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36206/0 (socket says 172.21.15.67:36206) 2024-09-19T05:39:03.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f600c640 1 -- 172.21.15.67:0/1773591121 learned_addr learned my addr 172.21.15.67:0/1773591121 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:03.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f500a640 1 --2- 172.21.15.67:0/1773591121 >> v2:172.21.15.97:3300/0 conn(0x7f52f00d0e80 0x7f52f00d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f580b640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f0161da0 0x7f52f00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809055258 0 0) 0x7f52f00d4d40 con 0x7f52f00b41c0 2024-09-19T05:39:03.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52dc003530 con 0x7f52f00b41c0 2024-09-19T05:39:03.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1370485647 0 0) 0x7f52dc003530 con 0x7f52f00b41c0 2024-09-19T05:39:03.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f0161da0 msgr2=0x7f52f00d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:03.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f0161da0 0x7f52f00d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 >> v2:172.21.15.97:3300/0 conn(0x7f52f00d0e80 msgr2=0x7f52f00d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:03.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 --2- 172.21.15.67:0/1773591121 >> v2:172.21.15.97:3300/0 conn(0x7f52f00d0e80 0x7f52f00d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f00d5020 con 0x7f52f00b41c0 2024-09-19T05:39:03.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f52e8001a00 con 0x7f52f00b41c0 2024-09-19T05:39:03.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 >> v1:172.21.15.67:6789/0 conn(0x7f52f00b41c0 legacy=0x7f52f00b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 0x7f52dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f0161da0 0x7f52dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52dc004d50 0x7f52dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00d0840 con 0x7f52dc0039c0 2024-09-19T05:39:03.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00d1800 con 0x7f52dc004d50 2024-09-19T05:39:03.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f52dc00b9d0 con 0x7f52f0161da0 2024-09-19T05:39:03.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f580b640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 0x7f52dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f600c640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52dc004d50 0x7f52dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f500a640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f0161da0 0x7f52dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f580b640 1 -- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f0161da0 msgr2=0x7f52dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:03.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f580b640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f0161da0 0x7f52dc004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f580b640 1 -- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52dc004d50 msgr2=0x7f52dc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:03.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f580b640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52dc004d50 0x7f52dc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.964+0000 7f52f580b640 1 -- 172.21.15.67:0/1773591121 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52dc003530 con 0x7f52dc0039c0 2024-09-19T05:39:03.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f580b640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 0x7f52dc003de0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009ae0 tx=0x7f52ec01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5887f518a9ba05a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:03.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0096b0 con 0x7f52dc0039c0 2024-09-19T05:39:03.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ec0a6450 con 0x7f52dc0039c0 2024-09-19T05:39:03.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f4809640 1 -- 172.21.15.67:0/1773591121 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0a6840 con 0x7f52dc0039c0 2024-09-19T05:39:03.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f7a6f640 1 -- 172.21.15.67:0/1773591121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 msgr2=0x7f52dc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f7a6f640 1 --2- 172.21.15.67:0/1773591121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 0x7f52dc003de0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009ae0 tx=0x7f52ec01ca70 comp rx=0 tx=0).stop 2024-09-19T05:39:03.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f600c640 1 -- 172.21.15.67:0/1773591121 reap_dead start 2024-09-19T05:39:03.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f7a6f640 1 -- 172.21.15.67:0/1773591121 shutdown_connections 2024-09-19T05:39:03.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f7a6f640 1 -- 172.21.15.67:0/1773591121 >> 172.21.15.67:0/1773591121 conn(0x7f52f008bfc0 msgr2=0x7f52f00d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:03.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f7a6f640 1 -- 172.21.15.67:0/1773591121 shutdown_connections 2024-09-19T05:39:03.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f7a6f640 1 -- 172.21.15.67:0/1773591121 wait complete. 2024-09-19T05:39:03.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f7a6f640 1 Processor -- start 2024-09-19T05:39:03.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.968+0000 7f52f7a6f640 1 -- start start 2024-09-19T05:39:03.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f7a6f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 0x7f52f00b8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f7a6f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f00b98c0 0x7f52f0162560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f7a6f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52f0167a20 0x7f52f0167ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f7a6f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f52f0162180 con 0x7f52dc0039c0 2024-09-19T05:39:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f7a6f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00b5d00 con 0x7f52f0167a20 2024-09-19T05:39:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f7a6f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f52f01694e0 con 0x7f52f00b98c0 2024-09-19T05:39:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f580b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 0x7f52f00b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f580b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 0x7f52f00b8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51894/0 (socket says 172.21.15.67:51894) 2024-09-19T05:39:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f580b640 1 -- 172.21.15.67:0/3516115618 learned_addr learned my addr 172.21.15.67:0/3516115618 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:03.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f500a640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f00b98c0 0x7f52f0162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f600c640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52f0167a20 0x7f52f0167ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f580b640 1 -- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f00b98c0 msgr2=0x7f52f0162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f580b640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f00b98c0 0x7f52f0162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f580b640 1 -- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52f0167a20 msgr2=0x7f52f0167ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:03.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f580b640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52f0167a20 0x7f52f0167ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f580b640 1 -- 172.21.15.67:0/3516115618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f00ba110 con 0x7f52dc0039c0 2024-09-19T05:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f580b640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 0x7f52f00b8910 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009ae0 tx=0x7f52dc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52e67fc640 1 -- 172.21.15.67:0/3516115618 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0c0070 con 0x7f52dc0039c0 2024-09-19T05:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52e67fc640 1 -- 172.21.15.67:0/3516115618 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ec00f000 con 0x7f52dc0039c0 2024-09-19T05:39:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f7a6f640 1 -- 172.21.15.67:0/3516115618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f0165560 con 0x7f52dc0039c0 2024-09-19T05:39:03.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52e67fc640 1 -- 172.21.15.67:0/3516115618 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0a6e20 con 0x7f52dc0039c0 2024-09-19T05:39:03.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f7a6f640 1 -- 172.21.15.67:0/3516115618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f0165b20 con 0x7f52dc0039c0 2024-09-19T05:39:03.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52f7a6f640 1 -- 172.21.15.67:0/3516115618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f00d12c0 con 0x7f52dc0039c0 2024-09-19T05:39:03.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52e67fc640 1 -- 172.21.15.67:0/3516115618 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f52ec0c3070 con 0x7f52dc0039c0 2024-09-19T05:39:03.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52e67fc640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52d40678f0 0x7f52d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:03.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.972+0000 7f52e67fc640 1 -- 172.21.15.67:0/3516115618 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5249+0+0 (secure 0 0 0) 0x7f52ec11f770 con 0x7f52dc0039c0 2024-09-19T05:39:03.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.976+0000 7f52f500a640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52d40678f0 0x7f52d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.976+0000 7f52f500a640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52d40678f0 0x7f52d4069db0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f52f00ce240 tx=0x7f52e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:03.980+0000 7f52e67fc640 1 -- 172.21.15.67:0/3516115618 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f52ec0ac020 con 0x7f52dc0039c0 2024-09-19T05:39:04.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.140+0000 7f52f7a6f640 1 -- 172.21.15.67:0/3516115618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f52f0168860 con 0x7f52dc0039c0 2024-09-19T05:39:04.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52e67fc640 1 -- 172.21.15.67:0/3516115618 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v96) ==== 84+0+65 (secure 0 0 0) 0x7f52ec016780 con 0x7f52dc0039c0 2024-09-19T05:39:04.146 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:04.146 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:39:04.146 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:04.146 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:39:04.146 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:39:04.146 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:04.146 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 -- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52d40678f0 msgr2=0x7f52d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52d40678f0 0x7f52d4069db0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f52f00ce240 tx=0x7f52e0008040 comp rx=0 tx=0).stop 2024-09-19T05:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 -- 172.21.15.67:0/3516115618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 msgr2=0x7f52f00b8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 0x7f52f00b8910 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009ae0 tx=0x7f52dc005840 comp rx=0 tx=0).stop 2024-09-19T05:39:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 -- 172.21.15.67:0/3516115618 shutdown_connections 2024-09-19T05:39:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52f0167a20 0x7f52f0167ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52d40678f0 0x7f52d4069db0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52f00b98c0 0x7f52f0162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 --2- 172.21.15.67:0/3516115618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52dc0039c0 0x7f52f00b8910 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 -- 172.21.15.67:0/3516115618 >> 172.21.15.67:0/3516115618 conn(0x7f52f008bfc0 msgr2=0x7f52f00d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 -- 172.21.15.67:0/3516115618 shutdown_connections 2024-09-19T05:39:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.144+0000 7f52f7a6f640 1 -- 172.21.15.67:0/3516115618 wait complete. 2024-09-19T05:39:04.164 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:39:04.165 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:39:04.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5beca3c640 1 Processor -- start 2024-09-19T05:39:04.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5beca3c640 1 -- start start 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5beca3c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80d0520 0x7f5be80d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5beca3c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5be80addf0 0x7f5be80ae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5beca3c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be80b4e00 con 0x7f5be80738b0 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5beca3c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5be80d0ed0 con 0x7f5be80addf0 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5beca3c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5be80b3500 con 0x7f5be80d0520 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5be6d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5be80addf0 0x7f5be80ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5be659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5be80738b0 0x7f5be815c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36216/0 (socket says 172.21.15.67:36216) 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5be659c640 1 -- 172.21.15.67:0/2905506583 learned_addr learned my addr 172.21.15.67:0/2905506583 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5be5d9b640 1 --2- 172.21.15.67:0/2905506583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80d0520 0x7f5be80d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5be6d9d640 1 -- 172.21.15.67:0/2905506583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80d0520 msgr2=0x7f5be80d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5be6d9d640 1 --2- 172.21.15.67:0/2905506583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80d0520 0x7f5be80d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5be6d9d640 1 -- 172.21.15.67:0/2905506583 >> v1:172.21.15.67:6789/0 conn(0x7f5be80738b0 legacy=0x7f5be815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:04.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5be559a640 1 -- 172.21.15.67:0/2905506583 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206002119 0 0) 0x7f5be80b4e00 con 0x7f5be80738b0 2024-09-19T05:39:04.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.292+0000 7f5be6d9d640 1 -- 172.21.15.67:0/2905506583 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be80b37e0 con 0x7f5be80addf0 2024-09-19T05:39:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5be6d9d640 1 --2- 172.21.15.67:0/2905506583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80addf0 0x7f5be80ae280 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5be00097c0 tx=0x7f5be001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e31d50a9a9b741 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5be559a640 1 -- 172.21.15.67:0/2905506583 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be00b0070 con 0x7f5be80addf0 2024-09-19T05:39:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5be559a640 1 -- 172.21.15.67:0/2905506583 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be00ab600 con 0x7f5be80addf0 2024-09-19T05:39:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5be559a640 1 -- 172.21.15.67:0/2905506583 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be00ab9d0 con 0x7f5be80addf0 2024-09-19T05:39:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5beca3c640 1 -- 172.21.15.67:0/2905506583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80addf0 msgr2=0x7f5be80ae280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5beca3c640 1 --2- 172.21.15.67:0/2905506583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80addf0 0x7f5be80ae280 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5be00097c0 tx=0x7f5be001c4a0 comp rx=0 tx=0).stop 2024-09-19T05:39:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5beca3c640 1 -- 172.21.15.67:0/2905506583 shutdown_connections 2024-09-19T05:39:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5beca3c640 1 --2- 172.21.15.67:0/2905506583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80addf0 0x7f5be80ae280 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5beca3c640 1 --2- 172.21.15.67:0/2905506583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80d0520 0x7f5be80d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5beca3c640 1 -- 172.21.15.67:0/2905506583 >> 172.21.15.67:0/2905506583 conn(0x7f5be806c0c0 msgr2=0x7f5be806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5beca3c640 1 -- 172.21.15.67:0/2905506583 shutdown_connections 2024-09-19T05:39:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.296+0000 7f5beca3c640 1 -- 172.21.15.67:0/2905506583 wait complete. 2024-09-19T05:39:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 Processor -- start 2024-09-19T05:39:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 -- start start 2024-09-19T05:39:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80738b0 0x7f5be814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80addf0 0x7f5be814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80d0520 0x7f5be80cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5be80b30b0 con 0x7f5be80d0520 2024-09-19T05:39:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5be8073c90 con 0x7f5be80addf0 2024-09-19T05:39:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5be80b3230 con 0x7f5be80738b0 2024-09-19T05:39:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80d0520 0x7f5be80cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80d0520 0x7f5be80cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51914/0 (socket says 172.21.15.67:51914) 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be6d9d640 1 -- 172.21.15.67:0/593337727 learned_addr learned my addr 172.21.15.67:0/593337727 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be659c640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80738b0 0x7f5be814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be5d9b640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80addf0 0x7f5be814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be6d9d640 1 -- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80738b0 msgr2=0x7f5be814e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be6d9d640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80738b0 0x7f5be814e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be6d9d640 1 -- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80addf0 msgr2=0x7f5be814fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be6d9d640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80addf0 0x7f5be814fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be6d9d640 1 -- 172.21.15.67:0/593337727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be8150c20 con 0x7f5be80d0520 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be659c640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80738b0 0x7f5be814e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5be6d9d640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80d0520 0x7f5be80cc750 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f5be00097c0 tx=0x7f5be001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5bdeffd640 1 -- 172.21.15.67:0/593337727 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be00bc070 con 0x7f5be80d0520 2024-09-19T05:39:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5bdeffd640 1 -- 172.21.15.67:0/593337727 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be00b1040 con 0x7f5be80d0520 2024-09-19T05:39:04.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 -- 172.21.15.67:0/593337727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be8150660 con 0x7f5be80d0520 2024-09-19T05:39:04.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5bdeffd640 1 -- 172.21.15.67:0/593337727 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be00b0050 con 0x7f5be80d0520 2024-09-19T05:39:04.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 -- 172.21.15.67:0/593337727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be8156570 con 0x7f5be80d0520 2024-09-19T05:39:04.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5beca3c640 1 -- 172.21.15.67:0/593337727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be80ae280 con 0x7f5be80d0520 2024-09-19T05:39:04.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5bdeffd640 1 -- 172.21.15.67:0/593337727 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5be00bf070 con 0x7f5be80d0520 2024-09-19T05:39:04.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.300+0000 7f5bdeffd640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bc80678c0 0x7f5bc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:04.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.308+0000 7f5bdeffd640 1 -- 172.21.15.67:0/593337727 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5249+0+0 (secure 0 0 0) 0x7f5be011f5e0 con 0x7f5be80d0520 2024-09-19T05:39:04.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.308+0000 7f5be659c640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bc80678c0 0x7f5bc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:04.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.308+0000 7f5be659c640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bc80678c0 0x7f5bc8069d80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8000f70 tx=0x7f5bd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:04.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.308+0000 7f5bdeffd640 1 -- 172.21.15.67:0/593337727 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5be0016090 con 0x7f5be80d0520 2024-09-19T05:39:04.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:04.472+0000 7f5beca3c640 1 -- 172.21.15.67:0/593337727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5be806c820 con 0x7f5be80d0520 2024-09-19T05:39:05.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.436+0000 7f5bdeffd640 1 -- 172.21.15.67:0/593337727 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v97) ==== 138+0+0 (secure 0 0 0) 0x7f5be00f6070 con 0x7f5be80d0520 2024-09-19T05:39:05.437 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:39:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 -- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bc80678c0 msgr2=0x7f5bc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bc80678c0 0x7f5bc8069d80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8000f70 tx=0x7f5bd8009040 comp rx=0 tx=0).stop 2024-09-19T05:39:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 -- 172.21.15.67:0/593337727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80d0520 msgr2=0x7f5be80cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80d0520 0x7f5be80cc750 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f5be00097c0 tx=0x7f5be001ace0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 -- 172.21.15.67:0/593337727 shutdown_connections 2024-09-19T05:39:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5be80d0520 0x7f5be80cc750 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80addf0 0x7f5be814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5bc80678c0 0x7f5bc8069d80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 --2- 172.21.15.67:0/593337727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5be80738b0 0x7f5be814e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 -- 172.21.15.67:0/593337727 >> 172.21.15.67:0/593337727 conn(0x7f5be806c0c0 msgr2=0x7f5be815e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 -- 172.21.15.67:0/593337727 shutdown_connections 2024-09-19T05:39:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.440+0000 7f5beca3c640 1 -- 172.21.15.67:0/593337727 wait complete. 2024-09-19T05:39:05.467 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:39:05.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.604+0000 7fd6d4270640 1 Processor -- start 2024-09-19T05:39:05.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.604+0000 7fd6d4270640 1 -- start start 2024-09-19T05:39:05.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.604+0000 7fd6d4270640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6cc15b1d0 0x7fd6cc0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:05.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.604+0000 7fd6d4270640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6cc0aef30 con 0x7fd6cc070070 2024-09-19T05:39:05.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.604+0000 7fd6d4270640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6cc0ae0f0 con 0x7fd6cc06dfc0 2024-09-19T05:39:05.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.604+0000 7fd6d4270640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd6cc072210 con 0x7fd6cc15b1d0 2024-09-19T05:39:05.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.604+0000 7fd6d280d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd6cc070070 0x7fd6cc0b3430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36232/0 (socket says 172.21.15.67:36232) 2024-09-19T05:39:05.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.604+0000 7fd6d280d640 1 -- 172.21.15.67:0/3530169272 learned_addr learned my addr 172.21.15.67:0/3530169272 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698700921 0 0) 0x7fd6cc0aef30 con 0x7fd6cc070070 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6b4005740 con 0x7fd6cc070070 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d200c640 1 --2- 172.21.15.67:0/3530169272 >> v2:172.21.15.97:3300/0 conn(0x7fd6cc15b1d0 0x7fd6cc0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4275027496 0 0) 0x7fd6b4005740 con 0x7fd6cc070070 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 >> v2:172.21.15.97:3300/0 conn(0x7fd6cc15b1d0 msgr2=0x7fd6cc0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 --2- 172.21.15.67:0/3530169272 >> v2:172.21.15.97:3300/0 conn(0x7fd6cc15b1d0 0x7fd6cc0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 >> v1:172.21.15.97:6789/0 conn(0x7fd6cc06dfc0 legacy=0x7fd6cc06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc0ae3b0 con 0x7fd6cc070070 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fd6bc001680 con 0x7fd6cc070070 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 >> v1:172.21.15.67:6789/0 conn(0x7fd6cc070070 legacy=0x7fd6cc0b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6b4005bd0 0x7fd6b4005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6b4006a20 0x7fd6b4006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6b40073e0 0x7fd6b400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc072210 con 0x7fd6b4006a20 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b400e330 con 0x7fd6b40073e0 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b400e530 con 0x7fd6b4005bd0 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d180b640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6b4006a20 0x7fd6b4006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d200c640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6b4005bd0 0x7fd6b4005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d280d640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6b40073e0 0x7fd6b400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d180b640 1 -- 172.21.15.67:0/3530169272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6b4005bd0 msgr2=0x7fd6b4005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d180b640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6b4005bd0 0x7fd6b4005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d180b640 1 -- 172.21.15.67:0/3530169272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6b40073e0 msgr2=0x7fd6b400dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d180b640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6b40073e0 0x7fd6b400dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d280d640 1 -- 172.21.15.67:0/3530169272 reap_dead start 2024-09-19T05:39:05.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d180b640 1 -- 172.21.15.67:0/3530169272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b4005740 con 0x7fd6b4006a20 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d180b640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6b4006a20 0x7fd6b4006ea0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0001e70 tx=0x7fd6c001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47269fab54dff802 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0001a90 con 0x7fd6b4006a20 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c0003b80 con 0x7fd6b4006a20 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d100a640 1 -- 172.21.15.67:0/3530169272 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0005080 con 0x7fd6b4006a20 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d4270640 1 -- 172.21.15.67:0/3530169272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6b4006a20 msgr2=0x7fd6b4006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d4270640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6b4006a20 0x7fd6b4006ea0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0001e70 tx=0x7fd6c001c760 comp rx=0 tx=0).stop 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d4270640 1 -- 172.21.15.67:0/3530169272 shutdown_connections 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d4270640 1 --2- 172.21.15.67:0/3530169272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6b4006a20 0x7fd6b4006ea0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d4270640 1 -- 172.21.15.67:0/3530169272 >> 172.21.15.67:0/3530169272 conn(0x7fd6cc0b1e50 msgr2=0x7fd6cc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d4270640 1 -- 172.21.15.67:0/3530169272 shutdown_connections 2024-09-19T05:39:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.608+0000 7fd6d4270640 1 -- 172.21.15.67:0/3530169272 wait complete. 2024-09-19T05:39:05.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 Processor -- start 2024-09-19T05:39:05.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 -- start start 2024-09-19T05:39:05.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6b4006a20 0x7fd6cc14aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:05.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc15a150 0x7fd6cc152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6cc072d50 0x7fd6cc0731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc0aec50 con 0x7fd6cc15a150 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc0ae970 con 0x7fd6cc072d50 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd6cc072420 con 0x7fd6b4006a20 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d180b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc15a150 0x7fd6cc152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d180b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc15a150 0x7fd6cc152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51926/0 (socket says 172.21.15.67:51926) 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d180b640 1 -- 172.21.15.67:0/1896933799 learned_addr learned my addr 172.21.15.67:0/1896933799 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d280d640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6cc072d50 0x7fd6cc0731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d200c640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6b4006a20 0x7fd6cc14aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d180b640 1 -- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6b4006a20 msgr2=0x7fd6cc14aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d180b640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6b4006a20 0x7fd6cc14aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d180b640 1 -- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6cc072d50 msgr2=0x7fd6cc0731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d180b640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6cc072d50 0x7fd6cc0731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d180b640 1 -- 172.21.15.67:0/1896933799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc14e3c0 con 0x7fd6cc15a150 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d200c640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6b4006a20 0x7fd6cc14aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d280d640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6cc072d50 0x7fd6cc0731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d180b640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc15a150 0x7fd6cc152120 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0000f90 tx=0x7fd6b4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6caffd640 1 -- 172.21.15.67:0/1896933799 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c00b5070 con 0x7fd6cc15a150 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6caffd640 1 -- 172.21.15.67:0/1896933799 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c0006b60 con 0x7fd6cc15a150 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6caffd640 1 -- 172.21.15.67:0/1896933799 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0007dc0 con 0x7fd6cc15a150 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 -- 172.21.15.67:0/1896933799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6cc14d600 con 0x7fd6cc15a150 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 -- 172.21.15.67:0/1896933799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6cc14dbc0 con 0x7fd6cc15a150 2024-09-19T05:39:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.612+0000 7fd6d4270640 1 -- 172.21.15.67:0/1896933799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6cc068530 con 0x7fd6cc15a150 2024-09-19T05:39:05.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.616+0000 7fd6caffd640 1 -- 172.21.15.67:0/1896933799 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6c0007030 con 0x7fd6cc15a150 2024-09-19T05:39:05.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.616+0000 7fd6caffd640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6b80678f0 0x7fd6b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:05.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.616+0000 7fd6caffd640 1 -- 172.21.15.67:0/1896933799 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5619+0+0 (secure 0 0 0) 0x7fd6c0120770 con 0x7fd6cc15a150 2024-09-19T05:39:05.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.616+0000 7fd6d200c640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6b80678f0 0x7fd6b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:05.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.616+0000 7fd6d200c640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6b80678f0 0x7fd6b8069db0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400baf0 tx=0x7fd6c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:05.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.620+0000 7fd6caffd640 1 -- 172.21.15.67:0/1896933799 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd6c00ad020 con 0x7fd6cc15a150 2024-09-19T05:39:05.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:05.784+0000 7fd6d4270640 1 -- 172.21.15.67:0/1896933799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd6cc0aded0 con 0x7fd6cc15a150 2024-09-19T05:39:06.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6caffd640 1 -- 172.21.15.67:0/1896933799 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v98) ==== 170+0+0 (secure 0 0 0) 0x7fd6c0016470 con 0x7fd6cc15a150 2024-09-19T05:39:06.442 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:39:06.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 -- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6b80678f0 msgr2=0x7fd6b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:06.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6b80678f0 0x7fd6b8069db0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400baf0 tx=0x7fd6c4008040 comp rx=0 tx=0).stop 2024-09-19T05:39:06.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 -- 172.21.15.67:0/1896933799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc15a150 msgr2=0x7fd6cc152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:06.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc15a150 0x7fd6cc152120 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0000f90 tx=0x7fd6b4007a50 comp rx=0 tx=0).stop 2024-09-19T05:39:06.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 -- 172.21.15.67:0/1896933799 shutdown_connections 2024-09-19T05:39:06.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6cc072d50 0x7fd6cc0731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:06.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc15a150 0x7fd6cc152120 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:06.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd6b80678f0 0x7fd6b8069db0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:06.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 --2- 172.21.15.67:0/1896933799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6b4006a20 0x7fd6cc14aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:06.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 -- 172.21.15.67:0/1896933799 >> 172.21.15.67:0/1896933799 conn(0x7fd6cc0b1e50 msgr2=0x7fd6cc0b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:06.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.444+0000 7fd6d4270640 1 -- 172.21.15.67:0/1896933799 shutdown_connections 2024-09-19T05:39:06.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.448+0000 7fd6d4270640 1 -- 172.21.15.67:0/1896933799 wait complete. 2024-09-19T05:39:06.478 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:39:06.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71f2d5640 1 Processor -- start 2024-09-19T05:39:06.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71f2d5640 1 -- start start 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71f2d5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc71815c6d0 0x7fc71806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71f2d5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc71806d850 0x7fc7180b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71f2d5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7180b1130 con 0x7fc7180b2860 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71f2d5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc71806cc10 con 0x7fc71806d850 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71f2d5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc7180b1410 con 0x7fc71815c6d0 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71c870640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc71806d850 0x7fc7180b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71d872640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc7180b2860 0x7fc7180d13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46746/0 (socket says 172.21.15.67:46746) 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71d872640 1 -- 172.21.15.67:0/3203286880 learned_addr learned my addr 172.21.15.67:0/3203286880 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71d071640 1 --2- 172.21.15.67:0/3203286880 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc71815c6d0 0x7fc71806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71c870640 1 -- 172.21.15.67:0/3203286880 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc71815c6d0 msgr2=0x7fc71806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71c870640 1 --2- 172.21.15.67:0/3203286880 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc71815c6d0 0x7fc71806c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71c870640 1 -- 172.21.15.67:0/3203286880 >> v1:172.21.15.67:6789/0 conn(0x7fc7180b2860 legacy=0x7fc7180d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:06.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc71c870640 1 -- 172.21.15.67:0/3203286880 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7180b16f0 con 0x7fc71806d850 2024-09-19T05:39:06.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.612+0000 7fc70ffff640 1 -- 172.21.15.67:0/3203286880 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024866188 0 0) 0x7fc7180b1130 con 0x7fc7180b2860 2024-09-19T05:39:06.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71c870640 1 --2- 172.21.15.67:0/3203286880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 0x7fc7180b2320 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097c0 tx=0x7fc70801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b853bf1c23039e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:06.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc70ffff640 1 -- 172.21.15.67:0/3203286880 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080b0070 con 0x7fc71806d850 2024-09-19T05:39:06.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc70ffff640 1 -- 172.21.15.67:0/3203286880 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7080ab600 con 0x7fc71806d850 2024-09-19T05:39:06.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc70ffff640 1 -- 172.21.15.67:0/3203286880 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080ab9d0 con 0x7fc71806d850 2024-09-19T05:39:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 -- 172.21.15.67:0/3203286880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 msgr2=0x7fc7180b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 --2- 172.21.15.67:0/3203286880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 0x7fc7180b2320 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097c0 tx=0x7fc70801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:39:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 -- 172.21.15.67:0/3203286880 shutdown_connections 2024-09-19T05:39:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 --2- 172.21.15.67:0/3203286880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 0x7fc7180b2320 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 --2- 172.21.15.67:0/3203286880 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc71815c6d0 0x7fc71806c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 -- 172.21.15.67:0/3203286880 >> 172.21.15.67:0/3203286880 conn(0x7fc718073760 msgr2=0x7fc71809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 -- 172.21.15.67:0/3203286880 shutdown_connections 2024-09-19T05:39:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 -- 172.21.15.67:0/3203286880 wait complete. 2024-09-19T05:39:06.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 Processor -- start 2024-09-19T05:39:06.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 -- start start 2024-09-19T05:39:06.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 0x7fc71814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:06.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7180b2860 0x7fc7180cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:06.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc718159ef0 0x7fc7181541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:06.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc718169410 con 0x7fc71806d850 2024-09-19T05:39:06.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.616+0000 7fc71f2d5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc718169290 con 0x7fc718159ef0 2024-09-19T05:39:06.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71f2d5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc718169590 con 0x7fc7180b2860 2024-09-19T05:39:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d071640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 0x7fc71814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d071640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 0x7fc71814d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56486/0 (socket says 172.21.15.67:56486) 2024-09-19T05:39:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d071640 1 -- 172.21.15.67:0/1575961366 learned_addr learned my addr 172.21.15.67:0/1575961366 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71c870640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7180b2860 0x7fc7180cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d872640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc718159ef0 0x7fc7181541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d071640 1 -- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7180b2860 msgr2=0x7fc7180cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d071640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7180b2860 0x7fc7180cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d071640 1 -- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc718159ef0 msgr2=0x7fc7181541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d071640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc718159ef0 0x7fc7181541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d071640 1 -- 172.21.15.67:0/1575961366 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7180ce640 con 0x7fc71806d850 2024-09-19T05:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d872640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc718159ef0 0x7fc7181541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71d071640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 0x7fc71814d3b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc71400d830 tx=0x7fc71400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc70dffb640 1 -- 172.21.15.67:0/1575961366 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71400b6c0 con 0x7fc71806d850 2024-09-19T05:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc70dffb640 1 -- 172.21.15.67:0/1575961366 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714019070 con 0x7fc71806d850 2024-09-19T05:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc70dffb640 1 -- 172.21.15.67:0/1575961366 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71400ba60 con 0x7fc71806d850 2024-09-19T05:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71f2d5640 1 -- 172.21.15.67:0/1575961366 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7180ce920 con 0x7fc71806d850 2024-09-19T05:39:06.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71f2d5640 1 -- 172.21.15.67:0/1575961366 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7180ceee0 con 0x7fc71806d850 2024-09-19T05:39:06.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71f2d5640 1 -- 172.21.15.67:0/1575961366 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7180b2320 con 0x7fc71806d850 2024-09-19T05:39:06.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc70dffb640 1 -- 172.21.15.67:0/1575961366 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc71401e460 con 0x7fc71806d850 2024-09-19T05:39:06.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc70dffb640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6fc0678f0 0x7fc6fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:06.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc70dffb640 1 -- 172.21.15.67:0/1575961366 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6001+0+0 (secure 0 0 0) 0x7fc714086e60 con 0x7fc71806d850 2024-09-19T05:39:06.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.620+0000 7fc71c870640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6fc0678f0 0x7fc6fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:06.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.624+0000 7fc71c870640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6fc0678f0 0x7fc6fc069db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc7080ad000 tx=0x7fc708008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:06.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.624+0000 7fc70dffb640 1 -- 172.21.15.67:0/1575961366 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc7140b4090 con 0x7fc71806d850 2024-09-19T05:39:06.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:06.824+0000 7fc71f2d5640 1 -- 172.21.15.67:0/1575961366 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc718073e30 con 0x7fc71806d850 2024-09-19T05:39:07.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.504+0000 7fc70dffb640 1 -- 172.21.15.67:0/1575961366 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v63) ==== 174+0+0 (secure 0 0 0) 0x7fc714057950 con 0x7fc71806d850 2024-09-19T05:39:07.505 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 13 and data pool 14 2024-09-19T05:39:07.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 -- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6fc0678f0 msgr2=0x7fc6fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6fc0678f0 0x7fc6fc069db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc7080ad000 tx=0x7fc708008040 comp rx=0 tx=0).stop 2024-09-19T05:39:07.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 -- 172.21.15.67:0/1575961366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 msgr2=0x7fc71814d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 0x7fc71814d3b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc71400d830 tx=0x7fc71400dcf0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 -- 172.21.15.67:0/1575961366 shutdown_connections 2024-09-19T05:39:07.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc718159ef0 0x7fc7181541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6fc0678f0 0x7fc6fc069db0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7180b2860 0x7fc7180cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 --2- 172.21.15.67:0/1575961366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc71806d850 0x7fc71814d3b0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 -- 172.21.15.67:0/1575961366 >> 172.21.15.67:0/1575961366 conn(0x7fc718073760 msgr2=0x7fc71809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:07.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 -- 172.21.15.67:0/1575961366 shutdown_connections 2024-09-19T05:39:07.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.520+0000 7fc71f2d5640 1 -- 172.21.15.67:0/1575961366 wait complete. 2024-09-19T05:39:07.544 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:39:07.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f15255cf640 1 Processor -- start 2024-09-19T05:39:07.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f15255cf640 1 -- start start 2024-09-19T05:39:07.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f15255cf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015c030 0x7f152006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f15255cf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f152006f460 0x7f152006f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f15255cf640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f152006e3c0 con 0x7f152015d1d0 2024-09-19T05:39:07.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f15255cf640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f152006e6a0 con 0x7f152006f460 2024-09-19T05:39:07.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f15255cf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f152006e980 con 0x7f152015c030 2024-09-19T05:39:07.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f151f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f152006f460 0x7f152006f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f151f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f152006f460 0x7f152006f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56492/0 (socket says 172.21.15.67:56492) 2024-09-19T05:39:07.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f151f7fe640 1 -- 172.21.15.67:0/2540080402 learned_addr learned my addr 172.21.15.67:0/2540080402 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:07.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f151effd640 1 --2- 172.21.15.67:0/2540080402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015c030 0x7f152006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f151f7fe640 1 -- 172.21.15.67:0/2540080402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015c030 msgr2=0x7f152006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:07.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f151f7fe640 1 --2- 172.21.15.67:0/2540080402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015c030 0x7f152006dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f151f7fe640 1 -- 172.21.15.67:0/2540080402 >> v1:172.21.15.97:6789/0 conn(0x7f152015d1d0 legacy=0x7f15200b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:07.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.664+0000 7f151f7fe640 1 -- 172.21.15.67:0/2540080402 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152006ec60 con 0x7f152006f460 2024-09-19T05:39:07.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151f7fe640 1 --2- 172.21.15.67:0/2540080402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152006f460 0x7f152006f8d0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f1518009870 tx=0x7f151801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8925e04c083cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:07.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151dffb640 1 -- 172.21.15.67:0/2540080402 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15180aa430 con 0x7f152006f460 2024-09-19T05:39:07.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151dffb640 1 -- 172.21.15.67:0/2540080402 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15180af070 con 0x7f152006f460 2024-09-19T05:39:07.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151dffb640 1 -- 172.21.15.67:0/2540080402 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15180aa7f0 con 0x7f152006f460 2024-09-19T05:39:07.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 -- 172.21.15.67:0/2540080402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152006f460 msgr2=0x7f152006f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 --2- 172.21.15.67:0/2540080402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152006f460 0x7f152006f8d0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f1518009870 tx=0x7f151801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 -- 172.21.15.67:0/2540080402 shutdown_connections 2024-09-19T05:39:07.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 --2- 172.21.15.67:0/2540080402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152006f460 0x7f152006f8d0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 --2- 172.21.15.67:0/2540080402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015c030 0x7f152006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 -- 172.21.15.67:0/2540080402 >> 172.21.15.67:0/2540080402 conn(0x7f15200d0080 msgr2=0x7f15200d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:07.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 -- 172.21.15.67:0/2540080402 shutdown_connections 2024-09-19T05:39:07.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 -- 172.21.15.67:0/2540080402 wait complete. 2024-09-19T05:39:07.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 Processor -- start 2024-09-19T05:39:07.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 -- start start 2024-09-19T05:39:07.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152006f460 0x7f1520072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152015c030 0x7f1520146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015d1d0 0x7f1520157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f152015c590 con 0x7f152015c030 2024-09-19T05:39:07.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f152015c410 con 0x7f152006f460 2024-09-19T05:39:07.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15255cf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f15201690e0 con 0x7f152015d1d0 2024-09-19T05:39:07.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152015c030 0x7f1520146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152015c030 0x7f1520146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56502/0 (socket says 172.21.15.67:56502) 2024-09-19T05:39:07.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151e7fc640 1 -- 172.21.15.67:0/521497043 learned_addr learned my addr 172.21.15.67:0/521497043 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:07.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151effd640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152006f460 0x7f1520072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151f7fe640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015d1d0 0x7f1520157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151e7fc640 1 -- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015d1d0 msgr2=0x7f1520157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151e7fc640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015d1d0 0x7f1520157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151e7fc640 1 -- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152006f460 msgr2=0x7f1520072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151e7fc640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152006f460 0x7f1520072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151e7fc640 1 -- 172.21.15.67:0/521497043 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15201596d0 con 0x7f152015c030 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151f7fe640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015d1d0 0x7f1520157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f151e7fc640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152015c030 0x7f1520146240 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f151400b9c0 tx=0x7f151400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.668+0000 7f15077fe640 1 -- 172.21.15.67:0/521497043 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151400cba0 con 0x7f152015c030 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.672+0000 7f15077fe640 1 -- 172.21.15.67:0/521497043 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f151400cd40 con 0x7f152015c030 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.672+0000 7f15255cf640 1 -- 172.21.15.67:0/521497043 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1520072e70 con 0x7f152015c030 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.672+0000 7f15077fe640 1 -- 172.21.15.67:0/521497043 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514003bc0 con 0x7f152015c030 2024-09-19T05:39:07.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.672+0000 7f15255cf640 1 -- 172.21.15.67:0/521497043 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1520073430 con 0x7f152015c030 2024-09-19T05:39:07.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.672+0000 7f15255cf640 1 -- 172.21.15.67:0/521497043 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f152006dde0 con 0x7f152015c030 2024-09-19T05:39:07.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.672+0000 7f15077fe640 1 -- 172.21.15.67:0/521497043 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1514006d10 con 0x7f152015c030 2024-09-19T05:39:07.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.672+0000 7f15077fe640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f150c0678c0 0x7f150c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.672+0000 7f15077fe640 1 -- 172.21.15.67:0/521497043 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f1514086180 con 0x7f152015c030 2024-09-19T05:39:07.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.672+0000 7f151effd640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f150c0678c0 0x7f150c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.672+0000 7f151effd640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f150c0678c0 0x7f150c069d80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f151000a970 tx=0x7f1510008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:07.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.676+0000 7f15077fe640 1 -- 172.21.15.67:0/521497043 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1514056c10 con 0x7f152015c030 2024-09-19T05:39:07.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.840+0000 7f15255cf640 1 -- 172.21.15.67:0/521497043 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15200d0f20 con 0x7f152015c030 2024-09-19T05:39:07.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.844+0000 7f15077fe640 1 -- 172.21.15.67:0/521497043 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16922 (secure 0 0 0) 0x7f1514056510 con 0x7f152015c030 2024-09-19T05:39:07.845 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:07.845 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":99,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:39:06.827992+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:39:04.521140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-19T05:39:05.828539+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:39:07.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 -- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f150c0678c0 msgr2=0x7f150c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f150c0678c0 0x7f150c069d80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f151000a970 tx=0x7f1510008040 comp rx=0 tx=0).stop 2024-09-19T05:39:07.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 -- 172.21.15.67:0/521497043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152015c030 msgr2=0x7f1520146240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152015c030 0x7f1520146240 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f151400b9c0 tx=0x7f151400be80 comp rx=0 tx=0).stop 2024-09-19T05:39:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 -- 172.21.15.67:0/521497043 shutdown_connections 2024-09-19T05:39:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f150c0678c0 0x7f150c069d80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f152015d1d0 0x7f1520157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f152015c030 0x7f1520146240 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 --2- 172.21.15.67:0/521497043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152006f460 0x7f1520072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 -- 172.21.15.67:0/521497043 >> 172.21.15.67:0/521497043 conn(0x7f15200d0080 msgr2=0x7f152015e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 -- 172.21.15.67:0/521497043 shutdown_connections 2024-09-19T05:39:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.848+0000 7f15255cf640 1 -- 172.21.15.67:0/521497043 wait complete. 2024-09-19T05:39:07.865 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:39:07.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.980+0000 7ffb5b057640 1 Processor -- start 2024-09-19T05:39:07.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.980+0000 7ffb5b057640 1 -- start start 2024-09-19T05:39:07.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb5b057640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb540d0430 0x7ffb541613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb5b057640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 0x7ffb5415e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb5b057640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb540d0bc0 con 0x7ffb5415e550 2024-09-19T05:39:07.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb5b057640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ffb540d0ea0 con 0x7ffb540d0430 2024-09-19T05:39:07.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb5b057640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ffb540d1180 con 0x7ffb54161920 2024-09-19T05:39:07.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb595f4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 0x7ffb5415e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb53fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb540d0430 0x7ffb541613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb58df3640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ffb5415e550 0x7ffb5409b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:54594/0 (socket says 172.21.15.67:54594) 2024-09-19T05:39:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb53fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb540d0430 0x7ffb541613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:53570/0 (socket says 172.21.15.67:53570) 2024-09-19T05:39:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb58df3640 1 -- 172.21.15.67:0/350384485 learned_addr learned my addr 172.21.15.67:0/350384485 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb595f4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 0x7ffb5415e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:43006/0 (socket says 172.21.15.67:43006) 2024-09-19T05:39:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb53fff640 1 -- 172.21.15.67:0/350384485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 msgr2=0x7ffb5415e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb53fff640 1 --2- 172.21.15.67:0/350384485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 0x7ffb5415e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb53fff640 1 -- 172.21.15.67:0/350384485 >> v1:172.21.15.97:6789/0 conn(0x7ffb5415e550 legacy=0x7ffb5409b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb53fff640 1 -- 172.21.15.67:0/350384485 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb540d1460 con 0x7ffb540d0430 2024-09-19T05:39:07.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.984+0000 7ffb595f4640 1 --2- 172.21.15.67:0/350384485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 0x7ffb5415e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:07.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb53fff640 1 --2- 172.21.15.67:0/350384485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb540d0430 0x7ffb541613e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffb440097c0 tx=0x7ffb4401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6c85e327e226e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:07.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb537fe640 1 -- 172.21.15.67:0/350384485 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb440ab650 con 0x7ffb540d0430 2024-09-19T05:39:07.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb537fe640 1 -- 172.21.15.67:0/350384485 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb440b0070 con 0x7ffb540d0430 2024-09-19T05:39:07.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb537fe640 1 -- 172.21.15.67:0/350384485 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb440aba10 con 0x7ffb540d0430 2024-09-19T05:39:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb5b057640 1 -- 172.21.15.67:0/350384485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb540d0430 msgr2=0x7ffb541613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb5b057640 1 --2- 172.21.15.67:0/350384485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb540d0430 0x7ffb541613e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffb440097c0 tx=0x7ffb4401c470 comp rx=0 tx=0).stop 2024-09-19T05:39:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb5b057640 1 -- 172.21.15.67:0/350384485 shutdown_connections 2024-09-19T05:39:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb5b057640 1 --2- 172.21.15.67:0/350384485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 0x7ffb5415e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb5b057640 1 --2- 172.21.15.67:0/350384485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb540d0430 0x7ffb541613e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb5b057640 1 -- 172.21.15.67:0/350384485 >> 172.21.15.67:0/350384485 conn(0x7ffb540b3d90 msgr2=0x7ffb540b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb5b057640 1 -- 172.21.15.67:0/350384485 shutdown_connections 2024-09-19T05:39:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb5b057640 1 -- 172.21.15.67:0/350384485 wait complete. 2024-09-19T05:39:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb5b057640 1 Processor -- start 2024-09-19T05:39:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.988+0000 7ffb5b057640 1 -- start start 2024-09-19T05:39:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb5b057640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb540d0430 0x7ffb540afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb5b057640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb5415e550 0x7ffb54159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb5b057640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 0x7ffb54157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb5b057640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5415f280 con 0x7ffb5415e550 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb5b057640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ffb54161d30 con 0x7ffb540d0430 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb5b057640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ffb5415f400 con 0x7ffb54161920 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb5415e550 0x7ffb54159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb5415e550 0x7ffb54159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56504/0 (socket says 172.21.15.67:56504) 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb53fff640 1 -- 172.21.15.67:0/4085671784 learned_addr learned my addr 172.21.15.67:0/4085671784 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb595f4640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 0x7ffb54157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb58df3640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb540d0430 0x7ffb540afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb53fff640 1 -- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 msgr2=0x7ffb54157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb53fff640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 0x7ffb54157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb53fff640 1 -- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb540d0430 msgr2=0x7ffb540afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb53fff640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb540d0430 0x7ffb540afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb53fff640 1 -- 172.21.15.67:0/4085671784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb540b7af0 con 0x7ffb5415e550 2024-09-19T05:39:07.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb58df3640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb540d0430 0x7ffb540afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:07.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb53fff640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb5415e550 0x7ffb54159530 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7ffb4401cd10 tx=0x7ffb4401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:07.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb517fa640 1 -- 172.21.15.67:0/4085671784 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44006e20 con 0x7ffb5415e550 2024-09-19T05:39:07.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb517fa640 1 -- 172.21.15.67:0/4085671784 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb440bf610 con 0x7ffb5415e550 2024-09-19T05:39:07.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb5b057640 1 -- 172.21.15.67:0/4085671784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb540b7dd0 con 0x7ffb5415e550 2024-09-19T05:39:07.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb517fa640 1 -- 172.21.15.67:0/4085671784 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb440bf9e0 con 0x7ffb5415e550 2024-09-19T05:39:07.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb5b057640 1 -- 172.21.15.67:0/4085671784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb54156e40 con 0x7ffb5415e550 2024-09-19T05:39:07.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb5b057640 1 -- 172.21.15.67:0/4085671784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb541613e0 con 0x7ffb5415e550 2024-09-19T05:39:07.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb517fa640 1 -- 172.21.15.67:0/4085671784 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb440bd020 con 0x7ffb5415e550 2024-09-19T05:39:07.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb517fa640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb340678c0 0x7ffb34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:07.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb517fa640 1 -- 172.21.15.67:0/4085671784 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7ffb44120540 con 0x7ffb5415e550 2024-09-19T05:39:07.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.992+0000 7ffb58df3640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb340678c0 0x7ffb34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:07.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:07.996+0000 7ffb58df3640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb340678c0 0x7ffb34069d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c000f70 tx=0x7ffb3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:07.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.000+0000 7ffb517fa640 1 -- 172.21.15.67:0/4085671784 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ffb44016090 con 0x7ffb5415e550 2024-09-19T05:39:08.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.164+0000 7ffb5b057640 1 -- 172.21.15.67:0/4085671784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb540d1b00 con 0x7ffb5415e550 2024-09-19T05:39:08.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb517fa640 1 -- 172.21.15.67:0/4085671784 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16922 (secure 0 0 0) 0x7ffb440f0f80 con 0x7ffb5415e550 2024-09-19T05:39:08.167 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:08.167 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":99,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:39:06.827992+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:39:04.521140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-19T05:39:05.828539+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:39:08.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 -- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb340678c0 msgr2=0x7ffb34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:08.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb340678c0 0x7ffb34069d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c000f70 tx=0x7ffb3c009040 comp rx=0 tx=0).stop 2024-09-19T05:39:08.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 -- 172.21.15.67:0/4085671784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb5415e550 msgr2=0x7ffb54159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb5415e550 0x7ffb54159530 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7ffb4401cd10 tx=0x7ffb4401acb0 comp rx=0 tx=0).stop 2024-09-19T05:39:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 -- 172.21.15.67:0/4085671784 shutdown_connections 2024-09-19T05:39:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb340678c0 0x7ffb34069d80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb54161920 0x7ffb54157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb5415e550 0x7ffb54159530 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 --2- 172.21.15.67:0/4085671784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb540d0430 0x7ffb540afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 -- 172.21.15.67:0/4085671784 >> 172.21.15.67:0/4085671784 conn(0x7ffb540b3d90 msgr2=0x7ffb541600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 -- 172.21.15.67:0/4085671784 shutdown_connections 2024-09-19T05:39:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.168+0000 7ffb5b057640 1 -- 172.21.15.67:0/4085671784 wait complete. 2024-09-19T05:39:08.187 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:39:08.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b544dd640 1 Processor -- start 2024-09-19T05:39:08.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b544dd640 1 -- start start 2024-09-19T05:39:08.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b544dd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8b4c159c60 0x7f8b4c0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:08.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b544dd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8b4c0af3a0 0x7f8b4c15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:08.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b544dd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b4c15a040 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b544dd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8b4c15d460 con 0x7f8b4c0af3a0 2024-09-19T05:39:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b544dd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8b4c15c850 con 0x7f8b4c159c60 2024-09-19T05:39:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b52a7a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8b4c0af3a0 0x7f8b4c15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b52a7a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8b4c0af3a0 0x7f8b4c15fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56514/0 (socket says 172.21.15.67:56514) 2024-09-19T05:39:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b52a7a640 1 -- 172.21.15.67:0/3582005975 learned_addr learned my addr 172.21.15.67:0/3582005975 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b52279640 1 --2- 172.21.15.67:0/3582005975 >> v2:172.21.15.97:3300/0 conn(0x7f8b4c159c60 0x7f8b4c0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b52a7a640 1 -- 172.21.15.67:0/3582005975 >> v2:172.21.15.97:3300/0 conn(0x7f8b4c159c60 msgr2=0x7f8b4c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b52a7a640 1 --2- 172.21.15.67:0/3582005975 >> v2:172.21.15.97:3300/0 conn(0x7f8b4c159c60 0x7f8b4c0ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b52a7a640 1 -- 172.21.15.67:0/3582005975 >> v1:172.21.15.97:6789/0 conn(0x7f8b4c06ffd0 legacy=0x7f8b4c0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.312+0000 7f8b52a7a640 1 -- 172.21.15.67:0/3582005975 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4c15cb30 con 0x7f8b4c0af3a0 2024-09-19T05:39:08.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b52a7a640 1 --2- 172.21.15.67:0/3582005975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c0af3a0 0x7f8b4c15fdc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0712f0 tx=0x7f8b4401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bbaaa49e944386 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:08.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b51277640 1 -- 172.21.15.67:0/3582005975 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b440a5840 con 0x7f8b4c0af3a0 2024-09-19T05:39:08.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b51277640 1 -- 172.21.15.67:0/3582005975 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b440a59e0 con 0x7f8b4c0af3a0 2024-09-19T05:39:08.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b51277640 1 -- 172.21.15.67:0/3582005975 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b440a5db0 con 0x7f8b4c0af3a0 2024-09-19T05:39:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 -- 172.21.15.67:0/3582005975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c0af3a0 msgr2=0x7f8b4c15fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 --2- 172.21.15.67:0/3582005975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c0af3a0 0x7f8b4c15fdc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0712f0 tx=0x7f8b4401c980 comp rx=0 tx=0).stop 2024-09-19T05:39:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 -- 172.21.15.67:0/3582005975 shutdown_connections 2024-09-19T05:39:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 --2- 172.21.15.67:0/3582005975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c0af3a0 0x7f8b4c15fdc0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 --2- 172.21.15.67:0/3582005975 >> v2:172.21.15.97:3300/0 conn(0x7f8b4c159c60 0x7f8b4c0ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 -- 172.21.15.67:0/3582005975 >> 172.21.15.67:0/3582005975 conn(0x7f8b4c0b1e50 msgr2=0x7f8b4c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 -- 172.21.15.67:0/3582005975 shutdown_connections 2024-09-19T05:39:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 -- 172.21.15.67:0/3582005975 wait complete. 2024-09-19T05:39:08.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 Processor -- start 2024-09-19T05:39:08.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 -- start start 2024-09-19T05:39:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c06ffd0 0x7f8b4c165b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.316+0000 7f8b544dd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b4c0af3a0 0x7f8b4c152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b544dd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b4c159c60 0x7f8b4c152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b544dd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c168e30 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b544dd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c168fb0 con 0x7f8b4c0af3a0 2024-09-19T05:39:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b544dd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4c169130 con 0x7f8b4c159c60 2024-09-19T05:39:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52279640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c06ffd0 0x7f8b4c165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52279640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c06ffd0 0x7f8b4c165b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56530/0 (socket says 172.21.15.67:56530) 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52279640 1 -- 172.21.15.67:0/3339706195 learned_addr learned my addr 172.21.15.67:0/3339706195 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b51a78640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b4c0af3a0 0x7f8b4c152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52a7a640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b4c159c60 0x7f8b4c152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52279640 1 -- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b4c159c60 msgr2=0x7f8b4c152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52279640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b4c159c60 0x7f8b4c152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52279640 1 -- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b4c0af3a0 msgr2=0x7f8b4c152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52279640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b4c0af3a0 0x7f8b4c152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52279640 1 -- 172.21.15.67:0/3339706195 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4c13fc50 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52a7a640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b4c159c60 0x7f8b4c152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b52279640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c06ffd0 0x7f8b4c165b70 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800d620 tx=0x7f8b4800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b42ffd640 1 -- 172.21.15.67:0/3339706195 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800b620 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b42ffd640 1 -- 172.21.15.67:0/3339706195 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b48019070 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b42ffd640 1 -- 172.21.15.67:0/3339706195 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800b9e0 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b544dd640 1 -- 172.21.15.67:0/3339706195 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4c09dd60 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b544dd640 1 -- 172.21.15.67:0/3339706195 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b4c09e000 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b544dd640 1 -- 172.21.15.67:0/3339706195 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b4c15fdc0 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b42ffd640 1 -- 172.21.15.67:0/3339706195 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b4800bb80 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b42ffd640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8b300678f0 0x7f8b30069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:08.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b42ffd640 1 -- 172.21.15.67:0/3339706195 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f8b48086220 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.320+0000 7f8b51a78640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8b300678f0 0x7f8b30069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:08.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.324+0000 7f8b51a78640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8b300678f0 0x7f8b30069db0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c1663e0 tx=0x7f8b3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:08.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.324+0000 7f8b42ffd640 1 -- 172.21.15.67:0/3339706195 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8b4c13fc50 con 0x7f8b4c06ffd0 2024-09-19T05:39:08.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:08.528+0000 7f8b544dd640 1 -- 172.21.15.67:0/3339706195 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8b4c0d0f20 con 0x7f8b4c06ffd0 2024-09-19T05:39:09.256 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:39:09.259 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:39:09.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.508+0000 7f8b42ffd640 1 -- 172.21.15.67:0/3339706195 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) ==== 118+0+0 (secure 0 0 0) 0x7f8b48056bd0 con 0x7f8b4c06ffd0 2024-09-19T05:39:09.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 -- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8b300678f0 msgr2=0x7f8b30069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:09.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8b300678f0 0x7f8b30069db0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c1663e0 tx=0x7f8b3c009040 comp rx=0 tx=0).stop 2024-09-19T05:39:09.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 -- 172.21.15.67:0/3339706195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c06ffd0 msgr2=0x7f8b4c165b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:09.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c06ffd0 0x7f8b4c165b70 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800d620 tx=0x7f8b4800dae0 comp rx=0 tx=0).stop 2024-09-19T05:39:09.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 -- 172.21.15.67:0/3339706195 shutdown_connections 2024-09-19T05:39:09.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8b300678f0 0x7f8b30069db0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b4c159c60 0x7f8b4c152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b4c0af3a0 0x7f8b4c152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 --2- 172.21.15.67:0/3339706195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b4c06ffd0 0x7f8b4c165b70 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 -- 172.21.15.67:0/3339706195 >> 172.21.15.67:0/3339706195 conn(0x7f8b4c0b1e50 msgr2=0x7f8b4c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 -- 172.21.15.67:0/3339706195 shutdown_connections 2024-09-19T05:39:09.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.512+0000 7f8b544dd640 1 -- 172.21.15.67:0/3339706195 wait complete. 2024-09-19T05:39:09.538 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:39:09.538 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:39:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff156b06640 1 Processor -- start 2024-09-19T05:39:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff156b06640 1 -- start start 2024-09-19T05:39:09.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff156b06640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff1500d4fb0 0x7ff1500d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:09.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff156b06640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1500d35a0 con 0x7ff1500d13c0 2024-09-19T05:39:09.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff156b06640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1500d32c0 con 0x7ff15015e690 2024-09-19T05:39:09.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff156b06640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff1500d17f0 con 0x7ff1500d4fb0 2024-09-19T05:39:09.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff14ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff1500d4fb0 0x7ff1500d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:09.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff1550a3640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff1500d13c0 0x7ff15006db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46754/0 (socket says 172.21.15.67:46754) 2024-09-19T05:39:09.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff1550a3640 1 -- 172.21.15.67:0/884202568 learned_addr learned my addr 172.21.15.67:0/884202568 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:09.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff14ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff1500d4fb0 0x7ff1500d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56540/0 (socket says 172.21.15.67:56540) 2024-09-19T05:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff14ffff640 1 -- 172.21.15.67:0/884202568 >> v1:172.21.15.97:6789/0 conn(0x7ff15015e690 legacy=0x7ff1500d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff14ffff640 1 -- 172.21.15.67:0/884202568 >> v1:172.21.15.67:6789/0 conn(0x7ff1500d13c0 legacy=0x7ff15006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff14ffff640 1 -- 172.21.15.67:0/884202568 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15006d040 con 0x7ff1500d4fb0 2024-09-19T05:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.664+0000 7ff14f7fe640 1 -- 172.21.15.67:0/884202568 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201871364 0 0) 0x7ff1500d35a0 con 0x7ff1500d13c0 2024-09-19T05:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff14ffff640 1 --2- 172.21.15.67:0/884202568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 0x7ff1500d0e80 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff1440097c0 tx=0x7ff14401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9140af72967caf22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff14f7fe640 1 -- 172.21.15.67:0/884202568 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1440a7070 con 0x7ff1500d4fb0 2024-09-19T05:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff14f7fe640 1 -- 172.21.15.67:0/884202568 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1440b0070 con 0x7ff1500d4fb0 2024-09-19T05:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff14f7fe640 1 -- 172.21.15.67:0/884202568 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1440ab890 con 0x7ff1500d4fb0 2024-09-19T05:39:09.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 -- 172.21.15.67:0/884202568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 msgr2=0x7ff1500d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 --2- 172.21.15.67:0/884202568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 0x7ff1500d0e80 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff1440097c0 tx=0x7ff14401c470 comp rx=0 tx=0).stop 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 -- 172.21.15.67:0/884202568 shutdown_connections 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 --2- 172.21.15.67:0/884202568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 0x7ff1500d0e80 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 -- 172.21.15.67:0/884202568 >> 172.21.15.67:0/884202568 conn(0x7ff1500d4490 msgr2=0x7ff1500d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 -- 172.21.15.67:0/884202568 shutdown_connections 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 -- 172.21.15.67:0/884202568 wait complete. 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 Processor -- start 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 -- start start 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1500d13c0 0x7ff150153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 0x7ff15013c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff15015e690 0x7ff1500c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff15006ebc0 con 0x7ff1500d4fb0 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff15006ea40 con 0x7ff1500d13c0 2024-09-19T05:39:09.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff156b06640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff15016c260 con 0x7ff15015e690 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 0x7ff15013c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 0x7ff15013c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56546/0 (socket says 172.21.15.67:56546) 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.668+0000 7ff14ffff640 1 -- 172.21.15.67:0/94535511 learned_addr learned my addr 172.21.15.67:0/94535511 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff1550a3640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff15015e690 0x7ff1500c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff1548a2640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1500d13c0 0x7ff150153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14ffff640 1 -- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff15015e690 msgr2=0x7ff1500c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14ffff640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff15015e690 0x7ff1500c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14ffff640 1 -- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1500d13c0 msgr2=0x7ff150153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14ffff640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1500d13c0 0x7ff150153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14ffff640 1 -- 172.21.15.67:0/94535511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1500ca3e0 con 0x7ff1500d4fb0 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff1550a3640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff15015e690 0x7ff1500c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14ffff640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 0x7ff15013c940 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ff1440ad040 tx=0x7ff14401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:09.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14d7fa640 1 -- 172.21.15.67:0/94535511 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1440bf610 con 0x7ff1500d4fb0 2024-09-19T05:39:09.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14d7fa640 1 -- 172.21.15.67:0/94535511 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1440bf7b0 con 0x7ff1500d4fb0 2024-09-19T05:39:09.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff156b06640 1 -- 172.21.15.67:0/94535511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1500ca6c0 con 0x7ff1500d4fb0 2024-09-19T05:39:09.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14d7fa640 1 -- 172.21.15.67:0/94535511 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1440bfba0 con 0x7ff1500d4fb0 2024-09-19T05:39:09.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff156b06640 1 -- 172.21.15.67:0/94535511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1500cac80 con 0x7ff1500d4fb0 2024-09-19T05:39:09.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff156b06640 1 -- 172.21.15.67:0/94535511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1500d0e80 con 0x7ff1500d4fb0 2024-09-19T05:39:09.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14d7fa640 1 -- 172.21.15.67:0/94535511 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1440bd020 con 0x7ff1500d4fb0 2024-09-19T05:39:09.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14d7fa640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff13c0678f0 0x7ff13c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:09.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff14d7fa640 1 -- 172.21.15.67:0/94535511 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7ff144120630 con 0x7ff1500d4fb0 2024-09-19T05:39:09.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff1548a2640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff13c0678f0 0x7ff13c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:09.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.672+0000 7ff1548a2640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff13c0678f0 0x7ff13c069db0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff140000f70 tx=0x7ff140009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:09.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.676+0000 7ff14d7fa640 1 -- 172.21.15.67:0/94535511 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff144016090 con 0x7ff1500d4fb0 2024-09-19T05:39:09.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:09.872+0000 7ff156b06640 1 -- 172.21.15.67:0/94535511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff1500d4a80 con 0x7ff1500d4fb0 2024-09-19T05:39:10.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.516+0000 7ff14d7fa640 1 -- 172.21.15.67:0/94535511 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v67) ==== 122+0+0 (secure 0 0 0) 0x7ff1440f5e20 con 0x7ff1500d4fb0 2024-09-19T05:39:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 -- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff13c0678f0 msgr2=0x7ff13c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff13c0678f0 0x7ff13c069db0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff140000f70 tx=0x7ff140009040 comp rx=0 tx=0).stop 2024-09-19T05:39:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 -- 172.21.15.67:0/94535511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 msgr2=0x7ff15013c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 0x7ff15013c940 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ff1440ad040 tx=0x7ff14401acb0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 -- 172.21.15.67:0/94535511 shutdown_connections 2024-09-19T05:39:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff13c0678f0 0x7ff13c069db0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff15015e690 0x7ff1500c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1500d4fb0 0x7ff15013c940 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 --2- 172.21.15.67:0/94535511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1500d13c0 0x7ff150153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 -- 172.21.15.67:0/94535511 >> 172.21.15.67:0/94535511 conn(0x7ff1500d4490 msgr2=0x7ff1500b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:10.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 -- 172.21.15.67:0/94535511 shutdown_connections 2024-09-19T05:39:10.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.520+0000 7ff156b06640 1 -- 172.21.15.67:0/94535511 wait complete. 2024-09-19T05:39:10.544 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:39:10.545 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:10.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f103db11640 1 Processor -- start 2024-09-19T05:39:10.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f103db11640 1 -- start start 2024-09-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f103db11640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103815b710 0x7f1038071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f103db11640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10380b3070 con 0x7f10380aef40 2024-09-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f103db11640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10380afa70 con 0x7f103815baf0 2024-09-19T05:39:10.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f103db11640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f10380b32e0 con 0x7f103815b710 2024-09-19T05:39:10.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f1037fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f10380aef40 0x7f10380af360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46756/0 (socket says 172.21.15.67:46756) 2024-09-19T05:39:10.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f1037fff640 1 -- 172.21.15.67:0/3662596491 learned_addr learned my addr 172.21.15.67:0/3662596491 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:10.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10377fe640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103815b710 0x7f1038071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522563292 0 0) 0x7f10380b3070 con 0x7f10380aef40 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1020003530 con 0x7f10380aef40 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2151714152 0 0) 0x7f1020003530 con 0x7f10380aef40 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103815b710 msgr2=0x7f1038071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103815b710 0x7f1038071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 >> v1:172.21.15.97:6789/0 conn(0x7f103815baf0 legacy=0x7f103815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10380b35c0 con 0x7f10380aef40 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1030001680 con 0x7f10380aef40 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 >> v1:172.21.15.67:6789/0 conn(0x7f10380aef40 legacy=0x7f10380af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103815b710 0x7f10200039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1020003f30 0x7f1020004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020004d50 0x7f10200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f10380b32e0 con 0x7f1020003f30 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f102000ba30 con 0x7f1020004d50 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f102000bc30 con 0x7f103815b710 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f1036ffd640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1020003f30 0x7f1020004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f10377fe640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103815b710 0x7f10200039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f1037fff640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020004d50 0x7f10200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f1036ffd640 1 -- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103815b710 msgr2=0x7f10200039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f1036ffd640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103815b710 0x7f10200039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f1036ffd640 1 -- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020004d50 msgr2=0x7f10200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f1036ffd640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020004d50 0x7f10200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f1036ffd640 1 -- 172.21.15.67:0/3662596491 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1020003530 con 0x7f1020003f30 2024-09-19T05:39:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.676+0000 7f1037fff640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020004d50 0x7f10200051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f1036ffd640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1020003f30 0x7f1020004810 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f102c001f60 tx=0x7f102c01c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4552c1efe32aeb6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c001b60 con 0x7f1020003f30 2024-09-19T05:39:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102c0a9650 con 0x7f1020003f30 2024-09-19T05:39:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f10367fc640 1 -- 172.21.15.67:0/3662596491 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c0a9a80 con 0x7f1020003f30 2024-09-19T05:39:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f103db11640 1 -- 172.21.15.67:0/3662596491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1020003f30 msgr2=0x7f1020004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f103db11640 1 --2- 172.21.15.67:0/3662596491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1020003f30 0x7f1020004810 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f102c001f60 tx=0x7f102c01c790 comp rx=0 tx=0).stop 2024-09-19T05:39:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f1037fff640 1 -- 172.21.15.67:0/3662596491 reap_dead start 2024-09-19T05:39:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f103db11640 1 -- 172.21.15.67:0/3662596491 shutdown_connections 2024-09-19T05:39:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f103db11640 1 -- 172.21.15.67:0/3662596491 >> 172.21.15.67:0/3662596491 conn(0x7f10380d0080 msgr2=0x7f10380d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:10.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f103db11640 1 -- 172.21.15.67:0/3662596491 shutdown_connections 2024-09-19T05:39:10.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f103db11640 1 -- 172.21.15.67:0/3662596491 wait complete. 2024-09-19T05:39:10.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f103db11640 1 Processor -- start 2024-09-19T05:39:10.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.680+0000 7f103db11640 1 -- start start 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f103db11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020003f30 0x7f103814f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f103db11640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103814a520 0x7f10381f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f103db11640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10381f5600 0x7f103814ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f103db11640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f10380b4c40 con 0x7f10381f5600 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f103db11640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f10380b4ac0 con 0x7f1020003f30 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f103db11640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f10380b4dc0 con 0x7f103814a520 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1037fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10381f5600 0x7f103814ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1037fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10381f5600 0x7f103814ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56564/0 (socket says 172.21.15.67:56564) 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1037fff640 1 -- 172.21.15.67:0/1256684357 learned_addr learned my addr 172.21.15.67:0/1256684357 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1036ffd640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103814a520 0x7f10381f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f10377fe640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020003f30 0x7f103814f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1037fff640 1 -- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103814a520 msgr2=0x7f10381f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:10.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1037fff640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103814a520 0x7f10381f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1037fff640 1 -- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020003f30 msgr2=0x7f103814f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:10.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1037fff640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020003f30 0x7f103814f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1037fff640 1 -- 172.21.15.67:0/1256684357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10381f5a90 con 0x7f10381f5600 2024-09-19T05:39:10.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f10377fe640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020003f30 0x7f103814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:10.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1036ffd640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103814a520 0x7f10381f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:10.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f1037fff640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10381f5600 0x7f103814ce00 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f10380adaf0 tx=0x7f103000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:10.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f101ffff640 1 -- 172.21.15.67:0/1256684357 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103000c610 con 0x7f10381f5600 2024-09-19T05:39:10.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f101ffff640 1 -- 172.21.15.67:0/1256684357 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1030018070 con 0x7f10381f5600 2024-09-19T05:39:10.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f103db11640 1 -- 172.21.15.67:0/1256684357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10381f5d70 con 0x7f10381f5600 2024-09-19T05:39:10.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f101ffff640 1 -- 172.21.15.67:0/1256684357 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103000c9f0 con 0x7f10381f5600 2024-09-19T05:39:10.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f103db11640 1 -- 172.21.15.67:0/1256684357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103809cdb0 con 0x7f10381f5600 2024-09-19T05:39:10.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f103db11640 1 -- 172.21.15.67:0/1256684357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f103815bf30 con 0x7f10381f5600 2024-09-19T05:39:10.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f101ffff640 1 -- 172.21.15.67:0/1256684357 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f103000cb90 con 0x7f10381f5600 2024-09-19T05:39:10.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f101ffff640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10240678c0 0x7f1024069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:10.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f101ffff640 1 -- 172.21.15.67:0/1256684357 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f1030085990 con 0x7f10381f5600 2024-09-19T05:39:10.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.684+0000 7f10377fe640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10240678c0 0x7f1024069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:10.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.688+0000 7f10377fe640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10240678c0 0x7f1024069d80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f103809a680 tx=0x7f1028008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:10.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.688+0000 7f101ffff640 1 -- 172.21.15.67:0/1256684357 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1030056340 con 0x7f10381f5600 2024-09-19T05:39:10.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.888+0000 7f103db11640 1 -- 172.21.15.67:0/1256684357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10380b5020 con 0x7f10381f5600 2024-09-19T05:39:10.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f101ffff640 1 -- 172.21.15.67:0/1256684357 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5219 (secure 0 0 0) 0x7f1030055c40 con 0x7f10381f5600 2024-09-19T05:39:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:10.892 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":67,"btime":"2024-09-19T05:39:10:515079+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1965498909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1965498909},{"type":"v1","addr":"172.21.15.97:6837","nonce":1965498909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/123788622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":123788622},{"type":"v1","addr":"172.21.15.97:6835","nonce":123788622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4015838682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":4015838682},{"type":"v1","addr":"172.21.15.67:6835","nonce":4015838682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:09.876016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6834/358275731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":358275731},{"type":"v1","addr":"172.21.15.67:6834","nonce":358275731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7215,"qdb_cluster":[7215]},"id":6}]} 2024-09-19T05:39:10.892 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 67 2024-09-19T05:39:10.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f103db11640 1 -- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10240678c0 msgr2=0x7f1024069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:10.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f103db11640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10240678c0 0x7f1024069d80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f103809a680 tx=0x7f1028008040 comp rx=0 tx=0).stop 2024-09-19T05:39:10.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f103db11640 1 -- 172.21.15.67:0/1256684357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10381f5600 msgr2=0x7f103814ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:10.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f103db11640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10381f5600 0x7f103814ce00 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f10380adaf0 tx=0x7f103000eb90 comp rx=0 tx=0).stop 2024-09-19T05:39:10.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f103db11640 1 -- 172.21.15.67:0/1256684357 shutdown_connections 2024-09-19T05:39:10.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f103db11640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10381f5600 0x7f103814ce00 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f103db11640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10240678c0 0x7f1024069d80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f103db11640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103814a520 0x7f10381f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f103db11640 1 --2- 172.21.15.67:0/1256684357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1020003f30 0x7f103814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:10.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.892+0000 7f103db11640 1 -- 172.21.15.67:0/1256684357 >> 172.21.15.67:0/1256684357 conn(0x7f10380d0080 msgr2=0x7f103806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:10.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.896+0000 7f103db11640 1 -- 172.21.15.67:0/1256684357 shutdown_connections 2024-09-19T05:39:10.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:10.896+0000 7f103db11640 1 -- 172.21.15.67:0/1256684357 wait complete. 2024-09-19T05:39:10.911 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:39:11.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.036+0000 7f76651bd640 1 Processor -- start 2024-09-19T05:39:11.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.036+0000 7f76651bd640 1 -- start start 2024-09-19T05:39:11.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.036+0000 7f76651bd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f766015c030 0x7f766006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f766006f460 0x7f766006f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f766006e3c0 con 0x7f766015d1d0 2024-09-19T05:39:11.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f766006e6a0 con 0x7f766006f460 2024-09-19T05:39:11.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f766006e980 con 0x7f766015c030 2024-09-19T05:39:11.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765f59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f766006f460 0x7f766006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765f59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f766006f460 0x7f766006f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56566/0 (socket says 172.21.15.67:56566) 2024-09-19T05:39:11.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765f59e640 1 -- 172.21.15.67:0/2525871169 learned_addr learned my addr 172.21.15.67:0/2525871169 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:11.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765ed9d640 1 --2- 172.21.15.67:0/2525871169 >> v2:172.21.15.97:3300/0 conn(0x7f766015c030 0x7f766006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765f59e640 1 -- 172.21.15.67:0/2525871169 >> v2:172.21.15.97:3300/0 conn(0x7f766015c030 msgr2=0x7f766006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:11.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765f59e640 1 --2- 172.21.15.67:0/2525871169 >> v2:172.21.15.97:3300/0 conn(0x7f766015c030 0x7f766006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765f59e640 1 -- 172.21.15.67:0/2525871169 >> v1:172.21.15.97:6789/0 conn(0x7f766015d1d0 legacy=0x7f76600b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:11.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765f59e640 1 -- 172.21.15.67:0/2525871169 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766006ec60 con 0x7f766006f460 2024-09-19T05:39:11.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765f59e640 1 --2- 172.21.15.67:0/2525871169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 0x7f766006f870 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7660070390 tx=0x7f765801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b4898b009236fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:11.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765dd9b640 1 -- 172.21.15.67:0/2525871169 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76580b0070 con 0x7f766006f460 2024-09-19T05:39:11.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765dd9b640 1 -- 172.21.15.67:0/2525871169 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76580ab600 con 0x7f766006f460 2024-09-19T05:39:11.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f765dd9b640 1 -- 172.21.15.67:0/2525871169 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76580ab9d0 con 0x7f766006f460 2024-09-19T05:39:11.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 -- 172.21.15.67:0/2525871169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 msgr2=0x7f766006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 --2- 172.21.15.67:0/2525871169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 0x7f766006f870 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7660070390 tx=0x7f765801c4e0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 -- 172.21.15.67:0/2525871169 shutdown_connections 2024-09-19T05:39:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 --2- 172.21.15.67:0/2525871169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 0x7f766006f870 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 --2- 172.21.15.67:0/2525871169 >> v2:172.21.15.97:3300/0 conn(0x7f766015c030 0x7f766006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 -- 172.21.15.67:0/2525871169 >> 172.21.15.67:0/2525871169 conn(0x7f76600d0080 msgr2=0x7f76600d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 -- 172.21.15.67:0/2525871169 shutdown_connections 2024-09-19T05:39:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.040+0000 7f76651bd640 1 -- 172.21.15.67:0/2525871169 wait complete. 2024-09-19T05:39:11.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76651bd640 1 Processor -- start 2024-09-19T05:39:11.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76651bd640 1 -- start start 2024-09-19T05:39:11.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76651bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 0x7f7660158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76651bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f766015c030 0x7f766014d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76651bd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766015d1d0 0x7f766014da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76651bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f766015c590 con 0x7f766006f460 2024-09-19T05:39:11.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76651bd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f766015c410 con 0x7f766015d1d0 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76651bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f76601690e0 con 0x7f766015c030 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 0x7f7660158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 0x7f7660158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56580/0 (socket says 172.21.15.67:56580) 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765ed9d640 1 -- 172.21.15.67:0/909519700 learned_addr learned my addr 172.21.15.67:0/909519700 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765f59e640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766015d1d0 0x7f766014da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765e59c640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f766015c030 0x7f766014d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765ed9d640 1 -- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f766015c030 msgr2=0x7f766014d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765ed9d640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f766015c030 0x7f766014d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765ed9d640 1 -- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766015d1d0 msgr2=0x7f766014da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765ed9d640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766015d1d0 0x7f766014da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765ed9d640 1 -- 172.21.15.67:0/909519700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7660150d40 con 0x7f766006f460 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f765ed9d640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 0x7f7660158cf0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f7650007f20 tx=0x7f765000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:11.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76577fe640 1 -- 172.21.15.67:0/909519700 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650014620 con 0x7f766006f460 2024-09-19T05:39:11.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76577fe640 1 -- 172.21.15.67:0/909519700 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7650019070 con 0x7f766006f460 2024-09-19T05:39:11.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76577fe640 1 -- 172.21.15.67:0/909519700 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650014a00 con 0x7f766006f460 2024-09-19T05:39:11.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76651bd640 1 -- 172.21.15.67:0/909519700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7660151020 con 0x7f766006f460 2024-09-19T05:39:11.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.044+0000 7f76651bd640 1 -- 172.21.15.67:0/909519700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76601515e0 con 0x7f766006f460 2024-09-19T05:39:11.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.048+0000 7f76651bd640 1 -- 172.21.15.67:0/909519700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f766006f870 con 0x7f766006f460 2024-09-19T05:39:11.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.048+0000 7f76577fe640 1 -- 172.21.15.67:0/909519700 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7650014ba0 con 0x7f766006f460 2024-09-19T05:39:11.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.048+0000 7f76577fe640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76400678f0 0x7f7640069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.048+0000 7f76577fe640 1 -- 172.21.15.67:0/909519700 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f76500866e0 con 0x7f766006f460 2024-09-19T05:39:11.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.048+0000 7f765e59c640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76400678f0 0x7f7640069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.048+0000 7f765e59c640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76400678f0 0x7f7640069db0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f76601530d0 tx=0x7f7648008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:11.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.052+0000 7f76577fe640 1 -- 172.21.15.67:0/909519700 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7650057100 con 0x7f766006f460 2024-09-19T05:39:11.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.216+0000 7f76651bd640 1 -- 172.21.15.67:0/909519700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76600d0f20 con 0x7f766006f460 2024-09-19T05:39:11.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76577fe640 1 -- 172.21.15.67:0/909519700 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16911 (secure 0 0 0) 0x7f7650056a00 con 0x7f766006f460 2024-09-19T05:39:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:11.218 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":100,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:39:08.465030+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:39:04.521140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-19T05:39:05.828539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:39:11.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 -- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76400678f0 msgr2=0x7f7640069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76400678f0 0x7f7640069db0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f76601530d0 tx=0x7f7648008040 comp rx=0 tx=0).stop 2024-09-19T05:39:11.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 -- 172.21.15.67:0/909519700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 msgr2=0x7f7660158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 0x7f7660158cf0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f7650007f20 tx=0x7f765000e570 comp rx=0 tx=0).stop 2024-09-19T05:39:11.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 -- 172.21.15.67:0/909519700 shutdown_connections 2024-09-19T05:39:11.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766015d1d0 0x7f766014da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76400678f0 0x7f7640069db0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f766015c030 0x7f766014d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 --2- 172.21.15.67:0/909519700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f766006f460 0x7f7660158cf0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 -- 172.21.15.67:0/909519700 >> 172.21.15.67:0/909519700 conn(0x7f76600d0080 msgr2=0x7f766015d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:11.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 -- 172.21.15.67:0/909519700 shutdown_connections 2024-09-19T05:39:11.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.220+0000 7f76651bd640 1 -- 172.21.15.67:0/909519700 wait complete. 2024-09-19T05:39:11.238 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:39:11.238 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:39:11.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.364+0000 7f1b8a1f0640 1 Processor -- start 2024-09-19T05:39:11.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.364+0000 7f1b8a1f0640 1 -- start start 2024-09-19T05:39:11.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b8a1f0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b8409b140 0x7f1b840705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b8a1f0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8415d290 0x7f1b84159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b8a1f0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b840c7130 con 0x7f1b840c8c40 2024-09-19T05:39:11.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b8a1f0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1b84070b90 con 0x7f1b8409b140 2024-09-19T05:39:11.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b8a1f0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b84070e70 con 0x7f1b8415d290 2024-09-19T05:39:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b83fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8415d290 0x7f1b84159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b82ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b8409b140 0x7f1b840705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b82ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b8409b140 0x7f1b840705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:53652/0 (socket says 172.21.15.67:53652) 2024-09-19T05:39:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b82ffd640 1 -- 172.21.15.67:0/3480094087 learned_addr learned my addr 172.21.15.67:0/3480094087 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b837fe640 1 --1- 172.21.15.67:0/3480094087 >> v1:172.21.15.97:6789/0 conn(0x7f1b840c8c40 0x7f1b8409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:54626/0 (socket says 172.21.15.67:54626) 2024-09-19T05:39:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b82ffd640 1 -- 172.21.15.67:0/3480094087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8415d290 msgr2=0x7f1b84159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b82ffd640 1 --2- 172.21.15.67:0/3480094087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8415d290 0x7f1b84159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b82ffd640 1 -- 172.21.15.67:0/3480094087 >> v1:172.21.15.97:6789/0 conn(0x7f1b840c8c40 legacy=0x7f1b8409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.368+0000 7f1b82ffd640 1 -- 172.21.15.67:0/3480094087 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b84071150 con 0x7f1b8409b140 2024-09-19T05:39:11.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b82ffd640 1 --2- 172.21.15.67:0/3480094087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8409b140 0x7f1b840705b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009870 tx=0x7f1b6c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b52362d577d09935 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b827fc640 1 -- 172.21.15.67:0/3480094087 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0a7070 con 0x7f1b8409b140 2024-09-19T05:39:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b827fc640 1 -- 172.21.15.67:0/3480094087 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6c0b0070 con 0x7f1b8409b140 2024-09-19T05:39:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b827fc640 1 -- 172.21.15.67:0/3480094087 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0ab890 con 0x7f1b8409b140 2024-09-19T05:39:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/3480094087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8409b140 msgr2=0x7f1b840705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b8a1f0640 1 --2- 172.21.15.67:0/3480094087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8409b140 0x7f1b840705b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009870 tx=0x7f1b6c01c560 comp rx=0 tx=0).stop 2024-09-19T05:39:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/3480094087 shutdown_connections 2024-09-19T05:39:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b8a1f0640 1 --2- 172.21.15.67:0/3480094087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8415d290 0x7f1b84159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b8a1f0640 1 --2- 172.21.15.67:0/3480094087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8409b140 0x7f1b840705b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/3480094087 >> 172.21.15.67:0/3480094087 conn(0x7f1b840d22b0 msgr2=0x7f1b840d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/3480094087 shutdown_connections 2024-09-19T05:39:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/3480094087 wait complete. 2024-09-19T05:39:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b8a1f0640 1 Processor -- start 2024-09-19T05:39:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.372+0000 7f1b8a1f0640 1 -- start start 2024-09-19T05:39:11.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b8a1f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8409b140 0x7f1b840b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b8a1f0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b840c8c40 0x7f1b84153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b8a1f0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8415d290 0x7f1b840b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b8a1f0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b840d0be0 con 0x7f1b8409b140 2024-09-19T05:39:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b8a1f0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b840d0a60 con 0x7f1b8415d290 2024-09-19T05:39:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b8a1f0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b840d0d60 con 0x7f1b840c8c40 2024-09-19T05:39:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8409b140 0x7f1b840b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8409b140 0x7f1b840b5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56592/0 (socket says 172.21.15.67:56592) 2024-09-19T05:39:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b837fe640 1 -- 172.21.15.67:0/1309640817 learned_addr learned my addr 172.21.15.67:0/1309640817 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b82ffd640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b840c8c40 0x7f1b84153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b83fff640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8415d290 0x7f1b840b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b837fe640 1 -- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b840c8c40 msgr2=0x7f1b84153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b837fe640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b840c8c40 0x7f1b84153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b837fe640 1 -- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8415d290 msgr2=0x7f1b840b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b837fe640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8415d290 0x7f1b840b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b837fe640 1 -- 172.21.15.67:0/1309640817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b840b61b0 con 0x7f1b8409b140 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b837fe640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8409b140 0x7f1b840b5bd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c790 tx=0x7f1b7c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b7bfff640 1 -- 172.21.15.67:0/1309640817 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c017070 con 0x7f1b8409b140 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b7bfff640 1 -- 172.21.15.67:0/1309640817 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7c00a5e0 con 0x7f1b8409b140 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b7bfff640 1 -- 172.21.15.67:0/1309640817 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00a990 con 0x7f1b8409b140 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/1309640817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b840b6490 con 0x7f1b8409b140 2024-09-19T05:39:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/1309640817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b840b6a50 con 0x7f1b8409b140 2024-09-19T05:39:11.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/1309640817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b840705b0 con 0x7f1b8409b140 2024-09-19T05:39:11.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b7bfff640 1 -- 172.21.15.67:0/1309640817 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b7c01a070 con 0x7f1b8409b140 2024-09-19T05:39:11.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b7bfff640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b640678c0 0x7f1b64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.376+0000 7f1b7bfff640 1 -- 172.21.15.67:0/1309640817 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f1b7c0852e0 con 0x7f1b8409b140 2024-09-19T05:39:11.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.380+0000 7f1b82ffd640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b640678c0 0x7f1b64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.380+0000 7f1b82ffd640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b640678c0 0x7f1b64069d80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0af000 tx=0x7f1b6c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:11.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.384+0000 7f1b7bfff640 1 -- 172.21.15.67:0/1309640817 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1b7c0556d0 con 0x7f1b8409b140 2024-09-19T05:39:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.540+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/1309640817 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b84154050 con 0x7f1b640678c0 2024-09-19T05:39:11.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.560+0000 7f1b7bfff640 1 -- 172.21.15.67:0/1309640817 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247737 (secure 0 0 0) 0x7f1b84154050 con 0x7f1b640678c0 2024-09-19T05:39:11.562 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:11.563 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:39:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b640678c0 msgr2=0x7f1b64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b640678c0 0x7f1b64069d80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0af000 tx=0x7f1b6c0a7000 comp rx=0 tx=0).stop 2024-09-19T05:39:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/1309640817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8409b140 msgr2=0x7f1b840b5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8409b140 0x7f1b840b5bd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c790 tx=0x7f1b7c00cc50 comp rx=0 tx=0).stop 2024-09-19T05:39:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/1309640817 shutdown_connections 2024-09-19T05:39:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8415d290 0x7f1b840b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b640678c0 0x7f1b64069d80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b840c8c40 0x7f1b84153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 --2- 172.21.15.67:0/1309640817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8409b140 0x7f1b840b5bd0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/1309640817 >> 172.21.15.67:0/1309640817 conn(0x7f1b840d22b0 msgr2=0x7f1b8415ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/1309640817 shutdown_connections 2024-09-19T05:39:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.564+0000 7f1b8a1f0640 1 -- 172.21.15.67:0/1309640817 wait complete. 2024-09-19T05:39:11.580 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-19T05:39:11.229277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357252,"kb_used_data":10568,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754617468,"statfs":{"total":773094113280,"available":772728287232,"internally_reserved":0,"allocated":10821632,"data_stored":5663160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.783739"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454618+0000","last_change":"2024-09-19T05:39:06.454618+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454618+0000","last_undegraded":"2024-09-19T05:39:06.454618+0000","last_fullsized":"2024-09-19T05:39:06.454618+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500414+0000","last_change":"2024-09-19T05:39:07.492635+0000","last_active":"2024-09-19T05:39:07.500414+0000","last_peered":"2024-09-19T05:39:07.500414+0000","last_clean":"2024-09-19T05:39:07.500414+0000","last_became_active":"2024-09-19T05:39:07.491437+0000","last_became_peered":"2024-09-19T05:39:07.491437+0000","last_unstale":"2024-09-19T05:39:07.500414+0000","last_undegraded":"2024-09-19T05:39:07.500414+0000","last_fullsized":"2024-09-19T05:39:07.500414+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.625174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459512+0000","last_change":"2024-09-19T05:39:06.459512+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459512+0000","last_undegraded":"2024-09-19T05:39:06.459512+0000","last_fullsized":"2024-09-19T05:39:06.459512+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.463465+0000","last_change":"2024-09-19T05:39:06.463465+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.463465+0000","last_undegraded":"2024-09-19T05:39:06.463465+0000","last_fullsized":"2024-09-19T05:39:06.463465+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457619+0000","last_change":"2024-09-19T05:39:06.457619+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457619+0000","last_undegraded":"2024-09-19T05:39:06.457619+0000","last_fullsized":"2024-09-19T05:39:06.457619+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461078+0000","last_change":"2024-09-19T05:39:06.461078+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461078+0000","last_undegraded":"2024-09-19T05:39:06.461078+0000","last_fullsized":"2024-09-19T05:39:06.461078+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462400+0000","last_change":"2024-09-19T05:39:06.462400+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462400+0000","last_undegraded":"2024-09-19T05:39:06.462400+0000","last_fullsized":"2024-09-19T05:39:06.462400+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.468495+0000","last_change":"2024-09-19T05:39:06.468495+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.468495+0000","last_undegraded":"2024-09-19T05:39:06.468495+0000","last_fullsized":"2024-09-19T05:39:06.468495+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.453651+0000","last_change":"2024-09-19T05:39:06.453651+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.453651+0000","last_undegraded":"2024-09-19T05:39:06.453651+0000","last_fullsized":"2024-09-19T05:39:06.453651+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.523878+0000","last_change":"2024-09-19T05:39:07.521121+0000","last_active":"2024-09-19T05:39:07.523878+0000","last_peered":"2024-09-19T05:39:07.523878+0000","last_clean":"2024-09-19T05:39:07.523878+0000","last_became_active":"2024-09-19T05:39:07.520605+0000","last_became_peered":"2024-09-19T05:39:07.520605+0000","last_unstale":"2024-09-19T05:39:07.523878+0000","last_undegraded":"2024-09-19T05:39:07.523878+0000","last_fullsized":"2024-09-19T05:39:07.523878+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:59.240315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454803+0000","last_change":"2024-09-19T05:39:06.454803+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454803+0000","last_undegraded":"2024-09-19T05:39:06.454803+0000","last_fullsized":"2024-09-19T05:39:06.454803+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500902+0000","last_change":"2024-09-19T05:39:07.498214+0000","last_active":"2024-09-19T05:39:07.500902+0000","last_peered":"2024-09-19T05:39:07.500902+0000","last_clean":"2024-09-19T05:39:07.500902+0000","last_became_active":"2024-09-19T05:39:07.497502+0000","last_became_peered":"2024-09-19T05:39:07.497502+0000","last_unstale":"2024-09-19T05:39:07.500902+0000","last_undegraded":"2024-09-19T05:39:07.500902+0000","last_fullsized":"2024-09-19T05:39:07.500902+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:32.098475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462692+0000","last_change":"2024-09-19T05:39:06.462692+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462692+0000","last_undegraded":"2024-09-19T05:39:06.462692+0000","last_fullsized":"2024-09-19T05:39:06.462692+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460045+0000","last_change":"2024-09-19T05:39:06.460045+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460045+0000","last_undegraded":"2024-09-19T05:39:06.460045+0000","last_fullsized":"2024-09-19T05:39:06.460045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461439+0000","last_change":"2024-09-19T05:39:06.461439+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461439+0000","last_undegraded":"2024-09-19T05:39:06.461439+0000","last_fullsized":"2024-09-19T05:39:06.461439+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.477616+0000","last_change":"2024-09-19T05:39:06.477616+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.477616+0000","last_undegraded":"2024-09-19T05:39:06.477616+0000","last_fullsized":"2024-09-19T05:39:06.477616+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459759+0000","last_change":"2024-09-19T05:39:06.459759+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459759+0000","last_undegraded":"2024-09-19T05:39:06.459759+0000","last_fullsized":"2024-09-19T05:39:06.459759+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459015+0000","last_change":"2024-09-19T05:39:06.459015+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459015+0000","last_undegraded":"2024-09-19T05:39:06.459015+0000","last_fullsized":"2024-09-19T05:39:06.459015+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.451195+0000","last_change":"2024-09-19T05:39:06.451195+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.451195+0000","last_undegraded":"2024-09-19T05:39:06.451195+0000","last_fullsized":"2024-09-19T05:39:06.451195+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462888+0000","last_change":"2024-09-19T05:39:06.462888+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462888+0000","last_undegraded":"2024-09-19T05:39:06.462888+0000","last_fullsized":"2024-09-19T05:39:06.462888+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455269+0000","last_change":"2024-09-19T05:39:06.455269+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455269+0000","last_undegraded":"2024-09-19T05:39:06.455269+0000","last_fullsized":"2024-09-19T05:39:06.455269+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458326+0000","last_change":"2024-09-19T05:39:06.458326+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458326+0000","last_undegraded":"2024-09-19T05:39:06.458326+0000","last_fullsized":"2024-09-19T05:39:06.458326+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461778+0000","last_change":"2024-09-19T05:39:06.461778+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461778+0000","last_undegraded":"2024-09-19T05:39:06.461778+0000","last_fullsized":"2024-09-19T05:39:06.461778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455309+0000","last_change":"2024-09-19T05:39:06.455309+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455309+0000","last_undegraded":"2024-09-19T05:39:06.455309+0000","last_fullsized":"2024-09-19T05:39:06.455309+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.515901+0000","last_change":"2024-09-19T05:39:07.513926+0000","last_active":"2024-09-19T05:39:07.515901+0000","last_peered":"2024-09-19T05:39:07.515901+0000","last_clean":"2024-09-19T05:39:07.515901+0000","last_became_active":"2024-09-19T05:39:07.513314+0000","last_became_peered":"2024-09-19T05:39:07.513314+0000","last_unstale":"2024-09-19T05:39:07.515901+0000","last_undegraded":"2024-09-19T05:39:07.515901+0000","last_fullsized":"2024-09-19T05:39:07.515901+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:07.490684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457238+0000","last_change":"2024-09-19T05:39:06.457238+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457238+0000","last_undegraded":"2024-09-19T05:39:06.457238+0000","last_fullsized":"2024-09-19T05:39:06.457238+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.512688+0000","last_change":"2024-09-19T05:39:07.511608+0000","last_active":"2024-09-19T05:39:07.512688+0000","last_peered":"2024-09-19T05:39:07.512688+0000","last_clean":"2024-09-19T05:39:07.512688+0000","last_became_active":"2024-09-19T05:39:07.511317+0000","last_became_peered":"2024-09-19T05:39:07.511317+0000","last_unstale":"2024-09-19T05:39:07.512688+0000","last_undegraded":"2024-09-19T05:39:07.512688+0000","last_fullsized":"2024-09-19T05:39:07.512688+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:23.656844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462308+0000","last_change":"2024-09-19T05:39:06.462308+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462308+0000","last_undegraded":"2024-09-19T05:39:06.462308+0000","last_fullsized":"2024-09-19T05:39:06.462308+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461436+0000","last_change":"2024-09-19T05:39:06.461436+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461436+0000","last_undegraded":"2024-09-19T05:39:06.461436+0000","last_fullsized":"2024-09-19T05:39:06.461436+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.450390+0000","last_change":"2024-09-19T05:39:06.450390+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.450390+0000","last_undegraded":"2024-09-19T05:39:06.450390+0000","last_fullsized":"2024-09-19T05:39:06.450390+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.516378+0000","last_change":"2024-09-19T05:39:07.515306+0000","last_active":"2024-09-19T05:39:07.516378+0000","last_peered":"2024-09-19T05:39:07.516378+0000","last_clean":"2024-09-19T05:39:07.516378+0000","last_became_active":"2024-09-19T05:39:07.514836+0000","last_became_peered":"2024-09-19T05:39:07.514836+0000","last_unstale":"2024-09-19T05:39:07.516378+0000","last_undegraded":"2024-09-19T05:39:07.516378+0000","last_fullsized":"2024-09-19T05:39:07.516378+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:24.860000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.476732+0000","last_change":"2024-09-19T05:39:06.476732+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.476732+0000","last_undegraded":"2024-09-19T05:39:06.476732+0000","last_fullsized":"2024-09-19T05:39:06.476732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459889+0000","last_change":"2024-09-19T05:39:06.459889+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459889+0000","last_undegraded":"2024-09-19T05:39:06.459889+0000","last_fullsized":"2024-09-19T05:39:06.459889+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.492648+0000","last_change":"2024-09-19T05:39:06.485427+0000","last_active":"2024-09-19T05:39:06.492648+0000","last_peered":"2024-09-19T05:39:06.492648+0000","last_clean":"2024-09-19T05:39:06.492648+0000","last_became_active":"2024-09-19T05:39:06.484690+0000","last_became_peered":"2024-09-19T05:39:06.484690+0000","last_unstale":"2024-09-19T05:39:06.492648+0000","last_undegraded":"2024-09-19T05:39:06.492648+0000","last_fullsized":"2024-09-19T05:39:06.492648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:18.254825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.463477+0000","last_change":"2024-09-19T05:39:06.463477+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.463477+0000","last_undegraded":"2024-09-19T05:39:06.463477+0000","last_fullsized":"2024-09-19T05:39:06.463477+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.487248+0000","last_change":"2024-09-19T05:39:06.480222+0000","last_active":"2024-09-19T05:39:06.487248+0000","last_peered":"2024-09-19T05:39:06.487248+0000","last_clean":"2024-09-19T05:39:06.487248+0000","last_became_active":"2024-09-19T05:39:06.478165+0000","last_became_peered":"2024-09-19T05:39:06.478165+0000","last_unstale":"2024-09-19T05:39:06.487248+0000","last_undegraded":"2024-09-19T05:39:06.487248+0000","last_fullsized":"2024-09-19T05:39:06.487248+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:13.250664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461662+0000","last_change":"2024-09-19T05:39:06.461662+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461662+0000","last_undegraded":"2024-09-19T05:39:06.461662+0000","last_fullsized":"2024-09-19T05:39:06.461662+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496368+0000","last_change":"2024-09-19T05:39:06.490107+0000","last_active":"2024-09-19T05:39:06.496368+0000","last_peered":"2024-09-19T05:39:06.496368+0000","last_clean":"2024-09-19T05:39:06.496368+0000","last_became_active":"2024-09-19T05:39:06.489368+0000","last_became_peered":"2024-09-19T05:39:06.489368+0000","last_unstale":"2024-09-19T05:39:06.496368+0000","last_undegraded":"2024-09-19T05:39:06.496368+0000","last_fullsized":"2024-09-19T05:39:06.496368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:15.681556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459172+0000","last_change":"2024-09-19T05:39:06.459172+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459172+0000","last_undegraded":"2024-09-19T05:39:06.459172+0000","last_fullsized":"2024-09-19T05:39:06.459172+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482834+0000","last_change":"2024-09-19T05:39:06.476967+0000","last_active":"2024-09-19T05:39:06.482834+0000","last_peered":"2024-09-19T05:39:06.482834+0000","last_clean":"2024-09-19T05:39:06.482834+0000","last_became_active":"2024-09-19T05:39:06.476220+0000","last_became_peered":"2024-09-19T05:39:06.476220+0000","last_unstale":"2024-09-19T05:39:06.482834+0000","last_undegraded":"2024-09-19T05:39:06.482834+0000","last_fullsized":"2024-09-19T05:39:06.482834+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:16.970848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.465294+0000","last_change":"2024-09-19T05:39:06.465294+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.465294+0000","last_undegraded":"2024-09-19T05:39:06.465294+0000","last_fullsized":"2024-09-19T05:39:06.465294+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.480520+0000","last_change":"2024-09-19T05:39:06.477568+0000","last_active":"2024-09-19T05:39:06.480520+0000","last_peered":"2024-09-19T05:39:06.480520+0000","last_clean":"2024-09-19T05:39:06.480520+0000","last_became_active":"2024-09-19T05:39:06.475121+0000","last_became_peered":"2024-09-19T05:39:06.475121+0000","last_unstale":"2024-09-19T05:39:06.480520+0000","last_undegraded":"2024-09-19T05:39:06.480520+0000","last_fullsized":"2024-09-19T05:39:06.480520+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:20.439330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462796+0000","last_change":"2024-09-19T05:39:06.462796+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462796+0000","last_undegraded":"2024-09-19T05:39:06.462796+0000","last_fullsized":"2024-09-19T05:39:06.462796+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.471647+0000","last_change":"2024-09-19T05:39:06.470618+0000","last_active":"2024-09-19T05:39:06.471647+0000","last_peered":"2024-09-19T05:39:06.471647+0000","last_clean":"2024-09-19T05:39:06.471647+0000","last_became_active":"2024-09-19T05:39:06.470223+0000","last_became_peered":"2024-09-19T05:39:06.470223+0000","last_unstale":"2024-09-19T05:39:06.471647+0000","last_undegraded":"2024-09-19T05:39:06.471647+0000","last_fullsized":"2024-09-19T05:39:06.471647+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.663250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460540+0000","last_change":"2024-09-19T05:39:06.460540+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460540+0000","last_undegraded":"2024-09-19T05:39:06.460540+0000","last_fullsized":"2024-09-19T05:39:06.460540+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.473973+0000","last_change":"2024-09-19T05:39:06.473491+0000","last_active":"2024-09-19T05:39:06.473973+0000","last_peered":"2024-09-19T05:39:06.473973+0000","last_clean":"2024-09-19T05:39:06.473973+0000","last_became_active":"2024-09-19T05:39:06.473154+0000","last_became_peered":"2024-09-19T05:39:06.473154+0000","last_unstale":"2024-09-19T05:39:06.473973+0000","last_undegraded":"2024-09-19T05:39:06.473973+0000","last_fullsized":"2024-09-19T05:39:06.473973+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459002+0000","last_change":"2024-09-19T05:39:06.459002+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459002+0000","last_undegraded":"2024-09-19T05:39:06.459002+0000","last_fullsized":"2024-09-19T05:39:06.459002+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496530+0000","last_change":"2024-09-19T05:39:06.491620+0000","last_active":"2024-09-19T05:39:06.496530+0000","last_peered":"2024-09-19T05:39:06.496530+0000","last_clean":"2024-09-19T05:39:06.496530+0000","last_became_active":"2024-09-19T05:39:06.491275+0000","last_became_peered":"2024-09-19T05:39:06.491275+0000","last_unstale":"2024-09-19T05:39:06.496530+0000","last_undegraded":"2024-09-19T05:39:06.496530+0000","last_fullsized":"2024-09-19T05:39:06.496530+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:14.227757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.450203+0000","last_change":"2024-09-19T05:39:06.450203+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.450203+0000","last_undegraded":"2024-09-19T05:39:06.450203+0000","last_fullsized":"2024-09-19T05:39:06.450203+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485850+0000","last_change":"2024-09-19T05:39:06.484638+0000","last_active":"2024-09-19T05:39:07.485850+0000","last_peered":"2024-09-19T05:39:07.485850+0000","last_clean":"2024-09-19T05:39:07.485850+0000","last_became_active":"2024-09-19T05:39:06.483824+0000","last_became_peered":"2024-09-19T05:39:06.483824+0000","last_unstale":"2024-09-19T05:39:07.485850+0000","last_undegraded":"2024-09-19T05:39:07.485850+0000","last_fullsized":"2024-09-19T05:39:07.485850+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:44:31.297046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.464045+0000","last_change":"2024-09-19T05:39:06.464045+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.464045+0000","last_undegraded":"2024-09-19T05:39:06.464045+0000","last_fullsized":"2024-09-19T05:39:06.464045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.472922+0000","last_change":"2024-09-19T05:39:06.472058+0000","last_active":"2024-09-19T05:39:06.472922+0000","last_peered":"2024-09-19T05:39:06.472922+0000","last_clean":"2024-09-19T05:39:06.472922+0000","last_became_active":"2024-09-19T05:39:06.471408+0000","last_became_peered":"2024-09-19T05:39:06.471408+0000","last_unstale":"2024-09-19T05:39:06.472922+0000","last_undegraded":"2024-09-19T05:39:06.472922+0000","last_fullsized":"2024-09-19T05:39:06.472922+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454843+0000","last_change":"2024-09-19T05:39:06.454843+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454843+0000","last_undegraded":"2024-09-19T05:39:06.454843+0000","last_fullsized":"2024-09-19T05:39:06.454843+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.462773+0000","last_change":"2024-09-19T05:39:06.459521+0000","last_active":"2024-09-19T05:39:06.462773+0000","last_peered":"2024-09-19T05:39:06.462773+0000","last_clean":"2024-09-19T05:39:06.462773+0000","last_became_active":"2024-09-19T05:39:06.458765+0000","last_became_peered":"2024-09-19T05:39:06.458765+0000","last_unstale":"2024-09-19T05:39:06.462773+0000","last_undegraded":"2024-09-19T05:39:06.462773+0000","last_fullsized":"2024-09-19T05:39:06.462773+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:54.147667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461370+0000","last_change":"2024-09-19T05:39:06.461370+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461370+0000","last_undegraded":"2024-09-19T05:39:06.461370+0000","last_fullsized":"2024-09-19T05:39:06.461370+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482148+0000","last_change":"2024-09-19T05:39:06.477718+0000","last_active":"2024-09-19T05:39:06.482148+0000","last_peered":"2024-09-19T05:39:06.482148+0000","last_clean":"2024-09-19T05:39:06.482148+0000","last_became_active":"2024-09-19T05:39:06.477354+0000","last_became_peered":"2024-09-19T05:39:06.477354+0000","last_unstale":"2024-09-19T05:39:06.482148+0000","last_undegraded":"2024-09-19T05:39:06.482148+0000","last_fullsized":"2024-09-19T05:39:06.482148+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460580+0000","last_change":"2024-09-19T05:39:06.460580+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460580+0000","last_undegraded":"2024-09-19T05:39:06.460580+0000","last_fullsized":"2024-09-19T05:39:06.460580+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496529+0000","last_change":"2024-09-19T05:39:06.491796+0000","last_active":"2024-09-19T05:39:06.496529+0000","last_peered":"2024-09-19T05:39:06.496529+0000","last_clean":"2024-09-19T05:39:06.496529+0000","last_became_active":"2024-09-19T05:39:06.490945+0000","last_became_peered":"2024-09-19T05:39:06.490945+0000","last_unstale":"2024-09-19T05:39:06.496529+0000","last_undegraded":"2024-09-19T05:39:06.496529+0000","last_fullsized":"2024-09-19T05:39:06.496529+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:12.345025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.452188+0000","last_change":"2024-09-19T05:39:06.452188+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.452188+0000","last_undegraded":"2024-09-19T05:39:06.452188+0000","last_fullsized":"2024-09-19T05:39:06.452188+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.484071+0000","last_change":"2024-09-19T05:39:06.482148+0000","last_active":"2024-09-19T05:39:06.484071+0000","last_peered":"2024-09-19T05:39:06.484071+0000","last_clean":"2024-09-19T05:39:06.484071+0000","last_became_active":"2024-09-19T05:39:06.477485+0000","last_became_peered":"2024-09-19T05:39:06.477485+0000","last_unstale":"2024-09-19T05:39:06.484071+0000","last_undegraded":"2024-09-19T05:39:06.484071+0000","last_fullsized":"2024-09-19T05:39:06.484071+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:23.889902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.523778+0000","last_change":"2024-09-19T05:39:07.520981+0000","last_active":"2024-09-19T05:39:07.523778+0000","last_peered":"2024-09-19T05:39:07.523778+0000","last_clean":"2024-09-19T05:39:07.523778+0000","last_became_active":"2024-09-19T05:39:07.520621+0000","last_became_peered":"2024-09-19T05:39:07.520621+0000","last_unstale":"2024-09-19T05:39:07.523778+0000","last_undegraded":"2024-09-19T05:39:07.523778+0000","last_fullsized":"2024-09-19T05:39:07.523778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:18.770956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.485776+0000","last_change":"2024-09-19T05:39:06.484372+0000","last_active":"2024-09-19T05:39:06.485776+0000","last_peered":"2024-09-19T05:39:06.485776+0000","last_clean":"2024-09-19T05:39:06.485776+0000","last_became_active":"2024-09-19T05:39:06.484002+0000","last_became_peered":"2024-09-19T05:39:06.484002+0000","last_unstale":"2024-09-19T05:39:06.485776+0000","last_undegraded":"2024-09-19T05:39:06.485776+0000","last_fullsized":"2024-09-19T05:39:06.485776+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:03.627009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.501139+0000","last_change":"2024-09-19T05:39:07.492388+0000","last_active":"2024-09-19T05:39:07.501139+0000","last_peered":"2024-09-19T05:39:07.501139+0000","last_clean":"2024-09-19T05:39:07.501139+0000","last_became_active":"2024-09-19T05:39:07.489450+0000","last_became_peered":"2024-09-19T05:39:07.489450+0000","last_unstale":"2024-09-19T05:39:07.501139+0000","last_undegraded":"2024-09-19T05:39:07.501139+0000","last_fullsized":"2024-09-19T05:39:07.501139+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:27.889589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.471472+0000","last_change":"2024-09-19T05:39:06.470272+0000","last_active":"2024-09-19T05:39:06.471472+0000","last_peered":"2024-09-19T05:39:06.471472+0000","last_clean":"2024-09-19T05:39:06.471472+0000","last_became_active":"2024-09-19T05:39:06.469862+0000","last_became_peered":"2024-09-19T05:39:06.469862+0000","last_unstale":"2024-09-19T05:39:06.471472+0000","last_undegraded":"2024-09-19T05:39:06.471472+0000","last_fullsized":"2024-09-19T05:39:06.471472+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.130680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459328+0000","last_change":"2024-09-19T05:39:06.459328+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459328+0000","last_undegraded":"2024-09-19T05:39:06.459328+0000","last_fullsized":"2024-09-19T05:39:06.459328+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.494277+0000","last_change":"2024-09-19T05:39:06.492000+0000","last_active":"2024-09-19T05:39:06.494277+0000","last_peered":"2024-09-19T05:39:06.494277+0000","last_clean":"2024-09-19T05:39:06.494277+0000","last_became_active":"2024-09-19T05:39:06.491277+0000","last_became_peered":"2024-09-19T05:39:06.491277+0000","last_unstale":"2024-09-19T05:39:06.494277+0000","last_undegraded":"2024-09-19T05:39:06.494277+0000","last_fullsized":"2024-09-19T05:39:06.494277+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:31.359640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460309+0000","last_change":"2024-09-19T05:39:06.460309+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460309+0000","last_undegraded":"2024-09-19T05:39:06.460309+0000","last_fullsized":"2024-09-19T05:39:06.460309+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496916+0000","last_change":"2024-09-19T05:39:06.495628+0000","last_active":"2024-09-19T05:39:06.496916+0000","last_peered":"2024-09-19T05:39:06.496916+0000","last_clean":"2024-09-19T05:39:06.496916+0000","last_became_active":"2024-09-19T05:39:06.491383+0000","last_became_peered":"2024-09-19T05:39:06.491383+0000","last_unstale":"2024-09-19T05:39:06.496916+0000","last_undegraded":"2024-09-19T05:39:06.496916+0000","last_fullsized":"2024-09-19T05:39:06.496916+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.451129+0000","last_change":"2024-09-19T05:39:06.451129+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.451129+0000","last_undegraded":"2024-09-19T05:39:06.451129+0000","last_fullsized":"2024-09-19T05:39:06.451129+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.490115+0000","last_change":"2024-09-19T05:39:06.488703+0000","last_active":"2024-09-19T05:39:06.490115+0000","last_peered":"2024-09-19T05:39:06.490115+0000","last_clean":"2024-09-19T05:39:06.490115+0000","last_became_active":"2024-09-19T05:39:06.487165+0000","last_became_peered":"2024-09-19T05:39:06.487165+0000","last_unstale":"2024-09-19T05:39:06.490115+0000","last_undegraded":"2024-09-19T05:39:06.490115+0000","last_fullsized":"2024-09-19T05:39:06.490115+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.948878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456505+0000","last_change":"2024-09-19T05:39:06.456505+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456505+0000","last_undegraded":"2024-09-19T05:39:06.456505+0000","last_fullsized":"2024-09-19T05:39:06.456505+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.520360+0000","last_change":"2024-09-19T05:39:06.487040+0000","last_active":"2024-09-19T05:39:07.520360+0000","last_peered":"2024-09-19T05:39:07.520360+0000","last_clean":"2024-09-19T05:39:07.520360+0000","last_became_active":"2024-09-19T05:39:06.485399+0000","last_became_peered":"2024-09-19T05:39:06.485399+0000","last_unstale":"2024-09-19T05:39:07.520360+0000","last_undegraded":"2024-09-19T05:39:07.520360+0000","last_fullsized":"2024-09-19T05:39:07.520360+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.642703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500486+0000","last_change":"2024-09-19T05:39:07.493726+0000","last_active":"2024-09-19T05:39:07.500486+0000","last_peered":"2024-09-19T05:39:07.500486+0000","last_clean":"2024-09-19T05:39:07.500486+0000","last_became_active":"2024-09-19T05:39:07.492964+0000","last_became_peered":"2024-09-19T05:39:07.492964+0000","last_unstale":"2024-09-19T05:39:07.500486+0000","last_undegraded":"2024-09-19T05:39:07.500486+0000","last_fullsized":"2024-09-19T05:39:07.500486+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:02.364388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.477119+0000","last_change":"2024-09-19T05:39:06.474748+0000","last_active":"2024-09-19T05:39:07.477119+0000","last_peered":"2024-09-19T05:39:07.477119+0000","last_clean":"2024-09-19T05:39:07.477119+0000","last_became_active":"2024-09-19T05:39:06.474265+0000","last_became_peered":"2024-09-19T05:39:06.474265+0000","last_unstale":"2024-09-19T05:39:07.477119+0000","last_undegraded":"2024-09-19T05:39:07.477119+0000","last_fullsized":"2024-09-19T05:39:07.477119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:08.194710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.519847+0000","last_change":"2024-09-19T05:39:07.510540+0000","last_active":"2024-09-19T05:39:07.519847+0000","last_peered":"2024-09-19T05:39:07.519847+0000","last_clean":"2024-09-19T05:39:07.519847+0000","last_became_active":"2024-09-19T05:39:07.509867+0000","last_became_peered":"2024-09-19T05:39:07.509867+0000","last_unstale":"2024-09-19T05:39:07.519847+0000","last_undegraded":"2024-09-19T05:39:07.519847+0000","last_fullsized":"2024-09-19T05:39:07.519847+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:06.006975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485238+0000","last_change":"2024-09-19T05:39:06.486335+0000","last_active":"2024-09-19T05:39:07.485238+0000","last_peered":"2024-09-19T05:39:07.485238+0000","last_clean":"2024-09-19T05:39:07.485238+0000","last_became_active":"2024-09-19T05:39:06.483059+0000","last_became_peered":"2024-09-19T05:39:06.483059+0000","last_unstale":"2024-09-19T05:39:07.485238+0000","last_undegraded":"2024-09-19T05:39:07.485238+0000","last_fullsized":"2024-09-19T05:39:07.485238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:33.395321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458614+0000","last_change":"2024-09-19T05:39:06.458614+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458614+0000","last_undegraded":"2024-09-19T05:39:06.458614+0000","last_fullsized":"2024-09-19T05:39:06.458614+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.476370+0000","last_change":"2024-09-19T05:39:06.488093+0000","last_active":"2024-09-19T05:39:07.476370+0000","last_peered":"2024-09-19T05:39:07.476370+0000","last_clean":"2024-09-19T05:39:07.476370+0000","last_became_active":"2024-09-19T05:39:06.487576+0000","last_became_peered":"2024-09-19T05:39:06.487576+0000","last_unstale":"2024-09-19T05:39:07.476370+0000","last_undegraded":"2024-09-19T05:39:07.476370+0000","last_fullsized":"2024-09-19T05:39:07.476370+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:03.461184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458849+0000","last_change":"2024-09-19T05:39:06.458849+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458849+0000","last_undegraded":"2024-09-19T05:39:06.458849+0000","last_fullsized":"2024-09-19T05:39:06.458849+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496980+0000","last_change":"2024-09-19T05:39:06.495673+0000","last_active":"2024-09-19T05:39:06.496980+0000","last_peered":"2024-09-19T05:39:06.496980+0000","last_clean":"2024-09-19T05:39:06.496980+0000","last_became_active":"2024-09-19T05:39:06.489071+0000","last_became_peered":"2024-09-19T05:39:06.489071+0000","last_unstale":"2024-09-19T05:39:06.496980+0000","last_undegraded":"2024-09-19T05:39:06.496980+0000","last_fullsized":"2024-09-19T05:39:06.496980+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455916+0000","last_change":"2024-09-19T05:39:06.455916+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455916+0000","last_undegraded":"2024-09-19T05:39:06.455916+0000","last_fullsized":"2024-09-19T05:39:06.455916+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.478630+0000","last_change":"2024-09-19T05:39:06.476552+0000","last_active":"2024-09-19T05:39:06.478630+0000","last_peered":"2024-09-19T05:39:06.478630+0000","last_clean":"2024-09-19T05:39:06.478630+0000","last_became_active":"2024-09-19T05:39:06.475840+0000","last_became_peered":"2024-09-19T05:39:06.475840+0000","last_unstale":"2024-09-19T05:39:06.478630+0000","last_undegraded":"2024-09-19T05:39:06.478630+0000","last_fullsized":"2024-09-19T05:39:06.478630+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:25.266383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456668+0000","last_change":"2024-09-19T05:39:06.456668+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456668+0000","last_undegraded":"2024-09-19T05:39:06.456668+0000","last_fullsized":"2024-09-19T05:39:06.456668+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.462055+0000","last_change":"2024-09-19T05:39:06.459439+0000","last_active":"2024-09-19T05:39:06.462055+0000","last_peered":"2024-09-19T05:39:06.462055+0000","last_clean":"2024-09-19T05:39:06.462055+0000","last_became_active":"2024-09-19T05:39:06.458677+0000","last_became_peered":"2024-09-19T05:39:06.458677+0000","last_unstale":"2024-09-19T05:39:06.462055+0000","last_undegraded":"2024-09-19T05:39:06.462055+0000","last_fullsized":"2024-09-19T05:39:06.462055+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.829966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500894+0000","last_change":"2024-09-19T05:39:07.497197+0000","last_active":"2024-09-19T05:39:07.500894+0000","last_peered":"2024-09-19T05:39:07.500894+0000","last_clean":"2024-09-19T05:39:07.500894+0000","last_became_active":"2024-09-19T05:39:07.496238+0000","last_became_peered":"2024-09-19T05:39:07.496238+0000","last_unstale":"2024-09-19T05:39:07.500894+0000","last_undegraded":"2024-09-19T05:39:07.500894+0000","last_fullsized":"2024-09-19T05:39:07.500894+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:48.100081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482559+0000","last_change":"2024-09-19T05:39:06.467833+0000","last_active":"2024-09-19T05:39:06.482559+0000","last_peered":"2024-09-19T05:39:06.482559+0000","last_clean":"2024-09-19T05:39:06.482559+0000","last_became_active":"2024-09-19T05:39:06.466980+0000","last_became_peered":"2024-09-19T05:39:06.466980+0000","last_unstale":"2024-09-19T05:39:06.482559+0000","last_undegraded":"2024-09-19T05:39:06.482559+0000","last_fullsized":"2024-09-19T05:39:06.482559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.663250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.508476+0000","last_change":"2024-09-19T05:39:07.506052+0000","last_active":"2024-09-19T05:39:07.508476+0000","last_peered":"2024-09-19T05:39:07.508476+0000","last_clean":"2024-09-19T05:39:07.508476+0000","last_became_active":"2024-09-19T05:39:07.505690+0000","last_became_peered":"2024-09-19T05:39:07.505690+0000","last_unstale":"2024-09-19T05:39:07.508476+0000","last_undegraded":"2024-09-19T05:39:07.508476+0000","last_fullsized":"2024-09-19T05:39:07.508476+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:05.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482114+0000","last_change":"2024-09-19T05:39:06.477685+0000","last_active":"2024-09-19T05:39:06.482114+0000","last_peered":"2024-09-19T05:39:06.482114+0000","last_clean":"2024-09-19T05:39:06.482114+0000","last_became_active":"2024-09-19T05:39:06.477270+0000","last_became_peered":"2024-09-19T05:39:06.477270+0000","last_unstale":"2024-09-19T05:39:06.482114+0000","last_undegraded":"2024-09-19T05:39:06.482114+0000","last_fullsized":"2024-09-19T05:39:06.482114+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454595+0000","last_change":"2024-09-19T05:39:06.454595+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454595+0000","last_undegraded":"2024-09-19T05:39:06.454595+0000","last_fullsized":"2024-09-19T05:39:06.454595+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485346+0000","last_change":"2024-09-19T05:39:06.487038+0000","last_active":"2024-09-19T05:39:07.485346+0000","last_peered":"2024-09-19T05:39:07.485346+0000","last_clean":"2024-09-19T05:39:07.485346+0000","last_became_active":"2024-09-19T05:39:06.486191+0000","last_became_peered":"2024-09-19T05:39:06.486191+0000","last_unstale":"2024-09-19T05:39:07.485346+0000","last_undegraded":"2024-09-19T05:39:07.485346+0000","last_fullsized":"2024-09-19T05:39:07.485346+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:57.630895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457046+0000","last_change":"2024-09-19T05:39:06.457046+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457046+0000","last_undegraded":"2024-09-19T05:39:06.457046+0000","last_fullsized":"2024-09-19T05:39:06.457046+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482851+0000","last_change":"2024-09-19T05:39:06.476838+0000","last_active":"2024-09-19T05:39:06.482851+0000","last_peered":"2024-09-19T05:39:06.482851+0000","last_clean":"2024-09-19T05:39:06.482851+0000","last_became_active":"2024-09-19T05:39:06.476128+0000","last_became_peered":"2024-09-19T05:39:06.476128+0000","last_unstale":"2024-09-19T05:39:06.482851+0000","last_undegraded":"2024-09-19T05:39:06.482851+0000","last_fullsized":"2024-09-19T05:39:06.482851+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:03.627009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456040+0000","last_change":"2024-09-19T05:39:06.456040+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456040+0000","last_undegraded":"2024-09-19T05:39:06.456040+0000","last_fullsized":"2024-09-19T05:39:06.456040+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496502+0000","last_change":"2024-09-19T05:39:06.489874+0000","last_active":"2024-09-19T05:39:06.496502+0000","last_peered":"2024-09-19T05:39:06.496502+0000","last_clean":"2024-09-19T05:39:06.496502+0000","last_became_active":"2024-09-19T05:39:06.489133+0000","last_became_peered":"2024-09-19T05:39:06.489133+0000","last_unstale":"2024-09-19T05:39:06.496502+0000","last_undegraded":"2024-09-19T05:39:06.496502+0000","last_fullsized":"2024-09-19T05:39:06.496502+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:04.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462879+0000","last_change":"2024-09-19T05:39:06.462879+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462879+0000","last_undegraded":"2024-09-19T05:39:06.462879+0000","last_fullsized":"2024-09-19T05:39:06.462879+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.488099+0000","last_change":"2024-09-19T05:39:06.486153+0000","last_active":"2024-09-19T05:39:06.488099+0000","last_peered":"2024-09-19T05:39:06.488099+0000","last_clean":"2024-09-19T05:39:06.488099+0000","last_became_active":"2024-09-19T05:39:06.485868+0000","last_became_peered":"2024-09-19T05:39:06.485868+0000","last_unstale":"2024-09-19T05:39:06.488099+0000","last_undegraded":"2024-09-19T05:39:06.488099+0000","last_fullsized":"2024-09-19T05:39:06.488099+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:16.970848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":308,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.473730+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:39:06.473730+0000","last_peered":"2024-09-19T05:39:06.473730+0000","last_clean":"2024-09-19T05:39:06.473730+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:39:06.473730+0000","last_undegraded":"2024-09-19T05:39:06.473730+0000","last_fullsized":"2024-09-19T05:39:06.473730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542219,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1798144,"data_stored":1150671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542219,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40688,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331152,"statfs":{"total":96636764160,"available":96595099648,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542221,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44844,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326996,"statfs":{"total":96636764160,"available":96590843904,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50416,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321424,"statfs":{"total":96636764160,"available":96585138176,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46256,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325584,"statfs":{"total":96636764160,"available":96589398016,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40688,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331152,"statfs":{"total":96636764160,"available":96595099648,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542219,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1798144,"data_stored":1150671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:39:11.585 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:39:11.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.744+0000 7f3800c8f640 1 Processor -- start 2024-09-19T05:39:11.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f3800c8f640 1 -- start start 2024-09-19T05:39:11.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f3800c8f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37fc15e330 0x7f37fc071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f3800c8f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc0b4bc0 0x7f37fc0724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f3800c8f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37fc0b4420 con 0x7f37fc0b2fd0 2024-09-19T05:39:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f3800c8f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f37fc0acfb0 con 0x7f37fc15e330 2024-09-19T05:39:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f3800c8f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f37fc0b3ef0 con 0x7f37fc0b4bc0 2024-09-19T05:39:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f37fad9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc0b4bc0 0x7f37fc0724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f37fa59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37fc15e330 0x7f37fc071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f37fad9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc0b4bc0 0x7f37fc0724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:43088/0 (socket says 172.21.15.67:43088) 2024-09-19T05:39:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f37fad9d640 1 -- 172.21.15.67:0/1678013559 learned_addr learned my addr 172.21.15.67:0/1678013559 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:11.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f37fa59c640 1 -- 172.21.15.67:0/1678013559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc0b4bc0 msgr2=0x7f37fc0724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:11.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f37fa59c640 1 --2- 172.21.15.67:0/1678013559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc0b4bc0 0x7f37fc0724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f37fa59c640 1 -- 172.21.15.67:0/1678013559 >> v1:172.21.15.97:6789/0 conn(0x7f37fc0b2fd0 legacy=0x7f37fc161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.748+0000 7f37fa59c640 1 -- 172.21.15.67:0/1678013559 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc0b4140 con 0x7f37fc15e330 2024-09-19T05:39:11.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f37fa59c640 1 --2- 172.21.15.67:0/1678013559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc15e330 0x7f37fc071fa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009d90 tx=0x7f37f401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48734de4f232041c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f37f959a640 1 -- 172.21.15.67:0/1678013559 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40b2070 con 0x7f37fc15e330 2024-09-19T05:39:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f37f959a640 1 -- 172.21.15.67:0/1678013559 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f40a5920 con 0x7f37fc15e330 2024-09-19T05:39:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f37f959a640 1 -- 172.21.15.67:0/1678013559 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40a5cf0 con 0x7f37fc15e330 2024-09-19T05:39:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 -- 172.21.15.67:0/1678013559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc15e330 msgr2=0x7f37fc071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 --2- 172.21.15.67:0/1678013559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc15e330 0x7f37fc071fa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009d90 tx=0x7f37f401c940 comp rx=0 tx=0).stop 2024-09-19T05:39:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 -- 172.21.15.67:0/1678013559 shutdown_connections 2024-09-19T05:39:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 --2- 172.21.15.67:0/1678013559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc0b4bc0 0x7f37fc0724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 --2- 172.21.15.67:0/1678013559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc15e330 0x7f37fc071fa0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 -- 172.21.15.67:0/1678013559 >> 172.21.15.67:0/1678013559 conn(0x7f37fc0d0080 msgr2=0x7f37fc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 -- 172.21.15.67:0/1678013559 shutdown_connections 2024-09-19T05:39:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 -- 172.21.15.67:0/1678013559 wait complete. 2024-09-19T05:39:11.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 Processor -- start 2024-09-19T05:39:11.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 -- start start 2024-09-19T05:39:11.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b4bc0 0x7f37fc15f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc15e330 0x7f37fc154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37fc15e920 0x7f37fc14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc06f880 con 0x7f37fc15e920 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc06f700 con 0x7f37fc0b4bc0 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f3800c8f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f37fc0cfcc0 con 0x7f37fc15e330 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f37fad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37fc15e920 0x7f37fc14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f37fad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37fc15e920 0x7f37fc14d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56604/0 (socket says 172.21.15.67:56604) 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.752+0000 7f37fad9d640 1 -- 172.21.15.67:0/729663787 learned_addr learned my addr 172.21.15.67:0/729663787 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37f9d9b640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc15e330 0x7f37fc154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37fa59c640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b4bc0 0x7f37fc15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37fad9d640 1 -- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc15e330 msgr2=0x7f37fc154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37fad9d640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc15e330 0x7f37fc154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37fad9d640 1 -- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b4bc0 msgr2=0x7f37fc15f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37fad9d640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b4bc0 0x7f37fc15f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37fad9d640 1 -- 172.21.15.67:0/729663787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc160a70 con 0x7f37fc15e920 2024-09-19T05:39:11.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37fad9d640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37fc15e920 0x7f37fc14d940 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00e880 tx=0x7f37ec00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:11.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37f2ffd640 1 -- 172.21.15.67:0/729663787 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec017070 con 0x7f37fc15e920 2024-09-19T05:39:11.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37f2ffd640 1 -- 172.21.15.67:0/729663787 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec00c940 con 0x7f37fc15e920 2024-09-19T05:39:11.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f3800c8f640 1 -- 172.21.15.67:0/729663787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37fc15fed0 con 0x7f37fc15e920 2024-09-19T05:39:11.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37f2ffd640 1 -- 172.21.15.67:0/729663787 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec00cd30 con 0x7f37fc15e920 2024-09-19T05:39:11.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f3800c8f640 1 -- 172.21.15.67:0/729663787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37fc14a310 con 0x7f37fc15e920 2024-09-19T05:39:11.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f3800c8f640 1 -- 172.21.15.67:0/729663787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37fc161f70 con 0x7f37fc15e920 2024-09-19T05:39:11.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37f2ffd640 1 -- 172.21.15.67:0/729663787 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37ec01a070 con 0x7f37fc15e920 2024-09-19T05:39:11.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37f2ffd640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37e00678c0 0x7f37e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:11.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37f2ffd640 1 -- 172.21.15.67:0/729663787 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f37ec085e20 con 0x7f37fc15e920 2024-09-19T05:39:11.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.756+0000 7f37fa59c640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37e00678c0 0x7f37e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:11.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.760+0000 7f37fa59c640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37e00678c0 0x7f37e0069d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f37f40af000 tx=0x7f37f40a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:11.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.760+0000 7f37f2ffd640 1 -- 172.21.15.67:0/729663787 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f37ec056180 con 0x7f37fc15e920 2024-09-19T05:39:11.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.924+0000 7f3800c8f640 1 -- 172.21.15.67:0/729663787 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f37fc072b00 con 0x7f37e00678c0 2024-09-19T05:39:11.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.940+0000 7f37f2ffd640 1 -- 172.21.15.67:0/729663787 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247737 (secure 0 0 0) 0x7f37fc072b00 con 0x7f37e00678c0 2024-09-19T05:39:11.942 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:11.944 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:39:11.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 -- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37e00678c0 msgr2=0x7f37e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37e00678c0 0x7f37e0069d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f37f40af000 tx=0x7f37f40a7070 comp rx=0 tx=0).stop 2024-09-19T05:39:11.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 -- 172.21.15.67:0/729663787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37fc15e920 msgr2=0x7f37fc14d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:11.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37fc15e920 0x7f37fc14d940 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00e880 tx=0x7f37ec00ed40 comp rx=0 tx=0).stop 2024-09-19T05:39:11.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 -- 172.21.15.67:0/729663787 shutdown_connections 2024-09-19T05:39:11.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37fc15e920 0x7f37fc14d940 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37e00678c0 0x7f37e0069d80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37fc15e330 0x7f37fc154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 --2- 172.21.15.67:0/729663787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b4bc0 0x7f37fc15f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:11.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 -- 172.21.15.67:0/729663787 >> 172.21.15.67:0/729663787 conn(0x7f37fc0d0080 msgr2=0x7f37fc071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:11.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 -- 172.21.15.67:0/729663787 shutdown_connections 2024-09-19T05:39:11.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:11.944+0000 7f3800c8f640 1 -- 172.21.15.67:0/729663787 wait complete. 2024-09-19T05:39:11.960 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-19T05:39:11.229277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357252,"kb_used_data":10568,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754617468,"statfs":{"total":773094113280,"available":772728287232,"internally_reserved":0,"allocated":10821632,"data_stored":5663160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.783739"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454618+0000","last_change":"2024-09-19T05:39:06.454618+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454618+0000","last_undegraded":"2024-09-19T05:39:06.454618+0000","last_fullsized":"2024-09-19T05:39:06.454618+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500414+0000","last_change":"2024-09-19T05:39:07.492635+0000","last_active":"2024-09-19T05:39:07.500414+0000","last_peered":"2024-09-19T05:39:07.500414+0000","last_clean":"2024-09-19T05:39:07.500414+0000","last_became_active":"2024-09-19T05:39:07.491437+0000","last_became_peered":"2024-09-19T05:39:07.491437+0000","last_unstale":"2024-09-19T05:39:07.500414+0000","last_undegraded":"2024-09-19T05:39:07.500414+0000","last_fullsized":"2024-09-19T05:39:07.500414+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.625174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459512+0000","last_change":"2024-09-19T05:39:06.459512+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459512+0000","last_undegraded":"2024-09-19T05:39:06.459512+0000","last_fullsized":"2024-09-19T05:39:06.459512+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.463465+0000","last_change":"2024-09-19T05:39:06.463465+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.463465+0000","last_undegraded":"2024-09-19T05:39:06.463465+0000","last_fullsized":"2024-09-19T05:39:06.463465+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457619+0000","last_change":"2024-09-19T05:39:06.457619+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457619+0000","last_undegraded":"2024-09-19T05:39:06.457619+0000","last_fullsized":"2024-09-19T05:39:06.457619+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461078+0000","last_change":"2024-09-19T05:39:06.461078+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461078+0000","last_undegraded":"2024-09-19T05:39:06.461078+0000","last_fullsized":"2024-09-19T05:39:06.461078+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462400+0000","last_change":"2024-09-19T05:39:06.462400+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462400+0000","last_undegraded":"2024-09-19T05:39:06.462400+0000","last_fullsized":"2024-09-19T05:39:06.462400+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.468495+0000","last_change":"2024-09-19T05:39:06.468495+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.468495+0000","last_undegraded":"2024-09-19T05:39:06.468495+0000","last_fullsized":"2024-09-19T05:39:06.468495+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.453651+0000","last_change":"2024-09-19T05:39:06.453651+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.453651+0000","last_undegraded":"2024-09-19T05:39:06.453651+0000","last_fullsized":"2024-09-19T05:39:06.453651+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.523878+0000","last_change":"2024-09-19T05:39:07.521121+0000","last_active":"2024-09-19T05:39:07.523878+0000","last_peered":"2024-09-19T05:39:07.523878+0000","last_clean":"2024-09-19T05:39:07.523878+0000","last_became_active":"2024-09-19T05:39:07.520605+0000","last_became_peered":"2024-09-19T05:39:07.520605+0000","last_unstale":"2024-09-19T05:39:07.523878+0000","last_undegraded":"2024-09-19T05:39:07.523878+0000","last_fullsized":"2024-09-19T05:39:07.523878+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:59.240315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454803+0000","last_change":"2024-09-19T05:39:06.454803+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454803+0000","last_undegraded":"2024-09-19T05:39:06.454803+0000","last_fullsized":"2024-09-19T05:39:06.454803+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500902+0000","last_change":"2024-09-19T05:39:07.498214+0000","last_active":"2024-09-19T05:39:07.500902+0000","last_peered":"2024-09-19T05:39:07.500902+0000","last_clean":"2024-09-19T05:39:07.500902+0000","last_became_active":"2024-09-19T05:39:07.497502+0000","last_became_peered":"2024-09-19T05:39:07.497502+0000","last_unstale":"2024-09-19T05:39:07.500902+0000","last_undegraded":"2024-09-19T05:39:07.500902+0000","last_fullsized":"2024-09-19T05:39:07.500902+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:32.098475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462692+0000","last_change":"2024-09-19T05:39:06.462692+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462692+0000","last_undegraded":"2024-09-19T05:39:06.462692+0000","last_fullsized":"2024-09-19T05:39:06.462692+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460045+0000","last_change":"2024-09-19T05:39:06.460045+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460045+0000","last_undegraded":"2024-09-19T05:39:06.460045+0000","last_fullsized":"2024-09-19T05:39:06.460045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461439+0000","last_change":"2024-09-19T05:39:06.461439+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461439+0000","last_undegraded":"2024-09-19T05:39:06.461439+0000","last_fullsized":"2024-09-19T05:39:06.461439+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.477616+0000","last_change":"2024-09-19T05:39:06.477616+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.477616+0000","last_undegraded":"2024-09-19T05:39:06.477616+0000","last_fullsized":"2024-09-19T05:39:06.477616+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459759+0000","last_change":"2024-09-19T05:39:06.459759+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459759+0000","last_undegraded":"2024-09-19T05:39:06.459759+0000","last_fullsized":"2024-09-19T05:39:06.459759+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459015+0000","last_change":"2024-09-19T05:39:06.459015+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459015+0000","last_undegraded":"2024-09-19T05:39:06.459015+0000","last_fullsized":"2024-09-19T05:39:06.459015+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.451195+0000","last_change":"2024-09-19T05:39:06.451195+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.451195+0000","last_undegraded":"2024-09-19T05:39:06.451195+0000","last_fullsized":"2024-09-19T05:39:06.451195+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462888+0000","last_change":"2024-09-19T05:39:06.462888+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462888+0000","last_undegraded":"2024-09-19T05:39:06.462888+0000","last_fullsized":"2024-09-19T05:39:06.462888+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455269+0000","last_change":"2024-09-19T05:39:06.455269+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455269+0000","last_undegraded":"2024-09-19T05:39:06.455269+0000","last_fullsized":"2024-09-19T05:39:06.455269+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458326+0000","last_change":"2024-09-19T05:39:06.458326+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458326+0000","last_undegraded":"2024-09-19T05:39:06.458326+0000","last_fullsized":"2024-09-19T05:39:06.458326+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461778+0000","last_change":"2024-09-19T05:39:06.461778+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461778+0000","last_undegraded":"2024-09-19T05:39:06.461778+0000","last_fullsized":"2024-09-19T05:39:06.461778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455309+0000","last_change":"2024-09-19T05:39:06.455309+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455309+0000","last_undegraded":"2024-09-19T05:39:06.455309+0000","last_fullsized":"2024-09-19T05:39:06.455309+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.515901+0000","last_change":"2024-09-19T05:39:07.513926+0000","last_active":"2024-09-19T05:39:07.515901+0000","last_peered":"2024-09-19T05:39:07.515901+0000","last_clean":"2024-09-19T05:39:07.515901+0000","last_became_active":"2024-09-19T05:39:07.513314+0000","last_became_peered":"2024-09-19T05:39:07.513314+0000","last_unstale":"2024-09-19T05:39:07.515901+0000","last_undegraded":"2024-09-19T05:39:07.515901+0000","last_fullsized":"2024-09-19T05:39:07.515901+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:07.490684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457238+0000","last_change":"2024-09-19T05:39:06.457238+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457238+0000","last_undegraded":"2024-09-19T05:39:06.457238+0000","last_fullsized":"2024-09-19T05:39:06.457238+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.512688+0000","last_change":"2024-09-19T05:39:07.511608+0000","last_active":"2024-09-19T05:39:07.512688+0000","last_peered":"2024-09-19T05:39:07.512688+0000","last_clean":"2024-09-19T05:39:07.512688+0000","last_became_active":"2024-09-19T05:39:07.511317+0000","last_became_peered":"2024-09-19T05:39:07.511317+0000","last_unstale":"2024-09-19T05:39:07.512688+0000","last_undegraded":"2024-09-19T05:39:07.512688+0000","last_fullsized":"2024-09-19T05:39:07.512688+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:23.656844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462308+0000","last_change":"2024-09-19T05:39:06.462308+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462308+0000","last_undegraded":"2024-09-19T05:39:06.462308+0000","last_fullsized":"2024-09-19T05:39:06.462308+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461436+0000","last_change":"2024-09-19T05:39:06.461436+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461436+0000","last_undegraded":"2024-09-19T05:39:06.461436+0000","last_fullsized":"2024-09-19T05:39:06.461436+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.450390+0000","last_change":"2024-09-19T05:39:06.450390+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.450390+0000","last_undegraded":"2024-09-19T05:39:06.450390+0000","last_fullsized":"2024-09-19T05:39:06.450390+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.516378+0000","last_change":"2024-09-19T05:39:07.515306+0000","last_active":"2024-09-19T05:39:07.516378+0000","last_peered":"2024-09-19T05:39:07.516378+0000","last_clean":"2024-09-19T05:39:07.516378+0000","last_became_active":"2024-09-19T05:39:07.514836+0000","last_became_peered":"2024-09-19T05:39:07.514836+0000","last_unstale":"2024-09-19T05:39:07.516378+0000","last_undegraded":"2024-09-19T05:39:07.516378+0000","last_fullsized":"2024-09-19T05:39:07.516378+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:24.860000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.476732+0000","last_change":"2024-09-19T05:39:06.476732+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.476732+0000","last_undegraded":"2024-09-19T05:39:06.476732+0000","last_fullsized":"2024-09-19T05:39:06.476732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459889+0000","last_change":"2024-09-19T05:39:06.459889+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459889+0000","last_undegraded":"2024-09-19T05:39:06.459889+0000","last_fullsized":"2024-09-19T05:39:06.459889+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.492648+0000","last_change":"2024-09-19T05:39:06.485427+0000","last_active":"2024-09-19T05:39:06.492648+0000","last_peered":"2024-09-19T05:39:06.492648+0000","last_clean":"2024-09-19T05:39:06.492648+0000","last_became_active":"2024-09-19T05:39:06.484690+0000","last_became_peered":"2024-09-19T05:39:06.484690+0000","last_unstale":"2024-09-19T05:39:06.492648+0000","last_undegraded":"2024-09-19T05:39:06.492648+0000","last_fullsized":"2024-09-19T05:39:06.492648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:18.254825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.463477+0000","last_change":"2024-09-19T05:39:06.463477+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.463477+0000","last_undegraded":"2024-09-19T05:39:06.463477+0000","last_fullsized":"2024-09-19T05:39:06.463477+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.487248+0000","last_change":"2024-09-19T05:39:06.480222+0000","last_active":"2024-09-19T05:39:06.487248+0000","last_peered":"2024-09-19T05:39:06.487248+0000","last_clean":"2024-09-19T05:39:06.487248+0000","last_became_active":"2024-09-19T05:39:06.478165+0000","last_became_peered":"2024-09-19T05:39:06.478165+0000","last_unstale":"2024-09-19T05:39:06.487248+0000","last_undegraded":"2024-09-19T05:39:06.487248+0000","last_fullsized":"2024-09-19T05:39:06.487248+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:13.250664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461662+0000","last_change":"2024-09-19T05:39:06.461662+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461662+0000","last_undegraded":"2024-09-19T05:39:06.461662+0000","last_fullsized":"2024-09-19T05:39:06.461662+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496368+0000","last_change":"2024-09-19T05:39:06.490107+0000","last_active":"2024-09-19T05:39:06.496368+0000","last_peered":"2024-09-19T05:39:06.496368+0000","last_clean":"2024-09-19T05:39:06.496368+0000","last_became_active":"2024-09-19T05:39:06.489368+0000","last_became_peered":"2024-09-19T05:39:06.489368+0000","last_unstale":"2024-09-19T05:39:06.496368+0000","last_undegraded":"2024-09-19T05:39:06.496368+0000","last_fullsized":"2024-09-19T05:39:06.496368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:15.681556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459172+0000","last_change":"2024-09-19T05:39:06.459172+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459172+0000","last_undegraded":"2024-09-19T05:39:06.459172+0000","last_fullsized":"2024-09-19T05:39:06.459172+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482834+0000","last_change":"2024-09-19T05:39:06.476967+0000","last_active":"2024-09-19T05:39:06.482834+0000","last_peered":"2024-09-19T05:39:06.482834+0000","last_clean":"2024-09-19T05:39:06.482834+0000","last_became_active":"2024-09-19T05:39:06.476220+0000","last_became_peered":"2024-09-19T05:39:06.476220+0000","last_unstale":"2024-09-19T05:39:06.482834+0000","last_undegraded":"2024-09-19T05:39:06.482834+0000","last_fullsized":"2024-09-19T05:39:06.482834+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:16.970848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.465294+0000","last_change":"2024-09-19T05:39:06.465294+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.465294+0000","last_undegraded":"2024-09-19T05:39:06.465294+0000","last_fullsized":"2024-09-19T05:39:06.465294+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.480520+0000","last_change":"2024-09-19T05:39:06.477568+0000","last_active":"2024-09-19T05:39:06.480520+0000","last_peered":"2024-09-19T05:39:06.480520+0000","last_clean":"2024-09-19T05:39:06.480520+0000","last_became_active":"2024-09-19T05:39:06.475121+0000","last_became_peered":"2024-09-19T05:39:06.475121+0000","last_unstale":"2024-09-19T05:39:06.480520+0000","last_undegraded":"2024-09-19T05:39:06.480520+0000","last_fullsized":"2024-09-19T05:39:06.480520+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:20.439330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462796+0000","last_change":"2024-09-19T05:39:06.462796+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462796+0000","last_undegraded":"2024-09-19T05:39:06.462796+0000","last_fullsized":"2024-09-19T05:39:06.462796+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.471647+0000","last_change":"2024-09-19T05:39:06.470618+0000","last_active":"2024-09-19T05:39:06.471647+0000","last_peered":"2024-09-19T05:39:06.471647+0000","last_clean":"2024-09-19T05:39:06.471647+0000","last_became_active":"2024-09-19T05:39:06.470223+0000","last_became_peered":"2024-09-19T05:39:06.470223+0000","last_unstale":"2024-09-19T05:39:06.471647+0000","last_undegraded":"2024-09-19T05:39:06.471647+0000","last_fullsized":"2024-09-19T05:39:06.471647+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.663250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460540+0000","last_change":"2024-09-19T05:39:06.460540+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460540+0000","last_undegraded":"2024-09-19T05:39:06.460540+0000","last_fullsized":"2024-09-19T05:39:06.460540+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.473973+0000","last_change":"2024-09-19T05:39:06.473491+0000","last_active":"2024-09-19T05:39:06.473973+0000","last_peered":"2024-09-19T05:39:06.473973+0000","last_clean":"2024-09-19T05:39:06.473973+0000","last_became_active":"2024-09-19T05:39:06.473154+0000","last_became_peered":"2024-09-19T05:39:06.473154+0000","last_unstale":"2024-09-19T05:39:06.473973+0000","last_undegraded":"2024-09-19T05:39:06.473973+0000","last_fullsized":"2024-09-19T05:39:06.473973+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459002+0000","last_change":"2024-09-19T05:39:06.459002+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459002+0000","last_undegraded":"2024-09-19T05:39:06.459002+0000","last_fullsized":"2024-09-19T05:39:06.459002+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496530+0000","last_change":"2024-09-19T05:39:06.491620+0000","last_active":"2024-09-19T05:39:06.496530+0000","last_peered":"2024-09-19T05:39:06.496530+0000","last_clean":"2024-09-19T05:39:06.496530+0000","last_became_active":"2024-09-19T05:39:06.491275+0000","last_became_peered":"2024-09-19T05:39:06.491275+0000","last_unstale":"2024-09-19T05:39:06.496530+0000","last_undegraded":"2024-09-19T05:39:06.496530+0000","last_fullsized":"2024-09-19T05:39:06.496530+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:14.227757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.450203+0000","last_change":"2024-09-19T05:39:06.450203+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.450203+0000","last_undegraded":"2024-09-19T05:39:06.450203+0000","last_fullsized":"2024-09-19T05:39:06.450203+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485850+0000","last_change":"2024-09-19T05:39:06.484638+0000","last_active":"2024-09-19T05:39:07.485850+0000","last_peered":"2024-09-19T05:39:07.485850+0000","last_clean":"2024-09-19T05:39:07.485850+0000","last_became_active":"2024-09-19T05:39:06.483824+0000","last_became_peered":"2024-09-19T05:39:06.483824+0000","last_unstale":"2024-09-19T05:39:07.485850+0000","last_undegraded":"2024-09-19T05:39:07.485850+0000","last_fullsized":"2024-09-19T05:39:07.485850+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:44:31.297046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.464045+0000","last_change":"2024-09-19T05:39:06.464045+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.464045+0000","last_undegraded":"2024-09-19T05:39:06.464045+0000","last_fullsized":"2024-09-19T05:39:06.464045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.472922+0000","last_change":"2024-09-19T05:39:06.472058+0000","last_active":"2024-09-19T05:39:06.472922+0000","last_peered":"2024-09-19T05:39:06.472922+0000","last_clean":"2024-09-19T05:39:06.472922+0000","last_became_active":"2024-09-19T05:39:06.471408+0000","last_became_peered":"2024-09-19T05:39:06.471408+0000","last_unstale":"2024-09-19T05:39:06.472922+0000","last_undegraded":"2024-09-19T05:39:06.472922+0000","last_fullsized":"2024-09-19T05:39:06.472922+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454843+0000","last_change":"2024-09-19T05:39:06.454843+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454843+0000","last_undegraded":"2024-09-19T05:39:06.454843+0000","last_fullsized":"2024-09-19T05:39:06.454843+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.462773+0000","last_change":"2024-09-19T05:39:06.459521+0000","last_active":"2024-09-19T05:39:06.462773+0000","last_peered":"2024-09-19T05:39:06.462773+0000","last_clean":"2024-09-19T05:39:06.462773+0000","last_became_active":"2024-09-19T05:39:06.458765+0000","last_became_peered":"2024-09-19T05:39:06.458765+0000","last_unstale":"2024-09-19T05:39:06.462773+0000","last_undegraded":"2024-09-19T05:39:06.462773+0000","last_fullsized":"2024-09-19T05:39:06.462773+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:54.147667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461370+0000","last_change":"2024-09-19T05:39:06.461370+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461370+0000","last_undegraded":"2024-09-19T05:39:06.461370+0000","last_fullsized":"2024-09-19T05:39:06.461370+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482148+0000","last_change":"2024-09-19T05:39:06.477718+0000","last_active":"2024-09-19T05:39:06.482148+0000","last_peered":"2024-09-19T05:39:06.482148+0000","last_clean":"2024-09-19T05:39:06.482148+0000","last_became_active":"2024-09-19T05:39:06.477354+0000","last_became_peered":"2024-09-19T05:39:06.477354+0000","last_unstale":"2024-09-19T05:39:06.482148+0000","last_undegraded":"2024-09-19T05:39:06.482148+0000","last_fullsized":"2024-09-19T05:39:06.482148+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460580+0000","last_change":"2024-09-19T05:39:06.460580+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460580+0000","last_undegraded":"2024-09-19T05:39:06.460580+0000","last_fullsized":"2024-09-19T05:39:06.460580+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496529+0000","last_change":"2024-09-19T05:39:06.491796+0000","last_active":"2024-09-19T05:39:06.496529+0000","last_peered":"2024-09-19T05:39:06.496529+0000","last_clean":"2024-09-19T05:39:06.496529+0000","last_became_active":"2024-09-19T05:39:06.490945+0000","last_became_peered":"2024-09-19T05:39:06.490945+0000","last_unstale":"2024-09-19T05:39:06.496529+0000","last_undegraded":"2024-09-19T05:39:06.496529+0000","last_fullsized":"2024-09-19T05:39:06.496529+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:12.345025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.452188+0000","last_change":"2024-09-19T05:39:06.452188+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.452188+0000","last_undegraded":"2024-09-19T05:39:06.452188+0000","last_fullsized":"2024-09-19T05:39:06.452188+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.484071+0000","last_change":"2024-09-19T05:39:06.482148+0000","last_active":"2024-09-19T05:39:06.484071+0000","last_peered":"2024-09-19T05:39:06.484071+0000","last_clean":"2024-09-19T05:39:06.484071+0000","last_became_active":"2024-09-19T05:39:06.477485+0000","last_became_peered":"2024-09-19T05:39:06.477485+0000","last_unstale":"2024-09-19T05:39:06.484071+0000","last_undegraded":"2024-09-19T05:39:06.484071+0000","last_fullsized":"2024-09-19T05:39:06.484071+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:23.889902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.523778+0000","last_change":"2024-09-19T05:39:07.520981+0000","last_active":"2024-09-19T05:39:07.523778+0000","last_peered":"2024-09-19T05:39:07.523778+0000","last_clean":"2024-09-19T05:39:07.523778+0000","last_became_active":"2024-09-19T05:39:07.520621+0000","last_became_peered":"2024-09-19T05:39:07.520621+0000","last_unstale":"2024-09-19T05:39:07.523778+0000","last_undegraded":"2024-09-19T05:39:07.523778+0000","last_fullsized":"2024-09-19T05:39:07.523778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:18.770956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.485776+0000","last_change":"2024-09-19T05:39:06.484372+0000","last_active":"2024-09-19T05:39:06.485776+0000","last_peered":"2024-09-19T05:39:06.485776+0000","last_clean":"2024-09-19T05:39:06.485776+0000","last_became_active":"2024-09-19T05:39:06.484002+0000","last_became_peered":"2024-09-19T05:39:06.484002+0000","last_unstale":"2024-09-19T05:39:06.485776+0000","last_undegraded":"2024-09-19T05:39:06.485776+0000","last_fullsized":"2024-09-19T05:39:06.485776+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:03.627009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.501139+0000","last_change":"2024-09-19T05:39:07.492388+0000","last_active":"2024-09-19T05:39:07.501139+0000","last_peered":"2024-09-19T05:39:07.501139+0000","last_clean":"2024-09-19T05:39:07.501139+0000","last_became_active":"2024-09-19T05:39:07.489450+0000","last_became_peered":"2024-09-19T05:39:07.489450+0000","last_unstale":"2024-09-19T05:39:07.501139+0000","last_undegraded":"2024-09-19T05:39:07.501139+0000","last_fullsized":"2024-09-19T05:39:07.501139+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:27.889589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.471472+0000","last_change":"2024-09-19T05:39:06.470272+0000","last_active":"2024-09-19T05:39:06.471472+0000","last_peered":"2024-09-19T05:39:06.471472+0000","last_clean":"2024-09-19T05:39:06.471472+0000","last_became_active":"2024-09-19T05:39:06.469862+0000","last_became_peered":"2024-09-19T05:39:06.469862+0000","last_unstale":"2024-09-19T05:39:06.471472+0000","last_undegraded":"2024-09-19T05:39:06.471472+0000","last_fullsized":"2024-09-19T05:39:06.471472+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.130680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459328+0000","last_change":"2024-09-19T05:39:06.459328+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459328+0000","last_undegraded":"2024-09-19T05:39:06.459328+0000","last_fullsized":"2024-09-19T05:39:06.459328+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.494277+0000","last_change":"2024-09-19T05:39:06.492000+0000","last_active":"2024-09-19T05:39:06.494277+0000","last_peered":"2024-09-19T05:39:06.494277+0000","last_clean":"2024-09-19T05:39:06.494277+0000","last_became_active":"2024-09-19T05:39:06.491277+0000","last_became_peered":"2024-09-19T05:39:06.491277+0000","last_unstale":"2024-09-19T05:39:06.494277+0000","last_undegraded":"2024-09-19T05:39:06.494277+0000","last_fullsized":"2024-09-19T05:39:06.494277+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:31.359640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460309+0000","last_change":"2024-09-19T05:39:06.460309+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460309+0000","last_undegraded":"2024-09-19T05:39:06.460309+0000","last_fullsized":"2024-09-19T05:39:06.460309+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496916+0000","last_change":"2024-09-19T05:39:06.495628+0000","last_active":"2024-09-19T05:39:06.496916+0000","last_peered":"2024-09-19T05:39:06.496916+0000","last_clean":"2024-09-19T05:39:06.496916+0000","last_became_active":"2024-09-19T05:39:06.491383+0000","last_became_peered":"2024-09-19T05:39:06.491383+0000","last_unstale":"2024-09-19T05:39:06.496916+0000","last_undegraded":"2024-09-19T05:39:06.496916+0000","last_fullsized":"2024-09-19T05:39:06.496916+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.451129+0000","last_change":"2024-09-19T05:39:06.451129+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.451129+0000","last_undegraded":"2024-09-19T05:39:06.451129+0000","last_fullsized":"2024-09-19T05:39:06.451129+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.490115+0000","last_change":"2024-09-19T05:39:06.488703+0000","last_active":"2024-09-19T05:39:06.490115+0000","last_peered":"2024-09-19T05:39:06.490115+0000","last_clean":"2024-09-19T05:39:06.490115+0000","last_became_active":"2024-09-19T05:39:06.487165+0000","last_became_peered":"2024-09-19T05:39:06.487165+0000","last_unstale":"2024-09-19T05:39:06.490115+0000","last_undegraded":"2024-09-19T05:39:06.490115+0000","last_fullsized":"2024-09-19T05:39:06.490115+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.948878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456505+0000","last_change":"2024-09-19T05:39:06.456505+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456505+0000","last_undegraded":"2024-09-19T05:39:06.456505+0000","last_fullsized":"2024-09-19T05:39:06.456505+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.520360+0000","last_change":"2024-09-19T05:39:06.487040+0000","last_active":"2024-09-19T05:39:07.520360+0000","last_peered":"2024-09-19T05:39:07.520360+0000","last_clean":"2024-09-19T05:39:07.520360+0000","last_became_active":"2024-09-19T05:39:06.485399+0000","last_became_peered":"2024-09-19T05:39:06.485399+0000","last_unstale":"2024-09-19T05:39:07.520360+0000","last_undegraded":"2024-09-19T05:39:07.520360+0000","last_fullsized":"2024-09-19T05:39:07.520360+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.642703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500486+0000","last_change":"2024-09-19T05:39:07.493726+0000","last_active":"2024-09-19T05:39:07.500486+0000","last_peered":"2024-09-19T05:39:07.500486+0000","last_clean":"2024-09-19T05:39:07.500486+0000","last_became_active":"2024-09-19T05:39:07.492964+0000","last_became_peered":"2024-09-19T05:39:07.492964+0000","last_unstale":"2024-09-19T05:39:07.500486+0000","last_undegraded":"2024-09-19T05:39:07.500486+0000","last_fullsized":"2024-09-19T05:39:07.500486+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:02.364388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.477119+0000","last_change":"2024-09-19T05:39:06.474748+0000","last_active":"2024-09-19T05:39:07.477119+0000","last_peered":"2024-09-19T05:39:07.477119+0000","last_clean":"2024-09-19T05:39:07.477119+0000","last_became_active":"2024-09-19T05:39:06.474265+0000","last_became_peered":"2024-09-19T05:39:06.474265+0000","last_unstale":"2024-09-19T05:39:07.477119+0000","last_undegraded":"2024-09-19T05:39:07.477119+0000","last_fullsized":"2024-09-19T05:39:07.477119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:08.194710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.519847+0000","last_change":"2024-09-19T05:39:07.510540+0000","last_active":"2024-09-19T05:39:07.519847+0000","last_peered":"2024-09-19T05:39:07.519847+0000","last_clean":"2024-09-19T05:39:07.519847+0000","last_became_active":"2024-09-19T05:39:07.509867+0000","last_became_peered":"2024-09-19T05:39:07.509867+0000","last_unstale":"2024-09-19T05:39:07.519847+0000","last_undegraded":"2024-09-19T05:39:07.519847+0000","last_fullsized":"2024-09-19T05:39:07.519847+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:06.006975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485238+0000","last_change":"2024-09-19T05:39:06.486335+0000","last_active":"2024-09-19T05:39:07.485238+0000","last_peered":"2024-09-19T05:39:07.485238+0000","last_clean":"2024-09-19T05:39:07.485238+0000","last_became_active":"2024-09-19T05:39:06.483059+0000","last_became_peered":"2024-09-19T05:39:06.483059+0000","last_unstale":"2024-09-19T05:39:07.485238+0000","last_undegraded":"2024-09-19T05:39:07.485238+0000","last_fullsized":"2024-09-19T05:39:07.485238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:33.395321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458614+0000","last_change":"2024-09-19T05:39:06.458614+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458614+0000","last_undegraded":"2024-09-19T05:39:06.458614+0000","last_fullsized":"2024-09-19T05:39:06.458614+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.476370+0000","last_change":"2024-09-19T05:39:06.488093+0000","last_active":"2024-09-19T05:39:07.476370+0000","last_peered":"2024-09-19T05:39:07.476370+0000","last_clean":"2024-09-19T05:39:07.476370+0000","last_became_active":"2024-09-19T05:39:06.487576+0000","last_became_peered":"2024-09-19T05:39:06.487576+0000","last_unstale":"2024-09-19T05:39:07.476370+0000","last_undegraded":"2024-09-19T05:39:07.476370+0000","last_fullsized":"2024-09-19T05:39:07.476370+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:03.461184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458849+0000","last_change":"2024-09-19T05:39:06.458849+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458849+0000","last_undegraded":"2024-09-19T05:39:06.458849+0000","last_fullsized":"2024-09-19T05:39:06.458849+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496980+0000","last_change":"2024-09-19T05:39:06.495673+0000","last_active":"2024-09-19T05:39:06.496980+0000","last_peered":"2024-09-19T05:39:06.496980+0000","last_clean":"2024-09-19T05:39:06.496980+0000","last_became_active":"2024-09-19T05:39:06.489071+0000","last_became_peered":"2024-09-19T05:39:06.489071+0000","last_unstale":"2024-09-19T05:39:06.496980+0000","last_undegraded":"2024-09-19T05:39:06.496980+0000","last_fullsized":"2024-09-19T05:39:06.496980+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455916+0000","last_change":"2024-09-19T05:39:06.455916+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455916+0000","last_undegraded":"2024-09-19T05:39:06.455916+0000","last_fullsized":"2024-09-19T05:39:06.455916+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.478630+0000","last_change":"2024-09-19T05:39:06.476552+0000","last_active":"2024-09-19T05:39:06.478630+0000","last_peered":"2024-09-19T05:39:06.478630+0000","last_clean":"2024-09-19T05:39:06.478630+0000","last_became_active":"2024-09-19T05:39:06.475840+0000","last_became_peered":"2024-09-19T05:39:06.475840+0000","last_unstale":"2024-09-19T05:39:06.478630+0000","last_undegraded":"2024-09-19T05:39:06.478630+0000","last_fullsized":"2024-09-19T05:39:06.478630+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:25.266383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456668+0000","last_change":"2024-09-19T05:39:06.456668+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456668+0000","last_undegraded":"2024-09-19T05:39:06.456668+0000","last_fullsized":"2024-09-19T05:39:06.456668+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.462055+0000","last_change":"2024-09-19T05:39:06.459439+0000","last_active":"2024-09-19T05:39:06.462055+0000","last_peered":"2024-09-19T05:39:06.462055+0000","last_clean":"2024-09-19T05:39:06.462055+0000","last_became_active":"2024-09-19T05:39:06.458677+0000","last_became_peered":"2024-09-19T05:39:06.458677+0000","last_unstale":"2024-09-19T05:39:06.462055+0000","last_undegraded":"2024-09-19T05:39:06.462055+0000","last_fullsized":"2024-09-19T05:39:06.462055+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.829966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500894+0000","last_change":"2024-09-19T05:39:07.497197+0000","last_active":"2024-09-19T05:39:07.500894+0000","last_peered":"2024-09-19T05:39:07.500894+0000","last_clean":"2024-09-19T05:39:07.500894+0000","last_became_active":"2024-09-19T05:39:07.496238+0000","last_became_peered":"2024-09-19T05:39:07.496238+0000","last_unstale":"2024-09-19T05:39:07.500894+0000","last_undegraded":"2024-09-19T05:39:07.500894+0000","last_fullsized":"2024-09-19T05:39:07.500894+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:48.100081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482559+0000","last_change":"2024-09-19T05:39:06.467833+0000","last_active":"2024-09-19T05:39:06.482559+0000","last_peered":"2024-09-19T05:39:06.482559+0000","last_clean":"2024-09-19T05:39:06.482559+0000","last_became_active":"2024-09-19T05:39:06.466980+0000","last_became_peered":"2024-09-19T05:39:06.466980+0000","last_unstale":"2024-09-19T05:39:06.482559+0000","last_undegraded":"2024-09-19T05:39:06.482559+0000","last_fullsized":"2024-09-19T05:39:06.482559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.663250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.508476+0000","last_change":"2024-09-19T05:39:07.506052+0000","last_active":"2024-09-19T05:39:07.508476+0000","last_peered":"2024-09-19T05:39:07.508476+0000","last_clean":"2024-09-19T05:39:07.508476+0000","last_became_active":"2024-09-19T05:39:07.505690+0000","last_became_peered":"2024-09-19T05:39:07.505690+0000","last_unstale":"2024-09-19T05:39:07.508476+0000","last_undegraded":"2024-09-19T05:39:07.508476+0000","last_fullsized":"2024-09-19T05:39:07.508476+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:05.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482114+0000","last_change":"2024-09-19T05:39:06.477685+0000","last_active":"2024-09-19T05:39:06.482114+0000","last_peered":"2024-09-19T05:39:06.482114+0000","last_clean":"2024-09-19T05:39:06.482114+0000","last_became_active":"2024-09-19T05:39:06.477270+0000","last_became_peered":"2024-09-19T05:39:06.477270+0000","last_unstale":"2024-09-19T05:39:06.482114+0000","last_undegraded":"2024-09-19T05:39:06.482114+0000","last_fullsized":"2024-09-19T05:39:06.482114+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454595+0000","last_change":"2024-09-19T05:39:06.454595+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454595+0000","last_undegraded":"2024-09-19T05:39:06.454595+0000","last_fullsized":"2024-09-19T05:39:06.454595+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485346+0000","last_change":"2024-09-19T05:39:06.487038+0000","last_active":"2024-09-19T05:39:07.485346+0000","last_peered":"2024-09-19T05:39:07.485346+0000","last_clean":"2024-09-19T05:39:07.485346+0000","last_became_active":"2024-09-19T05:39:06.486191+0000","last_became_peered":"2024-09-19T05:39:06.486191+0000","last_unstale":"2024-09-19T05:39:07.485346+0000","last_undegraded":"2024-09-19T05:39:07.485346+0000","last_fullsized":"2024-09-19T05:39:07.485346+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:57.630895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457046+0000","last_change":"2024-09-19T05:39:06.457046+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457046+0000","last_undegraded":"2024-09-19T05:39:06.457046+0000","last_fullsized":"2024-09-19T05:39:06.457046+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482851+0000","last_change":"2024-09-19T05:39:06.476838+0000","last_active":"2024-09-19T05:39:06.482851+0000","last_peered":"2024-09-19T05:39:06.482851+0000","last_clean":"2024-09-19T05:39:06.482851+0000","last_became_active":"2024-09-19T05:39:06.476128+0000","last_became_peered":"2024-09-19T05:39:06.476128+0000","last_unstale":"2024-09-19T05:39:06.482851+0000","last_undegraded":"2024-09-19T05:39:06.482851+0000","last_fullsized":"2024-09-19T05:39:06.482851+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:03.627009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456040+0000","last_change":"2024-09-19T05:39:06.456040+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456040+0000","last_undegraded":"2024-09-19T05:39:06.456040+0000","last_fullsized":"2024-09-19T05:39:06.456040+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496502+0000","last_change":"2024-09-19T05:39:06.489874+0000","last_active":"2024-09-19T05:39:06.496502+0000","last_peered":"2024-09-19T05:39:06.496502+0000","last_clean":"2024-09-19T05:39:06.496502+0000","last_became_active":"2024-09-19T05:39:06.489133+0000","last_became_peered":"2024-09-19T05:39:06.489133+0000","last_unstale":"2024-09-19T05:39:06.496502+0000","last_undegraded":"2024-09-19T05:39:06.496502+0000","last_fullsized":"2024-09-19T05:39:06.496502+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:04.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462879+0000","last_change":"2024-09-19T05:39:06.462879+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462879+0000","last_undegraded":"2024-09-19T05:39:06.462879+0000","last_fullsized":"2024-09-19T05:39:06.462879+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.488099+0000","last_change":"2024-09-19T05:39:06.486153+0000","last_active":"2024-09-19T05:39:06.488099+0000","last_peered":"2024-09-19T05:39:06.488099+0000","last_clean":"2024-09-19T05:39:06.488099+0000","last_became_active":"2024-09-19T05:39:06.485868+0000","last_became_peered":"2024-09-19T05:39:06.485868+0000","last_unstale":"2024-09-19T05:39:06.488099+0000","last_undegraded":"2024-09-19T05:39:06.488099+0000","last_fullsized":"2024-09-19T05:39:06.488099+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:16.970848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":308,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.473730+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:39:06.473730+0000","last_peered":"2024-09-19T05:39:06.473730+0000","last_clean":"2024-09-19T05:39:06.473730+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:39:06.473730+0000","last_undegraded":"2024-09-19T05:39:06.473730+0000","last_fullsized":"2024-09-19T05:39:06.473730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542219,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1798144,"data_stored":1150671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542219,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40688,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331152,"statfs":{"total":96636764160,"available":96595099648,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542221,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44844,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326996,"statfs":{"total":96636764160,"available":96590843904,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50416,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321424,"statfs":{"total":96636764160,"available":96585138176,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46256,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325584,"statfs":{"total":96636764160,"available":96589398016,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40688,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331152,"statfs":{"total":96636764160,"available":96595099648,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542219,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1798144,"data_stored":1150671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:39:11.964 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:39:12.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.124+0000 7f7aabf90640 1 Processor -- start 2024-09-19T05:39:12.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.124+0000 7f7aabf90640 1 -- start start 2024-09-19T05:39:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aabf90640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7aa415c030 0x7f7aa406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aabf90640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7aa415d1d0 0x7f7aa40b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aabf90640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa406e3c0 con 0x7f7aa40b3510 2024-09-19T05:39:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aabf90640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa406e6a0 con 0x7f7aa415c030 2024-09-19T05:39:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aabf90640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa406e980 con 0x7f7aa415d1d0 2024-09-19T05:39:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aa9d2c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7aa415c030 0x7f7aa406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aa9d2c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7aa415c030 0x7f7aa406dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56610/0 (socket says 172.21.15.67:56610) 2024-09-19T05:39:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aa9d2c640 1 -- 172.21.15.67:0/2673725709 learned_addr learned my addr 172.21.15.67:0/2673725709 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aa952b640 1 --2- 172.21.15.67:0/2673725709 >> v2:172.21.15.97:3300/0 conn(0x7f7aa415d1d0 0x7f7aa40b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aa9d2c640 1 -- 172.21.15.67:0/2673725709 >> v2:172.21.15.97:3300/0 conn(0x7f7aa415d1d0 msgr2=0x7f7aa40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aa9d2c640 1 --2- 172.21.15.67:0/2673725709 >> v2:172.21.15.97:3300/0 conn(0x7f7aa415d1d0 0x7f7aa40b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aa9d2c640 1 -- 172.21.15.67:0/2673725709 >> v1:172.21.15.67:6789/0 conn(0x7f7aa40b3510 legacy=0x7f7aa406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aa9d2c640 1 -- 172.21.15.67:0/2673725709 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa406ec60 con 0x7f7aa415c030 2024-09-19T05:39:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.128+0000 7f7aa952b640 1 --2- 172.21.15.67:0/2673725709 >> v2:172.21.15.97:3300/0 conn(0x7f7aa415d1d0 0x7f7aa40b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:12.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa9d2c640 1 --2- 172.21.15.67:0/2673725709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa415c030 0x7f7aa406dde0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40add20 tx=0x7f7aa001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b3cffa4168b8ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:12.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa8d2a640 1 -- 172.21.15.67:0/2673725709 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00ab610 con 0x7f7aa415c030 2024-09-19T05:39:12.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa8d2a640 1 -- 172.21.15.67:0/2673725709 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa00b0070 con 0x7f7aa415c030 2024-09-19T05:39:12.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa8d2a640 1 -- 172.21.15.67:0/2673725709 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00ab9d0 con 0x7f7aa415c030 2024-09-19T05:39:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 -- 172.21.15.67:0/2673725709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa415c030 msgr2=0x7f7aa406dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 --2- 172.21.15.67:0/2673725709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa415c030 0x7f7aa406dde0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40add20 tx=0x7f7aa001c4f0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 -- 172.21.15.67:0/2673725709 shutdown_connections 2024-09-19T05:39:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 --2- 172.21.15.67:0/2673725709 >> v2:172.21.15.97:3300/0 conn(0x7f7aa415d1d0 0x7f7aa40b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 --2- 172.21.15.67:0/2673725709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa415c030 0x7f7aa406dde0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 -- 172.21.15.67:0/2673725709 >> 172.21.15.67:0/2673725709 conn(0x7f7aa40d0080 msgr2=0x7f7aa40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 -- 172.21.15.67:0/2673725709 shutdown_connections 2024-09-19T05:39:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 -- 172.21.15.67:0/2673725709 wait complete. 2024-09-19T05:39:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 Processor -- start 2024-09-19T05:39:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 -- start start 2024-09-19T05:39:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa40b3510 0x7f7aa4149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa415c030 0x7f7aa40b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa415d1d0 0x7f7aa415df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa415c590 con 0x7f7aa40b3510 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa415c410 con 0x7f7aa415d1d0 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aabf90640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa41690e0 con 0x7f7aa415c030 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa9d2c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa40b3510 0x7f7aa4149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa9d2c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa40b3510 0x7f7aa4149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56626/0 (socket says 172.21.15.67:56626) 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa9d2c640 1 -- 172.21.15.67:0/3314152857 learned_addr learned my addr 172.21.15.67:0/3314152857 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa952b640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa415c030 0x7f7aa40b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aaa52d640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa415d1d0 0x7f7aa415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa9d2c640 1 -- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa415c030 msgr2=0x7f7aa40b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa9d2c640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa415c030 0x7f7aa40b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa9d2c640 1 -- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa415d1d0 msgr2=0x7f7aa415df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa9d2c640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa415d1d0 0x7f7aa415df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa9d2c640 1 -- 172.21.15.67:0/3314152857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa4150000 con 0x7f7aa40b3510 2024-09-19T05:39:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aaa52d640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa415d1d0 0x7f7aa415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.132+0000 7f7aa9d2c640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa40b3510 0x7f7aa4149510 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7aa001aba0 tx=0x7f7aa001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7a9a7fc640 1 -- 172.21.15.67:0/3314152857 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00b4800 con 0x7f7aa40b3510 2024-09-19T05:39:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7a9a7fc640 1 -- 172.21.15.67:0/3314152857 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa00b49a0 con 0x7f7aa40b3510 2024-09-19T05:39:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7a9a7fc640 1 -- 172.21.15.67:0/3314152857 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00b4d70 con 0x7f7aa40b3510 2024-09-19T05:39:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7aabf90640 1 -- 172.21.15.67:0/3314152857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa41502e0 con 0x7f7aa40b3510 2024-09-19T05:39:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7aabf90640 1 -- 172.21.15.67:0/3314152857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa41508a0 con 0x7f7aa40b3510 2024-09-19T05:39:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7aabf90640 1 -- 172.21.15.67:0/3314152857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa406dde0 con 0x7f7aa40b3510 2024-09-19T05:39:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7a9a7fc640 1 -- 172.21.15.67:0/3314152857 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7aa00b3380 con 0x7f7aa40b3510 2024-09-19T05:39:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7a9a7fc640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7a9a7fc640 1 -- 172.21.15.67:0/3314152857 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f7aa011ff30 con 0x7f7aa40b3510 2024-09-19T05:39:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7aa952b640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.136+0000 7f7aa952b640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7a880678c0 0x7f7a88069d80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7a94006fd0 tx=0x7f7a94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:12.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.140+0000 7f7a9a7fc640 1 -- 172.21.15.67:0/3314152857 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7aa00a8050 con 0x7f7aa40b3510 2024-09-19T05:39:12.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.296+0000 7f7aabf90640 1 -- 172.21.15.67:0/3314152857 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7aa40d0f20 con 0x7f7a880678c0 2024-09-19T05:39:12.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.316+0000 7f7a9a7fc640 1 -- 172.21.15.67:0/3314152857 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247737 (secure 0 0 0) 0x7f7aa40d0f20 con 0x7f7a880678c0 2024-09-19T05:39:12.317 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:12.324 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 -- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7a880678c0 msgr2=0x7f7a88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7a880678c0 0x7f7a88069d80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7a94006fd0 tx=0x7f7a94008040 comp rx=0 tx=0).stop 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 -- 172.21.15.67:0/3314152857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa40b3510 msgr2=0x7f7aa4149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa40b3510 0x7f7aa4149510 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7aa001aba0 tx=0x7f7aa001ad30 comp rx=0 tx=0).stop 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 -- 172.21.15.67:0/3314152857 shutdown_connections 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa415d1d0 0x7f7aa415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa415c030 0x7f7aa40b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 --2- 172.21.15.67:0/3314152857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa40b3510 0x7f7aa4149510 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 -- 172.21.15.67:0/3314152857 >> 172.21.15.67:0/3314152857 conn(0x7f7aa40d0080 msgr2=0x7f7aa40af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:12.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 -- 172.21.15.67:0/3314152857 shutdown_connections 2024-09-19T05:39:12.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.320+0000 7f7aabf90640 1 -- 172.21.15.67:0/3314152857 wait complete. 2024-09-19T05:39:12.337 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-19T05:39:11.229277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357252,"kb_used_data":10568,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754617468,"statfs":{"total":773094113280,"available":772728287232,"internally_reserved":0,"allocated":10821632,"data_stored":5663160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.783739"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454618+0000","last_change":"2024-09-19T05:39:06.454618+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454618+0000","last_undegraded":"2024-09-19T05:39:06.454618+0000","last_fullsized":"2024-09-19T05:39:06.454618+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500414+0000","last_change":"2024-09-19T05:39:07.492635+0000","last_active":"2024-09-19T05:39:07.500414+0000","last_peered":"2024-09-19T05:39:07.500414+0000","last_clean":"2024-09-19T05:39:07.500414+0000","last_became_active":"2024-09-19T05:39:07.491437+0000","last_became_peered":"2024-09-19T05:39:07.491437+0000","last_unstale":"2024-09-19T05:39:07.500414+0000","last_undegraded":"2024-09-19T05:39:07.500414+0000","last_fullsized":"2024-09-19T05:39:07.500414+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.625174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459512+0000","last_change":"2024-09-19T05:39:06.459512+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459512+0000","last_undegraded":"2024-09-19T05:39:06.459512+0000","last_fullsized":"2024-09-19T05:39:06.459512+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.463465+0000","last_change":"2024-09-19T05:39:06.463465+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.463465+0000","last_undegraded":"2024-09-19T05:39:06.463465+0000","last_fullsized":"2024-09-19T05:39:06.463465+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457619+0000","last_change":"2024-09-19T05:39:06.457619+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457619+0000","last_undegraded":"2024-09-19T05:39:06.457619+0000","last_fullsized":"2024-09-19T05:39:06.457619+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461078+0000","last_change":"2024-09-19T05:39:06.461078+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461078+0000","last_undegraded":"2024-09-19T05:39:06.461078+0000","last_fullsized":"2024-09-19T05:39:06.461078+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462400+0000","last_change":"2024-09-19T05:39:06.462400+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462400+0000","last_undegraded":"2024-09-19T05:39:06.462400+0000","last_fullsized":"2024-09-19T05:39:06.462400+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.468495+0000","last_change":"2024-09-19T05:39:06.468495+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.468495+0000","last_undegraded":"2024-09-19T05:39:06.468495+0000","last_fullsized":"2024-09-19T05:39:06.468495+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.453651+0000","last_change":"2024-09-19T05:39:06.453651+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.453651+0000","last_undegraded":"2024-09-19T05:39:06.453651+0000","last_fullsized":"2024-09-19T05:39:06.453651+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.523878+0000","last_change":"2024-09-19T05:39:07.521121+0000","last_active":"2024-09-19T05:39:07.523878+0000","last_peered":"2024-09-19T05:39:07.523878+0000","last_clean":"2024-09-19T05:39:07.523878+0000","last_became_active":"2024-09-19T05:39:07.520605+0000","last_became_peered":"2024-09-19T05:39:07.520605+0000","last_unstale":"2024-09-19T05:39:07.523878+0000","last_undegraded":"2024-09-19T05:39:07.523878+0000","last_fullsized":"2024-09-19T05:39:07.523878+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:59.240315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454803+0000","last_change":"2024-09-19T05:39:06.454803+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454803+0000","last_undegraded":"2024-09-19T05:39:06.454803+0000","last_fullsized":"2024-09-19T05:39:06.454803+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500902+0000","last_change":"2024-09-19T05:39:07.498214+0000","last_active":"2024-09-19T05:39:07.500902+0000","last_peered":"2024-09-19T05:39:07.500902+0000","last_clean":"2024-09-19T05:39:07.500902+0000","last_became_active":"2024-09-19T05:39:07.497502+0000","last_became_peered":"2024-09-19T05:39:07.497502+0000","last_unstale":"2024-09-19T05:39:07.500902+0000","last_undegraded":"2024-09-19T05:39:07.500902+0000","last_fullsized":"2024-09-19T05:39:07.500902+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:32.098475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462692+0000","last_change":"2024-09-19T05:39:06.462692+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462692+0000","last_undegraded":"2024-09-19T05:39:06.462692+0000","last_fullsized":"2024-09-19T05:39:06.462692+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460045+0000","last_change":"2024-09-19T05:39:06.460045+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460045+0000","last_undegraded":"2024-09-19T05:39:06.460045+0000","last_fullsized":"2024-09-19T05:39:06.460045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461439+0000","last_change":"2024-09-19T05:39:06.461439+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461439+0000","last_undegraded":"2024-09-19T05:39:06.461439+0000","last_fullsized":"2024-09-19T05:39:06.461439+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.477616+0000","last_change":"2024-09-19T05:39:06.477616+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.477616+0000","last_undegraded":"2024-09-19T05:39:06.477616+0000","last_fullsized":"2024-09-19T05:39:06.477616+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459759+0000","last_change":"2024-09-19T05:39:06.459759+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459759+0000","last_undegraded":"2024-09-19T05:39:06.459759+0000","last_fullsized":"2024-09-19T05:39:06.459759+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459015+0000","last_change":"2024-09-19T05:39:06.459015+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459015+0000","last_undegraded":"2024-09-19T05:39:06.459015+0000","last_fullsized":"2024-09-19T05:39:06.459015+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.451195+0000","last_change":"2024-09-19T05:39:06.451195+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.451195+0000","last_undegraded":"2024-09-19T05:39:06.451195+0000","last_fullsized":"2024-09-19T05:39:06.451195+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462888+0000","last_change":"2024-09-19T05:39:06.462888+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462888+0000","last_undegraded":"2024-09-19T05:39:06.462888+0000","last_fullsized":"2024-09-19T05:39:06.462888+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455269+0000","last_change":"2024-09-19T05:39:06.455269+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455269+0000","last_undegraded":"2024-09-19T05:39:06.455269+0000","last_fullsized":"2024-09-19T05:39:06.455269+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458326+0000","last_change":"2024-09-19T05:39:06.458326+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458326+0000","last_undegraded":"2024-09-19T05:39:06.458326+0000","last_fullsized":"2024-09-19T05:39:06.458326+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461778+0000","last_change":"2024-09-19T05:39:06.461778+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461778+0000","last_undegraded":"2024-09-19T05:39:06.461778+0000","last_fullsized":"2024-09-19T05:39:06.461778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455309+0000","last_change":"2024-09-19T05:39:06.455309+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455309+0000","last_undegraded":"2024-09-19T05:39:06.455309+0000","last_fullsized":"2024-09-19T05:39:06.455309+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.515901+0000","last_change":"2024-09-19T05:39:07.513926+0000","last_active":"2024-09-19T05:39:07.515901+0000","last_peered":"2024-09-19T05:39:07.515901+0000","last_clean":"2024-09-19T05:39:07.515901+0000","last_became_active":"2024-09-19T05:39:07.513314+0000","last_became_peered":"2024-09-19T05:39:07.513314+0000","last_unstale":"2024-09-19T05:39:07.515901+0000","last_undegraded":"2024-09-19T05:39:07.515901+0000","last_fullsized":"2024-09-19T05:39:07.515901+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:07.490684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457238+0000","last_change":"2024-09-19T05:39:06.457238+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457238+0000","last_undegraded":"2024-09-19T05:39:06.457238+0000","last_fullsized":"2024-09-19T05:39:06.457238+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.512688+0000","last_change":"2024-09-19T05:39:07.511608+0000","last_active":"2024-09-19T05:39:07.512688+0000","last_peered":"2024-09-19T05:39:07.512688+0000","last_clean":"2024-09-19T05:39:07.512688+0000","last_became_active":"2024-09-19T05:39:07.511317+0000","last_became_peered":"2024-09-19T05:39:07.511317+0000","last_unstale":"2024-09-19T05:39:07.512688+0000","last_undegraded":"2024-09-19T05:39:07.512688+0000","last_fullsized":"2024-09-19T05:39:07.512688+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:23.656844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462308+0000","last_change":"2024-09-19T05:39:06.462308+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462308+0000","last_undegraded":"2024-09-19T05:39:06.462308+0000","last_fullsized":"2024-09-19T05:39:06.462308+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461436+0000","last_change":"2024-09-19T05:39:06.461436+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461436+0000","last_undegraded":"2024-09-19T05:39:06.461436+0000","last_fullsized":"2024-09-19T05:39:06.461436+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.450390+0000","last_change":"2024-09-19T05:39:06.450390+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.450390+0000","last_undegraded":"2024-09-19T05:39:06.450390+0000","last_fullsized":"2024-09-19T05:39:06.450390+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.516378+0000","last_change":"2024-09-19T05:39:07.515306+0000","last_active":"2024-09-19T05:39:07.516378+0000","last_peered":"2024-09-19T05:39:07.516378+0000","last_clean":"2024-09-19T05:39:07.516378+0000","last_became_active":"2024-09-19T05:39:07.514836+0000","last_became_peered":"2024-09-19T05:39:07.514836+0000","last_unstale":"2024-09-19T05:39:07.516378+0000","last_undegraded":"2024-09-19T05:39:07.516378+0000","last_fullsized":"2024-09-19T05:39:07.516378+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:24.860000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.476732+0000","last_change":"2024-09-19T05:39:06.476732+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.476732+0000","last_undegraded":"2024-09-19T05:39:06.476732+0000","last_fullsized":"2024-09-19T05:39:06.476732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459889+0000","last_change":"2024-09-19T05:39:06.459889+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459889+0000","last_undegraded":"2024-09-19T05:39:06.459889+0000","last_fullsized":"2024-09-19T05:39:06.459889+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.492648+0000","last_change":"2024-09-19T05:39:06.485427+0000","last_active":"2024-09-19T05:39:06.492648+0000","last_peered":"2024-09-19T05:39:06.492648+0000","last_clean":"2024-09-19T05:39:06.492648+0000","last_became_active":"2024-09-19T05:39:06.484690+0000","last_became_peered":"2024-09-19T05:39:06.484690+0000","last_unstale":"2024-09-19T05:39:06.492648+0000","last_undegraded":"2024-09-19T05:39:06.492648+0000","last_fullsized":"2024-09-19T05:39:06.492648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:18.254825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.463477+0000","last_change":"2024-09-19T05:39:06.463477+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.463477+0000","last_undegraded":"2024-09-19T05:39:06.463477+0000","last_fullsized":"2024-09-19T05:39:06.463477+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.487248+0000","last_change":"2024-09-19T05:39:06.480222+0000","last_active":"2024-09-19T05:39:06.487248+0000","last_peered":"2024-09-19T05:39:06.487248+0000","last_clean":"2024-09-19T05:39:06.487248+0000","last_became_active":"2024-09-19T05:39:06.478165+0000","last_became_peered":"2024-09-19T05:39:06.478165+0000","last_unstale":"2024-09-19T05:39:06.487248+0000","last_undegraded":"2024-09-19T05:39:06.487248+0000","last_fullsized":"2024-09-19T05:39:06.487248+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:13.250664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461662+0000","last_change":"2024-09-19T05:39:06.461662+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461662+0000","last_undegraded":"2024-09-19T05:39:06.461662+0000","last_fullsized":"2024-09-19T05:39:06.461662+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496368+0000","last_change":"2024-09-19T05:39:06.490107+0000","last_active":"2024-09-19T05:39:06.496368+0000","last_peered":"2024-09-19T05:39:06.496368+0000","last_clean":"2024-09-19T05:39:06.496368+0000","last_became_active":"2024-09-19T05:39:06.489368+0000","last_became_peered":"2024-09-19T05:39:06.489368+0000","last_unstale":"2024-09-19T05:39:06.496368+0000","last_undegraded":"2024-09-19T05:39:06.496368+0000","last_fullsized":"2024-09-19T05:39:06.496368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:15.681556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459172+0000","last_change":"2024-09-19T05:39:06.459172+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459172+0000","last_undegraded":"2024-09-19T05:39:06.459172+0000","last_fullsized":"2024-09-19T05:39:06.459172+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482834+0000","last_change":"2024-09-19T05:39:06.476967+0000","last_active":"2024-09-19T05:39:06.482834+0000","last_peered":"2024-09-19T05:39:06.482834+0000","last_clean":"2024-09-19T05:39:06.482834+0000","last_became_active":"2024-09-19T05:39:06.476220+0000","last_became_peered":"2024-09-19T05:39:06.476220+0000","last_unstale":"2024-09-19T05:39:06.482834+0000","last_undegraded":"2024-09-19T05:39:06.482834+0000","last_fullsized":"2024-09-19T05:39:06.482834+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:16.970848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.465294+0000","last_change":"2024-09-19T05:39:06.465294+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.465294+0000","last_undegraded":"2024-09-19T05:39:06.465294+0000","last_fullsized":"2024-09-19T05:39:06.465294+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.480520+0000","last_change":"2024-09-19T05:39:06.477568+0000","last_active":"2024-09-19T05:39:06.480520+0000","last_peered":"2024-09-19T05:39:06.480520+0000","last_clean":"2024-09-19T05:39:06.480520+0000","last_became_active":"2024-09-19T05:39:06.475121+0000","last_became_peered":"2024-09-19T05:39:06.475121+0000","last_unstale":"2024-09-19T05:39:06.480520+0000","last_undegraded":"2024-09-19T05:39:06.480520+0000","last_fullsized":"2024-09-19T05:39:06.480520+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:20.439330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462796+0000","last_change":"2024-09-19T05:39:06.462796+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462796+0000","last_undegraded":"2024-09-19T05:39:06.462796+0000","last_fullsized":"2024-09-19T05:39:06.462796+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.471647+0000","last_change":"2024-09-19T05:39:06.470618+0000","last_active":"2024-09-19T05:39:06.471647+0000","last_peered":"2024-09-19T05:39:06.471647+0000","last_clean":"2024-09-19T05:39:06.471647+0000","last_became_active":"2024-09-19T05:39:06.470223+0000","last_became_peered":"2024-09-19T05:39:06.470223+0000","last_unstale":"2024-09-19T05:39:06.471647+0000","last_undegraded":"2024-09-19T05:39:06.471647+0000","last_fullsized":"2024-09-19T05:39:06.471647+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.663250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460540+0000","last_change":"2024-09-19T05:39:06.460540+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460540+0000","last_undegraded":"2024-09-19T05:39:06.460540+0000","last_fullsized":"2024-09-19T05:39:06.460540+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.473973+0000","last_change":"2024-09-19T05:39:06.473491+0000","last_active":"2024-09-19T05:39:06.473973+0000","last_peered":"2024-09-19T05:39:06.473973+0000","last_clean":"2024-09-19T05:39:06.473973+0000","last_became_active":"2024-09-19T05:39:06.473154+0000","last_became_peered":"2024-09-19T05:39:06.473154+0000","last_unstale":"2024-09-19T05:39:06.473973+0000","last_undegraded":"2024-09-19T05:39:06.473973+0000","last_fullsized":"2024-09-19T05:39:06.473973+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459002+0000","last_change":"2024-09-19T05:39:06.459002+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459002+0000","last_undegraded":"2024-09-19T05:39:06.459002+0000","last_fullsized":"2024-09-19T05:39:06.459002+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496530+0000","last_change":"2024-09-19T05:39:06.491620+0000","last_active":"2024-09-19T05:39:06.496530+0000","last_peered":"2024-09-19T05:39:06.496530+0000","last_clean":"2024-09-19T05:39:06.496530+0000","last_became_active":"2024-09-19T05:39:06.491275+0000","last_became_peered":"2024-09-19T05:39:06.491275+0000","last_unstale":"2024-09-19T05:39:06.496530+0000","last_undegraded":"2024-09-19T05:39:06.496530+0000","last_fullsized":"2024-09-19T05:39:06.496530+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:14.227757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.450203+0000","last_change":"2024-09-19T05:39:06.450203+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.450203+0000","last_undegraded":"2024-09-19T05:39:06.450203+0000","last_fullsized":"2024-09-19T05:39:06.450203+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485850+0000","last_change":"2024-09-19T05:39:06.484638+0000","last_active":"2024-09-19T05:39:07.485850+0000","last_peered":"2024-09-19T05:39:07.485850+0000","last_clean":"2024-09-19T05:39:07.485850+0000","last_became_active":"2024-09-19T05:39:06.483824+0000","last_became_peered":"2024-09-19T05:39:06.483824+0000","last_unstale":"2024-09-19T05:39:07.485850+0000","last_undegraded":"2024-09-19T05:39:07.485850+0000","last_fullsized":"2024-09-19T05:39:07.485850+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:44:31.297046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.464045+0000","last_change":"2024-09-19T05:39:06.464045+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.464045+0000","last_undegraded":"2024-09-19T05:39:06.464045+0000","last_fullsized":"2024-09-19T05:39:06.464045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.472922+0000","last_change":"2024-09-19T05:39:06.472058+0000","last_active":"2024-09-19T05:39:06.472922+0000","last_peered":"2024-09-19T05:39:06.472922+0000","last_clean":"2024-09-19T05:39:06.472922+0000","last_became_active":"2024-09-19T05:39:06.471408+0000","last_became_peered":"2024-09-19T05:39:06.471408+0000","last_unstale":"2024-09-19T05:39:06.472922+0000","last_undegraded":"2024-09-19T05:39:06.472922+0000","last_fullsized":"2024-09-19T05:39:06.472922+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454843+0000","last_change":"2024-09-19T05:39:06.454843+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454843+0000","last_undegraded":"2024-09-19T05:39:06.454843+0000","last_fullsized":"2024-09-19T05:39:06.454843+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.462773+0000","last_change":"2024-09-19T05:39:06.459521+0000","last_active":"2024-09-19T05:39:06.462773+0000","last_peered":"2024-09-19T05:39:06.462773+0000","last_clean":"2024-09-19T05:39:06.462773+0000","last_became_active":"2024-09-19T05:39:06.458765+0000","last_became_peered":"2024-09-19T05:39:06.458765+0000","last_unstale":"2024-09-19T05:39:06.462773+0000","last_undegraded":"2024-09-19T05:39:06.462773+0000","last_fullsized":"2024-09-19T05:39:06.462773+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:54.147667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461370+0000","last_change":"2024-09-19T05:39:06.461370+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461370+0000","last_undegraded":"2024-09-19T05:39:06.461370+0000","last_fullsized":"2024-09-19T05:39:06.461370+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482148+0000","last_change":"2024-09-19T05:39:06.477718+0000","last_active":"2024-09-19T05:39:06.482148+0000","last_peered":"2024-09-19T05:39:06.482148+0000","last_clean":"2024-09-19T05:39:06.482148+0000","last_became_active":"2024-09-19T05:39:06.477354+0000","last_became_peered":"2024-09-19T05:39:06.477354+0000","last_unstale":"2024-09-19T05:39:06.482148+0000","last_undegraded":"2024-09-19T05:39:06.482148+0000","last_fullsized":"2024-09-19T05:39:06.482148+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460580+0000","last_change":"2024-09-19T05:39:06.460580+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460580+0000","last_undegraded":"2024-09-19T05:39:06.460580+0000","last_fullsized":"2024-09-19T05:39:06.460580+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496529+0000","last_change":"2024-09-19T05:39:06.491796+0000","last_active":"2024-09-19T05:39:06.496529+0000","last_peered":"2024-09-19T05:39:06.496529+0000","last_clean":"2024-09-19T05:39:06.496529+0000","last_became_active":"2024-09-19T05:39:06.490945+0000","last_became_peered":"2024-09-19T05:39:06.490945+0000","last_unstale":"2024-09-19T05:39:06.496529+0000","last_undegraded":"2024-09-19T05:39:06.496529+0000","last_fullsized":"2024-09-19T05:39:06.496529+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:12.345025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.452188+0000","last_change":"2024-09-19T05:39:06.452188+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.452188+0000","last_undegraded":"2024-09-19T05:39:06.452188+0000","last_fullsized":"2024-09-19T05:39:06.452188+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.484071+0000","last_change":"2024-09-19T05:39:06.482148+0000","last_active":"2024-09-19T05:39:06.484071+0000","last_peered":"2024-09-19T05:39:06.484071+0000","last_clean":"2024-09-19T05:39:06.484071+0000","last_became_active":"2024-09-19T05:39:06.477485+0000","last_became_peered":"2024-09-19T05:39:06.477485+0000","last_unstale":"2024-09-19T05:39:06.484071+0000","last_undegraded":"2024-09-19T05:39:06.484071+0000","last_fullsized":"2024-09-19T05:39:06.484071+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:23.889902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.523778+0000","last_change":"2024-09-19T05:39:07.520981+0000","last_active":"2024-09-19T05:39:07.523778+0000","last_peered":"2024-09-19T05:39:07.523778+0000","last_clean":"2024-09-19T05:39:07.523778+0000","last_became_active":"2024-09-19T05:39:07.520621+0000","last_became_peered":"2024-09-19T05:39:07.520621+0000","last_unstale":"2024-09-19T05:39:07.523778+0000","last_undegraded":"2024-09-19T05:39:07.523778+0000","last_fullsized":"2024-09-19T05:39:07.523778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:18.770956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.485776+0000","last_change":"2024-09-19T05:39:06.484372+0000","last_active":"2024-09-19T05:39:06.485776+0000","last_peered":"2024-09-19T05:39:06.485776+0000","last_clean":"2024-09-19T05:39:06.485776+0000","last_became_active":"2024-09-19T05:39:06.484002+0000","last_became_peered":"2024-09-19T05:39:06.484002+0000","last_unstale":"2024-09-19T05:39:06.485776+0000","last_undegraded":"2024-09-19T05:39:06.485776+0000","last_fullsized":"2024-09-19T05:39:06.485776+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:03.627009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.501139+0000","last_change":"2024-09-19T05:39:07.492388+0000","last_active":"2024-09-19T05:39:07.501139+0000","last_peered":"2024-09-19T05:39:07.501139+0000","last_clean":"2024-09-19T05:39:07.501139+0000","last_became_active":"2024-09-19T05:39:07.489450+0000","last_became_peered":"2024-09-19T05:39:07.489450+0000","last_unstale":"2024-09-19T05:39:07.501139+0000","last_undegraded":"2024-09-19T05:39:07.501139+0000","last_fullsized":"2024-09-19T05:39:07.501139+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:27.889589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.471472+0000","last_change":"2024-09-19T05:39:06.470272+0000","last_active":"2024-09-19T05:39:06.471472+0000","last_peered":"2024-09-19T05:39:06.471472+0000","last_clean":"2024-09-19T05:39:06.471472+0000","last_became_active":"2024-09-19T05:39:06.469862+0000","last_became_peered":"2024-09-19T05:39:06.469862+0000","last_unstale":"2024-09-19T05:39:06.471472+0000","last_undegraded":"2024-09-19T05:39:06.471472+0000","last_fullsized":"2024-09-19T05:39:06.471472+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.130680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459328+0000","last_change":"2024-09-19T05:39:06.459328+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459328+0000","last_undegraded":"2024-09-19T05:39:06.459328+0000","last_fullsized":"2024-09-19T05:39:06.459328+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.494277+0000","last_change":"2024-09-19T05:39:06.492000+0000","last_active":"2024-09-19T05:39:06.494277+0000","last_peered":"2024-09-19T05:39:06.494277+0000","last_clean":"2024-09-19T05:39:06.494277+0000","last_became_active":"2024-09-19T05:39:06.491277+0000","last_became_peered":"2024-09-19T05:39:06.491277+0000","last_unstale":"2024-09-19T05:39:06.494277+0000","last_undegraded":"2024-09-19T05:39:06.494277+0000","last_fullsized":"2024-09-19T05:39:06.494277+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:31.359640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460309+0000","last_change":"2024-09-19T05:39:06.460309+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460309+0000","last_undegraded":"2024-09-19T05:39:06.460309+0000","last_fullsized":"2024-09-19T05:39:06.460309+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496916+0000","last_change":"2024-09-19T05:39:06.495628+0000","last_active":"2024-09-19T05:39:06.496916+0000","last_peered":"2024-09-19T05:39:06.496916+0000","last_clean":"2024-09-19T05:39:06.496916+0000","last_became_active":"2024-09-19T05:39:06.491383+0000","last_became_peered":"2024-09-19T05:39:06.491383+0000","last_unstale":"2024-09-19T05:39:06.496916+0000","last_undegraded":"2024-09-19T05:39:06.496916+0000","last_fullsized":"2024-09-19T05:39:06.496916+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.451129+0000","last_change":"2024-09-19T05:39:06.451129+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.451129+0000","last_undegraded":"2024-09-19T05:39:06.451129+0000","last_fullsized":"2024-09-19T05:39:06.451129+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.490115+0000","last_change":"2024-09-19T05:39:06.488703+0000","last_active":"2024-09-19T05:39:06.490115+0000","last_peered":"2024-09-19T05:39:06.490115+0000","last_clean":"2024-09-19T05:39:06.490115+0000","last_became_active":"2024-09-19T05:39:06.487165+0000","last_became_peered":"2024-09-19T05:39:06.487165+0000","last_unstale":"2024-09-19T05:39:06.490115+0000","last_undegraded":"2024-09-19T05:39:06.490115+0000","last_fullsized":"2024-09-19T05:39:06.490115+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.948878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456505+0000","last_change":"2024-09-19T05:39:06.456505+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456505+0000","last_undegraded":"2024-09-19T05:39:06.456505+0000","last_fullsized":"2024-09-19T05:39:06.456505+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.520360+0000","last_change":"2024-09-19T05:39:06.487040+0000","last_active":"2024-09-19T05:39:07.520360+0000","last_peered":"2024-09-19T05:39:07.520360+0000","last_clean":"2024-09-19T05:39:07.520360+0000","last_became_active":"2024-09-19T05:39:06.485399+0000","last_became_peered":"2024-09-19T05:39:06.485399+0000","last_unstale":"2024-09-19T05:39:07.520360+0000","last_undegraded":"2024-09-19T05:39:07.520360+0000","last_fullsized":"2024-09-19T05:39:07.520360+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.642703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500486+0000","last_change":"2024-09-19T05:39:07.493726+0000","last_active":"2024-09-19T05:39:07.500486+0000","last_peered":"2024-09-19T05:39:07.500486+0000","last_clean":"2024-09-19T05:39:07.500486+0000","last_became_active":"2024-09-19T05:39:07.492964+0000","last_became_peered":"2024-09-19T05:39:07.492964+0000","last_unstale":"2024-09-19T05:39:07.500486+0000","last_undegraded":"2024-09-19T05:39:07.500486+0000","last_fullsized":"2024-09-19T05:39:07.500486+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:02.364388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.477119+0000","last_change":"2024-09-19T05:39:06.474748+0000","last_active":"2024-09-19T05:39:07.477119+0000","last_peered":"2024-09-19T05:39:07.477119+0000","last_clean":"2024-09-19T05:39:07.477119+0000","last_became_active":"2024-09-19T05:39:06.474265+0000","last_became_peered":"2024-09-19T05:39:06.474265+0000","last_unstale":"2024-09-19T05:39:07.477119+0000","last_undegraded":"2024-09-19T05:39:07.477119+0000","last_fullsized":"2024-09-19T05:39:07.477119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:08.194710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.519847+0000","last_change":"2024-09-19T05:39:07.510540+0000","last_active":"2024-09-19T05:39:07.519847+0000","last_peered":"2024-09-19T05:39:07.519847+0000","last_clean":"2024-09-19T05:39:07.519847+0000","last_became_active":"2024-09-19T05:39:07.509867+0000","last_became_peered":"2024-09-19T05:39:07.509867+0000","last_unstale":"2024-09-19T05:39:07.519847+0000","last_undegraded":"2024-09-19T05:39:07.519847+0000","last_fullsized":"2024-09-19T05:39:07.519847+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:06.006975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485238+0000","last_change":"2024-09-19T05:39:06.486335+0000","last_active":"2024-09-19T05:39:07.485238+0000","last_peered":"2024-09-19T05:39:07.485238+0000","last_clean":"2024-09-19T05:39:07.485238+0000","last_became_active":"2024-09-19T05:39:06.483059+0000","last_became_peered":"2024-09-19T05:39:06.483059+0000","last_unstale":"2024-09-19T05:39:07.485238+0000","last_undegraded":"2024-09-19T05:39:07.485238+0000","last_fullsized":"2024-09-19T05:39:07.485238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:33.395321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458614+0000","last_change":"2024-09-19T05:39:06.458614+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458614+0000","last_undegraded":"2024-09-19T05:39:06.458614+0000","last_fullsized":"2024-09-19T05:39:06.458614+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.476370+0000","last_change":"2024-09-19T05:39:06.488093+0000","last_active":"2024-09-19T05:39:07.476370+0000","last_peered":"2024-09-19T05:39:07.476370+0000","last_clean":"2024-09-19T05:39:07.476370+0000","last_became_active":"2024-09-19T05:39:06.487576+0000","last_became_peered":"2024-09-19T05:39:06.487576+0000","last_unstale":"2024-09-19T05:39:07.476370+0000","last_undegraded":"2024-09-19T05:39:07.476370+0000","last_fullsized":"2024-09-19T05:39:07.476370+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:03.461184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458849+0000","last_change":"2024-09-19T05:39:06.458849+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458849+0000","last_undegraded":"2024-09-19T05:39:06.458849+0000","last_fullsized":"2024-09-19T05:39:06.458849+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496980+0000","last_change":"2024-09-19T05:39:06.495673+0000","last_active":"2024-09-19T05:39:06.496980+0000","last_peered":"2024-09-19T05:39:06.496980+0000","last_clean":"2024-09-19T05:39:06.496980+0000","last_became_active":"2024-09-19T05:39:06.489071+0000","last_became_peered":"2024-09-19T05:39:06.489071+0000","last_unstale":"2024-09-19T05:39:06.496980+0000","last_undegraded":"2024-09-19T05:39:06.496980+0000","last_fullsized":"2024-09-19T05:39:06.496980+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455916+0000","last_change":"2024-09-19T05:39:06.455916+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455916+0000","last_undegraded":"2024-09-19T05:39:06.455916+0000","last_fullsized":"2024-09-19T05:39:06.455916+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.478630+0000","last_change":"2024-09-19T05:39:06.476552+0000","last_active":"2024-09-19T05:39:06.478630+0000","last_peered":"2024-09-19T05:39:06.478630+0000","last_clean":"2024-09-19T05:39:06.478630+0000","last_became_active":"2024-09-19T05:39:06.475840+0000","last_became_peered":"2024-09-19T05:39:06.475840+0000","last_unstale":"2024-09-19T05:39:06.478630+0000","last_undegraded":"2024-09-19T05:39:06.478630+0000","last_fullsized":"2024-09-19T05:39:06.478630+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:25.266383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456668+0000","last_change":"2024-09-19T05:39:06.456668+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456668+0000","last_undegraded":"2024-09-19T05:39:06.456668+0000","last_fullsized":"2024-09-19T05:39:06.456668+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.462055+0000","last_change":"2024-09-19T05:39:06.459439+0000","last_active":"2024-09-19T05:39:06.462055+0000","last_peered":"2024-09-19T05:39:06.462055+0000","last_clean":"2024-09-19T05:39:06.462055+0000","last_became_active":"2024-09-19T05:39:06.458677+0000","last_became_peered":"2024-09-19T05:39:06.458677+0000","last_unstale":"2024-09-19T05:39:06.462055+0000","last_undegraded":"2024-09-19T05:39:06.462055+0000","last_fullsized":"2024-09-19T05:39:06.462055+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.829966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500894+0000","last_change":"2024-09-19T05:39:07.497197+0000","last_active":"2024-09-19T05:39:07.500894+0000","last_peered":"2024-09-19T05:39:07.500894+0000","last_clean":"2024-09-19T05:39:07.500894+0000","last_became_active":"2024-09-19T05:39:07.496238+0000","last_became_peered":"2024-09-19T05:39:07.496238+0000","last_unstale":"2024-09-19T05:39:07.500894+0000","last_undegraded":"2024-09-19T05:39:07.500894+0000","last_fullsized":"2024-09-19T05:39:07.500894+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:48.100081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482559+0000","last_change":"2024-09-19T05:39:06.467833+0000","last_active":"2024-09-19T05:39:06.482559+0000","last_peered":"2024-09-19T05:39:06.482559+0000","last_clean":"2024-09-19T05:39:06.482559+0000","last_became_active":"2024-09-19T05:39:06.466980+0000","last_became_peered":"2024-09-19T05:39:06.466980+0000","last_unstale":"2024-09-19T05:39:06.482559+0000","last_undegraded":"2024-09-19T05:39:06.482559+0000","last_fullsized":"2024-09-19T05:39:06.482559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.663250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.508476+0000","last_change":"2024-09-19T05:39:07.506052+0000","last_active":"2024-09-19T05:39:07.508476+0000","last_peered":"2024-09-19T05:39:07.508476+0000","last_clean":"2024-09-19T05:39:07.508476+0000","last_became_active":"2024-09-19T05:39:07.505690+0000","last_became_peered":"2024-09-19T05:39:07.505690+0000","last_unstale":"2024-09-19T05:39:07.508476+0000","last_undegraded":"2024-09-19T05:39:07.508476+0000","last_fullsized":"2024-09-19T05:39:07.508476+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:05.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482114+0000","last_change":"2024-09-19T05:39:06.477685+0000","last_active":"2024-09-19T05:39:06.482114+0000","last_peered":"2024-09-19T05:39:06.482114+0000","last_clean":"2024-09-19T05:39:06.482114+0000","last_became_active":"2024-09-19T05:39:06.477270+0000","last_became_peered":"2024-09-19T05:39:06.477270+0000","last_unstale":"2024-09-19T05:39:06.482114+0000","last_undegraded":"2024-09-19T05:39:06.482114+0000","last_fullsized":"2024-09-19T05:39:06.482114+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454595+0000","last_change":"2024-09-19T05:39:06.454595+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454595+0000","last_undegraded":"2024-09-19T05:39:06.454595+0000","last_fullsized":"2024-09-19T05:39:06.454595+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485346+0000","last_change":"2024-09-19T05:39:06.487038+0000","last_active":"2024-09-19T05:39:07.485346+0000","last_peered":"2024-09-19T05:39:07.485346+0000","last_clean":"2024-09-19T05:39:07.485346+0000","last_became_active":"2024-09-19T05:39:06.486191+0000","last_became_peered":"2024-09-19T05:39:06.486191+0000","last_unstale":"2024-09-19T05:39:07.485346+0000","last_undegraded":"2024-09-19T05:39:07.485346+0000","last_fullsized":"2024-09-19T05:39:07.485346+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:57.630895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457046+0000","last_change":"2024-09-19T05:39:06.457046+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457046+0000","last_undegraded":"2024-09-19T05:39:06.457046+0000","last_fullsized":"2024-09-19T05:39:06.457046+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482851+0000","last_change":"2024-09-19T05:39:06.476838+0000","last_active":"2024-09-19T05:39:06.482851+0000","last_peered":"2024-09-19T05:39:06.482851+0000","last_clean":"2024-09-19T05:39:06.482851+0000","last_became_active":"2024-09-19T05:39:06.476128+0000","last_became_peered":"2024-09-19T05:39:06.476128+0000","last_unstale":"2024-09-19T05:39:06.482851+0000","last_undegraded":"2024-09-19T05:39:06.482851+0000","last_fullsized":"2024-09-19T05:39:06.482851+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:03.627009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456040+0000","last_change":"2024-09-19T05:39:06.456040+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456040+0000","last_undegraded":"2024-09-19T05:39:06.456040+0000","last_fullsized":"2024-09-19T05:39:06.456040+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496502+0000","last_change":"2024-09-19T05:39:06.489874+0000","last_active":"2024-09-19T05:39:06.496502+0000","last_peered":"2024-09-19T05:39:06.496502+0000","last_clean":"2024-09-19T05:39:06.496502+0000","last_became_active":"2024-09-19T05:39:06.489133+0000","last_became_peered":"2024-09-19T05:39:06.489133+0000","last_unstale":"2024-09-19T05:39:06.496502+0000","last_undegraded":"2024-09-19T05:39:06.496502+0000","last_fullsized":"2024-09-19T05:39:06.496502+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:04.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462879+0000","last_change":"2024-09-19T05:39:06.462879+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462879+0000","last_undegraded":"2024-09-19T05:39:06.462879+0000","last_fullsized":"2024-09-19T05:39:06.462879+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.488099+0000","last_change":"2024-09-19T05:39:06.486153+0000","last_active":"2024-09-19T05:39:06.488099+0000","last_peered":"2024-09-19T05:39:06.488099+0000","last_clean":"2024-09-19T05:39:06.488099+0000","last_became_active":"2024-09-19T05:39:06.485868+0000","last_became_peered":"2024-09-19T05:39:06.485868+0000","last_unstale":"2024-09-19T05:39:06.488099+0000","last_undegraded":"2024-09-19T05:39:06.488099+0000","last_fullsized":"2024-09-19T05:39:06.488099+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:16.970848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":308,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.473730+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:39:06.473730+0000","last_peered":"2024-09-19T05:39:06.473730+0000","last_clean":"2024-09-19T05:39:06.473730+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:39:06.473730+0000","last_undegraded":"2024-09-19T05:39:06.473730+0000","last_fullsized":"2024-09-19T05:39:06.473730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542219,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1798144,"data_stored":1150671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542219,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40688,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331152,"statfs":{"total":96636764160,"available":96595099648,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542221,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44844,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326996,"statfs":{"total":96636764160,"available":96590843904,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50416,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321424,"statfs":{"total":96636764160,"available":96585138176,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46256,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325584,"statfs":{"total":96636764160,"available":96589398016,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40688,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331152,"statfs":{"total":96636764160,"available":96595099648,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542219,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1798144,"data_stored":1150671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:39:12.340 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3f is not active+clean 2024-09-19T05:39:12.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.454618+0000', 'last_change': '2024-09-19T05:39:06.454618+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.454618+0000', 'last_undegraded': '2024-09-19T05:39:06.454618+0000', 'last_fullsized': '2024-09-19T05:39:06.454618+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:39:12.340 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3d is not active+clean 2024-09-19T05:39:12.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.459512+0000', 'last_change': '2024-09-19T05:39:06.459512+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.459512+0000', 'last_undegraded': '2024-09-19T05:39:06.459512+0000', 'last_fullsized': '2024-09-19T05:39:06.459512+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:39:12.341 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3c is not active+clean 2024-09-19T05:39:12.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.463465+0000', 'last_change': '2024-09-19T05:39:06.463465+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.463465+0000', 'last_undegraded': '2024-09-19T05:39:06.463465+0000', 'last_fullsized': '2024-09-19T05:39:06.463465+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:39:12.341 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3b is not active+clean 2024-09-19T05:39:12.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.457619+0000', 'last_change': '2024-09-19T05:39:06.457619+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.457619+0000', 'last_undegraded': '2024-09-19T05:39:06.457619+0000', 'last_fullsized': '2024-09-19T05:39:06.457619+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.341 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3a is not active+clean 2024-09-19T05:39:12.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.461078+0000', 'last_change': '2024-09-19T05:39:06.461078+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.461078+0000', 'last_undegraded': '2024-09-19T05:39:06.461078+0000', 'last_fullsized': '2024-09-19T05:39:06.461078+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.341 INFO:tasks.ceph.ceph_manager.ceph:PG 14.39 is not active+clean 2024-09-19T05:39:12.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.462400+0000', 'last_change': '2024-09-19T05:39:06.462400+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.462400+0000', 'last_undegraded': '2024-09-19T05:39:06.462400+0000', 'last_fullsized': '2024-09-19T05:39:06.462400+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:39:12.341 INFO:tasks.ceph.ceph_manager.ceph:PG 14.38 is not active+clean 2024-09-19T05:39:12.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.468495+0000', 'last_change': '2024-09-19T05:39:06.468495+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.468495+0000', 'last_undegraded': '2024-09-19T05:39:06.468495+0000', 'last_fullsized': '2024-09-19T05:39:06.468495+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:39:12.342 INFO:tasks.ceph.ceph_manager.ceph:PG 14.37 is not active+clean 2024-09-19T05:39:12.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.453651+0000', 'last_change': '2024-09-19T05:39:06.453651+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.453651+0000', 'last_undegraded': '2024-09-19T05:39:06.453651+0000', 'last_fullsized': '2024-09-19T05:39:06.453651+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.342 INFO:tasks.ceph.ceph_manager.ceph:PG 14.35 is not active+clean 2024-09-19T05:39:12.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.454803+0000', 'last_change': '2024-09-19T05:39:06.454803+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.454803+0000', 'last_undegraded': '2024-09-19T05:39:06.454803+0000', 'last_fullsized': '2024-09-19T05:39:06.454803+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.342 INFO:tasks.ceph.ceph_manager.ceph:PG 14.33 is not active+clean 2024-09-19T05:39:12.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.462692+0000', 'last_change': '2024-09-19T05:39:06.462692+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.462692+0000', 'last_undegraded': '2024-09-19T05:39:06.462692+0000', 'last_fullsized': '2024-09-19T05:39:06.462692+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:39:12.342 INFO:tasks.ceph.ceph_manager.ceph:PG 14.32 is not active+clean 2024-09-19T05:39:12.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.460045+0000', 'last_change': '2024-09-19T05:39:06.460045+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.460045+0000', 'last_undegraded': '2024-09-19T05:39:06.460045+0000', 'last_fullsized': '2024-09-19T05:39:06.460045+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.342 INFO:tasks.ceph.ceph_manager.ceph:PG 14.31 is not active+clean 2024-09-19T05:39:12.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.461439+0000', 'last_change': '2024-09-19T05:39:06.461439+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.461439+0000', 'last_undegraded': '2024-09-19T05:39:06.461439+0000', 'last_fullsized': '2024-09-19T05:39:06.461439+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:PG 14.30 is not active+clean 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.477616+0000', 'last_change': '2024-09-19T05:39:06.477616+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.477616+0000', 'last_undegraded': '2024-09-19T05:39:06.477616+0000', 'last_fullsized': '2024-09-19T05:39:06.477616+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2f is not active+clean 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.459759+0000', 'last_change': '2024-09-19T05:39:06.459759+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.459759+0000', 'last_undegraded': '2024-09-19T05:39:06.459759+0000', 'last_fullsized': '2024-09-19T05:39:06.459759+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2e is not active+clean 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.459015+0000', 'last_change': '2024-09-19T05:39:06.459015+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.459015+0000', 'last_undegraded': '2024-09-19T05:39:06.459015+0000', 'last_fullsized': '2024-09-19T05:39:06.459015+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2d is not active+clean 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.451195+0000', 'last_change': '2024-09-19T05:39:06.451195+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.451195+0000', 'last_undegraded': '2024-09-19T05:39:06.451195+0000', 'last_fullsized': '2024-09-19T05:39:06.451195+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2c is not active+clean 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.462888+0000', 'last_change': '2024-09-19T05:39:06.462888+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.462888+0000', 'last_undegraded': '2024-09-19T05:39:06.462888+0000', 'last_fullsized': '2024-09-19T05:39:06.462888+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:39:12.343 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2b is not active+clean 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.455269+0000', 'last_change': '2024-09-19T05:39:06.455269+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.455269+0000', 'last_undegraded': '2024-09-19T05:39:06.455269+0000', 'last_fullsized': '2024-09-19T05:39:06.455269+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2a is not active+clean 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.458326+0000', 'last_change': '2024-09-19T05:39:06.458326+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.458326+0000', 'last_undegraded': '2024-09-19T05:39:06.458326+0000', 'last_fullsized': '2024-09-19T05:39:06.458326+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:PG 14.29 is not active+clean 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.461778+0000', 'last_change': '2024-09-19T05:39:06.461778+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.461778+0000', 'last_undegraded': '2024-09-19T05:39:06.461778+0000', 'last_fullsized': '2024-09-19T05:39:06.461778+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:PG 14.28 is not active+clean 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.455309+0000', 'last_change': '2024-09-19T05:39:06.455309+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.455309+0000', 'last_undegraded': '2024-09-19T05:39:06.455309+0000', 'last_fullsized': '2024-09-19T05:39:06.455309+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:PG 14.26 is not active+clean 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.457238+0000', 'last_change': '2024-09-19T05:39:06.457238+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.457238+0000', 'last_undegraded': '2024-09-19T05:39:06.457238+0000', 'last_fullsized': '2024-09-19T05:39:06.457238+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:PG 14.24 is not active+clean 2024-09-19T05:39:12.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.462308+0000', 'last_change': '2024-09-19T05:39:06.462308+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.462308+0000', 'last_undegraded': '2024-09-19T05:39:06.462308+0000', 'last_fullsized': '2024-09-19T05:39:06.462308+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:39:12.345 INFO:tasks.ceph.ceph_manager.ceph:PG 14.23 is not active+clean 2024-09-19T05:39:12.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.461436+0000', 'last_change': '2024-09-19T05:39:06.461436+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.461436+0000', 'last_undegraded': '2024-09-19T05:39:06.461436+0000', 'last_fullsized': '2024-09-19T05:39:06.461436+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:39:12.345 INFO:tasks.ceph.ceph_manager.ceph:PG 14.22 is not active+clean 2024-09-19T05:39:12.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.450390+0000', 'last_change': '2024-09-19T05:39:06.450390+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.450390+0000', 'last_undegraded': '2024-09-19T05:39:06.450390+0000', 'last_fullsized': '2024-09-19T05:39:06.450390+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.345 INFO:tasks.ceph.ceph_manager.ceph:PG 14.20 is not active+clean 2024-09-19T05:39:12.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.476732+0000', 'last_change': '2024-09-19T05:39:06.476732+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.476732+0000', 'last_undegraded': '2024-09-19T05:39:06.476732+0000', 'last_fullsized': '2024-09-19T05:39:06.476732+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.345 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1c is not active+clean 2024-09-19T05:39:12.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.459889+0000', 'last_change': '2024-09-19T05:39:06.459889+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.459889+0000', 'last_undegraded': '2024-09-19T05:39:06.459889+0000', 'last_fullsized': '2024-09-19T05:39:06.459889+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.345 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1d is not active+clean 2024-09-19T05:39:12.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.463477+0000', 'last_change': '2024-09-19T05:39:06.463477+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.463477+0000', 'last_undegraded': '2024-09-19T05:39:06.463477+0000', 'last_fullsized': '2024-09-19T05:39:06.463477+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1e is not active+clean 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.461662+0000', 'last_change': '2024-09-19T05:39:06.461662+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.461662+0000', 'last_undegraded': '2024-09-19T05:39:06.461662+0000', 'last_fullsized': '2024-09-19T05:39:06.461662+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1f is not active+clean 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.459172+0000', 'last_change': '2024-09-19T05:39:06.459172+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.459172+0000', 'last_undegraded': '2024-09-19T05:39:06.459172+0000', 'last_fullsized': '2024-09-19T05:39:06.459172+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:PG 14.18 is not active+clean 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.465294+0000', 'last_change': '2024-09-19T05:39:06.465294+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.465294+0000', 'last_undegraded': '2024-09-19T05:39:06.465294+0000', 'last_fullsized': '2024-09-19T05:39:06.465294+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:PG 14.19 is not active+clean 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.462796+0000', 'last_change': '2024-09-19T05:39:06.462796+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.462796+0000', 'last_undegraded': '2024-09-19T05:39:06.462796+0000', 'last_fullsized': '2024-09-19T05:39:06.462796+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1a is not active+clean 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.460540+0000', 'last_change': '2024-09-19T05:39:06.460540+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.460540+0000', 'last_undegraded': '2024-09-19T05:39:06.460540+0000', 'last_fullsized': '2024-09-19T05:39:06.460540+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1b is not active+clean 2024-09-19T05:39:12.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.459002+0000', 'last_change': '2024-09-19T05:39:06.459002+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.459002+0000', 'last_undegraded': '2024-09-19T05:39:06.459002+0000', 'last_fullsized': '2024-09-19T05:39:06.459002+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:PG 14.14 is not active+clean 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.450203+0000', 'last_change': '2024-09-19T05:39:06.450203+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.450203+0000', 'last_undegraded': '2024-09-19T05:39:06.450203+0000', 'last_fullsized': '2024-09-19T05:39:06.450203+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:PG 14.15 is not active+clean 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.464045+0000', 'last_change': '2024-09-19T05:39:06.464045+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.464045+0000', 'last_undegraded': '2024-09-19T05:39:06.464045+0000', 'last_fullsized': '2024-09-19T05:39:06.464045+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:PG 14.16 is not active+clean 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.454843+0000', 'last_change': '2024-09-19T05:39:06.454843+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.454843+0000', 'last_undegraded': '2024-09-19T05:39:06.454843+0000', 'last_fullsized': '2024-09-19T05:39:06.454843+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:PG 14.17 is not active+clean 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.461370+0000', 'last_change': '2024-09-19T05:39:06.461370+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.461370+0000', 'last_undegraded': '2024-09-19T05:39:06.461370+0000', 'last_fullsized': '2024-09-19T05:39:06.461370+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:PG 14.10 is not active+clean 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.460580+0000', 'last_change': '2024-09-19T05:39:06.460580+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.460580+0000', 'last_undegraded': '2024-09-19T05:39:06.460580+0000', 'last_fullsized': '2024-09-19T05:39:06.460580+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:39:12.347 INFO:tasks.ceph.ceph_manager.ceph:PG 14.11 is not active+clean 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.452188+0000', 'last_change': '2024-09-19T05:39:06.452188+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.452188+0000', 'last_undegraded': '2024-09-19T05:39:06.452188+0000', 'last_fullsized': '2024-09-19T05:39:06.452188+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:PG 14.c is not active+clean 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.459328+0000', 'last_change': '2024-09-19T05:39:06.459328+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.459328+0000', 'last_undegraded': '2024-09-19T05:39:06.459328+0000', 'last_fullsized': '2024-09-19T05:39:06.459328+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:PG 14.d is not active+clean 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.460309+0000', 'last_change': '2024-09-19T05:39:06.460309+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.460309+0000', 'last_undegraded': '2024-09-19T05:39:06.460309+0000', 'last_fullsized': '2024-09-19T05:39:06.460309+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:PG 14.e is not active+clean 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.451129+0000', 'last_change': '2024-09-19T05:39:06.451129+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.451129+0000', 'last_undegraded': '2024-09-19T05:39:06.451129+0000', 'last_fullsized': '2024-09-19T05:39:06.451129+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:PG 14.8 is not active+clean 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.456505+0000', 'last_change': '2024-09-19T05:39:06.456505+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.456505+0000', 'last_undegraded': '2024-09-19T05:39:06.456505+0000', 'last_fullsized': '2024-09-19T05:39:06.456505+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:PG 14.b is not active+clean 2024-09-19T05:39:12.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.458614+0000', 'last_change': '2024-09-19T05:39:06.458614+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.458614+0000', 'last_undegraded': '2024-09-19T05:39:06.458614+0000', 'last_fullsized': '2024-09-19T05:39:06.458614+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.349 INFO:tasks.ceph.ceph_manager.ceph:PG 14.4 is not active+clean 2024-09-19T05:39:12.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.458849+0000', 'last_change': '2024-09-19T05:39:06.458849+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.458849+0000', 'last_undegraded': '2024-09-19T05:39:06.458849+0000', 'last_fullsized': '2024-09-19T05:39:06.458849+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:39:12.349 INFO:tasks.ceph.ceph_manager.ceph:PG 14.5 is not active+clean 2024-09-19T05:39:12.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.455916+0000', 'last_change': '2024-09-19T05:39:06.455916+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.455916+0000', 'last_undegraded': '2024-09-19T05:39:06.455916+0000', 'last_fullsized': '2024-09-19T05:39:06.455916+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.349 INFO:tasks.ceph.ceph_manager.ceph:PG 14.6 is not active+clean 2024-09-19T05:39:12.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.456668+0000', 'last_change': '2024-09-19T05:39:06.456668+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.456668+0000', 'last_undegraded': '2024-09-19T05:39:06.456668+0000', 'last_fullsized': '2024-09-19T05:39:06.456668+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.349 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1 is not active+clean 2024-09-19T05:39:12.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.454595+0000', 'last_change': '2024-09-19T05:39:06.454595+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.454595+0000', 'last_undegraded': '2024-09-19T05:39:06.454595+0000', 'last_fullsized': '2024-09-19T05:39:06.454595+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:39:12.349 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2 is not active+clean 2024-09-19T05:39:12.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.457046+0000', 'last_change': '2024-09-19T05:39:06.457046+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.457046+0000', 'last_undegraded': '2024-09-19T05:39:06.457046+0000', 'last_fullsized': '2024-09-19T05:39:06.457046+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:39:12.350 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3 is not active+clean 2024-09-19T05:39:12.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.456040+0000', 'last_change': '2024-09-19T05:39:06.456040+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.456040+0000', 'last_undegraded': '2024-09-19T05:39:06.456040+0000', 'last_fullsized': '2024-09-19T05:39:06.456040+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:39:12.350 INFO:tasks.ceph.ceph_manager.ceph:PG 14.f is not active+clean 2024-09-19T05:39:12.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:39:06.462879+0000', 'last_change': '2024-09-19T05:39:06.462879+0000', 'last_active': '2024-09-19T05:39:06.438981+0000', 'last_peered': '2024-09-19T05:39:06.438981+0000', 'last_clean': '2024-09-19T05:39:06.438981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:39:06.462879+0000', 'last_undegraded': '2024-09-19T05:39:06.462879+0000', 'last_fullsized': '2024-09-19T05:39:06.462879+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'last_clean_scrub_stamp': '2024-09-19T05:39:06.438981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:39:12.350 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:39:12.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.496+0000 7fef0a8b4640 1 Processor -- start 2024-09-19T05:39:12.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.496+0000 7fef0a8b4640 1 -- start start 2024-09-19T05:39:12.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.496+0000 7fef0a8b4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef0415b1e0 0x7fef040b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.496+0000 7fef0a8b4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fef04072590 0x7fef040ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.496+0000 7fef0a8b4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef040b3860 con 0x7fef040b4900 2024-09-19T05:39:12.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.496+0000 7fef0a8b4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fef0415b5c0 con 0x7fef04072590 2024-09-19T05:39:12.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.496+0000 7fef0a8b4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fef040b3b40 con 0x7fef0415b1e0 2024-09-19T05:39:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.500+0000 7fef03fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef0415b1e0 0x7fef040b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.500+0000 7fef03fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef0415b1e0 0x7fef040b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:43112/0 (socket says 172.21.15.67:43112) 2024-09-19T05:39:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.500+0000 7fef03fff640 1 -- 172.21.15.67:0/3667675045 learned_addr learned my addr 172.21.15.67:0/3667675045 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.500+0000 7fef08e51640 1 --2- 172.21.15.67:0/3667675045 >> v2:172.21.15.97:3300/0 conn(0x7fef04072590 0x7fef040ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.500+0000 7fef03fff640 1 -- 172.21.15.67:0/3667675045 >> v2:172.21.15.97:3300/0 conn(0x7fef04072590 msgr2=0x7fef040ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.500+0000 7fef03fff640 1 --2- 172.21.15.67:0/3667675045 >> v2:172.21.15.97:3300/0 conn(0x7fef04072590 0x7fef040ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.500+0000 7fef03fff640 1 -- 172.21.15.67:0/3667675045 >> v1:172.21.15.97:6789/0 conn(0x7fef040b4900 legacy=0x7fef04071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.500+0000 7fef03fff640 1 -- 172.21.15.67:0/3667675045 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef040b3e20 con 0x7fef0415b1e0 2024-09-19T05:39:12.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef03fff640 1 --2- 172.21.15.67:0/3667675045 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef0415b1e0 0x7fef040b2fd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feef40098a0 tx=0x7feef401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e2db5abdd2e4acc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:12.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef02ffd640 1 -- 172.21.15.67:0/3667675045 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef40a95f0 con 0x7fef0415b1e0 2024-09-19T05:39:12.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef02ffd640 1 -- 172.21.15.67:0/3667675045 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef40a9790 con 0x7fef0415b1e0 2024-09-19T05:39:12.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef02ffd640 1 -- 172.21.15.67:0/3667675045 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef40a9b60 con 0x7fef0415b1e0 2024-09-19T05:39:12.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 -- 172.21.15.67:0/3667675045 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef0415b1e0 msgr2=0x7fef040b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 --2- 172.21.15.67:0/3667675045 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef0415b1e0 0x7fef040b2fd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feef40098a0 tx=0x7feef401c510 comp rx=0 tx=0).stop 2024-09-19T05:39:12.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 -- 172.21.15.67:0/3667675045 shutdown_connections 2024-09-19T05:39:12.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 --2- 172.21.15.67:0/3667675045 >> v2:172.21.15.97:3300/0 conn(0x7fef04072590 0x7fef040ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 --2- 172.21.15.67:0/3667675045 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef0415b1e0 0x7fef040b2fd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 -- 172.21.15.67:0/3667675045 >> 172.21.15.67:0/3667675045 conn(0x7fef040d0080 msgr2=0x7fef040d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:12.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 -- 172.21.15.67:0/3667675045 shutdown_connections 2024-09-19T05:39:12.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 -- 172.21.15.67:0/3667675045 wait complete. 2024-09-19T05:39:12.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 Processor -- start 2024-09-19T05:39:12.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 -- start start 2024-09-19T05:39:12.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef04072590 0x7fef04141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef040b4900 0x7fef040989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef0415b1e0 0x7fef04099240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fef041661d0 con 0x7fef040b4900 2024-09-19T05:39:12.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fef04166050 con 0x7fef0415b1e0 2024-09-19T05:39:12.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.504+0000 7fef0a8b4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fef04166350 con 0x7fef04072590 2024-09-19T05:39:12.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef040b4900 0x7fef040989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef040b4900 0x7fef040989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56638/0 (socket says 172.21.15.67:56638) 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef037fe640 1 -- 172.21.15.67:0/1610243720 learned_addr learned my addr 172.21.15.67:0/1610243720 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef03fff640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef04072590 0x7fef04141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef08e51640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef0415b1e0 0x7fef04099240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef037fe640 1 -- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef04072590 msgr2=0x7fef04141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef037fe640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef04072590 0x7fef04141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef037fe640 1 -- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef0415b1e0 msgr2=0x7fef04099240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef037fe640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef0415b1e0 0x7fef04099240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef037fe640 1 -- 172.21.15.67:0/1610243720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef040d0ba0 con 0x7fef040b4900 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef08e51640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef0415b1e0 0x7fef04099240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:12.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef037fe640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef040b4900 0x7fef040989d0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7feef800c500 tx=0x7feef800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:12.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef00ff9640 1 -- 172.21.15.67:0/1610243720 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef80052d0 con 0x7fef040b4900 2024-09-19T05:39:12.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef00ff9640 1 -- 172.21.15.67:0/1610243720 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef8005470 con 0x7fef040b4900 2024-09-19T05:39:12.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef0a8b4640 1 -- 172.21.15.67:0/1610243720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef040701f0 con 0x7fef040b4900 2024-09-19T05:39:12.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef00ff9640 1 -- 172.21.15.67:0/1610243720 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8012830 con 0x7fef040b4900 2024-09-19T05:39:12.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef0a8b4640 1 -- 172.21.15.67:0/1610243720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef04158db0 con 0x7fef040b4900 2024-09-19T05:39:12.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef0a8b4640 1 -- 172.21.15.67:0/1610243720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef040ade10 con 0x7fef040b4900 2024-09-19T05:39:12.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef00ff9640 1 -- 172.21.15.67:0/1610243720 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feef80129d0 con 0x7fef040b4900 2024-09-19T05:39:12.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef00ff9640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feef00678c0 0x7feef0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef00ff9640 1 -- 172.21.15.67:0/1610243720 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7feef8085960 con 0x7fef040b4900 2024-09-19T05:39:12.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.508+0000 7fef03fff640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feef00678c0 0x7feef0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.512+0000 7fef03fff640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feef00678c0 0x7feef0069d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7feef40ae000 tx=0x7feef40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:12.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.512+0000 7fef00ff9640 1 -- 172.21.15.67:0/1610243720 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7feef8056320 con 0x7fef040b4900 2024-09-19T05:39:12.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 -- 172.21.15.67:0/1610243720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fef0406eb30 con 0x7fef040b4900 2024-09-19T05:39:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef00ff9640 1 -- 172.21.15.67:0/1610243720 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1558 (secure 0 0 0) 0x7feef8055c20 con 0x7fef040b4900 2024-09-19T05:39:12.739 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:12.739 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":382,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":100,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":52},{"state_name":"active+clean","count":45}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":365826048,"bytes_avail":772728287232,"bytes_total":773094113280,"inactive_pgs_ratio":0.53608244657516479,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":67,"btime":"2024-09-19T05:39:10:515079+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7215}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-19T05:38:55.225020+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:39:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 -- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feef00678c0 msgr2=0x7feef0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feef00678c0 0x7feef0069d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7feef40ae000 tx=0x7feef40a7000 comp rx=0 tx=0).stop 2024-09-19T05:39:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 -- 172.21.15.67:0/1610243720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef040b4900 msgr2=0x7fef040989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef040b4900 0x7fef040989d0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7feef800c500 tx=0x7feef800c9c0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 -- 172.21.15.67:0/1610243720 shutdown_connections 2024-09-19T05:39:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef0415b1e0 0x7fef04099240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef040b4900 0x7fef040989d0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feef00678c0 0x7feef0069d80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 --2- 172.21.15.67:0/1610243720 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef04072590 0x7fef04141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 -- 172.21.15.67:0/1610243720 >> 172.21.15.67:0/1610243720 conn(0x7fef040d0080 msgr2=0x7fef040b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 -- 172.21.15.67:0/1610243720 shutdown_connections 2024-09-19T05:39:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.740+0000 7fef0a8b4640 1 -- 172.21.15.67:0/1610243720 wait complete. 2024-09-19T05:39:12.758 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T05:39:12.759 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:39:12.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.876+0000 7fcd8edb5640 1 Processor -- start 2024-09-19T05:39:12.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.876+0000 7fcd8edb5640 1 -- start start 2024-09-19T05:39:12.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8edb5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcd8815b710 0x7fcd88071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8edb5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd880b3070 con 0x7fcd8815baf0 2024-09-19T05:39:12.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8edb5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd880afa70 con 0x7fcd880aef40 2024-09-19T05:39:12.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8edb5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fcd880b32e0 con 0x7fcd8815b710 2024-09-19T05:39:12.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd87fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcd8815baf0 0x7fcd8815bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46774/0 (socket says 172.21.15.67:46774) 2024-09-19T05:39:12.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd87fff640 1 -- 172.21.15.67:0/2306742586 learned_addr learned my addr 172.21.15.67:0/2306742586 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:12.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8cb51640 1 --2- 172.21.15.67:0/2306742586 >> v2:172.21.15.97:3300/0 conn(0x7fcd8815b710 0x7fcd88071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182328370 0 0) 0x7fcd880b3070 con 0x7fcd8815baf0 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd70003530 con 0x7fcd8815baf0 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1800190962 0 0) 0x7fcd70003530 con 0x7fcd8815baf0 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 >> v2:172.21.15.97:3300/0 conn(0x7fcd8815b710 msgr2=0x7fcd88071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 --2- 172.21.15.67:0/2306742586 >> v2:172.21.15.97:3300/0 conn(0x7fcd8815b710 0x7fcd88071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 >> v1:172.21.15.97:6789/0 conn(0x7fcd880aef40 legacy=0x7fcd880af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd880b35c0 con 0x7fcd8815baf0 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fcd7c001680 con 0x7fcd8815baf0 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 >> v1:172.21.15.67:6789/0 conn(0x7fcd8815baf0 legacy=0x7fcd8815bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd700039c0 0x7fcd70003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd70004810 0x7fcd70004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd700051d0 0x7fcd7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880b32e0 con 0x7fcd700051d0 2024-09-19T05:39:12.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7000c070 con 0x7fcd70004810 2024-09-19T05:39:12.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7000c270 con 0x7fcd700039c0 2024-09-19T05:39:12.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8d352640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd700051d0 0x7fcd7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8cb51640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd700039c0 0x7fcd70003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8d352640 1 -- 172.21.15.67:0/2306742586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd700039c0 msgr2=0x7fcd70003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:12.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8d352640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd700039c0 0x7fcd70003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8d352640 1 -- 172.21.15.67:0/2306742586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd70004810 msgr2=0x7fcd70004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:12.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8d352640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd70004810 0x7fcd70004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8d352640 1 -- 172.21.15.67:0/2306742586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd70003530 con 0x7fcd700051d0 2024-09-19T05:39:12.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8cb51640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd700039c0 0x7fcd70003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8d352640 1 -- 172.21.15.67:0/2306742586 reap_dead start 2024-09-19T05:39:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd8d352640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd700051d0 0x7fcd7000b9d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fcd80001e70 tx=0x7fcd8001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5149c6163fddf9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80001a90 con 0x7fcd700051d0 2024-09-19T05:39:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd80003bc0 con 0x7fcd700051d0 2024-09-19T05:39:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.880+0000 7fcd877fe640 1 -- 172.21.15.67:0/2306742586 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80005020 con 0x7fcd700051d0 2024-09-19T05:39:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- 172.21.15.67:0/2306742586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd700051d0 msgr2=0x7fcd7000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd700051d0 0x7fcd7000b9d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fcd80001e70 tx=0x7fcd8001c780 comp rx=0 tx=0).stop 2024-09-19T05:39:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- 172.21.15.67:0/2306742586 shutdown_connections 2024-09-19T05:39:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 --2- 172.21.15.67:0/2306742586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd700051d0 0x7fcd7000b9d0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- 172.21.15.67:0/2306742586 >> 172.21.15.67:0/2306742586 conn(0x7fcd880d0080 msgr2=0x7fcd880d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:12.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- 172.21.15.67:0/2306742586 shutdown_connections 2024-09-19T05:39:12.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- 172.21.15.67:0/2306742586 wait complete. 2024-09-19T05:39:12.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 Processor -- start 2024-09-19T05:39:12.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- start start 2024-09-19T05:39:12.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd700051d0 0x7fcd8809ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd8809c8d0 0x7fcd8809cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8815a170 0x7fcd8815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcd88071e80 con 0x7fcd8815a170 2024-09-19T05:39:12.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880b3b80 con 0x7fcd8809c8d0 2024-09-19T05:39:12.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcd88072000 con 0x7fcd700051d0 2024-09-19T05:39:12.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8d352640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8815a170 0x7fcd8815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8d352640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8815a170 0x7fcd8815a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56666/0 (socket says 172.21.15.67:56666) 2024-09-19T05:39:12.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8d352640 1 -- 172.21.15.67:0/785810372 learned_addr learned my addr 172.21.15.67:0/785810372 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8cb51640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd700051d0 0x7fcd8809ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8d352640 1 -- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd700051d0 msgr2=0x7fcd8809ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8d352640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd700051d0 0x7fcd8809ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8d352640 1 -- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd8809c8d0 msgr2=0x7fcd8809cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd87fff640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd8809c8d0 0x7fcd8809cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8d352640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd8809c8d0 0x7fcd8809cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8d352640 1 -- 172.21.15.67:0/785810372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8809d3b0 con 0x7fcd8815a170 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8d352640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8815a170 0x7fcd8815a5f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcd8001cc60 tx=0x7fcd70005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd857fa640 1 -- 172.21.15.67:0/785810372 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd800012e0 con 0x7fcd8815a170 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd857fa640 1 -- 172.21.15.67:0/785810372 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd80003980 con 0x7fcd8815a170 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- 172.21.15.67:0/785810372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8809d690 con 0x7fcd8815a170 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd857fa640 1 -- 172.21.15.67:0/785810372 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80006d60 con 0x7fcd8815a170 2024-09-19T05:39:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.884+0000 7fcd8edb5640 1 -- 172.21.15.67:0/785810372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8809dc50 con 0x7fcd8815a170 2024-09-19T05:39:12.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.888+0000 7fcd8edb5640 1 -- 172.21.15.67:0/785810372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd880b3030 con 0x7fcd8815a170 2024-09-19T05:39:12.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.888+0000 7fcd857fa640 1 -- 172.21.15.67:0/785810372 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd800a6480 con 0x7fcd8815a170 2024-09-19T05:39:12.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.888+0000 7fcd857fa640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcd740678f0 0x7fcd74069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:12.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.888+0000 7fcd857fa640 1 -- 172.21.15.67:0/785810372 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7fcd8011f7e0 con 0x7fcd8815a170 2024-09-19T05:39:12.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.888+0000 7fcd8cb51640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcd740678f0 0x7fcd74069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:12.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.888+0000 7fcd8cb51640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcd740678f0 0x7fcd74069db0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcd780099b0 tx=0x7fcd78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:12.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:12.892+0000 7fcd857fa640 1 -- 172.21.15.67:0/785810372 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fcd800b8060 con 0x7fcd8815a170 2024-09-19T05:39:13.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.044+0000 7fcd8edb5640 1 -- 172.21.15.67:0/785810372 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd880b5020 con 0x7fcd740678f0 2024-09-19T05:39:13.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.060+0000 7fcd857fa640 1 -- 172.21.15.67:0/785810372 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247737 (secure 0 0 0) 0x7fcd880b5020 con 0x7fcd740678f0 2024-09-19T05:39:13.064 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:13.065 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:39:13.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 -- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcd740678f0 msgr2=0x7fcd74069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:13.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcd740678f0 0x7fcd74069db0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcd780099b0 tx=0x7fcd78008040 comp rx=0 tx=0).stop 2024-09-19T05:39:13.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 -- 172.21.15.67:0/785810372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8815a170 msgr2=0x7fcd8815a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8815a170 0x7fcd8815a5f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcd8001cc60 tx=0x7fcd70005840 comp rx=0 tx=0).stop 2024-09-19T05:39:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 -- 172.21.15.67:0/785810372 shutdown_connections 2024-09-19T05:39:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8815a170 0x7fcd8815a5f0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd8809c8d0 0x7fcd8809cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcd740678f0 0x7fcd74069db0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 --2- 172.21.15.67:0/785810372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd700051d0 0x7fcd8809ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 -- 172.21.15.67:0/785810372 >> 172.21.15.67:0/785810372 conn(0x7fcd880d0080 msgr2=0x7fcd8806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 -- 172.21.15.67:0/785810372 shutdown_connections 2024-09-19T05:39:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:13.064+0000 7fcd8edb5640 1 -- 172.21.15.67:0/785810372 wait complete. 2024-09-19T05:39:13.080 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-19T05:39:11.229277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357252,"kb_used_data":10568,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754617468,"statfs":{"total":773094113280,"available":772728287232,"internally_reserved":0,"allocated":10821632,"data_stored":5663160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.783739"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454618+0000","last_change":"2024-09-19T05:39:06.454618+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454618+0000","last_undegraded":"2024-09-19T05:39:06.454618+0000","last_fullsized":"2024-09-19T05:39:06.454618+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500414+0000","last_change":"2024-09-19T05:39:07.492635+0000","last_active":"2024-09-19T05:39:07.500414+0000","last_peered":"2024-09-19T05:39:07.500414+0000","last_clean":"2024-09-19T05:39:07.500414+0000","last_became_active":"2024-09-19T05:39:07.491437+0000","last_became_peered":"2024-09-19T05:39:07.491437+0000","last_unstale":"2024-09-19T05:39:07.500414+0000","last_undegraded":"2024-09-19T05:39:07.500414+0000","last_fullsized":"2024-09-19T05:39:07.500414+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.625174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459512+0000","last_change":"2024-09-19T05:39:06.459512+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459512+0000","last_undegraded":"2024-09-19T05:39:06.459512+0000","last_fullsized":"2024-09-19T05:39:06.459512+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.463465+0000","last_change":"2024-09-19T05:39:06.463465+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.463465+0000","last_undegraded":"2024-09-19T05:39:06.463465+0000","last_fullsized":"2024-09-19T05:39:06.463465+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457619+0000","last_change":"2024-09-19T05:39:06.457619+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457619+0000","last_undegraded":"2024-09-19T05:39:06.457619+0000","last_fullsized":"2024-09-19T05:39:06.457619+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461078+0000","last_change":"2024-09-19T05:39:06.461078+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461078+0000","last_undegraded":"2024-09-19T05:39:06.461078+0000","last_fullsized":"2024-09-19T05:39:06.461078+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462400+0000","last_change":"2024-09-19T05:39:06.462400+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462400+0000","last_undegraded":"2024-09-19T05:39:06.462400+0000","last_fullsized":"2024-09-19T05:39:06.462400+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.468495+0000","last_change":"2024-09-19T05:39:06.468495+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.468495+0000","last_undegraded":"2024-09-19T05:39:06.468495+0000","last_fullsized":"2024-09-19T05:39:06.468495+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.453651+0000","last_change":"2024-09-19T05:39:06.453651+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.453651+0000","last_undegraded":"2024-09-19T05:39:06.453651+0000","last_fullsized":"2024-09-19T05:39:06.453651+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.523878+0000","last_change":"2024-09-19T05:39:07.521121+0000","last_active":"2024-09-19T05:39:07.523878+0000","last_peered":"2024-09-19T05:39:07.523878+0000","last_clean":"2024-09-19T05:39:07.523878+0000","last_became_active":"2024-09-19T05:39:07.520605+0000","last_became_peered":"2024-09-19T05:39:07.520605+0000","last_unstale":"2024-09-19T05:39:07.523878+0000","last_undegraded":"2024-09-19T05:39:07.523878+0000","last_fullsized":"2024-09-19T05:39:07.523878+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:59.240315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454803+0000","last_change":"2024-09-19T05:39:06.454803+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454803+0000","last_undegraded":"2024-09-19T05:39:06.454803+0000","last_fullsized":"2024-09-19T05:39:06.454803+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500902+0000","last_change":"2024-09-19T05:39:07.498214+0000","last_active":"2024-09-19T05:39:07.500902+0000","last_peered":"2024-09-19T05:39:07.500902+0000","last_clean":"2024-09-19T05:39:07.500902+0000","last_became_active":"2024-09-19T05:39:07.497502+0000","last_became_peered":"2024-09-19T05:39:07.497502+0000","last_unstale":"2024-09-19T05:39:07.500902+0000","last_undegraded":"2024-09-19T05:39:07.500902+0000","last_fullsized":"2024-09-19T05:39:07.500902+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:32.098475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462692+0000","last_change":"2024-09-19T05:39:06.462692+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462692+0000","last_undegraded":"2024-09-19T05:39:06.462692+0000","last_fullsized":"2024-09-19T05:39:06.462692+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460045+0000","last_change":"2024-09-19T05:39:06.460045+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460045+0000","last_undegraded":"2024-09-19T05:39:06.460045+0000","last_fullsized":"2024-09-19T05:39:06.460045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461439+0000","last_change":"2024-09-19T05:39:06.461439+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461439+0000","last_undegraded":"2024-09-19T05:39:06.461439+0000","last_fullsized":"2024-09-19T05:39:06.461439+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.477616+0000","last_change":"2024-09-19T05:39:06.477616+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.477616+0000","last_undegraded":"2024-09-19T05:39:06.477616+0000","last_fullsized":"2024-09-19T05:39:06.477616+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459759+0000","last_change":"2024-09-19T05:39:06.459759+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459759+0000","last_undegraded":"2024-09-19T05:39:06.459759+0000","last_fullsized":"2024-09-19T05:39:06.459759+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459015+0000","last_change":"2024-09-19T05:39:06.459015+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459015+0000","last_undegraded":"2024-09-19T05:39:06.459015+0000","last_fullsized":"2024-09-19T05:39:06.459015+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.451195+0000","last_change":"2024-09-19T05:39:06.451195+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.451195+0000","last_undegraded":"2024-09-19T05:39:06.451195+0000","last_fullsized":"2024-09-19T05:39:06.451195+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462888+0000","last_change":"2024-09-19T05:39:06.462888+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462888+0000","last_undegraded":"2024-09-19T05:39:06.462888+0000","last_fullsized":"2024-09-19T05:39:06.462888+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455269+0000","last_change":"2024-09-19T05:39:06.455269+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455269+0000","last_undegraded":"2024-09-19T05:39:06.455269+0000","last_fullsized":"2024-09-19T05:39:06.455269+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458326+0000","last_change":"2024-09-19T05:39:06.458326+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458326+0000","last_undegraded":"2024-09-19T05:39:06.458326+0000","last_fullsized":"2024-09-19T05:39:06.458326+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461778+0000","last_change":"2024-09-19T05:39:06.461778+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461778+0000","last_undegraded":"2024-09-19T05:39:06.461778+0000","last_fullsized":"2024-09-19T05:39:06.461778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455309+0000","last_change":"2024-09-19T05:39:06.455309+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455309+0000","last_undegraded":"2024-09-19T05:39:06.455309+0000","last_fullsized":"2024-09-19T05:39:06.455309+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.515901+0000","last_change":"2024-09-19T05:39:07.513926+0000","last_active":"2024-09-19T05:39:07.515901+0000","last_peered":"2024-09-19T05:39:07.515901+0000","last_clean":"2024-09-19T05:39:07.515901+0000","last_became_active":"2024-09-19T05:39:07.513314+0000","last_became_peered":"2024-09-19T05:39:07.513314+0000","last_unstale":"2024-09-19T05:39:07.515901+0000","last_undegraded":"2024-09-19T05:39:07.515901+0000","last_fullsized":"2024-09-19T05:39:07.515901+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:07.490684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457238+0000","last_change":"2024-09-19T05:39:06.457238+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457238+0000","last_undegraded":"2024-09-19T05:39:06.457238+0000","last_fullsized":"2024-09-19T05:39:06.457238+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.512688+0000","last_change":"2024-09-19T05:39:07.511608+0000","last_active":"2024-09-19T05:39:07.512688+0000","last_peered":"2024-09-19T05:39:07.512688+0000","last_clean":"2024-09-19T05:39:07.512688+0000","last_became_active":"2024-09-19T05:39:07.511317+0000","last_became_peered":"2024-09-19T05:39:07.511317+0000","last_unstale":"2024-09-19T05:39:07.512688+0000","last_undegraded":"2024-09-19T05:39:07.512688+0000","last_fullsized":"2024-09-19T05:39:07.512688+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:23.656844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462308+0000","last_change":"2024-09-19T05:39:06.462308+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462308+0000","last_undegraded":"2024-09-19T05:39:06.462308+0000","last_fullsized":"2024-09-19T05:39:06.462308+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461436+0000","last_change":"2024-09-19T05:39:06.461436+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461436+0000","last_undegraded":"2024-09-19T05:39:06.461436+0000","last_fullsized":"2024-09-19T05:39:06.461436+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.450390+0000","last_change":"2024-09-19T05:39:06.450390+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.450390+0000","last_undegraded":"2024-09-19T05:39:06.450390+0000","last_fullsized":"2024-09-19T05:39:06.450390+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.516378+0000","last_change":"2024-09-19T05:39:07.515306+0000","last_active":"2024-09-19T05:39:07.516378+0000","last_peered":"2024-09-19T05:39:07.516378+0000","last_clean":"2024-09-19T05:39:07.516378+0000","last_became_active":"2024-09-19T05:39:07.514836+0000","last_became_peered":"2024-09-19T05:39:07.514836+0000","last_unstale":"2024-09-19T05:39:07.516378+0000","last_undegraded":"2024-09-19T05:39:07.516378+0000","last_fullsized":"2024-09-19T05:39:07.516378+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:24.860000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.476732+0000","last_change":"2024-09-19T05:39:06.476732+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.476732+0000","last_undegraded":"2024-09-19T05:39:06.476732+0000","last_fullsized":"2024-09-19T05:39:06.476732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459889+0000","last_change":"2024-09-19T05:39:06.459889+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459889+0000","last_undegraded":"2024-09-19T05:39:06.459889+0000","last_fullsized":"2024-09-19T05:39:06.459889+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.492648+0000","last_change":"2024-09-19T05:39:06.485427+0000","last_active":"2024-09-19T05:39:06.492648+0000","last_peered":"2024-09-19T05:39:06.492648+0000","last_clean":"2024-09-19T05:39:06.492648+0000","last_became_active":"2024-09-19T05:39:06.484690+0000","last_became_peered":"2024-09-19T05:39:06.484690+0000","last_unstale":"2024-09-19T05:39:06.492648+0000","last_undegraded":"2024-09-19T05:39:06.492648+0000","last_fullsized":"2024-09-19T05:39:06.492648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:18.254825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.463477+0000","last_change":"2024-09-19T05:39:06.463477+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.463477+0000","last_undegraded":"2024-09-19T05:39:06.463477+0000","last_fullsized":"2024-09-19T05:39:06.463477+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.487248+0000","last_change":"2024-09-19T05:39:06.480222+0000","last_active":"2024-09-19T05:39:06.487248+0000","last_peered":"2024-09-19T05:39:06.487248+0000","last_clean":"2024-09-19T05:39:06.487248+0000","last_became_active":"2024-09-19T05:39:06.478165+0000","last_became_peered":"2024-09-19T05:39:06.478165+0000","last_unstale":"2024-09-19T05:39:06.487248+0000","last_undegraded":"2024-09-19T05:39:06.487248+0000","last_fullsized":"2024-09-19T05:39:06.487248+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:13.250664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461662+0000","last_change":"2024-09-19T05:39:06.461662+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461662+0000","last_undegraded":"2024-09-19T05:39:06.461662+0000","last_fullsized":"2024-09-19T05:39:06.461662+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496368+0000","last_change":"2024-09-19T05:39:06.490107+0000","last_active":"2024-09-19T05:39:06.496368+0000","last_peered":"2024-09-19T05:39:06.496368+0000","last_clean":"2024-09-19T05:39:06.496368+0000","last_became_active":"2024-09-19T05:39:06.489368+0000","last_became_peered":"2024-09-19T05:39:06.489368+0000","last_unstale":"2024-09-19T05:39:06.496368+0000","last_undegraded":"2024-09-19T05:39:06.496368+0000","last_fullsized":"2024-09-19T05:39:06.496368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:15.681556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459172+0000","last_change":"2024-09-19T05:39:06.459172+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459172+0000","last_undegraded":"2024-09-19T05:39:06.459172+0000","last_fullsized":"2024-09-19T05:39:06.459172+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482834+0000","last_change":"2024-09-19T05:39:06.476967+0000","last_active":"2024-09-19T05:39:06.482834+0000","last_peered":"2024-09-19T05:39:06.482834+0000","last_clean":"2024-09-19T05:39:06.482834+0000","last_became_active":"2024-09-19T05:39:06.476220+0000","last_became_peered":"2024-09-19T05:39:06.476220+0000","last_unstale":"2024-09-19T05:39:06.482834+0000","last_undegraded":"2024-09-19T05:39:06.482834+0000","last_fullsized":"2024-09-19T05:39:06.482834+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:16.970848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.465294+0000","last_change":"2024-09-19T05:39:06.465294+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.465294+0000","last_undegraded":"2024-09-19T05:39:06.465294+0000","last_fullsized":"2024-09-19T05:39:06.465294+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.480520+0000","last_change":"2024-09-19T05:39:06.477568+0000","last_active":"2024-09-19T05:39:06.480520+0000","last_peered":"2024-09-19T05:39:06.480520+0000","last_clean":"2024-09-19T05:39:06.480520+0000","last_became_active":"2024-09-19T05:39:06.475121+0000","last_became_peered":"2024-09-19T05:39:06.475121+0000","last_unstale":"2024-09-19T05:39:06.480520+0000","last_undegraded":"2024-09-19T05:39:06.480520+0000","last_fullsized":"2024-09-19T05:39:06.480520+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:20.439330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462796+0000","last_change":"2024-09-19T05:39:06.462796+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462796+0000","last_undegraded":"2024-09-19T05:39:06.462796+0000","last_fullsized":"2024-09-19T05:39:06.462796+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.471647+0000","last_change":"2024-09-19T05:39:06.470618+0000","last_active":"2024-09-19T05:39:06.471647+0000","last_peered":"2024-09-19T05:39:06.471647+0000","last_clean":"2024-09-19T05:39:06.471647+0000","last_became_active":"2024-09-19T05:39:06.470223+0000","last_became_peered":"2024-09-19T05:39:06.470223+0000","last_unstale":"2024-09-19T05:39:06.471647+0000","last_undegraded":"2024-09-19T05:39:06.471647+0000","last_fullsized":"2024-09-19T05:39:06.471647+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.663250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460540+0000","last_change":"2024-09-19T05:39:06.460540+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460540+0000","last_undegraded":"2024-09-19T05:39:06.460540+0000","last_fullsized":"2024-09-19T05:39:06.460540+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.473973+0000","last_change":"2024-09-19T05:39:06.473491+0000","last_active":"2024-09-19T05:39:06.473973+0000","last_peered":"2024-09-19T05:39:06.473973+0000","last_clean":"2024-09-19T05:39:06.473973+0000","last_became_active":"2024-09-19T05:39:06.473154+0000","last_became_peered":"2024-09-19T05:39:06.473154+0000","last_unstale":"2024-09-19T05:39:06.473973+0000","last_undegraded":"2024-09-19T05:39:06.473973+0000","last_fullsized":"2024-09-19T05:39:06.473973+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459002+0000","last_change":"2024-09-19T05:39:06.459002+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459002+0000","last_undegraded":"2024-09-19T05:39:06.459002+0000","last_fullsized":"2024-09-19T05:39:06.459002+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496530+0000","last_change":"2024-09-19T05:39:06.491620+0000","last_active":"2024-09-19T05:39:06.496530+0000","last_peered":"2024-09-19T05:39:06.496530+0000","last_clean":"2024-09-19T05:39:06.496530+0000","last_became_active":"2024-09-19T05:39:06.491275+0000","last_became_peered":"2024-09-19T05:39:06.491275+0000","last_unstale":"2024-09-19T05:39:06.496530+0000","last_undegraded":"2024-09-19T05:39:06.496530+0000","last_fullsized":"2024-09-19T05:39:06.496530+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:14.227757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.450203+0000","last_change":"2024-09-19T05:39:06.450203+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.450203+0000","last_undegraded":"2024-09-19T05:39:06.450203+0000","last_fullsized":"2024-09-19T05:39:06.450203+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485850+0000","last_change":"2024-09-19T05:39:06.484638+0000","last_active":"2024-09-19T05:39:07.485850+0000","last_peered":"2024-09-19T05:39:07.485850+0000","last_clean":"2024-09-19T05:39:07.485850+0000","last_became_active":"2024-09-19T05:39:06.483824+0000","last_became_peered":"2024-09-19T05:39:06.483824+0000","last_unstale":"2024-09-19T05:39:07.485850+0000","last_undegraded":"2024-09-19T05:39:07.485850+0000","last_fullsized":"2024-09-19T05:39:07.485850+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:44:31.297046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.464045+0000","last_change":"2024-09-19T05:39:06.464045+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.464045+0000","last_undegraded":"2024-09-19T05:39:06.464045+0000","last_fullsized":"2024-09-19T05:39:06.464045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.472922+0000","last_change":"2024-09-19T05:39:06.472058+0000","last_active":"2024-09-19T05:39:06.472922+0000","last_peered":"2024-09-19T05:39:06.472922+0000","last_clean":"2024-09-19T05:39:06.472922+0000","last_became_active":"2024-09-19T05:39:06.471408+0000","last_became_peered":"2024-09-19T05:39:06.471408+0000","last_unstale":"2024-09-19T05:39:06.472922+0000","last_undegraded":"2024-09-19T05:39:06.472922+0000","last_fullsized":"2024-09-19T05:39:06.472922+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454843+0000","last_change":"2024-09-19T05:39:06.454843+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454843+0000","last_undegraded":"2024-09-19T05:39:06.454843+0000","last_fullsized":"2024-09-19T05:39:06.454843+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.462773+0000","last_change":"2024-09-19T05:39:06.459521+0000","last_active":"2024-09-19T05:39:06.462773+0000","last_peered":"2024-09-19T05:39:06.462773+0000","last_clean":"2024-09-19T05:39:06.462773+0000","last_became_active":"2024-09-19T05:39:06.458765+0000","last_became_peered":"2024-09-19T05:39:06.458765+0000","last_unstale":"2024-09-19T05:39:06.462773+0000","last_undegraded":"2024-09-19T05:39:06.462773+0000","last_fullsized":"2024-09-19T05:39:06.462773+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:54.147667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.461370+0000","last_change":"2024-09-19T05:39:06.461370+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.461370+0000","last_undegraded":"2024-09-19T05:39:06.461370+0000","last_fullsized":"2024-09-19T05:39:06.461370+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482148+0000","last_change":"2024-09-19T05:39:06.477718+0000","last_active":"2024-09-19T05:39:06.482148+0000","last_peered":"2024-09-19T05:39:06.482148+0000","last_clean":"2024-09-19T05:39:06.482148+0000","last_became_active":"2024-09-19T05:39:06.477354+0000","last_became_peered":"2024-09-19T05:39:06.477354+0000","last_unstale":"2024-09-19T05:39:06.482148+0000","last_undegraded":"2024-09-19T05:39:06.482148+0000","last_fullsized":"2024-09-19T05:39:06.482148+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460580+0000","last_change":"2024-09-19T05:39:06.460580+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460580+0000","last_undegraded":"2024-09-19T05:39:06.460580+0000","last_fullsized":"2024-09-19T05:39:06.460580+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496529+0000","last_change":"2024-09-19T05:39:06.491796+0000","last_active":"2024-09-19T05:39:06.496529+0000","last_peered":"2024-09-19T05:39:06.496529+0000","last_clean":"2024-09-19T05:39:06.496529+0000","last_became_active":"2024-09-19T05:39:06.490945+0000","last_became_peered":"2024-09-19T05:39:06.490945+0000","last_unstale":"2024-09-19T05:39:06.496529+0000","last_undegraded":"2024-09-19T05:39:06.496529+0000","last_fullsized":"2024-09-19T05:39:06.496529+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:12.345025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.452188+0000","last_change":"2024-09-19T05:39:06.452188+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.452188+0000","last_undegraded":"2024-09-19T05:39:06.452188+0000","last_fullsized":"2024-09-19T05:39:06.452188+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.484071+0000","last_change":"2024-09-19T05:39:06.482148+0000","last_active":"2024-09-19T05:39:06.484071+0000","last_peered":"2024-09-19T05:39:06.484071+0000","last_clean":"2024-09-19T05:39:06.484071+0000","last_became_active":"2024-09-19T05:39:06.477485+0000","last_became_peered":"2024-09-19T05:39:06.477485+0000","last_unstale":"2024-09-19T05:39:06.484071+0000","last_undegraded":"2024-09-19T05:39:06.484071+0000","last_fullsized":"2024-09-19T05:39:06.484071+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:23.889902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.523778+0000","last_change":"2024-09-19T05:39:07.520981+0000","last_active":"2024-09-19T05:39:07.523778+0000","last_peered":"2024-09-19T05:39:07.523778+0000","last_clean":"2024-09-19T05:39:07.523778+0000","last_became_active":"2024-09-19T05:39:07.520621+0000","last_became_peered":"2024-09-19T05:39:07.520621+0000","last_unstale":"2024-09-19T05:39:07.523778+0000","last_undegraded":"2024-09-19T05:39:07.523778+0000","last_fullsized":"2024-09-19T05:39:07.523778+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:18.770956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.485776+0000","last_change":"2024-09-19T05:39:06.484372+0000","last_active":"2024-09-19T05:39:06.485776+0000","last_peered":"2024-09-19T05:39:06.485776+0000","last_clean":"2024-09-19T05:39:06.485776+0000","last_became_active":"2024-09-19T05:39:06.484002+0000","last_became_peered":"2024-09-19T05:39:06.484002+0000","last_unstale":"2024-09-19T05:39:06.485776+0000","last_undegraded":"2024-09-19T05:39:06.485776+0000","last_fullsized":"2024-09-19T05:39:06.485776+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:03.627009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.501139+0000","last_change":"2024-09-19T05:39:07.492388+0000","last_active":"2024-09-19T05:39:07.501139+0000","last_peered":"2024-09-19T05:39:07.501139+0000","last_clean":"2024-09-19T05:39:07.501139+0000","last_became_active":"2024-09-19T05:39:07.489450+0000","last_became_peered":"2024-09-19T05:39:07.489450+0000","last_unstale":"2024-09-19T05:39:07.501139+0000","last_undegraded":"2024-09-19T05:39:07.501139+0000","last_fullsized":"2024-09-19T05:39:07.501139+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:27.889589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.471472+0000","last_change":"2024-09-19T05:39:06.470272+0000","last_active":"2024-09-19T05:39:06.471472+0000","last_peered":"2024-09-19T05:39:06.471472+0000","last_clean":"2024-09-19T05:39:06.471472+0000","last_became_active":"2024-09-19T05:39:06.469862+0000","last_became_peered":"2024-09-19T05:39:06.469862+0000","last_unstale":"2024-09-19T05:39:06.471472+0000","last_undegraded":"2024-09-19T05:39:06.471472+0000","last_fullsized":"2024-09-19T05:39:06.471472+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.130680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.459328+0000","last_change":"2024-09-19T05:39:06.459328+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.459328+0000","last_undegraded":"2024-09-19T05:39:06.459328+0000","last_fullsized":"2024-09-19T05:39:06.459328+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.494277+0000","last_change":"2024-09-19T05:39:06.492000+0000","last_active":"2024-09-19T05:39:06.494277+0000","last_peered":"2024-09-19T05:39:06.494277+0000","last_clean":"2024-09-19T05:39:06.494277+0000","last_became_active":"2024-09-19T05:39:06.491277+0000","last_became_peered":"2024-09-19T05:39:06.491277+0000","last_unstale":"2024-09-19T05:39:06.494277+0000","last_undegraded":"2024-09-19T05:39:06.494277+0000","last_fullsized":"2024-09-19T05:39:06.494277+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:31.359640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.460309+0000","last_change":"2024-09-19T05:39:06.460309+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.460309+0000","last_undegraded":"2024-09-19T05:39:06.460309+0000","last_fullsized":"2024-09-19T05:39:06.460309+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496916+0000","last_change":"2024-09-19T05:39:06.495628+0000","last_active":"2024-09-19T05:39:06.496916+0000","last_peered":"2024-09-19T05:39:06.496916+0000","last_clean":"2024-09-19T05:39:06.496916+0000","last_became_active":"2024-09-19T05:39:06.491383+0000","last_became_peered":"2024-09-19T05:39:06.491383+0000","last_unstale":"2024-09-19T05:39:06.496916+0000","last_undegraded":"2024-09-19T05:39:06.496916+0000","last_fullsized":"2024-09-19T05:39:06.496916+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.451129+0000","last_change":"2024-09-19T05:39:06.451129+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.451129+0000","last_undegraded":"2024-09-19T05:39:06.451129+0000","last_fullsized":"2024-09-19T05:39:06.451129+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.490115+0000","last_change":"2024-09-19T05:39:06.488703+0000","last_active":"2024-09-19T05:39:06.490115+0000","last_peered":"2024-09-19T05:39:06.490115+0000","last_clean":"2024-09-19T05:39:06.490115+0000","last_became_active":"2024-09-19T05:39:06.487165+0000","last_became_peered":"2024-09-19T05:39:06.487165+0000","last_unstale":"2024-09-19T05:39:06.490115+0000","last_undegraded":"2024-09-19T05:39:06.490115+0000","last_fullsized":"2024-09-19T05:39:06.490115+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.948878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456505+0000","last_change":"2024-09-19T05:39:06.456505+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456505+0000","last_undegraded":"2024-09-19T05:39:06.456505+0000","last_fullsized":"2024-09-19T05:39:06.456505+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.520360+0000","last_change":"2024-09-19T05:39:06.487040+0000","last_active":"2024-09-19T05:39:07.520360+0000","last_peered":"2024-09-19T05:39:07.520360+0000","last_clean":"2024-09-19T05:39:07.520360+0000","last_became_active":"2024-09-19T05:39:06.485399+0000","last_became_peered":"2024-09-19T05:39:06.485399+0000","last_unstale":"2024-09-19T05:39:07.520360+0000","last_undegraded":"2024-09-19T05:39:07.520360+0000","last_fullsized":"2024-09-19T05:39:07.520360+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.642703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500486+0000","last_change":"2024-09-19T05:39:07.493726+0000","last_active":"2024-09-19T05:39:07.500486+0000","last_peered":"2024-09-19T05:39:07.500486+0000","last_clean":"2024-09-19T05:39:07.500486+0000","last_became_active":"2024-09-19T05:39:07.492964+0000","last_became_peered":"2024-09-19T05:39:07.492964+0000","last_unstale":"2024-09-19T05:39:07.500486+0000","last_undegraded":"2024-09-19T05:39:07.500486+0000","last_fullsized":"2024-09-19T05:39:07.500486+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:02.364388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.477119+0000","last_change":"2024-09-19T05:39:06.474748+0000","last_active":"2024-09-19T05:39:07.477119+0000","last_peered":"2024-09-19T05:39:07.477119+0000","last_clean":"2024-09-19T05:39:07.477119+0000","last_became_active":"2024-09-19T05:39:06.474265+0000","last_became_peered":"2024-09-19T05:39:06.474265+0000","last_unstale":"2024-09-19T05:39:07.477119+0000","last_undegraded":"2024-09-19T05:39:07.477119+0000","last_fullsized":"2024-09-19T05:39:07.477119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:08.194710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.519847+0000","last_change":"2024-09-19T05:39:07.510540+0000","last_active":"2024-09-19T05:39:07.519847+0000","last_peered":"2024-09-19T05:39:07.519847+0000","last_clean":"2024-09-19T05:39:07.519847+0000","last_became_active":"2024-09-19T05:39:07.509867+0000","last_became_peered":"2024-09-19T05:39:07.509867+0000","last_unstale":"2024-09-19T05:39:07.519847+0000","last_undegraded":"2024-09-19T05:39:07.519847+0000","last_fullsized":"2024-09-19T05:39:07.519847+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:06.006975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485238+0000","last_change":"2024-09-19T05:39:06.486335+0000","last_active":"2024-09-19T05:39:07.485238+0000","last_peered":"2024-09-19T05:39:07.485238+0000","last_clean":"2024-09-19T05:39:07.485238+0000","last_became_active":"2024-09-19T05:39:06.483059+0000","last_became_peered":"2024-09-19T05:39:06.483059+0000","last_unstale":"2024-09-19T05:39:07.485238+0000","last_undegraded":"2024-09-19T05:39:07.485238+0000","last_fullsized":"2024-09-19T05:39:07.485238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:33.395321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458614+0000","last_change":"2024-09-19T05:39:06.458614+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458614+0000","last_undegraded":"2024-09-19T05:39:06.458614+0000","last_fullsized":"2024-09-19T05:39:06.458614+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.476370+0000","last_change":"2024-09-19T05:39:06.488093+0000","last_active":"2024-09-19T05:39:07.476370+0000","last_peered":"2024-09-19T05:39:07.476370+0000","last_clean":"2024-09-19T05:39:07.476370+0000","last_became_active":"2024-09-19T05:39:06.487576+0000","last_became_peered":"2024-09-19T05:39:06.487576+0000","last_unstale":"2024-09-19T05:39:07.476370+0000","last_undegraded":"2024-09-19T05:39:07.476370+0000","last_fullsized":"2024-09-19T05:39:07.476370+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:03.461184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.458849+0000","last_change":"2024-09-19T05:39:06.458849+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.458849+0000","last_undegraded":"2024-09-19T05:39:06.458849+0000","last_fullsized":"2024-09-19T05:39:06.458849+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496980+0000","last_change":"2024-09-19T05:39:06.495673+0000","last_active":"2024-09-19T05:39:06.496980+0000","last_peered":"2024-09-19T05:39:06.496980+0000","last_clean":"2024-09-19T05:39:06.496980+0000","last_became_active":"2024-09-19T05:39:06.489071+0000","last_became_peered":"2024-09-19T05:39:06.489071+0000","last_unstale":"2024-09-19T05:39:06.496980+0000","last_undegraded":"2024-09-19T05:39:06.496980+0000","last_fullsized":"2024-09-19T05:39:06.496980+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:12.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.455916+0000","last_change":"2024-09-19T05:39:06.455916+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.455916+0000","last_undegraded":"2024-09-19T05:39:06.455916+0000","last_fullsized":"2024-09-19T05:39:06.455916+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.478630+0000","last_change":"2024-09-19T05:39:06.476552+0000","last_active":"2024-09-19T05:39:06.478630+0000","last_peered":"2024-09-19T05:39:06.478630+0000","last_clean":"2024-09-19T05:39:06.478630+0000","last_became_active":"2024-09-19T05:39:06.475840+0000","last_became_peered":"2024-09-19T05:39:06.475840+0000","last_unstale":"2024-09-19T05:39:06.478630+0000","last_undegraded":"2024-09-19T05:39:06.478630+0000","last_fullsized":"2024-09-19T05:39:06.478630+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:25.266383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456668+0000","last_change":"2024-09-19T05:39:06.456668+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456668+0000","last_undegraded":"2024-09-19T05:39:06.456668+0000","last_fullsized":"2024-09-19T05:39:06.456668+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.462055+0000","last_change":"2024-09-19T05:39:06.459439+0000","last_active":"2024-09-19T05:39:06.462055+0000","last_peered":"2024-09-19T05:39:06.462055+0000","last_clean":"2024-09-19T05:39:06.462055+0000","last_became_active":"2024-09-19T05:39:06.458677+0000","last_became_peered":"2024-09-19T05:39:06.458677+0000","last_unstale":"2024-09-19T05:39:06.462055+0000","last_undegraded":"2024-09-19T05:39:06.462055+0000","last_fullsized":"2024-09-19T05:39:06.462055+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.829966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.500894+0000","last_change":"2024-09-19T05:39:07.497197+0000","last_active":"2024-09-19T05:39:07.500894+0000","last_peered":"2024-09-19T05:39:07.500894+0000","last_clean":"2024-09-19T05:39:07.500894+0000","last_became_active":"2024-09-19T05:39:07.496238+0000","last_became_peered":"2024-09-19T05:39:07.496238+0000","last_unstale":"2024-09-19T05:39:07.500894+0000","last_undegraded":"2024-09-19T05:39:07.500894+0000","last_fullsized":"2024-09-19T05:39:07.500894+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:48.100081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482559+0000","last_change":"2024-09-19T05:39:06.467833+0000","last_active":"2024-09-19T05:39:06.482559+0000","last_peered":"2024-09-19T05:39:06.482559+0000","last_clean":"2024-09-19T05:39:06.482559+0000","last_became_active":"2024-09-19T05:39:06.466980+0000","last_became_peered":"2024-09-19T05:39:06.466980+0000","last_unstale":"2024-09-19T05:39:06.482559+0000","last_undegraded":"2024-09-19T05:39:06.482559+0000","last_fullsized":"2024-09-19T05:39:06.482559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.663250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.508476+0000","last_change":"2024-09-19T05:39:07.506052+0000","last_active":"2024-09-19T05:39:07.508476+0000","last_peered":"2024-09-19T05:39:07.508476+0000","last_clean":"2024-09-19T05:39:07.508476+0000","last_became_active":"2024-09-19T05:39:07.505690+0000","last_became_peered":"2024-09-19T05:39:07.505690+0000","last_unstale":"2024-09-19T05:39:07.508476+0000","last_undegraded":"2024-09-19T05:39:07.508476+0000","last_fullsized":"2024-09-19T05:39:07.508476+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:05.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482114+0000","last_change":"2024-09-19T05:39:06.477685+0000","last_active":"2024-09-19T05:39:06.482114+0000","last_peered":"2024-09-19T05:39:06.482114+0000","last_clean":"2024-09-19T05:39:06.482114+0000","last_became_active":"2024-09-19T05:39:06.477270+0000","last_became_peered":"2024-09-19T05:39:06.477270+0000","last_unstale":"2024-09-19T05:39:06.482114+0000","last_undegraded":"2024-09-19T05:39:06.482114+0000","last_fullsized":"2024-09-19T05:39:06.482114+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:40.918835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.454595+0000","last_change":"2024-09-19T05:39:06.454595+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.454595+0000","last_undegraded":"2024-09-19T05:39:06.454595+0000","last_fullsized":"2024-09-19T05:39:06.454595+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-19T05:39:07.485346+0000","last_change":"2024-09-19T05:39:06.487038+0000","last_active":"2024-09-19T05:39:07.485346+0000","last_peered":"2024-09-19T05:39:07.485346+0000","last_clean":"2024-09-19T05:39:07.485346+0000","last_became_active":"2024-09-19T05:39:06.486191+0000","last_became_peered":"2024-09-19T05:39:06.486191+0000","last_unstale":"2024-09-19T05:39:07.485346+0000","last_undegraded":"2024-09-19T05:39:07.485346+0000","last_fullsized":"2024-09-19T05:39:07.485346+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:57.630895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.457046+0000","last_change":"2024-09-19T05:39:06.457046+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.457046+0000","last_undegraded":"2024-09-19T05:39:06.457046+0000","last_fullsized":"2024-09-19T05:39:06.457046+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.482851+0000","last_change":"2024-09-19T05:39:06.476838+0000","last_active":"2024-09-19T05:39:06.482851+0000","last_peered":"2024-09-19T05:39:06.482851+0000","last_clean":"2024-09-19T05:39:06.482851+0000","last_became_active":"2024-09-19T05:39:06.476128+0000","last_became_peered":"2024-09-19T05:39:06.476128+0000","last_unstale":"2024-09-19T05:39:06.482851+0000","last_undegraded":"2024-09-19T05:39:06.482851+0000","last_fullsized":"2024-09-19T05:39:06.482851+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:03.627009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.456040+0000","last_change":"2024-09-19T05:39:06.456040+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.456040+0000","last_undegraded":"2024-09-19T05:39:06.456040+0000","last_fullsized":"2024-09-19T05:39:06.456040+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.496502+0000","last_change":"2024-09-19T05:39:06.489874+0000","last_active":"2024-09-19T05:39:06.496502+0000","last_peered":"2024-09-19T05:39:06.496502+0000","last_clean":"2024-09-19T05:39:06.496502+0000","last_became_active":"2024-09-19T05:39:06.489133+0000","last_became_peered":"2024-09-19T05:39:06.489133+0000","last_unstale":"2024-09-19T05:39:06.496502+0000","last_undegraded":"2024-09-19T05:39:06.496502+0000","last_fullsized":"2024-09-19T05:39:06.496502+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:04.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-09-19T05:39:06.462879+0000","last_change":"2024-09-19T05:39:06.462879+0000","last_active":"2024-09-19T05:39:06.438981+0000","last_peered":"2024-09-19T05:39:06.438981+0000","last_clean":"2024-09-19T05:39:06.438981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:06.462879+0000","last_undegraded":"2024-09-19T05:39:06.462879+0000","last_fullsized":"2024-09-19T05:39:06.462879+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.488099+0000","last_change":"2024-09-19T05:39:06.486153+0000","last_active":"2024-09-19T05:39:06.488099+0000","last_peered":"2024-09-19T05:39:06.488099+0000","last_clean":"2024-09-19T05:39:06.488099+0000","last_became_active":"2024-09-19T05:39:06.485868+0000","last_became_peered":"2024-09-19T05:39:06.485868+0000","last_unstale":"2024-09-19T05:39:06.488099+0000","last_undegraded":"2024-09-19T05:39:06.488099+0000","last_fullsized":"2024-09-19T05:39:06.488099+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:16.970848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":308,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-19T05:39:06.473730+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:39:06.473730+0000","last_peered":"2024-09-19T05:39:06.473730+0000","last_clean":"2024-09-19T05:39:06.473730+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:39:06.473730+0000","last_undegraded":"2024-09-19T05:39:06.473730+0000","last_fullsized":"2024-09-19T05:39:06.473730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542219,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1798144,"data_stored":1150671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542219,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40688,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331152,"statfs":{"total":96636764160,"available":96595099648,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542221,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44844,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326996,"statfs":{"total":96636764160,"available":96590843904,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50416,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321424,"statfs":{"total":96636764160,"available":96585138176,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46256,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325584,"statfs":{"total":96636764160,"available":96589398016,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40688,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331152,"statfs":{"total":96636764160,"available":96595099648,"internally_reserved":0,"allocated":1204224,"data_stored":560303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542219,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1798144,"data_stored":1150671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:39:13.435 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:39:13.436+0000 7f36b1d69640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:39:16.086 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f528b422640 1 Processor -- start 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f528b422640 1 -- start start 2024-09-19T05:39:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f528b422640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f528406dde0 0x7f52840b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f528b422640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f52840b3510 0x7f528406f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f528b422640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528406e3c0 con 0x7f528415c030 2024-09-19T05:39:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f528b422640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f528406e6a0 con 0x7f528406dde0 2024-09-19T05:39:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f528b422640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f528406e980 con 0x7f52840b3510 2024-09-19T05:39:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f52889bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f528406dde0 0x7f52840b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f52889bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f528406dde0 0x7f52840b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52248/0 (socket says 172.21.15.67:52248) 2024-09-19T05:39:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f52889bd640 1 -- 172.21.15.67:0/2366251503 learned_addr learned my addr 172.21.15.67:0/2366251503 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f52899bf640 1 --2- 172.21.15.67:0/2366251503 >> v2:172.21.15.97:3300/0 conn(0x7f52840b3510 0x7f528406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f52889bd640 1 -- 172.21.15.67:0/2366251503 >> v2:172.21.15.97:3300/0 conn(0x7f52840b3510 msgr2=0x7f528406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f52889bd640 1 --2- 172.21.15.67:0/2366251503 >> v2:172.21.15.97:3300/0 conn(0x7f52840b3510 0x7f528406f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f52889bd640 1 -- 172.21.15.67:0/2366251503 >> v1:172.21.15.97:6789/0 conn(0x7f528415c030 legacy=0x7f528415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.220+0000 7f52889bd640 1 -- 172.21.15.67:0/2366251503 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528406ec60 con 0x7f528406dde0 2024-09-19T05:39:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f52889bd640 1 --2- 172.21.15.67:0/2366251503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f528406dde0 0x7f52840b2fd0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f52840afbf0 tx=0x7f527401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fafc44aba4297d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f527bfff640 1 -- 172.21.15.67:0/2366251503 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52740b1070 con 0x7f528406dde0 2024-09-19T05:39:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f527bfff640 1 -- 172.21.15.67:0/2366251503 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52740ac620 con 0x7f528406dde0 2024-09-19T05:39:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f527bfff640 1 -- 172.21.15.67:0/2366251503 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52740ac9f0 con 0x7f528406dde0 2024-09-19T05:39:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 -- 172.21.15.67:0/2366251503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f528406dde0 msgr2=0x7f52840b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 --2- 172.21.15.67:0/2366251503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f528406dde0 0x7f52840b2fd0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f52840afbf0 tx=0x7f527401c4b0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 -- 172.21.15.67:0/2366251503 shutdown_connections 2024-09-19T05:39:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 --2- 172.21.15.67:0/2366251503 >> v2:172.21.15.97:3300/0 conn(0x7f52840b3510 0x7f528406f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 --2- 172.21.15.67:0/2366251503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f528406dde0 0x7f52840b2fd0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 -- 172.21.15.67:0/2366251503 >> 172.21.15.67:0/2366251503 conn(0x7f52840d0080 msgr2=0x7f52840d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 -- 172.21.15.67:0/2366251503 shutdown_connections 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 -- 172.21.15.67:0/2366251503 wait complete. 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 Processor -- start 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 -- start start 2024-09-19T05:39:16.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f528406dde0 0x7f5284151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52840b3510 0x7f528415dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f528415c030 0x7f528415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f52841692f0 con 0x7f52840b3510 2024-09-19T05:39:16.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f528415c620 con 0x7f528406dde0 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f528b422640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5284169470 con 0x7f528415c030 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f52889bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52840b3510 0x7f528415dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f52889bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52840b3510 0x7f528415dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52264/0 (socket says 172.21.15.67:52264) 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f52889bd640 1 -- 172.21.15.67:0/1734277707 learned_addr learned my addr 172.21.15.67:0/1734277707 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f52899bf640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f528415c030 0x7f528415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.224+0000 7f52891be640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f528406dde0 0x7f5284151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f52889bd640 1 -- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f528415c030 msgr2=0x7f528415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f52889bd640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f528415c030 0x7f528415e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f52889bd640 1 -- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f528406dde0 msgr2=0x7f5284151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f52889bd640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f528406dde0 0x7f5284151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f52889bd640 1 -- 172.21.15.67:0/1734277707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5284157180 con 0x7f52840b3510 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f52889bd640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52840b3510 0x7f528415dda0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f52740af040 tx=0x7f5274019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f5279ffb640 1 -- 172.21.15.67:0/1734277707 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52740b1040 con 0x7f52840b3510 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f5279ffb640 1 -- 172.21.15.67:0/1734277707 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52740ac420 con 0x7f52840b3510 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f5279ffb640 1 -- 172.21.15.67:0/1734277707 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52740b5660 con 0x7f52840b3510 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f528b422640 1 -- 172.21.15.67:0/1734277707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5284157460 con 0x7f52840b3510 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f528b422640 1 -- 172.21.15.67:0/1734277707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5284157a20 con 0x7f52840b3510 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f528b422640 1 -- 172.21.15.67:0/1734277707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52840b2fd0 con 0x7f52840b3510 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f5279ffb640 1 -- 172.21.15.67:0/1734277707 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f52740bc020 con 0x7f52840b3510 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f5279ffb640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52680678f0 0x7f5268069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f5279ffb640 1 -- 172.21.15.67:0/1734277707 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f527411f390 con 0x7f52840b3510 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f52891be640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52680678f0 0x7f5268069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.228+0000 7f52891be640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52680678f0 0x7f5268069db0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f528000b810 tx=0x7f5280008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.232+0000 7f5279ffb640 1 -- 172.21.15.67:0/1734277707 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f52740c3020 con 0x7f52840b3510 2024-09-19T05:39:16.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.392+0000 7f528b422640 1 -- 172.21.15.67:0/1734277707 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52840d0f20 con 0x7f52680678f0 2024-09-19T05:39:16.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.412+0000 7f5279ffb640 1 -- 172.21.15.67:0/1734277707 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252174 (secure 0 0 0) 0x7f52840d0f20 con 0x7f52680678f0 2024-09-19T05:39:16.413 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:16.415 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:39:16.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 -- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52680678f0 msgr2=0x7f5268069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52680678f0 0x7f5268069db0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f528000b810 tx=0x7f5280008040 comp rx=0 tx=0).stop 2024-09-19T05:39:16.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 -- 172.21.15.67:0/1734277707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52840b3510 msgr2=0x7f528415dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52840b3510 0x7f528415dda0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f52740af040 tx=0x7f5274019250 comp rx=0 tx=0).stop 2024-09-19T05:39:16.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 -- 172.21.15.67:0/1734277707 shutdown_connections 2024-09-19T05:39:16.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52680678f0 0x7f5268069db0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f528415c030 0x7f528415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52840b3510 0x7f528415dda0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 --2- 172.21.15.67:0/1734277707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f528406dde0 0x7f5284151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 -- 172.21.15.67:0/1734277707 >> 172.21.15.67:0/1734277707 conn(0x7f52840d0080 msgr2=0x7f52840b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 -- 172.21.15.67:0/1734277707 shutdown_connections 2024-09-19T05:39:16.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.416+0000 7f528b422640 1 -- 172.21.15.67:0/1734277707 wait complete. 2024-09-19T05:39:16.432 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-09-19T05:39:15.230781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357492,"kb_used_data":10824,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754617228,"statfs":{"total":773094113280,"available":772728041472,"internally_reserved":0,"allocated":11083776,"data_stored":5778852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002654"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.474138+0000","last_change":"2024-09-19T05:39:07.508207+0000","last_active":"2024-09-19T05:39:08.474138+0000","last_peered":"2024-09-19T05:39:08.474138+0000","last_clean":"2024-09-19T05:39:08.474138+0000","last_became_active":"2024-09-19T05:39:07.507790+0000","last_became_peered":"2024-09-19T05:39:07.507790+0000","last_unstale":"2024-09-19T05:39:08.474138+0000","last_undegraded":"2024-09-19T05:39:08.474138+0000","last_fullsized":"2024-09-19T05:39:08.474138+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:04.633001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.510521+0000","last_change":"2024-09-19T05:39:07.492635+0000","last_active":"2024-09-19T05:39:08.510521+0000","last_peered":"2024-09-19T05:39:08.510521+0000","last_clean":"2024-09-19T05:39:08.510521+0000","last_became_active":"2024-09-19T05:39:07.491437+0000","last_became_peered":"2024-09-19T05:39:07.491437+0000","last_unstale":"2024-09-19T05:39:08.510521+0000","last_undegraded":"2024-09-19T05:39:08.510521+0000","last_fullsized":"2024-09-19T05:39:08.510521+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:28.518174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.473500+0000","last_change":"2024-09-19T05:39:07.479604+0000","last_active":"2024-09-19T05:39:08.473500+0000","last_peered":"2024-09-19T05:39:08.473500+0000","last_clean":"2024-09-19T05:39:08.473500+0000","last_became_active":"2024-09-19T05:39:07.478752+0000","last_became_peered":"2024-09-19T05:39:07.478752+0000","last_unstale":"2024-09-19T05:39:08.473500+0000","last_undegraded":"2024-09-19T05:39:08.473500+0000","last_fullsized":"2024-09-19T05:39:08.473500+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:12.143732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527074+0000","last_change":"2024-09-19T05:39:07.531104+0000","last_active":"2024-09-19T05:39:09.527074+0000","last_peered":"2024-09-19T05:39:09.527074+0000","last_clean":"2024-09-19T05:39:09.527074+0000","last_became_active":"2024-09-19T05:39:07.530818+0000","last_became_peered":"2024-09-19T05:39:07.530818+0000","last_unstale":"2024-09-19T05:39:09.527074+0000","last_undegraded":"2024-09-19T05:39:09.527074+0000","last_fullsized":"2024-09-19T05:39:09.527074+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.226928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.471916+0000","last_change":"2024-09-19T05:39:07.513994+0000","last_active":"2024-09-19T05:39:08.471916+0000","last_peered":"2024-09-19T05:39:08.471916+0000","last_clean":"2024-09-19T05:39:08.471916+0000","last_became_active":"2024-09-19T05:39:07.513314+0000","last_became_peered":"2024-09-19T05:39:07.513314+0000","last_unstale":"2024-09-19T05:39:08.471916+0000","last_undegraded":"2024-09-19T05:39:08.471916+0000","last_fullsized":"2024-09-19T05:39:08.471916+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:57.680519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308286+0000","last_change":"2024-09-19T05:39:07.517907+0000","last_active":"2024-09-19T05:39:10.308286+0000","last_peered":"2024-09-19T05:39:10.308286+0000","last_clean":"2024-09-19T05:39:10.308286+0000","last_became_active":"2024-09-19T05:39:07.517541+0000","last_became_peered":"2024-09-19T05:39:07.517541+0000","last_unstale":"2024-09-19T05:39:10.308286+0000","last_undegraded":"2024-09-19T05:39:10.308286+0000","last_fullsized":"2024-09-19T05:39:10.308286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:31.563472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.307924+0000","last_change":"2024-09-19T05:39:07.489209+0000","last_active":"2024-09-19T05:39:10.307924+0000","last_peered":"2024-09-19T05:39:10.307924+0000","last_clean":"2024-09-19T05:39:10.307924+0000","last_became_active":"2024-09-19T05:39:07.488316+0000","last_became_peered":"2024-09-19T05:39:07.488316+0000","last_unstale":"2024-09-19T05:39:10.307924+0000","last_undegraded":"2024-09-19T05:39:10.307924+0000","last_fullsized":"2024-09-19T05:39:10.307924+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:04.633001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527156+0000","last_change":"2024-09-19T05:39:07.513784+0000","last_active":"2024-09-19T05:39:09.527156+0000","last_peered":"2024-09-19T05:39:09.527156+0000","last_clean":"2024-09-19T05:39:09.527156+0000","last_became_active":"2024-09-19T05:39:07.513444+0000","last_became_peered":"2024-09-19T05:39:07.513444+0000","last_unstale":"2024-09-19T05:39:09.527156+0000","last_undegraded":"2024-09-19T05:39:09.527156+0000","last_fullsized":"2024-09-19T05:39:09.527156+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:07.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.473020+0000","last_change":"2024-09-19T05:39:07.489966+0000","last_active":"2024-09-19T05:39:08.473020+0000","last_peered":"2024-09-19T05:39:08.473020+0000","last_clean":"2024-09-19T05:39:08.473020+0000","last_became_active":"2024-09-19T05:39:07.489224+0000","last_became_peered":"2024-09-19T05:39:07.489224+0000","last_unstale":"2024-09-19T05:39:08.473020+0000","last_undegraded":"2024-09-19T05:39:08.473020+0000","last_fullsized":"2024-09-19T05:39:08.473020+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.226928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.576087+0000","last_change":"2024-09-19T05:39:07.521121+0000","last_active":"2024-09-19T05:39:08.576087+0000","last_peered":"2024-09-19T05:39:08.576087+0000","last_clean":"2024-09-19T05:39:08.576087+0000","last_became_active":"2024-09-19T05:39:07.520605+0000","last_became_peered":"2024-09-19T05:39:07.520605+0000","last_unstale":"2024-09-19T05:39:08.576087+0000","last_undegraded":"2024-09-19T05:39:08.576087+0000","last_fullsized":"2024-09-19T05:39:08.576087+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:07.844815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.473067+0000","last_change":"2024-09-19T05:39:07.498322+0000","last_active":"2024-09-19T05:39:08.473067+0000","last_peered":"2024-09-19T05:39:08.473067+0000","last_clean":"2024-09-19T05:39:08.473067+0000","last_became_active":"2024-09-19T05:39:07.497126+0000","last_became_peered":"2024-09-19T05:39:07.497126+0000","last_unstale":"2024-09-19T05:39:08.473067+0000","last_undegraded":"2024-09-19T05:39:08.473067+0000","last_fullsized":"2024-09-19T05:39:08.473067+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:07.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.575904+0000","last_change":"2024-09-19T05:39:07.498214+0000","last_active":"2024-09-19T05:39:08.575904+0000","last_peered":"2024-09-19T05:39:08.575904+0000","last_clean":"2024-09-19T05:39:08.575904+0000","last_became_active":"2024-09-19T05:39:07.497502+0000","last_became_peered":"2024-09-19T05:39:07.497502+0000","last_unstale":"2024-09-19T05:39:08.575904+0000","last_undegraded":"2024-09-19T05:39:08.575904+0000","last_fullsized":"2024-09-19T05:39:08.575904+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:47.603940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.526904+0000","last_change":"2024-09-19T05:39:07.508738+0000","last_active":"2024-09-19T05:39:09.526904+0000","last_peered":"2024-09-19T05:39:09.526904+0000","last_clean":"2024-09-19T05:39:09.526904+0000","last_became_active":"2024-09-19T05:39:07.508464+0000","last_became_peered":"2024-09-19T05:39:07.508464+0000","last_unstale":"2024-09-19T05:39:09.526904+0000","last_undegraded":"2024-09-19T05:39:09.526904+0000","last_fullsized":"2024-09-19T05:39:09.526904+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:08.754962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.471470+0000","last_change":"2024-09-19T05:39:07.508299+0000","last_active":"2024-09-19T05:39:08.471470+0000","last_peered":"2024-09-19T05:39:08.471470+0000","last_clean":"2024-09-19T05:39:08.471470+0000","last_became_active":"2024-09-19T05:39:07.507645+0000","last_became_peered":"2024-09-19T05:39:07.507645+0000","last_unstale":"2024-09-19T05:39:08.471470+0000","last_undegraded":"2024-09-19T05:39:08.471470+0000","last_fullsized":"2024-09-19T05:39:08.471470+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:40:37.367376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.526821+0000","last_change":"2024-09-19T05:39:07.511409+0000","last_active":"2024-09-19T05:39:09.526821+0000","last_peered":"2024-09-19T05:39:09.526821+0000","last_clean":"2024-09-19T05:39:09.526821+0000","last_became_active":"2024-09-19T05:39:07.510855+0000","last_became_peered":"2024-09-19T05:39:07.510855+0000","last_unstale":"2024-09-19T05:39:09.526821+0000","last_undegraded":"2024-09-19T05:39:09.526821+0000","last_fullsized":"2024-09-19T05:39:09.526821+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:46.402215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308142+0000","last_change":"2024-09-19T05:39:07.503780+0000","last_active":"2024-09-19T05:39:10.308142+0000","last_peered":"2024-09-19T05:39:10.308142+0000","last_clean":"2024-09-19T05:39:10.308142+0000","last_became_active":"2024-09-19T05:39:07.503383+0000","last_became_peered":"2024-09-19T05:39:07.503383+0000","last_unstale":"2024-09-19T05:39:10.308142+0000","last_undegraded":"2024-09-19T05:39:10.308142+0000","last_fullsized":"2024-09-19T05:39:10.308142+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:49.424572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309500+0000","last_change":"2024-09-19T05:39:07.513379+0000","last_active":"2024-09-19T05:39:10.309500+0000","last_peered":"2024-09-19T05:39:10.309500+0000","last_clean":"2024-09-19T05:39:10.309500+0000","last_became_active":"2024-09-19T05:39:07.513004+0000","last_became_peered":"2024-09-19T05:39:07.513004+0000","last_unstale":"2024-09-19T05:39:10.309500+0000","last_undegraded":"2024-09-19T05:39:10.309500+0000","last_fullsized":"2024-09-19T05:39:10.309500+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:12.160816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.474074+0000","last_change":"2024-09-19T05:39:07.489702+0000","last_active":"2024-09-19T05:39:08.474074+0000","last_peered":"2024-09-19T05:39:08.474074+0000","last_clean":"2024-09-19T05:39:08.474074+0000","last_became_active":"2024-09-19T05:39:07.488948+0000","last_became_peered":"2024-09-19T05:39:07.488948+0000","last_unstale":"2024-09-19T05:39:08.474074+0000","last_undegraded":"2024-09-19T05:39:08.474074+0000","last_fullsized":"2024-09-19T05:39:08.474074+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:08:16.977393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.472805+0000","last_change":"2024-09-19T05:39:07.516406+0000","last_active":"2024-09-19T05:39:08.472805+0000","last_peered":"2024-09-19T05:39:08.472805+0000","last_clean":"2024-09-19T05:39:08.472805+0000","last_became_active":"2024-09-19T05:39:07.515522+0000","last_became_peered":"2024-09-19T05:39:07.515522+0000","last_unstale":"2024-09-19T05:39:08.472805+0000","last_undegraded":"2024-09-19T05:39:08.472805+0000","last_fullsized":"2024-09-19T05:39:08.472805+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:45.515423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527196+0000","last_change":"2024-09-19T05:39:07.515087+0000","last_active":"2024-09-19T05:39:09.527196+0000","last_peered":"2024-09-19T05:39:09.527196+0000","last_clean":"2024-09-19T05:39:09.527196+0000","last_became_active":"2024-09-19T05:39:07.514386+0000","last_became_peered":"2024-09-19T05:39:07.514386+0000","last_unstale":"2024-09-19T05:39:09.527196+0000","last_undegraded":"2024-09-19T05:39:09.527196+0000","last_fullsized":"2024-09-19T05:39:09.527196+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:40.902947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.471828+0000","last_change":"2024-09-19T05:39:07.487245+0000","last_active":"2024-09-19T05:39:08.471828+0000","last_peered":"2024-09-19T05:39:08.471828+0000","last_clean":"2024-09-19T05:39:08.471828+0000","last_became_active":"2024-09-19T05:39:07.486231+0000","last_became_peered":"2024-09-19T05:39:07.486231+0000","last_unstale":"2024-09-19T05:39:08.471828+0000","last_undegraded":"2024-09-19T05:39:08.471828+0000","last_fullsized":"2024-09-19T05:39:08.471828+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:07.098088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.471497+0000","last_change":"2024-09-19T05:39:07.508056+0000","last_active":"2024-09-19T05:39:08.471497+0000","last_peered":"2024-09-19T05:39:08.471497+0000","last_clean":"2024-09-19T05:39:08.471497+0000","last_became_active":"2024-09-19T05:39:07.507489+0000","last_became_peered":"2024-09-19T05:39:07.507489+0000","last_unstale":"2024-09-19T05:39:08.471497+0000","last_undegraded":"2024-09-19T05:39:08.471497+0000","last_fullsized":"2024-09-19T05:39:08.471497+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:58.928271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.310086+0000","last_change":"2024-09-19T05:39:07.525122+0000","last_active":"2024-09-19T05:39:10.310086+0000","last_peered":"2024-09-19T05:39:10.310086+0000","last_clean":"2024-09-19T05:39:10.310086+0000","last_became_active":"2024-09-19T05:39:07.523883+0000","last_became_peered":"2024-09-19T05:39:07.523883+0000","last_unstale":"2024-09-19T05:39:10.310086+0000","last_undegraded":"2024-09-19T05:39:10.310086+0000","last_fullsized":"2024-09-19T05:39:10.310086+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:46.402215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.473584+0000","last_change":"2024-09-19T05:39:07.476742+0000","last_active":"2024-09-19T05:39:08.473584+0000","last_peered":"2024-09-19T05:39:08.473584+0000","last_clean":"2024-09-19T05:39:08.473584+0000","last_became_active":"2024-09-19T05:39:07.476014+0000","last_became_peered":"2024-09-19T05:39:07.476014+0000","last_unstale":"2024-09-19T05:39:08.473584+0000","last_undegraded":"2024-09-19T05:39:08.473584+0000","last_fullsized":"2024-09-19T05:39:08.473584+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:23:27.764821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.511439+0000","last_change":"2024-09-19T05:39:07.513926+0000","last_active":"2024-09-19T05:39:08.511439+0000","last_peered":"2024-09-19T05:39:08.511439+0000","last_clean":"2024-09-19T05:39:08.511439+0000","last_became_active":"2024-09-19T05:39:07.513314+0000","last_became_peered":"2024-09-19T05:39:07.513314+0000","last_unstale":"2024-09-19T05:39:08.511439+0000","last_undegraded":"2024-09-19T05:39:08.511439+0000","last_fullsized":"2024-09-19T05:39:08.511439+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:59.490345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.472763+0000","last_change":"2024-09-19T05:39:07.514536+0000","last_active":"2024-09-19T05:39:08.472763+0000","last_peered":"2024-09-19T05:39:08.472763+0000","last_clean":"2024-09-19T05:39:08.472763+0000","last_became_active":"2024-09-19T05:39:07.513764+0000","last_became_peered":"2024-09-19T05:39:07.513764+0000","last_unstale":"2024-09-19T05:39:08.472763+0000","last_undegraded":"2024-09-19T05:39:08.472763+0000","last_fullsized":"2024-09-19T05:39:08.472763+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:46.402215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.576190+0000","last_change":"2024-09-19T05:39:07.511608+0000","last_active":"2024-09-19T05:39:08.576190+0000","last_peered":"2024-09-19T05:39:08.576190+0000","last_clean":"2024-09-19T05:39:08.576190+0000","last_became_active":"2024-09-19T05:39:07.511317+0000","last_became_peered":"2024-09-19T05:39:07.511317+0000","last_unstale":"2024-09-19T05:39:08.576190+0000","last_undegraded":"2024-09-19T05:39:08.576190+0000","last_fullsized":"2024-09-19T05:39:08.576190+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:27.408917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527295+0000","last_change":"2024-09-19T05:39:07.512543+0000","last_active":"2024-09-19T05:39:09.527295+0000","last_peered":"2024-09-19T05:39:09.527295+0000","last_clean":"2024-09-19T05:39:09.527295+0000","last_became_active":"2024-09-19T05:39:07.512197+0000","last_became_peered":"2024-09-19T05:39:07.512197+0000","last_unstale":"2024-09-19T05:39:09.527295+0000","last_undegraded":"2024-09-19T05:39:09.527295+0000","last_fullsized":"2024-09-19T05:39:09.527295+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:53.739868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308112+0000","last_change":"2024-09-19T05:39:07.502020+0000","last_active":"2024-09-19T05:39:10.308112+0000","last_peered":"2024-09-19T05:39:10.308112+0000","last_clean":"2024-09-19T05:39:10.308112+0000","last_became_active":"2024-09-19T05:39:07.501253+0000","last_became_peered":"2024-09-19T05:39:07.501253+0000","last_unstale":"2024-09-19T05:39:10.308112+0000","last_undegraded":"2024-09-19T05:39:10.308112+0000","last_fullsized":"2024-09-19T05:39:10.308112+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:08.218931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.471955+0000","last_change":"2024-09-19T05:39:07.497602+0000","last_active":"2024-09-19T05:39:08.471955+0000","last_peered":"2024-09-19T05:39:08.471955+0000","last_clean":"2024-09-19T05:39:08.471955+0000","last_became_active":"2024-09-19T05:39:07.496849+0000","last_became_peered":"2024-09-19T05:39:07.496849+0000","last_unstale":"2024-09-19T05:39:08.471955+0000","last_undegraded":"2024-09-19T05:39:08.471955+0000","last_fullsized":"2024-09-19T05:39:08.471955+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:48.914571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.509513+0000","last_change":"2024-09-19T05:39:07.515306+0000","last_active":"2024-09-19T05:39:08.509513+0000","last_peered":"2024-09-19T05:39:08.509513+0000","last_clean":"2024-09-19T05:39:08.509513+0000","last_became_active":"2024-09-19T05:39:07.514836+0000","last_became_peered":"2024-09-19T05:39:07.514836+0000","last_unstale":"2024-09-19T05:39:08.509513+0000","last_undegraded":"2024-09-19T05:39:08.509513+0000","last_fullsized":"2024-09-19T05:39:08.509513+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:28.189936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308471+0000","last_change":"2024-09-19T05:39:07.503754+0000","last_active":"2024-09-19T05:39:10.308471+0000","last_peered":"2024-09-19T05:39:10.308471+0000","last_clean":"2024-09-19T05:39:10.308471+0000","last_became_active":"2024-09-19T05:39:07.503357+0000","last_became_peered":"2024-09-19T05:39:07.503357+0000","last_unstale":"2024-09-19T05:39:10.308471+0000","last_undegraded":"2024-09-19T05:39:10.308471+0000","last_fullsized":"2024-09-19T05:39:10.308471+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:50.263420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308591+0000","last_change":"2024-09-19T05:39:07.502863+0000","last_active":"2024-09-19T05:39:10.308591+0000","last_peered":"2024-09-19T05:39:10.308591+0000","last_clean":"2024-09-19T05:39:10.308591+0000","last_became_active":"2024-09-19T05:39:07.502485+0000","last_became_peered":"2024-09-19T05:39:07.502485+0000","last_unstale":"2024-09-19T05:39:10.308591+0000","last_undegraded":"2024-09-19T05:39:10.308591+0000","last_fullsized":"2024-09-19T05:39:10.308591+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:06.027438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"99'4","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309071+0000","last_change":"2024-09-19T05:39:06.485427+0000","last_active":"2024-09-19T05:39:10.309071+0000","last_peered":"2024-09-19T05:39:10.309071+0000","last_clean":"2024-09-19T05:39:10.309071+0000","last_became_active":"2024-09-19T05:39:06.484690+0000","last_became_peered":"2024-09-19T05:39:06.484690+0000","last_unstale":"2024-09-19T05:39:10.309071+0000","last_undegraded":"2024-09-19T05:39:10.309071+0000","last_fullsized":"2024-09-19T05:39:10.309071+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.330473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308726+0000","last_change":"2024-09-19T05:39:07.507065+0000","last_active":"2024-09-19T05:39:10.308726+0000","last_peered":"2024-09-19T05:39:10.308726+0000","last_clean":"2024-09-19T05:39:10.308726+0000","last_became_active":"2024-09-19T05:39:07.506728+0000","last_became_peered":"2024-09-19T05:39:07.506728+0000","last_unstale":"2024-09-19T05:39:10.308726+0000","last_undegraded":"2024-09-19T05:39:10.308726+0000","last_fullsized":"2024-09-19T05:39:10.308726+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:23.270957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.472943+0000","last_change":"2024-09-19T05:39:06.480222+0000","last_active":"2024-09-19T05:39:08.472943+0000","last_peered":"2024-09-19T05:39:08.472943+0000","last_clean":"2024-09-19T05:39:08.472943+0000","last_became_active":"2024-09-19T05:39:06.478165+0000","last_became_peered":"2024-09-19T05:39:06.478165+0000","last_unstale":"2024-09-19T05:39:08.472943+0000","last_undegraded":"2024-09-19T05:39:08.472943+0000","last_fullsized":"2024-09-19T05:39:08.472943+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:04.938931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308094+0000","last_change":"2024-09-19T05:39:07.515244+0000","last_active":"2024-09-19T05:39:10.308094+0000","last_peered":"2024-09-19T05:39:10.308094+0000","last_clean":"2024-09-19T05:39:10.308094+0000","last_became_active":"2024-09-19T05:39:07.514591+0000","last_became_peered":"2024-09-19T05:39:07.514591+0000","last_unstale":"2024-09-19T05:39:10.308094+0000","last_undegraded":"2024-09-19T05:39:10.308094+0000","last_fullsized":"2024-09-19T05:39:10.308094+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:28.423948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308967+0000","last_change":"2024-09-19T05:39:06.490107+0000","last_active":"2024-09-19T05:39:10.308967+0000","last_peered":"2024-09-19T05:39:10.308967+0000","last_clean":"2024-09-19T05:39:10.308967+0000","last_became_active":"2024-09-19T05:39:06.489368+0000","last_became_peered":"2024-09-19T05:39:06.489368+0000","last_unstale":"2024-09-19T05:39:10.308967+0000","last_undegraded":"2024-09-19T05:39:10.308967+0000","last_fullsized":"2024-09-19T05:39:10.308967+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:38.362465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309526+0000","last_change":"2024-09-19T05:39:07.526915+0000","last_active":"2024-09-19T05:39:10.309526+0000","last_peered":"2024-09-19T05:39:10.309526+0000","last_clean":"2024-09-19T05:39:10.309526+0000","last_became_active":"2024-09-19T05:39:07.525420+0000","last_became_peered":"2024-09-19T05:39:07.525420+0000","last_unstale":"2024-09-19T05:39:10.309526+0000","last_undegraded":"2024-09-19T05:39:10.309526+0000","last_fullsized":"2024-09-19T05:39:10.309526+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:09.019406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309350+0000","last_change":"2024-09-19T05:39:06.476967+0000","last_active":"2024-09-19T05:39:10.309350+0000","last_peered":"2024-09-19T05:39:10.309350+0000","last_clean":"2024-09-19T05:39:10.309350+0000","last_became_active":"2024-09-19T05:39:06.476220+0000","last_became_peered":"2024-09-19T05:39:06.476220+0000","last_unstale":"2024-09-19T05:39:10.309350+0000","last_undegraded":"2024-09-19T05:39:10.309350+0000","last_fullsized":"2024-09-19T05:39:10.309350+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:04.510928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527486+0000","last_change":"2024-09-19T05:39:07.511182+0000","last_active":"2024-09-19T05:39:09.527486+0000","last_peered":"2024-09-19T05:39:09.527486+0000","last_clean":"2024-09-19T05:39:09.527486+0000","last_became_active":"2024-09-19T05:39:07.510867+0000","last_became_peered":"2024-09-19T05:39:07.510867+0000","last_unstale":"2024-09-19T05:39:09.527486+0000","last_undegraded":"2024-09-19T05:39:09.527486+0000","last_fullsized":"2024-09-19T05:39:09.527486+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:56.154696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.472096+0000","last_change":"2024-09-19T05:39:06.477568+0000","last_active":"2024-09-19T05:39:08.472096+0000","last_peered":"2024-09-19T05:39:08.472096+0000","last_clean":"2024-09-19T05:39:08.472096+0000","last_became_active":"2024-09-19T05:39:06.475121+0000","last_became_peered":"2024-09-19T05:39:06.475121+0000","last_unstale":"2024-09-19T05:39:08.472096+0000","last_undegraded":"2024-09-19T05:39:08.472096+0000","last_fullsized":"2024-09-19T05:39:08.472096+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:00.813515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309744+0000","last_change":"2024-09-19T05:39:07.511197+0000","last_active":"2024-09-19T05:39:10.309744+0000","last_peered":"2024-09-19T05:39:10.309744+0000","last_clean":"2024-09-19T05:39:10.309744+0000","last_became_active":"2024-09-19T05:39:07.510456+0000","last_became_peered":"2024-09-19T05:39:07.510456+0000","last_unstale":"2024-09-19T05:39:10.309744+0000","last_undegraded":"2024-09-19T05:39:10.309744+0000","last_fullsized":"2024-09-19T05:39:10.309744+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:30.502064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527386+0000","last_change":"2024-09-19T05:39:06.470618+0000","last_active":"2024-09-19T05:39:09.527386+0000","last_peered":"2024-09-19T05:39:09.527386+0000","last_clean":"2024-09-19T05:39:09.527386+0000","last_became_active":"2024-09-19T05:39:06.470223+0000","last_became_peered":"2024-09-19T05:39:06.470223+0000","last_unstale":"2024-09-19T05:39:09.527386+0000","last_undegraded":"2024-09-19T05:39:09.527386+0000","last_fullsized":"2024-09-19T05:39:09.527386+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.330473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308391+0000","last_change":"2024-09-19T05:39:07.517795+0000","last_active":"2024-09-19T05:39:10.308391+0000","last_peered":"2024-09-19T05:39:10.308391+0000","last_clean":"2024-09-19T05:39:10.308391+0000","last_became_active":"2024-09-19T05:39:07.517481+0000","last_became_peered":"2024-09-19T05:39:07.517481+0000","last_unstale":"2024-09-19T05:39:10.308391+0000","last_undegraded":"2024-09-19T05:39:10.308391+0000","last_fullsized":"2024-09-19T05:39:10.308391+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:35.970091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.473341+0000","last_change":"2024-09-19T05:39:06.473491+0000","last_active":"2024-09-19T05:39:08.473341+0000","last_peered":"2024-09-19T05:39:08.473341+0000","last_clean":"2024-09-19T05:39:08.473341+0000","last_became_active":"2024-09-19T05:39:06.473154+0000","last_became_peered":"2024-09-19T05:39:06.473154+0000","last_unstale":"2024-09-19T05:39:08.473341+0000","last_undegraded":"2024-09-19T05:39:08.473341+0000","last_fullsized":"2024-09-19T05:39:08.473341+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:23.889902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.526988+0000","last_change":"2024-09-19T05:39:07.516121+0000","last_active":"2024-09-19T05:39:09.526988+0000","last_peered":"2024-09-19T05:39:09.526988+0000","last_clean":"2024-09-19T05:39:09.526988+0000","last_became_active":"2024-09-19T05:39:07.514910+0000","last_became_peered":"2024-09-19T05:39:07.514910+0000","last_unstale":"2024-09-19T05:39:09.526988+0000","last_undegraded":"2024-09-19T05:39:09.526988+0000","last_fullsized":"2024-09-19T05:39:09.526988+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:45.515423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308180+0000","last_change":"2024-09-19T05:39:06.491620+0000","last_active":"2024-09-19T05:39:10.308180+0000","last_peered":"2024-09-19T05:39:10.308180+0000","last_clean":"2024-09-19T05:39:10.308180+0000","last_became_active":"2024-09-19T05:39:06.491275+0000","last_became_peered":"2024-09-19T05:39:06.491275+0000","last_unstale":"2024-09-19T05:39:10.308180+0000","last_undegraded":"2024-09-19T05:39:10.308180+0000","last_fullsized":"2024-09-19T05:39:10.308180+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:53.747689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.472551+0000","last_change":"2024-09-19T05:39:07.478438+0000","last_active":"2024-09-19T05:39:08.472551+0000","last_peered":"2024-09-19T05:39:08.472551+0000","last_clean":"2024-09-19T05:39:08.472551+0000","last_became_active":"2024-09-19T05:39:07.477648+0000","last_became_peered":"2024-09-19T05:39:07.477648+0000","last_unstale":"2024-09-19T05:39:08.472551+0000","last_undegraded":"2024-09-19T05:39:08.472551+0000","last_fullsized":"2024-09-19T05:39:08.472551+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:30.502064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.511671+0000","last_change":"2024-09-19T05:39:06.484638+0000","last_active":"2024-09-19T05:39:08.511671+0000","last_peered":"2024-09-19T05:39:08.511671+0000","last_clean":"2024-09-19T05:39:08.511671+0000","last_became_active":"2024-09-19T05:39:06.483824+0000","last_became_peered":"2024-09-19T05:39:06.483824+0000","last_unstale":"2024-09-19T05:39:08.511671+0000","last_undegraded":"2024-09-19T05:39:08.511671+0000","last_fullsized":"2024-09-19T05:39:08.511671+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:44:31.297046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308728+0000","last_change":"2024-09-19T05:39:07.496679+0000","last_active":"2024-09-19T05:39:10.308728+0000","last_peered":"2024-09-19T05:39:10.308728+0000","last_clean":"2024-09-19T05:39:10.308728+0000","last_became_active":"2024-09-19T05:39:07.495917+0000","last_became_peered":"2024-09-19T05:39:07.495917+0000","last_unstale":"2024-09-19T05:39:10.308728+0000","last_undegraded":"2024-09-19T05:39:10.308728+0000","last_fullsized":"2024-09-19T05:39:10.308728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:52.487030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.474358+0000","last_change":"2024-09-19T05:39:06.472058+0000","last_active":"2024-09-19T05:39:08.474358+0000","last_peered":"2024-09-19T05:39:08.474358+0000","last_clean":"2024-09-19T05:39:08.474358+0000","last_became_active":"2024-09-19T05:39:06.471408+0000","last_became_peered":"2024-09-19T05:39:06.471408+0000","last_unstale":"2024-09-19T05:39:08.474358+0000","last_undegraded":"2024-09-19T05:39:08.474358+0000","last_fullsized":"2024-09-19T05:39:08.474358+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:53.747689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.474257+0000","last_change":"2024-09-19T05:39:07.507775+0000","last_active":"2024-09-19T05:39:08.474257+0000","last_peered":"2024-09-19T05:39:08.474257+0000","last_clean":"2024-09-19T05:39:08.474257+0000","last_became_active":"2024-09-19T05:39:07.507140+0000","last_became_peered":"2024-09-19T05:39:07.507140+0000","last_unstale":"2024-09-19T05:39:08.474257+0000","last_undegraded":"2024-09-19T05:39:08.474257+0000","last_fullsized":"2024-09-19T05:39:08.474257+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:28.423948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"99'3","reported_seq":17,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.473311+0000","last_change":"2024-09-19T05:39:06.459521+0000","last_active":"2024-09-19T05:39:08.473311+0000","last_peered":"2024-09-19T05:39:08.473311+0000","last_clean":"2024-09-19T05:39:08.473311+0000","last_became_active":"2024-09-19T05:39:06.458765+0000","last_became_peered":"2024-09-19T05:39:06.458765+0000","last_unstale":"2024-09-19T05:39:08.473311+0000","last_undegraded":"2024-09-19T05:39:08.473311+0000","last_fullsized":"2024-09-19T05:39:08.473311+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:13:30.176350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527569+0000","last_change":"2024-09-19T05:39:07.514304+0000","last_active":"2024-09-19T05:39:09.527569+0000","last_peered":"2024-09-19T05:39:09.527569+0000","last_clean":"2024-09-19T05:39:09.527569+0000","last_became_active":"2024-09-19T05:39:07.513489+0000","last_became_peered":"2024-09-19T05:39:07.513489+0000","last_unstale":"2024-09-19T05:39:09.527569+0000","last_undegraded":"2024-09-19T05:39:09.527569+0000","last_fullsized":"2024-09-19T05:39:09.527569+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:05.653346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"99'6","reported_seq":20,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309235+0000","last_change":"2024-09-19T05:39:06.477718+0000","last_active":"2024-09-19T05:39:10.309235+0000","last_peered":"2024-09-19T05:39:10.309235+0000","last_clean":"2024-09-19T05:39:10.309235+0000","last_became_active":"2024-09-19T05:39:06.477354+0000","last_became_peered":"2024-09-19T05:39:06.477354+0000","last_unstale":"2024-09-19T05:39:10.309235+0000","last_undegraded":"2024-09-19T05:39:10.309235+0000","last_fullsized":"2024-09-19T05:39:10.309235+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:40.183959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527616+0000","last_change":"2024-09-19T05:39:07.505127+0000","last_active":"2024-09-19T05:39:09.527616+0000","last_peered":"2024-09-19T05:39:09.527616+0000","last_clean":"2024-09-19T05:39:09.527616+0000","last_became_active":"2024-09-19T05:39:07.504653+0000","last_became_peered":"2024-09-19T05:39:07.504653+0000","last_unstale":"2024-09-19T05:39:09.527616+0000","last_undegraded":"2024-09-19T05:39:09.527616+0000","last_fullsized":"2024-09-19T05:39:09.527616+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:24:16.694566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308032+0000","last_change":"2024-09-19T05:39:06.491796+0000","last_active":"2024-09-19T05:39:10.308032+0000","last_peered":"2024-09-19T05:39:10.308032+0000","last_clean":"2024-09-19T05:39:10.308032+0000","last_became_active":"2024-09-19T05:39:06.490945+0000","last_became_peered":"2024-09-19T05:39:06.490945+0000","last_unstale":"2024-09-19T05:39:10.308032+0000","last_undegraded":"2024-09-19T05:39:10.308032+0000","last_fullsized":"2024-09-19T05:39:10.308032+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:52.832626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.471444+0000","last_change":"2024-09-19T05:39:07.511791+0000","last_active":"2024-09-19T05:39:08.471444+0000","last_peered":"2024-09-19T05:39:08.471444+0000","last_clean":"2024-09-19T05:39:08.471444+0000","last_became_active":"2024-09-19T05:39:07.511068+0000","last_became_peered":"2024-09-19T05:39:07.511068+0000","last_unstale":"2024-09-19T05:39:08.471444+0000","last_undegraded":"2024-09-19T05:39:08.471444+0000","last_fullsized":"2024-09-19T05:39:08.471444+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:32.142444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308695+0000","last_change":"2024-09-19T05:39:06.482148+0000","last_active":"2024-09-19T05:39:10.308695+0000","last_peered":"2024-09-19T05:39:10.308695+0000","last_clean":"2024-09-19T05:39:10.308695+0000","last_became_active":"2024-09-19T05:39:06.477485+0000","last_became_peered":"2024-09-19T05:39:06.477485+0000","last_unstale":"2024-09-19T05:39:10.308695+0000","last_undegraded":"2024-09-19T05:39:10.308695+0000","last_fullsized":"2024-09-19T05:39:10.308695+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:38.362465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.575563+0000","last_change":"2024-09-19T05:39:07.520981+0000","last_active":"2024-09-19T05:39:08.575563+0000","last_peered":"2024-09-19T05:39:08.575563+0000","last_clean":"2024-09-19T05:39:08.575563+0000","last_became_active":"2024-09-19T05:39:07.520621+0000","last_became_peered":"2024-09-19T05:39:07.520621+0000","last_unstale":"2024-09-19T05:39:08.575563+0000","last_undegraded":"2024-09-19T05:39:08.575563+0000","last_fullsized":"2024-09-19T05:39:08.575563+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:20.450929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527064+0000","last_change":"2024-09-19T05:39:06.484372+0000","last_active":"2024-09-19T05:39:09.527064+0000","last_peered":"2024-09-19T05:39:09.527064+0000","last_clean":"2024-09-19T05:39:09.527064+0000","last_became_active":"2024-09-19T05:39:06.484002+0000","last_became_peered":"2024-09-19T05:39:06.484002+0000","last_unstale":"2024-09-19T05:39:09.527064+0000","last_undegraded":"2024-09-19T05:39:09.527064+0000","last_fullsized":"2024-09-19T05:39:09.527064+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:21.720048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.575756+0000","last_change":"2024-09-19T05:39:07.492388+0000","last_active":"2024-09-19T05:39:08.575756+0000","last_peered":"2024-09-19T05:39:08.575756+0000","last_clean":"2024-09-19T05:39:08.575756+0000","last_became_active":"2024-09-19T05:39:07.489450+0000","last_became_peered":"2024-09-19T05:39:07.489450+0000","last_unstale":"2024-09-19T05:39:08.575756+0000","last_undegraded":"2024-09-19T05:39:08.575756+0000","last_fullsized":"2024-09-19T05:39:08.575756+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:37.574642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"99'8","reported_seq":22,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527646+0000","last_change":"2024-09-19T05:39:06.470272+0000","last_active":"2024-09-19T05:39:09.527646+0000","last_peered":"2024-09-19T05:39:09.527646+0000","last_clean":"2024-09-19T05:39:09.527646+0000","last_became_active":"2024-09-19T05:39:06.469862+0000","last_became_peered":"2024-09-19T05:39:06.469862+0000","last_unstale":"2024-09-19T05:39:09.527646+0000","last_undegraded":"2024-09-19T05:39:09.527646+0000","last_fullsized":"2024-09-19T05:39:09.527646+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:31.359640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309549+0000","last_change":"2024-09-19T05:39:07.504146+0000","last_active":"2024-09-19T05:39:10.309549+0000","last_peered":"2024-09-19T05:39:10.309549+0000","last_clean":"2024-09-19T05:39:10.309549+0000","last_became_active":"2024-09-19T05:39:07.498411+0000","last_became_peered":"2024-09-19T05:39:07.498411+0000","last_unstale":"2024-09-19T05:39:10.309549+0000","last_undegraded":"2024-09-19T05:39:10.309549+0000","last_fullsized":"2024-09-19T05:39:10.309549+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:55.783746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309160+0000","last_change":"2024-09-19T05:39:06.492000+0000","last_active":"2024-09-19T05:39:10.309160+0000","last_peered":"2024-09-19T05:39:10.309160+0000","last_clean":"2024-09-19T05:39:10.309160+0000","last_became_active":"2024-09-19T05:39:06.491277+0000","last_became_peered":"2024-09-19T05:39:06.491277+0000","last_unstale":"2024-09-19T05:39:10.309160+0000","last_undegraded":"2024-09-19T05:39:10.309160+0000","last_fullsized":"2024-09-19T05:39:10.309160+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:26.857563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308731+0000","last_change":"2024-09-19T05:39:07.511116+0000","last_active":"2024-09-19T05:39:10.308731+0000","last_peered":"2024-09-19T05:39:10.308731+0000","last_clean":"2024-09-19T05:39:10.308731+0000","last_became_active":"2024-09-19T05:39:07.510397+0000","last_became_peered":"2024-09-19T05:39:07.510397+0000","last_unstale":"2024-09-19T05:39:10.308731+0000","last_undegraded":"2024-09-19T05:39:10.308731+0000","last_fullsized":"2024-09-19T05:39:10.308731+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:57.680519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308387+0000","last_change":"2024-09-19T05:39:06.495628+0000","last_active":"2024-09-19T05:39:10.308387+0000","last_peered":"2024-09-19T05:39:10.308387+0000","last_clean":"2024-09-19T05:39:10.308387+0000","last_became_active":"2024-09-19T05:39:06.491383+0000","last_became_peered":"2024-09-19T05:39:06.491383+0000","last_unstale":"2024-09-19T05:39:10.308387+0000","last_undegraded":"2024-09-19T05:39:10.308387+0000","last_fullsized":"2024-09-19T05:39:10.308387+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:01.615531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.472816+0000","last_change":"2024-09-19T05:39:07.484846+0000","last_active":"2024-09-19T05:39:08.472816+0000","last_peered":"2024-09-19T05:39:08.472816+0000","last_clean":"2024-09-19T05:39:08.472816+0000","last_became_active":"2024-09-19T05:39:07.484047+0000","last_became_peered":"2024-09-19T05:39:07.484047+0000","last_unstale":"2024-09-19T05:39:08.472816+0000","last_undegraded":"2024-09-19T05:39:08.472816+0000","last_fullsized":"2024-09-19T05:39:08.472816+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:08.754962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.473342+0000","last_change":"2024-09-19T05:39:06.488703+0000","last_active":"2024-09-19T05:39:08.473342+0000","last_peered":"2024-09-19T05:39:08.473342+0000","last_clean":"2024-09-19T05:39:08.473342+0000","last_became_active":"2024-09-19T05:39:06.487165+0000","last_became_peered":"2024-09-19T05:39:06.487165+0000","last_unstale":"2024-09-19T05:39:08.473342+0000","last_undegraded":"2024-09-19T05:39:08.473342+0000","last_fullsized":"2024-09-19T05:39:08.473342+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:28.380690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309076+0000","last_change":"2024-09-19T05:39:07.514886+0000","last_active":"2024-09-19T05:39:10.309076+0000","last_peered":"2024-09-19T05:39:10.309076+0000","last_clean":"2024-09-19T05:39:10.309076+0000","last_became_active":"2024-09-19T05:39:07.514562+0000","last_became_peered":"2024-09-19T05:39:07.514562+0000","last_unstale":"2024-09-19T05:39:10.309076+0000","last_undegraded":"2024-09-19T05:39:10.309076+0000","last_fullsized":"2024-09-19T05:39:10.309076+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:33.526542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.509598+0000","last_change":"2024-09-19T05:39:06.487040+0000","last_active":"2024-09-19T05:39:08.509598+0000","last_peered":"2024-09-19T05:39:08.509598+0000","last_clean":"2024-09-19T05:39:08.509598+0000","last_became_active":"2024-09-19T05:39:06.485399+0000","last_became_peered":"2024-09-19T05:39:06.485399+0000","last_unstale":"2024-09-19T05:39:08.509598+0000","last_undegraded":"2024-09-19T05:39:08.509598+0000","last_fullsized":"2024-09-19T05:39:08.509598+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.642703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.509603+0000","last_change":"2024-09-19T05:39:07.493726+0000","last_active":"2024-09-19T05:39:08.509603+0000","last_peered":"2024-09-19T05:39:08.509603+0000","last_clean":"2024-09-19T05:39:08.509603+0000","last_became_active":"2024-09-19T05:39:07.492964+0000","last_became_peered":"2024-09-19T05:39:07.492964+0000","last_unstale":"2024-09-19T05:39:08.509603+0000","last_undegraded":"2024-09-19T05:39:08.509603+0000","last_fullsized":"2024-09-19T05:39:08.509603+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:08.677275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.575479+0000","last_change":"2024-09-19T05:39:06.474748+0000","last_active":"2024-09-19T05:39:08.575479+0000","last_peered":"2024-09-19T05:39:08.575479+0000","last_clean":"2024-09-19T05:39:08.575479+0000","last_became_active":"2024-09-19T05:39:06.474265+0000","last_became_peered":"2024-09-19T05:39:06.474265+0000","last_unstale":"2024-09-19T05:39:08.575479+0000","last_undegraded":"2024-09-19T05:39:08.575479+0000","last_fullsized":"2024-09-19T05:39:08.575479+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:08.194710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.509908+0000","last_change":"2024-09-19T05:39:07.510540+0000","last_active":"2024-09-19T05:39:08.509908+0000","last_peered":"2024-09-19T05:39:08.509908+0000","last_clean":"2024-09-19T05:39:08.509908+0000","last_became_active":"2024-09-19T05:39:07.509867+0000","last_became_peered":"2024-09-19T05:39:07.509867+0000","last_unstale":"2024-09-19T05:39:08.509908+0000","last_undegraded":"2024-09-19T05:39:08.509908+0000","last_fullsized":"2024-09-19T05:39:08.509908+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:17.684074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.509778+0000","last_change":"2024-09-19T05:39:06.486335+0000","last_active":"2024-09-19T05:39:08.509778+0000","last_peered":"2024-09-19T05:39:08.509778+0000","last_clean":"2024-09-19T05:39:08.509778+0000","last_became_active":"2024-09-19T05:39:06.483059+0000","last_became_peered":"2024-09-19T05:39:06.483059+0000","last_unstale":"2024-09-19T05:39:08.509778+0000","last_undegraded":"2024-09-19T05:39:08.509778+0000","last_fullsized":"2024-09-19T05:39:08.509778+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:33.395321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308823+0000","last_change":"2024-09-19T05:39:07.507655+0000","last_active":"2024-09-19T05:39:10.308823+0000","last_peered":"2024-09-19T05:39:10.308823+0000","last_clean":"2024-09-19T05:39:10.308823+0000","last_became_active":"2024-09-19T05:39:07.507048+0000","last_became_peered":"2024-09-19T05:39:07.507048+0000","last_unstale":"2024-09-19T05:39:10.308823+0000","last_undegraded":"2024-09-19T05:39:10.308823+0000","last_fullsized":"2024-09-19T05:39:10.308823+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:39.979155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.575587+0000","last_change":"2024-09-19T05:39:06.488093+0000","last_active":"2024-09-19T05:39:08.575587+0000","last_peered":"2024-09-19T05:39:08.575587+0000","last_clean":"2024-09-19T05:39:08.575587+0000","last_became_active":"2024-09-19T05:39:06.487576+0000","last_became_peered":"2024-09-19T05:39:06.487576+0000","last_unstale":"2024-09-19T05:39:08.575587+0000","last_undegraded":"2024-09-19T05:39:08.575587+0000","last_fullsized":"2024-09-19T05:39:08.575587+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:03.461184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309085+0000","last_change":"2024-09-19T05:39:07.512457+0000","last_active":"2024-09-19T05:39:10.309085+0000","last_peered":"2024-09-19T05:39:10.309085+0000","last_clean":"2024-09-19T05:39:10.309085+0000","last_became_active":"2024-09-19T05:39:07.511785+0000","last_became_peered":"2024-09-19T05:39:07.511785+0000","last_unstale":"2024-09-19T05:39:10.309085+0000","last_undegraded":"2024-09-19T05:39:10.309085+0000","last_fullsized":"2024-09-19T05:39:10.309085+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:48.914571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308436+0000","last_change":"2024-09-19T05:39:06.495673+0000","last_active":"2024-09-19T05:39:10.308436+0000","last_peered":"2024-09-19T05:39:10.308436+0000","last_clean":"2024-09-19T05:39:10.308436+0000","last_became_active":"2024-09-19T05:39:06.489071+0000","last_became_peered":"2024-09-19T05:39:06.489071+0000","last_unstale":"2024-09-19T05:39:10.308436+0000","last_undegraded":"2024-09-19T05:39:10.308436+0000","last_fullsized":"2024-09-19T05:39:10.308436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:25.266947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309351+0000","last_change":"2024-09-19T05:39:07.508387+0000","last_active":"2024-09-19T05:39:10.309351+0000","last_peered":"2024-09-19T05:39:10.309351+0000","last_clean":"2024-09-19T05:39:10.309351+0000","last_became_active":"2024-09-19T05:39:07.508010+0000","last_became_peered":"2024-09-19T05:39:07.508010+0000","last_unstale":"2024-09-19T05:39:10.309351+0000","last_undegraded":"2024-09-19T05:39:10.309351+0000","last_fullsized":"2024-09-19T05:39:10.309351+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:57:48.780921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"100'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.473217+0000","last_change":"2024-09-19T05:39:06.476552+0000","last_active":"2024-09-19T05:39:08.473217+0000","last_peered":"2024-09-19T05:39:08.473217+0000","last_clean":"2024-09-19T05:39:08.473217+0000","last_became_active":"2024-09-19T05:39:06.475840+0000","last_became_peered":"2024-09-19T05:39:06.475840+0000","last_unstale":"2024-09-19T05:39:08.473217+0000","last_undegraded":"2024-09-19T05:39:08.473217+0000","last_fullsized":"2024-09-19T05:39:08.473217+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:54.302837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309091+0000","last_change":"2024-09-19T05:39:07.508277+0000","last_active":"2024-09-19T05:39:10.309091+0000","last_peered":"2024-09-19T05:39:10.309091+0000","last_clean":"2024-09-19T05:39:10.309091+0000","last_became_active":"2024-09-19T05:39:07.504275+0000","last_became_peered":"2024-09-19T05:39:07.504275+0000","last_unstale":"2024-09-19T05:39:10.309091+0000","last_undegraded":"2024-09-19T05:39:10.309091+0000","last_fullsized":"2024-09-19T05:39:10.309091+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:05.241782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.473458+0000","last_change":"2024-09-19T05:39:06.459439+0000","last_active":"2024-09-19T05:39:08.473458+0000","last_peered":"2024-09-19T05:39:08.473458+0000","last_clean":"2024-09-19T05:39:08.473458+0000","last_became_active":"2024-09-19T05:39:06.458677+0000","last_became_peered":"2024-09-19T05:39:06.458677+0000","last_unstale":"2024-09-19T05:39:08.473458+0000","last_undegraded":"2024-09-19T05:39:08.473458+0000","last_fullsized":"2024-09-19T05:39:08.473458+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:24.512042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.511476+0000","last_change":"2024-09-19T05:39:07.497197+0000","last_active":"2024-09-19T05:39:08.511476+0000","last_peered":"2024-09-19T05:39:08.511476+0000","last_clean":"2024-09-19T05:39:08.511476+0000","last_became_active":"2024-09-19T05:39:07.496238+0000","last_became_peered":"2024-09-19T05:39:07.496238+0000","last_unstale":"2024-09-19T05:39:08.511476+0000","last_undegraded":"2024-09-19T05:39:08.511476+0000","last_fullsized":"2024-09-19T05:39:08.511476+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:34.550723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309472+0000","last_change":"2024-09-19T05:39:06.467833+0000","last_active":"2024-09-19T05:39:10.309472+0000","last_peered":"2024-09-19T05:39:10.309472+0000","last_clean":"2024-09-19T05:39:10.309472+0000","last_became_active":"2024-09-19T05:39:06.466980+0000","last_became_peered":"2024-09-19T05:39:06.466980+0000","last_unstale":"2024-09-19T05:39:10.309472+0000","last_undegraded":"2024-09-19T05:39:10.309472+0000","last_fullsized":"2024-09-19T05:39:10.309472+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:13.641713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.575531+0000","last_change":"2024-09-19T05:39:07.506052+0000","last_active":"2024-09-19T05:39:08.575531+0000","last_peered":"2024-09-19T05:39:08.575531+0000","last_clean":"2024-09-19T05:39:08.575531+0000","last_became_active":"2024-09-19T05:39:07.505690+0000","last_became_peered":"2024-09-19T05:39:07.505690+0000","last_unstale":"2024-09-19T05:39:08.575531+0000","last_undegraded":"2024-09-19T05:39:08.575531+0000","last_fullsized":"2024-09-19T05:39:08.575531+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:51.253711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309459+0000","last_change":"2024-09-19T05:39:06.477685+0000","last_active":"2024-09-19T05:39:10.309459+0000","last_peered":"2024-09-19T05:39:10.309459+0000","last_clean":"2024-09-19T05:39:10.309459+0000","last_became_active":"2024-09-19T05:39:06.477270+0000","last_became_peered":"2024-09-19T05:39:06.477270+0000","last_unstale":"2024-09-19T05:39:10.309459+0000","last_undegraded":"2024-09-19T05:39:10.309459+0000","last_fullsized":"2024-09-19T05:39:10.309459+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:53.747689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.473229+0000","last_change":"2024-09-19T05:39:07.511103+0000","last_active":"2024-09-19T05:39:08.473229+0000","last_peered":"2024-09-19T05:39:08.473229+0000","last_clean":"2024-09-19T05:39:08.473229+0000","last_became_active":"2024-09-19T05:39:07.510633+0000","last_became_peered":"2024-09-19T05:39:07.510633+0000","last_unstale":"2024-09-19T05:39:08.473229+0000","last_undegraded":"2024-09-19T05:39:08.473229+0000","last_fullsized":"2024-09-19T05:39:08.473229+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:46.048999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:08.510155+0000","last_change":"2024-09-19T05:39:06.487038+0000","last_active":"2024-09-19T05:39:08.510155+0000","last_peered":"2024-09-19T05:39:08.510155+0000","last_clean":"2024-09-19T05:39:08.510155+0000","last_became_active":"2024-09-19T05:39:06.486191+0000","last_became_peered":"2024-09-19T05:39:06.486191+0000","last_unstale":"2024-09-19T05:39:08.510155+0000","last_undegraded":"2024-09-19T05:39:08.510155+0000","last_fullsized":"2024-09-19T05:39:08.510155+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:57.630895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308274+0000","last_change":"2024-09-19T05:39:07.525501+0000","last_active":"2024-09-19T05:39:10.308274+0000","last_peered":"2024-09-19T05:39:10.308274+0000","last_clean":"2024-09-19T05:39:10.308274+0000","last_became_active":"2024-09-19T05:39:07.524641+0000","last_became_peered":"2024-09-19T05:39:07.524641+0000","last_unstale":"2024-09-19T05:39:10.308274+0000","last_undegraded":"2024-09-19T05:39:10.308274+0000","last_fullsized":"2024-09-19T05:39:10.308274+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:07.098088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.310214+0000","last_change":"2024-09-19T05:39:06.476838+0000","last_active":"2024-09-19T05:39:10.310214+0000","last_peered":"2024-09-19T05:39:10.310214+0000","last_clean":"2024-09-19T05:39:10.310214+0000","last_became_active":"2024-09-19T05:39:06.476128+0000","last_became_peered":"2024-09-19T05:39:06.476128+0000","last_unstale":"2024-09-19T05:39:10.310214+0000","last_undegraded":"2024-09-19T05:39:10.310214+0000","last_fullsized":"2024-09-19T05:39:10.310214+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:21.720048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.309358+0000","last_change":"2024-09-19T05:39:07.507379+0000","last_active":"2024-09-19T05:39:10.309358+0000","last_peered":"2024-09-19T05:39:10.309358+0000","last_clean":"2024-09-19T05:39:10.309358+0000","last_became_active":"2024-09-19T05:39:07.506591+0000","last_became_peered":"2024-09-19T05:39:07.506591+0000","last_unstale":"2024-09-19T05:39:10.309358+0000","last_undegraded":"2024-09-19T05:39:10.309358+0000","last_fullsized":"2024-09-19T05:39:10.309358+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:30.624727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.307809+0000","last_change":"2024-09-19T05:39:06.489874+0000","last_active":"2024-09-19T05:39:10.307809+0000","last_peered":"2024-09-19T05:39:10.307809+0000","last_clean":"2024-09-19T05:39:10.307809+0000","last_became_active":"2024-09-19T05:39:06.489133+0000","last_became_peered":"2024-09-19T05:39:06.489133+0000","last_unstale":"2024-09-19T05:39:10.307809+0000","last_undegraded":"2024-09-19T05:39:10.307809+0000","last_fullsized":"2024-09-19T05:39:10.307809+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:40.183959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308544+0000","last_change":"2024-09-19T05:39:07.489269+0000","last_active":"2024-09-19T05:39:10.308544+0000","last_peered":"2024-09-19T05:39:10.308544+0000","last_clean":"2024-09-19T05:39:10.308544+0000","last_became_active":"2024-09-19T05:39:07.488489+0000","last_became_peered":"2024-09-19T05:39:07.488489+0000","last_unstale":"2024-09-19T05:39:10.308544+0000","last_undegraded":"2024-09-19T05:39:10.308544+0000","last_fullsized":"2024-09-19T05:39:10.308544+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:06.438981+0000","last_clean_scrub_stamp":"2024-09-19T05:39:06.438981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:49:47.108570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:09.527376+0000","last_change":"2024-09-19T05:39:06.486153+0000","last_active":"2024-09-19T05:39:09.527376+0000","last_peered":"2024-09-19T05:39:09.527376+0000","last_clean":"2024-09-19T05:39:09.527376+0000","last_became_active":"2024-09-19T05:39:06.485868+0000","last_became_peered":"2024-09-19T05:39:06.485868+0000","last_unstale":"2024-09-19T05:39:09.527376+0000","last_undegraded":"2024-09-19T05:39:09.527376+0000","last_fullsized":"2024-09-19T05:39:09.527376+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:05.425971+0000","last_clean_scrub_stamp":"2024-09-19T05:39:05.425971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:04.510928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T05:39:10.308077+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:39:10.308077+0000","last_peered":"2024-09-19T05:39:10.308077+0000","last_clean":"2024-09-19T05:39:10.308077+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:39:10.308077+0000","last_undegraded":"2024-09-19T05:39:10.308077+0000","last_fullsized":"2024-09-19T05:39:10.308077+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542220,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51028,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320812,"statfs":{"total":96636764160,"available":96584511488,"internally_reserved":0,"allocated":1830912,"data_stored":1164586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542220,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40728,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331112,"statfs":{"total":96636764160,"available":96595058688,"internally_reserved":0,"allocated":1249280,"data_stored":576378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542222,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44876,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326964,"statfs":{"total":96636764160,"available":96590811136,"internally_reserved":0,"allocated":1228800,"data_stored":574162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542220,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50444,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321396,"statfs":{"total":96636764160,"available":96585109504,"internally_reserved":0,"allocated":1236992,"data_stored":574322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542221,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46276,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325564,"statfs":{"total":96636764160,"available":96589377536,"internally_reserved":0,"allocated":1228800,"data_stored":574162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542221,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1228800,"data_stored":574162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542223,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40712,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331128,"statfs":{"total":96636764160,"available":96595075072,"internally_reserved":0,"allocated":1232896,"data_stored":574232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542220,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55200,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316640,"statfs":{"total":96636764160,"available":96580239360,"internally_reserved":0,"allocated":1847296,"data_stored":1166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:39:16.436 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:39:16.436 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:39:16.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfb6248640 1 Processor -- start 2024-09-19T05:39:16.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfb6248640 1 -- start start 2024-09-19T05:39:16.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfb6248640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcfb00b32d0 0x7fcfb00d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfb6248640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfb00d33d0 con 0x7fcfb00d1510 2024-09-19T05:39:16.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfb6248640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfb006d850 con 0x7fcfb00d1130 2024-09-19T05:39:16.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfb6248640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb00d39e0 con 0x7fcfb00b32d0 2024-09-19T05:39:16.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfaffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcfb00d1510 0x7fcfb00cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34004/0 (socket says 172.21.15.67:34004) 2024-09-19T05:39:16.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfaffff640 1 -- 172.21.15.67:0/1570856175 learned_addr learned my addr 172.21.15.67:0/1570856175 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:16.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfaeffd640 1 --2- 172.21.15.67:0/1570856175 >> v2:172.21.15.67:3300/0 conn(0x7fcfb00b32d0 0x7fcfb00d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfae7fc640 1 -- 172.21.15.67:0/1570856175 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788192561 0 0) 0x7fcfb00d33d0 con 0x7fcfb00d1510 2024-09-19T05:39:16.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfae7fc640 1 -- 172.21.15.67:0/1570856175 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf98003530 con 0x7fcfb00d1510 2024-09-19T05:39:16.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfaeffd640 1 -- 172.21.15.67:0/1570856175 >> v1:172.21.15.97:6789/0 conn(0x7fcfb00d1130 legacy=0x7fcfb006d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfaeffd640 1 -- 172.21.15.67:0/1570856175 >> v1:172.21.15.67:6789/0 conn(0x7fcfb00d1510 legacy=0x7fcfb00cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.616+0000 7fcfaeffd640 1 -- 172.21.15.67:0/1570856175 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb006db20 con 0x7fcfb00b32d0 2024-09-19T05:39:16.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfaeffd640 1 --2- 172.21.15.67:0/1570856175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00b32d0 0x7fcfb00d3e70 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40097c0 tx=0x7fcfa401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d971537b587dc3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfae7fc640 1 -- 172.21.15.67:0/1570856175 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40b1070 con 0x7fcfb00b32d0 2024-09-19T05:39:16.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfae7fc640 1 -- 172.21.15.67:0/1570856175 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa40a8050 con 0x7fcfb00b32d0 2024-09-19T05:39:16.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfae7fc640 1 -- 172.21.15.67:0/1570856175 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40ac840 con 0x7fcfb00b32d0 2024-09-19T05:39:16.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfb6248640 1 -- 172.21.15.67:0/1570856175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00b32d0 msgr2=0x7fcfb00d3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfb6248640 1 --2- 172.21.15.67:0/1570856175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00b32d0 0x7fcfb00d3e70 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40097c0 tx=0x7fcfa401c3e0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfb6248640 1 -- 172.21.15.67:0/1570856175 shutdown_connections 2024-09-19T05:39:16.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfb6248640 1 --2- 172.21.15.67:0/1570856175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00b32d0 0x7fcfb00d3e70 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfb6248640 1 -- 172.21.15.67:0/1570856175 >> 172.21.15.67:0/1570856175 conn(0x7fcfb008bfc0 msgr2=0x7fcfb00d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfb6248640 1 -- 172.21.15.67:0/1570856175 shutdown_connections 2024-09-19T05:39:16.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.620+0000 7fcfb6248640 1 -- 172.21.15.67:0/1570856175 wait complete. 2024-09-19T05:39:16.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 Processor -- start 2024-09-19T05:39:16.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 -- start start 2024-09-19T05:39:16.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfb00b32d0 0x7fcfb0157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfb00d1130 0x7fcfb00a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00d1510 0x7fcfb015b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb016bed0 con 0x7fcfb00d1510 2024-09-19T05:39:16.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb016bd50 con 0x7fcfb00d1130 2024-09-19T05:39:16.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb016c050 con 0x7fcfb00b32d0 2024-09-19T05:39:16.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00d1510 0x7fcfb015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00d1510 0x7fcfb015b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52288/0 (socket says 172.21.15.67:52288) 2024-09-19T05:39:16.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaffff640 1 -- 172.21.15.67:0/2074719470 learned_addr learned my addr 172.21.15.67:0/2074719470 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaeffd640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfb00d1130 0x7fcfb00a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaf7fe640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfb00b32d0 0x7fcfb0157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaffff640 1 -- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfb00b32d0 msgr2=0x7fcfb0157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaffff640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfb00b32d0 0x7fcfb0157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaffff640 1 -- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfb00d1130 msgr2=0x7fcfb00a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaffff640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfb00d1130 0x7fcfb00a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaffff640 1 -- 172.21.15.67:0/2074719470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb0156770 con 0x7fcfb00d1510 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaf7fe640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfb00b32d0 0x7fcfb0157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfaffff640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00d1510 0x7fcfb015b610 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800caa0 tx=0x7fcfa800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcf97fff640 1 -- 172.21.15.67:0/2074719470 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8017070 con 0x7fcfb00d1510 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcf97fff640 1 -- 172.21.15.67:0/2074719470 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa800ac00 con 0x7fcfb00d1510 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcf97fff640 1 -- 172.21.15.67:0/2074719470 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8012400 con 0x7fcfb00d1510 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 -- 172.21.15.67:0/2074719470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb0156a10 con 0x7fcfb00d1510 2024-09-19T05:39:16.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 -- 172.21.15.67:0/2074719470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb0156fd0 con 0x7fcfb00d1510 2024-09-19T05:39:16.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.624+0000 7fcfb6248640 1 -- 172.21.15.67:0/2074719470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb00d3e70 con 0x7fcfb00d1510 2024-09-19T05:39:16.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.628+0000 7fcf97fff640 1 -- 172.21.15.67:0/2074719470 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcfa801a070 con 0x7fcfb00d1510 2024-09-19T05:39:16.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.628+0000 7fcf97fff640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf9c0678c0 0x7fcf9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.628+0000 7fcf97fff640 1 -- 172.21.15.67:0/2074719470 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7fcfa8085ba0 con 0x7fcfb00d1510 2024-09-19T05:39:16.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.628+0000 7fcfaf7fe640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf9c0678c0 0x7fcf9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.628+0000 7fcfaf7fe640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf9c0678c0 0x7fcf9c069d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00016f0 tx=0x7fcfa0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.632+0000 7fcf97fff640 1 -- 172.21.15.67:0/2074719470 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fcfa8056550 con 0x7fcfb00d1510 2024-09-19T05:39:16.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.852+0000 7fcfb6248640 1 -- 172.21.15.67:0/2074719470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fcfb00d53d0 con 0x7fcfb00d1510 2024-09-19T05:39:16.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.856+0000 7fcf97fff640 1 -- 172.21.15.67:0/2074719470 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fcfa8055e50 con 0x7fcfb00d1510 2024-09-19T05:39:16.858 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:39:16.858 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:39:16.858 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:39:16.858 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:39:16.858 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:39:16.858 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:39:16.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 -- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf9c0678c0 msgr2=0x7fcf9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf9c0678c0 0x7fcf9c069d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00016f0 tx=0x7fcfa0009040 comp rx=0 tx=0).stop 2024-09-19T05:39:16.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 -- 172.21.15.67:0/2074719470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00d1510 msgr2=0x7fcfb015b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00d1510 0x7fcfb015b610 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800caa0 tx=0x7fcfa800cf60 comp rx=0 tx=0).stop 2024-09-19T05:39:16.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 -- 172.21.15.67:0/2074719470 shutdown_connections 2024-09-19T05:39:16.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfb00d1510 0x7fcfb015b610 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfb00d1130 0x7fcfb00a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf9c0678c0 0x7fcf9c069d80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 --2- 172.21.15.67:0/2074719470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfb00b32d0 0x7fcfb0157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 -- 172.21.15.67:0/2074719470 >> 172.21.15.67:0/2074719470 conn(0x7fcfb008bfc0 msgr2=0x7fcfb00b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 -- 172.21.15.67:0/2074719470 shutdown_connections 2024-09-19T05:39:16.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.860+0000 7fcfb6248640 1 -- 172.21.15.67:0/2074719470 wait complete. 2024-09-19T05:39:16.876 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:16.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faac03f2640 1 Processor -- start 2024-09-19T05:39:16.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faac03f2640 1 -- start start 2024-09-19T05:39:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faac03f2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faab8162630 0x7faab8071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faac03f2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faab80cc3c0 0x7faab8072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faac03f2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faab806ecc0 con 0x7faab8162a10 2024-09-19T05:39:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faac03f2640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7faab80cfe80 con 0x7faab80cc3c0 2024-09-19T05:39:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faac03f2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7faab806ef50 con 0x7faab8162630 2024-09-19T05:39:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faabe98f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faab80cc3c0 0x7faab8072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faabd98d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7faab8162a10 0x7faab8166380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34012/0 (socket says 172.21.15.67:34012) 2024-09-19T05:39:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faabd98d640 1 -- 172.21.15.67:0/1442306396 learned_addr learned my addr 172.21.15.67:0/1442306396 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:16.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faabe18e640 1 --2- 172.21.15.67:0/1442306396 >> v2:172.21.15.97:3300/0 conn(0x7faab8162630 0x7faab8071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faabe98f640 1 -- 172.21.15.67:0/1442306396 >> v2:172.21.15.97:3300/0 conn(0x7faab8162630 msgr2=0x7faab8071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faabe98f640 1 --2- 172.21.15.67:0/1442306396 >> v2:172.21.15.97:3300/0 conn(0x7faab8162630 0x7faab8071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faabe98f640 1 -- 172.21.15.67:0/1442306396 >> v1:172.21.15.67:6789/0 conn(0x7faab8162a10 legacy=0x7faab8166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faabd18c640 1 -- 172.21.15.67:0/1442306396 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867638302 0 0) 0x7faab806ecc0 con 0x7faab8162a10 2024-09-19T05:39:16.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faabe98f640 1 -- 172.21.15.67:0/1442306396 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab806f230 con 0x7faab80cc3c0 2024-09-19T05:39:16.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.992+0000 7faabe18e640 1 --2- 172.21.15.67:0/1442306396 >> v2:172.21.15.97:3300/0 conn(0x7faab8162630 0x7faab8071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:16.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faabe98f640 1 --2- 172.21.15.67:0/1442306396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 0x7faab8072510 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7faab80744a0 tx=0x7faab001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771f1062d45f280d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faabd18c640 1 -- 172.21.15.67:0/1442306396 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab00b2070 con 0x7faab80cc3c0 2024-09-19T05:39:16.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faabd18c640 1 -- 172.21.15.67:0/1442306396 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab00a5930 con 0x7faab80cc3c0 2024-09-19T05:39:16.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faabd18c640 1 -- 172.21.15.67:0/1442306396 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab00a5d00 con 0x7faab80cc3c0 2024-09-19T05:39:16.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faac03f2640 1 -- 172.21.15.67:0/1442306396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 msgr2=0x7faab8072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faac03f2640 1 --2- 172.21.15.67:0/1442306396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 0x7faab8072510 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7faab80744a0 tx=0x7faab001c870 comp rx=0 tx=0).stop 2024-09-19T05:39:16.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faac03f2640 1 -- 172.21.15.67:0/1442306396 shutdown_connections 2024-09-19T05:39:16.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faac03f2640 1 --2- 172.21.15.67:0/1442306396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 0x7faab8072510 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faac03f2640 1 --2- 172.21.15.67:0/1442306396 >> v2:172.21.15.97:3300/0 conn(0x7faab8162630 0x7faab8071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faac03f2640 1 -- 172.21.15.67:0/1442306396 >> 172.21.15.67:0/1442306396 conn(0x7faab80d0080 msgr2=0x7faab80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faac03f2640 1 -- 172.21.15.67:0/1442306396 shutdown_connections 2024-09-19T05:39:16.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faac03f2640 1 -- 172.21.15.67:0/1442306396 wait complete. 2024-09-19T05:39:16.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faac03f2640 1 Processor -- start 2024-09-19T05:39:16.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:16.996+0000 7faac03f2640 1 -- start start 2024-09-19T05:39:16.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faac03f2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 0x7faab809d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faac03f2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faab8162630 0x7faab80acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faac03f2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faab8162a10 0x7faab815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faac03f2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faab816f880 con 0x7faab80cc3c0 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faac03f2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faab816f700 con 0x7faab8162a10 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faac03f2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faab816fa00 con 0x7faab8162630 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabe18e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 0x7faab809d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabe18e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 0x7faab809d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52298/0 (socket says 172.21.15.67:52298) 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabe18e640 1 -- 172.21.15.67:0/1164637384 learned_addr learned my addr 172.21.15.67:0/1164637384 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabd98d640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faab8162630 0x7faab80acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabe98f640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faab8162a10 0x7faab815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabe18e640 1 -- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faab8162630 msgr2=0x7faab80acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabe18e640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faab8162630 0x7faab80acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabe18e640 1 -- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faab8162a10 msgr2=0x7faab815cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabe18e640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faab8162a10 0x7faab815cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabe18e640 1 -- 172.21.15.67:0/1164637384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab809dfe0 con 0x7faab80cc3c0 2024-09-19T05:39:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabe18e640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 0x7faab809d8e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7faab400e840 tx=0x7faab400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faaaeffd640 1 -- 172.21.15.67:0/1164637384 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4017070 con 0x7faab80cc3c0 2024-09-19T05:39:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faaaeffd640 1 -- 172.21.15.67:0/1164637384 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab400c8d0 con 0x7faab80cc3c0 2024-09-19T05:39:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faac03f2640 1 -- 172.21.15.67:0/1164637384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab809be20 con 0x7faab80cc3c0 2024-09-19T05:39:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faaaeffd640 1 -- 172.21.15.67:0/1164637384 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab400f040 con 0x7faab80cc3c0 2024-09-19T05:39:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faac03f2640 1 -- 172.21.15.67:0/1164637384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab809c3e0 con 0x7faab80cc3c0 2024-09-19T05:39:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faac03f2640 1 -- 172.21.15.67:0/1164637384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faab8166380 con 0x7faab80cc3c0 2024-09-19T05:39:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faaaeffd640 1 -- 172.21.15.67:0/1164637384 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faab401a070 con 0x7faab80cc3c0 2024-09-19T05:39:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faaaeffd640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa9c0678c0 0x7faa9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faaaeffd640 1 -- 172.21.15.67:0/1164637384 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7faab4085a00 con 0x7faab80cc3c0 2024-09-19T05:39:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.000+0000 7faabd98d640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa9c0678c0 0x7faa9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.004+0000 7faabd98d640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa9c0678c0 0x7faa9c069d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faab8099ed0 tx=0x7faaa8007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.004+0000 7faaaeffd640 1 -- 172.21.15.67:0/1164637384 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7faab4055d60 con 0x7faab80cc3c0 2024-09-19T05:39:17.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.200+0000 7faac03f2640 1 -- 172.21.15.67:0/1164637384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faab80701a0 con 0x7faab80cc3c0 2024-09-19T05:39:17.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.200+0000 7faaaeffd640 1 -- 172.21.15.67:0/1164637384 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5219 (secure 0 0 0) 0x7faab405a060 con 0x7faab80cc3c0 2024-09-19T05:39:17.202 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:17.202 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":67,"btime":"2024-09-19T05:39:10:515079+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1965498909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1965498909},{"type":"v1","addr":"172.21.15.97:6837","nonce":1965498909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/123788622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":123788622},{"type":"v1","addr":"172.21.15.97:6835","nonce":123788622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4015838682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":4015838682},{"type":"v1","addr":"172.21.15.67:6835","nonce":4015838682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:09.876016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6834/358275731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":358275731},{"type":"v1","addr":"172.21.15.67:6834","nonce":358275731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7215,"qdb_cluster":[7215]},"id":6}]} 2024-09-19T05:39:17.202 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 67 2024-09-19T05:39:17.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 -- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa9c0678c0 msgr2=0x7faa9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa9c0678c0 0x7faa9c069d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faab8099ed0 tx=0x7faaa8007df0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 -- 172.21.15.67:0/1164637384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 msgr2=0x7faab809d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 0x7faab809d8e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7faab400e840 tx=0x7faab400ed00 comp rx=0 tx=0).stop 2024-09-19T05:39:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 -- 172.21.15.67:0/1164637384 shutdown_connections 2024-09-19T05:39:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faab8162a10 0x7faab815cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa9c0678c0 0x7faa9c069d80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faab8162630 0x7faab80acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 --2- 172.21.15.67:0/1164637384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faab80cc3c0 0x7faab809d8e0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 -- 172.21.15.67:0/1164637384 >> 172.21.15.67:0/1164637384 conn(0x7faab80d0080 msgr2=0x7faab80cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 -- 172.21.15.67:0/1164637384 shutdown_connections 2024-09-19T05:39:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.204+0000 7faac03f2640 1 -- 172.21.15.67:0/1164637384 wait complete. 2024-09-19T05:39:17.623 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:39:06.828432+0000', 'modified': '2024-09-19T05:39:09.876016+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7215}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7215': {'gid': 7215, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6834/358275731', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 358275731}, {'type': 'v1', 'addr': '172.21.15.67:6834', 'nonce': 358275731}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7215, 'qdb_cluster': [7215]} 2024-09-19T05:39:17.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:39:17.624 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:39:17.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06dbcc1640 1 Processor -- start 2024-09-19T05:39:17.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06dbcc1640 1 -- start start 2024-09-19T05:39:17.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06dbcc1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f06d4070140 0x7f06d415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06dbcc1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f06d40ccee0 0x7f06d4070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06dbcc1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d40cd350 con 0x7f06d4161ee0 2024-09-19T05:39:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06dbcc1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f06d4070a60 con 0x7f06d4070140 2024-09-19T05:39:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06dbcc1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f06d406e790 con 0x7f06d40ccee0 2024-09-19T05:39:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06d9a5d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f06d4070140 0x7f06d415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06d9a5d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f06d4070140 0x7f06d415f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52304/0 (socket says 172.21.15.67:52304) 2024-09-19T05:39:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06d9a5d640 1 -- 172.21.15.67:0/4218838586 learned_addr learned my addr 172.21.15.67:0/4218838586 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06d925c640 1 --2- 172.21.15.67:0/4218838586 >> v2:172.21.15.97:3300/0 conn(0x7f06d40ccee0 0x7f06d4070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06d9a5d640 1 -- 172.21.15.67:0/4218838586 >> v2:172.21.15.97:3300/0 conn(0x7f06d40ccee0 msgr2=0x7f06d4070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/4218838586 >> v2:172.21.15.97:3300/0 conn(0x7f06d40ccee0 0x7f06d4070520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06d9a5d640 1 -- 172.21.15.67:0/4218838586 >> v1:172.21.15.97:6789/0 conn(0x7f06d4161ee0 legacy=0x7f06d4162330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06d9a5d640 1 -- 172.21.15.67:0/4218838586 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d406ea50 con 0x7f06d4070140 2024-09-19T05:39:17.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.764+0000 7f06d925c640 1 --2- 172.21.15.67:0/4218838586 >> v2:172.21.15.97:3300/0 conn(0x7f06d40ccee0 0x7f06d4070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:17.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/4218838586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d4070140 0x7f06d415f370 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009870 tx=0x7f06cc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398b397760a7815e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06d8a5b640 1 -- 172.21.15.67:0/4218838586 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0b0070 con 0x7f06d4070140 2024-09-19T05:39:17.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06d8a5b640 1 -- 172.21.15.67:0/4218838586 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc0ab600 con 0x7f06d4070140 2024-09-19T05:39:17.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06d8a5b640 1 -- 172.21.15.67:0/4218838586 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0ab9d0 con 0x7f06d4070140 2024-09-19T05:39:17.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4218838586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d4070140 msgr2=0x7f06d415f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06dbcc1640 1 --2- 172.21.15.67:0/4218838586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d4070140 0x7f06d415f370 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009870 tx=0x7f06cc01c240 comp rx=0 tx=0).stop 2024-09-19T05:39:17.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4218838586 shutdown_connections 2024-09-19T05:39:17.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06dbcc1640 1 --2- 172.21.15.67:0/4218838586 >> v2:172.21.15.97:3300/0 conn(0x7f06d40ccee0 0x7f06d4070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06dbcc1640 1 --2- 172.21.15.67:0/4218838586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d4070140 0x7f06d415f370 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4218838586 >> 172.21.15.67:0/4218838586 conn(0x7f06d4073500 msgr2=0x7f06d406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:17.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4218838586 shutdown_connections 2024-09-19T05:39:17.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4218838586 wait complete. 2024-09-19T05:39:17.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06dbcc1640 1 Processor -- start 2024-09-19T05:39:17.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.768+0000 7f06dbcc1640 1 -- start start 2024-09-19T05:39:17.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06dbcc1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06d4070140 0x7f06d4154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06dbcc1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d40ccee0 0x7f06d4156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06dbcc1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06d4161ee0 0x7f06d40b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06dbcc1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f06d415c160 con 0x7f06d40ccee0 2024-09-19T05:39:17.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06dbcc1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f06d406f810 con 0x7f06d4161ee0 2024-09-19T05:39:17.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06dbcc1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f06d415c2e0 con 0x7f06d4070140 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d925c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d40ccee0 0x7f06d4156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d925c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d40ccee0 0x7f06d4156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52308/0 (socket says 172.21.15.67:52308) 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d925c640 1 -- 172.21.15.67:0/4286601843 learned_addr learned my addr 172.21.15.67:0/4286601843 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06d4070140 0x7f06d4154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06da25e640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06d4161ee0 0x7f06d40b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d925c640 1 -- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06d4070140 msgr2=0x7f06d4154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d925c640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06d4070140 0x7f06d4154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d925c640 1 -- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06d4161ee0 msgr2=0x7f06d40b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d925c640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06d4161ee0 0x7f06d40b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d925c640 1 -- 172.21.15.67:0/4286601843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d4157060 con 0x7f06d40ccee0 2024-09-19T05:39:17.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06d4070140 0x7f06d4154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:17.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d925c640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d40ccee0 0x7f06d4156680 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c7f0 tx=0x7f06c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d27fc640 1 -- 172.21.15.67:0/4286601843 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8015070 con 0x7f06d40ccee0 2024-09-19T05:39:17.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d27fc640 1 -- 172.21.15.67:0/4286601843 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c8007820 con 0x7f06d40ccee0 2024-09-19T05:39:17.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d27fc640 1 -- 172.21.15.67:0/4286601843 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8007c10 con 0x7f06d40ccee0 2024-09-19T05:39:17.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4286601843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d4157340 con 0x7f06d40ccee0 2024-09-19T05:39:17.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4286601843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d4157900 con 0x7f06d40ccee0 2024-09-19T05:39:17.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.772+0000 7f06d27fc640 1 -- 172.21.15.67:0/4286601843 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06c8018070 con 0x7f06d40ccee0 2024-09-19T05:39:17.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d27fc640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f06c00678c0 0x7f06c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d27fc640 1 -- 172.21.15.67:0/4286601843 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f06c8085fc0 con 0x7f06d40ccee0 2024-09-19T05:39:17.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f06c00678c0 0x7f06c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 Processor -- start 2024-09-19T05:39:17.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 -- start start 2024-09-19T05:39:17.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f06c00678c0 0x7f06c0069d80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0ad000 tx=0x7f06cc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 0x55fd81a79f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a7a440 0x55fd81a2fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a30290 0x55fd81a30670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fd81917b60 con 0x55fd81a7a440 2024-09-19T05:39:17.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fd8187ec70 con 0x55fd81a79b20 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55fd81824ed0 con 0x55fd81a30290 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d925c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a7a440 0x55fd81a2fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d925c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a7a440 0x55fd81a2fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52316/0 (socket says 172.21.15.67:52316) 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d925c640 1 -- 172.21.15.67:0/2806667855 learned_addr learned my addr 172.21.15.67:0/2806667855 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06da25e640 1 --2- 172.21.15.67:0/2806667855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a30290 0x55fd81a30670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/2806667855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 0x55fd81a79f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d925c640 1 -- 172.21.15.67:0/2806667855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a30290 msgr2=0x55fd81a30670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d925c640 1 --2- 172.21.15.67:0/2806667855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a30290 0x55fd81a30670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d925c640 1 -- 172.21.15.67:0/2806667855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 msgr2=0x55fd81a79f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d925c640 1 --2- 172.21.15.67:0/2806667855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 0x55fd81a79f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d925c640 1 -- 172.21.15.67:0/2806667855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd81836e50 con 0x55fd81a7a440 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/2806667855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 0x55fd81a79f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06d925c640 1 --2- 172.21.15.67:0/2806667855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a7a440 0x55fd81a2fd50 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f06c8006fd0 tx=0x7f06c80563b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6456a8775978df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06bb7fe640 1 -- 172.21.15.67:0/2806667855 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c806e020 con 0x55fd81a7a440 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06bb7fe640 1 -- 172.21.15.67:0/2806667855 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c8054570 con 0x55fd81a7a440 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06bb7fe640 1 -- 172.21.15.67:0/2806667855 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c801f040 con 0x55fd81a7a440 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 -- 172.21.15.67:0/2806667855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a7a440 msgr2=0x55fd81a2fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 --2- 172.21.15.67:0/2806667855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a7a440 0x55fd81a2fd50 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f06c8006fd0 tx=0x7f06c80563b0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 -- 172.21.15.67:0/2806667855 shutdown_connections 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 --2- 172.21.15.67:0/2806667855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a30290 0x55fd81a30670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 --2- 172.21.15.67:0/2806667855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a7a440 0x55fd81a2fd50 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 --2- 172.21.15.67:0/2806667855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 0x55fd81a79f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 -- 172.21.15.67:0/2806667855 >> 172.21.15.67:0/2806667855 conn(0x55fd81a36600 msgr2=0x55fd81a2e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:17.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 -- 172.21.15.67:0/2806667855 shutdown_connections 2024-09-19T05:39:17.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.776+0000 7f06ded7d000 1 -- 172.21.15.67:0/2806667855 wait complete. 2024-09-19T05:39:17.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 -- start start 2024-09-19T05:39:17.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 Processor -- start 2024-09-19T05:39:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 0x55fd81a34e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a7a440 0x55fd81a3acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a3b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fd818e0b00 con 0x55fd81a35390 2024-09-19T05:39:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fd81859360 con 0x55fd81a79b20 2024-09-19T05:39:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55fd818562d0 con 0x55fd81a7a440 2024-09-19T05:39:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 10 client.0 _ll_register_callbacks cb 0x55fd81a1b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06da25e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a3b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06da25e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a3b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52332/0 (socket says 172.21.15.67:52332) 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06da25e640 1 -- 172.21.15.67:0/2921666875 learned_addr learned my addr 172.21.15.67:0/2921666875 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 0x55fd81a34e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06d925c640 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a7a440 0x55fd81a3acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06da25e640 1 -- 172.21.15.67:0/2921666875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a7a440 msgr2=0x55fd81a3acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06da25e640 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a7a440 0x55fd81a3acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06da25e640 1 -- 172.21.15.67:0/2921666875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 msgr2=0x55fd81a34e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06da25e640 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 0x55fd81a34e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06da25e640 1 -- 172.21.15.67:0/2921666875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd81825120 con 0x55fd81a35390 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06d925c640 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a7a440 0x55fd81a3acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06da25e640 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a3b230 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f06c400cbf0 tx=0x7f06c400a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5d012ab67dc150 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06b8ff9640 1 -- 172.21.15.67:0/2921666875 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c401b020 con 0x55fd81a35390 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06b8ff9640 1 -- 172.21.15.67:0/2921666875 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f06c4003b80 con 0x55fd81a35390 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 -- 172.21.15.67:0/2921666875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06c8054570 con 0x55fd81a35390 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06b8ff9640 1 -- 172.21.15.67:0/2921666875 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f06c4022050 con 0x55fd81a35390 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 10 client.7365 fetch_fsmap learned FSMap version 67 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 -- 172.21.15.67:0/2921666875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55fd8181e450 con 0x55fd81a35390 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06b8ff9640 1 -- 172.21.15.67:0/2921666875 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c8054570 con 0x55fd81a35390 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06b8ff9640 1 -- 172.21.15.67:0/2921666875 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x7f06c4025020 con 0x55fd81a35390 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 10 client.7365 fetch_fsmap finished waiting for FSMap version 67 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 10 client.7365 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 20 client.7365 populate_metadata read hostname 'smithi067' 2024-09-19T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x55fd81a88280 0x55fd81a8a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 4 client.7365 mds_command: new command op to 7215 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 -- 172.21.15.67:0/2921666875 --> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd81818c00 con 0x55fd81a88280 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x55fd81a88280 0x55fd81a8a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06b8ff9640 10 client.7365 ms_handle_connect on v2:172.21.15.67:6832/358275731 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x55fd81a88280 0x55fd81a8a670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=423f2afd79437054 server_cookie=8aea003c65c56106 in_seq=0 out_seq=0 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06b8ff9640 1 -- 172.21.15.67:0/2921666875 <== mds.0 v2:172.21.15.67:6832/358275731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd81818c00 con 0x55fd81a88280 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06b8ff9640 10 client.7365 handle_command_reply: tid=0 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.780+0000 7f06ded7d000 1 client.7365 shutdown 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 1 -- 172.21.15.67:0/2921666875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 msgr2=0x55fd81a3b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a3b230 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f06c400cbf0 tx=0x7f06c400a7b0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 1 -- 172.21.15.67:0/2921666875 shutdown_connections 2024-09-19T05:39:17.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a3b230 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x55fd81a88280 0x55fd81a8a670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a7a440 0x55fd81a3acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 1 --2- 172.21.15.67:0/2921666875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a79b20 0x55fd81a34e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06b8ff9640 0 client.7365 ms_handle_reset on v2:172.21.15.67:6832/358275731 2024-09-19T05:39:17.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 1 -- 172.21.15.67:0/2921666875 >> 172.21.15.67:0/2921666875 conn(0x55fd81a30290 msgr2=0x55fd81a2ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:17.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 1 -- 172.21.15.67:0/2921666875 shutdown_connections 2024-09-19T05:39:17.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 1 -- 172.21.15.67:0/2921666875 wait complete. 2024-09-19T05:39:17.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.784+0000 7f06ded7d000 20 client.7365 trim_cache size 0 max 16384 2024-09-19T05:39:17.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06ded7d000 1 Processor -- start 2024-09-19T05:39:17.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06ded7d000 1 -- start start 2024-09-19T05:39:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a34650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 0x55fd81a34b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a7a440 0x55fd81a8a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06ded7d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4154390 con 0x55fd81a35390 2024-09-19T05:39:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06ded7d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4161670 con 0x55fd81a7a440 2024-09-19T05:39:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06ded7d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f06d4153d40 con 0x55fd81a79b20 2024-09-19T05:39:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06d9a5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a34650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06d9a5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a34650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52334/0 (socket says 172.21.15.67:52334) 2024-09-19T05:39:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06d9a5d640 1 -- 172.21.15.67:0/829118298 learned_addr learned my addr 172.21.15.67:0/829118298 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06d9a5d640 1 -- 172.21.15.67:0/829118298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 msgr2=0x55fd81a34b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06d925c640 1 --2- 172.21.15.67:0/829118298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 0x55fd81a34b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06da25e640 1 --2- 172.21.15.67:0/829118298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a7a440 0x55fd81a8a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/829118298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 0x55fd81a34b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06d9a5d640 1 -- 172.21.15.67:0/829118298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a7a440 msgr2=0x55fd81a8a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/829118298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a7a440 0x55fd81a8a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06d9a5d640 1 -- 172.21.15.67:0/829118298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd81a858e0 con 0x55fd81a35390 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.800+0000 7f06d925c640 1 --2- 172.21.15.67:0/829118298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 0x55fd81a34b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/829118298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a34650 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c10 tx=0x7f06cc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75883452ac8d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06baffd640 1 -- 172.21.15.67:0/829118298 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0b0040 con 0x55fd81a35390 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06baffd640 1 -- 172.21.15.67:0/829118298 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc0b77e0 con 0x55fd81a35390 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06baffd640 1 -- 172.21.15.67:0/829118298 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0b7b90 con 0x55fd81a35390 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- 172.21.15.67:0/829118298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 msgr2=0x55fd81a34650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 --2- 172.21.15.67:0/829118298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a34650 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c10 tx=0x7f06cc004740 comp rx=0 tx=0).stop 2024-09-19T05:39:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- 172.21.15.67:0/829118298 shutdown_connections 2024-09-19T05:39:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 --2- 172.21.15.67:0/829118298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a7a440 0x55fd81a8a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 --2- 172.21.15.67:0/829118298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 0x55fd81a34b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 --2- 172.21.15.67:0/829118298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a34650 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- 172.21.15.67:0/829118298 >> 172.21.15.67:0/829118298 conn(0x55fd81a30290 msgr2=0x55fd81a8d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- 172.21.15.67:0/829118298 shutdown_connections 2024-09-19T05:39:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- 172.21.15.67:0/829118298 wait complete. 2024-09-19T05:39:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- start start 2024-09-19T05:39:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 Processor -- start 2024-09-19T05:39:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a8cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 0x55fd81a8d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a7a440 0x55fd81ad3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fd8187df80 con 0x55fd81a35390 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fd81836ca0 con 0x55fd81a7a440 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55fd818832a0 con 0x55fd81a79b20 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 10 client.0 _ll_register_callbacks cb 0x7f06d406e2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d9a5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a8cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d9a5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a8cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52348/0 (socket says 172.21.15.67:52348) 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d9a5d640 1 -- 172.21.15.67:0/1975815878 learned_addr learned my addr 172.21.15.67:0/1975815878 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06da25e640 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a7a440 0x55fd81ad3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d925c640 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 0x55fd81a8d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d9a5d640 1 -- 172.21.15.67:0/1975815878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 msgr2=0x55fd81a8d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 0x55fd81a8d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d9a5d640 1 -- 172.21.15.67:0/1975815878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a7a440 msgr2=0x55fd81ad3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a7a440 0x55fd81ad3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d9a5d640 1 -- 172.21.15.67:0/1975815878 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd81a7a270 con 0x55fd81a35390 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d925c640 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 0x55fd81a8d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d9a5d640 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a8cb90 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c10 tx=0x7f06cc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2238076b8ffecdf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06b8ff9640 1 -- 172.21.15.67:0/1975815878 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0da060 con 0x55fd81a35390 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06b8ff9640 1 -- 172.21.15.67:0/1975815878 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f06cc0b7990 con 0x55fd81a35390 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- 172.21.15.67:0/1975815878 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06cc0b77e0 con 0x55fd81a35390 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06b8ff9640 1 -- 172.21.15.67:0/1975815878 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f06cc0e0050 con 0x55fd81a35390 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 10 client.7371 fetch_fsmap learned FSMap version 67 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- 172.21.15.67:0/1975815878 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55fd81805fd0 con 0x55fd81a35390 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06b8ff9640 1 -- 172.21.15.67:0/1975815878 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc0b77e0 con 0x55fd81a35390 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06b8ff9640 1 -- 172.21.15.67:0/1975815878 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x7f06cc0e3020 con 0x55fd81a35390 2024-09-19T05:39:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 10 client.7371 fetch_fsmap finished waiting for FSMap version 67 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 10 client.7371 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 20 client.7371 populate_metadata read hostname 'smithi067' 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x55fd81ad4e30 0x55fd81ad5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 4 client.7371 mds_command: new command op to 7215 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06ded7d000 1 -- 172.21.15.67:0/1975815878 --> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] -- command(tid 0: {"prefix": "status"}) -- 0x55fd8188c3a0 con 0x55fd81ad4e30 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d925c640 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x55fd81ad4e30 0x55fd81ad5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.804+0000 7f06d925c640 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x55fd81ad4e30 0x55fd81ad5210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0c4bf93e6eb315b server_cookie=4f3c0c90a1caeb24 in_seq=0 out_seq=0 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06b8ff9640 10 client.7371 ms_handle_connect on v2:172.21.15.67:6832/358275731 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06b8ff9640 1 -- 172.21.15.67:0/1975815878 <== mds.0 v2:172.21.15.67:6832/358275731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55fd8188c3a0 con 0x55fd81ad4e30 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06b8ff9640 10 client.7371 handle_command_reply: tid=0 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 client.7371 shutdown 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 -- 172.21.15.67:0/1975815878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 msgr2=0x55fd81a8cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a8cb90 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c10 tx=0x7f06cc0046d0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 -- 172.21.15.67:0/1975815878 shutdown_connections 2024-09-19T05:39:17.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fd81a7a440 0x55fd81ad3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x55fd81ad4e30 0x55fd81ad5210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fd81a79b20 0x55fd81a8d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 --2- 172.21.15.67:0/1975815878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fd81a35390 0x55fd81a8cb90 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 -- 172.21.15.67:0/1975815878 >> 172.21.15.67:0/1975815878 conn(0x55fd81a30290 msgr2=0x55fd81a34650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:17.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06b8ff9640 0 client.7371 ms_handle_reset on v2:172.21.15.67:6832/358275731 2024-09-19T05:39:17.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 -- 172.21.15.67:0/1975815878 shutdown_connections 2024-09-19T05:39:17.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 1 -- 172.21.15.67:0/1975815878 wait complete. 2024-09-19T05:39:17.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06ded7d000 20 client.7371 trim_cache size 0 max 16384 2024-09-19T05:39:17.812 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 7215, 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 10.308620913, 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 67, 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 100, 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 100, 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 15.305990589 2024-09-19T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:39:17.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f06c00678c0 msgr2=0x7f06c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f06c00678c0 0x7f06c0069d80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0ad000 tx=0x7f06cc0a6000 comp rx=0 tx=0).stop 2024-09-19T05:39:17.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4286601843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d40ccee0 msgr2=0x7f06d4156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d40ccee0 0x7f06d4156680 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c7f0 tx=0x7f06c800ccb0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4286601843 shutdown_connections 2024-09-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06d4161ee0 0x7f06d40b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06d40ccee0 0x7f06d4156680 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f06c00678c0 0x7f06c0069d80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 --2- 172.21.15.67:0/4286601843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06d4070140 0x7f06d4154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4286601843 >> 172.21.15.67:0/4286601843 conn(0x7f06d4073500 msgr2=0x7f06d406f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4286601843 shutdown_connections 2024-09-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.808+0000 7f06dbcc1640 1 -- 172.21.15.67:0/4286601843 wait complete. 2024-09-19T05:39:17.823 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:39:17.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.932+0000 7fa4f3664640 1 Processor -- start 2024-09-19T05:39:17.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.932+0000 7fa4f3664640 1 -- start start 2024-09-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.932+0000 7fa4f3664640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec06f460 0x7fa4ec06f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.932+0000 7fa4f3664640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4ec06e3c0 con 0x7fa4ec06dde0 2024-09-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.932+0000 7fa4f3664640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4ec06e6a0 con 0x7fa4ec15c030 2024-09-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.932+0000 7fa4f3664640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ec06e980 con 0x7fa4ec06f460 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f0bff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa4ec06dde0 0x7fa4ec0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34022/0 (socket says 172.21.15.67:34022) 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f0bff640 1 -- 172.21.15.67:0/2964324511 learned_addr learned my addr 172.21.15.67:0/2964324511 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f1c01640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec06f460 0x7fa4ec06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533922738 0 0) 0x7fa4ec06e3c0 con 0x7fa4ec06dde0 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4d8003530 con 0x7fa4ec06dde0 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2434536690 0 0) 0x7fa4d8003530 con 0x7fa4ec06dde0 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec06f460 msgr2=0x7fa4ec06f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec06f460 0x7fa4ec06f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 >> v1:172.21.15.97:6789/0 conn(0x7fa4ec15c030 legacy=0x7fa4ec15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec06ec60 con 0x7fa4ec06dde0 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fa4dc001680 con 0x7fa4ec06dde0 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 >> v1:172.21.15.67:6789/0 conn(0x7fa4ec06dde0 legacy=0x7fa4ec0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec06f460 0x7fa4d80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4d8003fc0 0x7fa4d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4d8004d50 0x7fa4d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec06e980 con 0x7fa4d8004d50 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d800bb10 con 0x7fa4d8003fc0 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d800bd10 con 0x7fa4ec06f460 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f1c01640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4d8004d50 0x7fa4d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f1400640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec06f460 0x7fa4d80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f0bff640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4d8003fc0 0x7fa4d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f1c01640 1 -- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec06f460 msgr2=0x7fa4d80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f1c01640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec06f460 0x7fa4d80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f1c01640 1 -- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4d8003fc0 msgr2=0x7fa4d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f1c01640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4d8003fc0 0x7fa4d8004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f1c01640 1 -- 172.21.15.67:0/2964324511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d8003530 con 0x7fa4d8004d50 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f1c01640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4d8004d50 0x7fa4d80051d0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009fa0 tx=0x7fa4e401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f200797033bbb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40b2070 con 0x7fa4d8004d50 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e40a5d10 con 0x7fa4d8004d50 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4e3fff640 1 -- 172.21.15.67:0/2964324511 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4009bf0 con 0x7fa4d8004d50 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f3664640 1 -- 172.21.15.67:0/2964324511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4d8004d50 msgr2=0x7fa4d80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f3664640 1 --2- 172.21.15.67:0/2964324511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4d8004d50 0x7fa4d80051d0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009fa0 tx=0x7fa4e401cc40 comp rx=0 tx=0).stop 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f1c01640 1 -- 172.21.15.67:0/2964324511 reap_dead start 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f3664640 1 -- 172.21.15.67:0/2964324511 shutdown_connections 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f3664640 1 -- 172.21.15.67:0/2964324511 >> 172.21.15.67:0/2964324511 conn(0x7fa4ec0d0080 msgr2=0x7fa4ec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.936+0000 7fa4f3664640 1 -- 172.21.15.67:0/2964324511 shutdown_connections 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 -- 172.21.15.67:0/2964324511 wait complete. 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 Processor -- start 2024-09-19T05:39:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 -- start start 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec1e5ba0 0x7fa4ec09abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4ec09c8e0 0x7fa4ec156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4ec1e5f80 0x7fa4ec1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec0b36e0 con 0x7fa4ec09c8e0 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec15c410 con 0x7fa4ec1e5f80 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ec1579e0 con 0x7fa4ec1e5ba0 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f0bff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4ec09c8e0 0x7fa4ec156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f0bff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4ec09c8e0 0x7fa4ec156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52376/0 (socket says 172.21.15.67:52376) 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f0bff640 1 -- 172.21.15.67:0/1484249184 learned_addr learned my addr 172.21.15.67:0/1484249184 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f1400640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec1e5ba0 0x7fa4ec09abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f1c01640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4ec1e5f80 0x7fa4ec1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f0bff640 1 -- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec1e5ba0 msgr2=0x7fa4ec09abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f0bff640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec1e5ba0 0x7fa4ec09abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f0bff640 1 -- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4ec1e5f80 msgr2=0x7fa4ec1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f0bff640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4ec1e5f80 0x7fa4ec1574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f0bff640 1 -- 172.21.15.67:0/1484249184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec1e5720 con 0x7fa4ec09c8e0 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f0bff640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4ec09c8e0 0x7fa4ec156f60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00db10 tx=0x7fa4dc001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4e1ffb640 1 -- 172.21.15.67:0/1484249184 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc019070 con 0x7fa4ec09c8e0 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4e1ffb640 1 -- 172.21.15.67:0/1484249184 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4dc004cc0 con 0x7fa4ec09c8e0 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4e1ffb640 1 -- 172.21.15.67:0/1484249184 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0072d0 con 0x7fa4ec09c8e0 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 -- 172.21.15.67:0/1484249184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ec09b240 con 0x7fa4ec09c8e0 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 -- 172.21.15.67:0/1484249184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ec09b800 con 0x7fa4ec09c8e0 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.940+0000 7fa4f3664640 1 -- 172.21.15.67:0/1484249184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4ec1f2060 con 0x7fa4ec09c8e0 2024-09-19T05:39:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.944+0000 7fa4e1ffb640 1 -- 172.21.15.67:0/1484249184 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4dc01c070 con 0x7fa4ec09c8e0 2024-09-19T05:39:17.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.944+0000 7fa4e1ffb640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4d00678c0 0x7fa4d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:17.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.944+0000 7fa4e1ffb640 1 -- 172.21.15.67:0/1484249184 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7fa4dc085b10 con 0x7fa4ec09c8e0 2024-09-19T05:39:17.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.944+0000 7fa4f1400640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4d00678c0 0x7fa4d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.944+0000 7fa4f1400640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4d00678c0 0x7fa4d0069d80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8005510 tx=0x7fa4e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:17.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:17.948+0000 7fa4e1ffb640 1 -- 172.21.15.67:0/1484249184 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa4ec1f2060 con 0x7fa4ec09c8e0 2024-09-19T05:39:18.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.148+0000 7fa4f3664640 1 -- 172.21.15.67:0/1484249184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa4ec06e2b0 con 0x7fa4ec09c8e0 2024-09-19T05:39:18.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.148+0000 7fa4e1ffb640 1 -- 172.21.15.67:0/1484249184 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) ==== 53+0+73 (secure 0 0 0) 0x7fa4dc056390 con 0x7fa4ec09c8e0 2024-09-19T05:39:18.149 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 -- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4d00678c0 msgr2=0x7fa4d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4d00678c0 0x7fa4d0069d80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8005510 tx=0x7fa4e8009040 comp rx=0 tx=0).stop 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 -- 172.21.15.67:0/1484249184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4ec09c8e0 msgr2=0x7fa4ec156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4ec09c8e0 0x7fa4ec156f60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00db10 tx=0x7fa4dc001da0 comp rx=0 tx=0).stop 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 -- 172.21.15.67:0/1484249184 shutdown_connections 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4ec1e5f80 0x7fa4ec1574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4ec09c8e0 0x7fa4ec156f60 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4d00678c0 0x7fa4d0069d80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 --2- 172.21.15.67:0/1484249184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec1e5ba0 0x7fa4ec09abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 -- 172.21.15.67:0/1484249184 >> 172.21.15.67:0/1484249184 conn(0x7fa4ec0d0080 msgr2=0x7fa4ec15c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 -- 172.21.15.67:0/1484249184 shutdown_connections 2024-09-19T05:39:18.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18.152+0000 7fa4f3664640 1 -- 172.21.15.67:0/1484249184 wait complete. 2024-09-19T05:39:18.167 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:39:18.167 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:39:18.167 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:39:18.167 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:39:18.167 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:39:18.167 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:39:18.167 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:39:18.167 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:39:18.167 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:39:18.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:18.168 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:39:18.173 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:39:18.174 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:39:18.175 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:39:18.175 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:39:18.175 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:39:18.175 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:39:18.175 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42146sec preferred_lft 42146sec 2024-09-19T05:39:18.175 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:39:18.175 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:39:18.175 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:39:18.176 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:39:18.176 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:39:18.176 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:39:18.176 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:39:18.176 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:39:18.176 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:39:18.176 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:39:18.176 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:39:18.176 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:39:18.176 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:39:18.177 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:39:18.177 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:39:18.177 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:39:18.177 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:39:18.177 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:39:18.177 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:39:18.177 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:39:18.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:18.177 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:39:18.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:18.229 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:39:18.277 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:39:18.278 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:39:18.278 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:39:18.278 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:39:18.278 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:39:18.278 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:39:18.278 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:39:18.278 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:39:18.278 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:39:18.278 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:39:18.278 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:39:18.279 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:39:18.279 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:39:18.279 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:39:18.279 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:39:18.279 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:39:18.279 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:39:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:39:18.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:39:18.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:18.402 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:39:18.452 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:39:18.453 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:39:18.453 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:39:18.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:18.453 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:39:18.507 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:39:18.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:39:18.507 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:39:18.554 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:39:18.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:39:18.555 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:39:18.602 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:39:18.664 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:39:18.713 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:39:18.713 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:39:18.713 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:39:18.713 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:39:18.713 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:39:18.713 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:39:18.714 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:39:18.715 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:39:18.716 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:39:18.716 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:39:18.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:18.717 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:39:18.763 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:39:18.764 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:39:18.808 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:39:18.823 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:39:18.877 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:39:18.877 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:39:18.877 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:39:18.877 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:39:18.877 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:39:18.877 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:39:18.877 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:39:18.877 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:39:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:39:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:39:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:39:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:39:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:39:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:39:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:39:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:39:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:39:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:39:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:39:18.880 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:39:18.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:18.880 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:39:18.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:39:18.888+0000 7fe6c49e0580 -1 init, newargv = 0x55d25f06a700 newargc=15 2024-09-19T05:39:18.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[58195]: starting ceph client 2024-09-19T05:39:18.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[58195]: starting fuse 2024-09-19T05:39:19.993 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:39:20.012 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:39:20.061 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:39:20.061 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:39:20.061 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:39:20.061 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:39:20.061 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:39:20.062 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:39:20.062 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:39:20.062 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:39:20.062 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:39:20.062 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:39:20.062 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:39:20.062 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:39:20.062 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:39:20.063 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:39:20.063 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:39:20.063 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:39:20.063 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:39:20.063 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:39:20.063 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:39:20.063 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:39:20.064 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:39:20.064 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:39:20.064 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:39:20.065 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:39:20.065 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:39:20.065 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:39:20.065 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:39:20.066 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:39:20.066 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:39:20.066 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:39:20.066 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:39:20.066 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:39:20.066 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:39:20.066 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:39:20.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:20.068 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:39:20.115 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:39:20.115 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:39:20.115 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:39:20.115 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:39:20.115 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:39:20.115 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:39:20.116 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:39:20.117 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:39:20.117 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:39:20.117 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:39:20.117 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:39:20.117 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:39:20.117 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:39:20.117 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:39:20.117 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:39:20.117 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:39:20.117 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:39:20.242 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.58195.asok 2024-09-19T05:39:20.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:39:20.256 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58195.asok 2024-09-19T05:39:20.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:20.256 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.58195.asok status 2024-09-19T05:39:20.416 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:39:20.416 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:39:20.416 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "58195", 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 7383, 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:39:20.417 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 7383 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 2049278257 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 2049278257 2024-09-19T05:39:20.418 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:20.419 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.7383 192.168.0.1:0/2049278257", 2024-09-19T05:39:20.419 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/2049278257", 2024-09-19T05:39:20.419 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:39:20.419 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 67, 2024-09-19T05:39:20.419 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 100, 2024-09-19T05:39:20.419 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:39:20.420 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:39:20.420 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:39:20.420 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:39:20.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:20.430 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:39:20.430 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:39:20.436 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:39:20.436 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:39:20.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:20.436 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:39:20.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:20.493 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-19T05:39:20.554 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:39:20.554 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:39:20.554 DEBUG:teuthology.orchestra.run.smithi067:> import stat 2024-09-19T05:39:20.554 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:39:20.554 DEBUG:teuthology.orchestra.run.smithi067:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-19T05:39:20.554 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:39:20.666 INFO:teuthology.orchestra.run.smithi067.stdout:1099511627776 2024-09-19T05:39:20.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:39:20.676 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46f0bf9640 1 Processor -- start 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46f0bf9640 1 -- start start 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46f0bf9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f46ec15f370 0x7f46ec0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46f0bf9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f46ec0ae8c0 0x7f46ec0aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46f0bf9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ec06e790 con 0x7f46ec070140 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46f0bf9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f46ec06ea50 con 0x7f46ec15f370 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46f0bf9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f46ec06ed30 con 0x7f46ec0ae8c0 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46ea59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f46ec070140 0x7f46ec070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34030/0 (socket says 172.21.15.67:34030) 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46ea59c640 1 -- 172.21.15.67:0/2489604864 learned_addr learned my addr 172.21.15.67:0/2489604864 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46e9d9b640 1 --2- 172.21.15.67:0/2489604864 >> v2:172.21.15.67:3300/0 conn(0x7f46ec15f370 0x7f46ec0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46ead9d640 1 --2- 172.21.15.67:0/2489604864 >> v2:172.21.15.97:3300/0 conn(0x7f46ec0ae8c0 0x7f46ec0aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46e959a640 1 -- 172.21.15.67:0/2489604864 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1357189469 0 0) 0x7f46ec06e790 con 0x7f46ec070140 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46e959a640 1 -- 172.21.15.67:0/2489604864 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46d8003530 con 0x7f46ec070140 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46e9d9b640 1 -- 172.21.15.67:0/2489604864 >> v2:172.21.15.97:3300/0 conn(0x7f46ec0ae8c0 msgr2=0x7f46ec0aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46e9d9b640 1 --2- 172.21.15.67:0/2489604864 >> v2:172.21.15.97:3300/0 conn(0x7f46ec0ae8c0 0x7f46ec0aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46e9d9b640 1 -- 172.21.15.67:0/2489604864 >> v1:172.21.15.67:6789/0 conn(0x7f46ec070140 legacy=0x7f46ec070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46e9d9b640 1 -- 172.21.15.67:0/2489604864 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec06f010 con 0x7f46ec15f370 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.844+0000 7f46ead9d640 1 --2- 172.21.15.67:0/2489604864 >> v2:172.21.15.97:3300/0 conn(0x7f46ec0ae8c0 0x7f46ec0aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46e9d9b640 1 --2- 172.21.15.67:0/2489604864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 0x7f46ec0ccee0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009d90 tx=0x7f46d401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76445bf92b09548 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46e959a640 1 -- 172.21.15.67:0/2489604864 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d40b2070 con 0x7f46ec15f370 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46e959a640 1 -- 172.21.15.67:0/2489604864 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d40a57f0 con 0x7f46ec15f370 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46e959a640 1 -- 172.21.15.67:0/2489604864 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0afa80 con 0x7f46ec15f370 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 -- 172.21.15.67:0/2489604864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 msgr2=0x7f46ec0ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 --2- 172.21.15.67:0/2489604864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 0x7f46ec0ccee0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009d90 tx=0x7f46d401c930 comp rx=0 tx=0).stop 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 -- 172.21.15.67:0/2489604864 shutdown_connections 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 --2- 172.21.15.67:0/2489604864 >> v2:172.21.15.97:3300/0 conn(0x7f46ec0ae8c0 0x7f46ec0aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 --2- 172.21.15.67:0/2489604864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 0x7f46ec0ccee0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 -- 172.21.15.67:0/2489604864 >> 172.21.15.67:0/2489604864 conn(0x7f46ec073500 msgr2=0x7f46ec06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 -- 172.21.15.67:0/2489604864 shutdown_connections 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 -- 172.21.15.67:0/2489604864 wait complete. 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 Processor -- start 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 -- start start 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46ec070140 0x7f46ec157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46ec0ae8c0 0x7f46ec15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 0x7f46ec157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec16b140 con 0x7f46ec15f370 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec16afc0 con 0x7f46ec0ae8c0 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.848+0000 7f46f0bf9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec16b2c0 con 0x7f46ec070140 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 0x7f46ec157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 0x7f46ec157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52394/0 (socket says 172.21.15.67:52394) 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ead9d640 1 -- 172.21.15.67:0/1814599329 learned_addr learned my addr 172.21.15.67:0/1814599329 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ea59c640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46ec070140 0x7f46ec157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46e9d9b640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46ec0ae8c0 0x7f46ec15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ead9d640 1 -- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46ec070140 msgr2=0x7f46ec157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ead9d640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46ec070140 0x7f46ec157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ead9d640 1 -- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46ec0ae8c0 msgr2=0x7f46ec15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ead9d640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46ec0ae8c0 0x7f46ec15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ead9d640 1 -- 172.21.15.67:0/1814599329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec158b20 con 0x7f46ec15f370 2024-09-19T05:39:20.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ead9d640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 0x7f46ec157ea0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00d560 tx=0x7f46dc00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:20.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46e2ffd640 1 -- 172.21.15.67:0/1814599329 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0125f0 con 0x7f46ec15f370 2024-09-19T05:39:20.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46e2ffd640 1 -- 172.21.15.67:0/1814599329 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46dc019070 con 0x7f46ec15f370 2024-09-19T05:39:20.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46f0bf9640 1 -- 172.21.15.67:0/1814599329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ec156860 con 0x7f46ec15f370 2024-09-19T05:39:20.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46e2ffd640 1 -- 172.21.15.67:0/1814599329 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0129d0 con 0x7f46ec15f370 2024-09-19T05:39:20.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46f0bf9640 1 -- 172.21.15.67:0/1814599329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ec15db60 con 0x7f46ec15f370 2024-09-19T05:39:20.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46f0bf9640 1 -- 172.21.15.67:0/1814599329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ec0b5ac0 con 0x7f46ec15f370 2024-09-19T05:39:20.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46e2ffd640 1 -- 172.21.15.67:0/1814599329 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46dc012b70 con 0x7f46ec15f370 2024-09-19T05:39:20.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46e2ffd640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46cc0678c0 0x7f46cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46e2ffd640 1 -- 172.21.15.67:0/1814599329 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f46dc0860a0 con 0x7f46ec15f370 2024-09-19T05:39:20.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.852+0000 7f46ea59c640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46cc0678c0 0x7f46cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.856+0000 7f46ea59c640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46cc0678c0 0x7f46cc069d80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f46e4005890 tx=0x7f46e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:20.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:20.856+0000 7f46e2ffd640 1 -- 172.21.15.67:0/1814599329 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f46dc056ae0 con 0x7f46ec15f370 2024-09-19T05:39:21.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.056+0000 7f46f0bf9640 1 -- 172.21.15.67:0/1814599329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46ec0aed30 con 0x7f46ec15f370 2024-09-19T05:39:21.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.056+0000 7f46e2ffd640 1 -- 172.21.15.67:0/1814599329 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5219 (secure 0 0 0) 0x7f46dc0563e0 con 0x7f46ec15f370 2024-09-19T05:39:21.056 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:21.056 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":67,"btime":"2024-09-19T05:39:10:515079+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1965498909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1965498909},{"type":"v1","addr":"172.21.15.97:6837","nonce":1965498909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/123788622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":123788622},{"type":"v1","addr":"172.21.15.97:6835","nonce":123788622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4015838682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":4015838682},{"type":"v1","addr":"172.21.15.67:6835","nonce":4015838682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:09.876016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6834/358275731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":358275731},{"type":"v1","addr":"172.21.15.67:6834","nonce":358275731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7215,"qdb_cluster":[7215]},"id":6}]} 2024-09-19T05:39:21.057 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 67 2024-09-19T05:39:21.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 -- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46cc0678c0 msgr2=0x7f46cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46cc0678c0 0x7f46cc069d80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f46e4005890 tx=0x7f46e4009040 comp rx=0 tx=0).stop 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 -- 172.21.15.67:0/1814599329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 msgr2=0x7f46ec157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 0x7f46ec157ea0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00d560 tx=0x7f46dc00da20 comp rx=0 tx=0).stop 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 -- 172.21.15.67:0/1814599329 shutdown_connections 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46ec15f370 0x7f46ec157ea0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46ec0ae8c0 0x7f46ec15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46cc0678c0 0x7f46cc069d80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 --2- 172.21.15.67:0/1814599329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46ec070140 0x7f46ec157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 -- 172.21.15.67:0/1814599329 >> 172.21.15.67:0/1814599329 conn(0x7f46ec073500 msgr2=0x7f46ec160b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 -- 172.21.15.67:0/1814599329 shutdown_connections 2024-09-19T05:39:21.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.060+0000 7f46f0bf9640 1 -- 172.21.15.67:0/1814599329 wait complete. 2024-09-19T05:39:21.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-19T05:39:21.220 INFO:teuthology.orchestra.run.smithi067.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-19T05:39:20.548130+0000","btime":"2024-09-19T05:39:20.548130+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-19T05:39:20.548130+0000","atime":"2024-09-19T05:39:20.548130+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":7383,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":7383,"want_loner":7383,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-19T05:39:21.220 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-19T05:39:20.548130+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-19T05:39:20.548130+0000", "change_attr": 0, "client_caps": [ { "client_id": 7383, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-19T05:39:20.548130+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 7383, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-19T05:39:20.548130+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 7383, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [] } 2024-09-19T05:39:21.221 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:39:21.221 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:21.227 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:39:21.227 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:39:21.227 DEBUG:teuthology.orchestra.run.smithi067:> import uuid 2024-09-19T05:39:21.227 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:39:21.227 DEBUG:teuthology.orchestra.run.smithi067:> n = 21 2024-09-19T05:39:21.227 DEBUG:teuthology.orchestra.run.smithi067:> create_hard_links = False 2024-09-19T05:39:21.227 DEBUG:teuthology.orchestra.run.smithi067:> if 0 > 0: 2024-09-19T05:39:21.227 DEBUG:teuthology.orchestra.run.smithi067:> create_hard_links = True 2024-09-19T05:39:21.227 DEBUG:teuthology.orchestra.run.smithi067:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> dpath = os.path.dirname(path) 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> fnameprefix = os.path.basename(path) 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> os.makedirs(dpath, exist_ok=True) 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> try: 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> for i in range(n): 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> with open(fpath, '"'"'w'"'"') as f: 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> f.write(f"{i}") 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> f.flush() 2024-09-19T05:39:21.228 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(f.fileno()) 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> os.unlink(fpath) 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(dirfd) 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> if create_hard_links: 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> for j in range(0): 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(dirfd) 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> finally: 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> os.close(dirfd) 2024-09-19T05:39:21.229 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:39:21.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:39:21.428 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:39:21.428 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:21.476 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:39:21.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.652+0000 7f93436e1640 1 Processor -- start 2024-09-19T05:39:21.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.652+0000 7f93436e1640 1 -- start start 2024-09-19T05:39:21.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f93436e1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c15c030 0x7f933c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:21.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f93436e1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933c06e3c0 con 0x7f933c06f460 2024-09-19T05:39:21.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f93436e1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933c06e6a0 con 0x7f933c15d1d0 2024-09-19T05:39:21.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f93436e1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f933c06e980 con 0x7f933c15c030 2024-09-19T05:39:21.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f9341c7e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f933c06f460 0x7f933c0acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34040/0 (socket says 172.21.15.67:34040) 2024-09-19T05:39:21.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f9341c7e640 1 -- 172.21.15.67:0/631099259 learned_addr learned my addr 172.21.15.67:0/631099259 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:21.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f934147d640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c15c030 0x7f933c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:21.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2619745301 0 0) 0x7f933c06e3c0 con 0x7f933c06f460 2024-09-19T05:39:21.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9328003530 con 0x7f933c06f460 2024-09-19T05:39:21.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4183712331 0 0) 0x7f9328003530 con 0x7f933c06f460 2024-09-19T05:39:21.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c15c030 msgr2=0x7f933c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:21.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c15c030 0x7f933c06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 >> v1:172.21.15.97:6789/0 conn(0x7f933c15d1d0 legacy=0x7f933c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c06ec60 con 0x7f933c06f460 2024-09-19T05:39:21.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9334001a00 con 0x7f933c06f460 2024-09-19T05:39:21.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 >> v1:172.21.15.67:6789/0 conn(0x7f933c06f460 legacy=0x7f933c0acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93280039f0 0x7f9328003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c15c030 0x7f9328004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9328004d50 0x7f93280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f933c06e980 con 0x7f9328004d50 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f932800b9d0 con 0x7f93280039f0 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f932800bbd0 con 0x7f933c15c030 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f9341c7e640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9328004d50 0x7f93280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f934147d640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93280039f0 0x7f9328003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f9340c7c640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c15c030 0x7f9328004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f9341c7e640 1 -- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c15c030 msgr2=0x7f9328004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f9341c7e640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c15c030 0x7f9328004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f9341c7e640 1 -- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93280039f0 msgr2=0x7f9328003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:21.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f9341c7e640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93280039f0 0x7f9328003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f9341c7e640 1 -- 172.21.15.67:0/631099259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9328003530 con 0x7f9328004d50 2024-09-19T05:39:21.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f934147d640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93280039f0 0x7f9328003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:21.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.656+0000 7f9340c7c640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c15c030 0x7f9328004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9341c7e640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9328004d50 0x7f93280051d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f933400a7c0 tx=0x7f933401fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61798ce9603fa294 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933400a410 con 0x7f9328004d50 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93340aa690 con 0x7f9328004d50 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f932ffff640 1 -- 172.21.15.67:0/631099259 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93340aaa80 con 0x7f9328004d50 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 -- 172.21.15.67:0/631099259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9328004d50 msgr2=0x7f93280051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 --2- 172.21.15.67:0/631099259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9328004d50 0x7f93280051d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f933400a7c0 tx=0x7f933401fa40 comp rx=0 tx=0).stop 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9341c7e640 1 -- 172.21.15.67:0/631099259 reap_dead start 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 -- 172.21.15.67:0/631099259 shutdown_connections 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 -- 172.21.15.67:0/631099259 >> 172.21.15.67:0/631099259 conn(0x7f933c0d0080 msgr2=0x7f933c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 -- 172.21.15.67:0/631099259 shutdown_connections 2024-09-19T05:39:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 -- 172.21.15.67:0/631099259 wait complete. 2024-09-19T05:39:21.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 Processor -- start 2024-09-19T05:39:21.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 -- start start 2024-09-19T05:39:21.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c153860 0x7f933c1f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c1e49b0 0x7f933c0b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b15b0 0x7f933c159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0b36e0 con 0x7f933c1e49b0 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f933c15d630 con 0x7f933c153860 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f93436e1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f933c1f55b0 con 0x7f933c0b15b0 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9340c7c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c1e49b0 0x7f933c0b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9340c7c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c1e49b0 0x7f933c0b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52414/0 (socket says 172.21.15.67:52414) 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9340c7c640 1 -- 172.21.15.67:0/3006712885 learned_addr learned my addr 172.21.15.67:0/3006712885 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9341c7e640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b15b0 0x7f933c159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f934147d640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c153860 0x7f933c1f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9340c7c640 1 -- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b15b0 msgr2=0x7f933c159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9340c7c640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b15b0 0x7f933c159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9340c7c640 1 -- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c153860 msgr2=0x7f933c1f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9340c7c640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c153860 0x7f933c1f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f9340c7c640 1 -- 172.21.15.67:0/3006712885 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c1e54f0 con 0x7f933c1e49b0 2024-09-19T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.660+0000 7f934147d640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c153860 0x7f933c1f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f9340c7c640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c1e49b0 0x7f933c0b1070 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f933800e800 tx=0x7f933800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f932dffb640 1 -- 172.21.15.67:0/3006712885 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93380050d0 con 0x7f933c1e49b0 2024-09-19T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f932dffb640 1 -- 172.21.15.67:0/3006712885 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9338018070 con 0x7f933c1e49b0 2024-09-19T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f932dffb640 1 -- 172.21.15.67:0/3006712885 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933800c660 con 0x7f933c1e49b0 2024-09-19T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f93436e1640 1 -- 172.21.15.67:0/3006712885 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933c1e5790 con 0x7f933c1e49b0 2024-09-19T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f93436e1640 1 -- 172.21.15.67:0/3006712885 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933c072040 con 0x7f933c1e49b0 2024-09-19T05:39:21.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f93436e1640 1 -- 172.21.15.67:0/3006712885 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933c15c410 con 0x7f933c1e49b0 2024-09-19T05:39:21.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f932dffb640 1 -- 172.21.15.67:0/3006712885 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f933800c800 con 0x7f933c1e49b0 2024-09-19T05:39:21.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f932dffb640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93200678c0 0x7f9320069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:21.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f932dffb640 1 -- 172.21.15.67:0/3006712885 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f9338085b20 con 0x7f933c1e49b0 2024-09-19T05:39:21.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f934147d640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93200678c0 0x7f9320069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:21.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.664+0000 7f934147d640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93200678c0 0x7f9320069d80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9330006f90 tx=0x7f9330008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:21.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.668+0000 7f932dffb640 1 -- 172.21.15.67:0/3006712885 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9338056560 con 0x7f933c1e49b0 2024-09-19T05:39:21.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.844+0000 7f93436e1640 1 -- 172.21.15.67:0/3006712885 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f933c0b1990 con 0x7f933c1e49b0 2024-09-19T05:39:21.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.844+0000 7f932dffb640 1 -- 172.21.15.67:0/3006712885 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v100) ==== 80+0+0 (secure 0 0 0) 0x7f9338055e60 con 0x7f933c1e49b0 2024-09-19T05:39:21.845 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:39:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 -- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93200678c0 msgr2=0x7f9320069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93200678c0 0x7f9320069d80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9330006f90 tx=0x7f9330008040 comp rx=0 tx=0).stop 2024-09-19T05:39:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 -- 172.21.15.67:0/3006712885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c1e49b0 msgr2=0x7f933c0b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c1e49b0 0x7f933c0b1070 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f933800e800 tx=0x7f933800ecc0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 -- 172.21.15.67:0/3006712885 shutdown_connections 2024-09-19T05:39:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93200678c0 0x7f9320069d80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b15b0 0x7f933c159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c1e49b0 0x7f933c0b1070 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 --2- 172.21.15.67:0/3006712885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c153860 0x7f933c1f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 -- 172.21.15.67:0/3006712885 >> 172.21.15.67:0/3006712885 conn(0x7f933c0d0080 msgr2=0x7f933c15f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:21.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 -- 172.21.15.67:0/3006712885 shutdown_connections 2024-09-19T05:39:21.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:21.848+0000 7f93436e1640 1 -- 172.21.15.67:0/3006712885 wait complete. 2024-09-19T05:39:21.864 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:39:21.864 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:21.870 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:39:22.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48d0dd5640 1 Processor -- start 2024-09-19T05:39:22.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48d0dd5640 1 -- start start 2024-09-19T05:39:22.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48d0dd5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f48cc15c030 0x7f48cc06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:22.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48d0dd5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48cc06f460 0x7f48cc06f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:22.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48d0dd5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48cc06e3c0 con 0x7f48cc15d1d0 2024-09-19T05:39:22.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48d0dd5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f48cc06e6a0 con 0x7f48cc15c030 2024-09-19T05:39:22.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48d0dd5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc06e980 con 0x7f48cc06f460 2024-09-19T05:39:22.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48ca59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f48cc15c030 0x7f48cc06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:22.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48c9d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f48cc15d1d0 0x7f48cc0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34056/0 (socket says 172.21.15.67:34056) 2024-09-19T05:39:22.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48c9d9b640 1 -- 172.21.15.67:0/2907784809 learned_addr learned my addr 172.21.15.67:0/2907784809 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:22.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48cad9d640 1 --2- 172.21.15.67:0/2907784809 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48cc06f460 0x7f48cc06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:22.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48ca59c640 1 -- 172.21.15.67:0/2907784809 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48cc06f460 msgr2=0x7f48cc06f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:22.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48ca59c640 1 --2- 172.21.15.67:0/2907784809 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48cc06f460 0x7f48cc06f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:22.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48ca59c640 1 -- 172.21.15.67:0/2907784809 >> v1:172.21.15.67:6789/0 conn(0x7f48cc15d1d0 legacy=0x7f48cc0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:22.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48c959a640 1 -- 172.21.15.67:0/2907784809 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37283278 0 0) 0x7f48cc06e3c0 con 0x7f48cc15d1d0 2024-09-19T05:39:22.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.044+0000 7f48ca59c640 1 -- 172.21.15.67:0/2907784809 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc06ec60 con 0x7f48cc15c030 2024-09-19T05:39:22.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48ca59c640 1 --2- 172.21.15.67:0/2907784809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 0x7f48cc06dde0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0097c0 tx=0x7f48bc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5137a1a371ccbdab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:22.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48c959a640 1 -- 172.21.15.67:0/2907784809 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0b0070 con 0x7f48cc15c030 2024-09-19T05:39:22.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48c959a640 1 -- 172.21.15.67:0/2907784809 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48bc0ab600 con 0x7f48cc15c030 2024-09-19T05:39:22.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48c959a640 1 -- 172.21.15.67:0/2907784809 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0ab9d0 con 0x7f48cc15c030 2024-09-19T05:39:22.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48d0dd5640 1 -- 172.21.15.67:0/2907784809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 msgr2=0x7f48cc06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:22.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48d0dd5640 1 --2- 172.21.15.67:0/2907784809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 0x7f48cc06dde0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0097c0 tx=0x7f48bc01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:39:22.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48d0dd5640 1 -- 172.21.15.67:0/2907784809 shutdown_connections 2024-09-19T05:39:22.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48d0dd5640 1 --2- 172.21.15.67:0/2907784809 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48cc06f460 0x7f48cc06f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:22.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48d0dd5640 1 --2- 172.21.15.67:0/2907784809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 0x7f48cc06dde0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:22.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48d0dd5640 1 -- 172.21.15.67:0/2907784809 >> 172.21.15.67:0/2907784809 conn(0x7f48cc0d0080 msgr2=0x7f48cc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:22.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48d0dd5640 1 -- 172.21.15.67:0/2907784809 shutdown_connections 2024-09-19T05:39:22.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48d0dd5640 1 -- 172.21.15.67:0/2907784809 wait complete. 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.048+0000 7f48d0dd5640 1 Processor -- start 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48d0dd5640 1 -- start start 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48d0dd5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48cc06f460 0x7f48cc14cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48d0dd5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 0x7f48cc149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48d0dd5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48cc15d1d0 0x7f48cc0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48d0dd5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc15c590 con 0x7f48cc15c030 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48d0dd5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc15c410 con 0x7f48cc15d1d0 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48d0dd5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc1690e0 con 0x7f48cc06f460 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48c9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 0x7f48cc149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48c9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 0x7f48cc149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52426/0 (socket says 172.21.15.67:52426) 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48c9d9b640 1 -- 172.21.15.67:0/1932292140 learned_addr learned my addr 172.21.15.67:0/1932292140 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48cad9d640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48cc15d1d0 0x7f48cc0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48ca59c640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48cc06f460 0x7f48cc14cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48c9d9b640 1 -- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48cc06f460 msgr2=0x7f48cc14cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48c9d9b640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48cc06f460 0x7f48cc14cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48c9d9b640 1 -- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48cc15d1d0 msgr2=0x7f48cc0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48c9d9b640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48cc15d1d0 0x7f48cc0b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48c9d9b640 1 -- 172.21.15.67:0/1932292140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc14f630 con 0x7f48cc15c030 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48c9d9b640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 0x7f48cc149ed0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f48c000c7c0 tx=0x7f48c000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48baffd640 1 -- 172.21.15.67:0/1932292140 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0018070 con 0x7f48cc15c030 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48baffd640 1 -- 172.21.15.67:0/1932292140 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c000a5e0 con 0x7f48cc15c030 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48d0dd5640 1 -- 172.21.15.67:0/1932292140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc14a410 con 0x7f48cc15c030 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48baffd640 1 -- 172.21.15.67:0/1932292140 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c000a9d0 con 0x7f48cc15c030 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48d0dd5640 1 -- 172.21.15.67:0/1932292140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc14f8d0 con 0x7f48cc15c030 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48d0dd5640 1 -- 172.21.15.67:0/1932292140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48cc06f890 con 0x7f48cc15c030 2024-09-19T05:39:22.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48baffd640 1 -- 172.21.15.67:0/1932292140 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f48c001b070 con 0x7f48cc15c030 2024-09-19T05:39:22.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.052+0000 7f48baffd640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ac0678c0 0x7f48ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:22.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.056+0000 7f48baffd640 1 -- 172.21.15.67:0/1932292140 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f48c0085440 con 0x7f48cc15c030 2024-09-19T05:39:22.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.056+0000 7f48ca59c640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ac0678c0 0x7f48ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:22.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.056+0000 7f48ca59c640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ac0678c0 0x7f48ac069d80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0ad000 tx=0x7f48bc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:22.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.060+0000 7f48baffd640 1 -- 172.21.15.67:0/1932292140 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f48c0055df0 con 0x7f48cc15c030 2024-09-19T05:39:22.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.232+0000 7f48d0dd5640 1 -- 172.21.15.67:0/1932292140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f48cc15e680 con 0x7f48cc15c030 2024-09-19T05:39:22.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.232+0000 7f48baffd640 1 -- 172.21.15.67:0/1932292140 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v100) ==== 80+0+0 (secure 0 0 0) 0x7f48c00556f0 con 0x7f48cc15c030 2024-09-19T05:39:22.234 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:39:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 -- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ac0678c0 msgr2=0x7f48ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ac0678c0 0x7f48ac069d80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0ad000 tx=0x7f48bc0a6000 comp rx=0 tx=0).stop 2024-09-19T05:39:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 -- 172.21.15.67:0/1932292140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 msgr2=0x7f48cc149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 0x7f48cc149ed0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f48c000c7c0 tx=0x7f48c000cc80 comp rx=0 tx=0).stop 2024-09-19T05:39:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 -- 172.21.15.67:0/1932292140 shutdown_connections 2024-09-19T05:39:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48cc15d1d0 0x7f48cc0b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48cc15c030 0x7f48cc149ed0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48ac0678c0 0x7f48ac069d80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 --2- 172.21.15.67:0/1932292140 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48cc06f460 0x7f48cc14cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:22.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 -- 172.21.15.67:0/1932292140 >> 172.21.15.67:0/1932292140 conn(0x7f48cc0d0080 msgr2=0x7f48cc15eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:22.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 -- 172.21.15.67:0/1932292140 shutdown_connections 2024-09-19T05:39:22.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:22.236+0000 7f48d0dd5640 1 -- 172.21.15.67:0/1932292140 wait complete. 2024-09-19T05:39:22.253 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:39:22.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:22.253 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:39:22.265 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[58195]: fuse finished with error 0 and tester_r 0 2024-09-19T05:39:22.266 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:28.368 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:39:28.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:28.368 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:39:28.376 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-19T05:39:28.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.552+0000 7fe4e1829640 1 Processor -- start 2024-09-19T05:39:28.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4e1829640 1 -- start start 2024-09-19T05:39:28.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4e1829640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe4dc15b1d0 0x7fe4dc0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4e1829640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4dc06dfc0 0x7fe4dc06f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4e1829640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4dc0aef30 con 0x7fe4dc06fea0 2024-09-19T05:39:28.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4e1829640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe4dc072210 con 0x7fe4dc06dfc0 2024-09-19T05:39:28.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4e1829640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe4dc0ae0f0 con 0x7fe4dc15b1d0 2024-09-19T05:39:28.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4d3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4dc06dfc0 0x7fe4dc06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4d3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4dc06dfc0 0x7fe4dc06f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46210/0 (socket says 172.21.15.67:46210) 2024-09-19T05:39:28.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4d3fff640 1 -- 172.21.15.67:0/3977823152 learned_addr learned my addr 172.21.15.67:0/3977823152 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4daffd640 1 --2- 172.21.15.67:0/3977823152 >> v2:172.21.15.97:3300/0 conn(0x7fe4dc15b1d0 0x7fe4dc0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4d3fff640 1 -- 172.21.15.67:0/3977823152 >> v2:172.21.15.97:3300/0 conn(0x7fe4dc15b1d0 msgr2=0x7fe4dc0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/3977823152 >> v2:172.21.15.97:3300/0 conn(0x7fe4dc15b1d0 0x7fe4dc0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4d3fff640 1 -- 172.21.15.67:0/3977823152 >> v1:172.21.15.97:6789/0 conn(0x7fe4dc06fea0 legacy=0x7fe4dc15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4d3fff640 1 -- 172.21.15.67:0/3977823152 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc0ae3b0 con 0x7fe4dc06dfc0 2024-09-19T05:39:28.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4daffd640 1 --2- 172.21.15.67:0/3977823152 >> v2:172.21.15.97:3300/0 conn(0x7fe4dc15b1d0 0x7fe4dc0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:28.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.556+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/3977823152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06dfc0 0x7fe4dc06f960 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0711d0 tx=0x7fe4c401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa155fb51a2a04f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4da7fc640 1 -- 172.21.15.67:0/3977823152 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40b0070 con 0x7fe4dc06dfc0 2024-09-19T05:39:28.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4da7fc640 1 -- 172.21.15.67:0/3977823152 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c40ab600 con 0x7fe4dc06dfc0 2024-09-19T05:39:28.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4da7fc640 1 -- 172.21.15.67:0/3977823152 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40ab9d0 con 0x7fe4dc06dfc0 2024-09-19T05:39:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 -- 172.21.15.67:0/3977823152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06dfc0 msgr2=0x7fe4dc06f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 --2- 172.21.15.67:0/3977823152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06dfc0 0x7fe4dc06f960 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0711d0 tx=0x7fe4c401c520 comp rx=0 tx=0).stop 2024-09-19T05:39:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 -- 172.21.15.67:0/3977823152 shutdown_connections 2024-09-19T05:39:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 --2- 172.21.15.67:0/3977823152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06dfc0 0x7fe4dc06f960 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 --2- 172.21.15.67:0/3977823152 >> v2:172.21.15.97:3300/0 conn(0x7fe4dc15b1d0 0x7fe4dc0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 -- 172.21.15.67:0/3977823152 >> 172.21.15.67:0/3977823152 conn(0x7fe4dc0b1e50 msgr2=0x7fe4dc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 -- 172.21.15.67:0/3977823152 shutdown_connections 2024-09-19T05:39:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 -- 172.21.15.67:0/3977823152 wait complete. 2024-09-19T05:39:28.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 Processor -- start 2024-09-19T05:39:28.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 -- start start 2024-09-19T05:39:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4dc06dfc0 0x7fe4dc15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06fea0 0x7fe4dc151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4dc15b1d0 0x7fe4dc15b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc0b4440 con 0x7fe4dc06fea0 2024-09-19T05:39:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc072420 con 0x7fe4dc15b1d0 2024-09-19T05:39:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4e1829640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4dc06e850 con 0x7fe4dc06dfc0 2024-09-19T05:39:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4d3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06fea0 0x7fe4dc151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4d3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06fea0 0x7fe4dc151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46220/0 (socket says 172.21.15.67:46220) 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4d3fff640 1 -- 172.21.15.67:0/2462016929 learned_addr learned my addr 172.21.15.67:0/2462016929 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4db7fe640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4dc15b1d0 0x7fe4dc15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4daffd640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4dc06dfc0 0x7fe4dc15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4d3fff640 1 -- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4dc06dfc0 msgr2=0x7fe4dc15a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4dc06dfc0 0x7fe4dc15a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4d3fff640 1 -- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4dc15b1d0 msgr2=0x7fe4dc15b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4dc15b1d0 0x7fe4dc15b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4d3fff640 1 -- 172.21.15.67:0/2462016929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc1593f0 con 0x7fe4dc06fea0 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4daffd640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4dc06dfc0 0x7fe4dc15a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06fea0 0x7fe4dc151030 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4019130 tx=0x7fe4c40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.560+0000 7fe4d8ff9640 1 -- 172.21.15.67:0/2462016929 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40b9070 con 0x7fe4dc06fea0 2024-09-19T05:39:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4d8ff9640 1 -- 172.21.15.67:0/2462016929 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c40b4600 con 0x7fe4dc06fea0 2024-09-19T05:39:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4d8ff9640 1 -- 172.21.15.67:0/2462016929 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40b0040 con 0x7fe4dc06fea0 2024-09-19T05:39:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4e1829640 1 -- 172.21.15.67:0/2462016929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4dc1596d0 con 0x7fe4dc06fea0 2024-09-19T05:39:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4e1829640 1 -- 172.21.15.67:0/2462016929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4dc154b40 con 0x7fe4dc06fea0 2024-09-19T05:39:28.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4d8ff9640 1 -- 172.21.15.67:0/2462016929 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4c40bc070 con 0x7fe4dc06fea0 2024-09-19T05:39:28.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4d8ff9640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4bc0678c0 0x7fe4bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4d8ff9640 1 -- 172.21.15.67:0/2462016929 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7fe4c411f000 con 0x7fe4dc06fea0 2024-09-19T05:39:28.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4daffd640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4bc0678c0 0x7fe4bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4e48e5000 1 Processor -- start 2024-09-19T05:39:28.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4e48e5000 1 -- start start 2024-09-19T05:39:28.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4daffd640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4bc0678c0 0x7fe4bc069d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc164e10 tx=0x7fe4cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9cfd70 0x56324c9d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9d0690 0x56324c983870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c983db0 0x56324c984190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56324c86d960 con 0x56324c9cfd70 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56324c7b1900 con 0x56324c9d0690 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56324c7d4d40 con 0x56324c983db0 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.564+0000 7fe4daffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9cfd70 0x56324c9d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9cfd70 0x56324c9d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46224/0 (socket says 172.21.15.67:46224) 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 -- 172.21.15.67:0/2480712403 learned_addr learned my addr 172.21.15.67:0/2480712403 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/2480712403 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9d0690 0x56324c983870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4db7fe640 1 --2- 172.21.15.67:0/2480712403 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c983db0 0x56324c984190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 -- 172.21.15.67:0/2480712403 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c983db0 msgr2=0x56324c984190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 --2- 172.21.15.67:0/2480712403 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c983db0 0x56324c984190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 -- 172.21.15.67:0/2480712403 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9d0690 msgr2=0x56324c983870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 --2- 172.21.15.67:0/2480712403 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9d0690 0x56324c983870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 -- 172.21.15.67:0/2480712403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324c77b580 con 0x56324c9cfd70 2024-09-19T05:39:28.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 --2- 172.21.15.67:0/2480712403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9cfd70 0x56324c9d0150 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00db90 tx=0x7fe4cc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4af5d5d378b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4d17fa640 1 -- 172.21.15.67:0/2480712403 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc019050 con 0x56324c9cfd70 2024-09-19T05:39:28.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4d17fa640 1 -- 172.21.15.67:0/2480712403 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4cc023070 con 0x56324c9cfd70 2024-09-19T05:39:28.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4d17fa640 1 -- 172.21.15.67:0/2480712403 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc012dc0 con 0x56324c9cfd70 2024-09-19T05:39:28.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 -- 172.21.15.67:0/2480712403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9cfd70 msgr2=0x56324c9d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/2480712403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9cfd70 0x56324c9d0150 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00db90 tx=0x7fe4cc010000 comp rx=0 tx=0).stop 2024-09-19T05:39:28.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 -- 172.21.15.67:0/2480712403 shutdown_connections 2024-09-19T05:39:28.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/2480712403 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c983db0 0x56324c984190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/2480712403 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9d0690 0x56324c983870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/2480712403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9cfd70 0x56324c9d0150 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 -- 172.21.15.67:0/2480712403 >> 172.21.15.67:0/2480712403 conn(0x56324c9b1040 msgr2=0x56324c9b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:28.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 -- 172.21.15.67:0/2480712403 shutdown_connections 2024-09-19T05:39:28.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 -- 172.21.15.67:0/2480712403 wait complete. 2024-09-19T05:39:28.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 -- start start 2024-09-19T05:39:28.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 Processor -- start 2024-09-19T05:39:28.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c983db0 0x56324c9d6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c9cfd70 0x56324c9d7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9d0690 0x56324c9d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56324c7d0d00 con 0x56324c983db0 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56324c78faa0 con 0x56324c9d0690 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56324c76e340 con 0x56324c9cfd70 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 10 client.0 _ll_register_callbacks cb 0x56324c971760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c983db0 0x56324c9d6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c983db0 0x56324c9d6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46230/0 (socket says 172.21.15.67:46230) 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 -- 172.21.15.67:0/66184316 learned_addr learned my addr 172.21.15.67:0/66184316 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c9cfd70 0x56324c9d7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4db7fe640 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9d0690 0x56324c9d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 -- 172.21.15.67:0/66184316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c9cfd70 msgr2=0x56324c9d7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c9cfd70 0x56324c9d7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 -- 172.21.15.67:0/66184316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9d0690 msgr2=0x56324c9d7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9d0690 0x56324c9d7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 -- 172.21.15.67:0/66184316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324c777dc0 con 0x56324c983db0 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4daffd640 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c983db0 0x56324c9d6ce0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc020040 tx=0x7fe4cc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2163f7cbcedc2f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/66184316 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc035060 con 0x56324c983db0 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/66184316 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7fe4cc01ea80 con 0x56324c983db0 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 1 -- 172.21.15.67:0/66184316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4cc023070 con 0x56324c983db0 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/66184316 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fe4cc019020 con 0x56324c983db0 2024-09-19T05:39:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.568+0000 7fe4e48e5000 10 client.7419 fetch_fsmap learned FSMap version 67 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 -- 172.21.15.67:0/66184316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x56324c7747f0 con 0x56324c983db0 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/66184316 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4cc023070 con 0x56324c983db0 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/66184316 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x7fe4cc01ec80 con 0x56324c983db0 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 10 client.7419 fetch_fsmap finished waiting for FSMap version 67 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 10 client.7419 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 20 client.7419 populate_metadata read hostname 'smithi067' 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x56324c9df0b0 0x56324c9e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 4 client.7419 mds_command: new command op to 7215 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 -- 172.21.15.67:0/66184316 --> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56324c76ee10 con 0x56324c9df0b0 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x56324c9df0b0 0x56324c9e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x56324c9df0b0 0x56324c9e14a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb862e5dde864eb7 server_cookie=ac66f46d84d96e2f in_seq=0 out_seq=0 2024-09-19T05:39:28.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4ba7fc640 10 client.7419 ms_handle_connect on v2:172.21.15.67:6832/358275731 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/66184316 <== mds.0 v2:172.21.15.67:6832/358275731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56324c76ee10 con 0x56324c9df0b0 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4ba7fc640 10 client.7419 handle_command_reply: tid=0 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 client.7419 shutdown 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 -- 172.21.15.67:0/66184316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c983db0 msgr2=0x56324c9d6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c983db0 0x56324c9d6ce0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc020040 tx=0x7fe4cc004740 comp rx=0 tx=0).stop 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 -- 172.21.15.67:0/66184316 shutdown_connections 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9d0690 0x56324c9d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x56324c9df0b0 0x56324c9e14a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c9cfd70 0x56324c9d7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/66184316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c983db0 0x56324c9d6ce0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 -- 172.21.15.67:0/66184316 >> 172.21.15.67:0/66184316 conn(0x56324c9b1040 msgr2=0x56324c982f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4ba7fc640 0 client.7419 ms_handle_reset on v2:172.21.15.67:6832/358275731 2024-09-19T05:39:28.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 -- 172.21.15.67:0/66184316 shutdown_connections 2024-09-19T05:39:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 1 -- 172.21.15.67:0/66184316 wait complete. 2024-09-19T05:39:28.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.572+0000 7fe4e48e5000 20 client.7419 trim_cache size 0 max 16384 2024-09-19T05:39:28.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 Processor -- start 2024-09-19T05:39:28.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 -- start start 2024-09-19T05:39:28.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c983db0 0x56324c9e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c9cfd70 0x56324c9dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9dd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc203f80 con 0x56324c9d0690 2024-09-19T05:39:28.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc202fe0 con 0x56324c983db0 2024-09-19T05:39:28.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4dc202440 con 0x56324c9cfd70 2024-09-19T05:39:28.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9dd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9dd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46232/0 (socket says 172.21.15.67:46232) 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4db7fe640 1 -- 172.21.15.67:0/1581820805 learned_addr learned my addr 172.21.15.67:0/1581820805 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4daffd640 1 --2- 172.21.15.67:0/1581820805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c983db0 0x56324c9e48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/1581820805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c9cfd70 0x56324c9dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4db7fe640 1 -- 172.21.15.67:0/1581820805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c9cfd70 msgr2=0x56324c9dd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4db7fe640 1 --2- 172.21.15.67:0/1581820805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c9cfd70 0x56324c9dd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4db7fe640 1 -- 172.21.15.67:0/1581820805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c983db0 msgr2=0x56324c9e48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4db7fe640 1 --2- 172.21.15.67:0/1581820805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c983db0 0x56324c9e48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4db7fe640 1 -- 172.21.15.67:0/1581820805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324c792470 con 0x56324c9d0690 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4db7fe640 1 --2- 172.21.15.67:0/1581820805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9dd720 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4005080 tx=0x7fe4d4005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1f6597a812f312 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4d0ff9640 1 -- 172.21.15.67:0/1581820805 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4005790 con 0x56324c9d0690 2024-09-19T05:39:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4d0ff9640 1 -- 172.21.15.67:0/1581820805 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d401b070 con 0x56324c9d0690 2024-09-19T05:39:28.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4d0ff9640 1 -- 172.21.15.67:0/1581820805 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4001d50 con 0x56324c9d0690 2024-09-19T05:39:28.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 -- 172.21.15.67:0/1581820805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 msgr2=0x56324c9dd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/1581820805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9dd720 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4005080 tx=0x7fe4d4005540 comp rx=0 tx=0).stop 2024-09-19T05:39:28.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 -- 172.21.15.67:0/1581820805 shutdown_connections 2024-09-19T05:39:28.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/1581820805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9dd720 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/1581820805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c9cfd70 0x56324c9dd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/1581820805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c983db0 0x56324c9e48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 -- 172.21.15.67:0/1581820805 >> 172.21.15.67:0/1581820805 conn(0x56324c9b1040 msgr2=0x56324c9dcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:28.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 -- 172.21.15.67:0/1581820805 shutdown_connections 2024-09-19T05:39:28.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.588+0000 7fe4e48e5000 1 -- 172.21.15.67:0/1581820805 wait complete. 2024-09-19T05:39:28.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 -- start start 2024-09-19T05:39:28.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 Processor -- start 2024-09-19T05:39:28.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c983db0 0x56324ca43620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9cfd70 0x56324ca43b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc202990 con 0x56324c9d0690 2024-09-19T05:39:28.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56324c814780 con 0x56324c9cfd70 2024-09-19T05:39:28.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56324c7937c0 con 0x56324c983db0 2024-09-19T05:39:28.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 10 client.0 _ll_register_callbacks cb 0x7fe4cc00da60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:28.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9e37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46240/0 (socket says 172.21.15.67:46240) 2024-09-19T05:39:28.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4db7fe640 1 -- 172.21.15.67:0/941365181 learned_addr learned my addr 172.21.15.67:0/941365181 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4d3fff640 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9cfd70 0x56324ca43b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4daffd640 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c983db0 0x56324ca43620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4db7fe640 1 -- 172.21.15.67:0/941365181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c983db0 msgr2=0x56324ca43620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4db7fe640 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c983db0 0x56324ca43620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4db7fe640 1 -- 172.21.15.67:0/941365181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9cfd70 msgr2=0x56324ca43b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4db7fe640 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9cfd70 0x56324ca43b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4db7fe640 1 -- 172.21.15.67:0/941365181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324c768640 con 0x56324c9d0690 2024-09-19T05:39:28.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4db7fe640 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9e37e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x56324c77d550 tx=0x7fe4d4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50def6e578cc2864 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:39:28.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/941365181 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4016680 con 0x56324c9d0690 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/941365181 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7fe4d4016820 con 0x56324c9d0690 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 -- 172.21.15.67:0/941365181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4d401b070 con 0x56324c9d0690 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/941365181 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fe4d4006b60 con 0x56324c9d0690 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 10 client.7425 fetch_fsmap learned FSMap version 67 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 -- 172.21.15.67:0/941365181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x56324c76c3b0 con 0x56324c9d0690 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/941365181 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d401b070 con 0x56324c9d0690 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/941365181 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x7fe4d4016a20 con 0x56324c9d0690 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 10 client.7425 fetch_fsmap finished waiting for FSMap version 67 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 10 client.7425 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 20 client.7425 populate_metadata read hostname 'smithi067' 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x56324c9e3d20 0x56324c9e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 4 client.7425 mds_command: new command op to 7215 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:39:28.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4e48e5000 1 -- 172.21.15.67:0/941365181 --> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56324c7e2470 con 0x56324c9e3d20 2024-09-19T05:39:28.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4daffd640 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x56324c9e3d20 0x56324c9e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4ba7fc640 10 client.7425 ms_handle_connect on v2:172.21.15.67:6832/358275731 2024-09-19T05:39:28.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.592+0000 7fe4daffd640 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x56324c9e3d20 0x56324c9e4130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66daf03a4438d083 server_cookie=9ee89186f1b49491 in_seq=0 out_seq=0 2024-09-19T05:39:28.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.608+0000 7fe4ba7fc640 1 -- 172.21.15.67:0/941365181 <== mds.0 v2:172.21.15.67:6832/358275731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56324c7e2470 con 0x56324c9e3d20 2024-09-19T05:39:28.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.608+0000 7fe4ba7fc640 10 client.7425 handle_command_reply: tid=0 2024-09-19T05:39:28.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.608+0000 7fe4e48e5000 1 client.7425 shutdown 2024-09-19T05:39:28.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 1 -- 172.21.15.67:0/941365181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 msgr2=0x56324c9e37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9e37e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x56324c77d550 tx=0x7fe4d4001260 comp rx=0 tx=0).stop 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 1 -- 172.21.15.67:0/941365181 shutdown_connections 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56324c9d0690 0x56324c9e37e0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56324c9cfd70 0x56324ca43b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.67:6832/358275731,v1:172.21.15.67:6834/358275731] conn(0x56324c9e3d20 0x56324c9e4130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 1 --2- 172.21.15.67:0/941365181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56324c983db0 0x56324ca43620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4ba7fc640 0 client.7425 ms_handle_reset on v2:172.21.15.67:6832/358275731 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 1 -- 172.21.15.67:0/941365181 >> 172.21.15.67:0/941365181 conn(0x56324c9b1040 msgr2=0x56324c9cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 1 -- 172.21.15.67:0/941365181 shutdown_connections 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 1 -- 172.21.15.67:0/941365181 wait complete. 2024-09-19T05:39:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e48e5000 20 client.7425 trim_cache size 0 max 16384 2024-09-19T05:39:28.612 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:39:28.612 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:39:28.612 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:39:28.612 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:39:28.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 -- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4bc0678c0 msgr2=0x7fe4bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4bc0678c0 0x7fe4bc069d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc164e10 tx=0x7fe4cc008040 comp rx=0 tx=0).stop 2024-09-19T05:39:28.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 -- 172.21.15.67:0/2462016929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06fea0 msgr2=0x7fe4dc151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06fea0 0x7fe4dc151030 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4019130 tx=0x7fe4c40192c0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 -- 172.21.15.67:0/2462016929 shutdown_connections 2024-09-19T05:39:28.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4dc15b1d0 0x7fe4dc15b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4dc06fea0 0x7fe4dc151030 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4bc0678c0 0x7fe4bc069d80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 --2- 172.21.15.67:0/2462016929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4dc06dfc0 0x7fe4dc15a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 -- 172.21.15.67:0/2462016929 >> 172.21.15.67:0/2462016929 conn(0x7fe4dc0b1e50 msgr2=0x7fe4dc1656b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:28.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 -- 172.21.15.67:0/2462016929 shutdown_connections 2024-09-19T05:39:28.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.612+0000 7fe4e1829640 1 -- 172.21.15.67:0/2462016929 wait complete. 2024-09-19T05:39:28.628 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:39:28.628 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:28.629 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:39:28.629 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:28.629 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:39:28.629 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:28.629 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:39:28.629 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:28.640 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:39:28.640 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-19T05:39:28.641 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:39:28.641 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-19T05:39:28.643 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:39:28.643 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-19T05:39:28.643 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:39:28.644 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-19T05:39:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e7bd9640 1 Processor -- start 2024-09-19T05:39:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f894d255640 1 Processor -- start 2024-09-19T05:39:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe818dd0640 1 Processor -- start 2024-09-19T05:39:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe818dd0640 1 -- start start 2024-09-19T05:39:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f894d255640 1 -- start start 2024-09-19T05:39:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e7bd9640 1 -- start start 2024-09-19T05:39:28.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a6c06640 1 Processor -- start 2024-09-19T05:39:28.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a6c06640 1 -- start start 2024-09-19T05:39:28.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e7bd9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f90e0162630 0x7f90e0071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f894d255640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f894809ac90 0x7f89480c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e7bd9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e006ecc0 con 0x7f90e0162a10 2024-09-19T05:39:28.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e7bd9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e01671a0 con 0x7f90e00cc3c0 2024-09-19T05:39:28.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e7bd9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f90e00cfe80 con 0x7f90e0162630 2024-09-19T05:39:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f894d255640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8948162d60 con 0x7f89480718e0 2024-09-19T05:39:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f894d255640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89480c7b10 con 0x7f89480c7670 2024-09-19T05:39:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f894d255640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f89480c7df0 con 0x7f894809ac90 2024-09-19T05:39:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe818dd0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 0x7fe8140d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe818dd0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe8140b51d0 0x7fe8140cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e5174640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f90e0162a10 0x7f90e0166380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47304/0 (socket says 172.21.15.67:47304) 2024-09-19T05:39:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e5174640 1 -- 172.21.15.67:0/1472665739 learned_addr learned my addr 172.21.15.67:0/1472665739 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f894759e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f89480718e0 0x7f8948166430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47314/0 (socket says 172.21.15.67:47314) 2024-09-19T05:39:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f894759e640 1 -- 172.21.15.67:0/2541149555 learned_addr learned my addr 172.21.15.67:0/2541149555 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:28.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe818dd0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8140d4d40 con 0x7fe814161da0 2024-09-19T05:39:28.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe818dd0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe8140d0840 con 0x7fe8140b51d0 2024-09-19T05:39:28.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe818dd0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe8140d5020 con 0x7fe8140d1590 2024-09-19T05:39:28.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe812d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe8140b51d0 0x7fe8140cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8946d9d640 1 --2- 172.21.15.67:0/2541149555 >> v2:172.21.15.97:3300/0 conn(0x7f894809ac90 0x7f89480c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e5975640 1 --2- 172.21.15.67:0/1472665739 >> v2:172.21.15.97:3300/0 conn(0x7f90e0162630 0x7f90e0071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898506163 0 0) 0x7f90e006ecc0 con 0x7f90e0162a10 2024-09-19T05:39:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90cc003530 con 0x7f90e0162a10 2024-09-19T05:39:28.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe812d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe8140b51d0 0x7fe8140cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:58476/0 (socket says 172.21.15.67:58476) 2024-09-19T05:39:28.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe812d9d640 1 -- 172.21.15.67:0/4062604609 learned_addr learned my addr 172.21.15.67:0/4062604609 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe811d9b640 1 --2- 172.21.15.67:0/4062604609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 0x7fe8140d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3243996401 0 0) 0x7f8948162d60 con 0x7f89480718e0 2024-09-19T05:39:28.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8930003530 con 0x7f89480718e0 2024-09-19T05:39:28.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a6c06640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb0a015e640 0x7fb0a00b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a6c06640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0a00b6cf0 0x7fb0a006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 360321901 0 0) 0x7f90cc003530 con 0x7f90e0162a10 2024-09-19T05:39:28.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 >> v2:172.21.15.97:3300/0 conn(0x7f90e0162630 msgr2=0x7f90e0071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 --2- 172.21.15.67:0/1472665739 >> v2:172.21.15.97:3300/0 conn(0x7f90e0162630 0x7f90e0071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 >> v1:172.21.15.97:6789/0 conn(0x7f90e00cc3c0 legacy=0x7f90e0166a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a6c06640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a00b5b90 con 0x7fb0a00ae0a0 2024-09-19T05:39:28.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a6c06640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a00b4780 con 0x7fb0a00b6cf0 2024-09-19T05:39:28.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a51a3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0a00b6cf0 0x7fb0a006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a51a3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0a00b6cf0 0x7fb0a006bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46246/0 (socket says 172.21.15.67:46246) 2024-09-19T05:39:28.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a51a3640 1 -- 172.21.15.67:0/990711296 learned_addr learned my addr 172.21.15.67:0/990711296 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a6c06640 1 -- 172.21.15.67:0/990711296 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a00ae510 con 0x7fb0a015e640 2024-09-19T05:39:28.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e006ef50 con 0x7f90e0162a10 2024-09-19T05:39:28.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f90dc001680 con 0x7f90e0162a10 2024-09-19T05:39:28.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 >> v1:172.21.15.67:6789/0 conn(0x7f90e0162a10 legacy=0x7f90e0166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 --2- 172.21.15.67:0/1472665739 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90cc0039c0 0x7f90cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 --2- 172.21.15.67:0/1472665739 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90cc004810 0x7f90cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 --2- 172.21.15.67:0/1472665739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 0x7f90cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f90e00cfe80 con 0x7f90cc0051d0 2024-09-19T05:39:28.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc00c0d0 con 0x7f90cc004810 2024-09-19T05:39:28.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f90cc00c2d0 con 0x7f90cc0039c0 2024-09-19T05:39:28.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 595990044 0 0) 0x7f8930003530 con 0x7f89480718e0 2024-09-19T05:39:28.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 >> v2:172.21.15.97:3300/0 conn(0x7f894809ac90 msgr2=0x7f89480c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 --2- 172.21.15.67:0/2541149555 >> v2:172.21.15.97:3300/0 conn(0x7f894809ac90 0x7f89480c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 >> v1:172.21.15.97:6789/0 conn(0x7f89480c7670 legacy=0x7f894809b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89480c80d0 con 0x7f89480718e0 2024-09-19T05:39:28.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f8940001a00 con 0x7f89480718e0 2024-09-19T05:39:28.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e6176640 1 --2- 172.21.15.67:0/1472665739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 0x7f90cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 >> v1:172.21.15.67:6789/0 conn(0x7f89480718e0 legacy=0x7f8948166430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89300039c0 0x7f8930003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8930004810 0x7f8930004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89300051d0 0x7f893000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89480c7df0 con 0x7f89300039c0 2024-09-19T05:39:28.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f893000c070 con 0x7f89300051d0 2024-09-19T05:39:28.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f893000c270 con 0x7f8930004810 2024-09-19T05:39:28.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe811d9b640 1 -- 172.21.15.67:0/4062604609 >> v2:172.21.15.97:3300/0 conn(0x7fe8140b51d0 msgr2=0x7fe8140cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe811d9b640 1 --2- 172.21.15.67:0/4062604609 >> v2:172.21.15.97:3300/0 conn(0x7fe8140b51d0 0x7fe8140cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe811d9b640 1 -- 172.21.15.67:0/4062604609 >> v1:172.21.15.97:6789/0 conn(0x7fe814161da0 legacy=0x7fe8140d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e5975640 1 --2- 172.21.15.67:0/1472665739 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90cc0039c0 0x7f90cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fe811d9b640 1 -- 172.21.15.67:0/4062604609 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8140d5300 con 0x7fe8140d1590 2024-09-19T05:39:28.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f8946d9d640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89300039c0 0x7f8930003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e6176640 1 -- 172.21.15.67:0/1472665739 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90cc0039c0 msgr2=0x7f90cc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e6176640 1 --2- 172.21.15.67:0/1472665739 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90cc0039c0 0x7f90cc003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e6176640 1 -- 172.21.15.67:0/1472665739 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90cc004810 msgr2=0x7f90cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e6176640 1 --2- 172.21.15.67:0/1472665739 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90cc004810 0x7f90cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7f90e6176640 1 -- 172.21.15.67:0/1472665739 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e006ef50 con 0x7f90cc0051d0 2024-09-19T05:39:28.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a51a3640 1 -- 172.21.15.67:0/990711296 >> v2:172.21.15.97:3300/0 conn(0x7fb0a015e640 msgr2=0x7fb0a00b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a49a2640 1 --2- 172.21.15.67:0/990711296 >> v2:172.21.15.97:3300/0 conn(0x7fb0a015e640 0x7fb0a00b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f894759e640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89300051d0 0x7f893000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f894659c640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8930004810 0x7f8930004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f8946d9d640 1 -- 172.21.15.67:0/2541149555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8930004810 msgr2=0x7f8930004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f8946d9d640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8930004810 0x7f8930004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f8946d9d640 1 -- 172.21.15.67:0/2541149555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89300051d0 msgr2=0x7f893000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f8946d9d640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89300051d0 0x7f893000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f894759e640 1 -- 172.21.15.67:0/2541149555 reap_dead start 2024-09-19T05:39:28.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f8946d9d640 1 -- 172.21.15.67:0/2541149555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89480c80d0 con 0x7f89300039c0 2024-09-19T05:39:28.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e6176640 1 -- 172.21.15.67:0/1472665739 reap_dead start 2024-09-19T05:39:28.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e6176640 1 --2- 172.21.15.67:0/1472665739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 0x7f90cc00b9d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f90d8001e70 tx=0x7f90d801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d4d5cd46ee48d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8001a90 con 0x7f90cc0051d0 2024-09-19T05:39:28.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d8003bc0 con 0x7f90cc0051d0 2024-09-19T05:39:28.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e4973640 1 -- 172.21.15.67:0/1472665739 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8005020 con 0x7f90cc0051d0 2024-09-19T05:39:28.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e7bd9640 1 -- 172.21.15.67:0/1472665739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 msgr2=0x7f90cc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e7bd9640 1 --2- 172.21.15.67:0/1472665739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 0x7f90cc00b9d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f90d8001e70 tx=0x7f90d801c780 comp rx=0 tx=0).stop 2024-09-19T05:39:28.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a51a3640 1 --2- 172.21.15.67:0/990711296 >> v2:172.21.15.97:3300/0 conn(0x7fb0a015e640 0x7fb0a00b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a51a3640 1 -- 172.21.15.67:0/990711296 >> v1:172.21.15.97:6789/0 conn(0x7fb0a00ae0a0 legacy=0x7fb0a00b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:28.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a51a3640 1 -- 172.21.15.67:0/990711296 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a00b15f0 con 0x7fb0a00b6cf0 2024-09-19T05:39:28.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.800+0000 7fb0a49a2640 1 --2- 172.21.15.67:0/990711296 >> v2:172.21.15.97:3300/0 conn(0x7fb0a015e640 0x7fb0a00b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:28.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e7bd9640 1 -- 172.21.15.67:0/1472665739 shutdown_connections 2024-09-19T05:39:28.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e7bd9640 1 --2- 172.21.15.67:0/1472665739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 0x7f90cc00b9d0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e7bd9640 1 -- 172.21.15.67:0/1472665739 >> 172.21.15.67:0/1472665739 conn(0x7f90e00d0080 msgr2=0x7f90e00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:28.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fb0a51a3640 1 --2- 172.21.15.67:0/990711296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a00b6cf0 0x7fb0a006bcc0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00689b0 tx=0x7fb09801c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e0cb8963248b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e7bd9640 1 -- 172.21.15.67:0/1472665739 shutdown_connections 2024-09-19T05:39:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f90e7bd9640 1 -- 172.21.15.67:0/1472665739 wait complete. 2024-09-19T05:39:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fb09f7fe640 1 -- 172.21.15.67:0/990711296 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0980ac020 con 0x7fb0a00b6cf0 2024-09-19T05:39:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fb09f7fe640 1 -- 172.21.15.67:0/990711296 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0980a6460 con 0x7fb0a00b6cf0 2024-09-19T05:39:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe811d9b640 1 --2- 172.21.15.67:0/4062604609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 0x7fe8140d1af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097c0 tx=0x7fe80801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3455140aaa13967 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe81159a640 1 -- 172.21.15.67:0/4062604609 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8080b0070 con 0x7fe8140d1590 2024-09-19T05:39:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe81159a640 1 -- 172.21.15.67:0/4062604609 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8080ab600 con 0x7fe8140d1590 2024-09-19T05:39:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe81159a640 1 -- 172.21.15.67:0/4062604609 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8080ab9d0 con 0x7fe8140d1590 2024-09-19T05:39:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe818dd0640 1 -- 172.21.15.67:0/4062604609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 msgr2=0x7fe8140d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe818dd0640 1 --2- 172.21.15.67:0/4062604609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 0x7fe8140d1af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097c0 tx=0x7fe80801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe818dd0640 1 -- 172.21.15.67:0/4062604609 shutdown_connections 2024-09-19T05:39:28.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fb09f7fe640 1 -- 172.21.15.67:0/990711296 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0980a6830 con 0x7fb0a00b6cf0 2024-09-19T05:39:28.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe818dd0640 1 --2- 172.21.15.67:0/4062604609 >> v2:172.21.15.97:3300/0 conn(0x7fe8140b51d0 0x7fe8140cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe818dd0640 1 --2- 172.21.15.67:0/4062604609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 0x7fe8140d1af0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe818dd0640 1 -- 172.21.15.67:0/4062604609 >> 172.21.15.67:0/4062604609 conn(0x7fe81408bfc0 msgr2=0x7fe8140d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:28.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f8946d9d640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89300039c0 0x7f8930003de0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f8938009ae0 tx=0x7f893801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28d7e482488b0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe818dd0640 1 -- 172.21.15.67:0/4062604609 shutdown_connections 2024-09-19T05:39:28.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7fe818dd0640 1 -- 172.21.15.67:0/4062604609 wait complete. 2024-09-19T05:39:28.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89380096b0 con 0x7f89300039c0 2024-09-19T05:39:28.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89380a6500 con 0x7f89300039c0 2024-09-19T05:39:28.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.804+0000 7f8945d9b640 1 -- 172.21.15.67:0/2541149555 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89380a68f0 con 0x7f89300039c0 2024-09-19T05:39:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fb0a6c06640 1 -- 172.21.15.67:0/990711296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a00b6cf0 msgr2=0x7fb0a006bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fb0a6c06640 1 --2- 172.21.15.67:0/990711296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a00b6cf0 0x7fb0a006bcc0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00689b0 tx=0x7fb09801c680 comp rx=0 tx=0).stop 2024-09-19T05:39:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fb0a6c06640 1 -- 172.21.15.67:0/990711296 shutdown_connections 2024-09-19T05:39:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fb0a6c06640 1 --2- 172.21.15.67:0/990711296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a00b6cf0 0x7fb0a006bcc0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fb0a6c06640 1 --2- 172.21.15.67:0/990711296 >> v2:172.21.15.97:3300/0 conn(0x7fb0a015e640 0x7fb0a00b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fb0a6c06640 1 -- 172.21.15.67:0/990711296 >> 172.21.15.67:0/990711296 conn(0x7fb0a009aa30 msgr2=0x7fb0a00b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fb0a6c06640 1 -- 172.21.15.67:0/990711296 shutdown_connections 2024-09-19T05:39:28.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fb0a6c06640 1 -- 172.21.15.67:0/990711296 wait complete. 2024-09-19T05:39:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 -- 172.21.15.67:0/2541149555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89300039c0 msgr2=0x7f8930003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89300039c0 0x7f8930003de0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f8938009ae0 tx=0x7f893801ca40 comp rx=0 tx=0).stop 2024-09-19T05:39:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 -- 172.21.15.67:0/2541149555 shutdown_connections 2024-09-19T05:39:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 --2- 172.21.15.67:0/2541149555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89300039c0 0x7f8930003de0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 -- 172.21.15.67:0/2541149555 >> 172.21.15.67:0/2541149555 conn(0x7f89480d22b0 msgr2=0x7f89480d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 -- 172.21.15.67:0/2541149555 shutdown_connections 2024-09-19T05:39:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 -- 172.21.15.67:0/2541149555 wait complete. 2024-09-19T05:39:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e7bd9640 1 Processor -- start 2024-09-19T05:39:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e7bd9640 1 -- start start 2024-09-19T05:39:28.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe818dd0640 1 Processor -- start 2024-09-19T05:39:28.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe818dd0640 1 -- start start 2024-09-19T05:39:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e7bd9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 0x7f90e0159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e7bd9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90e0158730 0x7f90e0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e7bd9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90e015a770 0x7f90e0164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e7bd9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f90e006f7f0 con 0x7f90cc0051d0 2024-09-19T05:39:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e7bd9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f90e006f510 con 0x7f90e015a770 2024-09-19T05:39:28.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e7bd9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f90e00b3070 con 0x7f90e0158730 2024-09-19T05:39:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe818dd0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8140b51d0 0x7fe8140b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe818dd0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 0x7fe814154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe818dd0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe814161da0 0x7fe8140b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fb0a6c06640 1 Processor -- start 2024-09-19T05:39:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe818dd0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe8140d0020 con 0x7fe8140b51d0 2024-09-19T05:39:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe818dd0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe8140cfea0 con 0x7fe814161da0 2024-09-19T05:39:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe818dd0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe8140d01a0 con 0x7fe8140d1590 2024-09-19T05:39:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e5174640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90e0158730 0x7f90e0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fb0a6c06640 1 -- start start 2024-09-19T05:39:28.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e6176640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90e015a770 0x7f90e0164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e5975640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 0x7f90e0159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e5174640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90e0158730 0x7f90e0157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:52740/0 (socket says 172.21.15.67:52740) 2024-09-19T05:39:28.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e5174640 1 -- 172.21.15.67:0/3059423534 learned_addr learned my addr 172.21.15.67:0/3059423534 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe81259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8140b51d0 0x7fe8140b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 Processor -- start 2024-09-19T05:39:28.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe81259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8140b51d0 0x7fe8140b99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46278/0 (socket says 172.21.15.67:46278) 2024-09-19T05:39:28.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe81259c640 1 -- 172.21.15.67:0/526637587 learned_addr learned my addr 172.21.15.67:0/526637587 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe811d9b640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 0x7fe814154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 -- start start 2024-09-19T05:39:28.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e5975640 1 -- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90e0158730 msgr2=0x7f90e0157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e5975640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90e0158730 0x7f90e0157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e5975640 1 -- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90e015a770 msgr2=0x7f90e0164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e5975640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90e015a770 0x7f90e0164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e5975640 1 -- 172.21.15.67:0/3059423534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e015b050 con 0x7f90cc0051d0 2024-09-19T05:39:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe81259c640 1 -- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 msgr2=0x7fe814154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe81259c640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 0x7fe814154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe81259c640 1 -- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe814161da0 msgr2=0x7fe8140b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe81259c640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe814161da0 0x7fe8140b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe81259c640 1 -- 172.21.15.67:0/526637587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8140ba0b0 con 0x7fe8140b51d0 2024-09-19T05:39:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe81259c640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8140b51d0 0x7fe8140b99f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c3f0 tx=0x7fe80400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e5975640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 0x7f90e0159c60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f90d4010890 tx=0x7f90d4010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe802ffd640 1 -- 172.21.15.67:0/526637587 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804017070 con 0x7fe8140b51d0 2024-09-19T05:39:28.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90d27fc640 1 -- 172.21.15.67:0/3059423534 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d400f040 con 0x7f90cc0051d0 2024-09-19T05:39:28.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe802ffd640 1 -- 172.21.15.67:0/526637587 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8040052d0 con 0x7fe8140b51d0 2024-09-19T05:39:28.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe802ffd640 1 -- 172.21.15.67:0/526637587 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804003840 con 0x7fe8140b51d0 2024-09-19T05:39:28.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90d27fc640 1 -- 172.21.15.67:0/3059423534 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d400eb60 con 0x7f90cc0051d0 2024-09-19T05:39:28.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90d27fc640 1 -- 172.21.15.67:0/3059423534 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d401c400 con 0x7f90cc0051d0 2024-09-19T05:39:28.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e7bd9640 1 -- 172.21.15.67:0/3059423534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e015b330 con 0x7f90cc0051d0 2024-09-19T05:39:28.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f90e7bd9640 1 -- 172.21.15.67:0/3059423534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e0159460 con 0x7f90cc0051d0 2024-09-19T05:39:28.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe818dd0640 1 -- 172.21.15.67:0/526637587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8141539b0 con 0x7fe8140b51d0 2024-09-19T05:39:28.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7fe818dd0640 1 -- 172.21.15.67:0/526637587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe814153f70 con 0x7fe8140b51d0 2024-09-19T05:39:28.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89300039c0 0x7f89481ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f894812c700 0x7f89480cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89480cd830 0x7f894815d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f894806d720 con 0x7f89480cd830 2024-09-19T05:39:28.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f894806d5a0 con 0x7f89300039c0 2024-09-19T05:39:28.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.808+0000 7f894d255640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f894806d8a0 con 0x7f894812c700 2024-09-19T05:39:28.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89480cd830 0x7f894815d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f8946d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89300039c0 0x7f89481ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89480cd830 0x7f894815d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46280/0 (socket says 172.21.15.67:46280) 2024-09-19T05:39:28.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894759e640 1 -- 172.21.15.67:0/1445397808 learned_addr learned my addr 172.21.15.67:0/1445397808 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894659c640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f894812c700 0x7f89480cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894759e640 1 -- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f894812c700 msgr2=0x7f89480cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894759e640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f894812c700 0x7f89480cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894759e640 1 -- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89300039c0 msgr2=0x7f89481ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894759e640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89300039c0 0x7f89481ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894759e640 1 -- 172.21.15.67:0/1445397808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8948167fb0 con 0x7f89480cd830 2024-09-19T05:39:28.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f90c3fff640 1 -- 172.21.15.67:0/3059423534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90bc0052a0 con 0x7f90cc0051d0 2024-09-19T05:39:28.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a6c06640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0a00ae0a0 0x7fb0a013aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a6c06640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0a00b6cf0 0x7fb0a01519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a6c06640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a015e640 0x7fb0a0151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894759e640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89480cd830 0x7f894815d4a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f894809bd70 tx=0x7f894000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a51a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a015e640 0x7fb0a0151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fe818dd0640 1 -- 172.21.15.67:0/526637587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe814154170 con 0x7fe8140b51d0 2024-09-19T05:39:28.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a6c06640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a00b2b40 con 0x7fb0a015e640 2024-09-19T05:39:28.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a6c06640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a00b7120 con 0x7fb0a00b6cf0 2024-09-19T05:39:28.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a6c06640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a00b0790 con 0x7fb0a00ae0a0 2024-09-19T05:39:28.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a51a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a015e640 0x7fb0a0151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46288/0 (socket says 172.21.15.67:46288) 2024-09-19T05:39:28.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a51a3640 1 -- 172.21.15.67:0/3135939692 learned_addr learned my addr 172.21.15.67:0/3135939692 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:28.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a49a2640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0a00ae0a0 0x7fb0a013aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb09ffff640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0a00b6cf0 0x7fb0a01519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f892f7fe640 1 -- 172.21.15.67:0/1445397808 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894000eb90 con 0x7f89480cd830 2024-09-19T05:39:28.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f892f7fe640 1 -- 172.21.15.67:0/1445397808 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894000ed30 con 0x7f89480cd830 2024-09-19T05:39:28.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894d255640 1 -- 172.21.15.67:0/1445397808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89480cdfb0 con 0x7f89480cd830 2024-09-19T05:39:28.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a51a3640 1 -- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0a00ae0a0 msgr2=0x7fb0a013aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a51a3640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0a00ae0a0 0x7fb0a013aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a51a3640 1 -- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0a00b6cf0 msgr2=0x7fb0a01519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:28.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a51a3640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0a00b6cf0 0x7fb0a01519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:28.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a51a3640 1 -- 172.21.15.67:0/3135939692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a01542b0 con 0x7fb0a015e640 2024-09-19T05:39:28.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb09ffff640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0a00b6cf0 0x7fb0a01519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:28.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fe802ffd640 1 -- 172.21.15.67:0/526637587 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe80401a070 con 0x7fe8140b51d0 2024-09-19T05:39:28.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f892f7fe640 1 -- 172.21.15.67:0/1445397808 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940014670 con 0x7f89480cd830 2024-09-19T05:39:28.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894d255640 1 -- 172.21.15.67:0/1445397808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89480cdcd0 con 0x7f89480cd830 2024-09-19T05:39:28.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fe802ffd640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7f40678c0 0x7fe7f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f90d27fc640 1 -- 172.21.15.67:0/3059423534 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f90d401c5a0 con 0x7f90cc0051d0 2024-09-19T05:39:28.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fe802ffd640 1 -- 172.21.15.67:0/526637587 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7fe8040850b0 con 0x7fe8140b51d0 2024-09-19T05:39:28.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f894d255640 1 -- 172.21.15.67:0/1445397808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f894806dbd0 con 0x7f89480cd830 2024-09-19T05:39:28.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fb0a51a3640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a015e640 0x7fb0a0151ee0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fb09801ad30 tx=0x7fb098019420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fe811d9b640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7f40678c0 0x7fe7f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f90d27fc640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90c40678c0 0x7f90c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f90e5174640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90c40678c0 0x7f90c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7fe811d9b640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7f40678c0 0x7fe7f4069d80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe8080ad000 tx=0x7fe808008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.812+0000 7f90e5174640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90c40678c0 0x7f90c4069d80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f90e0158b70 tx=0x7f90dc00c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.816+0000 7fe802ffd640 1 -- 172.21.15.67:0/526637587 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe814154170 con 0x7fe8140b51d0 2024-09-19T05:39:28.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.816+0000 7f90d27fc640 1 -- 172.21.15.67:0/3059423534 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f90d408a060 con 0x7f90cc0051d0 2024-09-19T05:39:28.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.816+0000 7fb09d7fa640 1 -- 172.21.15.67:0/3135939692 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0980ac040 con 0x7fb0a015e640 2024-09-19T05:39:28.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.816+0000 7fb09d7fa640 1 -- 172.21.15.67:0/3135939692 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0980a7640 con 0x7fb0a015e640 2024-09-19T05:39:28.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.816+0000 7fb0a6c06640 1 -- 172.21.15.67:0/3135939692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a0154550 con 0x7fb0a015e640 2024-09-19T05:39:28.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.816+0000 7fb09d7fa640 1 -- 172.21.15.67:0/3135939692 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0980a7a30 con 0x7fb0a015e640 2024-09-19T05:39:28.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.816+0000 7fb0a6c06640 1 -- 172.21.15.67:0/3135939692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a0154b10 con 0x7fb0a015e640 2024-09-19T05:39:28.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.820+0000 7fb08affd640 1 -- 172.21.15.67:0/3135939692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0780052a0 con 0x7fb0a015e640 2024-09-19T05:39:28.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.820+0000 7f892f7fe640 1 -- 172.21.15.67:0/1445397808 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8940014810 con 0x7f89480cd830 2024-09-19T05:39:28.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.820+0000 7f892f7fe640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89340678c0 0x7f8934069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.820+0000 7f892f7fe640 1 -- 172.21.15.67:0/1445397808 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f8940086450 con 0x7f89480cd830 2024-09-19T05:39:28.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.820+0000 7f8946d9d640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89340678c0 0x7f8934069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.820+0000 7f8946d9d640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89340678c0 0x7f8934069d80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f89380af000 tx=0x7f89380046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.824+0000 7f90d27fc640 1 -- 172.21.15.67:0/3059423534 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f90d4018030 con 0x7f90cc0051d0 2024-09-19T05:39:28.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.828+0000 7f892f7fe640 1 -- 172.21.15.67:0/1445397808 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8940056820 con 0x7f89480cd830 2024-09-19T05:39:28.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.828+0000 7fb09d7fa640 1 -- 172.21.15.67:0/3135939692 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0980af020 con 0x7fb0a015e640 2024-09-19T05:39:28.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.828+0000 7fb09d7fa640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0840678f0 0x7fb084069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:28.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.828+0000 7fb09d7fa640 1 -- 172.21.15.67:0/3135939692 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7fb09811ffe0 con 0x7fb0a015e640 2024-09-19T05:39:28.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.828+0000 7fb0a49a2640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0840678f0 0x7fb084069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:28.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.832+0000 7fb0a49a2640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0840678f0 0x7fb084069db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00d1d70 tx=0x7fb094008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:28.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:28.832+0000 7fb09d7fa640 1 -- 172.21.15.67:0/3135939692 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb0a00b5b90 con 0x7fb0a015e640 2024-09-19T05:39:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.036+0000 7fe818dd0640 1 -- 172.21.15.67:0/526637587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fe8140d1aa0 con 0x7fe8140b51d0 2024-09-19T05:39:29.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.052+0000 7fb08affd640 1 -- 172.21.15.67:0/3135939692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7fb078005860 con 0x7fb0a015e640 2024-09-19T05:39:29.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.160+0000 7f90c3fff640 1 -- 172.21.15.67:0/3059423534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f90bc005860 con 0x7f90cc0051d0 2024-09-19T05:39:29.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.168+0000 7f894d255640 1 -- 172.21.15.67:0/1445397808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f89480b7620 con 0x7f89480cd830 2024-09-19T05:39:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe802ffd640 1 -- 172.21.15.67:0/526637587 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5690 v68) ==== 95+0+0 (secure 0 0 0) 0x7fe804005480 con 0x7fe8140b51d0 2024-09-19T05:39:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 5690 2024-09-19T05:39:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 -- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7f40678c0 msgr2=0x7fe7f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7f40678c0 0x7fe7f4069d80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe8080ad000 tx=0x7fe808008040 comp rx=0 tx=0).stop 2024-09-19T05:39:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 -- 172.21.15.67:0/526637587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8140b51d0 msgr2=0x7fe8140b99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8140b51d0 0x7fe8140b99f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c3f0 tx=0x7fe80400c8b0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 -- 172.21.15.67:0/526637587 shutdown_connections 2024-09-19T05:39:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe814161da0 0x7fe8140b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7f40678c0 0x7fe7f4069d80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8140d1590 0x7fe814154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 --2- 172.21.15.67:0/526637587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8140b51d0 0x7fe8140b99f0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 -- 172.21.15.67:0/526637587 >> 172.21.15.67:0/526637587 conn(0x7fe81408bfc0 msgr2=0x7fe8140d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 -- 172.21.15.67:0/526637587 shutdown_connections 2024-09-19T05:39:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.364+0000 7fe818dd0640 1 -- 172.21.15.67:0/526637587 wait complete. 2024-09-19T05:39:29.366 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:39:29.368+0000 7fcbecc55640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:39:29.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.368+0000 7fb09d7fa640 1 -- 172.21.15.67:0/3135939692 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7215 v69) ==== 95+0+0 (secure 0 0 0) 0x7fb0980a6e20 con 0x7fb0a015e640 2024-09-19T05:39:29.369 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 7215 2024-09-19T05:39:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 -- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0840678f0 msgr2=0x7fb084069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0840678f0 0x7fb084069db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00d1d70 tx=0x7fb094008040 comp rx=0 tx=0).stop 2024-09-19T05:39:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 -- 172.21.15.67:0/3135939692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a015e640 msgr2=0x7fb0a0151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a015e640 0x7fb0a0151ee0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fb09801ad30 tx=0x7fb098019420 comp rx=0 tx=0).stop 2024-09-19T05:39:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 -- 172.21.15.67:0/3135939692 shutdown_connections 2024-09-19T05:39:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a015e640 0x7fb0a0151ee0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0a00b6cf0 0x7fb0a01519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0840678f0 0x7fb084069db0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 --2- 172.21.15.67:0/3135939692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0a00ae0a0 0x7fb0a013aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 -- 172.21.15.67:0/3135939692 >> 172.21.15.67:0/3135939692 conn(0x7fb0a009aa30 msgr2=0x7fb0a006fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 -- 172.21.15.67:0/3135939692 shutdown_connections 2024-09-19T05:39:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.372+0000 7fb08affd640 1 -- 172.21.15.67:0/3135939692 wait complete. 2024-09-19T05:39:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.380+0000 7f90d27fc640 1 -- 172.21.15.67:0/3059423534 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7212 v70) ==== 95+0+0 (secure 0 0 0) 0x7f90d4055a20 con 0x7f90cc0051d0 2024-09-19T05:39:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 7212 2024-09-19T05:39:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 -- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90c40678c0 msgr2=0x7f90c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90c40678c0 0x7f90c4069d80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f90e0158b70 tx=0x7f90dc00c040 comp rx=0 tx=0).stop 2024-09-19T05:39:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 -- 172.21.15.67:0/3059423534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 msgr2=0x7f90e0159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 0x7f90e0159c60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f90d4010890 tx=0x7f90d4010d50 comp rx=0 tx=0).stop 2024-09-19T05:39:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 -- 172.21.15.67:0/3059423534 shutdown_connections 2024-09-19T05:39:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90e015a770 0x7f90e0164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90c40678c0 0x7f90c4069d80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90e0158730 0x7f90e0157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 --2- 172.21.15.67:0/3059423534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90cc0051d0 0x7f90e0159c60 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 -- 172.21.15.67:0/3059423534 >> 172.21.15.67:0/3059423534 conn(0x7f90e00d0080 msgr2=0x7f90e00ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 -- 172.21.15.67:0/3059423534 shutdown_connections 2024-09-19T05:39:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:29.384+0000 7f90c3fff640 1 -- 172.21.15.67:0/3059423534 wait complete. 2024-09-19T05:39:29.393 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:39:29.393 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:39:29.396 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:39:29.396 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:29.399 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:39:29.399 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:39:29.406 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:39:29.406 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:39:29.452 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:39:29.452 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:29.453 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:39:29.453 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:29.471 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:39:29.512 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:39:29.514 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:39:30.362 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:39:30.364+0000 7fcbecc55640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:39:30.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.368+0000 7f892f7fe640 1 -- 172.21.15.67:0/1445397808 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6202 v71) ==== 95+0+0 (secure 0 0 0) 0x7f894005ab20 con 0x7f89480cd830 2024-09-19T05:39:30.366 INFO:teuthology.orchestra.run.smithi067.stderr:failed mds gid 6202 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 -- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89340678c0 msgr2=0x7f8934069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89340678c0 0x7f8934069d80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f89380af000 tx=0x7f89380046d0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 -- 172.21.15.67:0/1445397808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89480cd830 msgr2=0x7f894815d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89480cd830 0x7f894815d4a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f894809bd70 tx=0x7f894000e530 comp rx=0 tx=0).stop 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 -- 172.21.15.67:0/1445397808 shutdown_connections 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89480cd830 0x7f894815d4a0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89340678c0 0x7f8934069d80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f894812c700 0x7f89480cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 --2- 172.21.15.67:0/1445397808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89300039c0 0x7f89481ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 -- 172.21.15.67:0/1445397808 >> 172.21.15.67:0/1445397808 conn(0x7f89480d22b0 msgr2=0x7f89480b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 -- 172.21.15.67:0/1445397808 shutdown_connections 2024-09-19T05:39:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.372+0000 7f894d255640 1 -- 172.21.15.67:0/1445397808 wait complete. 2024-09-19T05:39:30.397 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:39:30.398 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:39:30.400 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:39:30.400 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:30.401 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:30.468 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:39:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.568+0000 7f582ba8d640 1 Processor -- start 2024-09-19T05:39:30.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f582ba8d640 1 -- start start 2024-09-19T05:39:30.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f582ba8d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5824159d60 0x7f582406ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:30.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f582ba8d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f582406f460 0x7f58240b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:30.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f582ba8d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f582406de80 con 0x7f58240b3510 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f582ba8d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f58240b3920 con 0x7f5824159d60 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f582ba8d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f582406e160 con 0x7f582406f460 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f5829829640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5824159d60 0x7f582406ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f582a02a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f58240b3510 0x7f58240acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47320/0 (socket says 172.21.15.67:47320) 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f582a02a640 1 -- 172.21.15.67:0/817907204 learned_addr learned my addr 172.21.15.67:0/817907204 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f5829028640 1 --2- 172.21.15.67:0/817907204 >> v2:172.21.15.97:3300/0 conn(0x7f582406f460 0x7f58240b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f5829829640 1 -- 172.21.15.67:0/817907204 >> v2:172.21.15.97:3300/0 conn(0x7f582406f460 msgr2=0x7f58240b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f5829829640 1 --2- 172.21.15.67:0/817907204 >> v2:172.21.15.97:3300/0 conn(0x7f582406f460 0x7f58240b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f5829829640 1 -- 172.21.15.67:0/817907204 >> v1:172.21.15.67:6789/0 conn(0x7f58240b3510 legacy=0x7f58240acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f5828827640 1 -- 172.21.15.67:0/817907204 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2399959625 0 0) 0x7f582406de80 con 0x7f58240b3510 2024-09-19T05:39:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f5829829640 1 -- 172.21.15.67:0/817907204 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582406e440 con 0x7f5824159d60 2024-09-19T05:39:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f5829028640 1 --2- 172.21.15.67:0/817907204 >> v2:172.21.15.97:3300/0 conn(0x7f582406f460 0x7f58240b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.572+0000 7f5829829640 1 --2- 172.21.15.67:0/817907204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 0x7f582406ef20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5824071e10 tx=0x7f582001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ccbd3768027ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f5828827640 1 -- 172.21.15.67:0/817907204 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200ab650 con 0x7f5824159d60 2024-09-19T05:39:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f5828827640 1 -- 172.21.15.67:0/817907204 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58200b0070 con 0x7f5824159d60 2024-09-19T05:39:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f5828827640 1 -- 172.21.15.67:0/817907204 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200aba10 con 0x7f5824159d60 2024-09-19T05:39:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 -- 172.21.15.67:0/817907204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 msgr2=0x7f582406ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 --2- 172.21.15.67:0/817907204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 0x7f582406ef20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5824071e10 tx=0x7f582001c450 comp rx=0 tx=0).stop 2024-09-19T05:39:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 -- 172.21.15.67:0/817907204 shutdown_connections 2024-09-19T05:39:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 --2- 172.21.15.67:0/817907204 >> v2:172.21.15.97:3300/0 conn(0x7f582406f460 0x7f58240b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 --2- 172.21.15.67:0/817907204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 0x7f582406ef20 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 -- 172.21.15.67:0/817907204 >> 172.21.15.67:0/817907204 conn(0x7f58240d0080 msgr2=0x7f58240d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 -- 172.21.15.67:0/817907204 shutdown_connections 2024-09-19T05:39:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 -- 172.21.15.67:0/817907204 wait complete. 2024-09-19T05:39:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 Processor -- start 2024-09-19T05:39:30.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 -- start start 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f582406f460 0x7f582414cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58240b3510 0x7f582409d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 0x7f582409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f58240ad840 con 0x7f5824159d60 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f58240ad6c0 con 0x7f582406f460 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582ba8d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f58240af6b0 con 0x7f58240b3510 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582a02a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 0x7f582409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582a02a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 0x7f582409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46324/0 (socket says 172.21.15.67:46324) 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582a02a640 1 -- 172.21.15.67:0/4016711059 learned_addr learned my addr 172.21.15.67:0/4016711059 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f5829829640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f582406f460 0x7f582414cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582a02a640 1 -- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58240b3510 msgr2=0x7f582409d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f5829028640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58240b3510 0x7f582409d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582a02a640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58240b3510 0x7f582409d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582a02a640 1 -- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f582406f460 msgr2=0x7f582414cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582a02a640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f582406f460 0x7f582414cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582a02a640 1 -- 172.21.15.67:0/4016711059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582409a630 con 0x7f5824159d60 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f5829829640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f582406f460 0x7f582414cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f582a02a640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 0x7f582409dac0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f581c00c7a0 tx=0x7f581c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f581a7fc640 1 -- 172.21.15.67:0/4016711059 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c018070 con 0x7f5824159d60 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f581a7fc640 1 -- 172.21.15.67:0/4016711059 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581c00a640 con 0x7f5824159d60 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.576+0000 7f581a7fc640 1 -- 172.21.15.67:0/4016711059 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c00aab0 con 0x7f5824159d60 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.580+0000 7f582ba8d640 1 -- 172.21.15.67:0/4016711059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5824072a30 con 0x7f5824159d60 2024-09-19T05:39:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.580+0000 7f582ba8d640 1 -- 172.21.15.67:0/4016711059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5824072ff0 con 0x7f5824159d60 2024-09-19T05:39:30.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.580+0000 7f582ba8d640 1 -- 172.21.15.67:0/4016711059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58240b2fd0 con 0x7f5824159d60 2024-09-19T05:39:30.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.580+0000 7f581a7fc640 1 -- 172.21.15.67:0/4016711059 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f581c00ac50 con 0x7f5824159d60 2024-09-19T05:39:30.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.580+0000 7f581a7fc640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58080678c0 0x7f5808069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:30.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.580+0000 7f581a7fc640 1 -- 172.21.15.67:0/4016711059 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7f581c085590 con 0x7f5824159d60 2024-09-19T05:39:30.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.580+0000 7f5829829640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58080678c0 0x7f5808069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:30.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.580+0000 7f5829829640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58080678c0 0x7f5808069d80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f58200af000 tx=0x7f5820008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:30.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.584+0000 7f581a7fc640 1 -- 172.21.15.67:0/4016711059 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f581c055e90 con 0x7f5824159d60 2024-09-19T05:39:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.780+0000 7f582ba8d640 1 -- 172.21.15.67:0/4016711059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58240d0f20 con 0x7f5824159d60 2024-09-19T05:39:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f581a7fc640 1 -- 172.21.15.67:0/4016711059 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+4395 (secure 0 0 0) 0x7f581c055790 con 0x7f5824159d60 2024-09-19T05:39:30.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:30.782 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":72,"btime":"2024-09-19T05:39:30:373177+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:30.373130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"a","rank":0,"incarnation":72,"state":"up:replay","state_seq":1,"addr":"172.21.15.67:6835/1158789793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1158789793},{"type":"v1","addr":"172.21.15.67:6835","nonce":1158789793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-19T05:39:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 72 2024-09-19T05:39:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 -- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58080678c0 msgr2=0x7f5808069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58080678c0 0x7f5808069d80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f58200af000 tx=0x7f5820008040 comp rx=0 tx=0).stop 2024-09-19T05:39:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 -- 172.21.15.67:0/4016711059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 msgr2=0x7f582409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 0x7f582409dac0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f581c00c7a0 tx=0x7f581c00cc60 comp rx=0 tx=0).stop 2024-09-19T05:39:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 -- 172.21.15.67:0/4016711059 shutdown_connections 2024-09-19T05:39:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5824159d60 0x7f582409dac0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58080678c0 0x7f5808069d80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58240b3510 0x7f582409d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 --2- 172.21.15.67:0/4016711059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f582406f460 0x7f582414cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 -- 172.21.15.67:0/4016711059 >> 172.21.15.67:0/4016711059 conn(0x7f58240d0080 msgr2=0x7f582415a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 -- 172.21.15.67:0/4016711059 shutdown_connections 2024-09-19T05:39:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:30.784+0000 7f582ba8d640 1 -- 172.21.15.67:0/4016711059 wait complete. 2024-09-19T05:39:31.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:39:06.828432+0000', 'modified': '2024-09-19T05:39:30.373130+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7464': {'gid': 7464, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.67:6835/1158789793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 1158789793}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 1158789793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-19T05:39:31.203 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7464:up:replay 2024-09-19T05:39:32.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff52c3a6640 1 Processor -- start 2024-09-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff52c3a6640 1 -- start start 2024-09-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff52c3a6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff52415c030 0x7ff52406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff52c3a6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff52415d1d0 0x7ff5240b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff52c3a6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52406e3c0 con 0x7ff5240b3510 2024-09-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff52c3a6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff52406e6a0 con 0x7ff52415d1d0 2024-09-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff52c3a6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff52406e980 con 0x7ff52415c030 2024-09-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff529941640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff52415d1d0 0x7ff5240b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff529941640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff52415d1d0 0x7ff5240b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46336/0 (socket says 172.21.15.67:46336) 2024-09-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff529941640 1 -- 172.21.15.67:0/513433994 learned_addr learned my addr 172.21.15.67:0/513433994 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff52a142640 1 --2- 172.21.15.67:0/513433994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff52415c030 0x7ff52406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff529941640 1 -- 172.21.15.67:0/513433994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff52415c030 msgr2=0x7ff52406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff529941640 1 --2- 172.21.15.67:0/513433994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff52415c030 0x7ff52406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff529941640 1 -- 172.21.15.67:0/513433994 >> v1:172.21.15.97:6789/0 conn(0x7ff5240b3510 legacy=0x7ff52406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.340+0000 7ff529941640 1 -- 172.21.15.67:0/513433994 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52406ec60 con 0x7ff52415d1d0 2024-09-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff529941640 1 --2- 172.21.15.67:0/513433994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 0x7ff5240b2fd0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff514009870 tx=0x7ff51401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0769f8a15f06dad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff529140640 1 -- 172.21.15.67:0/513433994 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5140aa430 con 0x7ff52415d1d0 2024-09-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff529140640 1 -- 172.21.15.67:0/513433994 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5140af070 con 0x7ff52415d1d0 2024-09-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff529140640 1 -- 172.21.15.67:0/513433994 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5140aa7f0 con 0x7ff52415d1d0 2024-09-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff52c3a6640 1 -- 172.21.15.67:0/513433994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 msgr2=0x7ff5240b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff52c3a6640 1 --2- 172.21.15.67:0/513433994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 0x7ff5240b2fd0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff514009870 tx=0x7ff51401c4f0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff52c3a6640 1 -- 172.21.15.67:0/513433994 shutdown_connections 2024-09-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff52c3a6640 1 --2- 172.21.15.67:0/513433994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 0x7ff5240b2fd0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff52c3a6640 1 --2- 172.21.15.67:0/513433994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff52415c030 0x7ff52406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff52c3a6640 1 -- 172.21.15.67:0/513433994 >> 172.21.15.67:0/513433994 conn(0x7ff5240d0080 msgr2=0x7ff5240d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff52c3a6640 1 -- 172.21.15.67:0/513433994 shutdown_connections 2024-09-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff52c3a6640 1 -- 172.21.15.67:0/513433994 wait complete. 2024-09-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff52c3a6640 1 Processor -- start 2024-09-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.344+0000 7ff52c3a6640 1 -- start start 2024-09-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52c3a6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5240b3510 0x7ff524166840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52c3a6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff52415c030 0x7ff52409d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52c3a6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 0x7ff52415b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52c3a6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff52415c590 con 0x7ff52415d1d0 2024-09-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52c3a6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff52415c410 con 0x7ff5240b3510 2024-09-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52c3a6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff5241690e0 con 0x7ff52415c030 2024-09-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a943640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 0x7ff52415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a943640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 0x7ff52415b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46344/0 (socket says 172.21.15.67:46344) 2024-09-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a943640 1 -- 172.21.15.67:0/275249272 learned_addr learned my addr 172.21.15.67:0/275249272 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff529941640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff52415c030 0x7ff52409d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a142640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5240b3510 0x7ff524166840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a943640 1 -- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff52415c030 msgr2=0x7ff52409d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a943640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff52415c030 0x7ff52409d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a943640 1 -- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5240b3510 msgr2=0x7ff524166840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a943640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5240b3510 0x7ff524166840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a943640 1 -- 172.21.15.67:0/275249272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff524164840 con 0x7ff52415d1d0 2024-09-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a142640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5240b3510 0x7ff524166840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a943640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 0x7ff52415b310 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00c7b0 tx=0x7ff51c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff51affd640 1 -- 172.21.15.67:0/275249272 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c004b70 con 0x7ff52415d1d0 2024-09-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff51affd640 1 -- 172.21.15.67:0/275249272 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51c004d10 con 0x7ff52415d1d0 2024-09-19T05:39:32.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff51affd640 1 -- 172.21.15.67:0/275249272 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00aa90 con 0x7ff52415d1d0 2024-09-19T05:39:32.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52c3a6640 1 -- 172.21.15.67:0/275249272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52415b850 con 0x7ff52415d1d0 2024-09-19T05:39:32.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52c3a6640 1 -- 172.21.15.67:0/275249272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff524073c80 con 0x7ff52415d1d0 2024-09-19T05:39:32.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52c3a6640 1 -- 172.21.15.67:0/275249272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff52406dde0 con 0x7ff52415d1d0 2024-09-19T05:39:32.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff51affd640 1 -- 172.21.15.67:0/275249272 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff51c00ac30 con 0x7ff52415d1d0 2024-09-19T05:39:32.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff51affd640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5080678c0 0x7ff508069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff51affd640 1 -- 172.21.15.67:0/275249272 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7ff51c086040 con 0x7ff52415d1d0 2024-09-19T05:39:32.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.348+0000 7ff52a142640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5080678c0 0x7ff508069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.352+0000 7ff52a142640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5080678c0 0x7ff508069d80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff5241562e0 tx=0x7ff520008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.356+0000 7ff51affd640 1 -- 172.21.15.67:0/275249272 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff51c020070 con 0x7ff52415d1d0 2024-09-19T05:39:32.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.556+0000 7ff52c3a6640 1 -- 172.21.15.67:0/275249272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5241596c0 con 0x7ff52415d1d0 2024-09-19T05:39:32.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.556+0000 7ff51affd640 1 -- 172.21.15.67:0/275249272 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5217 (secure 0 0 0) 0x7ff51c0569d0 con 0x7ff52415d1d0 2024-09-19T05:39:32.557 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:32.557 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":74,"btime":"2024-09-19T05:39:32:390482+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":5831,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/761363037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":761363037},{"type":"v1","addr":"172.21.15.97:6837","nonce":761363037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:31.392719+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"a","rank":0,"incarnation":72,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.67:6835/1158789793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1158789793},{"type":"v1","addr":"172.21.15.67:6835","nonce":1158789793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-19T05:39:32.557 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 74 2024-09-19T05:39:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 -- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5080678c0 msgr2=0x7ff508069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5080678c0 0x7ff508069d80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff5241562e0 tx=0x7ff520008040 comp rx=0 tx=0).stop 2024-09-19T05:39:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 -- 172.21.15.67:0/275249272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 msgr2=0x7ff52415b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 0x7ff52415b310 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00c7b0 tx=0x7ff51c00cc70 comp rx=0 tx=0).stop 2024-09-19T05:39:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 -- 172.21.15.67:0/275249272 shutdown_connections 2024-09-19T05:39:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff52415d1d0 0x7ff52415b310 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5080678c0 0x7ff508069d80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff52415c030 0x7ff52409d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 --2- 172.21.15.67:0/275249272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5240b3510 0x7ff524166840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 -- 172.21.15.67:0/275249272 >> 172.21.15.67:0/275249272 conn(0x7ff5240d0080 msgr2=0x7ff52415de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:32.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 -- 172.21.15.67:0/275249272 shutdown_connections 2024-09-19T05:39:32.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:32.560+0000 7ff52c3a6640 1 -- 172.21.15.67:0/275249272 wait complete. 2024-09-19T05:39:32.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:39:06.828432+0000', 'modified': '2024-09-19T05:39:31.392719+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7464': {'gid': 7464, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.67:6835/1158789793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 1158789793}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 1158789793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-19T05:39:32.979 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7464:up:rejoin 2024-09-19T05:39:33.981 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:34.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77e30d640 1 Processor -- start 2024-09-19T05:39:34.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77e30d640 1 -- start start 2024-09-19T05:39:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77e30d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe77815c030 0x7fe77806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77e30d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe77806e3c0 con 0x7fe77806f460 2024-09-19T05:39:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77e30d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe77806e6a0 con 0x7fe77815d1d0 2024-09-19T05:39:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77e30d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe77806e980 con 0x7fe77815c030 2024-09-19T05:39:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77c8aa640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe77806f460 0x7fe7780acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47330/0 (socket says 172.21.15.67:47330) 2024-09-19T05:39:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77c8aa640 1 -- 172.21.15.67:0/1752674461 learned_addr learned my addr 172.21.15.67:0/1752674461 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:34.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe777fff640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe77815c030 0x7fe77806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372582020 0 0) 0x7fe77806e3c0 con 0x7fe77806f460 2024-09-19T05:39:34.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe760003530 con 0x7fe77806f460 2024-09-19T05:39:34.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3417873014 0 0) 0x7fe760003530 con 0x7fe77806f460 2024-09-19T05:39:34.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe77815c030 msgr2=0x7fe77806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe77815c030 0x7fe77806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 >> v1:172.21.15.97:6789/0 conn(0x7fe77815d1d0 legacy=0x7fe7780b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77806ec60 con 0x7fe77806f460 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fe770001680 con 0x7fe77806f460 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 >> v1:172.21.15.67:6789/0 conn(0x7fe77806f460 legacy=0x7fe7780acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe77815c030 0x7fe7600039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe760003f70 0x7fe760004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe760004d50 0x7fe7600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe77806e980 con 0x7fe760004d50 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe76000bab0 con 0x7fe760003f70 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe76000bcb0 con 0x7fe77815c030 2024-09-19T05:39:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77c8aa640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe760004d50 0x7fe7600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe777fff640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe77815c030 0x7fe7600039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe7777fe640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe760003f70 0x7fe760004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77c8aa640 1 -- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe77815c030 msgr2=0x7fe7600039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77c8aa640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe77815c030 0x7fe7600039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77c8aa640 1 -- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe760003f70 msgr2=0x7fe760004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77c8aa640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe760003f70 0x7fe760004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe77c8aa640 1 -- 172.21.15.67:0/1752674461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe760003530 con 0x7fe760004d50 2024-09-19T05:39:34.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.120+0000 7fe777fff640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe77815c030 0x7fe7600039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe77c8aa640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe760004d50 0x7fe7600051d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fe77000c1c0 tx=0x7fe77001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d615a692f7d33f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770007d00 con 0x7fe760004d50 2024-09-19T05:39:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7700a9020 con 0x7fe760004d50 2024-09-19T05:39:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe776ffd640 1 -- 172.21.15.67:0/1752674461 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7700a5b80 con 0x7fe760004d50 2024-09-19T05:39:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe77e30d640 1 -- 172.21.15.67:0/1752674461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe760004d50 msgr2=0x7fe7600051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe77e30d640 1 --2- 172.21.15.67:0/1752674461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe760004d50 0x7fe7600051d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fe77000c1c0 tx=0x7fe77001cc60 comp rx=0 tx=0).stop 2024-09-19T05:39:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe77c8aa640 1 -- 172.21.15.67:0/1752674461 reap_dead start 2024-09-19T05:39:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe77e30d640 1 -- 172.21.15.67:0/1752674461 shutdown_connections 2024-09-19T05:39:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe77e30d640 1 -- 172.21.15.67:0/1752674461 >> 172.21.15.67:0/1752674461 conn(0x7fe7780d0080 msgr2=0x7fe7780d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe77e30d640 1 -- 172.21.15.67:0/1752674461 shutdown_connections 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe77e30d640 1 -- 172.21.15.67:0/1752674461 wait complete. 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe77e30d640 1 Processor -- start 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.124+0000 7fe77e30d640 1 -- start start 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77e30d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe760004d50 0x7fe77809daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77e30d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe77814fd70 0x7fe778151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77e30d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe778145270 0x7fe778145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77e30d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe7780b36e0 con 0x7fe778145270 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77e30d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe77815d630 con 0x7fe77814fd70 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77e30d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe77809b1f0 con 0x7fe760004d50 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77c8aa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe778145270 0x7fe778145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77c8aa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe778145270 0x7fe778145700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46362/0 (socket says 172.21.15.67:46362) 2024-09-19T05:39:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77c8aa640 1 -- 172.21.15.67:0/3162881274 learned_addr learned my addr 172.21.15.67:0/3162881274 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe777fff640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe760004d50 0x7fe77809daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe7777fe640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe77814fd70 0x7fe778151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77c8aa640 1 -- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe760004d50 msgr2=0x7fe77809daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77c8aa640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe760004d50 0x7fe77809daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77c8aa640 1 -- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe77814fd70 msgr2=0x7fe778151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77c8aa640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe77814fd70 0x7fe778151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77c8aa640 1 -- 172.21.15.67:0/3162881274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77814ea30 con 0x7fe778145270 2024-09-19T05:39:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77c8aa640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe778145270 0x7fe778145700 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fe770007040 tx=0x7fe760005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe774ff9640 1 -- 172.21.15.67:0/3162881274 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770001c40 con 0x7fe778145270 2024-09-19T05:39:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe774ff9640 1 -- 172.21.15.67:0/3162881274 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7700b3070 con 0x7fe778145270 2024-09-19T05:39:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77e30d640 1 -- 172.21.15.67:0/3162881274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe778150230 con 0x7fe778145270 2024-09-19T05:39:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe774ff9640 1 -- 172.21.15.67:0/3162881274 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770004bf0 con 0x7fe778145270 2024-09-19T05:39:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77e30d640 1 -- 172.21.15.67:0/3162881274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7781507f0 con 0x7fe778145270 2024-09-19T05:39:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe77e30d640 1 -- 172.21.15.67:0/3162881274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77815c410 con 0x7fe778145270 2024-09-19T05:39:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe774ff9640 1 -- 172.21.15.67:0/3162881274 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe7700070d0 con 0x7fe778145270 2024-09-19T05:39:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe774ff9640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 0x7fe764069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe774ff9640 1 -- 172.21.15.67:0/3162881274 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7fe77011f6c0 con 0x7fe778145270 2024-09-19T05:39:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.128+0000 7fe777fff640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 0x7fe764069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.132+0000 7fe777fff640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 0x7fe764069d80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0099d0 tx=0x7fe76c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.136+0000 7fe774ff9640 1 -- 172.21.15.67:0/3162881274 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe7700bf030 con 0x7fe778145270 2024-09-19T05:39:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.332+0000 7fe77e30d640 1 -- 172.21.15.67:0/3162881274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7780d0f20 con 0x7fe778145270 2024-09-19T05:39:34.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.332+0000 7fe774ff9640 1 -- 172.21.15.67:0/3162881274 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7fe770016970 con 0x7fe778145270 2024-09-19T05:39:34.332 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:34.332 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"btime":"2024-09-19T05:39:33:398633+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":5831,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/761363037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":761363037},{"type":"v1","addr":"172.21.15.97:6837","nonce":761363037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:33.398620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/1158789793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1158789793},{"type":"v1","addr":"172.21.15.67:6835","nonce":1158789793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7464,"qdb_cluster":[7464]},"id":6}]} 2024-09-19T05:39:34.332 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 75 2024-09-19T05:39:34.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 -- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 msgr2=0x7fe764069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 0x7fe764069d80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0099d0 tx=0x7fe76c008040 comp rx=0 tx=0).stop 2024-09-19T05:39:34.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 -- 172.21.15.67:0/3162881274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe778145270 msgr2=0x7fe778145700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe778145270 0x7fe778145700 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fe770007040 tx=0x7fe760005840 comp rx=0 tx=0).stop 2024-09-19T05:39:34.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 -- 172.21.15.67:0/3162881274 shutdown_connections 2024-09-19T05:39:34.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe778145270 0x7fe778145700 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe77814fd70 0x7fe778151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 0x7fe764069d80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 --2- 172.21.15.67:0/3162881274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe760004d50 0x7fe77809daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 -- 172.21.15.67:0/3162881274 >> 172.21.15.67:0/3162881274 conn(0x7fe7780d0080 msgr2=0x7fe7780acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 -- 172.21.15.67:0/3162881274 shutdown_connections 2024-09-19T05:39:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.336+0000 7fe77e30d640 1 -- 172.21.15.67:0/3162881274 wait complete. 2024-09-19T05:39:34.752 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:39:06.828432+0000', 'modified': '2024-09-19T05:39:33.398620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7464': {'gid': 7464, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.67:6835/1158789793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 1158789793}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 1158789793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7464, 'qdb_cluster': [7464]} 2024-09-19T05:39:34.753 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:39:34.753 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T05:39:34.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15f7e7640 1 Processor -- start 2024-09-19T05:39:34.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15f7e7640 1 -- start start 2024-09-19T05:39:34.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15f7e7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd15815c030 0x7fd15806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15f7e7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd15815d1d0 0x7fd1580b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15f7e7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd15806e3c0 con 0x7fd1580b3510 2024-09-19T05:39:34.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15f7e7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd15806e6a0 con 0x7fd15815c030 2024-09-19T05:39:34.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15f7e7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd15806e980 con 0x7fd15815d1d0 2024-09-19T05:39:34.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15d583640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd15815c030 0x7fd15806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15d583640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd15815c030 0x7fd15806dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46366/0 (socket says 172.21.15.67:46366) 2024-09-19T05:39:34.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15d583640 1 -- 172.21.15.67:0/2463501010 learned_addr learned my addr 172.21.15.67:0/2463501010 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:34.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15cd82640 1 --2- 172.21.15.67:0/2463501010 >> v2:172.21.15.97:3300/0 conn(0x7fd15815d1d0 0x7fd1580b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15d583640 1 -- 172.21.15.67:0/2463501010 >> v2:172.21.15.97:3300/0 conn(0x7fd15815d1d0 msgr2=0x7fd1580b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15d583640 1 --2- 172.21.15.67:0/2463501010 >> v2:172.21.15.97:3300/0 conn(0x7fd15815d1d0 0x7fd1580b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15d583640 1 -- 172.21.15.67:0/2463501010 >> v1:172.21.15.97:6789/0 conn(0x7fd1580b3510 legacy=0x7fd15806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.888+0000 7fd15d583640 1 -- 172.21.15.67:0/2463501010 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15806ec60 con 0x7fd15815c030 2024-09-19T05:39:34.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd15d583640 1 --2- 172.21.15.67:0/2463501010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815c030 0x7fd15806dde0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fd1580add20 tx=0x7fd14c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd17abdbc6026e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:34.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd14bfff640 1 -- 172.21.15.67:0/2463501010 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0ab610 con 0x7fd15815c030 2024-09-19T05:39:34.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd14bfff640 1 -- 172.21.15.67:0/2463501010 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c0b0070 con 0x7fd15815c030 2024-09-19T05:39:34.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd14bfff640 1 -- 172.21.15.67:0/2463501010 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0ab9d0 con 0x7fd15815c030 2024-09-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd15f7e7640 1 -- 172.21.15.67:0/2463501010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815c030 msgr2=0x7fd15806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd15f7e7640 1 --2- 172.21.15.67:0/2463501010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815c030 0x7fd15806dde0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fd1580add20 tx=0x7fd14c01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd15f7e7640 1 -- 172.21.15.67:0/2463501010 shutdown_connections 2024-09-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd15f7e7640 1 --2- 172.21.15.67:0/2463501010 >> v2:172.21.15.97:3300/0 conn(0x7fd15815d1d0 0x7fd1580b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd15f7e7640 1 --2- 172.21.15.67:0/2463501010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815c030 0x7fd15806dde0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd15f7e7640 1 -- 172.21.15.67:0/2463501010 >> 172.21.15.67:0/2463501010 conn(0x7fd1580d0080 msgr2=0x7fd1580d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd15f7e7640 1 -- 172.21.15.67:0/2463501010 shutdown_connections 2024-09-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.892+0000 7fd15f7e7640 1 -- 172.21.15.67:0/2463501010 wait complete. 2024-09-19T05:39:34.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15f7e7640 1 Processor -- start 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15f7e7640 1 -- start start 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15f7e7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1580b3510 0x7fd158155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15f7e7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd15815c030 0x7fd1581535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15f7e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815d1d0 0x7fd15809db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15f7e7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd15815c590 con 0x7fd15815d1d0 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15f7e7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd15815c410 con 0x7fd1580b3510 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15f7e7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd1581690e0 con 0x7fd15815c030 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15dd84640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815d1d0 0x7fd15809db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15dd84640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815d1d0 0x7fd15809db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46382/0 (socket says 172.21.15.67:46382) 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15dd84640 1 -- 172.21.15.67:0/1836544863 learned_addr learned my addr 172.21.15.67:0/1836544863 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15d583640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1580b3510 0x7fd158155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15cd82640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd15815c030 0x7fd1581535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15dd84640 1 -- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd15815c030 msgr2=0x7fd1581535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15dd84640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd15815c030 0x7fd1581535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15dd84640 1 -- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1580b3510 msgr2=0x7fd158155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15dd84640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1580b3510 0x7fd158155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15dd84640 1 -- 172.21.15.67:0/1836544863 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd158154600 con 0x7fd15815d1d0 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15cd82640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd15815c030 0x7fd1581535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15dd84640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815d1d0 0x7fd15809db40 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fd15000c430 tx=0x7fd15000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd149ffb640 1 -- 172.21.15.67:0/1836544863 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150005220 con 0x7fd15815d1d0 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd149ffb640 1 -- 172.21.15.67:0/1836544863 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1500053c0 con 0x7fd15815d1d0 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15f7e7640 1 -- 172.21.15.67:0/1836544863 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1581548e0 con 0x7fd15815d1d0 2024-09-19T05:39:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd149ffb640 1 -- 172.21.15.67:0/1836544863 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150007270 con 0x7fd15815d1d0 2024-09-19T05:39:34.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd15f7e7640 1 -- 172.21.15.67:0/1836544863 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd158154ea0 con 0x7fd15815d1d0 2024-09-19T05:39:34.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd149ffb640 1 -- 172.21.15.67:0/1836544863 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd150019020 con 0x7fd15815d1d0 2024-09-19T05:39:34.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd149ffb640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd13c0678c0 0x7fd13c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.896+0000 7fd149ffb640 1 -- 172.21.15.67:0/1836544863 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7fd150085290 con 0x7fd15815d1d0 2024-09-19T05:39:34.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd13c0678c0 0x7fd13c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 Processor -- start 2024-09-19T05:39:34.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 -- start start 2024-09-19T05:39:34.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd13c0678c0 0x7fd13c069d80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0af000 tx=0x7fd14c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:34.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b0b20 0x55d2251b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 0x55d225166d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d225167290 0x55d225167670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d22504eb60 con 0x55d2251b0b20 2024-09-19T05:39:34.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d224fb5c70 con 0x55d2251b1440 2024-09-19T05:39:34.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d224f5bed0 con 0x55d225167290 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b0b20 0x55d2251b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b0b20 0x55d2251b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46398/0 (socket says 172.21.15.67:46398) 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 -- 172.21.15.67:0/3032565472 learned_addr learned my addr 172.21.15.67:0/3032565472 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15dd84640 1 --2- 172.21.15.67:0/3032565472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d225167290 0x55d225167670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15cd82640 1 --2- 172.21.15.67:0/3032565472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 0x55d225166d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 -- 172.21.15.67:0/3032565472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d225167290 msgr2=0x55d225167670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 --2- 172.21.15.67:0/3032565472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d225167290 0x55d225167670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 -- 172.21.15.67:0/3032565472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 msgr2=0x55d225166d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 --2- 172.21.15.67:0/3032565472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 0x55d225166d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 -- 172.21.15.67:0/3032565472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d224f6de50 con 0x55d2251b0b20 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15cd82640 1 --2- 172.21.15.67:0/3032565472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 0x55d225166d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd15d583640 1 --2- 172.21.15.67:0/3032565472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b0b20 0x55d2251b0f00 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd14c01aba0 tx=0x7fd14c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e58eb8ce65fca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:34.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd142ffd640 1 -- 172.21.15.67:0/3032565472 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0ba070 con 0x55d2251b0b20 2024-09-19T05:39:34.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd142ffd640 1 -- 172.21.15.67:0/3032565472 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c0b0040 con 0x55d2251b0b20 2024-09-19T05:39:34.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd142ffd640 1 -- 172.21.15.67:0/3032565472 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0be8d0 con 0x55d2251b0b20 2024-09-19T05:39:34.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 -- 172.21.15.67:0/3032565472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b0b20 msgr2=0x55d2251b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 --2- 172.21.15.67:0/3032565472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b0b20 0x55d2251b0f00 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd14c01aba0 tx=0x7fd14c004740 comp rx=0 tx=0).stop 2024-09-19T05:39:34.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 -- 172.21.15.67:0/3032565472 shutdown_connections 2024-09-19T05:39:34.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 --2- 172.21.15.67:0/3032565472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d225167290 0x55d225167670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 --2- 172.21.15.67:0/3032565472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 0x55d225166d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 --2- 172.21.15.67:0/3032565472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b0b20 0x55d2251b0f00 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 -- 172.21.15.67:0/3032565472 >> 172.21.15.67:0/3032565472 conn(0x55d22516d600 msgr2=0x55d225165630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 -- 172.21.15.67:0/3032565472 shutdown_connections 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 -- 172.21.15.67:0/3032565472 wait complete. 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 -- start start 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.900+0000 7fd1628a3000 1 Processor -- start 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d2251b0b20 0x55d22516be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 0x55d225171cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d22516c390 0x55d225172230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d225017b00 con 0x55d22516c390 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d224f90360 con 0x55d2251b1440 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d224f8d2d0 con 0x55d2251b0b20 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 10 client.0 _ll_register_callbacks cb 0x55d225152820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15dd84640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d22516c390 0x55d225172230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15dd84640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d22516c390 0x55d225172230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46406/0 (socket says 172.21.15.67:46406) 2024-09-19T05:39:34.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15dd84640 1 -- 172.21.15.67:0/3131907037 learned_addr learned my addr 172.21.15.67:0/3131907037 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15cd82640 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 0x55d225171cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15d583640 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d2251b0b20 0x55d22516be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15dd84640 1 -- 172.21.15.67:0/3131907037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d2251b0b20 msgr2=0x55d22516be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15dd84640 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d2251b0b20 0x55d22516be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15dd84640 1 -- 172.21.15.67:0/3131907037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 msgr2=0x55d225171cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15dd84640 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 0x55d225171cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15dd84640 1 -- 172.21.15.67:0/3131907037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d224f5c120 con 0x55d22516c390 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15dd84640 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d22516c390 0x55d225172230 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fd15000a040 tx=0x7fd1500555d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2086943a47001c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd137fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd137fff640 1 -- 172.21.15.67:0/3131907037 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15005dbe0 con 0x55d22516c390 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd137fff640 1 -- 172.21.15.67:0/3131907037 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7fd15005dd80 con 0x55d22516c390 2024-09-19T05:39:34.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- 172.21.15.67:0/3131907037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd14c0b0040 con 0x55d22516c390 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd137fff640 1 -- 172.21.15.67:0/3131907037 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fd150007410 con 0x55d22516c390 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 10 client.7506 fetch_fsmap learned FSMap version 75 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- 172.21.15.67:0/3131907037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x55d224f55450 con 0x55d22516c390 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd137fff640 1 -- 172.21.15.67:0/3131907037 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c0b0040 con 0x55d22516c390 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd137fff640 1 -- 172.21.15.67:0/3131907037 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7fd150083080 con 0x55d22516c390 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 10 client.7506 fetch_fsmap finished waiting for FSMap version 75 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 10 client.7506 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 20 client.7506 populate_metadata read hostname 'smithi067' 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55d2251b6f50 0x55d2251b7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 4 client.7506 mds_command: new command op to 7464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- 172.21.15.67:0/3131907037 --> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d224f4fc00 con 0x55d2251b6f50 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15d583640 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55d2251b6f50 0x55d2251b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd15d583640 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55d2251b6f50 0x55d2251b7330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bc84d59877d93b5 server_cookie=da40a18f295e9258 in_seq=0 out_seq=0 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd137fff640 10 client.7506 ms_handle_connect on v2:172.21.15.67:6834/1158789793 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd137fff640 1 -- 172.21.15.67:0/3131907037 <== mds.0 v2:172.21.15.67:6834/1158789793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d224f4fc00 con 0x55d2251b6f50 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd137fff640 10 client.7506 handle_command_reply: tid=0 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 client.7506 shutdown 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- 172.21.15.67:0/3131907037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d22516c390 msgr2=0x55d225172230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d22516c390 0x55d225172230 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fd15000a040 tx=0x7fd1500555d0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- 172.21.15.67:0/3131907037 shutdown_connections 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55d2251b6f50 0x55d2251b7330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d22516c390 0x55d225172230 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b1440 0x55d225171cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd137fff640 0 client.7506 ms_handle_reset on v2:172.21.15.67:6834/1158789793 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 --2- 172.21.15.67:0/3131907037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d2251b0b20 0x55d22516be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- 172.21.15.67:0/3131907037 >> 172.21.15.67:0/3131907037 conn(0x55d225167290 msgr2=0x55d225165d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:34.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- 172.21.15.67:0/3131907037 shutdown_connections 2024-09-19T05:39:34.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 1 -- 172.21.15.67:0/3131907037 wait complete. 2024-09-19T05:39:34.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.904+0000 7fd1628a3000 20 client.7506 trim_cache size 0 max 16384 2024-09-19T05:39:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1628a3000 1 Processor -- start 2024-09-19T05:39:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1628a3000 1 -- start start 2024-09-19T05:39:34.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d22516c390 0x55d2251b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b0b20 0x55d2251c7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2251c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1628a3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd1580736e0 con 0x55d2251b1440 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1628a3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd15814d600 con 0x55d2251b0b20 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1628a3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd158073090 con 0x55d22516c390 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd15dd84640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2251c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd15dd84640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2251c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46422/0 (socket says 172.21.15.67:46422) 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd15dd84640 1 -- 172.21.15.67:0/2574309929 learned_addr learned my addr 172.21.15.67:0/2574309929 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd15dd84640 1 -- 172.21.15.67:0/2574309929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d22516c390 msgr2=0x55d2251b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd15dd84640 1 --2- 172.21.15.67:0/2574309929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d22516c390 0x55d2251b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd15dd84640 1 -- 172.21.15.67:0/2574309929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b0b20 msgr2=0x55d2251c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd15dd84640 1 --2- 172.21.15.67:0/2574309929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b0b20 0x55d2251c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd15dd84640 1 -- 172.21.15.67:0/2574309929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d224f3cfd0 con 0x55d2251b1440 2024-09-19T05:39:34.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd15dd84640 1 --2- 172.21.15.67:0/2574309929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2251c7550 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd150055420 tx=0x7fd150085050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4028982151caf89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:34.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1427fc640 1 -- 172.21.15.67:0/2574309929 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150055b90 con 0x55d2251b1440 2024-09-19T05:39:34.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1427fc640 1 -- 172.21.15.67:0/2574309929 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd150051b00 con 0x55d2251b1440 2024-09-19T05:39:34.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.924+0000 7fd1427fc640 1 -- 172.21.15.67:0/2574309929 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15005dbe0 con 0x55d2251b1440 2024-09-19T05:39:34.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/2574309929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 msgr2=0x55d2251c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- 172.21.15.67:0/2574309929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2251c7550 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd150055420 tx=0x7fd150085050 comp rx=0 tx=0).stop 2024-09-19T05:39:34.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/2574309929 shutdown_connections 2024-09-19T05:39:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- 172.21.15.67:0/2574309929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2251c7550 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- 172.21.15.67:0/2574309929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d2251b0b20 0x55d2251c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- 172.21.15.67:0/2574309929 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d22516c390 0x55d2251b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/2574309929 >> 172.21.15.67:0/2574309929 conn(0x55d225167290 msgr2=0x55d22516b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/2574309929 shutdown_connections 2024-09-19T05:39:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/2574309929 wait complete. 2024-09-19T05:39:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- start start 2024-09-19T05:39:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 Processor -- start 2024-09-19T05:39:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d22516c390 0x55d225223ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d2251b0b20 0x55d2252243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2252206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d224fb4f80 con 0x55d2251b1440 2024-09-19T05:39:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d224f6dca0 con 0x55d22516c390 2024-09-19T05:39:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d224fba2a0 con 0x55d2251b0b20 2024-09-19T05:39:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 10 client.0 _ll_register_callbacks cb 0x7fd150054fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15dd84640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2252206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15dd84640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2252206c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46424/0 (socket says 172.21.15.67:46424) 2024-09-19T05:39:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15dd84640 1 -- 172.21.15.67:0/1618007818 learned_addr learned my addr 172.21.15.67:0/1618007818 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15dd84640 1 -- 172.21.15.67:0/1618007818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d2251b0b20 msgr2=0x55d2252243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15dd84640 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d2251b0b20 0x55d2252243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15dd84640 1 -- 172.21.15.67:0/1618007818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d22516c390 msgr2=0x55d225223ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15dd84640 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d22516c390 0x55d225223ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15dd84640 1 -- 172.21.15.67:0/1618007818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d225038750 con 0x55d2251b1440 2024-09-19T05:39:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15dd84640 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2252206c0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd15000a040 tx=0x7fd150083450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ae500881593df0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd137fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:39:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd137fff640 1 -- 172.21.15.67:0/1618007818 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150071030 con 0x55d2251b1440 2024-09-19T05:39:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd137fff640 1 -- 172.21.15.67:0/1618007818 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7fd15005ddf0 con 0x55d2251b1440 2024-09-19T05:39:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/1618007818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd150051b00 con 0x55d2251b1440 2024-09-19T05:39:34.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd137fff640 1 -- 172.21.15.67:0/1618007818 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fd15007a050 con 0x55d2251b1440 2024-09-19T05:39:34.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 10 client.7512 fetch_fsmap learned FSMap version 75 2024-09-19T05:39:34.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/1618007818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x55d224f43a30 con 0x55d2251b1440 2024-09-19T05:39:34.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd137fff640 1 -- 172.21.15.67:0/1618007818 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd150051b00 con 0x55d2251b1440 2024-09-19T05:39:34.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd137fff640 1 -- 172.21.15.67:0/1618007818 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7fd1500548e0 con 0x55d2251b1440 2024-09-19T05:39:34.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 10 client.7512 fetch_fsmap finished waiting for FSMap version 75 2024-09-19T05:39:34.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 10 client.7512 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:39:34.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 20 client.7512 populate_metadata read hostname 'smithi067' 2024-09-19T05:39:34.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55d225220c00 0x55d225220fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:34.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 4 client.7512 mds_command: new command op to 7464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:39:34.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/1618007818 --> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] -- command(tid 0: {"prefix": "status"}) -- 0x55d224fc33a0 con 0x55d225220c00 2024-09-19T05:39:34.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15d583640 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55d225220c00 0x55d225220fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:34.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd15d583640 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55d225220c00 0x55d225220fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43f4d4956d8efe5f server_cookie=4369e52eace456b0 in_seq=0 out_seq=0 2024-09-19T05:39:34.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd137fff640 10 client.7512 ms_handle_connect on v2:172.21.15.67:6834/1158789793 2024-09-19T05:39:34.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd137fff640 1 -- 172.21.15.67:0/1618007818 <== mds.0 v2:172.21.15.67:6834/1158789793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55d224fc33a0 con 0x55d225220c00 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd137fff640 10 client.7512 handle_command_reply: tid=0 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 client.7512 shutdown 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/1618007818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 msgr2=0x55d2252206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2252206c0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd15000a040 tx=0x7fd150083450 comp rx=0 tx=0).stop 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/1618007818 shutdown_connections 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55d225220c00 0x55d225220fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d2251b1440 0x55d2252206c0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d2251b0b20 0x55d2252243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd137fff640 0 client.7512 ms_handle_reset on v2:172.21.15.67:6834/1158789793 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 --2- 172.21.15.67:0/1618007818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d22516c390 0x55d225223ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/1618007818 >> 172.21.15.67:0/1618007818 conn(0x55d225167290 msgr2=0x55d2251c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:34.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/1618007818 shutdown_connections 2024-09-19T05:39:34.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 1 -- 172.21.15.67:0/1618007818 wait complete. 2024-09-19T05:39:34.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.928+0000 7fd1628a3000 20 client.7512 trim_cache size 0 max 16384 2024-09-19T05:39:34.941 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:39:34.941 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:39:34.942 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:39:34.942 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 7464, 2024-09-19T05:39:34.942 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:39:34.942 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:39:34.942 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:39:34.942 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 4.5482356660000001, 2024-09-19T05:39:34.942 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 75, 2024-09-19T05:39:34.942 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 104, 2024-09-19T05:39:34.942 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 104, 2024-09-19T05:39:34.942 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 5.4134083840000002 2024-09-19T05:39:34.943 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:39:34.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 -- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd13c0678c0 msgr2=0x7fd13c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd13c0678c0 0x7fd13c069d80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0af000 tx=0x7fd14c0a7000 comp rx=0 tx=0).stop 2024-09-19T05:39:34.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 -- 172.21.15.67:0/1836544863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815d1d0 msgr2=0x7fd15809db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:34.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815d1d0 0x7fd15809db40 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fd15000c430 tx=0x7fd15000c8f0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 -- 172.21.15.67:0/1836544863 shutdown_connections 2024-09-19T05:39:34.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815d1d0 0x7fd15809db40 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd13c0678c0 0x7fd13c069d80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd15815c030 0x7fd1581535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 --2- 172.21.15.67:0/1836544863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1580b3510 0x7fd158155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:34.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 -- 172.21.15.67:0/1836544863 >> 172.21.15.67:0/1836544863 conn(0x7fd1580d0080 msgr2=0x7fd15815ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:34.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 -- 172.21.15.67:0/1836544863 shutdown_connections 2024-09-19T05:39:34.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:34.932+0000 7fd15f7e7640 1 -- 172.21.15.67:0/1836544863 wait complete. 2024-09-19T05:39:34.947 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-19T05:39:35.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb511166640 1 Processor -- start 2024-09-19T05:39:35.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb511166640 1 -- start start 2024-09-19T05:39:35.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb511166640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0d1590 0x7fb50c169240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb511166640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50c0d35a0 con 0x7fb50c0d4fb0 2024-09-19T05:39:35.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb511166640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50c0d32c0 con 0x7fb50c15e690 2024-09-19T05:39:35.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb511166640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb50c06d040 con 0x7fb50c0d1590 2024-09-19T05:39:35.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb50a59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb50c0d4fb0 0x7fb50c0d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47342/0 (socket says 172.21.15.67:47342) 2024-09-19T05:39:35.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb50a59c640 1 -- 172.21.15.67:0/1088273677 learned_addr learned my addr 172.21.15.67:0/1088273677 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:35.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132188792 0 0) 0x7fb50c0d35a0 con 0x7fb50c0d4fb0 2024-09-19T05:39:35.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4f4003530 con 0x7fb50c0d4fb0 2024-09-19T05:39:35.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb50b59e640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0d1590 0x7fb50c169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 305047477 0 0) 0x7fb4f4003530 con 0x7fb50c0d4fb0 2024-09-19T05:39:35.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0d1590 msgr2=0x7fb50c169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:35.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0d1590 0x7fb50c169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 >> v1:172.21.15.97:6789/0 conn(0x7fb50c15e690 legacy=0x7fb50c0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c06d320 con 0x7fb50c0d4fb0 2024-09-19T05:39:35.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fb500001680 con 0x7fb50c0d4fb0 2024-09-19T05:39:35.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 >> v1:172.21.15.67:6789/0 conn(0x7fb50c0d4fb0 legacy=0x7fb50c0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0d1590 0x7fb4f40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 0x7fb4f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4f4004d50 0x7fb4f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c06d040 con 0x7fb4f4004020 2024-09-19T05:39:35.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f400bb90 con 0x7fb4f4004d50 2024-09-19T05:39:35.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f400bd90 con 0x7fb50c0d1590 2024-09-19T05:39:35.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.060+0000 7fb50a59c640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 0x7fb4f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb50b59e640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4f4004d50 0x7fb4f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb50ad9d640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0d1590 0x7fb4f40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb50a59c640 1 -- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0d1590 msgr2=0x7fb4f40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:35.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb50a59c640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0d1590 0x7fb4f40039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb50a59c640 1 -- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4f4004d50 msgr2=0x7fb4f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:35.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb50a59c640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4f4004d50 0x7fb4f40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb50a59c640 1 -- 172.21.15.67:0/1088273677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f4003530 con 0x7fb4f4004020 2024-09-19T05:39:35.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb50b59e640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4f4004d50 0x7fb4f40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:35.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb50a59c640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 0x7fb4f4004810 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb50000c210 tx=0x7fb50001f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1d2c9b3a464a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500007d40 con 0x7fb4f4004020 2024-09-19T05:39:35.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb500005b00 con 0x7fb4f4004020 2024-09-19T05:39:35.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb509d9b640 1 -- 172.21.15.67:0/1088273677 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500007070 con 0x7fb4f4004020 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb511166640 1 -- 172.21.15.67:0/1088273677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 msgr2=0x7fb4f4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb511166640 1 --2- 172.21.15.67:0/1088273677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 0x7fb4f4004810 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb50000c210 tx=0x7fb50001f3f0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb50b59e640 1 -- 172.21.15.67:0/1088273677 reap_dead start 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb511166640 1 -- 172.21.15.67:0/1088273677 shutdown_connections 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb511166640 1 -- 172.21.15.67:0/1088273677 >> 172.21.15.67:0/1088273677 conn(0x7fb50c0d4490 msgr2=0x7fb50c0d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb511166640 1 -- 172.21.15.67:0/1088273677 shutdown_connections 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.064+0000 7fb511166640 1 -- 172.21.15.67:0/1088273677 wait complete. 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 Processor -- start 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 -- start start 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 0x7fb50c0b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb50c14f8d0 0x7fb50c0c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0cf040 0x7fb50c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c06eb30 con 0x7fb4f4004020 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c15ea70 con 0x7fb50c14f8d0 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb50c06ecb0 con 0x7fb50c0cf040 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 0x7fb50c0b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 0x7fb50c0b8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46442/0 (socket says 172.21.15.67:46442) 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50ad9d640 1 -- 172.21.15.67:0/2317440991 learned_addr learned my addr 172.21.15.67:0/2317440991 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50ad9d640 1 -- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0cf040 msgr2=0x7fb50c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50b59e640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0cf040 0x7fb50c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50a59c640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb50c14f8d0 0x7fb50c0c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50ad9d640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0cf040 0x7fb50c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50ad9d640 1 -- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb50c14f8d0 msgr2=0x7fb50c0c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50ad9d640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb50c14f8d0 0x7fb50c0c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50ad9d640 1 -- 172.21.15.67:0/2317440991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c0c9d20 con 0x7fb4f4004020 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50ad9d640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 0x7fb50c0b8870 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb50400d900 tx=0x7fb50400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb4f37fe640 1 -- 172.21.15.67:0/2317440991 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504003db0 con 0x7fb4f4004020 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb4f37fe640 1 -- 172.21.15.67:0/2317440991 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb504017070 con 0x7fb4f4004020 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 -- 172.21.15.67:0/2317440991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50c0c9fc0 con 0x7fb4f4004020 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb4f37fe640 1 -- 172.21.15.67:0/2317440991 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50400b970 con 0x7fb4f4004020 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 -- 172.21.15.67:0/2317440991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb50c0ca580 con 0x7fb4f4004020 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb511166640 1 -- 172.21.15.67:0/2317440991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50c0d3880 con 0x7fb4f4004020 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb4f37fe640 1 -- 172.21.15.67:0/2317440991 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb50400bb10 con 0x7fb4f4004020 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb4f37fe640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4f80678f0 0x7fb4f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb4f37fe640 1 -- 172.21.15.67:0/2317440991 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7fb504086070 con 0x7fb4f4004020 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.068+0000 7fb50a59c640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4f80678f0 0x7fb4f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.072+0000 7fb50a59c640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4f80678f0 0x7fb4f8069db0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb5000af000 tx=0x7fb5000aa000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.072+0000 7fb4f37fe640 1 -- 172.21.15.67:0/2317440991 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb504056a00 con 0x7fb4f4004020 2024-09-19T05:39:35.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.236+0000 7fb511166640 1 -- 172.21.15.67:0/2317440991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fb50c0d35a0 con 0x7fb4f4004020 2024-09-19T05:39:35.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb4f37fe640 1 -- 172.21.15.67:0/2317440991 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7fb504056300 con 0x7fb4f4004020 2024-09-19T05:39:35.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb511166640 1 -- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4f80678f0 msgr2=0x7fb4f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb511166640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4f80678f0 0x7fb4f8069db0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb5000af000 tx=0x7fb5000aa000 comp rx=0 tx=0).stop 2024-09-19T05:39:35.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb511166640 1 -- 172.21.15.67:0/2317440991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 msgr2=0x7fb50c0b8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb511166640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 0x7fb50c0b8870 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb50400d900 tx=0x7fb50400ddc0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb511166640 1 -- 172.21.15.67:0/2317440991 shutdown_connections 2024-09-19T05:39:35.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb511166640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb4f80678f0 0x7fb4f8069db0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb511166640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb50c0cf040 0x7fb50c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb511166640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb50c14f8d0 0x7fb50c0c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb511166640 1 --2- 172.21.15.67:0/2317440991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4f4004020 0x7fb50c0b8870 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.240+0000 7fb511166640 1 -- 172.21.15.67:0/2317440991 >> 172.21.15.67:0/2317440991 conn(0x7fb50c0d4490 msgr2=0x7fb50c0b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:35.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.244+0000 7fb511166640 1 -- 172.21.15.67:0/2317440991 shutdown_connections 2024-09-19T05:39:35.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.244+0000 7fb511166640 1 -- 172.21.15.67:0/2317440991 wait complete. 2024-09-19T05:39:35.258 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-19T05:39:35.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.372+0000 7fc698f45640 1 Processor -- start 2024-09-19T05:39:35.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.372+0000 7fc698f45640 1 -- start start 2024-09-19T05:39:35.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc694159c60 0x7fc6940ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc69406ffd0 0x7fc6940aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6940b3150 0x7fc6940af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc6940af710 con 0x7fc6940b3150 2024-09-19T05:39:35.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc69415d460 con 0x7fc69406ffd0 2024-09-19T05:39:35.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc69415a040 con 0x7fc694159c60 2024-09-19T05:39:35.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc692d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6940b3150 0x7fc6940af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc692d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6940b3150 0x7fc6940af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46448/0 (socket says 172.21.15.67:46448) 2024-09-19T05:39:35.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc692d9d640 1 -- 172.21.15.67:0/254577342 learned_addr learned my addr 172.21.15.67:0/254577342 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:35.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc69259c640 1 --2- 172.21.15.67:0/254577342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc694159c60 0x7fc6940ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc691d9b640 1 --2- 172.21.15.67:0/254577342 >> v2:172.21.15.97:3300/0 conn(0x7fc69406ffd0 0x7fc6940aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc692d9d640 1 -- 172.21.15.67:0/254577342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc694159c60 msgr2=0x7fc6940ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:35.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc692d9d640 1 --2- 172.21.15.67:0/254577342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc694159c60 0x7fc6940ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc692d9d640 1 -- 172.21.15.67:0/254577342 >> v2:172.21.15.97:3300/0 conn(0x7fc69406ffd0 msgr2=0x7fc6940aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:35.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc692d9d640 1 --2- 172.21.15.67:0/254577342 >> v2:172.21.15.97:3300/0 conn(0x7fc69406ffd0 0x7fc6940aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc692d9d640 1 -- 172.21.15.67:0/254577342 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69415c850 con 0x7fc6940b3150 2024-09-19T05:39:35.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc691d9b640 1 --2- 172.21.15.67:0/254577342 >> v2:172.21.15.97:3300/0 conn(0x7fc69406ffd0 0x7fc6940aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:35.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc692d9d640 1 --2- 172.21.15.67:0/254577342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6940b3150 0x7fc6940af1d0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc694071610 tx=0x7fc68c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede4c61dd58664d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc69159a640 1 -- 172.21.15.67:0/254577342 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0aa610 con 0x7fc6940b3150 2024-09-19T05:39:35.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc69159a640 1 -- 172.21.15.67:0/254577342 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68c0af070 con 0x7fc6940b3150 2024-09-19T05:39:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc69159a640 1 -- 172.21.15.67:0/254577342 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0aa9d0 con 0x7fc6940b3150 2024-09-19T05:39:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 -- 172.21.15.67:0/254577342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6940b3150 msgr2=0x7fc6940af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 --2- 172.21.15.67:0/254577342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6940b3150 0x7fc6940af1d0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc694071610 tx=0x7fc68c01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 -- 172.21.15.67:0/254577342 shutdown_connections 2024-09-19T05:39:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 --2- 172.21.15.67:0/254577342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6940b3150 0x7fc6940af1d0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 --2- 172.21.15.67:0/254577342 >> v2:172.21.15.97:3300/0 conn(0x7fc69406ffd0 0x7fc6940aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 --2- 172.21.15.67:0/254577342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc694159c60 0x7fc6940ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 -- 172.21.15.67:0/254577342 >> 172.21.15.67:0/254577342 conn(0x7fc6940b1e50 msgr2=0x7fc6940b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 -- 172.21.15.67:0/254577342 shutdown_connections 2024-09-19T05:39:35.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.376+0000 7fc698f45640 1 -- 172.21.15.67:0/254577342 wait complete. 2024-09-19T05:39:35.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 Processor -- start 2024-09-19T05:39:35.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 -- start start 2024-09-19T05:39:35.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc69406ffd0 0x7fc6941499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6940b3150 0x7fc69415f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc694159c60 0x7fc6940afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc6940ad7f0 con 0x7fc69406ffd0 2024-09-19T05:39:35.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc6940ad670 con 0x7fc694159c60 2024-09-19T05:39:35.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc6941605b0 con 0x7fc6940b3150 2024-09-19T05:39:35.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc69259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc69406ffd0 0x7fc6941499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc69259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc69406ffd0 0x7fc6941499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46462/0 (socket says 172.21.15.67:46462) 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc69259c640 1 -- 172.21.15.67:0/30611355 learned_addr learned my addr 172.21.15.67:0/30611355 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc691d9b640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6940b3150 0x7fc69415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc69259c640 1 -- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6940b3150 msgr2=0x7fc69415f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc692d9d640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc694159c60 0x7fc6940afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc69259c640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6940b3150 0x7fc69415f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc69259c640 1 -- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc694159c60 msgr2=0x7fc6940afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc69259c640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc694159c60 0x7fc6940afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc69259c640 1 -- 172.21.15.67:0/30611355 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69414fef0 con 0x7fc69406ffd0 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc69259c640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc69406ffd0 0x7fc6941499d0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00d620 tx=0x7fc67c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc68affd640 1 -- 172.21.15.67:0/30611355 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0125f0 con 0x7fc69406ffd0 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc68affd640 1 -- 172.21.15.67:0/30611355 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67c019070 con 0x7fc69406ffd0 2024-09-19T05:39:35.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 -- 172.21.15.67:0/30611355 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69415dc20 con 0x7fc69406ffd0 2024-09-19T05:39:35.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc68affd640 1 -- 172.21.15.67:0/30611355 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0129f0 con 0x7fc69406ffd0 2024-09-19T05:39:35.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 -- 172.21.15.67:0/30611355 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69414fb10 con 0x7fc69406ffd0 2024-09-19T05:39:35.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc698f45640 1 -- 172.21.15.67:0/30611355 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc694160990 con 0x7fc69406ffd0 2024-09-19T05:39:35.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.380+0000 7fc68affd640 1 -- 172.21.15.67:0/30611355 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc67c012b90 con 0x7fc69406ffd0 2024-09-19T05:39:35.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.384+0000 7fc68affd640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6740678f0 0x7fc674069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.384+0000 7fc68affd640 1 -- 172.21.15.67:0/30611355 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7fc67c086270 con 0x7fc69406ffd0 2024-09-19T05:39:35.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.384+0000 7fc691d9b640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6740678f0 0x7fc674069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.384+0000 7fc691d9b640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6740678f0 0x7fc674069db0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc6941f8080 tx=0x7fc6840084f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.388+0000 7fc68affd640 1 -- 172.21.15.67:0/30611355 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc67c056b70 con 0x7fc69406ffd0 2024-09-19T05:39:35.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.544+0000 7fc698f45640 1 -- 172.21.15.67:0/30611355 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fc69409e210 con 0x7fc69406ffd0 2024-09-19T05:39:35.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.548+0000 7fc68affd640 1 -- 172.21.15.67:0/30611355 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v28)=0 v28) ==== 116+0+0 (secure 0 0 0) 0x7fc67c056470 con 0x7fc69406ffd0 2024-09-19T05:39:35.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.548+0000 7fc698f45640 1 -- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6740678f0 msgr2=0x7fc674069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.548+0000 7fc698f45640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6740678f0 0x7fc674069db0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc6941f8080 tx=0x7fc6840084f0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.552+0000 7fc698f45640 1 -- 172.21.15.67:0/30611355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc69406ffd0 msgr2=0x7fc6941499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.552+0000 7fc698f45640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc69406ffd0 0x7fc6941499d0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00d620 tx=0x7fc67c00dae0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.552+0000 7fc698f45640 1 -- 172.21.15.67:0/30611355 shutdown_connections 2024-09-19T05:39:35.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.552+0000 7fc698f45640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc694159c60 0x7fc6940afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.552+0000 7fc698f45640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc6740678f0 0x7fc674069db0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.552+0000 7fc698f45640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6940b3150 0x7fc69415f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.552+0000 7fc698f45640 1 --2- 172.21.15.67:0/30611355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc69406ffd0 0x7fc6941499d0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.552+0000 7fc698f45640 1 -- 172.21.15.67:0/30611355 >> 172.21.15.67:0/30611355 conn(0x7fc6940b1e50 msgr2=0x7fc69415a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.552+0000 7fc698f45640 1 -- 172.21.15.67:0/30611355 shutdown_connections 2024-09-19T05:39:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.552+0000 7fc698f45640 1 -- 172.21.15.67:0/30611355 wait complete. 2024-09-19T05:39:35.566 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-19T05:39:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a258b9640 1 Processor -- start 2024-09-19T05:39:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a258b9640 1 -- start start 2024-09-19T05:39:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a258b9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1a20070070 0x7f1a20165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a258b9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a200aef30 con 0x7f1a2015b1d0 2024-09-19T05:39:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a258b9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a200ae3b0 con 0x7f1a2006dfc0 2024-09-19T05:39:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a258b9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1a20072210 con 0x7f1a20070070 2024-09-19T05:39:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1effd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1a2015b1d0 0x7f1a200adbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47350/0 (socket says 172.21.15.67:47350) 2024-09-19T05:39:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1effd640 1 -- 172.21.15.67:0/378380814 learned_addr learned my addr 172.21.15.67:0/378380814 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1f7fe640 1 --2- 172.21.15.67:0/378380814 >> v2:172.21.15.97:3300/0 conn(0x7f1a20070070 0x7f1a20165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532108841 0 0) 0x7f1a200aef30 con 0x7f1a2015b1d0 2024-09-19T05:39:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a0c005740 con 0x7f1a2015b1d0 2024-09-19T05:39:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 897153110 0 0) 0x7f1a0c005740 con 0x7f1a2015b1d0 2024-09-19T05:39:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 >> v2:172.21.15.97:3300/0 conn(0x7f1a20070070 msgr2=0x7f1a20165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 --2- 172.21.15.67:0/378380814 >> v2:172.21.15.97:3300/0 conn(0x7f1a20070070 0x7f1a20165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 >> v1:172.21.15.97:6789/0 conn(0x7f1a2006dfc0 legacy=0x7f1a2006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a200ae690 con 0x7f1a2015b1d0 2024-09-19T05:39:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1a10001680 con 0x7f1a2015b1d0 2024-09-19T05:39:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 >> v1:172.21.15.67:6789/0 conn(0x7f1a2015b1d0 legacy=0x7f1a200adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0c005bd0 0x7f1a0c005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a0c006a20 0x7f1a0c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a0c0073e0 0x7f1a0c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20072210 con 0x7f1a0c006a20 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c00e280 con 0x7f1a0c005bd0 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0c00e480 con 0x7f1a0c0073e0 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1e7fc640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a0c006a20 0x7f1a0c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1e7fc640 1 -- 172.21.15.67:0/378380814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a0c0073e0 msgr2=0x7f1a0c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1effd640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0c005bd0 0x7f1a0c005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1e7fc640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a0c0073e0 0x7f1a0c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1e7fc640 1 -- 172.21.15.67:0/378380814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0c005bd0 msgr2=0x7f1a0c005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1e7fc640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0c005bd0 0x7f1a0c005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1e7fc640 1 -- 172.21.15.67:0/378380814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c005740 con 0x7f1a0c006a20 2024-09-19T05:39:35.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1f7fe640 1 -- 172.21.15.67:0/378380814 reap_dead start 2024-09-19T05:39:35.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.696+0000 7f1a1effd640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0c005bd0 0x7f1a0c005ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:35.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a1e7fc640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a0c006a20 0x7f1a0c006ea0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1a08001780 tx=0x7f1a0801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae079b94b2d2b620 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a080013a0 con 0x7f1a0c006a20 2024-09-19T05:39:35.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a080052f0 con 0x7f1a0c006a20 2024-09-19T05:39:35.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a1dffb640 1 -- 172.21.15.67:0/378380814 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08003840 con 0x7f1a0c006a20 2024-09-19T05:39:35.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a258b9640 1 -- 172.21.15.67:0/378380814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a0c006a20 msgr2=0x7f1a0c006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a258b9640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a0c006a20 0x7f1a0c006ea0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1a08001780 tx=0x7f1a0801c400 comp rx=0 tx=0).stop 2024-09-19T05:39:35.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a258b9640 1 -- 172.21.15.67:0/378380814 shutdown_connections 2024-09-19T05:39:35.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a258b9640 1 --2- 172.21.15.67:0/378380814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a0c006a20 0x7f1a0c006ea0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a258b9640 1 -- 172.21.15.67:0/378380814 >> 172.21.15.67:0/378380814 conn(0x7f1a200b1e50 msgr2=0x7f1a200b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:35.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a258b9640 1 -- 172.21.15.67:0/378380814 shutdown_connections 2024-09-19T05:39:35.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a258b9640 1 -- 172.21.15.67:0/378380814 wait complete. 2024-09-19T05:39:35.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a258b9640 1 Processor -- start 2024-09-19T05:39:35.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a258b9640 1 -- start start 2024-09-19T05:39:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.700+0000 7f1a258b9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0c006a20 0x7f1a2015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a258b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a201f50a0 0x7f1a2014c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a258b9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a2015cc20 0x7f1a2015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a258b9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20072420 con 0x7f1a2015cc20 2024-09-19T05:39:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a258b9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1a200aec50 con 0x7f1a0c006a20 2024-09-19T05:39:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a258b9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1a200adbb0 con 0x7f1a201f50a0 2024-09-19T05:39:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a2015cc20 0x7f1a2015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a2015cc20 0x7f1a2015d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46478/0 (socket says 172.21.15.67:46478) 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1f7fe640 1 -- 172.21.15.67:0/684694495 learned_addr learned my addr 172.21.15.67:0/684694495 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1effd640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0c006a20 0x7f1a2015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1e7fc640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a201f50a0 0x7f1a2014c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1f7fe640 1 -- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a201f50a0 msgr2=0x7f1a2014c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1f7fe640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a201f50a0 0x7f1a2014c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1f7fe640 1 -- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0c006a20 msgr2=0x7f1a2015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1f7fe640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0c006a20 0x7f1a2015b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1f7fe640 1 -- 172.21.15.67:0/684694495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2015bde0 con 0x7f1a2015cc20 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1e7fc640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a201f50a0 0x7f1a2014c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1f7fe640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a2015cc20 0x7f1a2015d0a0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1a20071a60 tx=0x7f1a1800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a17fff640 1 -- 172.21.15.67:0/684694495 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1800bb10 con 0x7f1a2015cc20 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a17fff640 1 -- 172.21.15.67:0/684694495 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1801a070 con 0x7f1a2015cc20 2024-09-19T05:39:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a258b9640 1 -- 172.21.15.67:0/684694495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2015c0c0 con 0x7f1a2015cc20 2024-09-19T05:39:35.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a17fff640 1 -- 172.21.15.67:0/684694495 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18014400 con 0x7f1a2015cc20 2024-09-19T05:39:35.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a258b9640 1 -- 172.21.15.67:0/684694495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2015baf0 con 0x7f1a2015cc20 2024-09-19T05:39:35.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a258b9640 1 -- 172.21.15.67:0/684694495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2014dc70 con 0x7f1a2015cc20 2024-09-19T05:39:35.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a17fff640 1 -- 172.21.15.67:0/684694495 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1a18013070 con 0x7f1a2015cc20 2024-09-19T05:39:35.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a17fff640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a000678f0 0x7f1a00069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a17fff640 1 -- 172.21.15.67:0/684694495 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7f1a18086170 con 0x7f1a2015cc20 2024-09-19T05:39:35.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1effd640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a000678f0 0x7f1a00069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.704+0000 7f1a1effd640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a000678f0 0x7f1a00069db0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1a20156e90 tx=0x7f1a10000f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.708+0000 7f1a17fff640 1 -- 172.21.15.67:0/684694495 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1a18024020 con 0x7f1a2015cc20 2024-09-19T05:39:35.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.864+0000 7f1a258b9640 1 -- 172.21.15.67:0/684694495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f1a20068530 con 0x7f1a2015cc20 2024-09-19T05:39:35.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.872+0000 7f1a17fff640 1 -- 172.21.15.67:0/684694495 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v29)=0 v29) ==== 116+0+0 (secure 0 0 0) 0x7f1a18056a70 con 0x7f1a2015cc20 2024-09-19T05:39:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 -- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a000678f0 msgr2=0x7f1a00069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a000678f0 0x7f1a00069db0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1a20156e90 tx=0x7f1a10000f00 comp rx=0 tx=0).stop 2024-09-19T05:39:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 -- 172.21.15.67:0/684694495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a2015cc20 msgr2=0x7f1a2015d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a2015cc20 0x7f1a2015d0a0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1a20071a60 tx=0x7f1a1800ef30 comp rx=0 tx=0).stop 2024-09-19T05:39:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 -- 172.21.15.67:0/684694495 shutdown_connections 2024-09-19T05:39:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a2015cc20 0x7f1a2015d0a0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a000678f0 0x7f1a00069db0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a201f50a0 0x7f1a2014c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 --2- 172.21.15.67:0/684694495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0c006a20 0x7f1a2015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 -- 172.21.15.67:0/684694495 >> 172.21.15.67:0/684694495 conn(0x7f1a200b1e50 msgr2=0x7f1a20072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 -- 172.21.15.67:0/684694495 shutdown_connections 2024-09-19T05:39:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:35.876+0000 7f1a258b9640 1 -- 172.21.15.67:0/684694495 wait complete. 2024-09-19T05:39:35.890 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:36.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.008+0000 7fab61410640 1 Processor -- start 2024-09-19T05:39:36.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.008+0000 7fab61410640 1 -- start start 2024-09-19T05:39:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab61410640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab5c15b1e0 0x7fab5c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab61410640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab5c0b4900 0x7fab5c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab61410640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab5c0b3860 con 0x7fab5c0723c0 2024-09-19T05:39:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab61410640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fab5c15b5c0 con 0x7fab5c0b4900 2024-09-19T05:39:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab61410640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fab5c0b3b40 con 0x7fab5c15b1e0 2024-09-19T05:39:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab5a7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab5c0b4900 0x7fab5c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab5a7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab5c0b4900 0x7fab5c071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46938/0 (socket says 172.21.15.67:46938) 2024-09-19T05:39:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab5a7fc640 1 -- 172.21.15.67:0/2409329362 learned_addr learned my addr 172.21.15.67:0/2409329362 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab5affd640 1 --2- 172.21.15.67:0/2409329362 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab5c15b1e0 0x7fab5c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab5a7fc640 1 -- 172.21.15.67:0/2409329362 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab5c15b1e0 msgr2=0x7fab5c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab5a7fc640 1 --2- 172.21.15.67:0/2409329362 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab5c15b1e0 0x7fab5c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab5a7fc640 1 -- 172.21.15.67:0/2409329362 >> v1:172.21.15.67:6789/0 conn(0x7fab5c0723c0 legacy=0x7fab5c15ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab5a7fc640 1 -- 172.21.15.67:0/2409329362 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c0b3e20 con 0x7fab5c0b4900 2024-09-19T05:39:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab5affd640 1 --2- 172.21.15.67:0/2409329362 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab5c15b1e0 0x7fab5c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab5a7fc640 1 --2- 172.21.15.67:0/2409329362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0b4900 0x7fab5c071e80 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fab5000bb40 tx=0x7fab5001ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9f4a1108f4ea95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab59ffb640 1 -- 172.21.15.67:0/2409329362 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab500b4070 con 0x7fab5c0b4900 2024-09-19T05:39:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab59ffb640 1 -- 172.21.15.67:0/2409329362 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab500a7cb0 con 0x7fab5c0b4900 2024-09-19T05:39:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.012+0000 7fab59ffb640 1 -- 172.21.15.67:0/2409329362 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab500a7e60 con 0x7fab5c0b4900 2024-09-19T05:39:36.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- 172.21.15.67:0/2409329362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0b4900 msgr2=0x7fab5c071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 --2- 172.21.15.67:0/2409329362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0b4900 0x7fab5c071e80 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fab5000bb40 tx=0x7fab5001ebe0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- 172.21.15.67:0/2409329362 shutdown_connections 2024-09-19T05:39:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 --2- 172.21.15.67:0/2409329362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0b4900 0x7fab5c071e80 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 --2- 172.21.15.67:0/2409329362 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab5c15b1e0 0x7fab5c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- 172.21.15.67:0/2409329362 >> 172.21.15.67:0/2409329362 conn(0x7fab5c0d0080 msgr2=0x7fab5c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- 172.21.15.67:0/2409329362 shutdown_connections 2024-09-19T05:39:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- 172.21.15.67:0/2409329362 wait complete. 2024-09-19T05:39:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 Processor -- start 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- start start 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0723c0 0x7fab5c15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab5c0b4900 0x7fab5c099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab5c15b1e0 0x7fab5c14cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c06e670 con 0x7fab5c0723c0 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c0b3510 con 0x7fab5c15b1e0 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fab5c06e7f0 con 0x7fab5c0b4900 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab5affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0723c0 0x7fab5c15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab5affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0723c0 0x7fab5c15a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46946/0 (socket says 172.21.15.67:46946) 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab5affd640 1 -- 172.21.15.67:0/723172002 learned_addr learned my addr 172.21.15.67:0/723172002 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab5affd640 1 -- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab5c0b4900 msgr2=0x7fab5c099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab5affd640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab5c0b4900 0x7fab5c099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab5affd640 1 -- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab5c15b1e0 msgr2=0x7fab5c14cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab5affd640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab5c15b1e0 0x7fab5c14cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab5affd640 1 -- 172.21.15.67:0/723172002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c14c490 con 0x7fab5c0723c0 2024-09-19T05:39:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab5affd640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0723c0 0x7fab5c15a3b0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c7f0 tx=0x7fab4c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab437fe640 1 -- 172.21.15.67:0/723172002 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c015070 con 0x7fab5c0723c0 2024-09-19T05:39:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab437fe640 1 -- 172.21.15.67:0/723172002 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c007820 con 0x7fab5c0723c0 2024-09-19T05:39:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- 172.21.15.67:0/723172002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5c141230 con 0x7fab5c0723c0 2024-09-19T05:39:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab437fe640 1 -- 172.21.15.67:0/723172002 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c007c30 con 0x7fab5c0723c0 2024-09-19T05:39:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.016+0000 7fab61410640 1 -- 172.21.15.67:0/723172002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab5c14d190 con 0x7fab5c0723c0 2024-09-19T05:39:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.020+0000 7fab61410640 1 -- 172.21.15.67:0/723172002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab5c071e80 con 0x7fab5c0723c0 2024-09-19T05:39:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.020+0000 7fab437fe640 1 -- 172.21.15.67:0/723172002 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab4c018070 con 0x7fab5c0723c0 2024-09-19T05:39:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.020+0000 7fab437fe640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab480678c0 0x7fab48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.020+0000 7fab437fe640 1 -- 172.21.15.67:0/723172002 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7fab4c086070 con 0x7fab5c0723c0 2024-09-19T05:39:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.020+0000 7fab5a7fc640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab480678c0 0x7fab48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.020+0000 7fab5a7fc640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab480678c0 0x7fab48069d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab500b1000 tx=0x7fab50004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.024+0000 7fab437fe640 1 -- 172.21.15.67:0/723172002 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fab4c056970 con 0x7fab5c0723c0 2024-09-19T05:39:36.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.220+0000 7fab61410640 1 -- 172.21.15.67:0/723172002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab5c159aa0 con 0x7fab5c0723c0 2024-09-19T05:39:36.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab437fe640 1 -- 172.21.15.67:0/723172002 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7fab4c056270 con 0x7fab5c0723c0 2024-09-19T05:39:36.222 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:36.222 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"btime":"2024-09-19T05:39:33:398633+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":5831,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/761363037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":761363037},{"type":"v1","addr":"172.21.15.97:6837","nonce":761363037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:33.398620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/1158789793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1158789793},{"type":"v1","addr":"172.21.15.67:6835","nonce":1158789793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7464,"qdb_cluster":[7464]},"id":6}]} 2024-09-19T05:39:36.222 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 75 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 -- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab480678c0 msgr2=0x7fab48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab480678c0 0x7fab48069d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab500b1000 tx=0x7fab50004740 comp rx=0 tx=0).stop 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 -- 172.21.15.67:0/723172002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0723c0 msgr2=0x7fab5c15a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0723c0 0x7fab5c15a3b0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c7f0 tx=0x7fab4c00ccb0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 -- 172.21.15.67:0/723172002 shutdown_connections 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab5c15b1e0 0x7fab5c14cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab480678c0 0x7fab48069d80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab5c0b4900 0x7fab5c099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 --2- 172.21.15.67:0/723172002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0723c0 0x7fab5c15a3b0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 -- 172.21.15.67:0/723172002 >> 172.21.15.67:0/723172002 conn(0x7fab5c0d0080 msgr2=0x7fab5c0d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 -- 172.21.15.67:0/723172002 shutdown_connections 2024-09-19T05:39:36.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.224+0000 7fab61410640 1 -- 172.21.15.67:0/723172002 wait complete. 2024-09-19T05:39:36.241 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-19T05:39:36.373 INFO:teuthology.orchestra.run.smithi067.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-19T05:39:21.416246+0000","btime":"2024-09-19T05:39:20.548130+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-19T05:39:21.416246+0000","atime":"2024-09-19T05:39:20.548130+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-19T05:39:21.416246+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:39:21.418226+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:39:21.418226+0000"},"version":86,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-19T05:39:36.374 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-19T05:39:21.418226+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-19T05:39:20.548130+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-19T05:39:20.548130+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-19T05:39:21.416246+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-19T05:39:21.416246+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-19T05:39:21.416246+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-19T05:39:21.418226+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 86, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-19T05:39:36.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:36.374 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /testdir recursive 2024-09-19T05:39:36.377 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-09-19T05:39:36.376+0000 7f3f602b5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:39:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f50188f3640 1 Processor -- start 2024-09-19T05:39:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f50188f3640 1 -- start start 2024-09-19T05:39:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f50188f3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50140d0aa0 0x7f501406e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f50188f3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f501406eb40 0x7f501415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f50188f3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501415d030 con 0x7f50140cf5e0 2024-09-19T05:39:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f50188f3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f501406de90 con 0x7f50140d0aa0 2024-09-19T05:39:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f50188f3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f501406e170 con 0x7f501406eb40 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f501259c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f50140cf5e0 0x7f501415c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35888/0 (socket says 172.21.15.67:35888) 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f501259c640 1 -- 172.21.15.67:0/306640092 learned_addr learned my addr 172.21.15.67:0/306640092 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f5011d9b640 1 --2- 172.21.15.67:0/306640092 >> v2:172.21.15.67:3300/0 conn(0x7f50140d0aa0 0x7f501406e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f501159a640 1 -- 172.21.15.67:0/306640092 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361824325 0 0) 0x7f501415d030 con 0x7f50140cf5e0 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f501159a640 1 -- 172.21.15.67:0/306640092 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ffc003530 con 0x7f50140cf5e0 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f5011d9b640 1 -- 172.21.15.67:0/306640092 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f501406eb40 msgr2=0x7f501415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f5012d9d640 1 --2- 172.21.15.67:0/306640092 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f501406eb40 0x7f501415d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f5011d9b640 1 --2- 172.21.15.67:0/306640092 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f501406eb40 0x7f501415d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f5011d9b640 1 -- 172.21.15.67:0/306640092 >> v1:172.21.15.67:6789/0 conn(0x7f50140cf5e0 legacy=0x7f501415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f5011d9b640 1 -- 172.21.15.67:0/306640092 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501415d310 con 0x7f50140d0aa0 2024-09-19T05:39:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.500+0000 7f5012d9d640 1 --2- 172.21.15.67:0/306640092 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f501406eb40 0x7f501415d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:36.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f5011d9b640 1 --2- 172.21.15.67:0/306640092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 0x7f501406e600 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f50080097c0 tx=0x7f500801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70eea3b2c2c2ef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f501159a640 1 -- 172.21.15.67:0/306640092 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080b0070 con 0x7f50140d0aa0 2024-09-19T05:39:36.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f501159a640 1 -- 172.21.15.67:0/306640092 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50080ab600 con 0x7f50140d0aa0 2024-09-19T05:39:36.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f501159a640 1 -- 172.21.15.67:0/306640092 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080ab9d0 con 0x7f50140d0aa0 2024-09-19T05:39:36.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f50188f3640 1 -- 172.21.15.67:0/306640092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 msgr2=0x7f501406e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f50188f3640 1 --2- 172.21.15.67:0/306640092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 0x7f501406e600 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f50080097c0 tx=0x7f500801c410 comp rx=0 tx=0).stop 2024-09-19T05:39:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f50188f3640 1 -- 172.21.15.67:0/306640092 shutdown_connections 2024-09-19T05:39:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f50188f3640 1 --2- 172.21.15.67:0/306640092 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f501406eb40 0x7f501415d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f50188f3640 1 --2- 172.21.15.67:0/306640092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 0x7f501406e600 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f50188f3640 1 -- 172.21.15.67:0/306640092 >> 172.21.15.67:0/306640092 conn(0x7f501406c0c0 msgr2=0x7f501406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f50188f3640 1 -- 172.21.15.67:0/306640092 shutdown_connections 2024-09-19T05:39:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f50188f3640 1 -- 172.21.15.67:0/306640092 wait complete. 2024-09-19T05:39:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.504+0000 7f50188f3640 1 Processor -- start 2024-09-19T05:39:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f50188f3640 1 -- start start 2024-09-19T05:39:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f50188f3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f501406eb40 0x7f5014153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f50188f3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50140cf5e0 0x7f501414ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f50188f3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 0x7f50140b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f50188f3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5014169340 con 0x7f50140d0aa0 2024-09-19T05:39:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f50188f3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f50141691c0 con 0x7f501406eb40 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f50188f3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f50141694c0 con 0x7f50140cf5e0 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5012d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 0x7f50140b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5012d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 0x7f50140b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46970/0 (socket says 172.21.15.67:46970) 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5012d9d640 1 -- 172.21.15.67:0/3678911656 learned_addr learned my addr 172.21.15.67:0/3678911656 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5012d9d640 1 -- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50140cf5e0 msgr2=0x7f501414ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5012d9d640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50140cf5e0 0x7f501414ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5012d9d640 1 -- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f501406eb40 msgr2=0x7f5014153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5012d9d640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f501406eb40 0x7f5014153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5012d9d640 1 -- 172.21.15.67:0/3678911656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501414be00 con 0x7f50140d0aa0 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5012d9d640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 0x7f50140b0c70 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f500c00cd50 tx=0x7f500c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5002ffd640 1 -- 172.21.15.67:0/3678911656 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c00f680 con 0x7f50140d0aa0 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5002ffd640 1 -- 172.21.15.67:0/3678911656 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500c00f840 con 0x7f50140d0aa0 2024-09-19T05:39:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5002ffd640 1 -- 172.21.15.67:0/3678911656 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c00fc30 con 0x7f50140d0aa0 2024-09-19T05:39:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f50188f3640 1 -- 172.21.15.67:0/3678911656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501414c0e0 con 0x7f50140d0aa0 2024-09-19T05:39:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f50188f3640 1 -- 172.21.15.67:0/3678911656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501414cb40 con 0x7f50140d0aa0 2024-09-19T05:39:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5002ffd640 1 -- 172.21.15.67:0/3678911656 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f500c00e3e0 con 0x7f50140d0aa0 2024-09-19T05:39:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5002ffd640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ff40678c0 0x7f4ff4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.508+0000 7f5002ffd640 1 -- 172.21.15.67:0/3678911656 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7f500c086c90 con 0x7f50140d0aa0 2024-09-19T05:39:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501259c640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ff40678c0 0x7f4ff4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 Processor -- start 2024-09-19T05:39:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 -- start start 2024-09-19T05:39:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501259c640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ff40678c0 0x7f4ff4069d80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5004007fd0 tx=0x7f5004007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de6a90 0x55a602de6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602d9ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602d9d410 0x55a602d9d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a602be6b20 con 0x55a602de73b0 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a602ba1870 con 0x55a602de6a90 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a602be2ae0 con 0x55a602d9d410 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f5011d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602d9ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f5011d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602d9ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46972/0 (socket says 172.21.15.67:46972) 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f5011d9b640 1 -- 172.21.15.67:0/484501288 learned_addr learned my addr 172.21.15.67:0/484501288 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501259c640 1 --2- 172.21.15.67:0/484501288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de6a90 0x55a602de6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f5012d9d640 1 --2- 172.21.15.67:0/484501288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602d9d410 0x55a602d9d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f5011d9b640 1 -- 172.21.15.67:0/484501288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602d9d410 msgr2=0x55a602d9d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f5011d9b640 1 --2- 172.21.15.67:0/484501288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602d9d410 0x55a602d9d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f5011d9b640 1 -- 172.21.15.67:0/484501288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de6a90 msgr2=0x55a602de6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f5011d9b640 1 --2- 172.21.15.67:0/484501288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de6a90 0x55a602de6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f5011d9b640 1 -- 172.21.15.67:0/484501288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a602bb9940 con 0x55a602de73b0 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501259c640 1 --2- 172.21.15.67:0/484501288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de6a90 0x55a602de6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f5011d9b640 1 --2- 172.21.15.67:0/484501288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602d9ced0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f500801aac0 tx=0x7f50080046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80e4d7705c91362 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f4ff3fff640 1 -- 172.21.15.67:0/484501288 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080ba070 con 0x55a602de73b0 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f4ff3fff640 1 -- 172.21.15.67:0/484501288 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50080ab720 con 0x55a602de73b0 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f4ff3fff640 1 -- 172.21.15.67:0/484501288 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080b0040 con 0x55a602de73b0 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 -- 172.21.15.67:0/484501288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 msgr2=0x55a602d9ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 --2- 172.21.15.67:0/484501288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602d9ced0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f500801aac0 tx=0x7f50080046d0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 -- 172.21.15.67:0/484501288 shutdown_connections 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 --2- 172.21.15.67:0/484501288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602d9d410 0x55a602d9d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 --2- 172.21.15.67:0/484501288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602d9ced0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 --2- 172.21.15.67:0/484501288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de6a90 0x55a602de6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 -- 172.21.15.67:0/484501288 >> 172.21.15.67:0/484501288 conn(0x55a602d9f160 msgr2=0x55a602d973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 -- 172.21.15.67:0/484501288 shutdown_connections 2024-09-19T05:39:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 -- 172.21.15.67:0/484501288 wait complete. 2024-09-19T05:39:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 -- start start 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.512+0000 7f501b9af000 1 Processor -- start 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602d9d410 0x55a602dd0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de6a90 0x55a602dd1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de73b0 0x55a602dd18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a602bb38e0 con 0x55a602de6a90 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a602b8a9b0 con 0x55a602de73b0 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a602bae260 con 0x55a602d9d410 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 10 client.0 _ll_register_callbacks cb 0x55a602d84540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5011d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de6a90 0x55a602dd1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5011d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de6a90 0x55a602dd1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46974/0 (socket says 172.21.15.67:46974) 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5011d9b640 1 -- 172.21.15.67:0/4110629734 learned_addr learned my addr 172.21.15.67:0/4110629734 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501259c640 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602d9d410 0x55a602dd0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5012d9d640 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de73b0 0x55a602dd18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5011d9b640 1 -- 172.21.15.67:0/4110629734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602d9d410 msgr2=0x55a602dd0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5011d9b640 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602d9d410 0x55a602dd0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5011d9b640 1 -- 172.21.15.67:0/4110629734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de73b0 msgr2=0x55a602dd18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5011d9b640 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de73b0 0x55a602dd18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5011d9b640 1 -- 172.21.15.67:0/4110629734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a602ba1ac0 con 0x55a602de6a90 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5012d9d640 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de73b0 0x55a602dd18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f5011d9b640 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de6a90 0x55a602dd1390 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f500801aac0 tx=0x7f500801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6656424bb8dd7d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f4ff17fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f4ff17fa640 1 -- 172.21.15.67:0/4110629734 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080ba070 con 0x55a602de6a90 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f4ff17fa640 1 -- 172.21.15.67:0/4110629734 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7f50080abad0 con 0x55a602de6a90 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- 172.21.15.67:0/4110629734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50080ab720 con 0x55a602de6a90 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f4ff17fa640 1 -- 172.21.15.67:0/4110629734 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f50080cd050 con 0x55a602de6a90 2024-09-19T05:39:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 10 client.7554 fetch_fsmap learned FSMap version 75 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- 172.21.15.67:0/4110629734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x55a602b86810 con 0x55a602de6a90 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f4ff17fa640 1 -- 172.21.15.67:0/4110629734 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50080ab720 con 0x55a602de6a90 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f4ff17fa640 1 -- 172.21.15.67:0/4110629734 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f50080d0020 con 0x55a602de6a90 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 10 client.7554 fetch_fsmap finished waiting for FSMap version 75 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 10 client.7554 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 20 client.7554 populate_metadata read hostname 'smithi067' 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55a602dd22e0 0x55a602df7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 4 client.7554 mds_command: new command op to 7464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- 172.21.15.67:0/4110629734 --> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a602b80e30 con 0x55a602dd22e0 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501259c640 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55a602dd22e0 0x55a602df7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f4ff17fa640 10 client.7554 ms_handle_connect on v2:172.21.15.67:6834/1158789793 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501259c640 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55a602dd22e0 0x55a602df7b30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f910f50dac74fa2 server_cookie=835b846b4d395a36 in_seq=0 out_seq=0 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f4ff17fa640 1 -- 172.21.15.67:0/4110629734 <== mds.0 v2:172.21.15.67:6834/1158789793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a602b80e30 con 0x55a602dd22e0 2024-09-19T05:39:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f4ff17fa640 10 client.7554 handle_command_reply: tid=0 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 client.7554 shutdown 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- 172.21.15.67:0/4110629734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de6a90 msgr2=0x55a602dd1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de6a90 0x55a602dd1390 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f500801aac0 tx=0x7f500801ac50 comp rx=0 tx=0).stop 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- 172.21.15.67:0/4110629734 shutdown_connections 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55a602dd22e0 0x55a602df7b30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de73b0 0x55a602dd18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de6a90 0x55a602dd1390 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 --2- 172.21.15.67:0/4110629734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602d9d410 0x55a602dd0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- 172.21.15.67:0/4110629734 >> 172.21.15.67:0/4110629734 conn(0x55a602d9f160 msgr2=0x55a602d9e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f4ff17fa640 0 client.7554 ms_handle_reset on v2:172.21.15.67:6834/1158789793 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- 172.21.15.67:0/4110629734 shutdown_connections 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 1 -- 172.21.15.67:0/4110629734 wait complete. 2024-09-19T05:39:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.516+0000 7f501b9af000 20 client.7554 trim_cache size 0 max 16384 2024-09-19T05:39:36.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 Processor -- start 2024-09-19T05:39:36.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 -- start start 2024-09-19T05:39:36.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602d9d410 0x55a602e55630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602de6a90 0x55a602e55b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602e560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f50141fffb0 con 0x55a602de73b0 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f50140b4e90 con 0x55a602d9d410 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5014156320 con 0x55a602de6a90 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f5012d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602e560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f5012d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602e560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46980/0 (socket says 172.21.15.67:46980) 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f5012d9d640 1 -- 172.21.15.67:0/2779523472 learned_addr learned my addr 172.21.15.67:0/2779523472 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f5012d9d640 1 -- 172.21.15.67:0/2779523472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602de6a90 msgr2=0x55a602e55b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f5012d9d640 1 --2- 172.21.15.67:0/2779523472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602de6a90 0x55a602e55b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f5012d9d640 1 -- 172.21.15.67:0/2779523472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602d9d410 msgr2=0x55a602e55630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f5012d9d640 1 --2- 172.21.15.67:0/2779523472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602d9d410 0x55a602e55630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f5012d9d640 1 -- 172.21.15.67:0/2779523472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a602de71e0 con 0x55a602de73b0 2024-09-19T05:39:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f5012d9d640 1 --2- 172.21.15.67:0/2779523472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602e560b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f500c05f540 tx=0x7f500c056f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418eb398f9283d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f4ff37fe640 1 -- 172.21.15.67:0/2779523472 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c083070 con 0x55a602de73b0 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f4ff37fe640 1 -- 172.21.15.67:0/2779523472 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500c00fdd0 con 0x55a602de73b0 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f4ff37fe640 1 -- 172.21.15.67:0/2779523472 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c01d030 con 0x55a602de73b0 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 -- 172.21.15.67:0/2779523472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 msgr2=0x55a602e560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 --2- 172.21.15.67:0/2779523472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602e560b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f500c05f540 tx=0x7f500c056f50 comp rx=0 tx=0).stop 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 -- 172.21.15.67:0/2779523472 shutdown_connections 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 --2- 172.21.15.67:0/2779523472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602de73b0 0x55a602e560b0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 --2- 172.21.15.67:0/2779523472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602de6a90 0x55a602e55b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 --2- 172.21.15.67:0/2779523472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602d9d410 0x55a602e55630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 -- 172.21.15.67:0/2779523472 >> 172.21.15.67:0/2779523472 conn(0x55a602d9f160 msgr2=0x55a602d9da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 -- 172.21.15.67:0/2779523472 shutdown_connections 2024-09-19T05:39:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 -- 172.21.15.67:0/2779523472 wait complete. 2024-09-19T05:39:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 -- start start 2024-09-19T05:39:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.536+0000 7f501b9af000 1 Processor -- start 2024-09-19T05:39:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602d9d410 0x55a602dfa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de6a90 0x55a602e15e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602de73b0 0x55a602e16360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a602bb3520 con 0x55a602d9d410 2024-09-19T05:39:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f50140b4840 con 0x55a602de6a90 2024-09-19T05:39:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a602beb150 con 0x55a602de73b0 2024-09-19T05:39:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 10 client.0 _ll_register_callbacks cb 0x7f4ffc003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602d9d410 0x55a602dfa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602d9d410 0x55a602dfa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46992/0 (socket says 172.21.15.67:46992) 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501259c640 1 -- 172.21.15.67:0/2834635814 learned_addr learned my addr 172.21.15.67:0/2834635814 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501259c640 1 -- 172.21.15.67:0/2834635814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602de73b0 msgr2=0x55a602e16360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501259c640 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602de73b0 0x55a602e16360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501259c640 1 -- 172.21.15.67:0/2834635814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de6a90 msgr2=0x55a602e15e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501259c640 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de6a90 0x55a602e15e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501259c640 1 -- 172.21.15.67:0/2834635814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a602ba4240 con 0x55a602d9d410 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501259c640 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602d9d410 0x55a602dfa4b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f5004005c20 tx=0x7f5004000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4d35e09ae739f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f4ff17fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f4ff17fa640 1 -- 172.21.15.67:0/2834635814 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5004007750 con 0x55a602d9d410 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f4ff17fa640 1 -- 172.21.15.67:0/2834635814 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7f5004028b80 con 0x55a602d9d410 2024-09-19T05:39:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- 172.21.15.67:0/2834635814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f500c00fdd0 con 0x55a602d9d410 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f4ff17fa640 1 -- 172.21.15.67:0/2834635814 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f5004031070 con 0x55a602d9d410 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 10 client.7560 fetch_fsmap learned FSMap version 75 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- 172.21.15.67:0/2834635814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x55a602c69330 con 0x55a602d9d410 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f4ff17fa640 1 -- 172.21.15.67:0/2834635814 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500c00fdd0 con 0x55a602d9d410 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f4ff17fa640 1 -- 172.21.15.67:0/2834635814 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f500402a030 con 0x55a602d9d410 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 10 client.7560 fetch_fsmap finished waiting for FSMap version 75 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 10 client.7560 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 20 client.7560 populate_metadata read hostname 'smithi067' 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55a602e168a0 0x55a602e59460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 4 client.7560 mds_command: new command op to 7464 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- 172.21.15.67:0/2834635814 --> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x55a602bf4250 con 0x55a602e168a0 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f5011d9b640 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55a602e168a0 0x55a602e59460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f5011d9b640 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55a602e168a0 0x55a602e59460 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40a700902591228a server_cookie=53cc2134ae00d33a in_seq=0 out_seq=0 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f4ff17fa640 10 client.7560 ms_handle_connect on v2:172.21.15.67:6834/1158789793 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f4ff17fa640 1 -- 172.21.15.67:0/2834635814 <== mds.0 v2:172.21.15.67:6834/1158789793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a602bf4250 con 0x55a602e168a0 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f4ff17fa640 10 client.7560 handle_command_reply: tid=0 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 client.7560 shutdown 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- 172.21.15.67:0/2834635814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602d9d410 msgr2=0x55a602dfa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602d9d410 0x55a602dfa4b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f5004005c20 tx=0x7f5004000ee0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- 172.21.15.67:0/2834635814 shutdown_connections 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.67:6834/1158789793,v1:172.21.15.67:6835/1158789793] conn(0x55a602e168a0 0x55a602e59460 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a602de73b0 0x55a602e16360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a602de6a90 0x55a602e15e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 --2- 172.21.15.67:0/2834635814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a602d9d410 0x55a602dfa4b0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f4ff17fa640 0 client.7560 ms_handle_reset on v2:172.21.15.67:6834/1158789793 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- 172.21.15.67:0/2834635814 >> 172.21.15.67:0/2834635814 conn(0x55a602d9f160 msgr2=0x55a602d9e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- 172.21.15.67:0/2834635814 shutdown_connections 2024-09-19T05:39:36.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 1 -- 172.21.15.67:0/2834635814 wait complete. 2024-09-19T05:39:36.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f501b9af000 20 client.7560 trim_cache size 0 max 16384 2024-09-19T05:39:36.546 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:39:36.546 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:39:36.546 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "5d8f113b-0121-4e21-9466-b1560ef112fb", 2024-09-19T05:39:36.546 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:39:36.546 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:39:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 -- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ff40678c0 msgr2=0x7f4ff4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ff40678c0 0x7f4ff4069d80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5004007fd0 tx=0x7f5004007900 comp rx=0 tx=0).stop 2024-09-19T05:39:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 -- 172.21.15.67:0/3678911656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 msgr2=0x7f50140b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 0x7f50140b0c70 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f500c00cd50 tx=0x7f500c00a650 comp rx=0 tx=0).stop 2024-09-19T05:39:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 -- 172.21.15.67:0/3678911656 shutdown_connections 2024-09-19T05:39:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50140d0aa0 0x7f50140b0c70 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ff40678c0 0x7f4ff4069d80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f50140cf5e0 0x7f501414ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 --2- 172.21.15.67:0/3678911656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f501406eb40 0x7f5014153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 -- 172.21.15.67:0/3678911656 >> 172.21.15.67:0/3678911656 conn(0x7f501406c0c0 msgr2=0x7f501406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 -- 172.21.15.67:0/3678911656 shutdown_connections 2024-09-19T05:39:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.540+0000 7f50188f3640 1 -- 172.21.15.67:0/3678911656 wait complete. 2024-09-19T05:39:36.558 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff213936640 1 Processor -- start 2024-09-19T05:39:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff213936640 1 -- start start 2024-09-19T05:39:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff213936640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff20c161da0 0x7ff20c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff213936640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c0d0160 0x7ff20c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff213936640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff20c0d05d0 con 0x7ff20c0d0e80 2024-09-19T05:39:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff213936640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff20c0d1830 con 0x7ff20c161da0 2024-09-19T05:39:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff213936640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff20c0d0840 con 0x7ff20c0d0160 2024-09-19T05:39:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff2116d2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff20c161da0 0x7ff20c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff211ed3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c0d0160 0x7ff20c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff210ed1640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff20c0d0e80 0x7ff20c0b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:50402/0 (socket says 172.21.15.67:50402) 2024-09-19T05:39:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff210ed1640 1 -- 172.21.15.67:0/2011004629 learned_addr learned my addr 172.21.15.67:0/2011004629 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff211ed3640 1 -- 172.21.15.67:0/2011004629 >> v2:172.21.15.97:3300/0 conn(0x7ff20c161da0 msgr2=0x7ff20c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff211ed3640 1 --2- 172.21.15.67:0/2011004629 >> v2:172.21.15.97:3300/0 conn(0x7ff20c161da0 0x7ff20c0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff211ed3640 1 -- 172.21.15.67:0/2011004629 >> v1:172.21.15.97:6789/0 conn(0x7ff20c0d0e80 legacy=0x7ff20c0b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.716+0000 7ff211ed3640 1 -- 172.21.15.67:0/2011004629 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20c0d4d40 con 0x7ff20c0d0160 2024-09-19T05:39:36.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff211ed3640 1 --2- 172.21.15.67:0/2011004629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c0d0160 0x7ff20c0d12f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff204009d90 tx=0x7ff20401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6bed3d27991c195 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff203fff640 1 -- 172.21.15.67:0/2011004629 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2040b2070 con 0x7ff20c0d0160 2024-09-19T05:39:36.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff203fff640 1 -- 172.21.15.67:0/2011004629 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2040a5920 con 0x7ff20c0d0160 2024-09-19T05:39:36.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff203fff640 1 -- 172.21.15.67:0/2011004629 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2040a5cf0 con 0x7ff20c0d0160 2024-09-19T05:39:36.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 -- 172.21.15.67:0/2011004629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c0d0160 msgr2=0x7ff20c0d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 --2- 172.21.15.67:0/2011004629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c0d0160 0x7ff20c0d12f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff204009d90 tx=0x7ff20401c970 comp rx=0 tx=0).stop 2024-09-19T05:39:36.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 -- 172.21.15.67:0/2011004629 shutdown_connections 2024-09-19T05:39:36.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 --2- 172.21.15.67:0/2011004629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c0d0160 0x7ff20c0d12f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 --2- 172.21.15.67:0/2011004629 >> v2:172.21.15.97:3300/0 conn(0x7ff20c161da0 0x7ff20c0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 -- 172.21.15.67:0/2011004629 >> 172.21.15.67:0/2011004629 conn(0x7ff20c08bfc0 msgr2=0x7ff20c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 -- 172.21.15.67:0/2011004629 shutdown_connections 2024-09-19T05:39:36.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 -- 172.21.15.67:0/2011004629 wait complete. 2024-09-19T05:39:36.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 Processor -- start 2024-09-19T05:39:36.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 -- start start 2024-09-19T05:39:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff20c0d0160 0x7ff20c0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff20c0d0e80 0x7ff20c155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c161da0 0x7ff20c0b8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c162180 con 0x7ff20c0d0e80 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff20c0b5d00 con 0x7ff20c0d0160 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff213936640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff20c0b50e0 con 0x7ff20c161da0 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff210ed1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff20c0d0e80 0x7ff20c155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff210ed1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff20c0d0e80 0x7ff20c155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47006/0 (socket says 172.21.15.67:47006) 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff210ed1640 1 -- 172.21.15.67:0/2785647993 learned_addr learned my addr 172.21.15.67:0/2785647993 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.720+0000 7ff2116d2640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff20c0d0160 0x7ff20c0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff211ed3640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c161da0 0x7ff20c0b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff210ed1640 1 -- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c161da0 msgr2=0x7ff20c0b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff210ed1640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c161da0 0x7ff20c0b8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff210ed1640 1 -- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff20c0d0160 msgr2=0x7ff20c0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff210ed1640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff20c0d0160 0x7ff20c0cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff210ed1640 1 -- 172.21.15.67:0/2785647993 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20c0ccfb0 con 0x7ff20c0d0e80 2024-09-19T05:39:36.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff210ed1640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff20c0d0e80 0x7ff20c155220 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c420 tx=0x7ff20800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff201ffb640 1 -- 172.21.15.67:0/2785647993 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208017070 con 0x7ff20c0d0e80 2024-09-19T05:39:36.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff201ffb640 1 -- 172.21.15.67:0/2785647993 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff208005cf0 con 0x7ff20c0d0e80 2024-09-19T05:39:36.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff201ffb640 1 -- 172.21.15.67:0/2785647993 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2080072f0 con 0x7ff20c0d0e80 2024-09-19T05:39:36.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff213936640 1 -- 172.21.15.67:0/2785647993 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff20c155760 con 0x7ff20c0d0e80 2024-09-19T05:39:36.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff213936640 1 -- 172.21.15.67:0/2785647993 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff20c0cbcb0 con 0x7ff20c0d0e80 2024-09-19T05:39:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff213936640 1 -- 172.21.15.67:0/2785647993 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff20c0d12f0 con 0x7ff20c0d0e80 2024-09-19T05:39:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff201ffb640 1 -- 172.21.15.67:0/2785647993 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff20801a070 con 0x7ff20c0d0e80 2024-09-19T05:39:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff201ffb640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff1f00678c0 0x7ff1f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff201ffb640 1 -- 172.21.15.67:0/2785647993 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7ff208085210 con 0x7ff20c0d0e80 2024-09-19T05:39:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff2116d2640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff1f00678c0 0x7ff1f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.724+0000 7ff2116d2640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff1f00678c0 0x7ff1f0069d80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff20c156f70 tx=0x7ff1fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:36.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.728+0000 7ff201ffb640 1 -- 172.21.15.67:0/2785647993 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff208055ba0 con 0x7ff20c0d0e80 2024-09-19T05:39:36.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.920+0000 7ff213936640 1 -- 172.21.15.67:0/2785647993 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff20c06bd70 con 0x7ff20c0d0e80 2024-09-19T05:39:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.920+0000 7ff201ffb640 1 -- 172.21.15.67:0/2785647993 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7ff2080554a0 con 0x7ff20c0d0e80 2024-09-19T05:39:36.920 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:36.920 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"btime":"2024-09-19T05:39:33:398633+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":5831,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/761363037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":761363037},{"type":"v1","addr":"172.21.15.97:6837","nonce":761363037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:33.398620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/1158789793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1158789793},{"type":"v1","addr":"172.21.15.67:6835","nonce":1158789793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7464,"qdb_cluster":[7464]},"id":6}]} 2024-09-19T05:39:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 75 2024-09-19T05:39:36.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 -- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff1f00678c0 msgr2=0x7ff1f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff1f00678c0 0x7ff1f0069d80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff20c156f70 tx=0x7ff1fc008040 comp rx=0 tx=0).stop 2024-09-19T05:39:36.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 -- 172.21.15.67:0/2785647993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff20c0d0e80 msgr2=0x7ff20c155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff20c0d0e80 0x7ff20c155220 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c420 tx=0x7ff20800c8e0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 -- 172.21.15.67:0/2785647993 shutdown_connections 2024-09-19T05:39:36.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff1f00678c0 0x7ff1f0069d80 secure :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff20c156f70 tx=0x7ff1fc008040 comp rx=0 tx=0).stop 2024-09-19T05:39:36.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff20c161da0 0x7ff20c0b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff20c0d0e80 0x7ff20c155220 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 --2- 172.21.15.67:0/2785647993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff20c0d0160 0x7ff20c0cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 -- 172.21.15.67:0/2785647993 >> 172.21.15.67:0/2785647993 conn(0x7ff20c08bfc0 msgr2=0x7ff20c15bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 -- 172.21.15.67:0/2785647993 shutdown_connections 2024-09-19T05:39:36.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:36.924+0000 7ff213936640 1 -- 172.21.15.67:0/2785647993 wait complete. 2024-09-19T05:39:36.939 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-19T05:39:37.071 INFO:teuthology.orchestra.run.smithi067.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-19T05:39:21.416246+0000","btime":"2024-09-19T05:39:20.548130+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-19T05:39:21.416246+0000","atime":"2024-09-19T05:39:20.548130+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-19T05:39:21.416246+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:39:21.418226+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:39:21.418226+0000"},"version":86,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":1,"authpin":0,"scrubqueue":0},"nref":1,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-19T05:39:37.072 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-19T05:39:21.418226+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-19T05:39:20.548130+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-19T05:39:20.548130+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-19T05:39:21.416246+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-19T05:39:21.416246+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-19T05:39:21.416246+0000", "nestlock": {}, "nlink": 1, "nref": 1, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-19T05:39:21.418226+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 86, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-19T05:39:37.072 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-19T05:39:39.304 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:39:39.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:39:42.074 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:42.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac21801640 1 Processor -- start 2024-09-19T05:39:42.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac21801640 1 -- start start 2024-09-19T05:39:42.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac21801640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac1c15c200 0x7fac1c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:42.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac21801640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c0b3070 con 0x7fac1c15b710 2024-09-19T05:39:42.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac21801640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c0afa70 con 0x7fac1c0aef40 2024-09-19T05:39:42.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac21801640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fac1c0b32e0 con 0x7fac1c15c200 2024-09-19T05:39:42.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac1a7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac1c15c200 0x7fac1c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:42.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac1a7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac1c15c200 0x7fac1c071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47014/0 (socket says 172.21.15.67:47014) 2024-09-19T05:39:42.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac1a7fc640 1 -- 172.21.15.67:0/3025844758 learned_addr learned my addr 172.21.15.67:0/3025844758 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:42.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac1affd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fac1c15b710 0x7fac1c15baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35900/0 (socket says 172.21.15.67:35900) 2024-09-19T05:39:42.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac1a7fc640 1 -- 172.21.15.67:0/3025844758 >> v1:172.21.15.97:6789/0 conn(0x7fac1c0aef40 legacy=0x7fac1c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:42.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac1a7fc640 1 -- 172.21.15.67:0/3025844758 >> v1:172.21.15.67:6789/0 conn(0x7fac1c15b710 legacy=0x7fac1c15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:42.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.212+0000 7fac1a7fc640 1 -- 172.21.15.67:0/3025844758 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c0b35c0 con 0x7fac1c15c200 2024-09-19T05:39:42.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1a7fc640 1 --2- 172.21.15.67:0/3025844758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c15c200 0x7fac1c071e80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fac10009870 tx=0x7fac1001e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102e200f47bd853b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:42.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac19ffb640 1 -- 172.21.15.67:0/3025844758 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac100a86d0 con 0x7fac1c15c200 2024-09-19T05:39:42.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac19ffb640 1 -- 172.21.15.67:0/3025844758 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac100a8870 con 0x7fac1c15c200 2024-09-19T05:39:42.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac19ffb640 1 -- 172.21.15.67:0/3025844758 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac100a8c40 con 0x7fac1c15c200 2024-09-19T05:39:42.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 -- 172.21.15.67:0/3025844758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c15c200 msgr2=0x7fac1c071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:42.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 --2- 172.21.15.67:0/3025844758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c15c200 0x7fac1c071e80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fac10009870 tx=0x7fac1001e700 comp rx=0 tx=0).stop 2024-09-19T05:39:42.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 -- 172.21.15.67:0/3025844758 shutdown_connections 2024-09-19T05:39:42.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 --2- 172.21.15.67:0/3025844758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c15c200 0x7fac1c071e80 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:42.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 -- 172.21.15.67:0/3025844758 >> 172.21.15.67:0/3025844758 conn(0x7fac1c0d0080 msgr2=0x7fac1c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:42.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 -- 172.21.15.67:0/3025844758 shutdown_connections 2024-09-19T05:39:42.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 -- 172.21.15.67:0/3025844758 wait complete. 2024-09-19T05:39:42.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 Processor -- start 2024-09-19T05:39:42.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 -- start start 2024-09-19T05:39:42.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c15b710 0x7fac1c144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15c200 0x7fac1c153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c0b4c40 con 0x7fac1c0aef40 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c0b4ac0 con 0x7fac1c15c200 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac21801640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fac1c0b4dc0 con 0x7fac1c15b710 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47022/0 (socket says 172.21.15.67:47022) 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1affd640 1 -- 172.21.15.67:0/2129240971 learned_addr learned my addr 172.21.15.67:0/2129240971 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1b7fe640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15c200 0x7fac1c153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1a7fc640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c15b710 0x7fac1c144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1affd640 1 -- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c15b710 msgr2=0x7fac1c144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1affd640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c15b710 0x7fac1c144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:42.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1affd640 1 -- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15c200 msgr2=0x7fac1c153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1affd640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15c200 0x7fac1c153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1affd640 1 -- 172.21.15.67:0/2129240971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c144db0 con 0x7fac1c0aef40 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1a7fc640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c15b710 0x7fac1c144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.216+0000 7fac1b7fe640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15c200 0x7fac1c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac1affd640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c152ca0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c450 tx=0x7fac0c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac037fe640 1 -- 172.21.15.67:0/2129240971 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c018070 con 0x7fac1c0aef40 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac037fe640 1 -- 172.21.15.67:0/2129240971 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0c007480 con 0x7fac1c0aef40 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac21801640 1 -- 172.21.15.67:0/2129240971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1c15e970 con 0x7fac1c0aef40 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac037fe640 1 -- 172.21.15.67:0/2129240971 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0047f0 con 0x7fac1c0aef40 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac21801640 1 -- 172.21.15.67:0/2129240971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1c15dbb0 con 0x7fac1c0aef40 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac21801640 1 -- 172.21.15.67:0/2129240971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac1c071e80 con 0x7fac1c0aef40 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac037fe640 1 -- 172.21.15.67:0/2129240971 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac0c01b070 con 0x7fac1c0aef40 2024-09-19T05:39:42.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac037fe640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac080678c0 0x7fac08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:42.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac037fe640 1 -- 172.21.15.67:0/2129240971 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7fac0c085480 con 0x7fac1c0aef40 2024-09-19T05:39:42.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac1a7fc640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac080678c0 0x7fac08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:42.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.220+0000 7fac1a7fc640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac080678c0 0x7fac08069d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fac100b1000 tx=0x7fac10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:42.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.224+0000 7fac037fe640 1 -- 172.21.15.67:0/2129240971 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fac1c144db0 con 0x7fac1c0aef40 2024-09-19T05:39:42.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.424+0000 7fac21801640 1 -- 172.21.15.67:0/2129240971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac1c0b5020 con 0x7fac1c0aef40 2024-09-19T05:39:42.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.424+0000 7fac037fe640 1 -- 172.21.15.67:0/2129240971 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7fac0c055dd0 con 0x7fac1c0aef40 2024-09-19T05:39:42.425 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:42.425 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"btime":"2024-09-19T05:39:33:398633+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":5831,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/761363037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":761363037},{"type":"v1","addr":"172.21.15.97:6837","nonce":761363037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:33.398620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/1158789793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1158789793},{"type":"v1","addr":"172.21.15.67:6835","nonce":1158789793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7464,"qdb_cluster":[7464]},"id":6}]} 2024-09-19T05:39:42.425 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 75 2024-09-19T05:39:42.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 -- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac080678c0 msgr2=0x7fac08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:42.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac080678c0 0x7fac08069d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fac100b1000 tx=0x7fac10008040 comp rx=0 tx=0).stop 2024-09-19T05:39:42.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 -- 172.21.15.67:0/2129240971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 msgr2=0x7fac1c152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:42.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c152ca0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c450 tx=0x7fac0c00c910 comp rx=0 tx=0).stop 2024-09-19T05:39:42.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 -- 172.21.15.67:0/2129240971 shutdown_connections 2024-09-19T05:39:42.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15c200 0x7fac1c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:42.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac080678c0 0x7fac08069d80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:42.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c15b710 0x7fac1c144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:42.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 --2- 172.21.15.67:0/2129240971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c152ca0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:42.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 -- 172.21.15.67:0/2129240971 >> 172.21.15.67:0/2129240971 conn(0x7fac1c0d0080 msgr2=0x7fac1c0ade30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:42.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 -- 172.21.15.67:0/2129240971 shutdown_connections 2024-09-19T05:39:42.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:42.428+0000 7fac21801640 1 -- 172.21.15.67:0/2129240971 wait complete. 2024-09-19T05:39:42.442 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-19T05:39:42.581 INFO:teuthology.orchestra.run.smithi067.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-19T05:39:21.416246+0000","btime":"2024-09-19T05:39:20.548130+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-19T05:39:21.416246+0000","atime":"2024-09-19T05:39:20.548130+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-19T05:39:21.416246+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:39:21.418226+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-19T05:39:21.418226+0000"},"version":90,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-19T05:39:36.543841+0000","last_scrub_version":86,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-19T05:39:42.582 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-19T05:39:21.418226+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-19T05:39:20.548130+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-19T05:39:20.548130+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-19T05:39:21.416246+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-19T05:39:21.416246+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-19T05:39:36.543841+0000", "last_scrub_version": 86, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-19T05:39:21.416246+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-19T05:39:21.418226+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 90, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-19T05:39:42.582 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-19T05:39:42.583 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:39:42.583 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:39:42.659 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:39:42.707 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:39:42.707 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:39:42.708 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:39:42.708 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:42.714 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:39:42.714 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:39:42.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:42.714 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:39:42.762 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T05:39:42.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:39:42.764 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:39:42.764 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:39:42.764 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:42.770 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:39:42.770 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:39:42.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:42.771 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:39:42.818 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:39:42.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:39:42.819 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:39:42.820 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:39:42.820 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:42.826 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:39:42.826 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:39:42.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:42.827 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:39:42.874 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:39:42.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:39:42.875 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:39:42.876 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:39:42.876 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:42.882 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:39:42.882 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:39:42.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:39:42.882 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:39:42.934 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:39:42.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:39:42.935 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:43.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675b3df640 1 Processor -- start 2024-09-19T05:39:43.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675b3df640 1 -- start start 2024-09-19T05:39:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675b3df640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f675415a920 0x7f6754072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675b3df640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67540730e0 con 0x7f67540af730 2024-09-19T05:39:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675b3df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67540733c0 con 0x7f675406ed80 2024-09-19T05:39:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675b3df640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f67540ad8c0 con 0x7f675415a920 2024-09-19T05:39:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675897a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f67540af730 0x7f675406e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35908/0 (socket says 172.21.15.67:35908) 2024-09-19T05:39:43.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675897a640 1 -- 172.21.15.67:0/609536007 learned_addr learned my addr 172.21.15.67:0/609536007 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675917b640 1 --2- 172.21.15.67:0/609536007 >> v2:172.21.15.97:3300/0 conn(0x7f675415a920 0x7f6754072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726617843 0 0) 0x7f67540730e0 con 0x7f67540af730 2024-09-19T05:39:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6740003510 con 0x7f67540af730 2024-09-19T05:39:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854783145 0 0) 0x7f67540733c0 con 0x7f675406ed80 2024-09-19T05:39:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67540730e0 con 0x7f675406ed80 2024-09-19T05:39:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 622978428 0 0) 0x7f6740003510 con 0x7f67540af730 2024-09-19T05:39:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 >> v2:172.21.15.97:3300/0 conn(0x7f675415a920 msgr2=0x7f6754072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 --2- 172.21.15.67:0/609536007 >> v2:172.21.15.97:3300/0 conn(0x7f675415a920 0x7f6754072840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 >> v1:172.21.15.97:6789/0 conn(0x7f675406ed80 legacy=0x7f67540ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67540adba0 con 0x7f67540af730 2024-09-19T05:39:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6744001680 con 0x7f67540af730 2024-09-19T05:39:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 >> v1:172.21.15.67:6789/0 conn(0x7f67540af730 legacy=0x7f675406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6740003d00 0x7f6740006570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6740006ab0 0x7f6740008ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400093e0 0x7f674000b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67540ad8c0 con 0x7f67400093e0 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f674000c040 con 0x7f6740006ab0 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f674000c240 con 0x7f6740003d00 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675997c640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400093e0 0x7f674000b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675897a640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6740006ab0 0x7f6740008ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675917b640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6740003d00 0x7f6740006570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675997c640 1 -- 172.21.15.67:0/609536007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6740003d00 msgr2=0x7f6740006570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675997c640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6740003d00 0x7f6740006570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675997c640 1 -- 172.21.15.67:0/609536007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6740006ab0 msgr2=0x7f6740008ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675997c640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6740006ab0 0x7f6740008ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.072+0000 7f675997c640 1 -- 172.21.15.67:0/609536007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6740003510 con 0x7f67400093e0 2024-09-19T05:39:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675997c640 1 -- 172.21.15.67:0/609536007 reap_dead start 2024-09-19T05:39:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675997c640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400093e0 0x7f674000b7d0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f674c001fd0 tx=0x7f674c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba86229d0e7f24e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c001c20 con 0x7f67400093e0 2024-09-19T05:39:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f674c003ba0 con 0x7f67400093e0 2024-09-19T05:39:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f674bfff640 1 -- 172.21.15.67:0/609536007 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c0050d0 con 0x7f67400093e0 2024-09-19T05:39:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675b3df640 1 -- 172.21.15.67:0/609536007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400093e0 msgr2=0x7f674000b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675b3df640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400093e0 0x7f674000b7d0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f674c001fd0 tx=0x7f674c01c900 comp rx=0 tx=0).stop 2024-09-19T05:39:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675b3df640 1 -- 172.21.15.67:0/609536007 shutdown_connections 2024-09-19T05:39:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675b3df640 1 --2- 172.21.15.67:0/609536007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67400093e0 0x7f674000b7d0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675b3df640 1 -- 172.21.15.67:0/609536007 >> 172.21.15.67:0/609536007 conn(0x7f67540d0080 msgr2=0x7f67540d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675b3df640 1 -- 172.21.15.67:0/609536007 shutdown_connections 2024-09-19T05:39:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675b3df640 1 -- 172.21.15.67:0/609536007 wait complete. 2024-09-19T05:39:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675b3df640 1 Processor -- start 2024-09-19T05:39:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.076+0000 7f675b3df640 1 -- start start 2024-09-19T05:39:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675b3df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67400093e0 0x7f67540cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675b3df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f675414ca20 0x7f675406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675b3df640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675406c200 0x7f675414d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675b3df640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f675415ad00 con 0x7f675406c200 2024-09-19T05:39:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675b3df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6754072840 con 0x7f67400093e0 2024-09-19T05:39:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675b3df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67540cbf60 con 0x7f675414ca20 2024-09-19T05:39:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675997c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675406c200 0x7f675414d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675997c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675406c200 0x7f675414d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47040/0 (socket says 172.21.15.67:47040) 2024-09-19T05:39:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675997c640 1 -- 172.21.15.67:0/2535496194 learned_addr learned my addr 172.21.15.67:0/2535496194 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675917b640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67400093e0 0x7f67540cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675897a640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f675414ca20 0x7f675406bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675997c640 1 -- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f675414ca20 msgr2=0x7f675406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675997c640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f675414ca20 0x7f675406bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675997c640 1 -- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67400093e0 msgr2=0x7f67540cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675997c640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67400093e0 0x7f67540cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675997c640 1 -- 172.21.15.67:0/2535496194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675414ea00 con 0x7f675406c200 2024-09-19T05:39:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675997c640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675406c200 0x7f675414d400 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f674c000f90 tx=0x7f6740003800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f6749ffb640 1 -- 172.21.15.67:0/2535496194 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c001c00 con 0x7f675406c200 2024-09-19T05:39:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f6749ffb640 1 -- 172.21.15.67:0/2535496194 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f674c003d50 con 0x7f675406c200 2024-09-19T05:39:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675b3df640 1 -- 172.21.15.67:0/2535496194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f675414ece0 con 0x7f675406c200 2024-09-19T05:39:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f6749ffb640 1 -- 172.21.15.67:0/2535496194 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c006da0 con 0x7f675406c200 2024-09-19T05:39:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675b3df640 1 -- 172.21.15.67:0/2535496194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f675414f2a0 con 0x7f675406c200 2024-09-19T05:39:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675b3df640 1 -- 172.21.15.67:0/2535496194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6754072bd0 con 0x7f675406c200 2024-09-19T05:39:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f6749ffb640 1 -- 172.21.15.67:0/2535496194 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f674c0a6700 con 0x7f675406c200 2024-09-19T05:39:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f6749ffb640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67380678f0 0x7f6738069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f6749ffb640 1 -- 172.21.15.67:0/2535496194 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7f674c11fe50 con 0x7f675406c200 2024-09-19T05:39:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.080+0000 7f675917b640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67380678f0 0x7f6738069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.084+0000 7f675917b640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67380678f0 0x7f6738069db0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f675000b240 tx=0x7f6750008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:43.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.088+0000 7f6749ffb640 1 -- 172.21.15.67:0/2535496194 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f674c016610 con 0x7f675406c200 2024-09-19T05:39:43.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.288+0000 7f675b3df640 1 -- 172.21.15.67:0/2535496194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67541560c0 con 0x7f675406c200 2024-09-19T05:39:43.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f6749ffb640 1 -- 172.21.15.67:0/2535496194 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7f674c0f06c0 con 0x7f675406c200 2024-09-19T05:39:43.290 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:43.291 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"btime":"2024-09-19T05:39:33:398633+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":5831,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/761363037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":761363037},{"type":"v1","addr":"172.21.15.97:6837","nonce":761363037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:33.398620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/1158789793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1158789793},{"type":"v1","addr":"172.21.15.67:6835","nonce":1158789793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7464,"qdb_cluster":[7464]},"id":6}]} 2024-09-19T05:39:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 75 2024-09-19T05:39:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 -- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67380678f0 msgr2=0x7f6738069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67380678f0 0x7f6738069db0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f675000b240 tx=0x7f6750008040 comp rx=0 tx=0).stop 2024-09-19T05:39:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 -- 172.21.15.67:0/2535496194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675406c200 msgr2=0x7f675414d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675406c200 0x7f675414d400 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f674c000f90 tx=0x7f6740003800 comp rx=0 tx=0).stop 2024-09-19T05:39:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 -- 172.21.15.67:0/2535496194 shutdown_connections 2024-09-19T05:39:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675406c200 0x7f675414d400 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67380678f0 0x7f6738069db0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f675414ca20 0x7f675406bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 --2- 172.21.15.67:0/2535496194 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67400093e0 0x7f67540cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 -- 172.21.15.67:0/2535496194 >> 172.21.15.67:0/2535496194 conn(0x7f67540d0080 msgr2=0x7f67540aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 -- 172.21.15.67:0/2535496194 shutdown_connections 2024-09-19T05:39:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.292+0000 7f675b3df640 1 -- 172.21.15.67:0/2535496194 wait complete. 2024-09-19T05:39:43.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.432+0000 7f09c9de1640 1 Processor -- start 2024-09-19T05:39:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.432+0000 7f09c9de1640 1 -- start start 2024-09-19T05:39:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c9de1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f09c415c200 0x7f09c4071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c9de1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c40aef40 0x7f09c40af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c9de1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c40b3070 con 0x7f09c415b710 2024-09-19T05:39:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c9de1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f09c40b32e0 con 0x7f09c415c200 2024-09-19T05:39:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c9de1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f09c40b35c0 con 0x7f09c40aef40 2024-09-19T05:39:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c2ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f09c415c200 0x7f09c4071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f09c415b710 0x7f09c415baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:50430/0 (socket says 172.21.15.67:50430) 2024-09-19T05:39:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c37fe640 1 -- 172.21.15.67:0/3803986488 learned_addr learned my addr 172.21.15.67:0/3803986488 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c3fff640 1 --2- 172.21.15.67:0/3803986488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c40aef40 0x7f09c40af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c3fff640 1 -- 172.21.15.67:0/3803986488 >> v2:172.21.15.97:3300/0 conn(0x7f09c415c200 msgr2=0x7f09c4071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c3fff640 1 --2- 172.21.15.67:0/3803986488 >> v2:172.21.15.97:3300/0 conn(0x7f09c415c200 0x7f09c4071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c3fff640 1 -- 172.21.15.67:0/3803986488 >> v1:172.21.15.97:6789/0 conn(0x7f09c415b710 legacy=0x7f09c415baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.436+0000 7f09c3fff640 1 -- 172.21.15.67:0/3803986488 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c40b38a0 con 0x7f09c40aef40 2024-09-19T05:39:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c3fff640 1 --2- 172.21.15.67:0/3803986488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c40aef40 0x7f09c40af360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009d90 tx=0x7f09bc01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6da612602d6a2877 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c27fc640 1 -- 172.21.15.67:0/3803986488 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0b2070 con 0x7f09c40aef40 2024-09-19T05:39:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c27fc640 1 -- 172.21.15.67:0/3803986488 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09bc0a5910 con 0x7f09c40aef40 2024-09-19T05:39:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c27fc640 1 -- 172.21.15.67:0/3803986488 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0a5ce0 con 0x7f09c40aef40 2024-09-19T05:39:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c9de1640 1 -- 172.21.15.67:0/3803986488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c40aef40 msgr2=0x7f09c40af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c9de1640 1 --2- 172.21.15.67:0/3803986488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c40aef40 0x7f09c40af360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009d90 tx=0x7f09bc01c940 comp rx=0 tx=0).stop 2024-09-19T05:39:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c9de1640 1 -- 172.21.15.67:0/3803986488 shutdown_connections 2024-09-19T05:39:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c9de1640 1 --2- 172.21.15.67:0/3803986488 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c40aef40 0x7f09c40af360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c9de1640 1 --2- 172.21.15.67:0/3803986488 >> v2:172.21.15.97:3300/0 conn(0x7f09c415c200 0x7f09c4071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c9de1640 1 -- 172.21.15.67:0/3803986488 >> 172.21.15.67:0/3803986488 conn(0x7f09c40d0080 msgr2=0x7f09c40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c9de1640 1 -- 172.21.15.67:0/3803986488 shutdown_connections 2024-09-19T05:39:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c9de1640 1 -- 172.21.15.67:0/3803986488 wait complete. 2024-09-19T05:39:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c9de1640 1 Processor -- start 2024-09-19T05:39:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.440+0000 7f09c9de1640 1 -- start start 2024-09-19T05:39:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c9de1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c40aef40 0x7f09c40962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c9de1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09c415b710 0x7f09c414ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c9de1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c415c200 0x7f09c4151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c9de1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f09c40b4c40 con 0x7f09c40aef40 2024-09-19T05:39:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c9de1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f09c40b4ac0 con 0x7f09c415b710 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c9de1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f09c40b4dc0 con 0x7f09c415c200 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c40aef40 0x7f09c40962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c40aef40 0x7f09c40962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47042/0 (socket says 172.21.15.67:47042) 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c37fe640 1 -- 172.21.15.67:0/3343015850 learned_addr learned my addr 172.21.15.67:0/3343015850 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c2ffd640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09c415b710 0x7f09c414ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c3fff640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c415c200 0x7f09c4151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c37fe640 1 -- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c415c200 msgr2=0x7f09c4151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c37fe640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c415c200 0x7f09c4151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c37fe640 1 -- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09c415b710 msgr2=0x7f09c414ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c37fe640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09c415b710 0x7f09c414ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c37fe640 1 -- 172.21.15.67:0/3343015850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c41f5380 con 0x7f09c40aef40 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c37fe640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c40aef40 0x7f09c40962c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c420 tx=0x7f09b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09abfff640 1 -- 172.21.15.67:0/3343015850 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4017070 con 0x7f09c40aef40 2024-09-19T05:39:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09abfff640 1 -- 172.21.15.67:0/3343015850 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b4005cf0 con 0x7f09c40aef40 2024-09-19T05:39:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09abfff640 1 -- 172.21.15.67:0/3343015850 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b40072f0 con 0x7f09c40aef40 2024-09-19T05:39:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c9de1640 1 -- 172.21.15.67:0/3343015850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c414b6d0 con 0x7f09c40aef40 2024-09-19T05:39:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c9de1640 1 -- 172.21.15.67:0/3343015850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c414bf30 con 0x7f09c40aef40 2024-09-19T05:39:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09c9de1640 1 -- 172.21.15.67:0/3343015850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c40af360 con 0x7f09c40aef40 2024-09-19T05:39:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09abfff640 1 -- 172.21.15.67:0/3343015850 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09b401a070 con 0x7f09c40aef40 2024-09-19T05:39:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.444+0000 7f09abfff640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b00678c0 0x7f09b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.448+0000 7f09abfff640 1 -- 172.21.15.67:0/3343015850 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7f09b4085340 con 0x7f09c40aef40 2024-09-19T05:39:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.448+0000 7f09c2ffd640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b00678c0 0x7f09b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.448+0000 7f09c2ffd640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b00678c0 0x7f09b0069d80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f09c414a920 tx=0x7f09b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.452+0000 7f09abfff640 1 -- 172.21.15.67:0/3343015850 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f09b4055bc0 con 0x7f09c40aef40 2024-09-19T05:39:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.648+0000 7f09c9de1640 1 -- 172.21.15.67:0/3343015850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09c40736a0 con 0x7f09c40aef40 2024-09-19T05:39:43.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.648+0000 7f09abfff640 1 -- 172.21.15.67:0/3343015850 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7f09b40554c0 con 0x7f09c40aef40 2024-09-19T05:39:43.648 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:43.649 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"btime":"2024-09-19T05:39:33:398633+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":5831,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/761363037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":761363037},{"type":"v1","addr":"172.21.15.97:6837","nonce":761363037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:33.398620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/1158789793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1158789793},{"type":"v1","addr":"172.21.15.67:6835","nonce":1158789793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7464,"qdb_cluster":[7464]},"id":6}]} 2024-09-19T05:39:43.649 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 75 2024-09-19T05:39:43.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 -- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b00678c0 msgr2=0x7f09b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b00678c0 0x7f09b0069d80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f09c414a920 tx=0x7f09b8008040 comp rx=0 tx=0).stop 2024-09-19T05:39:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 -- 172.21.15.67:0/3343015850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c40aef40 msgr2=0x7f09c40962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c40aef40 0x7f09c40962c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c420 tx=0x7f09b400c8e0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 -- 172.21.15.67:0/3343015850 shutdown_connections 2024-09-19T05:39:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b00678c0 0x7f09b0069d80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09c415c200 0x7f09c4151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09c415b710 0x7f09c414ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 --2- 172.21.15.67:0/3343015850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c40aef40 0x7f09c40962c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 -- 172.21.15.67:0/3343015850 >> 172.21.15.67:0/3343015850 conn(0x7f09c40d0080 msgr2=0x7f09c415baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 -- 172.21.15.67:0/3343015850 shutdown_connections 2024-09-19T05:39:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.652+0000 7f09c9de1640 1 -- 172.21.15.67:0/3343015850 wait complete. 2024-09-19T05:39:43.667 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:39:43.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f09a0810640 1 Processor -- start 2024-09-19T05:39:43.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f09a0810640 1 -- start start 2024-09-19T05:39:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f09a0810640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f099c15b1e0 0x7f099c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f09a0810640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f099c072590 0x7f099c0ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f09a0810640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099c0b3860 con 0x7f099c0b4900 2024-09-19T05:39:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f09a0810640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f099c15b5c0 con 0x7f099c072590 2024-09-19T05:39:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f09a0810640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f099c0b3b40 con 0x7f099c15b1e0 2024-09-19T05:39:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f099ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f099c072590 0x7f099c0ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f099ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f099c072590 0x7f099c0ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47044/0 (socket says 172.21.15.67:47044) 2024-09-19T05:39:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f099ad9d640 1 -- 172.21.15.67:0/2283445975 learned_addr learned my addr 172.21.15.67:0/2283445975 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f099a59c640 1 --2- 172.21.15.67:0/2283445975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f099c15b1e0 0x7f099c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f099ad9d640 1 -- 172.21.15.67:0/2283445975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f099c15b1e0 msgr2=0x7f099c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f099ad9d640 1 --2- 172.21.15.67:0/2283445975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f099c15b1e0 0x7f099c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f099ad9d640 1 -- 172.21.15.67:0/2283445975 >> v1:172.21.15.97:6789/0 conn(0x7f099c0b4900 legacy=0x7f099c071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.788+0000 7f099ad9d640 1 -- 172.21.15.67:0/2283445975 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c0b3e20 con 0x7f099c072590 2024-09-19T05:39:43.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f099ad9d640 1 --2- 172.21.15.67:0/2283445975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c072590 0x7f099c0ade10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f0994009e80 tx=0x7f099401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db79ee3a562a3e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0999d9b640 1 -- 172.21.15.67:0/2283445975 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09940a58d0 con 0x7f099c072590 2024-09-19T05:39:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0999d9b640 1 -- 172.21.15.67:0/2283445975 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09940a5a70 con 0x7f099c072590 2024-09-19T05:39:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0999d9b640 1 -- 172.21.15.67:0/2283445975 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09940a5e40 con 0x7f099c072590 2024-09-19T05:39:43.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 -- 172.21.15.67:0/2283445975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c072590 msgr2=0x7f099c0ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 --2- 172.21.15.67:0/2283445975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c072590 0x7f099c0ade10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f0994009e80 tx=0x7f099401c9e0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 -- 172.21.15.67:0/2283445975 shutdown_connections 2024-09-19T05:39:43.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 --2- 172.21.15.67:0/2283445975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c072590 0x7f099c0ade10 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 --2- 172.21.15.67:0/2283445975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f099c15b1e0 0x7f099c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 -- 172.21.15.67:0/2283445975 >> 172.21.15.67:0/2283445975 conn(0x7f099c0d0080 msgr2=0x7f099c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:43.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 -- 172.21.15.67:0/2283445975 shutdown_connections 2024-09-19T05:39:43.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 -- 172.21.15.67:0/2283445975 wait complete. 2024-09-19T05:39:43.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 Processor -- start 2024-09-19T05:39:43.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 -- start start 2024-09-19T05:39:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f099c072590 0x7f099c142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c0b4900 0x7f099c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f099c15b1e0 0x7f099c15e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1681e0 con 0x7f099c0b4900 2024-09-19T05:39:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f099c168060 con 0x7f099c072590 2024-09-19T05:39:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f09a0810640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f099c168360 con 0x7f099c15b1e0 2024-09-19T05:39:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0991d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c0b4900 0x7f099c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0991d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c0b4900 0x7f099c15dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47048/0 (socket says 172.21.15.67:47048) 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0991d9b640 1 -- 172.21.15.67:0/308413329 learned_addr learned my addr 172.21.15.67:0/308413329 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f099a59c640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f099c072590 0x7f099c142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f099ad9d640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f099c15b1e0 0x7f099c15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0991d9b640 1 -- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f099c15b1e0 msgr2=0x7f099c15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0991d9b640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f099c15b1e0 0x7f099c15e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0991d9b640 1 -- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f099c072590 msgr2=0x7f099c142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0991d9b640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f099c072590 0x7f099c142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.792+0000 7f0991d9b640 1 -- 172.21.15.67:0/308413329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c151710 con 0x7f099c0b4900 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f0991d9b640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c0b4900 0x7f099c15dbd0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f098400c460 tx=0x7f098400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f09937fe640 1 -- 172.21.15.67:0/308413329 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0984016020 con 0x7f099c0b4900 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f09937fe640 1 -- 172.21.15.67:0/308413329 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09840052d0 con 0x7f099c0b4900 2024-09-19T05:39:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f09937fe640 1 -- 172.21.15.67:0/308413329 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0984007260 con 0x7f099c0b4900 2024-09-19T05:39:43.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f09a0810640 1 -- 172.21.15.67:0/308413329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c1519b0 con 0x7f099c0b4900 2024-09-19T05:39:43.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f09a0810640 1 -- 172.21.15.67:0/308413329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c1481e0 con 0x7f099c0b4900 2024-09-19T05:39:43.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f09a0810640 1 -- 172.21.15.67:0/308413329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099c0ade10 con 0x7f099c0b4900 2024-09-19T05:39:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f09937fe640 1 -- 172.21.15.67:0/308413329 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0984007400 con 0x7f099c0b4900 2024-09-19T05:39:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f09937fe640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f097c0678f0 0x7f097c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f09937fe640 1 -- 172.21.15.67:0/308413329 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7f0984085850 con 0x7f099c0b4900 2024-09-19T05:39:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f099a59c640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f097c0678f0 0x7f097c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.796+0000 7f099a59c640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f097c0678f0 0x7f097c069db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f098c00b930 tx=0x7f098c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:43.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.800+0000 7f09937fe640 1 -- 172.21.15.67:0/308413329 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0984020020 con 0x7f099c0b4900 2024-09-19T05:39:43.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.964+0000 7f09a0810640 1 -- 172.21.15.67:0/308413329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f099c0b4e30 con 0x7f099c0b4900 2024-09-19T05:39:43.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09937fe640 1 -- 172.21.15.67:0/308413329 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+17166 (secure 0 0 0) 0x7f0984005480 con 0x7f099c0b4900 2024-09-19T05:39:43.966 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:43.966 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":104,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:39:30.364878+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:39:04.521140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-19T05:39:05.828539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/123788622":"2024-09-20T05:39:30.364806+0000","172.21.15.97:6834/123788622":"2024-09-20T05:39:30.364806+0000","172.21.15.67:6834/358275731":"2024-09-20T05:39:29.369128+0000","172.21.15.67:6832/358275731":"2024-09-20T05:39:29.369128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:39:43.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 -- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f097c0678f0 msgr2=0x7f097c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f097c0678f0 0x7f097c069db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f098c00b930 tx=0x7f098c008040 comp rx=0 tx=0).stop 2024-09-19T05:39:43.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 -- 172.21.15.67:0/308413329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c0b4900 msgr2=0x7f099c15dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:43.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c0b4900 0x7f099c15dbd0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f098400c460 tx=0x7f098400c920 comp rx=0 tx=0).stop 2024-09-19T05:39:43.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 -- 172.21.15.67:0/308413329 shutdown_connections 2024-09-19T05:39:43.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f097c0678f0 0x7f097c069db0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f099c15b1e0 0x7f099c15e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f099c0b4900 0x7f099c15dbd0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 --2- 172.21.15.67:0/308413329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f099c072590 0x7f099c142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:43.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 -- 172.21.15.67:0/308413329 >> 172.21.15.67:0/308413329 conn(0x7f099c0d0080 msgr2=0x7f099c151000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:43.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 -- 172.21.15.67:0/308413329 shutdown_connections 2024-09-19T05:39:43.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:43.968+0000 7f09a0810640 1 -- 172.21.15.67:0/308413329 wait complete. 2024-09-19T05:39:43.985 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:39:43.986 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:44.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.112+0000 7fd5f3b85640 1 Processor -- start 2024-09-19T05:39:44.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.112+0000 7fd5f3b85640 1 -- start start 2024-09-19T05:39:44.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f3b85640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15c030 0x7fd5ec06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f3b85640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5ec06f460 0x7fd5ec06f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f3b85640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5ec06e3c0 con 0x7fd5ec15d1d0 2024-09-19T05:39:44.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f3b85640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd5ec06e6a0 con 0x7fd5ec06f460 2024-09-19T05:39:44.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f3b85640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd5ec06e980 con 0x7fd5ec15c030 2024-09-19T05:39:44.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f2122640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5ec06f460 0x7fd5ec06f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f1921640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15c030 0x7fd5ec06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f2122640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5ec06f460 0x7fd5ec06f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:54248/0 (socket says 172.21.15.67:54248) 2024-09-19T05:39:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f2122640 1 -- 172.21.15.67:0/3393561860 learned_addr learned my addr 172.21.15.67:0/3393561860 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f1120640 1 --1- 172.21.15.67:0/3393561860 >> v1:172.21.15.97:6789/0 conn(0x7fd5ec15d1d0 0x7fd5ec0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:50442/0 (socket says 172.21.15.67:50442) 2024-09-19T05:39:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f2122640 1 -- 172.21.15.67:0/3393561860 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15c030 msgr2=0x7fd5ec06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f2122640 1 --2- 172.21.15.67:0/3393561860 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15c030 0x7fd5ec06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f2122640 1 -- 172.21.15.67:0/3393561860 >> v1:172.21.15.97:6789/0 conn(0x7fd5ec15d1d0 legacy=0x7fd5ec0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f091f640 1 -- 172.21.15.67:0/3393561860 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2710377402 0 0) 0x7fd5ec06e3c0 con 0x7fd5ec15d1d0 2024-09-19T05:39:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.116+0000 7fd5f2122640 1 -- 172.21.15.67:0/3393561860 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ec06ec60 con 0x7fd5ec06f460 2024-09-19T05:39:44.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f2122640 1 --2- 172.21.15.67:0/3393561860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5ec06f460 0x7fd5ec06f8d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009e50 tx=0x7fd5e401ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb66ac0655b86e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:44.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f091f640 1 -- 172.21.15.67:0/3393561860 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40a58f0 con 0x7fd5ec06f460 2024-09-19T05:39:44.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f091f640 1 -- 172.21.15.67:0/3393561860 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e40a5a90 con 0x7fd5ec06f460 2024-09-19T05:39:44.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f091f640 1 -- 172.21.15.67:0/3393561860 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40a5e60 con 0x7fd5ec06f460 2024-09-19T05:39:44.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 -- 172.21.15.67:0/3393561860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5ec06f460 msgr2=0x7fd5ec06f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 --2- 172.21.15.67:0/3393561860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5ec06f460 0x7fd5ec06f8d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009e50 tx=0x7fd5e401ca00 comp rx=0 tx=0).stop 2024-09-19T05:39:44.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 -- 172.21.15.67:0/3393561860 shutdown_connections 2024-09-19T05:39:44.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 --2- 172.21.15.67:0/3393561860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5ec06f460 0x7fd5ec06f8d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 --2- 172.21.15.67:0/3393561860 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15c030 0x7fd5ec06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 -- 172.21.15.67:0/3393561860 >> 172.21.15.67:0/3393561860 conn(0x7fd5ec0d0080 msgr2=0x7fd5ec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:44.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 -- 172.21.15.67:0/3393561860 shutdown_connections 2024-09-19T05:39:44.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 -- 172.21.15.67:0/3393561860 wait complete. 2024-09-19T05:39:44.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 Processor -- start 2024-09-19T05:39:44.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 -- start start 2024-09-19T05:39:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec06f460 0x7fd5ec099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5ec15c030 0x7fd5ec150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15d1d0 0x7fd5ec0b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec15c590 con 0x7fd5ec06f460 2024-09-19T05:39:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec15c410 con 0x7fd5ec15c030 2024-09-19T05:39:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f3b85640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd5ec1690e0 con 0x7fd5ec15d1d0 2024-09-19T05:39:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f1921640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec06f460 0x7fd5ec099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f1921640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec06f460 0x7fd5ec099840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47054/0 (socket says 172.21.15.67:47054) 2024-09-19T05:39:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f1921640 1 -- 172.21.15.67:0/2368385848 learned_addr learned my addr 172.21.15.67:0/2368385848 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f1120640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5ec15c030 0x7fd5ec150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.120+0000 7fd5f2122640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15d1d0 0x7fd5ec0b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f1921640 1 -- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15d1d0 msgr2=0x7fd5ec0b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f1921640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15d1d0 0x7fd5ec0b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f1921640 1 -- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5ec15c030 msgr2=0x7fd5ec150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f1921640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5ec15c030 0x7fd5ec150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f1921640 1 -- 172.21.15.67:0/2368385848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ec150350 con 0x7fd5ec06f460 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f2122640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15d1d0 0x7fd5ec0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f1921640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec06f460 0x7fd5ec099840 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00e9e0 tx=0x7fd5dc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5e27fc640 1 -- 172.21.15.67:0/2368385848 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc017070 con 0x7fd5ec06f460 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5e27fc640 1 -- 172.21.15.67:0/2368385848 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5dc00c9d0 con 0x7fd5ec06f460 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f3b85640 1 -- 172.21.15.67:0/2368385848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5ec150630 con 0x7fd5ec06f460 2024-09-19T05:39:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5e27fc640 1 -- 172.21.15.67:0/2368385848 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc00cda0 con 0x7fd5ec06f460 2024-09-19T05:39:44.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f3b85640 1 -- 172.21.15.67:0/2368385848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5ec148100 con 0x7fd5ec06f460 2024-09-19T05:39:44.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f3b85640 1 -- 172.21.15.67:0/2368385848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5ec1500a0 con 0x7fd5ec06f460 2024-09-19T05:39:44.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5e27fc640 1 -- 172.21.15.67:0/2368385848 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5dc01a070 con 0x7fd5ec06f460 2024-09-19T05:39:44.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5e27fc640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5d00678c0 0x7fd5d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5e27fc640 1 -- 172.21.15.67:0/2368385848 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7fd5dc086310 con 0x7fd5ec06f460 2024-09-19T05:39:44.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f1120640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5d00678c0 0x7fd5d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.124+0000 7fd5f1120640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5d00678c0 0x7fd5d0069d80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec140d80 tx=0x7fd5e8007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:44.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.128+0000 7fd5e27fc640 1 -- 172.21.15.67:0/2368385848 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd5dc056540 con 0x7fd5ec06f460 2024-09-19T05:39:44.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.324+0000 7fd5f3b85640 1 -- 172.21.15.67:0/2368385848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5ec06dde0 con 0x7fd5ec06f460 2024-09-19T05:39:44.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.324+0000 7fd5e27fc640 1 -- 172.21.15.67:0/2368385848 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7fd5dc05a840 con 0x7fd5ec06f460 2024-09-19T05:39:44.325 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:44.325 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"btime":"2024-09-19T05:39:33:398633+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":5831,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/761363037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":761363037},{"type":"v1","addr":"172.21.15.97:6837","nonce":761363037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:33.398620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/1158789793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1158789793},{"type":"v1","addr":"172.21.15.67:6835","nonce":1158789793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7464,"qdb_cluster":[7464]},"id":6}]} 2024-09-19T05:39:44.325 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 75 2024-09-19T05:39:44.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 -- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5d00678c0 msgr2=0x7fd5d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5d00678c0 0x7fd5d0069d80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec140d80 tx=0x7fd5e8007df0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 -- 172.21.15.67:0/2368385848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec06f460 msgr2=0x7fd5ec099840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec06f460 0x7fd5ec099840 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00e9e0 tx=0x7fd5dc00eea0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 -- 172.21.15.67:0/2368385848 shutdown_connections 2024-09-19T05:39:44.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd5d00678c0 0x7fd5d0069d80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5ec15d1d0 0x7fd5ec0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5ec15c030 0x7fd5ec150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 --2- 172.21.15.67:0/2368385848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec06f460 0x7fd5ec099840 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 -- 172.21.15.67:0/2368385848 >> 172.21.15.67:0/2368385848 conn(0x7fd5ec0d0080 msgr2=0x7fd5ec1517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:44.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 -- 172.21.15.67:0/2368385848 shutdown_connections 2024-09-19T05:39:44.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.328+0000 7fd5f3b85640 1 -- 172.21.15.67:0/2368385848 wait complete. 2024-09-19T05:39:44.343 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:44.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2da007e640 1 Processor -- start 2024-09-19T05:39:44.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2da007e640 1 -- start start 2024-09-19T05:39:44.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2da007e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2d9806ed80 0x7f2d98165840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2da007e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d980730e0 con 0x7f2d9815a920 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2da007e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d980733c0 con 0x7f2d980af730 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2da007e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2d980ad8c0 con 0x7f2d9806ed80 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9de1a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2d9815a920 0x7f2d98072840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35920/0 (socket says 172.21.15.67:35920) 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9de1a640 1 -- 172.21.15.67:0/3830700117 learned_addr learned my addr 172.21.15.67:0/3830700117 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9e61b640 1 --2- 172.21.15.67:0/3830700117 >> v2:172.21.15.97:3300/0 conn(0x7f2d9806ed80 0x7f2d98165840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2588306348 0 0) 0x7f2d980730e0 con 0x7f2d9815a920 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d84003450 con 0x7f2d9815a920 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 427935552 0 0) 0x7f2d84003450 con 0x7f2d9815a920 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 >> v2:172.21.15.97:3300/0 conn(0x7f2d9806ed80 msgr2=0x7f2d98165840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:44.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 --2- 172.21.15.67:0/3830700117 >> v2:172.21.15.97:3300/0 conn(0x7f2d9806ed80 0x7f2d98165840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 >> v1:172.21.15.97:6789/0 conn(0x7f2d980af730 legacy=0x7f2d9806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d980adba0 con 0x7f2d9815a920 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f2d94001680 con 0x7f2d9815a920 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 >> v1:172.21.15.67:6789/0 conn(0x7f2d9815a920 legacy=0x7f2d98072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d84003ab0 0x7f2d84003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d84008860 0x7f2d8400acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d8400d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2d980ad8c0 con 0x7f2d8400b4d0 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8400e270 con 0x7f2d84003ab0 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2d8400e470 con 0x7f2d84008860 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9e61b640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d8400d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9de1a640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d84003ab0 0x7f2d84003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9e61b640 1 -- 172.21.15.67:0/3830700117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d84008860 msgr2=0x7f2d8400acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:44.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9d619640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d84008860 0x7f2d8400acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9e61b640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d84008860 0x7f2d8400acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9e61b640 1 -- 172.21.15.67:0/3830700117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d84003ab0 msgr2=0x7f2d84003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:44.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9e61b640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d84003ab0 0x7f2d84003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.456+0000 7f2d9e61b640 1 -- 172.21.15.67:0/3830700117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d84003450 con 0x7f2d8400b4d0 2024-09-19T05:39:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9e61b640 1 -- 172.21.15.67:0/3830700117 reap_dead start 2024-09-19T05:39:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9e61b640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d8400d990 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009fc0 tx=0x7f2d9001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610cc14694989dac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90009c10 con 0x7f2d8400b4d0 2024-09-19T05:39:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d900a5d10 con 0x7f2d8400b4d0 2024-09-19T05:39:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9ce18640 1 -- 172.21.15.67:0/3830700117 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90003be0 con 0x7f2d8400b4d0 2024-09-19T05:39:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 -- 172.21.15.67:0/3830700117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 msgr2=0x7f2d8400d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d8400d990 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009fc0 tx=0x7f2d9001ccc0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 -- 172.21.15.67:0/3830700117 shutdown_connections 2024-09-19T05:39:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 --2- 172.21.15.67:0/3830700117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d8400d990 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 -- 172.21.15.67:0/3830700117 >> 172.21.15.67:0/3830700117 conn(0x7f2d980d0080 msgr2=0x7f2d980d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 -- 172.21.15.67:0/3830700117 shutdown_connections 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 -- 172.21.15.67:0/3830700117 wait complete. 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 Processor -- start 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 -- start start 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d980ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d98158930 0x7f2d9813c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d981ef270 0x7f2d981ef720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9815ad00 con 0x7f2d8400b4d0 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2d98072840 con 0x7f2d981ef270 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2da007e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2d98158ea0 con 0x7f2d98158930 2024-09-19T05:39:44.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9de1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d980ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9de1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d980ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47072/0 (socket says 172.21.15.67:47072) 2024-09-19T05:39:44.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9de1a640 1 -- 172.21.15.67:0/1202294427 learned_addr learned my addr 172.21.15.67:0/1202294427 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:44.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9d619640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d98158930 0x7f2d9813c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9e61b640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d981ef270 0x7f2d981ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9de1a640 1 -- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d98158930 msgr2=0x7f2d9813c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9de1a640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d98158930 0x7f2d9813c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9de1a640 1 -- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d981ef270 msgr2=0x7f2d981ef720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9de1a640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d981ef270 0x7f2d981ef720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.460+0000 7f2d9de1a640 1 -- 172.21.15.67:0/1202294427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d98159180 con 0x7f2d8400b4d0 2024-09-19T05:39:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2d9de1a640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d980ccb00 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400e800 tx=0x7f2d9400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2d8e7fc640 1 -- 172.21.15.67:0/1202294427 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400c8d0 con 0x7f2d8400b4d0 2024-09-19T05:39:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2d8e7fc640 1 -- 172.21.15.67:0/1202294427 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d94018070 con 0x7f2d8400b4d0 2024-09-19T05:39:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2da007e640 1 -- 172.21.15.67:0/1202294427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d98159460 con 0x7f2d8400b4d0 2024-09-19T05:39:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2d8e7fc640 1 -- 172.21.15.67:0/1202294427 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400ccb0 con 0x7f2d8400b4d0 2024-09-19T05:39:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2da007e640 1 -- 172.21.15.67:0/1202294427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d981efc60 con 0x7f2d8400b4d0 2024-09-19T05:39:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2da007e640 1 -- 172.21.15.67:0/1202294427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d98072bd0 con 0x7f2d8400b4d0 2024-09-19T05:39:44.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2d8e7fc640 1 -- 172.21.15.67:0/1202294427 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d9401d460 con 0x7f2d8400b4d0 2024-09-19T05:39:44.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2d8e7fc640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d7c0678f0 0x7f2d7c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2d8e7fc640 1 -- 172.21.15.67:0/1202294427 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7f2d94085d10 con 0x7f2d8400b4d0 2024-09-19T05:39:44.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2d9d619640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d7c0678f0 0x7f2d7c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.464+0000 7f2d9d619640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d7c0678f0 0x7f2d7c069db0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2d88000c10 tx=0x7f2d88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:44.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.468+0000 7f2d8e7fc640 1 -- 172.21.15.67:0/1202294427 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2d94056610 con 0x7f2d8400b4d0 2024-09-19T05:39:44.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.664+0000 7f2da007e640 1 -- 172.21.15.67:0/1202294427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d981597f0 con 0x7f2d8400b4d0 2024-09-19T05:39:44.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.664+0000 7f2d8e7fc640 1 -- 172.21.15.67:0/1202294427 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5224 (secure 0 0 0) 0x7f2d94055f10 con 0x7f2d8400b4d0 2024-09-19T05:39:44.663 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:44.663 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"btime":"2024-09-19T05:39:33:398633+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":5831,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/761363037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":761363037},{"type":"v1","addr":"172.21.15.97:6837","nonce":761363037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:06.828432+0000","modified":"2024-09-19T05:39:33.398620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/1158789793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1158789793},{"type":"v1","addr":"172.21.15.67:6835","nonce":1158789793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7464,"qdb_cluster":[7464]},"id":6}]} 2024-09-19T05:39:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 75 2024-09-19T05:39:44.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.664+0000 7f2da007e640 1 -- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d7c0678f0 msgr2=0x7f2d7c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.664+0000 7f2da007e640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d7c0678f0 0x7f2d7c069db0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2d88000c10 tx=0x7f2d88009040 comp rx=0 tx=0).stop 2024-09-19T05:39:44.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.664+0000 7f2da007e640 1 -- 172.21.15.67:0/1202294427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 msgr2=0x7f2d980ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.664+0000 7f2da007e640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d980ccb00 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400e800 tx=0x7f2d9400ecc0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.668+0000 7f2da007e640 1 -- 172.21.15.67:0/1202294427 shutdown_connections 2024-09-19T05:39:44.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.668+0000 7f2da007e640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d981ef270 0x7f2d981ef720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.668+0000 7f2da007e640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d7c0678f0 0x7f2d7c069db0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.668+0000 7f2da007e640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d98158930 0x7f2d9813c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.668+0000 7f2da007e640 1 --2- 172.21.15.67:0/1202294427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d8400b4d0 0x7f2d980ccb00 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.668+0000 7f2da007e640 1 -- 172.21.15.67:0/1202294427 >> 172.21.15.67:0/1202294427 conn(0x7f2d980d0080 msgr2=0x7f2d981573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:44.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.668+0000 7f2da007e640 1 -- 172.21.15.67:0/1202294427 shutdown_connections 2024-09-19T05:39:44.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.668+0000 7f2da007e640 1 -- 172.21.15.67:0/1202294427 wait complete. 2024-09-19T05:39:44.681 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:39:44.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.792+0000 7fdc58d3b640 1 Processor -- start 2024-09-19T05:39:44.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.792+0000 7fdc58d3b640 1 -- start start 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc58d3b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdc5415c030 0x7fdc5406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc58d3b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdc5415d1d0 0x7fdc540b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc58d3b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5406e3c0 con 0x7fdc540b3510 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc58d3b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5406e6a0 con 0x7fdc5415c030 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc58d3b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5406e980 con 0x7fdc5415d1d0 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5259c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdc5415c030 0x7fdc5406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5259c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdc5415c030 0x7fdc5406dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47086/0 (socket says 172.21.15.67:47086) 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5259c640 1 -- 172.21.15.67:0/2053142260 learned_addr learned my addr 172.21.15.67:0/2053142260 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc51d9b640 1 --2- 172.21.15.67:0/2053142260 >> v2:172.21.15.97:3300/0 conn(0x7fdc5415d1d0 0x7fdc540b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5259c640 1 -- 172.21.15.67:0/2053142260 >> v2:172.21.15.97:3300/0 conn(0x7fdc5415d1d0 msgr2=0x7fdc540b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5259c640 1 --2- 172.21.15.67:0/2053142260 >> v2:172.21.15.97:3300/0 conn(0x7fdc5415d1d0 0x7fdc540b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5259c640 1 -- 172.21.15.67:0/2053142260 >> v1:172.21.15.97:6789/0 conn(0x7fdc540b3510 legacy=0x7fdc5406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:44.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5259c640 1 -- 172.21.15.67:0/2053142260 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5406ec60 con 0x7fdc5415c030 2024-09-19T05:39:44.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5259c640 1 --2- 172.21.15.67:0/2053142260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 0x7fdc5406dde0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fdc540add20 tx=0x7fdc4401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfc5afc6382d80e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:44.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5159a640 1 -- 172.21.15.67:0/2053142260 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc440b1070 con 0x7fdc5415c030 2024-09-19T05:39:44.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5159a640 1 -- 172.21.15.67:0/2053142260 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc440ac630 con 0x7fdc5415c030 2024-09-19T05:39:44.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.796+0000 7fdc5159a640 1 -- 172.21.15.67:0/2053142260 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc440a8050 con 0x7fdc5415c030 2024-09-19T05:39:44.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 -- 172.21.15.67:0/2053142260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 msgr2=0x7fdc5406dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 --2- 172.21.15.67:0/2053142260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 0x7fdc5406dde0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fdc540add20 tx=0x7fdc4401c4b0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 -- 172.21.15.67:0/2053142260 shutdown_connections 2024-09-19T05:39:44.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 --2- 172.21.15.67:0/2053142260 >> v2:172.21.15.97:3300/0 conn(0x7fdc5415d1d0 0x7fdc540b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 --2- 172.21.15.67:0/2053142260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 0x7fdc5406dde0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 -- 172.21.15.67:0/2053142260 >> 172.21.15.67:0/2053142260 conn(0x7fdc540d0080 msgr2=0x7fdc540d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:44.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 -- 172.21.15.67:0/2053142260 shutdown_connections 2024-09-19T05:39:44.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 -- 172.21.15.67:0/2053142260 wait complete. 2024-09-19T05:39:44.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 Processor -- start 2024-09-19T05:39:44.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 -- start start 2024-09-19T05:39:44.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc540b3510 0x7fdc5414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 0x7fdc541496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc5415d1d0 0x7fdc5414cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5415c590 con 0x7fdc5415c030 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5415c410 con 0x7fdc5415d1d0 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc58d3b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdc541690e0 con 0x7fdc540b3510 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc51d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 0x7fdc541496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc51d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 0x7fdc541496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47092/0 (socket says 172.21.15.67:47092) 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc51d9b640 1 -- 172.21.15.67:0/3318847607 learned_addr learned my addr 172.21.15.67:0/3318847607 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc5259c640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc540b3510 0x7fdc5414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc52d9d640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc5415d1d0 0x7fdc5414cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc51d9b640 1 -- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc540b3510 msgr2=0x7fdc5414ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc51d9b640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc540b3510 0x7fdc5414ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc51d9b640 1 -- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc5415d1d0 msgr2=0x7fdc5414cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc51d9b640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc5415d1d0 0x7fdc5414cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc51d9b640 1 -- 172.21.15.67:0/3318847607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc54150130 con 0x7fdc5415c030 2024-09-19T05:39:44.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.800+0000 7fdc52d9d640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc5415d1d0 0x7fdc5414cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:44.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc51d9b640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 0x7fdc541496a0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c820 tx=0x7fdc4800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:44.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc42ffd640 1 -- 172.21.15.67:0/3318847607 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48015070 con 0x7fdc5415c030 2024-09-19T05:39:44.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc42ffd640 1 -- 172.21.15.67:0/3318847607 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc48007a30 con 0x7fdc5415c030 2024-09-19T05:39:44.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc58d3b640 1 -- 172.21.15.67:0/3318847607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc54150410 con 0x7fdc5415c030 2024-09-19T05:39:44.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc42ffd640 1 -- 172.21.15.67:0/3318847607 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48007e20 con 0x7fdc5415c030 2024-09-19T05:39:44.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc58d3b640 1 -- 172.21.15.67:0/3318847607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc54150cb0 con 0x7fdc5415c030 2024-09-19T05:39:44.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc58d3b640 1 -- 172.21.15.67:0/3318847607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5406dde0 con 0x7fdc5415c030 2024-09-19T05:39:44.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc42ffd640 1 -- 172.21.15.67:0/3318847607 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc48018070 con 0x7fdc5415c030 2024-09-19T05:39:44.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc42ffd640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdc340678c0 0x7fdc34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:44.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc42ffd640 1 -- 172.21.15.67:0/3318847607 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7fdc48085d90 con 0x7fdc5415c030 2024-09-19T05:39:44.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc5259c640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdc340678c0 0x7fdc34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:44.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.804+0000 7fdc5259c640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdc340678c0 0x7fdc34069d80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdc440ae000 tx=0x7fdc44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:44.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.808+0000 7fdc42ffd640 1 -- 172.21.15.67:0/3318847607 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fdc48056690 con 0x7fdc5415c030 2024-09-19T05:39:44.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.972+0000 7fdc58d3b640 1 -- 172.21.15.67:0/3318847607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc540d0f20 con 0x7fdc5415c030 2024-09-19T05:39:44.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc42ffd640 1 -- 172.21.15.67:0/3318847607 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+17166 (secure 0 0 0) 0x7fdc48055f90 con 0x7fdc5415c030 2024-09-19T05:39:44.974 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:44.974 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":104,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:39:30.364878+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:39:04.521140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-19T05:39:05.828539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/123788622":"2024-09-20T05:39:30.364806+0000","172.21.15.97:6834/123788622":"2024-09-20T05:39:30.364806+0000","172.21.15.67:6834/358275731":"2024-09-20T05:39:29.369128+0000","172.21.15.67:6832/358275731":"2024-09-20T05:39:29.369128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:39:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 -- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdc340678c0 msgr2=0x7fdc34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdc340678c0 0x7fdc34069d80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdc440ae000 tx=0x7fdc44008040 comp rx=0 tx=0).stop 2024-09-19T05:39:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 -- 172.21.15.67:0/3318847607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 msgr2=0x7fdc541496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 0x7fdc541496a0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c820 tx=0x7fdc4800cce0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 -- 172.21.15.67:0/3318847607 shutdown_connections 2024-09-19T05:39:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc5415d1d0 0x7fdc5414cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5415c030 0x7fdc541496a0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdc340678c0 0x7fdc34069d80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 --2- 172.21.15.67:0/3318847607 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc540b3510 0x7fdc5414ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 -- 172.21.15.67:0/3318847607 >> 172.21.15.67:0/3318847607 conn(0x7fdc540d0080 msgr2=0x7fdc540af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 -- 172.21.15.67:0/3318847607 shutdown_connections 2024-09-19T05:39:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:44.976+0000 7fdc58d3b640 1 -- 172.21.15.67:0/3318847607 wait complete. 2024-09-19T05:39:44.994 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:39:45.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f171095f640 1 Processor -- start 2024-09-19T05:39:45.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f171095f640 1 -- start start 2024-09-19T05:39:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f171095f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f170c0b4900 0x7f170c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f171095f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c0723c0 0x7f170c072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f171095f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f170c0b3860 con 0x7f170c15b1e0 2024-09-19T05:39:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f171095f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f170c15b5c0 con 0x7f170c0b4900 2024-09-19T05:39:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f171095f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f170c0b3b40 con 0x7f170c0723c0 2024-09-19T05:39:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f1709d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f170c0b4900 0x7f170c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f170a59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f170c15b1e0 0x7f170c0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35930/0 (socket says 172.21.15.67:35930) 2024-09-19T05:39:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f170a59c640 1 -- 172.21.15.67:0/3313804464 learned_addr learned my addr 172.21.15.67:0/3313804464 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f170ad9d640 1 --2- 172.21.15.67:0/3313804464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c0723c0 0x7f170c072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f1709d9b640 1 -- 172.21.15.67:0/3313804464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c0723c0 msgr2=0x7f170c072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f1709d9b640 1 --2- 172.21.15.67:0/3313804464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c0723c0 0x7f170c072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f1709d9b640 1 -- 172.21.15.67:0/3313804464 >> v1:172.21.15.67:6789/0 conn(0x7f170c15b1e0 legacy=0x7f170c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f1709d9b640 1 -- 172.21.15.67:0/3313804464 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c0b3e20 con 0x7f170c0b4900 2024-09-19T05:39:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.108+0000 7f170959a640 1 -- 172.21.15.67:0/3313804464 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341798666 0 0) 0x7f170c0b3860 con 0x7f170c15b1e0 2024-09-19T05:39:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f1709d9b640 1 --2- 172.21.15.67:0/3313804464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0b4900 0x7f170c071e80 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f16f40097c0 tx=0x7f16f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91661cc7486b5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f170959a640 1 -- 172.21.15.67:0/3313804464 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f40b0070 con 0x7f170c0b4900 2024-09-19T05:39:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f170959a640 1 -- 172.21.15.67:0/3313804464 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f40ab600 con 0x7f170c0b4900 2024-09-19T05:39:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f170959a640 1 -- 172.21.15.67:0/3313804464 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f40ab9d0 con 0x7f170c0b4900 2024-09-19T05:39:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f171095f640 1 -- 172.21.15.67:0/3313804464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0b4900 msgr2=0x7f170c071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f171095f640 1 --2- 172.21.15.67:0/3313804464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0b4900 0x7f170c071e80 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f16f40097c0 tx=0x7f16f401c470 comp rx=0 tx=0).stop 2024-09-19T05:39:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f171095f640 1 -- 172.21.15.67:0/3313804464 shutdown_connections 2024-09-19T05:39:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f171095f640 1 --2- 172.21.15.67:0/3313804464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c0723c0 0x7f170c072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f171095f640 1 --2- 172.21.15.67:0/3313804464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0b4900 0x7f170c071e80 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f171095f640 1 -- 172.21.15.67:0/3313804464 >> 172.21.15.67:0/3313804464 conn(0x7f170c0d0080 msgr2=0x7f170c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f171095f640 1 -- 172.21.15.67:0/3313804464 shutdown_connections 2024-09-19T05:39:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f171095f640 1 -- 172.21.15.67:0/3313804464 wait complete. 2024-09-19T05:39:45.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f171095f640 1 Processor -- start 2024-09-19T05:39:45.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.112+0000 7f171095f640 1 -- start start 2024-09-19T05:39:45.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f171095f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0723c0 0x7f170c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f171095f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c0b4900 0x7f170c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f171095f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f170c15b1e0 0x7f170c14e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f171095f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f170c0ae9b0 con 0x7f170c0723c0 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f171095f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f170c0ae830 con 0x7f170c15b1e0 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f171095f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f170c0aeb30 con 0x7f170c0b4900 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f170a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0723c0 0x7f170c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f170a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0723c0 0x7f170c154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47114/0 (socket says 172.21.15.67:47114) 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f170a59c640 1 -- 172.21.15.67:0/3580320848 learned_addr learned my addr 172.21.15.67:0/3580320848 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f1709d9b640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c0b4900 0x7f170c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f170a59c640 1 -- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c0b4900 msgr2=0x7f170c146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f170a59c640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c0b4900 0x7f170c146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f170a59c640 1 -- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f170c15b1e0 msgr2=0x7f170c14e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f170a59c640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f170c15b1e0 0x7f170c14e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f170a59c640 1 -- 172.21.15.67:0/3580320848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c15e640 con 0x7f170c0723c0 2024-09-19T05:39:45.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f170a59c640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0723c0 0x7f170c154a60 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f1704001570 tx=0x7f170400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:45.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f1702ffd640 1 -- 172.21.15.67:0/3580320848 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704018070 con 0x7f170c0723c0 2024-09-19T05:39:45.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f1702ffd640 1 -- 172.21.15.67:0/3580320848 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170400a640 con 0x7f170c0723c0 2024-09-19T05:39:45.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f1702ffd640 1 -- 172.21.15.67:0/3580320848 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170400aa30 con 0x7f170c0723c0 2024-09-19T05:39:45.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f171095f640 1 -- 172.21.15.67:0/3580320848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170c15e080 con 0x7f170c0723c0 2024-09-19T05:39:45.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f171095f640 1 -- 172.21.15.67:0/3580320848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170c152790 con 0x7f170c0723c0 2024-09-19T05:39:45.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f171095f640 1 -- 172.21.15.67:0/3580320848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f170c072850 con 0x7f170c0723c0 2024-09-19T05:39:45.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f1702ffd640 1 -- 172.21.15.67:0/3580320848 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f170401b070 con 0x7f170c0723c0 2024-09-19T05:39:45.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f1702ffd640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16ec0678c0 0x7f16ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f1702ffd640 1 -- 172.21.15.67:0/3580320848 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6273+0+0 (secure 0 0 0) 0x7f1704085820 con 0x7f170c0723c0 2024-09-19T05:39:45.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.116+0000 7f1709d9b640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16ec0678c0 0x7f16ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.120+0000 7f1709d9b640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16ec0678c0 0x7f16ec069d80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f16f40ad000 tx=0x7f16f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:45.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.120+0000 7f1702ffd640 1 -- 172.21.15.67:0/3580320848 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1704056210 con 0x7f170c0723c0 2024-09-19T05:39:45.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.316+0000 7f171095f640 1 -- 172.21.15.67:0/3580320848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f170c147180 con 0x7f170c0723c0 2024-09-19T05:39:45.316 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:39:45.316+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:39:45.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.320+0000 7f1702ffd640 1 -- 172.21.15.67:0/3580320848 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) ==== 161+0+0 (secure 0 0 0) 0x7f1704055b10 con 0x7f170c0723c0 2024-09-19T05:39:45.320 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:39:45.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 -- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16ec0678c0 msgr2=0x7f16ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16ec0678c0 0x7f16ec069d80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f16f40ad000 tx=0x7f16f4008040 comp rx=0 tx=0).stop 2024-09-19T05:39:45.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 -- 172.21.15.67:0/3580320848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0723c0 msgr2=0x7f170c154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0723c0 0x7f170c154a60 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f1704001570 tx=0x7f170400cd20 comp rx=0 tx=0).stop 2024-09-19T05:39:45.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 -- 172.21.15.67:0/3580320848 shutdown_connections 2024-09-19T05:39:45.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f170c15b1e0 0x7f170c14e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16ec0678c0 0x7f16ec069d80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c0b4900 0x7f170c146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 --2- 172.21.15.67:0/3580320848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f170c0723c0 0x7f170c154a60 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 -- 172.21.15.67:0/3580320848 >> 172.21.15.67:0/3580320848 conn(0x7f170c0d0080 msgr2=0x7f170c0aef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:45.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 -- 172.21.15.67:0/3580320848 shutdown_connections 2024-09-19T05:39:45.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.324+0000 7f171095f640 1 -- 172.21.15.67:0/3580320848 wait complete. 2024-09-19T05:39:45.327 INFO:tasks.ceph.mds.a.smithi067.stderr: -1424> 2024-09-19T05:39:36.376+0000 7f3f602b5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:39:45.341 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:39:45.359 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:39:45.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.468+0000 7f97ea89a640 1 Processor -- start 2024-09-19T05:39:45.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.468+0000 7f97ea89a640 1 -- start start 2024-09-19T05:39:45.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97ea89a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97e40d1130 0x7f97e40d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97ea89a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97e40d1510 0x7f97e40cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97ea89a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e406d850 con 0x7f97e40b32d0 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97ea89a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f97e40d39e0 con 0x7f97e40d1510 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97ea89a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f97e40d33d0 con 0x7f97e40d1130 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f97e40b32d0 0x7f97e406d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35946/0 (socket says 172.21.15.67:35946) 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e37fe640 1 -- 172.21.15.67:0/722686834 learned_addr learned my addr 172.21.15.67:0/722686834 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e3fff640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97e40d1130 0x7f97e40d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e8e37640 1 --2- 172.21.15.67:0/722686834 >> v2:172.21.15.97:3300/0 conn(0x7f97e40d1510 0x7f97e40cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3503339873 0 0) 0x7f97e406d850 con 0x7f97e40b32d0 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97cc003530 con 0x7f97e40b32d0 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2167979469 0 0) 0x7f97cc003530 con 0x7f97e40b32d0 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97e40d1130 msgr2=0x7f97e40d3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97e40d1130 0x7f97e40d3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 >> v2:172.21.15.97:3300/0 conn(0x7f97e40d1510 msgr2=0x7f97e40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 --2- 172.21.15.67:0/722686834 >> v2:172.21.15.97:3300/0 conn(0x7f97e40d1510 0x7f97e40cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e406db20 con 0x7f97e40b32d0 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f97d8001680 con 0x7f97e40b32d0 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 >> v1:172.21.15.67:6789/0 conn(0x7f97e40b32d0 legacy=0x7f97e406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97e40d1130 0x7f97cc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc003f40 0x7f97cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97cc004d50 0x7f97cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97e40d39e0 con 0x7f97cc003f40 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f97e40d33d0 con 0x7f97cc004d50 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc00ba20 con 0x7f97e40d1130 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e37fe640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc003f40 0x7f97cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e3fff640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97e40d1130 0x7f97cc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e37fe640 1 -- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97e40d1130 msgr2=0x7f97cc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:45.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e8e37640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97cc004d50 0x7f97cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e37fe640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97e40d1130 0x7f97cc0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e37fe640 1 -- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97cc004d50 msgr2=0x7f97cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:45.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e37fe640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97cc004d50 0x7f97cc0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e37fe640 1 -- 172.21.15.67:0/722686834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc003530 con 0x7f97cc003f40 2024-09-19T05:39:45.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e37fe640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc003f40 0x7f97cc004810 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f97d800c210 tx=0x7f97d801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906c42a9256beb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:45.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.472+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8007d80 con 0x7f97cc003f40 2024-09-19T05:39:45.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d80a9020 con 0x7f97cc003f40 2024-09-19T05:39:45.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e2ffd640 1 -- 172.21.15.67:0/722686834 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8005ae0 con 0x7f97cc003f40 2024-09-19T05:39:45.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- 172.21.15.67:0/722686834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc003f40 msgr2=0x7f97cc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 --2- 172.21.15.67:0/722686834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc003f40 0x7f97cc004810 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f97d800c210 tx=0x7f97d801cc70 comp rx=0 tx=0).stop 2024-09-19T05:39:45.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e8e37640 1 -- 172.21.15.67:0/722686834 reap_dead start 2024-09-19T05:39:45.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- 172.21.15.67:0/722686834 shutdown_connections 2024-09-19T05:39:45.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- 172.21.15.67:0/722686834 >> 172.21.15.67:0/722686834 conn(0x7f97e408bfc0 msgr2=0x7f97e40d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:45.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- 172.21.15.67:0/722686834 shutdown_connections 2024-09-19T05:39:45.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- 172.21.15.67:0/722686834 wait complete. 2024-09-19T05:39:45.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 Processor -- start 2024-09-19T05:39:45.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- start start 2024-09-19T05:39:45.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97cc003f40 0x7f97e40c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e40c8510 0x7f97e40cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97e40cdd50 0x7f97e41fb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97e40d2750 con 0x7f97e40c8510 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f97e40d25d0 con 0x7f97e40cdd50 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f97e40d28d0 con 0x7f97cc003f40 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e40c8510 0x7f97e40cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e40c8510 0x7f97e40cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47152/0 (socket says 172.21.15.67:47152) 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e37fe640 1 -- 172.21.15.67:0/537366122 learned_addr learned my addr 172.21.15.67:0/537366122 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e3fff640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97cc003f40 0x7f97e40c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e8e37640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97e40cdd50 0x7f97e41fb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e37fe640 1 -- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97cc003f40 msgr2=0x7f97e40c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e37fe640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97cc003f40 0x7f97e40c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e37fe640 1 -- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97e40cdd50 msgr2=0x7f97e41fb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e37fe640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97e40cdd50 0x7f97e41fb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e37fe640 1 -- 172.21.15.67:0/537366122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e40c8a70 con 0x7f97e40c8510 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e3fff640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97cc003f40 0x7f97e40c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e8e37640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97e40cdd50 0x7f97e41fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e37fe640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e40c8510 0x7f97e40cd810 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f97d80ab040 tx=0x7f97cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e0ff9640 1 -- 172.21.15.67:0/537366122 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d80a5a60 con 0x7f97e40c8510 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e0ff9640 1 -- 172.21.15.67:0/537366122 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d80a5c00 con 0x7f97e40c8510 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- 172.21.15.67:0/537366122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e40c8d50 con 0x7f97e40c8510 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97e0ff9640 1 -- 172.21.15.67:0/537366122 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d80047f0 con 0x7f97e40c8510 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.476+0000 7f97ea89a640 1 -- 172.21.15.67:0/537366122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e40c9310 con 0x7f97e40c8510 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.480+0000 7f97ea89a640 1 -- 172.21.15.67:0/537366122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e40cf110 con 0x7f97e40c8510 2024-09-19T05:39:45.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.480+0000 7f97e0ff9640 1 -- 172.21.15.67:0/537366122 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97d8004990 con 0x7f97e40c8510 2024-09-19T05:39:45.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.480+0000 7f97e0ff9640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97d00678f0 0x7f97d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.480+0000 7f97e0ff9640 1 -- 172.21.15.67:0/537366122 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6359+0+0 (secure 0 0 0) 0x7f97d811fd60 con 0x7f97e40c8510 2024-09-19T05:39:45.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.480+0000 7f97e3fff640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97d00678f0 0x7f97d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.480+0000 7f97e3fff640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97d00678f0 0x7f97d0069db0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f97d40098d0 tx=0x7f97d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:45.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.484+0000 7f97e0ff9640 1 -- 172.21.15.67:0/537366122 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f97d8007e20 con 0x7f97e40c8510 2024-09-19T05:39:45.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:45.676+0000 7f97ea89a640 1 -- 172.21.15.67:0/537366122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f97e415c940 con 0x7f97e40c8510 2024-09-19T05:39:46.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.324+0000 7f97e0ff9640 1 -- 172.21.15.67:0/537366122 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) ==== 104+0+0 (secure 0 0 0) 0x7f97d80169b0 con 0x7f97e40c8510 2024-09-19T05:39:46.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 -- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97d00678f0 msgr2=0x7f97d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:46.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97d00678f0 0x7f97d0069db0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f97d40098d0 tx=0x7f97d4008040 comp rx=0 tx=0).stop 2024-09-19T05:39:46.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 -- 172.21.15.67:0/537366122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e40c8510 msgr2=0x7f97e40cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:46.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e40c8510 0x7f97e40cd810 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f97d80ab040 tx=0x7f97cc005840 comp rx=0 tx=0).stop 2024-09-19T05:39:46.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 -- 172.21.15.67:0/537366122 shutdown_connections 2024-09-19T05:39:46.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97e40cdd50 0x7f97e41fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e40c8510 0x7f97e40cd810 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97d00678f0 0x7f97d0069db0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 --2- 172.21.15.67:0/537366122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97cc003f40 0x7f97e40c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 -- 172.21.15.67:0/537366122 >> 172.21.15.67:0/537366122 conn(0x7f97e408bfc0 msgr2=0x7f97e40b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:46.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 -- 172.21.15.67:0/537366122 shutdown_connections 2024-09-19T05:39:46.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.328+0000 7f97ea89a640 1 -- 172.21.15.67:0/537366122 wait complete. 2024-09-19T05:39:46.350 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:39:46.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f6781aa9640 1 Processor -- start 2024-09-19T05:39:46.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f6781aa9640 1 -- start start 2024-09-19T05:39:46.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f6781aa9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f677c0cf5e0 0x7f677c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:46.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f6781aa9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c15c850 0x7f677c06e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:46.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f6781aa9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f677c15d030 con 0x7f677c06eb40 2024-09-19T05:39:46.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f6781aa9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f677c06de90 con 0x7f677c0cf5e0 2024-09-19T05:39:46.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f6781aa9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f677c06e170 con 0x7f677c15c850 2024-09-19T05:39:46.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f677b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f677c0cf5e0 0x7f677c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f677affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c15c850 0x7f677c06e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f677affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c15c850 0x7f677c06e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:46836/0 (socket says 172.21.15.67:46836) 2024-09-19T05:39:46.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f677bfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f677c06eb40 0x7f677c15d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:58740/0 (socket says 172.21.15.67:58740) 2024-09-19T05:39:46.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f677affd640 1 -- 172.21.15.67:0/2067384118 learned_addr learned my addr 172.21.15.67:0/2067384118 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:46.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f677b7fe640 1 -- 172.21.15.67:0/2067384118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c15c850 msgr2=0x7f677c06e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:46.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f677b7fe640 1 --2- 172.21.15.67:0/2067384118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c15c850 0x7f677c06e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f677b7fe640 1 -- 172.21.15.67:0/2067384118 >> v1:172.21.15.97:6789/0 conn(0x7f677c06eb40 legacy=0x7f677c15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:46.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f677b7fe640 1 -- 172.21.15.67:0/2067384118 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c15d310 con 0x7f677c0cf5e0 2024-09-19T05:39:46.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.532+0000 7f677affd640 1 --2- 172.21.15.67:0/2067384118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c15c850 0x7f677c06e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:46.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f677b7fe640 1 --2- 172.21.15.67:0/2067384118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f677c0cf5e0 0x7f677c0d0aa0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f676c0097c0 tx=0x7f676c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba5a0839f0711e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:46.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f677a7fc640 1 -- 172.21.15.67:0/2067384118 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c0b2070 con 0x7f677c0cf5e0 2024-09-19T05:39:46.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f677a7fc640 1 -- 172.21.15.67:0/2067384118 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f676c0ad680 con 0x7f677c0cf5e0 2024-09-19T05:39:46.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f677a7fc640 1 -- 172.21.15.67:0/2067384118 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c0ada50 con 0x7f677c0cf5e0 2024-09-19T05:39:46.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f6781aa9640 1 -- 172.21.15.67:0/2067384118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f677c0cf5e0 msgr2=0x7f677c0d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:46.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f6781aa9640 1 --2- 172.21.15.67:0/2067384118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f677c0cf5e0 0x7f677c0d0aa0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f676c0097c0 tx=0x7f676c01c470 comp rx=0 tx=0).stop 2024-09-19T05:39:46.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f6781aa9640 1 -- 172.21.15.67:0/2067384118 shutdown_connections 2024-09-19T05:39:46.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f6781aa9640 1 --2- 172.21.15.67:0/2067384118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c15c850 0x7f677c06e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f6781aa9640 1 --2- 172.21.15.67:0/2067384118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f677c0cf5e0 0x7f677c0d0aa0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f6781aa9640 1 -- 172.21.15.67:0/2067384118 >> 172.21.15.67:0/2067384118 conn(0x7f677c06c0c0 msgr2=0x7f677c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:46.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f6781aa9640 1 -- 172.21.15.67:0/2067384118 shutdown_connections 2024-09-19T05:39:46.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.536+0000 7f6781aa9640 1 -- 172.21.15.67:0/2067384118 wait complete. 2024-09-19T05:39:46.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 Processor -- start 2024-09-19T05:39:46.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 -- start start 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677c06eb40 0x7f677c160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c0cf5e0 0x7f677c09c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f677c15c850 0x7f677c09c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f677c169130 con 0x7f677c06eb40 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f677c168fb0 con 0x7f677c15c850 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f677c1692b0 con 0x7f677c0cf5e0 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677c06eb40 0x7f677c160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677c06eb40 0x7f677c160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46834/0 (socket says 172.21.15.67:46834) 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677b7fe640 1 -- 172.21.15.67:0/8182094 learned_addr learned my addr 172.21.15.67:0/8182094 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677bfff640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f677c15c850 0x7f677c09c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677affd640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c0cf5e0 0x7f677c09c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677b7fe640 1 -- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c0cf5e0 msgr2=0x7f677c09c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677b7fe640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c0cf5e0 0x7f677c09c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677b7fe640 1 -- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f677c15c850 msgr2=0x7f677c09c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677b7fe640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f677c15c850 0x7f677c09c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677b7fe640 1 -- 172.21.15.67:0/8182094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c09b340 con 0x7f677c06eb40 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677affd640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c0cf5e0 0x7f677c09c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f677b7fe640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677c06eb40 0x7f677c160770 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f676c01ab20 tx=0x7f676c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6763fff640 1 -- 172.21.15.67:0/8182094 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c0b2040 con 0x7f677c06eb40 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6763fff640 1 -- 172.21.15.67:0/8182094 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f676c0ad930 con 0x7f677c06eb40 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 -- 172.21.15.67:0/8182094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677c09b620 con 0x7f677c06eb40 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6763fff640 1 -- 172.21.15.67:0/8182094 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c0add20 con 0x7f677c06eb40 2024-09-19T05:39:46.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 -- 172.21.15.67:0/8182094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f677c09b050 con 0x7f677c06eb40 2024-09-19T05:39:46.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6781aa9640 1 -- 172.21.15.67:0/8182094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f677c0d0aa0 con 0x7f677c06eb40 2024-09-19T05:39:46.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.540+0000 7f6763fff640 1 -- 172.21.15.67:0/8182094 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f676c0c0030 con 0x7f677c06eb40 2024-09-19T05:39:46.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.544+0000 7f6763fff640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67680678c0 0x7f6768069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:46.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.544+0000 7f6763fff640 1 -- 172.21.15.67:0/8182094 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6359+0+0 (secure 0 0 0) 0x7f676c11f850 con 0x7f677c06eb40 2024-09-19T05:39:46.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.544+0000 7f677affd640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67680678c0 0x7f6768069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.544+0000 7f677affd640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67680678c0 0x7f6768069d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6770009a30 tx=0x7f6770008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.548+0000 7f6763fff640 1 -- 172.21.15.67:0/8182094 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f676c0c7060 con 0x7f677c06eb40 2024-09-19T05:39:46.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:46.708+0000 7f6781aa9640 1 -- 172.21.15.67:0/8182094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f677c09a450 con 0x7f677c06eb40 2024-09-19T05:39:47.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.332+0000 7f6763fff640 1 -- 172.21.15.67:0/8182094 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v106) ==== 181+0+0 (secure 0 0 0) 0x7f676c016090 con 0x7f677c06eb40 2024-09-19T05:39:47.330 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:39:47.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 -- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67680678c0 msgr2=0x7f6768069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67680678c0 0x7f6768069d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6770009a30 tx=0x7f6770008040 comp rx=0 tx=0).stop 2024-09-19T05:39:47.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 -- 172.21.15.67:0/8182094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677c06eb40 msgr2=0x7f677c160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677c06eb40 0x7f677c160770 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f676c01ab20 tx=0x7f676c01acb0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 -- 172.21.15.67:0/8182094 shutdown_connections 2024-09-19T05:39:47.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f677c15c850 0x7f677c09c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67680678c0 0x7f6768069d80 secure :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6770009a30 tx=0x7f6770008040 comp rx=0 tx=0).stop 2024-09-19T05:39:47.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f677c0cf5e0 0x7f677c09c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 --2- 172.21.15.67:0/8182094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677c06eb40 0x7f677c160770 secure :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f676c01ab20 tx=0x7f676c01acb0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 -- 172.21.15.67:0/8182094 >> 172.21.15.67:0/8182094 conn(0x7f677c06c0c0 msgr2=0x7f677c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:47.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 -- 172.21.15.67:0/8182094 shutdown_connections 2024-09-19T05:39:47.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.336+0000 7f6781aa9640 1 -- 172.21.15.67:0/8182094 wait complete. 2024-09-19T05:39:47.357 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:39:47.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.492+0000 7f9afc4ec640 1 Processor -- start 2024-09-19T05:39:47.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.492+0000 7f9afc4ec640 1 -- start start 2024-09-19T05:39:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.492+0000 7f9afc4ec640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9af415e6f0 0x7f9af40d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afc4ec640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af40cfe30 0x7f9af40d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afc4ec640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af415ead0 con 0x7f9af40b5f70 2024-09-19T05:39:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afc4ec640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9af40ceb40 con 0x7f9af415e6f0 2024-09-19T05:39:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afc4ec640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9af40ced90 con 0x7f9af40cfe30 2024-09-19T05:39:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afa288640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9af415e6f0 0x7f9af40d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afa288640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9af415e6f0 0x7f9af40d3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46844/0 (socket says 172.21.15.67:46844) 2024-09-19T05:39:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afa288640 1 -- 172.21.15.67:0/2114987458 learned_addr learned my addr 172.21.15.67:0/2114987458 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9af9a87640 1 --2- 172.21.15.67:0/2114987458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af40cfe30 0x7f9af40d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afa288640 1 -- 172.21.15.67:0/2114987458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af40cfe30 msgr2=0x7f9af40d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afa288640 1 --2- 172.21.15.67:0/2114987458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af40cfe30 0x7f9af40d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afa288640 1 -- 172.21.15.67:0/2114987458 >> v1:172.21.15.97:6789/0 conn(0x7f9af40b5f70 legacy=0x7f9af41621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afa288640 1 -- 172.21.15.67:0/2114987458 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af40cf070 con 0x7f9af415e6f0 2024-09-19T05:39:47.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afa288640 1 --2- 172.21.15.67:0/2114987458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 0x7f9af40d3090 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009870 tx=0x7f9af001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84e64b344336e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9af9286640 1 -- 172.21.15.67:0/2114987458 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af00b0070 con 0x7f9af415e6f0 2024-09-19T05:39:47.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9af9286640 1 -- 172.21.15.67:0/2114987458 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af00ab600 con 0x7f9af415e6f0 2024-09-19T05:39:47.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9af9286640 1 -- 172.21.15.67:0/2114987458 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af00ab9d0 con 0x7f9af415e6f0 2024-09-19T05:39:47.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afc4ec640 1 -- 172.21.15.67:0/2114987458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 msgr2=0x7f9af40d3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afc4ec640 1 --2- 172.21.15.67:0/2114987458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 0x7f9af40d3090 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009870 tx=0x7f9af001c400 comp rx=0 tx=0).stop 2024-09-19T05:39:47.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afc4ec640 1 -- 172.21.15.67:0/2114987458 shutdown_connections 2024-09-19T05:39:47.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afc4ec640 1 --2- 172.21.15.67:0/2114987458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af40cfe30 0x7f9af40d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afc4ec640 1 --2- 172.21.15.67:0/2114987458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 0x7f9af40d3090 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.496+0000 7f9afc4ec640 1 -- 172.21.15.67:0/2114987458 >> 172.21.15.67:0/2114987458 conn(0x7f9af408bfc0 msgr2=0x7f9af40d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:47.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 -- 172.21.15.67:0/2114987458 shutdown_connections 2024-09-19T05:39:47.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 -- 172.21.15.67:0/2114987458 wait complete. 2024-09-19T05:39:47.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 Processor -- start 2024-09-19T05:39:47.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 -- start start 2024-09-19T05:39:47.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af40b5f70 0x7f9af414e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af40cfe30 0x7f9af4161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 0x7f9af40b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9af416b500 con 0x7f9af415e6f0 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9af40b6830 con 0x7f9af40cfe30 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9af416b680 con 0x7f9af40b5f70 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afaa89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 0x7f9af40b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afaa89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 0x7f9af40b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46860/0 (socket says 172.21.15.67:46860) 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afaa89640 1 -- 172.21.15.67:0/706276804 learned_addr learned my addr 172.21.15.67:0/706276804 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9af9a87640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af40cfe30 0x7f9af4161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afa288640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af40b5f70 0x7f9af414e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afaa89640 1 -- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af40b5f70 msgr2=0x7f9af414e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afaa89640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af40b5f70 0x7f9af414e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afaa89640 1 -- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af40cfe30 msgr2=0x7f9af4161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afaa89640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af40cfe30 0x7f9af4161610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afaa89640 1 -- 172.21.15.67:0/706276804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af4152e30 con 0x7f9af415e6f0 2024-09-19T05:39:47.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afaa89640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 0x7f9af40b3100 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00b9e0 tx=0x7f9aec00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9aeaffd640 1 -- 172.21.15.67:0/706276804 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec003b80 con 0x7f9af415e6f0 2024-09-19T05:39:47.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9aeaffd640 1 -- 172.21.15.67:0/706276804 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aec003d20 con 0x7f9af415e6f0 2024-09-19T05:39:47.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 -- 172.21.15.67:0/706276804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af4153110 con 0x7f9af415e6f0 2024-09-19T05:39:47.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9aeaffd640 1 -- 172.21.15.67:0/706276804 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00cae0 con 0x7f9af415e6f0 2024-09-19T05:39:47.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.500+0000 7f9afc4ec640 1 -- 172.21.15.67:0/706276804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af41536d0 con 0x7f9af415e6f0 2024-09-19T05:39:47.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.504+0000 7f9ae8ff9640 1 -- 172.21.15.67:0/706276804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af41621c0 con 0x7f9af415e6f0 2024-09-19T05:39:47.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.504+0000 7f9aeaffd640 1 -- 172.21.15.67:0/706276804 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9aec006d10 con 0x7f9af415e6f0 2024-09-19T05:39:47.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.504+0000 7f9aeaffd640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad80678f0 0x7f9ad8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.504+0000 7f9aeaffd640 1 -- 172.21.15.67:0/706276804 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5921+0+0 (secure 0 0 0) 0x7f9aec085800 con 0x7f9af415e6f0 2024-09-19T05:39:47.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.504+0000 7f9afa288640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad80678f0 0x7f9ad8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.504+0000 7f9afa288640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad80678f0 0x7f9ad8069db0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9af00ad000 tx=0x7f9af00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.508+0000 7f9aeaffd640 1 -- 172.21.15.67:0/706276804 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9aec0562f0 con 0x7f9af415e6f0 2024-09-19T05:39:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:47.688+0000 7f9ae8ff9640 1 -- 172.21.15.67:0/706276804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9af40b6e20 con 0x7f9af415e6f0 2024-09-19T05:39:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.332+0000 7f9aeaffd640 1 -- 172.21.15.67:0/706276804 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v107) ==== 169+0+0 (secure 0 0 0) 0x7f9aec055bf0 con 0x7f9af415e6f0 2024-09-19T05:39:48.333 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:39:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 -- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad80678f0 msgr2=0x7f9ad8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad80678f0 0x7f9ad8069db0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9af00ad000 tx=0x7f9af00a6000 comp rx=0 tx=0).stop 2024-09-19T05:39:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 -- 172.21.15.67:0/706276804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 msgr2=0x7f9af40b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 0x7f9af40b3100 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00b9e0 tx=0x7f9aec00bea0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 -- 172.21.15.67:0/706276804 shutdown_connections 2024-09-19T05:39:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9af415e6f0 0x7f9af40b3100 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af40cfe30 0x7f9af4161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9ad80678f0 0x7f9ad8069db0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 --2- 172.21.15.67:0/706276804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9af40b5f70 0x7f9af414e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 -- 172.21.15.67:0/706276804 >> 172.21.15.67:0/706276804 conn(0x7f9af408bfc0 msgr2=0x7f9af40d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 -- 172.21.15.67:0/706276804 shutdown_connections 2024-09-19T05:39:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.340+0000 7f9ae8ff9640 1 -- 172.21.15.67:0/706276804 wait complete. 2024-09-19T05:39:48.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-09-19T05:39:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.484+0000 7f29395b4640 1 Processor -- start 2024-09-19T05:39:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.484+0000 7f29395b4640 1 -- start start 2024-09-19T05:39:48.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29395b4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f293406ffd0 0x7f29340aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29395b4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29340b3150 0x7f29340af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29395b4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29340ad840 con 0x7f2934159c60 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29395b4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f29340af710 con 0x7f29340b3150 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29395b4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f293415d460 con 0x7f293406ffd0 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f2932ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2934159c60 0x7f29340ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58320/0 (socket says 172.21.15.67:58320) 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f2932ffd640 1 -- 172.21.15.67:0/3843841241 learned_addr learned my addr 172.21.15.67:0/3843841241 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29337fe640 1 --2- 172.21.15.67:0/3843841241 >> v2:172.21.15.67:3300/0 conn(0x7f29340b3150 0x7f29340af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29327fc640 1 --2- 172.21.15.67:0/3843841241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f293406ffd0 0x7f29340aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29337fe640 1 -- 172.21.15.67:0/3843841241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f293406ffd0 msgr2=0x7f29340aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29337fe640 1 --2- 172.21.15.67:0/3843841241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f293406ffd0 0x7f29340aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29337fe640 1 -- 172.21.15.67:0/3843841241 >> v1:172.21.15.67:6789/0 conn(0x7f2934159c60 legacy=0x7f29340ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29337fe640 1 -- 172.21.15.67:0/3843841241 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293415a040 con 0x7f29340b3150 2024-09-19T05:39:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f2931ffb640 1 -- 172.21.15.67:0/3843841241 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 921479220 0 0) 0x7f29340ad840 con 0x7f2934159c60 2024-09-19T05:39:48.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29337fe640 1 --2- 172.21.15.67:0/3843841241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29340b3150 0x7f29340af1d0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f292c009d90 tx=0x7f292c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640c39ee2d2f37aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:48.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f2931ffb640 1 -- 172.21.15.67:0/3843841241 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c0b2070 con 0x7f29340b3150 2024-09-19T05:39:48.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f2931ffb640 1 -- 172.21.15.67:0/3843841241 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292c0a5a00 con 0x7f29340b3150 2024-09-19T05:39:48.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f2931ffb640 1 -- 172.21.15.67:0/3843841241 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c0a5dd0 con 0x7f29340b3150 2024-09-19T05:39:48.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29395b4640 1 -- 172.21.15.67:0/3843841241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29340b3150 msgr2=0x7f29340af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.488+0000 7f29395b4640 1 --2- 172.21.15.67:0/3843841241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29340b3150 0x7f29340af1d0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f292c009d90 tx=0x7f292c01c940 comp rx=0 tx=0).stop 2024-09-19T05:39:48.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- 172.21.15.67:0/3843841241 shutdown_connections 2024-09-19T05:39:48.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 --2- 172.21.15.67:0/3843841241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29340b3150 0x7f29340af1d0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 --2- 172.21.15.67:0/3843841241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f293406ffd0 0x7f29340aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- 172.21.15.67:0/3843841241 >> 172.21.15.67:0/3843841241 conn(0x7f29340b1e50 msgr2=0x7f29340b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:48.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- 172.21.15.67:0/3843841241 shutdown_connections 2024-09-19T05:39:48.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- 172.21.15.67:0/3843841241 wait complete. 2024-09-19T05:39:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 Processor -- start 2024-09-19T05:39:48.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- start start 2024-09-19T05:39:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f293406ffd0 0x7f293414bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29340b3150 0x7f29340b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2934159c60 0x7f29340b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f29341605d0 con 0x7f2934159c60 2024-09-19T05:39:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f293415d0f0 con 0x7f29340b3150 2024-09-19T05:39:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2934160750 con 0x7f293406ffd0 2024-09-19T05:39:48.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29337fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2934159c60 0x7f29340b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29337fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2934159c60 0x7f29340b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46878/0 (socket says 172.21.15.67:46878) 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29337fe640 1 -- 172.21.15.67:0/2850824892 learned_addr learned my addr 172.21.15.67:0/2850824892 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29327fc640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29340b3150 0x7f29340b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f2932ffd640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f293406ffd0 0x7f293414bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29337fe640 1 -- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f293406ffd0 msgr2=0x7f293414bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29337fe640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f293406ffd0 0x7f293414bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29337fe640 1 -- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29340b3150 msgr2=0x7f29340b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29337fe640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29340b3150 0x7f29340b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29337fe640 1 -- 172.21.15.67:0/2850824892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293414e3b0 con 0x7f2934159c60 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29337fe640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2934159c60 0x7f29340b1300 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f292c0b0040 tx=0x7f292c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:48.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f292b7fe640 1 -- 172.21.15.67:0/2850824892 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c0b2050 con 0x7f2934159c60 2024-09-19T05:39:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f292b7fe640 1 -- 172.21.15.67:0/2850824892 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292c0be070 con 0x7f2934159c60 2024-09-19T05:39:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- 172.21.15.67:0/2850824892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293414e690 con 0x7f2934159c60 2024-09-19T05:39:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f292b7fe640 1 -- 172.21.15.67:0/2850824892 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c0adbf0 con 0x7f2934159c60 2024-09-19T05:39:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- 172.21.15.67:0/2850824892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293415d980 con 0x7f2934159c60 2024-09-19T05:39:48.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.492+0000 7f29395b4640 1 -- 172.21.15.67:0/2850824892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29340ad130 con 0x7f2934159c60 2024-09-19T05:39:48.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.496+0000 7f292b7fe640 1 -- 172.21.15.67:0/2850824892 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f292c0c3460 con 0x7f2934159c60 2024-09-19T05:39:48.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.496+0000 7f292b7fe640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29140678c0 0x7f2914069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.496+0000 7f292b7fe640 1 -- 172.21.15.67:0/2850824892 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7f292c121070 con 0x7f2934159c60 2024-09-19T05:39:48.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.496+0000 7f2932ffd640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29140678c0 0x7f2914069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.496+0000 7f2932ffd640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29140678c0 0x7f2914069d80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2924000f70 tx=0x7f2924007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:48.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.500+0000 7f292b7fe640 1 -- 172.21.15.67:0/2850824892 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f292c016560 con 0x7f2934159c60 2024-09-19T05:39:48.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.672+0000 7f29395b4640 1 -- 172.21.15.67:0/2850824892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7f2934073910 con 0x7f2934159c60 2024-09-19T05:39:48.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f292b7fe640 1 -- 172.21.15.67:0/2850824892 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v30) ==== 101+0+0 (secure 0 0 0) 0x7f292c0f1c70 con 0x7f2934159c60 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 -- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29140678c0 msgr2=0x7f2914069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29140678c0 0x7f2914069d80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2924000f70 tx=0x7f2924007c10 comp rx=0 tx=0).stop 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 -- 172.21.15.67:0/2850824892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2934159c60 msgr2=0x7f29340b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2934159c60 0x7f29340b1300 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f292c0b0040 tx=0x7f292c0196e0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 -- 172.21.15.67:0/2850824892 shutdown_connections 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2934159c60 0x7f29340b1300 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29340b3150 0x7f29340b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29140678c0 0x7f2914069d80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 --2- 172.21.15.67:0/2850824892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f293406ffd0 0x7f293414bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 -- 172.21.15.67:0/2850824892 >> 172.21.15.67:0/2850824892 conn(0x7f29340b1e50 msgr2=0x7f29340b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 -- 172.21.15.67:0/2850824892 shutdown_connections 2024-09-19T05:39:48.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.680+0000 7f29395b4640 1 -- 172.21.15.67:0/2850824892 wait complete. 2024-09-19T05:39:48.702 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-19T05:39:48.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.824+0000 7f6f8a241640 1 Processor -- start 2024-09-19T05:39:48.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.824+0000 7f6f8a241640 1 -- start start 2024-09-19T05:39:48.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f8a241640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f841639f0 0x7f6f840aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f8a241640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 0x7f6f840723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f8a241640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f840ada80 con 0x7f6f8415cc30 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f8a241640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6f84072910 con 0x7f6f841639f0 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f8a241640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6f840ad840 con 0x7f6f84071f60 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f82ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f841639f0 0x7f6f840aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f82ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f841639f0 0x7f6f840aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46894/0 (socket says 172.21.15.67:46894) 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f82ffd640 1 -- 172.21.15.67:0/3336543995 learned_addr learned my addr 172.21.15.67:0/3336543995 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f83fff640 1 --2- 172.21.15.67:0/3336543995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 0x7f6f840723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f82ffd640 1 -- 172.21.15.67:0/3336543995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 msgr2=0x7f6f840723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f82ffd640 1 --2- 172.21.15.67:0/3336543995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 0x7f6f840723d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f82ffd640 1 -- 172.21.15.67:0/3336543995 >> v1:172.21.15.97:6789/0 conn(0x7f6f8415cc30 legacy=0x7f6f840ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:48.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f82ffd640 1 -- 172.21.15.67:0/3336543995 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f840add60 con 0x7f6f841639f0 2024-09-19T05:39:48.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f83fff640 1 --2- 172.21.15.67:0/3336543995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 0x7f6f840723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f82ffd640 1 --2- 172.21.15.67:0/3336543995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 0x7f6f840aeb20 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009870 tx=0x7f6f7801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a447eace49f3ff3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f827fc640 1 -- 172.21.15.67:0/3336543995 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f780b0070 con 0x7f6f841639f0 2024-09-19T05:39:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f827fc640 1 -- 172.21.15.67:0/3336543995 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f780ab600 con 0x7f6f841639f0 2024-09-19T05:39:48.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.828+0000 7f6f827fc640 1 -- 172.21.15.67:0/3336543995 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f780ab9d0 con 0x7f6f841639f0 2024-09-19T05:39:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- 172.21.15.67:0/3336543995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 msgr2=0x7f6f840aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 --2- 172.21.15.67:0/3336543995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 0x7f6f840aeb20 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009870 tx=0x7f6f7801c490 comp rx=0 tx=0).stop 2024-09-19T05:39:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- 172.21.15.67:0/3336543995 shutdown_connections 2024-09-19T05:39:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 --2- 172.21.15.67:0/3336543995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 0x7f6f840723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 --2- 172.21.15.67:0/3336543995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 0x7f6f840aeb20 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- 172.21.15.67:0/3336543995 >> 172.21.15.67:0/3336543995 conn(0x7f6f840b1e50 msgr2=0x7f6f840b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- 172.21.15.67:0/3336543995 shutdown_connections 2024-09-19T05:39:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- 172.21.15.67:0/3336543995 wait complete. 2024-09-19T05:39:48.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 Processor -- start 2024-09-19T05:39:48.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- start start 2024-09-19T05:39:48.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 0x7f6f840cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f8415cc30 0x7f6f84154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 0x7f6f84156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840b3ae0 con 0x7f6f841639f0 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840b3960 con 0x7f6f8415cc30 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6f840b3c60 con 0x7f6f84071f60 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f83fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 0x7f6f84156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f83fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 0x7f6f84156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46898/0 (socket says 172.21.15.67:46898) 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f83fff640 1 -- 172.21.15.67:0/2775868443 learned_addr learned my addr 172.21.15.67:0/2775868443 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f837fe640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 0x7f6f840cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f82ffd640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f8415cc30 0x7f6f84154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f83fff640 1 -- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 msgr2=0x7f6f840cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f83fff640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 0x7f6f840cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f83fff640 1 -- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f8415cc30 msgr2=0x7f6f84154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f83fff640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f8415cc30 0x7f6f84154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f83fff640 1 -- 172.21.15.67:0/2775868443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84157350 con 0x7f6f841639f0 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f837fe640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 0x7f6f840cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f82ffd640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f8415cc30 0x7f6f84154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f83fff640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 0x7f6f84156e10 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00cf20 tx=0x7f6f7c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f6bfff640 1 -- 172.21.15.67:0/2775868443 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c01a070 con 0x7f6f841639f0 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f6bfff640 1 -- 172.21.15.67:0/2775868443 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7c00d840 con 0x7f6f841639f0 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- 172.21.15.67:0/2775868443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f84154bb0 con 0x7f6f841639f0 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f6bfff640 1 -- 172.21.15.67:0/2775868443 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c00dc30 con 0x7f6f841639f0 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.832+0000 7f6f8a241640 1 -- 172.21.15.67:0/2775868443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f840ccd20 con 0x7f6f841639f0 2024-09-19T05:39:48.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.836+0000 7f6f8a241640 1 -- 172.21.15.67:0/2775868443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f840723d0 con 0x7f6f841639f0 2024-09-19T05:39:48.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.836+0000 7f6f6bfff640 1 -- 172.21.15.67:0/2775868443 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f7c01d070 con 0x7f6f841639f0 2024-09-19T05:39:48.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.836+0000 7f6f6bfff640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f700678c0 0x7f6f70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:48.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.836+0000 7f6f6bfff640 1 -- 172.21.15.67:0/2775868443 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7f6f7c086460 con 0x7f6f841639f0 2024-09-19T05:39:48.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.836+0000 7f6f837fe640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f700678c0 0x7f6f70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:48.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.836+0000 7f6f837fe640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f700678c0 0x7f6f70069d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6f74003e40 tx=0x7f6f74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:48.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:48.840+0000 7f6f6bfff640 1 -- 172.21.15.67:0/2775868443 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6f7c057060 con 0x7f6f841639f0 2024-09-19T05:39:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.004+0000 7f6f8a241640 1 -- 172.21.15.67:0/2775868443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7f6f840b51a0 con 0x7f6f841639f0 2024-09-19T05:39:49.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.008+0000 7f6f6bfff640 1 -- 172.21.15.67:0/2775868443 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v31) ==== 101+0+0 (secure 0 0 0) 0x7f6f7c056960 con 0x7f6f841639f0 2024-09-19T05:39:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 -- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f700678c0 msgr2=0x7f6f70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f700678c0 0x7f6f70069d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6f74003e40 tx=0x7f6f74009040 comp rx=0 tx=0).stop 2024-09-19T05:39:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 -- 172.21.15.67:0/2775868443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 msgr2=0x7f6f84156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 0x7f6f84156e10 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00cf20 tx=0x7f6f7c00a7d0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 -- 172.21.15.67:0/2775868443 shutdown_connections 2024-09-19T05:39:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f841639f0 0x7f6f84156e10 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f8415cc30 0x7f6f84154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f700678c0 0x7f6f70069d80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 --2- 172.21.15.67:0/2775868443 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84071f60 0x7f6f840cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 -- 172.21.15.67:0/2775868443 >> 172.21.15.67:0/2775868443 conn(0x7f6f840b1e50 msgr2=0x7f6f840b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 -- 172.21.15.67:0/2775868443 shutdown_connections 2024-09-19T05:39:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.012+0000 7f6f8a241640 1 -- 172.21.15.67:0/2775868443 wait complete. 2024-09-19T05:39:49.028 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:39:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.148+0000 7f9d8a2cd640 1 Processor -- start 2024-09-19T05:39:49.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.148+0000 7f9d8a2cd640 1 -- start start 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.148+0000 7f9d8a2cd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9d84159c60 0x7f9d840ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.148+0000 7f9d8a2cd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9d840af3a0 0x7f9d8415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.148+0000 7f9d8a2cd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8415a040 con 0x7f9d8406ffd0 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.148+0000 7f9d8a2cd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9d8415d460 con 0x7f9d84159c60 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.148+0000 7f9d8a2cd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9d8415c850 con 0x7f9d840af3a0 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.148+0000 7f9d83fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9d84159c60 0x7f9d840ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d837fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9d8406ffd0 0x7f9d840aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58332/0 (socket says 172.21.15.67:58332) 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d837fe640 1 -- 172.21.15.67:0/939694338 learned_addr learned my addr 172.21.15.67:0/939694338 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d8886a640 1 --2- 172.21.15.67:0/939694338 >> v2:172.21.15.97:3300/0 conn(0x7f9d840af3a0 0x7f9d8415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d82ffd640 1 -- 172.21.15.67:0/939694338 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2289173051 0 0) 0x7f9d8415a040 con 0x7f9d8406ffd0 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d82ffd640 1 -- 172.21.15.67:0/939694338 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d6c003530 con 0x7f9d8406ffd0 2024-09-19T05:39:49.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d83fff640 1 -- 172.21.15.67:0/939694338 >> v2:172.21.15.97:3300/0 conn(0x7f9d840af3a0 msgr2=0x7f9d8415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d83fff640 1 --2- 172.21.15.67:0/939694338 >> v2:172.21.15.97:3300/0 conn(0x7f9d840af3a0 0x7f9d8415fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d83fff640 1 -- 172.21.15.67:0/939694338 >> v1:172.21.15.67:6789/0 conn(0x7f9d8406ffd0 legacy=0x7f9d840aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d83fff640 1 -- 172.21.15.67:0/939694338 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8415cb30 con 0x7f9d84159c60 2024-09-19T05:39:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d83fff640 1 --2- 172.21.15.67:0/939694338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d84159c60 0x7f9d840ad130 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f9d84071950 tx=0x7f9d7801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608ae187798ef14b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d82ffd640 1 -- 172.21.15.67:0/939694338 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d780ab650 con 0x7f9d84159c60 2024-09-19T05:39:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d82ffd640 1 -- 172.21.15.67:0/939694338 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d780b0070 con 0x7f9d84159c60 2024-09-19T05:39:49.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d82ffd640 1 -- 172.21.15.67:0/939694338 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d780aba10 con 0x7f9d84159c60 2024-09-19T05:39:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/939694338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d84159c60 msgr2=0x7f9d840ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d8a2cd640 1 --2- 172.21.15.67:0/939694338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d84159c60 0x7f9d840ad130 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f9d84071950 tx=0x7f9d7801c450 comp rx=0 tx=0).stop 2024-09-19T05:39:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/939694338 shutdown_connections 2024-09-19T05:39:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d8a2cd640 1 --2- 172.21.15.67:0/939694338 >> v2:172.21.15.97:3300/0 conn(0x7f9d840af3a0 0x7f9d8415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d8a2cd640 1 --2- 172.21.15.67:0/939694338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d84159c60 0x7f9d840ad130 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/939694338 >> 172.21.15.67:0/939694338 conn(0x7f9d840b1e50 msgr2=0x7f9d840b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/939694338 shutdown_connections 2024-09-19T05:39:49.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.152+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/939694338 wait complete. 2024-09-19T05:39:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 Processor -- start 2024-09-19T05:39:49.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 -- start start 2024-09-19T05:39:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d8406ffd0 0x7f9d8415efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d840af3a0 0x7f9d841655c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d84159c60 0x7f9d84165b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9d84168e30 con 0x7f9d840af3a0 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9d84168fb0 con 0x7f9d84159c60 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9d84169130 con 0x7f9d8406ffd0 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d840af3a0 0x7f9d841655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d840af3a0 0x7f9d841655c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46930/0 (socket says 172.21.15.67:46930) 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d837fe640 1 -- 172.21.15.67:0/1637504585 learned_addr learned my addr 172.21.15.67:0/1637504585 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d837fe640 1 -- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d8406ffd0 msgr2=0x7f9d8415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d837fe640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d8406ffd0 0x7f9d8415efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8886a640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d84159c60 0x7f9d84165b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d837fe640 1 -- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d84159c60 msgr2=0x7f9d84165b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d837fe640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d84159c60 0x7f9d84165b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d837fe640 1 -- 172.21.15.67:0/1637504585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8409d9d0 con 0x7f9d840af3a0 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d837fe640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d840af3a0 0x7f9d841655c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400c450 tx=0x7f9d7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d80ff9640 1 -- 172.21.15.67:0/1637504585 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74017070 con 0x7f9d840af3a0 2024-09-19T05:39:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d80ff9640 1 -- 172.21.15.67:0/1637504585 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d74005cf0 con 0x7f9d840af3a0 2024-09-19T05:39:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/1637504585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d8409dc50 con 0x7f9d840af3a0 2024-09-19T05:39:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d80ff9640 1 -- 172.21.15.67:0/1637504585 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74007290 con 0x7f9d840af3a0 2024-09-19T05:39:49.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/1637504585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d8415e7b0 con 0x7f9d840af3a0 2024-09-19T05:39:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/1637504585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d8415fda0 con 0x7f9d840af3a0 2024-09-19T05:39:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.156+0000 7f9d80ff9640 1 -- 172.21.15.67:0/1637504585 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d7401a070 con 0x7f9d840af3a0 2024-09-19T05:39:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.160+0000 7f9d80ff9640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d700678c0 0x7f9d70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.160+0000 7f9d80ff9640 1 -- 172.21.15.67:0/1637504585 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7f9d74085010 con 0x7f9d840af3a0 2024-09-19T05:39:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.160+0000 7f9d83fff640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d700678c0 0x7f9d70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.160+0000 7f9d83fff640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d700678c0 0x7f9d70069d80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9d780af000 tx=0x7f9d78004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.164+0000 7f9d80ff9640 1 -- 172.21.15.67:0/1637504585 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9d8409d9d0 con 0x7f9d840af3a0 2024-09-19T05:39:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.327+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/1637504585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f9d8415b4a0 con 0x7f9d840af3a0 2024-09-19T05:39:49.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.331+0000 7f9d80ff9640 1 -- 172.21.15.67:0/1637504585 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f9d74055b80 con 0x7f9d840af3a0 2024-09-19T05:39:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d700678c0 msgr2=0x7f9d70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d700678c0 0x7f9d70069d80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9d780af000 tx=0x7f9d78004740 comp rx=0 tx=0).stop 2024-09-19T05:39:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/1637504585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d840af3a0 msgr2=0x7f9d841655c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d840af3a0 0x7f9d841655c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400c450 tx=0x7f9d7400c910 comp rx=0 tx=0).stop 2024-09-19T05:39:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/1637504585 shutdown_connections 2024-09-19T05:39:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d84159c60 0x7f9d84165b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d840af3a0 0x7f9d841655c0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9d700678c0 0x7f9d70069d80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 --2- 172.21.15.67:0/1637504585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d8406ffd0 0x7f9d8415efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/1637504585 >> 172.21.15.67:0/1637504585 conn(0x7f9d840b1e50 msgr2=0x7f9d84158660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/1637504585 shutdown_connections 2024-09-19T05:39:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.335+0000 7f9d8a2cd640 1 -- 172.21.15.67:0/1637504585 wait complete. 2024-09-19T05:39:49.353 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-09-19T05:39:49.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.475+0000 7fe6ee040640 1 Processor -- start 2024-09-19T05:39:49.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.475+0000 7fe6ee040640 1 -- start start 2024-09-19T05:39:49.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6ee040640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e80d05f0 0x7fe6e806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6ee040640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6e806efd0 0x7fe6e80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6ee040640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e806c780 con 0x7fe6e806c200 2024-09-19T05:39:49.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6ee040640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e806d390 con 0x7fe6e806efd0 2024-09-19T05:39:49.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6ee040640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e806ca60 con 0x7fe6e80d05f0 2024-09-19T05:39:49.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e6ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe6e806c200 0x7fe6e806e8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58346/0 (socket says 172.21.15.67:58346) 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e6ffd640 1 -- 172.21.15.67:0/3337768812 learned_addr learned my addr 172.21.15.67:0/3337768812 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e7fff640 1 --2- 172.21.15.67:0/3337768812 >> v2:172.21.15.97:3300/0 conn(0x7fe6e806efd0 0x7fe6e80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e77fe640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e80d05f0 0x7fe6e806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626304088 0 0) 0x7fe6e806c780 con 0x7fe6e806c200 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d4003530 con 0x7fe6e806c200 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 277050997 0 0) 0x7fe6d4003530 con 0x7fe6e806c200 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e80d05f0 msgr2=0x7fe6e806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e80d05f0 0x7fe6e806bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 >> v2:172.21.15.97:3300/0 conn(0x7fe6e806efd0 msgr2=0x7fe6e80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 --2- 172.21.15.67:0/3337768812 >> v2:172.21.15.97:3300/0 conn(0x7fe6e806efd0 0x7fe6e80ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e806cd40 con 0x7fe6e806c200 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fe6d8001a00 con 0x7fe6e806c200 2024-09-19T05:39:49.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 >> v1:172.21.15.67:6789/0 conn(0x7fe6e806c200 legacy=0x7fe6e806e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e80d05f0 0x7fe6d40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6d4003f40 0x7fe6d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6d4004d50 0x7fe6d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e806d390 con 0x7fe6d4004d50 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e806ca60 con 0x7fe6d4003f40 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d400b9d0 con 0x7fe6e80d05f0 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e7fff640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6d4004d50 0x7fe6d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e77fe640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e80d05f0 0x7fe6d40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e6ffd640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6d4003f40 0x7fe6d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e7fff640 1 -- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e80d05f0 msgr2=0x7fe6d40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e7fff640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e80d05f0 0x7fe6d40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e7fff640 1 -- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6d4003f40 msgr2=0x7fe6d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e7fff640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6d4003f40 0x7fe6d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e7fff640 1 -- 172.21.15.67:0/3337768812 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d4003530 con 0x7fe6d4004d50 2024-09-19T05:39:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.479+0000 7fe6e77fe640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e80d05f0 0x7fe6d40039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e7fff640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6d4004d50 0x7fe6d40051d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009ae0 tx=0x7fe6d001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41380b3a07f33643 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00b2070 con 0x7fe6d4004d50 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d00a56a0 con 0x7fe6d4004d50 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e67fc640 1 -- 172.21.15.67:0/3337768812 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00096b0 con 0x7fe6d4004d50 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- 172.21.15.67:0/3337768812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6d4004d50 msgr2=0x7fe6d40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 --2- 172.21.15.67:0/3337768812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6d4004d50 0x7fe6d40051d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009ae0 tx=0x7fe6d001ca50 comp rx=0 tx=0).stop 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e7fff640 1 -- 172.21.15.67:0/3337768812 reap_dead start 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- 172.21.15.67:0/3337768812 shutdown_connections 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- 172.21.15.67:0/3337768812 >> 172.21.15.67:0/3337768812 conn(0x7fe6e80cd770 msgr2=0x7fe6e80cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- 172.21.15.67:0/3337768812 shutdown_connections 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- 172.21.15.67:0/3337768812 wait complete. 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 Processor -- start 2024-09-19T05:39:49.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- start start 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e815d950 0x7fe6e8146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e8158fa0 0x7fe6e81466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e815dd30 0x7fe6e8157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e8162280 con 0x7fe6e815d950 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e80d09d0 con 0x7fe6e8158fa0 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e806bcc0 con 0x7fe6e815dd30 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e815d950 0x7fe6e8146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e815d950 0x7fe6e8146170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46950/0 (socket says 172.21.15.67:46950) 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e77fe640 1 -- 172.21.15.67:0/2774838241 learned_addr learned my addr 172.21.15.67:0/2774838241 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e6ffd640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e8158fa0 0x7fe6e81466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e77fe640 1 -- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e815dd30 msgr2=0x7fe6e8157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e7fff640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e815dd30 0x7fe6e8157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e77fe640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e815dd30 0x7fe6e8157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e77fe640 1 -- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e8158fa0 msgr2=0x7fe6e81466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e77fe640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e8158fa0 0x7fe6e81466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e77fe640 1 -- 172.21.15.67:0/2774838241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e8157f00 con 0x7fe6e815d950 2024-09-19T05:39:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e6ffd640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e8158fa0 0x7fe6e81466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6e77fe640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e815d950 0x7fe6e8146170 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00116d0 tx=0x7fe6e0011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6dffff640 1 -- 172.21.15.67:0/2774838241 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0004220 con 0x7fe6e815d950 2024-09-19T05:39:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6dffff640 1 -- 172.21.15.67:0/2774838241 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e00043c0 con 0x7fe6e815d950 2024-09-19T05:39:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- 172.21.15.67:0/2774838241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e81581e0 con 0x7fe6e815d950 2024-09-19T05:39:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6dffff640 1 -- 172.21.15.67:0/2774838241 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000f9e0 con 0x7fe6e815d950 2024-09-19T05:39:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.483+0000 7fe6ee040640 1 -- 172.21.15.67:0/2774838241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e81587a0 con 0x7fe6e815d950 2024-09-19T05:39:49.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.487+0000 7fe6ee040640 1 -- 172.21.15.67:0/2774838241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e806c6e0 con 0x7fe6e815d950 2024-09-19T05:39:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.487+0000 7fe6dffff640 1 -- 172.21.15.67:0/2774838241 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6e000fb80 con 0x7fe6e815d950 2024-09-19T05:39:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.487+0000 7fe6dffff640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c80678f0 0x7fe6c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.487+0000 7fe6dffff640 1 -- 172.21.15.67:0/2774838241 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7fe6e00862c0 con 0x7fe6e815d950 2024-09-19T05:39:49.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.487+0000 7fe6e6ffd640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c80678f0 0x7fe6c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.487+0000 7fe6e6ffd640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c80678f0 0x7fe6c8069db0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8004bd0 tx=0x7fe6d8002170 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.491+0000 7fe6dffff640 1 -- 172.21.15.67:0/2774838241 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe6e0019030 con 0x7fe6e815d950 2024-09-19T05:39:49.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.651+0000 7fe6ee040640 1 -- 172.21.15.67:0/2774838241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7fe6e80ce7e0 con 0x7fe6e815d950 2024-09-19T05:39:49.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6dffff640 1 -- 172.21.15.67:0/2774838241 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v33) ==== 101+0+0 (secure 0 0 0) 0x7fe6e0056f30 con 0x7fe6e815d950 2024-09-19T05:39:49.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 -- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c80678f0 msgr2=0x7fe6c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c80678f0 0x7fe6c8069db0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8004bd0 tx=0x7fe6d8002170 comp rx=0 tx=0).stop 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 -- 172.21.15.67:0/2774838241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e815d950 msgr2=0x7fe6e8146170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e815d950 0x7fe6e8146170 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00116d0 tx=0x7fe6e0011b90 comp rx=0 tx=0).stop 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 -- 172.21.15.67:0/2774838241 shutdown_connections 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c80678f0 0x7fe6c8069db0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e815dd30 0x7fe6e8157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e8158fa0 0x7fe6e81466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 --2- 172.21.15.67:0/2774838241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e815d950 0x7fe6e8146170 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 -- 172.21.15.67:0/2774838241 >> 172.21.15.67:0/2774838241 conn(0x7fe6e80cd770 msgr2=0x7fe6e8072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 -- 172.21.15.67:0/2774838241 shutdown_connections 2024-09-19T05:39:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.655+0000 7fe6ee040640 1 -- 172.21.15.67:0/2774838241 wait complete. 2024-09-19T05:39:49.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-19T05:39:49.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f676e27c640 1 Processor -- start 2024-09-19T05:39:49.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f676e27c640 1 -- start start 2024-09-19T05:39:49.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f676e27c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f676809aa30 0x7f6768070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f676e27c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6768070cc0 0x7f676809ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f676e27c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67680d1510 con 0x7f676809b350 2024-09-19T05:39:49.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f676e27c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6768071100 con 0x7f676809aa30 2024-09-19T05:39:49.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f676e27c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6768071340 con 0x7f6768070cc0 2024-09-19T05:39:49.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f675f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6768070cc0 0x7f676809ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f676c819640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f676809b350 0x7f67680d0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:58768/0 (socket says 172.21.15.67:58768) 2024-09-19T05:39:49.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f676c819640 1 -- 172.21.15.67:0/2342130283 learned_addr learned my addr 172.21.15.67:0/2342130283 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:49.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f6767fff640 1 --2- 172.21.15.67:0/2342130283 >> v2:172.21.15.97:3300/0 conn(0x7f676809aa30 0x7f6768070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f675f7fe640 1 -- 172.21.15.67:0/2342130283 >> v2:172.21.15.97:3300/0 conn(0x7f676809aa30 msgr2=0x7f6768070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:49.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f67677fe640 1 -- 172.21.15.67:0/2342130283 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591560911 0 0) 0x7f67680d1510 con 0x7f676809b350 2024-09-19T05:39:49.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f675f7fe640 1 --2- 172.21.15.67:0/2342130283 >> v2:172.21.15.97:3300/0 conn(0x7f676809aa30 0x7f6768070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f675f7fe640 1 -- 172.21.15.67:0/2342130283 >> v1:172.21.15.97:6789/0 conn(0x7f676809b350 legacy=0x7f67680d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.783+0000 7f675f7fe640 1 -- 172.21.15.67:0/2342130283 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6768071620 con 0x7f6768070cc0 2024-09-19T05:39:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f675f7fe640 1 --2- 172.21.15.67:0/2342130283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6768070cc0 0x7f676809ae10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67500097c0 tx=0x7f675001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e36804c1f6aa972 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f67677fe640 1 -- 172.21.15.67:0/2342130283 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67500b2070 con 0x7f6768070cc0 2024-09-19T05:39:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f67677fe640 1 -- 172.21.15.67:0/2342130283 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67500ad680 con 0x7f6768070cc0 2024-09-19T05:39:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f67677fe640 1 -- 172.21.15.67:0/2342130283 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67500ada50 con 0x7f6768070cc0 2024-09-19T05:39:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f676e27c640 1 -- 172.21.15.67:0/2342130283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6768070cc0 msgr2=0x7f676809ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f676e27c640 1 --2- 172.21.15.67:0/2342130283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6768070cc0 0x7f676809ae10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67500097c0 tx=0x7f675001c470 comp rx=0 tx=0).stop 2024-09-19T05:39:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f676e27c640 1 -- 172.21.15.67:0/2342130283 shutdown_connections 2024-09-19T05:39:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f676e27c640 1 --2- 172.21.15.67:0/2342130283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6768070cc0 0x7f676809ae10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f676e27c640 1 --2- 172.21.15.67:0/2342130283 >> v2:172.21.15.97:3300/0 conn(0x7f676809aa30 0x7f6768070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f676e27c640 1 -- 172.21.15.67:0/2342130283 >> 172.21.15.67:0/2342130283 conn(0x7f67680d22b0 msgr2=0x7f67680d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f676e27c640 1 -- 172.21.15.67:0/2342130283 shutdown_connections 2024-09-19T05:39:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.787+0000 7f676e27c640 1 -- 172.21.15.67:0/2342130283 wait complete. 2024-09-19T05:39:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 Processor -- start 2024-09-19T05:39:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 -- start start 2024-09-19T05:39:49.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6768070cc0 0x7f67680b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f676809aa30 0x7f676815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676809b350 0x7f676815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6768163060 con 0x7f676809b350 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67680c7690 con 0x7f6768070cc0 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67681631e0 con 0x7f676809aa30 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676c819640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676809b350 0x7f676815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676c819640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676809b350 0x7f676815b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46952/0 (socket says 172.21.15.67:46952) 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676c819640 1 -- 172.21.15.67:0/3431139231 learned_addr learned my addr 172.21.15.67:0/3431139231 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f675f7fe640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f676809aa30 0x7f676815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f6767fff640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6768070cc0 0x7f67680b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676c819640 1 -- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f676809aa30 msgr2=0x7f676815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676c819640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f676809aa30 0x7f676815afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676c819640 1 -- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6768070cc0 msgr2=0x7f67680b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676c819640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6768070cc0 0x7f67680b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676c819640 1 -- 172.21.15.67:0/3431139231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676815f860 con 0x7f676809b350 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f6767fff640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6768070cc0 0x7f67680b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676c819640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676809b350 0x7f676815b4f0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f676000c7a0 tx=0x7f676000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f67657fa640 1 -- 172.21.15.67:0/3431139231 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760018070 con 0x7f676809b350 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f67657fa640 1 -- 172.21.15.67:0/3431139231 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f676000a640 con 0x7f676809b350 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 -- 172.21.15.67:0/3431139231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676815fb40 con 0x7f676809b350 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f67657fa640 1 -- 172.21.15.67:0/3431139231 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676000aab0 con 0x7f676809b350 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 -- 172.21.15.67:0/3431139231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6768160100 con 0x7f676809b350 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.791+0000 7f676e27c640 1 -- 172.21.15.67:0/3431139231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f676809ae10 con 0x7f676809b350 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.795+0000 7f67657fa640 1 -- 172.21.15.67:0/3431139231 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f676001b070 con 0x7f676809b350 2024-09-19T05:39:49.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.795+0000 7f67657fa640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f674c0678c0 0x7f674c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.795+0000 7f67657fa640 1 -- 172.21.15.67:0/3431139231 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7f67600851c0 con 0x7f676809b350 2024-09-19T05:39:49.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.795+0000 7f6767fff640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f674c0678c0 0x7f674c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.795+0000 7f6767fff640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f674c0678c0 0x7f674c069d80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6758009ae0 tx=0x7f6758008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:49.799+0000 7f67657fa640 1 -- 172.21.15.67:0/3431139231 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6760055e50 con 0x7f676809b350 2024-09-19T05:39:50.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.011+0000 7f676e27c640 1 -- 172.21.15.67:0/3431139231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f67680c7a60 con 0x7f676809b350 2024-09-19T05:39:50.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.347+0000 7f67657fa640 1 -- 172.21.15.67:0/3431139231 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v323) ==== 151+0+0 (secure 0 0 0) 0x7f6760055750 con 0x7f676809b350 2024-09-19T05:39:50.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 -- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f674c0678c0 msgr2=0x7f674c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f674c0678c0 0x7f674c069d80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6758009ae0 tx=0x7f6758008040 comp rx=0 tx=0).stop 2024-09-19T05:39:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 -- 172.21.15.67:0/3431139231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676809b350 msgr2=0x7f676815b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676809b350 0x7f676815b4f0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f676000c7a0 tx=0x7f676000cc60 comp rx=0 tx=0).stop 2024-09-19T05:39:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 -- 172.21.15.67:0/3431139231 shutdown_connections 2024-09-19T05:39:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676809b350 0x7f676815b4f0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f674c0678c0 0x7f674c069d80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f676809aa30 0x7f676815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 --2- 172.21.15.67:0/3431139231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6768070cc0 0x7f67680b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 -- 172.21.15.67:0/3431139231 >> 172.21.15.67:0/3431139231 conn(0x7f67680d22b0 msgr2=0x7f67680d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:50.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 -- 172.21.15.67:0/3431139231 shutdown_connections 2024-09-19T05:39:50.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.351+0000 7f676e27c640 1 -- 172.21.15.67:0/3431139231 wait complete. 2024-09-19T05:39:50.372 INFO:tasks.cephfs_test_runner:That a directory is split during scrub. ... ok 2024-09-19T05:39:50.372 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-09-19T05:39:50.372 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-19T05:39:50.372 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:39:50.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.499+0000 7f3f6c8ed640 1 Processor -- start 2024-09-19T05:39:50.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.499+0000 7f3f6c8ed640 1 -- start start 2024-09-19T05:39:50.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.499+0000 7f3f6c8ed640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f6815c030 0x7f3f6806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:50.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.499+0000 7f3f6c8ed640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f6806e3c0 con 0x7f3f6815d1d0 2024-09-19T05:39:50.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.499+0000 7f3f6c8ed640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f6806e6a0 con 0x7f3f6806f460 2024-09-19T05:39:50.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.499+0000 7f3f6c8ed640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3f6806e980 con 0x7f3f6815c030 2024-09-19T05:39:50.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.499+0000 7f3f6659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f6815c030 0x7f3f6806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:50.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.499+0000 7f3f65d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3f6815d1d0 0x7f3f680b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58356/0 (socket says 172.21.15.67:58356) 2024-09-19T05:39:50.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.499+0000 7f3f6659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f6815c030 0x7f3f6806dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46958/0 (socket says 172.21.15.67:46958) 2024-09-19T05:39:50.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.499+0000 7f3f65d9b640 1 -- 172.21.15.67:0/15082209 learned_addr learned my addr 172.21.15.67:0/15082209 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:50.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6659c640 1 -- 172.21.15.67:0/15082209 >> v1:172.21.15.97:6789/0 conn(0x7f3f6806f460 legacy=0x7f3f680acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:50.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6659c640 1 -- 172.21.15.67:0/15082209 >> v1:172.21.15.67:6789/0 conn(0x7f3f6815d1d0 legacy=0x7f3f680b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6659c640 1 -- 172.21.15.67:0/15082209 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6806ec60 con 0x7f3f6815c030 2024-09-19T05:39:50.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6559a640 1 -- 172.21.15.67:0/15082209 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834336018 0 0) 0x7f3f6806e3c0 con 0x7f3f6815d1d0 2024-09-19T05:39:50.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6659c640 1 --2- 172.21.15.67:0/15082209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 0x7f3f6806dde0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f3f500097c0 tx=0x7f3f5001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b6807f2882cec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:50.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6559a640 1 -- 172.21.15.67:0/15082209 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f500b1070 con 0x7f3f6815c030 2024-09-19T05:39:50.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6559a640 1 -- 172.21.15.67:0/15082209 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f500ac5f0 con 0x7f3f6815c030 2024-09-19T05:39:50.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6559a640 1 -- 172.21.15.67:0/15082209 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f500ac9c0 con 0x7f3f6815c030 2024-09-19T05:39:50.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/15082209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 msgr2=0x7f3f6806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6c8ed640 1 --2- 172.21.15.67:0/15082209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 0x7f3f6806dde0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f3f500097c0 tx=0x7f3f5001c430 comp rx=0 tx=0).stop 2024-09-19T05:39:50.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/15082209 shutdown_connections 2024-09-19T05:39:50.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6c8ed640 1 --2- 172.21.15.67:0/15082209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 0x7f3f6806dde0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/15082209 >> 172.21.15.67:0/15082209 conn(0x7f3f680d0080 msgr2=0x7f3f680d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:50.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/15082209 shutdown_connections 2024-09-19T05:39:50.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.503+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/15082209 wait complete. 2024-09-19T05:39:50.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 Processor -- start 2024-09-19T05:39:50.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 -- start start 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f6806f460 0x7f3f6814b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 0x7f3f6815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f6815d1d0 0x7f3f68149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6815c590 con 0x7f3f6815c030 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6815c410 con 0x7f3f6815d1d0 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3f680ad6c0 con 0x7f3f6806f460 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f65d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 0x7f3f6815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f65d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 0x7f3f6815e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46964/0 (socket says 172.21.15.67:46964) 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f65d9b640 1 -- 172.21.15.67:0/2814642663 learned_addr learned my addr 172.21.15.67:0/2814642663 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6659c640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f6806f460 0x7f3f6814b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f66d9d640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f6815d1d0 0x7f3f68149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:50.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f65d9b640 1 -- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f6806f460 msgr2=0x7f3f6814b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f65d9b640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f6806f460 0x7f3f6814b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f65d9b640 1 -- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f6815d1d0 msgr2=0x7f3f68149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f65d9b640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f6815d1d0 0x7f3f68149290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f65d9b640 1 -- 172.21.15.67:0/2814642663 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6814a2d0 con 0x7f3f6815c030 2024-09-19T05:39:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f65d9b640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 0x7f3f6815e9d0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800c4b0 tx=0x7f3f5800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f5effd640 1 -- 172.21.15.67:0/2814642663 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58018070 con 0x7f3f6815c030 2024-09-19T05:39:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f5effd640 1 -- 172.21.15.67:0/2814642663 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f58007500 con 0x7f3f6815c030 2024-09-19T05:39:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/2814642663 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6814a5b0 con 0x7f3f6815c030 2024-09-19T05:39:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f5effd640 1 -- 172.21.15.67:0/2814642663 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58004a30 con 0x7f3f6815c030 2024-09-19T05:39:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/2814642663 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6814ab70 con 0x7f3f6815c030 2024-09-19T05:39:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/2814642663 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f6806dde0 con 0x7f3f6815c030 2024-09-19T05:39:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f5effd640 1 -- 172.21.15.67:0/2814642663 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f5801b070 con 0x7f3f6815c030 2024-09-19T05:39:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f5effd640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f480678c0 0x7f3f48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.507+0000 7f3f5effd640 1 -- 172.21.15.67:0/2814642663 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7f3f58084e80 con 0x7f3f6815c030 2024-09-19T05:39:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.511+0000 7f3f6659c640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f480678c0 0x7f3f48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.511+0000 7f3f6659c640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f480678c0 0x7f3f48069d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3f500ae000 tx=0x7f3f50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:50.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.515+0000 7f3f5effd640 1 -- 172.21.15.67:0/2814642663 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3f58055a80 con 0x7f3f6815c030 2024-09-19T05:39:50.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.679+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/2814642663 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f680d0f20 con 0x7f3f6815c030 2024-09-19T05:39:50.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.679+0000 7f3f5effd640 1 -- 172.21.15.67:0/2814642663 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+13527 (secure 0 0 0) 0x7f3f58055380 con 0x7f3f6815c030 2024-09-19T05:39:50.679 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:50.680 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":107,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:39:48.332375+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/1158789793":"2024-09-20T05:39:45.318996+0000","172.21.15.67:6834/1158789793":"2024-09-20T05:39:45.318996+0000","172.21.15.97:6835/123788622":"2024-09-20T05:39:30.364806+0000","172.21.15.97:6834/123788622":"2024-09-20T05:39:30.364806+0000","172.21.15.67:6834/358275731":"2024-09-20T05:39:29.369128+0000","172.21.15.67:6832/358275731":"2024-09-20T05:39:29.369128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:39:50.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f480678c0 msgr2=0x7f3f48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f480678c0 0x7f3f48069d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3f500ae000 tx=0x7f3f50008040 comp rx=0 tx=0).stop 2024-09-19T05:39:50.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/2814642663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 msgr2=0x7f3f6815e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 0x7f3f6815e9d0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800c4b0 tx=0x7f3f5800c970 comp rx=0 tx=0).stop 2024-09-19T05:39:50.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/2814642663 shutdown_connections 2024-09-19T05:39:50.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f6815d1d0 0x7f3f68149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f6815c030 0x7f3f6815e9d0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f480678c0 0x7f3f48069d80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 --2- 172.21.15.67:0/2814642663 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f6806f460 0x7f3f6814b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/2814642663 >> 172.21.15.67:0/2814642663 conn(0x7f3f680d0080 msgr2=0x7f3f680b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:50.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/2814642663 shutdown_connections 2024-09-19T05:39:50.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.683+0000 7f3f6c8ed640 1 -- 172.21.15.67:0/2814642663 wait complete. 2024-09-19T05:39:50.700 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:39:50.701 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:39:50.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.819+0000 7fcfa514c640 1 Processor -- start 2024-09-19T05:39:50.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcfa514c640 1 -- start start 2024-09-19T05:39:50.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcfa514c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcfa015b390 0x7fcfa00ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:50.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcfa514c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa00cfc00 con 0x7fcfa006ef70 2024-09-19T05:39:50.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcfa514c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa00d0e60 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcfa514c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fcfa006f4c0 con 0x7fcfa015b390 2024-09-19T05:39:50.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcf9ed9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcfa015b390 0x7fcfa00ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:50.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcf9e59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcfa006ef70 0x7fcfa00cf0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58366/0 (socket says 172.21.15.67:58366) 2024-09-19T05:39:50.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcf9e59c640 1 -- 172.21.15.67:0/3312272402 learned_addr learned my addr 172.21.15.67:0/3312272402 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:50.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcf9ed9d640 1 -- 172.21.15.67:0/3312272402 >> v1:172.21.15.97:6789/0 conn(0x7fcfa00cf7b0 legacy=0x7fcfa015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcf9ed9d640 1 -- 172.21.15.67:0/3312272402 >> v1:172.21.15.67:6789/0 conn(0x7fcfa006ef70 legacy=0x7fcfa00cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcf9dd9b640 1 -- 172.21.15.67:0/3312272402 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165731357 0 0) 0x7fcfa00cfc00 con 0x7fcfa006ef70 2024-09-19T05:39:50.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.823+0000 7fcf9ed9d640 1 -- 172.21.15.67:0/3312272402 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa00d0b80 con 0x7fcfa015b390 2024-09-19T05:39:50.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9ed9d640 1 --2- 172.21.15.67:0/3312272402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa015b390 0x7fcfa00ce440 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000ba60 tx=0x7fcf9001eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7695eddf003cf7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:50.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9dd9b640 1 -- 172.21.15.67:0/3312272402 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf900b4070 con 0x7fcfa015b390 2024-09-19T05:39:50.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9dd9b640 1 -- 172.21.15.67:0/3312272402 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf900a7a40 con 0x7fcfa015b390 2024-09-19T05:39:50.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9dd9b640 1 -- 172.21.15.67:0/3312272402 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf900a7e10 con 0x7fcfa015b390 2024-09-19T05:39:50.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- 172.21.15.67:0/3312272402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa015b390 msgr2=0x7fcfa00ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 --2- 172.21.15.67:0/3312272402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa015b390 0x7fcfa00ce440 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000ba60 tx=0x7fcf9001eb70 comp rx=0 tx=0).stop 2024-09-19T05:39:50.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- 172.21.15.67:0/3312272402 shutdown_connections 2024-09-19T05:39:50.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 --2- 172.21.15.67:0/3312272402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa015b390 0x7fcfa00ce440 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- 172.21.15.67:0/3312272402 >> 172.21.15.67:0/3312272402 conn(0x7fcfa00b6570 msgr2=0x7fcfa00b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:50.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- 172.21.15.67:0/3312272402 shutdown_connections 2024-09-19T05:39:50.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- 172.21.15.67:0/3312272402 wait complete. 2024-09-19T05:39:50.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 Processor -- start 2024-09-19T05:39:50.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- start start 2024-09-19T05:39:50.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfa006ef70 0x7fcfa014be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa00cf7b0 0x7fcfa014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfa015b390 0x7fcfa014c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa006bcc0 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa00cd680 con 0x7fcfa015b390 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa006be40 con 0x7fcfa006ef70 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa00cf7b0 0x7fcfa014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa00cf7b0 0x7fcfa014b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46978/0 (socket says 172.21.15.67:46978) 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9e59c640 1 -- 172.21.15.67:0/2575408591 learned_addr learned my addr 172.21.15.67:0/2575408591 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9ed9d640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfa006ef70 0x7fcfa014be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9f59e640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfa015b390 0x7fcfa014c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9e59c640 1 -- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfa006ef70 msgr2=0x7fcfa014be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9e59c640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfa006ef70 0x7fcfa014be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9e59c640 1 -- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfa015b390 msgr2=0x7fcfa014c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9e59c640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfa015b390 0x7fcfa014c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9e59c640 1 -- 172.21.15.67:0/2575408591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa00aed50 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9f59e640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfa015b390 0x7fcfa014c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:50.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf9e59c640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa00cf7b0 0x7fcfa014b2f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400c4a0 tx=0x7fcf9400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:50.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf877fe640 1 -- 172.21.15.67:0/2575408591 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94018070 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf877fe640 1 -- 172.21.15.67:0/2575408591 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf940074e0 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- 172.21.15.67:0/2575408591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa015e570 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcf877fe640 1 -- 172.21.15.67:0/2575408591 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94004a30 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.827+0000 7fcfa514c640 1 -- 172.21.15.67:0/2575408591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa00b0f10 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.831+0000 7fcfa514c640 1 -- 172.21.15.67:0/2575408591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa0073a30 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.831+0000 7fcf877fe640 1 -- 172.21.15.67:0/2575408591 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf9401b070 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.831+0000 7fcf877fe640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf8c0678f0 0x7fcf8c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.831+0000 7fcf877fe640 1 -- 172.21.15.67:0/2575408591 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7fcf94084e70 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.831+0000 7fcf9ed9d640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf8c0678f0 0x7fcf8c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.831+0000 7fcf9ed9d640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf8c0678f0 0x7fcf8c069db0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcf900b1000 tx=0x7fcf900a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:50.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.835+0000 7fcf877fe640 1 -- 172.21.15.67:0/2575408591 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fcf94055a60 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.991+0000 7fcfa514c640 1 -- 172.21.15.67:0/2575408591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcfa00b0cc0 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcf877fe640 1 -- 172.21.15.67:0/2575408591 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) ==== 93+0+10 (secure 0 0 0) 0x7fcf94055360 con 0x7fcfa00cf7b0 2024-09-19T05:39:50.993 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:39:50.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 -- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf8c0678f0 msgr2=0x7fcf8c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf8c0678f0 0x7fcf8c069db0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcf900b1000 tx=0x7fcf900a9070 comp rx=0 tx=0).stop 2024-09-19T05:39:50.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 -- 172.21.15.67:0/2575408591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa00cf7b0 msgr2=0x7fcfa014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa00cf7b0 0x7fcfa014b2f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400c4a0 tx=0x7fcf9400c960 comp rx=0 tx=0).stop 2024-09-19T05:39:50.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 -- 172.21.15.67:0/2575408591 shutdown_connections 2024-09-19T05:39:50.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfa015b390 0x7fcfa014c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa00cf7b0 0x7fcfa014b2f0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcf8c0678f0 0x7fcf8c069db0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 --2- 172.21.15.67:0/2575408591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfa006ef70 0x7fcfa014be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 -- 172.21.15.67:0/2575408591 >> 172.21.15.67:0/2575408591 conn(0x7fcfa00b6570 msgr2=0x7fcfa00ae640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 -- 172.21.15.67:0/2575408591 shutdown_connections 2024-09-19T05:39:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:50.995+0000 7fcfa514c640 1 -- 172.21.15.67:0/2575408591 wait complete. 2024-09-19T05:39:51.014 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-19T05:39:51.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c9d35640 1 Processor -- start 2024-09-19T05:39:51.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c9d35640 1 -- start start 2024-09-19T05:39:51.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c9d35640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5c40d1590 0x7ff5c40d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:51.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c9d35640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5c40d4d40 con 0x7ff5c4161da0 2024-09-19T05:39:51.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c9d35640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5c40d5020 con 0x7ff5c40b51d0 2024-09-19T05:39:51.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c9d35640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff5c40d0840 con 0x7ff5c40d1590 2024-09-19T05:39:51.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c2ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5c40d1590 0x7ff5c40d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:51.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff5c4161da0 0x7ff5c40d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58374/0 (socket says 172.21.15.67:58374) 2024-09-19T05:39:51.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c37fe640 1 -- 172.21.15.67:0/3129126231 learned_addr learned my addr 172.21.15.67:0/3129126231 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:51.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c2ffd640 1 -- 172.21.15.67:0/3129126231 >> v1:172.21.15.97:6789/0 conn(0x7ff5c40b51d0 legacy=0x7ff5c40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:51.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c2ffd640 1 -- 172.21.15.67:0/3129126231 >> v1:172.21.15.67:6789/0 conn(0x7ff5c4161da0 legacy=0x7ff5c40d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:51.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.127+0000 7ff5c2ffd640 1 -- 172.21.15.67:0/3129126231 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c40d5300 con 0x7ff5c40d1590 2024-09-19T05:39:51.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c2ffd640 1 --2- 172.21.15.67:0/3129126231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40d1590 0x7ff5c40d1af0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0097c0 tx=0x7ff5ac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189bf5736baf68c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:51.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c27fc640 1 -- 172.21.15.67:0/3129126231 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0b0070 con 0x7ff5c40d1590 2024-09-19T05:39:51.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c27fc640 1 -- 172.21.15.67:0/3129126231 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0ab600 con 0x7ff5c40d1590 2024-09-19T05:39:51.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c27fc640 1 -- 172.21.15.67:0/3129126231 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0ab9d0 con 0x7ff5c40d1590 2024-09-19T05:39:51.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 -- 172.21.15.67:0/3129126231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40d1590 msgr2=0x7ff5c40d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:51.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 --2- 172.21.15.67:0/3129126231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40d1590 0x7ff5c40d1af0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0097c0 tx=0x7ff5ac01c460 comp rx=0 tx=0).stop 2024-09-19T05:39:51.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 -- 172.21.15.67:0/3129126231 shutdown_connections 2024-09-19T05:39:51.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 --2- 172.21.15.67:0/3129126231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40d1590 0x7ff5c40d1af0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:51.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 -- 172.21.15.67:0/3129126231 >> 172.21.15.67:0/3129126231 conn(0x7ff5c408bfc0 msgr2=0x7ff5c40d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:51.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 -- 172.21.15.67:0/3129126231 shutdown_connections 2024-09-19T05:39:51.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 -- 172.21.15.67:0/3129126231 wait complete. 2024-09-19T05:39:51.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 Processor -- start 2024-09-19T05:39:51.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 -- start start 2024-09-19T05:39:51.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40b51d0 0x7ff5c414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5c40d1590 0x7ff5c40cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5c4161da0 0x7ff5c40b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c40d01f0 con 0x7ff5c40b51d0 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c40d0070 con 0x7ff5c40d1590 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c9d35640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c40d0370 con 0x7ff5c4161da0 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40b51d0 0x7ff5c414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40b51d0 0x7ff5c414dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46984/0 (socket says 172.21.15.67:46984) 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c37fe640 1 -- 172.21.15.67:0/733763740 learned_addr learned my addr 172.21.15.67:0/733763740 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c37fe640 1 -- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5c4161da0 msgr2=0x7ff5c40b85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c2ffd640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5c40d1590 0x7ff5c40cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c3fff640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5c4161da0 0x7ff5c40b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c37fe640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5c4161da0 0x7ff5c40b85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:51.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c37fe640 1 -- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5c40d1590 msgr2=0x7ff5c40cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:51.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c37fe640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5c40d1590 0x7ff5c40cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:51.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c37fe640 1 -- 172.21.15.67:0/733763740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c40ccbe0 con 0x7ff5c40b51d0 2024-09-19T05:39:51.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.131+0000 7ff5c37fe640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40b51d0 0x7ff5c414dad0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c3a0 tx=0x7ff5b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:51.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5bbfff640 1 -- 172.21.15.67:0/733763740 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4017070 con 0x7ff5c40b51d0 2024-09-19T05:39:51.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5bbfff640 1 -- 172.21.15.67:0/733763740 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b4005cf0 con 0x7ff5c40b51d0 2024-09-19T05:39:51.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5c9d35640 1 -- 172.21.15.67:0/733763740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c40ccec0 con 0x7ff5c40b51d0 2024-09-19T05:39:51.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5bbfff640 1 -- 172.21.15.67:0/733763740 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40072f0 con 0x7ff5c40b51d0 2024-09-19T05:39:51.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5c9d35640 1 -- 172.21.15.67:0/733763740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c40cd480 con 0x7ff5c40b51d0 2024-09-19T05:39:51.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5c9d35640 1 -- 172.21.15.67:0/733763740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c40d1af0 con 0x7ff5c40b51d0 2024-09-19T05:39:51.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5bbfff640 1 -- 172.21.15.67:0/733763740 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5b401a070 con 0x7ff5c40b51d0 2024-09-19T05:39:51.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5bbfff640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5a40678c0 0x7ff5a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:51.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5bbfff640 1 -- 172.21.15.67:0/733763740 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7ff5b4085260 con 0x7ff5c40b51d0 2024-09-19T05:39:51.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5c2ffd640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5a40678c0 0x7ff5a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:51.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.135+0000 7ff5c2ffd640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5a40678c0 0x7ff5a4069d80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0ad000 tx=0x7ff5ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:51.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.139+0000 7ff5bbfff640 1 -- 172.21.15.67:0/733763740 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff5b4021020 con 0x7ff5c40b51d0 2024-09-19T05:39:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:51.363+0000 7ff5c9d35640 1 -- 172.21.15.67:0/733763740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7ff5c414e010 con 0x7ff5c40b51d0 2024-09-19T05:39:52.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.359+0000 7ff5bbfff640 1 -- 172.21.15.67:0/733763740 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v325) ==== 161+0+0 (secure 0 0 0) 0x7ff5b4055fd0 con 0x7ff5c40b51d0 2024-09-19T05:39:52.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 -- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5a40678c0 msgr2=0x7ff5a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5a40678c0 0x7ff5a4069d80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0ad000 tx=0x7ff5ac008040 comp rx=0 tx=0).stop 2024-09-19T05:39:52.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 -- 172.21.15.67:0/733763740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40b51d0 msgr2=0x7ff5c414dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40b51d0 0x7ff5c414dad0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c3a0 tx=0x7ff5b400c860 comp rx=0 tx=0).stop 2024-09-19T05:39:52.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 -- 172.21.15.67:0/733763740 shutdown_connections 2024-09-19T05:39:52.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5a40678c0 0x7ff5a4069d80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5c4161da0 0x7ff5c40b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5c40d1590 0x7ff5c40cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 --2- 172.21.15.67:0/733763740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5c40b51d0 0x7ff5c414dad0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 -- 172.21.15.67:0/733763740 >> 172.21.15.67:0/733763740 conn(0x7ff5c408bfc0 msgr2=0x7ff5c415b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:52.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 -- 172.21.15.67:0/733763740 shutdown_connections 2024-09-19T05:39:52.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.363+0000 7ff5c9d35640 1 -- 172.21.15.67:0/733763740 wait complete. 2024-09-19T05:39:52.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:39:52.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f9421547640 1 Processor -- start 2024-09-19T05:39:52.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f9421547640 1 -- start start 2024-09-19T05:39:52.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f9421547640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 0x7f941c0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f9421547640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f941c06dfc0 0x7f941c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f9421547640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f941c0aef30 con 0x7f941c06fea0 2024-09-19T05:39:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f9421547640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f941c072210 con 0x7f941c06dfc0 2024-09-19T05:39:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f9421547640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f941c0ae0f0 con 0x7f941c15b1d0 2024-09-19T05:39:52.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f94127fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f941c06dfc0 0x7f941c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f941b7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f941c06fea0 0x7f941c15ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:58794/0 (socket says 172.21.15.67:58794) 2024-09-19T05:39:52.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f941affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 0x7f941c0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f941b7fe640 1 -- 172.21.15.67:0/4020593553 learned_addr learned my addr 172.21.15.67:0/4020593553 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f94127fc640 1 -- 172.21.15.67:0/4020593553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 msgr2=0x7f941c0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f94127fc640 1 --2- 172.21.15.67:0/4020593553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 0x7f941c0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f94127fc640 1 -- 172.21.15.67:0/4020593553 >> v1:172.21.15.97:6789/0 conn(0x7f941c06fea0 legacy=0x7f941c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.515+0000 7f94127fc640 1 -- 172.21.15.67:0/4020593553 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c0ae3b0 con 0x7f941c06dfc0 2024-09-19T05:39:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f94127fc640 1 --2- 172.21.15.67:0/4020593553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f941c06dfc0 0x7f941c06f960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f940c0097c0 tx=0x7f940c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=977cf468bb32c849 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f941a7fc640 1 -- 172.21.15.67:0/4020593553 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c0b0070 con 0x7f941c06dfc0 2024-09-19T05:39:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f941a7fc640 1 -- 172.21.15.67:0/4020593553 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f940c0a4e50 con 0x7f941c06dfc0 2024-09-19T05:39:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f941a7fc640 1 -- 172.21.15.67:0/4020593553 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c0ab820 con 0x7f941c06dfc0 2024-09-19T05:39:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f9421547640 1 -- 172.21.15.67:0/4020593553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f941c06dfc0 msgr2=0x7f941c06f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f9421547640 1 --2- 172.21.15.67:0/4020593553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f941c06dfc0 0x7f941c06f960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f940c0097c0 tx=0x7f940c01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f9421547640 1 -- 172.21.15.67:0/4020593553 shutdown_connections 2024-09-19T05:39:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f9421547640 1 --2- 172.21.15.67:0/4020593553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f941c06dfc0 0x7f941c06f960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f9421547640 1 --2- 172.21.15.67:0/4020593553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 0x7f941c0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f9421547640 1 -- 172.21.15.67:0/4020593553 >> 172.21.15.67:0/4020593553 conn(0x7f941c0b1e50 msgr2=0x7f941c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:52.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f9421547640 1 -- 172.21.15.67:0/4020593553 shutdown_connections 2024-09-19T05:39:52.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.519+0000 7f9421547640 1 -- 172.21.15.67:0/4020593553 wait complete. 2024-09-19T05:39:52.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 Processor -- start 2024-09-19T05:39:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 -- start start 2024-09-19T05:39:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f941c06dfc0 0x7f941c1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f941c06fea0 0x7f941c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 0x7f941c158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f941c0b4440 con 0x7f941c06dfc0 2024-09-19T05:39:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f941c072420 con 0x7f941c06fea0 2024-09-19T05:39:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f941c06e850 con 0x7f941c15b1d0 2024-09-19T05:39:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f941c06dfc0 0x7f941c1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f941c06dfc0 0x7f941c1517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46994/0 (socket says 172.21.15.67:46994) 2024-09-19T05:39:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941affd640 1 -- 172.21.15.67:0/2115262439 learned_addr learned my addr 172.21.15.67:0/2115262439 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941b7fe640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 0x7f941c158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f94127fc640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f941c06fea0 0x7f941c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941affd640 1 -- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 msgr2=0x7f941c158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941affd640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 0x7f941c158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941affd640 1 -- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f941c06fea0 msgr2=0x7f941c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941affd640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f941c06fea0 0x7f941c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941affd640 1 -- 172.21.15.67:0/2115262439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c1f2e70 con 0x7f941c06dfc0 2024-09-19T05:39:52.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941b7fe640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 0x7f941c158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:52.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f941affd640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f941c06dfc0 0x7f941c1517c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f940400e870 tx=0x7f940400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:52.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9413fff640 1 -- 172.21.15.67:0/2115262439 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9404017070 con 0x7f941c06dfc0 2024-09-19T05:39:52.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9413fff640 1 -- 172.21.15.67:0/2115262439 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f940400c940 con 0x7f941c06dfc0 2024-09-19T05:39:52.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 -- 172.21.15.67:0/2115262439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941c1f3150 con 0x7f941c06dfc0 2024-09-19T05:39:52.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9413fff640 1 -- 172.21.15.67:0/2115262439 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940400ccf0 con 0x7f941c06dfc0 2024-09-19T05:39:52.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 -- 172.21.15.67:0/2115262439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941c1f3710 con 0x7f941c06dfc0 2024-09-19T05:39:52.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9421547640 1 -- 172.21.15.67:0/2115262439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f941c0adbb0 con 0x7f941c06dfc0 2024-09-19T05:39:52.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.523+0000 7f9413fff640 1 -- 172.21.15.67:0/2115262439 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f940401a070 con 0x7f941c06dfc0 2024-09-19T05:39:52.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.527+0000 7f9413fff640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93fc0678c0 0x7f93fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.527+0000 7f9413fff640 1 -- 172.21.15.67:0/2115262439 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7f9404085e50 con 0x7f941c06dfc0 2024-09-19T05:39:52.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.527+0000 7f94127fc640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93fc0678c0 0x7f93fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.527+0000 7f94127fc640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93fc0678c0 0x7f93fc069d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f940c0ad000 tx=0x7f940c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:52.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.531+0000 7f9413fff640 1 -- 172.21.15.67:0/2115262439 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9404056a50 con 0x7f941c06dfc0 2024-09-19T05:39:52.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.691+0000 7f9421547640 1 -- 172.21.15.67:0/2115262439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f941c0b4cb0 con 0x7f941c06dfc0 2024-09-19T05:39:52.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.695+0000 7f9413fff640 1 -- 172.21.15.67:0/2115262439 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f9404056350 con 0x7f941c06dfc0 2024-09-19T05:39:52.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 -- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93fc0678c0 msgr2=0x7f93fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93fc0678c0 0x7f93fc069d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f940c0ad000 tx=0x7f940c008040 comp rx=0 tx=0).stop 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 -- 172.21.15.67:0/2115262439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f941c06dfc0 msgr2=0x7f941c1517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f941c06dfc0 0x7f941c1517c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f940400e870 tx=0x7f940400ec70 comp rx=0 tx=0).stop 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 -- 172.21.15.67:0/2115262439 shutdown_connections 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f93fc0678c0 0x7f93fc069d80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f941c15b1d0 0x7f941c158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f941c06fea0 0x7f941c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 --2- 172.21.15.67:0/2115262439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f941c06dfc0 0x7f941c1517c0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 -- 172.21.15.67:0/2115262439 >> 172.21.15.67:0/2115262439 conn(0x7f941c0b1e50 msgr2=0x7f941c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 -- 172.21.15.67:0/2115262439 shutdown_connections 2024-09-19T05:39:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:52.699+0000 7f9421547640 1 -- 172.21.15.67:0/2115262439 wait complete. 2024-09-19T05:39:52.714 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:39:52.715 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:39:52.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:39:52.855 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:39:52.855 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:39:52.855 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:52.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:39:52.862 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:39:52.862 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:52.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:39:52.868 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:39:52.868 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:52.910 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:39:52.910 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:39:52.910 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:39:52.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:39:52.916 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:39:52.917 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:39:53.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.079+0000 7f4705cd1640 1 Processor -- start 2024-09-19T05:39:53.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f4705cd1640 1 -- start start 2024-09-19T05:39:53.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f4705cd1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f470006dde0 0x7f47000b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f4705cd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47000b3510 0x7f470006f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f4705cd1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470006e3c0 con 0x7f470015c030 2024-09-19T05:39:53.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f4705cd1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f470006e6a0 con 0x7f470006dde0 2024-09-19T05:39:53.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f4705cd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f470006e980 con 0x7f47000b3510 2024-09-19T05:39:53.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46ff7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f470015c030 0x7f470015d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58376/0 (socket says 172.21.15.67:58376) 2024-09-19T05:39:53.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46ff7fe640 1 -- 172.21.15.67:0/486783727 learned_addr learned my addr 172.21.15.67:0/486783727 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:53.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46feffd640 1 --2- 172.21.15.67:0/486783727 >> v2:172.21.15.67:3300/0 conn(0x7f470006dde0 0x7f47000b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46fffff640 1 --2- 172.21.15.67:0/486783727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47000b3510 0x7f470006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46fe7fc640 1 -- 172.21.15.67:0/486783727 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699299505 0 0) 0x7f470006e3c0 con 0x7f470015c030 2024-09-19T05:39:53.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46fe7fc640 1 -- 172.21.15.67:0/486783727 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e8003530 con 0x7f470015c030 2024-09-19T05:39:53.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46feffd640 1 -- 172.21.15.67:0/486783727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47000b3510 msgr2=0x7f470006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:53.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46feffd640 1 --2- 172.21.15.67:0/486783727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47000b3510 0x7f470006f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46feffd640 1 -- 172.21.15.67:0/486783727 >> v1:172.21.15.67:6789/0 conn(0x7f470015c030 legacy=0x7f470015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46feffd640 1 -- 172.21.15.67:0/486783727 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470006ec60 con 0x7f470006dde0 2024-09-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.083+0000 7f46feffd640 1 --2- 172.21.15.67:0/486783727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470006dde0 0x7f47000b2fd0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f46f40097c0 tx=0x7f46f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dad7aa4d9e842ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fe7fc640 1 -- 172.21.15.67:0/486783727 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f40b2070 con 0x7f470006dde0 2024-09-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fe7fc640 1 -- 172.21.15.67:0/486783727 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f40ad680 con 0x7f470006dde0 2024-09-19T05:39:53.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fe7fc640 1 -- 172.21.15.67:0/486783727 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f40ada50 con 0x7f470006dde0 2024-09-19T05:39:53.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- 172.21.15.67:0/486783727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470006dde0 msgr2=0x7f47000b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 --2- 172.21.15.67:0/486783727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470006dde0 0x7f47000b2fd0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f46f40097c0 tx=0x7f46f401c470 comp rx=0 tx=0).stop 2024-09-19T05:39:53.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- 172.21.15.67:0/486783727 shutdown_connections 2024-09-19T05:39:53.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 --2- 172.21.15.67:0/486783727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47000b3510 0x7f470006f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 --2- 172.21.15.67:0/486783727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470006dde0 0x7f47000b2fd0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- 172.21.15.67:0/486783727 >> 172.21.15.67:0/486783727 conn(0x7f47000d0080 msgr2=0x7f47000d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:53.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- 172.21.15.67:0/486783727 shutdown_connections 2024-09-19T05:39:53.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- 172.21.15.67:0/486783727 wait complete. 2024-09-19T05:39:53.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 Processor -- start 2024-09-19T05:39:53.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- start start 2024-09-19T05:39:53.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f470006dde0 0x7f470015fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47000b3510 0x7f4700154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470015c030 0x7f470009bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47001692f0 con 0x7f470015c030 2024-09-19T05:39:53.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f470015c620 con 0x7f47000b3510 2024-09-19T05:39:53.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4700169470 con 0x7f470006dde0 2024-09-19T05:39:53.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470015c030 0x7f470009bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470015c030 0x7f470009bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47012/0 (socket says 172.21.15.67:47012) 2024-09-19T05:39:53.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fffff640 1 -- 172.21.15.67:0/2412305307 learned_addr learned my addr 172.21.15.67:0/2412305307 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:53.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46ff7fe640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f470006dde0 0x7f470015fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fffff640 1 -- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f470006dde0 msgr2=0x7f470015fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46feffd640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47000b3510 0x7f4700154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fffff640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f470006dde0 0x7f470015fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fffff640 1 -- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47000b3510 msgr2=0x7f4700154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fffff640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47000b3510 0x7f4700154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fffff640 1 -- 172.21.15.67:0/2412305307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4700155ef0 con 0x7f470015c030 2024-09-19T05:39:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46fffff640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470015c030 0x7f470009bad0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f46f800efc0 tx=0x7f46f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46e7fff640 1 -- 172.21.15.67:0/2412305307 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8018020 con 0x7f470015c030 2024-09-19T05:39:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46e7fff640 1 -- 172.21.15.67:0/2412305307 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f8014480 con 0x7f470015c030 2024-09-19T05:39:53.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- 172.21.15.67:0/2412305307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470009c770 con 0x7f470015c030 2024-09-19T05:39:53.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f46e7fff640 1 -- 172.21.15.67:0/2412305307 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8014870 con 0x7f470015c030 2024-09-19T05:39:53.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.087+0000 7f4705cd1640 1 -- 172.21.15.67:0/2412305307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470009a2d0 con 0x7f470015c030 2024-09-19T05:39:53.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.091+0000 7f4705cd1640 1 -- 172.21.15.67:0/2412305307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47000b2fd0 con 0x7f470015c030 2024-09-19T05:39:53.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.091+0000 7f46e7fff640 1 -- 172.21.15.67:0/2412305307 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46f801b020 con 0x7f470015c030 2024-09-19T05:39:53.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.091+0000 7f46e7fff640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46ec0678c0 0x7f46ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.091+0000 7f46e7fff640 1 -- 172.21.15.67:0/2412305307 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7f46f8086d50 con 0x7f470015c030 2024-09-19T05:39:53.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.091+0000 7f46ff7fe640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46ec0678c0 0x7f46ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.091+0000 7f46ff7fe640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46ec0678c0 0x7f46ec069d80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f46f0007fd0 tx=0x7f46f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:53.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.095+0000 7f46e7fff640 1 -- 172.21.15.67:0/2412305307 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f46f8022070 con 0x7f470015c030 2024-09-19T05:39:53.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.291+0000 7f4705cd1640 1 -- 172.21.15.67:0/2412305307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47000d0f20 con 0x7f470015c030 2024-09-19T05:39:53.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.291+0000 7f46e7fff640 1 -- 172.21.15.67:0/2412305307 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+3908 (secure 0 0 0) 0x7f46f8010040 con 0x7f470015c030 2024-09-19T05:39:53.293 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:53.293 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":77,"btime":"2024-09-19T05:39:46:322711+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1728684005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1728684005},{"type":"v1","addr":"172.21.15.97:6835","nonce":1728684005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":5831,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/761363037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":761363037},{"type":"v1","addr":"172.21.15.97:6837","nonce":761363037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4154460020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4154460020},{"type":"v1","addr":"172.21.15.67:6833","nonce":4154460020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7620,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1821647429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1821647429},{"type":"v1","addr":"172.21.15.67:6835","nonce":1821647429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[]} 2024-09-19T05:39:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 77 2024-09-19T05:39:53.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 -- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46ec0678c0 msgr2=0x7f46ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46ec0678c0 0x7f46ec069d80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f46f0007fd0 tx=0x7f46f0009040 comp rx=0 tx=0).stop 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 -- 172.21.15.67:0/2412305307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470015c030 msgr2=0x7f470009bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470015c030 0x7f470009bad0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f46f800efc0 tx=0x7f46f800c490 comp rx=0 tx=0).stop 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 -- 172.21.15.67:0/2412305307 shutdown_connections 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f470015c030 0x7f470009bad0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47000b3510 0x7f4700154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46ec0678c0 0x7f46ec069d80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 --2- 172.21.15.67:0/2412305307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f470006dde0 0x7f470015fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 -- 172.21.15.67:0/2412305307 >> 172.21.15.67:0/2412305307 conn(0x7f47000d0080 msgr2=0x7f470015c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 -- 172.21.15.67:0/2412305307 shutdown_connections 2024-09-19T05:39:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.295+0000 7f4705cd1640 1 -- 172.21.15.67:0/2412305307 wait complete. 2024-09-19T05:39:53.313 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:39:53.313 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:39:53.313 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:39:53.314 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:53.314 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:39:53.314 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:39:53.314 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:39:53.314 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:53.314 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:39:53.314 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:39:53.315 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:39:53.315 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:53.315 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:39:53.315 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:39:53.315 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:39:53.315 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:53.327 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:39:53.328 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:39:53.328 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:39:53.329 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:39:53.330 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:39:53.330 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:39:53.331 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:39:53.332 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:39:53.371 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:39:53.371 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:53.372 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:39:53.372 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:53.374 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:39:53.375 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:53.376 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:39:53.376 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:53.376 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:39:53.434 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:39:53.437 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:39:53.447 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:39:53.449 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:39:53.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f9691c31640 1 Processor -- start 2024-09-19T05:39:53.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f9691c31640 1 -- start start 2024-09-19T05:39:53.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f9691c31640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f968c06f200 0x7f968c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f9691c31640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f968c06d210 0x7f968c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f9691c31640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f968c06f7e0 con 0x7f968c15c2e0 2024-09-19T05:39:53.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f9691c31640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f968c06d640 con 0x7f968c06f200 2024-09-19T05:39:53.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f9691c31640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f968c06fac0 con 0x7f968c06d210 2024-09-19T05:39:53.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f968b7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f968c15c2e0 0x7f968c0b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58382/0 (socket says 172.21.15.67:58382) 2024-09-19T05:39:53.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f968b7fe640 1 -- 172.21.15.67:0/3163154012 learned_addr learned my addr 172.21.15.67:0/3163154012 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:53.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f968affd640 1 --2- 172.21.15.67:0/3163154012 >> v2:172.21.15.67:3300/0 conn(0x7f968c06f200 0x7f968c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f968bfff640 1 --2- 172.21.15.67:0/3163154012 >> v2:172.21.15.97:3300/0 conn(0x7f968c06d210 0x7f968c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f968a7fc640 1 -- 172.21.15.67:0/3163154012 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452113718 0 0) 0x7f968c06f7e0 con 0x7f968c15c2e0 2024-09-19T05:39:53.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f968a7fc640 1 -- 172.21.15.67:0/3163154012 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9674003530 con 0x7f968c15c2e0 2024-09-19T05:39:53.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f968affd640 1 -- 172.21.15.67:0/3163154012 >> v2:172.21.15.97:3300/0 conn(0x7f968c06d210 msgr2=0x7f968c0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:53.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f968affd640 1 --2- 172.21.15.67:0/3163154012 >> v2:172.21.15.97:3300/0 conn(0x7f968c06d210 0x7f968c0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f968affd640 1 -- 172.21.15.67:0/3163154012 >> v1:172.21.15.67:6789/0 conn(0x7f968c15c2e0 legacy=0x7f968c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.507+0000 7f968affd640 1 -- 172.21.15.67:0/3163154012 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c06fda0 con 0x7f968c06f200 2024-09-19T05:39:53.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f968affd640 1 --2- 172.21.15.67:0/3163154012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c06f200 0x7f968c06ccd0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f968c0699f0 tx=0x7f968001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e873dc187b387a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:53.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f968a7fc640 1 -- 172.21.15.67:0/3163154012 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96800b0070 con 0x7f968c06f200 2024-09-19T05:39:53.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f968a7fc640 1 -- 172.21.15.67:0/3163154012 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800ab600 con 0x7f968c06f200 2024-09-19T05:39:53.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f968a7fc640 1 -- 172.21.15.67:0/3163154012 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96800ab9d0 con 0x7f968c06f200 2024-09-19T05:39:53.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f9691c31640 1 -- 172.21.15.67:0/3163154012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c06f200 msgr2=0x7f968c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f9691c31640 1 --2- 172.21.15.67:0/3163154012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c06f200 0x7f968c06ccd0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f968c0699f0 tx=0x7f968001c480 comp rx=0 tx=0).stop 2024-09-19T05:39:53.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f9691c31640 1 -- 172.21.15.67:0/3163154012 shutdown_connections 2024-09-19T05:39:53.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f9691c31640 1 --2- 172.21.15.67:0/3163154012 >> v2:172.21.15.97:3300/0 conn(0x7f968c06d210 0x7f968c0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f9691c31640 1 --2- 172.21.15.67:0/3163154012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c06f200 0x7f968c06ccd0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f9691c31640 1 -- 172.21.15.67:0/3163154012 >> 172.21.15.67:0/3163154012 conn(0x7f968c072760 msgr2=0x7f968c072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:53.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f9691c31640 1 -- 172.21.15.67:0/3163154012 shutdown_connections 2024-09-19T05:39:53.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f9691c31640 1 -- 172.21.15.67:0/3163154012 wait complete. 2024-09-19T05:39:53.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f9691c31640 1 Processor -- start 2024-09-19T05:39:53.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.511+0000 7f9691c31640 1 -- start start 2024-09-19T05:39:53.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9691c31640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f968c06d210 0x7f968c14e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9691c31640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f968c06f200 0x7f968c13b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9691c31640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c15c2e0 0x7f968c15efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9691c31640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f968c0ceea0 con 0x7f968c15c2e0 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9691c31640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f968c0ced20 con 0x7f968c06d210 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9691c31640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f968c0cf020 con 0x7f968c06f200 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c15c2e0 0x7f968c15efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c15c2e0 0x7f968c15efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47062/0 (socket says 172.21.15.67:47062) 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968bfff640 1 -- 172.21.15.67:0/1838546794 learned_addr learned my addr 172.21.15.67:0/1838546794 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968affd640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f968c06f200 0x7f968c13b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968b7fe640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f968c06d210 0x7f968c14e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968bfff640 1 -- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f968c06f200 msgr2=0x7f968c13b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968bfff640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f968c06f200 0x7f968c13b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968bfff640 1 -- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f968c06d210 msgr2=0x7f968c14e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968bfff640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f968c06d210 0x7f968c14e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968bfff640 1 -- 172.21.15.67:0/1838546794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c149ab0 con 0x7f968c15c2e0 2024-09-19T05:39:53.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968bfff640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c15c2e0 0x7f968c15efe0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f968400efc0 tx=0x7f968400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:53.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9673fff640 1 -- 172.21.15.67:0/1838546794 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684018020 con 0x7f968c15c2e0 2024-09-19T05:39:53.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9673fff640 1 -- 172.21.15.67:0/1838546794 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9684014480 con 0x7f968c15c2e0 2024-09-19T05:39:53.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9673fff640 1 -- 172.21.15.67:0/1838546794 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684014870 con 0x7f968c15c2e0 2024-09-19T05:39:53.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9691c31640 1 -- 172.21.15.67:0/1838546794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c149d90 con 0x7f968c15c2e0 2024-09-19T05:39:53.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9691c31640 1 -- 172.21.15.67:0/1838546794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c14a350 con 0x7f968c15c2e0 2024-09-19T05:39:53.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9691c31640 1 -- 172.21.15.67:0/1838546794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c0cdd40 con 0x7f968c15c2e0 2024-09-19T05:39:53.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9673fff640 1 -- 172.21.15.67:0/1838546794 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f968401b020 con 0x7f968c15c2e0 2024-09-19T05:39:53.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9673fff640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96780678c0 0x7f9678069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:53.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f9673fff640 1 -- 172.21.15.67:0/1838546794 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5507+0+0 (secure 0 0 0) 0x7f9684086570 con 0x7f968c15c2e0 2024-09-19T05:39:53.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968b7fe640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96780678c0 0x7f9678069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:53.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.515+0000 7f968b7fe640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96780678c0 0x7f9678069d80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f967c007fd0 tx=0x7f967c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:53.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.519+0000 7f9673fff640 1 -- 172.21.15.67:0/1838546794 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9684022030 con 0x7f968c15c2e0 2024-09-19T05:39:53.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-19T05:39:53.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:53.699+0000 7f9691c31640 1 -- 172.21.15.67:0/1838546794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f968c15b7f0 con 0x7f968c15c2e0 2024-09-19T05:39:54.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.727+0000 7f9673fff640 1 -- 172.21.15.67:0/1838546794 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v112) ==== 97+0+0 (secure 0 0 0) 0x7f9684010040 con 0x7f968c15c2e0 2024-09-19T05:39:54.728 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:39:54.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 -- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96780678c0 msgr2=0x7f9678069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:54.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96780678c0 0x7f9678069d80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f967c007fd0 tx=0x7f967c009040 comp rx=0 tx=0).stop 2024-09-19T05:39:54.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 -- 172.21.15.67:0/1838546794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c15c2e0 msgr2=0x7f968c15efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:54.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c15c2e0 0x7f968c15efe0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f968400efc0 tx=0x7f968400c490 comp rx=0 tx=0).stop 2024-09-19T05:39:54.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 -- 172.21.15.67:0/1838546794 shutdown_connections 2024-09-19T05:39:54.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968c15c2e0 0x7f968c15efe0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:54.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96780678c0 0x7f9678069d80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:54.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f968c06f200 0x7f968c13b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:54.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 --2- 172.21.15.67:0/1838546794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f968c06d210 0x7f968c14e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:54.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 -- 172.21.15.67:0/1838546794 >> 172.21.15.67:0/1838546794 conn(0x7f968c072760 msgr2=0x7f968c06c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:54.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 -- 172.21.15.67:0/1838546794 shutdown_connections 2024-09-19T05:39:54.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.731+0000 7f9691c31640 1 -- 172.21.15.67:0/1838546794 wait complete. 2024-09-19T05:39:54.756 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:39:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.887+0000 7f8dc7bce640 1 Processor -- start 2024-09-19T05:39:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.887+0000 7f8dc7bce640 1 -- start start 2024-09-19T05:39:54.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.887+0000 7f8dc7bce640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8dc0161da0 0x7f8dc00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:54.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.887+0000 7f8dc7bce640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8dc00d0160 0x7f8dc00d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:54.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.887+0000 7f8dc7bce640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc00d05d0 con 0x7f8dc00d0e80 2024-09-19T05:39:54.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.887+0000 7f8dc7bce640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc00d1830 con 0x7f8dc00d0160 2024-09-19T05:39:54.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.887+0000 7f8dc7bce640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc00d0840 con 0x7f8dc0161da0 2024-09-19T05:39:54.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc616b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8dc00d0160 0x7f8dc00d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:54.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc5169640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8dc00d0e80 0x7f8dc00b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58386/0 (socket says 172.21.15.67:58386) 2024-09-19T05:39:54.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc5169640 1 -- 172.21.15.67:0/681748802 learned_addr learned my addr 172.21.15.67:0/681748802 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:54.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc596a640 1 --2- 172.21.15.67:0/681748802 >> v2:172.21.15.97:3300/0 conn(0x7f8dc0161da0 0x7f8dc00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:54.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc4968640 1 -- 172.21.15.67:0/681748802 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1002865141 0 0) 0x7f8dc00d05d0 con 0x7f8dc00d0e80 2024-09-19T05:39:54.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc4968640 1 -- 172.21.15.67:0/681748802 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dac003530 con 0x7f8dc00d0e80 2024-09-19T05:39:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc616b640 1 -- 172.21.15.67:0/681748802 >> v2:172.21.15.97:3300/0 conn(0x7f8dc0161da0 msgr2=0x7f8dc00d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc616b640 1 --2- 172.21.15.67:0/681748802 >> v2:172.21.15.97:3300/0 conn(0x7f8dc0161da0 0x7f8dc00d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc616b640 1 -- 172.21.15.67:0/681748802 >> v1:172.21.15.67:6789/0 conn(0x7f8dc00d0e80 legacy=0x7f8dc00b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc616b640 1 -- 172.21.15.67:0/681748802 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc00d4d40 con 0x7f8dc00d0160 2024-09-19T05:39:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc616b640 1 --2- 172.21.15.67:0/681748802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0160 0x7f8dc00d12f0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00b5f50 tx=0x7f8db801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299d2202efd40bda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc4968640 1 -- 172.21.15.67:0/681748802 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db80b2070 con 0x7f8dc00d0160 2024-09-19T05:39:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc4968640 1 -- 172.21.15.67:0/681748802 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db80a58e0 con 0x7f8dc00d0160 2024-09-19T05:39:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc4968640 1 -- 172.21.15.67:0/681748802 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db80a5cb0 con 0x7f8dc00d0160 2024-09-19T05:39:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc7bce640 1 -- 172.21.15.67:0/681748802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0160 msgr2=0x7f8dc00d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc7bce640 1 --2- 172.21.15.67:0/681748802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0160 0x7f8dc00d12f0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00b5f50 tx=0x7f8db801c930 comp rx=0 tx=0).stop 2024-09-19T05:39:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc7bce640 1 -- 172.21.15.67:0/681748802 shutdown_connections 2024-09-19T05:39:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc7bce640 1 --2- 172.21.15.67:0/681748802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0160 0x7f8dc00d12f0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc7bce640 1 --2- 172.21.15.67:0/681748802 >> v2:172.21.15.97:3300/0 conn(0x7f8dc0161da0 0x7f8dc00d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc7bce640 1 -- 172.21.15.67:0/681748802 >> 172.21.15.67:0/681748802 conn(0x7f8dc008bfc0 msgr2=0x7f8dc00d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc7bce640 1 -- 172.21.15.67:0/681748802 shutdown_connections 2024-09-19T05:39:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.891+0000 7f8dc7bce640 1 -- 172.21.15.67:0/681748802 wait complete. 2024-09-19T05:39:54.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 Processor -- start 2024-09-19T05:39:54.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 -- start start 2024-09-19T05:39:54.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8dc00d0160 0x7f8dc0157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:54.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0e80 0x7f8dc00b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:54.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dc0161da0 0x7f8dc00b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:54.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc0162180 con 0x7f8dc00d0e80 2024-09-19T05:39:54.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc00b5d00 con 0x7f8dc0161da0 2024-09-19T05:39:54.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc00b50e0 con 0x7f8dc00d0160 2024-09-19T05:39:54.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc5169640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0e80 0x7f8dc00b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:54.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc5169640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0e80 0x7f8dc00b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47070/0 (socket says 172.21.15.67:47070) 2024-09-19T05:39:54.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc5169640 1 -- 172.21.15.67:0/839322551 learned_addr learned my addr 172.21.15.67:0/839322551 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:54.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc616b640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dc0161da0 0x7f8dc00b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:54.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc596a640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8dc00d0160 0x7f8dc0157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:54.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc5169640 1 -- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8dc00d0160 msgr2=0x7f8dc0157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:54.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc5169640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8dc00d0160 0x7f8dc0157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:54.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc5169640 1 -- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dc0161da0 msgr2=0x7f8dc00b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:54.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc5169640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dc0161da0 0x7f8dc00b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:54.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc5169640 1 -- 172.21.15.67:0/839322551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc00b7680 con 0x7f8dc00d0e80 2024-09-19T05:39:54.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc616b640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dc0161da0 0x7f8dc00b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:54.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc5169640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0e80 0x7f8dc00b5e80 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f8db000c4d0 tx=0x7f8db000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:54.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8db67fc640 1 -- 172.21.15.67:0/839322551 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0017070 con 0x7f8dc00d0e80 2024-09-19T05:39:54.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8db67fc640 1 -- 172.21.15.67:0/839322551 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db0005cf0 con 0x7f8dc00d0e80 2024-09-19T05:39:54.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 -- 172.21.15.67:0/839322551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc00b7960 con 0x7f8dc00d0e80 2024-09-19T05:39:54.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8db67fc640 1 -- 172.21.15.67:0/839322551 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0007270 con 0x7f8dc00d0e80 2024-09-19T05:39:54.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 -- 172.21.15.67:0/839322551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc00cc610 con 0x7f8dc00d0e80 2024-09-19T05:39:54.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.895+0000 7f8dc7bce640 1 -- 172.21.15.67:0/839322551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc00d12f0 con 0x7f8dc00d0e80 2024-09-19T05:39:54.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.899+0000 7f8db67fc640 1 -- 172.21.15.67:0/839322551 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8db001a070 con 0x7f8dc00d0e80 2024-09-19T05:39:54.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.899+0000 7f8db67fc640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8da40678c0 0x7f8da4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:54.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.899+0000 7f8db67fc640 1 -- 172.21.15.67:0/839322551 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5249+0+0 (secure 0 0 0) 0x7f8db0084da0 con 0x7f8dc00d0e80 2024-09-19T05:39:54.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.899+0000 7f8dc596a640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8da40678c0 0x7f8da4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:54.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.899+0000 7f8dc596a640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8da40678c0 0x7f8da4069d80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009990 tx=0x7f8dbc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:54.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:54.903+0000 7f8db67fc640 1 -- 172.21.15.67:0/839322551 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8db00554e0 con 0x7f8dc00d0e80 2024-09-19T05:39:55.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 -- 172.21.15.67:0/839322551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8dc0158810 con 0x7f8dc00d0e80 2024-09-19T05:39:55.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8db67fc640 1 -- 172.21.15.67:0/839322551 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f8db00597e0 con 0x7f8dc00d0e80 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.127 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.128 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:55.129 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.130 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.131 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.132 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.134 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:39:55.135 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:39:55.136 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:39:55.137 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.138 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:39:55.139 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:39:55.140 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 -- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8da40678c0 msgr2=0x7f8da4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8da40678c0 0x7f8da4069d80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009990 tx=0x7f8dbc008040 comp rx=0 tx=0).stop 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 -- 172.21.15.67:0/839322551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0e80 msgr2=0x7f8dc00b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0e80 0x7f8dc00b5e80 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f8db000c4d0 tx=0x7f8db000c990 comp rx=0 tx=0).stop 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 -- 172.21.15.67:0/839322551 shutdown_connections 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dc0161da0 0x7f8dc00b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dc00d0e80 0x7f8dc00b5e80 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8da40678c0 0x7f8da4069d80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 --2- 172.21.15.67:0/839322551 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8dc00d0160 0x7f8dc0157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 -- 172.21.15.67:0/839322551 >> 172.21.15.67:0/839322551 conn(0x7f8dc008bfc0 msgr2=0x7f8dc015ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:55.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 -- 172.21.15.67:0/839322551 shutdown_connections 2024-09-19T05:39:55.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.127+0000 7f8dc7bce640 1 -- 172.21.15.67:0/839322551 wait complete. 2024-09-19T05:39:55.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:39:55.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd49d090640 1 Processor -- start 2024-09-19T05:39:55.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd49d090640 1 -- start start 2024-09-19T05:39:55.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd49d090640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd49806dde0 0x7fd4980b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd49d090640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4980b3510 0x7fd49806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd49d090640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49806e3c0 con 0x7fd49815c030 2024-09-19T05:39:55.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd49d090640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd49806e6a0 con 0x7fd4980b3510 2024-09-19T05:39:55.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd49d090640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd49806e980 con 0x7fd49806dde0 2024-09-19T05:39:55.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd49759e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4980b3510 0x7fd49806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd496d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd49815c030 0x7fd49815d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58388/0 (socket says 172.21.15.67:58388) 2024-09-19T05:39:55.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd49759e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4980b3510 0x7fd49806f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47076/0 (socket says 172.21.15.67:47076) 2024-09-19T05:39:55.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd496d9d640 1 -- 172.21.15.67:0/263431975 learned_addr learned my addr 172.21.15.67:0/263431975 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:55.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.271+0000 7fd49659c640 1 --2- 172.21.15.67:0/263431975 >> v2:172.21.15.97:3300/0 conn(0x7fd49806dde0 0x7fd4980b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49759e640 1 -- 172.21.15.67:0/263431975 >> v2:172.21.15.97:3300/0 conn(0x7fd49806dde0 msgr2=0x7fd4980b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:55.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49759e640 1 --2- 172.21.15.67:0/263431975 >> v2:172.21.15.97:3300/0 conn(0x7fd49806dde0 0x7fd4980b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49759e640 1 -- 172.21.15.67:0/263431975 >> v1:172.21.15.67:6789/0 conn(0x7fd49815c030 legacy=0x7fd49815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49759e640 1 -- 172.21.15.67:0/263431975 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49806ec60 con 0x7fd4980b3510 2024-09-19T05:39:55.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49759e640 1 --2- 172.21.15.67:0/263431975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 0x7fd49806f460 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fd4980add20 tx=0x7fd49001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72799170cc929b55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:55.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd495d9b640 1 -- 172.21.15.67:0/263431975 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4900b2070 con 0x7fd4980b3510 2024-09-19T05:39:55.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd495d9b640 1 -- 172.21.15.67:0/263431975 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4900a58d0 con 0x7fd4980b3510 2024-09-19T05:39:55.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd495d9b640 1 -- 172.21.15.67:0/263431975 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4900a5ca0 con 0x7fd4980b3510 2024-09-19T05:39:55.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49d090640 1 -- 172.21.15.67:0/263431975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 msgr2=0x7fd49806f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49d090640 1 --2- 172.21.15.67:0/263431975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 0x7fd49806f460 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fd4980add20 tx=0x7fd49001c900 comp rx=0 tx=0).stop 2024-09-19T05:39:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49d090640 1 -- 172.21.15.67:0/263431975 shutdown_connections 2024-09-19T05:39:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49d090640 1 --2- 172.21.15.67:0/263431975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 0x7fd49806f460 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49d090640 1 --2- 172.21.15.67:0/263431975 >> v2:172.21.15.97:3300/0 conn(0x7fd49806dde0 0x7fd4980b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49d090640 1 -- 172.21.15.67:0/263431975 >> 172.21.15.67:0/263431975 conn(0x7fd4980d0080 msgr2=0x7fd4980d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49d090640 1 -- 172.21.15.67:0/263431975 shutdown_connections 2024-09-19T05:39:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.275+0000 7fd49d090640 1 -- 172.21.15.67:0/263431975 wait complete. 2024-09-19T05:39:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 Processor -- start 2024-09-19T05:39:55.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 -- start start 2024-09-19T05:39:55.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd49806dde0 0x7fd49814d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 0x7fd498154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49815c030 0x7fd498154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd4981692f0 con 0x7fd4980b3510 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd49815c620 con 0x7fd49806dde0 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd498169470 con 0x7fd49815c030 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 0x7fd498154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 0x7fd498154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47088/0 (socket says 172.21.15.67:47088) 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49659c640 1 -- 172.21.15.67:0/513483224 learned_addr learned my addr 172.21.15.67:0/513483224 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd496d9d640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd49806dde0 0x7fd49814d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49759e640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49815c030 0x7fd498154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49659c640 1 -- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49815c030 msgr2=0x7fd498154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49659c640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49815c030 0x7fd498154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49659c640 1 -- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd49806dde0 msgr2=0x7fd49814d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49659c640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd49806dde0 0x7fd49814d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49659c640 1 -- 172.21.15.67:0/513483224 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd498157f50 con 0x7fd4980b3510 2024-09-19T05:39:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49759e640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49815c030 0x7fd498154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49659c640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 0x7fd498154450 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00d800 tx=0x7fd48c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd47f7fe640 1 -- 172.21.15.67:0/513483224 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00b6c0 con 0x7fd4980b3510 2024-09-19T05:39:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd47f7fe640 1 -- 172.21.15.67:0/513483224 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48c019070 con 0x7fd4980b3510 2024-09-19T05:39:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 -- 172.21.15.67:0/513483224 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd498158230 con 0x7fd4980b3510 2024-09-19T05:39:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd47f7fe640 1 -- 172.21.15.67:0/513483224 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00ba60 con 0x7fd4980b3510 2024-09-19T05:39:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 -- 172.21.15.67:0/513483224 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd498145750 con 0x7fd4980b3510 2024-09-19T05:39:55.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd49d090640 1 -- 172.21.15.67:0/513483224 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4980b2fd0 con 0x7fd4980b3510 2024-09-19T05:39:55.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.279+0000 7fd47f7fe640 1 -- 172.21.15.67:0/513483224 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd48c00bc00 con 0x7fd4980b3510 2024-09-19T05:39:55.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.283+0000 7fd47f7fe640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4840678c0 0x7fd484069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.283+0000 7fd47f7fe640 1 -- 172.21.15.67:0/513483224 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5249+0+0 (secure 0 0 0) 0x7fd48c085f90 con 0x7fd4980b3510 2024-09-19T05:39:55.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.283+0000 7fd496d9d640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4840678c0 0x7fd484069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.283+0000 7fd496d9d640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4840678c0 0x7fd484069d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd498156ff0 tx=0x7fd488009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.287+0000 7fd47f7fe640 1 -- 172.21.15.67:0/513483224 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd48c056c90 con 0x7fd4980b3510 2024-09-19T05:39:55.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.455+0000 7fd49d090640 1 -- 172.21.15.67:0/513483224 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd4980d0f20 con 0x7fd4980b3510 2024-09-19T05:39:55.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.455+0000 7fd47f7fe640 1 -- 172.21.15.67:0/513483224 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v112) ==== 84+0+65 (secure 0 0 0) 0x7fd48c056590 con 0x7fd4980b3510 2024-09-19T05:39:55.457 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:55.457 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:39:55.457 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:39:55.457 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:39:55.457 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:39:55.458 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:39:55.458 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:39:55.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 -- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4840678c0 msgr2=0x7fd484069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4840678c0 0x7fd484069d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd498156ff0 tx=0x7fd488009040 comp rx=0 tx=0).stop 2024-09-19T05:39:55.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 -- 172.21.15.67:0/513483224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 msgr2=0x7fd498154450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 0x7fd498154450 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00d800 tx=0x7fd48c00dcc0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 -- 172.21.15.67:0/513483224 shutdown_connections 2024-09-19T05:39:55.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4840678c0 0x7fd484069d80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd49815c030 0x7fd498154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4980b3510 0x7fd498154450 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 --2- 172.21.15.67:0/513483224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd49806dde0 0x7fd49814d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 -- 172.21.15.67:0/513483224 >> 172.21.15.67:0/513483224 conn(0x7fd4980d0080 msgr2=0x7fd49815ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:55.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 -- 172.21.15.67:0/513483224 shutdown_connections 2024-09-19T05:39:55.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.459+0000 7fd49d090640 1 -- 172.21.15.67:0/513483224 wait complete. 2024-09-19T05:39:55.477 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:39:55.477 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:39:55.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bafbf8640 1 Processor -- start 2024-09-19T05:39:55.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bafbf8640 1 -- start start 2024-09-19T05:39:55.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bafbf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba80cf5e0 0x7f9ba80d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bafbf8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9ba815c850 0x7f9ba806e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bafbf8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba815d030 con 0x7f9ba806eb40 2024-09-19T05:39:55.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bafbf8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba806de90 con 0x7f9ba815c850 2024-09-19T05:39:55.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bafbf8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba806e170 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bad994640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba80cf5e0 0x7f9ba80d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bad193640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9ba815c850 0x7f9ba806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bad193640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9ba815c850 0x7f9ba806e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:38790/0 (socket says 172.21.15.67:38790) 2024-09-19T05:39:55.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bad994640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba80cf5e0 0x7f9ba80d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:47126/0 (socket says 172.21.15.67:47126) 2024-09-19T05:39:55.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bae195640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9ba806eb40 0x7f9ba815d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:58830/0 (socket says 172.21.15.67:58830) 2024-09-19T05:39:55.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bad193640 1 -- 172.21.15.67:0/3615411908 learned_addr learned my addr 172.21.15.67:0/3615411908 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:55.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bad193640 1 -- 172.21.15.67:0/3615411908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba80cf5e0 msgr2=0x7f9ba80d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:55.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bad193640 1 --2- 172.21.15.67:0/3615411908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba80cf5e0 0x7f9ba80d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bad193640 1 -- 172.21.15.67:0/3615411908 >> v1:172.21.15.97:6789/0 conn(0x7f9ba806eb40 legacy=0x7f9ba815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.607+0000 7f9bad193640 1 -- 172.21.15.67:0/3615411908 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba815d310 con 0x7f9ba815c850 2024-09-19T05:39:55.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bad193640 1 --2- 172.21.15.67:0/3615411908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ba815c850 0x7f9ba806e600 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009870 tx=0x7f9b9801c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39bedda5dc98c284 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:55.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bac992640 1 -- 172.21.15.67:0/3615411908 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b980ab640 con 0x7f9ba815c850 2024-09-19T05:39:55.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bac992640 1 -- 172.21.15.67:0/3615411908 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b980b0070 con 0x7f9ba815c850 2024-09-19T05:39:55.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bac992640 1 -- 172.21.15.67:0/3615411908 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b980aba00 con 0x7f9ba815c850 2024-09-19T05:39:55.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bafbf8640 1 -- 172.21.15.67:0/3615411908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ba815c850 msgr2=0x7f9ba806e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bafbf8640 1 --2- 172.21.15.67:0/3615411908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ba815c850 0x7f9ba806e600 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009870 tx=0x7f9b9801c530 comp rx=0 tx=0).stop 2024-09-19T05:39:55.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bafbf8640 1 -- 172.21.15.67:0/3615411908 shutdown_connections 2024-09-19T05:39:55.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bafbf8640 1 --2- 172.21.15.67:0/3615411908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ba815c850 0x7f9ba806e600 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bafbf8640 1 --2- 172.21.15.67:0/3615411908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba80cf5e0 0x7f9ba80d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bafbf8640 1 -- 172.21.15.67:0/3615411908 >> 172.21.15.67:0/3615411908 conn(0x7f9ba806c0c0 msgr2=0x7f9ba806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:55.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bafbf8640 1 -- 172.21.15.67:0/3615411908 shutdown_connections 2024-09-19T05:39:55.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bafbf8640 1 -- 172.21.15.67:0/3615411908 wait complete. 2024-09-19T05:39:55.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bafbf8640 1 Processor -- start 2024-09-19T05:39:55.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.611+0000 7f9bafbf8640 1 -- start start 2024-09-19T05:39:55.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bafbf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba806eb40 0x7f9ba8160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bafbf8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba80cf5e0 0x7f9ba8151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bafbf8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ba815c850 0x7f9ba815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bafbf8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8169130 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bafbf8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8168fb0 con 0x7f9ba815c850 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bafbf8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba81692b0 con 0x7f9ba806eb40 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad193640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba80cf5e0 0x7f9ba8151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad193640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba80cf5e0 0x7f9ba8151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47090/0 (socket says 172.21.15.67:47090) 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad193640 1 -- 172.21.15.67:0/741491452 learned_addr learned my addr 172.21.15.67:0/741491452 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad994640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba806eb40 0x7f9ba8160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bae195640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ba815c850 0x7f9ba815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad193640 1 -- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba806eb40 msgr2=0x7f9ba8160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad193640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba806eb40 0x7f9ba8160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad193640 1 -- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ba815c850 msgr2=0x7f9ba815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:55.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad193640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ba815c850 0x7f9ba815f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:55.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad193640 1 -- 172.21.15.67:0/741491452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba8152510 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bae195640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ba815c850 0x7f9ba815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:55.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad193640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba80cf5e0 0x7f9ba8151e30 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f9b980ad040 tx=0x7f9b980192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:55.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9b9e7fc640 1 -- 172.21.15.67:0/741491452 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b980bf410 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9b9e7fc640 1 -- 172.21.15.67:0/741491452 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b980bf5d0 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9b9e7fc640 1 -- 172.21.15.67:0/741491452 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b980bf9c0 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bafbf8640 1 -- 172.21.15.67:0/741491452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba81527f0 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bafbf8640 1 -- 172.21.15.67:0/741491452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba8152db0 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bafbf8640 1 -- 172.21.15.67:0/741491452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba80d0aa0 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9b9e7fc640 1 -- 172.21.15.67:0/741491452 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b980bd020 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9b9e7fc640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b8c0678c0 0x7f9b8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:55.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9b9e7fc640 1 -- 172.21.15.67:0/741491452 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5249+0+0 (secure 0 0 0) 0x7f9b98120090 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.615+0000 7f9bad994640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b8c0678c0 0x7f9b8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:55.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.619+0000 7f9bad994640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b8c0678c0 0x7f9b8c069d80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40074a0 tx=0x7f9ba400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:55.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.623+0000 7f9b9e7fc640 1 -- 172.21.15.67:0/741491452 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9b98016150 con 0x7f9ba80cf5e0 2024-09-19T05:39:55.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:55.787+0000 7f9bafbf8640 1 -- 172.21.15.67:0/741491452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9ba8159fa0 con 0x7f9ba80cf5e0 2024-09-19T05:39:56.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.735+0000 7f9b9e7fc640 1 -- 172.21.15.67:0/741491452 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v113) ==== 138+0+0 (secure 0 0 0) 0x7f9b980f0d90 con 0x7f9ba80cf5e0 2024-09-19T05:39:56.770 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:39:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 -- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b8c0678c0 msgr2=0x7f9b8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b8c0678c0 0x7f9b8c069d80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40074a0 tx=0x7f9ba400b040 comp rx=0 tx=0).stop 2024-09-19T05:39:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 -- 172.21.15.67:0/741491452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba80cf5e0 msgr2=0x7f9ba8151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba80cf5e0 0x7f9ba8151e30 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f9b980ad040 tx=0x7f9b980192d0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 -- 172.21.15.67:0/741491452 shutdown_connections 2024-09-19T05:39:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ba815c850 0x7f9ba815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ba80cf5e0 0x7f9ba8151e30 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b8c0678c0 0x7f9b8c069d80 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 --2- 172.21.15.67:0/741491452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ba806eb40 0x7f9ba8160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 -- 172.21.15.67:0/741491452 >> 172.21.15.67:0/741491452 conn(0x7f9ba806c0c0 msgr2=0x7f9ba806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 -- 172.21.15.67:0/741491452 shutdown_connections 2024-09-19T05:39:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.739+0000 7f9bafbf8640 1 -- 172.21.15.67:0/741491452 wait complete. 2024-09-19T05:39:56.779 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:39:56.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.915+0000 7fe0b66d4640 1 Processor -- start 2024-09-19T05:39:56.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.915+0000 7fe0b66d4640 1 -- start start 2024-09-19T05:39:56.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0b66d4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b00af3a0 0x7fe0b015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:56.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0b66d4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b00ad840 con 0x7fe0b0159c60 2024-09-19T05:39:56.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0b66d4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b015a040 con 0x7fe0b006ffd0 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0b66d4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b015d460 con 0x7fe0b00af3a0 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0affff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe0b0159c60 0x7fe0b00ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50892/0 (socket says 172.21.15.67:50892) 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0affff640 1 -- 172.21.15.67:0/25265578 learned_addr learned my addr 172.21.15.67:0/25265578 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209932219 0 0) 0x7fe0b00ad840 con 0x7fe0b0159c60 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe09c003530 con 0x7fe0b0159c60 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0b4c71640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b00af3a0 0x7fe0b015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3659787794 0 0) 0x7fe09c003530 con 0x7fe0b0159c60 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b00af3a0 msgr2=0x7fe0b015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b00af3a0 0x7fe0b015fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 >> v1:172.21.15.97:6789/0 conn(0x7fe0b006ffd0 legacy=0x7fe0b00aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b015c850 con 0x7fe0b0159c60 2024-09-19T05:39:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fe098001680 con 0x7fe0b0159c60 2024-09-19T05:39:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 >> v1:172.21.15.67:6789/0 conn(0x7fe0b0159c60 legacy=0x7fe0b00ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:56.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe09c0039f0 0x7fe09c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:56.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe09c004810 0x7fe09c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:56.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b00af3a0 0x7fe09c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:56.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b015d460 con 0x7fe09c0039f0 2024-09-19T05:39:56.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c005530 con 0x7fe09c004810 2024-09-19T05:39:56.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c00bf10 con 0x7fe0b00af3a0 2024-09-19T05:39:56.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0affff640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe09c0039f0 0x7fe09c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:56.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0b4c71640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b00af3a0 0x7fe09c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:56.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0af7fe640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe09c004810 0x7fe09c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:56.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0affff640 1 -- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b00af3a0 msgr2=0x7fe09c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:56.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0affff640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b00af3a0 0x7fe09c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0affff640 1 -- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe09c004810 msgr2=0x7fe09c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:56.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0affff640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe09c004810 0x7fe09c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0affff640 1 -- 172.21.15.67:0/25265578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c003530 con 0x7fe09c0039f0 2024-09-19T05:39:56.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.919+0000 7fe0b4c71640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b00af3a0 0x7fe09c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:56.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0affff640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe09c0039f0 0x7fe09c003e30 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe09800c1c0 tx=0x7fe09801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223288913e7e534a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:56.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098007d00 con 0x7fe09c0039f0 2024-09-19T05:39:56.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0980a9020 con 0x7fe09c0039f0 2024-09-19T05:39:56.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0aeffd640 1 -- 172.21.15.67:0/25265578 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980a5b10 con 0x7fe09c0039f0 2024-09-19T05:39:56.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 -- 172.21.15.67:0/25265578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe09c0039f0 msgr2=0x7fe09c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:56.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 --2- 172.21.15.67:0/25265578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe09c0039f0 0x7fe09c003e30 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe09800c1c0 tx=0x7fe09801cbd0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b4c71640 1 -- 172.21.15.67:0/25265578 reap_dead start 2024-09-19T05:39:56.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 -- 172.21.15.67:0/25265578 shutdown_connections 2024-09-19T05:39:56.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 -- 172.21.15.67:0/25265578 >> 172.21.15.67:0/25265578 conn(0x7fe0b00b1e50 msgr2=0x7fe0b00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:56.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 -- 172.21.15.67:0/25265578 shutdown_connections 2024-09-19T05:39:56.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 -- 172.21.15.67:0/25265578 wait complete. 2024-09-19T05:39:56.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 Processor -- start 2024-09-19T05:39:56.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 -- start start 2024-09-19T05:39:56.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe09c0039f0 0x7fe0b0143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:56.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b015b3e0 0x7fe0b015b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:56.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b0145620 0x7fe0b0145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:56.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0160730 con 0x7fe0b0145620 2024-09-19T05:39:56.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b01605b0 con 0x7fe09c0039f0 2024-09-19T05:39:56.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b66d4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b01608b0 con 0x7fe0b015b3e0 2024-09-19T05:39:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b4c71640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b0145620 0x7fe0b0145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b4c71640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b0145620 0x7fe0b0145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57188/0 (socket says 172.21.15.67:57188) 2024-09-19T05:39:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0b4c71640 1 -- 172.21.15.67:0/273046553 learned_addr learned my addr 172.21.15.67:0/273046553 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0affff640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe09c0039f0 0x7fe0b0143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.923+0000 7fe0af7fe640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b015b3e0 0x7fe0b015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0b4c71640 1 -- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b015b3e0 msgr2=0x7fe0b015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0b4c71640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b015b3e0 0x7fe0b015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0b4c71640 1 -- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe09c0039f0 msgr2=0x7fe0b0143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0b4c71640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe09c0039f0 0x7fe0b0143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0b4c71640 1 -- 172.21.15.67:0/273046553 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b015eda0 con 0x7fe0b0145620 2024-09-19T05:39:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0affff640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe09c0039f0 0x7fe0b0143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0b4c71640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b0145620 0x7fe0b0145aa0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0071c50 tx=0x7fe0a8009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0acff9640 1 -- 172.21.15.67:0/273046553 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8019070 con 0x7fe0b0145620 2024-09-19T05:39:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0acff9640 1 -- 172.21.15.67:0/273046553 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a8007d70 con 0x7fe0b0145620 2024-09-19T05:39:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0acff9640 1 -- 172.21.15.67:0/273046553 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8014640 con 0x7fe0b0145620 2024-09-19T05:39:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0b66d4640 1 -- 172.21.15.67:0/273046553 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b015f080 con 0x7fe0b0145620 2024-09-19T05:39:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0b66d4640 1 -- 172.21.15.67:0/273046553 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b015f640 con 0x7fe0b0145620 2024-09-19T05:39:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0b66d4640 1 -- 172.21.15.67:0/273046553 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b00aec90 con 0x7fe0b0145620 2024-09-19T05:39:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0acff9640 1 -- 172.21.15.67:0/273046553 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe0a801c070 con 0x7fe0b0145620 2024-09-19T05:39:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0acff9640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0900678c0 0x7fe090069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0acff9640 1 -- 172.21.15.67:0/273046553 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5619+0+0 (secure 0 0 0) 0x7fe0a80859f0 con 0x7fe0b0145620 2024-09-19T05:39:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.927+0000 7fe0affff640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0900678c0 0x7fe090069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.931+0000 7fe0affff640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0900678c0 0x7fe090069d80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe0980aa000 tx=0x7fe0b015d3d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:56.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:56.931+0000 7fe0acff9640 1 -- 172.21.15.67:0/273046553 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe0a8023020 con 0x7fe0b0145620 2024-09-19T05:39:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.091+0000 7fe0b66d4640 1 -- 172.21.15.67:0/273046553 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe0b00b4050 con 0x7fe0b0145620 2024-09-19T05:39:57.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.743+0000 7fe0acff9640 1 -- 172.21.15.67:0/273046553 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v114) ==== 170+0+0 (secure 0 0 0) 0x7fe0a80566f0 con 0x7fe0b0145620 2024-09-19T05:39:57.746 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:39:57.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.751+0000 7fe0b66d4640 1 -- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0900678c0 msgr2=0x7fe090069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:57.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.751+0000 7fe0b66d4640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0900678c0 0x7fe090069d80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe0980aa000 tx=0x7fe0b015d3d0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.751+0000 7fe0b66d4640 1 -- 172.21.15.67:0/273046553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b0145620 msgr2=0x7fe0b0145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:57.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.751+0000 7fe0b66d4640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b0145620 0x7fe0b0145aa0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0071c50 tx=0x7fe0a8009dc0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.755+0000 7fe0b66d4640 1 -- 172.21.15.67:0/273046553 shutdown_connections 2024-09-19T05:39:57.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.755+0000 7fe0b66d4640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b0145620 0x7fe0b0145aa0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.755+0000 7fe0b66d4640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0900678c0 0x7fe090069d80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.755+0000 7fe0b66d4640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0b015b3e0 0x7fe0b015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.755+0000 7fe0b66d4640 1 --2- 172.21.15.67:0/273046553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe09c0039f0 0x7fe0b0143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.755+0000 7fe0b66d4640 1 -- 172.21.15.67:0/273046553 >> 172.21.15.67:0/273046553 conn(0x7fe0b00b1e50 msgr2=0x7fe0b00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:57.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.759+0000 7fe0b66d4640 1 -- 172.21.15.67:0/273046553 shutdown_connections 2024-09-19T05:39:57.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.759+0000 7fe0b66d4640 1 -- 172.21.15.67:0/273046553 wait complete. 2024-09-19T05:39:57.790 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:39:57.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff5984f4640 1 Processor -- start 2024-09-19T05:39:57.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff5984f4640 1 -- start start 2024-09-19T05:39:57.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff5984f4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff5900d4fb0 0x7ff5900d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:57.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff5984f4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5900d13c0 0x7ff59006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:57.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff5984f4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5900d35a0 con 0x7ff59015e690 2024-09-19T05:39:57.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff5984f4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff5900d17f0 con 0x7ff5900d13c0 2024-09-19T05:39:57.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff5984f4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff5900d32c0 con 0x7ff5900d4fb0 2024-09-19T05:39:57.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff596a91640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5900d13c0 0x7ff59006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:57.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff596290640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff59015e690 0x7ff5900d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50908/0 (socket says 172.21.15.67:50908) 2024-09-19T05:39:57.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff596a91640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5900d13c0 0x7ff59006db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57196/0 (socket says 172.21.15.67:57196) 2024-09-19T05:39:57.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff596290640 1 -- 172.21.15.67:0/1583497319 learned_addr learned my addr 172.21.15.67:0/1583497319 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:57.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff595a8f640 1 --2- 172.21.15.67:0/1583497319 >> v2:172.21.15.97:3300/0 conn(0x7ff5900d4fb0 0x7ff5900d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:57.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff596a91640 1 -- 172.21.15.67:0/1583497319 >> v2:172.21.15.97:3300/0 conn(0x7ff5900d4fb0 msgr2=0x7ff5900d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:57.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff596a91640 1 --2- 172.21.15.67:0/1583497319 >> v2:172.21.15.97:3300/0 conn(0x7ff5900d4fb0 0x7ff5900d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff596a91640 1 -- 172.21.15.67:0/1583497319 >> v1:172.21.15.67:6789/0 conn(0x7ff59015e690 legacy=0x7ff5900d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:57.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.919+0000 7ff596a91640 1 -- 172.21.15.67:0/1583497319 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59006d040 con 0x7ff5900d13c0 2024-09-19T05:39:57.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff596a91640 1 --2- 172.21.15.67:0/1583497319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5900d13c0 0x7ff59006db20 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ff5900d3770 tx=0x7ff58801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a56898e659f2dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:57.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff59528e640 1 -- 172.21.15.67:0/1583497319 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5880b2070 con 0x7ff5900d13c0 2024-09-19T05:39:57.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff59528e640 1 -- 172.21.15.67:0/1583497319 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5880a59c0 con 0x7ff5900d13c0 2024-09-19T05:39:57.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff59528e640 1 -- 172.21.15.67:0/1583497319 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5880a5d90 con 0x7ff5900d13c0 2024-09-19T05:39:57.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 -- 172.21.15.67:0/1583497319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5900d13c0 msgr2=0x7ff59006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:57.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 --2- 172.21.15.67:0/1583497319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5900d13c0 0x7ff59006db20 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ff5900d3770 tx=0x7ff58801c900 comp rx=0 tx=0).stop 2024-09-19T05:39:57.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 -- 172.21.15.67:0/1583497319 shutdown_connections 2024-09-19T05:39:57.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 --2- 172.21.15.67:0/1583497319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5900d13c0 0x7ff59006db20 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 --2- 172.21.15.67:0/1583497319 >> v2:172.21.15.97:3300/0 conn(0x7ff5900d4fb0 0x7ff5900d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 -- 172.21.15.67:0/1583497319 >> 172.21.15.67:0/1583497319 conn(0x7ff5900d4490 msgr2=0x7ff5900d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:57.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 -- 172.21.15.67:0/1583497319 shutdown_connections 2024-09-19T05:39:57.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 -- 172.21.15.67:0/1583497319 wait complete. 2024-09-19T05:39:57.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 Processor -- start 2024-09-19T05:39:57.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 -- start start 2024-09-19T05:39:57.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5900d13c0 0x7ff5901510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:57.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5900d4fb0 0x7ff590152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:57.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff59015e690 0x7ff5900b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:57.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff59006e9f0 con 0x7ff59015e690 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff59006e870 con 0x7ff5900d13c0 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff5984f4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff59006eb70 con 0x7ff5900d4fb0 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff596a91640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff59015e690 0x7ff5900b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff596a91640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff59015e690 0x7ff5900b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57204/0 (socket says 172.21.15.67:57204) 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.923+0000 7ff596a91640 1 -- 172.21.15.67:0/2876536750 learned_addr learned my addr 172.21.15.67:0/2876536750 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff595a8f640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5900d4fb0 0x7ff590152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff596290640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5900d13c0 0x7ff5901510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff596a91640 1 -- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5900d4fb0 msgr2=0x7ff590152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff596a91640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5900d4fb0 0x7ff590152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff596a91640 1 -- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5900d13c0 msgr2=0x7ff5901510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff596a91640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5900d13c0 0x7ff5901510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff596a91640 1 -- 172.21.15.67:0/2876536750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff590152a90 con 0x7ff59015e690 2024-09-19T05:39:57.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff596290640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5900d13c0 0x7ff5901510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:57.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff596a91640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff59015e690 0x7ff5900b1060 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ff58801a530 tx=0x7ff5880196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:57.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff586ffd640 1 -- 172.21.15.67:0/2876536750 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5880b2050 con 0x7ff59015e690 2024-09-19T05:39:57.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff586ffd640 1 -- 172.21.15.67:0/2876536750 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5880be070 con 0x7ff59015e690 2024-09-19T05:39:57.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff5984f4640 1 -- 172.21.15.67:0/2876536750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff590158c50 con 0x7ff59015e690 2024-09-19T05:39:57.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff586ffd640 1 -- 172.21.15.67:0/2876536750 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5880adb10 con 0x7ff59015e690 2024-09-19T05:39:57.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff5984f4640 1 -- 172.21.15.67:0/2876536750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff590159210 con 0x7ff59015e690 2024-09-19T05:39:57.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff5984f4640 1 -- 172.21.15.67:0/2876536750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff59006db20 con 0x7ff59015e690 2024-09-19T05:39:57.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff586ffd640 1 -- 172.21.15.67:0/2876536750 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5880adcb0 con 0x7ff59015e690 2024-09-19T05:39:57.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff586ffd640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5740678c0 0x7ff574069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:57.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff586ffd640 1 -- 172.21.15.67:0/2876536750 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6001+0+0 (secure 0 0 0) 0x7ff588121170 con 0x7ff59015e690 2024-09-19T05:39:57.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff596290640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5740678c0 0x7ff574069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:57.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.927+0000 7ff596290640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5740678c0 0x7ff574069d80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff59015cea0 tx=0x7ff58c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:57.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:57.931+0000 7ff586ffd640 1 -- 172.21.15.67:0/2876536750 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff590152a90 con 0x7ff59015e690 2024-09-19T05:39:58.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.131+0000 7ff5984f4640 1 -- 172.21.15.67:0/2876536750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff5900d3a70 con 0x7ff59015e690 2024-09-19T05:39:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.747+0000 7ff586ffd640 1 -- 172.21.15.67:0/2876536750 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v79) ==== 174+0+0 (secure 0 0 0) 0x7ff588016520 con 0x7ff59015e690 2024-09-19T05:39:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 15 and data pool 16 2024-09-19T05:39:58.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 -- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5740678c0 msgr2=0x7ff574069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:58.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5740678c0 0x7ff574069d80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff59015cea0 tx=0x7ff58c009040 comp rx=0 tx=0).stop 2024-09-19T05:39:58.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 -- 172.21.15.67:0/2876536750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff59015e690 msgr2=0x7ff5900b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:58.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff59015e690 0x7ff5900b1060 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ff58801a530 tx=0x7ff5880196a0 comp rx=0 tx=0).stop 2024-09-19T05:39:58.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 -- 172.21.15.67:0/2876536750 shutdown_connections 2024-09-19T05:39:58.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff59015e690 0x7ff5900b1060 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:58.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff5740678c0 0x7ff574069d80 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:58.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5900d4fb0 0x7ff590152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:58.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 --2- 172.21.15.67:0/2876536750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5900d13c0 0x7ff5901510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:58.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 -- 172.21.15.67:0/2876536750 >> 172.21.15.67:0/2876536750 conn(0x7ff5900d4490 msgr2=0x7ff5900b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:58.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 -- 172.21.15.67:0/2876536750 shutdown_connections 2024-09-19T05:39:58.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.751+0000 7ff5984f4640 1 -- 172.21.15.67:0/2876536750 wait complete. 2024-09-19T05:39:58.798 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:39:58.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05ec6e7640 1 Processor -- start 2024-09-19T05:39:58.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05ec6e7640 1 -- start start 2024-09-19T05:39:58.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05ec6e7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f05e40d1590 0x7f05e40d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:58.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05ec6e7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f05e40b51d0 0x7f05e40cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05ec6e7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e40d4d40 con 0x7f05e4161da0 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05ec6e7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f05e40d0840 con 0x7f05e40d1590 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05ec6e7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f05e40d5020 con 0x7f05e40b51d0 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05e9c82640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f05e40d1590 0x7f05e40d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05e9c82640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f05e40d1590 0x7f05e40d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57210/0 (socket says 172.21.15.67:57210) 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05e9c82640 1 -- 172.21.15.67:0/2014288601 learned_addr learned my addr 172.21.15.67:0/2014288601 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05ea483640 1 --1- 172.21.15.67:0/2014288601 >> v1:172.21.15.67:6789/0 conn(0x7f05e4161da0 0x7f05e40d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50920/0 (socket says 172.21.15.67:50920) 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05e9c82640 1 -- 172.21.15.67:0/2014288601 >> v2:172.21.15.97:3300/0 conn(0x7f05e40b51d0 msgr2=0x7f05e40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05eac84640 1 --2- 172.21.15.67:0/2014288601 >> v2:172.21.15.97:3300/0 conn(0x7f05e40b51d0 0x7f05e40cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05e9c82640 1 --2- 172.21.15.67:0/2014288601 >> v2:172.21.15.97:3300/0 conn(0x7f05e40b51d0 0x7f05e40cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:58.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05e9c82640 1 -- 172.21.15.67:0/2014288601 >> v1:172.21.15.67:6789/0 conn(0x7f05e4161da0 legacy=0x7f05e40d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:58.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05e9481640 1 -- 172.21.15.67:0/2014288601 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146330984 0 0) 0x7f05e40d4d40 con 0x7f05e4161da0 2024-09-19T05:39:58.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05e9c82640 1 -- 172.21.15.67:0/2014288601 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e40d5300 con 0x7f05e40d1590 2024-09-19T05:39:58.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.923+0000 7f05eac84640 1 --2- 172.21.15.67:0/2014288601 >> v2:172.21.15.97:3300/0 conn(0x7f05e40b51d0 0x7f05e40cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:58.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05e9c82640 1 --2- 172.21.15.67:0/2014288601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 0x7f05e40d1af0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f05e408e7c0 tx=0x7f05d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95536be6da8bdfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05e9481640 1 -- 172.21.15.67:0/2014288601 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d40b0070 con 0x7f05e40d1590 2024-09-19T05:39:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05e9481640 1 -- 172.21.15.67:0/2014288601 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d40ab600 con 0x7f05e40d1590 2024-09-19T05:39:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05e9481640 1 -- 172.21.15.67:0/2014288601 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d40ab9d0 con 0x7f05e40d1590 2024-09-19T05:39:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2014288601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 msgr2=0x7f05e40d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05ec6e7640 1 --2- 172.21.15.67:0/2014288601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 0x7f05e40d1af0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f05e408e7c0 tx=0x7f05d401c520 comp rx=0 tx=0).stop 2024-09-19T05:39:58.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2014288601 shutdown_connections 2024-09-19T05:39:58.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05ec6e7640 1 --2- 172.21.15.67:0/2014288601 >> v2:172.21.15.97:3300/0 conn(0x7f05e40b51d0 0x7f05e40cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:58.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05ec6e7640 1 --2- 172.21.15.67:0/2014288601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 0x7f05e40d1af0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:58.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2014288601 >> 172.21.15.67:0/2014288601 conn(0x7f05e408bfc0 msgr2=0x7f05e40d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:58.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2014288601 shutdown_connections 2024-09-19T05:39:58.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2014288601 wait complete. 2024-09-19T05:39:58.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05ec6e7640 1 Processor -- start 2024-09-19T05:39:58.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.927+0000 7f05ec6e7640 1 -- start start 2024-09-19T05:39:58.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ec6e7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e40b51d0 0x7f05e40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:58.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ec6e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 0x7f05e415cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:58.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ec6e7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f05e4161da0 0x7f05e414e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:58.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ec6e7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40d0020 con 0x7f05e40d1590 2024-09-19T05:39:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ec6e7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40cfea0 con 0x7f05e40b51d0 2024-09-19T05:39:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ec6e7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f05e40d01a0 con 0x7f05e4161da0 2024-09-19T05:39:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05e9c82640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 0x7f05e415cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05e9c82640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 0x7f05e415cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57216/0 (socket says 172.21.15.67:57216) 2024-09-19T05:39:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05e9c82640 1 -- 172.21.15.67:0/2186799560 learned_addr learned my addr 172.21.15.67:0/2186799560 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ea483640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e40b51d0 0x7f05e40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05eac84640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f05e4161da0 0x7f05e414e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05e9c82640 1 -- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f05e4161da0 msgr2=0x7f05e414e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05e9c82640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f05e4161da0 0x7f05e414e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05e9c82640 1 -- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e40b51d0 msgr2=0x7f05e40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05e9c82640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e40b51d0 0x7f05e40cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05e9c82640 1 -- 172.21.15.67:0/2186799560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e40d2ae0 con 0x7f05e40d1590 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05eac84640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f05e4161da0 0x7f05e414e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05e9c82640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 0x7f05e415cb40 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f05d4019130 tx=0x7f05d40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05daffd640 1 -- 172.21.15.67:0/2186799560 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d40b9070 con 0x7f05e40d1590 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05daffd640 1 -- 172.21.15.67:0/2186799560 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d40b4600 con 0x7f05e40d1590 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2186799560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e414e920 con 0x7f05e40d1590 2024-09-19T05:39:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05daffd640 1 -- 172.21.15.67:0/2186799560 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d40b0040 con 0x7f05e40d1590 2024-09-19T05:39:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2186799560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e415d590 con 0x7f05e40d1590 2024-09-19T05:39:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2186799560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e40cf150 con 0x7f05e40d1590 2024-09-19T05:39:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05daffd640 1 -- 172.21.15.67:0/2186799560 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f05d40bc070 con 0x7f05e40d1590 2024-09-19T05:39:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05daffd640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05c80678c0 0x7f05c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05daffd640 1 -- 172.21.15.67:0/2186799560 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f05d411eee0 con 0x7f05e40d1590 2024-09-19T05:39:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.931+0000 7f05ea483640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05c80678c0 0x7f05c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.935+0000 7f05ea483640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05c80678c0 0x7f05c8069d80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000f70 tx=0x7f05e0007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:58.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:58.935+0000 7f05daffd640 1 -- 172.21.15.67:0/2186799560 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f05d4016110 con 0x7f05e40d1590 2024-09-19T05:39:59.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.103+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2186799560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05e4158f80 con 0x7f05e40d1590 2024-09-19T05:39:59.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.107+0000 7f05daffd640 1 -- 172.21.15.67:0/2186799560 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16921 (secure 0 0 0) 0x7f05d40ef890 con 0x7f05e40d1590 2024-09-19T05:39:59.108 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:59.109 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:39:58.136539+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:39:55.832671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-19T05:39:57.135928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05c80678c0 msgr2=0x7f05c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05c80678c0 0x7f05c8069d80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000f70 tx=0x7f05e0007c10 comp rx=0 tx=0).stop 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2186799560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 msgr2=0x7f05e415cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 0x7f05e415cb40 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f05d4019130 tx=0x7f05d40192c0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2186799560 shutdown_connections 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05c80678c0 0x7f05c8069d80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f05e4161da0 0x7f05e414e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05e40d1590 0x7f05e415cb40 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 --2- 172.21.15.67:0/2186799560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e40b51d0 0x7f05e40cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2186799560 >> 172.21.15.67:0/2186799560 conn(0x7f05e408bfc0 msgr2=0x7f05e406ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:59.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2186799560 shutdown_connections 2024-09-19T05:39:59.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.111+0000 7f05ec6e7640 1 -- 172.21.15.67:0/2186799560 wait complete. 2024-09-19T05:39:59.129 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:39:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbfd22d640 1 Processor -- start 2024-09-19T05:39:59.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbfd22d640 1 -- start start 2024-09-19T05:39:59.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbfd22d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbbf806bcc0 0x7fbbf806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbfd22d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbf815fb00 0x7fbbf815ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbfd22d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbf80b1d70 con 0x7fbbf80b1990 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbfd22d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbbf815f950 con 0x7fbbf806bcc0 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbfd22d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf806c670 con 0x7fbbf815fb00 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbf659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbbf806bcc0 0x7fbbf806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbf659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbbf806bcc0 0x7fbbf806c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57226/0 (socket says 172.21.15.67:57226) 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbf659c640 1 -- 172.21.15.67:0/4078684398 learned_addr learned my addr 172.21.15.67:0/4078684398 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbf659c640 1 -- 172.21.15.67:0/4078684398 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbf815fb00 msgr2=0x7fbbf815ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbf659c640 1 --2- 172.21.15.67:0/4078684398 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbf815fb00 0x7fbbf815ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbf659c640 1 -- 172.21.15.67:0/4078684398 >> v1:172.21.15.67:6789/0 conn(0x7fbbf80b1990 legacy=0x7fbbf80b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.259+0000 7fbbf659c640 1 -- 172.21.15.67:0/4078684398 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf815eb90 con 0x7fbbf806bcc0 2024-09-19T05:39:59.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbf659c640 1 --2- 172.21.15.67:0/4078684398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 0x7fbbf806c130 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009870 tx=0x7fbbec01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ae0615f36d665c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:59.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbf5d9b640 1 -- 172.21.15.67:0/4078684398 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0ab650 con 0x7fbbf806bcc0 2024-09-19T05:39:59.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbf5d9b640 1 -- 172.21.15.67:0/4078684398 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec0b0070 con 0x7fbbf806bcc0 2024-09-19T05:39:59.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbf5d9b640 1 -- 172.21.15.67:0/4078684398 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0aba10 con 0x7fbbf806bcc0 2024-09-19T05:39:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 -- 172.21.15.67:0/4078684398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 msgr2=0x7fbbf806c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 --2- 172.21.15.67:0/4078684398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 0x7fbbf806c130 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009870 tx=0x7fbbec01c560 comp rx=0 tx=0).stop 2024-09-19T05:39:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 -- 172.21.15.67:0/4078684398 shutdown_connections 2024-09-19T05:39:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 --2- 172.21.15.67:0/4078684398 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbf815fb00 0x7fbbf815ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 --2- 172.21.15.67:0/4078684398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 0x7fbbf806c130 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 -- 172.21.15.67:0/4078684398 >> 172.21.15.67:0/4078684398 conn(0x7fbbf809aa30 msgr2=0x7fbbf80b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 -- 172.21.15.67:0/4078684398 shutdown_connections 2024-09-19T05:39:59.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 -- 172.21.15.67:0/4078684398 wait complete. 2024-09-19T05:39:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 Processor -- start 2024-09-19T05:39:59.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 -- start start 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 0x7fbbf8152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbf80b1990 0x7fbbf8152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbf815fb00 0x7fbbf8151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf80b29b0 con 0x7fbbf806bcc0 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf80b4470 con 0x7fbbf815fb00 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbfd22d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf8151d90 con 0x7fbbf80b1990 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbf6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 0x7fbbf8152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbf6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 0x7fbbf8152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57236/0 (socket says 172.21.15.67:57236) 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbf6d9d640 1 -- 172.21.15.67:0/748538300 learned_addr learned my addr 172.21.15.67:0/748538300 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbf659c640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbf80b1990 0x7fbbf8152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.263+0000 7fbbf759e640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbf815fb00 0x7fbbf8151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbf6d9d640 1 -- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbf80b1990 msgr2=0x7fbbf8152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbf6d9d640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbf80b1990 0x7fbbf8152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbf6d9d640 1 -- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbf815fb00 msgr2=0x7fbbf8151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbf6d9d640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbf815fb00 0x7fbbf8151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbf6d9d640 1 -- 172.21.15.67:0/748538300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf8152070 con 0x7fbbf806bcc0 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbf759e640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbf815fb00 0x7fbbf8151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbf6d9d640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 0x7fbbf8152980 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800c370 tx=0x7fbbe800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbdf7fe640 1 -- 172.21.15.67:0/748538300 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe80052d0 con 0x7fbbf806bcc0 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbdf7fe640 1 -- 172.21.15.67:0/748538300 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe8005470 con 0x7fbbf806bcc0 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbdf7fe640 1 -- 172.21.15.67:0/748538300 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8007260 con 0x7fbbf806bcc0 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbfd22d640 1 -- 172.21.15.67:0/748538300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf8155cb0 con 0x7fbbf806bcc0 2024-09-19T05:39:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbfd22d640 1 -- 172.21.15.67:0/748538300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf814d9d0 con 0x7fbbf806bcc0 2024-09-19T05:39:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbfd22d640 1 -- 172.21.15.67:0/748538300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf814dc60 con 0x7fbbf806bcc0 2024-09-19T05:39:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbdf7fe640 1 -- 172.21.15.67:0/748538300 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbbe8007400 con 0x7fbbf806bcc0 2024-09-19T05:39:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbdf7fe640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbbe40678c0 0x7fbbe4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbdf7fe640 1 -- 172.21.15.67:0/748538300 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fbbe80852a0 con 0x7fbbf806bcc0 2024-09-19T05:39:59.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbf659c640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbbe40678c0 0x7fbbe4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.267+0000 7fbbf659c640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbbe40678c0 0x7fbbe4069d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0af000 tx=0x7fbbec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:59.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.271+0000 7fbbdf7fe640 1 -- 172.21.15.67:0/748538300 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fbbe8055c50 con 0x7fbbf806bcc0 2024-09-19T05:39:59.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.439+0000 7fbbfd22d640 1 -- 172.21.15.67:0/748538300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbf806c130 con 0x7fbbf806bcc0 2024-09-19T05:39:59.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbdf7fe640 1 -- 172.21.15.67:0/748538300 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16921 (secure 0 0 0) 0x7fbbe80850c0 con 0x7fbbf806bcc0 2024-09-19T05:39:59.443 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:39:59.443 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:39:58.136539+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:39:55.832671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-19T05:39:57.135928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:39:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 -- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbbe40678c0 msgr2=0x7fbbe4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbbe40678c0 0x7fbbe4069d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0af000 tx=0x7fbbec008040 comp rx=0 tx=0).stop 2024-09-19T05:39:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 -- 172.21.15.67:0/748538300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 msgr2=0x7fbbf8152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 0x7fbbf8152980 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800c370 tx=0x7fbbe800c830 comp rx=0 tx=0).stop 2024-09-19T05:39:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 -- 172.21.15.67:0/748538300 shutdown_connections 2024-09-19T05:39:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbf815fb00 0x7fbbf8151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbbe40678c0 0x7fbbe4069d80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbf80b1990 0x7fbbf8152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 --2- 172.21.15.67:0/748538300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf806bcc0 0x7fbbf8152980 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 -- 172.21.15.67:0/748538300 >> 172.21.15.67:0/748538300 conn(0x7fbbf809aa30 msgr2=0x7fbbf8162910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 -- 172.21.15.67:0/748538300 shutdown_connections 2024-09-19T05:39:59.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.443+0000 7fbbfd22d640 1 -- 172.21.15.67:0/748538300 wait complete. 2024-09-19T05:39:59.462 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:39:59.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f891e69d640 1 Processor -- start 2024-09-19T05:39:59.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f891e69d640 1 -- start start 2024-09-19T05:39:59.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f891e69d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8918161ba0 0x7f89180b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f891e69d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89180b44f0 con 0x7f89180b0220 2024-09-19T05:39:59.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f891e69d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f891806cae0 con 0x7f891809aa30 2024-09-19T05:39:59.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f891e69d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f89180ae7e0 con 0x7f8918161ba0 2024-09-19T05:39:59.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f891cc3a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f89180b0220 0x7f891806c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50938/0 (socket says 172.21.15.67:50938) 2024-09-19T05:39:59.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f891cc3a640 1 -- 172.21.15.67:0/4014022159 learned_addr learned my addr 172.21.15.67:0/4014022159 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:39:59.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8917fff640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8918161ba0 0x7f89180b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054555913 0 0) 0x7f89100014a0 con 0x7f89180b0220 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8900003530 con 0x7f89180b0220 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3981760134 0 0) 0x7f891806cae0 con 0x7f891809aa30 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89100014a0 con 0x7f891809aa30 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 920512776 0 0) 0x7f8900003530 con 0x7f89180b0220 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8918161ba0 msgr2=0x7f89180b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8918161ba0 0x7f89180b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 >> v1:172.21.15.97:6789/0 conn(0x7f891809aa30 legacy=0x7f891806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89180b2cb0 con 0x7f89180b0220 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f8910001bd0 con 0x7f89180b0220 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 >> v1:172.21.15.67:6789/0 conn(0x7f89180b0220 legacy=0x7f891806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8918161ba0 0x7f8900003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8900004130 0x7f8900004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8900004d50 0x7f89000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f890000bae0 con 0x7f8900004d50 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f890000bc90 con 0x7f8900004130 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f890000be90 con 0x7f8918161ba0 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.591+0000 7f891cc3a640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8900004d50 0x7f89000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f8917fff640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8918161ba0 0x7f8900003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f89177fe640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8900004130 0x7f8900004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891cc3a640 1 -- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8918161ba0 msgr2=0x7f8900003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891cc3a640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8918161ba0 0x7f8900003b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891cc3a640 1 -- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8900004130 msgr2=0x7f8900004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891cc3a640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8900004130 0x7f8900004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891cc3a640 1 -- 172.21.15.67:0/4014022159 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8900003530 con 0x7f8900004d50 2024-09-19T05:39:59.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f89177fe640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8900004130 0x7f8900004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891cc3a640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8900004d50 0x7f89000051d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f891000a900 tx=0x7f891001f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3f77881a842708 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891000a550 con 0x7f8900004d50 2024-09-19T05:39:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89100b1070 con 0x7f8900004d50 2024-09-19T05:39:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f8916ffd640 1 -- 172.21.15.67:0/4014022159 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89100ac8b0 con 0x7f8900004d50 2024-09-19T05:39:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891e69d640 1 -- 172.21.15.67:0/4014022159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8900004d50 msgr2=0x7f89000051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891e69d640 1 --2- 172.21.15.67:0/4014022159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8900004d50 0x7f89000051d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f891000a900 tx=0x7f891001f980 comp rx=0 tx=0).stop 2024-09-19T05:39:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891cc3a640 1 -- 172.21.15.67:0/4014022159 reap_dead start 2024-09-19T05:39:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891e69d640 1 -- 172.21.15.67:0/4014022159 shutdown_connections 2024-09-19T05:39:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891e69d640 1 -- 172.21.15.67:0/4014022159 >> 172.21.15.67:0/4014022159 conn(0x7f89180b6a80 msgr2=0x7f89180b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:59.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891e69d640 1 -- 172.21.15.67:0/4014022159 shutdown_connections 2024-09-19T05:39:59.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.595+0000 7f891e69d640 1 -- 172.21.15.67:0/4014022159 wait complete. 2024-09-19T05:39:59.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 Processor -- start 2024-09-19T05:39:59.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 -- start start 2024-09-19T05:39:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f891814b9d0 0x7f891814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f891815b130 0x7f891815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f891815c020 0x7f891809cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8918073650 con 0x7f891815c020 2024-09-19T05:39:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f89180aed80 con 0x7f891814b9d0 2024-09-19T05:39:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f89180aea10 con 0x7f891815b130 2024-09-19T05:39:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891cc3a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f891815c020 0x7f891809cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891cc3a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f891815c020 0x7f891809cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57246/0 (socket says 172.21.15.67:57246) 2024-09-19T05:39:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891cc3a640 1 -- 172.21.15.67:0/939608612 learned_addr learned my addr 172.21.15.67:0/939608612 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f8917fff640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f891814b9d0 0x7f891814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f89177fe640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f891815b130 0x7f891815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891cc3a640 1 -- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f891815b130 msgr2=0x7f891815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891cc3a640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f891815b130 0x7f891815bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891cc3a640 1 -- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f891814b9d0 msgr2=0x7f891814bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891cc3a640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f891814b9d0 0x7f891814bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891cc3a640 1 -- 172.21.15.67:0/939608612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891815a090 con 0x7f891815c020 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891cc3a640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f891815c020 0x7f891809cd90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f891001f7b0 tx=0x7f8900005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f8914ff9640 1 -- 172.21.15.67:0/939608612 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891000a550 con 0x7f891815c020 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f8914ff9640 1 -- 172.21.15.67:0/939608612 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89100ba070 con 0x7f891815c020 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 -- 172.21.15.67:0/939608612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891815a370 con 0x7f891815c020 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f8914ff9640 1 -- 172.21.15.67:0/939608612 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89100ac890 con 0x7f891815c020 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 -- 172.21.15.67:0/939608612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891815a930 con 0x7f891815c020 2024-09-19T05:39:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f891e69d640 1 -- 172.21.15.67:0/939608612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89180b48a0 con 0x7f891815c020 2024-09-19T05:39:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.599+0000 7f8914ff9640 1 -- 172.21.15.67:0/939608612 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f89100c5060 con 0x7f891815c020 2024-09-19T05:39:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.603+0000 7f8914ff9640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89040678c0 0x7f8904069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.603+0000 7f8914ff9640 1 -- 172.21.15.67:0/939608612 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f8910123720 con 0x7f891815c020 2024-09-19T05:39:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.603+0000 7f8917fff640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89040678c0 0x7f8904069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.603+0000 7f8917fff640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89040678c0 0x7f8904069d80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8908009ae0 tx=0x7f8908008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.607+0000 7f8914ff9640 1 -- 172.21.15.67:0/939608612 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f89180b44f0 con 0x7f891815c020 2024-09-19T05:39:59.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:39:59.807+0000 7f891e69d640 1 -- 172.21.15.67:0/939608612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f891815c5d0 con 0x7f891815c020 2024-09-19T05:40:00.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-19T05:40:00.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.795+0000 7f8914ff9640 1 -- 172.21.15.67:0/939608612 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) ==== 118+0+0 (secure 0 0 0) 0x7f89100f40d0 con 0x7f891815c020 2024-09-19T05:40:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 -- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89040678c0 msgr2=0x7f8904069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89040678c0 0x7f8904069d80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8908009ae0 tx=0x7f8908008040 comp rx=0 tx=0).stop 2024-09-19T05:40:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 -- 172.21.15.67:0/939608612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f891815c020 msgr2=0x7f891809cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f891815c020 0x7f891809cd90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f891001f7b0 tx=0x7f8900005840 comp rx=0 tx=0).stop 2024-09-19T05:40:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 -- 172.21.15.67:0/939608612 shutdown_connections 2024-09-19T05:40:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f891815c020 0x7f891809cd90 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f89040678c0 0x7f8904069d80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f891815b130 0x7f891815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 --2- 172.21.15.67:0/939608612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f891814b9d0 0x7f891814bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 -- 172.21.15.67:0/939608612 >> 172.21.15.67:0/939608612 conn(0x7f89180b6a80 msgr2=0x7f89180af110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 -- 172.21.15.67:0/939608612 shutdown_connections 2024-09-19T05:40:00.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.799+0000 7f891e69d640 1 -- 172.21.15.67:0/939608612 wait complete. 2024-09-19T05:40:00.821 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:40:00.822 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:40:00.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a03e12640 1 Processor -- start 2024-09-19T05:40:00.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a03e12640 1 -- start start 2024-09-19T05:40:00.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a03e12640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f49fc070070 0x7f49fc165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:00.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a03e12640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49fc0aef30 con 0x7f49fc15b1d0 2024-09-19T05:40:00.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a03e12640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49fc0ae3b0 con 0x7f49fc06dfc0 2024-09-19T05:40:00.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a03e12640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f49fc072210 con 0x7f49fc070070 2024-09-19T05:40:00.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a01bae640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f49fc15b1d0 0x7f49fc0adbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50940/0 (socket says 172.21.15.67:50940) 2024-09-19T05:40:00.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a01bae640 1 -- 172.21.15.67:0/2638847269 learned_addr learned my addr 172.21.15.67:0/2638847269 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:40:00.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a023af640 1 --2- 172.21.15.67:0/2638847269 >> v2:172.21.15.97:3300/0 conn(0x7f49fc070070 0x7f49fc165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:00.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2657191808 0 0) 0x7f49fc0aef30 con 0x7f49fc15b1d0 2024-09-19T05:40:00.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49e8003530 con 0x7f49fc15b1d0 2024-09-19T05:40:00.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3888359320 0 0) 0x7f49e8003530 con 0x7f49fc15b1d0 2024-09-19T05:40:00.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 >> v2:172.21.15.97:3300/0 conn(0x7f49fc070070 msgr2=0x7f49fc165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:00.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 --2- 172.21.15.67:0/2638847269 >> v2:172.21.15.97:3300/0 conn(0x7f49fc070070 0x7f49fc165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 >> v1:172.21.15.97:6789/0 conn(0x7f49fc06dfc0 legacy=0x7f49fc06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:00.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49fc0ae690 con 0x7f49fc15b1d0 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f49f8001680 con 0x7f49fc15b1d0 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 >> v1:172.21.15.67:6789/0 conn(0x7f49fc15b1d0 legacy=0x7f49fc0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e80039c0 0x7f49e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e8004810 0x7f49e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80051d0 0x7f49e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc072210 con 0x7f49e80039c0 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f49e800c070 con 0x7f49e8004810 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f49e800c270 con 0x7f49e80051d0 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a01bae640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e80039c0 0x7f49e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a013ad640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e8004810 0x7f49e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a023af640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80051d0 0x7f49e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a01bae640 1 -- 172.21.15.67:0/2638847269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80051d0 msgr2=0x7f49e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:00.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a01bae640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49e80051d0 0x7f49e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a01bae640 1 -- 172.21.15.67:0/2638847269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e8004810 msgr2=0x7f49e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a01bae640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e8004810 0x7f49e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a023af640 1 -- 172.21.15.67:0/2638847269 reap_dead start 2024-09-19T05:40:00.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.955+0000 7f4a01bae640 1 -- 172.21.15.67:0/2638847269 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e8003530 con 0x7f49e80039c0 2024-09-19T05:40:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a01bae640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e80039c0 0x7f49e8003de0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f49f800c1c0 tx=0x7f49f801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce62a185a12d6547 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8007d00 con 0x7f49e80039c0 2024-09-19T05:40:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f80a9020 con 0x7f49e80039c0 2024-09-19T05:40:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a00bac640 1 -- 172.21.15.67:0/2638847269 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8005b00 con 0x7f49e80039c0 2024-09-19T05:40:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a03e12640 1 -- 172.21.15.67:0/2638847269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e80039c0 msgr2=0x7f49e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a03e12640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e80039c0 0x7f49e8003de0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f49f800c1c0 tx=0x7f49f801cbe0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a03e12640 1 -- 172.21.15.67:0/2638847269 shutdown_connections 2024-09-19T05:40:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a03e12640 1 --2- 172.21.15.67:0/2638847269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e80039c0 0x7f49e8003de0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a03e12640 1 -- 172.21.15.67:0/2638847269 >> 172.21.15.67:0/2638847269 conn(0x7f49fc0b1e50 msgr2=0x7f49fc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:00.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a03e12640 1 -- 172.21.15.67:0/2638847269 shutdown_connections 2024-09-19T05:40:00.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a03e12640 1 -- 172.21.15.67:0/2638847269 wait complete. 2024-09-19T05:40:00.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a03e12640 1 Processor -- start 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.959+0000 7f4a03e12640 1 -- start start 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a03e12640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e80039c0 0x7f49fc09aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a03e12640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc14f030 0x7f49fc14ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a03e12640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49fc159820 0x7f49fc159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a03e12640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc0ae100 con 0x7f49fc14f030 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a03e12640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc0adf80 con 0x7f49e80039c0 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a03e12640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f49fc15f490 con 0x7f49fc159820 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a013ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc14f030 0x7f49fc14ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a013ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc14f030 0x7f49fc14ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57256/0 (socket says 172.21.15.67:57256) 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a013ad640 1 -- 172.21.15.67:0/1250154790 learned_addr learned my addr 172.21.15.67:0/1250154790 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a01bae640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e80039c0 0x7f49fc09aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a023af640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49fc159820 0x7f49fc159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a013ad640 1 -- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49fc159820 msgr2=0x7f49fc159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a013ad640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49fc159820 0x7f49fc159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a013ad640 1 -- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e80039c0 msgr2=0x7f49fc09aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a013ad640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e80039c0 0x7f49fc09aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a013ad640 1 -- 172.21.15.67:0/1250154790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49fc09c770 con 0x7f49fc14f030 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a01bae640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e80039c0 0x7f49fc09aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a013ad640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc14f030 0x7f49fc14ea20 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00f770 tx=0x7f49ec00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f49f27fc640 1 -- 172.21.15.67:0/1250154790 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec0050d0 con 0x7f49fc14f030 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f49f27fc640 1 -- 172.21.15.67:0/1250154790 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ec018070 con 0x7f49fc14f030 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a03e12640 1 -- 172.21.15.67:0/1250154790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49fc09c9e0 con 0x7f49fc14f030 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f49f27fc640 1 -- 172.21.15.67:0/1250154790 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec005490 con 0x7f49fc14f030 2024-09-19T05:40:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a03e12640 1 -- 172.21.15.67:0/1250154790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49fc09cfa0 con 0x7f49fc14f030 2024-09-19T05:40:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a03e12640 1 -- 172.21.15.67:0/1250154790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49fc068530 con 0x7f49fc14f030 2024-09-19T05:40:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f49f27fc640 1 -- 172.21.15.67:0/1250154790 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f49ec00d730 con 0x7f49fc14f030 2024-09-19T05:40:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f49f27fc640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49e0067a90 0x7f49e0069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f49f27fc640 1 -- 172.21.15.67:0/1250154790 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f49ec085a90 con 0x7f49fc14f030 2024-09-19T05:40:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.963+0000 7f4a01bae640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49e0067a90 0x7f49e0069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.967+0000 7f4a01bae640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49e0067a90 0x7f49e0069f50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f49f80aa000 tx=0x7f49fc0ae580 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:00.967+0000 7f49f27fc640 1 -- 172.21.15.67:0/1250154790 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f49ec0564d0 con 0x7f49fc14f030 2024-09-19T05:40:01.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.167+0000 7f4a03e12640 1 -- 172.21.15.67:0/1250154790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f49fc0aef30 con 0x7f49fc14f030 2024-09-19T05:40:01.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.803+0000 7f49f27fc640 1 -- 172.21.15.67:0/1250154790 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) ==== 122+0+0 (secure 0 0 0) 0x7f49ec055dd0 con 0x7f49fc14f030 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 -- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49e0067a90 msgr2=0x7f49e0069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49e0067a90 0x7f49e0069f50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f49f80aa000 tx=0x7f49fc0ae580 comp rx=0 tx=0).stop 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 -- 172.21.15.67:0/1250154790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc14f030 msgr2=0x7f49fc14ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc14f030 0x7f49fc14ea20 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00f770 tx=0x7f49ec00fc30 comp rx=0 tx=0).stop 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 -- 172.21.15.67:0/1250154790 shutdown_connections 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f49e0067a90 0x7f49e0069f50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49fc159820 0x7f49fc159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc14f030 0x7f49fc14ea20 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 --2- 172.21.15.67:0/1250154790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49e80039c0 0x7f49fc09aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 -- 172.21.15.67:0/1250154790 >> 172.21.15.67:0/1250154790 conn(0x7f49fc0b1e50 msgr2=0x7f49fc06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 -- 172.21.15.67:0/1250154790 shutdown_connections 2024-09-19T05:40:01.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.807+0000 7f4a03e12640 1 -- 172.21.15.67:0/1250154790 wait complete. 2024-09-19T05:40:01.828 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:40:01.828 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:40:01.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f60325640 1 Processor -- start 2024-09-19T05:40:01.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f60325640 1 -- start start 2024-09-19T05:40:01.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f60325640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f5806dde0 0x7f0f580b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f60325640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0f580b3510 0x7f0f5806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f60325640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5806e3c0 con 0x7f0f5815c030 2024-09-19T05:40:01.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f60325640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0f5806e6a0 con 0x7f0f580b3510 2024-09-19T05:40:01.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f60325640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5806e980 con 0x7f0f5806dde0 2024-09-19T05:40:01.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f5e8c2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0f580b3510 0x7f0f5806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f5e0c1640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0f5815c030 0x7f0f5815d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50948/0 (socket says 172.21.15.67:50948) 2024-09-19T05:40:01.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f5e0c1640 1 -- 172.21.15.67:0/3550813491 learned_addr learned my addr 172.21.15.67:0/3550813491 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:40:01.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f5d8c0640 1 --2- 172.21.15.67:0/3550813491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f5806dde0 0x7f0f580b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f5e8c2640 1 -- 172.21.15.67:0/3550813491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f5806dde0 msgr2=0x7f0f580b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:01.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f5e8c2640 1 --2- 172.21.15.67:0/3550813491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f5806dde0 0x7f0f580b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f5e8c2640 1 -- 172.21.15.67:0/3550813491 >> v1:172.21.15.67:6789/0 conn(0x7f0f5815c030 legacy=0x7f0f5815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f5e8c2640 1 -- 172.21.15.67:0/3550813491 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5806ec60 con 0x7f0f580b3510 2024-09-19T05:40:01.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.959+0000 7f0f5d0bf640 1 -- 172.21.15.67:0/3550813491 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348992101 0 0) 0x7f0f5806e3c0 con 0x7f0f5815c030 2024-09-19T05:40:01.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5e8c2640 1 --2- 172.21.15.67:0/3550813491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 0x7f0f5806f460 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009d90 tx=0x7f0f5001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9068c5e35b8efdef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:01.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d0bf640 1 -- 172.21.15.67:0/3550813491 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f500b2070 con 0x7f0f580b3510 2024-09-19T05:40:01.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d0bf640 1 -- 172.21.15.67:0/3550813491 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f500a5880 con 0x7f0f580b3510 2024-09-19T05:40:01.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d0bf640 1 -- 172.21.15.67:0/3550813491 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f500a5c50 con 0x7f0f580b3510 2024-09-19T05:40:01.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- 172.21.15.67:0/3550813491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 msgr2=0x7f0f5806f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 --2- 172.21.15.67:0/3550813491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 0x7f0f5806f460 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009d90 tx=0x7f0f5001c8b0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- 172.21.15.67:0/3550813491 shutdown_connections 2024-09-19T05:40:01.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 --2- 172.21.15.67:0/3550813491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 0x7f0f5806f460 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 --2- 172.21.15.67:0/3550813491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f5806dde0 0x7f0f580b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- 172.21.15.67:0/3550813491 >> 172.21.15.67:0/3550813491 conn(0x7f0f580d0080 msgr2=0x7f0f580d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:01.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- 172.21.15.67:0/3550813491 shutdown_connections 2024-09-19T05:40:01.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- 172.21.15.67:0/3550813491 wait complete. 2024-09-19T05:40:01.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 Processor -- start 2024-09-19T05:40:01.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- start start 2024-09-19T05:40:01.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f5806dde0 0x7f0f580999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 0x7f0f58151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5815c030 0x7f0f5815a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0f581692f0 con 0x7f0f580b3510 2024-09-19T05:40:01.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5815c620 con 0x7f0f5815c030 2024-09-19T05:40:01.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f58169470 con 0x7f0f5806dde0 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d8c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 0x7f0f58151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d8c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 0x7f0f58151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57268/0 (socket says 172.21.15.67:57268) 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d8c0640 1 -- 172.21.15.67:0/4078295705 learned_addr learned my addr 172.21.15.67:0/4078295705 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5e0c1640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f5806dde0 0x7f0f580999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5e8c2640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5815c030 0x7f0f5815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d8c0640 1 -- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f5806dde0 msgr2=0x7f0f580999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d8c0640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f5806dde0 0x7f0f580999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d8c0640 1 -- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5815c030 msgr2=0x7f0f5815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d8c0640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5815c030 0x7f0f5815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d8c0640 1 -- 172.21.15.67:0/4078295705 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5815caf0 con 0x7f0f580b3510 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5e8c2640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5815c030 0x7f0f5815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f5d8c0640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 0x7f0f58151080 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800d800 tx=0x7f0f4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f4effd640 1 -- 172.21.15.67:0/4078295705 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800b6c0 con 0x7f0f580b3510 2024-09-19T05:40:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f4effd640 1 -- 172.21.15.67:0/4078295705 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f48019070 con 0x7f0f580b3510 2024-09-19T05:40:01.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- 172.21.15.67:0/4078295705 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5815cdd0 con 0x7f0f580b3510 2024-09-19T05:40:01.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f4effd640 1 -- 172.21.15.67:0/4078295705 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800bae0 con 0x7f0f580b3510 2024-09-19T05:40:01.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.963+0000 7f0f60325640 1 -- 172.21.15.67:0/4078295705 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5815d390 con 0x7f0f580b3510 2024-09-19T05:40:01.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.967+0000 7f0f60325640 1 -- 172.21.15.67:0/4078295705 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f580b2fd0 con 0x7f0f580b3510 2024-09-19T05:40:01.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.967+0000 7f0f4effd640 1 -- 172.21.15.67:0/4078295705 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f4800bc80 con 0x7f0f580b3510 2024-09-19T05:40:01.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.967+0000 7f0f4effd640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f3c0678c0 0x7f0f3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.967+0000 7f0f4effd640 1 -- 172.21.15.67:0/4078295705 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f0f48086350 con 0x7f0f580b3510 2024-09-19T05:40:01.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.967+0000 7f0f5e0c1640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f3c0678c0 0x7f0f3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.967+0000 7f0f5e0c1640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f3c0678c0 0x7f0f3c069d80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0f54000f70 tx=0x7f0f54007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:01.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:01.971+0000 7f0f4effd640 1 -- 172.21.15.67:0/4078295705 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0f48056d00 con 0x7f0f580b3510 2024-09-19T05:40:02.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.175+0000 7f0f60325640 1 -- 172.21.15.67:0/4078295705 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f5815b7f0 con 0x7f0f580b3510 2024-09-19T05:40:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.175+0000 7f0f4effd640 1 -- 172.21.15.67:0/4078295705 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5219 (secure 0 0 0) 0x7f0f48056600 con 0x7f0f580b3510 2024-09-19T05:40:02.178 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:40:02.178 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":83,"btime":"2024-09-19T05:40:01:798281+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3139499810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3139499810},{"type":"v1","addr":"172.21.15.67:6833","nonce":3139499810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2818006351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2818006351},{"type":"v1","addr":"172.21.15.67:6835","nonce":2818006351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/762722911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":762722911},{"type":"v1","addr":"172.21.15.97:6835","nonce":762722911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:58.136994+0000","modified":"2024-09-19T05:40:01.171588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/396819326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":396819326},{"type":"v1","addr":"172.21.15.97:6837","nonce":396819326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6556,"qdb_cluster":[6556]},"id":7}]} 2024-09-19T05:40:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 83 2024-09-19T05:40:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 -- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f3c0678c0 msgr2=0x7f0f3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f3c0678c0 0x7f0f3c069d80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0f54000f70 tx=0x7f0f54007c10 comp rx=0 tx=0).stop 2024-09-19T05:40:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 -- 172.21.15.67:0/4078295705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 msgr2=0x7f0f58151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 0x7f0f58151080 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800d800 tx=0x7f0f4800dcc0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 -- 172.21.15.67:0/4078295705 shutdown_connections 2024-09-19T05:40:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5815c030 0x7f0f5815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f580b3510 0x7f0f58151080 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f3c0678c0 0x7f0f3c069d80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 --2- 172.21.15.67:0/4078295705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f5806dde0 0x7f0f580999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 -- 172.21.15.67:0/4078295705 >> 172.21.15.67:0/4078295705 conn(0x7f0f580d0080 msgr2=0x7f0f580b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:02.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 -- 172.21.15.67:0/4078295705 shutdown_connections 2024-09-19T05:40:02.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.179+0000 7f0f60325640 1 -- 172.21.15.67:0/4078295705 wait complete. 2024-09-19T05:40:02.196 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:40:02.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.323+0000 7fce160e0640 1 Processor -- start 2024-09-19T05:40:02.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.323+0000 7fce160e0640 1 -- start start 2024-09-19T05:40:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce160e0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fce100b2fd0 0x7fce100b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce160e0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fce100acfb0 0x7fce100ad390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce160e0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce100ad8d0 con 0x7fce10159d60 2024-09-19T05:40:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce160e0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fce1006de80 con 0x7fce100b2fd0 2024-09-19T05:40:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce160e0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fce1006e160 con 0x7fce100acfb0 2024-09-19T05:40:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0effd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fce100b2fd0 0x7fce100b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0effd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fce100b2fd0 0x7fce100b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57284/0 (socket says 172.21.15.67:57284) 2024-09-19T05:40:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0effd640 1 -- 172.21.15.67:0/263885070 learned_addr learned my addr 172.21.15.67:0/263885070 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0ffff640 1 --2- 172.21.15.67:0/263885070 >> v2:172.21.15.97:3300/0 conn(0x7fce100acfb0 0x7fce100ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0effd640 1 -- 172.21.15.67:0/263885070 >> v2:172.21.15.97:3300/0 conn(0x7fce100acfb0 msgr2=0x7fce100ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:02.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0effd640 1 --2- 172.21.15.67:0/263885070 >> v2:172.21.15.97:3300/0 conn(0x7fce100acfb0 0x7fce100ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0effd640 1 -- 172.21.15.67:0/263885070 >> v1:172.21.15.97:6789/0 conn(0x7fce10159d60 legacy=0x7fce1006ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:02.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0effd640 1 -- 172.21.15.67:0/263885070 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1006e440 con 0x7fce100b2fd0 2024-09-19T05:40:02.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0ffff640 1 --2- 172.21.15.67:0/263885070 >> v2:172.21.15.97:3300/0 conn(0x7fce100acfb0 0x7fce100ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0effd640 1 --2- 172.21.15.67:0/263885070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 0x7fce100b3420 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fce100743c0 tx=0x7fce0401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe7ba506d55ce65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0e7fc640 1 -- 172.21.15.67:0/263885070 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce040b1070 con 0x7fce100b2fd0 2024-09-19T05:40:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0e7fc640 1 -- 172.21.15.67:0/263885070 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce040ac630 con 0x7fce100b2fd0 2024-09-19T05:40:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce0e7fc640 1 -- 172.21.15.67:0/263885070 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce040a8050 con 0x7fce100b2fd0 2024-09-19T05:40:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce160e0640 1 -- 172.21.15.67:0/263885070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 msgr2=0x7fce100b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce160e0640 1 --2- 172.21.15.67:0/263885070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 0x7fce100b3420 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fce100743c0 tx=0x7fce0401c4e0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.327+0000 7fce160e0640 1 -- 172.21.15.67:0/263885070 shutdown_connections 2024-09-19T05:40:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 --2- 172.21.15.67:0/263885070 >> v2:172.21.15.97:3300/0 conn(0x7fce100acfb0 0x7fce100ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 --2- 172.21.15.67:0/263885070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 0x7fce100b3420 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 -- 172.21.15.67:0/263885070 >> 172.21.15.67:0/263885070 conn(0x7fce100d0080 msgr2=0x7fce100d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 -- 172.21.15.67:0/263885070 shutdown_connections 2024-09-19T05:40:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 -- 172.21.15.67:0/263885070 wait complete. 2024-09-19T05:40:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 Processor -- start 2024-09-19T05:40:02.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 -- start start 2024-09-19T05:40:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce100acfb0 0x7fce101563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 0x7fce101f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce10159d60 0x7fce10154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fce100af6b0 con 0x7fce100b2fd0 2024-09-19T05:40:02.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fce1006f630 con 0x7fce100acfb0 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fce100af830 con 0x7fce10159d60 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 0x7fce101f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 0x7fce101f8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57294/0 (socket says 172.21.15.67:57294) 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0effd640 1 -- 172.21.15.67:0/3305752583 learned_addr learned my addr 172.21.15.67:0/3305752583 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0f7fe640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce100acfb0 0x7fce101563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0ffff640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce10159d60 0x7fce10154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0effd640 1 -- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce10159d60 msgr2=0x7fce10154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0effd640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce10159d60 0x7fce10154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0effd640 1 -- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce100acfb0 msgr2=0x7fce101563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0effd640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce100acfb0 0x7fce101563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0effd640 1 -- 172.21.15.67:0/3305752583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce10159470 con 0x7fce100b2fd0 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0ffff640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce10159d60 0x7fce10154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce0effd640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 0x7fce101f8010 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fce040af040 tx=0x7fce04019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:02.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fcdf7fff640 1 -- 172.21.15.67:0/3305752583 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce040bc070 con 0x7fce100b2fd0 2024-09-19T05:40:02.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fcdf7fff640 1 -- 172.21.15.67:0/3305752583 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce040ab800 con 0x7fce100b2fd0 2024-09-19T05:40:02.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 -- 172.21.15.67:0/3305752583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce10159190 con 0x7fce100b2fd0 2024-09-19T05:40:02.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fcdf7fff640 1 -- 172.21.15.67:0/3305752583 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce040b1070 con 0x7fce100b2fd0 2024-09-19T05:40:02.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.331+0000 7fce160e0640 1 -- 172.21.15.67:0/3305752583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce10154160 con 0x7fce100b2fd0 2024-09-19T05:40:02.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.335+0000 7fce160e0640 1 -- 172.21.15.67:0/3305752583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce100ad390 con 0x7fce100b2fd0 2024-09-19T05:40:02.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.335+0000 7fcdf7fff640 1 -- 172.21.15.67:0/3305752583 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fce040bf070 con 0x7fce100b2fd0 2024-09-19T05:40:02.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.335+0000 7fcdf7fff640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcdfc0678c0 0x7fcdfc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.335+0000 7fcdf7fff640 1 -- 172.21.15.67:0/3305752583 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7fce0411f820 con 0x7fce100b2fd0 2024-09-19T05:40:02.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.335+0000 7fce0f7fe640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcdfc0678c0 0x7fcdfc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.335+0000 7fce0f7fe640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcdfc0678c0 0x7fcdfc069d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fce00005530 tx=0x7fce00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:02.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.339+0000 7fcdf7fff640 1 -- 172.21.15.67:0/3305752583 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fce040160d0 con 0x7fce100b2fd0 2024-09-19T05:40:02.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.503+0000 7fce160e0640 1 -- 172.21.15.67:0/3305752583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce100d0f20 con 0x7fce100b2fd0 2024-09-19T05:40:02.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.503+0000 7fcdf7fff640 1 -- 172.21.15.67:0/3305752583 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16908 (secure 0 0 0) 0x7fce040f01c0 con 0x7fce100b2fd0 2024-09-19T05:40:02.505 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:40:02.505 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":116,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:39:59.750853+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:39:55.832671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-19T05:39:57.135928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:40:02.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 -- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcdfc0678c0 msgr2=0x7fcdfc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcdfc0678c0 0x7fcdfc069d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fce00005530 tx=0x7fce00009040 comp rx=0 tx=0).stop 2024-09-19T05:40:02.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 -- 172.21.15.67:0/3305752583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 msgr2=0x7fce101f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 0x7fce101f8010 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fce040af040 tx=0x7fce04019280 comp rx=0 tx=0).stop 2024-09-19T05:40:02.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 -- 172.21.15.67:0/3305752583 shutdown_connections 2024-09-19T05:40:02.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcdfc0678c0 0x7fcdfc069d80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce10159d60 0x7fce10154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce100b2fd0 0x7fce101f8010 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 --2- 172.21.15.67:0/3305752583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce100acfb0 0x7fce101563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 -- 172.21.15.67:0/3305752583 >> 172.21.15.67:0/3305752583 conn(0x7fce100d0080 msgr2=0x7fce101455c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:02.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 -- 172.21.15.67:0/3305752583 shutdown_connections 2024-09-19T05:40:02.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.507+0000 7fce160e0640 1 -- 172.21.15.67:0/3305752583 wait complete. 2024-09-19T05:40:02.523 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:40:02.523 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:40:02.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.635+0000 7f338d656640 1 Processor -- start 2024-09-19T05:40:02.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.635+0000 7f338d656640 1 -- start start 2024-09-19T05:40:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f338d656640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3388161da0 0x7f33880d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f338d656640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33880d05d0 con 0x7f33880d0e80 2024-09-19T05:40:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f338d656640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33880d4d40 con 0x7f33880d0160 2024-09-19T05:40:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f338d656640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f33880d0840 con 0x7f3388161da0 2024-09-19T05:40:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33867fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f33880d0e80 0x7f33880b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50954/0 (socket says 172.21.15.67:50954) 2024-09-19T05:40:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33867fc640 1 -- 172.21.15.67:0/3171162905 learned_addr learned my addr 172.21.15.67:0/3171162905 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:40:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3386ffd640 1 --2- 172.21.15.67:0/3171162905 >> v2:172.21.15.97:3300/0 conn(0x7f3388161da0 0x7f33880d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445983486 0 0) 0x7f33880d05d0 con 0x7f33880d0e80 2024-09-19T05:40:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3374003530 con 0x7f33880d0e80 2024-09-19T05:40:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4239227528 0 0) 0x7f3374003530 con 0x7f33880d0e80 2024-09-19T05:40:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 >> v2:172.21.15.97:3300/0 conn(0x7f3388161da0 msgr2=0x7f33880d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 --2- 172.21.15.67:0/3171162905 >> v2:172.21.15.97:3300/0 conn(0x7f3388161da0 0x7f33880d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 >> v1:172.21.15.97:6789/0 conn(0x7f33880d0160 legacy=0x7f33880b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33880d5020 con 0x7f33880d0e80 2024-09-19T05:40:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3378001680 con 0x7f33880d0e80 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 >> v1:172.21.15.67:6789/0 conn(0x7f33880d0e80 legacy=0x7f33880b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3374003a10 0x7f3374003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3374004810 0x7f3374004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33740051d0 0x7f337400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33880d0840 con 0x7f33740051d0 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f337400c0d0 con 0x7f3374003a10 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f337400c2d0 con 0x7f3374004810 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33877fe640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33740051d0 0x7f337400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3386ffd640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3374003a10 0x7f3374003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33867fc640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3374004810 0x7f3374004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33877fe640 1 -- 172.21.15.67:0/3171162905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3374004810 msgr2=0x7f3374004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33877fe640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3374004810 0x7f3374004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33877fe640 1 -- 172.21.15.67:0/3171162905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3374003a10 msgr2=0x7f3374003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:02.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33877fe640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3374003a10 0x7f3374003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33877fe640 1 -- 172.21.15.67:0/3171162905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3374003530 con 0x7f33740051d0 2024-09-19T05:40:02.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f3386ffd640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3374003a10 0x7f3374003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33877fe640 1 -- 172.21.15.67:0/3171162905 reap_dead start 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.639+0000 7f33877fe640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33740051d0 0x7f337400b9d0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f3380001e70 tx=0x7f338001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674b2a9b52895400 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380001a90 con 0x7f33740051d0 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3380003bc0 con 0x7f33740051d0 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f3385ffb640 1 -- 172.21.15.67:0/3171162905 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380005020 con 0x7f33740051d0 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- 172.21.15.67:0/3171162905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33740051d0 msgr2=0x7f337400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33740051d0 0x7f337400b9d0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f3380001e70 tx=0x7f338001c780 comp rx=0 tx=0).stop 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- 172.21.15.67:0/3171162905 shutdown_connections 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 --2- 172.21.15.67:0/3171162905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33740051d0 0x7f337400b9d0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- 172.21.15.67:0/3171162905 >> 172.21.15.67:0/3171162905 conn(0x7f338808bfc0 msgr2=0x7f33880d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- 172.21.15.67:0/3171162905 shutdown_connections 2024-09-19T05:40:02.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- 172.21.15.67:0/3171162905 wait complete. 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 Processor -- start 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- start start 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33740051d0 0x7f338815fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33880cab50 0x7f338815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f338815d430 0x7f338815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33880b5d00 con 0x7f338815d430 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33880b3ca0 con 0x7f33880cab50 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3388162180 con 0x7f33740051d0 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f33877fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f338815d430 0x7f338815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f33877fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f338815d430 0x7f338815d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57312/0 (socket says 172.21.15.67:57312) 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f33877fe640 1 -- 172.21.15.67:0/4267024323 learned_addr learned my addr 172.21.15.67:0/4267024323 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f33867fc640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33880cab50 0x7f338815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f3386ffd640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33740051d0 0x7f338815fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f33877fe640 1 -- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33740051d0 msgr2=0x7f338815fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f33877fe640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33740051d0 0x7f338815fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f33877fe640 1 -- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33880cab50 msgr2=0x7f338815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f33877fe640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33880cab50 0x7f338815b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f33877fe640 1 -- 172.21.15.67:0/4267024323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33880b9400 con 0x7f338815d430 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f33877fe640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f338815d430 0x7f338815d8c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f338001cc60 tx=0x7f3374005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f337f7fe640 1 -- 172.21.15.67:0/4267024323 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380007dc0 con 0x7f338815d430 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f337f7fe640 1 -- 172.21.15.67:0/4267024323 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33800057f0 con 0x7f338815d430 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- 172.21.15.67:0/4267024323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33880cafe0 con 0x7f338815d430 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f337f7fe640 1 -- 172.21.15.67:0/4267024323 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380006d70 con 0x7f338815d430 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.643+0000 7f338d656640 1 -- 172.21.15.67:0/4267024323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33880b9960 con 0x7f338815d430 2024-09-19T05:40:02.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.647+0000 7f338d656640 1 -- 172.21.15.67:0/4267024323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33880d1af0 con 0x7f338815d430 2024-09-19T05:40:02.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.647+0000 7f337f7fe640 1 -- 172.21.15.67:0/4267024323 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33800a6480 con 0x7f338815d430 2024-09-19T05:40:02.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.647+0000 7f337f7fe640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33680678c0 0x7f3368069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:02.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.647+0000 7f337f7fe640 1 -- 172.21.15.67:0/4267024323 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f338011f850 con 0x7f338815d430 2024-09-19T05:40:02.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.647+0000 7f3386ffd640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33680678c0 0x7f3368069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:02.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.647+0000 7f3386ffd640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33680678c0 0x7f3368069d80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f33700099b0 tx=0x7f3370008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:02.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.651+0000 7f337f7fe640 1 -- 172.21.15.67:0/4267024323 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f33800b8060 con 0x7f338815d430 2024-09-19T05:40:02.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.811+0000 7f338d656640 1 -- 172.21.15.67:0/4267024323 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33880b9cb0 con 0x7f33680678c0 2024-09-19T05:40:02.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.827+0000 7f337f7fe640 1 -- 172.21.15.67:0/4267024323 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240294 (secure 0 0 0) 0x7f33880b9cb0 con 0x7f33680678c0 2024-09-19T05:40:02.829 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:40:02.831 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:40:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 -- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33680678c0 msgr2=0x7f3368069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33680678c0 0x7f3368069d80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f33700099b0 tx=0x7f3370008040 comp rx=0 tx=0).stop 2024-09-19T05:40:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 -- 172.21.15.67:0/4267024323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f338815d430 msgr2=0x7f338815d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f338815d430 0x7f338815d8c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f338001cc60 tx=0x7f3374005840 comp rx=0 tx=0).stop 2024-09-19T05:40:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 -- 172.21.15.67:0/4267024323 shutdown_connections 2024-09-19T05:40:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f338815d430 0x7f338815d8c0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33880cab50 0x7f338815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33680678c0 0x7f3368069d80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 --2- 172.21.15.67:0/4267024323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33740051d0 0x7f338815fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:02.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 -- 172.21.15.67:0/4267024323 >> 172.21.15.67:0/4267024323 conn(0x7f338808bfc0 msgr2=0x7f33880b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:02.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 -- 172.21.15.67:0/4267024323 shutdown_connections 2024-09-19T05:40:02.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:02.831+0000 7f338d656640 1 -- 172.21.15.67:0/4267024323 wait complete. 2024-09-19T05:40:02.847 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-19T05:40:01.246523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":358716,"kb_used_data":12036,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754616004,"statfs":{"total":773094113280,"available":772726788096,"internally_reserved":0,"allocated":12324864,"data_stored":6393461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.508816"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.743551+0000","last_change":"2024-09-19T05:39:56.743551+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.743551+0000","last_undegraded":"2024-09-19T05:39:56.743551+0000","last_fullsized":"2024-09-19T05:39:56.743551+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.752131+0000","last_change":"2024-09-19T05:39:56.752131+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.752131+0000","last_undegraded":"2024-09-19T05:39:56.752131+0000","last_fullsized":"2024-09-19T05:39:56.752131+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.741305+0000","last_change":"2024-09-19T05:39:56.741305+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.741305+0000","last_undegraded":"2024-09-19T05:39:56.741305+0000","last_fullsized":"2024-09-19T05:39:56.741305+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.747401+0000","last_change":"2024-09-19T05:39:56.747401+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.747401+0000","last_undegraded":"2024-09-19T05:39:56.747401+0000","last_fullsized":"2024-09-19T05:39:56.747401+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.750446+0000","last_change":"2024-09-19T05:39:56.750446+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.750446+0000","last_undegraded":"2024-09-19T05:39:56.750446+0000","last_fullsized":"2024-09-19T05:39:56.750446+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.746302+0000","last_change":"2024-09-19T05:39:56.746302+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.746302+0000","last_undegraded":"2024-09-19T05:39:56.746302+0000","last_fullsized":"2024-09-19T05:39:56.746302+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.741225+0000","last_change":"2024-09-19T05:39:56.741225+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.741225+0000","last_undegraded":"2024-09-19T05:39:56.741225+0000","last_fullsized":"2024-09-19T05:39:56.741225+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.744169+0000","last_change":"2024-09-19T05:39:56.744169+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.744169+0000","last_undegraded":"2024-09-19T05:39:56.744169+0000","last_fullsized":"2024-09-19T05:39:56.744169+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.741326+0000","last_change":"2024-09-19T05:39:56.741326+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.741326+0000","last_undegraded":"2024-09-19T05:39:56.741326+0000","last_fullsized":"2024-09-19T05:39:56.741326+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.753401+0000","last_change":"2024-09-19T05:39:56.753401+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.753401+0000","last_undegraded":"2024-09-19T05:39:56.753401+0000","last_fullsized":"2024-09-19T05:39:56.753401+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.750341+0000","last_change":"2024-09-19T05:39:56.750341+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.750341+0000","last_undegraded":"2024-09-19T05:39:56.750341+0000","last_fullsized":"2024-09-19T05:39:56.750341+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.745569+0000","last_change":"2024-09-19T05:39:56.745569+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.745569+0000","last_undegraded":"2024-09-19T05:39:56.745569+0000","last_fullsized":"2024-09-19T05:39:56.745569+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.746825+0000","last_change":"2024-09-19T05:39:56.746825+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.746825+0000","last_undegraded":"2024-09-19T05:39:56.746825+0000","last_fullsized":"2024-09-19T05:39:56.746825+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.743780+0000","last_change":"2024-09-19T05:39:56.743780+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.743780+0000","last_undegraded":"2024-09-19T05:39:56.743780+0000","last_fullsized":"2024-09-19T05:39:56.743780+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.749614+0000","last_change":"2024-09-19T05:39:56.749614+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.749614+0000","last_undegraded":"2024-09-19T05:39:56.749614+0000","last_fullsized":"2024-09-19T05:39:56.749614+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.741195+0000","last_change":"2024-09-19T05:39:56.741195+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.741195+0000","last_undegraded":"2024-09-19T05:39:56.741195+0000","last_fullsized":"2024-09-19T05:39:56.741195+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.745609+0000","last_change":"2024-09-19T05:39:56.745609+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.745609+0000","last_undegraded":"2024-09-19T05:39:56.745609+0000","last_fullsized":"2024-09-19T05:39:56.745609+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.749170+0000","last_change":"2024-09-19T05:39:56.749170+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.749170+0000","last_undegraded":"2024-09-19T05:39:56.749170+0000","last_fullsized":"2024-09-19T05:39:56.749170+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.747439+0000","last_change":"2024-09-19T05:39:56.747439+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.747439+0000","last_undegraded":"2024-09-19T05:39:56.747439+0000","last_fullsized":"2024-09-19T05:39:56.747439+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.749663+0000","last_change":"2024-09-19T05:39:56.749663+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.749663+0000","last_undegraded":"2024-09-19T05:39:56.749663+0000","last_fullsized":"2024-09-19T05:39:56.749663+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.751092+0000","last_change":"2024-09-19T05:39:56.751092+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.751092+0000","last_undegraded":"2024-09-19T05:39:56.751092+0000","last_fullsized":"2024-09-19T05:39:56.751092+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.750747+0000","last_change":"2024-09-19T05:39:56.750747+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.750747+0000","last_undegraded":"2024-09-19T05:39:56.750747+0000","last_fullsized":"2024-09-19T05:39:56.750747+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.750062+0000","last_change":"2024-09-19T05:39:56.750062+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.750062+0000","last_undegraded":"2024-09-19T05:39:56.750062+0000","last_fullsized":"2024-09-19T05:39:56.750062+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.746825+0000","last_change":"2024-09-19T05:39:56.746825+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.746825+0000","last_undegraded":"2024-09-19T05:39:56.746825+0000","last_fullsized":"2024-09-19T05:39:56.746825+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.752736+0000","last_change":"2024-09-19T05:39:56.752736+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.752736+0000","last_undegraded":"2024-09-19T05:39:56.752736+0000","last_fullsized":"2024-09-19T05:39:56.752736+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.745640+0000","last_change":"2024-09-19T05:39:56.745640+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.745640+0000","last_undegraded":"2024-09-19T05:39:56.745640+0000","last_fullsized":"2024-09-19T05:39:56.745640+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.746742+0000","last_change":"2024-09-19T05:39:56.746742+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.746742+0000","last_undegraded":"2024-09-19T05:39:56.746742+0000","last_fullsized":"2024-09-19T05:39:56.746742+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.741817+0000","last_change":"2024-09-19T05:39:56.741817+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.741817+0000","last_undegraded":"2024-09-19T05:39:56.741817+0000","last_fullsized":"2024-09-19T05:39:56.741817+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.749971+0000","last_change":"2024-09-19T05:39:56.749971+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.749971+0000","last_undegraded":"2024-09-19T05:39:56.749971+0000","last_fullsized":"2024-09-19T05:39:56.749971+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.748674+0000","last_change":"2024-09-19T05:39:56.748674+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.748674+0000","last_undegraded":"2024-09-19T05:39:56.748674+0000","last_fullsized":"2024-09-19T05:39:56.748674+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.749523+0000","last_change":"2024-09-19T05:39:56.749523+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.749523+0000","last_undegraded":"2024-09-19T05:39:56.749523+0000","last_fullsized":"2024-09-19T05:39:56.749523+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.750054+0000","last_change":"2024-09-19T05:39:56.750054+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.750054+0000","last_undegraded":"2024-09-19T05:39:56.750054+0000","last_fullsized":"2024-09-19T05:39:56.750054+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":335,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-19T05:39:56.751111+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:39:56.751111+0000","last_peered":"2024-09-19T05:39:56.751111+0000","last_clean":"2024-09-19T05:39:56.751111+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:39:56.751111+0000","last_undegraded":"2024-09-19T05:39:56.751111+0000","last_fullsized":"2024-09-19T05:39:56.751111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542229,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51184,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320656,"statfs":{"total":96636764160,"available":96584351744,"internally_reserved":0,"allocated":1990656,"data_stored":1244287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40872,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330968,"statfs":{"total":96636764160,"available":96594911232,"internally_reserved":0,"allocated":1396736,"data_stored":653919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542231,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45028,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326812,"statfs":{"total":96636764160,"available":96590655488,"internally_reserved":0,"allocated":1384448,"data_stored":647710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50600,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321240,"statfs":{"total":96636764160,"available":96584949760,"internally_reserved":0,"allocated":1396736,"data_stored":653919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542230,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46436,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325404,"statfs":{"total":96636764160,"available":96589213696,"internally_reserved":0,"allocated":1384448,"data_stored":647710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28396,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343444,"statfs":{"total":96636764160,"available":96607686656,"internally_reserved":0,"allocated":1396736,"data_stored":653919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40872,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330968,"statfs":{"total":96636764160,"available":96594911232,"internally_reserved":0,"allocated":1396736,"data_stored":653919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542229,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55328,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316512,"statfs":{"total":96636764160,"available":96580108288,"internally_reserved":0,"allocated":1978368,"data_stored":1238078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:40:02.852 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:40:03.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.015+0000 7ffa3afbd640 1 Processor -- start 2024-09-19T05:40:03.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.015+0000 7ffa3afbd640 1 -- start start 2024-09-19T05:40:03.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3afbd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa340c8c40 0x7ffa340705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3afbd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffa3415d290 0x7ffa3409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3afbd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffa3409af70 0x7ffa34159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3afbd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ffa340c7130 con 0x7ffa3409af70 2024-09-19T05:40:03.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3afbd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ffa34070b90 con 0x7ffa3415d290 2024-09-19T05:40:03.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3afbd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ffa34070e70 con 0x7ffa340c8c40 2024-09-19T05:40:03.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3955a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffa3409af70 0x7ffa34159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3955a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffa3409af70 0x7ffa34159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57316/0 (socket says 172.21.15.67:57316) 2024-09-19T05:40:03.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3955a640 1 -- 172.21.15.67:0/380184241 learned_addr learned my addr 172.21.15.67:0/380184241 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:03.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa33fff640 1 --2- 172.21.15.67:0/380184241 >> v2:172.21.15.97:3300/0 conn(0x7ffa3415d290 0x7ffa3409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa38d59640 1 --2- 172.21.15.67:0/380184241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa340c8c40 0x7ffa340705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3955a640 1 -- 172.21.15.67:0/380184241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa340c8c40 msgr2=0x7ffa340705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:03.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3955a640 1 --2- 172.21.15.67:0/380184241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa340c8c40 0x7ffa340705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3955a640 1 -- 172.21.15.67:0/380184241 >> v2:172.21.15.97:3300/0 conn(0x7ffa3415d290 msgr2=0x7ffa3409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:03.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3955a640 1 --2- 172.21.15.67:0/380184241 >> v2:172.21.15.97:3300/0 conn(0x7ffa3415d290 0x7ffa3409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3955a640 1 -- 172.21.15.67:0/380184241 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa34071150 con 0x7ffa3409af70 2024-09-19T05:40:03.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa38d59640 1 --2- 172.21.15.67:0/380184241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa340c8c40 0x7ffa340705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:03.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa3955a640 1 --2- 172.21.15.67:0/380184241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3409af70 0x7ffa34159550 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7ffa340737d0 tx=0x7ffa2c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93ecf11f0218088 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:03.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa337fe640 1 -- 172.21.15.67:0/380184241 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0a5670 con 0x7ffa3409af70 2024-09-19T05:40:03.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa337fe640 1 -- 172.21.15.67:0/380184241 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa2c0a5810 con 0x7ffa3409af70 2024-09-19T05:40:03.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.019+0000 7ffa337fe640 1 -- 172.21.15.67:0/380184241 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0a5be0 con 0x7ffa3409af70 2024-09-19T05:40:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- 172.21.15.67:0/380184241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3409af70 msgr2=0x7ffa34159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 --2- 172.21.15.67:0/380184241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3409af70 0x7ffa34159550 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7ffa340737d0 tx=0x7ffa2c01c9f0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- 172.21.15.67:0/380184241 shutdown_connections 2024-09-19T05:40:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 --2- 172.21.15.67:0/380184241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3409af70 0x7ffa34159550 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 --2- 172.21.15.67:0/380184241 >> v2:172.21.15.97:3300/0 conn(0x7ffa3415d290 0x7ffa3409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 --2- 172.21.15.67:0/380184241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa340c8c40 0x7ffa340705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- 172.21.15.67:0/380184241 >> 172.21.15.67:0/380184241 conn(0x7ffa340d22b0 msgr2=0x7ffa340d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- 172.21.15.67:0/380184241 shutdown_connections 2024-09-19T05:40:03.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- 172.21.15.67:0/380184241 wait complete. 2024-09-19T05:40:03.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 Processor -- start 2024-09-19T05:40:03.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- start start 2024-09-19T05:40:03.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa3409af70 0x7ffa341594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa340c8c40 0x7ffa34158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3415d290 0x7ffa34151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3415ff20 con 0x7ffa3415d290 2024-09-19T05:40:03.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3415fda0 con 0x7ffa340c8c40 2024-09-19T05:40:03.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ffa341600a0 con 0x7ffa3409af70 2024-09-19T05:40:03.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3955a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3415d290 0x7ffa34151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3955a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3415d290 0x7ffa34151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57326/0 (socket says 172.21.15.67:57326) 2024-09-19T05:40:03.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3955a640 1 -- 172.21.15.67:0/2440083774 learned_addr learned my addr 172.21.15.67:0/2440083774 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa38d59640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa3409af70 0x7ffa341594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa33fff640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa340c8c40 0x7ffa34158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3955a640 1 -- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa3409af70 msgr2=0x7ffa341594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3955a640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa3409af70 0x7ffa341594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3955a640 1 -- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa340c8c40 msgr2=0x7ffa34158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3955a640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa340c8c40 0x7ffa34158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3955a640 1 -- 172.21.15.67:0/2440083774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa340b12d0 con 0x7ffa3415d290 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3955a640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3415d290 0x7ffa34151b40 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0af040 tx=0x7ffa2c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa317fa640 1 -- 172.21.15.67:0/2440083774 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c009510 con 0x7ffa3415d290 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa317fa640 1 -- 172.21.15.67:0/2440083774 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa2c0be070 con 0x7ffa3415d290 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- 172.21.15.67:0/2440083774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa34157f90 con 0x7ffa3415d290 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa317fa640 1 -- 172.21.15.67:0/2440083774 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0b88b0 con 0x7ffa3415d290 2024-09-19T05:40:03.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.023+0000 7ffa3afbd640 1 -- 172.21.15.67:0/2440083774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa34150210 con 0x7ffa3415d290 2024-09-19T05:40:03.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.027+0000 7ffa3afbd640 1 -- 172.21.15.67:0/2440083774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa340705b0 con 0x7ffa3415d290 2024-09-19T05:40:03.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.027+0000 7ffa317fa640 1 -- 172.21.15.67:0/2440083774 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa2c0b8a50 con 0x7ffa3415d290 2024-09-19T05:40:03.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.027+0000 7ffa317fa640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffa200678c0 0x7ffa20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.027+0000 7ffa317fa640 1 -- 172.21.15.67:0/2440083774 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7ffa2c120e70 con 0x7ffa3415d290 2024-09-19T05:40:03.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.027+0000 7ffa38d59640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffa200678c0 0x7ffa20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.027+0000 7ffa38d59640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffa200678c0 0x7ffa20069d80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa3415f690 tx=0x7ffa24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:03.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.031+0000 7ffa317fa640 1 -- 172.21.15.67:0/2440083774 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ffa2c0165e0 con 0x7ffa3415d290 2024-09-19T05:40:03.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.191+0000 7ffa3afbd640 1 -- 172.21.15.67:0/2440083774 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa34071a70 con 0x7ffa200678c0 2024-09-19T05:40:03.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.207+0000 7ffa317fa640 1 -- 172.21.15.67:0/2440083774 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240294 (secure 0 0 0) 0x7ffa34071a70 con 0x7ffa200678c0 2024-09-19T05:40:03.210 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:40:03.213 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 -- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffa200678c0 msgr2=0x7ffa20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffa200678c0 0x7ffa20069d80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa3415f690 tx=0x7ffa24008040 comp rx=0 tx=0).stop 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 -- 172.21.15.67:0/2440083774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3415d290 msgr2=0x7ffa34151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3415d290 0x7ffa34151b40 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0af040 tx=0x7ffa2c019790 comp rx=0 tx=0).stop 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 -- 172.21.15.67:0/2440083774 shutdown_connections 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa3415d290 0x7ffa34151b40 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa340c8c40 0x7ffa34158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffa200678c0 0x7ffa20069d80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 --2- 172.21.15.67:0/2440083774 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa3409af70 0x7ffa341594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 -- 172.21.15.67:0/2440083774 >> 172.21.15.67:0/2440083774 conn(0x7ffa340d22b0 msgr2=0x7ffa340d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 -- 172.21.15.67:0/2440083774 shutdown_connections 2024-09-19T05:40:03.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.211+0000 7ffa3afbd640 1 -- 172.21.15.67:0/2440083774 wait complete. 2024-09-19T05:40:03.229 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-19T05:40:01.246523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":358716,"kb_used_data":12036,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754616004,"statfs":{"total":773094113280,"available":772726788096,"internally_reserved":0,"allocated":12324864,"data_stored":6393461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.508816"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.743551+0000","last_change":"2024-09-19T05:39:56.743551+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.743551+0000","last_undegraded":"2024-09-19T05:39:56.743551+0000","last_fullsized":"2024-09-19T05:39:56.743551+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.752131+0000","last_change":"2024-09-19T05:39:56.752131+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.752131+0000","last_undegraded":"2024-09-19T05:39:56.752131+0000","last_fullsized":"2024-09-19T05:39:56.752131+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.741305+0000","last_change":"2024-09-19T05:39:56.741305+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.741305+0000","last_undegraded":"2024-09-19T05:39:56.741305+0000","last_fullsized":"2024-09-19T05:39:56.741305+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.747401+0000","last_change":"2024-09-19T05:39:56.747401+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.747401+0000","last_undegraded":"2024-09-19T05:39:56.747401+0000","last_fullsized":"2024-09-19T05:39:56.747401+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.750446+0000","last_change":"2024-09-19T05:39:56.750446+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.750446+0000","last_undegraded":"2024-09-19T05:39:56.750446+0000","last_fullsized":"2024-09-19T05:39:56.750446+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.746302+0000","last_change":"2024-09-19T05:39:56.746302+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.746302+0000","last_undegraded":"2024-09-19T05:39:56.746302+0000","last_fullsized":"2024-09-19T05:39:56.746302+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.741225+0000","last_change":"2024-09-19T05:39:56.741225+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.741225+0000","last_undegraded":"2024-09-19T05:39:56.741225+0000","last_fullsized":"2024-09-19T05:39:56.741225+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.744169+0000","last_change":"2024-09-19T05:39:56.744169+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.744169+0000","last_undegraded":"2024-09-19T05:39:56.744169+0000","last_fullsized":"2024-09-19T05:39:56.744169+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.741326+0000","last_change":"2024-09-19T05:39:56.741326+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.741326+0000","last_undegraded":"2024-09-19T05:39:56.741326+0000","last_fullsized":"2024-09-19T05:39:56.741326+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.753401+0000","last_change":"2024-09-19T05:39:56.753401+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.753401+0000","last_undegraded":"2024-09-19T05:39:56.753401+0000","last_fullsized":"2024-09-19T05:39:56.753401+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.750341+0000","last_change":"2024-09-19T05:39:56.750341+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.750341+0000","last_undegraded":"2024-09-19T05:39:56.750341+0000","last_fullsized":"2024-09-19T05:39:56.750341+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.745569+0000","last_change":"2024-09-19T05:39:56.745569+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.745569+0000","last_undegraded":"2024-09-19T05:39:56.745569+0000","last_fullsized":"2024-09-19T05:39:56.745569+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.746825+0000","last_change":"2024-09-19T05:39:56.746825+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.746825+0000","last_undegraded":"2024-09-19T05:39:56.746825+0000","last_fullsized":"2024-09-19T05:39:56.746825+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.743780+0000","last_change":"2024-09-19T05:39:56.743780+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.743780+0000","last_undegraded":"2024-09-19T05:39:56.743780+0000","last_fullsized":"2024-09-19T05:39:56.743780+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.749614+0000","last_change":"2024-09-19T05:39:56.749614+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.749614+0000","last_undegraded":"2024-09-19T05:39:56.749614+0000","last_fullsized":"2024-09-19T05:39:56.749614+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.741195+0000","last_change":"2024-09-19T05:39:56.741195+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.741195+0000","last_undegraded":"2024-09-19T05:39:56.741195+0000","last_fullsized":"2024-09-19T05:39:56.741195+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.745609+0000","last_change":"2024-09-19T05:39:56.745609+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.745609+0000","last_undegraded":"2024-09-19T05:39:56.745609+0000","last_fullsized":"2024-09-19T05:39:56.745609+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.749170+0000","last_change":"2024-09-19T05:39:56.749170+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.749170+0000","last_undegraded":"2024-09-19T05:39:56.749170+0000","last_fullsized":"2024-09-19T05:39:56.749170+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.747439+0000","last_change":"2024-09-19T05:39:56.747439+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.747439+0000","last_undegraded":"2024-09-19T05:39:56.747439+0000","last_fullsized":"2024-09-19T05:39:56.747439+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.749663+0000","last_change":"2024-09-19T05:39:56.749663+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.749663+0000","last_undegraded":"2024-09-19T05:39:56.749663+0000","last_fullsized":"2024-09-19T05:39:56.749663+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.751092+0000","last_change":"2024-09-19T05:39:56.751092+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.751092+0000","last_undegraded":"2024-09-19T05:39:56.751092+0000","last_fullsized":"2024-09-19T05:39:56.751092+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.750747+0000","last_change":"2024-09-19T05:39:56.750747+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.750747+0000","last_undegraded":"2024-09-19T05:39:56.750747+0000","last_fullsized":"2024-09-19T05:39:56.750747+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.750062+0000","last_change":"2024-09-19T05:39:56.750062+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.750062+0000","last_undegraded":"2024-09-19T05:39:56.750062+0000","last_fullsized":"2024-09-19T05:39:56.750062+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.746825+0000","last_change":"2024-09-19T05:39:56.746825+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.746825+0000","last_undegraded":"2024-09-19T05:39:56.746825+0000","last_fullsized":"2024-09-19T05:39:56.746825+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.752736+0000","last_change":"2024-09-19T05:39:56.752736+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.752736+0000","last_undegraded":"2024-09-19T05:39:56.752736+0000","last_fullsized":"2024-09-19T05:39:56.752736+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.745640+0000","last_change":"2024-09-19T05:39:56.745640+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.745640+0000","last_undegraded":"2024-09-19T05:39:56.745640+0000","last_fullsized":"2024-09-19T05:39:56.745640+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.746742+0000","last_change":"2024-09-19T05:39:56.746742+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.746742+0000","last_undegraded":"2024-09-19T05:39:56.746742+0000","last_fullsized":"2024-09-19T05:39:56.746742+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.741817+0000","last_change":"2024-09-19T05:39:56.741817+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.741817+0000","last_undegraded":"2024-09-19T05:39:56.741817+0000","last_fullsized":"2024-09-19T05:39:56.741817+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.749971+0000","last_change":"2024-09-19T05:39:56.749971+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.749971+0000","last_undegraded":"2024-09-19T05:39:56.749971+0000","last_fullsized":"2024-09-19T05:39:56.749971+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.748674+0000","last_change":"2024-09-19T05:39:56.748674+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.748674+0000","last_undegraded":"2024-09-19T05:39:56.748674+0000","last_fullsized":"2024-09-19T05:39:56.748674+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.749523+0000","last_change":"2024-09-19T05:39:56.749523+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.749523+0000","last_undegraded":"2024-09-19T05:39:56.749523+0000","last_fullsized":"2024-09-19T05:39:56.749523+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:39:57.737905+0000","last_change":"2024-09-19T05:39:57.737905+0000","last_active":"2024-09-19T05:39:57.737905+0000","last_peered":"2024-09-19T05:39:57.737905+0000","last_clean":"2024-09-19T05:39:57.737905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:57.737905+0000","last_undegraded":"2024-09-19T05:39:57.737905+0000","last_fullsized":"2024-09-19T05:39:57.737905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-19T05:39:56.750054+0000","last_change":"2024-09-19T05:39:56.750054+0000","last_active":"2024-09-19T05:39:56.733550+0000","last_peered":"2024-09-19T05:39:56.733550+0000","last_clean":"2024-09-19T05:39:56.733550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:39:56.750054+0000","last_undegraded":"2024-09-19T05:39:56.750054+0000","last_fullsized":"2024-09-19T05:39:56.750054+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":335,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-19T05:39:56.751111+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:39:56.751111+0000","last_peered":"2024-09-19T05:39:56.751111+0000","last_clean":"2024-09-19T05:39:56.751111+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:39:56.751111+0000","last_undegraded":"2024-09-19T05:39:56.751111+0000","last_fullsized":"2024-09-19T05:39:56.751111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542229,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51184,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320656,"statfs":{"total":96636764160,"available":96584351744,"internally_reserved":0,"allocated":1990656,"data_stored":1244287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40872,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330968,"statfs":{"total":96636764160,"available":96594911232,"internally_reserved":0,"allocated":1396736,"data_stored":653919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542231,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45028,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326812,"statfs":{"total":96636764160,"available":96590655488,"internally_reserved":0,"allocated":1384448,"data_stored":647710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50600,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321240,"statfs":{"total":96636764160,"available":96584949760,"internally_reserved":0,"allocated":1396736,"data_stored":653919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542230,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46436,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325404,"statfs":{"total":96636764160,"available":96589213696,"internally_reserved":0,"allocated":1384448,"data_stored":647710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28396,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343444,"statfs":{"total":96636764160,"available":96607686656,"internally_reserved":0,"allocated":1396736,"data_stored":653919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40872,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330968,"statfs":{"total":96636764160,"available":96594911232,"internally_reserved":0,"allocated":1396736,"data_stored":653919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542229,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55328,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316512,"statfs":{"total":96636764160,"available":96580108288,"internally_reserved":0,"allocated":1978368,"data_stored":1238078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:40:03.233 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:40:03.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.403+0000 7f358feb0640 1 Processor -- start 2024-09-19T05:40:03.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.403+0000 7f358feb0640 1 -- start start 2024-09-19T05:40:03.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358feb0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f358815b1e0 0x7f35880b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358feb0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35880b4900 0x7f3588071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358feb0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35880b3860 con 0x7f35880723c0 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358feb0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f358815b5c0 con 0x7f35880b4900 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358feb0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f35880b3b40 con 0x7f358815b1e0 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358d44b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35880b4900 0x7f3588071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358d44b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35880b4900 0x7f3588071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57342/0 (socket says 172.21.15.67:57342) 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358d44b640 1 -- 172.21.15.67:0/2646079721 learned_addr learned my addr 172.21.15.67:0/2646079721 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358dc4c640 1 --2- 172.21.15.67:0/2646079721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f358815b1e0 0x7f35880b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358d44b640 1 -- 172.21.15.67:0/2646079721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f358815b1e0 msgr2=0x7f35880b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358d44b640 1 --2- 172.21.15.67:0/2646079721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f358815b1e0 0x7f35880b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358d44b640 1 -- 172.21.15.67:0/2646079721 >> v1:172.21.15.97:6789/0 conn(0x7f35880723c0 legacy=0x7f358815ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358d44b640 1 -- 172.21.15.67:0/2646079721 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35880b3e20 con 0x7f35880b4900 2024-09-19T05:40:03.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358d44b640 1 --2- 172.21.15.67:0/2646079721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 0x7f3588071e80 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f35840098a0 tx=0x7f358401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6763ff5a0ecdbff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:03.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358cc4a640 1 -- 172.21.15.67:0/2646079721 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35840aa670 con 0x7f35880b4900 2024-09-19T05:40:03.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358cc4a640 1 -- 172.21.15.67:0/2646079721 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35840af070 con 0x7f35880b4900 2024-09-19T05:40:03.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.407+0000 7f358cc4a640 1 -- 172.21.15.67:0/2646079721 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35840aaa30 con 0x7f35880b4900 2024-09-19T05:40:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- 172.21.15.67:0/2646079721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 msgr2=0x7f3588071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 --2- 172.21.15.67:0/2646079721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 0x7f3588071e80 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f35840098a0 tx=0x7f358401c510 comp rx=0 tx=0).stop 2024-09-19T05:40:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- 172.21.15.67:0/2646079721 shutdown_connections 2024-09-19T05:40:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 --2- 172.21.15.67:0/2646079721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 0x7f3588071e80 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 --2- 172.21.15.67:0/2646079721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f358815b1e0 0x7f35880b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- 172.21.15.67:0/2646079721 >> 172.21.15.67:0/2646079721 conn(0x7f35880d0080 msgr2=0x7f35880d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- 172.21.15.67:0/2646079721 shutdown_connections 2024-09-19T05:40:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- 172.21.15.67:0/2646079721 wait complete. 2024-09-19T05:40:03.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 Processor -- start 2024-09-19T05:40:03.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- start start 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35880723c0 0x7f35881545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 0x7f358815c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f358815b1e0 0x7f358814bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3588166050 con 0x7f35880b4900 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f35880b3510 con 0x7f358815b1e0 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f35881661d0 con 0x7f35880723c0 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358d44b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 0x7f358815c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358d44b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 0x7f358815c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57354/0 (socket says 172.21.15.67:57354) 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358d44b640 1 -- 172.21.15.67:0/429846420 learned_addr learned my addr 172.21.15.67:0/429846420 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358e44d640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f358815b1e0 0x7f358814bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358dc4c640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35880723c0 0x7f35881545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358d44b640 1 -- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35880723c0 msgr2=0x7f35881545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358d44b640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35880723c0 0x7f35881545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358d44b640 1 -- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f358815b1e0 msgr2=0x7f358814bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358d44b640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f358815b1e0 0x7f358814bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358d44b640 1 -- 172.21.15.67:0/429846420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3588153520 con 0x7f35880b4900 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358e44d640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f358815b1e0 0x7f358814bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358d44b640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 0x7f358815c940 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f35840ac040 tx=0x7f358401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f357e7fc640 1 -- 172.21.15.67:0/429846420 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35840bd5f0 con 0x7f35880b4900 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f357e7fc640 1 -- 172.21.15.67:0/429846420 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35840bd7b0 con 0x7f35880b4900 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f357e7fc640 1 -- 172.21.15.67:0/429846420 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35840bdba0 con 0x7f35880b4900 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- 172.21.15.67:0/429846420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3588153800 con 0x7f35880b4900 2024-09-19T05:40:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.411+0000 7f358feb0640 1 -- 172.21.15.67:0/429846420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3588153dc0 con 0x7f35880b4900 2024-09-19T05:40:03.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.415+0000 7f358feb0640 1 -- 172.21.15.67:0/429846420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3588071e80 con 0x7f35880b4900 2024-09-19T05:40:03.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.415+0000 7f357e7fc640 1 -- 172.21.15.67:0/429846420 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35840b33f0 con 0x7f35880b4900 2024-09-19T05:40:03.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.415+0000 7f357e7fc640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 0x7f356c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.415+0000 7f357e7fc640 1 -- 172.21.15.67:0/429846420 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f3584120e70 con 0x7f35880b4900 2024-09-19T05:40:03.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.415+0000 7f358dc4c640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 0x7f356c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.415+0000 7f358dc4c640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 0x7f356c069d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3588152eb0 tx=0x7f3578008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:03.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.419+0000 7f357e7fc640 1 -- 172.21.15.67:0/429846420 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f35840c3060 con 0x7f35880b4900 2024-09-19T05:40:03.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.579+0000 7f358feb0640 1 -- 172.21.15.67:0/429846420 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35880b4e30 con 0x7f356c0678c0 2024-09-19T05:40:03.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.595+0000 7f357e7fc640 1 -- 172.21.15.67:0/429846420 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7f35880b4e30 con 0x7f356c0678c0 2024-09-19T05:40:03.599 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:40:03.600 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:40:03.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 -- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 msgr2=0x7f356c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 0x7f356c069d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3588152eb0 tx=0x7f3578008040 comp rx=0 tx=0).stop 2024-09-19T05:40:03.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 -- 172.21.15.67:0/429846420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 msgr2=0x7f358815c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 0x7f358815c940 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f35840ac040 tx=0x7f358401ad50 comp rx=0 tx=0).stop 2024-09-19T05:40:03.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 -- 172.21.15.67:0/429846420 shutdown_connections 2024-09-19T05:40:03.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f358815b1e0 0x7f358814bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35880b4900 0x7f358815c940 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f356c0678c0 0x7f356c069d80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 --2- 172.21.15.67:0/429846420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35880723c0 0x7f35881545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 -- 172.21.15.67:0/429846420 >> 172.21.15.67:0/429846420 conn(0x7f35880d0080 msgr2=0x7f35880af380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:03.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 -- 172.21.15.67:0/429846420 shutdown_connections 2024-09-19T05:40:03.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.599+0000 7f358feb0640 1 -- 172.21.15.67:0/429846420 wait complete. 2024-09-19T05:40:03.618 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-19T05:40:03.247080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346612,"kb_used_data":12424,"kb_used_omap":12,"kb_used_meta":334003,"kb_avail":754628108,"statfs":{"total":773094113280,"available":772739182592,"internally_reserved":0,"allocated":12722176,"data_stored":6581116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":342019633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001685"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393394+0000","last_change":"2024-09-19T05:39:58.796586+0000","last_active":"2024-09-19T05:40:00.393394+0000","last_peered":"2024-09-19T05:40:00.393394+0000","last_clean":"2024-09-19T05:40:00.393394+0000","last_became_active":"2024-09-19T05:39:58.791956+0000","last_became_peered":"2024-09-19T05:39:58.791956+0000","last_unstale":"2024-09-19T05:40:00.393394+0000","last_undegraded":"2024-09-19T05:40:00.393394+0000","last_fullsized":"2024-09-19T05:40:00.393394+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:48.398460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393140+0000","last_change":"2024-09-19T05:39:58.775052+0000","last_active":"2024-09-19T05:40:00.393140+0000","last_peered":"2024-09-19T05:40:00.393140+0000","last_clean":"2024-09-19T05:40:00.393140+0000","last_became_active":"2024-09-19T05:39:58.774780+0000","last_became_peered":"2024-09-19T05:39:58.774780+0000","last_unstale":"2024-09-19T05:40:00.393140+0000","last_undegraded":"2024-09-19T05:40:00.393140+0000","last_fullsized":"2024-09-19T05:40:00.393140+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:40.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391877+0000","last_change":"2024-09-19T05:39:58.779092+0000","last_active":"2024-09-19T05:40:00.391877+0000","last_peered":"2024-09-19T05:40:00.391877+0000","last_clean":"2024-09-19T05:40:00.391877+0000","last_became_active":"2024-09-19T05:39:58.778659+0000","last_became_peered":"2024-09-19T05:39:58.778659+0000","last_unstale":"2024-09-19T05:40:00.391877+0000","last_undegraded":"2024-09-19T05:40:00.391877+0000","last_fullsized":"2024-09-19T05:40:00.391877+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:58.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173081+0000","last_change":"2024-09-19T05:39:58.790340+0000","last_active":"2024-09-19T05:40:00.173081+0000","last_peered":"2024-09-19T05:40:00.173081+0000","last_clean":"2024-09-19T05:40:00.173081+0000","last_became_active":"2024-09-19T05:39:58.789762+0000","last_became_peered":"2024-09-19T05:39:58.789762+0000","last_unstale":"2024-09-19T05:40:00.173081+0000","last_undegraded":"2024-09-19T05:40:00.173081+0000","last_fullsized":"2024-09-19T05:40:00.173081+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:14.979906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392286+0000","last_change":"2024-09-19T05:39:58.804771+0000","last_active":"2024-09-19T05:40:00.392286+0000","last_peered":"2024-09-19T05:40:00.392286+0000","last_clean":"2024-09-19T05:40:00.392286+0000","last_became_active":"2024-09-19T05:39:58.799469+0000","last_became_peered":"2024-09-19T05:39:58.799469+0000","last_unstale":"2024-09-19T05:40:00.392286+0000","last_undegraded":"2024-09-19T05:40:00.392286+0000","last_fullsized":"2024-09-19T05:40:00.392286+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:03.459739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390069+0000","last_change":"2024-09-19T05:39:58.814170+0000","last_active":"2024-09-19T05:40:00.390069+0000","last_peered":"2024-09-19T05:40:00.390069+0000","last_clean":"2024-09-19T05:40:00.390069+0000","last_became_active":"2024-09-19T05:39:58.813903+0000","last_became_peered":"2024-09-19T05:39:58.813903+0000","last_unstale":"2024-09-19T05:40:00.390069+0000","last_undegraded":"2024-09-19T05:40:00.390069+0000","last_fullsized":"2024-09-19T05:40:00.390069+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:31.278078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.389572+0000","last_change":"2024-09-19T05:39:58.810365+0000","last_active":"2024-09-19T05:40:00.389572+0000","last_peered":"2024-09-19T05:40:00.389572+0000","last_clean":"2024-09-19T05:40:00.389572+0000","last_became_active":"2024-09-19T05:39:58.810073+0000","last_became_peered":"2024-09-19T05:39:58.810073+0000","last_unstale":"2024-09-19T05:40:00.389572+0000","last_undegraded":"2024-09-19T05:40:00.389572+0000","last_fullsized":"2024-09-19T05:40:00.389572+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:41.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756831+0000","last_change":"2024-09-19T05:39:58.785203+0000","last_active":"2024-09-19T05:39:59.756831+0000","last_peered":"2024-09-19T05:39:59.756831+0000","last_clean":"2024-09-19T05:39:59.756831+0000","last_became_active":"2024-09-19T05:39:58.784760+0000","last_became_peered":"2024-09-19T05:39:58.784760+0000","last_unstale":"2024-09-19T05:39:59.756831+0000","last_undegraded":"2024-09-19T05:39:59.756831+0000","last_fullsized":"2024-09-19T05:39:59.756831+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:31.076251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393358+0000","last_change":"2024-09-19T05:39:58.781763+0000","last_active":"2024-09-19T05:40:00.393358+0000","last_peered":"2024-09-19T05:40:00.393358+0000","last_clean":"2024-09-19T05:40:00.393358+0000","last_became_active":"2024-09-19T05:39:58.781465+0000","last_became_peered":"2024-09-19T05:39:58.781465+0000","last_unstale":"2024-09-19T05:40:00.393358+0000","last_undegraded":"2024-09-19T05:40:00.393358+0000","last_fullsized":"2024-09-19T05:40:00.393358+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:00.318329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393684+0000","last_change":"2024-09-19T05:39:58.811015+0000","last_active":"2024-09-19T05:40:00.393684+0000","last_peered":"2024-09-19T05:40:00.393684+0000","last_clean":"2024-09-19T05:40:00.393684+0000","last_became_active":"2024-09-19T05:39:58.809748+0000","last_became_peered":"2024-09-19T05:39:58.809748+0000","last_unstale":"2024-09-19T05:40:00.393684+0000","last_undegraded":"2024-09-19T05:40:00.393684+0000","last_fullsized":"2024-09-19T05:40:00.393684+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:20.019143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392792+0000","last_change":"2024-09-19T05:39:58.772242+0000","last_active":"2024-09-19T05:40:00.392792+0000","last_peered":"2024-09-19T05:40:00.392792+0000","last_clean":"2024-09-19T05:40:00.392792+0000","last_became_active":"2024-09-19T05:39:58.771930+0000","last_became_peered":"2024-09-19T05:39:58.771930+0000","last_unstale":"2024-09-19T05:40:00.392792+0000","last_undegraded":"2024-09-19T05:40:00.392792+0000","last_fullsized":"2024-09-19T05:40:00.392792+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:59.269174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761546+0000","last_change":"2024-09-19T05:39:58.786966+0000","last_active":"2024-09-19T05:39:59.761546+0000","last_peered":"2024-09-19T05:39:59.761546+0000","last_clean":"2024-09-19T05:39:59.761546+0000","last_became_active":"2024-09-19T05:39:58.786557+0000","last_became_peered":"2024-09-19T05:39:58.786557+0000","last_unstale":"2024-09-19T05:39:59.761546+0000","last_undegraded":"2024-09-19T05:39:59.761546+0000","last_fullsized":"2024-09-19T05:39:59.761546+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:14.569880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172768+0000","last_change":"2024-09-19T05:39:58.784695+0000","last_active":"2024-09-19T05:40:00.172768+0000","last_peered":"2024-09-19T05:40:00.172768+0000","last_clean":"2024-09-19T05:40:00.172768+0000","last_became_active":"2024-09-19T05:39:58.784280+0000","last_became_peered":"2024-09-19T05:39:58.784280+0000","last_unstale":"2024-09-19T05:40:00.172768+0000","last_undegraded":"2024-09-19T05:40:00.172768+0000","last_fullsized":"2024-09-19T05:40:00.172768+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:30.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390315+0000","last_change":"2024-09-19T05:39:58.785768+0000","last_active":"2024-09-19T05:40:00.390315+0000","last_peered":"2024-09-19T05:40:00.390315+0000","last_clean":"2024-09-19T05:40:00.390315+0000","last_became_active":"2024-09-19T05:39:58.785462+0000","last_became_peered":"2024-09-19T05:39:58.785462+0000","last_unstale":"2024-09-19T05:40:00.390315+0000","last_undegraded":"2024-09-19T05:40:00.390315+0000","last_fullsized":"2024-09-19T05:40:00.390315+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:52.994940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390966+0000","last_change":"2024-09-19T05:39:58.774634+0000","last_active":"2024-09-19T05:40:00.390966+0000","last_peered":"2024-09-19T05:40:00.390966+0000","last_clean":"2024-09-19T05:40:00.390966+0000","last_became_active":"2024-09-19T05:39:58.774325+0000","last_became_peered":"2024-09-19T05:39:58.774325+0000","last_unstale":"2024-09-19T05:40:00.390966+0000","last_undegraded":"2024-09-19T05:40:00.390966+0000","last_fullsized":"2024-09-19T05:40:00.390966+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:56.769969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390500+0000","last_change":"2024-09-19T05:39:58.773974+0000","last_active":"2024-09-19T05:40:00.390500+0000","last_peered":"2024-09-19T05:40:00.390500+0000","last_clean":"2024-09-19T05:40:00.390500+0000","last_became_active":"2024-09-19T05:39:58.771917+0000","last_became_peered":"2024-09-19T05:39:58.771917+0000","last_unstale":"2024-09-19T05:40:00.390500+0000","last_undegraded":"2024-09-19T05:40:00.390500+0000","last_fullsized":"2024-09-19T05:40:00.390500+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:30.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393082+0000","last_change":"2024-09-19T05:39:58.779348+0000","last_active":"2024-09-19T05:40:00.393082+0000","last_peered":"2024-09-19T05:40:00.393082+0000","last_clean":"2024-09-19T05:40:00.393082+0000","last_became_active":"2024-09-19T05:39:58.774126+0000","last_became_peered":"2024-09-19T05:39:58.774126+0000","last_unstale":"2024-09-19T05:40:00.393082+0000","last_undegraded":"2024-09-19T05:40:00.393082+0000","last_fullsized":"2024-09-19T05:40:00.393082+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:07.882835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393238+0000","last_change":"2024-09-19T05:39:58.804577+0000","last_active":"2024-09-19T05:40:00.393238+0000","last_peered":"2024-09-19T05:40:00.393238+0000","last_clean":"2024-09-19T05:40:00.393238+0000","last_became_active":"2024-09-19T05:39:58.804293+0000","last_became_peered":"2024-09-19T05:39:58.804293+0000","last_unstale":"2024-09-19T05:40:00.393238+0000","last_undegraded":"2024-09-19T05:40:00.393238+0000","last_fullsized":"2024-09-19T05:40:00.393238+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:03.459739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392164+0000","last_change":"2024-09-19T05:39:58.797053+0000","last_active":"2024-09-19T05:40:00.392164+0000","last_peered":"2024-09-19T05:40:00.392164+0000","last_clean":"2024-09-19T05:40:00.392164+0000","last_became_active":"2024-09-19T05:39:58.791887+0000","last_became_peered":"2024-09-19T05:39:58.791887+0000","last_unstale":"2024-09-19T05:40:00.392164+0000","last_undegraded":"2024-09-19T05:40:00.392164+0000","last_fullsized":"2024-09-19T05:40:00.392164+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:32.704910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.762051+0000","last_change":"2024-09-19T05:39:58.786636+0000","last_active":"2024-09-19T05:39:59.762051+0000","last_peered":"2024-09-19T05:39:59.762051+0000","last_clean":"2024-09-19T05:39:59.762051+0000","last_became_active":"2024-09-19T05:39:58.784899+0000","last_became_peered":"2024-09-19T05:39:58.784899+0000","last_unstale":"2024-09-19T05:39:59.762051+0000","last_undegraded":"2024-09-19T05:39:59.762051+0000","last_fullsized":"2024-09-19T05:39:59.762051+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:56.540706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756910+0000","last_change":"2024-09-19T05:39:58.768928+0000","last_active":"2024-09-19T05:39:59.756910+0000","last_peered":"2024-09-19T05:39:59.756910+0000","last_clean":"2024-09-19T05:39:59.756910+0000","last_became_active":"2024-09-19T05:39:58.768491+0000","last_became_peered":"2024-09-19T05:39:58.768491+0000","last_unstale":"2024-09-19T05:39:59.756910+0000","last_undegraded":"2024-09-19T05:39:59.756910+0000","last_fullsized":"2024-09-19T05:39:59.756910+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:09.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393395+0000","last_change":"2024-09-19T05:39:58.809896+0000","last_active":"2024-09-19T05:40:00.393395+0000","last_peered":"2024-09-19T05:40:00.393395+0000","last_clean":"2024-09-19T05:40:00.393395+0000","last_became_active":"2024-09-19T05:39:58.805345+0000","last_became_peered":"2024-09-19T05:39:58.805345+0000","last_unstale":"2024-09-19T05:40:00.393395+0000","last_undegraded":"2024-09-19T05:40:00.393395+0000","last_fullsized":"2024-09-19T05:40:00.393395+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:48.640047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391726+0000","last_change":"2024-09-19T05:39:58.777779+0000","last_active":"2024-09-19T05:40:00.391726+0000","last_peered":"2024-09-19T05:40:00.391726+0000","last_clean":"2024-09-19T05:40:00.391726+0000","last_became_active":"2024-09-19T05:39:58.773521+0000","last_became_peered":"2024-09-19T05:39:58.773521+0000","last_unstale":"2024-09-19T05:40:00.391726+0000","last_undegraded":"2024-09-19T05:40:00.391726+0000","last_fullsized":"2024-09-19T05:40:00.391726+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:53.395037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391235+0000","last_change":"2024-09-19T05:39:58.810690+0000","last_active":"2024-09-19T05:40:00.391235+0000","last_peered":"2024-09-19T05:40:00.391235+0000","last_clean":"2024-09-19T05:40:00.391235+0000","last_became_active":"2024-09-19T05:39:58.810100+0000","last_became_peered":"2024-09-19T05:39:58.810100+0000","last_unstale":"2024-09-19T05:40:00.391235+0000","last_undegraded":"2024-09-19T05:40:00.391235+0000","last_fullsized":"2024-09-19T05:40:00.391235+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:40.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.762115+0000","last_change":"2024-09-19T05:39:58.780852+0000","last_active":"2024-09-19T05:39:59.762115+0000","last_peered":"2024-09-19T05:39:59.762115+0000","last_clean":"2024-09-19T05:39:59.762115+0000","last_became_active":"2024-09-19T05:39:58.780547+0000","last_became_peered":"2024-09-19T05:39:58.780547+0000","last_unstale":"2024-09-19T05:39:59.762115+0000","last_undegraded":"2024-09-19T05:39:59.762115+0000","last_fullsized":"2024-09-19T05:39:59.762115+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:40.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.762112+0000","last_change":"2024-09-19T05:39:58.784030+0000","last_active":"2024-09-19T05:39:59.762112+0000","last_peered":"2024-09-19T05:39:59.762112+0000","last_clean":"2024-09-19T05:39:59.762112+0000","last_became_active":"2024-09-19T05:39:58.780838+0000","last_became_peered":"2024-09-19T05:39:58.780838+0000","last_unstale":"2024-09-19T05:39:59.762112+0000","last_undegraded":"2024-09-19T05:39:59.762112+0000","last_fullsized":"2024-09-19T05:39:59.762112+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:24.825465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392888+0000","last_change":"2024-09-19T05:39:58.776172+0000","last_active":"2024-09-19T05:40:00.392888+0000","last_peered":"2024-09-19T05:40:00.392888+0000","last_clean":"2024-09-19T05:40:00.392888+0000","last_became_active":"2024-09-19T05:39:58.775856+0000","last_became_peered":"2024-09-19T05:39:58.775856+0000","last_unstale":"2024-09-19T05:40:00.392888+0000","last_undegraded":"2024-09-19T05:40:00.392888+0000","last_fullsized":"2024-09-19T05:40:00.392888+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:37.353760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390072+0000","last_change":"2024-09-19T05:39:58.771174+0000","last_active":"2024-09-19T05:40:00.390072+0000","last_peered":"2024-09-19T05:40:00.390072+0000","last_clean":"2024-09-19T05:40:00.390072+0000","last_became_active":"2024-09-19T05:39:58.770897+0000","last_became_peered":"2024-09-19T05:39:58.770897+0000","last_unstale":"2024-09-19T05:40:00.390072+0000","last_undegraded":"2024-09-19T05:40:00.390072+0000","last_fullsized":"2024-09-19T05:40:00.390072+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:14.569880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757072+0000","last_change":"2024-09-19T05:39:58.777318+0000","last_active":"2024-09-19T05:39:59.757072+0000","last_peered":"2024-09-19T05:39:59.757072+0000","last_clean":"2024-09-19T05:39:59.757072+0000","last_became_active":"2024-09-19T05:39:58.776867+0000","last_became_peered":"2024-09-19T05:39:58.776867+0000","last_unstale":"2024-09-19T05:39:59.757072+0000","last_undegraded":"2024-09-19T05:39:59.757072+0000","last_fullsized":"2024-09-19T05:39:59.757072+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:05.234638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761375+0000","last_change":"2024-09-19T05:39:58.780376+0000","last_active":"2024-09-19T05:39:59.761375+0000","last_peered":"2024-09-19T05:39:59.761375+0000","last_clean":"2024-09-19T05:39:59.761375+0000","last_became_active":"2024-09-19T05:39:58.780007+0000","last_became_peered":"2024-09-19T05:39:58.780007+0000","last_unstale":"2024-09-19T05:39:59.761375+0000","last_undegraded":"2024-09-19T05:39:59.761375+0000","last_fullsized":"2024-09-19T05:39:59.761375+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:57.326361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.389996+0000","last_change":"2024-09-19T05:39:58.791308+0000","last_active":"2024-09-19T05:40:00.389996+0000","last_peered":"2024-09-19T05:40:00.389996+0000","last_clean":"2024-09-19T05:40:00.389996+0000","last_became_active":"2024-09-19T05:39:58.791011+0000","last_became_peered":"2024-09-19T05:39:58.791011+0000","last_unstale":"2024-09-19T05:40:00.389996+0000","last_undegraded":"2024-09-19T05:40:00.389996+0000","last_fullsized":"2024-09-19T05:40:00.389996+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:57.326361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756984+0000","last_change":"2024-09-19T05:39:58.793981+0000","last_active":"2024-09-19T05:39:59.756984+0000","last_peered":"2024-09-19T05:39:59.756984+0000","last_clean":"2024-09-19T05:39:59.756984+0000","last_became_active":"2024-09-19T05:39:58.786019+0000","last_became_peered":"2024-09-19T05:39:58.786019+0000","last_unstale":"2024-09-19T05:39:59.756984+0000","last_undegraded":"2024-09-19T05:39:59.756984+0000","last_fullsized":"2024-09-19T05:39:59.756984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:11.742568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392508+0000","last_change":"2024-09-19T05:39:58.791060+0000","last_active":"2024-09-19T05:40:00.392508+0000","last_peered":"2024-09-19T05:40:00.392508+0000","last_clean":"2024-09-19T05:40:00.392508+0000","last_became_active":"2024-09-19T05:39:58.790362+0000","last_became_peered":"2024-09-19T05:39:58.790362+0000","last_unstale":"2024-09-19T05:40:00.392508+0000","last_undegraded":"2024-09-19T05:40:00.392508+0000","last_fullsized":"2024-09-19T05:40:00.392508+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:49.366416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"115'4","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173347+0000","last_change":"2024-09-19T05:39:57.781598+0000","last_active":"2024-09-19T05:40:00.173347+0000","last_peered":"2024-09-19T05:40:00.173347+0000","last_clean":"2024-09-19T05:40:00.173347+0000","last_became_active":"2024-09-19T05:39:57.781120+0000","last_became_peered":"2024-09-19T05:39:57.781120+0000","last_unstale":"2024-09-19T05:40:00.173347+0000","last_undegraded":"2024-09-19T05:40:00.173347+0000","last_fullsized":"2024-09-19T05:40:00.173347+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:19.014788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757042+0000","last_change":"2024-09-19T05:39:58.785424+0000","last_active":"2024-09-19T05:39:59.757042+0000","last_peered":"2024-09-19T05:39:59.757042+0000","last_clean":"2024-09-19T05:39:59.757042+0000","last_became_active":"2024-09-19T05:39:58.785009+0000","last_became_peered":"2024-09-19T05:39:58.785009+0000","last_unstale":"2024-09-19T05:39:59.757042+0000","last_undegraded":"2024-09-19T05:39:59.757042+0000","last_fullsized":"2024-09-19T05:39:59.757042+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:14.824320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.758178+0000","last_change":"2024-09-19T05:39:57.770887+0000","last_active":"2024-09-19T05:39:59.758178+0000","last_peered":"2024-09-19T05:39:59.758178+0000","last_clean":"2024-09-19T05:39:59.758178+0000","last_became_active":"2024-09-19T05:39:57.769563+0000","last_became_peered":"2024-09-19T05:39:57.769563+0000","last_unstale":"2024-09-19T05:39:59.758178+0000","last_undegraded":"2024-09-19T05:39:59.758178+0000","last_fullsized":"2024-09-19T05:39:59.758178+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:46.442085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761741+0000","last_change":"2024-09-19T05:39:58.784923+0000","last_active":"2024-09-19T05:39:59.761741+0000","last_peered":"2024-09-19T05:39:59.761741+0000","last_clean":"2024-09-19T05:39:59.761741+0000","last_became_active":"2024-09-19T05:39:58.784607+0000","last_became_peered":"2024-09-19T05:39:58.784607+0000","last_unstale":"2024-09-19T05:39:59.761741+0000","last_undegraded":"2024-09-19T05:39:59.761741+0000","last_fullsized":"2024-09-19T05:39:59.761741+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:31.278078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761152+0000","last_change":"2024-09-19T05:39:57.784292+0000","last_active":"2024-09-19T05:39:59.761152+0000","last_peered":"2024-09-19T05:39:59.761152+0000","last_clean":"2024-09-19T05:39:59.761152+0000","last_became_active":"2024-09-19T05:39:57.783570+0000","last_became_peered":"2024-09-19T05:39:57.783570+0000","last_unstale":"2024-09-19T05:39:59.761152+0000","last_undegraded":"2024-09-19T05:39:59.761152+0000","last_fullsized":"2024-09-19T05:39:59.761152+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:18.718516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391862+0000","last_change":"2024-09-19T05:39:58.782226+0000","last_active":"2024-09-19T05:40:00.391862+0000","last_peered":"2024-09-19T05:40:00.391862+0000","last_clean":"2024-09-19T05:40:00.391862+0000","last_became_active":"2024-09-19T05:39:58.781964+0000","last_became_peered":"2024-09-19T05:39:58.781964+0000","last_unstale":"2024-09-19T05:40:00.391862+0000","last_undegraded":"2024-09-19T05:40:00.391862+0000","last_fullsized":"2024-09-19T05:40:00.391862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393325+0000","last_change":"2024-09-19T05:39:57.774005+0000","last_active":"2024-09-19T05:40:00.393325+0000","last_peered":"2024-09-19T05:40:00.393325+0000","last_clean":"2024-09-19T05:40:00.393325+0000","last_became_active":"2024-09-19T05:39:57.773649+0000","last_became_peered":"2024-09-19T05:39:57.773649+0000","last_unstale":"2024-09-19T05:40:00.393325+0000","last_undegraded":"2024-09-19T05:40:00.393325+0000","last_fullsized":"2024-09-19T05:40:00.393325+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:42.781599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173298+0000","last_change":"2024-09-19T05:39:58.789096+0000","last_active":"2024-09-19T05:40:00.173298+0000","last_peered":"2024-09-19T05:40:00.173298+0000","last_clean":"2024-09-19T05:40:00.173298+0000","last_became_active":"2024-09-19T05:39:58.788556+0000","last_became_peered":"2024-09-19T05:39:58.788556+0000","last_unstale":"2024-09-19T05:40:00.173298+0000","last_undegraded":"2024-09-19T05:40:00.173298+0000","last_fullsized":"2024-09-19T05:40:00.173298+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:31.788519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391589+0000","last_change":"2024-09-19T05:39:57.788827+0000","last_active":"2024-09-19T05:40:00.391589+0000","last_peered":"2024-09-19T05:40:00.391589+0000","last_clean":"2024-09-19T05:40:00.391589+0000","last_became_active":"2024-09-19T05:39:57.788203+0000","last_became_peered":"2024-09-19T05:39:57.788203+0000","last_unstale":"2024-09-19T05:40:00.391589+0000","last_undegraded":"2024-09-19T05:40:00.391589+0000","last_fullsized":"2024-09-19T05:40:00.391589+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.042348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392916+0000","last_change":"2024-09-19T05:39:58.797503+0000","last_active":"2024-09-19T05:40:00.392916+0000","last_peered":"2024-09-19T05:40:00.392916+0000","last_clean":"2024-09-19T05:40:00.392916+0000","last_became_active":"2024-09-19T05:39:58.792554+0000","last_became_peered":"2024-09-19T05:39:58.792554+0000","last_unstale":"2024-09-19T05:40:00.392916+0000","last_undegraded":"2024-09-19T05:40:00.392916+0000","last_fullsized":"2024-09-19T05:40:00.392916+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:27.961945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390969+0000","last_change":"2024-09-19T05:39:57.781182+0000","last_active":"2024-09-19T05:40:00.390969+0000","last_peered":"2024-09-19T05:40:00.390969+0000","last_clean":"2024-09-19T05:40:00.390969+0000","last_became_active":"2024-09-19T05:39:57.780473+0000","last_became_peered":"2024-09-19T05:39:57.780473+0000","last_unstale":"2024-09-19T05:40:00.390969+0000","last_undegraded":"2024-09-19T05:40:00.390969+0000","last_fullsized":"2024-09-19T05:40:00.390969+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:24.189507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393566+0000","last_change":"2024-09-19T05:39:58.770354+0000","last_active":"2024-09-19T05:40:00.393566+0000","last_peered":"2024-09-19T05:40:00.393566+0000","last_clean":"2024-09-19T05:40:00.393566+0000","last_became_active":"2024-09-19T05:39:58.769994+0000","last_became_peered":"2024-09-19T05:39:58.769994+0000","last_unstale":"2024-09-19T05:40:00.393566+0000","last_undegraded":"2024-09-19T05:40:00.393566+0000","last_fullsized":"2024-09-19T05:40:00.393566+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:47.082669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.760721+0000","last_change":"2024-09-19T05:39:57.794715+0000","last_active":"2024-09-19T05:39:59.760721+0000","last_peered":"2024-09-19T05:39:59.760721+0000","last_clean":"2024-09-19T05:39:59.760721+0000","last_became_active":"2024-09-19T05:39:57.793933+0000","last_became_peered":"2024-09-19T05:39:57.793933+0000","last_unstale":"2024-09-19T05:39:59.760721+0000","last_undegraded":"2024-09-19T05:39:59.760721+0000","last_fullsized":"2024-09-19T05:39:59.760721+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:54.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173430+0000","last_change":"2024-09-19T05:39:58.794916+0000","last_active":"2024-09-19T05:40:00.173430+0000","last_peered":"2024-09-19T05:40:00.173430+0000","last_clean":"2024-09-19T05:40:00.173430+0000","last_became_active":"2024-09-19T05:39:58.791104+0000","last_became_peered":"2024-09-19T05:39:58.791104+0000","last_unstale":"2024-09-19T05:40:00.173430+0000","last_undegraded":"2024-09-19T05:40:00.173430+0000","last_fullsized":"2024-09-19T05:40:00.173430+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:37.439578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172301+0000","last_change":"2024-09-19T05:39:57.765227+0000","last_active":"2024-09-19T05:40:00.172301+0000","last_peered":"2024-09-19T05:40:00.172301+0000","last_clean":"2024-09-19T05:40:00.172301+0000","last_became_active":"2024-09-19T05:39:57.764688+0000","last_became_peered":"2024-09-19T05:39:57.764688+0000","last_unstale":"2024-09-19T05:40:00.172301+0000","last_undegraded":"2024-09-19T05:40:00.172301+0000","last_fullsized":"2024-09-19T05:40:00.172301+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:46.078315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392065+0000","last_change":"2024-09-19T05:39:58.802896+0000","last_active":"2024-09-19T05:40:00.392065+0000","last_peered":"2024-09-19T05:40:00.392065+0000","last_clean":"2024-09-19T05:40:00.392065+0000","last_became_active":"2024-09-19T05:39:58.792481+0000","last_became_peered":"2024-09-19T05:39:58.792481+0000","last_unstale":"2024-09-19T05:40:00.392065+0000","last_undegraded":"2024-09-19T05:40:00.392065+0000","last_fullsized":"2024-09-19T05:40:00.392065+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:48.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761861+0000","last_change":"2024-09-19T05:39:57.784748+0000","last_active":"2024-09-19T05:39:59.761861+0000","last_peered":"2024-09-19T05:39:59.761861+0000","last_clean":"2024-09-19T05:39:59.761861+0000","last_became_active":"2024-09-19T05:39:57.783243+0000","last_became_peered":"2024-09-19T05:39:57.783243+0000","last_unstale":"2024-09-19T05:39:59.761861+0000","last_undegraded":"2024-09-19T05:39:59.761861+0000","last_fullsized":"2024-09-19T05:39:59.761861+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:18.059390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392829+0000","last_change":"2024-09-19T05:39:58.782763+0000","last_active":"2024-09-19T05:40:00.392829+0000","last_peered":"2024-09-19T05:40:00.392829+0000","last_clean":"2024-09-19T05:40:00.392829+0000","last_became_active":"2024-09-19T05:39:58.782316+0000","last_became_peered":"2024-09-19T05:39:58.782316+0000","last_unstale":"2024-09-19T05:40:00.392829+0000","last_undegraded":"2024-09-19T05:40:00.392829+0000","last_fullsized":"2024-09-19T05:40:00.392829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:21.923650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392163+0000","last_change":"2024-09-19T05:39:57.785900+0000","last_active":"2024-09-19T05:40:00.392163+0000","last_peered":"2024-09-19T05:40:00.392163+0000","last_clean":"2024-09-19T05:40:00.392163+0000","last_became_active":"2024-09-19T05:39:57.785546+0000","last_became_peered":"2024-09-19T05:39:57.785546+0000","last_unstale":"2024-09-19T05:40:00.392163+0000","last_undegraded":"2024-09-19T05:40:00.392163+0000","last_fullsized":"2024-09-19T05:40:00.392163+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:25.148091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756813+0000","last_change":"2024-09-19T05:39:58.811363+0000","last_active":"2024-09-19T05:39:59.756813+0000","last_peered":"2024-09-19T05:39:59.756813+0000","last_clean":"2024-09-19T05:39:59.756813+0000","last_became_active":"2024-09-19T05:39:58.810294+0000","last_became_peered":"2024-09-19T05:39:58.810294+0000","last_unstale":"2024-09-19T05:39:59.756813+0000","last_undegraded":"2024-09-19T05:39:59.756813+0000","last_fullsized":"2024-09-19T05:39:59.756813+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:10.448889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"115'3","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390943+0000","last_change":"2024-09-19T05:39:57.776395+0000","last_active":"2024-09-19T05:40:00.390943+0000","last_peered":"2024-09-19T05:40:00.390943+0000","last_clean":"2024-09-19T05:40:00.390943+0000","last_became_active":"2024-09-19T05:39:57.775694+0000","last_became_peered":"2024-09-19T05:39:57.775694+0000","last_unstale":"2024-09-19T05:40:00.390943+0000","last_undegraded":"2024-09-19T05:40:00.390943+0000","last_fullsized":"2024-09-19T05:40:00.390943+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:19.014788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392733+0000","last_change":"2024-09-19T05:39:58.800510+0000","last_active":"2024-09-19T05:40:00.392733+0000","last_peered":"2024-09-19T05:40:00.392733+0000","last_clean":"2024-09-19T05:40:00.392733+0000","last_became_active":"2024-09-19T05:39:58.783972+0000","last_became_peered":"2024-09-19T05:39:58.783972+0000","last_unstale":"2024-09-19T05:40:00.392733+0000","last_undegraded":"2024-09-19T05:40:00.392733+0000","last_fullsized":"2024-09-19T05:40:00.392733+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:47.082669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"115'6","reported_seq":20,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392117+0000","last_change":"2024-09-19T05:39:57.781959+0000","last_active":"2024-09-19T05:40:00.392117+0000","last_peered":"2024-09-19T05:40:00.392117+0000","last_clean":"2024-09-19T05:40:00.392117+0000","last_became_active":"2024-09-19T05:39:57.781166+0000","last_became_peered":"2024-09-19T05:39:57.781166+0000","last_unstale":"2024-09-19T05:40:00.392117+0000","last_undegraded":"2024-09-19T05:40:00.392117+0000","last_fullsized":"2024-09-19T05:40:00.392117+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:52.355948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391628+0000","last_change":"2024-09-19T05:39:58.790541+0000","last_active":"2024-09-19T05:40:00.391628+0000","last_peered":"2024-09-19T05:40:00.391628+0000","last_clean":"2024-09-19T05:40:00.391628+0000","last_became_active":"2024-09-19T05:39:58.790331+0000","last_became_peered":"2024-09-19T05:39:58.790331+0000","last_unstale":"2024-09-19T05:40:00.391628+0000","last_undegraded":"2024-09-19T05:40:00.391628+0000","last_fullsized":"2024-09-19T05:40:00.391628+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:42.796958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392515+0000","last_change":"2024-09-19T05:39:57.767610+0000","last_active":"2024-09-19T05:40:00.392515+0000","last_peered":"2024-09-19T05:40:00.392515+0000","last_clean":"2024-09-19T05:40:00.392515+0000","last_became_active":"2024-09-19T05:39:57.767330+0000","last_became_peered":"2024-09-19T05:39:57.767330+0000","last_unstale":"2024-09-19T05:40:00.392515+0000","last_undegraded":"2024-09-19T05:40:00.392515+0000","last_fullsized":"2024-09-19T05:40:00.392515+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:26.264660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393099+0000","last_change":"2024-09-19T05:39:58.781712+0000","last_active":"2024-09-19T05:40:00.393099+0000","last_peered":"2024-09-19T05:40:00.393099+0000","last_clean":"2024-09-19T05:40:00.393099+0000","last_became_active":"2024-09-19T05:39:58.781395+0000","last_became_peered":"2024-09-19T05:39:58.781395+0000","last_unstale":"2024-09-19T05:40:00.393099+0000","last_undegraded":"2024-09-19T05:40:00.393099+0000","last_fullsized":"2024-09-19T05:40:00.393099+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:24.825465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172794+0000","last_change":"2024-09-19T05:39:57.774297+0000","last_active":"2024-09-19T05:40:00.172794+0000","last_peered":"2024-09-19T05:40:00.172794+0000","last_clean":"2024-09-19T05:40:00.172794+0000","last_became_active":"2024-09-19T05:39:57.773905+0000","last_became_peered":"2024-09-19T05:39:57.773905+0000","last_unstale":"2024-09-19T05:40:00.172794+0000","last_undegraded":"2024-09-19T05:40:00.172794+0000","last_fullsized":"2024-09-19T05:40:00.172794+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:20.919296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.758047+0000","last_change":"2024-09-19T05:39:58.771968+0000","last_active":"2024-09-19T05:39:59.758047+0000","last_peered":"2024-09-19T05:39:59.758047+0000","last_clean":"2024-09-19T05:39:59.758047+0000","last_became_active":"2024-09-19T05:39:58.771416+0000","last_became_peered":"2024-09-19T05:39:58.771416+0000","last_unstale":"2024-09-19T05:39:59.758047+0000","last_undegraded":"2024-09-19T05:39:59.758047+0000","last_fullsized":"2024-09-19T05:39:59.758047+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:45.305142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757181+0000","last_change":"2024-09-19T05:39:57.762647+0000","last_active":"2024-09-19T05:39:59.757181+0000","last_peered":"2024-09-19T05:39:59.757181+0000","last_clean":"2024-09-19T05:39:59.757181+0000","last_became_active":"2024-09-19T05:39:57.762197+0000","last_became_peered":"2024-09-19T05:39:57.762197+0000","last_unstale":"2024-09-19T05:39:59.757181+0000","last_undegraded":"2024-09-19T05:39:59.757181+0000","last_fullsized":"2024-09-19T05:39:59.757181+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:37.135662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393495+0000","last_change":"2024-09-19T05:39:58.774450+0000","last_active":"2024-09-19T05:40:00.393495+0000","last_peered":"2024-09-19T05:40:00.393495+0000","last_clean":"2024-09-19T05:40:00.393495+0000","last_became_active":"2024-09-19T05:39:58.773993+0000","last_became_peered":"2024-09-19T05:39:58.773993+0000","last_unstale":"2024-09-19T05:40:00.393495+0000","last_undegraded":"2024-09-19T05:40:00.393495+0000","last_fullsized":"2024-09-19T05:40:00.393495+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:45.203947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"115'8","reported_seq":22,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.760672+0000","last_change":"2024-09-19T05:39:57.793974+0000","last_active":"2024-09-19T05:39:59.760672+0000","last_peered":"2024-09-19T05:39:59.760672+0000","last_clean":"2024-09-19T05:39:59.760672+0000","last_became_active":"2024-09-19T05:39:57.784027+0000","last_became_peered":"2024-09-19T05:39:57.784027+0000","last_unstale":"2024-09-19T05:39:59.760672+0000","last_undegraded":"2024-09-19T05:39:59.760672+0000","last_fullsized":"2024-09-19T05:39:59.760672+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.438301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757274+0000","last_change":"2024-09-19T05:39:58.793654+0000","last_active":"2024-09-19T05:39:59.757274+0000","last_peered":"2024-09-19T05:39:59.757274+0000","last_clean":"2024-09-19T05:39:59.757274+0000","last_became_active":"2024-09-19T05:39:58.793203+0000","last_became_peered":"2024-09-19T05:39:58.793203+0000","last_unstale":"2024-09-19T05:39:59.757274+0000","last_undegraded":"2024-09-19T05:39:59.757274+0000","last_fullsized":"2024-09-19T05:39:59.757274+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:20.773571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393447+0000","last_change":"2024-09-19T05:39:57.801655+0000","last_active":"2024-09-19T05:40:00.393447+0000","last_peered":"2024-09-19T05:40:00.393447+0000","last_clean":"2024-09-19T05:40:00.393447+0000","last_became_active":"2024-09-19T05:39:57.800788+0000","last_became_peered":"2024-09-19T05:39:57.800788+0000","last_unstale":"2024-09-19T05:40:00.393447+0000","last_undegraded":"2024-09-19T05:40:00.393447+0000","last_fullsized":"2024-09-19T05:40:00.393447+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:18.059390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391845+0000","last_change":"2024-09-19T05:39:58.791293+0000","last_active":"2024-09-19T05:40:00.391845+0000","last_peered":"2024-09-19T05:40:00.391845+0000","last_clean":"2024-09-19T05:40:00.391845+0000","last_became_active":"2024-09-19T05:39:58.790974+0000","last_became_peered":"2024-09-19T05:39:58.790974+0000","last_unstale":"2024-09-19T05:40:00.391845+0000","last_undegraded":"2024-09-19T05:40:00.391845+0000","last_fullsized":"2024-09-19T05:40:00.391845+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:56.540706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391182+0000","last_change":"2024-09-19T05:39:57.796495+0000","last_active":"2024-09-19T05:40:00.391182+0000","last_peered":"2024-09-19T05:40:00.391182+0000","last_clean":"2024-09-19T05:40:00.391182+0000","last_became_active":"2024-09-19T05:39:57.795756+0000","last_became_peered":"2024-09-19T05:39:57.795756+0000","last_unstale":"2024-09-19T05:40:00.391182+0000","last_undegraded":"2024-09-19T05:40:00.391182+0000","last_fullsized":"2024-09-19T05:40:00.391182+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:55.677304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392352+0000","last_change":"2024-09-19T05:39:58.805143+0000","last_active":"2024-09-19T05:40:00.392352+0000","last_peered":"2024-09-19T05:40:00.392352+0000","last_clean":"2024-09-19T05:40:00.392352+0000","last_became_active":"2024-09-19T05:39:58.799609+0000","last_became_peered":"2024-09-19T05:39:58.799609+0000","last_unstale":"2024-09-19T05:40:00.392352+0000","last_undegraded":"2024-09-19T05:40:00.392352+0000","last_fullsized":"2024-09-19T05:40:00.392352+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:00.318329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391087+0000","last_change":"2024-09-19T05:39:57.786985+0000","last_active":"2024-09-19T05:40:00.391087+0000","last_peered":"2024-09-19T05:40:00.391087+0000","last_clean":"2024-09-19T05:40:00.391087+0000","last_became_active":"2024-09-19T05:39:57.786287+0000","last_became_peered":"2024-09-19T05:39:57.786287+0000","last_unstale":"2024-09-19T05:40:00.391087+0000","last_undegraded":"2024-09-19T05:40:00.391087+0000","last_fullsized":"2024-09-19T05:40:00.391087+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:58.394463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391990+0000","last_change":"2024-09-19T05:39:58.791721+0000","last_active":"2024-09-19T05:40:00.391990+0000","last_peered":"2024-09-19T05:40:00.391990+0000","last_clean":"2024-09-19T05:40:00.391990+0000","last_became_active":"2024-09-19T05:39:58.791302+0000","last_became_peered":"2024-09-19T05:39:58.791302+0000","last_unstale":"2024-09-19T05:40:00.391990+0000","last_undegraded":"2024-09-19T05:40:00.391990+0000","last_fullsized":"2024-09-19T05:40:00.391990+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:13.879938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757203+0000","last_change":"2024-09-19T05:39:57.768804+0000","last_active":"2024-09-19T05:39:59.757203+0000","last_peered":"2024-09-19T05:39:59.757203+0000","last_clean":"2024-09-19T05:39:59.757203+0000","last_became_active":"2024-09-19T05:39:57.766204+0000","last_became_peered":"2024-09-19T05:39:57.766204+0000","last_unstale":"2024-09-19T05:39:59.757203+0000","last_undegraded":"2024-09-19T05:39:59.757203+0000","last_fullsized":"2024-09-19T05:39:59.757203+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:21.950392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392286+0000","last_change":"2024-09-19T05:39:58.812215+0000","last_active":"2024-09-19T05:40:00.392286+0000","last_peered":"2024-09-19T05:40:00.392286+0000","last_clean":"2024-09-19T05:40:00.392286+0000","last_became_active":"2024-09-19T05:39:58.811797+0000","last_became_peered":"2024-09-19T05:39:58.811797+0000","last_unstale":"2024-09-19T05:40:00.392286+0000","last_undegraded":"2024-09-19T05:40:00.392286+0000","last_fullsized":"2024-09-19T05:40:00.392286+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:35.612170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756577+0000","last_change":"2024-09-19T05:39:57.768643+0000","last_active":"2024-09-19T05:39:59.756577+0000","last_peered":"2024-09-19T05:39:59.756577+0000","last_clean":"2024-09-19T05:39:59.756577+0000","last_became_active":"2024-09-19T05:39:57.768283+0000","last_became_peered":"2024-09-19T05:39:57.768283+0000","last_unstale":"2024-09-19T05:39:59.756577+0000","last_undegraded":"2024-09-19T05:39:59.756577+0000","last_fullsized":"2024-09-19T05:39:59.756577+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:53.640752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172932+0000","last_change":"2024-09-19T05:39:58.782116+0000","last_active":"2024-09-19T05:40:00.172932+0000","last_peered":"2024-09-19T05:40:00.172932+0000","last_clean":"2024-09-19T05:40:00.172932+0000","last_became_active":"2024-09-19T05:39:58.781446+0000","last_became_peered":"2024-09-19T05:39:58.781446+0000","last_unstale":"2024-09-19T05:40:00.172932+0000","last_undegraded":"2024-09-19T05:40:00.172932+0000","last_fullsized":"2024-09-19T05:40:00.172932+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:56.769969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390126+0000","last_change":"2024-09-19T05:39:57.784426+0000","last_active":"2024-09-19T05:40:00.390126+0000","last_peered":"2024-09-19T05:40:00.390126+0000","last_clean":"2024-09-19T05:40:00.390126+0000","last_became_active":"2024-09-19T05:39:57.778640+0000","last_became_peered":"2024-09-19T05:39:57.778640+0000","last_unstale":"2024-09-19T05:40:00.390126+0000","last_undegraded":"2024-09-19T05:40:00.390126+0000","last_fullsized":"2024-09-19T05:40:00.390126+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:36.343568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757927+0000","last_change":"2024-09-19T05:39:58.785360+0000","last_active":"2024-09-19T05:39:59.757927+0000","last_peered":"2024-09-19T05:39:59.757927+0000","last_clean":"2024-09-19T05:39:59.757927+0000","last_became_active":"2024-09-19T05:39:58.784635+0000","last_became_peered":"2024-09-19T05:39:58.784635+0000","last_unstale":"2024-09-19T05:39:59.757927+0000","last_undegraded":"2024-09-19T05:39:59.757927+0000","last_fullsized":"2024-09-19T05:39:59.757927+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:51.255162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757128+0000","last_change":"2024-09-19T05:39:57.772384+0000","last_active":"2024-09-19T05:39:59.757128+0000","last_peered":"2024-09-19T05:39:59.757128+0000","last_clean":"2024-09-19T05:39:59.757128+0000","last_became_active":"2024-09-19T05:39:57.771015+0000","last_became_peered":"2024-09-19T05:39:57.771015+0000","last_unstale":"2024-09-19T05:39:59.757128+0000","last_undegraded":"2024-09-19T05:39:59.757128+0000","last_fullsized":"2024-09-19T05:39:59.757128+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:00.454032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391642+0000","last_change":"2024-09-19T05:39:58.796706+0000","last_active":"2024-09-19T05:40:00.391642+0000","last_peered":"2024-09-19T05:40:00.391642+0000","last_clean":"2024-09-19T05:40:00.391642+0000","last_became_active":"2024-09-19T05:39:58.791959+0000","last_became_peered":"2024-09-19T05:39:58.791959+0000","last_unstale":"2024-09-19T05:40:00.391642+0000","last_undegraded":"2024-09-19T05:40:00.391642+0000","last_fullsized":"2024-09-19T05:40:00.391642+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:31.757723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392180+0000","last_change":"2024-09-19T05:39:57.772162+0000","last_active":"2024-09-19T05:40:00.392180+0000","last_peered":"2024-09-19T05:40:00.392180+0000","last_clean":"2024-09-19T05:40:00.392180+0000","last_became_active":"2024-09-19T05:39:57.771861+0000","last_became_peered":"2024-09-19T05:39:57.771861+0000","last_unstale":"2024-09-19T05:40:00.392180+0000","last_undegraded":"2024-09-19T05:40:00.392180+0000","last_fullsized":"2024-09-19T05:40:00.392180+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:38.476733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.760915+0000","last_change":"2024-09-19T05:39:58.787151+0000","last_active":"2024-09-19T05:39:59.760915+0000","last_peered":"2024-09-19T05:39:59.760915+0000","last_clean":"2024-09-19T05:39:59.760915+0000","last_became_active":"2024-09-19T05:39:58.786837+0000","last_became_peered":"2024-09-19T05:39:58.786837+0000","last_unstale":"2024-09-19T05:39:59.760915+0000","last_undegraded":"2024-09-19T05:39:59.760915+0000","last_fullsized":"2024-09-19T05:39:59.760915+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:41.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"116'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392602+0000","last_change":"2024-09-19T05:39:57.783978+0000","last_active":"2024-09-19T05:40:00.392602+0000","last_peered":"2024-09-19T05:40:00.392602+0000","last_clean":"2024-09-19T05:40:00.392602+0000","last_became_active":"2024-09-19T05:39:57.783626+0000","last_became_peered":"2024-09-19T05:39:57.783626+0000","last_unstale":"2024-09-19T05:40:00.392602+0000","last_undegraded":"2024-09-19T05:40:00.392602+0000","last_fullsized":"2024-09-19T05:40:00.392602+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:42.058437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172691+0000","last_change":"2024-09-19T05:39:58.781283+0000","last_active":"2024-09-19T05:40:00.172691+0000","last_peered":"2024-09-19T05:40:00.172691+0000","last_clean":"2024-09-19T05:40:00.172691+0000","last_became_active":"2024-09-19T05:39:58.780771+0000","last_became_peered":"2024-09-19T05:39:58.780771+0000","last_unstale":"2024-09-19T05:40:00.172691+0000","last_undegraded":"2024-09-19T05:40:00.172691+0000","last_fullsized":"2024-09-19T05:40:00.172691+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:52.994940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392553+0000","last_change":"2024-09-19T05:39:57.781803+0000","last_active":"2024-09-19T05:40:00.392553+0000","last_peered":"2024-09-19T05:40:00.392553+0000","last_clean":"2024-09-19T05:40:00.392553+0000","last_became_active":"2024-09-19T05:39:57.780574+0000","last_became_peered":"2024-09-19T05:39:57.780574+0000","last_unstale":"2024-09-19T05:40:00.392553+0000","last_undegraded":"2024-09-19T05:40:00.392553+0000","last_fullsized":"2024-09-19T05:40:00.392553+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:52.923110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391439+0000","last_change":"2024-09-19T05:39:58.816078+0000","last_active":"2024-09-19T05:40:00.391439+0000","last_peered":"2024-09-19T05:40:00.391439+0000","last_clean":"2024-09-19T05:40:00.391439+0000","last_became_active":"2024-09-19T05:39:58.815844+0000","last_became_peered":"2024-09-19T05:39:58.815844+0000","last_unstale":"2024-09-19T05:40:00.391439+0000","last_undegraded":"2024-09-19T05:40:00.391439+0000","last_fullsized":"2024-09-19T05:40:00.391439+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:36.521051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393555+0000","last_change":"2024-09-19T05:39:57.778815+0000","last_active":"2024-09-19T05:40:00.393555+0000","last_peered":"2024-09-19T05:40:00.393555+0000","last_clean":"2024-09-19T05:40:00.393555+0000","last_became_active":"2024-09-19T05:39:57.778442+0000","last_became_peered":"2024-09-19T05:39:57.778442+0000","last_unstale":"2024-09-19T05:40:00.393555+0000","last_undegraded":"2024-09-19T05:40:00.393555+0000","last_fullsized":"2024-09-19T05:40:00.393555+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:39.719140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757765+0000","last_change":"2024-09-19T05:39:58.784849+0000","last_active":"2024-09-19T05:39:59.757765+0000","last_peered":"2024-09-19T05:39:59.757765+0000","last_clean":"2024-09-19T05:39:59.757765+0000","last_became_active":"2024-09-19T05:39:58.784403+0000","last_became_peered":"2024-09-19T05:39:58.784403+0000","last_unstale":"2024-09-19T05:39:59.757765+0000","last_undegraded":"2024-09-19T05:39:59.757765+0000","last_fullsized":"2024-09-19T05:39:59.757765+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:03.327092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761415+0000","last_change":"2024-09-19T05:39:57.795587+0000","last_active":"2024-09-19T05:39:59.761415+0000","last_peered":"2024-09-19T05:39:59.761415+0000","last_clean":"2024-09-19T05:39:59.761415+0000","last_became_active":"2024-09-19T05:39:57.794286+0000","last_became_peered":"2024-09-19T05:39:57.794286+0000","last_unstale":"2024-09-19T05:39:59.761415+0000","last_undegraded":"2024-09-19T05:39:59.761415+0000","last_fullsized":"2024-09-19T05:39:59.761415+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:07.271962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757624+0000","last_change":"2024-09-19T05:39:58.784607+0000","last_active":"2024-09-19T05:39:59.757624+0000","last_peered":"2024-09-19T05:39:59.757624+0000","last_clean":"2024-09-19T05:39:59.757624+0000","last_became_active":"2024-09-19T05:39:58.784101+0000","last_became_peered":"2024-09-19T05:39:58.784101+0000","last_unstale":"2024-09-19T05:39:59.757624+0000","last_undegraded":"2024-09-19T05:39:59.757624+0000","last_fullsized":"2024-09-19T05:39:59.757624+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:17.234984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756867+0000","last_change":"2024-09-19T05:39:57.777352+0000","last_active":"2024-09-19T05:39:59.756867+0000","last_peered":"2024-09-19T05:39:59.756867+0000","last_clean":"2024-09-19T05:39:59.756867+0000","last_became_active":"2024-09-19T05:39:57.776875+0000","last_became_peered":"2024-09-19T05:39:57.776875+0000","last_unstale":"2024-09-19T05:39:59.756867+0000","last_undegraded":"2024-09-19T05:39:59.756867+0000","last_fullsized":"2024-09-19T05:39:59.756867+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:44.433004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391439+0000","last_change":"2024-09-19T05:39:58.775300+0000","last_active":"2024-09-19T05:40:00.391439+0000","last_peered":"2024-09-19T05:40:00.391439+0000","last_clean":"2024-09-19T05:40:00.391439+0000","last_became_active":"2024-09-19T05:39:58.774430+0000","last_became_peered":"2024-09-19T05:39:58.774430+0000","last_unstale":"2024-09-19T05:40:00.391439+0000","last_undegraded":"2024-09-19T05:40:00.391439+0000","last_fullsized":"2024-09-19T05:40:00.391439+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:14.979906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390369+0000","last_change":"2024-09-19T05:39:57.783783+0000","last_active":"2024-09-19T05:40:00.390369+0000","last_peered":"2024-09-19T05:40:00.390369+0000","last_clean":"2024-09-19T05:40:00.390369+0000","last_became_active":"2024-09-19T05:39:57.782574+0000","last_became_peered":"2024-09-19T05:39:57.782574+0000","last_unstale":"2024-09-19T05:40:00.390369+0000","last_undegraded":"2024-09-19T05:40:00.390369+0000","last_fullsized":"2024-09-19T05:40:00.390369+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.438301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393903+0000","last_change":"2024-09-19T05:39:58.774808+0000","last_active":"2024-09-19T05:40:00.393903+0000","last_peered":"2024-09-19T05:40:00.393903+0000","last_clean":"2024-09-19T05:40:00.393903+0000","last_became_active":"2024-09-19T05:39:58.774517+0000","last_became_peered":"2024-09-19T05:39:58.774517+0000","last_unstale":"2024-09-19T05:40:00.393903+0000","last_undegraded":"2024-09-19T05:40:00.393903+0000","last_fullsized":"2024-09-19T05:40:00.393903+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:28.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757385+0000","last_change":"2024-09-19T05:39:57.777349+0000","last_active":"2024-09-19T05:39:59.757385+0000","last_peered":"2024-09-19T05:39:59.757385+0000","last_clean":"2024-09-19T05:39:59.757385+0000","last_became_active":"2024-09-19T05:39:57.776903+0000","last_became_peered":"2024-09-19T05:39:57.776903+0000","last_unstale":"2024-09-19T05:39:59.757385+0000","last_undegraded":"2024-09-19T05:39:59.757385+0000","last_fullsized":"2024-09-19T05:39:59.757385+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:12.523574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392258+0000","last_change":"2024-09-19T05:39:58.774834+0000","last_active":"2024-09-19T05:40:00.392258+0000","last_peered":"2024-09-19T05:40:00.392258+0000","last_clean":"2024-09-19T05:40:00.392258+0000","last_became_active":"2024-09-19T05:39:58.774465+0000","last_became_peered":"2024-09-19T05:39:58.774465+0000","last_unstale":"2024-09-19T05:40:00.392258+0000","last_undegraded":"2024-09-19T05:40:00.392258+0000","last_fullsized":"2024-09-19T05:40:00.392258+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:04.632793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.758443+0000","last_change":"2024-09-19T05:39:57.773272+0000","last_active":"2024-09-19T05:39:59.758443+0000","last_peered":"2024-09-19T05:39:59.758443+0000","last_clean":"2024-09-19T05:39:59.758443+0000","last_became_active":"2024-09-19T05:39:57.772523+0000","last_became_peered":"2024-09-19T05:39:57.772523+0000","last_unstale":"2024-09-19T05:39:59.758443+0000","last_undegraded":"2024-09-19T05:39:59.758443+0000","last_fullsized":"2024-09-19T05:39:59.758443+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:41.387913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":341,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390415+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:40:00.390415+0000","last_peered":"2024-09-19T05:40:00.390415+0000","last_clean":"2024-09-19T05:40:00.390415+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:40:00.390415+0000","last_undegraded":"2024-09-19T05:40:00.390415+0000","last_fullsized":"2024-09-19T05:40:00.390415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542230,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51228,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320612,"statfs":{"total":96636764160,"available":96584306688,"internally_reserved":0,"allocated":2035712,"data_stored":1264973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45092,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326748,"statfs":{"total":96636764160,"available":96590589952,"internally_reserved":0,"allocated":1454080,"data_stored":676661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542232,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1433600,"data_stored":674445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542230,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50644,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321196,"statfs":{"total":96636764160,"available":96584904704,"internally_reserved":0,"allocated":1441792,"data_stored":674537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542231,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46480,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325360,"statfs":{"total":96636764160,"available":96589168640,"internally_reserved":0,"allocated":1437696,"data_stored":675027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542231,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28432,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343408,"statfs":{"total":96636764160,"available":96607649792,"internally_reserved":0,"allocated":1437696,"data_stored":674479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40912,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330928,"statfs":{"total":96636764160,"available":96594870272,"internally_reserved":0,"allocated":1437696,"data_stored":674479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542230,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55396,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316444,"statfs":{"total":96636764160,"available":96580038656,"internally_reserved":0,"allocated":2043904,"data_stored":1266515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:40:03.622 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:40:03.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f027e245640 1 Processor -- start 2024-09-19T05:40:03.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f027e245640 1 -- start start 2024-09-19T05:40:03.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f027e245640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f027815c030 0x7f027806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f027e245640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f027806f460 0x7f027806f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f027e245640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027806e3c0 con 0x7f027815d1d0 2024-09-19T05:40:03.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f027e245640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f027806e6a0 con 0x7f027815c030 2024-09-19T05:40:03.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f027e245640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f027806e980 con 0x7f027806f460 2024-09-19T05:40:03.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f02777fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f027815c030 0x7f027806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f02777fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f027815c030 0x7f027806dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57364/0 (socket says 172.21.15.67:57364) 2024-09-19T05:40:03.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f02777fe640 1 -- 172.21.15.67:0/71553003 learned_addr learned my addr 172.21.15.67:0/71553003 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:03.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f0277fff640 1 --2- 172.21.15.67:0/71553003 >> v2:172.21.15.97:3300/0 conn(0x7f027806f460 0x7f027806f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f02777fe640 1 -- 172.21.15.67:0/71553003 >> v2:172.21.15.97:3300/0 conn(0x7f027806f460 msgr2=0x7f027806f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:03.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f02777fe640 1 --2- 172.21.15.67:0/71553003 >> v2:172.21.15.97:3300/0 conn(0x7f027806f460 0x7f027806f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f02777fe640 1 -- 172.21.15.67:0/71553003 >> v1:172.21.15.97:6789/0 conn(0x7f027815d1d0 legacy=0x7f02780b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:03.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.787+0000 7f02777fe640 1 -- 172.21.15.67:0/71553003 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027806ec60 con 0x7f027815c030 2024-09-19T05:40:03.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f02777fe640 1 --2- 172.21.15.67:0/71553003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815c030 0x7f027806dde0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f02780afbf0 tx=0x7f026001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2420a78d272e3e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:03.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f02767fc640 1 -- 172.21.15.67:0/71553003 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02600b0070 con 0x7f027815c030 2024-09-19T05:40:03.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f02767fc640 1 -- 172.21.15.67:0/71553003 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02600ab600 con 0x7f027815c030 2024-09-19T05:40:03.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f02767fc640 1 -- 172.21.15.67:0/71553003 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02600ab9d0 con 0x7f027815c030 2024-09-19T05:40:03.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f027e245640 1 -- 172.21.15.67:0/71553003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815c030 msgr2=0x7f027806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f027e245640 1 --2- 172.21.15.67:0/71553003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815c030 0x7f027806dde0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f02780afbf0 tx=0x7f026001c4e0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f027e245640 1 -- 172.21.15.67:0/71553003 shutdown_connections 2024-09-19T05:40:03.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f027e245640 1 --2- 172.21.15.67:0/71553003 >> v2:172.21.15.97:3300/0 conn(0x7f027806f460 0x7f027806f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f027e245640 1 --2- 172.21.15.67:0/71553003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815c030 0x7f027806dde0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f027e245640 1 -- 172.21.15.67:0/71553003 >> 172.21.15.67:0/71553003 conn(0x7f02780d0080 msgr2=0x7f02780d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f027e245640 1 -- 172.21.15.67:0/71553003 shutdown_connections 2024-09-19T05:40:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.791+0000 7f027e245640 1 -- 172.21.15.67:0/71553003 wait complete. 2024-09-19T05:40:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 Processor -- start 2024-09-19T05:40:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 -- start start 2024-09-19T05:40:03.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f027806f460 0x7f027809d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f027815c030 0x7f0278072ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815d1d0 0x7f0278073410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f027815c590 con 0x7f027815d1d0 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f027815c410 con 0x7f027815c030 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f02781690e0 con 0x7f027806f460 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f0277fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815d1d0 0x7f0278073410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f0277fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815d1d0 0x7f0278073410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57378/0 (socket says 172.21.15.67:57378) 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f0277fff640 1 -- 172.21.15.67:0/135222743 learned_addr learned my addr 172.21.15.67:0/135222743 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f0276ffd640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f027815c030 0x7f0278072ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f02777fe640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f027806f460 0x7f027809d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f0277fff640 1 -- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f027806f460 msgr2=0x7f027809d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f0277fff640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f027806f460 0x7f027809d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f0277fff640 1 -- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f027815c030 msgr2=0x7f0278072ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f0277fff640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f027815c030 0x7f0278072ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f0277fff640 1 -- 172.21.15.67:0/135222743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0278144040 con 0x7f027815d1d0 2024-09-19T05:40:03.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f0277fff640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815d1d0 0x7f0278073410 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f027000d800 tx=0x7f027000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:03.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f026ffff640 1 -- 172.21.15.67:0/135222743 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027000b6c0 con 0x7f027815d1d0 2024-09-19T05:40:03.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f026ffff640 1 -- 172.21.15.67:0/135222743 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0270019070 con 0x7f027815d1d0 2024-09-19T05:40:03.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 -- 172.21.15.67:0/135222743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0278158420 con 0x7f027815d1d0 2024-09-19T05:40:03.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f026ffff640 1 -- 172.21.15.67:0/135222743 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027000baa0 con 0x7f027815d1d0 2024-09-19T05:40:03.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 -- 172.21.15.67:0/135222743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02781445c0 con 0x7f027815d1d0 2024-09-19T05:40:03.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f027e245640 1 -- 172.21.15.67:0/135222743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f027806f870 con 0x7f027815d1d0 2024-09-19T05:40:03.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.795+0000 7f026ffff640 1 -- 172.21.15.67:0/135222743 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f027000bc40 con 0x7f027815d1d0 2024-09-19T05:40:03.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.799+0000 7f026ffff640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02580678c0 0x7f0258069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:03.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.799+0000 7f026ffff640 1 -- 172.21.15.67:0/135222743 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f0270086140 con 0x7f027815d1d0 2024-09-19T05:40:03.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.799+0000 7f02777fe640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02580678c0 0x7f0258069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:03.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.799+0000 7f02777fe640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02580678c0 0x7f0258069d80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f02600ad000 tx=0x7f0260008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:03.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:03.803+0000 7f026ffff640 1 -- 172.21.15.67:0/135222743 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0270056b80 con 0x7f027815d1d0 2024-09-19T05:40:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.031+0000 7f027e245640 1 -- 172.21.15.67:0/135222743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f02780d0f20 con 0x7f027815d1d0 2024-09-19T05:40:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.031+0000 7f026ffff640 1 -- 172.21.15.67:0/135222743 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1476 (secure 0 0 0) 0x7f0270056480 con 0x7f027815d1d0 2024-09-19T05:40:04.033 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:40:04.033 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":433,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":116,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":354930688,"bytes_avail":772739182592,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":83,"btime":"2024-09-19T05:40:01:798281+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":6556}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-19T05:39:31.236565+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 -- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02580678c0 msgr2=0x7f0258069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02580678c0 0x7f0258069d80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f02600ad000 tx=0x7f0260008040 comp rx=0 tx=0).stop 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 -- 172.21.15.67:0/135222743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815d1d0 msgr2=0x7f0278073410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815d1d0 0x7f0278073410 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f027000d800 tx=0x7f027000dcc0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 -- 172.21.15.67:0/135222743 shutdown_connections 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f027815d1d0 0x7f0278073410 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f027815c030 0x7f0278072ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02580678c0 0x7f0258069d80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 --2- 172.21.15.67:0/135222743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f027806f460 0x7f027809d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 -- 172.21.15.67:0/135222743 >> 172.21.15.67:0/135222743 conn(0x7f02780d0080 msgr2=0x7f0278153140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 -- 172.21.15.67:0/135222743 shutdown_connections 2024-09-19T05:40:04.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.035+0000 7f027e245640 1 -- 172.21.15.67:0/135222743 wait complete. 2024-09-19T05:40:04.053 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T05:40:04.053 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:40:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08bb80640 1 Processor -- start 2024-09-19T05:40:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08bb80640 1 -- start start 2024-09-19T05:40:04.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08bb80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08415b1e0 0x7fe0840b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:04.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08bb80640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe084072590 0x7fe0840ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:04.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08bb80640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0840b3860 con 0x7fe0840b4900 2024-09-19T05:40:04.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08bb80640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe08415b5c0 con 0x7fe084072590 2024-09-19T05:40:04.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08bb80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe0840b3b40 con 0x7fe08415b1e0 2024-09-19T05:40:04.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08a11d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe084072590 0x7fe0840ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:04.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08991c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08415b1e0 0x7fe0840b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:04.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08911b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe0840b4900 0x7fe084071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:46374/0 (socket says 172.21.15.67:46374) 2024-09-19T05:40:04.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08911b640 1 -- 172.21.15.67:0/951339172 learned_addr learned my addr 172.21.15.67:0/951339172 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:40:04.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08a11d640 1 -- 172.21.15.67:0/951339172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08415b1e0 msgr2=0x7fe0840b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:04.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08a11d640 1 --2- 172.21.15.67:0/951339172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08415b1e0 0x7fe0840b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08a11d640 1 -- 172.21.15.67:0/951339172 >> v1:172.21.15.97:6789/0 conn(0x7fe0840b4900 legacy=0x7fe084071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:04.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.179+0000 7fe08a11d640 1 -- 172.21.15.67:0/951339172 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0840b3e20 con 0x7fe084072590 2024-09-19T05:40:04.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08a11d640 1 --2- 172.21.15.67:0/951339172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe084072590 0x7fe0840ade10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe0800097f0 tx=0x7fe08001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d698ffb05337c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:04.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08891a640 1 -- 172.21.15.67:0/951339172 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0800aa5f0 con 0x7fe084072590 2024-09-19T05:40:04.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08891a640 1 -- 172.21.15.67:0/951339172 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0800af070 con 0x7fe084072590 2024-09-19T05:40:04.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08891a640 1 -- 172.21.15.67:0/951339172 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0800aa9b0 con 0x7fe084072590 2024-09-19T05:40:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08bb80640 1 -- 172.21.15.67:0/951339172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe084072590 msgr2=0x7fe0840ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08bb80640 1 --2- 172.21.15.67:0/951339172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe084072590 0x7fe0840ade10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe0800097f0 tx=0x7fe08001c470 comp rx=0 tx=0).stop 2024-09-19T05:40:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08bb80640 1 -- 172.21.15.67:0/951339172 shutdown_connections 2024-09-19T05:40:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08bb80640 1 --2- 172.21.15.67:0/951339172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe084072590 0x7fe0840ade10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08bb80640 1 --2- 172.21.15.67:0/951339172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08415b1e0 0x7fe0840b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08bb80640 1 -- 172.21.15.67:0/951339172 >> 172.21.15.67:0/951339172 conn(0x7fe0840d0080 msgr2=0x7fe0840d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08bb80640 1 -- 172.21.15.67:0/951339172 shutdown_connections 2024-09-19T05:40:04.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08bb80640 1 -- 172.21.15.67:0/951339172 wait complete. 2024-09-19T05:40:04.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08bb80640 1 Processor -- start 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.183+0000 7fe08bb80640 1 -- start start 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08bb80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe084072590 0x7fe08414c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08bb80640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0840b4900 0x7fe084099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08bb80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1e0 0x7fe084157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08bb80640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841681e0 con 0x7fe0840b4900 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08bb80640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe084168060 con 0x7fe08415b1e0 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08bb80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe084168360 con 0x7fe084072590 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08911b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0840b4900 0x7fe084099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08911b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0840b4900 0x7fe084099840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57386/0 (socket says 172.21.15.67:57386) 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08911b640 1 -- 172.21.15.67:0/2189924185 learned_addr learned my addr 172.21.15.67:0/2189924185 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08991c640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe084072590 0x7fe08414c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08a11d640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1e0 0x7fe084157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08911b640 1 -- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe084072590 msgr2=0x7fe08414c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08911b640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe084072590 0x7fe08414c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08911b640 1 -- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1e0 msgr2=0x7fe084157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08911b640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1e0 0x7fe084157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08911b640 1 -- 172.21.15.67:0/2189924185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0840ae120 con 0x7fe0840b4900 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08a11d640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1e0 0x7fe084157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08911b640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0840b4900 0x7fe084099840 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00cae0 tx=0x7fe07c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe07a7fc640 1 -- 172.21.15.67:0/2189924185 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c017070 con 0x7fe0840b4900 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe07a7fc640 1 -- 172.21.15.67:0/2189924185 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c00ac40 con 0x7fe0840b4900 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe07a7fc640 1 -- 172.21.15.67:0/2189924185 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c012620 con 0x7fe0840b4900 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08bb80640 1 -- 172.21.15.67:0/2189924185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08415c0d0 con 0x7fe0840b4900 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08bb80640 1 -- 172.21.15.67:0/2189924185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08415c370 con 0x7fe0840b4900 2024-09-19T05:40:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08bb80640 1 -- 172.21.15.67:0/2189924185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0840ade10 con 0x7fe0840b4900 2024-09-19T05:40:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe07a7fc640 1 -- 172.21.15.67:0/2189924185 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe07c01a070 con 0x7fe0840b4900 2024-09-19T05:40:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe07a7fc640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 0x7fe068069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe07a7fc640 1 -- 172.21.15.67:0/2189924185 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7fe07c085b90 con 0x7fe0840b4900 2024-09-19T05:40:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.187+0000 7fe08991c640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 0x7fe068069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.191+0000 7fe08991c640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 0x7fe068069d80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe0840b05b0 tx=0x7fe074008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:04.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.195+0000 7fe07a7fc640 1 -- 172.21.15.67:0/2189924185 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe07c056540 con 0x7fe0840b4900 2024-09-19T05:40:04.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.355+0000 7fe08bb80640 1 -- 172.21.15.67:0/2189924185 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0840b4e30 con 0x7fe0680678c0 2024-09-19T05:40:04.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.371+0000 7fe07a7fc640 1 -- 172.21.15.67:0/2189924185 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7fe0840b4e30 con 0x7fe0680678c0 2024-09-19T05:40:04.374 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:40:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:40:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 -- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 msgr2=0x7fe068069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 0x7fe068069d80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe0840b05b0 tx=0x7fe074008040 comp rx=0 tx=0).stop 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 -- 172.21.15.67:0/2189924185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0840b4900 msgr2=0x7fe084099840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0840b4900 0x7fe084099840 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00cae0 tx=0x7fe07c00a060 comp rx=0 tx=0).stop 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 -- 172.21.15.67:0/2189924185 shutdown_connections 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1e0 0x7fe084157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0840b4900 0x7fe084099840 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 0x7fe068069d80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 --2- 172.21.15.67:0/2189924185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe084072590 0x7fe08414c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 -- 172.21.15.67:0/2189924185 >> 172.21.15.67:0/2189924185 conn(0x7fe0840d0080 msgr2=0x7fe0841502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 -- 172.21.15.67:0/2189924185 shutdown_connections 2024-09-19T05:40:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:04.375+0000 7fe08bb80640 1 -- 172.21.15.67:0/2189924185 wait complete. 2024-09-19T05:40:04.383 INFO:tasks.ceph.mds.d.smithi097.stderr:2024-09-19T05:40:04.381+0000 7fce30e36640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:40:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-19T05:40:03.247080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346612,"kb_used_data":12424,"kb_used_omap":12,"kb_used_meta":334003,"kb_avail":754628108,"statfs":{"total":773094113280,"available":772739182592,"internally_reserved":0,"allocated":12722176,"data_stored":6581116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":342019633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001685"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393394+0000","last_change":"2024-09-19T05:39:58.796586+0000","last_active":"2024-09-19T05:40:00.393394+0000","last_peered":"2024-09-19T05:40:00.393394+0000","last_clean":"2024-09-19T05:40:00.393394+0000","last_became_active":"2024-09-19T05:39:58.791956+0000","last_became_peered":"2024-09-19T05:39:58.791956+0000","last_unstale":"2024-09-19T05:40:00.393394+0000","last_undegraded":"2024-09-19T05:40:00.393394+0000","last_fullsized":"2024-09-19T05:40:00.393394+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:48.398460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393140+0000","last_change":"2024-09-19T05:39:58.775052+0000","last_active":"2024-09-19T05:40:00.393140+0000","last_peered":"2024-09-19T05:40:00.393140+0000","last_clean":"2024-09-19T05:40:00.393140+0000","last_became_active":"2024-09-19T05:39:58.774780+0000","last_became_peered":"2024-09-19T05:39:58.774780+0000","last_unstale":"2024-09-19T05:40:00.393140+0000","last_undegraded":"2024-09-19T05:40:00.393140+0000","last_fullsized":"2024-09-19T05:40:00.393140+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:40.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391877+0000","last_change":"2024-09-19T05:39:58.779092+0000","last_active":"2024-09-19T05:40:00.391877+0000","last_peered":"2024-09-19T05:40:00.391877+0000","last_clean":"2024-09-19T05:40:00.391877+0000","last_became_active":"2024-09-19T05:39:58.778659+0000","last_became_peered":"2024-09-19T05:39:58.778659+0000","last_unstale":"2024-09-19T05:40:00.391877+0000","last_undegraded":"2024-09-19T05:40:00.391877+0000","last_fullsized":"2024-09-19T05:40:00.391877+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:58.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173081+0000","last_change":"2024-09-19T05:39:58.790340+0000","last_active":"2024-09-19T05:40:00.173081+0000","last_peered":"2024-09-19T05:40:00.173081+0000","last_clean":"2024-09-19T05:40:00.173081+0000","last_became_active":"2024-09-19T05:39:58.789762+0000","last_became_peered":"2024-09-19T05:39:58.789762+0000","last_unstale":"2024-09-19T05:40:00.173081+0000","last_undegraded":"2024-09-19T05:40:00.173081+0000","last_fullsized":"2024-09-19T05:40:00.173081+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:14.979906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392286+0000","last_change":"2024-09-19T05:39:58.804771+0000","last_active":"2024-09-19T05:40:00.392286+0000","last_peered":"2024-09-19T05:40:00.392286+0000","last_clean":"2024-09-19T05:40:00.392286+0000","last_became_active":"2024-09-19T05:39:58.799469+0000","last_became_peered":"2024-09-19T05:39:58.799469+0000","last_unstale":"2024-09-19T05:40:00.392286+0000","last_undegraded":"2024-09-19T05:40:00.392286+0000","last_fullsized":"2024-09-19T05:40:00.392286+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:03.459739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390069+0000","last_change":"2024-09-19T05:39:58.814170+0000","last_active":"2024-09-19T05:40:00.390069+0000","last_peered":"2024-09-19T05:40:00.390069+0000","last_clean":"2024-09-19T05:40:00.390069+0000","last_became_active":"2024-09-19T05:39:58.813903+0000","last_became_peered":"2024-09-19T05:39:58.813903+0000","last_unstale":"2024-09-19T05:40:00.390069+0000","last_undegraded":"2024-09-19T05:40:00.390069+0000","last_fullsized":"2024-09-19T05:40:00.390069+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:31.278078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.389572+0000","last_change":"2024-09-19T05:39:58.810365+0000","last_active":"2024-09-19T05:40:00.389572+0000","last_peered":"2024-09-19T05:40:00.389572+0000","last_clean":"2024-09-19T05:40:00.389572+0000","last_became_active":"2024-09-19T05:39:58.810073+0000","last_became_peered":"2024-09-19T05:39:58.810073+0000","last_unstale":"2024-09-19T05:40:00.389572+0000","last_undegraded":"2024-09-19T05:40:00.389572+0000","last_fullsized":"2024-09-19T05:40:00.389572+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:41.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756831+0000","last_change":"2024-09-19T05:39:58.785203+0000","last_active":"2024-09-19T05:39:59.756831+0000","last_peered":"2024-09-19T05:39:59.756831+0000","last_clean":"2024-09-19T05:39:59.756831+0000","last_became_active":"2024-09-19T05:39:58.784760+0000","last_became_peered":"2024-09-19T05:39:58.784760+0000","last_unstale":"2024-09-19T05:39:59.756831+0000","last_undegraded":"2024-09-19T05:39:59.756831+0000","last_fullsized":"2024-09-19T05:39:59.756831+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:31.076251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393358+0000","last_change":"2024-09-19T05:39:58.781763+0000","last_active":"2024-09-19T05:40:00.393358+0000","last_peered":"2024-09-19T05:40:00.393358+0000","last_clean":"2024-09-19T05:40:00.393358+0000","last_became_active":"2024-09-19T05:39:58.781465+0000","last_became_peered":"2024-09-19T05:39:58.781465+0000","last_unstale":"2024-09-19T05:40:00.393358+0000","last_undegraded":"2024-09-19T05:40:00.393358+0000","last_fullsized":"2024-09-19T05:40:00.393358+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:00.318329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393684+0000","last_change":"2024-09-19T05:39:58.811015+0000","last_active":"2024-09-19T05:40:00.393684+0000","last_peered":"2024-09-19T05:40:00.393684+0000","last_clean":"2024-09-19T05:40:00.393684+0000","last_became_active":"2024-09-19T05:39:58.809748+0000","last_became_peered":"2024-09-19T05:39:58.809748+0000","last_unstale":"2024-09-19T05:40:00.393684+0000","last_undegraded":"2024-09-19T05:40:00.393684+0000","last_fullsized":"2024-09-19T05:40:00.393684+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:20.019143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392792+0000","last_change":"2024-09-19T05:39:58.772242+0000","last_active":"2024-09-19T05:40:00.392792+0000","last_peered":"2024-09-19T05:40:00.392792+0000","last_clean":"2024-09-19T05:40:00.392792+0000","last_became_active":"2024-09-19T05:39:58.771930+0000","last_became_peered":"2024-09-19T05:39:58.771930+0000","last_unstale":"2024-09-19T05:40:00.392792+0000","last_undegraded":"2024-09-19T05:40:00.392792+0000","last_fullsized":"2024-09-19T05:40:00.392792+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:59.269174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761546+0000","last_change":"2024-09-19T05:39:58.786966+0000","last_active":"2024-09-19T05:39:59.761546+0000","last_peered":"2024-09-19T05:39:59.761546+0000","last_clean":"2024-09-19T05:39:59.761546+0000","last_became_active":"2024-09-19T05:39:58.786557+0000","last_became_peered":"2024-09-19T05:39:58.786557+0000","last_unstale":"2024-09-19T05:39:59.761546+0000","last_undegraded":"2024-09-19T05:39:59.761546+0000","last_fullsized":"2024-09-19T05:39:59.761546+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:14.569880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172768+0000","last_change":"2024-09-19T05:39:58.784695+0000","last_active":"2024-09-19T05:40:00.172768+0000","last_peered":"2024-09-19T05:40:00.172768+0000","last_clean":"2024-09-19T05:40:00.172768+0000","last_became_active":"2024-09-19T05:39:58.784280+0000","last_became_peered":"2024-09-19T05:39:58.784280+0000","last_unstale":"2024-09-19T05:40:00.172768+0000","last_undegraded":"2024-09-19T05:40:00.172768+0000","last_fullsized":"2024-09-19T05:40:00.172768+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:30.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390315+0000","last_change":"2024-09-19T05:39:58.785768+0000","last_active":"2024-09-19T05:40:00.390315+0000","last_peered":"2024-09-19T05:40:00.390315+0000","last_clean":"2024-09-19T05:40:00.390315+0000","last_became_active":"2024-09-19T05:39:58.785462+0000","last_became_peered":"2024-09-19T05:39:58.785462+0000","last_unstale":"2024-09-19T05:40:00.390315+0000","last_undegraded":"2024-09-19T05:40:00.390315+0000","last_fullsized":"2024-09-19T05:40:00.390315+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:52.994940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390966+0000","last_change":"2024-09-19T05:39:58.774634+0000","last_active":"2024-09-19T05:40:00.390966+0000","last_peered":"2024-09-19T05:40:00.390966+0000","last_clean":"2024-09-19T05:40:00.390966+0000","last_became_active":"2024-09-19T05:39:58.774325+0000","last_became_peered":"2024-09-19T05:39:58.774325+0000","last_unstale":"2024-09-19T05:40:00.390966+0000","last_undegraded":"2024-09-19T05:40:00.390966+0000","last_fullsized":"2024-09-19T05:40:00.390966+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:56.769969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390500+0000","last_change":"2024-09-19T05:39:58.773974+0000","last_active":"2024-09-19T05:40:00.390500+0000","last_peered":"2024-09-19T05:40:00.390500+0000","last_clean":"2024-09-19T05:40:00.390500+0000","last_became_active":"2024-09-19T05:39:58.771917+0000","last_became_peered":"2024-09-19T05:39:58.771917+0000","last_unstale":"2024-09-19T05:40:00.390500+0000","last_undegraded":"2024-09-19T05:40:00.390500+0000","last_fullsized":"2024-09-19T05:40:00.390500+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:30.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393082+0000","last_change":"2024-09-19T05:39:58.779348+0000","last_active":"2024-09-19T05:40:00.393082+0000","last_peered":"2024-09-19T05:40:00.393082+0000","last_clean":"2024-09-19T05:40:00.393082+0000","last_became_active":"2024-09-19T05:39:58.774126+0000","last_became_peered":"2024-09-19T05:39:58.774126+0000","last_unstale":"2024-09-19T05:40:00.393082+0000","last_undegraded":"2024-09-19T05:40:00.393082+0000","last_fullsized":"2024-09-19T05:40:00.393082+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:07.882835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393238+0000","last_change":"2024-09-19T05:39:58.804577+0000","last_active":"2024-09-19T05:40:00.393238+0000","last_peered":"2024-09-19T05:40:00.393238+0000","last_clean":"2024-09-19T05:40:00.393238+0000","last_became_active":"2024-09-19T05:39:58.804293+0000","last_became_peered":"2024-09-19T05:39:58.804293+0000","last_unstale":"2024-09-19T05:40:00.393238+0000","last_undegraded":"2024-09-19T05:40:00.393238+0000","last_fullsized":"2024-09-19T05:40:00.393238+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:03.459739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392164+0000","last_change":"2024-09-19T05:39:58.797053+0000","last_active":"2024-09-19T05:40:00.392164+0000","last_peered":"2024-09-19T05:40:00.392164+0000","last_clean":"2024-09-19T05:40:00.392164+0000","last_became_active":"2024-09-19T05:39:58.791887+0000","last_became_peered":"2024-09-19T05:39:58.791887+0000","last_unstale":"2024-09-19T05:40:00.392164+0000","last_undegraded":"2024-09-19T05:40:00.392164+0000","last_fullsized":"2024-09-19T05:40:00.392164+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:32.704910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.762051+0000","last_change":"2024-09-19T05:39:58.786636+0000","last_active":"2024-09-19T05:39:59.762051+0000","last_peered":"2024-09-19T05:39:59.762051+0000","last_clean":"2024-09-19T05:39:59.762051+0000","last_became_active":"2024-09-19T05:39:58.784899+0000","last_became_peered":"2024-09-19T05:39:58.784899+0000","last_unstale":"2024-09-19T05:39:59.762051+0000","last_undegraded":"2024-09-19T05:39:59.762051+0000","last_fullsized":"2024-09-19T05:39:59.762051+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:56.540706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756910+0000","last_change":"2024-09-19T05:39:58.768928+0000","last_active":"2024-09-19T05:39:59.756910+0000","last_peered":"2024-09-19T05:39:59.756910+0000","last_clean":"2024-09-19T05:39:59.756910+0000","last_became_active":"2024-09-19T05:39:58.768491+0000","last_became_peered":"2024-09-19T05:39:58.768491+0000","last_unstale":"2024-09-19T05:39:59.756910+0000","last_undegraded":"2024-09-19T05:39:59.756910+0000","last_fullsized":"2024-09-19T05:39:59.756910+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:09.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393395+0000","last_change":"2024-09-19T05:39:58.809896+0000","last_active":"2024-09-19T05:40:00.393395+0000","last_peered":"2024-09-19T05:40:00.393395+0000","last_clean":"2024-09-19T05:40:00.393395+0000","last_became_active":"2024-09-19T05:39:58.805345+0000","last_became_peered":"2024-09-19T05:39:58.805345+0000","last_unstale":"2024-09-19T05:40:00.393395+0000","last_undegraded":"2024-09-19T05:40:00.393395+0000","last_fullsized":"2024-09-19T05:40:00.393395+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:48.640047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391726+0000","last_change":"2024-09-19T05:39:58.777779+0000","last_active":"2024-09-19T05:40:00.391726+0000","last_peered":"2024-09-19T05:40:00.391726+0000","last_clean":"2024-09-19T05:40:00.391726+0000","last_became_active":"2024-09-19T05:39:58.773521+0000","last_became_peered":"2024-09-19T05:39:58.773521+0000","last_unstale":"2024-09-19T05:40:00.391726+0000","last_undegraded":"2024-09-19T05:40:00.391726+0000","last_fullsized":"2024-09-19T05:40:00.391726+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:53.395037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391235+0000","last_change":"2024-09-19T05:39:58.810690+0000","last_active":"2024-09-19T05:40:00.391235+0000","last_peered":"2024-09-19T05:40:00.391235+0000","last_clean":"2024-09-19T05:40:00.391235+0000","last_became_active":"2024-09-19T05:39:58.810100+0000","last_became_peered":"2024-09-19T05:39:58.810100+0000","last_unstale":"2024-09-19T05:40:00.391235+0000","last_undegraded":"2024-09-19T05:40:00.391235+0000","last_fullsized":"2024-09-19T05:40:00.391235+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:40.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.762115+0000","last_change":"2024-09-19T05:39:58.780852+0000","last_active":"2024-09-19T05:39:59.762115+0000","last_peered":"2024-09-19T05:39:59.762115+0000","last_clean":"2024-09-19T05:39:59.762115+0000","last_became_active":"2024-09-19T05:39:58.780547+0000","last_became_peered":"2024-09-19T05:39:58.780547+0000","last_unstale":"2024-09-19T05:39:59.762115+0000","last_undegraded":"2024-09-19T05:39:59.762115+0000","last_fullsized":"2024-09-19T05:39:59.762115+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:40.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.762112+0000","last_change":"2024-09-19T05:39:58.784030+0000","last_active":"2024-09-19T05:39:59.762112+0000","last_peered":"2024-09-19T05:39:59.762112+0000","last_clean":"2024-09-19T05:39:59.762112+0000","last_became_active":"2024-09-19T05:39:58.780838+0000","last_became_peered":"2024-09-19T05:39:58.780838+0000","last_unstale":"2024-09-19T05:39:59.762112+0000","last_undegraded":"2024-09-19T05:39:59.762112+0000","last_fullsized":"2024-09-19T05:39:59.762112+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:24.825465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392888+0000","last_change":"2024-09-19T05:39:58.776172+0000","last_active":"2024-09-19T05:40:00.392888+0000","last_peered":"2024-09-19T05:40:00.392888+0000","last_clean":"2024-09-19T05:40:00.392888+0000","last_became_active":"2024-09-19T05:39:58.775856+0000","last_became_peered":"2024-09-19T05:39:58.775856+0000","last_unstale":"2024-09-19T05:40:00.392888+0000","last_undegraded":"2024-09-19T05:40:00.392888+0000","last_fullsized":"2024-09-19T05:40:00.392888+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:37.353760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390072+0000","last_change":"2024-09-19T05:39:58.771174+0000","last_active":"2024-09-19T05:40:00.390072+0000","last_peered":"2024-09-19T05:40:00.390072+0000","last_clean":"2024-09-19T05:40:00.390072+0000","last_became_active":"2024-09-19T05:39:58.770897+0000","last_became_peered":"2024-09-19T05:39:58.770897+0000","last_unstale":"2024-09-19T05:40:00.390072+0000","last_undegraded":"2024-09-19T05:40:00.390072+0000","last_fullsized":"2024-09-19T05:40:00.390072+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:14.569880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757072+0000","last_change":"2024-09-19T05:39:58.777318+0000","last_active":"2024-09-19T05:39:59.757072+0000","last_peered":"2024-09-19T05:39:59.757072+0000","last_clean":"2024-09-19T05:39:59.757072+0000","last_became_active":"2024-09-19T05:39:58.776867+0000","last_became_peered":"2024-09-19T05:39:58.776867+0000","last_unstale":"2024-09-19T05:39:59.757072+0000","last_undegraded":"2024-09-19T05:39:59.757072+0000","last_fullsized":"2024-09-19T05:39:59.757072+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:05.234638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761375+0000","last_change":"2024-09-19T05:39:58.780376+0000","last_active":"2024-09-19T05:39:59.761375+0000","last_peered":"2024-09-19T05:39:59.761375+0000","last_clean":"2024-09-19T05:39:59.761375+0000","last_became_active":"2024-09-19T05:39:58.780007+0000","last_became_peered":"2024-09-19T05:39:58.780007+0000","last_unstale":"2024-09-19T05:39:59.761375+0000","last_undegraded":"2024-09-19T05:39:59.761375+0000","last_fullsized":"2024-09-19T05:39:59.761375+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:57.326361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.389996+0000","last_change":"2024-09-19T05:39:58.791308+0000","last_active":"2024-09-19T05:40:00.389996+0000","last_peered":"2024-09-19T05:40:00.389996+0000","last_clean":"2024-09-19T05:40:00.389996+0000","last_became_active":"2024-09-19T05:39:58.791011+0000","last_became_peered":"2024-09-19T05:39:58.791011+0000","last_unstale":"2024-09-19T05:40:00.389996+0000","last_undegraded":"2024-09-19T05:40:00.389996+0000","last_fullsized":"2024-09-19T05:40:00.389996+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:57.326361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756984+0000","last_change":"2024-09-19T05:39:58.793981+0000","last_active":"2024-09-19T05:39:59.756984+0000","last_peered":"2024-09-19T05:39:59.756984+0000","last_clean":"2024-09-19T05:39:59.756984+0000","last_became_active":"2024-09-19T05:39:58.786019+0000","last_became_peered":"2024-09-19T05:39:58.786019+0000","last_unstale":"2024-09-19T05:39:59.756984+0000","last_undegraded":"2024-09-19T05:39:59.756984+0000","last_fullsized":"2024-09-19T05:39:59.756984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:11.742568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392508+0000","last_change":"2024-09-19T05:39:58.791060+0000","last_active":"2024-09-19T05:40:00.392508+0000","last_peered":"2024-09-19T05:40:00.392508+0000","last_clean":"2024-09-19T05:40:00.392508+0000","last_became_active":"2024-09-19T05:39:58.790362+0000","last_became_peered":"2024-09-19T05:39:58.790362+0000","last_unstale":"2024-09-19T05:40:00.392508+0000","last_undegraded":"2024-09-19T05:40:00.392508+0000","last_fullsized":"2024-09-19T05:40:00.392508+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:49.366416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"115'4","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173347+0000","last_change":"2024-09-19T05:39:57.781598+0000","last_active":"2024-09-19T05:40:00.173347+0000","last_peered":"2024-09-19T05:40:00.173347+0000","last_clean":"2024-09-19T05:40:00.173347+0000","last_became_active":"2024-09-19T05:39:57.781120+0000","last_became_peered":"2024-09-19T05:39:57.781120+0000","last_unstale":"2024-09-19T05:40:00.173347+0000","last_undegraded":"2024-09-19T05:40:00.173347+0000","last_fullsized":"2024-09-19T05:40:00.173347+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:19.014788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757042+0000","last_change":"2024-09-19T05:39:58.785424+0000","last_active":"2024-09-19T05:39:59.757042+0000","last_peered":"2024-09-19T05:39:59.757042+0000","last_clean":"2024-09-19T05:39:59.757042+0000","last_became_active":"2024-09-19T05:39:58.785009+0000","last_became_peered":"2024-09-19T05:39:58.785009+0000","last_unstale":"2024-09-19T05:39:59.757042+0000","last_undegraded":"2024-09-19T05:39:59.757042+0000","last_fullsized":"2024-09-19T05:39:59.757042+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:14.824320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.758178+0000","last_change":"2024-09-19T05:39:57.770887+0000","last_active":"2024-09-19T05:39:59.758178+0000","last_peered":"2024-09-19T05:39:59.758178+0000","last_clean":"2024-09-19T05:39:59.758178+0000","last_became_active":"2024-09-19T05:39:57.769563+0000","last_became_peered":"2024-09-19T05:39:57.769563+0000","last_unstale":"2024-09-19T05:39:59.758178+0000","last_undegraded":"2024-09-19T05:39:59.758178+0000","last_fullsized":"2024-09-19T05:39:59.758178+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:46.442085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761741+0000","last_change":"2024-09-19T05:39:58.784923+0000","last_active":"2024-09-19T05:39:59.761741+0000","last_peered":"2024-09-19T05:39:59.761741+0000","last_clean":"2024-09-19T05:39:59.761741+0000","last_became_active":"2024-09-19T05:39:58.784607+0000","last_became_peered":"2024-09-19T05:39:58.784607+0000","last_unstale":"2024-09-19T05:39:59.761741+0000","last_undegraded":"2024-09-19T05:39:59.761741+0000","last_fullsized":"2024-09-19T05:39:59.761741+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:31.278078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761152+0000","last_change":"2024-09-19T05:39:57.784292+0000","last_active":"2024-09-19T05:39:59.761152+0000","last_peered":"2024-09-19T05:39:59.761152+0000","last_clean":"2024-09-19T05:39:59.761152+0000","last_became_active":"2024-09-19T05:39:57.783570+0000","last_became_peered":"2024-09-19T05:39:57.783570+0000","last_unstale":"2024-09-19T05:39:59.761152+0000","last_undegraded":"2024-09-19T05:39:59.761152+0000","last_fullsized":"2024-09-19T05:39:59.761152+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:18.718516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391862+0000","last_change":"2024-09-19T05:39:58.782226+0000","last_active":"2024-09-19T05:40:00.391862+0000","last_peered":"2024-09-19T05:40:00.391862+0000","last_clean":"2024-09-19T05:40:00.391862+0000","last_became_active":"2024-09-19T05:39:58.781964+0000","last_became_peered":"2024-09-19T05:39:58.781964+0000","last_unstale":"2024-09-19T05:40:00.391862+0000","last_undegraded":"2024-09-19T05:40:00.391862+0000","last_fullsized":"2024-09-19T05:40:00.391862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393325+0000","last_change":"2024-09-19T05:39:57.774005+0000","last_active":"2024-09-19T05:40:00.393325+0000","last_peered":"2024-09-19T05:40:00.393325+0000","last_clean":"2024-09-19T05:40:00.393325+0000","last_became_active":"2024-09-19T05:39:57.773649+0000","last_became_peered":"2024-09-19T05:39:57.773649+0000","last_unstale":"2024-09-19T05:40:00.393325+0000","last_undegraded":"2024-09-19T05:40:00.393325+0000","last_fullsized":"2024-09-19T05:40:00.393325+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:42.781599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173298+0000","last_change":"2024-09-19T05:39:58.789096+0000","last_active":"2024-09-19T05:40:00.173298+0000","last_peered":"2024-09-19T05:40:00.173298+0000","last_clean":"2024-09-19T05:40:00.173298+0000","last_became_active":"2024-09-19T05:39:58.788556+0000","last_became_peered":"2024-09-19T05:39:58.788556+0000","last_unstale":"2024-09-19T05:40:00.173298+0000","last_undegraded":"2024-09-19T05:40:00.173298+0000","last_fullsized":"2024-09-19T05:40:00.173298+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:31.788519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391589+0000","last_change":"2024-09-19T05:39:57.788827+0000","last_active":"2024-09-19T05:40:00.391589+0000","last_peered":"2024-09-19T05:40:00.391589+0000","last_clean":"2024-09-19T05:40:00.391589+0000","last_became_active":"2024-09-19T05:39:57.788203+0000","last_became_peered":"2024-09-19T05:39:57.788203+0000","last_unstale":"2024-09-19T05:40:00.391589+0000","last_undegraded":"2024-09-19T05:40:00.391589+0000","last_fullsized":"2024-09-19T05:40:00.391589+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.042348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392916+0000","last_change":"2024-09-19T05:39:58.797503+0000","last_active":"2024-09-19T05:40:00.392916+0000","last_peered":"2024-09-19T05:40:00.392916+0000","last_clean":"2024-09-19T05:40:00.392916+0000","last_became_active":"2024-09-19T05:39:58.792554+0000","last_became_peered":"2024-09-19T05:39:58.792554+0000","last_unstale":"2024-09-19T05:40:00.392916+0000","last_undegraded":"2024-09-19T05:40:00.392916+0000","last_fullsized":"2024-09-19T05:40:00.392916+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:27.961945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390969+0000","last_change":"2024-09-19T05:39:57.781182+0000","last_active":"2024-09-19T05:40:00.390969+0000","last_peered":"2024-09-19T05:40:00.390969+0000","last_clean":"2024-09-19T05:40:00.390969+0000","last_became_active":"2024-09-19T05:39:57.780473+0000","last_became_peered":"2024-09-19T05:39:57.780473+0000","last_unstale":"2024-09-19T05:40:00.390969+0000","last_undegraded":"2024-09-19T05:40:00.390969+0000","last_fullsized":"2024-09-19T05:40:00.390969+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:24.189507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393566+0000","last_change":"2024-09-19T05:39:58.770354+0000","last_active":"2024-09-19T05:40:00.393566+0000","last_peered":"2024-09-19T05:40:00.393566+0000","last_clean":"2024-09-19T05:40:00.393566+0000","last_became_active":"2024-09-19T05:39:58.769994+0000","last_became_peered":"2024-09-19T05:39:58.769994+0000","last_unstale":"2024-09-19T05:40:00.393566+0000","last_undegraded":"2024-09-19T05:40:00.393566+0000","last_fullsized":"2024-09-19T05:40:00.393566+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:47.082669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.760721+0000","last_change":"2024-09-19T05:39:57.794715+0000","last_active":"2024-09-19T05:39:59.760721+0000","last_peered":"2024-09-19T05:39:59.760721+0000","last_clean":"2024-09-19T05:39:59.760721+0000","last_became_active":"2024-09-19T05:39:57.793933+0000","last_became_peered":"2024-09-19T05:39:57.793933+0000","last_unstale":"2024-09-19T05:39:59.760721+0000","last_undegraded":"2024-09-19T05:39:59.760721+0000","last_fullsized":"2024-09-19T05:39:59.760721+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:54.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173430+0000","last_change":"2024-09-19T05:39:58.794916+0000","last_active":"2024-09-19T05:40:00.173430+0000","last_peered":"2024-09-19T05:40:00.173430+0000","last_clean":"2024-09-19T05:40:00.173430+0000","last_became_active":"2024-09-19T05:39:58.791104+0000","last_became_peered":"2024-09-19T05:39:58.791104+0000","last_unstale":"2024-09-19T05:40:00.173430+0000","last_undegraded":"2024-09-19T05:40:00.173430+0000","last_fullsized":"2024-09-19T05:40:00.173430+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:37.439578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172301+0000","last_change":"2024-09-19T05:39:57.765227+0000","last_active":"2024-09-19T05:40:00.172301+0000","last_peered":"2024-09-19T05:40:00.172301+0000","last_clean":"2024-09-19T05:40:00.172301+0000","last_became_active":"2024-09-19T05:39:57.764688+0000","last_became_peered":"2024-09-19T05:39:57.764688+0000","last_unstale":"2024-09-19T05:40:00.172301+0000","last_undegraded":"2024-09-19T05:40:00.172301+0000","last_fullsized":"2024-09-19T05:40:00.172301+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:46.078315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392065+0000","last_change":"2024-09-19T05:39:58.802896+0000","last_active":"2024-09-19T05:40:00.392065+0000","last_peered":"2024-09-19T05:40:00.392065+0000","last_clean":"2024-09-19T05:40:00.392065+0000","last_became_active":"2024-09-19T05:39:58.792481+0000","last_became_peered":"2024-09-19T05:39:58.792481+0000","last_unstale":"2024-09-19T05:40:00.392065+0000","last_undegraded":"2024-09-19T05:40:00.392065+0000","last_fullsized":"2024-09-19T05:40:00.392065+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:48.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761861+0000","last_change":"2024-09-19T05:39:57.784748+0000","last_active":"2024-09-19T05:39:59.761861+0000","last_peered":"2024-09-19T05:39:59.761861+0000","last_clean":"2024-09-19T05:39:59.761861+0000","last_became_active":"2024-09-19T05:39:57.783243+0000","last_became_peered":"2024-09-19T05:39:57.783243+0000","last_unstale":"2024-09-19T05:39:59.761861+0000","last_undegraded":"2024-09-19T05:39:59.761861+0000","last_fullsized":"2024-09-19T05:39:59.761861+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:18.059390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392829+0000","last_change":"2024-09-19T05:39:58.782763+0000","last_active":"2024-09-19T05:40:00.392829+0000","last_peered":"2024-09-19T05:40:00.392829+0000","last_clean":"2024-09-19T05:40:00.392829+0000","last_became_active":"2024-09-19T05:39:58.782316+0000","last_became_peered":"2024-09-19T05:39:58.782316+0000","last_unstale":"2024-09-19T05:40:00.392829+0000","last_undegraded":"2024-09-19T05:40:00.392829+0000","last_fullsized":"2024-09-19T05:40:00.392829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:21.923650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392163+0000","last_change":"2024-09-19T05:39:57.785900+0000","last_active":"2024-09-19T05:40:00.392163+0000","last_peered":"2024-09-19T05:40:00.392163+0000","last_clean":"2024-09-19T05:40:00.392163+0000","last_became_active":"2024-09-19T05:39:57.785546+0000","last_became_peered":"2024-09-19T05:39:57.785546+0000","last_unstale":"2024-09-19T05:40:00.392163+0000","last_undegraded":"2024-09-19T05:40:00.392163+0000","last_fullsized":"2024-09-19T05:40:00.392163+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:25.148091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756813+0000","last_change":"2024-09-19T05:39:58.811363+0000","last_active":"2024-09-19T05:39:59.756813+0000","last_peered":"2024-09-19T05:39:59.756813+0000","last_clean":"2024-09-19T05:39:59.756813+0000","last_became_active":"2024-09-19T05:39:58.810294+0000","last_became_peered":"2024-09-19T05:39:58.810294+0000","last_unstale":"2024-09-19T05:39:59.756813+0000","last_undegraded":"2024-09-19T05:39:59.756813+0000","last_fullsized":"2024-09-19T05:39:59.756813+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:10.448889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"115'3","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390943+0000","last_change":"2024-09-19T05:39:57.776395+0000","last_active":"2024-09-19T05:40:00.390943+0000","last_peered":"2024-09-19T05:40:00.390943+0000","last_clean":"2024-09-19T05:40:00.390943+0000","last_became_active":"2024-09-19T05:39:57.775694+0000","last_became_peered":"2024-09-19T05:39:57.775694+0000","last_unstale":"2024-09-19T05:40:00.390943+0000","last_undegraded":"2024-09-19T05:40:00.390943+0000","last_fullsized":"2024-09-19T05:40:00.390943+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:19.014788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392733+0000","last_change":"2024-09-19T05:39:58.800510+0000","last_active":"2024-09-19T05:40:00.392733+0000","last_peered":"2024-09-19T05:40:00.392733+0000","last_clean":"2024-09-19T05:40:00.392733+0000","last_became_active":"2024-09-19T05:39:58.783972+0000","last_became_peered":"2024-09-19T05:39:58.783972+0000","last_unstale":"2024-09-19T05:40:00.392733+0000","last_undegraded":"2024-09-19T05:40:00.392733+0000","last_fullsized":"2024-09-19T05:40:00.392733+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:47.082669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"115'6","reported_seq":20,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392117+0000","last_change":"2024-09-19T05:39:57.781959+0000","last_active":"2024-09-19T05:40:00.392117+0000","last_peered":"2024-09-19T05:40:00.392117+0000","last_clean":"2024-09-19T05:40:00.392117+0000","last_became_active":"2024-09-19T05:39:57.781166+0000","last_became_peered":"2024-09-19T05:39:57.781166+0000","last_unstale":"2024-09-19T05:40:00.392117+0000","last_undegraded":"2024-09-19T05:40:00.392117+0000","last_fullsized":"2024-09-19T05:40:00.392117+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:52.355948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391628+0000","last_change":"2024-09-19T05:39:58.790541+0000","last_active":"2024-09-19T05:40:00.391628+0000","last_peered":"2024-09-19T05:40:00.391628+0000","last_clean":"2024-09-19T05:40:00.391628+0000","last_became_active":"2024-09-19T05:39:58.790331+0000","last_became_peered":"2024-09-19T05:39:58.790331+0000","last_unstale":"2024-09-19T05:40:00.391628+0000","last_undegraded":"2024-09-19T05:40:00.391628+0000","last_fullsized":"2024-09-19T05:40:00.391628+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:42.796958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392515+0000","last_change":"2024-09-19T05:39:57.767610+0000","last_active":"2024-09-19T05:40:00.392515+0000","last_peered":"2024-09-19T05:40:00.392515+0000","last_clean":"2024-09-19T05:40:00.392515+0000","last_became_active":"2024-09-19T05:39:57.767330+0000","last_became_peered":"2024-09-19T05:39:57.767330+0000","last_unstale":"2024-09-19T05:40:00.392515+0000","last_undegraded":"2024-09-19T05:40:00.392515+0000","last_fullsized":"2024-09-19T05:40:00.392515+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:26.264660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393099+0000","last_change":"2024-09-19T05:39:58.781712+0000","last_active":"2024-09-19T05:40:00.393099+0000","last_peered":"2024-09-19T05:40:00.393099+0000","last_clean":"2024-09-19T05:40:00.393099+0000","last_became_active":"2024-09-19T05:39:58.781395+0000","last_became_peered":"2024-09-19T05:39:58.781395+0000","last_unstale":"2024-09-19T05:40:00.393099+0000","last_undegraded":"2024-09-19T05:40:00.393099+0000","last_fullsized":"2024-09-19T05:40:00.393099+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:24.825465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172794+0000","last_change":"2024-09-19T05:39:57.774297+0000","last_active":"2024-09-19T05:40:00.172794+0000","last_peered":"2024-09-19T05:40:00.172794+0000","last_clean":"2024-09-19T05:40:00.172794+0000","last_became_active":"2024-09-19T05:39:57.773905+0000","last_became_peered":"2024-09-19T05:39:57.773905+0000","last_unstale":"2024-09-19T05:40:00.172794+0000","last_undegraded":"2024-09-19T05:40:00.172794+0000","last_fullsized":"2024-09-19T05:40:00.172794+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:20.919296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.758047+0000","last_change":"2024-09-19T05:39:58.771968+0000","last_active":"2024-09-19T05:39:59.758047+0000","last_peered":"2024-09-19T05:39:59.758047+0000","last_clean":"2024-09-19T05:39:59.758047+0000","last_became_active":"2024-09-19T05:39:58.771416+0000","last_became_peered":"2024-09-19T05:39:58.771416+0000","last_unstale":"2024-09-19T05:39:59.758047+0000","last_undegraded":"2024-09-19T05:39:59.758047+0000","last_fullsized":"2024-09-19T05:39:59.758047+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:45.305142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757181+0000","last_change":"2024-09-19T05:39:57.762647+0000","last_active":"2024-09-19T05:39:59.757181+0000","last_peered":"2024-09-19T05:39:59.757181+0000","last_clean":"2024-09-19T05:39:59.757181+0000","last_became_active":"2024-09-19T05:39:57.762197+0000","last_became_peered":"2024-09-19T05:39:57.762197+0000","last_unstale":"2024-09-19T05:39:59.757181+0000","last_undegraded":"2024-09-19T05:39:59.757181+0000","last_fullsized":"2024-09-19T05:39:59.757181+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:37.135662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393495+0000","last_change":"2024-09-19T05:39:58.774450+0000","last_active":"2024-09-19T05:40:00.393495+0000","last_peered":"2024-09-19T05:40:00.393495+0000","last_clean":"2024-09-19T05:40:00.393495+0000","last_became_active":"2024-09-19T05:39:58.773993+0000","last_became_peered":"2024-09-19T05:39:58.773993+0000","last_unstale":"2024-09-19T05:40:00.393495+0000","last_undegraded":"2024-09-19T05:40:00.393495+0000","last_fullsized":"2024-09-19T05:40:00.393495+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:45.203947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"115'8","reported_seq":22,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.760672+0000","last_change":"2024-09-19T05:39:57.793974+0000","last_active":"2024-09-19T05:39:59.760672+0000","last_peered":"2024-09-19T05:39:59.760672+0000","last_clean":"2024-09-19T05:39:59.760672+0000","last_became_active":"2024-09-19T05:39:57.784027+0000","last_became_peered":"2024-09-19T05:39:57.784027+0000","last_unstale":"2024-09-19T05:39:59.760672+0000","last_undegraded":"2024-09-19T05:39:59.760672+0000","last_fullsized":"2024-09-19T05:39:59.760672+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.438301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757274+0000","last_change":"2024-09-19T05:39:58.793654+0000","last_active":"2024-09-19T05:39:59.757274+0000","last_peered":"2024-09-19T05:39:59.757274+0000","last_clean":"2024-09-19T05:39:59.757274+0000","last_became_active":"2024-09-19T05:39:58.793203+0000","last_became_peered":"2024-09-19T05:39:58.793203+0000","last_unstale":"2024-09-19T05:39:59.757274+0000","last_undegraded":"2024-09-19T05:39:59.757274+0000","last_fullsized":"2024-09-19T05:39:59.757274+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:20.773571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393447+0000","last_change":"2024-09-19T05:39:57.801655+0000","last_active":"2024-09-19T05:40:00.393447+0000","last_peered":"2024-09-19T05:40:00.393447+0000","last_clean":"2024-09-19T05:40:00.393447+0000","last_became_active":"2024-09-19T05:39:57.800788+0000","last_became_peered":"2024-09-19T05:39:57.800788+0000","last_unstale":"2024-09-19T05:40:00.393447+0000","last_undegraded":"2024-09-19T05:40:00.393447+0000","last_fullsized":"2024-09-19T05:40:00.393447+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:18.059390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391845+0000","last_change":"2024-09-19T05:39:58.791293+0000","last_active":"2024-09-19T05:40:00.391845+0000","last_peered":"2024-09-19T05:40:00.391845+0000","last_clean":"2024-09-19T05:40:00.391845+0000","last_became_active":"2024-09-19T05:39:58.790974+0000","last_became_peered":"2024-09-19T05:39:58.790974+0000","last_unstale":"2024-09-19T05:40:00.391845+0000","last_undegraded":"2024-09-19T05:40:00.391845+0000","last_fullsized":"2024-09-19T05:40:00.391845+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:56.540706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391182+0000","last_change":"2024-09-19T05:39:57.796495+0000","last_active":"2024-09-19T05:40:00.391182+0000","last_peered":"2024-09-19T05:40:00.391182+0000","last_clean":"2024-09-19T05:40:00.391182+0000","last_became_active":"2024-09-19T05:39:57.795756+0000","last_became_peered":"2024-09-19T05:39:57.795756+0000","last_unstale":"2024-09-19T05:40:00.391182+0000","last_undegraded":"2024-09-19T05:40:00.391182+0000","last_fullsized":"2024-09-19T05:40:00.391182+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:55.677304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392352+0000","last_change":"2024-09-19T05:39:58.805143+0000","last_active":"2024-09-19T05:40:00.392352+0000","last_peered":"2024-09-19T05:40:00.392352+0000","last_clean":"2024-09-19T05:40:00.392352+0000","last_became_active":"2024-09-19T05:39:58.799609+0000","last_became_peered":"2024-09-19T05:39:58.799609+0000","last_unstale":"2024-09-19T05:40:00.392352+0000","last_undegraded":"2024-09-19T05:40:00.392352+0000","last_fullsized":"2024-09-19T05:40:00.392352+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:00.318329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391087+0000","last_change":"2024-09-19T05:39:57.786985+0000","last_active":"2024-09-19T05:40:00.391087+0000","last_peered":"2024-09-19T05:40:00.391087+0000","last_clean":"2024-09-19T05:40:00.391087+0000","last_became_active":"2024-09-19T05:39:57.786287+0000","last_became_peered":"2024-09-19T05:39:57.786287+0000","last_unstale":"2024-09-19T05:40:00.391087+0000","last_undegraded":"2024-09-19T05:40:00.391087+0000","last_fullsized":"2024-09-19T05:40:00.391087+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:58.394463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391990+0000","last_change":"2024-09-19T05:39:58.791721+0000","last_active":"2024-09-19T05:40:00.391990+0000","last_peered":"2024-09-19T05:40:00.391990+0000","last_clean":"2024-09-19T05:40:00.391990+0000","last_became_active":"2024-09-19T05:39:58.791302+0000","last_became_peered":"2024-09-19T05:39:58.791302+0000","last_unstale":"2024-09-19T05:40:00.391990+0000","last_undegraded":"2024-09-19T05:40:00.391990+0000","last_fullsized":"2024-09-19T05:40:00.391990+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:13.879938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757203+0000","last_change":"2024-09-19T05:39:57.768804+0000","last_active":"2024-09-19T05:39:59.757203+0000","last_peered":"2024-09-19T05:39:59.757203+0000","last_clean":"2024-09-19T05:39:59.757203+0000","last_became_active":"2024-09-19T05:39:57.766204+0000","last_became_peered":"2024-09-19T05:39:57.766204+0000","last_unstale":"2024-09-19T05:39:59.757203+0000","last_undegraded":"2024-09-19T05:39:59.757203+0000","last_fullsized":"2024-09-19T05:39:59.757203+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:21.950392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392286+0000","last_change":"2024-09-19T05:39:58.812215+0000","last_active":"2024-09-19T05:40:00.392286+0000","last_peered":"2024-09-19T05:40:00.392286+0000","last_clean":"2024-09-19T05:40:00.392286+0000","last_became_active":"2024-09-19T05:39:58.811797+0000","last_became_peered":"2024-09-19T05:39:58.811797+0000","last_unstale":"2024-09-19T05:40:00.392286+0000","last_undegraded":"2024-09-19T05:40:00.392286+0000","last_fullsized":"2024-09-19T05:40:00.392286+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:35.612170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756577+0000","last_change":"2024-09-19T05:39:57.768643+0000","last_active":"2024-09-19T05:39:59.756577+0000","last_peered":"2024-09-19T05:39:59.756577+0000","last_clean":"2024-09-19T05:39:59.756577+0000","last_became_active":"2024-09-19T05:39:57.768283+0000","last_became_peered":"2024-09-19T05:39:57.768283+0000","last_unstale":"2024-09-19T05:39:59.756577+0000","last_undegraded":"2024-09-19T05:39:59.756577+0000","last_fullsized":"2024-09-19T05:39:59.756577+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:53.640752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172932+0000","last_change":"2024-09-19T05:39:58.782116+0000","last_active":"2024-09-19T05:40:00.172932+0000","last_peered":"2024-09-19T05:40:00.172932+0000","last_clean":"2024-09-19T05:40:00.172932+0000","last_became_active":"2024-09-19T05:39:58.781446+0000","last_became_peered":"2024-09-19T05:39:58.781446+0000","last_unstale":"2024-09-19T05:40:00.172932+0000","last_undegraded":"2024-09-19T05:40:00.172932+0000","last_fullsized":"2024-09-19T05:40:00.172932+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:56.769969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390126+0000","last_change":"2024-09-19T05:39:57.784426+0000","last_active":"2024-09-19T05:40:00.390126+0000","last_peered":"2024-09-19T05:40:00.390126+0000","last_clean":"2024-09-19T05:40:00.390126+0000","last_became_active":"2024-09-19T05:39:57.778640+0000","last_became_peered":"2024-09-19T05:39:57.778640+0000","last_unstale":"2024-09-19T05:40:00.390126+0000","last_undegraded":"2024-09-19T05:40:00.390126+0000","last_fullsized":"2024-09-19T05:40:00.390126+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:36.343568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757927+0000","last_change":"2024-09-19T05:39:58.785360+0000","last_active":"2024-09-19T05:39:59.757927+0000","last_peered":"2024-09-19T05:39:59.757927+0000","last_clean":"2024-09-19T05:39:59.757927+0000","last_became_active":"2024-09-19T05:39:58.784635+0000","last_became_peered":"2024-09-19T05:39:58.784635+0000","last_unstale":"2024-09-19T05:39:59.757927+0000","last_undegraded":"2024-09-19T05:39:59.757927+0000","last_fullsized":"2024-09-19T05:39:59.757927+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:51.255162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757128+0000","last_change":"2024-09-19T05:39:57.772384+0000","last_active":"2024-09-19T05:39:59.757128+0000","last_peered":"2024-09-19T05:39:59.757128+0000","last_clean":"2024-09-19T05:39:59.757128+0000","last_became_active":"2024-09-19T05:39:57.771015+0000","last_became_peered":"2024-09-19T05:39:57.771015+0000","last_unstale":"2024-09-19T05:39:59.757128+0000","last_undegraded":"2024-09-19T05:39:59.757128+0000","last_fullsized":"2024-09-19T05:39:59.757128+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:00.454032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391642+0000","last_change":"2024-09-19T05:39:58.796706+0000","last_active":"2024-09-19T05:40:00.391642+0000","last_peered":"2024-09-19T05:40:00.391642+0000","last_clean":"2024-09-19T05:40:00.391642+0000","last_became_active":"2024-09-19T05:39:58.791959+0000","last_became_peered":"2024-09-19T05:39:58.791959+0000","last_unstale":"2024-09-19T05:40:00.391642+0000","last_undegraded":"2024-09-19T05:40:00.391642+0000","last_fullsized":"2024-09-19T05:40:00.391642+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:31.757723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392180+0000","last_change":"2024-09-19T05:39:57.772162+0000","last_active":"2024-09-19T05:40:00.392180+0000","last_peered":"2024-09-19T05:40:00.392180+0000","last_clean":"2024-09-19T05:40:00.392180+0000","last_became_active":"2024-09-19T05:39:57.771861+0000","last_became_peered":"2024-09-19T05:39:57.771861+0000","last_unstale":"2024-09-19T05:40:00.392180+0000","last_undegraded":"2024-09-19T05:40:00.392180+0000","last_fullsized":"2024-09-19T05:40:00.392180+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:38.476733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.760915+0000","last_change":"2024-09-19T05:39:58.787151+0000","last_active":"2024-09-19T05:39:59.760915+0000","last_peered":"2024-09-19T05:39:59.760915+0000","last_clean":"2024-09-19T05:39:59.760915+0000","last_became_active":"2024-09-19T05:39:58.786837+0000","last_became_peered":"2024-09-19T05:39:58.786837+0000","last_unstale":"2024-09-19T05:39:59.760915+0000","last_undegraded":"2024-09-19T05:39:59.760915+0000","last_fullsized":"2024-09-19T05:39:59.760915+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:41.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"116'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392602+0000","last_change":"2024-09-19T05:39:57.783978+0000","last_active":"2024-09-19T05:40:00.392602+0000","last_peered":"2024-09-19T05:40:00.392602+0000","last_clean":"2024-09-19T05:40:00.392602+0000","last_became_active":"2024-09-19T05:39:57.783626+0000","last_became_peered":"2024-09-19T05:39:57.783626+0000","last_unstale":"2024-09-19T05:40:00.392602+0000","last_undegraded":"2024-09-19T05:40:00.392602+0000","last_fullsized":"2024-09-19T05:40:00.392602+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:42.058437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172691+0000","last_change":"2024-09-19T05:39:58.781283+0000","last_active":"2024-09-19T05:40:00.172691+0000","last_peered":"2024-09-19T05:40:00.172691+0000","last_clean":"2024-09-19T05:40:00.172691+0000","last_became_active":"2024-09-19T05:39:58.780771+0000","last_became_peered":"2024-09-19T05:39:58.780771+0000","last_unstale":"2024-09-19T05:40:00.172691+0000","last_undegraded":"2024-09-19T05:40:00.172691+0000","last_fullsized":"2024-09-19T05:40:00.172691+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:52.994940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392553+0000","last_change":"2024-09-19T05:39:57.781803+0000","last_active":"2024-09-19T05:40:00.392553+0000","last_peered":"2024-09-19T05:40:00.392553+0000","last_clean":"2024-09-19T05:40:00.392553+0000","last_became_active":"2024-09-19T05:39:57.780574+0000","last_became_peered":"2024-09-19T05:39:57.780574+0000","last_unstale":"2024-09-19T05:40:00.392553+0000","last_undegraded":"2024-09-19T05:40:00.392553+0000","last_fullsized":"2024-09-19T05:40:00.392553+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:52.923110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391439+0000","last_change":"2024-09-19T05:39:58.816078+0000","last_active":"2024-09-19T05:40:00.391439+0000","last_peered":"2024-09-19T05:40:00.391439+0000","last_clean":"2024-09-19T05:40:00.391439+0000","last_became_active":"2024-09-19T05:39:58.815844+0000","last_became_peered":"2024-09-19T05:39:58.815844+0000","last_unstale":"2024-09-19T05:40:00.391439+0000","last_undegraded":"2024-09-19T05:40:00.391439+0000","last_fullsized":"2024-09-19T05:40:00.391439+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:36.521051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393555+0000","last_change":"2024-09-19T05:39:57.778815+0000","last_active":"2024-09-19T05:40:00.393555+0000","last_peered":"2024-09-19T05:40:00.393555+0000","last_clean":"2024-09-19T05:40:00.393555+0000","last_became_active":"2024-09-19T05:39:57.778442+0000","last_became_peered":"2024-09-19T05:39:57.778442+0000","last_unstale":"2024-09-19T05:40:00.393555+0000","last_undegraded":"2024-09-19T05:40:00.393555+0000","last_fullsized":"2024-09-19T05:40:00.393555+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:39.719140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757765+0000","last_change":"2024-09-19T05:39:58.784849+0000","last_active":"2024-09-19T05:39:59.757765+0000","last_peered":"2024-09-19T05:39:59.757765+0000","last_clean":"2024-09-19T05:39:59.757765+0000","last_became_active":"2024-09-19T05:39:58.784403+0000","last_became_peered":"2024-09-19T05:39:58.784403+0000","last_unstale":"2024-09-19T05:39:59.757765+0000","last_undegraded":"2024-09-19T05:39:59.757765+0000","last_fullsized":"2024-09-19T05:39:59.757765+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:03.327092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761415+0000","last_change":"2024-09-19T05:39:57.795587+0000","last_active":"2024-09-19T05:39:59.761415+0000","last_peered":"2024-09-19T05:39:59.761415+0000","last_clean":"2024-09-19T05:39:59.761415+0000","last_became_active":"2024-09-19T05:39:57.794286+0000","last_became_peered":"2024-09-19T05:39:57.794286+0000","last_unstale":"2024-09-19T05:39:59.761415+0000","last_undegraded":"2024-09-19T05:39:59.761415+0000","last_fullsized":"2024-09-19T05:39:59.761415+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:07.271962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757624+0000","last_change":"2024-09-19T05:39:58.784607+0000","last_active":"2024-09-19T05:39:59.757624+0000","last_peered":"2024-09-19T05:39:59.757624+0000","last_clean":"2024-09-19T05:39:59.757624+0000","last_became_active":"2024-09-19T05:39:58.784101+0000","last_became_peered":"2024-09-19T05:39:58.784101+0000","last_unstale":"2024-09-19T05:39:59.757624+0000","last_undegraded":"2024-09-19T05:39:59.757624+0000","last_fullsized":"2024-09-19T05:39:59.757624+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:17.234984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756867+0000","last_change":"2024-09-19T05:39:57.777352+0000","last_active":"2024-09-19T05:39:59.756867+0000","last_peered":"2024-09-19T05:39:59.756867+0000","last_clean":"2024-09-19T05:39:59.756867+0000","last_became_active":"2024-09-19T05:39:57.776875+0000","last_became_peered":"2024-09-19T05:39:57.776875+0000","last_unstale":"2024-09-19T05:39:59.756867+0000","last_undegraded":"2024-09-19T05:39:59.756867+0000","last_fullsized":"2024-09-19T05:39:59.756867+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:44.433004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391439+0000","last_change":"2024-09-19T05:39:58.775300+0000","last_active":"2024-09-19T05:40:00.391439+0000","last_peered":"2024-09-19T05:40:00.391439+0000","last_clean":"2024-09-19T05:40:00.391439+0000","last_became_active":"2024-09-19T05:39:58.774430+0000","last_became_peered":"2024-09-19T05:39:58.774430+0000","last_unstale":"2024-09-19T05:40:00.391439+0000","last_undegraded":"2024-09-19T05:40:00.391439+0000","last_fullsized":"2024-09-19T05:40:00.391439+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:14.979906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390369+0000","last_change":"2024-09-19T05:39:57.783783+0000","last_active":"2024-09-19T05:40:00.390369+0000","last_peered":"2024-09-19T05:40:00.390369+0000","last_clean":"2024-09-19T05:40:00.390369+0000","last_became_active":"2024-09-19T05:39:57.782574+0000","last_became_peered":"2024-09-19T05:39:57.782574+0000","last_unstale":"2024-09-19T05:40:00.390369+0000","last_undegraded":"2024-09-19T05:40:00.390369+0000","last_fullsized":"2024-09-19T05:40:00.390369+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.438301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393903+0000","last_change":"2024-09-19T05:39:58.774808+0000","last_active":"2024-09-19T05:40:00.393903+0000","last_peered":"2024-09-19T05:40:00.393903+0000","last_clean":"2024-09-19T05:40:00.393903+0000","last_became_active":"2024-09-19T05:39:58.774517+0000","last_became_peered":"2024-09-19T05:39:58.774517+0000","last_unstale":"2024-09-19T05:40:00.393903+0000","last_undegraded":"2024-09-19T05:40:00.393903+0000","last_fullsized":"2024-09-19T05:40:00.393903+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:28.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757385+0000","last_change":"2024-09-19T05:39:57.777349+0000","last_active":"2024-09-19T05:39:59.757385+0000","last_peered":"2024-09-19T05:39:59.757385+0000","last_clean":"2024-09-19T05:39:59.757385+0000","last_became_active":"2024-09-19T05:39:57.776903+0000","last_became_peered":"2024-09-19T05:39:57.776903+0000","last_unstale":"2024-09-19T05:39:59.757385+0000","last_undegraded":"2024-09-19T05:39:59.757385+0000","last_fullsized":"2024-09-19T05:39:59.757385+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:12.523574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392258+0000","last_change":"2024-09-19T05:39:58.774834+0000","last_active":"2024-09-19T05:40:00.392258+0000","last_peered":"2024-09-19T05:40:00.392258+0000","last_clean":"2024-09-19T05:40:00.392258+0000","last_became_active":"2024-09-19T05:39:58.774465+0000","last_became_peered":"2024-09-19T05:39:58.774465+0000","last_unstale":"2024-09-19T05:40:00.392258+0000","last_undegraded":"2024-09-19T05:40:00.392258+0000","last_fullsized":"2024-09-19T05:40:00.392258+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:04.632793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.758443+0000","last_change":"2024-09-19T05:39:57.773272+0000","last_active":"2024-09-19T05:39:59.758443+0000","last_peered":"2024-09-19T05:39:59.758443+0000","last_clean":"2024-09-19T05:39:59.758443+0000","last_became_active":"2024-09-19T05:39:57.772523+0000","last_became_peered":"2024-09-19T05:39:57.772523+0000","last_unstale":"2024-09-19T05:39:59.758443+0000","last_undegraded":"2024-09-19T05:39:59.758443+0000","last_fullsized":"2024-09-19T05:39:59.758443+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:41.387913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":341,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390415+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:40:00.390415+0000","last_peered":"2024-09-19T05:40:00.390415+0000","last_clean":"2024-09-19T05:40:00.390415+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:40:00.390415+0000","last_undegraded":"2024-09-19T05:40:00.390415+0000","last_fullsized":"2024-09-19T05:40:00.390415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542230,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51228,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320612,"statfs":{"total":96636764160,"available":96584306688,"internally_reserved":0,"allocated":2035712,"data_stored":1264973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45092,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326748,"statfs":{"total":96636764160,"available":96590589952,"internally_reserved":0,"allocated":1454080,"data_stored":676661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542232,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1433600,"data_stored":674445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542230,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50644,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321196,"statfs":{"total":96636764160,"available":96584904704,"internally_reserved":0,"allocated":1441792,"data_stored":674537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542231,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46480,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325360,"statfs":{"total":96636764160,"available":96589168640,"internally_reserved":0,"allocated":1437696,"data_stored":675027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542231,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28432,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343408,"statfs":{"total":96636764160,"available":96607649792,"internally_reserved":0,"allocated":1437696,"data_stored":674479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40912,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330928,"statfs":{"total":96636764160,"available":96594870272,"internally_reserved":0,"allocated":1437696,"data_stored":674479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542230,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55396,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316444,"statfs":{"total":96636764160,"available":96580038656,"internally_reserved":0,"allocated":2043904,"data_stored":1266515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:40:07.399 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:40:07.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe058dfc640 1 Processor -- start 2024-09-19T05:40:07.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe058dfc640 1 -- start start 2024-09-19T05:40:07.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe058dfc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe054161da0 0x7fe0540d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe058dfc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0540d0160 0x7fe0540d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe058dfc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0540d05d0 con 0x7fe0540d0e80 2024-09-19T05:40:07.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe058dfc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe0540d1830 con 0x7fe0540d0160 2024-09-19T05:40:07.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe058dfc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe0540d0840 con 0x7fe054161da0 2024-09-19T05:40:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe052d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0540d0160 0x7fe0540d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe04bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe0540d0e80 0x7fe0540b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34860/0 (socket says 172.21.15.67:34860) 2024-09-19T05:40:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe052d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0540d0160 0x7fe0540d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59312/0 (socket says 172.21.15.67:59312) 2024-09-19T05:40:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe04bfff640 1 -- 172.21.15.67:0/795422218 learned_addr learned my addr 172.21.15.67:0/795422218 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:40:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe05259c640 1 --2- 172.21.15.67:0/795422218 >> v2:172.21.15.97:3300/0 conn(0x7fe054161da0 0x7fe0540d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe052d9d640 1 -- 172.21.15.67:0/795422218 >> v2:172.21.15.97:3300/0 conn(0x7fe054161da0 msgr2=0x7fe0540d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe052d9d640 1 --2- 172.21.15.67:0/795422218 >> v2:172.21.15.97:3300/0 conn(0x7fe054161da0 0x7fe0540d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe052d9d640 1 -- 172.21.15.67:0/795422218 >> v1:172.21.15.67:6789/0 conn(0x7fe0540d0e80 legacy=0x7fe0540b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe052d9d640 1 -- 172.21.15.67:0/795422218 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0540d4d40 con 0x7fe0540d0160 2024-09-19T05:40:07.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.539+0000 7fe051d9b640 1 -- 172.21.15.67:0/795422218 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467719834 0 0) 0x7fe0540d05d0 con 0x7fe0540d0e80 2024-09-19T05:40:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe052d9d640 1 --2- 172.21.15.67:0/795422218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0540d0160 0x7fe0540d12f0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe0540b5f50 tx=0x7fe04c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d30d85e8ed79878 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe051d9b640 1 -- 172.21.15.67:0/795422218 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0b2070 con 0x7fe0540d0160 2024-09-19T05:40:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe051d9b640 1 -- 172.21.15.67:0/795422218 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c0a58e0 con 0x7fe0540d0160 2024-09-19T05:40:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe051d9b640 1 -- 172.21.15.67:0/795422218 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0a5cb0 con 0x7fe0540d0160 2024-09-19T05:40:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 -- 172.21.15.67:0/795422218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0540d0160 msgr2=0x7fe0540d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 --2- 172.21.15.67:0/795422218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0540d0160 0x7fe0540d12f0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe0540b5f50 tx=0x7fe04c01c930 comp rx=0 tx=0).stop 2024-09-19T05:40:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 -- 172.21.15.67:0/795422218 shutdown_connections 2024-09-19T05:40:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 --2- 172.21.15.67:0/795422218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0540d0160 0x7fe0540d12f0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 --2- 172.21.15.67:0/795422218 >> v2:172.21.15.97:3300/0 conn(0x7fe054161da0 0x7fe0540d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 -- 172.21.15.67:0/795422218 >> 172.21.15.67:0/795422218 conn(0x7fe05408bfc0 msgr2=0x7fe0540d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 -- 172.21.15.67:0/795422218 shutdown_connections 2024-09-19T05:40:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 -- 172.21.15.67:0/795422218 wait complete. 2024-09-19T05:40:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 Processor -- start 2024-09-19T05:40:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 -- start start 2024-09-19T05:40:07.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0540d0160 0x7fe054158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0540d0e80 0x7fe0540cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe054161da0 0x7fe054154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe054162180 con 0x7fe054161da0 2024-09-19T05:40:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe0540b5d00 con 0x7fe0540d0e80 2024-09-19T05:40:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe058dfc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe0540b50e0 con 0x7fe0540d0160 2024-09-19T05:40:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe052d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe054161da0 0x7fe054154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe052d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe054161da0 0x7fe054154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59326/0 (socket says 172.21.15.67:59326) 2024-09-19T05:40:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe052d9d640 1 -- 172.21.15.67:0/1100649930 learned_addr learned my addr 172.21.15.67:0/1100649930 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:07.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe04bfff640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0540d0e80 0x7fe0540cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe05259c640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0540d0160 0x7fe054158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe052d9d640 1 -- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0540d0160 msgr2=0x7fe054158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe052d9d640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0540d0160 0x7fe054158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe052d9d640 1 -- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0540d0e80 msgr2=0x7fe0540cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe052d9d640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0540d0e80 0x7fe0540cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe052d9d640 1 -- 172.21.15.67:0/1100649930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0540cc9c0 con 0x7fe054161da0 2024-09-19T05:40:07.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.543+0000 7fe04bfff640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0540d0e80 0x7fe0540cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:07.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe052d9d640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe054161da0 0x7fe054154a30 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0b0040 tx=0x7fe04c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe04affd640 1 -- 172.21.15.67:0/1100649930 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0b2050 con 0x7fe054161da0 2024-09-19T05:40:07.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe04affd640 1 -- 172.21.15.67:0/1100649930 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c0be070 con 0x7fe054161da0 2024-09-19T05:40:07.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe04affd640 1 -- 172.21.15.67:0/1100649930 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0ada90 con 0x7fe054161da0 2024-09-19T05:40:07.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe058dfc640 1 -- 172.21.15.67:0/1100649930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0540ccca0 con 0x7fe054161da0 2024-09-19T05:40:07.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe058dfc640 1 -- 172.21.15.67:0/1100649930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0541401a0 con 0x7fe054161da0 2024-09-19T05:40:07.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe058dfc640 1 -- 172.21.15.67:0/1100649930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe054068ea0 con 0x7fe054161da0 2024-09-19T05:40:07.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe04affd640 1 -- 172.21.15.67:0/1100649930 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe04c0adc30 con 0x7fe054161da0 2024-09-19T05:40:07.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe04affd640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0340678c0 0x7fe034069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe04affd640 1 -- 172.21.15.67:0/1100649930 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7fe04c121190 con 0x7fe054161da0 2024-09-19T05:40:07.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe05259c640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0340678c0 0x7fe034069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.547+0000 7fe05259c640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0340678c0 0x7fe034069d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe0440096f0 tx=0x7fe044008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.551+0000 7fe04affd640 1 -- 172.21.15.67:0/1100649930 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe04c016520 con 0x7fe054161da0 2024-09-19T05:40:07.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.711+0000 7fe058dfc640 1 -- 172.21.15.67:0/1100649930 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0540b5470 con 0x7fe0340678c0 2024-09-19T05:40:07.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.731+0000 7fe04affd640 1 -- 172.21.15.67:0/1100649930 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7fe0540b5470 con 0x7fe0340678c0 2024-09-19T05:40:07.733 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:40:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:40:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 -- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0340678c0 msgr2=0x7fe034069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0340678c0 0x7fe034069d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe0440096f0 tx=0x7fe044008040 comp rx=0 tx=0).stop 2024-09-19T05:40:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 -- 172.21.15.67:0/1100649930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe054161da0 msgr2=0x7fe054154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe054161da0 0x7fe054154a30 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0b0040 tx=0x7fe04c0196d0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 -- 172.21.15.67:0/1100649930 shutdown_connections 2024-09-19T05:40:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe054161da0 0x7fe054154a30 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0540d0e80 0x7fe0540cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0340678c0 0x7fe034069d80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 --2- 172.21.15.67:0/1100649930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0540d0160 0x7fe054158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 -- 172.21.15.67:0/1100649930 >> 172.21.15.67:0/1100649930 conn(0x7fe05408bfc0 msgr2=0x7fe05415bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:07.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 -- 172.21.15.67:0/1100649930 shutdown_connections 2024-09-19T05:40:07.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.735+0000 7fe058dfc640 1 -- 172.21.15.67:0/1100649930 wait complete. 2024-09-19T05:40:07.753 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-19T05:40:07.248559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346612,"kb_used_data":12424,"kb_used_omap":12,"kb_used_meta":334003,"kb_avail":754628108,"statfs":{"total":773094113280,"available":772739182592,"internally_reserved":0,"allocated":12722176,"data_stored":6581116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":342019633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.495442"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393394+0000","last_change":"2024-09-19T05:39:58.796586+0000","last_active":"2024-09-19T05:40:00.393394+0000","last_peered":"2024-09-19T05:40:00.393394+0000","last_clean":"2024-09-19T05:40:00.393394+0000","last_became_active":"2024-09-19T05:39:58.791956+0000","last_became_peered":"2024-09-19T05:39:58.791956+0000","last_unstale":"2024-09-19T05:40:00.393394+0000","last_undegraded":"2024-09-19T05:40:00.393394+0000","last_fullsized":"2024-09-19T05:40:00.393394+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:48.398460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393140+0000","last_change":"2024-09-19T05:39:58.775052+0000","last_active":"2024-09-19T05:40:00.393140+0000","last_peered":"2024-09-19T05:40:00.393140+0000","last_clean":"2024-09-19T05:40:00.393140+0000","last_became_active":"2024-09-19T05:39:58.774780+0000","last_became_peered":"2024-09-19T05:39:58.774780+0000","last_unstale":"2024-09-19T05:40:00.393140+0000","last_undegraded":"2024-09-19T05:40:00.393140+0000","last_fullsized":"2024-09-19T05:40:00.393140+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:40.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391877+0000","last_change":"2024-09-19T05:39:58.779092+0000","last_active":"2024-09-19T05:40:00.391877+0000","last_peered":"2024-09-19T05:40:00.391877+0000","last_clean":"2024-09-19T05:40:00.391877+0000","last_became_active":"2024-09-19T05:39:58.778659+0000","last_became_peered":"2024-09-19T05:39:58.778659+0000","last_unstale":"2024-09-19T05:40:00.391877+0000","last_undegraded":"2024-09-19T05:40:00.391877+0000","last_fullsized":"2024-09-19T05:40:00.391877+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:58.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173081+0000","last_change":"2024-09-19T05:39:58.790340+0000","last_active":"2024-09-19T05:40:00.173081+0000","last_peered":"2024-09-19T05:40:00.173081+0000","last_clean":"2024-09-19T05:40:00.173081+0000","last_became_active":"2024-09-19T05:39:58.789762+0000","last_became_peered":"2024-09-19T05:39:58.789762+0000","last_unstale":"2024-09-19T05:40:00.173081+0000","last_undegraded":"2024-09-19T05:40:00.173081+0000","last_fullsized":"2024-09-19T05:40:00.173081+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:14.979906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392286+0000","last_change":"2024-09-19T05:39:58.804771+0000","last_active":"2024-09-19T05:40:00.392286+0000","last_peered":"2024-09-19T05:40:00.392286+0000","last_clean":"2024-09-19T05:40:00.392286+0000","last_became_active":"2024-09-19T05:39:58.799469+0000","last_became_peered":"2024-09-19T05:39:58.799469+0000","last_unstale":"2024-09-19T05:40:00.392286+0000","last_undegraded":"2024-09-19T05:40:00.392286+0000","last_fullsized":"2024-09-19T05:40:00.392286+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:03.459739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390069+0000","last_change":"2024-09-19T05:39:58.814170+0000","last_active":"2024-09-19T05:40:00.390069+0000","last_peered":"2024-09-19T05:40:00.390069+0000","last_clean":"2024-09-19T05:40:00.390069+0000","last_became_active":"2024-09-19T05:39:58.813903+0000","last_became_peered":"2024-09-19T05:39:58.813903+0000","last_unstale":"2024-09-19T05:40:00.390069+0000","last_undegraded":"2024-09-19T05:40:00.390069+0000","last_fullsized":"2024-09-19T05:40:00.390069+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:31.278078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.389572+0000","last_change":"2024-09-19T05:39:58.810365+0000","last_active":"2024-09-19T05:40:00.389572+0000","last_peered":"2024-09-19T05:40:00.389572+0000","last_clean":"2024-09-19T05:40:00.389572+0000","last_became_active":"2024-09-19T05:39:58.810073+0000","last_became_peered":"2024-09-19T05:39:58.810073+0000","last_unstale":"2024-09-19T05:40:00.389572+0000","last_undegraded":"2024-09-19T05:40:00.389572+0000","last_fullsized":"2024-09-19T05:40:00.389572+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:41.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756831+0000","last_change":"2024-09-19T05:39:58.785203+0000","last_active":"2024-09-19T05:39:59.756831+0000","last_peered":"2024-09-19T05:39:59.756831+0000","last_clean":"2024-09-19T05:39:59.756831+0000","last_became_active":"2024-09-19T05:39:58.784760+0000","last_became_peered":"2024-09-19T05:39:58.784760+0000","last_unstale":"2024-09-19T05:39:59.756831+0000","last_undegraded":"2024-09-19T05:39:59.756831+0000","last_fullsized":"2024-09-19T05:39:59.756831+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:31.076251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393358+0000","last_change":"2024-09-19T05:39:58.781763+0000","last_active":"2024-09-19T05:40:00.393358+0000","last_peered":"2024-09-19T05:40:00.393358+0000","last_clean":"2024-09-19T05:40:00.393358+0000","last_became_active":"2024-09-19T05:39:58.781465+0000","last_became_peered":"2024-09-19T05:39:58.781465+0000","last_unstale":"2024-09-19T05:40:00.393358+0000","last_undegraded":"2024-09-19T05:40:00.393358+0000","last_fullsized":"2024-09-19T05:40:00.393358+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:00.318329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393684+0000","last_change":"2024-09-19T05:39:58.811015+0000","last_active":"2024-09-19T05:40:00.393684+0000","last_peered":"2024-09-19T05:40:00.393684+0000","last_clean":"2024-09-19T05:40:00.393684+0000","last_became_active":"2024-09-19T05:39:58.809748+0000","last_became_peered":"2024-09-19T05:39:58.809748+0000","last_unstale":"2024-09-19T05:40:00.393684+0000","last_undegraded":"2024-09-19T05:40:00.393684+0000","last_fullsized":"2024-09-19T05:40:00.393684+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:20.019143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392792+0000","last_change":"2024-09-19T05:39:58.772242+0000","last_active":"2024-09-19T05:40:00.392792+0000","last_peered":"2024-09-19T05:40:00.392792+0000","last_clean":"2024-09-19T05:40:00.392792+0000","last_became_active":"2024-09-19T05:39:58.771930+0000","last_became_peered":"2024-09-19T05:39:58.771930+0000","last_unstale":"2024-09-19T05:40:00.392792+0000","last_undegraded":"2024-09-19T05:40:00.392792+0000","last_fullsized":"2024-09-19T05:40:00.392792+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:59.269174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761546+0000","last_change":"2024-09-19T05:39:58.786966+0000","last_active":"2024-09-19T05:39:59.761546+0000","last_peered":"2024-09-19T05:39:59.761546+0000","last_clean":"2024-09-19T05:39:59.761546+0000","last_became_active":"2024-09-19T05:39:58.786557+0000","last_became_peered":"2024-09-19T05:39:58.786557+0000","last_unstale":"2024-09-19T05:39:59.761546+0000","last_undegraded":"2024-09-19T05:39:59.761546+0000","last_fullsized":"2024-09-19T05:39:59.761546+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:14.569880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172768+0000","last_change":"2024-09-19T05:39:58.784695+0000","last_active":"2024-09-19T05:40:00.172768+0000","last_peered":"2024-09-19T05:40:00.172768+0000","last_clean":"2024-09-19T05:40:00.172768+0000","last_became_active":"2024-09-19T05:39:58.784280+0000","last_became_peered":"2024-09-19T05:39:58.784280+0000","last_unstale":"2024-09-19T05:40:00.172768+0000","last_undegraded":"2024-09-19T05:40:00.172768+0000","last_fullsized":"2024-09-19T05:40:00.172768+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:30.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390315+0000","last_change":"2024-09-19T05:39:58.785768+0000","last_active":"2024-09-19T05:40:00.390315+0000","last_peered":"2024-09-19T05:40:00.390315+0000","last_clean":"2024-09-19T05:40:00.390315+0000","last_became_active":"2024-09-19T05:39:58.785462+0000","last_became_peered":"2024-09-19T05:39:58.785462+0000","last_unstale":"2024-09-19T05:40:00.390315+0000","last_undegraded":"2024-09-19T05:40:00.390315+0000","last_fullsized":"2024-09-19T05:40:00.390315+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:52.994940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390966+0000","last_change":"2024-09-19T05:39:58.774634+0000","last_active":"2024-09-19T05:40:00.390966+0000","last_peered":"2024-09-19T05:40:00.390966+0000","last_clean":"2024-09-19T05:40:00.390966+0000","last_became_active":"2024-09-19T05:39:58.774325+0000","last_became_peered":"2024-09-19T05:39:58.774325+0000","last_unstale":"2024-09-19T05:40:00.390966+0000","last_undegraded":"2024-09-19T05:40:00.390966+0000","last_fullsized":"2024-09-19T05:40:00.390966+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:56.769969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390500+0000","last_change":"2024-09-19T05:39:58.773974+0000","last_active":"2024-09-19T05:40:00.390500+0000","last_peered":"2024-09-19T05:40:00.390500+0000","last_clean":"2024-09-19T05:40:00.390500+0000","last_became_active":"2024-09-19T05:39:58.771917+0000","last_became_peered":"2024-09-19T05:39:58.771917+0000","last_unstale":"2024-09-19T05:40:00.390500+0000","last_undegraded":"2024-09-19T05:40:00.390500+0000","last_fullsized":"2024-09-19T05:40:00.390500+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:30.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393082+0000","last_change":"2024-09-19T05:39:58.779348+0000","last_active":"2024-09-19T05:40:00.393082+0000","last_peered":"2024-09-19T05:40:00.393082+0000","last_clean":"2024-09-19T05:40:00.393082+0000","last_became_active":"2024-09-19T05:39:58.774126+0000","last_became_peered":"2024-09-19T05:39:58.774126+0000","last_unstale":"2024-09-19T05:40:00.393082+0000","last_undegraded":"2024-09-19T05:40:00.393082+0000","last_fullsized":"2024-09-19T05:40:00.393082+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:07.882835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393238+0000","last_change":"2024-09-19T05:39:58.804577+0000","last_active":"2024-09-19T05:40:00.393238+0000","last_peered":"2024-09-19T05:40:00.393238+0000","last_clean":"2024-09-19T05:40:00.393238+0000","last_became_active":"2024-09-19T05:39:58.804293+0000","last_became_peered":"2024-09-19T05:39:58.804293+0000","last_unstale":"2024-09-19T05:40:00.393238+0000","last_undegraded":"2024-09-19T05:40:00.393238+0000","last_fullsized":"2024-09-19T05:40:00.393238+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:03.459739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392164+0000","last_change":"2024-09-19T05:39:58.797053+0000","last_active":"2024-09-19T05:40:00.392164+0000","last_peered":"2024-09-19T05:40:00.392164+0000","last_clean":"2024-09-19T05:40:00.392164+0000","last_became_active":"2024-09-19T05:39:58.791887+0000","last_became_peered":"2024-09-19T05:39:58.791887+0000","last_unstale":"2024-09-19T05:40:00.392164+0000","last_undegraded":"2024-09-19T05:40:00.392164+0000","last_fullsized":"2024-09-19T05:40:00.392164+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:32.704910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.762051+0000","last_change":"2024-09-19T05:39:58.786636+0000","last_active":"2024-09-19T05:39:59.762051+0000","last_peered":"2024-09-19T05:39:59.762051+0000","last_clean":"2024-09-19T05:39:59.762051+0000","last_became_active":"2024-09-19T05:39:58.784899+0000","last_became_peered":"2024-09-19T05:39:58.784899+0000","last_unstale":"2024-09-19T05:39:59.762051+0000","last_undegraded":"2024-09-19T05:39:59.762051+0000","last_fullsized":"2024-09-19T05:39:59.762051+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:56.540706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756910+0000","last_change":"2024-09-19T05:39:58.768928+0000","last_active":"2024-09-19T05:39:59.756910+0000","last_peered":"2024-09-19T05:39:59.756910+0000","last_clean":"2024-09-19T05:39:59.756910+0000","last_became_active":"2024-09-19T05:39:58.768491+0000","last_became_peered":"2024-09-19T05:39:58.768491+0000","last_unstale":"2024-09-19T05:39:59.756910+0000","last_undegraded":"2024-09-19T05:39:59.756910+0000","last_fullsized":"2024-09-19T05:39:59.756910+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:09.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393395+0000","last_change":"2024-09-19T05:39:58.809896+0000","last_active":"2024-09-19T05:40:00.393395+0000","last_peered":"2024-09-19T05:40:00.393395+0000","last_clean":"2024-09-19T05:40:00.393395+0000","last_became_active":"2024-09-19T05:39:58.805345+0000","last_became_peered":"2024-09-19T05:39:58.805345+0000","last_unstale":"2024-09-19T05:40:00.393395+0000","last_undegraded":"2024-09-19T05:40:00.393395+0000","last_fullsized":"2024-09-19T05:40:00.393395+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:48.640047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391726+0000","last_change":"2024-09-19T05:39:58.777779+0000","last_active":"2024-09-19T05:40:00.391726+0000","last_peered":"2024-09-19T05:40:00.391726+0000","last_clean":"2024-09-19T05:40:00.391726+0000","last_became_active":"2024-09-19T05:39:58.773521+0000","last_became_peered":"2024-09-19T05:39:58.773521+0000","last_unstale":"2024-09-19T05:40:00.391726+0000","last_undegraded":"2024-09-19T05:40:00.391726+0000","last_fullsized":"2024-09-19T05:40:00.391726+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:53.395037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391235+0000","last_change":"2024-09-19T05:39:58.810690+0000","last_active":"2024-09-19T05:40:00.391235+0000","last_peered":"2024-09-19T05:40:00.391235+0000","last_clean":"2024-09-19T05:40:00.391235+0000","last_became_active":"2024-09-19T05:39:58.810100+0000","last_became_peered":"2024-09-19T05:39:58.810100+0000","last_unstale":"2024-09-19T05:40:00.391235+0000","last_undegraded":"2024-09-19T05:40:00.391235+0000","last_fullsized":"2024-09-19T05:40:00.391235+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:40.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.762115+0000","last_change":"2024-09-19T05:39:58.780852+0000","last_active":"2024-09-19T05:39:59.762115+0000","last_peered":"2024-09-19T05:39:59.762115+0000","last_clean":"2024-09-19T05:39:59.762115+0000","last_became_active":"2024-09-19T05:39:58.780547+0000","last_became_peered":"2024-09-19T05:39:58.780547+0000","last_unstale":"2024-09-19T05:39:59.762115+0000","last_undegraded":"2024-09-19T05:39:59.762115+0000","last_fullsized":"2024-09-19T05:39:59.762115+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:40.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.762112+0000","last_change":"2024-09-19T05:39:58.784030+0000","last_active":"2024-09-19T05:39:59.762112+0000","last_peered":"2024-09-19T05:39:59.762112+0000","last_clean":"2024-09-19T05:39:59.762112+0000","last_became_active":"2024-09-19T05:39:58.780838+0000","last_became_peered":"2024-09-19T05:39:58.780838+0000","last_unstale":"2024-09-19T05:39:59.762112+0000","last_undegraded":"2024-09-19T05:39:59.762112+0000","last_fullsized":"2024-09-19T05:39:59.762112+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:24.825465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392888+0000","last_change":"2024-09-19T05:39:58.776172+0000","last_active":"2024-09-19T05:40:00.392888+0000","last_peered":"2024-09-19T05:40:00.392888+0000","last_clean":"2024-09-19T05:40:00.392888+0000","last_became_active":"2024-09-19T05:39:58.775856+0000","last_became_peered":"2024-09-19T05:39:58.775856+0000","last_unstale":"2024-09-19T05:40:00.392888+0000","last_undegraded":"2024-09-19T05:40:00.392888+0000","last_fullsized":"2024-09-19T05:40:00.392888+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:37.353760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390072+0000","last_change":"2024-09-19T05:39:58.771174+0000","last_active":"2024-09-19T05:40:00.390072+0000","last_peered":"2024-09-19T05:40:00.390072+0000","last_clean":"2024-09-19T05:40:00.390072+0000","last_became_active":"2024-09-19T05:39:58.770897+0000","last_became_peered":"2024-09-19T05:39:58.770897+0000","last_unstale":"2024-09-19T05:40:00.390072+0000","last_undegraded":"2024-09-19T05:40:00.390072+0000","last_fullsized":"2024-09-19T05:40:00.390072+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:14.569880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757072+0000","last_change":"2024-09-19T05:39:58.777318+0000","last_active":"2024-09-19T05:39:59.757072+0000","last_peered":"2024-09-19T05:39:59.757072+0000","last_clean":"2024-09-19T05:39:59.757072+0000","last_became_active":"2024-09-19T05:39:58.776867+0000","last_became_peered":"2024-09-19T05:39:58.776867+0000","last_unstale":"2024-09-19T05:39:59.757072+0000","last_undegraded":"2024-09-19T05:39:59.757072+0000","last_fullsized":"2024-09-19T05:39:59.757072+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:05.234638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761375+0000","last_change":"2024-09-19T05:39:58.780376+0000","last_active":"2024-09-19T05:39:59.761375+0000","last_peered":"2024-09-19T05:39:59.761375+0000","last_clean":"2024-09-19T05:39:59.761375+0000","last_became_active":"2024-09-19T05:39:58.780007+0000","last_became_peered":"2024-09-19T05:39:58.780007+0000","last_unstale":"2024-09-19T05:39:59.761375+0000","last_undegraded":"2024-09-19T05:39:59.761375+0000","last_fullsized":"2024-09-19T05:39:59.761375+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:57.326361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.389996+0000","last_change":"2024-09-19T05:39:58.791308+0000","last_active":"2024-09-19T05:40:00.389996+0000","last_peered":"2024-09-19T05:40:00.389996+0000","last_clean":"2024-09-19T05:40:00.389996+0000","last_became_active":"2024-09-19T05:39:58.791011+0000","last_became_peered":"2024-09-19T05:39:58.791011+0000","last_unstale":"2024-09-19T05:40:00.389996+0000","last_undegraded":"2024-09-19T05:40:00.389996+0000","last_fullsized":"2024-09-19T05:40:00.389996+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:57.326361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756984+0000","last_change":"2024-09-19T05:39:58.793981+0000","last_active":"2024-09-19T05:39:59.756984+0000","last_peered":"2024-09-19T05:39:59.756984+0000","last_clean":"2024-09-19T05:39:59.756984+0000","last_became_active":"2024-09-19T05:39:58.786019+0000","last_became_peered":"2024-09-19T05:39:58.786019+0000","last_unstale":"2024-09-19T05:39:59.756984+0000","last_undegraded":"2024-09-19T05:39:59.756984+0000","last_fullsized":"2024-09-19T05:39:59.756984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:11.742568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392508+0000","last_change":"2024-09-19T05:39:58.791060+0000","last_active":"2024-09-19T05:40:00.392508+0000","last_peered":"2024-09-19T05:40:00.392508+0000","last_clean":"2024-09-19T05:40:00.392508+0000","last_became_active":"2024-09-19T05:39:58.790362+0000","last_became_peered":"2024-09-19T05:39:58.790362+0000","last_unstale":"2024-09-19T05:40:00.392508+0000","last_undegraded":"2024-09-19T05:40:00.392508+0000","last_fullsized":"2024-09-19T05:40:00.392508+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:49.366416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"115'4","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173347+0000","last_change":"2024-09-19T05:39:57.781598+0000","last_active":"2024-09-19T05:40:00.173347+0000","last_peered":"2024-09-19T05:40:00.173347+0000","last_clean":"2024-09-19T05:40:00.173347+0000","last_became_active":"2024-09-19T05:39:57.781120+0000","last_became_peered":"2024-09-19T05:39:57.781120+0000","last_unstale":"2024-09-19T05:40:00.173347+0000","last_undegraded":"2024-09-19T05:40:00.173347+0000","last_fullsized":"2024-09-19T05:40:00.173347+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:19.014788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757042+0000","last_change":"2024-09-19T05:39:58.785424+0000","last_active":"2024-09-19T05:39:59.757042+0000","last_peered":"2024-09-19T05:39:59.757042+0000","last_clean":"2024-09-19T05:39:59.757042+0000","last_became_active":"2024-09-19T05:39:58.785009+0000","last_became_peered":"2024-09-19T05:39:58.785009+0000","last_unstale":"2024-09-19T05:39:59.757042+0000","last_undegraded":"2024-09-19T05:39:59.757042+0000","last_fullsized":"2024-09-19T05:39:59.757042+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:14.824320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.758178+0000","last_change":"2024-09-19T05:39:57.770887+0000","last_active":"2024-09-19T05:39:59.758178+0000","last_peered":"2024-09-19T05:39:59.758178+0000","last_clean":"2024-09-19T05:39:59.758178+0000","last_became_active":"2024-09-19T05:39:57.769563+0000","last_became_peered":"2024-09-19T05:39:57.769563+0000","last_unstale":"2024-09-19T05:39:59.758178+0000","last_undegraded":"2024-09-19T05:39:59.758178+0000","last_fullsized":"2024-09-19T05:39:59.758178+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:46.442085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761741+0000","last_change":"2024-09-19T05:39:58.784923+0000","last_active":"2024-09-19T05:39:59.761741+0000","last_peered":"2024-09-19T05:39:59.761741+0000","last_clean":"2024-09-19T05:39:59.761741+0000","last_became_active":"2024-09-19T05:39:58.784607+0000","last_became_peered":"2024-09-19T05:39:58.784607+0000","last_unstale":"2024-09-19T05:39:59.761741+0000","last_undegraded":"2024-09-19T05:39:59.761741+0000","last_fullsized":"2024-09-19T05:39:59.761741+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:31.278078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761152+0000","last_change":"2024-09-19T05:39:57.784292+0000","last_active":"2024-09-19T05:39:59.761152+0000","last_peered":"2024-09-19T05:39:59.761152+0000","last_clean":"2024-09-19T05:39:59.761152+0000","last_became_active":"2024-09-19T05:39:57.783570+0000","last_became_peered":"2024-09-19T05:39:57.783570+0000","last_unstale":"2024-09-19T05:39:59.761152+0000","last_undegraded":"2024-09-19T05:39:59.761152+0000","last_fullsized":"2024-09-19T05:39:59.761152+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:18.718516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391862+0000","last_change":"2024-09-19T05:39:58.782226+0000","last_active":"2024-09-19T05:40:00.391862+0000","last_peered":"2024-09-19T05:40:00.391862+0000","last_clean":"2024-09-19T05:40:00.391862+0000","last_became_active":"2024-09-19T05:39:58.781964+0000","last_became_peered":"2024-09-19T05:39:58.781964+0000","last_unstale":"2024-09-19T05:40:00.391862+0000","last_undegraded":"2024-09-19T05:40:00.391862+0000","last_fullsized":"2024-09-19T05:40:00.391862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.710106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393325+0000","last_change":"2024-09-19T05:39:57.774005+0000","last_active":"2024-09-19T05:40:00.393325+0000","last_peered":"2024-09-19T05:40:00.393325+0000","last_clean":"2024-09-19T05:40:00.393325+0000","last_became_active":"2024-09-19T05:39:57.773649+0000","last_became_peered":"2024-09-19T05:39:57.773649+0000","last_unstale":"2024-09-19T05:40:00.393325+0000","last_undegraded":"2024-09-19T05:40:00.393325+0000","last_fullsized":"2024-09-19T05:40:00.393325+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:42.781599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173298+0000","last_change":"2024-09-19T05:39:58.789096+0000","last_active":"2024-09-19T05:40:00.173298+0000","last_peered":"2024-09-19T05:40:00.173298+0000","last_clean":"2024-09-19T05:40:00.173298+0000","last_became_active":"2024-09-19T05:39:58.788556+0000","last_became_peered":"2024-09-19T05:39:58.788556+0000","last_unstale":"2024-09-19T05:40:00.173298+0000","last_undegraded":"2024-09-19T05:40:00.173298+0000","last_fullsized":"2024-09-19T05:40:00.173298+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:31.788519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391589+0000","last_change":"2024-09-19T05:39:57.788827+0000","last_active":"2024-09-19T05:40:00.391589+0000","last_peered":"2024-09-19T05:40:00.391589+0000","last_clean":"2024-09-19T05:40:00.391589+0000","last_became_active":"2024-09-19T05:39:57.788203+0000","last_became_peered":"2024-09-19T05:39:57.788203+0000","last_unstale":"2024-09-19T05:40:00.391589+0000","last_undegraded":"2024-09-19T05:40:00.391589+0000","last_fullsized":"2024-09-19T05:40:00.391589+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.042348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392916+0000","last_change":"2024-09-19T05:39:58.797503+0000","last_active":"2024-09-19T05:40:00.392916+0000","last_peered":"2024-09-19T05:40:00.392916+0000","last_clean":"2024-09-19T05:40:00.392916+0000","last_became_active":"2024-09-19T05:39:58.792554+0000","last_became_peered":"2024-09-19T05:39:58.792554+0000","last_unstale":"2024-09-19T05:40:00.392916+0000","last_undegraded":"2024-09-19T05:40:00.392916+0000","last_fullsized":"2024-09-19T05:40:00.392916+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:27.961945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390969+0000","last_change":"2024-09-19T05:39:57.781182+0000","last_active":"2024-09-19T05:40:00.390969+0000","last_peered":"2024-09-19T05:40:00.390969+0000","last_clean":"2024-09-19T05:40:00.390969+0000","last_became_active":"2024-09-19T05:39:57.780473+0000","last_became_peered":"2024-09-19T05:39:57.780473+0000","last_unstale":"2024-09-19T05:40:00.390969+0000","last_undegraded":"2024-09-19T05:40:00.390969+0000","last_fullsized":"2024-09-19T05:40:00.390969+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:24.189507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393566+0000","last_change":"2024-09-19T05:39:58.770354+0000","last_active":"2024-09-19T05:40:00.393566+0000","last_peered":"2024-09-19T05:40:00.393566+0000","last_clean":"2024-09-19T05:40:00.393566+0000","last_became_active":"2024-09-19T05:39:58.769994+0000","last_became_peered":"2024-09-19T05:39:58.769994+0000","last_unstale":"2024-09-19T05:40:00.393566+0000","last_undegraded":"2024-09-19T05:40:00.393566+0000","last_fullsized":"2024-09-19T05:40:00.393566+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:47.082669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.760721+0000","last_change":"2024-09-19T05:39:57.794715+0000","last_active":"2024-09-19T05:39:59.760721+0000","last_peered":"2024-09-19T05:39:59.760721+0000","last_clean":"2024-09-19T05:39:59.760721+0000","last_became_active":"2024-09-19T05:39:57.793933+0000","last_became_peered":"2024-09-19T05:39:57.793933+0000","last_unstale":"2024-09-19T05:39:59.760721+0000","last_undegraded":"2024-09-19T05:39:59.760721+0000","last_fullsized":"2024-09-19T05:39:59.760721+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:54.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.173430+0000","last_change":"2024-09-19T05:39:58.794916+0000","last_active":"2024-09-19T05:40:00.173430+0000","last_peered":"2024-09-19T05:40:00.173430+0000","last_clean":"2024-09-19T05:40:00.173430+0000","last_became_active":"2024-09-19T05:39:58.791104+0000","last_became_peered":"2024-09-19T05:39:58.791104+0000","last_unstale":"2024-09-19T05:40:00.173430+0000","last_undegraded":"2024-09-19T05:40:00.173430+0000","last_fullsized":"2024-09-19T05:40:00.173430+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:37.439578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172301+0000","last_change":"2024-09-19T05:39:57.765227+0000","last_active":"2024-09-19T05:40:00.172301+0000","last_peered":"2024-09-19T05:40:00.172301+0000","last_clean":"2024-09-19T05:40:00.172301+0000","last_became_active":"2024-09-19T05:39:57.764688+0000","last_became_peered":"2024-09-19T05:39:57.764688+0000","last_unstale":"2024-09-19T05:40:00.172301+0000","last_undegraded":"2024-09-19T05:40:00.172301+0000","last_fullsized":"2024-09-19T05:40:00.172301+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:46.078315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392065+0000","last_change":"2024-09-19T05:39:58.802896+0000","last_active":"2024-09-19T05:40:00.392065+0000","last_peered":"2024-09-19T05:40:00.392065+0000","last_clean":"2024-09-19T05:40:00.392065+0000","last_became_active":"2024-09-19T05:39:58.792481+0000","last_became_peered":"2024-09-19T05:39:58.792481+0000","last_unstale":"2024-09-19T05:40:00.392065+0000","last_undegraded":"2024-09-19T05:40:00.392065+0000","last_fullsized":"2024-09-19T05:40:00.392065+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:48.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761861+0000","last_change":"2024-09-19T05:39:57.784748+0000","last_active":"2024-09-19T05:39:59.761861+0000","last_peered":"2024-09-19T05:39:59.761861+0000","last_clean":"2024-09-19T05:39:59.761861+0000","last_became_active":"2024-09-19T05:39:57.783243+0000","last_became_peered":"2024-09-19T05:39:57.783243+0000","last_unstale":"2024-09-19T05:39:59.761861+0000","last_undegraded":"2024-09-19T05:39:59.761861+0000","last_fullsized":"2024-09-19T05:39:59.761861+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:18.059390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392829+0000","last_change":"2024-09-19T05:39:58.782763+0000","last_active":"2024-09-19T05:40:00.392829+0000","last_peered":"2024-09-19T05:40:00.392829+0000","last_clean":"2024-09-19T05:40:00.392829+0000","last_became_active":"2024-09-19T05:39:58.782316+0000","last_became_peered":"2024-09-19T05:39:58.782316+0000","last_unstale":"2024-09-19T05:40:00.392829+0000","last_undegraded":"2024-09-19T05:40:00.392829+0000","last_fullsized":"2024-09-19T05:40:00.392829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:21.923650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392163+0000","last_change":"2024-09-19T05:39:57.785900+0000","last_active":"2024-09-19T05:40:00.392163+0000","last_peered":"2024-09-19T05:40:00.392163+0000","last_clean":"2024-09-19T05:40:00.392163+0000","last_became_active":"2024-09-19T05:39:57.785546+0000","last_became_peered":"2024-09-19T05:39:57.785546+0000","last_unstale":"2024-09-19T05:40:00.392163+0000","last_undegraded":"2024-09-19T05:40:00.392163+0000","last_fullsized":"2024-09-19T05:40:00.392163+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:25.148091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756813+0000","last_change":"2024-09-19T05:39:58.811363+0000","last_active":"2024-09-19T05:39:59.756813+0000","last_peered":"2024-09-19T05:39:59.756813+0000","last_clean":"2024-09-19T05:39:59.756813+0000","last_became_active":"2024-09-19T05:39:58.810294+0000","last_became_peered":"2024-09-19T05:39:58.810294+0000","last_unstale":"2024-09-19T05:39:59.756813+0000","last_undegraded":"2024-09-19T05:39:59.756813+0000","last_fullsized":"2024-09-19T05:39:59.756813+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:10.448889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"115'3","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390943+0000","last_change":"2024-09-19T05:39:57.776395+0000","last_active":"2024-09-19T05:40:00.390943+0000","last_peered":"2024-09-19T05:40:00.390943+0000","last_clean":"2024-09-19T05:40:00.390943+0000","last_became_active":"2024-09-19T05:39:57.775694+0000","last_became_peered":"2024-09-19T05:39:57.775694+0000","last_unstale":"2024-09-19T05:40:00.390943+0000","last_undegraded":"2024-09-19T05:40:00.390943+0000","last_fullsized":"2024-09-19T05:40:00.390943+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:19.014788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392733+0000","last_change":"2024-09-19T05:39:58.800510+0000","last_active":"2024-09-19T05:40:00.392733+0000","last_peered":"2024-09-19T05:40:00.392733+0000","last_clean":"2024-09-19T05:40:00.392733+0000","last_became_active":"2024-09-19T05:39:58.783972+0000","last_became_peered":"2024-09-19T05:39:58.783972+0000","last_unstale":"2024-09-19T05:40:00.392733+0000","last_undegraded":"2024-09-19T05:40:00.392733+0000","last_fullsized":"2024-09-19T05:40:00.392733+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:47.082669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"115'6","reported_seq":20,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392117+0000","last_change":"2024-09-19T05:39:57.781959+0000","last_active":"2024-09-19T05:40:00.392117+0000","last_peered":"2024-09-19T05:40:00.392117+0000","last_clean":"2024-09-19T05:40:00.392117+0000","last_became_active":"2024-09-19T05:39:57.781166+0000","last_became_peered":"2024-09-19T05:39:57.781166+0000","last_unstale":"2024-09-19T05:40:00.392117+0000","last_undegraded":"2024-09-19T05:40:00.392117+0000","last_fullsized":"2024-09-19T05:40:00.392117+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:52.355948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391628+0000","last_change":"2024-09-19T05:39:58.790541+0000","last_active":"2024-09-19T05:40:00.391628+0000","last_peered":"2024-09-19T05:40:00.391628+0000","last_clean":"2024-09-19T05:40:00.391628+0000","last_became_active":"2024-09-19T05:39:58.790331+0000","last_became_peered":"2024-09-19T05:39:58.790331+0000","last_unstale":"2024-09-19T05:40:00.391628+0000","last_undegraded":"2024-09-19T05:40:00.391628+0000","last_fullsized":"2024-09-19T05:40:00.391628+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:42.796958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392515+0000","last_change":"2024-09-19T05:39:57.767610+0000","last_active":"2024-09-19T05:40:00.392515+0000","last_peered":"2024-09-19T05:40:00.392515+0000","last_clean":"2024-09-19T05:40:00.392515+0000","last_became_active":"2024-09-19T05:39:57.767330+0000","last_became_peered":"2024-09-19T05:39:57.767330+0000","last_unstale":"2024-09-19T05:40:00.392515+0000","last_undegraded":"2024-09-19T05:40:00.392515+0000","last_fullsized":"2024-09-19T05:40:00.392515+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:26.264660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393099+0000","last_change":"2024-09-19T05:39:58.781712+0000","last_active":"2024-09-19T05:40:00.393099+0000","last_peered":"2024-09-19T05:40:00.393099+0000","last_clean":"2024-09-19T05:40:00.393099+0000","last_became_active":"2024-09-19T05:39:58.781395+0000","last_became_peered":"2024-09-19T05:39:58.781395+0000","last_unstale":"2024-09-19T05:40:00.393099+0000","last_undegraded":"2024-09-19T05:40:00.393099+0000","last_fullsized":"2024-09-19T05:40:00.393099+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:24.825465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172794+0000","last_change":"2024-09-19T05:39:57.774297+0000","last_active":"2024-09-19T05:40:00.172794+0000","last_peered":"2024-09-19T05:40:00.172794+0000","last_clean":"2024-09-19T05:40:00.172794+0000","last_became_active":"2024-09-19T05:39:57.773905+0000","last_became_peered":"2024-09-19T05:39:57.773905+0000","last_unstale":"2024-09-19T05:40:00.172794+0000","last_undegraded":"2024-09-19T05:40:00.172794+0000","last_fullsized":"2024-09-19T05:40:00.172794+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:20.919296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.758047+0000","last_change":"2024-09-19T05:39:58.771968+0000","last_active":"2024-09-19T05:39:59.758047+0000","last_peered":"2024-09-19T05:39:59.758047+0000","last_clean":"2024-09-19T05:39:59.758047+0000","last_became_active":"2024-09-19T05:39:58.771416+0000","last_became_peered":"2024-09-19T05:39:58.771416+0000","last_unstale":"2024-09-19T05:39:59.758047+0000","last_undegraded":"2024-09-19T05:39:59.758047+0000","last_fullsized":"2024-09-19T05:39:59.758047+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:45.305142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757181+0000","last_change":"2024-09-19T05:39:57.762647+0000","last_active":"2024-09-19T05:39:59.757181+0000","last_peered":"2024-09-19T05:39:59.757181+0000","last_clean":"2024-09-19T05:39:59.757181+0000","last_became_active":"2024-09-19T05:39:57.762197+0000","last_became_peered":"2024-09-19T05:39:57.762197+0000","last_unstale":"2024-09-19T05:39:59.757181+0000","last_undegraded":"2024-09-19T05:39:59.757181+0000","last_fullsized":"2024-09-19T05:39:59.757181+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:59:37.135662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393495+0000","last_change":"2024-09-19T05:39:58.774450+0000","last_active":"2024-09-19T05:40:00.393495+0000","last_peered":"2024-09-19T05:40:00.393495+0000","last_clean":"2024-09-19T05:40:00.393495+0000","last_became_active":"2024-09-19T05:39:58.773993+0000","last_became_peered":"2024-09-19T05:39:58.773993+0000","last_unstale":"2024-09-19T05:40:00.393495+0000","last_undegraded":"2024-09-19T05:40:00.393495+0000","last_fullsized":"2024-09-19T05:40:00.393495+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:45.203947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"115'8","reported_seq":22,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.760672+0000","last_change":"2024-09-19T05:39:57.793974+0000","last_active":"2024-09-19T05:39:59.760672+0000","last_peered":"2024-09-19T05:39:59.760672+0000","last_clean":"2024-09-19T05:39:59.760672+0000","last_became_active":"2024-09-19T05:39:57.784027+0000","last_became_peered":"2024-09-19T05:39:57.784027+0000","last_unstale":"2024-09-19T05:39:59.760672+0000","last_undegraded":"2024-09-19T05:39:59.760672+0000","last_fullsized":"2024-09-19T05:39:59.760672+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.438301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757274+0000","last_change":"2024-09-19T05:39:58.793654+0000","last_active":"2024-09-19T05:39:59.757274+0000","last_peered":"2024-09-19T05:39:59.757274+0000","last_clean":"2024-09-19T05:39:59.757274+0000","last_became_active":"2024-09-19T05:39:58.793203+0000","last_became_peered":"2024-09-19T05:39:58.793203+0000","last_unstale":"2024-09-19T05:39:59.757274+0000","last_undegraded":"2024-09-19T05:39:59.757274+0000","last_fullsized":"2024-09-19T05:39:59.757274+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:20.773571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393447+0000","last_change":"2024-09-19T05:39:57.801655+0000","last_active":"2024-09-19T05:40:00.393447+0000","last_peered":"2024-09-19T05:40:00.393447+0000","last_clean":"2024-09-19T05:40:00.393447+0000","last_became_active":"2024-09-19T05:39:57.800788+0000","last_became_peered":"2024-09-19T05:39:57.800788+0000","last_unstale":"2024-09-19T05:40:00.393447+0000","last_undegraded":"2024-09-19T05:40:00.393447+0000","last_fullsized":"2024-09-19T05:40:00.393447+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:18.059390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391845+0000","last_change":"2024-09-19T05:39:58.791293+0000","last_active":"2024-09-19T05:40:00.391845+0000","last_peered":"2024-09-19T05:40:00.391845+0000","last_clean":"2024-09-19T05:40:00.391845+0000","last_became_active":"2024-09-19T05:39:58.790974+0000","last_became_peered":"2024-09-19T05:39:58.790974+0000","last_unstale":"2024-09-19T05:40:00.391845+0000","last_undegraded":"2024-09-19T05:40:00.391845+0000","last_fullsized":"2024-09-19T05:40:00.391845+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:56.540706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"115'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391182+0000","last_change":"2024-09-19T05:39:57.796495+0000","last_active":"2024-09-19T05:40:00.391182+0000","last_peered":"2024-09-19T05:40:00.391182+0000","last_clean":"2024-09-19T05:40:00.391182+0000","last_became_active":"2024-09-19T05:39:57.795756+0000","last_became_peered":"2024-09-19T05:39:57.795756+0000","last_unstale":"2024-09-19T05:40:00.391182+0000","last_undegraded":"2024-09-19T05:40:00.391182+0000","last_fullsized":"2024-09-19T05:40:00.391182+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:55.677304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392352+0000","last_change":"2024-09-19T05:39:58.805143+0000","last_active":"2024-09-19T05:40:00.392352+0000","last_peered":"2024-09-19T05:40:00.392352+0000","last_clean":"2024-09-19T05:40:00.392352+0000","last_became_active":"2024-09-19T05:39:58.799609+0000","last_became_peered":"2024-09-19T05:39:58.799609+0000","last_unstale":"2024-09-19T05:40:00.392352+0000","last_undegraded":"2024-09-19T05:40:00.392352+0000","last_fullsized":"2024-09-19T05:40:00.392352+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:00.318329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391087+0000","last_change":"2024-09-19T05:39:57.786985+0000","last_active":"2024-09-19T05:40:00.391087+0000","last_peered":"2024-09-19T05:40:00.391087+0000","last_clean":"2024-09-19T05:40:00.391087+0000","last_became_active":"2024-09-19T05:39:57.786287+0000","last_became_peered":"2024-09-19T05:39:57.786287+0000","last_unstale":"2024-09-19T05:40:00.391087+0000","last_undegraded":"2024-09-19T05:40:00.391087+0000","last_fullsized":"2024-09-19T05:40:00.391087+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:58.394463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391990+0000","last_change":"2024-09-19T05:39:58.791721+0000","last_active":"2024-09-19T05:40:00.391990+0000","last_peered":"2024-09-19T05:40:00.391990+0000","last_clean":"2024-09-19T05:40:00.391990+0000","last_became_active":"2024-09-19T05:39:58.791302+0000","last_became_peered":"2024-09-19T05:39:58.791302+0000","last_unstale":"2024-09-19T05:40:00.391990+0000","last_undegraded":"2024-09-19T05:40:00.391990+0000","last_fullsized":"2024-09-19T05:40:00.391990+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:13.879938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757203+0000","last_change":"2024-09-19T05:39:57.768804+0000","last_active":"2024-09-19T05:39:59.757203+0000","last_peered":"2024-09-19T05:39:59.757203+0000","last_clean":"2024-09-19T05:39:59.757203+0000","last_became_active":"2024-09-19T05:39:57.766204+0000","last_became_peered":"2024-09-19T05:39:57.766204+0000","last_unstale":"2024-09-19T05:39:59.757203+0000","last_undegraded":"2024-09-19T05:39:59.757203+0000","last_fullsized":"2024-09-19T05:39:59.757203+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:21.950392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392286+0000","last_change":"2024-09-19T05:39:58.812215+0000","last_active":"2024-09-19T05:40:00.392286+0000","last_peered":"2024-09-19T05:40:00.392286+0000","last_clean":"2024-09-19T05:40:00.392286+0000","last_became_active":"2024-09-19T05:39:58.811797+0000","last_became_peered":"2024-09-19T05:39:58.811797+0000","last_unstale":"2024-09-19T05:40:00.392286+0000","last_undegraded":"2024-09-19T05:40:00.392286+0000","last_fullsized":"2024-09-19T05:40:00.392286+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:35.612170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756577+0000","last_change":"2024-09-19T05:39:57.768643+0000","last_active":"2024-09-19T05:39:59.756577+0000","last_peered":"2024-09-19T05:39:59.756577+0000","last_clean":"2024-09-19T05:39:59.756577+0000","last_became_active":"2024-09-19T05:39:57.768283+0000","last_became_peered":"2024-09-19T05:39:57.768283+0000","last_unstale":"2024-09-19T05:39:59.756577+0000","last_undegraded":"2024-09-19T05:39:59.756577+0000","last_fullsized":"2024-09-19T05:39:59.756577+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:53.640752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172932+0000","last_change":"2024-09-19T05:39:58.782116+0000","last_active":"2024-09-19T05:40:00.172932+0000","last_peered":"2024-09-19T05:40:00.172932+0000","last_clean":"2024-09-19T05:40:00.172932+0000","last_became_active":"2024-09-19T05:39:58.781446+0000","last_became_peered":"2024-09-19T05:39:58.781446+0000","last_unstale":"2024-09-19T05:40:00.172932+0000","last_undegraded":"2024-09-19T05:40:00.172932+0000","last_fullsized":"2024-09-19T05:40:00.172932+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:56.769969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390126+0000","last_change":"2024-09-19T05:39:57.784426+0000","last_active":"2024-09-19T05:40:00.390126+0000","last_peered":"2024-09-19T05:40:00.390126+0000","last_clean":"2024-09-19T05:40:00.390126+0000","last_became_active":"2024-09-19T05:39:57.778640+0000","last_became_peered":"2024-09-19T05:39:57.778640+0000","last_unstale":"2024-09-19T05:40:00.390126+0000","last_undegraded":"2024-09-19T05:40:00.390126+0000","last_fullsized":"2024-09-19T05:40:00.390126+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:36.343568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757927+0000","last_change":"2024-09-19T05:39:58.785360+0000","last_active":"2024-09-19T05:39:59.757927+0000","last_peered":"2024-09-19T05:39:59.757927+0000","last_clean":"2024-09-19T05:39:59.757927+0000","last_became_active":"2024-09-19T05:39:58.784635+0000","last_became_peered":"2024-09-19T05:39:58.784635+0000","last_unstale":"2024-09-19T05:39:59.757927+0000","last_undegraded":"2024-09-19T05:39:59.757927+0000","last_fullsized":"2024-09-19T05:39:59.757927+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:51.255162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757128+0000","last_change":"2024-09-19T05:39:57.772384+0000","last_active":"2024-09-19T05:39:59.757128+0000","last_peered":"2024-09-19T05:39:59.757128+0000","last_clean":"2024-09-19T05:39:59.757128+0000","last_became_active":"2024-09-19T05:39:57.771015+0000","last_became_peered":"2024-09-19T05:39:57.771015+0000","last_unstale":"2024-09-19T05:39:59.757128+0000","last_undegraded":"2024-09-19T05:39:59.757128+0000","last_fullsized":"2024-09-19T05:39:59.757128+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:00.454032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391642+0000","last_change":"2024-09-19T05:39:58.796706+0000","last_active":"2024-09-19T05:40:00.391642+0000","last_peered":"2024-09-19T05:40:00.391642+0000","last_clean":"2024-09-19T05:40:00.391642+0000","last_became_active":"2024-09-19T05:39:58.791959+0000","last_became_peered":"2024-09-19T05:39:58.791959+0000","last_unstale":"2024-09-19T05:40:00.391642+0000","last_undegraded":"2024-09-19T05:40:00.391642+0000","last_fullsized":"2024-09-19T05:40:00.391642+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:31.757723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392180+0000","last_change":"2024-09-19T05:39:57.772162+0000","last_active":"2024-09-19T05:40:00.392180+0000","last_peered":"2024-09-19T05:40:00.392180+0000","last_clean":"2024-09-19T05:40:00.392180+0000","last_became_active":"2024-09-19T05:39:57.771861+0000","last_became_peered":"2024-09-19T05:39:57.771861+0000","last_unstale":"2024-09-19T05:40:00.392180+0000","last_undegraded":"2024-09-19T05:40:00.392180+0000","last_fullsized":"2024-09-19T05:40:00.392180+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:38.476733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.760915+0000","last_change":"2024-09-19T05:39:58.787151+0000","last_active":"2024-09-19T05:39:59.760915+0000","last_peered":"2024-09-19T05:39:59.760915+0000","last_clean":"2024-09-19T05:39:59.760915+0000","last_became_active":"2024-09-19T05:39:58.786837+0000","last_became_peered":"2024-09-19T05:39:58.786837+0000","last_unstale":"2024-09-19T05:39:59.760915+0000","last_undegraded":"2024-09-19T05:39:59.760915+0000","last_fullsized":"2024-09-19T05:39:59.760915+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:41.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"116'1","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392602+0000","last_change":"2024-09-19T05:39:57.783978+0000","last_active":"2024-09-19T05:40:00.392602+0000","last_peered":"2024-09-19T05:40:00.392602+0000","last_clean":"2024-09-19T05:40:00.392602+0000","last_became_active":"2024-09-19T05:39:57.783626+0000","last_became_peered":"2024-09-19T05:39:57.783626+0000","last_unstale":"2024-09-19T05:40:00.392602+0000","last_undegraded":"2024-09-19T05:40:00.392602+0000","last_fullsized":"2024-09-19T05:40:00.392602+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:42.058437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.172691+0000","last_change":"2024-09-19T05:39:58.781283+0000","last_active":"2024-09-19T05:40:00.172691+0000","last_peered":"2024-09-19T05:40:00.172691+0000","last_clean":"2024-09-19T05:40:00.172691+0000","last_became_active":"2024-09-19T05:39:58.780771+0000","last_became_peered":"2024-09-19T05:39:58.780771+0000","last_unstale":"2024-09-19T05:40:00.172691+0000","last_undegraded":"2024-09-19T05:40:00.172691+0000","last_fullsized":"2024-09-19T05:40:00.172691+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:52.994940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392553+0000","last_change":"2024-09-19T05:39:57.781803+0000","last_active":"2024-09-19T05:40:00.392553+0000","last_peered":"2024-09-19T05:40:00.392553+0000","last_clean":"2024-09-19T05:40:00.392553+0000","last_became_active":"2024-09-19T05:39:57.780574+0000","last_became_peered":"2024-09-19T05:39:57.780574+0000","last_unstale":"2024-09-19T05:40:00.392553+0000","last_undegraded":"2024-09-19T05:40:00.392553+0000","last_fullsized":"2024-09-19T05:40:00.392553+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:52.923110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391439+0000","last_change":"2024-09-19T05:39:58.816078+0000","last_active":"2024-09-19T05:40:00.391439+0000","last_peered":"2024-09-19T05:40:00.391439+0000","last_clean":"2024-09-19T05:40:00.391439+0000","last_became_active":"2024-09-19T05:39:58.815844+0000","last_became_peered":"2024-09-19T05:39:58.815844+0000","last_unstale":"2024-09-19T05:40:00.391439+0000","last_undegraded":"2024-09-19T05:40:00.391439+0000","last_fullsized":"2024-09-19T05:40:00.391439+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:36.521051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393555+0000","last_change":"2024-09-19T05:39:57.778815+0000","last_active":"2024-09-19T05:40:00.393555+0000","last_peered":"2024-09-19T05:40:00.393555+0000","last_clean":"2024-09-19T05:40:00.393555+0000","last_became_active":"2024-09-19T05:39:57.778442+0000","last_became_peered":"2024-09-19T05:39:57.778442+0000","last_unstale":"2024-09-19T05:40:00.393555+0000","last_undegraded":"2024-09-19T05:40:00.393555+0000","last_fullsized":"2024-09-19T05:40:00.393555+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:39.719140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757765+0000","last_change":"2024-09-19T05:39:58.784849+0000","last_active":"2024-09-19T05:39:59.757765+0000","last_peered":"2024-09-19T05:39:59.757765+0000","last_clean":"2024-09-19T05:39:59.757765+0000","last_became_active":"2024-09-19T05:39:58.784403+0000","last_became_peered":"2024-09-19T05:39:58.784403+0000","last_unstale":"2024-09-19T05:39:59.757765+0000","last_undegraded":"2024-09-19T05:39:59.757765+0000","last_fullsized":"2024-09-19T05:39:59.757765+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:03.327092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.761415+0000","last_change":"2024-09-19T05:39:57.795587+0000","last_active":"2024-09-19T05:39:59.761415+0000","last_peered":"2024-09-19T05:39:59.761415+0000","last_clean":"2024-09-19T05:39:59.761415+0000","last_became_active":"2024-09-19T05:39:57.794286+0000","last_became_peered":"2024-09-19T05:39:57.794286+0000","last_unstale":"2024-09-19T05:39:59.761415+0000","last_undegraded":"2024-09-19T05:39:59.761415+0000","last_fullsized":"2024-09-19T05:39:59.761415+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:07.271962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757624+0000","last_change":"2024-09-19T05:39:58.784607+0000","last_active":"2024-09-19T05:39:59.757624+0000","last_peered":"2024-09-19T05:39:59.757624+0000","last_clean":"2024-09-19T05:39:59.757624+0000","last_became_active":"2024-09-19T05:39:58.784101+0000","last_became_peered":"2024-09-19T05:39:58.784101+0000","last_unstale":"2024-09-19T05:39:59.757624+0000","last_undegraded":"2024-09-19T05:39:59.757624+0000","last_fullsized":"2024-09-19T05:39:59.757624+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:17.234984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.756867+0000","last_change":"2024-09-19T05:39:57.777352+0000","last_active":"2024-09-19T05:39:59.756867+0000","last_peered":"2024-09-19T05:39:59.756867+0000","last_clean":"2024-09-19T05:39:59.756867+0000","last_became_active":"2024-09-19T05:39:57.776875+0000","last_became_peered":"2024-09-19T05:39:57.776875+0000","last_unstale":"2024-09-19T05:39:59.756867+0000","last_undegraded":"2024-09-19T05:39:59.756867+0000","last_fullsized":"2024-09-19T05:39:59.756867+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:44.433004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.391439+0000","last_change":"2024-09-19T05:39:58.775300+0000","last_active":"2024-09-19T05:40:00.391439+0000","last_peered":"2024-09-19T05:40:00.391439+0000","last_clean":"2024-09-19T05:40:00.391439+0000","last_became_active":"2024-09-19T05:39:58.774430+0000","last_became_peered":"2024-09-19T05:39:58.774430+0000","last_unstale":"2024-09-19T05:40:00.391439+0000","last_undegraded":"2024-09-19T05:40:00.391439+0000","last_fullsized":"2024-09-19T05:40:00.391439+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:14.979906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390369+0000","last_change":"2024-09-19T05:39:57.783783+0000","last_active":"2024-09-19T05:40:00.390369+0000","last_peered":"2024-09-19T05:40:00.390369+0000","last_clean":"2024-09-19T05:40:00.390369+0000","last_became_active":"2024-09-19T05:39:57.782574+0000","last_became_peered":"2024-09-19T05:39:57.782574+0000","last_unstale":"2024-09-19T05:40:00.390369+0000","last_undegraded":"2024-09-19T05:40:00.390369+0000","last_fullsized":"2024-09-19T05:40:00.390369+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.438301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.393903+0000","last_change":"2024-09-19T05:39:58.774808+0000","last_active":"2024-09-19T05:40:00.393903+0000","last_peered":"2024-09-19T05:40:00.393903+0000","last_clean":"2024-09-19T05:40:00.393903+0000","last_became_active":"2024-09-19T05:39:58.774517+0000","last_became_peered":"2024-09-19T05:39:58.774517+0000","last_unstale":"2024-09-19T05:40:00.393903+0000","last_undegraded":"2024-09-19T05:40:00.393903+0000","last_fullsized":"2024-09-19T05:40:00.393903+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:28.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.757385+0000","last_change":"2024-09-19T05:39:57.777349+0000","last_active":"2024-09-19T05:39:59.757385+0000","last_peered":"2024-09-19T05:39:59.757385+0000","last_clean":"2024-09-19T05:39:59.757385+0000","last_became_active":"2024-09-19T05:39:57.776903+0000","last_became_peered":"2024-09-19T05:39:57.776903+0000","last_unstale":"2024-09-19T05:39:59.757385+0000","last_undegraded":"2024-09-19T05:39:59.757385+0000","last_fullsized":"2024-09-19T05:39:59.757385+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:12.523574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.392258+0000","last_change":"2024-09-19T05:39:58.774834+0000","last_active":"2024-09-19T05:40:00.392258+0000","last_peered":"2024-09-19T05:40:00.392258+0000","last_clean":"2024-09-19T05:40:00.392258+0000","last_became_active":"2024-09-19T05:39:58.774465+0000","last_became_peered":"2024-09-19T05:39:58.774465+0000","last_unstale":"2024-09-19T05:40:00.392258+0000","last_undegraded":"2024-09-19T05:40:00.392258+0000","last_fullsized":"2024-09-19T05:40:00.392258+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:57.737905+0000","last_clean_scrub_stamp":"2024-09-19T05:39:57.737905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:04.632793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"115'2","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:39:59.758443+0000","last_change":"2024-09-19T05:39:57.773272+0000","last_active":"2024-09-19T05:39:59.758443+0000","last_peered":"2024-09-19T05:39:59.758443+0000","last_clean":"2024-09-19T05:39:59.758443+0000","last_became_active":"2024-09-19T05:39:57.772523+0000","last_became_peered":"2024-09-19T05:39:57.772523+0000","last_unstale":"2024-09-19T05:39:59.758443+0000","last_undegraded":"2024-09-19T05:39:59.758443+0000","last_fullsized":"2024-09-19T05:39:59.758443+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:39:56.733550+0000","last_clean_scrub_stamp":"2024-09-19T05:39:56.733550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:41.387913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":341,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.390415+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:40:00.390415+0000","last_peered":"2024-09-19T05:40:00.390415+0000","last_clean":"2024-09-19T05:40:00.390415+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:40:00.390415+0000","last_undegraded":"2024-09-19T05:40:00.390415+0000","last_fullsized":"2024-09-19T05:40:00.390415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542230,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51228,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320612,"statfs":{"total":96636764160,"available":96584306688,"internally_reserved":0,"allocated":2035712,"data_stored":1264973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45092,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326748,"statfs":{"total":96636764160,"available":96590589952,"internally_reserved":0,"allocated":1454080,"data_stored":676661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542232,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1433600,"data_stored":674445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542230,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50644,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321196,"statfs":{"total":96636764160,"available":96584904704,"internally_reserved":0,"allocated":1441792,"data_stored":674537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542231,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46480,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325360,"statfs":{"total":96636764160,"available":96589168640,"internally_reserved":0,"allocated":1437696,"data_stored":675027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542231,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28432,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343408,"statfs":{"total":96636764160,"available":96607649792,"internally_reserved":0,"allocated":1437696,"data_stored":674479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40912,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330928,"statfs":{"total":96636764160,"available":96594870272,"internally_reserved":0,"allocated":1437696,"data_stored":674479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542230,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55396,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316444,"statfs":{"total":96636764160,"available":96580038656,"internally_reserved":0,"allocated":2043904,"data_stored":1266515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:40:07.757 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:40:07.757 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:40:07.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.935+0000 7fcd055de640 1 Processor -- start 2024-09-19T05:40:07.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.935+0000 7fcd055de640 1 -- start start 2024-09-19T05:40:07.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fcd055de640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcd000d0de0 0x7fcd000ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fcd055de640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd000b3750 0x7fcd000b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fcd055de640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd000cea90 con 0x7fcd0015f950 2024-09-19T05:40:07.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fcd055de640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fcd000af1a0 con 0x7fcd000d0de0 2024-09-19T05:40:07.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fcd055de640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcd000ce110 con 0x7fcd000b3750 2024-09-19T05:40:07.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccff7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd000b3750 0x7fcd000b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfe7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcd000d0de0 0x7fcd000ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfeffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcd0015f950 0x7fcd000d06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:58834/0 (socket says 172.21.15.67:58834) 2024-09-19T05:40:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfeffd640 1 -- 172.21.15.67:0/2335308427 learned_addr learned my addr 172.21.15.67:0/2335308427 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:40:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfe7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcd000d0de0 0x7fcd000ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:43110/0 (socket says 172.21.15.67:43110) 2024-09-19T05:40:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfe7fc640 1 -- 172.21.15.67:0/2335308427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd000b3750 msgr2=0x7fcd000b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfe7fc640 1 --2- 172.21.15.67:0/2335308427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd000b3750 0x7fcd000b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfe7fc640 1 -- 172.21.15.67:0/2335308427 >> v1:172.21.15.97:6789/0 conn(0x7fcd0015f950 legacy=0x7fcd000d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfe7fc640 1 -- 172.21.15.67:0/2335308427 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd000cd7e0 con 0x7fcd000d0de0 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfe7fc640 1 --2- 172.21.15.67:0/2335308427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd000d0de0 0x7fcd000ce4b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fccf40097c0 tx=0x7fccf401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfe4c551c91d75da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfdffb640 1 -- 172.21.15.67:0/2335308427 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf40a7070 con 0x7fcd000d0de0 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfdffb640 1 -- 172.21.15.67:0/2335308427 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf40b0070 con 0x7fcd000d0de0 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.939+0000 7fccfdffb640 1 -- 172.21.15.67:0/2335308427 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf40ab890 con 0x7fcd000d0de0 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 -- 172.21.15.67:0/2335308427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd000d0de0 msgr2=0x7fcd000ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 --2- 172.21.15.67:0/2335308427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd000d0de0 0x7fcd000ce4b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fccf40097c0 tx=0x7fccf401c470 comp rx=0 tx=0).stop 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 -- 172.21.15.67:0/2335308427 shutdown_connections 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 --2- 172.21.15.67:0/2335308427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd000b3750 0x7fcd000b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 --2- 172.21.15.67:0/2335308427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd000d0de0 0x7fcd000ce4b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 -- 172.21.15.67:0/2335308427 >> 172.21.15.67:0/2335308427 conn(0x7fcd000d22f0 msgr2=0x7fcd000d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 -- 172.21.15.67:0/2335308427 shutdown_connections 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 -- 172.21.15.67:0/2335308427 wait complete. 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 Processor -- start 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 -- start start 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd000b3750 0x7fcd0015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd000d0de0 0x7fcd0015e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0015f950 0x7fcd000af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0015feb0 con 0x7fcd0015f950 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0015fd30 con 0x7fcd000b3750 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fcd055de640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcd000b2b90 con 0x7fcd000d0de0 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccff7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0015f950 0x7fcd000af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccff7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0015f950 0x7fcd000af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59334/0 (socket says 172.21.15.67:59334) 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccff7fe640 1 -- 172.21.15.67:0/2402763572 learned_addr learned my addr 172.21.15.67:0/2402763572 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccfeffd640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd000b3750 0x7fcd0015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccfe7fc640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd000d0de0 0x7fcd0015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccff7fe640 1 -- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd000d0de0 msgr2=0x7fcd0015e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccff7fe640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd000d0de0 0x7fcd0015e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccff7fe640 1 -- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd000b3750 msgr2=0x7fcd0015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccff7fe640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd000b3750 0x7fcd0015d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccff7fe640 1 -- 172.21.15.67:0/2402763572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd000b51c0 con 0x7fcd0015f950 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.943+0000 7fccff7fe640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0015f950 0x7fcd000af430 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fccf800e930 tx=0x7fccf800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fcce77fe640 1 -- 172.21.15.67:0/2402763572 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf8017070 con 0x7fcd0015f950 2024-09-19T05:40:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fcce77fe640 1 -- 172.21.15.67:0/2402763572 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf800c9a0 con 0x7fcd0015f950 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fcce77fe640 1 -- 172.21.15.67:0/2402763572 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf800cd70 con 0x7fcd0015f950 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fcd055de640 1 -- 172.21.15.67:0/2402763572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd000b5460 con 0x7fcd0015f950 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fcd055de640 1 -- 172.21.15.67:0/2402763572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd000b5a20 con 0x7fcd0015f950 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fcd055de640 1 -- 172.21.15.67:0/2402763572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd000b2f80 con 0x7fcd0015f950 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fcce77fe640 1 -- 172.21.15.67:0/2402763572 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fccf801a070 con 0x7fcd0015f950 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fcce77fe640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccec0678c0 0x7fccec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fcce77fe640 1 -- 172.21.15.67:0/2402763572 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7fccf8086560 con 0x7fcd0015f950 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fccfeffd640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccec0678c0 0x7fccec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.947+0000 7fccfeffd640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccec0678c0 0x7fccec069d80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fccf00012f0 tx=0x7fccf00019a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:07.951+0000 7fcce77fe640 1 -- 172.21.15.67:0/2402763572 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fccf80569f0 con 0x7fcd0015f950 2024-09-19T05:40:08.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.175+0000 7fcd055de640 1 -- 172.21.15.67:0/2402763572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fcd0006f090 con 0x7fcd0015f950 2024-09-19T05:40:08.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.179+0000 7fcce77fe640 1 -- 172.21.15.67:0/2402763572 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7fccf805acf0 con 0x7fcd0015f950 2024-09-19T05:40:08.180 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:40:08.181 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:40:08.181 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:40:08.181 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:40:08.181 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:40:08.181 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:40:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 -- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccec0678c0 msgr2=0x7fccec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccec0678c0 0x7fccec069d80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fccf00012f0 tx=0x7fccf00019a0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 -- 172.21.15.67:0/2402763572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0015f950 msgr2=0x7fcd000af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0015f950 0x7fcd000af430 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fccf800e930 tx=0x7fccf800edf0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 -- 172.21.15.67:0/2402763572 shutdown_connections 2024-09-19T05:40:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd0015f950 0x7fcd000af430 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fccec0678c0 0x7fccec069d80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd000d0de0 0x7fcd0015e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 --2- 172.21.15.67:0/2402763572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd000b3750 0x7fcd0015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 -- 172.21.15.67:0/2402763572 >> 172.21.15.67:0/2402763572 conn(0x7fcd000d22f0 msgr2=0x7fcd000745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:08.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 -- 172.21.15.67:0/2402763572 shutdown_connections 2024-09-19T05:40:08.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.183+0000 7fcd055de640 1 -- 172.21.15.67:0/2402763572 wait complete. 2024-09-19T05:40:08.203 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:40:08.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff3b6f640 1 Processor -- start 2024-09-19T05:40:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff3b6f640 1 -- start start 2024-09-19T05:40:08.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff3b6f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fefec0b6050 0x7fefec0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff3b6f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fefec0b6cf0 0x7fefec06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff3b6f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefec0b5b90 con 0x7fefec15e640 2024-09-19T05:40:08.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff3b6f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fefec0b4780 con 0x7fefec0b6cf0 2024-09-19T05:40:08.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff3b6f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fefec0b15f0 con 0x7fefec0b6050 2024-09-19T05:40:08.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff210c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fefec0b6cf0 0x7fefec06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff210c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fefec0b6cf0 0x7fefec06bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59348/0 (socket says 172.21.15.67:59348) 2024-09-19T05:40:08.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff210c640 1 -- 172.21.15.67:0/1947521760 learned_addr learned my addr 172.21.15.67:0/1947521760 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:08.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff110a640 1 --2- 172.21.15.67:0/1947521760 >> v2:172.21.15.97:3300/0 conn(0x7fefec0b6050 0x7fefec0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff210c640 1 -- 172.21.15.67:0/1947521760 >> v2:172.21.15.97:3300/0 conn(0x7fefec0b6050 msgr2=0x7fefec0ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:08.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff210c640 1 --2- 172.21.15.67:0/1947521760 >> v2:172.21.15.97:3300/0 conn(0x7fefec0b6050 0x7fefec0ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff210c640 1 -- 172.21.15.67:0/1947521760 >> v1:172.21.15.97:6789/0 conn(0x7fefec15e640 legacy=0x7fefec0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.323+0000 7feff210c640 1 -- 172.21.15.67:0/1947521760 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec0b44a0 con 0x7fefec0b6cf0 2024-09-19T05:40:08.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff210c640 1 --2- 172.21.15.67:0/1947521760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec0b6cf0 0x7fefec06bcc0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fefec073d90 tx=0x7fefe401c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36e46d9ac2582cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:08.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff0909640 1 -- 172.21.15.67:0/1947521760 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe40ac020 con 0x7fefec0b6cf0 2024-09-19T05:40:08.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff0909640 1 -- 172.21.15.67:0/1947521760 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe40a6490 con 0x7fefec0b6cf0 2024-09-19T05:40:08.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff0909640 1 -- 172.21.15.67:0/1947521760 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe40a6860 con 0x7fefec0b6cf0 2024-09-19T05:40:08.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 -- 172.21.15.67:0/1947521760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec0b6cf0 msgr2=0x7fefec06bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 --2- 172.21.15.67:0/1947521760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec0b6cf0 0x7fefec06bcc0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fefec073d90 tx=0x7fefe401c6b0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 -- 172.21.15.67:0/1947521760 shutdown_connections 2024-09-19T05:40:08.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 --2- 172.21.15.67:0/1947521760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec0b6cf0 0x7fefec06bcc0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 --2- 172.21.15.67:0/1947521760 >> v2:172.21.15.97:3300/0 conn(0x7fefec0b6050 0x7fefec0ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 -- 172.21.15.67:0/1947521760 >> 172.21.15.67:0/1947521760 conn(0x7fefec09aa30 msgr2=0x7fefec0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:08.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 -- 172.21.15.67:0/1947521760 shutdown_connections 2024-09-19T05:40:08.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 -- 172.21.15.67:0/1947521760 wait complete. 2024-09-19T05:40:08.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 Processor -- start 2024-09-19T05:40:08.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 -- start start 2024-09-19T05:40:08.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefec0b6050 0x7fefec1545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefec0b6cf0 0x7fefec154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec15e640 0x7fefec155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fefec0b2b40 con 0x7fefec15e640 2024-09-19T05:40:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fefec06c610 con 0x7fefec0b6cf0 2024-09-19T05:40:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fefec0b0790 con 0x7fefec0b6050 2024-09-19T05:40:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff210c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec15e640 0x7fefec155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff210c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec15e640 0x7fefec155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59358/0 (socket says 172.21.15.67:59358) 2024-09-19T05:40:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff210c640 1 -- 172.21.15.67:0/2938109104 learned_addr learned my addr 172.21.15.67:0/2938109104 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff110a640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefec0b6cf0 0x7fefec154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff190b640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefec0b6050 0x7fefec1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff210c640 1 -- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefec0b6050 msgr2=0x7fefec1545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff210c640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefec0b6050 0x7fefec1545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff210c640 1 -- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefec0b6cf0 msgr2=0x7fefec154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff210c640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefec0b6cf0 0x7fefec154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff210c640 1 -- 172.21.15.67:0/2938109104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec0ca4e0 con 0x7fefec15e640 2024-09-19T05:40:08.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff210c640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec15e640 0x7fefec155470 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fefe401a2e0 tx=0x7fefe4019450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:08.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7fefe27fc640 1 -- 172.21.15.67:0/2938109104 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe40b7070 con 0x7fefec15e640 2024-09-19T05:40:08.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7fefe27fc640 1 -- 172.21.15.67:0/2938109104 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe40a7670 con 0x7fefec15e640 2024-09-19T05:40:08.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7feff3b6f640 1 -- 172.21.15.67:0/2938109104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefec0ca7c0 con 0x7fefec15e640 2024-09-19T05:40:08.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.327+0000 7fefe27fc640 1 -- 172.21.15.67:0/2938109104 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4009510 con 0x7fefec15e640 2024-09-19T05:40:08.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.331+0000 7feff3b6f640 1 -- 172.21.15.67:0/2938109104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefec0cad80 con 0x7fefec15e640 2024-09-19T05:40:08.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.331+0000 7feff3b6f640 1 -- 172.21.15.67:0/2938109104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefec0b40c0 con 0x7fefec15e640 2024-09-19T05:40:08.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.331+0000 7fefe27fc640 1 -- 172.21.15.67:0/2938109104 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fefe40c2060 con 0x7fefec15e640 2024-09-19T05:40:08.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.331+0000 7fefe27fc640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd00678c0 0x7fefd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.331+0000 7fefe27fc640 1 -- 172.21.15.67:0/2938109104 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7fefe411ff10 con 0x7fefec15e640 2024-09-19T05:40:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.331+0000 7feff190b640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd00678c0 0x7fefd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.331+0000 7feff190b640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd00678c0 0x7fefd0069d80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fefe8007fd0 tx=0x7fefe8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.335+0000 7fefe27fc640 1 -- 172.21.15.67:0/2938109104 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fefec0b5b90 con 0x7fefec15e640 2024-09-19T05:40:08.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.535+0000 7feff3b6f640 1 -- 172.21.15.67:0/2938109104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefec157f60 con 0x7fefec15e640 2024-09-19T05:40:08.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.535+0000 7fefe27fc640 1 -- 172.21.15.67:0/2938109104 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5219 (secure 0 0 0) 0x7fefe40f09e0 con 0x7fefec15e640 2024-09-19T05:40:08.536 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:40:08.536 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":83,"btime":"2024-09-19T05:40:01:798281+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3139499810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3139499810},{"type":"v1","addr":"172.21.15.67:6833","nonce":3139499810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2818006351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2818006351},{"type":"v1","addr":"172.21.15.67:6835","nonce":2818006351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/762722911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":762722911},{"type":"v1","addr":"172.21.15.97:6835","nonce":762722911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:39:58.136994+0000","modified":"2024-09-19T05:40:01.171588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/396819326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":396819326},{"type":"v1","addr":"172.21.15.97:6837","nonce":396819326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6556,"qdb_cluster":[6556]},"id":7}]} 2024-09-19T05:40:08.537 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 83 2024-09-19T05:40:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.535+0000 7feff3b6f640 1 -- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd00678c0 msgr2=0x7fefd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.535+0000 7feff3b6f640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd00678c0 0x7fefd0069d80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fefe8007fd0 tx=0x7fefe8009040 comp rx=0 tx=0).stop 2024-09-19T05:40:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.535+0000 7feff3b6f640 1 -- 172.21.15.67:0/2938109104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec15e640 msgr2=0x7fefec155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.535+0000 7feff3b6f640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec15e640 0x7fefec155470 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fefe401a2e0 tx=0x7fefe4019450 comp rx=0 tx=0).stop 2024-09-19T05:40:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.535+0000 7feff3b6f640 1 -- 172.21.15.67:0/2938109104 shutdown_connections 2024-09-19T05:40:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.539+0000 7feff3b6f640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefec15e640 0x7fefec155470 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.539+0000 7feff3b6f640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefec0b6cf0 0x7fefec154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.539+0000 7feff3b6f640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd00678c0 0x7fefd0069d80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.539+0000 7feff3b6f640 1 --2- 172.21.15.67:0/2938109104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefec0b6050 0x7fefec1545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.539+0000 7feff3b6f640 1 -- 172.21.15.67:0/2938109104 >> 172.21.15.67:0/2938109104 conn(0x7fefec09aa30 msgr2=0x7fefec15d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:08.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.539+0000 7feff3b6f640 1 -- 172.21.15.67:0/2938109104 shutdown_connections 2024-09-19T05:40:08.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:08.539+0000 7feff3b6f640 1 -- 172.21.15.67:0/2938109104 wait complete. 2024-09-19T05:40:08.959 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:39:58.136994+0000', 'modified': '2024-09-19T05:40:01.171588+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6556}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6556': {'gid': 6556, 'name': 'd', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6837/396819326', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6836', 'nonce': 396819326}, {'type': 'v1', 'addr': '172.21.15.97:6837', 'nonce': 396819326}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6556, 'qdb_cluster': [6556]} 2024-09-19T05:40:08.959 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:40:08.959 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-19T05:40:09.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.095+0000 7f32db70b640 1 Processor -- start 2024-09-19T05:40:09.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.095+0000 7f32db70b640 1 -- start start 2024-09-19T05:40:09.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.095+0000 7f32db70b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32d415c200 0x7f32d4071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.095+0000 7f32db70b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d40b3070 con 0x7f32d40aef40 2024-09-19T05:40:09.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.095+0000 7f32db70b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d40afa70 con 0x7f32d415b710 2024-09-19T05:40:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.095+0000 7f32db70b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f32d40b32e0 con 0x7f32d415c200 2024-09-19T05:40:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.095+0000 7f32d8ca6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32d415c200 0x7f32d4071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.095+0000 7f32d8ca6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32d415c200 0x7f32d4071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59362/0 (socket says 172.21.15.67:59362) 2024-09-19T05:40:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.095+0000 7f32d8ca6640 1 -- 172.21.15.67:0/738837538 learned_addr learned my addr 172.21.15.67:0/738837538 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.095+0000 7f32d9ca8640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f32d40aef40 0x7f32d40af360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34874/0 (socket says 172.21.15.67:34874) 2024-09-19T05:40:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32d8ca6640 1 -- 172.21.15.67:0/738837538 >> v1:172.21.15.97:6789/0 conn(0x7f32d415b710 legacy=0x7f32d415baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32d3fff640 1 -- 172.21.15.67:0/738837538 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 71284317 0 0) 0x7f32d40b3070 con 0x7f32d40aef40 2024-09-19T05:40:09.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32d8ca6640 1 -- 172.21.15.67:0/738837538 >> v1:172.21.15.67:6789/0 conn(0x7f32d40aef40 legacy=0x7f32d40af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32d8ca6640 1 -- 172.21.15.67:0/738837538 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d40b35c0 con 0x7f32d415c200 2024-09-19T05:40:09.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32d8ca6640 1 --2- 172.21.15.67:0/738837538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 0x7f32d4071e80 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009870 tx=0x7f32c801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9925ac7c8c29fa1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32d3fff640 1 -- 172.21.15.67:0/738837538 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c80a95f0 con 0x7f32d415c200 2024-09-19T05:40:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32d3fff640 1 -- 172.21.15.67:0/738837538 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c80a9790 con 0x7f32d415c200 2024-09-19T05:40:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32d3fff640 1 -- 172.21.15.67:0/738837538 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c80a9b60 con 0x7f32d415c200 2024-09-19T05:40:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32db70b640 1 -- 172.21.15.67:0/738837538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 msgr2=0x7f32d4071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32db70b640 1 --2- 172.21.15.67:0/738837538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 0x7f32d4071e80 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009870 tx=0x7f32c801c530 comp rx=0 tx=0).stop 2024-09-19T05:40:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32db70b640 1 -- 172.21.15.67:0/738837538 shutdown_connections 2024-09-19T05:40:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32db70b640 1 --2- 172.21.15.67:0/738837538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 0x7f32d4071e80 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32db70b640 1 -- 172.21.15.67:0/738837538 >> 172.21.15.67:0/738837538 conn(0x7f32d40d0080 msgr2=0x7f32d40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32db70b640 1 -- 172.21.15.67:0/738837538 shutdown_connections 2024-09-19T05:40:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.099+0000 7f32db70b640 1 -- 172.21.15.67:0/738837538 wait complete. 2024-09-19T05:40:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32db70b640 1 Processor -- start 2024-09-19T05:40:09.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32db70b640 1 -- start start 2024-09-19T05:40:09.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32db70b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32d40aef40 0x7f32d4148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32db70b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32d415b710 0x7f32d4153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32db70b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 0x7f32d415a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32db70b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f32d40b4c40 con 0x7f32d415c200 2024-09-19T05:40:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32db70b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f32d40b4ac0 con 0x7f32d40aef40 2024-09-19T05:40:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32db70b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f32d40b4dc0 con 0x7f32d415b710 2024-09-19T05:40:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d9ca8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 0x7f32d415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d9ca8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 0x7f32d415a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59368/0 (socket says 172.21.15.67:59368) 2024-09-19T05:40:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d9ca8640 1 -- 172.21.15.67:0/3567051632 learned_addr learned my addr 172.21.15.67:0/3567051632 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d94a7640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32d40aef40 0x7f32d4148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d9ca8640 1 -- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32d415b710 msgr2=0x7f32d4153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d8ca6640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32d415b710 0x7f32d4153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32d415b710 0x7f32d4153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d9ca8640 1 -- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32d40aef40 msgr2=0x7f32d4148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32d40aef40 0x7f32d4148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d9ca8640 1 -- 172.21.15.67:0/3567051632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d4099cd0 con 0x7f32d415c200 2024-09-19T05:40:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d94a7640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32d40aef40 0x7f32d4148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d8ca6640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32d415b710 0x7f32d4153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 0x7f32d415a170 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00c480 tx=0x7f32cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d1ffb640 1 -- 172.21.15.67:0/3567051632 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc018070 con 0x7f32d415c200 2024-09-19T05:40:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d1ffb640 1 -- 172.21.15.67:0/3567051632 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32cc0074e0 con 0x7f32d415c200 2024-09-19T05:40:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32db70b640 1 -- 172.21.15.67:0/3567051632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d41539b0 con 0x7f32d415c200 2024-09-19T05:40:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d1ffb640 1 -- 172.21.15.67:0/3567051632 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc004a30 con 0x7f32d415c200 2024-09-19T05:40:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32db70b640 1 -- 172.21.15.67:0/3567051632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d4153f70 con 0x7f32d415c200 2024-09-19T05:40:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.103+0000 7f32d1ffb640 1 -- 172.21.15.67:0/3567051632 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32cc01b070 con 0x7f32d415c200 2024-09-19T05:40:09.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d1ffb640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32c00678c0 0x7f32c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d1ffb640 1 -- 172.21.15.67:0/3567051632 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f32cc0850e0 con 0x7f32d415c200 2024-09-19T05:40:09.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32c00678c0 0x7f32c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 Processor -- start 2024-09-19T05:40:09.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 -- start start 2024-09-19T05:40:09.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32c00678c0 0x7f32c0069d80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f32c4007fd0 tx=0x7f32c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:09.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac47f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac48440 0x55887abfdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887abfe290 0x55887abfe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55887aae5b60 con 0x55887ac47b20 2024-09-19T05:40:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55887aa4cc70 con 0x55887abfe290 2024-09-19T05:40:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55887a9f2ed0 con 0x55887ac48440 2024-09-19T05:40:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac47f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac47f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59374/0 (socket says 172.21.15.67:59374) 2024-09-19T05:40:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 -- 172.21.15.67:0/436366050 learned_addr learned my addr 172.21.15.67:0/436366050 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/436366050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887abfe290 0x55887abfe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 -- 172.21.15.67:0/436366050 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac48440 msgr2=0x55887abfdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d8ca6640 1 --2- 172.21.15.67:0/436366050 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac48440 0x55887abfdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 --2- 172.21.15.67:0/436366050 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac48440 0x55887abfdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 -- 172.21.15.67:0/436366050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887abfe290 msgr2=0x55887abfe670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 --2- 172.21.15.67:0/436366050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887abfe290 0x55887abfe670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 -- 172.21.15.67:0/436366050 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887aa04e50 con 0x55887ac47b20 2024-09-19T05:40:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/436366050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887abfe290 0x55887abfe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32d94a7640 1 --2- 172.21.15.67:0/436366050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac47f00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f32c400dcf0 tx=0x7f32c4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7287882c75de637 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32baffd640 1 -- 172.21.15.67:0/436366050 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4024070 con 0x55887ac47b20 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32baffd640 1 -- 172.21.15.67:0/436366050 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c401f600 con 0x55887ac47b20 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32baffd640 1 -- 172.21.15.67:0/436366050 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c401f9b0 con 0x55887ac47b20 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 -- 172.21.15.67:0/436366050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 msgr2=0x55887ac47f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 --2- 172.21.15.67:0/436366050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac47f00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f32c400dcf0 tx=0x7f32c4010000 comp rx=0 tx=0).stop 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 -- 172.21.15.67:0/436366050 shutdown_connections 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 --2- 172.21.15.67:0/436366050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887abfe290 0x55887abfe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 --2- 172.21.15.67:0/436366050 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac48440 0x55887abfdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 --2- 172.21.15.67:0/436366050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac47f00 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 -- 172.21.15.67:0/436366050 >> 172.21.15.67:0/436366050 conn(0x55887ac04600 msgr2=0x55887abfc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 -- 172.21.15.67:0/436366050 shutdown_connections 2024-09-19T05:40:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.107+0000 7f32de7c7000 1 -- 172.21.15.67:0/436366050 wait complete. 2024-09-19T05:40:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 -- start start 2024-09-19T05:40:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 Processor -- start 2024-09-19T05:40:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac47b20 0x55887ac02df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac48440 0x55887ac08cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac03330 0x55887ac09230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55887aaaeb00 con 0x55887ac03330 2024-09-19T05:40:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55887aa27360 con 0x55887ac48440 2024-09-19T05:40:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55887aa242d0 con 0x55887ac47b20 2024-09-19T05:40:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 10 client.0 _ll_register_callbacks cb 0x55887abe9820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:40:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d9ca8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac03330 0x55887ac09230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d9ca8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac03330 0x55887ac09230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59384/0 (socket says 172.21.15.67:59384) 2024-09-19T05:40:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d9ca8640 1 -- 172.21.15.67:0/2157740213 learned_addr learned my addr 172.21.15.67:0/2157740213 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d8ca6640 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac48440 0x55887ac08cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d94a7640 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac47b20 0x55887ac02df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d9ca8640 1 -- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac47b20 msgr2=0x55887ac02df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac47b20 0x55887ac02df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d9ca8640 1 -- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac48440 msgr2=0x55887ac08cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac48440 0x55887ac08cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d9ca8640 1 -- 172.21.15.67:0/2157740213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55887a9f3120 con 0x55887ac03330 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac03330 0x55887ac09230 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f32cc020030 tx=0x7f32cc055c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3034c69670e11fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32b3fff640 1 -- 172.21.15.67:0/2157740213 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc05dd70 con 0x55887ac03330 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32b3fff640 1 -- 172.21.15.67:0/2157740213 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f32cc06d170 con 0x55887ac03330 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 -- 172.21.15.67:0/2157740213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32c401f600 con 0x55887ac03330 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32b3fff640 1 -- 172.21.15.67:0/2157740213 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f32cc083050 con 0x55887ac03330 2024-09-19T05:40:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 10 client.7881 fetch_fsmap learned FSMap version 83 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 -- 172.21.15.67:0/2157740213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55887a9ec450 con 0x55887ac03330 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32b3fff640 1 -- 172.21.15.67:0/2157740213 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c401f600 con 0x55887ac03330 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32b3fff640 1 -- 172.21.15.67:0/2157740213 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 83) ==== 3502+0+0 (secure 0 0 0) 0x7f32cc054870 con 0x55887ac03330 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 10 client.7881 fetch_fsmap finished waiting for FSMap version 83 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 10 client.7881 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 20 client.7881 populate_metadata read hostname 'smithi067' 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55887ac56280 0x55887ac58670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 4 client.7881 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32de7c7000 1 -- 172.21.15.67:0/2157740213 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55887a9e6c00 con 0x55887ac56280 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d94a7640 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55887ac56280 0x55887ac58670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32b3fff640 10 client.7881 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.111+0000 7f32d94a7640 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55887ac56280 0x55887ac58670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d53caf1bb139439 server_cookie=acba2dafb334c198 in_seq=0 out_seq=0 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32b3fff640 1 -- 172.21.15.67:0/2157740213 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55887a9e6c00 con 0x55887ac56280 2024-09-19T05:40:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32b3fff640 10 client.7881 handle_command_reply: tid=0 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 client.7881 shutdown 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 -- 172.21.15.67:0/2157740213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac03330 msgr2=0x55887ac09230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac03330 0x55887ac09230 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f32cc020030 tx=0x7f32cc055c60 comp rx=0 tx=0).stop 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 -- 172.21.15.67:0/2157740213 shutdown_connections 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55887ac56280 0x55887ac58670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac03330 0x55887ac09230 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac48440 0x55887ac08cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32b3fff640 0 client.7881 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 --2- 172.21.15.67:0/2157740213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac47b20 0x55887ac02df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 -- 172.21.15.67:0/2157740213 >> 172.21.15.67:0/2157740213 conn(0x55887abfe290 msgr2=0x55887abfcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 -- 172.21.15.67:0/2157740213 shutdown_connections 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 1 -- 172.21.15.67:0/2157740213 wait complete. 2024-09-19T05:40:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.115+0000 7f32de7c7000 20 client.7881 trim_cache size 0 max 16384 2024-09-19T05:40:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 Processor -- start 2024-09-19T05:40:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 -- start start 2024-09-19T05:40:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac03330 0x55887ac025f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac47b20 0x55887ac02b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac48440 0x55887ac58670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f32d4202d80 con 0x55887ac48440 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f32d414b2f0 con 0x55887ac03330 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f32d414b940 con 0x55887ac47b20 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d9ca8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac48440 0x55887ac58670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d9ca8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac48440 0x55887ac58670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59400/0 (socket says 172.21.15.67:59400) 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d9ca8640 1 -- 172.21.15.67:0/1877790333 learned_addr learned my addr 172.21.15.67:0/1877790333 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d94a7640 1 --2- 172.21.15.67:0/1877790333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac03330 0x55887ac025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d8ca6640 1 --2- 172.21.15.67:0/1877790333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac47b20 0x55887ac02b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d9ca8640 1 -- 172.21.15.67:0/1877790333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac47b20 msgr2=0x55887ac02b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/1877790333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac47b20 0x55887ac02b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d9ca8640 1 -- 172.21.15.67:0/1877790333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac03330 msgr2=0x55887ac025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/1877790333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac03330 0x55887ac025f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d9ca8640 1 -- 172.21.15.67:0/1877790333 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887ac538e0 con 0x55887ac48440 2024-09-19T05:40:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/1877790333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac48440 0x55887ac58670 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00ce40 tx=0x7f32cc0517f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7349a8cc062d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32ba7fc640 1 -- 172.21.15.67:0/1877790333 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0831f0 con 0x55887ac48440 2024-09-19T05:40:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32ba7fc640 1 -- 172.21.15.67:0/1877790333 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32cc054870 con 0x55887ac48440 2024-09-19T05:40:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32ba7fc640 1 -- 172.21.15.67:0/1877790333 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc05ddb0 con 0x55887ac48440 2024-09-19T05:40:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 -- 172.21.15.67:0/1877790333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac48440 msgr2=0x55887ac58670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 --2- 172.21.15.67:0/1877790333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac48440 0x55887ac58670 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00ce40 tx=0x7f32cc0517f0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 -- 172.21.15.67:0/1877790333 shutdown_connections 2024-09-19T05:40:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 --2- 172.21.15.67:0/1877790333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac48440 0x55887ac58670 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 --2- 172.21.15.67:0/1877790333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac47b20 0x55887ac02b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 --2- 172.21.15.67:0/1877790333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac03330 0x55887ac025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 -- 172.21.15.67:0/1877790333 >> 172.21.15.67:0/1877790333 conn(0x55887abfe290 msgr2=0x55887ac5b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 -- 172.21.15.67:0/1877790333 shutdown_connections 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 -- 172.21.15.67:0/1877790333 wait complete. 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.135+0000 7f32de7c7000 1 -- start start 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 Processor -- start 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac03330 0x55887ac5ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac5b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac48440 0x55887aca1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55887aa4bf80 con 0x55887ac47b20 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55887aa04ca0 con 0x55887ac03330 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55887aa512a0 con 0x55887ac48440 2024-09-19T05:40:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 10 client.0 _ll_register_callbacks cb 0x7f32cc007e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d8ca6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac5b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d8ca6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac5b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59406/0 (socket says 172.21.15.67:59406) 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d8ca6640 1 -- 172.21.15.67:0/625449660 learned_addr learned my addr 172.21.15.67:0/625449660 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d9ca8640 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac48440 0x55887aca1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d94a7640 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac03330 0x55887ac5ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d8ca6640 1 -- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac48440 msgr2=0x55887aca1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d8ca6640 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac48440 0x55887aca1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d8ca6640 1 -- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac03330 msgr2=0x55887ac5ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d8ca6640 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac03330 0x55887ac5ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d8ca6640 1 -- 172.21.15.67:0/625449660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55887ac48270 con 0x55887ac47b20 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d8ca6640 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac5b0d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f32c801c570 tx=0x7f32c801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce90040567bd5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:40:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32b3fff640 1 -- 172.21.15.67:0/625449660 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c80c0060 con 0x55887ac47b20 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32b3fff640 1 -- 172.21.15.67:0/625449660 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f32c80b1c30 con 0x55887ac47b20 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- 172.21.15.67:0/625449660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32cc054870 con 0x55887ac47b20 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32b3fff640 1 -- 172.21.15.67:0/625449660 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f32c80c6050 con 0x55887ac47b20 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 10 client.7887 fetch_fsmap learned FSMap version 83 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- 172.21.15.67:0/625449660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55887a9d3fd0 con 0x55887ac47b20 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32b3fff640 1 -- 172.21.15.67:0/625449660 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32cc054870 con 0x55887ac47b20 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32b3fff640 1 -- 172.21.15.67:0/625449660 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 83) ==== 3502+0+0 (secure 0 0 0) 0x7f32c80c9020 con 0x55887ac47b20 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 10 client.7887 fetch_fsmap finished waiting for FSMap version 83 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 10 client.7887 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 20 client.7887 populate_metadata read hostname 'smithi067' 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55887aca2e30 0x55887aca3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 4 client.7887 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:40:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- 172.21.15.67:0/625449660 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "status"}) -- 0x55887aa5a3a0 con 0x55887aca2e30 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d94a7640 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55887aca2e30 0x55887aca3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32b3fff640 10 client.7887 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32d94a7640 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55887aca2e30 0x55887aca3210 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6e0f0cef8435835 server_cookie=3e5954d9bc3ed845 in_seq=0 out_seq=0 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32b3fff640 1 -- 172.21.15.67:0/625449660 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55887aa5a3a0 con 0x55887aca2e30 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32b3fff640 10 client.7887 handle_command_reply: tid=0 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 client.7887 shutdown 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- 172.21.15.67:0/625449660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 msgr2=0x55887ac5b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac5b0d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f32c801c570 tx=0x7f32c801ad70 comp rx=0 tx=0).stop 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- 172.21.15.67:0/625449660 shutdown_connections 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55887aca2e30 0x55887aca3210 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55887ac48440 0x55887aca1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55887ac47b20 0x55887ac5b0d0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32b3fff640 0 client.7887 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:40:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 --2- 172.21.15.67:0/625449660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55887ac03330 0x55887ac5ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- 172.21.15.67:0/625449660 >> 172.21.15.67:0/625449660 conn(0x55887abfe290 msgr2=0x55887ac025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:09.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- 172.21.15.67:0/625449660 shutdown_connections 2024-09-19T05:40:09.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.139+0000 7f32de7c7000 1 -- 172.21.15.67:0/625449660 wait complete. 2024-09-19T05:40:09.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32de7c7000 20 client.7887 trim_cache size 0 max 16384 2024-09-19T05:40:09.146 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:40:09.146 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:40:09.146 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:40:09.146 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 6556, 2024-09-19T05:40:09.146 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:40:09.146 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:40:09.147 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:40:09.147 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 10.390210683999999, 2024-09-19T05:40:09.147 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 83, 2024-09-19T05:40:09.147 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 116, 2024-09-19T05:40:09.147 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 116, 2024-09-19T05:40:09.147 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 15.689871606000001 2024-09-19T05:40:09.147 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:40:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 -- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32c00678c0 msgr2=0x7f32c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32c00678c0 0x7f32c0069d80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f32c4007fd0 tx=0x7f32c4009040 comp rx=0 tx=0).stop 2024-09-19T05:40:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 -- 172.21.15.67:0/3567051632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 msgr2=0x7f32d415a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 0x7f32d415a170 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00c480 tx=0x7f32cc00c940 comp rx=0 tx=0).stop 2024-09-19T05:40:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 -- 172.21.15.67:0/3567051632 shutdown_connections 2024-09-19T05:40:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32d415c200 0x7f32d415a170 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32c00678c0 0x7f32c0069d80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32d415b710 0x7f32d4153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 --2- 172.21.15.67:0/3567051632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32d40aef40 0x7f32d4148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 -- 172.21.15.67:0/3567051632 >> 172.21.15.67:0/3567051632 conn(0x7f32d40d0080 msgr2=0x7f32d4072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:09.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 -- 172.21.15.67:0/3567051632 shutdown_connections 2024-09-19T05:40:09.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.143+0000 7f32db70b640 1 -- 172.21.15.67:0/3567051632 wait complete. 2024-09-19T05:40:09.158 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:40:09.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.275+0000 7f3702c9a640 1 Processor -- start 2024-09-19T05:40:09.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.275+0000 7f3702c9a640 1 -- start start 2024-09-19T05:40:09.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.275+0000 7f3702c9a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36fc071e80 0x7f36fc0af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.275+0000 7f3702c9a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36fc0b3070 con 0x7f36fc15c200 2024-09-19T05:40:09.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.275+0000 7f3702c9a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36fc0b32e0 con 0x7f36fc15b710 2024-09-19T05:40:09.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.275+0000 7f3702c9a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f36fc0b35c0 con 0x7f36fc071e80 2024-09-19T05:40:09.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.275+0000 7f36fbfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f36fc15c200 0x7f36fc0aef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34888/0 (socket says 172.21.15.67:34888) 2024-09-19T05:40:09.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.275+0000 7f36fbfff640 1 -- 172.21.15.67:0/3002707 learned_addr learned my addr 172.21.15.67:0/3002707 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f3701237640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36fc071e80 0x7f36fc0af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617662882 0 0) 0x7f36fc0b3070 con 0x7f36fc15c200 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36e4003530 con 0x7f36fc15c200 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1052311500 0 0) 0x7f36e4003530 con 0x7f36fc15c200 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36fc071e80 msgr2=0x7f36fc0af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36fc071e80 0x7f36fc0af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 >> v1:172.21.15.97:6789/0 conn(0x7f36fc15b710 legacy=0x7f36fc15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36fc0b38a0 con 0x7f36fc15c200 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f36f0001680 con 0x7f36fc15c200 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 >> v1:172.21.15.67:6789/0 conn(0x7f36fc15c200 legacy=0x7f36fc0aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36e40039f0 0x7f36e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e4004810 0x7f36e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36fc071e80 0x7f36e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc0b35c0 con 0x7f36e4004810 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f36e400bab0 con 0x7f36e40039f0 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f36e400bcb0 con 0x7f36fc071e80 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fbfff640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e4004810 0x7f36e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f3701237640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36fc071e80 0x7f36e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f3700a36640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36e40039f0 0x7f36e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fbfff640 1 -- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36fc071e80 msgr2=0x7f36e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fbfff640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36fc071e80 0x7f36e40051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fbfff640 1 -- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36e40039f0 msgr2=0x7f36e4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fbfff640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36e40039f0 0x7f36e4003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fbfff640 1 -- 172.21.15.67:0/3002707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e4003530 con 0x7f36e4004810 2024-09-19T05:40:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fbfff640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e4004810 0x7f36e4004c90 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c210 tx=0x7f36f001f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6c9e321659f1ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0007d20 con 0x7f36e4004810 2024-09-19T05:40:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f0005ae0 con 0x7f36e4004810 2024-09-19T05:40:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f36fb7fe640 1 -- 172.21.15.67:0/3002707 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0007070 con 0x7f36e4004810 2024-09-19T05:40:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f3702c9a640 1 -- 172.21.15.67:0/3002707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e4004810 msgr2=0x7f36e4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f3702c9a640 1 --2- 172.21.15.67:0/3002707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e4004810 0x7f36e4004c90 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c210 tx=0x7f36f001f390 comp rx=0 tx=0).stop 2024-09-19T05:40:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f3701237640 1 -- 172.21.15.67:0/3002707 reap_dead start 2024-09-19T05:40:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f3702c9a640 1 -- 172.21.15.67:0/3002707 shutdown_connections 2024-09-19T05:40:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.279+0000 7f3702c9a640 1 -- 172.21.15.67:0/3002707 >> 172.21.15.67:0/3002707 conn(0x7f36fc0d0080 msgr2=0x7f36fc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 -- 172.21.15.67:0/3002707 shutdown_connections 2024-09-19T05:40:09.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 -- 172.21.15.67:0/3002707 wait complete. 2024-09-19T05:40:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 Processor -- start 2024-09-19T05:40:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 -- start start 2024-09-19T05:40:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e4004810 0x7f36fc098bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36fc099340 0x7f36fc06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36fc0997c0 0x7f36fc06c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc0af7d0 con 0x7f36fc0997c0 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc0af650 con 0x7f36fc099340 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f36fc0af950 con 0x7f36e4004810 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3701237640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36fc0997c0 0x7f36fc06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3701237640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36fc0997c0 0x7f36fc06c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59420/0 (socket says 172.21.15.67:59420) 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3701237640 1 -- 172.21.15.67:0/3938783640 learned_addr learned my addr 172.21.15.67:0/3938783640 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3700a36640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e4004810 0x7f36fc098bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f36fbfff640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36fc099340 0x7f36fc06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3701237640 1 -- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e4004810 msgr2=0x7f36fc098bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3701237640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e4004810 0x7f36fc098bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3701237640 1 -- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36fc099340 msgr2=0x7f36fc06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3701237640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36fc099340 0x7f36fc06bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3701237640 1 -- 172.21.15.67:0/3938783640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36fc099130 con 0x7f36fc0997c0 2024-09-19T05:40:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3701237640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36fc0997c0 0x7f36fc06c200 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0b1c80 tx=0x7f36f400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f36f97fa640 1 -- 172.21.15.67:0/3938783640 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f401c070 con 0x7f36fc0997c0 2024-09-19T05:40:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f36f97fa640 1 -- 172.21.15.67:0/3938783640 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f4017400 con 0x7f36fc0997c0 2024-09-19T05:40:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f36f97fa640 1 -- 172.21.15.67:0/3938783640 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f40177f0 con 0x7f36fc0997c0 2024-09-19T05:40:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 -- 172.21.15.67:0/3938783640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36fc09e0d0 con 0x7f36fc0997c0 2024-09-19T05:40:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.283+0000 7f3702c9a640 1 -- 172.21.15.67:0/3938783640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36fc09ddf0 con 0x7f36fc0997c0 2024-09-19T05:40:09.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.287+0000 7f3702c9a640 1 -- 172.21.15.67:0/3938783640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36fc15baf0 con 0x7f36fc0997c0 2024-09-19T05:40:09.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.287+0000 7f36f97fa640 1 -- 172.21.15.67:0/3938783640 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36f401f070 con 0x7f36fc0997c0 2024-09-19T05:40:09.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.287+0000 7f36f97fa640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e80678c0 0x7f36e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:09.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.287+0000 7f36f97fa640 1 -- 172.21.15.67:0/3938783640 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f36f4085fe0 con 0x7f36fc0997c0 2024-09-19T05:40:09.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.287+0000 7f3700a36640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e80678c0 0x7f36e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.287+0000 7f3700a36640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e80678c0 0x7f36e8069d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f36ec001660 tx=0x7f36ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:09.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.291+0000 7f36f97fa640 1 -- 172.21.15.67:0/3938783640 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f36f4012070 con 0x7f36fc0997c0 2024-09-19T05:40:09.411 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:40:09.413 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:40:09.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.495+0000 7f3702c9a640 1 -- 172.21.15.67:0/3938783640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f36fc0b5020 con 0x7f36fc0997c0 2024-09-19T05:40:09.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.495+0000 7f36f97fa640 1 -- 172.21.15.67:0/3938783640 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7f36f4056990 con 0x7f36fc0997c0 2024-09-19T05:40:09.495 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:40:09.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 -- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e80678c0 msgr2=0x7f36e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e80678c0 0x7f36e8069d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f36ec001660 tx=0x7f36ec009040 comp rx=0 tx=0).stop 2024-09-19T05:40:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 -- 172.21.15.67:0/3938783640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36fc0997c0 msgr2=0x7f36fc06c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36fc0997c0 0x7f36fc06c200 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0b1c80 tx=0x7f36f400f4a0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 -- 172.21.15.67:0/3938783640 shutdown_connections 2024-09-19T05:40:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36fc0997c0 0x7f36fc06c200 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36fc099340 0x7f36fc06bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e80678c0 0x7f36e8069d80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 --2- 172.21.15.67:0/3938783640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e4004810 0x7f36fc098bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 -- 172.21.15.67:0/3938783640 >> 172.21.15.67:0/3938783640 conn(0x7f36fc0d0080 msgr2=0x7f36fc0afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 -- 172.21.15.67:0/3938783640 shutdown_connections 2024-09-19T05:40:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09.499+0000 7f3702c9a640 1 -- 172.21.15.67:0/3938783640 wait complete. 2024-09-19T05:40:09.514 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:40:09.514 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:40:09.514 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:40:09.514 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:40:09.514 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:40:09.514 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:40:09.514 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:40:09.514 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:40:09.515 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:40:09.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:09.515 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:40:09.567 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:40:09.567 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:40:09.567 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:40:09.567 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:40:09.567 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:40:09.567 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:40:09.567 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:40:09.567 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:40:09.567 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42095sec preferred_lft 42095sec 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:40:09.568 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:40:09.569 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:40:09.570 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:40:09.570 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:40:09.570 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:40:09.570 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:40:09.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:09.570 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:40:09.619 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:40:09.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:09.620 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:40:09.669 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:40:09.669 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:40:09.669 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:40:09.670 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:40:09.670 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:40:09.670 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:40:09.670 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:40:09.670 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:40:09.670 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:40:09.670 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:40:09.670 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:40:09.670 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:40:09.671 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:40:09.671 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:40:09.671 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:40:09.671 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:40:09.671 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:40:09.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:40:09.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:40:09.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:09.793 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:40:09.799 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:40:09.799 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:40:09.799 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:40:09.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:09.800 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:40:09.853 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:40:09.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:40:09.854 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:40:09.902 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:40:09.902 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:40:09.902 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:40:09.949 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:40:10.012 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:40:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:40:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:40:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:40:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:40:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:40:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:40:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:40:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:40:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:40:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:40:10.061 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:40:10.061 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:40:10.061 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:40:10.061 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:40:10.061 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:40:10.061 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:40:10.061 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:40:10.061 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:40:10.061 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:40:10.061 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:40:10.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:10.062 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:40:10.110 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:40:10.110 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:40:10.155 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:40:10.169 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:40:10.219 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:40:10.219 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:40:10.219 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:40:10.219 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:40:10.219 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:40:10.220 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:40:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:40:10.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:10.222 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:40:10.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:40:10.231+0000 7f8cb0607580 -1 init, newargv = 0x55a3f3aaa5a0 newargc=15 2024-09-19T05:40:10.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[60145]: starting ceph client 2024-09-19T05:40:10.240 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[60145]: starting fuse 2024-09-19T05:40:11.338 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:40:11.355 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:40:11.404 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:40:11.404 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:40:11.404 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:40:11.404 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:40:11.404 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:40:11.404 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:40:11.404 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:40:11.404 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:40:11.404 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:40:11.405 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:40:11.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:11.407 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:40:11.450 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:40:11.450 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:40:11.451 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:40:11.451 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:40:11.451 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:40:11.451 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:40:11.451 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:40:11.451 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:40:11.451 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:40:11.451 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:40:11.452 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:40:11.453 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:40:11.453 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:40:11.453 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:40:11.453 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:40:11.453 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:40:11.453 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:40:11.453 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:40:11.453 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:40:11.576 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.60145.asok 2024-09-19T05:40:11.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:40:11.588 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.60145.asok 2024-09-19T05:40:11.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:11.589 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.60145.asok status 2024-09-19T05:40:11.747 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:40:11.747 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:40:11.747 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:40:11.747 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:40:11.747 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:40:11.747 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:40:11.747 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:40:11.747 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "60145", 2024-09-19T05:40:11.747 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:40:11.747 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 7896, 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 7896 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3722912967 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:40:11.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3722912967 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.7896 192.168.0.1:0/3722912967", 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/3722912967", 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 83, 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 116, 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:40:11.749 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:40:11.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:11.761 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:40:11.761 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:40:11.767 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:40:11.767 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:40:11.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:11.768 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:40:11.822 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-19T05:40:12.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:11.999+0000 7f00f1c7b640 1 Processor -- start 2024-09-19T05:40:12.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:11.999+0000 7f00f1c7b640 1 -- start start 2024-09-19T05:40:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:11.999+0000 7f00f1c7b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00ec0d0aa0 0x7f00ec06e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:11.999+0000 7f00f1c7b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f00ec06eb40 0x7f00ec15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:11.999+0000 7f00f1c7b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00ec15d030 con 0x7f00ec0cf5e0 2024-09-19T05:40:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:11.999+0000 7f00f1c7b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f00ec06de90 con 0x7f00ec0d0aa0 2024-09-19T05:40:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:11.999+0000 7f00f1c7b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f00ec06e170 con 0x7f00ec06eb40 2024-09-19T05:40:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00eaffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00ec0d0aa0 0x7f00ec06e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00eaffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f00ec0d0aa0 0x7f00ec06e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59432/0 (socket says 172.21.15.67:59432) 2024-09-19T05:40:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00eaffd640 1 -- 172.21.15.67:0/4208653775 learned_addr learned my addr 172.21.15.67:0/4208653775 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:12.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00ebfff640 1 --2- 172.21.15.67:0/4208653775 >> v2:172.21.15.97:3300/0 conn(0x7f00ec06eb40 0x7f00ec15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00eaffd640 1 -- 172.21.15.67:0/4208653775 >> v2:172.21.15.97:3300/0 conn(0x7f00ec06eb40 msgr2=0x7f00ec15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:12.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00eaffd640 1 --2- 172.21.15.67:0/4208653775 >> v2:172.21.15.97:3300/0 conn(0x7f00ec06eb40 0x7f00ec15d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00eaffd640 1 -- 172.21.15.67:0/4208653775 >> v1:172.21.15.97:6789/0 conn(0x7f00ec0cf5e0 legacy=0x7f00ec15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:12.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00eaffd640 1 -- 172.21.15.67:0/4208653775 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec15d310 con 0x7f00ec0d0aa0 2024-09-19T05:40:12.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00eaffd640 1 --2- 172.21.15.67:0/4208653775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec0d0aa0 0x7f00ec06e600 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f00ec15a380 tx=0x7f00e001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73584b7e06290afb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00ea7fc640 1 -- 172.21.15.67:0/4208653775 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e00b0070 con 0x7f00ec0d0aa0 2024-09-19T05:40:12.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00ea7fc640 1 -- 172.21.15.67:0/4208653775 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e00ab600 con 0x7f00ec0d0aa0 2024-09-19T05:40:12.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.003+0000 7f00ea7fc640 1 -- 172.21.15.67:0/4208653775 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e00ab9d0 con 0x7f00ec0d0aa0 2024-09-19T05:40:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- 172.21.15.67:0/4208653775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec0d0aa0 msgr2=0x7f00ec06e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 --2- 172.21.15.67:0/4208653775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec0d0aa0 0x7f00ec06e600 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f00ec15a380 tx=0x7f00e001c520 comp rx=0 tx=0).stop 2024-09-19T05:40:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- 172.21.15.67:0/4208653775 shutdown_connections 2024-09-19T05:40:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 --2- 172.21.15.67:0/4208653775 >> v2:172.21.15.97:3300/0 conn(0x7f00ec06eb40 0x7f00ec15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 --2- 172.21.15.67:0/4208653775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec0d0aa0 0x7f00ec06e600 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- 172.21.15.67:0/4208653775 >> 172.21.15.67:0/4208653775 conn(0x7f00ec06c0c0 msgr2=0x7f00ec06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- 172.21.15.67:0/4208653775 shutdown_connections 2024-09-19T05:40:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- 172.21.15.67:0/4208653775 wait complete. 2024-09-19T05:40:12.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 Processor -- start 2024-09-19T05:40:12.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- start start 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec06eb40 0x7f00ec0b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00ec0cf5e0 0x7f00ec0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00ec0d0aa0 0x7f00ec0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec1691c0 con 0x7f00ec06eb40 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec15e220 con 0x7f00ec0cf5e0 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f00ec169340 con 0x7f00ec0d0aa0 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00eb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec06eb40 0x7f00ec0b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00eb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec06eb40 0x7f00ec0b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59448/0 (socket says 172.21.15.67:59448) 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00eb7fe640 1 -- 172.21.15.67:0/3481876950 learned_addr learned my addr 172.21.15.67:0/3481876950 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00eaffd640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00ec0cf5e0 0x7f00ec0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00ebfff640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00ec0d0aa0 0x7f00ec0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00eb7fe640 1 -- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00ec0d0aa0 msgr2=0x7f00ec0afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00eb7fe640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00ec0d0aa0 0x7f00ec0afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00eb7fe640 1 -- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00ec0cf5e0 msgr2=0x7f00ec0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00eb7fe640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00ec0cf5e0 0x7f00ec0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00eb7fe640 1 -- 172.21.15.67:0/3481876950 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec0b3d10 con 0x7f00ec06eb40 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00ebfff640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00ec0d0aa0 0x7f00ec0afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00eb7fe640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec06eb40 0x7f00ec0b36c0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c420 tx=0x7f00dc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00d3fff640 1 -- 172.21.15.67:0/3481876950 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0052d0 con 0x7f00ec06eb40 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00d3fff640 1 -- 172.21.15.67:0/3481876950 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00dc005470 con 0x7f00ec06eb40 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- 172.21.15.67:0/3481876950 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ec0b42f0 con 0x7f00ec06eb40 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00d3fff640 1 -- 172.21.15.67:0/3481876950 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc007260 con 0x7f00ec06eb40 2024-09-19T05:40:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.007+0000 7f00f1c7b640 1 -- 172.21.15.67:0/3481876950 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ec0b48b0 con 0x7f00ec06eb40 2024-09-19T05:40:12.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.011+0000 7f00f1c7b640 1 -- 172.21.15.67:0/3481876950 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00ec15d8d0 con 0x7f00ec06eb40 2024-09-19T05:40:12.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.011+0000 7f00d3fff640 1 -- 172.21.15.67:0/3481876950 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00dc007400 con 0x7f00ec06eb40 2024-09-19T05:40:12.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.011+0000 7f00d3fff640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00d80678f0 0x7f00d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.011+0000 7f00d3fff640 1 -- 172.21.15.67:0/3481876950 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f00dc085390 con 0x7f00ec06eb40 2024-09-19T05:40:12.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.011+0000 7f00eaffd640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00d80678f0 0x7f00d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.011+0000 7f00eaffd640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00d80678f0 0x7f00d8069db0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f00e00ad000 tx=0x7f00e00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.015+0000 7f00d3fff640 1 -- 172.21.15.67:0/3481876950 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f00dc055ca0 con 0x7f00ec06eb40 2024-09-19T05:40:12.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.219+0000 7f00f1c7b640 1 -- 172.21.15.67:0/3481876950 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f00ec15a0e0 con 0x7f00ec06eb40 2024-09-19T05:40:12.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.319+0000 7f00d3fff640 1 -- 172.21.15.67:0/3481876950 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v84) ==== 167+0+0 (secure 0 0 0) 0x7f00dc0555a0 con 0x7f00ec06eb40 2024-09-19T05:40:12.319 INFO:teuthology.orchestra.run.smithi067.stderr:enabled new snapshots 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 -- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00d80678f0 msgr2=0x7f00d8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00d80678f0 0x7f00d8069db0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f00e00ad000 tx=0x7f00e00a6000 comp rx=0 tx=0).stop 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 -- 172.21.15.67:0/3481876950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec06eb40 msgr2=0x7f00ec0b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec06eb40 0x7f00ec0b36c0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c420 tx=0x7f00dc00c8e0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 -- 172.21.15.67:0/3481876950 shutdown_connections 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f00d80678f0 0x7f00d8069db0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00ec0d0aa0 0x7f00ec0afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00ec0cf5e0 0x7f00ec0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 --2- 172.21.15.67:0/3481876950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00ec06eb40 0x7f00ec0b36c0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 -- 172.21.15.67:0/3481876950 >> 172.21.15.67:0/3481876950 conn(0x7f00ec06c0c0 msgr2=0x7f00ec0736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:12.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 -- 172.21.15.67:0/3481876950 shutdown_connections 2024-09-19T05:40:12.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:12.323+0000 7f00f1c7b640 1 -- 172.21.15.67:0/3481876950 wait complete. 2024-09-19T05:40:12.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:12.342 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-19T05:40:12.361 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:40:12.361 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:40:12.410 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> import uuid 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> n = 2000 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> create_hard_links = False 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> if 3 > 0: 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> create_hard_links = True 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> dpath = os.path.dirname(path) 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> fnameprefix = os.path.basename(path) 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> os.makedirs(dpath, exist_ok=True) 2024-09-19T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> try: 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> for i in range(n): 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> with open(fpath, '"'"'w'"'"') as f: 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> f.write(f"{i}") 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> f.flush() 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(f.fileno()) 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> os.unlink(fpath) 2024-09-19T05:40:12.412 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:40:12.413 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(dirfd) 2024-09-19T05:40:12.413 DEBUG:teuthology.orchestra.run.smithi067:> if create_hard_links: 2024-09-19T05:40:12.413 DEBUG:teuthology.orchestra.run.smithi067:> for j in range(3): 2024-09-19T05:40:12.413 DEBUG:teuthology.orchestra.run.smithi067:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-19T05:40:12.413 DEBUG:teuthology.orchestra.run.smithi067:> if False: 2024-09-19T05:40:12.413 DEBUG:teuthology.orchestra.run.smithi067:> os.fsync(dirfd) 2024-09-19T05:40:12.413 DEBUG:teuthology.orchestra.run.smithi067:> finally: 2024-09-19T05:40:12.413 DEBUG:teuthology.orchestra.run.smithi067:> os.close(dirfd) 2024-09-19T05:40:12.413 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:40:39.492 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:40:39.495 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:40:52.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:40:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:40:52.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:52.766 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-19T05:40:52.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:52.809 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-19T05:41:09.540 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:41:09.543 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:41:39.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:41:39.633 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:42:09.721 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:42:09.724 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:42:11.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:42:11.815 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-19T05:42:11.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-19T05:42:12.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48f00d0640 1 Processor -- start 2024-09-19T05:42:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48f00d0640 1 -- start start 2024-09-19T05:42:12.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48f00d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f48e8159c60 0x7f48e80ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48f00d0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e806ffd0 0x7f48e80aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48f00d0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48e815a040 con 0x7f48e80b3150 2024-09-19T05:42:12.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48f00d0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f48e815d460 con 0x7f48e8159c60 2024-09-19T05:42:12.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48f00d0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f48e815c850 con 0x7f48e806ffd0 2024-09-19T05:42:12.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ee66d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f48e80b3150 0x7f48e815fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50898/0 (socket says 172.21.15.67:50898) 2024-09-19T05:42:12.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ee66d640 1 -- 172.21.15.67:0/64251055 learned_addr learned my addr 172.21.15.67:0/64251055 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ede6c640 1 --2- 172.21.15.67:0/64251055 >> v2:172.21.15.97:3300/0 conn(0x7f48e8159c60 0x7f48e80ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ed66b640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e806ffd0 0x7f48e80aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2615437720 0 0) 0x7f48e815a040 con 0x7f48e80b3150 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48d4003530 con 0x7f48e80b3150 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1310302283 0 0) 0x7f48d4003530 con 0x7f48e80b3150 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e806ffd0 msgr2=0x7f48e80aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e806ffd0 0x7f48e80aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 >> v2:172.21.15.97:3300/0 conn(0x7f48e8159c60 msgr2=0x7f48e80ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 --2- 172.21.15.67:0/64251055 >> v2:172.21.15.97:3300/0 conn(0x7f48e8159c60 0x7f48e80ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e815cb30 con 0x7f48e80b3150 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f48e0001a00 con 0x7f48e80b3150 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 >> v1:172.21.15.67:6789/0 conn(0x7f48e80b3150 legacy=0x7f48e815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d40039c0 0x7f48d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e806ffd0 0x7f48d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 0x7f48d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f48e815d460 con 0x7f48d4004d50 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f48e815c850 con 0x7f48d40039c0 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f48d400b9d0 con 0x7f48e806ffd0 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ee66d640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 0x7f48d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ede6c640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d40039c0 0x7f48d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ed66b640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e806ffd0 0x7f48d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ee66d640 1 -- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e806ffd0 msgr2=0x7f48d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ee66d640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e806ffd0 0x7f48d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ee66d640 1 -- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d40039c0 msgr2=0x7f48d4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ee66d640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d40039c0 0x7f48d4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.038+0000 7f48ee66d640 1 -- 172.21.15.67:0/64251055 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d4003530 con 0x7f48d4004d50 2024-09-19T05:42:12.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48ee66d640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 0x7f48d40051d0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f48e000a8a0 tx=0x7f48e001d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4a9a7e50a2315f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e000a4c0 con 0x7f48d4004d50 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e00ad630 con 0x7f48d4004d50 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48ece6a640 1 -- 172.21.15.67:0/64251055 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e00ada20 con 0x7f48d4004d50 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48f00d0640 1 -- 172.21.15.67:0/64251055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 msgr2=0x7f48d40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48f00d0640 1 --2- 172.21.15.67:0/64251055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 0x7f48d40051d0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f48e000a8a0 tx=0x7f48e001d380 comp rx=0 tx=0).stop 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48ee66d640 1 -- 172.21.15.67:0/64251055 reap_dead start 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48f00d0640 1 -- 172.21.15.67:0/64251055 shutdown_connections 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48f00d0640 1 -- 172.21.15.67:0/64251055 >> 172.21.15.67:0/64251055 conn(0x7f48e80b1e50 msgr2=0x7f48e80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48f00d0640 1 -- 172.21.15.67:0/64251055 shutdown_connections 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48f00d0640 1 -- 172.21.15.67:0/64251055 wait complete. 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48f00d0640 1 Processor -- start 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.042+0000 7f48f00d0640 1 -- start start 2024-09-19T05:42:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48f00d0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 0x7f48e814b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48f00d0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48e80b1130 0x7f48e8155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48f00d0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e80b0750 0x7f48e80b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48f00d0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f48e80ad670 con 0x7f48d4004d50 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48f00d0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f48e815d0f0 con 0x7f48e80b1130 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48f00d0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f48e80ad7f0 con 0x7f48e80b0750 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ede6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 0x7f48e814b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ede6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 0x7f48e814b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39134/0 (socket says 172.21.15.67:39134) 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ede6c640 1 -- 172.21.15.67:0/1151419088 learned_addr learned my addr 172.21.15.67:0/1151419088 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ed66b640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48e80b1130 0x7f48e8155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ee66d640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e80b0750 0x7f48e80b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ede6c640 1 -- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e80b0750 msgr2=0x7f48e80b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ede6c640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e80b0750 0x7f48e80b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ede6c640 1 -- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48e80b1130 msgr2=0x7f48e8155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ede6c640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48e80b1130 0x7f48e8155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ede6c640 1 -- 172.21.15.67:0/1151419088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e80b1680 con 0x7f48d4004d50 2024-09-19T05:42:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ede6c640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 0x7f48e814b210 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f48e4011610 tx=0x7f48e4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48de7fc640 1 -- 172.21.15.67:0/1151419088 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4015870 con 0x7f48d4004d50 2024-09-19T05:42:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48de7fc640 1 -- 172.21.15.67:0/1151419088 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e4015a10 con 0x7f48d4004d50 2024-09-19T05:42:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48de7fc640 1 -- 172.21.15.67:0/1151419088 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4015dc0 con 0x7f48d4004d50 2024-09-19T05:42:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48f00d0640 1 -- 172.21.15.67:0/1151419088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e80b1960 con 0x7f48d4004d50 2024-09-19T05:42:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48f00d0640 1 -- 172.21.15.67:0/1151419088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e80b0230 con 0x7f48d4004d50 2024-09-19T05:42:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48de7fc640 1 -- 172.21.15.67:0/1151419088 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f48e40143e0 con 0x7f48d4004d50 2024-09-19T05:42:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48de7fc640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48cc0678f0 0x7f48cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48de7fc640 1 -- 172.21.15.67:0/1151419088 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f48e40866d0 con 0x7f48d4004d50 2024-09-19T05:42:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.046+0000 7f48ed66b640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48cc0678f0 0x7f48cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 Processor -- start 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 -- start start 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ed66b640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48cc0678f0 0x7f48cc069db0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f48e8157870 tx=0x7f48d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b8083ebc10 0x55b8083ebff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ec530 0x55b80839f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b80839f780 0x55b80839fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b8081f0cc0 con 0x55b8083ec530 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b8081aba20 con 0x55b8083ebc10 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b8081ecc80 con 0x55b80839f780 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ed66b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ec530 0x55b80839f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ed66b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ec530 0x55b80839f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39140/0 (socket says 172.21.15.67:39140) 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ed66b640 1 -- 172.21.15.67:0/3258072513 learned_addr learned my addr 172.21.15.67:0/3258072513 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ede6c640 1 --2- 172.21.15.67:0/3258072513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b8083ebc10 0x55b8083ebff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ed66b640 1 -- 172.21.15.67:0/3258072513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b80839f780 msgr2=0x55b80839fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ed66b640 1 --2- 172.21.15.67:0/3258072513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b80839f780 0x55b80839fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ed66b640 1 -- 172.21.15.67:0/3258072513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b8083ebc10 msgr2=0x55b8083ebff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ed66b640 1 --2- 172.21.15.67:0/3258072513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b8083ebc10 0x55b8083ebff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ed66b640 1 -- 172.21.15.67:0/3258072513 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b808193d40 con 0x55b8083ec530 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48ed66b640 1 --2- 172.21.15.67:0/3258072513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ec530 0x55b80839f240 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f48d80043b0 tx=0x7f48d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7976aa20d55dd560 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48cb7fe640 1 -- 172.21.15.67:0/3258072513 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8029070 con 0x55b8083ec530 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48cb7fe640 1 -- 172.21.15.67:0/3258072513 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d801f050 con 0x55b8083ec530 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48cb7fe640 1 -- 172.21.15.67:0/3258072513 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8003d20 con 0x55b8083ec530 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 -- 172.21.15.67:0/3258072513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ec530 msgr2=0x55b80839f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 --2- 172.21.15.67:0/3258072513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ec530 0x55b80839f240 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f48d80043b0 tx=0x7f48d8016000 comp rx=0 tx=0).stop 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 -- 172.21.15.67:0/3258072513 shutdown_connections 2024-09-19T05:42:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 --2- 172.21.15.67:0/3258072513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b80839f780 0x55b80839fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 --2- 172.21.15.67:0/3258072513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ec530 0x55b80839f240 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 --2- 172.21.15.67:0/3258072513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b8083ebc10 0x55b8083ebff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 -- 172.21.15.67:0/3258072513 >> 172.21.15.67:0/3258072513 conn(0x55b8083cc9b0 msgr2=0x55b8083ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 -- 172.21.15.67:0/3258072513 shutdown_connections 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 -- 172.21.15.67:0/3258072513 wait complete. 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 -- start start 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.050+0000 7f48f318c000 1 Processor -- start 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b80839f780 0x55b8083f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b8083f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 0x55b8083a5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b80818a2c0 con 0x55b8083ebc10 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b8081af370 con 0x55b80839f780 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b8081fef50 con 0x55b8083ec530 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 10 client.0 _ll_register_callbacks cb 0x55b808251db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ed66b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b8083f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ed66b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b8083f34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39156/0 (socket says 172.21.15.67:39156) 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ed66b640 1 -- 172.21.15.67:0/1879701039 learned_addr learned my addr 172.21.15.67:0/1879701039 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ede6c640 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b80839f780 0x55b8083f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ee66d640 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 0x55b8083a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ed66b640 1 -- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 msgr2=0x55b8083a5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ed66b640 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 0x55b8083a5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ed66b640 1 -- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b80839f780 msgr2=0x55b8083f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ed66b640 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b80839f780 0x55b8083f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ed66b640 1 -- 172.21.15.67:0/1879701039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b808190770 con 0x55b8083ebc10 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ed66b640 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b8083f34b0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f48d8008010 tx=0x7f48d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541fb0f788b92aee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1879701039 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8034020 con 0x55b8083ebc10 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1879701039 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f48d8030680 con 0x55b8083ebc10 2024-09-19T05:42:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 1 -- 172.21.15.67:0/1879701039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48d801f050 con 0x55b8083ebc10 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1879701039 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f48d803e050 con 0x55b8083ebc10 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 10 client.7914 fetch_fsmap learned FSMap version 84 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 1 -- 172.21.15.67:0/1879701039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55b8081ae3f0 con 0x55b8083ebc10 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1879701039 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d801f050 con 0x55b8083ebc10 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1879701039 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f48d8041020 con 0x55b8083ebc10 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 10 client.7914 fetch_fsmap finished waiting for FSMap version 84 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 10 client.7914 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 20 client.7914 populate_metadata read hostname 'smithi067' 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55b8083a5e90 0x55b8083a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 4 client.7914 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48f318c000 1 -- 172.21.15.67:0/1879701039 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b80818ad90 con 0x55b8083a5e90 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ede6c640 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55b8083a5e90 0x55b8083a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48c8ff9640 10 client.7914 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.054+0000 7f48ede6c640 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55b8083a5e90 0x55b8083a62a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23e48c84d3f913ea server_cookie=21dba00d2c64977 in_seq=0 out_seq=0 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1879701039 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b80818ad90 con 0x55b8083a5e90 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48c8ff9640 10 client.7914 handle_command_reply: tid=0 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 client.7914 shutdown 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 -- 172.21.15.67:0/1879701039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 msgr2=0x55b8083f34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b8083f34b0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f48d8008010 tx=0x7f48d8004740 comp rx=0 tx=0).stop 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 -- 172.21.15.67:0/1879701039 shutdown_connections 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55b8083a5e90 0x55b8083a62a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 0x55b8083a5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b8083f34b0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48c8ff9640 0 client.7914 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 --2- 172.21.15.67:0/1879701039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b80839f780 0x55b8083f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 -- 172.21.15.67:0/1879701039 >> 172.21.15.67:0/1879701039 conn(0x55b8083cc9b0 msgr2=0x55b80839e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 -- 172.21.15.67:0/1879701039 shutdown_connections 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 1 -- 172.21.15.67:0/1879701039 wait complete. 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.058+0000 7f48f318c000 20 client.7914 trim_cache size 0 max 16384 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 Processor -- start 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 -- start start 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b80839f780 0x55b808402310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ebc10 0x55b808402850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b8083ec530 0x55b808402d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f48e8200740 con 0x55b80839f780 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f48e81ffad0 con 0x55b8083ec530 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f48e82000f0 con 0x55b8083ebc10 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48ede6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b80839f780 0x55b808402310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48ede6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b80839f780 0x55b808402310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39168/0 (socket says 172.21.15.67:39168) 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48ede6c640 1 -- 172.21.15.67:0/3635095121 learned_addr learned my addr 172.21.15.67:0/3635095121 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48ede6c640 1 -- 172.21.15.67:0/3635095121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ebc10 msgr2=0x55b808402850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48ede6c640 1 --2- 172.21.15.67:0/3635095121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ebc10 0x55b808402850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48ede6c640 1 -- 172.21.15.67:0/3635095121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b8083ec530 msgr2=0x55b808402d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48ede6c640 1 --2- 172.21.15.67:0/3635095121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b8083ec530 0x55b808402d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48ede6c640 1 -- 172.21.15.67:0/3635095121 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b808272320 con 0x55b80839f780 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48ede6c640 1 --2- 172.21.15.67:0/3635095121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b80839f780 0x55b808402310 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f48e401c000 tx=0x7f48e4086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1734621883573e09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48caffd640 1 -- 172.21.15.67:0/3635095121 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4022040 con 0x55b80839f780 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48caffd640 1 -- 172.21.15.67:0/3635095121 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e405f540 con 0x55b80839f780 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48caffd640 1 -- 172.21.15.67:0/3635095121 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4054a00 con 0x55b80839f780 2024-09-19T05:42:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 -- 172.21.15.67:0/3635095121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b80839f780 msgr2=0x55b808402310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 --2- 172.21.15.67:0/3635095121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b80839f780 0x55b808402310 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f48e401c000 tx=0x7f48e4086040 comp rx=0 tx=0).stop 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 -- 172.21.15.67:0/3635095121 shutdown_connections 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 --2- 172.21.15.67:0/3635095121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b8083ec530 0x55b808402d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 --2- 172.21.15.67:0/3635095121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ebc10 0x55b808402850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 --2- 172.21.15.67:0/3635095121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b80839f780 0x55b808402310 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 -- 172.21.15.67:0/3635095121 >> 172.21.15.67:0/3635095121 conn(0x55b8083cc9b0 msgr2=0x55b80839da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 -- 172.21.15.67:0/3635095121 shutdown_connections 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.074+0000 7f48f318c000 1 -- 172.21.15.67:0/3635095121 wait complete. 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 -- start start 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 Processor -- start 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b80839f780 0x55b80845fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b808460040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 0x55b8083f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b808198120 con 0x55b8083ebc10 2024-09-19T05:42:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b808271e90 con 0x55b80839f780 2024-09-19T05:42:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b80819ab90 con 0x55b8083ec530 2024-09-19T05:42:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 10 client.0 _ll_register_callbacks cb 0x7f48d8027070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ed66b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b808460040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ed66b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b808460040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39178/0 (socket says 172.21.15.67:39178) 2024-09-19T05:42:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ed66b640 1 -- 172.21.15.67:0/1291899643 learned_addr learned my addr 172.21.15.67:0/1291899643 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ede6c640 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b80839f780 0x55b80845fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ee66d640 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 0x55b8083f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ed66b640 1 -- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 msgr2=0x55b8083f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ed66b640 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 0x55b8083f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ed66b640 1 -- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b80839f780 msgr2=0x55b80845fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ed66b640 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b80839f780 0x55b80845fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ed66b640 1 -- 172.21.15.67:0/1291899643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8081845c0 con 0x55b8083ebc10 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ee66d640 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 0x55b8083f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ed66b640 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b808460040 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f48d8013720 tx=0x7f48d8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf5af3381aebf04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1291899643 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8034070 con 0x55b8083ebc10 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1291899643 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f48d8030cc0 con 0x55b8083ebc10 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 -- 172.21.15.67:0/1291899643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e405f540 con 0x55b8083ebc10 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1291899643 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f48d804f050 con 0x55b8083ebc10 2024-09-19T05:42:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 10 client.7920 fetch_fsmap learned FSMap version 84 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 -- 172.21.15.67:0/1291899643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55b808188330 con 0x55b8083ebc10 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1291899643 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e405f540 con 0x55b8083ebc10 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1291899643 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f48d8052020 con 0x55b8083ebc10 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 10 client.7920 fetch_fsmap finished waiting for FSMap version 84 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 10 client.7920 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 20 client.7920 populate_metadata read hostname 'smithi067' 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55b8083f85e0 0x55b8083f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 4 client.7920 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48f318c000 1 -- 172.21.15.67:0/1291899643 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55b8081fe3f0 con 0x55b8083f85e0 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ede6c640 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55b8083f85e0 0x55b8083f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48ede6c640 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55b8083f85e0 0x55b8083f89f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eb788fc6c2781b5 server_cookie=1c7babb4849d5e8b in_seq=0 out_seq=0 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.078+0000 7f48c8ff9640 10 client.7920 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48c8ff9640 1 -- 172.21.15.67:0/1291899643 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18004 (crc 0 0 0) 0x55b8081fe3f0 con 0x55b8083f85e0 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48c8ff9640 10 client.7920 handle_command_reply: tid=0 2024-09-19T05:42:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 client.7920 shutdown 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 -- 172.21.15.67:0/1291899643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 msgr2=0x55b808460040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b808460040 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f48d8013720 tx=0x7f48d8009190 comp rx=0 tx=0).stop 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 -- 172.21.15.67:0/1291899643 shutdown_connections 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55b8083f85e0 0x55b8083f89f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b8083ec530 0x55b8083f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8083ebc10 0x55b808460040 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48c8ff9640 0 client.7920 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 --2- 172.21.15.67:0/1291899643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b80839f780 0x55b80845fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 -- 172.21.15.67:0/1291899643 >> 172.21.15.67:0/1291899643 conn(0x55b8083cc9b0 msgr2=0x55b808402b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 -- 172.21.15.67:0/1291899643 shutdown_connections 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 1 -- 172.21.15.67:0/1291899643 wait complete. 2024-09-19T05:42:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f318c000 20 client.7920 trim_cache size 0 max 16384 2024-09-19T05:42:12.469 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:42:12.469 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:42:12.469 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 3413, 2024-09-19T05:42:12.469 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 3412, 2024-09-19T05:42:12.469 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 1033575, 2024-09-19T05:42:12.469 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 18091233, 2024-09-19T05:42:12.469 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 9, 2024-09-19T05:42:12.469 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 3, 2024-09-19T05:42:12.469 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.490167847, 2024-09-19T05:42:12.469 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.205905327, 2024-09-19T05:42:12.470 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.101323962, 2024-09-19T05:42:12.470 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.143928078, 2024-09-19T05:42:12.470 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:42:12.470 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3411, 2024-09-19T05:42:12.470 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.369523186, 2024-09-19T05:42:12.470 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000108332 2024-09-19T05:42:12.470 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.470 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:42:12.470 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000381, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000190 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 2540, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 2535, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 738519, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 21892105, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 5, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-19T05:42:12.471 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.444249865, 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.198677968, 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.092125861, 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.126167978, 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2535, 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.615053218, 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000242624 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.472 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 119568, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 29680 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 35633, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 62148, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 12482679, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 74029445, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 8, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 6.749784575, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 3.292470235, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 3.772889426, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.206713362, 2024-09-19T05:42:12.473 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 62146, 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 3.063304112, 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000049292 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 87635, 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.033937295, 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000387 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 136976 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-19T05:42:12.474 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 1, 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-MDSRank": { 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 10276, 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 34.151728390, 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.003323445 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-PurgeQueue": { 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1930, 2024-09-19T05:42:12.475 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 1.696091724, 2024-09-19T05:42:12.476 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000878804 2024-09-19T05:42:12.476 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.476 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.476 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-09-19T05:42:12.476 INFO:teuthology.orchestra.run.smithi067.stdout: "request": 27344, 2024-09-19T05:42:12.476 INFO:teuthology.orchestra.run.smithi067.stdout: "reply": 27344, 2024-09-19T05:42:12.476 INFO:teuthology.orchestra.run.smithi067.stdout: "reply_latency": { 2024-09-19T05:42:12.476 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 27344, 2024-09-19T05:42:12.476 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 459.454466901, 2024-09-19T05:42:12.476 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.016802752 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_reply": 0, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "forward": 0, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_complete": 0, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_keys": 0, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_commit": 12, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_split": 0, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_merge": 0, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes": 19922, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_top": 0, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_bottom": 19922, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pin_tail": 0, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pinned": 19922, 2024-09-19T05:42:12.477 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_expired": 0, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_with_caps": 216, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": 216, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "subtrees": 2, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse": 44236, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_hit": 43652, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_forward": 0, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_discover": 0, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_dir_fetch": 0, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_remote_ino": 0, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_lock": 119, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "load_cent": 0, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "q": 0, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "exported": 0, 2024-09-19T05:42:12.478 INFO:teuthology.orchestra.run.smithi067.stdout: "exported_inodes": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "imported": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "imported_inodes": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_dir_fetch": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_backtrace_fetch": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_peer_discover": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rfiles": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rbytes": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rsnaps": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_set_tag": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_inodes": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T05:42:12.479 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_file_inodes": 0, 2024-09-19T05:42:12.480 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_inode_file_caps": 0, 2024-09-19T05:42:12.480 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_revoke": 6621, 2024-09-19T05:42:12.480 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_grant": 6659, 2024-09-19T05:42:12.480 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T05:42:12.480 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:42:12.480 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:42:12.480 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps": 6621, 2024-09-19T05:42:12.480 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps_dirty": 2000, 2024-09-19T05:42:12.480 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_cap_release": 58, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "process_request_cap_release": 17908 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_cache": { 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update": 0, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update_receipt": 0, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_try_discover": 0, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_send_discover": 0, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_handle_discover": 0, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays": 2000, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_delayed": 56, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_created": 4204, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_enqueued": 1731, 2024-09-19T05:42:12.481 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_reintegrated": 2263, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_migrated": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_processing": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_started": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_completed": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_exportdir": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_flush": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragmentdir": 0, 2024-09-19T05:42:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragstats": 0, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_inodestats": 0 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_log": { 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "evlrg": 0, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "evadd": 23124, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "evex": 0, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "evtrm": 0, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "ev": 23124, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "evexg": 0, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "evexd": 0, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "segadd": 31, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "segex": 0, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "segtrm": 0, 2024-09-19T05:42:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: "seg": 31, 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "segmjr": 3, 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "segexg": 0, 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "segexd": 0, 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "expos": 4194304, 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "wrpos": 84708133, 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "rdpos": 0, 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "jlat": { 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7385, 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 115.250687129, 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.015606051 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: "replayed": 0 2024-09-19T05:42:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_mem": { 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 2014, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "ino+": 2014, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "ino-": 0, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "dir": 13, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "dir+": 13, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "dir-": 0, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "dn": 19922, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "dn+": 19922, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "dn-": 0, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "cap": 216, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "cap+": 2002, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "cap-": 1786, 2024-09-19T05:42:12.485 INFO:teuthology.orchestra.run.smithi067.stdout: "rss": 102396, 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "heap": 231732 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_server": { 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_client_request": 36421, 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_server_request": 0, 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_request": 27344, 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_session": 9, 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_peer_request": 0, 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "req_create_latency": { 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2000, 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 3.769485019, 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001884742 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.486 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getattr_latency": { 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1117, 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.892437837, 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000798959 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getfilelock_latency": { 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: "req_link_latency": { 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6000, 2024-09-19T05:42:12.487 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 22.101988653, 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.003683664 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookup_latency": { 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7951, 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 9.814257295, 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001234342 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookuphash_latency": { 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.488 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupino_latency": { 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupname_latency": { 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupparent_latency": { 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.489 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupsnap_latency": { 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3, 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.050293657, 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.016764552 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lssnap_latency": { 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mkdir_latency": { 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:42:12.490 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.005417198, 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005417198 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mknod_latency": { 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mksnap_latency": { 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.006730911, 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.006730911 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "req_open_latency": { 2024-09-19T05:42:12.491 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: "req_readdir_latency": { 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6, 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.268890625, 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.044815104 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rename_latency": { 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2263, 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 377.348057839, 2024-09-19T05:42:12.492 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.166746821 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: "req_renamesnap_latency": { 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: "req_snapdiff_latency": { 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmdir_latency": { 2024-09-19T05:42:12.493 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmsnap_latency": { 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.008686690, 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.008686690 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmxattr_latency": { 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.494 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setattr_latency": { 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000966742, 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000966742 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setdirlayout_latency": { 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setfilelock_latency": { 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.495 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setlayout_latency": { 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setxattr_latency": { 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "req_symlink_latency": { 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.496 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.497 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.497 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.497 INFO:teuthology.orchestra.run.smithi067.stdout: "req_unlink_latency": { 2024-09-19T05:42:12.497 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8000, 2024-09-19T05:42:12.497 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 45.187254435, 2024-09-19T05:42:12.498 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005648406 2024-09-19T05:42:12.498 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.498 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getvxattr_latency": { 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_sessions": { 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: "session_count": 1, 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: "session_add": 1, 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: "session_remove": 0, 2024-09-19T05:42:12.499 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_open": 1, 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_stale": 0, 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: "total_load": 13381, 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: "average_load": 13381, 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: "avg_session_uptime": 118, 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: "mdthresh_evicted": 0 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:42:12.500 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:42:12.501 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-19T05:42:12.502 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 18856517, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 4774, 2024-09-19T05:42:12.503 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 5520, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 78, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:42:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 21205658, 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 819960, 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "objecter": { 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "op_active": 0, 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "op_laggy": 0, 2024-09-19T05:42:12.505 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send": 9608, 2024-09-19T05:42:12.506 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send_bytes": 80894097, 2024-09-19T05:42:12.506 INFO:teuthology.orchestra.run.smithi067.stdout: "op_resend": 26, 2024-09-19T05:42:12.506 INFO:teuthology.orchestra.run.smithi067.stdout: "op_reply": 9608, 2024-09-19T05:42:12.506 INFO:teuthology.orchestra.run.smithi067.stdout: "op_latency": { 2024-09-19T05:42:12.506 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 9608, 2024-09-19T05:42:12.506 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 45.679573944, 2024-09-19T05:42:12.506 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.004754327 2024-09-19T05:42:12.506 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "op_inflight": 0, 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "oplen_avg": { 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 9608, 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 9811 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "op": 9608, 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "op_r": 123, 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "op_w": 9485, 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "op_rmw": 0, 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "op_pg": 0, 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_stat": 0, 2024-09-19T05:42:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_create": 11, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_read": 123, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_write": 7508, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writefull": 73, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writesame": 0, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_append": 0, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_zero": 1731, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_truncate": 0, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_delete": 31, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_mapext": 0, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_sparse_read": 0, 2024-09-19T05:42:12.508 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_clonerange": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_getxattr": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_setxattr": 22, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_rmxattr": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_call": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_watch": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_notify": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:42:12.509 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_other": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_active": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_send": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_resend": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_ping": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_active": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_send": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_resend": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_active": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_send": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_resend": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_active": 0, 2024-09-19T05:42:12.510 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_send": 0, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_resend": 0, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "command_active": 0, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "command_send": 0, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "command_resend": 0, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "map_epoch": 118, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "map_full": 0, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "map_inc": 3, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_sessions": 8, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_open": 8, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_close": 0, 2024-09-19T05:42:12.511 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_laggy": 0, 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_wr": 248, 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_rd": 0, 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_del": 64 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: "oft": { 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_objs": 1, 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_updates": 0, 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_removes": 0 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: "osd-slow-ops": { 2024-09-19T05:42:12.512 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_ops_count": 0 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: "purge_queue": { 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops": 0, 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops_high_water": 32, 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing": 0, 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_high_water": 32, 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed_ops": 1731, 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed": 1731, 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_item_in_journal": 0 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:42:12.513 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 41582, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 10506935, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 41582, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 41582, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 10506935, 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:42:12.514 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_bytes": { 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:42:12.515 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 9608, 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 81082776, 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 9608, 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 81082776, 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.516 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_ops": { 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 1024, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 9608, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 9608, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 9608, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 9608, 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:42:12.517 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 1731, 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 188679, 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:42:12.518 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 1731, 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 123, 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 188679, 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle-0x55f7738d4780": { 2024-09-19T05:42:12.519 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 84, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 23124, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 80513829, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 23124, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 7385, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 80513745, 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:42:12.520 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:12.521 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:12.521 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:12.521 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.521 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.521 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:42:12.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 -- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48cc0678f0 msgr2=0x7f48cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48cc0678f0 0x7f48cc069db0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f48e8157870 tx=0x7f48d8008040 comp rx=0 tx=0).stop 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 -- 172.21.15.67:0/1151419088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 msgr2=0x7f48e814b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 0x7f48e814b210 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f48e4011610 tx=0x7f48e4011ad0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 -- 172.21.15.67:0/1151419088 shutdown_connections 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f48cc0678f0 0x7f48cc069db0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48e80b0750 0x7f48e80b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48e80b1130 0x7f48e8155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 --2- 172.21.15.67:0/1151419088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48d4004d50 0x7f48e814b210 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 -- 172.21.15.67:0/1151419088 >> 172.21.15.67:0/1151419088 conn(0x7f48e80b1e50 msgr2=0x7f48e806f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 -- 172.21.15.67:0/1151419088 shutdown_connections 2024-09-19T05:42:12.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.082+0000 7f48f00d0640 1 -- 172.21.15.67:0/1151419088 wait complete. 2024-09-19T05:42:12.524 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-19T05:42:12.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:42:12.524 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start '~mdsdir' recursive 2024-09-19T05:42:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.666+0000 7fdcfaee5640 1 Processor -- start 2024-09-19T05:42:12.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.666+0000 7fdcfaee5640 1 -- start start 2024-09-19T05:42:12.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcfaee5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf40cf5e0 0x7fdcf40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcfaee5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdcf415c850 0x7fdcf406e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcfaee5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcf415d030 con 0x7fdcf406eb40 2024-09-19T05:42:12.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcfaee5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fdcf406de90 con 0x7fdcf415c850 2024-09-19T05:42:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcfaee5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf406e170 con 0x7fdcf40cf5e0 2024-09-19T05:42:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf9482640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdcf406eb40 0x7fdcf415d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50910/0 (socket says 172.21.15.67:50910) 2024-09-19T05:42:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf9482640 1 -- 172.21.15.67:0/951603745 learned_addr learned my addr 172.21.15.67:0/951603745 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/951603745 >> v2:172.21.15.97:3300/0 conn(0x7fdcf415c850 0x7fdcf406e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf40cf5e0 0x7fdcf40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205315874 0 0) 0x7fdcf415d030 con 0x7fdcf406eb40 2024-09-19T05:42:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce4003530 con 0x7fdcf406eb40 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2399090104 0 0) 0x7fdce4003530 con 0x7fdcf406eb40 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf40cf5e0 msgr2=0x7fdcf40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf40cf5e0 0x7fdcf40d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 >> v2:172.21.15.97:3300/0 conn(0x7fdcf415c850 msgr2=0x7fdcf406e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 --2- 172.21.15.67:0/951603745 >> v2:172.21.15.97:3300/0 conn(0x7fdcf415c850 0x7fdcf406e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf415d310 con 0x7fdcf406eb40 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fdcec001a00 con 0x7fdcf406eb40 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 >> v1:172.21.15.67:6789/0 conn(0x7fdcf406eb40 legacy=0x7fdcf415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdce40039c0 0x7fdce4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf40cf5e0 0x7fdce4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdce4004d50 0x7fdce40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf406de90 con 0x7fdce4004d50 2024-09-19T05:42:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf406e170 con 0x7fdce40039c0 2024-09-19T05:42:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdce400b9d0 con 0x7fdcf40cf5e0 2024-09-19T05:42:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf9482640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdce4004d50 0x7fdce40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdce40039c0 0x7fdce4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf40cf5e0 0x7fdce4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf9482640 1 -- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf40cf5e0 msgr2=0x7fdce4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf9482640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf40cf5e0 0x7fdce4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf9482640 1 -- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdce40039c0 msgr2=0x7fdce4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf9482640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdce40039c0 0x7fdce4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.670+0000 7fdcf9482640 1 -- 172.21.15.67:0/951603745 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce4003530 con 0x7fdce4004d50 2024-09-19T05:42:12.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf9482640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdce4004d50 0x7fdce40051d0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00a880 tx=0x7fdcec01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588d443b62c18d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec00a4a0 con 0x7fdce4004d50 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec0ad630 con 0x7fdce4004d50 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf37fe640 1 -- 172.21.15.67:0/951603745 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0ada20 con 0x7fdce4004d50 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 -- 172.21.15.67:0/951603745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdce4004d50 msgr2=0x7fdce40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 --2- 172.21.15.67:0/951603745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdce4004d50 0x7fdce40051d0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00a880 tx=0x7fdcec01d3a0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf9482640 1 -- 172.21.15.67:0/951603745 reap_dead start 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 -- 172.21.15.67:0/951603745 shutdown_connections 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 -- 172.21.15.67:0/951603745 >> 172.21.15.67:0/951603745 conn(0x7fdcf406c0c0 msgr2=0x7fdcf406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 -- 172.21.15.67:0/951603745 shutdown_connections 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 -- 172.21.15.67:0/951603745 wait complete. 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 Processor -- start 2024-09-19T05:42:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 -- start start 2024-09-19T05:42:12.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf415f870 0x7fdcf415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf415e780 0x7fdcf414ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcf414d230 0x7fdcf4099570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf40cf9c0 con 0x7fdcf415e780 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf415ccb0 con 0x7fdcf414d230 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcfaee5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf40cfb40 con 0x7fdcf415f870 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf415e780 0x7fdcf414ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf415e780 0x7fdcf414ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39186/0 (socket says 172.21.15.67:39186) 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf3fff640 1 -- 172.21.15.67:0/1212681080 learned_addr learned my addr 172.21.15.67:0/1212681080 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf415f870 0x7fdcf415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf9482640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcf414d230 0x7fdcf4099570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf3fff640 1 -- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf415f870 msgr2=0x7fdcf415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf415f870 0x7fdcf415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf3fff640 1 -- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcf414d230 msgr2=0x7fdcf4099570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcf414d230 0x7fdcf4099570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf3fff640 1 -- 172.21.15.67:0/1212681080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf4156f20 con 0x7fdcf415e780 2024-09-19T05:42:12.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.674+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf415e780 0x7fdcf414ccf0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fdce0011b00 tx=0x7fdce0009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcf17fa640 1 -- 172.21.15.67:0/1212681080 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce000fc10 con 0x7fdcf415e780 2024-09-19T05:42:12.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcf17fa640 1 -- 172.21.15.67:0/1212681080 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce000fdb0 con 0x7fdcf415e780 2024-09-19T05:42:12.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcfaee5640 1 -- 172.21.15.67:0/1212681080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf4157200 con 0x7fdcf415e780 2024-09-19T05:42:12.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcf17fa640 1 -- 172.21.15.67:0/1212681080 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce0014660 con 0x7fdcf415e780 2024-09-19T05:42:12.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcfaee5640 1 -- 172.21.15.67:0/1212681080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf41577c0 con 0x7fdcf415e780 2024-09-19T05:42:12.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcf17fa640 1 -- 172.21.15.67:0/1212681080 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdce0012040 con 0x7fdcf415e780 2024-09-19T05:42:12.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcf17fa640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdcd80678f0 0x7fdcd8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcf17fa640 1 -- 172.21.15.67:0/1212681080 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7fdce0086530 con 0x7fdcf415e780 2024-09-19T05:42:12.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdcd80678f0 0x7fdcd8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcfdfa1000 1 Processor -- start 2024-09-19T05:42:12.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcfdfa1000 1 -- start start 2024-09-19T05:42:12.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.678+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdcd80678f0 0x7fdcd8069db0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009aa0 tx=0x7fdce8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343df8840 0x55d343df8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343daeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343daf000 0x55d343daf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d343bfcb20 con 0x55d343df9160 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d343bb7870 con 0x55d343daf000 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d343bf8ae0 con 0x55d343df8840 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343daeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343daeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39202/0 (socket says 172.21.15.67:39202) 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 -- 172.21.15.67:0/1704674342 learned_addr learned my addr 172.21.15.67:0/1704674342 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/1704674342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343df8840 0x55d343df8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf9482640 1 --2- 172.21.15.67:0/1704674342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343daf000 0x55d343daf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 -- 172.21.15.67:0/1704674342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343df8840 msgr2=0x55d343df8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/1704674342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343df8840 0x55d343df8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 -- 172.21.15.67:0/1704674342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343daf000 msgr2=0x55d343daf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/1704674342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343daf000 0x55d343daf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 -- 172.21.15.67:0/1704674342 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d343bcf940 con 0x55d343df9160 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/1704674342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343daeac0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fdce00848b0 tx=0x7fdce0057010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73546e1a8ac121b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcde7fc640 1 -- 172.21.15.67:0/1704674342 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce005f430 con 0x55d343df9160 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcde7fc640 1 -- 172.21.15.67:0/1704674342 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce005d0c0 con 0x55d343df9160 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcde7fc640 1 -- 172.21.15.67:0/1704674342 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce0052ec0 con 0x55d343df9160 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/1704674342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 msgr2=0x55d343daeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/1704674342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343daeac0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fdce00848b0 tx=0x7fdce0057010 comp rx=0 tx=0).stop 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/1704674342 shutdown_connections 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/1704674342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343daf000 0x55d343daf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/1704674342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343daeac0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/1704674342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343df8840 0x55d343df8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/1704674342 >> 172.21.15.67:0/1704674342 conn(0x55d343db5160 msgr2=0x55d343dad3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/1704674342 shutdown_connections 2024-09-19T05:42:12.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/1704674342 wait complete. 2024-09-19T05:42:12.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- start start 2024-09-19T05:42:12.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 Processor -- start 2024-09-19T05:42:12.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343de5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343db39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 0x55d343db3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d343bc98e0 con 0x55d343df8840 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d343ba09b0 con 0x55d343df9160 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d343bc4260 con 0x55d343daf000 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcfdfa1000 10 client.0 _ll_register_callbacks cb 0x55d343d9a540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343db39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343db39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39208/0 (socket says 172.21.15.67:39208) 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 -- 172.21.15.67:0/2437993113 learned_addr learned my addr 172.21.15.67:0/2437993113 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf9482640 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 0x55d343db3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 -- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 msgr2=0x55d343de5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343de5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343de5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 -- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 msgr2=0x55d343db3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 0x55d343db3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 -- 172.21.15.67:0/2437993113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d343bb7ac0 con 0x55d343df8840 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343db39e0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fdce0086850 tx=0x7fdce0086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a95dcd15f87403 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.682+0000 7fdcd37fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcd37fe640 1 -- 172.21.15.67:0/2437993113 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce0054c10 con 0x55d343df8840 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/2437993113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdce005d0c0 con 0x55d343df8840 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcd37fe640 1 -- 172.21.15.67:0/2437993113 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7fdce005f1b0 con 0x55d343df8840 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcd37fe640 1 -- 172.21.15.67:0/2437993113 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fdce0057b80 con 0x55d343df8840 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 10 client.7932 fetch_fsmap learned FSMap version 84 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/2437993113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55d343b9c810 con 0x55d343df8840 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcd37fe640 1 -- 172.21.15.67:0/2437993113 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce005d0c0 con 0x55d343df8840 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcd37fe640 1 -- 172.21.15.67:0/2437993113 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7fdce006ace0 con 0x55d343df8840 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 10 client.7932 fetch_fsmap finished waiting for FSMap version 84 2024-09-19T05:42:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 10 client.7932 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-19T05:42:12.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 20 client.7932 populate_metadata read hostname 'smithi067' 2024-09-19T05:42:12.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55d343de6710 0x55d343e098e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 4 client.7932 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:42:12.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/2437993113 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d343b96e30 con 0x55d343de6710 2024-09-19T05:42:12.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55d343de6710 0x55d343e098e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcd37fe640 10 client.7932 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55d343de6710 0x55d343e098e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc70736aa3943e7a server_cookie=f01ac8739c54d44f in_seq=0 out_seq=0 2024-09-19T05:42:12.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcd37fe640 1 -- 172.21.15.67:0/2437993113 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d343b96e30 con 0x55d343de6710 2024-09-19T05:42:12.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcd37fe640 10 client.7932 handle_command_reply: tid=0 2024-09-19T05:42:12.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 client.7932 shutdown 2024-09-19T05:42:12.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/2437993113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 msgr2=0x55d343db39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343db39e0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fdce0086850 tx=0x7fdce0086040 comp rx=0 tx=0).stop 2024-09-19T05:42:12.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/2437993113 shutdown_connections 2024-09-19T05:42:12.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55d343de6710 0x55d343e098e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 0x55d343db3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343db39e0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcd37fe640 0 client.7932 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/2437993113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343de5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/2437993113 >> 172.21.15.67:0/2437993113 conn(0x55d343db5160 msgr2=0x55d343dad3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/2437993113 shutdown_connections 2024-09-19T05:42:12.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/2437993113 wait complete. 2024-09-19T05:42:12.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.686+0000 7fdcfdfa1000 20 client.7932 trim_cache size 0 max 16384 2024-09-19T05:42:12.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcfdfa1000 1 Processor -- start 2024-09-19T05:42:12.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcfdfa1000 1 -- start start 2024-09-19T05:42:12.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343e67810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343e67d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 0x55d343e68290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41ff9b0 con 0x55d343df8840 2024-09-19T05:42:12.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41fea30 con 0x55d343df9160 2024-09-19T05:42:12.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf41f6110 con 0x55d343daf000 2024-09-19T05:42:12.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343e67d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343e67d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39210/0 (socket says 172.21.15.67:39210) 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf3fff640 1 -- 172.21.15.67:0/742983187 learned_addr learned my addr 172.21.15.67:0/742983187 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf9482640 1 --2- 172.21.15.67:0/742983187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 0x55d343e68290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf3fff640 1 -- 172.21.15.67:0/742983187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 msgr2=0x55d343e67810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/742983187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343e67810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/742983187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343e67810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf3fff640 1 -- 172.21.15.67:0/742983187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 msgr2=0x55d343e68290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/742983187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 0x55d343e68290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf3fff640 1 -- 172.21.15.67:0/742983187 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d343bba240 con 0x55d343df8840 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf9482640 1 --2- 172.21.15.67:0/742983187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 0x55d343e68290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/742983187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343e67d50 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fdce0084880 tx=0x7fdce006f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cad48e4566bffb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcddffb640 1 -- 172.21.15.67:0/742983187 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce0056620 con 0x55d343df8840 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcddffb640 1 -- 172.21.15.67:0/742983187 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce0054c10 con 0x55d343df8840 2024-09-19T05:42:12.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.706+0000 7fdcddffb640 1 -- 172.21.15.67:0/742983187 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce00860b0 con 0x55d343df8840 2024-09-19T05:42:12.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/742983187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 msgr2=0x55d343e67d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/742983187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343e67d50 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fdce0084880 tx=0x7fdce006f000 comp rx=0 tx=0).stop 2024-09-19T05:42:12.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/742983187 shutdown_connections 2024-09-19T05:42:12.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/742983187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df9160 0x55d343e68290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/742983187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df8840 0x55d343e67d50 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/742983187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343e67810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/742983187 >> 172.21.15.67:0/742983187 conn(0x55d343db5160 msgr2=0x55d343df7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/742983187 shutdown_connections 2024-09-19T05:42:12.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/742983187 wait complete. 2024-09-19T05:42:12.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- start start 2024-09-19T05:42:12.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 Processor -- start 2024-09-19T05:42:12.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343e6b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df8840 0x55d343e6bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343e26c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d343bc9520 con 0x55d343df9160 2024-09-19T05:42:12.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41fe3e0 con 0x55d343df8840 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d343bfbe30 con 0x55d343daf000 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 10 client.0 _ll_register_callbacks cb 0x7fdce00561b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf9482640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343e26c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf9482640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343e26c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39216/0 (socket says 172.21.15.67:39216) 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf9482640 1 -- 172.21.15.67:0/4053197108 learned_addr learned my addr 172.21.15.67:0/4053197108 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343e6b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf3fff640 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df8840 0x55d343e6bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf9482640 1 -- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 msgr2=0x55d343e6b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf9482640 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343e6b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf9482640 1 -- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df8840 msgr2=0x55d343e6bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf9482640 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df8840 0x55d343e6bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf9482640 1 -- 172.21.15.67:0/4053197108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d343c7f330 con 0x55d343df9160 2024-09-19T05:42:12.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf9482640 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343e26c10 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fdcec098dc0 tx=0x7fdcec01a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214e53f2b59a010f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcd37fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcd37fe640 1 -- 172.21.15.67:0/4053197108 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec002000 con 0x55d343df9160 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcd37fe640 1 -- 172.21.15.67:0/4053197108 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7fdcec0b2040 con 0x55d343df9160 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/4053197108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d343c0a250 con 0x55d343df9160 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcd37fe640 1 -- 172.21.15.67:0/4053197108 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fdcec0c3050 con 0x55d343df9160 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 10 client.7938 fetch_fsmap learned FSMap version 84 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/4053197108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55d3438b7400 con 0x55d343df9160 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcd37fe640 1 -- 172.21.15.67:0/4053197108 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d343c0a250 con 0x55d343df9160 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcd37fe640 1 -- 172.21.15.67:0/4053197108 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7fdcec0c6020 con 0x55d343df9160 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 10 client.7938 fetch_fsmap finished waiting for FSMap version 84 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 10 client.7938 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 20 client.7938 populate_metadata read hostname 'smithi067' 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55d343e27150 0x55d343e27560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 4 client.7938 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-19T05:42:12.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/4053197108 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55d343c045a0 con 0x55d343e27150 2024-09-19T05:42:12.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.710+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55d343e27150 0x55d343e27560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.714+0000 7fdcf8c81640 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55d343e27150 0x55d343e27560 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ef6ee7cafb65c server_cookie=a950db6dd1ab3104 in_seq=0 out_seq=0 2024-09-19T05:42:12.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.714+0000 7fdcd37fe640 10 client.7938 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcd37fe640 1 -- 172.21.15.67:0/4053197108 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d343c045a0 con 0x55d343e27150 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcd37fe640 10 client.7938 handle_command_reply: tid=0 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 client.7938 shutdown 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/4053197108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 msgr2=0x55d343e26c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343e26c10 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fdcec098dc0 tx=0x7fdcec01a140 comp rx=0 tx=0).stop 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/4053197108 shutdown_connections 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x55d343e27150 0x55d343e27560 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d343df9160 0x55d343e26c10 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d343df8840 0x55d343e6bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 --2- 172.21.15.67:0/4053197108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d343daf000 0x55d343e6b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcd37fe640 0 client.7938 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/4053197108 >> 172.21.15.67:0/4053197108 conn(0x55d343db5160 msgr2=0x55d343df8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/4053197108 shutdown_connections 2024-09-19T05:42:12.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 1 -- 172.21.15.67:0/4053197108 wait complete. 2024-09-19T05:42:12.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.738+0000 7fdcfdfa1000 20 client.7938 trim_cache size 0 max 16384 2024-09-19T05:42:12.740 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:42:12.740 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:42:12.740 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "ef8e0a02-5b76-46bb-8633-61b834b6633b", 2024-09-19T05:42:12.740 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:42:12.740 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:42:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 -- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdcd80678f0 msgr2=0x7fdcd8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdcd80678f0 0x7fdcd8069db0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009aa0 tx=0x7fdce8008040 comp rx=0 tx=0).stop 2024-09-19T05:42:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 -- 172.21.15.67:0/1212681080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf415e780 msgr2=0x7fdcf414ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf415e780 0x7fdcf414ccf0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fdce0011b00 tx=0x7fdce0009f70 comp rx=0 tx=0).stop 2024-09-19T05:42:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 -- 172.21.15.67:0/1212681080 shutdown_connections 2024-09-19T05:42:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcf414d230 0x7fdcf4099570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf415e780 0x7fdcf414ccf0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdcd80678f0 0x7fdcd8069db0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 --2- 172.21.15.67:0/1212681080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcf415f870 0x7fdcf415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 -- 172.21.15.67:0/1212681080 >> 172.21.15.67:0/1212681080 conn(0x7fdcf406c0c0 msgr2=0x7fdcf40aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 -- 172.21.15.67:0/1212681080 shutdown_connections 2024-09-19T05:42:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.742+0000 7fdcfaee5640 1 -- 172.21.15.67:0/1212681080 wait complete. 2024-09-19T05:42:12.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:42:12.757 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-19T05:42:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3d079640 1 Processor -- start 2024-09-19T05:42:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3d079640 1 -- start start 2024-09-19T05:42:12.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3d079640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6b3815c2b0 0x7f6b380d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3d079640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b38067a00 0x7f6b3806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3d079640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b38067fa0 con 0x7f6b3806d210 2024-09-19T05:42:12.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3d079640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6b380b4200 con 0x7f6b38067a00 2024-09-19T05:42:12.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3d079640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6b380b3bb0 con 0x7f6b3815c2b0 2024-09-19T05:42:12.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b38067a00 0x7f6b3806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b38067a00 0x7f6b3806ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39218/0 (socket says 172.21.15.67:39218) 2024-09-19T05:42:12.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3659c640 1 -- 172.21.15.67:0/2826854410 learned_addr learned my addr 172.21.15.67:0/2826854410 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/2826854410 >> v2:172.21.15.97:3300/0 conn(0x7f6b3815c2b0 0x7f6b380d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3659c640 1 -- 172.21.15.67:0/2826854410 >> v2:172.21.15.97:3300/0 conn(0x7f6b3815c2b0 msgr2=0x7f6b380d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3659c640 1 --2- 172.21.15.67:0/2826854410 >> v2:172.21.15.97:3300/0 conn(0x7f6b3815c2b0 0x7f6b380d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3659c640 1 -- 172.21.15.67:0/2826854410 >> v1:172.21.15.97:6789/0 conn(0x7f6b3806d210 legacy=0x7f6b3815fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.890+0000 7f6b3659c640 1 -- 172.21.15.67:0/2826854410 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b380b3e90 con 0x7f6b38067a00 2024-09-19T05:42:12.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3659c640 1 --2- 172.21.15.67:0/2826854410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 0x7f6b3806ccd0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6b380724a0 tx=0x7f6b2c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33860cd7fd52f696 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b35d9b640 1 -- 172.21.15.67:0/2826854410 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0ab430 con 0x7f6b38067a00 2024-09-19T05:42:12.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b35d9b640 1 -- 172.21.15.67:0/2826854410 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b2c0b0070 con 0x7f6b38067a00 2024-09-19T05:42:12.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b35d9b640 1 -- 172.21.15.67:0/2826854410 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0ab7f0 con 0x7f6b38067a00 2024-09-19T05:42:12.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3d079640 1 -- 172.21.15.67:0/2826854410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 msgr2=0x7f6b3806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3d079640 1 --2- 172.21.15.67:0/2826854410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 0x7f6b3806ccd0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6b380724a0 tx=0x7f6b2c01c520 comp rx=0 tx=0).stop 2024-09-19T05:42:12.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3d079640 1 -- 172.21.15.67:0/2826854410 shutdown_connections 2024-09-19T05:42:12.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3d079640 1 --2- 172.21.15.67:0/2826854410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 0x7f6b3806ccd0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3d079640 1 --2- 172.21.15.67:0/2826854410 >> v2:172.21.15.97:3300/0 conn(0x7f6b3815c2b0 0x7f6b380d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3d079640 1 -- 172.21.15.67:0/2826854410 >> 172.21.15.67:0/2826854410 conn(0x7f6b380727b0 msgr2=0x7f6b38072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3d079640 1 -- 172.21.15.67:0/2826854410 shutdown_connections 2024-09-19T05:42:12.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3d079640 1 -- 172.21.15.67:0/2826854410 wait complete. 2024-09-19T05:42:12.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3d079640 1 Processor -- start 2024-09-19T05:42:12.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.894+0000 7f6b3d079640 1 -- start start 2024-09-19T05:42:12.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b3d079640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 0x7f6b381528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b3d079640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b3806d210 0x7f6b38161a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b3d079640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b3815c2b0 0x7f6b38159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b3d079640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b381690d0 con 0x7f6b38067a00 2024-09-19T05:42:12.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b3d079640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3806d620 con 0x7f6b3815c2b0 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b3d079640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b38169250 con 0x7f6b3806d210 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b36d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 0x7f6b381528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b36d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 0x7f6b381528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39222/0 (socket says 172.21.15.67:39222) 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b36d9d640 1 -- 172.21.15.67:0/4197991269 learned_addr learned my addr 172.21.15.67:0/4197991269 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b3759e640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b3815c2b0 0x7f6b38159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b3659c640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b3806d210 0x7f6b38161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b36d9d640 1 -- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b3806d210 msgr2=0x7f6b38161a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b3806d210 0x7f6b38161a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b36d9d640 1 -- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b3815c2b0 msgr2=0x7f6b38159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b3815c2b0 0x7f6b38159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b36d9d640 1 -- 172.21.15.67:0/4197991269 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b38153f60 con 0x7f6b38067a00 2024-09-19T05:42:12.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 0x7f6b381528d0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800d5f0 tx=0x7f6b2800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b1f7fe640 1 -- 172.21.15.67:0/4197991269 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b280125f0 con 0x7f6b38067a00 2024-09-19T05:42:12.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b1f7fe640 1 -- 172.21.15.67:0/4197991269 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b28019070 con 0x7f6b38067a00 2024-09-19T05:42:12.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b3d079640 1 -- 172.21.15.67:0/4197991269 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b38154240 con 0x7f6b38067a00 2024-09-19T05:42:12.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b1f7fe640 1 -- 172.21.15.67:0/4197991269 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b280129b0 con 0x7f6b38067a00 2024-09-19T05:42:12.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b3d079640 1 -- 172.21.15.67:0/4197991269 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b38154800 con 0x7f6b38067a00 2024-09-19T05:42:12.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b1f7fe640 1 -- 172.21.15.67:0/4197991269 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b28012b50 con 0x7f6b38067a00 2024-09-19T05:42:12.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.898+0000 7f6b1f7fe640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b240678c0 0x7f6b24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b1f7fe640 1 -- 172.21.15.67:0/4197991269 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f6b28086100 con 0x7f6b38067a00 2024-09-19T05:42:12.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b3659c640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b240678c0 0x7f6b24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b3659c640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b240678c0 0x7f6b24069d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0af000 tx=0x7f6b2c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b40135000 1 Processor -- start 2024-09-19T05:42:12.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b40135000 1 -- start start 2024-09-19T05:42:12.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b40135000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3a7c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b40135000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 0x563ee3a2f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b40135000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a30190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b40135000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563ee3919960 con 0x563ee3a7c690 2024-09-19T05:42:12.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b40135000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563ee385d900 con 0x563ee3a2fdb0 2024-09-19T05:42:12.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b40135000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563ee3880d40 con 0x563ee3a7bd70 2024-09-19T05:42:12.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b3759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a30190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b3759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a30190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:36444/0 (socket says 172.21.15.67:36444) 2024-09-19T05:42:12.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b36d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3a7c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b3759e640 1 -- 172.21.15.67:0/240022459 learned_addr learned my addr 172.21.15.67:0/240022459 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b3659c640 1 --2- 172.21.15.67:0/240022459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 0x563ee3a2f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b36d9d640 1 -- 172.21.15.67:0/240022459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 msgr2=0x563ee3a30190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/240022459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a30190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b36d9d640 1 -- 172.21.15.67:0/240022459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 msgr2=0x563ee3a2f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/240022459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 0x563ee3a2f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b36d9d640 1 -- 172.21.15.67:0/240022459 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ee3827580 con 0x563ee3a7bd70 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b3759e640 1 --2- 172.21.15.67:0/240022459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a30190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/240022459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3a7c150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6b280844d0 tx=0x7f6b28056580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25291719c4b36349 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b1cff9640 1 -- 172.21.15.67:0/240022459 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b280544e0 con 0x563ee3a7bd70 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b1cff9640 1 -- 172.21.15.67:0/240022459 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b28054740 con 0x563ee3a7bd70 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.902+0000 7f6b1cff9640 1 -- 172.21.15.67:0/240022459 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2806e1c0 con 0x563ee3a7bd70 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 -- 172.21.15.67:0/240022459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 msgr2=0x563ee3a7c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 --2- 172.21.15.67:0/240022459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3a7c150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6b280844d0 tx=0x7f6b28056580 comp rx=0 tx=0).stop 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 -- 172.21.15.67:0/240022459 shutdown_connections 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 --2- 172.21.15.67:0/240022459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a30190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 --2- 172.21.15.67:0/240022459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 0x563ee3a2f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 --2- 172.21.15.67:0/240022459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3a7c150 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 -- 172.21.15.67:0/240022459 >> 172.21.15.67:0/240022459 conn(0x563ee3a5d040 msgr2=0x563ee3a5f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 -- 172.21.15.67:0/240022459 shutdown_connections 2024-09-19T05:42:12.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 -- 172.21.15.67:0/240022459 wait complete. 2024-09-19T05:42:12.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 -- start start 2024-09-19T05:42:12.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 Processor -- start 2024-09-19T05:42:12.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a82ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7bd70 0x563ee3a83220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7c690 0x563ee3a83760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563ee387cd00 con 0x563ee3a2fdb0 2024-09-19T05:42:12.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563ee383baa0 con 0x563ee3a7bd70 2024-09-19T05:42:12.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563ee381a340 con 0x563ee3a7c690 2024-09-19T05:42:12.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b40135000 10 client.0 _ll_register_callbacks cb 0x563ee3a1d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:12.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b3659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7bd70 0x563ee3a83220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b36d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a82ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b3659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7bd70 0x563ee3a83220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:36448/0 (socket says 172.21.15.67:36448) 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b3659c640 1 -- 172.21.15.67:0/3530183868 learned_addr learned my addr 172.21.15.67:0/3530183868 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b3759e640 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7c690 0x563ee3a83760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b36d9d640 1 -- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7c690 msgr2=0x563ee3a83760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7c690 0x563ee3a83760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b36d9d640 1 -- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7bd70 msgr2=0x563ee3a83220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7bd70 0x563ee3a83220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b36d9d640 1 -- 172.21.15.67:0/3530183868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ee3823dc0 con 0x563ee3a2fdb0 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a82ce0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800d5c0 tx=0x7f6b28000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e889831795e1640 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.906+0000 7f6b15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3530183868 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2806e1c0 con 0x563ee3a2fdb0 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3530183868 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f6b2806e360 con 0x563ee3a2fdb0 2024-09-19T05:42:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 1 -- 172.21.15.67:0/3530183868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b28054740 con 0x563ee3a2fdb0 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3530183868 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f6b28055890 con 0x563ee3a2fdb0 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 10 client.7950 fetch_fsmap learned FSMap version 84 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 1 -- 172.21.15.67:0/3530183868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x563ee38207f0 con 0x563ee3a2fdb0 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3530183868 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b28054740 con 0x563ee3a2fdb0 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3530183868 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f6b28013070 con 0x563ee3a2fdb0 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 10 client.7950 fetch_fsmap finished waiting for FSMap version 84 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 10 client.7950 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 20 client.7950 populate_metadata read hostname 'smithi067' 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x563ee3a8b0b0 0x563ee3a8d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 4 client.7950 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 1 -- 172.21.15.67:0/3530183868 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ee381ae10 con 0x563ee3a8b0b0 2024-09-19T05:42:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b3659c640 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x563ee3a8b0b0 0x563ee3a8d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b3659c640 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x563ee3a8b0b0 0x563ee3a8d4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aa8fc946e19bfe5 server_cookie=470c6006deb864da in_seq=0 out_seq=0 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b15ffb640 10 client.7950 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3530183868 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ee381ae10 con 0x563ee3a8b0b0 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b15ffb640 10 client.7950 handle_command_reply: tid=0 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 1 client.7950 shutdown 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 1 -- 172.21.15.67:0/3530183868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 msgr2=0x563ee3a82ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a82ce0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800d5c0 tx=0x7f6b28000bd0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 1 -- 172.21.15.67:0/3530183868 shutdown_connections 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.910+0000 7f6b40135000 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x563ee3a8b0b0 0x563ee3a8d4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.914+0000 7f6b40135000 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7c690 0x563ee3a83760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.914+0000 7f6b40135000 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7bd70 0x563ee3a83220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.914+0000 7f6b40135000 1 --2- 172.21.15.67:0/3530183868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a82ce0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.914+0000 7f6b40135000 1 -- 172.21.15.67:0/3530183868 >> 172.21.15.67:0/3530183868 conn(0x563ee3a5d040 msgr2=0x563ee3a2ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.914+0000 7f6b15ffb640 0 client.7950 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.914+0000 7f6b40135000 1 -- 172.21.15.67:0/3530183868 shutdown_connections 2024-09-19T05:42:12.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.914+0000 7f6b40135000 1 -- 172.21.15.67:0/3530183868 wait complete. 2024-09-19T05:42:12.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.914+0000 7f6b40135000 20 client.7950 trim_cache size 0 max 16384 2024-09-19T05:42:12.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.934+0000 7f6b40135000 1 Processor -- start 2024-09-19T05:42:12.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.934+0000 7f6b40135000 1 -- start start 2024-09-19T05:42:12.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a891e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3a89720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 0x563ee3a90300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b382040f0 con 0x563ee3a7c690 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b38070410 con 0x563ee3a2fdb0 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b38155fa0 con 0x563ee3a7bd70 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b3759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 0x563ee3a90300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b36d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a891e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b3759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 0x563ee3a90300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39254/0 (socket says 172.21.15.67:39254) 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b3759e640 1 -- 172.21.15.67:0/3963892707 learned_addr learned my addr 172.21.15.67:0/3963892707 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b3659c640 1 --2- 172.21.15.67:0/3963892707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3a89720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b3759e640 1 -- 172.21.15.67:0/3963892707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 msgr2=0x563ee3a89720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b3759e640 1 --2- 172.21.15.67:0/3963892707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3a89720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b3759e640 1 -- 172.21.15.67:0/3963892707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 msgr2=0x563ee3a891e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b3759e640 1 --2- 172.21.15.67:0/3963892707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a891e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b3759e640 1 -- 172.21.15.67:0/3963892707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ee383e470 con 0x563ee3a7c690 2024-09-19T05:42:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/3963892707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a891e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:42:12.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b3759e640 1 --2- 172.21.15.67:0/3963892707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 0x563ee3a90300 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f6b300020a0 tx=0x7f6b300016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa6960ce4f37ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b17fff640 1 -- 172.21.15.67:0/3963892707 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3001a070 con 0x563ee3a7c690 2024-09-19T05:42:12.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b17fff640 1 -- 172.21.15.67:0/3963892707 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b300057c0 con 0x563ee3a7c690 2024-09-19T05:42:12.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b17fff640 1 -- 172.21.15.67:0/3963892707 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30016620 con 0x563ee3a7c690 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 -- 172.21.15.67:0/3963892707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 msgr2=0x563ee3a90300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 --2- 172.21.15.67:0/3963892707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 0x563ee3a90300 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f6b300020a0 tx=0x7f6b300016b0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 -- 172.21.15.67:0/3963892707 shutdown_connections 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 --2- 172.21.15.67:0/3963892707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a7c690 0x563ee3a90300 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 --2- 172.21.15.67:0/3963892707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3a89720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 --2- 172.21.15.67:0/3963892707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a2fdb0 0x563ee3a891e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 -- 172.21.15.67:0/3963892707 >> 172.21.15.67:0/3963892707 conn(0x563ee3a5d040 msgr2=0x563ee3a88ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 -- 172.21.15.67:0/3963892707 shutdown_connections 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 -- 172.21.15.67:0/3963892707 wait complete. 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.938+0000 7f6b40135000 1 -- start start 2024-09-19T05:42:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 Processor -- start 2024-09-19T05:42:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a8fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3aef250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7c690 0x563ee3aef790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563ee3826f20 con 0x563ee3a2fdb0 2024-09-19T05:42:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3806fdc0 con 0x563ee3a7c690 2024-09-19T05:42:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563ee3a3b3f0 con 0x563ee3a7bd70 2024-09-19T05:42:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 10 client.0 _ll_register_callbacks cb 0x7f6b2c0094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b36d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a8fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b36d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a8fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39260/0 (socket says 172.21.15.67:39260) 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b36d9d640 1 -- 172.21.15.67:0/3618934308 learned_addr learned my addr 172.21.15.67:0/3618934308 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b3659c640 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3aef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b3759e640 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7c690 0x563ee3aef790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b36d9d640 1 -- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 msgr2=0x563ee3aef250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3aef250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b36d9d640 1 -- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7c690 msgr2=0x563ee3aef790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7c690 0x563ee3aef790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b36d9d640 1 -- 172.21.15.67:0/3618934308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ee3814640 con 0x563ee3a2fdb0 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b36d9d640 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a8fa40 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800dfb0 tx=0x7f6b28052810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df80f41818328e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:42:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3618934308 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28052480 con 0x563ee3a2fdb0 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3618934308 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6130+0+0 (secure 0 0 0) 0x7f6b2801fcc0 con 0x563ee3a2fdb0 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 -- 172.21.15.67:0/3618934308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b300057c0 con 0x563ee3a2fdb0 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3618934308 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f6b2801fec0 con 0x563ee3a2fdb0 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 10 client.7956 fetch_fsmap learned FSMap version 84 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 -- 172.21.15.67:0/3618934308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x563ee38183b0 con 0x563ee3a2fdb0 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3618934308 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b300057c0 con 0x563ee3a2fdb0 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3618934308 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f6b28055300 con 0x563ee3a2fdb0 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 10 client.7956 fetch_fsmap finished waiting for FSMap version 84 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 10 client.7956 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 20 client.7956 populate_metadata read hostname 'smithi067' 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x563ee3aefcd0 0x563ee3aebc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 4 client.7956 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:42:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b40135000 1 -- 172.21.15.67:0/3618934308 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ee388e470 con 0x563ee3aefcd0 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b3659c640 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x563ee3aefcd0 0x563ee3aebc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b15ffb640 10 client.7956 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.942+0000 7f6b3659c640 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x563ee3aefcd0 0x563ee3aebc00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5326c86c61c6d0c1 server_cookie=15c5d8dd092a1ede in_seq=0 out_seq=0 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b15ffb640 1 -- 172.21.15.67:0/3618934308 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x563ee388e470 con 0x563ee3aefcd0 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b15ffb640 10 client.7956 handle_command_reply: tid=0 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 client.7956 shutdown 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 -- 172.21.15.67:0/3618934308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 msgr2=0x563ee3a8fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a8fa40 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800dfb0 tx=0x7f6b28052810 comp rx=0 tx=0).stop 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 -- 172.21.15.67:0/3618934308 shutdown_connections 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x563ee3aefcd0 0x563ee3aebc00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ee3a7c690 0x563ee3aef790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ee3a7bd70 0x563ee3aef250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 --2- 172.21.15.67:0/3618934308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ee3a2fdb0 0x563ee3a8fa40 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 -- 172.21.15.67:0/3618934308 >> 172.21.15.67:0/3618934308 conn(0x563ee3a5d040 msgr2=0x563ee3a892f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b15ffb640 0 client.7956 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:12.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 -- 172.21.15.67:0/3618934308 shutdown_connections 2024-09-19T05:42:12.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 1 -- 172.21.15.67:0/3618934308 wait complete. 2024-09-19T05:42:12.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b40135000 20 client.7956 trim_cache size 0 max 16384 2024-09-19T05:42:12.948 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:42:12.948 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "scrub active (789 inodes in the stack)", 2024-09-19T05:42:12.948 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-19T05:42:12.948 INFO:teuthology.orchestra.run.smithi067.stdout: "ef8e0a02-5b76-46bb-8633-61b834b6633b": { 2024-09-19T05:42:12.948 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "~mds0", 2024-09-19T05:42:12.949 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "ef8e0a02-5b76-46bb-8633-61b834b6633b", 2024-09-19T05:42:12.949 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive" 2024-09-19T05:42:12.949 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.949 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:12.949 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:42:12.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 -- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b240678c0 msgr2=0x7f6b24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b240678c0 0x7f6b24069d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0af000 tx=0x7f6b2c0a7000 comp rx=0 tx=0).stop 2024-09-19T05:42:12.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 -- 172.21.15.67:0/4197991269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 msgr2=0x7f6b381528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:12.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 0x7f6b381528d0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800d5f0 tx=0x7f6b2800dab0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 -- 172.21.15.67:0/4197991269 shutdown_connections 2024-09-19T05:42:12.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b3815c2b0 0x7f6b38159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b240678c0 0x7f6b24069d80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b3806d210 0x7f6b38161a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 --2- 172.21.15.67:0/4197991269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b38067a00 0x7f6b381528d0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:12.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 -- 172.21.15.67:0/4197991269 >> 172.21.15.67:0/4197991269 conn(0x7f6b380727b0 msgr2=0x7f6b380ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:12.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 -- 172.21.15.67:0/4197991269 shutdown_connections 2024-09-19T05:42:12.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:12.946+0000 7f6b3d079640 1 -- 172.21.15.67:0/4197991269 wait complete. 2024-09-19T05:42:12.966 INFO:tasks.cephfs.filesystem:scrub status for tag:ef8e0a02-5b76-46bb-8633-61b834b6633b - {'path': '~mds0', 'tag': 'ef8e0a02-5b76-46bb-8633-61b834b6633b', 'options': 'recursive'} 2024-09-19T05:42:40.193 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:42:40.196 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:42:42.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:42:42.966 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-19T05:42:43.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f844e4c4640 1 Processor -- start 2024-09-19T05:42:43.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f844e4c4640 1 -- start start 2024-09-19T05:42:43.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f844e4c4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8448159c60 0x7f84480ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f844e4c4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f844806ffd0 0x7f84480aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f844e4c4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844815a040 con 0x7f84480b3150 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f844e4c4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f844815d460 con 0x7f844806ffd0 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f844e4c4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f844815c850 con 0x7f8448159c60 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f84477fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f844806ffd0 0x7f84480aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f844ca61640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f84480b3150 0x7f844815fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48508/0 (socket says 172.21.15.67:48508) 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f844ca61640 1 -- 172.21.15.67:0/1341864985 learned_addr learned my addr 172.21.15.67:0/1341864985 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f8447fff640 1 --2- 172.21.15.67:0/1341864985 >> v2:172.21.15.97:3300/0 conn(0x7f8448159c60 0x7f84480ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f84477fe640 1 -- 172.21.15.67:0/1341864985 >> v2:172.21.15.97:3300/0 conn(0x7f8448159c60 msgr2=0x7f84480ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f84477fe640 1 --2- 172.21.15.67:0/1341864985 >> v2:172.21.15.97:3300/0 conn(0x7f8448159c60 0x7f84480ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f84477fe640 1 -- 172.21.15.67:0/1341864985 >> v1:172.21.15.67:6789/0 conn(0x7f84480b3150 legacy=0x7f844815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f8446ffd640 1 -- 172.21.15.67:0/1341864985 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022339906 0 0) 0x7f844815a040 con 0x7f84480b3150 2024-09-19T05:42:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.106+0000 7f84477fe640 1 -- 172.21.15.67:0/1341864985 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844815cb30 con 0x7f844806ffd0 2024-09-19T05:42:43.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f84477fe640 1 --2- 172.21.15.67:0/1341864985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 0x7f84480aec90 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f84480712f0 tx=0x7f843c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade985dbc502c387 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f8446ffd640 1 -- 172.21.15.67:0/1341864985 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c0ab650 con 0x7f844806ffd0 2024-09-19T05:42:43.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f8446ffd640 1 -- 172.21.15.67:0/1341864985 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843c0b0070 con 0x7f844806ffd0 2024-09-19T05:42:43.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f8446ffd640 1 -- 172.21.15.67:0/1341864985 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c0aba10 con 0x7f844806ffd0 2024-09-19T05:42:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f844e4c4640 1 -- 172.21.15.67:0/1341864985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 msgr2=0x7f84480aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f844e4c4640 1 --2- 172.21.15.67:0/1341864985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 0x7f84480aec90 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f84480712f0 tx=0x7f843c01c450 comp rx=0 tx=0).stop 2024-09-19T05:42:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f844e4c4640 1 -- 172.21.15.67:0/1341864985 shutdown_connections 2024-09-19T05:42:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f844e4c4640 1 --2- 172.21.15.67:0/1341864985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 0x7f84480aec90 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f844e4c4640 1 --2- 172.21.15.67:0/1341864985 >> v2:172.21.15.97:3300/0 conn(0x7f8448159c60 0x7f84480ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f844e4c4640 1 -- 172.21.15.67:0/1341864985 >> 172.21.15.67:0/1341864985 conn(0x7f84480b1e50 msgr2=0x7f84480b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f844e4c4640 1 -- 172.21.15.67:0/1341864985 shutdown_connections 2024-09-19T05:42:43.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f844e4c4640 1 -- 172.21.15.67:0/1341864985 wait complete. 2024-09-19T05:42:43.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f844e4c4640 1 Processor -- start 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.110+0000 7f844e4c4640 1 -- start start 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f844e4c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 0x7f8448153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f844e4c4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84480b3150 0x7f8448152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f844e4c4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8448159c60 0x7f8448155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f844e4c4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f84480ad7f0 con 0x7f844806ffd0 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f844e4c4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f84480ad670 con 0x7f8448159c60 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f844e4c4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8448168e30 con 0x7f84480b3150 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8447fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 0x7f8448153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8447fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 0x7f8448153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38398/0 (socket says 172.21.15.67:38398) 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8447fff640 1 -- 172.21.15.67:0/3816304372 learned_addr learned my addr 172.21.15.67:0/3816304372 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f844ca61640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8448159c60 0x7f8448155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f84477fe640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84480b3150 0x7f8448152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8447fff640 1 -- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84480b3150 msgr2=0x7f8448152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8447fff640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84480b3150 0x7f8448152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8447fff640 1 -- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8448159c60 msgr2=0x7f8448155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8447fff640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8448159c60 0x7f8448155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8447fff640 1 -- 172.21.15.67:0/3816304372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84481583f0 con 0x7f844806ffd0 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8447fff640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 0x7f8448153550 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f8440007f20 tx=0x7f844000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8444ff9640 1 -- 172.21.15.67:0/3816304372 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440014620 con 0x7f844806ffd0 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8444ff9640 1 -- 172.21.15.67:0/3816304372 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8440019070 con 0x7f844806ffd0 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f844e4c4640 1 -- 172.21.15.67:0/3816304372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84481586d0 con 0x7f844806ffd0 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8444ff9640 1 -- 172.21.15.67:0/3816304372 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440014a00 con 0x7f844806ffd0 2024-09-19T05:42:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f844e4c4640 1 -- 172.21.15.67:0/3816304372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8448158c90 con 0x7f844806ffd0 2024-09-19T05:42:43.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8444ff9640 1 -- 172.21.15.67:0/3816304372 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8440014ba0 con 0x7f844806ffd0 2024-09-19T05:42:43.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.114+0000 7f8444ff9640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84340678c0 0x7f8434069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8444ff9640 1 -- 172.21.15.67:0/3816304372 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f84400867e0 con 0x7f844806ffd0 2024-09-19T05:42:43.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f84477fe640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84340678c0 0x7f8434069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 Processor -- start 2024-09-19T05:42:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 -- start start 2024-09-19T05:42:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f84477fe640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84340678c0 0x7f8434069d80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f843c0af000 tx=0x7f843c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x56474512d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56474512d690 0x5647450e0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647450e0db0 0x5647450e1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564744fca960 con 0x56474512cd70 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564744f0e900 con 0x5647450e0db0 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564744f31d40 con 0x56474512d690 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8447fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x56474512d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8447fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x56474512d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38406/0 (socket says 172.21.15.67:38406) 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8447fff640 1 -- 172.21.15.67:0/1758990801 learned_addr learned my addr 172.21.15.67:0/1758990801 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f84477fe640 1 --2- 172.21.15.67:0/1758990801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56474512d690 0x5647450e0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f844ca61640 1 --2- 172.21.15.67:0/1758990801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647450e0db0 0x5647450e1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8447fff640 1 -- 172.21.15.67:0/1758990801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56474512d690 msgr2=0x5647450e0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8447fff640 1 --2- 172.21.15.67:0/1758990801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56474512d690 0x5647450e0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8447fff640 1 -- 172.21.15.67:0/1758990801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647450e0db0 msgr2=0x5647450e1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8447fff640 1 --2- 172.21.15.67:0/1758990801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647450e0db0 0x5647450e1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8447fff640 1 -- 172.21.15.67:0/1758990801 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564744ed8580 con 0x56474512cd70 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f84477fe640 1 --2- 172.21.15.67:0/1758990801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56474512d690 0x5647450e0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8447fff640 1 --2- 172.21.15.67:0/1758990801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x56474512d150 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f844005f110 tx=0x7f8440056490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86caab3dac384e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f842dffb640 1 -- 172.21.15.67:0/1758990801 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844005ae10 con 0x56474512cd70 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f842dffb640 1 -- 172.21.15.67:0/1758990801 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f844005f640 con 0x56474512cd70 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f842dffb640 1 -- 172.21.15.67:0/1758990801 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84400530d0 con 0x56474512cd70 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 -- 172.21.15.67:0/1758990801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 msgr2=0x56474512d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 --2- 172.21.15.67:0/1758990801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x56474512d150 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f844005f110 tx=0x7f8440056490 comp rx=0 tx=0).stop 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 -- 172.21.15.67:0/1758990801 shutdown_connections 2024-09-19T05:42:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 --2- 172.21.15.67:0/1758990801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647450e0db0 0x5647450e1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 --2- 172.21.15.67:0/1758990801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56474512d690 0x5647450e0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 --2- 172.21.15.67:0/1758990801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x56474512d150 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 -- 172.21.15.67:0/1758990801 >> 172.21.15.67:0/1758990801 conn(0x56474510e040 msgr2=0x564745110430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 -- 172.21.15.67:0/1758990801 shutdown_connections 2024-09-19T05:42:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 -- 172.21.15.67:0/1758990801 wait complete. 2024-09-19T05:42:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 -- start start 2024-09-19T05:42:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.118+0000 7f8451580000 1 Processor -- start 2024-09-19T05:42:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x564745133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x564745134220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512d690 0x564745134760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564744f2dd00 con 0x56474512cd70 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564744eecaa0 con 0x56474512d690 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564744ecb340 con 0x5647450e0db0 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 10 client.0 _ll_register_callbacks cb 0x5647450ce760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f84477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x564745134220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f84477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x564745134220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38422/0 (socket says 172.21.15.67:38422) 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f84477fe640 1 -- 172.21.15.67:0/1779285188 learned_addr learned my addr 172.21.15.67:0/1779285188 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8447fff640 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x564745133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f844ca61640 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512d690 0x564745134760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f84477fe640 1 -- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 msgr2=0x564745133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f84477fe640 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x564745133ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f84477fe640 1 -- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512d690 msgr2=0x564745134760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f84477fe640 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512d690 0x564745134760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f84477fe640 1 -- 172.21.15.67:0/1779285188 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564744ed4dc0 con 0x56474512cd70 2024-09-19T05:42:43.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f84477fe640 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x564745134220 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f843c008010 tx=0x7f843c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c24f1378a49dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8426ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:42:43.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8426ffd640 1 -- 172.21.15.67:0/1779285188 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c0b5b10 con 0x56474512cd70 2024-09-19T05:42:43.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8426ffd640 1 -- 172.21.15.67:0/1779285188 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f843c0b5cb0 con 0x56474512cd70 2024-09-19T05:42:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 1 -- 172.21.15.67:0/1779285188 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f844005f640 con 0x56474512cd70 2024-09-19T05:42:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8426ffd640 1 -- 172.21.15.67:0/1779285188 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f843c0cd050 con 0x56474512cd70 2024-09-19T05:42:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 10 client.7971 fetch_fsmap learned FSMap version 84 2024-09-19T05:42:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 1 -- 172.21.15.67:0/1779285188 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x564744ed17f0 con 0x56474512cd70 2024-09-19T05:42:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8426ffd640 1 -- 172.21.15.67:0/1779285188 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f844005f640 con 0x56474512cd70 2024-09-19T05:42:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8426ffd640 1 -- 172.21.15.67:0/1779285188 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f843c0d0020 con 0x56474512cd70 2024-09-19T05:42:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 10 client.7971 fetch_fsmap finished waiting for FSMap version 84 2024-09-19T05:42:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 10 client.7971 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-19T05:42:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 20 client.7971 populate_metadata read hostname 'smithi067' 2024-09-19T05:42:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x56474513c0b0 0x56474513e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 4 client.7971 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8451580000 1 -- 172.21.15.67:0/1779285188 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564744ecbe10 con 0x56474513c0b0 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8447fff640 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x56474513c0b0 0x56474513e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8447fff640 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x56474513c0b0 0x56474513e4a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2b424b5b703a1c server_cookie=a07d871fa070df6b in_seq=0 out_seq=0 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.122+0000 7f8426ffd640 10 client.7971 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8426ffd640 1 -- 172.21.15.67:0/1779285188 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564744ecbe10 con 0x56474513c0b0 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8426ffd640 10 client.7971 handle_command_reply: tid=0 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 client.7971 shutdown 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 -- 172.21.15.67:0/1779285188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 msgr2=0x564745134220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x564745134220 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f843c008010 tx=0x7f843c01ac90 comp rx=0 tx=0).stop 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 -- 172.21.15.67:0/1779285188 shutdown_connections 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x56474513c0b0 0x56474513e4a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512d690 0x564745134760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512cd70 0x564745134220 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8426ffd640 0 client.7971 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:43.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 --2- 172.21.15.67:0/1779285188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x564745133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 -- 172.21.15.67:0/1779285188 >> 172.21.15.67:0/1779285188 conn(0x56474510e040 msgr2=0x5647450dff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 -- 172.21.15.67:0/1779285188 shutdown_connections 2024-09-19T05:42:43.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 1 -- 172.21.15.67:0/1779285188 wait complete. 2024-09-19T05:42:43.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.126+0000 7f8451580000 20 client.7971 trim_cache size 0 max 16384 2024-09-19T05:42:43.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.142+0000 7f8451580000 1 Processor -- start 2024-09-19T05:42:43.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.142+0000 7f8451580000 1 -- start start 2024-09-19T05:42:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x56474513a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 0x56474513a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x5647450e7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8448201e20 con 0x56474512d690 2024-09-19T05:42:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8448200e80 con 0x56474512cd70 2024-09-19T05:42:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f844809cbc0 con 0x5647450e0db0 2024-09-19T05:42:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x5647450e7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x5647450e7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38436/0 (socket says 172.21.15.67:38436) 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 -- 172.21.15.67:0/1547070464 learned_addr learned my addr 172.21.15.67:0/1547070464 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f84477fe640 1 --2- 172.21.15.67:0/1547070464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 0x56474513a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8447fff640 1 --2- 172.21.15.67:0/1547070464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x56474513a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 -- 172.21.15.67:0/1547070464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 msgr2=0x56474513a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 --2- 172.21.15.67:0/1547070464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x56474513a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 -- 172.21.15.67:0/1547070464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 msgr2=0x56474513a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 --2- 172.21.15.67:0/1547070464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 0x56474513a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 -- 172.21.15.67:0/1547070464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564744eef470 con 0x56474512d690 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f84477fe640 1 --2- 172.21.15.67:0/1547070464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 0x56474513a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 --2- 172.21.15.67:0/1547070464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x5647450e7b90 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f8438007230 tx=0x7f84380076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f70829089580df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f842d7fa640 1 -- 172.21.15.67:0/1547070464 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438014400 con 0x56474512d690 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f842d7fa640 1 -- 172.21.15.67:0/1547070464 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8438019070 con 0x56474512d690 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f842d7fa640 1 -- 172.21.15.67:0/1547070464 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84380147e0 con 0x56474512d690 2024-09-19T05:42:43.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- 172.21.15.67:0/1547070464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 msgr2=0x5647450e7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 --2- 172.21.15.67:0/1547070464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x5647450e7b90 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f8438007230 tx=0x7f84380076f0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- 172.21.15.67:0/1547070464 shutdown_connections 2024-09-19T05:42:43.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 --2- 172.21.15.67:0/1547070464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x5647450e7b90 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 --2- 172.21.15.67:0/1547070464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 0x56474513a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 --2- 172.21.15.67:0/1547070464 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x56474513a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- 172.21.15.67:0/1547070464 >> 172.21.15.67:0/1547070464 conn(0x56474510e040 msgr2=0x564745139ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- 172.21.15.67:0/1547070464 shutdown_connections 2024-09-19T05:42:43.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- 172.21.15.67:0/1547070464 wait complete. 2024-09-19T05:42:43.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- start start 2024-09-19T05:42:43.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 Processor -- start 2024-09-19T05:42:43.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x5647451a4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 0x56474515fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x564745160240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564744f2dd00 con 0x56474512d690 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8448200830 con 0x56474512cd70 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564744f3ffd0 con 0x5647450e0db0 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 10 client.0 _ll_register_callbacks cb 0x7f843c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x564745160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x564745160240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38444/0 (socket says 172.21.15.67:38444) 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 -- 172.21.15.67:0/4027621959 learned_addr learned my addr 172.21.15.67:0/4027621959 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8447fff640 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x5647451a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f84477fe640 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 0x56474515fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 -- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 msgr2=0x5647451a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x5647451a4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 -- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 msgr2=0x56474515fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 0x56474515fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 -- 172.21.15.67:0/4027621959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564744ec5640 con 0x56474512d690 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8447fff640 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x5647451a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f844ca61640 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x564745160240 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f8438000c10 tx=0x7f8438007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf8569cfe1e306f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8426ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8426ffd640 1 -- 172.21.15.67:0/4027621959 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438024020 con 0x56474512d690 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8426ffd640 1 -- 172.21.15.67:0/4027621959 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f843801d650 con 0x56474512d690 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.146+0000 7f8451580000 1 -- 172.21.15.67:0/4027621959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8438019070 con 0x56474512d690 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8426ffd640 1 -- 172.21.15.67:0/4027621959 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f8438007e60 con 0x56474512d690 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 10 client.7977 fetch_fsmap learned FSMap version 84 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 -- 172.21.15.67:0/4027621959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x564744ec93b0 con 0x56474512d690 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8426ffd640 1 -- 172.21.15.67:0/4027621959 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8438019070 con 0x56474512d690 2024-09-19T05:42:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8426ffd640 1 -- 172.21.15.67:0/4027621959 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f843801d850 con 0x56474512d690 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 10 client.7977 fetch_fsmap finished waiting for FSMap version 84 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 10 client.7977 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 20 client.7977 populate_metadata read hostname 'smithi067' 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x564745160780 0x564745160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 4 client.7977 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 -- 172.21.15.67:0/4027621959 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564744f3f470 con 0x564745160780 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8447fff640 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x564745160780 0x564745160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8447fff640 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x564745160780 0x564745160b90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e134b21b106305f2 server_cookie=4d858a29be50d18 in_seq=0 out_seq=0 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8426ffd640 10 client.7977 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8426ffd640 1 -- 172.21.15.67:0/4027621959 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564744f3f470 con 0x564745160780 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8426ffd640 10 client.7977 handle_command_reply: tid=0 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 client.7977 shutdown 2024-09-19T05:42:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 -- 172.21.15.67:0/4027621959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 msgr2=0x564745160240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x564745160240 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f8438000c10 tx=0x7f8438007a20 comp rx=0 tx=0).stop 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 -- 172.21.15.67:0/4027621959 shutdown_connections 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x564745160780 0x564745160b90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56474512d690 0x564745160240 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56474512cd70 0x56474515fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 --2- 172.21.15.67:0/4027621959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5647450e0db0 0x5647451a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 -- 172.21.15.67:0/4027621959 >> 172.21.15.67:0/4027621959 conn(0x56474510e040 msgr2=0x5647450e7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8426ffd640 0 client.7977 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 -- 172.21.15.67:0/4027621959 shutdown_connections 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 1 -- 172.21.15.67:0/4027621959 wait complete. 2024-09-19T05:42:43.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f8451580000 20 client.7977 trim_cache size 0 max 16384 2024-09-19T05:42:43.155 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:42:43.155 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-19T05:42:43.155 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {} 2024-09-19T05:42:43.155 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 -- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84340678c0 msgr2=0x7f8434069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84340678c0 0x7f8434069d80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f843c0af000 tx=0x7f843c008040 comp rx=0 tx=0).stop 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 -- 172.21.15.67:0/3816304372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 msgr2=0x7f8448153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 0x7f8448153550 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f8440007f20 tx=0x7f844000e570 comp rx=0 tx=0).stop 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 -- 172.21.15.67:0/3816304372 shutdown_connections 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8448159c60 0x7f8448155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84340678c0 0x7f8434069d80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84480b3150 0x7f8448152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 --2- 172.21.15.67:0/3816304372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f844806ffd0 0x7f8448153550 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 -- 172.21.15.67:0/3816304372 >> 172.21.15.67:0/3816304372 conn(0x7f84480b1e50 msgr2=0x7f844815a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 -- 172.21.15.67:0/3816304372 shutdown_connections 2024-09-19T05:42:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.150+0000 7f844e4c4640 1 -- 172.21.15.67:0/3816304372 wait complete. 2024-09-19T05:42:43.166 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:42:43.166 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-19T05:42:43.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.282+0000 7f1236393640 1 Processor -- start 2024-09-19T05:42:43.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.282+0000 7f1236393640 1 -- start start 2024-09-19T05:42:43.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f1236393640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f12300ce800 0x7f12301605f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f1236393640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f12300b1370 0x7f12300cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f1236393640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12300d0900 con 0x7f123015c360 2024-09-19T05:42:43.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f1236393640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f12300ccd90 con 0x7f12300ce800 2024-09-19T05:42:43.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f1236393640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f12300d11c0 con 0x7f12300b1370 2024-09-19T05:42:43.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f12300ce800 0x7f12301605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f123015c360 0x7f123015fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48516/0 (socket says 172.21.15.67:48516) 2024-09-19T05:42:43.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122ffff640 1 -- 172.21.15.67:0/1420764558 learned_addr learned my addr 172.21.15.67:0/1420764558 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:43.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f1234930640 1 --2- 172.21.15.67:0/1420764558 >> v2:172.21.15.97:3300/0 conn(0x7f12300b1370 0x7f12300cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122f7fe640 1 -- 172.21.15.67:0/1420764558 >> v2:172.21.15.97:3300/0 conn(0x7f12300b1370 msgr2=0x7f12300cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122f7fe640 1 --2- 172.21.15.67:0/1420764558 >> v2:172.21.15.97:3300/0 conn(0x7f12300b1370 0x7f12300cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122f7fe640 1 -- 172.21.15.67:0/1420764558 >> v1:172.21.15.67:6789/0 conn(0x7f123015c360 legacy=0x7f123015fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122effd640 1 -- 172.21.15.67:0/1420764558 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020539698 0 0) 0x7f12300d0900 con 0x7f123015c360 2024-09-19T05:42:43.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122f7fe640 1 -- 172.21.15.67:0/1420764558 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12300d0b70 con 0x7f12300ce800 2024-09-19T05:42:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122f7fe640 1 --2- 172.21.15.67:0/1420764558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 0x7f12301605f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f12240097c0 tx=0x7f122401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785c51590851d26e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122effd640 1 -- 172.21.15.67:0/1420764558 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240b0070 con 0x7f12300ce800 2024-09-19T05:42:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122effd640 1 -- 172.21.15.67:0/1420764558 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12240ab600 con 0x7f12300ce800 2024-09-19T05:42:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f122effd640 1 -- 172.21.15.67:0/1420764558 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240ab9d0 con 0x7f12300ce800 2024-09-19T05:42:43.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f1236393640 1 -- 172.21.15.67:0/1420764558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 msgr2=0x7f12301605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.286+0000 7f1236393640 1 --2- 172.21.15.67:0/1420764558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 0x7f12301605f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f12240097c0 tx=0x7f122401c460 comp rx=0 tx=0).stop 2024-09-19T05:42:43.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 -- 172.21.15.67:0/1420764558 shutdown_connections 2024-09-19T05:42:43.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 --2- 172.21.15.67:0/1420764558 >> v2:172.21.15.97:3300/0 conn(0x7f12300b1370 0x7f12300cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 --2- 172.21.15.67:0/1420764558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 0x7f12301605f0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 -- 172.21.15.67:0/1420764558 >> 172.21.15.67:0/1420764558 conn(0x7f12300b3d70 msgr2=0x7f12300b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 -- 172.21.15.67:0/1420764558 shutdown_connections 2024-09-19T05:42:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 -- 172.21.15.67:0/1420764558 wait complete. 2024-09-19T05:42:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 Processor -- start 2024-09-19T05:42:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 -- start start 2024-09-19T05:42:43.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12300b1370 0x7f123015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 0x7f123015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f123015c360 0x7f12300cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12300702d0 con 0x7f12300ce800 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1230070150 con 0x7f123015c360 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f12300cdf10 con 0x7f12300b1370 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 0x7f123015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 0x7f123015a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38466/0 (socket says 172.21.15.67:38466) 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122f7fe640 1 -- 172.21.15.67:0/2838193244 learned_addr learned my addr 172.21.15.67:0/2838193244 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1234930640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f123015c360 0x7f12300cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122ffff640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12300b1370 0x7f123015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122f7fe640 1 -- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12300b1370 msgr2=0x7f123015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122f7fe640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12300b1370 0x7f123015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122f7fe640 1 -- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f123015c360 msgr2=0x7f12300cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122f7fe640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f123015c360 0x7f12300cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122f7fe640 1 -- 172.21.15.67:0/2838193244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12300cebe0 con 0x7f12300ce800 2024-09-19T05:42:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122f7fe640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 0x7f123015a8a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1224019070 tx=0x7f122401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122cff9640 1 -- 172.21.15.67:0/2838193244 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240b0050 con 0x7f12300ce800 2024-09-19T05:42:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122cff9640 1 -- 172.21.15.67:0/2838193244 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12240bc070 con 0x7f12300ce800 2024-09-19T05:42:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 -- 172.21.15.67:0/2838193244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12300ceec0 con 0x7f12300ce800 2024-09-19T05:42:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f122cff9640 1 -- 172.21.15.67:0/2838193244 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240b5830 con 0x7f12300ce800 2024-09-19T05:42:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.290+0000 7f1236393640 1 -- 172.21.15.67:0/2838193244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12300cf480 con 0x7f12300ce800 2024-09-19T05:42:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122cff9640 1 -- 172.21.15.67:0/2838193244 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12240b59d0 con 0x7f12300ce800 2024-09-19T05:42:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122cff9640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678f0 0x7f121c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122cff9640 1 -- 172.21.15.67:0/2838193244 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f1224120570 con 0x7f12300ce800 2024-09-19T05:42:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122ffff640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678f0 0x7f121c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f123944f000 1 Processor -- start 2024-09-19T05:42:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f123944f000 1 -- start start 2024-09-19T05:42:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122ffff640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678f0 0x7f121c069db0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1220000f70 tx=0x7f1220009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f123944f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb642fd50 0x559eb6430130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f123944f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63e3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f123944f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb63e3b90 0x559eb63e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f123944f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559eb6230cc0 con 0x559eb6430670 2024-09-19T05:42:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f123944f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559eb61eba20 con 0x559eb642fd50 2024-09-19T05:42:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f123944f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559eb622cc80 con 0x559eb63e3b90 2024-09-19T05:42:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63e3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38482/0 (socket says 172.21.15.67:38482) 2024-09-19T05:42:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122f7fe640 1 -- 172.21.15.67:0/2092417850 learned_addr learned my addr 172.21.15.67:0/2092417850 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122ffff640 1 --2- 172.21.15.67:0/2092417850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb642fd50 0x559eb6430130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f1234930640 1 --2- 172.21.15.67:0/2092417850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb63e3b90 0x559eb63e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122f7fe640 1 -- 172.21.15.67:0/2092417850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb63e3b90 msgr2=0x559eb63e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122f7fe640 1 --2- 172.21.15.67:0/2092417850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb63e3b90 0x559eb63e3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122f7fe640 1 -- 172.21.15.67:0/2092417850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb642fd50 msgr2=0x559eb6430130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122f7fe640 1 --2- 172.21.15.67:0/2092417850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb642fd50 0x559eb6430130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122f7fe640 1 -- 172.21.15.67:0/2092417850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb61d3d40 con 0x559eb6430670 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f122f7fe640 1 --2- 172.21.15.67:0/2092417850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63e3650 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f12240ecc40 tx=0x7f12240b3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657664eb69df1d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.294+0000 7f1215ffb640 1 -- 172.21.15.67:0/2092417850 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240f70b0 con 0x559eb6430670 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1215ffb640 1 -- 172.21.15.67:0/2092417850 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12240b1040 con 0x559eb6430670 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1215ffb640 1 -- 172.21.15.67:0/2092417850 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240f07e0 con 0x559eb6430670 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- 172.21.15.67:0/2092417850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 msgr2=0x559eb63e3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 --2- 172.21.15.67:0/2092417850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63e3650 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f12240ecc40 tx=0x7f12240b3000 comp rx=0 tx=0).stop 2024-09-19T05:42:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- 172.21.15.67:0/2092417850 shutdown_connections 2024-09-19T05:42:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 --2- 172.21.15.67:0/2092417850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb63e3b90 0x559eb63e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 --2- 172.21.15.67:0/2092417850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63e3650 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 --2- 172.21.15.67:0/2092417850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb642fd50 0x559eb6430130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- 172.21.15.67:0/2092417850 >> 172.21.15.67:0/2092417850 conn(0x559eb640c9b0 msgr2=0x559eb640eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- 172.21.15.67:0/2092417850 shutdown_connections 2024-09-19T05:42:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- 172.21.15.67:0/2092417850 wait complete. 2024-09-19T05:42:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- start start 2024-09-19T05:42:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 Processor -- start 2024-09-19T05:42:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb63e3b90 0x559eb6436f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb642fd50 0x559eb64374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63efde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559eb61ca2c0 con 0x559eb6430670 2024-09-19T05:42:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559eb61ef370 con 0x559eb63e3b90 2024-09-19T05:42:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559eb623ef50 con 0x559eb642fd50 2024-09-19T05:42:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 10 client.0 _ll_register_callbacks cb 0x559eb6291db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1234930640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1234930640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63efde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38492/0 (socket says 172.21.15.67:38492) 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1234930640 1 -- 172.21.15.67:0/2142478648 learned_addr learned my addr 172.21.15.67:0/2142478648 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f122ffff640 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb63e3b90 0x559eb6436f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f122f7fe640 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb642fd50 0x559eb64374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1234930640 1 -- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb642fd50 msgr2=0x559eb64374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1234930640 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb642fd50 0x559eb64374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1234930640 1 -- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb63e3b90 msgr2=0x559eb6436f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1234930640 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb63e3b90 0x559eb6436f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1234930640 1 -- 172.21.15.67:0/2142478648 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eb61d0770 con 0x559eb6430670 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f1234930640 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63efde0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1228007a40 tx=0x7f1228007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5191edfb40f7d778 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f120effd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f120effd640 1 -- 172.21.15.67:0/2142478648 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122801b020 con 0x559eb6430670 2024-09-19T05:42:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- 172.21.15.67:0/2142478648 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12240b1040 con 0x559eb6430670 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f120effd640 1 -- 172.21.15.67:0/2142478648 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f1228011ae0 con 0x559eb6430670 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f120effd640 1 -- 172.21.15.67:0/2142478648 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f1228025050 con 0x559eb6430670 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 10 client.7992 fetch_fsmap learned FSMap version 84 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- 172.21.15.67:0/2142478648 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x559eb61ee3f0 con 0x559eb6430670 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f120effd640 1 -- 172.21.15.67:0/2142478648 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12240b1040 con 0x559eb6430670 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f120effd640 1 -- 172.21.15.67:0/2142478648 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f1228028020 con 0x559eb6430670 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 10 client.7992 fetch_fsmap finished waiting for FSMap version 84 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 10 client.7992 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 20 client.7992 populate_metadata read hostname 'smithi067' 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x559eb63f07f0 0x559eb63f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 4 client.7992 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.298+0000 7f123944f000 1 -- 172.21.15.67:0/2142478648 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559eb61cad90 con 0x559eb63f07f0 2024-09-19T05:42:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f122ffff640 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x559eb63f07f0 0x559eb63f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f122ffff640 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x559eb63f07f0 0x559eb63f0c00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9b0528ee739d5ff server_cookie=b71edc7939c0b0a6 in_seq=0 out_seq=0 2024-09-19T05:42:43.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f120effd640 10 client.7992 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f120effd640 1 -- 172.21.15.67:0/2142478648 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559eb61cad90 con 0x559eb63f07f0 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f120effd640 10 client.7992 handle_command_reply: tid=0 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 client.7992 shutdown 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 -- 172.21.15.67:0/2142478648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 msgr2=0x559eb63efde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63efde0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1228007a40 tx=0x7f1228007f00 comp rx=0 tx=0).stop 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 -- 172.21.15.67:0/2142478648 shutdown_connections 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x559eb63f07f0 0x559eb63f0c00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb6430670 0x559eb63efde0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb642fd50 0x559eb64374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 --2- 172.21.15.67:0/2142478648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb63e3b90 0x559eb6436f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 -- 172.21.15.67:0/2142478648 >> 172.21.15.67:0/2142478648 conn(0x559eb640c9b0 msgr2=0x559eb63e5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f120effd640 0 client.7992 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:43.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 -- 172.21.15.67:0/2142478648 shutdown_connections 2024-09-19T05:42:43.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 1 -- 172.21.15.67:0/2142478648 wait complete. 2024-09-19T05:42:43.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.302+0000 7f123944f000 20 client.7992 trim_cache size 0 max 16384 2024-09-19T05:42:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.318+0000 7f123944f000 1 Processor -- start 2024-09-19T05:42:43.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.318+0000 7f123944f000 1 -- start start 2024-09-19T05:42:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb63e3b90 0x559eb64475b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb642fd50 0x559eb6447af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb6430670 0x559eb640b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f123006e390 con 0x559eb63e3b90 2024-09-19T05:42:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f12300ca4d0 con 0x559eb6430670 2024-09-19T05:42:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f12300cab20 con 0x559eb642fd50 2024-09-19T05:42:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb63e3b90 0x559eb64475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb63e3b90 0x559eb64475b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38506/0 (socket says 172.21.15.67:38506) 2024-09-19T05:42:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122ffff640 1 -- 172.21.15.67:0/1731646283 learned_addr learned my addr 172.21.15.67:0/1731646283 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122ffff640 1 -- 172.21.15.67:0/1731646283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb642fd50 msgr2=0x559eb6447af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122ffff640 1 --2- 172.21.15.67:0/1731646283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb642fd50 0x559eb6447af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122ffff640 1 -- 172.21.15.67:0/1731646283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb6430670 msgr2=0x559eb640b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122ffff640 1 --2- 172.21.15.67:0/1731646283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb6430670 0x559eb640b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122ffff640 1 -- 172.21.15.67:0/1731646283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb62b2320 con 0x559eb63e3b90 2024-09-19T05:42:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122ffff640 1 --2- 172.21.15.67:0/1731646283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb63e3b90 0x559eb64475b0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f1220001ec0 tx=0x7f1220011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642c348b93ac41d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f12157fa640 1 -- 172.21.15.67:0/1731646283 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220027070 con 0x559eb63e3b90 2024-09-19T05:42:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f12157fa640 1 -- 172.21.15.67:0/1731646283 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1220007310 con 0x559eb63e3b90 2024-09-19T05:42:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f12157fa640 1 -- 172.21.15.67:0/1731646283 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122000da70 con 0x559eb63e3b90 2024-09-19T05:42:43.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- 172.21.15.67:0/1731646283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb63e3b90 msgr2=0x559eb64475b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 --2- 172.21.15.67:0/1731646283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb63e3b90 0x559eb64475b0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f1220001ec0 tx=0x7f1220011000 comp rx=0 tx=0).stop 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- 172.21.15.67:0/1731646283 shutdown_connections 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 --2- 172.21.15.67:0/1731646283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb6430670 0x559eb640b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 --2- 172.21.15.67:0/1731646283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb642fd50 0x559eb6447af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 --2- 172.21.15.67:0/1731646283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb63e3b90 0x559eb64475b0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- 172.21.15.67:0/1731646283 >> 172.21.15.67:0/1731646283 conn(0x559eb640c9b0 msgr2=0x559eb63dda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- 172.21.15.67:0/1731646283 shutdown_connections 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- 172.21.15.67:0/1731646283 wait complete. 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- start start 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 Processor -- start 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb63e3b90 0x559eb64a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb642fd50 0x559eb64a2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb6430670 0x559eb64a2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559eb61d8120 con 0x559eb642fd50 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559eb62b1e90 con 0x559eb63e3b90 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559eb61dab90 con 0x559eb6430670 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 10 client.0 _ll_register_callbacks cb 0x7f1228009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb642fd50 0x559eb64a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb642fd50 0x559eb64a2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38512/0 (socket says 172.21.15.67:38512) 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122f7fe640 1 -- 172.21.15.67:0/177889056 learned_addr learned my addr 172.21.15.67:0/177889056 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122ffff640 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb63e3b90 0x559eb64a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122f7fe640 1 -- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb6430670 msgr2=0x559eb64a2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122f7fe640 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb6430670 0x559eb64a2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122f7fe640 1 -- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb63e3b90 msgr2=0x559eb64a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122f7fe640 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb63e3b90 0x559eb64a38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122f7fe640 1 -- 172.21.15.67:0/177889056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eb61c45c0 con 0x559eb642fd50 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f122f7fe640 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb642fd50 0x559eb64a2980 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f122401c9d0 tx=0x7f122411e7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4396d989baefd91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f120effd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f120effd640 1 -- 172.21.15.67:0/177889056 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122410d060 con 0x559eb642fd50 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f120effd640 1 -- 172.21.15.67:0/177889056 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f122411e460 con 0x559eb642fd50 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.322+0000 7f123944f000 1 -- 172.21.15.67:0/177889056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1220007310 con 0x559eb642fd50 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f120effd640 1 -- 172.21.15.67:0/177889056 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f12240f70b0 con 0x559eb642fd50 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 10 client.7998 fetch_fsmap learned FSMap version 84 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 -- 172.21.15.67:0/177889056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x559eb61c8330 con 0x559eb642fd50 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f120effd640 1 -- 172.21.15.67:0/177889056 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1220007310 con 0x559eb642fd50 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f120effd640 1 -- 172.21.15.67:0/177889056 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f12240b5cc0 con 0x559eb642fd50 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 10 client.7998 fetch_fsmap finished waiting for FSMap version 84 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 10 client.7998 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 20 client.7998 populate_metadata read hostname 'smithi067' 2024-09-19T05:42:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x559eb64a3de0 0x559eb640a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 4 client.7998 mds_command: new command op to 6556 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-19T05:42:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 -- 172.21.15.67:0/177889056 --> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] -- command(tid 0: {"prefix": "perf dump"}) -- 0x559eb623e3f0 con 0x559eb64a3de0 2024-09-19T05:42:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f122ffff640 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x559eb64a3de0 0x559eb640a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f122ffff640 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x559eb64a3de0 0x559eb640a8c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9fada39a0329552 server_cookie=ad61a32294b68e82 in_seq=0 out_seq=0 2024-09-19T05:42:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f120effd640 10 client.7998 ms_handle_connect on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f120effd640 1 -- 172.21.15.67:0/177889056 <== mds.0 v2:172.21.15.97:6836/396819326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18026 (crc 0 0 0) 0x559eb623e3f0 con 0x559eb64a3de0 2024-09-19T05:42:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f120effd640 10 client.7998 handle_command_reply: tid=0 2024-09-19T05:42:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 client.7998 shutdown 2024-09-19T05:42:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 -- 172.21.15.67:0/177889056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb642fd50 msgr2=0x559eb64a2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb642fd50 0x559eb64a2980 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f122401c9d0 tx=0x7f122411e7a0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 -- 172.21.15.67:0/177889056 shutdown_connections 2024-09-19T05:42:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:6836/396819326,v1:172.21.15.97:6837/396819326] conn(0x559eb64a3de0 0x559eb640a8c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559eb6430670 0x559eb64a2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559eb642fd50 0x559eb64a2980 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 --2- 172.21.15.67:0/177889056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559eb63e3b90 0x559eb64a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f120effd640 0 client.7998 ms_handle_reset on v2:172.21.15.97:6836/396819326 2024-09-19T05:42:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 -- 172.21.15.67:0/177889056 >> 172.21.15.67:0/177889056 conn(0x559eb640c9b0 msgr2=0x559eb63ee950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 -- 172.21.15.67:0/177889056 shutdown_connections 2024-09-19T05:42:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 1 -- 172.21.15.67:0/177889056 wait complete. 2024-09-19T05:42:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f123944f000 20 client.7998 trim_cache size 0 max 16384 2024-09-19T05:42:43.330 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:42:43.330 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 4788, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 4787, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 1583951, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 18858953, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 17, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 6, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.613001641, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.249654824, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.128295603, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.181846175, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 4786, 2024-09-19T05:42:43.331 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.452382985, 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000094522 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 10, 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000001763, 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000176 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 4070, 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 4066, 2024-09-19T05:42:43.332 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 1128723, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 23613732, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 5, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.553966848, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.237906361, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.117536526, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.162950012, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 4066, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.723941331, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000178047 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.333 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 123536, 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 36672 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 36769, 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 63257, 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 12781319, 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 74402945, 2024-09-19T05:42:43.334 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 8, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 6.838581565, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 3.326561734, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 3.791972226, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.234515564, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 63255, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 3.158874609, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000049938 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 87670, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.033944970, 2024-09-19T05:42:43.335 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000387 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 147872 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 1, 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-MDSRank": { 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 11711, 2024-09-19T05:42:43.336 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 34.625038531, 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.002956625 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-PurgeQueue": { 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3261, 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 2.147703499, 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000658602 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-09-19T05:42:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: "request": 27344, 2024-09-19T05:42:43.338 INFO:teuthology.orchestra.run.smithi067.stdout: "reply": 27344, 2024-09-19T05:42:43.338 INFO:teuthology.orchestra.run.smithi067.stdout: "reply_latency": { 2024-09-19T05:42:43.338 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 27344, 2024-09-19T05:42:43.338 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 459.454466901, 2024-09-19T05:42:43.338 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.016802752 2024-09-19T05:42:43.338 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.338 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_reply": 0, 2024-09-19T05:42:43.338 INFO:teuthology.orchestra.run.smithi067.stdout: "forward": 0, 2024-09-19T05:42:43.338 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_complete": 0, 2024-09-19T05:42:43.338 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_keys": 0, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_commit": 12, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_split": 0, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_merge": 0, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes": 17922, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_top": 0, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_bottom": 17922, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pin_tail": 0, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pinned": 17922, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_expired": 0, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_with_caps": 2, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": 2, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "subtrees": 2, 2024-09-19T05:42:43.339 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse": 44237, 2024-09-19T05:42:43.340 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_hit": 43653, 2024-09-19T05:42:43.340 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_forward": 0, 2024-09-19T05:42:43.340 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_discover": 0, 2024-09-19T05:42:43.340 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_dir_fetch": 0, 2024-09-19T05:42:43.340 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_remote_ino": 0, 2024-09-19T05:42:43.340 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_lock": 119, 2024-09-19T05:42:43.340 INFO:teuthology.orchestra.run.smithi067.stdout: "load_cent": 0, 2024-09-19T05:42:43.340 INFO:teuthology.orchestra.run.smithi067.stdout: "q": 0, 2024-09-19T05:42:43.340 INFO:teuthology.orchestra.run.smithi067.stdout: "exported": 0, 2024-09-19T05:42:43.340 INFO:teuthology.orchestra.run.smithi067.stdout: "exported_inodes": 0, 2024-09-19T05:42:43.341 INFO:teuthology.orchestra.run.smithi067.stdout: "imported": 0, 2024-09-19T05:42:43.341 INFO:teuthology.orchestra.run.smithi067.stdout: "imported_inodes": 0, 2024-09-19T05:42:43.341 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_dir_fetch": 0, 2024-09-19T05:42:43.341 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_backtrace_fetch": 1956, 2024-09-19T05:42:43.341 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_peer_discover": 0, 2024-09-19T05:42:43.341 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rfiles": 0, 2024-09-19T05:42:43.341 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rbytes": 0, 2024-09-19T05:42:43.341 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rsnaps": 0, 2024-09-19T05:42:43.341 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_fetch": 1956, 2024-09-19T05:42:43.342 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_set_tag": 0, 2024-09-19T05:42:43.342 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:42:43.342 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:42:43.342 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_inodes": 11, 2024-09-19T05:42:43.342 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_base_inodes": 1, 2024-09-19T05:42:43.342 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dirfrag_rstats": 10, 2024-09-19T05:42:43.342 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_file_inodes": 1945, 2024-09-19T05:42:43.342 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_inode_file_caps": 0, 2024-09-19T05:42:43.342 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_revoke": 6621, 2024-09-19T05:42:43.342 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_grant": 6659, 2024-09-19T05:42:43.343 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T05:42:43.343 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:42:43.343 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:42:43.343 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps": 6621, 2024-09-19T05:42:43.343 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps_dirty": 2000, 2024-09-19T05:42:43.343 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_cap_release": 60, 2024-09-19T05:42:43.343 INFO:teuthology.orchestra.run.smithi067.stdout: "process_request_cap_release": 17908 2024-09-19T05:42:43.343 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.343 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_cache": { 2024-09-19T05:42:43.343 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update_receipt": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_try_discover": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_send_discover": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_handle_discover": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_delayed": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_created": 4204, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_enqueued": 3731, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_reintegrated": 2263, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_migrated": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_processing": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:42:43.344 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_started": 0, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_completed": 0, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_enqueue_scrub": 1, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_exportdir": 0, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_flush": 0, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragmentdir": 0, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragstats": 0, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_inodestats": 0 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_log": { 2024-09-19T05:42:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "evlrg": 0, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "evadd": 25130, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "evex": 0, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "evtrm": 0, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "ev": 25130, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "evexg": 0, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "evexd": 0, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "segadd": 33, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "segex": 0, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "segtrm": 0, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "seg": 33, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "segmjr": 4, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "segexg": 0, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "segexd": 0, 2024-09-19T05:42:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "expos": 4194304, 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "wrpos": 85919377, 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "rdpos": 0, 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "jlat": { 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7389, 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 115.288492166, 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.015602719 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "replayed": 0 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_mem": { 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 14, 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "ino+": 2015, 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "ino-": 2001, 2024-09-19T05:42:43.347 INFO:teuthology.orchestra.run.smithi067.stdout: "dir": 13, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "dir+": 13, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "dir-": 0, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "dn": 17922, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "dn+": 19922, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "dn-": 2000, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "cap": 2, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "cap+": 2002, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "cap-": 2000, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "rss": 92052, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "heap": 231732 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_server": { 2024-09-19T05:42:43.348 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_client_request": 36421, 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_server_request": 0, 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_request": 27344, 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_session": 10, 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_peer_request": 0, 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "req_create_latency": { 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2000, 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 3.769485019, 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001884742 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getattr_latency": { 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1117, 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.892437837, 2024-09-19T05:42:43.349 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000798959 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getfilelock_latency": { 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "req_link_latency": { 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6000, 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 22.101988653, 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.003683664 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookup_latency": { 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7951, 2024-09-19T05:42:43.350 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 9.814257295, 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001234342 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookuphash_latency": { 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupino_latency": { 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.351 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupname_latency": { 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupparent_latency": { 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupsnap_latency": { 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3, 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.050293657, 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.016764552 2024-09-19T05:42:43.352 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lssnap_latency": { 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mkdir_latency": { 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.005417198, 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005417198 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mknod_latency": { 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.353 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mksnap_latency": { 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.006730911, 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.006730911 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "req_open_latency": { 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "req_readdir_latency": { 2024-09-19T05:42:43.354 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6, 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.268890625, 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.044815104 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rename_latency": { 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2263, 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 377.348057839, 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.166746821 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "req_renamesnap_latency": { 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "req_snapdiff_latency": { 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmdir_latency": { 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmsnap_latency": { 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.008686690, 2024-09-19T05:42:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.008686690 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmxattr_latency": { 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setattr_latency": { 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000966742, 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000966742 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setdirlayout_latency": { 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setfilelock_latency": { 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setlayout_latency": { 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setxattr_latency": { 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "req_symlink_latency": { 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "req_unlink_latency": { 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8000, 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 45.187254435, 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005648406 2024-09-19T05:42:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getvxattr_latency": { 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_sessions": { 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "session_count": 1, 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "session_add": 1, 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "session_remove": 0, 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_open": 1, 2024-09-19T05:42:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_stale": 0, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "total_load": 13381, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "average_load": 13381, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "avg_session_uptime": 148, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "mdthresh_evicted": 0 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:42:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:42:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:42:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 251454, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 86, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 5624, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 80, 2024-09-19T05:42:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 13498316, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 662020, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "objecter": { 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "op_active": 0, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "op_laggy": 0, 2024-09-19T05:42:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send": 13594, 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send_bytes": 82323632, 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "op_resend": 26, 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "op_reply": 13594, 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "op_latency": { 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 13594, 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 57.443464741, 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.004225648 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "op_inflight": 0, 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "oplen_avg": { 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 13594, 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 13804 2024-09-19T05:42:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "op": 13594, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "op_r": 2089, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "op_w": 11505, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "op_rmw": 0, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "op_pg": 0, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_stat": 0, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_create": 11, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_read": 132, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_write": 7520, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writefull": 77, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writesame": 0, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_append": 0, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_zero": 1731, 2024-09-19T05:42:43.367 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_truncate": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_delete": 2031, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_mapext": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_sparse_read": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_clonerange": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_getxattr": 1957, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_setxattr": 22, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_rmxattr": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_call": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_watch": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_notify": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:42:43.368 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_other": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_active": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_send": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_resend": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_ping": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_active": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_send": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_resend": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_active": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_send": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_resend": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_active": 0, 2024-09-19T05:42:43.369 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_send": 0, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_resend": 0, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "command_active": 0, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "command_send": 0, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "command_resend": 0, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "map_epoch": 120, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "map_full": 0, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "map_inc": 5, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_sessions": 8, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_open": 8, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_close": 0, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_laggy": 0, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_wr": 255, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_rd": 0, 2024-09-19T05:42:43.370 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_del": 68 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "oft": { 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_objs": 1, 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_updates": 0, 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_removes": 0 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "osd-slow-ops": { 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_ops_count": 0 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "purge_queue": { 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops": 0, 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops_high_water": 32, 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing": 0, 2024-09-19T05:42:43.371 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_high_water": 32, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed_ops": 3731, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed": 3731, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_item_in_journal": 0 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 45623, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 11381832, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 45623, 2024-09-19T05:42:43.372 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 45623, 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 11381832, 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_bytes": { 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:42:43.373 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 13594, 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 82714311, 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 13594, 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 82714311, 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:43.374 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_ops": { 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 1024, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 13594, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 13594, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 13594, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 13594, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.375 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 3731, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 390679, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 3731, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:42:43.376 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 131, 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 390679, 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle-0x55f7738d4780": { 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 25130, 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 81725073, 2024-09-19T05:42:43.377 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 25130, 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 7389, 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 81725073, 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:43.378 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:42:43.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 -- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678f0 msgr2=0x7f121c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678f0 0x7f121c069db0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1220000f70 tx=0x7f1220009040 comp rx=0 tx=0).stop 2024-09-19T05:42:43.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 -- 172.21.15.67:0/2838193244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 msgr2=0x7f123015a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 0x7f123015a8a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1224019070 tx=0x7f122401aca0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 -- 172.21.15.67:0/2838193244 shutdown_connections 2024-09-19T05:42:43.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f123015c360 0x7f12300cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12300ce800 0x7f123015a8a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f121c0678f0 0x7f121c069db0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 --2- 172.21.15.67:0/2838193244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12300b1370 0x7f123015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 -- 172.21.15.67:0/2838193244 >> 172.21.15.67:0/2838193244 conn(0x7f12300b3d70 msgr2=0x7f12300717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 -- 172.21.15.67:0/2838193244 shutdown_connections 2024-09-19T05:42:43.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.326+0000 7f1236393640 1 -- 172.21.15.67:0/2838193244 wait complete. 2024-09-19T05:42:43.381 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:42:43.382 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:42:43.444 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:42:43.522 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:42:43.522 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:42:43.522 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:42:43.522 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:42:43.533 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:42:43.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f633017e640 1 Processor -- start 2024-09-19T05:42:43.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f633017e640 1 -- start start 2024-09-19T05:42:43.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f633017e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f632809b440 0x7f63281602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f633017e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f63280cd920 0x7f63280cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f633017e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63281607f0 con 0x7f632815fed0 2024-09-19T05:42:43.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f633017e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6328160d50 con 0x7f63280cd920 2024-09-19T05:42:43.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f633017e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f632809b8d0 con 0x7f632809b440 2024-09-19T05:42:43.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f632e71b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f63280cd920 0x7f63280cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f632d719640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f632809b440 0x7f63281602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f632df1a640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f632815fed0 0x7f63280b1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:38376/0 (socket says 172.21.15.67:38376) 2024-09-19T05:42:43.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f632df1a640 1 -- 172.21.15.67:0/3064775061 learned_addr learned my addr 172.21.15.67:0/3064775061 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:43.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f632e71b640 1 -- 172.21.15.67:0/3064775061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f632809b440 msgr2=0x7f63281602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:43.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f632e71b640 1 --2- 172.21.15.67:0/3064775061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f632809b440 0x7f63281602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f632e71b640 1 -- 172.21.15.67:0/3064775061 >> v1:172.21.15.97:6789/0 conn(0x7f632815fed0 legacy=0x7f63280b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f632e71b640 1 -- 172.21.15.67:0/3064775061 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632809bbb0 con 0x7f63280cd920 2024-09-19T05:42:43.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.706+0000 7f632d719640 1 --2- 172.21.15.67:0/3064775061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f632809b440 0x7f63281602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:42:43.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f632e71b640 1 --2- 172.21.15.67:0/3064775061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63280cd920 0x7f63280cdd50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f63200097c0 tx=0x7f632001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2125e518f93067e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f632cf18640 1 -- 172.21.15.67:0/3064775061 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63200a7070 con 0x7f63280cd920 2024-09-19T05:42:43.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f632cf18640 1 -- 172.21.15.67:0/3064775061 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63200b0070 con 0x7f63280cd920 2024-09-19T05:42:43.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f632cf18640 1 -- 172.21.15.67:0/3064775061 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63200ab890 con 0x7f63280cd920 2024-09-19T05:42:43.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f633017e640 1 -- 172.21.15.67:0/3064775061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63280cd920 msgr2=0x7f63280cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f633017e640 1 --2- 172.21.15.67:0/3064775061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63280cd920 0x7f63280cdd50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f63200097c0 tx=0x7f632001c470 comp rx=0 tx=0).stop 2024-09-19T05:42:43.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f633017e640 1 -- 172.21.15.67:0/3064775061 shutdown_connections 2024-09-19T05:42:43.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f633017e640 1 --2- 172.21.15.67:0/3064775061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63280cd920 0x7f63280cdd50 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f633017e640 1 --2- 172.21.15.67:0/3064775061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f632809b440 0x7f63281602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f633017e640 1 -- 172.21.15.67:0/3064775061 >> 172.21.15.67:0/3064775061 conn(0x7f63280b3d90 msgr2=0x7f63280b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f633017e640 1 -- 172.21.15.67:0/3064775061 shutdown_connections 2024-09-19T05:42:43.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.710+0000 7f633017e640 1 -- 172.21.15.67:0/3064775061 wait complete. 2024-09-19T05:42:43.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f633017e640 1 Processor -- start 2024-09-19T05:42:43.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f633017e640 1 -- start start 2024-09-19T05:42:43.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f633017e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63280cd920 0x7f6328158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f633017e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f632815fed0 0x7f63280c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f633017e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63280c7a10 0x7f63280c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f633017e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f63280ccec0 con 0x7f63280cd920 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f633017e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f63280ccd40 con 0x7f632815fed0 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f633017e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6328169270 con 0x7f63280c7a10 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632df1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63280cd920 0x7f6328158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632df1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63280cd920 0x7f6328158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38518/0 (socket says 172.21.15.67:38518) 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632df1a640 1 -- 172.21.15.67:0/3603998962 learned_addr learned my addr 172.21.15.67:0/3603998962 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632d719640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f632815fed0 0x7f63280c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632e71b640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63280c7a10 0x7f63280c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632df1a640 1 -- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63280c7a10 msgr2=0x7f63280c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632df1a640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63280c7a10 0x7f63280c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632df1a640 1 -- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f632815fed0 msgr2=0x7f63280c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632df1a640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f632815fed0 0x7f63280c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632df1a640 1 -- 172.21.15.67:0/3603998962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63280c62f0 con 0x7f63280cd920 2024-09-19T05:42:43.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f632df1a640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63280cd920 0x7f6328158890 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f632400ca70 tx=0x7f632400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f631e7fc640 1 -- 172.21.15.67:0/3603998962 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324017070 con 0x7f63280cd920 2024-09-19T05:42:43.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f631e7fc640 1 -- 172.21.15.67:0/3603998962 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632400ab70 con 0x7f63280cd920 2024-09-19T05:42:43.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f631e7fc640 1 -- 172.21.15.67:0/3603998962 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324012400 con 0x7f63280cd920 2024-09-19T05:42:43.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f633017e640 1 -- 172.21.15.67:0/3603998962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63280b7230 con 0x7f63280cd920 2024-09-19T05:42:43.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.714+0000 7f633017e640 1 -- 172.21.15.67:0/3603998962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63280b77f0 con 0x7f63280cd920 2024-09-19T05:42:43.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.718+0000 7f633017e640 1 -- 172.21.15.67:0/3603998962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63281602b0 con 0x7f63280cd920 2024-09-19T05:42:43.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.718+0000 7f631e7fc640 1 -- 172.21.15.67:0/3603998962 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f632401a070 con 0x7f63280cd920 2024-09-19T05:42:43.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.718+0000 7f631e7fc640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f630c0678c0 0x7f630c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:43.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.718+0000 7f631e7fc640 1 -- 172.21.15.67:0/3603998962 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f6324085af0 con 0x7f63280cd920 2024-09-19T05:42:43.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.718+0000 7f632d719640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f630c0678c0 0x7f630c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:43.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.718+0000 7f632d719640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f630c0678c0 0x7f630c069d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6318009580 tx=0x7f6318008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:43.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.722+0000 7f631e7fc640 1 -- 172.21.15.67:0/3603998962 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6324056470 con 0x7f63280cd920 2024-09-19T05:42:43.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.898+0000 7f633017e640 1 -- 172.21.15.67:0/3603998962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f63280b4ca0 con 0x7f63280cd920 2024-09-19T05:42:43.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f631e7fc640 1 -- 172.21.15.67:0/3603998962 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v120) ==== 80+0+0 (secure 0 0 0) 0x7f6324055d70 con 0x7f63280cd920 2024-09-19T05:42:43.899 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:42:43.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 -- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f630c0678c0 msgr2=0x7f630c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f630c0678c0 0x7f630c069d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6318009580 tx=0x7f6318008040 comp rx=0 tx=0).stop 2024-09-19T05:42:43.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 -- 172.21.15.67:0/3603998962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63280cd920 msgr2=0x7f6328158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:43.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63280cd920 0x7f6328158890 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f632400ca70 tx=0x7f632400cf30 comp rx=0 tx=0).stop 2024-09-19T05:42:43.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 -- 172.21.15.67:0/3603998962 shutdown_connections 2024-09-19T05:42:43.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f630c0678c0 0x7f630c069d80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63280c7a10 0x7f63280c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f632815fed0 0x7f63280c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 --2- 172.21.15.67:0/3603998962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63280cd920 0x7f6328158890 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:43.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 -- 172.21.15.67:0/3603998962 >> 172.21.15.67:0/3603998962 conn(0x7f63280b3d90 msgr2=0x7f632815f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:43.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 -- 172.21.15.67:0/3603998962 shutdown_connections 2024-09-19T05:42:43.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:43.902+0000 7f633017e640 1 -- 172.21.15.67:0/3603998962 wait complete. 2024-09-19T05:42:43.920 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:42:43.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:42:43.920 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:42:43.930 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[60145]: fuse finished with error 0 and tester_r 0 2024-09-19T05:42:43.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:42:43.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:42:43.934 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:42:44.101 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:42:44.102 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:42:44.102 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:42:44.108 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:42:44.108 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:42:44.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:42:44.108 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:42:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:42:44.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:42:44.158 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:42:44.158 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:42:44.158 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:42:44.164 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:42:44.164 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:42:44.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:42:44.165 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:42:44.211 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:42:44.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:42:44.213 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:42:44.213 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:42:44.213 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:42:44.219 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:42:44.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:42:44.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:42:44.219 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:42:44.265 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:42:44.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:42:44.266 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:42:44.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b3f0f640 1 Processor -- start 2024-09-19T05:42:44.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b3f0f640 1 -- start start 2024-09-19T05:42:44.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b3f0f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3ac06f460 0x7ff3ac06f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b3f0f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3ac06e3c0 con 0x7ff3ac15c030 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b3f0f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3ac06e6a0 con 0x7ff3ac06dde0 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b3f0f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff3ac06e980 con 0x7ff3ac06f460 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b1cab640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff3ac15c030 0x7ff3ac15d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48530/0 (socket says 172.21.15.67:48530) 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b1cab640 1 -- 172.21.15.67:0/1897956136 learned_addr learned my addr 172.21.15.67:0/1897956136 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1486168603 0 0) 0x7ff3ac06e3c0 con 0x7ff3ac15c030 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff398003530 con 0x7ff3ac15c030 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b24ac640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3ac06f460 0x7ff3ac06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1596695987 0 0) 0x7ff398003530 con 0x7ff3ac15c030 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3ac06f460 msgr2=0x7ff3ac06f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3ac06f460 0x7ff3ac06f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 >> v1:172.21.15.97:6789/0 conn(0x7ff3ac06dde0 legacy=0x7ff3ac0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ac06ec60 con 0x7ff3ac15c030 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7ff3a8001680 con 0x7ff3ac15c030 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 >> v1:172.21.15.67:6789/0 conn(0x7ff3ac15c030 legacy=0x7ff3ac15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3980039f0 0x7ff398003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff398004810 0x7ff398004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3ac06f460 0x7ff3980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac06e980 con 0x7ff398004810 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff39800ba80 con 0x7ff3980039f0 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff39800bc80 con 0x7ff3ac06f460 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b14aa640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff398004810 0x7ff398004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b1cab640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3980039f0 0x7ff398003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b24ac640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3ac06f460 0x7ff3980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b14aa640 1 -- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3ac06f460 msgr2=0x7ff3980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:44.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b14aa640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3ac06f460 0x7ff3980051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b14aa640 1 -- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3980039f0 msgr2=0x7ff398003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:44.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b14aa640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3980039f0 0x7ff398003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b14aa640 1 -- 172.21.15.67:0/1897956136 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff398003530 con 0x7ff398004810 2024-09-19T05:42:44.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.402+0000 7ff3b1cab640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3980039f0 0x7ff398003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:42:44.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b14aa640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff398004810 0x7ff398004c90 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff39c001750 tx=0x7ff39c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f1b675003e4988 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:44.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0013a0 con 0x7ff398004810 2024-09-19T05:42:44.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39c0052f0 con 0x7ff398004810 2024-09-19T05:42:44.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b0ca9640 1 -- 172.21.15.67:0/1897956136 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c003840 con 0x7ff398004810 2024-09-19T05:42:44.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/1897956136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff398004810 msgr2=0x7ff398004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 --2- 172.21.15.67:0/1897956136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff398004810 0x7ff398004c90 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff39c001750 tx=0x7ff39c01c3c0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b24ac640 1 -- 172.21.15.67:0/1897956136 reap_dead start 2024-09-19T05:42:44.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/1897956136 shutdown_connections 2024-09-19T05:42:44.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/1897956136 >> 172.21.15.67:0/1897956136 conn(0x7ff3ac0d0080 msgr2=0x7ff3ac0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:44.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/1897956136 shutdown_connections 2024-09-19T05:42:44.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/1897956136 wait complete. 2024-09-19T05:42:44.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 Processor -- start 2024-09-19T05:42:44.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 -- start start 2024-09-19T05:42:44.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff398004810 0x7ff3ac1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3ac15f1f0 0x7ff3ac145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3ac1f3ad0 0x7ff3ac1f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac0b36e0 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac15c410 con 0x7ff3ac15f1f0 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.406+0000 7ff3b3f0f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff3ac15c8b0 con 0x7ff398004810 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b24ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3ac1f3ad0 0x7ff3ac1f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b24ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3ac1f3ad0 0x7ff3ac1f3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38536/0 (socket says 172.21.15.67:38536) 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b24ac640 1 -- 172.21.15.67:0/832159239 learned_addr learned my addr 172.21.15.67:0/832159239 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b14aa640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3ac15f1f0 0x7ff3ac145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b1cab640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff398004810 0x7ff3ac1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b24ac640 1 -- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff398004810 msgr2=0x7ff3ac1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b24ac640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff398004810 0x7ff3ac1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b24ac640 1 -- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3ac15f1f0 msgr2=0x7ff3ac145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b24ac640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3ac15f1f0 0x7ff3ac145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b24ac640 1 -- 172.21.15.67:0/832159239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ac151b40 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b24ac640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3ac1f3ad0 0x7ff3ac1f3f50 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac15fca0 tx=0x7ff3a40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3a27fc640 1 -- 172.21.15.67:0/832159239 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4011e70 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3a27fc640 1 -- 172.21.15.67:0/832159239 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a401b070 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/832159239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3ac151e20 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3a27fc640 1 -- 172.21.15.67:0/832159239 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a40039a0 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/832159239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3ac15cb00 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/832159239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3ac06f890 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3a27fc640 1 -- 172.21.15.67:0/832159239 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3a4003b40 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3a27fc640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3900678c0 0x7ff390069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3a27fc640 1 -- 172.21.15.67:0/832159239 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7ff3a4087430 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.410+0000 7ff3b1cab640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3900678c0 0x7ff390069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.414+0000 7ff3b1cab640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3900678c0 0x7ff390069d80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8001060 tx=0x7ff3a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:44.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.414+0000 7ff3a27fc640 1 -- 172.21.15.67:0/832159239 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff3a4025020 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.618+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/832159239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3ac0d0f20 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.618+0000 7ff3a27fc640 1 -- 172.21.15.67:0/832159239 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5219 (secure 0 0 0) 0x7ff3a4057ea0 con 0x7ff3ac1f3ad0 2024-09-19T05:42:44.618 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:44.618 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":84,"btime":"2024-09-19T05:40:12:319167+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3139499810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3139499810},{"type":"v1","addr":"172.21.15.67:6833","nonce":3139499810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2818006351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2818006351},{"type":"v1","addr":"172.21.15.67:6835","nonce":2818006351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/762722911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":762722911},{"type":"v1","addr":"172.21.15.97:6835","nonce":762722911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-19T05:39:58.136994+0000","modified":"2024-09-19T05:40:12.222026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/396819326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":396819326},{"type":"v1","addr":"172.21.15.97:6837","nonce":396819326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6556,"qdb_cluster":[6556]},"id":7}]} 2024-09-19T05:42:44.619 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 84 2024-09-19T05:42:44.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3900678c0 msgr2=0x7ff390069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3900678c0 0x7ff390069d80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8001060 tx=0x7ff3a8009040 comp rx=0 tx=0).stop 2024-09-19T05:42:44.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/832159239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3ac1f3ad0 msgr2=0x7ff3ac1f3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3ac1f3ad0 0x7ff3ac1f3f50 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac15fca0 tx=0x7ff3a40115a0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/832159239 shutdown_connections 2024-09-19T05:42:44.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3ac1f3ad0 0x7ff3ac1f3f50 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3ac15f1f0 0x7ff3ac145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3900678c0 0x7ff390069d80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 --2- 172.21.15.67:0/832159239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff398004810 0x7ff3ac1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/832159239 >> 172.21.15.67:0/832159239 conn(0x7ff3ac0d0080 msgr2=0x7ff3ac06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:44.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/832159239 shutdown_connections 2024-09-19T05:42:44.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.622+0000 7ff3b3f0f640 1 -- 172.21.15.67:0/832159239 wait complete. 2024-09-19T05:42:44.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:42:44.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f157081c640 1 Processor -- start 2024-09-19T05:42:44.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f157081c640 1 -- start start 2024-09-19T05:42:44.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f157081c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f156c15e800 0x7f156c0cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f157081c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f156c0b1b60 con 0x7f156c0c7a20 2024-09-19T05:42:44.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f157081c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f156c0713a0 con 0x7f156c0c7560 2024-09-19T05:42:44.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f157081c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f156c071cd0 con 0x7f156c15e800 2024-09-19T05:42:44.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f156a59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f156c0c7a20 0x7f156c0c7e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48546/0 (socket says 172.21.15.67:48546) 2024-09-19T05:42:44.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f156a59c640 1 -- 172.21.15.67:0/1464478252 learned_addr learned my addr 172.21.15.67:0/1464478252 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:44.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f1569d9b640 1 --2- 172.21.15.67:0/1464478252 >> v2:172.21.15.97:3300/0 conn(0x7f156c15e800 0x7f156c0cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723882837 0 0) 0x7f156c0b1b60 con 0x7f156c0c7a20 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.766+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1558003530 con 0x7f156c0c7a20 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 939989072 0 0) 0x7f1558003530 con 0x7f156c0c7a20 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 >> v2:172.21.15.97:3300/0 conn(0x7f156c15e800 msgr2=0x7f156c0cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 --2- 172.21.15.67:0/1464478252 >> v2:172.21.15.97:3300/0 conn(0x7f156c15e800 0x7f156c0cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 >> v1:172.21.15.97:6789/0 conn(0x7f156c0c7560 legacy=0x7f156c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c071680 con 0x7f156c0c7a20 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1564001680 con 0x7f156c0c7a20 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 >> v1:172.21.15.67:6789/0 conn(0x7f156c0c7a20 legacy=0x7f156c0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 --2- 172.21.15.67:0/1464478252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1558003a10 0x7f1558003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 --2- 172.21.15.67:0/1464478252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1558004810 0x7f1558004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 --2- 172.21.15.67:0/1464478252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1558005220 0x7f155800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f156c071cd0 con 0x7f1558005220 2024-09-19T05:42:44.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f155800c170 con 0x7f1558003a10 2024-09-19T05:42:44.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f155800c370 con 0x7f1558004810 2024-09-19T05:42:44.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156ad9d640 1 --2- 172.21.15.67:0/1464478252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1558005220 0x7f155800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156ad9d640 1 -- 172.21.15.67:0/1464478252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1558004810 msgr2=0x7f1558004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:44.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156ad9d640 1 --2- 172.21.15.67:0/1464478252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1558004810 0x7f1558004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156ad9d640 1 -- 172.21.15.67:0/1464478252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1558003a10 msgr2=0x7f1558003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:44.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156a59c640 1 --2- 172.21.15.67:0/1464478252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1558003a10 0x7f1558003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156ad9d640 1 --2- 172.21.15.67:0/1464478252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1558003a10 0x7f1558003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156ad9d640 1 -- 172.21.15.67:0/1464478252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1558003530 con 0x7f1558005220 2024-09-19T05:42:44.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156ad9d640 1 -- 172.21.15.67:0/1464478252 reap_dead start 2024-09-19T05:42:44.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156ad9d640 1 --2- 172.21.15.67:0/1464478252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1558005220 0x7f155800b9d0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f156c0c79f0 tx=0x7f155c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc29862c23e2ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:44.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c0013a0 con 0x7f1558005220 2024-09-19T05:42:44.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f155c0052d0 con 0x7f1558005220 2024-09-19T05:42:44.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f156959a640 1 -- 172.21.15.67:0/1464478252 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c003840 con 0x7f1558005220 2024-09-19T05:42:44.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f157081c640 1 -- 172.21.15.67:0/1464478252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1558005220 msgr2=0x7f155800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f157081c640 1 --2- 172.21.15.67:0/1464478252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1558005220 0x7f155800b9d0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f156c0c79f0 tx=0x7f155c01c3a0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f157081c640 1 -- 172.21.15.67:0/1464478252 shutdown_connections 2024-09-19T05:42:44.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f157081c640 1 --2- 172.21.15.67:0/1464478252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1558005220 0x7f155800b9d0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f157081c640 1 -- 172.21.15.67:0/1464478252 >> 172.21.15.67:0/1464478252 conn(0x7f156c0d22b0 msgr2=0x7f156c0d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:44.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f157081c640 1 -- 172.21.15.67:0/1464478252 shutdown_connections 2024-09-19T05:42:44.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.770+0000 7f157081c640 1 -- 172.21.15.67:0/1464478252 wait complete. 2024-09-19T05:42:44.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 Processor -- start 2024-09-19T05:42:44.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 -- start start 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1558005220 0x7f156c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f156c1545c0 0x7f156c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f156c155440 0x7f156c15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f156c0b1990 con 0x7f156c1545c0 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f156c0b1810 con 0x7f1558005220 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f156c0b12c0 con 0x7f156c155440 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1569d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f156c1545c0 0x7f156c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1569d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f156c1545c0 0x7f156c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38550/0 (socket says 172.21.15.67:38550) 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1569d9b640 1 -- 172.21.15.67:0/1871756526 learned_addr learned my addr 172.21.15.67:0/1871756526 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f156a59c640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1558005220 0x7f156c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f156ad9d640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f156c155440 0x7f156c15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1569d9b640 1 -- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f156c155440 msgr2=0x7f156c15c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1569d9b640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f156c155440 0x7f156c15c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1569d9b640 1 -- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1558005220 msgr2=0x7f156c156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1569d9b640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1558005220 0x7f156c156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1569d9b640 1 -- 172.21.15.67:0/1871756526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c1559c0 con 0x7f156c1545c0 2024-09-19T05:42:44.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1569d9b640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f156c1545c0 0x7f156c154f00 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f155400ef70 tx=0x7f155400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:44.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1562ffd640 1 -- 172.21.15.67:0/1871756526 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15540039a0 con 0x7f156c1545c0 2024-09-19T05:42:44.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1562ffd640 1 -- 172.21.15.67:0/1871756526 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1554019070 con 0x7f156c1545c0 2024-09-19T05:42:44.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 -- 172.21.15.67:0/1871756526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f156c155ca0 con 0x7f156c1545c0 2024-09-19T05:42:44.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f1562ffd640 1 -- 172.21.15.67:0/1871756526 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1554003d80 con 0x7f156c1545c0 2024-09-19T05:42:44.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 -- 172.21.15.67:0/1871756526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f156c156260 con 0x7f156c1545c0 2024-09-19T05:42:44.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.774+0000 7f157081c640 1 -- 172.21.15.67:0/1871756526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f156c068d10 con 0x7f156c1545c0 2024-09-19T05:42:44.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.778+0000 7f1562ffd640 1 -- 172.21.15.67:0/1871756526 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1554013070 con 0x7f156c1545c0 2024-09-19T05:42:44.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.778+0000 7f1562ffd640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f154c0678c0 0x7f154c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:44.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.778+0000 7f1562ffd640 1 -- 172.21.15.67:0/1871756526 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f1554086270 con 0x7f156c1545c0 2024-09-19T05:42:44.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.778+0000 7f156a59c640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f154c0678c0 0x7f154c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:44.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.778+0000 7f156a59c640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f154c0678c0 0x7f154c069d80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f15640017f0 tx=0x7f1564009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:44.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.782+0000 7f1562ffd640 1 -- 172.21.15.67:0/1871756526 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1554056bf0 con 0x7f156c1545c0 2024-09-19T05:42:44.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.982+0000 7f157081c640 1 -- 172.21.15.67:0/1871756526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f156c0c7130 con 0x7f156c1545c0 2024-09-19T05:42:44.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.982+0000 7f1562ffd640 1 -- 172.21.15.67:0/1871756526 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5219 (secure 0 0 0) 0x7f15540564f0 con 0x7f156c1545c0 2024-09-19T05:42:44.982 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:44.982 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":84,"btime":"2024-09-19T05:40:12:319167+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3139499810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3139499810},{"type":"v1","addr":"172.21.15.67:6833","nonce":3139499810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2818006351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2818006351},{"type":"v1","addr":"172.21.15.67:6835","nonce":2818006351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/762722911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":762722911},{"type":"v1","addr":"172.21.15.97:6835","nonce":762722911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-19T05:39:58.136994+0000","modified":"2024-09-19T05:40:12.222026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/396819326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":396819326},{"type":"v1","addr":"172.21.15.97:6837","nonce":396819326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6556,"qdb_cluster":[6556]},"id":7}]} 2024-09-19T05:42:44.982 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 84 2024-09-19T05:42:44.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 -- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f154c0678c0 msgr2=0x7f154c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f154c0678c0 0x7f154c069d80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f15640017f0 tx=0x7f1564009040 comp rx=0 tx=0).stop 2024-09-19T05:42:44.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 -- 172.21.15.67:0/1871756526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f156c1545c0 msgr2=0x7f156c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:44.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f156c1545c0 0x7f156c154f00 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f155400ef70 tx=0x7f155400b480 comp rx=0 tx=0).stop 2024-09-19T05:42:44.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 -- 172.21.15.67:0/1871756526 shutdown_connections 2024-09-19T05:42:44.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f154c0678c0 0x7f154c069d80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f156c155440 0x7f156c15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f156c1545c0 0x7f156c154f00 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 --2- 172.21.15.67:0/1871756526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1558005220 0x7f156c156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:44.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 -- 172.21.15.67:0/1871756526 >> 172.21.15.67:0/1871756526 conn(0x7f156c0d22b0 msgr2=0x7f156c0b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:44.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 -- 172.21.15.67:0/1871756526 shutdown_connections 2024-09-19T05:42:44.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:44.986+0000 7f157081c640 1 -- 172.21.15.67:0/1871756526 wait complete. 2024-09-19T05:42:45.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:42:45.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dbc280640 1 Processor -- start 2024-09-19T05:42:45.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dbc280640 1 -- start start 2024-09-19T05:42:45.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dbc280640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db415c030 0x7f6db406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dbc280640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6db406e3c0 con 0x7f6db406f460 2024-09-19T05:42:45.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dbc280640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6db406e6a0 con 0x7f6db415d1d0 2024-09-19T05:42:45.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dbc280640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6db406e980 con 0x7f6db415c030 2024-09-19T05:42:45.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dba81d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6db406f460 0x7f6db40acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48560/0 (socket says 172.21.15.67:48560) 2024-09-19T05:42:45.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dba81d640 1 -- 172.21.15.67:0/192507744 learned_addr learned my addr 172.21.15.67:0/192507744 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dba01c640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db415c030 0x7f6db406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43254190 0 0) 0x7f6db406e3c0 con 0x7f6db406f460 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6da0003530 con 0x7f6db406f460 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772368067 0 0) 0x7f6db406e6a0 con 0x7f6db415d1d0 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6db406e3c0 con 0x7f6db415d1d0 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1038762888 0 0) 0x7f6da0003530 con 0x7f6db406f460 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db415c030 msgr2=0x7f6db406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db415c030 0x7f6db406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 >> v1:172.21.15.97:6789/0 conn(0x7f6db415d1d0 legacy=0x7f6db40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db406ec60 con 0x7f6db406f460 2024-09-19T05:42:45.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6dac001980 con 0x7f6db406f460 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 >> v1:172.21.15.67:6789/0 conn(0x7f6db406f460 legacy=0x7f6db40acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6da0003b80 0x7f6da0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db415c030 0x7f6da0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6da0004d50 0x7f6da00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6db406e980 con 0x7f6da0003b80 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6da000ba80 con 0x7f6da0004d50 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6da000bc80 con 0x7f6db415c030 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dba01c640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6da0003b80 0x7f6da0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dba01c640 1 -- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db415c030 msgr2=0x7f6da0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6db981b640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db415c030 0x7f6da0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dba01c640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db415c030 0x7f6da0004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dba01c640 1 -- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6da0004d50 msgr2=0x7f6da00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dba81d640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6da0004d50 0x7f6da00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dba01c640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6da0004d50 0x7f6da00051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.122+0000 7f6dba01c640 1 -- 172.21.15.67:0/192507744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da0003530 con 0x7f6da0003b80 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6dba01c640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6da0003b80 0x7f6da0003f80 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009ae0 tx=0x7f6da401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dd2c7d9db727d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da40b2070 con 0x7f6da0003b80 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da40a5530 con 0x7f6da0003b80 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6db901a640 1 -- 172.21.15.67:0/192507744 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da40096b0 con 0x7f6da0003b80 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6dbc280640 1 -- 172.21.15.67:0/192507744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6da0003b80 msgr2=0x7f6da0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6dbc280640 1 --2- 172.21.15.67:0/192507744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6da0003b80 0x7f6da0003f80 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009ae0 tx=0x7f6da401ca40 comp rx=0 tx=0).stop 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6dba81d640 1 -- 172.21.15.67:0/192507744 reap_dead start 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6dbc280640 1 -- 172.21.15.67:0/192507744 shutdown_connections 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6dbc280640 1 -- 172.21.15.67:0/192507744 >> 172.21.15.67:0/192507744 conn(0x7f6db40d0080 msgr2=0x7f6db40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6dbc280640 1 -- 172.21.15.67:0/192507744 shutdown_connections 2024-09-19T05:42:45.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6dbc280640 1 -- 172.21.15.67:0/192507744 wait complete. 2024-09-19T05:42:45.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6dbc280640 1 Processor -- start 2024-09-19T05:42:45.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.126+0000 7f6dbc280640 1 -- start start 2024-09-19T05:42:45.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dbc280640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6da0003b80 0x7f6db41500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dbc280640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db4157960 0x7f6db4157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dbc280640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6db4155b70 0x7f6db4155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dbc280640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6db415c590 con 0x7f6db4157960 2024-09-19T05:42:45.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dbc280640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6db415c410 con 0x7f6db4155b70 2024-09-19T05:42:45.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dbc280640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6db40ad6c0 con 0x7f6da0003b80 2024-09-19T05:42:45.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6db981b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db4157960 0x7f6db4157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6db981b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db4157960 0x7f6db4157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38562/0 (socket says 172.21.15.67:38562) 2024-09-19T05:42:45.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6db981b640 1 -- 172.21.15.67:0/3952888855 learned_addr learned my addr 172.21.15.67:0/3952888855 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:45.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dba81d640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6db4155b70 0x7f6db4155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dba01c640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6da0003b80 0x7f6db41500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6db981b640 1 -- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6da0003b80 msgr2=0x7f6db41500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6db981b640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6da0003b80 0x7f6db41500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6db981b640 1 -- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6db4155b70 msgr2=0x7f6db4155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6db981b640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6db4155b70 0x7f6db4155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6db981b640 1 -- 172.21.15.67:0/3952888855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db41525d0 con 0x7f6db4157960 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6db981b640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db4157960 0x7f6db4157dc0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f6db000d7d0 tx=0x7f6db000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6daaffd640 1 -- 172.21.15.67:0/3952888855 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0016070 con 0x7f6db4157960 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6daaffd640 1 -- 172.21.15.67:0/3952888855 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db000b8d0 con 0x7f6db4157960 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dbc280640 1 -- 172.21.15.67:0/3952888855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db4152870 con 0x7f6db4157960 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6daaffd640 1 -- 172.21.15.67:0/3952888855 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db000bcc0 con 0x7f6db4157960 2024-09-19T05:42:45.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dbc280640 1 -- 172.21.15.67:0/3952888855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db4152e30 con 0x7f6db4157960 2024-09-19T05:42:45.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dbc280640 1 -- 172.21.15.67:0/3952888855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db406dde0 con 0x7f6db4157960 2024-09-19T05:42:45.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6daaffd640 1 -- 172.21.15.67:0/3952888855 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6db0019070 con 0x7f6db4157960 2024-09-19T05:42:45.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6daaffd640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6d980678c0 0x7f6d98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6daaffd640 1 -- 172.21.15.67:0/3952888855 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f6db0085e50 con 0x7f6db4157960 2024-09-19T05:42:45.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.130+0000 7f6dba01c640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6d980678c0 0x7f6d98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.134+0000 7f6dba01c640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6d980678c0 0x7f6d98069d80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6da40af000 tx=0x7f6da40046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.138+0000 7f6daaffd640 1 -- 172.21.15.67:0/3952888855 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6db0056740 con 0x7f6db4157960 2024-09-19T05:42:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.298+0000 7f6dbc280640 1 -- 172.21.15.67:0/3952888855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6db40d0f20 con 0x7f6db4157960 2024-09-19T05:42:45.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6daaffd640 1 -- 172.21.15.67:0/3952888855 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+17024 (secure 0 0 0) 0x7f6db0056040 con 0x7f6db4157960 2024-09-19T05:42:45.301 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:45.301 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":120,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:42:20.150268+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:39:55.832671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-19T05:39:57.135928+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":119,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:42:45.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6dbc280640 1 -- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6d980678c0 msgr2=0x7f6d98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6dbc280640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6d980678c0 0x7f6d98069d80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6da40af000 tx=0x7f6da40046d0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6dbc280640 1 -- 172.21.15.67:0/3952888855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db4157960 msgr2=0x7f6db4157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6dbc280640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db4157960 0x7f6db4157dc0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f6db000d7d0 tx=0x7f6db000dc90 comp rx=0 tx=0).stop 2024-09-19T05:42:45.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6dbc280640 1 -- 172.21.15.67:0/3952888855 shutdown_connections 2024-09-19T05:42:45.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6dbc280640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6db4155b70 0x7f6db4155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6dbc280640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db4157960 0x7f6db4157dc0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6dbc280640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6d980678c0 0x7f6d98069d80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6dbc280640 1 --2- 172.21.15.67:0/3952888855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6da0003b80 0x7f6db41500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.302+0000 7f6dbc280640 1 -- 172.21.15.67:0/3952888855 >> 172.21.15.67:0/3952888855 conn(0x7f6db40d0080 msgr2=0x7f6db40af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.306+0000 7f6dbc280640 1 -- 172.21.15.67:0/3952888855 shutdown_connections 2024-09-19T05:42:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.306+0000 7f6dbc280640 1 -- 172.21.15.67:0/3952888855 wait complete. 2024-09-19T05:42:45.320 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:42:45.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:42:45.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd789dd7640 1 Processor -- start 2024-09-19T05:42:45.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd789dd7640 1 -- start start 2024-09-19T05:42:45.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd789dd7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7840b4900 0x7fd784071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd789dd7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7840b3860 con 0x7fd7840723c0 2024-09-19T05:42:45.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd789dd7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7840b3b40 con 0x7fd78415b1e0 2024-09-19T05:42:45.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd789dd7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd78415b5c0 con 0x7fd7840b4900 2024-09-19T05:42:45.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd783fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd7840723c0 0x7fd7840ade10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48570/0 (socket says 172.21.15.67:48570) 2024-09-19T05:42:45.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd783fff640 1 -- 172.21.15.67:0/3958960190 learned_addr learned my addr 172.21.15.67:0/3958960190 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:45.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd782ffd640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7840b4900 0x7fd784071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130677952 0 0) 0x7fd7840b3860 con 0x7fd7840723c0 2024-09-19T05:42:45.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd76c003530 con 0x7fd7840723c0 2024-09-19T05:42:45.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1396666253 0 0) 0x7fd76c003530 con 0x7fd7840723c0 2024-09-19T05:42:45.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7840b4900 msgr2=0x7fd784071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:45.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7840b4900 0x7fd784071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 >> v1:172.21.15.97:6789/0 conn(0x7fd78415b1e0 legacy=0x7fd7840b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7840b3e20 con 0x7fd7840723c0 2024-09-19T05:42:45.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fd77c001a00 con 0x7fd7840723c0 2024-09-19T05:42:45.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 >> v1:172.21.15.67:6789/0 conn(0x7fd7840723c0 legacy=0x7fd7840ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd76c0039f0 0x7fd76c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c004810 0x7fd76c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7840b4900 0x7fd76c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd78415b5c0 con 0x7fd76c0039f0 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c00ba80 con 0x7fd76c004810 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd76c00bc80 con 0x7fd7840b4900 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7837fe640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd76c0039f0 0x7fd76c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd783fff640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7840b4900 0x7fd76c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd782ffd640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c004810 0x7fd76c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7837fe640 1 -- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7840b4900 msgr2=0x7fd76c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7837fe640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7840b4900 0x7fd76c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7837fe640 1 -- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c004810 msgr2=0x7fd76c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7837fe640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c004810 0x7fd76c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd7837fe640 1 -- 172.21.15.67:0/3958960190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c003530 con 0x7fd76c0039f0 2024-09-19T05:42:45.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.446+0000 7fd783fff640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7840b4900 0x7fd76c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:45.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd7837fe640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd76c0039f0 0x7fd76c003e10 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fd774001750 tx=0x7fd77401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25b416ea0df292b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:45.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7740013a0 con 0x7fd76c0039f0 2024-09-19T05:42:45.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7740052f0 con 0x7fd76c0039f0 2024-09-19T05:42:45.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd7827fc640 1 -- 172.21.15.67:0/3958960190 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774003840 con 0x7fd76c0039f0 2024-09-19T05:42:45.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd789dd7640 1 -- 172.21.15.67:0/3958960190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd76c0039f0 msgr2=0x7fd76c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd789dd7640 1 --2- 172.21.15.67:0/3958960190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd76c0039f0 0x7fd76c003e10 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fd774001750 tx=0x7fd77401c390 comp rx=0 tx=0).stop 2024-09-19T05:42:45.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd783fff640 1 -- 172.21.15.67:0/3958960190 reap_dead start 2024-09-19T05:42:45.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd789dd7640 1 -- 172.21.15.67:0/3958960190 shutdown_connections 2024-09-19T05:42:45.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd789dd7640 1 -- 172.21.15.67:0/3958960190 >> 172.21.15.67:0/3958960190 conn(0x7fd7840d0080 msgr2=0x7fd7840d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:45.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd789dd7640 1 -- 172.21.15.67:0/3958960190 shutdown_connections 2024-09-19T05:42:45.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd789dd7640 1 -- 172.21.15.67:0/3958960190 wait complete. 2024-09-19T05:42:45.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd789dd7640 1 Processor -- start 2024-09-19T05:42:45.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.450+0000 7fd789dd7640 1 -- start start 2024-09-19T05:42:45.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd789dd7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c0039f0 0x7fd784164d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd789dd7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd78414bbf0 0x7fd784165630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd789dd7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd78414c070 0x7fd784160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd789dd7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd784167060 con 0x7fd78414bbf0 2024-09-19T05:42:45.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd789dd7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd7840aed30 con 0x7fd76c0039f0 2024-09-19T05:42:45.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd789dd7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd7841671e0 con 0x7fd78414c070 2024-09-19T05:42:45.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd782ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd78414bbf0 0x7fd784165630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd782ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd78414bbf0 0x7fd784165630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38578/0 (socket says 172.21.15.67:38578) 2024-09-19T05:42:45.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd782ffd640 1 -- 172.21.15.67:0/1884239491 learned_addr learned my addr 172.21.15.67:0/1884239491 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:45.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd783fff640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd78414c070 0x7fd784160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd7837fe640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c0039f0 0x7fd784164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd782ffd640 1 -- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd78414c070 msgr2=0x7fd784160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd782ffd640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd78414c070 0x7fd784160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd782ffd640 1 -- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c0039f0 msgr2=0x7fd784164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd782ffd640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c0039f0 0x7fd784164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd782ffd640 1 -- 172.21.15.67:0/1884239491 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7841652b0 con 0x7fd78414bbf0 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd7837fe640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c0039f0 0x7fd784164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd782ffd640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd78414bbf0 0x7fd784165630 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd778010890 tx=0x7fd778010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd76bfff640 1 -- 172.21.15.67:0/1884239491 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77800f040 con 0x7fd78414bbf0 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd76bfff640 1 -- 172.21.15.67:0/1884239491 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77800eb60 con 0x7fd78414bbf0 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd76bfff640 1 -- 172.21.15.67:0/1884239491 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77801c400 con 0x7fd78414bbf0 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd789dd7640 1 -- 172.21.15.67:0/1884239491 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7841660f0 con 0x7fd78414bbf0 2024-09-19T05:42:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd789dd7640 1 -- 172.21.15.67:0/1884239491 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd784164570 con 0x7fd78414bbf0 2024-09-19T05:42:45.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.454+0000 7fd789dd7640 1 -- 172.21.15.67:0/1884239491 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7841640a0 con 0x7fd78414bbf0 2024-09-19T05:42:45.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.458+0000 7fd76bfff640 1 -- 172.21.15.67:0/1884239491 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd77801c5a0 con 0x7fd78414bbf0 2024-09-19T05:42:45.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.458+0000 7fd76bfff640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7700678c0 0x7fd770069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.458+0000 7fd76bfff640 1 -- 172.21.15.67:0/1884239491 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7fd778086550 con 0x7fd78414bbf0 2024-09-19T05:42:45.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.458+0000 7fd7837fe640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7700678c0 0x7fd770069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.458+0000 7fd7837fe640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7700678c0 0x7fd770069d80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0057f0 tx=0x7fd7740011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:45.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.462+0000 7fd76bfff640 1 -- 172.21.15.67:0/1884239491 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd778018030 con 0x7fd78414bbf0 2024-09-19T05:42:45.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.662+0000 7fd789dd7640 1 -- 172.21.15.67:0/1884239491 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7840ade10 con 0x7fd78414bbf0 2024-09-19T05:42:45.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.662+0000 7fd76bfff640 1 -- 172.21.15.67:0/1884239491 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5219 (secure 0 0 0) 0x7fd7780569f0 con 0x7fd78414bbf0 2024-09-19T05:42:45.661 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:45.661 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":84,"btime":"2024-09-19T05:40:12:319167+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3139499810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3139499810},{"type":"v1","addr":"172.21.15.67:6833","nonce":3139499810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2818006351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2818006351},{"type":"v1","addr":"172.21.15.67:6835","nonce":2818006351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/762722911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":762722911},{"type":"v1","addr":"172.21.15.97:6835","nonce":762722911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-19T05:39:58.136994+0000","modified":"2024-09-19T05:40:12.222026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/396819326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":396819326},{"type":"v1","addr":"172.21.15.97:6837","nonce":396819326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6556,"qdb_cluster":[6556]},"id":7}]} 2024-09-19T05:42:45.662 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 84 2024-09-19T05:42:45.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 -- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7700678c0 msgr2=0x7fd770069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7700678c0 0x7fd770069d80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0057f0 tx=0x7fd7740011a0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 -- 172.21.15.67:0/1884239491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd78414bbf0 msgr2=0x7fd784165630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd78414bbf0 0x7fd784165630 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd778010890 tx=0x7fd778010d50 comp rx=0 tx=0).stop 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 -- 172.21.15.67:0/1884239491 shutdown_connections 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd7700678c0 0x7fd770069d80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd78414c070 0x7fd784160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd78414bbf0 0x7fd784165630 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 --2- 172.21.15.67:0/1884239491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c0039f0 0x7fd784164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 -- 172.21.15.67:0/1884239491 >> 172.21.15.67:0/1884239491 conn(0x7fd7840d0080 msgr2=0x7fd7840aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 -- 172.21.15.67:0/1884239491 shutdown_connections 2024-09-19T05:42:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.666+0000 7fd789dd7640 1 -- 172.21.15.67:0/1884239491 wait complete. 2024-09-19T05:42:45.681 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:42:45.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.802+0000 7ff484b86640 1 Processor -- start 2024-09-19T05:42:45.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.802+0000 7ff484b86640 1 -- start start 2024-09-19T05:42:45.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff48015a920 0x7ff480072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4800af730 0x7ff48006e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4800730e0 con 0x7ff48006ebb0 2024-09-19T05:42:45.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff4800733c0 con 0x7ff48015a920 2024-09-19T05:42:45.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff4800ad8c0 con 0x7ff4800af730 2024-09-19T05:42:45.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff48015a920 0x7ff480072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff48015a920 0x7ff480072840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38584/0 (socket says 172.21.15.67:38584) 2024-09-19T05:42:45.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47e59c640 1 -- 172.21.15.67:0/254553837 learned_addr learned my addr 172.21.15.67:0/254553837 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:45.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff477fff640 1 --2- 172.21.15.67:0/254553837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4800af730 0x7ff48006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47e59c640 1 -- 172.21.15.67:0/254553837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4800af730 msgr2=0x7ff48006e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:45.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47e59c640 1 --2- 172.21.15.67:0/254553837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4800af730 0x7ff48006e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47e59c640 1 -- 172.21.15.67:0/254553837 >> v1:172.21.15.97:6789/0 conn(0x7ff48006ebb0 legacy=0x7ff48015e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:45.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47e59c640 1 -- 172.21.15.67:0/254553837 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4800adba0 con 0x7ff48015a920 2024-09-19T05:42:45.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47e59c640 1 --2- 172.21.15.67:0/254553837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff48015a920 0x7ff480072840 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7ff470009870 tx=0x7ff47001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38d2d960525a450 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:45.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47dd9b640 1 -- 172.21.15.67:0/254553837 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4700b0070 con 0x7ff48015a920 2024-09-19T05:42:45.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47dd9b640 1 -- 172.21.15.67:0/254553837 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4700ab600 con 0x7ff48015a920 2024-09-19T05:42:45.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff47dd9b640 1 -- 172.21.15.67:0/254553837 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4700a4e60 con 0x7ff48015a920 2024-09-19T05:42:45.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 -- 172.21.15.67:0/254553837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff48015a920 msgr2=0x7ff480072840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 --2- 172.21.15.67:0/254553837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff48015a920 0x7ff480072840 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7ff470009870 tx=0x7ff47001c560 comp rx=0 tx=0).stop 2024-09-19T05:42:45.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 -- 172.21.15.67:0/254553837 shutdown_connections 2024-09-19T05:42:45.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 --2- 172.21.15.67:0/254553837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4800af730 0x7ff48006e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 --2- 172.21.15.67:0/254553837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff48015a920 0x7ff480072840 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 -- 172.21.15.67:0/254553837 >> 172.21.15.67:0/254553837 conn(0x7ff4800d0080 msgr2=0x7ff4800d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:45.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 -- 172.21.15.67:0/254553837 shutdown_connections 2024-09-19T05:42:45.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.806+0000 7ff484b86640 1 -- 172.21.15.67:0/254553837 wait complete. 2024-09-19T05:42:45.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 Processor -- start 2024-09-19T05:42:45.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 -- start start 2024-09-19T05:42:45.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff48006ebb0 0x7ff480149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4800af730 0x7ff4800b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff48015a920 0x7ff480141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff48015eda0 con 0x7ff4800af730 2024-09-19T05:42:45.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff48015ec20 con 0x7ff48015a920 2024-09-19T05:42:45.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff48015ef20 con 0x7ff48006ebb0 2024-09-19T05:42:45.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff477fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4800af730 0x7ff4800b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff477fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4800af730 0x7ff4800b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38586/0 (socket says 172.21.15.67:38586) 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff477fff640 1 -- 172.21.15.67:0/2575901881 learned_addr learned my addr 172.21.15.67:0/2575901881 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff47ed9d640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff48015a920 0x7ff480141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff47e59c640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff48006ebb0 0x7ff480149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff477fff640 1 -- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff48006ebb0 msgr2=0x7ff480149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff477fff640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff48006ebb0 0x7ff480149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff477fff640 1 -- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff48015a920 msgr2=0x7ff480141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff477fff640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff48015a920 0x7ff480141390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff477fff640 1 -- 172.21.15.67:0/2575901881 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff480148a10 con 0x7ff4800af730 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff47ed9d640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff48015a920 0x7ff480141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff477fff640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4800af730 0x7ff4800b2fd0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ff46800d800 tx=0x7ff46800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:45.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff476ffd640 1 -- 172.21.15.67:0/2575901881 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46800b6c0 con 0x7ff4800af730 2024-09-19T05:42:45.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff476ffd640 1 -- 172.21.15.67:0/2575901881 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff468019070 con 0x7ff4800af730 2024-09-19T05:42:45.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 -- 172.21.15.67:0/2575901881 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff480148cf0 con 0x7ff4800af730 2024-09-19T05:42:45.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff476ffd640 1 -- 172.21.15.67:0/2575901881 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46800bae0 con 0x7ff4800af730 2024-09-19T05:42:45.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 -- 172.21.15.67:0/2575901881 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4801492b0 con 0x7ff4800af730 2024-09-19T05:42:45.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.810+0000 7ff484b86640 1 -- 172.21.15.67:0/2575901881 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48006e670 con 0x7ff4800af730 2024-09-19T05:42:45.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.814+0000 7ff476ffd640 1 -- 172.21.15.67:0/2575901881 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff46800bc80 con 0x7ff4800af730 2024-09-19T05:42:45.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.814+0000 7ff476ffd640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4600678c0 0x7ff460069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:45.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.814+0000 7ff476ffd640 1 -- 172.21.15.67:0/2575901881 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7ff468086420 con 0x7ff4800af730 2024-09-19T05:42:45.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.814+0000 7ff47e59c640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4600678c0 0x7ff460069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:45.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.814+0000 7ff47e59c640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4600678c0 0x7ff460069d80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff4700ad000 tx=0x7ff4700a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:45.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:45.818+0000 7ff476ffd640 1 -- 172.21.15.67:0/2575901881 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff468056d40 con 0x7ff4800af730 2024-09-19T05:42:46.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.010+0000 7ff484b86640 1 -- 172.21.15.67:0/2575901881 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff48015a150 con 0x7ff4800af730 2024-09-19T05:42:46.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff476ffd640 1 -- 172.21.15.67:0/2575901881 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5219 (secure 0 0 0) 0x7ff468056640 con 0x7ff4800af730 2024-09-19T05:42:46.011 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:46.011 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":84,"btime":"2024-09-19T05:40:12:319167+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3139499810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3139499810},{"type":"v1","addr":"172.21.15.67:6833","nonce":3139499810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2818006351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2818006351},{"type":"v1","addr":"172.21.15.67:6835","nonce":2818006351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/762722911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":762722911},{"type":"v1","addr":"172.21.15.97:6835","nonce":762722911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-19T05:39:58.136994+0000","modified":"2024-09-19T05:40:12.222026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/396819326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":396819326},{"type":"v1","addr":"172.21.15.97:6837","nonce":396819326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6556,"qdb_cluster":[6556]},"id":7}]} 2024-09-19T05:42:46.012 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 84 2024-09-19T05:42:46.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 -- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4600678c0 msgr2=0x7ff460069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4600678c0 0x7ff460069d80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff4700ad000 tx=0x7ff4700a6000 comp rx=0 tx=0).stop 2024-09-19T05:42:46.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 -- 172.21.15.67:0/2575901881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4800af730 msgr2=0x7ff4800b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4800af730 0x7ff4800b2fd0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ff46800d800 tx=0x7ff46800dcc0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 -- 172.21.15.67:0/2575901881 shutdown_connections 2024-09-19T05:42:46.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff48015a920 0x7ff480141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4800af730 0x7ff4800b2fd0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff4600678c0 0x7ff460069d80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 --2- 172.21.15.67:0/2575901881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff48006ebb0 0x7ff480149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 -- 172.21.15.67:0/2575901881 >> 172.21.15.67:0/2575901881 conn(0x7ff4800d0080 msgr2=0x7ff4800ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 -- 172.21.15.67:0/2575901881 shutdown_connections 2024-09-19T05:42:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.014+0000 7ff484b86640 1 -- 172.21.15.67:0/2575901881 wait complete. 2024-09-19T05:42:46.030 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:42:46.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafe13db640 1 Processor -- start 2024-09-19T05:42:46.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafe13db640 1 -- start start 2024-09-19T05:42:46.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafe13db640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fafdc06f460 0x7fafdc06f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafe13db640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafdc06e3c0 con 0x7fafdc06dde0 2024-09-19T05:42:46.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafe13db640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafdc06e6a0 con 0x7fafdc15c030 2024-09-19T05:42:46.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafe13db640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fafdc06e980 con 0x7fafdc06f460 2024-09-19T05:42:46.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafdb7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fafdc06f460 0x7fafdc06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafdb7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fafdc06f460 0x7fafdc06f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33934/0 (socket says 172.21.15.67:33934) 2024-09-19T05:42:46.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafdb7fe640 1 -- 172.21.15.67:0/537736305 learned_addr learned my addr 172.21.15.67:0/537736305 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:46.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafda7fc640 1 --1- 172.21.15.67:0/537736305 >> v1:172.21.15.67:6789/0 conn(0x7fafdc06dde0 0x7fafdc0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59108/0 (socket says 172.21.15.67:59108) 2024-09-19T05:42:46.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafdb7fe640 1 -- 172.21.15.67:0/537736305 >> v1:172.21.15.97:6789/0 conn(0x7fafdc15c030 legacy=0x7fafdc15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafdb7fe640 1 -- 172.21.15.67:0/537736305 >> v1:172.21.15.67:6789/0 conn(0x7fafdc06dde0 legacy=0x7fafdc0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafdb7fe640 1 -- 172.21.15.67:0/537736305 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafdc06ec60 con 0x7fafdc06f460 2024-09-19T05:42:46.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.154+0000 7fafdb7fe640 1 --2- 172.21.15.67:0/537736305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc06f460 0x7fafdc06f870 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009e50 tx=0x7fafd401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2a89a15cbac3f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:46.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafd9ffb640 1 -- 172.21.15.67:0/537736305 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd40a5700 con 0x7fafdc06f460 2024-09-19T05:42:46.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafd9ffb640 1 -- 172.21.15.67:0/537736305 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd40a58a0 con 0x7fafdc06f460 2024-09-19T05:42:46.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafd9ffb640 1 -- 172.21.15.67:0/537736305 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd40a5c70 con 0x7fafdc06f460 2024-09-19T05:42:46.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- 172.21.15.67:0/537736305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc06f460 msgr2=0x7fafdc06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 --2- 172.21.15.67:0/537736305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc06f460 0x7fafdc06f870 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009e50 tx=0x7fafd401ca30 comp rx=0 tx=0).stop 2024-09-19T05:42:46.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- 172.21.15.67:0/537736305 shutdown_connections 2024-09-19T05:42:46.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 --2- 172.21.15.67:0/537736305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc06f460 0x7fafdc06f870 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- 172.21.15.67:0/537736305 >> 172.21.15.67:0/537736305 conn(0x7fafdc0d0080 msgr2=0x7fafdc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:46.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- 172.21.15.67:0/537736305 shutdown_connections 2024-09-19T05:42:46.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- 172.21.15.67:0/537736305 wait complete. 2024-09-19T05:42:46.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 Processor -- start 2024-09-19T05:42:46.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- start start 2024-09-19T05:42:46.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06dde0 0x7fafdc147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc06f460 0x7fafdc15d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc15c030 0x7fafdc1f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc16a270 con 0x7fafdc15c030 2024-09-19T05:42:46.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc16a0f0 con 0x7fafdc06f460 2024-09-19T05:42:46.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fafdc16a3f0 con 0x7fafdc06dde0 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafdb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc15c030 0x7fafdc1f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafdb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc15c030 0x7fafdc1f8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33948/0 (socket says 172.21.15.67:33948) 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafdb7fe640 1 -- 172.21.15.67:0/467002644 learned_addr learned my addr 172.21.15.67:0/467002644 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafda7fc640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc06f460 0x7fafdc15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafdaffd640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06dde0 0x7fafdc147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafdb7fe640 1 -- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06dde0 msgr2=0x7fafdc147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafdb7fe640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06dde0 0x7fafdc147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafdb7fe640 1 -- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc06f460 msgr2=0x7fafdc15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafdb7fe640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc06f460 0x7fafdc15d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafdb7fe640 1 -- 172.21.15.67:0/467002644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafdc15d9a0 con 0x7fafdc15c030 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafdb7fe640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc15c030 0x7fafdc1f8e20 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fafd40af040 tx=0x7fafd40197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafc37fe640 1 -- 172.21.15.67:0/467002644 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd40b8670 con 0x7fafdc15c030 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafc37fe640 1 -- 172.21.15.67:0/467002644 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd40be070 con 0x7fafdc15c030 2024-09-19T05:42:46.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- 172.21.15.67:0/467002644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafdc15dc80 con 0x7fafdc15c030 2024-09-19T05:42:46.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafc37fe640 1 -- 172.21.15.67:0/467002644 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd40b8a70 con 0x7fafdc15c030 2024-09-19T05:42:46.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.158+0000 7fafe13db640 1 -- 172.21.15.67:0/467002644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafdc14aef0 con 0x7fafdc15c030 2024-09-19T05:42:46.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.162+0000 7fafe13db640 1 -- 172.21.15.67:0/467002644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafdc15f8b0 con 0x7fafdc15c030 2024-09-19T05:42:46.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.162+0000 7fafc37fe640 1 -- 172.21.15.67:0/467002644 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fafd40b8c10 con 0x7fafdc15c030 2024-09-19T05:42:46.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.162+0000 7fafc37fe640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafc80678c0 0x7fafc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.162+0000 7fafc37fe640 1 -- 172.21.15.67:0/467002644 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7fafd4120ff0 con 0x7fafdc15c030 2024-09-19T05:42:46.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.162+0000 7fafdaffd640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafc80678c0 0x7fafc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.162+0000 7fafdaffd640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafc80678c0 0x7fafc8069d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0015b0 tx=0x7fafcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:46.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.166+0000 7fafc37fe640 1 -- 172.21.15.67:0/467002644 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fafd4016620 con 0x7fafdc15c030 2024-09-19T05:42:46.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.326+0000 7fafe13db640 1 -- 172.21.15.67:0/467002644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafdc06f870 con 0x7fafdc15c030 2024-09-19T05:42:46.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.326+0000 7fafc37fe640 1 -- 172.21.15.67:0/467002644 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+17024 (secure 0 0 0) 0x7fafd40f1970 con 0x7fafdc15c030 2024-09-19T05:42:46.326 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:46.326 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":120,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:42:20.150268+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:39:55.832671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-19T05:39:57.135928+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":119,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:42:46.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 -- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafc80678c0 msgr2=0x7fafc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafc80678c0 0x7fafc8069d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0015b0 tx=0x7fafcc009040 comp rx=0 tx=0).stop 2024-09-19T05:42:46.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 -- 172.21.15.67:0/467002644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc15c030 msgr2=0x7fafdc1f8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc15c030 0x7fafdc1f8e20 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fafd40af040 tx=0x7fafd40197d0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 -- 172.21.15.67:0/467002644 shutdown_connections 2024-09-19T05:42:46.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafdc15c030 0x7fafdc1f8e20 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc06f460 0x7fafdc15d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafc80678c0 0x7fafc8069d80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 --2- 172.21.15.67:0/467002644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06dde0 0x7fafdc147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 -- 172.21.15.67:0/467002644 >> 172.21.15.67:0/467002644 conn(0x7fafdc0d0080 msgr2=0x7fafdc0b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:46.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 -- 172.21.15.67:0/467002644 shutdown_connections 2024-09-19T05:42:46.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.330+0000 7fafe13db640 1 -- 172.21.15.67:0/467002644 wait complete. 2024-09-19T05:42:46.344 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:42:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.466+0000 7f0bbca99640 1 Processor -- start 2024-09-19T05:42:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.466+0000 7f0bbca99640 1 -- start start 2024-09-19T05:42:46.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0bb815cd50 0x7f0bb815d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0bb80b6cf0 0x7f0bb806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb80ae3d0 con 0x7f0bb806c200 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb815da20 con 0x7f0bb815cd50 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb80b25c0 con 0x7f0bb80b6cf0 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0bb815cd50 0x7f0bb815d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0bb815cd50 0x7f0bb815d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33964/0 (socket says 172.21.15.67:33964) 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb659c640 1 -- 172.21.15.67:0/3039585522 learned_addr learned my addr 172.21.15.67:0/3039585522 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb659c640 1 -- 172.21.15.67:0/3039585522 >> v2:172.21.15.97:3300/0 conn(0x7f0bb80b6cf0 msgr2=0x7f0bb806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb659c640 1 --2- 172.21.15.67:0/3039585522 >> v2:172.21.15.97:3300/0 conn(0x7f0bb80b6cf0 0x7f0bb806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb659c640 1 -- 172.21.15.67:0/3039585522 >> v1:172.21.15.97:6789/0 conn(0x7f0bb806c200 legacy=0x7f0bb815fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb659c640 1 -- 172.21.15.67:0/3039585522 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb80b28a0 con 0x7f0bb815cd50 2024-09-19T05:42:46.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb659c640 1 --2- 172.21.15.67:0/3039585522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 0x7f0bb815d130 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8073fd0 tx=0x7f0ba801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b3d759193223f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:46.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb5d9b640 1 -- 172.21.15.67:0/3039585522 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80b0070 con 0x7f0bb815cd50 2024-09-19T05:42:46.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb5d9b640 1 -- 172.21.15.67:0/3039585522 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba80ab600 con 0x7f0bb815cd50 2024-09-19T05:42:46.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bb5d9b640 1 -- 172.21.15.67:0/3039585522 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80ab9d0 con 0x7f0bb815cd50 2024-09-19T05:42:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 -- 172.21.15.67:0/3039585522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 msgr2=0x7f0bb815d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 --2- 172.21.15.67:0/3039585522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 0x7f0bb815d130 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8073fd0 tx=0x7f0ba801c300 comp rx=0 tx=0).stop 2024-09-19T05:42:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 -- 172.21.15.67:0/3039585522 shutdown_connections 2024-09-19T05:42:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 --2- 172.21.15.67:0/3039585522 >> v2:172.21.15.97:3300/0 conn(0x7f0bb80b6cf0 0x7f0bb806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 --2- 172.21.15.67:0/3039585522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 0x7f0bb815d130 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 -- 172.21.15.67:0/3039585522 >> 172.21.15.67:0/3039585522 conn(0x7f0bb809aa30 msgr2=0x7f0bb80b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 -- 172.21.15.67:0/3039585522 shutdown_connections 2024-09-19T05:42:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.470+0000 7f0bbca99640 1 -- 172.21.15.67:0/3039585522 wait complete. 2024-09-19T05:42:46.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 Processor -- start 2024-09-19T05:42:46.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 -- start start 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bb806c200 0x7f0bb8156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bb80b6cf0 0x7f0bb80d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 0x7f0bb814cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb81692b0 con 0x7f0bb815cd50 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb8169130 con 0x7f0bb80b6cf0 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb8169430 con 0x7f0bb806c200 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bb6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 0x7f0bb814cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bb6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 0x7f0bb814cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33976/0 (socket says 172.21.15.67:33976) 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bb6d9d640 1 -- 172.21.15.67:0/1433975702 learned_addr learned my addr 172.21.15.67:0/1433975702 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0baffff640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bb80b6cf0 0x7f0bb80d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bb659c640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bb806c200 0x7f0bb8156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bb6d9d640 1 -- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bb806c200 msgr2=0x7f0bb8156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bb6d9d640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bb806c200 0x7f0bb8156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bb6d9d640 1 -- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bb80b6cf0 msgr2=0x7f0bb80d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bb6d9d640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bb80b6cf0 0x7f0bb80d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bb6d9d640 1 -- 172.21.15.67:0/1433975702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb809cd00 con 0x7f0bb815cd50 2024-09-19T05:42:46.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bb6d9d640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 0x7f0bb814cca0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000c780 tx=0x7f0bb000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:46.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0baeffd640 1 -- 172.21.15.67:0/1433975702 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0017070 con 0x7f0bb815cd50 2024-09-19T05:42:46.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0baeffd640 1 -- 172.21.15.67:0/1433975702 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb0003db0 con 0x7f0bb815cd50 2024-09-19T05:42:46.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 -- 172.21.15.67:0/1433975702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb80d0da0 con 0x7f0bb815cd50 2024-09-19T05:42:46.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0baeffd640 1 -- 172.21.15.67:0/1433975702 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00052b0 con 0x7f0bb815cd50 2024-09-19T05:42:46.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 -- 172.21.15.67:0/1433975702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb80d1360 con 0x7f0bb815cd50 2024-09-19T05:42:46.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0bbca99640 1 -- 172.21.15.67:0/1433975702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb806bcc0 con 0x7f0bb815cd50 2024-09-19T05:42:46.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0baeffd640 1 -- 172.21.15.67:0/1433975702 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0bb001a070 con 0x7f0bb815cd50 2024-09-19T05:42:46.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.474+0000 7f0baeffd640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b980678c0 0x7f0b98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.478+0000 7f0baeffd640 1 -- 172.21.15.67:0/1433975702 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6158+0+0 (secure 0 0 0) 0x7f0bb00854d0 con 0x7f0bb815cd50 2024-09-19T05:42:46.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.478+0000 7f0bb659c640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b980678c0 0x7f0b98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.478+0000 7f0bb659c640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b980678c0 0x7f0b98069d80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80ad000 tx=0x7f0ba8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:46.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.482+0000 7f0baeffd640 1 -- 172.21.15.67:0/1433975702 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0bb0055e50 con 0x7f0bb815cd50 2024-09-19T05:42:46.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.670+0000 7f0bbca99640 1 -- 172.21.15.67:0/1433975702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0bb806fd20 con 0x7f0bb815cd50 2024-09-19T05:42:46.671 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:42:46.674+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:42:46.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0baeffd640 1 -- 172.21.15.67:0/1433975702 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) ==== 161+0+0 (secure 0 0 0) 0x7f0bb0055750 con 0x7f0bb815cd50 2024-09-19T05:42:46.675 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:42:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 -- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b980678c0 msgr2=0x7f0b98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b980678c0 0x7f0b98069d80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80ad000 tx=0x7f0ba8008040 comp rx=0 tx=0).stop 2024-09-19T05:42:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 -- 172.21.15.67:0/1433975702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 msgr2=0x7f0bb814cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 0x7f0bb814cca0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000c780 tx=0x7f0bb000cc40 comp rx=0 tx=0).stop 2024-09-19T05:42:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 -- 172.21.15.67:0/1433975702 shutdown_connections 2024-09-19T05:42:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bb815cd50 0x7f0bb814cca0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bb80b6cf0 0x7f0bb80d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0b980678c0 0x7f0b98069d80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 --2- 172.21.15.67:0/1433975702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bb806c200 0x7f0bb8156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 -- 172.21.15.67:0/1433975702 >> 172.21.15.67:0/1433975702 conn(0x7f0bb809aa30 msgr2=0x7f0bb815c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 -- 172.21.15.67:0/1433975702 shutdown_connections 2024-09-19T05:42:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.678+0000 7f0bbca99640 1 -- 172.21.15.67:0/1433975702 wait complete. 2024-09-19T05:42:46.695 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:42:46.758 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:42:46.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.806+0000 7fb0b67f9640 1 Processor -- start 2024-09-19T05:42:46.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b67f9640 1 -- start start 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b67f9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b3940 0x7fb0b0072970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b67f9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0b00ad9e0 0x7fb0b006f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b67f9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b006eaa0 con 0x7fb0b0072eb0 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b67f9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b006e850 con 0x7fb0b00ad9e0 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b67f9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b006f3d0 con 0x7fb0b00b3940 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b4d96640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0b00ad9e0 0x7fb0b006f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0a7fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb0b0072eb0 0x7fb0b00ad2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59118/0 (socket says 172.21.15.67:59118) 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0a7fff640 1 -- 172.21.15.67:0/725143365 learned_addr learned my addr 172.21.15.67:0/725143365 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b4d96640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0b00ad9e0 0x7fb0b006f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33980/0 (socket says 172.21.15.67:33980) 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0affff640 1 --2- 172.21.15.67:0/725143365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b3940 0x7fb0b0072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b4d96640 1 -- 172.21.15.67:0/725143365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b3940 msgr2=0x7fb0b0072970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:46.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b4d96640 1 --2- 172.21.15.67:0/725143365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b3940 0x7fb0b0072970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b4d96640 1 -- 172.21.15.67:0/725143365 >> v1:172.21.15.67:6789/0 conn(0x7fb0b0072eb0 legacy=0x7fb0b00ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b4d96640 1 -- 172.21.15.67:0/725143365 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b006ed80 con 0x7fb0b00ad9e0 2024-09-19T05:42:46.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0af7fe640 1 -- 172.21.15.67:0/725143365 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2832632612 0 0) 0x7fb0b006eaa0 con 0x7fb0b0072eb0 2024-09-19T05:42:46.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0b4d96640 1 --2- 172.21.15.67:0/725143365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00ad9e0 0x7fb0b006f860 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800aea0 tx=0x7fb0a801da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cd84eb8c705c6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:46.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0af7fe640 1 -- 172.21.15.67:0/725143365 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80a66d0 con 0x7fb0b00ad9e0 2024-09-19T05:42:46.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0af7fe640 1 -- 172.21.15.67:0/725143365 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a80a6870 con 0x7fb0b00ad9e0 2024-09-19T05:42:46.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.810+0000 7fb0af7fe640 1 -- 172.21.15.67:0/725143365 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80a6c40 con 0x7fb0b00ad9e0 2024-09-19T05:42:46.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- 172.21.15.67:0/725143365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00ad9e0 msgr2=0x7fb0b006f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 --2- 172.21.15.67:0/725143365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00ad9e0 0x7fb0b006f860 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800aea0 tx=0x7fb0a801da70 comp rx=0 tx=0).stop 2024-09-19T05:42:46.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- 172.21.15.67:0/725143365 shutdown_connections 2024-09-19T05:42:46.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 --2- 172.21.15.67:0/725143365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00ad9e0 0x7fb0b006f860 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 --2- 172.21.15.67:0/725143365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00b3940 0x7fb0b0072970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- 172.21.15.67:0/725143365 >> 172.21.15.67:0/725143365 conn(0x7fb0b00b1e50 msgr2=0x7fb0b00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:46.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- 172.21.15.67:0/725143365 shutdown_connections 2024-09-19T05:42:46.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- 172.21.15.67:0/725143365 wait complete. 2024-09-19T05:42:46.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 Processor -- start 2024-09-19T05:42:46.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- start start 2024-09-19T05:42:46.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b0072eb0 0x7fb0b014e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b3940 0x7fb0b014f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00cb9d0 0x7fb0b0154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b00b40b0 con 0x7fb0b00b3940 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b00b3f30 con 0x7fb0b0072eb0 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b00b4230 con 0x7fb0b00cb9d0 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0a7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b3940 0x7fb0b014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0a7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b3940 0x7fb0b014f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33984/0 (socket says 172.21.15.67:33984) 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0a7fff640 1 -- 172.21.15.67:0/938890458 learned_addr learned my addr 172.21.15.67:0/938890458 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0affff640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b0072eb0 0x7fb0b014e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b4d96640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00cb9d0 0x7fb0b0154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0a7fff640 1 -- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00cb9d0 msgr2=0x7fb0b0154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0a7fff640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00cb9d0 0x7fb0b0154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0a7fff640 1 -- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b0072eb0 msgr2=0x7fb0b014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0a7fff640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b0072eb0 0x7fb0b014e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0a7fff640 1 -- 172.21.15.67:0/938890458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b00cbe60 con 0x7fb0b00b3940 2024-09-19T05:42:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b4d96640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00cb9d0 0x7fb0b0154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:42:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0a7fff640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b3940 0x7fb0b014f960 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fb09800c480 tx=0x7fb09800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0ad7fa640 1 -- 172.21.15.67:0/938890458 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098018070 con 0x7fb0b00b3940 2024-09-19T05:42:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0ad7fa640 1 -- 172.21.15.67:0/938890458 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb098007500 con 0x7fb0b00b3940 2024-09-19T05:42:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- 172.21.15.67:0/938890458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b00cc140 con 0x7fb0b00b3940 2024-09-19T05:42:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0ad7fa640 1 -- 172.21.15.67:0/938890458 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098004a30 con 0x7fb0b00b3940 2024-09-19T05:42:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.814+0000 7fb0b67f9640 1 -- 172.21.15.67:0/938890458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b0151fb0 con 0x7fb0b00b3940 2024-09-19T05:42:46.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.818+0000 7fb0b67f9640 1 -- 172.21.15.67:0/938890458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b00b45f0 con 0x7fb0b00b3940 2024-09-19T05:42:46.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.818+0000 7fb0ad7fa640 1 -- 172.21.15.67:0/938890458 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb09801b070 con 0x7fb0b00b3940 2024-09-19T05:42:46.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.818+0000 7fb0ad7fa640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0900678c0 0x7fb090069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:46.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.818+0000 7fb0ad7fa640 1 -- 172.21.15.67:0/938890458 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6216+0+0 (secure 0 0 0) 0x7fb0980850c0 con 0x7fb0b00b3940 2024-09-19T05:42:46.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.818+0000 7fb0affff640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0900678c0 0x7fb090069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:46.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.818+0000 7fb0affff640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0900678c0 0x7fb090069d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009b60 tx=0x7fb0a0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:46.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:46.822+0000 7fb0ad7fa640 1 -- 172.21.15.67:0/938890458 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb098055440 con 0x7fb0b00b3940 2024-09-19T05:42:47.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.014+0000 7fb0b67f9640 1 -- 172.21.15.67:0/938890458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb0b0074830 con 0x7fb0b00b3940 2024-09-19T05:42:47.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.686+0000 7fb0ad7fa640 1 -- 172.21.15.67:0/938890458 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v86) ==== 104+0+0 (secure 0 0 0) 0x7fb098059740 con 0x7fb0b00b3940 2024-09-19T05:42:47.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 -- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0900678c0 msgr2=0x7fb090069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:47.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0900678c0 0x7fb090069d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009b60 tx=0x7fb0a0009190 comp rx=0 tx=0).stop 2024-09-19T05:42:47.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 -- 172.21.15.67:0/938890458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b3940 msgr2=0x7fb0b014f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:47.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b3940 0x7fb0b014f960 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fb09800c480 tx=0x7fb09800c940 comp rx=0 tx=0).stop 2024-09-19T05:42:47.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 -- 172.21.15.67:0/938890458 shutdown_connections 2024-09-19T05:42:47.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0900678c0 0x7fb090069d80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:47.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0b00cb9d0 0x7fb0b0154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:47.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b00b3940 0x7fb0b014f960 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:47.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 --2- 172.21.15.67:0/938890458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0b0072eb0 0x7fb0b014e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:47.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 -- 172.21.15.67:0/938890458 >> 172.21.15.67:0/938890458 conn(0x7fb0b00b1e50 msgr2=0x7fb0b00b4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:47.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 -- 172.21.15.67:0/938890458 shutdown_connections 2024-09-19T05:42:47.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.690+0000 7fb0b67f9640 1 -- 172.21.15.67:0/938890458 wait complete. 2024-09-19T05:42:47.713 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:42:47.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.846+0000 7f47ee72d640 1 Processor -- start 2024-09-19T05:42:47.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.846+0000 7f47ee72d640 1 -- start start 2024-09-19T05:42:47.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.846+0000 7f47ee72d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47e80cf5e0 0x7f47e80d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:47.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.846+0000 7f47ee72d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f47e815d8d0 0x7f47e815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:47.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.846+0000 7f47ee72d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e815d030 con 0x7f47e815c850 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.846+0000 7f47ee72d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f47e806de90 con 0x7f47e80cf5e0 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.846+0000 7f47ee72d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f47e806e170 con 0x7f47e815d8d0 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.846+0000 7f47e7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47e80cf5e0 0x7f47e80d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.846+0000 7f47e7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47e80cf5e0 0x7f47e80d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34000/0 (socket says 172.21.15.67:34000) 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.846+0000 7f47e7fff640 1 -- 172.21.15.67:0/152828524 learned_addr learned my addr 172.21.15.67:0/152828524 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47eccca640 1 --2- 172.21.15.67:0/152828524 >> v2:172.21.15.97:3300/0 conn(0x7f47e815d8d0 0x7f47e815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47e7fff640 1 -- 172.21.15.67:0/152828524 >> v2:172.21.15.97:3300/0 conn(0x7f47e815d8d0 msgr2=0x7f47e815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47e7fff640 1 --2- 172.21.15.67:0/152828524 >> v2:172.21.15.97:3300/0 conn(0x7f47e815d8d0 0x7f47e815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47e7fff640 1 -- 172.21.15.67:0/152828524 >> v1:172.21.15.67:6789/0 conn(0x7f47e815c850 legacy=0x7f47e806e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47e7fff640 1 -- 172.21.15.67:0/152828524 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e815d310 con 0x7f47e80cf5e0 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47e6ffd640 1 -- 172.21.15.67:0/152828524 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788052893 0 0) 0x7f47e815d030 con 0x7f47e815c850 2024-09-19T05:42:47.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47eccca640 1 --2- 172.21.15.67:0/152828524 >> v2:172.21.15.97:3300/0 conn(0x7f47e815d8d0 0x7f47e815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:47.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47e7fff640 1 --2- 172.21.15.67:0/152828524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e80cf5e0 0x7f47e80d0aa0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f47e8156e10 tx=0x7f47d801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910272552b38ebdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:47.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47e6ffd640 1 -- 172.21.15.67:0/152828524 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d80ab430 con 0x7f47e80cf5e0 2024-09-19T05:42:47.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47e6ffd640 1 -- 172.21.15.67:0/152828524 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d80b0070 con 0x7f47e80cf5e0 2024-09-19T05:42:47.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47e6ffd640 1 -- 172.21.15.67:0/152828524 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d80ab7f0 con 0x7f47e80cf5e0 2024-09-19T05:42:47.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47ee72d640 1 -- 172.21.15.67:0/152828524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e80cf5e0 msgr2=0x7f47e80d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:47.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47ee72d640 1 --2- 172.21.15.67:0/152828524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e80cf5e0 0x7f47e80d0aa0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f47e8156e10 tx=0x7f47d801c520 comp rx=0 tx=0).stop 2024-09-19T05:42:47.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47ee72d640 1 -- 172.21.15.67:0/152828524 shutdown_connections 2024-09-19T05:42:47.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47ee72d640 1 --2- 172.21.15.67:0/152828524 >> v2:172.21.15.97:3300/0 conn(0x7f47e815d8d0 0x7f47e815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:47.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47ee72d640 1 --2- 172.21.15.67:0/152828524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e80cf5e0 0x7f47e80d0aa0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:47.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47ee72d640 1 -- 172.21.15.67:0/152828524 >> 172.21.15.67:0/152828524 conn(0x7f47e806c0c0 msgr2=0x7f47e806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:47.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47ee72d640 1 -- 172.21.15.67:0/152828524 shutdown_connections 2024-09-19T05:42:47.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.850+0000 7f47ee72d640 1 -- 172.21.15.67:0/152828524 wait complete. 2024-09-19T05:42:47.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 Processor -- start 2024-09-19T05:42:47.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 -- start start 2024-09-19T05:42:47.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e80cf5e0 0x7f47e814e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:47.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47e815c850 0x7f47e8152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e815d8d0 0x7f47e814c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47e806ee90 con 0x7f47e815d8d0 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f47e806ed10 con 0x7f47e80cf5e0 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f47e8168fb0 con 0x7f47e815c850 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47eccca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e815d8d0 0x7f47e814c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47eccca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e815d8d0 0x7f47e814c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34014/0 (socket says 172.21.15.67:34014) 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47eccca640 1 -- 172.21.15.67:0/3449719297 learned_addr learned my addr 172.21.15.67:0/3449719297 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47e7fff640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e80cf5e0 0x7f47e814e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47e77fe640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47e815c850 0x7f47e8152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47eccca640 1 -- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47e815c850 msgr2=0x7f47e8152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47eccca640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47e815c850 0x7f47e8152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47eccca640 1 -- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e80cf5e0 msgr2=0x7f47e814e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:47.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47eccca640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e80cf5e0 0x7f47e814e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:47.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47eccca640 1 -- 172.21.15.67:0/3449719297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e815f1e0 con 0x7f47e815d8d0 2024-09-19T05:42:47.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47eccca640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e815d8d0 0x7f47e814c510 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f47e000c820 tx=0x7f47e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:47.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47e4ff9640 1 -- 172.21.15.67:0/3449719297 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0015020 con 0x7f47e815d8d0 2024-09-19T05:42:47.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47e4ff9640 1 -- 172.21.15.67:0/3449719297 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e0004240 con 0x7f47e815d8d0 2024-09-19T05:42:47.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47e4ff9640 1 -- 172.21.15.67:0/3449719297 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0003620 con 0x7f47e815d8d0 2024-09-19T05:42:47.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 -- 172.21.15.67:0/3449719297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e815f4c0 con 0x7f47e815d8d0 2024-09-19T05:42:47.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 -- 172.21.15.67:0/3449719297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e815fa80 con 0x7f47e815d8d0 2024-09-19T05:42:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47ee72d640 1 -- 172.21.15.67:0/3449719297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e80d0aa0 con 0x7f47e815d8d0 2024-09-19T05:42:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.854+0000 7f47e4ff9640 1 -- 172.21.15.67:0/3449719297 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47e0018020 con 0x7f47e815d8d0 2024-09-19T05:42:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.858+0000 7f47e4ff9640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47c80678c0 0x7f47c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.858+0000 7f47e4ff9640 1 -- 172.21.15.67:0/3449719297 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6216+0+0 (secure 0 0 0) 0x7f47e0085f70 con 0x7f47e815d8d0 2024-09-19T05:42:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.858+0000 7f47e7fff640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47c80678c0 0x7f47c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.858+0000 7f47e7fff640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47c80678c0 0x7f47c8069d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f47d80af000 tx=0x7f47d80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:47.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:47.862+0000 7f47e4ff9640 1 -- 172.21.15.67:0/3449719297 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f47e001f020 con 0x7f47e815d8d0 2024-09-19T05:42:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.018+0000 7f47ee72d640 1 -- 172.21.15.67:0/3449719297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f47e815fcc0 con 0x7f47e815d8d0 2024-09-19T05:42:48.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.690+0000 7f47e4ff9640 1 -- 172.21.15.67:0/3449719297 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v122) ==== 181+0+0 (secure 0 0 0) 0x7f47e00568b0 con 0x7f47e815d8d0 2024-09-19T05:42:48.688 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:42:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 -- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47c80678c0 msgr2=0x7f47c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47c80678c0 0x7f47c8069d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f47d80af000 tx=0x7f47d80a7000 comp rx=0 tx=0).stop 2024-09-19T05:42:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 -- 172.21.15.67:0/3449719297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e815d8d0 msgr2=0x7f47e814c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e815d8d0 0x7f47e814c510 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f47e000c820 tx=0x7f47e000cce0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 -- 172.21.15.67:0/3449719297 shutdown_connections 2024-09-19T05:42:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47e815d8d0 0x7f47e814c510 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47c80678c0 0x7f47c8069d80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47e815c850 0x7f47e8152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 --2- 172.21.15.67:0/3449719297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e80cf5e0 0x7f47e814e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 -- 172.21.15.67:0/3449719297 >> 172.21.15.67:0/3449719297 conn(0x7f47e806c0c0 msgr2=0x7f47e806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 -- 172.21.15.67:0/3449719297 shutdown_connections 2024-09-19T05:42:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.694+0000 7f47ee72d640 1 -- 172.21.15.67:0/3449719297 wait complete. 2024-09-19T05:42:48.721 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:42:48.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.858+0000 7f1634b0d640 1 Processor -- start 2024-09-19T05:42:48.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.858+0000 7f1634b0d640 1 -- start start 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.858+0000 7f1634b0d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f16300cf5e0 0x7f16300d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.858+0000 7f1634b0d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f163015c850 0x7f163006e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.858+0000 7f1634b0d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f163015d030 con 0x7f163006eb40 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.858+0000 7f1634b0d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f163006de90 con 0x7f163015c850 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.858+0000 7f1634b0d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f163006e170 con 0x7f16300cf5e0 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162dd9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f163015c850 0x7f163006e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162dd9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f163015c850 0x7f163006e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34026/0 (socket says 172.21.15.67:34026) 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162dd9b640 1 -- 172.21.15.67:0/815181932 learned_addr learned my addr 172.21.15.67:0/815181932 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162e59c640 1 --2- 172.21.15.67:0/815181932 >> v2:172.21.15.97:3300/0 conn(0x7f16300cf5e0 0x7f16300d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162dd9b640 1 -- 172.21.15.67:0/815181932 >> v2:172.21.15.97:3300/0 conn(0x7f16300cf5e0 msgr2=0x7f16300d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162dd9b640 1 --2- 172.21.15.67:0/815181932 >> v2:172.21.15.97:3300/0 conn(0x7f16300cf5e0 0x7f16300d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162dd9b640 1 -- 172.21.15.67:0/815181932 >> v1:172.21.15.97:6789/0 conn(0x7f163006eb40 legacy=0x7f163015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162dd9b640 1 -- 172.21.15.67:0/815181932 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163015d310 con 0x7f163015c850 2024-09-19T05:42:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162e59c640 1 --2- 172.21.15.67:0/815181932 >> v2:172.21.15.97:3300/0 conn(0x7f16300cf5e0 0x7f16300d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162dd9b640 1 --2- 172.21.15.67:0/815181932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f163015c850 0x7f163006e600 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f16300b5450 tx=0x7f162401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4e67c7cbc7123b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:48.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162d59a640 1 -- 172.21.15.67:0/815181932 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16240aa430 con 0x7f163015c850 2024-09-19T05:42:48.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162d59a640 1 -- 172.21.15.67:0/815181932 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16240af070 con 0x7f163015c850 2024-09-19T05:42:48.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f162d59a640 1 -- 172.21.15.67:0/815181932 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16240aa7f0 con 0x7f163015c850 2024-09-19T05:42:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f1634b0d640 1 -- 172.21.15.67:0/815181932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f163015c850 msgr2=0x7f163006e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f1634b0d640 1 --2- 172.21.15.67:0/815181932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f163015c850 0x7f163006e600 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f16300b5450 tx=0x7f162401c4b0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f1634b0d640 1 -- 172.21.15.67:0/815181932 shutdown_connections 2024-09-19T05:42:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f1634b0d640 1 --2- 172.21.15.67:0/815181932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f163015c850 0x7f163006e600 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f1634b0d640 1 --2- 172.21.15.67:0/815181932 >> v2:172.21.15.97:3300/0 conn(0x7f16300cf5e0 0x7f16300d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f1634b0d640 1 -- 172.21.15.67:0/815181932 >> 172.21.15.67:0/815181932 conn(0x7f163006c0c0 msgr2=0x7f163006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f1634b0d640 1 -- 172.21.15.67:0/815181932 shutdown_connections 2024-09-19T05:42:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.862+0000 7f1634b0d640 1 -- 172.21.15.67:0/815181932 wait complete. 2024-09-19T05:42:48.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f1634b0d640 1 Processor -- start 2024-09-19T05:42:48.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f1634b0d640 1 -- start start 2024-09-19T05:42:48.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f1634b0d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f163006eb40 0x7f163009db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:48.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f1634b0d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16300cf5e0 0x7f16301f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:48.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f1634b0d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f163015c850 0x7f163009bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:48.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f1634b0d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1630169130 con 0x7f16300cf5e0 2024-09-19T05:42:48.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f1634b0d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1630168fb0 con 0x7f163015c850 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f1634b0d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f16301692b0 con 0x7f163006eb40 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16300cf5e0 0x7f16301f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16300cf5e0 0x7f16301f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34028/0 (socket says 172.21.15.67:34028) 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162dd9b640 1 -- 172.21.15.67:0/1713595660 learned_addr learned my addr 172.21.15.67:0/1713595660 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162e59c640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f163006eb40 0x7f163009db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162ed9d640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f163015c850 0x7f163009bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162dd9b640 1 -- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f163006eb40 msgr2=0x7f163009db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162dd9b640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f163006eb40 0x7f163009db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162dd9b640 1 -- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f163015c850 msgr2=0x7f163009bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162dd9b640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f163015c850 0x7f163009bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:48.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162dd9b640 1 -- 172.21.15.67:0/1713595660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1630150db0 con 0x7f16300cf5e0 2024-09-19T05:42:48.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162ed9d640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f163015c850 0x7f163009bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:48.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f162dd9b640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16300cf5e0 0x7f16301f5530 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f16240ac040 tx=0x7f162401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:48.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f161effd640 1 -- 172.21.15.67:0/1713595660 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16240b3800 con 0x7f16300cf5e0 2024-09-19T05:42:48.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f161effd640 1 -- 172.21.15.67:0/1713595660 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16240b39c0 con 0x7f16300cf5e0 2024-09-19T05:42:48.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f1634b0d640 1 -- 172.21.15.67:0/1713595660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f163009b250 con 0x7f16300cf5e0 2024-09-19T05:42:48.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f161effd640 1 -- 172.21.15.67:0/1713595660 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16240b3db0 con 0x7f16300cf5e0 2024-09-19T05:42:48.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.866+0000 7f1634b0d640 1 -- 172.21.15.67:0/1713595660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f163009b810 con 0x7f16300cf5e0 2024-09-19T05:42:48.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.870+0000 7f1634b0d640 1 -- 172.21.15.67:0/1713595660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16300d0aa0 con 0x7f16300cf5e0 2024-09-19T05:42:48.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.870+0000 7f161effd640 1 -- 172.21.15.67:0/1713595660 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16240c7420 con 0x7f16300cf5e0 2024-09-19T05:42:48.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.870+0000 7f161effd640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16100678c0 0x7f1610069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:48.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.870+0000 7f161effd640 1 -- 172.21.15.67:0/1713595660 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5778+0+0 (secure 0 0 0) 0x7f16241205b0 con 0x7f16300cf5e0 2024-09-19T05:42:48.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.870+0000 7f162e59c640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16100678c0 0x7f1610069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:48.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.870+0000 7f162e59c640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16100678c0 0x7f1610069d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f162000a9a0 tx=0x7f1620008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:48.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:48.874+0000 7f161effd640 1 -- 172.21.15.67:0/1713595660 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f16240c3060 con 0x7f16300cf5e0 2024-09-19T05:42:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.038+0000 7f1634b0d640 1 -- 172.21.15.67:0/1713595660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f163006c540 con 0x7f16300cf5e0 2024-09-19T05:42:49.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.698+0000 7f161effd640 1 -- 172.21.15.67:0/1713595660 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v123) ==== 169+0+0 (secure 0 0 0) 0x7f16240160d0 con 0x7f16300cf5e0 2024-09-19T05:42:49.696 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:42:49.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 -- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16100678c0 msgr2=0x7f1610069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:49.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16100678c0 0x7f1610069d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f162000a9a0 tx=0x7f1620008040 comp rx=0 tx=0).stop 2024-09-19T05:42:49.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 -- 172.21.15.67:0/1713595660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16300cf5e0 msgr2=0x7f16301f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:49.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16300cf5e0 0x7f16301f5530 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f16240ac040 tx=0x7f162401acf0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 -- 172.21.15.67:0/1713595660 shutdown_connections 2024-09-19T05:42:49.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f163015c850 0x7f163009bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16300cf5e0 0x7f16301f5530 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f16100678c0 0x7f1610069d80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 --2- 172.21.15.67:0/1713595660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f163006eb40 0x7f163009db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 -- 172.21.15.67:0/1713595660 >> 172.21.15.67:0/1713595660 conn(0x7f163006c0c0 msgr2=0x7f1630073910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:49.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 -- 172.21.15.67:0/1713595660 shutdown_connections 2024-09-19T05:42:49.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.702+0000 7f1634b0d640 1 -- 172.21.15.67:0/1713595660 wait complete. 2024-09-19T05:42:49.727 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:42:49.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.846+0000 7f57de0e4640 1 Processor -- start 2024-09-19T05:42:49.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.846+0000 7f57de0e4640 1 -- start start 2024-09-19T05:42:49.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57de0e4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f57d815e690 0x7f57d80d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:49.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57de0e4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 0x7f57d80d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:49.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57de0e4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d80d35a0 con 0x7f57d80d13c0 2024-09-19T05:42:49.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57de0e4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f57d80d32c0 con 0x7f57d815e690 2024-09-19T05:42:49.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57de0e4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f57d806d040 con 0x7f57d80d4fb0 2024-09-19T05:42:49.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57cffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 0x7f57d80d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:49.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57d77fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f57d815e690 0x7f57d80d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:49.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57d7fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f57d80d13c0 0x7f57d80cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:56054/0 (socket says 172.21.15.67:56054) 2024-09-19T05:42:49.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57d7fff640 1 -- 172.21.15.67:0/4020984705 learned_addr learned my addr 172.21.15.67:0/4020984705 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:49.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57cffff640 1 -- 172.21.15.67:0/4020984705 >> v2:172.21.15.97:3300/0 conn(0x7f57d815e690 msgr2=0x7f57d80d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:49.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57cffff640 1 --2- 172.21.15.67:0/4020984705 >> v2:172.21.15.97:3300/0 conn(0x7f57d815e690 0x7f57d80d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57cffff640 1 -- 172.21.15.67:0/4020984705 >> v1:172.21.15.97:6789/0 conn(0x7f57d80d13c0 legacy=0x7f57d80cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:49.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57cffff640 1 -- 172.21.15.67:0/4020984705 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d806d320 con 0x7f57d80d4fb0 2024-09-19T05:42:49.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.850+0000 7f57cffff640 1 --2- 172.21.15.67:0/4020984705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 0x7f57d80d0e80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57c00097c0 tx=0x7f57c001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6a3e57f49d5bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:49.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d6ffd640 1 -- 172.21.15.67:0/4020984705 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c00b0070 con 0x7f57d80d4fb0 2024-09-19T05:42:49.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d6ffd640 1 -- 172.21.15.67:0/4020984705 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c00ab600 con 0x7f57d80d4fb0 2024-09-19T05:42:49.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d6ffd640 1 -- 172.21.15.67:0/4020984705 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c00ab9d0 con 0x7f57d80d4fb0 2024-09-19T05:42:49.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- 172.21.15.67:0/4020984705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 msgr2=0x7f57d80d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:49.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 --2- 172.21.15.67:0/4020984705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 0x7f57d80d0e80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57c00097c0 tx=0x7f57c001c4a0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- 172.21.15.67:0/4020984705 shutdown_connections 2024-09-19T05:42:49.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 --2- 172.21.15.67:0/4020984705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 0x7f57d80d0e80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 --2- 172.21.15.67:0/4020984705 >> v2:172.21.15.97:3300/0 conn(0x7f57d815e690 0x7f57d80d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- 172.21.15.67:0/4020984705 >> 172.21.15.67:0/4020984705 conn(0x7f57d80d4490 msgr2=0x7f57d80d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:49.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- 172.21.15.67:0/4020984705 shutdown_connections 2024-09-19T05:42:49.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- 172.21.15.67:0/4020984705 wait complete. 2024-09-19T05:42:49.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 Processor -- start 2024-09-19T05:42:49.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- start start 2024-09-19T05:42:49.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57d80d13c0 0x7f57d815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:49.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 0x7f57d814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:49.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57d815e690 0x7f57d814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:49.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f57d806ecb0 con 0x7f57d80d13c0 2024-09-19T05:42:49.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f57d806eb30 con 0x7f57d815e690 2024-09-19T05:42:49.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f57d816b250 con 0x7f57d80d4fb0 2024-09-19T05:42:49.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57d80d13c0 0x7f57d815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:49.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57d80d13c0 0x7f57d815a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34044/0 (socket says 172.21.15.67:34044) 2024-09-19T05:42:49.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d77fe640 1 -- 172.21.15.67:0/3259843800 learned_addr learned my addr 172.21.15.67:0/3259843800 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57cffff640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 0x7f57d814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d7fff640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57d815e690 0x7f57d814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d77fe640 1 -- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 msgr2=0x7f57d814f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d77fe640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 0x7f57d814f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d77fe640 1 -- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57d815e690 msgr2=0x7f57d814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d77fe640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57d815e690 0x7f57d814f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d77fe640 1 -- 172.21.15.67:0/3259843800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d81512b0 con 0x7f57d80d13c0 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d77fe640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57d80d13c0 0x7f57d815a6a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f57c800e930 tx=0x7f57c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d4ff9640 1 -- 172.21.15.67:0/3259843800 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8017070 con 0x7f57d80d13c0 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d4ff9640 1 -- 172.21.15.67:0/3259843800 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c800ca00 con 0x7f57d80d13c0 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57d4ff9640 1 -- 172.21.15.67:0/3259843800 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c800cdb0 con 0x7f57d80d13c0 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- 172.21.15.67:0/3259843800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d80cac70 con 0x7f57d80d13c0 2024-09-19T05:42:49.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.854+0000 7f57de0e4640 1 -- 172.21.15.67:0/3259843800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d8150d90 con 0x7f57d80d13c0 2024-09-19T05:42:49.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.858+0000 7f57de0e4640 1 -- 172.21.15.67:0/3259843800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d81508a0 con 0x7f57d80d13c0 2024-09-19T05:42:49.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.858+0000 7f57d4ff9640 1 -- 172.21.15.67:0/3259843800 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57c801a070 con 0x7f57d80d13c0 2024-09-19T05:42:49.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.858+0000 7f57d4ff9640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57b80678c0 0x7f57b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:49.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.858+0000 7f57d4ff9640 1 -- 172.21.15.67:0/3259843800 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7f57c8085ad0 con 0x7f57d80d13c0 2024-09-19T05:42:49.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.858+0000 7f57cffff640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57b80678c0 0x7f57b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:49.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.858+0000 7f57cffff640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57b80678c0 0x7f57b8069d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f57c00ad000 tx=0x7f57c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:49.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:49.862+0000 7f57d4ff9640 1 -- 172.21.15.67:0/3259843800 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f57c80568d0 con 0x7f57d80d13c0 2024-09-19T05:42:50.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.022+0000 7f57de0e4640 1 -- 172.21.15.67:0/3259843800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f57d80cae40 con 0x7f57d80d13c0 2024-09-19T05:42:50.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.026+0000 7f57d4ff9640 1 -- 172.21.15.67:0/3259843800 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7f57d80cae40 con 0x7f57d80d13c0 2024-09-19T05:42:50.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 -- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57b80678c0 msgr2=0x7f57b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57b80678c0 0x7f57b8069d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f57c00ad000 tx=0x7f57c0008040 comp rx=0 tx=0).stop 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 -- 172.21.15.67:0/3259843800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57d80d13c0 msgr2=0x7f57d815a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57d80d13c0 0x7f57d815a6a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f57c800e930 tx=0x7f57c800edf0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 -- 172.21.15.67:0/3259843800 shutdown_connections 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57d815e690 0x7f57d814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57b80678c0 0x7f57b8069d80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d80d4fb0 0x7f57d814f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 --2- 172.21.15.67:0/3259843800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57d80d13c0 0x7f57d815a6a0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 -- 172.21.15.67:0/3259843800 >> 172.21.15.67:0/3259843800 conn(0x7f57d80d4490 msgr2=0x7f57d8157a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 -- 172.21.15.67:0/3259843800 shutdown_connections 2024-09-19T05:42:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.030+0000 7f57de0e4640 1 -- 172.21.15.67:0/3259843800 wait complete. 2024-09-19T05:42:50.044 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-19T05:42:50.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb916bc1640 1 Processor -- start 2024-09-19T05:42:50.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb916bc1640 1 -- start start 2024-09-19T05:42:50.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb916bc1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb9100d1590 0x7fb9100d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb916bc1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9100d4d40 con 0x7fb910161da0 2024-09-19T05:42:50.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb916bc1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9100d5020 con 0x7fb9100b51d0 2024-09-19T05:42:50.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb916bc1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb9100d0840 con 0x7fb9100d1590 2024-09-19T05:42:50.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb91495d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb910161da0 0x7fb9100d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59130/0 (socket says 172.21.15.67:59130) 2024-09-19T05:42:50.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb91495d640 1 -- 172.21.15.67:0/3919753104 learned_addr learned my addr 172.21.15.67:0/3919753104 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:50.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1158925497 0 0) 0x7fb9100d4d40 con 0x7fb910161da0 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90ffff640 1 --2- 172.21.15.67:0/3919753104 >> v2:172.21.15.97:3300/0 conn(0x7fb9100d1590 0x7fb9100d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8f8003530 con 0x7fb910161da0 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 803254610 0 0) 0x7fb8f8003530 con 0x7fb910161da0 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 >> v2:172.21.15.97:3300/0 conn(0x7fb9100d1590 msgr2=0x7fb9100d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 --2- 172.21.15.67:0/3919753104 >> v2:172.21.15.97:3300/0 conn(0x7fb9100d1590 0x7fb9100d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 >> v1:172.21.15.97:6789/0 conn(0x7fb9100b51d0 legacy=0x7fb9100cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9100d5300 con 0x7fb910161da0 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fb904001680 con 0x7fb910161da0 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 >> v1:172.21.15.67:6789/0 conn(0x7fb910161da0 legacy=0x7fb9100d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8f80039c0 0x7fb8f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8f8004810 0x7fb8f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb8f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb9100d0840 con 0x7fb8f80051d0 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f800c120 con 0x7fb8f8004810 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f800c320 con 0x7fb8f80039c0 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb91515e640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb8f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb90ffff640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8f8004810 0x7fb8f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb91495d640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8f80039c0 0x7fb8f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb91515e640 1 -- 172.21.15.67:0/3919753104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8f80039c0 msgr2=0x7fb8f8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb91515e640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8f80039c0 0x7fb8f8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb91515e640 1 -- 172.21.15.67:0/3919753104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8f8004810 msgr2=0x7fb8f8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb91515e640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8f8004810 0x7fb8f8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb91515e640 1 -- 172.21.15.67:0/3919753104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f8003530 con 0x7fb8f80051d0 2024-09-19T05:42:50.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.154+0000 7fb91495d640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8f80039c0 0x7fb8f8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:50.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91515e640 1 -- 172.21.15.67:0/3919753104 reap_dead start 2024-09-19T05:42:50.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91515e640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb8f800b9d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fb908001e70 tx=0x7fb90801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60b0562a2f3ad7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:50.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908001a90 con 0x7fb8f80051d0 2024-09-19T05:42:50.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb908003bc0 con 0x7fb8f80051d0 2024-09-19T05:42:50.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb90f7fe640 1 -- 172.21.15.67:0/3919753104 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908005020 con 0x7fb8f80051d0 2024-09-19T05:42:50.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 -- 172.21.15.67:0/3919753104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 msgr2=0x7fb8f800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb8f800b9d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fb908001e70 tx=0x7fb90801c780 comp rx=0 tx=0).stop 2024-09-19T05:42:50.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 -- 172.21.15.67:0/3919753104 shutdown_connections 2024-09-19T05:42:50.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 --2- 172.21.15.67:0/3919753104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb8f800b9d0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 -- 172.21.15.67:0/3919753104 >> 172.21.15.67:0/3919753104 conn(0x7fb91008bfc0 msgr2=0x7fb9100d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:50.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 -- 172.21.15.67:0/3919753104 shutdown_connections 2024-09-19T05:42:50.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 -- 172.21.15.67:0/3919753104 wait complete. 2024-09-19T05:42:50.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 Processor -- start 2024-09-19T05:42:50.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 -- start start 2024-09-19T05:42:50.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb9100cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb91015b440 0x7fb91015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb91015d4c0 0x7fb91015d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb910162180 con 0x7fb8f80051d0 2024-09-19T05:42:50.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb9100b5d00 con 0x7fb91015b440 2024-09-19T05:42:50.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb916bc1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb9100d1af0 con 0x7fb91015d4c0 2024-09-19T05:42:50.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91495d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb9100cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91495d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb9100cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34064/0 (socket says 172.21.15.67:34064) 2024-09-19T05:42:50.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91495d640 1 -- 172.21.15.67:0/1634756997 learned_addr learned my addr 172.21.15.67:0/1634756997 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:50.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91515e640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb91015d4c0 0x7fb91015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb90ffff640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb91015b440 0x7fb91015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91495d640 1 -- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb91015d4c0 msgr2=0x7fb91015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91495d640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb91015d4c0 0x7fb91015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91495d640 1 -- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb91015b440 msgr2=0x7fb91015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91495d640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb91015b440 0x7fb91015cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.158+0000 7fb91495d640 1 -- 172.21.15.67:0/1634756997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9100b7e70 con 0x7fb8f80051d0 2024-09-19T05:42:50.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb91495d640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb9100cc0a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fb90400d7e0 tx=0x7fb90400dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:50.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb90d7fa640 1 -- 172.21.15.67:0/1634756997 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904019070 con 0x7fb8f80051d0 2024-09-19T05:42:50.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb90d7fa640 1 -- 172.21.15.67:0/1634756997 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9040074e0 con 0x7fb8f80051d0 2024-09-19T05:42:50.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb916bc1640 1 -- 172.21.15.67:0/1634756997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9100b8150 con 0x7fb8f80051d0 2024-09-19T05:42:50.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb90d7fa640 1 -- 172.21.15.67:0/1634756997 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9040049f0 con 0x7fb8f80051d0 2024-09-19T05:42:50.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb916bc1640 1 -- 172.21.15.67:0/1634756997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91015b160 con 0x7fb8f80051d0 2024-09-19T05:42:50.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb916bc1640 1 -- 172.21.15.67:0/1634756997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9100b7bc0 con 0x7fb8f80051d0 2024-09-19T05:42:50.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb90d7fa640 1 -- 172.21.15.67:0/1634756997 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb90401c070 con 0x7fb8f80051d0 2024-09-19T05:42:50.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb90d7fa640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb8fc0678f0 0x7fb8fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb90d7fa640 1 -- 172.21.15.67:0/1634756997 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7fb904085600 con 0x7fb8f80051d0 2024-09-19T05:42:50.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb90ffff640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb8fc0678f0 0x7fb8fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.162+0000 7fb90ffff640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb8fc0678f0 0x7fb8fc069db0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb91015b940 tx=0x7fb900008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:50.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.166+0000 7fb90d7fa640 1 -- 172.21.15.67:0/1634756997 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb9040562b0 con 0x7fb8f80051d0 2024-09-19T05:42:50.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.398+0000 7fb916bc1640 1 -- 172.21.15.67:0/1634756997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7fb9100d0e80 con 0x7fb8f80051d0 2024-09-19T05:42:50.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.698+0000 7fb90d7fa640 1 -- 172.21.15.67:0/1634756997 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v427) ==== 158+0+0 (secure 0 0 0) 0x7fb904055bb0 con 0x7fb8f80051d0 2024-09-19T05:42:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.702+0000 7fb916bc1640 1 -- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb8fc0678f0 msgr2=0x7fb8fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.702+0000 7fb916bc1640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb8fc0678f0 0x7fb8fc069db0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb91015b940 tx=0x7fb900008040 comp rx=0 tx=0).stop 2024-09-19T05:42:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.702+0000 7fb916bc1640 1 -- 172.21.15.67:0/1634756997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 msgr2=0x7fb9100cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.702+0000 7fb916bc1640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb9100cc0a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fb90400d7e0 tx=0x7fb90400dca0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.702+0000 7fb916bc1640 1 -- 172.21.15.67:0/1634756997 shutdown_connections 2024-09-19T05:42:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.702+0000 7fb916bc1640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb8fc0678f0 0x7fb8fc069db0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.702+0000 7fb916bc1640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb91015d4c0 0x7fb91015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.702+0000 7fb916bc1640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb91015b440 0x7fb91015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.702+0000 7fb916bc1640 1 --2- 172.21.15.67:0/1634756997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb8f80051d0 0x7fb9100cc0a0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.702+0000 7fb916bc1640 1 -- 172.21.15.67:0/1634756997 >> 172.21.15.67:0/1634756997 conn(0x7fb91008bfc0 msgr2=0x7fb9100cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:50.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.706+0000 7fb916bc1640 1 -- 172.21.15.67:0/1634756997 shutdown_connections 2024-09-19T05:42:50.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.706+0000 7fb916bc1640 1 -- 172.21.15.67:0/1634756997 wait complete. 2024-09-19T05:42:50.726 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-09-19T05:42:50.726 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-19T05:42:50.727 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:42:50.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.854+0000 7fba63954640 1 Processor -- start 2024-09-19T05:42:50.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.854+0000 7fba63954640 1 -- start start 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fba5c0b2fd0 0x7fba5c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fba5c0acfb0 0x7fba5c0ad390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5c0ad8d0 con 0x7fba5c159d60 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fba5c06de80 con 0x7fba5c0b2fd0 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fba5c06e160 con 0x7fba5c0acfb0 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba60eef640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fba5c0b2fd0 0x7fba5c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba60eef640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fba5c0b2fd0 0x7fba5c0b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34070/0 (socket says 172.21.15.67:34070) 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba60eef640 1 -- 172.21.15.67:0/1021061799 learned_addr learned my addr 172.21.15.67:0/1021061799 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba61ef1640 1 --2- 172.21.15.67:0/1021061799 >> v2:172.21.15.97:3300/0 conn(0x7fba5c0acfb0 0x7fba5c0ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba60eef640 1 -- 172.21.15.67:0/1021061799 >> v2:172.21.15.97:3300/0 conn(0x7fba5c0acfb0 msgr2=0x7fba5c0ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:50.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba60eef640 1 --2- 172.21.15.67:0/1021061799 >> v2:172.21.15.97:3300/0 conn(0x7fba5c0acfb0 0x7fba5c0ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba60eef640 1 -- 172.21.15.67:0/1021061799 >> v1:172.21.15.97:6789/0 conn(0x7fba5c159d60 legacy=0x7fba5c06ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:50.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba60eef640 1 -- 172.21.15.67:0/1021061799 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c06e440 con 0x7fba5c0b2fd0 2024-09-19T05:42:50.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba60eef640 1 --2- 172.21.15.67:0/1021061799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0b2fd0 0x7fba5c0b3420 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0743c0 tx=0x7fba4c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bbc3bb1370a291 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:50.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba53fff640 1 -- 172.21.15.67:0/1021061799 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0b1070 con 0x7fba5c0b2fd0 2024-09-19T05:42:50.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba53fff640 1 -- 172.21.15.67:0/1021061799 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c0ac630 con 0x7fba5c0b2fd0 2024-09-19T05:42:50.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba53fff640 1 -- 172.21.15.67:0/1021061799 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0a8050 con 0x7fba5c0b2fd0 2024-09-19T05:42:50.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 -- 172.21.15.67:0/1021061799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0b2fd0 msgr2=0x7fba5c0b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 --2- 172.21.15.67:0/1021061799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0b2fd0 0x7fba5c0b3420 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0743c0 tx=0x7fba4c01c4e0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 -- 172.21.15.67:0/1021061799 shutdown_connections 2024-09-19T05:42:50.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 --2- 172.21.15.67:0/1021061799 >> v2:172.21.15.97:3300/0 conn(0x7fba5c0acfb0 0x7fba5c0ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 --2- 172.21.15.67:0/1021061799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0b2fd0 0x7fba5c0b3420 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.858+0000 7fba63954640 1 -- 172.21.15.67:0/1021061799 >> 172.21.15.67:0/1021061799 conn(0x7fba5c0d0080 msgr2=0x7fba5c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:50.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 -- 172.21.15.67:0/1021061799 shutdown_connections 2024-09-19T05:42:50.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 -- 172.21.15.67:0/1021061799 wait complete. 2024-09-19T05:42:50.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 Processor -- start 2024-09-19T05:42:50.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 -- start start 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0acfb0 0x7fba5c1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba5c0b2fd0 0x7fba5c1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba5c159d60 0x7fba5c1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0af6b0 con 0x7fba5c0acfb0 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c06f630 con 0x7fba5c0b2fd0 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fba5c0af830 con 0x7fba5c159d60 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba616f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0acfb0 0x7fba5c1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba616f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0acfb0 0x7fba5c1434d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34082/0 (socket says 172.21.15.67:34082) 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba616f0640 1 -- 172.21.15.67:0/2845841051 learned_addr learned my addr 172.21.15.67:0/2845841051 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba60eef640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba5c0b2fd0 0x7fba5c1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba61ef1640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba5c159d60 0x7fba5c1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba616f0640 1 -- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba5c159d60 msgr2=0x7fba5c1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba616f0640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba5c159d60 0x7fba5c1588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba616f0640 1 -- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba5c0b2fd0 msgr2=0x7fba5c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:50.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba616f0640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba5c0b2fd0 0x7fba5c1583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:50.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba616f0640 1 -- 172.21.15.67:0/2845841051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c15ac50 con 0x7fba5c0acfb0 2024-09-19T05:42:50.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba616f0640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0acfb0 0x7fba5c1434d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fba5800c450 tx=0x7fba5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:50.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba51ffb640 1 -- 172.21.15.67:0/2845841051 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58012830 con 0x7fba5c0acfb0 2024-09-19T05:42:50.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba51ffb640 1 -- 172.21.15.67:0/2845841051 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba58017070 con 0x7fba5c0acfb0 2024-09-19T05:42:50.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 -- 172.21.15.67:0/2845841051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c15aed0 con 0x7fba5c0acfb0 2024-09-19T05:42:50.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba51ffb640 1 -- 172.21.15.67:0/2845841051 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58012c30 con 0x7fba5c0acfb0 2024-09-19T05:42:50.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.862+0000 7fba63954640 1 -- 172.21.15.67:0/2845841051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c099dd0 con 0x7fba5c0acfb0 2024-09-19T05:42:50.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.866+0000 7fba63954640 1 -- 172.21.15.67:0/2845841051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5c0ad390 con 0x7fba5c0acfb0 2024-09-19T05:42:50.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.866+0000 7fba51ffb640 1 -- 172.21.15.67:0/2845841051 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba5801c460 con 0x7fba5c0acfb0 2024-09-19T05:42:50.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.866+0000 7fba51ffb640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fba400678c0 0x7fba40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:50.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.866+0000 7fba51ffb640 1 -- 172.21.15.67:0/2845841051 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7fba580858a0 con 0x7fba5c0acfb0 2024-09-19T05:42:50.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.866+0000 7fba60eef640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fba400678c0 0x7fba40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:50.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.866+0000 7fba60eef640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fba400678c0 0x7fba40069d80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0ae000 tx=0x7fba4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:50.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:50.870+0000 7fba51ffb640 1 -- 172.21.15.67:0/2845841051 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fba5c15ac50 con 0x7fba5c0acfb0 2024-09-19T05:42:51.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.038+0000 7fba63954640 1 -- 172.21.15.67:0/2845841051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba5c0d0f20 con 0x7fba5c0acfb0 2024-09-19T05:42:51.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.038+0000 7fba51ffb640 1 -- 172.21.15.67:0/2845841051 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+13277 (secure 0 0 0) 0x7fba58056550 con 0x7fba5c0acfb0 2024-09-19T05:42:51.037 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:51.037 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":123,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:42:49.693504+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6837/396819326":"2024-09-20T05:42:46.676522+0000","172.21.15.97:6836/396819326":"2024-09-20T05:42:46.676522+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:42:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 -- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fba400678c0 msgr2=0x7fba40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fba400678c0 0x7fba40069d80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0ae000 tx=0x7fba4c008040 comp rx=0 tx=0).stop 2024-09-19T05:42:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 -- 172.21.15.67:0/2845841051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0acfb0 msgr2=0x7fba5c1434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0acfb0 0x7fba5c1434d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fba5800c450 tx=0x7fba5800c910 comp rx=0 tx=0).stop 2024-09-19T05:42:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 -- 172.21.15.67:0/2845841051 shutdown_connections 2024-09-19T05:42:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fba400678c0 0x7fba40069d80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba5c159d60 0x7fba5c1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba5c0b2fd0 0x7fba5c1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 --2- 172.21.15.67:0/2845841051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba5c0acfb0 0x7fba5c1434d0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 -- 172.21.15.67:0/2845841051 >> 172.21.15.67:0/2845841051 conn(0x7fba5c0d0080 msgr2=0x7fba5c15c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 -- 172.21.15.67:0/2845841051 shutdown_connections 2024-09-19T05:42:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.042+0000 7fba63954640 1 -- 172.21.15.67:0/2845841051 wait complete. 2024-09-19T05:42:51.057 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:42:51.057 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:42:51.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb059cff640 1 Processor -- start 2024-09-19T05:42:51.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb059cff640 1 -- start start 2024-09-19T05:42:51.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb059cff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb054145c70 0x7fb054160910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb059cff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0540b4950 0x7fb0540ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb059cff640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0540b6120 con 0x7fb0540b3a60 2024-09-19T05:42:51.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb059cff640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb0540b63a0 con 0x7fb054145c70 2024-09-19T05:42:51.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb059cff640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0540b6680 con 0x7fb0540b4950 2024-09-19T05:42:51.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb0537fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb054145c70 0x7fb054160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb0537fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb054145c70 0x7fb054160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34090/0 (socket says 172.21.15.67:34090) 2024-09-19T05:42:51.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb0537fe640 1 -- 172.21.15.67:0/2945204444 learned_addr learned my addr 172.21.15.67:0/2945204444 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:51.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb053fff640 1 --2- 172.21.15.67:0/2945204444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0540b4950 0x7fb0540ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb0537fe640 1 -- 172.21.15.67:0/2945204444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0540b4950 msgr2=0x7fb0540ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:51.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb0537fe640 1 --2- 172.21.15.67:0/2945204444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0540b4950 0x7fb0540ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb0537fe640 1 -- 172.21.15.67:0/2945204444 >> v1:172.21.15.97:6789/0 conn(0x7fb0540b3a60 legacy=0x7fb0540b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:51.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.194+0000 7fb0537fe640 1 -- 172.21.15.67:0/2945204444 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0540b6960 con 0x7fb054145c70 2024-09-19T05:42:51.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb0537fe640 1 --2- 172.21.15.67:0/2945204444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 0x7fb054160910 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fb044009870 tx=0x7fb04401c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc3c155e687a44a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:51.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb0527fc640 1 -- 172.21.15.67:0/2945204444 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440b0070 con 0x7fb054145c70 2024-09-19T05:42:51.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb0527fc640 1 -- 172.21.15.67:0/2945204444 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0440ab600 con 0x7fb054145c70 2024-09-19T05:42:51.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb0527fc640 1 -- 172.21.15.67:0/2945204444 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440ab9d0 con 0x7fb054145c70 2024-09-19T05:42:51.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 -- 172.21.15.67:0/2945204444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 msgr2=0x7fb054160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 --2- 172.21.15.67:0/2945204444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 0x7fb054160910 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fb044009870 tx=0x7fb04401c220 comp rx=0 tx=0).stop 2024-09-19T05:42:51.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 -- 172.21.15.67:0/2945204444 shutdown_connections 2024-09-19T05:42:51.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 --2- 172.21.15.67:0/2945204444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0540b4950 0x7fb0540ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 --2- 172.21.15.67:0/2945204444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 0x7fb054160910 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 -- 172.21.15.67:0/2945204444 >> 172.21.15.67:0/2945204444 conn(0x7fb0540b2f40 msgr2=0x7fb0540b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:51.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 -- 172.21.15.67:0/2945204444 shutdown_connections 2024-09-19T05:42:51.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 -- 172.21.15.67:0/2945204444 wait complete. 2024-09-19T05:42:51.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 Processor -- start 2024-09-19T05:42:51.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 -- start start 2024-09-19T05:42:51.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0540b3a60 0x7fb0540ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0540b4950 0x7fb0540d0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 0x7fb0541432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb0540af0f0 con 0x7fb054145c70 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb0540aef70 con 0x7fb0540b3a60 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb059cff640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0540af270 con 0x7fb0540b4950 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb053fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 0x7fb0541432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb053fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 0x7fb0541432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34092/0 (socket says 172.21.15.67:34092) 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb053fff640 1 -- 172.21.15.67:0/3231498744 learned_addr learned my addr 172.21.15.67:0/3231498744 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb052ffd640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0540b4950 0x7fb0540d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb0537fe640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0540b3a60 0x7fb0540ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb053fff640 1 -- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0540b4950 msgr2=0x7fb0540d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb053fff640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0540b4950 0x7fb0540d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb053fff640 1 -- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0540b3a60 msgr2=0x7fb0540ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb053fff640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0540b3a60 0x7fb0540ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.198+0000 7fb053fff640 1 -- 172.21.15.67:0/3231498744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb054143a20 con 0x7fb054145c70 2024-09-19T05:42:51.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb053fff640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 0x7fb0541432b0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fb04c007e60 tx=0x7fb04c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:51.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb03bfff640 1 -- 172.21.15.67:0/3231498744 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c014420 con 0x7fb054145c70 2024-09-19T05:42:51.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb03bfff640 1 -- 172.21.15.67:0/3231498744 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb04c019070 con 0x7fb054145c70 2024-09-19T05:42:51.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb059cff640 1 -- 172.21.15.67:0/3231498744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0540cdc80 con 0x7fb054145c70 2024-09-19T05:42:51.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb03bfff640 1 -- 172.21.15.67:0/3231498744 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c014820 con 0x7fb054145c70 2024-09-19T05:42:51.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb059cff640 1 -- 172.21.15.67:0/3231498744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0540ce240 con 0x7fb054145c70 2024-09-19T05:42:51.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb059cff640 1 -- 172.21.15.67:0/3231498744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0540ae220 con 0x7fb054145c70 2024-09-19T05:42:51.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb03bfff640 1 -- 172.21.15.67:0/3231498744 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb04c0149c0 con 0x7fb054145c70 2024-09-19T05:42:51.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb03bfff640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0400678c0 0x7fb040069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb03bfff640 1 -- 172.21.15.67:0/3231498744 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7fb04c0863b0 con 0x7fb054145c70 2024-09-19T05:42:51.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb0537fe640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0400678c0 0x7fb040069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.202+0000 7fb0537fe640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0400678c0 0x7fb040069d80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb0440ad000 tx=0x7fb044008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:51.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.206+0000 7fb03bfff640 1 -- 172.21.15.67:0/3231498744 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb04c057060 con 0x7fb054145c70 2024-09-19T05:42:51.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 -- 172.21.15.67:0/3231498744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb054141730 con 0x7fb054145c70 2024-09-19T05:42:51.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb03bfff640 1 -- 172.21.15.67:0/3231498744 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) ==== 93+0+10 (secure 0 0 0) 0x7fb04c056960 con 0x7fb054145c70 2024-09-19T05:42:51.369 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:42:51.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 -- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0400678c0 msgr2=0x7fb040069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0400678c0 0x7fb040069d80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb0440ad000 tx=0x7fb044008040 comp rx=0 tx=0).stop 2024-09-19T05:42:51.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 -- 172.21.15.67:0/3231498744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 msgr2=0x7fb0541432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 0x7fb0541432b0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fb04c007e60 tx=0x7fb04c00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 -- 172.21.15.67:0/3231498744 shutdown_connections 2024-09-19T05:42:51.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb054145c70 0x7fb0541432b0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0400678c0 0x7fb040069d80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb0540b4950 0x7fb0540d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 --2- 172.21.15.67:0/3231498744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0540b3a60 0x7fb0540ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 -- 172.21.15.67:0/3231498744 >> 172.21.15.67:0/3231498744 conn(0x7fb0540b2f40 msgr2=0x7fb054140b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:51.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 -- 172.21.15.67:0/3231498744 shutdown_connections 2024-09-19T05:42:51.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.370+0000 7fb059cff640 1 -- 172.21.15.67:0/3231498744 wait complete. 2024-09-19T05:42:51.387 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-19T05:42:51.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75ad3cc640 1 Processor -- start 2024-09-19T05:42:51.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75ad3cc640 1 -- start start 2024-09-19T05:42:51.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75ad3cc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f75a806bcc0 0x7f75a806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75ad3cc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a80b1d70 con 0x7f75a815fb00 2024-09-19T05:42:51.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75ad3cc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a815eb90 con 0x7f75a80b1990 2024-09-19T05:42:51.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75ad3cc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f75a815f950 con 0x7f75a806bcc0 2024-09-19T05:42:51.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75a67fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f75a806bcc0 0x7f75a806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75a67fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f75a806bcc0 0x7f75a806c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34100/0 (socket says 172.21.15.67:34100) 2024-09-19T05:42:51.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75a67fc640 1 -- 172.21.15.67:0/2560306709 learned_addr learned my addr 172.21.15.67:0/2560306709 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:51.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75a77fe640 1 --1- 172.21.15.67:0/2560306709 >> v1:172.21.15.67:6789/0 conn(0x7f75a815fb00 0x7f75a815ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59146/0 (socket says 172.21.15.67:59146) 2024-09-19T05:42:51.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75a67fc640 1 -- 172.21.15.67:0/2560306709 >> v1:172.21.15.97:6789/0 conn(0x7f75a80b1990 legacy=0x7f75a80b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:51.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75a67fc640 1 -- 172.21.15.67:0/2560306709 >> v1:172.21.15.67:6789/0 conn(0x7f75a815fb00 legacy=0x7f75a815ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75a67fc640 1 -- 172.21.15.67:0/2560306709 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a815ee70 con 0x7f75a806bcc0 2024-09-19T05:42:51.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.502+0000 7f75a5ffb640 1 -- 172.21.15.67:0/2560306709 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443106668 0 0) 0x7f75a80b1d70 con 0x7f75a815fb00 2024-09-19T05:42:51.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a67fc640 1 --2- 172.21.15.67:0/2560306709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a806bcc0 0x7f75a806c130 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f759c009870 tx=0x7f759c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8026de9d6f28ff60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:51.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a5ffb640 1 -- 172.21.15.67:0/2560306709 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c0b1070 con 0x7f75a806bcc0 2024-09-19T05:42:51.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a5ffb640 1 -- 172.21.15.67:0/2560306709 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759c0ac630 con 0x7f75a806bcc0 2024-09-19T05:42:51.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a5ffb640 1 -- 172.21.15.67:0/2560306709 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c0a8050 con 0x7f75a806bcc0 2024-09-19T05:42:51.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 -- 172.21.15.67:0/2560306709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a806bcc0 msgr2=0x7f75a806c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 --2- 172.21.15.67:0/2560306709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a806bcc0 0x7f75a806c130 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f759c009870 tx=0x7f759c01c4e0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 -- 172.21.15.67:0/2560306709 shutdown_connections 2024-09-19T05:42:51.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 --2- 172.21.15.67:0/2560306709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a806bcc0 0x7f75a806c130 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 -- 172.21.15.67:0/2560306709 >> 172.21.15.67:0/2560306709 conn(0x7f75a809aa30 msgr2=0x7f75a80b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:51.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 -- 172.21.15.67:0/2560306709 shutdown_connections 2024-09-19T05:42:51.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 -- 172.21.15.67:0/2560306709 wait complete. 2024-09-19T05:42:51.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 Processor -- start 2024-09-19T05:42:51.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 -- start start 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75a806bcc0 0x7f75a809edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a80b1990 0x7f75a814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75a815fb00 0x7f75a8157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f75a80b29b0 con 0x7f75a80b1990 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f75a806c670 con 0x7f75a815fb00 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75ad3cc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f75a814dbb0 con 0x7f75a806bcc0 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a67fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a80b1990 0x7f75a814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a67fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a80b1990 0x7f75a814d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34114/0 (socket says 172.21.15.67:34114) 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a67fc640 1 -- 172.21.15.67:0/511999292 learned_addr learned my addr 172.21.15.67:0/511999292 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a6ffd640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75a806bcc0 0x7f75a809edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a67fc640 1 -- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75a806bcc0 msgr2=0x7f75a809edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a77fe640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75a815fb00 0x7f75a8157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a67fc640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75a806bcc0 0x7f75a809edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a67fc640 1 -- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75a815fb00 msgr2=0x7f75a8157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a67fc640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75a815fb00 0x7f75a8157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.506+0000 7f75a67fc640 1 -- 172.21.15.67:0/511999292 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a8151410 con 0x7f75a80b1990 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f75a67fc640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a80b1990 0x7f75a814d670 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f759c0af040 tx=0x7f759c01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f758f7fe640 1 -- 172.21.15.67:0/511999292 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c0b1040 con 0x7f75a80b1990 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f758f7fe640 1 -- 172.21.15.67:0/511999292 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759c0bd070 con 0x7f75a80b1990 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f758f7fe640 1 -- 172.21.15.67:0/511999292 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c0b7880 con 0x7f75a80b1990 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f75ad3cc640 1 -- 172.21.15.67:0/511999292 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a81516f0 con 0x7f75a80b1990 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f75ad3cc640 1 -- 172.21.15.67:0/511999292 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a8151cb0 con 0x7f75a80b1990 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f75ad3cc640 1 -- 172.21.15.67:0/511999292 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a806c130 con 0x7f75a80b1990 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f758f7fe640 1 -- 172.21.15.67:0/511999292 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f759c0ac4f0 con 0x7f75a80b1990 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f758f7fe640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75940678c0 0x7f7594069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:51.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f758f7fe640 1 -- 172.21.15.67:0/511999292 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7f759c11fb50 con 0x7f75a80b1990 2024-09-19T05:42:51.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f75a6ffd640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75940678c0 0x7f7594069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:51.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.510+0000 7f75a6ffd640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75940678c0 0x7f7594069d80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7598003d60 tx=0x7f7598009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:51.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.514+0000 7f758f7fe640 1 -- 172.21.15.67:0/511999292 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f759c0160d0 con 0x7f75a80b1990 2024-09-19T05:42:51.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:51.738+0000 7f75ad3cc640 1 -- 172.21.15.67:0/511999292 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f75a806fbc0 con 0x7f75a80b1990 2024-09-19T05:42:52.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.710+0000 7f758f7fe640 1 -- 172.21.15.67:0/511999292 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v429) ==== 147+0+0 (secure 0 0 0) 0x7f759c0f07e0 con 0x7f75a80b1990 2024-09-19T05:42:52.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 -- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75940678c0 msgr2=0x7f7594069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75940678c0 0x7f7594069d80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7598003d60 tx=0x7f7598009040 comp rx=0 tx=0).stop 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 -- 172.21.15.67:0/511999292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a80b1990 msgr2=0x7f75a814d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a80b1990 0x7f75a814d670 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f759c0af040 tx=0x7f759c01ad20 comp rx=0 tx=0).stop 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 -- 172.21.15.67:0/511999292 shutdown_connections 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75a815fb00 0x7f75a8157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75a80b1990 0x7f75a814d670 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75940678c0 0x7f7594069d80 secure :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7598003d60 tx=0x7f7598009040 comp rx=0 tx=0).stop 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 --2- 172.21.15.67:0/511999292 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75a806bcc0 0x7f75a809edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 -- 172.21.15.67:0/511999292 >> 172.21.15.67:0/511999292 conn(0x7f75a809aa30 msgr2=0x7f75a815ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 -- 172.21.15.67:0/511999292 shutdown_connections 2024-09-19T05:42:52.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.714+0000 7f75ad3cc640 1 -- 172.21.15.67:0/511999292 wait complete. 2024-09-19T05:42:52.737 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:42:52.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.870+0000 7f9b3c466640 1 Processor -- start 2024-09-19T05:42:52.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.870+0000 7f9b3c466640 1 -- start start 2024-09-19T05:42:52.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9b340d4fb0 0x7f9b340d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:52.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d13c0 0x7f9b3406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:52.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b340d35a0 con 0x7f9b3415e690 2024-09-19T05:42:52.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9b340d1830 con 0x7f9b340d4fb0 2024-09-19T05:42:52.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9b340d32c0 con 0x7f9b340d13c0 2024-09-19T05:42:52.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3a202640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9b3415e690 0x7f9b340d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59150/0 (socket says 172.21.15.67:59150) 2024-09-19T05:42:52.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3a202640 1 -- 172.21.15.67:0/3618338431 learned_addr learned my addr 172.21.15.67:0/3618338431 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:52.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b39a01640 1 --2- 172.21.15.67:0/3618338431 >> v2:172.21.15.67:3300/0 conn(0x7f9b340d4fb0 0x7f9b340d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:52.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3aa03640 1 --2- 172.21.15.67:0/3618338431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d13c0 0x7f9b3406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:52.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b39a01640 1 -- 172.21.15.67:0/3618338431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d13c0 msgr2=0x7f9b3406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:52.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b39a01640 1 --2- 172.21.15.67:0/3618338431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d13c0 0x7f9b3406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:52.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b39a01640 1 -- 172.21.15.67:0/3618338431 >> v1:172.21.15.67:6789/0 conn(0x7f9b3415e690 legacy=0x7f9b340d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:52.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b39a01640 1 -- 172.21.15.67:0/3618338431 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3406d040 con 0x7f9b340d4fb0 2024-09-19T05:42:52.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b39200640 1 -- 172.21.15.67:0/3618338431 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4238586243 0 0) 0x7f9b340d35a0 con 0x7f9b3415e690 2024-09-19T05:42:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b39a01640 1 --2- 172.21.15.67:0/3618338431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d4fb0 0x7f9b340d0e80 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f9b240097c0 tx=0x7f9b2401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd9178ccdd1585f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b39200640 1 -- 172.21.15.67:0/3618338431 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b240a7070 con 0x7f9b340d4fb0 2024-09-19T05:42:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b39200640 1 -- 172.21.15.67:0/3618338431 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b240b0070 con 0x7f9b340d4fb0 2024-09-19T05:42:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b39200640 1 -- 172.21.15.67:0/3618338431 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b240ab890 con 0x7f9b340d4fb0 2024-09-19T05:42:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 -- 172.21.15.67:0/3618338431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d4fb0 msgr2=0x7f9b340d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 --2- 172.21.15.67:0/3618338431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d4fb0 0x7f9b340d0e80 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f9b240097c0 tx=0x7f9b2401c470 comp rx=0 tx=0).stop 2024-09-19T05:42:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 -- 172.21.15.67:0/3618338431 shutdown_connections 2024-09-19T05:42:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 --2- 172.21.15.67:0/3618338431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d13c0 0x7f9b3406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 --2- 172.21.15.67:0/3618338431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d4fb0 0x7f9b340d0e80 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 -- 172.21.15.67:0/3618338431 >> 172.21.15.67:0/3618338431 conn(0x7f9b340d4490 msgr2=0x7f9b340d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:52.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 -- 172.21.15.67:0/3618338431 shutdown_connections 2024-09-19T05:42:52.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.874+0000 7f9b3c466640 1 -- 172.21.15.67:0/3618338431 wait complete. 2024-09-19T05:42:52.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3c466640 1 Processor -- start 2024-09-19T05:42:52.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3c466640 1 -- start start 2024-09-19T05:42:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3c466640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d13c0 0x7f9b341618b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3c466640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d4fb0 0x7f9b340c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3c466640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b3415e690 0x7f9b340b9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3c466640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3406e9f0 con 0x7f9b340d13c0 2024-09-19T05:42:52.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3c466640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3406e870 con 0x7f9b3415e690 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3c466640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3406eb70 con 0x7f9b340d4fb0 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3a202640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d13c0 0x7f9b341618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3a202640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d13c0 0x7f9b341618b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34134/0 (socket says 172.21.15.67:34134) 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3a202640 1 -- 172.21.15.67:0/1502401119 learned_addr learned my addr 172.21.15.67:0/1502401119 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b39a01640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d4fb0 0x7f9b340c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3aa03640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b3415e690 0x7f9b340b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3a202640 1 -- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d4fb0 msgr2=0x7f9b340c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3a202640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d4fb0 0x7f9b340c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3a202640 1 -- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b3415e690 msgr2=0x7f9b340b9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3a202640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b3415e690 0x7f9b340b9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3a202640 1 -- 172.21.15.67:0/1502401119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b34161f20 con 0x7f9b340d13c0 2024-09-19T05:42:52.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b39a01640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d4fb0 0x7f9b340c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3a202640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d13c0 0x7f9b341618b0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000c480 tx=0x7f9b3000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b2affd640 1 -- 172.21.15.67:0/1502401119 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30018070 con 0x7f9b340d13c0 2024-09-19T05:42:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b2affd640 1 -- 172.21.15.67:0/1502401119 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b30007500 con 0x7f9b340d13c0 2024-09-19T05:42:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b2affd640 1 -- 172.21.15.67:0/1502401119 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30004a30 con 0x7f9b340d13c0 2024-09-19T05:42:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3c466640 1 -- 172.21.15.67:0/1502401119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b340ccbe0 con 0x7f9b340d13c0 2024-09-19T05:42:52.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.878+0000 7f9b3c466640 1 -- 172.21.15.67:0/1502401119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b340cd1a0 con 0x7f9b340d13c0 2024-09-19T05:42:52.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.882+0000 7f9b3c466640 1 -- 172.21.15.67:0/1502401119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3406db20 con 0x7f9b340d13c0 2024-09-19T05:42:52.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.882+0000 7f9b2affd640 1 -- 172.21.15.67:0/1502401119 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b30004bd0 con 0x7f9b340d13c0 2024-09-19T05:42:52.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.882+0000 7f9b2affd640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b180678c0 0x7f9b18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:52.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.882+0000 7f9b2affd640 1 -- 172.21.15.67:0/1502401119 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7f9b30084df0 con 0x7f9b340d13c0 2024-09-19T05:42:52.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.882+0000 7f9b39a01640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b180678c0 0x7f9b18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:52.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.882+0000 7f9b39a01640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b180678c0 0x7f9b18069d80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9b240af000 tx=0x7f9b24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:52.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:52.886+0000 7f9b2affd640 1 -- 172.21.15.67:0/1502401119 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9b30055a90 con 0x7f9b340d13c0 2024-09-19T05:42:53.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.050+0000 7f9b3c466640 1 -- 172.21.15.67:0/1502401119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9b340d2fe0 con 0x7f9b340d13c0 2024-09-19T05:42:53.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b2affd640 1 -- 172.21.15.67:0/1502401119 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f9b30055390 con 0x7f9b340d13c0 2024-09-19T05:42:53.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 -- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b180678c0 msgr2=0x7f9b18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b180678c0 0x7f9b18069d80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9b240af000 tx=0x7f9b24008040 comp rx=0 tx=0).stop 2024-09-19T05:42:53.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 -- 172.21.15.67:0/1502401119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d13c0 msgr2=0x7f9b341618b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d13c0 0x7f9b341618b0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000c480 tx=0x7f9b3000c940 comp rx=0 tx=0).stop 2024-09-19T05:42:53.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 -- 172.21.15.67:0/1502401119 shutdown_connections 2024-09-19T05:42:53.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b3415e690 0x7f9b340b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b180678c0 0x7f9b18069d80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b340d4fb0 0x7f9b340c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 --2- 172.21.15.67:0/1502401119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b340d13c0 0x7f9b341618b0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 -- 172.21.15.67:0/1502401119 >> 172.21.15.67:0/1502401119 conn(0x7f9b340d4490 msgr2=0x7f9b340d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:53.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 -- 172.21.15.67:0/1502401119 shutdown_connections 2024-09-19T05:42:53.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.058+0000 7f9b3c466640 1 -- 172.21.15.67:0/1502401119 wait complete. 2024-09-19T05:42:53.076 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:42:53.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:42:53.149 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:42:53.230 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:42:53.230 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:42:53.230 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:42:53.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:42:53.237 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:42:53.237 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:42:53.243 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:42:53.243 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:42:53.243 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:42:53.284 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:42:53.284 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:42:53.284 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:42:53.289 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:42:53.290 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:42:53.290 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:42:53.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0ffde9f640 1 Processor -- start 2024-09-19T05:42:53.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0ffde9f640 1 -- start start 2024-09-19T05:42:53.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0ffde9f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0ff815c030 0x7f0ff806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0ffde9f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ff815d1d0 0x7f0ff80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0ffde9f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff806e3c0 con 0x7f0ff80b3510 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0ffde9f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff806e6a0 con 0x7f0ff815d1d0 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0ffde9f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff806e980 con 0x7f0ff815c030 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0feeffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ff815d1d0 0x7f0ff80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0feeffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ff815d1d0 0x7f0ff80b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34144/0 (socket says 172.21.15.67:34144) 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0ff7fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0ff80b3510 0x7f0ff806f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59158/0 (socket says 172.21.15.67:59158) 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0feeffd640 1 -- 172.21.15.67:0/544709452 learned_addr learned my addr 172.21.15.67:0/544709452 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0ff77fe640 1 --2- 172.21.15.67:0/544709452 >> v2:172.21.15.97:3300/0 conn(0x7f0ff815c030 0x7f0ff806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0feeffd640 1 -- 172.21.15.67:0/544709452 >> v2:172.21.15.97:3300/0 conn(0x7f0ff815c030 msgr2=0x7f0ff806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0feeffd640 1 --2- 172.21.15.67:0/544709452 >> v2:172.21.15.97:3300/0 conn(0x7f0ff815c030 0x7f0ff806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0feeffd640 1 -- 172.21.15.67:0/544709452 >> v1:172.21.15.67:6789/0 conn(0x7f0ff80b3510 legacy=0x7f0ff806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0feeffd640 1 -- 172.21.15.67:0/544709452 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff806ec60 con 0x7f0ff815d1d0 2024-09-19T05:42:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.462+0000 7f0ff6ffd640 1 -- 172.21.15.67:0/544709452 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3249585552 0 0) 0x7f0ff806e3c0 con 0x7f0ff80b3510 2024-09-19T05:42:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0feeffd640 1 --2- 172.21.15.67:0/544709452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff815d1d0 0x7f0ff80b2fd0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8070390 tx=0x7f0fe001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abcb3934a71c6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ff6ffd640 1 -- 172.21.15.67:0/544709452 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00aa5f0 con 0x7f0ff815d1d0 2024-09-19T05:42:53.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ff6ffd640 1 -- 172.21.15.67:0/544709452 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe00af070 con 0x7f0ff815d1d0 2024-09-19T05:42:53.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ff6ffd640 1 -- 172.21.15.67:0/544709452 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00aa9b0 con 0x7f0ff815d1d0 2024-09-19T05:42:53.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 -- 172.21.15.67:0/544709452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff815d1d0 msgr2=0x7f0ff80b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 --2- 172.21.15.67:0/544709452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff815d1d0 0x7f0ff80b2fd0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8070390 tx=0x7f0fe001c4f0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 -- 172.21.15.67:0/544709452 shutdown_connections 2024-09-19T05:42:53.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 --2- 172.21.15.67:0/544709452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff815d1d0 0x7f0ff80b2fd0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 --2- 172.21.15.67:0/544709452 >> v2:172.21.15.97:3300/0 conn(0x7f0ff815c030 0x7f0ff806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 -- 172.21.15.67:0/544709452 >> 172.21.15.67:0/544709452 conn(0x7f0ff80d0080 msgr2=0x7f0ff80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:53.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 -- 172.21.15.67:0/544709452 shutdown_connections 2024-09-19T05:42:53.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 -- 172.21.15.67:0/544709452 wait complete. 2024-09-19T05:42:53.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 Processor -- start 2024-09-19T05:42:53.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 -- start start 2024-09-19T05:42:53.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff80b3510 0x7f0ff814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ff815c030 0x7f0ff814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.466+0000 7f0ffde9f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ff815d1d0 0x7f0ff8157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ffde9f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff815c590 con 0x7f0ff80b3510 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ffde9f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff815c410 con 0x7f0ff815d1d0 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ffde9f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff81690e0 con 0x7f0ff815c030 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff80b3510 0x7f0ff814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff80b3510 0x7f0ff814ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34148/0 (socket says 172.21.15.67:34148) 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff77fe640 1 -- 172.21.15.67:0/1389551108 learned_addr learned my addr 172.21.15.67:0/1389551108 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0feeffd640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ff815c030 0x7f0ff814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff7fff640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ff815d1d0 0x7f0ff8157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff77fe640 1 -- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ff815c030 msgr2=0x7f0ff814cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff77fe640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ff815c030 0x7f0ff814cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff77fe640 1 -- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ff815d1d0 msgr2=0x7f0ff8157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff77fe640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ff815d1d0 0x7f0ff8157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff77fe640 1 -- 172.21.15.67:0/1389551108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff814def0 con 0x7f0ff80b3510 2024-09-19T05:42:53.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0feeffd640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ff815c030 0x7f0ff814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:53.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff7fff640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ff815d1d0 0x7f0ff8157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:53.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff77fe640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff80b3510 0x7f0ff814ea10 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800d800 tx=0x7f0fe800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:53.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff4ff9640 1 -- 172.21.15.67:0/1389551108 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe800b6c0 con 0x7f0ff80b3510 2024-09-19T05:42:53.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff4ff9640 1 -- 172.21.15.67:0/1389551108 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe8019070 con 0x7f0ff80b3510 2024-09-19T05:42:53.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ffde9f640 1 -- 172.21.15.67:0/1389551108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff814e170 con 0x7f0ff80b3510 2024-09-19T05:42:53.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff4ff9640 1 -- 172.21.15.67:0/1389551108 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe800ba60 con 0x7f0ff80b3510 2024-09-19T05:42:53.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ffde9f640 1 -- 172.21.15.67:0/1389551108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff814e730 con 0x7f0ff80b3510 2024-09-19T05:42:53.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ffde9f640 1 -- 172.21.15.67:0/1389551108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff806dde0 con 0x7f0ff80b3510 2024-09-19T05:42:53.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff4ff9640 1 -- 172.21.15.67:0/1389551108 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0fe800bc00 con 0x7f0ff80b3510 2024-09-19T05:42:53.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff4ff9640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fd80678c0 0x7f0fd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0ff4ff9640 1 -- 172.21.15.67:0/1389551108 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7f0fe8085fe0 con 0x7f0ff80b3510 2024-09-19T05:42:53.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.470+0000 7f0feeffd640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fd80678c0 0x7f0fd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.474+0000 7f0feeffd640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fd80678c0 0x7f0fd8069d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00ae000 tx=0x7f0fe0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:53.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.474+0000 7f0ff4ff9640 1 -- 172.21.15.67:0/1389551108 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0ff814def0 con 0x7f0ff80b3510 2024-09-19T05:42:53.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.670+0000 7f0ffde9f640 1 -- 172.21.15.67:0/1389551108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ff80d0f20 con 0x7f0ff80b3510 2024-09-19T05:42:53.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ff4ff9640 1 -- 172.21.15.67:0/1389551108 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+3908 (secure 0 0 0) 0x7f0fe8056c90 con 0x7f0ff80b3510 2024-09-19T05:42:53.671 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:53.671 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":86,"btime":"2024-09-19T05:42:47:680964+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3254797420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3254797420},{"type":"v1","addr":"172.21.15.97:6837","nonce":3254797420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":6538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3139499810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3139499810},{"type":"v1","addr":"172.21.15.67:6833","nonce":3139499810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2818006351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2818006351},{"type":"v1","addr":"172.21.15.67:6835","nonce":2818006351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/762722911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":762722911},{"type":"v1","addr":"172.21.15.97:6835","nonce":762722911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[]} 2024-09-19T05:42:53.672 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 86 2024-09-19T05:42:53.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 -- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fd80678c0 msgr2=0x7f0fd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fd80678c0 0x7f0fd8069d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00ae000 tx=0x7f0fe0008040 comp rx=0 tx=0).stop 2024-09-19T05:42:53.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 -- 172.21.15.67:0/1389551108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff80b3510 msgr2=0x7f0ff814ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff80b3510 0x7f0ff814ea10 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800d800 tx=0x7f0fe800dcc0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 -- 172.21.15.67:0/1389551108 shutdown_connections 2024-09-19T05:42:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ff815d1d0 0x7f0ff8157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0fd80678c0 0x7f0fd8069d80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ff815c030 0x7f0ff814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 --2- 172.21.15.67:0/1389551108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ff80b3510 0x7f0ff814ea10 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 -- 172.21.15.67:0/1389551108 >> 172.21.15.67:0/1389551108 conn(0x7f0ff80d0080 msgr2=0x7f0ff80745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 -- 172.21.15.67:0/1389551108 shutdown_connections 2024-09-19T05:42:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.674+0000 7f0ffde9f640 1 -- 172.21.15.67:0/1389551108 wait complete. 2024-09-19T05:42:53.689 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:42:53.689 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:42:53.690 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:42:53.690 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:42:53.690 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:42:53.690 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:42:53.690 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:42:53.690 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:42:53.691 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:42:53.691 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:42:53.691 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:42:53.691 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:42:53.691 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:42:53.691 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:42:53.692 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:42:53.692 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:42:53.699 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:42:53.699 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:42:53.701 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:42:53.701 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:42:53.711 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:42:53.711 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:42:53.712 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:42:53.712 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:42:53.744 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:42:53.744 DEBUG:teuthology.parallel:result is None 2024-09-19T05:42:53.745 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:42:53.745 DEBUG:teuthology.parallel:result is None 2024-09-19T05:42:53.754 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:42:53.754 DEBUG:teuthology.parallel:result is None 2024-09-19T05:42:53.755 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:42:53.755 DEBUG:teuthology.parallel:result is None 2024-09-19T05:42:53.755 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:42:53.803 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:42:53.818 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:42:53.827 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:42:53.828 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:42:53.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79e8f0640 1 Processor -- start 2024-09-19T05:42:53.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79e8f0640 1 -- start start 2024-09-19T05:42:53.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79e8f0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 0x7ff7980d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79e8f0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff7980d0e80 0x7ff7980d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79e8f0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff7980b41c0 0x7ff7980b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79e8f0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff7980d0840 con 0x7ff7980b41c0 2024-09-19T05:42:53.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79e8f0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff7980d1800 con 0x7ff7980d0e80 2024-09-19T05:42:53.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79e8f0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff7980d4d40 con 0x7ff798161da0 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79ce8d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff7980b41c0 0x7ff7980b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79ce8d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff7980b41c0 0x7ff7980b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34182/0 (socket says 172.21.15.67:34182) 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79ce8d640 1 -- 172.21.15.67:0/1733126048 learned_addr learned my addr 172.21.15.67:0/1733126048 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff7977fe640 1 --2- 172.21.15.67:0/1733126048 >> v2:172.21.15.97:3300/0 conn(0x7ff7980d0e80 0x7ff7980d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff797fff640 1 --2- 172.21.15.67:0/1733126048 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 0x7ff7980d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79ce8d640 1 -- 172.21.15.67:0/1733126048 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 msgr2=0x7ff7980d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79ce8d640 1 --2- 172.21.15.67:0/1733126048 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 0x7ff7980d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79ce8d640 1 -- 172.21.15.67:0/1733126048 >> v2:172.21.15.97:3300/0 conn(0x7ff7980d0e80 msgr2=0x7ff7980d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79ce8d640 1 --2- 172.21.15.67:0/1733126048 >> v2:172.21.15.97:3300/0 conn(0x7ff7980d0e80 0x7ff7980d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79ce8d640 1 -- 172.21.15.67:0/1733126048 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7980d5020 con 0x7ff7980b41c0 2024-09-19T05:42:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff797fff640 1 --2- 172.21.15.67:0/1733126048 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 0x7ff7980d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:42:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff79ce8d640 1 --2- 172.21.15.67:0/1733126048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980b41c0 0x7ff7980b4670 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7ff79808d460 tx=0x7ff79001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d749f23512548fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff796ffd640 1 -- 172.21.15.67:0/1733126048 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7900a5760 con 0x7ff7980b41c0 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff796ffd640 1 -- 172.21.15.67:0/1733126048 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7900a5900 con 0x7ff7980b41c0 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.874+0000 7ff796ffd640 1 -- 172.21.15.67:0/1733126048 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7900a5cd0 con 0x7ff7980b41c0 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1733126048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980b41c0 msgr2=0x7ff7980b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 --2- 172.21.15.67:0/1733126048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980b41c0 0x7ff7980b4670 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7ff79808d460 tx=0x7ff79001c9f0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1733126048 shutdown_connections 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 --2- 172.21.15.67:0/1733126048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980b41c0 0x7ff7980b4670 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 --2- 172.21.15.67:0/1733126048 >> v2:172.21.15.97:3300/0 conn(0x7ff7980d0e80 0x7ff7980d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 --2- 172.21.15.67:0/1733126048 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 0x7ff7980d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1733126048 >> 172.21.15.67:0/1733126048 conn(0x7ff79808bfc0 msgr2=0x7ff7980d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1733126048 shutdown_connections 2024-09-19T05:42:53.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1733126048 wait complete. 2024-09-19T05:42:53.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 Processor -- start 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- start start 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7980b41c0 0x7ff798153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980d0e80 0x7ff7980c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 0x7ff7980c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff7980cf150 con 0x7ff7980d0e80 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff798162180 con 0x7ff7980b41c0 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff7980cf2d0 con 0x7ff798161da0 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff7977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980d0e80 0x7ff7980c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff7977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980d0e80 0x7ff7980c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34198/0 (socket says 172.21.15.67:34198) 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff7977fe640 1 -- 172.21.15.67:0/1223131077 learned_addr learned my addr 172.21.15.67:0/1223131077 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:53.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff797fff640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7980b41c0 0x7ff798153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79ce8d640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 0x7ff7980c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff7977fe640 1 -- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 msgr2=0x7ff7980c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff7977fe640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 0x7ff7980c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff7977fe640 1 -- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7980b41c0 msgr2=0x7ff798153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:53.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff7977fe640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7980b41c0 0x7ff798153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:53.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff7977fe640 1 -- 172.21.15.67:0/1223131077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7980ca3f0 con 0x7ff7980d0e80 2024-09-19T05:42:53.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff7977fe640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980d0e80 0x7ff7980c9eb0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009fd0 tx=0x7ff78c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:53.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff794ff9640 1 -- 172.21.15.67:0/1223131077 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c017070 con 0x7ff7980d0e80 2024-09-19T05:42:53.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff794ff9640 1 -- 172.21.15.67:0/1223131077 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78c00c940 con 0x7ff7980d0e80 2024-09-19T05:42:53.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff794ff9640 1 -- 172.21.15.67:0/1223131077 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00cd10 con 0x7ff7980d0e80 2024-09-19T05:42:53.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1223131077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7980ca6b0 con 0x7ff7980d0e80 2024-09-19T05:42:53.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.878+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1223131077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7980cac70 con 0x7ff7980d0e80 2024-09-19T05:42:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.882+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1223131077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7980cae70 con 0x7ff7980d0e80 2024-09-19T05:42:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.882+0000 7ff794ff9640 1 -- 172.21.15.67:0/1223131077 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff78c01a070 con 0x7ff7980d0e80 2024-09-19T05:42:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.882+0000 7ff794ff9640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff7840678c0 0x7ff784069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.882+0000 7ff794ff9640 1 -- 172.21.15.67:0/1223131077 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5335+0+0 (secure 0 0 0) 0x7ff78c085a90 con 0x7ff7980d0e80 2024-09-19T05:42:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.882+0000 7ff797fff640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff7840678c0 0x7ff784069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.882+0000 7ff797fff640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff7840678c0 0x7ff784069d80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff7880045f0 tx=0x7ff788008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:53.886+0000 7ff794ff9640 1 -- 172.21.15.67:0/1223131077 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff78c0560f0 con 0x7ff7980d0e80 2024-09-19T05:42:54.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:54.058+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1223131077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff7980b4670 con 0x7ff7980d0e80 2024-09-19T05:42:55.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.090+0000 7ff794ff9640 1 -- 172.21.15.67:0/1223131077 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v128) ==== 97+0+0 (secure 0 0 0) 0x7ff78c05a3f0 con 0x7ff7980d0e80 2024-09-19T05:42:55.088 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:42:55.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff7840678c0 msgr2=0x7ff784069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff7840678c0 0x7ff784069d80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff7880045f0 tx=0x7ff788008040 comp rx=0 tx=0).stop 2024-09-19T05:42:55.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1223131077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980d0e80 msgr2=0x7ff7980c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980d0e80 0x7ff7980c9eb0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009fd0 tx=0x7ff78c00ed40 comp rx=0 tx=0).stop 2024-09-19T05:42:55.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1223131077 shutdown_connections 2024-09-19T05:42:55.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff7840678c0 0x7ff784069d80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff798161da0 0x7ff7980c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7980d0e80 0x7ff7980c9eb0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 --2- 172.21.15.67:0/1223131077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7980b41c0 0x7ff798153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1223131077 >> 172.21.15.67:0/1223131077 conn(0x7ff79808bfc0 msgr2=0x7ff79806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:55.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1223131077 shutdown_connections 2024-09-19T05:42:55.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.094+0000 7ff79e8f0640 1 -- 172.21.15.67:0/1223131077 wait complete. 2024-09-19T05:42:55.115 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:42:55.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647c622640 1 Processor -- start 2024-09-19T05:42:55.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647c622640 1 -- start start 2024-09-19T05:42:55.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647c622640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647406dde0 0x7f64740b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647c622640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f64740b3510 0x7f647406f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647c622640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647406e3c0 con 0x7f647415c030 2024-09-19T05:42:55.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647c622640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f647406e6a0 con 0x7f64740b3510 2024-09-19T05:42:55.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647c622640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f647406e980 con 0x7f647406dde0 2024-09-19T05:42:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647a3be640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f647415c030 0x7f647415d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59168/0 (socket says 172.21.15.67:59168) 2024-09-19T05:42:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647a3be640 1 -- 172.21.15.67:0/4064898154 learned_addr learned my addr 172.21.15.67:0/4064898154 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647abbf640 1 --2- 172.21.15.67:0/4064898154 >> v2:172.21.15.67:3300/0 conn(0x7f64740b3510 0x7f647406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f6479bbd640 1 --2- 172.21.15.67:0/4064898154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647406dde0 0x7f64740b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f64793bc640 1 -- 172.21.15.67:0/4064898154 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161214886 0 0) 0x7f647406e3c0 con 0x7f647415c030 2024-09-19T05:42:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f64793bc640 1 -- 172.21.15.67:0/4064898154 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6460003530 con 0x7f647415c030 2024-09-19T05:42:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647abbf640 1 -- 172.21.15.67:0/4064898154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647406dde0 msgr2=0x7f64740b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647abbf640 1 --2- 172.21.15.67:0/4064898154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647406dde0 0x7f64740b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647abbf640 1 -- 172.21.15.67:0/4064898154 >> v1:172.21.15.67:6789/0 conn(0x7f647415c030 legacy=0x7f647415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.246+0000 7f647abbf640 1 -- 172.21.15.67:0/4064898154 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647406ec60 con 0x7f64740b3510 2024-09-19T05:42:55.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647abbf640 1 --2- 172.21.15.67:0/4064898154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64740b3510 0x7f647406f460 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f646c0097c0 tx=0x7f646c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714cfad5a49d7ead server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:55.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f64793bc640 1 -- 172.21.15.67:0/4064898154 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c0b0070 con 0x7f64740b3510 2024-09-19T05:42:55.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f64793bc640 1 -- 172.21.15.67:0/4064898154 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646c0ab600 con 0x7f64740b3510 2024-09-19T05:42:55.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f64793bc640 1 -- 172.21.15.67:0/4064898154 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c0ab9d0 con 0x7f64740b3510 2024-09-19T05:42:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 -- 172.21.15.67:0/4064898154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64740b3510 msgr2=0x7f647406f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 --2- 172.21.15.67:0/4064898154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64740b3510 0x7f647406f460 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f646c0097c0 tx=0x7f646c01c3e0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 -- 172.21.15.67:0/4064898154 shutdown_connections 2024-09-19T05:42:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 --2- 172.21.15.67:0/4064898154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64740b3510 0x7f647406f460 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 --2- 172.21.15.67:0/4064898154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647406dde0 0x7f64740b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 -- 172.21.15.67:0/4064898154 >> 172.21.15.67:0/4064898154 conn(0x7f64740d0080 msgr2=0x7f64740d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 -- 172.21.15.67:0/4064898154 shutdown_connections 2024-09-19T05:42:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 -- 172.21.15.67:0/4064898154 wait complete. 2024-09-19T05:42:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 Processor -- start 2024-09-19T05:42:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 -- start start 2024-09-19T05:42:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647406dde0 0x7f6474150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64740b3510 0x7f647415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f647415c030 0x7f647409d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64741692f0 con 0x7f647415c030 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f647415c620 con 0x7f64740b3510 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647c622640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6474169470 con 0x7f647406dde0 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647abbf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f647415c030 0x7f647409d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647abbf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f647415c030 0x7f647409d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34208/0 (socket says 172.21.15.67:34208) 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647abbf640 1 -- 172.21.15.67:0/115810658 learned_addr learned my addr 172.21.15.67:0/115810658 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647a3be640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647406dde0 0x7f6474150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f6479bbd640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64740b3510 0x7f647415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647abbf640 1 -- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647406dde0 msgr2=0x7f6474150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647abbf640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647406dde0 0x7f6474150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647abbf640 1 -- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64740b3510 msgr2=0x7f647415e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647abbf640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64740b3510 0x7f647415e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f647abbf640 1 -- 172.21.15.67:0/115810658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64740afa20 con 0x7f647415c030 2024-09-19T05:42:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.250+0000 7f6479bbd640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64740b3510 0x7f647415e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f647abbf640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f647415c030 0x7f647409d750 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f646c01a010 tx=0x7f646c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f646affd640 1 -- 172.21.15.67:0/115810658 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c0b0040 con 0x7f647415c030 2024-09-19T05:42:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f646affd640 1 -- 172.21.15.67:0/115810658 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646c0b9070 con 0x7f647415c030 2024-09-19T05:42:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f646affd640 1 -- 172.21.15.67:0/115810658 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c0b4650 con 0x7f647415c030 2024-09-19T05:42:55.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f647c622640 1 -- 172.21.15.67:0/115810658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647415d420 con 0x7f647415c030 2024-09-19T05:42:55.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f647c622640 1 -- 172.21.15.67:0/115810658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647415d9e0 con 0x7f647415c030 2024-09-19T05:42:55.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f647c622640 1 -- 172.21.15.67:0/115810658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64740d0f20 con 0x7f647415c030 2024-09-19T05:42:55.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f646affd640 1 -- 172.21.15.67:0/115810658 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f646c0b47f0 con 0x7f647415c030 2024-09-19T05:42:55.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f646affd640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64580678c0 0x7f6458069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f646affd640 1 -- 172.21.15.67:0/115810658 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5249+0+0 (secure 0 0 0) 0x7f646c11f6d0 con 0x7f647415c030 2024-09-19T05:42:55.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.254+0000 7f647a3be640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64580678c0 0x7f6458069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.258+0000 7f647a3be640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64580678c0 0x7f6458069d80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6470005c10 tx=0x7f6470009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:55.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.258+0000 7f646affd640 1 -- 172.21.15.67:0/115810658 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f646c016090 con 0x7f647415c030 2024-09-19T05:42:55.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.482+0000 7f647c622640 1 -- 172.21.15.67:0/115810658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f647406f6f0 con 0x7f647415c030 2024-09-19T05:42:55.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.482+0000 7f646affd640 1 -- 172.21.15.67:0/115810658 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f646c0f03d0 con 0x7f647415c030 2024-09-19T05:42:55.481 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:55.481 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:42:55.481 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:42:55.482 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:42:55.483 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:42:55.484 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.485 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:42:55.486 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:42:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:42:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:42:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:42:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:42:55.488 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:42:55.489 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.490 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:42:55.491 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:42:55.492 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:42:55.493 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:42:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:42:55.495 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:42:55.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 -- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64580678c0 msgr2=0x7f6458069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64580678c0 0x7f6458069d80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6470005c10 tx=0x7f6470009040 comp rx=0 tx=0).stop 2024-09-19T05:42:55.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 -- 172.21.15.67:0/115810658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f647415c030 msgr2=0x7f647409d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f647415c030 0x7f647409d750 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f646c01a010 tx=0x7f646c019180 comp rx=0 tx=0).stop 2024-09-19T05:42:55.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 -- 172.21.15.67:0/115810658 shutdown_connections 2024-09-19T05:42:55.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f647415c030 0x7f647409d750 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64740b3510 0x7f647415e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64580678c0 0x7f6458069d80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 --2- 172.21.15.67:0/115810658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647406dde0 0x7f6474150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 -- 172.21.15.67:0/115810658 >> 172.21.15.67:0/115810658 conn(0x7f64740d0080 msgr2=0x7f64740d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:55.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 -- 172.21.15.67:0/115810658 shutdown_connections 2024-09-19T05:42:55.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.486+0000 7f647c622640 1 -- 172.21.15.67:0/115810658 wait complete. 2024-09-19T05:42:55.501 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:42:55.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff959b49640 1 Processor -- start 2024-09-19T05:42:55.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff959b49640 1 -- start start 2024-09-19T05:42:55.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff959b49640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff95415c030 0x7ff95406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff959b49640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff95406f460 0x7ff95406f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff959b49640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff95406e3c0 con 0x7ff95415d1d0 2024-09-19T05:42:55.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff959b49640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff95406e6a0 con 0x7ff95406f460 2024-09-19T05:42:55.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff959b49640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff95406e980 con 0x7ff95415c030 2024-09-19T05:42:55.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff953fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff95406f460 0x7ff95406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff94affd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff95415d1d0 0x7ff9540b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59172/0 (socket says 172.21.15.67:59172) 2024-09-19T05:42:55.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff94affd640 1 -- 172.21.15.67:0/1927871803 learned_addr learned my addr 172.21.15.67:0/1927871803 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:55.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff9537fe640 1 --2- 172.21.15.67:0/1927871803 >> v2:172.21.15.97:3300/0 conn(0x7ff95415c030 0x7ff95406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff953fff640 1 -- 172.21.15.67:0/1927871803 >> v2:172.21.15.97:3300/0 conn(0x7ff95415c030 msgr2=0x7ff95406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:55.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff953fff640 1 --2- 172.21.15.67:0/1927871803 >> v2:172.21.15.97:3300/0 conn(0x7ff95415c030 0x7ff95406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff953fff640 1 -- 172.21.15.67:0/1927871803 >> v1:172.21.15.67:6789/0 conn(0x7ff95415d1d0 legacy=0x7ff9540b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff953fff640 1 -- 172.21.15.67:0/1927871803 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95406ec60 con 0x7ff95406f460 2024-09-19T05:42:55.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.630+0000 7ff952ffd640 1 -- 172.21.15.67:0/1927871803 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425151579 0 0) 0x7ff95406e3c0 con 0x7ff95415d1d0 2024-09-19T05:42:55.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff953fff640 1 --2- 172.21.15.67:0/1927871803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95406f460 0x7ff95406f870 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ff954070390 tx=0x7ff94c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8697ccbd95a87ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:55.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff952ffd640 1 -- 172.21.15.67:0/1927871803 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c0b2070 con 0x7ff95406f460 2024-09-19T05:42:55.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff952ffd640 1 -- 172.21.15.67:0/1927871803 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94c0a5840 con 0x7ff95406f460 2024-09-19T05:42:55.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff952ffd640 1 -- 172.21.15.67:0/1927871803 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c0a5c10 con 0x7ff95406f460 2024-09-19T05:42:55.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff959b49640 1 -- 172.21.15.67:0/1927871803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95406f460 msgr2=0x7ff95406f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff959b49640 1 --2- 172.21.15.67:0/1927871803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95406f460 0x7ff95406f870 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ff954070390 tx=0x7ff94c01c930 comp rx=0 tx=0).stop 2024-09-19T05:42:55.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff959b49640 1 -- 172.21.15.67:0/1927871803 shutdown_connections 2024-09-19T05:42:55.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff959b49640 1 --2- 172.21.15.67:0/1927871803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95406f460 0x7ff95406f870 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff959b49640 1 --2- 172.21.15.67:0/1927871803 >> v2:172.21.15.97:3300/0 conn(0x7ff95415c030 0x7ff95406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff959b49640 1 -- 172.21.15.67:0/1927871803 >> 172.21.15.67:0/1927871803 conn(0x7ff9540d0080 msgr2=0x7ff9540d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:55.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff959b49640 1 -- 172.21.15.67:0/1927871803 shutdown_connections 2024-09-19T05:42:55.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff959b49640 1 -- 172.21.15.67:0/1927871803 wait complete. 2024-09-19T05:42:55.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff959b49640 1 Processor -- start 2024-09-19T05:42:55.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.634+0000 7ff959b49640 1 -- start start 2024-09-19T05:42:55.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff959b49640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95406f460 0x7ff9541497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff959b49640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff95415c030 0x7ff954155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff959b49640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95415d1d0 0x7ff95415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff959b49640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff95415c590 con 0x7ff95415d1d0 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff959b49640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff95415c410 con 0x7ff95415c030 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff959b49640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff9541690e0 con 0x7ff95406f460 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff953fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95415d1d0 0x7ff95415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff953fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95415d1d0 0x7ff95415a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34218/0 (socket says 172.21.15.67:34218) 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff953fff640 1 -- 172.21.15.67:0/3365745484 learned_addr learned my addr 172.21.15.67:0/3365745484 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff9537fe640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95406f460 0x7ff9541497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff94affd640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff95415c030 0x7ff954155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff953fff640 1 -- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95406f460 msgr2=0x7ff9541497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff953fff640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95406f460 0x7ff9541497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff953fff640 1 -- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff95415c030 msgr2=0x7ff954155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff953fff640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff95415c030 0x7ff954155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff953fff640 1 -- 172.21.15.67:0/3365745484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95415cd60 con 0x7ff95415d1d0 2024-09-19T05:42:55.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff953fff640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95415d1d0 0x7ff95415a7b0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ff94c019540 tx=0x7ff94c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:55.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff950ff9640 1 -- 172.21.15.67:0/3365745484 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c0b2050 con 0x7ff95415d1d0 2024-09-19T05:42:55.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff950ff9640 1 -- 172.21.15.67:0/3365745484 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94c0b3040 con 0x7ff95415d1d0 2024-09-19T05:42:55.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff959b49640 1 -- 172.21.15.67:0/3365745484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9541536b0 con 0x7ff95415d1d0 2024-09-19T05:42:55.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff950ff9640 1 -- 172.21.15.67:0/3365745484 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c0ad650 con 0x7ff95415d1d0 2024-09-19T05:42:55.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff959b49640 1 -- 172.21.15.67:0/3365745484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff954156be0 con 0x7ff95415d1d0 2024-09-19T05:42:55.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff959b49640 1 -- 172.21.15.67:0/3365745484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff954153880 con 0x7ff95415d1d0 2024-09-19T05:42:55.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff950ff9640 1 -- 172.21.15.67:0/3365745484 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff94c0c0020 con 0x7ff95415d1d0 2024-09-19T05:42:55.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff950ff9640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff9340678c0 0x7ff934069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff950ff9640 1 -- 172.21.15.67:0/3365745484 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5249+0+0 (secure 0 0 0) 0x7ff94c120400 con 0x7ff95415d1d0 2024-09-19T05:42:55.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.638+0000 7ff9537fe640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff9340678c0 0x7ff934069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.642+0000 7ff9537fe640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff9340678c0 0x7ff934069d80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff944009af0 tx=0x7ff944008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:55.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.642+0000 7ff950ff9640 1 -- 172.21.15.67:0/3365745484 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff94c016520 con 0x7ff95415d1d0 2024-09-19T05:42:55.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.806+0000 7ff959b49640 1 -- 172.21.15.67:0/3365745484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff95406f870 con 0x7ff95415d1d0 2024-09-19T05:42:55.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.806+0000 7ff950ff9640 1 -- 172.21.15.67:0/3365745484 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v128) ==== 84+0+65 (secure 0 0 0) 0x7ff94c0f1210 con 0x7ff95415d1d0 2024-09-19T05:42:55.805 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:55.806 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:42:55.806 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:42:55.806 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:42:55.806 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:42:55.806 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:42:55.806 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:42:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 -- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff9340678c0 msgr2=0x7ff934069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff9340678c0 0x7ff934069d80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff944009af0 tx=0x7ff944008040 comp rx=0 tx=0).stop 2024-09-19T05:42:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 -- 172.21.15.67:0/3365745484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95415d1d0 msgr2=0x7ff95415a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95415d1d0 0x7ff95415a7b0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ff94c019540 tx=0x7ff94c0196d0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 -- 172.21.15.67:0/3365745484 shutdown_connections 2024-09-19T05:42:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff95415d1d0 0x7ff95415a7b0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff95415c030 0x7ff954155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff9340678c0 0x7ff934069d80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 --2- 172.21.15.67:0/3365745484 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95406f460 0x7ff9541497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 -- 172.21.15.67:0/3365745484 >> 172.21.15.67:0/3365745484 conn(0x7ff9540d0080 msgr2=0x7ff9540b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:55.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 -- 172.21.15.67:0/3365745484 shutdown_connections 2024-09-19T05:42:55.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.810+0000 7ff959b49640 1 -- 172.21.15.67:0/3365745484 wait complete. 2024-09-19T05:42:55.823 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:42:55.823 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:42:55.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febb4da4640 1 Processor -- start 2024-09-19T05:42:55.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febb4da4640 1 -- start start 2024-09-19T05:42:55.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febb4da4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febb00cf5e0 0x7febb00d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febb4da4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7febb015c850 0x7febb006e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febb4da4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb015d030 con 0x7febb006eb40 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febb4da4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7febb006de90 con 0x7febb00cf5e0 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febb4da4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7febb006e170 con 0x7febb015c850 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febae59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febb00cf5e0 0x7febb00d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febae59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febb00cf5e0 0x7febb00d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46404/0 (socket says 172.21.15.67:46404) 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febae59c640 1 -- 172.21.15.67:0/508634545 learned_addr learned my addr 172.21.15.67:0/508634545 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febadd9b640 1 --2- 172.21.15.67:0/508634545 >> v2:172.21.15.97:3300/0 conn(0x7febb015c850 0x7febb006e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febae59c640 1 -- 172.21.15.67:0/508634545 >> v2:172.21.15.97:3300/0 conn(0x7febb015c850 msgr2=0x7febb006e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febae59c640 1 --2- 172.21.15.67:0/508634545 >> v2:172.21.15.97:3300/0 conn(0x7febb015c850 0x7febb006e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febae59c640 1 -- 172.21.15.67:0/508634545 >> v1:172.21.15.97:6789/0 conn(0x7febb006eb40 legacy=0x7febb015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:55.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.942+0000 7febae59c640 1 -- 172.21.15.67:0/508634545 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb015d310 con 0x7febb00cf5e0 2024-09-19T05:42:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febae59c640 1 --2- 172.21.15.67:0/508634545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 0x7febb00d0aa0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7febb015a380 tx=0x7feba001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8889ab31ea686a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febad59a640 1 -- 172.21.15.67:0/508634545 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba00aa430 con 0x7febb00cf5e0 2024-09-19T05:42:55.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febad59a640 1 -- 172.21.15.67:0/508634545 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba00af070 con 0x7febb00cf5e0 2024-09-19T05:42:55.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febad59a640 1 -- 172.21.15.67:0/508634545 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba00aa7f0 con 0x7febb00cf5e0 2024-09-19T05:42:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febb4da4640 1 -- 172.21.15.67:0/508634545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 msgr2=0x7febb00d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febb4da4640 1 --2- 172.21.15.67:0/508634545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 0x7febb00d0aa0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7febb015a380 tx=0x7feba001c4b0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febb4da4640 1 -- 172.21.15.67:0/508634545 shutdown_connections 2024-09-19T05:42:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febb4da4640 1 --2- 172.21.15.67:0/508634545 >> v2:172.21.15.97:3300/0 conn(0x7febb015c850 0x7febb006e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febb4da4640 1 --2- 172.21.15.67:0/508634545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 0x7febb00d0aa0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febb4da4640 1 -- 172.21.15.67:0/508634545 >> 172.21.15.67:0/508634545 conn(0x7febb006c0c0 msgr2=0x7febb006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febb4da4640 1 -- 172.21.15.67:0/508634545 shutdown_connections 2024-09-19T05:42:55.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.946+0000 7febb4da4640 1 -- 172.21.15.67:0/508634545 wait complete. 2024-09-19T05:42:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 Processor -- start 2024-09-19T05:42:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 -- start start 2024-09-19T05:42:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febb006eb40 0x7febb015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 0x7febb015ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb015c850 0x7febb014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7febb0169130 con 0x7febb00cf5e0 2024-09-19T05:42:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7febb0168fb0 con 0x7febb015c850 2024-09-19T05:42:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7febb01692b0 con 0x7febb006eb40 2024-09-19T05:42:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febadd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 0x7febb015ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febadd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 0x7febb015ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46418/0 (socket says 172.21.15.67:46418) 2024-09-19T05:42:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febadd9b640 1 -- 172.21.15.67:0/926381370 learned_addr learned my addr 172.21.15.67:0/926381370 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febaed9d640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb015c850 0x7febb014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febae59c640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febb006eb40 0x7febb015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febadd9b640 1 -- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febb006eb40 msgr2=0x7febb015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febadd9b640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febb006eb40 0x7febb015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febadd9b640 1 -- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb015c850 msgr2=0x7febb014bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febadd9b640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb015c850 0x7febb014bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febadd9b640 1 -- 172.21.15.67:0/926381370 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb015f340 con 0x7febb00cf5e0 2024-09-19T05:42:55.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febadd9b640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 0x7febb015ee00 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7feba400d5f0 tx=0x7feba400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:55.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7feb9effd640 1 -- 172.21.15.67:0/926381370 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40125f0 con 0x7febb00cf5e0 2024-09-19T05:42:55.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7feb9effd640 1 -- 172.21.15.67:0/926381370 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba4019070 con 0x7febb00cf5e0 2024-09-19T05:42:55.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 -- 172.21.15.67:0/926381370 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb015e9d0 con 0x7febb00cf5e0 2024-09-19T05:42:55.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7feb9effd640 1 -- 172.21.15.67:0/926381370 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40129d0 con 0x7febb00cf5e0 2024-09-19T05:42:55.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 -- 172.21.15.67:0/926381370 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb0151140 con 0x7febb00cf5e0 2024-09-19T05:42:55.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7febb4da4640 1 -- 172.21.15.67:0/926381370 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb00d0aa0 con 0x7febb00cf5e0 2024-09-19T05:42:55.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.950+0000 7feb9effd640 1 -- 172.21.15.67:0/926381370 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feba4012b70 con 0x7febb00cf5e0 2024-09-19T05:42:55.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.954+0000 7feb9effd640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb900678c0 0x7feb90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.954+0000 7feb9effd640 1 -- 172.21.15.67:0/926381370 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5249+0+0 (secure 0 0 0) 0x7feba4085fa0 con 0x7febb00cf5e0 2024-09-19T05:42:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.954+0000 7febae59c640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb900678c0 0x7feb90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:55.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.954+0000 7febae59c640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb900678c0 0x7feb90069d80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7feba00ae000 tx=0x7feba00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:55.958+0000 7feb9effd640 1 -- 172.21.15.67:0/926381370 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7feba4056ca0 con 0x7febb00cf5e0 2024-09-19T05:42:56.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:56.114+0000 7febb4da4640 1 -- 172.21.15.67:0/926381370 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7febb006c6b0 con 0x7febb00cf5e0 2024-09-19T05:42:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.094+0000 7feb9effd640 1 -- 172.21.15.67:0/926381370 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v129) ==== 138+0+0 (secure 0 0 0) 0x7feba40565a0 con 0x7febb00cf5e0 2024-09-19T05:42:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:42:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 -- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb900678c0 msgr2=0x7feb90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb900678c0 0x7feb90069d80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7feba00ae000 tx=0x7feba00a7000 comp rx=0 tx=0).stop 2024-09-19T05:42:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 -- 172.21.15.67:0/926381370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 msgr2=0x7febb015ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 0x7febb015ee00 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7feba400d5f0 tx=0x7feba400dab0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 -- 172.21.15.67:0/926381370 shutdown_connections 2024-09-19T05:42:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb015c850 0x7febb014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb00cf5e0 0x7febb015ee00 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb900678c0 0x7feb90069d80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 --2- 172.21.15.67:0/926381370 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febb006eb40 0x7febb015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 -- 172.21.15.67:0/926381370 >> 172.21.15.67:0/926381370 conn(0x7febb006c0c0 msgr2=0x7febb015d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 -- 172.21.15.67:0/926381370 shutdown_connections 2024-09-19T05:42:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.098+0000 7febb4da4640 1 -- 172.21.15.67:0/926381370 wait complete. 2024-09-19T05:42:57.127 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:42:57.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f7a56640 1 Processor -- start 2024-09-19T05:42:57.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f7a56640 1 -- start start 2024-09-19T05:42:57.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f7a56640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f00af3a0 0x7f87f015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:57.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f7a56640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f00ad840 con 0x7f87f006ffd0 2024-09-19T05:42:57.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f7a56640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f015a040 con 0x7f87f0159c60 2024-09-19T05:42:57.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f7a56640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f87f015d460 con 0x7f87f00af3a0 2024-09-19T05:42:57.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f4ff1640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f87f006ffd0 0x7f87f00aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34844/0 (socket says 172.21.15.67:34844) 2024-09-19T05:42:57.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f4ff1640 1 -- 172.21.15.67:0/3766492135 learned_addr learned my addr 172.21.15.67:0/3766492135 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:57.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f5ff3640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f00af3a0 0x7f87f015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:57.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1586065540 0 0) 0x7f87f00ad840 con 0x7f87f006ffd0 2024-09-19T05:42:57.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87dc003530 con 0x7f87f006ffd0 2024-09-19T05:42:57.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3171491797 0 0) 0x7f87dc003530 con 0x7f87f006ffd0 2024-09-19T05:42:57.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f00af3a0 msgr2=0x7f87f015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:57.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f00af3a0 0x7f87f015fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 >> v1:172.21.15.97:6789/0 conn(0x7f87f0159c60 legacy=0x7f87f00ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:57.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f015c850 con 0x7f87f006ffd0 2024-09-19T05:42:57.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f87e0001680 con 0x7f87f006ffd0 2024-09-19T05:42:57.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 >> v1:172.21.15.67:6789/0 conn(0x7f87f006ffd0 legacy=0x7f87f00aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:57.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87dc0039f0 0x7f87dc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:57.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87dc004810 0x7f87dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:57.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f00af3a0 0x7f87dc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:57.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f87f015d460 con 0x7f87dc0039f0 2024-09-19T05:42:57.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc00bb90 con 0x7f87dc004810 2024-09-19T05:42:57.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f87dc00bd90 con 0x7f87f00af3a0 2024-09-19T05:42:57.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f57f2640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87dc0039f0 0x7f87dc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:57.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f4ff1640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87dc004810 0x7f87dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:57.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f5ff3640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f00af3a0 0x7f87dc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:57.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f57f2640 1 -- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f00af3a0 msgr2=0x7f87dc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:57.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f57f2640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f00af3a0 0x7f87dc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f57f2640 1 -- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87dc004810 msgr2=0x7f87dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:57.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f57f2640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87dc004810 0x7f87dc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.266+0000 7f87f57f2640 1 -- 172.21.15.67:0/3766492135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87dc003530 con 0x7f87dc0039f0 2024-09-19T05:42:57.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87f57f2640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87dc0039f0 0x7f87dc003e30 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f87ec001780 tx=0x7f87ec01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ca64c6ec134966 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0013a0 con 0x7f87dc0039f0 2024-09-19T05:42:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ec0052f0 con 0x7f87dc0039f0 2024-09-19T05:42:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87e7fff640 1 -- 172.21.15.67:0/3766492135 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec003840 con 0x7f87dc0039f0 2024-09-19T05:42:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87f7a56640 1 -- 172.21.15.67:0/3766492135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87dc0039f0 msgr2=0x7f87dc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87f7a56640 1 --2- 172.21.15.67:0/3766492135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87dc0039f0 0x7f87dc003e30 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f87ec001780 tx=0x7f87ec01c3f0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87f5ff3640 1 -- 172.21.15.67:0/3766492135 reap_dead start 2024-09-19T05:42:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87f7a56640 1 -- 172.21.15.67:0/3766492135 shutdown_connections 2024-09-19T05:42:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87f7a56640 1 -- 172.21.15.67:0/3766492135 >> 172.21.15.67:0/3766492135 conn(0x7f87f00b1e50 msgr2=0x7f87f00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87f7a56640 1 -- 172.21.15.67:0/3766492135 shutdown_connections 2024-09-19T05:42:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87f7a56640 1 -- 172.21.15.67:0/3766492135 wait complete. 2024-09-19T05:42:57.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87f7a56640 1 Processor -- start 2024-09-19T05:42:57.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.270+0000 7f87f7a56640 1 -- start start 2024-09-19T05:42:57.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f7a56640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87dc0039f0 0x7f87f0154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:57.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f7a56640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87f0154a80 0x7f87f01526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:57.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f7a56640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f0147140 0x7f87f0152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:57.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f7a56640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f87f0160730 con 0x7f87f0154a80 2024-09-19T05:42:57.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f7a56640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01605b0 con 0x7f87dc0039f0 2024-09-19T05:42:57.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f7a56640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f87f01608b0 con 0x7f87f0147140 2024-09-19T05:42:57.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f4ff1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87f0154a80 0x7f87f01526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:57.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f4ff1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87f0154a80 0x7f87f01526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46442/0 (socket says 172.21.15.67:46442) 2024-09-19T05:42:57.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f4ff1640 1 -- 172.21.15.67:0/3517950842 learned_addr learned my addr 172.21.15.67:0/3517950842 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f5ff3640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f0147140 0x7f87f0152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f57f2640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87dc0039f0 0x7f87f0154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f4ff1640 1 -- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f0147140 msgr2=0x7f87f0152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f4ff1640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f0147140 0x7f87f0152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f4ff1640 1 -- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87dc0039f0 msgr2=0x7f87f0154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f4ff1640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87dc0039f0 0x7f87f0154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f4ff1640 1 -- 172.21.15.67:0/3517950842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f0151f10 con 0x7f87f0154a80 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f4ff1640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87f0154a80 0x7f87f01526d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f87e000e810 tx=0x7f87e000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87e5ffb640 1 -- 172.21.15.67:0/3517950842 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0019070 con 0x7f87f0154a80 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87e5ffb640 1 -- 172.21.15.67:0/3517950842 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e000c870 con 0x7f87f0154a80 2024-09-19T05:42:57.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f7a56640 1 -- 172.21.15.67:0/3517950842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f01521f0 con 0x7f87f0154a80 2024-09-19T05:42:57.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87e5ffb640 1 -- 172.21.15.67:0/3517950842 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e000cc60 con 0x7f87f0154a80 2024-09-19T05:42:57.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f7a56640 1 -- 172.21.15.67:0/3517950842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f00725f0 con 0x7f87f0154a80 2024-09-19T05:42:57.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87f7a56640 1 -- 172.21.15.67:0/3517950842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f00727f0 con 0x7f87f0154a80 2024-09-19T05:42:57.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.274+0000 7f87e5ffb640 1 -- 172.21.15.67:0/3517950842 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87e001c070 con 0x7f87f0154a80 2024-09-19T05:42:57.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.278+0000 7f87e5ffb640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87d40678c0 0x7f87d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:57.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.278+0000 7f87e5ffb640 1 -- 172.21.15.67:0/3517950842 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5619+0+0 (secure 0 0 0) 0x7f87e0085650 con 0x7f87f0154a80 2024-09-19T05:42:57.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.278+0000 7f87f57f2640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87d40678c0 0x7f87d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:57.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.278+0000 7f87f57f2640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87d40678c0 0x7f87d4069d80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f87ec001750 tx=0x7f87ec0011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:57.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.278+0000 7f87e5ffb640 1 -- 172.21.15.67:0/3517950842 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f87f00727f0 con 0x7f87f0154a80 2024-09-19T05:42:57.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:57.438+0000 7f87f7a56640 1 -- 172.21.15.67:0/3517950842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f87f006ccd0 con 0x7f87f0154a80 2024-09-19T05:42:58.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.106+0000 7f87e5ffb640 1 -- 172.21.15.67:0/3517950842 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v130) ==== 170+0+0 (secure 0 0 0) 0x7f87e0023020 con 0x7f87f0154a80 2024-09-19T05:42:58.104 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:42:58.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 -- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87d40678c0 msgr2=0x7f87d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:58.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87d40678c0 0x7f87d4069d80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f87ec001750 tx=0x7f87ec0011a0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 -- 172.21.15.67:0/3517950842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87f0154a80 msgr2=0x7f87f01526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:58.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87f0154a80 0x7f87f01526d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f87e000e810 tx=0x7f87e000ecd0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 -- 172.21.15.67:0/3517950842 shutdown_connections 2024-09-19T05:42:58.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87d40678c0 0x7f87d4069d80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87f0147140 0x7f87f0152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87f0154a80 0x7f87f01526d0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 --2- 172.21.15.67:0/3517950842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87dc0039f0 0x7f87f0154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 -- 172.21.15.67:0/3517950842 >> 172.21.15.67:0/3517950842 conn(0x7f87f00b1e50 msgr2=0x7f87f015b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:58.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 -- 172.21.15.67:0/3517950842 shutdown_connections 2024-09-19T05:42:58.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.110+0000 7f87f7a56640 1 -- 172.21.15.67:0/3517950842 wait complete. 2024-09-19T05:42:58.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:42:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.278+0000 7fdaa4c48640 1 Processor -- start 2024-09-19T05:42:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.278+0000 7fdaa4c48640 1 -- start start 2024-09-19T05:42:58.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fdaa4c48640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdaa015f950 0x7fdaa00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:58.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fdaa4c48640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdaa00b3750 0x7fdaa00d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:58.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fdaa4c48640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa00cea90 con 0x7fdaa00d0c10 2024-09-19T05:42:58.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fdaa4c48640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa00af1a0 con 0x7fdaa015f950 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fdaa4c48640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa00ce110 con 0x7fdaa00b3750 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdaa015f950 0x7fdaa00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdaa015f950 0x7fdaa00ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46456/0 (socket says 172.21.15.67:46456) 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9e59c640 1 -- 172.21.15.67:0/2685495274 learned_addr learned my addr 172.21.15.67:0/2685495274 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9ed9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdaa00d0c10 0x7fdaa009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34852/0 (socket says 172.21.15.67:34852) 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda97fff640 1 --2- 172.21.15.67:0/2685495274 >> v2:172.21.15.97:3300/0 conn(0x7fdaa00b3750 0x7fdaa00d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9e59c640 1 -- 172.21.15.67:0/2685495274 >> v2:172.21.15.97:3300/0 conn(0x7fdaa00b3750 msgr2=0x7fdaa00d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9e59c640 1 --2- 172.21.15.67:0/2685495274 >> v2:172.21.15.97:3300/0 conn(0x7fdaa00b3750 0x7fdaa00d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9e59c640 1 -- 172.21.15.67:0/2685495274 >> v1:172.21.15.67:6789/0 conn(0x7fdaa00d0c10 legacy=0x7fdaa009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9e59c640 1 -- 172.21.15.67:0/2685495274 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa00cd7e0 con 0x7fdaa015f950 2024-09-19T05:42:58.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda97fff640 1 --2- 172.21.15.67:0/2685495274 >> v2:172.21.15.97:3300/0 conn(0x7fdaa00b3750 0x7fdaa00d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:58.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9e59c640 1 --2- 172.21.15.67:0/2685495274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa015f950 0x7fdaa00ce4b0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0073390 tx=0x7fda9001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40380a633d84f216 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:58.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9dd9b640 1 -- 172.21.15.67:0/2685495274 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda900b0070 con 0x7fdaa015f950 2024-09-19T05:42:58.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9dd9b640 1 -- 172.21.15.67:0/2685495274 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda900ab600 con 0x7fdaa015f950 2024-09-19T05:42:58.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.282+0000 7fda9dd9b640 1 -- 172.21.15.67:0/2685495274 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda900ab9d0 con 0x7fdaa015f950 2024-09-19T05:42:58.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- 172.21.15.67:0/2685495274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa015f950 msgr2=0x7fdaa00ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:58.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 --2- 172.21.15.67:0/2685495274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa015f950 0x7fdaa00ce4b0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0073390 tx=0x7fda9001c520 comp rx=0 tx=0).stop 2024-09-19T05:42:58.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- 172.21.15.67:0/2685495274 shutdown_connections 2024-09-19T05:42:58.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 --2- 172.21.15.67:0/2685495274 >> v2:172.21.15.97:3300/0 conn(0x7fdaa00b3750 0x7fdaa00d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 --2- 172.21.15.67:0/2685495274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa015f950 0x7fdaa00ce4b0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- 172.21.15.67:0/2685495274 >> 172.21.15.67:0/2685495274 conn(0x7fdaa00d22f0 msgr2=0x7fdaa00d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:58.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- 172.21.15.67:0/2685495274 shutdown_connections 2024-09-19T05:42:58.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- 172.21.15.67:0/2685495274 wait complete. 2024-09-19T05:42:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 Processor -- start 2024-09-19T05:42:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- start start 2024-09-19T05:42:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa00b3750 0x7fdaa009f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaa00d0c10 0x7fdaa009d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdaa015f950 0x7fdaa00b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa015feb0 con 0x7fdaa00b3750 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa015fd30 con 0x7fdaa00d0c10 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa00b2e50 con 0x7fdaa015f950 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa00b3750 0x7fdaa009f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa00b3750 0x7fdaa009f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46468/0 (socket says 172.21.15.67:46468) 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9e59c640 1 -- 172.21.15.67:0/494731075 learned_addr learned my addr 172.21.15.67:0/494731075 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda97fff640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaa00d0c10 0x7fdaa009d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9ed9d640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdaa015f950 0x7fdaa00b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9e59c640 1 -- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdaa015f950 msgr2=0x7fdaa00b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9e59c640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdaa015f950 0x7fdaa00b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9e59c640 1 -- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaa00d0c10 msgr2=0x7fdaa009d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:58.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9e59c640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaa00d0c10 0x7fdaa009d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:58.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9e59c640 1 -- 172.21.15.67:0/494731075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa009f830 con 0x7fdaa00b3750 2024-09-19T05:42:58.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9ed9d640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdaa015f950 0x7fdaa00b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:58.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda9e59c640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa00b3750 0x7fdaa009f230 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fda900ae040 tx=0x7fda900192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:58.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda96ffd640 1 -- 172.21.15.67:0/494731075 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda900bb070 con 0x7fdaa00b3750 2024-09-19T05:42:58.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda96ffd640 1 -- 172.21.15.67:0/494731075 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda900b6650 con 0x7fdaa00b3750 2024-09-19T05:42:58.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fda96ffd640 1 -- 172.21.15.67:0/494731075 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda900b0040 con 0x7fdaa00b3750 2024-09-19T05:42:58.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- 172.21.15.67:0/494731075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa009fb10 con 0x7fdaa00b3750 2024-09-19T05:42:58.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.286+0000 7fdaa4c48640 1 -- 172.21.15.67:0/494731075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa00a00d0 con 0x7fdaa00b3750 2024-09-19T05:42:58.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.290+0000 7fdaa4c48640 1 -- 172.21.15.67:0/494731075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa00d06d0 con 0x7fdaa00b3750 2024-09-19T05:42:58.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.290+0000 7fda96ffd640 1 -- 172.21.15.67:0/494731075 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda900be070 con 0x7fdaa00b3750 2024-09-19T05:42:58.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.290+0000 7fda96ffd640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fda800678f0 0x7fda80069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:58.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.290+0000 7fda96ffd640 1 -- 172.21.15.67:0/494731075 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 6001+0+0 (secure 0 0 0) 0x7fda9011f430 con 0x7fdaa00b3750 2024-09-19T05:42:58.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.290+0000 7fda97fff640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fda800678f0 0x7fda80069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:58.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.290+0000 7fda97fff640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fda800678f0 0x7fda80069db0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdaa009c620 tx=0x7fda88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:58.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.294+0000 7fda96ffd640 1 -- 172.21.15.67:0/494731075 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fda90016110 con 0x7fdaa00b3750 2024-09-19T05:42:58.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:58.494+0000 7fdaa4c48640 1 -- 172.21.15.67:0/494731075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fdaa00cd2f0 con 0x7fdaa00b3750 2024-09-19T05:42:59.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.106+0000 7fda96ffd640 1 -- 172.21.15.67:0/494731075 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v88) ==== 174+0+0 (secure 0 0 0) 0x7fda900efe40 con 0x7fdaa00b3750 2024-09-19T05:42:59.107 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 17 and data pool 18 2024-09-19T05:42:59.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 -- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fda800678f0 msgr2=0x7fda80069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fda800678f0 0x7fda80069db0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdaa009c620 tx=0x7fda88008040 comp rx=0 tx=0).stop 2024-09-19T05:42:59.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 -- 172.21.15.67:0/494731075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa00b3750 msgr2=0x7fdaa009f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa00b3750 0x7fdaa009f230 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fda900ae040 tx=0x7fda900192c0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 -- 172.21.15.67:0/494731075 shutdown_connections 2024-09-19T05:42:59.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fda800678f0 0x7fda80069db0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdaa015f950 0x7fdaa00b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaa00d0c10 0x7fdaa009d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 --2- 172.21.15.67:0/494731075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaa00b3750 0x7fdaa009f230 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 -- 172.21.15.67:0/494731075 >> 172.21.15.67:0/494731075 conn(0x7fdaa00d22f0 msgr2=0x7fdaa00cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:59.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 -- 172.21.15.67:0/494731075 shutdown_connections 2024-09-19T05:42:59.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.114+0000 7fdaa4c48640 1 -- 172.21.15.67:0/494731075 wait complete. 2024-09-19T05:42:59.155 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:42:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.274+0000 7f59ab534640 1 Processor -- start 2024-09-19T05:42:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.274+0000 7f59ab534640 1 -- start start 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f59a40d0430 0x7f59a41613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f59a4161920 0x7f59a415e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a40d0bc0 con 0x7f59a415e550 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f59a40d0ea0 con 0x7f59a40d0430 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f59a40d1180 con 0x7f59a4161920 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a8acf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f59a40d0430 0x7f59a41613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a8acf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f59a40d0430 0x7f59a41613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46482/0 (socket says 172.21.15.67:46482) 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a8acf640 1 -- 172.21.15.67:0/4116107037 learned_addr learned my addr 172.21.15.67:0/4116107037 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a9ad1640 1 --2- 172.21.15.67:0/4116107037 >> v2:172.21.15.97:3300/0 conn(0x7f59a4161920 0x7f59a415e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a8acf640 1 -- 172.21.15.67:0/4116107037 >> v2:172.21.15.97:3300/0 conn(0x7f59a4161920 msgr2=0x7f59a415e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:59.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a8acf640 1 --2- 172.21.15.67:0/4116107037 >> v2:172.21.15.97:3300/0 conn(0x7f59a4161920 0x7f59a415e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a8acf640 1 -- 172.21.15.67:0/4116107037 >> v1:172.21.15.97:6789/0 conn(0x7f59a415e550 legacy=0x7f59a409b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:59.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a8acf640 1 -- 172.21.15.67:0/4116107037 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a40d1460 con 0x7f59a40d0430 2024-09-19T05:42:59.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a9ad1640 1 --2- 172.21.15.67:0/4116107037 >> v2:172.21.15.97:3300/0 conn(0x7f59a4161920 0x7f59a415e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:59.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a8acf640 1 --2- 172.21.15.67:0/4116107037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a40d0430 0x7f59a41613e0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f59a406ef80 tx=0x7f599c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedf48ae8ebfb2a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:59.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a3fff640 1 -- 172.21.15.67:0/4116107037 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c0a5820 con 0x7f59a40d0430 2024-09-19T05:42:59.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a3fff640 1 -- 172.21.15.67:0/4116107037 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c0a59c0 con 0x7f59a40d0430 2024-09-19T05:42:59.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59a3fff640 1 -- 172.21.15.67:0/4116107037 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c0a5d90 con 0x7f59a40d0430 2024-09-19T05:42:59.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 -- 172.21.15.67:0/4116107037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a40d0430 msgr2=0x7f59a41613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 --2- 172.21.15.67:0/4116107037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a40d0430 0x7f59a41613e0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f59a406ef80 tx=0x7f599c01c980 comp rx=0 tx=0).stop 2024-09-19T05:42:59.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 -- 172.21.15.67:0/4116107037 shutdown_connections 2024-09-19T05:42:59.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 --2- 172.21.15.67:0/4116107037 >> v2:172.21.15.97:3300/0 conn(0x7f59a4161920 0x7f59a415e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 --2- 172.21.15.67:0/4116107037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a40d0430 0x7f59a41613e0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 -- 172.21.15.67:0/4116107037 >> 172.21.15.67:0/4116107037 conn(0x7f59a40b3d90 msgr2=0x7f59a40b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:59.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.278+0000 7f59ab534640 1 -- 172.21.15.67:0/4116107037 shutdown_connections 2024-09-19T05:42:59.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 -- 172.21.15.67:0/4116107037 wait complete. 2024-09-19T05:42:59.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 Processor -- start 2024-09-19T05:42:59.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 -- start start 2024-09-19T05:42:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a40d0430 0x7f59a40c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59a415e550 0x7f59a4156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a4161920 0x7f59a40cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f59a4161e80 con 0x7f59a4161920 2024-09-19T05:42:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f59a4161d00 con 0x7f59a40d0430 2024-09-19T05:42:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f59a415f280 con 0x7f59a415e550 2024-09-19T05:42:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a9ad1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a4161920 0x7f59a40cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a9ad1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a4161920 0x7f59a40cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46494/0 (socket says 172.21.15.67:46494) 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a9ad1640 1 -- 172.21.15.67:0/1272150629 learned_addr learned my addr 172.21.15.67:0/1272150629 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a92d0640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a40d0430 0x7f59a40c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a8acf640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59a415e550 0x7f59a4156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a9ad1640 1 -- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59a415e550 msgr2=0x7f59a4156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a9ad1640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59a415e550 0x7f59a4156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a9ad1640 1 -- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a40d0430 msgr2=0x7f59a40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a9ad1640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a40d0430 0x7f59a40c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a9ad1640 1 -- 172.21.15.67:0/1272150629 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a40cbc60 con 0x7f59a4161920 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a92d0640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a40d0430 0x7f59a40c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a8acf640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59a415e550 0x7f59a4156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a9ad1640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a4161920 0x7f59a40cb510 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f598c00c7f0 tx=0x7f598c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a1ffb640 1 -- 172.21.15.67:0/1272150629 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c015020 con 0x7f59a4161920 2024-09-19T05:42:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a1ffb640 1 -- 172.21.15.67:0/1272150629 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598c004250 con 0x7f59a4161920 2024-09-19T05:42:59.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 -- 172.21.15.67:0/1272150629 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a40cbf40 con 0x7f59a4161920 2024-09-19T05:42:59.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59a1ffb640 1 -- 172.21.15.67:0/1272150629 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c003620 con 0x7f59a4161920 2024-09-19T05:42:59.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 -- 172.21.15.67:0/1272150629 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a40afa80 con 0x7f59a4161920 2024-09-19T05:42:59.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.282+0000 7f59ab534640 1 -- 172.21.15.67:0/1272150629 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a40b50d0 con 0x7f59a4161920 2024-09-19T05:42:59.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.286+0000 7f59a1ffb640 1 -- 172.21.15.67:0/1272150629 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f598c018020 con 0x7f59a4161920 2024-09-19T05:42:59.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.286+0000 7f59a1ffb640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59840678c0 0x7f5984069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.286+0000 7f59a1ffb640 1 -- 172.21.15.67:0/1272150629 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f598c085dc0 con 0x7f59a4161920 2024-09-19T05:42:59.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.286+0000 7f59a92d0640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59840678c0 0x7f5984069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.286+0000 7f59a92d0640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59840678c0 0x7f5984069d80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f59a415b7a0 tx=0x7f5994009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:59.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.290+0000 7f59a1ffb640 1 -- 172.21.15.67:0/1272150629 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f598c01f030 con 0x7f59a4161920 2024-09-19T05:42:59.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.454+0000 7f59ab534640 1 -- 172.21.15.67:0/1272150629 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59a40d1b00 con 0x7f59a4161920 2024-09-19T05:42:59.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.454+0000 7f59a1ffb640 1 -- 172.21.15.67:0/1272150629 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16989 (secure 0 0 0) 0x7f598c056800 con 0x7f59a4161920 2024-09-19T05:42:59.455 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:59.455 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":131,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:42:58.500091+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:42:56.158238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-19T05:42:57.484042+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:42:59.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 -- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59840678c0 msgr2=0x7f5984069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59840678c0 0x7f5984069d80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f59a415b7a0 tx=0x7f5994009040 comp rx=0 tx=0).stop 2024-09-19T05:42:59.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 -- 172.21.15.67:0/1272150629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a4161920 msgr2=0x7f59a40cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a4161920 0x7f59a40cb510 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f598c00c7f0 tx=0x7f598c00ccb0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 -- 172.21.15.67:0/1272150629 shutdown_connections 2024-09-19T05:42:59.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a4161920 0x7f59a40cb510 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59840678c0 0x7f5984069d80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59a415e550 0x7f59a4156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 --2- 172.21.15.67:0/1272150629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a40d0430 0x7f59a40c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 -- 172.21.15.67:0/1272150629 >> 172.21.15.67:0/1272150629 conn(0x7f59a40b3d90 msgr2=0x7f59a40b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:59.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 -- 172.21.15.67:0/1272150629 shutdown_connections 2024-09-19T05:42:59.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.458+0000 7f59ab534640 1 -- 172.21.15.67:0/1272150629 wait complete. 2024-09-19T05:42:59.476 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:42:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.598+0000 7f5c6437a640 1 Processor -- start 2024-09-19T05:42:59.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.598+0000 7f5c6437a640 1 -- start start 2024-09-19T05:42:59.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c6437a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5c5c161da0 0x7f5c5c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c6437a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c5c0d05d0 con 0x7f5c5c0d0160 2024-09-19T05:42:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c6437a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c5c0d4d40 con 0x7f5c5c0d0e80 2024-09-19T05:42:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c6437a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5c5c0d0840 con 0x7f5c5c161da0 2024-09-19T05:42:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c62116640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5c5c161da0 0x7f5c5c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c62116640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5c5c161da0 0x7f5c5c0d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46498/0 (socket says 172.21.15.67:46498) 2024-09-19T05:42:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c62116640 1 -- 172.21.15.67:0/1051984226 learned_addr learned my addr 172.21.15.67:0/1051984226 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c62917640 1 --1- 172.21.15.67:0/1051984226 >> v1:172.21.15.67:6789/0 conn(0x7f5c5c0d0160 0x7f5c5c0b48d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34858/0 (socket says 172.21.15.67:34858) 2024-09-19T05:42:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c62116640 1 -- 172.21.15.67:0/1051984226 >> v1:172.21.15.97:6789/0 conn(0x7f5c5c0d0e80 legacy=0x7f5c5c0b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c62116640 1 -- 172.21.15.67:0/1051984226 >> v1:172.21.15.67:6789/0 conn(0x7f5c5c0d0160 legacy=0x7f5c5c0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c62116640 1 -- 172.21.15.67:0/1051984226 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5c0d5020 con 0x7f5c5c161da0 2024-09-19T05:42:59.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c61114640 1 -- 172.21.15.67:0/1051984226 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2907998460 0 0) 0x7f5c5c0d05d0 con 0x7f5c5c0d0160 2024-09-19T05:42:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c62116640 1 --2- 172.21.15.67:0/1051984226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c161da0 0x7f5c5c0d1af0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009870 tx=0x7f5c5001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fd5bec0d490b9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c61114640 1 -- 172.21.15.67:0/1051984226 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c500ab650 con 0x7f5c5c161da0 2024-09-19T05:42:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c61114640 1 -- 172.21.15.67:0/1051984226 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c500b0070 con 0x7f5c5c161da0 2024-09-19T05:42:59.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c61114640 1 -- 172.21.15.67:0/1051984226 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c500aba10 con 0x7f5c5c161da0 2024-09-19T05:42:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c6437a640 1 -- 172.21.15.67:0/1051984226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c161da0 msgr2=0x7f5c5c0d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c6437a640 1 --2- 172.21.15.67:0/1051984226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c161da0 0x7f5c5c0d1af0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009870 tx=0x7f5c5001c560 comp rx=0 tx=0).stop 2024-09-19T05:42:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c6437a640 1 -- 172.21.15.67:0/1051984226 shutdown_connections 2024-09-19T05:42:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c6437a640 1 --2- 172.21.15.67:0/1051984226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c161da0 0x7f5c5c0d1af0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.602+0000 7f5c6437a640 1 -- 172.21.15.67:0/1051984226 >> 172.21.15.67:0/1051984226 conn(0x7f5c5c08bfc0 msgr2=0x7f5c5c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 -- 172.21.15.67:0/1051984226 shutdown_connections 2024-09-19T05:42:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 -- 172.21.15.67:0/1051984226 wait complete. 2024-09-19T05:42:59.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 Processor -- start 2024-09-19T05:42:59.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 -- start start 2024-09-19T05:42:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c0d0160 0x7f5c5c14e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c5c0d0e80 0x7f5c5c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c5c161da0 0x7f5c5c160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c162180 con 0x7f5c5c0d0160 2024-09-19T05:42:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c0b53f0 con 0x7f5c5c0d0e80 2024-09-19T05:42:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5c0d16a0 con 0x7f5c5c161da0 2024-09-19T05:42:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62116640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c0d0160 0x7f5c5c14e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62116640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c0d0160 0x7f5c5c14e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46508/0 (socket says 172.21.15.67:46508) 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62116640 1 -- 172.21.15.67:0/3215192585 learned_addr learned my addr 172.21.15.67:0/3215192585 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c61915640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c5c0d0e80 0x7f5c5c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62917640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c5c161da0 0x7f5c5c160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62116640 1 -- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c5c161da0 msgr2=0x7f5c5c160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62116640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c5c161da0 0x7f5c5c160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62116640 1 -- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c5c0d0e80 msgr2=0x7f5c5c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62116640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c5c0d0e80 0x7f5c5c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62116640 1 -- 172.21.15.67:0/3215192585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5c0cb770 con 0x7f5c5c0d0160 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62917640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c5c161da0 0x7f5c5c160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c62116640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c0d0160 0x7f5c5c14e2c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f5c500ad040 tx=0x7f5c5001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c4effd640 1 -- 172.21.15.67:0/3215192585 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c500abe60 con 0x7f5c5c0d0160 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c4effd640 1 -- 172.21.15.67:0/3215192585 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c500b4820 con 0x7f5c5c0d0160 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 -- 172.21.15.67:0/3215192585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5c0cba50 con 0x7f5c5c0d0160 2024-09-19T05:42:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c4effd640 1 -- 172.21.15.67:0/3215192585 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c500b4c10 con 0x7f5c5c0d0160 2024-09-19T05:42:59.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 -- 172.21.15.67:0/3215192585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5c0b1980 con 0x7f5c5c0d0160 2024-09-19T05:42:59.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.606+0000 7f5c6437a640 1 -- 172.21.15.67:0/3215192585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5c0b14c0 con 0x7f5c5c0d0160 2024-09-19T05:42:59.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.610+0000 7f5c4effd640 1 -- 172.21.15.67:0/3215192585 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c500c7390 con 0x7f5c5c0d0160 2024-09-19T05:42:59.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.610+0000 7f5c4effd640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5c400678c0 0x7f5c40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.610+0000 7f5c4effd640 1 -- 172.21.15.67:0/3215192585 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7f5c501206c0 con 0x7f5c5c0d0160 2024-09-19T05:42:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.610+0000 7f5c61915640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5c400678c0 0x7f5c40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.610+0000 7f5c61915640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5c400678c0 0x7f5c40069d80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c1610f0 tx=0x7f5c58009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:59.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.614+0000 7f5c4effd640 1 -- 172.21.15.67:0/3215192585 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5c5c0b14c0 con 0x7f5c5c0d0160 2024-09-19T05:42:59.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.778+0000 7f5c6437a640 1 -- 172.21.15.67:0/3215192585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c5c0d1af0 con 0x7f5c5c0d0160 2024-09-19T05:42:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c4effd640 1 -- 172.21.15.67:0/3215192585 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16989 (secure 0 0 0) 0x7f5c500c4060 con 0x7f5c5c0d0160 2024-09-19T05:42:59.780 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:42:59.780 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":131,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:42:58.500091+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:42:56.158238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-19T05:42:57.484042+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:42:59.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 -- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5c400678c0 msgr2=0x7f5c40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5c400678c0 0x7f5c40069d80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c1610f0 tx=0x7f5c58009040 comp rx=0 tx=0).stop 2024-09-19T05:42:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 -- 172.21.15.67:0/3215192585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c0d0160 msgr2=0x7f5c5c14e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c0d0160 0x7f5c5c14e2c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f5c500ad040 tx=0x7f5c5001ada0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 -- 172.21.15.67:0/3215192585 shutdown_connections 2024-09-19T05:42:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5c400678c0 0x7f5c40069d80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c5c161da0 0x7f5c5c160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c5c0d0e80 0x7f5c5c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 --2- 172.21.15.67:0/3215192585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c5c0d0160 0x7f5c5c14e2c0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 -- 172.21.15.67:0/3215192585 >> 172.21.15.67:0/3215192585 conn(0x7f5c5c08bfc0 msgr2=0x7f5c5c157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 -- 172.21.15.67:0/3215192585 shutdown_connections 2024-09-19T05:42:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.782+0000 7f5c6437a640 1 -- 172.21.15.67:0/3215192585 wait complete. 2024-09-19T05:42:59.800 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:42:59.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf3a01640 1 Processor -- start 2024-09-19T05:42:59.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf3a01640 1 -- start start 2024-09-19T05:42:59.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf3a01640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febec15e4b0 0x7febec15f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf3a01640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febec15f960 con 0x7febec09b140 2024-09-19T05:42:59.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf3a01640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febec0cd590 con 0x7febec0cd110 2024-09-19T05:42:59.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf3a01640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7febec15e890 con 0x7febec15e4b0 2024-09-19T05:42:59.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf179d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febec15e4b0 0x7febec15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf1f9e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7febec09b140 0x7febec0cfef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34866/0 (socket says 172.21.15.67:34866) 2024-09-19T05:42:59.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf1f9e640 1 -- 172.21.15.67:0/3895372155 learned_addr learned my addr 172.21.15.67:0/3895372155 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:42:59.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf179d640 1 -- 172.21.15.67:0/3895372155 >> v1:172.21.15.97:6789/0 conn(0x7febec0cd110 legacy=0x7febec09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf179d640 1 -- 172.21.15.67:0/3895372155 >> v1:172.21.15.67:6789/0 conn(0x7febec09b140 legacy=0x7febec0cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.926+0000 7febf179d640 1 -- 172.21.15.67:0/3895372155 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec0cd870 con 0x7febec15e4b0 2024-09-19T05:42:59.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf179d640 1 --2- 172.21.15.67:0/3895372155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 0x7febec15f420 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7febe80097c0 tx=0x7febe801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1003242c3cf791 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:59.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febe3fff640 1 -- 172.21.15.67:0/3895372155 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe80a7070 con 0x7febec15e4b0 2024-09-19T05:42:59.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febe3fff640 1 -- 172.21.15.67:0/3895372155 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe80b0070 con 0x7febec15e4b0 2024-09-19T05:42:59.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febe3fff640 1 -- 172.21.15.67:0/3895372155 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe80ab890 con 0x7febec15e4b0 2024-09-19T05:42:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 -- 172.21.15.67:0/3895372155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 msgr2=0x7febec15f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 --2- 172.21.15.67:0/3895372155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 0x7febec15f420 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7febe80097c0 tx=0x7febe801c470 comp rx=0 tx=0).stop 2024-09-19T05:42:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 -- 172.21.15.67:0/3895372155 shutdown_connections 2024-09-19T05:42:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 --2- 172.21.15.67:0/3895372155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 0x7febec15f420 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 -- 172.21.15.67:0/3895372155 >> 172.21.15.67:0/3895372155 conn(0x7febec0d2320 msgr2=0x7febec0d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:59.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 -- 172.21.15.67:0/3895372155 shutdown_connections 2024-09-19T05:42:59.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 -- 172.21.15.67:0/3895372155 wait complete. 2024-09-19T05:42:59.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 Processor -- start 2024-09-19T05:42:59.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 -- start start 2024-09-19T05:42:59.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec09b140 0x7febec158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec0cd110 0x7febec15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 0x7febec15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7febec0d0e10 con 0x7febec15e4b0 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7febec09b7d0 con 0x7febec0cd110 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf3a01640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7febec0d0f90 con 0x7febec09b140 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf1f9e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 0x7febec15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf1f9e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 0x7febec15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46526/0 (socket says 172.21.15.67:46526) 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.930+0000 7febf1f9e640 1 -- 172.21.15.67:0/4255281687 learned_addr learned my addr 172.21.15.67:0/4255281687 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf179d640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec09b140 0x7febec158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf0f9c640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec0cd110 0x7febec15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf1f9e640 1 -- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec09b140 msgr2=0x7febec158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf1f9e640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec09b140 0x7febec158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf1f9e640 1 -- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec0cd110 msgr2=0x7febec15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf1f9e640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec0cd110 0x7febec15a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:59.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf1f9e640 1 -- 172.21.15.67:0/4255281687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec0cb570 con 0x7febec15e4b0 2024-09-19T05:42:59.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf1f9e640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 0x7febec15a660 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7febe400cb20 tx=0x7febe400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:59.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febe1ffb640 1 -- 172.21.15.67:0/4255281687 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4017070 con 0x7febec15e4b0 2024-09-19T05:42:59.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febe1ffb640 1 -- 172.21.15.67:0/4255281687 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe400aca0 con 0x7febec15e4b0 2024-09-19T05:42:59.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febe1ffb640 1 -- 172.21.15.67:0/4255281687 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4012600 con 0x7febec15e4b0 2024-09-19T05:42:59.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf3a01640 1 -- 172.21.15.67:0/4255281687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febec0cb850 con 0x7febec15e4b0 2024-09-19T05:42:59.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf3a01640 1 -- 172.21.15.67:0/4255281687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febec0cbe10 con 0x7febec15e4b0 2024-09-19T05:42:59.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf3a01640 1 -- 172.21.15.67:0/4255281687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febec0cb300 con 0x7febec15e4b0 2024-09-19T05:42:59.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febe1ffb640 1 -- 172.21.15.67:0/4255281687 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7febe401a070 con 0x7febec15e4b0 2024-09-19T05:42:59.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febe1ffb640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd00678c0 0x7febd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:59.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febe1ffb640 1 -- 172.21.15.67:0/4255281687 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6101+0+0 (secure 0 0 0) 0x7febe4085ec0 con 0x7febec15e4b0 2024-09-19T05:42:59.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.934+0000 7febf179d640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd00678c0 0x7febd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:59.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.938+0000 7febf179d640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd00678c0 0x7febd0069d80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7febe80af000 tx=0x7febe80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:59.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:42:59.938+0000 7febe1ffb640 1 -- 172.21.15.67:0/4255281687 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7febec15f960 con 0x7febec15e4b0 2024-09-19T05:43:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:00.142+0000 7febf3a01640 1 -- 172.21.15.67:0/4255281687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7febec0702b0 con 0x7febec15e4b0 2024-09-19T05:43:01.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.154+0000 7febe1ffb640 1 -- 172.21.15.67:0/4255281687 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v90) ==== 118+0+0 (secure 0 0 0) 0x7febe4056300 con 0x7febec15e4b0 2024-09-19T05:43:01.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 -- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd00678c0 msgr2=0x7febd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:01.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd00678c0 0x7febd0069d80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7febe80af000 tx=0x7febe80a7000 comp rx=0 tx=0).stop 2024-09-19T05:43:01.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 -- 172.21.15.67:0/4255281687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 msgr2=0x7febec15a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:01.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 0x7febec15a660 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7febe400cb20 tx=0x7febe400a060 comp rx=0 tx=0).stop 2024-09-19T05:43:01.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 -- 172.21.15.67:0/4255281687 shutdown_connections 2024-09-19T05:43:01.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febec15e4b0 0x7febec15a660 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:01.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febec0cd110 0x7febec15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:01.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7febd00678c0 0x7febd0069d80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:01.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 --2- 172.21.15.67:0/4255281687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febec09b140 0x7febec158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:01.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 -- 172.21.15.67:0/4255281687 >> 172.21.15.67:0/4255281687 conn(0x7febec0d2320 msgr2=0x7febec0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:01.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 -- 172.21.15.67:0/4255281687 shutdown_connections 2024-09-19T05:43:01.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.158+0000 7febf3a01640 1 -- 172.21.15.67:0/4255281687 wait complete. 2024-09-19T05:43:01.177 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:43:01.178 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:43:01.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd469c2a640 1 Processor -- start 2024-09-19T05:43:01.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd469c2a640 1 -- start start 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd469c2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd464070070 0x7fd464165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd469c2a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4640aef30 con 0x7fd46415b1d0 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd469c2a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4640ae3b0 con 0x7fd46406dfc0 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd469c2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd464072210 con 0x7fd464070070 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4637fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd46415b1d0 0x7fd4640adbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34872/0 (socket says 172.21.15.67:34872) 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4637fe640 1 -- 172.21.15.67:0/4247382574 learned_addr learned my addr 172.21.15.67:0/4247382574 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd463fff640 1 --2- 172.21.15.67:0/4247382574 >> v2:172.21.15.97:3300/0 conn(0x7fd464070070 0x7fd464165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378980148 0 0) 0x7fd4640aef30 con 0x7fd46415b1d0 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd44c003530 con 0x7fd46415b1d0 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1163017522 0 0) 0x7fd44c003530 con 0x7fd46415b1d0 2024-09-19T05:43:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 >> v2:172.21.15.97:3300/0 conn(0x7fd464070070 msgr2=0x7fd464165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 --2- 172.21.15.67:0/4247382574 >> v2:172.21.15.97:3300/0 conn(0x7fd464070070 0x7fd464165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 >> v1:172.21.15.97:6789/0 conn(0x7fd46406dfc0 legacy=0x7fd46406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4640ae690 con 0x7fd46415b1d0 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fd454001680 con 0x7fd46415b1d0 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 >> v1:172.21.15.67:6789/0 conn(0x7fd46415b1d0 legacy=0x7fd4640adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 --2- 172.21.15.67:0/4247382574 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd44c0039c0 0x7fd44c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 --2- 172.21.15.67:0/4247382574 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd44c004810 0x7fd44c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 --2- 172.21.15.67:0/4247382574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd44c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd464072210 con 0x7fd44c0051d0 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c00c070 con 0x7fd44c004810 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd44c00c270 con 0x7fd44c0039c0 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd463fff640 1 --2- 172.21.15.67:0/4247382574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd44c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:01.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd4637fe640 1 --2- 172.21.15.67:0/4247382574 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd44c0039c0 0x7fd44c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:01.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd463fff640 1 -- 172.21.15.67:0/4247382574 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd44c0039c0 msgr2=0x7fd44c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:01.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd463fff640 1 --2- 172.21.15.67:0/4247382574 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd44c0039c0 0x7fd44c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:01.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd463fff640 1 -- 172.21.15.67:0/4247382574 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd44c004810 msgr2=0x7fd44c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:01.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd463fff640 1 --2- 172.21.15.67:0/4247382574 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd44c004810 0x7fd44c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:01.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.310+0000 7fd463fff640 1 -- 172.21.15.67:0/4247382574 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c003530 con 0x7fd44c0051d0 2024-09-19T05:43:01.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd463fff640 1 -- 172.21.15.67:0/4247382574 reap_dead start 2024-09-19T05:43:01.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd463fff640 1 --2- 172.21.15.67:0/4247382574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd44c00b9d0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fd4640d1160 tx=0x7fd45c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43db0572311a3527 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0b2070 con 0x7fd44c0051d0 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45c0a5c70 con 0x7fd44c0051d0 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd4627fc640 1 -- 172.21.15.67:0/4247382574 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c009c10 con 0x7fd44c0051d0 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd469c2a640 1 -- 172.21.15.67:0/4247382574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 msgr2=0x7fd44c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd469c2a640 1 --2- 172.21.15.67:0/4247382574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd44c00b9d0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fd4640d1160 tx=0x7fd45c01cc60 comp rx=0 tx=0).stop 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd469c2a640 1 -- 172.21.15.67:0/4247382574 shutdown_connections 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd469c2a640 1 --2- 172.21.15.67:0/4247382574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd44c00b9d0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd469c2a640 1 -- 172.21.15.67:0/4247382574 >> 172.21.15.67:0/4247382574 conn(0x7fd4640b1e50 msgr2=0x7fd4640b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd469c2a640 1 -- 172.21.15.67:0/4247382574 shutdown_connections 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd469c2a640 1 -- 172.21.15.67:0/4247382574 wait complete. 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd469c2a640 1 Processor -- start 2024-09-19T05:43:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.314+0000 7fd469c2a640 1 -- start start 2024-09-19T05:43:01.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd469c2a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd4641f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd469c2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd464150060 0x7fd464153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd469c2a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd464153cc0 0x7fd46406e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd469c2a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd464072420 con 0x7fd44c0051d0 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd469c2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd4640aec50 con 0x7fd464150060 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd469c2a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd46406f960 con 0x7fd464153cc0 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd4637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd4641f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd4637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd4641f1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46540/0 (socket says 172.21.15.67:46540) 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd4637fe640 1 -- 172.21.15.67:0/623668490 learned_addr learned my addr 172.21.15.67:0/623668490 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd463fff640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd464153cc0 0x7fd46406e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd4637fe640 1 -- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd464153cc0 msgr2=0x7fd46406e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd4637fe640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd464153cc0 0x7fd46406e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd462ffd640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd464150060 0x7fd464153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd4637fe640 1 -- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd464150060 msgr2=0x7fd464153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd4637fe640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd464150060 0x7fd464153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd4637fe640 1 -- 172.21.15.67:0/623668490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd464154200 con 0x7fd44c0051d0 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd4637fe640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd4641f1c70 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fd454000f70 tx=0x7fd45400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd44bfff640 1 -- 172.21.15.67:0/623668490 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45400ee70 con 0x7fd44c0051d0 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd44bfff640 1 -- 172.21.15.67:0/623668490 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd454018070 con 0x7fd44c0051d0 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd469c2a640 1 -- 172.21.15.67:0/623668490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46414f580 con 0x7fd44c0051d0 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd44bfff640 1 -- 172.21.15.67:0/623668490 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45400cad0 con 0x7fd44c0051d0 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd469c2a640 1 -- 172.21.15.67:0/623668490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd464146d60 con 0x7fd44c0051d0 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd469c2a640 1 -- 172.21.15.67:0/623668490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46414f3a0 con 0x7fd44c0051d0 2024-09-19T05:43:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd44bfff640 1 -- 172.21.15.67:0/623668490 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd45400cc70 con 0x7fd44c0051d0 2024-09-19T05:43:01.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd44bfff640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4500678f0 0x7fd450069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:01.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd44bfff640 1 -- 172.21.15.67:0/623668490 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7fd454086650 con 0x7fd44c0051d0 2024-09-19T05:43:01.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.318+0000 7fd462ffd640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4500678f0 0x7fd450069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:01.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.322+0000 7fd462ffd640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4500678f0 0x7fd450069db0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd4640cf310 tx=0x7fd458009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:01.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.322+0000 7fd44bfff640 1 -- 172.21.15.67:0/623668490 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd46414f3a0 con 0x7fd44c0051d0 2024-09-19T05:43:01.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:01.526+0000 7fd469c2a640 1 -- 172.21.15.67:0/623668490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd464068530 con 0x7fd44c0051d0 2024-09-19T05:43:02.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.166+0000 7fd44bfff640 1 -- 172.21.15.67:0/623668490 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v91) ==== 122+0+0 (secure 0 0 0) 0x7fd4540570e0 con 0x7fd44c0051d0 2024-09-19T05:43:02.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 -- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4500678f0 msgr2=0x7fd450069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4500678f0 0x7fd450069db0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd4640cf310 tx=0x7fd458009040 comp rx=0 tx=0).stop 2024-09-19T05:43:02.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 -- 172.21.15.67:0/623668490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 msgr2=0x7fd4641f1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd4641f1c70 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fd454000f70 tx=0x7fd45400ec80 comp rx=0 tx=0).stop 2024-09-19T05:43:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 -- 172.21.15.67:0/623668490 shutdown_connections 2024-09-19T05:43:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd4500678f0 0x7fd450069db0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd464153cc0 0x7fd46406e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd464150060 0x7fd464153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 --2- 172.21.15.67:0/623668490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd44c0051d0 0x7fd4641f1c70 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 -- 172.21.15.67:0/623668490 >> 172.21.15.67:0/623668490 conn(0x7fd4640b1e50 msgr2=0x7fd4640b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 -- 172.21.15.67:0/623668490 shutdown_connections 2024-09-19T05:43:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.170+0000 7fd469c2a640 1 -- 172.21.15.67:0/623668490 wait complete. 2024-09-19T05:43:02.193 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:43:02.193 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:43:02.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e9a538640 1 Processor -- start 2024-09-19T05:43:02.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e9a538640 1 -- start start 2024-09-19T05:43:02.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e9a538640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9e940d1590 0x7f9e940d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e9a538640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e940b51d0 0x7f9e940cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e9a538640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e940d4d40 con 0x7f9e94161da0 2024-09-19T05:43:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e9a538640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9e940d0840 con 0x7f9e940d1590 2024-09-19T05:43:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e9a538640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9e940d5020 con 0x7f9e940b51d0 2024-09-19T05:43:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e937fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9e940d1590 0x7f9e940d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e937fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9e940d1590 0x7f9e940d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46546/0 (socket says 172.21.15.67:46546) 2024-09-19T05:43:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e937fe640 1 -- 172.21.15.67:0/1389366226 learned_addr learned my addr 172.21.15.67:0/1389366226 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e98ad5640 1 --2- 172.21.15.67:0/1389366226 >> v2:172.21.15.97:3300/0 conn(0x7f9e940b51d0 0x7f9e940cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e937fe640 1 -- 172.21.15.67:0/1389366226 >> v2:172.21.15.97:3300/0 conn(0x7f9e940b51d0 msgr2=0x7f9e940cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e937fe640 1 --2- 172.21.15.67:0/1389366226 >> v2:172.21.15.97:3300/0 conn(0x7f9e940b51d0 0x7f9e940cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e937fe640 1 -- 172.21.15.67:0/1389366226 >> v1:172.21.15.97:6789/0 conn(0x7f9e94161da0 legacy=0x7f9e940d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.322+0000 7f9e937fe640 1 -- 172.21.15.67:0/1389366226 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e940d5300 con 0x7f9e940d1590 2024-09-19T05:43:02.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e937fe640 1 --2- 172.21.15.67:0/1389366226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e940d1590 0x7f9e940d1af0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f9e9408e7c0 tx=0x7f9e8401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce23c0a7e200fff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:02.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e92ffd640 1 -- 172.21.15.67:0/1389366226 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840b0070 con 0x7f9e940d1590 2024-09-19T05:43:02.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e92ffd640 1 -- 172.21.15.67:0/1389366226 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840ab600 con 0x7f9e940d1590 2024-09-19T05:43:02.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e92ffd640 1 -- 172.21.15.67:0/1389366226 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840ab9d0 con 0x7f9e940d1590 2024-09-19T05:43:02.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e9a538640 1 -- 172.21.15.67:0/1389366226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e940d1590 msgr2=0x7f9e940d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e9a538640 1 --2- 172.21.15.67:0/1389366226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e940d1590 0x7f9e940d1af0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f9e9408e7c0 tx=0x7f9e8401c4e0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e9a538640 1 -- 172.21.15.67:0/1389366226 shutdown_connections 2024-09-19T05:43:02.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e9a538640 1 --2- 172.21.15.67:0/1389366226 >> v2:172.21.15.97:3300/0 conn(0x7f9e940b51d0 0x7f9e940cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e9a538640 1 --2- 172.21.15.67:0/1389366226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e940d1590 0x7f9e940d1af0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e9a538640 1 -- 172.21.15.67:0/1389366226 >> 172.21.15.67:0/1389366226 conn(0x7f9e9408bfc0 msgr2=0x7f9e940d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:02.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e9a538640 1 -- 172.21.15.67:0/1389366226 shutdown_connections 2024-09-19T05:43:02.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e9a538640 1 -- 172.21.15.67:0/1389366226 wait complete. 2024-09-19T05:43:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e9a538640 1 Processor -- start 2024-09-19T05:43:02.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.326+0000 7f9e9a538640 1 -- start start 2024-09-19T05:43:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e9a538640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e940b51d0 0x7f9e94143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e9a538640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e940d1590 0x7f9e940cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e9a538640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e94161da0 0x7f9e940cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e9a538640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9e940d0020 con 0x7f9e94161da0 2024-09-19T05:43:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e9a538640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9e940cfea0 con 0x7f9e940b51d0 2024-09-19T05:43:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e9a538640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9e940d01a0 con 0x7f9e940d1590 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e98ad5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e94161da0 0x7f9e940cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e98ad5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e94161da0 0x7f9e940cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46550/0 (socket says 172.21.15.67:46550) 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e98ad5640 1 -- 172.21.15.67:0/2765044393 learned_addr learned my addr 172.21.15.67:0/2765044393 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e93fff640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e940b51d0 0x7f9e94143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e937fe640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e940d1590 0x7f9e940cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e98ad5640 1 -- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e940d1590 msgr2=0x7f9e940cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e98ad5640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e940d1590 0x7f9e940cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e98ad5640 1 -- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e940b51d0 msgr2=0x7f9e94143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e98ad5640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e940b51d0 0x7f9e94143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e98ad5640 1 -- 172.21.15.67:0/2765044393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e94144800 con 0x7f9e94161da0 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e98ad5640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e94161da0 0x7f9e940cdfc0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c007d90 tx=0x7f9e8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e90ff9640 1 -- 172.21.15.67:0/2765044393 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c014420 con 0x7f9e94161da0 2024-09-19T05:43:02.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e90ff9640 1 -- 172.21.15.67:0/2765044393 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c019070 con 0x7f9e94161da0 2024-09-19T05:43:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e90ff9640 1 -- 172.21.15.67:0/2765044393 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c014820 con 0x7f9e94161da0 2024-09-19T05:43:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e9a538640 1 -- 172.21.15.67:0/2765044393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e94144ae0 con 0x7f9e94161da0 2024-09-19T05:43:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e9a538640 1 -- 172.21.15.67:0/2765044393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e941450a0 con 0x7f9e94161da0 2024-09-19T05:43:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e9a538640 1 -- 172.21.15.67:0/2765044393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e940cf150 con 0x7f9e94161da0 2024-09-19T05:43:02.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.330+0000 7f9e90ff9640 1 -- 172.21.15.67:0/2765044393 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e8c0149c0 con 0x7f9e94161da0 2024-09-19T05:43:02.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.334+0000 7f9e90ff9640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e800678c0 0x7f9e80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.334+0000 7f9e90ff9640 1 -- 172.21.15.67:0/2765044393 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f9e8c086610 con 0x7f9e94161da0 2024-09-19T05:43:02.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.334+0000 7f9e93fff640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e800678c0 0x7f9e80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.334+0000 7f9e93fff640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e800678c0 0x7f9e80069d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800b810 tx=0x7f9e88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:02.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.338+0000 7f9e90ff9640 1 -- 172.21.15.67:0/2765044393 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9e8c011260 con 0x7f9e94161da0 2024-09-19T05:43:02.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.538+0000 7f9e9a538640 1 -- 172.21.15.67:0/2765044393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e940b4b00 con 0x7f9e94161da0 2024-09-19T05:43:02.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.538+0000 7f9e90ff9640 1 -- 172.21.15.67:0/2765044393 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5216 (secure 0 0 0) 0x7f9e8c056fc0 con 0x7f9e94161da0 2024-09-19T05:43:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:02.537 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":91,"btime":"2024-09-19T05:43:02:159748+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/617137818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":617137818},{"type":"v1","addr":"172.21.15.97:6835","nonce":617137818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":6862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3709077281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3709077281},{"type":"v1","addr":"172.21.15.97:6837","nonce":3709077281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1889576066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1889576066},{"type":"v1","addr":"172.21.15.67:6833","nonce":1889576066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:42:58.500443+0000","modified":"2024-09-19T05:43:01.531911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/96000467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":96000467},{"type":"v1","addr":"172.21.15.67:6835","nonce":96000467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8136,"qdb_cluster":[8136]},"id":8}]} 2024-09-19T05:43:02.537 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 91 2024-09-19T05:43:02.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 -- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e800678c0 msgr2=0x7f9e80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e800678c0 0x7f9e80069d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800b810 tx=0x7f9e88008040 comp rx=0 tx=0).stop 2024-09-19T05:43:02.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 -- 172.21.15.67:0/2765044393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e94161da0 msgr2=0x7f9e940cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e94161da0 0x7f9e940cdfc0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c007d90 tx=0x7f9e8c00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 -- 172.21.15.67:0/2765044393 shutdown_connections 2024-09-19T05:43:02.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e94161da0 0x7f9e940cdfc0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9e800678c0 0x7f9e80069d80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e940d1590 0x7f9e940cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 --2- 172.21.15.67:0/2765044393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e940b51d0 0x7f9e94143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 -- 172.21.15.67:0/2765044393 >> 172.21.15.67:0/2765044393 conn(0x7f9e9408bfc0 msgr2=0x7f9e94158690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:02.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 -- 172.21.15.67:0/2765044393 shutdown_connections 2024-09-19T05:43:02.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.542+0000 7f9e9a538640 1 -- 172.21.15.67:0/2765044393 wait complete. 2024-09-19T05:43:02.558 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:43:02.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a10cb1640 1 Processor -- start 2024-09-19T05:43:02.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a10cb1640 1 -- start start 2024-09-19T05:43:02.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a10cb1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7a0c15f370 0x7f7a0c0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a10cb1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a0c06e790 con 0x7f7a0c070140 2024-09-19T05:43:02.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a10cb1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a0c06ea50 con 0x7f7a0c0ae8c0 2024-09-19T05:43:02.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a10cb1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0c06ed30 con 0x7f7a0c15f370 2024-09-19T05:43:02.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0a59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7a0c070140 0x7f7a0c070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34874/0 (socket says 172.21.15.67:34874) 2024-09-19T05:43:02.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0a59c640 1 -- 172.21.15.67:0/1175852246 learned_addr learned my addr 172.21.15.67:0/1175852246 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:02.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a09d9b640 1 --2- 172.21.15.67:0/1175852246 >> v2:172.21.15.97:3300/0 conn(0x7f7a0c15f370 0x7f7a0c0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 36087259 0 0) 0x7f7a0c06e790 con 0x7f7a0c070140 2024-09-19T05:43:02.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79f4003530 con 0x7f7a0c070140 2024-09-19T05:43:02.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1640302339 0 0) 0x7f79f4003530 con 0x7f7a0c070140 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 >> v2:172.21.15.97:3300/0 conn(0x7f7a0c15f370 msgr2=0x7f7a0c0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 --2- 172.21.15.67:0/1175852246 >> v2:172.21.15.97:3300/0 conn(0x7f7a0c15f370 0x7f7a0c0ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 >> v1:172.21.15.97:6789/0 conn(0x7f7a0c0ae8c0 legacy=0x7f7a0c0aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0c06f010 con 0x7f7a0c070140 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f79fc001680 con 0x7f7a0c070140 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 >> v1:172.21.15.67:6789/0 conn(0x7f7a0c070140 legacy=0x7f7a0c070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79f40039f0 0x7f79f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79f4004810 0x7f79f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f40051d0 0x7f79f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c06ed30 con 0x7f79f40039f0 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f79f400c0a0 con 0x7f79f40051d0 2024-09-19T05:43:02.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f79f400c2a0 con 0x7f79f4004810 2024-09-19T05:43:02.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0a59c640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79f40039f0 0x7f79f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0ad9d640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f40051d0 0x7f79f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a09d9b640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79f4004810 0x7f79f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0a59c640 1 -- 172.21.15.67:0/1175852246 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79f4004810 msgr2=0x7f79f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:02.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0a59c640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79f4004810 0x7f79f4004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0a59c640 1 -- 172.21.15.67:0/1175852246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f40051d0 msgr2=0x7f79f400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:02.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0a59c640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f40051d0 0x7f79f400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0a59c640 1 -- 172.21.15.67:0/1175852246 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f4003530 con 0x7f79f40039f0 2024-09-19T05:43:02.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.678+0000 7f7a0ad9d640 1 -- 172.21.15.67:0/1175852246 reap_dead start 2024-09-19T05:43:02.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a0a59c640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79f40039f0 0x7f79f4003e10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00c210 tx=0x7f79fc01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606fa56581ea6b01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc007d40 con 0x7f79f40039f0 2024-09-19T05:43:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc0a9070 con 0x7f79f40039f0 2024-09-19T05:43:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a0959a640 1 -- 172.21.15.67:0/1175852246 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc005d80 con 0x7f79f40039f0 2024-09-19T05:43:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1175852246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79f40039f0 msgr2=0x7f79f4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a10cb1640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79f40039f0 0x7f79f4003e10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00c210 tx=0x7f79fc01cca0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1175852246 shutdown_connections 2024-09-19T05:43:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a10cb1640 1 --2- 172.21.15.67:0/1175852246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79f40039f0 0x7f79f4003e10 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1175852246 >> 172.21.15.67:0/1175852246 conn(0x7f7a0c073500 msgr2=0x7f7a0c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1175852246 shutdown_connections 2024-09-19T05:43:02.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.682+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1175852246 wait complete. 2024-09-19T05:43:02.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a10cb1640 1 Processor -- start 2024-09-19T05:43:02.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a10cb1640 1 -- start start 2024-09-19T05:43:02.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a10cb1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f40039f0 0x7f7a0c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a10cb1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a0c0cfb00 0x7f7a0c14a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a10cb1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c1555b0 0x7f7a0c0af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a10cb1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c070ab0 con 0x7f7a0c1555b0 2024-09-19T05:43:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a10cb1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c070930 con 0x7f79f40039f0 2024-09-19T05:43:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a10cb1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7a0c15c160 con 0x7f7a0c0cfb00 2024-09-19T05:43:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a0ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c1555b0 0x7f7a0c0af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a0ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c1555b0 0x7f7a0c0af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46578/0 (socket says 172.21.15.67:46578) 2024-09-19T05:43:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a0ad9d640 1 -- 172.21.15.67:0/1366938301 learned_addr learned my addr 172.21.15.67:0/1366938301 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a0a59c640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f40039f0 0x7f7a0c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a09d9b640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a0c0cfb00 0x7f7a0c14a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a0ad9d640 1 -- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a0c0cfb00 msgr2=0x7f7a0c14a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a0ad9d640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a0c0cfb00 0x7f7a0c14a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a0ad9d640 1 -- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f40039f0 msgr2=0x7f7a0c1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a0ad9d640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f40039f0 0x7f7a0c1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a0ad9d640 1 -- 172.21.15.67:0/1366938301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0c0d0080 con 0x7f7a0c1555b0 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a09d9b640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a0c0cfb00 0x7f7a0c14a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a0ad9d640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c1555b0 0x7f7a0c0af4e0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0d0820 tx=0x7f7a0400e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f79faffd640 1 -- 172.21.15.67:0/1366938301 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a04019070 con 0x7f7a0c1555b0 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f79faffd640 1 -- 172.21.15.67:0/1366938301 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a04006e30 con 0x7f7a0c1555b0 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1366938301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0c155a30 con 0x7f7a0c1555b0 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f79faffd640 1 -- 172.21.15.67:0/1366938301 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a04003ba0 con 0x7f7a0c1555b0 2024-09-19T05:43:02.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.686+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1366938301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0c1538a0 con 0x7f7a0c1555b0 2024-09-19T05:43:02.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.690+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1366938301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0c1533d0 con 0x7f7a0c1555b0 2024-09-19T05:43:02.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.690+0000 7f79faffd640 1 -- 172.21.15.67:0/1366938301 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a0401c070 con 0x7f7a0c1555b0 2024-09-19T05:43:02.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.690+0000 7f79faffd640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79ec0678f0 0x7f79ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:02.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.690+0000 7f79faffd640 1 -- 172.21.15.67:0/1366938301 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f7a04085170 con 0x7f7a0c1555b0 2024-09-19T05:43:02.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.690+0000 7f7a0a59c640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79ec0678f0 0x7f79ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:02.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.690+0000 7f7a0a59c640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79ec0678f0 0x7f79ec069db0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0ab000 tx=0x7f79fc0b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:02.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.694+0000 7f79faffd640 1 -- 172.21.15.67:0/1366938301 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7a04055a80 con 0x7f7a0c1555b0 2024-09-19T05:43:02.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.862+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1366938301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a0c0b5720 con 0x7f7a0c1555b0 2024-09-19T05:43:02.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.862+0000 7f79faffd640 1 -- 172.21.15.67:0/1366938301 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16976 (secure 0 0 0) 0x7f7a04055380 con 0x7f7a0c1555b0 2024-09-19T05:43:02.861 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:02.861 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":132,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:43:00.111870+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:42:56.158238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-19T05:42:57.484042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:43:02.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79ec0678f0 msgr2=0x7f79ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79ec0678f0 0x7f79ec069db0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0ab000 tx=0x7f79fc0b0040 comp rx=0 tx=0).stop 2024-09-19T05:43:02.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1366938301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c1555b0 msgr2=0x7f7a0c0af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:02.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c1555b0 0x7f7a0c0af4e0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0d0820 tx=0x7f7a0400e8b0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1366938301 shutdown_connections 2024-09-19T05:43:02.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c1555b0 0x7f7a0c0af4e0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79ec0678f0 0x7f79ec069db0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a0c0cfb00 0x7f7a0c14a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 --2- 172.21.15.67:0/1366938301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f40039f0 0x7f7a0c1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:02.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1366938301 >> 172.21.15.67:0/1366938301 conn(0x7f7a0c073500 msgr2=0x7f7a0c15f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:02.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1366938301 shutdown_connections 2024-09-19T05:43:02.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:02.866+0000 7f7a10cb1640 1 -- 172.21.15.67:0/1366938301 wait complete. 2024-09-19T05:43:02.881 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:43:02.882 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:43:03.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.002+0000 7fedbd217640 1 Processor -- start 2024-09-19T05:43:03.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.002+0000 7fedbd217640 1 -- start start 2024-09-19T05:43:03.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.002+0000 7fedbd217640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb815b1e0 0x7fedb80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.002+0000 7fedbd217640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fedb80b4900 0x7fedb8071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.002+0000 7fedbd217640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb80b3860 con 0x7fedb80723c0 2024-09-19T05:43:03.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.002+0000 7fedbd217640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fedb815b5c0 con 0x7fedb80b4900 2024-09-19T05:43:03.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.002+0000 7fedbd217640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fedb80b3b40 con 0x7fedb815b1e0 2024-09-19T05:43:03.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.002+0000 7fedb659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fedb80b4900 0x7fedb8071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.002+0000 7fedb759e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fedb80723c0 0x7fedb815ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34888/0 (socket says 172.21.15.67:34888) 2024-09-19T05:43:03.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.002+0000 7fedb759e640 1 -- 172.21.15.67:0/4044552844 learned_addr learned my addr 172.21.15.67:0/4044552844 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:03.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedb6d9d640 1 --2- 172.21.15.67:0/4044552844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb815b1e0 0x7fedb80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedb659c640 1 -- 172.21.15.67:0/4044552844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb815b1e0 msgr2=0x7fedb80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:03.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedb659c640 1 --2- 172.21.15.67:0/4044552844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb815b1e0 0x7fedb80b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedb659c640 1 -- 172.21.15.67:0/4044552844 >> v1:172.21.15.67:6789/0 conn(0x7fedb80723c0 legacy=0x7fedb815ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedb5d9b640 1 -- 172.21.15.67:0/4044552844 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2103884179 0 0) 0x7fedb80b3860 con 0x7fedb80723c0 2024-09-19T05:43:03.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedb659c640 1 -- 172.21.15.67:0/4044552844 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb80b3e20 con 0x7fedb80b4900 2024-09-19T05:43:03.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedb659c640 1 --2- 172.21.15.67:0/4044552844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 0x7fedb8071e80 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7feda8009dc0 tx=0x7feda801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8418b46cd5dc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:03.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedb5d9b640 1 -- 172.21.15.67:0/4044552844 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda80b2070 con 0x7fedb80b4900 2024-09-19T05:43:03.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedb5d9b640 1 -- 172.21.15.67:0/4044552844 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda80a5a00 con 0x7fedb80b4900 2024-09-19T05:43:03.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedb5d9b640 1 -- 172.21.15.67:0/4044552844 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda80a5dd0 con 0x7fedb80b4900 2024-09-19T05:43:03.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedbd217640 1 -- 172.21.15.67:0/4044552844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 msgr2=0x7fedb8071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedbd217640 1 --2- 172.21.15.67:0/4044552844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 0x7fedb8071e80 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7feda8009dc0 tx=0x7feda801c920 comp rx=0 tx=0).stop 2024-09-19T05:43:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedbd217640 1 -- 172.21.15.67:0/4044552844 shutdown_connections 2024-09-19T05:43:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedbd217640 1 --2- 172.21.15.67:0/4044552844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 0x7fedb8071e80 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedbd217640 1 --2- 172.21.15.67:0/4044552844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb815b1e0 0x7fedb80b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedbd217640 1 -- 172.21.15.67:0/4044552844 >> 172.21.15.67:0/4044552844 conn(0x7fedb80d0080 msgr2=0x7fedb80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedbd217640 1 -- 172.21.15.67:0/4044552844 shutdown_connections 2024-09-19T05:43:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.006+0000 7fedbd217640 1 -- 172.21.15.67:0/4044552844 wait complete. 2024-09-19T05:43:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 Processor -- start 2024-09-19T05:43:03.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 -- start start 2024-09-19T05:43:03.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb80723c0 0x7fedb8147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 0x7fedb8149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb815b1e0 0x7fedb8150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fedb8168060 con 0x7fedb80b4900 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fedb80b3510 con 0x7fedb815b1e0 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fedb81681e0 con 0x7fedb80723c0 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 0x7fedb8149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 0x7fedb8149430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46590/0 (socket says 172.21.15.67:46590) 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb659c640 1 -- 172.21.15.67:0/1199674555 learned_addr learned my addr 172.21.15.67:0/1199674555 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb759e640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb815b1e0 0x7fedb8150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb6d9d640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb80723c0 0x7fedb8147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb659c640 1 -- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb80723c0 msgr2=0x7fedb8147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb659c640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb80723c0 0x7fedb8147510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb659c640 1 -- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb815b1e0 msgr2=0x7fedb8150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb659c640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb815b1e0 0x7fedb8150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb659c640 1 -- 172.21.15.67:0/1199674555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb8149e80 con 0x7fedb80b4900 2024-09-19T05:43:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedb659c640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 0x7fedb8149430 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7feda80b0040 tx=0x7feda80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedaf7fe640 1 -- 172.21.15.67:0/1199674555 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda80b2050 con 0x7fedb80b4900 2024-09-19T05:43:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedaf7fe640 1 -- 172.21.15.67:0/1199674555 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda80be070 con 0x7fedb80b4900 2024-09-19T05:43:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedaf7fe640 1 -- 172.21.15.67:0/1199674555 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda80adc10 con 0x7fedb80b4900 2024-09-19T05:43:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 -- 172.21.15.67:0/1199674555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb814a160 con 0x7fedb80b4900 2024-09-19T05:43:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 -- 172.21.15.67:0/1199674555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb814a720 con 0x7fedb80b4900 2024-09-19T05:43:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.010+0000 7fedbd217640 1 -- 172.21.15.67:0/1199674555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb8071e80 con 0x7fedb80b4900 2024-09-19T05:43:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.014+0000 7fedaf7fe640 1 -- 172.21.15.67:0/1199674555 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feda80c3460 con 0x7fedb80b4900 2024-09-19T05:43:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.014+0000 7fedaf7fe640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed980678c0 0x7fed98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.014+0000 7fedaf7fe640 1 -- 172.21.15.67:0/1199674555 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7feda8121250 con 0x7fedb80b4900 2024-09-19T05:43:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.014+0000 7fedb6d9d640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed980678c0 0x7fed98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.014+0000 7fedb6d9d640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed980678c0 0x7fed98069d80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7feda00096f0 tx=0x7feda0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:03.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.018+0000 7fedaf7fe640 1 -- 172.21.15.67:0/1199674555 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7feda8016540 con 0x7fedb80b4900 2024-09-19T05:43:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.170+0000 7fedbd217640 1 -- 172.21.15.67:0/1199674555 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedb806f560 con 0x7fed980678c0 2024-09-19T05:43:03.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.190+0000 7fedaf7fe640 1 -- 172.21.15.67:0/1199674555 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240281 (secure 0 0 0) 0x7fedb806f560 con 0x7fed980678c0 2024-09-19T05:43:03.190 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:03.191 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:43:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 -- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed980678c0 msgr2=0x7fed98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed980678c0 0x7fed98069d80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7feda00096f0 tx=0x7feda0008040 comp rx=0 tx=0).stop 2024-09-19T05:43:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 -- 172.21.15.67:0/1199674555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 msgr2=0x7fedb8149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 0x7fedb8149430 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7feda80b0040 tx=0x7feda80196c0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 -- 172.21.15.67:0/1199674555 shutdown_connections 2024-09-19T05:43:03.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb815b1e0 0x7fedb8150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb80b4900 0x7fedb8149430 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed980678c0 0x7fed98069d80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 --2- 172.21.15.67:0/1199674555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb80723c0 0x7fedb8147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 -- 172.21.15.67:0/1199674555 >> 172.21.15.67:0/1199674555 conn(0x7fedb80d0080 msgr2=0x7fedb80d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:03.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 -- 172.21.15.67:0/1199674555 shutdown_connections 2024-09-19T05:43:03.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.194+0000 7fedbd217640 1 -- 172.21.15.67:0/1199674555 wait complete. 2024-09-19T05:43:03.207 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":425,"stamp":"2024-09-19T05:43:01.312258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":506084,"kb_used_data":13624,"kb_used_omap":12,"kb_used_meta":492275,"kb_avail":754468636,"statfs":{"total":773094113280,"available":772575883264,"internally_reserved":0,"allocated":13950976,"data_stored":7180708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":504090161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.213658"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.109226+0000","last_change":"2024-09-19T05:42:57.109226+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.109226+0000","last_undegraded":"2024-09-19T05:42:57.109226+0000","last_fullsized":"2024-09-19T05:42:57.109226+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.104911+0000","last_change":"2024-09-19T05:42:57.104911+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.104911+0000","last_undegraded":"2024-09-19T05:42:57.104911+0000","last_fullsized":"2024-09-19T05:42:57.104911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.114055+0000","last_change":"2024-09-19T05:42:57.114055+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.114055+0000","last_undegraded":"2024-09-19T05:42:57.114055+0000","last_fullsized":"2024-09-19T05:42:57.114055+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.104676+0000","last_change":"2024-09-19T05:42:57.104676+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.104676+0000","last_undegraded":"2024-09-19T05:42:57.104676+0000","last_fullsized":"2024-09-19T05:42:57.104676+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.102271+0000","last_change":"2024-09-19T05:42:57.102271+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.102271+0000","last_undegraded":"2024-09-19T05:42:57.102271+0000","last_fullsized":"2024-09-19T05:42:57.102271+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.108254+0000","last_change":"2024-09-19T05:42:57.108254+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.108254+0000","last_undegraded":"2024-09-19T05:42:57.108254+0000","last_fullsized":"2024-09-19T05:42:57.108254+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.104135+0000","last_change":"2024-09-19T05:42:57.104135+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.104135+0000","last_undegraded":"2024-09-19T05:42:57.104135+0000","last_fullsized":"2024-09-19T05:42:57.104135+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.107252+0000","last_change":"2024-09-19T05:42:57.107252+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.107252+0000","last_undegraded":"2024-09-19T05:42:57.107252+0000","last_fullsized":"2024-09-19T05:42:57.107252+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.108029+0000","last_change":"2024-09-19T05:42:57.108029+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.108029+0000","last_undegraded":"2024-09-19T05:42:57.108029+0000","last_fullsized":"2024-09-19T05:42:57.108029+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.104253+0000","last_change":"2024-09-19T05:42:57.104253+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.104253+0000","last_undegraded":"2024-09-19T05:42:57.104253+0000","last_fullsized":"2024-09-19T05:42:57.104253+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.104523+0000","last_change":"2024-09-19T05:42:57.104523+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.104523+0000","last_undegraded":"2024-09-19T05:42:57.104523+0000","last_fullsized":"2024-09-19T05:42:57.104523+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.110047+0000","last_change":"2024-09-19T05:42:57.110047+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.110047+0000","last_undegraded":"2024-09-19T05:42:57.110047+0000","last_fullsized":"2024-09-19T05:42:57.110047+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.113967+0000","last_change":"2024-09-19T05:42:57.113967+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.113967+0000","last_undegraded":"2024-09-19T05:42:57.113967+0000","last_fullsized":"2024-09-19T05:42:57.113967+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.109600+0000","last_change":"2024-09-19T05:42:57.109600+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.109600+0000","last_undegraded":"2024-09-19T05:42:57.109600+0000","last_fullsized":"2024-09-19T05:42:57.109600+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.114003+0000","last_change":"2024-09-19T05:42:57.114003+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.114003+0000","last_undegraded":"2024-09-19T05:42:57.114003+0000","last_fullsized":"2024-09-19T05:42:57.114003+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.104677+0000","last_change":"2024-09-19T05:42:57.104677+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.104677+0000","last_undegraded":"2024-09-19T05:42:57.104677+0000","last_fullsized":"2024-09-19T05:42:57.104677+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.106243+0000","last_change":"2024-09-19T05:42:57.106243+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.106243+0000","last_undegraded":"2024-09-19T05:42:57.106243+0000","last_fullsized":"2024-09-19T05:42:57.106243+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.109530+0000","last_change":"2024-09-19T05:42:57.109530+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.109530+0000","last_undegraded":"2024-09-19T05:42:57.109530+0000","last_fullsized":"2024-09-19T05:42:57.109530+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.109576+0000","last_change":"2024-09-19T05:42:57.109576+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.109576+0000","last_undegraded":"2024-09-19T05:42:57.109576+0000","last_fullsized":"2024-09-19T05:42:57.109576+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.107264+0000","last_change":"2024-09-19T05:42:57.107264+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.107264+0000","last_undegraded":"2024-09-19T05:42:57.107264+0000","last_fullsized":"2024-09-19T05:42:57.107264+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.112638+0000","last_change":"2024-09-19T05:42:57.112638+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.112638+0000","last_undegraded":"2024-09-19T05:42:57.112638+0000","last_fullsized":"2024-09-19T05:42:57.112638+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.109710+0000","last_change":"2024-09-19T05:42:57.109710+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.109710+0000","last_undegraded":"2024-09-19T05:42:57.109710+0000","last_fullsized":"2024-09-19T05:42:57.109710+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.111259+0000","last_change":"2024-09-19T05:42:57.111259+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.111259+0000","last_undegraded":"2024-09-19T05:42:57.111259+0000","last_fullsized":"2024-09-19T05:42:57.111259+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.107655+0000","last_change":"2024-09-19T05:42:57.107655+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.107655+0000","last_undegraded":"2024-09-19T05:42:57.107655+0000","last_fullsized":"2024-09-19T05:42:57.107655+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.107984+0000","last_change":"2024-09-19T05:42:57.107984+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.107984+0000","last_undegraded":"2024-09-19T05:42:57.107984+0000","last_fullsized":"2024-09-19T05:42:57.107984+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.107999+0000","last_change":"2024-09-19T05:42:57.107999+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.107999+0000","last_undegraded":"2024-09-19T05:42:57.107999+0000","last_fullsized":"2024-09-19T05:42:57.107999+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.108861+0000","last_change":"2024-09-19T05:42:57.108861+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.108861+0000","last_undegraded":"2024-09-19T05:42:57.108861+0000","last_fullsized":"2024-09-19T05:42:57.108861+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.100941+0000","last_change":"2024-09-19T05:42:57.100941+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.100941+0000","last_undegraded":"2024-09-19T05:42:57.100941+0000","last_fullsized":"2024-09-19T05:42:57.100941+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.100940+0000","last_change":"2024-09-19T05:42:57.100940+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.100940+0000","last_undegraded":"2024-09-19T05:42:57.100940+0000","last_fullsized":"2024-09-19T05:42:57.100940+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.108386+0000","last_change":"2024-09-19T05:42:57.108386+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.108386+0000","last_undegraded":"2024-09-19T05:42:57.108386+0000","last_fullsized":"2024-09-19T05:42:57.108386+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.109387+0000","last_change":"2024-09-19T05:42:57.109387+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.109387+0000","last_undegraded":"2024-09-19T05:42:57.109387+0000","last_fullsized":"2024-09-19T05:42:57.109387+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:42:58.099209+0000","last_change":"2024-09-19T05:42:58.099209+0000","last_active":"2024-09-19T05:42:58.099209+0000","last_peered":"2024-09-19T05:42:58.099209+0000","last_clean":"2024-09-19T05:42:58.099209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:58.099209+0000","last_undegraded":"2024-09-19T05:42:58.099209+0000","last_fullsized":"2024-09-19T05:42:58.099209+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":129,"state":"creating+peering","last_fresh":"2024-09-19T05:42:57.109595+0000","last_change":"2024-09-19T05:42:57.109595+0000","last_active":"2024-09-19T05:42:57.095230+0000","last_peered":"2024-09-19T05:42:57.095230+0000","last_clean":"2024-09-19T05:42:57.095230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:42:57.109595+0000","last_undegraded":"2024-09-19T05:42:57.109595+0000","last_fullsized":"2024-09-19T05:42:57.109595+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":366,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-19T05:42:57.114927+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:42:57.114927+0000","last_peered":"2024-09-19T05:42:57.114927+0000","last_clean":"2024-09-19T05:42:57.114927+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:42:57.114927+0000","last_undegraded":"2024-09-19T05:42:57.114927+0000","last_fullsized":"2024-09-19T05:42:57.114927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542265,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65268,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306572,"statfs":{"total":96636764160,"available":96569929728,"internally_reserved":0,"allocated":2195456,"data_stored":1343469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542265,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64688,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94307152,"statfs":{"total":96636764160,"available":96570523648,"internally_reserved":0,"allocated":1601536,"data_stored":753101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59116,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312724,"statfs":{"total":96636764160,"available":96576229376,"internally_reserved":0,"allocated":1589248,"data_stored":746892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542265,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64676,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94307164,"statfs":{"total":96636764160,"available":96570535936,"internally_reserved":0,"allocated":1589248,"data_stored":746892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542266,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59108,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312732,"statfs":{"total":96636764160,"available":96576237568,"internally_reserved":0,"allocated":1589248,"data_stored":746892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542266,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68852,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302988,"statfs":{"total":96636764160,"available":96566259712,"internally_reserved":0,"allocated":1601536,"data_stored":753101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542268,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54948,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316892,"statfs":{"total":96636764160,"available":96580497408,"internally_reserved":0,"allocated":1589248,"data_stored":746892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542265,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69428,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302412,"statfs":{"total":96636764160,"available":96565669888,"internally_reserved":0,"allocated":2195456,"data_stored":1343469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:43:03.212 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:43:03.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.366+0000 7f82ce128640 1 Processor -- start 2024-09-19T05:43:03.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.366+0000 7f82ce128640 1 -- start start 2024-09-19T05:43:03.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82ce128640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f82c80af730 0x7f82c806e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82ce128640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c80730e0 con 0x7f82c806ebb0 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82ce128640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c80733c0 con 0x7f82c815a920 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82ce128640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f82c806efe0 con 0x7f82c80af730 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c7fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f82c806ebb0 0x7f82c80ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34894/0 (socket says 172.21.15.67:34894) 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c7fff640 1 -- 172.21.15.67:0/3283997408 learned_addr learned my addr 172.21.15.67:0/3283997408 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82bffff640 1 --2- 172.21.15.67:0/3283997408 >> v2:172.21.15.97:3300/0 conn(0x7f82c80af730 0x7f82c806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494356965 0 0) 0x7f82c80730e0 con 0x7f82c806ebb0 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82b4003530 con 0x7f82c806ebb0 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4045737427 0 0) 0x7f82b4003530 con 0x7f82c806ebb0 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 >> v2:172.21.15.97:3300/0 conn(0x7f82c80af730 msgr2=0x7f82c806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 --2- 172.21.15.67:0/3283997408 >> v2:172.21.15.97:3300/0 conn(0x7f82c80af730 0x7f82c806e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 >> v1:172.21.15.97:6789/0 conn(0x7f82c815a920 legacy=0x7f82c8072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c80ad8c0 con 0x7f82c806ebb0 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f82c0001a00 con 0x7f82c806ebb0 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 >> v1:172.21.15.67:6789/0 conn(0x7f82c806ebb0 legacy=0x7f82c80ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82b40039c0 0x7f82b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82b4004810 0x7f82b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82b40051d0 0x7f82b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f82c806efe0 con 0x7f82b40051d0 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f82b400c070 con 0x7f82b4004810 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f82b400c270 con 0x7f82b40039c0 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c7fff640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82b40051d0 0x7f82b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82bffff640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82b4004810 0x7f82b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c77fe640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82b40039c0 0x7f82b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c7fff640 1 -- 172.21.15.67:0/3283997408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82b40039c0 msgr2=0x7f82b4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:03.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c7fff640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82b40039c0 0x7f82b4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c7fff640 1 -- 172.21.15.67:0/3283997408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82b4004810 msgr2=0x7f82b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:03.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c7fff640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82b4004810 0x7f82b4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82c7fff640 1 -- 172.21.15.67:0/3283997408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b4003530 con 0x7f82b40051d0 2024-09-19T05:43:03.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.370+0000 7f82bffff640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82b4004810 0x7f82b4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:03.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82c7fff640 1 -- 172.21.15.67:0/3283997408 reap_dead start 2024-09-19T05:43:03.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82c7fff640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82b40051d0 0x7f82b400b9d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f82c000a860 tx=0x7f82c001d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b4762356a1664c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:03.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c000a480 con 0x7f82b40051d0 2024-09-19T05:43:03.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c00ad630 con 0x7f82b40051d0 2024-09-19T05:43:03.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82c6ffd640 1 -- 172.21.15.67:0/3283997408 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c00ada20 con 0x7f82b40051d0 2024-09-19T05:43:03.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82ce128640 1 -- 172.21.15.67:0/3283997408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82b40051d0 msgr2=0x7f82b400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82ce128640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82b40051d0 0x7f82b400b9d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f82c000a860 tx=0x7f82c001d380 comp rx=0 tx=0).stop 2024-09-19T05:43:03.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82ce128640 1 -- 172.21.15.67:0/3283997408 shutdown_connections 2024-09-19T05:43:03.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82ce128640 1 --2- 172.21.15.67:0/3283997408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82b40051d0 0x7f82b400b9d0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82ce128640 1 -- 172.21.15.67:0/3283997408 >> 172.21.15.67:0/3283997408 conn(0x7f82c80d0080 msgr2=0x7f82c80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:03.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82ce128640 1 -- 172.21.15.67:0/3283997408 shutdown_connections 2024-09-19T05:43:03.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82ce128640 1 -- 172.21.15.67:0/3283997408 wait complete. 2024-09-19T05:43:03.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82ce128640 1 Processor -- start 2024-09-19T05:43:03.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.374+0000 7f82ce128640 1 -- start start 2024-09-19T05:43:03.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82ce128640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82b40051d0 0x7f82c8159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82ce128640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c8098740 0x7f82c8142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82ce128640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82c8168a20 0x7f82c8168ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82ce128640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f82c815ad00 con 0x7f82c8098740 2024-09-19T05:43:03.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82ce128640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80ad570 con 0x7f82c8168a20 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82ce128640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f82c8099a80 con 0x7f82b40051d0 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82bffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c8098740 0x7f82c8142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82bffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c8098740 0x7f82c8142aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46612/0 (socket says 172.21.15.67:46612) 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82bffff640 1 -- 172.21.15.67:0/4254206949 learned_addr learned my addr 172.21.15.67:0/4254206949 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82c77fe640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82b40051d0 0x7f82c8159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82c7fff640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82c8168a20 0x7f82c8168ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82bffff640 1 -- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82b40051d0 msgr2=0x7f82c8159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82bffff640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82b40051d0 0x7f82c8159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82bffff640 1 -- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82c8168a20 msgr2=0x7f82c8168ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82bffff640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82c8168a20 0x7f82c8168ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82bffff640 1 -- 172.21.15.67:0/4254206949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c8098bc0 con 0x7f82c8098740 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82c77fe640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82b40051d0 0x7f82c8159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:03.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82bffff640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c8098740 0x7f82c8142aa0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009160 tx=0x7f82b0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:03.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82c4ff9640 1 -- 172.21.15.67:0/4254206949 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0015870 con 0x7f82c8098740 2024-09-19T05:43:03.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82c4ff9640 1 -- 172.21.15.67:0/4254206949 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b0015a10 con 0x7f82c8098740 2024-09-19T05:43:03.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82ce128640 1 -- 172.21.15.67:0/4254206949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c8098e70 con 0x7f82c8098740 2024-09-19T05:43:03.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82c4ff9640 1 -- 172.21.15.67:0/4254206949 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0015e00 con 0x7f82c8098740 2024-09-19T05:43:03.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82ce128640 1 -- 172.21.15.67:0/4254206949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c8099430 con 0x7f82c8098740 2024-09-19T05:43:03.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82ce128640 1 -- 172.21.15.67:0/4254206949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c80728d0 con 0x7f82c8098740 2024-09-19T05:43:03.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82c4ff9640 1 -- 172.21.15.67:0/4254206949 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f82b001d400 con 0x7f82c8098740 2024-09-19T05:43:03.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82c4ff9640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82a80678c0 0x7f82a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82c4ff9640 1 -- 172.21.15.67:0/4254206949 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f82b00866e0 con 0x7f82c8098740 2024-09-19T05:43:03.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.378+0000 7f82c77fe640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82a80678c0 0x7f82a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.382+0000 7f82c77fe640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82a80678c0 0x7f82a8069d80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f82b8007fd0 tx=0x7f82b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:03.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.382+0000 7f82c4ff9640 1 -- 172.21.15.67:0/4254206949 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f82b0019030 con 0x7f82c8098740 2024-09-19T05:43:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.542+0000 7f82ce128640 1 -- 172.21.15.67:0/4254206949 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82c8157950 con 0x7f82a80678c0 2024-09-19T05:43:03.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.562+0000 7f82c4ff9640 1 -- 172.21.15.67:0/4254206949 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252499 (secure 0 0 0) 0x7f82c8157950 con 0x7f82a80678c0 2024-09-19T05:43:03.563 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:03.564 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:43:03.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 -- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82a80678c0 msgr2=0x7f82a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82a80678c0 0x7f82a8069d80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f82b8007fd0 tx=0x7f82b8009040 comp rx=0 tx=0).stop 2024-09-19T05:43:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 -- 172.21.15.67:0/4254206949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c8098740 msgr2=0x7f82c8142aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c8098740 0x7f82c8142aa0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009160 tx=0x7f82b0011a60 comp rx=0 tx=0).stop 2024-09-19T05:43:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 -- 172.21.15.67:0/4254206949 shutdown_connections 2024-09-19T05:43:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82c8168a20 0x7f82c8168ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c8098740 0x7f82c8142aa0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f82a80678c0 0x7f82a8069d80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 --2- 172.21.15.67:0/4254206949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f82b40051d0 0x7f82c8159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 -- 172.21.15.67:0/4254206949 >> 172.21.15.67:0/4254206949 conn(0x7f82c80d0080 msgr2=0x7f82c80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 -- 172.21.15.67:0/4254206949 shutdown_connections 2024-09-19T05:43:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.566+0000 7f82ce128640 1 -- 172.21.15.67:0/4254206949 wait complete. 2024-09-19T05:43:03.581 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":426,"stamp":"2024-09-19T05:43:03.312843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":506496,"kb_used_data":14024,"kb_used_omap":12,"kb_used_meta":492275,"kb_avail":754468224,"statfs":{"total":773094113280,"available":772575461376,"internally_reserved":0,"allocated":14360576,"data_stored":7374572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":504090161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001749"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119999+0000","last_change":"2024-09-19T05:42:59.142315+0000","last_active":"2024-09-19T05:43:00.119999+0000","last_peered":"2024-09-19T05:43:00.119999+0000","last_clean":"2024-09-19T05:43:00.119999+0000","last_became_active":"2024-09-19T05:42:59.141603+0000","last_became_peered":"2024-09-19T05:42:59.141603+0000","last_unstale":"2024-09-19T05:43:00.119999+0000","last_undegraded":"2024-09-19T05:43:00.119999+0000","last_fullsized":"2024-09-19T05:43:00.119999+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:34.210492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119514+0000","last_change":"2024-09-19T05:42:59.179003+0000","last_active":"2024-09-19T05:43:00.119514+0000","last_peered":"2024-09-19T05:43:00.119514+0000","last_clean":"2024-09-19T05:43:00.119514+0000","last_became_active":"2024-09-19T05:42:59.178705+0000","last_became_peered":"2024-09-19T05:42:59.178705+0000","last_unstale":"2024-09-19T05:43:00.119514+0000","last_undegraded":"2024-09-19T05:43:00.119514+0000","last_fullsized":"2024-09-19T05:43:00.119514+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:40.586610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.120533+0000","last_change":"2024-09-19T05:42:59.172764+0000","last_active":"2024-09-19T05:43:00.120533+0000","last_peered":"2024-09-19T05:43:00.120533+0000","last_clean":"2024-09-19T05:43:00.120533+0000","last_became_active":"2024-09-19T05:42:59.172474+0000","last_became_peered":"2024-09-19T05:42:59.172474+0000","last_unstale":"2024-09-19T05:43:00.120533+0000","last_undegraded":"2024-09-19T05:43:00.120533+0000","last_fullsized":"2024-09-19T05:43:00.120533+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:07.984958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425368+0000","last_change":"2024-09-19T05:42:59.163951+0000","last_active":"2024-09-19T05:43:01.425368+0000","last_peered":"2024-09-19T05:43:01.425368+0000","last_clean":"2024-09-19T05:43:01.425368+0000","last_became_active":"2024-09-19T05:42:59.163041+0000","last_became_peered":"2024-09-19T05:42:59.163041+0000","last_unstale":"2024-09-19T05:43:01.425368+0000","last_undegraded":"2024-09-19T05:43:01.425368+0000","last_fullsized":"2024-09-19T05:43:01.425368+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:13.708636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.118862+0000","last_change":"2024-09-19T05:42:59.165823+0000","last_active":"2024-09-19T05:43:00.118862+0000","last_peered":"2024-09-19T05:43:00.118862+0000","last_clean":"2024-09-19T05:43:00.118862+0000","last_became_active":"2024-09-19T05:42:59.165115+0000","last_became_peered":"2024-09-19T05:42:59.165115+0000","last_unstale":"2024-09-19T05:43:00.118862+0000","last_undegraded":"2024-09-19T05:43:00.118862+0000","last_fullsized":"2024-09-19T05:43:00.118862+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:03.059446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.824166+0000","last_change":"2024-09-19T05:42:59.149177+0000","last_active":"2024-09-19T05:43:00.824166+0000","last_peered":"2024-09-19T05:43:00.824166+0000","last_clean":"2024-09-19T05:43:00.824166+0000","last_became_active":"2024-09-19T05:42:59.148773+0000","last_became_peered":"2024-09-19T05:42:59.148773+0000","last_unstale":"2024-09-19T05:43:00.824166+0000","last_undegraded":"2024-09-19T05:43:00.824166+0000","last_fullsized":"2024-09-19T05:43:00.824166+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:30.920894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.823988+0000","last_change":"2024-09-19T05:42:59.137845+0000","last_active":"2024-09-19T05:43:00.823988+0000","last_peered":"2024-09-19T05:43:00.823988+0000","last_clean":"2024-09-19T05:43:00.823988+0000","last_became_active":"2024-09-19T05:42:59.137473+0000","last_became_peered":"2024-09-19T05:42:59.137473+0000","last_unstale":"2024-09-19T05:43:00.823988+0000","last_undegraded":"2024-09-19T05:43:00.823988+0000","last_fullsized":"2024-09-19T05:43:00.823988+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:14.165668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119260+0000","last_change":"2024-09-19T05:42:59.172737+0000","last_active":"2024-09-19T05:43:00.119260+0000","last_peered":"2024-09-19T05:43:00.119260+0000","last_clean":"2024-09-19T05:43:00.119260+0000","last_became_active":"2024-09-19T05:42:59.172459+0000","last_became_peered":"2024-09-19T05:42:59.172459+0000","last_unstale":"2024-09-19T05:43:00.119260+0000","last_undegraded":"2024-09-19T05:43:00.119260+0000","last_fullsized":"2024-09-19T05:43:00.119260+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:01.848198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425968+0000","last_change":"2024-09-19T05:42:59.153492+0000","last_active":"2024-09-19T05:43:01.425968+0000","last_peered":"2024-09-19T05:43:01.425968+0000","last_clean":"2024-09-19T05:43:01.425968+0000","last_became_active":"2024-09-19T05:42:59.151882+0000","last_became_peered":"2024-09-19T05:42:59.151882+0000","last_unstale":"2024-09-19T05:43:01.425968+0000","last_undegraded":"2024-09-19T05:43:01.425968+0000","last_fullsized":"2024-09-19T05:43:01.425968+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:40.586610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426629+0000","last_change":"2024-09-19T05:42:59.134956+0000","last_active":"2024-09-19T05:43:01.426629+0000","last_peered":"2024-09-19T05:43:01.426629+0000","last_clean":"2024-09-19T05:43:01.426629+0000","last_became_active":"2024-09-19T05:42:59.134623+0000","last_became_peered":"2024-09-19T05:42:59.134623+0000","last_unstale":"2024-09-19T05:43:01.426629+0000","last_undegraded":"2024-09-19T05:43:01.426629+0000","last_fullsized":"2024-09-19T05:43:01.426629+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:14.139192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119378+0000","last_change":"2024-09-19T05:42:59.156120+0000","last_active":"2024-09-19T05:43:00.119378+0000","last_peered":"2024-09-19T05:43:00.119378+0000","last_clean":"2024-09-19T05:43:00.119378+0000","last_became_active":"2024-09-19T05:42:59.155365+0000","last_became_peered":"2024-09-19T05:42:59.155365+0000","last_unstale":"2024-09-19T05:43:00.119378+0000","last_undegraded":"2024-09-19T05:43:00.119378+0000","last_fullsized":"2024-09-19T05:43:00.119378+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:40.418485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.825264+0000","last_change":"2024-09-19T05:42:59.122034+0000","last_active":"2024-09-19T05:43:00.825264+0000","last_peered":"2024-09-19T05:43:00.825264+0000","last_clean":"2024-09-19T05:43:00.825264+0000","last_became_active":"2024-09-19T05:42:59.121552+0000","last_became_peered":"2024-09-19T05:42:59.121552+0000","last_unstale":"2024-09-19T05:43:00.825264+0000","last_undegraded":"2024-09-19T05:43:00.825264+0000","last_fullsized":"2024-09-19T05:43:00.825264+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:08.163706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426753+0000","last_change":"2024-09-19T05:42:59.169077+0000","last_active":"2024-09-19T05:43:01.426753+0000","last_peered":"2024-09-19T05:43:01.426753+0000","last_clean":"2024-09-19T05:43:01.426753+0000","last_became_active":"2024-09-19T05:42:59.168801+0000","last_became_peered":"2024-09-19T05:42:59.168801+0000","last_unstale":"2024-09-19T05:43:01.426753+0000","last_undegraded":"2024-09-19T05:43:01.426753+0000","last_fullsized":"2024-09-19T05:43:01.426753+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:14.648935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.120516+0000","last_change":"2024-09-19T05:42:59.171111+0000","last_active":"2024-09-19T05:43:00.120516+0000","last_peered":"2024-09-19T05:43:00.120516+0000","last_clean":"2024-09-19T05:43:00.120516+0000","last_became_active":"2024-09-19T05:42:59.170843+0000","last_became_peered":"2024-09-19T05:42:59.170843+0000","last_unstale":"2024-09-19T05:43:00.120516+0000","last_undegraded":"2024-09-19T05:43:00.120516+0000","last_fullsized":"2024-09-19T05:43:00.120516+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:29.896576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119258+0000","last_change":"2024-09-19T05:42:59.140066+0000","last_active":"2024-09-19T05:43:00.119258+0000","last_peered":"2024-09-19T05:43:00.119258+0000","last_clean":"2024-09-19T05:43:00.119258+0000","last_became_active":"2024-09-19T05:42:59.139183+0000","last_became_peered":"2024-09-19T05:42:59.139183+0000","last_unstale":"2024-09-19T05:43:00.119258+0000","last_undegraded":"2024-09-19T05:43:00.119258+0000","last_fullsized":"2024-09-19T05:43:00.119258+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:34.221171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.823794+0000","last_change":"2024-09-19T05:42:59.133231+0000","last_active":"2024-09-19T05:43:00.823794+0000","last_peered":"2024-09-19T05:43:00.823794+0000","last_clean":"2024-09-19T05:43:00.823794+0000","last_became_active":"2024-09-19T05:42:59.129703+0000","last_became_peered":"2024-09-19T05:42:59.129703+0000","last_unstale":"2024-09-19T05:43:00.823794+0000","last_undegraded":"2024-09-19T05:43:00.823794+0000","last_fullsized":"2024-09-19T05:43:00.823794+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:59.123547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426647+0000","last_change":"2024-09-19T05:42:59.170580+0000","last_active":"2024-09-19T05:43:01.426647+0000","last_peered":"2024-09-19T05:43:01.426647+0000","last_clean":"2024-09-19T05:43:01.426647+0000","last_became_active":"2024-09-19T05:42:59.170227+0000","last_became_peered":"2024-09-19T05:42:59.170227+0000","last_unstale":"2024-09-19T05:43:01.426647+0000","last_undegraded":"2024-09-19T05:43:01.426647+0000","last_fullsized":"2024-09-19T05:43:01.426647+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:23.711331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119696+0000","last_change":"2024-09-19T05:42:59.156914+0000","last_active":"2024-09-19T05:43:00.119696+0000","last_peered":"2024-09-19T05:43:00.119696+0000","last_clean":"2024-09-19T05:43:00.119696+0000","last_became_active":"2024-09-19T05:42:59.156604+0000","last_became_peered":"2024-09-19T05:42:59.156604+0000","last_unstale":"2024-09-19T05:43:00.119696+0000","last_undegraded":"2024-09-19T05:43:00.119696+0000","last_fullsized":"2024-09-19T05:43:00.119696+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:25.665682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.122692+0000","last_change":"2024-09-19T05:42:59.163383+0000","last_active":"2024-09-19T05:43:01.122692+0000","last_peered":"2024-09-19T05:43:01.122692+0000","last_clean":"2024-09-19T05:43:01.122692+0000","last_became_active":"2024-09-19T05:42:59.162725+0000","last_became_peered":"2024-09-19T05:42:59.162725+0000","last_unstale":"2024-09-19T05:43:01.122692+0000","last_undegraded":"2024-09-19T05:43:01.122692+0000","last_fullsized":"2024-09-19T05:43:01.122692+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:33.467959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425279+0000","last_change":"2024-09-19T05:42:59.135698+0000","last_active":"2024-09-19T05:43:01.425279+0000","last_peered":"2024-09-19T05:43:01.425279+0000","last_clean":"2024-09-19T05:43:01.425279+0000","last_became_active":"2024-09-19T05:42:59.135444+0000","last_became_peered":"2024-09-19T05:42:59.135444+0000","last_unstale":"2024-09-19T05:43:01.425279+0000","last_undegraded":"2024-09-19T05:43:01.425279+0000","last_fullsized":"2024-09-19T05:43:01.425279+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:18.633263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.424747+0000","last_change":"2024-09-19T05:42:59.151490+0000","last_active":"2024-09-19T05:43:01.424747+0000","last_peered":"2024-09-19T05:43:01.424747+0000","last_clean":"2024-09-19T05:43:01.424747+0000","last_became_active":"2024-09-19T05:42:59.144593+0000","last_became_peered":"2024-09-19T05:42:59.144593+0000","last_unstale":"2024-09-19T05:43:01.424747+0000","last_undegraded":"2024-09-19T05:43:01.424747+0000","last_fullsized":"2024-09-19T05:43:01.424747+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:23.092416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.118746+0000","last_change":"2024-09-19T05:42:59.150505+0000","last_active":"2024-09-19T05:43:00.118746+0000","last_peered":"2024-09-19T05:43:00.118746+0000","last_clean":"2024-09-19T05:43:00.118746+0000","last_became_active":"2024-09-19T05:42:59.149612+0000","last_became_peered":"2024-09-19T05:42:59.149612+0000","last_unstale":"2024-09-19T05:43:00.118746+0000","last_undegraded":"2024-09-19T05:43:00.118746+0000","last_fullsized":"2024-09-19T05:43:00.118746+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:43:10.056256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.424256+0000","last_change":"2024-09-19T05:42:59.174189+0000","last_active":"2024-09-19T05:43:01.424256+0000","last_peered":"2024-09-19T05:43:01.424256+0000","last_clean":"2024-09-19T05:43:01.424256+0000","last_became_active":"2024-09-19T05:42:59.173657+0000","last_became_peered":"2024-09-19T05:42:59.173657+0000","last_unstale":"2024-09-19T05:43:01.424256+0000","last_undegraded":"2024-09-19T05:43:01.424256+0000","last_fullsized":"2024-09-19T05:43:01.424256+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:20.066731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.424077+0000","last_change":"2024-09-19T05:42:59.176457+0000","last_active":"2024-09-19T05:43:01.424077+0000","last_peered":"2024-09-19T05:43:01.424077+0000","last_clean":"2024-09-19T05:43:01.424077+0000","last_became_active":"2024-09-19T05:42:59.175745+0000","last_became_peered":"2024-09-19T05:42:59.175745+0000","last_unstale":"2024-09-19T05:43:01.424077+0000","last_undegraded":"2024-09-19T05:43:01.424077+0000","last_fullsized":"2024-09-19T05:43:01.424077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:36:48.461480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425875+0000","last_change":"2024-09-19T05:42:59.165137+0000","last_active":"2024-09-19T05:43:01.425875+0000","last_peered":"2024-09-19T05:43:01.425875+0000","last_clean":"2024-09-19T05:43:01.425875+0000","last_became_active":"2024-09-19T05:42:59.163699+0000","last_became_peered":"2024-09-19T05:42:59.163699+0000","last_unstale":"2024-09-19T05:43:01.425875+0000","last_undegraded":"2024-09-19T05:43:01.425875+0000","last_fullsized":"2024-09-19T05:43:01.425875+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:33.796427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425340+0000","last_change":"2024-09-19T05:42:59.139942+0000","last_active":"2024-09-19T05:43:01.425340+0000","last_peered":"2024-09-19T05:43:01.425340+0000","last_clean":"2024-09-19T05:43:01.425340+0000","last_became_active":"2024-09-19T05:42:59.139612+0000","last_became_peered":"2024-09-19T05:42:59.139612+0000","last_unstale":"2024-09-19T05:43:01.425340+0000","last_undegraded":"2024-09-19T05:43:01.425340+0000","last_fullsized":"2024-09-19T05:43:01.425340+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:12.318821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.122988+0000","last_change":"2024-09-19T05:42:59.164222+0000","last_active":"2024-09-19T05:43:01.122988+0000","last_peered":"2024-09-19T05:43:01.122988+0000","last_clean":"2024-09-19T05:43:01.122988+0000","last_became_active":"2024-09-19T05:42:59.163411+0000","last_became_peered":"2024-09-19T05:42:59.163411+0000","last_unstale":"2024-09-19T05:43:01.122988+0000","last_undegraded":"2024-09-19T05:43:01.122988+0000","last_fullsized":"2024-09-19T05:43:01.122988+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:19.524722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.824828+0000","last_change":"2024-09-19T05:42:59.141655+0000","last_active":"2024-09-19T05:43:00.824828+0000","last_peered":"2024-09-19T05:43:00.824828+0000","last_clean":"2024-09-19T05:43:00.824828+0000","last_became_active":"2024-09-19T05:42:59.141406+0000","last_became_peered":"2024-09-19T05:42:59.141406+0000","last_unstale":"2024-09-19T05:43:00.824828+0000","last_undegraded":"2024-09-19T05:43:00.824828+0000","last_fullsized":"2024-09-19T05:43:00.824828+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:37:57.329616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425970+0000","last_change":"2024-09-19T05:42:59.151010+0000","last_active":"2024-09-19T05:43:01.425970+0000","last_peered":"2024-09-19T05:43:01.425970+0000","last_clean":"2024-09-19T05:43:01.425970+0000","last_became_active":"2024-09-19T05:42:59.150733+0000","last_became_peered":"2024-09-19T05:42:59.150733+0000","last_unstale":"2024-09-19T05:43:01.425970+0000","last_undegraded":"2024-09-19T05:43:01.425970+0000","last_fullsized":"2024-09-19T05:43:01.425970+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:46.171337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.120920+0000","last_change":"2024-09-19T05:42:59.160720+0000","last_active":"2024-09-19T05:43:00.120920+0000","last_peered":"2024-09-19T05:43:00.120920+0000","last_clean":"2024-09-19T05:43:00.120920+0000","last_became_active":"2024-09-19T05:42:59.160508+0000","last_became_peered":"2024-09-19T05:42:59.160508+0000","last_unstale":"2024-09-19T05:43:00.120920+0000","last_undegraded":"2024-09-19T05:43:00.120920+0000","last_fullsized":"2024-09-19T05:43:00.120920+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:41.263177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425117+0000","last_change":"2024-09-19T05:42:59.139877+0000","last_active":"2024-09-19T05:43:01.425117+0000","last_peered":"2024-09-19T05:43:01.425117+0000","last_clean":"2024-09-19T05:43:01.425117+0000","last_became_active":"2024-09-19T05:42:59.131099+0000","last_became_peered":"2024-09-19T05:42:59.131099+0000","last_unstale":"2024-09-19T05:43:01.425117+0000","last_undegraded":"2024-09-19T05:43:01.425117+0000","last_fullsized":"2024-09-19T05:43:01.425117+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:11.448437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.424505+0000","last_change":"2024-09-19T05:42:59.175380+0000","last_active":"2024-09-19T05:43:01.424505+0000","last_peered":"2024-09-19T05:43:01.424505+0000","last_clean":"2024-09-19T05:43:01.424505+0000","last_became_active":"2024-09-19T05:42:59.174759+0000","last_became_peered":"2024-09-19T05:42:59.174759+0000","last_unstale":"2024-09-19T05:43:01.424505+0000","last_undegraded":"2024-09-19T05:43:01.424505+0000","last_fullsized":"2024-09-19T05:43:01.424505+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:09.315607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426251+0000","last_change":"2024-09-19T05:42:59.137621+0000","last_active":"2024-09-19T05:43:01.426251+0000","last_peered":"2024-09-19T05:43:01.426251+0000","last_clean":"2024-09-19T05:43:01.426251+0000","last_became_active":"2024-09-19T05:42:59.136608+0000","last_became_peered":"2024-09-19T05:42:59.136608+0000","last_unstale":"2024-09-19T05:43:01.426251+0000","last_undegraded":"2024-09-19T05:43:01.426251+0000","last_fullsized":"2024-09-19T05:43:01.426251+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:12.642127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"131'4","reported_seq":18,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.122223+0000","last_change":"2024-09-19T05:42:58.146431+0000","last_active":"2024-09-19T05:43:01.122223+0000","last_peered":"2024-09-19T05:43:01.122223+0000","last_clean":"2024-09-19T05:43:01.122223+0000","last_became_active":"2024-09-19T05:42:58.145613+0000","last_became_peered":"2024-09-19T05:42:58.145613+0000","last_unstale":"2024-09-19T05:43:01.122223+0000","last_undegraded":"2024-09-19T05:43:01.122223+0000","last_fullsized":"2024-09-19T05:43:01.122223+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:14.589444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.824943+0000","last_change":"2024-09-19T05:42:59.146664+0000","last_active":"2024-09-19T05:43:00.824943+0000","last_peered":"2024-09-19T05:43:00.824943+0000","last_clean":"2024-09-19T05:43:00.824943+0000","last_became_active":"2024-09-19T05:42:59.146347+0000","last_became_peered":"2024-09-19T05:42:59.146347+0000","last_unstale":"2024-09-19T05:43:00.824943+0000","last_undegraded":"2024-09-19T05:43:00.824943+0000","last_fullsized":"2024-09-19T05:43:00.824943+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426775+0000","last_change":"2024-09-19T05:42:58.125017+0000","last_active":"2024-09-19T05:43:01.426775+0000","last_peered":"2024-09-19T05:43:01.426775+0000","last_clean":"2024-09-19T05:43:01.426775+0000","last_became_active":"2024-09-19T05:42:58.124704+0000","last_became_peered":"2024-09-19T05:42:58.124704+0000","last_unstale":"2024-09-19T05:43:01.426775+0000","last_undegraded":"2024-09-19T05:43:01.426775+0000","last_fullsized":"2024-09-19T05:43:01.426775+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:18.391721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.424458+0000","last_change":"2024-09-19T05:42:59.149883+0000","last_active":"2024-09-19T05:43:01.424458+0000","last_peered":"2024-09-19T05:43:01.424458+0000","last_clean":"2024-09-19T05:43:01.424458+0000","last_became_active":"2024-09-19T05:42:59.149161+0000","last_became_peered":"2024-09-19T05:42:59.149161+0000","last_unstale":"2024-09-19T05:43:01.424458+0000","last_undegraded":"2024-09-19T05:43:01.424458+0000","last_fullsized":"2024-09-19T05:43:01.424458+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:44.554357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425425+0000","last_change":"2024-09-19T05:42:58.139157+0000","last_active":"2024-09-19T05:43:01.425425+0000","last_peered":"2024-09-19T05:43:01.425425+0000","last_clean":"2024-09-19T05:43:01.425425+0000","last_became_active":"2024-09-19T05:42:58.138398+0000","last_became_peered":"2024-09-19T05:42:58.138398+0000","last_unstale":"2024-09-19T05:43:01.425425+0000","last_undegraded":"2024-09-19T05:43:01.425425+0000","last_fullsized":"2024-09-19T05:43:01.425425+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:11.638147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426346+0000","last_change":"2024-09-19T05:42:59.146011+0000","last_active":"2024-09-19T05:43:01.426346+0000","last_peered":"2024-09-19T05:43:01.426346+0000","last_clean":"2024-09-19T05:43:01.426346+0000","last_became_active":"2024-09-19T05:42:59.145171+0000","last_became_peered":"2024-09-19T05:42:59.145171+0000","last_unstale":"2024-09-19T05:43:01.426346+0000","last_undegraded":"2024-09-19T05:43:01.426346+0000","last_fullsized":"2024-09-19T05:43:01.426346+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:25.665682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426182+0000","last_change":"2024-09-19T05:42:58.133138+0000","last_active":"2024-09-19T05:43:01.426182+0000","last_peered":"2024-09-19T05:43:01.426182+0000","last_clean":"2024-09-19T05:43:01.426182+0000","last_became_active":"2024-09-19T05:42:58.132756+0000","last_became_peered":"2024-09-19T05:42:58.132756+0000","last_unstale":"2024-09-19T05:43:01.426182+0000","last_undegraded":"2024-09-19T05:43:01.426182+0000","last_fullsized":"2024-09-19T05:43:01.426182+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:49.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426262+0000","last_change":"2024-09-19T05:42:59.171810+0000","last_active":"2024-09-19T05:43:01.426262+0000","last_peered":"2024-09-19T05:43:01.426262+0000","last_clean":"2024-09-19T05:43:01.426262+0000","last_became_active":"2024-09-19T05:42:59.171469+0000","last_became_peered":"2024-09-19T05:42:59.171469+0000","last_unstale":"2024-09-19T05:43:01.426262+0000","last_undegraded":"2024-09-19T05:43:01.426262+0000","last_fullsized":"2024-09-19T05:43:01.426262+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:06.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.118879+0000","last_change":"2024-09-19T05:42:58.123020+0000","last_active":"2024-09-19T05:43:00.118879+0000","last_peered":"2024-09-19T05:43:00.118879+0000","last_clean":"2024-09-19T05:43:00.118879+0000","last_became_active":"2024-09-19T05:42:58.122308+0000","last_became_peered":"2024-09-19T05:42:58.122308+0000","last_unstale":"2024-09-19T05:43:00.118879+0000","last_undegraded":"2024-09-19T05:43:00.118879+0000","last_fullsized":"2024-09-19T05:43:00.118879+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:44.860437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.118696+0000","last_change":"2024-09-19T05:42:59.141829+0000","last_active":"2024-09-19T05:43:00.118696+0000","last_peered":"2024-09-19T05:43:00.118696+0000","last_clean":"2024-09-19T05:43:00.118696+0000","last_became_active":"2024-09-19T05:42:59.141049+0000","last_became_peered":"2024-09-19T05:42:59.141049+0000","last_unstale":"2024-09-19T05:43:00.118696+0000","last_undegraded":"2024-09-19T05:43:00.118696+0000","last_fullsized":"2024-09-19T05:43:00.118696+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:50.025626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.824331+0000","last_change":"2024-09-19T05:42:58.135684+0000","last_active":"2024-09-19T05:43:00.824331+0000","last_peered":"2024-09-19T05:43:00.824331+0000","last_clean":"2024-09-19T05:43:00.824331+0000","last_became_active":"2024-09-19T05:42:58.135214+0000","last_became_peered":"2024-09-19T05:42:58.135214+0000","last_unstale":"2024-09-19T05:43:00.824331+0000","last_undegraded":"2024-09-19T05:43:00.824331+0000","last_fullsized":"2024-09-19T05:43:00.824331+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:00.938099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.120972+0000","last_change":"2024-09-19T05:42:59.147979+0000","last_active":"2024-09-19T05:43:00.120972+0000","last_peered":"2024-09-19T05:43:00.120972+0000","last_clean":"2024-09-19T05:43:00.120972+0000","last_became_active":"2024-09-19T05:42:59.147705+0000","last_became_peered":"2024-09-19T05:42:59.147705+0000","last_unstale":"2024-09-19T05:43:00.120972+0000","last_undegraded":"2024-09-19T05:43:00.120972+0000","last_fullsized":"2024-09-19T05:43:00.120972+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:06.007859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425250+0000","last_change":"2024-09-19T05:42:58.152837+0000","last_active":"2024-09-19T05:43:01.425250+0000","last_peered":"2024-09-19T05:43:01.425250+0000","last_clean":"2024-09-19T05:43:01.425250+0000","last_became_active":"2024-09-19T05:42:58.149079+0000","last_became_peered":"2024-09-19T05:42:58.149079+0000","last_unstale":"2024-09-19T05:43:01.425250+0000","last_undegraded":"2024-09-19T05:43:01.425250+0000","last_fullsized":"2024-09-19T05:43:01.425250+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:37.607322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.427008+0000","last_change":"2024-09-19T05:42:59.149779+0000","last_active":"2024-09-19T05:43:01.427008+0000","last_peered":"2024-09-19T05:43:01.427008+0000","last_clean":"2024-09-19T05:43:01.427008+0000","last_became_active":"2024-09-19T05:42:59.149402+0000","last_became_peered":"2024-09-19T05:42:59.149402+0000","last_unstale":"2024-09-19T05:43:01.427008+0000","last_undegraded":"2024-09-19T05:43:01.427008+0000","last_fullsized":"2024-09-19T05:43:01.427008+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:10:00.646213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.824031+0000","last_change":"2024-09-19T05:42:58.133828+0000","last_active":"2024-09-19T05:43:00.824031+0000","last_peered":"2024-09-19T05:43:00.824031+0000","last_clean":"2024-09-19T05:43:00.824031+0000","last_became_active":"2024-09-19T05:42:58.133448+0000","last_became_peered":"2024-09-19T05:42:58.133448+0000","last_unstale":"2024-09-19T05:43:00.824031+0000","last_undegraded":"2024-09-19T05:43:00.824031+0000","last_fullsized":"2024-09-19T05:43:00.824031+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:48.372256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.122433+0000","last_change":"2024-09-19T05:42:59.160998+0000","last_active":"2024-09-19T05:43:01.122433+0000","last_peered":"2024-09-19T05:43:01.122433+0000","last_clean":"2024-09-19T05:43:01.122433+0000","last_became_active":"2024-09-19T05:42:59.160279+0000","last_became_peered":"2024-09-19T05:42:59.160279+0000","last_unstale":"2024-09-19T05:43:01.122433+0000","last_undegraded":"2024-09-19T05:43:01.122433+0000","last_fullsized":"2024-09-19T05:43:01.122433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:34.210492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.122565+0000","last_change":"2024-09-19T05:42:58.144688+0000","last_active":"2024-09-19T05:43:01.122565+0000","last_peered":"2024-09-19T05:43:01.122565+0000","last_clean":"2024-09-19T05:43:01.122565+0000","last_became_active":"2024-09-19T05:42:58.143935+0000","last_became_peered":"2024-09-19T05:42:58.143935+0000","last_unstale":"2024-09-19T05:43:01.122565+0000","last_undegraded":"2024-09-19T05:43:01.122565+0000","last_fullsized":"2024-09-19T05:43:01.122565+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:49.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425088+0000","last_change":"2024-09-19T05:42:59.155140+0000","last_active":"2024-09-19T05:43:01.425088+0000","last_peered":"2024-09-19T05:43:01.425088+0000","last_clean":"2024-09-19T05:43:01.425088+0000","last_became_active":"2024-09-19T05:42:59.151546+0000","last_became_peered":"2024-09-19T05:42:59.151546+0000","last_unstale":"2024-09-19T05:43:01.425088+0000","last_undegraded":"2024-09-19T05:43:01.425088+0000","last_fullsized":"2024-09-19T05:43:01.425088+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:15.139328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.424612+0000","last_change":"2024-09-19T05:42:58.153127+0000","last_active":"2024-09-19T05:43:01.424612+0000","last_peered":"2024-09-19T05:43:01.424612+0000","last_clean":"2024-09-19T05:43:01.424612+0000","last_became_active":"2024-09-19T05:42:58.149632+0000","last_became_peered":"2024-09-19T05:42:58.149632+0000","last_unstale":"2024-09-19T05:43:01.424612+0000","last_undegraded":"2024-09-19T05:43:01.424612+0000","last_fullsized":"2024-09-19T05:43:01.424612+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:47.896028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119868+0000","last_change":"2024-09-19T05:42:59.176008+0000","last_active":"2024-09-19T05:43:00.119868+0000","last_peered":"2024-09-19T05:43:00.119868+0000","last_clean":"2024-09-19T05:43:00.119868+0000","last_became_active":"2024-09-19T05:42:59.175735+0000","last_became_peered":"2024-09-19T05:42:59.175735+0000","last_unstale":"2024-09-19T05:43:00.119868+0000","last_undegraded":"2024-09-19T05:43:00.119868+0000","last_fullsized":"2024-09-19T05:43:00.119868+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:45.546847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"131'3","reported_seq":17,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425233+0000","last_change":"2024-09-19T05:42:58.153706+0000","last_active":"2024-09-19T05:43:01.425233+0000","last_peered":"2024-09-19T05:43:01.425233+0000","last_clean":"2024-09-19T05:43:01.425233+0000","last_became_active":"2024-09-19T05:42:58.153142+0000","last_became_peered":"2024-09-19T05:42:58.153142+0000","last_unstale":"2024-09-19T05:43:01.425233+0000","last_undegraded":"2024-09-19T05:43:01.425233+0000","last_fullsized":"2024-09-19T05:43:01.425233+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:01.145548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426228+0000","last_change":"2024-09-19T05:42:59.164570+0000","last_active":"2024-09-19T05:43:01.426228+0000","last_peered":"2024-09-19T05:43:01.426228+0000","last_clean":"2024-09-19T05:43:01.426228+0000","last_became_active":"2024-09-19T05:42:59.162956+0000","last_became_peered":"2024-09-19T05:42:59.162956+0000","last_unstale":"2024-09-19T05:43:01.426228+0000","last_undegraded":"2024-09-19T05:43:01.426228+0000","last_fullsized":"2024-09-19T05:43:01.426228+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:50.780699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"131'6","reported_seq":20,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119247+0000","last_change":"2024-09-19T05:42:58.136802+0000","last_active":"2024-09-19T05:43:00.119247+0000","last_peered":"2024-09-19T05:43:00.119247+0000","last_clean":"2024-09-19T05:43:00.119247+0000","last_became_active":"2024-09-19T05:42:58.136314+0000","last_became_peered":"2024-09-19T05:42:58.136314+0000","last_unstale":"2024-09-19T05:43:00.119247+0000","last_undegraded":"2024-09-19T05:43:00.119247+0000","last_fullsized":"2024-09-19T05:43:00.119247+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:11.638147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.122858+0000","last_change":"2024-09-19T05:42:59.167437+0000","last_active":"2024-09-19T05:43:01.122858+0000","last_peered":"2024-09-19T05:43:01.122858+0000","last_clean":"2024-09-19T05:43:01.122858+0000","last_became_active":"2024-09-19T05:42:59.166560+0000","last_became_peered":"2024-09-19T05:42:59.166560+0000","last_unstale":"2024-09-19T05:43:01.122858+0000","last_undegraded":"2024-09-19T05:43:01.122858+0000","last_fullsized":"2024-09-19T05:43:01.122858+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:12.986172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119279+0000","last_change":"2024-09-19T05:42:58.137000+0000","last_active":"2024-09-19T05:43:00.119279+0000","last_peered":"2024-09-19T05:43:00.119279+0000","last_clean":"2024-09-19T05:43:00.119279+0000","last_became_active":"2024-09-19T05:42:58.136678+0000","last_became_peered":"2024-09-19T05:42:58.136678+0000","last_unstale":"2024-09-19T05:43:00.119279+0000","last_undegraded":"2024-09-19T05:43:00.119279+0000","last_fullsized":"2024-09-19T05:43:00.119279+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:22.707352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425973+0000","last_change":"2024-09-19T05:42:59.148492+0000","last_active":"2024-09-19T05:43:01.425973+0000","last_peered":"2024-09-19T05:43:01.425973+0000","last_clean":"2024-09-19T05:43:01.425973+0000","last_became_active":"2024-09-19T05:42:59.148185+0000","last_became_peered":"2024-09-19T05:42:59.148185+0000","last_unstale":"2024-09-19T05:43:01.425973+0000","last_undegraded":"2024-09-19T05:43:01.425973+0000","last_fullsized":"2024-09-19T05:43:01.425973+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:33.029115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.121275+0000","last_change":"2024-09-19T05:42:58.159115+0000","last_active":"2024-09-19T05:43:00.121275+0000","last_peered":"2024-09-19T05:43:00.121275+0000","last_clean":"2024-09-19T05:43:00.121275+0000","last_became_active":"2024-09-19T05:42:58.158652+0000","last_became_peered":"2024-09-19T05:42:58.158652+0000","last_unstale":"2024-09-19T05:43:00.121275+0000","last_undegraded":"2024-09-19T05:43:00.121275+0000","last_fullsized":"2024-09-19T05:43:00.121275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:59.642234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425093+0000","last_change":"2024-09-19T05:42:59.162199+0000","last_active":"2024-09-19T05:43:01.425093+0000","last_peered":"2024-09-19T05:43:01.425093+0000","last_clean":"2024-09-19T05:43:01.425093+0000","last_became_active":"2024-09-19T05:42:59.161999+0000","last_became_peered":"2024-09-19T05:42:59.161999+0000","last_unstale":"2024-09-19T05:43:01.425093+0000","last_undegraded":"2024-09-19T05:43:01.425093+0000","last_fullsized":"2024-09-19T05:43:01.425093+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:51.913601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119603+0000","last_change":"2024-09-19T05:42:58.138481+0000","last_active":"2024-09-19T05:43:00.119603+0000","last_peered":"2024-09-19T05:43:00.119603+0000","last_clean":"2024-09-19T05:43:00.119603+0000","last_became_active":"2024-09-19T05:42:58.138207+0000","last_became_peered":"2024-09-19T05:42:58.138207+0000","last_unstale":"2024-09-19T05:43:00.119603+0000","last_undegraded":"2024-09-19T05:43:00.119603+0000","last_fullsized":"2024-09-19T05:43:00.119603+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:59.155804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.424760+0000","last_change":"2024-09-19T05:42:59.150036+0000","last_active":"2024-09-19T05:43:01.424760+0000","last_peered":"2024-09-19T05:43:01.424760+0000","last_clean":"2024-09-19T05:43:01.424760+0000","last_became_active":"2024-09-19T05:42:59.149265+0000","last_became_peered":"2024-09-19T05:42:59.149265+0000","last_unstale":"2024-09-19T05:43:01.424760+0000","last_undegraded":"2024-09-19T05:43:01.424760+0000","last_fullsized":"2024-09-19T05:43:01.424760+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:06.837134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426451+0000","last_change":"2024-09-19T05:42:58.130325+0000","last_active":"2024-09-19T05:43:01.426451+0000","last_peered":"2024-09-19T05:43:01.426451+0000","last_clean":"2024-09-19T05:43:01.426451+0000","last_became_active":"2024-09-19T05:42:58.130013+0000","last_became_peered":"2024-09-19T05:42:58.130013+0000","last_unstale":"2024-09-19T05:43:01.426451+0000","last_undegraded":"2024-09-19T05:43:01.426451+0000","last_fullsized":"2024-09-19T05:43:01.426451+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:14.589444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119694+0000","last_change":"2024-09-19T05:42:59.147329+0000","last_active":"2024-09-19T05:43:00.119694+0000","last_peered":"2024-09-19T05:43:00.119694+0000","last_clean":"2024-09-19T05:43:00.119694+0000","last_became_active":"2024-09-19T05:42:59.146629+0000","last_became_peered":"2024-09-19T05:42:59.146629+0000","last_unstale":"2024-09-19T05:43:00.119694+0000","last_undegraded":"2024-09-19T05:43:00.119694+0000","last_fullsized":"2024-09-19T05:43:00.119694+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:53.815539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425468+0000","last_change":"2024-09-19T05:42:58.127717+0000","last_active":"2024-09-19T05:43:01.425468+0000","last_peered":"2024-09-19T05:43:01.425468+0000","last_clean":"2024-09-19T05:43:01.425468+0000","last_became_active":"2024-09-19T05:42:58.127278+0000","last_became_peered":"2024-09-19T05:42:58.127278+0000","last_unstale":"2024-09-19T05:43:01.425468+0000","last_undegraded":"2024-09-19T05:43:01.425468+0000","last_fullsized":"2024-09-19T05:43:01.425468+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:59.950341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.824935+0000","last_change":"2024-09-19T05:42:59.171049+0000","last_active":"2024-09-19T05:43:00.824935+0000","last_peered":"2024-09-19T05:43:00.824935+0000","last_clean":"2024-09-19T05:43:00.824935+0000","last_became_active":"2024-09-19T05:42:59.170747+0000","last_became_peered":"2024-09-19T05:42:59.170747+0000","last_unstale":"2024-09-19T05:43:00.824935+0000","last_undegraded":"2024-09-19T05:43:00.824935+0000","last_fullsized":"2024-09-19T05:43:00.824935+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:38.829544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425693+0000","last_change":"2024-09-19T05:42:58.156923+0000","last_active":"2024-09-19T05:43:01.425693+0000","last_peered":"2024-09-19T05:43:01.425693+0000","last_clean":"2024-09-19T05:43:01.425693+0000","last_became_active":"2024-09-19T05:42:58.156289+0000","last_became_peered":"2024-09-19T05:42:58.156289+0000","last_unstale":"2024-09-19T05:43:01.425693+0000","last_undegraded":"2024-09-19T05:43:01.425693+0000","last_fullsized":"2024-09-19T05:43:01.425693+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:13.135212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426270+0000","last_change":"2024-09-19T05:42:59.178997+0000","last_active":"2024-09-19T05:43:01.426270+0000","last_peered":"2024-09-19T05:43:01.426270+0000","last_clean":"2024-09-19T05:43:01.426270+0000","last_became_active":"2024-09-19T05:42:59.178470+0000","last_became_peered":"2024-09-19T05:42:59.178470+0000","last_unstale":"2024-09-19T05:43:01.426270+0000","last_undegraded":"2024-09-19T05:43:01.426270+0000","last_fullsized":"2024-09-19T05:43:01.426270+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:10.000046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425167+0000","last_change":"2024-09-19T05:42:58.135599+0000","last_active":"2024-09-19T05:43:01.425167+0000","last_peered":"2024-09-19T05:43:01.425167+0000","last_clean":"2024-09-19T05:43:01.425167+0000","last_became_active":"2024-09-19T05:42:58.134849+0000","last_became_peered":"2024-09-19T05:42:58.134849+0000","last_unstale":"2024-09-19T05:43:01.425167+0000","last_undegraded":"2024-09-19T05:43:01.425167+0000","last_fullsized":"2024-09-19T05:43:01.425167+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:05.991835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.823789+0000","last_change":"2024-09-19T05:42:59.169914+0000","last_active":"2024-09-19T05:43:00.823789+0000","last_peered":"2024-09-19T05:43:00.823789+0000","last_clean":"2024-09-19T05:43:00.823789+0000","last_became_active":"2024-09-19T05:42:59.169515+0000","last_became_peered":"2024-09-19T05:42:59.169515+0000","last_unstale":"2024-09-19T05:43:00.823789+0000","last_undegraded":"2024-09-19T05:43:00.823789+0000","last_fullsized":"2024-09-19T05:43:00.823789+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:04.698854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.824175+0000","last_change":"2024-09-19T05:42:58.143141+0000","last_active":"2024-09-19T05:43:00.824175+0000","last_peered":"2024-09-19T05:43:00.824175+0000","last_clean":"2024-09-19T05:43:00.824175+0000","last_became_active":"2024-09-19T05:42:58.142642+0000","last_became_peered":"2024-09-19T05:42:58.142642+0000","last_unstale":"2024-09-19T05:43:00.824175+0000","last_undegraded":"2024-09-19T05:43:00.824175+0000","last_fullsized":"2024-09-19T05:43:00.824175+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:13.246696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119467+0000","last_change":"2024-09-19T05:42:59.145761+0000","last_active":"2024-09-19T05:43:00.119467+0000","last_peered":"2024-09-19T05:43:00.119467+0000","last_clean":"2024-09-19T05:43:00.119467+0000","last_became_active":"2024-09-19T05:42:59.145354+0000","last_became_peered":"2024-09-19T05:42:59.145354+0000","last_unstale":"2024-09-19T05:43:00.119467+0000","last_undegraded":"2024-09-19T05:43:00.119467+0000","last_fullsized":"2024-09-19T05:43:00.119467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:13.708636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.424542+0000","last_change":"2024-09-19T05:42:58.139165+0000","last_active":"2024-09-19T05:43:01.424542+0000","last_peered":"2024-09-19T05:43:01.424542+0000","last_clean":"2024-09-19T05:43:01.424542+0000","last_became_active":"2024-09-19T05:42:58.138547+0000","last_became_peered":"2024-09-19T05:42:58.138547+0000","last_unstale":"2024-09-19T05:43:01.424542+0000","last_undegraded":"2024-09-19T05:43:01.424542+0000","last_fullsized":"2024-09-19T05:43:01.424542+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:22.707352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.121270+0000","last_change":"2024-09-19T05:42:59.171080+0000","last_active":"2024-09-19T05:43:00.121270+0000","last_peered":"2024-09-19T05:43:00.121270+0000","last_clean":"2024-09-19T05:43:00.121270+0000","last_became_active":"2024-09-19T05:42:59.170788+0000","last_became_peered":"2024-09-19T05:42:59.170788+0000","last_unstale":"2024-09-19T05:43:00.121270+0000","last_undegraded":"2024-09-19T05:43:00.121270+0000","last_fullsized":"2024-09-19T05:43:00.121270+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:43.353687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119777+0000","last_change":"2024-09-19T05:42:58.137359+0000","last_active":"2024-09-19T05:43:00.119777+0000","last_peered":"2024-09-19T05:43:00.119777+0000","last_clean":"2024-09-19T05:43:00.119777+0000","last_became_active":"2024-09-19T05:42:58.137086+0000","last_became_peered":"2024-09-19T05:42:58.137086+0000","last_unstale":"2024-09-19T05:43:00.119777+0000","last_undegraded":"2024-09-19T05:43:00.119777+0000","last_fullsized":"2024-09-19T05:43:00.119777+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:05.991835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425733+0000","last_change":"2024-09-19T05:42:59.136184+0000","last_active":"2024-09-19T05:43:01.425733+0000","last_peered":"2024-09-19T05:43:01.425733+0000","last_clean":"2024-09-19T05:43:01.425733+0000","last_became_active":"2024-09-19T05:42:59.135406+0000","last_became_peered":"2024-09-19T05:42:59.135406+0000","last_unstale":"2024-09-19T05:43:01.425733+0000","last_undegraded":"2024-09-19T05:43:01.425733+0000","last_fullsized":"2024-09-19T05:43:01.425733+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:59.709704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.423595+0000","last_change":"2024-09-19T05:42:58.140382+0000","last_active":"2024-09-19T05:43:01.423595+0000","last_peered":"2024-09-19T05:43:01.423595+0000","last_clean":"2024-09-19T05:43:01.423595+0000","last_became_active":"2024-09-19T05:42:58.139037+0000","last_became_peered":"2024-09-19T05:42:58.139037+0000","last_unstale":"2024-09-19T05:43:01.423595+0000","last_undegraded":"2024-09-19T05:43:01.423595+0000","last_fullsized":"2024-09-19T05:43:01.423595+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:33:32.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.825245+0000","last_change":"2024-09-19T05:42:59.134602+0000","last_active":"2024-09-19T05:43:00.825245+0000","last_peered":"2024-09-19T05:43:00.825245+0000","last_clean":"2024-09-19T05:43:00.825245+0000","last_became_active":"2024-09-19T05:42:59.133941+0000","last_became_peered":"2024-09-19T05:42:59.133941+0000","last_unstale":"2024-09-19T05:43:00.825245+0000","last_undegraded":"2024-09-19T05:43:00.825245+0000","last_fullsized":"2024-09-19T05:43:00.825245+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:55.380526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.824575+0000","last_change":"2024-09-19T05:42:58.137504+0000","last_active":"2024-09-19T05:43:00.824575+0000","last_peered":"2024-09-19T05:43:00.824575+0000","last_clean":"2024-09-19T05:43:00.824575+0000","last_became_active":"2024-09-19T05:42:58.137215+0000","last_became_peered":"2024-09-19T05:42:58.137215+0000","last_unstale":"2024-09-19T05:43:00.824575+0000","last_undegraded":"2024-09-19T05:43:00.824575+0000","last_fullsized":"2024-09-19T05:43:00.824575+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:15.793700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426019+0000","last_change":"2024-09-19T05:42:59.171738+0000","last_active":"2024-09-19T05:43:01.426019+0000","last_peered":"2024-09-19T05:43:01.426019+0000","last_clean":"2024-09-19T05:43:01.426019+0000","last_became_active":"2024-09-19T05:42:59.171447+0000","last_became_peered":"2024-09-19T05:42:59.171447+0000","last_unstale":"2024-09-19T05:43:01.426019+0000","last_undegraded":"2024-09-19T05:43:01.426019+0000","last_fullsized":"2024-09-19T05:43:01.426019+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:00.159783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"132'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.122656+0000","last_change":"2024-09-19T05:42:58.134080+0000","last_active":"2024-09-19T05:43:01.122656+0000","last_peered":"2024-09-19T05:43:01.122656+0000","last_clean":"2024-09-19T05:43:01.122656+0000","last_became_active":"2024-09-19T05:42:58.133407+0000","last_became_peered":"2024-09-19T05:42:58.133407+0000","last_unstale":"2024-09-19T05:43:01.122656+0000","last_undegraded":"2024-09-19T05:43:01.122656+0000","last_fullsized":"2024-09-19T05:43:01.122656+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:43:09.052276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.426149+0000","last_change":"2024-09-19T05:42:59.163303+0000","last_active":"2024-09-19T05:43:01.426149+0000","last_peered":"2024-09-19T05:43:01.426149+0000","last_clean":"2024-09-19T05:43:01.426149+0000","last_became_active":"2024-09-19T05:42:59.162504+0000","last_became_peered":"2024-09-19T05:42:59.162504+0000","last_unstale":"2024-09-19T05:43:01.426149+0000","last_undegraded":"2024-09-19T05:43:01.426149+0000","last_fullsized":"2024-09-19T05:43:01.426149+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:53.774615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.122794+0000","last_change":"2024-09-19T05:42:58.146005+0000","last_active":"2024-09-19T05:43:01.122794+0000","last_peered":"2024-09-19T05:43:01.122794+0000","last_clean":"2024-09-19T05:43:01.122794+0000","last_became_active":"2024-09-19T05:42:58.143780+0000","last_became_peered":"2024-09-19T05:42:58.143780+0000","last_unstale":"2024-09-19T05:43:01.122794+0000","last_undegraded":"2024-09-19T05:43:01.122794+0000","last_fullsized":"2024-09-19T05:43:01.122794+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:18.391721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425849+0000","last_change":"2024-09-19T05:42:59.167663+0000","last_active":"2024-09-19T05:43:01.425849+0000","last_peered":"2024-09-19T05:43:01.425849+0000","last_clean":"2024-09-19T05:43:01.425849+0000","last_became_active":"2024-09-19T05:42:59.167323+0000","last_became_peered":"2024-09-19T05:42:59.167323+0000","last_unstale":"2024-09-19T05:43:01.425849+0000","last_undegraded":"2024-09-19T05:43:01.425849+0000","last_fullsized":"2024-09-19T05:43:01.425849+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:32.596145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.825330+0000","last_change":"2024-09-19T05:42:58.135626+0000","last_active":"2024-09-19T05:43:00.825330+0000","last_peered":"2024-09-19T05:43:00.825330+0000","last_clean":"2024-09-19T05:43:00.825330+0000","last_became_active":"2024-09-19T05:42:58.134065+0000","last_became_peered":"2024-09-19T05:42:58.134065+0000","last_unstale":"2024-09-19T05:43:00.825330+0000","last_undegraded":"2024-09-19T05:43:00.825330+0000","last_fullsized":"2024-09-19T05:43:00.825330+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:18.667350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.824404+0000","last_change":"2024-09-19T05:42:59.124109+0000","last_active":"2024-09-19T05:43:00.824404+0000","last_peered":"2024-09-19T05:43:00.824404+0000","last_clean":"2024-09-19T05:43:00.824404+0000","last_became_active":"2024-09-19T05:42:59.123434+0000","last_became_peered":"2024-09-19T05:42:59.123434+0000","last_unstale":"2024-09-19T05:43:00.824404+0000","last_undegraded":"2024-09-19T05:43:00.824404+0000","last_fullsized":"2024-09-19T05:43:00.824404+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:32:14.584583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119015+0000","last_change":"2024-09-19T05:42:58.134127+0000","last_active":"2024-09-19T05:43:00.119015+0000","last_peered":"2024-09-19T05:43:00.119015+0000","last_clean":"2024-09-19T05:43:00.119015+0000","last_became_active":"2024-09-19T05:42:58.133357+0000","last_became_peered":"2024-09-19T05:42:58.133357+0000","last_unstale":"2024-09-19T05:43:00.119015+0000","last_undegraded":"2024-09-19T05:43:00.119015+0000","last_fullsized":"2024-09-19T05:43:00.119015+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:35.972783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.119655+0000","last_change":"2024-09-19T05:42:59.171329+0000","last_active":"2024-09-19T05:43:00.119655+0000","last_peered":"2024-09-19T05:43:00.119655+0000","last_clean":"2024-09-19T05:43:00.119655+0000","last_became_active":"2024-09-19T05:42:59.170974+0000","last_became_peered":"2024-09-19T05:42:59.170974+0000","last_unstale":"2024-09-19T05:43:00.119655+0000","last_undegraded":"2024-09-19T05:43:00.119655+0000","last_fullsized":"2024-09-19T05:43:00.119655+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:53.774615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.118753+0000","last_change":"2024-09-19T05:42:58.151366+0000","last_active":"2024-09-19T05:43:00.118753+0000","last_peered":"2024-09-19T05:43:00.118753+0000","last_clean":"2024-09-19T05:43:00.118753+0000","last_became_active":"2024-09-19T05:42:58.150676+0000","last_became_peered":"2024-09-19T05:42:58.150676+0000","last_unstale":"2024-09-19T05:43:00.118753+0000","last_undegraded":"2024-09-19T05:43:00.118753+0000","last_fullsized":"2024-09-19T05:43:00.118753+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:08.362608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.424408+0000","last_change":"2024-09-19T05:42:59.152995+0000","last_active":"2024-09-19T05:43:01.424408+0000","last_peered":"2024-09-19T05:43:01.424408+0000","last_clean":"2024-09-19T05:43:01.424408+0000","last_became_active":"2024-09-19T05:42:59.146302+0000","last_became_peered":"2024-09-19T05:42:59.146302+0000","last_unstale":"2024-09-19T05:43:01.424408+0000","last_undegraded":"2024-09-19T05:43:01.424408+0000","last_fullsized":"2024-09-19T05:43:01.424408+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:52.412145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.823833+0000","last_change":"2024-09-19T05:42:58.133600+0000","last_active":"2024-09-19T05:43:00.823833+0000","last_peered":"2024-09-19T05:43:00.823833+0000","last_clean":"2024-09-19T05:43:00.823833+0000","last_became_active":"2024-09-19T05:42:58.133288+0000","last_became_peered":"2024-09-19T05:42:58.133288+0000","last_unstale":"2024-09-19T05:43:00.823833+0000","last_undegraded":"2024-09-19T05:43:00.823833+0000","last_fullsized":"2024-09-19T05:43:00.823833+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:08:15.090566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.427089+0000","last_change":"2024-09-19T05:42:59.148960+0000","last_active":"2024-09-19T05:43:01.427089+0000","last_peered":"2024-09-19T05:43:01.427089+0000","last_clean":"2024-09-19T05:43:01.427089+0000","last_became_active":"2024-09-19T05:42:59.148253+0000","last_became_peered":"2024-09-19T05:42:59.148253+0000","last_unstale":"2024-09-19T05:43:01.427089+0000","last_undegraded":"2024-09-19T05:43:01.427089+0000","last_fullsized":"2024-09-19T05:43:01.427089+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:12.251697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.423595+0000","last_change":"2024-09-19T05:42:58.145273+0000","last_active":"2024-09-19T05:43:01.423595+0000","last_peered":"2024-09-19T05:43:01.423595+0000","last_clean":"2024-09-19T05:43:01.423595+0000","last_became_active":"2024-09-19T05:42:58.144572+0000","last_became_peered":"2024-09-19T05:42:58.144572+0000","last_unstale":"2024-09-19T05:43:01.423595+0000","last_undegraded":"2024-09-19T05:43:01.423595+0000","last_fullsized":"2024-09-19T05:43:01.423595+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:59.155804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.425151+0000","last_change":"2024-09-19T05:42:59.152206+0000","last_active":"2024-09-19T05:43:01.425151+0000","last_peered":"2024-09-19T05:43:01.425151+0000","last_clean":"2024-09-19T05:43:01.425151+0000","last_became_active":"2024-09-19T05:42:59.145689+0000","last_became_peered":"2024-09-19T05:42:59.145689+0000","last_unstale":"2024-09-19T05:43:01.425151+0000","last_undegraded":"2024-09-19T05:43:01.425151+0000","last_fullsized":"2024-09-19T05:43:01.425151+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:58.099209+0000","last_clean_scrub_stamp":"2024-09-19T05:42:58.099209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:01.848198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"131'8","reported_seq":22,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:00.118962+0000","last_change":"2024-09-19T05:42:58.137172+0000","last_active":"2024-09-19T05:43:00.118962+0000","last_peered":"2024-09-19T05:43:00.118962+0000","last_clean":"2024-09-19T05:43:00.118962+0000","last_became_active":"2024-09-19T05:42:58.136664+0000","last_became_peered":"2024-09-19T05:42:58.136664+0000","last_unstale":"2024-09-19T05:43:00.118962+0000","last_undegraded":"2024-09-19T05:43:00.118962+0000","last_fullsized":"2024-09-19T05:43:00.118962+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:42:57.095230+0000","last_clean_scrub_stamp":"2024-09-19T05:42:57.095230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:13.135212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":372,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-19T05:43:01.424110+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:43:01.424110+0000","last_peered":"2024-09-19T05:43:01.424110+0000","last_clean":"2024-09-19T05:43:01.424110+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:43:01.424110+0000","last_undegraded":"2024-09-19T05:43:01.424110+0000","last_fullsized":"2024-09-19T05:43:01.424110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542266,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65324,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306516,"statfs":{"total":96636764160,"available":96569872384,"internally_reserved":0,"allocated":2248704,"data_stored":1364771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542266,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64728,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94307112,"statfs":{"total":96636764160,"available":96570482688,"internally_reserved":0,"allocated":1642496,"data_stored":774209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542268,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59164,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312676,"statfs":{"total":96636764160,"available":96576180224,"internally_reserved":0,"allocated":1646592,"data_stored":773787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542266,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64744,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94307096,"statfs":{"total":96636764160,"available":96570466304,"internally_reserved":0,"allocated":1650688,"data_stored":775239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542267,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59180,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312660,"statfs":{"total":96636764160,"available":96576163840,"internally_reserved":0,"allocated":1654784,"data_stored":775273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542267,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68884,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302956,"statfs":{"total":96636764160,"available":96566226944,"internally_reserved":0,"allocated":1638400,"data_stored":773627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542269,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55000,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316840,"statfs":{"total":96636764160,"available":96580444160,"internally_reserved":0,"allocated":1642496,"data_stored":773649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542266,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69472,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302368,"statfs":{"total":96636764160,"available":96565624832,"internally_reserved":0,"allocated":2236416,"data_stored":1364017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:43:03.585 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:43:03.586 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:43:03.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.758+0000 7f5eac183640 1 Processor -- start 2024-09-19T05:43:03.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5eac183640 1 -- start start 2024-09-19T05:43:03.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5eac183640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5ea40d4fb0 0x7f5ea40d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5eac183640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea40d35a0 con 0x7f5ea40d13c0 2024-09-19T05:43:03.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5eac183640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea40d32c0 con 0x7f5ea415e690 2024-09-19T05:43:03.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5eac183640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea40d17f0 con 0x7f5ea40d4fb0 2024-09-19T05:43:03.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5eaa720640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5ea40d13c0 0x7f5ea406db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34896/0 (socket says 172.21.15.67:34896) 2024-09-19T05:43:03.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5eaa720640 1 -- 172.21.15.67:0/167526476 learned_addr learned my addr 172.21.15.67:0/167526476 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:03.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea971e640 1 --2- 172.21.15.67:0/167526476 >> v2:172.21.15.97:3300/0 conn(0x7f5ea40d4fb0 0x7f5ea40d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007170426 0 0) 0x7f5ea40d35a0 con 0x7f5ea40d13c0 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e90003530 con 0x7f5ea40d13c0 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3834843768 0 0) 0x7f5e90003530 con 0x7f5ea40d13c0 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 >> v2:172.21.15.97:3300/0 conn(0x7f5ea40d4fb0 msgr2=0x7f5ea40d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 --2- 172.21.15.67:0/167526476 >> v2:172.21.15.97:3300/0 conn(0x7f5ea40d4fb0 0x7f5ea40d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 >> v1:172.21.15.97:6789/0 conn(0x7f5ea415e690 legacy=0x7f5ea40d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea406d040 con 0x7f5ea40d13c0 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f5e9c001a00 con 0x7f5ea40d13c0 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 >> v1:172.21.15.67:6789/0 conn(0x7f5ea40d13c0 legacy=0x7f5ea406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e900039c0 0x7f5e90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e90004810 0x7f5e90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e900051d0 0x7f5e9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea40d17f0 con 0x7f5e900039c0 2024-09-19T05:43:03.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9000c070 con 0x7f5e900051d0 2024-09-19T05:43:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9000c270 con 0x7f5e90004810 2024-09-19T05:43:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea9f1f640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e900039c0 0x7f5e90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5eaa720640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e900051d0 0x7f5e9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea971e640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e90004810 0x7f5e90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea9f1f640 1 -- 172.21.15.67:0/167526476 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e90004810 msgr2=0x7f5e90004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea9f1f640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e90004810 0x7f5e90004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea9f1f640 1 -- 172.21.15.67:0/167526476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e900051d0 msgr2=0x7f5e9000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea9f1f640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e900051d0 0x7f5e9000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5eaa720640 1 -- 172.21.15.67:0/167526476 reap_dead start 2024-09-19T05:43:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.762+0000 7f5ea9f1f640 1 -- 172.21.15.67:0/167526476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e90003530 con 0x7f5e900039c0 2024-09-19T05:43:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5ea9f1f640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e900039c0 0x7f5e90003de0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0001750 tx=0x7f5ea001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4b8f7ee24639e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00013a0 con 0x7f5e900039c0 2024-09-19T05:43:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea00a9070 con 0x7f5e900039c0 2024-09-19T05:43:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5ea8f1d640 1 -- 172.21.15.67:0/167526476 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0003600 con 0x7f5e900039c0 2024-09-19T05:43:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 -- 172.21.15.67:0/167526476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e900039c0 msgr2=0x7f5e90003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e900039c0 0x7f5e90003de0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0001750 tx=0x7f5ea001c390 comp rx=0 tx=0).stop 2024-09-19T05:43:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 -- 172.21.15.67:0/167526476 shutdown_connections 2024-09-19T05:43:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 --2- 172.21.15.67:0/167526476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e900039c0 0x7f5e90003de0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 -- 172.21.15.67:0/167526476 >> 172.21.15.67:0/167526476 conn(0x7f5ea40d4490 msgr2=0x7f5ea40d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 -- 172.21.15.67:0/167526476 shutdown_connections 2024-09-19T05:43:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 -- 172.21.15.67:0/167526476 wait complete. 2024-09-19T05:43:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 Processor -- start 2024-09-19T05:43:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 -- start start 2024-09-19T05:43:03.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e900039c0 0x7f5ea415bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea4152870 0x7f5ea40c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ea40cdf80 0x7f5ea406da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea40d2a40 con 0x7f5ea4152870 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea415ea70 con 0x7f5ea40cdf80 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5eac183640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea40d2bc0 con 0x7f5e900039c0 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5ea971e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea4152870 0x7f5ea40c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5ea971e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea4152870 0x7f5ea40c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46624/0 (socket says 172.21.15.67:46624) 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.766+0000 7f5ea971e640 1 -- 172.21.15.67:0/2402117620 learned_addr learned my addr 172.21.15.67:0/2402117620 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5eaa720640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ea40cdf80 0x7f5ea406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5ea9f1f640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e900039c0 0x7f5ea415bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5ea971e640 1 -- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e900039c0 msgr2=0x7f5ea415bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5ea971e640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e900039c0 0x7f5ea415bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5ea971e640 1 -- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ea40cdf80 msgr2=0x7f5ea406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5ea971e640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ea40cdf80 0x7f5ea406da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5ea971e640 1 -- 172.21.15.67:0/2402117620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea40c8500 con 0x7f5ea4152870 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5ea971e640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea4152870 0x7f5ea40c7fc0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f5e94010930 tx=0x7f5e94010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5e9a7fc640 1 -- 172.21.15.67:0/2402117620 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400f040 con 0x7f5ea4152870 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5e9a7fc640 1 -- 172.21.15.67:0/2402117620 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9400ec20 con 0x7f5ea4152870 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5eac183640 1 -- 172.21.15.67:0/2402117620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea40ccee0 con 0x7f5ea4152870 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5e9a7fc640 1 -- 172.21.15.67:0/2402117620 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9401c400 con 0x7f5ea4152870 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5eac183640 1 -- 172.21.15.67:0/2402117620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea40cd4a0 con 0x7f5ea4152870 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5eac183640 1 -- 172.21.15.67:0/2402117620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea40d2f50 con 0x7f5ea4152870 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5e9a7fc640 1 -- 172.21.15.67:0/2402117620 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e9401c5a0 con 0x7f5ea4152870 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5e9a7fc640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e880678f0 0x7f5e88069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5e9a7fc640 1 -- 172.21.15.67:0/2402117620 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f5e94086300 con 0x7f5ea4152870 2024-09-19T05:43:03.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5ea9f1f640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e880678f0 0x7f5e88069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:03.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.770+0000 7f5ea9f1f640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e880678f0 0x7f5e88069db0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40d3770 tx=0x7f5ea00011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:03.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.774+0000 7f5e9a7fc640 1 -- 172.21.15.67:0/2402117620 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5e94018030 con 0x7f5ea4152870 2024-09-19T05:43:03.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:03.998+0000 7f5eac183640 1 -- 172.21.15.67:0/2402117620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5ea40ba2e0 con 0x7f5ea4152870 2024-09-19T05:43:03.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5e9a7fc640 1 -- 172.21.15.67:0/2402117620 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f5e94056d70 con 0x7f5ea4152870 2024-09-19T05:43:03.999 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:43:03.999 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:43:04.000 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:43:04.000 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:43:04.000 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:43:04.000 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:43:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 -- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e880678f0 msgr2=0x7f5e88069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e880678f0 0x7f5e88069db0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40d3770 tx=0x7f5ea00011a0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 -- 172.21.15.67:0/2402117620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea4152870 msgr2=0x7f5ea40c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea4152870 0x7f5ea40c7fc0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f5e94010930 tx=0x7f5e94010df0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 -- 172.21.15.67:0/2402117620 shutdown_connections 2024-09-19T05:43:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ea40cdf80 0x7f5ea406da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ea4152870 0x7f5ea40c7fc0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e880678f0 0x7f5e88069db0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 --2- 172.21.15.67:0/2402117620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e900039c0 0x7f5ea415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 -- 172.21.15.67:0/2402117620 >> 172.21.15.67:0/2402117620 conn(0x7f5ea40d4490 msgr2=0x7f5ea40b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:04.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 -- 172.21.15.67:0/2402117620 shutdown_connections 2024-09-19T05:43:04.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.002+0000 7f5eac183640 1 -- 172.21.15.67:0/2402117620 wait complete. 2024-09-19T05:43:04.018 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:43:04.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208e6fa640 1 Processor -- start 2024-09-19T05:43:04.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208e6fa640 1 -- start start 2024-09-19T05:43:04.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208e6fa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f20880d1590 0x7f20880d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208e6fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880b51d0 0x7f20880cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208e6fa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20880d4d40 con 0x7f2088161da0 2024-09-19T05:43:04.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208e6fa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f20880d0840 con 0x7f20880d1590 2024-09-19T05:43:04.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208e6fa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f20880d5020 con 0x7f20880b51d0 2024-09-19T05:43:04.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f20877fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f20880d1590 0x7f20880d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208cc97640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880b51d0 0x7f20880cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f20877fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f20880d1590 0x7f20880d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:39404/0 (socket says 172.21.15.67:39404) 2024-09-19T05:43:04.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f20877fe640 1 -- 172.21.15.67:0/64903313 learned_addr learned my addr 172.21.15.67:0/64903313 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:04.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f2086ffd640 1 -- 172.21.15.67:0/64903313 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1622619377 0 0) 0x7f20880d4d40 con 0x7f2088161da0 2024-09-19T05:43:04.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208cc97640 1 -- 172.21.15.67:0/64903313 >> v2:172.21.15.97:3300/0 conn(0x7f20880d1590 msgr2=0x7f20880d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:04.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208cc97640 1 --2- 172.21.15.67:0/64903313 >> v2:172.21.15.97:3300/0 conn(0x7f20880d1590 0x7f20880d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208cc97640 1 -- 172.21.15.67:0/64903313 >> v1:172.21.15.97:6789/0 conn(0x7f2088161da0 legacy=0x7f20880d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.146+0000 7f208cc97640 1 -- 172.21.15.67:0/64903313 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20880d5300 con 0x7f20880b51d0 2024-09-19T05:43:04.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208cc97640 1 --2- 172.21.15.67:0/64903313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880b51d0 0x7f20880cf150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2080009d90 tx=0x7f208001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5fd7c4fd1e7f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f2086ffd640 1 -- 172.21.15.67:0/64903313 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20800b2070 con 0x7f20880b51d0 2024-09-19T05:43:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f2086ffd640 1 -- 172.21.15.67:0/64903313 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20800a5800 con 0x7f20880b51d0 2024-09-19T05:43:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f2086ffd640 1 -- 172.21.15.67:0/64903313 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20800a5bd0 con 0x7f20880b51d0 2024-09-19T05:43:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208e6fa640 1 -- 172.21.15.67:0/64903313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880b51d0 msgr2=0x7f20880cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208e6fa640 1 --2- 172.21.15.67:0/64903313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880b51d0 0x7f20880cf150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2080009d90 tx=0x7f208001c970 comp rx=0 tx=0).stop 2024-09-19T05:43:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208e6fa640 1 -- 172.21.15.67:0/64903313 shutdown_connections 2024-09-19T05:43:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208e6fa640 1 --2- 172.21.15.67:0/64903313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880b51d0 0x7f20880cf150 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208e6fa640 1 --2- 172.21.15.67:0/64903313 >> v2:172.21.15.97:3300/0 conn(0x7f20880d1590 0x7f20880d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208e6fa640 1 -- 172.21.15.67:0/64903313 >> 172.21.15.67:0/64903313 conn(0x7f208808bfc0 msgr2=0x7f20880d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208e6fa640 1 -- 172.21.15.67:0/64903313 shutdown_connections 2024-09-19T05:43:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208e6fa640 1 -- 172.21.15.67:0/64903313 wait complete. 2024-09-19T05:43:04.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208e6fa640 1 Processor -- start 2024-09-19T05:43:04.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.150+0000 7f208e6fa640 1 -- start start 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f208e6fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20880b51d0 0x7f208815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f208e6fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880d1590 0x7f20880cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f208e6fa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2088161da0 0x7f20881f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f208e6fa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f20880d0020 con 0x7f20880b51d0 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f208e6fa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f20880cfea0 con 0x7f2088161da0 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f208e6fa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f20880d01a0 con 0x7f20880d1590 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2087fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20880b51d0 0x7f208815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2087fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20880b51d0 0x7f208815b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46632/0 (socket says 172.21.15.67:46632) 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2087fff640 1 -- 172.21.15.67:0/2619241671 learned_addr learned my addr 172.21.15.67:0/2619241671 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f208cc97640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2088161da0 0x7f20881f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f20877fe640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880d1590 0x7f20880cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2087fff640 1 -- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880d1590 msgr2=0x7f20880cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2087fff640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880d1590 0x7f20880cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2087fff640 1 -- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2088161da0 msgr2=0x7f20881f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2087fff640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2088161da0 0x7f20881f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2087fff640 1 -- 172.21.15.67:0/2619241671 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20880ba140 con 0x7f20880b51d0 2024-09-19T05:43:04.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2087fff640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20880b51d0 0x7f208815b5e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f207800c3f0 tx=0x7f207800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:04.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2084ff9640 1 -- 172.21.15.67:0/2619241671 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078017070 con 0x7f20880b51d0 2024-09-19T05:43:04.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2084ff9640 1 -- 172.21.15.67:0/2619241671 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20780052f0 con 0x7f20880b51d0 2024-09-19T05:43:04.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f208e6fa640 1 -- 172.21.15.67:0/2619241671 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20881f8510 con 0x7f20880b51d0 2024-09-19T05:43:04.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2084ff9640 1 -- 172.21.15.67:0/2619241671 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078003860 con 0x7f20880b51d0 2024-09-19T05:43:04.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f208e6fa640 1 -- 172.21.15.67:0/2619241671 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20880b8650 con 0x7f20880b51d0 2024-09-19T05:43:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f208e6fa640 1 -- 172.21.15.67:0/2619241671 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20880cf150 con 0x7f20880b51d0 2024-09-19T05:43:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2084ff9640 1 -- 172.21.15.67:0/2619241671 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f207801a070 con 0x7f20880b51d0 2024-09-19T05:43:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2084ff9640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20740678c0 0x7f2074069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.154+0000 7f2084ff9640 1 -- 172.21.15.67:0/2619241671 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f2078085260 con 0x7f20880b51d0 2024-09-19T05:43:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.158+0000 7f20877fe640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20740678c0 0x7f2074069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.158+0000 7f20877fe640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20740678c0 0x7f2074069d80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f20881fac10 tx=0x7f207c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.158+0000 7f2084ff9640 1 -- 172.21.15.67:0/2619241671 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2078021080 con 0x7f20880b51d0 2024-09-19T05:43:04.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.362+0000 7f208e6fa640 1 -- 172.21.15.67:0/2619241671 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f208815ca70 con 0x7f20880b51d0 2024-09-19T05:43:04.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.362+0000 7f2084ff9640 1 -- 172.21.15.67:0/2619241671 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5216 (secure 0 0 0) 0x7f2078055730 con 0x7f20880b51d0 2024-09-19T05:43:04.361 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:04.361 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":91,"btime":"2024-09-19T05:43:02:159748+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/617137818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":617137818},{"type":"v1","addr":"172.21.15.97:6835","nonce":617137818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":6862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3709077281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3709077281},{"type":"v1","addr":"172.21.15.97:6837","nonce":3709077281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1889576066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1889576066},{"type":"v1","addr":"172.21.15.67:6833","nonce":1889576066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:42:58.500443+0000","modified":"2024-09-19T05:43:01.531911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/96000467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":96000467},{"type":"v1","addr":"172.21.15.67:6835","nonce":96000467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8136,"qdb_cluster":[8136]},"id":8}]} 2024-09-19T05:43:04.362 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 91 2024-09-19T05:43:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 -- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20740678c0 msgr2=0x7f2074069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20740678c0 0x7f2074069d80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f20881fac10 tx=0x7f207c008040 comp rx=0 tx=0).stop 2024-09-19T05:43:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 -- 172.21.15.67:0/2619241671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20880b51d0 msgr2=0x7f208815b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20880b51d0 0x7f208815b5e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f207800c3f0 tx=0x7f207800c8b0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 -- 172.21.15.67:0/2619241671 shutdown_connections 2024-09-19T05:43:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2088161da0 0x7f20881f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20740678c0 0x7f2074069d80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20880d1590 0x7f20880cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 --2- 172.21.15.67:0/2619241671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20880b51d0 0x7f208815b5e0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 -- 172.21.15.67:0/2619241671 >> 172.21.15.67:0/2619241671 conn(0x7f208808bfc0 msgr2=0x7f2088160e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:04.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 -- 172.21.15.67:0/2619241671 shutdown_connections 2024-09-19T05:43:04.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.366+0000 7f208e6fa640 1 -- 172.21.15.67:0/2619241671 wait complete. 2024-09-19T05:43:04.734 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:43:04.734+0000 7fd3d9b88640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:43:04.784 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:42:58.500443+0000', 'modified': '2024-09-19T05:43:01.531911+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8136}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8136': {'gid': 8136, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/96000467', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 96000467}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 96000467}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8136, 'qdb_cluster': [8136]} 2024-09-19T05:43:04.784 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:43:04.785 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:43:04.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59e1942640 1 Processor -- start 2024-09-19T05:43:04.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59e1942640 1 -- start start 2024-09-19T05:43:04.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59e1942640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f59dc06dde0 0x7f59dc0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59e1942640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f59dc0b3510 0x7f59dc06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59e1942640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc06e3c0 con 0x7f59dc15c030 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59e1942640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f59dc06e6a0 con 0x7f59dc06dde0 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59e1942640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f59dc06e980 con 0x7f59dc0b3510 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59da7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f59dc06dde0 0x7f59dc0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59da7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f59dc06dde0 0x7f59dc0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46638/0 (socket says 172.21.15.67:46638) 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59da7fc640 1 -- 172.21.15.67:0/3141964631 learned_addr learned my addr 172.21.15.67:0/3141964631 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59db7fe640 1 --2- 172.21.15.67:0/3141964631 >> v2:172.21.15.97:3300/0 conn(0x7f59dc0b3510 0x7f59dc06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59da7fc640 1 -- 172.21.15.67:0/3141964631 >> v2:172.21.15.97:3300/0 conn(0x7f59dc0b3510 msgr2=0x7f59dc06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59da7fc640 1 --2- 172.21.15.67:0/3141964631 >> v2:172.21.15.97:3300/0 conn(0x7f59dc0b3510 0x7f59dc06f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59da7fc640 1 -- 172.21.15.67:0/3141964631 >> v1:172.21.15.97:6789/0 conn(0x7f59dc15c030 legacy=0x7f59dc15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59da7fc640 1 -- 172.21.15.67:0/3141964631 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc06ec60 con 0x7f59dc06dde0 2024-09-19T05:43:04.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.926+0000 7f59db7fe640 1 --2- 172.21.15.67:0/3141964631 >> v2:172.21.15.97:3300/0 conn(0x7f59dc0b3510 0x7f59dc06f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:04.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59da7fc640 1 --2- 172.21.15.67:0/3141964631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc06dde0 0x7f59dc0b2fd0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0afbf0 tx=0x7f59cc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ff48509fd046b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:04.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59d9ffb640 1 -- 172.21.15.67:0/3141964631 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0ab600 con 0x7f59dc06dde0 2024-09-19T05:43:04.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59d9ffb640 1 -- 172.21.15.67:0/3141964631 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59cc0b0070 con 0x7f59dc06dde0 2024-09-19T05:43:04.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59d9ffb640 1 -- 172.21.15.67:0/3141964631 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0ab9c0 con 0x7f59dc06dde0 2024-09-19T05:43:04.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 -- 172.21.15.67:0/3141964631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc06dde0 msgr2=0x7f59dc0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 --2- 172.21.15.67:0/3141964631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc06dde0 0x7f59dc0b2fd0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0afbf0 tx=0x7f59cc01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 -- 172.21.15.67:0/3141964631 shutdown_connections 2024-09-19T05:43:04.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 --2- 172.21.15.67:0/3141964631 >> v2:172.21.15.97:3300/0 conn(0x7f59dc0b3510 0x7f59dc06f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 --2- 172.21.15.67:0/3141964631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc06dde0 0x7f59dc0b2fd0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 -- 172.21.15.67:0/3141964631 >> 172.21.15.67:0/3141964631 conn(0x7f59dc0d0080 msgr2=0x7f59dc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:04.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 -- 172.21.15.67:0/3141964631 shutdown_connections 2024-09-19T05:43:04.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 -- 172.21.15.67:0/3141964631 wait complete. 2024-09-19T05:43:04.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 Processor -- start 2024-09-19T05:43:04.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 -- start start 2024-09-19T05:43:04.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59dc06dde0 0x7f59dc147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc0b3510 0x7f59dc14b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.930+0000 7f59e1942640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59dc15c030 0x7f59dc0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59e1942640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc1692f0 con 0x7f59dc0b3510 2024-09-19T05:43:04.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59e1942640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc15c620 con 0x7f59dc06dde0 2024-09-19T05:43:04.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59e1942640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc169470 con 0x7f59dc15c030 2024-09-19T05:43:04.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59da7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc0b3510 0x7f59dc14b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59da7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc0b3510 0x7f59dc14b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46652/0 (socket says 172.21.15.67:46652) 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59da7fc640 1 -- 172.21.15.67:0/2239645985 learned_addr learned my addr 172.21.15.67:0/2239645985 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59daffd640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59dc06dde0 0x7f59dc147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59db7fe640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59dc15c030 0x7f59dc0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59da7fc640 1 -- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59dc15c030 msgr2=0x7f59dc0b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59da7fc640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59dc15c030 0x7f59dc0b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59da7fc640 1 -- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59dc06dde0 msgr2=0x7f59dc147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59da7fc640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59dc06dde0 0x7f59dc147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59da7fc640 1 -- 172.21.15.67:0/2239645985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc14e900 con 0x7f59dc0b3510 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59da7fc640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc0b3510 0x7f59dc14b520 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f59cc019100 tx=0x7f59cc01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59d3fff640 1 -- 172.21.15.67:0/2239645985 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0be5f0 con 0x7f59dc0b3510 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59d3fff640 1 -- 172.21.15.67:0/2239645985 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59cc0be790 con 0x7f59dc0b3510 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59e1942640 1 -- 172.21.15.67:0/2239645985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc14ebe0 con 0x7f59dc0b3510 2024-09-19T05:43:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59d3fff640 1 -- 172.21.15.67:0/2239645985 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0beb40 con 0x7f59dc0b3510 2024-09-19T05:43:04.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59e1942640 1 -- 172.21.15.67:0/2239645985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc14f1a0 con 0x7f59dc0b3510 2024-09-19T05:43:04.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59d3fff640 1 -- 172.21.15.67:0/2239645985 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59cc0aa070 con 0x7f59dc0b3510 2024-09-19T05:43:04.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59d3fff640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59bc0678c0 0x7f59bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59d3fff640 1 -- 172.21.15.67:0/2239645985 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f59cc120510 con 0x7f59dc0b3510 2024-09-19T05:43:04.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59daffd640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59bc0678c0 0x7f59bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59e49fe000 1 Processor -- start 2024-09-19T05:43:04.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.934+0000 7f59e49fe000 1 -- start start 2024-09-19T05:43:04.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59daffd640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59bc0678c0 0x7f59bc069d80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f59c40015b0 tx=0x7f59c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:04.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce31e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31e7440 0x563ce319cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce319d290 0x563ce319d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563ce3084b60 con 0x563ce319d290 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563ce2febc70 con 0x563ce31e7440 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563ce2f91ed0 con 0x563ce31e6b20 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce319d290 0x563ce319d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce319d290 0x563ce319d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46660/0 (socket says 172.21.15.67:46660) 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59db7fe640 1 -- 172.21.15.67:0/1546471948 learned_addr learned my addr 172.21.15.67:0/1546471948 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59da7fc640 1 --2- 172.21.15.67:0/1546471948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31e7440 0x563ce319cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59daffd640 1 --2- 172.21.15.67:0/1546471948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce31e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59db7fe640 1 -- 172.21.15.67:0/1546471948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 msgr2=0x563ce31e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59db7fe640 1 --2- 172.21.15.67:0/1546471948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce31e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59db7fe640 1 -- 172.21.15.67:0/1546471948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31e7440 msgr2=0x563ce319cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59db7fe640 1 --2- 172.21.15.67:0/1546471948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31e7440 0x563ce319cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59db7fe640 1 -- 172.21.15.67:0/1546471948 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ce2fa3e50 con 0x563ce319d290 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59daffd640 1 --2- 172.21.15.67:0/1546471948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce31e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59db7fe640 1 --2- 172.21.15.67:0/1546471948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce319d290 0x563ce319d670 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009a60 tx=0x7f59d4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5a2c98a2e64da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59d17fa640 1 -- 172.21.15.67:0/1546471948 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4019070 con 0x563ce319d290 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59d17fa640 1 -- 172.21.15.67:0/1546471948 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d4014600 con 0x563ce319d290 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59d17fa640 1 -- 172.21.15.67:0/1546471948 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d40149d0 con 0x563ce319d290 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- 172.21.15.67:0/1546471948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce319d290 msgr2=0x563ce319d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 --2- 172.21.15.67:0/1546471948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce319d290 0x563ce319d670 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009a60 tx=0x7f59d4003f90 comp rx=0 tx=0).stop 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- 172.21.15.67:0/1546471948 shutdown_connections 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 --2- 172.21.15.67:0/1546471948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce319d290 0x563ce319d670 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 --2- 172.21.15.67:0/1546471948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31e7440 0x563ce319cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 --2- 172.21.15.67:0/1546471948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce31e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- 172.21.15.67:0/1546471948 >> 172.21.15.67:0/1546471948 conn(0x563ce31a3600 msgr2=0x563ce319b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- 172.21.15.67:0/1546471948 shutdown_connections 2024-09-19T05:43:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- 172.21.15.67:0/1546471948 wait complete. 2024-09-19T05:43:04.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- start start 2024-09-19T05:43:04.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 Processor -- start 2024-09-19T05:43:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e6b20 0x563ce31a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e7440 0x563ce31e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce31e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563ce304db00 con 0x563ce31e6b20 2024-09-19T05:43:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563ce2fc6360 con 0x563ce31a2390 2024-09-19T05:43:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563ce2fc32d0 con 0x563ce31e7440 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59e49fe000 10 client.0 _ll_register_callbacks cb 0x563ce3188820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59daffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e6b20 0x563ce31a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59daffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e6b20 0x563ce31a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46676/0 (socket says 172.21.15.67:46676) 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59daffd640 1 -- 172.21.15.67:0/1049561 learned_addr learned my addr 172.21.15.67:0/1049561 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.938+0000 7f59db7fe640 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce31e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59da7fc640 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e7440 0x563ce31e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59daffd640 1 -- 172.21.15.67:0/1049561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e7440 msgr2=0x563ce31e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59daffd640 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e7440 0x563ce31e7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59daffd640 1 -- 172.21.15.67:0/1049561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 msgr2=0x563ce31e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59daffd640 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce31e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59daffd640 1 -- 172.21.15.67:0/1049561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ce2f92120 con 0x563ce31e6b20 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59db7fe640 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce31e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59daffd640 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e6b20 0x563ce31a1e50 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f59c40038b0 tx=0x7f59c4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f147199ea0ad4cf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59ba7fc640 1 -- 172.21.15.67:0/1049561 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c400ec40 con 0x563ce31e6b20 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59ba7fc640 1 -- 172.21.15.67:0/1049561 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f59c400ede0 con 0x563ce31e6b20 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 -- 172.21.15.67:0/1049561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59d4014600 con 0x563ce31e6b20 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59ba7fc640 1 -- 172.21.15.67:0/1049561 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f59c4022430 con 0x563ce31e6b20 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 10 client.8268 fetch_fsmap learned FSMap version 91 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 -- 172.21.15.67:0/1049561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x563ce2f8b450 con 0x563ce31e6b20 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59ba7fc640 1 -- 172.21.15.67:0/1049561 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d4014600 con 0x563ce31e6b20 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59ba7fc640 1 -- 172.21.15.67:0/1049561 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f59c40225d0 con 0x563ce31e6b20 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 10 client.8268 fetch_fsmap finished waiting for FSMap version 91 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 10 client.8268 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 20 client.8268 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:04.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x563ce31e5c30 0x563ce31e6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 4 client.8268 mds_command: new command op to 8136 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 -- 172.21.15.67:0/1049561 --> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ce2f85c00 con 0x563ce31e5c30 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59da7fc640 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x563ce31e5c30 0x563ce31e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59da7fc640 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x563ce31e5c30 0x563ce31e6010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94973d4a58173aff server_cookie=eb1caca622a69d49 in_seq=0 out_seq=0 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59ba7fc640 10 client.8268 ms_handle_connect on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59ba7fc640 1 -- 172.21.15.67:0/1049561 <== mds.0 v2:172.21.15.67:6834/96000467 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ce2f85c00 con 0x563ce31e5c30 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59ba7fc640 10 client.8268 handle_command_reply: tid=0 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 client.8268 shutdown 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 -- 172.21.15.67:0/1049561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e6b20 msgr2=0x563ce31a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e6b20 0x563ce31a1e50 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f59c40038b0 tx=0x7f59c4000bd0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 -- 172.21.15.67:0/1049561 shutdown_connections 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce31e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x563ce31e5c30 0x563ce31e6010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e7440 0x563ce31e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 --2- 172.21.15.67:0/1049561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e6b20 0x563ce31a1e50 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59ba7fc640 0 client.8268 ms_handle_reset on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:04.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 -- 172.21.15.67:0/1049561 >> 172.21.15.67:0/1049561 conn(0x563ce319d290 msgr2=0x563ce319bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:04.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 -- 172.21.15.67:0/1049561 shutdown_connections 2024-09-19T05:43:04.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 1 -- 172.21.15.67:0/1049561 wait complete. 2024-09-19T05:43:04.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.942+0000 7f59e49fe000 20 client.8268 trim_cache size 0 max 16384 2024-09-19T05:43:04.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 Processor -- start 2024-09-19T05:43:04.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 -- start start 2024-09-19T05:43:04.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce31a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce31a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc0736e0 con 0x563ce31e7440 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc149d30 con 0x563ce31a2390 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc073090 con 0x563ce31e6b20 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46692/0 (socket says 172.21.15.67:46692) 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59db7fe640 1 -- 172.21.15.67:0/2361247900 learned_addr learned my addr 172.21.15.67:0/2361247900 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59da7fc640 1 --2- 172.21.15.67:0/2361247900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce31a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59daffd640 1 --2- 172.21.15.67:0/2361247900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce31a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59db7fe640 1 -- 172.21.15.67:0/2361247900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 msgr2=0x563ce31a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59db7fe640 1 --2- 172.21.15.67:0/2361247900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce31a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59db7fe640 1 -- 172.21.15.67:0/2361247900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 msgr2=0x563ce31a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59db7fe640 1 --2- 172.21.15.67:0/2361247900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce31a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59db7fe640 1 -- 172.21.15.67:0/2361247900 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ce31e7270 con 0x563ce31e7440 2024-09-19T05:43:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59daffd640 1 --2- 172.21.15.67:0/2361247900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce31a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59db7fe640 1 --2- 172.21.15.67:0/2361247900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f71c0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x563ce30a3ac0 tx=0x7f59d4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127089e5eb18e30d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59d0ff9640 1 -- 172.21.15.67:0/2361247900 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4025070 con 0x563ce31e7440 2024-09-19T05:43:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59d0ff9640 1 -- 172.21.15.67:0/2361247900 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d401f670 con 0x563ce31e7440 2024-09-19T05:43:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59d0ff9640 1 -- 172.21.15.67:0/2361247900 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4019040 con 0x563ce31e7440 2024-09-19T05:43:04.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 -- 172.21.15.67:0/2361247900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 msgr2=0x563ce31f71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 --2- 172.21.15.67:0/2361247900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f71c0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x563ce30a3ac0 tx=0x7f59d4012000 comp rx=0 tx=0).stop 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 -- 172.21.15.67:0/2361247900 shutdown_connections 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 --2- 172.21.15.67:0/2361247900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f71c0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 --2- 172.21.15.67:0/2361247900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce31a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 --2- 172.21.15.67:0/2361247900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce31a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 -- 172.21.15.67:0/2361247900 >> 172.21.15.67:0/2361247900 conn(0x563ce319d290 msgr2=0x563ce31e46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 -- 172.21.15.67:0/2361247900 shutdown_connections 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.962+0000 7f59e49fe000 1 -- 172.21.15.67:0/2361247900 wait complete. 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- start start 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 Processor -- start 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce325e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce325ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563ce2feaf80 con 0x563ce31e7440 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563ce2fa3ca0 con 0x563ce31a2390 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563ce2ff02a0 con 0x563ce31e6b20 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 10 client.0 _ll_register_callbacks cb 0x7f59c4001210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46706/0 (socket says 172.21.15.67:46706) 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59db7fe640 1 -- 172.21.15.67:0/4139845463 learned_addr learned my addr 172.21.15.67:0/4139845463 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59daffd640 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce325e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59da7fc640 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce325ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59db7fe640 1 -- 172.21.15.67:0/4139845463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 msgr2=0x563ce325ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59db7fe640 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce325ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59db7fe640 1 -- 172.21.15.67:0/4139845463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 msgr2=0x563ce325e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59db7fe640 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce325e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59db7fe640 1 -- 172.21.15.67:0/4139845463 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ce2f72fd0 con 0x563ce31e7440 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59db7fe640 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f51e0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x563ce3044900 tx=0x7f59d4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5737089e5f52f960 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59ba7fc640 1 -- 172.21.15.67:0/4139845463 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4019070 con 0x563ce31e7440 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59ba7fc640 1 -- 172.21.15.67:0/4139845463 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f59d4029440 con 0x563ce31e7440 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- 172.21.15.67:0/4139845463 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59d401f670 con 0x563ce31e7440 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59ba7fc640 1 -- 172.21.15.67:0/4139845463 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f59d4035050 con 0x563ce31e7440 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 10 client.8274 fetch_fsmap learned FSMap version 91 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- 172.21.15.67:0/4139845463 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x563ce306e750 con 0x563ce31e7440 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59ba7fc640 1 -- 172.21.15.67:0/4139845463 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d401f670 con 0x563ce31e7440 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59ba7fc640 1 -- 172.21.15.67:0/4139845463 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f59d4038020 con 0x563ce31e7440 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 10 client.8274 fetch_fsmap finished waiting for FSMap version 91 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 10 client.8274 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 20 client.8274 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x563ce31f5720 0x563ce31f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 4 client.8274 mds_command: new command op to 8136 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- 172.21.15.67:0/4139845463 --> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] -- command(tid 0: {"prefix": "status"}) -- 0x563ce2ff93a0 con 0x563ce31f5720 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59daffd640 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x563ce31f5720 0x563ce31f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59ba7fc640 10 client.8274 ms_handle_connect on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59daffd640 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x563ce31f5720 0x563ce31f5b00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=550a78b4f0cce126 server_cookie=3f90f95b8f82ed19 in_seq=0 out_seq=0 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59ba7fc640 1 -- 172.21.15.67:0/4139845463 <== mds.0 v2:172.21.15.67:6834/96000467 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x563ce2ff93a0 con 0x563ce31f5720 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59ba7fc640 10 client.8274 handle_command_reply: tid=0 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 client.8274 shutdown 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- 172.21.15.67:0/4139845463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 msgr2=0x563ce31f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f51e0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x563ce3044900 tx=0x7f59d4004ac0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- 172.21.15.67:0/4139845463 shutdown_connections 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ce31e7440 0x563ce31f51e0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x563ce31f5720 0x563ce31f5b00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563ce31e6b20 0x563ce325ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 --2- 172.21.15.67:0/4139845463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563ce31a2390 0x563ce325e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59ba7fc640 0 client.8274 ms_handle_reset on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- 172.21.15.67:0/4139845463 >> 172.21.15.67:0/4139845463 conn(0x563ce319d290 msgr2=0x563ce31e4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- 172.21.15.67:0/4139845463 shutdown_connections 2024-09-19T05:43:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 1 -- 172.21.15.67:0/4139845463 wait complete. 2024-09-19T05:43:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e49fe000 20 client.8274 trim_cache size 0 max 16384 2024-09-19T05:43:04.972 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:43:04.972 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:43:04.972 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:43:04.973 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 8136, 2024-09-19T05:43:04.973 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:43:04.973 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:43:04.973 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:43:04.973 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 5.8577011929999996, 2024-09-19T05:43:04.973 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 91, 2024-09-19T05:43:04.973 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 132, 2024-09-19T05:43:04.973 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 132, 2024-09-19T05:43:04.973 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 11.14606663 2024-09-19T05:43:04.973 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:43:04.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e1942640 1 -- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59bc0678c0 msgr2=0x7f59bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e1942640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59bc0678c0 0x7f59bc069d80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f59c40015b0 tx=0x7f59c4009040 comp rx=0 tx=0).stop 2024-09-19T05:43:04.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e1942640 1 -- 172.21.15.67:0/2239645985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc0b3510 msgr2=0x7f59dc14b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:04.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.966+0000 7f59e1942640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc0b3510 0x7f59dc14b520 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f59cc019100 tx=0x7f59cc01ad30 comp rx=0 tx=0).stop 2024-09-19T05:43:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.970+0000 7f59e1942640 1 -- 172.21.15.67:0/2239645985 shutdown_connections 2024-09-19T05:43:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.970+0000 7f59e1942640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59bc0678c0 0x7f59bc069d80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.970+0000 7f59e1942640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59dc15c030 0x7f59dc0b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.970+0000 7f59e1942640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59dc0b3510 0x7f59dc14b520 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.970+0000 7f59e1942640 1 --2- 172.21.15.67:0/2239645985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59dc06dde0 0x7f59dc147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.970+0000 7f59e1942640 1 -- 172.21.15.67:0/2239645985 >> 172.21.15.67:0/2239645985 conn(0x7f59dc0d0080 msgr2=0x7f59dc151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.970+0000 7f59e1942640 1 -- 172.21.15.67:0/2239645985 shutdown_connections 2024-09-19T05:43:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:04.970+0000 7f59e1942640 1 -- 172.21.15.67:0/2239645985 wait complete. 2024-09-19T05:43:04.983 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:43:05.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33f3bd640 1 Processor -- start 2024-09-19T05:43:05.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33f3bd640 1 -- start start 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33f3bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33815a920 0x7fb338072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33f3bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3380af730 0x7fb33806e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33f3bd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb33806ebb0 0x7fb33815e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33f3bd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb3380730e0 con 0x7fb3380af730 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33f3bd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb3380733c0 con 0x7fb33806ebb0 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33f3bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb3380ad8c0 con 0x7fb33815a920 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33c958640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3380af730 0x7fb33806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33c958640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3380af730 0x7fb33806e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46718/0 (socket says 172.21.15.67:46718) 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33c958640 1 -- 172.21.15.67:0/2042760958 learned_addr learned my addr 172.21.15.67:0/2042760958 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33d95a640 1 --2- 172.21.15.67:0/2042760958 >> v2:172.21.15.97:3300/0 conn(0x7fb33806ebb0 0x7fb33815e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:05.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33d159640 1 --2- 172.21.15.67:0/2042760958 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33815a920 0x7fb338072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:05.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33c958640 1 -- 172.21.15.67:0/2042760958 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33815a920 msgr2=0x7fb338072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:05.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33c958640 1 --2- 172.21.15.67:0/2042760958 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33815a920 0x7fb338072840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33c958640 1 -- 172.21.15.67:0/2042760958 >> v2:172.21.15.97:3300/0 conn(0x7fb33806ebb0 msgr2=0x7fb33815e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:05.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33c958640 1 --2- 172.21.15.67:0/2042760958 >> v2:172.21.15.97:3300/0 conn(0x7fb33806ebb0 0x7fb33815e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33c958640 1 -- 172.21.15.67:0/2042760958 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3380adba0 con 0x7fb3380af730 2024-09-19T05:43:05.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.102+0000 7fb33d95a640 1 --2- 172.21.15.67:0/2042760958 >> v2:172.21.15.97:3300/0 conn(0x7fb33806ebb0 0x7fb33815e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:05.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33c958640 1 --2- 172.21.15.67:0/2042760958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3380af730 0x7fb33806e670 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb3380cca10 tx=0x7fb32801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d9ff56d4ae0da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:05.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb32ffff640 1 -- 172.21.15.67:0/2042760958 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3280b4070 con 0x7fb3380af730 2024-09-19T05:43:05.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb32ffff640 1 -- 172.21.15.67:0/2042760958 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3280a7a00 con 0x7fb3380af730 2024-09-19T05:43:05.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb32ffff640 1 -- 172.21.15.67:0/2042760958 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3280a7dd0 con 0x7fb3380af730 2024-09-19T05:43:05.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 -- 172.21.15.67:0/2042760958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3380af730 msgr2=0x7fb33806e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:05.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 --2- 172.21.15.67:0/2042760958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3380af730 0x7fb33806e670 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb3380cca10 tx=0x7fb32801ebf0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 -- 172.21.15.67:0/2042760958 shutdown_connections 2024-09-19T05:43:05.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 --2- 172.21.15.67:0/2042760958 >> v2:172.21.15.97:3300/0 conn(0x7fb33806ebb0 0x7fb33815e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 --2- 172.21.15.67:0/2042760958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3380af730 0x7fb33806e670 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 --2- 172.21.15.67:0/2042760958 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33815a920 0x7fb338072840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 -- 172.21.15.67:0/2042760958 >> 172.21.15.67:0/2042760958 conn(0x7fb3380d0080 msgr2=0x7fb3380d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:05.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 -- 172.21.15.67:0/2042760958 shutdown_connections 2024-09-19T05:43:05.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 -- 172.21.15.67:0/2042760958 wait complete. 2024-09-19T05:43:05.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 Processor -- start 2024-09-19T05:43:05.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.106+0000 7fb33f3bd640 1 -- start start 2024-09-19T05:43:05.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33f3bd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb33806ebb0 0x7fb3380b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:05.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33f3bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3380af730 0x7fb3380ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:05.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33f3bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb33815a920 0x7fb3381450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33f3bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb33815ebd0 con 0x7fb33815a920 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33f3bd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb33815ea50 con 0x7fb33806ebb0 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33f3bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb33815ed50 con 0x7fb3380af730 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d95a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb33815a920 0x7fb3381450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d95a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb33815a920 0x7fb3381450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46734/0 (socket says 172.21.15.67:46734) 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d95a640 1 -- 172.21.15.67:0/651531094 learned_addr learned my addr 172.21.15.67:0/651531094 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d159640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb33806ebb0 0x7fb3380b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33c958640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3380af730 0x7fb3380ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d95a640 1 -- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3380af730 msgr2=0x7fb3380ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d95a640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3380af730 0x7fb3380ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d95a640 1 -- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb33806ebb0 msgr2=0x7fb3380b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d95a640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb33806ebb0 0x7fb3380b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d95a640 1 -- 172.21.15.67:0/651531094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb338145cb0 con 0x7fb33815a920 2024-09-19T05:43:05.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d95a640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb33815a920 0x7fb3381450d0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fb330007ef0 tx=0x7fb33000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:05.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb32dffb640 1 -- 172.21.15.67:0/651531094 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33001a070 con 0x7fb33815a920 2024-09-19T05:43:05.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb32dffb640 1 -- 172.21.15.67:0/651531094 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb330003ba0 con 0x7fb33815a920 2024-09-19T05:43:05.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb32dffb640 1 -- 172.21.15.67:0/651531094 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330004030 con 0x7fb33815a920 2024-09-19T05:43:05.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33f3bd640 1 -- 172.21.15.67:0/651531094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb338145f90 con 0x7fb33815a920 2024-09-19T05:43:05.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33f3bd640 1 -- 172.21.15.67:0/651531094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb338146550 con 0x7fb33815a920 2024-09-19T05:43:05.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33f3bd640 1 -- 172.21.15.67:0/651531094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33815f120 con 0x7fb33815a920 2024-09-19T05:43:05.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb32dffb640 1 -- 172.21.15.67:0/651531094 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb33001d070 con 0x7fb33815a920 2024-09-19T05:43:05.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb32dffb640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb31c0678f0 0x7fb31c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:05.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb32dffb640 1 -- 172.21.15.67:0/651531094 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7fb330085f60 con 0x7fb33815a920 2024-09-19T05:43:05.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.110+0000 7fb33d159640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb31c0678f0 0x7fb31c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:05.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.114+0000 7fb33d159640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb31c0678f0 0x7fb31c069db0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb33400d8d0 tx=0x7fb334008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:05.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.114+0000 7fb32dffb640 1 -- 172.21.15.67:0/651531094 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb330010070 con 0x7fb33815a920 2024-09-19T05:43:05.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.318+0000 7fb33f3bd640 1 -- 172.21.15.67:0/651531094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb3380b41f0 con 0x7fb33815a920 2024-09-19T05:43:05.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb32dffb640 1 -- 172.21.15.67:0/651531094 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) ==== 53+0+73 (secure 0 0 0) 0x7fb330056350 con 0x7fb33815a920 2024-09-19T05:43:05.319 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:43:05.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 -- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb31c0678f0 msgr2=0x7fb31c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:05.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb31c0678f0 0x7fb31c069db0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb33400d8d0 tx=0x7fb334008040 comp rx=0 tx=0).stop 2024-09-19T05:43:05.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 -- 172.21.15.67:0/651531094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb33815a920 msgr2=0x7fb3381450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:05.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb33815a920 0x7fb3381450d0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fb330007ef0 tx=0x7fb33000d4a0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 -- 172.21.15.67:0/651531094 shutdown_connections 2024-09-19T05:43:05.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb33815a920 0x7fb3381450d0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb31c0678f0 0x7fb31c069db0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3380af730 0x7fb3380ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 --2- 172.21.15.67:0/651531094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb33806ebb0 0x7fb3380b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:05.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 -- 172.21.15.67:0/651531094 >> 172.21.15.67:0/651531094 conn(0x7fb3380d0080 msgr2=0x7fb3380b0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:05.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 -- 172.21.15.67:0/651531094 shutdown_connections 2024-09-19T05:43:05.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05.322+0000 7fb33f3bd640 1 -- 172.21.15.67:0/651531094 wait complete. 2024-09-19T05:43:05.338 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:43:05.338 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:43:05.338 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:43:05.338 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:43:05.338 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:05.339 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:43:05.339 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:43:05.339 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:43:05.339 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:43:05.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:05.339 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:43:05.345 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:43:05.345 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:43:05.345 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:43:05.345 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:05.345 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:43:05.345 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:05.345 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41919sec preferred_lft 41919sec 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:43:05.346 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:43:05.347 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:05.348 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:43:05.348 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:05.348 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:43:05.348 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:05.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:05.348 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:43:05.397 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:43:05.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:05.399 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:43:05.451 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:43:05.451 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:43:05.451 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:43:05.452 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:43:05.452 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:43:05.452 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:43:05.452 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:43:05.452 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:43:05.452 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:43:05.452 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:43:05.452 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:43:05.452 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:43:05.453 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:05.453 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:43:05.453 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:43:05.453 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:43:05.453 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:05.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:43:05.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:05.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:05.584 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:43:05.589 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:43:05.590 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:43:05.590 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:43:05.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:05.590 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:43:05.642 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:43:05.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:43:05.642 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:05.692 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:43:05.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:43:05.692 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:05.739 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:43:05.797 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:43:05.846 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:43:05.846 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:43:05.846 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:43:05.846 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:43:05.846 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:43:05.847 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:43:05.847 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:43:05.847 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:43:05.847 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:43:05.847 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:43:05.847 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:43:05.847 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:43:05.847 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:43:05.847 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:43:05.847 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:43:05.848 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:43:05.849 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:43:05.849 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:05.849 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:05.849 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:05.849 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:05.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:05.850 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:43:05.896 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:43:05.896 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:43:05.941 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:43:05.955 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:43:06.004 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:43:06.004 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:43:06.004 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:43:06.004 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:43:06.004 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:43:06.004 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:43:06.004 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:43:06.005 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:43:06.005 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:43:06.005 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:43:06.005 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:43:06.005 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:43:06.005 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:43:06.005 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:43:06.005 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:43:06.005 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:43:06.005 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:43:06.006 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:43:06.006 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:43:06.006 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:43:06.006 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:43:06.006 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:06.007 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:06.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:06.008 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:43:06.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:43:06.022+0000 7fce8adab580 -1 init, newargv = 0x55f758c1c5b0 newargc=15 2024-09-19T05:43:06.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[73576]: starting ceph client 2024-09-19T05:43:06.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[73576]: starting fuse 2024-09-19T05:43:07.126 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:43:07.145 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:43:07.194 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:43:07.194 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:43:07.194 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:43:07.194 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:43:07.195 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:07.196 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:07.197 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:07.197 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:07.197 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:07.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:07.198 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:43:07.244 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:43:07.244 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:43:07.244 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:43:07.244 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:43:07.244 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:43:07.244 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:43:07.244 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:43:07.244 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:43:07.245 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:43:07.245 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:43:07.245 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:43:07.245 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:43:07.245 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:43:07.245 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:43:07.245 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:43:07.246 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:43:07.372 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.73576.asok 2024-09-19T05:43:07.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:07.385 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.73576.asok 2024-09-19T05:43:07.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:07.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.73576.asok status 2024-09-19T05:43:07.545 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:43:07.545 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:43:07.545 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:43:07.545 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:43:07.545 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:43:07.545 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "73576", 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 8286, 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 8286 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:43:07.546 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 1681030587 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 1681030587 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.8286 192.168.0.1:0/1681030587", 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/1681030587", 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 91, 2024-09-19T05:43:07.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 132, 2024-09-19T05:43:07.548 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:43:07.548 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:43:07.548 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:43:07.548 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:43:07.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:07.559 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:43:07.559 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:07.566 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:43:07.566 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:07.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:07.567 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:07.624 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:07.624 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:07.624 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.0 2024-09-19T05:43:07.624 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:07.624 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:07.624 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:07.625 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:07.753 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.754 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.754 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171127 s, 61.3 MB/s 2024-09-19T05:43:07.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.770 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127887 s, 82.0 MB/s 2024-09-19T05:43:07.788 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.788 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.788 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158224 s, 66.3 MB/s 2024-09-19T05:43:07.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.802 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105705 s, 99.2 MB/s 2024-09-19T05:43:07.819 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.819 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.819 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141795 s, 74.0 MB/s 2024-09-19T05:43:07.835 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.836 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138002 s, 76.0 MB/s 2024-09-19T05:43:07.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.854 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154958 s, 67.7 MB/s 2024-09-19T05:43:07.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.872 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149634 s, 70.1 MB/s 2024-09-19T05:43:07.889 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.889 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.890 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145384 s, 72.1 MB/s 2024-09-19T05:43:07.904 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.904 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.904 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116434 s, 90.1 MB/s 2024-09-19T05:43:07.921 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.922 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143558 s, 73.0 MB/s 2024-09-19T05:43:07.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.939 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146023 s, 71.8 MB/s 2024-09-19T05:43:07.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.957 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146544 s, 71.6 MB/s 2024-09-19T05:43:07.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.973 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129558 s, 80.9 MB/s 2024-09-19T05:43:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134403 s, 78.0 MB/s 2024-09-19T05:43:08.006 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.006 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.006 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137725 s, 76.1 MB/s 2024-09-19T05:43:08.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.023 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137678 s, 76.2 MB/s 2024-09-19T05:43:08.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.039 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130189 s, 80.5 MB/s 2024-09-19T05:43:08.056 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.056 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.057 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014474 s, 72.4 MB/s 2024-09-19T05:43:08.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.071 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116604 s, 89.9 MB/s 2024-09-19T05:43:08.089 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.089 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.089 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144753 s, 72.4 MB/s 2024-09-19T05:43:08.105 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.105 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.105 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137369 s, 76.3 MB/s 2024-09-19T05:43:08.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.122 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136427 s, 76.9 MB/s 2024-09-19T05:43:08.139 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.139 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.139 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136585 s, 76.8 MB/s 2024-09-19T05:43:08.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158095 s, 66.3 MB/s 2024-09-19T05:43:08.175 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.175 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.175 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144008 s, 72.8 MB/s 2024-09-19T05:43:08.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.193 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.193 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014779 s, 71.0 MB/s 2024-09-19T05:43:08.209 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.209 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.210 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137975 s, 76.0 MB/s 2024-09-19T05:43:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132378 s, 79.2 MB/s 2024-09-19T05:43:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141314 s, 74.2 MB/s 2024-09-19T05:43:08.260 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.260 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.260 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139837 s, 75.0 MB/s 2024-09-19T05:43:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134428 s, 78.0 MB/s 2024-09-19T05:43:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:08.285 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:08.286 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:08.286 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.1 2024-09-19T05:43:08.286 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:08.286 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:08.286 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:08.286 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:08.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:08.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.358 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126637 s, 82.8 MB/s 2024-09-19T05:43:08.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.376 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142066 s, 73.8 MB/s 2024-09-19T05:43:08.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.392 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128256 s, 81.8 MB/s 2024-09-19T05:43:08.410 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152688 s, 68.7 MB/s 2024-09-19T05:43:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141372 s, 74.2 MB/s 2024-09-19T05:43:08.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013153 s, 79.7 MB/s 2024-09-19T05:43:08.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.462 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128788 s, 81.4 MB/s 2024-09-19T05:43:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011008 s, 95.3 MB/s 2024-09-19T05:43:08.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.495 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142095 s, 73.8 MB/s 2024-09-19T05:43:08.508 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106107 s, 98.8 MB/s 2024-09-19T05:43:08.527 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.527 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.527 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149533 s, 70.1 MB/s 2024-09-19T05:43:08.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.543 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.543 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123373 s, 85.0 MB/s 2024-09-19T05:43:08.556 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.557 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.557 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110545 s, 94.9 MB/s 2024-09-19T05:43:08.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.571 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114051 s, 91.9 MB/s 2024-09-19T05:43:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132789 s, 79.0 MB/s 2024-09-19T05:43:08.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.600 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967747 s, 108 MB/s 2024-09-19T05:43:08.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.614 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112004 s, 93.6 MB/s 2024-09-19T05:43:08.629 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.630 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121889 s, 86.0 MB/s 2024-09-19T05:43:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.645 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117229 s, 89.4 MB/s 2024-09-19T05:43:08.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.662 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136713 s, 76.7 MB/s 2024-09-19T05:43:08.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.680 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141201 s, 74.3 MB/s 2024-09-19T05:43:08.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.699 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139663 s, 75.1 MB/s 2024-09-19T05:43:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159365 s, 65.8 MB/s 2024-09-19T05:43:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.739 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149415 s, 70.2 MB/s 2024-09-19T05:43:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150784 s, 69.5 MB/s 2024-09-19T05:43:08.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.776 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150366 s, 69.7 MB/s 2024-09-19T05:43:08.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.795 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142652 s, 73.5 MB/s 2024-09-19T05:43:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156934 s, 66.8 MB/s 2024-09-19T05:43:08.834 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.834 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.834 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162172 s, 64.7 MB/s 2024-09-19T05:43:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153142 s, 68.5 MB/s 2024-09-19T05:43:08.873 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.874 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146535 s, 71.6 MB/s 2024-09-19T05:43:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151106 s, 69.4 MB/s 2024-09-19T05:43:08.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:08.902 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:08.902 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:08.902 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.2 2024-09-19T05:43:08.902 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:08.903 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:08.903 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:08.903 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:08.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125107 s, 83.8 MB/s 2024-09-19T05:43:08.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:08.987 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112519 s, 93.2 MB/s 2024-09-19T05:43:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914459 s, 115 MB/s 2024-09-19T05:43:09.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.015 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120459 s, 87.0 MB/s 2024-09-19T05:43:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010879 s, 96.4 MB/s 2024-09-19T05:43:09.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.043 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107153 s, 97.9 MB/s 2024-09-19T05:43:09.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.058 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113515 s, 92.4 MB/s 2024-09-19T05:43:09.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011814 s, 88.8 MB/s 2024-09-19T05:43:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.086 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953924 s, 110 MB/s 2024-09-19T05:43:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.102 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012825 s, 81.8 MB/s 2024-09-19T05:43:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.118 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128516 s, 81.6 MB/s 2024-09-19T05:43:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126234 s, 83.1 MB/s 2024-09-19T05:43:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010484 s, 100 MB/s 2024-09-19T05:43:09.165 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.165 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.165 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134407 s, 78.0 MB/s 2024-09-19T05:43:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103489 s, 101 MB/s 2024-09-19T05:43:09.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.196 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132572 s, 79.1 MB/s 2024-09-19T05:43:09.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.213 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138612 s, 75.6 MB/s 2024-09-19T05:43:09.230 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141373 s, 74.2 MB/s 2024-09-19T05:43:09.248 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.248 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.248 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132167 s, 79.3 MB/s 2024-09-19T05:43:09.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.266 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014235 s, 73.7 MB/s 2024-09-19T05:43:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118809 s, 88.3 MB/s 2024-09-19T05:43:09.299 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.300 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.300 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137942 s, 76.0 MB/s 2024-09-19T05:43:09.317 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.317 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.317 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132064 s, 79.4 MB/s 2024-09-19T05:43:09.335 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.335 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.336 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143409 s, 73.1 MB/s 2024-09-19T05:43:09.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103507 s, 101 MB/s 2024-09-19T05:43:09.367 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.367 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.368 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140467 s, 74.6 MB/s 2024-09-19T05:43:09.384 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.384 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.384 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128297 s, 81.7 MB/s 2024-09-19T05:43:09.401 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.401 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.401 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131712 s, 79.6 MB/s 2024-09-19T05:43:09.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.419 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133449 s, 78.6 MB/s 2024-09-19T05:43:09.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.434 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114412 s, 91.6 MB/s 2024-09-19T05:43:09.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132796 s, 79.0 MB/s 2024-09-19T05:43:09.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.469 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132633 s, 79.1 MB/s 2024-09-19T05:43:09.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:09.478 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:09.478 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:09.478 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.3 2024-09-19T05:43:09.478 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:09.478 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:09.478 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:09.478 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:09.545 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.545 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.545 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113353 s, 92.5 MB/s 2024-09-19T05:43:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.560 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121099 s, 86.6 MB/s 2024-09-19T05:43:09.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.575 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114696 s, 91.4 MB/s 2024-09-19T05:43:09.591 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.591 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.592 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131191 s, 79.9 MB/s 2024-09-19T05:43:09.607 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.607 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.607 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125073 s, 83.8 MB/s 2024-09-19T05:43:09.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.622 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.622 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110837 s, 94.6 MB/s 2024-09-19T05:43:09.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.637 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115113 s, 91.1 MB/s 2024-09-19T05:43:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995059 s, 105 MB/s 2024-09-19T05:43:09.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.666 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128874 s, 81.4 MB/s 2024-09-19T05:43:09.683 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.683 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.683 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013532 s, 77.5 MB/s 2024-09-19T05:43:09.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.698 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.698 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110315 s, 95.1 MB/s 2024-09-19T05:43:09.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.713 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.713 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116374 s, 90.1 MB/s 2024-09-19T05:43:09.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.725 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955613 s, 110 MB/s 2024-09-19T05:43:09.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.741 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123665 s, 84.8 MB/s 2024-09-19T05:43:09.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.759 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012747 s, 82.3 MB/s 2024-09-19T05:43:09.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.778 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013537 s, 77.5 MB/s 2024-09-19T05:43:09.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.793 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117063 s, 89.6 MB/s 2024-09-19T05:43:09.808 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.809 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106933 s, 98.1 MB/s 2024-09-19T05:43:09.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.827 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141237 s, 74.2 MB/s 2024-09-19T05:43:09.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.841 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109462 s, 95.8 MB/s 2024-09-19T05:43:09.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.857 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126339 s, 83.0 MB/s 2024-09-19T05:43:09.871 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.871 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.871 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108191 s, 96.9 MB/s 2024-09-19T05:43:09.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.888 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013329 s, 78.7 MB/s 2024-09-19T05:43:09.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.901 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107653 s, 97.4 MB/s 2024-09-19T05:43:09.916 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.916 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.916 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116335 s, 90.1 MB/s 2024-09-19T05:43:09.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.930 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106518 s, 98.4 MB/s 2024-09-19T05:43:09.944 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.945 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011442 s, 91.6 MB/s 2024-09-19T05:43:09.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.961 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125998 s, 83.2 MB/s 2024-09-19T05:43:09.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.973 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100606 s, 104 MB/s 2024-09-19T05:43:09.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:09.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:09.988 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125252 s, 83.7 MB/s 2024-09-19T05:43:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121865 s, 86.0 MB/s 2024-09-19T05:43:10.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.017 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106295 s, 98.6 MB/s 2024-09-19T05:43:10.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:10.025 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:10.025 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:10.025 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.4 2024-09-19T05:43:10.025 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:10.025 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:10.026 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:10.026 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:10.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:10.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.092 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116663 s, 89.9 MB/s 2024-09-19T05:43:10.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.106 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119526 s, 87.7 MB/s 2024-09-19T05:43:10.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.122 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132506 s, 79.1 MB/s 2024-09-19T05:43:10.138 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.138 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.138 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128923 s, 81.3 MB/s 2024-09-19T05:43:10.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.153 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121112 s, 86.6 MB/s 2024-09-19T05:43:10.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.168 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.168 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118416 s, 88.5 MB/s 2024-09-19T05:43:10.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.182 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115137 s, 91.1 MB/s 2024-09-19T05:43:10.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.198 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121862 s, 86.0 MB/s 2024-09-19T05:43:10.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.213 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128739 s, 81.4 MB/s 2024-09-19T05:43:10.228 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.229 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125733 s, 83.4 MB/s 2024-09-19T05:43:10.240 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:43:10.242 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:43:10.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.243 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119264 s, 87.9 MB/s 2024-09-19T05:43:10.256 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.256 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.256 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097028 s, 108 MB/s 2024-09-19T05:43:10.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.269 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104255 s, 101 MB/s 2024-09-19T05:43:10.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.285 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136952 s, 76.6 MB/s 2024-09-19T05:43:10.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.301 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012169 s, 86.2 MB/s 2024-09-19T05:43:10.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.316 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123001 s, 85.2 MB/s 2024-09-19T05:43:10.330 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.330 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.330 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110602 s, 94.8 MB/s 2024-09-19T05:43:10.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112091 s, 93.5 MB/s 2024-09-19T05:43:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118276 s, 88.7 MB/s 2024-09-19T05:43:10.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.375 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141221 s, 74.3 MB/s 2024-09-19T05:43:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110418 s, 95.0 MB/s 2024-09-19T05:43:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118858 s, 88.2 MB/s 2024-09-19T05:43:10.418 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.418 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.419 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119947 s, 87.4 MB/s 2024-09-19T05:43:10.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.434 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125194 s, 83.8 MB/s 2024-09-19T05:43:10.448 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.448 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.448 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109306 s, 95.9 MB/s 2024-09-19T05:43:10.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.462 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115135 s, 91.1 MB/s 2024-09-19T05:43:10.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.475 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.475 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967161 s, 108 MB/s 2024-09-19T05:43:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912525 s, 115 MB/s 2024-09-19T05:43:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118402 s, 88.6 MB/s 2024-09-19T05:43:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112889 s, 92.9 MB/s 2024-09-19T05:43:10.530 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.531 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.531 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011763 s, 89.1 MB/s 2024-09-19T05:43:10.545 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119616 s, 87.7 MB/s 2024-09-19T05:43:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:10.553 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:10.553 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:10.553 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.5 2024-09-19T05:43:10.553 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:10.554 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:10.554 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:10.554 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:10.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:10.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.663 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.663 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120598 s, 86.9 MB/s 2024-09-19T05:43:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135517 s, 77.4 MB/s 2024-09-19T05:43:10.698 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.698 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.698 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131644 s, 79.7 MB/s 2024-09-19T05:43:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.714 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122759 s, 85.4 MB/s 2024-09-19T05:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130025 s, 80.6 MB/s 2024-09-19T05:43:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133113 s, 78.8 MB/s 2024-09-19T05:43:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135003 s, 77.7 MB/s 2024-09-19T05:43:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104908 s, 100 MB/s 2024-09-19T05:43:10.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.797 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137714 s, 76.1 MB/s 2024-09-19T05:43:10.812 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.812 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.812 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120728 s, 86.9 MB/s 2024-09-19T05:43:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014108 s, 74.3 MB/s 2024-09-19T05:43:10.845 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.845 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.845 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125606 s, 83.5 MB/s 2024-09-19T05:43:10.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.862 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133998 s, 78.3 MB/s 2024-09-19T05:43:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113717 s, 92.2 MB/s 2024-09-19T05:43:10.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.893 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130565 s, 80.3 MB/s 2024-09-19T05:43:10.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.909 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123739 s, 84.7 MB/s 2024-09-19T05:43:10.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.924 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120682 s, 86.9 MB/s 2024-09-19T05:43:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132567 s, 79.1 MB/s 2024-09-19T05:43:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124386 s, 84.3 MB/s 2024-09-19T05:43:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123704 s, 84.8 MB/s 2024-09-19T05:43:10.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:10.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:10.988 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114933 s, 91.2 MB/s 2024-09-19T05:43:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013455 s, 77.9 MB/s 2024-09-19T05:43:11.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.021 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130934 s, 80.1 MB/s 2024-09-19T05:43:11.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.039 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131353 s, 79.8 MB/s 2024-09-19T05:43:11.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.055 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130024 s, 80.6 MB/s 2024-09-19T05:43:11.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.071 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118541 s, 88.5 MB/s 2024-09-19T05:43:11.088 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.088 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.088 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013467 s, 77.9 MB/s 2024-09-19T05:43:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125624 s, 83.5 MB/s 2024-09-19T05:43:11.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.121 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135937 s, 77.1 MB/s 2024-09-19T05:43:11.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.136 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113742 s, 92.2 MB/s 2024-09-19T05:43:11.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.153 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132905 s, 78.9 MB/s 2024-09-19T05:43:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145304 s, 72.2 MB/s 2024-09-19T05:43:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:11.180 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:11.180 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:11.180 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.6 2024-09-19T05:43:11.180 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:11.181 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:11.181 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:11.181 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:11.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:11.297 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.298 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139927 s, 74.9 MB/s 2024-09-19T05:43:11.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.313 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108479 s, 96.7 MB/s 2024-09-19T05:43:11.332 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.332 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.332 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132842 s, 78.9 MB/s 2024-09-19T05:43:11.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.349 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151963 s, 69.0 MB/s 2024-09-19T05:43:11.365 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.365 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.365 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119263 s, 87.9 MB/s 2024-09-19T05:43:11.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.381 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131481 s, 79.8 MB/s 2024-09-19T05:43:11.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.397 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130746 s, 80.2 MB/s 2024-09-19T05:43:11.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.414 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.414 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127595 s, 82.2 MB/s 2024-09-19T05:43:11.430 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.431 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138074 s, 75.9 MB/s 2024-09-19T05:43:11.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.445 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111378 s, 94.1 MB/s 2024-09-19T05:43:11.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.462 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141317 s, 74.2 MB/s 2024-09-19T05:43:11.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.477 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119838 s, 87.5 MB/s 2024-09-19T05:43:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012924 s, 81.1 MB/s 2024-09-19T05:43:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01027 s, 102 MB/s 2024-09-19T05:43:11.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.521 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107855 s, 97.2 MB/s 2024-09-19T05:43:11.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.536 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115475 s, 90.8 MB/s 2024-09-19T05:43:11.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.553 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135648 s, 77.3 MB/s 2024-09-19T05:43:11.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.567 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104932 s, 99.9 MB/s 2024-09-19T05:43:11.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.584 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136704 s, 76.7 MB/s 2024-09-19T05:43:11.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.599 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117022 s, 89.6 MB/s 2024-09-19T05:43:11.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.616 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132645 s, 79.1 MB/s 2024-09-19T05:43:11.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.631 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121945 s, 86.0 MB/s 2024-09-19T05:43:11.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.649 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143594 s, 73.0 MB/s 2024-09-19T05:43:11.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.662 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102563 s, 102 MB/s 2024-09-19T05:43:11.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136929 s, 76.6 MB/s 2024-09-19T05:43:11.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.697 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141499 s, 74.1 MB/s 2024-09-19T05:43:11.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.712 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112851 s, 92.9 MB/s 2024-09-19T05:43:11.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.728 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117327 s, 89.4 MB/s 2024-09-19T05:43:11.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120238 s, 87.2 MB/s 2024-09-19T05:43:11.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.759 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134982 s, 77.7 MB/s 2024-09-19T05:43:11.774 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.774 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.774 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116969 s, 89.6 MB/s 2024-09-19T05:43:11.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.791 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125979 s, 83.2 MB/s 2024-09-19T05:43:11.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:11.800 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:11.800 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:11.800 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.7 2024-09-19T05:43:11.800 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:11.800 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:11.801 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:11.801 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:11.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.869 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012004 s, 87.4 MB/s 2024-09-19T05:43:11.882 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.882 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.882 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011343 s, 92.4 MB/s 2024-09-19T05:43:11.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.897 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123857 s, 84.7 MB/s 2024-09-19T05:43:11.912 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.912 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.912 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119656 s, 87.6 MB/s 2024-09-19T05:43:11.927 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.927 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.927 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115253 s, 91.0 MB/s 2024-09-19T05:43:11.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.942 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108914 s, 96.3 MB/s 2024-09-19T05:43:11.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.955 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104622 s, 100 MB/s 2024-09-19T05:43:11.966 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.966 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.967 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863982 s, 121 MB/s 2024-09-19T05:43:11.978 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.978 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.978 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899138 s, 117 MB/s 2024-09-19T05:43:11.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:11.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:11.993 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115909 s, 90.5 MB/s 2024-09-19T05:43:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.007 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110227 s, 95.1 MB/s 2024-09-19T05:43:12.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.021 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011765 s, 89.1 MB/s 2024-09-19T05:43:12.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.036 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119408 s, 87.8 MB/s 2024-09-19T05:43:12.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.050 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.050 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110404 s, 95.0 MB/s 2024-09-19T05:43:12.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.066 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135142 s, 77.6 MB/s 2024-09-19T05:43:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117525 s, 89.2 MB/s 2024-09-19T05:43:12.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.095 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119383 s, 87.8 MB/s 2024-09-19T05:43:12.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.106 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847825 s, 124 MB/s 2024-09-19T05:43:12.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01153 s, 90.9 MB/s 2024-09-19T05:43:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111189 s, 94.3 MB/s 2024-09-19T05:43:12.147 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.147 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.147 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959514 s, 109 MB/s 2024-09-19T05:43:12.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.163 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123752 s, 84.7 MB/s 2024-09-19T05:43:12.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.179 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132384 s, 79.2 MB/s 2024-09-19T05:43:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120463 s, 87.0 MB/s 2024-09-19T05:43:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121598 s, 86.2 MB/s 2024-09-19T05:43:12.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.224 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110405 s, 95.0 MB/s 2024-09-19T05:43:12.240 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.240 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.240 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133323 s, 78.6 MB/s 2024-09-19T05:43:12.257 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.257 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.258 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134093 s, 78.2 MB/s 2024-09-19T05:43:12.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.273 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011714 s, 89.5 MB/s 2024-09-19T05:43:12.289 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.289 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.289 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124242 s, 84.4 MB/s 2024-09-19T05:43:12.302 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.302 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.303 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996532 s, 105 MB/s 2024-09-19T05:43:12.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.320 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013706 s, 76.5 MB/s 2024-09-19T05:43:12.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:12.329 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:12.329 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:12.329 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.8 2024-09-19T05:43:12.329 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:12.329 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:12.329 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:12.329 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:12.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:12.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.392 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126044 s, 83.2 MB/s 2024-09-19T05:43:12.407 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.407 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.407 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012363 s, 84.8 MB/s 2024-09-19T05:43:12.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.422 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121447 s, 86.3 MB/s 2024-09-19T05:43:12.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103591 s, 101 MB/s 2024-09-19T05:43:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127837 s, 82.0 MB/s 2024-09-19T05:43:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998131 s, 105 MB/s 2024-09-19T05:43:12.475 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.475 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927931 s, 113 MB/s 2024-09-19T05:43:12.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.492 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012835 s, 81.7 MB/s 2024-09-19T05:43:12.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.506 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118591 s, 88.4 MB/s 2024-09-19T05:43:12.519 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.519 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.519 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987434 s, 106 MB/s 2024-09-19T05:43:12.534 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.534 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.534 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117101 s, 89.5 MB/s 2024-09-19T05:43:12.549 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.549 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.549 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122931 s, 85.3 MB/s 2024-09-19T05:43:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912697 s, 115 MB/s 2024-09-19T05:43:12.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.576 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.576 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116008 s, 90.4 MB/s 2024-09-19T05:43:12.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114296 s, 91.7 MB/s 2024-09-19T05:43:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115616 s, 90.7 MB/s 2024-09-19T05:43:12.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.617 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970883 s, 108 MB/s 2024-09-19T05:43:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108981 s, 96.2 MB/s 2024-09-19T05:43:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126898 s, 82.6 MB/s 2024-09-19T05:43:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106815 s, 98.2 MB/s 2024-09-19T05:43:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999531 s, 105 MB/s 2024-09-19T05:43:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114592 s, 91.5 MB/s 2024-09-19T05:43:12.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.703 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.703 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115679 s, 90.6 MB/s 2024-09-19T05:43:12.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.718 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127258 s, 82.4 MB/s 2024-09-19T05:43:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122666 s, 85.5 MB/s 2024-09-19T05:43:12.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.751 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131634 s, 79.7 MB/s 2024-09-19T05:43:12.767 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.767 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.767 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131858 s, 79.5 MB/s 2024-09-19T05:43:12.782 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.782 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.782 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115363 s, 90.9 MB/s 2024-09-19T05:43:12.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.797 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120447 s, 87.1 MB/s 2024-09-19T05:43:12.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.811 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010942 s, 95.8 MB/s 2024-09-19T05:43:12.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.826 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112057 s, 93.6 MB/s 2024-09-19T05:43:12.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.842 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115791 s, 90.6 MB/s 2024-09-19T05:43:12.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:12.850 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:12.850 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:12.850 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.9 2024-09-19T05:43:12.850 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:12.850 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:12.850 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:12.850 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:12.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:12.963 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.963 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.963 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136891 s, 76.6 MB/s 2024-09-19T05:43:12.982 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:12.982 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:12.982 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131559 s, 79.7 MB/s 2024-09-19T05:43:13.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.002 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143457 s, 73.1 MB/s 2024-09-19T05:43:13.018 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.018 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.018 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117572 s, 89.2 MB/s 2024-09-19T05:43:13.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.037 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01449 s, 72.4 MB/s 2024-09-19T05:43:13.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.055 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140228 s, 74.8 MB/s 2024-09-19T05:43:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111302 s, 94.2 MB/s 2024-09-19T05:43:13.086 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.087 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.087 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141116 s, 74.3 MB/s 2024-09-19T05:43:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115551 s, 90.7 MB/s 2024-09-19T05:43:13.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.122 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141249 s, 74.2 MB/s 2024-09-19T05:43:13.139 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.140 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.140 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133862 s, 78.3 MB/s 2024-09-19T05:43:13.158 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.159 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141668 s, 74.0 MB/s 2024-09-19T05:43:13.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.177 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133927 s, 78.3 MB/s 2024-09-19T05:43:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140313 s, 74.7 MB/s 2024-09-19T05:43:13.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.214 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131836 s, 79.5 MB/s 2024-09-19T05:43:13.232 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.232 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.232 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140153 s, 74.8 MB/s 2024-09-19T05:43:13.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.253 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015966 s, 65.7 MB/s 2024-09-19T05:43:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015007 s, 69.9 MB/s 2024-09-19T05:43:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149386 s, 70.2 MB/s 2024-09-19T05:43:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015435 s, 67.9 MB/s 2024-09-19T05:43:13.332 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.332 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.332 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142452 s, 73.6 MB/s 2024-09-19T05:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015258 s, 68.7 MB/s 2024-09-19T05:43:13.369 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.369 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.369 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123502 s, 84.9 MB/s 2024-09-19T05:43:13.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.388 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141816 s, 73.9 MB/s 2024-09-19T05:43:13.402 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.402 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.402 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01032 s, 102 MB/s 2024-09-19T05:43:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137873 s, 76.1 MB/s 2024-09-19T05:43:13.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121534 s, 86.3 MB/s 2024-09-19T05:43:13.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139337 s, 75.3 MB/s 2024-09-19T05:43:13.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.469 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126952 s, 82.6 MB/s 2024-09-19T05:43:13.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.486 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138323 s, 75.8 MB/s 2024-09-19T05:43:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139374 s, 75.2 MB/s 2024-09-19T05:43:13.520 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.520 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.520 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130523 s, 80.3 MB/s 2024-09-19T05:43:13.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:13.529 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:13.529 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:13.529 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.10 2024-09-19T05:43:13.529 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:13.529 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:13.529 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:13.529 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:13.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:13.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117746 s, 89.1 MB/s 2024-09-19T05:43:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935928 s, 112 MB/s 2024-09-19T05:43:13.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107578 s, 97.5 MB/s 2024-09-19T05:43:13.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.630 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122797 s, 85.4 MB/s 2024-09-19T05:43:13.646 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.646 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.646 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129974 s, 80.7 MB/s 2024-09-19T05:43:13.659 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.659 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.659 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101872 s, 103 MB/s 2024-09-19T05:43:13.674 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.674 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.674 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011769 s, 89.1 MB/s 2024-09-19T05:43:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123138 s, 85.2 MB/s 2024-09-19T05:43:13.704 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.704 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.704 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123053 s, 85.2 MB/s 2024-09-19T05:43:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111012 s, 94.5 MB/s 2024-09-19T05:43:13.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.734 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886763 s, 118 MB/s 2024-09-19T05:43:13.746 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.746 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.746 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123592 s, 84.8 MB/s 2024-09-19T05:43:13.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.759 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109211 s, 96.0 MB/s 2024-09-19T05:43:13.774 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.774 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.774 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118525 s, 88.5 MB/s 2024-09-19T05:43:13.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.791 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142786 s, 73.4 MB/s 2024-09-19T05:43:13.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.806 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119172 s, 88.0 MB/s 2024-09-19T05:43:13.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.820 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106538 s, 98.4 MB/s 2024-09-19T05:43:13.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.838 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137548 s, 76.2 MB/s 2024-09-19T05:43:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124179 s, 84.4 MB/s 2024-09-19T05:43:13.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.868 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119515 s, 87.7 MB/s 2024-09-19T05:43:13.883 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.883 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.883 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117608 s, 89.2 MB/s 2024-09-19T05:43:13.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.897 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116122 s, 90.3 MB/s 2024-09-19T05:43:13.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.914 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131961 s, 79.5 MB/s 2024-09-19T05:43:13.932 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.932 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.932 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129131 s, 81.2 MB/s 2024-09-19T05:43:13.943 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.943 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.943 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107509 s, 97.5 MB/s 2024-09-19T05:43:13.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.956 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010045 s, 104 MB/s 2024-09-19T05:43:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.970 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.970 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116189 s, 90.2 MB/s 2024-09-19T05:43:13.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.982 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944068 s, 111 MB/s 2024-09-19T05:43:13.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:13.995 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:13.995 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106297 s, 98.6 MB/s 2024-09-19T05:43:14.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.007 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103606 s, 101 MB/s 2024-09-19T05:43:14.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.021 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110327 s, 95.0 MB/s 2024-09-19T05:43:14.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.041 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176762 s, 59.3 MB/s 2024-09-19T05:43:14.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:14.049 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:14.049 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:14.049 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.11 2024-09-19T05:43:14.049 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:14.049 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:14.049 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:14.049 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:14.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:14.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.153 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125516 s, 83.5 MB/s 2024-09-19T05:43:14.166 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.167 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010199 s, 103 MB/s 2024-09-19T05:43:14.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.182 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117267 s, 89.4 MB/s 2024-09-19T05:43:14.198 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.198 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.198 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012837 s, 81.7 MB/s 2024-09-19T05:43:14.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.215 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131268 s, 79.9 MB/s 2024-09-19T05:43:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.232 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121283 s, 86.5 MB/s 2024-09-19T05:43:14.248 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.248 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.248 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132899 s, 78.9 MB/s 2024-09-19T05:43:14.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.264 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116184 s, 90.3 MB/s 2024-09-19T05:43:14.279 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.279 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.279 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122368 s, 85.7 MB/s 2024-09-19T05:43:14.294 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.294 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.294 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121235 s, 86.5 MB/s 2024-09-19T05:43:14.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.308 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104278 s, 101 MB/s 2024-09-19T05:43:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124312 s, 84.4 MB/s 2024-09-19T05:43:14.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.339 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115251 s, 91.0 MB/s 2024-09-19T05:43:14.355 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.355 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.355 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121366 s, 86.4 MB/s 2024-09-19T05:43:14.371 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.371 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.371 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125838 s, 83.3 MB/s 2024-09-19T05:43:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.388 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125513 s, 83.5 MB/s 2024-09-19T05:43:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130887 s, 80.1 MB/s 2024-09-19T05:43:14.418 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.418 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.419 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112069 s, 93.6 MB/s 2024-09-19T05:43:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126402 s, 83.0 MB/s 2024-09-19T05:43:14.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124635 s, 84.1 MB/s 2024-09-19T05:43:14.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133359 s, 78.6 MB/s 2024-09-19T05:43:14.483 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.484 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.484 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115034 s, 91.2 MB/s 2024-09-19T05:43:14.501 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.501 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.501 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136348 s, 76.9 MB/s 2024-09-19T05:43:14.516 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.516 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.516 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113379 s, 92.5 MB/s 2024-09-19T05:43:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013585 s, 77.2 MB/s 2024-09-19T05:43:14.550 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.550 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.550 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130996 s, 80.0 MB/s 2024-09-19T05:43:14.566 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.566 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.566 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123636 s, 84.8 MB/s 2024-09-19T05:43:14.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.580 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115287 s, 91.0 MB/s 2024-09-19T05:43:14.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.596 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128564 s, 81.6 MB/s 2024-09-19T05:43:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009003 s, 116 MB/s 2024-09-19T05:43:14.624 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.624 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.624 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126595 s, 82.8 MB/s 2024-09-19T05:43:14.640 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.640 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.640 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128654 s, 81.5 MB/s 2024-09-19T05:43:14.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:14.648 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:14.648 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:14.648 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.12 2024-09-19T05:43:14.648 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:14.648 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:14.648 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:14.648 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:14.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:14.767 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.767 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.767 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131108 s, 80.0 MB/s 2024-09-19T05:43:14.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.781 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114224 s, 91.8 MB/s 2024-09-19T05:43:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013662 s, 76.8 MB/s 2024-09-19T05:43:14.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.810 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917831 s, 114 MB/s 2024-09-19T05:43:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013714 s, 76.5 MB/s 2024-09-19T05:43:14.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.842 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124801 s, 84.0 MB/s 2024-09-19T05:43:14.858 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.858 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.858 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127433 s, 82.3 MB/s 2024-09-19T05:43:14.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.869 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862001 s, 122 MB/s 2024-09-19T05:43:14.882 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.882 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.882 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103352 s, 101 MB/s 2024-09-19T05:43:14.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.897 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011692 s, 89.7 MB/s 2024-09-19T05:43:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.910 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106212 s, 98.7 MB/s 2024-09-19T05:43:14.923 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.923 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.923 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107732 s, 97.3 MB/s 2024-09-19T05:43:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.937 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109857 s, 95.4 MB/s 2024-09-19T05:43:14.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.952 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.952 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012021 s, 87.2 MB/s 2024-09-19T05:43:14.963 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.964 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.964 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948009 s, 111 MB/s 2024-09-19T05:43:14.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.976 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991749 s, 106 MB/s 2024-09-19T05:43:14.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:14.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:14.989 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970071 s, 108 MB/s 2024-09-19T05:43:15.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.003 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119777 s, 87.5 MB/s 2024-09-19T05:43:15.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.017 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113382 s, 92.5 MB/s 2024-09-19T05:43:15.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.031 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113028 s, 92.8 MB/s 2024-09-19T05:43:15.048 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.049 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148862 s, 70.4 MB/s 2024-09-19T05:43:15.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.066 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936006 s, 112 MB/s 2024-09-19T05:43:15.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.080 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109408 s, 95.8 MB/s 2024-09-19T05:43:15.093 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.094 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110941 s, 94.5 MB/s 2024-09-19T05:43:15.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.110 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132467 s, 79.2 MB/s 2024-09-19T05:43:15.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.122 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960755 s, 109 MB/s 2024-09-19T05:43:15.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.135 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102969 s, 102 MB/s 2024-09-19T05:43:15.150 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.150 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.150 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120065 s, 87.3 MB/s 2024-09-19T05:43:15.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.160 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778686 s, 135 MB/s 2024-09-19T05:43:15.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.174 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112946 s, 92.8 MB/s 2024-09-19T05:43:15.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.188 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112686 s, 93.1 MB/s 2024-09-19T05:43:15.201 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.201 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.201 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106364 s, 98.6 MB/s 2024-09-19T05:43:15.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:15.208 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:15.208 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:15.208 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.13 2024-09-19T05:43:15.208 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:15.208 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:15.209 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:15.209 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:15.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:15.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103208 s, 102 MB/s 2024-09-19T05:43:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.275 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.275 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892441 s, 117 MB/s 2024-09-19T05:43:15.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.291 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137095 s, 76.5 MB/s 2024-09-19T05:43:15.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.305 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115541 s, 90.8 MB/s 2024-09-19T05:43:15.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.321 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129801 s, 80.8 MB/s 2024-09-19T05:43:15.330 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.330 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.330 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756417 s, 139 MB/s 2024-09-19T05:43:15.345 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.346 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.346 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131133 s, 80.0 MB/s 2024-09-19T05:43:15.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.360 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124513 s, 84.2 MB/s 2024-09-19T05:43:15.371 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.371 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.371 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848679 s, 124 MB/s 2024-09-19T05:43:15.385 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.385 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.385 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114188 s, 91.8 MB/s 2024-09-19T05:43:15.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.396 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888543 s, 118 MB/s 2024-09-19T05:43:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111007 s, 94.5 MB/s 2024-09-19T05:43:15.425 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.425 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.425 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136956 s, 76.6 MB/s 2024-09-19T05:43:15.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.439 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110447 s, 94.9 MB/s 2024-09-19T05:43:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.455 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120667 s, 86.9 MB/s 2024-09-19T05:43:15.470 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.470 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.470 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011244 s, 93.3 MB/s 2024-09-19T05:43:15.485 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.485 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.485 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120446 s, 87.1 MB/s 2024-09-19T05:43:15.497 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.498 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.498 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984219 s, 107 MB/s 2024-09-19T05:43:15.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.513 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012895 s, 81.3 MB/s 2024-09-19T05:43:15.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.524 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847463 s, 124 MB/s 2024-09-19T05:43:15.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.539 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115898 s, 90.5 MB/s 2024-09-19T05:43:15.552 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.552 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.552 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011263 s, 93.1 MB/s 2024-09-19T05:43:15.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.565 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010209 s, 103 MB/s 2024-09-19T05:43:15.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.581 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.581 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127308 s, 82.4 MB/s 2024-09-19T05:43:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116548 s, 90.0 MB/s 2024-09-19T05:43:15.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.608 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106294 s, 98.6 MB/s 2024-09-19T05:43:15.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.620 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878105 s, 119 MB/s 2024-09-19T05:43:15.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.633 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111984 s, 93.6 MB/s 2024-09-19T05:43:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110659 s, 94.8 MB/s 2024-09-19T05:43:15.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110513 s, 94.9 MB/s 2024-09-19T05:43:15.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.675 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113647 s, 92.3 MB/s 2024-09-19T05:43:15.690 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.690 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.690 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123755 s, 84.7 MB/s 2024-09-19T05:43:15.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:15.698 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:15.698 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:15.698 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.14 2024-09-19T05:43:15.698 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:15.698 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:15.698 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:15.698 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:15.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:15.805 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.806 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128629 s, 81.5 MB/s 2024-09-19T05:43:15.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.821 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121945 s, 86.0 MB/s 2024-09-19T05:43:15.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.836 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121678 s, 86.2 MB/s 2024-09-19T05:43:15.851 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.851 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.851 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120808 s, 86.8 MB/s 2024-09-19T05:43:15.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.866 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119328 s, 87.9 MB/s 2024-09-19T05:43:15.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.882 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.882 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129294 s, 81.1 MB/s 2024-09-19T05:43:15.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.894 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909551 s, 115 MB/s 2024-09-19T05:43:15.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.909 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123059 s, 85.2 MB/s 2024-09-19T05:43:15.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.923 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107607 s, 97.4 MB/s 2024-09-19T05:43:15.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.939 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013364 s, 78.5 MB/s 2024-09-19T05:43:15.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.953 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110953 s, 94.5 MB/s 2024-09-19T05:43:15.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.969 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130023 s, 80.6 MB/s 2024-09-19T05:43:15.985 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:15.985 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:15.985 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012857 s, 81.6 MB/s 2024-09-19T05:43:16.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.001 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125326 s, 83.7 MB/s 2024-09-19T05:43:16.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.016 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.016 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123082 s, 85.2 MB/s 2024-09-19T05:43:16.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.031 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122906 s, 85.3 MB/s 2024-09-19T05:43:16.048 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.048 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.048 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133433 s, 78.6 MB/s 2024-09-19T05:43:16.073 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.074 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.074 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114582 s, 91.5 MB/s 2024-09-19T05:43:16.088 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.088 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.088 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011319 s, 92.6 MB/s 2024-09-19T05:43:16.105 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.105 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.105 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140371 s, 74.7 MB/s 2024-09-19T05:43:16.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.120 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122664 s, 85.5 MB/s 2024-09-19T05:43:16.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.135 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119683 s, 87.6 MB/s 2024-09-19T05:43:16.151 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.151 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.151 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124276 s, 84.4 MB/s 2024-09-19T05:43:16.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129962 s, 80.7 MB/s 2024-09-19T05:43:16.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.185 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116724 s, 89.8 MB/s 2024-09-19T05:43:16.201 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.201 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.201 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109953 s, 95.4 MB/s 2024-09-19T05:43:16.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.218 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.218 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118571 s, 88.4 MB/s 2024-09-19T05:43:16.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.237 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015097 s, 69.5 MB/s 2024-09-19T05:43:16.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.254 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.254 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128504 s, 81.6 MB/s 2024-09-19T05:43:16.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.269 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114018 s, 92.0 MB/s 2024-09-19T05:43:16.286 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.287 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.287 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135987 s, 77.1 MB/s 2024-09-19T05:43:16.302 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.303 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119067 s, 88.1 MB/s 2024-09-19T05:43:16.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:16.312 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:16.312 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:16.312 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.15 2024-09-19T05:43:16.312 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:16.312 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:16.312 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:16.312 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:16.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:16.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.388 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139138 s, 75.4 MB/s 2024-09-19T05:43:16.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131366 s, 79.8 MB/s 2024-09-19T05:43:16.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.420 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120509 s, 87.0 MB/s 2024-09-19T05:43:16.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.437 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133949 s, 78.3 MB/s 2024-09-19T05:43:16.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.455 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143653 s, 73.0 MB/s 2024-09-19T05:43:16.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.473 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146763 s, 71.4 MB/s 2024-09-19T05:43:16.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.492 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146025 s, 71.8 MB/s 2024-09-19T05:43:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142664 s, 73.5 MB/s 2024-09-19T05:43:16.526 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.526 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.526 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135425 s, 77.4 MB/s 2024-09-19T05:43:16.543 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.543 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.543 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130092 s, 80.6 MB/s 2024-09-19T05:43:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136323 s, 76.9 MB/s 2024-09-19T05:43:16.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.578 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123437 s, 84.9 MB/s 2024-09-19T05:43:16.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.593 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114611 s, 91.5 MB/s 2024-09-19T05:43:16.611 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.611 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.611 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139466 s, 75.2 MB/s 2024-09-19T05:43:16.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134872 s, 77.7 MB/s 2024-09-19T05:43:16.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.645 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138257 s, 75.8 MB/s 2024-09-19T05:43:16.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.662 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131805 s, 79.6 MB/s 2024-09-19T05:43:16.678 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.678 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.678 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129336 s, 81.1 MB/s 2024-09-19T05:43:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.695 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136544 s, 76.8 MB/s 2024-09-19T05:43:16.713 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.713 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.713 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132839 s, 78.9 MB/s 2024-09-19T05:43:16.731 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.731 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.732 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138737 s, 75.6 MB/s 2024-09-19T05:43:16.750 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.750 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.750 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138884 s, 75.5 MB/s 2024-09-19T05:43:16.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.768 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131566 s, 79.7 MB/s 2024-09-19T05:43:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116535 s, 90.0 MB/s 2024-09-19T05:43:16.803 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.803 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.803 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138368 s, 75.8 MB/s 2024-09-19T05:43:16.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.821 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137107 s, 76.5 MB/s 2024-09-19T05:43:16.840 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.840 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.840 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142621 s, 73.5 MB/s 2024-09-19T05:43:16.858 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.859 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140122 s, 74.8 MB/s 2024-09-19T05:43:16.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.876 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129794 s, 80.8 MB/s 2024-09-19T05:43:16.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.893 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123008 s, 85.2 MB/s 2024-09-19T05:43:16.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.909 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115509 s, 90.8 MB/s 2024-09-19T05:43:16.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:16.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:16.929 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147603 s, 71.0 MB/s 2024-09-19T05:43:16.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:16.938 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:16.938 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:16.938 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.16 2024-09-19T05:43:16.938 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:16.938 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:16.938 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:16.938 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:17.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.007 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135398 s, 77.4 MB/s 2024-09-19T05:43:17.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.023 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126386 s, 83.0 MB/s 2024-09-19T05:43:17.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.037 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110551 s, 94.8 MB/s 2024-09-19T05:43:17.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.055 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143405 s, 73.1 MB/s 2024-09-19T05:43:17.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.081 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013083 s, 80.1 MB/s 2024-09-19T05:43:17.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110607 s, 94.8 MB/s 2024-09-19T05:43:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012211 s, 85.9 MB/s 2024-09-19T05:43:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.128 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137196 s, 76.4 MB/s 2024-09-19T05:43:17.144 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.144 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.144 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131284 s, 79.9 MB/s 2024-09-19T05:43:17.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.157 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102917 s, 102 MB/s 2024-09-19T05:43:17.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.172 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113301 s, 92.5 MB/s 2024-09-19T05:43:17.187 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.187 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.187 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126152 s, 83.1 MB/s 2024-09-19T05:43:17.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.203 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128944 s, 81.3 MB/s 2024-09-19T05:43:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126936 s, 82.6 MB/s 2024-09-19T05:43:17.235 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.235 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.235 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127844 s, 82.0 MB/s 2024-09-19T05:43:17.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124026 s, 84.5 MB/s 2024-09-19T05:43:17.267 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.267 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.267 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135751 s, 77.2 MB/s 2024-09-19T05:43:17.284 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.284 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.284 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135424 s, 77.4 MB/s 2024-09-19T05:43:17.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.298 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110459 s, 94.9 MB/s 2024-09-19T05:43:17.314 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.315 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128849 s, 81.4 MB/s 2024-09-19T05:43:17.331 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.332 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.332 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132736 s, 79.0 MB/s 2024-09-19T05:43:17.347 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130254 s, 80.5 MB/s 2024-09-19T05:43:17.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.362 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.362 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109623 s, 95.7 MB/s 2024-09-19T05:43:17.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.378 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129319 s, 81.1 MB/s 2024-09-19T05:43:17.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.393 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124097 s, 84.5 MB/s 2024-09-19T05:43:17.411 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.412 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151002 s, 69.4 MB/s 2024-09-19T05:43:17.427 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.427 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.427 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123012 s, 85.2 MB/s 2024-09-19T05:43:17.441 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.441 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.441 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110725 s, 94.7 MB/s 2024-09-19T05:43:17.457 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.457 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.457 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123395 s, 85.0 MB/s 2024-09-19T05:43:17.470 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.470 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.471 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105453 s, 99.4 MB/s 2024-09-19T05:43:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118292 s, 88.6 MB/s 2024-09-19T05:43:17.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.502 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140189 s, 74.8 MB/s 2024-09-19T05:43:17.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:17.510 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:17.510 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:17.511 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.17 2024-09-19T05:43:17.511 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:17.511 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:17.511 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:17.511 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:17.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:17.574 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.574 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.574 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117838 s, 89.0 MB/s 2024-09-19T05:43:17.588 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.588 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.588 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107745 s, 97.3 MB/s 2024-09-19T05:43:17.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.602 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101479 s, 103 MB/s 2024-09-19T05:43:17.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103801 s, 101 MB/s 2024-09-19T05:43:17.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.630 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121525 s, 86.3 MB/s 2024-09-19T05:43:17.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.645 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117008 s, 89.6 MB/s 2024-09-19T05:43:17.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.657 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938495 s, 112 MB/s 2024-09-19T05:43:17.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.676 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154056 s, 68.1 MB/s 2024-09-19T05:43:17.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.691 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124908 s, 83.9 MB/s 2024-09-19T05:43:17.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.708 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123868 s, 84.7 MB/s 2024-09-19T05:43:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107696 s, 97.4 MB/s 2024-09-19T05:43:17.740 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.740 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.740 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136545 s, 76.8 MB/s 2024-09-19T05:43:17.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.755 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125645 s, 83.5 MB/s 2024-09-19T05:43:17.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.771 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120826 s, 86.8 MB/s 2024-09-19T05:43:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.785 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117092 s, 89.6 MB/s 2024-09-19T05:43:17.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.802 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137 s, 76.5 MB/s 2024-09-19T05:43:17.818 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.818 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.818 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128314 s, 81.7 MB/s 2024-09-19T05:43:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999542 s, 105 MB/s 2024-09-19T05:43:17.845 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.845 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.845 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104049 s, 101 MB/s 2024-09-19T05:43:17.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.862 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133383 s, 78.6 MB/s 2024-09-19T05:43:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131502 s, 79.7 MB/s 2024-09-19T05:43:17.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.893 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114001 s, 92.0 MB/s 2024-09-19T05:43:17.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.909 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127171 s, 82.5 MB/s 2024-09-19T05:43:17.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.925 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128885 s, 81.4 MB/s 2024-09-19T05:43:17.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125254 s, 83.7 MB/s 2024-09-19T05:43:17.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.960 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155236 s, 67.5 MB/s 2024-09-19T05:43:17.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.977 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136702 s, 76.7 MB/s 2024-09-19T05:43:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149866 s, 70.0 MB/s 2024-09-19T05:43:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134873 s, 77.7 MB/s 2024-09-19T05:43:18.032 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.032 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.032 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014389 s, 72.9 MB/s 2024-09-19T05:43:18.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.052 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158914 s, 66.0 MB/s 2024-09-19T05:43:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013328 s, 78.7 MB/s 2024-09-19T05:43:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:18.095 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:18.095 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:18.095 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.18 2024-09-19T05:43:18.095 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:18.095 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:18.095 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:18.095 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:18.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:18.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.162 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133949 s, 78.3 MB/s 2024-09-19T05:43:18.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.177 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119508 s, 87.7 MB/s 2024-09-19T05:43:18.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.192 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118452 s, 88.5 MB/s 2024-09-19T05:43:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986059 s, 106 MB/s 2024-09-19T05:43:18.219 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.219 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.219 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114126 s, 91.9 MB/s 2024-09-19T05:43:18.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.234 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119181 s, 88.0 MB/s 2024-09-19T05:43:18.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127998 s, 81.9 MB/s 2024-09-19T05:43:18.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.266 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013166 s, 79.6 MB/s 2024-09-19T05:43:18.280 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.280 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.280 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104803 s, 100 MB/s 2024-09-19T05:43:18.296 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.296 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.296 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119541 s, 87.7 MB/s 2024-09-19T05:43:18.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.311 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130527 s, 80.3 MB/s 2024-09-19T05:43:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010119 s, 104 MB/s 2024-09-19T05:43:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146642 s, 71.5 MB/s 2024-09-19T05:43:18.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.358 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124557 s, 84.2 MB/s 2024-09-19T05:43:18.373 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.373 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.373 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121135 s, 86.6 MB/s 2024-09-19T05:43:18.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.392 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150623 s, 69.6 MB/s 2024-09-19T05:43:18.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.409 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128356 s, 81.7 MB/s 2024-09-19T05:43:18.424 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.424 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.424 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123998 s, 84.6 MB/s 2024-09-19T05:43:18.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.438 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109761 s, 95.5 MB/s 2024-09-19T05:43:18.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.456 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.456 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139842 s, 75.0 MB/s 2024-09-19T05:43:18.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.474 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141483 s, 74.1 MB/s 2024-09-19T05:43:18.490 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.490 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.490 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012944 s, 81.0 MB/s 2024-09-19T05:43:18.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.506 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126354 s, 83.0 MB/s 2024-09-19T05:43:18.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118788 s, 88.3 MB/s 2024-09-19T05:43:18.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.539 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131285 s, 79.9 MB/s 2024-09-19T05:43:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136511 s, 76.8 MB/s 2024-09-19T05:43:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133618 s, 78.5 MB/s 2024-09-19T05:43:18.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146125 s, 71.8 MB/s 2024-09-19T05:43:18.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.608 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131998 s, 79.4 MB/s 2024-09-19T05:43:18.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154581 s, 67.8 MB/s 2024-09-19T05:43:18.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.648 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149847 s, 70.0 MB/s 2024-09-19T05:43:18.665 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.666 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123585 s, 84.8 MB/s 2024-09-19T05:43:18.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:18.674 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:18.674 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:18.674 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.19 2024-09-19T05:43:18.675 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:18.675 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:18.675 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:18.675 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:18.739 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.739 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.739 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108688 s, 96.5 MB/s 2024-09-19T05:43:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128219 s, 81.8 MB/s 2024-09-19T05:43:18.771 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.771 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.771 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130197 s, 80.5 MB/s 2024-09-19T05:43:18.788 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.788 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.788 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135644 s, 77.3 MB/s 2024-09-19T05:43:18.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.800 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905306 s, 116 MB/s 2024-09-19T05:43:18.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.816 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122225 s, 85.8 MB/s 2024-09-19T05:43:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011714 s, 89.5 MB/s 2024-09-19T05:43:18.848 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.849 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013881 s, 75.5 MB/s 2024-09-19T05:43:18.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.861 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949838 s, 110 MB/s 2024-09-19T05:43:18.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.878 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132529 s, 79.1 MB/s 2024-09-19T05:43:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140278 s, 74.7 MB/s 2024-09-19T05:43:18.908 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.909 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109118 s, 96.1 MB/s 2024-09-19T05:43:18.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.923 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.923 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112721 s, 93.0 MB/s 2024-09-19T05:43:18.936 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.936 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.936 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106886 s, 98.1 MB/s 2024-09-19T05:43:18.949 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.949 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.950 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105787 s, 99.1 MB/s 2024-09-19T05:43:18.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.965 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130093 s, 80.6 MB/s 2024-09-19T05:43:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121476 s, 86.3 MB/s 2024-09-19T05:43:18.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:18.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:18.994 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109247 s, 96.0 MB/s 2024-09-19T05:43:19.004 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.005 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00818453 s, 128 MB/s 2024-09-19T05:43:19.019 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.019 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.019 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115211 s, 91.0 MB/s 2024-09-19T05:43:19.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.029 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789304 s, 133 MB/s 2024-09-19T05:43:19.042 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.042 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.042 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103527 s, 101 MB/s 2024-09-19T05:43:19.056 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.056 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.056 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117616 s, 89.2 MB/s 2024-09-19T05:43:19.083 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.083 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.083 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979926 s, 107 MB/s 2024-09-19T05:43:19.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.096 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105007 s, 99.9 MB/s 2024-09-19T05:43:19.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.106 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760252 s, 138 MB/s 2024-09-19T05:43:19.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.118 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101685 s, 103 MB/s 2024-09-19T05:43:19.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.133 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011939 s, 87.8 MB/s 2024-09-19T05:43:19.147 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.148 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118218 s, 88.7 MB/s 2024-09-19T05:43:19.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.160 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010146 s, 103 MB/s 2024-09-19T05:43:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956255 s, 110 MB/s 2024-09-19T05:43:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122528 s, 85.6 MB/s 2024-09-19T05:43:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:19.194 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:19.194 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:19.194 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.20 2024-09-19T05:43:19.194 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:19.194 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:19.194 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:19.194 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:19.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:19.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.311 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138034 s, 76.0 MB/s 2024-09-19T05:43:19.327 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.327 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.327 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122086 s, 85.9 MB/s 2024-09-19T05:43:19.344 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.344 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.344 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012667 s, 82.8 MB/s 2024-09-19T05:43:19.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.361 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130492 s, 80.4 MB/s 2024-09-19T05:43:19.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.379 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134622 s, 77.9 MB/s 2024-09-19T05:43:19.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.396 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121581 s, 86.2 MB/s 2024-09-19T05:43:19.414 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.414 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.414 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128096 s, 81.9 MB/s 2024-09-19T05:43:19.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.432 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119605 s, 87.7 MB/s 2024-09-19T05:43:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131274 s, 79.9 MB/s 2024-09-19T05:43:19.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.470 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127975 s, 81.9 MB/s 2024-09-19T05:43:19.487 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.487 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.487 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119983 s, 87.4 MB/s 2024-09-19T05:43:19.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.504 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109673 s, 95.6 MB/s 2024-09-19T05:43:19.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.524 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121543 s, 86.3 MB/s 2024-09-19T05:43:19.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.539 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135186 s, 77.6 MB/s 2024-09-19T05:43:19.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.554 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112439 s, 93.3 MB/s 2024-09-19T05:43:19.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.572 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134011 s, 78.2 MB/s 2024-09-19T05:43:19.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.589 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131647 s, 79.7 MB/s 2024-09-19T05:43:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113347 s, 92.5 MB/s 2024-09-19T05:43:19.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.617 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010516 s, 99.7 MB/s 2024-09-19T05:43:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105162 s, 99.7 MB/s 2024-09-19T05:43:19.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.644 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107887 s, 97.2 MB/s 2024-09-19T05:43:19.660 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134905 s, 77.7 MB/s 2024-09-19T05:43:19.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.677 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131039 s, 80.0 MB/s 2024-09-19T05:43:19.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.691 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104294 s, 101 MB/s 2024-09-19T05:43:19.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.706 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125467 s, 83.6 MB/s 2024-09-19T05:43:19.721 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.721 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.721 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012432 s, 84.3 MB/s 2024-09-19T05:43:19.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.733 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00894557 s, 117 MB/s 2024-09-19T05:43:19.748 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.748 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.748 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120463 s, 87.0 MB/s 2024-09-19T05:43:19.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.761 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102759 s, 102 MB/s 2024-09-19T05:43:19.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.776 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118424 s, 88.5 MB/s 2024-09-19T05:43:19.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.791 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120344 s, 87.1 MB/s 2024-09-19T05:43:19.804 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.804 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106614 s, 98.4 MB/s 2024-09-19T05:43:19.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:19.812 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:19.812 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:19.812 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.21 2024-09-19T05:43:19.812 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:19.812 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:19.812 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:19.812 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:19.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:19.873 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.873 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.873 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130564 s, 80.3 MB/s 2024-09-19T05:43:19.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.888 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011929 s, 87.9 MB/s 2024-09-19T05:43:19.902 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.902 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.902 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111162 s, 94.3 MB/s 2024-09-19T05:43:19.916 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.916 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.916 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111757 s, 93.8 MB/s 2024-09-19T05:43:19.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.931 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114806 s, 91.3 MB/s 2024-09-19T05:43:19.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121301 s, 86.4 MB/s 2024-09-19T05:43:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981346 s, 107 MB/s 2024-09-19T05:43:19.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.974 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132261 s, 79.3 MB/s 2024-09-19T05:43:19.986 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.986 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.986 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968699 s, 108 MB/s 2024-09-19T05:43:19.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:19.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:19.999 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110791 s, 94.6 MB/s 2024-09-19T05:43:20.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112399 s, 93.3 MB/s 2024-09-19T05:43:20.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.024 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854196 s, 123 MB/s 2024-09-19T05:43:20.035 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.035 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.035 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835909 s, 125 MB/s 2024-09-19T05:43:20.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.049 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012319 s, 85.1 MB/s 2024-09-19T05:43:20.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.067 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154078 s, 68.1 MB/s 2024-09-19T05:43:20.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.095 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107641 s, 97.4 MB/s 2024-09-19T05:43:20.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.108 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103535 s, 101 MB/s 2024-09-19T05:43:20.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.118 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724689 s, 145 MB/s 2024-09-19T05:43:20.131 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.131 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.131 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108638 s, 96.5 MB/s 2024-09-19T05:43:20.145 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.146 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117902 s, 88.9 MB/s 2024-09-19T05:43:20.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.159 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107902 s, 97.2 MB/s 2024-09-19T05:43:20.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.172 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010727 s, 97.8 MB/s 2024-09-19T05:43:20.186 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.186 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.186 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114844 s, 91.3 MB/s 2024-09-19T05:43:20.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.198 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.198 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930003 s, 113 MB/s 2024-09-19T05:43:20.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.213 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127681 s, 82.1 MB/s 2024-09-19T05:43:20.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.224 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910274 s, 115 MB/s 2024-09-19T05:43:20.236 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.236 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.236 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981864 s, 107 MB/s 2024-09-19T05:43:20.249 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.249 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.249 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106932 s, 98.1 MB/s 2024-09-19T05:43:20.261 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.261 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.261 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976236 s, 107 MB/s 2024-09-19T05:43:20.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.273 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984369 s, 107 MB/s 2024-09-19T05:43:20.284 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908074 s, 115 MB/s 2024-09-19T05:43:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981077 s, 107 MB/s 2024-09-19T05:43:20.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:20.303 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:20.303 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:20.303 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.22 2024-09-19T05:43:20.303 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:20.303 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:20.303 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:20.303 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:20.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119738 s, 87.6 MB/s 2024-09-19T05:43:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102754 s, 102 MB/s 2024-09-19T05:43:20.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.433 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868707 s, 121 MB/s 2024-09-19T05:43:20.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.447 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106388 s, 98.6 MB/s 2024-09-19T05:43:20.458 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.458 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.458 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863844 s, 121 MB/s 2024-09-19T05:43:20.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.472 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109763 s, 95.5 MB/s 2024-09-19T05:43:20.484 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.484 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.484 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956266 s, 110 MB/s 2024-09-19T05:43:20.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.496 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930735 s, 113 MB/s 2024-09-19T05:43:20.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.510 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.510 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111719 s, 93.9 MB/s 2024-09-19T05:43:20.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.524 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011811 s, 88.8 MB/s 2024-09-19T05:43:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.539 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120103 s, 87.3 MB/s 2024-09-19T05:43:20.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.551 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981292 s, 107 MB/s 2024-09-19T05:43:20.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.565 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011281 s, 93.0 MB/s 2024-09-19T05:43:20.574 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.575 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745703 s, 141 MB/s 2024-09-19T05:43:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776205 s, 135 MB/s 2024-09-19T05:43:20.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.600 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124208 s, 84.4 MB/s 2024-09-19T05:43:20.612 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.612 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.612 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926258 s, 113 MB/s 2024-09-19T05:43:20.623 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.623 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.623 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909749 s, 115 MB/s 2024-09-19T05:43:20.635 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.635 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.635 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931372 s, 113 MB/s 2024-09-19T05:43:20.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.648 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999162 s, 105 MB/s 2024-09-19T05:43:20.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.662 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122001 s, 85.9 MB/s 2024-09-19T05:43:20.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.672 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712611 s, 147 MB/s 2024-09-19T05:43:20.684 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.685 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096158 s, 109 MB/s 2024-09-19T05:43:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120487 s, 87.0 MB/s 2024-09-19T05:43:20.709 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.709 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.709 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753796 s, 139 MB/s 2024-09-19T05:43:20.723 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.723 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.723 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109464 s, 95.8 MB/s 2024-09-19T05:43:20.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.735 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.735 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921796 s, 114 MB/s 2024-09-19T05:43:20.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.749 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01189 s, 88.2 MB/s 2024-09-19T05:43:20.763 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.763 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.763 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115694 s, 90.6 MB/s 2024-09-19T05:43:20.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.778 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012206 s, 85.9 MB/s 2024-09-19T05:43:20.790 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.790 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.790 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998106 s, 105 MB/s 2024-09-19T05:43:20.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.802 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00821154 s, 128 MB/s 2024-09-19T05:43:20.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:20.808 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:20.808 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:20.808 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.23 2024-09-19T05:43:20.809 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:20.809 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:20.809 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:20.809 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:20.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:20.902 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.902 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.902 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885882 s, 118 MB/s 2024-09-19T05:43:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111143 s, 94.3 MB/s 2024-09-19T05:43:20.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.930 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111343 s, 94.2 MB/s 2024-09-19T05:43:20.944 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.945 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119922 s, 87.4 MB/s 2024-09-19T05:43:20.959 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.959 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.959 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120351 s, 87.1 MB/s 2024-09-19T05:43:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113643 s, 92.3 MB/s 2024-09-19T05:43:20.986 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:20.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:20.987 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112523 s, 93.2 MB/s 2024-09-19T05:43:21.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.000 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112416 s, 93.3 MB/s 2024-09-19T05:43:21.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103515 s, 101 MB/s 2024-09-19T05:43:21.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.028 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117032 s, 89.6 MB/s 2024-09-19T05:43:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997097 s, 105 MB/s 2024-09-19T05:43:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934994 s, 112 MB/s 2024-09-19T05:43:21.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.065 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105542 s, 99.4 MB/s 2024-09-19T05:43:21.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.094 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115596 s, 90.7 MB/s 2024-09-19T05:43:21.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.108 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114238 s, 91.8 MB/s 2024-09-19T05:43:21.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.122 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118628 s, 88.4 MB/s 2024-09-19T05:43:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985799 s, 106 MB/s 2024-09-19T05:43:21.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.150 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.150 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119051 s, 88.1 MB/s 2024-09-19T05:43:21.164 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.164 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.164 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104728 s, 100 MB/s 2024-09-19T05:43:21.178 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.178 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.178 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120506 s, 87.0 MB/s 2024-09-19T05:43:21.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.189 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841585 s, 125 MB/s 2024-09-19T05:43:21.201 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.201 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.202 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947742 s, 111 MB/s 2024-09-19T05:43:21.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.214 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976074 s, 107 MB/s 2024-09-19T05:43:21.228 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.229 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120173 s, 87.3 MB/s 2024-09-19T05:43:21.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.243 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114439 s, 91.6 MB/s 2024-09-19T05:43:21.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.258 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125113 s, 83.8 MB/s 2024-09-19T05:43:21.274 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.274 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.274 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012261 s, 85.5 MB/s 2024-09-19T05:43:21.289 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.290 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128215 s, 81.8 MB/s 2024-09-19T05:43:21.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.306 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135264 s, 77.5 MB/s 2024-09-19T05:43:21.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.324 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143218 s, 73.2 MB/s 2024-09-19T05:43:21.341 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.342 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137419 s, 76.3 MB/s 2024-09-19T05:43:21.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.358 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012911 s, 81.2 MB/s 2024-09-19T05:43:21.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:21.366 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:21.366 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:21.367 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.24 2024-09-19T05:43:21.367 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:21.367 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:21.367 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:21.367 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:21.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139932 s, 74.9 MB/s 2024-09-19T05:43:21.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.507 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145556 s, 72.0 MB/s 2024-09-19T05:43:21.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.525 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139788 s, 75.0 MB/s 2024-09-19T05:43:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.543 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136961 s, 76.6 MB/s 2024-09-19T05:43:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.559 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124994 s, 83.9 MB/s 2024-09-19T05:43:21.576 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.576 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.576 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132993 s, 78.8 MB/s 2024-09-19T05:43:21.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.593 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128599 s, 81.5 MB/s 2024-09-19T05:43:21.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.609 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011906 s, 88.1 MB/s 2024-09-19T05:43:21.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.627 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147365 s, 71.2 MB/s 2024-09-19T05:43:21.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.644 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140557 s, 74.6 MB/s 2024-09-19T05:43:21.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129274 s, 81.1 MB/s 2024-09-19T05:43:21.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.677 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012997 s, 80.7 MB/s 2024-09-19T05:43:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013292 s, 78.9 MB/s 2024-09-19T05:43:21.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.712 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148827 s, 70.5 MB/s 2024-09-19T05:43:21.729 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.729 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.729 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141253 s, 74.2 MB/s 2024-09-19T05:43:21.746 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.746 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.746 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136864 s, 76.6 MB/s 2024-09-19T05:43:21.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.761 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110643 s, 94.8 MB/s 2024-09-19T05:43:21.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.777 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125768 s, 83.4 MB/s 2024-09-19T05:43:21.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.793 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131741 s, 79.6 MB/s 2024-09-19T05:43:21.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.809 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127389 s, 82.3 MB/s 2024-09-19T05:43:21.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.826 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131004 s, 80.0 MB/s 2024-09-19T05:43:21.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.843 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137264 s, 76.4 MB/s 2024-09-19T05:43:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128247 s, 81.8 MB/s 2024-09-19T05:43:21.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.876 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139298 s, 75.3 MB/s 2024-09-19T05:43:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130376 s, 80.4 MB/s 2024-09-19T05:43:21.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.910 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137149 s, 76.5 MB/s 2024-09-19T05:43:21.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.924 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110099 s, 95.2 MB/s 2024-09-19T05:43:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135567 s, 77.3 MB/s 2024-09-19T05:43:21.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.957 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128292 s, 81.7 MB/s 2024-09-19T05:43:21.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.974 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134541 s, 77.9 MB/s 2024-09-19T05:43:21.991 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:21.991 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:21.991 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138136 s, 75.9 MB/s 2024-09-19T05:43:22.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.008 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126989 s, 82.6 MB/s 2024-09-19T05:43:22.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:22.017 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:22.017 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:22.017 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.25 2024-09-19T05:43:22.017 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:22.017 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:22.017 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:22.017 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:22.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:22.100 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.100 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.100 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110692 s, 94.7 MB/s 2024-09-19T05:43:22.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.114 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112938 s, 92.8 MB/s 2024-09-19T05:43:22.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.127 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105606 s, 99.3 MB/s 2024-09-19T05:43:22.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.142 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115006 s, 91.2 MB/s 2024-09-19T05:43:22.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.156 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121879 s, 86.0 MB/s 2024-09-19T05:43:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110397 s, 95.0 MB/s 2024-09-19T05:43:22.184 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.184 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114435 s, 91.6 MB/s 2024-09-19T05:43:22.198 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.198 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.198 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109626 s, 95.7 MB/s 2024-09-19T05:43:22.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.213 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125324 s, 83.7 MB/s 2024-09-19T05:43:22.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.227 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105238 s, 99.6 MB/s 2024-09-19T05:43:22.241 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.241 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.241 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114196 s, 91.8 MB/s 2024-09-19T05:43:22.254 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.254 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.254 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103498 s, 101 MB/s 2024-09-19T05:43:22.268 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.268 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.268 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108856 s, 96.3 MB/s 2024-09-19T05:43:22.280 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.281 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101772 s, 103 MB/s 2024-09-19T05:43:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.293 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.293 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903173 s, 116 MB/s 2024-09-19T05:43:22.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.306 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112731 s, 93.0 MB/s 2024-09-19T05:43:22.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.321 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011969 s, 87.6 MB/s 2024-09-19T05:43:22.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.336 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125743 s, 83.4 MB/s 2024-09-19T05:43:22.351 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.351 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.351 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123298 s, 85.0 MB/s 2024-09-19T05:43:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936753 s, 112 MB/s 2024-09-19T05:43:22.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.378 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117262 s, 89.4 MB/s 2024-09-19T05:43:22.394 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.394 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.394 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133155 s, 78.7 MB/s 2024-09-19T05:43:22.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.406 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926332 s, 113 MB/s 2024-09-19T05:43:22.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.422 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121653 s, 86.2 MB/s 2024-09-19T05:43:22.436 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.436 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.436 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011384 s, 92.1 MB/s 2024-09-19T05:43:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.451 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120678 s, 86.9 MB/s 2024-09-19T05:43:22.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.465 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115267 s, 91.0 MB/s 2024-09-19T05:43:22.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.481 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118253 s, 88.7 MB/s 2024-09-19T05:43:22.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.496 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116629 s, 89.9 MB/s 2024-09-19T05:43:22.508 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.508 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961948 s, 109 MB/s 2024-09-19T05:43:22.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.523 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114505 s, 91.6 MB/s 2024-09-19T05:43:22.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.538 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119556 s, 87.7 MB/s 2024-09-19T05:43:22.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:22.546 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:22.547 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:22.547 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.26 2024-09-19T05:43:22.547 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:22.547 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:22.547 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:22.547 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:22.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:22.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.613 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092912 s, 113 MB/s 2024-09-19T05:43:22.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119721 s, 87.6 MB/s 2024-09-19T05:43:22.639 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.639 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.640 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842698 s, 124 MB/s 2024-09-19T05:43:22.655 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.655 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.655 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124771 s, 84.0 MB/s 2024-09-19T05:43:22.668 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.668 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.668 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106435 s, 98.5 MB/s 2024-09-19T05:43:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105658 s, 99.2 MB/s 2024-09-19T05:43:22.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.697 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119721 s, 87.6 MB/s 2024-09-19T05:43:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.712 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118667 s, 88.4 MB/s 2024-09-19T05:43:22.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.728 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136302 s, 76.9 MB/s 2024-09-19T05:43:22.744 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.744 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.744 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128996 s, 81.3 MB/s 2024-09-19T05:43:22.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.759 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116562 s, 90.0 MB/s 2024-09-19T05:43:22.772 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.773 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108622 s, 96.5 MB/s 2024-09-19T05:43:22.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.787 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.787 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113338 s, 92.5 MB/s 2024-09-19T05:43:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113833 s, 92.1 MB/s 2024-09-19T05:43:22.813 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.813 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.813 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884377 s, 119 MB/s 2024-09-19T05:43:22.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.826 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106993 s, 98.0 MB/s 2024-09-19T05:43:22.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.843 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131892 s, 79.5 MB/s 2024-09-19T05:43:22.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.855 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.855 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910749 s, 115 MB/s 2024-09-19T05:43:22.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.869 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110362 s, 95.0 MB/s 2024-09-19T05:43:22.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.881 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922582 s, 114 MB/s 2024-09-19T05:43:22.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.896 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116807 s, 89.8 MB/s 2024-09-19T05:43:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117435 s, 89.3 MB/s 2024-09-19T05:43:22.926 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.926 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.926 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129878 s, 80.7 MB/s 2024-09-19T05:43:22.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117443 s, 89.3 MB/s 2024-09-19T05:43:22.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.960 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014237 s, 73.7 MB/s 2024-09-19T05:43:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.978 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144222 s, 72.7 MB/s 2024-09-19T05:43:22.995 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:22.995 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:22.995 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012321 s, 85.1 MB/s 2024-09-19T05:43:23.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.012 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130105 s, 80.6 MB/s 2024-09-19T05:43:23.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.028 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118822 s, 88.2 MB/s 2024-09-19T05:43:23.045 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.045 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.045 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133528 s, 78.5 MB/s 2024-09-19T05:43:23.060 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.061 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.061 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125215 s, 83.7 MB/s 2024-09-19T05:43:23.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.082 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181501 s, 57.8 MB/s 2024-09-19T05:43:23.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:23.094 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:23.094 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:23.094 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.27 2024-09-19T05:43:23.094 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:23.094 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:23.094 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:23.094 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:23.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:23.155 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.155 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.155 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120784 s, 86.8 MB/s 2024-09-19T05:43:23.170 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.170 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.170 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012057 s, 87.0 MB/s 2024-09-19T05:43:23.181 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.181 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.181 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839777 s, 125 MB/s 2024-09-19T05:43:23.194 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.195 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.195 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010732 s, 97.7 MB/s 2024-09-19T05:43:23.209 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.209 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.209 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118172 s, 88.7 MB/s 2024-09-19T05:43:23.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.226 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134389 s, 78.0 MB/s 2024-09-19T05:43:23.242 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.242 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.242 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133857 s, 78.3 MB/s 2024-09-19T05:43:23.257 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.257 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.257 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123072 s, 85.2 MB/s 2024-09-19T05:43:23.270 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.271 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.271 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102865 s, 102 MB/s 2024-09-19T05:43:23.284 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.285 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010946 s, 95.8 MB/s 2024-09-19T05:43:23.300 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.300 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.300 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125346 s, 83.7 MB/s 2024-09-19T05:43:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126238 s, 83.1 MB/s 2024-09-19T05:43:23.331 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.331 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.331 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118424 s, 88.5 MB/s 2024-09-19T05:43:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103964 s, 101 MB/s 2024-09-19T05:43:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012421 s, 84.4 MB/s 2024-09-19T05:43:23.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.377 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129366 s, 81.1 MB/s 2024-09-19T05:43:23.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.389 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920258 s, 114 MB/s 2024-09-19T05:43:23.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.406 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142697 s, 73.5 MB/s 2024-09-19T05:43:23.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.422 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125836 s, 83.3 MB/s 2024-09-19T05:43:23.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.438 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131141 s, 80.0 MB/s 2024-09-19T05:43:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104668 s, 100 MB/s 2024-09-19T05:43:23.466 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.467 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116415 s, 90.1 MB/s 2024-09-19T05:43:23.480 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.480 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.480 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010062 s, 104 MB/s 2024-09-19T05:43:23.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.496 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129628 s, 80.9 MB/s 2024-09-19T05:43:23.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.512 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129003 s, 81.3 MB/s 2024-09-19T05:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953733 s, 110 MB/s 2024-09-19T05:43:23.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.539 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115576 s, 90.7 MB/s 2024-09-19T05:43:23.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.555 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124622 s, 84.1 MB/s 2024-09-19T05:43:23.570 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.570 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.570 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120355 s, 87.1 MB/s 2024-09-19T05:43:23.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.585 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115774 s, 90.6 MB/s 2024-09-19T05:43:23.598 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.598 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.598 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010571 s, 99.2 MB/s 2024-09-19T05:43:23.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.613 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120326 s, 87.1 MB/s 2024-09-19T05:43:23.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:23.621 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:23.621 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:23.621 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.28 2024-09-19T05:43:23.621 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:23.622 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:23.622 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:23.622 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:23.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:23.737 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.737 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.737 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147249 s, 71.2 MB/s 2024-09-19T05:43:23.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.755 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143664 s, 73.0 MB/s 2024-09-19T05:43:23.772 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.772 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.772 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133301 s, 78.7 MB/s 2024-09-19T05:43:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.786 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109979 s, 95.3 MB/s 2024-09-19T05:43:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127361 s, 82.3 MB/s 2024-09-19T05:43:23.816 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.817 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116832 s, 89.8 MB/s 2024-09-19T05:43:23.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.832 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117729 s, 89.1 MB/s 2024-09-19T05:43:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011765 s, 89.1 MB/s 2024-09-19T05:43:23.860 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.860 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.860 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010695 s, 98.0 MB/s 2024-09-19T05:43:23.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.874 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105939 s, 99.0 MB/s 2024-09-19T05:43:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125251 s, 83.7 MB/s 2024-09-19T05:43:23.903 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.903 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.903 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108866 s, 96.3 MB/s 2024-09-19T05:43:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841803 s, 125 MB/s 2024-09-19T05:43:23.927 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.927 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.927 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929986 s, 113 MB/s 2024-09-19T05:43:23.938 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.938 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.938 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864068 s, 121 MB/s 2024-09-19T05:43:23.949 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.949 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.950 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888387 s, 118 MB/s 2024-09-19T05:43:23.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.962 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912149 s, 115 MB/s 2024-09-19T05:43:23.975 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.975 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.975 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105991 s, 98.9 MB/s 2024-09-19T05:43:23.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:23.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:23.989 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114144 s, 91.9 MB/s 2024-09-19T05:43:24.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.004 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111131 s, 94.4 MB/s 2024-09-19T05:43:24.018 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.019 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.019 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119714 s, 87.6 MB/s 2024-09-19T05:43:24.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.034 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131818 s, 79.5 MB/s 2024-09-19T05:43:24.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.047 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987204 s, 106 MB/s 2024-09-19T05:43:24.059 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.059 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.059 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966086 s, 109 MB/s 2024-09-19T05:43:24.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.073 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.073 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107314 s, 97.7 MB/s 2024-09-19T05:43:24.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101602 s, 103 MB/s 2024-09-19T05:43:24.119 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.119 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.119 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101045 s, 104 MB/s 2024-09-19T05:43:24.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.133 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116709 s, 89.8 MB/s 2024-09-19T05:43:24.147 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.148 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.148 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120845 s, 86.8 MB/s 2024-09-19T05:43:24.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.160 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100853 s, 104 MB/s 2024-09-19T05:43:24.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.177 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121603 s, 86.2 MB/s 2024-09-19T05:43:24.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.192 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010656 s, 98.4 MB/s 2024-09-19T05:43:24.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:24.199 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:24.199 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:24.199 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.29 2024-09-19T05:43:24.199 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:24.199 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:24.199 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:24.200 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:24.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111001 s, 94.5 MB/s 2024-09-19T05:43:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111145 s, 94.3 MB/s 2024-09-19T05:43:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117334 s, 89.4 MB/s 2024-09-19T05:43:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115295 s, 90.9 MB/s 2024-09-19T05:43:24.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.320 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987245 s, 106 MB/s 2024-09-19T05:43:24.341 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.341 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.341 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162061 s, 64.7 MB/s 2024-09-19T05:43:24.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.357 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116353 s, 90.1 MB/s 2024-09-19T05:43:24.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.375 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139936 s, 74.9 MB/s 2024-09-19T05:43:24.394 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.395 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144659 s, 72.5 MB/s 2024-09-19T05:43:24.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.412 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121922 s, 86.0 MB/s 2024-09-19T05:43:24.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152733 s, 68.7 MB/s 2024-09-19T05:43:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.447 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.447 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114132 s, 91.9 MB/s 2024-09-19T05:43:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113582 s, 92.3 MB/s 2024-09-19T05:43:24.475 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.475 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.475 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972436 s, 108 MB/s 2024-09-19T05:43:24.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.492 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133449 s, 78.6 MB/s 2024-09-19T05:43:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012359 s, 84.8 MB/s 2024-09-19T05:43:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012218 s, 85.8 MB/s 2024-09-19T05:43:24.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.542 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014387 s, 72.9 MB/s 2024-09-19T05:43:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.558 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.558 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125159 s, 83.8 MB/s 2024-09-19T05:43:24.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.576 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143106 s, 73.3 MB/s 2024-09-19T05:43:24.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110944 s, 94.5 MB/s 2024-09-19T05:43:24.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.606 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122862 s, 85.3 MB/s 2024-09-19T05:43:24.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012354 s, 84.9 MB/s 2024-09-19T05:43:24.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.637 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124481 s, 84.2 MB/s 2024-09-19T05:43:24.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.653 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126353 s, 83.0 MB/s 2024-09-19T05:43:24.668 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.668 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.668 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120564 s, 87.0 MB/s 2024-09-19T05:43:24.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.682 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111853 s, 93.7 MB/s 2024-09-19T05:43:24.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.699 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136086 s, 77.1 MB/s 2024-09-19T05:43:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127228 s, 82.4 MB/s 2024-09-19T05:43:24.731 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.731 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.731 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132812 s, 79.0 MB/s 2024-09-19T05:43:24.747 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.747 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.747 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125983 s, 83.2 MB/s 2024-09-19T05:43:24.763 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.764 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.764 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132706 s, 79.0 MB/s 2024-09-19T05:43:24.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:24.772 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:24.772 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:24.772 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.30 2024-09-19T05:43:24.772 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:24.772 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:24.772 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:24.772 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:24.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:24.845 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.845 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.845 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139256 s, 75.3 MB/s 2024-09-19T05:43:24.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.859 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114148 s, 91.9 MB/s 2024-09-19T05:43:24.871 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.872 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102823 s, 102 MB/s 2024-09-19T05:43:24.884 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.884 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.885 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104434 s, 100 MB/s 2024-09-19T05:43:24.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.897 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099171 s, 106 MB/s 2024-09-19T05:43:24.912 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.912 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.912 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012455 s, 84.2 MB/s 2024-09-19T05:43:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100893 s, 104 MB/s 2024-09-19T05:43:24.938 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.939 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122069 s, 85.9 MB/s 2024-09-19T05:43:24.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.954 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.954 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111591 s, 94.0 MB/s 2024-09-19T05:43:24.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.968 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.968 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104499 s, 100 MB/s 2024-09-19T05:43:24.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.981 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010867 s, 96.5 MB/s 2024-09-19T05:43:24.997 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:24.997 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:24.997 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125741 s, 83.4 MB/s 2024-09-19T05:43:25.011 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.012 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010808 s, 97.0 MB/s 2024-09-19T05:43:25.026 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.026 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.026 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115661 s, 90.7 MB/s 2024-09-19T05:43:25.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.041 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108832 s, 96.3 MB/s 2024-09-19T05:43:25.052 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.053 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.053 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885644 s, 118 MB/s 2024-09-19T05:43:25.064 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.064 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.065 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908874 s, 115 MB/s 2024-09-19T05:43:25.076 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.076 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.076 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854304 s, 123 MB/s 2024-09-19T05:43:25.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.091 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125435 s, 83.6 MB/s 2024-09-19T05:43:25.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.112 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886324 s, 118 MB/s 2024-09-19T05:43:25.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.125 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106574 s, 98.4 MB/s 2024-09-19T05:43:25.139 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.139 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.139 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111925 s, 93.7 MB/s 2024-09-19T05:43:25.154 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.154 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.154 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127303 s, 82.4 MB/s 2024-09-19T05:43:25.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.171 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138368 s, 75.8 MB/s 2024-09-19T05:43:25.186 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.186 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.187 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012927 s, 81.1 MB/s 2024-09-19T05:43:25.202 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.202 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.203 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013123 s, 79.9 MB/s 2024-09-19T05:43:25.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.217 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119227 s, 87.9 MB/s 2024-09-19T05:43:25.230 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.230 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.231 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104752 s, 100 MB/s 2024-09-19T05:43:25.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.246 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.246 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123456 s, 84.9 MB/s 2024-09-19T05:43:25.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.258 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100086 s, 105 MB/s 2024-09-19T05:43:25.272 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.273 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115315 s, 90.9 MB/s 2024-09-19T05:43:25.288 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.288 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.288 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012519 s, 83.8 MB/s 2024-09-19T05:43:25.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:25.296 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:25.296 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:25.296 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.31 2024-09-19T05:43:25.297 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:25.297 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:25.297 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:25.297 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:25.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:25.355 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.356 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.356 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104001 s, 101 MB/s 2024-09-19T05:43:25.368 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.369 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.369 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103542 s, 101 MB/s 2024-09-19T05:43:25.382 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.382 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.382 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108001 s, 97.1 MB/s 2024-09-19T05:43:25.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.394 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009025 s, 116 MB/s 2024-09-19T05:43:25.408 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.408 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.409 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118439 s, 88.5 MB/s 2024-09-19T05:43:25.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.422 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105788 s, 99.1 MB/s 2024-09-19T05:43:25.436 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.436 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.436 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117222 s, 89.5 MB/s 2024-09-19T05:43:25.450 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.450 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.450 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110962 s, 94.5 MB/s 2024-09-19T05:43:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111588 s, 94.0 MB/s 2024-09-19T05:43:25.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.479 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132339 s, 79.2 MB/s 2024-09-19T05:43:25.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.496 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137402 s, 76.3 MB/s 2024-09-19T05:43:25.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103212 s, 102 MB/s 2024-09-19T05:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010868 s, 96.5 MB/s 2024-09-19T05:43:25.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.536 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01017 s, 103 MB/s 2024-09-19T05:43:25.550 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.550 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.550 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115872 s, 90.5 MB/s 2024-09-19T05:43:25.563 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.564 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.564 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106999 s, 98.0 MB/s 2024-09-19T05:43:25.578 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.578 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.579 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117769 s, 89.0 MB/s 2024-09-19T05:43:25.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869108 s, 121 MB/s 2024-09-19T05:43:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129946 s, 80.7 MB/s 2024-09-19T05:43:25.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123305 s, 85.0 MB/s 2024-09-19T05:43:25.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.636 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115638 s, 90.7 MB/s 2024-09-19T05:43:25.651 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.651 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.651 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119234 s, 87.9 MB/s 2024-09-19T05:43:25.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.667 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.667 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124031 s, 84.5 MB/s 2024-09-19T05:43:25.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.682 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121961 s, 86.0 MB/s 2024-09-19T05:43:25.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.697 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116853 s, 89.7 MB/s 2024-09-19T05:43:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949033 s, 110 MB/s 2024-09-19T05:43:25.726 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.726 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.726 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141721 s, 74.0 MB/s 2024-09-19T05:43:25.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.741 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011852 s, 88.5 MB/s 2024-09-19T05:43:25.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.756 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108241 s, 96.9 MB/s 2024-09-19T05:43:25.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.768 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935428 s, 112 MB/s 2024-09-19T05:43:25.783 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.783 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.783 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117021 s, 89.6 MB/s 2024-09-19T05:43:25.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:25.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:25.798 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114061 s, 91.9 MB/s 2024-09-19T05:43:25.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:25.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:25.806 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-09-19T05:43:25.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.977+0000 7fe6e7e62640 1 Processor -- start 2024-09-19T05:43:25.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.977+0000 7fe6e7e62640 1 -- start start 2024-09-19T05:43:25.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e7e62640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe6e015e6f0 0x7fe6e00d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e7e62640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e00cfe30 0x7fe6e00d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e7e62640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e015ead0 con 0x7fe6e00b5f70 2024-09-19T05:43:25.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e7e62640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e00ceb40 con 0x7fe6e015e6f0 2024-09-19T05:43:25.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e7e62640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e00ced90 con 0x7fe6e00cfe30 2024-09-19T05:43:25.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e5bfe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe6e015e6f0 0x7fe6e00d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e63ff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe6e00b5f70 0x7fe6e01621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37628/0 (socket says 172.21.15.67:37628) 2024-09-19T05:43:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e63ff640 1 -- 172.21.15.67:0/901117588 learned_addr learned my addr 172.21.15.67:0/901117588 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/901117588 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e00cfe30 0x7fe6e00d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/901117588 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e00cfe30 msgr2=0x7fe6e00d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/901117588 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e00cfe30 0x7fe6e00d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e4bfc640 1 -- 172.21.15.67:0/901117588 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1643393917 0 0) 0x7fe6e015ead0 con 0x7fe6e00b5f70 2024-09-19T05:43:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/901117588 >> v1:172.21.15.67:6789/0 conn(0x7fe6e00b5f70 legacy=0x7fe6e01621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/901117588 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e00cf070 con 0x7fe6e015e6f0 2024-09-19T05:43:25.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/901117588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e015e6f0 0x7fe6e00d3090 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009d90 tx=0x7fe6dc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dab8606793fcac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:25.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e4bfc640 1 -- 172.21.15.67:0/901117588 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0b2070 con 0x7fe6e015e6f0 2024-09-19T05:43:25.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e4bfc640 1 -- 172.21.15.67:0/901117588 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0a5800 con 0x7fe6e015e6f0 2024-09-19T05:43:25.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.981+0000 7fe6e4bfc640 1 -- 172.21.15.67:0/901117588 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0a5bd0 con 0x7fe6e015e6f0 2024-09-19T05:43:25.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 -- 172.21.15.67:0/901117588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e015e6f0 msgr2=0x7fe6e00d3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:25.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 --2- 172.21.15.67:0/901117588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e015e6f0 0x7fe6e00d3090 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009d90 tx=0x7fe6dc01c850 comp rx=0 tx=0).stop 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 -- 172.21.15.67:0/901117588 shutdown_connections 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 --2- 172.21.15.67:0/901117588 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e00cfe30 0x7fe6e00d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 --2- 172.21.15.67:0/901117588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e015e6f0 0x7fe6e00d3090 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 -- 172.21.15.67:0/901117588 >> 172.21.15.67:0/901117588 conn(0x7fe6e008bfc0 msgr2=0x7fe6e00d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 -- 172.21.15.67:0/901117588 shutdown_connections 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 -- 172.21.15.67:0/901117588 wait complete. 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 Processor -- start 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 -- start start 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e00b5f70 0x7fe6e014d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e00cfe30 0x7fe6e015d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e015e6f0 0x7fe6e00b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e016b500 con 0x7fe6e00cfe30 2024-09-19T05:43:25.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e00b67f0 con 0x7fe6e015e6f0 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e016b680 con 0x7fe6e00b5f70 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e53fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e00cfe30 0x7fe6e015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e53fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e00cfe30 0x7fe6e015d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45594/0 (socket says 172.21.15.67:45594) 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e53fd640 1 -- 172.21.15.67:0/1943774559 learned_addr learned my addr 172.21.15.67:0/1943774559 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e63ff640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e015e6f0 0x7fe6e00b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e00b5f70 0x7fe6e014d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e53fd640 1 -- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e00b5f70 msgr2=0x7fe6e014d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e00b5f70 0x7fe6e014d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e53fd640 1 -- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e015e6f0 msgr2=0x7fe6e00b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e015e6f0 0x7fe6e00b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e53fd640 1 -- 172.21.15.67:0/1943774559 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e00b1c10 con 0x7fe6e00cfe30 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e00cfe30 0x7fe6e015d900 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000d830 tx=0x7fe6d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:25.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6d67fc640 1 -- 172.21.15.67:0/1943774559 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0007e10 con 0x7fe6e00cfe30 2024-09-19T05:43:25.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6d67fc640 1 -- 172.21.15.67:0/1943774559 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d0004240 con 0x7fe6e00cfe30 2024-09-19T05:43:25.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6d67fc640 1 -- 172.21.15.67:0/1943774559 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000b660 con 0x7fe6e00cfe30 2024-09-19T05:43:25.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.985+0000 7fe6e7e62640 1 -- 172.21.15.67:0/1943774559 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e015efa0 con 0x7fe6e00cfe30 2024-09-19T05:43:25.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6e7e62640 1 -- 172.21.15.67:0/1943774559 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e0161820 con 0x7fe6e00cfe30 2024-09-19T05:43:25.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6d67fc640 1 -- 172.21.15.67:0/1943774559 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6d000b800 con 0x7fe6e00cfe30 2024-09-19T05:43:25.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6d67fc640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c40678c0 0x7fe6c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6d67fc640 1 -- 172.21.15.67:0/1943774559 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7fe6d0086110 con 0x7fe6e00cfe30 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c40678c0 0x7fe6c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6eaf1e000 1 Processor -- start 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6eaf1e000 1 -- start start 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c40678c0 0x7fe6c4069d80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0af000 tx=0x7fe6dc0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c593ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 0x55d02c547160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c5476a0 0x55d02c547a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d02c397ba0 con 0x55d02c5936d0 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d02c33d350 con 0x55d02c5476a0 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d02c393b60 con 0x55d02c593ff0 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6e5bfe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c593ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6e5bfe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c593ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45608/0 (socket says 172.21.15.67:45608) 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/2181742497 learned_addr learned my addr 172.21.15.67:0/2181742497 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6e63ff640 1 --2- 172.21.15.67:0/2181742497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c5476a0 0x55d02c547a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.989+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/2181742497 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 0x55d02c547160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/2181742497 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 msgr2=0x55d02c547160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/2181742497 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 0x55d02c547160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/2181742497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c5476a0 msgr2=0x55d02c547a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/2181742497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c5476a0 0x55d02c547a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/2181742497 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d02c340bd0 con 0x55d02c5936d0 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/2181742497 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 0x55d02c547160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/2181742497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c593ab0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc01af00 tx=0x7fe6dc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b6919eff4dce34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6c37fe640 1 -- 172.21.15.67:0/2181742497 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0ca070 con 0x55d02c5936d0 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6c37fe640 1 -- 172.21.15.67:0/2181742497 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0b8650 con 0x55d02c5936d0 2024-09-19T05:43:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6c37fe640 1 -- 172.21.15.67:0/2181742497 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0b2040 con 0x55d02c5936d0 2024-09-19T05:43:25.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/2181742497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 msgr2=0x55d02c593ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:25.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/2181742497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c593ab0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc01af00 tx=0x7fe6dc004ac0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/2181742497 shutdown_connections 2024-09-19T05:43:25.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/2181742497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c5476a0 0x55d02c547a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/2181742497 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 0x55d02c547160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/2181742497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c593ab0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/2181742497 >> 172.21.15.67:0/2181742497 conn(0x55d02c574470 msgr2=0x55d02c576860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:25.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/2181742497 shutdown_connections 2024-09-19T05:43:25.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/2181742497 wait complete. 2024-09-19T05:43:25.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- start start 2024-09-19T05:43:25.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 Processor -- start 2024-09-19T05:43:25.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c5476a0 0x55d02c573ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c54f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 0x55d02c54f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:25.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d02c3312a0 con 0x55d02c5936d0 2024-09-19T05:43:25.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d02c3567d0 con 0x55d02c5476a0 2024-09-19T05:43:25.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d02c358f70 con 0x55d02c593ff0 2024-09-19T05:43:25.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 10 client.0 _ll_register_callbacks cb 0x55d02c534b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e53fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c54f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e53fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c54f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45618/0 (socket says 172.21.15.67:45618) 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e53fd640 1 -- 172.21.15.67:0/1892084869 learned_addr learned my addr 172.21.15.67:0/1892084869 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c5476a0 0x55d02c573ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e63ff640 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 0x55d02c54f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e53fd640 1 -- 172.21.15.67:0/1892084869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 msgr2=0x55d02c54f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 0x55d02c54f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e53fd640 1 -- 172.21.15.67:0/1892084869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c5476a0 msgr2=0x55d02c573ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c5476a0 0x55d02c573ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e53fd640 1 -- 172.21.15.67:0/1892084869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d02c3a0810 con 0x55d02c5936d0 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c54f1e0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe6d005ea70 tx=0x7fe6d0056c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734399d2e9432e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/1892084869 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d006e020 con 0x55d02c5936d0 2024-09-19T05:43:25.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/1892084869 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7fe6d006e1c0 con 0x55d02c5936d0 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1892084869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6dc0b8650 con 0x55d02c5936d0 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/1892084869 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fe6d006e3c0 con 0x55d02c5936d0 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 10 client.8301 fetch_fsmap learned FSMap version 91 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1892084869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x55d02c3419f0 con 0x55d02c5936d0 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/1892084869 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0b8650 con 0x55d02c5936d0 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.993+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/1892084869 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7fe6d0013070 con 0x55d02c5936d0 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 10 client.8301 fetch_fsmap finished waiting for FSMap version 91 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 10 client.8301 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 20 client.8301 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x55d02c54caa0 0x55d02c5a4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 4 client.8301 mds_command: new command op to 8136 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1892084869 --> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d02c331bd0 con 0x55d02c54caa0 2024-09-19T05:43:26.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x55d02c54caa0 0x55d02c5a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x55d02c54caa0 0x55d02c5a4980 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7b331bd0c6e9a5 server_cookie=2bf6723ad1b1e673 in_seq=0 out_seq=0 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6c0ff9640 10 client.8301 ms_handle_connect on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/1892084869 <== mds.0 v2:172.21.15.67:6834/96000467 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d02c331bd0 con 0x55d02c54caa0 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6c0ff9640 10 client.8301 handle_command_reply: tid=0 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 client.8301 shutdown 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1892084869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 msgr2=0x55d02c54f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c54f1e0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe6d005ea70 tx=0x7fe6d0056c00 comp rx=0 tx=0).stop 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1892084869 shutdown_connections 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x55d02c54caa0 0x55d02c5a4980 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c593ff0 0x55d02c54f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c54f1e0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6c0ff9640 0 client.8301 ms_handle_reset on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/1892084869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c5476a0 0x55d02c573ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1892084869 >> 172.21.15.67:0/1892084869 conn(0x55d02c574470 msgr2=0x55d02c546860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1892084869 shutdown_connections 2024-09-19T05:43:26.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1892084869 wait complete. 2024-09-19T05:43:26.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:25.997+0000 7fe6eaf1e000 20 client.8301 trim_cache size 0 max 16384 2024-09-19T05:43:26.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.013+0000 7fe6eaf1e000 1 Processor -- start 2024-09-19T05:43:26.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.013+0000 7fe6eaf1e000 1 -- start start 2024-09-19T05:43:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5476a0 0x55d02c546940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c5936d0 0x55d02c546e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 0x55d02c5a4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e0203210 con 0x55d02c5476a0 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e0156420 con 0x55d02c593ff0 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e0156a70 con 0x55d02c5936d0 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e5bfe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5476a0 0x55d02c546940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e5bfe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5476a0 0x55d02c546940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45626/0 (socket says 172.21.15.67:45626) 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/1036413679 learned_addr learned my addr 172.21.15.67:0/1036413679 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/1036413679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c5936d0 0x55d02c546e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/1036413679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c5936d0 msgr2=0x55d02c546e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e63ff640 1 --2- 172.21.15.67:0/1036413679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 0x55d02c5a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/1036413679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c5936d0 0x55d02c546e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/1036413679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 msgr2=0x55d02c5a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/1036413679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 0x55d02c5a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e5bfe640 1 -- 172.21.15.67:0/1036413679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d02c33d5a0 con 0x55d02c5476a0 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e63ff640 1 --2- 172.21.15.67:0/1036413679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 0x55d02c5a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/1036413679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5476a0 0x55d02c546940 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc01cd30 tx=0x7fe6dc0b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21eeff6d1c08ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6c2ffd640 1 -- 172.21.15.67:0/1036413679 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0ca040 con 0x55d02c5476a0 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6c2ffd640 1 -- 172.21.15.67:0/1036413679 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0d6030 con 0x55d02c5476a0 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6c2ffd640 1 -- 172.21.15.67:0/1036413679 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0b2040 con 0x55d02c5476a0 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1036413679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5476a0 msgr2=0x55d02c546940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/1036413679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5476a0 0x55d02c546940 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc01cd30 tx=0x7fe6dc0b8000 comp rx=0 tx=0).stop 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1036413679 shutdown_connections 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/1036413679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 0x55d02c5a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/1036413679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c5936d0 0x55d02c546e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/1036413679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5476a0 0x55d02c546940 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1036413679 >> 172.21.15.67:0/1036413679 conn(0x55d02c574470 msgr2=0x55d02c54f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1036413679 shutdown_connections 2024-09-19T05:43:26.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/1036413679 wait complete. 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- start start 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 Processor -- start 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c5476a0 0x55d02c5a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c5a8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 0x55d02c5c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d02c343c10 con 0x55d02c5936d0 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d02c33ee30 con 0x55d02c593ff0 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d02c31c8f0 con 0x55d02c5476a0 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6eaf1e000 10 client.0 _ll_register_callbacks cb 0x7fe6d0056190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e53fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c5a8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e53fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c5a8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45638/0 (socket says 172.21.15.67:45638) 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e53fd640 1 -- 172.21.15.67:0/675389641 learned_addr learned my addr 172.21.15.67:0/675389641 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c5476a0 0x55d02c5a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e53fd640 1 -- 172.21.15.67:0/675389641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c5476a0 msgr2=0x55d02c5a7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c5476a0 0x55d02c5a7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e63ff640 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 0x55d02c5c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e53fd640 1 -- 172.21.15.67:0/675389641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 msgr2=0x55d02c5c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 0x55d02c5c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e53fd640 1 -- 172.21.15.67:0/675389641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d02c3375b0 con 0x55d02c5936d0 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.017+0000 7fe6e63ff640 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 0x55d02c5c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6e53fd640 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c5a8110 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0086430 tx=0x7fe6d0084380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0df39fdfb3fcbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/675389641 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d006e040 con 0x55d02c5936d0 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/675389641 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7fe6d000baf0 con 0x55d02c5936d0 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/675389641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6dc0d6030 con 0x55d02c5936d0 2024-09-19T05:43:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/675389641 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fe6d0052660 con 0x55d02c5936d0 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6eaf1e000 10 client.8307 fetch_fsmap learned FSMap version 91 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/675389641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x55d02c32f330 con 0x55d02c5936d0 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/675389641 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0d6030 con 0x55d02c5936d0 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/675389641 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7fe6d0052110 con 0x55d02c5936d0 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6eaf1e000 10 client.8307 fetch_fsmap finished waiting for FSMap version 91 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6eaf1e000 10 client.8307 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6eaf1e000 20 client.8307 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x55d02c5c3860 0x55d02c607120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6eaf1e000 4 client.8307 mds_command: new command op to 8136 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/675389641 --> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55d02c3a52d0 con 0x55d02c5c3860 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x55d02c5c3860 0x55d02c607120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6c0ff9640 10 client.8307 ms_handle_connect on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.021+0000 7fe6e5bfe640 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x55d02c5c3860 0x55d02c607120 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71e9ffbdab83a25e server_cookie=4c2b8e1d4e51401c in_seq=0 out_seq=0 2024-09-19T05:43:26.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6c0ff9640 1 -- 172.21.15.67:0/675389641 <== mds.0 v2:172.21.15.67:6834/96000467 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d02c3a52d0 con 0x55d02c5c3860 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6c0ff9640 10 client.8307 handle_command_reply: tid=0 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 client.8307 shutdown 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/675389641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 msgr2=0x55d02c5a8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c5a8110 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0086430 tx=0x7fe6d0084380 comp rx=0 tx=0).stop 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/675389641 shutdown_connections 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d02c593ff0 0x55d02c5c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d02c5936d0 0x55d02c5a8110 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x55d02c5c3860 0x55d02c607120 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 --2- 172.21.15.67:0/675389641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d02c5476a0 0x55d02c5a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/675389641 >> 172.21.15.67:0/675389641 conn(0x55d02c574470 msgr2=0x55d02c545930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6c0ff9640 0 client.8307 ms_handle_reset on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/675389641 shutdown_connections 2024-09-19T05:43:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 1 -- 172.21.15.67:0/675389641 wait complete. 2024-09-19T05:43:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6eaf1e000 20 client.8307 trim_cache size 0 max 16384 2024-09-19T05:43:26.027 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:43:26.027 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:43:26.027 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "0a63a65c-5490-4479-b03c-67fcefdff48d", 2024-09-19T05:43:26.027 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:43:26.027 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:43:26.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 -- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c40678c0 msgr2=0x7fe6c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c40678c0 0x7fe6c4069d80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0af000 tx=0x7fe6dc0a7070 comp rx=0 tx=0).stop 2024-09-19T05:43:26.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 -- 172.21.15.67:0/1943774559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e00cfe30 msgr2=0x7fe6e015d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e00cfe30 0x7fe6e015d900 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000d830 tx=0x7fe6d000dcf0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 -- 172.21.15.67:0/1943774559 shutdown_connections 2024-09-19T05:43:26.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6e015e6f0 0x7fe6e00b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6e00cfe30 0x7fe6e015d900 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6c40678c0 0x7fe6c4069d80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 --2- 172.21.15.67:0/1943774559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6e00b5f70 0x7fe6e014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 -- 172.21.15.67:0/1943774559 >> 172.21.15.67:0/1943774559 conn(0x7fe6e008bfc0 msgr2=0x7fe6e014e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 -- 172.21.15.67:0/1943774559 shutdown_connections 2024-09-19T05:43:26.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.025+0000 7fe6e7e62640 1 -- 172.21.15.67:0/1943774559 wait complete. 2024-09-19T05:43:26.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:26.043 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-09-19T05:43:26.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.193+0000 7f67ec784640 1 Processor -- start 2024-09-19T05:43:26.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.193+0000 7f67ec784640 1 -- start start 2024-09-19T05:43:26.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.193+0000 7f67ec784640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f67e40b3750 0x7f67e40ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.193+0000 7f67ec784640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e40cea90 con 0x7f67e415f950 2024-09-19T05:43:26.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.193+0000 7f67ec784640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e40cd7e0 con 0x7f67e40d0de0 2024-09-19T05:43:26.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.193+0000 7f67ec784640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f67e40af1a0 con 0x7f67e40b3750 2024-09-19T05:43:26.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.193+0000 7f67ea520640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f67e415f950 0x7f67e40d06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37634/0 (socket says 172.21.15.67:37634) 2024-09-19T05:43:26.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.193+0000 7f67ea520640 1 -- 172.21.15.67:0/1315923163 learned_addr learned my addr 172.21.15.67:0/1315923163 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2489953775 0 0) 0x7f67e40cea90 con 0x7f67e415f950 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67d0003530 con 0x7f67e415f950 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67ead21640 1 --2- 172.21.15.67:0/1315923163 >> v2:172.21.15.97:3300/0 conn(0x7f67e40b3750 0x7f67e40ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1499725185 0 0) 0x7f67d0003530 con 0x7f67e415f950 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 >> v2:172.21.15.97:3300/0 conn(0x7f67e40b3750 msgr2=0x7f67e40ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 --2- 172.21.15.67:0/1315923163 >> v2:172.21.15.97:3300/0 conn(0x7f67e40b3750 0x7f67e40ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 >> v1:172.21.15.97:6789/0 conn(0x7f67e40d0de0 legacy=0x7f67e40b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e40cdac0 con 0x7f67e415f950 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f67e0001680 con 0x7f67e415f950 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 >> v1:172.21.15.67:6789/0 conn(0x7f67e415f950 legacy=0x7f67e40d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d00039c0 0x7f67d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67d00051d0 0x7f67d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67d000c0f0 con 0x7f67d0004810 2024-09-19T05:43:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67d000c2a0 con 0x7f67d00051d0 2024-09-19T05:43:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67d000c4a0 con 0x7f67d00039c0 2024-09-19T05:43:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67ea520640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d00039c0 0x7f67d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67ead21640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67d00051d0 0x7f67d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e9d1f640 1 -- 172.21.15.67:0/1315923163 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d00039c0 msgr2=0x7f67d0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d00039c0 0x7f67d0003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e9d1f640 1 -- 172.21.15.67:0/1315923163 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67d00051d0 msgr2=0x7f67d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67d00051d0 0x7f67d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e9d1f640 1 -- 172.21.15.67:0/1315923163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d0003530 con 0x7f67d0004810 2024-09-19T05:43:26.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67ead21640 1 -- 172.21.15.67:0/1315923163 reap_dead start 2024-09-19T05:43:26.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67d0004c90 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f67d4001780 tx=0x7f67d401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855f29fe400171c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d40013a0 con 0x7f67d0004810 2024-09-19T05:43:26.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d40a9070 con 0x7f67d0004810 2024-09-19T05:43:26.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.197+0000 7f67e951e640 1 -- 172.21.15.67:0/1315923163 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d40052d0 con 0x7f67d0004810 2024-09-19T05:43:26.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 -- 172.21.15.67:0/1315923163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 msgr2=0x7f67d0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67d0004c90 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f67d4001780 tx=0x7f67d401c420 comp rx=0 tx=0).stop 2024-09-19T05:43:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 -- 172.21.15.67:0/1315923163 shutdown_connections 2024-09-19T05:43:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 --2- 172.21.15.67:0/1315923163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67d0004c90 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 -- 172.21.15.67:0/1315923163 >> 172.21.15.67:0/1315923163 conn(0x7f67e40d22f0 msgr2=0x7f67e40d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 -- 172.21.15.67:0/1315923163 shutdown_connections 2024-09-19T05:43:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 -- 172.21.15.67:0/1315923163 wait complete. 2024-09-19T05:43:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 Processor -- start 2024-09-19T05:43:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 -- start start 2024-09-19T05:43:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67e406de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67e4158e30 0x7f67e406e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67e40b0ea0 0x7f67e40af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67e409bc40 con 0x7f67d0004810 2024-09-19T05:43:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67e415fd30 con 0x7f67e40b0ea0 2024-09-19T05:43:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ec784640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67e415feb0 con 0x7f67e4158e30 2024-09-19T05:43:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ea520640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67e406de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ea520640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67e406de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45668/0 (socket says 172.21.15.67:45668) 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ea520640 1 -- 172.21.15.67:0/2211809002 learned_addr learned my addr 172.21.15.67:0/2211809002 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67e4158e30 0x7f67e406e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ead21640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67e40b0ea0 0x7f67e40af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ea520640 1 -- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67e4158e30 msgr2=0x7f67e406e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ea520640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67e4158e30 0x7f67e406e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ea520640 1 -- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67e40b0ea0 msgr2=0x7f67e40af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ea520640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67e40b0ea0 0x7f67e40af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ea520640 1 -- 172.21.15.67:0/2211809002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e40b51c0 con 0x7f67d0004810 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ead21640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67e40b0ea0 0x7f67e40af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67ea520640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67e406de90 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f67e0010b40 tx=0x7f67e0005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.201+0000 7f67daffd640 1 -- 172.21.15.67:0/2211809002 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e001b070 con 0x7f67d0004810 2024-09-19T05:43:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.205+0000 7f67daffd640 1 -- 172.21.15.67:0/2211809002 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e0011040 con 0x7f67d0004810 2024-09-19T05:43:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.205+0000 7f67ec784640 1 -- 172.21.15.67:0/2211809002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e4159310 con 0x7f67d0004810 2024-09-19T05:43:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.205+0000 7f67daffd640 1 -- 172.21.15.67:0/2211809002 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e000edd0 con 0x7f67d0004810 2024-09-19T05:43:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.205+0000 7f67ec784640 1 -- 172.21.15.67:0/2211809002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e40b5480 con 0x7f67d0004810 2024-09-19T05:43:26.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.205+0000 7f67daffd640 1 -- 172.21.15.67:0/2211809002 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67e001e070 con 0x7f67d0004810 2024-09-19T05:43:26.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.205+0000 7f67daffd640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67c80678f0 0x7f67c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.205+0000 7f67daffd640 1 -- 172.21.15.67:0/2211809002 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f67e00887b0 con 0x7f67d0004810 2024-09-19T05:43:26.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.205+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67c80678f0 0x7f67c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67c80678f0 0x7f67c8069db0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f67d4001750 tx=0x7f67d40011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 Processor -- start 2024-09-19T05:43:26.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 -- start start 2024-09-19T05:43:26.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 0x559358e3fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e40530 0x559358df3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358df3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559358c44cc0 con 0x559358df3780 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559358bffa20 con 0x559358e3fc10 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559358c40c80 con 0x559358e40530 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ead21640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358df3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ead21640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358df3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45682/0 (socket says 172.21.15.67:45682) 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ead21640 1 -- 172.21.15.67:0/3865684845 learned_addr learned my addr 172.21.15.67:0/3865684845 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ea520640 1 --2- 172.21.15.67:0/3865684845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 0x559358e3fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/3865684845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e40530 0x559358df3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ead21640 1 -- 172.21.15.67:0/3865684845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e40530 msgr2=0x559358df3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ead21640 1 --2- 172.21.15.67:0/3865684845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e40530 0x559358df3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ead21640 1 -- 172.21.15.67:0/3865684845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 msgr2=0x559358e3fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ead21640 1 --2- 172.21.15.67:0/3865684845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 0x559358e3fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ead21640 1 -- 172.21.15.67:0/3865684845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559358be7d40 con 0x559358df3780 2024-09-19T05:43:26.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ea520640 1 --2- 172.21.15.67:0/3865684845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 0x559358e3fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:26.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ead21640 1 --2- 172.21.15.67:0/3865684845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358df3b60 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f67e40cfdd0 tx=0x7f67dc004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc30261709a171 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67c7fff640 1 -- 172.21.15.67:0/3865684845 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc009a20 con 0x559358df3780 2024-09-19T05:43:26.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67c7fff640 1 -- 172.21.15.67:0/3865684845 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc01a070 con 0x559358df3780 2024-09-19T05:43:26.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67c7fff640 1 -- 172.21.15.67:0/3865684845 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc009dc0 con 0x559358df3780 2024-09-19T05:43:26.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 -- 172.21.15.67:0/3865684845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 msgr2=0x559358df3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 --2- 172.21.15.67:0/3865684845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358df3b60 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f67e40cfdd0 tx=0x7f67dc004410 comp rx=0 tx=0).stop 2024-09-19T05:43:26.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 -- 172.21.15.67:0/3865684845 shutdown_connections 2024-09-19T05:43:26.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 --2- 172.21.15.67:0/3865684845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358df3b60 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 --2- 172.21.15.67:0/3865684845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e40530 0x559358df3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 --2- 172.21.15.67:0/3865684845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 0x559358e3fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 -- 172.21.15.67:0/3865684845 >> 172.21.15.67:0/3865684845 conn(0x559358e209b0 msgr2=0x559358e22da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 -- 172.21.15.67:0/3865684845 shutdown_connections 2024-09-19T05:43:26.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.209+0000 7f67ef840000 1 -- 172.21.15.67:0/3865684845 wait complete. 2024-09-19T05:43:26.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 -- start start 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 Processor -- start 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358df3780 0x559358e46f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 0x559358e474b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e40530 0x559358df9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559358bde2c0 con 0x559358e40530 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559358c03370 con 0x559358e3fc10 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559358c52f50 con 0x559358df3780 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 10 client.0 _ll_register_callbacks cb 0x559358ca5db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ead21640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e40530 0x559358df9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ead21640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e40530 0x559358df9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45684/0 (socket says 172.21.15.67:45684) 2024-09-19T05:43:26.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ead21640 1 -- 172.21.15.67:0/1167943592 learned_addr learned my addr 172.21.15.67:0/1167943592 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ea520640 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358df3780 0x559358e46f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 0x559358e474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ead21640 1 -- 172.21.15.67:0/1167943592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358df3780 msgr2=0x559358e46f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ead21640 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358df3780 0x559358e46f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ead21640 1 -- 172.21.15.67:0/1167943592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 msgr2=0x559358e474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ead21640 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 0x559358e474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ead21640 1 -- 172.21.15.67:0/1167943592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559358be4770 con 0x559358e40530 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ead21640 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e40530 0x559358df9480 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f67e40d1300 tx=0x7f67dc004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb86b715a4a3fbe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67c57fa640 1 -- 172.21.15.67:0/1167943592 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc015830 con 0x559358e40530 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67c57fa640 1 -- 172.21.15.67:0/1167943592 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f67dc0159d0 con 0x559358e40530 2024-09-19T05:43:26.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 -- 172.21.15.67:0/1167943592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67dc01a070 con 0x559358e40530 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67c57fa640 1 -- 172.21.15.67:0/1167943592 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f67dc031050 con 0x559358e40530 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 10 client.8319 fetch_fsmap learned FSMap version 91 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 -- 172.21.15.67:0/1167943592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x559358c023f0 con 0x559358e40530 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67c57fa640 1 -- 172.21.15.67:0/1167943592 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc01a070 con 0x559358e40530 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67c57fa640 1 -- 172.21.15.67:0/1167943592 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f67dc034020 con 0x559358e40530 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 10 client.8319 fetch_fsmap finished waiting for FSMap version 91 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 10 client.8319 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 20 client.8319 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x559358df9e90 0x559358dfa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 4 client.8319 mds_command: new command op to 8136 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 -- 172.21.15.67:0/1167943592 --> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559358bded90 con 0x559358df9e90 2024-09-19T05:43:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ea520640 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x559358df9e90 0x559358dfa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67c57fa640 10 client.8319 ms_handle_connect on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ea520640 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x559358df9e90 0x559358dfa270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d14ab8023bc5df65 server_cookie=861f43fb44d56cac in_seq=0 out_seq=0 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67c57fa640 1 -- 172.21.15.67:0/1167943592 <== mds.0 v2:172.21.15.67:6834/96000467 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559358bded90 con 0x559358df9e90 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67c57fa640 10 client.8319 handle_command_reply: tid=0 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 client.8319 shutdown 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 -- 172.21.15.67:0/1167943592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e40530 msgr2=0x559358df9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e40530 0x559358df9480 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f67e40d1300 tx=0x7f67dc004a50 comp rx=0 tx=0).stop 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 -- 172.21.15.67:0/1167943592 shutdown_connections 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e40530 0x559358df9480 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e3fc10 0x559358e474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x559358df9e90 0x559358dfa270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.213+0000 7f67ef840000 1 --2- 172.21.15.67:0/1167943592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358df3780 0x559358e46f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.217+0000 7f67ef840000 1 -- 172.21.15.67:0/1167943592 >> 172.21.15.67:0/1167943592 conn(0x559358e209b0 msgr2=0x559358df2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.217+0000 7f67c57fa640 0 client.8319 ms_handle_reset on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.217+0000 7f67ef840000 1 -- 172.21.15.67:0/1167943592 shutdown_connections 2024-09-19T05:43:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.217+0000 7f67ef840000 1 -- 172.21.15.67:0/1167943592 wait complete. 2024-09-19T05:43:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.217+0000 7f67ef840000 20 client.8319 trim_cache size 0 max 16384 2024-09-19T05:43:26.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 Processor -- start 2024-09-19T05:43:26.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 -- start start 2024-09-19T05:43:26.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358df3780 0x559358e56310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e3fc10 0x559358e56850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e40530 0x559358e56d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41fc1d0 con 0x559358e3fc10 2024-09-19T05:43:26.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67e40b6c70 con 0x559358df3780 2024-09-19T05:43:26.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67e41fbb80 con 0x559358e40530 2024-09-19T05:43:26.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67e9d1f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e3fc10 0x559358e56850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67e9d1f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e3fc10 0x559358e56850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45692/0 (socket says 172.21.15.67:45692) 2024-09-19T05:43:26.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67e9d1f640 1 -- 172.21.15.67:0/3447038750 learned_addr learned my addr 172.21.15.67:0/3447038750 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ea520640 1 --2- 172.21.15.67:0/3447038750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358df3780 0x559358e56310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67e9d1f640 1 -- 172.21.15.67:0/3447038750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e40530 msgr2=0x559358e56d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/3447038750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e40530 0x559358e56d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67e9d1f640 1 -- 172.21.15.67:0/3447038750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358df3780 msgr2=0x559358e56310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/3447038750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358df3780 0x559358e56310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67e9d1f640 1 -- 172.21.15.67:0/3447038750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559358cc6320 con 0x559358e3fc10 2024-09-19T05:43:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/3447038750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e3fc10 0x559358e56850 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f67d401c900 tx=0x7f67d4001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc7d1da4828ea97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67c77fe640 1 -- 172.21.15.67:0/3447038750 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d4006d70 con 0x559358e3fc10 2024-09-19T05:43:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67c77fe640 1 -- 172.21.15.67:0/3447038750 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d40c8070 con 0x559358e3fc10 2024-09-19T05:43:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67c77fe640 1 -- 172.21.15.67:0/3447038750 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d40052c0 con 0x559358e3fc10 2024-09-19T05:43:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 -- 172.21.15.67:0/3447038750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e3fc10 msgr2=0x559358e56850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 --2- 172.21.15.67:0/3447038750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e3fc10 0x559358e56850 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f67d401c900 tx=0x7f67d4001130 comp rx=0 tx=0).stop 2024-09-19T05:43:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 -- 172.21.15.67:0/3447038750 shutdown_connections 2024-09-19T05:43:26.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 --2- 172.21.15.67:0/3447038750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e40530 0x559358e56d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 --2- 172.21.15.67:0/3447038750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358e3fc10 0x559358e56850 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 --2- 172.21.15.67:0/3447038750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358df3780 0x559358e56310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 -- 172.21.15.67:0/3447038750 >> 172.21.15.67:0/3447038750 conn(0x559358e209b0 msgr2=0x559358df1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 -- 172.21.15.67:0/3447038750 shutdown_connections 2024-09-19T05:43:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.233+0000 7f67ef840000 1 -- 172.21.15.67:0/3447038750 wait complete. 2024-09-19T05:43:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- start start 2024-09-19T05:43:26.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 Processor -- start 2024-09-19T05:43:26.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358eb2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e3fc10 0x559358e4c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e40530 0x559358e4c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559358bec120 con 0x559358df3780 2024-09-19T05:43:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559358cc5e90 con 0x559358e40530 2024-09-19T05:43:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559358beeb90 con 0x559358e3fc10 2024-09-19T05:43:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 10 client.0 _ll_register_callbacks cb 0x7f67dc003e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ea520640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358eb2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ea520640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358eb2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45706/0 (socket says 172.21.15.67:45706) 2024-09-19T05:43:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ea520640 1 -- 172.21.15.67:0/574821276 learned_addr learned my addr 172.21.15.67:0/574821276 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ea520640 1 -- 172.21.15.67:0/574821276 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e3fc10 msgr2=0x559358e4c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ea520640 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e3fc10 0x559358e4c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ead21640 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e40530 0x559358e4c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ea520640 1 -- 172.21.15.67:0/574821276 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e40530 msgr2=0x559358e4c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ea520640 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e40530 0x559358e4c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ea520640 1 -- 172.21.15.67:0/574821276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559358bd85c0 con 0x559358df3780 2024-09-19T05:43:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ea520640 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358eb2cf0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f67e00587f0 tx=0x7f67e0088040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7316b65563e03383 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67c57fa640 1 -- 172.21.15.67:0/574821276 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0055160 con 0x559358df3780 2024-09-19T05:43:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67c57fa640 1 -- 172.21.15.67:0/574821276 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f67e0080120 con 0x559358df3780 2024-09-19T05:43:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- 172.21.15.67:0/574821276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67d40c8070 con 0x559358df3780 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67c57fa640 1 -- 172.21.15.67:0/574821276 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f67e0055300 con 0x559358df3780 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 10 client.8325 fetch_fsmap learned FSMap version 91 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- 172.21.15.67:0/574821276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x559358bdc330 con 0x559358df3780 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67c57fa640 1 -- 172.21.15.67:0/574821276 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d40c8070 con 0x559358df3780 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67c57fa640 1 -- 172.21.15.67:0/574821276 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f67e0061240 con 0x559358df3780 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 10 client.8325 fetch_fsmap finished waiting for FSMap version 91 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 10 client.8325 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 20 client.8325 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x559358e4cb50 0x559358e4cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 4 client.8325 mds_command: new command op to 8136 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- 172.21.15.67:0/574821276 --> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x559358c523f0 con 0x559358e4cb50 2024-09-19T05:43:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x559358e4cb50 0x559358e4cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67e9d1f640 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x559358e4cb50 0x559358e4cf60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca38ce4d0600692d server_cookie=e2750983d9b6c4ef in_seq=0 out_seq=0 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67c57fa640 10 client.8325 ms_handle_connect on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67c57fa640 1 -- 172.21.15.67:0/574821276 <== mds.0 v2:172.21.15.67:6834/96000467 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559358c523f0 con 0x559358e4cb50 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67c57fa640 10 client.8325 handle_command_reply: tid=0 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 client.8325 shutdown 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- 172.21.15.67:0/574821276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 msgr2=0x559358eb2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358eb2cf0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f67e00587f0 tx=0x7f67e0088040 comp rx=0 tx=0).stop 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- 172.21.15.67:0/574821276 shutdown_connections 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559358e40530 0x559358e4c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x559358e4cb50 0x559358e4cf60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559358e3fc10 0x559358e4c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 --2- 172.21.15.67:0/574821276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559358df3780 0x559358eb2cf0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67c57fa640 0 client.8325 ms_handle_reset on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- 172.21.15.67:0/574821276 >> 172.21.15.67:0/574821276 conn(0x559358e209b0 msgr2=0x559358df2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- 172.21.15.67:0/574821276 shutdown_connections 2024-09-19T05:43:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 1 -- 172.21.15.67:0/574821276 wait complete. 2024-09-19T05:43:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ef840000 20 client.8325 trim_cache size 0 max 16384 2024-09-19T05:43:26.248 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:43:26.248 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:43:26.249 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:43:26.249 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:43:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 -- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67c80678f0 msgr2=0x7f67c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67c80678f0 0x7f67c8069db0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f67d4001750 tx=0x7f67d40011a0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 -- 172.21.15.67:0/2211809002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 msgr2=0x7f67e406de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67e406de90 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f67e0010b40 tx=0x7f67e0005720 comp rx=0 tx=0).stop 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 -- 172.21.15.67:0/2211809002 shutdown_connections 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67e40b0ea0 0x7f67e40af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67c80678f0 0x7f67c8069db0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67e4158e30 0x7f67e406e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 --2- 172.21.15.67:0/2211809002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d0004810 0x7f67e406de90 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 -- 172.21.15.67:0/2211809002 >> 172.21.15.67:0/2211809002 conn(0x7f67e40d22f0 msgr2=0x7f67e406cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 -- 172.21.15.67:0/2211809002 shutdown_connections 2024-09-19T05:43:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.237+0000 7f67ec784640 1 -- 172.21.15.67:0/2211809002 wait complete. 2024-09-19T05:43:26.253 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-19T05:43:26.253 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-19T05:43:26.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.365+0000 7f28f7119640 1 Processor -- start 2024-09-19T05:43:26.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.365+0000 7f28f7119640 1 -- start start 2024-09-19T05:43:26.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28f006ffd0 0x7f28f00aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f28f00b3150 0x7f28f00af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f00ad840 con 0x7f28f0159c60 2024-09-19T05:43:26.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f28f00af710 con 0x7f28f00b3150 2024-09-19T05:43:26.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f28f015d460 con 0x7f28f006ffd0 2024-09-19T05:43:26.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f56b6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f28f00b3150 0x7f28f00af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f56b6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f28f00b3150 0x7f28f00af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45718/0 (socket says 172.21.15.67:45718) 2024-09-19T05:43:26.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f56b6640 1 -- 172.21.15.67:0/450177831 learned_addr learned my addr 172.21.15.67:0/450177831 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28effff640 1 --2- 172.21.15.67:0/450177831 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28f006ffd0 0x7f28f00aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f56b6640 1 -- 172.21.15.67:0/450177831 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28f006ffd0 msgr2=0x7f28f00aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f56b6640 1 --2- 172.21.15.67:0/450177831 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28f006ffd0 0x7f28f00aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f56b6640 1 -- 172.21.15.67:0/450177831 >> v1:172.21.15.97:6789/0 conn(0x7f28f0159c60 legacy=0x7f28f00ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f56b6640 1 -- 172.21.15.67:0/450177831 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f015a040 con 0x7f28f00b3150 2024-09-19T05:43:26.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f56b6640 1 --2- 172.21.15.67:0/450177831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f00b3150 0x7f28f00af1d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009e50 tx=0x7f28e801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80baab2d3b8fd198 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28ef7fe640 1 -- 172.21.15.67:0/450177831 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e80a58d0 con 0x7f28f00b3150 2024-09-19T05:43:26.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28ef7fe640 1 -- 172.21.15.67:0/450177831 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e80a5a70 con 0x7f28f00b3150 2024-09-19T05:43:26.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28ef7fe640 1 -- 172.21.15.67:0/450177831 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e80a5e40 con 0x7f28f00b3150 2024-09-19T05:43:26.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 -- 172.21.15.67:0/450177831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f00b3150 msgr2=0x7f28f00af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 --2- 172.21.15.67:0/450177831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f00b3150 0x7f28f00af1d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009e50 tx=0x7f28e801ca00 comp rx=0 tx=0).stop 2024-09-19T05:43:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 -- 172.21.15.67:0/450177831 shutdown_connections 2024-09-19T05:43:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 --2- 172.21.15.67:0/450177831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f00b3150 0x7f28f00af1d0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 --2- 172.21.15.67:0/450177831 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28f006ffd0 0x7f28f00aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 -- 172.21.15.67:0/450177831 >> 172.21.15.67:0/450177831 conn(0x7f28f00b1e50 msgr2=0x7f28f00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 -- 172.21.15.67:0/450177831 shutdown_connections 2024-09-19T05:43:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.369+0000 7f28f7119640 1 -- 172.21.15.67:0/450177831 wait complete. 2024-09-19T05:43:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f7119640 1 Processor -- start 2024-09-19T05:43:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f7119640 1 -- start start 2024-09-19T05:43:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f7119640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f006ffd0 0x7f28f014e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f7119640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28f00b3150 0x7f28f014b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f7119640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28f0159c60 0x7f28f0149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f7119640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f28f01605b0 con 0x7f28f006ffd0 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f7119640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f28f015d0f0 con 0x7f28f00b3150 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f7119640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f28f0160730 con 0x7f28f0159c60 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f4eb5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f006ffd0 0x7f28f014e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f4eb5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f006ffd0 0x7f28f014e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45730/0 (socket says 172.21.15.67:45730) 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f4eb5640 1 -- 172.21.15.67:0/1034578160 learned_addr learned my addr 172.21.15.67:0/1034578160 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28effff640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28f00b3150 0x7f28f014b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f56b6640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28f0159c60 0x7f28f0149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f4eb5640 1 -- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28f0159c60 msgr2=0x7f28f0149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28f0159c60 0x7f28f0149540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f4eb5640 1 -- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28f00b3150 msgr2=0x7f28f014b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28f00b3150 0x7f28f014b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f4eb5640 1 -- 172.21.15.67:0/1034578160 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f014b870 con 0x7f28f006ffd0 2024-09-19T05:43:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28effff640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28f00b3150 0x7f28f014b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f006ffd0 0x7f28f014e020 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f28e400c3a0 tx=0x7f28e400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28ed7fa640 1 -- 172.21.15.67:0/1034578160 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40052d0 con 0x7f28f006ffd0 2024-09-19T05:43:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28ed7fa640 1 -- 172.21.15.67:0/1034578160 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e4005470 con 0x7f28f006ffd0 2024-09-19T05:43:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f7119640 1 -- 172.21.15.67:0/1034578160 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f014bb50 con 0x7f28f006ffd0 2024-09-19T05:43:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28ed7fa640 1 -- 172.21.15.67:0/1034578160 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4007260 con 0x7f28f006ffd0 2024-09-19T05:43:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28f7119640 1 -- 172.21.15.67:0/1034578160 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f014c110 con 0x7f28f006ffd0 2024-09-19T05:43:26.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28ed7fa640 1 -- 172.21.15.67:0/1034578160 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28e4007400 con 0x7f28f006ffd0 2024-09-19T05:43:26.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.373+0000 7f28ed7fa640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28dc0678c0 0x7f28dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28ed7fa640 1 -- 172.21.15.67:0/1034578160 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f28e40852a0 con 0x7f28f006ffd0 2024-09-19T05:43:26.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28effff640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28dc0678c0 0x7f28dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 Processor -- start 2024-09-19T05:43:26.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 -- start start 2024-09-19T05:43:26.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28effff640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28dc0678c0 0x7f28dc069d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f28f015f460 tx=0x7f28e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd5d70 0x5631f9fd6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd6690 0x5631f9f89870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9f8a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5631f9e73960 con 0x5631f9f89db0 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5631f9db7900 con 0x5631f9fd6690 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5631f9ddad40 con 0x5631f9fd5d70 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28f56b6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9f8a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28f56b6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9f8a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45746/0 (socket says 172.21.15.67:45746) 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28f56b6640 1 -- 172.21.15.67:0/3819077794 learned_addr learned my addr 172.21.15.67:0/3819077794 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28effff640 1 --2- 172.21.15.67:0/3819077794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd6690 0x5631f9f89870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/3819077794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd5d70 0x5631f9fd6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28f56b6640 1 -- 172.21.15.67:0/3819077794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd5d70 msgr2=0x5631f9fd6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28f56b6640 1 --2- 172.21.15.67:0/3819077794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd5d70 0x5631f9fd6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28f56b6640 1 -- 172.21.15.67:0/3819077794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd6690 msgr2=0x5631f9f89870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28f56b6640 1 --2- 172.21.15.67:0/3819077794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd6690 0x5631f9f89870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28f56b6640 1 -- 172.21.15.67:0/3819077794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f9d81580 con 0x5631f9f89db0 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28f56b6640 1 --2- 172.21.15.67:0/3819077794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9f8a190 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f28e80af040 tx=0x7f28e8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce00d1a077851db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28d67fc640 1 -- 172.21.15.67:0/3819077794 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e80a58d0 con 0x5631f9f89db0 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28d67fc640 1 -- 172.21.15.67:0/3819077794 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e80a5a70 con 0x5631f9f89db0 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28d67fc640 1 -- 172.21.15.67:0/3819077794 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e80b9670 con 0x5631f9f89db0 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3819077794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 msgr2=0x5631f9f8a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3819077794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9f8a190 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f28e80af040 tx=0x7f28e8004ac0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3819077794 shutdown_connections 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3819077794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9f8a190 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3819077794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd6690 0x5631f9f89870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3819077794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd5d70 0x5631f9fd6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3819077794 >> 172.21.15.67:0/3819077794 conn(0x5631f9fb7040 msgr2=0x5631f9fb9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3819077794 shutdown_connections 2024-09-19T05:43:26.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3819077794 wait complete. 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 -- start start 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.377+0000 7f28fa1d5000 1 Processor -- start 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9fdcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd5d70 0x5631f9fdd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd6690 0x5631f9fdd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5631f9dd6d00 con 0x5631f9f89db0 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5631f9d95aa0 con 0x5631f9fd6690 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5631f9d74340 con 0x5631f9fd5d70 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 10 client.0 _ll_register_callbacks cb 0x5631f9f77760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28f4eb5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9fdcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28f4eb5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9fdcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45756/0 (socket says 172.21.15.67:45756) 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28f4eb5640 1 -- 172.21.15.67:0/3723799966 learned_addr learned my addr 172.21.15.67:0/3723799966 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28effff640 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd5d70 0x5631f9fdd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28f56b6640 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd6690 0x5631f9fdd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28f4eb5640 1 -- 172.21.15.67:0/3723799966 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd5d70 msgr2=0x5631f9fdd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd5d70 0x5631f9fdd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28f4eb5640 1 -- 172.21.15.67:0/3723799966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd6690 msgr2=0x5631f9fdd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd6690 0x5631f9fdd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28f4eb5640 1 -- 172.21.15.67:0/3723799966 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631f9d7ddc0 con 0x5631f9f89db0 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9fdcce0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f28e400cd60 tx=0x7f28e4055d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936870fd8e04c486 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3723799966 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e405e120 con 0x5631f9f89db0 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3723799966 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f28e4054990 con 0x5631f9f89db0 2024-09-19T05:43:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3723799966 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e80a5a70 con 0x5631f9f89db0 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3723799966 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f28e4054bb0 con 0x5631f9f89db0 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 10 client.8337 fetch_fsmap learned FSMap version 91 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3723799966 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x5631f9d7a7f0 con 0x5631f9f89db0 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3723799966 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e80a5a70 con 0x5631f9f89db0 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3723799966 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f28e4051290 con 0x5631f9f89db0 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 10 client.8337 fetch_fsmap finished waiting for FSMap version 91 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 10 client.8337 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 20 client.8337 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5631f9fe50b0 0x5631f9fe74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 4 client.8337 mds_command: new command op to 8136 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3723799966 --> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631f9d74e10 con 0x5631f9fe50b0 2024-09-19T05:43:26.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28effff640 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5631f9fe50b0 0x5631f9fe74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28cf7fe640 10 client.8337 ms_handle_connect on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28effff640 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5631f9fe50b0 0x5631f9fe74a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b2e9c9c559f10ed server_cookie=b3a8dd64581d3207 in_seq=0 out_seq=0 2024-09-19T05:43:26.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3723799966 <== mds.0 v2:172.21.15.67:6834/96000467 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631f9d74e10 con 0x5631f9fe50b0 2024-09-19T05:43:26.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28cf7fe640 10 client.8337 handle_command_reply: tid=0 2024-09-19T05:43:26.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 client.8337 shutdown 2024-09-19T05:43:26.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3723799966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 msgr2=0x5631f9fdcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9fdcce0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f28e400cd60 tx=0x7f28e4055d80 comp rx=0 tx=0).stop 2024-09-19T05:43:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3723799966 shutdown_connections 2024-09-19T05:43:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd6690 0x5631f9fdd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5631f9fe50b0 0x5631f9fe74a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd5d70 0x5631f9fdd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3723799966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9f89db0 0x5631f9fdcce0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28cf7fe640 0 client.8337 ms_handle_reset on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3723799966 >> 172.21.15.67:0/3723799966 conn(0x5631f9fb7040 msgr2=0x5631f9f88f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3723799966 shutdown_connections 2024-09-19T05:43:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3723799966 wait complete. 2024-09-19T05:43:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.381+0000 7f28fa1d5000 20 client.8337 trim_cache size 0 max 16384 2024-09-19T05:43:26.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28fa1d5000 1 Processor -- start 2024-09-19T05:43:26.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28fa1d5000 1 -- start start 2024-09-19T05:43:26.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9f89db0 0x5631f9f91c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd5d70 0x5631f9f92140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd6690 0x5631f9fdfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0201b50 con 0x5631f9fd6690 2024-09-19T05:43:26.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0200c20 con 0x5631f9fd5d70 2024-09-19T05:43:26.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f28f00b0f70 con 0x5631f9f89db0 2024-09-19T05:43:26.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28f56b6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd6690 0x5631f9fdfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28f56b6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd6690 0x5631f9fdfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45762/0 (socket says 172.21.15.67:45762) 2024-09-19T05:43:26.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28f56b6640 1 -- 172.21.15.67:0/3790746615 learned_addr learned my addr 172.21.15.67:0/3790746615 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/3790746615 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9f89db0 0x5631f9f91c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28effff640 1 --2- 172.21.15.67:0/3790746615 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd5d70 0x5631f9f92140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28f56b6640 1 -- 172.21.15.67:0/3790746615 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9f89db0 msgr2=0x5631f9f91c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28f56b6640 1 --2- 172.21.15.67:0/3790746615 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9f89db0 0x5631f9f91c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28f56b6640 1 -- 172.21.15.67:0/3790746615 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd5d70 msgr2=0x5631f9f92140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28f56b6640 1 --2- 172.21.15.67:0/3790746615 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd5d70 0x5631f9f92140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28f56b6640 1 -- 172.21.15.67:0/3790746615 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f9d98470 con 0x5631f9fd6690 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28f56b6640 1 --2- 172.21.15.67:0/3790746615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd6690 0x5631f9fdfd00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f28e801c470 tx=0x7f28e80a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a137e1c832b6623 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28d5ffb640 1 -- 172.21.15.67:0/3790746615 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e80a58d0 con 0x5631f9fd6690 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28d5ffb640 1 -- 172.21.15.67:0/3790746615 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e80c9070 con 0x5631f9fd6690 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.401+0000 7f28d5ffb640 1 -- 172.21.15.67:0/3790746615 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8003be0 con 0x5631f9fd6690 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3790746615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd6690 msgr2=0x5631f9fdfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3790746615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd6690 0x5631f9fdfd00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f28e801c470 tx=0x7f28e80a7000 comp rx=0 tx=0).stop 2024-09-19T05:43:26.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3790746615 shutdown_connections 2024-09-19T05:43:26.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3790746615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd6690 0x5631f9fdfd00 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3790746615 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9fd5d70 0x5631f9f92140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3790746615 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9f89db0 0x5631f9f91c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3790746615 >> 172.21.15.67:0/3790746615 conn(0x5631f9fb7040 msgr2=0x5631f9fdcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3790746615 shutdown_connections 2024-09-19T05:43:26.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3790746615 wait complete. 2024-09-19T05:43:26.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- start start 2024-09-19T05:43:26.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 Processor -- start 2024-09-19T05:43:26.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9f89db0 0x5631f9fe2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd5d70 0x5631fa009ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd6690 0x5631fa00a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5631f9dda050 con 0x5631f9fd5d70 2024-09-19T05:43:26.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f28f02006f0 con 0x5631f9f89db0 2024-09-19T05:43:26.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5631f9de8fd0 con 0x5631f9fd6690 2024-09-19T05:43:26.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 10 client.0 _ll_register_callbacks cb 0x7f28e40517e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:26.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28effff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd5d70 0x5631fa009ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28effff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd5d70 0x5631fa009ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45764/0 (socket says 172.21.15.67:45764) 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28effff640 1 -- 172.21.15.67:0/3027683475 learned_addr learned my addr 172.21.15.67:0/3027683475 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9f89db0 0x5631f9fe2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28f56b6640 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd6690 0x5631fa00a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28effff640 1 -- 172.21.15.67:0/3027683475 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd6690 msgr2=0x5631fa00a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28effff640 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd6690 0x5631fa00a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28effff640 1 -- 172.21.15.67:0/3027683475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9f89db0 msgr2=0x5631f9fe2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28effff640 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9f89db0 0x5631f9fe2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28effff640 1 -- 172.21.15.67:0/3027683475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631f9d6e640 con 0x5631f9fd5d70 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9f89db0 0x5631f9fe2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28effff640 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd5d70 0x5631fa009ba0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f28f014f6b0 tx=0x7f28e00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fbb1d65cc59676 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3027683475 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e000f040 con 0x5631f9fd5d70 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3027683475 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f28e0020040 con 0x5631f9fd5d70 2024-09-19T05:43:26.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3027683475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e80c9070 con 0x5631f9fd5d70 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3027683475 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f28e00039b0 con 0x5631f9fd5d70 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 10 client.8343 fetch_fsmap learned FSMap version 91 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3027683475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x5631f9d723b0 con 0x5631f9fd5d70 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3027683475 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e80c9070 con 0x5631f9fd5d70 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3027683475 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f28e0036050 con 0x5631f9fd5d70 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 10 client.8343 fetch_fsmap finished waiting for FSMap version 91 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 10 client.8343 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 20 client.8343 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5631fa00a620 0x5631fa04e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 4 client.8343 mds_command: new command op to 8136 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3027683475 --> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5631f9de8470 con 0x5631fa00a620 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5631fa00a620 0x5631fa04e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28cf7fe640 10 client.8343 ms_handle_connect on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28f4eb5640 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5631fa00a620 0x5631fa04e260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=368d50f915498e3b server_cookie=7c59d7a86b555801 in_seq=0 out_seq=0 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28cf7fe640 1 -- 172.21.15.67:0/3027683475 <== mds.0 v2:172.21.15.67:6834/96000467 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x5631f9de8470 con 0x5631fa00a620 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28cf7fe640 10 client.8343 handle_command_reply: tid=0 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.405+0000 7f28fa1d5000 1 client.8343 shutdown 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3027683475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd5d70 msgr2=0x5631fa009ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd5d70 0x5631fa009ba0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f28f014f6b0 tx=0x7f28e00046d0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3027683475 shutdown_connections 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5631fa00a620 0x5631fa04e260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5631f9fd6690 0x5631fa00a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5631f9fd5d70 0x5631fa009ba0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 1 --2- 172.21.15.67:0/3027683475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f9f89db0 0x5631f9fe2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28cf7fe640 0 client.8343 ms_handle_reset on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3027683475 >> 172.21.15.67:0/3027683475 conn(0x5631f9fb7040 msgr2=0x5631f9fdd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3027683475 shutdown_connections 2024-09-19T05:43:26.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 1 -- 172.21.15.67:0/3027683475 wait complete. 2024-09-19T05:43:26.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28fa1d5000 20 client.8343 trim_cache size 0 max 16384 2024-09-19T05:43:26.414 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:43:26.414 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T05:43:26.414 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-19T05:43:26.414 INFO:teuthology.orchestra.run.smithi067.stdout: "0a63a65c-5490-4479-b03c-67fcefdff48d": { 2024-09-19T05:43:26.414 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_control_test_path", 2024-09-19T05:43:26.414 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "0a63a65c-5490-4479-b03c-67fcefdff48d", 2024-09-19T05:43:26.414 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive" 2024-09-19T05:43:26.414 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:26.415 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:26.415 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:43:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 -- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28dc0678c0 msgr2=0x7f28dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28dc0678c0 0x7f28dc069d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f28f015f460 tx=0x7f28e0008040 comp rx=0 tx=0).stop 2024-09-19T05:43:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 -- 172.21.15.67:0/1034578160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f006ffd0 msgr2=0x7f28f014e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f006ffd0 0x7f28f014e020 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f28e400c3a0 tx=0x7f28e400c860 comp rx=0 tx=0).stop 2024-09-19T05:43:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 -- 172.21.15.67:0/1034578160 shutdown_connections 2024-09-19T05:43:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f28dc0678c0 0x7f28dc069d80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28f0159c60 0x7f28f0149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28f00b3150 0x7f28f014b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 --2- 172.21.15.67:0/1034578160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28f006ffd0 0x7f28f014e020 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 -- 172.21.15.67:0/1034578160 >> 172.21.15.67:0/1034578160 conn(0x7f28f00b1e50 msgr2=0x7f28f014fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:26.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 -- 172.21.15.67:0/1034578160 shutdown_connections 2024-09-19T05:43:26.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:26.409+0000 7f28f7119640 1 -- 172.21.15.67:0/1034578160 wait complete. 2024-09-19T05:43:31.423 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-19T05:43:31.423 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-19T05:43:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.561+0000 7f357588b640 1 Processor -- start 2024-09-19T05:43:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.561+0000 7f357588b640 1 -- start start 2024-09-19T05:43:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f357588b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3570072670 0x7f35701692d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f357588b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f357006e540 con 0x7f35700cf9c0 2024-09-19T05:43:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f357588b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f357006e820 con 0x7f357006dfc0 2024-09-19T05:43:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f357588b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f357006eb00 con 0x7f3570072670 2024-09-19T05:43:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356effd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f35700cf9c0 0x7f357015f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37650/0 (socket says 172.21.15.67:37650) 2024-09-19T05:43:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356effd640 1 -- 172.21.15.67:0/45145014 learned_addr learned my addr 172.21.15.67:0/45145014 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356f7fe640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3570072670 0x7f35701692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184801824 0 0) 0x7f357006e540 con 0x7f35700cf9c0 2024-09-19T05:43:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3558003530 con 0x7f35700cf9c0 2024-09-19T05:43:31.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1880268533 0 0) 0x7f3558003530 con 0x7f35700cf9c0 2024-09-19T05:43:31.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3570072670 msgr2=0x7f35701692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3570072670 0x7f35701692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 >> v1:172.21.15.97:6789/0 conn(0x7f357006dfc0 legacy=0x7f3570071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357006ede0 con 0x7f35700cf9c0 2024-09-19T05:43:31.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3560001a00 con 0x7f35700cf9c0 2024-09-19T05:43:31.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 >> v1:172.21.15.67:6789/0 conn(0x7f35700cf9c0 legacy=0x7f357015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35580039f0 0x7f3558003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3570072670 0x7f3558004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3558004d50 0x7f35580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f357006eb00 con 0x7f3558004d50 2024-09-19T05:43:31.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f355800b9d0 con 0x7f35580039f0 2024-09-19T05:43:31.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f355800bbd0 con 0x7f3570072670 2024-09-19T05:43:31.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356f7fe640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3558004d50 0x7f35580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356effd640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35580039f0 0x7f3558003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356e7fc640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3570072670 0x7f3558004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356f7fe640 1 -- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3570072670 msgr2=0x7f3558004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356f7fe640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3570072670 0x7f3558004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356f7fe640 1 -- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35580039f0 msgr2=0x7f3558003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356f7fe640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35580039f0 0x7f3558003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.565+0000 7f356f7fe640 1 -- 172.21.15.67:0/45145014 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3558003530 con 0x7f3558004d50 2024-09-19T05:43:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356f7fe640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3558004d50 0x7f35580051d0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3568009ae0 tx=0x7f356801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf0dd30f4d0b389 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35680b2070 con 0x7f3558004d50 2024-09-19T05:43:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35680a5550 con 0x7f3558004d50 2024-09-19T05:43:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356dffb640 1 -- 172.21.15.67:0/45145014 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35680096b0 con 0x7f3558004d50 2024-09-19T05:43:31.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 -- 172.21.15.67:0/45145014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3558004d50 msgr2=0x7f35580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 --2- 172.21.15.67:0/45145014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3558004d50 0x7f35580051d0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3568009ae0 tx=0x7f356801ca70 comp rx=0 tx=0).stop 2024-09-19T05:43:31.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356f7fe640 1 -- 172.21.15.67:0/45145014 reap_dead start 2024-09-19T05:43:31.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 -- 172.21.15.67:0/45145014 shutdown_connections 2024-09-19T05:43:31.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 -- 172.21.15.67:0/45145014 >> 172.21.15.67:0/45145014 conn(0x7f35700b1e50 msgr2=0x7f35700b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 -- 172.21.15.67:0/45145014 shutdown_connections 2024-09-19T05:43:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 -- 172.21.15.67:0/45145014 wait complete. 2024-09-19T05:43:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 Processor -- start 2024-09-19T05:43:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 -- start start 2024-09-19T05:43:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35701527b0 0x7f357009cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f357009d000 0x7f3570160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35701605c0 0x7f3570152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f35700cff20 con 0x7f357009d000 2024-09-19T05:43:31.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f35700cfda0 con 0x7f35701605c0 2024-09-19T05:43:31.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f357588b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f35700b4260 con 0x7f35701527b0 2024-09-19T05:43:31.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f357009d000 0x7f3570160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f357009d000 0x7f3570160080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45780/0 (socket says 172.21.15.67:45780) 2024-09-19T05:43:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356e7fc640 1 -- 172.21.15.67:0/200497594 learned_addr learned my addr 172.21.15.67:0/200497594 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356effd640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35701527b0 0x7f357009cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356f7fe640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35701605c0 0x7f3570152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356e7fc640 1 -- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35701527b0 msgr2=0x7f357009cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356e7fc640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35701527b0 0x7f357009cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356e7fc640 1 -- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35701605c0 msgr2=0x7f3570152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356e7fc640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35701605c0 0x7f3570152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.569+0000 7f356e7fc640 1 -- 172.21.15.67:0/200497594 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35701546c0 con 0x7f357009d000 2024-09-19T05:43:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f356e7fc640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f357009d000 0x7f3570160080 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f356400e5d0 tx=0x7f356400ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f3557fff640 1 -- 172.21.15.67:0/200497594 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35640053a0 con 0x7f357009d000 2024-09-19T05:43:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f3557fff640 1 -- 172.21.15.67:0/200497594 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3564018070 con 0x7f357009d000 2024-09-19T05:43:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f357588b640 1 -- 172.21.15.67:0/200497594 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357009d610 con 0x7f357009d000 2024-09-19T05:43:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f3557fff640 1 -- 172.21.15.67:0/200497594 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564003840 con 0x7f357009d000 2024-09-19T05:43:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f357588b640 1 -- 172.21.15.67:0/200497594 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f357009dbd0 con 0x7f357009d000 2024-09-19T05:43:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f3557fff640 1 -- 172.21.15.67:0/200497594 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35640039e0 con 0x7f357009d000 2024-09-19T05:43:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f3557fff640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f355c0678f0 0x7f355c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f3557fff640 1 -- 172.21.15.67:0/200497594 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f3564085840 con 0x7f357009d000 2024-09-19T05:43:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f356effd640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f355c0678f0 0x7f355c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f3578947000 1 Processor -- start 2024-09-19T05:43:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f3578947000 1 -- start start 2024-09-19T05:43:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.573+0000 7f356effd640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f355c0678f0 0x7f355c069db0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f35701f7480 tx=0x7f3560009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5bee690 0x5570b5ba1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5ba1db0 0x5570b5ba2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5570b5a8b960 con 0x5570b5bedd70 2024-09-19T05:43:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5570b59cf900 con 0x5570b5bee690 2024-09-19T05:43:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5570b59f2d40 con 0x5570b5ba1db0 2024-09-19T05:43:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bee150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45784/0 (socket says 172.21.15.67:45784) 2024-09-19T05:43:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356effd640 1 -- 172.21.15.67:0/256632608 learned_addr learned my addr 172.21.15.67:0/256632608 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356e7fc640 1 --2- 172.21.15.67:0/256632608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5bee690 0x5570b5ba1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356f7fe640 1 --2- 172.21.15.67:0/256632608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5ba1db0 0x5570b5ba2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356effd640 1 -- 172.21.15.67:0/256632608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5ba1db0 msgr2=0x5570b5ba2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356effd640 1 --2- 172.21.15.67:0/256632608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5ba1db0 0x5570b5ba2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356effd640 1 -- 172.21.15.67:0/256632608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5bee690 msgr2=0x5570b5ba1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356effd640 1 --2- 172.21.15.67:0/256632608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5bee690 0x5570b5ba1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356effd640 1 -- 172.21.15.67:0/256632608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b5999580 con 0x5570b5bedd70 2024-09-19T05:43:31.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356effd640 1 --2- 172.21.15.67:0/256632608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bee150 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f3560013c50 tx=0x7f3560016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6e9981fc88b200 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:31.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f35557fa640 1 -- 172.21.15.67:0/256632608 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560029070 con 0x5570b5bedd70 2024-09-19T05:43:31.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f35557fa640 1 -- 172.21.15.67:0/256632608 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3560013e80 con 0x5570b5bedd70 2024-09-19T05:43:31.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f35557fa640 1 -- 172.21.15.67:0/256632608 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560010040 con 0x5570b5bedd70 2024-09-19T05:43:31.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- 172.21.15.67:0/256632608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 msgr2=0x5570b5bee150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 --2- 172.21.15.67:0/256632608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bee150 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f3560013c50 tx=0x7f3560016000 comp rx=0 tx=0).stop 2024-09-19T05:43:31.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- 172.21.15.67:0/256632608 shutdown_connections 2024-09-19T05:43:31.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 --2- 172.21.15.67:0/256632608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5ba1db0 0x5570b5ba2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 --2- 172.21.15.67:0/256632608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5bee690 0x5570b5ba1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 --2- 172.21.15.67:0/256632608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bee150 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- 172.21.15.67:0/256632608 >> 172.21.15.67:0/256632608 conn(0x5570b5bcf040 msgr2=0x5570b5bd1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:31.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- 172.21.15.67:0/256632608 shutdown_connections 2024-09-19T05:43:31.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- 172.21.15.67:0/256632608 wait complete. 2024-09-19T05:43:31.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- start start 2024-09-19T05:43:31.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 Processor -- start 2024-09-19T05:43:31.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5ba1db0 0x5570b5bf4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bf5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5bf5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5570b59eed00 con 0x5570b5bedd70 2024-09-19T05:43:31.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5570b59adaa0 con 0x5570b5ba1db0 2024-09-19T05:43:31.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5570b598c340 con 0x5570b5bee690 2024-09-19T05:43:31.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f3578947000 10 client.0 _ll_register_callbacks cb 0x5570b5b8f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:31.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bf5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bf5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45800/0 (socket says 172.21.15.67:45800) 2024-09-19T05:43:31.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356e7fc640 1 -- 172.21.15.67:0/4123082127 learned_addr learned my addr 172.21.15.67:0/4123082127 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:31.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356effd640 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5ba1db0 0x5570b5bf4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.577+0000 7f356f7fe640 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5bf5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f356e7fc640 1 -- 172.21.15.67:0/4123082127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 msgr2=0x5570b5bf5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f356e7fc640 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5bf5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f356e7fc640 1 -- 172.21.15.67:0/4123082127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5ba1db0 msgr2=0x5570b5bf4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f356e7fc640 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5ba1db0 0x5570b5bf4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f356e7fc640 1 -- 172.21.15.67:0/4123082127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b5995dc0 con 0x5570b5bedd70 2024-09-19T05:43:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f356effd640 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5ba1db0 0x5570b5bf4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f356e7fc640 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bf5220 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f356400e5a0 tx=0x7f3564056340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1756488ee6127fed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f354e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f354e7fc640 1 -- 172.21.15.67:0/4123082127 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356405e760 con 0x5570b5bedd70 2024-09-19T05:43:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f354e7fc640 1 -- 172.21.15.67:0/4123082127 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f3564053e80 con 0x5570b5bedd70 2024-09-19T05:43:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 -- 172.21.15.67:0/4123082127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570b598ce10 con 0x5570b5bedd70 2024-09-19T05:43:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f354e7fc640 1 -- 172.21.15.67:0/4123082127 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f3564072050 con 0x5570b5bedd70 2024-09-19T05:43:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 10 client.8355 fetch_fsmap learned FSMap version 91 2024-09-19T05:43:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 -- 172.21.15.67:0/4123082127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x5570b59927f0 con 0x5570b5bedd70 2024-09-19T05:43:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f354e7fc640 1 -- 172.21.15.67:0/4123082127 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5570b598ce10 con 0x5570b5bedd70 2024-09-19T05:43:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f354e7fc640 1 -- 172.21.15.67:0/4123082127 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f3564003cd0 con 0x5570b5bedd70 2024-09-19T05:43:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 10 client.8355 fetch_fsmap finished waiting for FSMap version 91 2024-09-19T05:43:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 10 client.8355 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-19T05:43:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 20 client.8355 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5570b5bfd0b0 0x5570b5bff4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 4 client.8355 mds_command: new command op to 8136 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:43:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 -- 172.21.15.67:0/4123082127 --> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570b5a00470 con 0x5570b5bfd0b0 2024-09-19T05:43:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f356effd640 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5570b5bfd0b0 0x5570b5bff4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f354e7fc640 10 client.8355 ms_handle_connect on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f356effd640 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5570b5bfd0b0 0x5570b5bff4a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a28ea3967af400f0 server_cookie=54c5c911b711b2c2 in_seq=0 out_seq=0 2024-09-19T05:43:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f354e7fc640 1 -- 172.21.15.67:0/4123082127 <== mds.0 v2:172.21.15.67:6834/96000467 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570b5a00470 con 0x5570b5bfd0b0 2024-09-19T05:43:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f354e7fc640 10 client.8355 handle_command_reply: tid=0 2024-09-19T05:43:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 client.8355 shutdown 2024-09-19T05:43:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 -- 172.21.15.67:0/4123082127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 msgr2=0x5570b5bf5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bf5220 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f356400e5a0 tx=0x7f3564056340 comp rx=0 tx=0).stop 2024-09-19T05:43:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 -- 172.21.15.67:0/4123082127 shutdown_connections 2024-09-19T05:43:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5570b5bfd0b0 0x5570b5bff4a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5bf5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5bf5220 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f354e7fc640 0 client.8355 ms_handle_reset on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:31.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 --2- 172.21.15.67:0/4123082127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5ba1db0 0x5570b5bf4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 -- 172.21.15.67:0/4123082127 >> 172.21.15.67:0/4123082127 conn(0x5570b5bcf040 msgr2=0x5570b5ba0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:31.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 -- 172.21.15.67:0/4123082127 shutdown_connections 2024-09-19T05:43:31.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 1 -- 172.21.15.67:0/4123082127 wait complete. 2024-09-19T05:43:31.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.581+0000 7f3578947000 20 client.8355 trim_cache size 0 max 16384 2024-09-19T05:43:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 Processor -- start 2024-09-19T05:43:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 -- start start 2024-09-19T05:43:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5ba1db0 0x5570b5ba9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5baa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5bf7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3570201ab0 con 0x5570b5bedd70 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3570200b20 con 0x5570b5ba1db0 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3570155e70 con 0x5570b5bee690 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f356e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5baa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f356e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5baa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45802/0 (socket says 172.21.15.67:45802) 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f356e7fc640 1 -- 172.21.15.67:0/3691912347 learned_addr learned my addr 172.21.15.67:0/3691912347 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f356e7fc640 1 -- 172.21.15.67:0/3691912347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 msgr2=0x5570b5bf7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f356e7fc640 1 --2- 172.21.15.67:0/3691912347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5bf7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f356e7fc640 1 -- 172.21.15.67:0/3691912347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5ba1db0 msgr2=0x5570b5ba9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f356e7fc640 1 --2- 172.21.15.67:0/3691912347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5ba1db0 0x5570b5ba9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f356e7fc640 1 -- 172.21.15.67:0/3691912347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b59b0470 con 0x5570b5bedd70 2024-09-19T05:43:31.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f356e7fc640 1 --2- 172.21.15.67:0/3691912347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5baa140 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f3564051ed0 tx=0x7f356406b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fac02e72d36b627 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:31.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3554ff9640 1 -- 172.21.15.67:0/3691912347 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356405e760 con 0x5570b5bedd70 2024-09-19T05:43:31.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3554ff9640 1 -- 172.21.15.67:0/3691912347 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3564003cd0 con 0x5570b5bedd70 2024-09-19T05:43:31.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3554ff9640 1 -- 172.21.15.67:0/3691912347 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35640554e0 con 0x5570b5bedd70 2024-09-19T05:43:31.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 -- 172.21.15.67:0/3691912347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 msgr2=0x5570b5baa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 --2- 172.21.15.67:0/3691912347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5baa140 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f3564051ed0 tx=0x7f356406b000 comp rx=0 tx=0).stop 2024-09-19T05:43:31.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 -- 172.21.15.67:0/3691912347 shutdown_connections 2024-09-19T05:43:31.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 --2- 172.21.15.67:0/3691912347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5bf7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 --2- 172.21.15.67:0/3691912347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5bedd70 0x5570b5baa140 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 --2- 172.21.15.67:0/3691912347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5ba1db0 0x5570b5ba9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 -- 172.21.15.67:0/3691912347 >> 172.21.15.67:0/3691912347 conn(0x5570b5bcf040 msgr2=0x5570b5bf4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 -- 172.21.15.67:0/3691912347 shutdown_connections 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 -- 172.21.15.67:0/3691912347 wait complete. 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 -- start start 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.601+0000 7f3578947000 1 Processor -- start 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5ba1db0 0x5570b5bfab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5bedd70 0x5570b5c61a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5c61fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5570b598c480 con 0x5570b5ba1db0 2024-09-19T05:43:31.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5570b59ba400 con 0x5570b5bedd70 2024-09-19T05:43:31.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5570b59b13f0 con 0x5570b5bee690 2024-09-19T05:43:31.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 10 client.0 _ll_register_callbacks cb 0x7f35640012e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:31.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5ba1db0 0x5570b5bfab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5ba1db0 0x5570b5bfab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45818/0 (socket says 172.21.15.67:45818) 2024-09-19T05:43:31.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356effd640 1 -- 172.21.15.67:0/2489143519 learned_addr learned my addr 172.21.15.67:0/2489143519 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:31.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356e7fc640 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5bedd70 0x5570b5c61a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356f7fe640 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5c61fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356effd640 1 -- 172.21.15.67:0/2489143519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 msgr2=0x5570b5c61fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356effd640 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5c61fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356effd640 1 -- 172.21.15.67:0/2489143519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5bedd70 msgr2=0x5570b5c61a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356effd640 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5bedd70 0x5570b5c61a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356effd640 1 -- 172.21.15.67:0/2489143519 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b5986640 con 0x5570b5ba1db0 2024-09-19T05:43:31.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356f7fe640 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5c61fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:31.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356effd640 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5ba1db0 0x5570b5bfab90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f3560004ba0 tx=0x7f357006e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd5f793498cd900 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:31.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f354e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:31.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f354e7fc640 1 -- 172.21.15.67:0/2489143519 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560029040 con 0x5570b5ba1db0 2024-09-19T05:43:31.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f354e7fc640 1 -- 172.21.15.67:0/2489143519 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f356003cc70 con 0x5570b5ba1db0 2024-09-19T05:43:31.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- 172.21.15.67:0/2489143519 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3564003cd0 con 0x5570b5ba1db0 2024-09-19T05:43:31.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f354e7fc640 1 -- 172.21.15.67:0/2489143519 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f3560043050 con 0x5570b5ba1db0 2024-09-19T05:43:31.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 10 client.8361 fetch_fsmap learned FSMap version 91 2024-09-19T05:43:31.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- 172.21.15.67:0/2489143519 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x5570b598a3b0 con 0x5570b5ba1db0 2024-09-19T05:43:31.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f354e7fc640 1 -- 172.21.15.67:0/2489143519 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3564003cd0 con 0x5570b5ba1db0 2024-09-19T05:43:31.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f354e7fc640 1 -- 172.21.15.67:0/2489143519 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f3560046020 con 0x5570b5ba1db0 2024-09-19T05:43:31.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 10 client.8361 fetch_fsmap finished waiting for FSMap version 91 2024-09-19T05:43:31.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 10 client.8361 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-19T05:43:31.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 20 client.8361 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:31.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5570b5c624e0 0x5570b5c5e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 4 client.8361 mds_command: new command op to 8136 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:43:31.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- 172.21.15.67:0/2489143519 --> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5570b59fa7c0 con 0x5570b5c624e0 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356e7fc640 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5570b5c624e0 0x5570b5c5e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f356e7fc640 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5570b5c624e0 0x5570b5c5e450 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97f82535e8c7cb09 server_cookie=292b68399ce23aa6 in_seq=0 out_seq=0 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f354e7fc640 10 client.8361 ms_handle_connect on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f354e7fc640 1 -- 172.21.15.67:0/2489143519 <== mds.0 v2:172.21.15.67:6834/96000467 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5570b59fa7c0 con 0x5570b5c624e0 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f354e7fc640 10 client.8361 handle_command_reply: tid=0 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 client.8361 shutdown 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- 172.21.15.67:0/2489143519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5ba1db0 msgr2=0x5570b5bfab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5ba1db0 0x5570b5bfab90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f3560004ba0 tx=0x7f357006e430 comp rx=0 tx=0).stop 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- 172.21.15.67:0/2489143519 shutdown_connections 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.67:6834/96000467,v1:172.21.15.67:6835/96000467] conn(0x5570b5c624e0 0x5570b5c5e450 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5570b5bee690 0x5570b5c61fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5570b5bedd70 0x5570b5c61a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 --2- 172.21.15.67:0/2489143519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5570b5ba1db0 0x5570b5bfab90 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f354e7fc640 0 client.8361 ms_handle_reset on v2:172.21.15.67:6834/96000467 2024-09-19T05:43:31.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- 172.21.15.67:0/2489143519 >> 172.21.15.67:0/2489143519 conn(0x5570b5bcf040 msgr2=0x5570b5bf52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:31.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- 172.21.15.67:0/2489143519 shutdown_connections 2024-09-19T05:43:31.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 1 -- 172.21.15.67:0/2489143519 wait complete. 2024-09-19T05:43:31.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f3578947000 20 client.8361 trim_cache size 0 max 16384 2024-09-19T05:43:31.626 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:43:31.627 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-19T05:43:31.627 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {} 2024-09-19T05:43:31.627 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:43:31.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 -- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f355c0678f0 msgr2=0x7f355c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f355c0678f0 0x7f355c069db0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f35701f7480 tx=0x7f3560009040 comp rx=0 tx=0).stop 2024-09-19T05:43:31.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 -- 172.21.15.67:0/200497594 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f357009d000 msgr2=0x7f3570160080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f357009d000 0x7f3570160080 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f356400e5d0 tx=0x7f356400ea90 comp rx=0 tx=0).stop 2024-09-19T05:43:31.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 -- 172.21.15.67:0/200497594 shutdown_connections 2024-09-19T05:43:31.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35701605c0 0x7f3570152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f357009d000 0x7f3570160080 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f355c0678f0 0x7f355c069db0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 --2- 172.21.15.67:0/200497594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35701527b0 0x7f357009cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 -- 172.21.15.67:0/200497594 >> 172.21.15.67:0/200497594 conn(0x7f35700b1e50 msgr2=0x7f35700b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 -- 172.21.15.67:0/200497594 shutdown_connections 2024-09-19T05:43:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.605+0000 7f357588b640 1 -- 172.21.15.67:0/200497594 wait complete. 2024-09-19T05:43:31.629 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:43:31.629 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:43:31.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f42828c0640 1 Processor -- start 2024-09-19T05:43:31.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f42828c0640 1 -- start start 2024-09-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f42828c0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f427c161da0 0x7f427c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f42828c0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f427c0d0160 0x7f427c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f42828c0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f427c0d05d0 con 0x7f427c0d0e80 2024-09-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f42828c0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f427c0d1830 con 0x7f427c0d0160 2024-09-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f42828c0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f427c0d0840 con 0x7f427c161da0 2024-09-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f4280e5d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f427c0d0160 0x7f427c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f4280e5d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f427c0d0160 0x7f427c0d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45828/0 (socket says 172.21.15.67:45828) 2024-09-19T05:43:31.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f4280e5d640 1 -- 172.21.15.67:0/1140934625 learned_addr learned my addr 172.21.15.67:0/1140934625 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:31.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f427bfff640 1 --2- 172.21.15.67:0/1140934625 >> v2:172.21.15.97:3300/0 conn(0x7f427c161da0 0x7f427c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f4280e5d640 1 -- 172.21.15.67:0/1140934625 >> v2:172.21.15.97:3300/0 conn(0x7f427c161da0 msgr2=0x7f427c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f4280e5d640 1 --2- 172.21.15.67:0/1140934625 >> v2:172.21.15.97:3300/0 conn(0x7f427c161da0 0x7f427c0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f4280e5d640 1 -- 172.21.15.67:0/1140934625 >> v1:172.21.15.97:6789/0 conn(0x7f427c0d0e80 legacy=0x7f427c0b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:31.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.745+0000 7f4280e5d640 1 -- 172.21.15.67:0/1140934625 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c0d4d40 con 0x7f427c0d0160 2024-09-19T05:43:31.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f4280e5d640 1 --2- 172.21.15.67:0/1140934625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c0d0160 0x7f427c0d12f0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f427c0b5f50 tx=0x7f427401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848a390b0b2771ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:31.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f427affd640 1 -- 172.21.15.67:0/1140934625 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42740a5760 con 0x7f427c0d0160 2024-09-19T05:43:31.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f427affd640 1 -- 172.21.15.67:0/1140934625 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42740a5900 con 0x7f427c0d0160 2024-09-19T05:43:31.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f427affd640 1 -- 172.21.15.67:0/1140934625 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42740a5cd0 con 0x7f427c0d0160 2024-09-19T05:43:31.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 -- 172.21.15.67:0/1140934625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c0d0160 msgr2=0x7f427c0d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 --2- 172.21.15.67:0/1140934625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c0d0160 0x7f427c0d12f0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f427c0b5f50 tx=0x7f427401c9b0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 -- 172.21.15.67:0/1140934625 shutdown_connections 2024-09-19T05:43:31.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 --2- 172.21.15.67:0/1140934625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c0d0160 0x7f427c0d12f0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 --2- 172.21.15.67:0/1140934625 >> v2:172.21.15.97:3300/0 conn(0x7f427c161da0 0x7f427c0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 -- 172.21.15.67:0/1140934625 >> 172.21.15.67:0/1140934625 conn(0x7f427c08bfc0 msgr2=0x7f427c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:31.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 -- 172.21.15.67:0/1140934625 shutdown_connections 2024-09-19T05:43:31.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 -- 172.21.15.67:0/1140934625 wait complete. 2024-09-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 Processor -- start 2024-09-19T05:43:31.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 -- start start 2024-09-19T05:43:31.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427c0d0160 0x7f427c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f427c0d0e80 0x7f427c0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c161da0 0x7f427c0b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f427c162180 con 0x7f427c161da0 2024-09-19T05:43:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f427c0b5d00 con 0x7f427c0d0e80 2024-09-19T05:43:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f42828c0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f427c0b50e0 con 0x7f427c0d0160 2024-09-19T05:43:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f4280e5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c161da0 0x7f427c0b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f4280e5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c161da0 0x7f427c0b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45840/0 (socket says 172.21.15.67:45840) 2024-09-19T05:43:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f4280e5d640 1 -- 172.21.15.67:0/2514679935 learned_addr learned my addr 172.21.15.67:0/2514679935 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f427b7fe640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f427c0d0e80 0x7f427c0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.749+0000 7f427bfff640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427c0d0160 0x7f427c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4280e5d640 1 -- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427c0d0160 msgr2=0x7f427c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4280e5d640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427c0d0160 0x7f427c155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4280e5d640 1 -- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f427c0d0e80 msgr2=0x7f427c0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4280e5d640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f427c0d0e80 0x7f427c0cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4280e5d640 1 -- 172.21.15.67:0/2514679935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c0b33d0 con 0x7f427c161da0 2024-09-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f427bfff640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427c0d0160 0x7f427c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4280e5d640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c161da0 0x7f427c0b5e80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f42740af040 tx=0x7f4274019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4278ff9640 1 -- 172.21.15.67:0/2514679935 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42740bc020 con 0x7f427c161da0 2024-09-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4278ff9640 1 -- 172.21.15.67:0/2514679935 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42740b8670 con 0x7f427c161da0 2024-09-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f42828c0640 1 -- 172.21.15.67:0/2514679935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427c152150 con 0x7f427c161da0 2024-09-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4278ff9640 1 -- 172.21.15.67:0/2514679935 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42740b8a60 con 0x7f427c161da0 2024-09-19T05:43:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f42828c0640 1 -- 172.21.15.67:0/2514679935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427c152710 con 0x7f427c161da0 2024-09-19T05:43:31.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f42828c0640 1 -- 172.21.15.67:0/2514679935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427c068ea0 con 0x7f427c161da0 2024-09-19T05:43:31.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4278ff9640 1 -- 172.21.15.67:0/2514679935 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42740bf020 con 0x7f427c161da0 2024-09-19T05:43:31.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4278ff9640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f42680678c0 0x7f4268069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:31.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f4278ff9640 1 -- 172.21.15.67:0/2514679935 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f4274120d70 con 0x7f427c161da0 2024-09-19T05:43:31.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f427bfff640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f42680678c0 0x7f4268069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:31.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.753+0000 7f427bfff640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f42680678c0 0x7f4268069d80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f426c00b9f0 tx=0x7f426c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:31.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.757+0000 7f4278ff9640 1 -- 172.21.15.67:0/2514679935 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f42740c6030 con 0x7f427c161da0 2024-09-19T05:43:31.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.957+0000 7f42828c0640 1 -- 172.21.15.67:0/2514679935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f427c0b5470 con 0x7f427c161da0 2024-09-19T05:43:31.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.957+0000 7f4278ff9640 1 -- 172.21.15.67:0/2514679935 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5216 (secure 0 0 0) 0x7f42740165a0 con 0x7f427c161da0 2024-09-19T05:43:31.957 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:31.957 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":91,"btime":"2024-09-19T05:43:02:159748+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/617137818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":617137818},{"type":"v1","addr":"172.21.15.97:6835","nonce":617137818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":6862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3709077281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3709077281},{"type":"v1","addr":"172.21.15.97:6837","nonce":3709077281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1889576066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1889576066},{"type":"v1","addr":"172.21.15.67:6833","nonce":1889576066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:42:58.500443+0000","modified":"2024-09-19T05:43:01.531911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/96000467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":96000467},{"type":"v1","addr":"172.21.15.67:6835","nonce":96000467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8136,"qdb_cluster":[8136]},"id":8}]} 2024-09-19T05:43:31.957 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 91 2024-09-19T05:43:31.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 -- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f42680678c0 msgr2=0x7f4268069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f42680678c0 0x7f4268069d80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f426c00b9f0 tx=0x7f426c008040 comp rx=0 tx=0).stop 2024-09-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 -- 172.21.15.67:0/2514679935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c161da0 msgr2=0x7f427c0b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c161da0 0x7f427c0b5e80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f42740af040 tx=0x7f4274019750 comp rx=0 tx=0).stop 2024-09-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 -- 172.21.15.67:0/2514679935 shutdown_connections 2024-09-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c161da0 0x7f427c0b5e80 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f427c0d0e80 0x7f427c0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f42680678c0 0x7f4268069d80 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 --2- 172.21.15.67:0/2514679935 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427c0d0160 0x7f427c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:31.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 -- 172.21.15.67:0/2514679935 >> 172.21.15.67:0/2514679935 conn(0x7f427c08bfc0 msgr2=0x7f427c160f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:31.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 -- 172.21.15.67:0/2514679935 shutdown_connections 2024-09-19T05:43:31.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:31.961+0000 7f42828c0640 1 -- 172.21.15.67:0/2514679935 wait complete. 2024-09-19T05:43:31.976 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-19T05:43:31.976 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:43:32.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.097+0000 7fe78b0c6640 1 Processor -- start 2024-09-19T05:43:32.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.097+0000 7fe78b0c6640 1 -- start start 2024-09-19T05:43:32.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe78b0c6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe78406dde0 0x7fe7840b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe78b0c6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe7840b3510 0x7fe78406f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe78b0c6640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe78406e3c0 con 0x7fe78415c030 2024-09-19T05:43:32.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe78b0c6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe78406e6a0 con 0x7fe7840b3510 2024-09-19T05:43:32.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe78b0c6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe78406e980 con 0x7fe78406dde0 2024-09-19T05:43:32.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe789663640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe7840b3510 0x7fe78406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe788e62640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe78415c030 0x7fe78415d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37664/0 (socket says 172.21.15.67:37664) 2024-09-19T05:43:32.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe788e62640 1 -- 172.21.15.67:0/413019349 learned_addr learned my addr 172.21.15.67:0/413019349 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:32.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe783fff640 1 --2- 172.21.15.67:0/413019349 >> v2:172.21.15.97:3300/0 conn(0x7fe78406dde0 0x7fe7840b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe789663640 1 -- 172.21.15.67:0/413019349 >> v2:172.21.15.97:3300/0 conn(0x7fe78406dde0 msgr2=0x7fe7840b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:32.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe789663640 1 --2- 172.21.15.67:0/413019349 >> v2:172.21.15.97:3300/0 conn(0x7fe78406dde0 0x7fe7840b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe789663640 1 -- 172.21.15.67:0/413019349 >> v1:172.21.15.67:6789/0 conn(0x7fe78415c030 legacy=0x7fe78415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe789663640 1 -- 172.21.15.67:0/413019349 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78406ec60 con 0x7fe7840b3510 2024-09-19T05:43:32.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.101+0000 7fe789663640 1 --2- 172.21.15.67:0/413019349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7840b3510 0x7fe78406f460 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fe7840add20 tx=0x7fe77c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e974777814e9923 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:32.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe7837fe640 1 -- 172.21.15.67:0/413019349 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0b0070 con 0x7fe7840b3510 2024-09-19T05:43:32.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe7837fe640 1 -- 172.21.15.67:0/413019349 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c0ab400 con 0x7fe7840b3510 2024-09-19T05:43:32.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe7837fe640 1 -- 172.21.15.67:0/413019349 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0ab7d0 con 0x7fe7840b3510 2024-09-19T05:43:32.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 -- 172.21.15.67:0/413019349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7840b3510 msgr2=0x7fe78406f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 --2- 172.21.15.67:0/413019349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7840b3510 0x7fe78406f460 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fe7840add20 tx=0x7fe77c01c2e0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 -- 172.21.15.67:0/413019349 shutdown_connections 2024-09-19T05:43:32.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 --2- 172.21.15.67:0/413019349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7840b3510 0x7fe78406f460 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 --2- 172.21.15.67:0/413019349 >> v2:172.21.15.97:3300/0 conn(0x7fe78406dde0 0x7fe7840b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 -- 172.21.15.67:0/413019349 >> 172.21.15.67:0/413019349 conn(0x7fe7840d0080 msgr2=0x7fe7840d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:32.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 -- 172.21.15.67:0/413019349 shutdown_connections 2024-09-19T05:43:32.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 -- 172.21.15.67:0/413019349 wait complete. 2024-09-19T05:43:32.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 Processor -- start 2024-09-19T05:43:32.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 -- start start 2024-09-19T05:43:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe78406dde0 0x7fe7841563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7840b3510 0x7fe784071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe78415c030 0x7fe7840ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe7841692f0 con 0x7fe78406dde0 2024-09-19T05:43:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe78415c620 con 0x7fe78415c030 2024-09-19T05:43:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe78b0c6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe784169470 con 0x7fe7840b3510 2024-09-19T05:43:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe788e62640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe78406dde0 0x7fe7841563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe788e62640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe78406dde0 0x7fe7841563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45860/0 (socket says 172.21.15.67:45860) 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.105+0000 7fe788e62640 1 -- 172.21.15.67:0/2162756363 learned_addr learned my addr 172.21.15.67:0/2162756363 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe783fff640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7840b3510 0x7fe784071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe789663640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe78415c030 0x7fe7840ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe788e62640 1 -- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7840b3510 msgr2=0x7fe784071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe788e62640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7840b3510 0x7fe784071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe788e62640 1 -- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe78415c030 msgr2=0x7fe7840ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe788e62640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe78415c030 0x7fe7840ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe788e62640 1 -- 172.21.15.67:0/2162756363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7840cd750 con 0x7fe78406dde0 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe788e62640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe78406dde0 0x7fe7841563c0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fe77400c780 tx=0x7fe77400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe7817fa640 1 -- 172.21.15.67:0/2162756363 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774018070 con 0x7fe78406dde0 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe7817fa640 1 -- 172.21.15.67:0/2162756363 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7740072d0 con 0x7fe78406dde0 2024-09-19T05:43:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe7817fa640 1 -- 172.21.15.67:0/2162756363 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7740047f0 con 0x7fe78406dde0 2024-09-19T05:43:32.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe78b0c6640 1 -- 172.21.15.67:0/2162756363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7840cda30 con 0x7fe78406dde0 2024-09-19T05:43:32.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe78b0c6640 1 -- 172.21.15.67:0/2162756363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7840cdff0 con 0x7fe78406dde0 2024-09-19T05:43:32.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe78b0c6640 1 -- 172.21.15.67:0/2162756363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7840b2fd0 con 0x7fe78406dde0 2024-09-19T05:43:32.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe7817fa640 1 -- 172.21.15.67:0/2162756363 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe774004990 con 0x7fe78406dde0 2024-09-19T05:43:32.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe7817fa640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 0x7fe764069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe7817fa640 1 -- 172.21.15.67:0/2162756363 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7fe774085320 con 0x7fe78406dde0 2024-09-19T05:43:32.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.109+0000 7fe783fff640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 0x7fe764069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.113+0000 7fe783fff640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 0x7fe764069d80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe78414f510 tx=0x7fe76c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:32.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.113+0000 7fe7817fa640 1 -- 172.21.15.67:0/2162756363 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe774055d90 con 0x7fe78406dde0 2024-09-19T05:43:32.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.333+0000 7fe78b0c6640 1 -- 172.21.15.67:0/2162756363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe7840b1010 con 0x7fe78406dde0 2024-09-19T05:43:32.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.333+0000 7fe7817fa640 1 -- 172.21.15.67:0/2162756363 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1069 (secure 0 0 0) 0x7fe774055690 con 0x7fe78406dde0 2024-09-19T05:43:32.334 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:32.334 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":642,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077341207,"bytes_used":2684870656,"bytes_avail":770409242624,"bytes_total":773094113280,"write_bytes_sec":42289595,"read_op_per_sec":0,"write_op_per_sec":43},"fsmap":{"epoch":91,"btime":"2024-09-19T05:43:02:159748+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8136}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-19T05:42:47.308492+0000","services":{}},"progress_events":{}} 2024-09-19T05:43:32.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 -- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 msgr2=0x7fe764069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 0x7fe764069d80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe78414f510 tx=0x7fe76c00b040 comp rx=0 tx=0).stop 2024-09-19T05:43:32.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 -- 172.21.15.67:0/2162756363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe78406dde0 msgr2=0x7fe7841563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe78406dde0 0x7fe7841563c0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fe77400c780 tx=0x7fe77400cc40 comp rx=0 tx=0).stop 2024-09-19T05:43:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 -- 172.21.15.67:0/2162756363 shutdown_connections 2024-09-19T05:43:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe78415c030 0x7fe7840ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe7640678c0 0x7fe764069d80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7840b3510 0x7fe784071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 --2- 172.21.15.67:0/2162756363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe78406dde0 0x7fe7841563c0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 -- 172.21.15.67:0/2162756363 >> 172.21.15.67:0/2162756363 conn(0x7fe7840d0080 msgr2=0x7fe7840b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 -- 172.21.15.67:0/2162756363 shutdown_connections 2024-09-19T05:43:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.337+0000 7fe78b0c6640 1 -- 172.21.15.67:0/2162756363 wait complete. 2024-09-19T05:43:32.351 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:43:32.351 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:43:32.425 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:43:32.494 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:43:32.494 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:43:32.494 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:43:32.495 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:43:32.501 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:43:32.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0c384640 1 Processor -- start 2024-09-19T05:43:32.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0c384640 1 -- start start 2024-09-19T05:43:32.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0c384640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbd04161da0 0x7fbd040d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0c384640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbd040d0e80 0x7fbd040d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0c384640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd040d4d40 con 0x7fbd040b41c0 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0c384640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbd040d0840 con 0x7fbd040d0e80 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0c384640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbd040d1800 con 0x7fbd04161da0 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0991f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbd040d0e80 0x7fbd040d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0a921640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbd040b41c0 0x7fbd040b4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37674/0 (socket says 172.21.15.67:37674) 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0a921640 1 -- 172.21.15.67:0/2434997449 learned_addr learned my addr 172.21.15.67:0/2434997449 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.669+0000 7fbd0a120640 1 --2- 172.21.15.67:0/2434997449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbd04161da0 0x7fbd040d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0991f640 1 -- 172.21.15.67:0/2434997449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbd04161da0 msgr2=0x7fbd040d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0991f640 1 --2- 172.21.15.67:0/2434997449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbd04161da0 0x7fbd040d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0991f640 1 -- 172.21.15.67:0/2434997449 >> v1:172.21.15.67:6789/0 conn(0x7fbd040b41c0 legacy=0x7fbd040b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0911e640 1 -- 172.21.15.67:0/2434997449 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532982280 0 0) 0x7fbd040d4d40 con 0x7fbd040b41c0 2024-09-19T05:43:32.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0991f640 1 -- 172.21.15.67:0/2434997449 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd040d5020 con 0x7fbd040d0e80 2024-09-19T05:43:32.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0991f640 1 --2- 172.21.15.67:0/2434997449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd040d0e80 0x7fbd040d12c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40097c0 tx=0x7fbcf401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9423378ed79e9fd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:32.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0911e640 1 -- 172.21.15.67:0/2434997449 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40b0070 con 0x7fbd040d0e80 2024-09-19T05:43:32.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0911e640 1 -- 172.21.15.67:0/2434997449 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf40ab600 con 0x7fbd040d0e80 2024-09-19T05:43:32.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0911e640 1 -- 172.21.15.67:0/2434997449 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40ab9d0 con 0x7fbd040d0e80 2024-09-19T05:43:32.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0c384640 1 -- 172.21.15.67:0/2434997449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd040d0e80 msgr2=0x7fbd040d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0c384640 1 --2- 172.21.15.67:0/2434997449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd040d0e80 0x7fbd040d12c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40097c0 tx=0x7fbcf401c4a0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0c384640 1 -- 172.21.15.67:0/2434997449 shutdown_connections 2024-09-19T05:43:32.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0c384640 1 --2- 172.21.15.67:0/2434997449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd040d0e80 0x7fbd040d12c0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0c384640 1 --2- 172.21.15.67:0/2434997449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbd04161da0 0x7fbd040d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0c384640 1 -- 172.21.15.67:0/2434997449 >> 172.21.15.67:0/2434997449 conn(0x7fbd0408bfc0 msgr2=0x7fbd040d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:32.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0c384640 1 -- 172.21.15.67:0/2434997449 shutdown_connections 2024-09-19T05:43:32.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.673+0000 7fbd0c384640 1 -- 172.21.15.67:0/2434997449 wait complete. 2024-09-19T05:43:32.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 Processor -- start 2024-09-19T05:43:32.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 -- start start 2024-09-19T05:43:32.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbd040b41c0 0x7fbd04157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd040d0e80 0x7fbd040ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd04161da0 0x7fbd041f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd04162180 con 0x7fbd04161da0 2024-09-19T05:43:32.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbd040b5d00 con 0x7fbd040d0e80 2024-09-19T05:43:32.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbd0416b4f0 con 0x7fbd040b41c0 2024-09-19T05:43:32.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0a921640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd04161da0 0x7fbd041f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0a921640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd04161da0 0x7fbd041f75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45882/0 (socket says 172.21.15.67:45882) 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0a921640 1 -- 172.21.15.67:0/3568364393 learned_addr learned my addr 172.21.15.67:0/3568364393 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0991f640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd040d0e80 0x7fbd040ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0a120640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbd040b41c0 0x7fbd04157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0a921640 1 -- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbd040b41c0 msgr2=0x7fbd04157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0a921640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbd040b41c0 0x7fbd04157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0a921640 1 -- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd040d0e80 msgr2=0x7fbd040ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0a921640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd040d0e80 0x7fbd040ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0a921640 1 -- 172.21.15.67:0/3568364393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd040cc1a0 con 0x7fbd04161da0 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0a921640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd04161da0 0x7fbd041f75c0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c410 tx=0x7fbd0000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbcfaffd640 1 -- 172.21.15.67:0/3568364393 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd000074e0 con 0x7fbd04161da0 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbcfaffd640 1 -- 172.21.15.67:0/3568364393 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd00007680 con 0x7fbd04161da0 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbcfaffd640 1 -- 172.21.15.67:0/3568364393 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd00004a30 con 0x7fbd04161da0 2024-09-19T05:43:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 -- 172.21.15.67:0/3568364393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd040cc480 con 0x7fbd04161da0 2024-09-19T05:43:32.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 -- 172.21.15.67:0/3568364393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd041581b0 con 0x7fbd04161da0 2024-09-19T05:43:32.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.677+0000 7fbd0c384640 1 -- 172.21.15.67:0/3568364393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd040d12c0 con 0x7fbd04161da0 2024-09-19T05:43:32.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.681+0000 7fbcfaffd640 1 -- 172.21.15.67:0/3568364393 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbd00011070 con 0x7fbd04161da0 2024-09-19T05:43:32.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.681+0000 7fbcfaffd640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbce80678c0 0x7fbce8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:32.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.681+0000 7fbcfaffd640 1 -- 172.21.15.67:0/3568364393 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7fbd00085720 con 0x7fbd04161da0 2024-09-19T05:43:32.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.681+0000 7fbd0a120640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbce80678c0 0x7fbce8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:32.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.681+0000 7fbd0a120640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbce80678c0 0x7fbce8069d80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc003b90 tx=0x7fbcfc0098a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:32.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.685+0000 7fbcfaffd640 1 -- 172.21.15.67:0/3568364393 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fbd00055b10 con 0x7fbd04161da0 2024-09-19T05:43:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.861+0000 7fbd0c384640 1 -- 172.21.15.67:0/3568364393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbd040d47e0 con 0x7fbd04161da0 2024-09-19T05:43:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.861+0000 7fbcfaffd640 1 -- 172.21.15.67:0/3568364393 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v132) ==== 80+0+0 (secure 0 0 0) 0x7fbd00059e10 con 0x7fbd04161da0 2024-09-19T05:43:32.860 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.861+0000 7fbd0c384640 1 -- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbce80678c0 msgr2=0x7fbce8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.861+0000 7fbd0c384640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbce80678c0 0x7fbce8069d80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc003b90 tx=0x7fbcfc0098a0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.861+0000 7fbd0c384640 1 -- 172.21.15.67:0/3568364393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd04161da0 msgr2=0x7fbd041f75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.861+0000 7fbd0c384640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd04161da0 0x7fbd041f75c0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c410 tx=0x7fbd0000c8d0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.865+0000 7fbd0c384640 1 -- 172.21.15.67:0/3568364393 shutdown_connections 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.865+0000 7fbd0c384640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd04161da0 0x7fbd041f75c0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.865+0000 7fbd0c384640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd040d0e80 0x7fbd040ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.865+0000 7fbd0c384640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbce80678c0 0x7fbce8069d80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.865+0000 7fbd0c384640 1 --2- 172.21.15.67:0/3568364393 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbd040b41c0 0x7fbd04157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.865+0000 7fbd0c384640 1 -- 172.21.15.67:0/3568364393 >> 172.21.15.67:0/3568364393 conn(0x7fbd0408bfc0 msgr2=0x7fbd0406ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.865+0000 7fbd0c384640 1 -- 172.21.15.67:0/3568364393 shutdown_connections 2024-09-19T05:43:32.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:32.865+0000 7fbd0c384640 1 -- 172.21.15.67:0/3568364393 wait complete. 2024-09-19T05:43:32.879 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:43:32.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:32.879 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:32.890 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[73576]: fuse finished with error 0 and tester_r 0 2024-09-19T05:43:32.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:43:32.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:32.954 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:43:33.130 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:43:33.130 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:43:33.130 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:43:33.137 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:43:33.137 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:43:33.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:33.137 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:43:33.185 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:43:33.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:43:33.186 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:43:33.186 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:43:33.186 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:43:33.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:43:33.192 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:43:33.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:33.192 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:43:33.239 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:43:33.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:43:33.240 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:43:33.240 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:43:33.240 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:43:33.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:43:33.246 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:43:33.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:33.246 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:43:33.293 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:43:33.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:43:33.294 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:43:33.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d3c76640 1 Processor -- start 2024-09-19T05:43:33.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d3c76640 1 -- start start 2024-09-19T05:43:33.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d3c76640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f34cc06c3d0 0x7f34cc0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d3c76640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34cc0b5b90 con 0x7f34cc15e640 2024-09-19T05:43:33.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d3c76640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34cc0b15f0 con 0x7f34cc0b6050 2024-09-19T05:43:33.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d3c76640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f34cc0b4780 con 0x7f34cc06c3d0 2024-09-19T05:43:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d1a12640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f34cc15e640 0x7f34cc0b2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37682/0 (socket says 172.21.15.67:37682) 2024-09-19T05:43:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d1a12640 1 -- 172.21.15.67:0/1610054651 learned_addr learned my addr 172.21.15.67:0/1610054651 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d2213640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f34cc06c3d0 0x7f34cc0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d2213640 1 -- 172.21.15.67:0/1610054651 >> v1:172.21.15.97:6789/0 conn(0x7f34cc0b6050 legacy=0x7f34cc06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d2213640 1 -- 172.21.15.67:0/1610054651 >> v1:172.21.15.67:6789/0 conn(0x7f34cc15e640 legacy=0x7f34cc0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.429+0000 7f34d2213640 1 -- 172.21.15.67:0/1610054651 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc0b44a0 con 0x7f34cc06c3d0 2024-09-19T05:43:33.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d2213640 1 --2- 172.21.15.67:0/1610054651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 0x7f34cc0ae0a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f34c40097c0 tx=0x7f34c401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3f51d8f1320f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:33.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d0a10640 1 -- 172.21.15.67:0/1610054651 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c40b0070 con 0x7f34cc06c3d0 2024-09-19T05:43:33.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d0a10640 1 -- 172.21.15.67:0/1610054651 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c40ab600 con 0x7f34cc06c3d0 2024-09-19T05:43:33.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d0a10640 1 -- 172.21.15.67:0/1610054651 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c40ab9d0 con 0x7f34cc06c3d0 2024-09-19T05:43:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 -- 172.21.15.67:0/1610054651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 msgr2=0x7f34cc0ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 --2- 172.21.15.67:0/1610054651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 0x7f34cc0ae0a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f34c40097c0 tx=0x7f34c401c380 comp rx=0 tx=0).stop 2024-09-19T05:43:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 -- 172.21.15.67:0/1610054651 shutdown_connections 2024-09-19T05:43:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 --2- 172.21.15.67:0/1610054651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 0x7f34cc0ae0a0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 -- 172.21.15.67:0/1610054651 >> 172.21.15.67:0/1610054651 conn(0x7f34cc09aa30 msgr2=0x7f34cc0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 -- 172.21.15.67:0/1610054651 shutdown_connections 2024-09-19T05:43:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 -- 172.21.15.67:0/1610054651 wait complete. 2024-09-19T05:43:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 Processor -- start 2024-09-19T05:43:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 -- start start 2024-09-19T05:43:33.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 0x7f34cc1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34cc0b6050 0x7f34cc0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34cc15e640 0x7f34cc0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0b0790 con 0x7f34cc06c3d0 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0b2b40 con 0x7f34cc0b6050 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d3c76640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc0b0910 con 0x7f34cc15e640 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.433+0000 7f34d1a12640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 0x7f34cc1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d1a12640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 0x7f34cc1508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45902/0 (socket says 172.21.15.67:45902) 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d1a12640 1 -- 172.21.15.67:0/4075027492 learned_addr learned my addr 172.21.15.67:0/4075027492 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d2213640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34cc15e640 0x7f34cc0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d1211640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34cc0b6050 0x7f34cc0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d1a12640 1 -- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34cc15e640 msgr2=0x7f34cc0cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d1a12640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34cc15e640 0x7f34cc0cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d1a12640 1 -- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34cc0b6050 msgr2=0x7f34cc0cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d1a12640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34cc0b6050 0x7f34cc0cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d1a12640 1 -- 172.21.15.67:0/4075027492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc0cbbc0 con 0x7f34cc06c3d0 2024-09-19T05:43:33.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d1a12640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 0x7f34cc1508d0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f34c800cba0 tx=0x7f34c800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:33.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34c27fc640 1 -- 172.21.15.67:0/4075027492 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8017070 con 0x7f34cc06c3d0 2024-09-19T05:43:33.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34c27fc640 1 -- 172.21.15.67:0/4075027492 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c800ad40 con 0x7f34cc06c3d0 2024-09-19T05:43:33.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d3c76640 1 -- 172.21.15.67:0/4075027492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc0cbea0 con 0x7f34cc06c3d0 2024-09-19T05:43:33.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34c27fc640 1 -- 172.21.15.67:0/4075027492 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8012600 con 0x7f34cc06c3d0 2024-09-19T05:43:33.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d3c76640 1 -- 172.21.15.67:0/4075027492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc160160 con 0x7f34cc06c3d0 2024-09-19T05:43:33.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d3c76640 1 -- 172.21.15.67:0/4075027492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34cc068f70 con 0x7f34cc06c3d0 2024-09-19T05:43:33.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34c27fc640 1 -- 172.21.15.67:0/4075027492 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34c801a070 con 0x7f34cc06c3d0 2024-09-19T05:43:33.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34c27fc640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34b00678c0 0x7f34b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34c27fc640 1 -- 172.21.15.67:0/4075027492 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f34c8085ab0 con 0x7f34cc06c3d0 2024-09-19T05:43:33.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.437+0000 7f34d1211640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34b00678c0 0x7f34b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.441+0000 7f34d1211640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34b00678c0 0x7f34b0069d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f34cc09cb00 tx=0x7f34bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:33.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.441+0000 7f34c27fc640 1 -- 172.21.15.67:0/4075027492 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f34cc0b5b90 con 0x7f34cc06c3d0 2024-09-19T05:43:33.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.641+0000 7f34d3c76640 1 -- 172.21.15.67:0/4075027492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34cc169f10 con 0x7f34cc06c3d0 2024-09-19T05:43:33.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.641+0000 7f34c27fc640 1 -- 172.21.15.67:0/4075027492 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5216 (secure 0 0 0) 0x7f34c8055ea0 con 0x7f34cc06c3d0 2024-09-19T05:43:33.642 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:33.642 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":91,"btime":"2024-09-19T05:43:02:159748+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/617137818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":617137818},{"type":"v1","addr":"172.21.15.97:6835","nonce":617137818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":6862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3709077281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3709077281},{"type":"v1","addr":"172.21.15.97:6837","nonce":3709077281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1889576066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1889576066},{"type":"v1","addr":"172.21.15.67:6833","nonce":1889576066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:42:58.500443+0000","modified":"2024-09-19T05:43:01.531911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/96000467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":96000467},{"type":"v1","addr":"172.21.15.67:6835","nonce":96000467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8136,"qdb_cluster":[8136]},"id":8}]} 2024-09-19T05:43:33.642 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 91 2024-09-19T05:43:33.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 -- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34b00678c0 msgr2=0x7f34b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34b00678c0 0x7f34b0069d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f34cc09cb00 tx=0x7f34bc009040 comp rx=0 tx=0).stop 2024-09-19T05:43:33.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 -- 172.21.15.67:0/4075027492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 msgr2=0x7f34cc1508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 0x7f34cc1508d0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f34c800cba0 tx=0x7f34c800a430 comp rx=0 tx=0).stop 2024-09-19T05:43:33.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 -- 172.21.15.67:0/4075027492 shutdown_connections 2024-09-19T05:43:33.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34b00678c0 0x7f34b0069d80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34cc15e640 0x7f34cc0cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34cc0b6050 0x7f34cc0cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 --2- 172.21.15.67:0/4075027492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34cc06c3d0 0x7f34cc1508d0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 -- 172.21.15.67:0/4075027492 >> 172.21.15.67:0/4075027492 conn(0x7f34cc09aa30 msgr2=0x7f34cc156720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:33.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 -- 172.21.15.67:0/4075027492 shutdown_connections 2024-09-19T05:43:33.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.645+0000 7f34d3c76640 1 -- 172.21.15.67:0/4075027492 wait complete. 2024-09-19T05:43:33.661 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:43:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.785+0000 7f0f8efe7640 1 Processor -- start 2024-09-19T05:43:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8efe7640 1 -- start start 2024-09-19T05:43:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8efe7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f880cf070 0x7f0f8815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8efe7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815ef30 0x7f0f880d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8efe7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f880cf510 con 0x7f0f8815e610 2024-09-19T05:43:33.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8efe7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0f880d0120 con 0x7f0f880cf070 2024-09-19T05:43:33.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8efe7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f880cf7f0 con 0x7f0f8815ef30 2024-09-19T05:43:33.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8d584640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815ef30 0x7f0f880d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8d584640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815ef30 0x7f0f880d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:53862/0 (socket says 172.21.15.67:53862) 2024-09-19T05:43:33.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8d584640 1 -- 172.21.15.67:0/1726765340 learned_addr learned my addr 172.21.15.67:0/1726765340 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:33.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f87fff640 1 --2- 172.21.15.67:0/1726765340 >> v2:172.21.15.97:3300/0 conn(0x7f0f880cf070 0x7f0f8815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8d584640 1 -- 172.21.15.67:0/1726765340 >> v2:172.21.15.97:3300/0 conn(0x7f0f880cf070 msgr2=0x7f0f8815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:33.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8d584640 1 --2- 172.21.15.67:0/1726765340 >> v2:172.21.15.97:3300/0 conn(0x7f0f880cf070 0x7f0f8815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8d584640 1 -- 172.21.15.67:0/1726765340 >> v1:172.21.15.97:6789/0 conn(0x7f0f8815e610 legacy=0x7f0f88162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.789+0000 7f0f8d584640 1 -- 172.21.15.67:0/1726765340 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f880cfad0 con 0x7f0f8815ef30 2024-09-19T05:43:33.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8d584640 1 --2- 172.21.15.67:0/1726765340 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815ef30 0x7f0f880d2070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009e50 tx=0x7f0f8001ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b361dca66e35c0d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:33.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f877fe640 1 -- 172.21.15.67:0/1726765340 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800a5890 con 0x7f0f8815ef30 2024-09-19T05:43:33.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f877fe640 1 -- 172.21.15.67:0/1726765340 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f800a5a30 con 0x7f0f8815ef30 2024-09-19T05:43:33.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f877fe640 1 -- 172.21.15.67:0/1726765340 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800a5e00 con 0x7f0f8815ef30 2024-09-19T05:43:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 -- 172.21.15.67:0/1726765340 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815ef30 msgr2=0x7f0f880d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 --2- 172.21.15.67:0/1726765340 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815ef30 0x7f0f880d2070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009e50 tx=0x7f0f8001ca00 comp rx=0 tx=0).stop 2024-09-19T05:43:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 -- 172.21.15.67:0/1726765340 shutdown_connections 2024-09-19T05:43:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 --2- 172.21.15.67:0/1726765340 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815ef30 0x7f0f880d2070 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 --2- 172.21.15.67:0/1726765340 >> v2:172.21.15.97:3300/0 conn(0x7f0f880cf070 0x7f0f8815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 -- 172.21.15.67:0/1726765340 >> 172.21.15.67:0/1726765340 conn(0x7f0f8808bfc0 msgr2=0x7f0f880d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 -- 172.21.15.67:0/1726765340 shutdown_connections 2024-09-19T05:43:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 -- 172.21.15.67:0/1726765340 wait complete. 2024-09-19T05:43:33.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 Processor -- start 2024-09-19T05:43:33.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 -- start start 2024-09-19T05:43:33.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.793+0000 7f0f8efe7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f880cf070 0x7f0f88156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8efe7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815e610 0x7f0f88155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8efe7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f8815ef30 0x7f0f880b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8efe7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0f880d2f40 con 0x7f0f8815ef30 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8efe7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f880d2dc0 con 0x7f0f880cf070 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8efe7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f880d30c0 con 0x7f0f8815e610 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8d584640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f8815ef30 0x7f0f880b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8d584640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f8815ef30 0x7f0f880b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45912/0 (socket says 172.21.15.67:45912) 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8d584640 1 -- 172.21.15.67:0/2760521939 learned_addr learned my addr 172.21.15.67:0/2760521939 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8cd83640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f880cf070 0x7f0f88156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f87fff640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815e610 0x7f0f88155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8d584640 1 -- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815e610 msgr2=0x7f0f88155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8d584640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815e610 0x7f0f88155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8d584640 1 -- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f880cf070 msgr2=0x7f0f88156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:33.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8d584640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f880cf070 0x7f0f88156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:33.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8d584640 1 -- 172.21.15.67:0/2760521939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f881575c0 con 0x7f0f8815ef30 2024-09-19T05:43:33.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8d584640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f8815ef30 0x7f0f880b4f10 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f0f800af040 tx=0x7f0f800197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:33.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f857fa640 1 -- 172.21.15.67:0/2760521939 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800bc070 con 0x7f0f8815ef30 2024-09-19T05:43:33.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f857fa640 1 -- 172.21.15.67:0/2760521939 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f800b8640 con 0x7f0f8815ef30 2024-09-19T05:43:33.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f857fa640 1 -- 172.21.15.67:0/2760521939 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800b89f0 con 0x7f0f8815ef30 2024-09-19T05:43:33.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8efe7640 1 -- 172.21.15.67:0/2760521939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f881578a0 con 0x7f0f8815ef30 2024-09-19T05:43:33.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8efe7640 1 -- 172.21.15.67:0/2760521939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f88157e60 con 0x7f0f8815ef30 2024-09-19T05:43:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8efe7640 1 -- 172.21.15.67:0/2760521939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8815e9f0 con 0x7f0f8815ef30 2024-09-19T05:43:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f857fa640 1 -- 172.21.15.67:0/2760521939 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f800b8b90 con 0x7f0f8815ef30 2024-09-19T05:43:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f857fa640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f6c0678f0 0x7f0f6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f857fa640 1 -- 172.21.15.67:0/2760521939 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f0f80120d80 con 0x7f0f8815ef30 2024-09-19T05:43:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.797+0000 7f0f8cd83640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f6c0678f0 0x7f0f6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:33.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.801+0000 7f0f8cd83640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f6c0678f0 0x7f0f6c069db0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c001650 tx=0x7f0f7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:33.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:33.801+0000 7f0f857fa640 1 -- 172.21.15.67:0/2760521939 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0f80016620 con 0x7f0f8815ef30 2024-09-19T05:43:34.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.005+0000 7f0f8efe7640 1 -- 172.21.15.67:0/2760521939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f880cec70 con 0x7f0f8815ef30 2024-09-19T05:43:34.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.005+0000 7f0f857fa640 1 -- 172.21.15.67:0/2760521939 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5216 (secure 0 0 0) 0x7f0f800f17c0 con 0x7f0f8815ef30 2024-09-19T05:43:34.004 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:34.004 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":91,"btime":"2024-09-19T05:43:02:159748+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/617137818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":617137818},{"type":"v1","addr":"172.21.15.97:6835","nonce":617137818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":6862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3709077281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3709077281},{"type":"v1","addr":"172.21.15.97:6837","nonce":3709077281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1889576066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1889576066},{"type":"v1","addr":"172.21.15.67:6833","nonce":1889576066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:42:58.500443+0000","modified":"2024-09-19T05:43:01.531911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/96000467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":96000467},{"type":"v1","addr":"172.21.15.67:6835","nonce":96000467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8136,"qdb_cluster":[8136]},"id":8}]} 2024-09-19T05:43:34.005 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 91 2024-09-19T05:43:34.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.005+0000 7f0f8efe7640 1 -- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f6c0678f0 msgr2=0x7f0f6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f6c0678f0 0x7f0f6c069db0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c001650 tx=0x7f0f7c009040 comp rx=0 tx=0).stop 2024-09-19T05:43:34.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 -- 172.21.15.67:0/2760521939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f8815ef30 msgr2=0x7f0f880b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f8815ef30 0x7f0f880b4f10 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f0f800af040 tx=0x7f0f800197a0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 -- 172.21.15.67:0/2760521939 shutdown_connections 2024-09-19T05:43:34.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f8815ef30 0x7f0f880b4f10 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f6c0678f0 0x7f0f6c069db0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f8815e610 0x7f0f88155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 --2- 172.21.15.67:0/2760521939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f880cf070 0x7f0f88156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 -- 172.21.15.67:0/2760521939 >> 172.21.15.67:0/2760521939 conn(0x7f0f8808bfc0 msgr2=0x7f0f880d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:34.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 -- 172.21.15.67:0/2760521939 shutdown_connections 2024-09-19T05:43:34.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.009+0000 7f0f8efe7640 1 -- 172.21.15.67:0/2760521939 wait complete. 2024-09-19T05:43:34.023 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:43:34.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2da227640 1 Processor -- start 2024-09-19T05:43:34.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2da227640 1 -- start start 2024-09-19T05:43:34.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2da227640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb2d40b7100 0x7fb2d4070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2da227640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb2d40b74e0 0x7fb2d4070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2da227640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d413f8b0 con 0x7fb2d40b54b0 2024-09-19T05:43:34.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2da227640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d413f660 con 0x7fb2d40b74e0 2024-09-19T05:43:34.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2da227640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d413fb90 con 0x7fb2d40b7100 2024-09-19T05:43:34.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2d8a24640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb2d40b74e0 0x7fb2d4070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2d9a26640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb2d40b54b0 0x7fb2d41419a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37686/0 (socket says 172.21.15.67:37686) 2024-09-19T05:43:34.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2d9a26640 1 -- 172.21.15.67:0/3604653436 learned_addr learned my addr 172.21.15.67:0/3604653436 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:34.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2d9225640 1 --2- 172.21.15.67:0/3604653436 >> v2:172.21.15.97:3300/0 conn(0x7fb2d40b7100 0x7fb2d4070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2d8a24640 1 -- 172.21.15.67:0/3604653436 >> v2:172.21.15.97:3300/0 conn(0x7fb2d40b7100 msgr2=0x7fb2d4070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:34.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2d8a24640 1 --2- 172.21.15.67:0/3604653436 >> v2:172.21.15.97:3300/0 conn(0x7fb2d40b7100 0x7fb2d4070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2d8a24640 1 -- 172.21.15.67:0/3604653436 >> v1:172.21.15.67:6789/0 conn(0x7fb2d40b54b0 legacy=0x7fb2d41419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2cbfff640 1 -- 172.21.15.67:0/3604653436 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637769546 0 0) 0x7fb2d413f8b0 con 0x7fb2d40b54b0 2024-09-19T05:43:34.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.149+0000 7fb2d8a24640 1 -- 172.21.15.67:0/3604653436 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d413fe70 con 0x7fb2d40b74e0 2024-09-19T05:43:34.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2d8a24640 1 --2- 172.21.15.67:0/3604653436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 0x7fb2d4070980 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40097c0 tx=0x7fb2c401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634fda6e11dd1be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:34.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2cbfff640 1 -- 172.21.15.67:0/3604653436 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40ab650 con 0x7fb2d40b74e0 2024-09-19T05:43:34.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2cbfff640 1 -- 172.21.15.67:0/3604653436 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c40b0070 con 0x7fb2d40b74e0 2024-09-19T05:43:34.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2cbfff640 1 -- 172.21.15.67:0/3604653436 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40aba10 con 0x7fb2d40b74e0 2024-09-19T05:43:34.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2da227640 1 -- 172.21.15.67:0/3604653436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 msgr2=0x7fb2d4070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2da227640 1 --2- 172.21.15.67:0/3604653436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 0x7fb2d4070980 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40097c0 tx=0x7fb2c401c430 comp rx=0 tx=0).stop 2024-09-19T05:43:34.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2da227640 1 -- 172.21.15.67:0/3604653436 shutdown_connections 2024-09-19T05:43:34.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2da227640 1 --2- 172.21.15.67:0/3604653436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 0x7fb2d4070980 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2da227640 1 --2- 172.21.15.67:0/3604653436 >> v2:172.21.15.97:3300/0 conn(0x7fb2d40b7100 0x7fb2d4070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2da227640 1 -- 172.21.15.67:0/3604653436 >> 172.21.15.67:0/3604653436 conn(0x7fb2d4067e00 msgr2=0x7fb2d4068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:34.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2da227640 1 -- 172.21.15.67:0/3604653436 shutdown_connections 2024-09-19T05:43:34.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2da227640 1 -- 172.21.15.67:0/3604653436 wait complete. 2024-09-19T05:43:34.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2da227640 1 Processor -- start 2024-09-19T05:43:34.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.153+0000 7fb2da227640 1 -- start start 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2da227640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2d40b54b0 0x7fb2d413cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2da227640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2d40b7100 0x7fb2d40b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2da227640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 0x7fb2d40d1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2da227640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d4160620 con 0x7fb2d40b74e0 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2da227640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d41604a0 con 0x7fb2d40b54b0 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2da227640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d41607a0 con 0x7fb2d40b7100 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9a26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 0x7fb2d40d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9a26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 0x7fb2d40d1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45924/0 (socket says 172.21.15.67:45924) 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9a26640 1 -- 172.21.15.67:0/862703737 learned_addr learned my addr 172.21.15.67:0/862703737 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9225640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2d40b54b0 0x7fb2d413cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d8a24640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2d40b7100 0x7fb2d40b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9a26640 1 -- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2d40b7100 msgr2=0x7fb2d40b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9a26640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2d40b7100 0x7fb2d40b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9a26640 1 -- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2d40b54b0 msgr2=0x7fb2d413cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9a26640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2d40b54b0 0x7fb2d413cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9a26640 1 -- 172.21.15.67:0/862703737 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d413e950 con 0x7fb2d40b74e0 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9a26640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 0x7fb2d40d1260 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00c6d0 tx=0x7fb2cc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2c9ffb640 1 -- 172.21.15.67:0/862703737 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc018070 con 0x7fb2d40b74e0 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2c9ffb640 1 -- 172.21.15.67:0/862703737 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2cc004d70 con 0x7fb2d40b74e0 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2da227640 1 -- 172.21.15.67:0/862703737 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d40b4520 con 0x7fb2d40b74e0 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2c9ffb640 1 -- 172.21.15.67:0/862703737 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00a880 con 0x7fb2d40b74e0 2024-09-19T05:43:34.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2da227640 1 -- 172.21.15.67:0/862703737 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d413eed0 con 0x7fb2d40b74e0 2024-09-19T05:43:34.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2da227640 1 -- 172.21.15.67:0/862703737 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d41419a0 con 0x7fb2d40b74e0 2024-09-19T05:43:34.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2c9ffb640 1 -- 172.21.15.67:0/862703737 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb2cc01b070 con 0x7fb2d40b74e0 2024-09-19T05:43:34.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2c9ffb640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2b80678c0 0x7fb2b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2c9ffb640 1 -- 172.21.15.67:0/862703737 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7fb2cc0854d0 con 0x7fb2d40b74e0 2024-09-19T05:43:34.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.157+0000 7fb2d9225640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2b80678c0 0x7fb2b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.161+0000 7fb2d9225640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2b80678c0 0x7fb2b8069d80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4071cc0 tx=0x7fb2d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:34.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.161+0000 7fb2c9ffb640 1 -- 172.21.15.67:0/862703737 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb2cc055f10 con 0x7fb2d40b74e0 2024-09-19T05:43:34.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.321+0000 7fb2da227640 1 -- 172.21.15.67:0/862703737 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2d415b430 con 0x7fb2d40b74e0 2024-09-19T05:43:34.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.321+0000 7fb2c9ffb640 1 -- 172.21.15.67:0/862703737 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16976 (secure 0 0 0) 0x7fb2cc055810 con 0x7fb2d40b74e0 2024-09-19T05:43:34.321 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:34.322 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":132,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:43:00.111870+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:42:56.158238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-19T05:42:57.484042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:43:34.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 -- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2b80678c0 msgr2=0x7fb2b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2b80678c0 0x7fb2b8069d80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4071cc0 tx=0x7fb2d0008040 comp rx=0 tx=0).stop 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 -- 172.21.15.67:0/862703737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 msgr2=0x7fb2d40d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 0x7fb2d40d1260 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00c6d0 tx=0x7fb2cc00cb90 comp rx=0 tx=0).stop 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 -- 172.21.15.67:0/862703737 shutdown_connections 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d40b74e0 0x7fb2d40d1260 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2b80678c0 0x7fb2b8069d80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2d40b7100 0x7fb2d40b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 --2- 172.21.15.67:0/862703737 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2d40b54b0 0x7fb2d413cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 -- 172.21.15.67:0/862703737 >> 172.21.15.67:0/862703737 conn(0x7fb2d4067e00 msgr2=0x7fb2d415aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 -- 172.21.15.67:0/862703737 shutdown_connections 2024-09-19T05:43:34.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.325+0000 7fb2da227640 1 -- 172.21.15.67:0/862703737 wait complete. 2024-09-19T05:43:34.339 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:43:34.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:43:34.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10fe155640 1 Processor -- start 2024-09-19T05:43:34.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10fe155640 1 -- start start 2024-09-19T05:43:34.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10fe155640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f806dde0 0x7f10f80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10fe155640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f10f80b3510 0x7f10f806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10fe155640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f806e3c0 con 0x7f10f815c030 2024-09-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10fe155640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f10f806e6a0 con 0x7f10f80b3510 2024-09-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10fe155640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f10f806e980 con 0x7f10f806dde0 2024-09-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f77fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f10f815c030 0x7f10f815d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37696/0 (socket says 172.21.15.67:37696) 2024-09-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f77fe640 1 -- 172.21.15.67:0/3593407202 learned_addr learned my addr 172.21.15.67:0/3593407202 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f6ffd640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f806dde0 0x7f10f80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f7fff640 1 --2- 172.21.15.67:0/3593407202 >> v2:172.21.15.97:3300/0 conn(0x7f10f80b3510 0x7f10f806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811797995 0 0) 0x7f10f806e3c0 con 0x7f10f815c030 2024-09-19T05:43:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10e0003530 con 0x7f10f815c030 2024-09-19T05:43:34.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1950534136 0 0) 0x7f10e0003530 con 0x7f10f815c030 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f806dde0 msgr2=0x7f10f80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f806dde0 0x7f10f80b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 >> v2:172.21.15.97:3300/0 conn(0x7f10f80b3510 msgr2=0x7f10f806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 --2- 172.21.15.67:0/3593407202 >> v2:172.21.15.97:3300/0 conn(0x7f10f80b3510 0x7f10f806f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f806ec60 con 0x7f10f815c030 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f10ec001680 con 0x7f10f815c030 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 >> v1:172.21.15.67:6789/0 conn(0x7f10f815c030 legacy=0x7f10f815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10e00039c0 0x7f10e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10e0004810 0x7f10e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f806dde0 0x7f10e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f10f806e6a0 con 0x7f10e00039c0 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f10f806e980 con 0x7f10e0004810 2024-09-19T05:43:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f10e000ba00 con 0x7f10f806dde0 2024-09-19T05:43:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f77fe640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10e00039c0 0x7f10e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f7fff640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f806dde0 0x7f10e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f77fe640 1 -- 172.21.15.67:0/3593407202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f806dde0 msgr2=0x7f10e00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f77fe640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f806dde0 0x7f10e00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f77fe640 1 -- 172.21.15.67:0/3593407202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10e0004810 msgr2=0x7f10e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f77fe640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10e0004810 0x7f10e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.461+0000 7f10f77fe640 1 -- 172.21.15.67:0/3593407202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e0003530 con 0x7f10e00039c0 2024-09-19T05:43:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10f77fe640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10e00039c0 0x7f10e0003de0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00c210 tx=0x7f10ec01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4934c5baaa70e919 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec007d60 con 0x7f10e00039c0 2024-09-19T05:43:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ec0a9020 con 0x7f10e00039c0 2024-09-19T05:43:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10f67fc640 1 -- 172.21.15.67:0/3593407202 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec005b20 con 0x7f10e00039c0 2024-09-19T05:43:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 -- 172.21.15.67:0/3593407202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10e00039c0 msgr2=0x7f10e0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 --2- 172.21.15.67:0/3593407202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10e00039c0 0x7f10e0003de0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00c210 tx=0x7f10ec01cc10 comp rx=0 tx=0).stop 2024-09-19T05:43:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10f7fff640 1 -- 172.21.15.67:0/3593407202 reap_dead start 2024-09-19T05:43:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 -- 172.21.15.67:0/3593407202 shutdown_connections 2024-09-19T05:43:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 -- 172.21.15.67:0/3593407202 >> 172.21.15.67:0/3593407202 conn(0x7f10f80d0080 msgr2=0x7f10f80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 -- 172.21.15.67:0/3593407202 shutdown_connections 2024-09-19T05:43:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 -- 172.21.15.67:0/3593407202 wait complete. 2024-09-19T05:43:34.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 Processor -- start 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 -- start start 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10f81f5600 0x7f10f81f9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f815a5b0 0x7f10f8158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f81663e0 0x7f10f8166870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f10f81670d0 con 0x7f10f81663e0 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f10f815c620 con 0x7f10f81f5600 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.465+0000 7f10fe155640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f10f8167250 con 0x7f10f815a5b0 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f81663e0 0x7f10f8166870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f81663e0 0x7f10f8166870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45938/0 (socket says 172.21.15.67:45938) 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f7fff640 1 -- 172.21.15.67:0/3436661617 learned_addr learned my addr 172.21.15.67:0/3436661617 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f6ffd640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f815a5b0 0x7f10f8158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f77fe640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10f81f5600 0x7f10f81f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f7fff640 1 -- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f815a5b0 msgr2=0x7f10f8158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f7fff640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f815a5b0 0x7f10f8158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f7fff640 1 -- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10f81f5600 msgr2=0x7f10f81f9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f7fff640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10f81f5600 0x7f10f81f9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f7fff640 1 -- 172.21.15.67:0/3436661617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f815b090 con 0x7f10f81663e0 2024-09-19T05:43:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f7fff640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f81663e0 0x7f10f8166870 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f10f80afbf0 tx=0x7f10f00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10dffff640 1 -- 172.21.15.67:0/3436661617 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0007e40 con 0x7f10f81663e0 2024-09-19T05:43:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10dffff640 1 -- 172.21.15.67:0/3436661617 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f001b070 con 0x7f10f81663e0 2024-09-19T05:43:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10fe155640 1 -- 172.21.15.67:0/3436661617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f815b370 con 0x7f10f81663e0 2024-09-19T05:43:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10dffff640 1 -- 172.21.15.67:0/3436661617 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0011e40 con 0x7f10f81663e0 2024-09-19T05:43:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10fe155640 1 -- 172.21.15.67:0/3436661617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f81f59e0 con 0x7f10f81663e0 2024-09-19T05:43:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10fe155640 1 -- 172.21.15.67:0/3436661617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f806f460 con 0x7f10f81663e0 2024-09-19T05:43:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10dffff640 1 -- 172.21.15.67:0/3436661617 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10f00039a0 con 0x7f10f81663e0 2024-09-19T05:43:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10dffff640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10e40678f0 0x7f10e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10dffff640 1 -- 172.21.15.67:0/3436661617 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f10f0087160 con 0x7f10f81663e0 2024-09-19T05:43:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.469+0000 7f10f77fe640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10e40678f0 0x7f10e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.473+0000 7f10f77fe640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10e40678f0 0x7f10e4069db0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0aa000 tx=0x7f10ec000ff0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.473+0000 7f10dffff640 1 -- 172.21.15.67:0/3436661617 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f10f0025020 con 0x7f10f81663e0 2024-09-19T05:43:34.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.669+0000 7f10fe155640 1 -- 172.21.15.67:0/3436661617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10f815f880 con 0x7f10f81663e0 2024-09-19T05:43:34.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10dffff640 1 -- 172.21.15.67:0/3436661617 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5216 (secure 0 0 0) 0x7f10f0057bf0 con 0x7f10f81663e0 2024-09-19T05:43:34.671 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:34.671 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":91,"btime":"2024-09-19T05:43:02:159748+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/617137818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":617137818},{"type":"v1","addr":"172.21.15.97:6835","nonce":617137818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":6862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3709077281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3709077281},{"type":"v1","addr":"172.21.15.97:6837","nonce":3709077281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1889576066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1889576066},{"type":"v1","addr":"172.21.15.67:6833","nonce":1889576066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:42:58.500443+0000","modified":"2024-09-19T05:43:01.531911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/96000467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":96000467},{"type":"v1","addr":"172.21.15.67:6835","nonce":96000467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8136,"qdb_cluster":[8136]},"id":8}]} 2024-09-19T05:43:34.671 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 91 2024-09-19T05:43:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 -- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10e40678f0 msgr2=0x7f10e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10e40678f0 0x7f10e4069db0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0aa000 tx=0x7f10ec000ff0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 -- 172.21.15.67:0/3436661617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f81663e0 msgr2=0x7f10f8166870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f81663e0 0x7f10f8166870 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f10f80afbf0 tx=0x7f10f00115a0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 -- 172.21.15.67:0/3436661617 shutdown_connections 2024-09-19T05:43:34.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10f81663e0 0x7f10f8166870 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f10e40678f0 0x7f10e4069db0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10f815a5b0 0x7f10f8158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 --2- 172.21.15.67:0/3436661617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10f81f5600 0x7f10f81f9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 -- 172.21.15.67:0/3436661617 >> 172.21.15.67:0/3436661617 conn(0x7f10f80d0080 msgr2=0x7f10f80b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 -- 172.21.15.67:0/3436661617 shutdown_connections 2024-09-19T05:43:34.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.673+0000 7f10fe155640 1 -- 172.21.15.67:0/3436661617 wait complete. 2024-09-19T05:43:34.691 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:43:34.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f90067c4640 1 Processor -- start 2024-09-19T05:43:34.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f90067c4640 1 -- start start 2024-09-19T05:43:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f90067c4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f900015e640 0x7f90000b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f90067c4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90000ae0a0 0x7f90000b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f90067c4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90000b5b90 con 0x7f90000b2430 2024-09-19T05:43:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f90067c4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f90000b4780 con 0x7f900015e640 2024-09-19T05:43:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f90067c4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f90000b15f0 con 0x7f90000ae0a0 2024-09-19T05:43:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f9004d61640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f90000b2430 0x7f900006bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37710/0 (socket says 172.21.15.67:37710) 2024-09-19T05:43:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f9004d61640 1 -- 172.21.15.67:0/2758322368 learned_addr learned my addr 172.21.15.67:0/2758322368 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffffff640 1 --2- 172.21.15.67:0/2758322368 >> v2:172.21.15.97:3300/0 conn(0x7f900015e640 0x7f90000b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8fff7fe640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90000ae0a0 0x7f90000b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110066678 0 0) 0x7f8ff0001120 con 0x7f90000b2430 2024-09-19T05:43:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fe8003530 con 0x7f90000b2430 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4018833269 0 0) 0x7f8fe8003530 con 0x7f90000b2430 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90000ae0a0 msgr2=0x7f90000b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90000ae0a0 0x7f90000b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 >> v2:172.21.15.97:3300/0 conn(0x7f900015e640 msgr2=0x7f90000b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 --2- 172.21.15.67:0/2758322368 >> v2:172.21.15.97:3300/0 conn(0x7f900015e640 0x7f90000b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90000ae4e0 con 0x7f90000b2430 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f8ff0001850 con 0x7f90000b2430 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 >> v1:172.21.15.67:6789/0 conn(0x7f90000b2430 legacy=0x7f900006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 0x7f8fe8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe8004810 0x7f8fe8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90000ae0a0 0x7f8fe80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f90000b15f0 con 0x7f8fe80039c0 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe800ba00 con 0x7f8fe8004810 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe800bc00 con 0x7f90000ae0a0 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffffff640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 0x7f8fe8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f9004d61640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90000ae0a0 0x7f8fe80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8fff7fe640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe8004810 0x7f8fe8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffffff640 1 -- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90000ae0a0 msgr2=0x7f8fe80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffffff640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90000ae0a0 0x7f8fe80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffffff640 1 -- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe8004810 msgr2=0x7f8fe8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffffff640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe8004810 0x7f8fe8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8ffffff640 1 -- 172.21.15.67:0/2758322368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe8003530 con 0x7f8fe80039c0 2024-09-19T05:43:34.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.817+0000 7f8fff7fe640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe8004810 0x7f8fe8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f8ffffff640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 0x7f8fe8003de0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009fc0 tx=0x7f8ff801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736fcd5e946a7778 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80b2070 con 0x7f8fe80039c0 2024-09-19T05:43:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff80a5c80 con 0x7f8fe80039c0 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f8ffeffd640 1 -- 172.21.15.67:0/2758322368 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8009c10 con 0x7f8fe80039c0 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f90067c4640 1 -- 172.21.15.67:0/2758322368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 msgr2=0x7f8fe8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f90067c4640 1 --2- 172.21.15.67:0/2758322368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 0x7f8fe8003de0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009fc0 tx=0x7f8ff801cc90 comp rx=0 tx=0).stop 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f9004d61640 1 -- 172.21.15.67:0/2758322368 reap_dead start 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f90067c4640 1 -- 172.21.15.67:0/2758322368 shutdown_connections 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f90067c4640 1 -- 172.21.15.67:0/2758322368 >> 172.21.15.67:0/2758322368 conn(0x7f900009aa30 msgr2=0x7f90000b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f90067c4640 1 -- 172.21.15.67:0/2758322368 shutdown_connections 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f90067c4640 1 -- 172.21.15.67:0/2758322368 wait complete. 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.821+0000 7f90067c4640 1 Processor -- start 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f90067c4640 1 -- start start 2024-09-19T05:43:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f90067c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 0x7f9000164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f90067c4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9000156df0 0x7f9000157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f90067c4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9000157b00 0x7f9000157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f90067c4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f90000b0910 con 0x7f8fe80039c0 2024-09-19T05:43:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f90067c4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f90000b0790 con 0x7f9000157b00 2024-09-19T05:43:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f90067c4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f90000b40c0 con 0x7f9000156df0 2024-09-19T05:43:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 0x7f9000164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 0x7f9000164680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45956/0 (socket says 172.21.15.67:45956) 2024-09-19T05:43:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffffff640 1 -- 172.21.15.67:0/598607784 learned_addr learned my addr 172.21.15.67:0/598607784 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f9004d61640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9000157b00 0x7f9000157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8fff7fe640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9000156df0 0x7f9000157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffffff640 1 -- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9000156df0 msgr2=0x7f9000157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffffff640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9000156df0 0x7f9000157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffffff640 1 -- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9000157b00 msgr2=0x7f9000157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffffff640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9000157b00 0x7f9000157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffffff640 1 -- 172.21.15.67:0/598607784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90001fac80 con 0x7f8fe80039c0 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffffff640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 0x7f9000164680 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80987a0 tx=0x7f8ff8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffcff9640 1 -- 172.21.15.67:0/598607784 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80ba070 con 0x7f8fe80039c0 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffcff9640 1 -- 172.21.15.67:0/598607784 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff80ada20 con 0x7f8fe80039c0 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f90067c4640 1 -- 172.21.15.67:0/598607784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90001faf60 con 0x7f8fe80039c0 2024-09-19T05:43:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffcff9640 1 -- 172.21.15.67:0/598607784 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80b2040 con 0x7f8fe80039c0 2024-09-19T05:43:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f90067c4640 1 -- 172.21.15.67:0/598607784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90001584a0 con 0x7f8fe80039c0 2024-09-19T05:43:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f90067c4640 1 -- 172.21.15.67:0/598607784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90000b6050 con 0x7f8fe80039c0 2024-09-19T05:43:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffcff9640 1 -- 172.21.15.67:0/598607784 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ff80b6410 con 0x7f8fe80039c0 2024-09-19T05:43:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffcff9640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fec0678c0 0x7f8fec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8ffcff9640 1 -- 172.21.15.67:0/598607784 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f8ff8120450 con 0x7f8fe80039c0 2024-09-19T05:43:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.825+0000 7f8fff7fe640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fec0678c0 0x7f8fec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.829+0000 7f8fff7fe640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fec0678c0 0x7f8fec069d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f90000b6540 tx=0x7f8ff4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:34.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:34.829+0000 7f8ffcff9640 1 -- 172.21.15.67:0/598607784 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8ff80169d0 con 0x7f8fe80039c0 2024-09-19T05:43:35.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.029+0000 7f90067c4640 1 -- 172.21.15.67:0/598607784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9000156450 con 0x7f8fe80039c0 2024-09-19T05:43:35.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.029+0000 7f8ffcff9640 1 -- 172.21.15.67:0/598607784 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5216 (secure 0 0 0) 0x7f8ff80f0840 con 0x7f8fe80039c0 2024-09-19T05:43:35.030 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:35.030 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":91,"btime":"2024-09-19T05:43:02:159748+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/617137818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":617137818},{"type":"v1","addr":"172.21.15.97:6835","nonce":617137818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":6862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3709077281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3709077281},{"type":"v1","addr":"172.21.15.97:6837","nonce":3709077281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1889576066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1889576066},{"type":"v1","addr":"172.21.15.67:6833","nonce":1889576066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:42:58.500443+0000","modified":"2024-09-19T05:43:01.531911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/96000467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":96000467},{"type":"v1","addr":"172.21.15.67:6835","nonce":96000467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8136,"qdb_cluster":[8136]},"id":8}]} 2024-09-19T05:43:35.030 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 91 2024-09-19T05:43:35.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 -- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fec0678c0 msgr2=0x7f8fec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fec0678c0 0x7f8fec069d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f90000b6540 tx=0x7f8ff4008040 comp rx=0 tx=0).stop 2024-09-19T05:43:35.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 -- 172.21.15.67:0/598607784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 msgr2=0x7f9000164680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 0x7f9000164680 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80987a0 tx=0x7f8ff8009750 comp rx=0 tx=0).stop 2024-09-19T05:43:35.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 -- 172.21.15.67:0/598607784 shutdown_connections 2024-09-19T05:43:35.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9000157b00 0x7f9000157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fec0678c0 0x7f8fec069d80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9000156df0 0x7f9000157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 --2- 172.21.15.67:0/598607784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fe80039c0 0x7f9000164680 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 -- 172.21.15.67:0/598607784 >> 172.21.15.67:0/598607784 conn(0x7f900009aa30 msgr2=0x7f90001685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:35.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 -- 172.21.15.67:0/598607784 shutdown_connections 2024-09-19T05:43:35.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.033+0000 7f90067c4640 1 -- 172.21.15.67:0/598607784 wait complete. 2024-09-19T05:43:35.049 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:43:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683f69d640 1 Processor -- start 2024-09-19T05:43:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683f69d640 1 -- start start 2024-09-19T05:43:35.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683f69d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f683809aa30 0x7f6838070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683f69d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 0x7f6838162050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683f69d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68380d1270 con 0x7f6838070cc0 2024-09-19T05:43:35.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683f69d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f68380d1510 con 0x7f683809aa30 2024-09-19T05:43:35.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683f69d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6838071340 con 0x7f683809b520 2024-09-19T05:43:35.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683cc38640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6838070cc0 0x7f683809ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37724/0 (socket says 172.21.15.67:37724) 2024-09-19T05:43:35.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683cc38640 1 -- 172.21.15.67:0/2915176312 learned_addr learned my addr 172.21.15.67:0/2915176312 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:35.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683d439640 1 --2- 172.21.15.67:0/2915176312 >> v2:172.21.15.67:3300/0 conn(0x7f683809aa30 0x7f6838070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683dc3a640 1 --2- 172.21.15.67:0/2915176312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 0x7f6838162050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f682ffff640 1 -- 172.21.15.67:0/2915176312 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640406610 0 0) 0x7f68380d1270 con 0x7f6838070cc0 2024-09-19T05:43:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f682ffff640 1 -- 172.21.15.67:0/2915176312 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6824003530 con 0x7f6838070cc0 2024-09-19T05:43:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683d439640 1 -- 172.21.15.67:0/2915176312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 msgr2=0x7f6838162050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683d439640 1 --2- 172.21.15.67:0/2915176312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 0x7f6838162050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683d439640 1 -- 172.21.15.67:0/2915176312 >> v1:172.21.15.67:6789/0 conn(0x7f6838070cc0 legacy=0x7f683809ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.169+0000 7f683d439640 1 -- 172.21.15.67:0/2915176312 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6838071620 con 0x7f683809aa30 2024-09-19T05:43:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683d439640 1 --2- 172.21.15.67:0/2915176312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f683809aa30 0x7f6838070780 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f68280097c0 tx=0x7f682801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fb2f0ed9b30e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f682ffff640 1 -- 172.21.15.67:0/2915176312 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68280b0070 con 0x7f683809aa30 2024-09-19T05:43:35.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f682ffff640 1 -- 172.21.15.67:0/2915176312 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68280ab600 con 0x7f683809aa30 2024-09-19T05:43:35.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f682ffff640 1 -- 172.21.15.67:0/2915176312 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68280ab9d0 con 0x7f683809aa30 2024-09-19T05:43:35.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 -- 172.21.15.67:0/2915176312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f683809aa30 msgr2=0x7f6838070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 --2- 172.21.15.67:0/2915176312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f683809aa30 0x7f6838070780 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f68280097c0 tx=0x7f682801c410 comp rx=0 tx=0).stop 2024-09-19T05:43:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 -- 172.21.15.67:0/2915176312 shutdown_connections 2024-09-19T05:43:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 --2- 172.21.15.67:0/2915176312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 0x7f6838162050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 --2- 172.21.15.67:0/2915176312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f683809aa30 0x7f6838070780 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 -- 172.21.15.67:0/2915176312 >> 172.21.15.67:0/2915176312 conn(0x7f68380d22b0 msgr2=0x7f68380d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 -- 172.21.15.67:0/2915176312 shutdown_connections 2024-09-19T05:43:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 -- 172.21.15.67:0/2915176312 wait complete. 2024-09-19T05:43:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 Processor -- start 2024-09-19T05:43:35.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 -- start start 2024-09-19T05:43:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6838070cc0 0x7f68380b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f683809aa30 0x7f68381582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 0x7f6838158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6838162f20 con 0x7f6838070cc0 2024-09-19T05:43:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6838162da0 con 0x7f683809aa30 2024-09-19T05:43:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.173+0000 7f683f69d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f68381630a0 con 0x7f683809b520 2024-09-19T05:43:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683d439640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6838070cc0 0x7f68380b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683d439640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6838070cc0 0x7f68380b6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45968/0 (socket says 172.21.15.67:45968) 2024-09-19T05:43:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683d439640 1 -- 172.21.15.67:0/4236723387 learned_addr learned my addr 172.21.15.67:0/4236723387 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:35.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683dc3a640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 0x7f6838158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683cc38640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f683809aa30 0x7f68381582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683d439640 1 -- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 msgr2=0x7f6838158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683d439640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 0x7f6838158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683d439640 1 -- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f683809aa30 msgr2=0x7f68381582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683d439640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f683809aa30 0x7f68381582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683d439640 1 -- 172.21.15.67:0/4236723387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68380b7c30 con 0x7f6838070cc0 2024-09-19T05:43:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683dc3a640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 0x7f6838158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:35.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683d439640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6838070cc0 0x7f68380b6500 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f682801a040 tx=0x7f682801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f682dffb640 1 -- 172.21.15.67:0/4236723387 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68280b0050 con 0x7f6838070cc0 2024-09-19T05:43:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f682dffb640 1 -- 172.21.15.67:0/4236723387 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68280bc070 con 0x7f6838070cc0 2024-09-19T05:43:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f682dffb640 1 -- 172.21.15.67:0/4236723387 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828006e20 con 0x7f6838070cc0 2024-09-19T05:43:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683f69d640 1 -- 172.21.15.67:0/4236723387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68380b7f10 con 0x7f6838070cc0 2024-09-19T05:43:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683f69d640 1 -- 172.21.15.67:0/4236723387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68380b6a40 con 0x7f6838070cc0 2024-09-19T05:43:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683f69d640 1 -- 172.21.15.67:0/4236723387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6838070780 con 0x7f6838070cc0 2024-09-19T05:43:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f682dffb640 1 -- 172.21.15.67:0/4236723387 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f68280b5850 con 0x7f6838070cc0 2024-09-19T05:43:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f682dffb640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f681c0678c0 0x7f681c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f682dffb640 1 -- 172.21.15.67:0/4236723387 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f68281205f0 con 0x7f6838070cc0 2024-09-19T05:43:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.177+0000 7f683cc38640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f681c0678c0 0x7f681c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.181+0000 7f683cc38640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f681c0678c0 0x7f681c069d80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f68380b37b0 tx=0x7f6834009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:35.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.181+0000 7f682dffb640 1 -- 172.21.15.67:0/4236723387 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6828016090 con 0x7f6838070cc0 2024-09-19T05:43:35.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.345+0000 7f683f69d640 1 -- 172.21.15.67:0/4236723387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68380c8080 con 0x7f6838070cc0 2024-09-19T05:43:35.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.345+0000 7f682dffb640 1 -- 172.21.15.67:0/4236723387 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16976 (secure 0 0 0) 0x7f68280f10d0 con 0x7f6838070cc0 2024-09-19T05:43:35.346 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:35.346 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":132,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:43:00.111870+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:42:56.158238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-19T05:42:57.484042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:43:35.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 -- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f681c0678c0 msgr2=0x7f681c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f681c0678c0 0x7f681c069d80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f68380b37b0 tx=0x7f6834009040 comp rx=0 tx=0).stop 2024-09-19T05:43:35.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 -- 172.21.15.67:0/4236723387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6838070cc0 msgr2=0x7f68380b6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6838070cc0 0x7f68380b6500 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f682801a040 tx=0x7f682801ac50 comp rx=0 tx=0).stop 2024-09-19T05:43:35.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 -- 172.21.15.67:0/4236723387 shutdown_connections 2024-09-19T05:43:35.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f681c0678c0 0x7f681c069d80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f683809b520 0x7f6838158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f683809aa30 0x7f68381582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 --2- 172.21.15.67:0/4236723387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6838070cc0 0x7f68380b6500 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 -- 172.21.15.67:0/4236723387 >> 172.21.15.67:0/4236723387 conn(0x7f68380d22b0 msgr2=0x7f683806ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:35.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 -- 172.21.15.67:0/4236723387 shutdown_connections 2024-09-19T05:43:35.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.349+0000 7f683f69d640 1 -- 172.21.15.67:0/4236723387 wait complete. 2024-09-19T05:43:35.366 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:43:35.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.489+0000 7fafff3e5640 1 Processor -- start 2024-09-19T05:43:35.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.489+0000 7fafff3e5640 1 -- start start 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.489+0000 7fafff3e5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faff815e640 0x7faff80b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.489+0000 7fafff3e5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faff80b6cf0 0x7faff806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.489+0000 7fafff3e5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff80b5b90 con 0x7faff80ae0a0 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.489+0000 7fafff3e5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7faff80b4780 con 0x7faff815e640 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.489+0000 7fafff3e5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7faff80ae510 con 0x7faff80b6cf0 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.489+0000 7faffd181640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faff815e640 0x7faff80b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.489+0000 7faffd181640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faff815e640 0x7faff80b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45974/0 (socket says 172.21.15.67:45974) 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.489+0000 7faffd181640 1 -- 172.21.15.67:0/1079653060 learned_addr learned my addr 172.21.15.67:0/1079653060 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7faffd181640 1 -- 172.21.15.67:0/1079653060 >> v2:172.21.15.97:3300/0 conn(0x7faff80b6cf0 msgr2=0x7faff806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7faffd982640 1 --2- 172.21.15.67:0/1079653060 >> v2:172.21.15.97:3300/0 conn(0x7faff80b6cf0 0x7faff806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7faffd181640 1 --2- 172.21.15.67:0/1079653060 >> v2:172.21.15.97:3300/0 conn(0x7faff80b6cf0 0x7faff806bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7faffd181640 1 -- 172.21.15.67:0/1079653060 >> v1:172.21.15.97:6789/0 conn(0x7faff80ae0a0 legacy=0x7faff80b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:35.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7faffd181640 1 -- 172.21.15.67:0/1079653060 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff80b15f0 con 0x7faff815e640 2024-09-19T05:43:35.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7faffd982640 1 --2- 172.21.15.67:0/1079653060 >> v2:172.21.15.97:3300/0 conn(0x7faff80b6cf0 0x7faff806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:35.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7faffd181640 1 --2- 172.21.15.67:0/1079653060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff815e640 0x7faff80b6050 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7faff80d21f0 tx=0x7faff401c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf618f6c3ec6a64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:35.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafeffff640 1 -- 172.21.15.67:0/1079653060 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff40ac020 con 0x7faff815e640 2024-09-19T05:43:35.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafeffff640 1 -- 172.21.15.67:0/1079653060 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff40a6460 con 0x7faff815e640 2024-09-19T05:43:35.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafeffff640 1 -- 172.21.15.67:0/1079653060 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff40a6830 con 0x7faff815e640 2024-09-19T05:43:35.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafff3e5640 1 -- 172.21.15.67:0/1079653060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff815e640 msgr2=0x7faff80b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafff3e5640 1 --2- 172.21.15.67:0/1079653060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff815e640 0x7faff80b6050 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7faff80d21f0 tx=0x7faff401c680 comp rx=0 tx=0).stop 2024-09-19T05:43:35.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafff3e5640 1 -- 172.21.15.67:0/1079653060 shutdown_connections 2024-09-19T05:43:35.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafff3e5640 1 --2- 172.21.15.67:0/1079653060 >> v2:172.21.15.97:3300/0 conn(0x7faff80b6cf0 0x7faff806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafff3e5640 1 --2- 172.21.15.67:0/1079653060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff815e640 0x7faff80b6050 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafff3e5640 1 -- 172.21.15.67:0/1079653060 >> 172.21.15.67:0/1079653060 conn(0x7faff809aa30 msgr2=0x7faff80b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:35.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafff3e5640 1 -- 172.21.15.67:0/1079653060 shutdown_connections 2024-09-19T05:43:35.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.493+0000 7fafff3e5640 1 -- 172.21.15.67:0/1079653060 wait complete. 2024-09-19T05:43:35.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafff3e5640 1 Processor -- start 2024-09-19T05:43:35.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafff3e5640 1 -- start start 2024-09-19T05:43:35.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafff3e5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faff80ae0a0 0x7faff815b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafff3e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff80b6cf0 0x7faff80ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafff3e5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faff815e640 0x7faff809cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafff3e5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faff80b2b40 con 0x7faff80b6cf0 2024-09-19T05:43:35.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafff3e5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faff80b7100 con 0x7faff815e640 2024-09-19T05:43:35.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafff3e5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faff80b0790 con 0x7faff80ae0a0 2024-09-19T05:43:35.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffc980640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff80b6cf0 0x7faff80ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffc980640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff80b6cf0 0x7faff80ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45980/0 (socket says 172.21.15.67:45980) 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffc980640 1 -- 172.21.15.67:0/1035359700 learned_addr learned my addr 172.21.15.67:0/1035359700 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffd181640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faff80ae0a0 0x7faff815b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffd982640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faff815e640 0x7faff809cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffc980640 1 -- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faff80ae0a0 msgr2=0x7faff815b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffc980640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faff80ae0a0 0x7faff815b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffc980640 1 -- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faff815e640 msgr2=0x7faff809cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffc980640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faff815e640 0x7faff809cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffc980640 1 -- 172.21.15.67:0/1035359700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff80cafd0 con 0x7faff80b6cf0 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7faffc980640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff80b6cf0 0x7faff80ccad0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fafe800b440 tx=0x7fafe800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafedffb640 1 -- 172.21.15.67:0/1035359700 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe8015020 con 0x7faff80b6cf0 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafedffb640 1 -- 172.21.15.67:0/1035359700 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe8011890 con 0x7faff80b6cf0 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafedffb640 1 -- 172.21.15.67:0/1035359700 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe8011c80 con 0x7faff80b6cf0 2024-09-19T05:43:35.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafff3e5640 1 -- 172.21.15.67:0/1035359700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff80cb2b0 con 0x7faff80b6cf0 2024-09-19T05:43:35.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.497+0000 7fafff3e5640 1 -- 172.21.15.67:0/1035359700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff80cb870 con 0x7faff80b6cf0 2024-09-19T05:43:35.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.501+0000 7fafff3e5640 1 -- 172.21.15.67:0/1035359700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff80b40c0 con 0x7faff80b6cf0 2024-09-19T05:43:35.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.501+0000 7fafedffb640 1 -- 172.21.15.67:0/1035359700 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fafe8018020 con 0x7faff80b6cf0 2024-09-19T05:43:35.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.501+0000 7fafedffb640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafdc0678f0 0x7fafdc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.501+0000 7fafedffb640 1 -- 172.21.15.67:0/1035359700 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7fafe8085c80 con 0x7faff80b6cf0 2024-09-19T05:43:35.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.501+0000 7faffd181640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafdc0678f0 0x7fafdc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.501+0000 7faffd181640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafdc0678f0 0x7fafdc069db0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7faff40ad000 tx=0x7faff40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:35.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.505+0000 7fafedffb640 1 -- 172.21.15.67:0/1035359700 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fafe801f030 con 0x7faff80b6cf0 2024-09-19T05:43:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.697+0000 7fafff3e5640 1 -- 172.21.15.67:0/1035359700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faff80b22a0 con 0x7faff80b6cf0 2024-09-19T05:43:35.697 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:43:35.697+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:43:35.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.701+0000 7fafedffb640 1 -- 172.21.15.67:0/1035359700 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v92) ==== 161+0+0 (secure 0 0 0) 0x7fafe800d040 con 0x7faff80b6cf0 2024-09-19T05:43:35.700 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:43:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 -- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafdc0678f0 msgr2=0x7fafdc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafdc0678f0 0x7fafdc069db0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7faff40ad000 tx=0x7faff40a7000 comp rx=0 tx=0).stop 2024-09-19T05:43:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 -- 172.21.15.67:0/1035359700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff80b6cf0 msgr2=0x7faff80ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff80b6cf0 0x7faff80ccad0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fafe800b440 tx=0x7fafe800b900 comp rx=0 tx=0).stop 2024-09-19T05:43:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 -- 172.21.15.67:0/1035359700 shutdown_connections 2024-09-19T05:43:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faff815e640 0x7faff809cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faff80b6cf0 0x7faff80ccad0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fafdc0678f0 0x7fafdc069db0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 --2- 172.21.15.67:0/1035359700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faff80ae0a0 0x7faff815b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 -- 172.21.15.67:0/1035359700 >> 172.21.15.67:0/1035359700 conn(0x7faff809aa30 msgr2=0x7faff806fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 -- 172.21.15.67:0/1035359700 shutdown_connections 2024-09-19T05:43:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.705+0000 7fafff3e5640 1 -- 172.21.15.67:0/1035359700 wait complete. 2024-09-19T05:43:35.721 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:43:35.753 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:43:35.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264fe83640 1 Processor -- start 2024-09-19T05:43:35.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264fe83640 1 -- start start 2024-09-19T05:43:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264fe83640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2648159c60 0x7f26480ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264fe83640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f264806ffd0 0x7f26480aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264fe83640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f264815a040 con 0x7f26480b3150 2024-09-19T05:43:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264fe83640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f264815d460 con 0x7f2648159c60 2024-09-19T05:43:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264fe83640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f264815c850 con 0x7f264806ffd0 2024-09-19T05:43:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264dc1f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2648159c60 0x7f26480ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264dc1f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2648159c60 0x7f26480ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46000/0 (socket says 172.21.15.67:46000) 2024-09-19T05:43:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264dc1f640 1 -- 172.21.15.67:0/1916436092 learned_addr learned my addr 172.21.15.67:0/1916436092 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264d41e640 1 --2- 172.21.15.67:0/1916436092 >> v2:172.21.15.97:3300/0 conn(0x7f264806ffd0 0x7f26480aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264dc1f640 1 -- 172.21.15.67:0/1916436092 >> v2:172.21.15.97:3300/0 conn(0x7f264806ffd0 msgr2=0x7f26480aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264dc1f640 1 --2- 172.21.15.67:0/1916436092 >> v2:172.21.15.97:3300/0 conn(0x7f264806ffd0 0x7f26480aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264dc1f640 1 -- 172.21.15.67:0/1916436092 >> v1:172.21.15.97:6789/0 conn(0x7f26480b3150 legacy=0x7f264815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.837+0000 7f264dc1f640 1 -- 172.21.15.67:0/1916436092 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264815cb30 con 0x7f2648159c60 2024-09-19T05:43:35.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264dc1f640 1 --2- 172.21.15.67:0/1916436092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2648159c60 0x7f26480ad130 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f26480adba0 tx=0x7f264401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7233906e65d208d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:35.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264cc1d640 1 -- 172.21.15.67:0/1916436092 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26440aa610 con 0x7f2648159c60 2024-09-19T05:43:35.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264cc1d640 1 -- 172.21.15.67:0/1916436092 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26440af070 con 0x7f2648159c60 2024-09-19T05:43:35.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264cc1d640 1 -- 172.21.15.67:0/1916436092 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26440aa9d0 con 0x7f2648159c60 2024-09-19T05:43:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264fe83640 1 -- 172.21.15.67:0/1916436092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2648159c60 msgr2=0x7f26480ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264fe83640 1 --2- 172.21.15.67:0/1916436092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2648159c60 0x7f26480ad130 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f26480adba0 tx=0x7f264401c4b0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264fe83640 1 -- 172.21.15.67:0/1916436092 shutdown_connections 2024-09-19T05:43:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264fe83640 1 --2- 172.21.15.67:0/1916436092 >> v2:172.21.15.97:3300/0 conn(0x7f264806ffd0 0x7f26480aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264fe83640 1 --2- 172.21.15.67:0/1916436092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2648159c60 0x7f26480ad130 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264fe83640 1 -- 172.21.15.67:0/1916436092 >> 172.21.15.67:0/1916436092 conn(0x7f26480b1e50 msgr2=0x7f26480b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:35.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264fe83640 1 -- 172.21.15.67:0/1916436092 shutdown_connections 2024-09-19T05:43:35.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264fe83640 1 -- 172.21.15.67:0/1916436092 wait complete. 2024-09-19T05:43:35.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264fe83640 1 Processor -- start 2024-09-19T05:43:35.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.841+0000 7f264fe83640 1 -- start start 2024-09-19T05:43:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264fe83640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f264806ffd0 0x7f2648146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264fe83640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26480b3150 0x7f26481f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264fe83640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2648159c60 0x7f2648156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264fe83640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f26480ad7f0 con 0x7f264806ffd0 2024-09-19T05:43:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264fe83640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f26480ad670 con 0x7f2648159c60 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264fe83640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2648168e30 con 0x7f26480b3150 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264dc1f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f264806ffd0 0x7f2648146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264dc1f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f264806ffd0 0x7f2648146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46014/0 (socket says 172.21.15.67:46014) 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264dc1f640 1 -- 172.21.15.67:0/3162412524 learned_addr learned my addr 172.21.15.67:0/3162412524 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264d41e640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26480b3150 0x7f26481f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264e420640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2648159c60 0x7f2648156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264dc1f640 1 -- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26480b3150 msgr2=0x7f26481f7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264dc1f640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26480b3150 0x7f26481f7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264dc1f640 1 -- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2648159c60 msgr2=0x7f2648156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264dc1f640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2648159c60 0x7f2648156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264dc1f640 1 -- 172.21.15.67:0/3162412524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26480722f0 con 0x7f264806ffd0 2024-09-19T05:43:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264e420640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2648159c60 0x7f2648156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:35.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264dc1f640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f264806ffd0 0x7f2648146450 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f26440ac040 tx=0x7f264401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:35.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f263e7fc640 1 -- 172.21.15.67:0/3162412524 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26440bd5f0 con 0x7f264806ffd0 2024-09-19T05:43:35.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f263e7fc640 1 -- 172.21.15.67:0/3162412524 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26440bd790 con 0x7f264806ffd0 2024-09-19T05:43:35.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264fe83640 1 -- 172.21.15.67:0/3162412524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26480725d0 con 0x7f264806ffd0 2024-09-19T05:43:35.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f263e7fc640 1 -- 172.21.15.67:0/3162412524 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26440bdb60 con 0x7f264806ffd0 2024-09-19T05:43:35.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264fe83640 1 -- 172.21.15.67:0/3162412524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2648072b90 con 0x7f264806ffd0 2024-09-19T05:43:35.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f264fe83640 1 -- 172.21.15.67:0/3162412524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26480aec90 con 0x7f264806ffd0 2024-09-19T05:43:35.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f263e7fc640 1 -- 172.21.15.67:0/3162412524 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f26440b33f0 con 0x7f264806ffd0 2024-09-19T05:43:35.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f263e7fc640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f262c0678c0 0x7f262c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:35.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.845+0000 7f263e7fc640 1 -- 172.21.15.67:0/3162412524 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6187+0+0 (secure 0 0 0) 0x7f2644120bc0 con 0x7f264806ffd0 2024-09-19T05:43:35.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.849+0000 7f264d41e640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f262c0678c0 0x7f262c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:35.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.849+0000 7f264d41e640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f262c0678c0 0x7f262c069d80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2648153b70 tx=0x7f2638008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:35.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:35.853+0000 7f263e7fc640 1 -- 172.21.15.67:0/3162412524 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f26440c3060 con 0x7f264806ffd0 2024-09-19T05:43:36.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.049+0000 7f264fe83640 1 -- 172.21.15.67:0/3162412524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2648146990 con 0x7f264806ffd0 2024-09-19T05:43:36.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.701+0000 7f263e7fc640 1 -- 172.21.15.67:0/3162412524 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v93) ==== 104+0+0 (secure 0 0 0) 0x7f26440a7070 con 0x7f264806ffd0 2024-09-19T05:43:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 -- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f262c0678c0 msgr2=0x7f262c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f262c0678c0 0x7f262c069d80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2648153b70 tx=0x7f2638008040 comp rx=0 tx=0).stop 2024-09-19T05:43:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 -- 172.21.15.67:0/3162412524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f264806ffd0 msgr2=0x7f2648146450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f264806ffd0 0x7f2648146450 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f26440ac040 tx=0x7f264401acf0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 -- 172.21.15.67:0/3162412524 shutdown_connections 2024-09-19T05:43:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2648159c60 0x7f2648156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f262c0678c0 0x7f262c069d80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26480b3150 0x7f26481f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 --2- 172.21.15.67:0/3162412524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f264806ffd0 0x7f2648146450 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 -- 172.21.15.67:0/3162412524 >> 172.21.15.67:0/3162412524 conn(0x7f26480b1e50 msgr2=0x7f2648166120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 -- 172.21.15.67:0/3162412524 shutdown_connections 2024-09-19T05:43:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.709+0000 7f264fe83640 1 -- 172.21.15.67:0/3162412524 wait complete. 2024-09-19T05:43:36.731 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:43:36.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.909+0000 7f99289cf640 1 Processor -- start 2024-09-19T05:43:36.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.909+0000 7f99289cf640 1 -- start start 2024-09-19T05:43:36.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f99289cf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f99240d0520 0x7f99240d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:36.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f99289cf640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99240b4e00 con 0x7f99240738b0 2024-09-19T05:43:36.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f99289cf640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99240b3500 con 0x7f99240addf0 2024-09-19T05:43:36.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f99289cf640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f99240d0ed0 con 0x7f99240d0520 2024-09-19T05:43:36.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992259c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f99240738b0 0x7f992415c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33766/0 (socket says 172.21.15.67:33766) 2024-09-19T05:43:36.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992259c640 1 -- 172.21.15.67:0/1320919252 learned_addr learned my addr 172.21.15.67:0/1320919252 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:36.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f9921d9b640 1 --2- 172.21.15.67:0/1320919252 >> v2:172.21.15.97:3300/0 conn(0x7f99240d0520 0x7f99240d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:36.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598955602 0 0) 0x7f99240b4e00 con 0x7f99240738b0 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f990c005740 con 0x7f99240738b0 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2620748183 0 0) 0x7f990c005740 con 0x7f99240738b0 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 >> v2:172.21.15.97:3300/0 conn(0x7f99240d0520 msgr2=0x7f99240d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 --2- 172.21.15.67:0/1320919252 >> v2:172.21.15.97:3300/0 conn(0x7f99240d0520 0x7f99240d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 >> v1:172.21.15.97:6789/0 conn(0x7f99240addf0 legacy=0x7f99240ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99240b37e0 con 0x7f99240738b0 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9914001680 con 0x7f99240738b0 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 >> v1:172.21.15.67:6789/0 conn(0x7f99240738b0 legacy=0x7f992415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f990c005bd0 0x7f990c005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f990c006a20 0x7f990c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f990c0073e0 0x7f990c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f99240d0ed0 con 0x7f990c006a20 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f990c00e380 con 0x7f990c0073e0 2024-09-19T05:43:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f990c00e580 con 0x7f990c005bd0 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f9921d9b640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f990c006a20 0x7f990c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f9922d9d640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f990c0073e0 0x7f990c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992259c640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f990c005bd0 0x7f990c005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f9921d9b640 1 -- 172.21.15.67:0/1320919252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f990c005bd0 msgr2=0x7f990c005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f9921d9b640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f990c005bd0 0x7f990c005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f9921d9b640 1 -- 172.21.15.67:0/1320919252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f990c0073e0 msgr2=0x7f990c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f9921d9b640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f990c0073e0 0x7f990c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f9921d9b640 1 -- 172.21.15.67:0/1320919252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c005740 con 0x7f990c006a20 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f9922d9d640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f990c0073e0 0x7f990c00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f9922d9d640 1 -- 172.21.15.67:0/1320919252 reap_dead start 2024-09-19T05:43:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.913+0000 7f992259c640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f990c005bd0 0x7f990c005ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f9921d9b640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f990c006a20 0x7f990c006ea0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f9918009ae0 tx=0x7f991801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ad409f4226b3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99180096b0 con 0x7f990c006a20 2024-09-19T05:43:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99180a6450 con 0x7f990c006a20 2024-09-19T05:43:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f992159a640 1 -- 172.21.15.67:0/1320919252 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99180a6840 con 0x7f990c006a20 2024-09-19T05:43:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 -- 172.21.15.67:0/1320919252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f990c006a20 msgr2=0x7f990c006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f990c006a20 0x7f990c006ea0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f9918009ae0 tx=0x7f991801ca70 comp rx=0 tx=0).stop 2024-09-19T05:43:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 -- 172.21.15.67:0/1320919252 shutdown_connections 2024-09-19T05:43:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 --2- 172.21.15.67:0/1320919252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f990c006a20 0x7f990c006ea0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 -- 172.21.15.67:0/1320919252 >> 172.21.15.67:0/1320919252 conn(0x7f992406c0c0 msgr2=0x7f992406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 -- 172.21.15.67:0/1320919252 shutdown_connections 2024-09-19T05:43:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 -- 172.21.15.67:0/1320919252 wait complete. 2024-09-19T05:43:36.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 Processor -- start 2024-09-19T05:43:36.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 -- start start 2024-09-19T05:43:36.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f990c006a20 0x7f9924153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:36.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f99240cd1a0 0x7f99240ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:36.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f992409d7d0 0x7f992409dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9924073c90 con 0x7f992409d7d0 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f992415c490 con 0x7f990c006a20 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f99289cf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f992415c610 con 0x7f99240cd1a0 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f9922d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f992409d7d0 0x7f992409dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f9922d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f992409d7d0 0x7f992409dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43068/0 (socket says 172.21.15.67:43068) 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f9922d9d640 1 -- 172.21.15.67:0/1003842003 learned_addr learned my addr 172.21.15.67:0/1003842003 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f9921d9b640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f99240cd1a0 0x7f99240ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.917+0000 7f992259c640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f990c006a20 0x7f9924153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9922d9d640 1 -- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f99240cd1a0 msgr2=0x7f99240ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9922d9d640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f99240cd1a0 0x7f99240ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9922d9d640 1 -- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f990c006a20 msgr2=0x7f9924153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9922d9d640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f990c006a20 0x7f9924153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9922d9d640 1 -- 172.21.15.67:0/1003842003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9924156e70 con 0x7f992409d7d0 2024-09-19T05:43:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9921d9b640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f99240cd1a0 0x7f99240ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9922d9d640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f992409d7d0 0x7f992409dc50 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f99240cfb80 tx=0x7f991c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9912ffd640 1 -- 172.21.15.67:0/1003842003 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c003980 con 0x7f992409d7d0 2024-09-19T05:43:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9912ffd640 1 -- 172.21.15.67:0/1003842003 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991c018070 con 0x7f992409d7d0 2024-09-19T05:43:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f99289cf640 1 -- 172.21.15.67:0/1003842003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99240cd710 con 0x7f992409d7d0 2024-09-19T05:43:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9912ffd640 1 -- 172.21.15.67:0/1003842003 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c003d40 con 0x7f992409d7d0 2024-09-19T05:43:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f99289cf640 1 -- 172.21.15.67:0/1003842003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99240cdcd0 con 0x7f992409d7d0 2024-09-19T05:43:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f99289cf640 1 -- 172.21.15.67:0/1003842003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99240b31d0 con 0x7f992409d7d0 2024-09-19T05:43:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9912ffd640 1 -- 172.21.15.67:0/1003842003 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f991c0050d0 con 0x7f992409d7d0 2024-09-19T05:43:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9912ffd640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f99040678f0 0x7f9904069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f9912ffd640 1 -- 172.21.15.67:0/1003842003 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6187+0+0 (secure 0 0 0) 0x7f991c085ad0 con 0x7f992409d7d0 2024-09-19T05:43:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f992259c640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f99040678f0 0x7f9904069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.921+0000 7f992259c640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f99040678f0 0x7f9904069db0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f992406a420 tx=0x7f99240ad0c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:36.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:36.925+0000 7f9912ffd640 1 -- 172.21.15.67:0/1003842003 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f991c0564c0 con 0x7f992409d7d0 2024-09-19T05:43:37.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.089+0000 7f99289cf640 1 -- 172.21.15.67:0/1003842003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f99240b5390 con 0x7f992409d7d0 2024-09-19T05:43:37.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.717+0000 7f9912ffd640 1 -- 172.21.15.67:0/1003842003 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v134) ==== 181+0+0 (secure 0 0 0) 0x7f991c01be40 con 0x7f992409d7d0 2024-09-19T05:43:37.715 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:43:37.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 -- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f99040678f0 msgr2=0x7f9904069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:37.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f99040678f0 0x7f9904069db0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f992406a420 tx=0x7f99240ad0c0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 -- 172.21.15.67:0/1003842003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f992409d7d0 msgr2=0x7f992409dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f992409d7d0 0x7f992409dc50 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f99240cfb80 tx=0x7f991c00eb90 comp rx=0 tx=0).stop 2024-09-19T05:43:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 -- 172.21.15.67:0/1003842003 shutdown_connections 2024-09-19T05:43:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f992409d7d0 0x7f992409dc50 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f99040678f0 0x7f9904069db0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f99240cd1a0 0x7f99240ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 --2- 172.21.15.67:0/1003842003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f990c006a20 0x7f9924153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 -- 172.21.15.67:0/1003842003 >> 172.21.15.67:0/1003842003 conn(0x7f992406c0c0 msgr2=0x7f992415d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 -- 172.21.15.67:0/1003842003 shutdown_connections 2024-09-19T05:43:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.721+0000 7f99289cf640 1 -- 172.21.15.67:0/1003842003 wait complete. 2024-09-19T05:43:37.745 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:43:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f269d9f3640 1 Processor -- start 2024-09-19T05:43:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f269d9f3640 1 -- start start 2024-09-19T05:43:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f269d9f3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26980d0aa0 0x7f269806e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f269d9f3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f269806eb40 0x7f269815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f269d9f3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f269815d030 con 0x7f26980cf5e0 2024-09-19T05:43:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f269d9f3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f269806de90 con 0x7f26980d0aa0 2024-09-19T05:43:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f269d9f3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f269806e170 con 0x7f269806eb40 2024-09-19T05:43:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f26967fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26980d0aa0 0x7f269806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f26967fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26980d0aa0 0x7f269806e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43072/0 (socket says 172.21.15.67:43072) 2024-09-19T05:43:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f26967fc640 1 -- 172.21.15.67:0/2490891944 learned_addr learned my addr 172.21.15.67:0/2490891944 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.881+0000 7f26977fe640 1 --2- 172.21.15.67:0/2490891944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f269806eb40 0x7f269815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f26967fc640 1 -- 172.21.15.67:0/2490891944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f269806eb40 msgr2=0x7f269815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f26967fc640 1 --2- 172.21.15.67:0/2490891944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f269806eb40 0x7f269815d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f26967fc640 1 -- 172.21.15.67:0/2490891944 >> v1:172.21.15.67:6789/0 conn(0x7f26980cf5e0 legacy=0x7f269815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f26967fc640 1 -- 172.21.15.67:0/2490891944 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269815d310 con 0x7f26980d0aa0 2024-09-19T05:43:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f26977fe640 1 --2- 172.21.15.67:0/2490891944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f269806eb40 0x7f269815d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f26967fc640 1 --2- 172.21.15.67:0/2490891944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 0x7f269806e600 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f2680009e50 tx=0x7f268001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7cd299b9db7988 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f2695ffb640 1 -- 172.21.15.67:0/2490891944 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26800a5660 con 0x7f26980d0aa0 2024-09-19T05:43:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f2695ffb640 1 -- 172.21.15.67:0/2490891944 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26800a5800 con 0x7f26980d0aa0 2024-09-19T05:43:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f2695ffb640 1 -- 172.21.15.67:0/2490891944 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26800a5bd0 con 0x7f26980d0aa0 2024-09-19T05:43:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f269d9f3640 1 -- 172.21.15.67:0/2490891944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 msgr2=0x7f269806e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f269d9f3640 1 --2- 172.21.15.67:0/2490891944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 0x7f269806e600 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f2680009e50 tx=0x7f268001c9a0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f269d9f3640 1 -- 172.21.15.67:0/2490891944 shutdown_connections 2024-09-19T05:43:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f269d9f3640 1 --2- 172.21.15.67:0/2490891944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f269806eb40 0x7f269815d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f269d9f3640 1 --2- 172.21.15.67:0/2490891944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 0x7f269806e600 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f269d9f3640 1 -- 172.21.15.67:0/2490891944 >> 172.21.15.67:0/2490891944 conn(0x7f269806c0c0 msgr2=0x7f269806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f269d9f3640 1 -- 172.21.15.67:0/2490891944 shutdown_connections 2024-09-19T05:43:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.885+0000 7f269d9f3640 1 -- 172.21.15.67:0/2490891944 wait complete. 2024-09-19T05:43:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 Processor -- start 2024-09-19T05:43:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 -- start start 2024-09-19T05:43:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f269806eb40 0x7f2698152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26980cf5e0 0x7f26980b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 0x7f26981655c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2698169340 con 0x7f26980d0aa0 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f26981691c0 con 0x7f269806eb40 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f26981694c0 con 0x7f26980cf5e0 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f26977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 0x7f26981655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f26977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 0x7f26981655c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43088/0 (socket says 172.21.15.67:43088) 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f26977fe640 1 -- 172.21.15.67:0/1357889771 learned_addr learned my addr 172.21.15.67:0/1357889771 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f26967fc640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26980cf5e0 0x7f26980b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f2696ffd640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f269806eb40 0x7f2698152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f26977fe640 1 -- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26980cf5e0 msgr2=0x7f26980b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f26977fe640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26980cf5e0 0x7f26980b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f26977fe640 1 -- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f269806eb40 msgr2=0x7f2698152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f26977fe640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f269806eb40 0x7f2698152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f26977fe640 1 -- 172.21.15.67:0/1357889771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26980b4870 con 0x7f26980d0aa0 2024-09-19T05:43:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f2696ffd640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f269806eb40 0x7f2698152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f26977fe640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 0x7f26981655c0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f269000c7f0 tx=0x7f269000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f268ffff640 1 -- 172.21.15.67:0/1357889771 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690015020 con 0x7f26980d0aa0 2024-09-19T05:43:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f268ffff640 1 -- 172.21.15.67:0/1357889771 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2690004250 con 0x7f26980d0aa0 2024-09-19T05:43:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 -- 172.21.15.67:0/1357889771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26980b4bf0 con 0x7f26980d0aa0 2024-09-19T05:43:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f268ffff640 1 -- 172.21.15.67:0/1357889771 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690003620 con 0x7f26980d0aa0 2024-09-19T05:43:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 -- 172.21.15.67:0/1357889771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2698152520 con 0x7f26980d0aa0 2024-09-19T05:43:37.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f269d9f3640 1 -- 172.21.15.67:0/1357889771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269815d8d0 con 0x7f26980d0aa0 2024-09-19T05:43:37.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.889+0000 7f268ffff640 1 -- 172.21.15.67:0/1357889771 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2690018020 con 0x7f26980d0aa0 2024-09-19T05:43:37.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.893+0000 7f268ffff640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26780678c0 0x7f2678069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:37.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.893+0000 7f268ffff640 1 -- 172.21.15.67:0/1357889771 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5749+0+0 (secure 0 0 0) 0x7f2690085c20 con 0x7f26980d0aa0 2024-09-19T05:43:37.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.893+0000 7f2696ffd640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26780678c0 0x7f2678069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:37.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.893+0000 7f2696ffd640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26780678c0 0x7f2678069d80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f26980af600 tx=0x7f2688009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:37.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:37.897+0000 7f268ffff640 1 -- 172.21.15.67:0/1357889771 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f269001f030 con 0x7f26980d0aa0 2024-09-19T05:43:38.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.057+0000 7f269d9f3640 1 -- 172.21.15.67:0/1357889771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f269806e6a0 con 0x7f26980d0aa0 2024-09-19T05:43:38.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.717+0000 7f268ffff640 1 -- 172.21.15.67:0/1357889771 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v135) ==== 169+0+0 (secure 0 0 0) 0x7f26980b4870 con 0x7f26980d0aa0 2024-09-19T05:43:38.717 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:43:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.721+0000 7f269d9f3640 1 -- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26780678c0 msgr2=0x7f2678069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.721+0000 7f269d9f3640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26780678c0 0x7f2678069d80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f26980af600 tx=0x7f2688009040 comp rx=0 tx=0).stop 2024-09-19T05:43:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.721+0000 7f269d9f3640 1 -- 172.21.15.67:0/1357889771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 msgr2=0x7f26981655c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.721+0000 7f269d9f3640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 0x7f26981655c0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f269000c7f0 tx=0x7f269000ccb0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.721+0000 7f269d9f3640 1 -- 172.21.15.67:0/1357889771 shutdown_connections 2024-09-19T05:43:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.721+0000 7f269d9f3640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26980d0aa0 0x7f26981655c0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.721+0000 7f269d9f3640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26780678c0 0x7f2678069d80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.721+0000 7f269d9f3640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26980cf5e0 0x7f26980b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.721+0000 7f269d9f3640 1 --2- 172.21.15.67:0/1357889771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f269806eb40 0x7f2698152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.721+0000 7f269d9f3640 1 -- 172.21.15.67:0/1357889771 >> 172.21.15.67:0/1357889771 conn(0x7f269806c0c0 msgr2=0x7f26980afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.725+0000 7f269d9f3640 1 -- 172.21.15.67:0/1357889771 shutdown_connections 2024-09-19T05:43:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.725+0000 7f269d9f3640 1 -- 172.21.15.67:0/1357889771 wait complete. 2024-09-19T05:43:38.748 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:43:38.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f17197640 1 Processor -- start 2024-09-19T05:43:38.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f17197640 1 -- start start 2024-09-19T05:43:38.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f17197640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1015e780 0x7f6f100d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f17197640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f100ae030 0x7f6f100cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f17197640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6f1006bd30 0x7f6f100cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f17197640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1006fc80 con 0x7f6f100ae030 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f17197640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6f100d18c0 con 0x7f6f1006bd30 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f17197640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6f100d1ba0 con 0x7f6f1015e780 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f0ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f100ae030 0x7f6f100cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f0ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f100ae030 0x7f6f100cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43100/0 (socket says 172.21.15.67:43100) 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f0ffff640 1 -- 172.21.15.67:0/1364563854 learned_addr learned my addr 172.21.15.67:0/1364563854 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f15734640 1 --2- 172.21.15.67:0/1364563854 >> v2:172.21.15.97:3300/0 conn(0x7f6f1006bd30 0x7f6f100cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f14f33640 1 --2- 172.21.15.67:0/1364563854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1015e780 0x7f6f100d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f0ffff640 1 -- 172.21.15.67:0/1364563854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1015e780 msgr2=0x7f6f100d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f0ffff640 1 --2- 172.21.15.67:0/1364563854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1015e780 0x7f6f100d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f0ffff640 1 -- 172.21.15.67:0/1364563854 >> v2:172.21.15.97:3300/0 conn(0x7f6f1006bd30 msgr2=0x7f6f100cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:38.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f0ffff640 1 --2- 172.21.15.67:0/1364563854 >> v2:172.21.15.97:3300/0 conn(0x7f6f1006bd30 0x7f6f100cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f0ffff640 1 -- 172.21.15.67:0/1364563854 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f100d1e80 con 0x7f6f100ae030 2024-09-19T05:43:38.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.917+0000 7f6f15734640 1 --2- 172.21.15.67:0/1364563854 >> v2:172.21.15.97:3300/0 conn(0x7f6f1006bd30 0x7f6f100cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:38.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f0ffff640 1 --2- 172.21.15.67:0/1364563854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f100ae030 0x7f6f100cfa90 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f6f100d2210 tx=0x7f6f0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1751f28a2ccd551c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:38.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f0f7fe640 1 -- 172.21.15.67:0/1364563854 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f040ab620 con 0x7f6f100ae030 2024-09-19T05:43:38.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f0f7fe640 1 -- 172.21.15.67:0/1364563854 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f040b0070 con 0x7f6f100ae030 2024-09-19T05:43:38.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f0f7fe640 1 -- 172.21.15.67:0/1364563854 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f040ab9e0 con 0x7f6f100ae030 2024-09-19T05:43:38.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 -- 172.21.15.67:0/1364563854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f100ae030 msgr2=0x7f6f100cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:38.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 --2- 172.21.15.67:0/1364563854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f100ae030 0x7f6f100cfa90 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f6f100d2210 tx=0x7f6f0401c520 comp rx=0 tx=0).stop 2024-09-19T05:43:38.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 -- 172.21.15.67:0/1364563854 shutdown_connections 2024-09-19T05:43:38.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 --2- 172.21.15.67:0/1364563854 >> v2:172.21.15.97:3300/0 conn(0x7f6f1006bd30 0x7f6f100cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 --2- 172.21.15.67:0/1364563854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f100ae030 0x7f6f100cfa90 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 --2- 172.21.15.67:0/1364563854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1015e780 0x7f6f100d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 -- 172.21.15.67:0/1364563854 >> 172.21.15.67:0/1364563854 conn(0x7f6f100b6570 msgr2=0x7f6f100b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:38.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 -- 172.21.15.67:0/1364563854 shutdown_connections 2024-09-19T05:43:38.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 -- 172.21.15.67:0/1364563854 wait complete. 2024-09-19T05:43:38.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 Processor -- start 2024-09-19T05:43:38.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 -- start start 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1006bd30 0x7f6f1014e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f100ae030 0x7f6f101f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1015e780 0x7f6f10151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10070c90 con 0x7f6f1015e780 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10070b10 con 0x7f6f1006bd30 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f17197640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6f10070e10 con 0x7f6f100ae030 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f15734640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1015e780 0x7f6f10151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f15734640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1015e780 0x7f6f10151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43112/0 (socket says 172.21.15.67:43112) 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f15734640 1 -- 172.21.15.67:0/2150303420 learned_addr learned my addr 172.21.15.67:0/2150303420 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f14f33640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1006bd30 0x7f6f1014e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f0ffff640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f100ae030 0x7f6f101f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f15734640 1 -- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f100ae030 msgr2=0x7f6f101f7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f15734640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f100ae030 0x7f6f101f7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f15734640 1 -- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1006bd30 msgr2=0x7f6f1014e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f15734640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1006bd30 0x7f6f1014e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f15734640 1 -- 172.21.15.67:0/2150303420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f101558c0 con 0x7f6f1015e780 2024-09-19T05:43:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.921+0000 7f6f15734640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1015e780 0x7f6f10151ab0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800e5e0 tx=0x7f6f0800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f0d7fa640 1 -- 172.21.15.67:0/2150303420 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800f040 con 0x7f6f1015e780 2024-09-19T05:43:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f0d7fa640 1 -- 172.21.15.67:0/2150303420 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f08004230 con 0x7f6f1015e780 2024-09-19T05:43:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f0d7fa640 1 -- 172.21.15.67:0/2150303420 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08003620 con 0x7f6f1015e780 2024-09-19T05:43:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f17197640 1 -- 172.21.15.67:0/2150303420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f10155b60 con 0x7f6f1015e780 2024-09-19T05:43:38.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f17197640 1 -- 172.21.15.67:0/2150303420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f10152f20 con 0x7f6f1015e780 2024-09-19T05:43:38.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f17197640 1 -- 172.21.15.67:0/2150303420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f100d0f20 con 0x7f6f1015e780 2024-09-19T05:43:38.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f0d7fa640 1 -- 172.21.15.67:0/2150303420 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f080037c0 con 0x7f6f1015e780 2024-09-19T05:43:38.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f0d7fa640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6efc0678f0 0x7f6efc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:38.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f0d7fa640 1 -- 172.21.15.67:0/2150303420 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5335+0+0 (secure 0 0 0) 0x7f6f08085650 con 0x7f6f1015e780 2024-09-19T05:43:38.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f14f33640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6efc0678f0 0x7f6efc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.925+0000 7f6f14f33640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6efc0678f0 0x7f6efc069db0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6f100afdb0 tx=0x7f6f00009800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:38.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:38.929+0000 7f6f0d7fa640 1 -- 172.21.15.67:0/2150303420 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6f08017020 con 0x7f6f1015e780 2024-09-19T05:43:39.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.093+0000 7f6f17197640 1 -- 172.21.15.67:0/2150303420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f6f100afb00 con 0x7f6f1015e780 2024-09-19T05:43:39.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.097+0000 7f6f0d7fa640 1 -- 172.21.15.67:0/2150303420 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7f6f08055cb0 con 0x7f6f1015e780 2024-09-19T05:43:39.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 -- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6efc0678f0 msgr2=0x7f6efc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6efc0678f0 0x7f6efc069db0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6f100afdb0 tx=0x7f6f00009800 comp rx=0 tx=0).stop 2024-09-19T05:43:39.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 -- 172.21.15.67:0/2150303420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1015e780 msgr2=0x7f6f10151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1015e780 0x7f6f10151ab0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800e5e0 tx=0x7f6f0800eaa0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 -- 172.21.15.67:0/2150303420 shutdown_connections 2024-09-19T05:43:39.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1015e780 0x7f6f10151ab0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6efc0678f0 0x7f6efc069db0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f100ae030 0x7f6f101f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 --2- 172.21.15.67:0/2150303420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1006bd30 0x7f6f1014e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 -- 172.21.15.67:0/2150303420 >> 172.21.15.67:0/2150303420 conn(0x7f6f100b6570 msgr2=0x7f6f100b5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 -- 172.21.15.67:0/2150303420 shutdown_connections 2024-09-19T05:43:39.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.101+0000 7f6f17197640 1 -- 172.21.15.67:0/2150303420 wait complete. 2024-09-19T05:43:39.119 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-19T05:43:39.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc31e06f640 1 Processor -- start 2024-09-19T05:43:39.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc31e06f640 1 -- start start 2024-09-19T05:43:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc31e06f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc31806d3e0 0x7fc3180b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc31e06f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 0x7fc3180ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc31e06f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3180b5320 con 0x7fc31815e340 2024-09-19T05:43:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc31e06f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc3180aee20 con 0x7fc31806d3e0 2024-09-19T05:43:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc31e06f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc3180b4990 con 0x7fc3180b5a10 2024-09-19T05:43:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc316ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc31806d3e0 0x7fc3180b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc317fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 0x7fc3180ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc316ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc31806d3e0 0x7fc3180b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:54058/0 (socket says 172.21.15.67:54058) 2024-09-19T05:43:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc3177fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc31815e340 0x7fc31806ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:42730/0 (socket says 172.21.15.67:42730) 2024-09-19T05:43:39.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc316ffd640 1 -- 172.21.15.67:0/758570408 learned_addr learned my addr 172.21.15.67:0/758570408 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:39.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc317fff640 1 -- 172.21.15.67:0/758570408 >> v2:172.21.15.97:3300/0 conn(0x7fc31806d3e0 msgr2=0x7fc3180b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:39.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc317fff640 1 --2- 172.21.15.67:0/758570408 >> v2:172.21.15.97:3300/0 conn(0x7fc31806d3e0 0x7fc3180b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc317fff640 1 -- 172.21.15.67:0/758570408 >> v1:172.21.15.97:6789/0 conn(0x7fc31815e340 legacy=0x7fc31806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.249+0000 7fc317fff640 1 -- 172.21.15.67:0/758570408 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3180b40f0 con 0x7fc3180b5a10 2024-09-19T05:43:39.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc317fff640 1 --2- 172.21.15.67:0/758570408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 0x7fc3180ae8e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc310009d90 tx=0x7fc31001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74d093747ff8e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:39.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc3167fc640 1 -- 172.21.15.67:0/758570408 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3100b2070 con 0x7fc3180b5a10 2024-09-19T05:43:39.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc3167fc640 1 -- 172.21.15.67:0/758570408 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3100a5a30 con 0x7fc3180b5a10 2024-09-19T05:43:39.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc3167fc640 1 -- 172.21.15.67:0/758570408 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3100a5e00 con 0x7fc3180b5a10 2024-09-19T05:43:39.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc31e06f640 1 -- 172.21.15.67:0/758570408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 msgr2=0x7fc3180ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc31e06f640 1 --2- 172.21.15.67:0/758570408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 0x7fc3180ae8e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc310009d90 tx=0x7fc31001c970 comp rx=0 tx=0).stop 2024-09-19T05:43:39.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc31e06f640 1 -- 172.21.15.67:0/758570408 shutdown_connections 2024-09-19T05:43:39.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc31e06f640 1 --2- 172.21.15.67:0/758570408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 0x7fc3180ae8e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc31e06f640 1 --2- 172.21.15.67:0/758570408 >> v2:172.21.15.97:3300/0 conn(0x7fc31806d3e0 0x7fc3180b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc31e06f640 1 -- 172.21.15.67:0/758570408 >> 172.21.15.67:0/758570408 conn(0x7fc318072800 msgr2=0x7fc318072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:39.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc31e06f640 1 -- 172.21.15.67:0/758570408 shutdown_connections 2024-09-19T05:43:39.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc31e06f640 1 -- 172.21.15.67:0/758570408 wait complete. 2024-09-19T05:43:39.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc31e06f640 1 Processor -- start 2024-09-19T05:43:39.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.253+0000 7fc31e06f640 1 -- start start 2024-09-19T05:43:39.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc31e06f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc31806d3e0 0x7fc318151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc31e06f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 0x7fc3181506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc31e06f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc31815e340 0x7fc318159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc31e06f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc31815e8a0 con 0x7fc31815e340 2024-09-19T05:43:39.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc31e06f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc31815e720 con 0x7fc31806d3e0 2024-09-19T05:43:39.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc31e06f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc31806f570 con 0x7fc3180b5a10 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc317fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc31815e340 0x7fc318159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc317fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc31815e340 0x7fc318159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43128/0 (socket says 172.21.15.67:43128) 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc317fff640 1 -- 172.21.15.67:0/3408588261 learned_addr learned my addr 172.21.15.67:0/3408588261 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc3177fe640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc31806d3e0 0x7fc318151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc316ffd640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 0x7fc3181506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc317fff640 1 -- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 msgr2=0x7fc3181506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc317fff640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 0x7fc3181506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc317fff640 1 -- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc31806d3e0 msgr2=0x7fc318151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc317fff640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc31806d3e0 0x7fc318151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc317fff640 1 -- 172.21.15.67:0/3408588261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3181525d0 con 0x7fc31815e340 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc316ffd640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 0x7fc3181506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc317fff640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc31815e340 0x7fc318159540 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fc310009d90 tx=0x7fc310019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc2fffff640 1 -- 172.21.15.67:0/3408588261 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3100b2050 con 0x7fc31815e340 2024-09-19T05:43:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc31e06f640 1 -- 172.21.15.67:0/3408588261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc318150e50 con 0x7fc31815e340 2024-09-19T05:43:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc2fffff640 1 -- 172.21.15.67:0/3408588261 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3100be070 con 0x7fc31815e340 2024-09-19T05:43:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc2fffff640 1 -- 172.21.15.67:0/3408588261 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3100adb10 con 0x7fc31815e340 2024-09-19T05:43:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc31e06f640 1 -- 172.21.15.67:0/3408588261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc318151410 con 0x7fc31815e340 2024-09-19T05:43:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.257+0000 7fc31e06f640 1 -- 172.21.15.67:0/3408588261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31806f9a0 con 0x7fc31815e340 2024-09-19T05:43:39.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.261+0000 7fc2fffff640 1 -- 172.21.15.67:0/3408588261 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3100adcb0 con 0x7fc31815e340 2024-09-19T05:43:39.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.261+0000 7fc2fffff640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3040678f0 0x7fc304069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.261+0000 7fc2fffff640 1 -- 172.21.15.67:0/3408588261 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5335+0+0 (secure 0 0 0) 0x7fc310121850 con 0x7fc31815e340 2024-09-19T05:43:39.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.261+0000 7fc3177fe640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3040678f0 0x7fc304069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.261+0000 7fc3177fe640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3040678f0 0x7fc304069db0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc308000f70 tx=0x7fc308007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:39.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.265+0000 7fc2fffff640 1 -- 172.21.15.67:0/3408588261 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc3181525d0 con 0x7fc31815e340 2024-09-19T05:43:39.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.489+0000 7fc31e06f640 1 -- 172.21.15.67:0/3408588261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7fc318072c80 con 0x7fc31815e340 2024-09-19T05:43:39.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.721+0000 7fc2fffff640 1 -- 172.21.15.67:0/3408588261 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v464) ==== 144+0+0 (secure 0 0 0) 0x7fc310016560 con 0x7fc31815e340 2024-09-19T05:43:39.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 -- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3040678f0 msgr2=0x7fc304069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3040678f0 0x7fc304069db0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc308000f70 tx=0x7fc308007e30 comp rx=0 tx=0).stop 2024-09-19T05:43:39.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 -- 172.21.15.67:0/3408588261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc31815e340 msgr2=0x7fc318159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc31815e340 0x7fc318159540 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fc310009d90 tx=0x7fc310019710 comp rx=0 tx=0).stop 2024-09-19T05:43:39.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 -- 172.21.15.67:0/3408588261 shutdown_connections 2024-09-19T05:43:39.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc31815e340 0x7fc318159540 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc3040678f0 0x7fc304069db0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3180b5a10 0x7fc3181506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 --2- 172.21.15.67:0/3408588261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc31806d3e0 0x7fc318151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 -- 172.21.15.67:0/3408588261 >> 172.21.15.67:0/3408588261 conn(0x7fc318072800 msgr2=0x7fc3181605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:39.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 -- 172.21.15.67:0/3408588261 shutdown_connections 2024-09-19T05:43:39.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.725+0000 7fc31e06f640 1 -- 172.21.15.67:0/3408588261 wait complete. 2024-09-19T05:43:39.746 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-19T05:43:39.747 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-19T05:43:39.747 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:43:39.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5b1bac640 1 Processor -- start 2024-09-19T05:43:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5b1bac640 1 -- start start 2024-09-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5b1bac640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac0d1590 0x7fc5ac0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5b1bac640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5ac0d4d40 con 0x7fc5ac161da0 2024-09-19T05:43:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5b1bac640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5ac0d5020 con 0x7fc5ac0b51d0 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5b1bac640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ac0d0840 con 0x7fc5ac0d1590 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5ab7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc5ac161da0 0x7fc5ac0d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33784/0 (socket says 172.21.15.67:33784) 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5ab7fe640 1 -- 172.21.15.67:0/1873986560 learned_addr learned my addr 172.21.15.67:0/1873986560 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aaffd640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac0d1590 0x7fc5ac0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3169632045 0 0) 0x7fc5ac0d4d40 con 0x7fc5ac161da0 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc598003530 con 0x7fc5ac161da0 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 694463053 0 0) 0x7fc598003530 con 0x7fc5ac161da0 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac0d1590 msgr2=0x7fc5ac0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac0d1590 0x7fc5ac0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 >> v1:172.21.15.97:6789/0 conn(0x7fc5ac0b51d0 legacy=0x7fc5ac0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ac0d5300 con 0x7fc5ac161da0 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fc5a4001a00 con 0x7fc5ac161da0 2024-09-19T05:43:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 >> v1:172.21.15.67:6789/0 conn(0x7fc5ac161da0 legacy=0x7fc5ac0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 0x7fc598003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc598004810 0x7fc598004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac0d1590 0x7fc5980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ac0d0840 con 0x7fc5980039f0 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc59800bab0 con 0x7fc598004810 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc59800bcb0 con 0x7fc5ac0d1590 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5ab7fe640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 0x7fc598003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5aaffd640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc598004810 0x7fc598004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5ab7fe640 1 -- 172.21.15.67:0/1873986560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac0d1590 msgr2=0x7fc5980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5ab7fe640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac0d1590 0x7fc5980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5ab7fe640 1 -- 172.21.15.67:0/1873986560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc598004810 msgr2=0x7fc598004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5ab7fe640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc598004810 0x7fc598004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.881+0000 7fc5ab7fe640 1 -- 172.21.15.67:0/1873986560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc598003530 con 0x7fc5980039f0 2024-09-19T05:43:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5ab7fe640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 0x7fc598003e10 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400a830 tx=0x7fc5a401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe78e508ec29a6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a400a480 con 0x7fc5980039f0 2024-09-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a40ad630 con 0x7fc5980039f0 2024-09-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5aa7fc640 1 -- 172.21.15.67:0/1873986560 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40ada20 con 0x7fc5980039f0 2024-09-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5b1bac640 1 -- 172.21.15.67:0/1873986560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 msgr2=0x7fc598003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5b1bac640 1 --2- 172.21.15.67:0/1873986560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 0x7fc598003e10 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400a830 tx=0x7fc5a401d340 comp rx=0 tx=0).stop 2024-09-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5abfff640 1 -- 172.21.15.67:0/1873986560 reap_dead start 2024-09-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5b1bac640 1 -- 172.21.15.67:0/1873986560 shutdown_connections 2024-09-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5b1bac640 1 -- 172.21.15.67:0/1873986560 >> 172.21.15.67:0/1873986560 conn(0x7fc5ac08bfc0 msgr2=0x7fc5ac0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5b1bac640 1 -- 172.21.15.67:0/1873986560 shutdown_connections 2024-09-19T05:43:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5b1bac640 1 -- 172.21.15.67:0/1873986560 wait complete. 2024-09-19T05:43:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5b1bac640 1 Processor -- start 2024-09-19T05:43:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.885+0000 7fc5b1bac640 1 -- start start 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5b1bac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 0x7fc5ac1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5b1bac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac15bb10 0x7fc5ac15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5b1bac640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac164620 0x7fc5ac164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5b1bac640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ac0d01f0 con 0x7fc5980039f0 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5b1bac640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ac0d0070 con 0x7fc5ac15bb10 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5b1bac640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ac0d0370 con 0x7fc5ac164620 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5ab7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 0x7fc5ac1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5ab7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 0x7fc5ac1535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43152/0 (socket says 172.21.15.67:43152) 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5ab7fe640 1 -- 172.21.15.67:0/266034862 learned_addr learned my addr 172.21.15.67:0/266034862 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5aaffd640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac15bb10 0x7fc5ac15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5abfff640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac164620 0x7fc5ac164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5ab7fe640 1 -- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac164620 msgr2=0x7fc5ac164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5ab7fe640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac164620 0x7fc5ac164ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5ab7fe640 1 -- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac15bb10 msgr2=0x7fc5ac15bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5ab7fe640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac15bb10 0x7fc5ac15bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5ab7fe640 1 -- 172.21.15.67:0/266034862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ac0cbe10 con 0x7fc5980039f0 2024-09-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5ab7fe640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 0x7fc5ac1535e0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400a830 tx=0x7fc598005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5a3fff640 1 -- 172.21.15.67:0/266034862 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40bc020 con 0x7fc5980039f0 2024-09-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5a3fff640 1 -- 172.21.15.67:0/266034862 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a40b3040 con 0x7fc5980039f0 2024-09-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5b1bac640 1 -- 172.21.15.67:0/266034862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5ac0cc0b0 con 0x7fc5980039f0 2024-09-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5a3fff640 1 -- 172.21.15.67:0/266034862 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40017c0 con 0x7fc5980039f0 2024-09-19T05:43:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5b1bac640 1 -- 172.21.15.67:0/266034862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5ac0cc670 con 0x7fc5980039f0 2024-09-19T05:43:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5b1bac640 1 -- 172.21.15.67:0/266034862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5ac0cf150 con 0x7fc5980039f0 2024-09-19T05:43:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5a3fff640 1 -- 172.21.15.67:0/266034862 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc5a40bf020 con 0x7fc5980039f0 2024-09-19T05:43:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5a3fff640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc58c0678f0 0x7fc58c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5a3fff640 1 -- 172.21.15.67:0/266034862 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5335+0+0 (secure 0 0 0) 0x7fc5a41209f0 con 0x7fc5980039f0 2024-09-19T05:43:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.889+0000 7fc5aaffd640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc58c0678f0 0x7fc58c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.893+0000 7fc5aaffd640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc58c0678f0 0x7fc58c069db0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc594009970 tx=0x7fc594008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:39.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:39.893+0000 7fc5a3fff640 1 -- 172.21.15.67:0/266034862 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc5a40c6030 con 0x7fc5980039f0 2024-09-19T05:43:40.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.061+0000 7fc5b1bac640 1 -- 172.21.15.67:0/266034862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5ac164ff0 con 0x7fc5980039f0 2024-09-19T05:43:40.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.061+0000 7fc5a3fff640 1 -- 172.21.15.67:0/266034862 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+13275 (secure 0 0 0) 0x7fc5a4017050 con 0x7fc5980039f0 2024-09-19T05:43:40.060 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:40.061 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":135,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:43:38.720037+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/96000467":"2024-09-20T05:43:35.702975+0000","172.21.15.67:6834/96000467":"2024-09-20T05:43:35.702975+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:43:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.061+0000 7fc5b1bac640 1 -- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc58c0678f0 msgr2=0x7fc58c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.061+0000 7fc5b1bac640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc58c0678f0 0x7fc58c069db0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc594009970 tx=0x7fc594008040 comp rx=0 tx=0).stop 2024-09-19T05:43:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.061+0000 7fc5b1bac640 1 -- 172.21.15.67:0/266034862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 msgr2=0x7fc5ac1535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.061+0000 7fc5b1bac640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 0x7fc5ac1535e0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400a830 tx=0x7fc598005840 comp rx=0 tx=0).stop 2024-09-19T05:43:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.065+0000 7fc5b1bac640 1 -- 172.21.15.67:0/266034862 shutdown_connections 2024-09-19T05:43:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.065+0000 7fc5b1bac640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc58c0678f0 0x7fc58c069db0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.065+0000 7fc5b1bac640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac164620 0x7fc5ac164ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.065+0000 7fc5b1bac640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac15bb10 0x7fc5ac15bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.065+0000 7fc5b1bac640 1 --2- 172.21.15.67:0/266034862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5980039f0 0x7fc5ac1535e0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.065+0000 7fc5b1bac640 1 -- 172.21.15.67:0/266034862 >> 172.21.15.67:0/266034862 conn(0x7fc5ac08bfc0 msgr2=0x7fc5ac15cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:40.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.065+0000 7fc5b1bac640 1 -- 172.21.15.67:0/266034862 shutdown_connections 2024-09-19T05:43:40.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.065+0000 7fc5b1bac640 1 -- 172.21.15.67:0/266034862 wait complete. 2024-09-19T05:43:40.079 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:43:40.080 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:43:40.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe42b244640 1 Processor -- start 2024-09-19T05:43:40.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe42b244640 1 -- start start 2024-09-19T05:43:40.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe42b244640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe4240b3b40 0x7fe4240b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe42b244640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4240d1f30 con 0x7fe424161cb0 2024-09-19T05:43:40.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe42b244640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42409b440 con 0x7fe4240cf3d0 2024-09-19T05:43:40.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe42b244640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe42409b720 con 0x7fe4240b3b40 2024-09-19T05:43:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe428fe0640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe424161cb0 0x7fe4240cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33794/0 (socket says 172.21.15.67:33794) 2024-09-19T05:43:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe428fe0640 1 -- 172.21.15.67:0/4097933394 learned_addr learned my addr 172.21.15.67:0/4097933394 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe423fff640 1 --2- 172.21.15.67:0/4097933394 >> v2:172.21.15.97:3300/0 conn(0x7fe4240b3b40 0x7fe4240b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657949272 0 0) 0x7fe4240d1f30 con 0x7fe424161cb0 2024-09-19T05:43:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe40c003530 con 0x7fe424161cb0 2024-09-19T05:43:40.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1732961539 0 0) 0x7fe40c003530 con 0x7fe424161cb0 2024-09-19T05:43:40.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 >> v2:172.21.15.97:3300/0 conn(0x7fe4240b3b40 msgr2=0x7fe4240b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:40.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 --2- 172.21.15.67:0/4097933394 >> v2:172.21.15.97:3300/0 conn(0x7fe4240b3b40 0x7fe4240b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 >> v1:172.21.15.97:6789/0 conn(0x7fe4240cf3d0 legacy=0x7fe4240b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4240b3620 con 0x7fe424161cb0 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fe41c001a00 con 0x7fe424161cb0 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 >> v1:172.21.15.67:6789/0 conn(0x7fe424161cb0 legacy=0x7fe4240cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 --2- 172.21.15.67:0/4097933394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe40c0039c0 0x7fe40c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 --2- 172.21.15.67:0/4097933394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe40c004810 0x7fe40c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 --2- 172.21.15.67:0/4097933394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe40c0051d0 0x7fe40c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe42409b720 con 0x7fe40c0039c0 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c00c170 con 0x7fe40c0051d0 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe40c00c370 con 0x7fe40c004810 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe428fe0640 1 --2- 172.21.15.67:0/4097933394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe40c0039c0 0x7fe40c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4297e1640 1 --2- 172.21.15.67:0/4097933394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe40c0051d0 0x7fe40c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe428fe0640 1 -- 172.21.15.67:0/4097933394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe40c004810 msgr2=0x7fe40c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe428fe0640 1 --2- 172.21.15.67:0/4097933394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe40c004810 0x7fe40c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe428fe0640 1 -- 172.21.15.67:0/4097933394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe40c0051d0 msgr2=0x7fe40c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:40.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe428fe0640 1 --2- 172.21.15.67:0/4097933394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe40c0051d0 0x7fe40c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe4297e1640 1 -- 172.21.15.67:0/4097933394 reap_dead start 2024-09-19T05:43:40.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.209+0000 7fe428fe0640 1 -- 172.21.15.67:0/4097933394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c003530 con 0x7fe40c0039c0 2024-09-19T05:43:40.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe428fe0640 1 --2- 172.21.15.67:0/4097933394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe40c0039c0 0x7fe40c003de0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00a860 tx=0x7fe41c01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9e2aacb5914934 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:40.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00a480 con 0x7fe40c0039c0 2024-09-19T05:43:40.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41c0a5e50 con 0x7fe40c0039c0 2024-09-19T05:43:40.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe4237fe640 1 -- 172.21.15.67:0/4097933394 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0ad8d0 con 0x7fe40c0039c0 2024-09-19T05:43:40.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe42b244640 1 -- 172.21.15.67:0/4097933394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe40c0039c0 msgr2=0x7fe40c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe42b244640 1 --2- 172.21.15.67:0/4097933394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe40c0039c0 0x7fe40c003de0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00a860 tx=0x7fe41c01d380 comp rx=0 tx=0).stop 2024-09-19T05:43:40.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe42b244640 1 -- 172.21.15.67:0/4097933394 shutdown_connections 2024-09-19T05:43:40.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe42b244640 1 --2- 172.21.15.67:0/4097933394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe40c0039c0 0x7fe40c003de0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe42b244640 1 -- 172.21.15.67:0/4097933394 >> 172.21.15.67:0/4097933394 conn(0x7fe4240b3f30 msgr2=0x7fe4240b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:40.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe42b244640 1 -- 172.21.15.67:0/4097933394 shutdown_connections 2024-09-19T05:43:40.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.213+0000 7fe42b244640 1 -- 172.21.15.67:0/4097933394 wait complete. 2024-09-19T05:43:40.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 Processor -- start 2024-09-19T05:43:40.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 -- start start 2024-09-19T05:43:40.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe40c0039c0 0x7fe424160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe42415f350 0x7fe4241567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe42409f970 0x7fe42409fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4240cf050 con 0x7fe42415f350 2024-09-19T05:43:40.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4240ceed0 con 0x7fe40c0039c0 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4240cf1d0 con 0x7fe42409f970 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe423fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe42415f350 0x7fe4241567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe423fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe42415f350 0x7fe4241567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43162/0 (socket says 172.21.15.67:43162) 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe423fff640 1 -- 172.21.15.67:0/419827687 learned_addr learned my addr 172.21.15.67:0/419827687 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe428fe0640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe40c0039c0 0x7fe424160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe4297e1640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe42409f970 0x7fe42409fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe423fff640 1 -- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe42409f970 msgr2=0x7fe42409fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe423fff640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe42409f970 0x7fe42409fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe423fff640 1 -- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe40c0039c0 msgr2=0x7fe424160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe423fff640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe40c0039c0 0x7fe424160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe423fff640 1 -- 172.21.15.67:0/419827687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42415e2b0 con 0x7fe42415f350 2024-09-19T05:43:40.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe4297e1640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe42409f970 0x7fe42409fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:40.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe423fff640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe42415f350 0x7fe4241567d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fe41800e770 tx=0x7fe41800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:40.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe4217fa640 1 -- 172.21.15.67:0/419827687 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418017070 con 0x7fe42415f350 2024-09-19T05:43:40.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe4217fa640 1 -- 172.21.15.67:0/419827687 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41800ee80 con 0x7fe42415f350 2024-09-19T05:43:40.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 -- 172.21.15.67:0/419827687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42415e590 con 0x7fe42415f350 2024-09-19T05:43:40.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe4217fa640 1 -- 172.21.15.67:0/419827687 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41800cae0 con 0x7fe42415f350 2024-09-19T05:43:40.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 -- 172.21.15.67:0/419827687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42415eb50 con 0x7fe42415f350 2024-09-19T05:43:40.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe42b244640 1 -- 172.21.15.67:0/419827687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4241629b0 con 0x7fe42415f350 2024-09-19T05:43:40.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe4217fa640 1 -- 172.21.15.67:0/419827687 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe41801a070 con 0x7fe42415f350 2024-09-19T05:43:40.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.217+0000 7fe4217fa640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4100678c0 0x7fe410069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.221+0000 7fe4217fa640 1 -- 172.21.15.67:0/419827687 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5335+0+0 (secure 0 0 0) 0x7fe418085be0 con 0x7fe42415f350 2024-09-19T05:43:40.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.221+0000 7fe428fe0640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4100678c0 0x7fe410069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.221+0000 7fe428fe0640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4100678c0 0x7fe410069d80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0ad000 tx=0x7fe41c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:40.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.225+0000 7fe4217fa640 1 -- 172.21.15.67:0/419827687 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe418056240 con 0x7fe42415f350 2024-09-19T05:43:40.280 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:43:40.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:43:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 -- 172.21.15.67:0/419827687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe42409bca0 con 0x7fe42415f350 2024-09-19T05:43:40.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe4217fa640 1 -- 172.21.15.67:0/419827687 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) ==== 93+0+10 (secure 0 0 0) 0x7fe41805a540 con 0x7fe42415f350 2024-09-19T05:43:40.383 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:43:40.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 -- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4100678c0 msgr2=0x7fe410069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4100678c0 0x7fe410069d80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0ad000 tx=0x7fe41c0a7000 comp rx=0 tx=0).stop 2024-09-19T05:43:40.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 -- 172.21.15.67:0/419827687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe42415f350 msgr2=0x7fe4241567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe42415f350 0x7fe4241567d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fe41800e770 tx=0x7fe41800ec30 comp rx=0 tx=0).stop 2024-09-19T05:43:40.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 -- 172.21.15.67:0/419827687 shutdown_connections 2024-09-19T05:43:40.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4100678c0 0x7fe410069d80 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe42409f970 0x7fe42409fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe42415f350 0x7fe4241567d0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 --2- 172.21.15.67:0/419827687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe40c0039c0 0x7fe424160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 -- 172.21.15.67:0/419827687 >> 172.21.15.67:0/419827687 conn(0x7fe4240b3f30 msgr2=0x7fe424158000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:40.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 -- 172.21.15.67:0/419827687 shutdown_connections 2024-09-19T05:43:40.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.385+0000 7fe42b244640 1 -- 172.21.15.67:0/419827687 wait complete. 2024-09-19T05:43:40.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-19T05:43:40.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36fead640 1 Processor -- start 2024-09-19T05:43:40.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36fead640 1 -- start start 2024-09-19T05:43:40.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36fead640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe36815e640 0x7fe3680b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36fead640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe3680ae0a0 0x7fe3680b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36fead640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3680b2430 0x7fe36806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36fead640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe3680b4780 con 0x7fe36815e640 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36fead640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe3680b5b90 con 0x7fe3680ae0a0 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36fead640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe3680ae510 con 0x7fe3680b2430 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36dc49640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe36815e640 0x7fe3680b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36dc49640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe36815e640 0x7fe3680b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43168/0 (socket says 172.21.15.67:43168) 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36dc49640 1 -- 172.21.15.67:0/662384911 learned_addr learned my addr 172.21.15.67:0/662384911 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36d448640 1 --2- 172.21.15.67:0/662384911 >> v2:172.21.15.97:3300/0 conn(0x7fe3680ae0a0 0x7fe3680b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36e44a640 1 --2- 172.21.15.67:0/662384911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3680b2430 0x7fe36806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36dc49640 1 -- 172.21.15.67:0/662384911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3680b2430 msgr2=0x7fe36806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36dc49640 1 --2- 172.21.15.67:0/662384911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3680b2430 0x7fe36806bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36dc49640 1 -- 172.21.15.67:0/662384911 >> v2:172.21.15.97:3300/0 conn(0x7fe3680ae0a0 msgr2=0x7fe3680b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:40.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36dc49640 1 --2- 172.21.15.67:0/662384911 >> v2:172.21.15.97:3300/0 conn(0x7fe3680ae0a0 0x7fe3680b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36dc49640 1 -- 172.21.15.67:0/662384911 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3680b15f0 con 0x7fe36815e640 2024-09-19T05:43:40.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.513+0000 7fe36e44a640 1 --2- 172.21.15.67:0/662384911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3680b2430 0x7fe36806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:40.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36dc49640 1 --2- 172.21.15.67:0/662384911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe36815e640 0x7fe3680b6050 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe368073d90 tx=0x7fe36401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a0c56afb829efe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:40.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36cc47640 1 -- 172.21.15.67:0/662384911 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3640b0070 con 0x7fe36815e640 2024-09-19T05:43:40.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36cc47640 1 -- 172.21.15.67:0/662384911 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3640a4e50 con 0x7fe36815e640 2024-09-19T05:43:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36cc47640 1 -- 172.21.15.67:0/662384911 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3640ab820 con 0x7fe36815e640 2024-09-19T05:43:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 -- 172.21.15.67:0/662384911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe36815e640 msgr2=0x7fe3680b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 --2- 172.21.15.67:0/662384911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe36815e640 0x7fe3680b6050 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe368073d90 tx=0x7fe36401c400 comp rx=0 tx=0).stop 2024-09-19T05:43:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 -- 172.21.15.67:0/662384911 shutdown_connections 2024-09-19T05:43:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 --2- 172.21.15.67:0/662384911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3680b2430 0x7fe36806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 --2- 172.21.15.67:0/662384911 >> v2:172.21.15.97:3300/0 conn(0x7fe3680ae0a0 0x7fe3680b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 --2- 172.21.15.67:0/662384911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe36815e640 0x7fe3680b6050 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 -- 172.21.15.67:0/662384911 >> 172.21.15.67:0/662384911 conn(0x7fe36809aa30 msgr2=0x7fe3680b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 -- 172.21.15.67:0/662384911 shutdown_connections 2024-09-19T05:43:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 -- 172.21.15.67:0/662384911 wait complete. 2024-09-19T05:43:40.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 Processor -- start 2024-09-19T05:43:40.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 -- start start 2024-09-19T05:43:40.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3680ae0a0 0x7fe368151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3680b2430 0x7fe36809b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe36815e640 0x7fe368160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe3680b0790 con 0x7fe3680ae0a0 2024-09-19T05:43:40.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe36806c610 con 0x7fe3680b2430 2024-09-19T05:43:40.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36fead640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe3680b0910 con 0x7fe36815e640 2024-09-19T05:43:40.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36dc49640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3680ae0a0 0x7fe368151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36dc49640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3680ae0a0 0x7fe368151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43174/0 (socket says 172.21.15.67:43174) 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36dc49640 1 -- 172.21.15.67:0/2717934596 learned_addr learned my addr 172.21.15.67:0/2717934596 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.517+0000 7fe36d448640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3680b2430 0x7fe36809b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36dc49640 1 -- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe36815e640 msgr2=0x7fe368160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36dc49640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe36815e640 0x7fe368160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36dc49640 1 -- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3680b2430 msgr2=0x7fe36809b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36dc49640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3680b2430 0x7fe36809b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36dc49640 1 -- 172.21.15.67:0/2717934596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36806ebe0 con 0x7fe3680ae0a0 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36dc49640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3680ae0a0 0x7fe368151490 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fe3640ae040 tx=0x7fe3640191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe35e7fc640 1 -- 172.21.15.67:0/2717934596 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3640b0040 con 0x7fe3680ae0a0 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe35e7fc640 1 -- 172.21.15.67:0/2717934596 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3640b9070 con 0x7fe3680ae0a0 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36fead640 1 -- 172.21.15.67:0/2717934596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe368156690 con 0x7fe3680ae0a0 2024-09-19T05:43:40.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe35e7fc640 1 -- 172.21.15.67:0/2717934596 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3640b4680 con 0x7fe3680ae0a0 2024-09-19T05:43:40.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36fead640 1 -- 172.21.15.67:0/2717934596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe368160220 con 0x7fe3680ae0a0 2024-09-19T05:43:40.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36fead640 1 -- 172.21.15.67:0/2717934596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3680b4150 con 0x7fe3680ae0a0 2024-09-19T05:43:40.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe35e7fc640 1 -- 172.21.15.67:0/2717934596 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3640b4820 con 0x7fe3680ae0a0 2024-09-19T05:43:40.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe35e7fc640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe34c0678c0 0x7fe34c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:40.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe35e7fc640 1 -- 172.21.15.67:0/2717934596 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5335+0+0 (secure 0 0 0) 0x7fe36411f5e0 con 0x7fe3680ae0a0 2024-09-19T05:43:40.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36d448640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe34c0678c0 0x7fe34c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:40.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.521+0000 7fe36d448640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe34c0678c0 0x7fe34c069d80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe3681553c0 tx=0x7fe358008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:40.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.525+0000 7fe35e7fc640 1 -- 172.21.15.67:0/2717934596 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe364016110 con 0x7fe3680ae0a0 2024-09-19T05:43:40.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:40.741+0000 7fe36fead640 1 -- 172.21.15.67:0/2717934596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7fe368155110 con 0x7fe3680ae0a0 2024-09-19T05:43:41.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.733+0000 7fe35e7fc640 1 -- 172.21.15.67:0/2717934596 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v466) ==== 158+0+0 (secure 0 0 0) 0x7fe3640abe20 con 0x7fe3680ae0a0 2024-09-19T05:43:41.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 -- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe34c0678c0 msgr2=0x7fe34c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:41.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe34c0678c0 0x7fe34c069d80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe3681553c0 tx=0x7fe358008040 comp rx=0 tx=0).stop 2024-09-19T05:43:41.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 -- 172.21.15.67:0/2717934596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3680ae0a0 msgr2=0x7fe368151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:41.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3680ae0a0 0x7fe368151490 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fe3640ae040 tx=0x7fe3640191a0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 -- 172.21.15.67:0/2717934596 shutdown_connections 2024-09-19T05:43:41.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe34c0678c0 0x7fe34c069d80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe36815e640 0x7fe368160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3680b2430 0x7fe36809b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 --2- 172.21.15.67:0/2717934596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3680ae0a0 0x7fe368151490 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 -- 172.21.15.67:0/2717934596 >> 172.21.15.67:0/2717934596 conn(0x7fe36809aa30 msgr2=0x7fe36815d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:41.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 -- 172.21.15.67:0/2717934596 shutdown_connections 2024-09-19T05:43:41.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.737+0000 7fe36fead640 1 -- 172.21.15.67:0/2717934596 wait complete. 2024-09-19T05:43:41.761 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.893+0000 7f5846aea640 1 Processor -- start 2024-09-19T05:43:41.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.893+0000 7f5846aea640 1 -- start start 2024-09-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f5846aea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f58400b5f80 0x7f58400b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f5846aea640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58400cf410 con 0x7f584006d920 2024-09-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f5846aea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58400cf6f0 con 0x7f584015e5c0 2024-09-19T05:43:41.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f5846aea640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f58400b6930 con 0x7f58400b5f80 2024-09-19T05:43:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f584006d920 0x7f58400b7560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33806/0 (socket says 172.21.15.67:33806) 2024-09-19T05:43:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583ffff640 1 -- 172.21.15.67:0/2897612444 learned_addr learned my addr 172.21.15.67:0/2897612444 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f5845087640 1 --2- 172.21.15.67:0/2897612444 >> v2:172.21.15.97:3300/0 conn(0x7f58400b5f80 0x7f58400b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 216985647 0 0) 0x7f58400cf410 con 0x7f584006d920 2024-09-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5830003530 con 0x7f584006d920 2024-09-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3562077363 0 0) 0x7f5830003530 con 0x7f584006d920 2024-09-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 >> v2:172.21.15.97:3300/0 conn(0x7f58400b5f80 msgr2=0x7f58400b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 --2- 172.21.15.67:0/2897612444 >> v2:172.21.15.97:3300/0 conn(0x7f58400b5f80 0x7f58400b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 >> v1:172.21.15.97:6789/0 conn(0x7f584015e5c0 legacy=0x7f58400d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58400cf9d0 con 0x7f584006d920 2024-09-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f582c001680 con 0x7f584006d920 2024-09-19T05:43:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 >> v1:172.21.15.67:6789/0 conn(0x7f584006d920 legacy=0x7f58400b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58300039c0 0x7f5830003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5830004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58300051d0 0x7f583000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f58400b6930 con 0x7f5830004810 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f583000c080 con 0x7f58300039c0 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f583000c280 con 0x7f58300051d0 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583ffff640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5830004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f5844886640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58300039c0 0x7f5830003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f5845087640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58300051d0 0x7f583000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583ffff640 1 -- 172.21.15.67:0/2897612444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58300051d0 msgr2=0x7f583000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583ffff640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58300051d0 0x7f583000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583ffff640 1 -- 172.21.15.67:0/2897612444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58300039c0 msgr2=0x7f5830003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583ffff640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58300039c0 0x7f5830003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f583ffff640 1 -- 172.21.15.67:0/2897612444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5830003530 con 0x7f5830004810 2024-09-19T05:43:41.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.897+0000 7f5845087640 1 -- 172.21.15.67:0/2897612444 reap_dead start 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f583ffff640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5830004c90 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c210 tx=0x7f582c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74d220c14bb5864 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c007d40 con 0x7f5830004810 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c0a9070 con 0x7f5830004810 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f583f7fe640 1 -- 172.21.15.67:0/2897612444 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c0a5dc0 con 0x7f5830004810 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f5846aea640 1 -- 172.21.15.67:0/2897612444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 msgr2=0x7f5830004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f5846aea640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5830004c90 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c210 tx=0x7f582c01cc20 comp rx=0 tx=0).stop 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f5846aea640 1 -- 172.21.15.67:0/2897612444 shutdown_connections 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f5846aea640 1 --2- 172.21.15.67:0/2897612444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5830004c90 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f5846aea640 1 -- 172.21.15.67:0/2897612444 >> 172.21.15.67:0/2897612444 conn(0x7f58400d46b0 msgr2=0x7f58400d4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f5846aea640 1 -- 172.21.15.67:0/2897612444 shutdown_connections 2024-09-19T05:43:41.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f5846aea640 1 -- 172.21.15.67:0/2897612444 wait complete. 2024-09-19T05:43:41.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f5846aea640 1 Processor -- start 2024-09-19T05:43:41.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.901+0000 7f5846aea640 1 -- start start 2024-09-19T05:43:41.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5846aea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5840157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:41.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5846aea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58400cdf00 0x7f58400ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:41.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5846aea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58400cbfa0 0x7f58400cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:41.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5846aea640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f58400b6780 con 0x7f5830004810 2024-09-19T05:43:41.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5846aea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f58400b6600 con 0x7f58400cbfa0 2024-09-19T05:43:41.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5846aea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f584015e9a0 con 0x7f58400cdf00 2024-09-19T05:43:41.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5844886640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5840157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5844886640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5840157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43194/0 (socket says 172.21.15.67:43194) 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5844886640 1 -- 172.21.15.67:0/1742308768 learned_addr learned my addr 172.21.15.67:0/1742308768 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5845087640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58400cbfa0 0x7f58400cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f583ffff640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58400cdf00 0x7f58400ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5844886640 1 -- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58400cdf00 msgr2=0x7f58400ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5844886640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58400cdf00 0x7f58400ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5844886640 1 -- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58400cbfa0 msgr2=0x7f58400cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5844886640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58400cbfa0 0x7f58400cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5844886640 1 -- 172.21.15.67:0/1742308768 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5840158190 con 0x7f5830004810 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5845087640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58400cbfa0 0x7f58400cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5844886640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5840157c50 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f583400f7f0 tx=0x7f583400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f583d7fa640 1 -- 172.21.15.67:0/1742308768 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58340050d0 con 0x7f5830004810 2024-09-19T05:43:41.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f583d7fa640 1 -- 172.21.15.67:0/1742308768 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5834018070 con 0x7f5830004810 2024-09-19T05:43:41.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5846aea640 1 -- 172.21.15.67:0/1742308768 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58400c7f70 con 0x7f5830004810 2024-09-19T05:43:41.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f583d7fa640 1 -- 172.21.15.67:0/1742308768 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5834005490 con 0x7f5830004810 2024-09-19T05:43:41.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5846aea640 1 -- 172.21.15.67:0/1742308768 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58400c8530 con 0x7f5830004810 2024-09-19T05:43:41.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f5846aea640 1 -- 172.21.15.67:0/1742308768 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58400d28a0 con 0x7f5830004810 2024-09-19T05:43:41.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f583d7fa640 1 -- 172.21.15.67:0/1742308768 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f583400d730 con 0x7f5830004810 2024-09-19T05:43:41.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f583d7fa640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5824067a90 0x7f5824069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:41.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f583d7fa640 1 -- 172.21.15.67:0/1742308768 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5335+0+0 (secure 0 0 0) 0x7f5834085890 con 0x7f5830004810 2024-09-19T05:43:41.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.905+0000 7f583ffff640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5824067a90 0x7f5824069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:41.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.909+0000 7f583ffff640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5824067a90 0x7f5824069f50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f582c0ab000 tx=0x7f582c0b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:41.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:41.909+0000 7f583d7fa640 1 -- 172.21.15.67:0/1742308768 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f58340565d0 con 0x7f5830004810 2024-09-19T05:43:42.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.077+0000 7f5846aea640 1 -- 172.21.15.67:0/1742308768 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f58400cec00 con 0x7f5830004810 2024-09-19T05:43:42.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.081+0000 7f583d7fa640 1 -- 172.21.15.67:0/1742308768 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f5834055ed0 con 0x7f5830004810 2024-09-19T05:43:42.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 -- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5824067a90 msgr2=0x7f5824069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5824067a90 0x7f5824069f50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f582c0ab000 tx=0x7f582c0b0040 comp rx=0 tx=0).stop 2024-09-19T05:43:42.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 -- 172.21.15.67:0/1742308768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 msgr2=0x7f5840157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5840157c50 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f583400f7f0 tx=0x7f583400fcb0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 -- 172.21.15.67:0/1742308768 shutdown_connections 2024-09-19T05:43:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58400cbfa0 0x7f58400cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5824067a90 0x7f5824069f50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58400cdf00 0x7f58400ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 --2- 172.21.15.67:0/1742308768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5830004810 0x7f5840157c50 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 -- 172.21.15.67:0/1742308768 >> 172.21.15.67:0/1742308768 conn(0x7f58400d46b0 msgr2=0x7f58400d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 -- 172.21.15.67:0/1742308768 shutdown_connections 2024-09-19T05:43:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.085+0000 7f5846aea640 1 -- 172.21.15.67:0/1742308768 wait complete. 2024-09-19T05:43:42.104 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:43:42.105 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:43:42.188 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:43:42.254 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:43:42.254 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:43:42.254 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:43:42.260 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:43:42.261 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:43:42.261 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:43:42.266 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:43:42.266 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:43:42.266 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:43:42.307 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:43:42.307 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:43:42.307 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:43:42.312 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:43:42.313 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:43:42.313 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:43:42.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.485+0000 7f09d84b9640 1 Processor -- start 2024-09-19T05:43:42.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.485+0000 7f09d84b9640 1 -- start start 2024-09-19T05:43:42.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.485+0000 7f09d84b9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f09d015c0d0 0x7f09d00b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.485+0000 7f09d84b9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f09d015c4b0 0x7f09d00b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.485+0000 7f09d84b9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09d00b5790 con 0x7f09d00709a0 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.485+0000 7f09d84b9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f09d00b5a70 con 0x7f09d015c0d0 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.485+0000 7f09d84b9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f09d015ca00 con 0x7f09d015c4b0 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.485+0000 7f09d6255640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f09d015c0d0 0x7f09d00b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.485+0000 7f09d6255640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f09d015c0d0 0x7f09d00b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43210/0 (socket says 172.21.15.67:43210) 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.485+0000 7f09d6255640 1 -- 172.21.15.67:0/4100725134 learned_addr learned my addr 172.21.15.67:0/4100725134 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d5a54640 1 --2- 172.21.15.67:0/4100725134 >> v2:172.21.15.97:3300/0 conn(0x7f09d015c4b0 0x7f09d00b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d6255640 1 -- 172.21.15.67:0/4100725134 >> v2:172.21.15.97:3300/0 conn(0x7f09d015c4b0 msgr2=0x7f09d00b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d6255640 1 --2- 172.21.15.67:0/4100725134 >> v2:172.21.15.97:3300/0 conn(0x7f09d015c4b0 0x7f09d00b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d6255640 1 -- 172.21.15.67:0/4100725134 >> v1:172.21.15.97:6789/0 conn(0x7f09d00709a0 legacy=0x7f09d015fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:42.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d6255640 1 -- 172.21.15.67:0/4100725134 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d015cce0 con 0x7f09d015c0d0 2024-09-19T05:43:42.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d5a54640 1 --2- 172.21.15.67:0/4100725134 >> v2:172.21.15.97:3300/0 conn(0x7f09d015c4b0 0x7f09d00b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:42.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d6255640 1 --2- 172.21.15.67:0/4100725134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 0x7f09d00b3bd0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f09d00b0810 tx=0x7f09cc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05138d7e793666d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:42.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d5253640 1 -- 172.21.15.67:0/4100725134 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0aa660 con 0x7f09d015c0d0 2024-09-19T05:43:42.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d5253640 1 -- 172.21.15.67:0/4100725134 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc0af070 con 0x7f09d015c0d0 2024-09-19T05:43:42.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d5253640 1 -- 172.21.15.67:0/4100725134 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0aaa20 con 0x7f09d015c0d0 2024-09-19T05:43:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d84b9640 1 -- 172.21.15.67:0/4100725134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 msgr2=0x7f09d00b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d84b9640 1 --2- 172.21.15.67:0/4100725134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 0x7f09d00b3bd0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f09d00b0810 tx=0x7f09cc01c4e0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d84b9640 1 -- 172.21.15.67:0/4100725134 shutdown_connections 2024-09-19T05:43:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d84b9640 1 --2- 172.21.15.67:0/4100725134 >> v2:172.21.15.97:3300/0 conn(0x7f09d015c4b0 0x7f09d00b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d84b9640 1 --2- 172.21.15.67:0/4100725134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 0x7f09d00b3bd0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d84b9640 1 -- 172.21.15.67:0/4100725134 >> 172.21.15.67:0/4100725134 conn(0x7f09d0073500 msgr2=0x7f09d006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d84b9640 1 -- 172.21.15.67:0/4100725134 shutdown_connections 2024-09-19T05:43:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.489+0000 7f09d84b9640 1 -- 172.21.15.67:0/4100725134 wait complete. 2024-09-19T05:43:42.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 Processor -- start 2024-09-19T05:43:42.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 -- start start 2024-09-19T05:43:42.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09d00709a0 0x7f09d0155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 0x7f09d014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09d015c4b0 0x7f09d015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f09d0169460 con 0x7f09d015c0d0 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f09d01692e0 con 0x7f09d00709a0 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f09d01695e0 con 0x7f09d015c4b0 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d5a54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 0x7f09d014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d5a54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 0x7f09d014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43222/0 (socket says 172.21.15.67:43222) 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d5a54640 1 -- 172.21.15.67:0/2334141892 learned_addr learned my addr 172.21.15.67:0/2334141892 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d6a56640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09d015c4b0 0x7f09d015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d6255640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09d00709a0 0x7f09d0155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d5a54640 1 -- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09d015c4b0 msgr2=0x7f09d015a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d5a54640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09d015c4b0 0x7f09d015a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d5a54640 1 -- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09d00709a0 msgr2=0x7f09d0155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d5a54640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09d00709a0 0x7f09d0155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d5a54640 1 -- 172.21.15.67:0/2334141892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d0166cc0 con 0x7f09d015c0d0 2024-09-19T05:43:42.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d5a54640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 0x7f09d014f670 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f09c000c7f0 tx=0x7f09c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:42.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09c6ffd640 1 -- 172.21.15.67:0/2334141892 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0015070 con 0x7f09d015c0d0 2024-09-19T05:43:42.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09c6ffd640 1 -- 172.21.15.67:0/2334141892 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c0007820 con 0x7f09d015c0d0 2024-09-19T05:43:42.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 -- 172.21.15.67:0/2334141892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d0166210 con 0x7f09d015c0d0 2024-09-19T05:43:42.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09c6ffd640 1 -- 172.21.15.67:0/2334141892 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0007c10 con 0x7f09d015c0d0 2024-09-19T05:43:42.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 -- 172.21.15.67:0/2334141892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d0165970 con 0x7f09d015c0d0 2024-09-19T05:43:42.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09d84b9640 1 -- 172.21.15.67:0/2334141892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d015fd30 con 0x7f09d015c0d0 2024-09-19T05:43:42.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.493+0000 7f09c6ffd640 1 -- 172.21.15.67:0/2334141892 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09c0018070 con 0x7f09d015c0d0 2024-09-19T05:43:42.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.497+0000 7f09c6ffd640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b40678c0 0x7f09b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.497+0000 7f09c6ffd640 1 -- 172.21.15.67:0/2334141892 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5335+0+0 (secure 0 0 0) 0x7f09c0085bc0 con 0x7f09d015c0d0 2024-09-19T05:43:42.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.497+0000 7f09d6255640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b40678c0 0x7f09b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.497+0000 7f09d6255640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b40678c0 0x7f09b4069d80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0ae000 tx=0x7f09cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:42.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.501+0000 7f09c6ffd640 1 -- 172.21.15.67:0/2334141892 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f09c0056900 con 0x7f09d015c0d0 2024-09-19T05:43:42.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.693+0000 7f09d84b9640 1 -- 172.21.15.67:0/2334141892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09d006ca10 con 0x7f09d015c0d0 2024-09-19T05:43:42.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09c6ffd640 1 -- 172.21.15.67:0/2334141892 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+3908 (secure 0 0 0) 0x7f09c0056200 con 0x7f09d015c0d0 2024-09-19T05:43:42.695 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:42.696 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":93,"btime":"2024-09-19T05:43:36:705747+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/617137818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":617137818},{"type":"v1","addr":"172.21.15.97:6835","nonce":617137818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":6862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3709077281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3709077281},{"type":"v1","addr":"172.21.15.97:6837","nonce":3709077281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1889576066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1889576066},{"type":"v1","addr":"172.21.15.67:6833","nonce":1889576066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2405198563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2405198563},{"type":"v1","addr":"172.21.15.67:6835","nonce":2405198563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[]} 2024-09-19T05:43:42.696 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 93 2024-09-19T05:43:42.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 -- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b40678c0 msgr2=0x7f09b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b40678c0 0x7f09b4069d80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0ae000 tx=0x7f09cc008040 comp rx=0 tx=0).stop 2024-09-19T05:43:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 -- 172.21.15.67:0/2334141892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 msgr2=0x7f09d014f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 0x7f09d014f670 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f09c000c7f0 tx=0x7f09c000ccb0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 -- 172.21.15.67:0/2334141892 shutdown_connections 2024-09-19T05:43:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09b40678c0 0x7f09b4069d80 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09d015c4b0 0x7f09d015a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d015c0d0 0x7f09d014f670 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 --2- 172.21.15.67:0/2334141892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09d00709a0 0x7f09d0155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 -- 172.21.15.67:0/2334141892 >> 172.21.15.67:0/2334141892 conn(0x7f09d0073500 msgr2=0x7f09d00b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 -- 172.21.15.67:0/2334141892 shutdown_connections 2024-09-19T05:43:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.697+0000 7f09d84b9640 1 -- 172.21.15.67:0/2334141892 wait complete. 2024-09-19T05:43:42.713 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:43:42.714 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:43:42.714 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:43:42.714 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:43:42.714 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:43:42.714 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:43:42.714 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:43:42.714 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:43:42.715 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:43:42.715 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:43:42.715 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:43:42.715 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:43:42.715 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:43:42.715 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:43:42.715 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:43:42.716 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:43:42.723 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:43:42.723 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:43:42.725 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:43:42.726 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:43:42.735 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:43:42.735 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:43:42.736 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:43:42.736 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:43:42.771 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:43:42.771 DEBUG:teuthology.parallel:result is None 2024-09-19T05:43:42.772 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:43:42.772 DEBUG:teuthology.parallel:result is None 2024-09-19T05:43:42.778 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:43:42.778 DEBUG:teuthology.parallel:result is None 2024-09-19T05:43:42.779 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:43:42.779 DEBUG:teuthology.parallel:result is None 2024-09-19T05:43:42.779 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:43:42.830 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:43:42.837 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:43:42.852 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:43:42.853 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:43:42.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.885+0000 7f0f7d9bf640 1 Processor -- start 2024-09-19T05:43:42.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.885+0000 7f0f7d9bf640 1 -- start start 2024-09-19T05:43:42.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f780d1590 0x7f0f780d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0f780b51d0 0x7f0f780cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f780d4d40 con 0x7f0f78161da0 2024-09-19T05:43:42.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0f780d0840 con 0x7f0f780b51d0 2024-09-19T05:43:42.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f780d5020 con 0x7f0f780d1590 2024-09-19T05:43:42.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f777fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0f780b51d0 0x7f0f780cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f76ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0f78161da0 0x7f0f780d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33820/0 (socket says 172.21.15.67:33820) 2024-09-19T05:43:42.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f76ffd640 1 -- 172.21.15.67:0/2666781820 learned_addr learned my addr 172.21.15.67:0/2666781820 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:42.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f767fc640 1 --2- 172.21.15.67:0/2666781820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f780d1590 0x7f0f780d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f777fe640 1 -- 172.21.15.67:0/2666781820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f780d1590 msgr2=0x7f0f780d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:42.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f777fe640 1 --2- 172.21.15.67:0/2666781820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f780d1590 0x7f0f780d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f777fe640 1 -- 172.21.15.67:0/2666781820 >> v1:172.21.15.67:6789/0 conn(0x7f0f78161da0 legacy=0x7f0f780d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f75ffb640 1 -- 172.21.15.67:0/2666781820 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122107357 0 0) 0x7f0f780d4d40 con 0x7f0f78161da0 2024-09-19T05:43:42.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f777fe640 1 -- 172.21.15.67:0/2666781820 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f780d5300 con 0x7f0f780b51d0 2024-09-19T05:43:42.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f777fe640 1 --2- 172.21.15.67:0/2666781820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 0x7f0f780cf150 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f0f700097c0 tx=0x7f0f7001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cddf5824ce4b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f75ffb640 1 -- 172.21.15.67:0/2666781820 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f700b0070 con 0x7f0f780b51d0 2024-09-19T05:43:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f75ffb640 1 -- 172.21.15.67:0/2666781820 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f700ab600 con 0x7f0f780b51d0 2024-09-19T05:43:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f75ffb640 1 -- 172.21.15.67:0/2666781820 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f700ab9d0 con 0x7f0f780b51d0 2024-09-19T05:43:42.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2666781820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 msgr2=0x7f0f780cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 --2- 172.21.15.67:0/2666781820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 0x7f0f780cf150 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f0f700097c0 tx=0x7f0f7001c4a0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2666781820 shutdown_connections 2024-09-19T05:43:42.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 --2- 172.21.15.67:0/2666781820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 0x7f0f780cf150 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 --2- 172.21.15.67:0/2666781820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f780d1590 0x7f0f780d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2666781820 >> 172.21.15.67:0/2666781820 conn(0x7f0f7808bfc0 msgr2=0x7f0f780d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:42.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2666781820 shutdown_connections 2024-09-19T05:43:42.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.889+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2666781820 wait complete. 2024-09-19T05:43:42.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 Processor -- start 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 -- start start 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 0x7f0f7814e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f780d1590 0x7f0f780cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f78161da0 0x7f0f780b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780d0020 con 0x7f0f780b51d0 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780cfea0 con 0x7f0f78161da0 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f780d01a0 con 0x7f0f780d1590 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f76ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 0x7f0f7814e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f76ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 0x7f0f7814e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43284/0 (socket says 172.21.15.67:43284) 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f76ffd640 1 -- 172.21.15.67:0/2495283909 learned_addr learned my addr 172.21.15.67:0/2495283909 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f767fc640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f780d1590 0x7f0f780cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f777fe640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f78161da0 0x7f0f780b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f76ffd640 1 -- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f780d1590 msgr2=0x7f0f780cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f76ffd640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f780d1590 0x7f0f780cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f76ffd640 1 -- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f78161da0 msgr2=0x7f0f780b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f76ffd640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f78161da0 0x7f0f780b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f76ffd640 1 -- 172.21.15.67:0/2495283909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f781594f0 con 0x7f0f780b51d0 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f76ffd640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 0x7f0f7814e470 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800c480 tx=0x7f0f6800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f6ffff640 1 -- 172.21.15.67:0/2495283909 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68018070 con 0x7f0f780b51d0 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f6ffff640 1 -- 172.21.15.67:0/2495283909 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f68007500 con 0x7f0f780b51d0 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2495283909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f780cc010 con 0x7f0f780b51d0 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f6ffff640 1 -- 172.21.15.67:0/2495283909 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68004a30 con 0x7f0f780b51d0 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2495283909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f780cc5d0 con 0x7f0f780b51d0 2024-09-19T05:43:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.893+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2495283909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f780cf150 con 0x7f0f780b51d0 2024-09-19T05:43:42.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.897+0000 7f0f6ffff640 1 -- 172.21.15.67:0/2495283909 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f6801b070 con 0x7f0f780b51d0 2024-09-19T05:43:42.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.897+0000 7f0f6ffff640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f580678c0 0x7f0f58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:42.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.897+0000 7f0f6ffff640 1 -- 172.21.15.67:0/2495283909 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5335+0+0 (secure 0 0 0) 0x7f0f68084d70 con 0x7f0f780b51d0 2024-09-19T05:43:42.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.897+0000 7f0f767fc640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f580678c0 0x7f0f58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:42.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.897+0000 7f0f767fc640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f580678c0 0x7f0f58069d80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0f60003fd0 tx=0x7f0f600039c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:42.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:42.901+0000 7f0f6ffff640 1 -- 172.21.15.67:0/2495283909 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0f68055ab0 con 0x7f0f780b51d0 2024-09-19T05:43:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.073+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2495283909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0f78158750 con 0x7f0f780b51d0 2024-09-19T05:43:43.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.757+0000 7f0f6ffff640 1 -- 172.21.15.67:0/2495283909 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v137) ==== 97+0+0 (secure 0 0 0) 0x7f0f680553b0 con 0x7f0f780b51d0 2024-09-19T05:43:43.757 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:43:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f580678c0 msgr2=0x7f0f58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f580678c0 0x7f0f58069d80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0f60003fd0 tx=0x7f0f600039c0 comp rx=0 tx=0).stop 2024-09-19T05:43:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2495283909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 msgr2=0x7f0f7814e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 0x7f0f7814e470 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800c480 tx=0x7f0f6800c940 comp rx=0 tx=0).stop 2024-09-19T05:43:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2495283909 shutdown_connections 2024-09-19T05:43:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f78161da0 0x7f0f780b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f580678c0 0x7f0f58069d80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f780d1590 0x7f0f780cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 --2- 172.21.15.67:0/2495283909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f780b51d0 0x7f0f7814e470 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2495283909 >> 172.21.15.67:0/2495283909 conn(0x7f0f7808bfc0 msgr2=0x7f0f78160e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2495283909 shutdown_connections 2024-09-19T05:43:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.761+0000 7f0f7d9bf640 1 -- 172.21.15.67:0/2495283909 wait complete. 2024-09-19T05:43:43.782 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:43:43.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faf04c17640 1 Processor -- start 2024-09-19T05:43:43.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faf04c17640 1 -- start start 2024-09-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faf04c17640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faf0015b1e0 0x7faf000b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:43.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faf04c17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 0x7faf00071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faf04c17640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf000b3860 con 0x7faf000723c0 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faf04c17640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7faf0015b5c0 con 0x7faf0015b1e0 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faf04c17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faf000b3b40 con 0x7faf000b4900 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faefe59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faf0015b1e0 0x7faf000b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faefe59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faf0015b1e0 0x7faf000b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43300/0 (socket says 172.21.15.67:43300) 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faefe59c640 1 -- 172.21.15.67:0/609827306 learned_addr learned my addr 172.21.15.67:0/609827306 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faefdd9b640 1 --2- 172.21.15.67:0/609827306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 0x7faf00071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faefe59c640 1 -- 172.21.15.67:0/609827306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 msgr2=0x7faf00071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faefe59c640 1 --2- 172.21.15.67:0/609827306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 0x7faf00071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faefe59c640 1 -- 172.21.15.67:0/609827306 >> v1:172.21.15.67:6789/0 conn(0x7faf000723c0 legacy=0x7faf0015ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:43.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.909+0000 7faefe59c640 1 -- 172.21.15.67:0/609827306 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf000b3e20 con 0x7faf0015b1e0 2024-09-19T05:43:43.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faefe59c640 1 --2- 172.21.15.67:0/609827306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf0015b1e0 0x7faf000b2fd0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7faef0009870 tx=0x7faef001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83090fa983de8a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:43.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faefd59a640 1 -- 172.21.15.67:0/609827306 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef00a9610 con 0x7faf0015b1e0 2024-09-19T05:43:43.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faefd59a640 1 -- 172.21.15.67:0/609827306 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef00a97b0 con 0x7faf0015b1e0 2024-09-19T05:43:43.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faefd59a640 1 -- 172.21.15.67:0/609827306 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef00a9b80 con 0x7faf0015b1e0 2024-09-19T05:43:43.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 -- 172.21.15.67:0/609827306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf0015b1e0 msgr2=0x7faf000b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:43.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 --2- 172.21.15.67:0/609827306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf0015b1e0 0x7faf000b2fd0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7faef0009870 tx=0x7faef001c530 comp rx=0 tx=0).stop 2024-09-19T05:43:43.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 -- 172.21.15.67:0/609827306 shutdown_connections 2024-09-19T05:43:43.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 --2- 172.21.15.67:0/609827306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 0x7faf00071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:43.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 --2- 172.21.15.67:0/609827306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf0015b1e0 0x7faf000b2fd0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:43.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 -- 172.21.15.67:0/609827306 >> 172.21.15.67:0/609827306 conn(0x7faf000d0080 msgr2=0x7faf000d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:43.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 -- 172.21.15.67:0/609827306 shutdown_connections 2024-09-19T05:43:43.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 -- 172.21.15.67:0/609827306 wait complete. 2024-09-19T05:43:43.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 Processor -- start 2024-09-19T05:43:43.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 -- start start 2024-09-19T05:43:43.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf000723c0 0x7faf0006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:43.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 0x7faf001462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:43.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf0015b1e0 0x7faf0015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faf00168060 con 0x7faf000723c0 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faf000b3510 con 0x7faf0015b1e0 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faf04c17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faf001681e0 con 0x7faf000b4900 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faefe59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf000723c0 0x7faf0006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faefe59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf000723c0 0x7faf0006ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43306/0 (socket says 172.21.15.67:43306) 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.913+0000 7faefe59c640 1 -- 172.21.15.67:0/1550054937 learned_addr learned my addr 172.21.15.67:0/1550054937 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefed9d640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf0015b1e0 0x7faf0015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefe59c640 1 -- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 msgr2=0x7faf001462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefdd9b640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 0x7faf001462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefe59c640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 0x7faf001462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefe59c640 1 -- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf0015b1e0 msgr2=0x7faf0015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefe59c640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf0015b1e0 0x7faf0015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefe59c640 1 -- 172.21.15.67:0/1550054937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf000d0c70 con 0x7faf000723c0 2024-09-19T05:43:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefed9d640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf0015b1e0 0x7faf0015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefdd9b640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 0x7faf001462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefe59c640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf000723c0 0x7faf0006ee60 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7faef00097c0 tx=0x7faef00192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faeeeffd640 1 -- 172.21.15.67:0/1550054937 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef00bb5f0 con 0x7faf000723c0 2024-09-19T05:43:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faeeeffd640 1 -- 172.21.15.67:0/1550054937 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef00bb790 con 0x7faf000723c0 2024-09-19T05:43:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faf04c17640 1 -- 172.21.15.67:0/1550054937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf001484a0 con 0x7faf000723c0 2024-09-19T05:43:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faeeeffd640 1 -- 172.21.15.67:0/1550054937 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef00bbb80 con 0x7faf000723c0 2024-09-19T05:43:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faf04c17640 1 -- 172.21.15.67:0/1550054937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf00148a60 con 0x7faf000723c0 2024-09-19T05:43:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faf04c17640 1 -- 172.21.15.67:0/1550054937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0015b7f0 con 0x7faf000723c0 2024-09-19T05:43:43.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faeeeffd640 1 -- 172.21.15.67:0/1550054937 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faef00c43f0 con 0x7faf000723c0 2024-09-19T05:43:43.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faeeeffd640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faee00678f0 0x7faee0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:43.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faeeeffd640 1 -- 172.21.15.67:0/1550054937 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5249+0+0 (secure 0 0 0) 0x7faef0120460 con 0x7faf000723c0 2024-09-19T05:43:43.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefdd9b640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faee00678f0 0x7faee0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:43.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.917+0000 7faefdd9b640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faee00678f0 0x7faee0069db0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7faf0015a240 tx=0x7faef4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:43.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:43.921+0000 7faeeeffd640 1 -- 172.21.15.67:0/1550054937 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7faef00ca080 con 0x7faf000723c0 2024-09-19T05:43:44.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.137+0000 7faf04c17640 1 -- 172.21.15.67:0/1550054937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7faf00071e80 con 0x7faf000723c0 2024-09-19T05:43:44.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faeeeffd640 1 -- 172.21.15.67:0/1550054937 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7faef00ad020 con 0x7faf000723c0 2024-09-19T05:43:44.139 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:44.139 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:43:44.139 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:43:44.139 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.139 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:43:44.139 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:43:44.140 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.141 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:43:44.142 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.143 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:43:44.144 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.145 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:43:44.146 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.147 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.148 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:43:44.149 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:43:44.150 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.151 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:43:44.152 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:43:44.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 -- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faee00678f0 msgr2=0x7faee0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faee00678f0 0x7faee0069db0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7faf0015a240 tx=0x7faef4008040 comp rx=0 tx=0).stop 2024-09-19T05:43:44.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 -- 172.21.15.67:0/1550054937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf000723c0 msgr2=0x7faf0006ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf000723c0 0x7faf0006ee60 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7faef00097c0 tx=0x7faef00192d0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 -- 172.21.15.67:0/1550054937 shutdown_connections 2024-09-19T05:43:44.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf0015b1e0 0x7faf0015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faee00678f0 0x7faee0069db0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000b4900 0x7faf001462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 --2- 172.21.15.67:0/1550054937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf000723c0 0x7faf0006ee60 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 -- 172.21.15.67:0/1550054937 >> 172.21.15.67:0/1550054937 conn(0x7faf000d0080 msgr2=0x7faf0006dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:44.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 -- 172.21.15.67:0/1550054937 shutdown_connections 2024-09-19T05:43:44.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.141+0000 7faf04c17640 1 -- 172.21.15.67:0/1550054937 wait complete. 2024-09-19T05:43:44.157 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:43:44.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36e5216640 1 Processor -- start 2024-09-19T05:43:44.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36e5216640 1 -- start start 2024-09-19T05:43:44.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36e5216640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e015e550 0x7f36e00d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36e5216640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f36e0161af0 0x7f36e015e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36e5216640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36e00d0bc0 con 0x7f36e009b5d0 2024-09-19T05:43:44.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36e5216640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f36e00d0970 con 0x7f36e0161af0 2024-09-19T05:43:44.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36e5216640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f36e00d0ea0 con 0x7f36e015e550 2024-09-19T05:43:44.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36df59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f36e0161af0 0x7f36e015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36df59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f36e0161af0 0x7f36e015e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43320/0 (socket says 172.21.15.67:43320) 2024-09-19T05:43:44.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36df59e640 1 -- 172.21.15.67:0/10044206 learned_addr learned my addr 172.21.15.67:0/10044206 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:44.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36ded9d640 1 --2- 172.21.15.67:0/10044206 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e015e550 0x7f36e00d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36df59e640 1 -- 172.21.15.67:0/10044206 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e015e550 msgr2=0x7f36e00d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:44.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36df59e640 1 --2- 172.21.15.67:0/10044206 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e015e550 0x7f36e00d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36df59e640 1 -- 172.21.15.67:0/10044206 >> v1:172.21.15.97:6789/0 conn(0x7f36e009b5d0 legacy=0x7f36e01613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.269+0000 7f36df59e640 1 -- 172.21.15.67:0/10044206 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e00d1180 con 0x7f36e0161af0 2024-09-19T05:43:44.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36df59e640 1 --2- 172.21.15.67:0/10044206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e0161af0 0x7f36e015e930 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009e50 tx=0x7f36d801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce622b7fe4c8d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:44.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36ddd9b640 1 -- 172.21.15.67:0/10044206 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d80a58d0 con 0x7f36e0161af0 2024-09-19T05:43:44.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36ddd9b640 1 -- 172.21.15.67:0/10044206 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d80a5a70 con 0x7f36e0161af0 2024-09-19T05:43:44.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36ddd9b640 1 -- 172.21.15.67:0/10044206 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d80a5e40 con 0x7f36e0161af0 2024-09-19T05:43:44.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36e5216640 1 -- 172.21.15.67:0/10044206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e0161af0 msgr2=0x7f36e015e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36e5216640 1 --2- 172.21.15.67:0/10044206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e0161af0 0x7f36e015e930 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009e50 tx=0x7f36d801ca00 comp rx=0 tx=0).stop 2024-09-19T05:43:44.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36e5216640 1 -- 172.21.15.67:0/10044206 shutdown_connections 2024-09-19T05:43:44.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36e5216640 1 --2- 172.21.15.67:0/10044206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e0161af0 0x7f36e015e930 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36e5216640 1 --2- 172.21.15.67:0/10044206 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e015e550 0x7f36e00d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36e5216640 1 -- 172.21.15.67:0/10044206 >> 172.21.15.67:0/10044206 conn(0x7f36e00b3d90 msgr2=0x7f36e00b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:44.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36e5216640 1 -- 172.21.15.67:0/10044206 shutdown_connections 2024-09-19T05:43:44.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36e5216640 1 -- 172.21.15.67:0/10044206 wait complete. 2024-09-19T05:43:44.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36e5216640 1 Processor -- start 2024-09-19T05:43:44.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.273+0000 7f36e5216640 1 -- start start 2024-09-19T05:43:44.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36e5216640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e009b5d0 0x7f36e00b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36e5216640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e015e550 0x7f36e00c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36e5216640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36e0161af0 0x7f36e00c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36e5216640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f36e009bb30 con 0x7f36e009b5d0 2024-09-19T05:43:44.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36e5216640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f36e009b9b0 con 0x7f36e0161af0 2024-09-19T05:43:44.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36e5216640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f36e015f280 con 0x7f36e015e550 2024-09-19T05:43:44.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e009b5d0 0x7f36e00b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e009b5d0 0x7f36e00b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43334/0 (socket says 172.21.15.67:43334) 2024-09-19T05:43:44.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36ded9d640 1 -- 172.21.15.67:0/3721152530 learned_addr learned my addr 172.21.15.67:0/3721152530 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:44.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36df59e640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36e0161af0 0x7f36e00c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36de59c640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e015e550 0x7f36e00c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36ded9d640 1 -- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e015e550 msgr2=0x7f36e00c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36ded9d640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e015e550 0x7f36e00c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36ded9d640 1 -- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36e0161af0 msgr2=0x7f36e00c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36ded9d640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36e0161af0 0x7f36e00c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36ded9d640 1 -- 172.21.15.67:0/3721152530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e00c7180 con 0x7f36e009b5d0 2024-09-19T05:43:44.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36ded9d640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e009b5d0 0x7f36e00b0b80 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f36d400d800 tx=0x7f36d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:44.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36c77fe640 1 -- 172.21.15.67:0/3721152530 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d400b6c0 con 0x7f36e009b5d0 2024-09-19T05:43:44.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36c77fe640 1 -- 172.21.15.67:0/3721152530 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d4019070 con 0x7f36e009b5d0 2024-09-19T05:43:44.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36e5216640 1 -- 172.21.15.67:0/3721152530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e00afae0 con 0x7f36e009b5d0 2024-09-19T05:43:44.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36c77fe640 1 -- 172.21.15.67:0/3721152530 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d400bae0 con 0x7f36e009b5d0 2024-09-19T05:43:44.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36e5216640 1 -- 172.21.15.67:0/3721152530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e00b00a0 con 0x7f36e009b5d0 2024-09-19T05:43:44.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36e5216640 1 -- 172.21.15.67:0/3721152530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e00d0430 con 0x7f36e009b5d0 2024-09-19T05:43:44.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36c77fe640 1 -- 172.21.15.67:0/3721152530 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36d400bc80 con 0x7f36e009b5d0 2024-09-19T05:43:44.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36c77fe640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36cc0678c0 0x7f36cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36c77fe640 1 -- 172.21.15.67:0/3721152530 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5249+0+0 (secure 0 0 0) 0x7f36d4085ff0 con 0x7f36e009b5d0 2024-09-19T05:43:44.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.277+0000 7f36de59c640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36cc0678c0 0x7f36cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.281+0000 7f36de59c640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36cc0678c0 0x7f36cc069d80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f36d0007fd0 tx=0x7f36d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:44.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.281+0000 7f36c77fe640 1 -- 172.21.15.67:0/3721152530 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f36d4056d40 con 0x7f36e009b5d0 2024-09-19T05:43:44.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.441+0000 7f36e5216640 1 -- 172.21.15.67:0/3721152530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f36e00d1b00 con 0x7f36e009b5d0 2024-09-19T05:43:44.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.441+0000 7f36c77fe640 1 -- 172.21.15.67:0/3721152530 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v139) ==== 84+0+65 (secure 0 0 0) 0x7f36d4056640 con 0x7f36e009b5d0 2024-09-19T05:43:44.441 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:44.441 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:43:44.441 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:43:44.441 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:43:44.441 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:43:44.441 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:44.441 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 -- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36cc0678c0 msgr2=0x7f36cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36cc0678c0 0x7f36cc069d80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f36d0007fd0 tx=0x7f36d0009040 comp rx=0 tx=0).stop 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 -- 172.21.15.67:0/3721152530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e009b5d0 msgr2=0x7f36e00b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e009b5d0 0x7f36e00b0b80 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f36d400d800 tx=0x7f36d400dcc0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 -- 172.21.15.67:0/3721152530 shutdown_connections 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36e0161af0 0x7f36e00c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36cc0678c0 0x7f36cc069d80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36e015e550 0x7f36e00c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 --2- 172.21.15.67:0/3721152530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36e009b5d0 0x7f36e00b0b80 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 -- 172.21.15.67:0/3721152530 >> 172.21.15.67:0/3721152530 conn(0x7f36e00b3d90 msgr2=0x7f36e006cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:44.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 -- 172.21.15.67:0/3721152530 shutdown_connections 2024-09-19T05:43:44.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.445+0000 7f36e5216640 1 -- 172.21.15.67:0/3721152530 wait complete. 2024-09-19T05:43:44.459 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:43:44.460 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:43:44.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.589+0000 7f02c9073640 1 Processor -- start 2024-09-19T05:43:44.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.589+0000 7f02c9073640 1 -- start start 2024-09-19T05:43:44.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.589+0000 7f02c9073640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f02c40738b0 0x7f02c415c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.589+0000 7f02c9073640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c40b4e00 con 0x7f02c40d0520 2024-09-19T05:43:44.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.589+0000 7f02c9073640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c415fa40 con 0x7f02c40aee00 2024-09-19T05:43:44.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.589+0000 7f02c9073640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f02c415c5c0 con 0x7f02c40738b0 2024-09-19T05:43:44.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c259c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f02c40d0520 0x7f02c415ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33832/0 (socket says 172.21.15.67:33832) 2024-09-19T05:43:44.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c259c640 1 -- 172.21.15.67:0/1184387875 learned_addr learned my addr 172.21.15.67:0/1184387875 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:44.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c2d9d640 1 --2- 172.21.15.67:0/1184387875 >> v2:172.21.15.97:3300/0 conn(0x7f02c40738b0 0x7f02c415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3039286572 0 0) 0x7f02c40b4e00 con 0x7f02c40d0520 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02ac005740 con 0x7f02c40d0520 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155613923 0 0) 0x7f02c415fa40 con 0x7f02c40aee00 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02c40b4e00 con 0x7f02c40aee00 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3867058395 0 0) 0x7f02ac005740 con 0x7f02c40d0520 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 >> v2:172.21.15.97:3300/0 conn(0x7f02c40738b0 msgr2=0x7f02c415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 --2- 172.21.15.67:0/1184387875 >> v2:172.21.15.97:3300/0 conn(0x7f02c40738b0 0x7f02c415c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 >> v1:172.21.15.97:6789/0 conn(0x7f02c40aee00 legacy=0x7f02c415f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c40b3500 con 0x7f02c40d0520 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f02b8001680 con 0x7f02c40d0520 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 >> v1:172.21.15.67:6789/0 conn(0x7f02c40d0520 legacy=0x7f02c415ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 --2- 172.21.15.67:0/1184387875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02ac005d60 0x7f02ac006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 --2- 172.21.15.67:0/1184387875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02ac006a20 0x7f02ac006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 --2- 172.21.15.67:0/1184387875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02ac00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f02c415c5c0 con 0x7f02ac0073e0 2024-09-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac00e260 con 0x7f02ac006a20 2024-09-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f02ac00e460 con 0x7f02ac005d60 2024-09-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c359e640 1 --2- 172.21.15.67:0/1184387875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02ac00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c2d9d640 1 --2- 172.21.15.67:0/1184387875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02ac005d60 0x7f02ac006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c359e640 1 -- 172.21.15.67:0/1184387875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02ac005d60 msgr2=0x7f02ac006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c359e640 1 --2- 172.21.15.67:0/1184387875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02ac005d60 0x7f02ac006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c359e640 1 -- 172.21.15.67:0/1184387875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02ac006a20 msgr2=0x7f02ac006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c359e640 1 --2- 172.21.15.67:0/1184387875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02ac006a20 0x7f02ac006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c359e640 1 -- 172.21.15.67:0/1184387875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac005740 con 0x7f02ac0073e0 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c359e640 1 -- 172.21.15.67:0/1184387875 reap_dead start 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c359e640 1 --2- 172.21.15.67:0/1184387875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02ac00dbe0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001fd0 tx=0x7f02bc01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4046ece05fb86147 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc001c20 con 0x7f02ac0073e0 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc003b80 con 0x7f02ac0073e0 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.593+0000 7f02c1d9b640 1 -- 172.21.15.67:0/1184387875 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0050d0 con 0x7f02ac0073e0 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- 172.21.15.67:0/1184387875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 msgr2=0x7f02ac00dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 --2- 172.21.15.67:0/1184387875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02ac00dbe0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001fd0 tx=0x7f02bc01c900 comp rx=0 tx=0).stop 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- 172.21.15.67:0/1184387875 shutdown_connections 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 --2- 172.21.15.67:0/1184387875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02ac00dbe0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- 172.21.15.67:0/1184387875 >> 172.21.15.67:0/1184387875 conn(0x7f02c406c0c0 msgr2=0x7f02c406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- 172.21.15.67:0/1184387875 shutdown_connections 2024-09-19T05:43:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- 172.21.15.67:0/1184387875 wait complete. 2024-09-19T05:43:44.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 Processor -- start 2024-09-19T05:43:44.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- start start 2024-09-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02c4099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02c4158b10 0x7f02c4158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02c4142a00 0x7f02c4142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f02c40b3da0 con 0x7f02ac0073e0 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f02c40b3ac0 con 0x7f02c4142a00 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f02c40b4080 con 0x7f02c4158b10 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02c4099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02c4099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43352/0 (socket says 172.21.15.67:43352) 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c2d9d640 1 -- 172.21.15.67:0/2823492667 learned_addr learned my addr 172.21.15.67:0/2823492667 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c259c640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02c4158b10 0x7f02c4158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c2d9d640 1 -- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02c4158b10 msgr2=0x7f02c4158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c2d9d640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02c4158b10 0x7f02c4158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c359e640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02c4142a00 0x7f02c4142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c2d9d640 1 -- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02c4142a00 msgr2=0x7f02c4142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c2d9d640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02c4142a00 0x7f02c4142e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c2d9d640 1 -- 172.21.15.67:0/2823492667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c41595d0 con 0x7f02ac0073e0 2024-09-19T05:43:44.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c259c640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02c4158b10 0x7f02c4158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:44.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c2d9d640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02c4099a70 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f02b4011590 tx=0x7f02b4011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:44.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02ab7fe640 1 -- 172.21.15.67:0/2823492667 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4015870 con 0x7f02ac0073e0 2024-09-19T05:43:44.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02ab7fe640 1 -- 172.21.15.67:0/2823492667 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4015a10 con 0x7f02ac0073e0 2024-09-19T05:43:44.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- 172.21.15.67:0/2823492667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c41598b0 con 0x7f02ac0073e0 2024-09-19T05:43:44.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02ab7fe640 1 -- 172.21.15.67:0/2823492667 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4015dc0 con 0x7f02ac0073e0 2024-09-19T05:43:44.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.597+0000 7f02c9073640 1 -- 172.21.15.67:0/2823492667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c415a1e0 con 0x7f02ac0073e0 2024-09-19T05:43:44.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.601+0000 7f02c9073640 1 -- 172.21.15.67:0/2823492667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c4073c90 con 0x7f02ac0073e0 2024-09-19T05:43:44.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.601+0000 7f02ab7fe640 1 -- 172.21.15.67:0/2823492667 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02b4013400 con 0x7f02ac0073e0 2024-09-19T05:43:44.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.601+0000 7f02ab7fe640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02b00678f0 0x7f02b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:44.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.601+0000 7f02ab7fe640 1 -- 172.21.15.67:0/2823492667 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5249+0+0 (secure 0 0 0) 0x7f02b4086310 con 0x7f02ac0073e0 2024-09-19T05:43:44.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.601+0000 7f02c259c640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02b00678f0 0x7f02b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:44.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.601+0000 7f02c259c640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02b00678f0 0x7f02b0069db0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f02c4072980 tx=0x7f02b800c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:44.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.605+0000 7f02ab7fe640 1 -- 172.21.15.67:0/2823492667 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f02b4019030 con 0x7f02ac0073e0 2024-09-19T05:43:44.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:44.773+0000 7f02c9073640 1 -- 172.21.15.67:0/2823492667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f02c40b5390 con 0x7f02ac0073e0 2024-09-19T05:43:45.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.761+0000 7f02ab7fe640 1 -- 172.21.15.67:0/2823492667 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v140) ==== 138+0+0 (secure 0 0 0) 0x7f02b4084e20 con 0x7f02ac0073e0 2024-09-19T05:43:45.761 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:43:45.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 -- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02b00678f0 msgr2=0x7f02b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:45.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02b00678f0 0x7f02b0069db0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f02c4072980 tx=0x7f02b800c040 comp rx=0 tx=0).stop 2024-09-19T05:43:45.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 -- 172.21.15.67:0/2823492667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 msgr2=0x7f02c4099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02c4099a70 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f02b4011590 tx=0x7f02b4011a50 comp rx=0 tx=0).stop 2024-09-19T05:43:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 -- 172.21.15.67:0/2823492667 shutdown_connections 2024-09-19T05:43:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02c4142a00 0x7f02c4142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02b00678f0 0x7f02b0069db0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02c4158b10 0x7f02c4158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 --2- 172.21.15.67:0/2823492667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ac0073e0 0x7f02c4099a70 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 -- 172.21.15.67:0/2823492667 >> 172.21.15.67:0/2823492667 conn(0x7f02c406c0c0 msgr2=0x7f02c415d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 -- 172.21.15.67:0/2823492667 shutdown_connections 2024-09-19T05:43:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.765+0000 7f02c9073640 1 -- 172.21.15.67:0/2823492667 wait complete. 2024-09-19T05:43:45.788 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:43:45.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa65b515640 1 Processor -- start 2024-09-19T05:43:45.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa65b515640 1 -- start start 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa65b515640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa65415dc40 0x7fa6540ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa65b515640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa654160c50 con 0x7fa65415d800 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa65b515640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa65415d240 con 0x7fa654160870 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa65b515640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa65415e0d0 con 0x7fa65415dc40 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa658ab0640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa65415d800 0x7fa654072cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56646/0 (socket says 172.21.15.67:56646) 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa658ab0640 1 -- 172.21.15.67:0/42356212 learned_addr learned my addr 172.21.15.67:0/42356212 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa659ab2640 1 --2- 172.21.15.67:0/42356212 >> v2:172.21.15.67:3300/0 conn(0x7fa65415dc40 0x7fa6540ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa64bfff640 1 -- 172.21.15.67:0/42356212 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268630752 0 0) 0x7fa654160c50 con 0x7fa65415d800 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa64bfff640 1 -- 172.21.15.67:0/42356212 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa640003530 con 0x7fa65415d800 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa659ab2640 1 -- 172.21.15.67:0/42356212 >> v1:172.21.15.97:6789/0 conn(0x7fa654160870 legacy=0x7fa65415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa659ab2640 1 -- 172.21.15.67:0/42356212 >> v1:172.21.15.67:6789/0 conn(0x7fa65415d800 legacy=0x7fa654072cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:45.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.925+0000 7fa659ab2640 1 -- 172.21.15.67:0/42356212 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65415d520 con 0x7fa65415dc40 2024-09-19T05:43:45.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa659ab2640 1 --2- 172.21.15.67:0/42356212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 0x7fa6540ce2c0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009d90 tx=0x7fa64c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cd148ecacf91e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:45.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa64bfff640 1 -- 172.21.15.67:0/42356212 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0b2070 con 0x7fa65415dc40 2024-09-19T05:43:45.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa64bfff640 1 -- 172.21.15.67:0/42356212 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64c0a5830 con 0x7fa65415dc40 2024-09-19T05:43:45.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa64bfff640 1 -- 172.21.15.67:0/42356212 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0a5c00 con 0x7fa65415dc40 2024-09-19T05:43:45.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa65b515640 1 -- 172.21.15.67:0/42356212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 msgr2=0x7fa6540ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:45.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa65b515640 1 --2- 172.21.15.67:0/42356212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 0x7fa6540ce2c0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009d90 tx=0x7fa64c01c970 comp rx=0 tx=0).stop 2024-09-19T05:43:45.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa65b515640 1 -- 172.21.15.67:0/42356212 shutdown_connections 2024-09-19T05:43:45.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa65b515640 1 --2- 172.21.15.67:0/42356212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 0x7fa6540ce2c0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:45.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa65b515640 1 -- 172.21.15.67:0/42356212 >> 172.21.15.67:0/42356212 conn(0x7fa65406bcc0 msgr2=0x7fa65406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:45.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa65b515640 1 -- 172.21.15.67:0/42356212 shutdown_connections 2024-09-19T05:43:45.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa65b515640 1 -- 172.21.15.67:0/42356212 wait complete. 2024-09-19T05:43:45.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa65b515640 1 Processor -- start 2024-09-19T05:43:45.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.929+0000 7fa65b515640 1 -- start start 2024-09-19T05:43:45.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa65b515640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65415d800 0x7fa6541f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:45.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa65b515640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 0x7fa6541f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:45.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa65b515640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa654160870 0x7fa654151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:45.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa65b515640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa654160080 con 0x7fa65415dc40 2024-09-19T05:43:45.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa65b515640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa65415ff00 con 0x7fa65415d800 2024-09-19T05:43:45.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa65b515640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa65416a700 con 0x7fa654160870 2024-09-19T05:43:45.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa658ab0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 0x7fa6541f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa658ab0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 0x7fa6541f7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55442/0 (socket says 172.21.15.67:55442) 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa658ab0640 1 -- 172.21.15.67:0/1463701666 learned_addr learned my addr 172.21.15.67:0/1463701666 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa6592b1640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65415d800 0x7fa6541f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa659ab2640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa654160870 0x7fa654151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa658ab0640 1 -- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa654160870 msgr2=0x7fa654151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa658ab0640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa654160870 0x7fa654151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa658ab0640 1 -- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65415d800 msgr2=0x7fa6541f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa658ab0640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65415d800 0x7fa6541f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa658ab0640 1 -- 172.21.15.67:0/1463701666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa654151980 con 0x7fa65415dc40 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa659ab2640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa654160870 0x7fa654151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa658ab0640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 0x7fa6541f7b10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fa65000c420 tx=0x7fa65000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa649ffb640 1 -- 172.21.15.67:0/1463701666 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650017070 con 0x7fa65415dc40 2024-09-19T05:43:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa649ffb640 1 -- 172.21.15.67:0/1463701666 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa650005cf0 con 0x7fa65415dc40 2024-09-19T05:43:45.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa65b515640 1 -- 172.21.15.67:0/1463701666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa654151c60 con 0x7fa65415dc40 2024-09-19T05:43:45.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa649ffb640 1 -- 172.21.15.67:0/1463701666 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6500072d0 con 0x7fa65415dc40 2024-09-19T05:43:45.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa65b515640 1 -- 172.21.15.67:0/1463701666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa654153c00 con 0x7fa65415dc40 2024-09-19T05:43:45.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa65b515640 1 -- 172.21.15.67:0/1463701666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa654153e00 con 0x7fa65415dc40 2024-09-19T05:43:45.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa649ffb640 1 -- 172.21.15.67:0/1463701666 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa65001a070 con 0x7fa65415dc40 2024-09-19T05:43:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa649ffb640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa6380678c0 0x7fa638069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.933+0000 7fa649ffb640 1 -- 172.21.15.67:0/1463701666 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5619+0+0 (secure 0 0 0) 0x7fa650085290 con 0x7fa65415dc40 2024-09-19T05:43:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.937+0000 7fa6592b1640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa6380678c0 0x7fa638069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.937+0000 7fa6592b1640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa6380678c0 0x7fa638069d80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa644001650 tx=0x7fa644009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:45.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:45.937+0000 7fa649ffb640 1 -- 172.21.15.67:0/1463701666 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa654153e00 con 0x7fa65415dc40 2024-09-19T05:43:46.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.101+0000 7fa65b515640 1 -- 172.21.15.67:0/1463701666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa6540cf260 con 0x7fa65415dc40 2024-09-19T05:43:46.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.765+0000 7fa649ffb640 1 -- 172.21.15.67:0/1463701666 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v141) ==== 170+0+0 (secure 0 0 0) 0x7fa650055940 con 0x7fa65415dc40 2024-09-19T05:43:46.766 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:43:46.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 -- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa6380678c0 msgr2=0x7fa638069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:46.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa6380678c0 0x7fa638069d80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa644001650 tx=0x7fa644009040 comp rx=0 tx=0).stop 2024-09-19T05:43:46.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 -- 172.21.15.67:0/1463701666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 msgr2=0x7fa6541f7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:46.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 0x7fa6541f7b10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fa65000c420 tx=0x7fa65000c8e0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 -- 172.21.15.67:0/1463701666 shutdown_connections 2024-09-19T05:43:46.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa6380678c0 0x7fa638069d80 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa654160870 0x7fa654151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa65415dc40 0x7fa6541f7b10 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 --2- 172.21.15.67:0/1463701666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65415d800 0x7fa6541f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 -- 172.21.15.67:0/1463701666 >> 172.21.15.67:0/1463701666 conn(0x7fa65406bcc0 msgr2=0x7fa6540cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:46.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 -- 172.21.15.67:0/1463701666 shutdown_connections 2024-09-19T05:43:46.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.769+0000 7fa65b515640 1 -- 172.21.15.67:0/1463701666 wait complete. 2024-09-19T05:43:46.802 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:43:46.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bbc804640 1 Processor -- start 2024-09-19T05:43:46.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bbc804640 1 -- start start 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bbc804640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb8072f30 0x7f1bb80cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bbc804640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1bb806f490 0x7f1bb806f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bbc804640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb80cd910 con 0x7f1bb815b220 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bbc804640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb80cded0 con 0x7f1bb806f490 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bbc804640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb80cf990 con 0x7f1bb8072f30 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1bb815b220 0x7f1bb80cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56650/0 (socket says 172.21.15.67:56650) 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb659c640 1 -- 172.21.15.67:0/3628033439 learned_addr learned my addr 172.21.15.67:0/3628033439 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb5d9b640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb8072f30 0x7f1bb80cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb6d9d640 1 --2- 172.21.15.67:0/3628033439 >> v2:172.21.15.97:3300/0 conn(0x7f1bb806f490 0x7f1bb806f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591731805 0 0) 0x7f1bb80cd910 con 0x7f1bb815b220 2024-09-19T05:43:46.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ba0003530 con 0x7f1bb815b220 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2472086708 0 0) 0x7f1ba0003530 con 0x7f1bb815b220 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb8072f30 msgr2=0x7f1bb80cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb8072f30 0x7f1bb80cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 >> v2:172.21.15.97:3300/0 conn(0x7f1bb806f490 msgr2=0x7f1bb806f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 --2- 172.21.15.67:0/3628033439 >> v2:172.21.15.97:3300/0 conn(0x7f1bb806f490 0x7f1bb806f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb80cdbf0 con 0x7f1bb815b220 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1ba8001680 con 0x7f1bb815b220 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 >> v1:172.21.15.67:6789/0 conn(0x7f1bb815b220 legacy=0x7f1bb80cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb8072f30 0x7f1ba00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 0x7f1ba0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ba0004d50 0x7f1ba00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:46.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80cded0 con 0x7f1ba0003f40 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80cf990 con 0x7f1ba0004d50 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba000b9d0 con 0x7f1bb8072f30 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb5d9b640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 0x7f1ba0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb659c640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb8072f30 0x7f1ba00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb5d9b640 1 -- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb8072f30 msgr2=0x7f1ba00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb6d9d640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ba0004d50 0x7f1ba00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb5d9b640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb8072f30 0x7f1ba00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.933+0000 7f1bb5d9b640 1 -- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ba0004d50 msgr2=0x7f1ba00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bb5d9b640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ba0004d50 0x7f1ba00051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bb5d9b640 1 -- 172.21.15.67:0/3628033439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba0003530 con 0x7f1ba0003f40 2024-09-19T05:43:46.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bb659c640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb8072f30 0x7f1ba00039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:46.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bb5d9b640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 0x7f1ba0004810 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009ab0 tx=0x7f1bac01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f4630a05548334 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0b2070 con 0x7f1ba0003f40 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac0a5640 con 0x7f1ba0003f40 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bb559a640 1 -- 172.21.15.67:0/3628033439 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0096b0 con 0x7f1ba0003f40 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bbc804640 1 -- 172.21.15.67:0/3628033439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 msgr2=0x7f1ba0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bbc804640 1 --2- 172.21.15.67:0/3628033439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 0x7f1ba0004810 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009ab0 tx=0x7f1bac01c9f0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bb6d9d640 1 -- 172.21.15.67:0/3628033439 reap_dead start 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bbc804640 1 -- 172.21.15.67:0/3628033439 shutdown_connections 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bbc804640 1 -- 172.21.15.67:0/3628033439 >> 172.21.15.67:0/3628033439 conn(0x7f1bb806bcc0 msgr2=0x7f1bb806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bbc804640 1 -- 172.21.15.67:0/3628033439 shutdown_connections 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.937+0000 7f1bbc804640 1 -- 172.21.15.67:0/3628033439 wait complete. 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 Processor -- start 2024-09-19T05:43:46.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 -- start start 2024-09-19T05:43:46.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 0x7f1bb81f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:46.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb814c2a0 0x7f1bb814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:46.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb814e1d0 0x7f1bb8159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:46.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80cfe20 con 0x7f1ba0003f40 2024-09-19T05:43:46.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80cf2d0 con 0x7f1bb814e1d0 2024-09-19T05:43:46.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb80cffa0 con 0x7f1bb814c2a0 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 0x7f1bb81f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 0x7f1bb81f83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55452/0 (socket says 172.21.15.67:55452) 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb659c640 1 -- 172.21.15.67:0/2263224874 learned_addr learned my addr 172.21.15.67:0/2263224874 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb6d9d640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb814e1d0 0x7f1bb8159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb5d9b640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb814c2a0 0x7f1bb814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb659c640 1 -- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb814c2a0 msgr2=0x7f1bb814dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb659c640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb814c2a0 0x7f1bb814dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb659c640 1 -- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb814e1d0 msgr2=0x7f1bb8159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb659c640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb814e1d0 0x7f1bb8159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb659c640 1 -- 172.21.15.67:0/2263224874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb81f8930 con 0x7f1ba0003f40 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bb659c640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 0x7f1bb81f83f0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8010c20 tx=0x7f1ba800e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1ba6ffd640 1 -- 172.21.15.67:0/2263224874 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba801b070 con 0x7f1ba0003f40 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1ba6ffd640 1 -- 172.21.15.67:0/2263224874 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba8011040 con 0x7f1ba0003f40 2024-09-19T05:43:46.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 -- 172.21.15.67:0/2263224874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb814e770 con 0x7f1ba0003f40 2024-09-19T05:43:46.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1ba6ffd640 1 -- 172.21.15.67:0/2263224874 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba80143a0 con 0x7f1ba0003f40 2024-09-19T05:43:46.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 -- 172.21.15.67:0/2263224874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb81f7bf0 con 0x7f1ba0003f40 2024-09-19T05:43:46.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1bbc804640 1 -- 172.21.15.67:0/2263224874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb814ec90 con 0x7f1ba0003f40 2024-09-19T05:43:46.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.941+0000 7f1ba6ffd640 1 -- 172.21.15.67:0/2263224874 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ba801e070 con 0x7f1ba0003f40 2024-09-19T05:43:46.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.945+0000 7f1ba6ffd640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b980678f0 0x7f1b98069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:46.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.945+0000 7f1ba6ffd640 1 -- 172.21.15.67:0/2263224874 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6001+0+0 (secure 0 0 0) 0x7f1ba80887d0 con 0x7f1ba0003f40 2024-09-19T05:43:46.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.945+0000 7f1bb5d9b640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b980678f0 0x7f1b98069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:46.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.945+0000 7f1bb5d9b640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b980678f0 0x7f1b98069db0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0af000 tx=0x7f1bac0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:46.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:46.949+0000 7f1ba6ffd640 1 -- 172.21.15.67:0/2263224874 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1ba80591e0 con 0x7f1ba0003f40 2024-09-19T05:43:47.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.153+0000 7f1bbc804640 1 -- 172.21.15.67:0/2263224874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1bb80d0390 con 0x7f1ba0003f40 2024-09-19T05:43:47.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.781+0000 7f1ba6ffd640 1 -- 172.21.15.67:0/2263224874 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v96) ==== 174+0+0 (secure 0 0 0) 0x7f1ba8058ae0 con 0x7f1ba0003f40 2024-09-19T05:43:47.781 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 19 and data pool 20 2024-09-19T05:43:47.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 -- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b980678f0 msgr2=0x7f1b98069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:47.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b980678f0 0x7f1b98069db0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0af000 tx=0x7f1bac0046d0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 -- 172.21.15.67:0/2263224874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 msgr2=0x7f1bb81f83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:47.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 0x7f1bb81f83f0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8010c20 tx=0x7f1ba800e4d0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 -- 172.21.15.67:0/2263224874 shutdown_connections 2024-09-19T05:43:47.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bb814e1d0 0x7f1bb8159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b980678f0 0x7f1b98069db0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1bb814c2a0 0x7f1bb814dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 --2- 172.21.15.67:0/2263224874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ba0003f40 0x7f1bb81f83f0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 -- 172.21.15.67:0/2263224874 >> 172.21.15.67:0/2263224874 conn(0x7f1bb806bcc0 msgr2=0x7f1bb80ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:47.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 -- 172.21.15.67:0/2263224874 shutdown_connections 2024-09-19T05:43:47.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.785+0000 7f1bbc804640 1 -- 172.21.15.67:0/2263224874 wait complete. 2024-09-19T05:43:47.818 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:43:47.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.945+0000 7f5acdd11640 1 Processor -- start 2024-09-19T05:43:47.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.945+0000 7f5acdd11640 1 -- start start 2024-09-19T05:43:47.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5acdd11640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5ac806dde0 0x7f5ac80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:47.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5acdd11640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ac80b3510 0x7f5ac806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:47.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5acdd11640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac806e3c0 con 0x7f5ac815c030 2024-09-19T05:43:47.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5acdd11640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac806e6a0 con 0x7f5ac80b3510 2024-09-19T05:43:47.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5acdd11640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac806e980 con 0x7f5ac806dde0 2024-09-19T05:43:47.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ac80b3510 0x7f5ac806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:47.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ac80b3510 0x7f5ac806f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55466/0 (socket says 172.21.15.67:55466) 2024-09-19T05:43:47.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac7fff640 1 -- 172.21.15.67:0/819239047 learned_addr learned my addr 172.21.15.67:0/819239047 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:47.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac6ffd640 1 --2- 172.21.15.67:0/819239047 >> v2:172.21.15.97:3300/0 conn(0x7f5ac806dde0 0x7f5ac80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:47.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac7fff640 1 -- 172.21.15.67:0/819239047 >> v2:172.21.15.97:3300/0 conn(0x7f5ac806dde0 msgr2=0x7f5ac80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:47.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac7fff640 1 --2- 172.21.15.67:0/819239047 >> v2:172.21.15.97:3300/0 conn(0x7f5ac806dde0 0x7f5ac80b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac7fff640 1 -- 172.21.15.67:0/819239047 >> v1:172.21.15.97:6789/0 conn(0x7f5ac815c030 legacy=0x7f5ac815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:47.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac7fff640 1 -- 172.21.15.67:0/819239047 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac806ec60 con 0x7f5ac80b3510 2024-09-19T05:43:47.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac7fff640 1 --2- 172.21.15.67:0/819239047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 0x7f5ac806f460 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80add20 tx=0x7f5ac001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4cd74b8c628d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:47.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac67fc640 1 -- 172.21.15.67:0/819239047 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00a5750 con 0x7f5ac80b3510 2024-09-19T05:43:47.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac67fc640 1 -- 172.21.15.67:0/819239047 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac00a58f0 con 0x7f5ac80b3510 2024-09-19T05:43:47.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.949+0000 7f5ac67fc640 1 -- 172.21.15.67:0/819239047 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00a5cc0 con 0x7f5ac80b3510 2024-09-19T05:43:47.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- 172.21.15.67:0/819239047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 msgr2=0x7f5ac806f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:47.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 --2- 172.21.15.67:0/819239047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 0x7f5ac806f460 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80add20 tx=0x7f5ac001c980 comp rx=0 tx=0).stop 2024-09-19T05:43:47.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- 172.21.15.67:0/819239047 shutdown_connections 2024-09-19T05:43:47.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 --2- 172.21.15.67:0/819239047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 0x7f5ac806f460 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 --2- 172.21.15.67:0/819239047 >> v2:172.21.15.97:3300/0 conn(0x7f5ac806dde0 0x7f5ac80b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- 172.21.15.67:0/819239047 >> 172.21.15.67:0/819239047 conn(0x7f5ac80d0080 msgr2=0x7f5ac80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:47.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- 172.21.15.67:0/819239047 shutdown_connections 2024-09-19T05:43:47.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- 172.21.15.67:0/819239047 wait complete. 2024-09-19T05:43:47.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 Processor -- start 2024-09-19T05:43:47.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- start start 2024-09-19T05:43:47.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ac806dde0 0x7f5ac8154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:47.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 0x7f5ac80999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:47.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ac815c030 0x7f5ac8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:47.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81692f0 con 0x7f5ac80b3510 2024-09-19T05:43:47.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac815c620 con 0x7f5ac806dde0 2024-09-19T05:43:47.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac8169470 con 0x7f5ac815c030 2024-09-19T05:43:47.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 0x7f5ac80999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:47.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 0x7f5ac80999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55474/0 (socket says 172.21.15.67:55474) 2024-09-19T05:43:47.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac6ffd640 1 -- 172.21.15.67:0/1185360132 learned_addr learned my addr 172.21.15.67:0/1185360132 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:47.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac77fe640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ac806dde0 0x7f5ac8154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:47.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac7fff640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ac815c030 0x7f5ac8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac6ffd640 1 -- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ac815c030 msgr2=0x7f5ac8157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac6ffd640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ac815c030 0x7f5ac8157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac6ffd640 1 -- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ac806dde0 msgr2=0x7f5ac8154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac6ffd640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ac806dde0 0x7f5ac8154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac6ffd640 1 -- 172.21.15.67:0/1185360132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac815d1d0 con 0x7f5ac80b3510 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac77fe640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ac806dde0 0x7f5ac8154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5ac6ffd640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 0x7f5ac80999c0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800d800 tx=0x7f5ab800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5abffff640 1 -- 172.21.15.67:0/1185360132 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800b6c0 con 0x7f5ac80b3510 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5abffff640 1 -- 172.21.15.67:0/1185360132 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab8019070 con 0x7f5ac80b3510 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- 172.21.15.67:0/1185360132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac8154aa0 con 0x7f5ac80b3510 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5abffff640 1 -- 172.21.15.67:0/1185360132 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800ba60 con 0x7f5ac80b3510 2024-09-19T05:43:47.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.953+0000 7f5acdd11640 1 -- 172.21.15.67:0/1185360132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac8155060 con 0x7f5ac80b3510 2024-09-19T05:43:47.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.957+0000 7f5acdd11640 1 -- 172.21.15.67:0/1185360132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac80b2fd0 con 0x7f5ac80b3510 2024-09-19T05:43:47.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.957+0000 7f5abffff640 1 -- 172.21.15.67:0/1185360132 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ab800bc00 con 0x7f5ac80b3510 2024-09-19T05:43:47.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.957+0000 7f5abffff640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5aa80678c0 0x7f5aa8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:47.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.957+0000 7f5abffff640 1 -- 172.21.15.67:0/1185360132 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f5ab80862c0 con 0x7f5ac80b3510 2024-09-19T05:43:47.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.957+0000 7f5ac77fe640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5aa80678c0 0x7f5aa8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:47.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.957+0000 7f5ac77fe640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5aa80678c0 0x7f5aa8069d80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000a850 tx=0x7f5ab0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:47.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:47.961+0000 7f5abffff640 1 -- 172.21.15.67:0/1185360132 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5ab8056c70 con 0x7f5ac80b3510 2024-09-19T05:43:48.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.121+0000 7f5acdd11640 1 -- 172.21.15.67:0/1185360132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ac80d0f20 con 0x7f5ac80b3510 2024-09-19T05:43:48.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5abffff640 1 -- 172.21.15.67:0/1185360132 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16937 (secure 0 0 0) 0x7f5ab80860e0 con 0x7f5ac80b3510 2024-09-19T05:43:48.124 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:48.124 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":142,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:43:47.158724+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:43:44.817575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-19T05:43:46.149161+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:43:48.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 -- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5aa80678c0 msgr2=0x7f5aa8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5aa80678c0 0x7f5aa8069d80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000a850 tx=0x7f5ab0008040 comp rx=0 tx=0).stop 2024-09-19T05:43:48.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 -- 172.21.15.67:0/1185360132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 msgr2=0x7f5ac80999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 0x7f5ac80999c0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800d800 tx=0x7f5ab800dcc0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 -- 172.21.15.67:0/1185360132 shutdown_connections 2024-09-19T05:43:48.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5aa80678c0 0x7f5aa8069d80 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ac815c030 0x7f5ac8157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac80b3510 0x7f5ac80999c0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 --2- 172.21.15.67:0/1185360132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ac806dde0 0x7f5ac8154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 -- 172.21.15.67:0/1185360132 >> 172.21.15.67:0/1185360132 conn(0x7f5ac80d0080 msgr2=0x7f5ac80af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:48.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 -- 172.21.15.67:0/1185360132 shutdown_connections 2024-09-19T05:43:48.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.125+0000 7f5acdd11640 1 -- 172.21.15.67:0/1185360132 wait complete. 2024-09-19T05:43:48.143 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:43:48.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e99ca2640 1 Processor -- start 2024-09-19T05:43:48.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e99ca2640 1 -- start start 2024-09-19T05:43:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e99ca2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5e9415b1e0 0x7f5e940b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e99ca2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5e940b4900 0x7f5e94071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e99ca2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e940b3860 con 0x7f5e940723c0 2024-09-19T05:43:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e99ca2640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5e9415b5c0 con 0x7f5e9415b1e0 2024-09-19T05:43:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e99ca2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5e940b3b40 con 0x7f5e940b4900 2024-09-19T05:43:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e937fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5e9415b1e0 0x7f5e940b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e937fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5e9415b1e0 0x7f5e940b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55482/0 (socket says 172.21.15.67:55482) 2024-09-19T05:43:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e937fe640 1 -- 172.21.15.67:0/1173119889 learned_addr learned my addr 172.21.15.67:0/1173119889 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e8affd640 1 --2- 172.21.15.67:0/1173119889 >> v2:172.21.15.97:3300/0 conn(0x7f5e940b4900 0x7f5e94071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e937fe640 1 -- 172.21.15.67:0/1173119889 >> v2:172.21.15.97:3300/0 conn(0x7f5e940b4900 msgr2=0x7f5e94071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e937fe640 1 --2- 172.21.15.67:0/1173119889 >> v2:172.21.15.97:3300/0 conn(0x7f5e940b4900 0x7f5e94071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e937fe640 1 -- 172.21.15.67:0/1173119889 >> v1:172.21.15.97:6789/0 conn(0x7f5e940723c0 legacy=0x7f5e9415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:48.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.257+0000 7f5e937fe640 1 -- 172.21.15.67:0/1173119889 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e940b3e20 con 0x7f5e9415b1e0 2024-09-19T05:43:48.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e937fe640 1 --2- 172.21.15.67:0/1173119889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 0x7f5e940b2fd0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f5e940ad2e0 tx=0x7f5e8401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a517371299f847e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:48.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e92ffd640 1 -- 172.21.15.67:0/1173119889 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e840aa430 con 0x7f5e9415b1e0 2024-09-19T05:43:48.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e92ffd640 1 -- 172.21.15.67:0/1173119889 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e840af070 con 0x7f5e9415b1e0 2024-09-19T05:43:48.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e92ffd640 1 -- 172.21.15.67:0/1173119889 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e840aa7f0 con 0x7f5e9415b1e0 2024-09-19T05:43:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 -- 172.21.15.67:0/1173119889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 msgr2=0x7f5e940b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 --2- 172.21.15.67:0/1173119889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 0x7f5e940b2fd0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f5e940ad2e0 tx=0x7f5e8401c4b0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 -- 172.21.15.67:0/1173119889 shutdown_connections 2024-09-19T05:43:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 --2- 172.21.15.67:0/1173119889 >> v2:172.21.15.97:3300/0 conn(0x7f5e940b4900 0x7f5e94071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 --2- 172.21.15.67:0/1173119889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 0x7f5e940b2fd0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 -- 172.21.15.67:0/1173119889 >> 172.21.15.67:0/1173119889 conn(0x7f5e940d0080 msgr2=0x7f5e940d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 -- 172.21.15.67:0/1173119889 shutdown_connections 2024-09-19T05:43:48.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 -- 172.21.15.67:0/1173119889 wait complete. 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 Processor -- start 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 -- start start 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e940723c0 0x7f5e941fb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e940b4900 0x7f5e9406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 0x7f5e9406c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5e94168060 con 0x7f5e9415b1e0 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5e94072c60 con 0x7f5e940723c0 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e99ca2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5e941681e0 con 0x7f5e940b4900 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e93fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 0x7f5e9406c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e93fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 0x7f5e9406c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55484/0 (socket says 172.21.15.67:55484) 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e93fff640 1 -- 172.21.15.67:0/2984117675 learned_addr learned my addr 172.21.15.67:0/2984117675 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:48.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e8affd640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e940b4900 0x7f5e9406bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e937fe640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e940723c0 0x7f5e941fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e93fff640 1 -- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e940b4900 msgr2=0x7f5e9406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e93fff640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e940b4900 0x7f5e9406bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e93fff640 1 -- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e940723c0 msgr2=0x7f5e941fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e93fff640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e940723c0 0x7f5e941fb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e93fff640 1 -- 172.21.15.67:0/2984117675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9414b7d0 con 0x7f5e9415b1e0 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e93fff640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 0x7f5e9406c200 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00b9a0 tx=0x7f5e8c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.261+0000 7f5e90ff9640 1 -- 172.21.15.67:0/2984117675 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c019070 con 0x7f5e9415b1e0 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.265+0000 7f5e90ff9640 1 -- 172.21.15.67:0/2984117675 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8c00cb40 con 0x7f5e9415b1e0 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.265+0000 7f5e99ca2640 1 -- 172.21.15.67:0/2984117675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9414bab0 con 0x7f5e9415b1e0 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.265+0000 7f5e90ff9640 1 -- 172.21.15.67:0/2984117675 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c014440 con 0x7f5e9415b1e0 2024-09-19T05:43:48.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.265+0000 7f5e99ca2640 1 -- 172.21.15.67:0/2984117675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9414c070 con 0x7f5e9415b1e0 2024-09-19T05:43:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.265+0000 7f5e99ca2640 1 -- 172.21.15.67:0/2984117675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e94071e80 con 0x7f5e9415b1e0 2024-09-19T05:43:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.265+0000 7f5e90ff9640 1 -- 172.21.15.67:0/2984117675 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e8c01c070 con 0x7f5e9415b1e0 2024-09-19T05:43:48.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.265+0000 7f5e90ff9640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e740678c0 0x7f5e74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.265+0000 7f5e90ff9640 1 -- 172.21.15.67:0/2984117675 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f5e8c085a50 con 0x7f5e9415b1e0 2024-09-19T05:43:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.265+0000 7f5e937fe640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e740678c0 0x7f5e74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.265+0000 7f5e937fe640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e740678c0 0x7f5e74069d80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5e840ae000 tx=0x7f5e840a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:48.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.269+0000 7f5e90ff9640 1 -- 172.21.15.67:0/2984117675 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5e8c056400 con 0x7f5e9415b1e0 2024-09-19T05:43:48.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.429+0000 7f5e99ca2640 1 -- 172.21.15.67:0/2984117675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e940b4e30 con 0x7f5e9415b1e0 2024-09-19T05:43:48.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.429+0000 7f5e90ff9640 1 -- 172.21.15.67:0/2984117675 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16937 (secure 0 0 0) 0x7f5e8c055d00 con 0x7f5e9415b1e0 2024-09-19T05:43:48.429 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:48.429 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":142,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:43:47.158724+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:43:44.817575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-19T05:43:46.149161+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:43:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 -- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e740678c0 msgr2=0x7f5e74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e740678c0 0x7f5e74069d80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5e840ae000 tx=0x7f5e840a7000 comp rx=0 tx=0).stop 2024-09-19T05:43:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 -- 172.21.15.67:0/2984117675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 msgr2=0x7f5e9406c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 0x7f5e9406c200 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00b9a0 tx=0x7f5e8c00be60 comp rx=0 tx=0).stop 2024-09-19T05:43:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 -- 172.21.15.67:0/2984117675 shutdown_connections 2024-09-19T05:43:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e9415b1e0 0x7f5e9406c200 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5e740678c0 0x7f5e74069d80 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e940b4900 0x7f5e9406bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 --2- 172.21.15.67:0/2984117675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e940723c0 0x7f5e941fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 -- 172.21.15.67:0/2984117675 >> 172.21.15.67:0/2984117675 conn(0x7f5e940d0080 msgr2=0x7f5e9415d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 -- 172.21.15.67:0/2984117675 shutdown_connections 2024-09-19T05:43:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.433+0000 7f5e99ca2640 1 -- 172.21.15.67:0/2984117675 wait complete. 2024-09-19T05:43:48.447 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:43:48.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660c5d5640 1 Processor -- start 2024-09-19T05:43:48.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660c5d5640 1 -- start start 2024-09-19T05:43:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660c5d5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f660409aa30 0x7f660409ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660c5d5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66040b2be0 0x7f66040d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660c5d5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66040b3040 0x7f66040d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660c5d5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f66040b2750 con 0x7f66040b3040 2024-09-19T05:43:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660c5d5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f660409b750 con 0x7f660409aa30 2024-09-19T05:43:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660c5d5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f660409b350 con 0x7f66040b2be0 2024-09-19T05:43:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660ab72640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66040b3040 0x7f66040d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660ab72640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66040b3040 0x7f66040d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55494/0 (socket says 172.21.15.67:55494) 2024-09-19T05:43:48.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660ab72640 1 -- 172.21.15.67:0/2871161313 learned_addr learned my addr 172.21.15.67:0/2871161313 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:48.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660a371640 1 --2- 172.21.15.67:0/2871161313 >> v2:172.21.15.97:3300/0 conn(0x7f660409aa30 0x7f660409ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660ab72640 1 -- 172.21.15.67:0/2871161313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66040b2be0 msgr2=0x7f66040d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:48.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f6609b70640 1 --2- 172.21.15.67:0/2871161313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66040b2be0 0x7f66040d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660ab72640 1 --2- 172.21.15.67:0/2871161313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66040b2be0 0x7f66040d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660ab72640 1 -- 172.21.15.67:0/2871161313 >> v2:172.21.15.97:3300/0 conn(0x7f660409aa30 msgr2=0x7f660409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:48.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660ab72640 1 --2- 172.21.15.67:0/2871161313 >> v2:172.21.15.97:3300/0 conn(0x7f660409aa30 0x7f660409ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f660ab72640 1 -- 172.21.15.67:0/2871161313 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66040b23e0 con 0x7f66040b3040 2024-09-19T05:43:48.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.565+0000 7f6609b70640 1 --2- 172.21.15.67:0/2871161313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66040b2be0 0x7f66040d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:48.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660ab72640 1 --2- 172.21.15.67:0/2871161313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 0x7f66040d08a0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f6604069690 tx=0x7f65fc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d387d689280f8811 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:48.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660936f640 1 -- 172.21.15.67:0/2871161313 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0a5850 con 0x7f66040b3040 2024-09-19T05:43:48.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660936f640 1 -- 172.21.15.67:0/2871161313 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65fc0a59f0 con 0x7f66040b3040 2024-09-19T05:43:48.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660936f640 1 -- 172.21.15.67:0/2871161313 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0a5dc0 con 0x7f66040b3040 2024-09-19T05:43:48.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 -- 172.21.15.67:0/2871161313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 msgr2=0x7f66040d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 --2- 172.21.15.67:0/2871161313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 0x7f66040d08a0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f6604069690 tx=0x7f65fc01c9f0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 -- 172.21.15.67:0/2871161313 shutdown_connections 2024-09-19T05:43:48.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 --2- 172.21.15.67:0/2871161313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 0x7f66040d08a0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 --2- 172.21.15.67:0/2871161313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66040b2be0 0x7f66040d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 --2- 172.21.15.67:0/2871161313 >> v2:172.21.15.97:3300/0 conn(0x7f660409aa30 0x7f660409ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 -- 172.21.15.67:0/2871161313 >> 172.21.15.67:0/2871161313 conn(0x7f66040d22f0 msgr2=0x7f66040d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 -- 172.21.15.67:0/2871161313 shutdown_connections 2024-09-19T05:43:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 -- 172.21.15.67:0/2871161313 wait complete. 2024-09-19T05:43:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 Processor -- start 2024-09-19T05:43:48.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 -- start start 2024-09-19T05:43:48.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f660409aa30 0x7f660415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66040b2be0 0x7f6604152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 0x7f6604158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6604161c20 con 0x7f66040b3040 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f660409b9f0 con 0x7f66040b2be0 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.569+0000 7f660c5d5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6604161da0 con 0x7f660409aa30 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660ab72640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 0x7f6604158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660ab72640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 0x7f6604158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55510/0 (socket says 172.21.15.67:55510) 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660ab72640 1 -- 172.21.15.67:0/3113094761 learned_addr learned my addr 172.21.15.67:0/3113094761 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660a371640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f660409aa30 0x7f660415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f6609b70640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66040b2be0 0x7f6604152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660ab72640 1 -- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f660409aa30 msgr2=0x7f660415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660ab72640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f660409aa30 0x7f660415dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660ab72640 1 -- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66040b2be0 msgr2=0x7f6604152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660ab72640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66040b2be0 0x7f6604152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660ab72640 1 -- 172.21.15.67:0/3113094761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66041514d0 con 0x7f66040b3040 2024-09-19T05:43:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f6609b70640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66040b2be0 0x7f6604152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660ab72640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 0x7f6604158c40 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f65fc01c820 tx=0x7f65fc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f65faffd640 1 -- 172.21.15.67:0/3113094761 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0b8440 con 0x7f66040b3040 2024-09-19T05:43:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f65faffd640 1 -- 172.21.15.67:0/3113094761 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65fc0b85e0 con 0x7f66040b3040 2024-09-19T05:43:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660c5d5640 1 -- 172.21.15.67:0/3113094761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66041517b0 con 0x7f66040b3040 2024-09-19T05:43:48.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f65faffd640 1 -- 172.21.15.67:0/3113094761 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0b89b0 con 0x7f66040b3040 2024-09-19T05:43:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660c5d5640 1 -- 172.21.15.67:0/3113094761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6604151d70 con 0x7f66040b3040 2024-09-19T05:43:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660c5d5640 1 -- 172.21.15.67:0/3113094761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660409ae10 con 0x7f66040b3040 2024-09-19T05:43:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f65faffd640 1 -- 172.21.15.67:0/3113094761 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65fc0c1020 con 0x7f66040b3040 2024-09-19T05:43:48.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f65faffd640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65e80678c0 0x7f65e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f65faffd640 1 -- 172.21.15.67:0/3113094761 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6101+0+0 (secure 0 0 0) 0x7f65fc120430 con 0x7f66040b3040 2024-09-19T05:43:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660a371640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65e80678c0 0x7f65e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.573+0000 7f660a371640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65e80678c0 0x7f65e8069d80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f66041fa630 tx=0x7f6600008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:48.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.577+0000 7f65faffd640 1 -- 172.21.15.67:0/3113094761 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f65fc0c8020 con 0x7f66040b3040 2024-09-19T05:43:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.777+0000 7f660c5d5640 1 -- 172.21.15.67:0/3113094761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f66041598a0 con 0x7f66040b3040 2024-09-19T05:43:48.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.813+0000 7f65faffd640 1 -- 172.21.15.67:0/3113094761 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v97) ==== 118+0+0 (secure 0 0 0) 0x7f65fc0165e0 con 0x7f66040b3040 2024-09-19T05:43:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 -- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65e80678c0 msgr2=0x7f65e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65e80678c0 0x7f65e8069d80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f66041fa630 tx=0x7f6600008040 comp rx=0 tx=0).stop 2024-09-19T05:43:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 -- 172.21.15.67:0/3113094761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 msgr2=0x7f6604158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 0x7f6604158c40 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f65fc01c820 tx=0x7f65fc019790 comp rx=0 tx=0).stop 2024-09-19T05:43:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 -- 172.21.15.67:0/3113094761 shutdown_connections 2024-09-19T05:43:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66040b3040 0x7f6604158c40 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66040b2be0 0x7f6604152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65e80678c0 0x7f65e8069d80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 --2- 172.21.15.67:0/3113094761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f660409aa30 0x7f660415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 -- 172.21.15.67:0/3113094761 >> 172.21.15.67:0/3113094761 conn(0x7f66040d22f0 msgr2=0x7f6604070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 -- 172.21.15.67:0/3113094761 shutdown_connections 2024-09-19T05:43:48.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.817+0000 7f660c5d5640 1 -- 172.21.15.67:0/3113094761 wait complete. 2024-09-19T05:43:48.835 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:43:48.835 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:43:48.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ebc21640 1 Processor -- start 2024-09-19T05:43:48.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ebc21640 1 -- start start 2024-09-19T05:43:48.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ebc21640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65e4162ae0 0x7f65e40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ebc21640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f65e40cf420 0x7f65e40b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ebc21640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e4162ec0 con 0x7f65e40ce740 2024-09-19T05:43:48.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ebc21640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f65e40b4ce0 con 0x7f65e40cf420 2024-09-19T05:43:48.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ebc21640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f65e40d1e30 con 0x7f65e4162ae0 2024-09-19T05:43:48.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ea1be640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f65e40cf420 0x7f65e40b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65e99bd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65e4162ae0 0x7f65e40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ea1be640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f65e40cf420 0x7f65e40b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55518/0 (socket says 172.21.15.67:55518) 2024-09-19T05:43:48.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ea1be640 1 -- 172.21.15.67:0/1375952431 learned_addr learned my addr 172.21.15.67:0/1375952431 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:48.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ea1be640 1 -- 172.21.15.67:0/1375952431 >> v2:172.21.15.97:3300/0 conn(0x7f65e4162ae0 msgr2=0x7f65e40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:48.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ea1be640 1 --2- 172.21.15.67:0/1375952431 >> v2:172.21.15.97:3300/0 conn(0x7f65e4162ae0 0x7f65e40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ea1be640 1 -- 172.21.15.67:0/1375952431 >> v1:172.21.15.97:6789/0 conn(0x7f65e40ce740 legacy=0x7f65e40ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.957+0000 7f65ea1be640 1 -- 172.21.15.67:0/1375952431 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e409b5e0 con 0x7f65e40cf420 2024-09-19T05:43:48.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ea1be640 1 --2- 172.21.15.67:0/1375952431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40cf420 0x7f65e40b18a0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f65e4073530 tx=0x7f65d401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9013dd94d023ab67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:48.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65e89bb640 1 -- 172.21.15.67:0/1375952431 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d40ab680 con 0x7f65e40cf420 2024-09-19T05:43:48.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65e89bb640 1 -- 172.21.15.67:0/1375952431 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d40b0070 con 0x7f65e40cf420 2024-09-19T05:43:48.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65e89bb640 1 -- 172.21.15.67:0/1375952431 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d40aba40 con 0x7f65e40cf420 2024-09-19T05:43:48.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ebc21640 1 -- 172.21.15.67:0/1375952431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40cf420 msgr2=0x7f65e40b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ebc21640 1 --2- 172.21.15.67:0/1375952431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40cf420 0x7f65e40b18a0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f65e4073530 tx=0x7f65d401c460 comp rx=0 tx=0).stop 2024-09-19T05:43:48.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ebc21640 1 -- 172.21.15.67:0/1375952431 shutdown_connections 2024-09-19T05:43:48.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ebc21640 1 --2- 172.21.15.67:0/1375952431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40cf420 0x7f65e40b18a0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ebc21640 1 --2- 172.21.15.67:0/1375952431 >> v2:172.21.15.97:3300/0 conn(0x7f65e4162ae0 0x7f65e40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ebc21640 1 -- 172.21.15.67:0/1375952431 >> 172.21.15.67:0/1375952431 conn(0x7f65e40b3f30 msgr2=0x7f65e40b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:48.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ebc21640 1 -- 172.21.15.67:0/1375952431 shutdown_connections 2024-09-19T05:43:48.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ebc21640 1 -- 172.21.15.67:0/1375952431 wait complete. 2024-09-19T05:43:48.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ebc21640 1 Processor -- start 2024-09-19T05:43:48.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.961+0000 7f65ebc21640 1 -- start start 2024-09-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65ebc21640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40ce740 0x7f65e415d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65ebc21640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e40cf420 0x7f65e409c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65ebc21640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e4162ae0 0x7f65e409cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65ebc21640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f65e416fcc0 con 0x7f65e40ce740 2024-09-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65ebc21640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f65e416fb40 con 0x7f65e40cf420 2024-09-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65ebc21640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f65e416fe40 con 0x7f65e4162ae0 2024-09-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e99bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40ce740 0x7f65e415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e99bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40ce740 0x7f65e415d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55526/0 (socket says 172.21.15.67:55526) 2024-09-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e99bd640 1 -- 172.21.15.67:0/847699850 learned_addr learned my addr 172.21.15.67:0/847699850 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:48.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e91bc640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e40cf420 0x7f65e409c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65ea1be640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e4162ae0 0x7f65e409cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e99bd640 1 -- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e4162ae0 msgr2=0x7f65e409cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e99bd640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e4162ae0 0x7f65e409cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e99bd640 1 -- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e40cf420 msgr2=0x7f65e409c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e99bd640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e40cf420 0x7f65e409c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e99bd640 1 -- 172.21.15.67:0/847699850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e40c7610 con 0x7f65e40ce740 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e91bc640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e40cf420 0x7f65e409c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e99bd640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40ce740 0x7f65e415d620 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009d10 tx=0x7f65dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e27fc640 1 -- 172.21.15.67:0/847699850 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc018020 con 0x7f65e40ce740 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e27fc640 1 -- 172.21.15.67:0/847699850 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc014480 con 0x7f65e40ce740 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65ebc21640 1 -- 172.21.15.67:0/847699850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e40b0150 con 0x7f65e40ce740 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e27fc640 1 -- 172.21.15.67:0/847699850 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc014830 con 0x7f65e40ce740 2024-09-19T05:43:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65ebc21640 1 -- 172.21.15.67:0/847699850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e40b0710 con 0x7f65e40ce740 2024-09-19T05:43:48.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65ebc21640 1 -- 172.21.15.67:0/847699850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e40b18a0 con 0x7f65e40ce740 2024-09-19T05:43:48.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e27fc640 1 -- 172.21.15.67:0/847699850 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65dc01b020 con 0x7f65e40ce740 2024-09-19T05:43:48.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e27fc640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65d00678c0 0x7f65d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:48.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e27fc640 1 -- 172.21.15.67:0/847699850 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f65dc086b10 con 0x7f65e40ce740 2024-09-19T05:43:48.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.965+0000 7f65e91bc640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65d00678c0 0x7f65d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:48.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.969+0000 7f65e91bc640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65d00678c0 0x7f65d0069d80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f65e40ce2e0 tx=0x7f65d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:48.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:48.969+0000 7f65e27fc640 1 -- 172.21.15.67:0/847699850 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f65dc022030 con 0x7f65e40ce740 2024-09-19T05:43:49.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.169+0000 7f65ebc21640 1 -- 172.21.15.67:0/847699850 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f65e409bca0 con 0x7f65e40ce740 2024-09-19T05:43:49.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.825+0000 7f65e27fc640 1 -- 172.21.15.67:0/847699850 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v98) ==== 122+0+0 (secure 0 0 0) 0x7f65dc010040 con 0x7f65e40ce740 2024-09-19T05:43:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 -- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65d00678c0 msgr2=0x7f65d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65d00678c0 0x7f65d0069d80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f65e40ce2e0 tx=0x7f65d8009040 comp rx=0 tx=0).stop 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 -- 172.21.15.67:0/847699850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40ce740 msgr2=0x7f65e415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40ce740 0x7f65e415d620 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009d10 tx=0x7f65dc00c490 comp rx=0 tx=0).stop 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 -- 172.21.15.67:0/847699850 shutdown_connections 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65d00678c0 0x7f65d0069d80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e4162ae0 0x7f65e409cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e40cf420 0x7f65e409c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 --2- 172.21.15.67:0/847699850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65e40ce740 0x7f65e415d620 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 -- 172.21.15.67:0/847699850 >> 172.21.15.67:0/847699850 conn(0x7f65e40b3f30 msgr2=0x7f65e40b6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 -- 172.21.15.67:0/847699850 shutdown_connections 2024-09-19T05:43:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.829+0000 7f65ebc21640 1 -- 172.21.15.67:0/847699850 wait complete. 2024-09-19T05:43:49.853 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:43:49.853 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:43:49.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d4ec35640 1 Processor -- start 2024-09-19T05:43:49.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d4ec35640 1 -- start start 2024-09-19T05:43:49.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d4ec35640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d480d3080 0x7f1d481693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:49.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d4ec35640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d480cf510 con 0x7f1d480cf070 2024-09-19T05:43:49.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d4ec35640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d480cf7f0 con 0x7f1d4815e610 2024-09-19T05:43:49.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d4ec35640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1d480d0120 con 0x7f1d480d3080 2024-09-19T05:43:49.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d4d1d2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d480d3080 0x7f1d481693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:49.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d47fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1d480cf070 0x7f1d4815e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56666/0 (socket says 172.21.15.67:56666) 2024-09-19T05:43:49.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d47fff640 1 -- 172.21.15.67:0/1355458796 learned_addr learned my addr 172.21.15.67:0/1355458796 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:49.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d4d1d2640 1 -- 172.21.15.67:0/1355458796 >> v1:172.21.15.97:6789/0 conn(0x7f1d4815e610 legacy=0x7f1d48162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:49.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d4d1d2640 1 -- 172.21.15.67:0/1355458796 >> v1:172.21.15.67:6789/0 conn(0x7f1d480cf070 legacy=0x7f1d4815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:49.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d477fe640 1 -- 172.21.15.67:0/1355458796 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540502246 0 0) 0x7f1d480cf510 con 0x7f1d480cf070 2024-09-19T05:43:49.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.989+0000 7f1d4d1d2640 1 -- 172.21.15.67:0/1355458796 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d480cfad0 con 0x7f1d480d3080 2024-09-19T05:43:49.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4d1d2640 1 --2- 172.21.15.67:0/1355458796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 0x7f1d481693f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009d90 tx=0x7f1d4001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4128665a820f2f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:49.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d477fe640 1 -- 172.21.15.67:0/1355458796 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d400b2070 con 0x7f1d480d3080 2024-09-19T05:43:49.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d477fe640 1 -- 172.21.15.67:0/1355458796 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d400a5a20 con 0x7f1d480d3080 2024-09-19T05:43:49.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d477fe640 1 -- 172.21.15.67:0/1355458796 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d400a5df0 con 0x7f1d480d3080 2024-09-19T05:43:49.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1355458796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 msgr2=0x7f1d481693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:49.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 --2- 172.21.15.67:0/1355458796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 0x7f1d481693f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009d90 tx=0x7f1d4001c940 comp rx=0 tx=0).stop 2024-09-19T05:43:49.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1355458796 shutdown_connections 2024-09-19T05:43:49.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 --2- 172.21.15.67:0/1355458796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 0x7f1d481693f0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:49.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1355458796 >> 172.21.15.67:0/1355458796 conn(0x7f1d4808bfc0 msgr2=0x7f1d480d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:49.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1355458796 shutdown_connections 2024-09-19T05:43:49.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1355458796 wait complete. 2024-09-19T05:43:49.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 Processor -- start 2024-09-19T05:43:49.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 -- start start 2024-09-19T05:43:49.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d480cf070 0x7f1d480b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:49.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 0x7f1d480b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:49.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4815e610 0x7f1d4814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:49.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4816c8f0 con 0x7f1d480d3080 2024-09-19T05:43:49.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4816c770 con 0x7f1d4815e610 2024-09-19T05:43:49.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4ec35640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4816ca70 con 0x7f1d480cf070 2024-09-19T05:43:49.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 0x7f1d480b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:49.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 0x7f1d480b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55544/0 (socket says 172.21.15.67:55544) 2024-09-19T05:43:50.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d47fff640 1 -- 172.21.15.67:0/1529445857 learned_addr learned my addr 172.21.15.67:0/1529445857 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:50.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4c9d1640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d480cf070 0x7f1d480b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.993+0000 7f1d4d1d2640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4815e610 0x7f1d4814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d47fff640 1 -- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d480cf070 msgr2=0x7f1d480b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d47fff640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d480cf070 0x7f1d480b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d47fff640 1 -- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4815e610 msgr2=0x7f1d4814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d47fff640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4815e610 0x7f1d4814ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d47fff640 1 -- 172.21.15.67:0/1529445857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d480b19f0 con 0x7f1d480d3080 2024-09-19T05:43:50.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d4d1d2640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4815e610 0x7f1d4814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:50.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d4c9d1640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d480cf070 0x7f1d480b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:50.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d47fff640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 0x7f1d480b28c0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00c410 tx=0x7f1d3c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:50.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d457fa640 1 -- 172.21.15.67:0/1529445857 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0074e0 con 0x7f1d480d3080 2024-09-19T05:43:50.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d457fa640 1 -- 172.21.15.67:0/1529445857 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c0047f0 con 0x7f1d480d3080 2024-09-19T05:43:50.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1529445857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d480b1cd0 con 0x7f1d480d3080 2024-09-19T05:43:50.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d457fa640 1 -- 172.21.15.67:0/1529445857 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c007680 con 0x7f1d480d3080 2024-09-19T05:43:50.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1529445857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4815b4b0 con 0x7f1d480d3080 2024-09-19T05:43:50.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1529445857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d480cf510 con 0x7f1d480d3080 2024-09-19T05:43:50.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d457fa640 1 -- 172.21.15.67:0/1529445857 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d3c011070 con 0x7f1d480d3080 2024-09-19T05:43:50.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d457fa640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d340678c0 0x7f1d34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d457fa640 1 -- 172.21.15.67:0/1529445857 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f1d3c085a50 con 0x7f1d480d3080 2024-09-19T05:43:50.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d4c9d1640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d340678c0 0x7f1d34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:49.997+0000 7f1d4c9d1640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d340678c0 0x7f1d34069d80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1d481faf30 tx=0x7f1d38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:50.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.001+0000 7f1d457fa640 1 -- 172.21.15.67:0/1529445857 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1d3c0563e0 con 0x7f1d480d3080 2024-09-19T05:43:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.201+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1529445857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d480d1c00 con 0x7f1d480d3080 2024-09-19T05:43:50.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d457fa640 1 -- 172.21.15.67:0/1529445857 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f1d3c055ce0 con 0x7f1d480d3080 2024-09-19T05:43:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:50.203 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:43:50.203 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:43:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d340678c0 msgr2=0x7f1d34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d340678c0 0x7f1d34069d80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1d481faf30 tx=0x7f1d38009040 comp rx=0 tx=0).stop 2024-09-19T05:43:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1529445857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 msgr2=0x7f1d480b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 0x7f1d480b28c0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00c410 tx=0x7f1d3c00c8d0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1529445857 shutdown_connections 2024-09-19T05:43:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4815e610 0x7f1d4814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d480d3080 0x7f1d480b28c0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1d340678c0 0x7f1d34069d80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 --2- 172.21.15.67:0/1529445857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d480cf070 0x7f1d480b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1529445857 >> 172.21.15.67:0/1529445857 conn(0x7f1d4808bfc0 msgr2=0x7f1d480b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:50.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1529445857 shutdown_connections 2024-09-19T05:43:50.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.205+0000 7f1d4ec35640 1 -- 172.21.15.67:0/1529445857 wait complete. 2024-09-19T05:43:50.222 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:43:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbfc23640 1 Processor -- start 2024-09-19T05:43:50.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbfc23640 1 -- start start 2024-09-19T05:43:50.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbfc23640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5db8145e10 0x7f5db815c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbfc23640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5db806c3d0 0x7f5db80b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbfc23640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db80b1140 con 0x7f5db80b03a0 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbfc23640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5db81461f0 con 0x7f5db806c3d0 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbfc23640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5db80b1420 con 0x7f5db8145e10 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbe1c0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5db806c3d0 0x7f5db80b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbe1c0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5db806c3d0 0x7f5db80b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55554/0 (socket says 172.21.15.67:55554) 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbe1c0640 1 -- 172.21.15.67:0/910773734 learned_addr learned my addr 172.21.15.67:0/910773734 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbd9bf640 1 --2- 172.21.15.67:0/910773734 >> v2:172.21.15.97:3300/0 conn(0x7f5db8145e10 0x7f5db815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbe1c0640 1 -- 172.21.15.67:0/910773734 >> v2:172.21.15.97:3300/0 conn(0x7f5db8145e10 msgr2=0x7f5db815c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbe1c0640 1 --2- 172.21.15.67:0/910773734 >> v2:172.21.15.97:3300/0 conn(0x7f5db8145e10 0x7f5db815c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbe1c0640 1 -- 172.21.15.67:0/910773734 >> v1:172.21.15.97:6789/0 conn(0x7f5db80b03a0 legacy=0x7f5db806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:50.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.353+0000 7f5dbe1c0640 1 -- 172.21.15.67:0/910773734 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db80b1700 con 0x7f5db806c3d0 2024-09-19T05:43:50.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbe1c0640 1 --2- 172.21.15.67:0/910773734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db806c3d0 0x7f5db80b0810 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f5db80b3f70 tx=0x7f5db001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8f060abd727ecc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:50.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbc9bd640 1 -- 172.21.15.67:0/910773734 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db00a5780 con 0x7f5db806c3d0 2024-09-19T05:43:50.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbc9bd640 1 -- 172.21.15.67:0/910773734 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db00a5920 con 0x7f5db806c3d0 2024-09-19T05:43:50.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbc9bd640 1 -- 172.21.15.67:0/910773734 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db00a5cf0 con 0x7f5db806c3d0 2024-09-19T05:43:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 -- 172.21.15.67:0/910773734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db806c3d0 msgr2=0x7f5db80b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 --2- 172.21.15.67:0/910773734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db806c3d0 0x7f5db80b0810 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f5db80b3f70 tx=0x7f5db001c9b0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 -- 172.21.15.67:0/910773734 shutdown_connections 2024-09-19T05:43:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 --2- 172.21.15.67:0/910773734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db806c3d0 0x7f5db80b0810 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 --2- 172.21.15.67:0/910773734 >> v2:172.21.15.97:3300/0 conn(0x7f5db8145e10 0x7f5db815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 -- 172.21.15.67:0/910773734 >> 172.21.15.67:0/910773734 conn(0x7f5db809aa30 msgr2=0x7f5db80b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 -- 172.21.15.67:0/910773734 shutdown_connections 2024-09-19T05:43:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 -- 172.21.15.67:0/910773734 wait complete. 2024-09-19T05:43:50.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 Processor -- start 2024-09-19T05:43:50.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 -- start start 2024-09-19T05:43:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5db806c3d0 0x7f5db80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5db80b03a0 0x7f5db815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db8145e10 0x7f5db8165350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5db80b2b50 con 0x7f5db8145e10 2024-09-19T05:43:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5db80b29d0 con 0x7f5db80b03a0 2024-09-19T05:43:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbfc23640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5db80b2cd0 con 0x7f5db806c3d0 2024-09-19T05:43:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.357+0000 7f5dbe1c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db8145e10 0x7f5db8165350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbe1c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db8145e10 0x7f5db8165350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55562/0 (socket says 172.21.15.67:55562) 2024-09-19T05:43:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbe1c0640 1 -- 172.21.15.67:0/3517532316 learned_addr learned my addr 172.21.15.67:0/3517532316 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbd1be640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5db80b03a0 0x7f5db815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbe1c0640 1 -- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5db806c3d0 msgr2=0x7f5db80b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbd9bf640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5db806c3d0 0x7f5db80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbe1c0640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5db806c3d0 0x7f5db80b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbe1c0640 1 -- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5db80b03a0 msgr2=0x7f5db815bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbe1c0640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5db80b03a0 0x7f5db815bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbe1c0640 1 -- 172.21.15.67:0/3517532316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db8070e80 con 0x7f5db8145e10 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbd1be640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5db80b03a0 0x7f5db815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbd9bf640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5db806c3d0 0x7f5db80b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbe1c0640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db8145e10 0x7f5db8165350 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f5db001a5e0 tx=0x7f5db0019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dae7fc640 1 -- 172.21.15.67:0/3517532316 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db00b8470 con 0x7f5db8145e10 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dae7fc640 1 -- 172.21.15.67:0/3517532316 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db00b8610 con 0x7f5db8145e10 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbfc23640 1 -- 172.21.15.67:0/3517532316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db8070ba0 con 0x7f5db8145e10 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dae7fc640 1 -- 172.21.15.67:0/3517532316 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db00b8a00 con 0x7f5db8145e10 2024-09-19T05:43:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbfc23640 1 -- 172.21.15.67:0/3517532316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db80b5fe0 con 0x7f5db8145e10 2024-09-19T05:43:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbfc23640 1 -- 172.21.15.67:0/3517532316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db809f130 con 0x7f5db8145e10 2024-09-19T05:43:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dae7fc640 1 -- 172.21.15.67:0/3517532316 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5db00c0020 con 0x7f5db8145e10 2024-09-19T05:43:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dae7fc640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5d9c0678c0 0x7f5d9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dae7fc640 1 -- 172.21.15.67:0/3517532316 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f5db01206b0 con 0x7f5db8145e10 2024-09-19T05:43:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbd9bf640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5d9c0678c0 0x7f5d9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.361+0000 7f5dbd9bf640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5d9c0678c0 0x7f5d9c069d80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009840 tx=0x7f5db4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:50.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.369+0000 7f5dae7fc640 1 -- 172.21.15.67:0/3517532316 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5db00c7020 con 0x7f5db8145e10 2024-09-19T05:43:50.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.529+0000 7f5dbfc23640 1 -- 172.21.15.67:0/3517532316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5db809ee50 con 0x7f5db8145e10 2024-09-19T05:43:50.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.529+0000 7f5dae7fc640 1 -- 172.21.15.67:0/3517532316 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16924 (secure 0 0 0) 0x7f5db00165a0 con 0x7f5db8145e10 2024-09-19T05:43:50.529 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:50.530 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":143,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:43:48.786447+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:43:44.817575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-19T05:43:46.149161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:43:50.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 -- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5d9c0678c0 msgr2=0x7f5d9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5d9c0678c0 0x7f5d9c069d80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009840 tx=0x7f5db4008040 comp rx=0 tx=0).stop 2024-09-19T05:43:50.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 -- 172.21.15.67:0/3517532316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db8145e10 msgr2=0x7f5db8165350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db8145e10 0x7f5db8165350 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f5db001a5e0 tx=0x7f5db0019750 comp rx=0 tx=0).stop 2024-09-19T05:43:50.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 -- 172.21.15.67:0/3517532316 shutdown_connections 2024-09-19T05:43:50.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5db8145e10 0x7f5db8165350 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5db80b03a0 0x7f5db815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5d9c0678c0 0x7f5d9c069d80 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 --2- 172.21.15.67:0/3517532316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5db806c3d0 0x7f5db80b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 -- 172.21.15.67:0/3517532316 >> 172.21.15.67:0/3517532316 conn(0x7f5db809aa30 msgr2=0x7f5db80af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:50.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 -- 172.21.15.67:0/3517532316 shutdown_connections 2024-09-19T05:43:50.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.533+0000 7f5dbfc23640 1 -- 172.21.15.67:0/3517532316 wait complete. 2024-09-19T05:43:50.547 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:43:50.548 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:43:50.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb131b1d640 1 Processor -- start 2024-09-19T05:43:50.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb131b1d640 1 -- start start 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb131b1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb12c161da0 0x7fb12c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb131b1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb12c0d0e80 0x7fb12c0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb131b1d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb12c0b41c0 0x7fb12c0b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb131b1d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb12c0d0840 con 0x7fb12c0b41c0 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb131b1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb12c0d1800 con 0x7fb12c161da0 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb131b1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb12c0d4d40 con 0x7fb12c0d0e80 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb12c0b41c0 0x7fb12c0b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb12c0b41c0 0x7fb12c0b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55566/0 (socket says 172.21.15.67:55566) 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12bfff640 1 -- 172.21.15.67:0/2930449158 learned_addr learned my addr 172.21.15.67:0/2930449158 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12b7fe640 1 --2- 172.21.15.67:0/2930449158 >> v2:172.21.15.97:3300/0 conn(0x7fb12c161da0 0x7fb12c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12affd640 1 --2- 172.21.15.67:0/2930449158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb12c0d0e80 0x7fb12c0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12bfff640 1 -- 172.21.15.67:0/2930449158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb12c0d0e80 msgr2=0x7fb12c0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:50.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12bfff640 1 --2- 172.21.15.67:0/2930449158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb12c0d0e80 0x7fb12c0d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12bfff640 1 -- 172.21.15.67:0/2930449158 >> v2:172.21.15.97:3300/0 conn(0x7fb12c161da0 msgr2=0x7fb12c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:50.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12bfff640 1 --2- 172.21.15.67:0/2930449158 >> v2:172.21.15.97:3300/0 conn(0x7fb12c161da0 0x7fb12c0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12bfff640 1 -- 172.21.15.67:0/2930449158 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12c0d5020 con 0x7fb12c0b41c0 2024-09-19T05:43:50.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.673+0000 7fb12b7fe640 1 --2- 172.21.15.67:0/2930449158 >> v2:172.21.15.97:3300/0 conn(0x7fb12c161da0 0x7fb12c0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:50.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb12bfff640 1 --2- 172.21.15.67:0/2930449158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c0b41c0 0x7fb12c0b4650 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0b5f50 tx=0x7fb12401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4fe0f5e5369f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:50.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb12a7fc640 1 -- 172.21.15.67:0/2930449158 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1240a5760 con 0x7fb12c0b41c0 2024-09-19T05:43:50.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb12a7fc640 1 -- 172.21.15.67:0/2930449158 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1240a5900 con 0x7fb12c0b41c0 2024-09-19T05:43:50.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb12a7fc640 1 -- 172.21.15.67:0/2930449158 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1240a5cd0 con 0x7fb12c0b41c0 2024-09-19T05:43:50.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 -- 172.21.15.67:0/2930449158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c0b41c0 msgr2=0x7fb12c0b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 --2- 172.21.15.67:0/2930449158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c0b41c0 0x7fb12c0b4650 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0b5f50 tx=0x7fb12401c9f0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 -- 172.21.15.67:0/2930449158 shutdown_connections 2024-09-19T05:43:50.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 --2- 172.21.15.67:0/2930449158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c0b41c0 0x7fb12c0b4650 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 --2- 172.21.15.67:0/2930449158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb12c0d0e80 0x7fb12c0d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 --2- 172.21.15.67:0/2930449158 >> v2:172.21.15.97:3300/0 conn(0x7fb12c161da0 0x7fb12c0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 -- 172.21.15.67:0/2930449158 >> 172.21.15.67:0/2930449158 conn(0x7fb12c08bfc0 msgr2=0x7fb12c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:50.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 -- 172.21.15.67:0/2930449158 shutdown_connections 2024-09-19T05:43:50.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 -- 172.21.15.67:0/2930449158 wait complete. 2024-09-19T05:43:50.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 Processor -- start 2024-09-19T05:43:50.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 -- start start 2024-09-19T05:43:50.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb12c0b41c0 0x7fb12c155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb12c0d0e80 0x7fb12c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c161da0 0x7fb12c157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c0cf150 con 0x7fb12c161da0 2024-09-19T05:43:50.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c162180 con 0x7fb12c0d0e80 2024-09-19T05:43:50.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb131b1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb12c0cf2d0 con 0x7fb12c0b41c0 2024-09-19T05:43:50.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb12bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c161da0 0x7fb12c157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb12bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c161da0 0x7fb12c157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55582/0 (socket says 172.21.15.67:55582) 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.677+0000 7fb12bfff640 1 -- 172.21.15.67:0/4021536805 learned_addr learned my addr 172.21.15.67:0/4021536805 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb12affd640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb12c0d0e80 0x7fb12c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb12b7fe640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb12c0b41c0 0x7fb12c155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb12bfff640 1 -- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb12c0b41c0 msgr2=0x7fb12c155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb12bfff640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb12c0b41c0 0x7fb12c155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb12bfff640 1 -- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb12c0d0e80 msgr2=0x7fb12c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb12bfff640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb12c0d0e80 0x7fb12c06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb12bfff640 1 -- 172.21.15.67:0/4021536805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12c15ee20 con 0x7fb12c161da0 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb12bfff640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c161da0 0x7fb12c157590 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb1240af040 tx=0x7fb124019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb113fff640 1 -- 172.21.15.67:0/4021536805 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1240bc020 con 0x7fb12c161da0 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb113fff640 1 -- 172.21.15.67:0/4021536805 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1240b8670 con 0x7fb12c161da0 2024-09-19T05:43:50.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb113fff640 1 -- 172.21.15.67:0/4021536805 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1240b8a60 con 0x7fb12c161da0 2024-09-19T05:43:50.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb131b1d640 1 -- 172.21.15.67:0/4021536805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12c15f100 con 0x7fb12c161da0 2024-09-19T05:43:50.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb131b1d640 1 -- 172.21.15.67:0/4021536805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12c15f6c0 con 0x7fb12c161da0 2024-09-19T05:43:50.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb131b1d640 1 -- 172.21.15.67:0/4021536805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb12c0b4650 con 0x7fb12c161da0 2024-09-19T05:43:50.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb113fff640 1 -- 172.21.15.67:0/4021536805 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1240bf020 con 0x7fb12c161da0 2024-09-19T05:43:50.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb113fff640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1180678c0 0x7fb118069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:50.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb113fff640 1 -- 172.21.15.67:0/4021536805 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fb1241213f0 con 0x7fb12c161da0 2024-09-19T05:43:50.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.681+0000 7fb12b7fe640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1180678c0 0x7fb118069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:50.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.685+0000 7fb12b7fe640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1180678c0 0x7fb118069d80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb12c160360 tx=0x7fb11c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:50.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.685+0000 7fb113fff640 1 -- 172.21.15.67:0/4021536805 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb1240c6030 con 0x7fb12c161da0 2024-09-19T05:43:50.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.849+0000 7fb131b1d640 1 -- 172.21.15.67:0/4021536805 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb12c050010 con 0x7fb1180678c0 2024-09-19T05:43:50.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.865+0000 7fb113fff640 1 -- 172.21.15.67:0/4021536805 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247089 (secure 0 0 0) 0x7fb12c050010 con 0x7fb1180678c0 2024-09-19T05:43:50.868 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:50.870 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:43:50.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 -- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1180678c0 msgr2=0x7fb118069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1180678c0 0x7fb118069d80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb12c160360 tx=0x7fb11c008040 comp rx=0 tx=0).stop 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 -- 172.21.15.67:0/4021536805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c161da0 msgr2=0x7fb12c157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c161da0 0x7fb12c157590 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb1240af040 tx=0x7fb124019790 comp rx=0 tx=0).stop 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 -- 172.21.15.67:0/4021536805 shutdown_connections 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12c161da0 0x7fb12c157590 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb12c0d0e80 0x7fb12c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1180678c0 0x7fb118069d80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 --2- 172.21.15.67:0/4021536805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb12c0b41c0 0x7fb12c155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 -- 172.21.15.67:0/4021536805 >> 172.21.15.67:0/4021536805 conn(0x7fb12c08bfc0 msgr2=0x7fb12c15c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 -- 172.21.15.67:0/4021536805 shutdown_connections 2024-09-19T05:43:50.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:50.869+0000 7fb131b1d640 1 -- 172.21.15.67:0/4021536805 wait complete. 2024-09-19T05:43:50.888 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":460,"stamp":"2024-09-19T05:43:49.330630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":519824,"kb_used_data":14876,"kb_used_omap":12,"kb_used_meta":504755,"kb_avail":754454896,"statfs":{"total":773094113280,"available":772561813504,"internally_reserved":0,"allocated":15233024,"data_stored":7792253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516869681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001118"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786885+0000","last_change":"2024-09-19T05:43:46.786885+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786885+0000","last_undegraded":"2024-09-19T05:43:46.786885+0000","last_fullsized":"2024-09-19T05:43:46.786885+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779840+0000","last_change":"2024-09-19T05:43:46.779840+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779840+0000","last_undegraded":"2024-09-19T05:43:46.779840+0000","last_fullsized":"2024-09-19T05:43:46.779840+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.791744+0000","last_change":"2024-09-19T05:43:46.791744+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.791744+0000","last_undegraded":"2024-09-19T05:43:46.791744+0000","last_fullsized":"2024-09-19T05:43:46.791744+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779987+0000","last_change":"2024-09-19T05:43:46.779987+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779987+0000","last_undegraded":"2024-09-19T05:43:46.779987+0000","last_fullsized":"2024-09-19T05:43:46.779987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788817+0000","last_change":"2024-09-19T05:43:46.788817+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788817+0000","last_undegraded":"2024-09-19T05:43:46.788817+0000","last_fullsized":"2024-09-19T05:43:46.788817+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782782+0000","last_change":"2024-09-19T05:43:46.782782+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782782+0000","last_undegraded":"2024-09-19T05:43:46.782782+0000","last_fullsized":"2024-09-19T05:43:46.782782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.776382+0000","last_change":"2024-09-19T05:43:46.776382+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.776382+0000","last_undegraded":"2024-09-19T05:43:46.776382+0000","last_fullsized":"2024-09-19T05:43:46.776382+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783917+0000","last_change":"2024-09-19T05:43:46.783917+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783917+0000","last_undegraded":"2024-09-19T05:43:46.783917+0000","last_fullsized":"2024-09-19T05:43:46.783917+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783796+0000","last_change":"2024-09-19T05:43:46.783796+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783796+0000","last_undegraded":"2024-09-19T05:43:46.783796+0000","last_fullsized":"2024-09-19T05:43:46.783796+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785868+0000","last_change":"2024-09-19T05:43:46.785868+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785868+0000","last_undegraded":"2024-09-19T05:43:46.785868+0000","last_fullsized":"2024-09-19T05:43:46.785868+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781021+0000","last_change":"2024-09-19T05:43:46.781021+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781021+0000","last_undegraded":"2024-09-19T05:43:46.781021+0000","last_fullsized":"2024-09-19T05:43:46.781021+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785523+0000","last_change":"2024-09-19T05:43:46.785523+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785523+0000","last_undegraded":"2024-09-19T05:43:46.785523+0000","last_fullsized":"2024-09-19T05:43:46.785523+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783473+0000","last_change":"2024-09-19T05:43:46.783473+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783473+0000","last_undegraded":"2024-09-19T05:43:46.783473+0000","last_fullsized":"2024-09-19T05:43:46.783473+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780991+0000","last_change":"2024-09-19T05:43:46.780991+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780991+0000","last_undegraded":"2024-09-19T05:43:46.780991+0000","last_fullsized":"2024-09-19T05:43:46.780991+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783358+0000","last_change":"2024-09-19T05:43:46.783358+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783358+0000","last_undegraded":"2024-09-19T05:43:46.783358+0000","last_fullsized":"2024-09-19T05:43:46.783358+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783440+0000","last_change":"2024-09-19T05:43:46.783440+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783440+0000","last_undegraded":"2024-09-19T05:43:46.783440+0000","last_fullsized":"2024-09-19T05:43:46.783440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782821+0000","last_change":"2024-09-19T05:43:46.782821+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782821+0000","last_undegraded":"2024-09-19T05:43:46.782821+0000","last_fullsized":"2024-09-19T05:43:46.782821+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.799215+0000","last_change":"2024-09-19T05:43:46.799215+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.799215+0000","last_undegraded":"2024-09-19T05:43:46.799215+0000","last_fullsized":"2024-09-19T05:43:46.799215+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.778003+0000","last_change":"2024-09-19T05:43:46.778003+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.778003+0000","last_undegraded":"2024-09-19T05:43:46.778003+0000","last_fullsized":"2024-09-19T05:43:46.778003+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788783+0000","last_change":"2024-09-19T05:43:46.788783+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788783+0000","last_undegraded":"2024-09-19T05:43:46.788783+0000","last_fullsized":"2024-09-19T05:43:46.788783+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780660+0000","last_change":"2024-09-19T05:43:46.780660+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780660+0000","last_undegraded":"2024-09-19T05:43:46.780660+0000","last_fullsized":"2024-09-19T05:43:46.780660+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781566+0000","last_change":"2024-09-19T05:43:46.781566+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781566+0000","last_undegraded":"2024-09-19T05:43:46.781566+0000","last_fullsized":"2024-09-19T05:43:46.781566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779677+0000","last_change":"2024-09-19T05:43:46.779677+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779677+0000","last_undegraded":"2024-09-19T05:43:46.779677+0000","last_fullsized":"2024-09-19T05:43:46.779677+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782927+0000","last_change":"2024-09-19T05:43:46.782927+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782927+0000","last_undegraded":"2024-09-19T05:43:46.782927+0000","last_fullsized":"2024-09-19T05:43:46.782927+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784525+0000","last_change":"2024-09-19T05:43:46.784525+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784525+0000","last_undegraded":"2024-09-19T05:43:46.784525+0000","last_fullsized":"2024-09-19T05:43:46.784525+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781058+0000","last_change":"2024-09-19T05:43:46.781058+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781058+0000","last_undegraded":"2024-09-19T05:43:46.781058+0000","last_fullsized":"2024-09-19T05:43:46.781058+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774177+0000","last_change":"2024-09-19T05:43:46.774177+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774177+0000","last_undegraded":"2024-09-19T05:43:46.774177+0000","last_fullsized":"2024-09-19T05:43:46.774177+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787345+0000","last_change":"2024-09-19T05:43:46.787345+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787345+0000","last_undegraded":"2024-09-19T05:43:46.787345+0000","last_fullsized":"2024-09-19T05:43:46.787345+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785168+0000","last_change":"2024-09-19T05:43:46.785168+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785168+0000","last_undegraded":"2024-09-19T05:43:46.785168+0000","last_fullsized":"2024-09-19T05:43:46.785168+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784727+0000","last_change":"2024-09-19T05:43:46.784727+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784727+0000","last_undegraded":"2024-09-19T05:43:46.784727+0000","last_fullsized":"2024-09-19T05:43:46.784727+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783235+0000","last_change":"2024-09-19T05:43:46.783235+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783235+0000","last_undegraded":"2024-09-19T05:43:46.783235+0000","last_fullsized":"2024-09-19T05:43:46.783235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788400+0000","last_change":"2024-09-19T05:43:46.788400+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788400+0000","last_undegraded":"2024-09-19T05:43:46.788400+0000","last_fullsized":"2024-09-19T05:43:46.788400+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782905+0000","last_change":"2024-09-19T05:43:46.782905+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782905+0000","last_undegraded":"2024-09-19T05:43:46.782905+0000","last_fullsized":"2024-09-19T05:43:46.782905+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798473+0000","last_change":"2024-09-19T05:43:46.796706+0000","last_active":"2024-09-19T05:43:46.798473+0000","last_peered":"2024-09-19T05:43:46.798473+0000","last_clean":"2024-09-19T05:43:46.798473+0000","last_became_active":"2024-09-19T05:43:46.796008+0000","last_became_peered":"2024-09-19T05:43:46.796008+0000","last_unstale":"2024-09-19T05:43:46.798473+0000","last_undegraded":"2024-09-19T05:43:46.798473+0000","last_fullsized":"2024-09-19T05:43:46.798473+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:23.480515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782774+0000","last_change":"2024-09-19T05:43:46.782774+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782774+0000","last_undegraded":"2024-09-19T05:43:46.782774+0000","last_fullsized":"2024-09-19T05:43:46.782774+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805655+0000","last_change":"2024-09-19T05:43:46.803874+0000","last_active":"2024-09-19T05:43:46.805655+0000","last_peered":"2024-09-19T05:43:46.805655+0000","last_clean":"2024-09-19T05:43:46.805655+0000","last_became_active":"2024-09-19T05:43:46.803453+0000","last_became_peered":"2024-09-19T05:43:46.803453+0000","last_unstale":"2024-09-19T05:43:46.805655+0000","last_undegraded":"2024-09-19T05:43:46.805655+0000","last_fullsized":"2024-09-19T05:43:46.805655+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:47.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781636+0000","last_change":"2024-09-19T05:43:46.781636+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781636+0000","last_undegraded":"2024-09-19T05:43:46.781636+0000","last_fullsized":"2024-09-19T05:43:46.781636+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794711+0000","last_change":"2024-09-19T05:43:46.794089+0000","last_active":"2024-09-19T05:43:46.794711+0000","last_peered":"2024-09-19T05:43:46.794711+0000","last_clean":"2024-09-19T05:43:46.794711+0000","last_became_active":"2024-09-19T05:43:46.793490+0000","last_became_peered":"2024-09-19T05:43:46.793490+0000","last_unstale":"2024-09-19T05:43:46.794711+0000","last_undegraded":"2024-09-19T05:43:46.794711+0000","last_fullsized":"2024-09-19T05:43:46.794711+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:49.600351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780729+0000","last_change":"2024-09-19T05:43:46.780729+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780729+0000","last_undegraded":"2024-09-19T05:43:46.780729+0000","last_fullsized":"2024-09-19T05:43:46.780729+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802482+0000","last_change":"2024-09-19T05:43:46.801246+0000","last_active":"2024-09-19T05:43:46.802482+0000","last_peered":"2024-09-19T05:43:46.802482+0000","last_clean":"2024-09-19T05:43:46.802482+0000","last_became_active":"2024-09-19T05:43:46.800763+0000","last_became_peered":"2024-09-19T05:43:46.800763+0000","last_unstale":"2024-09-19T05:43:46.802482+0000","last_undegraded":"2024-09-19T05:43:46.802482+0000","last_fullsized":"2024-09-19T05:43:46.802482+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:07.329602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784304+0000","last_change":"2024-09-19T05:43:46.784304+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784304+0000","last_undegraded":"2024-09-19T05:43:46.784304+0000","last_fullsized":"2024-09-19T05:43:46.784304+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803455+0000","last_change":"2024-09-19T05:43:46.801139+0000","last_active":"2024-09-19T05:43:46.803455+0000","last_peered":"2024-09-19T05:43:46.803455+0000","last_clean":"2024-09-19T05:43:46.803455+0000","last_became_active":"2024-09-19T05:43:46.798867+0000","last_became_peered":"2024-09-19T05:43:46.798867+0000","last_unstale":"2024-09-19T05:43:46.803455+0000","last_undegraded":"2024-09-19T05:43:46.803455+0000","last_fullsized":"2024-09-19T05:43:46.803455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:03.817783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783593+0000","last_change":"2024-09-19T05:43:46.783593+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783593+0000","last_undegraded":"2024-09-19T05:43:46.783593+0000","last_fullsized":"2024-09-19T05:43:46.783593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805559+0000","last_change":"2024-09-19T05:43:46.805047+0000","last_active":"2024-09-19T05:43:46.805559+0000","last_peered":"2024-09-19T05:43:46.805559+0000","last_clean":"2024-09-19T05:43:46.805559+0000","last_became_active":"2024-09-19T05:43:46.804641+0000","last_became_peered":"2024-09-19T05:43:46.804641+0000","last_unstale":"2024-09-19T05:43:46.805559+0000","last_undegraded":"2024-09-19T05:43:46.805559+0000","last_fullsized":"2024-09-19T05:43:46.805559+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:16:31.888923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788872+0000","last_change":"2024-09-19T05:43:46.788872+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788872+0000","last_undegraded":"2024-09-19T05:43:46.788872+0000","last_fullsized":"2024-09-19T05:43:46.788872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.791499+0000","last_change":"2024-09-19T05:43:46.790512+0000","last_active":"2024-09-19T05:43:46.791499+0000","last_peered":"2024-09-19T05:43:46.791499+0000","last_clean":"2024-09-19T05:43:46.791499+0000","last_became_active":"2024-09-19T05:43:46.790026+0000","last_became_peered":"2024-09-19T05:43:46.790026+0000","last_unstale":"2024-09-19T05:43:46.791499+0000","last_undegraded":"2024-09-19T05:43:46.791499+0000","last_fullsized":"2024-09-19T05:43:46.791499+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:28.921450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.776994+0000","last_change":"2024-09-19T05:43:46.776994+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.776994+0000","last_undegraded":"2024-09-19T05:43:46.776994+0000","last_fullsized":"2024-09-19T05:43:46.776994+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.806351+0000","last_change":"2024-09-19T05:43:46.805617+0000","last_active":"2024-09-19T05:43:46.806351+0000","last_peered":"2024-09-19T05:43:46.806351+0000","last_clean":"2024-09-19T05:43:46.806351+0000","last_became_active":"2024-09-19T05:43:46.805192+0000","last_became_peered":"2024-09-19T05:43:46.805192+0000","last_unstale":"2024-09-19T05:43:46.806351+0000","last_undegraded":"2024-09-19T05:43:46.806351+0000","last_fullsized":"2024-09-19T05:43:46.806351+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:40.070418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781299+0000","last_change":"2024-09-19T05:43:46.781299+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781299+0000","last_undegraded":"2024-09-19T05:43:46.781299+0000","last_fullsized":"2024-09-19T05:43:46.781299+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803706+0000","last_change":"2024-09-19T05:43:46.801306+0000","last_active":"2024-09-19T05:43:46.803706+0000","last_peered":"2024-09-19T05:43:46.803706+0000","last_clean":"2024-09-19T05:43:46.803706+0000","last_became_active":"2024-09-19T05:43:46.800754+0000","last_became_peered":"2024-09-19T05:43:46.800754+0000","last_unstale":"2024-09-19T05:43:46.803706+0000","last_undegraded":"2024-09-19T05:43:46.803706+0000","last_fullsized":"2024-09-19T05:43:46.803706+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:12.525296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782871+0000","last_change":"2024-09-19T05:43:46.782871+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782871+0000","last_undegraded":"2024-09-19T05:43:46.782871+0000","last_fullsized":"2024-09-19T05:43:46.782871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.797079+0000","last_change":"2024-09-19T05:43:46.792317+0000","last_active":"2024-09-19T05:43:46.797079+0000","last_peered":"2024-09-19T05:43:46.797079+0000","last_clean":"2024-09-19T05:43:46.797079+0000","last_became_active":"2024-09-19T05:43:46.791902+0000","last_became_peered":"2024-09-19T05:43:46.791902+0000","last_unstale":"2024-09-19T05:43:46.797079+0000","last_undegraded":"2024-09-19T05:43:46.797079+0000","last_fullsized":"2024-09-19T05:43:46.797079+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.145371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780622+0000","last_change":"2024-09-19T05:43:46.780622+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780622+0000","last_undegraded":"2024-09-19T05:43:46.780622+0000","last_fullsized":"2024-09-19T05:43:46.780622+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.801337+0000","last_change":"2024-09-19T05:43:46.796419+0000","last_active":"2024-09-19T05:43:46.801337+0000","last_peered":"2024-09-19T05:43:46.801337+0000","last_clean":"2024-09-19T05:43:46.801337+0000","last_became_active":"2024-09-19T05:43:46.795811+0000","last_became_peered":"2024-09-19T05:43:46.795811+0000","last_unstale":"2024-09-19T05:43:46.801337+0000","last_undegraded":"2024-09-19T05:43:46.801337+0000","last_fullsized":"2024-09-19T05:43:46.801337+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:04.455952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783662+0000","last_change":"2024-09-19T05:43:46.783662+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783662+0000","last_undegraded":"2024-09-19T05:43:46.783662+0000","last_fullsized":"2024-09-19T05:43:46.783662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804576+0000","last_change":"2024-09-19T05:43:46.803323+0000","last_active":"2024-09-19T05:43:46.804576+0000","last_peered":"2024-09-19T05:43:46.804576+0000","last_clean":"2024-09-19T05:43:46.804576+0000","last_became_active":"2024-09-19T05:43:46.803032+0000","last_became_peered":"2024-09-19T05:43:46.803032+0000","last_unstale":"2024-09-19T05:43:46.804576+0000","last_undegraded":"2024-09-19T05:43:46.804576+0000","last_fullsized":"2024-09-19T05:43:46.804576+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:29.172683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785731+0000","last_change":"2024-09-19T05:43:46.785731+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785731+0000","last_undegraded":"2024-09-19T05:43:46.785731+0000","last_fullsized":"2024-09-19T05:43:46.785731+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.800482+0000","last_change":"2024-09-19T05:43:46.799385+0000","last_active":"2024-09-19T05:43:46.800482+0000","last_peered":"2024-09-19T05:43:46.800482+0000","last_clean":"2024-09-19T05:43:46.800482+0000","last_became_active":"2024-09-19T05:43:46.797943+0000","last_became_peered":"2024-09-19T05:43:46.797943+0000","last_unstale":"2024-09-19T05:43:46.800482+0000","last_undegraded":"2024-09-19T05:43:46.800482+0000","last_fullsized":"2024-09-19T05:43:46.800482+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:18.054179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775892+0000","last_change":"2024-09-19T05:43:46.775892+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775892+0000","last_undegraded":"2024-09-19T05:43:46.775892+0000","last_fullsized":"2024-09-19T05:43:46.775892+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805595+0000","last_change":"2024-09-19T05:43:46.804287+0000","last_active":"2024-09-19T05:43:46.805595+0000","last_peered":"2024-09-19T05:43:46.805595+0000","last_clean":"2024-09-19T05:43:46.805595+0000","last_became_active":"2024-09-19T05:43:46.803954+0000","last_became_peered":"2024-09-19T05:43:46.803954+0000","last_unstale":"2024-09-19T05:43:46.805595+0000","last_undegraded":"2024-09-19T05:43:46.805595+0000","last_fullsized":"2024-09-19T05:43:46.805595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:07.725004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788130+0000","last_change":"2024-09-19T05:43:46.788130+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788130+0000","last_undegraded":"2024-09-19T05:43:46.788130+0000","last_fullsized":"2024-09-19T05:43:46.788130+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798172+0000","last_change":"2024-09-19T05:43:46.797549+0000","last_active":"2024-09-19T05:43:46.798172+0000","last_peered":"2024-09-19T05:43:46.798172+0000","last_clean":"2024-09-19T05:43:46.798172+0000","last_became_active":"2024-09-19T05:43:46.797153+0000","last_became_peered":"2024-09-19T05:43:46.797153+0000","last_unstale":"2024-09-19T05:43:46.798172+0000","last_undegraded":"2024-09-19T05:43:46.798172+0000","last_fullsized":"2024-09-19T05:43:46.798172+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:15.091624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784573+0000","last_change":"2024-09-19T05:43:46.784573+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784573+0000","last_undegraded":"2024-09-19T05:43:46.784573+0000","last_fullsized":"2024-09-19T05:43:46.784573+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803653+0000","last_change":"2024-09-19T05:43:46.800003+0000","last_active":"2024-09-19T05:43:46.803653+0000","last_peered":"2024-09-19T05:43:46.803653+0000","last_clean":"2024-09-19T05:43:46.803653+0000","last_became_active":"2024-09-19T05:43:46.799092+0000","last_became_peered":"2024-09-19T05:43:46.799092+0000","last_unstale":"2024-09-19T05:43:46.803653+0000","last_undegraded":"2024-09-19T05:43:46.803653+0000","last_fullsized":"2024-09-19T05:43:46.803653+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:59.820569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775297+0000","last_change":"2024-09-19T05:43:46.775297+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775297+0000","last_undegraded":"2024-09-19T05:43:46.775297+0000","last_fullsized":"2024-09-19T05:43:46.775297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.796400+0000","last_change":"2024-09-19T05:43:46.795206+0000","last_active":"2024-09-19T05:43:46.796400+0000","last_peered":"2024-09-19T05:43:46.796400+0000","last_clean":"2024-09-19T05:43:46.796400+0000","last_became_active":"2024-09-19T05:43:46.794855+0000","last_became_peered":"2024-09-19T05:43:46.794855+0000","last_unstale":"2024-09-19T05:43:46.796400+0000","last_undegraded":"2024-09-19T05:43:46.796400+0000","last_fullsized":"2024-09-19T05:43:46.796400+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:10.402439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774036+0000","last_change":"2024-09-19T05:43:46.774036+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774036+0000","last_undegraded":"2024-09-19T05:43:46.774036+0000","last_fullsized":"2024-09-19T05:43:46.774036+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.791063+0000","last_change":"2024-09-19T05:43:46.790169+0000","last_active":"2024-09-19T05:43:46.791063+0000","last_peered":"2024-09-19T05:43:46.791063+0000","last_clean":"2024-09-19T05:43:46.791063+0000","last_became_active":"2024-09-19T05:43:46.789867+0000","last_became_peered":"2024-09-19T05:43:46.789867+0000","last_unstale":"2024-09-19T05:43:46.791063+0000","last_undegraded":"2024-09-19T05:43:46.791063+0000","last_fullsized":"2024-09-19T05:43:46.791063+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:55.643231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786570+0000","last_change":"2024-09-19T05:43:46.786570+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786570+0000","last_undegraded":"2024-09-19T05:43:46.786570+0000","last_fullsized":"2024-09-19T05:43:46.786570+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804679+0000","last_change":"2024-09-19T05:43:46.804003+0000","last_active":"2024-09-19T05:43:46.804679+0000","last_peered":"2024-09-19T05:43:46.804679+0000","last_clean":"2024-09-19T05:43:46.804679+0000","last_became_active":"2024-09-19T05:43:46.799507+0000","last_became_peered":"2024-09-19T05:43:46.799507+0000","last_unstale":"2024-09-19T05:43:46.804679+0000","last_undegraded":"2024-09-19T05:43:46.804679+0000","last_fullsized":"2024-09-19T05:43:46.804679+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:09.181248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787593+0000","last_change":"2024-09-19T05:43:46.787593+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787593+0000","last_undegraded":"2024-09-19T05:43:46.787593+0000","last_fullsized":"2024-09-19T05:43:46.787593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803417+0000","last_change":"2024-09-19T05:43:46.801154+0000","last_active":"2024-09-19T05:43:46.803417+0000","last_peered":"2024-09-19T05:43:46.803417+0000","last_clean":"2024-09-19T05:43:46.803417+0000","last_became_active":"2024-09-19T05:43:46.798367+0000","last_became_peered":"2024-09-19T05:43:46.798367+0000","last_unstale":"2024-09-19T05:43:46.803417+0000","last_undegraded":"2024-09-19T05:43:46.803417+0000","last_fullsized":"2024-09-19T05:43:46.803417+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:11.177367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781841+0000","last_change":"2024-09-19T05:43:46.781841+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781841+0000","last_undegraded":"2024-09-19T05:43:46.781841+0000","last_fullsized":"2024-09-19T05:43:46.781841+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.806011+0000","last_change":"2024-09-19T05:43:46.805429+0000","last_active":"2024-09-19T05:43:46.806011+0000","last_peered":"2024-09-19T05:43:46.806011+0000","last_clean":"2024-09-19T05:43:46.806011+0000","last_became_active":"2024-09-19T05:43:46.805016+0000","last_became_peered":"2024-09-19T05:43:46.805016+0000","last_unstale":"2024-09-19T05:43:46.806011+0000","last_undegraded":"2024-09-19T05:43:46.806011+0000","last_fullsized":"2024-09-19T05:43:46.806011+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:06.495111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788028+0000","last_change":"2024-09-19T05:43:46.788028+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788028+0000","last_undegraded":"2024-09-19T05:43:46.788028+0000","last_fullsized":"2024-09-19T05:43:46.788028+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.796767+0000","last_change":"2024-09-19T05:43:46.796046+0000","last_active":"2024-09-19T05:43:46.796767+0000","last_peered":"2024-09-19T05:43:46.796767+0000","last_clean":"2024-09-19T05:43:46.796767+0000","last_became_active":"2024-09-19T05:43:46.795486+0000","last_became_peered":"2024-09-19T05:43:46.795486+0000","last_unstale":"2024-09-19T05:43:46.796767+0000","last_undegraded":"2024-09-19T05:43:46.796767+0000","last_fullsized":"2024-09-19T05:43:46.796767+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:37.034508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782676+0000","last_change":"2024-09-19T05:43:46.782676+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782676+0000","last_undegraded":"2024-09-19T05:43:46.782676+0000","last_fullsized":"2024-09-19T05:43:46.782676+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794691+0000","last_change":"2024-09-19T05:43:46.793209+0000","last_active":"2024-09-19T05:43:46.794691+0000","last_peered":"2024-09-19T05:43:46.794691+0000","last_clean":"2024-09-19T05:43:46.794691+0000","last_became_active":"2024-09-19T05:43:46.792865+0000","last_became_peered":"2024-09-19T05:43:46.792865+0000","last_unstale":"2024-09-19T05:43:46.794691+0000","last_undegraded":"2024-09-19T05:43:46.794691+0000","last_fullsized":"2024-09-19T05:43:46.794691+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:43.808413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787618+0000","last_change":"2024-09-19T05:43:46.787618+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787618+0000","last_undegraded":"2024-09-19T05:43:46.787618+0000","last_fullsized":"2024-09-19T05:43:46.787618+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.800461+0000","last_change":"2024-09-19T05:43:46.799401+0000","last_active":"2024-09-19T05:43:46.800461+0000","last_peered":"2024-09-19T05:43:46.800461+0000","last_clean":"2024-09-19T05:43:46.800461+0000","last_became_active":"2024-09-19T05:43:46.797931+0000","last_became_peered":"2024-09-19T05:43:46.797931+0000","last_unstale":"2024-09-19T05:43:46.800461+0000","last_undegraded":"2024-09-19T05:43:46.800461+0000","last_fullsized":"2024-09-19T05:43:46.800461+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:46.679571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781068+0000","last_change":"2024-09-19T05:43:46.781068+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781068+0000","last_undegraded":"2024-09-19T05:43:46.781068+0000","last_fullsized":"2024-09-19T05:43:46.781068+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805402+0000","last_change":"2024-09-19T05:43:46.803632+0000","last_active":"2024-09-19T05:43:46.805402+0000","last_peered":"2024-09-19T05:43:46.805402+0000","last_clean":"2024-09-19T05:43:46.805402+0000","last_became_active":"2024-09-19T05:43:46.803191+0000","last_became_peered":"2024-09-19T05:43:46.803191+0000","last_unstale":"2024-09-19T05:43:46.805402+0000","last_undegraded":"2024-09-19T05:43:46.805402+0000","last_fullsized":"2024-09-19T05:43:46.805402+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:10.402439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775393+0000","last_change":"2024-09-19T05:43:46.775393+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775393+0000","last_undegraded":"2024-09-19T05:43:46.775393+0000","last_fullsized":"2024-09-19T05:43:46.775393+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802411+0000","last_change":"2024-09-19T05:43:46.797969+0000","last_active":"2024-09-19T05:43:46.802411+0000","last_peered":"2024-09-19T05:43:46.802411+0000","last_clean":"2024-09-19T05:43:46.802411+0000","last_became_active":"2024-09-19T05:43:46.797489+0000","last_became_peered":"2024-09-19T05:43:46.797489+0000","last_unstale":"2024-09-19T05:43:46.802411+0000","last_undegraded":"2024-09-19T05:43:46.802411+0000","last_fullsized":"2024-09-19T05:43:46.802411+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:31.524906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786019+0000","last_change":"2024-09-19T05:43:46.786019+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786019+0000","last_undegraded":"2024-09-19T05:43:46.786019+0000","last_fullsized":"2024-09-19T05:43:46.786019+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794623+0000","last_change":"2024-09-19T05:43:46.792214+0000","last_active":"2024-09-19T05:43:46.794623+0000","last_peered":"2024-09-19T05:43:46.794623+0000","last_clean":"2024-09-19T05:43:46.794623+0000","last_became_active":"2024-09-19T05:43:46.791792+0000","last_became_peered":"2024-09-19T05:43:46.791792+0000","last_unstale":"2024-09-19T05:43:46.794623+0000","last_undegraded":"2024-09-19T05:43:46.794623+0000","last_fullsized":"2024-09-19T05:43:46.794623+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:31.011960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782662+0000","last_change":"2024-09-19T05:43:46.782662+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782662+0000","last_undegraded":"2024-09-19T05:43:46.782662+0000","last_fullsized":"2024-09-19T05:43:46.782662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802451+0000","last_change":"2024-09-19T05:43:46.790954+0000","last_active":"2024-09-19T05:43:46.802451+0000","last_peered":"2024-09-19T05:43:46.802451+0000","last_clean":"2024-09-19T05:43:46.802451+0000","last_became_active":"2024-09-19T05:43:46.790304+0000","last_became_peered":"2024-09-19T05:43:46.790304+0000","last_unstale":"2024-09-19T05:43:46.802451+0000","last_undegraded":"2024-09-19T05:43:46.802451+0000","last_fullsized":"2024-09-19T05:43:46.802451+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:00.007614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784239+0000","last_change":"2024-09-19T05:43:46.784239+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784239+0000","last_undegraded":"2024-09-19T05:43:46.784239+0000","last_fullsized":"2024-09-19T05:43:46.784239+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803746+0000","last_change":"2024-09-19T05:43:46.802290+0000","last_active":"2024-09-19T05:43:46.803746+0000","last_peered":"2024-09-19T05:43:46.803746+0000","last_clean":"2024-09-19T05:43:46.803746+0000","last_became_active":"2024-09-19T05:43:46.802005+0000","last_became_peered":"2024-09-19T05:43:46.802005+0000","last_unstale":"2024-09-19T05:43:46.803746+0000","last_undegraded":"2024-09-19T05:43:46.803746+0000","last_fullsized":"2024-09-19T05:43:46.803746+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:50.223356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784548+0000","last_change":"2024-09-19T05:43:46.784548+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784548+0000","last_undegraded":"2024-09-19T05:43:46.784548+0000","last_fullsized":"2024-09-19T05:43:46.784548+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.792514+0000","last_change":"2024-09-19T05:43:46.791368+0000","last_active":"2024-09-19T05:43:46.792514+0000","last_peered":"2024-09-19T05:43:46.792514+0000","last_clean":"2024-09-19T05:43:46.792514+0000","last_became_active":"2024-09-19T05:43:46.791101+0000","last_became_peered":"2024-09-19T05:43:46.791101+0000","last_unstale":"2024-09-19T05:43:46.792514+0000","last_undegraded":"2024-09-19T05:43:46.792514+0000","last_fullsized":"2024-09-19T05:43:46.792514+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:53.666132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774036+0000","last_change":"2024-09-19T05:43:46.774036+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774036+0000","last_undegraded":"2024-09-19T05:43:46.774036+0000","last_fullsized":"2024-09-19T05:43:46.774036+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804572+0000","last_change":"2024-09-19T05:43:46.803154+0000","last_active":"2024-09-19T05:43:46.804572+0000","last_peered":"2024-09-19T05:43:46.804572+0000","last_clean":"2024-09-19T05:43:46.804572+0000","last_became_active":"2024-09-19T05:43:46.802771+0000","last_became_peered":"2024-09-19T05:43:46.802771+0000","last_unstale":"2024-09-19T05:43:46.804572+0000","last_undegraded":"2024-09-19T05:43:46.804572+0000","last_fullsized":"2024-09-19T05:43:46.804572+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:06.895736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784563+0000","last_change":"2024-09-19T05:43:46.784563+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784563+0000","last_undegraded":"2024-09-19T05:43:46.784563+0000","last_fullsized":"2024-09-19T05:43:46.784563+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798838+0000","last_change":"2024-09-19T05:43:46.798297+0000","last_active":"2024-09-19T05:43:46.798838+0000","last_peered":"2024-09-19T05:43:46.798838+0000","last_clean":"2024-09-19T05:43:46.798838+0000","last_became_active":"2024-09-19T05:43:46.797990+0000","last_became_peered":"2024-09-19T05:43:46.797990+0000","last_unstale":"2024-09-19T05:43:46.798838+0000","last_undegraded":"2024-09-19T05:43:46.798838+0000","last_fullsized":"2024-09-19T05:43:46.798838+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:03.752818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":388,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.787456+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:43:46.787456+0000","last_peered":"2024-09-19T05:43:46.787456+0000","last_clean":"2024-09-19T05:43:46.787456+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:43:46.787456+0000","last_undegraded":"2024-09-19T05:43:46.787456+0000","last_fullsized":"2024-09-19T05:43:46.787456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542275,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65424,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306416,"statfs":{"total":96636764160,"available":96569769984,"internally_reserved":0,"allocated":2351104,"data_stored":1417640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542275,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64844,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306996,"statfs":{"total":96636764160,"available":96570363904,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542277,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59260,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312580,"statfs":{"total":96636764160,"available":96576081920,"internally_reserved":0,"allocated":1744896,"data_stored":820613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542275,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69000,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302840,"statfs":{"total":96636764160,"available":96566108160,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63436,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308404,"statfs":{"total":96636764160,"available":96571805696,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69004,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302836,"statfs":{"total":96636764160,"available":96566104064,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542278,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55116,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316724,"statfs":{"total":96636764160,"available":96580325376,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542275,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73740,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298100,"statfs":{"total":96636764160,"available":96561254400,"internally_reserved":0,"allocated":2351104,"data_stored":1417640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:43:50.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:43:51.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc816a8f640 1 Processor -- start 2024-09-19T05:43:51.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc816a8f640 1 -- start start 2024-09-19T05:43:51.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc816a8f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc81015b1e0 0x7fc8100b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc816a8f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810072590 0x7fc8100ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc816a8f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8100b3860 con 0x7fc8100b4900 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc816a8f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc81015b5c0 con 0x7fc81015b1e0 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc816a8f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc8100b3b40 con 0x7fc810072590 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc8100b4900 0x7fc810071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56674/0 (socket says 172.21.15.67:56674) 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80ffff640 1 -- 172.21.15.67:0/2223197240 learned_addr learned my addr 172.21.15.67:0/2223197240 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1390272030 0 0) 0x7fc8100b3860 con 0x7fc8100b4900 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc81502c640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810072590 0x7fc8100ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc81482b640 1 --2- 172.21.15.67:0/2223197240 >> v2:172.21.15.97:3300/0 conn(0x7fc81015b1e0 0x7fc8100b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7f8005740 con 0x7fc8100b4900 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 836000303 0 0) 0x7fc7f8005740 con 0x7fc8100b4900 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810072590 msgr2=0x7fc8100ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810072590 0x7fc8100ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 >> v2:172.21.15.97:3300/0 conn(0x7fc81015b1e0 msgr2=0x7fc8100b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:51.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 --2- 172.21.15.67:0/2223197240 >> v2:172.21.15.97:3300/0 conn(0x7fc81015b1e0 0x7fc8100b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8100b3e20 con 0x7fc8100b4900 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fc804001680 con 0x7fc8100b4900 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 >> v1:172.21.15.67:6789/0 conn(0x7fc8100b4900 legacy=0x7fc810071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f8005bd0 0x7fc7f8005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f8006a20 0x7fc7f8006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810072590 0x7fc7f80073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc81015b5c0 con 0x7fc7f8006a20 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc8100b3b40 con 0x7fc7f8005bd0 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f800dbe0 con 0x7fc810072590 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80ffff640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f8006a20 0x7fc7f8006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc81502c640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810072590 0x7fc7f80073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80ffff640 1 -- 172.21.15.67:0/2223197240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810072590 msgr2=0x7fc7f80073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80ffff640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810072590 0x7fc7f80073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80ffff640 1 -- 172.21.15.67:0/2223197240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f8005bd0 msgr2=0x7fc7f8005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:51.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80ffff640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f8005bd0 0x7fc7f8005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.061+0000 7fc80ffff640 1 -- 172.21.15.67:0/2223197240 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f8005740 con 0x7fc7f8006a20 2024-09-19T05:43:51.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc80ffff640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f8006a20 0x7fc7f8006ea0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fc80400c210 tx=0x7fc80401f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e02449195d38d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:51.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804007d60 con 0x7fc7f8006a20 2024-09-19T05:43:51.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc804005ae0 con 0x7fc7f8006a20 2024-09-19T05:43:51.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc80f7fe640 1 -- 172.21.15.67:0/2223197240 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804007070 con 0x7fc7f8006a20 2024-09-19T05:43:51.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 -- 172.21.15.67:0/2223197240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f8006a20 msgr2=0x7fc7f8006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 --2- 172.21.15.67:0/2223197240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f8006a20 0x7fc7f8006ea0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fc80400c210 tx=0x7fc80401f3f0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc81502c640 1 -- 172.21.15.67:0/2223197240 reap_dead start 2024-09-19T05:43:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 -- 172.21.15.67:0/2223197240 shutdown_connections 2024-09-19T05:43:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 -- 172.21.15.67:0/2223197240 >> 172.21.15.67:0/2223197240 conn(0x7fc8100d0080 msgr2=0x7fc8100d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 -- 172.21.15.67:0/2223197240 shutdown_connections 2024-09-19T05:43:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 -- 172.21.15.67:0/2223197240 wait complete. 2024-09-19T05:43:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 Processor -- start 2024-09-19T05:43:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 -- start start 2024-09-19T05:43:51.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc81015dec0 0x7fc8101545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81006dde0 0x7fc81006e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810152cc0 0x7fc810153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc8100b3510 con 0x7fc81015dec0 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc8100b43e0 con 0x7fc81006dde0 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.065+0000 7fc816a8f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc810072a20 con 0x7fc810152cc0 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc81482b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc81015dec0 0x7fc8101545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc81482b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc81015dec0 0x7fc8101545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55596/0 (socket says 172.21.15.67:55596) 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc81482b640 1 -- 172.21.15.67:0/1168384352 learned_addr learned my addr 172.21.15.67:0/1168384352 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc81502c640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810152cc0 0x7fc810153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc80ffff640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81006dde0 0x7fc81006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc81482b640 1 -- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810152cc0 msgr2=0x7fc810153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc81482b640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810152cc0 0x7fc810153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc81482b640 1 -- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81006dde0 msgr2=0x7fc81006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc81482b640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81006dde0 0x7fc81006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc81482b640 1 -- 172.21.15.67:0/1168384352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81015b8c0 con 0x7fc81015dec0 2024-09-19T05:43:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc81482b640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc81015dec0 0x7fc8101545a0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fc80000e840 tx=0x7fc80000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc80d7fa640 1 -- 172.21.15.67:0/1168384352 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800017070 con 0x7fc81015dec0 2024-09-19T05:43:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc80d7fa640 1 -- 172.21.15.67:0/1168384352 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80000c8c0 con 0x7fc81015dec0 2024-09-19T05:43:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc816a8f640 1 -- 172.21.15.67:0/1168384352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81015bb80 con 0x7fc81015dec0 2024-09-19T05:43:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc80d7fa640 1 -- 172.21.15.67:0/1168384352 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80000ccb0 con 0x7fc81015dec0 2024-09-19T05:43:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc816a8f640 1 -- 172.21.15.67:0/1168384352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81015c140 con 0x7fc81015dec0 2024-09-19T05:43:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc816a8f640 1 -- 172.21.15.67:0/1168384352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8100b2fd0 con 0x7fc81015dec0 2024-09-19T05:43:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc80d7fa640 1 -- 172.21.15.67:0/1168384352 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc80001a070 con 0x7fc81015dec0 2024-09-19T05:43:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc80d7fa640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7fc0678f0 0x7fc7fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.069+0000 7fc80d7fa640 1 -- 172.21.15.67:0/1168384352 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fc800086420 con 0x7fc81015dec0 2024-09-19T05:43:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.073+0000 7fc80ffff640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7fc0678f0 0x7fc7fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.073+0000 7fc80ffff640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7fc0678f0 0x7fc7fc069db0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc8040ae000 tx=0x7fc804007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:51.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.073+0000 7fc80d7fa640 1 -- 172.21.15.67:0/1168384352 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc800056eb0 con 0x7fc81015dec0 2024-09-19T05:43:51.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.233+0000 7fc816a8f640 1 -- 172.21.15.67:0/1168384352 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8100b4e30 con 0x7fc7fc0678f0 2024-09-19T05:43:51.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.249+0000 7fc80d7fa640 1 -- 172.21.15.67:0/1168384352 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247089 (secure 0 0 0) 0x7fc8100b4e30 con 0x7fc7fc0678f0 2024-09-19T05:43:51.252 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:51.254 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:43:51.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 -- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7fc0678f0 msgr2=0x7fc7fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7fc0678f0 0x7fc7fc069db0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc8040ae000 tx=0x7fc804007040 comp rx=0 tx=0).stop 2024-09-19T05:43:51.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 -- 172.21.15.67:0/1168384352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc81015dec0 msgr2=0x7fc8101545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc81015dec0 0x7fc8101545a0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fc80000e840 tx=0x7fc80000ed00 comp rx=0 tx=0).stop 2024-09-19T05:43:51.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 -- 172.21.15.67:0/1168384352 shutdown_connections 2024-09-19T05:43:51.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc7fc0678f0 0x7fc7fc069db0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810152cc0 0x7fc810153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81006dde0 0x7fc81006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 --2- 172.21.15.67:0/1168384352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc81015dec0 0x7fc8101545a0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 -- 172.21.15.67:0/1168384352 >> 172.21.15.67:0/1168384352 conn(0x7fc8100d0080 msgr2=0x7fc810154f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:51.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 -- 172.21.15.67:0/1168384352 shutdown_connections 2024-09-19T05:43:51.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.257+0000 7fc816a8f640 1 -- 172.21.15.67:0/1168384352 wait complete. 2024-09-19T05:43:51.274 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":460,"stamp":"2024-09-19T05:43:49.330630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":519824,"kb_used_data":14876,"kb_used_omap":12,"kb_used_meta":504755,"kb_avail":754454896,"statfs":{"total":773094113280,"available":772561813504,"internally_reserved":0,"allocated":15233024,"data_stored":7792253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516869681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001118"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786885+0000","last_change":"2024-09-19T05:43:46.786885+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786885+0000","last_undegraded":"2024-09-19T05:43:46.786885+0000","last_fullsized":"2024-09-19T05:43:46.786885+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779840+0000","last_change":"2024-09-19T05:43:46.779840+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779840+0000","last_undegraded":"2024-09-19T05:43:46.779840+0000","last_fullsized":"2024-09-19T05:43:46.779840+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.791744+0000","last_change":"2024-09-19T05:43:46.791744+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.791744+0000","last_undegraded":"2024-09-19T05:43:46.791744+0000","last_fullsized":"2024-09-19T05:43:46.791744+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779987+0000","last_change":"2024-09-19T05:43:46.779987+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779987+0000","last_undegraded":"2024-09-19T05:43:46.779987+0000","last_fullsized":"2024-09-19T05:43:46.779987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788817+0000","last_change":"2024-09-19T05:43:46.788817+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788817+0000","last_undegraded":"2024-09-19T05:43:46.788817+0000","last_fullsized":"2024-09-19T05:43:46.788817+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782782+0000","last_change":"2024-09-19T05:43:46.782782+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782782+0000","last_undegraded":"2024-09-19T05:43:46.782782+0000","last_fullsized":"2024-09-19T05:43:46.782782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.776382+0000","last_change":"2024-09-19T05:43:46.776382+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.776382+0000","last_undegraded":"2024-09-19T05:43:46.776382+0000","last_fullsized":"2024-09-19T05:43:46.776382+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783917+0000","last_change":"2024-09-19T05:43:46.783917+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783917+0000","last_undegraded":"2024-09-19T05:43:46.783917+0000","last_fullsized":"2024-09-19T05:43:46.783917+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783796+0000","last_change":"2024-09-19T05:43:46.783796+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783796+0000","last_undegraded":"2024-09-19T05:43:46.783796+0000","last_fullsized":"2024-09-19T05:43:46.783796+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785868+0000","last_change":"2024-09-19T05:43:46.785868+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785868+0000","last_undegraded":"2024-09-19T05:43:46.785868+0000","last_fullsized":"2024-09-19T05:43:46.785868+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781021+0000","last_change":"2024-09-19T05:43:46.781021+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781021+0000","last_undegraded":"2024-09-19T05:43:46.781021+0000","last_fullsized":"2024-09-19T05:43:46.781021+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785523+0000","last_change":"2024-09-19T05:43:46.785523+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785523+0000","last_undegraded":"2024-09-19T05:43:46.785523+0000","last_fullsized":"2024-09-19T05:43:46.785523+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783473+0000","last_change":"2024-09-19T05:43:46.783473+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783473+0000","last_undegraded":"2024-09-19T05:43:46.783473+0000","last_fullsized":"2024-09-19T05:43:46.783473+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780991+0000","last_change":"2024-09-19T05:43:46.780991+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780991+0000","last_undegraded":"2024-09-19T05:43:46.780991+0000","last_fullsized":"2024-09-19T05:43:46.780991+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783358+0000","last_change":"2024-09-19T05:43:46.783358+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783358+0000","last_undegraded":"2024-09-19T05:43:46.783358+0000","last_fullsized":"2024-09-19T05:43:46.783358+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783440+0000","last_change":"2024-09-19T05:43:46.783440+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783440+0000","last_undegraded":"2024-09-19T05:43:46.783440+0000","last_fullsized":"2024-09-19T05:43:46.783440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782821+0000","last_change":"2024-09-19T05:43:46.782821+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782821+0000","last_undegraded":"2024-09-19T05:43:46.782821+0000","last_fullsized":"2024-09-19T05:43:46.782821+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.799215+0000","last_change":"2024-09-19T05:43:46.799215+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.799215+0000","last_undegraded":"2024-09-19T05:43:46.799215+0000","last_fullsized":"2024-09-19T05:43:46.799215+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.778003+0000","last_change":"2024-09-19T05:43:46.778003+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.778003+0000","last_undegraded":"2024-09-19T05:43:46.778003+0000","last_fullsized":"2024-09-19T05:43:46.778003+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788783+0000","last_change":"2024-09-19T05:43:46.788783+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788783+0000","last_undegraded":"2024-09-19T05:43:46.788783+0000","last_fullsized":"2024-09-19T05:43:46.788783+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780660+0000","last_change":"2024-09-19T05:43:46.780660+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780660+0000","last_undegraded":"2024-09-19T05:43:46.780660+0000","last_fullsized":"2024-09-19T05:43:46.780660+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781566+0000","last_change":"2024-09-19T05:43:46.781566+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781566+0000","last_undegraded":"2024-09-19T05:43:46.781566+0000","last_fullsized":"2024-09-19T05:43:46.781566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779677+0000","last_change":"2024-09-19T05:43:46.779677+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779677+0000","last_undegraded":"2024-09-19T05:43:46.779677+0000","last_fullsized":"2024-09-19T05:43:46.779677+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782927+0000","last_change":"2024-09-19T05:43:46.782927+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782927+0000","last_undegraded":"2024-09-19T05:43:46.782927+0000","last_fullsized":"2024-09-19T05:43:46.782927+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784525+0000","last_change":"2024-09-19T05:43:46.784525+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784525+0000","last_undegraded":"2024-09-19T05:43:46.784525+0000","last_fullsized":"2024-09-19T05:43:46.784525+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781058+0000","last_change":"2024-09-19T05:43:46.781058+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781058+0000","last_undegraded":"2024-09-19T05:43:46.781058+0000","last_fullsized":"2024-09-19T05:43:46.781058+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774177+0000","last_change":"2024-09-19T05:43:46.774177+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774177+0000","last_undegraded":"2024-09-19T05:43:46.774177+0000","last_fullsized":"2024-09-19T05:43:46.774177+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787345+0000","last_change":"2024-09-19T05:43:46.787345+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787345+0000","last_undegraded":"2024-09-19T05:43:46.787345+0000","last_fullsized":"2024-09-19T05:43:46.787345+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785168+0000","last_change":"2024-09-19T05:43:46.785168+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785168+0000","last_undegraded":"2024-09-19T05:43:46.785168+0000","last_fullsized":"2024-09-19T05:43:46.785168+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784727+0000","last_change":"2024-09-19T05:43:46.784727+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784727+0000","last_undegraded":"2024-09-19T05:43:46.784727+0000","last_fullsized":"2024-09-19T05:43:46.784727+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783235+0000","last_change":"2024-09-19T05:43:46.783235+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783235+0000","last_undegraded":"2024-09-19T05:43:46.783235+0000","last_fullsized":"2024-09-19T05:43:46.783235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788400+0000","last_change":"2024-09-19T05:43:46.788400+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788400+0000","last_undegraded":"2024-09-19T05:43:46.788400+0000","last_fullsized":"2024-09-19T05:43:46.788400+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782905+0000","last_change":"2024-09-19T05:43:46.782905+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782905+0000","last_undegraded":"2024-09-19T05:43:46.782905+0000","last_fullsized":"2024-09-19T05:43:46.782905+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798473+0000","last_change":"2024-09-19T05:43:46.796706+0000","last_active":"2024-09-19T05:43:46.798473+0000","last_peered":"2024-09-19T05:43:46.798473+0000","last_clean":"2024-09-19T05:43:46.798473+0000","last_became_active":"2024-09-19T05:43:46.796008+0000","last_became_peered":"2024-09-19T05:43:46.796008+0000","last_unstale":"2024-09-19T05:43:46.798473+0000","last_undegraded":"2024-09-19T05:43:46.798473+0000","last_fullsized":"2024-09-19T05:43:46.798473+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:23.480515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782774+0000","last_change":"2024-09-19T05:43:46.782774+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782774+0000","last_undegraded":"2024-09-19T05:43:46.782774+0000","last_fullsized":"2024-09-19T05:43:46.782774+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805655+0000","last_change":"2024-09-19T05:43:46.803874+0000","last_active":"2024-09-19T05:43:46.805655+0000","last_peered":"2024-09-19T05:43:46.805655+0000","last_clean":"2024-09-19T05:43:46.805655+0000","last_became_active":"2024-09-19T05:43:46.803453+0000","last_became_peered":"2024-09-19T05:43:46.803453+0000","last_unstale":"2024-09-19T05:43:46.805655+0000","last_undegraded":"2024-09-19T05:43:46.805655+0000","last_fullsized":"2024-09-19T05:43:46.805655+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:47.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781636+0000","last_change":"2024-09-19T05:43:46.781636+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781636+0000","last_undegraded":"2024-09-19T05:43:46.781636+0000","last_fullsized":"2024-09-19T05:43:46.781636+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794711+0000","last_change":"2024-09-19T05:43:46.794089+0000","last_active":"2024-09-19T05:43:46.794711+0000","last_peered":"2024-09-19T05:43:46.794711+0000","last_clean":"2024-09-19T05:43:46.794711+0000","last_became_active":"2024-09-19T05:43:46.793490+0000","last_became_peered":"2024-09-19T05:43:46.793490+0000","last_unstale":"2024-09-19T05:43:46.794711+0000","last_undegraded":"2024-09-19T05:43:46.794711+0000","last_fullsized":"2024-09-19T05:43:46.794711+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:49.600351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780729+0000","last_change":"2024-09-19T05:43:46.780729+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780729+0000","last_undegraded":"2024-09-19T05:43:46.780729+0000","last_fullsized":"2024-09-19T05:43:46.780729+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802482+0000","last_change":"2024-09-19T05:43:46.801246+0000","last_active":"2024-09-19T05:43:46.802482+0000","last_peered":"2024-09-19T05:43:46.802482+0000","last_clean":"2024-09-19T05:43:46.802482+0000","last_became_active":"2024-09-19T05:43:46.800763+0000","last_became_peered":"2024-09-19T05:43:46.800763+0000","last_unstale":"2024-09-19T05:43:46.802482+0000","last_undegraded":"2024-09-19T05:43:46.802482+0000","last_fullsized":"2024-09-19T05:43:46.802482+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:07.329602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784304+0000","last_change":"2024-09-19T05:43:46.784304+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784304+0000","last_undegraded":"2024-09-19T05:43:46.784304+0000","last_fullsized":"2024-09-19T05:43:46.784304+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803455+0000","last_change":"2024-09-19T05:43:46.801139+0000","last_active":"2024-09-19T05:43:46.803455+0000","last_peered":"2024-09-19T05:43:46.803455+0000","last_clean":"2024-09-19T05:43:46.803455+0000","last_became_active":"2024-09-19T05:43:46.798867+0000","last_became_peered":"2024-09-19T05:43:46.798867+0000","last_unstale":"2024-09-19T05:43:46.803455+0000","last_undegraded":"2024-09-19T05:43:46.803455+0000","last_fullsized":"2024-09-19T05:43:46.803455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:03.817783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783593+0000","last_change":"2024-09-19T05:43:46.783593+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783593+0000","last_undegraded":"2024-09-19T05:43:46.783593+0000","last_fullsized":"2024-09-19T05:43:46.783593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805559+0000","last_change":"2024-09-19T05:43:46.805047+0000","last_active":"2024-09-19T05:43:46.805559+0000","last_peered":"2024-09-19T05:43:46.805559+0000","last_clean":"2024-09-19T05:43:46.805559+0000","last_became_active":"2024-09-19T05:43:46.804641+0000","last_became_peered":"2024-09-19T05:43:46.804641+0000","last_unstale":"2024-09-19T05:43:46.805559+0000","last_undegraded":"2024-09-19T05:43:46.805559+0000","last_fullsized":"2024-09-19T05:43:46.805559+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:16:31.888923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788872+0000","last_change":"2024-09-19T05:43:46.788872+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788872+0000","last_undegraded":"2024-09-19T05:43:46.788872+0000","last_fullsized":"2024-09-19T05:43:46.788872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.791499+0000","last_change":"2024-09-19T05:43:46.790512+0000","last_active":"2024-09-19T05:43:46.791499+0000","last_peered":"2024-09-19T05:43:46.791499+0000","last_clean":"2024-09-19T05:43:46.791499+0000","last_became_active":"2024-09-19T05:43:46.790026+0000","last_became_peered":"2024-09-19T05:43:46.790026+0000","last_unstale":"2024-09-19T05:43:46.791499+0000","last_undegraded":"2024-09-19T05:43:46.791499+0000","last_fullsized":"2024-09-19T05:43:46.791499+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:28.921450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.776994+0000","last_change":"2024-09-19T05:43:46.776994+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.776994+0000","last_undegraded":"2024-09-19T05:43:46.776994+0000","last_fullsized":"2024-09-19T05:43:46.776994+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.806351+0000","last_change":"2024-09-19T05:43:46.805617+0000","last_active":"2024-09-19T05:43:46.806351+0000","last_peered":"2024-09-19T05:43:46.806351+0000","last_clean":"2024-09-19T05:43:46.806351+0000","last_became_active":"2024-09-19T05:43:46.805192+0000","last_became_peered":"2024-09-19T05:43:46.805192+0000","last_unstale":"2024-09-19T05:43:46.806351+0000","last_undegraded":"2024-09-19T05:43:46.806351+0000","last_fullsized":"2024-09-19T05:43:46.806351+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:40.070418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781299+0000","last_change":"2024-09-19T05:43:46.781299+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781299+0000","last_undegraded":"2024-09-19T05:43:46.781299+0000","last_fullsized":"2024-09-19T05:43:46.781299+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803706+0000","last_change":"2024-09-19T05:43:46.801306+0000","last_active":"2024-09-19T05:43:46.803706+0000","last_peered":"2024-09-19T05:43:46.803706+0000","last_clean":"2024-09-19T05:43:46.803706+0000","last_became_active":"2024-09-19T05:43:46.800754+0000","last_became_peered":"2024-09-19T05:43:46.800754+0000","last_unstale":"2024-09-19T05:43:46.803706+0000","last_undegraded":"2024-09-19T05:43:46.803706+0000","last_fullsized":"2024-09-19T05:43:46.803706+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:12.525296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782871+0000","last_change":"2024-09-19T05:43:46.782871+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782871+0000","last_undegraded":"2024-09-19T05:43:46.782871+0000","last_fullsized":"2024-09-19T05:43:46.782871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.797079+0000","last_change":"2024-09-19T05:43:46.792317+0000","last_active":"2024-09-19T05:43:46.797079+0000","last_peered":"2024-09-19T05:43:46.797079+0000","last_clean":"2024-09-19T05:43:46.797079+0000","last_became_active":"2024-09-19T05:43:46.791902+0000","last_became_peered":"2024-09-19T05:43:46.791902+0000","last_unstale":"2024-09-19T05:43:46.797079+0000","last_undegraded":"2024-09-19T05:43:46.797079+0000","last_fullsized":"2024-09-19T05:43:46.797079+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.145371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780622+0000","last_change":"2024-09-19T05:43:46.780622+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780622+0000","last_undegraded":"2024-09-19T05:43:46.780622+0000","last_fullsized":"2024-09-19T05:43:46.780622+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.801337+0000","last_change":"2024-09-19T05:43:46.796419+0000","last_active":"2024-09-19T05:43:46.801337+0000","last_peered":"2024-09-19T05:43:46.801337+0000","last_clean":"2024-09-19T05:43:46.801337+0000","last_became_active":"2024-09-19T05:43:46.795811+0000","last_became_peered":"2024-09-19T05:43:46.795811+0000","last_unstale":"2024-09-19T05:43:46.801337+0000","last_undegraded":"2024-09-19T05:43:46.801337+0000","last_fullsized":"2024-09-19T05:43:46.801337+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:04.455952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783662+0000","last_change":"2024-09-19T05:43:46.783662+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783662+0000","last_undegraded":"2024-09-19T05:43:46.783662+0000","last_fullsized":"2024-09-19T05:43:46.783662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804576+0000","last_change":"2024-09-19T05:43:46.803323+0000","last_active":"2024-09-19T05:43:46.804576+0000","last_peered":"2024-09-19T05:43:46.804576+0000","last_clean":"2024-09-19T05:43:46.804576+0000","last_became_active":"2024-09-19T05:43:46.803032+0000","last_became_peered":"2024-09-19T05:43:46.803032+0000","last_unstale":"2024-09-19T05:43:46.804576+0000","last_undegraded":"2024-09-19T05:43:46.804576+0000","last_fullsized":"2024-09-19T05:43:46.804576+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:29.172683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785731+0000","last_change":"2024-09-19T05:43:46.785731+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785731+0000","last_undegraded":"2024-09-19T05:43:46.785731+0000","last_fullsized":"2024-09-19T05:43:46.785731+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.800482+0000","last_change":"2024-09-19T05:43:46.799385+0000","last_active":"2024-09-19T05:43:46.800482+0000","last_peered":"2024-09-19T05:43:46.800482+0000","last_clean":"2024-09-19T05:43:46.800482+0000","last_became_active":"2024-09-19T05:43:46.797943+0000","last_became_peered":"2024-09-19T05:43:46.797943+0000","last_unstale":"2024-09-19T05:43:46.800482+0000","last_undegraded":"2024-09-19T05:43:46.800482+0000","last_fullsized":"2024-09-19T05:43:46.800482+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:18.054179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775892+0000","last_change":"2024-09-19T05:43:46.775892+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775892+0000","last_undegraded":"2024-09-19T05:43:46.775892+0000","last_fullsized":"2024-09-19T05:43:46.775892+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805595+0000","last_change":"2024-09-19T05:43:46.804287+0000","last_active":"2024-09-19T05:43:46.805595+0000","last_peered":"2024-09-19T05:43:46.805595+0000","last_clean":"2024-09-19T05:43:46.805595+0000","last_became_active":"2024-09-19T05:43:46.803954+0000","last_became_peered":"2024-09-19T05:43:46.803954+0000","last_unstale":"2024-09-19T05:43:46.805595+0000","last_undegraded":"2024-09-19T05:43:46.805595+0000","last_fullsized":"2024-09-19T05:43:46.805595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:07.725004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788130+0000","last_change":"2024-09-19T05:43:46.788130+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788130+0000","last_undegraded":"2024-09-19T05:43:46.788130+0000","last_fullsized":"2024-09-19T05:43:46.788130+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798172+0000","last_change":"2024-09-19T05:43:46.797549+0000","last_active":"2024-09-19T05:43:46.798172+0000","last_peered":"2024-09-19T05:43:46.798172+0000","last_clean":"2024-09-19T05:43:46.798172+0000","last_became_active":"2024-09-19T05:43:46.797153+0000","last_became_peered":"2024-09-19T05:43:46.797153+0000","last_unstale":"2024-09-19T05:43:46.798172+0000","last_undegraded":"2024-09-19T05:43:46.798172+0000","last_fullsized":"2024-09-19T05:43:46.798172+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:15.091624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784573+0000","last_change":"2024-09-19T05:43:46.784573+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784573+0000","last_undegraded":"2024-09-19T05:43:46.784573+0000","last_fullsized":"2024-09-19T05:43:46.784573+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803653+0000","last_change":"2024-09-19T05:43:46.800003+0000","last_active":"2024-09-19T05:43:46.803653+0000","last_peered":"2024-09-19T05:43:46.803653+0000","last_clean":"2024-09-19T05:43:46.803653+0000","last_became_active":"2024-09-19T05:43:46.799092+0000","last_became_peered":"2024-09-19T05:43:46.799092+0000","last_unstale":"2024-09-19T05:43:46.803653+0000","last_undegraded":"2024-09-19T05:43:46.803653+0000","last_fullsized":"2024-09-19T05:43:46.803653+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:59.820569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775297+0000","last_change":"2024-09-19T05:43:46.775297+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775297+0000","last_undegraded":"2024-09-19T05:43:46.775297+0000","last_fullsized":"2024-09-19T05:43:46.775297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.796400+0000","last_change":"2024-09-19T05:43:46.795206+0000","last_active":"2024-09-19T05:43:46.796400+0000","last_peered":"2024-09-19T05:43:46.796400+0000","last_clean":"2024-09-19T05:43:46.796400+0000","last_became_active":"2024-09-19T05:43:46.794855+0000","last_became_peered":"2024-09-19T05:43:46.794855+0000","last_unstale":"2024-09-19T05:43:46.796400+0000","last_undegraded":"2024-09-19T05:43:46.796400+0000","last_fullsized":"2024-09-19T05:43:46.796400+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:10.402439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774036+0000","last_change":"2024-09-19T05:43:46.774036+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774036+0000","last_undegraded":"2024-09-19T05:43:46.774036+0000","last_fullsized":"2024-09-19T05:43:46.774036+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.791063+0000","last_change":"2024-09-19T05:43:46.790169+0000","last_active":"2024-09-19T05:43:46.791063+0000","last_peered":"2024-09-19T05:43:46.791063+0000","last_clean":"2024-09-19T05:43:46.791063+0000","last_became_active":"2024-09-19T05:43:46.789867+0000","last_became_peered":"2024-09-19T05:43:46.789867+0000","last_unstale":"2024-09-19T05:43:46.791063+0000","last_undegraded":"2024-09-19T05:43:46.791063+0000","last_fullsized":"2024-09-19T05:43:46.791063+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:55.643231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786570+0000","last_change":"2024-09-19T05:43:46.786570+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786570+0000","last_undegraded":"2024-09-19T05:43:46.786570+0000","last_fullsized":"2024-09-19T05:43:46.786570+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804679+0000","last_change":"2024-09-19T05:43:46.804003+0000","last_active":"2024-09-19T05:43:46.804679+0000","last_peered":"2024-09-19T05:43:46.804679+0000","last_clean":"2024-09-19T05:43:46.804679+0000","last_became_active":"2024-09-19T05:43:46.799507+0000","last_became_peered":"2024-09-19T05:43:46.799507+0000","last_unstale":"2024-09-19T05:43:46.804679+0000","last_undegraded":"2024-09-19T05:43:46.804679+0000","last_fullsized":"2024-09-19T05:43:46.804679+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:09.181248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787593+0000","last_change":"2024-09-19T05:43:46.787593+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787593+0000","last_undegraded":"2024-09-19T05:43:46.787593+0000","last_fullsized":"2024-09-19T05:43:46.787593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803417+0000","last_change":"2024-09-19T05:43:46.801154+0000","last_active":"2024-09-19T05:43:46.803417+0000","last_peered":"2024-09-19T05:43:46.803417+0000","last_clean":"2024-09-19T05:43:46.803417+0000","last_became_active":"2024-09-19T05:43:46.798367+0000","last_became_peered":"2024-09-19T05:43:46.798367+0000","last_unstale":"2024-09-19T05:43:46.803417+0000","last_undegraded":"2024-09-19T05:43:46.803417+0000","last_fullsized":"2024-09-19T05:43:46.803417+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:11.177367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781841+0000","last_change":"2024-09-19T05:43:46.781841+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781841+0000","last_undegraded":"2024-09-19T05:43:46.781841+0000","last_fullsized":"2024-09-19T05:43:46.781841+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.806011+0000","last_change":"2024-09-19T05:43:46.805429+0000","last_active":"2024-09-19T05:43:46.806011+0000","last_peered":"2024-09-19T05:43:46.806011+0000","last_clean":"2024-09-19T05:43:46.806011+0000","last_became_active":"2024-09-19T05:43:46.805016+0000","last_became_peered":"2024-09-19T05:43:46.805016+0000","last_unstale":"2024-09-19T05:43:46.806011+0000","last_undegraded":"2024-09-19T05:43:46.806011+0000","last_fullsized":"2024-09-19T05:43:46.806011+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:06.495111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788028+0000","last_change":"2024-09-19T05:43:46.788028+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788028+0000","last_undegraded":"2024-09-19T05:43:46.788028+0000","last_fullsized":"2024-09-19T05:43:46.788028+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.796767+0000","last_change":"2024-09-19T05:43:46.796046+0000","last_active":"2024-09-19T05:43:46.796767+0000","last_peered":"2024-09-19T05:43:46.796767+0000","last_clean":"2024-09-19T05:43:46.796767+0000","last_became_active":"2024-09-19T05:43:46.795486+0000","last_became_peered":"2024-09-19T05:43:46.795486+0000","last_unstale":"2024-09-19T05:43:46.796767+0000","last_undegraded":"2024-09-19T05:43:46.796767+0000","last_fullsized":"2024-09-19T05:43:46.796767+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:37.034508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782676+0000","last_change":"2024-09-19T05:43:46.782676+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782676+0000","last_undegraded":"2024-09-19T05:43:46.782676+0000","last_fullsized":"2024-09-19T05:43:46.782676+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794691+0000","last_change":"2024-09-19T05:43:46.793209+0000","last_active":"2024-09-19T05:43:46.794691+0000","last_peered":"2024-09-19T05:43:46.794691+0000","last_clean":"2024-09-19T05:43:46.794691+0000","last_became_active":"2024-09-19T05:43:46.792865+0000","last_became_peered":"2024-09-19T05:43:46.792865+0000","last_unstale":"2024-09-19T05:43:46.794691+0000","last_undegraded":"2024-09-19T05:43:46.794691+0000","last_fullsized":"2024-09-19T05:43:46.794691+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:43.808413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787618+0000","last_change":"2024-09-19T05:43:46.787618+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787618+0000","last_undegraded":"2024-09-19T05:43:46.787618+0000","last_fullsized":"2024-09-19T05:43:46.787618+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.800461+0000","last_change":"2024-09-19T05:43:46.799401+0000","last_active":"2024-09-19T05:43:46.800461+0000","last_peered":"2024-09-19T05:43:46.800461+0000","last_clean":"2024-09-19T05:43:46.800461+0000","last_became_active":"2024-09-19T05:43:46.797931+0000","last_became_peered":"2024-09-19T05:43:46.797931+0000","last_unstale":"2024-09-19T05:43:46.800461+0000","last_undegraded":"2024-09-19T05:43:46.800461+0000","last_fullsized":"2024-09-19T05:43:46.800461+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:46.679571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781068+0000","last_change":"2024-09-19T05:43:46.781068+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781068+0000","last_undegraded":"2024-09-19T05:43:46.781068+0000","last_fullsized":"2024-09-19T05:43:46.781068+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805402+0000","last_change":"2024-09-19T05:43:46.803632+0000","last_active":"2024-09-19T05:43:46.805402+0000","last_peered":"2024-09-19T05:43:46.805402+0000","last_clean":"2024-09-19T05:43:46.805402+0000","last_became_active":"2024-09-19T05:43:46.803191+0000","last_became_peered":"2024-09-19T05:43:46.803191+0000","last_unstale":"2024-09-19T05:43:46.805402+0000","last_undegraded":"2024-09-19T05:43:46.805402+0000","last_fullsized":"2024-09-19T05:43:46.805402+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:10.402439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775393+0000","last_change":"2024-09-19T05:43:46.775393+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775393+0000","last_undegraded":"2024-09-19T05:43:46.775393+0000","last_fullsized":"2024-09-19T05:43:46.775393+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802411+0000","last_change":"2024-09-19T05:43:46.797969+0000","last_active":"2024-09-19T05:43:46.802411+0000","last_peered":"2024-09-19T05:43:46.802411+0000","last_clean":"2024-09-19T05:43:46.802411+0000","last_became_active":"2024-09-19T05:43:46.797489+0000","last_became_peered":"2024-09-19T05:43:46.797489+0000","last_unstale":"2024-09-19T05:43:46.802411+0000","last_undegraded":"2024-09-19T05:43:46.802411+0000","last_fullsized":"2024-09-19T05:43:46.802411+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:31.524906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786019+0000","last_change":"2024-09-19T05:43:46.786019+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786019+0000","last_undegraded":"2024-09-19T05:43:46.786019+0000","last_fullsized":"2024-09-19T05:43:46.786019+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794623+0000","last_change":"2024-09-19T05:43:46.792214+0000","last_active":"2024-09-19T05:43:46.794623+0000","last_peered":"2024-09-19T05:43:46.794623+0000","last_clean":"2024-09-19T05:43:46.794623+0000","last_became_active":"2024-09-19T05:43:46.791792+0000","last_became_peered":"2024-09-19T05:43:46.791792+0000","last_unstale":"2024-09-19T05:43:46.794623+0000","last_undegraded":"2024-09-19T05:43:46.794623+0000","last_fullsized":"2024-09-19T05:43:46.794623+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:31.011960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782662+0000","last_change":"2024-09-19T05:43:46.782662+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782662+0000","last_undegraded":"2024-09-19T05:43:46.782662+0000","last_fullsized":"2024-09-19T05:43:46.782662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802451+0000","last_change":"2024-09-19T05:43:46.790954+0000","last_active":"2024-09-19T05:43:46.802451+0000","last_peered":"2024-09-19T05:43:46.802451+0000","last_clean":"2024-09-19T05:43:46.802451+0000","last_became_active":"2024-09-19T05:43:46.790304+0000","last_became_peered":"2024-09-19T05:43:46.790304+0000","last_unstale":"2024-09-19T05:43:46.802451+0000","last_undegraded":"2024-09-19T05:43:46.802451+0000","last_fullsized":"2024-09-19T05:43:46.802451+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:00.007614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784239+0000","last_change":"2024-09-19T05:43:46.784239+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784239+0000","last_undegraded":"2024-09-19T05:43:46.784239+0000","last_fullsized":"2024-09-19T05:43:46.784239+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803746+0000","last_change":"2024-09-19T05:43:46.802290+0000","last_active":"2024-09-19T05:43:46.803746+0000","last_peered":"2024-09-19T05:43:46.803746+0000","last_clean":"2024-09-19T05:43:46.803746+0000","last_became_active":"2024-09-19T05:43:46.802005+0000","last_became_peered":"2024-09-19T05:43:46.802005+0000","last_unstale":"2024-09-19T05:43:46.803746+0000","last_undegraded":"2024-09-19T05:43:46.803746+0000","last_fullsized":"2024-09-19T05:43:46.803746+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:50.223356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784548+0000","last_change":"2024-09-19T05:43:46.784548+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784548+0000","last_undegraded":"2024-09-19T05:43:46.784548+0000","last_fullsized":"2024-09-19T05:43:46.784548+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.792514+0000","last_change":"2024-09-19T05:43:46.791368+0000","last_active":"2024-09-19T05:43:46.792514+0000","last_peered":"2024-09-19T05:43:46.792514+0000","last_clean":"2024-09-19T05:43:46.792514+0000","last_became_active":"2024-09-19T05:43:46.791101+0000","last_became_peered":"2024-09-19T05:43:46.791101+0000","last_unstale":"2024-09-19T05:43:46.792514+0000","last_undegraded":"2024-09-19T05:43:46.792514+0000","last_fullsized":"2024-09-19T05:43:46.792514+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:53.666132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774036+0000","last_change":"2024-09-19T05:43:46.774036+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774036+0000","last_undegraded":"2024-09-19T05:43:46.774036+0000","last_fullsized":"2024-09-19T05:43:46.774036+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804572+0000","last_change":"2024-09-19T05:43:46.803154+0000","last_active":"2024-09-19T05:43:46.804572+0000","last_peered":"2024-09-19T05:43:46.804572+0000","last_clean":"2024-09-19T05:43:46.804572+0000","last_became_active":"2024-09-19T05:43:46.802771+0000","last_became_peered":"2024-09-19T05:43:46.802771+0000","last_unstale":"2024-09-19T05:43:46.804572+0000","last_undegraded":"2024-09-19T05:43:46.804572+0000","last_fullsized":"2024-09-19T05:43:46.804572+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:06.895736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784563+0000","last_change":"2024-09-19T05:43:46.784563+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784563+0000","last_undegraded":"2024-09-19T05:43:46.784563+0000","last_fullsized":"2024-09-19T05:43:46.784563+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798838+0000","last_change":"2024-09-19T05:43:46.798297+0000","last_active":"2024-09-19T05:43:46.798838+0000","last_peered":"2024-09-19T05:43:46.798838+0000","last_clean":"2024-09-19T05:43:46.798838+0000","last_became_active":"2024-09-19T05:43:46.797990+0000","last_became_peered":"2024-09-19T05:43:46.797990+0000","last_unstale":"2024-09-19T05:43:46.798838+0000","last_undegraded":"2024-09-19T05:43:46.798838+0000","last_fullsized":"2024-09-19T05:43:46.798838+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:03.752818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":388,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.787456+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:43:46.787456+0000","last_peered":"2024-09-19T05:43:46.787456+0000","last_clean":"2024-09-19T05:43:46.787456+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:43:46.787456+0000","last_undegraded":"2024-09-19T05:43:46.787456+0000","last_fullsized":"2024-09-19T05:43:46.787456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542275,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65424,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306416,"statfs":{"total":96636764160,"available":96569769984,"internally_reserved":0,"allocated":2351104,"data_stored":1417640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542275,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64844,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306996,"statfs":{"total":96636764160,"available":96570363904,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542277,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59260,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312580,"statfs":{"total":96636764160,"available":96576081920,"internally_reserved":0,"allocated":1744896,"data_stored":820613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542275,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69000,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302840,"statfs":{"total":96636764160,"available":96566108160,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63436,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308404,"statfs":{"total":96636764160,"available":96571805696,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69004,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302836,"statfs":{"total":96636764160,"available":96566104064,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542278,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55116,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316724,"statfs":{"total":96636764160,"available":96580325376,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542275,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73740,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298100,"statfs":{"total":96636764160,"available":96561254400,"internally_reserved":0,"allocated":2351104,"data_stored":1417640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:43:51.277 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:43:51.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.449+0000 7f9489634640 1 Processor -- start 2024-09-19T05:43:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.449+0000 7f9489634640 1 -- start start 2024-09-19T05:43:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f948415e330 0x7f9484071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f94840b2fd0 0x7f94840724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94840b4bc0 0x7f9484161f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f94840acfb0 con 0x7f948415e330 2024-09-19T05:43:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f94840b3ef0 con 0x7f94840b2fd0 2024-09-19T05:43:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f94840b4420 con 0x7f94840b4bc0 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9482ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f948415e330 0x7f9484071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9482ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f948415e330 0x7f9484071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55604/0 (socket says 172.21.15.67:55604) 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9482ffd640 1 -- 172.21.15.67:0/2145018190 learned_addr learned my addr 172.21.15.67:0/2145018190 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f94837fe640 1 --2- 172.21.15.67:0/2145018190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94840b4bc0 0x7f9484161f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f94827fc640 1 --2- 172.21.15.67:0/2145018190 >> v2:172.21.15.97:3300/0 conn(0x7f94840b2fd0 0x7f94840724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9482ffd640 1 -- 172.21.15.67:0/2145018190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94840b4bc0 msgr2=0x7f9484161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9482ffd640 1 --2- 172.21.15.67:0/2145018190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94840b4bc0 0x7f9484161f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9482ffd640 1 -- 172.21.15.67:0/2145018190 >> v2:172.21.15.97:3300/0 conn(0x7f94840b2fd0 msgr2=0x7f94840724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9482ffd640 1 --2- 172.21.15.67:0/2145018190 >> v2:172.21.15.97:3300/0 conn(0x7f94840b2fd0 0x7f94840724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9482ffd640 1 -- 172.21.15.67:0/2145018190 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94840b4140 con 0x7f948415e330 2024-09-19T05:43:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f94827fc640 1 --2- 172.21.15.67:0/2145018190 >> v2:172.21.15.97:3300/0 conn(0x7f94840b2fd0 0x7f94840724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9482ffd640 1 --2- 172.21.15.67:0/2145018190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f948415e330 0x7f9484071fa0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f94840b2d60 tx=0x7f947c01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe88b323873767b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9481ffb640 1 -- 172.21.15.67:0/2145018190 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0a5580 con 0x7f948415e330 2024-09-19T05:43:51.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9481ffb640 1 -- 172.21.15.67:0/2145018190 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c0a5720 con 0x7f948415e330 2024-09-19T05:43:51.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9481ffb640 1 -- 172.21.15.67:0/2145018190 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0a5af0 con 0x7f948415e330 2024-09-19T05:43:51.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 -- 172.21.15.67:0/2145018190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f948415e330 msgr2=0x7f9484071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 --2- 172.21.15.67:0/2145018190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f948415e330 0x7f9484071fa0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f94840b2d60 tx=0x7f947c01c700 comp rx=0 tx=0).stop 2024-09-19T05:43:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 -- 172.21.15.67:0/2145018190 shutdown_connections 2024-09-19T05:43:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 --2- 172.21.15.67:0/2145018190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94840b4bc0 0x7f9484161f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 --2- 172.21.15.67:0/2145018190 >> v2:172.21.15.97:3300/0 conn(0x7f94840b2fd0 0x7f94840724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 --2- 172.21.15.67:0/2145018190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f948415e330 0x7f9484071fa0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 -- 172.21.15.67:0/2145018190 >> 172.21.15.67:0/2145018190 conn(0x7f94840d0080 msgr2=0x7f94840d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.453+0000 7f9489634640 1 -- 172.21.15.67:0/2145018190 shutdown_connections 2024-09-19T05:43:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 -- 172.21.15.67:0/2145018190 wait complete. 2024-09-19T05:43:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 Processor -- start 2024-09-19T05:43:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 -- start start 2024-09-19T05:43:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94840b4bc0 0x7f9484148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f948415e330 0x7f948415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9484149eb0 0x7f9484154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f94840cfe40 con 0x7f94840b4bc0 2024-09-19T05:43:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f94840cfcc0 con 0x7f9484149eb0 2024-09-19T05:43:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f948406e6f0 con 0x7f948415e330 2024-09-19T05:43:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9482ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94840b4bc0 0x7f9484148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9482ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94840b4bc0 0x7f9484148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55612/0 (socket says 172.21.15.67:55612) 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9482ffd640 1 -- 172.21.15.67:0/124438864 learned_addr learned my addr 172.21.15.67:0/124438864 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f94837fe640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9484149eb0 0x7f9484154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f94827fc640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f948415e330 0x7f948415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9482ffd640 1 -- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f948415e330 msgr2=0x7f948415d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9482ffd640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f948415e330 0x7f948415d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9482ffd640 1 -- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9484149eb0 msgr2=0x7f9484154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9482ffd640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9484149eb0 0x7f9484154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9482ffd640 1 -- 172.21.15.67:0/124438864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9484148a60 con 0x7f94840b4bc0 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f94837fe640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9484149eb0 0x7f9484154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f94827fc640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f948415e330 0x7f948415d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9482ffd640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94840b4bc0 0x7f9484148520 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f947c0af040 tx=0x7f947c0194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f946b7fe640 1 -- 172.21.15.67:0/124438864 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0bc020 con 0x7f94840b4bc0 2024-09-19T05:43:51.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f946b7fe640 1 -- 172.21.15.67:0/124438864 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c0b8670 con 0x7f94840b4bc0 2024-09-19T05:43:51.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f946b7fe640 1 -- 172.21.15.67:0/124438864 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c009510 con 0x7f94840b4bc0 2024-09-19T05:43:51.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 -- 172.21.15.67:0/124438864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948414a440 con 0x7f94840b4bc0 2024-09-19T05:43:51.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 -- 172.21.15.67:0/124438864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948414aa00 con 0x7f94840b4bc0 2024-09-19T05:43:51.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.457+0000 7f9489634640 1 -- 172.21.15.67:0/124438864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9484161f70 con 0x7f94840b4bc0 2024-09-19T05:43:51.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.461+0000 7f946b7fe640 1 -- 172.21.15.67:0/124438864 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f947c0bf020 con 0x7f94840b4bc0 2024-09-19T05:43:51.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.461+0000 7f946b7fe640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f94700678c0 0x7f9470069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.461+0000 7f946b7fe640 1 -- 172.21.15.67:0/124438864 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f947c120cb0 con 0x7f94840b4bc0 2024-09-19T05:43:51.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.461+0000 7f94827fc640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f94700678c0 0x7f9470069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.461+0000 7f94827fc640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f94700678c0 0x7f9470069d80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f94840ae580 tx=0x7f9478008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:51.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.465+0000 7f946b7fe640 1 -- 172.21.15.67:0/124438864 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f947c0c6030 con 0x7f94840b4bc0 2024-09-19T05:43:51.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.625+0000 7f9489634640 1 -- 172.21.15.67:0/124438864 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9484072b00 con 0x7f94700678c0 2024-09-19T05:43:51.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.641+0000 7f946b7fe640 1 -- 172.21.15.67:0/124438864 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247089 (secure 0 0 0) 0x7f9484072b00 con 0x7f94700678c0 2024-09-19T05:43:51.642 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:51.645 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:43:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 -- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f94700678c0 msgr2=0x7f9470069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f94700678c0 0x7f9470069d80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f94840ae580 tx=0x7f9478008040 comp rx=0 tx=0).stop 2024-09-19T05:43:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 -- 172.21.15.67:0/124438864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94840b4bc0 msgr2=0x7f9484148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94840b4bc0 0x7f9484148520 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f947c0af040 tx=0x7f947c0194a0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 -- 172.21.15.67:0/124438864 shutdown_connections 2024-09-19T05:43:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9484149eb0 0x7f9484154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f94700678c0 0x7f9470069d80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f948415e330 0x7f948415d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 --2- 172.21.15.67:0/124438864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94840b4bc0 0x7f9484148520 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 -- 172.21.15.67:0/124438864 >> 172.21.15.67:0/124438864 conn(0x7f94840d0080 msgr2=0x7f94840ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 -- 172.21.15.67:0/124438864 shutdown_connections 2024-09-19T05:43:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.645+0000 7f9489634640 1 -- 172.21.15.67:0/124438864 wait complete. 2024-09-19T05:43:51.660 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":461,"stamp":"2024-09-19T05:43:51.331198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":519824,"kb_used_data":14876,"kb_used_omap":12,"kb_used_meta":504755,"kb_avail":754454896,"statfs":{"total":773094113280,"available":772561813504,"internally_reserved":0,"allocated":15233024,"data_stored":7792253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516869681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.565949"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786885+0000","last_change":"2024-09-19T05:43:46.786885+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786885+0000","last_undegraded":"2024-09-19T05:43:46.786885+0000","last_fullsized":"2024-09-19T05:43:46.786885+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779840+0000","last_change":"2024-09-19T05:43:46.779840+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779840+0000","last_undegraded":"2024-09-19T05:43:46.779840+0000","last_fullsized":"2024-09-19T05:43:46.779840+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.791744+0000","last_change":"2024-09-19T05:43:46.791744+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.791744+0000","last_undegraded":"2024-09-19T05:43:46.791744+0000","last_fullsized":"2024-09-19T05:43:46.791744+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779987+0000","last_change":"2024-09-19T05:43:46.779987+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779987+0000","last_undegraded":"2024-09-19T05:43:46.779987+0000","last_fullsized":"2024-09-19T05:43:46.779987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788817+0000","last_change":"2024-09-19T05:43:46.788817+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788817+0000","last_undegraded":"2024-09-19T05:43:46.788817+0000","last_fullsized":"2024-09-19T05:43:46.788817+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782782+0000","last_change":"2024-09-19T05:43:46.782782+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782782+0000","last_undegraded":"2024-09-19T05:43:46.782782+0000","last_fullsized":"2024-09-19T05:43:46.782782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.776382+0000","last_change":"2024-09-19T05:43:46.776382+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.776382+0000","last_undegraded":"2024-09-19T05:43:46.776382+0000","last_fullsized":"2024-09-19T05:43:46.776382+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783917+0000","last_change":"2024-09-19T05:43:46.783917+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783917+0000","last_undegraded":"2024-09-19T05:43:46.783917+0000","last_fullsized":"2024-09-19T05:43:46.783917+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783796+0000","last_change":"2024-09-19T05:43:46.783796+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783796+0000","last_undegraded":"2024-09-19T05:43:46.783796+0000","last_fullsized":"2024-09-19T05:43:46.783796+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785868+0000","last_change":"2024-09-19T05:43:46.785868+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785868+0000","last_undegraded":"2024-09-19T05:43:46.785868+0000","last_fullsized":"2024-09-19T05:43:46.785868+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781021+0000","last_change":"2024-09-19T05:43:46.781021+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781021+0000","last_undegraded":"2024-09-19T05:43:46.781021+0000","last_fullsized":"2024-09-19T05:43:46.781021+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785523+0000","last_change":"2024-09-19T05:43:46.785523+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785523+0000","last_undegraded":"2024-09-19T05:43:46.785523+0000","last_fullsized":"2024-09-19T05:43:46.785523+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783473+0000","last_change":"2024-09-19T05:43:46.783473+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783473+0000","last_undegraded":"2024-09-19T05:43:46.783473+0000","last_fullsized":"2024-09-19T05:43:46.783473+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780991+0000","last_change":"2024-09-19T05:43:46.780991+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780991+0000","last_undegraded":"2024-09-19T05:43:46.780991+0000","last_fullsized":"2024-09-19T05:43:46.780991+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783358+0000","last_change":"2024-09-19T05:43:46.783358+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783358+0000","last_undegraded":"2024-09-19T05:43:46.783358+0000","last_fullsized":"2024-09-19T05:43:46.783358+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783440+0000","last_change":"2024-09-19T05:43:46.783440+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783440+0000","last_undegraded":"2024-09-19T05:43:46.783440+0000","last_fullsized":"2024-09-19T05:43:46.783440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782821+0000","last_change":"2024-09-19T05:43:46.782821+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782821+0000","last_undegraded":"2024-09-19T05:43:46.782821+0000","last_fullsized":"2024-09-19T05:43:46.782821+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.799215+0000","last_change":"2024-09-19T05:43:46.799215+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.799215+0000","last_undegraded":"2024-09-19T05:43:46.799215+0000","last_fullsized":"2024-09-19T05:43:46.799215+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.778003+0000","last_change":"2024-09-19T05:43:46.778003+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.778003+0000","last_undegraded":"2024-09-19T05:43:46.778003+0000","last_fullsized":"2024-09-19T05:43:46.778003+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788783+0000","last_change":"2024-09-19T05:43:46.788783+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788783+0000","last_undegraded":"2024-09-19T05:43:46.788783+0000","last_fullsized":"2024-09-19T05:43:46.788783+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780660+0000","last_change":"2024-09-19T05:43:46.780660+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780660+0000","last_undegraded":"2024-09-19T05:43:46.780660+0000","last_fullsized":"2024-09-19T05:43:46.780660+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781566+0000","last_change":"2024-09-19T05:43:46.781566+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781566+0000","last_undegraded":"2024-09-19T05:43:46.781566+0000","last_fullsized":"2024-09-19T05:43:46.781566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779677+0000","last_change":"2024-09-19T05:43:46.779677+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779677+0000","last_undegraded":"2024-09-19T05:43:46.779677+0000","last_fullsized":"2024-09-19T05:43:46.779677+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782927+0000","last_change":"2024-09-19T05:43:46.782927+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782927+0000","last_undegraded":"2024-09-19T05:43:46.782927+0000","last_fullsized":"2024-09-19T05:43:46.782927+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784525+0000","last_change":"2024-09-19T05:43:46.784525+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784525+0000","last_undegraded":"2024-09-19T05:43:46.784525+0000","last_fullsized":"2024-09-19T05:43:46.784525+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781058+0000","last_change":"2024-09-19T05:43:46.781058+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781058+0000","last_undegraded":"2024-09-19T05:43:46.781058+0000","last_fullsized":"2024-09-19T05:43:46.781058+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774177+0000","last_change":"2024-09-19T05:43:46.774177+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774177+0000","last_undegraded":"2024-09-19T05:43:46.774177+0000","last_fullsized":"2024-09-19T05:43:46.774177+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787345+0000","last_change":"2024-09-19T05:43:46.787345+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787345+0000","last_undegraded":"2024-09-19T05:43:46.787345+0000","last_fullsized":"2024-09-19T05:43:46.787345+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785168+0000","last_change":"2024-09-19T05:43:46.785168+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785168+0000","last_undegraded":"2024-09-19T05:43:46.785168+0000","last_fullsized":"2024-09-19T05:43:46.785168+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784727+0000","last_change":"2024-09-19T05:43:46.784727+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784727+0000","last_undegraded":"2024-09-19T05:43:46.784727+0000","last_fullsized":"2024-09-19T05:43:46.784727+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783235+0000","last_change":"2024-09-19T05:43:46.783235+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783235+0000","last_undegraded":"2024-09-19T05:43:46.783235+0000","last_fullsized":"2024-09-19T05:43:46.783235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788400+0000","last_change":"2024-09-19T05:43:46.788400+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788400+0000","last_undegraded":"2024-09-19T05:43:46.788400+0000","last_fullsized":"2024-09-19T05:43:46.788400+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782905+0000","last_change":"2024-09-19T05:43:46.782905+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782905+0000","last_undegraded":"2024-09-19T05:43:46.782905+0000","last_fullsized":"2024-09-19T05:43:46.782905+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798473+0000","last_change":"2024-09-19T05:43:46.796706+0000","last_active":"2024-09-19T05:43:46.798473+0000","last_peered":"2024-09-19T05:43:46.798473+0000","last_clean":"2024-09-19T05:43:46.798473+0000","last_became_active":"2024-09-19T05:43:46.796008+0000","last_became_peered":"2024-09-19T05:43:46.796008+0000","last_unstale":"2024-09-19T05:43:46.798473+0000","last_undegraded":"2024-09-19T05:43:46.798473+0000","last_fullsized":"2024-09-19T05:43:46.798473+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:23.480515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782774+0000","last_change":"2024-09-19T05:43:46.782774+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782774+0000","last_undegraded":"2024-09-19T05:43:46.782774+0000","last_fullsized":"2024-09-19T05:43:46.782774+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805655+0000","last_change":"2024-09-19T05:43:46.803874+0000","last_active":"2024-09-19T05:43:46.805655+0000","last_peered":"2024-09-19T05:43:46.805655+0000","last_clean":"2024-09-19T05:43:46.805655+0000","last_became_active":"2024-09-19T05:43:46.803453+0000","last_became_peered":"2024-09-19T05:43:46.803453+0000","last_unstale":"2024-09-19T05:43:46.805655+0000","last_undegraded":"2024-09-19T05:43:46.805655+0000","last_fullsized":"2024-09-19T05:43:46.805655+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:47.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781636+0000","last_change":"2024-09-19T05:43:46.781636+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781636+0000","last_undegraded":"2024-09-19T05:43:46.781636+0000","last_fullsized":"2024-09-19T05:43:46.781636+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794711+0000","last_change":"2024-09-19T05:43:46.794089+0000","last_active":"2024-09-19T05:43:46.794711+0000","last_peered":"2024-09-19T05:43:46.794711+0000","last_clean":"2024-09-19T05:43:46.794711+0000","last_became_active":"2024-09-19T05:43:46.793490+0000","last_became_peered":"2024-09-19T05:43:46.793490+0000","last_unstale":"2024-09-19T05:43:46.794711+0000","last_undegraded":"2024-09-19T05:43:46.794711+0000","last_fullsized":"2024-09-19T05:43:46.794711+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:49.600351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780729+0000","last_change":"2024-09-19T05:43:46.780729+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780729+0000","last_undegraded":"2024-09-19T05:43:46.780729+0000","last_fullsized":"2024-09-19T05:43:46.780729+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802482+0000","last_change":"2024-09-19T05:43:46.801246+0000","last_active":"2024-09-19T05:43:46.802482+0000","last_peered":"2024-09-19T05:43:46.802482+0000","last_clean":"2024-09-19T05:43:46.802482+0000","last_became_active":"2024-09-19T05:43:46.800763+0000","last_became_peered":"2024-09-19T05:43:46.800763+0000","last_unstale":"2024-09-19T05:43:46.802482+0000","last_undegraded":"2024-09-19T05:43:46.802482+0000","last_fullsized":"2024-09-19T05:43:46.802482+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:07.329602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784304+0000","last_change":"2024-09-19T05:43:46.784304+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784304+0000","last_undegraded":"2024-09-19T05:43:46.784304+0000","last_fullsized":"2024-09-19T05:43:46.784304+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803455+0000","last_change":"2024-09-19T05:43:46.801139+0000","last_active":"2024-09-19T05:43:46.803455+0000","last_peered":"2024-09-19T05:43:46.803455+0000","last_clean":"2024-09-19T05:43:46.803455+0000","last_became_active":"2024-09-19T05:43:46.798867+0000","last_became_peered":"2024-09-19T05:43:46.798867+0000","last_unstale":"2024-09-19T05:43:46.803455+0000","last_undegraded":"2024-09-19T05:43:46.803455+0000","last_fullsized":"2024-09-19T05:43:46.803455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:03.817783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783593+0000","last_change":"2024-09-19T05:43:46.783593+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783593+0000","last_undegraded":"2024-09-19T05:43:46.783593+0000","last_fullsized":"2024-09-19T05:43:46.783593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805559+0000","last_change":"2024-09-19T05:43:46.805047+0000","last_active":"2024-09-19T05:43:46.805559+0000","last_peered":"2024-09-19T05:43:46.805559+0000","last_clean":"2024-09-19T05:43:46.805559+0000","last_became_active":"2024-09-19T05:43:46.804641+0000","last_became_peered":"2024-09-19T05:43:46.804641+0000","last_unstale":"2024-09-19T05:43:46.805559+0000","last_undegraded":"2024-09-19T05:43:46.805559+0000","last_fullsized":"2024-09-19T05:43:46.805559+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:16:31.888923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788872+0000","last_change":"2024-09-19T05:43:46.788872+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788872+0000","last_undegraded":"2024-09-19T05:43:46.788872+0000","last_fullsized":"2024-09-19T05:43:46.788872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.791499+0000","last_change":"2024-09-19T05:43:46.790512+0000","last_active":"2024-09-19T05:43:46.791499+0000","last_peered":"2024-09-19T05:43:46.791499+0000","last_clean":"2024-09-19T05:43:46.791499+0000","last_became_active":"2024-09-19T05:43:46.790026+0000","last_became_peered":"2024-09-19T05:43:46.790026+0000","last_unstale":"2024-09-19T05:43:46.791499+0000","last_undegraded":"2024-09-19T05:43:46.791499+0000","last_fullsized":"2024-09-19T05:43:46.791499+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:28.921450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.776994+0000","last_change":"2024-09-19T05:43:46.776994+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.776994+0000","last_undegraded":"2024-09-19T05:43:46.776994+0000","last_fullsized":"2024-09-19T05:43:46.776994+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.806351+0000","last_change":"2024-09-19T05:43:46.805617+0000","last_active":"2024-09-19T05:43:46.806351+0000","last_peered":"2024-09-19T05:43:46.806351+0000","last_clean":"2024-09-19T05:43:46.806351+0000","last_became_active":"2024-09-19T05:43:46.805192+0000","last_became_peered":"2024-09-19T05:43:46.805192+0000","last_unstale":"2024-09-19T05:43:46.806351+0000","last_undegraded":"2024-09-19T05:43:46.806351+0000","last_fullsized":"2024-09-19T05:43:46.806351+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:40.070418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781299+0000","last_change":"2024-09-19T05:43:46.781299+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781299+0000","last_undegraded":"2024-09-19T05:43:46.781299+0000","last_fullsized":"2024-09-19T05:43:46.781299+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803706+0000","last_change":"2024-09-19T05:43:46.801306+0000","last_active":"2024-09-19T05:43:46.803706+0000","last_peered":"2024-09-19T05:43:46.803706+0000","last_clean":"2024-09-19T05:43:46.803706+0000","last_became_active":"2024-09-19T05:43:46.800754+0000","last_became_peered":"2024-09-19T05:43:46.800754+0000","last_unstale":"2024-09-19T05:43:46.803706+0000","last_undegraded":"2024-09-19T05:43:46.803706+0000","last_fullsized":"2024-09-19T05:43:46.803706+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:12.525296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782871+0000","last_change":"2024-09-19T05:43:46.782871+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782871+0000","last_undegraded":"2024-09-19T05:43:46.782871+0000","last_fullsized":"2024-09-19T05:43:46.782871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.797079+0000","last_change":"2024-09-19T05:43:46.792317+0000","last_active":"2024-09-19T05:43:46.797079+0000","last_peered":"2024-09-19T05:43:46.797079+0000","last_clean":"2024-09-19T05:43:46.797079+0000","last_became_active":"2024-09-19T05:43:46.791902+0000","last_became_peered":"2024-09-19T05:43:46.791902+0000","last_unstale":"2024-09-19T05:43:46.797079+0000","last_undegraded":"2024-09-19T05:43:46.797079+0000","last_fullsized":"2024-09-19T05:43:46.797079+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.145371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780622+0000","last_change":"2024-09-19T05:43:46.780622+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780622+0000","last_undegraded":"2024-09-19T05:43:46.780622+0000","last_fullsized":"2024-09-19T05:43:46.780622+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.801337+0000","last_change":"2024-09-19T05:43:46.796419+0000","last_active":"2024-09-19T05:43:46.801337+0000","last_peered":"2024-09-19T05:43:46.801337+0000","last_clean":"2024-09-19T05:43:46.801337+0000","last_became_active":"2024-09-19T05:43:46.795811+0000","last_became_peered":"2024-09-19T05:43:46.795811+0000","last_unstale":"2024-09-19T05:43:46.801337+0000","last_undegraded":"2024-09-19T05:43:46.801337+0000","last_fullsized":"2024-09-19T05:43:46.801337+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:04.455952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783662+0000","last_change":"2024-09-19T05:43:46.783662+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783662+0000","last_undegraded":"2024-09-19T05:43:46.783662+0000","last_fullsized":"2024-09-19T05:43:46.783662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804576+0000","last_change":"2024-09-19T05:43:46.803323+0000","last_active":"2024-09-19T05:43:46.804576+0000","last_peered":"2024-09-19T05:43:46.804576+0000","last_clean":"2024-09-19T05:43:46.804576+0000","last_became_active":"2024-09-19T05:43:46.803032+0000","last_became_peered":"2024-09-19T05:43:46.803032+0000","last_unstale":"2024-09-19T05:43:46.804576+0000","last_undegraded":"2024-09-19T05:43:46.804576+0000","last_fullsized":"2024-09-19T05:43:46.804576+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:29.172683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785731+0000","last_change":"2024-09-19T05:43:46.785731+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785731+0000","last_undegraded":"2024-09-19T05:43:46.785731+0000","last_fullsized":"2024-09-19T05:43:46.785731+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.800482+0000","last_change":"2024-09-19T05:43:46.799385+0000","last_active":"2024-09-19T05:43:46.800482+0000","last_peered":"2024-09-19T05:43:46.800482+0000","last_clean":"2024-09-19T05:43:46.800482+0000","last_became_active":"2024-09-19T05:43:46.797943+0000","last_became_peered":"2024-09-19T05:43:46.797943+0000","last_unstale":"2024-09-19T05:43:46.800482+0000","last_undegraded":"2024-09-19T05:43:46.800482+0000","last_fullsized":"2024-09-19T05:43:46.800482+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:18.054179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775892+0000","last_change":"2024-09-19T05:43:46.775892+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775892+0000","last_undegraded":"2024-09-19T05:43:46.775892+0000","last_fullsized":"2024-09-19T05:43:46.775892+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805595+0000","last_change":"2024-09-19T05:43:46.804287+0000","last_active":"2024-09-19T05:43:46.805595+0000","last_peered":"2024-09-19T05:43:46.805595+0000","last_clean":"2024-09-19T05:43:46.805595+0000","last_became_active":"2024-09-19T05:43:46.803954+0000","last_became_peered":"2024-09-19T05:43:46.803954+0000","last_unstale":"2024-09-19T05:43:46.805595+0000","last_undegraded":"2024-09-19T05:43:46.805595+0000","last_fullsized":"2024-09-19T05:43:46.805595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:07.725004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788130+0000","last_change":"2024-09-19T05:43:46.788130+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788130+0000","last_undegraded":"2024-09-19T05:43:46.788130+0000","last_fullsized":"2024-09-19T05:43:46.788130+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798172+0000","last_change":"2024-09-19T05:43:46.797549+0000","last_active":"2024-09-19T05:43:46.798172+0000","last_peered":"2024-09-19T05:43:46.798172+0000","last_clean":"2024-09-19T05:43:46.798172+0000","last_became_active":"2024-09-19T05:43:46.797153+0000","last_became_peered":"2024-09-19T05:43:46.797153+0000","last_unstale":"2024-09-19T05:43:46.798172+0000","last_undegraded":"2024-09-19T05:43:46.798172+0000","last_fullsized":"2024-09-19T05:43:46.798172+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:15.091624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784573+0000","last_change":"2024-09-19T05:43:46.784573+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784573+0000","last_undegraded":"2024-09-19T05:43:46.784573+0000","last_fullsized":"2024-09-19T05:43:46.784573+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803653+0000","last_change":"2024-09-19T05:43:46.800003+0000","last_active":"2024-09-19T05:43:46.803653+0000","last_peered":"2024-09-19T05:43:46.803653+0000","last_clean":"2024-09-19T05:43:46.803653+0000","last_became_active":"2024-09-19T05:43:46.799092+0000","last_became_peered":"2024-09-19T05:43:46.799092+0000","last_unstale":"2024-09-19T05:43:46.803653+0000","last_undegraded":"2024-09-19T05:43:46.803653+0000","last_fullsized":"2024-09-19T05:43:46.803653+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:59.820569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775297+0000","last_change":"2024-09-19T05:43:46.775297+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775297+0000","last_undegraded":"2024-09-19T05:43:46.775297+0000","last_fullsized":"2024-09-19T05:43:46.775297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.796400+0000","last_change":"2024-09-19T05:43:46.795206+0000","last_active":"2024-09-19T05:43:46.796400+0000","last_peered":"2024-09-19T05:43:46.796400+0000","last_clean":"2024-09-19T05:43:46.796400+0000","last_became_active":"2024-09-19T05:43:46.794855+0000","last_became_peered":"2024-09-19T05:43:46.794855+0000","last_unstale":"2024-09-19T05:43:46.796400+0000","last_undegraded":"2024-09-19T05:43:46.796400+0000","last_fullsized":"2024-09-19T05:43:46.796400+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:10.402439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774036+0000","last_change":"2024-09-19T05:43:46.774036+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774036+0000","last_undegraded":"2024-09-19T05:43:46.774036+0000","last_fullsized":"2024-09-19T05:43:46.774036+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.791063+0000","last_change":"2024-09-19T05:43:46.790169+0000","last_active":"2024-09-19T05:43:46.791063+0000","last_peered":"2024-09-19T05:43:46.791063+0000","last_clean":"2024-09-19T05:43:46.791063+0000","last_became_active":"2024-09-19T05:43:46.789867+0000","last_became_peered":"2024-09-19T05:43:46.789867+0000","last_unstale":"2024-09-19T05:43:46.791063+0000","last_undegraded":"2024-09-19T05:43:46.791063+0000","last_fullsized":"2024-09-19T05:43:46.791063+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:55.643231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786570+0000","last_change":"2024-09-19T05:43:46.786570+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786570+0000","last_undegraded":"2024-09-19T05:43:46.786570+0000","last_fullsized":"2024-09-19T05:43:46.786570+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804679+0000","last_change":"2024-09-19T05:43:46.804003+0000","last_active":"2024-09-19T05:43:46.804679+0000","last_peered":"2024-09-19T05:43:46.804679+0000","last_clean":"2024-09-19T05:43:46.804679+0000","last_became_active":"2024-09-19T05:43:46.799507+0000","last_became_peered":"2024-09-19T05:43:46.799507+0000","last_unstale":"2024-09-19T05:43:46.804679+0000","last_undegraded":"2024-09-19T05:43:46.804679+0000","last_fullsized":"2024-09-19T05:43:46.804679+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:09.181248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787593+0000","last_change":"2024-09-19T05:43:46.787593+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787593+0000","last_undegraded":"2024-09-19T05:43:46.787593+0000","last_fullsized":"2024-09-19T05:43:46.787593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803417+0000","last_change":"2024-09-19T05:43:46.801154+0000","last_active":"2024-09-19T05:43:46.803417+0000","last_peered":"2024-09-19T05:43:46.803417+0000","last_clean":"2024-09-19T05:43:46.803417+0000","last_became_active":"2024-09-19T05:43:46.798367+0000","last_became_peered":"2024-09-19T05:43:46.798367+0000","last_unstale":"2024-09-19T05:43:46.803417+0000","last_undegraded":"2024-09-19T05:43:46.803417+0000","last_fullsized":"2024-09-19T05:43:46.803417+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:11.177367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781841+0000","last_change":"2024-09-19T05:43:46.781841+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781841+0000","last_undegraded":"2024-09-19T05:43:46.781841+0000","last_fullsized":"2024-09-19T05:43:46.781841+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.806011+0000","last_change":"2024-09-19T05:43:46.805429+0000","last_active":"2024-09-19T05:43:46.806011+0000","last_peered":"2024-09-19T05:43:46.806011+0000","last_clean":"2024-09-19T05:43:46.806011+0000","last_became_active":"2024-09-19T05:43:46.805016+0000","last_became_peered":"2024-09-19T05:43:46.805016+0000","last_unstale":"2024-09-19T05:43:46.806011+0000","last_undegraded":"2024-09-19T05:43:46.806011+0000","last_fullsized":"2024-09-19T05:43:46.806011+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:06.495111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788028+0000","last_change":"2024-09-19T05:43:46.788028+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788028+0000","last_undegraded":"2024-09-19T05:43:46.788028+0000","last_fullsized":"2024-09-19T05:43:46.788028+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.796767+0000","last_change":"2024-09-19T05:43:46.796046+0000","last_active":"2024-09-19T05:43:46.796767+0000","last_peered":"2024-09-19T05:43:46.796767+0000","last_clean":"2024-09-19T05:43:46.796767+0000","last_became_active":"2024-09-19T05:43:46.795486+0000","last_became_peered":"2024-09-19T05:43:46.795486+0000","last_unstale":"2024-09-19T05:43:46.796767+0000","last_undegraded":"2024-09-19T05:43:46.796767+0000","last_fullsized":"2024-09-19T05:43:46.796767+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:37.034508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782676+0000","last_change":"2024-09-19T05:43:46.782676+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782676+0000","last_undegraded":"2024-09-19T05:43:46.782676+0000","last_fullsized":"2024-09-19T05:43:46.782676+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794691+0000","last_change":"2024-09-19T05:43:46.793209+0000","last_active":"2024-09-19T05:43:46.794691+0000","last_peered":"2024-09-19T05:43:46.794691+0000","last_clean":"2024-09-19T05:43:46.794691+0000","last_became_active":"2024-09-19T05:43:46.792865+0000","last_became_peered":"2024-09-19T05:43:46.792865+0000","last_unstale":"2024-09-19T05:43:46.794691+0000","last_undegraded":"2024-09-19T05:43:46.794691+0000","last_fullsized":"2024-09-19T05:43:46.794691+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:43.808413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787618+0000","last_change":"2024-09-19T05:43:46.787618+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787618+0000","last_undegraded":"2024-09-19T05:43:46.787618+0000","last_fullsized":"2024-09-19T05:43:46.787618+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.800461+0000","last_change":"2024-09-19T05:43:46.799401+0000","last_active":"2024-09-19T05:43:46.800461+0000","last_peered":"2024-09-19T05:43:46.800461+0000","last_clean":"2024-09-19T05:43:46.800461+0000","last_became_active":"2024-09-19T05:43:46.797931+0000","last_became_peered":"2024-09-19T05:43:46.797931+0000","last_unstale":"2024-09-19T05:43:46.800461+0000","last_undegraded":"2024-09-19T05:43:46.800461+0000","last_fullsized":"2024-09-19T05:43:46.800461+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:46.679571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781068+0000","last_change":"2024-09-19T05:43:46.781068+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781068+0000","last_undegraded":"2024-09-19T05:43:46.781068+0000","last_fullsized":"2024-09-19T05:43:46.781068+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805402+0000","last_change":"2024-09-19T05:43:46.803632+0000","last_active":"2024-09-19T05:43:46.805402+0000","last_peered":"2024-09-19T05:43:46.805402+0000","last_clean":"2024-09-19T05:43:46.805402+0000","last_became_active":"2024-09-19T05:43:46.803191+0000","last_became_peered":"2024-09-19T05:43:46.803191+0000","last_unstale":"2024-09-19T05:43:46.805402+0000","last_undegraded":"2024-09-19T05:43:46.805402+0000","last_fullsized":"2024-09-19T05:43:46.805402+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:10.402439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775393+0000","last_change":"2024-09-19T05:43:46.775393+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775393+0000","last_undegraded":"2024-09-19T05:43:46.775393+0000","last_fullsized":"2024-09-19T05:43:46.775393+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802411+0000","last_change":"2024-09-19T05:43:46.797969+0000","last_active":"2024-09-19T05:43:46.802411+0000","last_peered":"2024-09-19T05:43:46.802411+0000","last_clean":"2024-09-19T05:43:46.802411+0000","last_became_active":"2024-09-19T05:43:46.797489+0000","last_became_peered":"2024-09-19T05:43:46.797489+0000","last_unstale":"2024-09-19T05:43:46.802411+0000","last_undegraded":"2024-09-19T05:43:46.802411+0000","last_fullsized":"2024-09-19T05:43:46.802411+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:31.524906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786019+0000","last_change":"2024-09-19T05:43:46.786019+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786019+0000","last_undegraded":"2024-09-19T05:43:46.786019+0000","last_fullsized":"2024-09-19T05:43:46.786019+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794623+0000","last_change":"2024-09-19T05:43:46.792214+0000","last_active":"2024-09-19T05:43:46.794623+0000","last_peered":"2024-09-19T05:43:46.794623+0000","last_clean":"2024-09-19T05:43:46.794623+0000","last_became_active":"2024-09-19T05:43:46.791792+0000","last_became_peered":"2024-09-19T05:43:46.791792+0000","last_unstale":"2024-09-19T05:43:46.794623+0000","last_undegraded":"2024-09-19T05:43:46.794623+0000","last_fullsized":"2024-09-19T05:43:46.794623+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:31.011960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782662+0000","last_change":"2024-09-19T05:43:46.782662+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782662+0000","last_undegraded":"2024-09-19T05:43:46.782662+0000","last_fullsized":"2024-09-19T05:43:46.782662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802451+0000","last_change":"2024-09-19T05:43:46.790954+0000","last_active":"2024-09-19T05:43:46.802451+0000","last_peered":"2024-09-19T05:43:46.802451+0000","last_clean":"2024-09-19T05:43:46.802451+0000","last_became_active":"2024-09-19T05:43:46.790304+0000","last_became_peered":"2024-09-19T05:43:46.790304+0000","last_unstale":"2024-09-19T05:43:46.802451+0000","last_undegraded":"2024-09-19T05:43:46.802451+0000","last_fullsized":"2024-09-19T05:43:46.802451+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:00.007614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784239+0000","last_change":"2024-09-19T05:43:46.784239+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784239+0000","last_undegraded":"2024-09-19T05:43:46.784239+0000","last_fullsized":"2024-09-19T05:43:46.784239+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803746+0000","last_change":"2024-09-19T05:43:46.802290+0000","last_active":"2024-09-19T05:43:46.803746+0000","last_peered":"2024-09-19T05:43:46.803746+0000","last_clean":"2024-09-19T05:43:46.803746+0000","last_became_active":"2024-09-19T05:43:46.802005+0000","last_became_peered":"2024-09-19T05:43:46.802005+0000","last_unstale":"2024-09-19T05:43:46.803746+0000","last_undegraded":"2024-09-19T05:43:46.803746+0000","last_fullsized":"2024-09-19T05:43:46.803746+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:50.223356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784548+0000","last_change":"2024-09-19T05:43:46.784548+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784548+0000","last_undegraded":"2024-09-19T05:43:46.784548+0000","last_fullsized":"2024-09-19T05:43:46.784548+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.792514+0000","last_change":"2024-09-19T05:43:46.791368+0000","last_active":"2024-09-19T05:43:46.792514+0000","last_peered":"2024-09-19T05:43:46.792514+0000","last_clean":"2024-09-19T05:43:46.792514+0000","last_became_active":"2024-09-19T05:43:46.791101+0000","last_became_peered":"2024-09-19T05:43:46.791101+0000","last_unstale":"2024-09-19T05:43:46.792514+0000","last_undegraded":"2024-09-19T05:43:46.792514+0000","last_fullsized":"2024-09-19T05:43:46.792514+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:53.666132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774036+0000","last_change":"2024-09-19T05:43:46.774036+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774036+0000","last_undegraded":"2024-09-19T05:43:46.774036+0000","last_fullsized":"2024-09-19T05:43:46.774036+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804572+0000","last_change":"2024-09-19T05:43:46.803154+0000","last_active":"2024-09-19T05:43:46.804572+0000","last_peered":"2024-09-19T05:43:46.804572+0000","last_clean":"2024-09-19T05:43:46.804572+0000","last_became_active":"2024-09-19T05:43:46.802771+0000","last_became_peered":"2024-09-19T05:43:46.802771+0000","last_unstale":"2024-09-19T05:43:46.804572+0000","last_undegraded":"2024-09-19T05:43:46.804572+0000","last_fullsized":"2024-09-19T05:43:46.804572+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:06.895736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784563+0000","last_change":"2024-09-19T05:43:46.784563+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784563+0000","last_undegraded":"2024-09-19T05:43:46.784563+0000","last_fullsized":"2024-09-19T05:43:46.784563+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798838+0000","last_change":"2024-09-19T05:43:46.798297+0000","last_active":"2024-09-19T05:43:46.798838+0000","last_peered":"2024-09-19T05:43:46.798838+0000","last_clean":"2024-09-19T05:43:46.798838+0000","last_became_active":"2024-09-19T05:43:46.797990+0000","last_became_peered":"2024-09-19T05:43:46.797990+0000","last_unstale":"2024-09-19T05:43:46.798838+0000","last_undegraded":"2024-09-19T05:43:46.798838+0000","last_fullsized":"2024-09-19T05:43:46.798838+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:03.752818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":388,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.787456+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:43:46.787456+0000","last_peered":"2024-09-19T05:43:46.787456+0000","last_clean":"2024-09-19T05:43:46.787456+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:43:46.787456+0000","last_undegraded":"2024-09-19T05:43:46.787456+0000","last_fullsized":"2024-09-19T05:43:46.787456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542275,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65424,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306416,"statfs":{"total":96636764160,"available":96569769984,"internally_reserved":0,"allocated":2351104,"data_stored":1417640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542275,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64844,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306996,"statfs":{"total":96636764160,"available":96570363904,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542277,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59260,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312580,"statfs":{"total":96636764160,"available":96576081920,"internally_reserved":0,"allocated":1744896,"data_stored":820613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542275,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69000,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302840,"statfs":{"total":96636764160,"available":96566108160,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63436,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308404,"statfs":{"total":96636764160,"available":96571805696,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69004,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302836,"statfs":{"total":96636764160,"available":96566104064,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542278,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55116,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316724,"statfs":{"total":96636764160,"available":96580325376,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542275,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73740,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298100,"statfs":{"total":96636764160,"available":96561254400,"internally_reserved":0,"allocated":2351104,"data_stored":1417640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:43:51.664 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3f is not active+clean 2024-09-19T05:43:51.664 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.786885+0000', 'last_change': '2024-09-19T05:43:46.786885+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.786885+0000', 'last_undegraded': '2024-09-19T05:43:46.786885+0000', 'last_fullsized': '2024-09-19T05:43:46.786885+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:43:51.664 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3e is not active+clean 2024-09-19T05:43:51.664 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.779840+0000', 'last_change': '2024-09-19T05:43:46.779840+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.779840+0000', 'last_undegraded': '2024-09-19T05:43:46.779840+0000', 'last_fullsized': '2024-09-19T05:43:46.779840+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:43:51.664 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3d is not active+clean 2024-09-19T05:43:51.664 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.791744+0000', 'last_change': '2024-09-19T05:43:46.791744+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.791744+0000', 'last_undegraded': '2024-09-19T05:43:46.791744+0000', 'last_fullsized': '2024-09-19T05:43:46.791744+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3c is not active+clean 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.779987+0000', 'last_change': '2024-09-19T05:43:46.779987+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.779987+0000', 'last_undegraded': '2024-09-19T05:43:46.779987+0000', 'last_fullsized': '2024-09-19T05:43:46.779987+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3b is not active+clean 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.788817+0000', 'last_change': '2024-09-19T05:43:46.788817+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.788817+0000', 'last_undegraded': '2024-09-19T05:43:46.788817+0000', 'last_fullsized': '2024-09-19T05:43:46.788817+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3a is not active+clean 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.782782+0000', 'last_change': '2024-09-19T05:43:46.782782+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.782782+0000', 'last_undegraded': '2024-09-19T05:43:46.782782+0000', 'last_fullsized': '2024-09-19T05:43:46.782782+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:PG 20.39 is not active+clean 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.776382+0000', 'last_change': '2024-09-19T05:43:46.776382+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.776382+0000', 'last_undegraded': '2024-09-19T05:43:46.776382+0000', 'last_fullsized': '2024-09-19T05:43:46.776382+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:PG 20.38 is not active+clean 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.783917+0000', 'last_change': '2024-09-19T05:43:46.783917+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.783917+0000', 'last_undegraded': '2024-09-19T05:43:46.783917+0000', 'last_fullsized': '2024-09-19T05:43:46.783917+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:PG 20.37 is not active+clean 2024-09-19T05:43:51.665 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.783796+0000', 'last_change': '2024-09-19T05:43:46.783796+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.783796+0000', 'last_undegraded': '2024-09-19T05:43:46.783796+0000', 'last_fullsized': '2024-09-19T05:43:46.783796+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:PG 20.36 is not active+clean 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.785868+0000', 'last_change': '2024-09-19T05:43:46.785868+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.785868+0000', 'last_undegraded': '2024-09-19T05:43:46.785868+0000', 'last_fullsized': '2024-09-19T05:43:46.785868+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:PG 20.35 is not active+clean 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.781021+0000', 'last_change': '2024-09-19T05:43:46.781021+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.781021+0000', 'last_undegraded': '2024-09-19T05:43:46.781021+0000', 'last_fullsized': '2024-09-19T05:43:46.781021+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:PG 20.34 is not active+clean 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.785523+0000', 'last_change': '2024-09-19T05:43:46.785523+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.785523+0000', 'last_undegraded': '2024-09-19T05:43:46.785523+0000', 'last_fullsized': '2024-09-19T05:43:46.785523+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:PG 20.33 is not active+clean 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.783473+0000', 'last_change': '2024-09-19T05:43:46.783473+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.783473+0000', 'last_undegraded': '2024-09-19T05:43:46.783473+0000', 'last_fullsized': '2024-09-19T05:43:46.783473+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:PG 20.32 is not active+clean 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.780991+0000', 'last_change': '2024-09-19T05:43:46.780991+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.780991+0000', 'last_undegraded': '2024-09-19T05:43:46.780991+0000', 'last_fullsized': '2024-09-19T05:43:46.780991+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:PG 20.31 is not active+clean 2024-09-19T05:43:51.666 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.783358+0000', 'last_change': '2024-09-19T05:43:46.783358+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.783358+0000', 'last_undegraded': '2024-09-19T05:43:46.783358+0000', 'last_fullsized': '2024-09-19T05:43:46.783358+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:PG 20.30 is not active+clean 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.783440+0000', 'last_change': '2024-09-19T05:43:46.783440+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.783440+0000', 'last_undegraded': '2024-09-19T05:43:46.783440+0000', 'last_fullsized': '2024-09-19T05:43:46.783440+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2f is not active+clean 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.782821+0000', 'last_change': '2024-09-19T05:43:46.782821+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.782821+0000', 'last_undegraded': '2024-09-19T05:43:46.782821+0000', 'last_fullsized': '2024-09-19T05:43:46.782821+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2e is not active+clean 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.799215+0000', 'last_change': '2024-09-19T05:43:46.799215+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.799215+0000', 'last_undegraded': '2024-09-19T05:43:46.799215+0000', 'last_fullsized': '2024-09-19T05:43:46.799215+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2d is not active+clean 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.778003+0000', 'last_change': '2024-09-19T05:43:46.778003+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.778003+0000', 'last_undegraded': '2024-09-19T05:43:46.778003+0000', 'last_fullsized': '2024-09-19T05:43:46.778003+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2c is not active+clean 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.788783+0000', 'last_change': '2024-09-19T05:43:46.788783+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.788783+0000', 'last_undegraded': '2024-09-19T05:43:46.788783+0000', 'last_fullsized': '2024-09-19T05:43:46.788783+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2b is not active+clean 2024-09-19T05:43:51.667 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.780660+0000', 'last_change': '2024-09-19T05:43:46.780660+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.780660+0000', 'last_undegraded': '2024-09-19T05:43:46.780660+0000', 'last_fullsized': '2024-09-19T05:43:46.780660+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:43:51.668 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2a is not active+clean 2024-09-19T05:43:51.668 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.781566+0000', 'last_change': '2024-09-19T05:43:46.781566+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.781566+0000', 'last_undegraded': '2024-09-19T05:43:46.781566+0000', 'last_fullsized': '2024-09-19T05:43:46.781566+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:43:51.668 INFO:tasks.ceph.ceph_manager.ceph:PG 20.29 is not active+clean 2024-09-19T05:43:51.668 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.779677+0000', 'last_change': '2024-09-19T05:43:46.779677+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.779677+0000', 'last_undegraded': '2024-09-19T05:43:46.779677+0000', 'last_fullsized': '2024-09-19T05:43:46.779677+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:43:51.668 INFO:tasks.ceph.ceph_manager.ceph:PG 20.28 is not active+clean 2024-09-19T05:43:51.668 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.782927+0000', 'last_change': '2024-09-19T05:43:46.782927+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.782927+0000', 'last_undegraded': '2024-09-19T05:43:46.782927+0000', 'last_fullsized': '2024-09-19T05:43:46.782927+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:43:51.668 INFO:tasks.ceph.ceph_manager.ceph:PG 20.27 is not active+clean 2024-09-19T05:43:51.668 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.784525+0000', 'last_change': '2024-09-19T05:43:46.784525+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.784525+0000', 'last_undegraded': '2024-09-19T05:43:46.784525+0000', 'last_fullsized': '2024-09-19T05:43:46.784525+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:43:51.668 INFO:tasks.ceph.ceph_manager.ceph:PG 20.26 is not active+clean 2024-09-19T05:43:51.668 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.781058+0000', 'last_change': '2024-09-19T05:43:46.781058+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.781058+0000', 'last_undegraded': '2024-09-19T05:43:46.781058+0000', 'last_fullsized': '2024-09-19T05:43:46.781058+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:PG 20.25 is not active+clean 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.774177+0000', 'last_change': '2024-09-19T05:43:46.774177+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.774177+0000', 'last_undegraded': '2024-09-19T05:43:46.774177+0000', 'last_fullsized': '2024-09-19T05:43:46.774177+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:PG 20.24 is not active+clean 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.787345+0000', 'last_change': '2024-09-19T05:43:46.787345+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.787345+0000', 'last_undegraded': '2024-09-19T05:43:46.787345+0000', 'last_fullsized': '2024-09-19T05:43:46.787345+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:PG 20.23 is not active+clean 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.785168+0000', 'last_change': '2024-09-19T05:43:46.785168+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.785168+0000', 'last_undegraded': '2024-09-19T05:43:46.785168+0000', 'last_fullsized': '2024-09-19T05:43:46.785168+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:PG 20.22 is not active+clean 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.784727+0000', 'last_change': '2024-09-19T05:43:46.784727+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.784727+0000', 'last_undegraded': '2024-09-19T05:43:46.784727+0000', 'last_fullsized': '2024-09-19T05:43:46.784727+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:PG 20.21 is not active+clean 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.783235+0000', 'last_change': '2024-09-19T05:43:46.783235+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.783235+0000', 'last_undegraded': '2024-09-19T05:43:46.783235+0000', 'last_fullsized': '2024-09-19T05:43:46.783235+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:PG 20.20 is not active+clean 2024-09-19T05:43:51.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.788400+0000', 'last_change': '2024-09-19T05:43:46.788400+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.788400+0000', 'last_undegraded': '2024-09-19T05:43:46.788400+0000', 'last_fullsized': '2024-09-19T05:43:46.788400+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:PG 20.18 is not active+clean 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.782905+0000', 'last_change': '2024-09-19T05:43:46.782905+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.782905+0000', 'last_undegraded': '2024-09-19T05:43:46.782905+0000', 'last_fullsized': '2024-09-19T05:43:46.782905+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:PG 20.19 is not active+clean 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.782774+0000', 'last_change': '2024-09-19T05:43:46.782774+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.782774+0000', 'last_undegraded': '2024-09-19T05:43:46.782774+0000', 'last_fullsized': '2024-09-19T05:43:46.782774+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1a is not active+clean 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.781636+0000', 'last_change': '2024-09-19T05:43:46.781636+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.781636+0000', 'last_undegraded': '2024-09-19T05:43:46.781636+0000', 'last_fullsized': '2024-09-19T05:43:46.781636+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1b is not active+clean 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.780729+0000', 'last_change': '2024-09-19T05:43:46.780729+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.780729+0000', 'last_undegraded': '2024-09-19T05:43:46.780729+0000', 'last_fullsized': '2024-09-19T05:43:46.780729+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1c is not active+clean 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.784304+0000', 'last_change': '2024-09-19T05:43:46.784304+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.784304+0000', 'last_undegraded': '2024-09-19T05:43:46.784304+0000', 'last_fullsized': '2024-09-19T05:43:46.784304+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:43:51.670 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1d is not active+clean 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.783593+0000', 'last_change': '2024-09-19T05:43:46.783593+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.783593+0000', 'last_undegraded': '2024-09-19T05:43:46.783593+0000', 'last_fullsized': '2024-09-19T05:43:46.783593+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1e is not active+clean 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.788872+0000', 'last_change': '2024-09-19T05:43:46.788872+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.788872+0000', 'last_undegraded': '2024-09-19T05:43:46.788872+0000', 'last_fullsized': '2024-09-19T05:43:46.788872+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1f is not active+clean 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.776994+0000', 'last_change': '2024-09-19T05:43:46.776994+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.776994+0000', 'last_undegraded': '2024-09-19T05:43:46.776994+0000', 'last_fullsized': '2024-09-19T05:43:46.776994+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:PG 20.10 is not active+clean 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.781299+0000', 'last_change': '2024-09-19T05:43:46.781299+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.781299+0000', 'last_undegraded': '2024-09-19T05:43:46.781299+0000', 'last_fullsized': '2024-09-19T05:43:46.781299+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:PG 20.11 is not active+clean 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.782871+0000', 'last_change': '2024-09-19T05:43:46.782871+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.782871+0000', 'last_undegraded': '2024-09-19T05:43:46.782871+0000', 'last_fullsized': '2024-09-19T05:43:46.782871+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:PG 20.12 is not active+clean 2024-09-19T05:43:51.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.780622+0000', 'last_change': '2024-09-19T05:43:46.780622+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.780622+0000', 'last_undegraded': '2024-09-19T05:43:46.780622+0000', 'last_fullsized': '2024-09-19T05:43:46.780622+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:43:51.672 INFO:tasks.ceph.ceph_manager.ceph:PG 20.13 is not active+clean 2024-09-19T05:43:51.672 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.783662+0000', 'last_change': '2024-09-19T05:43:46.783662+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.783662+0000', 'last_undegraded': '2024-09-19T05:43:46.783662+0000', 'last_fullsized': '2024-09-19T05:43:46.783662+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:43:51.672 INFO:tasks.ceph.ceph_manager.ceph:PG 20.14 is not active+clean 2024-09-19T05:43:51.672 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.785731+0000', 'last_change': '2024-09-19T05:43:46.785731+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.785731+0000', 'last_undegraded': '2024-09-19T05:43:46.785731+0000', 'last_fullsized': '2024-09-19T05:43:46.785731+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:43:51.672 INFO:tasks.ceph.ceph_manager.ceph:PG 20.16 is not active+clean 2024-09-19T05:43:51.672 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.775892+0000', 'last_change': '2024-09-19T05:43:46.775892+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.775892+0000', 'last_undegraded': '2024-09-19T05:43:46.775892+0000', 'last_fullsized': '2024-09-19T05:43:46.775892+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:43:51.672 INFO:tasks.ceph.ceph_manager.ceph:PG 20.17 is not active+clean 2024-09-19T05:43:51.672 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.788130+0000', 'last_change': '2024-09-19T05:43:46.788130+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.788130+0000', 'last_undegraded': '2024-09-19T05:43:46.788130+0000', 'last_fullsized': '2024-09-19T05:43:46.788130+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:43:51.672 INFO:tasks.ceph.ceph_manager.ceph:PG 20.8 is not active+clean 2024-09-19T05:43:51.672 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.784573+0000', 'last_change': '2024-09-19T05:43:46.784573+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.784573+0000', 'last_undegraded': '2024-09-19T05:43:46.784573+0000', 'last_fullsized': '2024-09-19T05:43:46.784573+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:43:51.673 INFO:tasks.ceph.ceph_manager.ceph:PG 20.9 is not active+clean 2024-09-19T05:43:51.673 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.775297+0000', 'last_change': '2024-09-19T05:43:46.775297+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.775297+0000', 'last_undegraded': '2024-09-19T05:43:46.775297+0000', 'last_fullsized': '2024-09-19T05:43:46.775297+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:43:51.673 INFO:tasks.ceph.ceph_manager.ceph:PG 20.a is not active+clean 2024-09-19T05:43:51.673 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.774036+0000', 'last_change': '2024-09-19T05:43:46.774036+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.774036+0000', 'last_undegraded': '2024-09-19T05:43:46.774036+0000', 'last_fullsized': '2024-09-19T05:43:46.774036+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:43:51.673 INFO:tasks.ceph.ceph_manager.ceph:PG 20.b is not active+clean 2024-09-19T05:43:51.673 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.786570+0000', 'last_change': '2024-09-19T05:43:46.786570+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.786570+0000', 'last_undegraded': '2024-09-19T05:43:46.786570+0000', 'last_fullsized': '2024-09-19T05:43:46.786570+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:43:51.673 INFO:tasks.ceph.ceph_manager.ceph:PG 20.c is not active+clean 2024-09-19T05:43:51.673 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.787593+0000', 'last_change': '2024-09-19T05:43:46.787593+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.787593+0000', 'last_undegraded': '2024-09-19T05:43:46.787593+0000', 'last_fullsized': '2024-09-19T05:43:46.787593+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:43:51.673 INFO:tasks.ceph.ceph_manager.ceph:PG 20.d is not active+clean 2024-09-19T05:43:51.673 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.781841+0000', 'last_change': '2024-09-19T05:43:46.781841+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.781841+0000', 'last_undegraded': '2024-09-19T05:43:46.781841+0000', 'last_fullsized': '2024-09-19T05:43:46.781841+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:PG 20.e is not active+clean 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.788028+0000', 'last_change': '2024-09-19T05:43:46.788028+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.788028+0000', 'last_undegraded': '2024-09-19T05:43:46.788028+0000', 'last_fullsized': '2024-09-19T05:43:46.788028+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:PG 20.f is not active+clean 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.782676+0000', 'last_change': '2024-09-19T05:43:46.782676+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.782676+0000', 'last_undegraded': '2024-09-19T05:43:46.782676+0000', 'last_fullsized': '2024-09-19T05:43:46.782676+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:PG 20.0 is not active+clean 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.787618+0000', 'last_change': '2024-09-19T05:43:46.787618+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.787618+0000', 'last_undegraded': '2024-09-19T05:43:46.787618+0000', 'last_fullsized': '2024-09-19T05:43:46.787618+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1 is not active+clean 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.781068+0000', 'last_change': '2024-09-19T05:43:46.781068+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.781068+0000', 'last_undegraded': '2024-09-19T05:43:46.781068+0000', 'last_fullsized': '2024-09-19T05:43:46.781068+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2 is not active+clean 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.775393+0000', 'last_change': '2024-09-19T05:43:46.775393+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.775393+0000', 'last_undegraded': '2024-09-19T05:43:46.775393+0000', 'last_fullsized': '2024-09-19T05:43:46.775393+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:43:51.674 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3 is not active+clean 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.786019+0000', 'last_change': '2024-09-19T05:43:46.786019+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.786019+0000', 'last_undegraded': '2024-09-19T05:43:46.786019+0000', 'last_fullsized': '2024-09-19T05:43:46.786019+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:PG 20.4 is not active+clean 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.782662+0000', 'last_change': '2024-09-19T05:43:46.782662+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.782662+0000', 'last_undegraded': '2024-09-19T05:43:46.782662+0000', 'last_fullsized': '2024-09-19T05:43:46.782662+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:PG 20.5 is not active+clean 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.784239+0000', 'last_change': '2024-09-19T05:43:46.784239+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.784239+0000', 'last_undegraded': '2024-09-19T05:43:46.784239+0000', 'last_fullsized': '2024-09-19T05:43:46.784239+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:PG 20.6 is not active+clean 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.784548+0000', 'last_change': '2024-09-19T05:43:46.784548+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.784548+0000', 'last_undegraded': '2024-09-19T05:43:46.784548+0000', 'last_fullsized': '2024-09-19T05:43:46.784548+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:PG 20.7 is not active+clean 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.774036+0000', 'last_change': '2024-09-19T05:43:46.774036+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.774036+0000', 'last_undegraded': '2024-09-19T05:43:46.774036+0000', 'last_fullsized': '2024-09-19T05:43:46.774036+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:PG 20.15 is not active+clean 2024-09-19T05:43:51.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:43:46.784563+0000', 'last_change': '2024-09-19T05:43:46.784563+0000', 'last_active': '2024-09-19T05:43:46.766523+0000', 'last_peered': '2024-09-19T05:43:46.766523+0000', 'last_clean': '2024-09-19T05:43:46.766523+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:43:46.784563+0000', 'last_undegraded': '2024-09-19T05:43:46.784563+0000', 'last_fullsized': '2024-09-19T05:43:46.784563+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'last_clean_scrub_stamp': '2024-09-19T05:43:46.766523+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:43:51.676 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:43:51.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.817+0000 7f79f8343640 1 Processor -- start 2024-09-19T05:43:51.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.817+0000 7f79f8343640 1 -- start start 2024-09-19T05:43:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f8343640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f79f00d1590 0x7f79f00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f8343640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f00d4d40 con 0x7f79f00b51d0 2024-09-19T05:43:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f8343640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f00d5020 con 0x7f79f0161da0 2024-09-19T05:43:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f8343640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f79f00d0840 con 0x7f79f00d1590 2024-09-19T05:43:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f68e0640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f79f00b51d0 0x7f79f00cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56676/0 (socket says 172.21.15.67:56676) 2024-09-19T05:43:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f68e0640 1 -- 172.21.15.67:0/2837164291 learned_addr learned my addr 172.21.15.67:0/2837164291 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f58de640 1 --2- 172.21.15.67:0/2837164291 >> v2:172.21.15.97:3300/0 conn(0x7f79f00d1590 0x7f79f00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2417348461 0 0) 0x7f79f00d4d40 con 0x7f79f00b51d0 2024-09-19T05:43:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79dc003530 con 0x7f79f00b51d0 2024-09-19T05:43:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 824410682 0 0) 0x7f79dc003530 con 0x7f79f00b51d0 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 >> v2:172.21.15.97:3300/0 conn(0x7f79f00d1590 msgr2=0x7f79f00d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 --2- 172.21.15.67:0/2837164291 >> v2:172.21.15.97:3300/0 conn(0x7f79f00d1590 0x7f79f00d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 >> v1:172.21.15.97:6789/0 conn(0x7f79f0161da0 legacy=0x7f79f00d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f00d5300 con 0x7f79f00b51d0 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f79ec001680 con 0x7f79f00b51d0 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 >> v1:172.21.15.67:6789/0 conn(0x7f79f00b51d0 legacy=0x7f79f00cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 --2- 172.21.15.67:0/2837164291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79dc0039c0 0x7f79dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 --2- 172.21.15.67:0/2837164291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79dc004810 0x7f79dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 --2- 172.21.15.67:0/2837164291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79dc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f79f00d0840 con 0x7f79dc0051d0 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc00c070 con 0x7f79dc004810 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f79dc00c270 con 0x7f79dc0039c0 2024-09-19T05:43:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f68e0640 1 --2- 172.21.15.67:0/2837164291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79dc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f60df640 1 --2- 172.21.15.67:0/2837164291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79dc0039c0 0x7f79dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f68e0640 1 -- 172.21.15.67:0/2837164291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79dc0039c0 msgr2=0x7f79dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f68e0640 1 --2- 172.21.15.67:0/2837164291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79dc0039c0 0x7f79dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f68e0640 1 -- 172.21.15.67:0/2837164291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79dc004810 msgr2=0x7f79dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f68e0640 1 --2- 172.21.15.67:0/2837164291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79dc004810 0x7f79dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f68e0640 1 -- 172.21.15.67:0/2837164291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79dc003530 con 0x7f79dc0051d0 2024-09-19T05:43:51.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f68e0640 1 -- 172.21.15.67:0/2837164291 reap_dead start 2024-09-19T05:43:51.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f68e0640 1 --2- 172.21.15.67:0/2837164291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79dc00b9d0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00c1c0 tx=0x7f79ec01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d6fbd249023bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:51.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec007d00 con 0x7f79dc0051d0 2024-09-19T05:43:51.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79ec0a9070 con 0x7f79dc0051d0 2024-09-19T05:43:51.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.821+0000 7f79f50dd640 1 -- 172.21.15.67:0/2837164291 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0a5dc0 con 0x7f79dc0051d0 2024-09-19T05:43:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- 172.21.15.67:0/2837164291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 msgr2=0x7f79dc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 --2- 172.21.15.67:0/2837164291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79dc00b9d0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00c1c0 tx=0x7f79ec01cc60 comp rx=0 tx=0).stop 2024-09-19T05:43:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- 172.21.15.67:0/2837164291 shutdown_connections 2024-09-19T05:43:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 --2- 172.21.15.67:0/2837164291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79dc00b9d0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- 172.21.15.67:0/2837164291 >> 172.21.15.67:0/2837164291 conn(0x7f79f008bfc0 msgr2=0x7f79f00d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- 172.21.15.67:0/2837164291 shutdown_connections 2024-09-19T05:43:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- 172.21.15.67:0/2837164291 wait complete. 2024-09-19T05:43:51.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 Processor -- start 2024-09-19T05:43:51.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- start start 2024-09-19T05:43:51.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79f01592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f00b9940 0x7f79f00b9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79f00b2090 0x7f79f00b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f79f0162180 con 0x7f79dc0051d0 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f79f00b5d00 con 0x7f79f00b9940 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f79f00d1af0 con 0x7f79f00b2090 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f60df640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79f01592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f60df640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79f01592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55628/0 (socket says 172.21.15.67:55628) 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f60df640 1 -- 172.21.15.67:0/1905286536 learned_addr learned my addr 172.21.15.67:0/1905286536 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f68e0640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79f00b2090 0x7f79f00b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f58de640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f00b9940 0x7f79f00b9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f60df640 1 -- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79f00b2090 msgr2=0x7f79f00b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f60df640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79f00b2090 0x7f79f00b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f60df640 1 -- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f00b9940 msgr2=0x7f79f00b9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f60df640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f00b9940 0x7f79f00b9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f60df640 1 -- 172.21.15.67:0/1905286536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f015a3d0 con 0x7f79dc0051d0 2024-09-19T05:43:51.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f60df640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79f01592f0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f79e800e950 tx=0x7f79e800ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79e2ffd640 1 -- 172.21.15.67:0/1905286536 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8003b90 con 0x7f79dc0051d0 2024-09-19T05:43:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79e2ffd640 1 -- 172.21.15.67:0/1905286536 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e8018070 con 0x7f79dc0051d0 2024-09-19T05:43:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- 172.21.15.67:0/1905286536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f00b7e70 con 0x7f79dc0051d0 2024-09-19T05:43:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79e2ffd640 1 -- 172.21.15.67:0/1905286536 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80050d0 con 0x7f79dc0051d0 2024-09-19T05:43:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.825+0000 7f79f8343640 1 -- 172.21.15.67:0/1905286536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f015a670 con 0x7f79dc0051d0 2024-09-19T05:43:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.829+0000 7f79f8343640 1 -- 172.21.15.67:0/1905286536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f00d0e80 con 0x7f79dc0051d0 2024-09-19T05:43:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.829+0000 7f79e2ffd640 1 -- 172.21.15.67:0/1905286536 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f79e8005270 con 0x7f79dc0051d0 2024-09-19T05:43:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.829+0000 7f79e2ffd640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79d40678c0 0x7f79d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.829+0000 7f79e2ffd640 1 -- 172.21.15.67:0/1905286536 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f79e8085da0 con 0x7f79dc0051d0 2024-09-19T05:43:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.829+0000 7f79f58de640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79d40678c0 0x7f79d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.829+0000 7f79f58de640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79d40678c0 0x7f79d4069d80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f79e40047c0 tx=0x7f79e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:51.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:51.833+0000 7f79e2ffd640 1 -- 172.21.15.67:0/1905286536 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f79e80567e0 con 0x7f79dc0051d0 2024-09-19T05:43:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.049+0000 7f79f8343640 1 -- 172.21.15.67:0/1905286536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f79f00cf770 con 0x7f79dc0051d0 2024-09-19T05:43:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.049+0000 7f79e2ffd640 1 -- 172.21.15.67:0/1905286536 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1078 (secure 0 0 0) 0x7f79e80560e0 con 0x7f79dc0051d0 2024-09-19T05:43:52.049 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:52.049 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":661,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":532299776,"bytes_avail":772561813504,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8514}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-19T05:42:47.308492+0000","services":{}},"progress_events":{}} 2024-09-19T05:43:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 -- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79d40678c0 msgr2=0x7f79d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79d40678c0 0x7f79d4069d80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f79e40047c0 tx=0x7f79e4008040 comp rx=0 tx=0).stop 2024-09-19T05:43:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 -- 172.21.15.67:0/1905286536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 msgr2=0x7f79f01592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79f01592f0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f79e800e950 tx=0x7f79e800ee10 comp rx=0 tx=0).stop 2024-09-19T05:43:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 -- 172.21.15.67:0/1905286536 shutdown_connections 2024-09-19T05:43:52.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f79d40678c0 0x7f79d4069d80 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79f00b2090 0x7f79f00b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79f00b9940 0x7f79f00b9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 --2- 172.21.15.67:0/1905286536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79dc0051d0 0x7f79f01592f0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 -- 172.21.15.67:0/1905286536 >> 172.21.15.67:0/1905286536 conn(0x7f79f008bfc0 msgr2=0x7f79f00cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:52.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 -- 172.21.15.67:0/1905286536 shutdown_connections 2024-09-19T05:43:52.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.053+0000 7f79f8343640 1 -- 172.21.15.67:0/1905286536 wait complete. 2024-09-19T05:43:52.066 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T05:43:52.067 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:43:52.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.181+0000 7f4aca14b640 1 Processor -- start 2024-09-19T05:43:52.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.181+0000 7f4aca14b640 1 -- start start 2024-09-19T05:43:52.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4ac415c030 0x7f4ac406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:52.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4ac415d1d0 0x7f4ac40b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:52.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac406e3c0 con 0x7f4ac40b3510 2024-09-19T05:43:52.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac406e6a0 con 0x7f4ac415d1d0 2024-09-19T05:43:52.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac406e980 con 0x7f4ac415c030 2024-09-19T05:43:52.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac2ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4ac415d1d0 0x7f4ac40b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:52.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac3fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4ac40b3510 0x7f4ac406f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56680/0 (socket says 172.21.15.67:56680) 2024-09-19T05:43:52.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac3fff640 1 -- 172.21.15.67:0/4119973218 learned_addr learned my addr 172.21.15.67:0/4119973218 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:52.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac37fe640 1 --2- 172.21.15.67:0/4119973218 >> v2:172.21.15.97:3300/0 conn(0x7f4ac415c030 0x7f4ac406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:52.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac2ffd640 1 -- 172.21.15.67:0/4119973218 >> v2:172.21.15.97:3300/0 conn(0x7f4ac415c030 msgr2=0x7f4ac406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:52.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac2ffd640 1 --2- 172.21.15.67:0/4119973218 >> v2:172.21.15.97:3300/0 conn(0x7f4ac415c030 0x7f4ac406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac2ffd640 1 -- 172.21.15.67:0/4119973218 >> v1:172.21.15.67:6789/0 conn(0x7f4ac40b3510 legacy=0x7f4ac406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:52.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac2ffd640 1 -- 172.21.15.67:0/4119973218 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac406ec60 con 0x7f4ac415d1d0 2024-09-19T05:43:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac2ffd640 1 --2- 172.21.15.67:0/4119973218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac415d1d0 0x7f4ac40b2fd0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4070390 tx=0x7f4ab801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3281bedffe2e83db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac27fc640 1 -- 172.21.15.67:0/4119973218 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80ab5f0 con 0x7f4ac415d1d0 2024-09-19T05:43:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac27fc640 1 -- 172.21.15.67:0/4119973218 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab80b0070 con 0x7f4ac415d1d0 2024-09-19T05:43:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4ac27fc640 1 -- 172.21.15.67:0/4119973218 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80ab9b0 con 0x7f4ac415d1d0 2024-09-19T05:43:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 -- 172.21.15.67:0/4119973218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac415d1d0 msgr2=0x7f4ac40b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 --2- 172.21.15.67:0/4119973218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac415d1d0 0x7f4ac40b2fd0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4070390 tx=0x7f4ab801c450 comp rx=0 tx=0).stop 2024-09-19T05:43:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 -- 172.21.15.67:0/4119973218 shutdown_connections 2024-09-19T05:43:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 --2- 172.21.15.67:0/4119973218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac415d1d0 0x7f4ac40b2fd0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 --2- 172.21.15.67:0/4119973218 >> v2:172.21.15.97:3300/0 conn(0x7f4ac415c030 0x7f4ac406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 -- 172.21.15.67:0/4119973218 >> 172.21.15.67:0/4119973218 conn(0x7f4ac40d0080 msgr2=0x7f4ac40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:52.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 -- 172.21.15.67:0/4119973218 shutdown_connections 2024-09-19T05:43:52.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.185+0000 7f4aca14b640 1 -- 172.21.15.67:0/4119973218 wait complete. 2024-09-19T05:43:52.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 Processor -- start 2024-09-19T05:43:52.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 -- start start 2024-09-19T05:43:52.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac40b3510 0x7f4ac41f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:52.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac415c030 0x7f4ac414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:52.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4ac415d1d0 0x7f4ac4150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:52.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac415c590 con 0x7f4ac40b3510 2024-09-19T05:43:52.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac415c410 con 0x7f4ac415c030 2024-09-19T05:43:52.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac41690e0 con 0x7f4ac415d1d0 2024-09-19T05:43:52.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac40b3510 0x7f4ac41f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:52.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac40b3510 0x7f4ac41f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55656/0 (socket says 172.21.15.67:55656) 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac37fe640 1 -- 172.21.15.67:0/3944098869 learned_addr learned my addr 172.21.15.67:0/3944098869 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac2ffd640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac415c030 0x7f4ac414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac3fff640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4ac415d1d0 0x7f4ac4150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac37fe640 1 -- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4ac415d1d0 msgr2=0x7f4ac4150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac37fe640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4ac415d1d0 0x7f4ac4150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac37fe640 1 -- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac415c030 msgr2=0x7f4ac414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac37fe640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac415c030 0x7f4ac414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac37fe640 1 -- 172.21.15.67:0/3944098869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac4072020 con 0x7f4ac40b3510 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac2ffd640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac415c030 0x7f4ac414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4ac37fe640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac40b3510 0x7f4ac41f75a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4007f20 tx=0x7f4ab400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aabfff640 1 -- 172.21.15.67:0/3944098869 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4014620 con 0x7f4ac40b3510 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aabfff640 1 -- 172.21.15.67:0/3944098869 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab4019070 con 0x7f4ac40b3510 2024-09-19T05:43:52.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 -- 172.21.15.67:0/3944098869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac4072300 con 0x7f4ac40b3510 2024-09-19T05:43:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aabfff640 1 -- 172.21.15.67:0/3944098869 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4014a00 con 0x7f4ac40b3510 2024-09-19T05:43:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 -- 172.21.15.67:0/3944098869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac40728c0 con 0x7f4ac40b3510 2024-09-19T05:43:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.189+0000 7f4aca14b640 1 -- 172.21.15.67:0/3944098869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac406dde0 con 0x7f4ac40b3510 2024-09-19T05:43:52.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.193+0000 7f4aabfff640 1 -- 172.21.15.67:0/3944098869 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ab4014ba0 con 0x7f4ac40b3510 2024-09-19T05:43:52.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.193+0000 7f4aabfff640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ab00678c0 0x7f4ab0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:52.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.193+0000 7f4aabfff640 1 -- 172.21.15.67:0/3944098869 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f4ab4086800 con 0x7f4ac40b3510 2024-09-19T05:43:52.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.193+0000 7f4ac2ffd640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ab00678c0 0x7f4ab0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:52.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.193+0000 7f4ac2ffd640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ab00678c0 0x7f4ab0069d80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80af000 tx=0x7f4ab8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:52.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.197+0000 7f4aabfff640 1 -- 172.21.15.67:0/3944098869 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4ab40571b0 con 0x7f4ac40b3510 2024-09-19T05:43:52.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.353+0000 7f4aca14b640 1 -- 172.21.15.67:0/3944098869 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ac40d0f20 con 0x7f4ab00678c0 2024-09-19T05:43:52.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aabfff640 1 -- 172.21.15.67:0/3944098869 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247089 (secure 0 0 0) 0x7f4ac40d0f20 con 0x7f4ab00678c0 2024-09-19T05:43:52.372 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:52.374 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:43:52.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 -- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ab00678c0 msgr2=0x7f4ab0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:52.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ab00678c0 0x7f4ab0069d80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80af000 tx=0x7f4ab8008040 comp rx=0 tx=0).stop 2024-09-19T05:43:52.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 -- 172.21.15.67:0/3944098869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac40b3510 msgr2=0x7f4ac41f75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:52.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac40b3510 0x7f4ac41f75a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4007f20 tx=0x7f4ab400e570 comp rx=0 tx=0).stop 2024-09-19T05:43:52.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 -- 172.21.15.67:0/3944098869 shutdown_connections 2024-09-19T05:43:52.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4ab00678c0 0x7f4ab0069d80 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4ac415d1d0 0x7f4ac4150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac415c030 0x7f4ac414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 --2- 172.21.15.67:0/3944098869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ac40b3510 0x7f4ac41f75a0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:52.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 -- 172.21.15.67:0/3944098869 >> 172.21.15.67:0/3944098869 conn(0x7f4ac40d0080 msgr2=0x7f4ac40af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:52.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 -- 172.21.15.67:0/3944098869 shutdown_connections 2024-09-19T05:43:52.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:52.373+0000 7f4aca14b640 1 -- 172.21.15.67:0/3944098869 wait complete. 2024-09-19T05:43:52.389 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":461,"stamp":"2024-09-19T05:43:51.331198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":519824,"kb_used_data":14876,"kb_used_omap":12,"kb_used_meta":504755,"kb_avail":754454896,"statfs":{"total":773094113280,"available":772561813504,"internally_reserved":0,"allocated":15233024,"data_stored":7792253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516869681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.565949"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786885+0000","last_change":"2024-09-19T05:43:46.786885+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786885+0000","last_undegraded":"2024-09-19T05:43:46.786885+0000","last_fullsized":"2024-09-19T05:43:46.786885+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779840+0000","last_change":"2024-09-19T05:43:46.779840+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779840+0000","last_undegraded":"2024-09-19T05:43:46.779840+0000","last_fullsized":"2024-09-19T05:43:46.779840+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.791744+0000","last_change":"2024-09-19T05:43:46.791744+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.791744+0000","last_undegraded":"2024-09-19T05:43:46.791744+0000","last_fullsized":"2024-09-19T05:43:46.791744+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779987+0000","last_change":"2024-09-19T05:43:46.779987+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779987+0000","last_undegraded":"2024-09-19T05:43:46.779987+0000","last_fullsized":"2024-09-19T05:43:46.779987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788817+0000","last_change":"2024-09-19T05:43:46.788817+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788817+0000","last_undegraded":"2024-09-19T05:43:46.788817+0000","last_fullsized":"2024-09-19T05:43:46.788817+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782782+0000","last_change":"2024-09-19T05:43:46.782782+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782782+0000","last_undegraded":"2024-09-19T05:43:46.782782+0000","last_fullsized":"2024-09-19T05:43:46.782782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.776382+0000","last_change":"2024-09-19T05:43:46.776382+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.776382+0000","last_undegraded":"2024-09-19T05:43:46.776382+0000","last_fullsized":"2024-09-19T05:43:46.776382+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783917+0000","last_change":"2024-09-19T05:43:46.783917+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783917+0000","last_undegraded":"2024-09-19T05:43:46.783917+0000","last_fullsized":"2024-09-19T05:43:46.783917+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783796+0000","last_change":"2024-09-19T05:43:46.783796+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783796+0000","last_undegraded":"2024-09-19T05:43:46.783796+0000","last_fullsized":"2024-09-19T05:43:46.783796+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785868+0000","last_change":"2024-09-19T05:43:46.785868+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785868+0000","last_undegraded":"2024-09-19T05:43:46.785868+0000","last_fullsized":"2024-09-19T05:43:46.785868+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781021+0000","last_change":"2024-09-19T05:43:46.781021+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781021+0000","last_undegraded":"2024-09-19T05:43:46.781021+0000","last_fullsized":"2024-09-19T05:43:46.781021+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785523+0000","last_change":"2024-09-19T05:43:46.785523+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785523+0000","last_undegraded":"2024-09-19T05:43:46.785523+0000","last_fullsized":"2024-09-19T05:43:46.785523+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783473+0000","last_change":"2024-09-19T05:43:46.783473+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783473+0000","last_undegraded":"2024-09-19T05:43:46.783473+0000","last_fullsized":"2024-09-19T05:43:46.783473+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780991+0000","last_change":"2024-09-19T05:43:46.780991+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780991+0000","last_undegraded":"2024-09-19T05:43:46.780991+0000","last_fullsized":"2024-09-19T05:43:46.780991+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783358+0000","last_change":"2024-09-19T05:43:46.783358+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783358+0000","last_undegraded":"2024-09-19T05:43:46.783358+0000","last_fullsized":"2024-09-19T05:43:46.783358+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783440+0000","last_change":"2024-09-19T05:43:46.783440+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783440+0000","last_undegraded":"2024-09-19T05:43:46.783440+0000","last_fullsized":"2024-09-19T05:43:46.783440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782821+0000","last_change":"2024-09-19T05:43:46.782821+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782821+0000","last_undegraded":"2024-09-19T05:43:46.782821+0000","last_fullsized":"2024-09-19T05:43:46.782821+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.799215+0000","last_change":"2024-09-19T05:43:46.799215+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.799215+0000","last_undegraded":"2024-09-19T05:43:46.799215+0000","last_fullsized":"2024-09-19T05:43:46.799215+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.778003+0000","last_change":"2024-09-19T05:43:46.778003+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.778003+0000","last_undegraded":"2024-09-19T05:43:46.778003+0000","last_fullsized":"2024-09-19T05:43:46.778003+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788783+0000","last_change":"2024-09-19T05:43:46.788783+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788783+0000","last_undegraded":"2024-09-19T05:43:46.788783+0000","last_fullsized":"2024-09-19T05:43:46.788783+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780660+0000","last_change":"2024-09-19T05:43:46.780660+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780660+0000","last_undegraded":"2024-09-19T05:43:46.780660+0000","last_fullsized":"2024-09-19T05:43:46.780660+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781566+0000","last_change":"2024-09-19T05:43:46.781566+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781566+0000","last_undegraded":"2024-09-19T05:43:46.781566+0000","last_fullsized":"2024-09-19T05:43:46.781566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.779677+0000","last_change":"2024-09-19T05:43:46.779677+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.779677+0000","last_undegraded":"2024-09-19T05:43:46.779677+0000","last_fullsized":"2024-09-19T05:43:46.779677+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782927+0000","last_change":"2024-09-19T05:43:46.782927+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782927+0000","last_undegraded":"2024-09-19T05:43:46.782927+0000","last_fullsized":"2024-09-19T05:43:46.782927+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784525+0000","last_change":"2024-09-19T05:43:46.784525+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784525+0000","last_undegraded":"2024-09-19T05:43:46.784525+0000","last_fullsized":"2024-09-19T05:43:46.784525+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781058+0000","last_change":"2024-09-19T05:43:46.781058+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781058+0000","last_undegraded":"2024-09-19T05:43:46.781058+0000","last_fullsized":"2024-09-19T05:43:46.781058+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774177+0000","last_change":"2024-09-19T05:43:46.774177+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774177+0000","last_undegraded":"2024-09-19T05:43:46.774177+0000","last_fullsized":"2024-09-19T05:43:46.774177+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787345+0000","last_change":"2024-09-19T05:43:46.787345+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787345+0000","last_undegraded":"2024-09-19T05:43:46.787345+0000","last_fullsized":"2024-09-19T05:43:46.787345+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785168+0000","last_change":"2024-09-19T05:43:46.785168+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785168+0000","last_undegraded":"2024-09-19T05:43:46.785168+0000","last_fullsized":"2024-09-19T05:43:46.785168+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784727+0000","last_change":"2024-09-19T05:43:46.784727+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784727+0000","last_undegraded":"2024-09-19T05:43:46.784727+0000","last_fullsized":"2024-09-19T05:43:46.784727+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783235+0000","last_change":"2024-09-19T05:43:46.783235+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783235+0000","last_undegraded":"2024-09-19T05:43:46.783235+0000","last_fullsized":"2024-09-19T05:43:46.783235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788400+0000","last_change":"2024-09-19T05:43:46.788400+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788400+0000","last_undegraded":"2024-09-19T05:43:46.788400+0000","last_fullsized":"2024-09-19T05:43:46.788400+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782905+0000","last_change":"2024-09-19T05:43:46.782905+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782905+0000","last_undegraded":"2024-09-19T05:43:46.782905+0000","last_fullsized":"2024-09-19T05:43:46.782905+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798473+0000","last_change":"2024-09-19T05:43:46.796706+0000","last_active":"2024-09-19T05:43:46.798473+0000","last_peered":"2024-09-19T05:43:46.798473+0000","last_clean":"2024-09-19T05:43:46.798473+0000","last_became_active":"2024-09-19T05:43:46.796008+0000","last_became_peered":"2024-09-19T05:43:46.796008+0000","last_unstale":"2024-09-19T05:43:46.798473+0000","last_undegraded":"2024-09-19T05:43:46.798473+0000","last_fullsized":"2024-09-19T05:43:46.798473+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:23.480515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782774+0000","last_change":"2024-09-19T05:43:46.782774+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782774+0000","last_undegraded":"2024-09-19T05:43:46.782774+0000","last_fullsized":"2024-09-19T05:43:46.782774+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805655+0000","last_change":"2024-09-19T05:43:46.803874+0000","last_active":"2024-09-19T05:43:46.805655+0000","last_peered":"2024-09-19T05:43:46.805655+0000","last_clean":"2024-09-19T05:43:46.805655+0000","last_became_active":"2024-09-19T05:43:46.803453+0000","last_became_peered":"2024-09-19T05:43:46.803453+0000","last_unstale":"2024-09-19T05:43:46.805655+0000","last_undegraded":"2024-09-19T05:43:46.805655+0000","last_fullsized":"2024-09-19T05:43:46.805655+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:47.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781636+0000","last_change":"2024-09-19T05:43:46.781636+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781636+0000","last_undegraded":"2024-09-19T05:43:46.781636+0000","last_fullsized":"2024-09-19T05:43:46.781636+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794711+0000","last_change":"2024-09-19T05:43:46.794089+0000","last_active":"2024-09-19T05:43:46.794711+0000","last_peered":"2024-09-19T05:43:46.794711+0000","last_clean":"2024-09-19T05:43:46.794711+0000","last_became_active":"2024-09-19T05:43:46.793490+0000","last_became_peered":"2024-09-19T05:43:46.793490+0000","last_unstale":"2024-09-19T05:43:46.794711+0000","last_undegraded":"2024-09-19T05:43:46.794711+0000","last_fullsized":"2024-09-19T05:43:46.794711+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:49.600351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780729+0000","last_change":"2024-09-19T05:43:46.780729+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780729+0000","last_undegraded":"2024-09-19T05:43:46.780729+0000","last_fullsized":"2024-09-19T05:43:46.780729+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802482+0000","last_change":"2024-09-19T05:43:46.801246+0000","last_active":"2024-09-19T05:43:46.802482+0000","last_peered":"2024-09-19T05:43:46.802482+0000","last_clean":"2024-09-19T05:43:46.802482+0000","last_became_active":"2024-09-19T05:43:46.800763+0000","last_became_peered":"2024-09-19T05:43:46.800763+0000","last_unstale":"2024-09-19T05:43:46.802482+0000","last_undegraded":"2024-09-19T05:43:46.802482+0000","last_fullsized":"2024-09-19T05:43:46.802482+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:07.329602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784304+0000","last_change":"2024-09-19T05:43:46.784304+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784304+0000","last_undegraded":"2024-09-19T05:43:46.784304+0000","last_fullsized":"2024-09-19T05:43:46.784304+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803455+0000","last_change":"2024-09-19T05:43:46.801139+0000","last_active":"2024-09-19T05:43:46.803455+0000","last_peered":"2024-09-19T05:43:46.803455+0000","last_clean":"2024-09-19T05:43:46.803455+0000","last_became_active":"2024-09-19T05:43:46.798867+0000","last_became_peered":"2024-09-19T05:43:46.798867+0000","last_unstale":"2024-09-19T05:43:46.803455+0000","last_undegraded":"2024-09-19T05:43:46.803455+0000","last_fullsized":"2024-09-19T05:43:46.803455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:03.817783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783593+0000","last_change":"2024-09-19T05:43:46.783593+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783593+0000","last_undegraded":"2024-09-19T05:43:46.783593+0000","last_fullsized":"2024-09-19T05:43:46.783593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805559+0000","last_change":"2024-09-19T05:43:46.805047+0000","last_active":"2024-09-19T05:43:46.805559+0000","last_peered":"2024-09-19T05:43:46.805559+0000","last_clean":"2024-09-19T05:43:46.805559+0000","last_became_active":"2024-09-19T05:43:46.804641+0000","last_became_peered":"2024-09-19T05:43:46.804641+0000","last_unstale":"2024-09-19T05:43:46.805559+0000","last_undegraded":"2024-09-19T05:43:46.805559+0000","last_fullsized":"2024-09-19T05:43:46.805559+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:16:31.888923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788872+0000","last_change":"2024-09-19T05:43:46.788872+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788872+0000","last_undegraded":"2024-09-19T05:43:46.788872+0000","last_fullsized":"2024-09-19T05:43:46.788872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.791499+0000","last_change":"2024-09-19T05:43:46.790512+0000","last_active":"2024-09-19T05:43:46.791499+0000","last_peered":"2024-09-19T05:43:46.791499+0000","last_clean":"2024-09-19T05:43:46.791499+0000","last_became_active":"2024-09-19T05:43:46.790026+0000","last_became_peered":"2024-09-19T05:43:46.790026+0000","last_unstale":"2024-09-19T05:43:46.791499+0000","last_undegraded":"2024-09-19T05:43:46.791499+0000","last_fullsized":"2024-09-19T05:43:46.791499+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:28.921450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.776994+0000","last_change":"2024-09-19T05:43:46.776994+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.776994+0000","last_undegraded":"2024-09-19T05:43:46.776994+0000","last_fullsized":"2024-09-19T05:43:46.776994+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.806351+0000","last_change":"2024-09-19T05:43:46.805617+0000","last_active":"2024-09-19T05:43:46.806351+0000","last_peered":"2024-09-19T05:43:46.806351+0000","last_clean":"2024-09-19T05:43:46.806351+0000","last_became_active":"2024-09-19T05:43:46.805192+0000","last_became_peered":"2024-09-19T05:43:46.805192+0000","last_unstale":"2024-09-19T05:43:46.806351+0000","last_undegraded":"2024-09-19T05:43:46.806351+0000","last_fullsized":"2024-09-19T05:43:46.806351+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:40.070418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781299+0000","last_change":"2024-09-19T05:43:46.781299+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781299+0000","last_undegraded":"2024-09-19T05:43:46.781299+0000","last_fullsized":"2024-09-19T05:43:46.781299+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803706+0000","last_change":"2024-09-19T05:43:46.801306+0000","last_active":"2024-09-19T05:43:46.803706+0000","last_peered":"2024-09-19T05:43:46.803706+0000","last_clean":"2024-09-19T05:43:46.803706+0000","last_became_active":"2024-09-19T05:43:46.800754+0000","last_became_peered":"2024-09-19T05:43:46.800754+0000","last_unstale":"2024-09-19T05:43:46.803706+0000","last_undegraded":"2024-09-19T05:43:46.803706+0000","last_fullsized":"2024-09-19T05:43:46.803706+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:12.525296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782871+0000","last_change":"2024-09-19T05:43:46.782871+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782871+0000","last_undegraded":"2024-09-19T05:43:46.782871+0000","last_fullsized":"2024-09-19T05:43:46.782871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.797079+0000","last_change":"2024-09-19T05:43:46.792317+0000","last_active":"2024-09-19T05:43:46.797079+0000","last_peered":"2024-09-19T05:43:46.797079+0000","last_clean":"2024-09-19T05:43:46.797079+0000","last_became_active":"2024-09-19T05:43:46.791902+0000","last_became_peered":"2024-09-19T05:43:46.791902+0000","last_unstale":"2024-09-19T05:43:46.797079+0000","last_undegraded":"2024-09-19T05:43:46.797079+0000","last_fullsized":"2024-09-19T05:43:46.797079+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.145371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.780622+0000","last_change":"2024-09-19T05:43:46.780622+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.780622+0000","last_undegraded":"2024-09-19T05:43:46.780622+0000","last_fullsized":"2024-09-19T05:43:46.780622+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.801337+0000","last_change":"2024-09-19T05:43:46.796419+0000","last_active":"2024-09-19T05:43:46.801337+0000","last_peered":"2024-09-19T05:43:46.801337+0000","last_clean":"2024-09-19T05:43:46.801337+0000","last_became_active":"2024-09-19T05:43:46.795811+0000","last_became_peered":"2024-09-19T05:43:46.795811+0000","last_unstale":"2024-09-19T05:43:46.801337+0000","last_undegraded":"2024-09-19T05:43:46.801337+0000","last_fullsized":"2024-09-19T05:43:46.801337+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:04.455952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.783662+0000","last_change":"2024-09-19T05:43:46.783662+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.783662+0000","last_undegraded":"2024-09-19T05:43:46.783662+0000","last_fullsized":"2024-09-19T05:43:46.783662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804576+0000","last_change":"2024-09-19T05:43:46.803323+0000","last_active":"2024-09-19T05:43:46.804576+0000","last_peered":"2024-09-19T05:43:46.804576+0000","last_clean":"2024-09-19T05:43:46.804576+0000","last_became_active":"2024-09-19T05:43:46.803032+0000","last_became_peered":"2024-09-19T05:43:46.803032+0000","last_unstale":"2024-09-19T05:43:46.804576+0000","last_undegraded":"2024-09-19T05:43:46.804576+0000","last_fullsized":"2024-09-19T05:43:46.804576+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:29.172683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.785731+0000","last_change":"2024-09-19T05:43:46.785731+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.785731+0000","last_undegraded":"2024-09-19T05:43:46.785731+0000","last_fullsized":"2024-09-19T05:43:46.785731+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.800482+0000","last_change":"2024-09-19T05:43:46.799385+0000","last_active":"2024-09-19T05:43:46.800482+0000","last_peered":"2024-09-19T05:43:46.800482+0000","last_clean":"2024-09-19T05:43:46.800482+0000","last_became_active":"2024-09-19T05:43:46.797943+0000","last_became_peered":"2024-09-19T05:43:46.797943+0000","last_unstale":"2024-09-19T05:43:46.800482+0000","last_undegraded":"2024-09-19T05:43:46.800482+0000","last_fullsized":"2024-09-19T05:43:46.800482+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:18.054179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775892+0000","last_change":"2024-09-19T05:43:46.775892+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775892+0000","last_undegraded":"2024-09-19T05:43:46.775892+0000","last_fullsized":"2024-09-19T05:43:46.775892+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805595+0000","last_change":"2024-09-19T05:43:46.804287+0000","last_active":"2024-09-19T05:43:46.805595+0000","last_peered":"2024-09-19T05:43:46.805595+0000","last_clean":"2024-09-19T05:43:46.805595+0000","last_became_active":"2024-09-19T05:43:46.803954+0000","last_became_peered":"2024-09-19T05:43:46.803954+0000","last_unstale":"2024-09-19T05:43:46.805595+0000","last_undegraded":"2024-09-19T05:43:46.805595+0000","last_fullsized":"2024-09-19T05:43:46.805595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:07.725004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788130+0000","last_change":"2024-09-19T05:43:46.788130+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788130+0000","last_undegraded":"2024-09-19T05:43:46.788130+0000","last_fullsized":"2024-09-19T05:43:46.788130+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798172+0000","last_change":"2024-09-19T05:43:46.797549+0000","last_active":"2024-09-19T05:43:46.798172+0000","last_peered":"2024-09-19T05:43:46.798172+0000","last_clean":"2024-09-19T05:43:46.798172+0000","last_became_active":"2024-09-19T05:43:46.797153+0000","last_became_peered":"2024-09-19T05:43:46.797153+0000","last_unstale":"2024-09-19T05:43:46.798172+0000","last_undegraded":"2024-09-19T05:43:46.798172+0000","last_fullsized":"2024-09-19T05:43:46.798172+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:15.091624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784573+0000","last_change":"2024-09-19T05:43:46.784573+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784573+0000","last_undegraded":"2024-09-19T05:43:46.784573+0000","last_fullsized":"2024-09-19T05:43:46.784573+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803653+0000","last_change":"2024-09-19T05:43:46.800003+0000","last_active":"2024-09-19T05:43:46.803653+0000","last_peered":"2024-09-19T05:43:46.803653+0000","last_clean":"2024-09-19T05:43:46.803653+0000","last_became_active":"2024-09-19T05:43:46.799092+0000","last_became_peered":"2024-09-19T05:43:46.799092+0000","last_unstale":"2024-09-19T05:43:46.803653+0000","last_undegraded":"2024-09-19T05:43:46.803653+0000","last_fullsized":"2024-09-19T05:43:46.803653+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:59.820569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775297+0000","last_change":"2024-09-19T05:43:46.775297+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775297+0000","last_undegraded":"2024-09-19T05:43:46.775297+0000","last_fullsized":"2024-09-19T05:43:46.775297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.796400+0000","last_change":"2024-09-19T05:43:46.795206+0000","last_active":"2024-09-19T05:43:46.796400+0000","last_peered":"2024-09-19T05:43:46.796400+0000","last_clean":"2024-09-19T05:43:46.796400+0000","last_became_active":"2024-09-19T05:43:46.794855+0000","last_became_peered":"2024-09-19T05:43:46.794855+0000","last_unstale":"2024-09-19T05:43:46.796400+0000","last_undegraded":"2024-09-19T05:43:46.796400+0000","last_fullsized":"2024-09-19T05:43:46.796400+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:10.402439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774036+0000","last_change":"2024-09-19T05:43:46.774036+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774036+0000","last_undegraded":"2024-09-19T05:43:46.774036+0000","last_fullsized":"2024-09-19T05:43:46.774036+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.791063+0000","last_change":"2024-09-19T05:43:46.790169+0000","last_active":"2024-09-19T05:43:46.791063+0000","last_peered":"2024-09-19T05:43:46.791063+0000","last_clean":"2024-09-19T05:43:46.791063+0000","last_became_active":"2024-09-19T05:43:46.789867+0000","last_became_peered":"2024-09-19T05:43:46.789867+0000","last_unstale":"2024-09-19T05:43:46.791063+0000","last_undegraded":"2024-09-19T05:43:46.791063+0000","last_fullsized":"2024-09-19T05:43:46.791063+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:55.643231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786570+0000","last_change":"2024-09-19T05:43:46.786570+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786570+0000","last_undegraded":"2024-09-19T05:43:46.786570+0000","last_fullsized":"2024-09-19T05:43:46.786570+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804679+0000","last_change":"2024-09-19T05:43:46.804003+0000","last_active":"2024-09-19T05:43:46.804679+0000","last_peered":"2024-09-19T05:43:46.804679+0000","last_clean":"2024-09-19T05:43:46.804679+0000","last_became_active":"2024-09-19T05:43:46.799507+0000","last_became_peered":"2024-09-19T05:43:46.799507+0000","last_unstale":"2024-09-19T05:43:46.804679+0000","last_undegraded":"2024-09-19T05:43:46.804679+0000","last_fullsized":"2024-09-19T05:43:46.804679+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:09.181248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787593+0000","last_change":"2024-09-19T05:43:46.787593+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787593+0000","last_undegraded":"2024-09-19T05:43:46.787593+0000","last_fullsized":"2024-09-19T05:43:46.787593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803417+0000","last_change":"2024-09-19T05:43:46.801154+0000","last_active":"2024-09-19T05:43:46.803417+0000","last_peered":"2024-09-19T05:43:46.803417+0000","last_clean":"2024-09-19T05:43:46.803417+0000","last_became_active":"2024-09-19T05:43:46.798367+0000","last_became_peered":"2024-09-19T05:43:46.798367+0000","last_unstale":"2024-09-19T05:43:46.803417+0000","last_undegraded":"2024-09-19T05:43:46.803417+0000","last_fullsized":"2024-09-19T05:43:46.803417+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:11.177367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781841+0000","last_change":"2024-09-19T05:43:46.781841+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781841+0000","last_undegraded":"2024-09-19T05:43:46.781841+0000","last_fullsized":"2024-09-19T05:43:46.781841+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.806011+0000","last_change":"2024-09-19T05:43:46.805429+0000","last_active":"2024-09-19T05:43:46.806011+0000","last_peered":"2024-09-19T05:43:46.806011+0000","last_clean":"2024-09-19T05:43:46.806011+0000","last_became_active":"2024-09-19T05:43:46.805016+0000","last_became_peered":"2024-09-19T05:43:46.805016+0000","last_unstale":"2024-09-19T05:43:46.806011+0000","last_undegraded":"2024-09-19T05:43:46.806011+0000","last_fullsized":"2024-09-19T05:43:46.806011+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:06.495111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.788028+0000","last_change":"2024-09-19T05:43:46.788028+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.788028+0000","last_undegraded":"2024-09-19T05:43:46.788028+0000","last_fullsized":"2024-09-19T05:43:46.788028+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.796767+0000","last_change":"2024-09-19T05:43:46.796046+0000","last_active":"2024-09-19T05:43:46.796767+0000","last_peered":"2024-09-19T05:43:46.796767+0000","last_clean":"2024-09-19T05:43:46.796767+0000","last_became_active":"2024-09-19T05:43:46.795486+0000","last_became_peered":"2024-09-19T05:43:46.795486+0000","last_unstale":"2024-09-19T05:43:46.796767+0000","last_undegraded":"2024-09-19T05:43:46.796767+0000","last_fullsized":"2024-09-19T05:43:46.796767+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:37.034508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782676+0000","last_change":"2024-09-19T05:43:46.782676+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782676+0000","last_undegraded":"2024-09-19T05:43:46.782676+0000","last_fullsized":"2024-09-19T05:43:46.782676+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794691+0000","last_change":"2024-09-19T05:43:46.793209+0000","last_active":"2024-09-19T05:43:46.794691+0000","last_peered":"2024-09-19T05:43:46.794691+0000","last_clean":"2024-09-19T05:43:46.794691+0000","last_became_active":"2024-09-19T05:43:46.792865+0000","last_became_peered":"2024-09-19T05:43:46.792865+0000","last_unstale":"2024-09-19T05:43:46.794691+0000","last_undegraded":"2024-09-19T05:43:46.794691+0000","last_fullsized":"2024-09-19T05:43:46.794691+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:43.808413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.787618+0000","last_change":"2024-09-19T05:43:46.787618+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.787618+0000","last_undegraded":"2024-09-19T05:43:46.787618+0000","last_fullsized":"2024-09-19T05:43:46.787618+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.800461+0000","last_change":"2024-09-19T05:43:46.799401+0000","last_active":"2024-09-19T05:43:46.800461+0000","last_peered":"2024-09-19T05:43:46.800461+0000","last_clean":"2024-09-19T05:43:46.800461+0000","last_became_active":"2024-09-19T05:43:46.797931+0000","last_became_peered":"2024-09-19T05:43:46.797931+0000","last_unstale":"2024-09-19T05:43:46.800461+0000","last_undegraded":"2024-09-19T05:43:46.800461+0000","last_fullsized":"2024-09-19T05:43:46.800461+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:46.679571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.781068+0000","last_change":"2024-09-19T05:43:46.781068+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.781068+0000","last_undegraded":"2024-09-19T05:43:46.781068+0000","last_fullsized":"2024-09-19T05:43:46.781068+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.805402+0000","last_change":"2024-09-19T05:43:46.803632+0000","last_active":"2024-09-19T05:43:46.805402+0000","last_peered":"2024-09-19T05:43:46.805402+0000","last_clean":"2024-09-19T05:43:46.805402+0000","last_became_active":"2024-09-19T05:43:46.803191+0000","last_became_peered":"2024-09-19T05:43:46.803191+0000","last_unstale":"2024-09-19T05:43:46.805402+0000","last_undegraded":"2024-09-19T05:43:46.805402+0000","last_fullsized":"2024-09-19T05:43:46.805402+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:10.402439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.775393+0000","last_change":"2024-09-19T05:43:46.775393+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.775393+0000","last_undegraded":"2024-09-19T05:43:46.775393+0000","last_fullsized":"2024-09-19T05:43:46.775393+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802411+0000","last_change":"2024-09-19T05:43:46.797969+0000","last_active":"2024-09-19T05:43:46.802411+0000","last_peered":"2024-09-19T05:43:46.802411+0000","last_clean":"2024-09-19T05:43:46.802411+0000","last_became_active":"2024-09-19T05:43:46.797489+0000","last_became_peered":"2024-09-19T05:43:46.797489+0000","last_unstale":"2024-09-19T05:43:46.802411+0000","last_undegraded":"2024-09-19T05:43:46.802411+0000","last_fullsized":"2024-09-19T05:43:46.802411+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:31.524906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.786019+0000","last_change":"2024-09-19T05:43:46.786019+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.786019+0000","last_undegraded":"2024-09-19T05:43:46.786019+0000","last_fullsized":"2024-09-19T05:43:46.786019+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.794623+0000","last_change":"2024-09-19T05:43:46.792214+0000","last_active":"2024-09-19T05:43:46.794623+0000","last_peered":"2024-09-19T05:43:46.794623+0000","last_clean":"2024-09-19T05:43:46.794623+0000","last_became_active":"2024-09-19T05:43:46.791792+0000","last_became_peered":"2024-09-19T05:43:46.791792+0000","last_unstale":"2024-09-19T05:43:46.794623+0000","last_undegraded":"2024-09-19T05:43:46.794623+0000","last_fullsized":"2024-09-19T05:43:46.794623+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:31.011960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.782662+0000","last_change":"2024-09-19T05:43:46.782662+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.782662+0000","last_undegraded":"2024-09-19T05:43:46.782662+0000","last_fullsized":"2024-09-19T05:43:46.782662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.802451+0000","last_change":"2024-09-19T05:43:46.790954+0000","last_active":"2024-09-19T05:43:46.802451+0000","last_peered":"2024-09-19T05:43:46.802451+0000","last_clean":"2024-09-19T05:43:46.802451+0000","last_became_active":"2024-09-19T05:43:46.790304+0000","last_became_peered":"2024-09-19T05:43:46.790304+0000","last_unstale":"2024-09-19T05:43:46.802451+0000","last_undegraded":"2024-09-19T05:43:46.802451+0000","last_fullsized":"2024-09-19T05:43:46.802451+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:00.007614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784239+0000","last_change":"2024-09-19T05:43:46.784239+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784239+0000","last_undegraded":"2024-09-19T05:43:46.784239+0000","last_fullsized":"2024-09-19T05:43:46.784239+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.803746+0000","last_change":"2024-09-19T05:43:46.802290+0000","last_active":"2024-09-19T05:43:46.803746+0000","last_peered":"2024-09-19T05:43:46.803746+0000","last_clean":"2024-09-19T05:43:46.803746+0000","last_became_active":"2024-09-19T05:43:46.802005+0000","last_became_peered":"2024-09-19T05:43:46.802005+0000","last_unstale":"2024-09-19T05:43:46.803746+0000","last_undegraded":"2024-09-19T05:43:46.803746+0000","last_fullsized":"2024-09-19T05:43:46.803746+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:50.223356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784548+0000","last_change":"2024-09-19T05:43:46.784548+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784548+0000","last_undegraded":"2024-09-19T05:43:46.784548+0000","last_fullsized":"2024-09-19T05:43:46.784548+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.792514+0000","last_change":"2024-09-19T05:43:46.791368+0000","last_active":"2024-09-19T05:43:46.792514+0000","last_peered":"2024-09-19T05:43:46.792514+0000","last_clean":"2024-09-19T05:43:46.792514+0000","last_became_active":"2024-09-19T05:43:46.791101+0000","last_became_peered":"2024-09-19T05:43:46.791101+0000","last_unstale":"2024-09-19T05:43:46.792514+0000","last_undegraded":"2024-09-19T05:43:46.792514+0000","last_fullsized":"2024-09-19T05:43:46.792514+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:53.666132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.774036+0000","last_change":"2024-09-19T05:43:46.774036+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.774036+0000","last_undegraded":"2024-09-19T05:43:46.774036+0000","last_fullsized":"2024-09-19T05:43:46.774036+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.804572+0000","last_change":"2024-09-19T05:43:46.803154+0000","last_active":"2024-09-19T05:43:46.804572+0000","last_peered":"2024-09-19T05:43:46.804572+0000","last_clean":"2024-09-19T05:43:46.804572+0000","last_became_active":"2024-09-19T05:43:46.802771+0000","last_became_peered":"2024-09-19T05:43:46.802771+0000","last_unstale":"2024-09-19T05:43:46.804572+0000","last_undegraded":"2024-09-19T05:43:46.804572+0000","last_fullsized":"2024-09-19T05:43:46.804572+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:06.895736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-19T05:43:46.784563+0000","last_change":"2024-09-19T05:43:46.784563+0000","last_active":"2024-09-19T05:43:46.766523+0000","last_peered":"2024-09-19T05:43:46.766523+0000","last_clean":"2024-09-19T05:43:46.766523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:43:46.784563+0000","last_undegraded":"2024-09-19T05:43:46.784563+0000","last_fullsized":"2024-09-19T05:43:46.784563+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.798838+0000","last_change":"2024-09-19T05:43:46.798297+0000","last_active":"2024-09-19T05:43:46.798838+0000","last_peered":"2024-09-19T05:43:46.798838+0000","last_clean":"2024-09-19T05:43:46.798838+0000","last_became_active":"2024-09-19T05:43:46.797990+0000","last_became_peered":"2024-09-19T05:43:46.797990+0000","last_unstale":"2024-09-19T05:43:46.798838+0000","last_undegraded":"2024-09-19T05:43:46.798838+0000","last_fullsized":"2024-09-19T05:43:46.798838+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:03.752818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":388,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-19T05:43:46.787456+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:43:46.787456+0000","last_peered":"2024-09-19T05:43:46.787456+0000","last_clean":"2024-09-19T05:43:46.787456+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:43:46.787456+0000","last_undegraded":"2024-09-19T05:43:46.787456+0000","last_fullsized":"2024-09-19T05:43:46.787456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542275,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65424,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306416,"statfs":{"total":96636764160,"available":96569769984,"internally_reserved":0,"allocated":2351104,"data_stored":1417640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542275,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64844,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306996,"statfs":{"total":96636764160,"available":96570363904,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542277,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59260,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312580,"statfs":{"total":96636764160,"available":96576081920,"internally_reserved":0,"allocated":1744896,"data_stored":820613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542275,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69000,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302840,"statfs":{"total":96636764160,"available":96566108160,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63436,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308404,"statfs":{"total":96636764160,"available":96571805696,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69004,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302836,"statfs":{"total":96636764160,"available":96566104064,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542278,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55116,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316724,"statfs":{"total":96636764160,"available":96580325376,"internally_reserved":0,"allocated":1757184,"data_stored":827272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542275,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73740,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298100,"statfs":{"total":96636764160,"available":96561254400,"internally_reserved":0,"allocated":2351104,"data_stored":1417640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:43:53.760 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:43:53.761+0000 7f1651e08640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:43:55.394 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:43:55.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f18886a9640 1 Processor -- start 2024-09-19T05:43:55.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f18886a9640 1 -- start start 2024-09-19T05:43:55.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f18886a9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f188015c030 0x7f188006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f18886a9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 0x7f18800b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f18886a9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188006e3c0 con 0x7f18800b3510 2024-09-19T05:43:55.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f18886a9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f188006e6a0 con 0x7f188015c030 2024-09-19T05:43:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f18886a9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f188006e980 con 0x7f188015d1d0 2024-09-19T05:43:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f1886445640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f188015c030 0x7f188006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f1886445640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f188015c030 0x7f188006dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55670/0 (socket says 172.21.15.67:55670) 2024-09-19T05:43:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f1886445640 1 -- 172.21.15.67:0/1314570545 learned_addr learned my addr 172.21.15.67:0/1314570545 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f1885c44640 1 --2- 172.21.15.67:0/1314570545 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 0x7f18800b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f1886445640 1 -- 172.21.15.67:0/1314570545 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 msgr2=0x7f18800b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f1886445640 1 --2- 172.21.15.67:0/1314570545 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 0x7f18800b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f1886445640 1 -- 172.21.15.67:0/1314570545 >> v1:172.21.15.97:6789/0 conn(0x7f18800b3510 legacy=0x7f188006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f1886445640 1 -- 172.21.15.67:0/1314570545 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188006ec60 con 0x7f188015c030 2024-09-19T05:43:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.533+0000 7f1886445640 1 --2- 172.21.15.67:0/1314570545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f188015c030 0x7f188006dde0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f187c009870 tx=0x7f187c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e6d59242077d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f1885443640 1 -- 172.21.15.67:0/1314570545 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c0ab640 con 0x7f188015c030 2024-09-19T05:43:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f1885443640 1 -- 172.21.15.67:0/1314570545 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c0b0070 con 0x7f188015c030 2024-09-19T05:43:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f1885443640 1 -- 172.21.15.67:0/1314570545 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c0aba00 con 0x7f188015c030 2024-09-19T05:43:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 -- 172.21.15.67:0/1314570545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f188015c030 msgr2=0x7f188006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 --2- 172.21.15.67:0/1314570545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f188015c030 0x7f188006dde0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f187c009870 tx=0x7f187c01c460 comp rx=0 tx=0).stop 2024-09-19T05:43:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 -- 172.21.15.67:0/1314570545 shutdown_connections 2024-09-19T05:43:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 --2- 172.21.15.67:0/1314570545 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 0x7f18800b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 --2- 172.21.15.67:0/1314570545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f188015c030 0x7f188006dde0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 -- 172.21.15.67:0/1314570545 >> 172.21.15.67:0/1314570545 conn(0x7f18800d0080 msgr2=0x7f18800d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 -- 172.21.15.67:0/1314570545 shutdown_connections 2024-09-19T05:43:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 -- 172.21.15.67:0/1314570545 wait complete. 2024-09-19T05:43:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 Processor -- start 2024-09-19T05:43:55.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 -- start start 2024-09-19T05:43:55.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18800b3510 0x7f1880147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188015c030 0x7f188014cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 0x7f188014d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f188015c590 con 0x7f18800b3510 2024-09-19T05:43:55.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f188015c410 con 0x7f188015c030 2024-09-19T05:43:55.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f18886a9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f18801690e0 con 0x7f188015d1d0 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f1886445640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18800b3510 0x7f1880147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f1886445640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18800b3510 0x7f1880147c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55674/0 (socket says 172.21.15.67:55674) 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f1886445640 1 -- 172.21.15.67:0/3584565744 learned_addr learned my addr 172.21.15.67:0/3584565744 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f1885c44640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188015c030 0x7f188014cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.537+0000 7f1886c46640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 0x7f188014d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1886445640 1 -- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 msgr2=0x7f188014d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1886445640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 0x7f188014d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1886445640 1 -- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188015c030 msgr2=0x7f188014cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1886445640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188015c030 0x7f188014cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1886445640 1 -- 172.21.15.67:0/3584565744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188014fbb0 con 0x7f18800b3510 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1885c44640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188015c030 0x7f188014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:55.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1886c46640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 0x7f188014d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:55.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1886445640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18800b3510 0x7f1880147c80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f187c0ad040 tx=0x7f187c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:55.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1876ffd640 1 -- 172.21.15.67:0/3584565744 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c0be5f0 con 0x7f18800b3510 2024-09-19T05:43:55.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1876ffd640 1 -- 172.21.15.67:0/3584565744 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c0be790 con 0x7f18800b3510 2024-09-19T05:43:55.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1876ffd640 1 -- 172.21.15.67:0/3584565744 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c0beb80 con 0x7f18800b3510 2024-09-19T05:43:55.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f18886a9640 1 -- 172.21.15.67:0/3584565744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188014fe90 con 0x7f18800b3510 2024-09-19T05:43:55.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f18886a9640 1 -- 172.21.15.67:0/3584565744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1880149010 con 0x7f18800b3510 2024-09-19T05:43:55.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f18886a9640 1 -- 172.21.15.67:0/3584565744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f188006dde0 con 0x7f18800b3510 2024-09-19T05:43:55.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1876ffd640 1 -- 172.21.15.67:0/3584565744 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f187c0b43f0 con 0x7f18800b3510 2024-09-19T05:43:55.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1876ffd640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18640678c0 0x7f1864069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1876ffd640 1 -- 172.21.15.67:0/3584565744 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f187c120ba0 con 0x7f18800b3510 2024-09-19T05:43:55.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1885c44640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18640678c0 0x7f1864069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.541+0000 7f1885c44640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18640678c0 0x7f1864069d80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1870006fd0 tx=0x7f1870008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:55.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.545+0000 7f1876ffd640 1 -- 172.21.15.67:0/3584565744 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f187c0c4060 con 0x7f18800b3510 2024-09-19T05:43:55.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.709+0000 7f18886a9640 1 -- 172.21.15.67:0/3584565744 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f188006dde0 con 0x7f18640678c0 2024-09-19T05:43:55.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.725+0000 7f1876ffd640 1 -- 172.21.15.67:0/3584565744 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252486 (secure 0 0 0) 0x7f188006dde0 con 0x7f18640678c0 2024-09-19T05:43:55.727 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:55.728 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:43:55.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 -- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18640678c0 msgr2=0x7f1864069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:55.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18640678c0 0x7f1864069d80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1870006fd0 tx=0x7f1870008040 comp rx=0 tx=0).stop 2024-09-19T05:43:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 -- 172.21.15.67:0/3584565744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18800b3510 msgr2=0x7f1880147c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18800b3510 0x7f1880147c80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f187c0ad040 tx=0x7f187c01aca0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 -- 172.21.15.67:0/3584565744 shutdown_connections 2024-09-19T05:43:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f18640678c0 0x7f1864069d80 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188015d1d0 0x7f188014d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188015c030 0x7f188014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 --2- 172.21.15.67:0/3584565744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18800b3510 0x7f1880147c80 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 -- 172.21.15.67:0/3584565744 >> 172.21.15.67:0/3584565744 conn(0x7f18800d0080 msgr2=0x7f188006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 -- 172.21.15.67:0/3584565744 shutdown_connections 2024-09-19T05:43:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.729+0000 7f18886a9640 1 -- 172.21.15.67:0/3584565744 wait complete. 2024-09-19T05:43:55.746 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":463,"stamp":"2024-09-19T05:43:55.332775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":520088,"kb_used_data":15144,"kb_used_omap":12,"kb_used_meta":504755,"kb_avail":754454632,"statfs":{"total":773094113280,"available":772561543168,"internally_reserved":0,"allocated":15507456,"data_stored":7914604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516869681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002749"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712854+0000","last_change":"2024-09-19T05:43:47.811761+0000","last_active":"2024-09-19T05:43:50.712854+0000","last_peered":"2024-09-19T05:43:50.712854+0000","last_clean":"2024-09-19T05:43:50.712854+0000","last_became_active":"2024-09-19T05:43:47.810895+0000","last_became_peered":"2024-09-19T05:43:47.810895+0000","last_unstale":"2024-09-19T05:43:50.712854+0000","last_undegraded":"2024-09-19T05:43:50.712854+0000","last_fullsized":"2024-09-19T05:43:50.712854+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:48.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.795076+0000","last_change":"2024-09-19T05:43:47.840247+0000","last_active":"2024-09-19T05:43:49.795076+0000","last_peered":"2024-09-19T05:43:49.795076+0000","last_clean":"2024-09-19T05:43:49.795076+0000","last_became_active":"2024-09-19T05:43:47.839100+0000","last_became_peered":"2024-09-19T05:43:47.839100+0000","last_unstale":"2024-09-19T05:43:49.795076+0000","last_undegraded":"2024-09-19T05:43:49.795076+0000","last_fullsized":"2024-09-19T05:43:49.795076+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:15.406209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.010137+0000","last_change":"2024-09-19T05:43:47.857788+0000","last_active":"2024-09-19T05:43:49.010137+0000","last_peered":"2024-09-19T05:43:49.010137+0000","last_clean":"2024-09-19T05:43:49.010137+0000","last_became_active":"2024-09-19T05:43:47.852814+0000","last_became_peered":"2024-09-19T05:43:47.852814+0000","last_unstale":"2024-09-19T05:43:49.010137+0000","last_undegraded":"2024-09-19T05:43:49.010137+0000","last_fullsized":"2024-09-19T05:43:49.010137+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:50.609392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.794400+0000","last_change":"2024-09-19T05:43:47.808477+0000","last_active":"2024-09-19T05:43:49.794400+0000","last_peered":"2024-09-19T05:43:49.794400+0000","last_clean":"2024-09-19T05:43:49.794400+0000","last_became_active":"2024-09-19T05:43:47.807675+0000","last_became_peered":"2024-09-19T05:43:47.807675+0000","last_unstale":"2024-09-19T05:43:49.794400+0000","last_undegraded":"2024-09-19T05:43:49.794400+0000","last_fullsized":"2024-09-19T05:43:49.794400+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:54.196598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.791892+0000","last_change":"2024-09-19T05:43:47.831016+0000","last_active":"2024-09-19T05:43:48.791892+0000","last_peered":"2024-09-19T05:43:48.791892+0000","last_clean":"2024-09-19T05:43:48.791892+0000","last_became_active":"2024-09-19T05:43:47.830726+0000","last_became_peered":"2024-09-19T05:43:47.830726+0000","last_unstale":"2024-09-19T05:43:48.791892+0000","last_undegraded":"2024-09-19T05:43:48.791892+0000","last_fullsized":"2024-09-19T05:43:48.791892+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:35.061747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712029+0000","last_change":"2024-09-19T05:43:47.863209+0000","last_active":"2024-09-19T05:43:50.712029+0000","last_peered":"2024-09-19T05:43:50.712029+0000","last_clean":"2024-09-19T05:43:50.712029+0000","last_became_active":"2024-09-19T05:43:47.862909+0000","last_became_peered":"2024-09-19T05:43:47.862909+0000","last_unstale":"2024-09-19T05:43:50.712029+0000","last_undegraded":"2024-09-19T05:43:50.712029+0000","last_fullsized":"2024-09-19T05:43:50.712029+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:16:32.897964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.710532+0000","last_change":"2024-09-19T05:43:47.855002+0000","last_active":"2024-09-19T05:43:50.710532+0000","last_peered":"2024-09-19T05:43:50.710532+0000","last_clean":"2024-09-19T05:43:50.710532+0000","last_became_active":"2024-09-19T05:43:47.854578+0000","last_became_peered":"2024-09-19T05:43:47.854578+0000","last_unstale":"2024-09-19T05:43:50.710532+0000","last_undegraded":"2024-09-19T05:43:50.710532+0000","last_fullsized":"2024-09-19T05:43:50.710532+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:44.047840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.789913+0000","last_change":"2024-09-19T05:43:47.815426+0000","last_active":"2024-09-19T05:43:48.789913+0000","last_peered":"2024-09-19T05:43:48.789913+0000","last_clean":"2024-09-19T05:43:48.789913+0000","last_became_active":"2024-09-19T05:43:47.814738+0000","last_became_peered":"2024-09-19T05:43:47.814738+0000","last_unstale":"2024-09-19T05:43:48.789913+0000","last_undegraded":"2024-09-19T05:43:48.789913+0000","last_fullsized":"2024-09-19T05:43:48.789913+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:56.652272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712737+0000","last_change":"2024-09-19T05:43:47.834002+0000","last_active":"2024-09-19T05:43:50.712737+0000","last_peered":"2024-09-19T05:43:50.712737+0000","last_clean":"2024-09-19T05:43:50.712737+0000","last_became_active":"2024-09-19T05:43:47.832814+0000","last_became_peered":"2024-09-19T05:43:47.832814+0000","last_unstale":"2024-09-19T05:43:50.712737+0000","last_undegraded":"2024-09-19T05:43:50.712737+0000","last_fullsized":"2024-09-19T05:43:50.712737+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:02.832982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713775+0000","last_change":"2024-09-19T05:43:47.814002+0000","last_active":"2024-09-19T05:43:50.713775+0000","last_peered":"2024-09-19T05:43:50.713775+0000","last_clean":"2024-09-19T05:43:50.713775+0000","last_became_active":"2024-09-19T05:43:47.813706+0000","last_became_peered":"2024-09-19T05:43:47.813706+0000","last_unstale":"2024-09-19T05:43:50.713775+0000","last_undegraded":"2024-09-19T05:43:50.713775+0000","last_fullsized":"2024-09-19T05:43:50.713775+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:16.694424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.794580+0000","last_change":"2024-09-19T05:43:47.853509+0000","last_active":"2024-09-19T05:43:49.794580+0000","last_peered":"2024-09-19T05:43:49.794580+0000","last_clean":"2024-09-19T05:43:49.794580+0000","last_became_active":"2024-09-19T05:43:47.852982+0000","last_became_peered":"2024-09-19T05:43:47.852982+0000","last_unstale":"2024-09-19T05:43:49.794580+0000","last_undegraded":"2024-09-19T05:43:49.794580+0000","last_fullsized":"2024-09-19T05:43:49.794580+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:42.465199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712620+0000","last_change":"2024-09-19T05:43:47.833438+0000","last_active":"2024-09-19T05:43:50.712620+0000","last_peered":"2024-09-19T05:43:50.712620+0000","last_clean":"2024-09-19T05:43:50.712620+0000","last_became_active":"2024-09-19T05:43:47.833169+0000","last_became_peered":"2024-09-19T05:43:47.833169+0000","last_unstale":"2024-09-19T05:43:50.712620+0000","last_undegraded":"2024-09-19T05:43:50.712620+0000","last_fullsized":"2024-09-19T05:43:50.712620+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:57.056846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712137+0000","last_change":"2024-09-19T05:43:47.855713+0000","last_active":"2024-09-19T05:43:50.712137+0000","last_peered":"2024-09-19T05:43:50.712137+0000","last_clean":"2024-09-19T05:43:50.712137+0000","last_became_active":"2024-09-19T05:43:47.855412+0000","last_became_peered":"2024-09-19T05:43:47.855412+0000","last_unstale":"2024-09-19T05:43:50.712137+0000","last_undegraded":"2024-09-19T05:43:50.712137+0000","last_fullsized":"2024-09-19T05:43:50.712137+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:52.115435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713436+0000","last_change":"2024-09-19T05:43:47.819246+0000","last_active":"2024-09-19T05:43:50.713436+0000","last_peered":"2024-09-19T05:43:50.713436+0000","last_clean":"2024-09-19T05:43:50.713436+0000","last_became_active":"2024-09-19T05:43:47.818932+0000","last_became_peered":"2024-09-19T05:43:47.818932+0000","last_unstale":"2024-09-19T05:43:50.713436+0000","last_undegraded":"2024-09-19T05:43:50.713436+0000","last_fullsized":"2024-09-19T05:43:50.713436+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:10.419352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712406+0000","last_change":"2024-09-19T05:43:47.832358+0000","last_active":"2024-09-19T05:43:50.712406+0000","last_peered":"2024-09-19T05:43:50.712406+0000","last_clean":"2024-09-19T05:43:50.712406+0000","last_became_active":"2024-09-19T05:43:47.832064+0000","last_became_peered":"2024-09-19T05:43:47.832064+0000","last_unstale":"2024-09-19T05:43:50.712406+0000","last_undegraded":"2024-09-19T05:43:50.712406+0000","last_fullsized":"2024-09-19T05:43:50.712406+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:06.029059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711987+0000","last_change":"2024-09-19T05:43:47.831699+0000","last_active":"2024-09-19T05:43:50.711987+0000","last_peered":"2024-09-19T05:43:50.711987+0000","last_clean":"2024-09-19T05:43:50.711987+0000","last_became_active":"2024-09-19T05:43:47.831392+0000","last_became_peered":"2024-09-19T05:43:47.831392+0000","last_unstale":"2024-09-19T05:43:50.711987+0000","last_undegraded":"2024-09-19T05:43:50.711987+0000","last_fullsized":"2024-09-19T05:43:50.711987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:10.190289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712882+0000","last_change":"2024-09-19T05:43:47.831070+0000","last_active":"2024-09-19T05:43:50.712882+0000","last_peered":"2024-09-19T05:43:50.712882+0000","last_clean":"2024-09-19T05:43:50.712882+0000","last_became_active":"2024-09-19T05:43:47.830755+0000","last_became_peered":"2024-09-19T05:43:47.830755+0000","last_unstale":"2024-09-19T05:43:50.712882+0000","last_undegraded":"2024-09-19T05:43:50.712882+0000","last_fullsized":"2024-09-19T05:43:50.712882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:19.588208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.791890+0000","last_change":"2024-09-19T05:43:47.838259+0000","last_active":"2024-09-19T05:43:48.791890+0000","last_peered":"2024-09-19T05:43:48.791890+0000","last_clean":"2024-09-19T05:43:48.791890+0000","last_became_active":"2024-09-19T05:43:47.837959+0000","last_became_peered":"2024-09-19T05:43:47.837959+0000","last_unstale":"2024-09-19T05:43:48.791890+0000","last_undegraded":"2024-09-19T05:43:48.791890+0000","last_fullsized":"2024-09-19T05:43:48.791890+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:44.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711062+0000","last_change":"2024-09-19T05:43:47.833210+0000","last_active":"2024-09-19T05:43:50.711062+0000","last_peered":"2024-09-19T05:43:50.711062+0000","last_clean":"2024-09-19T05:43:50.711062+0000","last_became_active":"2024-09-19T05:43:47.832679+0000","last_became_peered":"2024-09-19T05:43:47.832679+0000","last_unstale":"2024-09-19T05:43:50.711062+0000","last_undegraded":"2024-09-19T05:43:50.711062+0000","last_fullsized":"2024-09-19T05:43:50.711062+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:44.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.792021+0000","last_change":"2024-09-19T05:43:47.799982+0000","last_active":"2024-09-19T05:43:48.792021+0000","last_peered":"2024-09-19T05:43:48.792021+0000","last_clean":"2024-09-19T05:43:48.792021+0000","last_became_active":"2024-09-19T05:43:47.799593+0000","last_became_peered":"2024-09-19T05:43:47.799593+0000","last_unstale":"2024-09-19T05:43:48.792021+0000","last_undegraded":"2024-09-19T05:43:48.792021+0000","last_fullsized":"2024-09-19T05:43:48.792021+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:43.418079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.794389+0000","last_change":"2024-09-19T05:43:47.827991+0000","last_active":"2024-09-19T05:43:49.794389+0000","last_peered":"2024-09-19T05:43:49.794389+0000","last_clean":"2024-09-19T05:43:49.794389+0000","last_became_active":"2024-09-19T05:43:47.827356+0000","last_became_peered":"2024-09-19T05:43:47.827356+0000","last_unstale":"2024-09-19T05:43:49.794389+0000","last_undegraded":"2024-09-19T05:43:49.794389+0000","last_fullsized":"2024-09-19T05:43:49.794389+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:18.499400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713322+0000","last_change":"2024-09-19T05:43:47.829872+0000","last_active":"2024-09-19T05:43:50.713322+0000","last_peered":"2024-09-19T05:43:50.713322+0000","last_clean":"2024-09-19T05:43:50.713322+0000","last_became_active":"2024-09-19T05:43:47.829522+0000","last_became_peered":"2024-09-19T05:43:47.829522+0000","last_unstale":"2024-09-19T05:43:50.713322+0000","last_undegraded":"2024-09-19T05:43:50.713322+0000","last_fullsized":"2024-09-19T05:43:50.713322+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:23.452609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.794405+0000","last_change":"2024-09-19T05:43:47.839933+0000","last_active":"2024-09-19T05:43:49.794405+0000","last_peered":"2024-09-19T05:43:49.794405+0000","last_clean":"2024-09-19T05:43:49.794405+0000","last_became_active":"2024-09-19T05:43:47.839346+0000","last_became_peered":"2024-09-19T05:43:47.839346+0000","last_unstale":"2024-09-19T05:43:49.794405+0000","last_undegraded":"2024-09-19T05:43:49.794405+0000","last_fullsized":"2024-09-19T05:43:49.794405+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:49.783730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712153+0000","last_change":"2024-09-19T05:43:47.834369+0000","last_active":"2024-09-19T05:43:50.712153+0000","last_peered":"2024-09-19T05:43:50.712153+0000","last_clean":"2024-09-19T05:43:50.712153+0000","last_became_active":"2024-09-19T05:43:47.834042+0000","last_became_peered":"2024-09-19T05:43:47.834042+0000","last_unstale":"2024-09-19T05:43:50.712153+0000","last_undegraded":"2024-09-19T05:43:50.712153+0000","last_fullsized":"2024-09-19T05:43:50.712153+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:25.799715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.010816+0000","last_change":"2024-09-19T05:43:47.857694+0000","last_active":"2024-09-19T05:43:49.010816+0000","last_peered":"2024-09-19T05:43:49.010816+0000","last_clean":"2024-09-19T05:43:49.010816+0000","last_became_active":"2024-09-19T05:43:47.852096+0000","last_became_peered":"2024-09-19T05:43:47.852096+0000","last_unstale":"2024-09-19T05:43:49.010816+0000","last_undegraded":"2024-09-19T05:43:49.010816+0000","last_fullsized":"2024-09-19T05:43:49.010816+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:51.232397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.010579+0000","last_change":"2024-09-19T05:43:47.854662+0000","last_active":"2024-09-19T05:43:49.010579+0000","last_peered":"2024-09-19T05:43:49.010579+0000","last_clean":"2024-09-19T05:43:49.010579+0000","last_became_active":"2024-09-19T05:43:47.847109+0000","last_became_peered":"2024-09-19T05:43:47.847109+0000","last_unstale":"2024-09-19T05:43:49.010579+0000","last_undegraded":"2024-09-19T05:43:49.010579+0000","last_fullsized":"2024-09-19T05:43:49.010579+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:08.338643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711254+0000","last_change":"2024-09-19T05:43:47.810499+0000","last_active":"2024-09-19T05:43:50.711254+0000","last_peered":"2024-09-19T05:43:50.711254+0000","last_clean":"2024-09-19T05:43:50.711254+0000","last_became_active":"2024-09-19T05:43:47.806196+0000","last_became_peered":"2024-09-19T05:43:47.806196+0000","last_unstale":"2024-09-19T05:43:50.711254+0000","last_undegraded":"2024-09-19T05:43:50.711254+0000","last_fullsized":"2024-09-19T05:43:50.711254+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:35.061747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713269+0000","last_change":"2024-09-19T05:43:47.816524+0000","last_active":"2024-09-19T05:43:50.713269+0000","last_peered":"2024-09-19T05:43:50.713269+0000","last_clean":"2024-09-19T05:43:50.713269+0000","last_became_active":"2024-09-19T05:43:47.816211+0000","last_became_peered":"2024-09-19T05:43:47.816211+0000","last_unstale":"2024-09-19T05:43:50.713269+0000","last_undegraded":"2024-09-19T05:43:50.713269+0000","last_fullsized":"2024-09-19T05:43:50.713269+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:55.042883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.010354+0000","last_change":"2024-09-19T05:43:47.855125+0000","last_active":"2024-09-19T05:43:49.010354+0000","last_peered":"2024-09-19T05:43:49.010354+0000","last_clean":"2024-09-19T05:43:49.010354+0000","last_became_active":"2024-09-19T05:43:47.854348+0000","last_became_peered":"2024-09-19T05:43:47.854348+0000","last_unstale":"2024-09-19T05:43:49.010354+0000","last_undegraded":"2024-09-19T05:43:49.010354+0000","last_fullsized":"2024-09-19T05:43:49.010354+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:38.043549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.009873+0000","last_change":"2024-09-19T05:43:47.862898+0000","last_active":"2024-09-19T05:43:49.009873+0000","last_peered":"2024-09-19T05:43:49.009873+0000","last_clean":"2024-09-19T05:43:49.009873+0000","last_became_active":"2024-09-19T05:43:47.851982+0000","last_became_peered":"2024-09-19T05:43:47.851982+0000","last_unstale":"2024-09-19T05:43:49.009873+0000","last_undegraded":"2024-09-19T05:43:49.009873+0000","last_fullsized":"2024-09-19T05:43:49.009873+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:21.493824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.789937+0000","last_change":"2024-09-19T05:43:47.829065+0000","last_active":"2024-09-19T05:43:48.789937+0000","last_peered":"2024-09-19T05:43:48.789937+0000","last_clean":"2024-09-19T05:43:48.789937+0000","last_became_active":"2024-09-19T05:43:47.828316+0000","last_became_peered":"2024-09-19T05:43:47.828316+0000","last_unstale":"2024-09-19T05:43:48.789937+0000","last_undegraded":"2024-09-19T05:43:48.789937+0000","last_fullsized":"2024-09-19T05:43:48.789937+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:18.563890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713278+0000","last_change":"2024-09-19T05:43:47.805947+0000","last_active":"2024-09-19T05:43:50.713278+0000","last_peered":"2024-09-19T05:43:50.713278+0000","last_clean":"2024-09-19T05:43:50.713278+0000","last_became_active":"2024-09-19T05:43:47.805630+0000","last_became_peered":"2024-09-19T05:43:47.805630+0000","last_unstale":"2024-09-19T05:43:50.713278+0000","last_undegraded":"2024-09-19T05:43:50.713278+0000","last_fullsized":"2024-09-19T05:43:50.713278+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:16.203670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.789920+0000","last_change":"2024-09-19T05:43:47.824265+0000","last_active":"2024-09-19T05:43:48.789920+0000","last_peered":"2024-09-19T05:43:48.789920+0000","last_clean":"2024-09-19T05:43:48.789920+0000","last_became_active":"2024-09-19T05:43:47.823418+0000","last_became_peered":"2024-09-19T05:43:47.823418+0000","last_unstale":"2024-09-19T05:43:48.789920+0000","last_undegraded":"2024-09-19T05:43:48.789920+0000","last_fullsized":"2024-09-19T05:43:48.789920+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:29.930491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"142'4","reported_seq":18,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.010924+0000","last_change":"2024-09-19T05:43:46.796706+0000","last_active":"2024-09-19T05:43:49.010924+0000","last_peered":"2024-09-19T05:43:49.010924+0000","last_clean":"2024-09-19T05:43:49.010924+0000","last_became_active":"2024-09-19T05:43:46.796008+0000","last_became_peered":"2024-09-19T05:43:46.796008+0000","last_unstale":"2024-09-19T05:43:49.010924+0000","last_undegraded":"2024-09-19T05:43:49.010924+0000","last_fullsized":"2024-09-19T05:43:49.010924+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:28.244883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713309+0000","last_change":"2024-09-19T05:43:47.832401+0000","last_active":"2024-09-19T05:43:50.713309+0000","last_peered":"2024-09-19T05:43:50.713309+0000","last_clean":"2024-09-19T05:43:50.713309+0000","last_became_active":"2024-09-19T05:43:47.832115+0000","last_became_peered":"2024-09-19T05:43:47.832115+0000","last_unstale":"2024-09-19T05:43:50.713309+0000","last_undegraded":"2024-09-19T05:43:50.713309+0000","last_fullsized":"2024-09-19T05:43:50.713309+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:12.147027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.792318+0000","last_change":"2024-09-19T05:43:46.803874+0000","last_active":"2024-09-19T05:43:48.792318+0000","last_peered":"2024-09-19T05:43:48.792318+0000","last_clean":"2024-09-19T05:43:48.792318+0000","last_became_active":"2024-09-19T05:43:46.803453+0000","last_became_peered":"2024-09-19T05:43:46.803453+0000","last_unstale":"2024-09-19T05:43:48.792318+0000","last_undegraded":"2024-09-19T05:43:48.792318+0000","last_fullsized":"2024-09-19T05:43:48.792318+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:14.376324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.794466+0000","last_change":"2024-09-19T05:43:47.826918+0000","last_active":"2024-09-19T05:43:49.794466+0000","last_peered":"2024-09-19T05:43:49.794466+0000","last_clean":"2024-09-19T05:43:49.794466+0000","last_became_active":"2024-09-19T05:43:47.826173+0000","last_became_peered":"2024-09-19T05:43:47.826173+0000","last_unstale":"2024-09-19T05:43:49.794466+0000","last_undegraded":"2024-09-19T05:43:49.794466+0000","last_fullsized":"2024-09-19T05:43:49.794466+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:42.951631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711374+0000","last_change":"2024-09-19T05:43:46.794089+0000","last_active":"2024-09-19T05:43:50.711374+0000","last_peered":"2024-09-19T05:43:50.711374+0000","last_clean":"2024-09-19T05:43:50.711374+0000","last_became_active":"2024-09-19T05:43:46.793490+0000","last_became_peered":"2024-09-19T05:43:46.793490+0000","last_unstale":"2024-09-19T05:43:50.711374+0000","last_undegraded":"2024-09-19T05:43:50.711374+0000","last_fullsized":"2024-09-19T05:43:50.711374+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:09.181248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712625+0000","last_change":"2024-09-19T05:43:47.818752+0000","last_active":"2024-09-19T05:43:50.712625+0000","last_peered":"2024-09-19T05:43:50.712625+0000","last_clean":"2024-09-19T05:43:50.712625+0000","last_became_active":"2024-09-19T05:43:47.818440+0000","last_became_peered":"2024-09-19T05:43:47.818440+0000","last_unstale":"2024-09-19T05:43:50.712625+0000","last_undegraded":"2024-09-19T05:43:50.712625+0000","last_fullsized":"2024-09-19T05:43:50.712625+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:32.278917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711160+0000","last_change":"2024-09-19T05:43:46.801246+0000","last_active":"2024-09-19T05:43:50.711160+0000","last_peered":"2024-09-19T05:43:50.711160+0000","last_clean":"2024-09-19T05:43:50.711160+0000","last_became_active":"2024-09-19T05:43:46.800763+0000","last_became_peered":"2024-09-19T05:43:46.800763+0000","last_unstale":"2024-09-19T05:43:50.711160+0000","last_undegraded":"2024-09-19T05:43:50.711160+0000","last_fullsized":"2024-09-19T05:43:50.711160+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:25.389903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.790706+0000","last_change":"2024-09-19T05:43:47.828728+0000","last_active":"2024-09-19T05:43:48.790706+0000","last_peered":"2024-09-19T05:43:48.790706+0000","last_clean":"2024-09-19T05:43:48.790706+0000","last_became_active":"2024-09-19T05:43:47.828024+0000","last_became_peered":"2024-09-19T05:43:47.828024+0000","last_unstale":"2024-09-19T05:43:48.790706+0000","last_undegraded":"2024-09-19T05:43:48.790706+0000","last_fullsized":"2024-09-19T05:43:48.790706+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:54.675173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.790424+0000","last_change":"2024-09-19T05:43:46.801139+0000","last_active":"2024-09-19T05:43:48.790424+0000","last_peered":"2024-09-19T05:43:48.790424+0000","last_clean":"2024-09-19T05:43:48.790424+0000","last_became_active":"2024-09-19T05:43:46.798867+0000","last_became_peered":"2024-09-19T05:43:46.798867+0000","last_unstale":"2024-09-19T05:43:48.790424+0000","last_undegraded":"2024-09-19T05:43:48.790424+0000","last_fullsized":"2024-09-19T05:43:48.790424+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:07.725004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.790900+0000","last_change":"2024-09-19T05:43:47.816675+0000","last_active":"2024-09-19T05:43:48.790900+0000","last_peered":"2024-09-19T05:43:48.790900+0000","last_clean":"2024-09-19T05:43:48.790900+0000","last_became_active":"2024-09-19T05:43:47.815962+0000","last_became_peered":"2024-09-19T05:43:47.815962+0000","last_unstale":"2024-09-19T05:43:48.790900+0000","last_undegraded":"2024-09-19T05:43:48.790900+0000","last_fullsized":"2024-09-19T05:43:48.790900+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:32.021001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.791616+0000","last_change":"2024-09-19T05:43:46.805047+0000","last_active":"2024-09-19T05:43:48.791616+0000","last_peered":"2024-09-19T05:43:48.791616+0000","last_clean":"2024-09-19T05:43:48.791616+0000","last_became_active":"2024-09-19T05:43:46.804641+0000","last_became_peered":"2024-09-19T05:43:46.804641+0000","last_unstale":"2024-09-19T05:43:48.791616+0000","last_undegraded":"2024-09-19T05:43:48.791616+0000","last_fullsized":"2024-09-19T05:43:48.791616+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:51.106394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.792175+0000","last_change":"2024-09-19T05:43:47.799954+0000","last_active":"2024-09-19T05:43:48.792175+0000","last_peered":"2024-09-19T05:43:48.792175+0000","last_clean":"2024-09-19T05:43:48.792175+0000","last_became_active":"2024-09-19T05:43:47.799494+0000","last_became_peered":"2024-09-19T05:43:47.799494+0000","last_unstale":"2024-09-19T05:43:48.792175+0000","last_undegraded":"2024-09-19T05:43:48.792175+0000","last_fullsized":"2024-09-19T05:43:48.792175+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:00.310791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712424+0000","last_change":"2024-09-19T05:43:46.790512+0000","last_active":"2024-09-19T05:43:50.712424+0000","last_peered":"2024-09-19T05:43:50.712424+0000","last_clean":"2024-09-19T05:43:50.712424+0000","last_became_active":"2024-09-19T05:43:46.790026+0000","last_became_peered":"2024-09-19T05:43:46.790026+0000","last_unstale":"2024-09-19T05:43:50.712424+0000","last_undegraded":"2024-09-19T05:43:50.712424+0000","last_fullsized":"2024-09-19T05:43:50.712424+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:01.908949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711666+0000","last_change":"2024-09-19T05:43:47.806766+0000","last_active":"2024-09-19T05:43:50.711666+0000","last_peered":"2024-09-19T05:43:50.711666+0000","last_clean":"2024-09-19T05:43:50.711666+0000","last_became_active":"2024-09-19T05:43:47.806038+0000","last_became_peered":"2024-09-19T05:43:47.806038+0000","last_unstale":"2024-09-19T05:43:50.711666+0000","last_undegraded":"2024-09-19T05:43:50.711666+0000","last_fullsized":"2024-09-19T05:43:50.711666+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:00.310791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.009675+0000","last_change":"2024-09-19T05:43:46.805617+0000","last_active":"2024-09-19T05:43:49.009675+0000","last_peered":"2024-09-19T05:43:49.009675+0000","last_clean":"2024-09-19T05:43:49.009675+0000","last_became_active":"2024-09-19T05:43:46.805192+0000","last_became_peered":"2024-09-19T05:43:46.805192+0000","last_unstale":"2024-09-19T05:43:49.009675+0000","last_undegraded":"2024-09-19T05:43:49.009675+0000","last_fullsized":"2024-09-19T05:43:49.009675+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:10.750689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712171+0000","last_change":"2024-09-19T05:43:47.863209+0000","last_active":"2024-09-19T05:43:50.712171+0000","last_peered":"2024-09-19T05:43:50.712171+0000","last_clean":"2024-09-19T05:43:50.712171+0000","last_became_active":"2024-09-19T05:43:47.862827+0000","last_became_peered":"2024-09-19T05:43:47.862827+0000","last_unstale":"2024-09-19T05:43:50.712171+0000","last_undegraded":"2024-09-19T05:43:50.712171+0000","last_fullsized":"2024-09-19T05:43:50.712171+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:26.098805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.794927+0000","last_change":"2024-09-19T05:43:46.801306+0000","last_active":"2024-09-19T05:43:49.794927+0000","last_peered":"2024-09-19T05:43:49.794927+0000","last_clean":"2024-09-19T05:43:49.794927+0000","last_became_active":"2024-09-19T05:43:46.800754+0000","last_became_peered":"2024-09-19T05:43:46.800754+0000","last_unstale":"2024-09-19T05:43:49.794927+0000","last_undegraded":"2024-09-19T05:43:49.794927+0000","last_fullsized":"2024-09-19T05:43:49.794927+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:00.905924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712557+0000","last_change":"2024-09-19T05:43:47.806616+0000","last_active":"2024-09-19T05:43:50.712557+0000","last_peered":"2024-09-19T05:43:50.712557+0000","last_clean":"2024-09-19T05:43:50.712557+0000","last_became_active":"2024-09-19T05:43:47.805946+0000","last_became_peered":"2024-09-19T05:43:47.805946+0000","last_unstale":"2024-09-19T05:43:50.712557+0000","last_undegraded":"2024-09-19T05:43:50.712557+0000","last_fullsized":"2024-09-19T05:43:50.712557+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:47.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712234+0000","last_change":"2024-09-19T05:43:46.792317+0000","last_active":"2024-09-19T05:43:50.712234+0000","last_peered":"2024-09-19T05:43:50.712234+0000","last_clean":"2024-09-19T05:43:50.712234+0000","last_became_active":"2024-09-19T05:43:46.791902+0000","last_became_peered":"2024-09-19T05:43:46.791902+0000","last_unstale":"2024-09-19T05:43:50.712234+0000","last_undegraded":"2024-09-19T05:43:50.712234+0000","last_fullsized":"2024-09-19T05:43:50.712234+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:44:56.135213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.009915+0000","last_change":"2024-09-19T05:43:47.864035+0000","last_active":"2024-09-19T05:43:49.009915+0000","last_peered":"2024-09-19T05:43:49.009915+0000","last_clean":"2024-09-19T05:43:49.009915+0000","last_became_active":"2024-09-19T05:43:47.859075+0000","last_became_peered":"2024-09-19T05:43:47.859075+0000","last_unstale":"2024-09-19T05:43:49.009915+0000","last_undegraded":"2024-09-19T05:43:49.009915+0000","last_fullsized":"2024-09-19T05:43:49.009915+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:02.917990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"142'3","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711526+0000","last_change":"2024-09-19T05:43:46.796419+0000","last_active":"2024-09-19T05:43:50.711526+0000","last_peered":"2024-09-19T05:43:50.711526+0000","last_clean":"2024-09-19T05:43:50.711526+0000","last_became_active":"2024-09-19T05:43:46.795811+0000","last_became_peered":"2024-09-19T05:43:46.795811+0000","last_unstale":"2024-09-19T05:43:50.711526+0000","last_undegraded":"2024-09-19T05:43:50.711526+0000","last_fullsized":"2024-09-19T05:43:50.711526+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:16:31.888923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.010480+0000","last_change":"2024-09-19T05:43:47.842052+0000","last_active":"2024-09-19T05:43:49.010480+0000","last_peered":"2024-09-19T05:43:49.010480+0000","last_clean":"2024-09-19T05:43:49.010480+0000","last_became_active":"2024-09-19T05:43:47.841062+0000","last_became_peered":"2024-09-19T05:43:47.841062+0000","last_unstale":"2024-09-19T05:43:49.010480+0000","last_undegraded":"2024-09-19T05:43:49.010480+0000","last_fullsized":"2024-09-19T05:43:49.010480+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:04.761859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"142'6","reported_seq":20,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711426+0000","last_change":"2024-09-19T05:43:46.803323+0000","last_active":"2024-09-19T05:43:50.711426+0000","last_peered":"2024-09-19T05:43:50.711426+0000","last_clean":"2024-09-19T05:43:50.711426+0000","last_became_active":"2024-09-19T05:43:46.803032+0000","last_became_peered":"2024-09-19T05:43:46.803032+0000","last_unstale":"2024-09-19T05:43:50.711426+0000","last_undegraded":"2024-09-19T05:43:50.711426+0000","last_fullsized":"2024-09-19T05:43:50.711426+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:14.868312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713735+0000","last_change":"2024-09-19T05:43:47.817278+0000","last_active":"2024-09-19T05:43:50.713735+0000","last_peered":"2024-09-19T05:43:50.713735+0000","last_clean":"2024-09-19T05:43:50.713735+0000","last_became_active":"2024-09-19T05:43:47.816971+0000","last_became_peered":"2024-09-19T05:43:47.816971+0000","last_unstale":"2024-09-19T05:43:50.713735+0000","last_undegraded":"2024-09-19T05:43:50.713735+0000","last_fullsized":"2024-09-19T05:43:50.713735+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:32.270129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712733+0000","last_change":"2024-09-19T05:43:46.799385+0000","last_active":"2024-09-19T05:43:50.712733+0000","last_peered":"2024-09-19T05:43:50.712733+0000","last_clean":"2024-09-19T05:43:50.712733+0000","last_became_active":"2024-09-19T05:43:46.797943+0000","last_became_peered":"2024-09-19T05:43:46.797943+0000","last_unstale":"2024-09-19T05:43:50.712733+0000","last_undegraded":"2024-09-19T05:43:50.712733+0000","last_fullsized":"2024-09-19T05:43:50.712733+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:09.350203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711393+0000","last_change":"2024-09-19T05:43:47.843730+0000","last_active":"2024-09-19T05:43:50.711393+0000","last_peered":"2024-09-19T05:43:50.711393+0000","last_clean":"2024-09-19T05:43:50.711393+0000","last_became_active":"2024-09-19T05:43:47.843176+0000","last_became_peered":"2024-09-19T05:43:47.843176+0000","last_unstale":"2024-09-19T05:43:50.711393+0000","last_undegraded":"2024-09-19T05:43:50.711393+0000","last_fullsized":"2024-09-19T05:43:50.711393+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:43.418079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.009612+0000","last_change":"2024-09-19T05:43:46.804287+0000","last_active":"2024-09-19T05:43:49.009612+0000","last_peered":"2024-09-19T05:43:49.009612+0000","last_clean":"2024-09-19T05:43:49.009612+0000","last_became_active":"2024-09-19T05:43:46.803954+0000","last_became_peered":"2024-09-19T05:43:46.803954+0000","last_unstale":"2024-09-19T05:43:49.009612+0000","last_undegraded":"2024-09-19T05:43:49.009612+0000","last_fullsized":"2024-09-19T05:43:49.009612+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:01.366908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.792361+0000","last_change":"2024-09-19T05:43:47.820735+0000","last_active":"2024-09-19T05:43:48.792361+0000","last_peered":"2024-09-19T05:43:48.792361+0000","last_clean":"2024-09-19T05:43:48.792361+0000","last_became_active":"2024-09-19T05:43:47.819813+0000","last_became_peered":"2024-09-19T05:43:47.819813+0000","last_unstale":"2024-09-19T05:43:48.792361+0000","last_undegraded":"2024-09-19T05:43:48.792361+0000","last_fullsized":"2024-09-19T05:43:48.792361+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:51:19.009241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"142'8","reported_seq":22,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712184+0000","last_change":"2024-09-19T05:43:46.797549+0000","last_active":"2024-09-19T05:43:50.712184+0000","last_peered":"2024-09-19T05:43:50.712184+0000","last_clean":"2024-09-19T05:43:50.712184+0000","last_became_active":"2024-09-19T05:43:46.797153+0000","last_became_peered":"2024-09-19T05:43:46.797153+0000","last_unstale":"2024-09-19T05:43:50.712184+0000","last_undegraded":"2024-09-19T05:43:50.712184+0000","last_fullsized":"2024-09-19T05:43:50.712184+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:05.941865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.009593+0000","last_change":"2024-09-19T05:43:47.859160+0000","last_active":"2024-09-19T05:43:49.009593+0000","last_peered":"2024-09-19T05:43:49.009593+0000","last_clean":"2024-09-19T05:43:49.009593+0000","last_became_active":"2024-09-19T05:43:47.858375+0000","last_became_peered":"2024-09-19T05:43:47.858375+0000","last_unstale":"2024-09-19T05:43:49.009593+0000","last_undegraded":"2024-09-19T05:43:49.009593+0000","last_fullsized":"2024-09-19T05:43:49.009593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:24.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.794975+0000","last_change":"2024-09-19T05:43:46.800003+0000","last_active":"2024-09-19T05:43:49.794975+0000","last_peered":"2024-09-19T05:43:49.794975+0000","last_clean":"2024-09-19T05:43:49.794975+0000","last_became_active":"2024-09-19T05:43:46.799092+0000","last_became_peered":"2024-09-19T05:43:46.799092+0000","last_unstale":"2024-09-19T05:43:49.794975+0000","last_undegraded":"2024-09-19T05:43:49.794975+0000","last_fullsized":"2024-09-19T05:43:49.794975+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:41.231900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.710684+0000","last_change":"2024-09-19T05:43:47.814645+0000","last_active":"2024-09-19T05:43:50.710684+0000","last_peered":"2024-09-19T05:43:50.710684+0000","last_clean":"2024-09-19T05:43:50.710684+0000","last_became_active":"2024-09-19T05:43:47.804394+0000","last_became_peered":"2024-09-19T05:43:47.804394+0000","last_unstale":"2024-09-19T05:43:50.710684+0000","last_undegraded":"2024-09-19T05:43:50.710684+0000","last_fullsized":"2024-09-19T05:43:50.710684+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:08.690778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.010513+0000","last_change":"2024-09-19T05:43:46.795206+0000","last_active":"2024-09-19T05:43:49.010513+0000","last_peered":"2024-09-19T05:43:49.010513+0000","last_clean":"2024-09-19T05:43:49.010513+0000","last_became_active":"2024-09-19T05:43:46.794855+0000","last_became_peered":"2024-09-19T05:43:46.794855+0000","last_unstale":"2024-09-19T05:43:49.010513+0000","last_undegraded":"2024-09-19T05:43:49.010513+0000","last_fullsized":"2024-09-19T05:43:49.010513+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:49.506471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711779+0000","last_change":"2024-09-19T05:43:47.803942+0000","last_active":"2024-09-19T05:43:50.711779+0000","last_peered":"2024-09-19T05:43:50.711779+0000","last_clean":"2024-09-19T05:43:50.711779+0000","last_became_active":"2024-09-19T05:43:47.801700+0000","last_became_peered":"2024-09-19T05:43:47.801700+0000","last_unstale":"2024-09-19T05:43:50.711779+0000","last_undegraded":"2024-09-19T05:43:50.711779+0000","last_fullsized":"2024-09-19T05:43:50.711779+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:38.904596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712821+0000","last_change":"2024-09-19T05:43:46.790169+0000","last_active":"2024-09-19T05:43:50.712821+0000","last_peered":"2024-09-19T05:43:50.712821+0000","last_clean":"2024-09-19T05:43:50.712821+0000","last_became_active":"2024-09-19T05:43:46.789867+0000","last_became_peered":"2024-09-19T05:43:46.789867+0000","last_unstale":"2024-09-19T05:43:50.712821+0000","last_undegraded":"2024-09-19T05:43:50.712821+0000","last_fullsized":"2024-09-19T05:43:50.712821+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:20.484783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713448+0000","last_change":"2024-09-19T05:43:47.851444+0000","last_active":"2024-09-19T05:43:50.713448+0000","last_peered":"2024-09-19T05:43:50.713448+0000","last_clean":"2024-09-19T05:43:50.713448+0000","last_became_active":"2024-09-19T05:43:47.851126+0000","last_became_peered":"2024-09-19T05:43:47.851126+0000","last_unstale":"2024-09-19T05:43:50.713448+0000","last_undegraded":"2024-09-19T05:43:50.713448+0000","last_fullsized":"2024-09-19T05:43:50.713448+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:43.872759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.792170+0000","last_change":"2024-09-19T05:43:46.804003+0000","last_active":"2024-09-19T05:43:48.792170+0000","last_peered":"2024-09-19T05:43:48.792170+0000","last_clean":"2024-09-19T05:43:48.792170+0000","last_became_active":"2024-09-19T05:43:46.799507+0000","last_became_peered":"2024-09-19T05:43:46.799507+0000","last_unstale":"2024-09-19T05:43:48.792170+0000","last_undegraded":"2024-09-19T05:43:48.792170+0000","last_fullsized":"2024-09-19T05:43:48.792170+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:46.781820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.792313+0000","last_change":"2024-09-19T05:43:47.820322+0000","last_active":"2024-09-19T05:43:48.792313+0000","last_peered":"2024-09-19T05:43:48.792313+0000","last_clean":"2024-09-19T05:43:48.792313+0000","last_became_active":"2024-09-19T05:43:47.820013+0000","last_became_peered":"2024-09-19T05:43:47.820013+0000","last_unstale":"2024-09-19T05:43:48.792313+0000","last_undegraded":"2024-09-19T05:43:48.792313+0000","last_fullsized":"2024-09-19T05:43:48.792313+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:34.695085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.790505+0000","last_change":"2024-09-19T05:43:46.801154+0000","last_active":"2024-09-19T05:43:48.790505+0000","last_peered":"2024-09-19T05:43:48.790505+0000","last_clean":"2024-09-19T05:43:48.790505+0000","last_became_active":"2024-09-19T05:43:46.798367+0000","last_became_peered":"2024-09-19T05:43:46.798367+0000","last_unstale":"2024-09-19T05:43:48.790505+0000","last_undegraded":"2024-09-19T05:43:48.790505+0000","last_fullsized":"2024-09-19T05:43:48.790505+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:40.070418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713062+0000","last_change":"2024-09-19T05:43:47.823441+0000","last_active":"2024-09-19T05:43:50.713062+0000","last_peered":"2024-09-19T05:43:50.713062+0000","last_clean":"2024-09-19T05:43:50.713062+0000","last_became_active":"2024-09-19T05:43:47.822810+0000","last_became_peered":"2024-09-19T05:43:47.822810+0000","last_unstale":"2024-09-19T05:43:50.713062+0000","last_undegraded":"2024-09-19T05:43:50.713062+0000","last_fullsized":"2024-09-19T05:43:50.713062+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:50.446800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713486+0000","last_change":"2024-09-19T05:43:46.805429+0000","last_active":"2024-09-19T05:43:50.713486+0000","last_peered":"2024-09-19T05:43:50.713486+0000","last_clean":"2024-09-19T05:43:50.713486+0000","last_became_active":"2024-09-19T05:43:46.805016+0000","last_became_peered":"2024-09-19T05:43:46.805016+0000","last_unstale":"2024-09-19T05:43:50.713486+0000","last_undegraded":"2024-09-19T05:43:50.713486+0000","last_fullsized":"2024-09-19T05:43:50.713486+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:00.430339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.792364+0000","last_change":"2024-09-19T05:43:47.866495+0000","last_active":"2024-09-19T05:43:48.792364+0000","last_peered":"2024-09-19T05:43:48.792364+0000","last_clean":"2024-09-19T05:43:48.792364+0000","last_became_active":"2024-09-19T05:43:47.866253+0000","last_became_peered":"2024-09-19T05:43:47.866253+0000","last_unstale":"2024-09-19T05:43:48.792364+0000","last_undegraded":"2024-09-19T05:43:48.792364+0000","last_fullsized":"2024-09-19T05:43:48.792364+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:56.899952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711007+0000","last_change":"2024-09-19T05:43:46.796046+0000","last_active":"2024-09-19T05:43:50.711007+0000","last_peered":"2024-09-19T05:43:50.711007+0000","last_clean":"2024-09-19T05:43:50.711007+0000","last_became_active":"2024-09-19T05:43:46.795486+0000","last_became_peered":"2024-09-19T05:43:46.795486+0000","last_unstale":"2024-09-19T05:43:50.711007+0000","last_undegraded":"2024-09-19T05:43:50.711007+0000","last_fullsized":"2024-09-19T05:43:50.711007+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:51.106394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.794817+0000","last_change":"2024-09-19T05:43:47.861200+0000","last_active":"2024-09-19T05:43:49.794817+0000","last_peered":"2024-09-19T05:43:49.794817+0000","last_clean":"2024-09-19T05:43:49.794817+0000","last_became_active":"2024-09-19T05:43:47.860399+0000","last_became_peered":"2024-09-19T05:43:47.860399+0000","last_unstale":"2024-09-19T05:43:49.794817+0000","last_undegraded":"2024-09-19T05:43:49.794817+0000","last_fullsized":"2024-09-19T05:43:49.794817+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:54.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712240+0000","last_change":"2024-09-19T05:43:46.793209+0000","last_active":"2024-09-19T05:43:50.712240+0000","last_peered":"2024-09-19T05:43:50.712240+0000","last_clean":"2024-09-19T05:43:50.712240+0000","last_became_active":"2024-09-19T05:43:46.792865+0000","last_became_peered":"2024-09-19T05:43:46.792865+0000","last_unstale":"2024-09-19T05:43:50.712240+0000","last_undegraded":"2024-09-19T05:43:50.712240+0000","last_fullsized":"2024-09-19T05:43:50.712240+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:45.868966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.792315+0000","last_change":"2024-09-19T05:43:47.799808+0000","last_active":"2024-09-19T05:43:48.792315+0000","last_peered":"2024-09-19T05:43:48.792315+0000","last_clean":"2024-09-19T05:43:48.792315+0000","last_became_active":"2024-09-19T05:43:47.799507+0000","last_became_peered":"2024-09-19T05:43:47.799507+0000","last_unstale":"2024-09-19T05:43:48.792315+0000","last_undegraded":"2024-09-19T05:43:48.792315+0000","last_fullsized":"2024-09-19T05:43:48.792315+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:38.904596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712947+0000","last_change":"2024-09-19T05:43:46.799401+0000","last_active":"2024-09-19T05:43:50.712947+0000","last_peered":"2024-09-19T05:43:50.712947+0000","last_clean":"2024-09-19T05:43:50.712947+0000","last_became_active":"2024-09-19T05:43:46.797931+0000","last_became_peered":"2024-09-19T05:43:46.797931+0000","last_unstale":"2024-09-19T05:43:50.712947+0000","last_undegraded":"2024-09-19T05:43:50.712947+0000","last_fullsized":"2024-09-19T05:43:50.712947+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:20.680015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.009567+0000","last_change":"2024-09-19T05:43:47.857927+0000","last_active":"2024-09-19T05:43:49.009567+0000","last_peered":"2024-09-19T05:43:49.009567+0000","last_clean":"2024-09-19T05:43:49.009567+0000","last_became_active":"2024-09-19T05:43:47.853359+0000","last_became_peered":"2024-09-19T05:43:47.853359+0000","last_unstale":"2024-09-19T05:43:49.009567+0000","last_undegraded":"2024-09-19T05:43:49.009567+0000","last_fullsized":"2024-09-19T05:43:49.009567+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:46.878007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"143'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.791030+0000","last_change":"2024-09-19T05:43:46.803632+0000","last_active":"2024-09-19T05:43:48.791030+0000","last_peered":"2024-09-19T05:43:48.791030+0000","last_clean":"2024-09-19T05:43:48.791030+0000","last_became_active":"2024-09-19T05:43:46.803191+0000","last_became_peered":"2024-09-19T05:43:46.803191+0000","last_unstale":"2024-09-19T05:43:48.791030+0000","last_undegraded":"2024-09-19T05:43:48.791030+0000","last_fullsized":"2024-09-19T05:43:48.791030+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:10.750689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.710674+0000","last_change":"2024-09-19T05:43:47.849252+0000","last_active":"2024-09-19T05:43:50.710674+0000","last_peered":"2024-09-19T05:43:50.710674+0000","last_clean":"2024-09-19T05:43:50.710674+0000","last_became_active":"2024-09-19T05:43:47.848826+0000","last_became_peered":"2024-09-19T05:43:47.848826+0000","last_unstale":"2024-09-19T05:43:50.710674+0000","last_undegraded":"2024-09-19T05:43:50.710674+0000","last_fullsized":"2024-09-19T05:43:50.710674+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:56.831020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.791169+0000","last_change":"2024-09-19T05:43:46.797969+0000","last_active":"2024-09-19T05:43:48.791169+0000","last_peered":"2024-09-19T05:43:48.791169+0000","last_clean":"2024-09-19T05:43:48.791169+0000","last_became_active":"2024-09-19T05:43:46.797489+0000","last_became_peered":"2024-09-19T05:43:46.797489+0000","last_unstale":"2024-09-19T05:43:48.791169+0000","last_undegraded":"2024-09-19T05:43:48.791169+0000","last_fullsized":"2024-09-19T05:43:48.791169+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:23.480515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713525+0000","last_change":"2024-09-19T05:43:47.831302+0000","last_active":"2024-09-19T05:43:50.713525+0000","last_peered":"2024-09-19T05:43:50.713525+0000","last_clean":"2024-09-19T05:43:50.713525+0000","last_became_active":"2024-09-19T05:43:47.831074+0000","last_became_peered":"2024-09-19T05:43:47.831074+0000","last_unstale":"2024-09-19T05:43:50.713525+0000","last_undegraded":"2024-09-19T05:43:50.713525+0000","last_fullsized":"2024-09-19T05:43:50.713525+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:01.642528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712405+0000","last_change":"2024-09-19T05:43:46.792214+0000","last_active":"2024-09-19T05:43:50.712405+0000","last_peered":"2024-09-19T05:43:50.712405+0000","last_clean":"2024-09-19T05:43:50.712405+0000","last_became_active":"2024-09-19T05:43:46.791792+0000","last_became_peered":"2024-09-19T05:43:46.791792+0000","last_unstale":"2024-09-19T05:43:50.712405+0000","last_undegraded":"2024-09-19T05:43:50.712405+0000","last_fullsized":"2024-09-19T05:43:50.712405+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:23.988229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712282+0000","last_change":"2024-09-19T05:43:47.825837+0000","last_active":"2024-09-19T05:43:50.712282+0000","last_peered":"2024-09-19T05:43:50.712282+0000","last_clean":"2024-09-19T05:43:50.712282+0000","last_became_active":"2024-09-19T05:43:47.825347+0000","last_became_peered":"2024-09-19T05:43:47.825347+0000","last_unstale":"2024-09-19T05:43:50.712282+0000","last_undegraded":"2024-09-19T05:43:50.712282+0000","last_fullsized":"2024-09-19T05:43:50.712282+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:15.385365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.794357+0000","last_change":"2024-09-19T05:43:46.790954+0000","last_active":"2024-09-19T05:43:49.794357+0000","last_peered":"2024-09-19T05:43:49.794357+0000","last_clean":"2024-09-19T05:43:49.794357+0000","last_became_active":"2024-09-19T05:43:46.790304+0000","last_became_peered":"2024-09-19T05:43:46.790304+0000","last_unstale":"2024-09-19T05:43:49.794357+0000","last_undegraded":"2024-09-19T05:43:49.794357+0000","last_fullsized":"2024-09-19T05:43:49.794357+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:37.590881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712720+0000","last_change":"2024-09-19T05:43:47.825231+0000","last_active":"2024-09-19T05:43:50.712720+0000","last_peered":"2024-09-19T05:43:50.712720+0000","last_clean":"2024-09-19T05:43:50.712720+0000","last_became_active":"2024-09-19T05:43:47.824694+0000","last_became_peered":"2024-09-19T05:43:47.824694+0000","last_unstale":"2024-09-19T05:43:50.712720+0000","last_undegraded":"2024-09-19T05:43:50.712720+0000","last_fullsized":"2024-09-19T05:43:50.712720+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:53.366168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711946+0000","last_change":"2024-09-19T05:43:46.802290+0000","last_active":"2024-09-19T05:43:50.711946+0000","last_peered":"2024-09-19T05:43:50.711946+0000","last_clean":"2024-09-19T05:43:50.711946+0000","last_became_active":"2024-09-19T05:43:46.802005+0000","last_became_peered":"2024-09-19T05:43:46.802005+0000","last_unstale":"2024-09-19T05:43:50.711946+0000","last_undegraded":"2024-09-19T05:43:50.711946+0000","last_fullsized":"2024-09-19T05:43:50.711946+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:47.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.713000+0000","last_change":"2024-09-19T05:43:47.823767+0000","last_active":"2024-09-19T05:43:50.713000+0000","last_peered":"2024-09-19T05:43:50.713000+0000","last_clean":"2024-09-19T05:43:50.713000+0000","last_became_active":"2024-09-19T05:43:47.813595+0000","last_became_peered":"2024-09-19T05:43:47.813595+0000","last_unstale":"2024-09-19T05:43:50.713000+0000","last_undegraded":"2024-09-19T05:43:50.713000+0000","last_fullsized":"2024-09-19T05:43:50.713000+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:03.251897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.712656+0000","last_change":"2024-09-19T05:43:46.791368+0000","last_active":"2024-09-19T05:43:50.712656+0000","last_peered":"2024-09-19T05:43:50.712656+0000","last_clean":"2024-09-19T05:43:50.712656+0000","last_became_active":"2024-09-19T05:43:46.791101+0000","last_became_peered":"2024-09-19T05:43:46.791101+0000","last_unstale":"2024-09-19T05:43:50.712656+0000","last_undegraded":"2024-09-19T05:43:50.712656+0000","last_fullsized":"2024-09-19T05:43:50.712656+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:49.600351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.711843+0000","last_change":"2024-09-19T05:43:47.843205+0000","last_active":"2024-09-19T05:43:50.711843+0000","last_peered":"2024-09-19T05:43:50.711843+0000","last_clean":"2024-09-19T05:43:50.711843+0000","last_became_active":"2024-09-19T05:43:47.842478+0000","last_became_peered":"2024-09-19T05:43:47.842478+0000","last_unstale":"2024-09-19T05:43:50.711843+0000","last_undegraded":"2024-09-19T05:43:50.711843+0000","last_fullsized":"2024-09-19T05:43:50.711843+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:34.695085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:48.791814+0000","last_change":"2024-09-19T05:43:46.803154+0000","last_active":"2024-09-19T05:43:48.791814+0000","last_peered":"2024-09-19T05:43:48.791814+0000","last_clean":"2024-09-19T05:43:48.791814+0000","last_became_active":"2024-09-19T05:43:46.802771+0000","last_became_peered":"2024-09-19T05:43:46.802771+0000","last_unstale":"2024-09-19T05:43:48.791814+0000","last_undegraded":"2024-09-19T05:43:48.791814+0000","last_fullsized":"2024-09-19T05:43:48.791814+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:24.790674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:49.010399+0000","last_change":"2024-09-19T05:43:47.848204+0000","last_active":"2024-09-19T05:43:49.010399+0000","last_peered":"2024-09-19T05:43:49.010399+0000","last_clean":"2024-09-19T05:43:49.010399+0000","last_became_active":"2024-09-19T05:43:47.847693+0000","last_became_peered":"2024-09-19T05:43:47.847693+0000","last_unstale":"2024-09-19T05:43:49.010399+0000","last_undegraded":"2024-09-19T05:43:49.010399+0000","last_fullsized":"2024-09-19T05:43:49.010399+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:46.766523+0000","last_clean_scrub_stamp":"2024-09-19T05:43:46.766523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:05.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.710809+0000","last_change":"2024-09-19T05:43:46.798297+0000","last_active":"2024-09-19T05:43:50.710809+0000","last_peered":"2024-09-19T05:43:50.710809+0000","last_clean":"2024-09-19T05:43:50.710809+0000","last_became_active":"2024-09-19T05:43:46.797990+0000","last_became_peered":"2024-09-19T05:43:46.797990+0000","last_unstale":"2024-09-19T05:43:50.710809+0000","last_undegraded":"2024-09-19T05:43:50.710809+0000","last_fullsized":"2024-09-19T05:43:50.710809+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:43:45.757482+0000","last_clean_scrub_stamp":"2024-09-19T05:43:45.757482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:06.895736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":392,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-19T05:43:50.710367+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:43:50.710367+0000","last_peered":"2024-09-19T05:43:50.710367+0000","last_clean":"2024-09-19T05:43:50.710367+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:43:50.710367+0000","last_undegraded":"2024-09-19T05:43:50.710367+0000","last_fullsized":"2024-09-19T05:43:50.710367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542276,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65460,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306380,"statfs":{"total":96636764160,"available":96569733120,"internally_reserved":0,"allocated":2392064,"data_stored":1433201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542276,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64876,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306964,"statfs":{"total":96636764160,"available":96570331136,"internally_reserved":0,"allocated":1789952,"data_stored":841803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542278,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59304,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312536,"statfs":{"total":96636764160,"available":96576036864,"internally_reserved":0,"allocated":1785856,"data_stored":841153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542276,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69032,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302808,"statfs":{"total":96636764160,"available":96566075392,"internally_reserved":0,"allocated":1781760,"data_stored":841131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542277,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63472,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308368,"statfs":{"total":96636764160,"available":96571768832,"internally_reserved":0,"allocated":1798144,"data_stored":842813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542277,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69032,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302808,"statfs":{"total":96636764160,"available":96566075392,"internally_reserved":0,"allocated":1789952,"data_stored":841747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542279,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55140,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316700,"statfs":{"total":96636764160,"available":96580300800,"internally_reserved":0,"allocated":1785856,"data_stored":841201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542276,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73772,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298068,"statfs":{"total":96636764160,"available":96561221632,"internally_reserved":0,"allocated":2383872,"data_stored":1431555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:43:55.750 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:43:55.750 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:43:55.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.917+0000 7fb3a97c7640 1 Processor -- start 2024-09-19T05:43:55.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.917+0000 7fb3a97c7640 1 -- start start 2024-09-19T05:43:55.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.917+0000 7fb3a97c7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3a415b1d0 0x7fb3a40adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb3a4070070 0x7fb3a40b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a40aef30 con 0x7fb3a406dfc0 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a4072210 con 0x7fb3a415b1d0 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a40ae0f0 con 0x7fb3a4070070 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a2ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3a415b1d0 0x7fb3a40adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a2ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3a415b1d0 0x7fb3a40adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38208/0 (socket says 172.21.15.67:38208) 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a2ffd640 1 -- 172.21.15.67:0/3296151313 learned_addr learned my addr 172.21.15.67:0/3296151313 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a37fe640 1 --2- 172.21.15.67:0/3296151313 >> v2:172.21.15.97:3300/0 conn(0x7fb3a4070070 0x7fb3a40b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a2ffd640 1 -- 172.21.15.67:0/3296151313 >> v2:172.21.15.97:3300/0 conn(0x7fb3a4070070 msgr2=0x7fb3a40b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a2ffd640 1 --2- 172.21.15.67:0/3296151313 >> v2:172.21.15.97:3300/0 conn(0x7fb3a4070070 0x7fb3a40b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a2ffd640 1 -- 172.21.15.67:0/3296151313 >> v1:172.21.15.97:6789/0 conn(0x7fb3a406dfc0 legacy=0x7fb3a406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a2ffd640 1 -- 172.21.15.67:0/3296151313 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a40ae3b0 con 0x7fb3a415b1d0 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a2ffd640 1 --2- 172.21.15.67:0/3296151313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 0x7fb3a40adbb0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40b52f0 tx=0x7fb38c01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e691321af2b65ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a27fc640 1 -- 172.21.15.67:0/3296151313 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0b4070 con 0x7fb3a415b1d0 2024-09-19T05:43:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a27fc640 1 -- 172.21.15.67:0/3296151313 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb38c0a7b70 con 0x7fb3a415b1d0 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a27fc640 1 -- 172.21.15.67:0/3296151313 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0af440 con 0x7fb3a415b1d0 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 -- 172.21.15.67:0/3296151313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 msgr2=0x7fb3a40adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 --2- 172.21.15.67:0/3296151313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 0x7fb3a40adbb0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40b52f0 tx=0x7fb38c01ebb0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 -- 172.21.15.67:0/3296151313 shutdown_connections 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 --2- 172.21.15.67:0/3296151313 >> v2:172.21.15.97:3300/0 conn(0x7fb3a4070070 0x7fb3a40b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 --2- 172.21.15.67:0/3296151313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 0x7fb3a40adbb0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 -- 172.21.15.67:0/3296151313 >> 172.21.15.67:0/3296151313 conn(0x7fb3a40b1e50 msgr2=0x7fb3a40b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 -- 172.21.15.67:0/3296151313 shutdown_connections 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.921+0000 7fb3a97c7640 1 -- 172.21.15.67:0/3296151313 wait complete. 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 Processor -- start 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 -- start start 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a406dfc0 0x7fb3a41538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3a4070070 0x7fb3a409db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 0x7fb3a40730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40b4180 con 0x7fb3a415b1d0 2024-09-19T05:43:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a4072420 con 0x7fb3a406dfc0 2024-09-19T05:43:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a40b4300 con 0x7fb3a4070070 2024-09-19T05:43:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 0x7fb3a40730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 0x7fb3a40730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38218/0 (socket says 172.21.15.67:38218) 2024-09-19T05:43:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a37fe640 1 -- 172.21.15.67:0/755347678 learned_addr learned my addr 172.21.15.67:0/755347678 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a2ffd640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a406dfc0 0x7fb3a41538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb39bfff640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3a4070070 0x7fb3a409db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a37fe640 1 -- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3a4070070 msgr2=0x7fb3a409db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a37fe640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3a4070070 0x7fb3a409db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a37fe640 1 -- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a406dfc0 msgr2=0x7fb3a41538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a37fe640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a406dfc0 0x7fb3a41538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a37fe640 1 -- 172.21.15.67:0/755347678 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a409cf70 con 0x7fb3a415b1d0 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a2ffd640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a406dfc0 0x7fb3a41538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a37fe640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 0x7fb3a40730e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00cc80 tx=0x7fb39c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb39b7fe640 1 -- 172.21.15.67:0/755347678 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c00ce30 con 0x7fb3a415b1d0 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb39b7fe640 1 -- 172.21.15.67:0/755347678 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c0039a0 con 0x7fb3a415b1d0 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb39b7fe640 1 -- 172.21.15.67:0/755347678 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c003df0 con 0x7fb3a415b1d0 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 -- 172.21.15.67:0/755347678 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a409d250 con 0x7fb3a415b1d0 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 -- 172.21.15.67:0/755347678 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a4153e20 con 0x7fb3a415b1d0 2024-09-19T05:43:55.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb3a97c7640 1 -- 172.21.15.67:0/755347678 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a40b3430 con 0x7fb3a415b1d0 2024-09-19T05:43:55.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.925+0000 7fb39b7fe640 1 -- 172.21.15.67:0/755347678 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb39c003fd0 con 0x7fb3a415b1d0 2024-09-19T05:43:55.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.929+0000 7fb39b7fe640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 0x7fb384069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:55.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.929+0000 7fb39b7fe640 1 -- 172.21.15.67:0/755347678 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fb39c086650 con 0x7fb3a415b1d0 2024-09-19T05:43:55.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.929+0000 7fb3a2ffd640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 0x7fb384069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:55.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.929+0000 7fb3a2ffd640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 0x7fb384069d80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb38c0b1000 tx=0x7fb38c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:55.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:55.933+0000 7fb39b7fe640 1 -- 172.21.15.67:0/755347678 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb39c014030 con 0x7fb3a415b1d0 2024-09-19T05:43:56.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.145+0000 7fb3a97c7640 1 -- 172.21.15.67:0/755347678 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb3a4072bc0 con 0x7fb3a415b1d0 2024-09-19T05:43:56.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.149+0000 7fb39b7fe640 1 -- 172.21.15.67:0/755347678 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7fb39c056ff0 con 0x7fb3a415b1d0 2024-09-19T05:43:56.150 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:43:56.150 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:43:56.150 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:43:56.150 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:43:56.150 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:43:56.151 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:43:56.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 -- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 msgr2=0x7fb384069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:56.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 0x7fb384069d80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb38c0b1000 tx=0x7fb38c008040 comp rx=0 tx=0).stop 2024-09-19T05:43:56.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 -- 172.21.15.67:0/755347678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 msgr2=0x7fb3a40730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:56.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 0x7fb3a40730e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00cc80 tx=0x7fb39c00a5c0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 -- 172.21.15.67:0/755347678 shutdown_connections 2024-09-19T05:43:56.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a415b1d0 0x7fb3a40730e0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3840678c0 0x7fb384069d80 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3a4070070 0x7fb3a409db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 --2- 172.21.15.67:0/755347678 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3a406dfc0 0x7fb3a41538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 -- 172.21.15.67:0/755347678 >> 172.21.15.67:0/755347678 conn(0x7fb3a40b1e50 msgr2=0x7fb3a40afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:56.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 -- 172.21.15.67:0/755347678 shutdown_connections 2024-09-19T05:43:56.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.153+0000 7fb3a97c7640 1 -- 172.21.15.67:0/755347678 wait complete. 2024-09-19T05:43:56.168 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:43:56.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f9d500640 1 Processor -- start 2024-09-19T05:43:56.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f9d500640 1 -- start start 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f9d500640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6f980b3880 0x7f6f98161660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f9d500640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f980d2170 con 0x7f6f98161ba0 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f9d500640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f980d1bb0 con 0x7f6f9809ac90 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f9d500640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6f980d1e90 con 0x7f6f980b3880 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f977fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6f98161ba0 0x7f6f980b1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56278/0 (socket says 172.21.15.67:56278) 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f977fe640 1 -- 172.21.15.67:0/2525187474 learned_addr learned my addr 172.21.15.67:0/2525187474 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f967fc640 1 --2- 172.21.15.67:0/2525187474 >> v2:172.21.15.97:3300/0 conn(0x7f6f980b3880 0x7f6f98161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234091842 0 0) 0x7f6f980d2170 con 0x7f6f98161ba0 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f84003530 con 0x7f6f98161ba0 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2768423775 0 0) 0x7f6f84003530 con 0x7f6f98161ba0 2024-09-19T05:43:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 >> v2:172.21.15.97:3300/0 conn(0x7f6f980b3880 msgr2=0x7f6f98161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 --2- 172.21.15.67:0/2525187474 >> v2:172.21.15.97:3300/0 conn(0x7f6f980b3880 0x7f6f98161660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 >> v1:172.21.15.97:6789/0 conn(0x7f6f9809ac90 legacy=0x7f6f9809b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f980d0ff0 con 0x7f6f98161ba0 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6f88001a00 con 0x7f6f98161ba0 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 >> v1:172.21.15.67:6789/0 conn(0x7f6f98161ba0 legacy=0x7f6f980b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f840039c0 0x7f6f84003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f84004810 0x7f6f84004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f840051d0 0x7f6f8400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6f980d1e90 con 0x7f6f84004810 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8400c170 con 0x7f6f840039c0 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8400c370 con 0x7f6f840051d0 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f967fc640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f84004810 0x7f6f84004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f96ffd640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f840039c0 0x7f6f84003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f977fe640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f840051d0 0x7f6f8400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f967fc640 1 -- 172.21.15.67:0/2525187474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f840051d0 msgr2=0x7f6f8400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f967fc640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f840051d0 0x7f6f8400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f967fc640 1 -- 172.21.15.67:0/2525187474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f840039c0 msgr2=0x7f6f84003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f967fc640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f840039c0 0x7f6f84003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f967fc640 1 -- 172.21.15.67:0/2525187474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84003530 con 0x7f6f84004810 2024-09-19T05:43:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f96ffd640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f840039c0 0x7f6f84003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f977fe640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f840051d0 0x7f6f8400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.293+0000 7f6f977fe640 1 -- 172.21.15.67:0/2525187474 reap_dead start 2024-09-19T05:43:56.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f967fc640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f84004810 0x7f6f84004c90 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009ae0 tx=0x7f6f8001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6c2c1c11dac854 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800096b0 con 0x7f6f84004810 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f800a6450 con 0x7f6f84004810 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f95ffb640 1 -- 172.21.15.67:0/2525187474 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800a6840 con 0x7f6f84004810 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f9d500640 1 -- 172.21.15.67:0/2525187474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f84004810 msgr2=0x7f6f84004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f9d500640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f84004810 0x7f6f84004c90 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009ae0 tx=0x7f6f8001ca70 comp rx=0 tx=0).stop 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f9d500640 1 -- 172.21.15.67:0/2525187474 shutdown_connections 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f9d500640 1 --2- 172.21.15.67:0/2525187474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f84004810 0x7f6f84004c90 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f9d500640 1 -- 172.21.15.67:0/2525187474 >> 172.21.15.67:0/2525187474 conn(0x7f6f980d2340 msgr2=0x7f6f980d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f9d500640 1 -- 172.21.15.67:0/2525187474 shutdown_connections 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f9d500640 1 -- 172.21.15.67:0/2525187474 wait complete. 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f9d500640 1 Processor -- start 2024-09-19T05:43:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.297+0000 7f6f9d500640 1 -- start start 2024-09-19T05:43:56.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f9d500640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84004810 0x7f6f9815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:56.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f9d500640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f9809cc80 0x7f6f9809e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f9d500640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f9809ec70 0x7f6f980b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f9d500640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9806d160 con 0x7f6f9809cc80 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f9d500640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9806cfe0 con 0x7f6f9809ec70 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f9d500640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9806d2e0 con 0x7f6f84004810 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f967fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f9809cc80 0x7f6f9809e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f967fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f9809cc80 0x7f6f9809e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38236/0 (socket says 172.21.15.67:38236) 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f967fc640 1 -- 172.21.15.67:0/823391296 learned_addr learned my addr 172.21.15.67:0/823391296 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f96ffd640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84004810 0x7f6f9815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f977fe640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f9809ec70 0x7f6f980b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f967fc640 1 -- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84004810 msgr2=0x7f6f9815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f967fc640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84004810 0x7f6f9815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f967fc640 1 -- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f9809ec70 msgr2=0x7f6f980b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f967fc640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f9809ec70 0x7f6f980b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f967fc640 1 -- 172.21.15.67:0/823391296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f981ec970 con 0x7f6f9809cc80 2024-09-19T05:43:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f977fe640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f9809ec70 0x7f6f980b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f967fc640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f9809cc80 0x7f6f9809e730 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009ae0 tx=0x7f6f80019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f8f7fe640 1 -- 172.21.15.67:0/823391296 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800bd070 con 0x7f6f9809cc80 2024-09-19T05:43:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f8f7fe640 1 -- 172.21.15.67:0/823391296 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f800a6c00 con 0x7f6f9809cc80 2024-09-19T05:43:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f9d500640 1 -- 172.21.15.67:0/823391296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f981ec690 con 0x7f6f9809cc80 2024-09-19T05:43:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f8f7fe640 1 -- 172.21.15.67:0/823391296 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800a7430 con 0x7f6f9809cc80 2024-09-19T05:43:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f9d500640 1 -- 172.21.15.67:0/823391296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f980b6100 con 0x7f6f9809cc80 2024-09-19T05:43:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f9d500640 1 -- 172.21.15.67:0/823391296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9806d670 con 0x7f6f9809cc80 2024-09-19T05:43:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f8f7fe640 1 -- 172.21.15.67:0/823391296 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f800c0070 con 0x7f6f9809cc80 2024-09-19T05:43:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f8f7fe640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f780678f0 0x7f6f78069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f8f7fe640 1 -- 172.21.15.67:0/823391296 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f6f8011f790 con 0x7f6f9809cc80 2024-09-19T05:43:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.301+0000 7f6f96ffd640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f780678f0 0x7f6f78069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.305+0000 7f6f96ffd640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f780678f0 0x7f6f78069db0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6f900055b0 tx=0x7f6f90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.305+0000 7f6f8f7fe640 1 -- 172.21.15.67:0/823391296 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6f800b5070 con 0x7f6f9809cc80 2024-09-19T05:43:56.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.497+0000 7f6f9d500640 1 -- 172.21.15.67:0/823391296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f980b34d0 con 0x7f6f9809cc80 2024-09-19T05:43:56.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f8f7fe640 1 -- 172.21.15.67:0/823391296 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f6f800ac020 con 0x7f6f9809cc80 2024-09-19T05:43:56.499 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:43:56.499 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:43:56.500 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:43:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 -- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f780678f0 msgr2=0x7f6f78069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f780678f0 0x7f6f78069db0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6f900055b0 tx=0x7f6f90009040 comp rx=0 tx=0).stop 2024-09-19T05:43:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 -- 172.21.15.67:0/823391296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f9809cc80 msgr2=0x7f6f9809e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f9809cc80 0x7f6f9809e730 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009ae0 tx=0x7f6f80019810 comp rx=0 tx=0).stop 2024-09-19T05:43:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 -- 172.21.15.67:0/823391296 shutdown_connections 2024-09-19T05:43:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f9809ec70 0x7f6f980b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f9809cc80 0x7f6f9809e730 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f780678f0 0x7f6f78069db0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 --2- 172.21.15.67:0/823391296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f84004810 0x7f6f9815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:56.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 -- 172.21.15.67:0/823391296 >> 172.21.15.67:0/823391296 conn(0x7f6f980d2340 msgr2=0x7f6f98071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:56.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 -- 172.21.15.67:0/823391296 shutdown_connections 2024-09-19T05:43:56.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:56.501+0000 7f6f9d500640 1 -- 172.21.15.67:0/823391296 wait complete. 2024-09-19T05:43:56.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:43:47.159161+0000', 'modified': '2024-09-19T05:43:49.173989+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8514}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8514': {'gid': 8514, 'name': 'c', 'rank': 0, 'incarnation': 96, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/4202714855', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 4202714855}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 4202714855}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8514, 'qdb_cluster': [8514]} 2024-09-19T05:43:56.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:43:56.921 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:43:57.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.057+0000 7f6c4d605640 1 Processor -- start 2024-09-19T05:43:57.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.057+0000 7f6c4d605640 1 -- start start 2024-09-19T05:43:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.057+0000 7f6c4d605640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6c48161da0 0x7f6c480d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.057+0000 7f6c4d605640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c480d0e80 0x7f6c480d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c4d605640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c480d4d40 con 0x7f6c480b41c0 2024-09-19T05:43:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c4d605640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6c480d0840 con 0x7f6c48161da0 2024-09-19T05:43:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c4d605640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6c480d1800 con 0x7f6c480d0e80 2024-09-19T05:43:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c46ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6c48161da0 0x7f6c480d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c46ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6c48161da0 0x7f6c480d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38246/0 (socket says 172.21.15.67:38246) 2024-09-19T05:43:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c477fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6c480b41c0 0x7f6c480b4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56288/0 (socket says 172.21.15.67:56288) 2024-09-19T05:43:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c46ffd640 1 -- 172.21.15.67:0/3956934057 learned_addr learned my addr 172.21.15.67:0/3956934057 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c467fc640 1 --2- 172.21.15.67:0/3956934057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c480d0e80 0x7f6c480d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c46ffd640 1 -- 172.21.15.67:0/3956934057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c480d0e80 msgr2=0x7f6c480d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/3956934057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c480d0e80 0x7f6c480d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c46ffd640 1 -- 172.21.15.67:0/3956934057 >> v1:172.21.15.67:6789/0 conn(0x7f6c480b41c0 legacy=0x7f6c480b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c45ffb640 1 -- 172.21.15.67:0/3956934057 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657120995 0 0) 0x7f6c480d4d40 con 0x7f6c480b41c0 2024-09-19T05:43:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c46ffd640 1 -- 172.21.15.67:0/3956934057 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c480d5020 con 0x7f6c48161da0 2024-09-19T05:43:57.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/3956934057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c48161da0 0x7f6c480d1af0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009e50 tx=0x7f6c4001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a696a7173f22c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:57.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c45ffb640 1 -- 172.21.15.67:0/3956934057 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400a57f0 con 0x7f6c48161da0 2024-09-19T05:43:57.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c45ffb640 1 -- 172.21.15.67:0/3956934057 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c400a5990 con 0x7f6c48161da0 2024-09-19T05:43:57.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.061+0000 7f6c45ffb640 1 -- 172.21.15.67:0/3956934057 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400a5d60 con 0x7f6c48161da0 2024-09-19T05:43:57.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- 172.21.15.67:0/3956934057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c48161da0 msgr2=0x7f6c480d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 --2- 172.21.15.67:0/3956934057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c48161da0 0x7f6c480d1af0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009e50 tx=0x7f6c4001ca30 comp rx=0 tx=0).stop 2024-09-19T05:43:57.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- 172.21.15.67:0/3956934057 shutdown_connections 2024-09-19T05:43:57.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 --2- 172.21.15.67:0/3956934057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c480d0e80 0x7f6c480d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 --2- 172.21.15.67:0/3956934057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c48161da0 0x7f6c480d1af0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- 172.21.15.67:0/3956934057 >> 172.21.15.67:0/3956934057 conn(0x7f6c4808bfc0 msgr2=0x7f6c480d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:57.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- 172.21.15.67:0/3956934057 shutdown_connections 2024-09-19T05:43:57.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- 172.21.15.67:0/3956934057 wait complete. 2024-09-19T05:43:57.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 Processor -- start 2024-09-19T05:43:57.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- start start 2024-09-19T05:43:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c480b41c0 0x7f6c480cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c480d0e80 0x7f6c4814e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c48161da0 0x7f6c4814ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6c48162180 con 0x7f6c480d0e80 2024-09-19T05:43:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c480b5d00 con 0x7f6c48161da0 2024-09-19T05:43:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4816b4f0 con 0x7f6c480b41c0 2024-09-19T05:43:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c467fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c480d0e80 0x7f6c4814e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c467fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c480d0e80 0x7f6c4814e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38248/0 (socket says 172.21.15.67:38248) 2024-09-19T05:43:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c467fc640 1 -- 172.21.15.67:0/4244976267 learned_addr learned my addr 172.21.15.67:0/4244976267 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:57.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c480b41c0 0x7f6c480cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c477fe640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c48161da0 0x7f6c4814ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c467fc640 1 -- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c480b41c0 msgr2=0x7f6c480cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c467fc640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c480b41c0 0x7f6c480cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c467fc640 1 -- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c48161da0 msgr2=0x7f6c4814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c467fc640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c48161da0 0x7f6c4814ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c467fc640 1 -- 172.21.15.67:0/4244976267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c48156930 con 0x7f6c480d0e80 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c467fc640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c480d0e80 0x7f6c4814e4c0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00d830 tx=0x7f6c3c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c2f7fe640 1 -- 172.21.15.67:0/4244976267 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00b6c0 con 0x7f6c480d0e80 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c2f7fe640 1 -- 172.21.15.67:0/4244976267 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c019070 con 0x7f6c480d0e80 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- 172.21.15.67:0/4244976267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c48156bd0 con 0x7f6c480d0e80 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c2f7fe640 1 -- 172.21.15.67:0/4244976267 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00ba60 con 0x7f6c480d0e80 2024-09-19T05:43:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.065+0000 7f6c4d605640 1 -- 172.21.15.67:0/4244976267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c48157190 con 0x7f6c480d0e80 2024-09-19T05:43:57.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c2f7fe640 1 -- 172.21.15.67:0/4244976267 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c3c00bc00 con 0x7f6c480d0e80 2024-09-19T05:43:57.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c2f7fe640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c340678c0 0x7f6c34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c2f7fe640 1 -- 172.21.15.67:0/4244976267 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f6c3c086330 con 0x7f6c480d0e80 2024-09-19T05:43:57.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c340678c0 0x7f6c34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c506c1000 1 Processor -- start 2024-09-19T05:43:57.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c506c1000 1 -- start start 2024-09-19T05:43:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c340678c0 0x7f6c34069d80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6c400ae000 tx=0x7f6c400a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71547b20 0x55dd71547f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd714fdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd714fe290 0x55dd714fe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c506c1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dd713e5b60 con 0x55dd71548440 2024-09-19T05:43:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c506c1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55dd7134cc70 con 0x55dd714fe290 2024-09-19T05:43:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c506c1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55dd712f2ed0 con 0x55dd71547b20 2024-09-19T05:43:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c467fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd714fdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c467fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd714fdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38262/0 (socket says 172.21.15.67:38262) 2024-09-19T05:43:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c467fc640 1 -- 172.21.15.67:0/903232113 learned_addr learned my addr 172.21.15.67:0/903232113 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c477fe640 1 --2- 172.21.15.67:0/903232113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd714fe290 0x55dd714fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/903232113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71547b20 0x55dd71547f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c467fc640 1 -- 172.21.15.67:0/903232113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71547b20 msgr2=0x55dd71547f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c467fc640 1 --2- 172.21.15.67:0/903232113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71547b20 0x55dd71547f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c467fc640 1 -- 172.21.15.67:0/903232113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd714fe290 msgr2=0x55dd714fe670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c467fc640 1 --2- 172.21.15.67:0/903232113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd714fe290 0x55dd714fe670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c467fc640 1 -- 172.21.15.67:0/903232113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd71304e50 con 0x55dd71548440 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.069+0000 7f6c467fc640 1 --2- 172.21.15.67:0/903232113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd714fdd50 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c052a20 tx=0x7f6c3c056050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526cf8d596d6895c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c2cff9640 1 -- 172.21.15.67:0/903232113 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c05f1a0 con 0x55dd71548440 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c2cff9640 1 -- 172.21.15.67:0/903232113 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0548c0 con 0x55dd71548440 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c2cff9640 1 -- 172.21.15.67:0/903232113 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c05ed10 con 0x55dd71548440 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- 172.21.15.67:0/903232113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 msgr2=0x55dd714fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 --2- 172.21.15.67:0/903232113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd714fdd50 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c052a20 tx=0x7f6c3c056050 comp rx=0 tx=0).stop 2024-09-19T05:43:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- 172.21.15.67:0/903232113 shutdown_connections 2024-09-19T05:43:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 --2- 172.21.15.67:0/903232113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd714fe290 0x55dd714fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 --2- 172.21.15.67:0/903232113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd714fdd50 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 --2- 172.21.15.67:0/903232113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71547b20 0x55dd71547f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- 172.21.15.67:0/903232113 >> 172.21.15.67:0/903232113 conn(0x55dd71504600 msgr2=0x55dd714fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- 172.21.15.67:0/903232113 shutdown_connections 2024-09-19T05:43:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- 172.21.15.67:0/903232113 wait complete. 2024-09-19T05:43:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- start start 2024-09-19T05:43:57.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 Processor -- start 2024-09-19T05:43:57.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71502df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71548440 0x55dd71508cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 0x55dd71509230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dd713aeb00 con 0x55dd71547b20 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55dd71327360 con 0x55dd71503330 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55dd713242d0 con 0x55dd71548440 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 10 client.0 _ll_register_callbacks cb 0x55dd714e9820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c46ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71502df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c46ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71502df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38266/0 (socket says 172.21.15.67:38266) 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c46ffd640 1 -- 172.21.15.67:0/486692227 learned_addr learned my addr 172.21.15.67:0/486692227 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c477fe640 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 0x55dd71509230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c467fc640 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71548440 0x55dd71508cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c46ffd640 1 -- 172.21.15.67:0/486692227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71548440 msgr2=0x55dd71508cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71548440 0x55dd71508cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c46ffd640 1 -- 172.21.15.67:0/486692227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 msgr2=0x55dd71509230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 0x55dd71509230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c46ffd640 1 -- 172.21.15.67:0/486692227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd712f3120 con 0x55dd71547b20 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c477fe640 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 0x55dd71509230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71502df0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f6c4001c4a0 tx=0x7f6c4001b270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980190a13d78daa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c25ffb640 1 -- 172.21.15.67:0/486692227 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400c7020 con 0x55dd71547b20 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c25ffb640 1 -- 172.21.15.67:0/486692227 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f6c400c4cb0 con 0x55dd71547b20 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- 172.21.15.67:0/486692227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c3c0548c0 con 0x55dd71547b20 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c25ffb640 1 -- 172.21.15.67:0/486692227 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f6c400c4eb0 con 0x55dd71547b20 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 10 client.8679 fetch_fsmap learned FSMap version 98 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- 172.21.15.67:0/486692227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55dd712ec450 con 0x55dd71547b20 2024-09-19T05:43:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c25ffb640 1 -- 172.21.15.67:0/486692227 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0548c0 con 0x55dd71547b20 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c25ffb640 1 -- 172.21.15.67:0/486692227 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f6c400b66e0 con 0x55dd71547b20 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 10 client.8679 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 10 client.8679 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 20 client.8679 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55dd71556280 0x55dd71558670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 4 client.8679 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c506c1000 1 -- 172.21.15.67:0/486692227 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd712e6c00 con 0x55dd71556280 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.073+0000 7f6c467fc640 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55dd71556280 0x55dd71558670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c467fc640 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55dd71556280 0x55dd71558670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45e43a64fddbde7c server_cookie=9a737304393cf6c6 in_seq=0 out_seq=0 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c25ffb640 10 client.8679 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c25ffb640 1 -- 172.21.15.67:0/486692227 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd712e6c00 con 0x55dd71556280 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c25ffb640 10 client.8679 handle_command_reply: tid=0 2024-09-19T05:43:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 client.8679 shutdown 2024-09-19T05:43:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 -- 172.21.15.67:0/486692227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 msgr2=0x55dd71502df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71502df0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f6c4001c4a0 tx=0x7f6c4001b270 comp rx=0 tx=0).stop 2024-09-19T05:43:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 -- 172.21.15.67:0/486692227 shutdown_connections 2024-09-19T05:43:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55dd71556280 0x55dd71558670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 0x55dd71509230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71548440 0x55dd71508cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c25ffb640 0 client.8679 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:43:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 --2- 172.21.15.67:0/486692227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71502df0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 -- 172.21.15.67:0/486692227 >> 172.21.15.67:0/486692227 conn(0x55dd714fe290 msgr2=0x55dd714fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 -- 172.21.15.67:0/486692227 shutdown_connections 2024-09-19T05:43:57.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 1 -- 172.21.15.67:0/486692227 wait complete. 2024-09-19T05:43:57.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.077+0000 7f6c506c1000 20 client.8679 trim_cache size 0 max 16384 2024-09-19T05:43:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 Processor -- start 2024-09-19T05:43:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- start start 2024-09-19T05:43:57.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71503330 0x55dd71546cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71547200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71548440 0x55dd71558670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6c48203340 con 0x55dd71547b20 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4815ab40 con 0x55dd71548440 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6c48202dc0 con 0x55dd71503330 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c467fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71547200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c467fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71547200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38272/0 (socket says 172.21.15.67:38272) 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c467fc640 1 -- 172.21.15.67:0/2607317117 learned_addr learned my addr 172.21.15.67:0/2607317117 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c467fc640 1 -- 172.21.15.67:0/2607317117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71503330 msgr2=0x55dd71546cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/2607317117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71503330 0x55dd71546cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c477fe640 1 --2- 172.21.15.67:0/2607317117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71548440 0x55dd71558670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c467fc640 1 --2- 172.21.15.67:0/2607317117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71503330 0x55dd71546cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c467fc640 1 -- 172.21.15.67:0/2607317117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71548440 msgr2=0x55dd71558670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c467fc640 1 --2- 172.21.15.67:0/2607317117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71548440 0x55dd71558670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c467fc640 1 -- 172.21.15.67:0/2607317117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd712d3fd0 con 0x55dd71547b20 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c477fe640 1 --2- 172.21.15.67:0/2607317117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71548440 0x55dd71558670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c467fc640 1 --2- 172.21.15.67:0/2607317117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71547200 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c056550 tx=0x7f6c3c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c101642d824386 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c27fff640 1 -- 172.21.15.67:0/2607317117 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c05f1a0 con 0x55dd71547b20 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c27fff640 1 -- 172.21.15.67:0/2607317117 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0548c0 con 0x55dd71547b20 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c27fff640 1 -- 172.21.15.67:0/2607317117 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c052c30 con 0x55dd71547b20 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- 172.21.15.67:0/2607317117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 msgr2=0x55dd71547200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 --2- 172.21.15.67:0/2607317117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71547200 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c056550 tx=0x7f6c3c020000 comp rx=0 tx=0).stop 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- 172.21.15.67:0/2607317117 shutdown_connections 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 --2- 172.21.15.67:0/2607317117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71548440 0x55dd71558670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 --2- 172.21.15.67:0/2607317117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71547b20 0x55dd71547200 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 --2- 172.21.15.67:0/2607317117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71503330 0x55dd71546cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- 172.21.15.67:0/2607317117 >> 172.21.15.67:0/2607317117 conn(0x55dd714fe290 msgr2=0x55dd715025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- 172.21.15.67:0/2607317117 shutdown_connections 2024-09-19T05:43:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- 172.21.15.67:0/2607317117 wait complete. 2024-09-19T05:43:57.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- start start 2024-09-19T05:43:57.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 Processor -- start 2024-09-19T05:43:57.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 0x55dd7155b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71547b20 0x55dd71576960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd71576ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dd7134bf80 con 0x55dd71548440 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55dd71304ca0 con 0x55dd71503330 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55dd713512a0 con 0x55dd71547b20 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c506c1000 10 client.0 _ll_register_callbacks cb 0x7f6c40009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd71576ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.097+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd71576ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38276/0 (socket says 172.21.15.67:38276) 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c477fe640 1 -- 172.21.15.67:0/4126025431 learned_addr learned my addr 172.21.15.67:0/4126025431 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 0x55dd7155b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c467fc640 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71547b20 0x55dd71576960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c477fe640 1 -- 172.21.15.67:0/4126025431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71547b20 msgr2=0x55dd71576960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c477fe640 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71547b20 0x55dd71576960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c477fe640 1 -- 172.21.15.67:0/4126025431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 msgr2=0x55dd7155b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c477fe640 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 0x55dd7155b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c477fe640 1 -- 172.21.15.67:0/4126025431 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd713cf750 con 0x55dd71548440 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c477fe640 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd71576ea0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f6c38005c70 tx=0x7f6c38001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e7ed4e177ae350 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c25ffb640 1 -- 172.21.15.67:0/4126025431 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38005e20 con 0x55dd71548440 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c25ffb640 1 -- 172.21.15.67:0/4126025431 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f6c38015560 con 0x55dd71548440 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 -- 172.21.15.67:0/4126025431 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c3c0548c0 con 0x55dd71548440 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c25ffb640 1 -- 172.21.15.67:0/4126025431 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f6c38023050 con 0x55dd71548440 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 10 client.8685 fetch_fsmap learned FSMap version 98 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 -- 172.21.15.67:0/4126025431 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55dd712daa30 con 0x55dd71548440 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c25ffb640 1 -- 172.21.15.67:0/4126025431 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0548c0 con 0x55dd71548440 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c25ffb640 1 -- 172.21.15.67:0/4126025431 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f6c38026020 con 0x55dd71548440 2024-09-19T05:43:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 10 client.8685 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 10 client.8685 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 20 client.8685 populate_metadata read hostname 'smithi067' 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55dd715773e0 0x55dd715bac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 4 client.8685 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 -- 172.21.15.67:0/4126025431 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "status"}) -- 0x55dd7135a3a0 con 0x55dd715773e0 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55dd715773e0 0x55dd715bac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c46ffd640 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55dd715773e0 0x55dd715bac00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f50c3d961914b25 server_cookie=2c9219ad255fa406 in_seq=0 out_seq=0 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c25ffb640 10 client.8685 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c25ffb640 1 -- 172.21.15.67:0/4126025431 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55dd7135a3a0 con 0x55dd715773e0 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c25ffb640 10 client.8685 handle_command_reply: tid=0 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 client.8685 shutdown 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 -- 172.21.15.67:0/4126025431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 msgr2=0x55dd71576ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd71576ea0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f6c38005c70 tx=0x7f6c38001690 comp rx=0 tx=0).stop 2024-09-19T05:43:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 -- 172.21.15.67:0/4126025431 shutdown_connections 2024-09-19T05:43:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55dd715773e0 0x55dd715bac00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd71548440 0x55dd71576ea0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dd71547b20 0x55dd71576960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c25ffb640 0 client.8685 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:43:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 --2- 172.21.15.67:0/4126025431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dd71503330 0x55dd7155b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 -- 172.21.15.67:0/4126025431 >> 172.21.15.67:0/4126025431 conn(0x55dd714fe290 msgr2=0x55dd71545cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 -- 172.21.15.67:0/4126025431 shutdown_connections 2024-09-19T05:43:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 1 -- 172.21.15.67:0/4126025431 wait complete. 2024-09-19T05:43:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c506c1000 20 client.8685 trim_cache size 0 max 16384 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 8514, 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 9.3182574969999994, 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 98, 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 143, 2024-09-19T05:43:57.107 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 143, 2024-09-19T05:43:57.108 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 14.262073226 2024-09-19T05:43:57.108 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:43:57.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 -- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c340678c0 msgr2=0x7f6c34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c340678c0 0x7f6c34069d80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6c400ae000 tx=0x7f6c400a7070 comp rx=0 tx=0).stop 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 -- 172.21.15.67:0/4244976267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c480d0e80 msgr2=0x7f6c4814e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c480d0e80 0x7f6c4814e4c0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00d830 tx=0x7f6c3c00dcf0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 -- 172.21.15.67:0/4244976267 shutdown_connections 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c48161da0 0x7f6c4814ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c480d0e80 0x7f6c4814e4c0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c340678c0 0x7f6c34069d80 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 --2- 172.21.15.67:0/4244976267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c480b41c0 0x7f6c480cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 -- 172.21.15.67:0/4244976267 >> 172.21.15.67:0/4244976267 conn(0x7f6c4808bfc0 msgr2=0x7f6c4814f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 -- 172.21.15.67:0/4244976267 shutdown_connections 2024-09-19T05:43:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.101+0000 7f6c4d605640 1 -- 172.21.15.67:0/4244976267 wait complete. 2024-09-19T05:43:57.118 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:43:57.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feffb936640 1 Processor -- start 2024-09-19T05:43:57.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feffb936640 1 -- start start 2024-09-19T05:43:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feffb936640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff4070140 0x7feff415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feffb936640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff40cd320 con 0x7feff40ccee0 2024-09-19T05:43:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feffb936640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff406e790 con 0x7feff40ae8c0 2024-09-19T05:43:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feffb936640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7feff406ea50 con 0x7feff4070140 2024-09-19T05:43:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feff8ed1640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7feff40ccee0 0x7feff4070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56294/0 (socket says 172.21.15.67:56294) 2024-09-19T05:43:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feff8ed1640 1 -- 172.21.15.67:0/2702484297 learned_addr learned my addr 172.21.15.67:0/2702484297 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:43:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feff96d2640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff4070140 0x7feff415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553088582 0 0) 0x7feff40cd320 con 0x7feff40ccee0 2024-09-19T05:43:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefe0003530 con 0x7feff40ccee0 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1260332324 0 0) 0x7fefe0003530 con 0x7feff40ccee0 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff4070140 msgr2=0x7feff415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff4070140 0x7feff415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 >> v1:172.21.15.97:6789/0 conn(0x7feff40ae8c0 legacy=0x7feff40aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff406ed30 con 0x7feff40ccee0 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fefe4001680 con 0x7feff40ccee0 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 >> v1:172.21.15.67:6789/0 conn(0x7feff40ccee0 legacy=0x7feff4070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefe00039f0 0x7fefe0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 0x7fefe0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff4070140 0x7fefe0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feff406ea50 con 0x7fefe0004810 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fefe000bb00 con 0x7fefe00039f0 2024-09-19T05:43:57.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fefe000bd00 con 0x7feff4070140 2024-09-19T05:43:57.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feff8ed1640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 0x7fefe0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feff96d2640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefe00039f0 0x7fefe0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feff8ed1640 1 -- 172.21.15.67:0/2702484297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff4070140 msgr2=0x7fefe0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feff8ed1640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff4070140 0x7fefe0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feff8ed1640 1 -- 172.21.15.67:0/2702484297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefe00039f0 msgr2=0x7fefe0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:43:57.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feff8ed1640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefe00039f0 0x7fefe0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.229+0000 7feff8ed1640 1 -- 172.21.15.67:0/2702484297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe0003530 con 0x7fefe0004810 2024-09-19T05:43:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7feff8ed1640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 0x7fefe0004c90 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7feff4161e40 tx=0x7fefe401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2365b1f745777e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4007d40 con 0x7fefe0004810 2024-09-19T05:43:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe40a9070 con 0x7fefe0004810 2024-09-19T05:43:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7fefebfff640 1 -- 172.21.15.67:0/2702484297 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4005d40 con 0x7fefe0004810 2024-09-19T05:43:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7feffb936640 1 -- 172.21.15.67:0/2702484297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 msgr2=0x7fefe0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7feffb936640 1 --2- 172.21.15.67:0/2702484297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 0x7fefe0004c90 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7feff4161e40 tx=0x7fefe401cc30 comp rx=0 tx=0).stop 2024-09-19T05:43:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7feff9ed3640 1 -- 172.21.15.67:0/2702484297 reap_dead start 2024-09-19T05:43:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7feffb936640 1 -- 172.21.15.67:0/2702484297 shutdown_connections 2024-09-19T05:43:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7feffb936640 1 -- 172.21.15.67:0/2702484297 >> 172.21.15.67:0/2702484297 conn(0x7feff4073500 msgr2=0x7feff406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7feffb936640 1 -- 172.21.15.67:0/2702484297 shutdown_connections 2024-09-19T05:43:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7feffb936640 1 -- 172.21.15.67:0/2702484297 wait complete. 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7feffb936640 1 Processor -- start 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.233+0000 7feffb936640 1 -- start start 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feffb936640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 0x7feff41694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feffb936640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff414ecd0 0x7feff4157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feffb936640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feff40b3bd0 0x7feff40b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feffb936640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feff415c2e0 con 0x7fefe0004810 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feffb936640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7feff415c160 con 0x7feff40b3bd0 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feffb936640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7feff40af890 con 0x7feff414ecd0 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff96d2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 0x7feff41694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff96d2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 0x7feff41694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38298/0 (socket says 172.21.15.67:38298) 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff96d2640 1 -- 172.21.15.67:0/3543443208 learned_addr learned my addr 172.21.15.67:0/3543443208 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff9ed3640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feff40b3bd0 0x7feff40b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff8ed1640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff414ecd0 0x7feff4157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff96d2640 1 -- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff414ecd0 msgr2=0x7feff4157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff96d2640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff414ecd0 0x7feff4157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff96d2640 1 -- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feff40b3bd0 msgr2=0x7feff40b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff96d2640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feff40b3bd0 0x7feff40b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff96d2640 1 -- 172.21.15.67:0/3543443208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff40b26f0 con 0x7fefe0004810 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff9ed3640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feff40b3bd0 0x7feff40b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff8ed1640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff414ecd0 0x7feff4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff96d2640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 0x7feff41694a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7feff0011630 tx=0x7feff0011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7fefe9ffb640 1 -- 172.21.15.67:0/3543443208 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0004220 con 0x7fefe0004810 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7fefe9ffb640 1 -- 172.21.15.67:0/3543443208 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff00043c0 con 0x7fefe0004810 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feffb936640 1 -- 172.21.15.67:0/3543443208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff40b1930 con 0x7fefe0004810 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7fefe9ffb640 1 -- 172.21.15.67:0/3543443208 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff000f920 con 0x7fefe0004810 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feffb936640 1 -- 172.21.15.67:0/3543443208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff40b1ef0 con 0x7fefe0004810 2024-09-19T05:43:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feffb936640 1 -- 172.21.15.67:0/3543443208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff40b4590 con 0x7fefe0004810 2024-09-19T05:43:57.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7fefe9ffb640 1 -- 172.21.15.67:0/3543443208 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feff000fac0 con 0x7fefe0004810 2024-09-19T05:43:57.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7fefe9ffb640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd80678c0 0x7fefd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:43:57.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7fefe9ffb640 1 -- 172.21.15.67:0/3543443208 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7feff00864a0 con 0x7fefe0004810 2024-09-19T05:43:57.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.237+0000 7feff8ed1640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd80678c0 0x7fefd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:43:57.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.241+0000 7feff8ed1640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd80678c0 0x7fefd8069d80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fefe40ab000 tx=0x7fefe40a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:43:57.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.241+0000 7fefe9ffb640 1 -- 172.21.15.67:0/3543443208 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7feff40b26f0 con 0x7fefe0004810 2024-09-19T05:43:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.453+0000 7feffb936640 1 -- 172.21.15.67:0/3543443208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7feff40b5ac0 con 0x7fefe0004810 2024-09-19T05:43:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.453+0000 7fefe9ffb640 1 -- 172.21.15.67:0/3543443208 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v98) ==== 53+0+73 (secure 0 0 0) 0x7feff0019030 con 0x7fefe0004810 2024-09-19T05:43:57.452 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.453+0000 7feffb936640 1 -- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd80678c0 msgr2=0x7fefd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.453+0000 7feffb936640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd80678c0 0x7fefd8069d80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fefe40ab000 tx=0x7fefe40a7070 comp rx=0 tx=0).stop 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.457+0000 7feffb936640 1 -- 172.21.15.67:0/3543443208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 msgr2=0x7feff41694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.457+0000 7feffb936640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 0x7feff41694a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7feff0011630 tx=0x7feff0011af0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.457+0000 7feffb936640 1 -- 172.21.15.67:0/3543443208 shutdown_connections 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.457+0000 7feffb936640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feff40b3bd0 0x7feff40b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.457+0000 7feffb936640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefd80678c0 0x7fefd8069d80 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.457+0000 7feffb936640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feff414ecd0 0x7feff4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.457+0000 7feffb936640 1 --2- 172.21.15.67:0/3543443208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe0004810 0x7feff41694a0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.457+0000 7feffb936640 1 -- 172.21.15.67:0/3543443208 >> 172.21.15.67:0/3543443208 conn(0x7feff4073500 msgr2=0x7feff415fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:43:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.457+0000 7feffb936640 1 -- 172.21.15.67:0/3543443208 shutdown_connections 2024-09-19T05:43:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57.457+0000 7feffb936640 1 -- 172.21.15.67:0/3543443208 wait complete. 2024-09-19T05:43:57.470 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:43:57.470 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:43:57.470 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:43:57.470 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:43:57.470 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:57.470 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:43:57.470 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:43:57.470 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:43:57.470 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:43:57.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:57.471 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:43:57.477 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:43:57.477 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:43:57.477 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:43:57.477 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:57.477 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:43:57.477 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41867sec preferred_lft 41867sec 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:43:57.478 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:43:57.479 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:57.480 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:43:57.480 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:57.480 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:43:57.480 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:57.480 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:43:57.480 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:43:57.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:57.481 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:43:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:43:57.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:57.531 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:43:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:43:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:43:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:43:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:43:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:43:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:43:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:43:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:43:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:43:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:43:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:43:57.583 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:43:57.583 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:57.584 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:43:57.584 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:43:57.584 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:43:57.584 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:57.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:43:57.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:57.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:57.707 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:43:57.713 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:43:57.713 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:43:57.713 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:43:57.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:57.714 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:43:57.769 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:43:57.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:43:57.770 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:57.815 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:43:57.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:43:57.815 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:57.863 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:43:57.920 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:43:57.968 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:43:57.968 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:43:57.968 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:43:57.968 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:43:57.968 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:43:57.969 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:57.970 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:57.971 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:57.971 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:57.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:57.972 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:43:58.019 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:43:58.019 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:43:58.064 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:43:58.078 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:43:58.127 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:43:58.127 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:43:58.127 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:43:58.127 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:43:58.128 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:58.129 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:58.130 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:58.130 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:58.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:58.131 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:43:58.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:43:58.145+0000 7f8c0ed48580 -1 init, newargv = 0x563fb4146390 newargc=15 2024-09-19T05:43:58.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[76238]: starting ceph client 2024-09-19T05:43:58.152 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[76238]: starting fuse 2024-09-19T05:43:59.252 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:43:59.269 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:43:59.316 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:43:59.316 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:43:59.316 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:43:59.316 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:43:59.316 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:43:59.316 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:43:59.316 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:43:59.317 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:43:59.318 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:59.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:59.319 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:43:59.367 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:43:59.367 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:43:59.368 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:43:59.369 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:43:59.499 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.76238.asok 2024-09-19T05:43:59.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:43:59.513 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76238.asok 2024-09-19T05:43:59.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:59.514 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76238.asok status 2024-09-19T05:43:59.677 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:43:59.677 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:43:59.677 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:43:59.677 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:43:59.677 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:43:59.678 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:43:59.678 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:43:59.678 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "76238", 2024-09-19T05:43:59.678 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:43:59.678 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:59.678 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:43:59.678 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:43:59.679 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 8700, 2024-09-19T05:43:59.679 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:43:59.679 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:43:59.679 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:43:59.679 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 8700 2024-09-19T05:43:59.679 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:59.679 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:43:59.680 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:43:59.680 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:43:59.680 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 550849481 2024-09-19T05:43:59.680 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:43:59.680 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:59.680 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:43:59.680 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:43:59.680 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:43:59.681 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 550849481 2024-09-19T05:43:59.681 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:43:59.681 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.8700 192.168.0.1:0/550849481", 2024-09-19T05:43:59.681 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/550849481", 2024-09-19T05:43:59.681 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:43:59.681 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 98, 2024-09-19T05:43:59.681 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 143, 2024-09-19T05:43:59.681 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:43:59.681 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:43:59.681 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:43:59.682 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:43:59.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:59.693 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:43:59.694 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:59.699 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:43:59.700 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:59.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:43:59.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:59.753 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-19T05:43:59.754 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-09-19T05:43:59.754 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:43:59.754 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:43:59.754 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.0 2024-09-19T05:43:59.754 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:43:59.754 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:43:59.754 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:43:59.754 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:43:59.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:43:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:43:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190276 s, 55.1 MB/s 2024-09-19T05:43:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150777 s, 69.5 MB/s 2024-09-19T05:43:59.911 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:59.911 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:59.911 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154743 s, 67.8 MB/s 2024-09-19T05:43:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135742 s, 77.2 MB/s 2024-09-19T05:43:59.943 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:59.943 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:59.943 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103109 s, 102 MB/s 2024-09-19T05:43:59.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:59.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:59.960 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144661 s, 72.5 MB/s 2024-09-19T05:43:59.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:59.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:59.976 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129346 s, 81.1 MB/s 2024-09-19T05:43:59.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:43:59.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:43:59.993 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134484 s, 78.0 MB/s 2024-09-19T05:44:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151621 s, 69.2 MB/s 2024-09-19T05:44:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.030 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145094 s, 72.3 MB/s 2024-09-19T05:44:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141174 s, 74.3 MB/s 2024-09-19T05:44:00.063 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.063 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.063 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124453 s, 84.3 MB/s 2024-09-19T05:44:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.078 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120786 s, 86.8 MB/s 2024-09-19T05:44:00.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.095 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142197 s, 73.7 MB/s 2024-09-19T05:44:00.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.109 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106667 s, 98.3 MB/s 2024-09-19T05:44:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127585 s, 82.2 MB/s 2024-09-19T05:44:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128592 s, 81.5 MB/s 2024-09-19T05:44:00.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.157 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135717 s, 77.3 MB/s 2024-09-19T05:44:00.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.173 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.173 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121373 s, 86.4 MB/s 2024-09-19T05:44:00.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.189 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123884 s, 84.6 MB/s 2024-09-19T05:44:00.205 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.205 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.205 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123347 s, 85.0 MB/s 2024-09-19T05:44:00.220 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.220 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.220 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115695 s, 90.6 MB/s 2024-09-19T05:44:00.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.234 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114734 s, 91.4 MB/s 2024-09-19T05:44:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128077 s, 81.9 MB/s 2024-09-19T05:44:00.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.263 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108239 s, 96.9 MB/s 2024-09-19T05:44:00.279 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.279 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.279 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124271 s, 84.4 MB/s 2024-09-19T05:44:00.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.295 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138527 s, 75.7 MB/s 2024-09-19T05:44:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.313 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132656 s, 79.0 MB/s 2024-09-19T05:44:00.331 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.331 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.331 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135916 s, 77.1 MB/s 2024-09-19T05:44:00.347 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.347 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.348 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130225 s, 80.5 MB/s 2024-09-19T05:44:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.364 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130353 s, 80.4 MB/s 2024-09-19T05:44:00.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.378 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113002 s, 92.8 MB/s 2024-09-19T05:44:00.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:00.387 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:00.388 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:00.388 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.1 2024-09-19T05:44:00.388 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:00.388 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:00.388 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:00.388 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:00.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:00.497 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.497 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.497 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117898 s, 88.9 MB/s 2024-09-19T05:44:00.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.513 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130818 s, 80.2 MB/s 2024-09-19T05:44:00.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.529 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132549 s, 79.1 MB/s 2024-09-19T05:44:00.545 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.545 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.545 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132632 s, 79.1 MB/s 2024-09-19T05:44:00.564 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.564 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.564 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156337 s, 67.1 MB/s 2024-09-19T05:44:00.581 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.581 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.581 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137037 s, 76.5 MB/s 2024-09-19T05:44:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135923 s, 77.1 MB/s 2024-09-19T05:44:00.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142251 s, 73.7 MB/s 2024-09-19T05:44:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152997 s, 68.5 MB/s 2024-09-19T05:44:00.651 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.651 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.651 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116552 s, 90.0 MB/s 2024-09-19T05:44:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121587 s, 86.2 MB/s 2024-09-19T05:44:00.684 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.685 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147387 s, 71.1 MB/s 2024-09-19T05:44:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.702 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133666 s, 78.4 MB/s 2024-09-19T05:44:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143433 s, 73.1 MB/s 2024-09-19T05:44:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143557 s, 73.0 MB/s 2024-09-19T05:44:00.756 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.756 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.756 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157248 s, 66.7 MB/s 2024-09-19T05:44:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129921 s, 80.7 MB/s 2024-09-19T05:44:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140963 s, 74.4 MB/s 2024-09-19T05:44:00.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.809 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154071 s, 68.1 MB/s 2024-09-19T05:44:00.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.828 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148803 s, 70.5 MB/s 2024-09-19T05:44:00.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.844 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128271 s, 81.7 MB/s 2024-09-19T05:44:00.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.861 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135822 s, 77.2 MB/s 2024-09-19T05:44:00.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.877 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132871 s, 78.9 MB/s 2024-09-19T05:44:00.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.896 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154141 s, 68.0 MB/s 2024-09-19T05:44:00.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.913 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136353 s, 76.9 MB/s 2024-09-19T05:44:00.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.931 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146124 s, 71.8 MB/s 2024-09-19T05:44:00.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.948 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138718 s, 75.6 MB/s 2024-09-19T05:44:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126744 s, 82.7 MB/s 2024-09-19T05:44:00.983 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:00.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:00.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146616 s, 71.5 MB/s 2024-09-19T05:44:01.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.001 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138801 s, 75.5 MB/s 2024-09-19T05:44:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.020 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147032 s, 71.3 MB/s 2024-09-19T05:44:01.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.036 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131712 s, 79.6 MB/s 2024-09-19T05:44:01.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:01.046 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:01.046 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:01.046 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.2 2024-09-19T05:44:01.046 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:01.046 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:01.046 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:01.046 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:01.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.117 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.117 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012769 s, 82.1 MB/s 2024-09-19T05:44:01.132 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.132 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.132 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131293 s, 79.9 MB/s 2024-09-19T05:44:01.150 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.150 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.150 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015027 s, 69.8 MB/s 2024-09-19T05:44:01.165 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.165 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.165 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113845 s, 92.1 MB/s 2024-09-19T05:44:01.181 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.181 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.181 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122951 s, 85.3 MB/s 2024-09-19T05:44:01.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.196 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129331 s, 81.1 MB/s 2024-09-19T05:44:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127409 s, 82.3 MB/s 2024-09-19T05:44:01.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.227 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117256 s, 89.4 MB/s 2024-09-19T05:44:01.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.244 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139917 s, 74.9 MB/s 2024-09-19T05:44:01.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.258 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116287 s, 90.2 MB/s 2024-09-19T05:44:01.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.276 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143558 s, 73.0 MB/s 2024-09-19T05:44:01.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.292 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128685 s, 81.5 MB/s 2024-09-19T05:44:01.307 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.307 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.307 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117621 s, 89.1 MB/s 2024-09-19T05:44:01.322 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.322 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.322 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120568 s, 87.0 MB/s 2024-09-19T05:44:01.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.340 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148544 s, 70.6 MB/s 2024-09-19T05:44:01.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.357 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140399 s, 74.7 MB/s 2024-09-19T05:44:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126053 s, 83.2 MB/s 2024-09-19T05:44:01.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.389 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013527 s, 77.5 MB/s 2024-09-19T05:44:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136477 s, 76.8 MB/s 2024-09-19T05:44:01.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.422 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131241 s, 79.9 MB/s 2024-09-19T05:44:01.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135133 s, 77.6 MB/s 2024-09-19T05:44:01.457 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.457 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.457 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143617 s, 73.0 MB/s 2024-09-19T05:44:01.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.473 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128827 s, 81.4 MB/s 2024-09-19T05:44:01.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.490 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.490 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137808 s, 76.1 MB/s 2024-09-19T05:44:01.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.505 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.505 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118965 s, 88.1 MB/s 2024-09-19T05:44:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144553 s, 72.5 MB/s 2024-09-19T05:44:01.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.538 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128427 s, 81.6 MB/s 2024-09-19T05:44:01.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.554 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131573 s, 79.7 MB/s 2024-09-19T05:44:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101528 s, 103 MB/s 2024-09-19T05:44:01.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.584 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135864 s, 77.2 MB/s 2024-09-19T05:44:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148349 s, 70.7 MB/s 2024-09-19T05:44:01.619 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.619 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.619 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130515 s, 80.3 MB/s 2024-09-19T05:44:01.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:01.628 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:01.628 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:01.628 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.3 2024-09-19T05:44:01.628 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:01.628 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:01.628 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:01.628 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:01.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:01.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.699 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127592 s, 82.2 MB/s 2024-09-19T05:44:01.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.713 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.713 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114325 s, 91.7 MB/s 2024-09-19T05:44:01.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.727 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116526 s, 90.0 MB/s 2024-09-19T05:44:01.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.738 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088194 s, 119 MB/s 2024-09-19T05:44:01.753 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.753 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.753 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120995 s, 86.7 MB/s 2024-09-19T05:44:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012997 s, 80.7 MB/s 2024-09-19T05:44:01.780 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.781 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930579 s, 113 MB/s 2024-09-19T05:44:01.792 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.793 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937293 s, 112 MB/s 2024-09-19T05:44:01.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.807 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111796 s, 93.8 MB/s 2024-09-19T05:44:01.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.820 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114258 s, 91.8 MB/s 2024-09-19T05:44:01.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.832 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880279 s, 119 MB/s 2024-09-19T05:44:01.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.846 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118413 s, 88.6 MB/s 2024-09-19T05:44:01.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.861 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122146 s, 85.8 MB/s 2024-09-19T05:44:01.875 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.875 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.875 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113784 s, 92.2 MB/s 2024-09-19T05:44:01.890 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.890 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.890 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011871 s, 88.3 MB/s 2024-09-19T05:44:01.905 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.905 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.905 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125337 s, 83.7 MB/s 2024-09-19T05:44:01.918 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.919 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.919 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103595 s, 101 MB/s 2024-09-19T05:44:01.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.933 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114412 s, 91.6 MB/s 2024-09-19T05:44:01.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.948 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113343 s, 92.5 MB/s 2024-09-19T05:44:01.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.962 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106189 s, 98.7 MB/s 2024-09-19T05:44:01.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.976 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112431 s, 93.3 MB/s 2024-09-19T05:44:01.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:01.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:01.990 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121406 s, 86.4 MB/s 2024-09-19T05:44:02.006 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.006 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.006 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123094 s, 85.2 MB/s 2024-09-19T05:44:02.018 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.018 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.018 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902481 s, 116 MB/s 2024-09-19T05:44:02.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.035 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133007 s, 78.8 MB/s 2024-09-19T05:44:02.050 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.050 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.051 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012191 s, 86.0 MB/s 2024-09-19T05:44:02.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.065 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121831 s, 86.1 MB/s 2024-09-19T05:44:02.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.079 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115026 s, 91.2 MB/s 2024-09-19T05:44:02.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.094 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115342 s, 90.9 MB/s 2024-09-19T05:44:02.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.109 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114968 s, 91.2 MB/s 2024-09-19T05:44:02.123 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.124 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121073 s, 86.6 MB/s 2024-09-19T05:44:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116222 s, 90.2 MB/s 2024-09-19T05:44:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:02.145 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:02.145 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:02.146 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.4 2024-09-19T05:44:02.146 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:02.146 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:02.146 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:02.146 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:02.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.206 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112224 s, 93.4 MB/s 2024-09-19T05:44:02.221 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.221 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.221 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122187 s, 85.8 MB/s 2024-09-19T05:44:02.236 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.237 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124804 s, 84.0 MB/s 2024-09-19T05:44:02.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114779 s, 91.4 MB/s 2024-09-19T05:44:02.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.263 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094429 s, 111 MB/s 2024-09-19T05:44:02.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109552 s, 95.7 MB/s 2024-09-19T05:44:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.291 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118732 s, 88.3 MB/s 2024-09-19T05:44:02.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.304 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.304 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100714 s, 104 MB/s 2024-09-19T05:44:02.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.316 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938145 s, 112 MB/s 2024-09-19T05:44:02.327 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.327 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921876 s, 114 MB/s 2024-09-19T05:44:02.344 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.345 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.345 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141978 s, 73.9 MB/s 2024-09-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115928 s, 90.5 MB/s 2024-09-19T05:44:02.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.374 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121829 s, 86.1 MB/s 2024-09-19T05:44:02.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.389 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126015 s, 83.2 MB/s 2024-09-19T05:44:02.403 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.403 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.403 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010814 s, 97.0 MB/s 2024-09-19T05:44:02.415 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.415 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972671 s, 108 MB/s 2024-09-19T05:44:02.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.433 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013824 s, 75.9 MB/s 2024-09-19T05:44:02.447 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.447 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.447 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117849 s, 89.0 MB/s 2024-09-19T05:44:02.463 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.464 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132757 s, 79.0 MB/s 2024-09-19T05:44:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121168 s, 86.5 MB/s 2024-09-19T05:44:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141466 s, 74.1 MB/s 2024-09-19T05:44:02.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.513 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013057 s, 80.3 MB/s 2024-09-19T05:44:02.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.529 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132485 s, 79.1 MB/s 2024-09-19T05:44:02.545 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.545 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.545 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125989 s, 83.2 MB/s 2024-09-19T05:44:02.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.561 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129947 s, 80.7 MB/s 2024-09-19T05:44:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106979 s, 98.0 MB/s 2024-09-19T05:44:02.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.593 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143132 s, 73.3 MB/s 2024-09-19T05:44:02.607 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.607 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.607 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118327 s, 88.6 MB/s 2024-09-19T05:44:02.623 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.623 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.624 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128925 s, 81.3 MB/s 2024-09-19T05:44:02.639 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131229 s, 79.9 MB/s 2024-09-19T05:44:02.656 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.656 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.656 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131104 s, 80.0 MB/s 2024-09-19T05:44:02.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.672 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129156 s, 81.2 MB/s 2024-09-19T05:44:02.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:02.680 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:02.681 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:02.681 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.5 2024-09-19T05:44:02.681 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:02.681 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:02.681 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:02.681 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:02.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:02.792 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015836 s, 66.2 MB/s 2024-09-19T05:44:02.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.809 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134155 s, 78.2 MB/s 2024-09-19T05:44:02.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.825 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123662 s, 84.8 MB/s 2024-09-19T05:44:02.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.842 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140172 s, 74.8 MB/s 2024-09-19T05:44:02.856 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.856 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.856 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105151 s, 99.7 MB/s 2024-09-19T05:44:02.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.874 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143884 s, 72.9 MB/s 2024-09-19T05:44:02.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.888 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104751 s, 100 MB/s 2024-09-19T05:44:02.903 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.903 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.903 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113746 s, 92.2 MB/s 2024-09-19T05:44:02.919 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.920 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.920 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133048 s, 78.8 MB/s 2024-09-19T05:44:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.934 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113241 s, 92.6 MB/s 2024-09-19T05:44:02.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.945 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904734 s, 116 MB/s 2024-09-19T05:44:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012192 s, 86.0 MB/s 2024-09-19T05:44:02.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.973 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102363 s, 102 MB/s 2024-09-19T05:44:02.986 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.986 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.986 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104791 s, 100 MB/s 2024-09-19T05:44:02.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:02.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:02.999 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109062 s, 96.1 MB/s 2024-09-19T05:44:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111832 s, 93.8 MB/s 2024-09-19T05:44:03.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.029 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129066 s, 81.2 MB/s 2024-09-19T05:44:03.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.044 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123163 s, 85.1 MB/s 2024-09-19T05:44:03.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.057 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996673 s, 105 MB/s 2024-09-19T05:44:03.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.072 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124378 s, 84.3 MB/s 2024-09-19T05:44:03.087 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.087 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.087 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122269 s, 85.8 MB/s 2024-09-19T05:44:03.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.102 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116673 s, 89.9 MB/s 2024-09-19T05:44:03.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.117 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.117 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118987 s, 88.1 MB/s 2024-09-19T05:44:03.132 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.132 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.133 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129053 s, 81.3 MB/s 2024-09-19T05:44:03.147 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.147 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.147 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119588 s, 87.7 MB/s 2024-09-19T05:44:03.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.162 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106218 s, 98.7 MB/s 2024-09-19T05:44:03.175 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.175 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.175 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107452 s, 97.6 MB/s 2024-09-19T05:44:03.191 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.191 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.191 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122953 s, 85.3 MB/s 2024-09-19T05:44:03.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.204 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952171 s, 110 MB/s 2024-09-19T05:44:03.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.218 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113371 s, 92.5 MB/s 2024-09-19T05:44:03.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.233 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127268 s, 82.4 MB/s 2024-09-19T05:44:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935698 s, 112 MB/s 2024-09-19T05:44:03.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:03.253 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:03.253 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:03.253 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.6 2024-09-19T05:44:03.253 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:03.253 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:03.254 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:03.254 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:03.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110305 s, 95.1 MB/s 2024-09-19T05:44:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.331 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126927 s, 82.6 MB/s 2024-09-19T05:44:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883105 s, 119 MB/s 2024-09-19T05:44:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.358 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129774 s, 80.8 MB/s 2024-09-19T05:44:03.369 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.369 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.370 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901949 s, 116 MB/s 2024-09-19T05:44:03.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.383 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113113 s, 92.7 MB/s 2024-09-19T05:44:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124632 s, 84.1 MB/s 2024-09-19T05:44:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.414 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130791 s, 80.2 MB/s 2024-09-19T05:44:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888224 s, 118 MB/s 2024-09-19T05:44:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902626 s, 116 MB/s 2024-09-19T05:44:03.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.453 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117248 s, 89.4 MB/s 2024-09-19T05:44:03.466 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.466 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.466 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108756 s, 96.4 MB/s 2024-09-19T05:44:03.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.481 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118769 s, 88.3 MB/s 2024-09-19T05:44:03.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.496 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118271 s, 88.7 MB/s 2024-09-19T05:44:03.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.507 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870842 s, 120 MB/s 2024-09-19T05:44:03.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.521 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107668 s, 97.4 MB/s 2024-09-19T05:44:03.535 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.535 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.535 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111663 s, 93.9 MB/s 2024-09-19T05:44:03.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.546 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857095 s, 122 MB/s 2024-09-19T05:44:03.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.559 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987599 s, 106 MB/s 2024-09-19T05:44:03.573 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.573 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.573 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110294 s, 95.1 MB/s 2024-09-19T05:44:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.587 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115043 s, 91.1 MB/s 2024-09-19T05:44:03.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.601 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112183 s, 93.5 MB/s 2024-09-19T05:44:03.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.613 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912937 s, 115 MB/s 2024-09-19T05:44:03.626 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.626 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.626 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104363 s, 100 MB/s 2024-09-19T05:44:03.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.639 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916691 s, 114 MB/s 2024-09-19T05:44:03.652 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.652 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.652 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107774 s, 97.3 MB/s 2024-09-19T05:44:03.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.667 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.667 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117222 s, 89.5 MB/s 2024-09-19T05:44:03.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.681 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110133 s, 95.2 MB/s 2024-09-19T05:44:03.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.692 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.692 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830809 s, 126 MB/s 2024-09-19T05:44:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117307 s, 89.4 MB/s 2024-09-19T05:44:03.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.722 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132948 s, 78.9 MB/s 2024-09-19T05:44:03.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.738 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130997 s, 80.0 MB/s 2024-09-19T05:44:03.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:03.746 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:03.746 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:03.746 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.7 2024-09-19T05:44:03.746 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:03.746 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:03.746 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:03.746 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:03.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.861 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100634 s, 104 MB/s 2024-09-19T05:44:03.875 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.875 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.876 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113947 s, 92.0 MB/s 2024-09-19T05:44:03.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.891 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121684 s, 86.2 MB/s 2024-09-19T05:44:03.906 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.906 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.906 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114503 s, 91.6 MB/s 2024-09-19T05:44:03.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.922 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126666 s, 82.8 MB/s 2024-09-19T05:44:03.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.935 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009169 s, 114 MB/s 2024-09-19T05:44:03.950 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.950 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.950 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117542 s, 89.2 MB/s 2024-09-19T05:44:03.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.967 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129761 s, 80.8 MB/s 2024-09-19T05:44:03.983 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.983 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.983 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012738 s, 82.3 MB/s 2024-09-19T05:44:03.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:03.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:03.999 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126889 s, 82.6 MB/s 2024-09-19T05:44:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983154 s, 107 MB/s 2024-09-19T05:44:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896901 s, 117 MB/s 2024-09-19T05:44:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.039 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106168 s, 98.8 MB/s 2024-09-19T05:44:04.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.052 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.052 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859669 s, 122 MB/s 2024-09-19T05:44:04.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.067 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122166 s, 85.8 MB/s 2024-09-19T05:44:04.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.082 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110875 s, 94.6 MB/s 2024-09-19T05:44:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110627 s, 94.8 MB/s 2024-09-19T05:44:04.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.112 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124063 s, 84.5 MB/s 2024-09-19T05:44:04.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.127 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114918 s, 91.2 MB/s 2024-09-19T05:44:04.144 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.144 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.144 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121795 s, 86.1 MB/s 2024-09-19T05:44:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118796 s, 88.3 MB/s 2024-09-19T05:44:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103412 s, 101 MB/s 2024-09-19T05:44:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113719 s, 92.2 MB/s 2024-09-19T05:44:04.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.207 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128971 s, 81.3 MB/s 2024-09-19T05:44:04.221 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.221 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.221 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108223 s, 96.9 MB/s 2024-09-19T05:44:04.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.237 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129186 s, 81.2 MB/s 2024-09-19T05:44:04.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.251 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110037 s, 95.3 MB/s 2024-09-19T05:44:04.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.267 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.267 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127883 s, 82.0 MB/s 2024-09-19T05:44:04.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.282 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126624 s, 82.8 MB/s 2024-09-19T05:44:04.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.295 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100645 s, 104 MB/s 2024-09-19T05:44:04.310 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.310 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.310 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011931 s, 87.9 MB/s 2024-09-19T05:44:04.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.326 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127322 s, 82.4 MB/s 2024-09-19T05:44:04.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:04.334 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:04.334 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:04.334 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.8 2024-09-19T05:44:04.334 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:04.334 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:04.334 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:04.334 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:04.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:04.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.393 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102963 s, 102 MB/s 2024-09-19T05:44:04.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.406 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010961 s, 95.7 MB/s 2024-09-19T05:44:04.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.420 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108547 s, 96.6 MB/s 2024-09-19T05:44:04.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.436 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124657 s, 84.1 MB/s 2024-09-19T05:44:04.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.450 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.450 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109445 s, 95.8 MB/s 2024-09-19T05:44:04.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.465 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123124 s, 85.2 MB/s 2024-09-19T05:44:04.478 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.479 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110356 s, 95.0 MB/s 2024-09-19T05:44:04.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.491 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932493 s, 112 MB/s 2024-09-19T05:44:04.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.502 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885867 s, 118 MB/s 2024-09-19T05:44:04.515 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.515 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.515 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010383 s, 101 MB/s 2024-09-19T05:44:04.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.530 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117601 s, 89.2 MB/s 2024-09-19T05:44:04.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.539 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765489 s, 137 MB/s 2024-09-19T05:44:04.552 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.552 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.552 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105413 s, 99.5 MB/s 2024-09-19T05:44:04.564 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.564 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.564 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985646 s, 106 MB/s 2024-09-19T05:44:04.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.577 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109005 s, 96.2 MB/s 2024-09-19T05:44:04.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976712 s, 107 MB/s 2024-09-19T05:44:04.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984402 s, 107 MB/s 2024-09-19T05:44:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120712 s, 86.9 MB/s 2024-09-19T05:44:04.629 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.629 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.629 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107355 s, 97.7 MB/s 2024-09-19T05:44:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126515 s, 82.9 MB/s 2024-09-19T05:44:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104151 s, 101 MB/s 2024-09-19T05:44:04.671 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.671 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.671 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120253 s, 87.2 MB/s 2024-09-19T05:44:04.683 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.683 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.684 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981731 s, 107 MB/s 2024-09-19T05:44:04.700 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.701 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.701 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120802 s, 86.8 MB/s 2024-09-19T05:44:04.709 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.710 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.710 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946549 s, 111 MB/s 2024-09-19T05:44:04.721 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.722 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954631 s, 110 MB/s 2024-09-19T05:44:04.735 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.735 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.735 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110793 s, 94.6 MB/s 2024-09-19T05:44:04.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.749 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119002 s, 88.1 MB/s 2024-09-19T05:44:04.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.759 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759498 s, 138 MB/s 2024-09-19T05:44:04.771 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.772 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.772 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102535 s, 102 MB/s 2024-09-19T05:44:04.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.786 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122902 s, 85.3 MB/s 2024-09-19T05:44:04.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.798 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986811 s, 106 MB/s 2024-09-19T05:44:04.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:04.804 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:04.805 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:04.805 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.9 2024-09-19T05:44:04.805 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:04.805 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:04.805 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:04.805 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:04.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:04.906 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.906 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.906 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817102 s, 128 MB/s 2024-09-19T05:44:04.920 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.920 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.920 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105018 s, 99.8 MB/s 2024-09-19T05:44:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.933 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101696 s, 103 MB/s 2024-09-19T05:44:04.947 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.948 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117261 s, 89.4 MB/s 2024-09-19T05:44:04.964 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.964 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.964 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134138 s, 78.2 MB/s 2024-09-19T05:44:04.980 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.980 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.980 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132392 s, 79.2 MB/s 2024-09-19T05:44:04.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:04.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:04.994 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107739 s, 97.3 MB/s 2024-09-19T05:44:05.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.008 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117464 s, 89.3 MB/s 2024-09-19T05:44:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100503 s, 104 MB/s 2024-09-19T05:44:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141986 s, 73.9 MB/s 2024-09-19T05:44:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110375 s, 95.0 MB/s 2024-09-19T05:44:05.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.066 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121073 s, 86.6 MB/s 2024-09-19T05:44:05.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.080 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116123 s, 90.3 MB/s 2024-09-19T05:44:05.092 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.092 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.092 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881997 s, 119 MB/s 2024-09-19T05:44:05.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.102 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753383 s, 139 MB/s 2024-09-19T05:44:05.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.116 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113467 s, 92.4 MB/s 2024-09-19T05:44:05.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107906 s, 97.2 MB/s 2024-09-19T05:44:05.143 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.143 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.143 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105638 s, 99.3 MB/s 2024-09-19T05:44:05.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.157 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109364 s, 95.9 MB/s 2024-09-19T05:44:05.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.171 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113395 s, 92.5 MB/s 2024-09-19T05:44:05.186 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.187 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.187 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127279 s, 82.4 MB/s 2024-09-19T05:44:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111265 s, 94.2 MB/s 2024-09-19T05:44:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011063 s, 94.8 MB/s 2024-09-19T05:44:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108147 s, 97.0 MB/s 2024-09-19T05:44:05.240 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.240 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.240 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111084 s, 94.4 MB/s 2024-09-19T05:44:05.254 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.254 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.255 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115323 s, 90.9 MB/s 2024-09-19T05:44:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111053 s, 94.4 MB/s 2024-09-19T05:44:05.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.281 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106451 s, 98.5 MB/s 2024-09-19T05:44:05.296 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.296 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.296 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122453 s, 85.6 MB/s 2024-09-19T05:44:05.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.308 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100607 s, 104 MB/s 2024-09-19T05:44:05.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.321 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107901 s, 97.2 MB/s 2024-09-19T05:44:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108316 s, 96.8 MB/s 2024-09-19T05:44:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:05.341 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:05.341 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:05.341 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.10 2024-09-19T05:44:05.341 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:05.341 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:05.341 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:05.341 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:05.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:05.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.396 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010995 s, 95.4 MB/s 2024-09-19T05:44:05.410 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.410 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.410 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116982 s, 89.6 MB/s 2024-09-19T05:44:05.423 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.423 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.423 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107786 s, 97.3 MB/s 2024-09-19T05:44:05.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972552 s, 108 MB/s 2024-09-19T05:44:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112434 s, 93.3 MB/s 2024-09-19T05:44:05.458 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.459 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731242 s, 143 MB/s 2024-09-19T05:44:05.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.468 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762592 s, 138 MB/s 2024-09-19T05:44:05.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.480 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915443 s, 115 MB/s 2024-09-19T05:44:05.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.489 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074395 s, 141 MB/s 2024-09-19T05:44:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112958 s, 92.8 MB/s 2024-09-19T05:44:05.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.519 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119091 s, 88.0 MB/s 2024-09-19T05:44:05.532 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.532 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.532 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011065 s, 94.8 MB/s 2024-09-19T05:44:05.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.544 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967708 s, 108 MB/s 2024-09-19T05:44:05.557 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.558 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.558 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104342 s, 100 MB/s 2024-09-19T05:44:05.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.571 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101804 s, 103 MB/s 2024-09-19T05:44:05.582 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.582 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.582 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817836 s, 128 MB/s 2024-09-19T05:44:05.597 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.598 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.598 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012024 s, 87.2 MB/s 2024-09-19T05:44:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.612 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.612 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110884 s, 94.6 MB/s 2024-09-19T05:44:05.626 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.626 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.626 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111501 s, 94.0 MB/s 2024-09-19T05:44:05.641 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.642 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.642 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117929 s, 88.9 MB/s 2024-09-19T05:44:05.655 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.656 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.656 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100383 s, 104 MB/s 2024-09-19T05:44:05.670 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.670 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.670 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011779 s, 89.0 MB/s 2024-09-19T05:44:05.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.685 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112883 s, 92.9 MB/s 2024-09-19T05:44:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138705 s, 75.6 MB/s 2024-09-19T05:44:05.721 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.722 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121387 s, 86.4 MB/s 2024-09-19T05:44:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135 s, 77.7 MB/s 2024-09-19T05:44:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113097 s, 92.7 MB/s 2024-09-19T05:44:05.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.773 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128584 s, 81.5 MB/s 2024-09-19T05:44:05.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.791 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120941 s, 86.7 MB/s 2024-09-19T05:44:05.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.809 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123514 s, 84.9 MB/s 2024-09-19T05:44:05.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.826 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120585 s, 87.0 MB/s 2024-09-19T05:44:05.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.843 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110262 s, 95.1 MB/s 2024-09-19T05:44:05.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:05.850 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:05.850 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:05.850 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.11 2024-09-19T05:44:05.850 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:05.850 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:05.851 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:05.851 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:05.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:05.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.960 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123041 s, 85.2 MB/s 2024-09-19T05:44:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124757 s, 84.0 MB/s 2024-09-19T05:44:05.991 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:05.991 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:05.991 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113162 s, 92.7 MB/s 2024-09-19T05:44:06.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.005 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100686 s, 104 MB/s 2024-09-19T05:44:06.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.022 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128923 s, 81.3 MB/s 2024-09-19T05:44:06.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.039 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130976 s, 80.1 MB/s 2024-09-19T05:44:06.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.055 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119671 s, 87.6 MB/s 2024-09-19T05:44:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116961 s, 89.7 MB/s 2024-09-19T05:44:06.086 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.086 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.086 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112587 s, 93.1 MB/s 2024-09-19T05:44:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.102 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122964 s, 85.3 MB/s 2024-09-19T05:44:06.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.116 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010026 s, 105 MB/s 2024-09-19T05:44:06.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.133 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130751 s, 80.2 MB/s 2024-09-19T05:44:06.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.149 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122935 s, 85.3 MB/s 2024-09-19T05:44:06.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.167 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137703 s, 76.1 MB/s 2024-09-19T05:44:06.187 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.188 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011937 s, 87.8 MB/s 2024-09-19T05:44:06.200 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.202 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.202 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996496 s, 105 MB/s 2024-09-19T05:44:06.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.216 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.216 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012515 s, 83.8 MB/s 2024-09-19T05:44:06.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.231 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130022 s, 80.6 MB/s 2024-09-19T05:44:06.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.245 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110437 s, 94.9 MB/s 2024-09-19T05:44:06.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.262 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140465 s, 74.7 MB/s 2024-09-19T05:44:06.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.277 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126117 s, 83.1 MB/s 2024-09-19T05:44:06.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.292 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115305 s, 90.9 MB/s 2024-09-19T05:44:06.307 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.307 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.307 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125648 s, 83.5 MB/s 2024-09-19T05:44:06.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.321 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113924 s, 92.0 MB/s 2024-09-19T05:44:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119311 s, 87.9 MB/s 2024-09-19T05:44:06.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.350 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113712 s, 92.2 MB/s 2024-09-19T05:44:06.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117378 s, 89.3 MB/s 2024-09-19T05:44:06.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.380 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.380 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127449 s, 82.3 MB/s 2024-09-19T05:44:06.394 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.395 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122537 s, 85.6 MB/s 2024-09-19T05:44:06.408 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.408 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.408 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109653 s, 95.6 MB/s 2024-09-19T05:44:06.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.423 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.423 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117944 s, 88.9 MB/s 2024-09-19T05:44:06.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962487 s, 109 MB/s 2024-09-19T05:44:06.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:06.442 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:06.442 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:06.443 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.12 2024-09-19T05:44:06.443 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:06.443 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:06.443 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:06.443 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:06.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:06.548 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.548 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.548 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125295 s, 83.7 MB/s 2024-09-19T05:44:06.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.565 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131467 s, 79.8 MB/s 2024-09-19T05:44:06.578 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.578 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.578 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106234 s, 98.7 MB/s 2024-09-19T05:44:06.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.591 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.591 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994174 s, 105 MB/s 2024-09-19T05:44:06.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.604 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103327 s, 101 MB/s 2024-09-19T05:44:06.618 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.619 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.619 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124863 s, 84.0 MB/s 2024-09-19T05:44:06.634 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.634 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.634 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012347 s, 84.9 MB/s 2024-09-19T05:44:06.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.647 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106557 s, 98.4 MB/s 2024-09-19T05:44:06.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130753 s, 80.2 MB/s 2024-09-19T05:44:06.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.677 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118364 s, 88.6 MB/s 2024-09-19T05:44:06.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.693 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131471 s, 79.8 MB/s 2024-09-19T05:44:06.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.708 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115668 s, 90.7 MB/s 2024-09-19T05:44:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.722 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110692 s, 94.7 MB/s 2024-09-19T05:44:06.735 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.736 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.736 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115626 s, 90.7 MB/s 2024-09-19T05:44:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120959 s, 86.7 MB/s 2024-09-19T05:44:06.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.765 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115805 s, 90.5 MB/s 2024-09-19T05:44:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125052 s, 83.9 MB/s 2024-09-19T05:44:06.796 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.796 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.796 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130932 s, 80.1 MB/s 2024-09-19T05:44:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120485 s, 87.0 MB/s 2024-09-19T05:44:06.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.826 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120822 s, 86.8 MB/s 2024-09-19T05:44:06.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.843 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132064 s, 79.4 MB/s 2024-09-19T05:44:06.858 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.858 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.858 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124612 s, 84.1 MB/s 2024-09-19T05:44:06.873 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.874 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129062 s, 81.2 MB/s 2024-09-19T05:44:06.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.888 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116325 s, 90.1 MB/s 2024-09-19T05:44:06.903 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.903 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.904 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01249 s, 84.0 MB/s 2024-09-19T05:44:06.918 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.918 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.918 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118185 s, 88.7 MB/s 2024-09-19T05:44:06.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.933 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115049 s, 91.1 MB/s 2024-09-19T05:44:06.949 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.949 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.950 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130252 s, 80.5 MB/s 2024-09-19T05:44:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124593 s, 84.2 MB/s 2024-09-19T05:44:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103348 s, 101 MB/s 2024-09-19T05:44:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125279 s, 83.7 MB/s 2024-09-19T05:44:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129196 s, 81.2 MB/s 2024-09-19T05:44:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:07.019 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:07.019 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:07.019 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.13 2024-09-19T05:44:07.019 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:07.019 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:07.019 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:07.019 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:07.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.136 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123817 s, 84.7 MB/s 2024-09-19T05:44:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.154 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.154 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014138 s, 74.2 MB/s 2024-09-19T05:44:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149424 s, 70.2 MB/s 2024-09-19T05:44:07.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.197 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128583 s, 81.5 MB/s 2024-09-19T05:44:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.210 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107335 s, 97.7 MB/s 2024-09-19T05:44:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930586 s, 113 MB/s 2024-09-19T05:44:07.236 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.237 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011551 s, 90.8 MB/s 2024-09-19T05:44:07.248 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.248 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.248 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878238 s, 119 MB/s 2024-09-19T05:44:07.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.263 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112432 s, 93.3 MB/s 2024-09-19T05:44:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123588 s, 84.8 MB/s 2024-09-19T05:44:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099761 s, 105 MB/s 2024-09-19T05:44:07.304 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.304 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.305 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112799 s, 93.0 MB/s 2024-09-19T05:44:07.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.321 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129061 s, 81.2 MB/s 2024-09-19T05:44:07.335 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.335 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.336 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120362 s, 87.1 MB/s 2024-09-19T05:44:07.348 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.348 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.348 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980891 s, 107 MB/s 2024-09-19T05:44:07.363 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.364 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130985 s, 80.1 MB/s 2024-09-19T05:44:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136112 s, 77.0 MB/s 2024-09-19T05:44:07.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.397 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123131 s, 85.2 MB/s 2024-09-19T05:44:07.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.412 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127332 s, 82.3 MB/s 2024-09-19T05:44:07.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.428 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128033 s, 81.9 MB/s 2024-09-19T05:44:07.442 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.442 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.442 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111415 s, 94.1 MB/s 2024-09-19T05:44:07.458 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.458 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.458 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124712 s, 84.1 MB/s 2024-09-19T05:44:07.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.473 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118031 s, 88.8 MB/s 2024-09-19T05:44:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141402 s, 74.2 MB/s 2024-09-19T05:44:07.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.505 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.505 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011378 s, 92.2 MB/s 2024-09-19T05:44:07.520 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.521 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120363 s, 87.1 MB/s 2024-09-19T05:44:07.535 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124267 s, 84.4 MB/s 2024-09-19T05:44:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.551 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122412 s, 85.7 MB/s 2024-09-19T05:44:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.570 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149202 s, 70.3 MB/s 2024-09-19T05:44:07.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.584 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106537 s, 98.4 MB/s 2024-09-19T05:44:07.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.600 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129284 s, 81.1 MB/s 2024-09-19T05:44:07.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.616 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127672 s, 82.1 MB/s 2024-09-19T05:44:07.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:07.625 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:07.625 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:07.625 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.14 2024-09-19T05:44:07.625 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:07.625 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:07.626 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:07.626 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:07.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:07.695 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.695 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.695 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011206 s, 93.6 MB/s 2024-09-19T05:44:07.709 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.710 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116954 s, 89.7 MB/s 2024-09-19T05:44:07.724 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.724 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.724 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112649 s, 93.1 MB/s 2024-09-19T05:44:07.739 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.739 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.739 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124239 s, 84.4 MB/s 2024-09-19T05:44:07.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.755 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125431 s, 83.6 MB/s 2024-09-19T05:44:07.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.770 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114585 s, 91.5 MB/s 2024-09-19T05:44:07.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.786 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125639 s, 83.5 MB/s 2024-09-19T05:44:07.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.801 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125319 s, 83.7 MB/s 2024-09-19T05:44:07.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.817 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119742 s, 87.6 MB/s 2024-09-19T05:44:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118088 s, 88.8 MB/s 2024-09-19T05:44:07.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.850 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.850 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140301 s, 74.7 MB/s 2024-09-19T05:44:07.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.867 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.867 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133876 s, 78.3 MB/s 2024-09-19T05:44:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.885 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137744 s, 76.1 MB/s 2024-09-19T05:44:07.900 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.900 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.900 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122053 s, 85.9 MB/s 2024-09-19T05:44:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117499 s, 89.2 MB/s 2024-09-19T05:44:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139864 s, 75.0 MB/s 2024-09-19T05:44:07.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.945 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110909 s, 94.5 MB/s 2024-09-19T05:44:07.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.959 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103641 s, 101 MB/s 2024-09-19T05:44:07.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.974 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123851 s, 84.7 MB/s 2024-09-19T05:44:07.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:07.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110591 s, 94.8 MB/s 2024-09-19T05:44:08.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.001 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110863 s, 94.6 MB/s 2024-09-19T05:44:08.014 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.014 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.015 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107523 s, 97.5 MB/s 2024-09-19T05:44:08.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.028 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01069 s, 98.1 MB/s 2024-09-19T05:44:08.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.043 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120733 s, 86.9 MB/s 2024-09-19T05:44:08.056 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.056 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.056 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102158 s, 103 MB/s 2024-09-19T05:44:08.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.070 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.070 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103868 s, 101 MB/s 2024-09-19T05:44:08.083 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.083 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.083 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104541 s, 100 MB/s 2024-09-19T05:44:08.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.099 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01205 s, 87.0 MB/s 2024-09-19T05:44:08.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.109 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785877 s, 133 MB/s 2024-09-19T05:44:08.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.122 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105146 s, 99.7 MB/s 2024-09-19T05:44:08.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.135 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104457 s, 100 MB/s 2024-09-19T05:44:08.148 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.148 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.148 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104798 s, 100 MB/s 2024-09-19T05:44:08.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:08.156 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:08.156 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:08.156 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.15 2024-09-19T05:44:08.156 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:08.156 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:08.156 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:08.156 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:08.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120632 s, 86.9 MB/s 2024-09-19T05:44:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114414 s, 91.6 MB/s 2024-09-19T05:44:08.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.263 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100985 s, 104 MB/s 2024-09-19T05:44:08.279 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.279 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.279 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124331 s, 84.3 MB/s 2024-09-19T05:44:08.294 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.295 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128053 s, 81.9 MB/s 2024-09-19T05:44:08.310 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.310 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.310 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123539 s, 84.9 MB/s 2024-09-19T05:44:08.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.326 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100071 s, 105 MB/s 2024-09-19T05:44:08.335 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.335 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.335 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944901 s, 111 MB/s 2024-09-19T05:44:08.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.350 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115308 s, 90.9 MB/s 2024-09-19T05:44:08.366 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.366 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.367 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130964 s, 80.1 MB/s 2024-09-19T05:44:08.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.381 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118323 s, 88.6 MB/s 2024-09-19T05:44:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104844 s, 100 MB/s 2024-09-19T05:44:08.408 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.408 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.408 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961774 s, 109 MB/s 2024-09-19T05:44:08.424 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.424 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.424 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133355 s, 78.6 MB/s 2024-09-19T05:44:08.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.438 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104054 s, 101 MB/s 2024-09-19T05:44:08.453 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.453 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.453 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124387 s, 84.3 MB/s 2024-09-19T05:44:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.466 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993776 s, 106 MB/s 2024-09-19T05:44:08.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.479 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097233 s, 108 MB/s 2024-09-19T05:44:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124485 s, 84.2 MB/s 2024-09-19T05:44:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.510 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120605 s, 86.9 MB/s 2024-09-19T05:44:08.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.523 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106463 s, 98.5 MB/s 2024-09-19T05:44:08.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.541 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01425 s, 73.6 MB/s 2024-09-19T05:44:08.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.556 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118384 s, 88.6 MB/s 2024-09-19T05:44:08.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.571 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123422 s, 85.0 MB/s 2024-09-19T05:44:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127519 s, 82.2 MB/s 2024-09-19T05:44:08.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.603 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132541 s, 79.1 MB/s 2024-09-19T05:44:08.618 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123428 s, 85.0 MB/s 2024-09-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.634 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130074 s, 80.6 MB/s 2024-09-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.649 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119491 s, 87.8 MB/s 2024-09-19T05:44:08.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.664 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011519 s, 91.0 MB/s 2024-09-19T05:44:08.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.680 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012614 s, 83.1 MB/s 2024-09-19T05:44:08.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.697 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137353 s, 76.3 MB/s 2024-09-19T05:44:08.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:08.706 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:08.706 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:08.706 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.16 2024-09-19T05:44:08.706 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:08.706 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:08.706 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:08.706 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:08.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:08.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.777 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125108 s, 83.8 MB/s 2024-09-19T05:44:08.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.792 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.792 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01158 s, 90.6 MB/s 2024-09-19T05:44:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.807 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123883 s, 84.6 MB/s 2024-09-19T05:44:08.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.821 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106199 s, 98.7 MB/s 2024-09-19T05:44:08.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.837 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133988 s, 78.3 MB/s 2024-09-19T05:44:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110085 s, 95.3 MB/s 2024-09-19T05:44:08.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.873 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.873 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018552 s, 56.5 MB/s 2024-09-19T05:44:08.890 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.890 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.890 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139619 s, 75.1 MB/s 2024-09-19T05:44:08.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.907 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135106 s, 77.6 MB/s 2024-09-19T05:44:08.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.924 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138376 s, 75.8 MB/s 2024-09-19T05:44:08.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134219 s, 78.1 MB/s 2024-09-19T05:44:08.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.957 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123113 s, 85.2 MB/s 2024-09-19T05:44:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125502 s, 83.6 MB/s 2024-09-19T05:44:08.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:08.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:08.990 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128996 s, 81.3 MB/s 2024-09-19T05:44:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137205 s, 76.4 MB/s 2024-09-19T05:44:09.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.024 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014011 s, 74.8 MB/s 2024-09-19T05:44:09.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.039 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114012 s, 92.0 MB/s 2024-09-19T05:44:09.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.057 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146884 s, 71.4 MB/s 2024-09-19T05:44:09.075 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.075 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.075 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138676 s, 75.6 MB/s 2024-09-19T05:44:09.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.091 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128405 s, 81.7 MB/s 2024-09-19T05:44:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.108 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141889 s, 73.9 MB/s 2024-09-19T05:44:09.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.126 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138644 s, 75.6 MB/s 2024-09-19T05:44:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012821 s, 81.8 MB/s 2024-09-19T05:44:09.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.159 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140274 s, 74.8 MB/s 2024-09-19T05:44:09.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.176 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135113 s, 77.6 MB/s 2024-09-19T05:44:09.216 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.216 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.216 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132562 s, 79.1 MB/s 2024-09-19T05:44:09.235 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.235 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.235 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147526 s, 71.1 MB/s 2024-09-19T05:44:09.255 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.255 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.255 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153093 s, 68.5 MB/s 2024-09-19T05:44:09.274 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.274 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.275 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144532 s, 72.5 MB/s 2024-09-19T05:44:09.294 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.294 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.294 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144186 s, 72.7 MB/s 2024-09-19T05:44:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137884 s, 76.0 MB/s 2024-09-19T05:44:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.330 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137765 s, 76.1 MB/s 2024-09-19T05:44:09.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:09.340 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:09.340 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:09.340 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.17 2024-09-19T05:44:09.340 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:09.341 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:09.341 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:09.341 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:09.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127643 s, 82.1 MB/s 2024-09-19T05:44:09.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.428 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126722 s, 82.7 MB/s 2024-09-19T05:44:09.444 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.444 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.444 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126264 s, 83.0 MB/s 2024-09-19T05:44:09.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.460 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114049 s, 91.9 MB/s 2024-09-19T05:44:09.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.476 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131696 s, 79.6 MB/s 2024-09-19T05:44:09.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.491 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119927 s, 87.4 MB/s 2024-09-19T05:44:09.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.507 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122454 s, 85.6 MB/s 2024-09-19T05:44:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114074 s, 91.9 MB/s 2024-09-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.538 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125473 s, 83.6 MB/s 2024-09-19T05:44:09.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.554 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128845 s, 81.4 MB/s 2024-09-19T05:44:09.569 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.569 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.569 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124344 s, 84.3 MB/s 2024-09-19T05:44:09.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.584 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112157 s, 93.5 MB/s 2024-09-19T05:44:09.597 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.597 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.597 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100839 s, 104 MB/s 2024-09-19T05:44:09.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.613 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128 s, 81.9 MB/s 2024-09-19T05:44:09.629 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.629 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.629 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126574 s, 82.8 MB/s 2024-09-19T05:44:09.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.645 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126865 s, 82.7 MB/s 2024-09-19T05:44:09.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.662 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139985 s, 74.9 MB/s 2024-09-19T05:44:09.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.676 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110411 s, 95.0 MB/s 2024-09-19T05:44:09.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.691 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111469 s, 94.1 MB/s 2024-09-19T05:44:09.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.707 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130955 s, 80.1 MB/s 2024-09-19T05:44:09.720 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.720 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.720 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100776 s, 104 MB/s 2024-09-19T05:44:09.736 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.736 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.736 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012526 s, 83.7 MB/s 2024-09-19T05:44:09.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.750 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.750 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105034 s, 99.8 MB/s 2024-09-19T05:44:09.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.765 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122524 s, 85.6 MB/s 2024-09-19T05:44:09.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.782 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.782 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130828 s, 80.1 MB/s 2024-09-19T05:44:09.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.802 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125699 s, 83.4 MB/s 2024-09-19T05:44:09.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.815 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133635 s, 78.5 MB/s 2024-09-19T05:44:09.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.831 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137749 s, 76.1 MB/s 2024-09-19T05:44:09.848 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.848 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.848 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136514 s, 76.8 MB/s 2024-09-19T05:44:09.863 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.863 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.863 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124096 s, 84.5 MB/s 2024-09-19T05:44:09.879 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.879 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.880 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128002 s, 81.9 MB/s 2024-09-19T05:44:09.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.895 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128565 s, 81.6 MB/s 2024-09-19T05:44:09.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:09.904 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:09.904 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:09.904 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.18 2024-09-19T05:44:09.904 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:09.904 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:09.905 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:09.905 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:09.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:09.970 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.971 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.971 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108778 s, 96.4 MB/s 2024-09-19T05:44:09.986 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:09.986 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:09.986 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128602 s, 81.5 MB/s 2024-09-19T05:44:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124152 s, 84.5 MB/s 2024-09-19T05:44:10.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862592 s, 122 MB/s 2024-09-19T05:44:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123511 s, 84.9 MB/s 2024-09-19T05:44:10.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.044 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134222 s, 78.1 MB/s 2024-09-19T05:44:10.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.057 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107261 s, 97.8 MB/s 2024-09-19T05:44:10.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.072 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116924 s, 89.7 MB/s 2024-09-19T05:44:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.086 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011116 s, 94.3 MB/s 2024-09-19T05:44:10.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.098 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961234 s, 109 MB/s 2024-09-19T05:44:10.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.112 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111365 s, 94.2 MB/s 2024-09-19T05:44:10.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.127 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123199 s, 85.1 MB/s 2024-09-19T05:44:10.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.141 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113778 s, 92.2 MB/s 2024-09-19T05:44:10.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.156 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118158 s, 88.7 MB/s 2024-09-19T05:44:10.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102 s, 103 MB/s 2024-09-19T05:44:10.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.190 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180188 s, 58.2 MB/s 2024-09-19T05:44:10.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.214 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111072 s, 94.4 MB/s 2024-09-19T05:44:10.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.227 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106933 s, 98.1 MB/s 2024-09-19T05:44:10.241 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.241 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.241 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114328 s, 91.7 MB/s 2024-09-19T05:44:10.256 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.257 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.257 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122221 s, 85.8 MB/s 2024-09-19T05:44:10.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.274 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.274 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013443 s, 78.0 MB/s 2024-09-19T05:44:10.289 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.290 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128526 s, 81.6 MB/s 2024-09-19T05:44:10.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.305 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118812 s, 88.3 MB/s 2024-09-19T05:44:10.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.320 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119391 s, 87.8 MB/s 2024-09-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.337 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974289 s, 108 MB/s 2024-09-19T05:44:10.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.350 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130647 s, 80.3 MB/s 2024-09-19T05:44:10.367 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.367 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.367 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133138 s, 78.8 MB/s 2024-09-19T05:44:10.382 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.383 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119641 s, 87.6 MB/s 2024-09-19T05:44:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131684 s, 79.6 MB/s 2024-09-19T05:44:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118861 s, 88.2 MB/s 2024-09-19T05:44:10.430 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.430 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.430 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119784 s, 87.5 MB/s 2024-09-19T05:44:10.448 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.448 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.448 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144962 s, 72.3 MB/s 2024-09-19T05:44:10.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:10.457 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:10.457 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:10.457 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.19 2024-09-19T05:44:10.457 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:10.457 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:10.457 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:10.457 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:10.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:10.527 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.527 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.527 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012183 s, 86.1 MB/s 2024-09-19T05:44:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124745 s, 84.1 MB/s 2024-09-19T05:44:10.556 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115685 s, 90.6 MB/s 2024-09-19T05:44:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125784 s, 83.4 MB/s 2024-09-19T05:44:10.587 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.587 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.587 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01145 s, 91.6 MB/s 2024-09-19T05:44:10.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.603 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136711 s, 76.7 MB/s 2024-09-19T05:44:10.613 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:44:10.615 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:44:10.618 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.618 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.618 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116121 s, 90.3 MB/s 2024-09-19T05:44:10.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.633 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120131 s, 87.3 MB/s 2024-09-19T05:44:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113274 s, 92.6 MB/s 2024-09-19T05:44:10.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.664 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012984 s, 80.8 MB/s 2024-09-19T05:44:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113568 s, 92.3 MB/s 2024-09-19T05:44:10.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.694 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123138 s, 85.2 MB/s 2024-09-19T05:44:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.710 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122473 s, 85.6 MB/s 2024-09-19T05:44:10.726 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.726 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.727 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132013 s, 79.4 MB/s 2024-09-19T05:44:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103273 s, 102 MB/s 2024-09-19T05:44:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117669 s, 89.1 MB/s 2024-09-19T05:44:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119992 s, 87.4 MB/s 2024-09-19T05:44:10.787 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.787 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.787 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131151 s, 80.0 MB/s 2024-09-19T05:44:10.803 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.804 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.804 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134726 s, 77.8 MB/s 2024-09-19T05:44:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113241 s, 92.6 MB/s 2024-09-19T05:44:10.833 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.833 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.833 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112865 s, 92.9 MB/s 2024-09-19T05:44:10.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.849 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130294 s, 80.5 MB/s 2024-09-19T05:44:10.864 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.864 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.864 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110537 s, 94.9 MB/s 2024-09-19T05:44:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122715 s, 85.4 MB/s 2024-09-19T05:44:10.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.896 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137606 s, 76.2 MB/s 2024-09-19T05:44:10.908 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.908 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.909 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961224 s, 109 MB/s 2024-09-19T05:44:10.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.924 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124738 s, 84.1 MB/s 2024-09-19T05:44:10.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.940 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132212 s, 79.3 MB/s 2024-09-19T05:44:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125362 s, 83.6 MB/s 2024-09-19T05:44:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.970 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101065 s, 104 MB/s 2024-09-19T05:44:10.985 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:10.986 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:10.986 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012815 s, 81.8 MB/s 2024-09-19T05:44:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133362 s, 78.6 MB/s 2024-09-19T05:44:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:11.011 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:11.011 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:11.011 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.20 2024-09-19T05:44:11.011 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:11.011 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:11.012 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:11.012 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:11.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:11.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.125 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106644 s, 98.3 MB/s 2024-09-19T05:44:11.139 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.139 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.139 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117476 s, 89.3 MB/s 2024-09-19T05:44:11.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.153 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107362 s, 97.7 MB/s 2024-09-19T05:44:11.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.167 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115382 s, 90.9 MB/s 2024-09-19T05:44:11.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.179 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854107 s, 123 MB/s 2024-09-19T05:44:11.200 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.201 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.201 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014488 s, 72.4 MB/s 2024-09-19T05:44:11.220 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.220 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.220 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136077 s, 77.1 MB/s 2024-09-19T05:44:11.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.235 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.235 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118933 s, 88.2 MB/s 2024-09-19T05:44:11.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127958 s, 81.9 MB/s 2024-09-19T05:44:11.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.266 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121805 s, 86.1 MB/s 2024-09-19T05:44:11.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.283 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143115 s, 73.3 MB/s 2024-09-19T05:44:11.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.298 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119302 s, 87.9 MB/s 2024-09-19T05:44:11.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.313 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121918 s, 86.0 MB/s 2024-09-19T05:44:11.329 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.329 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.329 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118501 s, 88.5 MB/s 2024-09-19T05:44:11.345 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.345 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.345 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132597 s, 79.1 MB/s 2024-09-19T05:44:11.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.362 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129738 s, 80.8 MB/s 2024-09-19T05:44:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116149 s, 90.3 MB/s 2024-09-19T05:44:11.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.392 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125703 s, 83.4 MB/s 2024-09-19T05:44:11.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.407 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.407 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119344 s, 87.9 MB/s 2024-09-19T05:44:11.423 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.423 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.423 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137941 s, 76.0 MB/s 2024-09-19T05:44:11.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.437 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108631 s, 96.5 MB/s 2024-09-19T05:44:11.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121478 s, 86.3 MB/s 2024-09-19T05:44:11.466 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115757 s, 90.6 MB/s 2024-09-19T05:44:11.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120034 s, 87.4 MB/s 2024-09-19T05:44:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.495 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103356 s, 101 MB/s 2024-09-19T05:44:11.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112855 s, 92.9 MB/s 2024-09-19T05:44:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120435 s, 87.1 MB/s 2024-09-19T05:44:11.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.539 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111772 s, 93.8 MB/s 2024-09-19T05:44:11.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.554 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124817 s, 84.0 MB/s 2024-09-19T05:44:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147975 s, 70.9 MB/s 2024-09-19T05:44:11.588 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.588 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.588 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124659 s, 84.1 MB/s 2024-09-19T05:44:11.604 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.604 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.604 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128423 s, 81.7 MB/s 2024-09-19T05:44:11.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:11.612 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:11.612 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:11.612 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.21 2024-09-19T05:44:11.612 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:11.613 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:11.613 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:11.613 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:11.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:11.674 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.674 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.674 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108536 s, 96.6 MB/s 2024-09-19T05:44:11.687 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.687 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.687 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100709 s, 104 MB/s 2024-09-19T05:44:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109074 s, 96.1 MB/s 2024-09-19T05:44:11.716 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.716 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.716 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011573 s, 90.6 MB/s 2024-09-19T05:44:11.729 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.730 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103249 s, 102 MB/s 2024-09-19T05:44:11.744 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.744 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.744 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118179 s, 88.7 MB/s 2024-09-19T05:44:11.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.761 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131812 s, 79.6 MB/s 2024-09-19T05:44:11.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.778 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135315 s, 77.5 MB/s 2024-09-19T05:44:11.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.794 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121568 s, 86.3 MB/s 2024-09-19T05:44:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131899 s, 79.5 MB/s 2024-09-19T05:44:11.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.828 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152205 s, 68.9 MB/s 2024-09-19T05:44:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123751 s, 84.7 MB/s 2024-09-19T05:44:11.858 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.859 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120387 s, 87.1 MB/s 2024-09-19T05:44:11.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.876 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138682 s, 75.6 MB/s 2024-09-19T05:44:11.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.891 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123698 s, 84.8 MB/s 2024-09-19T05:44:11.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.907 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130185 s, 80.5 MB/s 2024-09-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.921 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.922 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112127 s, 93.5 MB/s 2024-09-19T05:44:11.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.935 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104219 s, 101 MB/s 2024-09-19T05:44:11.950 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.950 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.950 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113511 s, 92.4 MB/s 2024-09-19T05:44:11.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.965 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127475 s, 82.3 MB/s 2024-09-19T05:44:11.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.979 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010357 s, 101 MB/s 2024-09-19T05:44:11.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:11.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:11.994 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123855 s, 84.7 MB/s 2024-09-19T05:44:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.010 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125073 s, 83.8 MB/s 2024-09-19T05:44:12.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.027 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133121 s, 78.8 MB/s 2024-09-19T05:44:12.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.041 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010877 s, 96.4 MB/s 2024-09-19T05:44:12.058 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.058 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.058 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133925 s, 78.3 MB/s 2024-09-19T05:44:12.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.073 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122355 s, 85.7 MB/s 2024-09-19T05:44:12.089 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135703 s, 77.3 MB/s 2024-09-19T05:44:12.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.102 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936877 s, 112 MB/s 2024-09-19T05:44:12.119 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.119 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.119 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139513 s, 75.2 MB/s 2024-09-19T05:44:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128966 s, 81.3 MB/s 2024-09-19T05:44:12.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.150 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.150 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109911 s, 95.4 MB/s 2024-09-19T05:44:12.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:12.158 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:12.158 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:12.158 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.22 2024-09-19T05:44:12.158 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:12.158 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:12.158 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:12.158 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:12.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:12.272 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.272 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.272 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132945 s, 78.9 MB/s 2024-09-19T05:44:12.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.290 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140254 s, 74.8 MB/s 2024-09-19T05:44:12.309 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.309 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.309 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153759 s, 68.2 MB/s 2024-09-19T05:44:12.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.326 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141489 s, 74.1 MB/s 2024-09-19T05:44:12.344 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.344 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.344 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137265 s, 76.4 MB/s 2024-09-19T05:44:12.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.361 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141294 s, 74.2 MB/s 2024-09-19T05:44:12.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.379 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147189 s, 71.2 MB/s 2024-09-19T05:44:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139999 s, 74.9 MB/s 2024-09-19T05:44:12.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.413 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125969 s, 83.2 MB/s 2024-09-19T05:44:12.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.430 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.430 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133465 s, 78.6 MB/s 2024-09-19T05:44:12.447 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.447 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.447 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134194 s, 78.1 MB/s 2024-09-19T05:44:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113812 s, 92.1 MB/s 2024-09-19T05:44:12.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.477 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126153 s, 83.1 MB/s 2024-09-19T05:44:12.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.496 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150414 s, 69.7 MB/s 2024-09-19T05:44:12.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.512 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128177 s, 81.8 MB/s 2024-09-19T05:44:12.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.529 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135202 s, 77.6 MB/s 2024-09-19T05:44:12.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.546 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138268 s, 75.8 MB/s 2024-09-19T05:44:12.562 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129902 s, 80.7 MB/s 2024-09-19T05:44:12.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.580 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138154 s, 75.9 MB/s 2024-09-19T05:44:12.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.596 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126949 s, 82.6 MB/s 2024-09-19T05:44:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115885 s, 90.5 MB/s 2024-09-19T05:44:12.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135645 s, 77.3 MB/s 2024-09-19T05:44:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139816 s, 75.0 MB/s 2024-09-19T05:44:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129354 s, 81.1 MB/s 2024-09-19T05:44:12.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.675 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106143 s, 98.8 MB/s 2024-09-19T05:44:12.692 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.692 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.692 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135725 s, 77.3 MB/s 2024-09-19T05:44:12.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.706 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107689 s, 97.4 MB/s 2024-09-19T05:44:12.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.722 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129681 s, 80.9 MB/s 2024-09-19T05:44:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.739 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129947 s, 80.7 MB/s 2024-09-19T05:44:12.753 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.753 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.753 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110665 s, 94.8 MB/s 2024-09-19T05:44:12.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.769 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124906 s, 83.9 MB/s 2024-09-19T05:44:12.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.786 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135873 s, 77.2 MB/s 2024-09-19T05:44:12.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:12.795 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:12.795 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:12.795 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.23 2024-09-19T05:44:12.795 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:12.795 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:12.796 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:12.796 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:12.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:12.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.866 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120243 s, 87.2 MB/s 2024-09-19T05:44:12.879 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.880 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114487 s, 91.6 MB/s 2024-09-19T05:44:12.894 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.894 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.894 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118938 s, 88.2 MB/s 2024-09-19T05:44:12.908 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.908 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.908 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102576 s, 102 MB/s 2024-09-19T05:44:12.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.922 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117978 s, 88.9 MB/s 2024-09-19T05:44:12.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.935 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106889 s, 98.1 MB/s 2024-09-19T05:44:12.952 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.952 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.952 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138107 s, 75.9 MB/s 2024-09-19T05:44:12.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.969 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013969 s, 75.1 MB/s 2024-09-19T05:44:12.983 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:12.983 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:12.983 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109351 s, 95.9 MB/s 2024-09-19T05:44:13.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.000 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140318 s, 74.7 MB/s 2024-09-19T05:44:13.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106866 s, 98.1 MB/s 2024-09-19T05:44:13.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.027 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109242 s, 96.0 MB/s 2024-09-19T05:44:13.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.042 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119281 s, 87.9 MB/s 2024-09-19T05:44:13.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.055 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109164 s, 96.1 MB/s 2024-09-19T05:44:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990808 s, 106 MB/s 2024-09-19T05:44:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105765 s, 99.1 MB/s 2024-09-19T05:44:13.090 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.090 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.091 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781959 s, 134 MB/s 2024-09-19T05:44:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010045 s, 104 MB/s 2024-09-19T05:44:13.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.118 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125751 s, 83.4 MB/s 2024-09-19T05:44:13.132 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.132 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.132 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116528 s, 90.0 MB/s 2024-09-19T05:44:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789139 s, 133 MB/s 2024-09-19T05:44:13.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.157 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011803 s, 88.8 MB/s 2024-09-19T05:44:13.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101691 s, 103 MB/s 2024-09-19T05:44:13.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.182 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106659 s, 98.3 MB/s 2024-09-19T05:44:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119658 s, 87.6 MB/s 2024-09-19T05:44:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121718 s, 86.1 MB/s 2024-09-19T05:44:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108853 s, 96.3 MB/s 2024-09-19T05:44:13.254 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.254 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.254 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108337 s, 96.8 MB/s 2024-09-19T05:44:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113881 s, 92.1 MB/s 2024-09-19T05:44:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887049 s, 118 MB/s 2024-09-19T05:44:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855805 s, 123 MB/s 2024-09-19T05:44:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130914 s, 80.1 MB/s 2024-09-19T05:44:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:13.316 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:13.316 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:13.316 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.24 2024-09-19T05:44:13.316 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:13.316 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:13.316 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:13.316 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:13.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:13.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.376 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135164 s, 77.6 MB/s 2024-09-19T05:44:13.390 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.390 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.390 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109762 s, 95.5 MB/s 2024-09-19T05:44:13.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.407 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131866 s, 79.5 MB/s 2024-09-19T05:44:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101922 s, 103 MB/s 2024-09-19T05:44:13.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.434 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114342 s, 91.7 MB/s 2024-09-19T05:44:13.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.451 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139802 s, 75.0 MB/s 2024-09-19T05:44:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.466 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011463 s, 91.5 MB/s 2024-09-19T05:44:13.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.482 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130115 s, 80.6 MB/s 2024-09-19T05:44:13.497 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.497 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.497 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128412 s, 81.7 MB/s 2024-09-19T05:44:13.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.513 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126805 s, 82.7 MB/s 2024-09-19T05:44:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090448 s, 116 MB/s 2024-09-19T05:44:13.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.541 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130164 s, 80.6 MB/s 2024-09-19T05:44:13.556 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.556 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.557 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126981 s, 82.6 MB/s 2024-09-19T05:44:13.574 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.574 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.574 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014146 s, 74.1 MB/s 2024-09-19T05:44:13.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120005 s, 87.4 MB/s 2024-09-19T05:44:13.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.606 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133313 s, 78.7 MB/s 2024-09-19T05:44:13.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.620 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111182 s, 94.3 MB/s 2024-09-19T05:44:13.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.636 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125964 s, 83.2 MB/s 2024-09-19T05:44:13.651 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.651 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.651 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118508 s, 88.5 MB/s 2024-09-19T05:44:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102134 s, 103 MB/s 2024-09-19T05:44:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128246 s, 81.8 MB/s 2024-09-19T05:44:13.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.696 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128439 s, 81.6 MB/s 2024-09-19T05:44:13.710 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.710 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.710 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106641 s, 98.3 MB/s 2024-09-19T05:44:13.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.725 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127501 s, 82.2 MB/s 2024-09-19T05:44:13.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.738 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929556 s, 113 MB/s 2024-09-19T05:44:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121664 s, 86.2 MB/s 2024-09-19T05:44:13.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.768 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121698 s, 86.2 MB/s 2024-09-19T05:44:13.782 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.782 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.782 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116512 s, 90.0 MB/s 2024-09-19T05:44:13.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.794 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00890216 s, 118 MB/s 2024-09-19T05:44:13.808 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.809 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118016 s, 88.9 MB/s 2024-09-19T05:44:13.823 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.823 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.823 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112305 s, 93.4 MB/s 2024-09-19T05:44:13.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.838 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.838 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011612 s, 90.3 MB/s 2024-09-19T05:44:13.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:13.845 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:13.845 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:13.845 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.25 2024-09-19T05:44:13.845 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:13.845 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:13.845 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:13.845 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:13.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:13.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.958 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012761 s, 82.2 MB/s 2024-09-19T05:44:13.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.974 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132099 s, 79.4 MB/s 2024-09-19T05:44:13.992 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:13.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:13.993 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143207 s, 73.2 MB/s 2024-09-19T05:44:14.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.008 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119294 s, 87.9 MB/s 2024-09-19T05:44:14.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.022 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108668 s, 96.5 MB/s 2024-09-19T05:44:14.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.038 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124552 s, 84.2 MB/s 2024-09-19T05:44:14.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.051 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104635 s, 100 MB/s 2024-09-19T05:44:14.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.067 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013274 s, 79.0 MB/s 2024-09-19T05:44:14.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.084 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136428 s, 76.9 MB/s 2024-09-19T05:44:14.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.096 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912622 s, 115 MB/s 2024-09-19T05:44:14.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.112 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124529 s, 84.2 MB/s 2024-09-19T05:44:14.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.124 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941002 s, 111 MB/s 2024-09-19T05:44:14.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.137 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100482 s, 104 MB/s 2024-09-19T05:44:14.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.152 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110859 s, 94.6 MB/s 2024-09-19T05:44:14.168 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130959 s, 80.1 MB/s 2024-09-19T05:44:14.186 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.186 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.186 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135561 s, 77.4 MB/s 2024-09-19T05:44:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140949 s, 74.4 MB/s 2024-09-19T05:44:14.247 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.247 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.247 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151401 s, 69.3 MB/s 2024-09-19T05:44:14.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.266 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146789 s, 71.4 MB/s 2024-09-19T05:44:14.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.281 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110745 s, 94.7 MB/s 2024-09-19T05:44:14.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.301 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151702 s, 69.1 MB/s 2024-09-19T05:44:14.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.317 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.317 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111352 s, 94.2 MB/s 2024-09-19T05:44:14.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.334 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126834 s, 82.7 MB/s 2024-09-19T05:44:14.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.353 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014849 s, 70.6 MB/s 2024-09-19T05:44:14.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.374 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174223 s, 60.2 MB/s 2024-09-19T05:44:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152354 s, 68.8 MB/s 2024-09-19T05:44:14.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.412 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144692 s, 72.5 MB/s 2024-09-19T05:44:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157051 s, 66.8 MB/s 2024-09-19T05:44:14.450 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.451 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152309 s, 68.8 MB/s 2024-09-19T05:44:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142782 s, 73.4 MB/s 2024-09-19T05:44:14.488 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.489 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152163 s, 68.9 MB/s 2024-09-19T05:44:14.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159727 s, 65.6 MB/s 2024-09-19T05:44:14.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:14.518 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:14.518 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:14.518 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.26 2024-09-19T05:44:14.518 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:14.518 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:14.519 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:14.519 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:14.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:14.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.584 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128965 s, 81.3 MB/s 2024-09-19T05:44:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121958 s, 86.0 MB/s 2024-09-19T05:44:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119119 s, 88.0 MB/s 2024-09-19T05:44:14.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.630 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132206 s, 79.3 MB/s 2024-09-19T05:44:14.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.647 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142047 s, 73.8 MB/s 2024-09-19T05:44:14.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.662 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126849 s, 82.7 MB/s 2024-09-19T05:44:14.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.681 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.681 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138936 s, 75.5 MB/s 2024-09-19T05:44:14.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.693 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095365 s, 110 MB/s 2024-09-19T05:44:14.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.706 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104008 s, 101 MB/s 2024-09-19T05:44:14.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.719 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102527 s, 102 MB/s 2024-09-19T05:44:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.733 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116701 s, 89.9 MB/s 2024-09-19T05:44:14.748 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121604 s, 86.2 MB/s 2024-09-19T05:44:14.764 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.764 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.764 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127231 s, 82.4 MB/s 2024-09-19T05:44:14.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.777 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104869 s, 100 MB/s 2024-09-19T05:44:14.789 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.789 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.789 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918702 s, 114 MB/s 2024-09-19T05:44:14.804 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.804 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.804 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122843 s, 85.4 MB/s 2024-09-19T05:44:14.816 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.817 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954614 s, 110 MB/s 2024-09-19T05:44:14.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.832 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122655 s, 85.5 MB/s 2024-09-19T05:44:14.847 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.847 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.847 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124445 s, 84.3 MB/s 2024-09-19T05:44:14.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.861 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011381 s, 92.1 MB/s 2024-09-19T05:44:14.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.877 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133862 s, 78.3 MB/s 2024-09-19T05:44:14.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.894 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132041 s, 79.4 MB/s 2024-09-19T05:44:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132579 s, 79.1 MB/s 2024-09-19T05:44:14.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.924 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010936 s, 95.9 MB/s 2024-09-19T05:44:14.938 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.939 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113489 s, 92.4 MB/s 2024-09-19T05:44:14.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.951 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091761 s, 114 MB/s 2024-09-19T05:44:14.966 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.967 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121355 s, 86.4 MB/s 2024-09-19T05:44:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119076 s, 88.1 MB/s 2024-09-19T05:44:14.997 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:14.997 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:14.997 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127976 s, 81.9 MB/s 2024-09-19T05:44:15.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125471 s, 83.6 MB/s 2024-09-19T05:44:15.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.029 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126911 s, 82.6 MB/s 2024-09-19T05:44:15.045 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.045 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.045 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111415 s, 94.1 MB/s 2024-09-19T05:44:15.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:15.053 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:15.053 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:15.053 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.27 2024-09-19T05:44:15.053 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:15.053 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:15.053 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:15.053 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:15.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:15.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.124 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130769 s, 80.2 MB/s 2024-09-19T05:44:15.140 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.140 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.140 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125188 s, 83.8 MB/s 2024-09-19T05:44:15.155 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.155 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.156 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124707 s, 84.1 MB/s 2024-09-19T05:44:15.173 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.173 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.173 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139691 s, 75.1 MB/s 2024-09-19T05:44:15.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.189 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129454 s, 81.0 MB/s 2024-09-19T05:44:15.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.203 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112008 s, 93.6 MB/s 2024-09-19T05:44:15.249 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155545 s, 67.4 MB/s 2024-09-19T05:44:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01194 s, 87.8 MB/s 2024-09-19T05:44:15.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.282 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136011 s, 77.1 MB/s 2024-09-19T05:44:15.296 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.296 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.296 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108832 s, 96.3 MB/s 2024-09-19T05:44:15.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.312 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012988 s, 80.7 MB/s 2024-09-19T05:44:15.327 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.327 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.327 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121139 s, 86.6 MB/s 2024-09-19T05:44:15.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.343 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120233 s, 87.2 MB/s 2024-09-19T05:44:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.360 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135155 s, 77.6 MB/s 2024-09-19T05:44:15.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.376 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129395 s, 81.0 MB/s 2024-09-19T05:44:15.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.392 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131659 s, 79.6 MB/s 2024-09-19T05:44:15.408 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.408 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.408 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131314 s, 79.9 MB/s 2024-09-19T05:44:15.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.427 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147343 s, 71.2 MB/s 2024-09-19T05:44:15.441 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011523 s, 91.0 MB/s 2024-09-19T05:44:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.456 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116762 s, 89.8 MB/s 2024-09-19T05:44:15.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.475 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.475 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143003 s, 73.3 MB/s 2024-09-19T05:44:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.490 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121415 s, 86.4 MB/s 2024-09-19T05:44:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.508 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142263 s, 73.7 MB/s 2024-09-19T05:44:15.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.523 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115946 s, 90.4 MB/s 2024-09-19T05:44:15.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.539 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137529 s, 76.2 MB/s 2024-09-19T05:44:15.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.554 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01136 s, 92.3 MB/s 2024-09-19T05:44:15.573 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.573 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.573 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153535 s, 68.3 MB/s 2024-09-19T05:44:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120596 s, 86.9 MB/s 2024-09-19T05:44:15.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.605 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128967 s, 81.3 MB/s 2024-09-19T05:44:15.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124741 s, 84.1 MB/s 2024-09-19T05:44:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.639 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.639 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139404 s, 75.2 MB/s 2024-09-19T05:44:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139916 s, 74.9 MB/s 2024-09-19T05:44:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:15.666 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:15.666 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:15.666 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.28 2024-09-19T05:44:15.666 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:15.666 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:15.666 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:15.666 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:15.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:15.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.734 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141817 s, 73.9 MB/s 2024-09-19T05:44:15.747 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.747 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.747 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112214 s, 93.4 MB/s 2024-09-19T05:44:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125058 s, 83.8 MB/s 2024-09-19T05:44:15.779 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.779 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.779 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126464 s, 82.9 MB/s 2024-09-19T05:44:15.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.794 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111032 s, 94.4 MB/s 2024-09-19T05:44:15.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.809 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120785 s, 86.8 MB/s 2024-09-19T05:44:15.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.825 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129037 s, 81.3 MB/s 2024-09-19T05:44:15.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.842 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129887 s, 80.7 MB/s 2024-09-19T05:44:15.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.859 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129807 s, 80.8 MB/s 2024-09-19T05:44:15.875 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.875 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.875 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132419 s, 79.2 MB/s 2024-09-19T05:44:15.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.892 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129128 s, 81.2 MB/s 2024-09-19T05:44:15.908 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.908 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.908 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125241 s, 83.7 MB/s 2024-09-19T05:44:15.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.925 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138002 s, 76.0 MB/s 2024-09-19T05:44:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.979 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128299 s, 81.7 MB/s 2024-09-19T05:44:15.980 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.980 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.980 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130613 s, 80.3 MB/s 2024-09-19T05:44:15.980 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.980 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.980 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013035 s, 80.4 MB/s 2024-09-19T05:44:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:15.991 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:15.992 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133372 s, 78.6 MB/s 2024-09-19T05:44:16.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.008 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122575 s, 85.5 MB/s 2024-09-19T05:44:16.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.027 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015108 s, 69.4 MB/s 2024-09-19T05:44:16.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.044 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136576 s, 76.8 MB/s 2024-09-19T05:44:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136368 s, 76.9 MB/s 2024-09-19T05:44:16.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.078 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125143 s, 83.8 MB/s 2024-09-19T05:44:16.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.095 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129257 s, 81.1 MB/s 2024-09-19T05:44:16.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.110 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117999 s, 88.9 MB/s 2024-09-19T05:44:16.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.127 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138954 s, 75.5 MB/s 2024-09-19T05:44:16.143 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.144 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.144 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117885 s, 88.9 MB/s 2024-09-19T05:44:16.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.162 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139747 s, 75.0 MB/s 2024-09-19T05:44:16.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.182 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150805 s, 69.5 MB/s 2024-09-19T05:44:16.200 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.200 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.200 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142717 s, 73.5 MB/s 2024-09-19T05:44:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.225 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192161 s, 54.6 MB/s 2024-09-19T05:44:16.287 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.287 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.287 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143308 s, 73.2 MB/s 2024-09-19T05:44:16.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.306 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153261 s, 68.4 MB/s 2024-09-19T05:44:16.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:16.316 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:16.316 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:16.316 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.29 2024-09-19T05:44:16.316 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:16.316 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:16.316 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:16.316 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:16.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:16.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.431 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142738 s, 73.5 MB/s 2024-09-19T05:44:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116691 s, 89.9 MB/s 2024-09-19T05:44:16.461 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.461 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.461 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012228 s, 85.8 MB/s 2024-09-19T05:44:16.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.477 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122755 s, 85.4 MB/s 2024-09-19T05:44:16.490 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.490 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.490 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103333 s, 101 MB/s 2024-09-19T05:44:16.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.504 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112269 s, 93.4 MB/s 2024-09-19T05:44:16.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.518 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107212 s, 97.8 MB/s 2024-09-19T05:44:16.534 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.534 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.534 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125894 s, 83.3 MB/s 2024-09-19T05:44:16.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.551 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133364 s, 78.6 MB/s 2024-09-19T05:44:16.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.565 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111295 s, 94.2 MB/s 2024-09-19T05:44:16.581 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.581 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.581 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128816 s, 81.4 MB/s 2024-09-19T05:44:16.597 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.597 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.598 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123605 s, 84.8 MB/s 2024-09-19T05:44:16.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123877 s, 84.6 MB/s 2024-09-19T05:44:16.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.630 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115156 s, 91.1 MB/s 2024-09-19T05:44:16.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141413 s, 74.1 MB/s 2024-09-19T05:44:16.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.666 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133886 s, 78.3 MB/s 2024-09-19T05:44:16.681 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.681 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.681 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010911 s, 96.1 MB/s 2024-09-19T05:44:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.696 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112939 s, 92.8 MB/s 2024-09-19T05:44:16.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.711 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118037 s, 88.8 MB/s 2024-09-19T05:44:16.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.729 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136466 s, 76.8 MB/s 2024-09-19T05:44:16.745 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.745 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.745 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129702 s, 80.8 MB/s 2024-09-19T05:44:16.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.761 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130437 s, 80.4 MB/s 2024-09-19T05:44:16.780 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.780 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.780 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146233 s, 71.7 MB/s 2024-09-19T05:44:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.800 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151768 s, 69.1 MB/s 2024-09-19T05:44:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134343 s, 78.1 MB/s 2024-09-19T05:44:16.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.837 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153284 s, 68.4 MB/s 2024-09-19T05:44:16.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.855 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.855 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134921 s, 77.7 MB/s 2024-09-19T05:44:16.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.872 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013023 s, 80.5 MB/s 2024-09-19T05:44:16.890 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.890 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.890 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136199 s, 77.0 MB/s 2024-09-19T05:44:16.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.907 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013679 s, 76.7 MB/s 2024-09-19T05:44:16.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.925 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141928 s, 73.9 MB/s 2024-09-19T05:44:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120764 s, 86.8 MB/s 2024-09-19T05:44:16.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:16.949 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:16.950 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:16.950 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.30 2024-09-19T05:44:16.950 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:16.950 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:16.950 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:16.950 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:17.025 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.025 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.025 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132224 s, 79.3 MB/s 2024-09-19T05:44:17.042 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.042 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.043 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130627 s, 80.3 MB/s 2024-09-19T05:44:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.059 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125532 s, 83.5 MB/s 2024-09-19T05:44:17.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.078 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139749 s, 75.0 MB/s 2024-09-19T05:44:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014009 s, 74.9 MB/s 2024-09-19T05:44:17.113 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.113 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.114 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143663 s, 73.0 MB/s 2024-09-19T05:44:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.131 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.131 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128661 s, 81.5 MB/s 2024-09-19T05:44:17.148 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.149 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134085 s, 78.2 MB/s 2024-09-19T05:44:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119499 s, 87.7 MB/s 2024-09-19T05:44:17.183 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.184 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.184 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144563 s, 72.5 MB/s 2024-09-19T05:44:17.201 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.201 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.201 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136562 s, 76.8 MB/s 2024-09-19T05:44:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129079 s, 81.2 MB/s 2024-09-19T05:44:17.261 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.261 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.261 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129538 s, 80.9 MB/s 2024-09-19T05:44:17.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.277 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118701 s, 88.3 MB/s 2024-09-19T05:44:17.293 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.293 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.293 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134197 s, 78.1 MB/s 2024-09-19T05:44:17.309 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.309 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.309 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012092 s, 86.7 MB/s 2024-09-19T05:44:17.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.324 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113334 s, 92.5 MB/s 2024-09-19T05:44:17.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.342 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137769 s, 76.1 MB/s 2024-09-19T05:44:17.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.358 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128843 s, 81.4 MB/s 2024-09-19T05:44:17.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.375 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131683 s, 79.6 MB/s 2024-09-19T05:44:17.390 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.390 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.390 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124981 s, 83.9 MB/s 2024-09-19T05:44:17.410 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.410 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.410 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147051 s, 71.3 MB/s 2024-09-19T05:44:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138719 s, 75.6 MB/s 2024-09-19T05:44:17.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.447 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.447 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141195 s, 74.3 MB/s 2024-09-19T05:44:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013398 s, 78.3 MB/s 2024-09-19T05:44:17.478 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.478 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.478 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112973 s, 92.8 MB/s 2024-09-19T05:44:17.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.495 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142236 s, 73.7 MB/s 2024-09-19T05:44:17.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.512 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013608 s, 77.1 MB/s 2024-09-19T05:44:17.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.529 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138015 s, 76.0 MB/s 2024-09-19T05:44:17.545 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.545 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.545 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125085 s, 83.8 MB/s 2024-09-19T05:44:17.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.560 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011425 s, 91.8 MB/s 2024-09-19T05:44:17.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.578 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141355 s, 74.2 MB/s 2024-09-19T05:44:17.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:17.586 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:17.587 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:17.587 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.31 2024-09-19T05:44:17.587 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:17.587 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:17.587 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:17.588 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:17.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:17.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.657 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130279 s, 80.5 MB/s 2024-09-19T05:44:17.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.675 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014399 s, 72.8 MB/s 2024-09-19T05:44:17.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.691 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128685 s, 81.5 MB/s 2024-09-19T05:44:17.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.708 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131567 s, 79.7 MB/s 2024-09-19T05:44:17.724 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.725 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012942 s, 81.0 MB/s 2024-09-19T05:44:17.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.743 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141202 s, 74.3 MB/s 2024-09-19T05:44:17.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.759 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128756 s, 81.4 MB/s 2024-09-19T05:44:17.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.776 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139203 s, 75.3 MB/s 2024-09-19T05:44:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142278 s, 73.7 MB/s 2024-09-19T05:44:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.812 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144427 s, 72.6 MB/s 2024-09-19T05:44:17.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.829 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.829 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136432 s, 76.9 MB/s 2024-09-19T05:44:17.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.846 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141133 s, 74.3 MB/s 2024-09-19T05:44:17.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.862 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127243 s, 82.4 MB/s 2024-09-19T05:44:17.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.880 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132807 s, 79.0 MB/s 2024-09-19T05:44:17.902 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.902 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.902 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175327 s, 59.8 MB/s 2024-09-19T05:44:17.919 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.920 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.920 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140748 s, 74.5 MB/s 2024-09-19T05:44:17.934 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.934 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.934 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115063 s, 91.1 MB/s 2024-09-19T05:44:17.950 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.950 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.950 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124966 s, 83.9 MB/s 2024-09-19T05:44:17.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.966 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.966 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127867 s, 82.0 MB/s 2024-09-19T05:44:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155502 s, 67.4 MB/s 2024-09-19T05:44:17.998 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:17.998 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:17.998 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011033 s, 95.0 MB/s 2024-09-19T05:44:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012613 s, 83.1 MB/s 2024-09-19T05:44:18.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.029 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120951 s, 86.7 MB/s 2024-09-19T05:44:18.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.043 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113857 s, 92.1 MB/s 2024-09-19T05:44:18.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.055 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841888 s, 125 MB/s 2024-09-19T05:44:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112169 s, 93.5 MB/s 2024-09-19T05:44:18.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.078 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786177 s, 133 MB/s 2024-09-19T05:44:18.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.092 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107849 s, 97.2 MB/s 2024-09-19T05:44:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.104 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102858 s, 102 MB/s 2024-09-19T05:44:18.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.114 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786362 s, 133 MB/s 2024-09-19T05:44:18.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.127 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104172 s, 101 MB/s 2024-09-19T05:44:18.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:18.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:18.141 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110549 s, 94.9 MB/s 2024-09-19T05:44:18.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:18.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:18.149 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-09-19T05:44:18.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa97d7a5640 1 Processor -- start 2024-09-19T05:44:18.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa97d7a5640 1 -- start start 2024-09-19T05:44:18.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa97d7a5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa97815d8d0 0x7fa97815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa97d7a5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97815d030 con 0x7fa9780d0aa0 2024-09-19T05:44:18.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa97d7a5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97815d310 con 0x7fa9780cf5e0 2024-09-19T05:44:18.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa97d7a5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa97815e250 con 0x7fa97815d8d0 2024-09-19T05:44:18.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa9767fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa9780d0aa0 0x7fa97806e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48640/0 (socket says 172.21.15.67:48640) 2024-09-19T05:44:18.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa9767fc640 1 -- 172.21.15.67:0/2107850547 learned_addr learned my addr 172.21.15.67:0/2107850547 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa9777fe640 1 --2- 172.21.15.67:0/2107850547 >> v2:172.21.15.97:3300/0 conn(0x7fa97815d8d0 0x7fa97815dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164410325 0 0) 0x7fa97815d030 con 0x7fa9780d0aa0 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.321+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa960003530 con 0x7fa9780d0aa0 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2783890991 0 0) 0x7fa960003530 con 0x7fa9780d0aa0 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 >> v2:172.21.15.97:3300/0 conn(0x7fa97815d8d0 msgr2=0x7fa97815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 --2- 172.21.15.67:0/2107850547 >> v2:172.21.15.97:3300/0 conn(0x7fa97815d8d0 0x7fa97815dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 >> v1:172.21.15.97:6789/0 conn(0x7fa9780cf5e0 legacy=0x7fa97815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97815d5f0 con 0x7fa9780d0aa0 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fa96c001a00 con 0x7fa9780d0aa0 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 >> v1:172.21.15.67:6789/0 conn(0x7fa9780d0aa0 legacy=0x7fa97806e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9600039c0 0x7fa960003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa960004810 0x7fa960004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9600051d0 0x7fa96000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa97815e250 con 0x7fa960004810 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa96000c070 con 0x7fa9600039c0 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa96000c270 con 0x7fa9600051d0 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa9767fc640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa960004810 0x7fa960004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa976ffd640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9600039c0 0x7fa960003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa9777fe640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9600051d0 0x7fa96000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa9767fc640 1 -- 172.21.15.67:0/2107850547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9600051d0 msgr2=0x7fa96000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa9767fc640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9600051d0 0x7fa96000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa9767fc640 1 -- 172.21.15.67:0/2107850547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9600039c0 msgr2=0x7fa960003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa9767fc640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9600039c0 0x7fa960003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa9767fc640 1 -- 172.21.15.67:0/2107850547 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa960003530 con 0x7fa960004810 2024-09-19T05:44:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa9777fe640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9600051d0 0x7fa96000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:18.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa9777fe640 1 -- 172.21.15.67:0/2107850547 reap_dead start 2024-09-19T05:44:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa9767fc640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa960004810 0x7fa960004c90 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00a840 tx=0x7fa96c01fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67754a36ece6a0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00a460 con 0x7fa960004810 2024-09-19T05:44:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96c0aa690 con 0x7fa960004810 2024-09-19T05:44:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa975ffb640 1 -- 172.21.15.67:0/2107850547 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0aaac0 con 0x7fa960004810 2024-09-19T05:44:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2107850547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa960004810 msgr2=0x7fa960004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa97d7a5640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa960004810 0x7fa960004c90 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00a840 tx=0x7fa96c01fa40 comp rx=0 tx=0).stop 2024-09-19T05:44:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2107850547 shutdown_connections 2024-09-19T05:44:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa97d7a5640 1 --2- 172.21.15.67:0/2107850547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa960004810 0x7fa960004c90 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2107850547 >> 172.21.15.67:0/2107850547 conn(0x7fa97806c0c0 msgr2=0x7fa97806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2107850547 shutdown_connections 2024-09-19T05:44:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.325+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2107850547 wait complete. 2024-09-19T05:44:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa97d7a5640 1 Processor -- start 2024-09-19T05:44:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa97d7a5640 1 -- start start 2024-09-19T05:44:18.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa97d7a5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa960004810 0x7fa978150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa97d7a5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9780ce9f0 0x7fa9780b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa97d7a5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9780b36f0 0x7fa9781602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa97d7a5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa97806e170 con 0x7fa9780b36f0 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa97d7a5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa97806de90 con 0x7fa960004810 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa97d7a5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa97815dd10 con 0x7fa9780ce9f0 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9780b36f0 0x7fa9781602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9780b36f0 0x7fa9781602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41266/0 (socket says 172.21.15.67:41266) 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa9777fe640 1 -- 172.21.15.67:0/2467155508 learned_addr learned my addr 172.21.15.67:0/2467155508 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa976ffd640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa960004810 0x7fa978150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa9767fc640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9780ce9f0 0x7fa9780b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa9777fe640 1 -- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9780ce9f0 msgr2=0x7fa9780b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa9777fe640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9780ce9f0 0x7fa9780b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa9777fe640 1 -- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa960004810 msgr2=0x7fa978150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa9777fe640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa960004810 0x7fa978150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa9777fe640 1 -- 172.21.15.67:0/2467155508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9781f7270 con 0x7fa9780b36f0 2024-09-19T05:44:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa9777fe640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9780b36f0 0x7fa9781602b0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fa97815a3b0 tx=0x7fa970010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa95f7fe640 1 -- 172.21.15.67:0/2467155508 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97000f040 con 0x7fa9780b36f0 2024-09-19T05:44:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa95f7fe640 1 -- 172.21.15.67:0/2467155508 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa97001c070 con 0x7fa9780b36f0 2024-09-19T05:44:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2467155508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9781f41f0 con 0x7fa9780b36f0 2024-09-19T05:44:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa95f7fe640 1 -- 172.21.15.67:0/2467155508 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97000ea60 con 0x7fa9780b36f0 2024-09-19T05:44:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.329+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2467155508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9781f47b0 con 0x7fa9780b36f0 2024-09-19T05:44:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa95f7fe640 1 -- 172.21.15.67:0/2467155508 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa97000ec00 con 0x7fa9780b36f0 2024-09-19T05:44:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa95f7fe640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa9640678c0 0x7fa964069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa95f7fe640 1 -- 172.21.15.67:0/2467155508 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fa970085610 con 0x7fa9780b36f0 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa976ffd640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa9640678c0 0x7fa964069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 Processor -- start 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 -- start start 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa976ffd640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa9640678c0 0x7fa964069d80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa968005490 tx=0x7fa968009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56374668f6d0 0x56374668fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 0x563746643160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637466436a0 0x563746643a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563746493ba0 con 0x5637466436a0 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563746439350 con 0x56374668fff0 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56374648fb60 con 0x56374668f6d0 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637466436a0 0x563746643a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637466436a0 0x563746643a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41272/0 (socket says 172.21.15.67:41272) 2024-09-19T05:44:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9777fe640 1 -- 172.21.15.67:0/286273160 learned_addr learned my addr 172.21.15.67:0/286273160 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa976ffd640 1 --2- 172.21.15.67:0/286273160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56374668f6d0 0x56374668fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9767fc640 1 --2- 172.21.15.67:0/286273160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 0x563746643160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9777fe640 1 -- 172.21.15.67:0/286273160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56374668f6d0 msgr2=0x56374668fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9777fe640 1 --2- 172.21.15.67:0/286273160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56374668f6d0 0x56374668fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9777fe640 1 -- 172.21.15.67:0/286273160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 msgr2=0x563746643160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9777fe640 1 --2- 172.21.15.67:0/286273160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 0x563746643160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9777fe640 1 -- 172.21.15.67:0/286273160 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56374643cbd0 con 0x5637466436a0 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9767fc640 1 --2- 172.21.15.67:0/286273160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 0x563746643160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa9777fe640 1 --2- 172.21.15.67:0/286273160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637466436a0 0x563746643a80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fa970083950 tx=0x7fa970055fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30a74e3fad92a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa95cff9640 1 -- 172.21.15.67:0/286273160 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970059c70 con 0x5637466436a0 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa95cff9640 1 -- 172.21.15.67:0/286273160 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa97005e4a0 con 0x5637466436a0 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa95cff9640 1 -- 172.21.15.67:0/286273160 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970053bc0 con 0x5637466436a0 2024-09-19T05:44:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 -- 172.21.15.67:0/286273160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637466436a0 msgr2=0x563746643a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 --2- 172.21.15.67:0/286273160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637466436a0 0x563746643a80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fa970083950 tx=0x7fa970055fc0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 -- 172.21.15.67:0/286273160 shutdown_connections 2024-09-19T05:44:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 --2- 172.21.15.67:0/286273160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637466436a0 0x563746643a80 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 --2- 172.21.15.67:0/286273160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 0x563746643160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 --2- 172.21.15.67:0/286273160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56374668f6d0 0x56374668fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 -- 172.21.15.67:0/286273160 >> 172.21.15.67:0/286273160 conn(0x563746670470 msgr2=0x563746672860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.333+0000 7fa980861000 1 -- 172.21.15.67:0/286273160 shutdown_connections 2024-09-19T05:44:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 -- 172.21.15.67:0/286273160 wait complete. 2024-09-19T05:44:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 -- start start 2024-09-19T05:44:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 Processor -- start 2024-09-19T05:44:18.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637466436a0 0x56374666fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x56374664ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56374668fff0 0x56374664b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56374642d2a0 con 0x56374668f6d0 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5637464527d0 con 0x5637466436a0 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563746454f70 con 0x56374668fff0 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 10 client.0 _ll_register_callbacks cb 0x563746630b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa9767fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x56374664ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa9767fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x56374664ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41288/0 (socket says 172.21.15.67:41288) 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa9767fc640 1 -- 172.21.15.67:0/3591618773 learned_addr learned my addr 172.21.15.67:0/3591618773 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa976ffd640 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637466436a0 0x56374666fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa9777fe640 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56374668fff0 0x56374664b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa9767fc640 1 -- 172.21.15.67:0/3591618773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56374668fff0 msgr2=0x56374664b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa9767fc640 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56374668fff0 0x56374664b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa9767fc640 1 -- 172.21.15.67:0/3591618773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637466436a0 msgr2=0x56374666fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa9767fc640 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637466436a0 0x56374666fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa9767fc640 1 -- 172.21.15.67:0/3591618773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56374649c810 con 0x56374668f6d0 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa9767fc640 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x56374664ade0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fa96c002240 tx=0x7fa96c01e280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98903b4468079756 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa955ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa955ffb640 1 -- 172.21.15.67:0/3591618773 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00a460 con 0x56374668f6d0 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa955ffb640 1 -- 172.21.15.67:0/3591618773 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fa96c0b4c30 con 0x56374668f6d0 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 -- 172.21.15.67:0/3591618773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa97005e4a0 con 0x56374668f6d0 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa955ffb640 1 -- 172.21.15.67:0/3591618773 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fa96c0b4e30 con 0x56374668f6d0 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 10 client.8712 fetch_fsmap learned FSMap version 98 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 -- 172.21.15.67:0/3591618773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x56374643d9f0 con 0x56374668f6d0 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa955ffb640 1 -- 172.21.15.67:0/3591618773 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa97005e4a0 con 0x56374668f6d0 2024-09-19T05:44:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa955ffb640 1 -- 172.21.15.67:0/3591618773 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7fa96c004b70 con 0x56374668f6d0 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 10 client.8712 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 10 client.8712 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 20 client.8712 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x563746648550 0x563746648930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 4 client.8712 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa980861000 1 -- 172.21.15.67:0/3591618773 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56374642dbd0 con 0x563746648550 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa976ffd640 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x563746648550 0x563746648930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa955ffb640 10 client.8712 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.337+0000 7fa976ffd640 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x563746648550 0x563746648930 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30b903edc27ea213 server_cookie=adfa3356d29b1bcc in_seq=0 out_seq=0 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa955ffb640 1 -- 172.21.15.67:0/3591618773 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56374642dbd0 con 0x563746648550 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa955ffb640 10 client.8712 handle_command_reply: tid=0 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 client.8712 shutdown 2024-09-19T05:44:18.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 -- 172.21.15.67:0/3591618773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 msgr2=0x56374664ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x56374664ade0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fa96c002240 tx=0x7fa96c01e280 comp rx=0 tx=0).stop 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 -- 172.21.15.67:0/3591618773 shutdown_connections 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x563746648550 0x563746648930 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56374668fff0 0x56374664b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x56374664ade0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 --2- 172.21.15.67:0/3591618773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637466436a0 0x56374666fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa955ffb640 0 client.8712 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 -- 172.21.15.67:0/3591618773 >> 172.21.15.67:0/3591618773 conn(0x563746670470 msgr2=0x563746672860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 -- 172.21.15.67:0/3591618773 shutdown_connections 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 1 -- 172.21.15.67:0/3591618773 wait complete. 2024-09-19T05:44:18.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.341+0000 7fa980861000 20 client.8712 trim_cache size 0 max 16384 2024-09-19T05:44:18.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa980861000 1 Processor -- start 2024-09-19T05:44:18.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa980861000 1 -- start start 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa980861000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 0x5637466fe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa980861000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668f6d0 0x5637466feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa980861000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668fff0 0x5637466fefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa980861000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa978200740 con 0x56374668fff0 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa980861000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781f36c0 con 0x56374668f6d0 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa980861000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa9781f3d10 con 0x5637466436a0 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668fff0 0x5637466fefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668fff0 0x5637466fefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41304/0 (socket says 172.21.15.67:41304) 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa9777fe640 1 -- 172.21.15.67:0/4048345234 learned_addr learned my addr 172.21.15.67:0/4048345234 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa9767fc640 1 --2- 172.21.15.67:0/4048345234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668f6d0 0x5637466feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa976ffd640 1 --2- 172.21.15.67:0/4048345234 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 0x5637466fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa9777fe640 1 -- 172.21.15.67:0/4048345234 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 msgr2=0x5637466fe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa9777fe640 1 --2- 172.21.15.67:0/4048345234 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 0x5637466fe560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa9777fe640 1 -- 172.21.15.67:0/4048345234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668f6d0 msgr2=0x5637466feaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa9777fe640 1 --2- 172.21.15.67:0/4048345234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668f6d0 0x5637466feaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa9777fe640 1 -- 172.21.15.67:0/4048345234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637464395a0 con 0x56374668fff0 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.357+0000 7fa9767fc640 1 --2- 172.21.15.67:0/4048345234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668f6d0 0x5637466feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9777fe640 1 --2- 172.21.15.67:0/4048345234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668fff0 0x5637466fefe0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa970083a00 tx=0x7fa97005c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dbe9f8984e2342 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa957fff640 1 -- 172.21.15.67:0/4048345234 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970059c70 con 0x56374668fff0 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa957fff640 1 -- 172.21.15.67:0/4048345234 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa970053960 con 0x56374668fff0 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa957fff640 1 -- 172.21.15.67:0/4048345234 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97005c070 con 0x56374668fff0 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- 172.21.15.67:0/4048345234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668fff0 msgr2=0x5637466fefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 --2- 172.21.15.67:0/4048345234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668fff0 0x5637466fefe0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa970083a00 tx=0x7fa97005c000 comp rx=0 tx=0).stop 2024-09-19T05:44:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- 172.21.15.67:0/4048345234 shutdown_connections 2024-09-19T05:44:18.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 --2- 172.21.15.67:0/4048345234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668fff0 0x5637466fefe0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 --2- 172.21.15.67:0/4048345234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668f6d0 0x5637466feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 --2- 172.21.15.67:0/4048345234 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 0x5637466fe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- 172.21.15.67:0/4048345234 >> 172.21.15.67:0/4048345234 conn(0x563746670470 msgr2=0x5637466429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- 172.21.15.67:0/4048345234 shutdown_connections 2024-09-19T05:44:18.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- 172.21.15.67:0/4048345234 wait complete. 2024-09-19T05:44:18.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- start start 2024-09-19T05:44:18.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 Processor -- start 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 0x563746702540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x563746702a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 0x5637466a3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56374643fc10 con 0x56374668f6d0 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56374643ae30 con 0x56374668fff0 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5637464188f0 con 0x5637466436a0 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 10 client.0 _ll_register_callbacks cb 0x7fa960003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9767fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x563746702a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9767fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x563746702a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41308/0 (socket says 172.21.15.67:41308) 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9767fc640 1 -- 172.21.15.67:0/1297208821 learned_addr learned my addr 172.21.15.67:0/1297208821 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa976ffd640 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 0x563746702540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9777fe640 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 0x5637466a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9767fc640 1 -- 172.21.15.67:0/1297208821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 msgr2=0x563746702540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9767fc640 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 0x563746702540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9767fc640 1 -- 172.21.15.67:0/1297208821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 msgr2=0x5637466a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9767fc640 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 0x5637466a3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9767fc640 1 -- 172.21.15.67:0/1297208821 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637464335b0 con 0x56374668f6d0 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa976ffd640 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 0x563746702540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa9767fc640 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x563746702a80 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa96c01fa80 tx=0x7fa96c01c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84158b9934d4be6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa955ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa955ffb640 1 -- 172.21.15.67:0/1297208821 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c007440 con 0x56374668f6d0 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa955ffb640 1 -- 172.21.15.67:0/1297208821 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fa96c0075e0 con 0x56374668f6d0 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- 172.21.15.67:0/1297208821 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa970053960 con 0x56374668f6d0 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa955ffb640 1 -- 172.21.15.67:0/1297208821 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fa96c0cf050 con 0x56374668f6d0 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 10 client.8718 fetch_fsmap learned FSMap version 98 2024-09-19T05:44:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- 172.21.15.67:0/1297208821 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x56374642b330 con 0x56374668f6d0 2024-09-19T05:44:18.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa955ffb640 1 -- 172.21.15.67:0/1297208821 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa970053960 con 0x56374668f6d0 2024-09-19T05:44:18.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa955ffb640 1 -- 172.21.15.67:0/1297208821 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7fa96c0d2020 con 0x56374668f6d0 2024-09-19T05:44:18.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 10 client.8718 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:44:18.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 10 client.8718 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-19T05:44:18.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 20 client.8718 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:18.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x5637466a3dd0 0x5637466a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 4 client.8718 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-19T05:44:18.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa980861000 1 -- 172.21.15.67:0/1297208821 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5637464a12d0 con 0x5637466a3dd0 2024-09-19T05:44:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.361+0000 7fa976ffd640 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x5637466a3dd0 0x5637466a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa976ffd640 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x5637466a3dd0 0x5637466a41e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=302296d81d30d71c server_cookie=ed18f94550ca63ee in_seq=0 out_seq=0 2024-09-19T05:44:18.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa955ffb640 10 client.8718 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa955ffb640 1 -- 172.21.15.67:0/1297208821 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5637464a12d0 con 0x5637466a3dd0 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa955ffb640 10 client.8718 handle_command_reply: tid=0 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 client.8718 shutdown 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 -- 172.21.15.67:0/1297208821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 msgr2=0x563746702a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x563746702a80 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa96c01fa80 tx=0x7fa96c01c7e0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 -- 172.21.15.67:0/1297208821 shutdown_connections 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x5637466a3dd0 0x5637466a41e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56374668fff0 0x5637466a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56374668f6d0 0x563746702a80 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa955ffb640 0 client.8718 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 --2- 172.21.15.67:0/1297208821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637466436a0 0x563746702540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 -- 172.21.15.67:0/1297208821 >> 172.21.15.67:0/1297208821 conn(0x563746670470 msgr2=0x56374669e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 -- 172.21.15.67:0/1297208821 shutdown_connections 2024-09-19T05:44:18.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 1 -- 172.21.15.67:0/1297208821 wait complete. 2024-09-19T05:44:18.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa980861000 20 client.8718 trim_cache size 0 max 16384 2024-09-19T05:44:18.370 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:44:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:44:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "a6a2ab33-57cd-4f32-aa2c-7da57120e692", 2024-09-19T05:44:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:44:18.370 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:44:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa9640678c0 msgr2=0x7fa964069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa97d7a5640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa9640678c0 0x7fa964069d80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa968005490 tx=0x7fa968009040 comp rx=0 tx=0).stop 2024-09-19T05:44:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2467155508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9780b36f0 msgr2=0x7fa9781602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa97d7a5640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9780b36f0 0x7fa9781602b0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fa97815a3b0 tx=0x7fa970010c20 comp rx=0 tx=0).stop 2024-09-19T05:44:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2467155508 shutdown_connections 2024-09-19T05:44:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa97d7a5640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9780b36f0 0x7fa9781602b0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa97d7a5640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa9640678c0 0x7fa964069d80 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa97d7a5640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9780ce9f0 0x7fa9780b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.365+0000 7fa97d7a5640 1 --2- 172.21.15.67:0/2467155508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa960004810 0x7fa978150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.369+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2467155508 >> 172.21.15.67:0/2467155508 conn(0x7fa97806c0c0 msgr2=0x7fa97815a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.369+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2467155508 shutdown_connections 2024-09-19T05:44:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.369+0000 7fa97d7a5640 1 -- 172.21.15.67:0/2467155508 wait complete. 2024-09-19T05:44:18.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:18.386 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-09-19T05:44:18.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.533+0000 7f7285d9a640 1 Processor -- start 2024-09-19T05:44:18.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f7285d9a640 1 -- start start 2024-09-19T05:44:18.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f7285d9a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f728015e660 0x7f72800b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f7285d9a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72800af120 0x7f72800b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f7285d9a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7280071110 con 0x7f72800b3a60 2024-09-19T05:44:18.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f7285d9a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f728015ea40 con 0x7f72800af120 2024-09-19T05:44:18.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f7285d9a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7280070610 con 0x7f728015e660 2024-09-19T05:44:18.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f727f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f728015e660 0x7f72800b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f727ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72800af120 0x7f72800b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f727f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f728015e660 0x7f72800b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:49928/0 (socket says 172.21.15.67:49928) 2024-09-19T05:44:18.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f727effd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f72800b3a60 0x7f72800aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:52042/0 (socket says 172.21.15.67:52042) 2024-09-19T05:44:18.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f727f7fe640 1 -- 172.21.15.67:0/4152163961 learned_addr learned my addr 172.21.15.67:0/4152163961 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f727ffff640 1 -- 172.21.15.67:0/4152163961 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f728015e660 msgr2=0x7f72800b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f727ffff640 1 --2- 172.21.15.67:0/4152163961 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f728015e660 0x7f72800b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f727ffff640 1 -- 172.21.15.67:0/4152163961 >> v1:172.21.15.97:6789/0 conn(0x7f72800b3a60 legacy=0x7f72800aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f727ffff640 1 -- 172.21.15.67:0/4152163961 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72800b4240 con 0x7f72800af120 2024-09-19T05:44:18.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.537+0000 7f727f7fe640 1 --2- 172.21.15.67:0/4152163961 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f728015e660 0x7f72800b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:44:18.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727ffff640 1 --2- 172.21.15.67:0/4152163961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72800af120 0x7f72800b4740 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7278009d90 tx=0x7f727801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a00faab448ef6df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727e7fc640 1 -- 172.21.15.67:0/4152163961 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72780b2070 con 0x7f72800af120 2024-09-19T05:44:18.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727e7fc640 1 -- 172.21.15.67:0/4152163961 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72780a5890 con 0x7f72800af120 2024-09-19T05:44:18.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727e7fc640 1 -- 172.21.15.67:0/4152163961 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72780a5c60 con 0x7f72800af120 2024-09-19T05:44:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 -- 172.21.15.67:0/4152163961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72800af120 msgr2=0x7f72800b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 --2- 172.21.15.67:0/4152163961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72800af120 0x7f72800b4740 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7278009d90 tx=0x7f727801c8e0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 -- 172.21.15.67:0/4152163961 shutdown_connections 2024-09-19T05:44:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 --2- 172.21.15.67:0/4152163961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72800af120 0x7f72800b4740 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 --2- 172.21.15.67:0/4152163961 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f728015e660 0x7f72800b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 -- 172.21.15.67:0/4152163961 >> 172.21.15.67:0/4152163961 conn(0x7f72800b2f40 msgr2=0x7f72800b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 -- 172.21.15.67:0/4152163961 shutdown_connections 2024-09-19T05:44:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 -- 172.21.15.67:0/4152163961 wait complete. 2024-09-19T05:44:18.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 Processor -- start 2024-09-19T05:44:18.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 -- start start 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72800af120 0x7f7280149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800b3a60 0x7f7280160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f728015e660 0x7f728014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f72800b5610 con 0x7f72800b3a60 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f72800b5490 con 0x7f728015e660 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f7285d9a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f72800b5790 con 0x7f72800af120 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800b3a60 0x7f7280160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800b3a60 0x7f7280160160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41312/0 (socket says 172.21.15.67:41312) 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727effd640 1 -- 172.21.15.67:0/3249503115 learned_addr learned my addr 172.21.15.67:0/3249503115 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727f7fe640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72800af120 0x7f7280149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727ffff640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f728015e660 0x7f728014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727effd640 1 -- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72800af120 msgr2=0x7f7280149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727effd640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72800af120 0x7f7280149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727effd640 1 -- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f728015e660 msgr2=0x7f728014eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727effd640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f728015e660 0x7f728014eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727effd640 1 -- 172.21.15.67:0/3249503115 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728014d1b0 con 0x7f72800b3a60 2024-09-19T05:44:18.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.541+0000 7f727effd640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800b3a60 0x7f7280160160 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f727000c430 tx=0x7f727000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7267fff640 1 -- 172.21.15.67:0/3249503115 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72700074e0 con 0x7f72800b3a60 2024-09-19T05:44:18.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7267fff640 1 -- 172.21.15.67:0/3249503115 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270007680 con 0x7f72800b3a60 2024-09-19T05:44:18.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7285d9a640 1 -- 172.21.15.67:0/3249503115 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f728014d490 con 0x7f72800b3a60 2024-09-19T05:44:18.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7267fff640 1 -- 172.21.15.67:0/3249503115 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270004a30 con 0x7f72800b3a60 2024-09-19T05:44:18.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7285d9a640 1 -- 172.21.15.67:0/3249503115 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7280149f50 con 0x7f72800b3a60 2024-09-19T05:44:18.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7267fff640 1 -- 172.21.15.67:0/3249503115 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f727001a020 con 0x7f72800b3a60 2024-09-19T05:44:18.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7267fff640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f726c0678c0 0x7f726c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7267fff640 1 -- 172.21.15.67:0/3249503115 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f7270085670 con 0x7f72800b3a60 2024-09-19T05:44:18.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f727f7fe640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f726c0678c0 0x7f726c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7288e56000 1 Processor -- start 2024-09-19T05:44:18.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7288e56000 1 -- start start 2024-09-19T05:44:18.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f727f7fe640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f726c0678c0 0x7f726c069d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7274009a40 tx=0x7f7274008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7288e56000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a92180bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7288e56000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a9217bf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7288e56000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 0x55a9217bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7288e56000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a921610cc0 con 0x55a92180bc10 2024-09-19T05:44:18.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7288e56000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a9215cba20 con 0x55a9217bf780 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f7288e56000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a92160cc80 con 0x55a92180c530 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f727f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a92180bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f727f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a92180bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41328/0 (socket says 172.21.15.67:41328) 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.545+0000 7f727f7fe640 1 -- 172.21.15.67:0/2523571596 learned_addr learned my addr 172.21.15.67:0/2523571596 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727effd640 1 --2- 172.21.15.67:0/2523571596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a9217bf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727ffff640 1 --2- 172.21.15.67:0/2523571596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 0x55a9217bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727f7fe640 1 -- 172.21.15.67:0/2523571596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 msgr2=0x55a9217bf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727f7fe640 1 --2- 172.21.15.67:0/2523571596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a9217bf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727f7fe640 1 -- 172.21.15.67:0/2523571596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 msgr2=0x55a9217bfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727f7fe640 1 --2- 172.21.15.67:0/2523571596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 0x55a9217bfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727f7fe640 1 -- 172.21.15.67:0/2523571596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9215b3d40 con 0x55a92180bc10 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727ffff640 1 --2- 172.21.15.67:0/2523571596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 0x55a9217bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727f7fe640 1 --2- 172.21.15.67:0/2523571596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a92180bff0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f7274011ce0 tx=0x7f7274014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f92a7e68c76451 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f72657fa640 1 -- 172.21.15.67:0/2523571596 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274011d10 con 0x55a92180bc10 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f72657fa640 1 -- 172.21.15.67:0/2523571596 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7274026070 con 0x55a92180bc10 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f72657fa640 1 -- 172.21.15.67:0/2523571596 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274021640 con 0x55a92180bc10 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- 172.21.15.67:0/2523571596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 msgr2=0x55a92180bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 --2- 172.21.15.67:0/2523571596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a92180bff0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f7274011ce0 tx=0x7f7274014000 comp rx=0 tx=0).stop 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- 172.21.15.67:0/2523571596 shutdown_connections 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 --2- 172.21.15.67:0/2523571596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 0x55a9217bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 --2- 172.21.15.67:0/2523571596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a9217bf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 --2- 172.21.15.67:0/2523571596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a92180bff0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- 172.21.15.67:0/2523571596 >> 172.21.15.67:0/2523571596 conn(0x55a9217ec9b0 msgr2=0x55a9217eeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- 172.21.15.67:0/2523571596 shutdown_connections 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- 172.21.15.67:0/2523571596 wait complete. 2024-09-19T05:44:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- start start 2024-09-19T05:44:18.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 Processor -- start 2024-09-19T05:44:18.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 0x55a921812f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a9218134b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a9217c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a9215aa2c0 con 0x55a92180bc10 2024-09-19T05:44:18.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a9215cf370 con 0x55a9217bf780 2024-09-19T05:44:18.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a92161ef50 con 0x55a92180c530 2024-09-19T05:44:18.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 10 client.0 _ll_register_callbacks cb 0x55a921671db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a9218134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a9218134b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41334/0 (socket says 172.21.15.67:41334) 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727effd640 1 -- 172.21.15.67:0/1215810068 learned_addr learned my addr 172.21.15.67:0/1215810068 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727ffff640 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a9217c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727effd640 1 -- 172.21.15.67:0/1215810068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 msgr2=0x55a9217c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727f7fe640 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 0x55a921812f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727effd640 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a9217c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727effd640 1 -- 172.21.15.67:0/1215810068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 msgr2=0x55a921812f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727effd640 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 0x55a921812f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727effd640 1 -- 172.21.15.67:0/1215810068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9215b0770 con 0x55a92180bc10 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f727effd640 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a9218134b0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f72700839a0 tx=0x7f72700559d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee54132bea4e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f725e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f725e7fc640 1 -- 172.21.15.67:0/1215810068 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727005c070 con 0x55a92180bc10 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f725e7fc640 1 -- 172.21.15.67:0/1215810068 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f7270055b70 con 0x55a92180bc10 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- 172.21.15.67:0/1215810068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7274026070 con 0x55a92180bc10 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f725e7fc640 1 -- 172.21.15.67:0/1215810068 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f727005c210 con 0x55a92180bc10 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 10 client.8727 fetch_fsmap learned FSMap version 98 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 1 -- 172.21.15.67:0/1215810068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55a9215ce3f0 con 0x55a92180bc10 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f725e7fc640 1 -- 172.21.15.67:0/1215810068 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7274026070 con 0x55a92180bc10 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f725e7fc640 1 -- 172.21.15.67:0/1215810068 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f7270004bd0 con 0x55a92180bc10 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.549+0000 7f7288e56000 10 client.8727 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 10 client.8727 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 20 client.8727 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55a9217c5ea0 0x55a9217c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 4 client.8727 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 -- 172.21.15.67:0/1215810068 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9215aad90 con 0x55a9217c5ea0 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f727f7fe640 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55a9217c5ea0 0x55a9217c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f727f7fe640 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55a9217c5ea0 0x55a9217c6280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc3d480d0598ed28 server_cookie=5248b48f7d6afafb in_seq=0 out_seq=0 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f725e7fc640 10 client.8727 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f725e7fc640 1 -- 172.21.15.67:0/1215810068 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9215aad90 con 0x55a9217c5ea0 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f725e7fc640 10 client.8727 handle_command_reply: tid=0 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 client.8727 shutdown 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 -- 172.21.15.67:0/1215810068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 msgr2=0x55a9218134b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a9218134b0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f72700839a0 tx=0x7f72700559d0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 -- 172.21.15.67:0/1215810068 shutdown_connections 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55a9217c5ea0 0x55a9217c6280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a9217c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a92180bc10 0x55a9218134b0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 --2- 172.21.15.67:0/1215810068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a9217bf780 0x55a921812f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 -- 172.21.15.67:0/1215810068 >> 172.21.15.67:0/1215810068 conn(0x55a9217ec9b0 msgr2=0x55a9217be940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f725e7fc640 0 client.8727 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 -- 172.21.15.67:0/1215810068 shutdown_connections 2024-09-19T05:44:18.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 1 -- 172.21.15.67:0/1215810068 wait complete. 2024-09-19T05:44:18.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.553+0000 7f7288e56000 20 client.8727 trim_cache size 0 max 16384 2024-09-19T05:44:18.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.569+0000 7f7288e56000 1 Processor -- start 2024-09-19T05:44:18.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.569+0000 7f7288e56000 1 -- start start 2024-09-19T05:44:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a921819600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a92180bc10 0x55a921823530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a921823a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7280202f50 con 0x55a9217bf780 2024-09-19T05:44:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f728015f720 con 0x55a92180bc10 2024-09-19T05:44:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7280202900 con 0x55a92180c530 2024-09-19T05:44:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a921819600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a921819600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41348/0 (socket says 172.21.15.67:41348) 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 -- 172.21.15.67:0/3324218558 learned_addr learned my addr 172.21.15.67:0/3324218558 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 -- 172.21.15.67:0/3324218558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 msgr2=0x55a921823a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727ffff640 1 --2- 172.21.15.67:0/3324218558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a921823a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727effd640 1 --2- 172.21.15.67:0/3324218558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a92180bc10 0x55a921823530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 --2- 172.21.15.67:0/3324218558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a921823a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 -- 172.21.15.67:0/3324218558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a92180bc10 msgr2=0x55a921823530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 --2- 172.21.15.67:0/3324218558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a92180bc10 0x55a921823530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 -- 172.21.15.67:0/3324218558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a921692320 con 0x55a9217bf780 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 --2- 172.21.15.67:0/3324218558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a921819600 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f7274008010 tx=0x7f7274018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f36717461fed2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7264ff9640 1 -- 172.21.15.67:0/3324218558 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727403b070 con 0x55a9217bf780 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7264ff9640 1 -- 172.21.15.67:0/3324218558 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7274026040 con 0x55a9217bf780 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7264ff9640 1 -- 172.21.15.67:0/3324218558 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274021800 con 0x55a9217bf780 2024-09-19T05:44:18.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- 172.21.15.67:0/3324218558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 msgr2=0x55a921819600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 --2- 172.21.15.67:0/3324218558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a921819600 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f7274008010 tx=0x7f7274018000 comp rx=0 tx=0).stop 2024-09-19T05:44:18.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- 172.21.15.67:0/3324218558 shutdown_connections 2024-09-19T05:44:18.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 --2- 172.21.15.67:0/3324218558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180c530 0x55a921823a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 --2- 172.21.15.67:0/3324218558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a92180bc10 0x55a921823530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 --2- 172.21.15.67:0/3324218558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a921819600 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- 172.21.15.67:0/3324218558 >> 172.21.15.67:0/3324218558 conn(0x55a9217ec9b0 msgr2=0x55a9217c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- 172.21.15.67:0/3324218558 shutdown_connections 2024-09-19T05:44:18.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- 172.21.15.67:0/3324218558 wait complete. 2024-09-19T05:44:18.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- start start 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 Processor -- start 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a92187b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180bc10 0x55a921817240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a92180c530 0x55a921817780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a9215b8120 con 0x55a9217bf780 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a921691e90 con 0x55a92180c530 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a9215bab90 con 0x55a92180bc10 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f7288e56000 10 client.0 _ll_register_callbacks cb 0x7f7270051bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a92187b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a92187b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41356/0 (socket says 172.21.15.67:41356) 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 -- 172.21.15.67:0/3311156644 learned_addr learned my addr 172.21.15.67:0/3311156644 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727effd640 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180bc10 0x55a921817240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727ffff640 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a92180c530 0x55a921817780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 -- 172.21.15.67:0/3311156644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180bc10 msgr2=0x55a921817240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180bc10 0x55a921817240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 -- 172.21.15.67:0/3311156644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a92180c530 msgr2=0x55a921817780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a92180c530 0x55a921817780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 -- 172.21.15.67:0/3311156644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9215a45c0 con 0x55a9217bf780 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f727f7fe640 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a92187b280 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f7274000c10 tx=0x7f72740046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f63e2ab300190c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.573+0000 7f725e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f725e7fc640 1 -- 172.21.15.67:0/3311156644 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727403b070 con 0x55a9217bf780 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 -- 172.21.15.67:0/3311156644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7274026040 con 0x55a9217bf780 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f725e7fc640 1 -- 172.21.15.67:0/3311156644 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f727400f040 con 0x55a9217bf780 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f725e7fc640 1 -- 172.21.15.67:0/3311156644 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f7274048050 con 0x55a9217bf780 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 10 client.8733 fetch_fsmap learned FSMap version 98 2024-09-19T05:44:18.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 -- 172.21.15.67:0/3311156644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55a9215a8330 con 0x55a9217bf780 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f725e7fc640 1 -- 172.21.15.67:0/3311156644 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7274026040 con 0x55a9217bf780 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f725e7fc640 1 -- 172.21.15.67:0/3311156644 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f727404b020 con 0x55a9217bf780 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 10 client.8733 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 10 client.8733 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 20 client.8733 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55a921817cc0 0x55a9218180d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 4 client.8733 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 -- 172.21.15.67:0/3311156644 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55a92161e3f0 con 0x55a921817cc0 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f727effd640 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55a921817cc0 0x55a9218180d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f727effd640 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55a921817cc0 0x55a9218180d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55ee2051b160ac72 server_cookie=3b21ebd0f37add5e in_seq=0 out_seq=0 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f725e7fc640 10 client.8733 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f725e7fc640 1 -- 172.21.15.67:0/3311156644 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a92161e3f0 con 0x55a921817cc0 2024-09-19T05:44:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f725e7fc640 10 client.8733 handle_command_reply: tid=0 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 client.8733 shutdown 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 -- 172.21.15.67:0/3311156644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 msgr2=0x55a92187b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a92187b280 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f7274000c10 tx=0x7f72740046d0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 -- 172.21.15.67:0/3311156644 shutdown_connections 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x55a921817cc0 0x55a9218180d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a92180c530 0x55a921817780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a92180bc10 0x55a921817240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f725e7fc640 0 client.8733 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 --2- 172.21.15.67:0/3311156644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a9217bf780 0x55a92187b280 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 -- 172.21.15.67:0/3311156644 >> 172.21.15.67:0/3311156644 conn(0x55a9217ec9b0 msgr2=0x55a9217bda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 -- 172.21.15.67:0/3311156644 shutdown_connections 2024-09-19T05:44:18.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 1 -- 172.21.15.67:0/3311156644 wait complete. 2024-09-19T05:44:18.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7288e56000 20 client.8733 trim_cache size 0 max 16384 2024-09-19T05:44:18.582 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:44:18.582 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:44:18.582 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:44:18.582 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:44:18.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 -- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f726c0678c0 msgr2=0x7f726c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f726c0678c0 0x7f726c069d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7274009a40 tx=0x7f7274008040 comp rx=0 tx=0).stop 2024-09-19T05:44:18.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 -- 172.21.15.67:0/3249503115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800b3a60 msgr2=0x7f7280160160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800b3a60 0x7f7280160160 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f727000c430 tx=0x7f727000c8f0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 -- 172.21.15.67:0/3249503115 shutdown_connections 2024-09-19T05:44:18.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f728015e660 0x7f728014eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72800b3a60 0x7f7280160160 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f726c0678c0 0x7f726c069d80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 --2- 172.21.15.67:0/3249503115 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72800af120 0x7f7280149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 -- 172.21.15.67:0/3249503115 >> 172.21.15.67:0/3249503115 conn(0x7f72800b2f40 msgr2=0x7f7280158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 -- 172.21.15.67:0/3249503115 shutdown_connections 2024-09-19T05:44:18.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.577+0000 7f7285d9a640 1 -- 172.21.15.67:0/3249503115 wait complete. 2024-09-19T05:44:18.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:18.593 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-19T05:44:18.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e0a712640 1 Processor -- start 2024-09-19T05:44:18.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e0a712640 1 -- start start 2024-09-19T05:44:18.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e0a712640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3e040b3750 0x7f3e040ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e0a712640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e040cea90 con 0x7f3e040d0de0 2024-09-19T05:44:18.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e0a712640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e040cd7e0 con 0x7f3e0415f950 2024-09-19T05:44:18.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e0a712640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3e040af1a0 con 0x7f3e040b3750 2024-09-19T05:44:18.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e037fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3e040d0de0 0x7f3e040b1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48646/0 (socket says 172.21.15.67:48646) 2024-09-19T05:44:18.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e037fe640 1 -- 172.21.15.67:0/1896989482 learned_addr learned my addr 172.21.15.67:0/1896989482 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:18.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e08caf640 1 --2- 172.21.15.67:0/1896989482 >> v2:172.21.15.97:3300/0 conn(0x7f3e040b3750 0x7f3e040ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156292419 0 0) 0x7f3e040cea90 con 0x7f3e040d0de0 2024-09-19T05:44:18.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dec003530 con 0x7f3e040d0de0 2024-09-19T05:44:18.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 855730083 0 0) 0x7f3dec003530 con 0x7f3e040d0de0 2024-09-19T05:44:18.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 >> v2:172.21.15.97:3300/0 conn(0x7f3e040b3750 msgr2=0x7f3e040ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 --2- 172.21.15.67:0/1896989482 >> v2:172.21.15.97:3300/0 conn(0x7f3e040b3750 0x7f3e040ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 >> v1:172.21.15.97:6789/0 conn(0x7f3e0415f950 legacy=0x7f3e040d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e040cdac0 con 0x7f3e040d0de0 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3df4001680 con 0x7f3e040d0de0 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 >> v1:172.21.15.67:6789/0 conn(0x7f3e040d0de0 legacy=0x7f3e040b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3dec0039c0 0x7f3dec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3dec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3dec0051d0 0x7f3dec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec00c040 con 0x7f3dec004810 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec00c1f0 con 0x7f3dec0051d0 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3dec00c3f0 con 0x7f3dec0039c0 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e037fe640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3dec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e08caf640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3dec0051d0 0x7f3dec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e03fff640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3dec0039c0 0x7f3dec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e037fe640 1 -- 172.21.15.67:0/1896989482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3dec0039c0 msgr2=0x7f3dec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e037fe640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3dec0039c0 0x7f3dec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e037fe640 1 -- 172.21.15.67:0/1896989482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3dec0051d0 msgr2=0x7f3dec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e037fe640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3dec0051d0 0x7f3dec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e037fe640 1 -- 172.21.15.67:0/1896989482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec003530 con 0x7f3dec004810 2024-09-19T05:44:18.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.713+0000 7f3e08caf640 1 -- 172.21.15.67:0/1896989482 reap_dead start 2024-09-19T05:44:18.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e037fe640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3dec004c90 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f3df400c210 tx=0x7f3df401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c173b396205d92d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4007d40 con 0x7f3dec004810 2024-09-19T05:44:18.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4005b00 con 0x7f3dec004810 2024-09-19T05:44:18.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e02ffd640 1 -- 172.21.15.67:0/1896989482 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4007070 con 0x7f3dec004810 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 -- 172.21.15.67:0/1896989482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 msgr2=0x7f3dec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3dec004c90 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f3df400c210 tx=0x7f3df401f3b0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 -- 172.21.15.67:0/1896989482 shutdown_connections 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 --2- 172.21.15.67:0/1896989482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3dec004c90 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 -- 172.21.15.67:0/1896989482 >> 172.21.15.67:0/1896989482 conn(0x7f3e040d22f0 msgr2=0x7f3e040d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 -- 172.21.15.67:0/1896989482 shutdown_connections 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 -- 172.21.15.67:0/1896989482 wait complete. 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 Processor -- start 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 -- start start 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3e0414f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.717+0000 7f3e0a712640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e04151bc0 0x7f3e0414e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e0a712640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e040ca460 0x7f3e040ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e0a712640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0409bc40 con 0x7f3dec004810 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e0a712640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0415fd30 con 0x7f3e04151bc0 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e0a712640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0415feb0 con 0x7f3e040ca460 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e03fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3e0414f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e03fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3e0414f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41364/0 (socket says 172.21.15.67:41364) 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e03fff640 1 -- 172.21.15.67:0/3130949415 learned_addr learned my addr 172.21.15.67:0/3130949415 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e037fe640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e04151bc0 0x7f3e0414e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e08caf640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e040ca460 0x7f3e040ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e03fff640 1 -- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e040ca460 msgr2=0x7f3e040ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e03fff640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e040ca460 0x7f3e040ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e03fff640 1 -- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e04151bc0 msgr2=0x7f3e0414e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e03fff640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e04151bc0 0x7f3e0414e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e03fff640 1 -- 172.21.15.67:0/3130949415 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e040c93c0 con 0x7f3dec004810 2024-09-19T05:44:18.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e03fff640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3e0414f080 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f3df800e4b0 tx=0x7f3df800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e00ff9640 1 -- 172.21.15.67:0/3130949415 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df80052e0 con 0x7f3dec004810 2024-09-19T05:44:18.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e00ff9640 1 -- 172.21.15.67:0/3130949415 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df8018070 con 0x7f3dec004810 2024-09-19T05:44:18.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e0a712640 1 -- 172.21.15.67:0/3130949415 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e040c96a0 con 0x7f3dec004810 2024-09-19T05:44:18.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e00ff9640 1 -- 172.21.15.67:0/3130949415 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8005480 con 0x7f3dec004810 2024-09-19T05:44:18.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e0a712640 1 -- 172.21.15.67:0/3130949415 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e040c9c60 con 0x7f3dec004810 2024-09-19T05:44:18.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e00ff9640 1 -- 172.21.15.67:0/3130949415 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3df8003840 con 0x7f3dec004810 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e00ff9640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3df00678c0 0x7f3df0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e00ff9640 1 -- 172.21.15.67:0/3130949415 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f3df80859e0 con 0x7f3dec004810 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.721+0000 7f3e037fe640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3df00678c0 0x7f3df0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e037fe640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3df00678c0 0x7f3df0069d80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3df40af000 tx=0x7f3df40aa000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 Processor -- start 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- start start 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9d9c0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d973870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9d974190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560e9d85d960 con 0x560e9d9c0690 2024-09-19T05:44:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x560e9d7a1900 con 0x560e9d9bfd70 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x560e9d7c4d40 con 0x560e9d973db0 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d973870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d973870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41370/0 (socket says 172.21.15.67:41370) 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e037fe640 1 -- 172.21.15.67:0/156405039 learned_addr learned my addr 172.21.15.67:0/156405039 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e03fff640 1 --2- 172.21.15.67:0/156405039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9d9c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e08caf640 1 --2- 172.21.15.67:0/156405039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9d974190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e037fe640 1 -- 172.21.15.67:0/156405039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 msgr2=0x560e9d974190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e037fe640 1 --2- 172.21.15.67:0/156405039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9d974190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e037fe640 1 -- 172.21.15.67:0/156405039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 msgr2=0x560e9d9c0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e037fe640 1 --2- 172.21.15.67:0/156405039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9d9c0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e037fe640 1 -- 172.21.15.67:0/156405039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9d76b580 con 0x560e9d9c0690 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e037fe640 1 --2- 172.21.15.67:0/156405039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d973870 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f3df401f1e0 tx=0x7f3df4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3897640453f1f426 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3de9ffb640 1 -- 172.21.15.67:0/156405039 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4007270 con 0x560e9d9c0690 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3de9ffb640 1 -- 172.21.15.67:0/156405039 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4007410 con 0x560e9d9c0690 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3de9ffb640 1 -- 172.21.15.67:0/156405039 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df40bb480 con 0x560e9d9c0690 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/156405039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 msgr2=0x560e9d973870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/156405039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d973870 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f3df401f1e0 tx=0x7f3df4001a50 comp rx=0 tx=0).stop 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/156405039 shutdown_connections 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/156405039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9d974190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/156405039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d973870 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/156405039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9d9c0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/156405039 >> 172.21.15.67:0/156405039 conn(0x560e9d9a1040 msgr2=0x560e9d9a3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/156405039 shutdown_connections 2024-09-19T05:44:18.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/156405039 wait complete. 2024-09-19T05:44:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- start start 2024-09-19T05:44:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 Processor -- start 2024-09-19T05:44:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d973db0 0x560e9d9c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d9bfd70 0x560e9d9c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9c0690 0x560e9d9c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560e9d7c0d00 con 0x560e9d973db0 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x560e9d77faa0 con 0x560e9d9c0690 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x560e9d75e340 con 0x560e9d9bfd70 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.725+0000 7f3e0d7ce000 10 client.0 _ll_register_callbacks cb 0x560e9d961760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e03fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d973db0 0x560e9d9c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e03fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d973db0 0x560e9d9c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41380/0 (socket says 172.21.15.67:41380) 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e03fff640 1 -- 172.21.15.67:0/709675738 learned_addr learned my addr 172.21.15.67:0/709675738 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e037fe640 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d9bfd70 0x560e9d9c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e08caf640 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9c0690 0x560e9d9c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e03fff640 1 -- 172.21.15.67:0/709675738 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d9bfd70 msgr2=0x560e9d9c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e03fff640 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d9bfd70 0x560e9d9c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e03fff640 1 -- 172.21.15.67:0/709675738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9c0690 msgr2=0x560e9d9c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e03fff640 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9c0690 0x560e9d9c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e03fff640 1 -- 172.21.15.67:0/709675738 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e9d767dc0 con 0x560e9d973db0 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e037fe640 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d9bfd70 0x560e9d9c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e03fff640 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d973db0 0x560e9d9c6ce0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f3df8000fc0 tx=0x7f3df80564e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de25ce550f86d993 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3de2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3de2ffd640 1 -- 172.21.15.67:0/709675738 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df805e900 con 0x560e9d973db0 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3de2ffd640 1 -- 172.21.15.67:0/709675738 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f3df8010da0 con 0x560e9d973db0 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/709675738 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df4007410 con 0x560e9d973db0 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3de2ffd640 1 -- 172.21.15.67:0/709675738 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f3df8074050 con 0x560e9d973db0 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 10 client.8745 fetch_fsmap learned FSMap version 98 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/709675738 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x560e9d7647f0 con 0x560e9d973db0 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3de2ffd640 1 -- 172.21.15.67:0/709675738 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4007410 con 0x560e9d973db0 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3de2ffd640 1 -- 172.21.15.67:0/709675738 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f3df806d070 con 0x560e9d973db0 2024-09-19T05:44:18.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 10 client.8745 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 10 client.8745 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 20 client.8745 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x560e9d9cf0b0 0x560e9d9d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 4 client.8745 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/709675738 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e9d75ee10 con 0x560e9d9cf0b0 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e037fe640 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x560e9d9cf0b0 0x560e9d9d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3de2ffd640 10 client.8745 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e037fe640 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x560e9d9cf0b0 0x560e9d9d14a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a38ba873bdab539 server_cookie=a9fe4833c275f4f2 in_seq=0 out_seq=0 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3de2ffd640 1 -- 172.21.15.67:0/709675738 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e9d75ee10 con 0x560e9d9cf0b0 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3de2ffd640 10 client.8745 handle_command_reply: tid=0 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 client.8745 shutdown 2024-09-19T05:44:18.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/709675738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d973db0 msgr2=0x560e9d9c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d973db0 0x560e9d9c6ce0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f3df8000fc0 tx=0x7f3df80564e0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/709675738 shutdown_connections 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x560e9d9cf0b0 0x560e9d9d14a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9c0690 0x560e9d9c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d9bfd70 0x560e9d9c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3de2ffd640 0 client.8745 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/709675738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d973db0 0x560e9d9c6ce0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/709675738 >> 172.21.15.67:0/709675738 conn(0x560e9d9a1040 msgr2=0x560e9d972f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/709675738 shutdown_connections 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/709675738 wait complete. 2024-09-19T05:44:18.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.729+0000 7f3e0d7ce000 20 client.8745 trim_cache size 0 max 16384 2024-09-19T05:44:18.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 Processor -- start 2024-09-19T05:44:18.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 -- start start 2024-09-19T05:44:18.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9da2f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9da2f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9da2fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04201540 con 0x560e9d9c0690 2024-09-19T05:44:18.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04200540 con 0x560e9d9bfd70 2024-09-19T05:44:18.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e040b7960 con 0x560e9d973db0 2024-09-19T05:44:18.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e08caf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9da2fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e08caf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9da2fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41394/0 (socket says 172.21.15.67:41394) 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e08caf640 1 -- 172.21.15.67:0/4053292439 learned_addr learned my addr 172.21.15.67:0/4053292439 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e037fe640 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9da2f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e03fff640 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9da2f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e08caf640 1 -- 172.21.15.67:0/4053292439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 msgr2=0x560e9da2f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e08caf640 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9da2f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e08caf640 1 -- 172.21.15.67:0/4053292439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 msgr2=0x560e9da2f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e08caf640 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9da2f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e08caf640 1 -- 172.21.15.67:0/4053292439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9d782470 con 0x560e9d9c0690 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e037fe640 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9da2f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e03fff640 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9da2f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e08caf640 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9da2fc30 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f3e040cfdd0 tx=0x7f3dfc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34260710889c350f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3de97fa640 1 -- 172.21.15.67:0/4053292439 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc01b020 con 0x560e9d9c0690 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3de97fa640 1 -- 172.21.15.67:0/4053292439 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc004780 con 0x560e9d9c0690 2024-09-19T05:44:18.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3de97fa640 1 -- 172.21.15.67:0/4053292439 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0176b0 con 0x560e9d9c0690 2024-09-19T05:44:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/4053292439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 msgr2=0x560e9da2fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9da2fc30 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f3e040cfdd0 tx=0x7f3dfc009750 comp rx=0 tx=0).stop 2024-09-19T05:44:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/4053292439 shutdown_connections 2024-09-19T05:44:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9da2fc30 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9da2f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/4053292439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9da2f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/4053292439 >> 172.21.15.67:0/4053292439 conn(0x560e9d9a1040 msgr2=0x560e9d97abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/4053292439 shutdown_connections 2024-09-19T05:44:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.749+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/4053292439 wait complete. 2024-09-19T05:44:18.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- start start 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 Processor -- start 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9d9cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9d9ef790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d9efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560e9d76af20 con 0x560e9d9c0690 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e041fff50 con 0x560e9d9bfd70 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x560e9d97f3f0 con 0x560e9d973db0 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 10 client.0 _ll_register_callbacks cb 0x7f3df8055680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e08caf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d9efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e08caf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d9efcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41398/0 (socket says 172.21.15.67:41398) 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e08caf640 1 -- 172.21.15.67:0/2264459442 learned_addr learned my addr 172.21.15.67:0/2264459442 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e037fe640 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9d9ef790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e03fff640 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9d9cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e08caf640 1 -- 172.21.15.67:0/2264459442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 msgr2=0x560e9d9cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e08caf640 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9d9cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e08caf640 1 -- 172.21.15.67:0/2264459442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 msgr2=0x560e9d9ef790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e08caf640 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9d9ef790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e08caf640 1 -- 172.21.15.67:0/2264459442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e9d758640 con 0x560e9d9c0690 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e08caf640 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d9efcd0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc002240 tx=0x7f3dfc004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb08fdb08a6e69be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3de2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3de2ffd640 1 -- 172.21.15.67:0/2264459442 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc02a430 con 0x560e9d9c0690 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3de2ffd640 1 -- 172.21.15.67:0/2264459442 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f3dfc021430 con 0x560e9d9c0690 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/2264459442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dfc004780 con 0x560e9d9c0690 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3de2ffd640 1 -- 172.21.15.67:0/2264459442 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f3dfc032050 con 0x560e9d9c0690 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 10 client.8751 fetch_fsmap learned FSMap version 98 2024-09-19T05:44:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/2264459442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x560e9d75c3b0 con 0x560e9d9c0690 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3de2ffd640 1 -- 172.21.15.67:0/2264459442 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc004780 con 0x560e9d9c0690 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3de2ffd640 1 -- 172.21.15.67:0/2264459442 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f3dfc035020 con 0x560e9d9c0690 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 10 client.8751 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 10 client.8751 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 20 client.8751 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x560e9d9f0210 0x560e9da33aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 4 client.8751 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/2264459442 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560e9d7d2470 con 0x560e9d9f0210 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e03fff640 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x560e9d9f0210 0x560e9da33aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3de2ffd640 10 client.8751 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e03fff640 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x560e9d9f0210 0x560e9da33aa0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15625a0a02817c7a server_cookie=612fa64c79e0a1e6 in_seq=0 out_seq=0 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3de2ffd640 1 -- 172.21.15.67:0/2264459442 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x560e9d7d2470 con 0x560e9d9f0210 2024-09-19T05:44:18.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3de2ffd640 10 client.8751 handle_command_reply: tid=0 2024-09-19T05:44:18.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 client.8751 shutdown 2024-09-19T05:44:18.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/2264459442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 msgr2=0x560e9d9efcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d9efcd0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc002240 tx=0x7f3dfc004a50 comp rx=0 tx=0).stop 2024-09-19T05:44:18.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/2264459442 shutdown_connections 2024-09-19T05:44:18.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x560e9d9f0210 0x560e9da33aa0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560e9d9c0690 0x560e9d9efcd0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560e9d9bfd70 0x560e9d9ef790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3de2ffd640 0 client.8751 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:18.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 --2- 172.21.15.67:0/2264459442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x560e9d973db0 0x560e9d9cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/2264459442 >> 172.21.15.67:0/2264459442 conn(0x560e9d9a1040 msgr2=0x560e9d97b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/2264459442 shutdown_connections 2024-09-19T05:44:18.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 1 -- 172.21.15.67:0/2264459442 wait complete. 2024-09-19T05:44:18.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0d7ce000 20 client.8751 trim_cache size 0 max 16384 2024-09-19T05:44:18.760 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:44:18.760 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-19T05:44:18.760 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-19T05:44:18.760 INFO:teuthology.orchestra.run.smithi067.stdout: "a6a2ab33-57cd-4f32-aa2c-7da57120e692": { 2024-09-19T05:44:18.760 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_control_test_path", 2024-09-19T05:44:18.760 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "a6a2ab33-57cd-4f32-aa2c-7da57120e692", 2024-09-19T05:44:18.761 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive" 2024-09-19T05:44:18.761 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:18.761 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:18.761 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:44:18.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0a712640 1 -- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3df00678c0 msgr2=0x7f3df0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0a712640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3df00678c0 0x7f3df0069d80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3df40af000 tx=0x7f3df40aa000 comp rx=0 tx=0).stop 2024-09-19T05:44:18.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0a712640 1 -- 172.21.15.67:0/3130949415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 msgr2=0x7f3e0414f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.753+0000 7f3e0a712640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3e0414f080 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f3df800e4b0 tx=0x7f3df800e970 comp rx=0 tx=0).stop 2024-09-19T05:44:18.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.757+0000 7f3e0a712640 1 -- 172.21.15.67:0/3130949415 shutdown_connections 2024-09-19T05:44:18.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.757+0000 7f3e0a712640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3df00678c0 0x7f3df0069d80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.757+0000 7f3e0a712640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e040ca460 0x7f3e040ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.757+0000 7f3e0a712640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e04151bc0 0x7f3e0414e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.757+0000 7f3e0a712640 1 --2- 172.21.15.67:0/3130949415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dec004810 0x7f3e0414f080 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.757+0000 7f3e0a712640 1 -- 172.21.15.67:0/3130949415 >> 172.21.15.67:0/3130949415 conn(0x7f3e040d22f0 msgr2=0x7f3e040719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.757+0000 7f3e0a712640 1 -- 172.21.15.67:0/3130949415 shutdown_connections 2024-09-19T05:44:18.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.757+0000 7f3e0a712640 1 -- 172.21.15.67:0/3130949415 wait complete. 2024-09-19T05:44:18.771 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:18.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f15903640 1 Processor -- start 2024-09-19T05:44:18.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f15903640 1 -- start start 2024-09-19T05:44:18.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f15903640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4f1006dde0 0x7f4f100b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f15903640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4f100b3510 0x7f4f1006f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f15903640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f1006e3c0 con 0x7f4f1015c030 2024-09-19T05:44:18.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f15903640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4f1006e6a0 con 0x7f4f1006dde0 2024-09-19T05:44:18.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f15903640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4f1006e980 con 0x7f4f100b3510 2024-09-19T05:44:18.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f0e7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4f1006dde0 0x7f4f100b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f0e7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4f1006dde0 0x7f4f100b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41404/0 (socket says 172.21.15.67:41404) 2024-09-19T05:44:18.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f0e7fc640 1 -- 172.21.15.67:0/4182611102 learned_addr learned my addr 172.21.15.67:0/4182611102 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f0f7fe640 1 --2- 172.21.15.67:0/4182611102 >> v2:172.21.15.97:3300/0 conn(0x7f4f100b3510 0x7f4f1006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f0e7fc640 1 -- 172.21.15.67:0/4182611102 >> v2:172.21.15.97:3300/0 conn(0x7f4f100b3510 msgr2=0x7f4f1006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f0e7fc640 1 --2- 172.21.15.67:0/4182611102 >> v2:172.21.15.97:3300/0 conn(0x7f4f100b3510 0x7f4f1006f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f0e7fc640 1 -- 172.21.15.67:0/4182611102 >> v1:172.21.15.97:6789/0 conn(0x7f4f1015c030 legacy=0x7f4f1015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:18.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.889+0000 7f4f0e7fc640 1 -- 172.21.15.67:0/4182611102 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1006ec60 con 0x7f4f1006dde0 2024-09-19T05:44:18.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0e7fc640 1 --2- 172.21.15.67:0/4182611102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1006dde0 0x7f4f100b2fd0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f4f100afbf0 tx=0x7f4f0401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbaf4c9cf51a2ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0dffb640 1 -- 172.21.15.67:0/4182611102 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f040b1070 con 0x7f4f1006dde0 2024-09-19T05:44:18.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0dffb640 1 -- 172.21.15.67:0/4182611102 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f040ac620 con 0x7f4f1006dde0 2024-09-19T05:44:18.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0dffb640 1 -- 172.21.15.67:0/4182611102 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f040ac9f0 con 0x7f4f1006dde0 2024-09-19T05:44:18.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 -- 172.21.15.67:0/4182611102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1006dde0 msgr2=0x7f4f100b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 --2- 172.21.15.67:0/4182611102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1006dde0 0x7f4f100b2fd0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f4f100afbf0 tx=0x7f4f0401c4b0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 -- 172.21.15.67:0/4182611102 shutdown_connections 2024-09-19T05:44:18.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 --2- 172.21.15.67:0/4182611102 >> v2:172.21.15.97:3300/0 conn(0x7f4f100b3510 0x7f4f1006f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 --2- 172.21.15.67:0/4182611102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1006dde0 0x7f4f100b2fd0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 -- 172.21.15.67:0/4182611102 >> 172.21.15.67:0/4182611102 conn(0x7f4f100d0080 msgr2=0x7f4f100d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:18.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 -- 172.21.15.67:0/4182611102 shutdown_connections 2024-09-19T05:44:18.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 -- 172.21.15.67:0/4182611102 wait complete. 2024-09-19T05:44:18.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 Processor -- start 2024-09-19T05:44:18.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 -- start start 2024-09-19T05:44:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f1006dde0 0x7f4f1015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f100b3510 0x7f4f10159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1015c030 0x7f4f1014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4f101692f0 con 0x7f4f1015c030 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1015c620 con 0x7f4f100b3510 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f15903640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4f10169470 con 0x7f4f1006dde0 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1015c030 0x7f4f1014ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1015c030 0x7f4f1014ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41408/0 (socket says 172.21.15.67:41408) 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0f7fe640 1 -- 172.21.15.67:0/640788530 learned_addr learned my addr 172.21.15.67:0/640788530 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0e7fc640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f100b3510 0x7f4f10159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0effd640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f1006dde0 0x7f4f1015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0f7fe640 1 -- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f1006dde0 msgr2=0x7f4f1015dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0f7fe640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f1006dde0 0x7f4f1015dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0f7fe640 1 -- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f100b3510 msgr2=0x7f4f10159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0f7fe640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f100b3510 0x7f4f10159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0f7fe640 1 -- 172.21.15.67:0/640788530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1015e4e0 con 0x7f4f1015c030 2024-09-19T05:44:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0effd640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f1006dde0 0x7f4f1015dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.893+0000 7f4f0e7fc640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f100b3510 0x7f4f10159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4f0f7fe640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1015c030 0x7f4f1014ed10 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f4f08007e40 tx=0x7f4f0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4ef7fff640 1 -- 172.21.15.67:0/640788530 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08014620 con 0x7f4f1015c030 2024-09-19T05:44:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4ef7fff640 1 -- 172.21.15.67:0/640788530 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f08019070 con 0x7f4f1015c030 2024-09-19T05:44:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4f15903640 1 -- 172.21.15.67:0/640788530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1015e7c0 con 0x7f4f1015c030 2024-09-19T05:44:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4ef7fff640 1 -- 172.21.15.67:0/640788530 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08014a20 con 0x7f4f1015c030 2024-09-19T05:44:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4f15903640 1 -- 172.21.15.67:0/640788530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f1015ed80 con 0x7f4f1015c030 2024-09-19T05:44:18.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4f15903640 1 -- 172.21.15.67:0/640788530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f100b2fd0 con 0x7f4f1015c030 2024-09-19T05:44:18.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4ef7fff640 1 -- 172.21.15.67:0/640788530 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f08014bc0 con 0x7f4f1015c030 2024-09-19T05:44:18.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4ef7fff640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4efc0678c0 0x7f4efc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:18.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4ef7fff640 1 -- 172.21.15.67:0/640788530 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f4f08086660 con 0x7f4f1015c030 2024-09-19T05:44:18.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4f0effd640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4efc0678c0 0x7f4efc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:18.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.897+0000 7f4f0effd640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4efc0678c0 0x7f4efc069d80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4f10155be0 tx=0x7f4f00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:18.901+0000 7f4ef7fff640 1 -- 172.21.15.67:0/640788530 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4f080570a0 con 0x7f4f1015c030 2024-09-19T05:44:19.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.093+0000 7f4f15903640 1 -- 172.21.15.67:0/640788530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f1015f220 con 0x7f4f1015c030 2024-09-19T05:44:19.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4ef7fff640 1 -- 172.21.15.67:0/640788530 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f4f080569a0 con 0x7f4f1015c030 2024-09-19T05:44:19.094 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:19.095 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:19.095 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:19.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 -- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4efc0678c0 msgr2=0x7f4efc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:19.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4efc0678c0 0x7f4efc069d80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4f10155be0 tx=0x7f4f00008040 comp rx=0 tx=0).stop 2024-09-19T05:44:19.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 -- 172.21.15.67:0/640788530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1015c030 msgr2=0x7f4f1014ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1015c030 0x7f4f1014ed10 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f4f08007e40 tx=0x7f4f0800e4b0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 -- 172.21.15.67:0/640788530 shutdown_connections 2024-09-19T05:44:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f1015c030 0x7f4f1014ed10 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f100b3510 0x7f4f10159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4efc0678c0 0x7f4efc069d80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 --2- 172.21.15.67:0/640788530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f1006dde0 0x7f4f1015dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 -- 172.21.15.67:0/640788530 >> 172.21.15.67:0/640788530 conn(0x7f4f100d0080 msgr2=0x7f4f100b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 -- 172.21.15.67:0/640788530 shutdown_connections 2024-09-19T05:44:19.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.097+0000 7f4f15903640 1 -- 172.21.15.67:0/640788530 wait complete. 2024-09-19T05:44:19.112 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-19T05:44:19.112 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:44:19.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a474c640 1 Processor -- start 2024-09-19T05:44:19.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a474c640 1 -- start start 2024-09-19T05:44:19.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a474c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa49c15c030 0x7fa49c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:19.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a474c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c06e3c0 con 0x7fa49c06f460 2024-09-19T05:44:19.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a474c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c06e6a0 con 0x7fa49c15d1d0 2024-09-19T05:44:19.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a474c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c06e980 con 0x7fa49c15c030 2024-09-19T05:44:19.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a2ce9640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa49c06f460 0x7fa49c0acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48660/0 (socket says 172.21.15.67:48660) 2024-09-19T05:44:19.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a2ce9640 1 -- 172.21.15.67:0/12960871 learned_addr learned my addr 172.21.15.67:0/12960871 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:19.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a24e8640 1 --2- 172.21.15.67:0/12960871 >> v2:172.21.15.67:3300/0 conn(0x7fa49c15c030 0x7fa49c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:19.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a14e6640 1 -- 172.21.15.67:0/12960871 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731867637 0 0) 0x7fa49c06e3c0 con 0x7fa49c06f460 2024-09-19T05:44:19.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.221+0000 7fa4a14e6640 1 -- 172.21.15.67:0/12960871 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa484003530 con 0x7fa49c06f460 2024-09-19T05:44:19.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a24e8640 1 -- 172.21.15.67:0/12960871 >> v1:172.21.15.97:6789/0 conn(0x7fa49c15d1d0 legacy=0x7fa49c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:19.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a24e8640 1 -- 172.21.15.67:0/12960871 >> v1:172.21.15.67:6789/0 conn(0x7fa49c06f460 legacy=0x7fa49c0acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:19.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a24e8640 1 -- 172.21.15.67:0/12960871 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c06ec60 con 0x7fa49c15c030 2024-09-19T05:44:19.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a24e8640 1 --2- 172.21.15.67:0/12960871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 0x7fa49c06dde0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa494009d90 tx=0x7fa49401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b22d165a996b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:19.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a14e6640 1 -- 172.21.15.67:0/12960871 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940b2070 con 0x7fa49c15c030 2024-09-19T05:44:19.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a14e6640 1 -- 172.21.15.67:0/12960871 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4940a5920 con 0x7fa49c15c030 2024-09-19T05:44:19.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a14e6640 1 -- 172.21.15.67:0/12960871 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940a5cd0 con 0x7fa49c15c030 2024-09-19T05:44:19.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a474c640 1 -- 172.21.15.67:0/12960871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 msgr2=0x7fa49c06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:19.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a474c640 1 --2- 172.21.15.67:0/12960871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 0x7fa49c06dde0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa494009d90 tx=0x7fa49401c940 comp rx=0 tx=0).stop 2024-09-19T05:44:19.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a474c640 1 -- 172.21.15.67:0/12960871 shutdown_connections 2024-09-19T05:44:19.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a474c640 1 --2- 172.21.15.67:0/12960871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 0x7fa49c06dde0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a474c640 1 -- 172.21.15.67:0/12960871 >> 172.21.15.67:0/12960871 conn(0x7fa49c0d0080 msgr2=0x7fa49c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:19.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a474c640 1 -- 172.21.15.67:0/12960871 shutdown_connections 2024-09-19T05:44:19.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a474c640 1 -- 172.21.15.67:0/12960871 wait complete. 2024-09-19T05:44:19.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a474c640 1 Processor -- start 2024-09-19T05:44:19.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.225+0000 7fa4a474c640 1 -- start start 2024-09-19T05:44:19.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a474c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49c06f460 0x7fa49c153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:19.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a474c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 0x7fa49c0998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:19.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a474c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa49c15d1d0 0x7fa49c14f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:19.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a474c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c15c590 con 0x7fa49c15c030 2024-09-19T05:44:19.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a474c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c15c410 con 0x7fa49c06f460 2024-09-19T05:44:19.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a474c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c0ad6c0 con 0x7fa49c15d1d0 2024-09-19T05:44:19.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a1ce7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 0x7fa49c0998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:19.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a1ce7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 0x7fa49c0998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41414/0 (socket says 172.21.15.67:41414) 2024-09-19T05:44:19.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a1ce7640 1 -- 172.21.15.67:0/756511122 learned_addr learned my addr 172.21.15.67:0/756511122 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:19.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a24e8640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49c06f460 0x7fa49c153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:19.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a2ce9640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa49c15d1d0 0x7fa49c14f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a1ce7640 1 -- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa49c15d1d0 msgr2=0x7fa49c14f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a1ce7640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa49c15d1d0 0x7fa49c14f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a1ce7640 1 -- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49c06f460 msgr2=0x7fa49c153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a1ce7640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49c06f460 0x7fa49c153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a1ce7640 1 -- 172.21.15.67:0/756511122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c14e500 con 0x7fa49c15c030 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a1ce7640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 0x7fa49c0998e0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c370 tx=0x7fa49000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa49affd640 1 -- 172.21.15.67:0/756511122 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4900052d0 con 0x7fa49c15c030 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa49affd640 1 -- 172.21.15.67:0/756511122 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490005470 con 0x7fa49c15c030 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a474c640 1 -- 172.21.15.67:0/756511122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c14e7e0 con 0x7fa49c15c030 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa49affd640 1 -- 172.21.15.67:0/756511122 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490007260 con 0x7fa49c15c030 2024-09-19T05:44:19.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a474c640 1 -- 172.21.15.67:0/756511122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c14f080 con 0x7fa49c15c030 2024-09-19T05:44:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa4a474c640 1 -- 172.21.15.67:0/756511122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c14e9b0 con 0x7fa49c15c030 2024-09-19T05:44:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa49affd640 1 -- 172.21.15.67:0/756511122 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa490007400 con 0x7fa49c15c030 2024-09-19T05:44:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa49affd640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4880678c0 0x7fa488069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:19.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.229+0000 7fa49affd640 1 -- 172.21.15.67:0/756511122 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fa4900852c0 con 0x7fa49c15c030 2024-09-19T05:44:19.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.233+0000 7fa4a24e8640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4880678c0 0x7fa488069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:19.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.233+0000 7fa4a24e8640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4880678c0 0x7fa488069d80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa4940af000 tx=0x7fa4940a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:19.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.237+0000 7fa49affd640 1 -- 172.21.15.67:0/756511122 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa490055c70 con 0x7fa49c15c030 2024-09-19T05:44:19.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.449+0000 7fa4a474c640 1 -- 172.21.15.67:0/756511122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa49c06dde0 con 0x7fa49c15c030 2024-09-19T05:44:19.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa49affd640 1 -- 172.21.15.67:0/756511122 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1069 (secure 0 0 0) 0x7fa490055570 con 0x7fa49c15c030 2024-09-19T05:44:19.450 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:19.450 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":689,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1011,"data_bytes":1037860403,"bytes_used":2557771776,"bytes_avail":770536341504,"bytes_total":773094113280,"write_bytes_sec":73400975,"read_op_per_sec":0,"write_op_per_sec":73},"fsmap":{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8514}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-19T05:42:47.308492+0000","services":{}},"progress_events":{}} 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 -- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4880678c0 msgr2=0x7fa488069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4880678c0 0x7fa488069d80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa4940af000 tx=0x7fa4940a7070 comp rx=0 tx=0).stop 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 -- 172.21.15.67:0/756511122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 msgr2=0x7fa49c0998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 0x7fa49c0998e0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c370 tx=0x7fa49000c830 comp rx=0 tx=0).stop 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 -- 172.21.15.67:0/756511122 shutdown_connections 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa4880678c0 0x7fa488069d80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa49c15d1d0 0x7fa49c14f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c15c030 0x7fa49c0998e0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 --2- 172.21.15.67:0/756511122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49c06f460 0x7fa49c153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 -- 172.21.15.67:0/756511122 >> 172.21.15.67:0/756511122 conn(0x7fa49c0d0080 msgr2=0x7fa49c0745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 -- 172.21.15.67:0/756511122 shutdown_connections 2024-09-19T05:44:19.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:19.453+0000 7fa4a474c640 1 -- 172.21.15.67:0/756511122 wait complete. 2024-09-19T05:44:20.468 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:20.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f93000d0640 1 Processor -- start 2024-09-19T05:44:20.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f93000d0640 1 -- start start 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f93000d0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f815c030 0x7f92f806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f93000d0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f806e3c0 con 0x7f92f806f460 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f93000d0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f806e6a0 con 0x7f92f815d1d0 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f93000d0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f92f806e980 con 0x7f92f815c030 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fe66d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f92f806f460 0x7f92f80acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48668/0 (socket says 172.21.15.67:48668) 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fe66d640 1 -- 172.21.15.67:0/1413071773 learned_addr learned my addr 172.21.15.67:0/1413071773 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fde6c640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f815c030 0x7f92f806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483705420 0 0) 0x7f92f806e3c0 con 0x7f92f806f460 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92e4003530 con 0x7f92f806f460 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1036068129 0 0) 0x7f92e4003530 con 0x7f92f806f460 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f815c030 msgr2=0x7f92f806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f815c030 0x7f92f806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 >> v1:172.21.15.97:6789/0 conn(0x7f92f815d1d0 legacy=0x7f92f80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f806ec60 con 0x7f92f806f460 2024-09-19T05:44:20.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f92f0001680 con 0x7f92f806f460 2024-09-19T05:44:20.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 >> v1:172.21.15.67:6789/0 conn(0x7f92f806f460 legacy=0x7f92f80acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92e40039f0 0x7f92e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 0x7f92e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f815c030 0x7f92e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f92f806e980 con 0x7f92e4004810 2024-09-19T05:44:20.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f92e400ba80 con 0x7f92e40039f0 2024-09-19T05:44:20.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f92e400bc80 con 0x7f92f815c030 2024-09-19T05:44:20.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fd66b640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 0x7f92e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fde6c640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92e40039f0 0x7f92e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fe66d640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f815c030 0x7f92e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fd66b640 1 -- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f815c030 msgr2=0x7f92e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:20.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fd66b640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f815c030 0x7f92e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fd66b640 1 -- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92e40039f0 msgr2=0x7f92e4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:20.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fd66b640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92e40039f0 0x7f92e4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.605+0000 7f92fd66b640 1 -- 172.21.15.67:0/1413071773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e4003530 con 0x7f92e4004810 2024-09-19T05:44:20.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f92fd66b640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 0x7f92e4004c90 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f92f80d0ef0 tx=0x7f92e801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f34ab76b8f83988 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:20.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e80013a0 con 0x7f92e4004810 2024-09-19T05:44:20.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e80052f0 con 0x7f92e4004810 2024-09-19T05:44:20.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f92fce6a640 1 -- 172.21.15.67:0/1413071773 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e80a4e60 con 0x7f92e4004810 2024-09-19T05:44:20.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f93000d0640 1 -- 172.21.15.67:0/1413071773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 msgr2=0x7f92e4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f93000d0640 1 --2- 172.21.15.67:0/1413071773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 0x7f92e4004c90 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f92f80d0ef0 tx=0x7f92e801c3a0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f92fe66d640 1 -- 172.21.15.67:0/1413071773 reap_dead start 2024-09-19T05:44:20.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f93000d0640 1 -- 172.21.15.67:0/1413071773 shutdown_connections 2024-09-19T05:44:20.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f93000d0640 1 -- 172.21.15.67:0/1413071773 >> 172.21.15.67:0/1413071773 conn(0x7f92f80d0080 msgr2=0x7f92f80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:20.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f93000d0640 1 -- 172.21.15.67:0/1413071773 shutdown_connections 2024-09-19T05:44:20.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f93000d0640 1 -- 172.21.15.67:0/1413071773 wait complete. 2024-09-19T05:44:20.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f93000d0640 1 Processor -- start 2024-09-19T05:44:20.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.609+0000 7f93000d0640 1 -- start start 2024-09-19T05:44:20.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f93000d0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 0x7f92f8099b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f93000d0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92f8153430 0x7f92f815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f93000d0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f8153850 0x7f92f815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f93000d0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f92f80b36e0 con 0x7f92e4004810 2024-09-19T05:44:20.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f93000d0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f92f815d630 con 0x7f92f8153430 2024-09-19T05:44:20.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f93000d0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f92f81f57b0 con 0x7f92f8153850 2024-09-19T05:44:20.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fde6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 0x7f92f8099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fde6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 0x7f92f8099b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41434/0 (socket says 172.21.15.67:41434) 2024-09-19T05:44:20.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fde6c640 1 -- 172.21.15.67:0/3952125424 learned_addr learned my addr 172.21.15.67:0/3952125424 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:20.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fd66b640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92f8153430 0x7f92f815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fe66d640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f8153850 0x7f92f815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fde6c640 1 -- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f8153850 msgr2=0x7f92f815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fde6c640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f8153850 0x7f92f815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fde6c640 1 -- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92f8153430 msgr2=0x7f92f815eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fde6c640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92f8153430 0x7f92f815eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fde6c640 1 -- 172.21.15.67:0/3952125424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f8153e20 con 0x7f92e4004810 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fde6c640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 0x7f92f8099b00 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f92f4007f30 tx=0x7f92f4011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92ee7fc640 1 -- 172.21.15.67:0/3952125424 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f401a020 con 0x7f92e4004810 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92ee7fc640 1 -- 172.21.15.67:0/3952125424 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f4016470 con 0x7f92e4004810 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f93000d0640 1 -- 172.21.15.67:0/3952125424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f81f5a50 con 0x7f92e4004810 2024-09-19T05:44:20.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92ee7fc640 1 -- 172.21.15.67:0/3952125424 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4016860 con 0x7f92e4004810 2024-09-19T05:44:20.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f93000d0640 1 -- 172.21.15.67:0/3952125424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f81f6010 con 0x7f92e4004810 2024-09-19T05:44:20.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f93000d0640 1 -- 172.21.15.67:0/3952125424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f815c410 con 0x7f92e4004810 2024-09-19T05:44:20.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92ee7fc640 1 -- 172.21.15.67:0/3952125424 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92f401d020 con 0x7f92e4004810 2024-09-19T05:44:20.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92ee7fc640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92dc0678f0 0x7f92dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92ee7fc640 1 -- 172.21.15.67:0/3952125424 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f92f4086d20 con 0x7f92e4004810 2024-09-19T05:44:20.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.613+0000 7f92fd66b640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92dc0678f0 0x7f92dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.617+0000 7f92fd66b640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92dc0678f0 0x7f92dc069db0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f92e40057f0 tx=0x7f92e80011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:20.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.617+0000 7f92ee7fc640 1 -- 172.21.15.67:0/3952125424 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f92f4024030 con 0x7f92e4004810 2024-09-19T05:44:20.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.817+0000 7f93000d0640 1 -- 172.21.15.67:0/3952125424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92f80d0f20 con 0x7f92e4004810 2024-09-19T05:44:20.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.817+0000 7f92ee7fc640 1 -- 172.21.15.67:0/3952125424 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f92f40576d0 con 0x7f92e4004810 2024-09-19T05:44:20.818 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:20.818 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:20.818 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 -- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92dc0678f0 msgr2=0x7f92dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92dc0678f0 0x7f92dc069db0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f92e40057f0 tx=0x7f92e80011a0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 -- 172.21.15.67:0/3952125424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 msgr2=0x7f92f8099b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 0x7f92f8099b00 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f92f4007f30 tx=0x7f92f4011660 comp rx=0 tx=0).stop 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 -- 172.21.15.67:0/3952125424 shutdown_connections 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92dc0678f0 0x7f92dc069db0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92f8153850 0x7f92f815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92f8153430 0x7f92f815eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 --2- 172.21.15.67:0/3952125424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92e4004810 0x7f92f8099b00 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 -- 172.21.15.67:0/3952125424 >> 172.21.15.67:0/3952125424 conn(0x7f92f80d0080 msgr2=0x7f92f80b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:20.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 -- 172.21.15.67:0/3952125424 shutdown_connections 2024-09-19T05:44:20.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.821+0000 7f93000d0640 1 -- 172.21.15.67:0/3952125424 wait complete. 2024-09-19T05:44:20.836 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-19T05:44:20.837 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:44:20.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.961+0000 7f90f2a11640 1 Processor -- start 2024-09-19T05:44:20.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.961+0000 7f90f2a11640 1 -- start start 2024-09-19T05:44:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.961+0000 7f90f2a11640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90ec15c030 0x7f90ec06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.961+0000 7f90f2a11640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90ec15d1d0 0x7f90ec0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.961+0000 7f90f2a11640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ec06e3c0 con 0x7f90ec0b3510 2024-09-19T05:44:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.961+0000 7f90f2a11640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f90ec06e6a0 con 0x7f90ec15c030 2024-09-19T05:44:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.961+0000 7f90f2a11640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f90ec06e980 con 0x7f90ec15d1d0 2024-09-19T05:44:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.961+0000 7f90ebfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90ec15c030 0x7f90ec06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.961+0000 7f90f0fae640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f90ec0b3510 0x7f90ec06f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48676/0 (socket says 172.21.15.67:48676) 2024-09-19T05:44:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.961+0000 7f90f0fae640 1 -- 172.21.15.67:0/3639269799 learned_addr learned my addr 172.21.15.67:0/3639269799 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90eb7fe640 1 --2- 172.21.15.67:0/3639269799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90ec15d1d0 0x7f90ec0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90ebfff640 1 -- 172.21.15.67:0/3639269799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90ec15d1d0 msgr2=0x7f90ec0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90ebfff640 1 --2- 172.21.15.67:0/3639269799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90ec15d1d0 0x7f90ec0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90ebfff640 1 -- 172.21.15.67:0/3639269799 >> v1:172.21.15.67:6789/0 conn(0x7f90ec0b3510 legacy=0x7f90ec06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90eaffd640 1 -- 172.21.15.67:0/3639269799 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3059456115 0 0) 0x7f90ec06e3c0 con 0x7f90ec0b3510 2024-09-19T05:44:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90ebfff640 1 -- 172.21.15.67:0/3639269799 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec06ec60 con 0x7f90ec15c030 2024-09-19T05:44:20.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90ebfff640 1 --2- 172.21.15.67:0/3639269799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec15c030 0x7f90ec06dde0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009d90 tx=0x7f90dc01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40448d792837187f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:20.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90eaffd640 1 -- 172.21.15.67:0/3639269799 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0b2070 con 0x7f90ec15c030 2024-09-19T05:44:20.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90eaffd640 1 -- 172.21.15.67:0/3639269799 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc0a5990 con 0x7f90ec15c030 2024-09-19T05:44:20.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90eaffd640 1 -- 172.21.15.67:0/3639269799 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0a5d60 con 0x7f90ec15c030 2024-09-19T05:44:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90f2a11640 1 -- 172.21.15.67:0/3639269799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec15c030 msgr2=0x7f90ec06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90f2a11640 1 --2- 172.21.15.67:0/3639269799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec15c030 0x7f90ec06dde0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009d90 tx=0x7f90dc01c8b0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90f2a11640 1 -- 172.21.15.67:0/3639269799 shutdown_connections 2024-09-19T05:44:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90f2a11640 1 --2- 172.21.15.67:0/3639269799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90ec15d1d0 0x7f90ec0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90f2a11640 1 --2- 172.21.15.67:0/3639269799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec15c030 0x7f90ec06dde0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90f2a11640 1 -- 172.21.15.67:0/3639269799 >> 172.21.15.67:0/3639269799 conn(0x7f90ec0d0080 msgr2=0x7f90ec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90f2a11640 1 -- 172.21.15.67:0/3639269799 shutdown_connections 2024-09-19T05:44:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.965+0000 7f90f2a11640 1 -- 172.21.15.67:0/3639269799 wait complete. 2024-09-19T05:44:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 Processor -- start 2024-09-19T05:44:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 -- start start 2024-09-19T05:44:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec0b3510 0x7f90ec072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90ec15c030 0x7f90ec139180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90ec15d1d0 0x7f90ec155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec15c410 con 0x7f90ec0b3510 2024-09-19T05:44:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec15c590 con 0x7f90ec15d1d0 2024-09-19T05:44:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f90ec1690e0 con 0x7f90ec15c030 2024-09-19T05:44:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec0b3510 0x7f90ec072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec0b3510 0x7f90ec072be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41448/0 (socket says 172.21.15.67:41448) 2024-09-19T05:44:20.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90ebfff640 1 -- 172.21.15.67:0/12085022 learned_addr learned my addr 172.21.15.67:0/12085022 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90eb7fe640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90ec15c030 0x7f90ec139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f0fae640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90ec15d1d0 0x7f90ec155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90ebfff640 1 -- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90ec15c030 msgr2=0x7f90ec139180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90ebfff640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90ec15c030 0x7f90ec139180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90ebfff640 1 -- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90ec15d1d0 msgr2=0x7f90ec155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90ebfff640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90ec15d1d0 0x7f90ec155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90ebfff640 1 -- 172.21.15.67:0/12085022 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec073250 con 0x7f90ec0b3510 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f0fae640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90ec15d1d0 0x7f90ec155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90ebfff640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec0b3510 0x7f90ec072be0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0b0040 tx=0x7f90dc019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90e8ff9640 1 -- 172.21.15.67:0/12085022 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0bd070 con 0x7f90ec0b3510 2024-09-19T05:44:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90e8ff9640 1 -- 172.21.15.67:0/12085022 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc003ba0 con 0x7f90ec0b3510 2024-09-19T05:44:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 -- 172.21.15.67:0/12085022 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ec073530 con 0x7f90ec0b3510 2024-09-19T05:44:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90e8ff9640 1 -- 172.21.15.67:0/12085022 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0b2040 con 0x7f90ec0b3510 2024-09-19T05:44:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 -- 172.21.15.67:0/12085022 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ec073af0 con 0x7f90ec0b3510 2024-09-19T05:44:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.969+0000 7f90f2a11640 1 -- 172.21.15.67:0/12085022 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ec06dde0 con 0x7f90ec0b3510 2024-09-19T05:44:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.973+0000 7f90e8ff9640 1 -- 172.21.15.67:0/12085022 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f90dc003f90 con 0x7f90ec0b3510 2024-09-19T05:44:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.973+0000 7f90e8ff9640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90d80678c0 0x7f90d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.973+0000 7f90e8ff9640 1 -- 172.21.15.67:0/12085022 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f90dc121940 con 0x7f90ec0b3510 2024-09-19T05:44:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.973+0000 7f90eb7fe640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90d80678c0 0x7f90d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.973+0000 7f90eb7fe640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90d80678c0 0x7f90d8069d80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0b3d80 tx=0x7f90e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:20.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:20.977+0000 7f90e8ff9640 1 -- 172.21.15.67:0/12085022 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f90dc016560 con 0x7f90ec0b3510 2024-09-19T05:44:21.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 -- 172.21.15.67:0/12085022 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f90ec0d0f20 con 0x7f90ec0b3510 2024-09-19T05:44:21.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90e8ff9640 1 -- 172.21.15.67:0/12085022 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1069 (secure 0 0 0) 0x7f90dc0f2460 con 0x7f90ec0b3510 2024-09-19T05:44:21.203 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:21.203 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":690,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1011,"data_bytes":1037860403,"bytes_used":2557771776,"bytes_avail":770536341504,"bytes_total":773094113280,"write_bytes_sec":73400975,"read_op_per_sec":0,"write_op_per_sec":73},"fsmap":{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8514}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-19T05:42:47.308492+0000","services":{}},"progress_events":{}} 2024-09-19T05:44:21.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 -- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90d80678c0 msgr2=0x7f90d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:21.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90d80678c0 0x7f90d8069d80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0b3d80 tx=0x7f90e0008040 comp rx=0 tx=0).stop 2024-09-19T05:44:21.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 -- 172.21.15.67:0/12085022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec0b3510 msgr2=0x7f90ec072be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:21.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec0b3510 0x7f90ec072be0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0b0040 tx=0x7f90dc019650 comp rx=0 tx=0).stop 2024-09-19T05:44:21.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 -- 172.21.15.67:0/12085022 shutdown_connections 2024-09-19T05:44:21.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90ec15d1d0 0x7f90ec155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:21.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90d80678c0 0x7f90d8069d80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:21.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90ec15c030 0x7f90ec139180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:21.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 --2- 172.21.15.67:0/12085022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90ec0b3510 0x7f90ec072be0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:21.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 -- 172.21.15.67:0/12085022 >> 172.21.15.67:0/12085022 conn(0x7f90ec0d0080 msgr2=0x7f90ec0b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:21.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 -- 172.21.15.67:0/12085022 shutdown_connections 2024-09-19T05:44:21.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:21.205+0000 7f90f2a11640 1 -- 172.21.15.67:0/12085022 wait complete. 2024-09-19T05:44:22.223 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:22.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.357+0000 7fcedf82c640 1 Processor -- start 2024-09-19T05:44:22.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.357+0000 7fcedf82c640 1 -- start start 2024-09-19T05:44:22.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedf82c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815c030 0x7fced806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedf82c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fced806f460 0x7fced806f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedf82c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced806e3c0 con 0x7fced815d1d0 2024-09-19T05:44:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedf82c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fced806e6a0 con 0x7fced806f460 2024-09-19T05:44:22.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedf82c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fced806e980 con 0x7fced815c030 2024-09-19T05:44:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedd5c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815c030 0x7fced806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedd5c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815c030 0x7fced806dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:50104/0 (socket says 172.21.15.67:50104) 2024-09-19T05:44:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedd5c8640 1 -- 172.21.15.67:0/2246207059 learned_addr learned my addr 172.21.15.67:0/2246207059 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedddc9640 1 --2- 172.21.15.67:0/2246207059 >> v2:172.21.15.97:3300/0 conn(0x7fced806f460 0x7fced806f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedd5c8640 1 -- 172.21.15.67:0/2246207059 >> v2:172.21.15.97:3300/0 conn(0x7fced806f460 msgr2=0x7fced806f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedd5c8640 1 --2- 172.21.15.67:0/2246207059 >> v2:172.21.15.97:3300/0 conn(0x7fced806f460 0x7fced806f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedd5c8640 1 -- 172.21.15.67:0/2246207059 >> v1:172.21.15.97:6789/0 conn(0x7fced815d1d0 legacy=0x7fced80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.361+0000 7fcedd5c8640 1 -- 172.21.15.67:0/2246207059 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced806ec60 con 0x7fced815c030 2024-09-19T05:44:22.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedd5c8640 1 --2- 172.21.15.67:0/2246207059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815c030 0x7fced806dde0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009870 tx=0x7fcec801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2086c41cdd4fea66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcecffff640 1 -- 172.21.15.67:0/2246207059 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80ab650 con 0x7fced815c030 2024-09-19T05:44:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcecffff640 1 -- 172.21.15.67:0/2246207059 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec80b0070 con 0x7fced815c030 2024-09-19T05:44:22.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcecffff640 1 -- 172.21.15.67:0/2246207059 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80aba10 con 0x7fced815c030 2024-09-19T05:44:22.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedf82c640 1 -- 172.21.15.67:0/2246207059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815c030 msgr2=0x7fced806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedf82c640 1 --2- 172.21.15.67:0/2246207059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815c030 0x7fced806dde0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009870 tx=0x7fcec801c530 comp rx=0 tx=0).stop 2024-09-19T05:44:22.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedf82c640 1 -- 172.21.15.67:0/2246207059 shutdown_connections 2024-09-19T05:44:22.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedf82c640 1 --2- 172.21.15.67:0/2246207059 >> v2:172.21.15.97:3300/0 conn(0x7fced806f460 0x7fced806f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedf82c640 1 --2- 172.21.15.67:0/2246207059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815c030 0x7fced806dde0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedf82c640 1 -- 172.21.15.67:0/2246207059 >> 172.21.15.67:0/2246207059 conn(0x7fced80d0080 msgr2=0x7fced80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:22.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedf82c640 1 -- 172.21.15.67:0/2246207059 shutdown_connections 2024-09-19T05:44:22.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedf82c640 1 -- 172.21.15.67:0/2246207059 wait complete. 2024-09-19T05:44:22.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedf82c640 1 Processor -- start 2024-09-19T05:44:22.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.365+0000 7fcedf82c640 1 -- start start 2024-09-19T05:44:22.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedf82c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced806f460 0x7fced81485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedf82c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced815c030 0x7fced814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedf82c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815d1d0 0x7fced815ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedf82c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fced815c590 con 0x7fced815c030 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedf82c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fced815c410 con 0x7fced806f460 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedf82c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fced81690e0 con 0x7fced815d1d0 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedcdc7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced815c030 0x7fced814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedcdc7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced815c030 0x7fced814ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41450/0 (socket says 172.21.15.67:41450) 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedcdc7640 1 -- 172.21.15.67:0/2096802579 learned_addr learned my addr 172.21.15.67:0/2096802579 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedddc9640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815d1d0 0x7fced815ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedd5c8640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced806f460 0x7fced81485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedcdc7640 1 -- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815d1d0 msgr2=0x7fced815ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedcdc7640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815d1d0 0x7fced815ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedcdc7640 1 -- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced806f460 msgr2=0x7fced81485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedcdc7640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced806f460 0x7fced81485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedcdc7640 1 -- 172.21.15.67:0/2096802579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced81f7a80 con 0x7fced815c030 2024-09-19T05:44:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedcdc7640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced815c030 0x7fced814ab20 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fced400c340 tx=0x7fced400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcecdffb640 1 -- 172.21.15.67:0/2096802579 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced40052d0 con 0x7fced815c030 2024-09-19T05:44:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcecdffb640 1 -- 172.21.15.67:0/2096802579 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced4005470 con 0x7fced815c030 2024-09-19T05:44:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedf82c640 1 -- 172.21.15.67:0/2096802579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced81f7d60 con 0x7fced815c030 2024-09-19T05:44:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcecdffb640 1 -- 172.21.15.67:0/2096802579 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4007260 con 0x7fced815c030 2024-09-19T05:44:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedf82c640 1 -- 172.21.15.67:0/2096802579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced81f8320 con 0x7fced815c030 2024-09-19T05:44:22.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedf82c640 1 -- 172.21.15.67:0/2096802579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced806dde0 con 0x7fced815c030 2024-09-19T05:44:22.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcecdffb640 1 -- 172.21.15.67:0/2096802579 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fced4007400 con 0x7fced815c030 2024-09-19T05:44:22.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcecdffb640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcebc0678c0 0x7fcebc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcecdffb640 1 -- 172.21.15.67:0/2096802579 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fced40852a0 con 0x7fced815c030 2024-09-19T05:44:22.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.369+0000 7fcedd5c8640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcebc0678c0 0x7fcebc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.373+0000 7fcedd5c8640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcebc0678c0 0x7fcebc069d80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcec80af000 tx=0x7fcec80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:22.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.377+0000 7fcecdffb640 1 -- 172.21.15.67:0/2096802579 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fced4055c50 con 0x7fced815c030 2024-09-19T05:44:22.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.573+0000 7fcedf82c640 1 -- 172.21.15.67:0/2096802579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fced80d0f20 con 0x7fced815c030 2024-09-19T05:44:22.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcecdffb640 1 -- 172.21.15.67:0/2096802579 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7fced40850c0 con 0x7fced815c030 2024-09-19T05:44:22.574 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:22.575 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 -- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcebc0678c0 msgr2=0x7fcebc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcebc0678c0 0x7fcebc069d80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcec80af000 tx=0x7fcec80a7000 comp rx=0 tx=0).stop 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 -- 172.21.15.67:0/2096802579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced815c030 msgr2=0x7fced814ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced815c030 0x7fced814ab20 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fced400c340 tx=0x7fced400c800 comp rx=0 tx=0).stop 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 -- 172.21.15.67:0/2096802579 shutdown_connections 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcebc0678c0 0x7fcebc069d80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced815d1d0 0x7fced815ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced815c030 0x7fced814ab20 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 --2- 172.21.15.67:0/2096802579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced806f460 0x7fced81485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 -- 172.21.15.67:0/2096802579 >> 172.21.15.67:0/2096802579 conn(0x7fced80d0080 msgr2=0x7fced8155020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 -- 172.21.15.67:0/2096802579 shutdown_connections 2024-09-19T05:44:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.577+0000 7fcedf82c640 1 -- 172.21.15.67:0/2096802579 wait complete. 2024-09-19T05:44:22.593 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-19T05:44:22.593 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:44:22.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.705+0000 7fdc0fa1b640 1 Processor -- start 2024-09-19T05:44:22.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.705+0000 7fdc0fa1b640 1 -- start start 2024-09-19T05:44:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0fa1b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdc0815a920 0x7fdc08072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0fa1b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdc080af730 0x7fdc0806e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0fa1b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc080730e0 con 0x7fdc0806ebb0 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0fa1b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0806efe0 con 0x7fdc080af730 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0fa1b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fdc080733c0 con 0x7fdc0815a920 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0cfb6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdc080af730 0x7fdc0806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0dfb8640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdc0806ebb0 0x7fdc0815e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48678/0 (socket says 172.21.15.67:48678) 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0dfb8640 1 -- 172.21.15.67:0/3670564757 learned_addr learned my addr 172.21.15.67:0/3670564757 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0d7b7640 1 --2- 172.21.15.67:0/3670564757 >> v2:172.21.15.97:3300/0 conn(0x7fdc0815a920 0x7fdc08072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0cfb6640 1 -- 172.21.15.67:0/3670564757 >> v2:172.21.15.97:3300/0 conn(0x7fdc0815a920 msgr2=0x7fdc08072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0cfb6640 1 --2- 172.21.15.67:0/3670564757 >> v2:172.21.15.97:3300/0 conn(0x7fdc0815a920 0x7fdc08072840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0cfb6640 1 -- 172.21.15.67:0/3670564757 >> v1:172.21.15.67:6789/0 conn(0x7fdc0806ebb0 legacy=0x7fdc0815e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdbfffff640 1 -- 172.21.15.67:0/3670564757 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011438348 0 0) 0x7fdc080730e0 con 0x7fdc0806ebb0 2024-09-19T05:44:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0cfb6640 1 -- 172.21.15.67:0/3670564757 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc080ad8c0 con 0x7fdc080af730 2024-09-19T05:44:22.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdc0cfb6640 1 --2- 172.21.15.67:0/3670564757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc080af730 0x7fdc0806e670 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fdc08071680 tx=0x7fdbf801d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd871ff18ea2561 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:22.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdbfffff640 1 -- 172.21.15.67:0/3670564757 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80ac430 con 0x7fdc080af730 2024-09-19T05:44:22.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdbfffff640 1 -- 172.21.15.67:0/3670564757 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf80b1070 con 0x7fdc080af730 2024-09-19T05:44:22.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.709+0000 7fdbfffff640 1 -- 172.21.15.67:0/3670564757 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80ac7f0 con 0x7fdc080af730 2024-09-19T05:44:22.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/3670564757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc080af730 msgr2=0x7fdc0806e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 --2- 172.21.15.67:0/3670564757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc080af730 0x7fdc0806e670 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fdc08071680 tx=0x7fdbf801d590 comp rx=0 tx=0).stop 2024-09-19T05:44:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/3670564757 shutdown_connections 2024-09-19T05:44:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 --2- 172.21.15.67:0/3670564757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc080af730 0x7fdc0806e670 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 --2- 172.21.15.67:0/3670564757 >> v2:172.21.15.97:3300/0 conn(0x7fdc0815a920 0x7fdc08072840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/3670564757 >> 172.21.15.67:0/3670564757 conn(0x7fdc080d0080 msgr2=0x7fdc080d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/3670564757 shutdown_connections 2024-09-19T05:44:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/3670564757 wait complete. 2024-09-19T05:44:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 Processor -- start 2024-09-19T05:44:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- start start 2024-09-19T05:44:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc0806ebb0 0x7fdc0814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc080af730 0x7fdc080cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc0815a920 0x7fdc0815cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0815ad00 con 0x7fdc0815a920 2024-09-19T05:44:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0815ec20 con 0x7fdc080af730 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0814d440 con 0x7fdc0806ebb0 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0dfb8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc0815a920 0x7fdc0815cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0dfb8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc0815a920 0x7fdc0815cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41476/0 (socket says 172.21.15.67:41476) 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0dfb8640 1 -- 172.21.15.67:0/584640256 learned_addr learned my addr 172.21.15.67:0/584640256 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0d7b7640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc0806ebb0 0x7fdc0814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0cfb6640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc080af730 0x7fdc080cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0dfb8640 1 -- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc0806ebb0 msgr2=0x7fdc0814cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0dfb8640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc0806ebb0 0x7fdc0814cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0dfb8640 1 -- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc080af730 msgr2=0x7fdc080cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0dfb8640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc080af730 0x7fdc080cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0dfb8640 1 -- 172.21.15.67:0/584640256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc080cd310 con 0x7fdc0815a920 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0dfb8640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc0815a920 0x7fdc0815cf10 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000c7a0 tx=0x7fdc0000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdbfdffb640 1 -- 172.21.15.67:0/584640256 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00018070 con 0x7fdc0815a920 2024-09-19T05:44:22.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdbfdffb640 1 -- 172.21.15.67:0/584640256 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc0000a640 con 0x7fdc0815a920 2024-09-19T05:44:22.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/584640256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc080cd5f0 con 0x7fdc0815a920 2024-09-19T05:44:22.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdbfdffb640 1 -- 172.21.15.67:0/584640256 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000aa70 con 0x7fdc0815a920 2024-09-19T05:44:22.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/584640256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc080cde90 con 0x7fdc0815a920 2024-09-19T05:44:22.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.713+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/584640256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc080cd9e0 con 0x7fdc0815a920 2024-09-19T05:44:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.717+0000 7fdbfdffb640 1 -- 172.21.15.67:0/584640256 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc0001b070 con 0x7fdc0815a920 2024-09-19T05:44:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.717+0000 7fdbfdffb640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbec0678c0 0x7fdbec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.717+0000 7fdbfdffb640 1 -- 172.21.15.67:0/584640256 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fdc00085590 con 0x7fdc0815a920 2024-09-19T05:44:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.717+0000 7fdc0d7b7640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbec0678c0 0x7fdbec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.717+0000 7fdc0d7b7640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbec0678c0 0x7fdbec069d80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400b930 tx=0x7fdc04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:22.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.721+0000 7fdbfdffb640 1 -- 172.21.15.67:0/584640256 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fdc00055e10 con 0x7fdc0815a920 2024-09-19T05:44:22.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.985+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/584640256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdc08072840 con 0x7fdc0815a920 2024-09-19T05:44:22.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdbfdffb640 1 -- 172.21.15.67:0/584640256 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1069 (secure 0 0 0) 0x7fdc00055710 con 0x7fdc0815a920 2024-09-19T05:44:22.987 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:22.987 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":692,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1011,"data_bytes":1037860403,"bytes_used":2557771776,"bytes_avail":770536341504,"bytes_total":773094113280,"write_bytes_sec":47688059,"read_op_per_sec":0,"write_op_per_sec":48},"fsmap":{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8514}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-19T05:42:47.308492+0000","services":{}},"progress_events":{}} 2024-09-19T05:44:22.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbec0678c0 msgr2=0x7fdbec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbec0678c0 0x7fdbec069d80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400b930 tx=0x7fdc04008040 comp rx=0 tx=0).stop 2024-09-19T05:44:22.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/584640256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc0815a920 msgr2=0x7fdc0815cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:22.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc0815a920 0x7fdc0815cf10 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000c7a0 tx=0x7fdc0000cc60 comp rx=0 tx=0).stop 2024-09-19T05:44:22.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/584640256 shutdown_connections 2024-09-19T05:44:22.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc0815a920 0x7fdc0815cf10 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc080af730 0x7fdc080cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbec0678c0 0x7fdbec069d80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 --2- 172.21.15.67:0/584640256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc0806ebb0 0x7fdc0814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:22.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/584640256 >> 172.21.15.67:0/584640256 conn(0x7fdc080d0080 msgr2=0x7fdc08156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:22.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/584640256 shutdown_connections 2024-09-19T05:44:22.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:22.989+0000 7fdc0fa1b640 1 -- 172.21.15.67:0/584640256 wait complete. 2024-09-19T05:44:24.006 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:24.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f6659e77640 1 Processor -- start 2024-09-19T05:44:24.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f6659e77640 1 -- start start 2024-09-19T05:44:24.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f6659e77640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f665415b1e0 0x7f66540b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f6659e77640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6654072590 0x7f66540ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f6659e77640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66540b3860 con 0x7f66540b4900 2024-09-19T05:44:24.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f6659e77640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f665415b5c0 con 0x7f665415b1e0 2024-09-19T05:44:24.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f6659e77640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f66540b3b40 con 0x7f6654072590 2024-09-19T05:44:24.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f66537fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f665415b1e0 0x7f66540b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f66537fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f665415b1e0 0x7f66540b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41488/0 (socket says 172.21.15.67:41488) 2024-09-19T05:44:24.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f66537fe640 1 -- 172.21.15.67:0/2863018189 learned_addr learned my addr 172.21.15.67:0/2863018189 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:24.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f6652ffd640 1 --1- 172.21.15.67:0/2863018189 >> v1:172.21.15.67:6789/0 conn(0x7f66540b4900 0x7f6654071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48692/0 (socket says 172.21.15.67:48692) 2024-09-19T05:44:24.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f6653fff640 1 --2- 172.21.15.67:0/2863018189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6654072590 0x7f66540ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f66537fe640 1 -- 172.21.15.67:0/2863018189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6654072590 msgr2=0x7f66540ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:24.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f66537fe640 1 --2- 172.21.15.67:0/2863018189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6654072590 0x7f66540ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f66537fe640 1 -- 172.21.15.67:0/2863018189 >> v1:172.21.15.67:6789/0 conn(0x7f66540b4900 legacy=0x7f6654071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f66537fe640 1 -- 172.21.15.67:0/2863018189 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66540b3e20 con 0x7f665415b1e0 2024-09-19T05:44:24.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f66527fc640 1 -- 172.21.15.67:0/2863018189 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569749473 0 0) 0x7f66540b3860 con 0x7f66540b4900 2024-09-19T05:44:24.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.145+0000 7f6653fff640 1 --2- 172.21.15.67:0/2863018189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6654072590 0x7f66540ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:24.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66537fe640 1 --2- 172.21.15.67:0/2863018189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f665415b1e0 0x7f66540b2fd0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f664c00d150 tx=0x7f664c01ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e0716d76ef3f0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:24.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66527fc640 1 -- 172.21.15.67:0/2863018189 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0a7cd0 con 0x7f665415b1e0 2024-09-19T05:44:24.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66527fc640 1 -- 172.21.15.67:0/2863018189 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c00b0d0 con 0x7f665415b1e0 2024-09-19T05:44:24.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66527fc640 1 -- 172.21.15.67:0/2863018189 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c009600 con 0x7f665415b1e0 2024-09-19T05:44:24.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- 172.21.15.67:0/2863018189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f665415b1e0 msgr2=0x7f66540b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 --2- 172.21.15.67:0/2863018189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f665415b1e0 0x7f66540b2fd0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f664c00d150 tx=0x7f664c01ec00 comp rx=0 tx=0).stop 2024-09-19T05:44:24.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- 172.21.15.67:0/2863018189 shutdown_connections 2024-09-19T05:44:24.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 --2- 172.21.15.67:0/2863018189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6654072590 0x7f66540ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 --2- 172.21.15.67:0/2863018189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f665415b1e0 0x7f66540b2fd0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- 172.21.15.67:0/2863018189 >> 172.21.15.67:0/2863018189 conn(0x7f66540d0080 msgr2=0x7f66540d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:24.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- 172.21.15.67:0/2863018189 shutdown_connections 2024-09-19T05:44:24.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- 172.21.15.67:0/2863018189 wait complete. 2024-09-19T05:44:24.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 Processor -- start 2024-09-19T05:44:24.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- start start 2024-09-19T05:44:24.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6654072590 0x7f66541506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66540b4900 0x7f6654142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f665415b1e0 0x7f66541499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f665406e7f0 con 0x7f6654072590 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f665406e670 con 0x7f665415b1e0 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f665406e970 con 0x7f66540b4900 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66537fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6654072590 0x7f66541506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66537fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6654072590 0x7f66541506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41504/0 (socket says 172.21.15.67:41504) 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66537fe640 1 -- 172.21.15.67:0/2907439802 learned_addr learned my addr 172.21.15.67:0/2907439802 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6652ffd640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66540b4900 0x7f6654142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6653fff640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f665415b1e0 0x7f66541499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66537fe640 1 -- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66540b4900 msgr2=0x7f6654142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66537fe640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66540b4900 0x7f6654142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66537fe640 1 -- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f665415b1e0 msgr2=0x7f66541499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66537fe640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f665415b1e0 0x7f66541499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66537fe640 1 -- 172.21.15.67:0/2907439802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6654143870 con 0x7f6654072590 2024-09-19T05:44:24.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6653fff640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f665415b1e0 0x7f66541499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:24.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f66537fe640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6654072590 0x7f66541506e0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f664c0b1040 tx=0x7f664c01b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:24.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f663bfff640 1 -- 172.21.15.67:0/2907439802 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c003ba0 con 0x7f6654072590 2024-09-19T05:44:24.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f663bfff640 1 -- 172.21.15.67:0/2907439802 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c003d40 con 0x7f6654072590 2024-09-19T05:44:24.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- 172.21.15.67:0/2907439802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6654143b50 con 0x7f6654072590 2024-09-19T05:44:24.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f663bfff640 1 -- 172.21.15.67:0/2907439802 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c004220 con 0x7f6654072590 2024-09-19T05:44:24.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.149+0000 7f6659e77640 1 -- 172.21.15.67:0/2907439802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6654144110 con 0x7f6654072590 2024-09-19T05:44:24.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.153+0000 7f6659e77640 1 -- 172.21.15.67:0/2907439802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66540ade10 con 0x7f6654072590 2024-09-19T05:44:24.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.153+0000 7f663bfff640 1 -- 172.21.15.67:0/2907439802 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f664c0c3060 con 0x7f6654072590 2024-09-19T05:44:24.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.153+0000 7f663bfff640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66400678c0 0x7f6640069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.153+0000 7f663bfff640 1 -- 172.21.15.67:0/2907439802 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f664c1228d0 con 0x7f6654072590 2024-09-19T05:44:24.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.153+0000 7f6652ffd640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66400678c0 0x7f6640069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.153+0000 7f6652ffd640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66400678c0 0x7f6640069d80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f66540b0e10 tx=0x7f6648009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:24.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.157+0000 7f663bfff640 1 -- 172.21.15.67:0/2907439802 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f664c018820 con 0x7f6654072590 2024-09-19T05:44:24.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.357+0000 7f6659e77640 1 -- 172.21.15.67:0/2907439802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f665414e060 con 0x7f6654072590 2024-09-19T05:44:24.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.357+0000 7f663bfff640 1 -- 172.21.15.67:0/2907439802 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f664c0f3360 con 0x7f6654072590 2024-09-19T05:44:24.358 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:24.358 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:24.358 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:24.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 -- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66400678c0 msgr2=0x7f6640069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66400678c0 0x7f6640069d80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f66540b0e10 tx=0x7f6648009040 comp rx=0 tx=0).stop 2024-09-19T05:44:24.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 -- 172.21.15.67:0/2907439802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6654072590 msgr2=0x7f66541506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6654072590 0x7f66541506e0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f664c0b1040 tx=0x7f664c01b9a0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 -- 172.21.15.67:0/2907439802 shutdown_connections 2024-09-19T05:44:24.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f665415b1e0 0x7f66541499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66400678c0 0x7f6640069d80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66540b4900 0x7f6654142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 --2- 172.21.15.67:0/2907439802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6654072590 0x7f66541506e0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 -- 172.21.15.67:0/2907439802 >> 172.21.15.67:0/2907439802 conn(0x7f66540d0080 msgr2=0x7f665414b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:24.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 -- 172.21.15.67:0/2907439802 shutdown_connections 2024-09-19T05:44:24.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.361+0000 7f6659e77640 1 -- 172.21.15.67:0/2907439802 wait complete. 2024-09-19T05:44:24.377 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-19T05:44:24.377 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:44:24.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f97771e8640 1 Processor -- start 2024-09-19T05:44:24.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f97771e8640 1 -- start start 2024-09-19T05:44:24.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f97771e8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f97700d1590 0x7f97700d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f97771e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700b51d0 0x7f97700cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f97771e8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97700d4d40 con 0x7f9770161da0 2024-09-19T05:44:24.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f97771e8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f97700d0840 con 0x7f97700d1590 2024-09-19T05:44:24.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f97771e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f97700d5020 con 0x7f97700b51d0 2024-09-19T05:44:24.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f9774f84640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9770161da0 0x7f97700d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48708/0 (socket says 172.21.15.67:48708) 2024-09-19T05:44:24.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f9774f84640 1 -- 172.21.15.67:0/3443196009 learned_addr learned my addr 172.21.15.67:0/3443196009 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:24.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f976ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f97700d1590 0x7f97700d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f9775785640 1 --2- 172.21.15.67:0/3443196009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700b51d0 0x7f97700cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f976ffff640 1 -- 172.21.15.67:0/3443196009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700b51d0 msgr2=0x7f97700cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:24.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f976ffff640 1 --2- 172.21.15.67:0/3443196009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700b51d0 0x7f97700cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f976ffff640 1 -- 172.21.15.67:0/3443196009 >> v1:172.21.15.67:6789/0 conn(0x7f9770161da0 legacy=0x7f97700d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f976f7fe640 1 -- 172.21.15.67:0/3443196009 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096267353 0 0) 0x7f97700d4d40 con 0x7f9770161da0 2024-09-19T05:44:24.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f976ffff640 1 -- 172.21.15.67:0/3443196009 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97700d5300 con 0x7f97700d1590 2024-09-19T05:44:24.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.505+0000 7f9775785640 1 --2- 172.21.15.67:0/3443196009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700b51d0 0x7f97700cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:24.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f976ffff640 1 --2- 172.21.15.67:0/3443196009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 0x7f97700d1af0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f97640097c0 tx=0x7f976401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6c577d54174201 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:24.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f976f7fe640 1 -- 172.21.15.67:0/3443196009 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97640b0070 con 0x7f97700d1590 2024-09-19T05:44:24.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f976f7fe640 1 -- 172.21.15.67:0/3443196009 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97640ab600 con 0x7f97700d1590 2024-09-19T05:44:24.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f976f7fe640 1 -- 172.21.15.67:0/3443196009 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97640ab9d0 con 0x7f97700d1590 2024-09-19T05:44:24.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 -- 172.21.15.67:0/3443196009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 msgr2=0x7f97700d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 --2- 172.21.15.67:0/3443196009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 0x7f97700d1af0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f97640097c0 tx=0x7f976401c4a0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 -- 172.21.15.67:0/3443196009 shutdown_connections 2024-09-19T05:44:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 --2- 172.21.15.67:0/3443196009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700b51d0 0x7f97700cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 --2- 172.21.15.67:0/3443196009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 0x7f97700d1af0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 -- 172.21.15.67:0/3443196009 >> 172.21.15.67:0/3443196009 conn(0x7f977008bfc0 msgr2=0x7f97700d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 -- 172.21.15.67:0/3443196009 shutdown_connections 2024-09-19T05:44:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 -- 172.21.15.67:0/3443196009 wait complete. 2024-09-19T05:44:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 Processor -- start 2024-09-19T05:44:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 -- start start 2024-09-19T05:44:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97700b51d0 0x7f977014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 0x7f977015f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9770161da0 0x7f977015f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97700d0020 con 0x7f97700d1590 2024-09-19T05:44:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f97700cfea0 con 0x7f97700b51d0 2024-09-19T05:44:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f97771e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f97700d01a0 con 0x7f9770161da0 2024-09-19T05:44:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f976ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 0x7f977015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f976ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 0x7f977015f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41520/0 (socket says 172.21.15.67:41520) 2024-09-19T05:44:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f976ffff640 1 -- 172.21.15.67:0/3418854075 learned_addr learned my addr 172.21.15.67:0/3418854075 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f9774f84640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97700b51d0 0x7f977014eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.509+0000 7f9775785640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9770161da0 0x7f977015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976ffff640 1 -- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9770161da0 msgr2=0x7f977015f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976ffff640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9770161da0 0x7f977015f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976ffff640 1 -- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97700b51d0 msgr2=0x7f977014eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976ffff640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97700b51d0 0x7f977014eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976ffff640 1 -- 172.21.15.67:0/3418854075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977015de30 con 0x7f97700d1590 2024-09-19T05:44:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976ffff640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 0x7f977015f230 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f97640ae040 tx=0x7f976401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976d7fa640 1 -- 172.21.15.67:0/3418854075 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97640b0050 con 0x7f97700d1590 2024-09-19T05:44:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976d7fa640 1 -- 172.21.15.67:0/3418854075 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97640b1040 con 0x7f97700d1590 2024-09-19T05:44:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f97771e8640 1 -- 172.21.15.67:0/3418854075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f977015e110 con 0x7f97700d1590 2024-09-19T05:44:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976d7fa640 1 -- 172.21.15.67:0/3418854075 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9764004220 con 0x7f97700d1590 2024-09-19T05:44:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f97771e8640 1 -- 172.21.15.67:0/3418854075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f977015e6d0 con 0x7f97700d1590 2024-09-19T05:44:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f97771e8640 1 -- 172.21.15.67:0/3418854075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97700cf150 con 0x7f97700d1590 2024-09-19T05:44:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976d7fa640 1 -- 172.21.15.67:0/3418854075 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97640be060 con 0x7f97700d1590 2024-09-19T05:44:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976d7fa640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f975c0678c0 0x7f975c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f976d7fa640 1 -- 172.21.15.67:0/3418854075 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f976411f900 con 0x7f97700d1590 2024-09-19T05:44:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.513+0000 7f9774f84640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f975c0678c0 0x7f975c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.517+0000 7f9774f84640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f975c0678c0 0x7f975c069d80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9760000f70 tx=0x7f9760009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:24.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.517+0000 7f976d7fa640 1 -- 172.21.15.67:0/3418854075 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9764016090 con 0x7f97700d1590 2024-09-19T05:44:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.741+0000 7f97771e8640 1 -- 172.21.15.67:0/3418854075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f977006e4d0 con 0x7f97700d1590 2024-09-19T05:44:24.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.741+0000 7f976d7fa640 1 -- 172.21.15.67:0/3418854075 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1069 (secure 0 0 0) 0x7f97640f0340 con 0x7f97700d1590 2024-09-19T05:44:24.742 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:24.742 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":694,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077791312,"bytes_used":2686918656,"bytes_avail":770407194624,"bytes_total":773094113280,"write_bytes_sec":51018043,"read_op_per_sec":0,"write_op_per_sec":52},"fsmap":{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8514}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-19T05:42:47.308492+0000","services":{}},"progress_events":{}} 2024-09-19T05:44:24.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 -- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f975c0678c0 msgr2=0x7f975c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f975c0678c0 0x7f975c069d80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9760000f70 tx=0x7f9760009040 comp rx=0 tx=0).stop 2024-09-19T05:44:24.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 -- 172.21.15.67:0/3418854075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 msgr2=0x7f977015f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:24.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 0x7f977015f230 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f97640ae040 tx=0x7f976401ace0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 -- 172.21.15.67:0/3418854075 shutdown_connections 2024-09-19T05:44:24.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f975c0678c0 0x7f975c069d80 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9770161da0 0x7f977015f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700d1590 0x7f977015f230 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 --2- 172.21.15.67:0/3418854075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97700b51d0 0x7f977014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:24.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 -- 172.21.15.67:0/3418854075 >> 172.21.15.67:0/3418854075 conn(0x7f977008bfc0 msgr2=0x7f9770160dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:24.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 -- 172.21.15.67:0/3418854075 shutdown_connections 2024-09-19T05:44:24.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:24.745+0000 7f97771e8640 1 -- 172.21.15.67:0/3418854075 wait complete. 2024-09-19T05:44:25.763 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.897+0000 7fd2b33c8640 1 Processor -- start 2024-09-19T05:44:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.897+0000 7fd2b33c8640 1 -- start start 2024-09-19T05:44:25.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b33c8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2ac15a920 0x7fd2ac072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:25.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b33c8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd2ac06ed80 0x7fd2ac0ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:25.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b33c8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac0730e0 con 0x7fd2ac0af730 2024-09-19T05:44:25.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b33c8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac0733c0 con 0x7fd2ac15a920 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b33c8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac0ad8c0 con 0x7fd2ac06ed80 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b1164640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2ac15a920 0x7fd2ac072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b0963640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd2ac0af730 0x7fd2ac06e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37028/0 (socket says 172.21.15.67:37028) 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b0963640 1 -- 172.21.15.67:0/1419532294 learned_addr learned my addr 172.21.15.67:0/1419532294 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b1965640 1 --2- 172.21.15.67:0/1419532294 >> v2:172.21.15.97:3300/0 conn(0x7fd2ac06ed80 0x7fd2ac0ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2a3fff640 1 -- 172.21.15.67:0/1419532294 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089939638 0 0) 0x7fd2ac0730e0 con 0x7fd2ac0af730 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2a3fff640 1 -- 172.21.15.67:0/1419532294 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd298003450 con 0x7fd2ac0af730 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b1164640 1 -- 172.21.15.67:0/1419532294 >> v2:172.21.15.97:3300/0 conn(0x7fd2ac06ed80 msgr2=0x7fd2ac0ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b1164640 1 --2- 172.21.15.67:0/1419532294 >> v2:172.21.15.97:3300/0 conn(0x7fd2ac06ed80 0x7fd2ac0ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b1164640 1 -- 172.21.15.67:0/1419532294 >> v1:172.21.15.67:6789/0 conn(0x7fd2ac0af730 legacy=0x7fd2ac06e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b1164640 1 -- 172.21.15.67:0/1419532294 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac0adba0 con 0x7fd2ac15a920 2024-09-19T05:44:25.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2b1164640 1 --2- 172.21.15.67:0/1419532294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac15a920 0x7fd2ac072840 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac074480 tx=0x7fd2a801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a589f334f1572350 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:25.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2a3fff640 1 -- 172.21.15.67:0/1419532294 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80b1070 con 0x7fd2ac15a920 2024-09-19T05:44:25.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2a3fff640 1 -- 172.21.15.67:0/1419532294 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a80ac640 con 0x7fd2ac15a920 2024-09-19T05:44:25.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.901+0000 7fd2a3fff640 1 -- 172.21.15.67:0/1419532294 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80aca10 con 0x7fd2ac15a920 2024-09-19T05:44:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1419532294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac15a920 msgr2=0x7fd2ac072840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 --2- 172.21.15.67:0/1419532294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac15a920 0x7fd2ac072840 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac074480 tx=0x7fd2a801c480 comp rx=0 tx=0).stop 2024-09-19T05:44:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1419532294 shutdown_connections 2024-09-19T05:44:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 --2- 172.21.15.67:0/1419532294 >> v2:172.21.15.97:3300/0 conn(0x7fd2ac06ed80 0x7fd2ac0ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 --2- 172.21.15.67:0/1419532294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac15a920 0x7fd2ac072840 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1419532294 >> 172.21.15.67:0/1419532294 conn(0x7fd2ac0d0080 msgr2=0x7fd2ac0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1419532294 shutdown_connections 2024-09-19T05:44:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1419532294 wait complete. 2024-09-19T05:44:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 Processor -- start 2024-09-19T05:44:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- start start 2024-09-19T05:44:25.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac06ed80 0x7fd2ac097170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2ac0af730 0x7fd2ac147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2ac15a920 0x7fd2ac0b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0ae780 con 0x7fd2ac06ed80 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0ae600 con 0x7fd2ac0af730 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac0ae900 con 0x7fd2ac15a920 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b1164640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac06ed80 0x7fd2ac097170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b1164640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac06ed80 0x7fd2ac097170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56900/0 (socket says 172.21.15.67:56900) 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b1164640 1 -- 172.21.15.67:0/1708645627 learned_addr learned my addr 172.21.15.67:0/1708645627 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b0963640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2ac0af730 0x7fd2ac147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b1965640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2ac15a920 0x7fd2ac0b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b1164640 1 -- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2ac15a920 msgr2=0x7fd2ac0b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b1164640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2ac15a920 0x7fd2ac0b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b1164640 1 -- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2ac0af730 msgr2=0x7fd2ac147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b1164640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2ac0af730 0x7fd2ac147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b1164640 1 -- 172.21.15.67:0/1708645627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac15bbc0 con 0x7fd2ac06ed80 2024-09-19T05:44:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b0963640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2ac0af730 0x7fd2ac147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b1164640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac06ed80 0x7fd2ac097170 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80af040 tx=0x7fd2a8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2a1ffb640 1 -- 172.21.15.67:0/1708645627 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80b1040 con 0x7fd2ac06ed80 2024-09-19T05:44:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2a1ffb640 1 -- 172.21.15.67:0/1708645627 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a80ba070 con 0x7fd2ac06ed80 2024-09-19T05:44:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1708645627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac148740 con 0x7fd2ac06ed80 2024-09-19T05:44:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2a1ffb640 1 -- 172.21.15.67:0/1708645627 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80b5690 con 0x7fd2ac06ed80 2024-09-19T05:44:25.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.905+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1708645627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac148d00 con 0x7fd2ac06ed80 2024-09-19T05:44:25.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.909+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1708645627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac0ae0c0 con 0x7fd2ac06ed80 2024-09-19T05:44:25.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.909+0000 7fd2a1ffb640 1 -- 172.21.15.67:0/1708645627 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2a80b5830 con 0x7fd2ac06ed80 2024-09-19T05:44:25.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.909+0000 7fd2a1ffb640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2900678f0 0x7fd290069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:25.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.909+0000 7fd2a1ffb640 1 -- 172.21.15.67:0/1708645627 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fd2a811fb70 con 0x7fd2ac06ed80 2024-09-19T05:44:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.909+0000 7fd2b0963640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2900678f0 0x7fd290069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.909+0000 7fd2b0963640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2900678f0 0x7fd290069db0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac1f63c0 tx=0x7fd29c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:25.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:25.913+0000 7fd2a1ffb640 1 -- 172.21.15.67:0/1708645627 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd2a8016070 con 0x7fd2ac06ed80 2024-09-19T05:44:26.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.108+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1708645627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2ac06ce60 con 0x7fd2ac06ed80 2024-09-19T05:44:26.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.108+0000 7fd2a1ffb640 1 -- 172.21.15.67:0/1708645627 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7fd2a80f0500 con 0x7fd2ac06ed80 2024-09-19T05:44:26.110 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:26.110 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:26.110 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:26.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2900678f0 msgr2=0x7fd290069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2900678f0 0x7fd290069db0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac1f63c0 tx=0x7fd29c009040 comp rx=0 tx=0).stop 2024-09-19T05:44:26.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1708645627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac06ed80 msgr2=0x7fd2ac097170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac06ed80 0x7fd2ac097170 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80af040 tx=0x7fd2a8019220 comp rx=0 tx=0).stop 2024-09-19T05:44:26.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1708645627 shutdown_connections 2024-09-19T05:44:26.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd2900678f0 0x7fd290069db0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd2ac15a920 0x7fd2ac0b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2ac0af730 0x7fd2ac147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 --2- 172.21.15.67:0/1708645627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2ac06ed80 0x7fd2ac097170 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1708645627 >> 172.21.15.67:0/1708645627 conn(0x7fd2ac0d0080 msgr2=0x7fd2ac14d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1708645627 shutdown_connections 2024-09-19T05:44:26.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.112+0000 7fd2b33c8640 1 -- 172.21.15.67:0/1708645627 wait complete. 2024-09-19T05:44:26.128 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-19T05:44:26.128 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:44:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.244+0000 7fe4c8d7d640 1 Processor -- start 2024-09-19T05:44:26.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.244+0000 7fe4c8d7d640 1 -- start start 2024-09-19T05:44:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c8d7d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4c40b4900 0x7fe4c4071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c8d7d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe4c40723c0 0x7fe4c4072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c8d7d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c40b3860 con 0x7fe4c415b1e0 2024-09-19T05:44:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c8d7d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c415b5c0 con 0x7fe4c40723c0 2024-09-19T05:44:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c8d7d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c40b3b40 con 0x7fe4c40b4900 2024-09-19T05:44:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c259c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe4c415b1e0 0x7fe4c40b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37040/0 (socket says 172.21.15.67:37040) 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c259c640 1 -- 172.21.15.67:0/1601858255 learned_addr learned my addr 172.21.15.67:0/1601858255 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c2d9d640 1 --2- 172.21.15.67:0/1601858255 >> v2:172.21.15.97:3300/0 conn(0x7fe4c40723c0 0x7fe4c4072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c1d9b640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4c40b4900 0x7fe4c4071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677990087 0 0) 0x7fe4c40b3860 con 0x7fe4c415b1e0 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4b0003530 con 0x7fe4c415b1e0 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3982319372 0 0) 0x7fe4b0003530 con 0x7fe4c415b1e0 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4c40b4900 msgr2=0x7fe4c4071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4c40b4900 0x7fe4c4071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 >> v2:172.21.15.97:3300/0 conn(0x7fe4c40723c0 msgr2=0x7fe4c4072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 --2- 172.21.15.67:0/1601858255 >> v2:172.21.15.97:3300/0 conn(0x7fe4c40723c0 0x7fe4c4072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c40b3e20 con 0x7fe4c415b1e0 2024-09-19T05:44:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fe4b4001680 con 0x7fe4c415b1e0 2024-09-19T05:44:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 >> v1:172.21.15.67:6789/0 conn(0x7fe4c415b1e0 legacy=0x7fe4c40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4c40b4900 0x7fe4b00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4b0003f40 0x7fe4b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4b0004d50 0x7fe4b00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c415b5c0 con 0x7fe4b0004d50 2024-09-19T05:44:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c40b3b40 con 0x7fe4b0003f40 2024-09-19T05:44:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b000b9d0 con 0x7fe4c40b4900 2024-09-19T05:44:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c2d9d640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4b0004d50 0x7fe4b00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c259c640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4c40b4900 0x7fe4b00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c2d9d640 1 -- 172.21.15.67:0/1601858255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4c40b4900 msgr2=0x7fe4b00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c2d9d640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4c40b4900 0x7fe4b00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c2d9d640 1 -- 172.21.15.67:0/1601858255 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4b0003f40 msgr2=0x7fe4b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c2d9d640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4b0003f40 0x7fe4b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c2d9d640 1 -- 172.21.15.67:0/1601858255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b0003530 con 0x7fe4b0004d50 2024-09-19T05:44:26.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c2d9d640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4b0004d50 0x7fe4b00051d0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009fc0 tx=0x7fe4bc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf9e0fc485f0e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0b2070 con 0x7fe4b0004d50 2024-09-19T05:44:26.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0a5cd0 con 0x7fe4b0004d50 2024-09-19T05:44:26.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c159a640 1 -- 172.21.15.67:0/1601858255 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc009c10 con 0x7fe4b0004d50 2024-09-19T05:44:26.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/1601858255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4b0004d50 msgr2=0x7fe4b00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c8d7d640 1 --2- 172.21.15.67:0/1601858255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4b0004d50 0x7fe4b00051d0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009fc0 tx=0x7fe4bc01cc60 comp rx=0 tx=0).stop 2024-09-19T05:44:26.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c2d9d640 1 -- 172.21.15.67:0/1601858255 reap_dead start 2024-09-19T05:44:26.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.248+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/1601858255 shutdown_connections 2024-09-19T05:44:26.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/1601858255 >> 172.21.15.67:0/1601858255 conn(0x7fe4c40d0080 msgr2=0x7fe4c40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/1601858255 shutdown_connections 2024-09-19T05:44:26.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/1601858255 wait complete. 2024-09-19T05:44:26.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 Processor -- start 2024-09-19T05:44:26.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 -- start start 2024-09-19T05:44:26.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4b0004d50 0x7fe4c415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c415da70 0x7fe4c41f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c41f78c0 0x7fe4c414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c4071e80 con 0x7fe4c41f78c0 2024-09-19T05:44:26.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c40b43e0 con 0x7fe4c415da70 2024-09-19T05:44:26.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c4072000 con 0x7fe4b0004d50 2024-09-19T05:44:26.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c41f78c0 0x7fe4c414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c41f78c0 0x7fe4c414dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56912/0 (socket says 172.21.15.67:56912) 2024-09-19T05:44:26.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c2d9d640 1 -- 172.21.15.67:0/3319942862 learned_addr learned my addr 172.21.15.67:0/3319942862 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c259c640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4b0004d50 0x7fe4c415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c1d9b640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c415da70 0x7fe4c41f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c2d9d640 1 -- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4b0004d50 msgr2=0x7fe4c415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c2d9d640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4b0004d50 0x7fe4c415d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c2d9d640 1 -- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c415da70 msgr2=0x7fe4c41f7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c2d9d640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c415da70 0x7fe4c41f7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c2d9d640 1 -- 172.21.15.67:0/3319942862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c415e030 con 0x7fe4c41f78c0 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c259c640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4b0004d50 0x7fe4c415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c2d9d640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c41f78c0 0x7fe4c414dc10 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc002240 tx=0x7fe4bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4baffd640 1 -- 172.21.15.67:0/3319942862 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0bd070 con 0x7fe4c41f78c0 2024-09-19T05:44:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4baffd640 1 -- 172.21.15.67:0/3319942862 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0a5ad0 con 0x7fe4c41f78c0 2024-09-19T05:44:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4baffd640 1 -- 172.21.15.67:0/3319942862 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0b2040 con 0x7fe4c41f78c0 2024-09-19T05:44:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/3319942862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c415e310 con 0x7fe4c41f78c0 2024-09-19T05:44:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/3319942862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c4156570 con 0x7fe4c41f78c0 2024-09-19T05:44:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.252+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/3319942862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c415e4e0 con 0x7fe4c41f78c0 2024-09-19T05:44:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.256+0000 7fe4baffd640 1 -- 172.21.15.67:0/3319942862 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4bc0c0070 con 0x7fe4c41f78c0 2024-09-19T05:44:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.256+0000 7fe4baffd640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4a40678c0 0x7fe4a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.256+0000 7fe4baffd640 1 -- 172.21.15.67:0/3319942862 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fe4bc11fb30 con 0x7fe4c41f78c0 2024-09-19T05:44:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.256+0000 7fe4c259c640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4a40678c0 0x7fe4a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.256+0000 7fe4c259c640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4a40678c0 0x7fe4a4069d80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4000c10 tx=0x7fe4b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.260+0000 7fe4baffd640 1 -- 172.21.15.67:0/3319942862 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe4bc0169d0 con 0x7fe4c41f78c0 2024-09-19T05:44:26.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/3319942862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe4c4073010 con 0x7fe4c41f78c0 2024-09-19T05:44:26.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4baffd640 1 -- 172.21.15.67:0/3319942862 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7fe4bc0efe00 con 0x7fe4c41f78c0 2024-09-19T05:44:26.480 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:26.480 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":696,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077791312,"bytes_used":2686918656,"bytes_avail":770407194624,"bytes_total":773094113280,"write_bytes_sec":26919757,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8514}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-09-19T05:44:25.344276+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:44:26.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4a40678c0 msgr2=0x7fe4a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4a40678c0 0x7fe4a4069d80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4000c10 tx=0x7fe4b4009040 comp rx=0 tx=0).stop 2024-09-19T05:44:26.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/3319942862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c41f78c0 msgr2=0x7fe4c414dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c41f78c0 0x7fe4c414dc10 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc002240 tx=0x7fe4bc009750 comp rx=0 tx=0).stop 2024-09-19T05:44:26.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/3319942862 shutdown_connections 2024-09-19T05:44:26.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c41f78c0 0x7fe4c414dc10 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c415da70 0x7fe4c41f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4a40678c0 0x7fe4a4069d80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 --2- 172.21.15.67:0/3319942862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4b0004d50 0x7fe4c415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.480+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/3319942862 >> 172.21.15.67:0/3319942862 conn(0x7fe4c40d0080 msgr2=0x7fe4c40ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.484+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/3319942862 shutdown_connections 2024-09-19T05:44:26.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.484+0000 7fe4c8d7d640 1 -- 172.21.15.67:0/3319942862 wait complete. 2024-09-19T05:44:26.500 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-19T05:44:26.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:26.500 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub resume 2024-09-19T05:44:26.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.612+0000 7f3259c98640 1 Processor -- start 2024-09-19T05:44:26.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.612+0000 7f3259c98640 1 -- start start 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.612+0000 7f3259c98640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f325415e5c0 0x7f32540d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.612+0000 7f3259c98640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f325406d920 0x7f32540b7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.612+0000 7f3259c98640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32540cf410 con 0x7f32540b7aa0 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.612+0000 7f3259c98640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f325415e9a0 con 0x7f325406d920 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.612+0000 7f3259c98640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f32540cfd40 con 0x7f325415e5c0 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.612+0000 7f324bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f325406d920 0x7f32540b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.612+0000 7f324bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f325406d920 0x7f32540b7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56918/0 (socket says 172.21.15.67:56918) 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.612+0000 7f324bfff640 1 -- 172.21.15.67:0/4128083931 learned_addr learned my addr 172.21.15.67:0/4128083931 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f32537fe640 1 --2- 172.21.15.67:0/4128083931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f325415e5c0 0x7f32540d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f324bfff640 1 -- 172.21.15.67:0/4128083931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f325415e5c0 msgr2=0x7f32540d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f324bfff640 1 --2- 172.21.15.67:0/4128083931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f325415e5c0 0x7f32540d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f324bfff640 1 -- 172.21.15.67:0/4128083931 >> v1:172.21.15.97:6789/0 conn(0x7f32540b7aa0 legacy=0x7f32540b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f324bfff640 1 -- 172.21.15.67:0/4128083931 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32540cf6f0 con 0x7f325406d920 2024-09-19T05:44:26.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f324bfff640 1 --2- 172.21.15.67:0/4128083931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325406d920 0x7f32540b7560 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f323c009870 tx=0x7f323c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d7098b380d8d25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3252ffd640 1 -- 172.21.15.67:0/4128083931 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c0b5070 con 0x7f325406d920 2024-09-19T05:44:26.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3252ffd640 1 -- 172.21.15.67:0/4128083931 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f323c0a8a50 con 0x7f325406d920 2024-09-19T05:44:26.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3252ffd640 1 -- 172.21.15.67:0/4128083931 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c0a8e20 con 0x7f325406d920 2024-09-19T05:44:26.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3259c98640 1 -- 172.21.15.67:0/4128083931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325406d920 msgr2=0x7f32540b7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3259c98640 1 --2- 172.21.15.67:0/4128083931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325406d920 0x7f32540b7560 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f323c009870 tx=0x7f323c01ed50 comp rx=0 tx=0).stop 2024-09-19T05:44:26.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3259c98640 1 -- 172.21.15.67:0/4128083931 shutdown_connections 2024-09-19T05:44:26.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3259c98640 1 --2- 172.21.15.67:0/4128083931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325406d920 0x7f32540b7560 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3259c98640 1 --2- 172.21.15.67:0/4128083931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f325415e5c0 0x7f32540d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3259c98640 1 -- 172.21.15.67:0/4128083931 >> 172.21.15.67:0/4128083931 conn(0x7f32540d46b0 msgr2=0x7f32540d4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3259c98640 1 -- 172.21.15.67:0/4128083931 shutdown_connections 2024-09-19T05:44:26.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.616+0000 7f3259c98640 1 -- 172.21.15.67:0/4128083931 wait complete. 2024-09-19T05:44:26.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3259c98640 1 Processor -- start 2024-09-19T05:44:26.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3259c98640 1 -- start start 2024-09-19T05:44:26.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3259c98640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f325406d920 0x7f3254161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3259c98640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32540b7aa0 0x7f32540cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3259c98640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f325415e5c0 0x7f32540b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3259c98640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f32540d2f60 con 0x7f32540b7aa0 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3259c98640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f32540d2de0 con 0x7f325415e5c0 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3259c98640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f32540b6690 con 0x7f325406d920 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f324bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32540b7aa0 0x7f32540cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f324bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32540b7aa0 0x7f32540cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56926/0 (socket says 172.21.15.67:56926) 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f324bfff640 1 -- 172.21.15.67:0/3097008709 learned_addr learned my addr 172.21.15.67:0/3097008709 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f32537fe640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f325406d920 0x7f3254161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3253fff640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f325415e5c0 0x7f32540b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f324bfff640 1 -- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f325406d920 msgr2=0x7f3254161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f324bfff640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f325406d920 0x7f3254161660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f324bfff640 1 -- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f325415e5c0 msgr2=0x7f32540b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f324bfff640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f325415e5c0 0x7f32540b8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f324bfff640 1 -- 172.21.15.67:0/3097008709 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32541605c0 con 0x7f32540b7aa0 2024-09-19T05:44:26.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f324bfff640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32540b7aa0 0x7f32540cd010 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f323c0b3040 tx=0x7f323c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3250ff9640 1 -- 172.21.15.67:0/3097008709 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c0c0070 con 0x7f32540b7aa0 2024-09-19T05:44:26.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3250ff9640 1 -- 172.21.15.67:0/3097008709 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f323c0b0c40 con 0x7f32540b7aa0 2024-09-19T05:44:26.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3250ff9640 1 -- 172.21.15.67:0/3097008709 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c0b5040 con 0x7f32540b7aa0 2024-09-19T05:44:26.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3259c98640 1 -- 172.21.15.67:0/3097008709 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32541608a0 con 0x7f32540b7aa0 2024-09-19T05:44:26.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3259c98640 1 -- 172.21.15.67:0/3097008709 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3254160e60 con 0x7f32540b7aa0 2024-09-19T05:44:26.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3250ff9640 1 -- 172.21.15.67:0/3097008709 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f323c0ba3d0 con 0x7f32540b7aa0 2024-09-19T05:44:26.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3250ff9640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32340678c0 0x7f3234069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.620+0000 7f3250ff9640 1 -- 172.21.15.67:0/3097008709 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f323c123270 con 0x7f32540b7aa0 2024-09-19T05:44:26.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f32537fe640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32340678c0 0x7f3234069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 Processor -- start 2024-09-19T05:44:26.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 -- start start 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f32537fe640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32340678c0 0x7f3234069d80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3254161da0 tx=0x7f3244008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a904150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a8b7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a8b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556a6a7a1960 con 0x556a6a904690 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556a6a6e5900 con 0x556a6a8b7db0 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x556a6a708d40 con 0x556a6a903d70 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f324bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a8b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f324bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a8b7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56940/0 (socket says 172.21.15.67:56940) 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f324bfff640 1 -- 172.21.15.67:0/4144762516 learned_addr learned my addr 172.21.15.67:0/4144762516 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f3253fff640 1 --2- 172.21.15.67:0/4144762516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a8b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f32537fe640 1 --2- 172.21.15.67:0/4144762516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a904150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f324bfff640 1 -- 172.21.15.67:0/4144762516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 msgr2=0x556a6a904150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f324bfff640 1 --2- 172.21.15.67:0/4144762516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a904150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f324bfff640 1 -- 172.21.15.67:0/4144762516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 msgr2=0x556a6a8b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f324bfff640 1 --2- 172.21.15.67:0/4144762516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a8b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f324bfff640 1 -- 172.21.15.67:0/4144762516 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a6a6af580 con 0x556a6a904690 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f3253fff640 1 --2- 172.21.15.67:0/4144762516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a8b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f324bfff640 1 --2- 172.21.15.67:0/4144762516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a8b7870 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f323c0f34a0 tx=0x7f323c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8ae6950a2857c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f32497fa640 1 -- 172.21.15.67:0/4144762516 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c0f3510 con 0x556a6a904690 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f32497fa640 1 -- 172.21.15.67:0/4144762516 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f323c0f78c0 con 0x556a6a904690 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f32497fa640 1 -- 172.21.15.67:0/4144762516 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c0fc0f0 con 0x556a6a904690 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 -- 172.21.15.67:0/4144762516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 msgr2=0x556a6a8b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 --2- 172.21.15.67:0/4144762516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a8b7870 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f323c0f34a0 tx=0x7f323c009240 comp rx=0 tx=0).stop 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 -- 172.21.15.67:0/4144762516 shutdown_connections 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 --2- 172.21.15.67:0/4144762516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a8b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 --2- 172.21.15.67:0/4144762516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a8b7870 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 --2- 172.21.15.67:0/4144762516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a904150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 -- 172.21.15.67:0/4144762516 >> 172.21.15.67:0/4144762516 conn(0x556a6a8e5040 msgr2=0x556a6a8e7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 -- 172.21.15.67:0/4144762516 shutdown_connections 2024-09-19T05:44:26.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 -- 172.21.15.67:0/4144762516 wait complete. 2024-09-19T05:44:26.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 -- start start 2024-09-19T05:44:26.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.624+0000 7f325cd54000 1 Processor -- start 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a8b7db0 0x556a6a90ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a90b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a904690 0x556a6a90b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556a6a704d00 con 0x556a6a8b7db0 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556a6a6c3aa0 con 0x556a6a904690 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x556a6a6a2340 con 0x556a6a903d70 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 10 client.0 _ll_register_callbacks cb 0x556a6a8a5760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32537fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a8b7db0 0x556a6a90ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32537fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a8b7db0 0x556a6a90ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56950/0 (socket says 172.21.15.67:56950) 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32537fe640 1 -- 172.21.15.67:0/2747134075 learned_addr learned my addr 172.21.15.67:0/2747134075 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f324bfff640 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a90b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f3253fff640 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a904690 0x556a6a90b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32537fe640 1 -- 172.21.15.67:0/2747134075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 msgr2=0x556a6a90b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32537fe640 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a90b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32537fe640 1 -- 172.21.15.67:0/2747134075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a904690 msgr2=0x556a6a90b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32537fe640 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a904690 0x556a6a90b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32537fe640 1 -- 172.21.15.67:0/2747134075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a6a6abdc0 con 0x556a6a8b7db0 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f324bfff640 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a90b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f3253fff640 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a904690 0x556a6a90b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32537fe640 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a8b7db0 0x556a6a90ace0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f32440144f0 tx=0x7f3244004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0b77bb03971590 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32327fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32327fc640 1 -- 172.21.15.67:0/2747134075 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244027060 con 0x556a6a8b7db0 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32327fc640 1 -- 172.21.15.67:0/2747134075 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f3244003620 con 0x556a6a8b7db0 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- 172.21.15.67:0/2747134075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f323c0f78c0 con 0x556a6a8b7db0 2024-09-19T05:44:26.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32327fc640 1 -- 172.21.15.67:0/2747134075 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f324402d050 con 0x556a6a8b7db0 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 10 client.8838 fetch_fsmap learned FSMap version 98 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- 172.21.15.67:0/2747134075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x556a6a6a87f0 con 0x556a6a8b7db0 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32327fc640 1 -- 172.21.15.67:0/2747134075 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f323c0f78c0 con 0x556a6a8b7db0 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32327fc640 1 -- 172.21.15.67:0/2747134075 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f3244030020 con 0x556a6a8b7db0 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 10 client.8838 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 10 client.8838 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 20 client.8838 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x556a6a9130b0 0x556a6a9154a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 4 client.8838 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- 172.21.15.67:0/2747134075 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a6a6a2e10 con 0x556a6a9130b0 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f324bfff640 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x556a6a9130b0 0x556a6a9154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f324bfff640 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x556a6a9130b0 0x556a6a9154a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9a626840fc06ff5 server_cookie=ad68a26eab672c in_seq=0 out_seq=0 2024-09-19T05:44:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32327fc640 10 client.8838 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32327fc640 1 -- 172.21.15.67:0/2747134075 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a6a6a2e10 con 0x556a6a9130b0 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32327fc640 10 client.8838 handle_command_reply: tid=0 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 client.8838 shutdown 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- 172.21.15.67:0/2747134075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a8b7db0 msgr2=0x556a6a90ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a8b7db0 0x556a6a90ace0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f32440144f0 tx=0x7f3244004740 comp rx=0 tx=0).stop 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- 172.21.15.67:0/2747134075 shutdown_connections 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x556a6a9130b0 0x556a6a9154a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a904690 0x556a6a90b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a90b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f32327fc640 0 client.8838 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 --2- 172.21.15.67:0/2747134075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a8b7db0 0x556a6a90ace0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- 172.21.15.67:0/2747134075 >> 172.21.15.67:0/2747134075 conn(0x556a6a8e5040 msgr2=0x556a6a8b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- 172.21.15.67:0/2747134075 shutdown_connections 2024-09-19T05:44:26.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 1 -- 172.21.15.67:0/2747134075 wait complete. 2024-09-19T05:44:26.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.628+0000 7f325cd54000 20 client.8838 trim_cache size 0 max 16384 2024-09-19T05:44:26.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.644+0000 7f325cd54000 1 Processor -- start 2024-09-19T05:44:26.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.644+0000 7f325cd54000 1 -- start start 2024-09-19T05:44:26.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a918d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a9113f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a911930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3254200ff0 con 0x556a6a904690 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3254200070 con 0x556a6a8b7db0 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f325415f800 con 0x556a6a903d70 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a911930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a911930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56962/0 (socket says 172.21.15.67:56962) 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 -- 172.21.15.67:0/2737730404 learned_addr learned my addr 172.21.15.67:0/2737730404 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f32537fe640 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a918d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 -- 172.21.15.67:0/2737730404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 msgr2=0x556a6a9113f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f324bfff640 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a9113f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a9113f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 -- 172.21.15.67:0/2737730404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 msgr2=0x556a6a918d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a918d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 -- 172.21.15.67:0/2737730404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a6a6c6470 con 0x556a6a904690 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f32537fe640 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a918d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f324bfff640 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a9113f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a911930 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f324c001db0 tx=0x7f324c010240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31a9d2f0423d534 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3248ff9640 1 -- 172.21.15.67:0/2737730404 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c006d70 con 0x556a6a904690 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3248ff9640 1 -- 172.21.15.67:0/2737730404 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324c010a70 con 0x556a6a904690 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3248ff9640 1 -- 172.21.15.67:0/2737730404 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c010e60 con 0x556a6a904690 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- 172.21.15.67:0/2737730404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 msgr2=0x556a6a911930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a911930 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f324c001db0 tx=0x7f324c010240 comp rx=0 tx=0).stop 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- 172.21.15.67:0/2737730404 shutdown_connections 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a911930 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a9113f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 --2- 172.21.15.67:0/2737730404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a918d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- 172.21.15.67:0/2737730404 >> 172.21.15.67:0/2737730404 conn(0x556a6a8e5040 msgr2=0x556a6a910ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- 172.21.15.67:0/2737730404 shutdown_connections 2024-09-19T05:44:26.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- 172.21.15.67:0/2737730404 wait complete. 2024-09-19T05:44:26.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- start start 2024-09-19T05:44:26.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 Processor -- start 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a917e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a933790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a933cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f325415fe50 con 0x556a6a904690 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556a6a8c07b0 con 0x556a6a8b7db0 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x556a6a748780 con 0x556a6a903d70 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f325cd54000 10 client.0 _ll_register_callbacks cb 0x7f324400b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a933cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a933cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56978/0 (socket says 172.21.15.67:56978) 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 -- 172.21.15.67:0/1569257621 learned_addr learned my addr 172.21.15.67:0/1569257621 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f324bfff640 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a933790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 -- 172.21.15.67:0/1569257621 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 msgr2=0x556a6a933790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a933790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f32537fe640 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a917e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 -- 172.21.15.67:0/1569257621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 msgr2=0x556a6a917e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a917e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 -- 172.21.15.67:0/1569257621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a6a69c640 con 0x556a6a904690 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f324bfff640 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a933790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f3253fff640 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a933cd0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f324c0012f0 tx=0x7f324c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f122d76c085252b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.648+0000 7f32327fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32327fc640 1 -- 172.21.15.67:0/1569257621 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c024070 con 0x556a6a904690 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32327fc640 1 -- 172.21.15.67:0/1569257621 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f324c005070 con 0x556a6a904690 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 -- 172.21.15.67:0/1569257621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f324c010a70 con 0x556a6a904690 2024-09-19T05:44:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32327fc640 1 -- 172.21.15.67:0/1569257621 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f324c02f050 con 0x556a6a904690 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 10 client.8844 fetch_fsmap learned FSMap version 98 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 -- 172.21.15.67:0/1569257621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x556a6a6a03b0 con 0x556a6a904690 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32327fc640 1 -- 172.21.15.67:0/1569257621 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324c010a70 con 0x556a6a904690 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32327fc640 1 -- 172.21.15.67:0/1569257621 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f324c032020 con 0x556a6a904690 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 10 client.8844 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 10 client.8844 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 20 client.8844 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x556a6a934210 0x556a6a977cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 4 client.8844 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 -- 172.21.15.67:0/1569257621 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x556a6a716470 con 0x556a6a934210 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32537fe640 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x556a6a934210 0x556a6a977cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32537fe640 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x556a6a934210 0x556a6a977cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a1e5aad552ec429 server_cookie=51f7670b4b400680 in_seq=0 out_seq=0 2024-09-19T05:44:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32327fc640 10 client.8844 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32327fc640 1 -- 172.21.15.67:0/1569257621 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556a6a716470 con 0x556a6a934210 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32327fc640 10 client.8844 handle_command_reply: tid=0 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 client.8844 shutdown 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 -- 172.21.15.67:0/1569257621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 msgr2=0x556a6a933cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a933cd0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f324c0012f0 tx=0x7f324c001260 comp rx=0 tx=0).stop 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 -- 172.21.15.67:0/1569257621 shutdown_connections 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x556a6a934210 0x556a6a977cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556a6a904690 0x556a6a933cd0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556a6a903d70 0x556a6a933790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f32327fc640 0 client.8844 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 --2- 172.21.15.67:0/1569257621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556a6a8b7db0 0x556a6a917e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 -- 172.21.15.67:0/1569257621 >> 172.21.15.67:0/1569257621 conn(0x556a6a8e5040 msgr2=0x556a6a9112f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 -- 172.21.15.67:0/1569257621 shutdown_connections 2024-09-19T05:44:26.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 1 -- 172.21.15.67:0/1569257621 wait complete. 2024-09-19T05:44:26.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f325cd54000 20 client.8844 trim_cache size 0 max 16384 2024-09-19T05:44:26.659 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:44:26.659 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:44:26.659 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:44:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 -- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32340678c0 msgr2=0x7f3234069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32340678c0 0x7f3234069d80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3254161da0 tx=0x7f3244008040 comp rx=0 tx=0).stop 2024-09-19T05:44:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 -- 172.21.15.67:0/3097008709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32540b7aa0 msgr2=0x7f32540cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32540b7aa0 0x7f32540cd010 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f323c0b3040 tx=0x7f323c01baf0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 -- 172.21.15.67:0/3097008709 shutdown_connections 2024-09-19T05:44:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f325415e5c0 0x7f32540b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32540b7aa0 0x7f32540cd010 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32340678c0 0x7f3234069d80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 --2- 172.21.15.67:0/3097008709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f325406d920 0x7f3254161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 -- 172.21.15.67:0/3097008709 >> 172.21.15.67:0/3097008709 conn(0x7f32540d46b0 msgr2=0x7f325415ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 -- 172.21.15.67:0/3097008709 shutdown_connections 2024-09-19T05:44:26.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.652+0000 7f3259c98640 1 -- 172.21.15.67:0/3097008709 wait complete. 2024-09-19T05:44:26.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:26.667 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-19T05:44:26.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.776+0000 7fab114f8640 1 Processor -- start 2024-09-19T05:44:26.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.776+0000 7fab114f8640 1 -- start start 2024-09-19T05:44:26.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.776+0000 7fab114f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab0c159c60 0x7fab0c0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.776+0000 7fab114f8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab0c0af3a0 0x7fab0c15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.776+0000 7fab114f8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab0c15a040 con 0x7fab0c06ffd0 2024-09-19T05:44:26.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab114f8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fab0c15d460 con 0x7fab0c0af3a0 2024-09-19T05:44:26.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab114f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fab0c15c850 con 0x7fab0c159c60 2024-09-19T05:44:26.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab0b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab0c0af3a0 0x7fab0c15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab0a7fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fab0c06ffd0 0x7fab0c0aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37054/0 (socket says 172.21.15.67:37054) 2024-09-19T05:44:26.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab0b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab0c0af3a0 0x7fab0c15fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56992/0 (socket says 172.21.15.67:56992) 2024-09-19T05:44:26.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab0a7fc640 1 -- 172.21.15.67:0/2557911258 learned_addr learned my addr 172.21.15.67:0/2557911258 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:26.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab0affd640 1 --2- 172.21.15.67:0/2557911258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab0c159c60 0x7fab0c0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab0b7fe640 1 -- 172.21.15.67:0/2557911258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab0c159c60 msgr2=0x7fab0c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab0b7fe640 1 --2- 172.21.15.67:0/2557911258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab0c159c60 0x7fab0c0ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab0b7fe640 1 -- 172.21.15.67:0/2557911258 >> v1:172.21.15.67:6789/0 conn(0x7fab0c06ffd0 legacy=0x7fab0c0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab0b7fe640 1 -- 172.21.15.67:0/2557911258 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c15cb30 con 0x7fab0c0af3a0 2024-09-19T05:44:26.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab09ffb640 1 -- 172.21.15.67:0/2557911258 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719253918 0 0) 0x7fab0c15a040 con 0x7fab0c06ffd0 2024-09-19T05:44:26.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab0b7fe640 1 --2- 172.21.15.67:0/2557911258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c0af3a0 0x7fab0c15fdc0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fab04009d90 tx=0x7fab0401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29a103f76dbf53f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab09ffb640 1 -- 172.21.15.67:0/2557911258 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab040b2070 con 0x7fab0c0af3a0 2024-09-19T05:44:26.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab09ffb640 1 -- 172.21.15.67:0/2557911258 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab040a5a00 con 0x7fab0c0af3a0 2024-09-19T05:44:26.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab09ffb640 1 -- 172.21.15.67:0/2557911258 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab040a5dd0 con 0x7fab0c0af3a0 2024-09-19T05:44:26.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab114f8640 1 -- 172.21.15.67:0/2557911258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c0af3a0 msgr2=0x7fab0c15fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab114f8640 1 --2- 172.21.15.67:0/2557911258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c0af3a0 0x7fab0c15fdc0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fab04009d90 tx=0x7fab0401c940 comp rx=0 tx=0).stop 2024-09-19T05:44:26.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab114f8640 1 -- 172.21.15.67:0/2557911258 shutdown_connections 2024-09-19T05:44:26.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab114f8640 1 --2- 172.21.15.67:0/2557911258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c0af3a0 0x7fab0c15fdc0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab114f8640 1 --2- 172.21.15.67:0/2557911258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab0c159c60 0x7fab0c0ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab114f8640 1 -- 172.21.15.67:0/2557911258 >> 172.21.15.67:0/2557911258 conn(0x7fab0c0b1e50 msgr2=0x7fab0c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab114f8640 1 -- 172.21.15.67:0/2557911258 shutdown_connections 2024-09-19T05:44:26.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.780+0000 7fab114f8640 1 -- 172.21.15.67:0/2557911258 wait complete. 2024-09-19T05:44:26.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab114f8640 1 Processor -- start 2024-09-19T05:44:26.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab114f8640 1 -- start start 2024-09-19T05:44:26.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab114f8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c06ffd0 0x7fab0c0b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab114f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab0c0af3a0 0x7fab0c147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab114f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab0c159c60 0x7fab0c0997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab114f8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c168e30 con 0x7fab0c06ffd0 2024-09-19T05:44:26.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab114f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c168fb0 con 0x7fab0c159c60 2024-09-19T05:44:26.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab114f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fab0c169130 con 0x7fab0c0af3a0 2024-09-19T05:44:26.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c06ffd0 0x7fab0c0b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c06ffd0 0x7fab0c0b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57006/0 (socket says 172.21.15.67:57006) 2024-09-19T05:44:26.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0affd640 1 -- 172.21.15.67:0/1484640373 learned_addr learned my addr 172.21.15.67:0/1484640373 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab0c0af3a0 0x7fab0c147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0b7fe640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab0c159c60 0x7fab0c0997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0affd640 1 -- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab0c0af3a0 msgr2=0x7fab0c147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0affd640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab0c0af3a0 0x7fab0c147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0affd640 1 -- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab0c159c60 msgr2=0x7fab0c0997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0affd640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab0c159c60 0x7fab0c0997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0affd640 1 -- 172.21.15.67:0/1484640373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c14db00 con 0x7fab0c06ffd0 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab0affd640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c06ffd0 0x7fab0c0b0980 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7faafc00d5f0 tx=0x7faafc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7faaf37fe640 1 -- 172.21.15.67:0/1484640373 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc0125f0 con 0x7fab0c06ffd0 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7faaf37fe640 1 -- 172.21.15.67:0/1484640373 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faafc019070 con 0x7fab0c06ffd0 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7faaf37fe640 1 -- 172.21.15.67:0/1484640373 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc0129b0 con 0x7fab0c06ffd0 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab114f8640 1 -- 172.21.15.67:0/1484640373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab0c0afea0 con 0x7fab0c06ffd0 2024-09-19T05:44:26.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.784+0000 7fab114f8640 1 -- 172.21.15.67:0/1484640373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab0c0b0460 con 0x7fab0c06ffd0 2024-09-19T05:44:26.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7faaf37fe640 1 -- 172.21.15.67:0/1484640373 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faafc012b50 con 0x7fab0c06ffd0 2024-09-19T05:44:26.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7faaf37fe640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faaf80678c0 0x7faaf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7faaf37fe640 1 -- 172.21.15.67:0/1484640373 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7faafc0861d0 con 0x7fab0c06ffd0 2024-09-19T05:44:26.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faaf80678c0 0x7faaf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 Processor -- start 2024-09-19T05:44:26.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 -- start start 2024-09-19T05:44:26.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faaf80678c0 0x7faaf8069d80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fab0c166190 tx=0x7fab00007b60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b5add70 0x561e9b5ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b561870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b561db0 0x561e9b562190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561e9b44b960 con 0x561e9b561db0 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561e9b38f900 con 0x561e9b5add70 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561e9b3b2d40 con 0x561e9b5ae690 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b561db0 0x561e9b562190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b561db0 0x561e9b562190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57018/0 (socket says 172.21.15.67:57018) 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0b7fe640 1 -- 172.21.15.67:0/136719729 learned_addr learned my addr 172.21.15.67:0/136719729 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0affd640 1 --2- 172.21.15.67:0/136719729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b5add70 0x561e9b5ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/136719729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b561870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0b7fe640 1 -- 172.21.15.67:0/136719729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 msgr2=0x561e9b561870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0b7fe640 1 --2- 172.21.15.67:0/136719729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b561870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0b7fe640 1 -- 172.21.15.67:0/136719729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b5add70 msgr2=0x561e9b5ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0b7fe640 1 --2- 172.21.15.67:0/136719729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b5add70 0x561e9b5ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0b7fe640 1 -- 172.21.15.67:0/136719729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e9b359580 con 0x561e9b561db0 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0affd640 1 --2- 172.21.15.67:0/136719729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b5add70 0x561e9b5ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab0b7fe640 1 --2- 172.21.15.67:0/136719729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b561db0 0x561e9b562190 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fab0401a570 tx=0x7fab04004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520f1af6f32b8b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7faaf0ff9640 1 -- 172.21.15.67:0/136719729 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab040b2040 con 0x561e9b561db0 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7faaf0ff9640 1 -- 172.21.15.67:0/136719729 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab040a5800 con 0x561e9b561db0 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7faaf0ff9640 1 -- 172.21.15.67:0/136719729 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab040a5bf0 con 0x561e9b561db0 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 -- 172.21.15.67:0/136719729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b561db0 msgr2=0x561e9b562190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 --2- 172.21.15.67:0/136719729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b561db0 0x561e9b562190 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fab0401a570 tx=0x7fab04004ac0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 -- 172.21.15.67:0/136719729 shutdown_connections 2024-09-19T05:44:26.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 --2- 172.21.15.67:0/136719729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b561db0 0x561e9b562190 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 --2- 172.21.15.67:0/136719729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b561870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 --2- 172.21.15.67:0/136719729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b5add70 0x561e9b5ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 -- 172.21.15.67:0/136719729 >> 172.21.15.67:0/136719729 conn(0x561e9b58f040 msgr2=0x561e9b591430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 -- 172.21.15.67:0/136719729 shutdown_connections 2024-09-19T05:44:26.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.788+0000 7fab145b4000 1 -- 172.21.15.67:0/136719729 wait complete. 2024-09-19T05:44:26.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 -- start start 2024-09-19T05:44:26.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 Processor -- start 2024-09-19T05:44:26.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 0x561e9b5b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b5b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561e9b3aed00 con 0x561e9b5add70 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561e9b36daa0 con 0x561e9b561db0 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561e9b34c340 con 0x561e9b5ae690 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 10 client.0 _ll_register_callbacks cb 0x561e9b54f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57026/0 (socket says 172.21.15.67:57026) 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0a7fc640 1 -- 172.21.15.67:0/2894444383 learned_addr learned my addr 172.21.15.67:0/2894444383 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0b7fe640 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b5b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0affd640 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 0x561e9b5b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0a7fc640 1 -- 172.21.15.67:0/2894444383 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 msgr2=0x561e9b5b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b5b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0a7fc640 1 -- 172.21.15.67:0/2894444383 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 msgr2=0x561e9b5b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 0x561e9b5b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0a7fc640 1 -- 172.21.15.67:0/2894444383 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e9b355dc0 con 0x561e9b5add70 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5b5220 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0adba0 tx=0x7fab00011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1ae78a18454bab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7faae9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7faae9ffb640 1 -- 172.21.15.67:0/2894444383 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00027060 con 0x561e9b5add70 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7faae9ffb640 1 -- 172.21.15.67:0/2894444383 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fab00010040 con 0x561e9b5add70 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 -- 172.21.15.67:0/2894444383 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab040a5800 con 0x561e9b5add70 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7faae9ffb640 1 -- 172.21.15.67:0/2894444383 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fab00015110 con 0x561e9b5add70 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 10 client.8859 fetch_fsmap learned FSMap version 98 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 -- 172.21.15.67:0/2894444383 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x561e9b3527f0 con 0x561e9b5add70 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7faae9ffb640 1 -- 172.21.15.67:0/2894444383 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab040a5800 con 0x561e9b5add70 2024-09-19T05:44:26.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7faae9ffb640 1 -- 172.21.15.67:0/2894444383 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7fab00013420 con 0x561e9b5add70 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 10 client.8859 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 10 client.8859 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 20 client.8859 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x561e9b5bd0b0 0x561e9b5bf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 4 client.8859 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 -- 172.21.15.67:0/2894444383 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e9b34ce10 con 0x561e9b5bd0b0 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0affd640 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x561e9b5bd0b0 0x561e9b5bf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab0affd640 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x561e9b5bd0b0 0x561e9b5bf4a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbce1229fce0b37 server_cookie=b58dc04d84640652 in_seq=0 out_seq=0 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7faae9ffb640 10 client.8859 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7faae9ffb640 1 -- 172.21.15.67:0/2894444383 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e9b34ce10 con 0x561e9b5bd0b0 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7faae9ffb640 10 client.8859 handle_command_reply: tid=0 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 client.8859 shutdown 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 -- 172.21.15.67:0/2894444383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 msgr2=0x561e9b5b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5b5220 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0adba0 tx=0x7fab00011000 comp rx=0 tx=0).stop 2024-09-19T05:44:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 -- 172.21.15.67:0/2894444383 shutdown_connections 2024-09-19T05:44:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.792+0000 7fab145b4000 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x561e9b5bd0b0 0x561e9b5bf4a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.796+0000 7fab145b4000 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b5b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.796+0000 7faae9ffb640 0 client.8859 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.796+0000 7fab145b4000 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5b5220 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.796+0000 7fab145b4000 1 --2- 172.21.15.67:0/2894444383 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 0x561e9b5b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.796+0000 7fab145b4000 1 -- 172.21.15.67:0/2894444383 >> 172.21.15.67:0/2894444383 conn(0x561e9b58f040 msgr2=0x561e9b560f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.796+0000 7fab145b4000 1 -- 172.21.15.67:0/2894444383 shutdown_connections 2024-09-19T05:44:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.796+0000 7fab145b4000 1 -- 172.21.15.67:0/2894444383 wait complete. 2024-09-19T05:44:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.796+0000 7fab145b4000 20 client.8859 trim_cache size 0 max 16384 2024-09-19T05:44:26.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab145b4000 1 Processor -- start 2024-09-19T05:44:26.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab145b4000 1 -- start start 2024-09-19T05:44:26.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab145b4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 0x561e9b5bb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab145b4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5bb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab145b4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b569d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab145b4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c201f90 con 0x561e9b5add70 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab145b4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c200fd0 con 0x561e9b561db0 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab145b4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fab0c098750 con 0x561e9b5ae690 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5bb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5bb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57040/0 (socket says 172.21.15.67:57040) 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0a7fc640 1 -- 172.21.15.67:0/650863437 learned_addr learned my addr 172.21.15.67:0/650863437 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0a7fc640 1 -- 172.21.15.67:0/650863437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 msgr2=0x561e9b569d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0affd640 1 --2- 172.21.15.67:0/650863437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 0x561e9b5bb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0b7fe640 1 --2- 172.21.15.67:0/650863437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b569d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/650863437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b569d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0a7fc640 1 -- 172.21.15.67:0/650863437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 msgr2=0x561e9b5bb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/650863437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 0x561e9b5bb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0a7fc640 1 -- 172.21.15.67:0/650863437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e9b370470 con 0x561e9b5add70 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0affd640 1 --2- 172.21.15.67:0/650863437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 0x561e9b5bb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/650863437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5bb720 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fab00007ee0 tx=0x7fab00013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7086fc399ca48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7faaebfff640 1 -- 172.21.15.67:0/650863437 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00015ca0 con 0x561e9b5add70 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7faaebfff640 1 -- 172.21.15.67:0/650863437 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab00013420 con 0x561e9b5add70 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7faaebfff640 1 -- 172.21.15.67:0/650863437 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00013970 con 0x561e9b5add70 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab145b4000 1 -- 172.21.15.67:0/650863437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 msgr2=0x561e9b5bb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.812+0000 7fab145b4000 1 --2- 172.21.15.67:0/650863437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5bb720 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fab00007ee0 tx=0x7fab00013000 comp rx=0 tx=0).stop 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/650863437 shutdown_connections 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- 172.21.15.67:0/650863437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b5ae690 0x561e9b569d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- 172.21.15.67:0/650863437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5bb720 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- 172.21.15.67:0/650863437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b561db0 0x561e9b5bb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/650863437 >> 172.21.15.67:0/650863437 conn(0x561e9b58f040 msgr2=0x561e9b5baad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/650863437 shutdown_connections 2024-09-19T05:44:26.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/650863437 wait complete. 2024-09-19T05:44:26.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- start start 2024-09-19T05:44:26.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 Processor -- start 2024-09-19T05:44:26.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b561db0 0x561e9b5e0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5e1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b5ae690 0x561e9b6267e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c098da0 con 0x561e9b5add70 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561e9b37a400 con 0x561e9b5ae690 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561e9b46f0c0 con 0x561e9b561db0 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 10 client.0 _ll_register_callbacks cb 0x7fab00001910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5e1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57042/0 (socket says 172.21.15.67:57042) 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0a7fc640 1 -- 172.21.15.67:0/946776583 learned_addr learned my addr 172.21.15.67:0/946776583 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0a7fc640 1 -- 172.21.15.67:0/946776583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b561db0 msgr2=0x561e9b5e0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b561db0 0x561e9b5e0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0a7fc640 1 -- 172.21.15.67:0/946776583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b5ae690 msgr2=0x561e9b6267e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b5ae690 0x561e9b6267e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0a7fc640 1 -- 172.21.15.67:0/946776583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e9b346640 con 0x561e9b5add70 2024-09-19T05:44:26.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0a7fc640 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5e1430 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fab00001780 tx=0x7fab00000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c3ce5e1d3571cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7faae9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:26.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7faae9ffb640 1 -- 172.21.15.67:0/946776583 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00015ca0 con 0x561e9b5add70 2024-09-19T05:44:26.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/946776583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab00013420 con 0x561e9b5add70 2024-09-19T05:44:26.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7faae9ffb640 1 -- 172.21.15.67:0/946776583 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fab00032040 con 0x561e9b5add70 2024-09-19T05:44:26.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7faae9ffb640 1 -- 172.21.15.67:0/946776583 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fab00043050 con 0x561e9b5add70 2024-09-19T05:44:26.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 10 client.8865 fetch_fsmap learned FSMap version 98 2024-09-19T05:44:26.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/946776583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x561e9b34a3b0 con 0x561e9b5add70 2024-09-19T05:44:26.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7faae9ffb640 1 -- 172.21.15.67:0/946776583 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab00013420 con 0x561e9b5add70 2024-09-19T05:44:26.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7faae9ffb640 1 -- 172.21.15.67:0/946776583 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7fab00046020 con 0x561e9b5add70 2024-09-19T05:44:26.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 10 client.8865 fetch_fsmap finished waiting for FSMap version 98 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 10 client.8865 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 20 client.8865 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x561e9b626d20 0x561e9b627130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 4 client.8865 mds_command: new command op to 8514 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/946776583 --> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561e9b3c0470 con 0x561e9b626d20 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0affd640 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x561e9b626d20 0x561e9b627130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7faae9ffb640 10 client.8865 ms_handle_connect on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab0affd640 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x561e9b626d20 0x561e9b627130 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c4ba17601a47e6 server_cookie=dcc93e94cd35c908 in_seq=0 out_seq=0 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7faae9ffb640 1 -- 172.21.15.67:0/946776583 <== mds.0 v2:172.21.15.67:6834/4202714855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561e9b3c0470 con 0x561e9b626d20 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7faae9ffb640 10 client.8865 handle_command_reply: tid=0 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 client.8865 shutdown 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/946776583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 msgr2=0x561e9b5e1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5e1430 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fab00001780 tx=0x7fab00000ee0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/946776583 shutdown_connections 2024-09-19T05:44:26.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.67:6834/4202714855,v1:172.21.15.67:6835/4202714855] conn(0x561e9b626d20 0x561e9b627130 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e9b5ae690 0x561e9b6267e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e9b5add70 0x561e9b5e1430 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 --2- 172.21.15.67:0/946776583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561e9b561db0 0x561e9b5e0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7faae9ffb640 0 client.8865 ms_handle_reset on v2:172.21.15.67:6834/4202714855 2024-09-19T05:44:26.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/946776583 >> 172.21.15.67:0/946776583 conn(0x561e9b58f040 msgr2=0x561e9b5bb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/946776583 shutdown_connections 2024-09-19T05:44:26.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 1 -- 172.21.15.67:0/946776583 wait complete. 2024-09-19T05:44:26.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.816+0000 7fab145b4000 20 client.8865 trim_cache size 0 max 16384 2024-09-19T05:44:26.827 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:44:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-19T05:44:26.828 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {} 2024-09-19T05:44:26.828 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:44:26.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 -- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faaf80678c0 msgr2=0x7faaf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faaf80678c0 0x7faaf8069d80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fab0c166190 tx=0x7fab00007b60 comp rx=0 tx=0).stop 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 -- 172.21.15.67:0/1484640373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c06ffd0 msgr2=0x7fab0c0b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c06ffd0 0x7fab0c0b0980 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7faafc00d5f0 tx=0x7faafc00dab0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 -- 172.21.15.67:0/1484640373 shutdown_connections 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab0c159c60 0x7fab0c0997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faaf80678c0 0x7faaf8069d80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab0c0af3a0 0x7fab0c147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 --2- 172.21.15.67:0/1484640373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab0c06ffd0 0x7fab0c0b0980 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 -- 172.21.15.67:0/1484640373 >> 172.21.15.67:0/1484640373 conn(0x7fab0c0b1e50 msgr2=0x7fab0c14fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 -- 172.21.15.67:0/1484640373 shutdown_connections 2024-09-19T05:44:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.820+0000 7fab114f8640 1 -- 172.21.15.67:0/1484640373 wait complete. 2024-09-19T05:44:26.833 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:26.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.944+0000 7f25592e2640 1 Processor -- start 2024-09-19T05:44:26.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.944+0000 7f25592e2640 1 -- start start 2024-09-19T05:44:26.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25592e2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f255415c030 0x7f255406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25592e2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f255415d1d0 0x7f25540b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25592e2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f25540b3510 0x7f255406f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25592e2640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f255406e3c0 con 0x7f255415d1d0 2024-09-19T05:44:26.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25592e2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f255406e6a0 con 0x7f25540b3510 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25592e2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f255406e980 con 0x7f255415c030 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25527fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f255415d1d0 0x7f25540b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25527fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f255415d1d0 0x7f25540b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57058/0 (socket says 172.21.15.67:57058) 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25527fc640 1 -- 172.21.15.67:0/2206688662 learned_addr learned my addr 172.21.15.67:0/2206688662 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f2552ffd640 1 --2- 172.21.15.67:0/2206688662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f255415c030 0x7f255406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25537fe640 1 --2- 172.21.15.67:0/2206688662 >> v2:172.21.15.97:3300/0 conn(0x7f25540b3510 0x7f255406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25527fc640 1 -- 172.21.15.67:0/2206688662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f255415c030 msgr2=0x7f255406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25527fc640 1 --2- 172.21.15.67:0/2206688662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f255415c030 0x7f255406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25527fc640 1 -- 172.21.15.67:0/2206688662 >> v2:172.21.15.97:3300/0 conn(0x7f25540b3510 msgr2=0x7f255406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25527fc640 1 --2- 172.21.15.67:0/2206688662 >> v2:172.21.15.97:3300/0 conn(0x7f25540b3510 0x7f255406f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25527fc640 1 -- 172.21.15.67:0/2206688662 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255406ec60 con 0x7f255415d1d0 2024-09-19T05:44:26.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25537fe640 1 --2- 172.21.15.67:0/2206688662 >> v2:172.21.15.97:3300/0 conn(0x7f25540b3510 0x7f255406f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:26.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f25527fc640 1 --2- 172.21.15.67:0/2206688662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415d1d0 0x7f25540b2fd0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f25540d0c30 tx=0x7f254401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa607ed6a0f9fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.948+0000 7f2551ffb640 1 -- 172.21.15.67:0/2206688662 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440b1070 con 0x7f255415d1d0 2024-09-19T05:44:26.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f2551ffb640 1 -- 172.21.15.67:0/2206688662 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25440ac620 con 0x7f255415d1d0 2024-09-19T05:44:26.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f2551ffb640 1 -- 172.21.15.67:0/2206688662 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440ac9f0 con 0x7f255415d1d0 2024-09-19T05:44:26.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- 172.21.15.67:0/2206688662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415d1d0 msgr2=0x7f25540b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 --2- 172.21.15.67:0/2206688662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415d1d0 0x7f25540b2fd0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f25540d0c30 tx=0x7f254401c4f0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- 172.21.15.67:0/2206688662 shutdown_connections 2024-09-19T05:44:26.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 --2- 172.21.15.67:0/2206688662 >> v2:172.21.15.97:3300/0 conn(0x7f25540b3510 0x7f255406f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 --2- 172.21.15.67:0/2206688662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415d1d0 0x7f25540b2fd0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 --2- 172.21.15.67:0/2206688662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f255415c030 0x7f255406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- 172.21.15.67:0/2206688662 >> 172.21.15.67:0/2206688662 conn(0x7f25540d0080 msgr2=0x7f25540d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:26.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- 172.21.15.67:0/2206688662 shutdown_connections 2024-09-19T05:44:26.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- 172.21.15.67:0/2206688662 wait complete. 2024-09-19T05:44:26.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 Processor -- start 2024-09-19T05:44:26.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- start start 2024-09-19T05:44:26.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25540b3510 0x7f255409caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415c030 0x7f25541f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f255415d1d0 0x7f25541f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f255415fd40 con 0x7f255415c030 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f255415c620 con 0x7f25540b3510 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f255415fec0 con 0x7f255415d1d0 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25527fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415c030 0x7f25541f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25527fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415c030 0x7f25541f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57072/0 (socket says 172.21.15.67:57072) 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25527fc640 1 -- 172.21.15.67:0/264093750 learned_addr learned my addr 172.21.15.67:0/264093750 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25527fc640 1 -- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f255415d1d0 msgr2=0x7f25541f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25527fc640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f255415d1d0 0x7f25541f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25527fc640 1 -- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25540b3510 msgr2=0x7f255409caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f2552ffd640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25540b3510 0x7f255409caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25527fc640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25540b3510 0x7f255409caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25527fc640 1 -- 172.21.15.67:0/264093750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25541f94f0 con 0x7f255415c030 2024-09-19T05:44:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f2552ffd640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25540b3510 0x7f255409caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25527fc640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415c030 0x7f25541f8b10 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f25440af040 tx=0x7f2544019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f254b7fe640 1 -- 172.21.15.67:0/264093750 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440bb020 con 0x7f255415c030 2024-09-19T05:44:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f254b7fe640 1 -- 172.21.15.67:0/264093750 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25440b7640 con 0x7f255415c030 2024-09-19T05:44:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- 172.21.15.67:0/264093750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25541f97d0 con 0x7f255415c030 2024-09-19T05:44:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f254b7fe640 1 -- 172.21.15.67:0/264093750 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440b1040 con 0x7f255415c030 2024-09-19T05:44:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.952+0000 7f25592e2640 1 -- 172.21.15.67:0/264093750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255409cfe0 con 0x7f255415c030 2024-09-19T05:44:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.956+0000 7f25592e2640 1 -- 172.21.15.67:0/264093750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f255406dde0 con 0x7f255415c030 2024-09-19T05:44:26.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.956+0000 7f254b7fe640 1 -- 172.21.15.67:0/264093750 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f25440be020 con 0x7f255415c030 2024-09-19T05:44:26.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.956+0000 7f254b7fe640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f25340678f0 0x7f2534069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:26.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.956+0000 7f254b7fe640 1 -- 172.21.15.67:0/264093750 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f25441200f0 con 0x7f255415c030 2024-09-19T05:44:26.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.956+0000 7f2552ffd640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f25340678f0 0x7f2534069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:26.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.956+0000 7f2552ffd640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f25340678f0 0x7f2534069db0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f25541f8a70 tx=0x7f253c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:26.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:26.960+0000 7f254b7fe640 1 -- 172.21.15.67:0/264093750 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f25440c5030 con 0x7f255415c030 2024-09-19T05:44:27.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.156+0000 7f25592e2640 1 -- 172.21.15.67:0/264093750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25541f99a0 con 0x7f255415c030 2024-09-19T05:44:27.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.156+0000 7f254b7fe640 1 -- 172.21.15.67:0/264093750 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f2544016110 con 0x7f255415c030 2024-09-19T05:44:27.158 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:27.158 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:27.158 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:27.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 -- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f25340678f0 msgr2=0x7f2534069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f25340678f0 0x7f2534069db0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f25541f8a70 tx=0x7f253c008040 comp rx=0 tx=0).stop 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 -- 172.21.15.67:0/264093750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415c030 msgr2=0x7f25541f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415c030 0x7f25541f8b10 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f25440af040 tx=0x7f2544019290 comp rx=0 tx=0).stop 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 -- 172.21.15.67:0/264093750 shutdown_connections 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f25340678f0 0x7f2534069db0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f255415d1d0 0x7f25541f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255415c030 0x7f25541f8b10 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 --2- 172.21.15.67:0/264093750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25540b3510 0x7f255409caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 -- 172.21.15.67:0/264093750 >> 172.21.15.67:0/264093750 conn(0x7f25540d0080 msgr2=0x7f25540d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 -- 172.21.15.67:0/264093750 shutdown_connections 2024-09-19T05:44:27.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.160+0000 7f25592e2640 1 -- 172.21.15.67:0/264093750 wait complete. 2024-09-19T05:44:27.175 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-19T05:44:27.176 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:44:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.284+0000 7f0c03b1c640 1 Processor -- start 2024-09-19T05:44:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.284+0000 7f0c03b1c640 1 -- start start 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c03b1c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bfc15c200 0x7f0bfc071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c03b1c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bfc0b3070 con 0x7f0bfc15b710 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c03b1c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bfc0b32e0 con 0x7f0bfc0aef40 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c03b1c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0bfc0afaa0 con 0x7f0bfc15c200 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c018b8640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0bfc15b710 0x7f0bfc15baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37062/0 (socket says 172.21.15.67:37062) 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c018b8640 1 -- 172.21.15.67:0/2713763073 learned_addr learned my addr 172.21.15.67:0/2713763073 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3456277958 0 0) 0x7f0bfc0b3070 con 0x7f0bfc15b710 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c010b7640 1 --2- 172.21.15.67:0/2713763073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bfc15c200 0x7f0bfc071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0be8003530 con 0x7f0bfc15b710 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1168911952 0 0) 0x7f0be8003530 con 0x7f0bfc15b710 2024-09-19T05:44:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bfc15c200 msgr2=0x7f0bfc071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 --2- 172.21.15.67:0/2713763073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bfc15c200 0x7f0bfc071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 >> v1:172.21.15.97:6789/0 conn(0x7f0bfc0aef40 legacy=0x7f0bfc0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc0b35c0 con 0x7f0bfc15b710 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f0bf8001680 con 0x7f0bfc15b710 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 >> v1:172.21.15.67:6789/0 conn(0x7f0bfc15b710 legacy=0x7f0bfc15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 --2- 172.21.15.67:0/2713763073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0be80039f0 0x7f0be8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 --2- 172.21.15.67:0/2713763073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bfc15c200 0x7f0be8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 --2- 172.21.15.67:0/2713763073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0be8004d50 0x7f0be80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc0afaa0 con 0x7f0be80039f0 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0be800bab0 con 0x7f0be8004d50 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0be800bcb0 con 0x7f0bfc15c200 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c018b8640 1 --2- 172.21.15.67:0/2713763073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0be80039f0 0x7f0be8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c018b8640 1 -- 172.21.15.67:0/2713763073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bfc15c200 msgr2=0x7f0be8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c018b8640 1 --2- 172.21.15.67:0/2713763073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bfc15c200 0x7f0be8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c018b8640 1 -- 172.21.15.67:0/2713763073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0be8004d50 msgr2=0x7f0be80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c018b8640 1 --2- 172.21.15.67:0/2713763073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0be8004d50 0x7f0be80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c018b8640 1 -- 172.21.15.67:0/2713763073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be8003530 con 0x7f0be80039f0 2024-09-19T05:44:27.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c018b8640 1 --2- 172.21.15.67:0/2713763073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0be80039f0 0x7f0be8003e10 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800c190 tx=0x7f0bf801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc289ab32aefc9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:27.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8007d00 con 0x7f0be80039f0 2024-09-19T05:44:27.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf80a9020 con 0x7f0be80039f0 2024-09-19T05:44:27.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.288+0000 7f0c008b6640 1 -- 172.21.15.67:0/2713763073 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8005b00 con 0x7f0be80039f0 2024-09-19T05:44:27.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- 172.21.15.67:0/2713763073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0be80039f0 msgr2=0x7f0be8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:27.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 --2- 172.21.15.67:0/2713763073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0be80039f0 0x7f0be8003e10 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800c190 tx=0x7f0bf801cc10 comp rx=0 tx=0).stop 2024-09-19T05:44:27.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c020b9640 1 -- 172.21.15.67:0/2713763073 reap_dead start 2024-09-19T05:44:27.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- 172.21.15.67:0/2713763073 shutdown_connections 2024-09-19T05:44:27.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- 172.21.15.67:0/2713763073 >> 172.21.15.67:0/2713763073 conn(0x7f0bfc0d0080 msgr2=0x7f0bfc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:27.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- 172.21.15.67:0/2713763073 shutdown_connections 2024-09-19T05:44:27.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- 172.21.15.67:0/2713763073 wait complete. 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 Processor -- start 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- start start 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0be80039f0 0x7f0bfc155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bfc09bd50 0x7f0bfc09d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bfc09d830 0x7f0bfc148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc0b4c40 con 0x7f0bfc09bd50 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc0b4ac0 con 0x7f0bfc09d830 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0bfc0b4dc0 con 0x7f0be80039f0 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c010b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bfc09bd50 0x7f0bfc09d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c010b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bfc09bd50 0x7f0bfc09d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57078/0 (socket says 172.21.15.67:57078) 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c010b7640 1 -- 172.21.15.67:0/4012213526 learned_addr learned my addr 172.21.15.67:0/4012213526 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:27.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c018b8640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0be80039f0 0x7f0bfc155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c020b9640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bfc09d830 0x7f0bfc148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c010b7640 1 -- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0be80039f0 msgr2=0x7f0bfc155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c010b7640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0be80039f0 0x7f0bfc155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c010b7640 1 -- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bfc09d830 msgr2=0x7f0bfc148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c010b7640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bfc09d830 0x7f0bfc148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c010b7640 1 -- 172.21.15.67:0/4012213526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc09c250 con 0x7f0bfc09bd50 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c020b9640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bfc09d830 0x7f0bfc148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c018b8640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0be80039f0 0x7f0bfc155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c010b7640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bfc09bd50 0x7f0bfc09d2f0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00e850 tx=0x7f0bec00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0bf27fc640 1 -- 172.21.15.67:0/4012213526 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec017070 con 0x7f0bfc09bd50 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0bf27fc640 1 -- 172.21.15.67:0/4012213526 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bec00c940 con 0x7f0bfc09bd50 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- 172.21.15.67:0/4012213526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bfc09c530 con 0x7f0bfc09bd50 2024-09-19T05:44:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0bf27fc640 1 -- 172.21.15.67:0/4012213526 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec00cd30 con 0x7f0bfc09bd50 2024-09-19T05:44:27.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- 172.21.15.67:0/4012213526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bfc09caf0 con 0x7f0bfc09bd50 2024-09-19T05:44:27.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.292+0000 7f0c03b1c640 1 -- 172.21.15.67:0/4012213526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bfc0af390 con 0x7f0bfc09bd50 2024-09-19T05:44:27.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.296+0000 7f0bf27fc640 1 -- 172.21.15.67:0/4012213526 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0bec01a070 con 0x7f0bfc09bd50 2024-09-19T05:44:27.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.296+0000 7f0bf27fc640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0be00678f0 0x7f0be0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:27.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.296+0000 7f0bf27fc640 1 -- 172.21.15.67:0/4012213526 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f0bec085c20 con 0x7f0bfc09bd50 2024-09-19T05:44:27.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.296+0000 7f0c018b8640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0be00678f0 0x7f0be0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:27.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.296+0000 7f0c018b8640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0be00678f0 0x7f0be0069db0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80aa000 tx=0x7f0bfc15b6a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:27.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.300+0000 7f0bf27fc640 1 -- 172.21.15.67:0/4012213526 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0bec056540 con 0x7f0bfc09bd50 2024-09-19T05:44:27.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.516+0000 7f0c03b1c640 1 -- 172.21.15.67:0/4012213526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0bfc0b5020 con 0x7f0bfc09bd50 2024-09-19T05:44:27.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.516+0000 7f0bf27fc640 1 -- 172.21.15.67:0/4012213526 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7f0bec055e40 con 0x7f0bfc09bd50 2024-09-19T05:44:27.517 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:27.517 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":697,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077791312,"bytes_used":2686918656,"bytes_avail":770407194624,"bytes_total":773094113280,"write_bytes_sec":26920728,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8514}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-09-19T05:44:25.344276+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:44:27.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 -- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0be00678f0 msgr2=0x7f0be0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:27.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0be00678f0 0x7f0be0069db0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80aa000 tx=0x7f0bfc15b6a0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 -- 172.21.15.67:0/4012213526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bfc09bd50 msgr2=0x7f0bfc09d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:27.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bfc09bd50 0x7f0bfc09d2f0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00e850 tx=0x7f0bec00ed10 comp rx=0 tx=0).stop 2024-09-19T05:44:27.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 -- 172.21.15.67:0/4012213526 shutdown_connections 2024-09-19T05:44:27.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bfc09d830 0x7f0bfc148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bfc09bd50 0x7f0bfc09d2f0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0be00678f0 0x7f0be0069db0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 --2- 172.21.15.67:0/4012213526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0be80039f0 0x7f0bfc155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:27.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 -- 172.21.15.67:0/4012213526 >> 172.21.15.67:0/4012213526 conn(0x7f0bfc0d0080 msgr2=0x7f0bfc14c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:27.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 -- 172.21.15.67:0/4012213526 shutdown_connections 2024-09-19T05:44:27.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:27.520+0000 7f0c03b1c640 1 -- 172.21.15.67:0/4012213526 wait complete. 2024-09-19T05:44:27.534 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-19T05:44:28.535 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfc43a640 1 Processor -- start 2024-09-19T05:44:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfc43a640 1 -- start start 2024-09-19T05:44:28.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfc43a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf415a920 0x7f2bf4072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:28.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfc43a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf40730e0 con 0x7f2bf406ed80 2024-09-19T05:44:28.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfc43a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf40733c0 con 0x7f2bf40af730 2024-09-19T05:44:28.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfc43a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf40ad8c0 con 0x7f2bf415a920 2024-09-19T05:44:28.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfa9d7640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2bf406ed80 0x7f2bf40ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37078/0 (socket says 172.21.15.67:37078) 2024-09-19T05:44:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfa9d7640 1 -- 172.21.15.67:0/3308307655 learned_addr learned my addr 172.21.15.67:0/3308307655 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfa1d6640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf415a920 0x7f2bf4072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792242798 0 0) 0x7f2bf40730e0 con 0x7f2bf406ed80 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2be0004640 con 0x7f2bf406ed80 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4013699535 0 0) 0x7f2be0004640 con 0x7f2bf406ed80 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf415a920 msgr2=0x7f2bf4072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf415a920 0x7f2bf4072840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 >> v1:172.21.15.97:6789/0 conn(0x7f2bf40af730 legacy=0x7f2bf406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf40adba0 con 0x7f2bf406ed80 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f2bec001a00 con 0x7f2bf406ed80 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 >> v1:172.21.15.67:6789/0 conn(0x7f2bf406ed80 legacy=0x7f2bf40ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2be0004b00 0x7f2be0004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:28.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf415a920 0x7f2be0005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2be0005e60 0x7f2be00062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf40ad8c0 con 0x7f2be0005e60 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2be000cb90 con 0x7f2be0004b00 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2be00034d0 con 0x7f2bf415a920 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfa9d7640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2be0005e60 0x7f2be00062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfa1d6640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2be0004b00 0x7f2be0004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bf99d5640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf415a920 0x7f2be0005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfa9d7640 1 -- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf415a920 msgr2=0x7f2be0005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfa9d7640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf415a920 0x7f2be0005920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfa9d7640 1 -- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2be0004b00 msgr2=0x7f2be0004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfa9d7640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2be0004b00 0x7f2be0004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.672+0000 7f2bfa9d7640 1 -- 172.21.15.67:0/3308307655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be0004640 con 0x7f2be0005e60 2024-09-19T05:44:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bfa9d7640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2be0005e60 0x7f2be00062e0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40cc210 tx=0x7f2bec01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab78bff45b3aa6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00a480 con 0x7f2be0005e60 2024-09-19T05:44:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec0ad630 con 0x7f2be0005e60 2024-09-19T05:44:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bf91d4640 1 -- 172.21.15.67:0/3308307655 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0ada60 con 0x7f2be0005e60 2024-09-19T05:44:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bfc43a640 1 -- 172.21.15.67:0/3308307655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2be0005e60 msgr2=0x7f2be00062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bfc43a640 1 --2- 172.21.15.67:0/3308307655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2be0005e60 0x7f2be00062e0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40cc210 tx=0x7f2bec01d300 comp rx=0 tx=0).stop 2024-09-19T05:44:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bfa9d7640 1 -- 172.21.15.67:0/3308307655 reap_dead start 2024-09-19T05:44:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bfc43a640 1 -- 172.21.15.67:0/3308307655 shutdown_connections 2024-09-19T05:44:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bfc43a640 1 -- 172.21.15.67:0/3308307655 >> 172.21.15.67:0/3308307655 conn(0x7f2bf40d0080 msgr2=0x7f2bf40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bfc43a640 1 -- 172.21.15.67:0/3308307655 shutdown_connections 2024-09-19T05:44:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bfc43a640 1 -- 172.21.15.67:0/3308307655 wait complete. 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bfc43a640 1 Processor -- start 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.676+0000 7f2bfc43a640 1 -- start start 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfc43a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf41ef850 0x7f2bf40ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfc43a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf41efc30 0x7f2bf40cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfc43a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf414f270 0x7f2bf40ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfc43a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf415ad00 con 0x7f2bf414f270 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfc43a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4072840 con 0x7f2bf41efc30 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfc43a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf414bd10 con 0x7f2bf41ef850 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa9d7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf414f270 0x7f2bf40ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa9d7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf414f270 0x7f2bf40ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57106/0 (socket says 172.21.15.67:57106) 2024-09-19T05:44:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa9d7640 1 -- 172.21.15.67:0/568892657 learned_addr learned my addr 172.21.15.67:0/568892657 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bf99d5640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf41efc30 0x7f2bf40cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa1d6640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf41ef850 0x7f2bf40ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa9d7640 1 -- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf41ef850 msgr2=0x7f2bf40ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa9d7640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf41ef850 0x7f2bf40ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa9d7640 1 -- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf41efc30 msgr2=0x7f2bf40cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa9d7640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf41efc30 0x7f2bf40cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa9d7640 1 -- 172.21.15.67:0/568892657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf415bbc0 con 0x7f2bf414f270 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bf99d5640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf41efc30 0x7f2bf40cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa9d7640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf414f270 0x7f2bf40ccc30 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f2bec01d130 tx=0x7f2be0006950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2beaffd640 1 -- 172.21.15.67:0/568892657 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00a480 con 0x7f2bf414f270 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2beaffd640 1 -- 172.21.15.67:0/568892657 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec0bb070 con 0x7f2bf414f270 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2beaffd640 1 -- 172.21.15.67:0/568892657 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0017c0 con 0x7f2bf414f270 2024-09-19T05:44:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfc43a640 1 -- 172.21.15.67:0/568892657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf415bea0 con 0x7f2bf414f270 2024-09-19T05:44:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfc43a640 1 -- 172.21.15.67:0/568892657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf415c460 con 0x7f2bf414f270 2024-09-19T05:44:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfc43a640 1 -- 172.21.15.67:0/568892657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf415c660 con 0x7f2bf414f270 2024-09-19T05:44:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2beaffd640 1 -- 172.21.15.67:0/568892657 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2bec0ad630 con 0x7f2bf414f270 2024-09-19T05:44:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2beaffd640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bd80678f0 0x7f2bd8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2beaffd640 1 -- 172.21.15.67:0/568892657 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f2bec1204f0 con 0x7f2bf414f270 2024-09-19T05:44:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.680+0000 7f2bfa1d6640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bd80678f0 0x7f2bd8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.684+0000 7f2bfa1d6640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bd80678f0 0x7f2bd8069db0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009b20 tx=0x7f2bf0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.684+0000 7f2beaffd640 1 -- 172.21.15.67:0/568892657 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2bf415c660 con 0x7f2bf414f270 2024-09-19T05:44:28.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.884+0000 7f2bfc43a640 1 -- 172.21.15.67:0/568892657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bf4072c80 con 0x7f2bf414f270 2024-09-19T05:44:28.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2beaffd640 1 -- 172.21.15.67:0/568892657 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f2bec017010 con 0x7f2bf414f270 2024-09-19T05:44:28.886 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:28.886 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 -- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bd80678f0 msgr2=0x7f2bd8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bd80678f0 0x7f2bd8069db0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009b20 tx=0x7f2bf0008040 comp rx=0 tx=0).stop 2024-09-19T05:44:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 -- 172.21.15.67:0/568892657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf414f270 msgr2=0x7f2bf40ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf414f270 0x7f2bf40ccc30 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f2bec01d130 tx=0x7f2be0006950 comp rx=0 tx=0).stop 2024-09-19T05:44:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 -- 172.21.15.67:0/568892657 shutdown_connections 2024-09-19T05:44:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bf414f270 0x7f2bf40ccc30 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf41efc30 0x7f2bf40cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2bd80678f0 0x7f2bd8069db0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 --2- 172.21.15.67:0/568892657 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bf41ef850 0x7f2bf40ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 -- 172.21.15.67:0/568892657 >> 172.21.15.67:0/568892657 conn(0x7f2bf40d0080 msgr2=0x7f2bf415e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:28.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 -- 172.21.15.67:0/568892657 shutdown_connections 2024-09-19T05:44:28.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:28.888+0000 7f2bfc43a640 1 -- 172.21.15.67:0/568892657 wait complete. 2024-09-19T05:44:28.905 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-19T05:44:28.906 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:44:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.020+0000 7fc3452ec640 1 Processor -- start 2024-09-19T05:44:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.020+0000 7fc3452ec640 1 -- start start 2024-09-19T05:44:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc340161da0 0x7fc3400d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3400d05d0 con 0x7fc3400d0160 2024-09-19T05:44:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3400d4d40 con 0x7fc3400d0e80 2024-09-19T05:44:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc3400d0840 con 0x7fc340161da0 2024-09-19T05:44:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33effd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc340161da0 0x7fc3400d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33effd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc340161da0 0x7fc3400d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57112/0 (socket says 172.21.15.67:57112) 2024-09-19T05:44:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33f7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc3400d0160 0x7fc3400b48d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37084/0 (socket says 172.21.15.67:37084) 2024-09-19T05:44:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33effd640 1 -- 172.21.15.67:0/4285558885 learned_addr learned my addr 172.21.15.67:0/4285558885 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33dffb640 1 -- 172.21.15.67:0/4285558885 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753182543 0 0) 0x7fc3400d05d0 con 0x7fc3400d0160 2024-09-19T05:44:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33dffb640 1 -- 172.21.15.67:0/4285558885 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc328003530 con 0x7fc3400d0160 2024-09-19T05:44:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33effd640 1 -- 172.21.15.67:0/4285558885 >> v1:172.21.15.97:6789/0 conn(0x7fc3400d0e80 legacy=0x7fc3400b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33effd640 1 -- 172.21.15.67:0/4285558885 >> v1:172.21.15.67:6789/0 conn(0x7fc3400d0160 legacy=0x7fc3400b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33effd640 1 -- 172.21.15.67:0/4285558885 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3400d5020 con 0x7fc340161da0 2024-09-19T05:44:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33effd640 1 --2- 172.21.15.67:0/4285558885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc340161da0 0x7fc3400d1af0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fc330009870 tx=0x7fc33001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49779986f023c7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33dffb640 1 -- 172.21.15.67:0/4285558885 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3300ab650 con 0x7fc340161da0 2024-09-19T05:44:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33dffb640 1 -- 172.21.15.67:0/4285558885 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3300b0070 con 0x7fc340161da0 2024-09-19T05:44:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc33dffb640 1 -- 172.21.15.67:0/4285558885 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3300aba10 con 0x7fc340161da0 2024-09-19T05:44:29.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 -- 172.21.15.67:0/4285558885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc340161da0 msgr2=0x7fc3400d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:29.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 --2- 172.21.15.67:0/4285558885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc340161da0 0x7fc3400d1af0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fc330009870 tx=0x7fc33001c560 comp rx=0 tx=0).stop 2024-09-19T05:44:29.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 -- 172.21.15.67:0/4285558885 shutdown_connections 2024-09-19T05:44:29.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 --2- 172.21.15.67:0/4285558885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc340161da0 0x7fc3400d1af0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 -- 172.21.15.67:0/4285558885 >> 172.21.15.67:0/4285558885 conn(0x7fc34008bfc0 msgr2=0x7fc3400d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:29.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 -- 172.21.15.67:0/4285558885 shutdown_connections 2024-09-19T05:44:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.024+0000 7fc3452ec640 1 -- 172.21.15.67:0/4285558885 wait complete. 2024-09-19T05:44:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 Processor -- start 2024-09-19T05:44:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 -- start start 2024-09-19T05:44:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400d0160 0x7fc340150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3400d0e80 0x7fc34014e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc340161da0 0x7fc3400b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc340162180 con 0x7fc3400d0e80 2024-09-19T05:44:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc3400b53f0 con 0x7fc340161da0 2024-09-19T05:44:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc3400d16a0 con 0x7fc3400d0160 2024-09-19T05:44:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3400d0e80 0x7fc34014e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3400d0e80 0x7fc34014e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57124/0 (socket says 172.21.15.67:57124) 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33e7fc640 1 -- 172.21.15.67:0/3810825294 learned_addr learned my addr 172.21.15.67:0/3810825294 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33effd640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400d0160 0x7fc340150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33e7fc640 1 -- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400d0160 msgr2=0x7fc340150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33e7fc640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400d0160 0x7fc340150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33e7fc640 1 -- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc340161da0 msgr2=0x7fc3400b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33e7fc640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc340161da0 0x7fc3400b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33e7fc640 1 -- 172.21.15.67:0/3810825294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3400b8710 con 0x7fc3400d0e80 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33effd640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400d0160 0x7fc340150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc33e7fc640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3400d0e80 0x7fc34014e2e0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fc33400c420 tx=0x7fc33400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3277fe640 1 -- 172.21.15.67:0/3810825294 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3340052d0 con 0x7fc3400d0e80 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3277fe640 1 -- 172.21.15.67:0/3810825294 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc334005470 con 0x7fc3400d0e80 2024-09-19T05:44:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 -- 172.21.15.67:0/3810825294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3400b89f0 con 0x7fc3400d0e80 2024-09-19T05:44:29.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3277fe640 1 -- 172.21.15.67:0/3810825294 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334007260 con 0x7fc3400d0e80 2024-09-19T05:44:29.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 -- 172.21.15.67:0/3810825294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3400ccf00 con 0x7fc3400d0e80 2024-09-19T05:44:29.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.028+0000 7fc3452ec640 1 -- 172.21.15.67:0/3810825294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3400d1af0 con 0x7fc3400d0e80 2024-09-19T05:44:29.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.032+0000 7fc3277fe640 1 -- 172.21.15.67:0/3810825294 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc334007400 con 0x7fc3400d0e80 2024-09-19T05:44:29.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.032+0000 7fc3277fe640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc32c0678c0 0x7fc32c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:29.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.032+0000 7fc3277fe640 1 -- 172.21.15.67:0/3810825294 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fc3340852a0 con 0x7fc3400d0e80 2024-09-19T05:44:29.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.032+0000 7fc33effd640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc32c0678c0 0x7fc32c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:29.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.032+0000 7fc33effd640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc32c0678c0 0x7fc32c069d80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc3300af000 tx=0x7fc330008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.036+0000 7fc3277fe640 1 -- 172.21.15.67:0/3810825294 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc334055c50 con 0x7fc3400d0e80 2024-09-19T05:44:29.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.256+0000 7fc3452ec640 1 -- 172.21.15.67:0/3810825294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc3400cd0d0 con 0x7fc3400d0e80 2024-09-19T05:44:29.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.256+0000 7fc3277fe640 1 -- 172.21.15.67:0/3810825294 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7fc334055550 con 0x7fc3400d0e80 2024-09-19T05:44:29.256 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:29.256 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":698,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077791312,"bytes_used":2686918656,"bytes_avail":770407194624,"bytes_total":773094113280,"write_bytes_sec":26920728,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8514}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-09-19T05:44:25.344276+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:44:29.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.256+0000 7fc3452ec640 1 -- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc32c0678c0 msgr2=0x7fc32c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:29.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.256+0000 7fc3452ec640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc32c0678c0 0x7fc32c069d80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc3300af000 tx=0x7fc330008040 comp rx=0 tx=0).stop 2024-09-19T05:44:29.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.256+0000 7fc3452ec640 1 -- 172.21.15.67:0/3810825294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3400d0e80 msgr2=0x7fc34014e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:29.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.256+0000 7fc3452ec640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3400d0e80 0x7fc34014e2e0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fc33400c420 tx=0x7fc33400c8e0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.256+0000 7fc3452ec640 1 -- 172.21.15.67:0/3810825294 shutdown_connections 2024-09-19T05:44:29.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.256+0000 7fc3452ec640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc340161da0 0x7fc3400b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.256+0000 7fc3452ec640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3400d0e80 0x7fc34014e2e0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.260+0000 7fc3452ec640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc32c0678c0 0x7fc32c069d80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.260+0000 7fc3452ec640 1 --2- 172.21.15.67:0/3810825294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc3400d0160 0x7fc340150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.260+0000 7fc3452ec640 1 -- 172.21.15.67:0/3810825294 >> 172.21.15.67:0/3810825294 conn(0x7fc34008bfc0 msgr2=0x7fc34006e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:29.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.260+0000 7fc3452ec640 1 -- 172.21.15.67:0/3810825294 shutdown_connections 2024-09-19T05:44:29.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:29.260+0000 7fc3452ec640 1 -- 172.21.15.67:0/3810825294 wait complete. 2024-09-19T05:44:29.274 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-19T05:44:30.275 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.408+0000 7f47bca2b640 1 Processor -- start 2024-09-19T05:44:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.408+0000 7f47bca2b640 1 -- start start 2024-09-19T05:44:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47bca2b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 0x7f47b8071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47bca2b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47b80aef40 0x7f47b80af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47bca2b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b80b3070 con 0x7f47b815baf0 2024-09-19T05:44:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47bca2b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f47b80b32e0 con 0x7f47b80aef40 2024-09-19T05:44:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47bca2b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f47b80b35c0 con 0x7f47b815b710 2024-09-19T05:44:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b5d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f47b815baf0 0x7f47b815bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37086/0 (socket says 172.21.15.67:37086) 2024-09-19T05:44:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b5d9b640 1 -- 172.21.15.67:0/532469568 learned_addr learned my addr 172.21.15.67:0/532469568 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b6d9d640 1 --2- 172.21.15.67:0/532469568 >> v2:172.21.15.67:3300/0 conn(0x7f47b80aef40 0x7f47b80af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b659c640 1 --2- 172.21.15.67:0/532469568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 0x7f47b8071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b6d9d640 1 -- 172.21.15.67:0/532469568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 msgr2=0x7f47b8071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b6d9d640 1 --2- 172.21.15.67:0/532469568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 0x7f47b8071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b6d9d640 1 -- 172.21.15.67:0/532469568 >> v1:172.21.15.67:6789/0 conn(0x7f47b815baf0 legacy=0x7f47b815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b6d9d640 1 -- 172.21.15.67:0/532469568 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b80b38a0 con 0x7f47b80aef40 2024-09-19T05:44:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b559a640 1 -- 172.21.15.67:0/532469568 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862911214 0 0) 0x7f47b80b3070 con 0x7f47b815baf0 2024-09-19T05:44:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b6d9d640 1 --2- 172.21.15.67:0/532469568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b80aef40 0x7f47b80af360 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009d90 tx=0x7f47b001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee223ec35c07f56a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b559a640 1 -- 172.21.15.67:0/532469568 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b2070 con 0x7f47b80aef40 2024-09-19T05:44:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b559a640 1 -- 172.21.15.67:0/532469568 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b00a5a20 con 0x7f47b80aef40 2024-09-19T05:44:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.412+0000 7f47b559a640 1 -- 172.21.15.67:0/532469568 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00a5df0 con 0x7f47b80aef40 2024-09-19T05:44:30.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- 172.21.15.67:0/532469568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b80aef40 msgr2=0x7f47b80af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 --2- 172.21.15.67:0/532469568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b80aef40 0x7f47b80af360 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009d90 tx=0x7f47b001c940 comp rx=0 tx=0).stop 2024-09-19T05:44:30.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- 172.21.15.67:0/532469568 shutdown_connections 2024-09-19T05:44:30.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 --2- 172.21.15.67:0/532469568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b80aef40 0x7f47b80af360 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 --2- 172.21.15.67:0/532469568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 0x7f47b8071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- 172.21.15.67:0/532469568 >> 172.21.15.67:0/532469568 conn(0x7f47b80d0080 msgr2=0x7f47b80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:30.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- 172.21.15.67:0/532469568 shutdown_connections 2024-09-19T05:44:30.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- 172.21.15.67:0/532469568 wait complete. 2024-09-19T05:44:30.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 Processor -- start 2024-09-19T05:44:30.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- start start 2024-09-19T05:44:30.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80aef40 0x7f47b809a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 0x7f47b8145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b815baf0 0x7f47b814bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80b4c40 con 0x7f47b815baf0 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80b4ac0 con 0x7f47b80aef40 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f47b80b4dc0 con 0x7f47b815b710 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b815baf0 0x7f47b814bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b815baf0 0x7f47b814bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57148/0 (socket says 172.21.15.67:57148) 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b6d9d640 1 -- 172.21.15.67:0/1475841504 learned_addr learned my addr 172.21.15.67:0/1475841504 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b5d9b640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 0x7f47b8145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b659c640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80aef40 0x7f47b809a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b6d9d640 1 -- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 msgr2=0x7f47b8145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b6d9d640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 0x7f47b8145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b6d9d640 1 -- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80aef40 msgr2=0x7f47b809a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b6d9d640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80aef40 0x7f47b809a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b6d9d640 1 -- 172.21.15.67:0/1475841504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b8150c30 con 0x7f47b815baf0 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b659c640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80aef40 0x7f47b809a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b5d9b640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 0x7f47b8145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47b6d9d640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b815baf0 0x7f47b814bcb0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f47b001aff0 tx=0x7f47b00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47a6ffd640 1 -- 172.21.15.67:0/1475841504 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b2050 con 0x7f47b815baf0 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47a6ffd640 1 -- 172.21.15.67:0/1475841504 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b00be070 con 0x7f47b815baf0 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- 172.21.15.67:0/1475841504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b8150f10 con 0x7f47b815baf0 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47a6ffd640 1 -- 172.21.15.67:0/1475841504 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00adad0 con 0x7f47b815baf0 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.416+0000 7f47bca2b640 1 -- 172.21.15.67:0/1475841504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b81514d0 con 0x7f47b815baf0 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.420+0000 7f47bca2b640 1 -- 172.21.15.67:0/1475841504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b80af360 con 0x7f47b815baf0 2024-09-19T05:44:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.420+0000 7f47a6ffd640 1 -- 172.21.15.67:0/1475841504 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47b00adc70 con 0x7f47b815baf0 2024-09-19T05:44:30.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.420+0000 7f47a6ffd640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47980678c0 0x7f4798069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.420+0000 7f47a6ffd640 1 -- 172.21.15.67:0/1475841504 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f47b0121300 con 0x7f47b815baf0 2024-09-19T05:44:30.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.420+0000 7f47b659c640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47980678c0 0x7f4798069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.420+0000 7f47b659c640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47980678c0 0x7f4798069d80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009840 tx=0x7f47a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:30.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.424+0000 7f47a6ffd640 1 -- 172.21.15.67:0/1475841504 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f47b0016560 con 0x7f47b815baf0 2024-09-19T05:44:30.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.628+0000 7f47bca2b640 1 -- 172.21.15.67:0/1475841504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47b80b5020 con 0x7f47b815baf0 2024-09-19T05:44:30.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.628+0000 7f47a6ffd640 1 -- 172.21.15.67:0/1475841504 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f47b00ab340 con 0x7f47b815baf0 2024-09-19T05:44:30.628 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:30.628 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:30.628 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.628+0000 7f47bca2b640 1 -- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47980678c0 msgr2=0x7f4798069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.628+0000 7f47bca2b640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47980678c0 0x7f4798069d80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009840 tx=0x7f47a8008040 comp rx=0 tx=0).stop 2024-09-19T05:44:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.628+0000 7f47bca2b640 1 -- 172.21.15.67:0/1475841504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b815baf0 msgr2=0x7f47b814bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.628+0000 7f47bca2b640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b815baf0 0x7f47b814bcb0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f47b001aff0 tx=0x7f47b00196e0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.632+0000 7f47bca2b640 1 -- 172.21.15.67:0/1475841504 shutdown_connections 2024-09-19T05:44:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.632+0000 7f47bca2b640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47b815baf0 0x7f47b814bcb0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.632+0000 7f47bca2b640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47980678c0 0x7f4798069d80 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.632+0000 7f47bca2b640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b815b710 0x7f47b8145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.632+0000 7f47bca2b640 1 --2- 172.21.15.67:0/1475841504 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80aef40 0x7f47b809a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.632+0000 7f47bca2b640 1 -- 172.21.15.67:0/1475841504 >> 172.21.15.67:0/1475841504 conn(0x7f47b80d0080 msgr2=0x7f47b806e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.632+0000 7f47bca2b640 1 -- 172.21.15.67:0/1475841504 shutdown_connections 2024-09-19T05:44:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.632+0000 7f47bca2b640 1 -- 172.21.15.67:0/1475841504 wait complete. 2024-09-19T05:44:30.647 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-19T05:44:30.647 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:44:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.772+0000 7febb9456640 1 Processor -- start 2024-09-19T05:44:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.772+0000 7febb9456640 1 -- start start 2024-09-19T05:44:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.772+0000 7febb9456640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febb40b2fd0 0x7febb406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.772+0000 7febb9456640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb40b4420 con 0x7febb415e330 2024-09-19T05:44:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.772+0000 7febb9456640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb40b4140 con 0x7febb40726b0 2024-09-19T05:44:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.772+0000 7febb9456640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7febb40acfb0 con 0x7febb40b2fd0 2024-09-19T05:44:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.772+0000 7febb27fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febb40b2fd0 0x7febb406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.772+0000 7febb2ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7febb415e330 0x7febb4071fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37094/0 (socket says 172.21.15.67:37094) 2024-09-19T05:44:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.772+0000 7febb2ffd640 1 -- 172.21.15.67:0/537715341 learned_addr learned my addr 172.21.15.67:0/537715341 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb27fc640 1 -- 172.21.15.67:0/537715341 >> v1:172.21.15.97:6789/0 conn(0x7febb40726b0 legacy=0x7febb406ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb27fc640 1 -- 172.21.15.67:0/537715341 >> v1:172.21.15.67:6789/0 conn(0x7febb415e330 legacy=0x7febb4071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb27fc640 1 -- 172.21.15.67:0/537715341 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb406def0 con 0x7febb40b2fd0 2024-09-19T05:44:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb1ffb640 1 -- 172.21.15.67:0/537715341 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041632077 0 0) 0x7febb40b4420 con 0x7febb415e330 2024-09-19T05:44:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb27fc640 1 --2- 172.21.15.67:0/537715341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40b2fd0 0x7febb406e6f0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0097c0 tx=0x7feb9c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5525e34302ca2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:30.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb1ffb640 1 -- 172.21.15.67:0/537715341 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0b1070 con 0x7febb40b2fd0 2024-09-19T05:44:30.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb1ffb640 1 -- 172.21.15.67:0/537715341 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c0ac410 con 0x7febb40b2fd0 2024-09-19T05:44:30.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb1ffb640 1 -- 172.21.15.67:0/537715341 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0ac7e0 con 0x7febb40b2fd0 2024-09-19T05:44:30.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb9456640 1 -- 172.21.15.67:0/537715341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40b2fd0 msgr2=0x7febb406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb9456640 1 --2- 172.21.15.67:0/537715341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40b2fd0 0x7febb406e6f0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0097c0 tx=0x7feb9c01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb9456640 1 -- 172.21.15.67:0/537715341 shutdown_connections 2024-09-19T05:44:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb9456640 1 --2- 172.21.15.67:0/537715341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40b2fd0 0x7febb406e6f0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb9456640 1 -- 172.21.15.67:0/537715341 >> 172.21.15.67:0/537715341 conn(0x7febb40d0080 msgr2=0x7febb40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb9456640 1 -- 172.21.15.67:0/537715341 shutdown_connections 2024-09-19T05:44:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.776+0000 7febb9456640 1 -- 172.21.15.67:0/537715341 wait complete. 2024-09-19T05:44:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 Processor -- start 2024-09-19T05:44:30.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 -- start start 2024-09-19T05:44:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40726b0 0x7febb41595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febb415e330 0x7febb41541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb415ac40 0x7febb406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7febb40cfe40 con 0x7febb40726b0 2024-09-19T05:44:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7febb40cfcc0 con 0x7febb415ac40 2024-09-19T05:44:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7febb416cb30 con 0x7febb415e330 2024-09-19T05:44:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40726b0 0x7febb41595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40726b0 0x7febb41595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57162/0 (socket says 172.21.15.67:57162) 2024-09-19T05:44:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb2ffd640 1 -- 172.21.15.67:0/3714957391 learned_addr learned my addr 172.21.15.67:0/3714957391 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:30.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb27fc640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febb415e330 0x7febb41541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb37fe640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb415ac40 0x7febb406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb2ffd640 1 -- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febb415e330 msgr2=0x7febb41541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb2ffd640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febb415e330 0x7febb41541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb2ffd640 1 -- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb415ac40 msgr2=0x7febb406e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb2ffd640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb415ac40 0x7febb406e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb2ffd640 1 -- 172.21.15.67:0/3714957391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb4159ba0 con 0x7febb40726b0 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb37fe640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb415ac40 0x7febb406e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb2ffd640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40726b0 0x7febb41595c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7feba400c410 tx=0x7feba400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febab7fe640 1 -- 172.21.15.67:0/3714957391 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40074e0 con 0x7febb40726b0 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febab7fe640 1 -- 172.21.15.67:0/3714957391 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba40047f0 con 0x7febb40726b0 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 -- 172.21.15.67:0/3714957391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb4159e80 con 0x7febb40726b0 2024-09-19T05:44:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febab7fe640 1 -- 172.21.15.67:0/3714957391 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4007680 con 0x7febb40726b0 2024-09-19T05:44:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 -- 172.21.15.67:0/3714957391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb415a440 con 0x7febb40726b0 2024-09-19T05:44:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febb9456640 1 -- 172.21.15.67:0/3714957391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb4071fa0 con 0x7febb40726b0 2024-09-19T05:44:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.780+0000 7febab7fe640 1 -- 172.21.15.67:0/3714957391 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feba4011070 con 0x7febb40726b0 2024-09-19T05:44:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.784+0000 7febab7fe640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb940678c0 0x7feb94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.784+0000 7febab7fe640 1 -- 172.21.15.67:0/3714957391 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7feba4085b10 con 0x7febb40726b0 2024-09-19T05:44:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.784+0000 7febb27fc640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb940678c0 0x7feb94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.784+0000 7febb27fc640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb940678c0 0x7feb94069d80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ae000 tx=0x7feb9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:30.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:30.788+0000 7febab7fe640 1 -- 172.21.15.67:0/3714957391 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7feba4056420 con 0x7febb40726b0 2024-09-19T05:44:31.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 -- 172.21.15.67:0/3714957391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7febb4072b00 con 0x7febb40726b0 2024-09-19T05:44:31.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febab7fe640 1 -- 172.21.15.67:0/3714957391 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1617 (secure 0 0 0) 0x7feba4055d20 con 0x7febb40726b0 2024-09-19T05:44:31.012 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:31.012 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":700,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078326592,"bytes_used":2687983616,"bytes_avail":770406129664,"bytes_total":773094113280,"write_bytes_sec":26965315,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8514}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-19T05:44:29.345831+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:44:31.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 -- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb940678c0 msgr2=0x7feb94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb940678c0 0x7feb94069d80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ae000 tx=0x7feb9c008040 comp rx=0 tx=0).stop 2024-09-19T05:44:31.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 -- 172.21.15.67:0/3714957391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40726b0 msgr2=0x7febb41595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40726b0 0x7febb41595c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7feba400c410 tx=0x7feba400c8d0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 -- 172.21.15.67:0/3714957391 shutdown_connections 2024-09-19T05:44:31.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb415ac40 0x7febb406e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb940678c0 0x7feb94069d80 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febb415e330 0x7febb41541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 --2- 172.21.15.67:0/3714957391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febb40726b0 0x7febb41595c0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 -- 172.21.15.67:0/3714957391 >> 172.21.15.67:0/3714957391 conn(0x7febb40d0080 msgr2=0x7febb415b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:31.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 -- 172.21.15.67:0/3714957391 shutdown_connections 2024-09-19T05:44:31.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.012+0000 7febb9456640 1 -- 172.21.15.67:0/3714957391 wait complete. 2024-09-19T05:44:31.031 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-19T05:44:31.031 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:44:31.031 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:44:31.124 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:44:31.190 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:44:31.190 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:44:31.190 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:44:31.190 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:44:31.197 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:44:31.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32c1493640 1 Processor -- start 2024-09-19T05:44:31.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32c1493640 1 -- start start 2024-09-19T05:44:31.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32c1493640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32bc15c030 0x7f32bc06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32c1493640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32bc06f460 0x7f32bc06f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32c1493640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32bc06e3c0 con 0x7f32bc15d1d0 2024-09-19T05:44:31.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32c1493640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f32bc06e6a0 con 0x7f32bc15c030 2024-09-19T05:44:31.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32c1493640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f32bc06e980 con 0x7f32bc06f460 2024-09-19T05:44:31.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32ba7fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f32bc15d1d0 0x7f32bc0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37106/0 (socket says 172.21.15.67:37106) 2024-09-19T05:44:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32ba7fc640 1 -- 172.21.15.67:0/2296854951 learned_addr learned my addr 172.21.15.67:0/2296854951 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32baffd640 1 --2- 172.21.15.67:0/2296854951 >> v2:172.21.15.67:3300/0 conn(0x7f32bc15c030 0x7f32bc06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32bb7fe640 1 --2- 172.21.15.67:0/2296854951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32bc06f460 0x7f32bc06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32baffd640 1 -- 172.21.15.67:0/2296854951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32bc06f460 msgr2=0x7f32bc06f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32baffd640 1 --2- 172.21.15.67:0/2296854951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32bc06f460 0x7f32bc06f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32baffd640 1 -- 172.21.15.67:0/2296854951 >> v1:172.21.15.67:6789/0 conn(0x7f32bc15d1d0 legacy=0x7f32bc0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32b9ffb640 1 -- 172.21.15.67:0/2296854951 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504203455 0 0) 0x7f32bc06e3c0 con 0x7f32bc15d1d0 2024-09-19T05:44:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.368+0000 7f32baffd640 1 -- 172.21.15.67:0/2296854951 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc06ec60 con 0x7f32bc15c030 2024-09-19T05:44:31.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32baffd640 1 --2- 172.21.15.67:0/2296854951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc15c030 0x7f32bc06dde0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0097c0 tx=0x7f32ac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d36f03e2ed1dd99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32b9ffb640 1 -- 172.21.15.67:0/2296854951 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0b0070 con 0x7f32bc15c030 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32b9ffb640 1 -- 172.21.15.67:0/2296854951 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac0ab600 con 0x7f32bc15c030 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32b9ffb640 1 -- 172.21.15.67:0/2296854951 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0ab9d0 con 0x7f32bc15c030 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32c1493640 1 -- 172.21.15.67:0/2296854951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc15c030 msgr2=0x7f32bc06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32c1493640 1 --2- 172.21.15.67:0/2296854951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc15c030 0x7f32bc06dde0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0097c0 tx=0x7f32ac01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32c1493640 1 -- 172.21.15.67:0/2296854951 shutdown_connections 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32c1493640 1 --2- 172.21.15.67:0/2296854951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32bc06f460 0x7f32bc06f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32c1493640 1 --2- 172.21.15.67:0/2296854951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc15c030 0x7f32bc06dde0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32c1493640 1 -- 172.21.15.67:0/2296854951 >> 172.21.15.67:0/2296854951 conn(0x7f32bc0d0080 msgr2=0x7f32bc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32c1493640 1 -- 172.21.15.67:0/2296854951 shutdown_connections 2024-09-19T05:44:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.372+0000 7f32c1493640 1 -- 172.21.15.67:0/2296854951 wait complete. 2024-09-19T05:44:31.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 Processor -- start 2024-09-19T05:44:31.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 -- start start 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc06f460 0x7f32bc154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32bc15c030 0x7f32bc15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32bc15d1d0 0x7f32bc15dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc15c590 con 0x7f32bc06f460 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc15c410 con 0x7f32bc15d1d0 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f32bc1690e0 con 0x7f32bc15c030 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32baffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc06f460 0x7f32bc154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32baffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc06f460 0x7f32bc154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57172/0 (socket says 172.21.15.67:57172) 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32baffd640 1 -- 172.21.15.67:0/4190883976 learned_addr learned my addr 172.21.15.67:0/4190883976 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32ba7fc640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32bc15c030 0x7f32bc15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32baffd640 1 -- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32bc15c030 msgr2=0x7f32bc15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32baffd640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32bc15c030 0x7f32bc15daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32bb7fe640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32bc15d1d0 0x7f32bc15dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32baffd640 1 -- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32bc15d1d0 msgr2=0x7f32bc15dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32baffd640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32bc15d1d0 0x7f32bc15dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32baffd640 1 -- 172.21.15.67:0/4190883976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc15efb0 con 0x7f32bc06f460 2024-09-19T05:44:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32baffd640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc06f460 0x7f32bc154380 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f32ac01a0d0 tx=0x7f32ac019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32a37fe640 1 -- 172.21.15.67:0/4190883976 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0b0040 con 0x7f32bc06f460 2024-09-19T05:44:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32a37fe640 1 -- 172.21.15.67:0/4190883976 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac0ba070 con 0x7f32bc06f460 2024-09-19T05:44:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 -- 172.21.15.67:0/4190883976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32bc15e610 con 0x7f32bc06f460 2024-09-19T05:44:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32a37fe640 1 -- 172.21.15.67:0/4190883976 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0b4630 con 0x7f32bc06f460 2024-09-19T05:44:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 -- 172.21.15.67:0/4190883976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32bc1538a0 con 0x7f32bc06f460 2024-09-19T05:44:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32c1493640 1 -- 172.21.15.67:0/4190883976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32bc06f890 con 0x7f32bc06f460 2024-09-19T05:44:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.376+0000 7f32a37fe640 1 -- 172.21.15.67:0/4190883976 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32ac0b47d0 con 0x7f32bc06f460 2024-09-19T05:44:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.380+0000 7f32a37fe640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32a80678c0 0x7f32a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.380+0000 7f32a37fe640 1 -- 172.21.15.67:0/4190883976 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f32ac11fba0 con 0x7f32bc06f460 2024-09-19T05:44:31.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.380+0000 7f32ba7fc640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32a80678c0 0x7f32a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.380+0000 7f32ba7fc640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32a80678c0 0x7f32a8069d80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f32bc151700 tx=0x7f32b0007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:31.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.384+0000 7f32a37fe640 1 -- 172.21.15.67:0/4190883976 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f32ac016090 con 0x7f32bc06f460 2024-09-19T05:44:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.560+0000 7f32c1493640 1 -- 172.21.15.67:0/4190883976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f32bc0d0f20 con 0x7f32bc06f460 2024-09-19T05:44:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.560+0000 7f32a37fe640 1 -- 172.21.15.67:0/4190883976 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v143) ==== 80+0+0 (secure 0 0 0) 0x7f32ac0f04b0 con 0x7f32bc06f460 2024-09-19T05:44:31.560 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 -- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32a80678c0 msgr2=0x7f32a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32a80678c0 0x7f32a8069d80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f32bc151700 tx=0x7f32b0007c10 comp rx=0 tx=0).stop 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 -- 172.21.15.67:0/4190883976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc06f460 msgr2=0x7f32bc154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc06f460 0x7f32bc154380 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f32ac01a0d0 tx=0x7f32ac019240 comp rx=0 tx=0).stop 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 -- 172.21.15.67:0/4190883976 shutdown_connections 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32bc15d1d0 0x7f32bc15dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32a80678c0 0x7f32a8069d80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32bc15c030 0x7f32bc15daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 --2- 172.21.15.67:0/4190883976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32bc06f460 0x7f32bc154380 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 -- 172.21.15.67:0/4190883976 >> 172.21.15.67:0/4190883976 conn(0x7f32bc0d0080 msgr2=0x7f32bc0b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 -- 172.21.15.67:0/4190883976 shutdown_connections 2024-09-19T05:44:31.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:31.564+0000 7f32c1493640 1 -- 172.21.15.67:0/4190883976 wait complete. 2024-09-19T05:44:31.581 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:44:31.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:31.581 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:44:31.593 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[76238]: fuse finished with error 0 and tester_r 0 2024-09-19T05:44:31.678 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:44:31.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:31.679 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:44:31.775 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:44:31.775 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:44:31.775 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:44:31.782 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:44:31.783 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:44:31.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:31.783 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:44:31.830 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:44:31.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:44:31.832 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:44:31.833 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:44:31.833 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:44:31.839 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:44:31.839 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:31.839 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:44:31.888 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:44:31.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:44:31.889 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:44:31.889 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:44:31.889 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:44:31.895 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:44:31.895 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:44:31.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:31.895 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:44:31.941 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:44:31.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:44:31.942 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:32.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e19510640 1 Processor -- start 2024-09-19T05:44:32.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e19510640 1 -- start start 2024-09-19T05:44:32.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e19510640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7e1406dde0 0x7f7e140b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e19510640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e1406e3c0 con 0x7f7e1415c030 2024-09-19T05:44:32.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e19510640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e1406e6a0 con 0x7f7e140b3510 2024-09-19T05:44:32.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e19510640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7e1406e980 con 0x7f7e1406dde0 2024-09-19T05:44:32.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e12ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7e1415c030 0x7f7e1415d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37122/0 (socket says 172.21.15.67:37122) 2024-09-19T05:44:32.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e12ffd640 1 -- 172.21.15.67:0/212317407 learned_addr learned my addr 172.21.15.67:0/212317407 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e127fc640 1 --2- 172.21.15.67:0/212317407 >> v2:172.21.15.97:3300/0 conn(0x7f7e1406dde0 0x7f7e140b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436363041 0 0) 0x7f7e1406e3c0 con 0x7f7e1415c030 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dfc003530 con 0x7f7e1415c030 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1136115513 0 0) 0x7f7dfc003530 con 0x7f7e1415c030 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 >> v2:172.21.15.97:3300/0 conn(0x7f7e1406dde0 msgr2=0x7f7e140b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 --2- 172.21.15.67:0/212317407 >> v2:172.21.15.97:3300/0 conn(0x7f7e1406dde0 0x7f7e140b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 >> v1:172.21.15.97:6789/0 conn(0x7f7e140b3510 legacy=0x7f7e1406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1406ec60 con 0x7f7e1415c030 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7e0c001a00 con 0x7f7e1415c030 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 >> v1:172.21.15.67:6789/0 conn(0x7f7e1415c030 legacy=0x7f7e1415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dfc0039c0 0x7f7dfc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7dfc004810 0x7f7dfc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dfc0051d0 0x7f7dfc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1406e980 con 0x7f7dfc0039c0 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc00c070 con 0x7f7dfc0051d0 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7dfc00c270 con 0x7f7dfc004810 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e12ffd640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dfc0039c0 0x7f7dfc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e137fe640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dfc0051d0 0x7f7dfc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e127fc640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7dfc004810 0x7f7dfc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e12ffd640 1 -- 172.21.15.67:0/212317407 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7dfc004810 msgr2=0x7f7dfc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e12ffd640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7dfc004810 0x7f7dfc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e12ffd640 1 -- 172.21.15.67:0/212317407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dfc0051d0 msgr2=0x7f7dfc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e12ffd640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dfc0051d0 0x7f7dfc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e12ffd640 1 -- 172.21.15.67:0/212317407 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc003530 con 0x7f7dfc0039c0 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e137fe640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dfc0051d0 0x7f7dfc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:32.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.072+0000 7f7e137fe640 1 -- 172.21.15.67:0/212317407 reap_dead start 2024-09-19T05:44:32.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e12ffd640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dfc0039c0 0x7f7dfc003de0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00a840 tx=0x7f7e0c01d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1a5e02ddbd841 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:32.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00a460 con 0x7f7dfc0039c0 2024-09-19T05:44:32.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0c0ad430 con 0x7f7dfc0039c0 2024-09-19T05:44:32.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e11ffb640 1 -- 172.21.15.67:0/212317407 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0ad880 con 0x7f7dfc0039c0 2024-09-19T05:44:32.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 -- 172.21.15.67:0/212317407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dfc0039c0 msgr2=0x7f7dfc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dfc0039c0 0x7f7dfc003de0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00a840 tx=0x7f7e0c01d330 comp rx=0 tx=0).stop 2024-09-19T05:44:32.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 -- 172.21.15.67:0/212317407 shutdown_connections 2024-09-19T05:44:32.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 --2- 172.21.15.67:0/212317407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dfc0039c0 0x7f7dfc003de0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 -- 172.21.15.67:0/212317407 >> 172.21.15.67:0/212317407 conn(0x7f7e140d0080 msgr2=0x7f7e140d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:32.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 -- 172.21.15.67:0/212317407 shutdown_connections 2024-09-19T05:44:32.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 -- 172.21.15.67:0/212317407 wait complete. 2024-09-19T05:44:32.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 Processor -- start 2024-09-19T05:44:32.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 -- start start 2024-09-19T05:44:32.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7dfc0039c0 0x7f7e1409d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1415ab00 0x7f7e14147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e14157410 0x7f7e14157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1415d5c0 con 0x7f7e1415ab00 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1415c620 con 0x7f7e14157410 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.076+0000 7f7e19510640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1415d740 con 0x7f7dfc0039c0 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e127fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1415ab00 0x7f7e14147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e127fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1415ab00 0x7f7e14147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57198/0 (socket says 172.21.15.67:57198) 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e127fc640 1 -- 172.21.15.67:0/2079287477 learned_addr learned my addr 172.21.15.67:0/2079287477 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e137fe640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e14157410 0x7f7e14157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e12ffd640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7dfc0039c0 0x7f7e1409d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e127fc640 1 -- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7dfc0039c0 msgr2=0x7f7e1409d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e127fc640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7dfc0039c0 0x7f7e1409d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e127fc640 1 -- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e14157410 msgr2=0x7f7e14157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e127fc640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e14157410 0x7f7e14157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e127fc640 1 -- 172.21.15.67:0/2079287477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1409a240 con 0x7f7e1415ab00 2024-09-19T05:44:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e127fc640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1415ab00 0x7f7e14147610 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7e08011690 tx=0x7f7e08011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7dfb7fe640 1 -- 172.21.15.67:0/2079287477 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800f960 con 0x7f7e1415ab00 2024-09-19T05:44:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7dfb7fe640 1 -- 172.21.15.67:0/2079287477 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0800fb00 con 0x7f7e1415ab00 2024-09-19T05:44:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7dfb7fe640 1 -- 172.21.15.67:0/2079287477 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08015460 con 0x7f7e1415ab00 2024-09-19T05:44:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e19510640 1 -- 172.21.15.67:0/2079287477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1409a520 con 0x7f7e1415ab00 2024-09-19T05:44:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e19510640 1 -- 172.21.15.67:0/2079287477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1415b2c0 con 0x7f7e1415ab00 2024-09-19T05:44:32.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e19510640 1 -- 172.21.15.67:0/2079287477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e14157dd0 con 0x7f7e1415ab00 2024-09-19T05:44:32.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7dfb7fe640 1 -- 172.21.15.67:0/2079287477 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e08015600 con 0x7f7e1415ab00 2024-09-19T05:44:32.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7dfb7fe640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e000678c0 0x7f7e00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7dfb7fe640 1 -- 172.21.15.67:0/2079287477 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f7e08086620 con 0x7f7e1415ab00 2024-09-19T05:44:32.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.080+0000 7f7e12ffd640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e000678c0 0x7f7e00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.084+0000 7f7e12ffd640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e000678c0 0x7f7e00069d80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0ad000 tx=0x7f7e1406e870 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:32.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.084+0000 7f7dfb7fe640 1 -- 172.21.15.67:0/2079287477 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7e08019030 con 0x7f7e1415ab00 2024-09-19T05:44:32.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.284+0000 7f7e19510640 1 -- 172.21.15.67:0/2079287477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e140acfb0 con 0x7f7e1415ab00 2024-09-19T05:44:32.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.284+0000 7f7dfb7fe640 1 -- 172.21.15.67:0/2079287477 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f7e08056fd0 con 0x7f7e1415ab00 2024-09-19T05:44:32.285 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:32.286 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 -- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e000678c0 msgr2=0x7f7e00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e000678c0 0x7f7e00069d80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0ad000 tx=0x7f7e1406e870 comp rx=0 tx=0).stop 2024-09-19T05:44:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 -- 172.21.15.67:0/2079287477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1415ab00 msgr2=0x7f7e14147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1415ab00 0x7f7e14147610 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7e08011690 tx=0x7f7e08011b50 comp rx=0 tx=0).stop 2024-09-19T05:44:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 -- 172.21.15.67:0/2079287477 shutdown_connections 2024-09-19T05:44:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e14157410 0x7f7e14157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1415ab00 0x7f7e14147610 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e000678c0 0x7f7e00069d80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 --2- 172.21.15.67:0/2079287477 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7dfc0039c0 0x7f7e1409d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 -- 172.21.15.67:0/2079287477 >> 172.21.15.67:0/2079287477 conn(0x7f7e140d0080 msgr2=0x7f7e1415ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 -- 172.21.15.67:0/2079287477 shutdown_connections 2024-09-19T05:44:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.288+0000 7f7e19510640 1 -- 172.21.15.67:0/2079287477 wait complete. 2024-09-19T05:44:32.305 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:32.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.428+0000 7f478bf91640 1 Processor -- start 2024-09-19T05:44:32.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.428+0000 7f478bf91640 1 -- start start 2024-09-19T05:44:32.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478bf91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f478415c030 0x7f478406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478bf91640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f478406f460 0x7f478406f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478bf91640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478406e3c0 con 0x7f478415d1d0 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478bf91640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f478406e6a0 con 0x7f478406f460 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478bf91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f478406e980 con 0x7f478415c030 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478a52e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f478406f460 0x7f478406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478952c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f478415d1d0 0x7f47840b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37126/0 (socket says 172.21.15.67:37126) 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478952c640 1 -- 172.21.15.67:0/517258521 learned_addr learned my addr 172.21.15.67:0/517258521 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f4789d2d640 1 --2- 172.21.15.67:0/517258521 >> v2:172.21.15.97:3300/0 conn(0x7f478415c030 0x7f478406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478a52e640 1 -- 172.21.15.67:0/517258521 >> v2:172.21.15.97:3300/0 conn(0x7f478415c030 msgr2=0x7f478406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478a52e640 1 --2- 172.21.15.67:0/517258521 >> v2:172.21.15.97:3300/0 conn(0x7f478415c030 0x7f478406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478a52e640 1 -- 172.21.15.67:0/517258521 >> v1:172.21.15.67:6789/0 conn(0x7f478415d1d0 legacy=0x7f47840b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f4788d2b640 1 -- 172.21.15.67:0/517258521 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753610907 0 0) 0x7f478406e3c0 con 0x7f478415d1d0 2024-09-19T05:44:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478a52e640 1 -- 172.21.15.67:0/517258521 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478406ec60 con 0x7f478406f460 2024-09-19T05:44:32.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f478a52e640 1 --2- 172.21.15.67:0/517258521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 0x7f478406f870 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f4784070390 tx=0x7f477c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9520afa6d591d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:32.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f4788d2b640 1 -- 172.21.15.67:0/517258521 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c0b2070 con 0x7f478406f460 2024-09-19T05:44:32.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f4788d2b640 1 -- 172.21.15.67:0/517258521 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477c0a5840 con 0x7f478406f460 2024-09-19T05:44:32.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.432+0000 7f4788d2b640 1 -- 172.21.15.67:0/517258521 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c0a5c10 con 0x7f478406f460 2024-09-19T05:44:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- 172.21.15.67:0/517258521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 msgr2=0x7f478406f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 --2- 172.21.15.67:0/517258521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 0x7f478406f870 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f4784070390 tx=0x7f477c01c930 comp rx=0 tx=0).stop 2024-09-19T05:44:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- 172.21.15.67:0/517258521 shutdown_connections 2024-09-19T05:44:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 --2- 172.21.15.67:0/517258521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 0x7f478406f870 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 --2- 172.21.15.67:0/517258521 >> v2:172.21.15.97:3300/0 conn(0x7f478415c030 0x7f478406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- 172.21.15.67:0/517258521 >> 172.21.15.67:0/517258521 conn(0x7f47840d0080 msgr2=0x7f47840d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- 172.21.15.67:0/517258521 shutdown_connections 2024-09-19T05:44:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- 172.21.15.67:0/517258521 wait complete. 2024-09-19T05:44:32.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 Processor -- start 2024-09-19T05:44:32.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- start start 2024-09-19T05:44:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 0x7f47840af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f478415c030 0x7f47840afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478415d1d0 0x7f47840b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f478415c590 con 0x7f478406f460 2024-09-19T05:44:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f478415c410 con 0x7f478415d1d0 2024-09-19T05:44:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f47841690e0 con 0x7f478415c030 2024-09-19T05:44:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f4789d2d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 0x7f47840af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f4789d2d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 0x7f47840af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57214/0 (socket says 172.21.15.67:57214) 2024-09-19T05:44:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f4789d2d640 1 -- 172.21.15.67:0/1803578865 learned_addr learned my addr 172.21.15.67:0/1803578865 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478a52e640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478415d1d0 0x7f47840b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478952c640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f478415c030 0x7f47840afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f4789d2d640 1 -- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f478415c030 msgr2=0x7f47840afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f4789d2d640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f478415c030 0x7f47840afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f4789d2d640 1 -- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478415d1d0 msgr2=0x7f47840b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f4789d2d640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478415d1d0 0x7f47840b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f4789d2d640 1 -- 172.21.15.67:0/1803578865 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478414f660 con 0x7f478406f460 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478a52e640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478415d1d0 0x7f47840b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478952c640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f478415c030 0x7f47840afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f4789d2d640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 0x7f47840af710 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f477400d830 tx=0x7f477400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f477a7fc640 1 -- 172.21.15.67:0/1803578865 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477400b6c0 con 0x7f478406f460 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f477a7fc640 1 -- 172.21.15.67:0/1803578865 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4774019070 con 0x7f478406f460 2024-09-19T05:44:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- 172.21.15.67:0/1803578865 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4784158240 con 0x7f478406f460 2024-09-19T05:44:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f477a7fc640 1 -- 172.21.15.67:0/1803578865 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477400ba60 con 0x7f478406f460 2024-09-19T05:44:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.436+0000 7f478bf91640 1 -- 172.21.15.67:0/1803578865 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4784157ef0 con 0x7f478406f460 2024-09-19T05:44:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.440+0000 7f478bf91640 1 -- 172.21.15.67:0/1803578865 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478406f870 con 0x7f478406f460 2024-09-19T05:44:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.440+0000 7f477a7fc640 1 -- 172.21.15.67:0/1803578865 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f477401e460 con 0x7f478406f460 2024-09-19T05:44:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.440+0000 7f477a7fc640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47680678c0 0x7f4768069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.440+0000 7f477a7fc640 1 -- 172.21.15.67:0/1803578865 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f4774086520 con 0x7f478406f460 2024-09-19T05:44:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.440+0000 7f478952c640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47680678c0 0x7f4768069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.440+0000 7f478952c640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47680678c0 0x7f4768069d80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4780007fd0 tx=0x7f4780009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.444+0000 7f477a7fc640 1 -- 172.21.15.67:0/1803578865 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4774056ed0 con 0x7f478406f460 2024-09-19T05:44:32.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.636+0000 7f478bf91640 1 -- 172.21.15.67:0/1803578865 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4784074960 con 0x7f478406f460 2024-09-19T05:44:32.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.636+0000 7f477a7fc640 1 -- 172.21.15.67:0/1803578865 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f47740567d0 con 0x7f478406f460 2024-09-19T05:44:32.638 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:32.638 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:32.638 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 -- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47680678c0 msgr2=0x7f4768069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47680678c0 0x7f4768069d80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4780007fd0 tx=0x7f4780009040 comp rx=0 tx=0).stop 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 -- 172.21.15.67:0/1803578865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 msgr2=0x7f47840af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 0x7f47840af710 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f477400d830 tx=0x7f477400dcf0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 -- 172.21.15.67:0/1803578865 shutdown_connections 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478415d1d0 0x7f47840b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47680678c0 0x7f4768069d80 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f478415c030 0x7f47840afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 --2- 172.21.15.67:0/1803578865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478406f460 0x7f47840af710 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 -- 172.21.15.67:0/1803578865 >> 172.21.15.67:0/1803578865 conn(0x7f47840d0080 msgr2=0x7f47840b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 -- 172.21.15.67:0/1803578865 shutdown_connections 2024-09-19T05:44:32.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.640+0000 7f478bf91640 1 -- 172.21.15.67:0/1803578865 wait complete. 2024-09-19T05:44:32.657 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:44:32.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97d14bd640 1 Processor -- start 2024-09-19T05:44:32.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97d14bd640 1 -- start start 2024-09-19T05:44:32.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97d14bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f97cc06c130 0x7f97cc160210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97d14bd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97cc0b1d70 con 0x7f97cc06bcc0 2024-09-19T05:44:32.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97d14bd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97cc15eb90 con 0x7f97cc0b1990 2024-09-19T05:44:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97d14bd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f97cc15f950 con 0x7f97cc06c130 2024-09-19T05:44:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97ca7fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f97cc06bcc0 0x7f97cc15fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37130/0 (socket says 172.21.15.67:37130) 2024-09-19T05:44:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97ca7fc640 1 -- 172.21.15.67:0/4186714336 learned_addr learned my addr 172.21.15.67:0/4186714336 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97cb7fe640 1 --2- 172.21.15.67:0/4186714336 >> v2:172.21.15.67:3300/0 conn(0x7f97cc06c130 0x7f97cc160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97c9ffb640 1 -- 172.21.15.67:0/4186714336 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891328964 0 0) 0x7f97cc0b1d70 con 0x7f97cc06bcc0 2024-09-19T05:44:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97c9ffb640 1 -- 172.21.15.67:0/4186714336 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97b4003530 con 0x7f97cc06bcc0 2024-09-19T05:44:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97cb7fe640 1 -- 172.21.15.67:0/4186714336 >> v1:172.21.15.97:6789/0 conn(0x7f97cc0b1990 legacy=0x7f97cc0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97cb7fe640 1 -- 172.21.15.67:0/4186714336 >> v1:172.21.15.67:6789/0 conn(0x7f97cc06bcc0 legacy=0x7f97cc15fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.768+0000 7f97cb7fe640 1 -- 172.21.15.67:0/4186714336 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc15ee70 con 0x7f97cc06c130 2024-09-19T05:44:32.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97cb7fe640 1 --2- 172.21.15.67:0/4186714336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06c130 0x7f97cc160210 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009d90 tx=0x7f97c401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9234d35dcb7094b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:32.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97c9ffb640 1 -- 172.21.15.67:0/4186714336 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40b2070 con 0x7f97cc06c130 2024-09-19T05:44:32.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97c9ffb640 1 -- 172.21.15.67:0/4186714336 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c40a5920 con 0x7f97cc06c130 2024-09-19T05:44:32.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97c9ffb640 1 -- 172.21.15.67:0/4186714336 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40a5cf0 con 0x7f97cc06c130 2024-09-19T05:44:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 -- 172.21.15.67:0/4186714336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06c130 msgr2=0x7f97cc160210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 --2- 172.21.15.67:0/4186714336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06c130 0x7f97cc160210 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009d90 tx=0x7f97c401c970 comp rx=0 tx=0).stop 2024-09-19T05:44:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 -- 172.21.15.67:0/4186714336 shutdown_connections 2024-09-19T05:44:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 --2- 172.21.15.67:0/4186714336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06c130 0x7f97cc160210 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 -- 172.21.15.67:0/4186714336 >> 172.21.15.67:0/4186714336 conn(0x7f97cc09aa30 msgr2=0x7f97cc0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 -- 172.21.15.67:0/4186714336 shutdown_connections 2024-09-19T05:44:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 -- 172.21.15.67:0/4186714336 wait complete. 2024-09-19T05:44:32.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 Processor -- start 2024-09-19T05:44:32.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 -- start start 2024-09-19T05:44:32.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06bcc0 0x7f97cc152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97cc06c130 0x7f97cc158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97cc0b1990 0x7f97cc155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.772+0000 7f97d14bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0b29b0 con 0x7f97cc06bcc0 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97d14bd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc06c540 con 0x7f97cc0b1990 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97d14bd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc14f910 con 0x7f97cc06c130 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97caffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06bcc0 0x7f97cc152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97caffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06bcc0 0x7f97cc152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57240/0 (socket says 172.21.15.67:57240) 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97caffd640 1 -- 172.21.15.67:0/3130526007 learned_addr learned my addr 172.21.15.67:0/3130526007 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97caffd640 1 -- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97cc06c130 msgr2=0x7f97cc158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97caffd640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97cc06c130 0x7f97cc158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97caffd640 1 -- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97cc0b1990 msgr2=0x7f97cc155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97caffd640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97cc0b1990 0x7f97cc155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97caffd640 1 -- 172.21.15.67:0/3130526007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc14fbf0 con 0x7f97cc06bcc0 2024-09-19T05:44:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97caffd640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06bcc0 0x7f97cc152260 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f97c000c420 tx=0x7f97c000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97b37fe640 1 -- 172.21.15.67:0/3130526007 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c00052d0 con 0x7f97cc06bcc0 2024-09-19T05:44:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97b37fe640 1 -- 172.21.15.67:0/3130526007 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c0005470 con 0x7f97cc06bcc0 2024-09-19T05:44:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97d14bd640 1 -- 172.21.15.67:0/3130526007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97cc14fed0 con 0x7f97cc06bcc0 2024-09-19T05:44:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97b37fe640 1 -- 172.21.15.67:0/3130526007 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0007260 con 0x7f97cc06bcc0 2024-09-19T05:44:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97d14bd640 1 -- 172.21.15.67:0/3130526007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97cc158520 con 0x7f97cc06bcc0 2024-09-19T05:44:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97d14bd640 1 -- 172.21.15.67:0/3130526007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97cc06f030 con 0x7f97cc06bcc0 2024-09-19T05:44:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97b37fe640 1 -- 172.21.15.67:0/3130526007 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97c0007400 con 0x7f97cc06bcc0 2024-09-19T05:44:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97b37fe640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97b80678c0 0x7f97b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97b37fe640 1 -- 172.21.15.67:0/3130526007 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f97c0085360 con 0x7f97cc06bcc0 2024-09-19T05:44:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97ca7fc640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97b80678c0 0x7f97b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.776+0000 7f97ca7fc640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97b80678c0 0x7f97b8069d80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f97bc007fd0 tx=0x7f97bc007940 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:32.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.780+0000 7f97b37fe640 1 -- 172.21.15.67:0/3130526007 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f97c0055d10 con 0x7f97cc06bcc0 2024-09-19T05:44:32.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.940+0000 7f97d14bd640 1 -- 172.21.15.67:0/3130526007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97cc169760 con 0x7f97cc06bcc0 2024-09-19T05:44:32.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.940+0000 7f97b37fe640 1 -- 172.21.15.67:0/3130526007 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16924 (secure 0 0 0) 0x7f97c0055610 con 0x7f97cc06bcc0 2024-09-19T05:44:32.942 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:32.943 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":143,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:43:48.786447+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:43:44.817575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-19T05:43:46.149161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:44:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 -- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97b80678c0 msgr2=0x7f97b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97b80678c0 0x7f97b8069d80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f97bc007fd0 tx=0x7f97bc007940 comp rx=0 tx=0).stop 2024-09-19T05:44:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 -- 172.21.15.67:0/3130526007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06bcc0 msgr2=0x7f97cc152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06bcc0 0x7f97cc152260 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f97c000c420 tx=0x7f97c000c8e0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 -- 172.21.15.67:0/3130526007 shutdown_connections 2024-09-19T05:44:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97cc0b1990 0x7f97cc155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97b80678c0 0x7f97b8069d80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97cc06c130 0x7f97cc158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 --2- 172.21.15.67:0/3130526007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc06bcc0 0x7f97cc152260 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:32.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 -- 172.21.15.67:0/3130526007 >> 172.21.15.67:0/3130526007 conn(0x7f97cc09aa30 msgr2=0x7f97cc15fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:32.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 -- 172.21.15.67:0/3130526007 shutdown_connections 2024-09-19T05:44:32.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:32.944+0000 7f97d14bd640 1 -- 172.21.15.67:0/3130526007 wait complete. 2024-09-19T05:44:32.960 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:44:32.961 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:33.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9760e8b640 1 Processor -- start 2024-09-19T05:44:33.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9760e8b640 1 -- start start 2024-09-19T05:44:33.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9760e8b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c15e610 0x7f975c162a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9760e8b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f975c162fb0 con 0x7f975c15f100 2024-09-19T05:44:33.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9760e8b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f975c0cf510 con 0x7f975c0cf070 2024-09-19T05:44:33.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9760e8b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f975c0d0120 con 0x7f975c15e610 2024-09-19T05:44:33.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f975ad9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f975c15f100 0x7f975c0d2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37136/0 (socket says 172.21.15.67:37136) 2024-09-19T05:44:33.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f975ad9d640 1 -- 172.21.15.67:0/1595192992 learned_addr learned my addr 172.21.15.67:0/1595192992 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:33.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f975a59c640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c15e610 0x7f975c162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273478029 0 0) 0x7f97540014a0 con 0x7f975c15f100 2024-09-19T05:44:33.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9748003530 con 0x7f975c15f100 2024-09-19T05:44:33.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1972077843 0 0) 0x7f9748003530 con 0x7f975c15f100 2024-09-19T05:44:33.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c15e610 msgr2=0x7f975c162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:33.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c15e610 0x7f975c162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 >> v1:172.21.15.97:6789/0 conn(0x7f975c0cf070 legacy=0x7f975c15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c0cf7f0 con 0x7f975c15f100 2024-09-19T05:44:33.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9754001bd0 con 0x7f975c15f100 2024-09-19T05:44:33.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 >> v1:172.21.15.67:6789/0 conn(0x7f975c15f100 legacy=0x7f975c0d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c15e610 0x7f97480039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9748003fc0 0x7f9748004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9748004d50 0x7f97480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f975c0d0120 con 0x7f9748003fc0 2024-09-19T05:44:33.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f974800bb10 con 0x7f9748004d50 2024-09-19T05:44:33.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f974800bd10 con 0x7f975c15e610 2024-09-19T05:44:33.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9753fff640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9748003fc0 0x7f9748004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f975ad9d640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9748004d50 0x7f97480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9753fff640 1 -- 172.21.15.67:0/1595192992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c15e610 msgr2=0x7f97480039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:33.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9753fff640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c15e610 0x7f97480039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9753fff640 1 -- 172.21.15.67:0/1595192992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9748004d50 msgr2=0x7f97480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:33.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9753fff640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9748004d50 0x7f97480051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.076+0000 7f9753fff640 1 -- 172.21.15.67:0/1595192992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9748003530 con 0x7f9748003fc0 2024-09-19T05:44:33.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9753fff640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9748003fc0 0x7f9748004810 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f975c0d0860 tx=0x7f974401c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8daa126c7a9935b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:33.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97440013a0 con 0x7f9748003fc0 2024-09-19T05:44:33.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97440052f0 con 0x7f9748003fc0 2024-09-19T05:44:33.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9759d9b640 1 -- 172.21.15.67:0/1595192992 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744003840 con 0x7f9748003fc0 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 -- 172.21.15.67:0/1595192992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9748003fc0 msgr2=0x7f9748004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 --2- 172.21.15.67:0/1595192992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9748003fc0 0x7f9748004810 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f975c0d0860 tx=0x7f974401c300 comp rx=0 tx=0).stop 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f975ad9d640 1 -- 172.21.15.67:0/1595192992 reap_dead start 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 -- 172.21.15.67:0/1595192992 shutdown_connections 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 -- 172.21.15.67:0/1595192992 >> 172.21.15.67:0/1595192992 conn(0x7f975c08bfc0 msgr2=0x7f975c0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 -- 172.21.15.67:0/1595192992 shutdown_connections 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 -- 172.21.15.67:0/1595192992 wait complete. 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 Processor -- start 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 -- start start 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9748003fc0 0x7f975c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f975c0cd490 0x7f975c0b9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c0b8790 0x7f975c0b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f975c15f830 con 0x7f975c0cd490 2024-09-19T05:44:33.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f975c0cfdb0 con 0x7f9748003fc0 2024-09-19T05:44:33.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9760e8b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f975c162a70 con 0x7f975c0b8790 2024-09-19T05:44:33.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9753fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f975c0cd490 0x7f975c0b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9753fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f975c0cd490 0x7f975c0b9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57260/0 (socket says 172.21.15.67:57260) 2024-09-19T05:44:33.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9753fff640 1 -- 172.21.15.67:0/4056147457 learned_addr learned my addr 172.21.15.67:0/4056147457 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:33.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f975a59c640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9748003fc0 0x7f975c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f975ad9d640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c0b8790 0x7f975c0b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9753fff640 1 -- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c0b8790 msgr2=0x7f975c0b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9753fff640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c0b8790 0x7f975c0b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9753fff640 1 -- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9748003fc0 msgr2=0x7f975c15cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9753fff640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9748003fc0 0x7f975c15cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.080+0000 7f9753fff640 1 -- 172.21.15.67:0/4056147457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c15d150 con 0x7f975c0cd490 2024-09-19T05:44:33.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f9753fff640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f975c0cd490 0x7f975c0b9970 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f974401c7e0 tx=0x7f9748005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:33.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f9752ffd640 1 -- 172.21.15.67:0/4056147457 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97440013a0 con 0x7f975c0cd490 2024-09-19T05:44:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f9752ffd640 1 -- 172.21.15.67:0/4056147457 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97440bb070 con 0x7f975c0cd490 2024-09-19T05:44:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f9760e8b640 1 -- 172.21.15.67:0/4056147457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975c0cc9b0 con 0x7f975c0cd490 2024-09-19T05:44:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f9752ffd640 1 -- 172.21.15.67:0/4056147457 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744006a20 con 0x7f975c0cd490 2024-09-19T05:44:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f9760e8b640 1 -- 172.21.15.67:0/4056147457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975c0cd910 con 0x7f975c0cd490 2024-09-19T05:44:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f9760e8b640 1 -- 172.21.15.67:0/4056147457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975c15e9f0 con 0x7f975c0cd490 2024-09-19T05:44:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f9752ffd640 1 -- 172.21.15.67:0/4056147457 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97440b4040 con 0x7f975c0cd490 2024-09-19T05:44:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f9752ffd640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f973c0678f0 0x7f973c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f9752ffd640 1 -- 172.21.15.67:0/4056147457 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f9744120090 con 0x7f975c0cd490 2024-09-19T05:44:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f975a59c640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f973c0678f0 0x7f973c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.084+0000 7f975a59c640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f973c0678f0 0x7f973c069db0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f974c009a70 tx=0x7f974c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:33.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.088+0000 7f9752ffd640 1 -- 172.21.15.67:0/4056147457 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9744016010 con 0x7f975c0cd490 2024-09-19T05:44:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.280+0000 7f9760e8b640 1 -- 172.21.15.67:0/4056147457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f975c0c7a40 con 0x7f975c0cd490 2024-09-19T05:44:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9752ffd640 1 -- 172.21.15.67:0/4056147457 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f97440f0b60 con 0x7f975c0cd490 2024-09-19T05:44:33.283 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:33.283 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:33.283 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:33.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 -- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f973c0678f0 msgr2=0x7f973c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f973c0678f0 0x7f973c069db0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f974c009a70 tx=0x7f974c008040 comp rx=0 tx=0).stop 2024-09-19T05:44:33.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 -- 172.21.15.67:0/4056147457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f975c0cd490 msgr2=0x7f975c0b9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f975c0cd490 0x7f975c0b9970 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f974401c7e0 tx=0x7f9748005840 comp rx=0 tx=0).stop 2024-09-19T05:44:33.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 -- 172.21.15.67:0/4056147457 shutdown_connections 2024-09-19T05:44:33.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f973c0678f0 0x7f973c069db0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f975c0b8790 0x7f975c0b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f975c0cd490 0x7f975c0b9970 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 --2- 172.21.15.67:0/4056147457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9748003fc0 0x7f975c15cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 -- 172.21.15.67:0/4056147457 >> 172.21.15.67:0/4056147457 conn(0x7f975c08bfc0 msgr2=0x7f975c0b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:33.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 -- 172.21.15.67:0/4056147457 shutdown_connections 2024-09-19T05:44:33.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.284+0000 7f9760e8b640 1 -- 172.21.15.67:0/4056147457 wait complete. 2024-09-19T05:44:33.301 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:33.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c405da640 1 Processor -- start 2024-09-19T05:44:33.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c405da640 1 -- start start 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c405da640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c3815a8b0 0x7f3c380cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c405da640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3c3815f040 0x7f3c3815e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c405da640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3c3815e950 0x7f3c3806e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c405da640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3c38071070 con 0x7f3c3815f040 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c405da640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3c3815eda0 con 0x7f3c3815e950 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c405da640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3c380d0210 con 0x7f3c3815a8b0 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3db75640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3c3815f040 0x7f3c3815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3db75640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3c3815f040 0x7f3c3815e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57276/0 (socket says 172.21.15.67:57276) 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3db75640 1 -- 172.21.15.67:0/868391646 learned_addr learned my addr 172.21.15.67:0/868391646 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3eb77640 1 --2- 172.21.15.67:0/868391646 >> v2:172.21.15.97:3300/0 conn(0x7f3c3815e950 0x7f3c3806e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3e376640 1 --2- 172.21.15.67:0/868391646 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c3815a8b0 0x7f3c380cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3db75640 1 -- 172.21.15.67:0/868391646 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c3815a8b0 msgr2=0x7f3c380cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:33.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3db75640 1 --2- 172.21.15.67:0/868391646 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c3815a8b0 0x7f3c380cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3db75640 1 -- 172.21.15.67:0/868391646 >> v2:172.21.15.97:3300/0 conn(0x7f3c3815e950 msgr2=0x7f3c3806e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:33.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3db75640 1 --2- 172.21.15.67:0/868391646 >> v2:172.21.15.97:3300/0 conn(0x7f3c3815e950 0x7f3c3806e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3db75640 1 -- 172.21.15.67:0/868391646 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c380cdaa0 con 0x7f3c3815f040 2024-09-19T05:44:33.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.424+0000 7f3c3e376640 1 --2- 172.21.15.67:0/868391646 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c3815a8b0 0x7f3c380cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:33.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c3db75640 1 --2- 172.21.15.67:0/868391646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815f040 0x7f3c3815e410 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f3c3806e820 tx=0x7f3c2801d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6dfb8ff386beac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:33.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c3d374640 1 -- 172.21.15.67:0/868391646 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c280b3070 con 0x7f3c3815f040 2024-09-19T05:44:33.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c3d374640 1 -- 172.21.15.67:0/868391646 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c280a67d0 con 0x7f3c3815f040 2024-09-19T05:44:33.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c3d374640 1 -- 172.21.15.67:0/868391646 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2800b040 con 0x7f3c3815f040 2024-09-19T05:44:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c405da640 1 -- 172.21.15.67:0/868391646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815f040 msgr2=0x7f3c3815e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c405da640 1 --2- 172.21.15.67:0/868391646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815f040 0x7f3c3815e410 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f3c3806e820 tx=0x7f3c2801d8f0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c405da640 1 -- 172.21.15.67:0/868391646 shutdown_connections 2024-09-19T05:44:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c405da640 1 --2- 172.21.15.67:0/868391646 >> v2:172.21.15.97:3300/0 conn(0x7f3c3815e950 0x7f3c3806e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c405da640 1 --2- 172.21.15.67:0/868391646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815f040 0x7f3c3815e410 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c405da640 1 --2- 172.21.15.67:0/868391646 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c3815a8b0 0x7f3c380cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c405da640 1 -- 172.21.15.67:0/868391646 >> 172.21.15.67:0/868391646 conn(0x7f3c38073500 msgr2=0x7f3c3806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c405da640 1 -- 172.21.15.67:0/868391646 shutdown_connections 2024-09-19T05:44:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.428+0000 7f3c405da640 1 -- 172.21.15.67:0/868391646 wait complete. 2024-09-19T05:44:33.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 Processor -- start 2024-09-19T05:44:33.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 -- start start 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c3815a8b0 0x7f3c381640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815e950 0x7f3c38158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c3815f040 0x7f3c38159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3c380d0680 con 0x7f3c3815e950 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3c38070a40 con 0x7f3c3815a8b0 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3c380d0800 con 0x7f3c3815f040 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c3db75640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815e950 0x7f3c38158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c3db75640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815e950 0x7f3c38158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57284/0 (socket says 172.21.15.67:57284) 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c3db75640 1 -- 172.21.15.67:0/286099387 learned_addr learned my addr 172.21.15.67:0/286099387 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c3e376640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c3815a8b0 0x7f3c381640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c3db75640 1 -- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c3815f040 msgr2=0x7f3c38159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c3db75640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c3815f040 0x7f3c38159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c3db75640 1 -- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c3815a8b0 msgr2=0x7f3c381640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c3db75640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c3815a8b0 0x7f3c381640b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c3db75640 1 -- 172.21.15.67:0/286099387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3815f9c0 con 0x7f3c3815e950 2024-09-19T05:44:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c3db75640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815e950 0x7f3c38158f40 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f3c2801bfa0 tx=0x7f3c2801c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c2effd640 1 -- 172.21.15.67:0/286099387 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c280be070 con 0x7f3c3815e950 2024-09-19T05:44:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c2effd640 1 -- 172.21.15.67:0/286099387 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c280ae650 con 0x7f3c3815e950 2024-09-19T05:44:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 -- 172.21.15.67:0/286099387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3815fca0 con 0x7f3c3815e950 2024-09-19T05:44:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c2effd640 1 -- 172.21.15.67:0/286099387 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c280b3070 con 0x7f3c3815e950 2024-09-19T05:44:33.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 -- 172.21.15.67:0/286099387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c38160260 con 0x7f3c3815e950 2024-09-19T05:44:33.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c405da640 1 -- 172.21.15.67:0/286099387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c380b5d60 con 0x7f3c3815e950 2024-09-19T05:44:33.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c2effd640 1 -- 172.21.15.67:0/286099387 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c280c1070 con 0x7f3c3815e950 2024-09-19T05:44:33.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c2effd640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c1c0678f0 0x7f3c1c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.432+0000 7f3c2effd640 1 -- 172.21.15.67:0/286099387 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f3c28120030 con 0x7f3c3815e950 2024-09-19T05:44:33.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.436+0000 7f3c3e376640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c1c0678f0 0x7f3c1c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.436+0000 7f3c3e376640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c1c0678f0 0x7f3c1c069db0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3c38157860 tx=0x7f3c3000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:33.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.436+0000 7f3c2effd640 1 -- 172.21.15.67:0/286099387 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3c280c8020 con 0x7f3c3815e950 2024-09-19T05:44:33.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.636+0000 7f3c405da640 1 -- 172.21.15.67:0/286099387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c380b0de0 con 0x7f3c3815e950 2024-09-19T05:44:33.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.636+0000 7f3c2effd640 1 -- 172.21.15.67:0/286099387 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f3c280174e0 con 0x7f3c3815e950 2024-09-19T05:44:33.638 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:33.639 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":98,"btime":"2024-09-19T05:43:49:826476+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:43:47.159161+0000","modified":"2024-09-19T05:43:49.173989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/4202714855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4202714855},{"type":"v1","addr":"172.21.15.67:6835","nonce":4202714855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8514,"qdb_cluster":[8514]},"id":9}]} 2024-09-19T05:44:33.639 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 98 2024-09-19T05:44:33.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 -- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c1c0678f0 msgr2=0x7f3c1c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c1c0678f0 0x7f3c1c069db0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3c38157860 tx=0x7f3c3000b040 comp rx=0 tx=0).stop 2024-09-19T05:44:33.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 -- 172.21.15.67:0/286099387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815e950 msgr2=0x7f3c38158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815e950 0x7f3c38158f40 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f3c2801bfa0 tx=0x7f3c2801c130 comp rx=0 tx=0).stop 2024-09-19T05:44:33.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 -- 172.21.15.67:0/286099387 shutdown_connections 2024-09-19T05:44:33.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3c1c0678f0 0x7f3c1c069db0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c3815f040 0x7f3c38159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c3815e950 0x7f3c38158f40 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 --2- 172.21.15.67:0/286099387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c3815a8b0 0x7f3c381640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 -- 172.21.15.67:0/286099387 >> 172.21.15.67:0/286099387 conn(0x7f3c38073500 msgr2=0x7f3c3815cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:33.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 -- 172.21.15.67:0/286099387 shutdown_connections 2024-09-19T05:44:33.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.640+0000 7f3c405da640 1 -- 172.21.15.67:0/286099387 wait complete. 2024-09-19T05:44:33.657 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:44:33.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.780+0000 7f7f8bfef640 1 Processor -- start 2024-09-19T05:44:33.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.780+0000 7f7f8bfef640 1 -- start start 2024-09-19T05:44:33.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8bfef640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7f84159d60 0x7f7f8406ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8bfef640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8406de80 con 0x7f7f8406f460 2024-09-19T05:44:33.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8bfef640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8406e160 con 0x7f7f840b36e0 2024-09-19T05:44:33.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8bfef640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7f8406e440 con 0x7f7f84159d60 2024-09-19T05:44:33.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8958a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7f8406f460 0x7f7f840b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:37146/0 (socket says 172.21.15.67:37146) 2024-09-19T05:44:33.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8958a640 1 -- 172.21.15.67:0/3863814034 learned_addr learned my addr 172.21.15.67:0/3863814034 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:33.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f89d8b640 1 --2- 172.21.15.67:0/3863814034 >> v2:172.21.15.97:3300/0 conn(0x7f7f84159d60 0x7f7f8406ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697371007 0 0) 0x7f7f8406de80 con 0x7f7f8406f460 2024-09-19T05:44:33.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f70003530 con 0x7f7f8406f460 2024-09-19T05:44:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3418614701 0 0) 0x7f7f70003530 con 0x7f7f8406f460 2024-09-19T05:44:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 >> v2:172.21.15.97:3300/0 conn(0x7f7f84159d60 msgr2=0x7f7f8406ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 --2- 172.21.15.67:0/3863814034 >> v2:172.21.15.97:3300/0 conn(0x7f7f84159d60 0x7f7f8406ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 >> v1:172.21.15.97:6789/0 conn(0x7f7f840b36e0 legacy=0x7f7f840acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8406e720 con 0x7f7f8406f460 2024-09-19T05:44:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7f74001680 con 0x7f7f8406f460 2024-09-19T05:44:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 >> v1:172.21.15.67:6789/0 conn(0x7f7f8406f460 legacy=0x7f7f840b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 --2- 172.21.15.67:0/3863814034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f700039c0 0x7f7f70003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 --2- 172.21.15.67:0/3863814034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f70004810 0x7f7f70004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 --2- 172.21.15.67:0/3863814034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f700051d0 0x7f7f7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8406e440 con 0x7f7f70004810 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7000c070 con 0x7f7f700039c0 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7000c270 con 0x7f7f700051d0 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8958a640 1 --2- 172.21.15.67:0/3863814034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f70004810 0x7f7f70004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f89d8b640 1 --2- 172.21.15.67:0/3863814034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f700039c0 0x7f7f70003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8958a640 1 -- 172.21.15.67:0/3863814034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f700051d0 msgr2=0x7f7f7000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8958a640 1 --2- 172.21.15.67:0/3863814034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f700051d0 0x7f7f7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8958a640 1 -- 172.21.15.67:0/3863814034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f700039c0 msgr2=0x7f7f70003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8958a640 1 --2- 172.21.15.67:0/3863814034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f700039c0 0x7f7f70003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8958a640 1 -- 172.21.15.67:0/3863814034 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f70003530 con 0x7f7f70004810 2024-09-19T05:44:33.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.784+0000 7f7f8a58c640 1 -- 172.21.15.67:0/3863814034 reap_dead start 2024-09-19T05:44:33.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8958a640 1 --2- 172.21.15.67:0/3863814034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f70004810 0x7f7f70004c90 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c240 tx=0x7f7f7401f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561ccf16a24dbeee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:33.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74007d20 con 0x7f7f70004810 2024-09-19T05:44:33.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f74005ae0 con 0x7f7f70004810 2024-09-19T05:44:33.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f88d89640 1 -- 172.21.15.67:0/3863814034 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74007070 con 0x7f7f70004810 2024-09-19T05:44:33.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 -- 172.21.15.67:0/3863814034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f70004810 msgr2=0x7f7f70004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 --2- 172.21.15.67:0/3863814034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f70004810 0x7f7f70004c90 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c240 tx=0x7f7f7401f3f0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 -- 172.21.15.67:0/3863814034 shutdown_connections 2024-09-19T05:44:33.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 --2- 172.21.15.67:0/3863814034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f70004810 0x7f7f70004c90 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 -- 172.21.15.67:0/3863814034 >> 172.21.15.67:0/3863814034 conn(0x7f7f840d0080 msgr2=0x7f7f840d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:33.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 -- 172.21.15.67:0/3863814034 shutdown_connections 2024-09-19T05:44:33.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 -- 172.21.15.67:0/3863814034 wait complete. 2024-09-19T05:44:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 Processor -- start 2024-09-19T05:44:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 -- start start 2024-09-19T05:44:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f70004810 0x7f7f8414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f84150c40 0x7f7f84099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f84152810 0x7f7f84152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8406ef20 con 0x7f7f84150c40 2024-09-19T05:44:33.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8415a140 con 0x7f7f84152810 2024-09-19T05:44:33.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8406f0a0 con 0x7f7f70004810 2024-09-19T05:44:33.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8958a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f84150c40 0x7f7f84099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8958a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f84150c40 0x7f7f84099900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57302/0 (socket says 172.21.15.67:57302) 2024-09-19T05:44:33.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8958a640 1 -- 172.21.15.67:0/1660056003 learned_addr learned my addr 172.21.15.67:0/1660056003 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:33.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8a58c640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f84152810 0x7f7f84152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f89d8b640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f70004810 0x7f7f8414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8958a640 1 -- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f70004810 msgr2=0x7f7f8414e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8958a640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f70004810 0x7f7f8414e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8958a640 1 -- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f84152810 msgr2=0x7f7f84152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8958a640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f84152810 0x7f7f84152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8958a640 1 -- 172.21.15.67:0/1660056003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f841510c0 con 0x7f7f84150c40 2024-09-19T05:44:33.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8958a640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f84150c40 0x7f7f84099900 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f7f7401f220 tx=0x7f7f70005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:33.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f7a7fc640 1 -- 172.21.15.67:0/1660056003 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74007d20 con 0x7f7f84150c40 2024-09-19T05:44:33.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f7a7fc640 1 -- 172.21.15.67:0/1660056003 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f74007690 con 0x7f7f84150c40 2024-09-19T05:44:33.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f8bfef640 1 -- 172.21.15.67:0/1660056003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f84151370 con 0x7f7f84150c40 2024-09-19T05:44:33.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.788+0000 7f7f7a7fc640 1 -- 172.21.15.67:0/1660056003 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74001680 con 0x7f7f84150c40 2024-09-19T05:44:33.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.792+0000 7f7f8bfef640 1 -- 172.21.15.67:0/1660056003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f84151930 con 0x7f7f84150c40 2024-09-19T05:44:33.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.792+0000 7f7f8bfef640 1 -- 172.21.15.67:0/1660056003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f840b2fd0 con 0x7f7f84150c40 2024-09-19T05:44:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.792+0000 7f7f7a7fc640 1 -- 172.21.15.67:0/1660056003 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f740047f0 con 0x7f7f84150c40 2024-09-19T05:44:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.792+0000 7f7f7a7fc640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f680678c0 0x7f7f68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.792+0000 7f7f7a7fc640 1 -- 172.21.15.67:0/1660056003 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f7f74123140 con 0x7f7f84150c40 2024-09-19T05:44:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.792+0000 7f7f89d8b640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f680678c0 0x7f7f68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.792+0000 7f7f89d8b640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f680678c0 0x7f7f68069d80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7f800099f0 tx=0x7f7f80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:33.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.796+0000 7f7f7a7fc640 1 -- 172.21.15.67:0/1660056003 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7f74019100 con 0x7f7f84150c40 2024-09-19T05:44:33.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.964+0000 7f7f8bfef640 1 -- 172.21.15.67:0/1660056003 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f840d0f20 con 0x7f7f84150c40 2024-09-19T05:44:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f7a7fc640 1 -- 172.21.15.67:0/1660056003 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16924 (secure 0 0 0) 0x7f7f740f3b80 con 0x7f7f84150c40 2024-09-19T05:44:33.967 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:33.967 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":143,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:43:48.786447+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:43:44.817575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-19T05:43:46.149161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:44:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 -- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f680678c0 msgr2=0x7f7f68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f680678c0 0x7f7f68069d80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7f800099f0 tx=0x7f7f80008040 comp rx=0 tx=0).stop 2024-09-19T05:44:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 -- 172.21.15.67:0/1660056003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f84150c40 msgr2=0x7f7f84099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f84150c40 0x7f7f84099900 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f7f7401f220 tx=0x7f7f70005840 comp rx=0 tx=0).stop 2024-09-19T05:44:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 -- 172.21.15.67:0/1660056003 shutdown_connections 2024-09-19T05:44:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f84152810 0x7f7f84152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f84150c40 0x7f7f84099900 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f680678c0 0x7f7f68069d80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 --2- 172.21.15.67:0/1660056003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f70004810 0x7f7f8414e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 -- 172.21.15.67:0/1660056003 >> 172.21.15.67:0/1660056003 conn(0x7f7f840d0080 msgr2=0x7f7f840b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:33.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 -- 172.21.15.67:0/1660056003 shutdown_connections 2024-09-19T05:44:33.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:33.968+0000 7f7f8bfef640 1 -- 172.21.15.67:0/1660056003 wait complete. 2024-09-19T05:44:33.987 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:44:34.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.108+0000 7f4dfb266640 1 Processor -- start 2024-09-19T05:44:34.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.108+0000 7f4dfb266640 1 -- start start 2024-09-19T05:44:34.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4dfb266640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df4161da0 0x7f4df40d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4dfb266640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4df40d0e80 0x7f4df40d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4dfb266640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df40d4d40 con 0x7f4df40b41c0 2024-09-19T05:44:34.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4dfb266640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4df40d0840 con 0x7f4df40d0e80 2024-09-19T05:44:34.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4dfb266640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4df40d1800 con 0x7f4df4161da0 2024-09-19T05:44:34.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4df9002640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df4161da0 0x7f4df40d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:34.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4df8801640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4df40d0e80 0x7f4df40d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:34.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4df9002640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df4161da0 0x7f4df40d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:54334/0 (socket says 172.21.15.67:54334) 2024-09-19T05:44:34.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4df9002640 1 -- 172.21.15.67:0/3063599264 learned_addr learned my addr 172.21.15.67:0/3063599264 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:34.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4df8801640 1 -- 172.21.15.67:0/3063599264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df4161da0 msgr2=0x7f4df40d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:34.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4df8801640 1 --2- 172.21.15.67:0/3063599264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df4161da0 0x7f4df40d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4df8801640 1 -- 172.21.15.67:0/3063599264 >> v1:172.21.15.97:6789/0 conn(0x7f4df40b41c0 legacy=0x7f4df40b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:34.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4df8801640 1 -- 172.21.15.67:0/3063599264 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df40d5020 con 0x7f4df40d0e80 2024-09-19T05:44:34.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.112+0000 7f4df9002640 1 --2- 172.21.15.67:0/3063599264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df4161da0 0x7f4df40d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:44:34.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4df8801640 1 --2- 172.21.15.67:0/3063599264 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df40d0e80 0x7f4df40d12c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4de40097c0 tx=0x7f4de401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20a4eb9dd43f1dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:34.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4debfff640 1 -- 172.21.15.67:0/3063599264 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40b0070 con 0x7f4df40d0e80 2024-09-19T05:44:34.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4debfff640 1 -- 172.21.15.67:0/3063599264 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de40ab600 con 0x7f4df40d0e80 2024-09-19T05:44:34.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4debfff640 1 -- 172.21.15.67:0/3063599264 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40ab9d0 con 0x7f4df40d0e80 2024-09-19T05:44:34.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4dfb266640 1 -- 172.21.15.67:0/3063599264 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df40d0e80 msgr2=0x7f4df40d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:34.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4dfb266640 1 --2- 172.21.15.67:0/3063599264 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df40d0e80 0x7f4df40d12c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4de40097c0 tx=0x7f4de401c4a0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4dfb266640 1 -- 172.21.15.67:0/3063599264 shutdown_connections 2024-09-19T05:44:34.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4dfb266640 1 --2- 172.21.15.67:0/3063599264 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df40d0e80 0x7f4df40d12c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4dfb266640 1 --2- 172.21.15.67:0/3063599264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df4161da0 0x7f4df40d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4dfb266640 1 -- 172.21.15.67:0/3063599264 >> 172.21.15.67:0/3063599264 conn(0x7f4df408bfc0 msgr2=0x7f4df40d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:34.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4dfb266640 1 -- 172.21.15.67:0/3063599264 shutdown_connections 2024-09-19T05:44:34.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4dfb266640 1 -- 172.21.15.67:0/3063599264 wait complete. 2024-09-19T05:44:34.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4dfb266640 1 Processor -- start 2024-09-19T05:44:34.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.116+0000 7f4dfb266640 1 -- start start 2024-09-19T05:44:34.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4dfb266640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40b41c0 0x7f4df40caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4dfb266640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df40d0e80 0x7f4df415f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4dfb266640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df4161da0 0x7f4df41faa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4dfb266640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4df4162180 con 0x7f4df40b41c0 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4dfb266640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4df40b5d00 con 0x7f4df4161da0 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4dfb266640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4df416b4f0 con 0x7f4df40d0e80 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df9002640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40b41c0 0x7f4df40caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df9002640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40b41c0 0x7f4df40caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57310/0 (socket says 172.21.15.67:57310) 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df9002640 1 -- 172.21.15.67:0/1325226827 learned_addr learned my addr 172.21.15.67:0/1325226827 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df8801640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df40d0e80 0x7f4df415f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df9803640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df4161da0 0x7f4df41faa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df9002640 1 -- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df40d0e80 msgr2=0x7f4df415f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:34.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df9002640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df40d0e80 0x7f4df415f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df9002640 1 -- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df4161da0 msgr2=0x7f4df41faa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df9002640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df4161da0 0x7f4df41faa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df9002640 1 -- 172.21.15.67:0/1325226827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df415e0c0 con 0x7f4df40b41c0 2024-09-19T05:44:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df9002640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40b41c0 0x7f4df40caac0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f4df000e960 tx=0x7f4df000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4de9ffb640 1 -- 172.21.15.67:0/1325226827 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0017070 con 0x7f4df40b41c0 2024-09-19T05:44:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4de9ffb640 1 -- 172.21.15.67:0/1325226827 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df000ca00 con 0x7f4df40b41c0 2024-09-19T05:44:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4dfb266640 1 -- 172.21.15.67:0/1325226827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df415e3a0 con 0x7f4df40b41c0 2024-09-19T05:44:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4de9ffb640 1 -- 172.21.15.67:0/1325226827 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df000cdb0 con 0x7f4df40b41c0 2024-09-19T05:44:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4dfb266640 1 -- 172.21.15.67:0/1325226827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df415e960 con 0x7f4df40b41c0 2024-09-19T05:44:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4dfb266640 1 -- 172.21.15.67:0/1325226827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df40d12c0 con 0x7f4df40b41c0 2024-09-19T05:44:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4de9ffb640 1 -- 172.21.15.67:0/1325226827 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4df001a070 con 0x7f4df40b41c0 2024-09-19T05:44:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4de9ffb640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4dd80678c0 0x7f4dd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4de9ffb640 1 -- 172.21.15.67:0/1325226827 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f4df00860a0 con 0x7f4df40b41c0 2024-09-19T05:44:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.120+0000 7f4df8801640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4dd80678c0 0x7f4dd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:34.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.124+0000 7f4df8801640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4dd80678c0 0x7f4dd8069d80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4de40ad000 tx=0x7f4de4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:34.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.128+0000 7f4de9ffb640 1 -- 172.21.15.67:0/1325226827 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4df0056a50 con 0x7f4df40b41c0 2024-09-19T05:44:34.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.328+0000 7f4dfb266640 1 -- 172.21.15.67:0/1325226827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4df415ed30 con 0x7f4df40b41c0 2024-09-19T05:44:34.329 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:44:34.328+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:44:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.332+0000 7f4de9ffb640 1 -- 172.21.15.67:0/1325226827 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v99) ==== 161+0+0 (secure 0 0 0) 0x7f4df0056350 con 0x7f4df40b41c0 2024-09-19T05:44:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:44:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 -- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4dd80678c0 msgr2=0x7f4dd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4dd80678c0 0x7f4dd8069d80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4de40ad000 tx=0x7f4de4008040 comp rx=0 tx=0).stop 2024-09-19T05:44:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 -- 172.21.15.67:0/1325226827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40b41c0 msgr2=0x7f4df40caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40b41c0 0x7f4df40caac0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f4df000e960 tx=0x7f4df000ee20 comp rx=0 tx=0).stop 2024-09-19T05:44:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 -- 172.21.15.67:0/1325226827 shutdown_connections 2024-09-19T05:44:34.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df4161da0 0x7f4df41faa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4dd80678c0 0x7f4dd8069d80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df40d0e80 0x7f4df415f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 --2- 172.21.15.67:0/1325226827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40b41c0 0x7f4df40caac0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 -- 172.21.15.67:0/1325226827 >> 172.21.15.67:0/1325226827 conn(0x7f4df408bfc0 msgr2=0x7f4df40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:34.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 -- 172.21.15.67:0/1325226827 shutdown_connections 2024-09-19T05:44:34.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.336+0000 7f4dfb266640 1 -- 172.21.15.67:0/1325226827 wait complete. 2024-09-19T05:44:34.359 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:44:34.391 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:44:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa8970640 1 Processor -- start 2024-09-19T05:44:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa8970640 1 -- start start 2024-09-19T05:44:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa8970640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbfa415b1d0 0x7fbfa40adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa8970640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbfa406dfc0 0x7fbfa406f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa8970640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa40aef30 con 0x7fbfa406fea0 2024-09-19T05:44:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa8970640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa4072210 con 0x7fbfa406dfc0 2024-09-19T05:44:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa8970640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa40ae0f0 con 0x7fbfa415b1d0 2024-09-19T05:44:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa1d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbfa406dfc0 0x7fbfa406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa1d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbfa406dfc0 0x7fbfa406f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57332/0 (socket says 172.21.15.67:57332) 2024-09-19T05:44:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa1d9b640 1 -- 172.21.15.67:0/3938175983 learned_addr learned my addr 172.21.15.67:0/3938175983 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa259c640 1 --2- 172.21.15.67:0/3938175983 >> v2:172.21.15.97:3300/0 conn(0x7fbfa415b1d0 0x7fbfa40adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa1d9b640 1 -- 172.21.15.67:0/3938175983 >> v2:172.21.15.97:3300/0 conn(0x7fbfa415b1d0 msgr2=0x7fbfa40adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa1d9b640 1 --2- 172.21.15.67:0/3938175983 >> v2:172.21.15.97:3300/0 conn(0x7fbfa415b1d0 0x7fbfa40adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa1d9b640 1 -- 172.21.15.67:0/3938175983 >> v1:172.21.15.97:6789/0 conn(0x7fbfa406fea0 legacy=0x7fbfa415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:34.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.492+0000 7fbfa1d9b640 1 -- 172.21.15.67:0/3938175983 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa40ae3b0 con 0x7fbfa406dfc0 2024-09-19T05:44:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa1d9b640 1 --2- 172.21.15.67:0/3938175983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 0x7fbfa406f960 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40711d0 tx=0x7fbf9801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e84cdef47c67d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa159a640 1 -- 172.21.15.67:0/3938175983 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf980b4070 con 0x7fbfa406dfc0 2024-09-19T05:44:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa159a640 1 -- 172.21.15.67:0/3938175983 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf980a79a0 con 0x7fbfa406dfc0 2024-09-19T05:44:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa159a640 1 -- 172.21.15.67:0/3938175983 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf980a7d70 con 0x7fbfa406dfc0 2024-09-19T05:44:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 -- 172.21.15.67:0/3938175983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 msgr2=0x7fbfa406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 --2- 172.21.15.67:0/3938175983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 0x7fbfa406f960 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40711d0 tx=0x7fbf9801ebb0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 -- 172.21.15.67:0/3938175983 shutdown_connections 2024-09-19T05:44:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 --2- 172.21.15.67:0/3938175983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 0x7fbfa406f960 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 --2- 172.21.15.67:0/3938175983 >> v2:172.21.15.97:3300/0 conn(0x7fbfa415b1d0 0x7fbfa40adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 -- 172.21.15.67:0/3938175983 >> 172.21.15.67:0/3938175983 conn(0x7fbfa40b1e50 msgr2=0x7fbfa40b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 -- 172.21.15.67:0/3938175983 shutdown_connections 2024-09-19T05:44:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 -- 172.21.15.67:0/3938175983 wait complete. 2024-09-19T05:44:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 Processor -- start 2024-09-19T05:44:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 -- start start 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 0x7fbfa414e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa406fea0 0x7fbfa415c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa415b1d0 0x7fbfa415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa40b4440 con 0x7fbfa406dfc0 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa4072420 con 0x7fbfa406fea0 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa8970640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa406e850 con 0x7fbfa415b1d0 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 0x7fbfa414e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 0x7fbfa414e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57340/0 (socket says 172.21.15.67:57340) 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa259c640 1 -- 172.21.15.67:0/4212986610 learned_addr learned my addr 172.21.15.67:0/4212986610 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa259c640 1 -- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa415b1d0 msgr2=0x7fbfa415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa259c640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa415b1d0 0x7fbfa415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa259c640 1 -- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa406fea0 msgr2=0x7fbfa415c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa259c640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa406fea0 0x7fbfa415c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa259c640 1 -- 172.21.15.67:0/4212986610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa4156a40 con 0x7fbfa406dfc0 2024-09-19T05:44:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.496+0000 7fbfa259c640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 0x7fbfa414e700 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400cd00 tx=0x7fbf9400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbf92ffd640 1 -- 172.21.15.67:0/4212986610 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf940039a0 con 0x7fbfa406dfc0 2024-09-19T05:44:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbf92ffd640 1 -- 172.21.15.67:0/4212986610 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf94003b40 con 0x7fbfa406dfc0 2024-09-19T05:44:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbfa8970640 1 -- 172.21.15.67:0/4212986610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa4156d20 con 0x7fbfa406dfc0 2024-09-19T05:44:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbf92ffd640 1 -- 172.21.15.67:0/4212986610 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94004020 con 0x7fbfa406dfc0 2024-09-19T05:44:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbfa8970640 1 -- 172.21.15.67:0/4212986610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa41536c0 con 0x7fbfa406dfc0 2024-09-19T05:44:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbfa8970640 1 -- 172.21.15.67:0/4212986610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa40adbb0 con 0x7fbfa406dfc0 2024-09-19T05:44:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbf92ffd640 1 -- 172.21.15.67:0/4212986610 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbf940041c0 con 0x7fbfa406dfc0 2024-09-19T05:44:34.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbf92ffd640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf840678c0 0x7fbf84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:34.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbf92ffd640 1 -- 172.21.15.67:0/4212986610 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6187+0+0 (secure 0 0 0) 0x7fbf940863a0 con 0x7fbfa406dfc0 2024-09-19T05:44:34.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbfa1d9b640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf840678c0 0x7fbf84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:34.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.500+0000 7fbfa1d9b640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf840678c0 0x7fbf84069d80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbf980b1000 tx=0x7fbf98004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:34.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.504+0000 7fbf92ffd640 1 -- 172.21.15.67:0/4212986610 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fbf94014030 con 0x7fbfa406dfc0 2024-09-19T05:44:34.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:34.704+0000 7fbfa8970640 1 -- 172.21.15.67:0/4212986610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbfa406cf40 con 0x7fbfa406dfc0 2024-09-19T05:44:35.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.332+0000 7fbf92ffd640 1 -- 172.21.15.67:0/4212986610 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v100) ==== 104+0+0 (secure 0 0 0) 0x7fbf94056d00 con 0x7fbfa406dfc0 2024-09-19T05:44:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.336+0000 7fbfa8970640 1 -- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf840678c0 msgr2=0x7fbf84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.336+0000 7fbfa8970640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf840678c0 0x7fbf84069d80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbf980b1000 tx=0x7fbf98004740 comp rx=0 tx=0).stop 2024-09-19T05:44:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.336+0000 7fbfa8970640 1 -- 172.21.15.67:0/4212986610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 msgr2=0x7fbfa414e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.336+0000 7fbfa8970640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 0x7fbfa414e700 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400cd00 tx=0x7fbf9400a5c0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.336+0000 7fbfa8970640 1 -- 172.21.15.67:0/4212986610 shutdown_connections 2024-09-19T05:44:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.336+0000 7fbfa8970640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf840678c0 0x7fbf84069d80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.336+0000 7fbfa8970640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa415b1d0 0x7fbfa415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.336+0000 7fbfa8970640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa406fea0 0x7fbfa415c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.336+0000 7fbfa8970640 1 --2- 172.21.15.67:0/4212986610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfa406dfc0 0x7fbfa414e700 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.336+0000 7fbfa8970640 1 -- 172.21.15.67:0/4212986610 >> 172.21.15.67:0/4212986610 conn(0x7fbfa40b1e50 msgr2=0x7fbfa406f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.340+0000 7fbfa8970640 1 -- 172.21.15.67:0/4212986610 shutdown_connections 2024-09-19T05:44:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.340+0000 7fbfa8970640 1 -- 172.21.15.67:0/4212986610 wait complete. 2024-09-19T05:44:35.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:44:35.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb4adeb640 1 Processor -- start 2024-09-19T05:44:35.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb4adeb640 1 -- start start 2024-09-19T05:44:35.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb4adeb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb4406ff90 0x7ffb4415b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:35.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb4adeb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb4415bf30 0x7ffb4415d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:35.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb4adeb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb4415ca20 con 0x7ffb44141530 2024-09-19T05:44:35.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb4adeb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ffb4415cd00 con 0x7ffb4415bf30 2024-09-19T05:44:35.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb4adeb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ffb4415cfe0 con 0x7ffb4406ff90 2024-09-19T05:44:35.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb49388640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb4415bf30 0x7ffb4415d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:35.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb49388640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb4415bf30 0x7ffb4415d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57346/0 (socket says 172.21.15.67:57346) 2024-09-19T05:44:35.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb49388640 1 -- 172.21.15.67:0/378837569 learned_addr learned my addr 172.21.15.67:0/378837569 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:35.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb43fff640 1 --2- 172.21.15.67:0/378837569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb4406ff90 0x7ffb4415b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:35.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb49388640 1 -- 172.21.15.67:0/378837569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb4406ff90 msgr2=0x7ffb4415b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:35.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb49388640 1 --2- 172.21.15.67:0/378837569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb4406ff90 0x7ffb4415b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb49388640 1 -- 172.21.15.67:0/378837569 >> v1:172.21.15.97:6789/0 conn(0x7ffb44141530 legacy=0x7ffb4406f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:35.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.544+0000 7ffb49388640 1 -- 172.21.15.67:0/378837569 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4415d2c0 con 0x7ffb4415bf30 2024-09-19T05:44:35.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb49388640 1 --2- 172.21.15.67:0/378837569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb4415bf30 0x7ffb4415d7e0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00d150 tx=0x7ffb3c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e83e6a2b1283033 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:35.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb437fe640 1 -- 172.21.15.67:0/378837569 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c00b2d0 con 0x7ffb4415bf30 2024-09-19T05:44:35.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb437fe640 1 -- 172.21.15.67:0/378837569 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb3c00b470 con 0x7ffb4415bf30 2024-09-19T05:44:35.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb437fe640 1 -- 172.21.15.67:0/378837569 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c0a7ba0 con 0x7ffb4415bf30 2024-09-19T05:44:35.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/378837569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb4415bf30 msgr2=0x7ffb4415d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:35.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 --2- 172.21.15.67:0/378837569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb4415bf30 0x7ffb4415d7e0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00d150 tx=0x7ffb3c01eba0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/378837569 shutdown_connections 2024-09-19T05:44:35.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 --2- 172.21.15.67:0/378837569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb4415bf30 0x7ffb4415d7e0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 --2- 172.21.15.67:0/378837569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb4406ff90 0x7ffb4415b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/378837569 >> 172.21.15.67:0/378837569 conn(0x7ffb44073640 msgr2=0x7ffb4406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:35.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/378837569 shutdown_connections 2024-09-19T05:44:35.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/378837569 wait complete. 2024-09-19T05:44:35.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 Processor -- start 2024-09-19T05:44:35.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 -- start start 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb4406ff90 0x7ffb44152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb44141530 0x7ffb4413b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb4415bf30 0x7ffb4413b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4415e8c0 con 0x7ffb44141530 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4415e740 con 0x7ffb4415bf30 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb4adeb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ffb4415ea40 con 0x7ffb4406ff90 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb44141530 0x7ffb4413b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb44141530 0x7ffb4413b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57350/0 (socket says 172.21.15.67:57350) 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb43fff640 1 -- 172.21.15.67:0/1873931789 learned_addr learned my addr 172.21.15.67:0/1873931789 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb48b87640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb4406ff90 0x7ffb44152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb49388640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb4415bf30 0x7ffb4413b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb43fff640 1 -- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb4406ff90 msgr2=0x7ffb44152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb43fff640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb4406ff90 0x7ffb44152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb43fff640 1 -- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb4415bf30 msgr2=0x7ffb4413b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb43fff640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb4415bf30 0x7ffb4413b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb43fff640 1 -- 172.21.15.67:0/1873931789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb44139360 con 0x7ffb44141530 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb43fff640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb44141530 0x7ffb4413b3e0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000d830 tx=0x7ffb3000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.548+0000 7ffb417fa640 1 -- 172.21.15.67:0/1873931789 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000b660 con 0x7ffb44141530 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.552+0000 7ffb417fa640 1 -- 172.21.15.67:0/1873931789 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb30019070 con 0x7ffb44141530 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.552+0000 7ffb4adeb640 1 -- 172.21.15.67:0/1873931789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb441386b0 con 0x7ffb44141530 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.552+0000 7ffb417fa640 1 -- 172.21.15.67:0/1873931789 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000ba00 con 0x7ffb44141530 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.552+0000 7ffb4adeb640 1 -- 172.21.15.67:0/1873931789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb441535e0 con 0x7ffb44141530 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.552+0000 7ffb4adeb640 1 -- 172.21.15.67:0/1873931789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb4415b9f0 con 0x7ffb44141530 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.552+0000 7ffb417fa640 1 -- 172.21.15.67:0/1873931789 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb3001e460 con 0x7ffb44141530 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.552+0000 7ffb417fa640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb280678c0 0x7ffb28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.552+0000 7ffb417fa640 1 -- 172.21.15.67:0/1873931789 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6187+0+0 (secure 0 0 0) 0x7ffb30086500 con 0x7ffb44141530 2024-09-19T05:44:35.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.552+0000 7ffb48b87640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb280678c0 0x7ffb28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:35.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.552+0000 7ffb48b87640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb280678c0 0x7ffb28069d80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffb441f6240 tx=0x7ffb38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:35.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.556+0000 7ffb417fa640 1 -- 172.21.15.67:0/1873931789 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ffb30056ef0 con 0x7ffb44141530 2024-09-19T05:44:35.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:35.724+0000 7ffb4adeb640 1 -- 172.21.15.67:0/1873931789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffb440704b0 con 0x7ffb44141530 2024-09-19T05:44:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.540+0000 7ffb417fa640 1 -- 172.21.15.67:0/1873931789 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v145) ==== 181+0+0 (secure 0 0 0) 0x7ffb3005d0c0 con 0x7ffb44141530 2024-09-19T05:44:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:44:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb280678c0 msgr2=0x7ffb28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb280678c0 0x7ffb28069d80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffb441f6240 tx=0x7ffb38009040 comp rx=0 tx=0).stop 2024-09-19T05:44:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/1873931789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb44141530 msgr2=0x7ffb4413b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb44141530 0x7ffb4413b3e0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000d830 tx=0x7ffb3000dcf0 comp rx=0 tx=0).stop 2024-09-19T05:44:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/1873931789 shutdown_connections 2024-09-19T05:44:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb4415bf30 0x7ffb4413b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb44141530 0x7ffb4413b3e0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ffb280678c0 0x7ffb28069d80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 --2- 172.21.15.67:0/1873931789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb4406ff90 0x7ffb44152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/1873931789 >> 172.21.15.67:0/1873931789 conn(0x7ffb44073640 msgr2=0x7ffb44159e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:36.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/1873931789 shutdown_connections 2024-09-19T05:44:36.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.548+0000 7ffb4adeb640 1 -- 172.21.15.67:0/1873931789 wait complete. 2024-09-19T05:44:36.571 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:44:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.704+0000 7f58509bb640 1 Processor -- start 2024-09-19T05:44:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.704+0000 7f58509bb640 1 -- start start 2024-09-19T05:44:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f584c0d37a0 0x7f584c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f584c0cfe30 0x7f584c0b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584c15ead0 con 0x7f584c15e6f0 2024-09-19T05:44:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f584c0ceb40 con 0x7f584c0cfe30 2024-09-19T05:44:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f584c0ced90 con 0x7f584c0d37a0 2024-09-19T05:44:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f584c0cfe30 0x7f584c0b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f584c0cfe30 0x7f584c0b64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46866/0 (socket says 172.21.15.67:46866) 2024-09-19T05:44:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584ad9d640 1 -- 172.21.15.67:0/1785356711 learned_addr learned my addr 172.21.15.67:0/1785356711 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f5849d9b640 1 --2- 172.21.15.67:0/1785356711 >> v2:172.21.15.97:3300/0 conn(0x7f584c0d37a0 0x7f584c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584ad9d640 1 -- 172.21.15.67:0/1785356711 >> v2:172.21.15.97:3300/0 conn(0x7f584c0d37a0 msgr2=0x7f584c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584ad9d640 1 --2- 172.21.15.67:0/1785356711 >> v2:172.21.15.97:3300/0 conn(0x7f584c0d37a0 0x7f584c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584ad9d640 1 -- 172.21.15.67:0/1785356711 >> v1:172.21.15.97:6789/0 conn(0x7f584c15e6f0 legacy=0x7f584c0d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584ad9d640 1 -- 172.21.15.67:0/1785356711 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c0cf070 con 0x7f584c0cfe30 2024-09-19T05:44:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584ad9d640 1 --2- 172.21.15.67:0/1785356711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c0cfe30 0x7f584c0b64b0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f584c0c7ff0 tx=0x7f584401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0879b6babe4085 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584959a640 1 -- 172.21.15.67:0/1785356711 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440b0070 con 0x7f584c0cfe30 2024-09-19T05:44:36.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584959a640 1 -- 172.21.15.67:0/1785356711 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58440ab600 con 0x7f584c0cfe30 2024-09-19T05:44:36.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f584959a640 1 -- 172.21.15.67:0/1785356711 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440ab9d0 con 0x7f584c0cfe30 2024-09-19T05:44:36.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 -- 172.21.15.67:0/1785356711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c0cfe30 msgr2=0x7f584c0b64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:36.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 --2- 172.21.15.67:0/1785356711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c0cfe30 0x7f584c0b64b0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f584c0c7ff0 tx=0x7f584401c390 comp rx=0 tx=0).stop 2024-09-19T05:44:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 -- 172.21.15.67:0/1785356711 shutdown_connections 2024-09-19T05:44:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 --2- 172.21.15.67:0/1785356711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c0cfe30 0x7f584c0b64b0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 --2- 172.21.15.67:0/1785356711 >> v2:172.21.15.97:3300/0 conn(0x7f584c0d37a0 0x7f584c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.708+0000 7f58509bb640 1 -- 172.21.15.67:0/1785356711 >> 172.21.15.67:0/1785356711 conn(0x7f584c08bfc0 msgr2=0x7f584c0d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 -- 172.21.15.67:0/1785356711 shutdown_connections 2024-09-19T05:44:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 -- 172.21.15.67:0/1785356711 wait complete. 2024-09-19T05:44:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 Processor -- start 2024-09-19T05:44:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 -- start start 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f584c0cfe30 0x7f584c14e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f584c0d37a0 0x7f584c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c15e6f0 0x7f584c15fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f584c06d770 con 0x7f584c15e6f0 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f584c06d5f0 con 0x7f584c0d37a0 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f584c06d8f0 con 0x7f584c0cfe30 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f584ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c15e6f0 0x7f584c15fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f584ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c15e6f0 0x7f584c15fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46876/0 (socket says 172.21.15.67:46876) 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f584ad9d640 1 -- 172.21.15.67:0/627423013 learned_addr learned my addr 172.21.15.67:0/627423013 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f5849d9b640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f584c0d37a0 0x7f584c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f584a59c640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f584c0cfe30 0x7f584c14e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f584ad9d640 1 -- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f584c0cfe30 msgr2=0x7f584c14e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f584ad9d640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f584c0cfe30 0x7f584c14e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f584ad9d640 1 -- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f584c0d37a0 msgr2=0x7f584c0a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f584ad9d640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f584c0d37a0 0x7f584c0a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f584ad9d640 1 -- 172.21.15.67:0/627423013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c09f360 con 0x7f584c15e6f0 2024-09-19T05:44:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f584ad9d640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c15e6f0 0x7f584c15fd10 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f58440ae040 tx=0x7f5844019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f583affd640 1 -- 172.21.15.67:0/627423013 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440b0040 con 0x7f584c15e6f0 2024-09-19T05:44:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f583affd640 1 -- 172.21.15.67:0/627423013 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58440b9070 con 0x7f584c15e6f0 2024-09-19T05:44:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 -- 172.21.15.67:0/627423013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584c09f640 con 0x7f584c15e6f0 2024-09-19T05:44:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f583affd640 1 -- 172.21.15.67:0/627423013 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440abe60 con 0x7f584c15e6f0 2024-09-19T05:44:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.712+0000 7f58509bb640 1 -- 172.21.15.67:0/627423013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f584c0cd060 con 0x7f584c15e6f0 2024-09-19T05:44:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.716+0000 7f58509bb640 1 -- 172.21.15.67:0/627423013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f584c0d3090 con 0x7f584c15e6f0 2024-09-19T05:44:36.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.716+0000 7f583affd640 1 -- 172.21.15.67:0/627423013 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58440b4640 con 0x7f584c15e6f0 2024-09-19T05:44:36.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.716+0000 7f583affd640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f582c0678c0 0x7f582c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:36.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.716+0000 7f583affd640 1 -- 172.21.15.67:0/627423013 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5749+0+0 (secure 0 0 0) 0x7f584411f890 con 0x7f584c15e6f0 2024-09-19T05:44:36.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.716+0000 7f584a59c640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f582c0678c0 0x7f582c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:36.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.716+0000 7f584a59c640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f582c0678c0 0x7f582c069d80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f583c009f20 tx=0x7f583c0094d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:36.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.720+0000 7f583affd640 1 -- 172.21.15.67:0/627423013 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f58440160d0 con 0x7f584c15e6f0 2024-09-19T05:44:36.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:36.884+0000 7f58509bb640 1 -- 172.21.15.67:0/627423013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f584c0b6e20 con 0x7f584c15e6f0 2024-09-19T05:44:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.548+0000 7f583affd640 1 -- 172.21.15.67:0/627423013 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v146) ==== 169+0+0 (secure 0 0 0) 0x7f584411f070 con 0x7f584c15e6f0 2024-09-19T05:44:37.550 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:44:37.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.552+0000 7f58509bb640 1 -- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f582c0678c0 msgr2=0x7f582c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:37.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.552+0000 7f58509bb640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f582c0678c0 0x7f582c069d80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f583c009f20 tx=0x7f583c0094d0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.552+0000 7f58509bb640 1 -- 172.21.15.67:0/627423013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c15e6f0 msgr2=0x7f584c15fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.552+0000 7f58509bb640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c15e6f0 0x7f584c15fd10 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f58440ae040 tx=0x7f5844019130 comp rx=0 tx=0).stop 2024-09-19T05:44:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.556+0000 7f58509bb640 1 -- 172.21.15.67:0/627423013 shutdown_connections 2024-09-19T05:44:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.556+0000 7f58509bb640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c15e6f0 0x7f584c15fd10 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.556+0000 7f58509bb640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f584c0d37a0 0x7f584c0a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.556+0000 7f58509bb640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f582c0678c0 0x7f582c069d80 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.556+0000 7f58509bb640 1 --2- 172.21.15.67:0/627423013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f584c0cfe30 0x7f584c14e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.556+0000 7f58509bb640 1 -- 172.21.15.67:0/627423013 >> 172.21.15.67:0/627423013 conn(0x7f584c08bfc0 msgr2=0x7f584c0b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:37.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.556+0000 7f58509bb640 1 -- 172.21.15.67:0/627423013 shutdown_connections 2024-09-19T05:44:37.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.556+0000 7f58509bb640 1 -- 172.21.15.67:0/627423013 wait complete. 2024-09-19T05:44:37.580 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:44:37.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.716+0000 7f35cf4b2640 1 Processor -- start 2024-09-19T05:44:37.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.716+0000 7f35cf4b2640 1 -- start start 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.716+0000 7f35cf4b2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35c806ffd0 0x7f35c80aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.716+0000 7f35cf4b2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f35c80b3150 0x7f35c80af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.716+0000 7f35cf4b2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c80ad840 con 0x7f35c8159c60 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.716+0000 7f35cf4b2640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f35c80af710 con 0x7f35c806ffd0 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.716+0000 7f35cf4b2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f35c815d460 con 0x7f35c80b3150 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cd24e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f35c8159c60 0x7f35c80ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56748/0 (socket says 172.21.15.67:56748) 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cd24e640 1 -- 172.21.15.67:0/1113673123 learned_addr learned my addr 172.21.15.67:0/1113673123 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cca4d640 1 --2- 172.21.15.67:0/1113673123 >> v2:172.21.15.67:3300/0 conn(0x7f35c806ffd0 0x7f35c80aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cda4f640 1 --2- 172.21.15.67:0/1113673123 >> v2:172.21.15.97:3300/0 conn(0x7f35c80b3150 0x7f35c80af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35bffff640 1 -- 172.21.15.67:0/1113673123 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880361441 0 0) 0x7f35c80ad840 con 0x7f35c8159c60 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35bffff640 1 -- 172.21.15.67:0/1113673123 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b4003530 con 0x7f35c8159c60 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cca4d640 1 -- 172.21.15.67:0/1113673123 >> v2:172.21.15.97:3300/0 conn(0x7f35c80b3150 msgr2=0x7f35c80af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cca4d640 1 --2- 172.21.15.67:0/1113673123 >> v2:172.21.15.97:3300/0 conn(0x7f35c80b3150 0x7f35c80af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cca4d640 1 -- 172.21.15.67:0/1113673123 >> v1:172.21.15.67:6789/0 conn(0x7f35c8159c60 legacy=0x7f35c80ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:37.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cca4d640 1 -- 172.21.15.67:0/1113673123 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c815a040 con 0x7f35c806ffd0 2024-09-19T05:44:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cca4d640 1 --2- 172.21.15.67:0/1113673123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c806ffd0 0x7f35c80aec90 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f35c8071950 tx=0x7f35b801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f884abcb3a469c61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35bffff640 1 -- 172.21.15.67:0/1113673123 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80ab650 con 0x7f35c806ffd0 2024-09-19T05:44:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35bffff640 1 -- 172.21.15.67:0/1113673123 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b80b0070 con 0x7f35c806ffd0 2024-09-19T05:44:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35bffff640 1 -- 172.21.15.67:0/1113673123 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80aba10 con 0x7f35c806ffd0 2024-09-19T05:44:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cf4b2640 1 -- 172.21.15.67:0/1113673123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c806ffd0 msgr2=0x7f35c80aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cf4b2640 1 --2- 172.21.15.67:0/1113673123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c806ffd0 0x7f35c80aec90 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f35c8071950 tx=0x7f35b801c450 comp rx=0 tx=0).stop 2024-09-19T05:44:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cf4b2640 1 -- 172.21.15.67:0/1113673123 shutdown_connections 2024-09-19T05:44:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cf4b2640 1 --2- 172.21.15.67:0/1113673123 >> v2:172.21.15.97:3300/0 conn(0x7f35c80b3150 0x7f35c80af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cf4b2640 1 --2- 172.21.15.67:0/1113673123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c806ffd0 0x7f35c80aec90 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cf4b2640 1 -- 172.21.15.67:0/1113673123 >> 172.21.15.67:0/1113673123 conn(0x7f35c80b1e50 msgr2=0x7f35c80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cf4b2640 1 -- 172.21.15.67:0/1113673123 shutdown_connections 2024-09-19T05:44:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.720+0000 7f35cf4b2640 1 -- 172.21.15.67:0/1113673123 wait complete. 2024-09-19T05:44:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 Processor -- start 2024-09-19T05:44:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 -- start start 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35c806ffd0 0x7f35c814bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c80b3150 0x7f35c80cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35c8159c60 0x7f35c814f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f35c81605b0 con 0x7f35c80b3150 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f35c815d0f0 con 0x7f35c8159c60 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f35c8160730 con 0x7f35c806ffd0 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cca4d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c80b3150 0x7f35c80cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cca4d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c80b3150 0x7f35c80cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46892/0 (socket says 172.21.15.67:46892) 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cca4d640 1 -- 172.21.15.67:0/217958181 learned_addr learned my addr 172.21.15.67:0/217958181 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cda4f640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35c8159c60 0x7f35c814f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cca4d640 1 -- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35c806ffd0 msgr2=0x7f35c814bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cca4d640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35c806ffd0 0x7f35c814bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cca4d640 1 -- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35c8159c60 msgr2=0x7f35c814f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cca4d640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35c8159c60 0x7f35c814f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cca4d640 1 -- 172.21.15.67:0/217958181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c809a5f0 con 0x7f35c80b3150 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cda4f640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35c8159c60 0x7f35c814f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cca4d640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c80b3150 0x7f35c80cf370 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f35b8019060 tx=0x7f35b801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35bdffb640 1 -- 172.21.15.67:0/217958181 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80bf610 con 0x7f35c80b3150 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35bdffb640 1 -- 172.21.15.67:0/217958181 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b80bf7d0 con 0x7f35c80b3150 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 -- 172.21.15.67:0/217958181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c814c160 con 0x7f35c80b3150 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35bdffb640 1 -- 172.21.15.67:0/217958181 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80bfbc0 con 0x7f35c80b3150 2024-09-19T05:44:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 -- 172.21.15.67:0/217958181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c814c650 con 0x7f35c80b3150 2024-09-19T05:44:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.724+0000 7f35cf4b2640 1 -- 172.21.15.67:0/217958181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c8160ac0 con 0x7f35c80b3150 2024-09-19T05:44:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.728+0000 7f35bdffb640 1 -- 172.21.15.67:0/217958181 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35b80bd020 con 0x7f35c80b3150 2024-09-19T05:44:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.728+0000 7f35bdffb640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35ac0678c0 0x7f35ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.728+0000 7f35bdffb640 1 -- 172.21.15.67:0/217958181 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5335+0+0 (secure 0 0 0) 0x7f35b81205c0 con 0x7f35c80b3150 2024-09-19T05:44:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.728+0000 7f35cd24e640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35ac0678c0 0x7f35ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.728+0000 7f35cd24e640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35ac0678c0 0x7f35ac069d80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f35c4007fd0 tx=0x7f35c4007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.732+0000 7f35bdffb640 1 -- 172.21.15.67:0/217958181 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f35b8016070 con 0x7f35c80b3150 2024-09-19T05:44:37.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.896+0000 7f35cf4b2640 1 -- 172.21.15.67:0/217958181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f35c815be60 con 0x7f35c80b3150 2024-09-19T05:44:37.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.900+0000 7f35bdffb640 1 -- 172.21.15.67:0/217958181 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f35b80f11e0 con 0x7f35c80b3150 2024-09-19T05:44:37.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 -- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35ac0678c0 msgr2=0x7f35ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:37.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35ac0678c0 0x7f35ac069d80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f35c4007fd0 tx=0x7f35c4007900 comp rx=0 tx=0).stop 2024-09-19T05:44:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 -- 172.21.15.67:0/217958181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c80b3150 msgr2=0x7f35c80cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c80b3150 0x7f35c80cf370 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f35b8019060 tx=0x7f35b801ac90 comp rx=0 tx=0).stop 2024-09-19T05:44:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 -- 172.21.15.67:0/217958181 shutdown_connections 2024-09-19T05:44:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35c8159c60 0x7f35c814f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35c80b3150 0x7f35c80cf370 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35ac0678c0 0x7f35ac069d80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 --2- 172.21.15.67:0/217958181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35c806ffd0 0x7f35c814bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 -- 172.21.15.67:0/217958181 >> 172.21.15.67:0/217958181 conn(0x7f35c80b1e50 msgr2=0x7f35c815ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 -- 172.21.15.67:0/217958181 shutdown_connections 2024-09-19T05:44:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:37.904+0000 7f35cf4b2640 1 -- 172.21.15.67:0/217958181 wait complete. 2024-09-19T05:44:37.921 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-19T05:44:38.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a8813a640 1 Processor -- start 2024-09-19T05:44:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a8813a640 1 -- start start 2024-09-19T05:44:38.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a8813a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8006f460 0x7f3a8006f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a8813a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8006e3c0 con 0x7f3a8006dde0 2024-09-19T05:44:38.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a8813a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8006e6a0 con 0x7f3a8015c030 2024-09-19T05:44:38.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a8813a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8006e980 con 0x7f3a8006f460 2024-09-19T05:44:38.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a856d5640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3a8006dde0 0x7f3a800b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56758/0 (socket says 172.21.15.67:56758) 2024-09-19T05:44:38.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a856d5640 1 -- 172.21.15.67:0/3015115186 learned_addr learned my addr 172.21.15.67:0/3015115186 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a866d7640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8006f460 0x7f3a8006f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093725210 0 0) 0x7f3a8006e3c0 con 0x7f3a8006dde0 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a6c003530 con 0x7f3a8006dde0 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1182254273 0 0) 0x7f3a6c003530 con 0x7f3a8006dde0 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8006f460 msgr2=0x7f3a8006f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8006f460 0x7f3a8006f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 >> v1:172.21.15.97:6789/0 conn(0x7f3a8015c030 legacy=0x7f3a8015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8006ec60 con 0x7f3a8006dde0 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3a70001680 con 0x7f3a8006dde0 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 >> v1:172.21.15.67:6789/0 conn(0x7f3a8006dde0 legacy=0x7f3a800b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8006f460 0x7f3a6c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c003f70 0x7f3a6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a6c004d50 0x7f3a6c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8006e980 con 0x7f3a6c004d50 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c00bab0 con 0x7f3a6c003f70 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3a6c00bcb0 con 0x7f3a8006f460 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a866d7640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a6c004d50 0x7f3a6c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a856d5640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c003f70 0x7f3a6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a85ed6640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8006f460 0x7f3a6c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a866d7640 1 -- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8006f460 msgr2=0x7f3a6c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a866d7640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8006f460 0x7f3a6c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a866d7640 1 -- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c003f70 msgr2=0x7f3a6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a866d7640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c003f70 0x7f3a6c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.044+0000 7f3a866d7640 1 -- 172.21.15.67:0/3015115186 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c003530 con 0x7f3a6c004d50 2024-09-19T05:44:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a866d7640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a6c004d50 0x7f3a6c0051d0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009fc0 tx=0x7f3a7801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f34b70adee8e206 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780b2070 con 0x7f3a6c004d50 2024-09-19T05:44:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a780a5c90 con 0x7f3a6c004d50 2024-09-19T05:44:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a84ed4640 1 -- 172.21.15.67:0/3015115186 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78009c10 con 0x7f3a6c004d50 2024-09-19T05:44:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 -- 172.21.15.67:0/3015115186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a6c004d50 msgr2=0x7f3a6c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 --2- 172.21.15.67:0/3015115186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a6c004d50 0x7f3a6c0051d0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009fc0 tx=0x7f3a7801cc80 comp rx=0 tx=0).stop 2024-09-19T05:44:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a866d7640 1 -- 172.21.15.67:0/3015115186 reap_dead start 2024-09-19T05:44:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 -- 172.21.15.67:0/3015115186 shutdown_connections 2024-09-19T05:44:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 -- 172.21.15.67:0/3015115186 >> 172.21.15.67:0/3015115186 conn(0x7f3a800d0080 msgr2=0x7f3a800d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 -- 172.21.15.67:0/3015115186 shutdown_connections 2024-09-19T05:44:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 -- 172.21.15.67:0/3015115186 wait complete. 2024-09-19T05:44:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 Processor -- start 2024-09-19T05:44:38.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 -- start start 2024-09-19T05:44:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c004d50 0x7f3a8009a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a80158840 0x7f3a80151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8009c770 0x7f3a8009d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a800b36e0 con 0x7f3a80158840 2024-09-19T05:44:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8015c410 con 0x7f3a6c004d50 2024-09-19T05:44:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a8813a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3a801538c0 con 0x7f3a8009c770 2024-09-19T05:44:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a856d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a80158840 0x7f3a80151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a856d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a80158840 0x7f3a80151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46908/0 (socket says 172.21.15.67:46908) 2024-09-19T05:44:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.048+0000 7f3a856d5640 1 -- 172.21.15.67:0/2183162624 learned_addr learned my addr 172.21.15.67:0/2183162624 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a85ed6640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c004d50 0x7f3a8009a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a856d5640 1 -- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8009c770 msgr2=0x7f3a8009d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a856d5640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8009c770 0x7f3a8009d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a856d5640 1 -- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c004d50 msgr2=0x7f3a8009a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a856d5640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c004d50 0x7f3a8009a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a856d5640 1 -- 172.21.15.67:0/2183162624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8009d2b0 con 0x7f3a80158840 2024-09-19T05:44:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a856d5640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a80158840 0x7f3a80151620 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f3a70007310 tx=0x7f3a700077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a767fc640 1 -- 172.21.15.67:0/2183162624 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7000f8e0 con 0x7f3a80158840 2024-09-19T05:44:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a767fc640 1 -- 172.21.15.67:0/2183162624 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a70018070 con 0x7f3a80158840 2024-09-19T05:44:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a8813a640 1 -- 172.21.15.67:0/2183162624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8009cfd0 con 0x7f3a80158840 2024-09-19T05:44:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a767fc640 1 -- 172.21.15.67:0/2183162624 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7000fce0 con 0x7f3a80158840 2024-09-19T05:44:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a8813a640 1 -- 172.21.15.67:0/2183162624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a80153550 con 0x7f3a80158840 2024-09-19T05:44:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a8813a640 1 -- 172.21.15.67:0/2183162624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a8006e2b0 con 0x7f3a80158840 2024-09-19T05:44:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a767fc640 1 -- 172.21.15.67:0/2183162624 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a7001d460 con 0x7f3a80158840 2024-09-19T05:44:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a767fc640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a640678c0 0x7f3a64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a767fc640 1 -- 172.21.15.67:0/2183162624 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5335+0+0 (secure 0 0 0) 0x7f3a70085b50 con 0x7f3a80158840 2024-09-19T05:44:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a85ed6640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a640678c0 0x7f3a64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.052+0000 7f3a85ed6640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a640678c0 0x7f3a64069d80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3a801f56a0 tx=0x7f3a7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:38.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.056+0000 7f3a767fc640 1 -- 172.21.15.67:0/2183162624 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3a70056890 con 0x7f3a80158840 2024-09-19T05:44:38.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.284+0000 7f3a8813a640 1 -- 172.21.15.67:0/2183162624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f3a8015b680 con 0x7f3a80158840 2024-09-19T05:44:38.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.552+0000 7f3a767fc640 1 -- 172.21.15.67:0/2183162624 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v511) ==== 155+0+0 (secure 0 0 0) 0x7f3a70056190 con 0x7f3a80158840 2024-09-19T05:44:38.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 -- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a640678c0 msgr2=0x7f3a64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a640678c0 0x7f3a64069d80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3a801f56a0 tx=0x7f3a7c009040 comp rx=0 tx=0).stop 2024-09-19T05:44:38.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 -- 172.21.15.67:0/2183162624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a80158840 msgr2=0x7f3a80151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a80158840 0x7f3a80151620 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f3a70007310 tx=0x7f3a700077d0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 -- 172.21.15.67:0/2183162624 shutdown_connections 2024-09-19T05:44:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3a640678c0 0x7f3a64069d80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a8009c770 0x7f3a8009d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a80158840 0x7f3a80151620 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 --2- 172.21.15.67:0/2183162624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c004d50 0x7f3a8009a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 -- 172.21.15.67:0/2183162624 >> 172.21.15.67:0/2183162624 conn(0x7f3a800d0080 msgr2=0x7f3a8015c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 -- 172.21.15.67:0/2183162624 shutdown_connections 2024-09-19T05:44:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.556+0000 7f3a8813a640 1 -- 172.21.15.67:0/2183162624 wait complete. 2024-09-19T05:44:38.575 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-19T05:44:38.575 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-19T05:44:38.576 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:44:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.700+0000 7f29d53f5640 1 Processor -- start 2024-09-19T05:44:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.700+0000 7f29d53f5640 1 -- start start 2024-09-19T05:44:38.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29d53f5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29d015c030 0x7f29d006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29d53f5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d006e3c0 con 0x7f29d006f460 2024-09-19T05:44:38.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29d53f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d006e6a0 con 0x7f29d015d1d0 2024-09-19T05:44:38.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29d53f5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f29d006e980 con 0x7f29d015c030 2024-09-19T05:44:38.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29ceffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29d015c030 0x7f29d006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29cf7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f29d006f460 0x7f29d00acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56764/0 (socket says 172.21.15.67:56764) 2024-09-19T05:44:38.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29cf7fe640 1 -- 172.21.15.67:0/3763401483 learned_addr learned my addr 172.21.15.67:0/3763401483 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:38.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29cdffb640 1 -- 172.21.15.67:0/3763401483 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2548220675 0 0) 0x7f29d006e3c0 con 0x7f29d006f460 2024-09-19T05:44:38.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29cdffb640 1 -- 172.21.15.67:0/3763401483 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29bc003530 con 0x7f29d006f460 2024-09-19T05:44:38.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29ceffd640 1 -- 172.21.15.67:0/3763401483 >> v1:172.21.15.97:6789/0 conn(0x7f29d015d1d0 legacy=0x7f29d00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:38.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29ceffd640 1 -- 172.21.15.67:0/3763401483 >> v1:172.21.15.67:6789/0 conn(0x7f29d006f460 legacy=0x7f29d00acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29ceffd640 1 -- 172.21.15.67:0/3763401483 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d006ec60 con 0x7f29d015c030 2024-09-19T05:44:38.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29ceffd640 1 --2- 172.21.15.67:0/3763401483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015c030 0x7f29d006dde0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009d90 tx=0x7f29c001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20eff7e9513a896f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:38.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.704+0000 7f29cdffb640 1 -- 172.21.15.67:0/3763401483 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c00b2070 con 0x7f29d015c030 2024-09-19T05:44:38.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29cdffb640 1 -- 172.21.15.67:0/3763401483 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c00a5920 con 0x7f29d015c030 2024-09-19T05:44:38.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29cdffb640 1 -- 172.21.15.67:0/3763401483 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c00a5cf0 con 0x7f29d015c030 2024-09-19T05:44:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- 172.21.15.67:0/3763401483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015c030 msgr2=0x7f29d006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 --2- 172.21.15.67:0/3763401483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015c030 0x7f29d006dde0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009d90 tx=0x7f29c001c940 comp rx=0 tx=0).stop 2024-09-19T05:44:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- 172.21.15.67:0/3763401483 shutdown_connections 2024-09-19T05:44:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 --2- 172.21.15.67:0/3763401483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015c030 0x7f29d006dde0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- 172.21.15.67:0/3763401483 >> 172.21.15.67:0/3763401483 conn(0x7f29d00d0080 msgr2=0x7f29d00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- 172.21.15.67:0/3763401483 shutdown_connections 2024-09-19T05:44:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- 172.21.15.67:0/3763401483 wait complete. 2024-09-19T05:44:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 Processor -- start 2024-09-19T05:44:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- start start 2024-09-19T05:44:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d006f460 0x7f29d009a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015d1d0 0x7f29d0149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29d014de30 0x7f29d009d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f29d015c590 con 0x7f29d015d1d0 2024-09-19T05:44:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f29d015c410 con 0x7f29d006f460 2024-09-19T05:44:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f29d00ad6c0 con 0x7f29d014de30 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29ce7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015d1d0 0x7f29d0149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29ce7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015d1d0 0x7f29d0149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46920/0 (socket says 172.21.15.67:46920) 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29ce7fc640 1 -- 172.21.15.67:0/2338737635 learned_addr learned my addr 172.21.15.67:0/2338737635 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29ceffd640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d006f460 0x7f29d009a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29cf7fe640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29d014de30 0x7f29d009d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29ce7fc640 1 -- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29d014de30 msgr2=0x7f29d009d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29ce7fc640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29d014de30 0x7f29d009d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29ce7fc640 1 -- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d006f460 msgr2=0x7f29d009a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29ce7fc640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d006f460 0x7f29d009a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29ce7fc640 1 -- 172.21.15.67:0/2338737635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d014a360 con 0x7f29d015d1d0 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29ce7fc640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015d1d0 0x7f29d0149270 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c370 tx=0x7f29b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29c77fe640 1 -- 172.21.15.67:0/2338737635 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b80052d0 con 0x7f29d015d1d0 2024-09-19T05:44:38.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29c77fe640 1 -- 172.21.15.67:0/2338737635 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b8005470 con 0x7f29d015d1d0 2024-09-19T05:44:38.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- 172.21.15.67:0/2338737635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d014a640 con 0x7f29d015d1d0 2024-09-19T05:44:38.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29c77fe640 1 -- 172.21.15.67:0/2338737635 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8007260 con 0x7f29d015d1d0 2024-09-19T05:44:38.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.708+0000 7f29d53f5640 1 -- 172.21.15.67:0/2338737635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d014ac00 con 0x7f29d015d1d0 2024-09-19T05:44:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.712+0000 7f29d53f5640 1 -- 172.21.15.67:0/2338737635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d01497b0 con 0x7f29d015d1d0 2024-09-19T05:44:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.712+0000 7f29c77fe640 1 -- 172.21.15.67:0/2338737635 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29b8007400 con 0x7f29d015d1d0 2024-09-19T05:44:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.712+0000 7f29c77fe640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29b00678c0 0x7f29b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.712+0000 7f29c77fe640 1 -- 172.21.15.67:0/2338737635 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5335+0+0 (secure 0 0 0) 0x7f29b8084ef0 con 0x7f29d015d1d0 2024-09-19T05:44:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.712+0000 7f29ceffd640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29b00678c0 0x7f29b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.712+0000 7f29ceffd640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29b00678c0 0x7f29b0069d80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f29c00af000 tx=0x7f29c00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:38.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.716+0000 7f29c77fe640 1 -- 172.21.15.67:0/2338737635 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f29b8055550 con 0x7f29d015d1d0 2024-09-19T05:44:38.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.880+0000 7f29d53f5640 1 -- 172.21.15.67:0/2338737635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29d00d0f20 con 0x7f29d015d1d0 2024-09-19T05:44:38.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29c77fe640 1 -- 172.21.15.67:0/2338737635 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+13279 (secure 0 0 0) 0x7f29b8059850 con 0x7f29d015d1d0 2024-09-19T05:44:38.883 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:38.884 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":146,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:44:37.547382+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/4202714855":"2024-09-20T05:44:34.334024+0000","172.21.15.67:6834/4202714855":"2024-09-20T05:44:34.334024+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:44:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 -- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29b00678c0 msgr2=0x7f29b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29b00678c0 0x7f29b0069d80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f29c00af000 tx=0x7f29c00a7070 comp rx=0 tx=0).stop 2024-09-19T05:44:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 -- 172.21.15.67:0/2338737635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015d1d0 msgr2=0x7f29d0149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015d1d0 0x7f29d0149270 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c370 tx=0x7f29b800c830 comp rx=0 tx=0).stop 2024-09-19T05:44:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 -- 172.21.15.67:0/2338737635 shutdown_connections 2024-09-19T05:44:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f29b00678c0 0x7f29b0069d80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29d014de30 0x7f29d009d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29d015d1d0 0x7f29d0149270 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 --2- 172.21.15.67:0/2338737635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d006f460 0x7f29d009a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:38.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 -- 172.21.15.67:0/2338737635 >> 172.21.15.67:0/2338737635 conn(0x7f29d00d0080 msgr2=0x7f29d00cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:38.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 -- 172.21.15.67:0/2338737635 shutdown_connections 2024-09-19T05:44:38.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:38.884+0000 7f29d53f5640 1 -- 172.21.15.67:0/2338737635 wait complete. 2024-09-19T05:44:38.904 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:44:38.904 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:44:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b3612d640 1 Processor -- start 2024-09-19T05:44:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b3612d640 1 -- start start 2024-09-19T05:44:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b3612d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b30159c60 0x7f7b300ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b3612d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b3015a040 con 0x7f7b3006ffd0 2024-09-19T05:44:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b3612d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b3015c850 con 0x7f7b300af3a0 2024-09-19T05:44:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b3612d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3015d460 con 0x7f7b30159c60 2024-09-19T05:44:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2effd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7b3006ffd0 0x7f7b300aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56780/0 (socket says 172.21.15.67:56780) 2024-09-19T05:44:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2effd640 1 -- 172.21.15.67:0/689527728 learned_addr learned my addr 172.21.15.67:0/689527728 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2f7fe640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b30159c60 0x7f7b300ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1390161080 0 0) 0x7f7b3015a040 con 0x7f7b3006ffd0 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b18003530 con 0x7f7b3006ffd0 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 276734693 0 0) 0x7f7b3015c850 con 0x7f7b300af3a0 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b3015a040 con 0x7f7b300af3a0 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2874988443 0 0) 0x7f7b18003530 con 0x7f7b3006ffd0 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b30159c60 msgr2=0x7f7b300ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b30159c60 0x7f7b300ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 >> v1:172.21.15.97:6789/0 conn(0x7f7b300af3a0 legacy=0x7f7b3015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3015cb30 con 0x7f7b3006ffd0 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7b24001680 con 0x7f7b3006ffd0 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 >> v1:172.21.15.67:6789/0 conn(0x7f7b3006ffd0 legacy=0x7f7b300aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b18003b80 0x7f7b18003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b30159c60 0x7f7b18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b18004d50 0x7f7b180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3015d460 con 0x7f7b18004d50 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1800ba80 con 0x7f7b18003b80 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1800bc30 con 0x7f7b30159c60 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2ffff640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b18004d50 0x7f7b180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2effd640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b30159c60 0x7f7b18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2f7fe640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b18003b80 0x7f7b18003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2ffff640 1 -- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b30159c60 msgr2=0x7f7b18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2ffff640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b30159c60 0x7f7b18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2ffff640 1 -- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b18003b80 msgr2=0x7f7b18003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2ffff640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b18003b80 0x7f7b18003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2ffff640 1 -- 172.21.15.67:0/689527728 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b18003530 con 0x7f7b18004d50 2024-09-19T05:44:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.028+0000 7f7b2f7fe640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b18003b80 0x7f7b18003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b2ffff640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b18004d50 0x7f7b180051d0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f7b28001fd0 tx=0x7f7b2801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4f0c1aa00ed6c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b28001c20 con 0x7f7b18004d50 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b28003ba0 con 0x7f7b18004d50 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b2e7fc640 1 -- 172.21.15.67:0/689527728 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b280050d0 con 0x7f7b18004d50 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b3612d640 1 -- 172.21.15.67:0/689527728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b18004d50 msgr2=0x7f7b180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b3612d640 1 --2- 172.21.15.67:0/689527728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b18004d50 0x7f7b180051d0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f7b28001fd0 tx=0x7f7b2801c900 comp rx=0 tx=0).stop 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b2ffff640 1 -- 172.21.15.67:0/689527728 reap_dead start 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b3612d640 1 -- 172.21.15.67:0/689527728 shutdown_connections 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b3612d640 1 -- 172.21.15.67:0/689527728 >> 172.21.15.67:0/689527728 conn(0x7f7b300b1e50 msgr2=0x7f7b300b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b3612d640 1 -- 172.21.15.67:0/689527728 shutdown_connections 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b3612d640 1 -- 172.21.15.67:0/689527728 wait complete. 2024-09-19T05:44:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b3612d640 1 Processor -- start 2024-09-19T05:44:39.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.032+0000 7f7b3612d640 1 -- start start 2024-09-19T05:44:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b3612d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b3014b540 0x7f7b30072f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b3612d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b920 0x7f7b300b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b3612d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b301f4aa0 0x7f7b301546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b3612d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7b300b3150 con 0x7f7b3014b920 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b3612d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3015d0f0 con 0x7f7b3014b540 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b3612d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7b300b32d0 con 0x7f7b301f4aa0 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b920 0x7f7b300b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b920 0x7f7b300b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46940/0 (socket says 172.21.15.67:46940) 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2effd640 1 -- 172.21.15.67:0/1216847108 learned_addr learned my addr 172.21.15.67:0/1216847108 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2f7fe640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b3014b540 0x7f7b30072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2ffff640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b301f4aa0 0x7f7b301546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2effd640 1 -- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b301f4aa0 msgr2=0x7f7b301546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2effd640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b301f4aa0 0x7f7b301546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2effd640 1 -- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b3014b540 msgr2=0x7f7b30072f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2effd640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b3014b540 0x7f7b30072f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2effd640 1 -- 172.21.15.67:0/1216847108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b300734b0 con 0x7f7b3014b920 2024-09-19T05:44:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2effd640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b920 0x7f7b300b3e00 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7b240017f0 tx=0x7f7b24011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b17fff640 1 -- 172.21.15.67:0/1216847108 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24010040 con 0x7f7b3014b920 2024-09-19T05:44:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b17fff640 1 -- 172.21.15.67:0/1216847108 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2401a070 con 0x7f7b3014b920 2024-09-19T05:44:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b17fff640 1 -- 172.21.15.67:0/1216847108 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400fd60 con 0x7f7b3014b920 2024-09-19T05:44:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b3612d640 1 -- 172.21.15.67:0/1216847108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b300721b0 con 0x7f7b3014b920 2024-09-19T05:44:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b3612d640 1 -- 172.21.15.67:0/1216847108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b30072770 con 0x7f7b3014b920 2024-09-19T05:44:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b3612d640 1 -- 172.21.15.67:0/1216847108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b300aec90 con 0x7f7b3014b920 2024-09-19T05:44:39.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b17fff640 1 -- 172.21.15.67:0/1216847108 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b2401f460 con 0x7f7b3014b920 2024-09-19T05:44:39.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b17fff640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7b1c0678f0 0x7f7b1c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b17fff640 1 -- 172.21.15.67:0/1216847108 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5335+0+0 (secure 0 0 0) 0x7f7b24088d20 con 0x7f7b3014b920 2024-09-19T05:44:39.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.036+0000 7f7b2f7fe640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7b1c0678f0 0x7f7b1c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.040+0000 7f7b2f7fe640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7b1c0678f0 0x7f7b1c069db0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009ae0 tx=0x7f7b20008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:39.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.040+0000 7f7b17fff640 1 -- 172.21.15.67:0/1216847108 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7b24059930 con 0x7f7b3014b920 2024-09-19T05:44:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.200+0000 7f7b3612d640 1 -- 172.21.15.67:0/1216847108 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7b3015e7a0 con 0x7f7b3014b920 2024-09-19T05:44:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.200+0000 7f7b17fff640 1 -- 172.21.15.67:0/1216847108 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) ==== 93+0+10 (secure 0 0 0) 0x7f7b24059230 con 0x7f7b3014b920 2024-09-19T05:44:39.202 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:44:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 -- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7b1c0678f0 msgr2=0x7f7b1c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7b1c0678f0 0x7f7b1c069db0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009ae0 tx=0x7f7b20008040 comp rx=0 tx=0).stop 2024-09-19T05:44:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 -- 172.21.15.67:0/1216847108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b920 msgr2=0x7f7b300b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b920 0x7f7b300b3e00 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7b240017f0 tx=0x7f7b24011c80 comp rx=0 tx=0).stop 2024-09-19T05:44:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 -- 172.21.15.67:0/1216847108 shutdown_connections 2024-09-19T05:44:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7b1c0678f0 0x7f7b1c069db0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b301f4aa0 0x7f7b301546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b3014b920 0x7f7b300b3e00 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 --2- 172.21.15.67:0/1216847108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b3014b540 0x7f7b30072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 -- 172.21.15.67:0/1216847108 >> 172.21.15.67:0/1216847108 conn(0x7f7b300b1e50 msgr2=0x7f7b3015b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 -- 172.21.15.67:0/1216847108 shutdown_connections 2024-09-19T05:44:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.204+0000 7f7b3612d640 1 -- 172.21.15.67:0/1216847108 wait complete. 2024-09-19T05:44:39.220 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-19T05:44:39.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d4e625640 1 Processor -- start 2024-09-19T05:44:39.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d4e625640 1 -- start start 2024-09-19T05:44:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d4e625640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0d4815a8b0 0x7f0d480cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d4e625640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0d4815eb20 0x7f0d480b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d4e625640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d480cdaa0 con 0x7f0d4815f040 2024-09-19T05:44:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d4e625640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0d48071070 con 0x7f0d4815a8b0 2024-09-19T05:44:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d4e625640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0d480d0210 con 0x7f0d4815eb20 2024-09-19T05:44:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d47fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0d4815a8b0 0x7f0d480cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d47fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0d4815a8b0 0x7f0d480cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46952/0 (socket says 172.21.15.67:46952) 2024-09-19T05:44:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d47fff640 1 -- 172.21.15.67:0/3623656113 learned_addr learned my addr 172.21.15.67:0/3623656113 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d47fff640 1 -- 172.21.15.67:0/3623656113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0d4815eb20 msgr2=0x7f0d480b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d47fff640 1 --2- 172.21.15.67:0/3623656113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0d4815eb20 0x7f0d480b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d47fff640 1 -- 172.21.15.67:0/3623656113 >> v1:172.21.15.97:6789/0 conn(0x7f0d4815f040 legacy=0x7f0d4815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d47fff640 1 -- 172.21.15.67:0/3623656113 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4815ac90 con 0x7f0d4815a8b0 2024-09-19T05:44:39.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.360+0000 7f0d47fff640 1 --2- 172.21.15.67:0/3623656113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 0x7f0d480cd560 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009870 tx=0x7f0d3c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777beec5f5041a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:39.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d46ffd640 1 -- 172.21.15.67:0/3623656113 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0b0070 con 0x7f0d4815a8b0 2024-09-19T05:44:39.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d46ffd640 1 -- 172.21.15.67:0/3623656113 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0ab600 con 0x7f0d4815a8b0 2024-09-19T05:44:39.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d46ffd640 1 -- 172.21.15.67:0/3623656113 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0ab9d0 con 0x7f0d4815a8b0 2024-09-19T05:44:39.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- 172.21.15.67:0/3623656113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 msgr2=0x7f0d480cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:39.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 --2- 172.21.15.67:0/3623656113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 0x7f0d480cd560 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009870 tx=0x7f0d3c01c510 comp rx=0 tx=0).stop 2024-09-19T05:44:39.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- 172.21.15.67:0/3623656113 shutdown_connections 2024-09-19T05:44:39.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 --2- 172.21.15.67:0/3623656113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0d4815eb20 0x7f0d480b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 --2- 172.21.15.67:0/3623656113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 0x7f0d480cd560 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- 172.21.15.67:0/3623656113 >> 172.21.15.67:0/3623656113 conn(0x7f0d48073500 msgr2=0x7f0d4806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:39.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- 172.21.15.67:0/3623656113 shutdown_connections 2024-09-19T05:44:39.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- 172.21.15.67:0/3623656113 wait complete. 2024-09-19T05:44:39.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 Processor -- start 2024-09-19T05:44:39.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- start start 2024-09-19T05:44:39.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 0x7f0d4815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0d4815eb20 0x7f0d4815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d4815f040 0x7f0d4814a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0d480d06a0 con 0x7f0d4815a8b0 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0d48070a40 con 0x7f0d4815f040 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4815d630 con 0x7f0d4815eb20 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 0x7f0d4815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 0x7f0d4815ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46962/0 (socket says 172.21.15.67:46962) 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d47fff640 1 -- 172.21.15.67:0/1021575569 learned_addr learned my addr 172.21.15.67:0/1021575569 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4cbc2640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d4815f040 0x7f0d4814a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d477fe640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0d4815eb20 0x7f0d4815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d47fff640 1 -- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0d4815eb20 msgr2=0x7f0d4815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d47fff640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0d4815eb20 0x7f0d4815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d47fff640 1 -- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d4815f040 msgr2=0x7f0d4814a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d47fff640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d4815f040 0x7f0d4814a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d47fff640 1 -- 172.21.15.67:0/1021575569 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4815ca20 con 0x7f0d4815a8b0 2024-09-19T05:44:39.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4cbc2640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d4815f040 0x7f0d4814a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:39.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d477fe640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0d4815eb20 0x7f0d4815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:39.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d47fff640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 0x7f0d4815ba60 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c01abc0 tx=0x7f0d3c0192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:39.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d44ff9640 1 -- 172.21.15.67:0/1021575569 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0b0040 con 0x7f0d4815a8b0 2024-09-19T05:44:39.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d44ff9640 1 -- 172.21.15.67:0/1021575569 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0b6660 con 0x7f0d4815a8b0 2024-09-19T05:44:39.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- 172.21.15.67:0/1021575569 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4815cd00 con 0x7f0d4815a8b0 2024-09-19T05:44:39.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d44ff9640 1 -- 172.21.15.67:0/1021575569 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0b6a50 con 0x7f0d4815a8b0 2024-09-19T05:44:39.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.364+0000 7f0d4e625640 1 -- 172.21.15.67:0/1021575569 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d4815d2c0 con 0x7f0d4815a8b0 2024-09-19T05:44:39.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.368+0000 7f0d4e625640 1 -- 172.21.15.67:0/1021575569 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d480cd560 con 0x7f0d4815a8b0 2024-09-19T05:44:39.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.368+0000 7f0d44ff9640 1 -- 172.21.15.67:0/1021575569 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d3c0bd060 con 0x7f0d4815a8b0 2024-09-19T05:44:39.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.368+0000 7f0d44ff9640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0d340678c0 0x7f0d34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:39.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.368+0000 7f0d44ff9640 1 -- 172.21.15.67:0/1021575569 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5335+0+0 (secure 0 0 0) 0x7f0d3c11f880 con 0x7f0d4815a8b0 2024-09-19T05:44:39.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.368+0000 7f0d477fe640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0d340678c0 0x7f0d34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:39.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.368+0000 7f0d477fe640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0d340678c0 0x7f0d34069d80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0d4814ec90 tx=0x7f0d38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:39.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.372+0000 7f0d44ff9640 1 -- 172.21.15.67:0/1021575569 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0d3c016130 con 0x7f0d4815a8b0 2024-09-19T05:44:39.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:39.600+0000 7f0d4e625640 1 -- 172.21.15.67:0/1021575569 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f0d480b0620 con 0x7f0d4815a8b0 2024-09-19T05:44:40.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.564+0000 7f0d44ff9640 1 -- 172.21.15.67:0/1021575569 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v513) ==== 169+0+0 (secure 0 0 0) 0x7f0d3c0f0530 con 0x7f0d4815a8b0 2024-09-19T05:44:40.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 -- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0d340678c0 msgr2=0x7f0d34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:40.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0d340678c0 0x7f0d34069d80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0d4814ec90 tx=0x7f0d38009040 comp rx=0 tx=0).stop 2024-09-19T05:44:40.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 -- 172.21.15.67:0/1021575569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 msgr2=0x7f0d4815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:40.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 0x7f0d4815ba60 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c01abc0 tx=0x7f0d3c0192b0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 -- 172.21.15.67:0/1021575569 shutdown_connections 2024-09-19T05:44:40.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d4815f040 0x7f0d4814a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0d340678c0 0x7f0d34069d80 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0d4815eb20 0x7f0d4815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 --2- 172.21.15.67:0/1021575569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d4815a8b0 0x7f0d4815ba60 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 -- 172.21.15.67:0/1021575569 >> 172.21.15.67:0/1021575569 conn(0x7f0d48073500 msgr2=0x7f0d48070260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:40.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 -- 172.21.15.67:0/1021575569 shutdown_connections 2024-09-19T05:44:40.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.568+0000 7f0d4e625640 1 -- 172.21.15.67:0/1021575569 wait complete. 2024-09-19T05:44:40.592 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:44:40.661 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:44:40.664 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:44:40.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.724+0000 7f023cdc0640 1 Processor -- start 2024-09-19T05:44:40.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.724+0000 7f023cdc0640 1 -- start start 2024-09-19T05:44:40.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f023cdc0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023815e690 0x7f02380d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:40.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f023cdc0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f02380d4fb0 0x7f02380d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:40.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f023cdc0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f02380d13c0 0x7f02380cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:40.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f023cdc0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f02380d35a0 con 0x7f02380d13c0 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f023cdc0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f02380d32c0 con 0x7f02380d4fb0 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f023cdc0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f023806d040 con 0x7f023815e690 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0236d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f02380d13c0 0x7f02380cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0236d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f02380d13c0 0x7f02380cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46972/0 (socket says 172.21.15.67:46972) 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0236d9d640 1 -- 172.21.15.67:0/1836870469 learned_addr learned my addr 172.21.15.67:0/1836870469 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f023659c640 1 --2- 172.21.15.67:0/1836870469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023815e690 0x7f02380d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0235d9b640 1 --2- 172.21.15.67:0/1836870469 >> v2:172.21.15.97:3300/0 conn(0x7f02380d4fb0 0x7f02380d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0236d9d640 1 -- 172.21.15.67:0/1836870469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023815e690 msgr2=0x7f02380d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0236d9d640 1 --2- 172.21.15.67:0/1836870469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023815e690 0x7f02380d2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0236d9d640 1 -- 172.21.15.67:0/1836870469 >> v2:172.21.15.97:3300/0 conn(0x7f02380d4fb0 msgr2=0x7f02380d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0236d9d640 1 --2- 172.21.15.67:0/1836870469 >> v2:172.21.15.97:3300/0 conn(0x7f02380d4fb0 0x7f02380d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0236d9d640 1 -- 172.21.15.67:0/1836870469 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023806d320 con 0x7f02380d13c0 2024-09-19T05:44:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0235d9b640 1 --2- 172.21.15.67:0/1836870469 >> v2:172.21.15.97:3300/0 conn(0x7f02380d4fb0 0x7f02380d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f0236d9d640 1 --2- 172.21.15.67:0/1836870469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02380d13c0 0x7f02380cf080 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f023808d010 tx=0x7f023001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8c1daeffb3ddb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f023559a640 1 -- 172.21.15.67:0/1836870469 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02300b0070 con 0x7f02380d13c0 2024-09-19T05:44:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f023559a640 1 -- 172.21.15.67:0/1836870469 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02300ab600 con 0x7f02380d13c0 2024-09-19T05:44:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.728+0000 7f023559a640 1 -- 172.21.15.67:0/1836870469 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02300ab9d0 con 0x7f02380d13c0 2024-09-19T05:44:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- 172.21.15.67:0/1836870469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02380d13c0 msgr2=0x7f02380cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 --2- 172.21.15.67:0/1836870469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02380d13c0 0x7f02380cf080 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f023808d010 tx=0x7f023001c520 comp rx=0 tx=0).stop 2024-09-19T05:44:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- 172.21.15.67:0/1836870469 shutdown_connections 2024-09-19T05:44:40.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 --2- 172.21.15.67:0/1836870469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02380d13c0 0x7f02380cf080 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 --2- 172.21.15.67:0/1836870469 >> v2:172.21.15.97:3300/0 conn(0x7f02380d4fb0 0x7f02380d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 --2- 172.21.15.67:0/1836870469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023815e690 0x7f02380d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- 172.21.15.67:0/1836870469 >> 172.21.15.67:0/1836870469 conn(0x7f02380d4490 msgr2=0x7f02380d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:40.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- 172.21.15.67:0/1836870469 shutdown_connections 2024-09-19T05:44:40.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- 172.21.15.67:0/1836870469 wait complete. 2024-09-19T05:44:40.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 Processor -- start 2024-09-19T05:44:40.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- start start 2024-09-19T05:44:40.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02380d13c0 0x7f0238152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:40.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02380d4fb0 0x7f02380b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:40.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f023815e690 0x7f02380b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:40.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f023806dca0 con 0x7f023815e690 2024-09-19T05:44:40.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f023806db20 con 0x7f02380d13c0 2024-09-19T05:44:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f023806de20 con 0x7f02380d4fb0 2024-09-19T05:44:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02380d13c0 0x7f0238152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f0236d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f023815e690 0x7f02380b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02380d13c0 0x7f0238152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:40774/0 (socket says 172.21.15.67:40774) 2024-09-19T05:44:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023659c640 1 -- 172.21.15.67:0/3694441503 learned_addr learned my addr 172.21.15.67:0/3694441503 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f0235d9b640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02380d4fb0 0x7f02380b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f0236d9d640 1 -- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02380d4fb0 msgr2=0x7f02380b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f0236d9d640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02380d4fb0 0x7f02380b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f0236d9d640 1 -- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02380d13c0 msgr2=0x7f0238152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f0236d9d640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02380d13c0 0x7f0238152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f0236d9d640 1 -- 172.21.15.67:0/3694441503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02381531d0 con 0x7f023815e690 2024-09-19T05:44:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f0236d9d640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f023815e690 0x7f02380b2a70 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f02300ab000 tx=0x7f023001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f022effd640 1 -- 172.21.15.67:0/3694441503 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02300b0040 con 0x7f023815e690 2024-09-19T05:44:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f022effd640 1 -- 172.21.15.67:0/3694441503 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02300bc070 con 0x7f023815e690 2024-09-19T05:44:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f022effd640 1 -- 172.21.15.67:0/3694441503 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02300b6880 con 0x7f023815e690 2024-09-19T05:44:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- 172.21.15.67:0/3694441503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0238157e10 con 0x7f023815e690 2024-09-19T05:44:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.732+0000 7f023cdc0640 1 -- 172.21.15.67:0/3694441503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02381583d0 con 0x7f023815e690 2024-09-19T05:44:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.736+0000 7f023cdc0640 1 -- 172.21.15.67:0/3694441503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02380d0e80 con 0x7f023815e690 2024-09-19T05:44:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.736+0000 7f022effd640 1 -- 172.21.15.67:0/3694441503 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02300b6a20 con 0x7f023815e690 2024-09-19T05:44:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.736+0000 7f022effd640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02180678c0 0x7f0218069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.736+0000 7f022effd640 1 -- 172.21.15.67:0/3694441503 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5335+0+0 (secure 0 0 0) 0x7f023011fe60 con 0x7f023815e690 2024-09-19T05:44:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.736+0000 7f023659c640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02180678c0 0x7f0218069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:40.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.736+0000 7f023659c640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02180678c0 0x7f0218069d80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f022000aa70 tx=0x7f0220008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:40.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.740+0000 7f022effd640 1 -- 172.21.15.67:0/3694441503 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0230016110 con 0x7f023815e690 2024-09-19T05:44:40.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.896+0000 7f023cdc0640 1 -- 172.21.15.67:0/3694441503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f02380b3a60 con 0x7f023815e690 2024-09-19T05:44:40.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.900+0000 7f022effd640 1 -- 172.21.15.67:0/3694441503 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f02300f04c0 con 0x7f023815e690 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 -- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02180678c0 msgr2=0x7f0218069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02180678c0 0x7f0218069d80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f022000aa70 tx=0x7f0220008040 comp rx=0 tx=0).stop 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 -- 172.21.15.67:0/3694441503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f023815e690 msgr2=0x7f02380b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f023815e690 0x7f02380b2a70 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f02300ab000 tx=0x7f023001ad60 comp rx=0 tx=0).stop 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 -- 172.21.15.67:0/3694441503 shutdown_connections 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f023815e690 0x7f02380b2a70 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02180678c0 0x7f0218069d80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f02380d4fb0 0x7f02380b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 --2- 172.21.15.67:0/3694441503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f02380d13c0 0x7f0238152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 -- 172.21.15.67:0/3694441503 >> 172.21.15.67:0/3694441503 conn(0x7f02380d4490 msgr2=0x7f02380b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 -- 172.21.15.67:0/3694441503 shutdown_connections 2024-09-19T05:44:40.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:40.904+0000 7f023cdc0640 1 -- 172.21.15.67:0/3694441503 wait complete. 2024-09-19T05:44:40.920 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:44:40.921 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:44:41.051 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:44:41.126 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:44:41.126 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:44:41.126 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:44:41.132 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:44:41.132 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:44:41.132 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:44:41.138 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:44:41.138 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:44:41.138 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:44:41.183 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:44:41.184 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:44:41.184 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:44:41.189 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:44:41.190 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:44:41.190 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:41.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de9007640 1 Processor -- start 2024-09-19T05:44:41.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de9007640 1 -- start start 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de9007640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8de415b710 0x7f8de4071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de9007640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8de415baf0 0x7f8de415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de9007640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8de40b3070 con 0x7f8de40aef40 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de9007640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8de40afaa0 con 0x7f8de415b710 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de9007640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8de40b32e0 con 0x7f8de415baf0 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de2d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8de415b710 0x7f8de4071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de359e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8de40aef40 0x7f8de40af390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56792/0 (socket says 172.21.15.67:56792) 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de359e640 1 -- 172.21.15.67:0/2400413881 learned_addr learned my addr 172.21.15.67:0/2400413881 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de259c640 1 --2- 172.21.15.67:0/2400413881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8de415baf0 0x7f8de415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de2d9d640 1 -- 172.21.15.67:0/2400413881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8de415baf0 msgr2=0x7f8de415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de2d9d640 1 --2- 172.21.15.67:0/2400413881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8de415baf0 0x7f8de415bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de2d9d640 1 -- 172.21.15.67:0/2400413881 >> v1:172.21.15.67:6789/0 conn(0x7f8de40aef40 legacy=0x7f8de40af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:41.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de2d9d640 1 -- 172.21.15.67:0/2400413881 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de40b35c0 con 0x7f8de415b710 2024-09-19T05:44:41.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de2d9d640 1 --2- 172.21.15.67:0/2400413881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de415b710 0x7f8de4071e80 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40097c0 tx=0x7f8dd401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7058e291f5a3efb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:41.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de1d9b640 1 -- 172.21.15.67:0/2400413881 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40a7070 con 0x7f8de415b710 2024-09-19T05:44:41.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de1d9b640 1 -- 172.21.15.67:0/2400413881 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd40b0070 con 0x7f8de415b710 2024-09-19T05:44:41.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.356+0000 7f8de1d9b640 1 -- 172.21.15.67:0/2400413881 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40ab890 con 0x7f8de415b710 2024-09-19T05:44:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 -- 172.21.15.67:0/2400413881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de415b710 msgr2=0x7f8de4071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 --2- 172.21.15.67:0/2400413881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de415b710 0x7f8de4071e80 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40097c0 tx=0x7f8dd401c470 comp rx=0 tx=0).stop 2024-09-19T05:44:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 -- 172.21.15.67:0/2400413881 shutdown_connections 2024-09-19T05:44:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 --2- 172.21.15.67:0/2400413881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8de415baf0 0x7f8de415bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 --2- 172.21.15.67:0/2400413881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de415b710 0x7f8de4071e80 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 -- 172.21.15.67:0/2400413881 >> 172.21.15.67:0/2400413881 conn(0x7f8de40d0080 msgr2=0x7f8de40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:41.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 -- 172.21.15.67:0/2400413881 shutdown_connections 2024-09-19T05:44:41.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 -- 172.21.15.67:0/2400413881 wait complete. 2024-09-19T05:44:41.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 Processor -- start 2024-09-19T05:44:41.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 -- start start 2024-09-19T05:44:41.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de40aef40 0x7f8de409d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8de415b710 0x7f8de409cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8de415baf0 0x7f8de414eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8de40b4a30 con 0x7f8de40aef40 2024-09-19T05:44:41.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8de40b48b0 con 0x7f8de415baf0 2024-09-19T05:44:41.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de9007640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8de40b4bb0 con 0x7f8de415b710 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de40aef40 0x7f8de409d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de40aef40 0x7f8de409d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46990/0 (socket says 172.21.15.67:46990) 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de2d9d640 1 -- 172.21.15.67:0/1388211439 learned_addr learned my addr 172.21.15.67:0/1388211439 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de259c640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8de415b710 0x7f8de409cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de359e640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8de415baf0 0x7f8de414eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de2d9d640 1 -- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8de415b710 msgr2=0x7f8de409cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de2d9d640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8de415b710 0x7f8de409cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de2d9d640 1 -- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8de415baf0 msgr2=0x7f8de414eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de2d9d640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8de415baf0 0x7f8de414eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de2d9d640 1 -- 172.21.15.67:0/1388211439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de409da40 con 0x7f8de40aef40 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.360+0000 7f8de359e640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8de415baf0 0x7f8de414eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8de2d9d640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de40aef40 0x7f8de409d500 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f8dd401a0a0 tx=0x7f8dd401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:41.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8dcb7fe640 1 -- 172.21.15.67:0/1388211439 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40bf610 con 0x7f8de40aef40 2024-09-19T05:44:41.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8dcb7fe640 1 -- 172.21.15.67:0/1388211439 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd40bf7d0 con 0x7f8de40aef40 2024-09-19T05:44:41.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8de9007640 1 -- 172.21.15.67:0/1388211439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de409dce0 con 0x7f8de40aef40 2024-09-19T05:44:41.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8dcb7fe640 1 -- 172.21.15.67:0/1388211439 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40bfbc0 con 0x7f8de40aef40 2024-09-19T05:44:41.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8de9007640 1 -- 172.21.15.67:0/1388211439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de409c1b0 con 0x7f8de40aef40 2024-09-19T05:44:41.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8de9007640 1 -- 172.21.15.67:0/1388211439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de4072640 con 0x7f8de40aef40 2024-09-19T05:44:41.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8dcb7fe640 1 -- 172.21.15.67:0/1388211439 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8dd40bd020 con 0x7f8de40aef40 2024-09-19T05:44:41.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8dcb7fe640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8dd00678c0 0x7f8dd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8dcb7fe640 1 -- 172.21.15.67:0/1388211439 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5335+0+0 (secure 0 0 0) 0x7f8dd4120930 con 0x7f8de40aef40 2024-09-19T05:44:41.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8de259c640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8dd00678c0 0x7f8dd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.364+0000 7f8de259c640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8dd00678c0 0x7f8dd0069d80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8de40cfaf0 tx=0x7f8dd8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:41.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.368+0000 7f8dcb7fe640 1 -- 172.21.15.67:0/1388211439 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8dd4016090 con 0x7f8de40aef40 2024-09-19T05:44:41.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.568+0000 7f8de9007640 1 -- 172.21.15.67:0/1388211439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8de40b5020 con 0x7f8de40aef40 2024-09-19T05:44:41.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8dcb7fe640 1 -- 172.21.15.67:0/1388211439 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+3910 (secure 0 0 0) 0x7f8dd40f1870 con 0x7f8de40aef40 2024-09-19T05:44:41.571 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:41.572 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":100,"btime":"2024-09-19T05:44:35:336890+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2297176119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2297176119},{"type":"v1","addr":"172.21.15.97:6835","nonce":2297176119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/567076641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":567076641},{"type":"v1","addr":"172.21.15.97:6837","nonce":567076641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/3138148314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3138148314},{"type":"v1","addr":"172.21.15.67:6833","nonce":3138148314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8970,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2067195831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2067195831},{"type":"v1","addr":"172.21.15.67:6835","nonce":2067195831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100}],"filesystems":[]} 2024-09-19T05:44:41.572 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 100 2024-09-19T05:44:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 -- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8dd00678c0 msgr2=0x7f8dd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8dd00678c0 0x7f8dd0069d80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8de40cfaf0 tx=0x7f8dd8008040 comp rx=0 tx=0).stop 2024-09-19T05:44:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 -- 172.21.15.67:0/1388211439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de40aef40 msgr2=0x7f8de409d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de40aef40 0x7f8de409d500 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f8dd401a0a0 tx=0x7f8dd401acb0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 -- 172.21.15.67:0/1388211439 shutdown_connections 2024-09-19T05:44:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8de415baf0 0x7f8de414eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8dd00678c0 0x7f8dd0069d80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8de415b710 0x7f8de409cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 --2- 172.21.15.67:0/1388211439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8de40aef40 0x7f8de409d500 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 -- 172.21.15.67:0/1388211439 >> 172.21.15.67:0/1388211439 conn(0x7f8de40d0080 msgr2=0x7f8de415e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 -- 172.21.15.67:0/1388211439 shutdown_connections 2024-09-19T05:44:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.572+0000 7f8de9007640 1 -- 172.21.15.67:0/1388211439 wait complete. 2024-09-19T05:44:41.591 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:44:41.591 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:44:41.591 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:44:41.591 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:44:41.591 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:44:41.591 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:44:41.592 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:44:41.592 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:44:41.592 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:44:41.592 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:44:41.592 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:44:41.593 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:44:41.593 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:44:41.593 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:44:41.593 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:44:41.594 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:44:41.605 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:44:41.605 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:44:41.606 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:44:41.606 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:44:41.607 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:44:41.607 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:44:41.608 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:44:41.608 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:44:41.648 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:44:41.648 DEBUG:teuthology.parallel:result is None 2024-09-19T05:44:41.648 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:44:41.649 DEBUG:teuthology.parallel:result is None 2024-09-19T05:44:41.654 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:44:41.654 DEBUG:teuthology.parallel:result is None 2024-09-19T05:44:41.654 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:44:41.654 DEBUG:teuthology.parallel:result is None 2024-09-19T05:44:41.655 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:44:41.709 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:44:41.713 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:44:41.723 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:44:41.727 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:44:41.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a4239640 1 Processor -- start 2024-09-19T05:44:41.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a4239640 1 -- start start 2024-09-19T05:44:41.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a4239640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f359c0d1590 0x7f359c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a4239640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0b51d0 0x7f359c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a4239640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359c0d4d40 con 0x7f359c161da0 2024-09-19T05:44:41.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a4239640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f359c0d0840 con 0x7f359c0d1590 2024-09-19T05:44:41.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a4239640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f359c0d5020 con 0x7f359c0b51d0 2024-09-19T05:44:41.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a27d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0b51d0 0x7f359c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a17d4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f359c0d1590 0x7f359c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a27d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0b51d0 0x7f359c0cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:45268/0 (socket says 172.21.15.67:45268) 2024-09-19T05:44:41.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a27d6640 1 -- 172.21.15.67:0/3394714894 learned_addr learned my addr 172.21.15.67:0/3394714894 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:41.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a1fd5640 1 --1- 172.21.15.67:0/3394714894 >> v1:172.21.15.97:6789/0 conn(0x7f359c161da0 0x7f359c0d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:50586/0 (socket says 172.21.15.67:50586) 2024-09-19T05:44:41.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a27d6640 1 -- 172.21.15.67:0/3394714894 >> v2:172.21.15.97:3300/0 conn(0x7f359c0d1590 msgr2=0x7f359c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:41.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a27d6640 1 --2- 172.21.15.67:0/3394714894 >> v2:172.21.15.97:3300/0 conn(0x7f359c0d1590 0x7f359c0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a27d6640 1 -- 172.21.15.67:0/3394714894 >> v1:172.21.15.97:6789/0 conn(0x7f359c161da0 legacy=0x7f359c0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:41.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.764+0000 7f35a27d6640 1 -- 172.21.15.67:0/3394714894 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c0d5300 con 0x7f359c0b51d0 2024-09-19T05:44:41.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a27d6640 1 --2- 172.21.15.67:0/3394714894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0b51d0 0x7f359c0cf150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3594009870 tx=0x7f359401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb154ba3d9e08cae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:41.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a0fd3640 1 -- 172.21.15.67:0/3394714894 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940b0070 con 0x7f359c0b51d0 2024-09-19T05:44:41.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a0fd3640 1 -- 172.21.15.67:0/3394714894 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35940ab600 con 0x7f359c0b51d0 2024-09-19T05:44:41.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a0fd3640 1 -- 172.21.15.67:0/3394714894 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940ab9d0 con 0x7f359c0b51d0 2024-09-19T05:44:41.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a4239640 1 -- 172.21.15.67:0/3394714894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0b51d0 msgr2=0x7f359c0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:41.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a4239640 1 --2- 172.21.15.67:0/3394714894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0b51d0 0x7f359c0cf150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3594009870 tx=0x7f359401c560 comp rx=0 tx=0).stop 2024-09-19T05:44:41.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a4239640 1 -- 172.21.15.67:0/3394714894 shutdown_connections 2024-09-19T05:44:41.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a4239640 1 --2- 172.21.15.67:0/3394714894 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0b51d0 0x7f359c0cf150 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a4239640 1 --2- 172.21.15.67:0/3394714894 >> v2:172.21.15.97:3300/0 conn(0x7f359c0d1590 0x7f359c0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a4239640 1 -- 172.21.15.67:0/3394714894 >> 172.21.15.67:0/3394714894 conn(0x7f359c08bfc0 msgr2=0x7f359c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:41.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a4239640 1 -- 172.21.15.67:0/3394714894 shutdown_connections 2024-09-19T05:44:41.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a4239640 1 -- 172.21.15.67:0/3394714894 wait complete. 2024-09-19T05:44:41.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.768+0000 7f35a4239640 1 Processor -- start 2024-09-19T05:44:41.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a4239640 1 -- start start 2024-09-19T05:44:41.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a4239640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f359c0b51d0 0x7f359c153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a4239640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0d1590 0x7f359c155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a4239640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c161da0 0x7f359c155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a4239640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f359c0d0020 con 0x7f359c161da0 2024-09-19T05:44:41.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a4239640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f359c0cfea0 con 0x7f359c0b51d0 2024-09-19T05:44:41.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a4239640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f359c0d01a0 con 0x7f359c0d1590 2024-09-19T05:44:41.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a27d6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c161da0 0x7f359c155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a27d6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c161da0 0x7f359c155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47040/0 (socket says 172.21.15.67:47040) 2024-09-19T05:44:41.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a27d6640 1 -- 172.21.15.67:0/1904423528 learned_addr learned my addr 172.21.15.67:0/1904423528 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a17d4640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0d1590 0x7f359c155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a1fd5640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f359c0b51d0 0x7f359c153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a27d6640 1 -- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0d1590 msgr2=0x7f359c155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a27d6640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0d1590 0x7f359c155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a27d6640 1 -- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f359c0b51d0 msgr2=0x7f359c153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a27d6640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f359c0b51d0 0x7f359c153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a27d6640 1 -- 172.21.15.67:0/1904423528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c0cb9f0 con 0x7f359c161da0 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a17d4640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0d1590 0x7f359c155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a27d6640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c161da0 0x7f359c155740 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f359401a190 tx=0x7f3594019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35927fc640 1 -- 172.21.15.67:0/1904423528 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940b0040 con 0x7f359c161da0 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35927fc640 1 -- 172.21.15.67:0/1904423528 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35940b4420 con 0x7f359c161da0 2024-09-19T05:44:41.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a4239640 1 -- 172.21.15.67:0/1904423528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359c154810 con 0x7f359c161da0 2024-09-19T05:44:41.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35927fc640 1 -- 172.21.15.67:0/1904423528 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940b47d0 con 0x7f359c161da0 2024-09-19T05:44:41.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a4239640 1 -- 172.21.15.67:0/1904423528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359c153950 con 0x7f359c161da0 2024-09-19T05:44:41.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a4239640 1 -- 172.21.15.67:0/1904423528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359c0cf150 con 0x7f359c161da0 2024-09-19T05:44:41.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35927fc640 1 -- 172.21.15.67:0/1904423528 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35940b4970 con 0x7f359c161da0 2024-09-19T05:44:41.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35927fc640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35800678c0 0x7f3580069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:41.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35927fc640 1 -- 172.21.15.67:0/1904423528 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5335+0+0 (secure 0 0 0) 0x7f359411f600 con 0x7f359c161da0 2024-09-19T05:44:41.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.772+0000 7f35a1fd5640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35800678c0 0x7f3580069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:41.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.776+0000 7f35a1fd5640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35800678c0 0x7f3580069d80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f35980012f0 tx=0x7f3598001620 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:41.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.776+0000 7f35927fc640 1 -- 172.21.15.67:0/1904423528 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3594016150 con 0x7f359c161da0 2024-09-19T05:44:41.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-19T05:44:41.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-19T05:44:41.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-19T05:44:41.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:41.948+0000 7f35a4239640 1 -- 172.21.15.67:0/1904423528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f359c0b4720 con 0x7f359c161da0 2024-09-19T05:44:42.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.928+0000 7f35927fc640 1 -- 172.21.15.67:0/1904423528 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v151) ==== 97+0+0 (secure 0 0 0) 0x7f35940efc60 con 0x7f359c161da0 2024-09-19T05:44:42.930 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:44:42.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 -- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35800678c0 msgr2=0x7f3580069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:42.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35800678c0 0x7f3580069d80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f35980012f0 tx=0x7f3598001620 comp rx=0 tx=0).stop 2024-09-19T05:44:42.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 -- 172.21.15.67:0/1904423528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c161da0 msgr2=0x7f359c155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:42.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c161da0 0x7f359c155740 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f359401a190 tx=0x7f3594019300 comp rx=0 tx=0).stop 2024-09-19T05:44:42.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 -- 172.21.15.67:0/1904423528 shutdown_connections 2024-09-19T05:44:42.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c161da0 0x7f359c155740 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35800678c0 0x7f3580069d80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f359c0d1590 0x7f359c155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 --2- 172.21.15.67:0/1904423528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f359c0b51d0 0x7f359c153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 -- 172.21.15.67:0/1904423528 >> 172.21.15.67:0/1904423528 conn(0x7f359c08bfc0 msgr2=0x7f359c0d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:42.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 -- 172.21.15.67:0/1904423528 shutdown_connections 2024-09-19T05:44:42.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:42.932+0000 7f35a4239640 1 -- 172.21.15.67:0/1904423528 wait complete. 2024-09-19T05:44:42.953 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:44:43.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe66c517640 1 Processor -- start 2024-09-19T05:44:43.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe66c517640 1 -- start start 2024-09-19T05:44:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe66c517640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe6640af730 0x7fe66406e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe66c517640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6640730e0 con 0x7fe66406ebb0 2024-09-19T05:44:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe66c517640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6640733c0 con 0x7fe66415a920 2024-09-19T05:44:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe66c517640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe66406efe0 con 0x7fe6640af730 2024-09-19T05:44:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe66aab4640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe66406ebb0 0x7fe6640ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56822/0 (socket says 172.21.15.67:56822) 2024-09-19T05:44:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe669ab2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe6640af730 0x7fe66406e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe66aab4640 1 -- 172.21.15.67:0/979967233 learned_addr learned my addr 172.21.15.67:0/979967233 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe669ab2640 1 -- 172.21.15.67:0/979967233 >> v1:172.21.15.97:6789/0 conn(0x7fe66415a920 legacy=0x7fe664072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe669ab2640 1 -- 172.21.15.67:0/979967233 >> v1:172.21.15.67:6789/0 conn(0x7fe66406ebb0 legacy=0x7fe6640ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe6692b1640 1 -- 172.21.15.67:0/979967233 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3205052922 0 0) 0x7fe6640730e0 con 0x7fe66406ebb0 2024-09-19T05:44:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.076+0000 7fe669ab2640 1 -- 172.21.15.67:0/979967233 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6640ad8c0 con 0x7fe6640af730 2024-09-19T05:44:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe669ab2640 1 --2- 172.21.15.67:0/979967233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 0x7fe66406e670 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fe65400a960 tx=0x7fe65401d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccde82b595380b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe6692b1640 1 -- 172.21.15.67:0/979967233 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540b3070 con 0x7fe6640af730 2024-09-19T05:44:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe6692b1640 1 -- 172.21.15.67:0/979967233 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6540a67d0 con 0x7fe6640af730 2024-09-19T05:44:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe6692b1640 1 -- 172.21.15.67:0/979967233 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65400b040 con 0x7fe6640af730 2024-09-19T05:44:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 -- 172.21.15.67:0/979967233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 msgr2=0x7fe66406e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 --2- 172.21.15.67:0/979967233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 0x7fe66406e670 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fe65400a960 tx=0x7fe65401d870 comp rx=0 tx=0).stop 2024-09-19T05:44:43.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 -- 172.21.15.67:0/979967233 shutdown_connections 2024-09-19T05:44:43.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 --2- 172.21.15.67:0/979967233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 0x7fe66406e670 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 -- 172.21.15.67:0/979967233 >> 172.21.15.67:0/979967233 conn(0x7fe6640d0080 msgr2=0x7fe6640d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:43.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 -- 172.21.15.67:0/979967233 shutdown_connections 2024-09-19T05:44:43.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 -- 172.21.15.67:0/979967233 wait complete. 2024-09-19T05:44:43.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 Processor -- start 2024-09-19T05:44:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 -- start start 2024-09-19T05:44:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe66406ebb0 0x7fe6640b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 0x7fe664099550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe66415a920 0x7fe664099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6640ae950 con 0x7fe6640af730 2024-09-19T05:44:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe6640ae7d0 con 0x7fe66406ebb0 2024-09-19T05:44:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66c517640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe6640aead0 con 0x7fe66415a920 2024-09-19T05:44:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe669ab2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 0x7fe664099550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe669ab2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 0x7fe664099550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47060/0 (socket says 172.21.15.67:47060) 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe669ab2640 1 -- 172.21.15.67:0/163068906 learned_addr learned my addr 172.21.15.67:0/163068906 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66a2b3640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe66406ebb0 0x7fe6640b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66aab4640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe66415a920 0x7fe664099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe669ab2640 1 -- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe66415a920 msgr2=0x7fe664099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe669ab2640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe66415a920 0x7fe664099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe669ab2640 1 -- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe66406ebb0 msgr2=0x7fe6640b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe669ab2640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe66406ebb0 0x7fe6640b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe669ab2640 1 -- 172.21.15.67:0/163068906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6640cc540 con 0x7fe6640af730 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe66aab4640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe66415a920 0x7fe664099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.080+0000 7fe669ab2640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 0x7fe664099550 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fe65401b4a0 tx=0x7fe65401a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe65affd640 1 -- 172.21.15.67:0/163068906 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540b3070 con 0x7fe6640af730 2024-09-19T05:44:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe65affd640 1 -- 172.21.15.67:0/163068906 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6540ae870 con 0x7fe6640af730 2024-09-19T05:44:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe66c517640 1 -- 172.21.15.67:0/163068906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6640cc260 con 0x7fe6640af730 2024-09-19T05:44:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe65affd640 1 -- 172.21.15.67:0/163068906 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540aec60 con 0x7fe6640af730 2024-09-19T05:44:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe66c517640 1 -- 172.21.15.67:0/163068906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6640cef10 con 0x7fe6640af730 2024-09-19T05:44:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe66c517640 1 -- 172.21.15.67:0/163068906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66406e670 con 0x7fe6640af730 2024-09-19T05:44:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe65affd640 1 -- 172.21.15.67:0/163068906 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6540c0060 con 0x7fe6640af730 2024-09-19T05:44:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe65affd640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6480678c0 0x7fe648069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe65affd640 1 -- 172.21.15.67:0/163068906 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5249+0+0 (secure 0 0 0) 0x7fe65411f9b0 con 0x7fe6640af730 2024-09-19T05:44:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe66a2b3640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6480678c0 0x7fe648069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.084+0000 7fe66a2b3640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6480678c0 0x7fe648069d80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe660000f70 tx=0x7fe660009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:43.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.088+0000 7fe65affd640 1 -- 172.21.15.67:0/163068906 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe654017460 con 0x7fe6640af730 2024-09-19T05:44:43.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 -- 172.21.15.67:0/163068906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe66414b240 con 0x7fe6640af730 2024-09-19T05:44:43.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe65affd640 1 -- 172.21.15.67:0/163068906 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fe6540f06b0 con 0x7fe6640af730 2024-09-19T05:44:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:43.303 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.305 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:44:43.306 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:44:43.306 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:44:43.306 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.306 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.306 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.306 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.306 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:44:43.306 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:44:43.306 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.306 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.307 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.308 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.308 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:44:43.308 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:44:43.308 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.308 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:44:43.308 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:44:43.308 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.308 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.308 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.308 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.309 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:44:43.309 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:44:43.309 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.309 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:44:43.309 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:44:43.309 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.309 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:44:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:44:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:44:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:44:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.311 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.311 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.311 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.311 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:44:43.311 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:44:43.311 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.311 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:44:43.311 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:44:43.311 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.312 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.312 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.312 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.312 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:44:43.312 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:44:43.312 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.312 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:44:43.312 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:44:43.313 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.313 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.313 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.313 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.313 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:44:43.313 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:44:43.313 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.313 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:44:43.313 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:44:43.314 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.314 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.314 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.314 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.314 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:44:43.314 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:44:43.314 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.314 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:44:43.315 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:44:43.315 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.315 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.315 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.315 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.315 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:44:43.315 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:44:43.315 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.315 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:44:43.316 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:44:43.316 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:44:43.316 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.316 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.316 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.316 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:44:43.316 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:44:43.316 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.317 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:44:43.317 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:44:43.317 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:44:43.317 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:44:43.317 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.317 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.317 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.317 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:44:43.317 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:44:43.318 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.318 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:44:43.318 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:44:43.318 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:44:43.318 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:44:43.318 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.318 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.319 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.319 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:44:43.319 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:44:43.319 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.319 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:44:43.319 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:44:43.319 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:44:43.319 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:44:43.319 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.320 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.320 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.320 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:44:43.320 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:44:43.320 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.320 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:44:43.320 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:44:43.320 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:44:43.321 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.321 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.321 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.321 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.321 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:44:43.321 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:44:43.321 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.321 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:44:43.322 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:44:43.322 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.322 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.322 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:43.322 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.322 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:44:43.322 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:44:43.322 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:44:43.322 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:44:43.323 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:44:43.323 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:44:43.323 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.323 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.323 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:44:43.323 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:44:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 -- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6480678c0 msgr2=0x7fe648069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6480678c0 0x7fe648069d80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe660000f70 tx=0x7fe660009040 comp rx=0 tx=0).stop 2024-09-19T05:44:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 -- 172.21.15.67:0/163068906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 msgr2=0x7fe664099550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 0x7fe664099550 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fe65401b4a0 tx=0x7fe65401a610 comp rx=0 tx=0).stop 2024-09-19T05:44:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 -- 172.21.15.67:0/163068906 shutdown_connections 2024-09-19T05:44:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe6480678c0 0x7fe648069d80 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe66415a920 0x7fe664099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6640af730 0x7fe664099550 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 --2- 172.21.15.67:0/163068906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe66406ebb0 0x7fe6640b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 -- 172.21.15.67:0/163068906 >> 172.21.15.67:0/163068906 conn(0x7fe6640d0080 msgr2=0x7fe6640b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 -- 172.21.15.67:0/163068906 shutdown_connections 2024-09-19T05:44:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.304+0000 7fe66c517640 1 -- 172.21.15.67:0/163068906 wait complete. 2024-09-19T05:44:43.326 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:44:43.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.452+0000 7f0f17636640 1 Processor -- start 2024-09-19T05:44:43.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.452+0000 7f0f17636640 1 -- start start 2024-09-19T05:44:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.452+0000 7f0f17636640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0f1015c030 0x7f0f1006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.452+0000 7f0f17636640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1006e3c0 con 0x7f0f1015d1d0 2024-09-19T05:44:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.452+0000 7f0f17636640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1006e6a0 con 0x7f0f1006f460 2024-09-19T05:44:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.452+0000 7f0f17636640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0f1006e980 con 0x7f0f1015c030 2024-09-19T05:44:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.452+0000 7f0f14bd1640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0f1015d1d0 0x7f0f100b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56836/0 (socket says 172.21.15.67:56836) 2024-09-19T05:44:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.452+0000 7f0f14bd1640 1 -- 172.21.15.67:0/802559721 learned_addr learned my addr 172.21.15.67:0/802559721 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.452+0000 7f0f153d2640 1 --2- 172.21.15.67:0/802559721 >> v2:172.21.15.67:3300/0 conn(0x7f0f1015c030 0x7f0f1006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f153d2640 1 -- 172.21.15.67:0/802559721 >> v1:172.21.15.97:6789/0 conn(0x7f0f1006f460 legacy=0x7f0f100acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f153d2640 1 -- 172.21.15.67:0/802559721 >> v1:172.21.15.67:6789/0 conn(0x7f0f1015d1d0 legacy=0x7f0f100b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f153d2640 1 -- 172.21.15.67:0/802559721 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1006ec60 con 0x7f0f1015c030 2024-09-19T05:44:43.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f153d2640 1 --2- 172.21.15.67:0/802559721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015c030 0x7f0f1006dde0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009d90 tx=0x7f0f0801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6d8a72b1844199 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:43.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f07fff640 1 -- 172.21.15.67:0/802559721 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f080b2070 con 0x7f0f1015c030 2024-09-19T05:44:43.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f07fff640 1 -- 172.21.15.67:0/802559721 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f080a59a0 con 0x7f0f1015c030 2024-09-19T05:44:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f07fff640 1 -- 172.21.15.67:0/802559721 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f080a5d70 con 0x7f0f1015c030 2024-09-19T05:44:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f17636640 1 -- 172.21.15.67:0/802559721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015c030 msgr2=0x7f0f1006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f17636640 1 --2- 172.21.15.67:0/802559721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015c030 0x7f0f1006dde0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009d90 tx=0x7f0f0801c940 comp rx=0 tx=0).stop 2024-09-19T05:44:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f17636640 1 -- 172.21.15.67:0/802559721 shutdown_connections 2024-09-19T05:44:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f17636640 1 --2- 172.21.15.67:0/802559721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015c030 0x7f0f1006dde0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f17636640 1 -- 172.21.15.67:0/802559721 >> 172.21.15.67:0/802559721 conn(0x7f0f100d0080 msgr2=0x7f0f100d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f17636640 1 -- 172.21.15.67:0/802559721 shutdown_connections 2024-09-19T05:44:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.456+0000 7f0f17636640 1 -- 172.21.15.67:0/802559721 wait complete. 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 Processor -- start 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 -- start start 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1006f460 0x7f0f101f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f1015c030 0x7f0f1009dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015d1d0 0x7f0f10099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1015c590 con 0x7f0f1015d1d0 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1015c410 con 0x7f0f1015c030 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0f100ad6c0 con 0x7f0f1006f460 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f15bd3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015d1d0 0x7f0f10099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f15bd3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015d1d0 0x7f0f10099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47074/0 (socket says 172.21.15.67:47074) 2024-09-19T05:44:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f15bd3640 1 -- 172.21.15.67:0/2647592104 learned_addr learned my addr 172.21.15.67:0/2647592104 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f14bd1640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f1015c030 0x7f0f1009dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f153d2640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1006f460 0x7f0f101f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f15bd3640 1 -- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1006f460 msgr2=0x7f0f101f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f15bd3640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1006f460 0x7f0f101f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f15bd3640 1 -- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f1015c030 msgr2=0x7f0f1009dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f15bd3640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f1015c030 0x7f0f1009dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f15bd3640 1 -- 172.21.15.67:0/2647592104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f10099eb0 con 0x7f0f1015d1d0 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f14bd1640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f1015c030 0x7f0f1009dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f15bd3640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015d1d0 0x7f0f10099970 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00c460 tx=0x7f0f0c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f05ffb640 1 -- 172.21.15.67:0/2647592104 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c016020 con 0x7f0f1015d1d0 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f05ffb640 1 -- 172.21.15.67:0/2647592104 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0c005220 con 0x7f0f1015d1d0 2024-09-19T05:44:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 -- 172.21.15.67:0/2647592104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f10152f70 con 0x7f0f1015d1d0 2024-09-19T05:44:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f05ffb640 1 -- 172.21.15.67:0/2647592104 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c007030 con 0x7f0f1015d1d0 2024-09-19T05:44:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 -- 172.21.15.67:0/2647592104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f101f4fa0 con 0x7f0f1015d1d0 2024-09-19T05:44:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f17636640 1 -- 172.21.15.67:0/2647592104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1006dde0 con 0x7f0f1015d1d0 2024-09-19T05:44:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f05ffb640 1 -- 172.21.15.67:0/2647592104 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f0c0071d0 con 0x7f0f1015d1d0 2024-09-19T05:44:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.460+0000 7f0f05ffb640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ef40678c0 0x7f0ef4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.464+0000 7f0f05ffb640 1 -- 172.21.15.67:0/2647592104 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5249+0+0 (secure 0 0 0) 0x7f0f0c085330 con 0x7f0f1015d1d0 2024-09-19T05:44:43.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.464+0000 7f0f153d2640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ef40678c0 0x7f0ef4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.464+0000 7f0f153d2640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ef40678c0 0x7f0ef4069d80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0f080af000 tx=0x7f0f080a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.468+0000 7f0f05ffb640 1 -- 172.21.15.67:0/2647592104 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0f0c020020 con 0x7f0f1015d1d0 2024-09-19T05:44:43.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.632+0000 7f0f17636640 1 -- 172.21.15.67:0/2647592104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0f100d0f20 con 0x7f0f1015d1d0 2024-09-19T05:44:43.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f05ffb640 1 -- 172.21.15.67:0/2647592104 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v151) ==== 84+0+65 (secure 0 0 0) 0x7f0f0c0074c0 con 0x7f0f1015d1d0 2024-09-19T05:44:43.635 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:43.635 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:44:43.635 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:44:43.635 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:44:43.635 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:44:43.635 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:43.635 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:44:43.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 -- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ef40678c0 msgr2=0x7f0ef4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ef40678c0 0x7f0ef4069d80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0f080af000 tx=0x7f0f080a7070 comp rx=0 tx=0).stop 2024-09-19T05:44:43.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 -- 172.21.15.67:0/2647592104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015d1d0 msgr2=0x7f0f10099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015d1d0 0x7f0f10099970 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00c460 tx=0x7f0f0c00c920 comp rx=0 tx=0).stop 2024-09-19T05:44:43.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 -- 172.21.15.67:0/2647592104 shutdown_connections 2024-09-19T05:44:43.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1015d1d0 0x7f0f10099970 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f1015c030 0x7f0f1009dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ef40678c0 0x7f0ef4069d80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 --2- 172.21.15.67:0/2647592104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1006f460 0x7f0f101f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 -- 172.21.15.67:0/2647592104 >> 172.21.15.67:0/2647592104 conn(0x7f0f100d0080 msgr2=0x7f0f100745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:43.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 -- 172.21.15.67:0/2647592104 shutdown_connections 2024-09-19T05:44:43.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.636+0000 7f0f17636640 1 -- 172.21.15.67:0/2647592104 wait complete. 2024-09-19T05:44:43.655 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:44:43.655 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:44:43.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.784+0000 7f6cd9057640 1 Processor -- start 2024-09-19T05:44:43.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.784+0000 7f6cd9057640 1 -- start start 2024-09-19T05:44:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.784+0000 7f6cd9057640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6cd40cf510 0x7f6cd40cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.784+0000 7f6cd9057640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6cd40ceb20 0x7f6cd40cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.784+0000 7f6cd9057640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cd40cfe30 con 0x7f6cd40b5f50 2024-09-19T05:44:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.784+0000 7f6cd9057640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd40d3a10 con 0x7f6cd40cf510 2024-09-19T05:44:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.784+0000 7f6cd9057640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd415ea70 con 0x7f6cd40ceb20 2024-09-19T05:44:43.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd2d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6cd40cf510 0x7f6cd40cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd359e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6cd40b5f50 0x7f6cd40b6400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56850/0 (socket says 172.21.15.67:56850) 2024-09-19T05:44:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd359e640 1 -- 172.21.15.67:0/2591884568 learned_addr learned my addr 172.21.15.67:0/2591884568 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd259c640 1 --2- 172.21.15.67:0/2591884568 >> v2:172.21.15.97:3300/0 conn(0x7f6cd40ceb20 0x7f6cd40cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd2d9d640 1 -- 172.21.15.67:0/2591884568 >> v2:172.21.15.97:3300/0 conn(0x7f6cd40ceb20 msgr2=0x7f6cd40cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd2d9d640 1 --2- 172.21.15.67:0/2591884568 >> v2:172.21.15.97:3300/0 conn(0x7f6cd40ceb20 0x7f6cd40cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd2d9d640 1 -- 172.21.15.67:0/2591884568 >> v1:172.21.15.67:6789/0 conn(0x7f6cd40b5f50 legacy=0x7f6cd40b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd2d9d640 1 -- 172.21.15.67:0/2591884568 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd40d3450 con 0x7f6cd40cf510 2024-09-19T05:44:43.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd2d9d640 1 --2- 172.21.15.67:0/2591884568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40cf510 0x7f6cd40cf8f0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40d2340 tx=0x7f6cc401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa68116ba3025b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:43.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd1d9b640 1 -- 172.21.15.67:0/2591884568 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40ab650 con 0x7f6cd40cf510 2024-09-19T05:44:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd1d9b640 1 -- 172.21.15.67:0/2591884568 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc40b0070 con 0x7f6cd40cf510 2024-09-19T05:44:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd1d9b640 1 -- 172.21.15.67:0/2591884568 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40aba10 con 0x7f6cd40cf510 2024-09-19T05:44:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd9057640 1 -- 172.21.15.67:0/2591884568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40cf510 msgr2=0x7f6cd40cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd9057640 1 --2- 172.21.15.67:0/2591884568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40cf510 0x7f6cd40cf8f0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40d2340 tx=0x7f6cc401c450 comp rx=0 tx=0).stop 2024-09-19T05:44:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd9057640 1 -- 172.21.15.67:0/2591884568 shutdown_connections 2024-09-19T05:44:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd9057640 1 --2- 172.21.15.67:0/2591884568 >> v2:172.21.15.97:3300/0 conn(0x7f6cd40ceb20 0x7f6cd40cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd9057640 1 --2- 172.21.15.67:0/2591884568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40cf510 0x7f6cd40cf8f0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd9057640 1 -- 172.21.15.67:0/2591884568 >> 172.21.15.67:0/2591884568 conn(0x7f6cd40d44d0 msgr2=0x7f6cd40d48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd9057640 1 -- 172.21.15.67:0/2591884568 shutdown_connections 2024-09-19T05:44:43.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.788+0000 7f6cd9057640 1 -- 172.21.15.67:0/2591884568 wait complete. 2024-09-19T05:44:43.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 Processor -- start 2024-09-19T05:44:43.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 -- start start 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40b5f50 0x7f6cd40b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cd40ceb20 0x7f6cd41559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cd40cf510 0x7f6cd40b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd416ba00 con 0x7f6cd40b5f50 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd40d30e0 con 0x7f6cd40ceb20 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd416bb80 con 0x7f6cd40cf510 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40b5f50 0x7f6cd40b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40b5f50 0x7f6cd40b7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47088/0 (socket says 172.21.15.67:47088) 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd2d9d640 1 -- 172.21.15.67:0/3831789367 learned_addr learned my addr 172.21.15.67:0/3831789367 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd259c640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cd40ceb20 0x7f6cd41559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd2d9d640 1 -- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cd40cf510 msgr2=0x7f6cd40b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd2d9d640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cd40cf510 0x7f6cd40b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd2d9d640 1 -- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cd40ceb20 msgr2=0x7f6cd41559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd2d9d640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cd40ceb20 0x7f6cd41559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd2d9d640 1 -- 172.21.15.67:0/3831789367 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd40b84f0 con 0x7f6cd40b5f50 2024-09-19T05:44:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd259c640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cd40ceb20 0x7f6cd41559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd2d9d640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40b5f50 0x7f6cd40b7fb0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f6cc401a080 tx=0x7f6cc401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cbb7fe640 1 -- 172.21.15.67:0/3831789367 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40bf610 con 0x7f6cd40b5f50 2024-09-19T05:44:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cbb7fe640 1 -- 172.21.15.67:0/3831789367 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc40bf7d0 con 0x7f6cd40b5f50 2024-09-19T05:44:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 -- 172.21.15.67:0/3831789367 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd40b9e60 con 0x7f6cd40b5f50 2024-09-19T05:44:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cbb7fe640 1 -- 172.21.15.67:0/3831789367 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40bfbc0 con 0x7f6cd40b5f50 2024-09-19T05:44:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 -- 172.21.15.67:0/3831789367 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd41594f0 con 0x7f6cd40b5f50 2024-09-19T05:44:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cd9057640 1 -- 172.21.15.67:0/3831789367 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd40cf8f0 con 0x7f6cd40b5f50 2024-09-19T05:44:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.792+0000 7f6cbb7fe640 1 -- 172.21.15.67:0/3831789367 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6cc40bd020 con 0x7f6cd40b5f50 2024-09-19T05:44:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.796+0000 7f6cbb7fe640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6cc00678f0 0x7f6cc0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.796+0000 7f6cbb7fe640 1 -- 172.21.15.67:0/3831789367 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5249+0+0 (secure 0 0 0) 0x7f6cc4120800 con 0x7f6cd40b5f50 2024-09-19T05:44:43.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.796+0000 7f6cd259c640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6cc00678f0 0x7f6cc0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:43.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.796+0000 7f6cd259c640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6cc00678f0 0x7f6cc0069db0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40b5450 tx=0x7f6cc8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:43.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.800+0000 7f6cbb7fe640 1 -- 172.21.15.67:0/3831789367 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6cd40b9e60 con 0x7f6cd40b5f50 2024-09-19T05:44:43.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:43.964+0000 7f6cd9057640 1 -- 172.21.15.67:0/3831789367 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6cd40b3c10 con 0x7f6cd40b5f50 2024-09-19T05:44:44.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.936+0000 7f6cbb7fe640 1 -- 172.21.15.67:0/3831789367 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v152) ==== 138+0+0 (secure 0 0 0) 0x7f6cc4016070 con 0x7f6cd40b5f50 2024-09-19T05:44:44.935 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:44:44.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.936+0000 7f6cd9057640 1 -- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6cc00678f0 msgr2=0x7f6cc0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.936+0000 7f6cd9057640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6cc00678f0 0x7f6cc0069db0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40b5450 tx=0x7f6cc8008040 comp rx=0 tx=0).stop 2024-09-19T05:44:44.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.936+0000 7f6cd9057640 1 -- 172.21.15.67:0/3831789367 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40b5f50 msgr2=0x7f6cd40b7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.936+0000 7f6cd9057640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40b5f50 0x7f6cd40b7fb0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f6cc401a080 tx=0x7f6cc401ac90 comp rx=0 tx=0).stop 2024-09-19T05:44:44.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.940+0000 7f6cd9057640 1 -- 172.21.15.67:0/3831789367 shutdown_connections 2024-09-19T05:44:44.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.940+0000 7f6cd9057640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6cc00678f0 0x7f6cc0069db0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.940+0000 7f6cd9057640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cd40cf510 0x7f6cd40b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.940+0000 7f6cd9057640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cd40ceb20 0x7f6cd41559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.940+0000 7f6cd9057640 1 --2- 172.21.15.67:0/3831789367 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40b5f50 0x7f6cd40b7fb0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.940+0000 7f6cd9057640 1 -- 172.21.15.67:0/3831789367 >> 172.21.15.67:0/3831789367 conn(0x7f6cd40d44d0 msgr2=0x7f6cd40b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:44.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.940+0000 7f6cd9057640 1 -- 172.21.15.67:0/3831789367 shutdown_connections 2024-09-19T05:44:44.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:44.940+0000 7f6cd9057640 1 -- 172.21.15.67:0/3831789367 wait complete. 2024-09-19T05:44:44.962 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:44:45.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31d03f5640 1 Processor -- start 2024-09-19T05:44:45.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31d03f5640 1 -- start start 2024-09-19T05:44:45.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31d03f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31c80b6c70 0x7f31c806d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:45.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31d03f5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c80cf1a0 con 0x7f31c815ea60 2024-09-19T05:44:45.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31d03f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c80cf480 con 0x7f31c80cff60 2024-09-19T05:44:45.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31d03f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f31c80cf760 con 0x7f31c80b6c70 2024-09-19T05:44:45.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31ce191640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f31c815ea60 0x7f31c80b6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:56854/0 (socket says 172.21.15.67:56854) 2024-09-19T05:44:45.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31ce191640 1 -- 172.21.15.67:0/3205235373 learned_addr learned my addr 172.21.15.67:0/3205235373 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:45.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd990640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31c80b6c70 0x7f31c806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:45.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3432922388 0 0) 0x7f31c80cf1a0 con 0x7f31c815ea60 2024-09-19T05:44:45.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b4003530 con 0x7f31c815ea60 2024-09-19T05:44:45.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1616174244 0 0) 0x7f31b4003530 con 0x7f31c815ea60 2024-09-19T05:44:45.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31c80b6c70 msgr2=0x7f31c806d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:45.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31c80b6c70 0x7f31c806d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:45.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 >> v1:172.21.15.97:6789/0 conn(0x7f31c80cff60 legacy=0x7f31c80d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:45.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c80b3340 con 0x7f31c815ea60 2024-09-19T05:44:45.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f31c4001680 con 0x7f31c815ea60 2024-09-19T05:44:45.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 >> v1:172.21.15.67:6789/0 conn(0x7f31c815ea60 legacy=0x7f31c80b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:45.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31b40039f0 0x7f31b4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:45.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31c80b6c70 0x7f31b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:45.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b4004d50 0x7f31b40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:45.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f31c80cf760 con 0x7f31b4004d50 2024-09-19T05:44:45.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f31b400bab0 con 0x7f31b40039f0 2024-09-19T05:44:45.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f31b400bcb0 con 0x7f31c80b6c70 2024-09-19T05:44:45.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31ce992640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b4004d50 0x7f31b40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:45.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.100+0000 7f31ce191640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31b40039f0 0x7f31b4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:45.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31cd990640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31c80b6c70 0x7f31b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:45.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31ce992640 1 -- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31c80b6c70 msgr2=0x7f31b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:45.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31ce992640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31c80b6c70 0x7f31b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:45.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31ce992640 1 -- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31b40039f0 msgr2=0x7f31b4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:45.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31ce992640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31b40039f0 0x7f31b4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:45.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31ce992640 1 -- 172.21.15.67:0/3205235373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b4003530 con 0x7f31b4004d50 2024-09-19T05:44:45.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31cd990640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31c80b6c70 0x7f31b4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:45.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31ce191640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31b40039f0 0x7f31b4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31ce992640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b4004d50 0x7f31b40051d0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f31c8163690 tx=0x7f31c001c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c559cf72012752c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0001a90 con 0x7f31b4004d50 2024-09-19T05:44:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c0003b80 con 0x7f31b4004d50 2024-09-19T05:44:45.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31cd18f640 1 -- 172.21.15.67:0/3205235373 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0005080 con 0x7f31b4004d50 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31d03f5640 1 -- 172.21.15.67:0/3205235373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b4004d50 msgr2=0x7f31b40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31d03f5640 1 --2- 172.21.15.67:0/3205235373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b4004d50 0x7f31b40051d0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f31c8163690 tx=0x7f31c001c720 comp rx=0 tx=0).stop 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31ce992640 1 -- 172.21.15.67:0/3205235373 reap_dead start 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31d03f5640 1 -- 172.21.15.67:0/3205235373 shutdown_connections 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31d03f5640 1 -- 172.21.15.67:0/3205235373 >> 172.21.15.67:0/3205235373 conn(0x7f31c80d1620 msgr2=0x7f31c80d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31d03f5640 1 -- 172.21.15.67:0/3205235373 shutdown_connections 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.104+0000 7f31d03f5640 1 -- 172.21.15.67:0/3205235373 wait complete. 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 Processor -- start 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 -- start start 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31b4004d50 0x7f31c80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80cdb80 0x7f31c80ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31c80ce000 0x7f31c80cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f31c80b3780 con 0x7f31c80ce000 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f31c80b3600 con 0x7f31c80cdb80 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f31c80b3900 con 0x7f31b4004d50 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31ce992640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31c80ce000 0x7f31c80cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31ce992640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31c80ce000 0x7f31c80cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47102/0 (socket says 172.21.15.67:47102) 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31ce992640 1 -- 172.21.15.67:0/3515210298 learned_addr learned my addr 172.21.15.67:0/3515210298 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31cd990640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80cdb80 0x7f31c80ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31ce191640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31b4004d50 0x7f31c80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31ce992640 1 -- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31b4004d50 msgr2=0x7f31c80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31ce992640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31b4004d50 0x7f31c80cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31ce992640 1 -- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80cdb80 msgr2=0x7f31c80ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31ce992640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80cdb80 0x7f31c80ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31ce992640 1 -- 172.21.15.67:0/3515210298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c80c81e0 con 0x7f31c80ce000 2024-09-19T05:44:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31ce992640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31c80ce000 0x7f31c80cacc0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f31c0098130 tx=0x7f31b4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31beffd640 1 -- 172.21.15.67:0/3515210298 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c00ba070 con 0x7f31c80ce000 2024-09-19T05:44:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31beffd640 1 -- 172.21.15.67:0/3515210298 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c0005820 con 0x7f31c80ce000 2024-09-19T05:44:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 -- 172.21.15.67:0/3515210298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c80c84c0 con 0x7f31c80ce000 2024-09-19T05:44:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31beffd640 1 -- 172.21.15.67:0/3515210298 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0001a90 con 0x7f31c80ce000 2024-09-19T05:44:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 -- 172.21.15.67:0/3515210298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c80c8a80 con 0x7f31c80ce000 2024-09-19T05:44:45.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.108+0000 7f31d03f5640 1 -- 172.21.15.67:0/3515210298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c80c8c80 con 0x7f31c80ce000 2024-09-19T05:44:45.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.112+0000 7f31beffd640 1 -- 172.21.15.67:0/3515210298 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f31c00bd070 con 0x7f31c80ce000 2024-09-19T05:44:45.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.112+0000 7f31beffd640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f31ac0678c0 0x7f31ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:45.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.112+0000 7f31beffd640 1 -- 172.21.15.67:0/3515210298 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5619+0+0 (secure 0 0 0) 0x7f31c011f160 con 0x7f31c80ce000 2024-09-19T05:44:45.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.112+0000 7f31ce191640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f31ac0678c0 0x7f31ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:45.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.112+0000 7f31ce191640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f31ac0678c0 0x7f31ac069d80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f31c4001ec0 tx=0x7f31c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:45.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.116+0000 7f31beffd640 1 -- 172.21.15.67:0/3515210298 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f31c80c8c80 con 0x7f31c80ce000 2024-09-19T05:44:45.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.284+0000 7f31d03f5640 1 -- 172.21.15.67:0/3515210298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f31c80b6560 con 0x7f31c80ce000 2024-09-19T05:44:45.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.940+0000 7f31beffd640 1 -- 172.21.15.67:0/3515210298 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v153) ==== 170+0+0 (secure 0 0 0) 0x7f31c00ac020 con 0x7f31c80ce000 2024-09-19T05:44:45.940 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:44:45.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 -- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f31ac0678c0 msgr2=0x7f31ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:45.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f31ac0678c0 0x7f31ac069d80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f31c4001ec0 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2024-09-19T05:44:45.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 -- 172.21.15.67:0/3515210298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31c80ce000 msgr2=0x7f31c80cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:45.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31c80ce000 0x7f31c80cacc0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f31c0098130 tx=0x7f31b4005840 comp rx=0 tx=0).stop 2024-09-19T05:44:45.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 -- 172.21.15.67:0/3515210298 shutdown_connections 2024-09-19T05:44:45.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31c80ce000 0x7f31c80cacc0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:45.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80cdb80 0x7f31c80ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:45.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f31ac0678c0 0x7f31ac069d80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:45.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 --2- 172.21.15.67:0/3515210298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31b4004d50 0x7f31c80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:45.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 -- 172.21.15.67:0/3515210298 >> 172.21.15.67:0/3515210298 conn(0x7f31c80d1620 msgr2=0x7f31c80d3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:45.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 -- 172.21.15.67:0/3515210298 shutdown_connections 2024-09-19T05:44:45.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:45.944+0000 7f31d03f5640 1 -- 172.21.15.67:0/3515210298 wait complete. 2024-09-19T05:44:45.987 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:44:46.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba2fb7640 1 Processor -- start 2024-09-19T05:44:46.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba2fb7640 1 -- start start 2024-09-19T05:44:46.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba2fb7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4b9c159c60 0x7f4b9c0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:46.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba2fb7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4b9c0af3a0 0x7f4b9c15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba2fb7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9c15a040 con 0x7f4b9c06ffd0 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba2fb7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9c15d460 con 0x7f4b9c159c60 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba2fb7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9c15c850 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba0d53640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4b9c159c60 0x7f4b9c0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4b9bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4b9c06ffd0 0x7f4b9c0aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44548/0 (socket says 172.21.15.67:44548) 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4b9bfff640 1 -- 172.21.15.67:0/4093753090 learned_addr learned my addr 172.21.15.67:0/4093753090 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba1554640 1 --2- 172.21.15.67:0/4093753090 >> v2:172.21.15.97:3300/0 conn(0x7f4b9c0af3a0 0x7f4b9c15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba0d53640 1 -- 172.21.15.67:0/4093753090 >> v2:172.21.15.97:3300/0 conn(0x7f4b9c0af3a0 msgr2=0x7f4b9c15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba0d53640 1 --2- 172.21.15.67:0/4093753090 >> v2:172.21.15.97:3300/0 conn(0x7f4b9c0af3a0 0x7f4b9c15fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba0d53640 1 -- 172.21.15.67:0/4093753090 >> v1:172.21.15.67:6789/0 conn(0x7f4b9c06ffd0 legacy=0x7f4b9c0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba0d53640 1 -- 172.21.15.67:0/4093753090 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c15cb30 con 0x7f4b9c159c60 2024-09-19T05:44:46.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.116+0000 7f4ba1554640 1 --2- 172.21.15.67:0/4093753090 >> v2:172.21.15.97:3300/0 conn(0x7f4b9c0af3a0 0x7f4b9c15fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:46.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba0d53640 1 --2- 172.21.15.67:0/4093753090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c159c60 0x7f4b9c0ad130 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c071950 tx=0x7f4b8c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e3966027bf41c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:46.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4b9b7fe640 1 -- 172.21.15.67:0/4093753090 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0ab650 con 0x7f4b9c159c60 2024-09-19T05:44:46.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4b9b7fe640 1 -- 172.21.15.67:0/4093753090 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8c0b0070 con 0x7f4b9c159c60 2024-09-19T05:44:46.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4b9b7fe640 1 -- 172.21.15.67:0/4093753090 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0aba10 con 0x7f4b9c159c60 2024-09-19T05:44:46.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/4093753090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c159c60 msgr2=0x7f4b9c0ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:46.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 --2- 172.21.15.67:0/4093753090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c159c60 0x7f4b9c0ad130 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c071950 tx=0x7f4b8c01c450 comp rx=0 tx=0).stop 2024-09-19T05:44:46.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/4093753090 shutdown_connections 2024-09-19T05:44:46.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 --2- 172.21.15.67:0/4093753090 >> v2:172.21.15.97:3300/0 conn(0x7f4b9c0af3a0 0x7f4b9c15fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:46.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 --2- 172.21.15.67:0/4093753090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c159c60 0x7f4b9c0ad130 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:46.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/4093753090 >> 172.21.15.67:0/4093753090 conn(0x7f4b9c0b1e50 msgr2=0x7f4b9c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:46.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/4093753090 shutdown_connections 2024-09-19T05:44:46.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/4093753090 wait complete. 2024-09-19T05:44:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 Processor -- start 2024-09-19T05:44:46.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 -- start start 2024-09-19T05:44:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c06ffd0 0x7f4b9c14dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c0af3a0 0x7f4b9c09a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b9c159c60 0x7f4b9c099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c168e30 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c168fb0 con 0x7f4b9c159c60 2024-09-19T05:44:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4ba2fb7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9c169130 con 0x7f4b9c06ffd0 2024-09-19T05:44:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4b9bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c0af3a0 0x7f4b9c09a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4b9bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c0af3a0 0x7f4b9c09a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51412/0 (socket says 172.21.15.67:51412) 2024-09-19T05:44:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.120+0000 7f4b9bfff640 1 -- 172.21.15.67:0/2672982164 learned_addr learned my addr 172.21.15.67:0/2672982164 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4ba1554640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b9c159c60 0x7f4b9c099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4ba0d53640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c06ffd0 0x7f4b9c14dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b9bfff640 1 -- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c06ffd0 msgr2=0x7f4b9c14dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b9bfff640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c06ffd0 0x7f4b9c14dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b9bfff640 1 -- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b9c159c60 msgr2=0x7f4b9c099840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b9bfff640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b9c159c60 0x7f4b9c099840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b9bfff640 1 -- 172.21.15.67:0/2672982164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c14e1a0 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4ba1554640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b9c159c60 0x7f4b9c099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b9bfff640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c0af3a0 0x7f4b9c09a2b0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000c450 tx=0x7f4b9000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b997fa640 1 -- 172.21.15.67:0/2672982164 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90017070 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b997fa640 1 -- 172.21.15.67:0/2672982164 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b90005cf0 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b997fa640 1 -- 172.21.15.67:0/2672982164 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90007290 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/2672982164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9c151240 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/2672982164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9c09cb80 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/2672982164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9c15fda0 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b997fa640 1 -- 172.21.15.67:0/2672982164 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b9001a070 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b997fa640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b880678c0 0x7f4b88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4b997fa640 1 -- 172.21.15.67:0/2672982164 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6001+0+0 (secure 0 0 0) 0x7f4b90085020 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.124+0000 7f4ba0d53640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b880678c0 0x7f4b88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.128+0000 7f4ba0d53640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b880678c0 0x7f4b88069d80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0af000 tx=0x7f4b8c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:46.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.128+0000 7f4b997fa640 1 -- 172.21.15.67:0/2672982164 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4b90055ac0 con 0x7f4b9c0af3a0 2024-09-19T05:44:46.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:46.328+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/2672982164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4b9c0b44d0 con 0x7f4b9c0af3a0 2024-09-19T05:44:47.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.184+0000 7f4b997fa640 1 -- 172.21.15.67:0/2672982164 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v102) ==== 174+0+0 (secure 0 0 0) 0x7f4b900553c0 con 0x7f4b9c0af3a0 2024-09-19T05:44:47.184 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 21 and data pool 22 2024-09-19T05:44:47.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b880678c0 msgr2=0x7f4b88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b880678c0 0x7f4b88069d80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0af000 tx=0x7f4b8c008040 comp rx=0 tx=0).stop 2024-09-19T05:44:47.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/2672982164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c0af3a0 msgr2=0x7f4b9c09a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c0af3a0 0x7f4b9c09a2b0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000c450 tx=0x7f4b9000c910 comp rx=0 tx=0).stop 2024-09-19T05:44:47.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/2672982164 shutdown_connections 2024-09-19T05:44:47.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b9c159c60 0x7f4b9c099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b9c0af3a0 0x7f4b9c09a2b0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4b880678c0 0x7f4b88069d80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 --2- 172.21.15.67:0/2672982164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c06ffd0 0x7f4b9c14dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/2672982164 >> 172.21.15.67:0/2672982164 conn(0x7f4b9c0b1e50 msgr2=0x7f4b9c06ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:47.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/2672982164 shutdown_connections 2024-09-19T05:44:47.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.188+0000 7f4ba2fb7640 1 -- 172.21.15.67:0/2672982164 wait complete. 2024-09-19T05:44:47.217 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:44:47.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d12706640 1 Processor -- start 2024-09-19T05:44:47.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d12706640 1 -- start start 2024-09-19T05:44:47.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d12706640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c159d60 0x7f9d0c06ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d12706640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9d0c0b36e0 0x7f9d0c0acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d12706640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d0c06de80 con 0x7f9d0c06f460 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d12706640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0c06e160 con 0x7f9d0c0b36e0 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d12706640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0c06e440 con 0x7f9d0c159d60 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d10ca3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9d0c0b36e0 0x7f9d0c0acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d03fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9d0c06f460 0x7f9d0c0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44552/0 (socket says 172.21.15.67:44552) 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d03fff640 1 -- 172.21.15.67:0/1238742603 learned_addr learned my addr 172.21.15.67:0/1238742603 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d0bfff640 1 --2- 172.21.15.67:0/1238742603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c159d60 0x7f9d0c06ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d10ca3640 1 -- 172.21.15.67:0/1238742603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c159d60 msgr2=0x7f9d0c06ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d10ca3640 1 --2- 172.21.15.67:0/1238742603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c159d60 0x7f9d0c06ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d10ca3640 1 -- 172.21.15.67:0/1238742603 >> v1:172.21.15.67:6789/0 conn(0x7f9d0c06f460 legacy=0x7f9d0c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d0b7fe640 1 -- 172.21.15.67:0/1238742603 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321160345 0 0) 0x7f9d0c06de80 con 0x7f9d0c06f460 2024-09-19T05:44:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.360+0000 7f9d10ca3640 1 -- 172.21.15.67:0/1238742603 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c06e720 con 0x7f9d0c0b36e0 2024-09-19T05:44:47.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d10ca3640 1 --2- 172.21.15.67:0/1238742603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b36e0 0x7f9d0c0acfb0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009d90 tx=0x7f9d0401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29133922b5cbd8e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:47.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d0b7fe640 1 -- 172.21.15.67:0/1238742603 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d040b2070 con 0x7f9d0c0b36e0 2024-09-19T05:44:47.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d0b7fe640 1 -- 172.21.15.67:0/1238742603 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d040a5910 con 0x7f9d0c0b36e0 2024-09-19T05:44:47.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d0b7fe640 1 -- 172.21.15.67:0/1238742603 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d040a5ce0 con 0x7f9d0c0b36e0 2024-09-19T05:44:47.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 -- 172.21.15.67:0/1238742603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b36e0 msgr2=0x7f9d0c0acfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 --2- 172.21.15.67:0/1238742603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b36e0 0x7f9d0c0acfb0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009d90 tx=0x7f9d0401c940 comp rx=0 tx=0).stop 2024-09-19T05:44:47.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 -- 172.21.15.67:0/1238742603 shutdown_connections 2024-09-19T05:44:47.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 --2- 172.21.15.67:0/1238742603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b36e0 0x7f9d0c0acfb0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 --2- 172.21.15.67:0/1238742603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c159d60 0x7f9d0c06ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 -- 172.21.15.67:0/1238742603 >> 172.21.15.67:0/1238742603 conn(0x7f9d0c0d0080 msgr2=0x7f9d0c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:47.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 -- 172.21.15.67:0/1238742603 shutdown_connections 2024-09-19T05:44:47.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 -- 172.21.15.67:0/1238742603 wait complete. 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 Processor -- start 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 -- start start 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c06f460 0x7f9d0c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d0c159d60 0x7f9d0c152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b4720 0x7f9d0c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c0afa40 con 0x7f9d0c0b4720 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c0af8c0 con 0x7f9d0c159d60 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d12706640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0c169140 con 0x7f9d0c06f460 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d10ca3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b4720 0x7f9d0c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d10ca3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b4720 0x7f9d0c1531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51434/0 (socket says 172.21.15.67:51434) 2024-09-19T05:44:47.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d10ca3640 1 -- 172.21.15.67:0/2724010123 learned_addr learned my addr 172.21.15.67:0/2724010123 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d03fff640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d0c159d60 0x7f9d0c152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d0bfff640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c06f460 0x7f9d0c156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d10ca3640 1 -- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c06f460 msgr2=0x7f9d0c156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d10ca3640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c06f460 0x7f9d0c156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d10ca3640 1 -- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d0c159d60 msgr2=0x7f9d0c152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d10ca3640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d0c159d60 0x7f9d0c152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d10ca3640 1 -- 172.21.15.67:0/2724010123 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c145b80 con 0x7f9d0c0b4720 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d0bfff640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c06f460 0x7f9d0c156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.364+0000 7f9d10ca3640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b4720 0x7f9d0c1531f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f9d0401aff0 tx=0x7f9d040196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d097fa640 1 -- 172.21.15.67:0/2724010123 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d040b2050 con 0x7f9d0c0b4720 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d097fa640 1 -- 172.21.15.67:0/2724010123 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d040be070 con 0x7f9d0c0b4720 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d097fa640 1 -- 172.21.15.67:0/2724010123 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d040ada50 con 0x7f9d0c0b4720 2024-09-19T05:44:47.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d12706640 1 -- 172.21.15.67:0/2724010123 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0c1513f0 con 0x7f9d0c0b4720 2024-09-19T05:44:47.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d12706640 1 -- 172.21.15.67:0/2724010123 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0c154890 con 0x7f9d0c0b4720 2024-09-19T05:44:47.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d12706640 1 -- 172.21.15.67:0/2724010123 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0c0acfb0 con 0x7f9d0c0b4720 2024-09-19T05:44:47.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d097fa640 1 -- 172.21.15.67:0/2724010123 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d040adbf0 con 0x7f9d0c0b4720 2024-09-19T05:44:47.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d097fa640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9cec0678c0 0x7f9cec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d097fa640 1 -- 172.21.15.67:0/2724010123 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6101+0+0 (secure 0 0 0) 0x7f9d04120f70 con 0x7f9d0c0b4720 2024-09-19T05:44:47.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d0bfff640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9cec0678c0 0x7f9cec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.368+0000 7f9d0bfff640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9cec0678c0 0x7f9cec069d80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009840 tx=0x7f9cfc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:47.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.372+0000 7f9d097fa640 1 -- 172.21.15.67:0/2724010123 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9d04016560 con 0x7f9d0c0b4720 2024-09-19T05:44:47.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.540+0000 7f9d12706640 1 -- 172.21.15.67:0/2724010123 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d0c06f1f0 con 0x7f9d0c0b4720 2024-09-19T05:44:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.540+0000 7f9d097fa640 1 -- 172.21.15.67:0/2724010123 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16929 (secure 0 0 0) 0x7f9d040f1a40 con 0x7f9d0c0b4720 2024-09-19T05:44:47.541 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:47.542 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":154,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:44:46.334850+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:44:44.010860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-19T05:44:45.332354+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:44:47.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 -- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9cec0678c0 msgr2=0x7f9cec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9cec0678c0 0x7f9cec069d80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009840 tx=0x7f9cfc008040 comp rx=0 tx=0).stop 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 -- 172.21.15.67:0/2724010123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b4720 msgr2=0x7f9d0c1531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b4720 0x7f9d0c1531f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f9d0401aff0 tx=0x7f9d040196e0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 -- 172.21.15.67:0/2724010123 shutdown_connections 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d0c0b4720 0x7f9d0c1531f0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d0c159d60 0x7f9d0c152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9cec0678c0 0x7f9cec069d80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 --2- 172.21.15.67:0/2724010123 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d0c06f460 0x7f9d0c156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 -- 172.21.15.67:0/2724010123 >> 172.21.15.67:0/2724010123 conn(0x7f9d0c0d0080 msgr2=0x7f9d0c145220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 -- 172.21.15.67:0/2724010123 shutdown_connections 2024-09-19T05:44:47.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.544+0000 7f9d12706640 1 -- 172.21.15.67:0/2724010123 wait complete. 2024-09-19T05:44:47.562 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:44:47.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9ebd20640 1 Processor -- start 2024-09-19T05:44:47.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9ebd20640 1 -- start start 2024-09-19T05:44:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9ebd20640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc9e40b51d0 0x7fc9e40d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9ebd20640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e40d4d40 con 0x7fc9e40d1590 2024-09-19T05:44:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9ebd20640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e40d5020 con 0x7fc9e4161da0 2024-09-19T05:44:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9ebd20640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e40d0840 con 0x7fc9e40b51d0 2024-09-19T05:44:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e92bb640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc9e40d1590 0x7fc9e40cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44556/0 (socket says 172.21.15.67:44556) 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e92bb640 1 -- 172.21.15.67:0/1436637146 learned_addr learned my addr 172.21.15.67:0/1436637146 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9ea2bd640 1 --2- 172.21.15.67:0/1436637146 >> v2:172.21.15.97:3300/0 conn(0x7fc9e40b51d0 0x7fc9e40d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2640311017 0 0) 0x7fc9e40d4d40 con 0x7fc9e40d1590 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9d0003530 con 0x7fc9e40d1590 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1308117735 0 0) 0x7fc9d0003530 con 0x7fc9e40d1590 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 >> v2:172.21.15.97:3300/0 conn(0x7fc9e40b51d0 msgr2=0x7fc9e40d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 --2- 172.21.15.67:0/1436637146 >> v2:172.21.15.97:3300/0 conn(0x7fc9e40b51d0 0x7fc9e40d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 >> v1:172.21.15.97:6789/0 conn(0x7fc9e4161da0 legacy=0x7fc9e40d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e40d5300 con 0x7fc9e40d1590 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fc9d4001a00 con 0x7fc9e40d1590 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 >> v1:172.21.15.67:6789/0 conn(0x7fc9e40d1590 legacy=0x7fc9e40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9d00039c0 0x7fc9d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9d0004810 0x7fc9d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9d00051d0 0x7fc9d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e40d0840 con 0x7fc9d00039c0 2024-09-19T05:44:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d000c070 con 0x7fc9d0004810 2024-09-19T05:44:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d000c270 con 0x7fc9d00051d0 2024-09-19T05:44:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e9abc640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9d00039c0 0x7fc9d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e92bb640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9d0004810 0x7fc9d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9ea2bd640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9d00051d0 0x7fc9d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e9abc640 1 -- 172.21.15.67:0/1436637146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9d00051d0 msgr2=0x7fc9d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e9abc640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9d00051d0 0x7fc9d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e9abc640 1 -- 172.21.15.67:0/1436637146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9d0004810 msgr2=0x7fc9d0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:47.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e9abc640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9d0004810 0x7fc9d0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9e9abc640 1 -- 172.21.15.67:0/1436637146 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d0003530 con 0x7fc9d00039c0 2024-09-19T05:44:47.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9ea2bd640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9d00051d0 0x7fc9d000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:47.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.684+0000 7fc9ea2bd640 1 -- 172.21.15.67:0/1436637146 reap_dead start 2024-09-19T05:44:47.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9e9abc640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9d00039c0 0x7fc9d0003de0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc001780 tx=0x7fc9cc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7141993ace613879 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:47.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0013a0 con 0x7fc9d00039c0 2024-09-19T05:44:47.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9cc0052f0 con 0x7fc9d00039c0 2024-09-19T05:44:47.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9e8aba640 1 -- 172.21.15.67:0/1436637146 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc003840 con 0x7fc9d00039c0 2024-09-19T05:44:47.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9ebd20640 1 -- 172.21.15.67:0/1436637146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9d00039c0 msgr2=0x7fc9d0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9ebd20640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9d00039c0 0x7fc9d0003de0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc001780 tx=0x7fc9cc01c400 comp rx=0 tx=0).stop 2024-09-19T05:44:47.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9ebd20640 1 -- 172.21.15.67:0/1436637146 shutdown_connections 2024-09-19T05:44:47.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9ebd20640 1 --2- 172.21.15.67:0/1436637146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9d00039c0 0x7fc9d0003de0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9ebd20640 1 -- 172.21.15.67:0/1436637146 >> 172.21.15.67:0/1436637146 conn(0x7fc9e408bfc0 msgr2=0x7fc9e40d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:47.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9ebd20640 1 -- 172.21.15.67:0/1436637146 shutdown_connections 2024-09-19T05:44:47.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9ebd20640 1 -- 172.21.15.67:0/1436637146 wait complete. 2024-09-19T05:44:47.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.688+0000 7fc9ebd20640 1 Processor -- start 2024-09-19T05:44:47.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ebd20640 1 -- start start 2024-09-19T05:44:47.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ebd20640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9d00039c0 0x7fc9e40cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ebd20640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9e415cda0 0x7fc9e40ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ebd20640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e40ca8b0 0x7fc9e40b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ebd20640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e40d1410 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ebd20640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e40d1290 con 0x7fc9e415cda0 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ebd20640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e40b49d0 con 0x7fc9d00039c0 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ea2bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e40ca8b0 0x7fc9e40b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ea2bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e40ca8b0 0x7fc9e40b8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51446/0 (socket says 172.21.15.67:51446) 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ea2bd640 1 -- 172.21.15.67:0/2677059902 learned_addr learned my addr 172.21.15.67:0/2677059902 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9e92bb640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9e415cda0 0x7fc9e40ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9e9abc640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9d00039c0 0x7fc9e40cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ea2bd640 1 -- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9d00039c0 msgr2=0x7fc9e40cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ea2bd640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9d00039c0 0x7fc9e40cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ea2bd640 1 -- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9e415cda0 msgr2=0x7fc9e40ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ea2bd640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9e415cda0 0x7fc9e40ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ea2bd640 1 -- 172.21.15.67:0/2677059902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e40cc010 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9e92bb640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9e415cda0 0x7fc9e40ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:47.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ea2bd640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e40ca8b0 0x7fc9e40b8650 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40d4440 tx=0x7fc9dc010a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:47.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9e27fc640 1 -- 172.21.15.67:0/2677059902 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc00f040 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9e27fc640 1 -- 172.21.15.67:0/2677059902 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9dc014800 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9e27fc640 1 -- 172.21.15.67:0/2677059902 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc014bd0 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ebd20640 1 -- 172.21.15.67:0/2677059902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e40cc2f0 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ebd20640 1 -- 172.21.15.67:0/2677059902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e40cc8b0 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9ebd20640 1 -- 172.21.15.67:0/2677059902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e40b4dc0 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9e27fc640 1 -- 172.21.15.67:0/2677059902 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc9dc0253f0 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9e27fc640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9c40678f0 0x7fc9c4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:47.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9e27fc640 1 -- 172.21.15.67:0/2677059902 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6101+0+0 (secure 0 0 0) 0x7fc9dc085fa0 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.692+0000 7fc9e9abc640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9c40678f0 0x7fc9c4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:47.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.696+0000 7fc9e9abc640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9c40678f0 0x7fc9c4069db0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc001750 tx=0x7fc9cc0011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:47.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.696+0000 7fc9e27fc640 1 -- 172.21.15.67:0/2677059902 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc9dc018030 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.864+0000 7fc9ebd20640 1 -- 172.21.15.67:0/2677059902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9e406df80 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9e27fc640 1 -- 172.21.15.67:0/2677059902 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16929 (secure 0 0 0) 0x7fc9dc056950 con 0x7fc9e40ca8b0 2024-09-19T05:44:47.867 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:47.867 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":154,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:44:46.334850+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:44:44.010860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-19T05:44:45.332354+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:44:47.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 -- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9c40678f0 msgr2=0x7fc9c4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9c40678f0 0x7fc9c4069db0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc001750 tx=0x7fc9cc0011a0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 -- 172.21.15.67:0/2677059902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e40ca8b0 msgr2=0x7fc9e40b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e40ca8b0 0x7fc9e40b8650 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40d4440 tx=0x7fc9dc010a10 comp rx=0 tx=0).stop 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 -- 172.21.15.67:0/2677059902 shutdown_connections 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e40ca8b0 0x7fc9e40b8650 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9e415cda0 0x7fc9e40ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9c40678f0 0x7fc9c4069db0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 --2- 172.21.15.67:0/2677059902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9d00039c0 0x7fc9e40cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 -- 172.21.15.67:0/2677059902 >> 172.21.15.67:0/2677059902 conn(0x7fc9e408bfc0 msgr2=0x7fc9e406d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 -- 172.21.15.67:0/2677059902 shutdown_connections 2024-09-19T05:44:47.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:47.868+0000 7fc9ebd20640 1 -- 172.21.15.67:0/2677059902 wait complete. 2024-09-19T05:44:47.887 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:44:48.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a6cb9640 1 Processor -- start 2024-09-19T05:44:48.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a6cb9640 1 -- start start 2024-09-19T05:44:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a6cb9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a00cf9c0 0x7fd3a015f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a6cb9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd3a0072670 0x7fd3a00b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a6cb9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a015f910 con 0x7fd3a006dfc0 2024-09-19T05:44:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a6cb9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd3a006e540 con 0x7fd3a0072670 2024-09-19T05:44:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a6cb9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a006e820 con 0x7fd3a00cf9c0 2024-09-19T05:44:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd3a006dfc0 0x7fd3a0071f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44560/0 (socket says 172.21.15.67:44560) 2024-09-19T05:44:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39ffff640 1 -- 172.21.15.67:0/622647573 learned_addr learned my addr 172.21.15.67:0/622647573 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3160690711 0 0) 0x7fd388001120 con 0x7fd3a006dfc0 2024-09-19T05:44:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a5256640 1 --2- 172.21.15.67:0/622647573 >> v2:172.21.15.97:3300/0 conn(0x7fd3a0072670 0x7fd3a00b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd38c003530 con 0x7fd3a006dfc0 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a4a55640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a00cf9c0 0x7fd3a015f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3622918582 0 0) 0x7fd38c003530 con 0x7fd3a006dfc0 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a00cf9c0 msgr2=0x7fd3a015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a00cf9c0 0x7fd3a015f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 >> v2:172.21.15.97:3300/0 conn(0x7fd3a0072670 msgr2=0x7fd3a00b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 --2- 172.21.15.67:0/622647573 >> v2:172.21.15.97:3300/0 conn(0x7fd3a0072670 0x7fd3a00b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a006eb00 con 0x7fd3a006dfc0 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fd388001850 con 0x7fd3a006dfc0 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a5256640 1 --2- 172.21.15.67:0/622647573 >> v2:172.21.15.97:3300/0 conn(0x7fd3a0072670 0x7fd3a00b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 >> v1:172.21.15.67:6789/0 conn(0x7fd3a006dfc0 legacy=0x7fd3a0071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd38c0039c0 0x7fd38c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c004810 0x7fd38c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:48.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a00cf9c0 0x7fd38c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a006e540 con 0x7fd38c0039c0 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a006e820 con 0x7fd38c004810 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd38c00ba80 con 0x7fd3a00cf9c0 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.008+0000 7fd3a4a55640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd38c0039c0 0x7fd38c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd39ffff640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c004810 0x7fd38c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a5256640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a00cf9c0 0x7fd38c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a4a55640 1 -- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a00cf9c0 msgr2=0x7fd38c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a4a55640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a00cf9c0 0x7fd38c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a4a55640 1 -- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c004810 msgr2=0x7fd38c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a4a55640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c004810 0x7fd38c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a4a55640 1 -- 172.21.15.67:0/622647573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c003530 con 0x7fd38c0039c0 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd39ffff640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c004810 0x7fd38c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:48.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a5256640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a00cf9c0 0x7fd38c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:48.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a4a55640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd38c0039c0 0x7fd38c003de0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fd398009fc0 tx=0x7fd39801cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6399032d96dce20f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:48.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3980b2070 con 0x7fd38c0039c0 2024-09-19T05:44:48.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3980a5bc0 con 0x7fd38c0039c0 2024-09-19T05:44:48.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd39f7fe640 1 -- 172.21.15.67:0/622647573 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398009bc0 con 0x7fd38c0039c0 2024-09-19T05:44:48.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/622647573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd38c0039c0 msgr2=0x7fd38c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:48.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a6cb9640 1 --2- 172.21.15.67:0/622647573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd38c0039c0 0x7fd38c003de0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fd398009fc0 tx=0x7fd39801cdb0 comp rx=0 tx=0).stop 2024-09-19T05:44:48.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a5256640 1 -- 172.21.15.67:0/622647573 reap_dead start 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/622647573 shutdown_connections 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/622647573 >> 172.21.15.67:0/622647573 conn(0x7fd3a00b1e50 msgr2=0x7fd3a00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/622647573 shutdown_connections 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.012+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/622647573 wait complete. 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 Processor -- start 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 -- start start 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c0039c0 0x7fd3a0151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a01f7bf0 0x7fd3a009dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3a014df50 0x7fd3a0161d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a00b4120 con 0x7fd3a014df50 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a00b3fa0 con 0x7fd38c0039c0 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a00b42a0 con 0x7fd3a01f7bf0 2024-09-19T05:44:48.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a5256640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3a014df50 0x7fd3a0161d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a5256640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3a014df50 0x7fd3a0161d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51460/0 (socket says 172.21.15.67:51460) 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a5256640 1 -- 172.21.15.67:0/4058444827 learned_addr learned my addr 172.21.15.67:0/4058444827 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a4a55640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c0039c0 0x7fd3a0151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd39ffff640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a01f7bf0 0x7fd3a009dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a5256640 1 -- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a01f7bf0 msgr2=0x7fd3a009dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a5256640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a01f7bf0 0x7fd3a009dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a5256640 1 -- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c0039c0 msgr2=0x7fd3a0151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a5256640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c0039c0 0x7fd3a0151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a5256640 1 -- 172.21.15.67:0/4058444827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a01f8280 con 0x7fd3a014df50 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd39ffff640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a01f7bf0 0x7fd3a009dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a4a55640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c0039c0 0x7fd3a0151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a5256640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3a014df50 0x7fd3a0161d60 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0071950 tx=0x7fd39000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd39d7fa640 1 -- 172.21.15.67:0/4058444827 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390004030 con 0x7fd3a014df50 2024-09-19T05:44:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd39d7fa640 1 -- 172.21.15.67:0/4058444827 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd390019070 con 0x7fd3a014df50 2024-09-19T05:44:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/4058444827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a01520b0 con 0x7fd3a014df50 2024-09-19T05:44:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd39d7fa640 1 -- 172.21.15.67:0/4058444827 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390004410 con 0x7fd3a014df50 2024-09-19T05:44:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/4058444827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a0152670 con 0x7fd3a014df50 2024-09-19T05:44:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/4058444827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a00b3250 con 0x7fd3a014df50 2024-09-19T05:44:48.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd39d7fa640 1 -- 172.21.15.67:0/4058444827 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd390012070 con 0x7fd3a014df50 2024-09-19T05:44:48.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd39d7fa640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3800678f0 0x7fd380069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:48.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd39d7fa640 1 -- 172.21.15.67:0/4058444827 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fd3900857a0 con 0x7fd3a014df50 2024-09-19T05:44:48.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.016+0000 7fd3a4a55640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3800678f0 0x7fd380069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:48.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.020+0000 7fd3a4a55640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3800678f0 0x7fd380069db0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd3980af000 tx=0x7fd398004a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:48.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.024+0000 7fd39d7fa640 1 -- 172.21.15.67:0/4058444827 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd3900560d0 con 0x7fd3a014df50 2024-09-19T05:44:48.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:48.216+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/4058444827 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd3a009e280 con 0x7fd3a014df50 2024-09-19T05:44:48.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-19T05:44:48.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-19T05:44:48.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-19T05:44:49.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.204+0000 7fd39d7fa640 1 -- 172.21.15.67:0/4058444827 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v105) ==== 118+0+0 (secure 0 0 0) 0x7fd3900559d0 con 0x7fd3a014df50 2024-09-19T05:44:49.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3800678f0 msgr2=0x7fd380069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:49.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3800678f0 0x7fd380069db0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd3980af000 tx=0x7fd398004a50 comp rx=0 tx=0).stop 2024-09-19T05:44:49.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/4058444827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3a014df50 msgr2=0x7fd3a0161d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:49.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3a014df50 0x7fd3a0161d60 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0071950 tx=0x7fd39000f670 comp rx=0 tx=0).stop 2024-09-19T05:44:49.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/4058444827 shutdown_connections 2024-09-19T05:44:49.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3a014df50 0x7fd3a0161d60 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:49.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3800678f0 0x7fd380069db0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:49.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3a01f7bf0 0x7fd3a009dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:49.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 --2- 172.21.15.67:0/4058444827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd38c0039c0 0x7fd3a0151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:49.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/4058444827 >> 172.21.15.67:0/4058444827 conn(0x7fd3a00b1e50 msgr2=0x7fd3a00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:49.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/4058444827 shutdown_connections 2024-09-19T05:44:49.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.208+0000 7fd3a6cb9640 1 -- 172.21.15.67:0/4058444827 wait complete. 2024-09-19T05:44:49.228 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:44:49.228 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:44:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b3dcc640 1 Processor -- start 2024-09-19T05:44:49.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b3dcc640 1 -- start start 2024-09-19T05:44:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b3dcc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f30ac15c200 0x7f30ac06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b3dcc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac070990 0x7f30ac06d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b3dcc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30ac0d0330 con 0x7f30ac0732f0 2024-09-19T05:44:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b3dcc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f30ac0b3a10 con 0x7f30ac15c200 2024-09-19T05:44:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b3dcc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac0d00e0 con 0x7f30ac070990 2024-09-19T05:44:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b1367640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac070990 0x7f30ac06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b1b68640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f30ac15c200 0x7f30ac06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b2369640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f30ac0732f0 0x7f30ac15c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:58900/0 (socket says 172.21.15.67:58900) 2024-09-19T05:44:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b1367640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac070990 0x7f30ac06d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:56022/0 (socket says 172.21.15.67:56022) 2024-09-19T05:44:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b2369640 1 -- 172.21.15.67:0/1866984305 learned_addr learned my addr 172.21.15.67:0/1866984305 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b1b68640 1 -- 172.21.15.67:0/1866984305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac070990 msgr2=0x7f30ac06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:49.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b1b68640 1 --2- 172.21.15.67:0/1866984305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac070990 0x7f30ac06d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b1b68640 1 -- 172.21.15.67:0/1866984305 >> v1:172.21.15.97:6789/0 conn(0x7f30ac0732f0 legacy=0x7f30ac15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:49.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.356+0000 7f30b1b68640 1 -- 172.21.15.67:0/1866984305 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac0d0610 con 0x7f30ac15c200 2024-09-19T05:44:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.360+0000 7f30b1b68640 1 --2- 172.21.15.67:0/1866984305 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ac15c200 0x7f30ac06ccd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f30a80097c0 tx=0x7f30a801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=423174ca71106ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:49.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.360+0000 7f30b0b66640 1 -- 172.21.15.67:0/1866984305 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80aa5f0 con 0x7f30ac15c200 2024-09-19T05:44:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.360+0000 7f30b0b66640 1 -- 172.21.15.67:0/1866984305 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a80af070 con 0x7f30ac15c200 2024-09-19T05:44:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.360+0000 7f30b0b66640 1 -- 172.21.15.67:0/1866984305 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80aa9b0 con 0x7f30ac15c200 2024-09-19T05:44:49.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- 172.21.15.67:0/1866984305 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ac15c200 msgr2=0x7f30ac06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 --2- 172.21.15.67:0/1866984305 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ac15c200 0x7f30ac06ccd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f30a80097c0 tx=0x7f30a801c470 comp rx=0 tx=0).stop 2024-09-19T05:44:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- 172.21.15.67:0/1866984305 shutdown_connections 2024-09-19T05:44:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 --2- 172.21.15.67:0/1866984305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac070990 0x7f30ac06d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 --2- 172.21.15.67:0/1866984305 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ac15c200 0x7f30ac06ccd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- 172.21.15.67:0/1866984305 >> 172.21.15.67:0/1866984305 conn(0x7f30ac0727d0 msgr2=0x7f30ac072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- 172.21.15.67:0/1866984305 shutdown_connections 2024-09-19T05:44:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- 172.21.15.67:0/1866984305 wait complete. 2024-09-19T05:44:49.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 Processor -- start 2024-09-19T05:44:49.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- start start 2024-09-19T05:44:49.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ac0732f0 0x7f30ac1484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac15c200 0x7f30ac133ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30ac134430 0x7f30ac14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac1691a0 con 0x7f30ac134430 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac169020 con 0x7f30ac0732f0 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac169320 con 0x7f30ac15c200 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b2369640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30ac134430 0x7f30ac14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b2369640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30ac134430 0x7f30ac14a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51464/0 (socket says 172.21.15.67:51464) 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b2369640 1 -- 172.21.15.67:0/98310131 learned_addr learned my addr 172.21.15.67:0/98310131 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b1b68640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ac0732f0 0x7f30ac1484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b1367640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac15c200 0x7f30ac133ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b2369640 1 -- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac15c200 msgr2=0x7f30ac133ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:49.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b2369640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac15c200 0x7f30ac133ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b2369640 1 -- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ac0732f0 msgr2=0x7f30ac1484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b2369640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ac0732f0 0x7f30ac1484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b2369640 1 -- 172.21.15.67:0/98310131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac134990 con 0x7f30ac134430 2024-09-19T05:44:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b1367640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac15c200 0x7f30ac133ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b2369640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30ac134430 0x7f30ac14a970 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f30a400caf0 tx=0x7f30a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30a27fc640 1 -- 172.21.15.67:0/98310131 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4017070 con 0x7f30ac134430 2024-09-19T05:44:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30a27fc640 1 -- 172.21.15.67:0/98310131 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a400ac40 con 0x7f30ac134430 2024-09-19T05:44:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- 172.21.15.67:0/98310131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac134c70 con 0x7f30ac134430 2024-09-19T05:44:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30a27fc640 1 -- 172.21.15.67:0/98310131 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4012600 con 0x7f30ac134430 2024-09-19T05:44:49.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.364+0000 7f30b3dcc640 1 -- 172.21.15.67:0/98310131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac14a450 con 0x7f30ac134430 2024-09-19T05:44:49.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.368+0000 7f30b3dcc640 1 -- 172.21.15.67:0/98310131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ac14a650 con 0x7f30ac134430 2024-09-19T05:44:49.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.368+0000 7f30a27fc640 1 -- 172.21.15.67:0/98310131 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30a401a070 con 0x7f30ac134430 2024-09-19T05:44:49.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.368+0000 7f30a27fc640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30900678c0 0x7f3090069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:49.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.368+0000 7f30a27fc640 1 -- 172.21.15.67:0/98310131 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f30a4085a80 con 0x7f30ac134430 2024-09-19T05:44:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.368+0000 7f30b1b68640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30900678c0 0x7f3090069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:49.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.368+0000 7f30b1b68640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30900678c0 0x7f3090069d80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f30a80ae000 tx=0x7f30a80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:49.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.372+0000 7f30a27fc640 1 -- 172.21.15.67:0/98310131 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f30ac14a650 con 0x7f30ac134430 2024-09-19T05:44:49.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:49.564+0000 7f30b3dcc640 1 -- 172.21.15.67:0/98310131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f30ac149f40 con 0x7f30ac134430 2024-09-19T05:44:50.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30a27fc640 1 -- 172.21.15.67:0/98310131 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v106) ==== 122+0+0 (secure 0 0 0) 0x7f30a4055d50 con 0x7f30ac134430 2024-09-19T05:44:50.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 -- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30900678c0 msgr2=0x7f3090069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30900678c0 0x7f3090069d80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f30a80ae000 tx=0x7f30a80a7000 comp rx=0 tx=0).stop 2024-09-19T05:44:50.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 -- 172.21.15.67:0/98310131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30ac134430 msgr2=0x7f30ac14a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30ac134430 0x7f30ac14a970 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f30a400caf0 tx=0x7f30a400a060 comp rx=0 tx=0).stop 2024-09-19T05:44:50.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 -- 172.21.15.67:0/98310131 shutdown_connections 2024-09-19T05:44:50.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30ac134430 0x7f30ac14a970 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30900678c0 0x7f3090069d80 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30ac15c200 0x7f30ac133ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 --2- 172.21.15.67:0/98310131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ac0732f0 0x7f30ac1484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 -- 172.21.15.67:0/98310131 >> 172.21.15.67:0/98310131 conn(0x7f30ac0727d0 msgr2=0x7f30ac0b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:50.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 -- 172.21.15.67:0/98310131 shutdown_connections 2024-09-19T05:44:50.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.216+0000 7f30b3dcc640 1 -- 172.21.15.67:0/98310131 wait complete. 2024-09-19T05:44:50.240 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:44:50.241 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:50.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bd3159640 1 Processor -- start 2024-09-19T05:44:50.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bd3159640 1 -- start start 2024-09-19T05:44:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bd3159640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4bcc0b2060 0x7f4bcc0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bd3159640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc0cc030 0x7f4bcc0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bd3159640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bcc0cd8e0 con 0x7f4bcc15b2f0 2024-09-19T05:44:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bd3159640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4bcc0b29e0 con 0x7f4bcc0b2060 2024-09-19T05:44:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bd3159640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4bcc0cdbc0 con 0x7f4bcc0cc030 2024-09-19T05:44:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bcbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4bcc0b2060 0x7f4bcc0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bcbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4bcc0b2060 0x7f4bcc0b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51476/0 (socket says 172.21.15.67:51476) 2024-09-19T05:44:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bcbfff640 1 -- 172.21.15.67:0/4111668781 learned_addr learned my addr 172.21.15.67:0/4111668781 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bd0ef5640 1 --1- 172.21.15.67:0/4111668781 >> v1:172.21.15.67:6789/0 conn(0x7f4bcc15b2f0 0x7f4bcc0b35e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44568/0 (socket says 172.21.15.67:44568) 2024-09-19T05:44:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bd16f6640 1 --2- 172.21.15.67:0/4111668781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc0cc030 0x7f4bcc0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bcbfff640 1 -- 172.21.15.67:0/4111668781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc0cc030 msgr2=0x7f4bcc0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bcbfff640 1 --2- 172.21.15.67:0/4111668781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc0cc030 0x7f4bcc0cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bcbfff640 1 -- 172.21.15.67:0/4111668781 >> v1:172.21.15.67:6789/0 conn(0x7f4bcc15b2f0 legacy=0x7f4bcc0b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bcbfff640 1 -- 172.21.15.67:0/4111668781 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc0cdea0 con 0x7f4bcc0b2060 2024-09-19T05:44:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.372+0000 7f4bcb7fe640 1 -- 172.21.15.67:0/4111668781 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199969787 0 0) 0x7f4bcc0cd8e0 con 0x7f4bcc15b2f0 2024-09-19T05:44:50.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bcbfff640 1 --2- 172.21.15.67:0/4111668781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0b2060 0x7f4bcc0b24a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009870 tx=0x7f4bbc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80c5c2406bbd862 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:50.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bcb7fe640 1 -- 172.21.15.67:0/4111668781 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0aa600 con 0x7f4bcc0b2060 2024-09-19T05:44:50.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bcb7fe640 1 -- 172.21.15.67:0/4111668781 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bbc0af070 con 0x7f4bcc0b2060 2024-09-19T05:44:50.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bcb7fe640 1 -- 172.21.15.67:0/4111668781 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0aa9c0 con 0x7f4bcc0b2060 2024-09-19T05:44:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bd3159640 1 -- 172.21.15.67:0/4111668781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0b2060 msgr2=0x7f4bcc0b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bd3159640 1 --2- 172.21.15.67:0/4111668781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0b2060 0x7f4bcc0b24a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009870 tx=0x7f4bbc01c4a0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bd3159640 1 -- 172.21.15.67:0/4111668781 shutdown_connections 2024-09-19T05:44:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bd3159640 1 --2- 172.21.15.67:0/4111668781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc0cc030 0x7f4bcc0cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bd3159640 1 --2- 172.21.15.67:0/4111668781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0b2060 0x7f4bcc0b24a0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bd3159640 1 -- 172.21.15.67:0/4111668781 >> 172.21.15.67:0/4111668781 conn(0x7f4bcc09aa30 msgr2=0x7f4bcc0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bd3159640 1 -- 172.21.15.67:0/4111668781 shutdown_connections 2024-09-19T05:44:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bd3159640 1 -- 172.21.15.67:0/4111668781 wait complete. 2024-09-19T05:44:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bd3159640 1 Processor -- start 2024-09-19T05:44:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.376+0000 7f4bd3159640 1 -- start start 2024-09-19T05:44:50.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd3159640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc0b2060 0x7f4bcc14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd3159640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0cc030 0x7f4bcc0af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd3159640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc15b2f0 0x7f4bcc0ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd3159640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc15b6d0 con 0x7f4bcc0cc030 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd3159640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc0b3cf0 con 0x7f4bcc0b2060 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd3159640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4bcc15b850 con 0x7f4bcc15b2f0 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bcbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0cc030 0x7f4bcc0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bcbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0cc030 0x7f4bcc0af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51482/0 (socket says 172.21.15.67:51482) 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bcbfff640 1 -- 172.21.15.67:0/4256144951 learned_addr learned my addr 172.21.15.67:0/4256144951 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd0ef5640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc0b2060 0x7f4bcc14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd16f6640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc15b2f0 0x7f4bcc0ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bcbfff640 1 -- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc15b2f0 msgr2=0x7f4bcc0ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bcbfff640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc15b2f0 0x7f4bcc0ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bcbfff640 1 -- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc0b2060 msgr2=0x7f4bcc14d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bcbfff640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc0b2060 0x7f4bcc14d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bcbfff640 1 -- 172.21.15.67:0/4256144951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc14e100 con 0x7f4bcc0cc030 2024-09-19T05:44:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd16f6640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc15b2f0 0x7f4bcc0ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bcbfff640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0cc030 0x7f4bcc0af450 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc01a0d0 tx=0x7f4bbc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bc97fa640 1 -- 172.21.15.67:0/4256144951 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0b9070 con 0x7f4bcc0cc030 2024-09-19T05:44:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bc97fa640 1 -- 172.21.15.67:0/4256144951 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bbc004220 con 0x7f4bcc0cc030 2024-09-19T05:44:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd3159640 1 -- 172.21.15.67:0/4256144951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bcc153de0 con 0x7f4bcc0cc030 2024-09-19T05:44:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bc97fa640 1 -- 172.21.15.67:0/4256144951 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0aa940 con 0x7f4bcc0cc030 2024-09-19T05:44:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd3159640 1 -- 172.21.15.67:0/4256144951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bcc1543a0 con 0x7f4bcc0cc030 2024-09-19T05:44:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd3159640 1 -- 172.21.15.67:0/4256144951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bcc0b24a0 con 0x7f4bcc0cc030 2024-09-19T05:44:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bc97fa640 1 -- 172.21.15.67:0/4256144951 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4bbc0a9070 con 0x7f4bcc0cc030 2024-09-19T05:44:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bc97fa640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4bb80678c0 0x7f4bb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bc97fa640 1 -- 172.21.15.67:0/4256144951 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f4bbc11faf0 con 0x7f4bcc0cc030 2024-09-19T05:44:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.380+0000 7f4bd0ef5640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4bb80678c0 0x7f4bb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.384+0000 7f4bd0ef5640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4bb80678c0 0x7f4bb8069d80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0000f70 tx=0x7f4bc0007b80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:50.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.384+0000 7f4bc97fa640 1 -- 172.21.15.67:0/4256144951 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4bcc14e100 con 0x7f4bcc0cc030 2024-09-19T05:44:50.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.584+0000 7f4bd3159640 1 -- 172.21.15.67:0/4256144951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bcc154dd0 con 0x7f4bcc0cc030 2024-09-19T05:44:50.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.584+0000 7f4bc97fa640 1 -- 172.21.15.67:0/4256144951 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7f4bbc016150 con 0x7f4bcc0cc030 2024-09-19T05:44:50.585 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:50.585 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:44:50.585 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:44:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 -- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4bb80678c0 msgr2=0x7f4bb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4bb80678c0 0x7f4bb8069d80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0000f70 tx=0x7f4bc0007b80 comp rx=0 tx=0).stop 2024-09-19T05:44:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 -- 172.21.15.67:0/4256144951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0cc030 msgr2=0x7f4bcc0af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0cc030 0x7f4bcc0af450 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc01a0d0 tx=0x7f4bbc01ace0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 -- 172.21.15.67:0/4256144951 shutdown_connections 2024-09-19T05:44:50.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4bb80678c0 0x7f4bb8069d80 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bcc15b2f0 0x7f4bcc0ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc0cc030 0x7f4bcc0af450 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 --2- 172.21.15.67:0/4256144951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc0b2060 0x7f4bcc14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 -- 172.21.15.67:0/4256144951 >> 172.21.15.67:0/4256144951 conn(0x7f4bcc09aa30 msgr2=0x7f4bcc0704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:50.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 -- 172.21.15.67:0/4256144951 shutdown_connections 2024-09-19T05:44:50.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.588+0000 7f4bd3159640 1 -- 172.21.15.67:0/4256144951 wait complete. 2024-09-19T05:44:50.605 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:44:50.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa343e21640 1 Processor -- start 2024-09-19T05:44:50.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa343e21640 1 -- start start 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa343e21640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa33c0b51d0 0x7fa33c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa343e21640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33c0d4d40 con 0x7fa33c0d1590 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa343e21640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33c0d5020 con 0x7fa33c161da0 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa343e21640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa33c0d0840 con 0x7fa33c0b51d0 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa3413bc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa33c0d1590 0x7fa33c0cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44580/0 (socket says 172.21.15.67:44580) 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa3413bc640 1 -- 172.21.15.67:0/4028119288 learned_addr learned my addr 172.21.15.67:0/4028119288 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa3423be640 1 --2- 172.21.15.67:0/4028119288 >> v2:172.21.15.97:3300/0 conn(0x7fa33c0b51d0 0x7fa33c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064033895 0 0) 0x7fa33c0d4d40 con 0x7fa33c0d1590 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa328003530 con 0x7fa33c0d1590 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1836801639 0 0) 0x7fa328003530 con 0x7fa33c0d1590 2024-09-19T05:44:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 >> v2:172.21.15.97:3300/0 conn(0x7fa33c0b51d0 msgr2=0x7fa33c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 --2- 172.21.15.67:0/4028119288 >> v2:172.21.15.97:3300/0 conn(0x7fa33c0b51d0 0x7fa33c0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 >> v1:172.21.15.97:6789/0 conn(0x7fa33c161da0 legacy=0x7fa33c0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c0d5300 con 0x7fa33c0d1590 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fa32c001680 con 0x7fa33c0d1590 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 >> v1:172.21.15.67:6789/0 conn(0x7fa33c0d1590 legacy=0x7fa33c0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa328003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa328004810 0x7fa328004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3280051d0 0x7fa32800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c0d0840 con 0x7fa3280039c0 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa32800c070 con 0x7fa3280051d0 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa32800c270 con 0x7fa328004810 2024-09-19T05:44:50.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa341bbd640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa328003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa3413bc640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa328004810 0x7fa328004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa341bbd640 1 -- 172.21.15.67:0/4028119288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa328004810 msgr2=0x7fa328004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:50.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa341bbd640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa328004810 0x7fa328004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa341bbd640 1 -- 172.21.15.67:0/4028119288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3280051d0 msgr2=0x7fa32800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:50.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa341bbd640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3280051d0 0x7fa32800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa3423be640 1 -- 172.21.15.67:0/4028119288 reap_dead start 2024-09-19T05:44:50.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa341bbd640 1 -- 172.21.15.67:0/4028119288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa328003530 con 0x7fa3280039c0 2024-09-19T05:44:50.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.732+0000 7fa3413bc640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa328004810 0x7fa328004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:50.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa341bbd640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa328003de0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fa338001780 tx=0x7fa33801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aed85cd542239c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:50.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3380013a0 con 0x7fa3280039c0 2024-09-19T05:44:50.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3380052f0 con 0x7fa3280039c0 2024-09-19T05:44:50.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa340bbb640 1 -- 172.21.15.67:0/4028119288 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa338003840 con 0x7fa3280039c0 2024-09-19T05:44:50.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 -- 172.21.15.67:0/4028119288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 msgr2=0x7fa328003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa328003de0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fa338001780 tx=0x7fa33801c420 comp rx=0 tx=0).stop 2024-09-19T05:44:50.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 -- 172.21.15.67:0/4028119288 shutdown_connections 2024-09-19T05:44:50.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 --2- 172.21.15.67:0/4028119288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa328003de0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 -- 172.21.15.67:0/4028119288 >> 172.21.15.67:0/4028119288 conn(0x7fa33c08bfc0 msgr2=0x7fa33c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:50.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 -- 172.21.15.67:0/4028119288 shutdown_connections 2024-09-19T05:44:50.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 -- 172.21.15.67:0/4028119288 wait complete. 2024-09-19T05:44:50.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 Processor -- start 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 -- start start 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa33c156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa33c0c92e0 0x7fa33c0c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c15d360 0x7fa33c15d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c0d1410 con 0x7fa3280039c0 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c0d1290 con 0x7fa33c15d360 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa343e21640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa33c0b49d0 con 0x7fa33c0c92e0 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa341bbd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa33c156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa341bbd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa33c156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51494/0 (socket says 172.21.15.67:51494) 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.736+0000 7fa341bbd640 1 -- 172.21.15.67:0/2394848020 learned_addr learned my addr 172.21.15.67:0/2394848020 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3413bc640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa33c0c92e0 0x7fa33c0c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3423be640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c15d360 0x7fa33c15d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa341bbd640 1 -- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa33c0c92e0 msgr2=0x7fa33c0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa341bbd640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa33c0c92e0 0x7fa33c0c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa341bbd640 1 -- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c15d360 msgr2=0x7fa33c15d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa341bbd640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c15d360 0x7fa33c15d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa341bbd640 1 -- 172.21.15.67:0/2394848020 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c050020 con 0x7fa3280039c0 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3413bc640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa33c0c92e0 0x7fa33c0c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3423be640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c15d360 0x7fa33c15d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa341bbd640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa33c156b60 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fa338005040 tx=0x7fa328005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3327fc640 1 -- 172.21.15.67:0/2394848020 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa338007a40 con 0x7fa3280039c0 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3327fc640 1 -- 172.21.15.67:0/2394848020 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3380ba070 con 0x7fa3280039c0 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa343e21640 1 -- 172.21.15.67:0/2394848020 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33c0cb700 con 0x7fa3280039c0 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3327fc640 1 -- 172.21.15.67:0/2394848020 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa338000ee0 con 0x7fa3280039c0 2024-09-19T05:44:50.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa343e21640 1 -- 172.21.15.67:0/2394848020 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33c0cc480 con 0x7fa3280039c0 2024-09-19T05:44:50.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa343e21640 1 -- 172.21.15.67:0/2394848020 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa33c0b4dc0 con 0x7fa3280039c0 2024-09-19T05:44:50.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3327fc640 1 -- 172.21.15.67:0/2394848020 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa338005270 con 0x7fa3280039c0 2024-09-19T05:44:50.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3327fc640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa320067a90 0x7fa320069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:50.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3327fc640 1 -- 172.21.15.67:0/2394848020 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fa33811fdd0 con 0x7fa3280039c0 2024-09-19T05:44:50.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3413bc640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa320067a90 0x7fa320069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:50.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.740+0000 7fa3413bc640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa320067a90 0x7fa320069f50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa32c001ec0 tx=0x7fa32c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:50.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.744+0000 7fa3327fc640 1 -- 172.21.15.67:0/2394848020 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa338016130 con 0x7fa3280039c0 2024-09-19T05:44:50.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.904+0000 7fa343e21640 1 -- 172.21.15.67:0/2394848020 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa33c0ba1f0 con 0x7fa3280039c0 2024-09-19T05:44:50.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.904+0000 7fa3327fc640 1 -- 172.21.15.67:0/2394848020 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16916 (secure 0 0 0) 0x7fa3380f0780 con 0x7fa3280039c0 2024-09-19T05:44:50.905 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:50.906 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":155,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:44:47.966306+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:44:44.010860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-19T05:44:45.332354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:44:50.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 -- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa320067a90 msgr2=0x7fa320069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa320067a90 0x7fa320069f50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa32c001ec0 tx=0x7fa32c009040 comp rx=0 tx=0).stop 2024-09-19T05:44:50.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 -- 172.21.15.67:0/2394848020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 msgr2=0x7fa33c156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:50.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa33c156b60 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fa338005040 tx=0x7fa328005840 comp rx=0 tx=0).stop 2024-09-19T05:44:50.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 -- 172.21.15.67:0/2394848020 shutdown_connections 2024-09-19T05:44:50.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c15d360 0x7fa33c15d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa320067a90 0x7fa320069f50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa33c0c92e0 0x7fa33c0c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 --2- 172.21.15.67:0/2394848020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3280039c0 0x7fa33c156b60 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:50.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 -- 172.21.15.67:0/2394848020 >> 172.21.15.67:0/2394848020 conn(0x7fa33c08bfc0 msgr2=0x7fa33c162390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:50.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 -- 172.21.15.67:0/2394848020 shutdown_connections 2024-09-19T05:44:50.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:50.908+0000 7fa343e21640 1 -- 172.21.15.67:0/2394848020 wait complete. 2024-09-19T05:44:50.925 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:44:50.925 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:44:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc469142640 1 Processor -- start 2024-09-19T05:44:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc469142640 1 -- start start 2024-09-19T05:44:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc469142640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc464161da0 0x7fc4640d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc469142640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc4640d0e80 0x7fc4640d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc469142640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4640d4d40 con 0x7fc4640b41c0 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc469142640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc4640d1830 con 0x7fc464161da0 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc469142640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc4640d0840 con 0x7fc4640d0e80 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc462d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc464161da0 0x7fc4640d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc462d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc464161da0 0x7fc4640d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51508/0 (socket says 172.21.15.67:51508) 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc462d9d640 1 -- 172.21.15.67:0/113902340 learned_addr learned my addr 172.21.15.67:0/113902340 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc46259c640 1 --2- 172.21.15.67:0/113902340 >> v2:172.21.15.97:3300/0 conn(0x7fc4640d0e80 0x7fc4640d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc462d9d640 1 -- 172.21.15.67:0/113902340 >> v2:172.21.15.97:3300/0 conn(0x7fc4640d0e80 msgr2=0x7fc4640d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc462d9d640 1 --2- 172.21.15.67:0/113902340 >> v2:172.21.15.97:3300/0 conn(0x7fc4640d0e80 0x7fc4640d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc462d9d640 1 -- 172.21.15.67:0/113902340 >> v1:172.21.15.97:6789/0 conn(0x7fc4640b41c0 legacy=0x7fc4640b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc462d9d640 1 -- 172.21.15.67:0/113902340 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4640d5020 con 0x7fc464161da0 2024-09-19T05:44:51.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.040+0000 7fc46259c640 1 --2- 172.21.15.67:0/113902340 >> v2:172.21.15.97:3300/0 conn(0x7fc4640d0e80 0x7fc4640d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc462d9d640 1 --2- 172.21.15.67:0/113902340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc464161da0 0x7fc4640d1af0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fc4640d4440 tx=0x7fc45401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b072be4fba6788 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc461d9b640 1 -- 172.21.15.67:0/113902340 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4540b1070 con 0x7fc464161da0 2024-09-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc461d9b640 1 -- 172.21.15.67:0/113902340 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4540ac630 con 0x7fc464161da0 2024-09-19T05:44:51.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc461d9b640 1 -- 172.21.15.67:0/113902340 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4540a8050 con 0x7fc464161da0 2024-09-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc469142640 1 -- 172.21.15.67:0/113902340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc464161da0 msgr2=0x7fc4640d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc469142640 1 --2- 172.21.15.67:0/113902340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc464161da0 0x7fc4640d1af0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fc4640d4440 tx=0x7fc45401c4e0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc469142640 1 -- 172.21.15.67:0/113902340 shutdown_connections 2024-09-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc469142640 1 --2- 172.21.15.67:0/113902340 >> v2:172.21.15.97:3300/0 conn(0x7fc4640d0e80 0x7fc4640d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc469142640 1 --2- 172.21.15.67:0/113902340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc464161da0 0x7fc4640d1af0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc469142640 1 -- 172.21.15.67:0/113902340 >> 172.21.15.67:0/113902340 conn(0x7fc46408bfc0 msgr2=0x7fc4640d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc469142640 1 -- 172.21.15.67:0/113902340 shutdown_connections 2024-09-19T05:44:51.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc469142640 1 -- 172.21.15.67:0/113902340 wait complete. 2024-09-19T05:44:51.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc469142640 1 Processor -- start 2024-09-19T05:44:51.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.044+0000 7fc469142640 1 -- start start 2024-09-19T05:44:51.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc469142640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640b41c0 0x7fc4640b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc469142640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4640d0e80 0x7fc4640cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc469142640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc464161da0 0x7fc464153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc469142640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc464162180 con 0x7fc4640b41c0 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc469142640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc4640b5d00 con 0x7fc4640d0e80 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc469142640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc46416b4f0 con 0x7fc464161da0 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc462d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640b41c0 0x7fc4640b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc462d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640b41c0 0x7fc4640b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51516/0 (socket says 172.21.15.67:51516) 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc462d9d640 1 -- 172.21.15.67:0/2623530274 learned_addr learned my addr 172.21.15.67:0/2623530274 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc46259c640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4640d0e80 0x7fc4640cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc46359e640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc464161da0 0x7fc464153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc462d9d640 1 -- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc464161da0 msgr2=0x7fc464153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc462d9d640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc464161da0 0x7fc464153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc462d9d640 1 -- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4640d0e80 msgr2=0x7fc4640cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc462d9d640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4640d0e80 0x7fc4640cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc462d9d640 1 -- 172.21.15.67:0/2623530274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4640b1f60 con 0x7fc4640b41c0 2024-09-19T05:44:51.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc462d9d640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640b41c0 0x7fc4640b1a20 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fc4540af040 tx=0x7fc454019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:51.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc44b7fe640 1 -- 172.21.15.67:0/2623530274 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4540bc070 con 0x7fc4640b41c0 2024-09-19T05:44:51.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc44b7fe640 1 -- 172.21.15.67:0/2623530274 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4540ab820 con 0x7fc4640b41c0 2024-09-19T05:44:51.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc469142640 1 -- 172.21.15.67:0/2623530274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4641559d0 con 0x7fc4640b41c0 2024-09-19T05:44:51.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc44b7fe640 1 -- 172.21.15.67:0/2623530274 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4540b1070 con 0x7fc4640b41c0 2024-09-19T05:44:51.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc469142640 1 -- 172.21.15.67:0/2623530274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4640b2d40 con 0x7fc4640b41c0 2024-09-19T05:44:51.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc469142640 1 -- 172.21.15.67:0/2623530274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4640d12f0 con 0x7fc4640b41c0 2024-09-19T05:44:51.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc44b7fe640 1 -- 172.21.15.67:0/2623530274 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4540bf070 con 0x7fc4640b41c0 2024-09-19T05:44:51.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc44b7fe640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4500678c0 0x7fc450069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc44b7fe640 1 -- 172.21.15.67:0/2623530274 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fc45411f930 con 0x7fc4640b41c0 2024-09-19T05:44:51.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.048+0000 7fc46259c640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4500678c0 0x7fc450069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.052+0000 7fc46259c640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4500678c0 0x7fc450069d80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc4640b6ad0 tx=0x7fc458008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:51.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.052+0000 7fc44b7fe640 1 -- 172.21.15.67:0/2623530274 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc4641559d0 con 0x7fc4640b41c0 2024-09-19T05:44:51.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.212+0000 7fc469142640 1 -- 172.21.15.67:0/2623530274 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4640cd920 con 0x7fc4500678c0 2024-09-19T05:44:51.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.232+0000 7fc44b7fe640 1 -- 172.21.15.67:0/2623530274 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252416 (secure 0 0 0) 0x7fc4640cd920 con 0x7fc4500678c0 2024-09-19T05:44:51.233 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:51.235 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:44:51.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 -- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4500678c0 msgr2=0x7fc450069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4500678c0 0x7fc450069d80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc4640b6ad0 tx=0x7fc458008040 comp rx=0 tx=0).stop 2024-09-19T05:44:51.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 -- 172.21.15.67:0/2623530274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640b41c0 msgr2=0x7fc4640b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640b41c0 0x7fc4640b1a20 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fc4540af040 tx=0x7fc454019280 comp rx=0 tx=0).stop 2024-09-19T05:44:51.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 -- 172.21.15.67:0/2623530274 shutdown_connections 2024-09-19T05:44:51.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4500678c0 0x7fc450069d80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc464161da0 0x7fc464153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4640d0e80 0x7fc4640cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 --2- 172.21.15.67:0/2623530274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4640b41c0 0x7fc4640b1a20 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 -- 172.21.15.67:0/2623530274 >> 172.21.15.67:0/2623530274 conn(0x7fc46408bfc0 msgr2=0x7fc464160060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:51.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 -- 172.21.15.67:0/2623530274 shutdown_connections 2024-09-19T05:44:51.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.236+0000 7fc469142640 1 -- 172.21.15.67:0/2623530274 wait complete. 2024-09-19T05:44:51.251 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":502,"stamp":"2024-09-19T05:44:49.351477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":521120,"kb_used_data":16160,"kb_used_omap":12,"kb_used_meta":504755,"kb_avail":754453600,"statfs":{"total":773094113280,"available":772560486400,"internally_reserved":0,"allocated":16547840,"data_stored":8413948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516869681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.411598"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.015245+0000","last_change":"2024-09-19T05:44:47.006369+0000","last_active":"2024-09-19T05:44:47.015245+0000","last_peered":"2024-09-19T05:44:47.015245+0000","last_clean":"2024-09-19T05:44:47.015245+0000","last_became_active":"2024-09-19T05:44:47.005550+0000","last_became_peered":"2024-09-19T05:44:47.005550+0000","last_unstale":"2024-09-19T05:44:47.015245+0000","last_undegraded":"2024-09-19T05:44:47.015245+0000","last_fullsized":"2024-09-19T05:44:47.015245+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:52.436162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.021696+0000","last_change":"2024-09-19T05:44:47.006951+0000","last_active":"2024-09-19T05:44:47.021696+0000","last_peered":"2024-09-19T05:44:47.021696+0000","last_clean":"2024-09-19T05:44:47.021696+0000","last_became_active":"2024-09-19T05:44:47.006219+0000","last_became_peered":"2024-09-19T05:44:47.006219+0000","last_unstale":"2024-09-19T05:44:47.021696+0000","last_undegraded":"2024-09-19T05:44:47.021696+0000","last_fullsized":"2024-09-19T05:44:47.021696+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:00.816801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.030244+0000","last_change":"2024-09-19T05:44:47.029273+0000","last_active":"2024-09-19T05:44:47.030244+0000","last_peered":"2024-09-19T05:44:47.030244+0000","last_clean":"2024-09-19T05:44:47.030244+0000","last_became_active":"2024-09-19T05:44:47.028567+0000","last_became_peered":"2024-09-19T05:44:47.028567+0000","last_unstale":"2024-09-19T05:44:47.030244+0000","last_undegraded":"2024-09-19T05:44:47.030244+0000","last_fullsized":"2024-09-19T05:44:47.030244+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:27.956126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.013019+0000","last_change":"2024-09-19T05:44:47.005995+0000","last_active":"2024-09-19T05:44:47.013019+0000","last_peered":"2024-09-19T05:44:47.013019+0000","last_clean":"2024-09-19T05:44:47.013019+0000","last_became_active":"2024-09-19T05:44:47.005259+0000","last_became_peered":"2024-09-19T05:44:47.005259+0000","last_unstale":"2024-09-19T05:44:47.013019+0000","last_undegraded":"2024-09-19T05:44:47.013019+0000","last_fullsized":"2024-09-19T05:44:47.013019+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:55.441478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.012394+0000","last_change":"2024-09-19T05:44:47.000216+0000","last_active":"2024-09-19T05:44:47.012394+0000","last_peered":"2024-09-19T05:44:47.012394+0000","last_clean":"2024-09-19T05:44:47.012394+0000","last_became_active":"2024-09-19T05:44:46.991782+0000","last_became_peered":"2024-09-19T05:44:46.991782+0000","last_unstale":"2024-09-19T05:44:47.012394+0000","last_undegraded":"2024-09-19T05:44:47.012394+0000","last_fullsized":"2024-09-19T05:44:47.012394+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:24.180164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.010184+0000","last_change":"2024-09-19T05:44:46.990307+0000","last_active":"2024-09-19T05:44:47.010184+0000","last_peered":"2024-09-19T05:44:47.010184+0000","last_clean":"2024-09-19T05:44:47.010184+0000","last_became_active":"2024-09-19T05:44:46.987180+0000","last_became_peered":"2024-09-19T05:44:46.987180+0000","last_unstale":"2024-09-19T05:44:47.010184+0000","last_undegraded":"2024-09-19T05:44:47.010184+0000","last_fullsized":"2024-09-19T05:44:47.010184+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:57.230255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.017144+0000","last_change":"2024-09-19T05:44:47.012586+0000","last_active":"2024-09-19T05:44:47.017144+0000","last_peered":"2024-09-19T05:44:47.017144+0000","last_clean":"2024-09-19T05:44:47.017144+0000","last_became_active":"2024-09-19T05:44:47.011330+0000","last_became_peered":"2024-09-19T05:44:47.011330+0000","last_unstale":"2024-09-19T05:44:47.017144+0000","last_undegraded":"2024-09-19T05:44:47.017144+0000","last_fullsized":"2024-09-19T05:44:47.017144+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:55.449312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.000891+0000","last_change":"2024-09-19T05:44:46.996517+0000","last_active":"2024-09-19T05:44:47.000891+0000","last_peered":"2024-09-19T05:44:47.000891+0000","last_clean":"2024-09-19T05:44:47.000891+0000","last_became_active":"2024-09-19T05:44:46.995611+0000","last_became_peered":"2024-09-19T05:44:46.995611+0000","last_unstale":"2024-09-19T05:44:47.000891+0000","last_undegraded":"2024-09-19T05:44:47.000891+0000","last_fullsized":"2024-09-19T05:44:47.000891+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:45.171203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.014003+0000","last_change":"2024-09-19T05:44:47.008932+0000","last_active":"2024-09-19T05:44:47.014003+0000","last_peered":"2024-09-19T05:44:47.014003+0000","last_clean":"2024-09-19T05:44:47.014003+0000","last_became_active":"2024-09-19T05:44:47.008088+0000","last_became_peered":"2024-09-19T05:44:47.008088+0000","last_unstale":"2024-09-19T05:44:47.014003+0000","last_undegraded":"2024-09-19T05:44:47.014003+0000","last_fullsized":"2024-09-19T05:44:47.014003+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:22.907112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.991690+0000","last_change":"2024-09-19T05:44:46.985420+0000","last_active":"2024-09-19T05:44:46.991690+0000","last_peered":"2024-09-19T05:44:46.991690+0000","last_clean":"2024-09-19T05:44:46.991690+0000","last_became_active":"2024-09-19T05:44:46.984541+0000","last_became_peered":"2024-09-19T05:44:46.984541+0000","last_unstale":"2024-09-19T05:44:46.991690+0000","last_undegraded":"2024-09-19T05:44:46.991690+0000","last_fullsized":"2024-09-19T05:44:46.991690+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:11.135912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.026769+0000","last_change":"2024-09-19T05:44:47.026134+0000","last_active":"2024-09-19T05:44:47.026769+0000","last_peered":"2024-09-19T05:44:47.026769+0000","last_clean":"2024-09-19T05:44:47.026769+0000","last_became_active":"2024-09-19T05:44:47.025534+0000","last_became_peered":"2024-09-19T05:44:47.025534+0000","last_unstale":"2024-09-19T05:44:47.026769+0000","last_undegraded":"2024-09-19T05:44:47.026769+0000","last_fullsized":"2024-09-19T05:44:47.026769+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:46.105630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.016873+0000","last_change":"2024-09-19T05:44:47.014371+0000","last_active":"2024-09-19T05:44:47.016873+0000","last_peered":"2024-09-19T05:44:47.016873+0000","last_clean":"2024-09-19T05:44:47.016873+0000","last_became_active":"2024-09-19T05:44:47.013631+0000","last_became_peered":"2024-09-19T05:44:47.013631+0000","last_unstale":"2024-09-19T05:44:47.016873+0000","last_undegraded":"2024-09-19T05:44:47.016873+0000","last_fullsized":"2024-09-19T05:44:47.016873+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.649408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.009960+0000","last_change":"2024-09-19T05:44:46.999209+0000","last_active":"2024-09-19T05:44:47.009960+0000","last_peered":"2024-09-19T05:44:47.009960+0000","last_clean":"2024-09-19T05:44:47.009960+0000","last_became_active":"2024-09-19T05:44:46.990693+0000","last_became_peered":"2024-09-19T05:44:46.990693+0000","last_unstale":"2024-09-19T05:44:47.009960+0000","last_undegraded":"2024-09-19T05:44:47.009960+0000","last_fullsized":"2024-09-19T05:44:47.009960+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:47.844503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.000345+0000","last_change":"2024-09-19T05:44:46.994132+0000","last_active":"2024-09-19T05:44:47.000345+0000","last_peered":"2024-09-19T05:44:47.000345+0000","last_clean":"2024-09-19T05:44:47.000345+0000","last_became_active":"2024-09-19T05:44:46.993356+0000","last_became_peered":"2024-09-19T05:44:46.993356+0000","last_unstale":"2024-09-19T05:44:47.000345+0000","last_undegraded":"2024-09-19T05:44:47.000345+0000","last_fullsized":"2024-09-19T05:44:47.000345+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:33.869358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.021479+0000","last_change":"2024-09-19T05:44:47.004908+0000","last_active":"2024-09-19T05:44:47.021479+0000","last_peered":"2024-09-19T05:44:47.021479+0000","last_clean":"2024-09-19T05:44:47.021479+0000","last_became_active":"2024-09-19T05:44:47.003754+0000","last_became_peered":"2024-09-19T05:44:47.003754+0000","last_unstale":"2024-09-19T05:44:47.021479+0000","last_undegraded":"2024-09-19T05:44:47.021479+0000","last_fullsized":"2024-09-19T05:44:47.021479+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:15.377943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.014243+0000","last_change":"2024-09-19T05:44:47.008882+0000","last_active":"2024-09-19T05:44:47.014243+0000","last_peered":"2024-09-19T05:44:47.014243+0000","last_clean":"2024-09-19T05:44:47.014243+0000","last_became_active":"2024-09-19T05:44:47.008117+0000","last_became_peered":"2024-09-19T05:44:47.008117+0000","last_unstale":"2024-09-19T05:44:47.014243+0000","last_undegraded":"2024-09-19T05:44:47.014243+0000","last_fullsized":"2024-09-19T05:44:47.014243+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:14.913170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.001349+0000","last_change":"2024-09-19T05:44:46.996840+0000","last_active":"2024-09-19T05:44:47.001349+0000","last_peered":"2024-09-19T05:44:47.001349+0000","last_clean":"2024-09-19T05:44:47.001349+0000","last_became_active":"2024-09-19T05:44:46.994080+0000","last_became_peered":"2024-09-19T05:44:46.994080+0000","last_unstale":"2024-09-19T05:44:47.001349+0000","last_undegraded":"2024-09-19T05:44:47.001349+0000","last_fullsized":"2024-09-19T05:44:47.001349+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:18.183514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.024012+0000","last_change":"2024-09-19T05:44:47.021869+0000","last_active":"2024-09-19T05:44:47.024012+0000","last_peered":"2024-09-19T05:44:47.024012+0000","last_clean":"2024-09-19T05:44:47.024012+0000","last_became_active":"2024-09-19T05:44:47.021021+0000","last_became_peered":"2024-09-19T05:44:47.021021+0000","last_unstale":"2024-09-19T05:44:47.024012+0000","last_undegraded":"2024-09-19T05:44:47.024012+0000","last_fullsized":"2024-09-19T05:44:47.024012+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:38.207976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.024832+0000","last_change":"2024-09-19T05:44:47.014344+0000","last_active":"2024-09-19T05:44:47.024832+0000","last_peered":"2024-09-19T05:44:47.024832+0000","last_clean":"2024-09-19T05:44:47.024832+0000","last_became_active":"2024-09-19T05:44:47.013608+0000","last_became_peered":"2024-09-19T05:44:47.013608+0000","last_unstale":"2024-09-19T05:44:47.024832+0000","last_undegraded":"2024-09-19T05:44:47.024832+0000","last_fullsized":"2024-09-19T05:44:47.024832+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:25.546418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.011161+0000","last_change":"2024-09-19T05:44:47.004058+0000","last_active":"2024-09-19T05:44:47.011161+0000","last_peered":"2024-09-19T05:44:47.011161+0000","last_clean":"2024-09-19T05:44:47.011161+0000","last_became_active":"2024-09-19T05:44:47.003348+0000","last_became_peered":"2024-09-19T05:44:47.003348+0000","last_unstale":"2024-09-19T05:44:47.011161+0000","last_undegraded":"2024-09-19T05:44:47.011161+0000","last_fullsized":"2024-09-19T05:44:47.011161+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:10.995069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.014046+0000","last_change":"2024-09-19T05:44:47.008711+0000","last_active":"2024-09-19T05:44:47.014046+0000","last_peered":"2024-09-19T05:44:47.014046+0000","last_clean":"2024-09-19T05:44:47.014046+0000","last_became_active":"2024-09-19T05:44:47.001752+0000","last_became_peered":"2024-09-19T05:44:47.001752+0000","last_unstale":"2024-09-19T05:44:47.014046+0000","last_undegraded":"2024-09-19T05:44:47.014046+0000","last_fullsized":"2024-09-19T05:44:47.014046+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:05.465769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.018699+0000","last_change":"2024-09-19T05:44:47.013884+0000","last_active":"2024-09-19T05:44:47.018699+0000","last_peered":"2024-09-19T05:44:47.018699+0000","last_clean":"2024-09-19T05:44:47.018699+0000","last_became_active":"2024-09-19T05:44:47.011087+0000","last_became_peered":"2024-09-19T05:44:47.011087+0000","last_unstale":"2024-09-19T05:44:47.018699+0000","last_undegraded":"2024-09-19T05:44:47.018699+0000","last_fullsized":"2024-09-19T05:44:47.018699+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:57.636127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.997322+0000","last_change":"2024-09-19T05:44:46.987908+0000","last_active":"2024-09-19T05:44:46.997322+0000","last_peered":"2024-09-19T05:44:46.997322+0000","last_clean":"2024-09-19T05:44:46.997322+0000","last_became_active":"2024-09-19T05:44:46.987162+0000","last_became_peered":"2024-09-19T05:44:46.987162+0000","last_unstale":"2024-09-19T05:44:46.997322+0000","last_undegraded":"2024-09-19T05:44:46.997322+0000","last_fullsized":"2024-09-19T05:44:46.997322+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:02.007255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.015110+0000","last_change":"2024-09-19T05:44:47.013897+0000","last_active":"2024-09-19T05:44:47.015110+0000","last_peered":"2024-09-19T05:44:47.015110+0000","last_clean":"2024-09-19T05:44:47.015110+0000","last_became_active":"2024-09-19T05:44:47.013252+0000","last_became_peered":"2024-09-19T05:44:47.013252+0000","last_unstale":"2024-09-19T05:44:47.015110+0000","last_undegraded":"2024-09-19T05:44:47.015110+0000","last_fullsized":"2024-09-19T05:44:47.015110+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:05.593538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.014795+0000","last_change":"2024-09-19T05:44:46.993121+0000","last_active":"2024-09-19T05:44:47.014795+0000","last_peered":"2024-09-19T05:44:47.014795+0000","last_clean":"2024-09-19T05:44:47.014795+0000","last_became_active":"2024-09-19T05:44:46.989503+0000","last_became_peered":"2024-09-19T05:44:46.989503+0000","last_unstale":"2024-09-19T05:44:47.014795+0000","last_undegraded":"2024-09-19T05:44:47.014795+0000","last_fullsized":"2024-09-19T05:44:47.014795+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:00.507065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.018761+0000","last_change":"2024-09-19T05:44:47.014897+0000","last_active":"2024-09-19T05:44:47.018761+0000","last_peered":"2024-09-19T05:44:47.018761+0000","last_clean":"2024-09-19T05:44:47.018761+0000","last_became_active":"2024-09-19T05:44:47.011158+0000","last_became_peered":"2024-09-19T05:44:47.011158+0000","last_unstale":"2024-09-19T05:44:47.018761+0000","last_undegraded":"2024-09-19T05:44:47.018761+0000","last_fullsized":"2024-09-19T05:44:47.018761+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:20.673232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022173+0000","last_change":"2024-09-19T05:44:47.018194+0000","last_active":"2024-09-19T05:44:47.022173+0000","last_peered":"2024-09-19T05:44:47.022173+0000","last_clean":"2024-09-19T05:44:47.022173+0000","last_became_active":"2024-09-19T05:44:47.017290+0000","last_became_peered":"2024-09-19T05:44:47.017290+0000","last_unstale":"2024-09-19T05:44:47.022173+0000","last_undegraded":"2024-09-19T05:44:47.022173+0000","last_fullsized":"2024-09-19T05:44:47.022173+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:10.995069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.994461+0000","last_change":"2024-09-19T05:44:46.987968+0000","last_active":"2024-09-19T05:44:46.994461+0000","last_peered":"2024-09-19T05:44:46.994461+0000","last_clean":"2024-09-19T05:44:46.994461+0000","last_became_active":"2024-09-19T05:44:46.987250+0000","last_became_peered":"2024-09-19T05:44:46.987250+0000","last_unstale":"2024-09-19T05:44:46.994461+0000","last_undegraded":"2024-09-19T05:44:46.994461+0000","last_fullsized":"2024-09-19T05:44:46.994461+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:01.521890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022319+0000","last_change":"2024-09-19T05:44:47.013021+0000","last_active":"2024-09-19T05:44:47.022319+0000","last_peered":"2024-09-19T05:44:47.022319+0000","last_clean":"2024-09-19T05:44:47.022319+0000","last_became_active":"2024-09-19T05:44:47.011483+0000","last_became_peered":"2024-09-19T05:44:47.011483+0000","last_unstale":"2024-09-19T05:44:47.022319+0000","last_undegraded":"2024-09-19T05:44:47.022319+0000","last_fullsized":"2024-09-19T05:44:47.022319+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:07.865051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.006780+0000","last_change":"2024-09-19T05:44:46.998722+0000","last_active":"2024-09-19T05:44:47.006780+0000","last_peered":"2024-09-19T05:44:47.006780+0000","last_clean":"2024-09-19T05:44:47.006780+0000","last_became_active":"2024-09-19T05:44:46.997640+0000","last_became_peered":"2024-09-19T05:44:46.997640+0000","last_unstale":"2024-09-19T05:44:47.006780+0000","last_undegraded":"2024-09-19T05:44:47.006780+0000","last_fullsized":"2024-09-19T05:44:47.006780+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:26.412923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.012270+0000","last_change":"2024-09-19T05:44:47.000193+0000","last_active":"2024-09-19T05:44:47.012270+0000","last_peered":"2024-09-19T05:44:47.012270+0000","last_clean":"2024-09-19T05:44:47.012270+0000","last_became_active":"2024-09-19T05:44:46.999462+0000","last_became_peered":"2024-09-19T05:44:46.999462+0000","last_unstale":"2024-09-19T05:44:47.012270+0000","last_undegraded":"2024-09-19T05:44:47.012270+0000","last_fullsized":"2024-09-19T05:44:47.012270+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:50.778885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.000789+0000","last_change":"2024-09-19T05:44:46.986333+0000","last_active":"2024-09-19T05:44:47.000789+0000","last_peered":"2024-09-19T05:44:47.000789+0000","last_clean":"2024-09-19T05:44:47.000789+0000","last_became_active":"2024-09-19T05:44:46.985628+0000","last_became_peered":"2024-09-19T05:44:46.985628+0000","last_unstale":"2024-09-19T05:44:47.000789+0000","last_undegraded":"2024-09-19T05:44:47.000789+0000","last_fullsized":"2024-09-19T05:44:47.000789+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:52.540441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.026362+0000","last_change":"2024-09-19T05:44:47.025564+0000","last_active":"2024-09-19T05:44:47.026362+0000","last_peered":"2024-09-19T05:44:47.026362+0000","last_clean":"2024-09-19T05:44:47.026362+0000","last_became_active":"2024-09-19T05:44:47.024864+0000","last_became_peered":"2024-09-19T05:44:47.024864+0000","last_unstale":"2024-09-19T05:44:47.026362+0000","last_undegraded":"2024-09-19T05:44:47.026362+0000","last_fullsized":"2024-09-19T05:44:47.026362+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:19.042066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"154'4","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.210675+0000","last_change":"2024-09-19T05:44:45.987634+0000","last_active":"2024-09-19T05:44:47.210675+0000","last_peered":"2024-09-19T05:44:47.210675+0000","last_clean":"2024-09-19T05:44:47.210675+0000","last_became_active":"2024-09-19T05:44:45.987148+0000","last_became_peered":"2024-09-19T05:44:45.987148+0000","last_unstale":"2024-09-19T05:44:47.210675+0000","last_undegraded":"2024-09-19T05:44:47.210675+0000","last_fullsized":"2024-09-19T05:44:47.210675+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:24.542726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022588+0000","last_change":"2024-09-19T05:44:47.012918+0000","last_active":"2024-09-19T05:44:47.022588+0000","last_peered":"2024-09-19T05:44:47.022588+0000","last_clean":"2024-09-19T05:44:47.022588+0000","last_became_active":"2024-09-19T05:44:47.012095+0000","last_became_peered":"2024-09-19T05:44:47.012095+0000","last_unstale":"2024-09-19T05:44:47.022588+0000","last_undegraded":"2024-09-19T05:44:47.022588+0000","last_fullsized":"2024-09-19T05:44:47.022588+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:31.444402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"154'1","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.202385+0000","last_change":"2024-09-19T05:44:45.977301+0000","last_active":"2024-09-19T05:44:47.202385+0000","last_peered":"2024-09-19T05:44:47.202385+0000","last_clean":"2024-09-19T05:44:47.202385+0000","last_became_active":"2024-09-19T05:44:45.976477+0000","last_became_peered":"2024-09-19T05:44:45.976477+0000","last_unstale":"2024-09-19T05:44:47.202385+0000","last_undegraded":"2024-09-19T05:44:47.202385+0000","last_fullsized":"2024-09-19T05:44:47.202385+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:39.962608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.997758+0000","last_change":"2024-09-19T05:44:46.993506+0000","last_active":"2024-09-19T05:44:46.997758+0000","last_peered":"2024-09-19T05:44:46.997758+0000","last_clean":"2024-09-19T05:44:46.997758+0000","last_became_active":"2024-09-19T05:44:46.992345+0000","last_became_peered":"2024-09-19T05:44:46.992345+0000","last_unstale":"2024-09-19T05:44:46.997758+0000","last_undegraded":"2024-09-19T05:44:46.997758+0000","last_fullsized":"2024-09-19T05:44:46.997758+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:18.762481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.204340+0000","last_change":"2024-09-19T05:44:45.976930+0000","last_active":"2024-09-19T05:44:47.204340+0000","last_peered":"2024-09-19T05:44:47.204340+0000","last_clean":"2024-09-19T05:44:47.204340+0000","last_became_active":"2024-09-19T05:44:45.976205+0000","last_became_peered":"2024-09-19T05:44:45.976205+0000","last_unstale":"2024-09-19T05:44:47.204340+0000","last_undegraded":"2024-09-19T05:44:47.204340+0000","last_fullsized":"2024-09-19T05:44:47.204340+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:37.889502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.025691+0000","last_change":"2024-09-19T05:44:47.020778+0000","last_active":"2024-09-19T05:44:47.025691+0000","last_peered":"2024-09-19T05:44:47.025691+0000","last_clean":"2024-09-19T05:44:47.025691+0000","last_became_active":"2024-09-19T05:44:47.019467+0000","last_became_peered":"2024-09-19T05:44:47.019467+0000","last_unstale":"2024-09-19T05:44:47.025691+0000","last_undegraded":"2024-09-19T05:44:47.025691+0000","last_fullsized":"2024-09-19T05:44:47.025691+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:57.230255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.209984+0000","last_change":"2024-09-19T05:44:45.979412+0000","last_active":"2024-09-19T05:44:47.209984+0000","last_peered":"2024-09-19T05:44:47.209984+0000","last_clean":"2024-09-19T05:44:47.209984+0000","last_became_active":"2024-09-19T05:44:45.978953+0000","last_became_peered":"2024-09-19T05:44:45.978953+0000","last_unstale":"2024-09-19T05:44:47.209984+0000","last_undegraded":"2024-09-19T05:44:47.209984+0000","last_fullsized":"2024-09-19T05:44:47.209984+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:14.180291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.011085+0000","last_change":"2024-09-19T05:44:46.998319+0000","last_active":"2024-09-19T05:44:47.011085+0000","last_peered":"2024-09-19T05:44:47.011085+0000","last_clean":"2024-09-19T05:44:47.011085+0000","last_became_active":"2024-09-19T05:44:46.997555+0000","last_became_peered":"2024-09-19T05:44:46.997555+0000","last_unstale":"2024-09-19T05:44:47.011085+0000","last_undegraded":"2024-09-19T05:44:47.011085+0000","last_fullsized":"2024-09-19T05:44:47.011085+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:06.284075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"154'1","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.199201+0000","last_change":"2024-09-19T05:44:45.985417+0000","last_active":"2024-09-19T05:44:47.199201+0000","last_peered":"2024-09-19T05:44:47.199201+0000","last_clean":"2024-09-19T05:44:47.199201+0000","last_became_active":"2024-09-19T05:44:45.984785+0000","last_became_peered":"2024-09-19T05:44:45.984785+0000","last_unstale":"2024-09-19T05:44:47.199201+0000","last_undegraded":"2024-09-19T05:44:47.199201+0000","last_fullsized":"2024-09-19T05:44:47.199201+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:13.555945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.024320+0000","last_change":"2024-09-19T05:44:47.017781+0000","last_active":"2024-09-19T05:44:47.024320+0000","last_peered":"2024-09-19T05:44:47.024320+0000","last_clean":"2024-09-19T05:44:47.024320+0000","last_became_active":"2024-09-19T05:44:47.016989+0000","last_became_peered":"2024-09-19T05:44:47.016989+0000","last_unstale":"2024-09-19T05:44:47.024320+0000","last_undegraded":"2024-09-19T05:44:47.024320+0000","last_fullsized":"2024-09-19T05:44:47.024320+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:35.073879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"154'1","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.204409+0000","last_change":"2024-09-19T05:44:45.993808+0000","last_active":"2024-09-19T05:44:47.204409+0000","last_peered":"2024-09-19T05:44:47.204409+0000","last_clean":"2024-09-19T05:44:47.204409+0000","last_became_active":"2024-09-19T05:44:45.993465+0000","last_became_peered":"2024-09-19T05:44:45.993465+0000","last_unstale":"2024-09-19T05:44:47.204409+0000","last_undegraded":"2024-09-19T05:44:47.204409+0000","last_fullsized":"2024-09-19T05:44:47.204409+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:36.614164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022600+0000","last_change":"2024-09-19T05:44:47.015225+0000","last_active":"2024-09-19T05:44:47.022600+0000","last_peered":"2024-09-19T05:44:47.022600+0000","last_clean":"2024-09-19T05:44:47.022600+0000","last_became_active":"2024-09-19T05:44:47.014450+0000","last_became_peered":"2024-09-19T05:44:47.014450+0000","last_unstale":"2024-09-19T05:44:47.022600+0000","last_undegraded":"2024-09-19T05:44:47.022600+0000","last_fullsized":"2024-09-19T05:44:47.022600+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:17.302194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.979279+0000","last_change":"2024-09-19T05:44:45.969218+0000","last_active":"2024-09-19T05:44:46.979279+0000","last_peered":"2024-09-19T05:44:46.979279+0000","last_clean":"2024-09-19T05:44:46.979279+0000","last_became_active":"2024-09-19T05:44:45.968479+0000","last_became_peered":"2024-09-19T05:44:45.968479+0000","last_unstale":"2024-09-19T05:44:46.979279+0000","last_undegraded":"2024-09-19T05:44:46.979279+0000","last_fullsized":"2024-09-19T05:44:46.979279+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:09.532459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.017002+0000","last_change":"2024-09-19T05:44:47.008186+0000","last_active":"2024-09-19T05:44:47.017002+0000","last_peered":"2024-09-19T05:44:47.017002+0000","last_clean":"2024-09-19T05:44:47.017002+0000","last_became_active":"2024-09-19T05:44:47.007376+0000","last_became_peered":"2024-09-19T05:44:47.007376+0000","last_unstale":"2024-09-19T05:44:47.017002+0000","last_undegraded":"2024-09-19T05:44:47.017002+0000","last_fullsized":"2024-09-19T05:44:47.017002+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:10.130701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.970878+0000","last_change":"2024-09-19T05:44:45.988408+0000","last_active":"2024-09-19T05:44:46.970878+0000","last_peered":"2024-09-19T05:44:46.970878+0000","last_clean":"2024-09-19T05:44:46.970878+0000","last_became_active":"2024-09-19T05:44:45.987735+0000","last_became_peered":"2024-09-19T05:44:45.987735+0000","last_unstale":"2024-09-19T05:44:46.970878+0000","last_undegraded":"2024-09-19T05:44:46.970878+0000","last_fullsized":"2024-09-19T05:44:46.970878+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:53.955060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.000507+0000","last_change":"2024-09-19T05:44:46.998481+0000","last_active":"2024-09-19T05:44:47.000507+0000","last_peered":"2024-09-19T05:44:47.000507+0000","last_clean":"2024-09-19T05:44:47.000507+0000","last_became_active":"2024-09-19T05:44:46.997763+0000","last_became_peered":"2024-09-19T05:44:46.997763+0000","last_unstale":"2024-09-19T05:44:47.000507+0000","last_undegraded":"2024-09-19T05:44:47.000507+0000","last_fullsized":"2024-09-19T05:44:47.000507+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.680668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.988912+0000","last_change":"2024-09-19T05:44:45.971922+0000","last_active":"2024-09-19T05:44:46.988912+0000","last_peered":"2024-09-19T05:44:46.988912+0000","last_clean":"2024-09-19T05:44:46.988912+0000","last_became_active":"2024-09-19T05:44:45.971614+0000","last_became_peered":"2024-09-19T05:44:45.971614+0000","last_unstale":"2024-09-19T05:44:46.988912+0000","last_undegraded":"2024-09-19T05:44:46.988912+0000","last_fullsized":"2024-09-19T05:44:46.988912+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:36.614164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.030385+0000","last_change":"2024-09-19T05:44:47.029167+0000","last_active":"2024-09-19T05:44:47.030385+0000","last_peered":"2024-09-19T05:44:47.030385+0000","last_clean":"2024-09-19T05:44:47.030385+0000","last_became_active":"2024-09-19T05:44:47.028711+0000","last_became_peered":"2024-09-19T05:44:47.028711+0000","last_unstale":"2024-09-19T05:44:47.030385+0000","last_undegraded":"2024-09-19T05:44:47.030385+0000","last_fullsized":"2024-09-19T05:44:47.030385+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:43.870385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.009675+0000","last_change":"2024-09-19T05:44:45.975368+0000","last_active":"2024-09-19T05:44:47.009675+0000","last_peered":"2024-09-19T05:44:47.009675+0000","last_clean":"2024-09-19T05:44:47.009675+0000","last_became_active":"2024-09-19T05:44:45.973608+0000","last_became_peered":"2024-09-19T05:44:45.973608+0000","last_unstale":"2024-09-19T05:44:47.009675+0000","last_undegraded":"2024-09-19T05:44:47.009675+0000","last_fullsized":"2024-09-19T05:44:47.009675+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:04.669197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.024613+0000","last_change":"2024-09-19T05:44:47.023567+0000","last_active":"2024-09-19T05:44:47.024613+0000","last_peered":"2024-09-19T05:44:47.024613+0000","last_clean":"2024-09-19T05:44:47.024613+0000","last_became_active":"2024-09-19T05:44:47.022415+0000","last_became_peered":"2024-09-19T05:44:47.022415+0000","last_unstale":"2024-09-19T05:44:47.024613+0000","last_undegraded":"2024-09-19T05:44:47.024613+0000","last_fullsized":"2024-09-19T05:44:47.024613+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:50.065752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"154'3","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.210731+0000","last_change":"2024-09-19T05:44:45.966982+0000","last_active":"2024-09-19T05:44:47.210731+0000","last_peered":"2024-09-19T05:44:47.210731+0000","last_clean":"2024-09-19T05:44:47.210731+0000","last_became_active":"2024-09-19T05:44:45.965288+0000","last_became_peered":"2024-09-19T05:44:45.965288+0000","last_unstale":"2024-09-19T05:44:47.210731+0000","last_undegraded":"2024-09-19T05:44:47.210731+0000","last_fullsized":"2024-09-19T05:44:47.210731+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:39.209341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.004212+0000","last_change":"2024-09-19T05:44:47.002249+0000","last_active":"2024-09-19T05:44:47.004212+0000","last_peered":"2024-09-19T05:44:47.004212+0000","last_clean":"2024-09-19T05:44:47.004212+0000","last_became_active":"2024-09-19T05:44:47.001513+0000","last_became_peered":"2024-09-19T05:44:47.001513+0000","last_unstale":"2024-09-19T05:44:47.004212+0000","last_undegraded":"2024-09-19T05:44:47.004212+0000","last_fullsized":"2024-09-19T05:44:47.004212+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:32:43.222113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.207864+0000","last_change":"2024-09-19T05:44:45.988430+0000","last_active":"2024-09-19T05:44:47.207864+0000","last_peered":"2024-09-19T05:44:47.207864+0000","last_clean":"2024-09-19T05:44:47.207864+0000","last_became_active":"2024-09-19T05:44:45.987360+0000","last_became_peered":"2024-09-19T05:44:45.987360+0000","last_unstale":"2024-09-19T05:44:47.207864+0000","last_undegraded":"2024-09-19T05:44:47.207864+0000","last_fullsized":"2024-09-19T05:44:47.207864+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:37.889502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.016485+0000","last_change":"2024-09-19T05:44:47.003569+0000","last_active":"2024-09-19T05:44:47.016485+0000","last_peered":"2024-09-19T05:44:47.016485+0000","last_clean":"2024-09-19T05:44:47.016485+0000","last_became_active":"2024-09-19T05:44:47.002789+0000","last_became_peered":"2024-09-19T05:44:47.002789+0000","last_unstale":"2024-09-19T05:44:47.016485+0000","last_undegraded":"2024-09-19T05:44:47.016485+0000","last_fullsized":"2024-09-19T05:44:47.016485+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:54.217156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.984900+0000","last_change":"2024-09-19T05:44:45.986266+0000","last_active":"2024-09-19T05:44:46.984900+0000","last_peered":"2024-09-19T05:44:46.984900+0000","last_clean":"2024-09-19T05:44:46.984900+0000","last_became_active":"2024-09-19T05:44:45.985579+0000","last_became_peered":"2024-09-19T05:44:45.985579+0000","last_unstale":"2024-09-19T05:44:46.984900+0000","last_undegraded":"2024-09-19T05:44:46.984900+0000","last_fullsized":"2024-09-19T05:44:46.984900+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:41.588659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.010246+0000","last_change":"2024-09-19T05:44:46.992739+0000","last_active":"2024-09-19T05:44:47.010246+0000","last_peered":"2024-09-19T05:44:47.010246+0000","last_clean":"2024-09-19T05:44:47.010246+0000","last_became_active":"2024-09-19T05:44:46.991982+0000","last_became_peered":"2024-09-19T05:44:46.991982+0000","last_unstale":"2024-09-19T05:44:47.010246+0000","last_undegraded":"2024-09-19T05:44:47.010246+0000","last_fullsized":"2024-09-19T05:44:47.010246+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:35.047100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.987273+0000","last_change":"2024-09-19T05:44:45.984852+0000","last_active":"2024-09-19T05:44:46.987273+0000","last_peered":"2024-09-19T05:44:46.987273+0000","last_clean":"2024-09-19T05:44:46.987273+0000","last_became_active":"2024-09-19T05:44:45.984161+0000","last_became_peered":"2024-09-19T05:44:45.984161+0000","last_unstale":"2024-09-19T05:44:46.987273+0000","last_undegraded":"2024-09-19T05:44:46.987273+0000","last_fullsized":"2024-09-19T05:44:46.987273+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:58.481371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022790+0000","last_change":"2024-09-19T05:44:47.017257+0000","last_active":"2024-09-19T05:44:47.022790+0000","last_peered":"2024-09-19T05:44:47.022790+0000","last_clean":"2024-09-19T05:44:47.022790+0000","last_became_active":"2024-09-19T05:44:47.016552+0000","last_became_peered":"2024-09-19T05:44:47.016552+0000","last_unstale":"2024-09-19T05:44:47.022790+0000","last_undegraded":"2024-09-19T05:44:47.022790+0000","last_fullsized":"2024-09-19T05:44:47.022790+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:30.674809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"154'8","reported_seq":20,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.203562+0000","last_change":"2024-09-19T05:44:45.981008+0000","last_active":"2024-09-19T05:44:47.203562+0000","last_peered":"2024-09-19T05:44:47.203562+0000","last_clean":"2024-09-19T05:44:47.203562+0000","last_became_active":"2024-09-19T05:44:45.979523+0000","last_became_peered":"2024-09-19T05:44:45.979523+0000","last_unstale":"2024-09-19T05:44:47.203562+0000","last_undegraded":"2024-09-19T05:44:47.203562+0000","last_fullsized":"2024-09-19T05:44:47.203562+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:13.680991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.021027+0000","last_change":"2024-09-19T05:44:47.011492+0000","last_active":"2024-09-19T05:44:47.021027+0000","last_peered":"2024-09-19T05:44:47.021027+0000","last_clean":"2024-09-19T05:44:47.021027+0000","last_became_active":"2024-09-19T05:44:47.010708+0000","last_became_peered":"2024-09-19T05:44:47.010708+0000","last_unstale":"2024-09-19T05:44:47.021027+0000","last_undegraded":"2024-09-19T05:44:47.021027+0000","last_fullsized":"2024-09-19T05:44:47.021027+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:47.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"154'1","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.207267+0000","last_change":"2024-09-19T05:44:45.983647+0000","last_active":"2024-09-19T05:44:47.207267+0000","last_peered":"2024-09-19T05:44:47.207267+0000","last_clean":"2024-09-19T05:44:47.207267+0000","last_became_active":"2024-09-19T05:44:45.979969+0000","last_became_peered":"2024-09-19T05:44:45.979969+0000","last_unstale":"2024-09-19T05:44:47.207267+0000","last_undegraded":"2024-09-19T05:44:47.207267+0000","last_fullsized":"2024-09-19T05:44:47.207267+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:06.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.024972+0000","last_change":"2024-09-19T05:44:47.020136+0000","last_active":"2024-09-19T05:44:47.024972+0000","last_peered":"2024-09-19T05:44:47.024972+0000","last_clean":"2024-09-19T05:44:47.024972+0000","last_became_active":"2024-09-19T05:44:47.019393+0000","last_became_peered":"2024-09-19T05:44:47.019393+0000","last_unstale":"2024-09-19T05:44:47.024972+0000","last_undegraded":"2024-09-19T05:44:47.024972+0000","last_fullsized":"2024-09-19T05:44:47.024972+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:11.135912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.207104+0000","last_change":"2024-09-19T05:44:45.973032+0000","last_active":"2024-09-19T05:44:47.207104+0000","last_peered":"2024-09-19T05:44:47.207104+0000","last_clean":"2024-09-19T05:44:47.207104+0000","last_became_active":"2024-09-19T05:44:45.972176+0000","last_became_peered":"2024-09-19T05:44:45.972176+0000","last_unstale":"2024-09-19T05:44:47.207104+0000","last_undegraded":"2024-09-19T05:44:47.207104+0000","last_fullsized":"2024-09-19T05:44:47.207104+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:24.345234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.020292+0000","last_change":"2024-09-19T05:44:47.016685+0000","last_active":"2024-09-19T05:44:47.020292+0000","last_peered":"2024-09-19T05:44:47.020292+0000","last_clean":"2024-09-19T05:44:47.020292+0000","last_became_active":"2024-09-19T05:44:47.015440+0000","last_became_peered":"2024-09-19T05:44:47.015440+0000","last_unstale":"2024-09-19T05:44:47.020292+0000","last_undegraded":"2024-09-19T05:44:47.020292+0000","last_fullsized":"2024-09-19T05:44:47.020292+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:55:11.292987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"154'1","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.209644+0000","last_change":"2024-09-19T05:44:45.991495+0000","last_active":"2024-09-19T05:44:47.209644+0000","last_peered":"2024-09-19T05:44:47.209644+0000","last_clean":"2024-09-19T05:44:47.209644+0000","last_became_active":"2024-09-19T05:44:45.991082+0000","last_became_peered":"2024-09-19T05:44:45.991082+0000","last_unstale":"2024-09-19T05:44:47.209644+0000","last_undegraded":"2024-09-19T05:44:47.209644+0000","last_fullsized":"2024-09-19T05:44:47.209644+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.755429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.015177+0000","last_change":"2024-09-19T05:44:46.993176+0000","last_active":"2024-09-19T05:44:47.015177+0000","last_peered":"2024-09-19T05:44:47.015177+0000","last_clean":"2024-09-19T05:44:47.015177+0000","last_became_active":"2024-09-19T05:44:46.992462+0000","last_became_peered":"2024-09-19T05:44:46.992462+0000","last_unstale":"2024-09-19T05:44:47.015177+0000","last_undegraded":"2024-09-19T05:44:47.015177+0000","last_fullsized":"2024-09-19T05:44:47.015177+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:25.651326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.984468+0000","last_change":"2024-09-19T05:44:45.986873+0000","last_active":"2024-09-19T05:44:46.984468+0000","last_peered":"2024-09-19T05:44:46.984468+0000","last_clean":"2024-09-19T05:44:46.984468+0000","last_became_active":"2024-09-19T05:44:45.986472+0000","last_became_peered":"2024-09-19T05:44:45.986472+0000","last_unstale":"2024-09-19T05:44:46.984468+0000","last_undegraded":"2024-09-19T05:44:46.984468+0000","last_fullsized":"2024-09-19T05:44:46.984468+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:33.232328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.025769+0000","last_change":"2024-09-19T05:44:47.021351+0000","last_active":"2024-09-19T05:44:47.025769+0000","last_peered":"2024-09-19T05:44:47.025769+0000","last_clean":"2024-09-19T05:44:47.025769+0000","last_became_active":"2024-09-19T05:44:47.020732+0000","last_became_peered":"2024-09-19T05:44:47.020732+0000","last_unstale":"2024-09-19T05:44:47.025769+0000","last_undegraded":"2024-09-19T05:44:47.025769+0000","last_fullsized":"2024-09-19T05:44:47.025769+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:35.047100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.205546+0000","last_change":"2024-09-19T05:44:45.976211+0000","last_active":"2024-09-19T05:44:47.205546+0000","last_peered":"2024-09-19T05:44:47.205546+0000","last_clean":"2024-09-19T05:44:47.205546+0000","last_became_active":"2024-09-19T05:44:45.975772+0000","last_became_peered":"2024-09-19T05:44:45.975772+0000","last_unstale":"2024-09-19T05:44:47.205546+0000","last_undegraded":"2024-09-19T05:44:47.205546+0000","last_fullsized":"2024-09-19T05:44:47.205546+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:21.903420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022812+0000","last_change":"2024-09-19T05:44:47.019771+0000","last_active":"2024-09-19T05:44:47.022812+0000","last_peered":"2024-09-19T05:44:47.022812+0000","last_clean":"2024-09-19T05:44:47.022812+0000","last_became_active":"2024-09-19T05:44:47.018968+0000","last_became_peered":"2024-09-19T05:44:47.018968+0000","last_unstale":"2024-09-19T05:44:47.022812+0000","last_undegraded":"2024-09-19T05:44:47.022812+0000","last_fullsized":"2024-09-19T05:44:47.022812+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:56.599052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.972343+0000","last_change":"2024-09-19T05:44:45.973977+0000","last_active":"2024-09-19T05:44:46.972343+0000","last_peered":"2024-09-19T05:44:46.972343+0000","last_clean":"2024-09-19T05:44:46.972343+0000","last_became_active":"2024-09-19T05:44:45.973410+0000","last_became_peered":"2024-09-19T05:44:45.973410+0000","last_unstale":"2024-09-19T05:44:46.972343+0000","last_undegraded":"2024-09-19T05:44:46.972343+0000","last_fullsized":"2024-09-19T05:44:46.972343+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:23.970296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.027093+0000","last_change":"2024-09-19T05:44:47.026181+0000","last_active":"2024-09-19T05:44:47.027093+0000","last_peered":"2024-09-19T05:44:47.027093+0000","last_clean":"2024-09-19T05:44:47.027093+0000","last_became_active":"2024-09-19T05:44:47.025260+0000","last_became_peered":"2024-09-19T05:44:47.025260+0000","last_unstale":"2024-09-19T05:44:47.027093+0000","last_undegraded":"2024-09-19T05:44:47.027093+0000","last_fullsized":"2024-09-19T05:44:47.027093+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:47.844503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.979385+0000","last_change":"2024-09-19T05:44:45.965374+0000","last_active":"2024-09-19T05:44:46.979385+0000","last_peered":"2024-09-19T05:44:46.979385+0000","last_clean":"2024-09-19T05:44:46.979385+0000","last_became_active":"2024-09-19T05:44:45.964736+0000","last_became_peered":"2024-09-19T05:44:45.964736+0000","last_unstale":"2024-09-19T05:44:46.979385+0000","last_undegraded":"2024-09-19T05:44:46.979385+0000","last_fullsized":"2024-09-19T05:44:46.979385+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:04.462077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022763+0000","last_change":"2024-09-19T05:44:47.013719+0000","last_active":"2024-09-19T05:44:47.022763+0000","last_peered":"2024-09-19T05:44:47.022763+0000","last_clean":"2024-09-19T05:44:47.022763+0000","last_became_active":"2024-09-19T05:44:47.013016+0000","last_became_peered":"2024-09-19T05:44:47.013016+0000","last_unstale":"2024-09-19T05:44:47.022763+0000","last_undegraded":"2024-09-19T05:44:47.022763+0000","last_fullsized":"2024-09-19T05:44:47.022763+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:15.868697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.973988+0000","last_change":"2024-09-19T05:44:45.969900+0000","last_active":"2024-09-19T05:44:46.973988+0000","last_peered":"2024-09-19T05:44:46.973988+0000","last_clean":"2024-09-19T05:44:46.973988+0000","last_became_active":"2024-09-19T05:44:45.969292+0000","last_became_peered":"2024-09-19T05:44:45.969292+0000","last_unstale":"2024-09-19T05:44:46.973988+0000","last_undegraded":"2024-09-19T05:44:46.973988+0000","last_fullsized":"2024-09-19T05:44:46.973988+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:45.961441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.017094+0000","last_change":"2024-09-19T05:44:47.014523+0000","last_active":"2024-09-19T05:44:47.017094+0000","last_peered":"2024-09-19T05:44:47.017094+0000","last_clean":"2024-09-19T05:44:47.017094+0000","last_became_active":"2024-09-19T05:44:47.012261+0000","last_became_peered":"2024-09-19T05:44:47.012261+0000","last_unstale":"2024-09-19T05:44:47.017094+0000","last_undegraded":"2024-09-19T05:44:47.017094+0000","last_fullsized":"2024-09-19T05:44:47.017094+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:06.284075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.199089+0000","last_change":"2024-09-19T05:44:45.988445+0000","last_active":"2024-09-19T05:44:47.199089+0000","last_peered":"2024-09-19T05:44:47.199089+0000","last_clean":"2024-09-19T05:44:47.199089+0000","last_became_active":"2024-09-19T05:44:45.987791+0000","last_became_peered":"2024-09-19T05:44:45.987791+0000","last_unstale":"2024-09-19T05:44:47.199089+0000","last_undegraded":"2024-09-19T05:44:47.199089+0000","last_fullsized":"2024-09-19T05:44:47.199089+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:37.075176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.003200+0000","last_change":"2024-09-19T05:44:47.000605+0000","last_active":"2024-09-19T05:44:47.003200+0000","last_peered":"2024-09-19T05:44:47.003200+0000","last_clean":"2024-09-19T05:44:47.003200+0000","last_became_active":"2024-09-19T05:44:46.998722+0000","last_became_peered":"2024-09-19T05:44:46.998722+0000","last_unstale":"2024-09-19T05:44:47.003200+0000","last_undegraded":"2024-09-19T05:44:47.003200+0000","last_fullsized":"2024-09-19T05:44:47.003200+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:56.074225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.009236+0000","last_change":"2024-09-19T05:44:45.981622+0000","last_active":"2024-09-19T05:44:47.009236+0000","last_peered":"2024-09-19T05:44:47.009236+0000","last_clean":"2024-09-19T05:44:47.009236+0000","last_became_active":"2024-09-19T05:44:45.980909+0000","last_became_peered":"2024-09-19T05:44:45.980909+0000","last_unstale":"2024-09-19T05:44:47.009236+0000","last_undegraded":"2024-09-19T05:44:47.009236+0000","last_fullsized":"2024-09-19T05:44:47.009236+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:40.581852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.017199+0000","last_change":"2024-09-19T05:44:47.011838+0000","last_active":"2024-09-19T05:44:47.017199+0000","last_peered":"2024-09-19T05:44:47.017199+0000","last_clean":"2024-09-19T05:44:47.017199+0000","last_became_active":"2024-09-19T05:44:47.010416+0000","last_became_peered":"2024-09-19T05:44:47.010416+0000","last_unstale":"2024-09-19T05:44:47.017199+0000","last_undegraded":"2024-09-19T05:44:47.017199+0000","last_fullsized":"2024-09-19T05:44:47.017199+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:19.919150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.998811+0000","last_change":"2024-09-19T05:44:45.980006+0000","last_active":"2024-09-19T05:44:46.998811+0000","last_peered":"2024-09-19T05:44:46.998811+0000","last_clean":"2024-09-19T05:44:46.998811+0000","last_became_active":"2024-09-19T05:44:45.979054+0000","last_became_peered":"2024-09-19T05:44:45.979054+0000","last_unstale":"2024-09-19T05:44:46.998811+0000","last_undegraded":"2024-09-19T05:44:46.998811+0000","last_fullsized":"2024-09-19T05:44:46.998811+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:49:41.019002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.013616+0000","last_change":"2024-09-19T05:44:47.002511+0000","last_active":"2024-09-19T05:44:47.013616+0000","last_peered":"2024-09-19T05:44:47.013616+0000","last_clean":"2024-09-19T05:44:47.013616+0000","last_became_active":"2024-09-19T05:44:47.001728+0000","last_became_peered":"2024-09-19T05:44:47.001728+0000","last_unstale":"2024-09-19T05:44:47.013616+0000","last_undegraded":"2024-09-19T05:44:47.013616+0000","last_fullsized":"2024-09-19T05:44:47.013616+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:53.663945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.973276+0000","last_change":"2024-09-19T05:44:45.988081+0000","last_active":"2024-09-19T05:44:46.973276+0000","last_peered":"2024-09-19T05:44:46.973276+0000","last_clean":"2024-09-19T05:44:46.973276+0000","last_became_active":"2024-09-19T05:44:45.986796+0000","last_became_peered":"2024-09-19T05:44:45.986796+0000","last_unstale":"2024-09-19T05:44:46.973276+0000","last_undegraded":"2024-09-19T05:44:46.973276+0000","last_fullsized":"2024-09-19T05:44:46.973276+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.093153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.000844+0000","last_change":"2024-09-19T05:44:46.994671+0000","last_active":"2024-09-19T05:44:47.000844+0000","last_peered":"2024-09-19T05:44:47.000844+0000","last_clean":"2024-09-19T05:44:47.000844+0000","last_became_active":"2024-09-19T05:44:46.992389+0000","last_became_peered":"2024-09-19T05:44:46.992389+0000","last_unstale":"2024-09-19T05:44:47.000844+0000","last_undegraded":"2024-09-19T05:44:47.000844+0000","last_fullsized":"2024-09-19T05:44:47.000844+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:02.426170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.984326+0000","last_change":"2024-09-19T05:44:45.989797+0000","last_active":"2024-09-19T05:44:46.984326+0000","last_peered":"2024-09-19T05:44:46.984326+0000","last_clean":"2024-09-19T05:44:46.984326+0000","last_became_active":"2024-09-19T05:44:45.989270+0000","last_became_peered":"2024-09-19T05:44:45.989270+0000","last_unstale":"2024-09-19T05:44:46.984326+0000","last_undegraded":"2024-09-19T05:44:46.984326+0000","last_fullsized":"2024-09-19T05:44:46.984326+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:42.320657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.016888+0000","last_change":"2024-09-19T05:44:47.014504+0000","last_active":"2024-09-19T05:44:47.016888+0000","last_peered":"2024-09-19T05:44:47.016888+0000","last_clean":"2024-09-19T05:44:47.016888+0000","last_became_active":"2024-09-19T05:44:47.012803+0000","last_became_peered":"2024-09-19T05:44:47.012803+0000","last_unstale":"2024-09-19T05:44:47.016888+0000","last_undegraded":"2024-09-19T05:44:47.016888+0000","last_fullsized":"2024-09-19T05:44:47.016888+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:39.489426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.981811+0000","last_change":"2024-09-19T05:44:45.973299+0000","last_active":"2024-09-19T05:44:46.981811+0000","last_peered":"2024-09-19T05:44:46.981811+0000","last_clean":"2024-09-19T05:44:46.981811+0000","last_became_active":"2024-09-19T05:44:45.972531+0000","last_became_peered":"2024-09-19T05:44:45.972531+0000","last_unstale":"2024-09-19T05:44:46.981811+0000","last_undegraded":"2024-09-19T05:44:46.981811+0000","last_fullsized":"2024-09-19T05:44:46.981811+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:56.837940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.021781+0000","last_change":"2024-09-19T05:44:47.006358+0000","last_active":"2024-09-19T05:44:47.021781+0000","last_peered":"2024-09-19T05:44:47.021781+0000","last_clean":"2024-09-19T05:44:47.021781+0000","last_became_active":"2024-09-19T05:44:47.005620+0000","last_became_peered":"2024-09-19T05:44:47.005620+0000","last_unstale":"2024-09-19T05:44:47.021781+0000","last_undegraded":"2024-09-19T05:44:47.021781+0000","last_fullsized":"2024-09-19T05:44:47.021781+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:43.047032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.979639+0000","last_change":"2024-09-19T05:44:45.977725+0000","last_active":"2024-09-19T05:44:46.979639+0000","last_peered":"2024-09-19T05:44:46.979639+0000","last_clean":"2024-09-19T05:44:46.979639+0000","last_became_active":"2024-09-19T05:44:45.970039+0000","last_became_peered":"2024-09-19T05:44:45.970039+0000","last_unstale":"2024-09-19T05:44:46.979639+0000","last_undegraded":"2024-09-19T05:44:46.979639+0000","last_fullsized":"2024-09-19T05:44:46.979639+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:00.980614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.999610+0000","last_change":"2024-09-19T05:44:46.997463+0000","last_active":"2024-09-19T05:44:46.999610+0000","last_peered":"2024-09-19T05:44:46.999610+0000","last_clean":"2024-09-19T05:44:46.999610+0000","last_became_active":"2024-09-19T05:44:46.996611+0000","last_became_peered":"2024-09-19T05:44:46.996611+0000","last_unstale":"2024-09-19T05:44:46.999610+0000","last_undegraded":"2024-09-19T05:44:46.999610+0000","last_fullsized":"2024-09-19T05:44:46.999610+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:26.671131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.987417+0000","last_change":"2024-09-19T05:44:45.962671+0000","last_active":"2024-09-19T05:44:46.987417+0000","last_peered":"2024-09-19T05:44:46.987417+0000","last_clean":"2024-09-19T05:44:46.987417+0000","last_became_active":"2024-09-19T05:44:45.962097+0000","last_became_peered":"2024-09-19T05:44:45.962097+0000","last_unstale":"2024-09-19T05:44:46.987417+0000","last_undegraded":"2024-09-19T05:44:46.987417+0000","last_fullsized":"2024-09-19T05:44:46.987417+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:53.955060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.004263+0000","last_change":"2024-09-19T05:44:47.002345+0000","last_active":"2024-09-19T05:44:47.004263+0000","last_peered":"2024-09-19T05:44:47.004263+0000","last_clean":"2024-09-19T05:44:47.004263+0000","last_became_active":"2024-09-19T05:44:47.001570+0000","last_became_peered":"2024-09-19T05:44:47.001570+0000","last_unstale":"2024-09-19T05:44:47.004263+0000","last_undegraded":"2024-09-19T05:44:47.004263+0000","last_fullsized":"2024-09-19T05:44:47.004263+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:56.005293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"154'6","reported_seq":18,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.212891+0000","last_change":"2024-09-19T05:44:45.965612+0000","last_active":"2024-09-19T05:44:47.212891+0000","last_peered":"2024-09-19T05:44:47.212891+0000","last_clean":"2024-09-19T05:44:47.212891+0000","last_became_active":"2024-09-19T05:44:45.964835+0000","last_became_peered":"2024-09-19T05:44:45.964835+0000","last_unstale":"2024-09-19T05:44:47.212891+0000","last_undegraded":"2024-09-19T05:44:47.212891+0000","last_fullsized":"2024-09-19T05:44:47.212891+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:13.909477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":412,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.987580+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:44:46.987580+0000","last_peered":"2024-09-19T05:44:46.987580+0000","last_clean":"2024-09-19T05:44:46.987580+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:44:46.987580+0000","last_undegraded":"2024-09-19T05:44:46.987580+0000","last_fullsized":"2024-09-19T05:44:46.987580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542287,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69752,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302088,"statfs":{"total":96636764160,"available":96565338112,"internally_reserved":0,"allocated":2519040,"data_stored":1498026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542287,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69168,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302672,"statfs":{"total":96636764160,"available":96565936128,"internally_reserved":0,"allocated":1925120,"data_stored":907658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542289,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63588,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308252,"statfs":{"total":96636764160,"available":96571650048,"internally_reserved":0,"allocated":1912832,"data_stored":900491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69156,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302684,"statfs":{"total":96636764160,"available":96565948416,"internally_reserved":0,"allocated":1912832,"data_stored":900491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542288,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46968,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324872,"statfs":{"total":96636764160,"available":96588668928,"internally_reserved":0,"allocated":1933312,"data_stored":908274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542288,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69152,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302688,"statfs":{"total":96636764160,"available":96565952512,"internally_reserved":0,"allocated":1912832,"data_stored":900491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542290,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59440,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312400,"statfs":{"total":96636764160,"available":96575897600,"internally_reserved":0,"allocated":1925120,"data_stored":907658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542287,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73896,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297944,"statfs":{"total":96636764160,"available":96561094656,"internally_reserved":0,"allocated":2506752,"data_stored":1490859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:44:51.256 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:44:51.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dcc7a0640 1 Processor -- start 2024-09-19T05:44:51.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dcc7a0640 1 -- start start 2024-09-19T05:44:51.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dcc7a0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6dc406dde0 0x7f6dc40b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dcc7a0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc406e3c0 con 0x7f6dc415c030 2024-09-19T05:44:51.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dcc7a0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc406e6a0 con 0x7f6dc40b3510 2024-09-19T05:44:51.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dcc7a0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc406e980 con 0x7f6dc406dde0 2024-09-19T05:44:51.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dca53c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6dc415c030 0x7f6dc415d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44596/0 (socket says 172.21.15.67:44596) 2024-09-19T05:44:51.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dca53c640 1 -- 172.21.15.67:0/89773298 learned_addr learned my addr 172.21.15.67:0/89773298 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:51.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2619719797 0 0) 0x7f6dc406e3c0 con 0x7f6dc415c030 2024-09-19T05:44:51.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc9d3b640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6dc406dde0 0x7f6dc40b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6db0003530 con 0x7f6dc415c030 2024-09-19T05:44:51.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2483034449 0 0) 0x7f6db0003530 con 0x7f6dc415c030 2024-09-19T05:44:51.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6dc406dde0 msgr2=0x7f6dc40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:51.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6dc406dde0 0x7f6dc40b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 >> v1:172.21.15.97:6789/0 conn(0x7f6dc40b3510 legacy=0x7f6dc406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc406ec60 con 0x7f6dc415c030 2024-09-19T05:44:51.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6db4001680 con 0x7f6dc415c030 2024-09-19T05:44:51.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 >> v1:172.21.15.67:6789/0 conn(0x7f6dc415c030 legacy=0x7f6dc415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db00039f0 0x7f6db0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6db0004810 0x7f6db0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6dc406dde0 0x7f6db000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc406e980 con 0x7f6db00039f0 2024-09-19T05:44:51.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6db0005560 con 0x7f6db0004810 2024-09-19T05:44:51.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6db000bf10 con 0x7f6dc406dde0 2024-09-19T05:44:51.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dca53c640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db00039f0 0x7f6db0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dc9d3b640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6db0004810 0x7f6db0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dcad3d640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6dc406dde0 0x7f6db000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dca53c640 1 -- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6dc406dde0 msgr2=0x7f6db000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:51.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dca53c640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6dc406dde0 0x7f6db000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dca53c640 1 -- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6db0004810 msgr2=0x7f6db0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:51.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dca53c640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6db0004810 0x7f6db0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dca53c640 1 -- 172.21.15.67:0/89773298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db0003530 con 0x7f6db00039f0 2024-09-19T05:44:51.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.424+0000 7f6dcad3d640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6dc406dde0 0x7f6db000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:51.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dca53c640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db00039f0 0x7f6db0003e10 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c1c0 tx=0x7f6db401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f631aad697f341 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:51.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4007d00 con 0x7f6db00039f0 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db40a9020 con 0x7f6db00039f0 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dc953a640 1 -- 172.21.15.67:0/89773298 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4005b00 con 0x7f6db00039f0 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/89773298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db00039f0 msgr2=0x7f6db0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dcc7a0640 1 --2- 172.21.15.67:0/89773298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6db00039f0 0x7f6db0003e10 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c1c0 tx=0x7f6db401cc30 comp rx=0 tx=0).stop 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dcad3d640 1 -- 172.21.15.67:0/89773298 reap_dead start 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/89773298 shutdown_connections 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/89773298 >> 172.21.15.67:0/89773298 conn(0x7f6dc40d0080 msgr2=0x7f6dc40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/89773298 shutdown_connections 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/89773298 wait complete. 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dcc7a0640 1 Processor -- start 2024-09-19T05:44:51.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.428+0000 7f6dcc7a0640 1 -- start start 2024-09-19T05:44:51.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dcc7a0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db00039f0 0x7f6dc414a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dcc7a0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dc414ef70 0x7f6dc414f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dcc7a0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6dc4150ac0 0x7f6dc4150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dcc7a0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc415c620 con 0x7f6dc414ef70 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dcc7a0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc4071e80 con 0x7f6dc4150ac0 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dcc7a0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc4072000 con 0x7f6db00039f0 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dc9d3b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dc414ef70 0x7f6dc414f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dc9d3b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dc414ef70 0x7f6dc414f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51542/0 (socket says 172.21.15.67:51542) 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dc9d3b640 1 -- 172.21.15.67:0/485693799 learned_addr learned my addr 172.21.15.67:0/485693799 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dcad3d640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6dc4150ac0 0x7f6dc4150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dca53c640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db00039f0 0x7f6dc414a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dc9d3b640 1 -- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db00039f0 msgr2=0x7f6dc414a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dc9d3b640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db00039f0 0x7f6dc414a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dc9d3b640 1 -- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6dc4150ac0 msgr2=0x7f6dc4150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dc9d3b640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6dc4150ac0 0x7f6dc4150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dc9d3b640 1 -- 172.21.15.67:0/485693799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc414fd20 con 0x7f6dc414ef70 2024-09-19T05:44:51.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dca53c640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db00039f0 0x7f6dc414a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:51.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dc9d3b640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dc414ef70 0x7f6dc414f3f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000f580 tx=0x7f6dc000fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:51.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dbaffd640 1 -- 172.21.15.67:0/485693799 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0019020 con 0x7f6dc414ef70 2024-09-19T05:44:51.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dbaffd640 1 -- 172.21.15.67:0/485693799 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc0014870 con 0x7f6dc414ef70 2024-09-19T05:44:51.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/485693799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc4150880 con 0x7f6dc414ef70 2024-09-19T05:44:51.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dbaffd640 1 -- 172.21.15.67:0/485693799 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0014c40 con 0x7f6dc414ef70 2024-09-19T05:44:51.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/485693799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc414aaa0 con 0x7f6dc414ef70 2024-09-19T05:44:51.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/485693799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc406f460 con 0x7f6dc414ef70 2024-09-19T05:44:51.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dbaffd640 1 -- 172.21.15.67:0/485693799 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6dc001c020 con 0x7f6dc414ef70 2024-09-19T05:44:51.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dbaffd640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6da80678f0 0x7f6da8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dbaffd640 1 -- 172.21.15.67:0/485693799 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f6dc00864b0 con 0x7f6dc414ef70 2024-09-19T05:44:51.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.432+0000 7f6dca53c640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6da80678f0 0x7f6da8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.436+0000 7f6dca53c640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6da80678f0 0x7f6da8069db0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6db40aa000 tx=0x7f6dc406e590 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:51.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.436+0000 7f6dbaffd640 1 -- 172.21.15.67:0/485693799 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6dc0023020 con 0x7f6dc414ef70 2024-09-19T05:44:51.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.596+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/485693799 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6dc40d0f20 con 0x7f6da80678f0 2024-09-19T05:44:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dbaffd640 1 -- 172.21.15.67:0/485693799 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252416 (secure 0 0 0) 0x7f6dc40d0f20 con 0x7f6da80678f0 2024-09-19T05:44:51.617 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:51.618 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:44:51.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6da80678f0 msgr2=0x7f6da8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6da80678f0 0x7f6da8069db0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6db40aa000 tx=0x7f6dc406e590 comp rx=0 tx=0).stop 2024-09-19T05:44:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/485693799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dc414ef70 msgr2=0x7f6dc414f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dc414ef70 0x7f6dc414f3f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000f580 tx=0x7f6dc000fa40 comp rx=0 tx=0).stop 2024-09-19T05:44:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/485693799 shutdown_connections 2024-09-19T05:44:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6dc4150ac0 0x7f6dc4150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dc414ef70 0x7f6dc414f3f0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6da80678f0 0x7f6da8069db0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 --2- 172.21.15.67:0/485693799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6db00039f0 0x7f6dc414a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/485693799 >> 172.21.15.67:0/485693799 conn(0x7f6dc40d0080 msgr2=0x7f6dc415e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/485693799 shutdown_connections 2024-09-19T05:44:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.616+0000 7f6dcc7a0640 1 -- 172.21.15.67:0/485693799 wait complete. 2024-09-19T05:44:51.635 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":503,"stamp":"2024-09-19T05:44:51.352081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":521120,"kb_used_data":16160,"kb_used_omap":12,"kb_used_meta":504755,"kb_avail":754453600,"statfs":{"total":773094113280,"available":772560486400,"internally_reserved":0,"allocated":16547840,"data_stored":8413948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516869681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001743"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.015245+0000","last_change":"2024-09-19T05:44:47.006369+0000","last_active":"2024-09-19T05:44:47.015245+0000","last_peered":"2024-09-19T05:44:47.015245+0000","last_clean":"2024-09-19T05:44:47.015245+0000","last_became_active":"2024-09-19T05:44:47.005550+0000","last_became_peered":"2024-09-19T05:44:47.005550+0000","last_unstale":"2024-09-19T05:44:47.015245+0000","last_undegraded":"2024-09-19T05:44:47.015245+0000","last_fullsized":"2024-09-19T05:44:47.015245+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:52.436162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.021696+0000","last_change":"2024-09-19T05:44:47.006951+0000","last_active":"2024-09-19T05:44:47.021696+0000","last_peered":"2024-09-19T05:44:47.021696+0000","last_clean":"2024-09-19T05:44:47.021696+0000","last_became_active":"2024-09-19T05:44:47.006219+0000","last_became_peered":"2024-09-19T05:44:47.006219+0000","last_unstale":"2024-09-19T05:44:47.021696+0000","last_undegraded":"2024-09-19T05:44:47.021696+0000","last_fullsized":"2024-09-19T05:44:47.021696+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:00.816801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.030244+0000","last_change":"2024-09-19T05:44:47.029273+0000","last_active":"2024-09-19T05:44:47.030244+0000","last_peered":"2024-09-19T05:44:47.030244+0000","last_clean":"2024-09-19T05:44:47.030244+0000","last_became_active":"2024-09-19T05:44:47.028567+0000","last_became_peered":"2024-09-19T05:44:47.028567+0000","last_unstale":"2024-09-19T05:44:47.030244+0000","last_undegraded":"2024-09-19T05:44:47.030244+0000","last_fullsized":"2024-09-19T05:44:47.030244+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:27.956126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.013019+0000","last_change":"2024-09-19T05:44:47.005995+0000","last_active":"2024-09-19T05:44:47.013019+0000","last_peered":"2024-09-19T05:44:47.013019+0000","last_clean":"2024-09-19T05:44:47.013019+0000","last_became_active":"2024-09-19T05:44:47.005259+0000","last_became_peered":"2024-09-19T05:44:47.005259+0000","last_unstale":"2024-09-19T05:44:47.013019+0000","last_undegraded":"2024-09-19T05:44:47.013019+0000","last_fullsized":"2024-09-19T05:44:47.013019+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:55.441478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.012394+0000","last_change":"2024-09-19T05:44:47.000216+0000","last_active":"2024-09-19T05:44:47.012394+0000","last_peered":"2024-09-19T05:44:47.012394+0000","last_clean":"2024-09-19T05:44:47.012394+0000","last_became_active":"2024-09-19T05:44:46.991782+0000","last_became_peered":"2024-09-19T05:44:46.991782+0000","last_unstale":"2024-09-19T05:44:47.012394+0000","last_undegraded":"2024-09-19T05:44:47.012394+0000","last_fullsized":"2024-09-19T05:44:47.012394+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:24.180164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.010184+0000","last_change":"2024-09-19T05:44:46.990307+0000","last_active":"2024-09-19T05:44:47.010184+0000","last_peered":"2024-09-19T05:44:47.010184+0000","last_clean":"2024-09-19T05:44:47.010184+0000","last_became_active":"2024-09-19T05:44:46.987180+0000","last_became_peered":"2024-09-19T05:44:46.987180+0000","last_unstale":"2024-09-19T05:44:47.010184+0000","last_undegraded":"2024-09-19T05:44:47.010184+0000","last_fullsized":"2024-09-19T05:44:47.010184+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:57.230255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.017144+0000","last_change":"2024-09-19T05:44:47.012586+0000","last_active":"2024-09-19T05:44:47.017144+0000","last_peered":"2024-09-19T05:44:47.017144+0000","last_clean":"2024-09-19T05:44:47.017144+0000","last_became_active":"2024-09-19T05:44:47.011330+0000","last_became_peered":"2024-09-19T05:44:47.011330+0000","last_unstale":"2024-09-19T05:44:47.017144+0000","last_undegraded":"2024-09-19T05:44:47.017144+0000","last_fullsized":"2024-09-19T05:44:47.017144+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:55.449312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.000891+0000","last_change":"2024-09-19T05:44:46.996517+0000","last_active":"2024-09-19T05:44:47.000891+0000","last_peered":"2024-09-19T05:44:47.000891+0000","last_clean":"2024-09-19T05:44:47.000891+0000","last_became_active":"2024-09-19T05:44:46.995611+0000","last_became_peered":"2024-09-19T05:44:46.995611+0000","last_unstale":"2024-09-19T05:44:47.000891+0000","last_undegraded":"2024-09-19T05:44:47.000891+0000","last_fullsized":"2024-09-19T05:44:47.000891+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:45.171203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.014003+0000","last_change":"2024-09-19T05:44:47.008932+0000","last_active":"2024-09-19T05:44:47.014003+0000","last_peered":"2024-09-19T05:44:47.014003+0000","last_clean":"2024-09-19T05:44:47.014003+0000","last_became_active":"2024-09-19T05:44:47.008088+0000","last_became_peered":"2024-09-19T05:44:47.008088+0000","last_unstale":"2024-09-19T05:44:47.014003+0000","last_undegraded":"2024-09-19T05:44:47.014003+0000","last_fullsized":"2024-09-19T05:44:47.014003+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:22.907112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.991690+0000","last_change":"2024-09-19T05:44:46.985420+0000","last_active":"2024-09-19T05:44:46.991690+0000","last_peered":"2024-09-19T05:44:46.991690+0000","last_clean":"2024-09-19T05:44:46.991690+0000","last_became_active":"2024-09-19T05:44:46.984541+0000","last_became_peered":"2024-09-19T05:44:46.984541+0000","last_unstale":"2024-09-19T05:44:46.991690+0000","last_undegraded":"2024-09-19T05:44:46.991690+0000","last_fullsized":"2024-09-19T05:44:46.991690+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:11.135912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.026769+0000","last_change":"2024-09-19T05:44:47.026134+0000","last_active":"2024-09-19T05:44:47.026769+0000","last_peered":"2024-09-19T05:44:47.026769+0000","last_clean":"2024-09-19T05:44:47.026769+0000","last_became_active":"2024-09-19T05:44:47.025534+0000","last_became_peered":"2024-09-19T05:44:47.025534+0000","last_unstale":"2024-09-19T05:44:47.026769+0000","last_undegraded":"2024-09-19T05:44:47.026769+0000","last_fullsized":"2024-09-19T05:44:47.026769+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:46.105630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.016873+0000","last_change":"2024-09-19T05:44:47.014371+0000","last_active":"2024-09-19T05:44:47.016873+0000","last_peered":"2024-09-19T05:44:47.016873+0000","last_clean":"2024-09-19T05:44:47.016873+0000","last_became_active":"2024-09-19T05:44:47.013631+0000","last_became_peered":"2024-09-19T05:44:47.013631+0000","last_unstale":"2024-09-19T05:44:47.016873+0000","last_undegraded":"2024-09-19T05:44:47.016873+0000","last_fullsized":"2024-09-19T05:44:47.016873+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.649408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.009960+0000","last_change":"2024-09-19T05:44:46.999209+0000","last_active":"2024-09-19T05:44:47.009960+0000","last_peered":"2024-09-19T05:44:47.009960+0000","last_clean":"2024-09-19T05:44:47.009960+0000","last_became_active":"2024-09-19T05:44:46.990693+0000","last_became_peered":"2024-09-19T05:44:46.990693+0000","last_unstale":"2024-09-19T05:44:47.009960+0000","last_undegraded":"2024-09-19T05:44:47.009960+0000","last_fullsized":"2024-09-19T05:44:47.009960+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:47.844503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.000345+0000","last_change":"2024-09-19T05:44:46.994132+0000","last_active":"2024-09-19T05:44:47.000345+0000","last_peered":"2024-09-19T05:44:47.000345+0000","last_clean":"2024-09-19T05:44:47.000345+0000","last_became_active":"2024-09-19T05:44:46.993356+0000","last_became_peered":"2024-09-19T05:44:46.993356+0000","last_unstale":"2024-09-19T05:44:47.000345+0000","last_undegraded":"2024-09-19T05:44:47.000345+0000","last_fullsized":"2024-09-19T05:44:47.000345+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:33.869358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.021479+0000","last_change":"2024-09-19T05:44:47.004908+0000","last_active":"2024-09-19T05:44:47.021479+0000","last_peered":"2024-09-19T05:44:47.021479+0000","last_clean":"2024-09-19T05:44:47.021479+0000","last_became_active":"2024-09-19T05:44:47.003754+0000","last_became_peered":"2024-09-19T05:44:47.003754+0000","last_unstale":"2024-09-19T05:44:47.021479+0000","last_undegraded":"2024-09-19T05:44:47.021479+0000","last_fullsized":"2024-09-19T05:44:47.021479+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:15.377943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.014243+0000","last_change":"2024-09-19T05:44:47.008882+0000","last_active":"2024-09-19T05:44:47.014243+0000","last_peered":"2024-09-19T05:44:47.014243+0000","last_clean":"2024-09-19T05:44:47.014243+0000","last_became_active":"2024-09-19T05:44:47.008117+0000","last_became_peered":"2024-09-19T05:44:47.008117+0000","last_unstale":"2024-09-19T05:44:47.014243+0000","last_undegraded":"2024-09-19T05:44:47.014243+0000","last_fullsized":"2024-09-19T05:44:47.014243+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:14.913170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.001349+0000","last_change":"2024-09-19T05:44:46.996840+0000","last_active":"2024-09-19T05:44:47.001349+0000","last_peered":"2024-09-19T05:44:47.001349+0000","last_clean":"2024-09-19T05:44:47.001349+0000","last_became_active":"2024-09-19T05:44:46.994080+0000","last_became_peered":"2024-09-19T05:44:46.994080+0000","last_unstale":"2024-09-19T05:44:47.001349+0000","last_undegraded":"2024-09-19T05:44:47.001349+0000","last_fullsized":"2024-09-19T05:44:47.001349+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:18.183514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.024012+0000","last_change":"2024-09-19T05:44:47.021869+0000","last_active":"2024-09-19T05:44:47.024012+0000","last_peered":"2024-09-19T05:44:47.024012+0000","last_clean":"2024-09-19T05:44:47.024012+0000","last_became_active":"2024-09-19T05:44:47.021021+0000","last_became_peered":"2024-09-19T05:44:47.021021+0000","last_unstale":"2024-09-19T05:44:47.024012+0000","last_undegraded":"2024-09-19T05:44:47.024012+0000","last_fullsized":"2024-09-19T05:44:47.024012+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:38.207976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.024832+0000","last_change":"2024-09-19T05:44:47.014344+0000","last_active":"2024-09-19T05:44:47.024832+0000","last_peered":"2024-09-19T05:44:47.024832+0000","last_clean":"2024-09-19T05:44:47.024832+0000","last_became_active":"2024-09-19T05:44:47.013608+0000","last_became_peered":"2024-09-19T05:44:47.013608+0000","last_unstale":"2024-09-19T05:44:47.024832+0000","last_undegraded":"2024-09-19T05:44:47.024832+0000","last_fullsized":"2024-09-19T05:44:47.024832+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:25.546418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.011161+0000","last_change":"2024-09-19T05:44:47.004058+0000","last_active":"2024-09-19T05:44:47.011161+0000","last_peered":"2024-09-19T05:44:47.011161+0000","last_clean":"2024-09-19T05:44:47.011161+0000","last_became_active":"2024-09-19T05:44:47.003348+0000","last_became_peered":"2024-09-19T05:44:47.003348+0000","last_unstale":"2024-09-19T05:44:47.011161+0000","last_undegraded":"2024-09-19T05:44:47.011161+0000","last_fullsized":"2024-09-19T05:44:47.011161+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:10.995069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.014046+0000","last_change":"2024-09-19T05:44:47.008711+0000","last_active":"2024-09-19T05:44:47.014046+0000","last_peered":"2024-09-19T05:44:47.014046+0000","last_clean":"2024-09-19T05:44:47.014046+0000","last_became_active":"2024-09-19T05:44:47.001752+0000","last_became_peered":"2024-09-19T05:44:47.001752+0000","last_unstale":"2024-09-19T05:44:47.014046+0000","last_undegraded":"2024-09-19T05:44:47.014046+0000","last_fullsized":"2024-09-19T05:44:47.014046+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:05.465769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.018699+0000","last_change":"2024-09-19T05:44:47.013884+0000","last_active":"2024-09-19T05:44:47.018699+0000","last_peered":"2024-09-19T05:44:47.018699+0000","last_clean":"2024-09-19T05:44:47.018699+0000","last_became_active":"2024-09-19T05:44:47.011087+0000","last_became_peered":"2024-09-19T05:44:47.011087+0000","last_unstale":"2024-09-19T05:44:47.018699+0000","last_undegraded":"2024-09-19T05:44:47.018699+0000","last_fullsized":"2024-09-19T05:44:47.018699+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:57.636127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.997322+0000","last_change":"2024-09-19T05:44:46.987908+0000","last_active":"2024-09-19T05:44:46.997322+0000","last_peered":"2024-09-19T05:44:46.997322+0000","last_clean":"2024-09-19T05:44:46.997322+0000","last_became_active":"2024-09-19T05:44:46.987162+0000","last_became_peered":"2024-09-19T05:44:46.987162+0000","last_unstale":"2024-09-19T05:44:46.997322+0000","last_undegraded":"2024-09-19T05:44:46.997322+0000","last_fullsized":"2024-09-19T05:44:46.997322+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:02.007255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.015110+0000","last_change":"2024-09-19T05:44:47.013897+0000","last_active":"2024-09-19T05:44:47.015110+0000","last_peered":"2024-09-19T05:44:47.015110+0000","last_clean":"2024-09-19T05:44:47.015110+0000","last_became_active":"2024-09-19T05:44:47.013252+0000","last_became_peered":"2024-09-19T05:44:47.013252+0000","last_unstale":"2024-09-19T05:44:47.015110+0000","last_undegraded":"2024-09-19T05:44:47.015110+0000","last_fullsized":"2024-09-19T05:44:47.015110+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:05.593538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.014795+0000","last_change":"2024-09-19T05:44:46.993121+0000","last_active":"2024-09-19T05:44:47.014795+0000","last_peered":"2024-09-19T05:44:47.014795+0000","last_clean":"2024-09-19T05:44:47.014795+0000","last_became_active":"2024-09-19T05:44:46.989503+0000","last_became_peered":"2024-09-19T05:44:46.989503+0000","last_unstale":"2024-09-19T05:44:47.014795+0000","last_undegraded":"2024-09-19T05:44:47.014795+0000","last_fullsized":"2024-09-19T05:44:47.014795+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:00.507065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.018761+0000","last_change":"2024-09-19T05:44:47.014897+0000","last_active":"2024-09-19T05:44:47.018761+0000","last_peered":"2024-09-19T05:44:47.018761+0000","last_clean":"2024-09-19T05:44:47.018761+0000","last_became_active":"2024-09-19T05:44:47.011158+0000","last_became_peered":"2024-09-19T05:44:47.011158+0000","last_unstale":"2024-09-19T05:44:47.018761+0000","last_undegraded":"2024-09-19T05:44:47.018761+0000","last_fullsized":"2024-09-19T05:44:47.018761+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:20.673232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022173+0000","last_change":"2024-09-19T05:44:47.018194+0000","last_active":"2024-09-19T05:44:47.022173+0000","last_peered":"2024-09-19T05:44:47.022173+0000","last_clean":"2024-09-19T05:44:47.022173+0000","last_became_active":"2024-09-19T05:44:47.017290+0000","last_became_peered":"2024-09-19T05:44:47.017290+0000","last_unstale":"2024-09-19T05:44:47.022173+0000","last_undegraded":"2024-09-19T05:44:47.022173+0000","last_fullsized":"2024-09-19T05:44:47.022173+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:10.995069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.994461+0000","last_change":"2024-09-19T05:44:46.987968+0000","last_active":"2024-09-19T05:44:46.994461+0000","last_peered":"2024-09-19T05:44:46.994461+0000","last_clean":"2024-09-19T05:44:46.994461+0000","last_became_active":"2024-09-19T05:44:46.987250+0000","last_became_peered":"2024-09-19T05:44:46.987250+0000","last_unstale":"2024-09-19T05:44:46.994461+0000","last_undegraded":"2024-09-19T05:44:46.994461+0000","last_fullsized":"2024-09-19T05:44:46.994461+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:01.521890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022319+0000","last_change":"2024-09-19T05:44:47.013021+0000","last_active":"2024-09-19T05:44:47.022319+0000","last_peered":"2024-09-19T05:44:47.022319+0000","last_clean":"2024-09-19T05:44:47.022319+0000","last_became_active":"2024-09-19T05:44:47.011483+0000","last_became_peered":"2024-09-19T05:44:47.011483+0000","last_unstale":"2024-09-19T05:44:47.022319+0000","last_undegraded":"2024-09-19T05:44:47.022319+0000","last_fullsized":"2024-09-19T05:44:47.022319+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:07.865051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.006780+0000","last_change":"2024-09-19T05:44:46.998722+0000","last_active":"2024-09-19T05:44:47.006780+0000","last_peered":"2024-09-19T05:44:47.006780+0000","last_clean":"2024-09-19T05:44:47.006780+0000","last_became_active":"2024-09-19T05:44:46.997640+0000","last_became_peered":"2024-09-19T05:44:46.997640+0000","last_unstale":"2024-09-19T05:44:47.006780+0000","last_undegraded":"2024-09-19T05:44:47.006780+0000","last_fullsized":"2024-09-19T05:44:47.006780+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:26.412923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.012270+0000","last_change":"2024-09-19T05:44:47.000193+0000","last_active":"2024-09-19T05:44:47.012270+0000","last_peered":"2024-09-19T05:44:47.012270+0000","last_clean":"2024-09-19T05:44:47.012270+0000","last_became_active":"2024-09-19T05:44:46.999462+0000","last_became_peered":"2024-09-19T05:44:46.999462+0000","last_unstale":"2024-09-19T05:44:47.012270+0000","last_undegraded":"2024-09-19T05:44:47.012270+0000","last_fullsized":"2024-09-19T05:44:47.012270+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:50.778885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.000789+0000","last_change":"2024-09-19T05:44:46.986333+0000","last_active":"2024-09-19T05:44:47.000789+0000","last_peered":"2024-09-19T05:44:47.000789+0000","last_clean":"2024-09-19T05:44:47.000789+0000","last_became_active":"2024-09-19T05:44:46.985628+0000","last_became_peered":"2024-09-19T05:44:46.985628+0000","last_unstale":"2024-09-19T05:44:47.000789+0000","last_undegraded":"2024-09-19T05:44:47.000789+0000","last_fullsized":"2024-09-19T05:44:47.000789+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:52.540441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.026362+0000","last_change":"2024-09-19T05:44:47.025564+0000","last_active":"2024-09-19T05:44:47.026362+0000","last_peered":"2024-09-19T05:44:47.026362+0000","last_clean":"2024-09-19T05:44:47.026362+0000","last_became_active":"2024-09-19T05:44:47.024864+0000","last_became_peered":"2024-09-19T05:44:47.024864+0000","last_unstale":"2024-09-19T05:44:47.026362+0000","last_undegraded":"2024-09-19T05:44:47.026362+0000","last_fullsized":"2024-09-19T05:44:47.026362+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:19.042066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"154'4","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.210675+0000","last_change":"2024-09-19T05:44:45.987634+0000","last_active":"2024-09-19T05:44:47.210675+0000","last_peered":"2024-09-19T05:44:47.210675+0000","last_clean":"2024-09-19T05:44:47.210675+0000","last_became_active":"2024-09-19T05:44:45.987148+0000","last_became_peered":"2024-09-19T05:44:45.987148+0000","last_unstale":"2024-09-19T05:44:47.210675+0000","last_undegraded":"2024-09-19T05:44:47.210675+0000","last_fullsized":"2024-09-19T05:44:47.210675+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:24.542726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022588+0000","last_change":"2024-09-19T05:44:47.012918+0000","last_active":"2024-09-19T05:44:47.022588+0000","last_peered":"2024-09-19T05:44:47.022588+0000","last_clean":"2024-09-19T05:44:47.022588+0000","last_became_active":"2024-09-19T05:44:47.012095+0000","last_became_peered":"2024-09-19T05:44:47.012095+0000","last_unstale":"2024-09-19T05:44:47.022588+0000","last_undegraded":"2024-09-19T05:44:47.022588+0000","last_fullsized":"2024-09-19T05:44:47.022588+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:31.444402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"154'1","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.202385+0000","last_change":"2024-09-19T05:44:45.977301+0000","last_active":"2024-09-19T05:44:47.202385+0000","last_peered":"2024-09-19T05:44:47.202385+0000","last_clean":"2024-09-19T05:44:47.202385+0000","last_became_active":"2024-09-19T05:44:45.976477+0000","last_became_peered":"2024-09-19T05:44:45.976477+0000","last_unstale":"2024-09-19T05:44:47.202385+0000","last_undegraded":"2024-09-19T05:44:47.202385+0000","last_fullsized":"2024-09-19T05:44:47.202385+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:39.962608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.997758+0000","last_change":"2024-09-19T05:44:46.993506+0000","last_active":"2024-09-19T05:44:46.997758+0000","last_peered":"2024-09-19T05:44:46.997758+0000","last_clean":"2024-09-19T05:44:46.997758+0000","last_became_active":"2024-09-19T05:44:46.992345+0000","last_became_peered":"2024-09-19T05:44:46.992345+0000","last_unstale":"2024-09-19T05:44:46.997758+0000","last_undegraded":"2024-09-19T05:44:46.997758+0000","last_fullsized":"2024-09-19T05:44:46.997758+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:18.762481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.204340+0000","last_change":"2024-09-19T05:44:45.976930+0000","last_active":"2024-09-19T05:44:47.204340+0000","last_peered":"2024-09-19T05:44:47.204340+0000","last_clean":"2024-09-19T05:44:47.204340+0000","last_became_active":"2024-09-19T05:44:45.976205+0000","last_became_peered":"2024-09-19T05:44:45.976205+0000","last_unstale":"2024-09-19T05:44:47.204340+0000","last_undegraded":"2024-09-19T05:44:47.204340+0000","last_fullsized":"2024-09-19T05:44:47.204340+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:37.889502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.025691+0000","last_change":"2024-09-19T05:44:47.020778+0000","last_active":"2024-09-19T05:44:47.025691+0000","last_peered":"2024-09-19T05:44:47.025691+0000","last_clean":"2024-09-19T05:44:47.025691+0000","last_became_active":"2024-09-19T05:44:47.019467+0000","last_became_peered":"2024-09-19T05:44:47.019467+0000","last_unstale":"2024-09-19T05:44:47.025691+0000","last_undegraded":"2024-09-19T05:44:47.025691+0000","last_fullsized":"2024-09-19T05:44:47.025691+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:57.230255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.209984+0000","last_change":"2024-09-19T05:44:45.979412+0000","last_active":"2024-09-19T05:44:47.209984+0000","last_peered":"2024-09-19T05:44:47.209984+0000","last_clean":"2024-09-19T05:44:47.209984+0000","last_became_active":"2024-09-19T05:44:45.978953+0000","last_became_peered":"2024-09-19T05:44:45.978953+0000","last_unstale":"2024-09-19T05:44:47.209984+0000","last_undegraded":"2024-09-19T05:44:47.209984+0000","last_fullsized":"2024-09-19T05:44:47.209984+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:14.180291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.011085+0000","last_change":"2024-09-19T05:44:46.998319+0000","last_active":"2024-09-19T05:44:47.011085+0000","last_peered":"2024-09-19T05:44:47.011085+0000","last_clean":"2024-09-19T05:44:47.011085+0000","last_became_active":"2024-09-19T05:44:46.997555+0000","last_became_peered":"2024-09-19T05:44:46.997555+0000","last_unstale":"2024-09-19T05:44:47.011085+0000","last_undegraded":"2024-09-19T05:44:47.011085+0000","last_fullsized":"2024-09-19T05:44:47.011085+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:06.284075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"154'1","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.199201+0000","last_change":"2024-09-19T05:44:45.985417+0000","last_active":"2024-09-19T05:44:47.199201+0000","last_peered":"2024-09-19T05:44:47.199201+0000","last_clean":"2024-09-19T05:44:47.199201+0000","last_became_active":"2024-09-19T05:44:45.984785+0000","last_became_peered":"2024-09-19T05:44:45.984785+0000","last_unstale":"2024-09-19T05:44:47.199201+0000","last_undegraded":"2024-09-19T05:44:47.199201+0000","last_fullsized":"2024-09-19T05:44:47.199201+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:13.555945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.024320+0000","last_change":"2024-09-19T05:44:47.017781+0000","last_active":"2024-09-19T05:44:47.024320+0000","last_peered":"2024-09-19T05:44:47.024320+0000","last_clean":"2024-09-19T05:44:47.024320+0000","last_became_active":"2024-09-19T05:44:47.016989+0000","last_became_peered":"2024-09-19T05:44:47.016989+0000","last_unstale":"2024-09-19T05:44:47.024320+0000","last_undegraded":"2024-09-19T05:44:47.024320+0000","last_fullsized":"2024-09-19T05:44:47.024320+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:35.073879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"154'1","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.204409+0000","last_change":"2024-09-19T05:44:45.993808+0000","last_active":"2024-09-19T05:44:47.204409+0000","last_peered":"2024-09-19T05:44:47.204409+0000","last_clean":"2024-09-19T05:44:47.204409+0000","last_became_active":"2024-09-19T05:44:45.993465+0000","last_became_peered":"2024-09-19T05:44:45.993465+0000","last_unstale":"2024-09-19T05:44:47.204409+0000","last_undegraded":"2024-09-19T05:44:47.204409+0000","last_fullsized":"2024-09-19T05:44:47.204409+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:36.614164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022600+0000","last_change":"2024-09-19T05:44:47.015225+0000","last_active":"2024-09-19T05:44:47.022600+0000","last_peered":"2024-09-19T05:44:47.022600+0000","last_clean":"2024-09-19T05:44:47.022600+0000","last_became_active":"2024-09-19T05:44:47.014450+0000","last_became_peered":"2024-09-19T05:44:47.014450+0000","last_unstale":"2024-09-19T05:44:47.022600+0000","last_undegraded":"2024-09-19T05:44:47.022600+0000","last_fullsized":"2024-09-19T05:44:47.022600+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:17.302194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.979279+0000","last_change":"2024-09-19T05:44:45.969218+0000","last_active":"2024-09-19T05:44:46.979279+0000","last_peered":"2024-09-19T05:44:46.979279+0000","last_clean":"2024-09-19T05:44:46.979279+0000","last_became_active":"2024-09-19T05:44:45.968479+0000","last_became_peered":"2024-09-19T05:44:45.968479+0000","last_unstale":"2024-09-19T05:44:46.979279+0000","last_undegraded":"2024-09-19T05:44:46.979279+0000","last_fullsized":"2024-09-19T05:44:46.979279+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:09.532459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.017002+0000","last_change":"2024-09-19T05:44:47.008186+0000","last_active":"2024-09-19T05:44:47.017002+0000","last_peered":"2024-09-19T05:44:47.017002+0000","last_clean":"2024-09-19T05:44:47.017002+0000","last_became_active":"2024-09-19T05:44:47.007376+0000","last_became_peered":"2024-09-19T05:44:47.007376+0000","last_unstale":"2024-09-19T05:44:47.017002+0000","last_undegraded":"2024-09-19T05:44:47.017002+0000","last_fullsized":"2024-09-19T05:44:47.017002+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:10.130701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.970878+0000","last_change":"2024-09-19T05:44:45.988408+0000","last_active":"2024-09-19T05:44:46.970878+0000","last_peered":"2024-09-19T05:44:46.970878+0000","last_clean":"2024-09-19T05:44:46.970878+0000","last_became_active":"2024-09-19T05:44:45.987735+0000","last_became_peered":"2024-09-19T05:44:45.987735+0000","last_unstale":"2024-09-19T05:44:46.970878+0000","last_undegraded":"2024-09-19T05:44:46.970878+0000","last_fullsized":"2024-09-19T05:44:46.970878+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:53.955060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.000507+0000","last_change":"2024-09-19T05:44:46.998481+0000","last_active":"2024-09-19T05:44:47.000507+0000","last_peered":"2024-09-19T05:44:47.000507+0000","last_clean":"2024-09-19T05:44:47.000507+0000","last_became_active":"2024-09-19T05:44:46.997763+0000","last_became_peered":"2024-09-19T05:44:46.997763+0000","last_unstale":"2024-09-19T05:44:47.000507+0000","last_undegraded":"2024-09-19T05:44:47.000507+0000","last_fullsized":"2024-09-19T05:44:47.000507+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.680668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.988912+0000","last_change":"2024-09-19T05:44:45.971922+0000","last_active":"2024-09-19T05:44:46.988912+0000","last_peered":"2024-09-19T05:44:46.988912+0000","last_clean":"2024-09-19T05:44:46.988912+0000","last_became_active":"2024-09-19T05:44:45.971614+0000","last_became_peered":"2024-09-19T05:44:45.971614+0000","last_unstale":"2024-09-19T05:44:46.988912+0000","last_undegraded":"2024-09-19T05:44:46.988912+0000","last_fullsized":"2024-09-19T05:44:46.988912+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:36.614164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.030385+0000","last_change":"2024-09-19T05:44:47.029167+0000","last_active":"2024-09-19T05:44:47.030385+0000","last_peered":"2024-09-19T05:44:47.030385+0000","last_clean":"2024-09-19T05:44:47.030385+0000","last_became_active":"2024-09-19T05:44:47.028711+0000","last_became_peered":"2024-09-19T05:44:47.028711+0000","last_unstale":"2024-09-19T05:44:47.030385+0000","last_undegraded":"2024-09-19T05:44:47.030385+0000","last_fullsized":"2024-09-19T05:44:47.030385+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:43.870385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.009675+0000","last_change":"2024-09-19T05:44:45.975368+0000","last_active":"2024-09-19T05:44:47.009675+0000","last_peered":"2024-09-19T05:44:47.009675+0000","last_clean":"2024-09-19T05:44:47.009675+0000","last_became_active":"2024-09-19T05:44:45.973608+0000","last_became_peered":"2024-09-19T05:44:45.973608+0000","last_unstale":"2024-09-19T05:44:47.009675+0000","last_undegraded":"2024-09-19T05:44:47.009675+0000","last_fullsized":"2024-09-19T05:44:47.009675+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:04.669197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.024613+0000","last_change":"2024-09-19T05:44:47.023567+0000","last_active":"2024-09-19T05:44:47.024613+0000","last_peered":"2024-09-19T05:44:47.024613+0000","last_clean":"2024-09-19T05:44:47.024613+0000","last_became_active":"2024-09-19T05:44:47.022415+0000","last_became_peered":"2024-09-19T05:44:47.022415+0000","last_unstale":"2024-09-19T05:44:47.024613+0000","last_undegraded":"2024-09-19T05:44:47.024613+0000","last_fullsized":"2024-09-19T05:44:47.024613+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:50.065752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"154'3","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.210731+0000","last_change":"2024-09-19T05:44:45.966982+0000","last_active":"2024-09-19T05:44:47.210731+0000","last_peered":"2024-09-19T05:44:47.210731+0000","last_clean":"2024-09-19T05:44:47.210731+0000","last_became_active":"2024-09-19T05:44:45.965288+0000","last_became_peered":"2024-09-19T05:44:45.965288+0000","last_unstale":"2024-09-19T05:44:47.210731+0000","last_undegraded":"2024-09-19T05:44:47.210731+0000","last_fullsized":"2024-09-19T05:44:47.210731+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:39.209341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.004212+0000","last_change":"2024-09-19T05:44:47.002249+0000","last_active":"2024-09-19T05:44:47.004212+0000","last_peered":"2024-09-19T05:44:47.004212+0000","last_clean":"2024-09-19T05:44:47.004212+0000","last_became_active":"2024-09-19T05:44:47.001513+0000","last_became_peered":"2024-09-19T05:44:47.001513+0000","last_unstale":"2024-09-19T05:44:47.004212+0000","last_undegraded":"2024-09-19T05:44:47.004212+0000","last_fullsized":"2024-09-19T05:44:47.004212+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:32:43.222113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.207864+0000","last_change":"2024-09-19T05:44:45.988430+0000","last_active":"2024-09-19T05:44:47.207864+0000","last_peered":"2024-09-19T05:44:47.207864+0000","last_clean":"2024-09-19T05:44:47.207864+0000","last_became_active":"2024-09-19T05:44:45.987360+0000","last_became_peered":"2024-09-19T05:44:45.987360+0000","last_unstale":"2024-09-19T05:44:47.207864+0000","last_undegraded":"2024-09-19T05:44:47.207864+0000","last_fullsized":"2024-09-19T05:44:47.207864+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:37.889502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.016485+0000","last_change":"2024-09-19T05:44:47.003569+0000","last_active":"2024-09-19T05:44:47.016485+0000","last_peered":"2024-09-19T05:44:47.016485+0000","last_clean":"2024-09-19T05:44:47.016485+0000","last_became_active":"2024-09-19T05:44:47.002789+0000","last_became_peered":"2024-09-19T05:44:47.002789+0000","last_unstale":"2024-09-19T05:44:47.016485+0000","last_undegraded":"2024-09-19T05:44:47.016485+0000","last_fullsized":"2024-09-19T05:44:47.016485+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:54.217156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.984900+0000","last_change":"2024-09-19T05:44:45.986266+0000","last_active":"2024-09-19T05:44:46.984900+0000","last_peered":"2024-09-19T05:44:46.984900+0000","last_clean":"2024-09-19T05:44:46.984900+0000","last_became_active":"2024-09-19T05:44:45.985579+0000","last_became_peered":"2024-09-19T05:44:45.985579+0000","last_unstale":"2024-09-19T05:44:46.984900+0000","last_undegraded":"2024-09-19T05:44:46.984900+0000","last_fullsized":"2024-09-19T05:44:46.984900+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:41.588659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.010246+0000","last_change":"2024-09-19T05:44:46.992739+0000","last_active":"2024-09-19T05:44:47.010246+0000","last_peered":"2024-09-19T05:44:47.010246+0000","last_clean":"2024-09-19T05:44:47.010246+0000","last_became_active":"2024-09-19T05:44:46.991982+0000","last_became_peered":"2024-09-19T05:44:46.991982+0000","last_unstale":"2024-09-19T05:44:47.010246+0000","last_undegraded":"2024-09-19T05:44:47.010246+0000","last_fullsized":"2024-09-19T05:44:47.010246+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:35.047100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.987273+0000","last_change":"2024-09-19T05:44:45.984852+0000","last_active":"2024-09-19T05:44:46.987273+0000","last_peered":"2024-09-19T05:44:46.987273+0000","last_clean":"2024-09-19T05:44:46.987273+0000","last_became_active":"2024-09-19T05:44:45.984161+0000","last_became_peered":"2024-09-19T05:44:45.984161+0000","last_unstale":"2024-09-19T05:44:46.987273+0000","last_undegraded":"2024-09-19T05:44:46.987273+0000","last_fullsized":"2024-09-19T05:44:46.987273+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:58.481371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022790+0000","last_change":"2024-09-19T05:44:47.017257+0000","last_active":"2024-09-19T05:44:47.022790+0000","last_peered":"2024-09-19T05:44:47.022790+0000","last_clean":"2024-09-19T05:44:47.022790+0000","last_became_active":"2024-09-19T05:44:47.016552+0000","last_became_peered":"2024-09-19T05:44:47.016552+0000","last_unstale":"2024-09-19T05:44:47.022790+0000","last_undegraded":"2024-09-19T05:44:47.022790+0000","last_fullsized":"2024-09-19T05:44:47.022790+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:30.674809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"154'8","reported_seq":20,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.203562+0000","last_change":"2024-09-19T05:44:45.981008+0000","last_active":"2024-09-19T05:44:47.203562+0000","last_peered":"2024-09-19T05:44:47.203562+0000","last_clean":"2024-09-19T05:44:47.203562+0000","last_became_active":"2024-09-19T05:44:45.979523+0000","last_became_peered":"2024-09-19T05:44:45.979523+0000","last_unstale":"2024-09-19T05:44:47.203562+0000","last_undegraded":"2024-09-19T05:44:47.203562+0000","last_fullsized":"2024-09-19T05:44:47.203562+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:13.680991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.021027+0000","last_change":"2024-09-19T05:44:47.011492+0000","last_active":"2024-09-19T05:44:47.021027+0000","last_peered":"2024-09-19T05:44:47.021027+0000","last_clean":"2024-09-19T05:44:47.021027+0000","last_became_active":"2024-09-19T05:44:47.010708+0000","last_became_peered":"2024-09-19T05:44:47.010708+0000","last_unstale":"2024-09-19T05:44:47.021027+0000","last_undegraded":"2024-09-19T05:44:47.021027+0000","last_fullsized":"2024-09-19T05:44:47.021027+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:47.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"154'1","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.207267+0000","last_change":"2024-09-19T05:44:45.983647+0000","last_active":"2024-09-19T05:44:47.207267+0000","last_peered":"2024-09-19T05:44:47.207267+0000","last_clean":"2024-09-19T05:44:47.207267+0000","last_became_active":"2024-09-19T05:44:45.979969+0000","last_became_peered":"2024-09-19T05:44:45.979969+0000","last_unstale":"2024-09-19T05:44:47.207267+0000","last_undegraded":"2024-09-19T05:44:47.207267+0000","last_fullsized":"2024-09-19T05:44:47.207267+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:06.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.024972+0000","last_change":"2024-09-19T05:44:47.020136+0000","last_active":"2024-09-19T05:44:47.024972+0000","last_peered":"2024-09-19T05:44:47.024972+0000","last_clean":"2024-09-19T05:44:47.024972+0000","last_became_active":"2024-09-19T05:44:47.019393+0000","last_became_peered":"2024-09-19T05:44:47.019393+0000","last_unstale":"2024-09-19T05:44:47.024972+0000","last_undegraded":"2024-09-19T05:44:47.024972+0000","last_fullsized":"2024-09-19T05:44:47.024972+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:11.135912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.207104+0000","last_change":"2024-09-19T05:44:45.973032+0000","last_active":"2024-09-19T05:44:47.207104+0000","last_peered":"2024-09-19T05:44:47.207104+0000","last_clean":"2024-09-19T05:44:47.207104+0000","last_became_active":"2024-09-19T05:44:45.972176+0000","last_became_peered":"2024-09-19T05:44:45.972176+0000","last_unstale":"2024-09-19T05:44:47.207104+0000","last_undegraded":"2024-09-19T05:44:47.207104+0000","last_fullsized":"2024-09-19T05:44:47.207104+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:24.345234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.020292+0000","last_change":"2024-09-19T05:44:47.016685+0000","last_active":"2024-09-19T05:44:47.020292+0000","last_peered":"2024-09-19T05:44:47.020292+0000","last_clean":"2024-09-19T05:44:47.020292+0000","last_became_active":"2024-09-19T05:44:47.015440+0000","last_became_peered":"2024-09-19T05:44:47.015440+0000","last_unstale":"2024-09-19T05:44:47.020292+0000","last_undegraded":"2024-09-19T05:44:47.020292+0000","last_fullsized":"2024-09-19T05:44:47.020292+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:55:11.292987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"154'1","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.209644+0000","last_change":"2024-09-19T05:44:45.991495+0000","last_active":"2024-09-19T05:44:47.209644+0000","last_peered":"2024-09-19T05:44:47.209644+0000","last_clean":"2024-09-19T05:44:47.209644+0000","last_became_active":"2024-09-19T05:44:45.991082+0000","last_became_peered":"2024-09-19T05:44:45.991082+0000","last_unstale":"2024-09-19T05:44:47.209644+0000","last_undegraded":"2024-09-19T05:44:47.209644+0000","last_fullsized":"2024-09-19T05:44:47.209644+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.755429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.015177+0000","last_change":"2024-09-19T05:44:46.993176+0000","last_active":"2024-09-19T05:44:47.015177+0000","last_peered":"2024-09-19T05:44:47.015177+0000","last_clean":"2024-09-19T05:44:47.015177+0000","last_became_active":"2024-09-19T05:44:46.992462+0000","last_became_peered":"2024-09-19T05:44:46.992462+0000","last_unstale":"2024-09-19T05:44:47.015177+0000","last_undegraded":"2024-09-19T05:44:47.015177+0000","last_fullsized":"2024-09-19T05:44:47.015177+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:25.651326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.984468+0000","last_change":"2024-09-19T05:44:45.986873+0000","last_active":"2024-09-19T05:44:46.984468+0000","last_peered":"2024-09-19T05:44:46.984468+0000","last_clean":"2024-09-19T05:44:46.984468+0000","last_became_active":"2024-09-19T05:44:45.986472+0000","last_became_peered":"2024-09-19T05:44:45.986472+0000","last_unstale":"2024-09-19T05:44:46.984468+0000","last_undegraded":"2024-09-19T05:44:46.984468+0000","last_fullsized":"2024-09-19T05:44:46.984468+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:33.232328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.025769+0000","last_change":"2024-09-19T05:44:47.021351+0000","last_active":"2024-09-19T05:44:47.025769+0000","last_peered":"2024-09-19T05:44:47.025769+0000","last_clean":"2024-09-19T05:44:47.025769+0000","last_became_active":"2024-09-19T05:44:47.020732+0000","last_became_peered":"2024-09-19T05:44:47.020732+0000","last_unstale":"2024-09-19T05:44:47.025769+0000","last_undegraded":"2024-09-19T05:44:47.025769+0000","last_fullsized":"2024-09-19T05:44:47.025769+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:35.047100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.205546+0000","last_change":"2024-09-19T05:44:45.976211+0000","last_active":"2024-09-19T05:44:47.205546+0000","last_peered":"2024-09-19T05:44:47.205546+0000","last_clean":"2024-09-19T05:44:47.205546+0000","last_became_active":"2024-09-19T05:44:45.975772+0000","last_became_peered":"2024-09-19T05:44:45.975772+0000","last_unstale":"2024-09-19T05:44:47.205546+0000","last_undegraded":"2024-09-19T05:44:47.205546+0000","last_fullsized":"2024-09-19T05:44:47.205546+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:21.903420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022812+0000","last_change":"2024-09-19T05:44:47.019771+0000","last_active":"2024-09-19T05:44:47.022812+0000","last_peered":"2024-09-19T05:44:47.022812+0000","last_clean":"2024-09-19T05:44:47.022812+0000","last_became_active":"2024-09-19T05:44:47.018968+0000","last_became_peered":"2024-09-19T05:44:47.018968+0000","last_unstale":"2024-09-19T05:44:47.022812+0000","last_undegraded":"2024-09-19T05:44:47.022812+0000","last_fullsized":"2024-09-19T05:44:47.022812+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:56.599052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.972343+0000","last_change":"2024-09-19T05:44:45.973977+0000","last_active":"2024-09-19T05:44:46.972343+0000","last_peered":"2024-09-19T05:44:46.972343+0000","last_clean":"2024-09-19T05:44:46.972343+0000","last_became_active":"2024-09-19T05:44:45.973410+0000","last_became_peered":"2024-09-19T05:44:45.973410+0000","last_unstale":"2024-09-19T05:44:46.972343+0000","last_undegraded":"2024-09-19T05:44:46.972343+0000","last_fullsized":"2024-09-19T05:44:46.972343+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:23.970296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.027093+0000","last_change":"2024-09-19T05:44:47.026181+0000","last_active":"2024-09-19T05:44:47.027093+0000","last_peered":"2024-09-19T05:44:47.027093+0000","last_clean":"2024-09-19T05:44:47.027093+0000","last_became_active":"2024-09-19T05:44:47.025260+0000","last_became_peered":"2024-09-19T05:44:47.025260+0000","last_unstale":"2024-09-19T05:44:47.027093+0000","last_undegraded":"2024-09-19T05:44:47.027093+0000","last_fullsized":"2024-09-19T05:44:47.027093+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:47.844503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.979385+0000","last_change":"2024-09-19T05:44:45.965374+0000","last_active":"2024-09-19T05:44:46.979385+0000","last_peered":"2024-09-19T05:44:46.979385+0000","last_clean":"2024-09-19T05:44:46.979385+0000","last_became_active":"2024-09-19T05:44:45.964736+0000","last_became_peered":"2024-09-19T05:44:45.964736+0000","last_unstale":"2024-09-19T05:44:46.979385+0000","last_undegraded":"2024-09-19T05:44:46.979385+0000","last_fullsized":"2024-09-19T05:44:46.979385+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:04.462077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.022763+0000","last_change":"2024-09-19T05:44:47.013719+0000","last_active":"2024-09-19T05:44:47.022763+0000","last_peered":"2024-09-19T05:44:47.022763+0000","last_clean":"2024-09-19T05:44:47.022763+0000","last_became_active":"2024-09-19T05:44:47.013016+0000","last_became_peered":"2024-09-19T05:44:47.013016+0000","last_unstale":"2024-09-19T05:44:47.022763+0000","last_undegraded":"2024-09-19T05:44:47.022763+0000","last_fullsized":"2024-09-19T05:44:47.022763+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:15.868697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.973988+0000","last_change":"2024-09-19T05:44:45.969900+0000","last_active":"2024-09-19T05:44:46.973988+0000","last_peered":"2024-09-19T05:44:46.973988+0000","last_clean":"2024-09-19T05:44:46.973988+0000","last_became_active":"2024-09-19T05:44:45.969292+0000","last_became_peered":"2024-09-19T05:44:45.969292+0000","last_unstale":"2024-09-19T05:44:46.973988+0000","last_undegraded":"2024-09-19T05:44:46.973988+0000","last_fullsized":"2024-09-19T05:44:46.973988+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:45.961441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.017094+0000","last_change":"2024-09-19T05:44:47.014523+0000","last_active":"2024-09-19T05:44:47.017094+0000","last_peered":"2024-09-19T05:44:47.017094+0000","last_clean":"2024-09-19T05:44:47.017094+0000","last_became_active":"2024-09-19T05:44:47.012261+0000","last_became_peered":"2024-09-19T05:44:47.012261+0000","last_unstale":"2024-09-19T05:44:47.017094+0000","last_undegraded":"2024-09-19T05:44:47.017094+0000","last_fullsized":"2024-09-19T05:44:47.017094+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:06.284075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"154'2","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.199089+0000","last_change":"2024-09-19T05:44:45.988445+0000","last_active":"2024-09-19T05:44:47.199089+0000","last_peered":"2024-09-19T05:44:47.199089+0000","last_clean":"2024-09-19T05:44:47.199089+0000","last_became_active":"2024-09-19T05:44:45.987791+0000","last_became_peered":"2024-09-19T05:44:45.987791+0000","last_unstale":"2024-09-19T05:44:47.199089+0000","last_undegraded":"2024-09-19T05:44:47.199089+0000","last_fullsized":"2024-09-19T05:44:47.199089+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:37.075176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.003200+0000","last_change":"2024-09-19T05:44:47.000605+0000","last_active":"2024-09-19T05:44:47.003200+0000","last_peered":"2024-09-19T05:44:47.003200+0000","last_clean":"2024-09-19T05:44:47.003200+0000","last_became_active":"2024-09-19T05:44:46.998722+0000","last_became_peered":"2024-09-19T05:44:46.998722+0000","last_unstale":"2024-09-19T05:44:47.003200+0000","last_undegraded":"2024-09-19T05:44:47.003200+0000","last_fullsized":"2024-09-19T05:44:47.003200+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:56.074225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.009236+0000","last_change":"2024-09-19T05:44:45.981622+0000","last_active":"2024-09-19T05:44:47.009236+0000","last_peered":"2024-09-19T05:44:47.009236+0000","last_clean":"2024-09-19T05:44:47.009236+0000","last_became_active":"2024-09-19T05:44:45.980909+0000","last_became_peered":"2024-09-19T05:44:45.980909+0000","last_unstale":"2024-09-19T05:44:47.009236+0000","last_undegraded":"2024-09-19T05:44:47.009236+0000","last_fullsized":"2024-09-19T05:44:47.009236+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:40.581852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.017199+0000","last_change":"2024-09-19T05:44:47.011838+0000","last_active":"2024-09-19T05:44:47.017199+0000","last_peered":"2024-09-19T05:44:47.017199+0000","last_clean":"2024-09-19T05:44:47.017199+0000","last_became_active":"2024-09-19T05:44:47.010416+0000","last_became_peered":"2024-09-19T05:44:47.010416+0000","last_unstale":"2024-09-19T05:44:47.017199+0000","last_undegraded":"2024-09-19T05:44:47.017199+0000","last_fullsized":"2024-09-19T05:44:47.017199+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:19.919150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.998811+0000","last_change":"2024-09-19T05:44:45.980006+0000","last_active":"2024-09-19T05:44:46.998811+0000","last_peered":"2024-09-19T05:44:46.998811+0000","last_clean":"2024-09-19T05:44:46.998811+0000","last_became_active":"2024-09-19T05:44:45.979054+0000","last_became_peered":"2024-09-19T05:44:45.979054+0000","last_unstale":"2024-09-19T05:44:46.998811+0000","last_undegraded":"2024-09-19T05:44:46.998811+0000","last_fullsized":"2024-09-19T05:44:46.998811+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:49:41.019002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.013616+0000","last_change":"2024-09-19T05:44:47.002511+0000","last_active":"2024-09-19T05:44:47.013616+0000","last_peered":"2024-09-19T05:44:47.013616+0000","last_clean":"2024-09-19T05:44:47.013616+0000","last_became_active":"2024-09-19T05:44:47.001728+0000","last_became_peered":"2024-09-19T05:44:47.001728+0000","last_unstale":"2024-09-19T05:44:47.013616+0000","last_undegraded":"2024-09-19T05:44:47.013616+0000","last_fullsized":"2024-09-19T05:44:47.013616+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:53.663945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.973276+0000","last_change":"2024-09-19T05:44:45.988081+0000","last_active":"2024-09-19T05:44:46.973276+0000","last_peered":"2024-09-19T05:44:46.973276+0000","last_clean":"2024-09-19T05:44:46.973276+0000","last_became_active":"2024-09-19T05:44:45.986796+0000","last_became_peered":"2024-09-19T05:44:45.986796+0000","last_unstale":"2024-09-19T05:44:46.973276+0000","last_undegraded":"2024-09-19T05:44:46.973276+0000","last_fullsized":"2024-09-19T05:44:46.973276+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.093153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.000844+0000","last_change":"2024-09-19T05:44:46.994671+0000","last_active":"2024-09-19T05:44:47.000844+0000","last_peered":"2024-09-19T05:44:47.000844+0000","last_clean":"2024-09-19T05:44:47.000844+0000","last_became_active":"2024-09-19T05:44:46.992389+0000","last_became_peered":"2024-09-19T05:44:46.992389+0000","last_unstale":"2024-09-19T05:44:47.000844+0000","last_undegraded":"2024-09-19T05:44:47.000844+0000","last_fullsized":"2024-09-19T05:44:47.000844+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:02.426170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.984326+0000","last_change":"2024-09-19T05:44:45.989797+0000","last_active":"2024-09-19T05:44:46.984326+0000","last_peered":"2024-09-19T05:44:46.984326+0000","last_clean":"2024-09-19T05:44:46.984326+0000","last_became_active":"2024-09-19T05:44:45.989270+0000","last_became_peered":"2024-09-19T05:44:45.989270+0000","last_unstale":"2024-09-19T05:44:46.984326+0000","last_undegraded":"2024-09-19T05:44:46.984326+0000","last_fullsized":"2024-09-19T05:44:46.984326+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:42.320657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.016888+0000","last_change":"2024-09-19T05:44:47.014504+0000","last_active":"2024-09-19T05:44:47.016888+0000","last_peered":"2024-09-19T05:44:47.016888+0000","last_clean":"2024-09-19T05:44:47.016888+0000","last_became_active":"2024-09-19T05:44:47.012803+0000","last_became_peered":"2024-09-19T05:44:47.012803+0000","last_unstale":"2024-09-19T05:44:47.016888+0000","last_undegraded":"2024-09-19T05:44:47.016888+0000","last_fullsized":"2024-09-19T05:44:47.016888+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:39.489426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.981811+0000","last_change":"2024-09-19T05:44:45.973299+0000","last_active":"2024-09-19T05:44:46.981811+0000","last_peered":"2024-09-19T05:44:46.981811+0000","last_clean":"2024-09-19T05:44:46.981811+0000","last_became_active":"2024-09-19T05:44:45.972531+0000","last_became_peered":"2024-09-19T05:44:45.972531+0000","last_unstale":"2024-09-19T05:44:46.981811+0000","last_undegraded":"2024-09-19T05:44:46.981811+0000","last_fullsized":"2024-09-19T05:44:46.981811+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:56.837940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.021781+0000","last_change":"2024-09-19T05:44:47.006358+0000","last_active":"2024-09-19T05:44:47.021781+0000","last_peered":"2024-09-19T05:44:47.021781+0000","last_clean":"2024-09-19T05:44:47.021781+0000","last_became_active":"2024-09-19T05:44:47.005620+0000","last_became_peered":"2024-09-19T05:44:47.005620+0000","last_unstale":"2024-09-19T05:44:47.021781+0000","last_undegraded":"2024-09-19T05:44:47.021781+0000","last_fullsized":"2024-09-19T05:44:47.021781+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:43.047032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.979639+0000","last_change":"2024-09-19T05:44:45.977725+0000","last_active":"2024-09-19T05:44:46.979639+0000","last_peered":"2024-09-19T05:44:46.979639+0000","last_clean":"2024-09-19T05:44:46.979639+0000","last_became_active":"2024-09-19T05:44:45.970039+0000","last_became_peered":"2024-09-19T05:44:45.970039+0000","last_unstale":"2024-09-19T05:44:46.979639+0000","last_undegraded":"2024-09-19T05:44:46.979639+0000","last_fullsized":"2024-09-19T05:44:46.979639+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:00.980614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.999610+0000","last_change":"2024-09-19T05:44:46.997463+0000","last_active":"2024-09-19T05:44:46.999610+0000","last_peered":"2024-09-19T05:44:46.999610+0000","last_clean":"2024-09-19T05:44:46.999610+0000","last_became_active":"2024-09-19T05:44:46.996611+0000","last_became_peered":"2024-09-19T05:44:46.996611+0000","last_unstale":"2024-09-19T05:44:46.999610+0000","last_undegraded":"2024-09-19T05:44:46.999610+0000","last_fullsized":"2024-09-19T05:44:46.999610+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:26.671131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.987417+0000","last_change":"2024-09-19T05:44:45.962671+0000","last_active":"2024-09-19T05:44:46.987417+0000","last_peered":"2024-09-19T05:44:46.987417+0000","last_clean":"2024-09-19T05:44:46.987417+0000","last_became_active":"2024-09-19T05:44:45.962097+0000","last_became_peered":"2024-09-19T05:44:45.962097+0000","last_unstale":"2024-09-19T05:44:46.987417+0000","last_undegraded":"2024-09-19T05:44:46.987417+0000","last_fullsized":"2024-09-19T05:44:46.987417+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:53.955060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.004263+0000","last_change":"2024-09-19T05:44:47.002345+0000","last_active":"2024-09-19T05:44:47.004263+0000","last_peered":"2024-09-19T05:44:47.004263+0000","last_clean":"2024-09-19T05:44:47.004263+0000","last_became_active":"2024-09-19T05:44:47.001570+0000","last_became_peered":"2024-09-19T05:44:47.001570+0000","last_unstale":"2024-09-19T05:44:47.004263+0000","last_undegraded":"2024-09-19T05:44:47.004263+0000","last_fullsized":"2024-09-19T05:44:47.004263+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:45.940796+0000","last_clean_scrub_stamp":"2024-09-19T05:44:45.940796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:56.005293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"154'6","reported_seq":18,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:47.212891+0000","last_change":"2024-09-19T05:44:45.965612+0000","last_active":"2024-09-19T05:44:47.212891+0000","last_peered":"2024-09-19T05:44:47.212891+0000","last_clean":"2024-09-19T05:44:47.212891+0000","last_became_active":"2024-09-19T05:44:45.964835+0000","last_became_peered":"2024-09-19T05:44:45.964835+0000","last_unstale":"2024-09-19T05:44:47.212891+0000","last_undegraded":"2024-09-19T05:44:47.212891+0000","last_fullsized":"2024-09-19T05:44:47.212891+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:44:44.937103+0000","last_clean_scrub_stamp":"2024-09-19T05:44:44.937103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:13.909477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":412,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-19T05:44:46.987580+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:44:46.987580+0000","last_peered":"2024-09-19T05:44:46.987580+0000","last_clean":"2024-09-19T05:44:46.987580+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:44:46.987580+0000","last_undegraded":"2024-09-19T05:44:46.987580+0000","last_fullsized":"2024-09-19T05:44:46.987580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542287,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69752,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302088,"statfs":{"total":96636764160,"available":96565338112,"internally_reserved":0,"allocated":2519040,"data_stored":1498026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542287,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69168,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302672,"statfs":{"total":96636764160,"available":96565936128,"internally_reserved":0,"allocated":1925120,"data_stored":907658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542289,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63588,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308252,"statfs":{"total":96636764160,"available":96571650048,"internally_reserved":0,"allocated":1912832,"data_stored":900491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69156,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302684,"statfs":{"total":96636764160,"available":96565948416,"internally_reserved":0,"allocated":1912832,"data_stored":900491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542288,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46968,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324872,"statfs":{"total":96636764160,"available":96588668928,"internally_reserved":0,"allocated":1933312,"data_stored":908274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542288,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69152,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302688,"statfs":{"total":96636764160,"available":96565952512,"internally_reserved":0,"allocated":1912832,"data_stored":900491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542290,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59440,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312400,"statfs":{"total":96636764160,"available":96575897600,"internally_reserved":0,"allocated":1925120,"data_stored":907658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542287,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73896,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297944,"statfs":{"total":96636764160,"available":96561094656,"internally_reserved":0,"allocated":2506752,"data_stored":1490859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:44:51.639 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:44:51.639 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:44:51.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f17391ff640 1 Processor -- start 2024-09-19T05:44:51.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f17391ff640 1 -- start start 2024-09-19T05:44:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f17391ff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 0x7f17340d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f17391ff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17340d1590 0x7f173406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f17391ff640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17340d35a0 con 0x7f17340d4fb0 2024-09-19T05:44:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f17391ff640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f17340d32c0 con 0x7f17340d1590 2024-09-19T05:44:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f17391ff640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f173406d040 con 0x7f173415e690 2024-09-19T05:44:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f1732d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 0x7f17340d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f173359e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17340d1590 0x7f173406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f173259c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f17340d4fb0 0x7f17340d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:58920/0 (socket says 172.21.15.67:58920) 2024-09-19T05:44:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f173259c640 1 -- 172.21.15.67:0/3727565212 learned_addr learned my addr 172.21.15.67:0/3727565212 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f1732d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 0x7f17340d2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:56122/0 (socket says 172.21.15.67:56122) 2024-09-19T05:44:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f173359e640 1 -- 172.21.15.67:0/3727565212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 msgr2=0x7f17340d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f173359e640 1 --2- 172.21.15.67:0/3727565212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 0x7f17340d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f173359e640 1 -- 172.21.15.67:0/3727565212 >> v1:172.21.15.97:6789/0 conn(0x7f17340d4fb0 legacy=0x7f17340d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.820+0000 7f173359e640 1 -- 172.21.15.67:0/3727565212 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173406d320 con 0x7f17340d1590 2024-09-19T05:44:51.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f173359e640 1 --2- 172.21.15.67:0/3727565212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17340d1590 0x7f173406db20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f172c009d90 tx=0x7f172c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbf37939ab6d2adf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f1731d9b640 1 -- 172.21.15.67:0/3727565212 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c0b2070 con 0x7f17340d1590 2024-09-19T05:44:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f1731d9b640 1 -- 172.21.15.67:0/3727565212 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c0a59a0 con 0x7f17340d1590 2024-09-19T05:44:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f1731d9b640 1 -- 172.21.15.67:0/3727565212 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c0a5d70 con 0x7f17340d1590 2024-09-19T05:44:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f17391ff640 1 -- 172.21.15.67:0/3727565212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17340d1590 msgr2=0x7f173406db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f17391ff640 1 --2- 172.21.15.67:0/3727565212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17340d1590 0x7f173406db20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f172c009d90 tx=0x7f172c01c940 comp rx=0 tx=0).stop 2024-09-19T05:44:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f17391ff640 1 -- 172.21.15.67:0/3727565212 shutdown_connections 2024-09-19T05:44:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f17391ff640 1 --2- 172.21.15.67:0/3727565212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17340d1590 0x7f173406db20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f17391ff640 1 --2- 172.21.15.67:0/3727565212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 0x7f17340d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f17391ff640 1 -- 172.21.15.67:0/3727565212 >> 172.21.15.67:0/3727565212 conn(0x7f17340d4490 msgr2=0x7f17340d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f17391ff640 1 -- 172.21.15.67:0/3727565212 shutdown_connections 2024-09-19T05:44:51.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f17391ff640 1 -- 172.21.15.67:0/3727565212 wait complete. 2024-09-19T05:44:51.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f17391ff640 1 Processor -- start 2024-09-19T05:44:51.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.824+0000 7f17391ff640 1 -- start start 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f17391ff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17340d1590 0x7f1734159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f17391ff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17340d4fb0 0x7f17341539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f17391ff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 0x7f17340cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f17391ff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f173406e9f0 con 0x7f17340d1590 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f17391ff640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f173406e870 con 0x7f17340d4fb0 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f17391ff640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f173406eb70 con 0x7f173415e690 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f1732d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17340d1590 0x7f1734159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f1732d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17340d1590 0x7f1734159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51556/0 (socket says 172.21.15.67:51556) 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f1732d9d640 1 -- 172.21.15.67:0/1561263750 learned_addr learned my addr 172.21.15.67:0/1561263750 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f173259c640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17340d4fb0 0x7f17341539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f173359e640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 0x7f17340cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f1732d9d640 1 -- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 msgr2=0x7f17340cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f1732d9d640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 0x7f17340cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f1732d9d640 1 -- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17340d4fb0 msgr2=0x7f17341539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f1732d9d640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17340d4fb0 0x7f17341539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f1732d9d640 1 -- 172.21.15.67:0/1561263750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17340ccb60 con 0x7f17340d1590 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f173359e640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 0x7f17340cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f1732d9d640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17340d1590 0x7f1734159660 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f172400e870 tx=0x7f172400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f171b7fe640 1 -- 172.21.15.67:0/1561263750 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724017070 con 0x7f17340d1590 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f171b7fe640 1 -- 172.21.15.67:0/1561263750 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172400c940 con 0x7f17340d1590 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f17391ff640 1 -- 172.21.15.67:0/1561263750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17340cce40 con 0x7f17340d1590 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f171b7fe640 1 -- 172.21.15.67:0/1561263750 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172400ccf0 con 0x7f17340d1590 2024-09-19T05:44:51.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f17391ff640 1 -- 172.21.15.67:0/1561263750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17340cc7f0 con 0x7f17340d1590 2024-09-19T05:44:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f17391ff640 1 -- 172.21.15.67:0/1561263750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173406db20 con 0x7f17340d1590 2024-09-19T05:44:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f171b7fe640 1 -- 172.21.15.67:0/1561263750 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f172401a070 con 0x7f17340d1590 2024-09-19T05:44:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f171b7fe640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17200678f0 0x7f1720069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.828+0000 7f171b7fe640 1 -- 172.21.15.67:0/1561263750 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f1724085c70 con 0x7f17340d1590 2024-09-19T05:44:51.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.832+0000 7f173259c640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17200678f0 0x7f1720069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:51.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.832+0000 7f173259c640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17200678f0 0x7f1720069db0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f17341595f0 tx=0x7f1728009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:51.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:51.836+0000 7f171b7fe640 1 -- 172.21.15.67:0/1561263750 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f17240566b0 con 0x7f17340d1590 2024-09-19T05:44:52.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.052+0000 7f17391ff640 1 -- 172.21.15.67:0/1561263750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f17340d37a0 con 0x7f17340d1590 2024-09-19T05:44:52.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.056+0000 7f171b7fe640 1 -- 172.21.15.67:0/1561263750 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7f1724055fb0 con 0x7f17340d1590 2024-09-19T05:44:52.057 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:44:52.057 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:44:52.057 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:44:52.057 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:44:52.057 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:44:52.057 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:44:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 -- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17200678f0 msgr2=0x7f1720069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17200678f0 0x7f1720069db0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f17341595f0 tx=0x7f1728009040 comp rx=0 tx=0).stop 2024-09-19T05:44:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 -- 172.21.15.67:0/1561263750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17340d1590 msgr2=0x7f1734159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17340d1590 0x7f1734159660 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f172400e870 tx=0x7f172400ec70 comp rx=0 tx=0).stop 2024-09-19T05:44:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 -- 172.21.15.67:0/1561263750 shutdown_connections 2024-09-19T05:44:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17200678f0 0x7f1720069db0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f173415e690 0x7f17340cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17340d4fb0 0x7f17341539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 --2- 172.21.15.67:0/1561263750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17340d1590 0x7f1734159660 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 -- 172.21.15.67:0/1561263750 >> 172.21.15.67:0/1561263750 conn(0x7f17340d4490 msgr2=0x7f17340d4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:52.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 -- 172.21.15.67:0/1561263750 shutdown_connections 2024-09-19T05:44:52.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.060+0000 7f17391ff640 1 -- 172.21.15.67:0/1561263750 wait complete. 2024-09-19T05:44:52.075 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:44:52.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.192+0000 7f2d3be02640 1 Processor -- start 2024-09-19T05:44:52.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.192+0000 7f2d3be02640 1 -- start start 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2d3415e330 0x7f2d34071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2d340b2fd0 0x7f2d340724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d340b4420 con 0x7f2d340b4bc0 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2d340acfb0 con 0x7f2d340b2fd0 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2d340b3ef0 con 0x7f2d3415e330 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3939d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2d340b2fd0 0x7f2d340724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3a39f640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2d340b4bc0 0x7f2d34161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44604/0 (socket says 172.21.15.67:44604) 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3a39f640 1 -- 172.21.15.67:0/2342291028 learned_addr learned my addr 172.21.15.67:0/2342291028 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d39b9e640 1 --2- 172.21.15.67:0/2342291028 >> v2:172.21.15.97:3300/0 conn(0x7f2d3415e330 0x7f2d34071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3939d640 1 -- 172.21.15.67:0/2342291028 >> v2:172.21.15.97:3300/0 conn(0x7f2d3415e330 msgr2=0x7f2d34071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3939d640 1 --2- 172.21.15.67:0/2342291028 >> v2:172.21.15.97:3300/0 conn(0x7f2d3415e330 0x7f2d34071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3939d640 1 -- 172.21.15.67:0/2342291028 >> v1:172.21.15.67:6789/0 conn(0x7f2d340b4bc0 legacy=0x7f2d34161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3939d640 1 -- 172.21.15.67:0/2342291028 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d340b4140 con 0x7f2d340b2fd0 2024-09-19T05:44:52.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d38b9c640 1 -- 172.21.15.67:0/2342291028 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3083474340 0 0) 0x7f2d340b4420 con 0x7f2d340b4bc0 2024-09-19T05:44:52.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d39b9e640 1 --2- 172.21.15.67:0/2342291028 >> v2:172.21.15.97:3300/0 conn(0x7f2d3415e330 0x7f2d34071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:52.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3939d640 1 --2- 172.21.15.67:0/2342291028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d340b2fd0 0x7f2d340724e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f2d340b2d90 tx=0x7f2d2401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41b8813c69aa9c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:52.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d38b9c640 1 -- 172.21.15.67:0/2342291028 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d240b0070 con 0x7f2d340b2fd0 2024-09-19T05:44:52.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d38b9c640 1 -- 172.21.15.67:0/2342291028 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d240ab600 con 0x7f2d340b2fd0 2024-09-19T05:44:52.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d38b9c640 1 -- 172.21.15.67:0/2342291028 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d240ab9d0 con 0x7f2d340b2fd0 2024-09-19T05:44:52.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 -- 172.21.15.67:0/2342291028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d340b2fd0 msgr2=0x7f2d340724e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 --2- 172.21.15.67:0/2342291028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d340b2fd0 0x7f2d340724e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f2d340b2d90 tx=0x7f2d2401c450 comp rx=0 tx=0).stop 2024-09-19T05:44:52.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 -- 172.21.15.67:0/2342291028 shutdown_connections 2024-09-19T05:44:52.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 --2- 172.21.15.67:0/2342291028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d340b2fd0 0x7f2d340724e0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 --2- 172.21.15.67:0/2342291028 >> v2:172.21.15.97:3300/0 conn(0x7f2d3415e330 0x7f2d34071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 -- 172.21.15.67:0/2342291028 >> 172.21.15.67:0/2342291028 conn(0x7f2d340d0080 msgr2=0x7f2d340d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:52.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 -- 172.21.15.67:0/2342291028 shutdown_connections 2024-09-19T05:44:52.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.196+0000 7f2d3be02640 1 -- 172.21.15.67:0/2342291028 wait complete. 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 Processor -- start 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 -- start start 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d340b4bc0 0x7f2d34148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d3415e330 0x7f2d34158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d34158bd0 0x7f2d34151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3406f880 con 0x7f2d3415e330 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3406f700 con 0x7f2d340b4bc0 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2d340cfcc0 con 0x7f2d34158bd0 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3939d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d3415e330 0x7f2d34158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3939d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d3415e330 0x7f2d34158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51586/0 (socket says 172.21.15.67:51586) 2024-09-19T05:44:52.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3939d640 1 -- 172.21.15.67:0/3445783957 learned_addr learned my addr 172.21.15.67:0/3445783957 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d39b9e640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d340b4bc0 0x7f2d34148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3939d640 1 -- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d34158bd0 msgr2=0x7f2d34151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3939d640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d34158bd0 0x7f2d34151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3939d640 1 -- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d340b4bc0 msgr2=0x7f2d34148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3939d640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d340b4bc0 0x7f2d34148490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3939d640 1 -- 172.21.15.67:0/3445783957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d34159090 con 0x7f2d3415e330 2024-09-19T05:44:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3939d640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d3415e330 0x7f2d34158690 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f2d2401a080 tx=0x7f2d240191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d2a7fc640 1 -- 172.21.15.67:0/3445783957 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d240b8020 con 0x7f2d3415e330 2024-09-19T05:44:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d2a7fc640 1 -- 172.21.15.67:0/3445783957 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d240b4630 con 0x7f2d3415e330 2024-09-19T05:44:52.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 -- 172.21.15.67:0/3445783957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d34159370 con 0x7f2d3415e330 2024-09-19T05:44:52.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d2a7fc640 1 -- 172.21.15.67:0/3445783957 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d240b0040 con 0x7f2d3415e330 2024-09-19T05:44:52.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 -- 172.21.15.67:0/3445783957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d34159930 con 0x7f2d3415e330 2024-09-19T05:44:52.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d3be02640 1 -- 172.21.15.67:0/3445783957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d34161f70 con 0x7f2d3415e330 2024-09-19T05:44:52.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.200+0000 7f2d2a7fc640 1 -- 172.21.15.67:0/3445783957 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d240bb020 con 0x7f2d3415e330 2024-09-19T05:44:52.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.204+0000 7f2d2a7fc640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d180678f0 0x7f2d18069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.204+0000 7f2d2a7fc640 1 -- 172.21.15.67:0/3445783957 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f2d2411fb40 con 0x7f2d3415e330 2024-09-19T05:44:52.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.204+0000 7f2d39b9e640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d180678f0 0x7f2d18069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.204+0000 7f2d39b9e640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d180678f0 0x7f2d18069db0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2d30006fd0 tx=0x7f2d30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:52.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.208+0000 7f2d2a7fc640 1 -- 172.21.15.67:0/3445783957 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2d240c2030 con 0x7f2d3415e330 2024-09-19T05:44:52.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.400+0000 7f2d3be02640 1 -- 172.21.15.67:0/3445783957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d34161ce0 con 0x7f2d3415e330 2024-09-19T05:44:52.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.400+0000 7f2d2a7fc640 1 -- 172.21.15.67:0/3445783957 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7f2d24016070 con 0x7f2d3415e330 2024-09-19T05:44:52.402 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:44:52.403 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:44:52.403 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:44:52.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 -- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d180678f0 msgr2=0x7f2d18069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d180678f0 0x7f2d18069db0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2d30006fd0 tx=0x7f2d30008040 comp rx=0 tx=0).stop 2024-09-19T05:44:52.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 -- 172.21.15.67:0/3445783957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d3415e330 msgr2=0x7f2d34158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d3415e330 0x7f2d34158690 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f2d2401a080 tx=0x7f2d240191f0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 -- 172.21.15.67:0/3445783957 shutdown_connections 2024-09-19T05:44:52.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2d180678f0 0x7f2d18069db0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d34158bd0 0x7f2d34151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d3415e330 0x7f2d34158690 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 --2- 172.21.15.67:0/3445783957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d340b4bc0 0x7f2d34148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 -- 172.21.15.67:0/3445783957 >> 172.21.15.67:0/3445783957 conn(0x7f2d340d0080 msgr2=0x7f2d3415ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:52.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 -- 172.21.15.67:0/3445783957 shutdown_connections 2024-09-19T05:44:52.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.404+0000 7f2d3be02640 1 -- 172.21.15.67:0/3445783957 wait complete. 2024-09-19T05:44:52.580 INFO:tasks.ceph.mds.b.smithi097.stderr:2024-09-19T05:44:52.581+0000 7f542ce33640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:44:52.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 106, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:44:46.335183+0000', 'modified': '2024-09-19T05:44:49.571001+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9066}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9066': {'gid': 9066, 'name': 'b', 'rank': 0, 'incarnation': 102, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6835/2824250574', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6834', 'nonce': 2824250574}, {'type': 'v1', 'addr': '172.21.15.97:6835', 'nonce': 2824250574}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9066, 'qdb_cluster': [9066]} 2024-09-19T05:44:52.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:44:52.822 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-19T05:44:52.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7fecbb8aa640 1 Processor -- start 2024-09-19T05:44:52.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7fecbb8aa640 1 -- start start 2024-09-19T05:44:52.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7fecbb8aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fecb415e330 0x7fecb4071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7fecbb8aa640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb40b4420 con 0x7fecb40b2fd0 2024-09-19T05:44:52.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7fecbb8aa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb4162d90 con 0x7fecb40b4bc0 2024-09-19T05:44:52.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7fecbb8aa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fecb40acfb0 con 0x7fecb415e330 2024-09-19T05:44:52.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7fecb8e45640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fecb40b2fd0 0x7fecb4161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44618/0 (socket says 172.21.15.67:44618) 2024-09-19T05:44:52.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7fecb8e45640 1 -- 172.21.15.67:0/3467574208 learned_addr learned my addr 172.21.15.67:0/3467574208 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:44:52.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7fecb9646640 1 --2- 172.21.15.67:0/3467574208 >> v2:172.21.15.97:3300/0 conn(0x7fecb415e330 0x7fecb4071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755393458 0 0) 0x7fecb40b4420 con 0x7fecb40b2fd0 2024-09-19T05:44:52.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feca0003530 con 0x7fecb40b2fd0 2024-09-19T05:44:52.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2058205522 0 0) 0x7feca0003530 con 0x7fecb40b2fd0 2024-09-19T05:44:52.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 >> v2:172.21.15.97:3300/0 conn(0x7fecb415e330 msgr2=0x7fecb4071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:52.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 --2- 172.21.15.67:0/3467574208 >> v2:172.21.15.97:3300/0 conn(0x7fecb415e330 0x7fecb4071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 >> v1:172.21.15.97:6789/0 conn(0x7fecb40b4bc0 legacy=0x7fecb4162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb40b4140 con 0x7fecb40b2fd0 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fecb0001680 con 0x7fecb40b2fd0 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 >> v1:172.21.15.67:6789/0 conn(0x7fecb40b2fd0 legacy=0x7fecb4161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7feca0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feca0004810 0x7feca0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feca00051d0 0x7feca000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feca000c040 con 0x7feca00039c0 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7feca000c1f0 con 0x7feca0004810 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.956+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7feca000c3f0 con 0x7feca00051d0 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecb9646640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7feca0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecb9e47640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feca00051d0 0x7feca000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecb8e45640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feca0004810 0x7feca0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecb9646640 1 -- 172.21.15.67:0/3467574208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feca00051d0 msgr2=0x7feca000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:52.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecb9646640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feca00051d0 0x7feca000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecb9646640 1 -- 172.21.15.67:0/3467574208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feca0004810 msgr2=0x7feca0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:52.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecb9646640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feca0004810 0x7feca0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecb9646640 1 -- 172.21.15.67:0/3467574208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca0003530 con 0x7feca00039c0 2024-09-19T05:44:52.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecb9e47640 1 -- 172.21.15.67:0/3467574208 reap_dead start 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecb9646640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7feca0003de0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7feca8009ae0 tx=0x7feca801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121c61f342543f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca80b2070 con 0x7feca00039c0 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca80a5550 con 0x7feca00039c0 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7feca7fff640 1 -- 172.21.15.67:0/3467574208 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca80096b0 con 0x7feca00039c0 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecbb8aa640 1 -- 172.21.15.67:0/3467574208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 msgr2=0x7feca0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecbb8aa640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7feca0003de0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7feca8009ae0 tx=0x7feca801ca90 comp rx=0 tx=0).stop 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecbb8aa640 1 -- 172.21.15.67:0/3467574208 shutdown_connections 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecbb8aa640 1 --2- 172.21.15.67:0/3467574208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7feca0003de0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecbb8aa640 1 -- 172.21.15.67:0/3467574208 >> 172.21.15.67:0/3467574208 conn(0x7fecb40d0080 msgr2=0x7fecb40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecbb8aa640 1 -- 172.21.15.67:0/3467574208 shutdown_connections 2024-09-19T05:44:52.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.960+0000 7fecbb8aa640 1 -- 172.21.15.67:0/3467574208 wait complete. 2024-09-19T05:44:52.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecbb8aa640 1 Processor -- start 2024-09-19T05:44:52.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecbb8aa640 1 -- start start 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecbb8aa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7fecb415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecbb8aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fecb415d200 0x7fecb414f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecbb8aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fecb4151850 0x7fecb4151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecbb8aa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fecb40cfe40 con 0x7feca00039c0 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecbb8aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fecb40cfcc0 con 0x7fecb4151850 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecbb8aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fecb4161f70 con 0x7fecb415d200 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9646640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7fecb415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9646640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7fecb415c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51606/0 (socket says 172.21.15.67:51606) 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9646640 1 -- 172.21.15.67:0/1844923242 learned_addr learned my addr 172.21.15.67:0/1844923242 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9646640 1 -- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fecb415d200 msgr2=0x7fecb414f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9646640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fecb415d200 0x7fecb414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9646640 1 -- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fecb4151850 msgr2=0x7fecb4151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9e47640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fecb4151850 0x7fecb4151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9646640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fecb4151850 0x7fecb4151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9646640 1 -- 172.21.15.67:0/1844923242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb415d680 con 0x7feca00039c0 2024-09-19T05:44:52.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9e47640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fecb4151850 0x7fecb4151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:52.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecb9646640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7fecb415c1d0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7feca801c8c0 tx=0x7feca8019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:52.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7feca5ffb640 1 -- 172.21.15.67:0/1844923242 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca80b2040 con 0x7feca00039c0 2024-09-19T05:44:52.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7feca5ffb640 1 -- 172.21.15.67:0/1844923242 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca800f000 con 0x7feca00039c0 2024-09-19T05:44:52.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecbb8aa640 1 -- 172.21.15.67:0/1844923242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb415c7b0 con 0x7feca00039c0 2024-09-19T05:44:52.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7feca5ffb640 1 -- 172.21.15.67:0/1844923242 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8004020 con 0x7feca00039c0 2024-09-19T05:44:52.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7fecbb8aa640 1 -- 172.21.15.67:0/1844923242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb41eae80 con 0x7feca00039c0 2024-09-19T05:44:52.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.964+0000 7feca5ffb640 1 -- 172.21.15.67:0/1844923242 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feca80bf030 con 0x7feca00039c0 2024-09-19T05:44:52.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7feca5ffb640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec980678f0 0x7fec98069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7feca5ffb640 1 -- 172.21.15.67:0/1844923242 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7feca811f990 con 0x7feca00039c0 2024-09-19T05:44:52.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec980678f0 0x7fec98069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 Processor -- start 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 -- start start 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec980678f0 0x7fec98069db0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fecb0001210 tx=0x7fecb0001120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126769f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12671fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126720290 0x55f126720670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f126607b60 con 0x55f12676a440 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f12656ec70 con 0x55f126769b20 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f126514ed0 con 0x55f126720290 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12671fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12671fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51610/0 (socket says 172.21.15.67:51610) 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 -- 172.21.15.67:0/3903267653 learned_addr learned my addr 172.21.15.67:0/3903267653 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:52.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb9646640 1 --2- 172.21.15.67:0/3903267653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126769f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb9e47640 1 --2- 172.21.15.67:0/3903267653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126720290 0x55f126720670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 -- 172.21.15.67:0/3903267653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126720290 msgr2=0x55f126720670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 --2- 172.21.15.67:0/3903267653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126720290 0x55f126720670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 -- 172.21.15.67:0/3903267653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 msgr2=0x55f126769f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 --2- 172.21.15.67:0/3903267653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126769f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 -- 172.21.15.67:0/3903267653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f126526e50 con 0x55f12676a440 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb9e47640 1 --2- 172.21.15.67:0/3903267653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126720290 0x55f126720670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecb8e45640 1 --2- 172.21.15.67:0/3903267653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12671fd50 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fecb40512d0 tx=0x7fecb0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb445bcc1cc3db4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fec9effd640 1 -- 172.21.15.67:0/3903267653 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0015580 con 0x55f12676a440 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fec9effd640 1 -- 172.21.15.67:0/3903267653 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb0015720 con 0x55f12676a440 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fec9effd640 1 -- 172.21.15.67:0/3903267653 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0015af0 con 0x55f12676a440 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 -- 172.21.15.67:0/3903267653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 msgr2=0x55f12671fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 --2- 172.21.15.67:0/3903267653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12671fd50 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fecb40512d0 tx=0x7fecb0012000 comp rx=0 tx=0).stop 2024-09-19T05:44:52.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 -- 172.21.15.67:0/3903267653 shutdown_connections 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 --2- 172.21.15.67:0/3903267653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126720290 0x55f126720670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 --2- 172.21.15.67:0/3903267653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12671fd50 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 --2- 172.21.15.67:0/3903267653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126769f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 -- 172.21.15.67:0/3903267653 >> 172.21.15.67:0/3903267653 conn(0x55f126726600 msgr2=0x55f12671e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 -- 172.21.15.67:0/3903267653 shutdown_connections 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.968+0000 7fecbe966000 1 -- 172.21.15.67:0/3903267653 wait complete. 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 -- start start 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 Processor -- start 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126724df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12672acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f12672b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f1265d0b00 con 0x55f12676a440 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f126549360 con 0x55f126769b20 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f1265462d0 con 0x55f126725330 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 10 client.0 _ll_register_callbacks cb 0x55f12670b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb8e45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12672acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb8e45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12672acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51618/0 (socket says 172.21.15.67:51618) 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb8e45640 1 -- 172.21.15.67:0/2773905037 learned_addr learned my addr 172.21.15.67:0/2773905037 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb9646640 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126724df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb9e47640 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f12672b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb8e45640 1 -- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 msgr2=0x55f12672b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb8e45640 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f12672b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb8e45640 1 -- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 msgr2=0x55f126724df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb8e45640 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126724df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb8e45640 1 -- 172.21.15.67:0/2773905037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f126515120 con 0x55f12676a440 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb9e47640 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f12672b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb8e45640 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12672acf0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fecb0001ec0 tx=0x7fecb0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabbc614b0a71fde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fec93fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fec93fff640 1 -- 172.21.15.67:0/2773905037 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb002d480 con 0x55f12676a440 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fec93fff640 1 -- 172.21.15.67:0/2773905037 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fecb002d620 con 0x55f12676a440 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 -- 172.21.15.67:0/2773905037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecb0015720 con 0x55f12676a440 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fec93fff640 1 -- 172.21.15.67:0/2773905037 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fecb0035050 con 0x55f12676a440 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 10 client.9189 fetch_fsmap learned FSMap version 106 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 -- 172.21.15.67:0/2773905037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55f12650e450 con 0x55f12676a440 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fec93fff640 1 -- 172.21.15.67:0/2773905037 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb0015720 con 0x55f12676a440 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fec93fff640 1 -- 172.21.15.67:0/2773905037 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fecb0038020 con 0x55f12676a440 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 10 client.9189 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 10 client.9189 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T05:44:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 20 client.9189 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:52.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f126778280 0x55f12677a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 4 client.9189 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:44:52.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecbe966000 1 -- 172.21.15.67:0/2773905037 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f126508c00 con 0x55f126778280 2024-09-19T05:44:52.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb9646640 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f126778280 0x55f12677a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fecb9646640 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f126778280 0x55f12677a670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b252e938795217f0 server_cookie=e9754b1781587ce6 in_seq=0 out_seq=0 2024-09-19T05:44:52.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.972+0000 7fec93fff640 10 client.9189 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:44:52.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fec93fff640 1 -- 172.21.15.67:0/2773905037 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f126508c00 con 0x55f126778280 2024-09-19T05:44:52.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fec93fff640 10 client.9189 handle_command_reply: tid=0 2024-09-19T05:44:52.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 client.9189 shutdown 2024-09-19T05:44:52.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 -- 172.21.15.67:0/2773905037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 msgr2=0x55f12672acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:52.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12672acf0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fecb0001ec0 tx=0x7fecb0011000 comp rx=0 tx=0).stop 2024-09-19T05:44:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 -- 172.21.15.67:0/2773905037 shutdown_connections 2024-09-19T05:44:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f126778280 0x55f12677a670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f12672b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12672acf0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 --2- 172.21.15.67:0/2773905037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126724df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fec93fff640 0 client.9189 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:44:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 -- 172.21.15.67:0/2773905037 >> 172.21.15.67:0/2773905037 conn(0x55f126720290 msgr2=0x55f12671ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 -- 172.21.15.67:0/2773905037 shutdown_connections 2024-09-19T05:44:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 1 -- 172.21.15.67:0/2773905037 wait complete. 2024-09-19T05:44:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.976+0000 7fecbe966000 20 client.9189 trim_cache size 0 max 16384 2024-09-19T05:44:52.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.992+0000 7fecbe966000 1 Processor -- start 2024-09-19T05:44:52.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.992+0000 7fecbe966000 1 -- start start 2024-09-19T05:44:52.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f126768c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126769170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12677a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fecb4203790 con 0x55f12676a440 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fecb415b3a0 con 0x55f126769b20 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fecb4203140 con 0x55f126725330 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12677a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12677a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51630/0 (socket says 172.21.15.67:51630) 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 -- 172.21.15.67:0/3575039178 learned_addr learned my addr 172.21.15.67:0/3575039178 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb8e45640 1 --2- 172.21.15.67:0/3575039178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126769170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 -- 172.21.15.67:0/3575039178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 msgr2=0x55f126768c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 --2- 172.21.15.67:0/3575039178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f126768c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 -- 172.21.15.67:0/3575039178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 msgr2=0x55f126769170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 --2- 172.21.15.67:0/3575039178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126769170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 -- 172.21.15.67:0/3575039178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1264f5fd0 con 0x55f12676a440 2024-09-19T05:44:52.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 --2- 172.21.15.67:0/3575039178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12677a670 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fecb40afbf0 tx=0x7fecac002020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68707ee3c1ad365 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fec9e7fc640 1 -- 172.21.15.67:0/3575039178 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac003980 con 0x55f12676a440 2024-09-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fec9e7fc640 1 -- 172.21.15.67:0/3575039178 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecac003b40 con 0x55f12676a440 2024-09-19T05:44:52.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fec9e7fc640 1 -- 172.21.15.67:0/3575039178 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac0117e0 con 0x55f12676a440 2024-09-19T05:44:53.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- 172.21.15.67:0/3575039178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 msgr2=0x55f12677a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 --2- 172.21.15.67:0/3575039178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12677a670 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fecb40afbf0 tx=0x7fecac002020 comp rx=0 tx=0).stop 2024-09-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- 172.21.15.67:0/3575039178 shutdown_connections 2024-09-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 --2- 172.21.15.67:0/3575039178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f12676a440 0x55f12677a670 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 --2- 172.21.15.67:0/3575039178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f126769b20 0x55f126769170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 --2- 172.21.15.67:0/3575039178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f126768c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- 172.21.15.67:0/3575039178 >> 172.21.15.67:0/3575039178 conn(0x55f126720290 msgr2=0x55f1267245f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- 172.21.15.67:0/3575039178 shutdown_connections 2024-09-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- 172.21.15.67:0/3575039178 wait complete. 2024-09-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- start start 2024-09-19T05:44:53.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 Processor -- start 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f12677d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f126769b20 0x55f126798960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f12676a440 0x55f126798ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f12656df80 con 0x55f126769b20 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f126526ca0 con 0x55f12676a440 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f1265732a0 con 0x55f126725330 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecbe966000 10 client.0 _ll_register_callbacks cb 0x7fecb0001d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb8e45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f126769b20 0x55f126798960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb8e45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f126769b20 0x55f126798960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51634/0 (socket says 172.21.15.67:51634) 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb8e45640 1 -- 172.21.15.67:0/3809553619 learned_addr learned my addr 172.21.15.67:0/3809553619 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f12676a440 0x55f126798ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9646640 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f12677d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:53.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb8e45640 1 -- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 msgr2=0x55f12677d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb8e45640 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f12677d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb8e45640 1 -- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f12676a440 msgr2=0x55f126798ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb8e45640 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f12676a440 0x55f126798ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb8e45640 1 -- 172.21.15.67:0/3809553619 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1265f1750 con 0x55f126769b20 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:52.996+0000 7fecb9e47640 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f12676a440 0x55f126798ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecb8e45640 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f126769b20 0x55f126798960 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fecb000efe0 tx=0x7fecb001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24616992dd2f2476 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fec93fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fec93fff640 1 -- 172.21.15.67:0/3809553619 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb003e060 con 0x55f126769b20 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fec93fff640 1 -- 172.21.15.67:0/3809553619 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fecb0016030 con 0x55f126769b20 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 -- 172.21.15.67:0/3809553619 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecac003b40 con 0x55f126769b20 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fec93fff640 1 -- 172.21.15.67:0/3809553619 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fecb0044050 con 0x55f126769b20 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 10 client.9195 fetch_fsmap learned FSMap version 106 2024-09-19T05:44:53.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 -- 172.21.15.67:0/3809553619 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55f1264fca30 con 0x55f126769b20 2024-09-19T05:44:53.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fec93fff640 1 -- 172.21.15.67:0/3809553619 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecac003b40 con 0x55f126769b20 2024-09-19T05:44:53.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fec93fff640 1 -- 172.21.15.67:0/3809553619 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fecb0047020 con 0x55f126769b20 2024-09-19T05:44:53.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 10 client.9195 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:44:53.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 10 client.9195 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T05:44:53.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 20 client.9195 populate_metadata read hostname 'smithi067' 2024-09-19T05:44:53.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f1267993e0 0x55f1267dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:53.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 4 client.9195 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:44:53.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 -- 172.21.15.67:0/3809553619 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "status"}) -- 0x55f12657c3a0 con 0x55f1267993e0 2024-09-19T05:44:53.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecb9646640 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f1267993e0 0x55f1267dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fec93fff640 10 client.9195 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecb9646640 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f1267993e0 0x55f1267dcc00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df9ec8d6e4b1964 server_cookie=750620db7697923b in_seq=0 out_seq=0 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fec93fff640 1 -- 172.21.15.67:0/3809553619 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55f12657c3a0 con 0x55f1267993e0 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fec93fff640 10 client.9195 handle_command_reply: tid=0 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 client.9195 shutdown 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 -- 172.21.15.67:0/3809553619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f126769b20 msgr2=0x55f126798960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f126769b20 0x55f126798960 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fecb000efe0 tx=0x7fecb001d000 comp rx=0 tx=0).stop 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 -- 172.21.15.67:0/3809553619 shutdown_connections 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f1267993e0 0x55f1267dcc00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f12676a440 0x55f126798ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fec93fff640 0 client.9195 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f126769b20 0x55f126798960 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 --2- 172.21.15.67:0/3809553619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f126725330 0x55f12677d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 -- 172.21.15.67:0/3809553619 >> 172.21.15.67:0/3809553619 conn(0x55f126720290 msgr2=0x55f126767c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:53.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 -- 172.21.15.67:0/3809553619 shutdown_connections 2024-09-19T05:44:53.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 1 -- 172.21.15.67:0/3809553619 wait complete. 2024-09-19T05:44:53.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbe966000 20 client.9195 trim_cache size 0 max 16384 2024-09-19T05:44:53.007 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:44:53.007 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:44:53.007 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:44:53.007 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 9066, 2024-09-19T05:44:53.007 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:44:53.008 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:44:53.008 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:44:53.008 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 5.81546889, 2024-09-19T05:44:53.008 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 106, 2024-09-19T05:44:53.008 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 155, 2024-09-19T05:44:53.008 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 155, 2024-09-19T05:44:53.008 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 11.275396367999999 2024-09-19T05:44:53.008 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:44:53.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 -- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec980678f0 msgr2=0x7fec98069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:53.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec980678f0 0x7fec98069db0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fecb0001210 tx=0x7fecb0001120 comp rx=0 tx=0).stop 2024-09-19T05:44:53.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 -- 172.21.15.67:0/1844923242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 msgr2=0x7fecb415c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:53.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7fecb415c1d0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7feca801c8c0 tx=0x7feca8019830 comp rx=0 tx=0).stop 2024-09-19T05:44:53.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 -- 172.21.15.67:0/1844923242 shutdown_connections 2024-09-19T05:44:53.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fecb4151850 0x7fecb4151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fec980678f0 0x7fec98069db0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fecb415d200 0x7fecb414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 --2- 172.21.15.67:0/1844923242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca00039c0 0x7fecb415c1d0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 -- 172.21.15.67:0/1844923242 >> 172.21.15.67:0/1844923242 conn(0x7fecb40d0080 msgr2=0x7fecb40adae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:53.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 -- 172.21.15.67:0/1844923242 shutdown_connections 2024-09-19T05:44:53.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.000+0000 7fecbb8aa640 1 -- 172.21.15.67:0/1844923242 wait complete. 2024-09-19T05:44:53.017 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:44:53.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030f2a1640 1 Processor -- start 2024-09-19T05:44:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030f2a1640 1 -- start start 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030f2a1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f03080b2fd0 0x7f030806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030f2a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03080726b0 0x7f030806ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030f2a1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03080b4420 con 0x7f030815e330 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030f2a1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f03080acfb0 con 0x7f03080b2fd0 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030f2a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f03080b3ef0 con 0x7f03080726b0 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030c83c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f03080b2fd0 0x7f030806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030c83c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f03080b2fd0 0x7f030806e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51642/0 (socket says 172.21.15.67:51642) 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030c83c640 1 -- 172.21.15.67:0/1795675733 learned_addr learned my addr 172.21.15.67:0/1795675733 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030d83e640 1 --2- 172.21.15.67:0/1795675733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03080726b0 0x7f030806ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030c83c640 1 -- 172.21.15.67:0/1795675733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03080726b0 msgr2=0x7f030806ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030c83c640 1 --2- 172.21.15.67:0/1795675733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03080726b0 0x7f030806ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030c83c640 1 -- 172.21.15.67:0/1795675733 >> v1:172.21.15.97:6789/0 conn(0x7f030815e330 legacy=0x7f0308071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030c83c640 1 -- 172.21.15.67:0/1795675733 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03080b4140 con 0x7f03080b2fd0 2024-09-19T05:44:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.128+0000 7f030c83c640 1 --2- 172.21.15.67:0/1795675733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03080b2fd0 0x7f030806e6f0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009870 tx=0x7f02f801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54dc6875515d2e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f02fffff640 1 -- 172.21.15.67:0/1795675733 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f80a95f0 con 0x7f03080b2fd0 2024-09-19T05:44:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f02fffff640 1 -- 172.21.15.67:0/1795675733 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f80a9790 con 0x7f03080b2fd0 2024-09-19T05:44:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f02fffff640 1 -- 172.21.15.67:0/1795675733 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f80a9b60 con 0x7f03080b2fd0 2024-09-19T05:44:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- 172.21.15.67:0/1795675733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03080b2fd0 msgr2=0x7f030806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 --2- 172.21.15.67:0/1795675733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03080b2fd0 0x7f030806e6f0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009870 tx=0x7f02f801c530 comp rx=0 tx=0).stop 2024-09-19T05:44:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- 172.21.15.67:0/1795675733 shutdown_connections 2024-09-19T05:44:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 --2- 172.21.15.67:0/1795675733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03080726b0 0x7f030806ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 --2- 172.21.15.67:0/1795675733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03080b2fd0 0x7f030806e6f0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- 172.21.15.67:0/1795675733 >> 172.21.15.67:0/1795675733 conn(0x7f03080d0080 msgr2=0x7f03080d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:53.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- 172.21.15.67:0/1795675733 shutdown_connections 2024-09-19T05:44:53.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- 172.21.15.67:0/1795675733 wait complete. 2024-09-19T05:44:53.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 Processor -- start 2024-09-19T05:44:53.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- start start 2024-09-19T05:44:53.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03080726b0 0x7f03081612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:53.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f030815e330 0x7f030814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:53.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03080af0e0 0x7f030814f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:53.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f03080cfe40 con 0x7f030815e330 2024-09-19T05:44:53.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f03080cfcc0 con 0x7f03080af0e0 2024-09-19T05:44:53.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f030816b310 con 0x7f03080726b0 2024-09-19T05:44:53.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030c83c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f030815e330 0x7f030814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030c83c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f030815e330 0x7f030814ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51646/0 (socket says 172.21.15.67:51646) 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030c83c640 1 -- 172.21.15.67:0/2643143526 learned_addr learned my addr 172.21.15.67:0/2643143526 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030d03d640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03080726b0 0x7f03081612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030d83e640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03080af0e0 0x7f030814f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030c83c640 1 -- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03080726b0 msgr2=0x7f03081612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030c83c640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03080726b0 0x7f03081612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030c83c640 1 -- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03080af0e0 msgr2=0x7f030814f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030c83c640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03080af0e0 0x7f030814f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030c83c640 1 -- 172.21.15.67:0/2643143526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030815ec00 con 0x7f030815e330 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030c83c640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f030815e330 0x7f030814ef60 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f02f801cdd0 tx=0x7f02f801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f02fdffb640 1 -- 172.21.15.67:0/2643143526 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f80a95f0 con 0x7f030815e330 2024-09-19T05:44:53.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f02fdffb640 1 -- 172.21.15.67:0/2643143526 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f80b1800 con 0x7f030815e330 2024-09-19T05:44:53.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- 172.21.15.67:0/2643143526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030815eee0 con 0x7f030815e330 2024-09-19T05:44:53.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f02fdffb640 1 -- 172.21.15.67:0/2643143526 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f80b1bf0 con 0x7f030815e330 2024-09-19T05:44:53.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.132+0000 7f030f2a1640 1 -- 172.21.15.67:0/2643143526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030815f4a0 con 0x7f030815e330 2024-09-19T05:44:53.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.136+0000 7f030f2a1640 1 -- 172.21.15.67:0/2643143526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030815f6e0 con 0x7f030815e330 2024-09-19T05:44:53.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.136+0000 7f02fdffb640 1 -- 172.21.15.67:0/2643143526 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02f80c43f0 con 0x7f030815e330 2024-09-19T05:44:53.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.136+0000 7f02fdffb640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02ec0678c0 0x7f02ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:53.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.136+0000 7f02fdffb640 1 -- 172.21.15.67:0/2643143526 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f02f81204d0 con 0x7f030815e330 2024-09-19T05:44:53.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.136+0000 7f030d03d640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02ec0678c0 0x7f02ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:53.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.136+0000 7f030d03d640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02ec0678c0 0x7f02ec069d80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f03040015b0 tx=0x7f0304009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:53.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.140+0000 7f02fdffb640 1 -- 172.21.15.67:0/2643143526 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f02f80ad020 con 0x7f030815e330 2024-09-19T05:44:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.340+0000 7f030f2a1640 1 -- 172.21.15.67:0/2643143526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0308071fa0 con 0x7f030815e330 2024-09-19T05:44:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.340+0000 7f02fdffb640 1 -- 172.21.15.67:0/2643143526 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v106) ==== 53+0+73 (secure 0 0 0) 0x7f02f8016150 con 0x7f030815e330 2024-09-19T05:44:53.342 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:44:53.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 -- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02ec0678c0 msgr2=0x7f02ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:53.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02ec0678c0 0x7f02ec069d80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f03040015b0 tx=0x7f0304009040 comp rx=0 tx=0).stop 2024-09-19T05:44:53.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 -- 172.21.15.67:0/2643143526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f030815e330 msgr2=0x7f030814ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:53.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f030815e330 0x7f030814ef60 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f02f801cdd0 tx=0x7f02f801ad70 comp rx=0 tx=0).stop 2024-09-19T05:44:53.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 -- 172.21.15.67:0/2643143526 shutdown_connections 2024-09-19T05:44:53.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03080af0e0 0x7f030814f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f030815e330 0x7f030814ef60 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f02ec0678c0 0x7f02ec069d80 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 --2- 172.21.15.67:0/2643143526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03080726b0 0x7f03081612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:53.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 -- 172.21.15.67:0/2643143526 >> 172.21.15.67:0/2643143526 conn(0x7f03080d0080 msgr2=0x7f03081545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:53.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 -- 172.21.15.67:0/2643143526 shutdown_connections 2024-09-19T05:44:53.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53.344+0000 7f030f2a1640 1 -- 172.21.15.67:0/2643143526 wait complete. 2024-09-19T05:44:53.360 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:44:53.360 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:44:53.360 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:44:53.360 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:44:53.360 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:44:53.360 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:44:53.360 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:44:53.360 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:44:53.360 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:44:53.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:53.361 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:44:53.367 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:44:53.367 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:44:53.367 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:44:53.367 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:44:53.368 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41811sec preferred_lft 41811sec 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:44:53.369 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:44:53.370 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:44:53.371 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:44:53.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:53.371 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:44:53.425 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:44:53.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:53.427 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:44:53.479 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:44:53.479 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:44:53.479 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:44:53.479 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:44:53.479 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:44:53.479 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:44:53.480 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:44:53.480 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:44:53.480 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:44:53.480 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:44:53.480 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:44:53.480 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:44:53.480 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:53.480 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:44:53.480 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:44:53.481 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:44:53.481 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:53.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:44:53.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:53.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:53.605 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:44:53.611 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:44:53.611 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:44:53.611 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:44:53.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:53.611 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:44:53.667 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:44:53.668 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:44:53.668 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:44:53.719 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:44:53.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:44:53.720 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:44:53.767 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:44:53.829 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:44:53.877 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:44:53.877 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:44:53.877 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:44:53.877 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:44:53.877 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:44:53.878 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:44:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:44:53.880 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:44:53.880 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:44:53.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:53.881 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:44:53.927 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:44:53.927 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:44:53.971 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:44:53.988 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:44:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:44:54.037 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:44:54.037 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:44:54.037 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:44:54.037 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:44:54.038 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:44:54.038 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:44:54.038 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:44:54.038 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:44:54.038 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:44:54.039 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:44:54.039 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:44:54.039 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:44:54.039 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:44:54.039 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:44:54.039 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:44:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:44:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:44:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:44:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:44:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:44:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:44:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:44:54.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:54.040 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:44:54.055 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:44:54.056+0000 7f21b5490580 -1 init, newargv = 0x55d7fa254820 newargc=15 2024-09-19T05:44:54.055 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[79198]: starting ceph client 2024-09-19T05:44:54.062 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[79198]: starting fuse 2024-09-19T05:44:55.160 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:44:55.177 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:44:55.227 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:44:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:44:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:44:55.230 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:44:55.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:55.231 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:44:55.279 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:44:55.279 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:44:55.280 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:44:55.280 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:44:55.280 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:44:55.280 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:44:55.280 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:44:55.280 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:44:55.280 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:44:55.280 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:44:55.280 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:44:55.280 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:44:55.281 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:44:55.282 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:44:55.282 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:44:55.282 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:44:55.282 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:44:55.408 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.79198.asok 2024-09-19T05:44:55.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:55.421 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.79198.asok 2024-09-19T05:44:55.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:55.421 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.79198.asok status 2024-09-19T05:44:55.582 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:44:55.583 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:44:55.583 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:44:55.583 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:44:55.583 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:44:55.583 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:44:55.583 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:44:55.583 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "79198", 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 9207, 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 9207 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:44:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3697458870 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3697458870 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.9207 192.168.0.1:0/3697458870", 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/3697458870", 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 106, 2024-09-19T05:44:55.585 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 155, 2024-09-19T05:44:55.586 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:44:55.586 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:44:55.586 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:44:55.586 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:44:55.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:55.598 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:44:55.598 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:44:55.605 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:44:55.605 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:44:55.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:44:55.605 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:44:55.660 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:55.660 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:55.660 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.0 2024-09-19T05:44:55.660 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:55.660 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:55.660 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:55.660 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:55.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:55.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.797 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147733 s, 71.0 MB/s 2024-09-19T05:44:55.812 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.812 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.812 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112836 s, 92.9 MB/s 2024-09-19T05:44:55.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.833 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.833 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164215 s, 63.9 MB/s 2024-09-19T05:44:55.848 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.849 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119992 s, 87.4 MB/s 2024-09-19T05:44:55.871 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.871 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.872 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186813 s, 56.1 MB/s 2024-09-19T05:44:55.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.892 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155164 s, 67.6 MB/s 2024-09-19T05:44:55.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.913 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170146 s, 61.6 MB/s 2024-09-19T05:44:55.932 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.933 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015761 s, 66.5 MB/s 2024-09-19T05:44:55.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.953 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015328 s, 68.4 MB/s 2024-09-19T05:44:55.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.972 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148979 s, 70.4 MB/s 2024-09-19T05:44:55.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:55.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:55.990 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136468 s, 76.8 MB/s 2024-09-19T05:44:56.006 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.007 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01263 s, 83.0 MB/s 2024-09-19T05:44:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114561 s, 91.5 MB/s 2024-09-19T05:44:56.040 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.040 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.040 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138201 s, 75.9 MB/s 2024-09-19T05:44:56.059 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.059 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.059 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142945 s, 73.4 MB/s 2024-09-19T05:44:56.076 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.076 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.077 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136472 s, 76.8 MB/s 2024-09-19T05:44:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146313 s, 71.7 MB/s 2024-09-19T05:44:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139278 s, 75.3 MB/s 2024-09-19T05:44:56.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.133 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015031 s, 69.8 MB/s 2024-09-19T05:44:56.151 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.151 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.151 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139868 s, 75.0 MB/s 2024-09-19T05:44:56.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136746 s, 76.7 MB/s 2024-09-19T05:44:56.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.188 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015372 s, 68.2 MB/s 2024-09-19T05:44:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138661 s, 75.6 MB/s 2024-09-19T05:44:56.225 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.225 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.225 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143806 s, 72.9 MB/s 2024-09-19T05:44:56.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.244 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141268 s, 74.2 MB/s 2024-09-19T05:44:56.261 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.262 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132926 s, 78.9 MB/s 2024-09-19T05:44:56.280 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.280 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.280 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139069 s, 75.4 MB/s 2024-09-19T05:44:56.299 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.299 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.299 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152389 s, 68.8 MB/s 2024-09-19T05:44:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.314 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.314 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105383 s, 99.5 MB/s 2024-09-19T05:44:56.333 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.333 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.333 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152775 s, 68.6 MB/s 2024-09-19T05:44:56.351 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.351 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.351 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138961 s, 75.5 MB/s 2024-09-19T05:44:56.369 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.369 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.369 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143646 s, 73.0 MB/s 2024-09-19T05:44:56.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:56.378 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:56.379 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:56.379 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.1 2024-09-19T05:44:56.379 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:56.379 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:56.379 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:56.379 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:56.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:56.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111148 s, 94.3 MB/s 2024-09-19T05:44:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013204 s, 79.4 MB/s 2024-09-19T05:44:56.485 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.485 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.485 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121504 s, 86.3 MB/s 2024-09-19T05:44:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126515 s, 82.9 MB/s 2024-09-19T05:44:56.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.518 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121685 s, 86.2 MB/s 2024-09-19T05:44:56.535 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.535 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.535 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131886 s, 79.5 MB/s 2024-09-19T05:44:56.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.553 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138934 s, 75.5 MB/s 2024-09-19T05:44:56.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.571 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140319 s, 74.7 MB/s 2024-09-19T05:44:56.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.589 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135693 s, 77.3 MB/s 2024-09-19T05:44:56.607 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.607 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.607 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137832 s, 76.1 MB/s 2024-09-19T05:44:56.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153808 s, 68.2 MB/s 2024-09-19T05:44:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140221 s, 74.8 MB/s 2024-09-19T05:44:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135423 s, 77.4 MB/s 2024-09-19T05:44:56.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.683 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.683 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014372 s, 73.0 MB/s 2024-09-19T05:44:56.705 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.705 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.705 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146995 s, 71.3 MB/s 2024-09-19T05:44:56.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.718 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115207 s, 91.0 MB/s 2024-09-19T05:44:56.737 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.738 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151232 s, 69.3 MB/s 2024-09-19T05:44:56.758 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.758 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.758 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163617 s, 64.1 MB/s 2024-09-19T05:44:56.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.776 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133963 s, 78.3 MB/s 2024-09-19T05:44:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137265 s, 76.4 MB/s 2024-09-19T05:44:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148999 s, 70.4 MB/s 2024-09-19T05:44:56.830 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.830 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.830 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122878 s, 85.3 MB/s 2024-09-19T05:44:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138045 s, 76.0 MB/s 2024-09-19T05:44:56.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.868 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153504 s, 68.3 MB/s 2024-09-19T05:44:56.886 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.887 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139032 s, 75.4 MB/s 2024-09-19T05:44:56.905 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.905 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.905 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143309 s, 73.2 MB/s 2024-09-19T05:44:56.921 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121836 s, 86.1 MB/s 2024-09-19T05:44:56.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143084 s, 73.3 MB/s 2024-09-19T05:44:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120664 s, 86.9 MB/s 2024-09-19T05:44:56.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129574 s, 80.9 MB/s 2024-09-19T05:44:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138608 s, 75.7 MB/s 2024-09-19T05:44:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128045 s, 81.9 MB/s 2024-09-19T05:44:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:57.019 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:57.019 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:57.019 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.2 2024-09-19T05:44:57.019 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:57.020 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:57.020 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:57.020 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:57.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:57.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.091 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135272 s, 77.5 MB/s 2024-09-19T05:44:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993461 s, 106 MB/s 2024-09-19T05:44:57.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.121 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116395 s, 90.1 MB/s 2024-09-19T05:44:57.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.137 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121718 s, 86.1 MB/s 2024-09-19T05:44:57.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.152 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114413 s, 91.6 MB/s 2024-09-19T05:44:57.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012727 s, 82.4 MB/s 2024-09-19T05:44:57.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.188 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154053 s, 68.1 MB/s 2024-09-19T05:44:57.208 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.208 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.208 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014411 s, 72.8 MB/s 2024-09-19T05:44:57.228 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.228 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.228 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153651 s, 68.2 MB/s 2024-09-19T05:44:57.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.246 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126067 s, 83.2 MB/s 2024-09-19T05:44:57.265 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.269 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146001 s, 71.8 MB/s 2024-09-19T05:44:57.284 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.284 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.284 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140274 s, 74.8 MB/s 2024-09-19T05:44:57.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.304 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.304 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149226 s, 70.3 MB/s 2024-09-19T05:44:57.322 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.322 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.322 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143642 s, 73.0 MB/s 2024-09-19T05:44:57.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.340 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131315 s, 79.9 MB/s 2024-09-19T05:44:57.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.360 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151021 s, 69.4 MB/s 2024-09-19T05:44:57.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.377 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122996 s, 85.3 MB/s 2024-09-19T05:44:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141837 s, 73.9 MB/s 2024-09-19T05:44:57.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.416 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164616 s, 63.7 MB/s 2024-09-19T05:44:57.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143566 s, 73.0 MB/s 2024-09-19T05:44:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133018 s, 78.8 MB/s 2024-09-19T05:44:57.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.473 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152319 s, 68.8 MB/s 2024-09-19T05:44:57.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.492 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160507 s, 65.3 MB/s 2024-09-19T05:44:57.511 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.511 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.511 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146692 s, 71.5 MB/s 2024-09-19T05:44:57.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.529 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133349 s, 78.6 MB/s 2024-09-19T05:44:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013866 s, 75.6 MB/s 2024-09-19T05:44:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145718 s, 72.0 MB/s 2024-09-19T05:44:57.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.584 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143272 s, 73.2 MB/s 2024-09-19T05:44:57.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141327 s, 74.2 MB/s 2024-09-19T05:44:57.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.620 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129027 s, 81.3 MB/s 2024-09-19T05:44:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.640 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.640 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151548 s, 69.2 MB/s 2024-09-19T05:44:57.660 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157342 s, 66.6 MB/s 2024-09-19T05:44:57.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:57.670 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:57.670 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:57.670 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.3 2024-09-19T05:44:57.670 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:57.670 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:57.670 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:57.670 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:57.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:57.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.741 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120949 s, 86.7 MB/s 2024-09-19T05:44:57.757 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.757 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.757 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118771 s, 88.3 MB/s 2024-09-19T05:44:57.775 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.775 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.775 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144916 s, 72.4 MB/s 2024-09-19T05:44:57.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.791 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118477 s, 88.5 MB/s 2024-09-19T05:44:57.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.809 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135861 s, 77.2 MB/s 2024-09-19T05:44:57.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.827 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139376 s, 75.2 MB/s 2024-09-19T05:44:57.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.844 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137055 s, 76.5 MB/s 2024-09-19T05:44:57.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.862 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131726 s, 79.6 MB/s 2024-09-19T05:44:57.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.877 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011896 s, 88.1 MB/s 2024-09-19T05:44:57.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.896 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138428 s, 75.7 MB/s 2024-09-19T05:44:57.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.914 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139668 s, 75.1 MB/s 2024-09-19T05:44:57.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.930 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118664 s, 88.4 MB/s 2024-09-19T05:44:57.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.948 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013158 s, 79.7 MB/s 2024-09-19T05:44:57.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.965 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123936 s, 84.6 MB/s 2024-09-19T05:44:57.985 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:57.985 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:57.985 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152036 s, 69.0 MB/s 2024-09-19T05:44:58.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.003 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144257 s, 72.7 MB/s 2024-09-19T05:44:58.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.023 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014208 s, 73.8 MB/s 2024-09-19T05:44:58.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.043 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156554 s, 67.0 MB/s 2024-09-19T05:44:58.061 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.061 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.061 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143678 s, 73.0 MB/s 2024-09-19T05:44:58.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.080 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144434 s, 72.6 MB/s 2024-09-19T05:44:58.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.098 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134505 s, 78.0 MB/s 2024-09-19T05:44:58.115 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.116 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138612 s, 75.6 MB/s 2024-09-19T05:44:58.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.136 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156287 s, 67.1 MB/s 2024-09-19T05:44:58.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.153 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134854 s, 77.8 MB/s 2024-09-19T05:44:58.170 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.170 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.170 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01284 s, 81.7 MB/s 2024-09-19T05:44:58.187 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.187 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.187 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124465 s, 84.2 MB/s 2024-09-19T05:44:58.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.206 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146987 s, 71.3 MB/s 2024-09-19T05:44:58.223 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.223 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.223 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128455 s, 81.6 MB/s 2024-09-19T05:44:58.242 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.243 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148593 s, 70.6 MB/s 2024-09-19T05:44:58.261 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.261 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.261 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141067 s, 74.3 MB/s 2024-09-19T05:44:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131302 s, 79.9 MB/s 2024-09-19T05:44:58.297 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.297 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.297 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148151 s, 70.8 MB/s 2024-09-19T05:44:58.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:58.306 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:58.306 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:58.306 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.4 2024-09-19T05:44:58.307 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:58.307 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:58.307 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:58.307 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:58.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:58.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.376 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120313 s, 87.2 MB/s 2024-09-19T05:44:58.394 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.394 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.394 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141758 s, 74.0 MB/s 2024-09-19T05:44:58.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140021 s, 74.9 MB/s 2024-09-19T05:44:58.430 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.430 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.430 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109676 s, 95.6 MB/s 2024-09-19T05:44:58.453 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.453 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.453 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186441 s, 56.2 MB/s 2024-09-19T05:44:58.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.472 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014482 s, 72.4 MB/s 2024-09-19T05:44:58.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.492 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149474 s, 70.2 MB/s 2024-09-19T05:44:58.511 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.511 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.511 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143231 s, 73.2 MB/s 2024-09-19T05:44:58.531 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.531 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.531 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153234 s, 68.4 MB/s 2024-09-19T05:44:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139342 s, 75.3 MB/s 2024-09-19T05:44:58.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.568 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138053 s, 76.0 MB/s 2024-09-19T05:44:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139425 s, 75.2 MB/s 2024-09-19T05:44:58.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.604 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.604 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138715 s, 75.6 MB/s 2024-09-19T05:44:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133148 s, 78.8 MB/s 2024-09-19T05:44:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.639 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127858 s, 82.0 MB/s 2024-09-19T05:44:58.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.657 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144849 s, 72.4 MB/s 2024-09-19T05:44:58.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.677 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157482 s, 66.6 MB/s 2024-09-19T05:44:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.694 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126706 s, 82.8 MB/s 2024-09-19T05:44:58.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.711 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129564 s, 80.9 MB/s 2024-09-19T05:44:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016039 s, 65.4 MB/s 2024-09-19T05:44:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136885 s, 76.6 MB/s 2024-09-19T05:44:58.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.769 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148449 s, 70.6 MB/s 2024-09-19T05:44:58.788 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.788 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.788 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142493 s, 73.6 MB/s 2024-09-19T05:44:58.805 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.805 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.805 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133053 s, 78.8 MB/s 2024-09-19T05:44:58.824 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.824 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.824 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142539 s, 73.6 MB/s 2024-09-19T05:44:58.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.843 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150914 s, 69.5 MB/s 2024-09-19T05:44:58.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:58.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:58.861 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132151 s, 79.3 MB/s 2024-09-19T05:44:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.615911 s, 1.7 MB/s 2024-09-19T05:44:59.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.504 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016476 s, 63.6 MB/s 2024-09-19T05:44:59.528 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.529 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171744 s, 61.1 MB/s 2024-09-19T05:44:59.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.546 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151001 s, 69.4 MB/s 2024-09-19T05:44:59.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171236 s, 61.2 MB/s 2024-09-19T05:44:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:44:59.577 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:44:59.577 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:44:59.577 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.5 2024-09-19T05:44:59.577 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:44:59.578 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:44:59.578 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:44:59.578 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:44:59.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:44:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:44:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131244 s, 79.9 MB/s 2024-09-19T05:44:59.713 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.714 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.714 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110015 s, 95.3 MB/s 2024-09-19T05:44:59.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.730 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124906 s, 83.9 MB/s 2024-09-19T05:44:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145292 s, 72.2 MB/s 2024-09-19T05:44:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132723 s, 79.0 MB/s 2024-09-19T05:44:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144738 s, 72.4 MB/s 2024-09-19T05:44:59.803 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.804 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146074 s, 71.8 MB/s 2024-09-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.822 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141136 s, 74.3 MB/s 2024-09-19T05:44:59.838 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.838 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.838 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012063 s, 86.9 MB/s 2024-09-19T05:44:59.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.857 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142516 s, 73.6 MB/s 2024-09-19T05:44:59.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.877 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156488 s, 67.0 MB/s 2024-09-19T05:44:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.892 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.893 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120152 s, 87.3 MB/s 2024-09-19T05:44:59.910 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.911 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.911 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136166 s, 77.0 MB/s 2024-09-19T05:44:59.928 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.929 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133849 s, 78.3 MB/s 2024-09-19T05:44:59.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.946 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.946 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125588 s, 83.5 MB/s 2024-09-19T05:44:59.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.961 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112404 s, 93.3 MB/s 2024-09-19T05:44:59.980 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:44:59.980 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:44:59.980 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147629 s, 71.0 MB/s 2024-09-19T05:44:59.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.000 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145059 s, 72.3 MB/s 2024-09-19T05:45:00.019 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.019 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.019 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147333 s, 71.2 MB/s 2024-09-19T05:45:00.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.039 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150677 s, 69.6 MB/s 2024-09-19T05:45:00.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.056 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.056 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012595 s, 83.3 MB/s 2024-09-19T05:45:00.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.072 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120524 s, 87.0 MB/s 2024-09-19T05:45:00.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.091 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.091 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147902 s, 70.9 MB/s 2024-09-19T05:45:00.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.108 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132791 s, 79.0 MB/s 2024-09-19T05:45:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123944 s, 84.6 MB/s 2024-09-19T05:45:00.145 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.145 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.145 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138782 s, 75.6 MB/s 2024-09-19T05:45:00.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.160 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133708 s, 78.4 MB/s 2024-09-19T05:45:00.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.180 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147828 s, 70.9 MB/s 2024-09-19T05:45:00.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.199 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145047 s, 72.3 MB/s 2024-09-19T05:45:00.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.217 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144765 s, 72.4 MB/s 2024-09-19T05:45:00.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.237 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139011 s, 75.4 MB/s 2024-09-19T05:45:00.256 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.256 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142836 s, 73.4 MB/s 2024-09-19T05:45:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:00.266 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:00.266 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:00.266 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.6 2024-09-19T05:45:00.266 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:00.266 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:00.266 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:00.266 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:00.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:00.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.343 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136252 s, 77.0 MB/s 2024-09-19T05:45:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.359 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109943 s, 95.4 MB/s 2024-09-19T05:45:00.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123462 s, 84.9 MB/s 2024-09-19T05:45:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114704 s, 91.4 MB/s 2024-09-19T05:45:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137191 s, 76.4 MB/s 2024-09-19T05:45:00.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.431 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138973 s, 75.5 MB/s 2024-09-19T05:45:00.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.449 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120144 s, 87.3 MB/s 2024-09-19T05:45:00.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.467 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012786 s, 82.0 MB/s 2024-09-19T05:45:00.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.487 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.487 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136266 s, 77.0 MB/s 2024-09-19T05:45:00.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.507 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014615 s, 71.7 MB/s 2024-09-19T05:45:00.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.526 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.526 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131014 s, 80.0 MB/s 2024-09-19T05:45:00.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.544 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132354 s, 79.2 MB/s 2024-09-19T05:45:00.563 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.563 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.563 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134803 s, 77.8 MB/s 2024-09-19T05:45:00.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.581 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128117 s, 81.8 MB/s 2024-09-19T05:45:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115052 s, 91.1 MB/s 2024-09-19T05:45:00.610 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.610 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.610 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961813 s, 109 MB/s 2024-09-19T05:45:00.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.627 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012685 s, 82.7 MB/s 2024-09-19T05:45:00.643 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.643 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.643 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122432 s, 85.6 MB/s 2024-09-19T05:45:00.659 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.659 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.660 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119403 s, 87.8 MB/s 2024-09-19T05:45:00.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.675 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112361 s, 93.3 MB/s 2024-09-19T05:45:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013931 s, 75.3 MB/s 2024-09-19T05:45:00.710 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.710 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.710 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129285 s, 81.1 MB/s 2024-09-19T05:45:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.728 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128792 s, 81.4 MB/s 2024-09-19T05:45:00.745 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.745 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.745 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134031 s, 78.2 MB/s 2024-09-19T05:45:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.762 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.762 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121146 s, 86.6 MB/s 2024-09-19T05:45:00.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.778 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122999 s, 85.3 MB/s 2024-09-19T05:45:00.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.798 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151041 s, 69.4 MB/s 2024-09-19T05:45:00.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.816 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137227 s, 76.4 MB/s 2024-09-19T05:45:00.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.831 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112144 s, 93.5 MB/s 2024-09-19T05:45:00.850 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.850 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.850 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143396 s, 73.1 MB/s 2024-09-19T05:45:00.867 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.867 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.868 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136613 s, 76.8 MB/s 2024-09-19T05:45:00.885 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.886 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.886 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137552 s, 76.2 MB/s 2024-09-19T05:45:00.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:00.895 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:00.895 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:00.895 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.7 2024-09-19T05:45:00.895 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:00.895 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:00.895 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:00.895 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:00.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126965 s, 82.6 MB/s 2024-09-19T05:45:00.980 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.980 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.980 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101368 s, 103 MB/s 2024-09-19T05:45:00.996 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:00.996 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:00.996 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121144 s, 86.6 MB/s 2024-09-19T05:45:01.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.012 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121003 s, 86.7 MB/s 2024-09-19T05:45:01.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.028 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126186 s, 83.1 MB/s 2024-09-19T05:45:01.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.044 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123662 s, 84.8 MB/s 2024-09-19T05:45:01.060 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.060 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.060 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135948 s, 77.1 MB/s 2024-09-19T05:45:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130556 s, 80.3 MB/s 2024-09-19T05:45:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120111 s, 87.3 MB/s 2024-09-19T05:45:01.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.115 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.115 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129845 s, 80.8 MB/s 2024-09-19T05:45:01.130 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.130 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.130 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111182 s, 94.3 MB/s 2024-09-19T05:45:01.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.149 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143617 s, 73.0 MB/s 2024-09-19T05:45:01.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.168 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.168 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141492 s, 74.1 MB/s 2024-09-19T05:45:01.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.185 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138426 s, 75.7 MB/s 2024-09-19T05:45:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142849 s, 73.4 MB/s 2024-09-19T05:45:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141769 s, 74.0 MB/s 2024-09-19T05:45:01.241 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.241 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.241 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137596 s, 76.2 MB/s 2024-09-19T05:45:01.259 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.259 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.259 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130414 s, 80.4 MB/s 2024-09-19T05:45:01.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.279 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014199 s, 73.8 MB/s 2024-09-19T05:45:01.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.295 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012421 s, 84.4 MB/s 2024-09-19T05:45:01.314 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.314 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.314 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147907 s, 70.9 MB/s 2024-09-19T05:45:01.332 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.332 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.333 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138097 s, 75.9 MB/s 2024-09-19T05:45:01.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.352 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152025 s, 69.0 MB/s 2024-09-19T05:45:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132987 s, 78.8 MB/s 2024-09-19T05:45:01.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.388 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137279 s, 76.4 MB/s 2024-09-19T05:45:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134013 s, 78.2 MB/s 2024-09-19T05:45:01.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.421 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110901 s, 94.6 MB/s 2024-09-19T05:45:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.441 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.441 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147508 s, 71.1 MB/s 2024-09-19T05:45:01.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.460 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.460 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138554 s, 75.7 MB/s 2024-09-19T05:45:01.478 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.478 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.478 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139065 s, 75.4 MB/s 2024-09-19T05:45:01.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.495 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011576 s, 90.6 MB/s 2024-09-19T05:45:01.515 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.515 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.515 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016148 s, 64.9 MB/s 2024-09-19T05:45:01.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:01.525 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:01.525 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:01.525 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.8 2024-09-19T05:45:01.525 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:01.525 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:01.525 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:01.525 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:01.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:01.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.600 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111205 s, 94.3 MB/s 2024-09-19T05:45:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.614 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116809 s, 89.8 MB/s 2024-09-19T05:45:01.632 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.632 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.632 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138858 s, 75.5 MB/s 2024-09-19T05:45:01.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.648 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115527 s, 90.8 MB/s 2024-09-19T05:45:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015196 s, 69.0 MB/s 2024-09-19T05:45:01.684 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.684 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.684 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012295 s, 85.3 MB/s 2024-09-19T05:45:01.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.699 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010892 s, 96.3 MB/s 2024-09-19T05:45:01.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.715 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120802 s, 86.8 MB/s 2024-09-19T05:45:01.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.734 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141245 s, 74.2 MB/s 2024-09-19T05:45:01.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.752 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.752 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127228 s, 82.4 MB/s 2024-09-19T05:45:01.771 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.771 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.771 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153642 s, 68.2 MB/s 2024-09-19T05:45:01.788 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.788 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.788 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125966 s, 83.2 MB/s 2024-09-19T05:45:01.807 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.807 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.807 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138991 s, 75.4 MB/s 2024-09-19T05:45:01.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.827 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146243 s, 71.7 MB/s 2024-09-19T05:45:01.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.844 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126935 s, 82.6 MB/s 2024-09-19T05:45:01.860 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.860 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.861 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124437 s, 84.3 MB/s 2024-09-19T05:45:01.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.876 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118391 s, 88.6 MB/s 2024-09-19T05:45:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137845 s, 76.1 MB/s 2024-09-19T05:45:01.908 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.908 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.908 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115259 s, 91.0 MB/s 2024-09-19T05:45:01.923 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.923 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.923 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101836 s, 103 MB/s 2024-09-19T05:45:01.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.940 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114845 s, 91.3 MB/s 2024-09-19T05:45:01.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.958 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124562 s, 84.2 MB/s 2024-09-19T05:45:01.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.977 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132447 s, 79.2 MB/s 2024-09-19T05:45:01.995 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:01.995 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:01.995 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013063 s, 80.3 MB/s 2024-09-19T05:45:02.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128945 s, 81.3 MB/s 2024-09-19T05:45:02.032 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.032 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.032 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135899 s, 77.2 MB/s 2024-09-19T05:45:02.053 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.054 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154222 s, 68.0 MB/s 2024-09-19T05:45:02.075 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.076 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.076 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164896 s, 63.6 MB/s 2024-09-19T05:45:02.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.167 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203346 s, 51.6 MB/s 2024-09-19T05:45:02.193 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.193 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.193 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162239 s, 64.6 MB/s 2024-09-19T05:45:02.210 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.210 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.210 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134676 s, 77.9 MB/s 2024-09-19T05:45:02.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.231 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157659 s, 66.5 MB/s 2024-09-19T05:45:02.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:02.240 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:02.240 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:02.240 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.9 2024-09-19T05:45:02.240 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:02.241 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:02.241 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:02.241 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:02.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133568 s, 78.5 MB/s 2024-09-19T05:45:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.328 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131798 s, 79.6 MB/s 2024-09-19T05:45:02.346 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.346 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.347 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140811 s, 74.5 MB/s 2024-09-19T05:45:02.362 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.362 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.362 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103764 s, 101 MB/s 2024-09-19T05:45:02.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.379 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125601 s, 83.5 MB/s 2024-09-19T05:45:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.398 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146571 s, 71.5 MB/s 2024-09-19T05:45:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.416 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139206 s, 75.3 MB/s 2024-09-19T05:45:02.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.434 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142358 s, 73.7 MB/s 2024-09-19T05:45:02.454 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.454 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.454 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153981 s, 68.1 MB/s 2024-09-19T05:45:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142351 s, 73.7 MB/s 2024-09-19T05:45:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135558 s, 77.4 MB/s 2024-09-19T05:45:02.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137522 s, 76.2 MB/s 2024-09-19T05:45:02.528 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.528 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.528 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014535 s, 72.1 MB/s 2024-09-19T05:45:02.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.546 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131695 s, 79.6 MB/s 2024-09-19T05:45:02.564 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.564 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.564 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133429 s, 78.6 MB/s 2024-09-19T05:45:02.581 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.581 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.582 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012927 s, 81.1 MB/s 2024-09-19T05:45:02.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.601 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145732 s, 72.0 MB/s 2024-09-19T05:45:02.618 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.618 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.619 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013426 s, 78.1 MB/s 2024-09-19T05:45:02.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150997 s, 69.4 MB/s 2024-09-19T05:45:02.658 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.658 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.659 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014153 s, 74.1 MB/s 2024-09-19T05:45:02.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.676 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140912 s, 74.4 MB/s 2024-09-19T05:45:02.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.693 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012963 s, 80.9 MB/s 2024-09-19T05:45:02.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.711 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132696 s, 79.0 MB/s 2024-09-19T05:45:02.729 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.729 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.729 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128797 s, 81.4 MB/s 2024-09-19T05:45:02.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.750 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.750 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015328 s, 68.4 MB/s 2024-09-19T05:45:02.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.769 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145278 s, 72.2 MB/s 2024-09-19T05:45:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136953 s, 76.6 MB/s 2024-09-19T05:45:02.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.806 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137454 s, 76.3 MB/s 2024-09-19T05:45:02.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.825 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145374 s, 72.1 MB/s 2024-09-19T05:45:02.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.843 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.843 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133489 s, 78.6 MB/s 2024-09-19T05:45:02.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.861 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125415 s, 83.6 MB/s 2024-09-19T05:45:02.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:02.878 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:02.878 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119363 s, 87.8 MB/s 2024-09-19T05:45:02.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:02.886 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:02.887 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:02.887 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.10 2024-09-19T05:45:02.887 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:02.887 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:02.887 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:02.887 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:02.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.007 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128072 s, 81.9 MB/s 2024-09-19T05:45:03.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.021 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962467 s, 109 MB/s 2024-09-19T05:45:03.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.036 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111312 s, 94.2 MB/s 2024-09-19T05:45:03.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.054 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134393 s, 78.0 MB/s 2024-09-19T05:45:03.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.070 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.070 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117963 s, 88.9 MB/s 2024-09-19T05:45:03.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.136 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160589 s, 65.3 MB/s 2024-09-19T05:45:03.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.157 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167447 s, 62.6 MB/s 2024-09-19T05:45:03.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.176 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139288 s, 75.3 MB/s 2024-09-19T05:45:03.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.196 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151917 s, 69.0 MB/s 2024-09-19T05:45:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.214 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128747 s, 81.4 MB/s 2024-09-19T05:45:03.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.231 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123482 s, 84.9 MB/s 2024-09-19T05:45:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140681 s, 74.5 MB/s 2024-09-19T05:45:03.268 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.269 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139748 s, 75.0 MB/s 2024-09-19T05:45:03.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.285 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127073 s, 82.5 MB/s 2024-09-19T05:45:03.302 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.302 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.302 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122006 s, 85.9 MB/s 2024-09-19T05:45:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146725 s, 71.5 MB/s 2024-09-19T05:45:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122632 s, 85.5 MB/s 2024-09-19T05:45:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133791 s, 78.4 MB/s 2024-09-19T05:45:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.373 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141587 s, 74.1 MB/s 2024-09-19T05:45:03.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.389 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119484 s, 87.8 MB/s 2024-09-19T05:45:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136991 s, 76.5 MB/s 2024-09-19T05:45:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139533 s, 75.1 MB/s 2024-09-19T05:45:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130264 s, 80.5 MB/s 2024-09-19T05:45:03.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.459 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116548 s, 90.0 MB/s 2024-09-19T05:45:03.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.477 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138648 s, 75.6 MB/s 2024-09-19T05:45:03.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.494 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013049 s, 80.4 MB/s 2024-09-19T05:45:03.511 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.511 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.511 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125453 s, 83.6 MB/s 2024-09-19T05:45:03.530 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.530 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.530 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146488 s, 71.6 MB/s 2024-09-19T05:45:03.548 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.548 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.548 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137512 s, 76.3 MB/s 2024-09-19T05:45:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135185 s, 77.6 MB/s 2024-09-19T05:45:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145933 s, 71.9 MB/s 2024-09-19T05:45:03.604 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.604 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.605 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146041 s, 71.8 MB/s 2024-09-19T05:45:03.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:03.614 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:03.614 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:03.614 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.11 2024-09-19T05:45:03.614 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:03.614 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:03.614 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:03.614 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:03.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:03.689 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.689 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.689 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124449 s, 84.3 MB/s 2024-09-19T05:45:03.703 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.704 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.704 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106459 s, 98.5 MB/s 2024-09-19T05:45:03.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.718 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104119 s, 101 MB/s 2024-09-19T05:45:03.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.734 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119724 s, 87.6 MB/s 2024-09-19T05:45:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124959 s, 83.9 MB/s 2024-09-19T05:45:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118827 s, 88.2 MB/s 2024-09-19T05:45:03.783 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.783 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.783 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119956 s, 87.4 MB/s 2024-09-19T05:45:03.799 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.799 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.799 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117818 s, 89.0 MB/s 2024-09-19T05:45:03.816 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.816 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.816 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129807 s, 80.8 MB/s 2024-09-19T05:45:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114189 s, 91.8 MB/s 2024-09-19T05:45:03.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.849 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013482 s, 77.8 MB/s 2024-09-19T05:45:03.864 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.864 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.864 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112398 s, 93.3 MB/s 2024-09-19T05:45:03.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.881 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125931 s, 83.3 MB/s 2024-09-19T05:45:03.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.895 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982936 s, 107 MB/s 2024-09-19T05:45:03.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.913 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135011 s, 77.7 MB/s 2024-09-19T05:45:03.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.930 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134353 s, 78.0 MB/s 2024-09-19T05:45:03.950 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.950 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.950 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151159 s, 69.4 MB/s 2024-09-19T05:45:03.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.969 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141503 s, 74.1 MB/s 2024-09-19T05:45:03.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:03.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:03.987 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138093 s, 75.9 MB/s 2024-09-19T05:45:04.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.007 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146975 s, 71.3 MB/s 2024-09-19T05:45:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131524 s, 79.7 MB/s 2024-09-19T05:45:04.046 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.047 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175315 s, 59.8 MB/s 2024-09-19T05:45:04.064 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.064 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.064 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132998 s, 78.8 MB/s 2024-09-19T05:45:04.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.084 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143618 s, 73.0 MB/s 2024-09-19T05:45:04.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.120 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113682 s, 92.2 MB/s 2024-09-19T05:45:04.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.138 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013447 s, 78.0 MB/s 2024-09-19T05:45:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014295 s, 73.4 MB/s 2024-09-19T05:45:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133265 s, 78.7 MB/s 2024-09-19T05:45:04.194 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.195 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.195 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158252 s, 66.3 MB/s 2024-09-19T05:45:04.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.214 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145307 s, 72.2 MB/s 2024-09-19T05:45:04.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.234 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148417 s, 70.7 MB/s 2024-09-19T05:45:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131267 s, 79.9 MB/s 2024-09-19T05:45:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:04.262 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:04.262 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:04.262 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.12 2024-09-19T05:45:04.262 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:04.262 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:04.262 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:04.263 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:04.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:04.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.334 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144536 s, 72.5 MB/s 2024-09-19T05:45:04.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.349 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103535 s, 101 MB/s 2024-09-19T05:45:04.366 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.366 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.366 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129965 s, 80.7 MB/s 2024-09-19T05:45:04.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.383 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119733 s, 87.6 MB/s 2024-09-19T05:45:04.401 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.402 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.402 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142457 s, 73.6 MB/s 2024-09-19T05:45:04.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.420 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140175 s, 74.8 MB/s 2024-09-19T05:45:04.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.439 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152184 s, 68.9 MB/s 2024-09-19T05:45:04.458 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.458 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.458 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136252 s, 77.0 MB/s 2024-09-19T05:45:04.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.477 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142344 s, 73.7 MB/s 2024-09-19T05:45:04.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141494 s, 74.1 MB/s 2024-09-19T05:45:04.514 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.514 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.514 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141785 s, 74.0 MB/s 2024-09-19T05:45:04.532 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.532 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.532 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134231 s, 78.1 MB/s 2024-09-19T05:45:04.552 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.552 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.552 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148971 s, 70.4 MB/s 2024-09-19T05:45:04.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.572 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015072 s, 69.6 MB/s 2024-09-19T05:45:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140366 s, 74.7 MB/s 2024-09-19T05:45:04.611 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.612 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.612 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163322 s, 64.2 MB/s 2024-09-19T05:45:04.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.631 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150526 s, 69.7 MB/s 2024-09-19T05:45:04.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146666 s, 71.5 MB/s 2024-09-19T05:45:04.669 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.669 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.669 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136675 s, 76.7 MB/s 2024-09-19T05:45:04.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.688 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139852 s, 75.0 MB/s 2024-09-19T05:45:04.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.708 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145732 s, 72.0 MB/s 2024-09-19T05:45:04.724 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.724 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.724 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123954 s, 84.6 MB/s 2024-09-19T05:45:04.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.742 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134868 s, 77.7 MB/s 2024-09-19T05:45:04.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.762 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.762 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146958 s, 71.4 MB/s 2024-09-19T05:45:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013845 s, 75.7 MB/s 2024-09-19T05:45:04.799 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.799 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.799 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151409 s, 69.3 MB/s 2024-09-19T05:45:04.818 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.818 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.819 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141808 s, 73.9 MB/s 2024-09-19T05:45:04.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.839 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155467 s, 67.4 MB/s 2024-09-19T05:45:04.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.857 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130585 s, 80.3 MB/s 2024-09-19T05:45:04.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.874 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132726 s, 79.0 MB/s 2024-09-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.891 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124454 s, 84.3 MB/s 2024-09-19T05:45:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013465 s, 77.9 MB/s 2024-09-19T05:45:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:04.918 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:04.918 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:04.918 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.13 2024-09-19T05:45:04.918 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:04.918 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:04.918 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:04.918 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:04.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:04.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:04.994 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123841 s, 84.7 MB/s 2024-09-19T05:45:05.009 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.009 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.009 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011665 s, 89.9 MB/s 2024-09-19T05:45:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147511 s, 71.1 MB/s 2024-09-19T05:45:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135001 s, 77.7 MB/s 2024-09-19T05:45:05.063 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.063 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.063 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129467 s, 81.0 MB/s 2024-09-19T05:45:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143743 s, 72.9 MB/s 2024-09-19T05:45:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122348 s, 85.7 MB/s 2024-09-19T05:45:05.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.129 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159597 s, 65.7 MB/s 2024-09-19T05:45:05.147 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.147 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.147 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133726 s, 78.4 MB/s 2024-09-19T05:45:05.164 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.164 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.164 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132727 s, 79.0 MB/s 2024-09-19T05:45:05.181 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.182 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013165 s, 79.6 MB/s 2024-09-19T05:45:05.196 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.197 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108927 s, 96.3 MB/s 2024-09-19T05:45:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101833 s, 103 MB/s 2024-09-19T05:45:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126049 s, 83.2 MB/s 2024-09-19T05:45:05.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.245 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124693 s, 84.1 MB/s 2024-09-19T05:45:05.264 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.264 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.264 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142273 s, 73.7 MB/s 2024-09-19T05:45:05.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.282 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136107 s, 77.0 MB/s 2024-09-19T05:45:05.300 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.301 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139901 s, 75.0 MB/s 2024-09-19T05:45:05.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.319 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.319 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140468 s, 74.6 MB/s 2024-09-19T05:45:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995012 s, 105 MB/s 2024-09-19T05:45:05.351 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.351 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.351 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136506 s, 76.8 MB/s 2024-09-19T05:45:05.366 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.366 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.366 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113228 s, 92.6 MB/s 2024-09-19T05:45:05.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.383 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128301 s, 81.7 MB/s 2024-09-19T05:45:05.399 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.400 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122916 s, 85.3 MB/s 2024-09-19T05:45:05.417 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.417 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.417 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133718 s, 78.4 MB/s 2024-09-19T05:45:05.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137148 s, 76.5 MB/s 2024-09-19T05:45:05.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.451 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119478 s, 87.8 MB/s 2024-09-19T05:45:05.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.468 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126856 s, 82.7 MB/s 2024-09-19T05:45:05.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.486 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132117 s, 79.4 MB/s 2024-09-19T05:45:05.505 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.506 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144888 s, 72.4 MB/s 2024-09-19T05:45:05.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.521 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011287 s, 92.9 MB/s 2024-09-19T05:45:05.537 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.537 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.537 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122947 s, 85.3 MB/s 2024-09-19T05:45:05.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:05.546 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:05.547 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:05.547 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.14 2024-09-19T05:45:05.547 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:05.547 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:05.547 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:05.547 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:05.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:05.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123403 s, 85.0 MB/s 2024-09-19T05:45:05.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.638 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013278 s, 79.0 MB/s 2024-09-19T05:45:05.656 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.656 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.656 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139166 s, 75.3 MB/s 2024-09-19T05:45:05.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.672 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113668 s, 92.2 MB/s 2024-09-19T05:45:05.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.688 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118164 s, 88.7 MB/s 2024-09-19T05:45:05.703 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.703 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.703 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116113 s, 90.3 MB/s 2024-09-19T05:45:05.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.718 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105209 s, 99.7 MB/s 2024-09-19T05:45:05.732 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.732 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.732 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971777 s, 108 MB/s 2024-09-19T05:45:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948239 s, 111 MB/s 2024-09-19T05:45:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013065 s, 80.3 MB/s 2024-09-19T05:45:05.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.778 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123091 s, 85.2 MB/s 2024-09-19T05:45:05.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.794 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117362 s, 89.3 MB/s 2024-09-19T05:45:05.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.811 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131636 s, 79.7 MB/s 2024-09-19T05:45:05.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.828 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127886 s, 82.0 MB/s 2024-09-19T05:45:05.845 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.845 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.845 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126223 s, 83.1 MB/s 2024-09-19T05:45:05.861 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.862 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124154 s, 84.5 MB/s 2024-09-19T05:45:05.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.878 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118792 s, 88.3 MB/s 2024-09-19T05:45:05.894 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.894 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.894 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127167 s, 82.5 MB/s 2024-09-19T05:45:05.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.913 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140146 s, 74.8 MB/s 2024-09-19T05:45:05.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.931 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136921 s, 76.6 MB/s 2024-09-19T05:45:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128961 s, 81.3 MB/s 2024-09-19T05:45:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144571 s, 72.5 MB/s 2024-09-19T05:45:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127775 s, 82.1 MB/s 2024-09-19T05:45:06.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.002 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133153 s, 78.7 MB/s 2024-09-19T05:45:06.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.017 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113589 s, 92.3 MB/s 2024-09-19T05:45:06.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.034 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128654 s, 81.5 MB/s 2024-09-19T05:45:06.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.049 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106565 s, 98.4 MB/s 2024-09-19T05:45:06.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.068 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147336 s, 71.2 MB/s 2024-09-19T05:45:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.088 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015769 s, 66.5 MB/s 2024-09-19T05:45:06.139 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.139 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.139 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151006 s, 69.4 MB/s 2024-09-19T05:45:06.155 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.155 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.155 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115569 s, 90.7 MB/s 2024-09-19T05:45:06.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.175 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.175 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141541 s, 74.1 MB/s 2024-09-19T05:45:06.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:06.183 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:06.183 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:06.183 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.15 2024-09-19T05:45:06.183 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:06.183 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:06.183 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:06.183 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:06.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011879 s, 88.3 MB/s 2024-09-19T05:45:06.272 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.272 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.272 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110074 s, 95.3 MB/s 2024-09-19T05:45:06.289 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.289 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.289 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129866 s, 80.7 MB/s 2024-09-19T05:45:06.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.302 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867293 s, 121 MB/s 2024-09-19T05:45:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970335 s, 108 MB/s 2024-09-19T05:45:06.329 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.329 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.329 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994204 s, 105 MB/s 2024-09-19T05:45:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.345 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.345 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120091 s, 87.3 MB/s 2024-09-19T05:45:06.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.360 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113978 s, 92.0 MB/s 2024-09-19T05:45:06.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.374 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107784 s, 97.3 MB/s 2024-09-19T05:45:06.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.393 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142939 s, 73.4 MB/s 2024-09-19T05:45:06.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.409 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124679 s, 84.1 MB/s 2024-09-19T05:45:06.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.426 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132561 s, 79.1 MB/s 2024-09-19T05:45:06.442 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.442 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.443 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121858 s, 86.0 MB/s 2024-09-19T05:45:06.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.459 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127246 s, 82.4 MB/s 2024-09-19T05:45:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.478 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146379 s, 71.6 MB/s 2024-09-19T05:45:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129767 s, 80.8 MB/s 2024-09-19T05:45:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.512 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126075 s, 83.2 MB/s 2024-09-19T05:45:06.528 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.528 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.528 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123906 s, 84.6 MB/s 2024-09-19T05:45:06.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.544 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117532 s, 89.2 MB/s 2024-09-19T05:45:06.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.560 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123685 s, 84.8 MB/s 2024-09-19T05:45:06.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.577 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127919 s, 82.0 MB/s 2024-09-19T05:45:06.592 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.592 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.592 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110677 s, 94.7 MB/s 2024-09-19T05:45:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129539 s, 80.9 MB/s 2024-09-19T05:45:06.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.627 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130841 s, 80.1 MB/s 2024-09-19T05:45:06.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.645 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130318 s, 80.5 MB/s 2024-09-19T05:45:06.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132983 s, 78.9 MB/s 2024-09-19T05:45:06.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.678 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.678 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011052 s, 94.9 MB/s 2024-09-19T05:45:06.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.696 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139659 s, 75.1 MB/s 2024-09-19T05:45:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140955 s, 74.4 MB/s 2024-09-19T05:45:06.731 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.731 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.731 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117749 s, 89.1 MB/s 2024-09-19T05:45:06.750 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.750 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.750 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138801 s, 75.5 MB/s 2024-09-19T05:45:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163058 s, 64.3 MB/s 2024-09-19T05:45:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:06.781 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:06.781 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:06.781 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.16 2024-09-19T05:45:06.781 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:06.781 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:06.781 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:06.781 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:06.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:06.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.853 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138271 s, 75.8 MB/s 2024-09-19T05:45:06.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.869 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122995 s, 85.3 MB/s 2024-09-19T05:45:06.884 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.884 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.885 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101941 s, 103 MB/s 2024-09-19T05:45:06.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.901 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114397 s, 91.7 MB/s 2024-09-19T05:45:06.917 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.917 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.917 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01138 s, 92.1 MB/s 2024-09-19T05:45:06.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.935 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132028 s, 79.4 MB/s 2024-09-19T05:45:06.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.951 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114997 s, 91.2 MB/s 2024-09-19T05:45:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144803 s, 72.4 MB/s 2024-09-19T05:45:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:06.988 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125536 s, 83.5 MB/s 2024-09-19T05:45:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128045 s, 81.9 MB/s 2024-09-19T05:45:07.020 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.021 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120441 s, 87.1 MB/s 2024-09-19T05:45:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138488 s, 75.7 MB/s 2024-09-19T05:45:07.058 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.058 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.058 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145357 s, 72.1 MB/s 2024-09-19T05:45:07.076 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.076 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.076 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137714 s, 76.1 MB/s 2024-09-19T05:45:07.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.147 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153553 s, 68.3 MB/s 2024-09-19T05:45:07.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.167 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149181 s, 70.3 MB/s 2024-09-19T05:45:07.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.191 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.191 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179874 s, 58.3 MB/s 2024-09-19T05:45:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.213 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168583 s, 62.2 MB/s 2024-09-19T05:45:07.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.235 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158619 s, 66.1 MB/s 2024-09-19T05:45:07.255 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.255 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.255 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160599 s, 65.3 MB/s 2024-09-19T05:45:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016741 s, 62.6 MB/s 2024-09-19T05:45:07.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.298 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015423 s, 68.0 MB/s 2024-09-19T05:45:07.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.321 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014164 s, 74.0 MB/s 2024-09-19T05:45:07.338 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.338 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.338 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156131 s, 67.2 MB/s 2024-09-19T05:45:07.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.358 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138168 s, 75.9 MB/s 2024-09-19T05:45:07.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.378 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015126 s, 69.3 MB/s 2024-09-19T05:45:07.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.397 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148758 s, 70.5 MB/s 2024-09-19T05:45:07.418 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.418 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.419 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157879 s, 66.4 MB/s 2024-09-19T05:45:07.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.439 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149209 s, 70.3 MB/s 2024-09-19T05:45:07.457 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.457 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.457 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130733 s, 80.2 MB/s 2024-09-19T05:45:07.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.475 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012766 s, 82.1 MB/s 2024-09-19T05:45:07.493 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.493 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.494 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144201 s, 72.7 MB/s 2024-09-19T05:45:07.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:07.503 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:07.503 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:07.503 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.17 2024-09-19T05:45:07.503 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:07.503 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:07.503 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:07.503 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:07.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:07.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.577 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113689 s, 92.2 MB/s 2024-09-19T05:45:07.591 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.591 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.591 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998706 s, 105 MB/s 2024-09-19T05:45:07.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.609 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129697 s, 80.8 MB/s 2024-09-19T05:45:07.623 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.623 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.623 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101788 s, 103 MB/s 2024-09-19T05:45:07.641 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.641 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.641 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132778 s, 79.0 MB/s 2024-09-19T05:45:07.658 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.658 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.659 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135721 s, 77.3 MB/s 2024-09-19T05:45:07.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.675 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122702 s, 85.5 MB/s 2024-09-19T05:45:07.692 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.692 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.692 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131406 s, 79.8 MB/s 2024-09-19T05:45:07.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.708 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119138 s, 88.0 MB/s 2024-09-19T05:45:07.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135047 s, 77.6 MB/s 2024-09-19T05:45:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.744 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136966 s, 76.6 MB/s 2024-09-19T05:45:07.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.761 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.762 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133423 s, 78.6 MB/s 2024-09-19T05:45:07.779 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.779 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.779 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127267 s, 82.4 MB/s 2024-09-19T05:45:07.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.797 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01368 s, 76.7 MB/s 2024-09-19T05:45:07.813 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.814 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128918 s, 81.3 MB/s 2024-09-19T05:45:07.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140751 s, 74.5 MB/s 2024-09-19T05:45:07.847 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.847 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.847 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107176 s, 97.8 MB/s 2024-09-19T05:45:07.864 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.864 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.864 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126296 s, 83.0 MB/s 2024-09-19T05:45:07.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.880 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123562 s, 84.9 MB/s 2024-09-19T05:45:07.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.897 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124363 s, 84.3 MB/s 2024-09-19T05:45:07.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.914 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133717 s, 78.4 MB/s 2024-09-19T05:45:07.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.933 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147062 s, 71.3 MB/s 2024-09-19T05:45:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134215 s, 78.1 MB/s 2024-09-19T05:45:07.966 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.966 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.967 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116589 s, 89.9 MB/s 2024-09-19T05:45:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139311 s, 75.3 MB/s 2024-09-19T05:45:08.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.001 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123595 s, 84.8 MB/s 2024-09-19T05:45:08.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.018 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.018 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125256 s, 83.7 MB/s 2024-09-19T05:45:08.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.034 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01296 s, 80.9 MB/s 2024-09-19T05:45:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124993 s, 83.9 MB/s 2024-09-19T05:45:08.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.069 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126683 s, 82.8 MB/s 2024-09-19T05:45:08.085 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.085 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.085 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127512 s, 82.2 MB/s 2024-09-19T05:45:08.138 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.138 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.138 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138804 s, 75.5 MB/s 2024-09-19T05:45:08.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:08.148 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:08.149 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:08.149 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.18 2024-09-19T05:45:08.149 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:08.149 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:08.149 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:08.149 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138403 s, 75.8 MB/s 2024-09-19T05:45:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.243 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141564 s, 74.1 MB/s 2024-09-19T05:45:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111223 s, 94.3 MB/s 2024-09-19T05:45:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137412 s, 76.3 MB/s 2024-09-19T05:45:08.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.292 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114648 s, 91.5 MB/s 2024-09-19T05:45:08.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.308 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116921 s, 89.7 MB/s 2024-09-19T05:45:08.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.326 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136789 s, 76.7 MB/s 2024-09-19T05:45:08.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.343 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123699 s, 84.8 MB/s 2024-09-19T05:45:08.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.361 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132912 s, 78.9 MB/s 2024-09-19T05:45:08.380 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.381 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151204 s, 69.3 MB/s 2024-09-19T05:45:08.399 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.399 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.399 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137363 s, 76.3 MB/s 2024-09-19T05:45:08.415 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.416 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124822 s, 84.0 MB/s 2024-09-19T05:45:08.433 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.433 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.433 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131286 s, 79.9 MB/s 2024-09-19T05:45:08.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.449 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117783 s, 89.0 MB/s 2024-09-19T05:45:08.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.465 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114766 s, 91.4 MB/s 2024-09-19T05:45:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117659 s, 89.1 MB/s 2024-09-19T05:45:08.500 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.500 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.500 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014325 s, 73.2 MB/s 2024-09-19T05:45:08.517 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.517 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.517 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129504 s, 81.0 MB/s 2024-09-19T05:45:08.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.533 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115137 s, 91.1 MB/s 2024-09-19T05:45:08.550 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.550 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.551 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134083 s, 78.2 MB/s 2024-09-19T05:45:08.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.567 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126743 s, 82.7 MB/s 2024-09-19T05:45:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012519 s, 83.8 MB/s 2024-09-19T05:45:08.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.601 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129802 s, 80.8 MB/s 2024-09-19T05:45:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103542 s, 101 MB/s 2024-09-19T05:45:08.632 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.632 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.632 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126139 s, 83.1 MB/s 2024-09-19T05:45:08.650 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.650 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.650 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140946 s, 74.4 MB/s 2024-09-19T05:45:08.667 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.667 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.667 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129492 s, 81.0 MB/s 2024-09-19T05:45:08.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.685 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130167 s, 80.6 MB/s 2024-09-19T05:45:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013019 s, 80.5 MB/s 2024-09-19T05:45:08.720 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.720 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.720 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136523 s, 76.8 MB/s 2024-09-19T05:45:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115362 s, 90.9 MB/s 2024-09-19T05:45:08.754 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.754 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.754 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135092 s, 77.6 MB/s 2024-09-19T05:45:08.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:08.763 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:08.763 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:08.763 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.19 2024-09-19T05:45:08.763 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:08.763 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:08.763 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:08.763 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:08.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:08.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.828 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103083 s, 102 MB/s 2024-09-19T05:45:08.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.841 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896987 s, 117 MB/s 2024-09-19T05:45:08.856 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.856 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.857 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117753 s, 89.0 MB/s 2024-09-19T05:45:08.871 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.871 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.871 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106885 s, 98.1 MB/s 2024-09-19T05:45:08.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.887 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129472 s, 81.0 MB/s 2024-09-19T05:45:08.905 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.905 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.905 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138991 s, 75.4 MB/s 2024-09-19T05:45:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125486 s, 83.6 MB/s 2024-09-19T05:45:08.938 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.938 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.938 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123797 s, 84.7 MB/s 2024-09-19T05:45:08.956 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.956 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.957 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134856 s, 77.8 MB/s 2024-09-19T05:45:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116965 s, 89.6 MB/s 2024-09-19T05:45:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127449 s, 82.3 MB/s 2024-09-19T05:45:09.004 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.004 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.004 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116504 s, 90.0 MB/s 2024-09-19T05:45:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126903 s, 82.6 MB/s 2024-09-19T05:45:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108743 s, 96.4 MB/s 2024-09-19T05:45:09.053 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.054 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133349 s, 78.6 MB/s 2024-09-19T05:45:09.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.071 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130727 s, 80.2 MB/s 2024-09-19T05:45:09.089 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.090 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.090 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146155 s, 71.7 MB/s 2024-09-19T05:45:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170389 s, 61.5 MB/s 2024-09-19T05:45:09.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.207 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155555 s, 67.4 MB/s 2024-09-19T05:45:09.230 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.230 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.230 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167928 s, 62.4 MB/s 2024-09-19T05:45:09.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149236 s, 70.3 MB/s 2024-09-19T05:45:09.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.273 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152494 s, 68.8 MB/s 2024-09-19T05:45:09.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.295 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151078 s, 69.4 MB/s 2024-09-19T05:45:09.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.318 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156691 s, 66.9 MB/s 2024-09-19T05:45:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.338 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156717 s, 66.9 MB/s 2024-09-19T05:45:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.358 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143012 s, 73.3 MB/s 2024-09-19T05:45:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.377 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145967 s, 71.8 MB/s 2024-09-19T05:45:09.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.396 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144721 s, 72.5 MB/s 2024-09-19T05:45:09.418 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.418 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.418 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150791 s, 69.5 MB/s 2024-09-19T05:45:09.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.437 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135038 s, 77.7 MB/s 2024-09-19T05:45:09.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.456 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.456 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130712 s, 80.2 MB/s 2024-09-19T05:45:09.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.475 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.475 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137047 s, 76.5 MB/s 2024-09-19T05:45:09.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:09.484 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:09.484 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:09.484 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.20 2024-09-19T05:45:09.484 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:09.484 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:09.484 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:09.484 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:09.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:09.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.604 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963963 s, 109 MB/s 2024-09-19T05:45:09.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.620 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125497 s, 83.6 MB/s 2024-09-19T05:45:09.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.637 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121498 s, 86.3 MB/s 2024-09-19T05:45:09.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.654 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.654 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126563 s, 82.9 MB/s 2024-09-19T05:45:09.670 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.670 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.670 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126853 s, 82.7 MB/s 2024-09-19T05:45:09.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.688 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143556 s, 73.0 MB/s 2024-09-19T05:45:09.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.706 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139656 s, 75.1 MB/s 2024-09-19T05:45:09.724 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.724 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.724 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137307 s, 76.4 MB/s 2024-09-19T05:45:09.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.742 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132374 s, 79.2 MB/s 2024-09-19T05:45:09.758 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.758 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.758 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120808 s, 86.8 MB/s 2024-09-19T05:45:09.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.776 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115998 s, 90.4 MB/s 2024-09-19T05:45:09.792 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.792 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.793 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013748 s, 76.3 MB/s 2024-09-19T05:45:09.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.810 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139802 s, 75.0 MB/s 2024-09-19T05:45:09.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.828 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137069 s, 76.5 MB/s 2024-09-19T05:45:09.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.846 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132364 s, 79.2 MB/s 2024-09-19T05:45:09.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.866 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148902 s, 70.4 MB/s 2024-09-19T05:45:09.883 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.883 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.884 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132141 s, 79.4 MB/s 2024-09-19T05:45:09.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.901 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133476 s, 78.6 MB/s 2024-09-19T05:45:09.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.925 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196402 s, 53.4 MB/s 2024-09-19T05:45:09.943 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.943 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.943 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134174 s, 78.2 MB/s 2024-09-19T05:45:09.962 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.963 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.963 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144404 s, 72.6 MB/s 2024-09-19T05:45:09.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:09.982 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:09.982 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145711 s, 72.0 MB/s 2024-09-19T05:45:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137521 s, 76.2 MB/s 2024-09-19T05:45:10.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.016 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119119 s, 88.0 MB/s 2024-09-19T05:45:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.034 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141175 s, 74.3 MB/s 2024-09-19T05:45:10.052 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.053 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.053 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135865 s, 77.2 MB/s 2024-09-19T05:45:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.068 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124431 s, 84.3 MB/s 2024-09-19T05:45:10.083 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.083 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.083 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114636 s, 91.5 MB/s 2024-09-19T05:45:10.105 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.105 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.105 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132058 s, 79.4 MB/s 2024-09-19T05:45:10.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.149 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138675 s, 75.6 MB/s 2024-09-19T05:45:10.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153103 s, 68.5 MB/s 2024-09-19T05:45:10.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.190 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154565 s, 67.8 MB/s 2024-09-19T05:45:10.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:10.199 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:10.199 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:10.199 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.21 2024-09-19T05:45:10.199 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:10.199 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:10.199 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:10.199 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:10.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:10.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.273 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148327 s, 70.7 MB/s 2024-09-19T05:45:10.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.291 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130795 s, 80.2 MB/s 2024-09-19T05:45:10.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135713 s, 77.3 MB/s 2024-09-19T05:45:10.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.328 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150124 s, 69.8 MB/s 2024-09-19T05:45:10.347 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.347 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.347 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143737 s, 73.0 MB/s 2024-09-19T05:45:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127441 s, 82.3 MB/s 2024-09-19T05:45:10.382 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.382 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.382 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138485 s, 75.7 MB/s 2024-09-19T05:45:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137327 s, 76.4 MB/s 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147331 s, 71.2 MB/s 2024-09-19T05:45:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132442 s, 79.2 MB/s 2024-09-19T05:45:10.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.455 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134672 s, 77.9 MB/s 2024-09-19T05:45:10.471 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.471 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.471 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117448 s, 89.3 MB/s 2024-09-19T05:45:10.488 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.488 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.488 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122502 s, 85.6 MB/s 2024-09-19T05:45:10.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.506 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139783 s, 75.0 MB/s 2024-09-19T05:45:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142381 s, 73.6 MB/s 2024-09-19T05:45:10.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.544 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139719 s, 75.0 MB/s 2024-09-19T05:45:10.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133538 s, 78.5 MB/s 2024-09-19T05:45:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134542 s, 77.9 MB/s 2024-09-19T05:45:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011516 s, 91.1 MB/s 2024-09-19T05:45:10.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.613 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145224 s, 72.2 MB/s 2024-09-19T05:45:10.632 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.632 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.632 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136844 s, 76.6 MB/s 2024-09-19T05:45:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013973 s, 75.0 MB/s 2024-09-19T05:45:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142442 s, 73.6 MB/s 2024-09-19T05:45:10.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.686 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130055 s, 80.6 MB/s 2024-09-19T05:45:10.705 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.705 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.705 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146912 s, 71.4 MB/s 2024-09-19T05:45:10.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.723 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128346 s, 81.7 MB/s 2024-09-19T05:45:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140711 s, 74.5 MB/s 2024-09-19T05:45:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148044 s, 70.8 MB/s 2024-09-19T05:45:10.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:45:10.777 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:45:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135034 s, 77.7 MB/s 2024-09-19T05:45:10.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.797 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147114 s, 71.3 MB/s 2024-09-19T05:45:10.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.815 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127813 s, 82.0 MB/s 2024-09-19T05:45:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.831 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013231 s, 79.3 MB/s 2024-09-19T05:45:10.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:10.840 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:10.840 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:10.840 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.22 2024-09-19T05:45:10.841 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:10.841 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:10.841 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:10.841 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:10.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:10.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.961 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121696 s, 86.2 MB/s 2024-09-19T05:45:10.978 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.978 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.978 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134468 s, 78.0 MB/s 2024-09-19T05:45:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118713 s, 88.3 MB/s 2024-09-19T05:45:11.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.012 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140985 s, 74.4 MB/s 2024-09-19T05:45:11.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.029 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125671 s, 83.4 MB/s 2024-09-19T05:45:11.045 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.045 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.045 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123979 s, 84.6 MB/s 2024-09-19T05:45:11.061 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.061 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.061 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122382 s, 85.7 MB/s 2024-09-19T05:45:11.077 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.077 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.078 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121872 s, 86.0 MB/s 2024-09-19T05:45:11.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.097 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152393 s, 68.8 MB/s 2024-09-19T05:45:11.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.162 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164126 s, 63.9 MB/s 2024-09-19T05:45:11.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.185 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171016 s, 61.3 MB/s 2024-09-19T05:45:11.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.206 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159761 s, 65.6 MB/s 2024-09-19T05:45:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166349 s, 63.0 MB/s 2024-09-19T05:45:11.249 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153116 s, 68.5 MB/s 2024-09-19T05:45:11.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.269 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150878 s, 69.5 MB/s 2024-09-19T05:45:11.287 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.287 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.287 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129948 s, 80.7 MB/s 2024-09-19T05:45:11.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.306 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141693 s, 74.0 MB/s 2024-09-19T05:45:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120837 s, 86.8 MB/s 2024-09-19T05:45:11.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.342 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151645 s, 69.1 MB/s 2024-09-19T05:45:11.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.361 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142322 s, 73.7 MB/s 2024-09-19T05:45:11.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.379 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137755 s, 76.1 MB/s 2024-09-19T05:45:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.396 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117802 s, 89.0 MB/s 2024-09-19T05:45:11.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.413 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133003 s, 78.8 MB/s 2024-09-19T05:45:11.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.431 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136739 s, 76.7 MB/s 2024-09-19T05:45:11.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.449 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013375 s, 78.4 MB/s 2024-09-19T05:45:11.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.468 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143166 s, 73.2 MB/s 2024-09-19T05:45:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138685 s, 75.6 MB/s 2024-09-19T05:45:11.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.504 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122772 s, 85.4 MB/s 2024-09-19T05:45:11.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.521 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131891 s, 79.5 MB/s 2024-09-19T05:45:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015341 s, 68.4 MB/s 2024-09-19T05:45:11.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.560 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142882 s, 73.4 MB/s 2024-09-19T05:45:11.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.580 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150623 s, 69.6 MB/s 2024-09-19T05:45:11.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:11.590 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:11.590 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:11.590 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.23 2024-09-19T05:45:11.590 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:11.590 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:11.590 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:11.590 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:11.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:11.669 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.669 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.669 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013484 s, 77.8 MB/s 2024-09-19T05:45:11.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.685 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126265 s, 83.0 MB/s 2024-09-19T05:45:11.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.702 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126936 s, 82.6 MB/s 2024-09-19T05:45:11.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.719 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127988 s, 81.9 MB/s 2024-09-19T05:45:11.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.738 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149995 s, 69.9 MB/s 2024-09-19T05:45:11.754 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.754 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120898 s, 86.7 MB/s 2024-09-19T05:45:11.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.773 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136355 s, 76.9 MB/s 2024-09-19T05:45:11.789 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.790 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.790 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122897 s, 85.3 MB/s 2024-09-19T05:45:11.807 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.807 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.807 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131933 s, 79.5 MB/s 2024-09-19T05:45:11.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.825 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121684 s, 86.2 MB/s 2024-09-19T05:45:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119375 s, 87.8 MB/s 2024-09-19T05:45:11.856 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.856 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.856 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119764 s, 87.6 MB/s 2024-09-19T05:45:11.870 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.870 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.871 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991331 s, 106 MB/s 2024-09-19T05:45:11.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.887 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123613 s, 84.8 MB/s 2024-09-19T05:45:11.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.901 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108473 s, 96.7 MB/s 2024-09-19T05:45:11.919 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.919 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.919 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136987 s, 76.5 MB/s 2024-09-19T05:45:11.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.935 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117225 s, 89.4 MB/s 2024-09-19T05:45:11.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.953 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138228 s, 75.9 MB/s 2024-09-19T05:45:11.970 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.970 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.970 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126242 s, 83.1 MB/s 2024-09-19T05:45:11.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:11.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:11.987 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120984 s, 86.7 MB/s 2024-09-19T05:45:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.001 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981828 s, 107 MB/s 2024-09-19T05:45:12.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.017 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011895 s, 88.2 MB/s 2024-09-19T05:45:12.033 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.033 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.034 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122389 s, 85.7 MB/s 2024-09-19T05:45:12.050 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.051 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130379 s, 80.4 MB/s 2024-09-19T05:45:12.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.065 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100118 s, 105 MB/s 2024-09-19T05:45:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101033 s, 104 MB/s 2024-09-19T05:45:12.101 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.101 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.102 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180815 s, 58.0 MB/s 2024-09-19T05:45:12.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.158 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.158 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151301 s, 69.3 MB/s 2024-09-19T05:45:12.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.177 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144388 s, 72.6 MB/s 2024-09-19T05:45:12.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156129 s, 67.2 MB/s 2024-09-19T05:45:12.216 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.217 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143888 s, 72.9 MB/s 2024-09-19T05:45:12.235 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.236 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.236 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129639 s, 80.9 MB/s 2024-09-19T05:45:12.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:12.245 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:12.245 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:12.245 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.24 2024-09-19T05:45:12.245 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:12.245 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:12.245 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:12.245 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:12.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:12.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.320 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977096 s, 107 MB/s 2024-09-19T05:45:12.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.340 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146844 s, 71.4 MB/s 2024-09-19T05:45:12.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.358 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124094 s, 84.5 MB/s 2024-09-19T05:45:12.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.378 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139641 s, 75.1 MB/s 2024-09-19T05:45:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.397 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135911 s, 77.2 MB/s 2024-09-19T05:45:12.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.416 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135227 s, 77.5 MB/s 2024-09-19T05:45:12.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.437 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015123 s, 69.3 MB/s 2024-09-19T05:45:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113525 s, 92.4 MB/s 2024-09-19T05:45:12.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.474 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147651 s, 71.0 MB/s 2024-09-19T05:45:12.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.494 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139382 s, 75.2 MB/s 2024-09-19T05:45:12.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.513 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133477 s, 78.6 MB/s 2024-09-19T05:45:12.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.533 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145763 s, 71.9 MB/s 2024-09-19T05:45:12.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.553 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142816 s, 73.4 MB/s 2024-09-19T05:45:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013351 s, 78.5 MB/s 2024-09-19T05:45:12.591 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.591 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.592 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137318 s, 76.4 MB/s 2024-09-19T05:45:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131797 s, 79.6 MB/s 2024-09-19T05:45:12.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.630 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013743 s, 76.3 MB/s 2024-09-19T05:45:12.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.649 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135207 s, 77.6 MB/s 2024-09-19T05:45:12.668 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.668 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.668 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137443 s, 76.3 MB/s 2024-09-19T05:45:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134528 s, 77.9 MB/s 2024-09-19T05:45:12.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.707 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138385 s, 75.8 MB/s 2024-09-19T05:45:12.726 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.726 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.726 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136082 s, 77.1 MB/s 2024-09-19T05:45:12.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.744 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119732 s, 87.6 MB/s 2024-09-19T05:45:12.763 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.763 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.763 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139467 s, 75.2 MB/s 2024-09-19T05:45:12.782 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.782 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.782 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143956 s, 72.8 MB/s 2024-09-19T05:45:12.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.802 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152489 s, 68.8 MB/s 2024-09-19T05:45:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109721 s, 95.6 MB/s 2024-09-19T05:45:12.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.836 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147564 s, 71.1 MB/s 2024-09-19T05:45:12.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.855 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130353 s, 80.4 MB/s 2024-09-19T05:45:12.873 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.873 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.873 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01306 s, 80.3 MB/s 2024-09-19T05:45:12.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.893 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144377 s, 72.6 MB/s 2024-09-19T05:45:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130774 s, 80.2 MB/s 2024-09-19T05:45:12.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:12.921 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:12.921 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:12.921 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.25 2024-09-19T05:45:12.922 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:12.922 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:12.922 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:12.922 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:12.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:12.992 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:12.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:12.993 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119052 s, 88.1 MB/s 2024-09-19T05:45:13.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.008 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117378 s, 89.3 MB/s 2024-09-19T05:45:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127535 s, 82.2 MB/s 2024-09-19T05:45:13.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.043 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130422 s, 80.4 MB/s 2024-09-19T05:45:13.060 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.060 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.060 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130159 s, 80.6 MB/s 2024-09-19T05:45:13.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.078 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137969 s, 76.0 MB/s 2024-09-19T05:45:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136932 s, 76.6 MB/s 2024-09-19T05:45:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144587 s, 72.5 MB/s 2024-09-19T05:45:13.168 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.168 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.168 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160413 s, 65.4 MB/s 2024-09-19T05:45:13.186 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.186 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.186 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136453 s, 76.8 MB/s 2024-09-19T05:45:13.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.206 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152831 s, 68.6 MB/s 2024-09-19T05:45:13.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.227 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158542 s, 66.1 MB/s 2024-09-19T05:45:13.247 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.247 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.247 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157516 s, 66.6 MB/s 2024-09-19T05:45:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142113 s, 73.8 MB/s 2024-09-19T05:45:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120936 s, 86.7 MB/s 2024-09-19T05:45:13.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.301 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144508 s, 72.6 MB/s 2024-09-19T05:45:13.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.320 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135768 s, 77.2 MB/s 2024-09-19T05:45:13.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.340 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153846 s, 68.2 MB/s 2024-09-19T05:45:13.356 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.356 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.356 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114956 s, 91.2 MB/s 2024-09-19T05:45:13.373 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.374 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132856 s, 78.9 MB/s 2024-09-19T05:45:13.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.391 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133449 s, 78.6 MB/s 2024-09-19T05:45:13.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.409 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137535 s, 76.2 MB/s 2024-09-19T05:45:13.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.427 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.427 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131737 s, 79.6 MB/s 2024-09-19T05:45:13.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.445 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014109 s, 74.3 MB/s 2024-09-19T05:45:13.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.464 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138704 s, 75.6 MB/s 2024-09-19T05:45:13.484 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.485 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.485 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153331 s, 68.4 MB/s 2024-09-19T05:45:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138095 s, 75.9 MB/s 2024-09-19T05:45:13.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.522 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140462 s, 74.7 MB/s 2024-09-19T05:45:13.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.540 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134389 s, 78.0 MB/s 2024-09-19T05:45:13.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.560 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143572 s, 73.0 MB/s 2024-09-19T05:45:13.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.576 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.576 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115642 s, 90.7 MB/s 2024-09-19T05:45:13.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.591 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.591 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113455 s, 92.4 MB/s 2024-09-19T05:45:13.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:13.600 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:13.600 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:13.600 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.26 2024-09-19T05:45:13.600 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:13.600 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:13.600 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:13.600 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:13.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:13.667 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012379 s, 84.7 MB/s 2024-09-19T05:45:13.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.685 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135723 s, 77.3 MB/s 2024-09-19T05:45:13.701 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.701 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.701 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011729 s, 89.4 MB/s 2024-09-19T05:45:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129315 s, 81.1 MB/s 2024-09-19T05:45:13.732 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.732 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.732 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104368 s, 100 MB/s 2024-09-19T05:45:13.748 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.748 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.748 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122954 s, 85.3 MB/s 2024-09-19T05:45:13.764 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.765 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121951 s, 86.0 MB/s 2024-09-19T05:45:13.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.781 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124055 s, 84.5 MB/s 2024-09-19T05:45:13.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.799 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129636 s, 80.9 MB/s 2024-09-19T05:45:13.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.814 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126796 s, 82.7 MB/s 2024-09-19T05:45:13.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.831 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.831 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012847 s, 81.6 MB/s 2024-09-19T05:45:13.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.846 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111031 s, 94.4 MB/s 2024-09-19T05:45:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130819 s, 80.2 MB/s 2024-09-19T05:45:13.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.880 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125726 s, 83.4 MB/s 2024-09-19T05:45:13.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.896 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126888 s, 82.6 MB/s 2024-09-19T05:45:13.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.913 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128694 s, 81.5 MB/s 2024-09-19T05:45:13.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.930 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123376 s, 85.0 MB/s 2024-09-19T05:45:13.946 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.946 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.946 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123306 s, 85.0 MB/s 2024-09-19T05:45:13.962 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.962 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.962 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124664 s, 84.1 MB/s 2024-09-19T05:45:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119197 s, 88.0 MB/s 2024-09-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:13.996 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143749 s, 72.9 MB/s 2024-09-19T05:45:14.009 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.009 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.010 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960541 s, 109 MB/s 2024-09-19T05:45:14.025 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.026 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.026 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119282 s, 87.9 MB/s 2024-09-19T05:45:14.042 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.042 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.042 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119779 s, 87.5 MB/s 2024-09-19T05:45:14.060 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.060 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.060 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144471 s, 72.6 MB/s 2024-09-19T05:45:14.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.078 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129126 s, 81.2 MB/s 2024-09-19T05:45:14.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.096 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140986 s, 74.4 MB/s 2024-09-19T05:45:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178984 s, 58.6 MB/s 2024-09-19T05:45:14.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.171 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160782 s, 65.2 MB/s 2024-09-19T05:45:14.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.190 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014472 s, 72.5 MB/s 2024-09-19T05:45:14.211 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.211 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.212 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160867 s, 65.2 MB/s 2024-09-19T05:45:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.232 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146479 s, 71.6 MB/s 2024-09-19T05:45:14.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:14.241 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:14.241 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:14.241 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.27 2024-09-19T05:45:14.241 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:14.241 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:14.241 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:14.241 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:14.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:14.366 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.366 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.366 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150655 s, 69.6 MB/s 2024-09-19T05:45:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135815 s, 77.2 MB/s 2024-09-19T05:45:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146097 s, 71.8 MB/s 2024-09-19T05:45:14.423 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.424 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.424 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146944 s, 71.4 MB/s 2024-09-19T05:45:14.444 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.445 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161016 s, 65.1 MB/s 2024-09-19T05:45:14.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.464 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148246 s, 70.7 MB/s 2024-09-19T05:45:14.482 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.482 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.482 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129018 s, 81.3 MB/s 2024-09-19T05:45:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139255 s, 75.3 MB/s 2024-09-19T05:45:14.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.519 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.519 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142182 s, 73.7 MB/s 2024-09-19T05:45:14.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.536 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131412 s, 79.8 MB/s 2024-09-19T05:45:14.552 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.552 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.552 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122232 s, 85.8 MB/s 2024-09-19T05:45:14.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.571 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142636 s, 73.5 MB/s 2024-09-19T05:45:14.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.589 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013924 s, 75.3 MB/s 2024-09-19T05:45:14.607 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143497 s, 73.1 MB/s 2024-09-19T05:45:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.626 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141834 s, 73.9 MB/s 2024-09-19T05:45:14.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.644 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141413 s, 74.1 MB/s 2024-09-19T05:45:14.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122645 s, 85.5 MB/s 2024-09-19T05:45:14.678 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131627 s, 79.7 MB/s 2024-09-19T05:45:14.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.696 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013685 s, 76.6 MB/s 2024-09-19T05:45:14.714 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.715 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139723 s, 75.0 MB/s 2024-09-19T05:45:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012139 s, 86.4 MB/s 2024-09-19T05:45:14.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.751 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143057 s, 73.3 MB/s 2024-09-19T05:45:14.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.768 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136518 s, 76.8 MB/s 2024-09-19T05:45:14.787 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.787 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.787 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147601 s, 71.0 MB/s 2024-09-19T05:45:14.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.806 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142475 s, 73.6 MB/s 2024-09-19T05:45:14.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.825 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150498 s, 69.7 MB/s 2024-09-19T05:45:14.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.844 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140112 s, 74.8 MB/s 2024-09-19T05:45:14.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.862 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138047 s, 76.0 MB/s 2024-09-19T05:45:14.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.877 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112963 s, 92.8 MB/s 2024-09-19T05:45:14.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.893 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119099 s, 88.0 MB/s 2024-09-19T05:45:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118326 s, 88.6 MB/s 2024-09-19T05:45:14.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:14.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:14.929 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153625 s, 68.3 MB/s 2024-09-19T05:45:14.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:14.937 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:14.938 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:14.938 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.28 2024-09-19T05:45:14.938 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:14.938 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:14.938 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:14.938 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:14.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:15.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134245 s, 78.1 MB/s 2024-09-19T05:45:15.030 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.030 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.030 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129677 s, 80.9 MB/s 2024-09-19T05:45:15.046 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.046 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.046 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124367 s, 84.3 MB/s 2024-09-19T05:45:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115573 s, 90.7 MB/s 2024-09-19T05:45:15.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.080 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140664 s, 74.5 MB/s 2024-09-19T05:45:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124749 s, 84.1 MB/s 2024-09-19T05:45:15.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.112 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120954 s, 86.7 MB/s 2024-09-19T05:45:15.170 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.170 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.170 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150348 s, 69.7 MB/s 2024-09-19T05:45:15.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.189 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140175 s, 74.8 MB/s 2024-09-19T05:45:15.205 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.205 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.206 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123352 s, 85.0 MB/s 2024-09-19T05:45:15.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.224 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138677 s, 75.6 MB/s 2024-09-19T05:45:15.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.244 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154045 s, 68.1 MB/s 2024-09-19T05:45:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156244 s, 67.1 MB/s 2024-09-19T05:45:15.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.284 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.284 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139999 s, 74.9 MB/s 2024-09-19T05:45:15.304 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.304 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.304 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150503 s, 69.7 MB/s 2024-09-19T05:45:15.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.324 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152236 s, 68.9 MB/s 2024-09-19T05:45:15.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.343 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013759 s, 76.2 MB/s 2024-09-19T05:45:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.365 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162149 s, 64.7 MB/s 2024-09-19T05:45:15.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.384 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.384 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140534 s, 74.6 MB/s 2024-09-19T05:45:15.401 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.401 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.401 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125818 s, 83.3 MB/s 2024-09-19T05:45:15.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.421 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149417 s, 70.2 MB/s 2024-09-19T05:45:15.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.439 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139912 s, 74.9 MB/s 2024-09-19T05:45:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.460 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151735 s, 69.1 MB/s 2024-09-19T05:45:15.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.479 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151127 s, 69.4 MB/s 2024-09-19T05:45:15.499 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.499 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.499 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151936 s, 69.0 MB/s 2024-09-19T05:45:15.519 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.519 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.520 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157472 s, 66.6 MB/s 2024-09-19T05:45:15.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.540 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149125 s, 70.3 MB/s 2024-09-19T05:45:15.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.560 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157359 s, 66.6 MB/s 2024-09-19T05:45:15.578 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.579 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140709 s, 74.5 MB/s 2024-09-19T05:45:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016037 s, 65.4 MB/s 2024-09-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.619 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146472 s, 71.6 MB/s 2024-09-19T05:45:15.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.637 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135677 s, 77.3 MB/s 2024-09-19T05:45:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:15.646 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:15.646 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:15.646 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.29 2024-09-19T05:45:15.647 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:15.647 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:15.647 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:15.647 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:15.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:15.721 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.721 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.721 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105516 s, 99.4 MB/s 2024-09-19T05:45:15.735 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.735 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.735 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010401 s, 101 MB/s 2024-09-19T05:45:15.752 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.753 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.753 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134772 s, 77.8 MB/s 2024-09-19T05:45:15.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.770 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133496 s, 78.5 MB/s 2024-09-19T05:45:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.787 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125293 s, 83.7 MB/s 2024-09-19T05:45:15.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.802 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111741 s, 93.8 MB/s 2024-09-19T05:45:15.816 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.816 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.816 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997501 s, 105 MB/s 2024-09-19T05:45:15.833 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.833 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.833 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123822 s, 84.7 MB/s 2024-09-19T05:45:15.850 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.850 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.850 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127471 s, 82.3 MB/s 2024-09-19T05:45:15.867 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.867 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.867 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130345 s, 80.4 MB/s 2024-09-19T05:45:15.884 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.884 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.884 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131906 s, 79.5 MB/s 2024-09-19T05:45:15.905 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.905 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.905 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154727 s, 67.8 MB/s 2024-09-19T05:45:15.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.925 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140292 s, 74.7 MB/s 2024-09-19T05:45:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129551 s, 80.9 MB/s 2024-09-19T05:45:15.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.965 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146171 s, 71.7 MB/s 2024-09-19T05:45:15.982 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:15.982 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:15.982 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011679 s, 89.8 MB/s 2024-09-19T05:45:16.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.003 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147199 s, 71.2 MB/s 2024-09-19T05:45:16.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.023 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146955 s, 71.4 MB/s 2024-09-19T05:45:16.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.041 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120568 s, 87.0 MB/s 2024-09-19T05:45:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149551 s, 70.1 MB/s 2024-09-19T05:45:16.077 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.077 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.078 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108384 s, 96.7 MB/s 2024-09-19T05:45:16.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.097 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136699 s, 76.7 MB/s 2024-09-19T05:45:16.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.117 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142203 s, 73.7 MB/s 2024-09-19T05:45:16.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.173 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.173 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143682 s, 73.0 MB/s 2024-09-19T05:45:16.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.192 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147613 s, 71.0 MB/s 2024-09-19T05:45:16.209 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.209 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.209 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121675 s, 86.2 MB/s 2024-09-19T05:45:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135481 s, 77.4 MB/s 2024-09-19T05:45:16.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.245 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132781 s, 79.0 MB/s 2024-09-19T05:45:16.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.262 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128647 s, 81.5 MB/s 2024-09-19T05:45:16.279 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.279 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.279 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013217 s, 79.3 MB/s 2024-09-19T05:45:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115917 s, 90.5 MB/s 2024-09-19T05:45:16.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.313 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133935 s, 78.3 MB/s 2024-09-19T05:45:16.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:16.322 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:16.322 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:16.322 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.30 2024-09-19T05:45:16.322 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:16.322 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:16.322 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:16.322 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:16.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:16.390 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.391 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123974 s, 84.6 MB/s 2024-09-19T05:45:16.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.406 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115312 s, 90.9 MB/s 2024-09-19T05:45:16.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.421 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107102 s, 97.9 MB/s 2024-09-19T05:45:16.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.434 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990987 s, 106 MB/s 2024-09-19T05:45:16.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.451 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125413 s, 83.6 MB/s 2024-09-19T05:45:16.466 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.467 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114646 s, 91.5 MB/s 2024-09-19T05:45:16.485 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.485 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.485 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133328 s, 78.6 MB/s 2024-09-19T05:45:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.503 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119352 s, 87.9 MB/s 2024-09-19T05:45:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137764 s, 76.1 MB/s 2024-09-19T05:45:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112605 s, 93.1 MB/s 2024-09-19T05:45:16.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.559 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134021 s, 78.2 MB/s 2024-09-19T05:45:16.578 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.579 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140046 s, 74.9 MB/s 2024-09-19T05:45:16.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.599 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144237 s, 72.7 MB/s 2024-09-19T05:45:16.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.618 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.618 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124372 s, 84.3 MB/s 2024-09-19T05:45:16.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.638 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014498 s, 72.3 MB/s 2024-09-19T05:45:16.656 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.656 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.656 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128127 s, 81.8 MB/s 2024-09-19T05:45:16.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.675 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135036 s, 77.7 MB/s 2024-09-19T05:45:16.690 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.690 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.690 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995201 s, 105 MB/s 2024-09-19T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132096 s, 79.4 MB/s 2024-09-19T05:45:16.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.727 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127173 s, 82.5 MB/s 2024-09-19T05:45:16.746 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.746 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.746 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132821 s, 78.9 MB/s 2024-09-19T05:45:16.762 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.762 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.762 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120201 s, 87.2 MB/s 2024-09-19T05:45:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142116 s, 73.8 MB/s 2024-09-19T05:45:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134468 s, 78.0 MB/s 2024-09-19T05:45:16.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.815 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118545 s, 88.5 MB/s 2024-09-19T05:45:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152582 s, 68.7 MB/s 2024-09-19T05:45:16.852 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.852 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.852 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126397 s, 83.0 MB/s 2024-09-19T05:45:16.870 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.870 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.871 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142493 s, 73.6 MB/s 2024-09-19T05:45:16.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.888 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126093 s, 83.2 MB/s 2024-09-19T05:45:16.905 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.905 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.905 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123366 s, 85.0 MB/s 2024-09-19T05:45:16.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.923 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.923 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132734 s, 79.0 MB/s 2024-09-19T05:45:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011621 s, 90.2 MB/s 2024-09-19T05:45:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:16.946 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:16.947 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:16.947 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.31 2024-09-19T05:45:16.947 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:16.947 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:16.947 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:16.947 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:17.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:17.061 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.062 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.062 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116135 s, 90.3 MB/s 2024-09-19T05:45:17.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.079 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128272 s, 81.7 MB/s 2024-09-19T05:45:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120556 s, 87.0 MB/s 2024-09-19T05:45:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109864 s, 95.4 MB/s 2024-09-19T05:45:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.130 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157473 s, 66.6 MB/s 2024-09-19T05:45:17.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.180 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.180 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137812 s, 76.1 MB/s 2024-09-19T05:45:17.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.199 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141509 s, 74.1 MB/s 2024-09-19T05:45:17.216 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.216 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.216 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131536 s, 79.7 MB/s 2024-09-19T05:45:17.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.233 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128166 s, 81.8 MB/s 2024-09-19T05:45:17.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.251 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136956 s, 76.6 MB/s 2024-09-19T05:45:17.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.266 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116208 s, 90.2 MB/s 2024-09-19T05:45:17.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.283 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012454 s, 84.2 MB/s 2024-09-19T05:45:17.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.306 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185296 s, 56.6 MB/s 2024-09-19T05:45:17.323 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.324 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.324 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138211 s, 75.9 MB/s 2024-09-19T05:45:17.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.339 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112565 s, 93.2 MB/s 2024-09-19T05:45:17.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.357 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133085 s, 78.8 MB/s 2024-09-19T05:45:17.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.377 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015134 s, 69.3 MB/s 2024-09-19T05:45:17.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.393 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012398 s, 84.6 MB/s 2024-09-19T05:45:17.411 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.411 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.411 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013864 s, 75.6 MB/s 2024-09-19T05:45:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131506 s, 79.7 MB/s 2024-09-19T05:45:17.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.446 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131836 s, 79.5 MB/s 2024-09-19T05:45:17.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.464 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142689 s, 73.5 MB/s 2024-09-19T05:45:17.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.482 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.482 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128323 s, 81.7 MB/s 2024-09-19T05:45:17.499 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.499 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.499 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126645 s, 82.8 MB/s 2024-09-19T05:45:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134164 s, 78.2 MB/s 2024-09-19T05:45:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132963 s, 78.9 MB/s 2024-09-19T05:45:17.552 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.552 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.552 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128606 s, 81.5 MB/s 2024-09-19T05:45:17.570 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.570 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.570 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132989 s, 78.8 MB/s 2024-09-19T05:45:17.588 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.589 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143928 s, 72.9 MB/s 2024-09-19T05:45:17.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.606 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012624 s, 83.1 MB/s 2024-09-19T05:45:17.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107327 s, 97.7 MB/s 2024-09-19T05:45:17.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:17.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:17.637 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01213 s, 86.4 MB/s 2024-09-19T05:45:17.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:17.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:17.645 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub start /scrub_control_test_path recursive 2024-09-19T05:45:17.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee95ac640 1 Processor -- start 2024-09-19T05:45:17.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee95ac640 1 -- start start 2024-09-19T05:45:17.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee95ac640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee40d37a0 0x7fbee40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee95ac640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbee40cfe30 0x7fbee40b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee95ac640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbee415ead0 con 0x7fbee415e6f0 2024-09-19T05:45:17.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee95ac640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fbee40ceb40 con 0x7fbee40cfe30 2024-09-19T05:45:17.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee95ac640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbee40ced90 con 0x7fbee40d37a0 2024-09-19T05:45:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee27fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee40d37a0 0x7fbee40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbee40cfe30 0x7fbee40b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee27fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee40d37a0 0x7fbee40b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:59556/0 (socket says 172.21.15.67:59556) 2024-09-19T05:45:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.779+0000 7fbee27fc640 1 -- 172.21.15.67:0/1463633777 learned_addr learned my addr 172.21.15.67:0/1463633777 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee1ffb640 1 -- 172.21.15.67:0/1463633777 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1563492985 0 0) 0x7fbee415ead0 con 0x7fbee415e6f0 2024-09-19T05:45:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee1ffb640 1 -- 172.21.15.67:0/1463633777 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbecc003530 con 0x7fbee415e6f0 2024-09-19T05:45:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee27fc640 1 -- 172.21.15.67:0/1463633777 >> v2:172.21.15.97:3300/0 conn(0x7fbee40cfe30 msgr2=0x7fbee40b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee27fc640 1 --2- 172.21.15.67:0/1463633777 >> v2:172.21.15.97:3300/0 conn(0x7fbee40cfe30 0x7fbee40b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee27fc640 1 -- 172.21.15.67:0/1463633777 >> v1:172.21.15.97:6789/0 conn(0x7fbee415e6f0 legacy=0x7fbee40d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee27fc640 1 -- 172.21.15.67:0/1463633777 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee40cf070 con 0x7fbee40d37a0 2024-09-19T05:45:17.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee27fc640 1 --2- 172.21.15.67:0/1463633777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee40d37a0 0x7fbee40b5f70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009870 tx=0x7fbed801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=237cb54412ced95b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee1ffb640 1 -- 172.21.15.67:0/1463633777 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed80b0070 con 0x7fbee40d37a0 2024-09-19T05:45:17.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee1ffb640 1 -- 172.21.15.67:0/1463633777 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed80ab600 con 0x7fbee40d37a0 2024-09-19T05:45:17.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee1ffb640 1 -- 172.21.15.67:0/1463633777 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed80ab9b0 con 0x7fbee40d37a0 2024-09-19T05:45:17.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee95ac640 1 -- 172.21.15.67:0/1463633777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee40d37a0 msgr2=0x7fbee40b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.783+0000 7fbee95ac640 1 --2- 172.21.15.67:0/1463633777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee40d37a0 0x7fbee40b5f70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009870 tx=0x7fbed801c410 comp rx=0 tx=0).stop 2024-09-19T05:45:17.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 -- 172.21.15.67:0/1463633777 shutdown_connections 2024-09-19T05:45:17.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 --2- 172.21.15.67:0/1463633777 >> v2:172.21.15.97:3300/0 conn(0x7fbee40cfe30 0x7fbee40b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 --2- 172.21.15.67:0/1463633777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee40d37a0 0x7fbee40b5f70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 -- 172.21.15.67:0/1463633777 >> 172.21.15.67:0/1463633777 conn(0x7fbee408bfc0 msgr2=0x7fbee40d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:17.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 -- 172.21.15.67:0/1463633777 shutdown_connections 2024-09-19T05:45:17.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 -- 172.21.15.67:0/1463633777 wait complete. 2024-09-19T05:45:17.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 Processor -- start 2024-09-19T05:45:17.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 -- start start 2024-09-19T05:45:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee40cfe30 0x7fbee41563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbee40d37a0 0x7fbee415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee415e6f0 0x7fbee415c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbee406d770 con 0x7fbee40cfe30 2024-09-19T05:45:17.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbee406d5f0 con 0x7fbee40d37a0 2024-09-19T05:45:17.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbee406d8f0 con 0x7fbee415e6f0 2024-09-19T05:45:17.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee40cfe30 0x7fbee41563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee40cfe30 0x7fbee41563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45096/0 (socket says 172.21.15.67:45096) 2024-09-19T05:45:17.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee2ffd640 1 -- 172.21.15.67:0/144190437 learned_addr learned my addr 172.21.15.67:0/144190437 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:17.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee27fc640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbee40d37a0 0x7fbee415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee37fe640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee415e6f0 0x7fbee415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee2ffd640 1 -- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee415e6f0 msgr2=0x7fbee415c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee2ffd640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee415e6f0 0x7fbee415c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee2ffd640 1 -- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbee40d37a0 msgr2=0x7fbee415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee2ffd640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbee40d37a0 0x7fbee415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee2ffd640 1 -- 172.21.15.67:0/144190437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee40b97a0 con 0x7fbee40cfe30 2024-09-19T05:45:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee2ffd640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee40cfe30 0x7fbee41563d0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c430 tx=0x7fbed400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbecb7fe640 1 -- 172.21.15.67:0/144190437 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4017070 con 0x7fbee40cfe30 2024-09-19T05:45:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbecb7fe640 1 -- 172.21.15.67:0/144190437 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed40052f0 con 0x7fbee40cfe30 2024-09-19T05:45:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbecb7fe640 1 -- 172.21.15.67:0/144190437 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4003840 con 0x7fbee40cfe30 2024-09-19T05:45:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 -- 172.21.15.67:0/144190437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee40b9ae0 con 0x7fbee40cfe30 2024-09-19T05:45:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.787+0000 7fbee95ac640 1 -- 172.21.15.67:0/144190437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee414e130 con 0x7fbee40cfe30 2024-09-19T05:45:17.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbecb7fe640 1 -- 172.21.15.67:0/144190437 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbed401a070 con 0x7fbee40cfe30 2024-09-19T05:45:17.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbecb7fe640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbed00678f0 0x7fbed0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbecb7fe640 1 -- 172.21.15.67:0/144190437 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fbed4085270 con 0x7fbee40cfe30 2024-09-19T05:45:17.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee27fc640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbed00678f0 0x7fbed0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbeec668000 1 Processor -- start 2024-09-19T05:45:17.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbeec668000 1 -- start start 2024-09-19T05:45:17.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee27fc640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbed00678f0 0x7fbed0069db0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbed80ad000 tx=0x7fbed8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbeec668000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3e6d0 0x55a04da3eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbeec668000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04da3eff0 0x55a04d9f2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbeec668000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbeec668000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a04d842ba0 con 0x55a04d9f26a0 2024-09-19T05:45:17.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbeec668000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a04d7e8350 con 0x55a04da3eff0 2024-09-19T05:45:17.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbeec668000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a04d83eb60 con 0x55a04da3e6d0 2024-09-19T05:45:17.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45100/0 (socket says 172.21.15.67:45100) 2024-09-19T05:45:17.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee37fe640 1 -- 172.21.15.67:0/735472641 learned_addr learned my addr 172.21.15.67:0/735472641 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:17.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee2ffd640 1 --2- 172.21.15.67:0/735472641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3e6d0 0x55a04da3eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee27fc640 1 --2- 172.21.15.67:0/735472641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04da3eff0 0x55a04d9f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee37fe640 1 -- 172.21.15.67:0/735472641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3e6d0 msgr2=0x55a04da3eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee37fe640 1 --2- 172.21.15.67:0/735472641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3e6d0 0x55a04da3eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee37fe640 1 -- 172.21.15.67:0/735472641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04da3eff0 msgr2=0x55a04d9f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee37fe640 1 --2- 172.21.15.67:0/735472641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04da3eff0 0x55a04d9f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee37fe640 1 -- 172.21.15.67:0/735472641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04d7ebbd0 con 0x55a04d9f26a0 2024-09-19T05:45:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.791+0000 7fbee37fe640 1 --2- 172.21.15.67:0/735472641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f2a80 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0074c0 tx=0x7fbedc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a55d113a6cc18dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbec8ff9640 1 -- 172.21.15.67:0/735472641 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc019020 con 0x55a04d9f26a0 2024-09-19T05:45:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbec8ff9640 1 -- 172.21.15.67:0/735472641 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbedc015600 con 0x55a04d9f26a0 2024-09-19T05:45:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbec8ff9640 1 -- 172.21.15.67:0/735472641 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc0159d0 con 0x55a04d9f26a0 2024-09-19T05:45:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- 172.21.15.67:0/735472641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 msgr2=0x55a04d9f2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 --2- 172.21.15.67:0/735472641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f2a80 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0074c0 tx=0x7fbedc009750 comp rx=0 tx=0).stop 2024-09-19T05:45:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- 172.21.15.67:0/735472641 shutdown_connections 2024-09-19T05:45:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 --2- 172.21.15.67:0/735472641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f2a80 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 --2- 172.21.15.67:0/735472641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04da3eff0 0x55a04d9f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 --2- 172.21.15.67:0/735472641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3e6d0 0x55a04da3eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- 172.21.15.67:0/735472641 >> 172.21.15.67:0/735472641 conn(0x55a04da1f470 msgr2=0x55a04da21860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:17.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- 172.21.15.67:0/735472641 shutdown_connections 2024-09-19T05:45:17.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- 172.21.15.67:0/735472641 wait complete. 2024-09-19T05:45:17.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- start start 2024-09-19T05:45:17.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 Processor -- start 2024-09-19T05:45:17.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04da3e6d0 0x55a04d9fa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3eff0 0x55a04d9f7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a04d7dc2a0 con 0x55a04d9f26a0 2024-09-19T05:45:17.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a04d8017d0 con 0x55a04da3e6d0 2024-09-19T05:45:17.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a04d803f70 con 0x55a04da3eff0 2024-09-19T05:45:17.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 10 client.0 _ll_register_callbacks cb 0x55a04d9dfb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:17.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45102/0 (socket says 172.21.15.67:45102) 2024-09-19T05:45:17.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee2ffd640 1 -- 172.21.15.67:0/242304198 learned_addr learned my addr 172.21.15.67:0/242304198 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee27fc640 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04da3e6d0 0x55a04d9fa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee37fe640 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3eff0 0x55a04d9f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee2ffd640 1 -- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3eff0 msgr2=0x55a04d9f7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee2ffd640 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3eff0 0x55a04d9f7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee2ffd640 1 -- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04da3e6d0 msgr2=0x55a04d9fa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee2ffd640 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04da3e6d0 0x55a04d9fa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee2ffd640 1 -- 172.21.15.67:0/242304198 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a04d84b810 con 0x55a04d9f26a0 2024-09-19T05:45:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee2ffd640 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f9d80 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c400 tx=0x7fbed40055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c525ba5d4b5d548 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbec1ffb640 1 -- 172.21.15.67:0/242304198 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed405e030 con 0x55a04d9f26a0 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbec1ffb640 1 -- 172.21.15.67:0/242304198 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fbed406d180 con 0x55a04d9f26a0 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- 172.21.15.67:0/242304198 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbedc015600 con 0x55a04d9f26a0 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbec1ffb640 1 -- 172.21.15.67:0/242304198 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fbed406d380 con 0x55a04d9f26a0 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 10 client.9216 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- 172.21.15.67:0/242304198 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55a04d7ec9f0 con 0x55a04d9f26a0 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbec1ffb640 1 -- 172.21.15.67:0/242304198 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbedc015600 con 0x55a04d9f26a0 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbec1ffb640 1 -- 172.21.15.67:0/242304198 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fbed40548a0 con 0x55a04d9f26a0 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 10 client.9216 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 10 client.9216 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 20 client.9216 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55a04da44a50 0x55a04da44e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 4 client.9216 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbeec668000 1 -- 172.21.15.67:0/242304198 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a04d7dcbd0 con 0x55a04da44a50 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.795+0000 7fbee27fc640 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55a04da44a50 0x55a04da44e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbec1ffb640 10 client.9216 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbee27fc640 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55a04da44a50 0x55a04da44e30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2da377a6577b7bbe server_cookie=1bc8bc9b408a759a in_seq=0 out_seq=0 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbec1ffb640 1 -- 172.21.15.67:0/242304198 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a04d7dcbd0 con 0x55a04da44a50 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbec1ffb640 10 client.9216 handle_command_reply: tid=0 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 client.9216 shutdown 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 -- 172.21.15.67:0/242304198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 msgr2=0x55a04d9f9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f9d80 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c400 tx=0x7fbed40055e0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 -- 172.21.15.67:0/242304198 shutdown_connections 2024-09-19T05:45:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55a04da44a50 0x55a04da44e30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3eff0 0x55a04d9f7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04da3e6d0 0x55a04d9fa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbec1ffb640 0 client.9216 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 --2- 172.21.15.67:0/242304198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04d9f26a0 0x55a04d9f9d80 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 -- 172.21.15.67:0/242304198 >> 172.21.15.67:0/242304198 conn(0x55a04da1f470 msgr2=0x55a04da21860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 -- 172.21.15.67:0/242304198 shutdown_connections 2024-09-19T05:45:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 1 -- 172.21.15.67:0/242304198 wait complete. 2024-09-19T05:45:17.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.799+0000 7fbeec668000 20 client.9216 trim_cache size 0 max 16384 2024-09-19T05:45:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 Processor -- start 2024-09-19T05:45:17.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 -- start start 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04d9f26a0 0x55a04daae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3e6d0 0x55a04daae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3eff0 0x55a04daaede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbee4202c30 con 0x55a04da3e6d0 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbee414ce40 con 0x55a04d9f26a0 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbee414d490 con 0x55a04da3eff0 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbee27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3e6d0 0x55a04daae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbee27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3e6d0 0x55a04daae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45110/0 (socket says 172.21.15.67:45110) 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbee27fc640 1 -- 172.21.15.67:0/3910508711 learned_addr learned my addr 172.21.15.67:0/3910508711 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbee27fc640 1 -- 172.21.15.67:0/3910508711 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3eff0 msgr2=0x55a04daaede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbee27fc640 1 --2- 172.21.15.67:0/3910508711 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3eff0 0x55a04daaede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbee27fc640 1 -- 172.21.15.67:0/3910508711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04d9f26a0 msgr2=0x55a04daae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbee27fc640 1 --2- 172.21.15.67:0/3910508711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04d9f26a0 0x55a04daae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbee27fc640 1 -- 172.21.15.67:0/3910508711 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04da3ee20 con 0x55a04da3e6d0 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbee27fc640 1 --2- 172.21.15.67:0/3910508711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3e6d0 0x55a04daae8a0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fbed801a040 tx=0x7fbed8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58551b3d158bfb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbec3fff640 1 -- 172.21.15.67:0/3910508711 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed80d1070 con 0x55a04da3e6d0 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbec3fff640 1 -- 172.21.15.67:0/3910508711 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed8003d30 con 0x55a04da3e6d0 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbec3fff640 1 -- 172.21.15.67:0/3910508711 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed80b0040 con 0x55a04da3e6d0 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 -- 172.21.15.67:0/3910508711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3e6d0 msgr2=0x55a04daae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 --2- 172.21.15.67:0/3910508711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3e6d0 0x55a04daae8a0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fbed801a040 tx=0x7fbed8004740 comp rx=0 tx=0).stop 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 -- 172.21.15.67:0/3910508711 shutdown_connections 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 --2- 172.21.15.67:0/3910508711 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3eff0 0x55a04daaede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 --2- 172.21.15.67:0/3910508711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3e6d0 0x55a04daae8a0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 --2- 172.21.15.67:0/3910508711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04d9f26a0 0x55a04daae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 -- 172.21.15.67:0/3910508711 >> 172.21.15.67:0/3910508711 conn(0x55a04da1f470 msgr2=0x55a04d9f0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 -- 172.21.15.67:0/3910508711 shutdown_connections 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 -- 172.21.15.67:0/3910508711 wait complete. 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 -- start start 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.819+0000 7fbeec668000 1 Processor -- start 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04d9f26a0 0x55a04dab2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3e6d0 0x55a04dab28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3eff0 0x55a04da49180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a04d7eec10 con 0x55a04da3eff0 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a04d7e9e30 con 0x55a04d9f26a0 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55a04d7c78f0 con 0x55a04da3e6d0 2024-09-19T05:45:17.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 10 client.0 _ll_register_callbacks cb 0x7fbed40850b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3eff0 0x55a04da49180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3eff0 0x55a04da49180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45112/0 (socket says 172.21.15.67:45112) 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee37fe640 1 -- 172.21.15.67:0/809497218 learned_addr learned my addr 172.21.15.67:0/809497218 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee37fe640 1 -- 172.21.15.67:0/809497218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3e6d0 msgr2=0x55a04dab28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee37fe640 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3e6d0 0x55a04dab28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee37fe640 1 -- 172.21.15.67:0/809497218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04d9f26a0 msgr2=0x55a04dab2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee37fe640 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04d9f26a0 0x55a04dab2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee37fe640 1 -- 172.21.15.67:0/809497218 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a04d7e85a0 con 0x55a04da3eff0 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee37fe640 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3eff0 0x55a04da49180 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fbedc018040 tx=0x7fbedc004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d6d71df630ece3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbec1ffb640 1 -- 172.21.15.67:0/809497218 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc019040 con 0x55a04da3eff0 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbec1ffb640 1 -- 172.21.15.67:0/809497218 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fbedc01e630 con 0x55a04da3eff0 2024-09-19T05:45:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 1 -- 172.21.15.67:0/809497218 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed8003d30 con 0x55a04da3eff0 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbec1ffb640 1 -- 172.21.15.67:0/809497218 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fbedc030050 con 0x55a04da3eff0 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 10 client.9222 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 1 -- 172.21.15.67:0/809497218 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55a04d7e25b0 con 0x55a04da3eff0 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbec1ffb640 1 -- 172.21.15.67:0/809497218 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed8003d30 con 0x55a04da3eff0 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbec1ffb640 1 -- 172.21.15.67:0/809497218 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fbedc033020 con 0x55a04da3eff0 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 10 client.9222 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 10 client.9222 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 20 client.9222 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55a04da496c0 0x55a04da49ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 4 client.9222 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbeec668000 1 -- 172.21.15.67:0/809497218 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55a04d8502d0 con 0x55a04da496c0 2024-09-19T05:45:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee2ffd640 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55a04da496c0 0x55a04da49ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbee2ffd640 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55a04da496c0 0x55a04da49ad0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1daf3fe3425a425d server_cookie=54631c311c149652 in_seq=0 out_seq=0 2024-09-19T05:45:17.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.823+0000 7fbec1ffb640 10 client.9222 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:17.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbec1ffb640 1 -- 172.21.15.67:0/809497218 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a04d8502d0 con 0x55a04da496c0 2024-09-19T05:45:17.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbec1ffb640 10 client.9222 handle_command_reply: tid=0 2024-09-19T05:45:17.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 client.9222 shutdown 2024-09-19T05:45:17.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 -- 172.21.15.67:0/809497218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3eff0 msgr2=0x55a04da49180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3eff0 0x55a04da49180 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fbedc018040 tx=0x7fbedc004a50 comp rx=0 tx=0).stop 2024-09-19T05:45:17.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 -- 172.21.15.67:0/809497218 shutdown_connections 2024-09-19T05:45:17.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55a04da496c0 0x55a04da49ad0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a04da3eff0 0x55a04da49180 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a04da3e6d0 0x55a04dab28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbec1ffb640 0 client.9222 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:17.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 --2- 172.21.15.67:0/809497218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a04d9f26a0 0x55a04dab2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 -- 172.21.15.67:0/809497218 >> 172.21.15.67:0/809497218 conn(0x55a04da1f470 msgr2=0x55a04d9f1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:17.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 -- 172.21.15.67:0/809497218 shutdown_connections 2024-09-19T05:45:17.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 1 -- 172.21.15.67:0/809497218 wait complete. 2024-09-19T05:45:17.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.827+0000 7fbeec668000 20 client.9222 trim_cache size 0 max 16384 2024-09-19T05:45:17.829 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:45:17.829 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:45:17.829 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "ddf364ac-a302-4d07-b049-437331faea15", 2024-09-19T05:45:17.830 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:45:17.830 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 -- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbed00678f0 msgr2=0x7fbed0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbed00678f0 0x7fbed0069db0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbed80ad000 tx=0x7fbed8009040 comp rx=0 tx=0).stop 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 -- 172.21.15.67:0/144190437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee40cfe30 msgr2=0x7fbee41563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee40cfe30 0x7fbee41563d0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c430 tx=0x7fbed400c8f0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 -- 172.21.15.67:0/144190437 shutdown_connections 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbed00678f0 0x7fbed0069db0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee415e6f0 0x7fbee415c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbee40d37a0 0x7fbee415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 --2- 172.21.15.67:0/144190437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee40cfe30 0x7fbee41563d0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 -- 172.21.15.67:0/144190437 >> 172.21.15.67:0/144190437 conn(0x7fbee408bfc0 msgr2=0x7fbee40b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 -- 172.21.15.67:0/144190437 shutdown_connections 2024-09-19T05:45:17.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.831+0000 7fbee95ac640 1 -- 172.21.15.67:0/144190437 wait complete. 2024-09-19T05:45:17.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:17.844 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub pause 2024-09-19T05:45:17.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.975+0000 7f0ad7320640 1 Processor -- start 2024-09-19T05:45:17.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.975+0000 7f0ad7320640 1 -- start start 2024-09-19T05:45:17.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad7320640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ad015aa50 0x7f0ad006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad7320640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ad006eb60 0x7f0ad006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad7320640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0ad006f4e0 0x7f0ad00b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad7320640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad006d670 con 0x7f0ad006eb60 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad7320640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad015ae30 con 0x7f0ad006f4e0 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad7320640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad00b5a20 con 0x7f0ad015aa50 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad48bb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ad006eb60 0x7f0ad006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad48bb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ad006eb60 0x7f0ad006efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45120/0 (socket says 172.21.15.67:45120) 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad48bb640 1 -- 172.21.15.67:0/3784455216 learned_addr learned my addr 172.21.15.67:0/3784455216 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad58bd640 1 --2- 172.21.15.67:0/3784455216 >> v2:172.21.15.97:3300/0 conn(0x7f0ad006f4e0 0x7f0ad00b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/3784455216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ad015aa50 0x7f0ad006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad48bb640 1 -- 172.21.15.67:0/3784455216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ad015aa50 msgr2=0x7f0ad006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/3784455216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ad015aa50 0x7f0ad006c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad48bb640 1 -- 172.21.15.67:0/3784455216 >> v2:172.21.15.97:3300/0 conn(0x7f0ad006f4e0 msgr2=0x7f0ad00b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/3784455216 >> v2:172.21.15.97:3300/0 conn(0x7f0ad006f4e0 0x7f0ad00b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad48bb640 1 -- 172.21.15.67:0/3784455216 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad006f990 con 0x7f0ad006eb60 2024-09-19T05:45:17.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/3784455216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 0x7f0ad006efa0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0072750 tx=0x7f0ac001d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809bfc637f402eba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ac7fff640 1 -- 172.21.15.67:0/3784455216 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00b3070 con 0x7f0ad006eb60 2024-09-19T05:45:17.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ac7fff640 1 -- 172.21.15.67:0/3784455216 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac00a68e0 con 0x7f0ad006eb60 2024-09-19T05:45:17.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.979+0000 7f0ac7fff640 1 -- 172.21.15.67:0/3784455216 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac000b040 con 0x7f0ad006eb60 2024-09-19T05:45:17.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- 172.21.15.67:0/3784455216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 msgr2=0x7f0ad006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 --2- 172.21.15.67:0/3784455216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 0x7f0ad006efa0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0072750 tx=0x7f0ac001d8f0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- 172.21.15.67:0/3784455216 shutdown_connections 2024-09-19T05:45:17.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 --2- 172.21.15.67:0/3784455216 >> v2:172.21.15.97:3300/0 conn(0x7f0ad006f4e0 0x7f0ad00b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 --2- 172.21.15.67:0/3784455216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 0x7f0ad006efa0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 --2- 172.21.15.67:0/3784455216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ad015aa50 0x7f0ad006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- 172.21.15.67:0/3784455216 >> 172.21.15.67:0/3784455216 conn(0x7f0ad00cd770 msgr2=0x7f0ad00cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:17.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- 172.21.15.67:0/3784455216 shutdown_connections 2024-09-19T05:45:17.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- 172.21.15.67:0/3784455216 wait complete. 2024-09-19T05:45:17.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 Processor -- start 2024-09-19T05:45:17.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- start start 2024-09-19T05:45:17.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 0x7f0ad013ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ad006f4e0 0x7f0ad009c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ad015aa50 0x7f0ad00cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad00b4b90 con 0x7f0ad006eb60 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad00cedc0 con 0x7f0ad015aa50 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad00b4d10 con 0x7f0ad006f4e0 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad50bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 0x7f0ad013ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad50bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 0x7f0ad013ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45130/0 (socket says 172.21.15.67:45130) 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad50bc640 1 -- 172.21.15.67:0/1661103279 learned_addr learned my addr 172.21.15.67:0/1661103279 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad58bd640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ad015aa50 0x7f0ad00cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ad006f4e0 0x7f0ad009c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad50bc640 1 -- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ad006f4e0 msgr2=0x7f0ad009c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ad006f4e0 0x7f0ad009c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad50bc640 1 -- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ad015aa50 msgr2=0x7f0ad00cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ad015aa50 0x7f0ad00cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad50bc640 1 -- 172.21.15.67:0/1661103279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad009c9e0 con 0x7f0ad006eb60 2024-09-19T05:45:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 0x7f0ad013ef70 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00e870 tx=0x7f0acc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ac5ffb640 1 -- 172.21.15.67:0/1661103279 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc017070 con 0x7f0ad006eb60 2024-09-19T05:45:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ac5ffb640 1 -- 172.21.15.67:0/1661103279 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc00c940 con 0x7f0ad006eb60 2024-09-19T05:45:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- 172.21.15.67:0/1661103279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad009cc80 con 0x7f0ad006eb60 2024-09-19T05:45:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ac5ffb640 1 -- 172.21.15.67:0/1661103279 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc00ccf0 con 0x7f0ad006eb60 2024-09-19T05:45:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.983+0000 7f0ad7320640 1 -- 172.21.15.67:0/1661103279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad009d240 con 0x7f0ad006eb60 2024-09-19T05:45:17.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ac5ffb640 1 -- 172.21.15.67:0/1661103279 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0acc01a070 con 0x7f0ad006eb60 2024-09-19T05:45:17.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ac5ffb640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ab4067910 0x7f0ab4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ac5ffb640 1 -- 172.21.15.67:0/1661103279 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f0acc085b80 con 0x7f0ad006eb60 2024-09-19T05:45:17.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ab4067910 0x7f0ab4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ab4067910 0x7f0ab4069dd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00b0000 tx=0x7f0ac0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ada3dc000 1 Processor -- start 2024-09-19T05:45:17.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ada3dc000 1 -- start start 2024-09-19T05:45:17.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3ad3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3ad3670 0x561fd3a86650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3a86b90 0x561fd3a86f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561fd38d3cc0 con 0x561fd3ad2d50 2024-09-19T05:45:17.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561fd388ea20 con 0x561fd3a86b90 2024-09-19T05:45:17.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561fd38cfc80 con 0x561fd3ad3670 2024-09-19T05:45:17.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ad50bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3ad3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ad50bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3ad3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45132/0 (socket says 172.21.15.67:45132) 2024-09-19T05:45:17.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ad50bc640 1 -- 172.21.15.67:0/2101465172 learned_addr learned my addr 172.21.15.67:0/2101465172 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:17.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ad58bd640 1 --2- 172.21.15.67:0/2101465172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3a86b90 0x561fd3a86f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.987+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/2101465172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3ad3670 0x561fd3a86650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 -- 172.21.15.67:0/2101465172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3ad3670 msgr2=0x561fd3a86650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/2101465172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3ad3670 0x561fd3a86650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 -- 172.21.15.67:0/2101465172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3a86b90 msgr2=0x561fd3a86f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/2101465172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3a86b90 0x561fd3a86f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 -- 172.21.15.67:0/2101465172 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd3876d40 con 0x561fd3ad2d50 2024-09-19T05:45:17.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/2101465172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3ad3130 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f0acc05e510 tx=0x7f0acc055b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1142806804eea96b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0abaffd640 1 -- 172.21.15.67:0/2101465172 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc082070 con 0x561fd3ad2d50 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0abaffd640 1 -- 172.21.15.67:0/2101465172 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc05ea40 con 0x561fd3ad2d50 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0abaffd640 1 -- 172.21.15.67:0/2101465172 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc021040 con 0x561fd3ad2d50 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2101465172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 msgr2=0x561fd3ad3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/2101465172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3ad3130 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f0acc05e510 tx=0x7f0acc055b80 comp rx=0 tx=0).stop 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2101465172 shutdown_connections 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/2101465172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3a86b90 0x561fd3a86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/2101465172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3ad3670 0x561fd3a86650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/2101465172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3ad3130 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2101465172 >> 172.21.15.67:0/2101465172 conn(0x561fd3aaf9b0 msgr2=0x561fd3ab1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2101465172 shutdown_connections 2024-09-19T05:45:17.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2101465172 wait complete. 2024-09-19T05:45:17.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- start start 2024-09-19T05:45:17.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 Processor -- start 2024-09-19T05:45:17.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3a86b90 0x561fd3ada080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad2d50 0x561fd3ada5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3ad3670 0x561fd3a92de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561fd386d2c0 con 0x561fd3a86b90 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561fd3892370 con 0x561fd3ad2d50 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561fd38e1f50 con 0x561fd3ad3670 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3a86b90 0x561fd3ada080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3a86b90 0x561fd3ada080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45146/0 (socket says 172.21.15.67:45146) 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 -- 172.21.15.67:0/2226126832 learned_addr learned my addr 172.21.15.67:0/2226126832 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 10 client.0 _ll_register_callbacks cb 0x561fd3934db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad2d50 0x561fd3ada5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad58bd640 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3ad3670 0x561fd3a92de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 -- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3ad3670 msgr2=0x561fd3a92de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3ad3670 0x561fd3a92de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 -- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad2d50 msgr2=0x561fd3ada5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad2d50 0x561fd3ada5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 -- 172.21.15.67:0/2226126832 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd3873770 con 0x561fd3a86b90 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3a86b90 0x561fd3ada080 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00e840 tx=0x7f0acc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d187c7528c423cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0aaffff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0aaffff640 1 -- 172.21.15.67:0/2226126832 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc082070 con 0x561fd3a86b90 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2226126832 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0acc05ea40 con 0x561fd3a86b90 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0aaffff640 1 -- 172.21.15.67:0/2226126832 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f0acc05e5b0 con 0x561fd3a86b90 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0aaffff640 1 -- 172.21.15.67:0/2226126832 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f0acc021040 con 0x561fd3a86b90 2024-09-19T05:45:17.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 10 client.9234 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:17.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2226126832 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x561fd38913f0 con 0x561fd3a86b90 2024-09-19T05:45:17.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0aaffff640 1 -- 172.21.15.67:0/2226126832 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc05ea40 con 0x561fd3a86b90 2024-09-19T05:45:17.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.991+0000 7f0aaffff640 1 -- 172.21.15.67:0/2226126832 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7f0acc06b070 con 0x561fd3a86b90 2024-09-19T05:45:17.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 10 client.9234 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:17.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 10 client.9234 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:17.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 20 client.9234 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:17.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x561fd3a937f0 0x561fd3a93bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:17.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 4 client.9234 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:17.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2226126832 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fd386dd90 con 0x561fd3a937f0 2024-09-19T05:45:17.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x561fd3a937f0 0x561fd3a93bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:17.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x561fd3a937f0 0x561fd3a93bd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55a43410c81d1e5c server_cookie=923534c8fd667e9e in_seq=0 out_seq=0 2024-09-19T05:45:17.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0aaffff640 10 client.9234 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:17.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0aaffff640 1 -- 172.21.15.67:0/2226126832 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fd386dd90 con 0x561fd3a937f0 2024-09-19T05:45:18.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0aaffff640 10 client.9234 handle_command_reply: tid=0 2024-09-19T05:45:18.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 client.9234 shutdown 2024-09-19T05:45:18.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2226126832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3a86b90 msgr2=0x561fd3ada080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3a86b90 0x561fd3ada080 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00e840 tx=0x7f0acc01d000 comp rx=0 tx=0).stop 2024-09-19T05:45:18.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2226126832 shutdown_connections 2024-09-19T05:45:18.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x561fd3a937f0 0x561fd3a93bd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3ad3670 0x561fd3a92de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad2d50 0x561fd3ada5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0aaffff640 0 client.9234 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:18.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/2226126832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3a86b90 0x561fd3ada080 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2226126832 >> 172.21.15.67:0/2226126832 conn(0x561fd3aaf9b0 msgr2=0x561fd3a88f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2226126832 shutdown_connections 2024-09-19T05:45:18.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 1 -- 172.21.15.67:0/2226126832 wait complete. 2024-09-19T05:45:18.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:17.995+0000 7f0ada3dc000 20 client.9234 trim_cache size 0 max 16384 2024-09-19T05:45:18.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.011+0000 7f0ada3dc000 1 Processor -- start 2024-09-19T05:45:18.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.011+0000 7f0ada3dc000 1 -- start start 2024-09-19T05:45:18.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3a86b90 0x561fd3aea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3aea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad3670 0x561fd3adfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad0168d90 con 0x561fd3ad2d50 2024-09-19T05:45:18.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad009b340 con 0x561fd3ad3670 2024-09-19T05:45:18.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad0168740 con 0x561fd3a86b90 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad48bb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3aea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad48bb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3aea9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45158/0 (socket says 172.21.15.67:45158) 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad48bb640 1 -- 172.21.15.67:0/1751149296 learned_addr learned my addr 172.21.15.67:0/1751149296 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/1751149296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3a86b90 0x561fd3aea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad58bd640 1 --2- 172.21.15.67:0/1751149296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad3670 0x561fd3adfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad48bb640 1 -- 172.21.15.67:0/1751149296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3a86b90 msgr2=0x561fd3aea4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/1751149296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3a86b90 0x561fd3aea4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad48bb640 1 -- 172.21.15.67:0/1751149296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad3670 msgr2=0x561fd3adfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/1751149296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad3670 0x561fd3adfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad48bb640 1 -- 172.21.15.67:0/1751149296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd3ad34a0 con 0x561fd3ad2d50 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/1751149296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3aea9e0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000a1c0 tx=0x7f0ac00a8070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd35e4d345c4fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0aba7fc640 1 -- 172.21.15.67:0/1751149296 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00d1070 con 0x561fd3ad2d50 2024-09-19T05:45:18.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0aba7fc640 1 -- 172.21.15.67:0/1751149296 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac00ae640 con 0x561fd3ad2d50 2024-09-19T05:45:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0aba7fc640 1 -- 172.21.15.67:0/1751149296 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00b3040 con 0x561fd3ad2d50 2024-09-19T05:45:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- 172.21.15.67:0/1751149296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 msgr2=0x561fd3aea9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/1751149296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3aea9e0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000a1c0 tx=0x7f0ac00a8070 comp rx=0 tx=0).stop 2024-09-19T05:45:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- 172.21.15.67:0/1751149296 shutdown_connections 2024-09-19T05:45:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/1751149296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad3670 0x561fd3adfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/1751149296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad2d50 0x561fd3aea9e0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/1751149296 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3a86b90 0x561fd3aea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- 172.21.15.67:0/1751149296 >> 172.21.15.67:0/1751149296 conn(0x561fd3aaf9b0 msgr2=0x561fd3a81230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- 172.21.15.67:0/1751149296 shutdown_connections 2024-09-19T05:45:18.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- 172.21.15.67:0/1751149296 wait complete. 2024-09-19T05:45:18.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- start start 2024-09-19T05:45:18.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 Processor -- start 2024-09-19T05:45:18.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3a86b90 0x561fd3b45e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad2d50 0x561fd3ae9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad3670 0x561fd3ae99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561fd387b120 con 0x561fd3ad3670 2024-09-19T05:45:18.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561fd3954e90 con 0x561fd3ad2d50 2024-09-19T05:45:18.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561fd387db90 con 0x561fd3a86b90 2024-09-19T05:45:18.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ada3dc000 10 client.0 _ll_register_callbacks cb 0x7f0acc080070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:18.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad58bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad3670 0x561fd3ae99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad58bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad3670 0x561fd3ae99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45160/0 (socket says 172.21.15.67:45160) 2024-09-19T05:45:18.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad58bd640 1 -- 172.21.15.67:0/3182686051 learned_addr learned my addr 172.21.15.67:0/3182686051 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:18.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3a86b90 0x561fd3b45e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad48bb640 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad2d50 0x561fd3ae9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad58bd640 1 -- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3a86b90 msgr2=0x561fd3b45e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad58bd640 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3a86b90 0x561fd3b45e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad58bd640 1 -- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad2d50 msgr2=0x561fd3ae9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad58bd640 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad2d50 0x561fd3ae9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad58bd640 1 -- 172.21.15.67:0/3182686051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd3955320 con 0x561fd3ad3670 2024-09-19T05:45:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0ad58bd640 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad3670 0x561fd3ae99d0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8018fd0 tx=0x7f0ac8015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3ffabbf1ce7710 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.015+0000 7f0aaffff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0aaffff640 1 -- 172.21.15.67:0/3182686051 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8018340 con 0x561fd3ad3670 2024-09-19T05:45:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0aaffff640 1 -- 172.21.15.67:0/3182686051 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f0ac8023c90 con 0x561fd3ad3670 2024-09-19T05:45:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 -- 172.21.15.67:0/3182686051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ac00ae640 con 0x561fd3ad3670 2024-09-19T05:45:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0aaffff640 1 -- 172.21.15.67:0/3182686051 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f0ac8016400 con 0x561fd3ad3670 2024-09-19T05:45:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 10 client.9240 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 -- 172.21.15.67:0/3182686051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x561fd38675c0 con 0x561fd3ad3670 2024-09-19T05:45:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0aaffff640 1 -- 172.21.15.67:0/3182686051 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac00ae640 con 0x561fd3ad3670 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0aaffff640 1 -- 172.21.15.67:0/3182686051 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7f0ac80165a0 con 0x561fd3ad3670 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 10 client.9240 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 10 client.9240 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 20 client.9240 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x561fd3ae9f10 0x561fd3aea320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 4 client.9240 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 -- 172.21.15.67:0/3182686051 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x561fd38e13f0 con 0x561fd3ae9f10 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x561fd3ae9f10 0x561fd3aea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad50bc640 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x561fd3ae9f10 0x561fd3aea320 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=385a4762fca108b8 server_cookie=cb3c5c6d22c1df77 in_seq=0 out_seq=0 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0aaffff640 10 client.9240 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0aaffff640 1 -- 172.21.15.67:0/3182686051 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561fd38e13f0 con 0x561fd3ae9f10 2024-09-19T05:45:18.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0aaffff640 10 client.9240 handle_command_reply: tid=0 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 client.9240 shutdown 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 -- 172.21.15.67:0/3182686051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad3670 msgr2=0x561fd3ae99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad3670 0x561fd3ae99d0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8018fd0 tx=0x7f0ac8015820 comp rx=0 tx=0).stop 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 -- 172.21.15.67:0/3182686051 shutdown_connections 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x561fd3ae9f10 0x561fd3aea320 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561fd3ad3670 0x561fd3ae99d0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561fd3ad2d50 0x561fd3ae9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 --2- 172.21.15.67:0/3182686051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561fd3a86b90 0x561fd3b45e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0aaffff640 0 client.9240 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 -- 172.21.15.67:0/3182686051 >> 172.21.15.67:0/3182686051 conn(0x561fd3aaf9b0 msgr2=0x561fd3a91950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 -- 172.21.15.67:0/3182686051 shutdown_connections 2024-09-19T05:45:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 1 -- 172.21.15.67:0/3182686051 wait complete. 2024-09-19T05:45:18.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ada3dc000 20 client.9240 trim_cache size 0 max 16384 2024-09-19T05:45:18.024 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:45:18.025 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:45:18.025 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:45:18.025 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:45:18.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 -- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ab4067910 msgr2=0x7f0ab4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ab4067910 0x7f0ab4069dd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00b0000 tx=0x7f0ac0008040 comp rx=0 tx=0).stop 2024-09-19T05:45:18.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 -- 172.21.15.67:0/1661103279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 msgr2=0x7f0ad013ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 0x7f0ad013ef70 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00e870 tx=0x7f0acc00ec70 comp rx=0 tx=0).stop 2024-09-19T05:45:18.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 -- 172.21.15.67:0/1661103279 shutdown_connections 2024-09-19T05:45:18.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ad015aa50 0x7f0ad00cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0ab4067910 0x7f0ab4069dd0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ad006f4e0 0x7f0ad009c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 --2- 172.21.15.67:0/1661103279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad006eb60 0x7f0ad013ef70 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 -- 172.21.15.67:0/1661103279 >> 172.21.15.67:0/1661103279 conn(0x7f0ad00cd770 msgr2=0x7f0ad0157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 -- 172.21.15.67:0/1661103279 shutdown_connections 2024-09-19T05:45:18.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.019+0000 7f0ad7320640 1 -- 172.21.15.67:0/1661103279 wait complete. 2024-09-19T05:45:18.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:18.033 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-19T05:45:18.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.155+0000 7fdbf7bdf640 1 Processor -- start 2024-09-19T05:45:18.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.155+0000 7fdbf7bdf640 1 -- start start 2024-09-19T05:45:18.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf7bdf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdbf00d4fb0 0x7fdbf00d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf7bdf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdbf00d13c0 0x7fdbf006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf7bdf640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbf00d35a0 con 0x7fdbf015e690 2024-09-19T05:45:18.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf7bdf640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdbf00d17f0 con 0x7fdbf00d13c0 2024-09-19T05:45:18.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf7bdf640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fdbf00d32c0 con 0x7fdbf00d4fb0 2024-09-19T05:45:18.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf617c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdbf00d13c0 0x7fdbf006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf597b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdbf015e690 0x7fdbf00d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55202/0 (socket says 172.21.15.67:55202) 2024-09-19T05:45:18.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf597b640 1 -- 172.21.15.67:0/706634780 learned_addr learned my addr 172.21.15.67:0/706634780 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:18.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf517a640 1 --2- 172.21.15.67:0/706634780 >> v2:172.21.15.97:3300/0 conn(0x7fdbf00d4fb0 0x7fdbf00d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf617c640 1 -- 172.21.15.67:0/706634780 >> v2:172.21.15.97:3300/0 conn(0x7fdbf00d4fb0 msgr2=0x7fdbf00d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf617c640 1 --2- 172.21.15.67:0/706634780 >> v2:172.21.15.97:3300/0 conn(0x7fdbf00d4fb0 0x7fdbf00d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf617c640 1 -- 172.21.15.67:0/706634780 >> v1:172.21.15.67:6789/0 conn(0x7fdbf015e690 legacy=0x7fdbf00d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf617c640 1 -- 172.21.15.67:0/706634780 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf006d040 con 0x7fdbf00d13c0 2024-09-19T05:45:18.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf4979640 1 -- 172.21.15.67:0/706634780 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3397495893 0 0) 0x7fdbf00d35a0 con 0x7fdbf015e690 2024-09-19T05:45:18.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf617c640 1 --2- 172.21.15.67:0/706634780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf00d13c0 0x7fdbf006db20 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00d3770 tx=0x7fdbe801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae90f5f1a3c46c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf4979640 1 -- 172.21.15.67:0/706634780 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80b2070 con 0x7fdbf00d13c0 2024-09-19T05:45:18.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf4979640 1 -- 172.21.15.67:0/706634780 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe80a59c0 con 0x7fdbf00d13c0 2024-09-19T05:45:18.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.159+0000 7fdbf4979640 1 -- 172.21.15.67:0/706634780 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80a5d90 con 0x7fdbf00d13c0 2024-09-19T05:45:18.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/706634780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf00d13c0 msgr2=0x7fdbf006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 --2- 172.21.15.67:0/706634780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf00d13c0 0x7fdbf006db20 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00d3770 tx=0x7fdbe801c900 comp rx=0 tx=0).stop 2024-09-19T05:45:18.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/706634780 shutdown_connections 2024-09-19T05:45:18.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 --2- 172.21.15.67:0/706634780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf00d13c0 0x7fdbf006db20 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 --2- 172.21.15.67:0/706634780 >> v2:172.21.15.97:3300/0 conn(0x7fdbf00d4fb0 0x7fdbf00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/706634780 >> 172.21.15.67:0/706634780 conn(0x7fdbf00d4490 msgr2=0x7fdbf00d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/706634780 shutdown_connections 2024-09-19T05:45:18.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/706634780 wait complete. 2024-09-19T05:45:18.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 Processor -- start 2024-09-19T05:45:18.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- start start 2024-09-19T05:45:18.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf00d13c0 0x7fdbf015b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdbf00d4fb0 0x7fdbf00b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf015e690 0x7fdbf0153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf006e9f0 con 0x7fdbf015e690 2024-09-19T05:45:18.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf006e870 con 0x7fdbf00d13c0 2024-09-19T05:45:18.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf006eb70 con 0x7fdbf00d4fb0 2024-09-19T05:45:18.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf617c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf015e690 0x7fdbf0153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf617c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf015e690 0x7fdbf0153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45170/0 (socket says 172.21.15.67:45170) 2024-09-19T05:45:18.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf617c640 1 -- 172.21.15.67:0/1799784168 learned_addr learned my addr 172.21.15.67:0/1799784168 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:18.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf597b640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf00d13c0 0x7fdbf015b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf517a640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdbf00d4fb0 0x7fdbf00b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf617c640 1 -- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdbf00d4fb0 msgr2=0x7fdbf00b9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf617c640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdbf00d4fb0 0x7fdbf00b9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf617c640 1 -- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf00d13c0 msgr2=0x7fdbf015b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf617c640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf00d13c0 0x7fdbf015b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf617c640 1 -- 172.21.15.67:0/1799784168 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf015c4c0 con 0x7fdbf015e690 2024-09-19T05:45:18.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf597b640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf00d13c0 0x7fdbf015b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:18.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf617c640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf015e690 0x7fdbf0153ff0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80b0040 tx=0x7fdbe80196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbe67fc640 1 -- 172.21.15.67:0/1799784168 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80bd020 con 0x7fdbf015e690 2024-09-19T05:45:18.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbe67fc640 1 -- 172.21.15.67:0/1799784168 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe80ad6c0 con 0x7fdbf015e690 2024-09-19T05:45:18.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/1799784168 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf015cbd0 con 0x7fdbf015e690 2024-09-19T05:45:18.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbe67fc640 1 -- 172.21.15.67:0/1799784168 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80b2040 con 0x7fdbf015e690 2024-09-19T05:45:18.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.163+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/1799784168 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf015ce90 con 0x7fdbf015e690 2024-09-19T05:45:18.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbe67fc640 1 -- 172.21.15.67:0/1799784168 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdbe80c0020 con 0x7fdbf015e690 2024-09-19T05:45:18.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbe67fc640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbd40678f0 0x7fdbd4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbe67fc640 1 -- 172.21.15.67:0/1799784168 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fdbe8120fa0 con 0x7fdbf015e690 2024-09-19T05:45:18.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf597b640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbd40678f0 0x7fdbd4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbfac9b000 1 Processor -- start 2024-09-19T05:45:18.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbfac9b000 1 -- start start 2024-09-19T05:45:18.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf597b640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbd40678f0 0x7fdbd4069db0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0007fd0 tx=0x7fdbe0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b761796150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b761749870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761749db0 0x55b76174a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b761633960 con 0x55b761796690 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b761577900 con 0x55b761795d70 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b76159ad40 con 0x55b761749db0 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf517a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b761749870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf517a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b761749870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45174/0 (socket says 172.21.15.67:45174) 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf517a640 1 -- 172.21.15.67:0/1220551297 learned_addr learned my addr 172.21.15.67:0/1220551297 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf597b640 1 --2- 172.21.15.67:0/1220551297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b761796150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf617c640 1 --2- 172.21.15.67:0/1220551297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761749db0 0x55b76174a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf517a640 1 -- 172.21.15.67:0/1220551297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761749db0 msgr2=0x55b76174a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf517a640 1 --2- 172.21.15.67:0/1220551297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761749db0 0x55b76174a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf517a640 1 -- 172.21.15.67:0/1220551297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 msgr2=0x55b761796150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf517a640 1 --2- 172.21.15.67:0/1220551297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b761796150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf517a640 1 -- 172.21.15.67:0/1220551297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b761541580 con 0x55b761796690 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.167+0000 7fdbf517a640 1 --2- 172.21.15.67:0/1220551297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b761749870 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00b8e0 tx=0x7fdbec00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2720c769185e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbd37fe640 1 -- 172.21.15.67:0/1220551297 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec004230 con 0x55b761796690 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbd37fe640 1 -- 172.21.15.67:0/1220551297 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec0043d0 con 0x55b761796690 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbd37fe640 1 -- 172.21.15.67:0/1220551297 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00faa0 con 0x55b761796690 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1220551297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 msgr2=0x55b761749870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1220551297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b761749870 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00b8e0 tx=0x7fdbec00bda0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1220551297 shutdown_connections 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1220551297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761749db0 0x55b76174a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1220551297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b761749870 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1220551297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b761796150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1220551297 >> 172.21.15.67:0/1220551297 conn(0x55b761777040 msgr2=0x55b761779430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1220551297 shutdown_connections 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1220551297 wait complete. 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- start start 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 Processor -- start 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b76179cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b76179d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761796690 0x55b76179d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b761596d00 con 0x55b761749db0 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b761555aa0 con 0x55b761795d70 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b761534340 con 0x55b761796690 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 10 client.0 _ll_register_callbacks cb 0x55b761737760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf597b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b76179cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf597b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b76179cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45188/0 (socket says 172.21.15.67:45188) 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf597b640 1 -- 172.21.15.67:0/1484278124 learned_addr learned my addr 172.21.15.67:0/1484278124 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf517a640 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b76179d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf617c640 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761796690 0x55b76179d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf597b640 1 -- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761796690 msgr2=0x55b76179d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf597b640 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761796690 0x55b76179d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf597b640 1 -- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 msgr2=0x55b76179d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf597b640 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b76179d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf597b640 1 -- 172.21.15.67:0/1484278124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76153ddc0 con 0x55b761749db0 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbf597b640 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b76179cce0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0005a80 tx=0x7fdbe0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defa4c51096b3945 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/1484278124 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0026060 con 0x55b761749db0 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/1484278124 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fdbe0021c50 con 0x55b761749db0 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1484278124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbec0043d0 con 0x55b761749db0 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/1484278124 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fdbe0021e50 con 0x55b761749db0 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 10 client.9255 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1484278124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55b76153a7f0 con 0x55b761749db0 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/1484278124 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec0043d0 con 0x55b761749db0 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/1484278124 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fdbe0012410 con 0x55b761749db0 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 10 client.9255 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 10 client.9255 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 20 client.9255 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55b7617a50b0 0x55b7617a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 4 client.9255 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.171+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1484278124 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b761534e10 con 0x55b7617a50b0 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbf517a640 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55b7617a50b0 0x55b7617a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbf517a640 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55b7617a50b0 0x55b7617a74a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d817df98ae72140 server_cookie=355dcb666c333ae in_seq=0 out_seq=0 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbd0ff9640 10 client.9255 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/1484278124 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b761534e10 con 0x55b7617a50b0 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbd0ff9640 10 client.9255 handle_command_reply: tid=0 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 client.9255 shutdown 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1484278124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 msgr2=0x55b76179cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b76179cce0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0005a80 tx=0x7fdbe0000ee0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1484278124 shutdown_connections 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55b7617a50b0 0x55b7617a74a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761796690 0x55b76179d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbd0ff9640 0 client.9255 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b76179d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1484278124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b76179cce0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1484278124 >> 172.21.15.67:0/1484278124 conn(0x55b761777040 msgr2=0x55b761748f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1484278124 shutdown_connections 2024-09-19T05:45:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1484278124 wait complete. 2024-09-19T05:45:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.175+0000 7fdbfac9b000 20 client.9255 trim_cache size 0 max 16384 2024-09-19T05:45:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 Processor -- start 2024-09-19T05:45:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 -- start start 2024-09-19T05:45:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761749db0 0x55b7617a31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b7617a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b7617aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf0203c30 con 0x55b761796690 2024-09-19T05:45:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf0202cf0 con 0x55b761795d70 2024-09-19T05:45:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf0156a40 con 0x55b761749db0 2024-09-19T05:45:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbf617c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b7617aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbf617c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b7617aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45202/0 (socket says 172.21.15.67:45202) 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbf617c640 1 -- 172.21.15.67:0/1242163710 learned_addr learned my addr 172.21.15.67:0/1242163710 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbf617c640 1 -- 172.21.15.67:0/1242163710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761749db0 msgr2=0x55b7617a31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbf617c640 1 --2- 172.21.15.67:0/1242163710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761749db0 0x55b7617a31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbf617c640 1 -- 172.21.15.67:0/1242163710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 msgr2=0x55b7617a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbf617c640 1 --2- 172.21.15.67:0/1242163710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b7617a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbf617c640 1 -- 172.21.15.67:0/1242163710 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b761558470 con 0x55b761796690 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbf617c640 1 --2- 172.21.15.67:0/1242163710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b7617aa4d0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80984e0 tx=0x7fdbe8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba71cef821e5057 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbd2ffd640 1 -- 172.21.15.67:0/1242163710 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80f55e0 con 0x55b761796690 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbd2ffd640 1 -- 172.21.15.67:0/1242163710 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe80f9e10 con 0x55b761796690 2024-09-19T05:45:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbd2ffd640 1 -- 172.21.15.67:0/1242163710 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80ef530 con 0x55b761796690 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1242163710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 msgr2=0x55b7617aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1242163710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b7617aa4d0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80984e0 tx=0x7fdbe8009750 comp rx=0 tx=0).stop 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1242163710 shutdown_connections 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1242163710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761796690 0x55b7617aa4d0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1242163710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761795d70 0x55b7617a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/1242163710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761749db0 0x55b7617a31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1242163710 >> 172.21.15.67:0/1242163710 conn(0x55b761777040 msgr2=0x55b7617a2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1242163710 shutdown_connections 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 -- 172.21.15.67:0/1242163710 wait complete. 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 -- start start 2024-09-19T05:45:18.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.195+0000 7fdbfac9b000 1 Processor -- start 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b7617a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761795d70 0x55b7617aa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761796690 0x55b761805c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b7615da780 con 0x55b761749db0 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b7617509d0 con 0x55b761796690 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b7616570c0 con 0x55b761795d70 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 10 client.0 _ll_register_callbacks cb 0x7fdbe0001cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf597b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b7617a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf597b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b7617a9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45206/0 (socket says 172.21.15.67:45206) 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf597b640 1 -- 172.21.15.67:0/708479141 learned_addr learned my addr 172.21.15.67:0/708479141 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf617c640 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761796690 0x55b761805c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf517a640 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761795d70 0x55b7617aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf597b640 1 -- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761795d70 msgr2=0x55b7617aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf597b640 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761795d70 0x55b7617aa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf597b640 1 -- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761796690 msgr2=0x55b761805c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf597b640 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761796690 0x55b761805c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf597b640 1 -- 172.21.15.67:0/708479141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76152e640 con 0x55b761749db0 2024-09-19T05:45:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf597b640 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b7617a9cf0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000d610 tx=0x7fdbe0001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c670d175188e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/708479141 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe000db70 con 0x55b761749db0 2024-09-19T05:45:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/708479141 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fdbe0012070 con 0x55b761749db0 2024-09-19T05:45:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- 172.21.15.67:0/708479141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbe80f9e10 con 0x55b761749db0 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/708479141 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fdbe003d050 con 0x55b761749db0 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 10 client.9261 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- 172.21.15.67:0/708479141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55b7615323b0 con 0x55b761749db0 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/708479141 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe80f9e10 con 0x55b761749db0 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/708479141 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fdbe0040020 con 0x55b761749db0 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 10 client.9261 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 10 client.9261 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 20 client.9261 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55b761806140 0x55b761806550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 4 client.9261 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- 172.21.15.67:0/708479141 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b7615a8470 con 0x55b761806140 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf517a640 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55b761806140 0x55b761806550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbf517a640 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55b761806140 0x55b761806550 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1be281d4f81c69a server_cookie=3d0d637c7fc83969 in_seq=0 out_seq=0 2024-09-19T05:45:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbd0ff9640 10 client.9261 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbd0ff9640 1 -- 172.21.15.67:0/708479141 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x55b7615a8470 con 0x55b761806140 2024-09-19T05:45:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbd0ff9640 10 client.9261 handle_command_reply: tid=0 2024-09-19T05:45:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 client.9261 shutdown 2024-09-19T05:45:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- 172.21.15.67:0/708479141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 msgr2=0x55b7617a9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b7617a9cf0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000d610 tx=0x7fdbe0001090 comp rx=0 tx=0).stop 2024-09-19T05:45:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- 172.21.15.67:0/708479141 shutdown_connections 2024-09-19T05:45:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55b761806140 0x55b761806550 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b761796690 0x55b761805c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b761795d70 0x55b7617aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 --2- 172.21.15.67:0/708479141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b761749db0 0x55b7617a9cf0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- 172.21.15.67:0/708479141 >> 172.21.15.67:0/708479141 conn(0x55b761777040 msgr2=0x55b7617955f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbd0ff9640 0 client.9261 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- 172.21.15.67:0/708479141 shutdown_connections 2024-09-19T05:45:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 1 -- 172.21.15.67:0/708479141 wait complete. 2024-09-19T05:45:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.199+0000 7fdbfac9b000 20 client.9261 trim_cache size 0 max 16384 2024-09-19T05:45:18.207 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:45:18.207 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-19T05:45:18.207 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-19T05:45:18.207 INFO:teuthology.orchestra.run.smithi067.stdout: "ddf364ac-a302-4d07-b049-437331faea15": { 2024-09-19T05:45:18.207 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_control_test_path", 2024-09-19T05:45:18.208 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "ddf364ac-a302-4d07-b049-437331faea15", 2024-09-19T05:45:18.208 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive" 2024-09-19T05:45:18.208 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:18.208 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:18.208 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:45:18.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbd40678f0 msgr2=0x7fdbd4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbd40678f0 0x7fdbd4069db0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0007fd0 tx=0x7fdbe0009040 comp rx=0 tx=0).stop 2024-09-19T05:45:18.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/1799784168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf015e690 msgr2=0x7fdbf0153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf015e690 0x7fdbf0153ff0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80b0040 tx=0x7fdbe80196a0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/1799784168 shutdown_connections 2024-09-19T05:45:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf015e690 0x7fdbf0153ff0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdbd40678f0 0x7fdbd4069db0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdbf00d4fb0 0x7fdbf00b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 --2- 172.21.15.67:0/1799784168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf00d13c0 0x7fdbf015b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/1799784168 >> 172.21.15.67:0/1799784168 conn(0x7fdbf00d4490 msgr2=0x7fdbf00b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/1799784168 shutdown_connections 2024-09-19T05:45:18.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.203+0000 7fdbf7bdf640 1 -- 172.21.15.67:0/1799784168 wait complete. 2024-09-19T05:45:18.216 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8ca4d640 1 Processor -- start 2024-09-19T05:45:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8ca4d640 1 -- start start 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8ca4d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0a8815b1e0 0x7f0a880b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8ca4d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a88072590 0x7f0a880ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8ca4d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a880b3860 con 0x7f0a880b4900 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8ca4d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0a8815b5c0 con 0x7f0a8815b1e0 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8ca4d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0a880b3b40 con 0x7f0a88072590 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0a8815b1e0 0x7f0a880b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a85d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0a880b4900 0x7f0a88071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55210/0 (socket says 172.21.15.67:55210) 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a85d9b640 1 -- 172.21.15.67:0/55602542 learned_addr learned my addr 172.21.15.67:0/55602542 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a86d9d640 1 --2- 172.21.15.67:0/55602542 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a88072590 0x7f0a880ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8659c640 1 -- 172.21.15.67:0/55602542 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a88072590 msgr2=0x7f0a880ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8659c640 1 --2- 172.21.15.67:0/55602542 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a88072590 0x7f0a880ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8659c640 1 -- 172.21.15.67:0/55602542 >> v1:172.21.15.67:6789/0 conn(0x7f0a880b4900 legacy=0x7f0a88071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8559a640 1 -- 172.21.15.67:0/55602542 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242718701 0 0) 0x7f0a880b3860 con 0x7f0a880b4900 2024-09-19T05:45:18.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.331+0000 7f0a8659c640 1 -- 172.21.15.67:0/55602542 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a880b3e20 con 0x7f0a8815b1e0 2024-09-19T05:45:18.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8659c640 1 --2- 172.21.15.67:0/55602542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 0x7f0a880b2fd0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0097c0 tx=0x7f0a7c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce289a22de9fdb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8559a640 1 -- 172.21.15.67:0/55602542 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0a7070 con 0x7f0a8815b1e0 2024-09-19T05:45:18.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8559a640 1 -- 172.21.15.67:0/55602542 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7c0b0070 con 0x7f0a8815b1e0 2024-09-19T05:45:18.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8559a640 1 -- 172.21.15.67:0/55602542 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0ab890 con 0x7f0a8815b1e0 2024-09-19T05:45:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/55602542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 msgr2=0x7f0a880b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8ca4d640 1 --2- 172.21.15.67:0/55602542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 0x7f0a880b2fd0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0097c0 tx=0x7f0a7c01c470 comp rx=0 tx=0).stop 2024-09-19T05:45:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/55602542 shutdown_connections 2024-09-19T05:45:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8ca4d640 1 --2- 172.21.15.67:0/55602542 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a88072590 0x7f0a880ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8ca4d640 1 --2- 172.21.15.67:0/55602542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 0x7f0a880b2fd0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/55602542 >> 172.21.15.67:0/55602542 conn(0x7f0a880d0080 msgr2=0x7f0a880d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/55602542 shutdown_connections 2024-09-19T05:45:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/55602542 wait complete. 2024-09-19T05:45:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8ca4d640 1 Processor -- start 2024-09-19T05:45:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.335+0000 7f0a8ca4d640 1 -- start start 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8ca4d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a88072590 0x7f0a8814e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8ca4d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a880b4900 0x7f0a88145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8ca4d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 0x7f0a88099740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8ca4d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0a881681e0 con 0x7f0a8815b1e0 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8ca4d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0a88168060 con 0x7f0a880b4900 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8ca4d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0a88168360 con 0x7f0a88072590 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a86d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 0x7f0a88099740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a86d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 0x7f0a88099740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45226/0 (socket says 172.21.15.67:45226) 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a86d9d640 1 -- 172.21.15.67:0/1851828773 learned_addr learned my addr 172.21.15.67:0/1851828773 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a85d9b640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a880b4900 0x7f0a88145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8659c640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a88072590 0x7f0a8814e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a86d9d640 1 -- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a88072590 msgr2=0x7f0a8814e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a86d9d640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a88072590 0x7f0a8814e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a86d9d640 1 -- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a880b4900 msgr2=0x7f0a88145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a86d9d640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a880b4900 0x7f0a88145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a86d9d640 1 -- 172.21.15.67:0/1851828773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a88146050 con 0x7f0a8815b1e0 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a85d9b640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a880b4900 0x7f0a88145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a86d9d640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 0x7f0a88099740 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f0a80007e30 tx=0x7f0a800106c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a76ffd640 1 -- 172.21.15.67:0/1851828773 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80018070 con 0x7f0a8815b1e0 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a76ffd640 1 -- 172.21.15.67:0/1851828773 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a800138a0 con 0x7f0a8815b1e0 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/1851828773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8814e840 con 0x7f0a8815b1e0 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a76ffd640 1 -- 172.21.15.67:0/1851828773 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80013c90 con 0x7f0a8815b1e0 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/1851828773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8814d380 con 0x7f0a8815b1e0 2024-09-19T05:45:18.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/1851828773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a880ade10 con 0x7f0a8815b1e0 2024-09-19T05:45:18.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a76ffd640 1 -- 172.21.15.67:0/1851828773 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a8001b070 con 0x7f0a8815b1e0 2024-09-19T05:45:18.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a76ffd640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a680678c0 0x7f0a68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a76ffd640 1 -- 172.21.15.67:0/1851828773 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f0a80088c20 con 0x7f0a8815b1e0 2024-09-19T05:45:18.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.339+0000 7f0a8659c640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a680678c0 0x7f0a68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.343+0000 7f0a8659c640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a680678c0 0x7f0a68069d80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0af000 tx=0x7f0a7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.343+0000 7f0a76ffd640 1 -- 172.21.15.67:0/1851828773 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0a80059630 con 0x7f0a8815b1e0 2024-09-19T05:45:18.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.539+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/1851828773 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a880b0050 con 0x7f0a8815b1e0 2024-09-19T05:45:18.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a76ffd640 1 -- 172.21.15.67:0/1851828773 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7f0a80058f30 con 0x7f0a8815b1e0 2024-09-19T05:45:18.539 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:18.540 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:18.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a680678c0 msgr2=0x7f0a68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a680678c0 0x7f0a68069d80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0af000 tx=0x7f0a7c008040 comp rx=0 tx=0).stop 2024-09-19T05:45:18.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/1851828773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 msgr2=0x7f0a88099740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 0x7f0a88099740 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f0a80007e30 tx=0x7f0a800106c0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/1851828773 shutdown_connections 2024-09-19T05:45:18.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a8815b1e0 0x7f0a88099740 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a880b4900 0x7f0a88145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a680678c0 0x7f0a68069d80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 --2- 172.21.15.67:0/1851828773 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a88072590 0x7f0a8814e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/1851828773 >> 172.21.15.67:0/1851828773 conn(0x7f0a880d0080 msgr2=0x7f0a880d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/1851828773 shutdown_connections 2024-09-19T05:45:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.543+0000 7f0a8ca4d640 1 -- 172.21.15.67:0/1851828773 wait complete. 2024-09-19T05:45:18.557 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-19T05:45:18.558 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:45:18.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac6c52e640 1 Processor -- start 2024-09-19T05:45:18.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac6c52e640 1 -- start start 2024-09-19T05:45:18.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac6c52e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fac640d3080 0x7fac641693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac6c52e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac640cf510 con 0x7fac6415e610 2024-09-19T05:45:18.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac6c52e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac640cf7f0 con 0x7fac640cf070 2024-09-19T05:45:18.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac6c52e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fac640d0120 con 0x7fac640d3080 2024-09-19T05:45:18.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac6a2ca640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fac6415e610 0x7fac64162a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55216/0 (socket says 172.21.15.67:55216) 2024-09-19T05:45:18.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac6a2ca640 1 -- 172.21.15.67:0/151248880 learned_addr learned my addr 172.21.15.67:0/151248880 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:18.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac6aacb640 1 --2- 172.21.15.67:0/151248880 >> v2:172.21.15.97:3300/0 conn(0x7fac640d3080 0x7fac641693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616701953 0 0) 0x7fac640cf510 con 0x7fac6415e610 2024-09-19T05:45:18.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac50003530 con 0x7fac6415e610 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 612660684 0 0) 0x7fac50003530 con 0x7fac6415e610 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 >> v2:172.21.15.97:3300/0 conn(0x7fac640d3080 msgr2=0x7fac641693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.671+0000 7fac692c8640 1 --2- 172.21.15.67:0/151248880 >> v2:172.21.15.97:3300/0 conn(0x7fac640d3080 0x7fac641693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 >> v1:172.21.15.97:6789/0 conn(0x7fac640cf070 legacy=0x7fac6415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac640cfad0 con 0x7fac6415e610 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fac60001a00 con 0x7fac6415e610 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 >> v1:172.21.15.67:6789/0 conn(0x7fac6415e610 legacy=0x7fac64162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac500039c0 0x7fac50003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac50004810 0x7fac50004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac500051d0 0x7fac5000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac640d0120 con 0x7fac500039c0 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fac5000c070 con 0x7fac500051d0 2024-09-19T05:45:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fac5000c270 con 0x7fac50004810 2024-09-19T05:45:18.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6a2ca640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac500039c0 0x7fac50003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6aacb640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac500051d0 0x7fac5000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac69ac9640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac50004810 0x7fac50004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6a2ca640 1 -- 172.21.15.67:0/151248880 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac50004810 msgr2=0x7fac50004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6a2ca640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac50004810 0x7fac50004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6a2ca640 1 -- 172.21.15.67:0/151248880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac500051d0 msgr2=0x7fac5000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:18.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6a2ca640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac500051d0 0x7fac5000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6a2ca640 1 -- 172.21.15.67:0/151248880 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac50003530 con 0x7fac500039c0 2024-09-19T05:45:18.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6aacb640 1 -- 172.21.15.67:0/151248880 reap_dead start 2024-09-19T05:45:18.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6a2ca640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac500039c0 0x7fac50003de0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fac6000a850 tx=0x7fac6001d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560e24261c9743da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6000a4a0 con 0x7fac500039c0 2024-09-19T05:45:18.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac600ad650 con 0x7fac500039c0 2024-09-19T05:45:18.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac692c8640 1 -- 172.21.15.67:0/151248880 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600ada80 con 0x7fac500039c0 2024-09-19T05:45:18.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6c52e640 1 -- 172.21.15.67:0/151248880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac500039c0 msgr2=0x7fac50003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6c52e640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac500039c0 0x7fac50003de0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fac6000a850 tx=0x7fac6001d2f0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6c52e640 1 -- 172.21.15.67:0/151248880 shutdown_connections 2024-09-19T05:45:18.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6c52e640 1 --2- 172.21.15.67:0/151248880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac500039c0 0x7fac50003de0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6c52e640 1 -- 172.21.15.67:0/151248880 >> 172.21.15.67:0/151248880 conn(0x7fac6408bfc0 msgr2=0x7fac640d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6c52e640 1 -- 172.21.15.67:0/151248880 shutdown_connections 2024-09-19T05:45:18.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.675+0000 7fac6c52e640 1 -- 172.21.15.67:0/151248880 wait complete. 2024-09-19T05:45:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 Processor -- start 2024-09-19T05:45:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 -- start start 2024-09-19T05:45:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac500039c0 0x7fac640cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac640cbab0 0x7fac641474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac64147a10 0x7fac64153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac6415f380 con 0x7fac640cbab0 2024-09-19T05:45:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fac6415f200 con 0x7fac64147a10 2024-09-19T05:45:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fac640d2070 con 0x7fac500039c0 2024-09-19T05:45:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac69ac9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac640cbab0 0x7fac641474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac69ac9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac640cbab0 0x7fac641474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45250/0 (socket says 172.21.15.67:45250) 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac69ac9640 1 -- 172.21.15.67:0/317794722 learned_addr learned my addr 172.21.15.67:0/317794722 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6aacb640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac64147a10 0x7fac64153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6a2ca640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac500039c0 0x7fac640cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac69ac9640 1 -- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac500039c0 msgr2=0x7fac640cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac69ac9640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac500039c0 0x7fac640cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac69ac9640 1 -- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac64147a10 msgr2=0x7fac64153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac69ac9640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac64147a10 0x7fac64153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac69ac9640 1 -- 172.21.15.67:0/317794722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac640ce680 con 0x7fac640cbab0 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac69ac9640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac640cbab0 0x7fac641474d0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fac5400f820 tx=0x7fac5400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac5affd640 1 -- 172.21.15.67:0/317794722 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54001cf0 con 0x7fac640cbab0 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac5affd640 1 -- 172.21.15.67:0/317794722 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac54018070 con 0x7fac640cbab0 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 -- 172.21.15.67:0/317794722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac640b8ed0 con 0x7fac640cbab0 2024-09-19T05:45:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac5affd640 1 -- 172.21.15.67:0/317794722 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5400d730 con 0x7fac640cbab0 2024-09-19T05:45:18.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 -- 172.21.15.67:0/317794722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac640b9490 con 0x7fac640cbab0 2024-09-19T05:45:18.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac6c52e640 1 -- 172.21.15.67:0/317794722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac640cf510 con 0x7fac640cbab0 2024-09-19T05:45:18.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.679+0000 7fac5affd640 1 -- 172.21.15.67:0/317794722 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac5400d8d0 con 0x7fac640cbab0 2024-09-19T05:45:18.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.683+0000 7fac5affd640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac480678c0 0x7fac48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:18.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.683+0000 7fac5affd640 1 -- 172.21.15.67:0/317794722 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fac54085d00 con 0x7fac640cbab0 2024-09-19T05:45:18.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.683+0000 7fac6a2ca640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac480678c0 0x7fac48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:18.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.683+0000 7fac6a2ca640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac480678c0 0x7fac48069d80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fac600ad000 tx=0x7fac600a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:18.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.687+0000 7fac5affd640 1 -- 172.21.15.67:0/317794722 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fac54056670 con 0x7fac640cbab0 2024-09-19T05:45:18.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.899+0000 7fac6c52e640 1 -- 172.21.15.67:0/317794722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fac640d1c00 con 0x7fac640cbab0 2024-09-19T05:45:18.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.899+0000 7fac5affd640 1 -- 172.21.15.67:0/317794722 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7fac54055f70 con 0x7fac640cbab0 2024-09-19T05:45:18.898 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:18.898 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":748,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":157,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":801,"data_bytes":817820658,"bytes_used":2115690496,"bytes_avail":770978422784,"bytes_total":773094113280,"write_bytes_sec":41915628,"read_op_per_sec":0,"write_op_per_sec":42},"fsmap":{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":9066}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-19T05:44:29.345831+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 -- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac480678c0 msgr2=0x7fac48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac480678c0 0x7fac48069d80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fac600ad000 tx=0x7fac600a7000 comp rx=0 tx=0).stop 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 -- 172.21.15.67:0/317794722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac640cbab0 msgr2=0x7fac641474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac640cbab0 0x7fac641474d0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fac5400f820 tx=0x7fac5400fce0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 -- 172.21.15.67:0/317794722 shutdown_connections 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac64147a10 0x7fac64153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac640cbab0 0x7fac641474d0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac480678c0 0x7fac48069d80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 --2- 172.21.15.67:0/317794722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac500039c0 0x7fac640cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 -- 172.21.15.67:0/317794722 >> 172.21.15.67:0/317794722 conn(0x7fac6408bfc0 msgr2=0x7fac641612a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:18.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 -- 172.21.15.67:0/317794722 shutdown_connections 2024-09-19T05:45:18.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:18.903+0000 7fac6c52e640 1 -- 172.21.15.67:0/317794722 wait complete. 2024-09-19T05:45:18.916 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-19T05:45:19.916 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:20.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac24750640 1 Processor -- start 2024-09-19T05:45:20.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac24750640 1 -- start start 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac24750640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac1c15b710 0x7fac1c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac24750640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fac1c15baf0 0x7fac1c15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac24750640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c0b3070 con 0x7fac1c0aef40 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac24750640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fac1c0b32e0 con 0x7fac1c15b710 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac24750640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fac1c0b35c0 con 0x7fac1c15baf0 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac224ec640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac1c15b710 0x7fac1c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac224ec640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac1c15b710 0x7fac1c071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45266/0 (socket says 172.21.15.67:45266) 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac224ec640 1 -- 172.21.15.67:0/3899061515 learned_addr learned my addr 172.21.15.67:0/3899061515 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac22ced640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fac1c0aef40 0x7fac1c0af360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55226/0 (socket says 172.21.15.67:55226) 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac21ceb640 1 --2- 172.21.15.67:0/3899061515 >> v2:172.21.15.97:3300/0 conn(0x7fac1c15baf0 0x7fac1c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac224ec640 1 -- 172.21.15.67:0/3899061515 >> v2:172.21.15.97:3300/0 conn(0x7fac1c15baf0 msgr2=0x7fac1c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:20.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac224ec640 1 --2- 172.21.15.67:0/3899061515 >> v2:172.21.15.97:3300/0 conn(0x7fac1c15baf0 0x7fac1c15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac224ec640 1 -- 172.21.15.67:0/3899061515 >> v1:172.21.15.67:6789/0 conn(0x7fac1c0aef40 legacy=0x7fac1c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.055+0000 7fac224ec640 1 -- 172.21.15.67:0/3899061515 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c0afa70 con 0x7fac1c15b710 2024-09-19T05:45:20.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac224ec640 1 --2- 172.21.15.67:0/3899061515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c15b710 0x7fac1c071e80 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fac1c071890 tx=0x7fac1801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542f5fba13af36b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:20.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac214ea640 1 -- 172.21.15.67:0/3899061515 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180aa650 con 0x7fac1c15b710 2024-09-19T05:45:20.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac214ea640 1 -- 172.21.15.67:0/3899061515 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac180af070 con 0x7fac1c15b710 2024-09-19T05:45:20.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac214ea640 1 -- 172.21.15.67:0/3899061515 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180aaa10 con 0x7fac1c15b710 2024-09-19T05:45:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 -- 172.21.15.67:0/3899061515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c15b710 msgr2=0x7fac1c071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 --2- 172.21.15.67:0/3899061515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c15b710 0x7fac1c071e80 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fac1c071890 tx=0x7fac1801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 -- 172.21.15.67:0/3899061515 shutdown_connections 2024-09-19T05:45:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 --2- 172.21.15.67:0/3899061515 >> v2:172.21.15.97:3300/0 conn(0x7fac1c15baf0 0x7fac1c15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 --2- 172.21.15.67:0/3899061515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c15b710 0x7fac1c071e80 secure :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fac1c071890 tx=0x7fac1801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 -- 172.21.15.67:0/3899061515 >> 172.21.15.67:0/3899061515 conn(0x7fac1c0d0080 msgr2=0x7fac1c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 -- 172.21.15.67:0/3899061515 shutdown_connections 2024-09-19T05:45:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 -- 172.21.15.67:0/3899061515 wait complete. 2024-09-19T05:45:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 Processor -- start 2024-09-19T05:45:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 -- start start 2024-09-19T05:45:20.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c0ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15baf0 0x7fac1c0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c099a00 0x7fac1c0cf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c0b4a30 con 0x7fac1c0aef40 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c0b48b0 con 0x7fac1c15baf0 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac24750640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fac1c0b4bb0 con 0x7fac1c099a00 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac224ec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c0ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac224ec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c0ad0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45276/0 (socket says 172.21.15.67:45276) 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.059+0000 7fac224ec640 1 -- 172.21.15.67:0/2170230077 learned_addr learned my addr 172.21.15.67:0/2170230077 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac21ceb640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15baf0 0x7fac1c0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac224ec640 1 -- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c099a00 msgr2=0x7fac1c0cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac22ced640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c099a00 0x7fac1c0cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac224ec640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c099a00 0x7fac1c0cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac224ec640 1 -- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15baf0 msgr2=0x7fac1c0734b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac224ec640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15baf0 0x7fac1c0734b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac224ec640 1 -- 172.21.15.67:0/2170230077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c144e40 con 0x7fac1c0aef40 2024-09-19T05:45:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac21ceb640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15baf0 0x7fac1c0734b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac22ced640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c099a00 0x7fac1c0cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac224ec640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c0ad0a0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fac1801c9d0 tx=0x7fac1801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac12ffd640 1 -- 172.21.15.67:0/2170230077 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180bd5f0 con 0x7fac1c0aef40 2024-09-19T05:45:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac12ffd640 1 -- 172.21.15.67:0/2170230077 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac180a6040 con 0x7fac1c0aef40 2024-09-19T05:45:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac12ffd640 1 -- 172.21.15.67:0/2170230077 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180bd9f0 con 0x7fac1c0aef40 2024-09-19T05:45:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac24750640 1 -- 172.21.15.67:0/2170230077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1c099e90 con 0x7fac1c0aef40 2024-09-19T05:45:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac24750640 1 -- 172.21.15.67:0/2170230077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1c1450e0 con 0x7fac1c0aef40 2024-09-19T05:45:20.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac24750640 1 -- 172.21.15.67:0/2170230077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac1c1454c0 con 0x7fac1c0aef40 2024-09-19T05:45:20.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac12ffd640 1 -- 172.21.15.67:0/2170230077 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac180b33f0 con 0x7fac1c0aef40 2024-09-19T05:45:20.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac12ffd640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac000678f0 0x7fac00069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac12ffd640 1 -- 172.21.15.67:0/2170230077 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fac1811fd10 con 0x7fac1c0aef40 2024-09-19T05:45:20.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.063+0000 7fac21ceb640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac000678f0 0x7fac00069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.067+0000 7fac21ceb640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac000678f0 0x7fac00069db0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fac1c1fa820 tx=0x7fac0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:20.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.067+0000 7fac12ffd640 1 -- 172.21.15.67:0/2170230077 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fac1c1454c0 con 0x7fac1c0aef40 2024-09-19T05:45:20.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.267+0000 7fac24750640 1 -- 172.21.15.67:0/2170230077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac1c071e80 con 0x7fac1c0aef40 2024-09-19T05:45:20.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.267+0000 7fac12ffd640 1 -- 172.21.15.67:0/2170230077 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7fac18016110 con 0x7fac1c0aef40 2024-09-19T05:45:20.266 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:20.266 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:20.267 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 -- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac000678f0 msgr2=0x7fac00069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac000678f0 0x7fac00069db0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fac1c1fa820 tx=0x7fac0c008040 comp rx=0 tx=0).stop 2024-09-19T05:45:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 -- 172.21.15.67:0/2170230077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 msgr2=0x7fac1c0ad0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c0ad0a0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fac1801c9d0 tx=0x7fac1801ad30 comp rx=0 tx=0).stop 2024-09-19T05:45:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 -- 172.21.15.67:0/2170230077 shutdown_connections 2024-09-19T05:45:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac000678f0 0x7fac00069db0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac1c099a00 0x7fac1c0cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac1c15baf0 0x7fac1c0734b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 --2- 172.21.15.67:0/2170230077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1c0aef40 0x7fac1c0ad0a0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 -- 172.21.15.67:0/2170230077 >> 172.21.15.67:0/2170230077 conn(0x7fac1c0d0080 msgr2=0x7fac1c15a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 -- 172.21.15.67:0/2170230077 shutdown_connections 2024-09-19T05:45:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.271+0000 7fac24750640 1 -- 172.21.15.67:0/2170230077 wait complete. 2024-09-19T05:45:20.286 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-19T05:45:20.286 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:45:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.411+0000 7fdb5381b640 1 Processor -- start 2024-09-19T05:45:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.411+0000 7fdb5381b640 1 -- start start 2024-09-19T05:45:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb5381b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdb4c15b210 0x7fdb4c0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb5381b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb4c0d1d70 0x7fdb4c0d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb5381b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb4c0d1420 0x7fdb4c0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb5381b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4c0cd890 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb5381b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4c0cdae0 con 0x7fdb4c15b210 2024-09-19T05:45:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb5381b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4c0cddc0 con 0x7fdb4c0d1420 2024-09-19T05:45:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb50db6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb4c0d1d70 0x7fdb4c0d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb515b7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdb4c15b210 0x7fdb4c0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb50db6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb4c0d1d70 0x7fdb4c0d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45282/0 (socket says 172.21.15.67:45282) 2024-09-19T05:45:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb50db6640 1 -- 172.21.15.67:0/3237749502 learned_addr learned my addr 172.21.15.67:0/3237749502 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb51db8640 1 --2- 172.21.15.67:0/3237749502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb4c0d1420 0x7fdb4c0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb50db6640 1 -- 172.21.15.67:0/3237749502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb4c0d1420 msgr2=0x7fdb4c0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb50db6640 1 --2- 172.21.15.67:0/3237749502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb4c0d1420 0x7fdb4c0ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb50db6640 1 -- 172.21.15.67:0/3237749502 >> v2:172.21.15.97:3300/0 conn(0x7fdb4c15b210 msgr2=0x7fdb4c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb50db6640 1 --2- 172.21.15.67:0/3237749502 >> v2:172.21.15.97:3300/0 conn(0x7fdb4c15b210 0x7fdb4c0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.415+0000 7fdb50db6640 1 -- 172.21.15.67:0/3237749502 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4c0ce0a0 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb50db6640 1 --2- 172.21.15.67:0/3237749502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 0x7fdb4c0d0ee0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0723e0 tx=0x7fdb3c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919ef9ce71cb421b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb43fff640 1 -- 172.21.15.67:0/3237749502 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0b2070 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb43fff640 1 -- 172.21.15.67:0/3237749502 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb3c0a9070 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb43fff640 1 -- 172.21.15.67:0/3237749502 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0ad880 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- 172.21.15.67:0/3237749502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 msgr2=0x7fdb4c0d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 --2- 172.21.15.67:0/3237749502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 0x7fdb4c0d0ee0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0723e0 tx=0x7fdb3c01c490 comp rx=0 tx=0).stop 2024-09-19T05:45:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- 172.21.15.67:0/3237749502 shutdown_connections 2024-09-19T05:45:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 --2- 172.21.15.67:0/3237749502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb4c0d1420 0x7fdb4c0ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 --2- 172.21.15.67:0/3237749502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 0x7fdb4c0d0ee0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 --2- 172.21.15.67:0/3237749502 >> v2:172.21.15.97:3300/0 conn(0x7fdb4c15b210 0x7fdb4c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- 172.21.15.67:0/3237749502 >> 172.21.15.67:0/3237749502 conn(0x7fdb4c09aa30 msgr2=0x7fdb4c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- 172.21.15.67:0/3237749502 shutdown_connections 2024-09-19T05:45:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- 172.21.15.67:0/3237749502 wait complete. 2024-09-19T05:45:20.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 Processor -- start 2024-09-19T05:45:20.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- start start 2024-09-19T05:45:20.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb4c0d1420 0x7fdb4c157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 0x7fdb4c0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb4c15b210 0x7fdb4c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c06c090 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c06bf10 con 0x7fdb4c0d1420 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4c06c210 con 0x7fdb4c15b210 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb50db6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 0x7fdb4c0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb50db6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 0x7fdb4c0b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45292/0 (socket says 172.21.15.67:45292) 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb50db6640 1 -- 172.21.15.67:0/2816292837 learned_addr learned my addr 172.21.15.67:0/2816292837 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb515b7640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb4c0d1420 0x7fdb4c157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb51db8640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb4c15b210 0x7fdb4c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb50db6640 1 -- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb4c15b210 msgr2=0x7fdb4c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb50db6640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb4c15b210 0x7fdb4c0b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb50db6640 1 -- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb4c0d1420 msgr2=0x7fdb4c157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb50db6640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb4c0d1420 0x7fdb4c157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb50db6640 1 -- 172.21.15.67:0/2816292837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4c15cfb0 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb50db6640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 0x7fdb4c0b2d80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c01ab40 tx=0x7fdb3c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb41ffb640 1 -- 172.21.15.67:0/2816292837 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0bb070 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb41ffb640 1 -- 172.21.15.67:0/2816292837 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb3c0add20 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- 172.21.15.67:0/2816292837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4c15d290 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb41ffb640 1 -- 172.21.15.67:0/2816292837 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0b2040 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.419+0000 7fdb5381b640 1 -- 172.21.15.67:0/2816292837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4c15d850 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.423+0000 7fdb5381b640 1 -- 172.21.15.67:0/2816292837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb4c0d0ee0 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.423+0000 7fdb41ffb640 1 -- 172.21.15.67:0/2816292837 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb3c0be070 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.423+0000 7fdb41ffb640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdb300678c0 0x7fdb30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.423+0000 7fdb41ffb640 1 -- 172.21.15.67:0/2816292837 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fdb3c11f0a0 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.423+0000 7fdb515b7640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdb300678c0 0x7fdb30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.423+0000 7fdb515b7640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdb300678c0 0x7fdb30069d80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009a50 tx=0x7fdb48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.427+0000 7fdb41ffb640 1 -- 172.21.15.67:0/2816292837 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fdb3c016110 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.651+0000 7fdb5381b640 1 -- 172.21.15.67:0/2816292837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdb4c157b40 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.651+0000 7fdb41ffb640 1 -- 172.21.15.67:0/2816292837 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7fdb3c0efaa0 con 0x7fdb4c0d1d70 2024-09-19T05:45:20.650 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:20.651 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":750,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":157,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1040,"data_bytes":1069344009,"bytes_used":2596884480,"bytes_avail":770497228800,"bytes_total":773094113280,"write_bytes_sec":62870740,"read_op_per_sec":0,"write_op_per_sec":64},"fsmap":{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":9066}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-19T05:44:29.345831+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:45:20.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 -- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdb300678c0 msgr2=0x7fdb30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdb300678c0 0x7fdb30069d80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009a50 tx=0x7fdb48008040 comp rx=0 tx=0).stop 2024-09-19T05:45:20.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 -- 172.21.15.67:0/2816292837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 msgr2=0x7fdb4c0b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:20.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 0x7fdb4c0b2d80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c01ab40 tx=0x7fdb3c019230 comp rx=0 tx=0).stop 2024-09-19T05:45:20.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 -- 172.21.15.67:0/2816292837 shutdown_connections 2024-09-19T05:45:20.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fdb300678c0 0x7fdb30069d80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb4c15b210 0x7fdb4c0b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb4c0d1d70 0x7fdb4c0b2d80 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 --2- 172.21.15.67:0/2816292837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb4c0d1420 0x7fdb4c157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:20.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 -- 172.21.15.67:0/2816292837 >> 172.21.15.67:0/2816292837 conn(0x7fdb4c09aa30 msgr2=0x7fdb4c1546f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:20.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 -- 172.21.15.67:0/2816292837 shutdown_connections 2024-09-19T05:45:20.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:20.655+0000 7fdb5381b640 1 -- 172.21.15.67:0/2816292837 wait complete. 2024-09-19T05:45:20.670 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-19T05:45:21.671 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:21.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c435b640 1 Processor -- start 2024-09-19T05:45:21.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c435b640 1 -- start start 2024-09-19T05:45:21.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c435b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc072590 0x7f55bc166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c435b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55bc0b3860 con 0x7f55bc15b1e0 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c435b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55bc0b3b40 con 0x7f55bc0b4900 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c435b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc15b5c0 con 0x7f55bc072590 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c20f7640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f55bc15b1e0 0x7f55bc0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55230/0 (socket says 172.21.15.67:55230) 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c20f7640 1 -- 172.21.15.67:0/2874390219 learned_addr learned my addr 172.21.15.67:0/2874390219 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c28f8640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc072590 0x7f55bc166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395104936 0 0) 0x7f55bc0b3860 con 0x7f55bc15b1e0 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55a8003530 con 0x7f55bc15b1e0 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883033507 0 0) 0x7f55bc0b3b40 con 0x7f55bc0b4900 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55bc0b3860 con 0x7f55bc0b4900 2024-09-19T05:45:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3909415558 0 0) 0x7f55a8003530 con 0x7f55bc15b1e0 2024-09-19T05:45:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc072590 msgr2=0x7f55bc166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc072590 0x7f55bc166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 >> v1:172.21.15.97:6789/0 conn(0x7f55bc0b4900 legacy=0x7f55bc071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc0b3e20 con 0x7f55bc15b1e0 2024-09-19T05:45:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f55b8001680 con 0x7f55bc15b1e0 2024-09-19T05:45:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 >> v1:172.21.15.67:6789/0 conn(0x7f55bc15b1e0 legacy=0x7f55bc0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55a8003b80 0x7f55a8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc072590 0x7f55a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55a8004d50 0x7f55a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc15b5c0 con 0x7f55a8004d50 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f55a800bab0 con 0x7f55a8003b80 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f55a800bcb0 con 0x7f55bc072590 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c28f8640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55a8004d50 0x7f55a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c20f7640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55a8003b80 0x7f55a8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c18f6640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc072590 0x7f55a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c28f8640 1 -- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc072590 msgr2=0x7f55a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c28f8640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc072590 0x7f55a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c28f8640 1 -- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55a8003b80 msgr2=0x7f55a8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c28f8640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55a8003b80 0x7f55a8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c28f8640 1 -- 172.21.15.67:0/2874390219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a8003530 con 0x7f55a8004d50 2024-09-19T05:45:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.811+0000 7f55c18f6640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc072590 0x7f55a8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:21.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c28f8640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55a8004d50 0x7f55a80051d0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009fc0 tx=0x7f55b401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625feee906fdf781 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:21.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b40b0070 con 0x7f55a8004d50 2024-09-19T05:45:21.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b40ab600 con 0x7f55a8004d50 2024-09-19T05:45:21.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c10f5640 1 -- 172.21.15.67:0/2874390219 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b4009c10 con 0x7f55a8004d50 2024-09-19T05:45:21.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c435b640 1 -- 172.21.15.67:0/2874390219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55a8004d50 msgr2=0x7f55a80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:21.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c435b640 1 --2- 172.21.15.67:0/2874390219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55a8004d50 0x7f55a80051d0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009fc0 tx=0x7f55b401c960 comp rx=0 tx=0).stop 2024-09-19T05:45:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c28f8640 1 -- 172.21.15.67:0/2874390219 reap_dead start 2024-09-19T05:45:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c435b640 1 -- 172.21.15.67:0/2874390219 shutdown_connections 2024-09-19T05:45:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c435b640 1 -- 172.21.15.67:0/2874390219 >> 172.21.15.67:0/2874390219 conn(0x7f55bc0d0080 msgr2=0x7f55bc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c435b640 1 -- 172.21.15.67:0/2874390219 shutdown_connections 2024-09-19T05:45:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c435b640 1 -- 172.21.15.67:0/2874390219 wait complete. 2024-09-19T05:45:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c435b640 1 Processor -- start 2024-09-19T05:45:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.815+0000 7f55c435b640 1 -- start start 2024-09-19T05:45:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c435b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc1496a0 0x7f55bc149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c435b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55bc14a3a0 0x7f55bc15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c435b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55bc15de90 0x7f55bc06e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c435b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc072a20 con 0x7f55bc15de90 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c435b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc0b43e0 con 0x7f55bc14a3a0 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c435b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc072ba0 con 0x7f55bc1496a0 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c28f8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55bc15de90 0x7f55bc06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c28f8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55bc15de90 0x7f55bc06e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45304/0 (socket says 172.21.15.67:45304) 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c28f8640 1 -- 172.21.15.67:0/2200283088 learned_addr learned my addr 172.21.15.67:0/2200283088 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c18f6640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55bc14a3a0 0x7f55bc15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c20f7640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc1496a0 0x7f55bc149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c28f8640 1 -- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc1496a0 msgr2=0x7f55bc149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c28f8640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc1496a0 0x7f55bc149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c28f8640 1 -- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55bc14a3a0 msgr2=0x7f55bc15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c28f8640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55bc14a3a0 0x7f55bc15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:21.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c28f8640 1 -- 172.21.15.67:0/2200283088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc14e0d0 con 0x7f55bc15de90 2024-09-19T05:45:21.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c28f8640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55bc15de90 0x7f55bc06e670 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f55b40ae040 tx=0x7f55b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:21.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55b2ffd640 1 -- 172.21.15.67:0/2200283088 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b40be070 con 0x7f55bc15de90 2024-09-19T05:45:21.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55b2ffd640 1 -- 172.21.15.67:0/2200283088 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b40ab400 con 0x7f55bc15de90 2024-09-19T05:45:21.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55b2ffd640 1 -- 172.21.15.67:0/2200283088 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b40b0040 con 0x7f55bc15de90 2024-09-19T05:45:21.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c435b640 1 -- 172.21.15.67:0/2200283088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc159b80 con 0x7f55bc15de90 2024-09-19T05:45:21.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c435b640 1 -- 172.21.15.67:0/2200283088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc15a100 con 0x7f55bc15de90 2024-09-19T05:45:21.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c435b640 1 -- 172.21.15.67:0/2200283088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc071e80 con 0x7f55bc15de90 2024-09-19T05:45:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55b2ffd640 1 -- 172.21.15.67:0/2200283088 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55b40c1070 con 0x7f55bc15de90 2024-09-19T05:45:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55b2ffd640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55a00678f0 0x7f55a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55b2ffd640 1 -- 172.21.15.67:0/2200283088 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f55b411f780 con 0x7f55bc15de90 2024-09-19T05:45:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.819+0000 7f55c20f7640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55a00678f0 0x7f55a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.823+0000 7f55c20f7640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55a00678f0 0x7f55a0069db0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f55b8001c20 tx=0x7f55b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:21.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:21.827+0000 7f55b2ffd640 1 -- 172.21.15.67:0/2200283088 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f55b4016990 con 0x7f55bc15de90 2024-09-19T05:45:22.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.027+0000 7f55c435b640 1 -- 172.21.15.67:0/2200283088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55bc0b4e30 con 0x7f55bc15de90 2024-09-19T05:45:22.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.027+0000 7f55b2ffd640 1 -- 172.21.15.67:0/2200283088 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7f55b40efb40 con 0x7f55bc15de90 2024-09-19T05:45:22.026 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:22.026 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:22.026 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:22.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 -- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55a00678f0 msgr2=0x7f55a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:22.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55a00678f0 0x7f55a0069db0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f55b8001c20 tx=0x7f55b8009040 comp rx=0 tx=0).stop 2024-09-19T05:45:22.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 -- 172.21.15.67:0/2200283088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55bc15de90 msgr2=0x7f55bc06e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:22.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55bc15de90 0x7f55bc06e670 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f55b40ae040 tx=0x7f55b4009750 comp rx=0 tx=0).stop 2024-09-19T05:45:22.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 -- 172.21.15.67:0/2200283088 shutdown_connections 2024-09-19T05:45:22.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55bc15de90 0x7f55bc06e670 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55bc14a3a0 0x7f55bc15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f55a00678f0 0x7f55a0069db0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 --2- 172.21.15.67:0/2200283088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55bc1496a0 0x7f55bc149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 -- 172.21.15.67:0/2200283088 >> 172.21.15.67:0/2200283088 conn(0x7f55bc0d0080 msgr2=0x7f55bc150d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:22.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 -- 172.21.15.67:0/2200283088 shutdown_connections 2024-09-19T05:45:22.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.031+0000 7f55c435b640 1 -- 172.21.15.67:0/2200283088 wait complete. 2024-09-19T05:45:22.045 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-19T05:45:22.046 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:45:22.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.159+0000 7f2806707640 1 Processor -- start 2024-09-19T05:45:22.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.159+0000 7f2806707640 1 -- start start 2024-09-19T05:45:22.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f2806707640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2800161da0 0x7f28000d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:22.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f2806707640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28000d05d0 con 0x7f28000d0160 2024-09-19T05:45:22.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f2806707640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28000d4d40 con 0x7f28000d0e80 2024-09-19T05:45:22.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f2806707640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f28000d0840 con 0x7f2800161da0 2024-09-19T05:45:22.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f2804ca4640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f28000d0160 0x7f28000b48d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55246/0 (socket says 172.21.15.67:55246) 2024-09-19T05:45:22.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f2804ca4640 1 -- 172.21.15.67:0/915768494 learned_addr learned my addr 172.21.15.67:0/915768494 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:22.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27fffff640 1 --2- 172.21.15.67:0/915768494 >> v2:172.21.15.97:3300/0 conn(0x7f2800161da0 0x7f28000d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:22.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659668218 0 0) 0x7f28000d05d0 con 0x7f28000d0160 2024-09-19T05:45:22.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e8003530 con 0x7f28000d0160 2024-09-19T05:45:22.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4120079985 0 0) 0x7f27e8003530 con 0x7f28000d0160 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 >> v2:172.21.15.97:3300/0 conn(0x7f2800161da0 msgr2=0x7f28000d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 --2- 172.21.15.67:0/915768494 >> v2:172.21.15.97:3300/0 conn(0x7f2800161da0 0x7f28000d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 >> v1:172.21.15.97:6789/0 conn(0x7f28000d0e80 legacy=0x7f28000b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28000d5020 con 0x7f28000d0160 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f27f8001a00 con 0x7f28000d0160 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 >> v1:172.21.15.67:6789/0 conn(0x7f28000d0160 legacy=0x7f28000b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27e80039c0 0x7f27e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e8004810 0x7f27e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27e80051d0 0x7f27e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f28000d0840 con 0x7f27e8004810 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f27e800c070 con 0x7f27e80051d0 2024-09-19T05:45:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f27e800c270 con 0x7f27e80039c0 2024-09-19T05:45:22.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27ff7fe640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e8004810 0x7f27e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:22.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27ff7fe640 1 -- 172.21.15.67:0/915768494 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27e80039c0 msgr2=0x7f27e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:22.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27fffff640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27e80039c0 0x7f27e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:22.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f2804ca4640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27e80051d0 0x7f27e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:22.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27ff7fe640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27e80039c0 0x7f27e8003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27ff7fe640 1 -- 172.21.15.67:0/915768494 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27e80051d0 msgr2=0x7f27e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:22.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27ff7fe640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27e80051d0 0x7f27e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f27ff7fe640 1 -- 172.21.15.67:0/915768494 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e8003530 con 0x7f27e8004810 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f2804ca4640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27e80051d0 0x7f27e800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.163+0000 7f2804ca4640 1 -- 172.21.15.67:0/915768494 reap_dead start 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27ff7fe640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e8004810 0x7f27e8004c90 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f27f4001780 tx=0x7f27f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc98df615e9a2f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f40013a0 con 0x7f27e8004810 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f40052f0 con 0x7f27e8004810 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27feffd640 1 -- 172.21.15.67:0/915768494 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4003840 con 0x7f27e8004810 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- 172.21.15.67:0/915768494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e8004810 msgr2=0x7f27e8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e8004810 0x7f27e8004c90 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f27f4001780 tx=0x7f27f401c400 comp rx=0 tx=0).stop 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- 172.21.15.67:0/915768494 shutdown_connections 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 --2- 172.21.15.67:0/915768494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e8004810 0x7f27e8004c90 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- 172.21.15.67:0/915768494 >> 172.21.15.67:0/915768494 conn(0x7f280008bfc0 msgr2=0x7f28000d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:22.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- 172.21.15.67:0/915768494 shutdown_connections 2024-09-19T05:45:22.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- 172.21.15.67:0/915768494 wait complete. 2024-09-19T05:45:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 Processor -- start 2024-09-19T05:45:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- start start 2024-09-19T05:45:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27e8004810 0x7f280015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28001f7880 0x7f280015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28001f7d00 0x7f280015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f28000b5d00 con 0x7f28001f7880 2024-09-19T05:45:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f28000b3ca0 con 0x7f28001f7d00 2024-09-19T05:45:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2800162180 con 0x7f27e8004810 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27ff7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28001f7880 0x7f280015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27ff7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28001f7880 0x7f280015d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45318/0 (socket says 172.21.15.67:45318) 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27ff7fe640 1 -- 172.21.15.67:0/3025540603 learned_addr learned my addr 172.21.15.67:0/3025540603 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27fffff640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27e8004810 0x7f280015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27ff7fe640 1 -- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27e8004810 msgr2=0x7f280015ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27ff7fe640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27e8004810 0x7f280015ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27ff7fe640 1 -- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28001f7d00 msgr2=0x7f280015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27ff7fe640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28001f7d00 0x7f280015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27ff7fe640 1 -- 172.21.15.67:0/3025540603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280015bfd0 con 0x7f28001f7880 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27ff7fe640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28001f7880 0x7f280015d4f0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f27f401c230 tx=0x7f27e8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27fcff9640 1 -- 172.21.15.67:0/3025540603 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4007a40 con 0x7f28001f7880 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27fcff9640 1 -- 172.21.15.67:0/3025540603 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f40ba070 con 0x7f28001f7880 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f27fcff9640 1 -- 172.21.15.67:0/3025540603 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4007270 con 0x7f28001f7880 2024-09-19T05:45:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- 172.21.15.67:0/3025540603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28001f5540 con 0x7f28001f7880 2024-09-19T05:45:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.167+0000 7f2806707640 1 -- 172.21.15.67:0/3025540603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28001f8540 con 0x7f28001f7880 2024-09-19T05:45:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.171+0000 7f2806707640 1 -- 172.21.15.67:0/3025540603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28000d1af0 con 0x7f28001f7880 2024-09-19T05:45:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.171+0000 7f27fcff9640 1 -- 172.21.15.67:0/3025540603 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27f4005280 con 0x7f28001f7880 2024-09-19T05:45:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.171+0000 7f27fcff9640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27ec0678f0 0x7f27ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.171+0000 7f27fcff9640 1 -- 172.21.15.67:0/3025540603 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f27f411fef0 con 0x7f28001f7880 2024-09-19T05:45:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.171+0000 7f27fffff640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27ec0678f0 0x7f27ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.171+0000 7f27fffff640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27ec0678f0 0x7f27ec069db0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f28000cf9d0 tx=0x7f27f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.175+0000 7f27fcff9640 1 -- 172.21.15.67:0/3025540603 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f27f4016110 con 0x7f28001f7880 2024-09-19T05:45:22.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.395+0000 7f2806707640 1 -- 172.21.15.67:0/3025540603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f280015f890 con 0x7f28001f7880 2024-09-19T05:45:22.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f27fcff9640 1 -- 172.21.15.67:0/3025540603 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7f27f40f0870 con 0x7f28001f7880 2024-09-19T05:45:22.395 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:22.396 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":752,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":157,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1040,"data_bytes":1069344009,"bytes_used":2596884480,"bytes_avail":770497228800,"bytes_total":773094113280,"write_bytes_sec":41303804,"read_op_per_sec":0,"write_op_per_sec":42},"fsmap":{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":9066}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-19T05:44:29.345831+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:45:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 -- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27ec0678f0 msgr2=0x7f27ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27ec0678f0 0x7f27ec069db0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f28000cf9d0 tx=0x7f27f0008040 comp rx=0 tx=0).stop 2024-09-19T05:45:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 -- 172.21.15.67:0/3025540603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28001f7880 msgr2=0x7f280015d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28001f7880 0x7f280015d4f0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f27f401c230 tx=0x7f27e8005840 comp rx=0 tx=0).stop 2024-09-19T05:45:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 -- 172.21.15.67:0/3025540603 shutdown_connections 2024-09-19T05:45:22.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28001f7d00 0x7f280015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28001f7880 0x7f280015d4f0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27ec0678f0 0x7f27ec069db0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 --2- 172.21.15.67:0/3025540603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27e8004810 0x7f280015ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:22.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 -- 172.21.15.67:0/3025540603 >> 172.21.15.67:0/3025540603 conn(0x7f280008bfc0 msgr2=0x7f280006e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:22.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 -- 172.21.15.67:0/3025540603 shutdown_connections 2024-09-19T05:45:22.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:22.399+0000 7f2806707640 1 -- 172.21.15.67:0/3025540603 wait complete. 2024-09-19T05:45:22.413 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-19T05:45:23.414 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:23.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f83a168e640 1 Processor -- start 2024-09-19T05:45:23.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f83a168e640 1 -- start start 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f83a168e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f839c15e640 0x7f839c0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f83a168e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f839c0ae0a0 0x7f839c0b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f83a168e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0b2430 0x7f839c06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f83a168e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f839c0b4780 con 0x7f839c0ae0a0 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f83a168e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f839c0b5b90 con 0x7f839c15e640 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f83a168e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f839c0ae510 con 0x7f839c0b2430 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f839a7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f839c0ae0a0 0x7f839c0b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f839a7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f839c0ae0a0 0x7f839c0b6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45326/0 (socket says 172.21.15.67:45326) 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f839a7fc640 1 -- 172.21.15.67:0/2362432502 learned_addr learned my addr 172.21.15.67:0/2362432502 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f839affd640 1 --2- 172.21.15.67:0/2362432502 >> v2:172.21.15.97:3300/0 conn(0x7f839c15e640 0x7f839c0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f839b7fe640 1 --2- 172.21.15.67:0/2362432502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0b2430 0x7f839c06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f839a7fc640 1 -- 172.21.15.67:0/2362432502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0b2430 msgr2=0x7f839c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f839a7fc640 1 --2- 172.21.15.67:0/2362432502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0b2430 0x7f839c06bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f839a7fc640 1 -- 172.21.15.67:0/2362432502 >> v2:172.21.15.97:3300/0 conn(0x7f839c15e640 msgr2=0x7f839c0b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:23.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f839a7fc640 1 --2- 172.21.15.67:0/2362432502 >> v2:172.21.15.97:3300/0 conn(0x7f839c15e640 0x7f839c0b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.555+0000 7f839a7fc640 1 -- 172.21.15.67:0/2362432502 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c0b15f0 con 0x7f839c0ae0a0 2024-09-19T05:45:23.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839a7fc640 1 --2- 172.21.15.67:0/2362432502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0ae0a0 0x7f839c0b6cf0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f839c0689b0 tx=0x7f839001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef2d044d2c64397 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:23.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f8399ffb640 1 -- 172.21.15.67:0/2362432502 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83900b0070 con 0x7f839c0ae0a0 2024-09-19T05:45:23.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f8399ffb640 1 -- 172.21.15.67:0/2362432502 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83900a4e50 con 0x7f839c0ae0a0 2024-09-19T05:45:23.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f8399ffb640 1 -- 172.21.15.67:0/2362432502 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83900ab820 con 0x7f839c0ae0a0 2024-09-19T05:45:23.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 -- 172.21.15.67:0/2362432502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0ae0a0 msgr2=0x7f839c0b6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:23.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 --2- 172.21.15.67:0/2362432502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0ae0a0 0x7f839c0b6cf0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f839c0689b0 tx=0x7f839001c400 comp rx=0 tx=0).stop 2024-09-19T05:45:23.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 -- 172.21.15.67:0/2362432502 shutdown_connections 2024-09-19T05:45:23.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 --2- 172.21.15.67:0/2362432502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0b2430 0x7f839c06bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 --2- 172.21.15.67:0/2362432502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0ae0a0 0x7f839c0b6cf0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 --2- 172.21.15.67:0/2362432502 >> v2:172.21.15.97:3300/0 conn(0x7f839c15e640 0x7f839c0b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 -- 172.21.15.67:0/2362432502 >> 172.21.15.67:0/2362432502 conn(0x7f839c09aa30 msgr2=0x7f839c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:23.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 -- 172.21.15.67:0/2362432502 shutdown_connections 2024-09-19T05:45:23.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 -- 172.21.15.67:0/2362432502 wait complete. 2024-09-19T05:45:23.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 Processor -- start 2024-09-19T05:45:23.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 -- start start 2024-09-19T05:45:23.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0ae0a0 0x7f839c09ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0b2430 0x7f839c168500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839c15e640 0x7f839c154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0b0790 con 0x7f839c0b2430 2024-09-19T05:45:23.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f839c06c610 con 0x7f839c15e640 2024-09-19T05:45:23.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83a168e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f839c0b0910 con 0x7f839c0ae0a0 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0b2430 0x7f839c168500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0b2430 0x7f839c168500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45332/0 (socket says 172.21.15.67:45332) 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839a7fc640 1 -- 172.21.15.67:0/1750858868 learned_addr learned my addr 172.21.15.67:0/1750858868 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839affd640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0ae0a0 0x7f839c09ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839b7fe640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839c15e640 0x7f839c154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839a7fc640 1 -- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0ae0a0 msgr2=0x7f839c09ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839a7fc640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0ae0a0 0x7f839c09ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839a7fc640 1 -- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839c15e640 msgr2=0x7f839c154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839a7fc640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839c15e640 0x7f839c154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839a7fc640 1 -- 172.21.15.67:0/1750858868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c09d8a0 con 0x7f839c0b2430 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839affd640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0ae0a0 0x7f839c09ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f839a7fc640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0b2430 0x7f839c168500 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f839001aab0 tx=0x7f83900191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:23.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.559+0000 7f83837fe640 1 -- 172.21.15.67:0/1750858868 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83900b9070 con 0x7f839c0b2430 2024-09-19T05:45:23.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.563+0000 7f83837fe640 1 -- 172.21.15.67:0/1750858868 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83900abe20 con 0x7f839c0b2430 2024-09-19T05:45:23.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.563+0000 7f83a168e640 1 -- 172.21.15.67:0/1750858868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c168a40 con 0x7f839c0b2430 2024-09-19T05:45:23.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.563+0000 7f83837fe640 1 -- 172.21.15.67:0/1750858868 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83900b0040 con 0x7f839c0b2430 2024-09-19T05:45:23.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.563+0000 7f83a168e640 1 -- 172.21.15.67:0/1750858868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c09de20 con 0x7f839c0b2430 2024-09-19T05:45:23.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.563+0000 7f83a168e640 1 -- 172.21.15.67:0/1750858868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c068e20 con 0x7f839c0b2430 2024-09-19T05:45:23.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.563+0000 7f83837fe640 1 -- 172.21.15.67:0/1750858868 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83900bc070 con 0x7f839c0b2430 2024-09-19T05:45:23.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.563+0000 7f83837fe640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83880678f0 0x7f8388069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.563+0000 7f83837fe640 1 -- 172.21.15.67:0/1750858868 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f839011ee50 con 0x7f839c0b2430 2024-09-19T05:45:23.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.563+0000 7f839affd640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83880678f0 0x7f8388069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.563+0000 7f839affd640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83880678f0 0x7f8388069db0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f838c009840 tx=0x7f838c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:23.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.567+0000 7f83837fe640 1 -- 172.21.15.67:0/1750858868 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8390016110 con 0x7f839c0b2430 2024-09-19T05:45:23.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 -- 172.21.15.67:0/1750858868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f839c154240 con 0x7f839c0b2430 2024-09-19T05:45:23.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83837fe640 1 -- 172.21.15.67:0/1750858868 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7f83900ef7d0 con 0x7f839c0b2430 2024-09-19T05:45:23.756 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:23.757 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:23.757 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 -- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83880678f0 msgr2=0x7f8388069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83880678f0 0x7f8388069db0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f838c009840 tx=0x7f838c008040 comp rx=0 tx=0).stop 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 -- 172.21.15.67:0/1750858868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0b2430 msgr2=0x7f839c168500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0b2430 0x7f839c168500 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f839001aab0 tx=0x7f83900191a0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 -- 172.21.15.67:0/1750858868 shutdown_connections 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839c15e640 0x7f839c154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f839c0b2430 0x7f839c168500 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f83880678f0 0x7f8388069db0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 --2- 172.21.15.67:0/1750858868 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839c0ae0a0 0x7f839c09ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.759+0000 7f83a168e640 1 -- 172.21.15.67:0/1750858868 >> 172.21.15.67:0/1750858868 conn(0x7f839c09aa30 msgr2=0x7f839c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.763+0000 7f83a168e640 1 -- 172.21.15.67:0/1750858868 shutdown_connections 2024-09-19T05:45:23.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.763+0000 7f83a168e640 1 -- 172.21.15.67:0/1750858868 wait complete. 2024-09-19T05:45:23.775 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-19T05:45:23.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:45:23.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.887+0000 7ff0fdc00640 1 Processor -- start 2024-09-19T05:45:23.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.887+0000 7ff0fdc00640 1 -- start start 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.887+0000 7ff0fdc00640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0f8161da0 0x7ff0f80d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.887+0000 7ff0fdc00640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff0f80d0e80 0x7ff0f80d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.887+0000 7ff0fdc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f80d4d40 con 0x7ff0f80b41c0 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.887+0000 7ff0fdc00640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f80d0840 con 0x7ff0f80d0e80 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.887+0000 7ff0fdc00640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f80d1800 con 0x7ff0f8161da0 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.887+0000 7ff0f7fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff0f80b41c0 0x7ff0f80b4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55258/0 (socket says 172.21.15.67:55258) 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.887+0000 7ff0f7fff640 1 -- 172.21.15.67:0/4133051572 learned_addr learned my addr 172.21.15.67:0/4133051572 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f77fe640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0f8161da0 0x7ff0f80d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f6ffd640 1 --2- 172.21.15.67:0/4133051572 >> v2:172.21.15.97:3300/0 conn(0x7ff0f80d0e80 0x7ff0f80d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418576966 0 0) 0x7ff0f80d4d40 con 0x7ff0f80b41c0 2024-09-19T05:45:23.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0e0003530 con 0x7ff0f80b41c0 2024-09-19T05:45:23.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3947381780 0 0) 0x7ff0e0003530 con 0x7ff0f80b41c0 2024-09-19T05:45:23.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0f8161da0 msgr2=0x7ff0f80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:23.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0f8161da0 0x7ff0f80d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 >> v2:172.21.15.97:3300/0 conn(0x7ff0f80d0e80 msgr2=0x7ff0f80d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:23.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 --2- 172.21.15.67:0/4133051572 >> v2:172.21.15.97:3300/0 conn(0x7ff0f80d0e80 0x7ff0f80d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f80d5020 con 0x7ff0f80b41c0 2024-09-19T05:45:23.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7ff0f0001680 con 0x7ff0f80b41c0 2024-09-19T05:45:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 >> v1:172.21.15.67:6789/0 conn(0x7ff0f80b41c0 legacy=0x7ff0f80b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0f8161da0 0x7ff0e00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e0003f40 0x7ff0e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0e0004d50 0x7ff0e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f80d0840 con 0x7ff0e0003f40 2024-09-19T05:45:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f80d1800 con 0x7ff0e0004d50 2024-09-19T05:45:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e000b9d0 con 0x7ff0f8161da0 2024-09-19T05:45:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f6ffd640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e0003f40 0x7ff0e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f77fe640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0f8161da0 0x7ff0e00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f7fff640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0e0004d50 0x7ff0e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f6ffd640 1 -- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0f8161da0 msgr2=0x7ff0e00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:23.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f6ffd640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0f8161da0 0x7ff0e00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f6ffd640 1 -- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0e0004d50 msgr2=0x7ff0e00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:23.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f6ffd640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0e0004d50 0x7ff0e00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f6ffd640 1 -- 172.21.15.67:0/4133051572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e0003530 con 0x7ff0e0003f40 2024-09-19T05:45:23.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f6ffd640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e0003f40 0x7ff0e0004810 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009ab0 tx=0x7ff0ec01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d166fd8c3ccaf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:23.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0b2070 con 0x7ff0e0003f40 2024-09-19T05:45:23.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0a5570 con 0x7ff0e0003f40 2024-09-19T05:45:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f67fc640 1 -- 172.21.15.67:0/4133051572 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0096b0 con 0x7ff0e0003f40 2024-09-19T05:45:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0fdc00640 1 -- 172.21.15.67:0/4133051572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e0003f40 msgr2=0x7ff0e0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0fdc00640 1 --2- 172.21.15.67:0/4133051572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e0003f40 0x7ff0e0004810 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009ab0 tx=0x7ff0ec01ca30 comp rx=0 tx=0).stop 2024-09-19T05:45:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0f7fff640 1 -- 172.21.15.67:0/4133051572 reap_dead start 2024-09-19T05:45:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0fdc00640 1 -- 172.21.15.67:0/4133051572 shutdown_connections 2024-09-19T05:45:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0fdc00640 1 -- 172.21.15.67:0/4133051572 >> 172.21.15.67:0/4133051572 conn(0x7ff0f808bfc0 msgr2=0x7ff0f80d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0fdc00640 1 -- 172.21.15.67:0/4133051572 shutdown_connections 2024-09-19T05:45:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.891+0000 7ff0fdc00640 1 -- 172.21.15.67:0/4133051572 wait complete. 2024-09-19T05:45:23.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 Processor -- start 2024-09-19T05:45:23.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 -- start start 2024-09-19T05:45:23.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0e0003f40 0x7ff0f815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0f80b2090 0x7ff0f80b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0f80b96a0 0x7ff0f80b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f80b5d00 con 0x7ff0f80b96a0 2024-09-19T05:45:23.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f80b3ca0 con 0x7ff0f80b2090 2024-09-19T05:45:23.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f8162180 con 0x7ff0e0003f40 2024-09-19T05:45:23.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0f80b96a0 0x7ff0f80b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0f80b96a0 0x7ff0f80b9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45344/0 (socket says 172.21.15.67:45344) 2024-09-19T05:45:23.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f7fff640 1 -- 172.21.15.67:0/3575358396 learned_addr learned my addr 172.21.15.67:0/3575358396 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:23.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f77fe640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0e0003f40 0x7ff0f815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f6ffd640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0f80b2090 0x7ff0f80b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f7fff640 1 -- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0e0003f40 msgr2=0x7ff0f815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:23.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f7fff640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0e0003f40 0x7ff0f815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f7fff640 1 -- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0f80b2090 msgr2=0x7ff0f80b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:23.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f7fff640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0f80b2090 0x7ff0f80b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f7fff640 1 -- 172.21.15.67:0/3575358396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f81f5360 con 0x7ff0f80b96a0 2024-09-19T05:45:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0f7fff640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0f80b96a0 0x7ff0f80b9b20 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80b7080 tx=0x7ff0f00119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0dffff640 1 -- 172.21.15.67:0/3575358396 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0010040 con 0x7ff0f80b96a0 2024-09-19T05:45:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0dffff640 1 -- 172.21.15.67:0/3575358396 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f001a070 con 0x7ff0f80b96a0 2024-09-19T05:45:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0dffff640 1 -- 172.21.15.67:0/3575358396 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f00139e0 con 0x7ff0f80b96a0 2024-09-19T05:45:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 -- 172.21.15.67:0/3575358396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f80ba060 con 0x7ff0f80b96a0 2024-09-19T05:45:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 -- 172.21.15.67:0/3575358396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f81f4880 con 0x7ff0f80b96a0 2024-09-19T05:45:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.895+0000 7ff0fdc00640 1 -- 172.21.15.67:0/3575358396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f80b2a50 con 0x7ff0f80b96a0 2024-09-19T05:45:23.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.899+0000 7ff0dffff640 1 -- 172.21.15.67:0/3575358396 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0f0013b80 con 0x7ff0f80b96a0 2024-09-19T05:45:23.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.899+0000 7ff0dffff640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0e40678c0 0x7ff0e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:23.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.899+0000 7ff0dffff640 1 -- 172.21.15.67:0/3575358396 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7ff0f0088c00 con 0x7ff0f80b96a0 2024-09-19T05:45:23.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.899+0000 7ff0f77fe640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0e40678c0 0x7ff0e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:23.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.899+0000 7ff0f77fe640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0e40678c0 0x7ff0e4069d80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8007440 tx=0x7ff0e800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:23.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:23.903+0000 7ff0dffff640 1 -- 172.21.15.67:0/3575358396 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff0f008f080 con 0x7ff0f80b96a0 2024-09-19T05:45:24.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.119+0000 7ff0fdc00640 1 -- 172.21.15.67:0/3575358396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff0f80d12c0 con 0x7ff0f80b96a0 2024-09-19T05:45:24.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.119+0000 7ff0dffff640 1 -- 172.21.15.67:0/3575358396 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7ff0f0059590 con 0x7ff0f80b96a0 2024-09-19T05:45:24.118 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:24.118 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":753,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":157,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078291705,"bytes_used":2672316416,"bytes_avail":770421796864,"bytes_total":773094113280,"write_bytes_sec":42050805,"read_op_per_sec":0,"write_op_per_sec":44},"fsmap":{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":9066}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-19T05:45:23.363784+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:45:24.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 -- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0e40678c0 msgr2=0x7ff0e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0e40678c0 0x7ff0e4069d80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8007440 tx=0x7ff0e800b040 comp rx=0 tx=0).stop 2024-09-19T05:45:24.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 -- 172.21.15.67:0/3575358396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0f80b96a0 msgr2=0x7ff0f80b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0f80b96a0 0x7ff0f80b9b20 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80b7080 tx=0x7ff0f00119f0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 -- 172.21.15.67:0/3575358396 shutdown_connections 2024-09-19T05:45:24.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0f80b96a0 0x7ff0f80b9b20 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0f80b2090 0x7ff0f80b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff0e40678c0 0x7ff0e4069d80 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 --2- 172.21.15.67:0/3575358396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0e0003f40 0x7ff0f815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 -- 172.21.15.67:0/3575358396 >> 172.21.15.67:0/3575358396 conn(0x7ff0f808bfc0 msgr2=0x7ff0f80cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 -- 172.21.15.67:0/3575358396 shutdown_connections 2024-09-19T05:45:24.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.123+0000 7ff0fdc00640 1 -- 172.21.15.67:0/3575358396 wait complete. 2024-09-19T05:45:24.136 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused paths [/scrub_control_test_path]'} 2024-09-19T05:45:24.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:24.137 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub abort 2024-09-19T05:45:24.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4dc868640 1 Processor -- start 2024-09-19T05:45:24.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4dc868640 1 -- start start 2024-09-19T05:45:24.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4dc868640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc4d80b6c70 0x7fc4d806d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4dc868640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc4d80cff60 0x7fc4d80d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4dc868640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d80cf1a0 con 0x7fc4d815ea60 2024-09-19T05:45:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4dc868640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d80cf480 con 0x7fc4d80cff60 2024-09-19T05:45:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4dc868640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d80cf760 con 0x7fc4d80b6c70 2024-09-19T05:45:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc4d815ea60 0x7fc4d80b6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55272/0 (socket says 172.21.15.67:55272) 2024-09-19T05:45:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d659c640 1 -- 172.21.15.67:0/4169438670 learned_addr learned my addr 172.21.15.67:0/4169438670 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d6d9d640 1 --2- 172.21.15.67:0/4169438670 >> v2:172.21.15.67:3300/0 conn(0x7fc4d80cff60 0x7fc4d80d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/4169438670 >> v2:172.21.15.97:3300/0 conn(0x7fc4d80b6c70 0x7fc4d806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d559a640 1 -- 172.21.15.67:0/4169438670 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816791776 0 0) 0x7fc4d80cf1a0 con 0x7fc4d815ea60 2024-09-19T05:45:24.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d559a640 1 -- 172.21.15.67:0/4169438670 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4c0003530 con 0x7fc4d815ea60 2024-09-19T05:45:24.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d6d9d640 1 -- 172.21.15.67:0/4169438670 >> v2:172.21.15.97:3300/0 conn(0x7fc4d80b6c70 msgr2=0x7fc4d806d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d6d9d640 1 --2- 172.21.15.67:0/4169438670 >> v2:172.21.15.97:3300/0 conn(0x7fc4d80b6c70 0x7fc4d806d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d6d9d640 1 -- 172.21.15.67:0/4169438670 >> v1:172.21.15.67:6789/0 conn(0x7fc4d815ea60 legacy=0x7fc4d80b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d6d9d640 1 -- 172.21.15.67:0/4169438670 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d80b3340 con 0x7fc4d80cff60 2024-09-19T05:45:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.255+0000 7fc4d6d9d640 1 --2- 172.21.15.67:0/4169438670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 0x7fc4d80d2910 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80d26c0 tx=0x7fc4d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a6f006b91a91c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d559a640 1 -- 172.21.15.67:0/4169438670 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00b1070 con 0x7fc4d80cff60 2024-09-19T05:45:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d559a640 1 -- 172.21.15.67:0/4169438670 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d00ac5f0 con 0x7fc4d80cff60 2024-09-19T05:45:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d559a640 1 -- 172.21.15.67:0/4169438670 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00ac9c0 con 0x7fc4d80cff60 2024-09-19T05:45:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- 172.21.15.67:0/4169438670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 msgr2=0x7fc4d80d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 --2- 172.21.15.67:0/4169438670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 0x7fc4d80d2910 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80d26c0 tx=0x7fc4d001c480 comp rx=0 tx=0).stop 2024-09-19T05:45:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- 172.21.15.67:0/4169438670 shutdown_connections 2024-09-19T05:45:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 --2- 172.21.15.67:0/4169438670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 0x7fc4d80d2910 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 --2- 172.21.15.67:0/4169438670 >> v2:172.21.15.97:3300/0 conn(0x7fc4d80b6c70 0x7fc4d806d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- 172.21.15.67:0/4169438670 >> 172.21.15.67:0/4169438670 conn(0x7fc4d80d1620 msgr2=0x7fc4d80d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- 172.21.15.67:0/4169438670 shutdown_connections 2024-09-19T05:45:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- 172.21.15.67:0/4169438670 wait complete. 2024-09-19T05:45:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 Processor -- start 2024-09-19T05:45:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- start start 2024-09-19T05:45:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4d80b6c70 0x7fc4d80cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 0x7fc4d8158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4d815ea60 0x7fc4d8153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d816bca0 con 0x7fc4d80cff60 2024-09-19T05:45:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d816bb20 con 0x7fc4d815ea60 2024-09-19T05:45:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d816be20 con 0x7fc4d80b6c70 2024-09-19T05:45:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 0x7fc4d8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 0x7fc4d8158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45372/0 (socket says 172.21.15.67:45372) 2024-09-19T05:45:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d5d9b640 1 -- 172.21.15.67:0/2853025586 learned_addr learned my addr 172.21.15.67:0/2853025586 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d659c640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4d80b6c70 0x7fc4d80cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d6d9d640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4d815ea60 0x7fc4d8153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d5d9b640 1 -- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4d80b6c70 msgr2=0x7fc4d80cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4d80b6c70 0x7fc4d80cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d5d9b640 1 -- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4d815ea60 msgr2=0x7fc4d8153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4d815ea60 0x7fc4d8153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d5d9b640 1 -- 172.21.15.67:0/2853025586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d81617d0 con 0x7fc4d80cff60 2024-09-19T05:45:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 0x7fc4d8158110 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00d5f0 tx=0x7fc4cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4c6ffd640 1 -- 172.21.15.67:0/2853025586 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0125f0 con 0x7fc4d80cff60 2024-09-19T05:45:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4c6ffd640 1 -- 172.21.15.67:0/2853025586 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc019070 con 0x7fc4d80cff60 2024-09-19T05:45:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- 172.21.15.67:0/2853025586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d815fbf0 con 0x7fc4d80cff60 2024-09-19T05:45:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4c6ffd640 1 -- 172.21.15.67:0/2853025586 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0129b0 con 0x7fc4d80cff60 2024-09-19T05:45:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.259+0000 7fc4dc868640 1 -- 172.21.15.67:0/2853025586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d8161210 con 0x7fc4d80cff60 2024-09-19T05:45:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4c6ffd640 1 -- 172.21.15.67:0/2853025586 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4cc012b50 con 0x7fc4d80cff60 2024-09-19T05:45:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4c6ffd640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4b80678f0 0x7fc4b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4c6ffd640 1 -- 172.21.15.67:0/2853025586 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fc4cc086250 con 0x7fc4d80cff60 2024-09-19T05:45:24.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4b80678f0 0x7fc4b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4df924000 1 Processor -- start 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4df924000 1 -- start start 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4b80678f0 0x7fc4b8069db0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80012f0 tx=0x7fc4c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4df924000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfaeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4df924000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 0x557e3cf62240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4df924000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf62780 0x557e3cf62b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4df924000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557e3cdb3cc0 con 0x557e3cfaec10 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4df924000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557e3cd6ea20 con 0x557e3cf62780 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4df924000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557e3cdafc80 con 0x557e3cfaf530 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfaeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfaeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45384/0 (socket says 172.21.15.67:45384) 2024-09-19T05:45:24.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 -- 172.21.15.67:0/3794811556 learned_addr learned my addr 172.21.15.67:0/3794811556 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 0x557e3cf62240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d6d9d640 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf62780 0x557e3cf62b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 -- 172.21.15.67:0/3794811556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 msgr2=0x557e3cf62240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 0x557e3cf62240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 -- 172.21.15.67:0/3794811556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf62780 msgr2=0x557e3cf62b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf62780 0x557e3cf62b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 -- 172.21.15.67:0/3794811556 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3cd56d40 con 0x557e3cfaec10 2024-09-19T05:45:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d6d9d640 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf62780 0x557e3cf62b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:24.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 0x557e3cf62240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4d659c640 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfaeff0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800df80 tx=0x7fc4c8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69f6121f8c9d60e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4b7fff640 1 -- 172.21.15.67:0/3794811556 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8012820 con 0x557e3cfaec10 2024-09-19T05:45:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4b7fff640 1 -- 172.21.15.67:0/3794811556 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c80129c0 con 0x557e3cfaec10 2024-09-19T05:45:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4b7fff640 1 -- 172.21.15.67:0/3794811556 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8012d70 con 0x557e3cfaec10 2024-09-19T05:45:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4df924000 1 -- 172.21.15.67:0/3794811556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 msgr2=0x557e3cfaeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.263+0000 7fc4df924000 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfaeff0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800df80 tx=0x7fc4c8010000 comp rx=0 tx=0).stop 2024-09-19T05:45:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- 172.21.15.67:0/3794811556 shutdown_connections 2024-09-19T05:45:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf62780 0x557e3cf62b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 0x557e3cf62240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 --2- 172.21.15.67:0/3794811556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfaeff0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- 172.21.15.67:0/3794811556 >> 172.21.15.67:0/3794811556 conn(0x557e3cf8f9b0 msgr2=0x557e3cf91da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- 172.21.15.67:0/3794811556 shutdown_connections 2024-09-19T05:45:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- 172.21.15.67:0/3794811556 wait complete. 2024-09-19T05:45:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- start start 2024-09-19T05:45:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 Processor -- start 2024-09-19T05:45:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfb5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cfaec10 0x557e3cfb64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 0x557e3cf68450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557e3cd4d2c0 con 0x557e3cf62780 2024-09-19T05:45:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557e3cd72370 con 0x557e3cfaec10 2024-09-19T05:45:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557e3cdc1f50 con 0x557e3cfaf530 2024-09-19T05:45:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 10 client.0 _ll_register_callbacks cb 0x557e3ce14db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfb5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfb5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45400/0 (socket says 172.21.15.67:45400) 2024-09-19T05:45:24.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d659c640 1 -- 172.21.15.67:0/2971409743 learned_addr learned my addr 172.21.15.67:0/2971409743 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d6d9d640 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 0x557e3cf68450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d659c640 1 -- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 msgr2=0x557e3cf68450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d659c640 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 0x557e3cf68450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cfaec10 0x557e3cfb64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d659c640 1 -- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cfaec10 msgr2=0x557e3cfb64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d659c640 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cfaec10 0x557e3cfb64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d659c640 1 -- 172.21.15.67:0/2971409743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e3cd53770 con 0x557e3cf62780 2024-09-19T05:45:24.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d659c640 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfb5f70 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8007930 tx=0x7fc4c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba69ca84056f401 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2971409743 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8004d80 con 0x557e3cf62780 2024-09-19T05:45:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2971409743 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fc4c8020450 con 0x557e3cf62780 2024-09-19T05:45:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- 172.21.15.67:0/2971409743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4c80129c0 con 0x557e3cf62780 2024-09-19T05:45:24.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2971409743 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fc4c8033050 con 0x557e3cf62780 2024-09-19T05:45:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 10 client.9330 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- 172.21.15.67:0/2971409743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x557e3cd713f0 con 0x557e3cf62780 2024-09-19T05:45:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2971409743 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c80129c0 con 0x557e3cf62780 2024-09-19T05:45:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2971409743 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fc4c8036020 con 0x557e3cf62780 2024-09-19T05:45:24.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 10 client.9330 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 10 client.9330 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 20 client.9330 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x557e3cf68e60 0x557e3cf69240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 4 client.9330 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:24.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4df924000 1 -- 172.21.15.67:0/2971409743 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e3cd4dd90 con 0x557e3cf68e60 2024-09-19T05:45:24.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x557e3cf68e60 0x557e3cf69240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4b57fa640 10 client.9330 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:24.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.267+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x557e3cf68e60 0x557e3cf69240 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb2900d5f56464 server_cookie=5c09cd929f090a80 in_seq=0 out_seq=0 2024-09-19T05:45:24.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2971409743 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e3cd4dd90 con 0x557e3cf68e60 2024-09-19T05:45:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4b57fa640 10 client.9330 handle_command_reply: tid=0 2024-09-19T05:45:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 client.9330 shutdown 2024-09-19T05:45:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 -- 172.21.15.67:0/2971409743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 msgr2=0x557e3cfb5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfb5f70 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8007930 tx=0x7fc4c8012000 comp rx=0 tx=0).stop 2024-09-19T05:45:24.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 -- 172.21.15.67:0/2971409743 shutdown_connections 2024-09-19T05:45:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x557e3cf68e60 0x557e3cf69240 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaf530 0x557e3cf68450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cfaec10 0x557e3cfb64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4b57fa640 0 client.9330 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 --2- 172.21.15.67:0/2971409743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfb5f70 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 -- 172.21.15.67:0/2971409743 >> 172.21.15.67:0/2971409743 conn(0x557e3cf8f9b0 msgr2=0x557e3cf61940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 -- 172.21.15.67:0/2971409743 shutdown_connections 2024-09-19T05:45:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 1 -- 172.21.15.67:0/2971409743 wait complete. 2024-09-19T05:45:24.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.271+0000 7fc4df924000 20 client.9330 trim_cache size 0 max 16384 2024-09-19T05:45:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4df924000 1 Processor -- start 2024-09-19T05:45:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4df924000 1 -- start start 2024-09-19T05:45:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4df924000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf8f9b0 0x557e3cfbc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4df924000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cf62780 0x557e3cfc6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4df924000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfc6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4df924000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d8203390 con 0x557e3cfaec10 2024-09-19T05:45:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4df924000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d8156800 con 0x557e3cf8f9b0 2024-09-19T05:45:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4df924000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d8156e50 con 0x557e3cf62780 2024-09-19T05:45:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4d6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfc6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4d6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfc6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45408/0 (socket says 172.21.15.67:45408) 2024-09-19T05:45:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4d6d9d640 1 -- 172.21.15.67:0/4174146916 learned_addr learned my addr 172.21.15.67:0/4174146916 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4d6d9d640 1 -- 172.21.15.67:0/4174146916 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cf62780 msgr2=0x557e3cfc6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4d6d9d640 1 --2- 172.21.15.67:0/4174146916 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cf62780 0x557e3cfc6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4d6d9d640 1 -- 172.21.15.67:0/4174146916 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf8f9b0 msgr2=0x557e3cfbc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4d6d9d640 1 --2- 172.21.15.67:0/4174146916 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf8f9b0 0x557e3cfbc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4d6d9d640 1 -- 172.21.15.67:0/4174146916 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3ce35320 con 0x557e3cfaec10 2024-09-19T05:45:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4d6d9d640 1 --2- 172.21.15.67:0/4174146916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfc6860 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00af040 tx=0x7fc4d00a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecc1b5f79038200 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4b77fe640 1 -- 172.21.15.67:0/4174146916 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00bd070 con 0x557e3cfaec10 2024-09-19T05:45:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4b77fe640 1 -- 172.21.15.67:0/4174146916 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d00ac6f0 con 0x557e3cfaec10 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.287+0000 7fc4b77fe640 1 -- 172.21.15.67:0/4174146916 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00b1040 con 0x557e3cfaec10 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- 172.21.15.67:0/4174146916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 msgr2=0x557e3cfc6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 --2- 172.21.15.67:0/4174146916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfc6860 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00af040 tx=0x7fc4d00a7000 comp rx=0 tx=0).stop 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- 172.21.15.67:0/4174146916 shutdown_connections 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 --2- 172.21.15.67:0/4174146916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cfaec10 0x557e3cfc6860 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 --2- 172.21.15.67:0/4174146916 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cf62780 0x557e3cfc6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 --2- 172.21.15.67:0/4174146916 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf8f9b0 0x557e3cfbc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- 172.21.15.67:0/4174146916 >> 172.21.15.67:0/4174146916 conn(0x557e3cf67e30 msgr2=0x557e3cf618a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- 172.21.15.67:0/4174146916 shutdown_connections 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- 172.21.15.67:0/4174146916 wait complete. 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- start start 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 Processor -- start 2024-09-19T05:45:24.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfbba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf8f9b0 0x557e3cfbbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaec10 0x557e3d01f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557e3cd5b120 con 0x557e3cf62780 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557e3ce34e90 con 0x557e3cf8f9b0 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557e3cd5db90 con 0x557e3cfaec10 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 10 client.0 _ll_register_callbacks cb 0x7fc4c800de50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfbba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfbba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45418/0 (socket says 172.21.15.67:45418) 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d659c640 1 -- 172.21.15.67:0/2237518515 learned_addr learned my addr 172.21.15.67:0/2237518515 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d659c640 1 -- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaec10 msgr2=0x557e3d01f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d659c640 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaec10 0x557e3d01f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d659c640 1 -- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf8f9b0 msgr2=0x557e3cfbbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf8f9b0 0x557e3cfbbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d659c640 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf8f9b0 0x557e3cfbbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d659c640 1 -- 172.21.15.67:0/2237518515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e3cd475c0 con 0x557e3cf62780 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d659c640 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfbba40 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800da50 tx=0x7fc4c8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d022081e140118a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2237518515 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80129a0 con 0x557e3cf62780 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2237518515 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fc4c802cd10 con 0x557e3cf62780 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- 172.21.15.67:0/2237518515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d00ac6f0 con 0x557e3cf62780 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2237518515 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fc4c803f050 con 0x557e3cf62780 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 10 client.9336 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- 172.21.15.67:0/2237518515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x557e3cd4b330 con 0x557e3cf62780 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2237518515 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d00ac6f0 con 0x557e3cf62780 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2237518515 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fc4c8042020 con 0x557e3cf62780 2024-09-19T05:45:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 10 client.9336 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 10 client.9336 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 20 client.9336 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x557e3cfaf530 0x557e3d0201f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 4 client.9336 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4df924000 1 -- 172.21.15.67:0/2237518515 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x557e3cdc13f0 con 0x557e3cfaf530 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x557e3cfaf530 0x557e3d0201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4b57fa640 10 client.9336 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.291+0000 7fc4d5d9b640 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x557e3cfaf530 0x557e3d0201f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91d3ba217f75534f server_cookie=757dcbc6d5a57d49 in_seq=0 out_seq=0 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4b57fa640 1 -- 172.21.15.67:0/2237518515 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e3cdc13f0 con 0x557e3cfaf530 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4b57fa640 10 client.9336 handle_command_reply: tid=0 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 client.9336 shutdown 2024-09-19T05:45:24.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 -- 172.21.15.67:0/2237518515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 msgr2=0x557e3cfbba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfbba40 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800da50 tx=0x7fc4c8001260 comp rx=0 tx=0).stop 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 -- 172.21.15.67:0/2237518515 shutdown_connections 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x557e3cfaf530 0x557e3d0201f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557e3cfaec10 0x557e3d01f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3cf8f9b0 0x557e3cfbbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4b57fa640 0 client.9336 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 --2- 172.21.15.67:0/2237518515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e3cf62780 0x557e3cfbba40 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 -- 172.21.15.67:0/2237518515 >> 172.21.15.67:0/2237518515 conn(0x557e3cf67e30 msgr2=0x557e3cf61fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 -- 172.21.15.67:0/2237518515 shutdown_connections 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 1 -- 172.21.15.67:0/2237518515 wait complete. 2024-09-19T05:45:24.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4df924000 20 client.9336 trim_cache size 0 max 16384 2024-09-19T05:45:24.304 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:45:24.304 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:45:24.304 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:45:24.304 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:45:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 -- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4b80678f0 msgr2=0x7fc4b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4b80678f0 0x7fc4b8069db0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80012f0 tx=0x7fc4c8009040 comp rx=0 tx=0).stop 2024-09-19T05:45:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 -- 172.21.15.67:0/2853025586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 msgr2=0x7fc4d8158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 0x7fc4d8158110 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00d5f0 tx=0x7fc4cc00dab0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 -- 172.21.15.67:0/2853025586 shutdown_connections 2024-09-19T05:45:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4d815ea60 0x7fc4d8153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d80cff60 0x7fc4d8158110 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc4b80678f0 0x7fc4b8069db0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 --2- 172.21.15.67:0/2853025586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4d80b6c70 0x7fc4d80cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 -- 172.21.15.67:0/2853025586 >> 172.21.15.67:0/2853025586 conn(0x7fc4d80d1620 msgr2=0x7fc4d80b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 -- 172.21.15.67:0/2853025586 shutdown_connections 2024-09-19T05:45:24.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.295+0000 7fc4dc868640 1 -- 172.21.15.67:0/2853025586 wait complete. 2024-09-19T05:45:24.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:24.307 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-19T05:45:24.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.419+0000 7f6795a15640 1 Processor -- start 2024-09-19T05:45:24.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.419+0000 7f6795a15640 1 -- start start 2024-09-19T05:45:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f679015b1d0 0x7f67900adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6790070070 0x7f67900b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67900aef30 con 0x7f679006dfc0 2024-09-19T05:45:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6790072210 con 0x7f679015b1d0 2024-09-19T05:45:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f67900ae0f0 con 0x7f6790070070 2024-09-19T05:45:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678effd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f679015b1d0 0x7f67900adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678effd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f679015b1d0 0x7f67900adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45434/0 (socket says 172.21.15.67:45434) 2024-09-19T05:45:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678effd640 1 -- 172.21.15.67:0/970401105 learned_addr learned my addr 172.21.15.67:0/970401105 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678f7fe640 1 --2- 172.21.15.67:0/970401105 >> v2:172.21.15.97:3300/0 conn(0x7f6790070070 0x7f67900b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678effd640 1 -- 172.21.15.67:0/970401105 >> v2:172.21.15.97:3300/0 conn(0x7f6790070070 msgr2=0x7f67900b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678effd640 1 --2- 172.21.15.67:0/970401105 >> v2:172.21.15.97:3300/0 conn(0x7f6790070070 0x7f67900b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678effd640 1 -- 172.21.15.67:0/970401105 >> v1:172.21.15.97:6789/0 conn(0x7f679006dfc0 legacy=0x7f679006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678effd640 1 -- 172.21.15.67:0/970401105 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67900ae3b0 con 0x7f679015b1d0 2024-09-19T05:45:24.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678effd640 1 --2- 172.21.15.67:0/970401105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 0x7f67900adbb0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f67900b52f0 tx=0x7f678001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a855a715fd454838 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678e7fc640 1 -- 172.21.15.67:0/970401105 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67800b1070 con 0x7f679015b1d0 2024-09-19T05:45:24.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678e7fc640 1 -- 172.21.15.67:0/970401105 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67800ac630 con 0x7f679015b1d0 2024-09-19T05:45:24.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f678e7fc640 1 -- 172.21.15.67:0/970401105 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67800a8050 con 0x7f679015b1d0 2024-09-19T05:45:24.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 -- 172.21.15.67:0/970401105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 msgr2=0x7f67900adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 --2- 172.21.15.67:0/970401105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 0x7f67900adbb0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f67900b52f0 tx=0x7f678001c4e0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 -- 172.21.15.67:0/970401105 shutdown_connections 2024-09-19T05:45:24.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 --2- 172.21.15.67:0/970401105 >> v2:172.21.15.97:3300/0 conn(0x7f6790070070 0x7f67900b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 --2- 172.21.15.67:0/970401105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 0x7f67900adbb0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 -- 172.21.15.67:0/970401105 >> 172.21.15.67:0/970401105 conn(0x7f67900b1e50 msgr2=0x7f67900b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 -- 172.21.15.67:0/970401105 shutdown_connections 2024-09-19T05:45:24.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.423+0000 7f6795a15640 1 -- 172.21.15.67:0/970401105 wait complete. 2024-09-19T05:45:24.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6795a15640 1 Processor -- start 2024-09-19T05:45:24.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6795a15640 1 -- start start 2024-09-19T05:45:24.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6795a15640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679006dfc0 0x7f679009dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6795a15640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6790070070 0x7f6790150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6795a15640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 0x7f67900725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6795a15640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67900b4180 con 0x7f679015b1d0 2024-09-19T05:45:24.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6795a15640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6790072420 con 0x7f679006dfc0 2024-09-19T05:45:24.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6795a15640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67900b4300 con 0x7f6790070070 2024-09-19T05:45:24.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 0x7f67900725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 0x7f67900725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45438/0 (socket says 172.21.15.67:45438) 2024-09-19T05:45:24.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678f7fe640 1 -- 172.21.15.67:0/50394489 learned_addr learned my addr 172.21.15.67:0/50394489 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678effd640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679006dfc0 0x7f679009dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6787fff640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6790070070 0x7f6790150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678f7fe640 1 -- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6790070070 msgr2=0x7f6790150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678f7fe640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6790070070 0x7f6790150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678f7fe640 1 -- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679006dfc0 msgr2=0x7f679009dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678f7fe640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679006dfc0 0x7f679009dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678f7fe640 1 -- 172.21.15.67:0/50394489 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679009e190 con 0x7f679015b1d0 2024-09-19T05:45:24.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678effd640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679006dfc0 0x7f679009dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:24.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678f7fe640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 0x7f67900725a0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f6788007e60 tx=0x7f67880106c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678cff9640 1 -- 172.21.15.67:0/50394489 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788018070 con 0x7f679015b1d0 2024-09-19T05:45:24.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678cff9640 1 -- 172.21.15.67:0/50394489 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880138a0 con 0x7f679015b1d0 2024-09-19T05:45:24.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f678cff9640 1 -- 172.21.15.67:0/50394489 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788013c90 con 0x7f679015b1d0 2024-09-19T05:45:24.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6795a15640 1 -- 172.21.15.67:0/50394489 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6790150f50 con 0x7f679015b1d0 2024-09-19T05:45:24.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.427+0000 7f6795a15640 1 -- 172.21.15.67:0/50394489 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679013c1f0 con 0x7f679015b1d0 2024-09-19T05:45:24.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678cff9640 1 -- 172.21.15.67:0/50394489 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f678801b070 con 0x7f679015b1d0 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678cff9640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67700678c0 0x7f6770069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678cff9640 1 -- 172.21.15.67:0/50394489 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f6788088e10 con 0x7f679015b1d0 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678effd640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67700678c0 0x7f6770069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f6798ad1000 1 Processor -- start 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f6798ad1000 1 -- start start 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678effd640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67700678c0 0x7f6770069d80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f67800ae000 tx=0x7f6780008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 0x5566a3e9b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e9b690 0x5566a3e4e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e4edb0 0x5566a3e4f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f6798ad1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5566a3d38960 con 0x5566a3e4edb0 2024-09-19T05:45:24.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f6798ad1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5566a3c7c900 con 0x5566a3e9ad70 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f6798ad1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5566a3c9fd40 con 0x5566a3e9b690 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e4edb0 0x5566a3e4f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e4edb0 0x5566a3e4f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45450/0 (socket says 172.21.15.67:45450) 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678f7fe640 1 -- 172.21.15.67:0/3314826879 learned_addr learned my addr 172.21.15.67:0/3314826879 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678effd640 1 --2- 172.21.15.67:0/3314826879 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 0x5566a3e9b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f6787fff640 1 --2- 172.21.15.67:0/3314826879 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e9b690 0x5566a3e4e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678f7fe640 1 -- 172.21.15.67:0/3314826879 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e9b690 msgr2=0x5566a3e4e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678f7fe640 1 --2- 172.21.15.67:0/3314826879 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e9b690 0x5566a3e4e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678f7fe640 1 -- 172.21.15.67:0/3314826879 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 msgr2=0x5566a3e9b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678f7fe640 1 --2- 172.21.15.67:0/3314826879 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 0x5566a3e9b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678f7fe640 1 -- 172.21.15.67:0/3314826879 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566a3c46580 con 0x5566a3e4edb0 2024-09-19T05:45:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678effd640 1 --2- 172.21.15.67:0/3314826879 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 0x5566a3e9b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f678f7fe640 1 --2- 172.21.15.67:0/3314826879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e4edb0 0x5566a3e4f190 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f6788058ef0 tx=0x7f6788013ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598e360ba8c525ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f67857fa640 1 -- 172.21.15.67:0/3314826879 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788071020 con 0x5566a3e4edb0 2024-09-19T05:45:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.431+0000 7f67857fa640 1 -- 172.21.15.67:0/3314826879 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678805d310 con 0x5566a3e4edb0 2024-09-19T05:45:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f67857fa640 1 -- 172.21.15.67:0/3314826879 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788022050 con 0x5566a3e4edb0 2024-09-19T05:45:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- 172.21.15.67:0/3314826879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e4edb0 msgr2=0x5566a3e4f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 --2- 172.21.15.67:0/3314826879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e4edb0 0x5566a3e4f190 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f6788058ef0 tx=0x7f6788013ef0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- 172.21.15.67:0/3314826879 shutdown_connections 2024-09-19T05:45:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 --2- 172.21.15.67:0/3314826879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e4edb0 0x5566a3e4f190 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 --2- 172.21.15.67:0/3314826879 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e9b690 0x5566a3e4e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 --2- 172.21.15.67:0/3314826879 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 0x5566a3e9b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- 172.21.15.67:0/3314826879 >> 172.21.15.67:0/3314826879 conn(0x5566a3e7c040 msgr2=0x5566a3e7e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- 172.21.15.67:0/3314826879 shutdown_connections 2024-09-19T05:45:24.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- 172.21.15.67:0/3314826879 wait complete. 2024-09-19T05:45:24.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- start start 2024-09-19T05:45:24.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 Processor -- start 2024-09-19T05:45:24.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3ea1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 0x5566a3ea2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9b690 0x5566a3ea2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5566a3c9bd00 con 0x5566a3e9b690 2024-09-19T05:45:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5566a3c5aaa0 con 0x5566a3e9ad70 2024-09-19T05:45:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5566a3c39340 con 0x5566a3e4edb0 2024-09-19T05:45:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9b690 0x5566a3ea2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 10 client.0 _ll_register_callbacks cb 0x5566a3e3c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:24.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9b690 0x5566a3ea2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45460/0 (socket says 172.21.15.67:45460) 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678f7fe640 1 -- 172.21.15.67:0/845935666 learned_addr learned my addr 172.21.15.67:0/845935666 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678effd640 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3ea1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678f7fe640 1 -- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 msgr2=0x5566a3ea1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6787fff640 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 0x5566a3ea2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678f7fe640 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3ea1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678f7fe640 1 -- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 msgr2=0x5566a3ea2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678f7fe640 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 0x5566a3ea2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678f7fe640 1 -- 172.21.15.67:0/845935666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566a3c42dc0 con 0x5566a3e9b690 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678effd640 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3ea1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678f7fe640 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9b690 0x5566a3ea2760 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f6788058ef0 tx=0x7f678801f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1120e7a6ca3a1bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f676e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f676e7fc640 1 -- 172.21.15.67:0/845935666 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788061940 con 0x5566a3e9b690 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f676e7fc640 1 -- 172.21.15.67:0/845935666 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f67880583b0 con 0x5566a3e9b690 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- 172.21.15.67:0/845935666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f678805d310 con 0x5566a3e9b690 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f676e7fc640 1 -- 172.21.15.67:0/845935666 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f678807e050 con 0x5566a3e9b690 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 10 client.9348 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- 172.21.15.67:0/845935666 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x5566a3c3f7f0 con 0x5566a3e9b690 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f676e7fc640 1 -- 172.21.15.67:0/845935666 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678805d310 con 0x5566a3e9b690 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f676e7fc640 1 -- 172.21.15.67:0/845935666 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7f6788073030 con 0x5566a3e9b690 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 10 client.9348 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 10 client.9348 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 20 client.9348 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5566a3eaa0b0 0x5566a3eac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 4 client.9348 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f6798ad1000 1 -- 172.21.15.67:0/845935666 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566a3c39e10 con 0x5566a3eaa0b0 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.435+0000 7f678effd640 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5566a3eaa0b0 0x5566a3eac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f676e7fc640 10 client.9348 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f678effd640 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5566a3eaa0b0 0x5566a3eac4a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fa7e822b25375a7 server_cookie=b25e9121739cdc56 in_seq=0 out_seq=0 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f676e7fc640 1 -- 172.21.15.67:0/845935666 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5566a3c39e10 con 0x5566a3eaa0b0 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f676e7fc640 10 client.9348 handle_command_reply: tid=0 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 client.9348 shutdown 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 -- 172.21.15.67:0/845935666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9b690 msgr2=0x5566a3ea2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9b690 0x5566a3ea2760 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f6788058ef0 tx=0x7f678801f070 comp rx=0 tx=0).stop 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 -- 172.21.15.67:0/845935666 shutdown_connections 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5566a3eaa0b0 0x5566a3eac4a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9b690 0x5566a3ea2760 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e9ad70 0x5566a3ea2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f676e7fc640 0 client.9348 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 --2- 172.21.15.67:0/845935666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3ea1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 -- 172.21.15.67:0/845935666 >> 172.21.15.67:0/845935666 conn(0x5566a3e7c040 msgr2=0x5566a3e4df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 -- 172.21.15.67:0/845935666 shutdown_connections 2024-09-19T05:45:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 1 -- 172.21.15.67:0/845935666 wait complete. 2024-09-19T05:45:24.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.439+0000 7f6798ad1000 20 client.9348 trim_cache size 0 max 16384 2024-09-19T05:45:24.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.455+0000 7f6798ad1000 1 Processor -- start 2024-09-19T05:45:24.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.455+0000 7f6798ad1000 1 -- start start 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e7c040 0x5566a3e56fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3ea81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ea8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67901ffcf0 con 0x5566a3e9ad70 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67901fed10 con 0x5566a3e7c040 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f679006f7b0 con 0x5566a3e4edb0 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ea8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ea8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45462/0 (socket says 172.21.15.67:45462) 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 -- 172.21.15.67:0/4145863401 learned_addr learned my addr 172.21.15.67:0/4145863401 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 -- 172.21.15.67:0/4145863401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 msgr2=0x5566a3ea81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 --2- 172.21.15.67:0/4145863401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3ea81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 -- 172.21.15.67:0/4145863401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e7c040 msgr2=0x5566a3e56fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 --2- 172.21.15.67:0/4145863401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e7c040 0x5566a3e56fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 -- 172.21.15.67:0/4145863401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566a3c5d470 con 0x5566a3e9ad70 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 --2- 172.21.15.67:0/4145863401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ea8720 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f67880616a0 tx=0x7f6788015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2f7a7dbd68f378 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6784ff9640 1 -- 172.21.15.67:0/4145863401 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788022020 con 0x5566a3e9ad70 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6784ff9640 1 -- 172.21.15.67:0/4145863401 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6788061740 con 0x5566a3e9ad70 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6784ff9640 1 -- 172.21.15.67:0/4145863401 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788054cb0 con 0x5566a3e9ad70 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- 172.21.15.67:0/4145863401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 msgr2=0x5566a3ea8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- 172.21.15.67:0/4145863401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ea8720 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f67880616a0 tx=0x7f6788015040 comp rx=0 tx=0).stop 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- 172.21.15.67:0/4145863401 shutdown_connections 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- 172.21.15.67:0/4145863401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ea8720 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- 172.21.15.67:0/4145863401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3ea81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- 172.21.15.67:0/4145863401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e7c040 0x5566a3e56fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- 172.21.15.67:0/4145863401 >> 172.21.15.67:0/4145863401 conn(0x5566a3e53890 msgr2=0x5566a3ea7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- 172.21.15.67:0/4145863401 shutdown_connections 2024-09-19T05:45:24.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- 172.21.15.67:0/4145863401 wait complete. 2024-09-19T05:45:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- start start 2024-09-19T05:45:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 Processor -- start 2024-09-19T05:45:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3eaee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e7c040 0x5566a3eca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ecacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5566a3c67400 con 0x5566a3e9ad70 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5566a3e5a3f0 con 0x5566a3e7c040 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5566a3c5e3f0 con 0x5566a3e4edb0 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 10 client.0 _ll_register_callbacks cb 0x7f67880588c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ecacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ecacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45470/0 (socket says 172.21.15.67:45470) 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 -- 172.21.15.67:0/1716947733 learned_addr learned my addr 172.21.15.67:0/1716947733 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6787fff640 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e7c040 0x5566a3eca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678effd640 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3eaee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 -- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 msgr2=0x5566a3eaee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3eaee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 -- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e7c040 msgr2=0x5566a3eca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e7c040 0x5566a3eca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 -- 172.21.15.67:0/1716947733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566a3c33640 con 0x5566a3e9ad70 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6787fff640 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e7c040 0x5566a3eca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f678f7fe640 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ecacd0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f6788058e10 tx=0x7f6788055200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a3a26c136b8439 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f676e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f676e7fc640 1 -- 172.21.15.67:0/1716947733 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788022070 con 0x5566a3e9ad70 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f676e7fc640 1 -- 172.21.15.67:0/1716947733 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f678801ecc0 con 0x5566a3e9ad70 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- 172.21.15.67:0/1716947733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6788061740 con 0x5566a3e9ad70 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f676e7fc640 1 -- 172.21.15.67:0/1716947733 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f67880586c0 con 0x5566a3e9ad70 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 10 client.9354 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- 172.21.15.67:0/1716947733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x5566a3c373b0 con 0x5566a3e9ad70 2024-09-19T05:45:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f676e7fc640 1 -- 172.21.15.67:0/1716947733 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6788061740 con 0x5566a3e9ad70 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f676e7fc640 1 -- 172.21.15.67:0/1716947733 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7f6788073040 con 0x5566a3e9ad70 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 10 client.9354 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 10 client.9354 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 20 client.9354 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5566a3e9b690 0x5566a3ecb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 4 client.9354 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.459+0000 7f6798ad1000 1 -- 172.21.15.67:0/1716947733 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5566a3cad470 con 0x5566a3e9b690 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f678effd640 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5566a3e9b690 0x5566a3ecb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f676e7fc640 10 client.9354 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f678effd640 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5566a3e9b690 0x5566a3ecb210 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f064786be6addbf0 server_cookie=94439bb2f439fe5e in_seq=0 out_seq=0 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f676e7fc640 1 -- 172.21.15.67:0/1716947733 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+69 (crc 0 0 0) 0x5566a3cad470 con 0x5566a3e9b690 2024-09-19T05:45:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f676e7fc640 10 client.9354 handle_command_reply: tid=0 2024-09-19T05:45:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 client.9354 shutdown 2024-09-19T05:45:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 -- 172.21.15.67:0/1716947733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 msgr2=0x5566a3ecacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ecacd0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f6788058e10 tx=0x7f6788055200 comp rx=0 tx=0).stop 2024-09-19T05:45:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 -- 172.21.15.67:0/1716947733 shutdown_connections 2024-09-19T05:45:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5566a3e9b690 0x5566a3ecb210 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566a3e9ad70 0x5566a3ecacd0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5566a3e7c040 0x5566a3eca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f676e7fc640 0 client.9354 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 --2- 172.21.15.67:0/1716947733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5566a3e4edb0 0x5566a3eaee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 -- 172.21.15.67:0/1716947733 >> 172.21.15.67:0/1716947733 conn(0x5566a3e53890 msgr2=0x5566a3ea82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 -- 172.21.15.67:0/1716947733 shutdown_connections 2024-09-19T05:45:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 1 -- 172.21.15.67:0/1716947733 wait complete. 2024-09-19T05:45:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6798ad1000 20 client.9354 trim_cache size 0 max 16384 2024-09-19T05:45:24.467 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:45:24.468 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-19T05:45:24.468 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {} 2024-09-19T05:45:24.468 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:45:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 -- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67700678c0 msgr2=0x7f6770069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67700678c0 0x7f6770069d80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f67800ae000 tx=0x7f6780008040 comp rx=0 tx=0).stop 2024-09-19T05:45:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 -- 172.21.15.67:0/50394489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 msgr2=0x7f67900725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 0x7f67900725a0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f6788007e60 tx=0x7f67880106c0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 -- 172.21.15.67:0/50394489 shutdown_connections 2024-09-19T05:45:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f679015b1d0 0x7f67900725a0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67700678c0 0x7f6770069d80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6790070070 0x7f6790150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 --2- 172.21.15.67:0/50394489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f679006dfc0 0x7f679009dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 -- 172.21.15.67:0/50394489 >> 172.21.15.67:0/50394489 conn(0x7f67900b1e50 msgr2=0x7f67900b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 -- 172.21.15.67:0/50394489 shutdown_connections 2024-09-19T05:45:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.463+0000 7f6795a15640 1 -- 172.21.15.67:0/50394489 wait complete. 2024-09-19T05:45:24.475 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:24.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.583+0000 7f405069d640 1 Processor -- start 2024-09-19T05:45:24.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.583+0000 7f405069d640 1 -- start start 2024-09-19T05:45:24.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4048161da0 0x7f40480d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480d0e80 0x7f40480d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40480b41c0 0x7f40480b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f40480d0840 con 0x7f4048161da0 2024-09-19T05:45:24.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f40480d1800 con 0x7f40480b41c0 2024-09-19T05:45:24.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f40480d4d40 con 0x7f40480d0e80 2024-09-19T05:45:24.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404e439640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4048161da0 0x7f40480d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404e439640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4048161da0 0x7f40480d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45482/0 (socket says 172.21.15.67:45482) 2024-09-19T05:45:24.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404e439640 1 -- 172.21.15.67:0/2028591365 learned_addr learned my addr 172.21.15.67:0/2028591365 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404dc38640 1 --2- 172.21.15.67:0/2028591365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480d0e80 0x7f40480d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404ec3a640 1 --2- 172.21.15.67:0/2028591365 >> v2:172.21.15.97:3300/0 conn(0x7f40480b41c0 0x7f40480b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404e439640 1 -- 172.21.15.67:0/2028591365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480d0e80 msgr2=0x7f40480d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404e439640 1 --2- 172.21.15.67:0/2028591365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480d0e80 0x7f40480d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404e439640 1 -- 172.21.15.67:0/2028591365 >> v2:172.21.15.97:3300/0 conn(0x7f40480b41c0 msgr2=0x7f40480b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404e439640 1 --2- 172.21.15.67:0/2028591365 >> v2:172.21.15.97:3300/0 conn(0x7f40480b41c0 0x7f40480b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404e439640 1 -- 172.21.15.67:0/2028591365 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40480d5020 con 0x7f4048161da0 2024-09-19T05:45:24.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404e439640 1 --2- 172.21.15.67:0/2028591365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4048161da0 0x7f40480d1af0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f404808e7c0 tx=0x7f403801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe76d18e5bc2643 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404d437640 1 -- 172.21.15.67:0/2028591365 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40380b1070 con 0x7f4048161da0 2024-09-19T05:45:24.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404d437640 1 -- 172.21.15.67:0/2028591365 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40380ac630 con 0x7f4048161da0 2024-09-19T05:45:24.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f404d437640 1 -- 172.21.15.67:0/2028591365 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40380a8050 con 0x7f4048161da0 2024-09-19T05:45:24.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 -- 172.21.15.67:0/2028591365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4048161da0 msgr2=0x7f40480d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 --2- 172.21.15.67:0/2028591365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4048161da0 0x7f40480d1af0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f404808e7c0 tx=0x7f403801c520 comp rx=0 tx=0).stop 2024-09-19T05:45:24.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 -- 172.21.15.67:0/2028591365 shutdown_connections 2024-09-19T05:45:24.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 --2- 172.21.15.67:0/2028591365 >> v2:172.21.15.97:3300/0 conn(0x7f40480b41c0 0x7f40480b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 --2- 172.21.15.67:0/2028591365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480d0e80 0x7f40480d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 --2- 172.21.15.67:0/2028591365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4048161da0 0x7f40480d1af0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 -- 172.21.15.67:0/2028591365 >> 172.21.15.67:0/2028591365 conn(0x7f404808bfc0 msgr2=0x7f40480d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 -- 172.21.15.67:0/2028591365 shutdown_connections 2024-09-19T05:45:24.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.587+0000 7f405069d640 1 -- 172.21.15.67:0/2028591365 wait complete. 2024-09-19T05:45:24.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f405069d640 1 Processor -- start 2024-09-19T05:45:24.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f405069d640 1 -- start start 2024-09-19T05:45:24.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f405069d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480b41c0 0x7f404814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f405069d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40480d0e80 0x7f404814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f405069d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4048161da0 0x7f4048157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f405069d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f40480cf150 con 0x7f40480d0e80 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f405069d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4048162180 con 0x7f4048161da0 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f405069d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f40480cf2d0 con 0x7f40480b41c0 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404dc38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40480d0e80 0x7f404814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404dc38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40480d0e80 0x7f404814f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45498/0 (socket says 172.21.15.67:45498) 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404dc38640 1 -- 172.21.15.67:0/804045242 learned_addr learned my addr 172.21.15.67:0/804045242 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404e439640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480b41c0 0x7f404814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404ec3a640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4048161da0 0x7f4048157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404dc38640 1 -- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480b41c0 msgr2=0x7f404814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404dc38640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480b41c0 0x7f404814ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404dc38640 1 -- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4048161da0 msgr2=0x7f4048157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404dc38640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4048161da0 0x7f4048157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404dc38640 1 -- 172.21.15.67:0/804045242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40480b32a0 con 0x7f40480d0e80 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404e439640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480b41c0 0x7f404814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404ec3a640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4048161da0 0x7f4048157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f404dc38640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40480d0e80 0x7f404814f2c0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f404400d800 tx=0x7f404400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f403effd640 1 -- 172.21.15.67:0/804045242 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404400b6c0 con 0x7f40480d0e80 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f403effd640 1 -- 172.21.15.67:0/804045242 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4044019070 con 0x7f40480d0e80 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f403effd640 1 -- 172.21.15.67:0/804045242 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404400ba60 con 0x7f40480d0e80 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f405069d640 1 -- 172.21.15.67:0/804045242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40480cc940 con 0x7f40480d0e80 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.591+0000 7f405069d640 1 -- 172.21.15.67:0/804045242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40480ccf00 con 0x7f40480d0e80 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.595+0000 7f405069d640 1 -- 172.21.15.67:0/804045242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40480b4650 con 0x7f40480d0e80 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.595+0000 7f403effd640 1 -- 172.21.15.67:0/804045242 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f404400bc00 con 0x7f40480d0e80 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.595+0000 7f403effd640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f402c0678c0 0x7f402c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.595+0000 7f403effd640 1 -- 172.21.15.67:0/804045242 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f4044086320 con 0x7f40480d0e80 2024-09-19T05:45:24.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.595+0000 7f404e439640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f402c0678c0 0x7f402c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.595+0000 7f404e439640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f402c0678c0 0x7f402c069d80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f40380ae000 tx=0x7f40380a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.599+0000 7f403effd640 1 -- 172.21.15.67:0/804045242 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4044056c90 con 0x7f40480d0e80 2024-09-19T05:45:24.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.795+0000 7f405069d640 1 -- 172.21.15.67:0/804045242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40480d0340 con 0x7f40480d0e80 2024-09-19T05:45:24.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.795+0000 7f403effd640 1 -- 172.21.15.67:0/804045242 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7f40440860e0 con 0x7f40480d0e80 2024-09-19T05:45:24.794 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:24.794 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:24.794 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:24.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 -- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f402c0678c0 msgr2=0x7f402c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f402c0678c0 0x7f402c069d80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f40380ae000 tx=0x7f40380a7000 comp rx=0 tx=0).stop 2024-09-19T05:45:24.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 -- 172.21.15.67:0/804045242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40480d0e80 msgr2=0x7f404814f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40480d0e80 0x7f404814f2c0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f404400d800 tx=0x7f404400dcc0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 -- 172.21.15.67:0/804045242 shutdown_connections 2024-09-19T05:45:24.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4048161da0 0x7f4048157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40480d0e80 0x7f404814f2c0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f402c0678c0 0x7f402c069d80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 --2- 172.21.15.67:0/804045242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40480b41c0 0x7f404814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 -- 172.21.15.67:0/804045242 >> 172.21.15.67:0/804045242 conn(0x7f404808bfc0 msgr2=0x7f40480d4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 -- 172.21.15.67:0/804045242 shutdown_connections 2024-09-19T05:45:24.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.799+0000 7f405069d640 1 -- 172.21.15.67:0/804045242 wait complete. 2024-09-19T05:45:24.811 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-19T05:45:24.812 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:45:24.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.923+0000 7f3fa5bc3640 1 Processor -- start 2024-09-19T05:45:24.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3fa5bc3640 1 -- start start 2024-09-19T05:45:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3fa5bc3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3fa006d3e0 0x7f3fa00b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3fa5bc3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fa00b5a10 0x7f3fa00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3fa5bc3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa00b5320 con 0x7f3fa015e340 2024-09-19T05:45:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3fa5bc3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa00aee20 con 0x7f3fa00b5a10 2024-09-19T05:45:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3fa5bc3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa00b4990 con 0x7f3fa006d3e0 2024-09-19T05:45:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3f9ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fa00b5a10 0x7f3fa00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3f9ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fa00b5a10 0x7f3fa00ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45500/0 (socket says 172.21.15.67:45500) 2024-09-19T05:45:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3f9ffff640 1 -- 172.21.15.67:0/2540281851 learned_addr learned my addr 172.21.15.67:0/2540281851 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3f97fff640 1 --2- 172.21.15.67:0/2540281851 >> v2:172.21.15.97:3300/0 conn(0x7f3fa006d3e0 0x7f3fa00b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3f9ffff640 1 -- 172.21.15.67:0/2540281851 >> v2:172.21.15.97:3300/0 conn(0x7f3fa006d3e0 msgr2=0x7f3fa00b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3f9ffff640 1 --2- 172.21.15.67:0/2540281851 >> v2:172.21.15.97:3300/0 conn(0x7f3fa006d3e0 0x7f3fa00b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3f9ffff640 1 -- 172.21.15.67:0/2540281851 >> v1:172.21.15.97:6789/0 conn(0x7f3fa015e340 legacy=0x7f3fa006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.927+0000 7f3f9ffff640 1 -- 172.21.15.67:0/2540281851 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa00b40f0 con 0x7f3fa00b5a10 2024-09-19T05:45:24.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9ffff640 1 --2- 172.21.15.67:0/2540281851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa00b5a10 0x7f3fa00ae8e0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00b54f0 tx=0x7f3f9801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b458fd39ab683ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9effd640 1 -- 172.21.15.67:0/2540281851 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f980a58b0 con 0x7f3fa00b5a10 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9effd640 1 -- 172.21.15.67:0/2540281851 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f980a5a50 con 0x7f3fa00b5a10 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9effd640 1 -- 172.21.15.67:0/2540281851 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f980a5e20 con 0x7f3fa00b5a10 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/2540281851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa00b5a10 msgr2=0x7f3fa00ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 --2- 172.21.15.67:0/2540281851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa00b5a10 0x7f3fa00ae8e0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00b54f0 tx=0x7f3f9801c9f0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/2540281851 shutdown_connections 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 --2- 172.21.15.67:0/2540281851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa00b5a10 0x7f3fa00ae8e0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 --2- 172.21.15.67:0/2540281851 >> v2:172.21.15.97:3300/0 conn(0x7f3fa006d3e0 0x7f3fa00b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/2540281851 >> 172.21.15.67:0/2540281851 conn(0x7f3fa0072800 msgr2=0x7f3fa0072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/2540281851 shutdown_connections 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/2540281851 wait complete. 2024-09-19T05:45:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 Processor -- start 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- start start 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fa006d3e0 0x7f3fa0148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fa00b5a10 0x7f3fa0161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa015e340 0x7f3fa01585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa015e8a0 con 0x7f3fa015e340 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa015e720 con 0x7f3fa00b5a10 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa006f570 con 0x7f3fa006d3e0 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa015e340 0x7f3fa01585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa015e340 0x7f3fa01585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45506/0 (socket says 172.21.15.67:45506) 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9ffff640 1 -- 172.21.15.67:0/3153856988 learned_addr learned my addr 172.21.15.67:0/3153856988 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f97fff640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fa00b5a10 0x7f3fa0161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9f7fe640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fa006d3e0 0x7f3fa0148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9ffff640 1 -- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fa006d3e0 msgr2=0x7f3fa0148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9ffff640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fa006d3e0 0x7f3fa0148b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9ffff640 1 -- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fa00b5a10 msgr2=0x7f3fa0161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9ffff640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fa00b5a10 0x7f3fa0161240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9ffff640 1 -- 172.21.15.67:0/3153856988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa0160610 con 0x7f3fa015e340 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9f7fe640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fa006d3e0 0x7f3fa0148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9ffff640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa015e340 0x7f3fa01585a0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f3f9801a620 tx=0x7f3f98019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9cff9640 1 -- 172.21.15.67:0/3153856988 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f980a58b0 con 0x7f3fa015e340 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9cff9640 1 -- 172.21.15.67:0/3153856988 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f980be070 con 0x7f3fa015e340 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/3153856988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa014f020 con 0x7f3fa015e340 2024-09-19T05:45:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3f9cff9640 1 -- 172.21.15.67:0/3153856988 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98009510 con 0x7f3fa015e340 2024-09-19T05:45:24.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.931+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/3153856988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa014f300 con 0x7f3fa015e340 2024-09-19T05:45:24.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.935+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/3153856988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa006f8a0 con 0x7f3fa015e340 2024-09-19T05:45:24.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.935+0000 7f3f9cff9640 1 -- 172.21.15.67:0/3153856988 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f980b8470 con 0x7f3fa015e340 2024-09-19T05:45:24.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.935+0000 7f3f9cff9640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f800678f0 0x7f3f80069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:24.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.935+0000 7f3f9cff9640 1 -- 172.21.15.67:0/3153856988 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f3f98121340 con 0x7f3fa015e340 2024-09-19T05:45:24.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.935+0000 7f3f9f7fe640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f800678f0 0x7f3f80069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:24.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.935+0000 7f3f9f7fe640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f800678f0 0x7f3f80069db0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0153c50 tx=0x7f3f90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:24.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:24.939+0000 7f3f9cff9640 1 -- 172.21.15.67:0/3153856988 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3f980165e0 con 0x7f3fa015e340 2024-09-19T05:45:25.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/3153856988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3fa015c9e0 con 0x7f3fa015e340 2024-09-19T05:45:25.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3f9cff9640 1 -- 172.21.15.67:0/3153856988 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f3f980f1d80 con 0x7f3fa015e340 2024-09-19T05:45:25.152 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:25.152 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":754,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":157,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078291705,"bytes_used":2672316416,"bytes_avail":770421796864,"bytes_total":773094113280,"write_bytes_sec":42050805,"read_op_per_sec":0,"write_op_per_sec":44},"fsmap":{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":9066}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-19T05:45:23.363784+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:45:25.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f800678f0 msgr2=0x7f3f80069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f800678f0 0x7f3f80069db0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0153c50 tx=0x7f3f90009040 comp rx=0 tx=0).stop 2024-09-19T05:45:25.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/3153856988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa015e340 msgr2=0x7f3fa01585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa015e340 0x7f3fa01585a0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f3f9801a620 tx=0x7f3f98019790 comp rx=0 tx=0).stop 2024-09-19T05:45:25.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/3153856988 shutdown_connections 2024-09-19T05:45:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fa015e340 0x7f3fa01585a0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fa00b5a10 0x7f3fa0161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f800678f0 0x7f3f80069db0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 --2- 172.21.15.67:0/3153856988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fa006d3e0 0x7f3fa0148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/3153856988 >> 172.21.15.67:0/3153856988 conn(0x7f3fa0072800 msgr2=0x7f3fa0072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/3153856988 shutdown_connections 2024-09-19T05:45:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.155+0000 7f3fa5bc3640 1 -- 172.21.15.67:0/3153856988 wait complete. 2024-09-19T05:45:25.169 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused paths [/scrub_control_test_path]'} 2024-09-19T05:45:25.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:25.170 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub resume 2024-09-19T05:45:25.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa1847ee640 1 Processor -- start 2024-09-19T05:45:25.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa1847ee640 1 -- start start 2024-09-19T05:45:25.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa1847ee640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa17c159c60 0x7fa17c0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa1847ee640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa17c06ffd0 0x7fa17c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa1847ee640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa17c0b3150 0x7fa17c0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa1847ee640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa17c0af710 con 0x7fa17c06ffd0 2024-09-19T05:45:25.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa1847ee640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa17c15d460 con 0x7fa17c0b3150 2024-09-19T05:45:25.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa1847ee640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c15a040 con 0x7fa17c159c60 2024-09-19T05:45:25.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa181d89640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa17c06ffd0 0x7fa17c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa181d89640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa17c06ffd0 0x7fa17c0aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45512/0 (socket says 172.21.15.67:45512) 2024-09-19T05:45:25.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa181d89640 1 -- 172.21.15.67:0/1176380170 learned_addr learned my addr 172.21.15.67:0/1176380170 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa18258a640 1 --2- 172.21.15.67:0/1176380170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa17c159c60 0x7fa17c0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa182d8b640 1 --2- 172.21.15.67:0/1176380170 >> v2:172.21.15.97:3300/0 conn(0x7fa17c0b3150 0x7fa17c0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa181d89640 1 -- 172.21.15.67:0/1176380170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa17c159c60 msgr2=0x7fa17c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa181d89640 1 --2- 172.21.15.67:0/1176380170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa17c159c60 0x7fa17c0ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa181d89640 1 -- 172.21.15.67:0/1176380170 >> v2:172.21.15.97:3300/0 conn(0x7fa17c0b3150 msgr2=0x7fa17c0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa181d89640 1 --2- 172.21.15.67:0/1176380170 >> v2:172.21.15.97:3300/0 conn(0x7fa17c0b3150 0x7fa17c0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa181d89640 1 -- 172.21.15.67:0/1176380170 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c15c850 con 0x7fa17c06ffd0 2024-09-19T05:45:25.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.291+0000 7fa182d8b640 1 --2- 172.21.15.67:0/1176380170 >> v2:172.21.15.97:3300/0 conn(0x7fa17c0b3150 0x7fa17c0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:25.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa181d89640 1 --2- 172.21.15.67:0/1176380170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c06ffd0 0x7fa17c0aec90 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0b2e70 tx=0x7fa17801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e5bcd9440cf005 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa181588640 1 -- 172.21.15.67:0/1176380170 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1780a5840 con 0x7fa17c06ffd0 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa181588640 1 -- 172.21.15.67:0/1176380170 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1780a59e0 con 0x7fa17c06ffd0 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa181588640 1 -- 172.21.15.67:0/1176380170 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1780a5db0 con 0x7fa17c06ffd0 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 -- 172.21.15.67:0/1176380170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c06ffd0 msgr2=0x7fa17c0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 --2- 172.21.15.67:0/1176380170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c06ffd0 0x7fa17c0aec90 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0b2e70 tx=0x7fa17801c9c0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 -- 172.21.15.67:0/1176380170 shutdown_connections 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 --2- 172.21.15.67:0/1176380170 >> v2:172.21.15.97:3300/0 conn(0x7fa17c0b3150 0x7fa17c0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 --2- 172.21.15.67:0/1176380170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c06ffd0 0x7fa17c0aec90 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 --2- 172.21.15.67:0/1176380170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa17c159c60 0x7fa17c0ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 -- 172.21.15.67:0/1176380170 >> 172.21.15.67:0/1176380170 conn(0x7fa17c0b1e50 msgr2=0x7fa17c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 -- 172.21.15.67:0/1176380170 shutdown_connections 2024-09-19T05:45:25.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 -- 172.21.15.67:0/1176380170 wait complete. 2024-09-19T05:45:25.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 Processor -- start 2024-09-19T05:45:25.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 -- start start 2024-09-19T05:45:25.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa17c06ffd0 0x7fa17c14b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c0b3150 0x7fa17c150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa17c159c60 0x7fa17c165f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c0ad7f0 con 0x7fa17c0b3150 2024-09-19T05:45:25.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c0ad670 con 0x7fa17c06ffd0 2024-09-19T05:45:25.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.295+0000 7fa1847ee640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c1605b0 con 0x7fa17c159c60 2024-09-19T05:45:25.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa181d89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c0b3150 0x7fa17c150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa181d89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c0b3150 0x7fa17c150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45528/0 (socket says 172.21.15.67:45528) 2024-09-19T05:45:25.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa181d89640 1 -- 172.21.15.67:0/3861655469 learned_addr learned my addr 172.21.15.67:0/3861655469 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa18258a640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa17c06ffd0 0x7fa17c14b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa182d8b640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa17c159c60 0x7fa17c165f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa181d89640 1 -- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa17c159c60 msgr2=0x7fa17c165f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa181d89640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa17c159c60 0x7fa17c165f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa181d89640 1 -- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa17c06ffd0 msgr2=0x7fa17c14b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa181d89640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa17c06ffd0 0x7fa17c14b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa181d89640 1 -- 172.21.15.67:0/3861655469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c14f960 con 0x7fa17c0b3150 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa18258a640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa17c06ffd0 0x7fa17c14b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa181d89640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c0b3150 0x7fa17c150f50 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fa17801d260 tx=0x7fa178019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa172ffd640 1 -- 172.21.15.67:0/3861655469 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1780bc020 con 0x7fa17c0b3150 2024-09-19T05:45:25.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa172ffd640 1 -- 172.21.15.67:0/3861655469 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1780b88a0 con 0x7fa17c0b3150 2024-09-19T05:45:25.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa1847ee640 1 -- 172.21.15.67:0/3861655469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17c14fc40 con 0x7fa17c0b3150 2024-09-19T05:45:25.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa172ffd640 1 -- 172.21.15.67:0/3861655469 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1780b8c90 con 0x7fa17c0b3150 2024-09-19T05:45:25.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa1847ee640 1 -- 172.21.15.67:0/3861655469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17c150200 con 0x7fa17c0b3150 2024-09-19T05:45:25.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa172ffd640 1 -- 172.21.15.67:0/3861655469 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1780bf020 con 0x7fa17c0b3150 2024-09-19T05:45:25.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa172ffd640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1680678c0 0x7fa168069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa172ffd640 1 -- 172.21.15.67:0/3861655469 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fa178121060 con 0x7fa17c0b3150 2024-09-19T05:45:25.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa18258a640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1680678c0 0x7fa168069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa1878aa000 1 Processor -- start 2024-09-19T05:45:25.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.299+0000 7fa1878aa000 1 -- start start 2024-09-19T05:45:25.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa18258a640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1680678c0 0x7fa168069d80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa17c14f3d0 tx=0x7fa174008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761271150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 0x557761224870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761224db0 0x557761225190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55776110e960 con 0x557761270d70 2024-09-19T05:45:25.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557761052900 con 0x557761271690 2024-09-19T05:45:25.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x557761075d40 con 0x557761224db0 2024-09-19T05:45:25.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa18258a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761271150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa18258a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761271150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45536/0 (socket says 172.21.15.67:45536) 2024-09-19T05:45:25.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa18258a640 1 -- 172.21.15.67:0/3496189955 learned_addr learned my addr 172.21.15.67:0/3496189955 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa181d89640 1 --2- 172.21.15.67:0/3496189955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 0x557761224870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa18258a640 1 -- 172.21.15.67:0/3496189955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761224db0 msgr2=0x557761225190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa18258a640 1 --2- 172.21.15.67:0/3496189955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761224db0 0x557761225190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa18258a640 1 -- 172.21.15.67:0/3496189955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 msgr2=0x557761224870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa18258a640 1 --2- 172.21.15.67:0/3496189955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 0x557761224870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa18258a640 1 -- 172.21.15.67:0/3496189955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55776101c580 con 0x557761270d70 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa18258a640 1 --2- 172.21.15.67:0/3496189955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761271150 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fa17400b570 tx=0x7fa174012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c33ecd7f935bf7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa163fff640 1 -- 172.21.15.67:0/3496189955 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17401b050 con 0x557761270d70 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa163fff640 1 -- 172.21.15.67:0/3496189955 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa174025070 con 0x557761270d70 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa163fff640 1 -- 172.21.15.67:0/3496189955 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174014e00 con 0x557761270d70 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- 172.21.15.67:0/3496189955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 msgr2=0x557761271150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 --2- 172.21.15.67:0/3496189955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761271150 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fa17400b570 tx=0x7fa174012000 comp rx=0 tx=0).stop 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- 172.21.15.67:0/3496189955 shutdown_connections 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 --2- 172.21.15.67:0/3496189955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761224db0 0x557761225190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 --2- 172.21.15.67:0/3496189955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 0x557761224870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 --2- 172.21.15.67:0/3496189955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761271150 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- 172.21.15.67:0/3496189955 >> 172.21.15.67:0/3496189955 conn(0x557761252040 msgr2=0x557761254430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- 172.21.15.67:0/3496189955 shutdown_connections 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- 172.21.15.67:0/3496189955 wait complete. 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- start start 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 Processor -- start 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761224db0 0x557761277ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761278220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 0x557761278760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557761071d00 con 0x557761270d70 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557761030aa0 con 0x557761271690 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55776100f340 con 0x557761224db0 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 10 client.0 _ll_register_callbacks cb 0x557761212760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa181d89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761278220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa181d89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761278220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45552/0 (socket says 172.21.15.67:45552) 2024-09-19T05:45:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa181d89640 1 -- 172.21.15.67:0/2725694546 learned_addr learned my addr 172.21.15.67:0/2725694546 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa181d89640 1 -- 172.21.15.67:0/2725694546 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761224db0 msgr2=0x557761277ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa181d89640 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761224db0 0x557761277ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa181d89640 1 -- 172.21.15.67:0/2725694546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 msgr2=0x557761278760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa181d89640 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 0x557761278760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa181d89640 1 -- 172.21.15.67:0/2725694546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557761018dc0 con 0x557761270d70 2024-09-19T05:45:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa181d89640 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761278220 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fa178000f90 tx=0x7fa1780f0c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be28c92256b99bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1617fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1617fa640 1 -- 172.21.15.67:0/2725694546 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1780f12f0 con 0x557761270d70 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1617fa640 1 -- 172.21.15.67:0/2725694546 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fa1780f1550 con 0x557761270d70 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1878aa000 1 -- 172.21.15.67:0/2725694546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa174025070 con 0x557761270d70 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.303+0000 7fa1617fa640 1 -- 172.21.15.67:0/2725694546 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fa1780f56a0 con 0x557761270d70 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 10 client.9378 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 -- 172.21.15.67:0/2725694546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x5577610157f0 con 0x557761270d70 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1617fa640 1 -- 172.21.15.67:0/2725694546 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa174025070 con 0x557761270d70 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1617fa640 1 -- 172.21.15.67:0/2725694546 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fa17810e080 con 0x557761270d70 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 10 client.9378 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 10 client.9378 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 20 client.9378 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5577612800b0 0x5577612824a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 4 client.9378 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 -- 172.21.15.67:0/2725694546 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55776100fe10 con 0x5577612800b0 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa18258a640 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5577612800b0 0x5577612824a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1617fa640 10 client.9378 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa18258a640 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5577612800b0 0x5577612824a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c1e51bf649d7b4 server_cookie=96a915ac12f9ef8 in_seq=0 out_seq=0 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1617fa640 1 -- 172.21.15.67:0/2725694546 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55776100fe10 con 0x5577612800b0 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1617fa640 10 client.9378 handle_command_reply: tid=0 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 client.9378 shutdown 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 -- 172.21.15.67:0/2725694546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 msgr2=0x557761278220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761278220 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fa178000f90 tx=0x7fa1780f0c50 comp rx=0 tx=0).stop 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 -- 172.21.15.67:0/2725694546 shutdown_connections 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x5577612800b0 0x5577612824a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 0x557761278760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x557761278220 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1617fa640 0 client.9378 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 --2- 172.21.15.67:0/2725694546 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761224db0 0x557761277ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 -- 172.21.15.67:0/2725694546 >> 172.21.15.67:0/2725694546 conn(0x557761252040 msgr2=0x557761223f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 -- 172.21.15.67:0/2725694546 shutdown_connections 2024-09-19T05:45:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 1 -- 172.21.15.67:0/2725694546 wait complete. 2024-09-19T05:45:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.307+0000 7fa1878aa000 20 client.9378 trim_cache size 0 max 16384 2024-09-19T05:45:25.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 Processor -- start 2024-09-19T05:45:25.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- start start 2024-09-19T05:45:25.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761224db0 0x55776122cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761270d70 0x55776122d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 0x55776127ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c203b30 con 0x557761224db0 2024-09-19T05:45:25.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c0b1ab0 con 0x557761271690 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c0b0e10 con 0x557761270d70 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa18258a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761224db0 0x55776122cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa18258a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761224db0 0x55776122cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45568/0 (socket says 172.21.15.67:45568) 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa18258a640 1 -- 172.21.15.67:0/122621984 learned_addr learned my addr 172.21.15.67:0/122621984 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa18258a640 1 -- 172.21.15.67:0/122621984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761270d70 msgr2=0x55776122d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa18258a640 1 --2- 172.21.15.67:0/122621984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761270d70 0x55776122d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa18258a640 1 -- 172.21.15.67:0/122621984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 msgr2=0x55776127ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa18258a640 1 --2- 172.21.15.67:0/122621984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 0x55776127ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa18258a640 1 -- 172.21.15.67:0/122621984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557761033470 con 0x557761224db0 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa18258a640 1 --2- 172.21.15.67:0/122621984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761224db0 0x55776122cc00 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fa174022040 tx=0x7fa174014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e88f3c1e88dd69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1637fe640 1 -- 172.21.15.67:0/122621984 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174039070 con 0x557761224db0 2024-09-19T05:45:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1637fe640 1 -- 172.21.15.67:0/122621984 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa174025050 con 0x557761224db0 2024-09-19T05:45:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1637fe640 1 -- 172.21.15.67:0/122621984 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17401b040 con 0x557761224db0 2024-09-19T05:45:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- 172.21.15.67:0/122621984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761224db0 msgr2=0x55776122cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 --2- 172.21.15.67:0/122621984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761224db0 0x55776122cc00 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fa174022040 tx=0x7fa174014000 comp rx=0 tx=0).stop 2024-09-19T05:45:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- 172.21.15.67:0/122621984 shutdown_connections 2024-09-19T05:45:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 --2- 172.21.15.67:0/122621984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761271690 0x55776127ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 --2- 172.21.15.67:0/122621984 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761270d70 0x55776122d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 --2- 172.21.15.67:0/122621984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761224db0 0x55776122cc00 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- 172.21.15.67:0/122621984 >> 172.21.15.67:0/122621984 conn(0x557761252040 msgr2=0x557761277aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- 172.21.15.67:0/122621984 shutdown_connections 2024-09-19T05:45:25.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- 172.21.15.67:0/122621984 wait complete. 2024-09-19T05:45:25.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- start start 2024-09-19T05:45:25.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 Processor -- start 2024-09-19T05:45:25.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761224db0 0x55776127d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x5577612a0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761271690 0x5577612a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557761075050 con 0x557761270d70 2024-09-19T05:45:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5577610343f0 con 0x557761224db0 2024-09-19T05:45:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5577610b5780 con 0x557761271690 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.327+0000 7fa1878aa000 10 client.0 _ll_register_callbacks cb 0x7fa178009290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa181d89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x5577612a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa181d89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x5577612a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45580/0 (socket says 172.21.15.67:45580) 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa181d89640 1 -- 172.21.15.67:0/4092341531 learned_addr learned my addr 172.21.15.67:0/4092341531 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa181d89640 1 -- 172.21.15.67:0/4092341531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761271690 msgr2=0x5577612a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa181d89640 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761271690 0x5577612a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa181d89640 1 -- 172.21.15.67:0/4092341531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761224db0 msgr2=0x55776127d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa181d89640 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761224db0 0x55776127d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa181d89640 1 -- 172.21.15.67:0/4092341531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557761009640 con 0x557761270d70 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa181d89640 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x5577612a0790 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fa178098560 tx=0x7fa17801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b20a01d8975563 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1617fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1617fa640 1 -- 172.21.15.67:0/4092341531 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1780f12f0 con 0x557761270d70 2024-09-19T05:45:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1617fa640 1 -- 172.21.15.67:0/4092341531 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fa1780f0950 con 0x557761270d70 2024-09-19T05:45:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 -- 172.21.15.67:0/4092341531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa174025050 con 0x557761270d70 2024-09-19T05:45:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1617fa640 1 -- 172.21.15.67:0/4092341531 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fa1780f10c0 con 0x557761270d70 2024-09-19T05:45:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 10 client.9384 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 -- 172.21.15.67:0/4092341531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55776100d3b0 con 0x557761270d70 2024-09-19T05:45:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1617fa640 1 -- 172.21.15.67:0/4092341531 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa174025050 con 0x557761270d70 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1617fa640 1 -- 172.21.15.67:0/4092341531 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fa1780f5150 con 0x557761270d70 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 10 client.9384 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 10 client.9384 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 20 client.9384 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55776127de90 0x5577612a1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 4 client.9384 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 -- 172.21.15.67:0/4092341531 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x557761083470 con 0x55776127de90 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa18258a640 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55776127de90 0x5577612a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa18258a640 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55776127de90 0x5577612a1210 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef2024c69249041 server_cookie=f97522b28ca1311d in_seq=0 out_seq=0 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1617fa640 10 client.9384 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:25.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1617fa640 1 -- 172.21.15.67:0/4092341531 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557761083470 con 0x55776127de90 2024-09-19T05:45:25.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1617fa640 10 client.9384 handle_command_reply: tid=0 2024-09-19T05:45:25.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 client.9384 shutdown 2024-09-19T05:45:25.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 -- 172.21.15.67:0/4092341531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 msgr2=0x5577612a0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x5577612a0790 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fa178098560 tx=0x7fa17801c9c0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 -- 172.21.15.67:0/4092341531 shutdown_connections 2024-09-19T05:45:25.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55776127de90 0x5577612a1210 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557761271690 0x5577612a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557761270d70 0x5577612a0790 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1617fa640 0 client.9384 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:25.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 --2- 172.21.15.67:0/4092341531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557761224db0 0x55776127d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 -- 172.21.15.67:0/4092341531 >> 172.21.15.67:0/4092341531 conn(0x557761252040 msgr2=0x55776122c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 -- 172.21.15.67:0/4092341531 shutdown_connections 2024-09-19T05:45:25.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 1 -- 172.21.15.67:0/4092341531 wait complete. 2024-09-19T05:45:25.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1878aa000 20 client.9384 trim_cache size 0 max 16384 2024-09-19T05:45:25.337 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:45:25.338 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:45:25.338 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:45:25.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 -- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1680678c0 msgr2=0x7fa168069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1680678c0 0x7fa168069d80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa17c14f3d0 tx=0x7fa174008040 comp rx=0 tx=0).stop 2024-09-19T05:45:25.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 -- 172.21.15.67:0/3861655469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c0b3150 msgr2=0x7fa17c150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c0b3150 0x7fa17c150f50 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fa17801d260 tx=0x7fa178019760 comp rx=0 tx=0).stop 2024-09-19T05:45:25.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 -- 172.21.15.67:0/3861655469 shutdown_connections 2024-09-19T05:45:25.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1680678c0 0x7fa168069d80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa17c159c60 0x7fa17c165f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa17c0b3150 0x7fa17c150f50 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 --2- 172.21.15.67:0/3861655469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa17c06ffd0 0x7fa17c14b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 -- 172.21.15.67:0/3861655469 >> 172.21.15.67:0/3861655469 conn(0x7fa17c0b1e50 msgr2=0x7fa17c06e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 -- 172.21.15.67:0/3861655469 shutdown_connections 2024-09-19T05:45:25.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.331+0000 7fa1847ee640 1 -- 172.21.15.67:0/3861655469 wait complete. 2024-09-19T05:45:25.344 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-19T05:45:25.344 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-19T05:45:25.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524bd94640 1 Processor -- start 2024-09-19T05:45:25.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524bd94640 1 -- start start 2024-09-19T05:45:25.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524bd94640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f524406ffd0 0x7f52440aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524bd94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52440b3150 0x7f52440af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524bd94640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52440ad840 con 0x7f5244159c60 2024-09-19T05:45:25.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524bd94640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f52440af710 con 0x7f524406ffd0 2024-09-19T05:45:25.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524bd94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f524415d460 con 0x7f52440b3150 2024-09-19T05:45:25.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524a331640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52440b3150 0x7f52440af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524932f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f524406ffd0 0x7f52440aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f5249b30640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5244159c60 0x7f52440ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:39662/0 (socket says 172.21.15.67:39662) 2024-09-19T05:45:25.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f5249b30640 1 -- 172.21.15.67:0/26124458 learned_addr learned my addr 172.21.15.67:0/26124458 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:25.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524932f640 1 -- 172.21.15.67:0/26124458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52440b3150 msgr2=0x7f52440af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524932f640 1 --2- 172.21.15.67:0/26124458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52440b3150 0x7f52440af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524932f640 1 -- 172.21.15.67:0/26124458 >> v1:172.21.15.97:6789/0 conn(0x7f5244159c60 legacy=0x7f52440ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524932f640 1 -- 172.21.15.67:0/26124458 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524415a040 con 0x7f524406ffd0 2024-09-19T05:45:25.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.455+0000 7f524a331640 1 --2- 172.21.15.67:0/26124458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52440b3150 0x7f52440af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:45:25.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524932f640 1 --2- 172.21.15.67:0/26124458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f524406ffd0 0x7f52440aec90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f52340097c0 tx=0x7f523401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2161d03333d0ed48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f5248b2e640 1 -- 172.21.15.67:0/26124458 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52340a7070 con 0x7f524406ffd0 2024-09-19T05:45:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f5248b2e640 1 -- 172.21.15.67:0/26124458 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52340b0070 con 0x7f524406ffd0 2024-09-19T05:45:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f5248b2e640 1 -- 172.21.15.67:0/26124458 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52340ab890 con 0x7f524406ffd0 2024-09-19T05:45:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524bd94640 1 -- 172.21.15.67:0/26124458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f524406ffd0 msgr2=0x7f52440aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524bd94640 1 --2- 172.21.15.67:0/26124458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f524406ffd0 0x7f52440aec90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f52340097c0 tx=0x7f523401c470 comp rx=0 tx=0).stop 2024-09-19T05:45:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524bd94640 1 -- 172.21.15.67:0/26124458 shutdown_connections 2024-09-19T05:45:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524bd94640 1 --2- 172.21.15.67:0/26124458 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52440b3150 0x7f52440af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524bd94640 1 --2- 172.21.15.67:0/26124458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f524406ffd0 0x7f52440aec90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524bd94640 1 -- 172.21.15.67:0/26124458 >> 172.21.15.67:0/26124458 conn(0x7f52440b1e50 msgr2=0x7f52440b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524bd94640 1 -- 172.21.15.67:0/26124458 shutdown_connections 2024-09-19T05:45:25.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524bd94640 1 -- 172.21.15.67:0/26124458 wait complete. 2024-09-19T05:45:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524bd94640 1 Processor -- start 2024-09-19T05:45:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.459+0000 7f524bd94640 1 -- start start 2024-09-19T05:45:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524bd94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f524406ffd0 0x7f524414de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524bd94640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52440b3150 0x7f5244152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524bd94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5244159c60 0x7f52441515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524bd94640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f52441605b0 con 0x7f52440b3150 2024-09-19T05:45:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524bd94640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f524415d0f0 con 0x7f524406ffd0 2024-09-19T05:45:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524bd94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5244160730 con 0x7f5244159c60 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524932f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52440b3150 0x7f5244152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524932f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52440b3150 0x7f5244152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45594/0 (socket says 172.21.15.67:45594) 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524932f640 1 -- 172.21.15.67:0/3610760593 learned_addr learned my addr 172.21.15.67:0/3610760593 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f5249b30640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f524406ffd0 0x7f524414de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524a331640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5244159c60 0x7f52441515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524932f640 1 -- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5244159c60 msgr2=0x7f52441515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524932f640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5244159c60 0x7f52441515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524932f640 1 -- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f524406ffd0 msgr2=0x7f524414de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524932f640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f524406ffd0 0x7f524414de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524932f640 1 -- 172.21.15.67:0/3610760593 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5244152c50 con 0x7f52440b3150 2024-09-19T05:45:25.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524932f640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52440b3150 0x7f5244152190 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f52340097c0 tx=0x7f523401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f523a7fc640 1 -- 172.21.15.67:0/3610760593 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52340bf610 con 0x7f52440b3150 2024-09-19T05:45:25.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f523a7fc640 1 -- 172.21.15.67:0/3610760593 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52340bf7b0 con 0x7f52440b3150 2024-09-19T05:45:25.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f523a7fc640 1 -- 172.21.15.67:0/3610760593 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52340bfba0 con 0x7f52440b3150 2024-09-19T05:45:25.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524bd94640 1 -- 172.21.15.67:0/3610760593 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52441526d0 con 0x7f52440b3150 2024-09-19T05:45:25.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f524bd94640 1 -- 172.21.15.67:0/3610760593 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5244150ac0 con 0x7f52440b3150 2024-09-19T05:45:25.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f523a7fc640 1 -- 172.21.15.67:0/3610760593 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f52340bd020 con 0x7f52440b3150 2024-09-19T05:45:25.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f523a7fc640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52280678c0 0x7f5228069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f523a7fc640 1 -- 172.21.15.67:0/3610760593 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f52341201b0 con 0x7f52440b3150 2024-09-19T05:45:25.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.463+0000 7f5249b30640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52280678c0 0x7f5228069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 Processor -- start 2024-09-19T05:45:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- start start 2024-09-19T05:45:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f5249b30640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52280678c0 0x7f5228069d80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f524415bf50 tx=0x7f5240009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c71d70 0x55f4c0c72150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c72690 0x55f4c0c25870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c26190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f4c0b0f960 con 0x55f4c0c25db0 2024-09-19T05:45:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f4c0a53900 con 0x55f4c0c72690 2024-09-19T05:45:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f4c0a76d40 con 0x55f4c0c71d70 2024-09-19T05:45:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c26190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c26190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45602/0 (socket says 172.21.15.67:45602) 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 -- 172.21.15.67:0/909208946 learned_addr learned my addr 172.21.15.67:0/909208946 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 -- 172.21.15.67:0/909208946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c71d70 msgr2=0x55f4c0c72150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 --2- 172.21.15.67:0/909208946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c71d70 0x55f4c0c72150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 -- 172.21.15.67:0/909208946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c72690 msgr2=0x55f4c0c25870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 --2- 172.21.15.67:0/909208946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c72690 0x55f4c0c25870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 -- 172.21.15.67:0/909208946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4c0a1d580 con 0x55f4c0c25db0 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 --2- 172.21.15.67:0/909208946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c26190 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f523c007680 tx=0x7f523c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61389bb2120ac36c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f52277fe640 1 -- 172.21.15.67:0/909208946 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c01a020 con 0x55f4c0c25db0 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f52277fe640 1 -- 172.21.15.67:0/909208946 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523c015850 con 0x55f4c0c25db0 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f52277fe640 1 -- 172.21.15.67:0/909208946 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c015c00 con 0x55f4c0c25db0 2024-09-19T05:45:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- 172.21.15.67:0/909208946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 msgr2=0x55f4c0c26190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 --2- 172.21.15.67:0/909208946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c26190 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f523c007680 tx=0x7f523c009750 comp rx=0 tx=0).stop 2024-09-19T05:45:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- 172.21.15.67:0/909208946 shutdown_connections 2024-09-19T05:45:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 --2- 172.21.15.67:0/909208946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c26190 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 --2- 172.21.15.67:0/909208946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c72690 0x55f4c0c25870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 --2- 172.21.15.67:0/909208946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c71d70 0x55f4c0c72150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- 172.21.15.67:0/909208946 >> 172.21.15.67:0/909208946 conn(0x55f4c0c53040 msgr2=0x55f4c0c55430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- 172.21.15.67:0/909208946 shutdown_connections 2024-09-19T05:45:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- 172.21.15.67:0/909208946 wait complete. 2024-09-19T05:45:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- start start 2024-09-19T05:45:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 Processor -- start 2024-09-19T05:45:25.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c25db0 0x55f4c0c78ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0c79220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c72690 0x55f4c0c79760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f4c0a72d00 con 0x55f4c0c72690 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f4c0a31aa0 con 0x55f4c0c71d70 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f4c0a10340 con 0x55f4c0c25db0 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524ee50000 10 client.0 _ll_register_callbacks cb 0x55f4c0c13760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c72690 0x55f4c0c79760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c72690 0x55f4c0c79760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45606/0 (socket says 172.21.15.67:45606) 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 -- 172.21.15.67:0/2257659519 learned_addr learned my addr 172.21.15.67:0/2257659519 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524932f640 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0c79220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f5249b30640 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c25db0 0x55f4c0c78ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 -- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c25db0 msgr2=0x55f4c0c78ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c25db0 0x55f4c0c78ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 -- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 msgr2=0x55f4c0c79220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0c79220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524a331640 1 -- 172.21.15.67:0/2257659519 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4c0a19dc0 con 0x55f4c0c72690 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.467+0000 7f524932f640 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0c79220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524a331640 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c72690 0x55f4c0c79760 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f523c000f90 tx=0x7f523c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2255f0e6671dfb00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5224ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5224ff9640 1 -- 172.21.15.67:0/2257659519 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c0039a0 con 0x55f4c0c72690 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 -- 172.21.15.67:0/2257659519 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f523c015850 con 0x55f4c0c72690 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5224ff9640 1 -- 172.21.15.67:0/2257659519 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f523c02ac90 con 0x55f4c0c72690 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5224ff9640 1 -- 172.21.15.67:0/2257659519 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f523c02ae90 con 0x55f4c0c72690 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 10 client.9393 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:25.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 -- 172.21.15.67:0/2257659519 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55f4c0a167f0 con 0x55f4c0c72690 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5224ff9640 1 -- 172.21.15.67:0/2257659519 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523c015850 con 0x55f4c0c72690 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5224ff9640 1 -- 172.21.15.67:0/2257659519 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7f523c003b40 con 0x55f4c0c72690 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 10 client.9393 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 10 client.9393 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 20 client.9393 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f4c0c810b0 0x55f4c0c834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 4 client.9393 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 -- 172.21.15.67:0/2257659519 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4c0a10e10 con 0x55f4c0c810b0 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5249b30640 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f4c0c810b0 0x55f4c0c834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5249b30640 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f4c0c810b0 0x55f4c0c834a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c3e1816b0477cbe server_cookie=35a3de55dc25012e in_seq=0 out_seq=0 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5224ff9640 10 client.9393 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5224ff9640 1 -- 172.21.15.67:0/2257659519 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4c0a10e10 con 0x55f4c0c810b0 2024-09-19T05:45:25.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5224ff9640 10 client.9393 handle_command_reply: tid=0 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 client.9393 shutdown 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 -- 172.21.15.67:0/2257659519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c72690 msgr2=0x55f4c0c79760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c72690 0x55f4c0c79760 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f523c000f90 tx=0x7f523c004ac0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 -- 172.21.15.67:0/2257659519 shutdown_connections 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f4c0c810b0 0x55f4c0c834a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c72690 0x55f4c0c79760 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0c79220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f5224ff9640 0 client.9393 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 --2- 172.21.15.67:0/2257659519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c25db0 0x55f4c0c78ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 -- 172.21.15.67:0/2257659519 >> 172.21.15.67:0/2257659519 conn(0x55f4c0c53040 msgr2=0x55f4c0c24f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 -- 172.21.15.67:0/2257659519 shutdown_connections 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 1 -- 172.21.15.67:0/2257659519 wait complete. 2024-09-19T05:45:25.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.471+0000 7f524ee50000 20 client.9393 trim_cache size 0 max 16384 2024-09-19T05:45:25.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 Processor -- start 2024-09-19T05:45:25.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 -- start start 2024-09-19T05:45:25.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c86d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0c2dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c72690 0x55f4c0c2e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5244203e40 con 0x55f4c0c25db0 2024-09-19T05:45:25.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5244202e90 con 0x55f4c0c71d70 2024-09-19T05:45:25.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5244072db0 con 0x55f4c0c72690 2024-09-19T05:45:25.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5249b30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c86d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5249b30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c86d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45608/0 (socket says 172.21.15.67:45608) 2024-09-19T05:45:25.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5249b30640 1 -- 172.21.15.67:0/3494480736 learned_addr learned my addr 172.21.15.67:0/3494480736 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5249b30640 1 -- 172.21.15.67:0/3494480736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c72690 msgr2=0x55f4c0c2e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5249b30640 1 --2- 172.21.15.67:0/3494480736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c72690 0x55f4c0c2e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5249b30640 1 -- 172.21.15.67:0/3494480736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 msgr2=0x55f4c0c2dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5249b30640 1 --2- 172.21.15.67:0/3494480736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0c2dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5249b30640 1 -- 172.21.15.67:0/3494480736 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4c0a34470 con 0x55f4c0c25db0 2024-09-19T05:45:25.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5249b30640 1 --2- 172.21.15.67:0/3494480736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c86d10 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f52400059c0 tx=0x7f5240017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad243c79978b60b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5226ffd640 1 -- 172.21.15.67:0/3494480736 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240023440 con 0x55f4c0c25db0 2024-09-19T05:45:25.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5226ffd640 1 -- 172.21.15.67:0/3494480736 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52400235e0 con 0x55f4c0c25db0 2024-09-19T05:45:25.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f5226ffd640 1 -- 172.21.15.67:0/3494480736 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240023990 con 0x55f4c0c25db0 2024-09-19T05:45:25.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 -- 172.21.15.67:0/3494480736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 msgr2=0x55f4c0c86d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 --2- 172.21.15.67:0/3494480736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c86d10 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f52400059c0 tx=0x7f5240017040 comp rx=0 tx=0).stop 2024-09-19T05:45:25.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 -- 172.21.15.67:0/3494480736 shutdown_connections 2024-09-19T05:45:25.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 --2- 172.21.15.67:0/3494480736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c72690 0x55f4c0c2e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 --2- 172.21.15.67:0/3494480736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0c2dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 --2- 172.21.15.67:0/3494480736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c86d10 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 -- 172.21.15.67:0/3494480736 >> 172.21.15.67:0/3494480736 conn(0x55f4c0c53040 msgr2=0x55f4c0c7ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 -- 172.21.15.67:0/3494480736 shutdown_connections 2024-09-19T05:45:25.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 -- 172.21.15.67:0/3494480736 wait complete. 2024-09-19T05:45:25.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 -- start start 2024-09-19T05:45:25.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 Processor -- start 2024-09-19T05:45:25.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c85e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0ca1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.491+0000 7f524ee50000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c72690 0x55f4c0ca1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f4c0a1cf20 con 0x55f4c0c25db0 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f524415f520 con 0x55f4c0c71d70 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f4c0a7b370 con 0x55f4c0c72690 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 10 client.0 _ll_register_callbacks cb 0x7f523c007550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5249b30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c85e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5249b30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c85e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45614/0 (socket says 172.21.15.67:45614) 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5249b30640 1 -- 172.21.15.67:0/2925630751 learned_addr learned my addr 172.21.15.67:0/2925630751 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524a331640 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c72690 0x55f4c0ca1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5249b30640 1 -- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c72690 msgr2=0x55f4c0ca1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5249b30640 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c72690 0x55f4c0ca1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524932f640 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0ca1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5249b30640 1 -- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 msgr2=0x55f4c0ca1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5249b30640 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0ca1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5249b30640 1 -- 172.21.15.67:0/2925630751 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4c0a0a640 con 0x55f4c0c25db0 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524a331640 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c72690 0x55f4c0ca1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5249b30640 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c85e20 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f5240001440 tx=0x7f5240000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a2f9cacef28569 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5224ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5224ff9640 1 -- 172.21.15.67:0/2925630751 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240023440 con 0x55f4c0c25db0 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5224ff9640 1 -- 172.21.15.67:0/2925630751 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f52400239a0 con 0x55f4c0c25db0 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- 172.21.15.67:0/2925630751 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52400235e0 con 0x55f4c0c25db0 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5224ff9640 1 -- 172.21.15.67:0/2925630751 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f5240023be0 con 0x55f4c0c25db0 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 10 client.9399 fetch_fsmap learned FSMap version 106 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- 172.21.15.67:0/2925630751 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55f4c0a0e3b0 con 0x55f4c0c25db0 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5224ff9640 1 -- 172.21.15.67:0/2925630751 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52400235e0 con 0x55f4c0c25db0 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5224ff9640 1 -- 172.21.15.67:0/2925630751 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7f524000e4b0 con 0x55f4c0c25db0 2024-09-19T05:45:25.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 10 client.9399 fetch_fsmap finished waiting for FSMap version 106 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 10 client.9399 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 20 client.9399 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f4c0ca2210 0x55f4c0ce5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 4 client.9399 mds_command: new command op to 9066 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- 172.21.15.67:0/2925630751 --> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f4c0a84470 con 0x55f4c0ca2210 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524932f640 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f4c0ca2210 0x55f4c0ce5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524932f640 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f4c0ca2210 0x55f4c0ce5950 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b83e1fca8c3c9a36 server_cookie=3c5bdee0759c0f9b in_seq=0 out_seq=0 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5224ff9640 10 client.9399 ms_handle_connect on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5224ff9640 1 -- 172.21.15.67:0/2925630751 <== mds.0 v2:172.21.15.97:6834/2824250574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f4c0a84470 con 0x55f4c0ca2210 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5224ff9640 10 client.9399 handle_command_reply: tid=0 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 client.9399 shutdown 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- 172.21.15.67:0/2925630751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 msgr2=0x55f4c0c85e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c85e20 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f5240001440 tx=0x7f5240000bd0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- 172.21.15.67:0/2925630751 shutdown_connections 2024-09-19T05:45:25.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:6834/2824250574,v1:172.21.15.97:6835/2824250574] conn(0x55f4c0ca2210 0x55f4c0ce5950 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4c0c72690 0x55f4c0ca1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f5224ff9640 0 client.9399 ms_handle_reset on v2:172.21.15.97:6834/2824250574 2024-09-19T05:45:25.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f4c0c71d70 0x55f4c0ca1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 --2- 172.21.15.67:0/2925630751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4c0c25db0 0x55f4c0c85e20 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- 172.21.15.67:0/2925630751 >> 172.21.15.67:0/2925630751 conn(0x55f4c0c53040 msgr2=0x55f4c0c7f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- 172.21.15.67:0/2925630751 shutdown_connections 2024-09-19T05:45:25.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 1 -- 172.21.15.67:0/2925630751 wait complete. 2024-09-19T05:45:25.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524ee50000 20 client.9399 trim_cache size 0 max 16384 2024-09-19T05:45:25.502 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:45:25.502 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-19T05:45:25.502 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {} 2024-09-19T05:45:25.502 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 -- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52280678c0 msgr2=0x7f5228069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52280678c0 0x7f5228069d80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f524415bf50 tx=0x7f5240009040 comp rx=0 tx=0).stop 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 -- 172.21.15.67:0/3610760593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52440b3150 msgr2=0x7f5244152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52440b3150 0x7f5244152190 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f52340097c0 tx=0x7f523401acb0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 -- 172.21.15.67:0/3610760593 shutdown_connections 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f52280678c0 0x7f5228069d80 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5244159c60 0x7f52441515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52440b3150 0x7f5244152190 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 --2- 172.21.15.67:0/3610760593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f524406ffd0 0x7f524414de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 -- 172.21.15.67:0/3610760593 >> 172.21.15.67:0/3610760593 conn(0x7f52440b1e50 msgr2=0x7f5244150070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 -- 172.21.15.67:0/3610760593 shutdown_connections 2024-09-19T05:45:25.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.495+0000 7f524bd94640 1 -- 172.21.15.67:0/3610760593 wait complete. 2024-09-19T05:45:25.509 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:45:25.509 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:25.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff219af640 1 Processor -- start 2024-09-19T05:45:25.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff219af640 1 -- start start 2024-09-19T05:45:25.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff219af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff1c15cd50 0x7eff1c15d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff219af640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff1c06c3d0 0x7eff1c15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff219af640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c0ae3d0 con 0x7eff1c0b6cf0 2024-09-19T05:45:25.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff219af640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7eff1c15da20 con 0x7eff1c06c3d0 2024-09-19T05:45:25.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff219af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c0b25c0 con 0x7eff1c15cd50 2024-09-19T05:45:25.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff1b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff1c06c3d0 0x7eff1c15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff1b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff1c06c3d0 0x7eff1c15deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45620/0 (socket says 172.21.15.67:45620) 2024-09-19T05:45:25.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff1b7fe640 1 -- 172.21.15.67:0/2955196948 learned_addr learned my addr 172.21.15.67:0/2955196948 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff1affd640 1 --2- 172.21.15.67:0/2955196948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff1c15cd50 0x7eff1c15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff1b7fe640 1 -- 172.21.15.67:0/2955196948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff1c15cd50 msgr2=0x7eff1c15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:25.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff1b7fe640 1 --2- 172.21.15.67:0/2955196948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff1c15cd50 0x7eff1c15d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff1b7fe640 1 -- 172.21.15.67:0/2955196948 >> v1:172.21.15.97:6789/0 conn(0x7eff1c0b6cf0 legacy=0x7eff1c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.619+0000 7eff1b7fe640 1 -- 172.21.15.67:0/2955196948 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c0b28a0 con 0x7eff1c06c3d0 2024-09-19T05:45:25.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff1b7fe640 1 --2- 172.21.15.67:0/2955196948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 0x7eff1c15deb0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7eff14009e50 tx=0x7eff1401d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc209d5d921b8dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff1a7fc640 1 -- 172.21.15.67:0/2955196948 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140a5810 con 0x7eff1c06c3d0 2024-09-19T05:45:25.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff1a7fc640 1 -- 172.21.15.67:0/2955196948 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff140a59b0 con 0x7eff1c06c3d0 2024-09-19T05:45:25.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff1a7fc640 1 -- 172.21.15.67:0/2955196948 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140a5d80 con 0x7eff1c06c3d0 2024-09-19T05:45:25.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 -- 172.21.15.67:0/2955196948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 msgr2=0x7eff1c15deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 --2- 172.21.15.67:0/2955196948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 0x7eff1c15deb0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7eff14009e50 tx=0x7eff1401d490 comp rx=0 tx=0).stop 2024-09-19T05:45:25.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 -- 172.21.15.67:0/2955196948 shutdown_connections 2024-09-19T05:45:25.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 --2- 172.21.15.67:0/2955196948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 0x7eff1c15deb0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 --2- 172.21.15.67:0/2955196948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff1c15cd50 0x7eff1c15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 -- 172.21.15.67:0/2955196948 >> 172.21.15.67:0/2955196948 conn(0x7eff1c09aa30 msgr2=0x7eff1c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 -- 172.21.15.67:0/2955196948 shutdown_connections 2024-09-19T05:45:25.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 -- 172.21.15.67:0/2955196948 wait complete. 2024-09-19T05:45:25.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 Processor -- start 2024-09-19T05:45:25.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 -- start start 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 0x7eff1c1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.623+0000 7eff219af640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff1c0b6cf0 0x7eff1c1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff219af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff1c15cd50 0x7eff1c1349d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff219af640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c15ef90 con 0x7eff1c06c3d0 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff219af640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c15ee10 con 0x7eff1c0b6cf0 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff219af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c15f110 con 0x7eff1c15cd50 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff1affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 0x7eff1c1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff1affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 0x7eff1c1508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45626/0 (socket says 172.21.15.67:45626) 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff1affd640 1 -- 172.21.15.67:0/3815010906 learned_addr learned my addr 172.21.15.67:0/3815010906 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff1affd640 1 -- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff1c15cd50 msgr2=0x7eff1c1349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff1affd640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff1c15cd50 0x7eff1c1349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff1affd640 1 -- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff1c0b6cf0 msgr2=0x7eff1c1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff1affd640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff1c0b6cf0 0x7eff1c1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff1affd640 1 -- 172.21.15.67:0/3815010906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c150f90 con 0x7eff1c06c3d0 2024-09-19T05:45:25.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff1affd640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 0x7eff1c1508d0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00d5f0 tx=0x7eff0c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff18ff9640 1 -- 172.21.15.67:0/3815010906 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0125f0 con 0x7eff1c06c3d0 2024-09-19T05:45:25.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff18ff9640 1 -- 172.21.15.67:0/3815010906 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0c019070 con 0x7eff1c06c3d0 2024-09-19T05:45:25.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff219af640 1 -- 172.21.15.67:0/3815010906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c151270 con 0x7eff1c06c3d0 2024-09-19T05:45:25.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff18ff9640 1 -- 172.21.15.67:0/3815010906 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0129b0 con 0x7eff1c06c3d0 2024-09-19T05:45:25.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff219af640 1 -- 172.21.15.67:0/3815010906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c06f310 con 0x7eff1c06c3d0 2024-09-19T05:45:25.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff219af640 1 -- 172.21.15.67:0/3815010906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c15deb0 con 0x7eff1c06c3d0 2024-09-19T05:45:25.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff18ff9640 1 -- 172.21.15.67:0/3815010906 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff0c012b50 con 0x7eff1c06c3d0 2024-09-19T05:45:25.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff18ff9640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:25.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff18ff9640 1 -- 172.21.15.67:0/3815010906 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7eff0c086190 con 0x7eff1c06c3d0 2024-09-19T05:45:25.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff127fc640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:25.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.627+0000 7eff127fc640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efefc0678c0 0x7efefc069d80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7eff04000f70 tx=0x7eff040079e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:25.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.631+0000 7eff18ff9640 1 -- 172.21.15.67:0/3815010906 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7eff0c056ba0 con 0x7eff1c06c3d0 2024-09-19T05:45:25.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.823+0000 7eff219af640 1 -- 172.21.15.67:0/3815010906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff1c0b1f00 con 0x7eff1c06c3d0 2024-09-19T05:45:25.822 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:25.822 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:25.823 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.823+0000 7eff18ff9640 1 -- 172.21.15.67:0/3815010906 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7eff0c0564a0 con 0x7eff1c06c3d0 2024-09-19T05:45:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 -- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efefc0678c0 msgr2=0x7efefc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efefc0678c0 0x7efefc069d80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7eff04000f70 tx=0x7eff040079e0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 -- 172.21.15.67:0/3815010906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 msgr2=0x7eff1c1508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 0x7eff1c1508d0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00d5f0 tx=0x7eff0c00dab0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 -- 172.21.15.67:0/3815010906 shutdown_connections 2024-09-19T05:45:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff1c15cd50 0x7eff1c1349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff1c0b6cf0 0x7eff1c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 --2- 172.21.15.67:0/3815010906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c06c3d0 0x7eff1c1508d0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:25.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 -- 172.21.15.67:0/3815010906 >> 172.21.15.67:0/3815010906 conn(0x7eff1c09aa30 msgr2=0x7eff1c0b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:25.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 -- 172.21.15.67:0/3815010906 shutdown_connections 2024-09-19T05:45:25.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:25.827+0000 7eff219af640 1 -- 172.21.15.67:0/3815010906 wait complete. 2024-09-19T05:45:25.900 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-19T05:45:25.900 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:45:26.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef77fdc640 1 Processor -- start 2024-09-19T05:45:26.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef77fdc640 1 -- start start 2024-09-19T05:45:26.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef77fdc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700b51d0 0x7fef700d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:26.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef77fdc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef700d4d40 con 0x7fef70161da0 2024-09-19T05:45:26.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef77fdc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef700d5020 con 0x7fef700d1590 2024-09-19T05:45:26.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef77fdc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fef700d0840 con 0x7fef700b51d0 2024-09-19T05:45:26.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef75d78640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fef70161da0 0x7fef700d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45738/0 (socket says 172.21.15.67:45738) 2024-09-19T05:45:26.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef75d78640 1 -- 172.21.15.67:0/3562604577 learned_addr learned my addr 172.21.15.67:0/3562604577 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:26.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3445398735 0 0) 0x7fef700d4d40 con 0x7fef70161da0 2024-09-19T05:45:26.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef5c003530 con 0x7fef70161da0 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef76579640 1 --2- 172.21.15.67:0/3562604577 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700b51d0 0x7fef700d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 291476840 0 0) 0x7fef5c003530 con 0x7fef70161da0 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.015+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700b51d0 msgr2=0x7fef700d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 --2- 172.21.15.67:0/3562604577 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700b51d0 0x7fef700d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 >> v1:172.21.15.97:6789/0 conn(0x7fef700d1590 legacy=0x7fef700cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef700d5300 con 0x7fef70161da0 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fef6c0016a0 con 0x7fef70161da0 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 >> v1:172.21.15.67:6789/0 conn(0x7fef70161da0 legacy=0x7fef700d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 --2- 172.21.15.67:0/3562604577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 0x7fef5c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 --2- 172.21.15.67:0/3562604577 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700b51d0 0x7fef5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 --2- 172.21.15.67:0/3562604577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef5c004d50 0x7fef5c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:26.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fef700d0840 con 0x7fef5c0039f0 2024-09-19T05:45:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c00bb60 con 0x7fef5c004d50 2024-09-19T05:45:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fef5c00bd60 con 0x7fef700b51d0 2024-09-19T05:45:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef75d78640 1 --2- 172.21.15.67:0/3562604577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 0x7fef5c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef75d78640 1 -- 172.21.15.67:0/3562604577 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700b51d0 msgr2=0x7fef5c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef75d78640 1 --2- 172.21.15.67:0/3562604577 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700b51d0 0x7fef5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef75d78640 1 -- 172.21.15.67:0/3562604577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef5c004d50 msgr2=0x7fef5c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef75d78640 1 --2- 172.21.15.67:0/3562604577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef5c004d50 0x7fef5c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:26.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef75d78640 1 -- 172.21.15.67:0/3562604577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c003530 con 0x7fef5c0039f0 2024-09-19T05:45:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef75d78640 1 --2- 172.21.15.67:0/3562604577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 0x7fef5c003e10 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c210 tx=0x7fef6c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6419f28237ff04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c007d40 con 0x7fef5c0039f0 2024-09-19T05:45:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6c0a9070 con 0x7fef5c0039f0 2024-09-19T05:45:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef74d76640 1 -- 172.21.15.67:0/3562604577 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c005d40 con 0x7fef5c0039f0 2024-09-19T05:45:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef77fdc640 1 -- 172.21.15.67:0/3562604577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 msgr2=0x7fef5c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:26.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef77fdc640 1 --2- 172.21.15.67:0/3562604577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 0x7fef5c003e10 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c210 tx=0x7fef6c01cc60 comp rx=0 tx=0).stop 2024-09-19T05:45:26.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef76579640 1 -- 172.21.15.67:0/3562604577 reap_dead start 2024-09-19T05:45:26.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef77fdc640 1 -- 172.21.15.67:0/3562604577 shutdown_connections 2024-09-19T05:45:26.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef77fdc640 1 -- 172.21.15.67:0/3562604577 >> 172.21.15.67:0/3562604577 conn(0x7fef7008bfc0 msgr2=0x7fef700d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:26.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef77fdc640 1 -- 172.21.15.67:0/3562604577 shutdown_connections 2024-09-19T05:45:26.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.019+0000 7fef77fdc640 1 -- 172.21.15.67:0/3562604577 wait complete. 2024-09-19T05:45:26.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 Processor -- start 2024-09-19T05:45:26.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 -- start start 2024-09-19T05:45:26.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 0x7fef70150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:26.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700ce070 0x7fef700cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:26.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef7006ce10 0x7fef7006d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:26.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fef700d01f0 con 0x7fef5c0039f0 2024-09-19T05:45:26.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fef700d0070 con 0x7fef7006ce10 2024-09-19T05:45:26.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fef700d0370 con 0x7fef700ce070 2024-09-19T05:45:26.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef75d78640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 0x7fef70150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef75d78640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 0x7fef70150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40124/0 (socket says 172.21.15.67:40124) 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef75d78640 1 -- 172.21.15.67:0/2031361743 learned_addr learned my addr 172.21.15.67:0/2031361743 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef75d78640 1 -- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700ce070 msgr2=0x7fef700cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef75d78640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700ce070 0x7fef700cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef75d78640 1 -- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef7006ce10 msgr2=0x7fef7006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef75d78640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef7006ce10 0x7fef7006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef75d78640 1 -- 172.21.15.67:0/2031361743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef700b29e0 con 0x7fef5c0039f0 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef75d78640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 0x7fef70150490 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fef6c098460 tx=0x7fef5c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef667fc640 1 -- 172.21.15.67:0/2031361743 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c005de0 con 0x7fef5c0039f0 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef667fc640 1 -- 172.21.15.67:0/2031361743 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6c0047f0 con 0x7fef5c0039f0 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 -- 172.21.15.67:0/2031361743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef700b2cc0 con 0x7fef5c0039f0 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef667fc640 1 -- 172.21.15.67:0/2031361743 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c004bc0 con 0x7fef5c0039f0 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 -- 172.21.15.67:0/2031361743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7015ad60 con 0x7fef5c0039f0 2024-09-19T05:45:26.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef77fdc640 1 -- 172.21.15.67:0/2031361743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef7006d7d0 con 0x7fef5c0039f0 2024-09-19T05:45:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef667fc640 1 -- 172.21.15.67:0/2031361743 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef6c007070 con 0x7fef5c0039f0 2024-09-19T05:45:26.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef667fc640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef540678c0 0x7fef54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.023+0000 7fef667fc640 1 -- 172.21.15.67:0/2031361743 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fef6c11f150 con 0x7fef5c0039f0 2024-09-19T05:45:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.027+0000 7fef75577640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef540678c0 0x7fef54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:26.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.027+0000 7fef75577640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef540678c0 0x7fef54069d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fef60007fd0 tx=0x7fef600079e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.031+0000 7fef667fc640 1 -- 172.21.15.67:0/2031361743 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fef6c016970 con 0x7fef5c0039f0 2024-09-19T05:45:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.247+0000 7fef77fdc640 1 -- 172.21.15.67:0/2031361743 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fef700cf150 con 0x7fef5c0039f0 2024-09-19T05:45:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.247+0000 7fef667fc640 1 -- 172.21.15.67:0/2031361743 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7fef6c0efad0 con 0x7fef5c0039f0 2024-09-19T05:45:26.246 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:26.246 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":755,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":157,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078291705,"bytes_used":2672316416,"bytes_avail":770421796864,"bytes_total":773094113280,"write_bytes_sec":21700532,"read_op_per_sec":0,"write_op_per_sec":23},"fsmap":{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":9066}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-19T05:45:23.363784+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:45:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 -- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef540678c0 msgr2=0x7fef54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef540678c0 0x7fef54069d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fef60007fd0 tx=0x7fef600079e0 comp rx=0 tx=0).stop 2024-09-19T05:45:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 -- 172.21.15.67:0/2031361743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 msgr2=0x7fef70150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 0x7fef70150490 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fef6c098460 tx=0x7fef5c005840 comp rx=0 tx=0).stop 2024-09-19T05:45:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 -- 172.21.15.67:0/2031361743 shutdown_connections 2024-09-19T05:45:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef7006ce10 0x7fef7006d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef540678c0 0x7fef54069d80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef700ce070 0x7fef700cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 --2- 172.21.15.67:0/2031361743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef5c0039f0 0x7fef70150490 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 -- 172.21.15.67:0/2031361743 >> 172.21.15.67:0/2031361743 conn(0x7fef7008bfc0 msgr2=0x7fef701607f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 -- 172.21.15.67:0/2031361743 shutdown_connections 2024-09-19T05:45:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:26.251+0000 7fef77fdc640 1 -- 172.21.15.67:0/2031361743 wait complete. 2024-09-19T05:45:26.263 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused paths [/scrub_control_test_path]'} 2024-09-19T05:45:27.264 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:27.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f6ce3640 1 Processor -- start 2024-09-19T05:45:27.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f6ce3640 1 -- start start 2024-09-19T05:45:27.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f6ce3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f78f006dde0 0x7f78f00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f6ce3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f00b3510 0x7f78f006f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f6ce3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f006e3c0 con 0x7f78f015c030 2024-09-19T05:45:27.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f6ce3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f78f006e6a0 con 0x7f78f006dde0 2024-09-19T05:45:27.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f6ce3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f78f006e980 con 0x7f78f00b3510 2024-09-19T05:45:27.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f5280640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f00b3510 0x7f78f006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f4a7f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f78f015c030 0x7f78f015d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:37778/0 (socket says 172.21.15.67:37778) 2024-09-19T05:45:27.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f4a7f640 1 -- 172.21.15.67:0/3942909741 learned_addr learned my addr 172.21.15.67:0/3942909741 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:27.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f5280640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f00b3510 0x7f78f006f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:36732/0 (socket says 172.21.15.67:36732) 2024-09-19T05:45:27.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78effff640 1 --2- 172.21.15.67:0/3942909741 >> v2:172.21.15.97:3300/0 conn(0x7f78f006dde0 0x7f78f00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f5280640 1 -- 172.21.15.67:0/3942909741 >> v2:172.21.15.97:3300/0 conn(0x7f78f006dde0 msgr2=0x7f78f00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:27.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f5280640 1 --2- 172.21.15.67:0/3942909741 >> v2:172.21.15.97:3300/0 conn(0x7f78f006dde0 0x7f78f00b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f5280640 1 -- 172.21.15.67:0/3942909741 >> v1:172.21.15.97:6789/0 conn(0x7f78f015c030 legacy=0x7f78f015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:27.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.403+0000 7f78f5280640 1 -- 172.21.15.67:0/3942909741 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f006ec60 con 0x7f78f00b3510 2024-09-19T05:45:27.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f5280640 1 --2- 172.21.15.67:0/3942909741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f00b3510 0x7f78f006f460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009d90 tx=0x7f78e801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97be01a617c6d32d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78ef7fe640 1 -- 172.21.15.67:0/3942909741 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80b2070 con 0x7f78f00b3510 2024-09-19T05:45:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78ef7fe640 1 -- 172.21.15.67:0/3942909741 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e80a5910 con 0x7f78f00b3510 2024-09-19T05:45:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78ef7fe640 1 -- 172.21.15.67:0/3942909741 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80a5ce0 con 0x7f78f00b3510 2024-09-19T05:45:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f6ce3640 1 -- 172.21.15.67:0/3942909741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f00b3510 msgr2=0x7f78f006f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f6ce3640 1 --2- 172.21.15.67:0/3942909741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f00b3510 0x7f78f006f460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009d90 tx=0x7f78e801c940 comp rx=0 tx=0).stop 2024-09-19T05:45:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f6ce3640 1 -- 172.21.15.67:0/3942909741 shutdown_connections 2024-09-19T05:45:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f6ce3640 1 --2- 172.21.15.67:0/3942909741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f00b3510 0x7f78f006f460 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f6ce3640 1 --2- 172.21.15.67:0/3942909741 >> v2:172.21.15.97:3300/0 conn(0x7f78f006dde0 0x7f78f00b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f6ce3640 1 -- 172.21.15.67:0/3942909741 >> 172.21.15.67:0/3942909741 conn(0x7f78f00d0080 msgr2=0x7f78f00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f6ce3640 1 -- 172.21.15.67:0/3942909741 shutdown_connections 2024-09-19T05:45:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f6ce3640 1 -- 172.21.15.67:0/3942909741 wait complete. 2024-09-19T05:45:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f6ce3640 1 Processor -- start 2024-09-19T05:45:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.407+0000 7f78f6ce3640 1 -- start start 2024-09-19T05:45:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f6ce3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f006dde0 0x7f78f0099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f6ce3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78f00b3510 0x7f78f00737d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f6ce3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78f015c030 0x7f78f0166120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f6ce3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01692f0 con 0x7f78f015c030 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f6ce3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f78f015c620 con 0x7f78f00b3510 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f6ce3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f78f0169470 con 0x7f78f006dde0 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f5280640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78f015c030 0x7f78f0166120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f5280640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78f015c030 0x7f78f0166120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40130/0 (socket says 172.21.15.67:40130) 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f5280640 1 -- 172.21.15.67:0/1981228632 learned_addr learned my addr 172.21.15.67:0/1981228632 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f4a7f640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f006dde0 0x7f78f0099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78effff640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78f00b3510 0x7f78f00737d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f5280640 1 -- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f006dde0 msgr2=0x7f78f0099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f5280640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f006dde0 0x7f78f0099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f5280640 1 -- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78f00b3510 msgr2=0x7f78f00737d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f5280640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78f00b3510 0x7f78f00737d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f5280640 1 -- 172.21.15.67:0/1981228632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f0157970 con 0x7f78f015c030 2024-09-19T05:45:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f5280640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78f015c030 0x7f78f0166120 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f78e80b0040 tx=0x7f78e80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78ed7fa640 1 -- 172.21.15.67:0/1981228632 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80b2050 con 0x7f78f015c030 2024-09-19T05:45:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78ed7fa640 1 -- 172.21.15.67:0/1981228632 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e80be070 con 0x7f78f015c030 2024-09-19T05:45:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78ed7fa640 1 -- 172.21.15.67:0/1981228632 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80ada90 con 0x7f78f015c030 2024-09-19T05:45:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f6ce3640 1 -- 172.21.15.67:0/1981228632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f0157c50 con 0x7f78f015c030 2024-09-19T05:45:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f6ce3640 1 -- 172.21.15.67:0/1981228632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f0158210 con 0x7f78f015c030 2024-09-19T05:45:27.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f6ce3640 1 -- 172.21.15.67:0/1981228632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f00b2fd0 con 0x7f78f015c030 2024-09-19T05:45:27.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78ed7fa640 1 -- 172.21.15.67:0/1981228632 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78e80adc30 con 0x7f78f015c030 2024-09-19T05:45:27.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78ed7fa640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78d40678c0 0x7f78d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78ed7fa640 1 -- 172.21.15.67:0/1981228632 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f78e8121050 con 0x7f78f015c030 2024-09-19T05:45:27.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.411+0000 7f78f4a7f640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78d40678c0 0x7f78d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.415+0000 7f78f4a7f640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78d40678c0 0x7f78d4069d80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f78e4000f70 tx=0x7f78e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.415+0000 7f78ed7fa640 1 -- 172.21.15.67:0/1981228632 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f78e8016560 con 0x7f78f015c030 2024-09-19T05:45:27.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.619+0000 7f78f6ce3640 1 -- 172.21.15.67:0/1981228632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78f0158ef0 con 0x7f78f015c030 2024-09-19T05:45:27.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.619+0000 7f78ed7fa640 1 -- 172.21.15.67:0/1981228632 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7f78e80f1b00 con 0x7f78f015c030 2024-09-19T05:45:27.618 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:27.618 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:27.619 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:27.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 -- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78d40678c0 msgr2=0x7f78d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:27.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78d40678c0 0x7f78d4069d80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f78e4000f70 tx=0x7f78e4009040 comp rx=0 tx=0).stop 2024-09-19T05:45:27.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 -- 172.21.15.67:0/1981228632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78f015c030 msgr2=0x7f78f0166120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:27.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78f015c030 0x7f78f0166120 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f78e80b0040 tx=0x7f78e80196e0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 -- 172.21.15.67:0/1981228632 shutdown_connections 2024-09-19T05:45:27.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78f015c030 0x7f78f0166120 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78f00b3510 0x7f78f00737d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f78d40678c0 0x7f78d4069d80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 --2- 172.21.15.67:0/1981228632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78f006dde0 0x7f78f0099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 -- 172.21.15.67:0/1981228632 >> 172.21.15.67:0/1981228632 conn(0x7f78f00d0080 msgr2=0x7f78f015c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:27.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 -- 172.21.15.67:0/1981228632 shutdown_connections 2024-09-19T05:45:27.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.623+0000 7f78f6ce3640 1 -- 172.21.15.67:0/1981228632 wait complete. 2024-09-19T05:45:27.637 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-19T05:45:27.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:45:27.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.763+0000 7f96a8944640 1 Processor -- start 2024-09-19T05:45:27.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.763+0000 7f96a8944640 1 -- start start 2024-09-19T05:45:27.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96a415c200 0x7f96a4071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f96a40aef40 0x7f96a40af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a40b3070 con 0x7f96a415b710 2024-09-19T05:45:27.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f96a40b32e0 con 0x7f96a40aef40 2024-09-19T05:45:27.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f96a40b35c0 con 0x7f96a415c200 2024-09-19T05:45:27.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a2d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f96a40aef40 0x7f96a40af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a2d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f96a40aef40 0x7f96a40af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40136/0 (socket says 172.21.15.67:40136) 2024-09-19T05:45:27.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a2d9d640 1 -- 172.21.15.67:0/3920331696 learned_addr learned my addr 172.21.15.67:0/3920331696 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:27.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a1d9b640 1 --2- 172.21.15.67:0/3920331696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96a415c200 0x7f96a4071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a2d9d640 1 -- 172.21.15.67:0/3920331696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96a415c200 msgr2=0x7f96a4071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:27.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a2d9d640 1 --2- 172.21.15.67:0/3920331696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96a415c200 0x7f96a4071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a2d9d640 1 -- 172.21.15.67:0/3920331696 >> v1:172.21.15.97:6789/0 conn(0x7f96a415b710 legacy=0x7f96a415baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:27.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a2d9d640 1 -- 172.21.15.67:0/3920331696 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a40b38a0 con 0x7f96a40aef40 2024-09-19T05:45:27.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a2d9d640 1 --2- 172.21.15.67:0/3920331696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 0x7f96a40af390 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f969c00d150 tx=0x7f969c01ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749d07c1905e024b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:27.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a159a640 1 -- 172.21.15.67:0/3920331696 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c00b2d0 con 0x7f96a40aef40 2024-09-19T05:45:27.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a159a640 1 -- 172.21.15.67:0/3920331696 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c00b470 con 0x7f96a40aef40 2024-09-19T05:45:27.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a159a640 1 -- 172.21.15.67:0/3920331696 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0a7c00 con 0x7f96a40aef40 2024-09-19T05:45:27.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 -- 172.21.15.67:0/3920331696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 msgr2=0x7f96a40af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:27.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 --2- 172.21.15.67:0/3920331696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 0x7f96a40af390 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f969c00d150 tx=0x7f969c01ec00 comp rx=0 tx=0).stop 2024-09-19T05:45:27.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 -- 172.21.15.67:0/3920331696 shutdown_connections 2024-09-19T05:45:27.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 --2- 172.21.15.67:0/3920331696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 0x7f96a40af390 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 --2- 172.21.15.67:0/3920331696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96a415c200 0x7f96a4071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 -- 172.21.15.67:0/3920331696 >> 172.21.15.67:0/3920331696 conn(0x7f96a40d0080 msgr2=0x7f96a40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:27.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 -- 172.21.15.67:0/3920331696 shutdown_connections 2024-09-19T05:45:27.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.767+0000 7f96a8944640 1 -- 172.21.15.67:0/3920331696 wait complete. 2024-09-19T05:45:27.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 Processor -- start 2024-09-19T05:45:27.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 -- start start 2024-09-19T05:45:27.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 0x7f96a40992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96a415b710 0x7f96a4150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96a415c200 0x7f96a4151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f96a40b4c80 con 0x7f96a40aef40 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f96a40b4b00 con 0x7f96a415b710 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f96a40b4e00 con 0x7f96a415c200 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 0x7f96a40992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 0x7f96a40992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40146/0 (socket says 172.21.15.67:40146) 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a259c640 1 -- 172.21.15.67:0/2673745489 learned_addr learned my addr 172.21.15.67:0/2673745489 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a2d9d640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96a415c200 0x7f96a4151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a1d9b640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96a415b710 0x7f96a4150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a259c640 1 -- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96a415c200 msgr2=0x7f96a4151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a259c640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96a415c200 0x7f96a4151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a259c640 1 -- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96a415b710 msgr2=0x7f96a4150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a259c640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96a415b710 0x7f96a4150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:27.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a259c640 1 -- 172.21.15.67:0/2673745489 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a4147840 con 0x7f96a40aef40 2024-09-19T05:45:27.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a259c640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 0x7f96a40992f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f969400c530 tx=0x7f969400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:27.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f969affd640 1 -- 172.21.15.67:0/2673745489 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694016020 con 0x7f96a40aef40 2024-09-19T05:45:27.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f969affd640 1 -- 172.21.15.67:0/2673745489 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9694005220 con 0x7f96a40aef40 2024-09-19T05:45:27.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 -- 172.21.15.67:0/2673745489 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a4147b20 con 0x7f96a40aef40 2024-09-19T05:45:27.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f969affd640 1 -- 172.21.15.67:0/2673745489 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694007030 con 0x7f96a40aef40 2024-09-19T05:45:27.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 -- 172.21.15.67:0/2673745489 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a41480e0 con 0x7f96a40aef40 2024-09-19T05:45:27.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.771+0000 7f96a8944640 1 -- 172.21.15.67:0/2673745489 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a40af390 con 0x7f96a40aef40 2024-09-19T05:45:27.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.775+0000 7f969affd640 1 -- 172.21.15.67:0/2673745489 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96940071d0 con 0x7f96a40aef40 2024-09-19T05:45:27.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.775+0000 7f969affd640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96840678c0 0x7f9684069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:27.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.775+0000 7f969affd640 1 -- 172.21.15.67:0/2673745489 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f96940857d0 con 0x7f96a40aef40 2024-09-19T05:45:27.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.775+0000 7f96a1d9b640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96840678c0 0x7f9684069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:27.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.775+0000 7f96a1d9b640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96840678c0 0x7f9684069d80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f96a4152a50 tx=0x7f968c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:27.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.779+0000 7f969affd640 1 -- 172.21.15.67:0/2673745489 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9694020020 con 0x7f96a40aef40 2024-09-19T05:45:27.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.999+0000 7f96a8944640 1 -- 172.21.15.67:0/2673745489 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f96a40b12c0 con 0x7f96a40aef40 2024-09-19T05:45:27.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:27.999+0000 7f969affd640 1 -- 172.21.15.67:0/2673745489 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f96940074c0 con 0x7f96a40aef40 2024-09-19T05:45:27.998 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:27.998 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":757,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":157,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078291705,"bytes_used":2672316416,"bytes_avail":770421796864,"bytes_total":773094113280,"write_bytes_sec":21701167,"read_op_per_sec":0,"write_op_per_sec":23},"fsmap":{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":9066}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-19T05:45:23.363784+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 -- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96840678c0 msgr2=0x7f9684069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96840678c0 0x7f9684069d80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f96a4152a50 tx=0x7f968c008040 comp rx=0 tx=0).stop 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 -- 172.21.15.67:0/2673745489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 msgr2=0x7f96a40992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 0x7f96a40992f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f969400c530 tx=0x7f969400c9f0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 -- 172.21.15.67:0/2673745489 shutdown_connections 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f96840678c0 0x7f9684069d80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96a415c200 0x7f96a4151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96a415b710 0x7f96a4150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 --2- 172.21.15.67:0/2673745489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96a40aef40 0x7f96a40992f0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 -- 172.21.15.67:0/2673745489 >> 172.21.15.67:0/2673745489 conn(0x7f96a40d0080 msgr2=0x7f96a406f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 -- 172.21.15.67:0/2673745489 shutdown_connections 2024-09-19T05:45:28.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:28.003+0000 7f96a8944640 1 -- 172.21.15.67:0/2673745489 wait complete. 2024-09-19T05:45:28.016 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused paths [/scrub_control_test_path]'} 2024-09-19T05:45:29.017 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:29.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.155+0000 7f233667c640 1 Processor -- start 2024-09-19T05:45:29.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.155+0000 7f233667c640 1 -- start start 2024-09-19T05:45:29.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f233667c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f233015b1e0 0x7f23300b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f233667c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f23300b4900 0x7f2330071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f233667c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23300b3860 con 0x7f23300723c0 2024-09-19T05:45:29.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f233667c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f233015b5c0 con 0x7f23300b4900 2024-09-19T05:45:29.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f233667c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f23300b3b40 con 0x7f233015b1e0 2024-09-19T05:45:29.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f232f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f23300b4900 0x7f2330071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f232f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f23300b4900 0x7f2330071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40158/0 (socket says 172.21.15.67:40158) 2024-09-19T05:45:29.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f232f7fe640 1 -- 172.21.15.67:0/436698131 learned_addr learned my addr 172.21.15.67:0/436698131 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:29.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f232ffff640 1 --2- 172.21.15.67:0/436698131 >> v2:172.21.15.97:3300/0 conn(0x7f233015b1e0 0x7f23300b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f232f7fe640 1 -- 172.21.15.67:0/436698131 >> v2:172.21.15.97:3300/0 conn(0x7f233015b1e0 msgr2=0x7f23300b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:29.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f232f7fe640 1 --2- 172.21.15.67:0/436698131 >> v2:172.21.15.97:3300/0 conn(0x7f233015b1e0 0x7f23300b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f232f7fe640 1 -- 172.21.15.67:0/436698131 >> v1:172.21.15.97:6789/0 conn(0x7f23300723c0 legacy=0x7f233015ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:29.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f232f7fe640 1 -- 172.21.15.67:0/436698131 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23300b3e20 con 0x7f23300b4900 2024-09-19T05:45:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f232f7fe640 1 --2- 172.21.15.67:0/436698131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300b4900 0x7f2330071e80 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f233015fde0 tx=0x7f231801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c9e75d47c2c717 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.159+0000 7f232effd640 1 -- 172.21.15.67:0/436698131 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180a5750 con 0x7f23300b4900 2024-09-19T05:45:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f232effd640 1 -- 172.21.15.67:0/436698131 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23180a58f0 con 0x7f23300b4900 2024-09-19T05:45:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f232effd640 1 -- 172.21.15.67:0/436698131 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180a5cc0 con 0x7f23300b4900 2024-09-19T05:45:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 -- 172.21.15.67:0/436698131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300b4900 msgr2=0x7f2330071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:29.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 --2- 172.21.15.67:0/436698131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300b4900 0x7f2330071e80 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f233015fde0 tx=0x7f231801c980 comp rx=0 tx=0).stop 2024-09-19T05:45:29.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 -- 172.21.15.67:0/436698131 shutdown_connections 2024-09-19T05:45:29.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 --2- 172.21.15.67:0/436698131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300b4900 0x7f2330071e80 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 --2- 172.21.15.67:0/436698131 >> v2:172.21.15.97:3300/0 conn(0x7f233015b1e0 0x7f23300b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 -- 172.21.15.67:0/436698131 >> 172.21.15.67:0/436698131 conn(0x7f23300d0080 msgr2=0x7f23300d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:29.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 -- 172.21.15.67:0/436698131 shutdown_connections 2024-09-19T05:45:29.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 -- 172.21.15.67:0/436698131 wait complete. 2024-09-19T05:45:29.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 Processor -- start 2024-09-19T05:45:29.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 -- start start 2024-09-19T05:45:29.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300723c0 0x7f2330154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23300b4900 0x7f233015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f233015b1e0 0x7f233015d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f23301681e0 con 0x7f23300723c0 2024-09-19T05:45:29.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2330168060 con 0x7f23300b4900 2024-09-19T05:45:29.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f233667c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2330168360 con 0x7f233015b1e0 2024-09-19T05:45:29.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f232ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300723c0 0x7f2330154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f232ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300723c0 0x7f2330154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40160/0 (socket says 172.21.15.67:40160) 2024-09-19T05:45:29.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.163+0000 7f232ffff640 1 -- 172.21.15.67:0/2573108935 learned_addr learned my addr 172.21.15.67:0/2573108935 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:29.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232f7fe640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23300b4900 0x7f233015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f2334c19640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f233015b1e0 0x7f233015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232ffff640 1 -- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f233015b1e0 msgr2=0x7f233015d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:29.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232ffff640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f233015b1e0 0x7f233015d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232ffff640 1 -- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23300b4900 msgr2=0x7f233015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:29.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232ffff640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23300b4900 0x7f233015ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232ffff640 1 -- 172.21.15.67:0/2573108935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23301f8810 con 0x7f23300723c0 2024-09-19T05:45:29.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232ffff640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300723c0 0x7f2330154fe0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f232000d800 tx=0x7f232000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:29.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232cff9640 1 -- 172.21.15.67:0/2573108935 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232000b6c0 con 0x7f23300723c0 2024-09-19T05:45:29.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232cff9640 1 -- 172.21.15.67:0/2573108935 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2320019070 con 0x7f23300723c0 2024-09-19T05:45:29.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232cff9640 1 -- 172.21.15.67:0/2573108935 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232000ba60 con 0x7f23300723c0 2024-09-19T05:45:29.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f233667c640 1 -- 172.21.15.67:0/2573108935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23301fb290 con 0x7f23300723c0 2024-09-19T05:45:29.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f233667c640 1 -- 172.21.15.67:0/2573108935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23301fb850 con 0x7f23300723c0 2024-09-19T05:45:29.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f233667c640 1 -- 172.21.15.67:0/2573108935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2330071e80 con 0x7f23300723c0 2024-09-19T05:45:29.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232cff9640 1 -- 172.21.15.67:0/2573108935 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f232000bc00 con 0x7f23300723c0 2024-09-19T05:45:29.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232cff9640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23100678c0 0x7f2310069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232cff9640 1 -- 172.21.15.67:0/2573108935 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f23200861f0 con 0x7f23300723c0 2024-09-19T05:45:29.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.167+0000 7f232f7fe640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23100678c0 0x7f2310069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.171+0000 7f232f7fe640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23100678c0 0x7f2310069d80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f23180ae000 tx=0x7f23180a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:29.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.171+0000 7f232cff9640 1 -- 172.21.15.67:0/2573108935 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2320056c00 con 0x7f23300723c0 2024-09-19T05:45:29.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.371+0000 7f233667c640 1 -- 172.21.15.67:0/2573108935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f233006f460 con 0x7f23300723c0 2024-09-19T05:45:29.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.371+0000 7f232cff9640 1 -- 172.21.15.67:0/2573108935 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7f2320056500 con 0x7f23300723c0 2024-09-19T05:45:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:29.368 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:29.369 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:29.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 -- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23100678c0 msgr2=0x7f2310069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:29.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23100678c0 0x7f2310069d80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f23180ae000 tx=0x7f23180a7070 comp rx=0 tx=0).stop 2024-09-19T05:45:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 -- 172.21.15.67:0/2573108935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300723c0 msgr2=0x7f2330154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300723c0 0x7f2330154fe0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f232000d800 tx=0x7f232000dcc0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 -- 172.21.15.67:0/2573108935 shutdown_connections 2024-09-19T05:45:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f23100678c0 0x7f2310069d80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f233015b1e0 0x7f233015d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23300b4900 0x7f233015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 --2- 172.21.15.67:0/2573108935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23300723c0 0x7f2330154fe0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 -- 172.21.15.67:0/2573108935 >> 172.21.15.67:0/2573108935 conn(0x7f23300d0080 msgr2=0x7f2330152980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 -- 172.21.15.67:0/2573108935 shutdown_connections 2024-09-19T05:45:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.375+0000 7f233667c640 1 -- 172.21.15.67:0/2573108935 wait complete. 2024-09-19T05:45:29.388 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-19T05:45:29.388 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:45:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc6e9d640 1 Processor -- start 2024-09-19T05:45:29.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc6e9d640 1 -- start start 2024-09-19T05:45:29.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc6e9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5cc015b710 0x7f5cc0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc6e9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cc015baf0 0x7f5cc015bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc6e9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cc00aef40 0x7f5cc00af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc6e9d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc00b3070 con 0x7f5cc00aef40 2024-09-19T05:45:29.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc6e9d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc00b32e0 con 0x7f5cc015b710 2024-09-19T05:45:29.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc6e9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc00b35c0 con 0x7f5cc015baf0 2024-09-19T05:45:29.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc543a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cc00aef40 0x7f5cc00af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc543a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cc00aef40 0x7f5cc00af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40166/0 (socket says 172.21.15.67:40166) 2024-09-19T05:45:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.507+0000 7f5cc543a640 1 -- 172.21.15.67:0/1132864321 learned_addr learned my addr 172.21.15.67:0/1132864321 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.511+0000 7f5cc4c39640 1 --2- 172.21.15.67:0/1132864321 >> v2:172.21.15.97:3300/0 conn(0x7f5cc015b710 0x7f5cc0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.511+0000 7f5cbffff640 1 --2- 172.21.15.67:0/1132864321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cc015baf0 0x7f5cc015bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.511+0000 7f5cc543a640 1 -- 172.21.15.67:0/1132864321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cc015baf0 msgr2=0x7f5cc015bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.511+0000 7f5cc543a640 1 --2- 172.21.15.67:0/1132864321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cc015baf0 0x7f5cc015bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.511+0000 7f5cc543a640 1 -- 172.21.15.67:0/1132864321 >> v2:172.21.15.97:3300/0 conn(0x7f5cc015b710 msgr2=0x7f5cc0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.511+0000 7f5cc543a640 1 --2- 172.21.15.67:0/1132864321 >> v2:172.21.15.97:3300/0 conn(0x7f5cc015b710 0x7f5cc0071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.511+0000 7f5cc543a640 1 -- 172.21.15.67:0/1132864321 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc00b38a0 con 0x7f5cc00aef40 2024-09-19T05:45:29.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.511+0000 7f5cc4c39640 1 --2- 172.21.15.67:0/1132864321 >> v2:172.21.15.97:3300/0 conn(0x7f5cc015b710 0x7f5cc0071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:29.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.511+0000 7f5cc543a640 1 --2- 172.21.15.67:0/1132864321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc00aef40 0x7f5cc00af390 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00717a0 tx=0x7f5cb001cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d520122b8494ee2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:29.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbf7fe640 1 -- 172.21.15.67:0/1132864321 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00aa430 con 0x7f5cc00aef40 2024-09-19T05:45:29.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbf7fe640 1 -- 172.21.15.67:0/1132864321 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb00af070 con 0x7f5cc00aef40 2024-09-19T05:45:29.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbf7fe640 1 -- 172.21.15.67:0/1132864321 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00aa7f0 con 0x7f5cc00aef40 2024-09-19T05:45:29.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1132864321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc00aef40 msgr2=0x7f5cc00af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:29.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 --2- 172.21.15.67:0/1132864321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc00aef40 0x7f5cc00af390 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00717a0 tx=0x7f5cb001cf50 comp rx=0 tx=0).stop 2024-09-19T05:45:29.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1132864321 shutdown_connections 2024-09-19T05:45:29.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 --2- 172.21.15.67:0/1132864321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc00aef40 0x7f5cc00af390 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 --2- 172.21.15.67:0/1132864321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cc015baf0 0x7f5cc015bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 --2- 172.21.15.67:0/1132864321 >> v2:172.21.15.97:3300/0 conn(0x7f5cc015b710 0x7f5cc0071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1132864321 >> 172.21.15.67:0/1132864321 conn(0x7f5cc00d0080 msgr2=0x7f5cc00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:29.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1132864321 shutdown_connections 2024-09-19T05:45:29.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1132864321 wait complete. 2024-09-19T05:45:29.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 Processor -- start 2024-09-19T05:45:29.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 -- start start 2024-09-19T05:45:29.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cc00aef40 0x7f5cc014f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc015b710 0x7f5cc014a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cc015baf0 0x7f5cc0150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc00b4a30 con 0x7f5cc015b710 2024-09-19T05:45:29.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc00b48b0 con 0x7f5cc015baf0 2024-09-19T05:45:29.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc6e9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc00b4bb0 con 0x7f5cc00aef40 2024-09-19T05:45:29.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc015b710 0x7f5cc014a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc015b710 0x7f5cc014a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40180/0 (socket says 172.21.15.67:40180) 2024-09-19T05:45:29.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbffff640 1 -- 172.21.15.67:0/1586626667 learned_addr learned my addr 172.21.15.67:0/1586626667 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:29.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc4c39640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cc00aef40 0x7f5cc014f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc543a640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cc015baf0 0x7f5cc0150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbffff640 1 -- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cc00aef40 msgr2=0x7f5cc014f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:29.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbffff640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cc00aef40 0x7f5cc014f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbffff640 1 -- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cc015baf0 msgr2=0x7f5cc0150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:29.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbffff640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cc015baf0 0x7f5cc0150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbffff640 1 -- 172.21.15.67:0/1586626667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc014e190 con 0x7f5cc015b710 2024-09-19T05:45:29.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cc543a640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cc015baf0 0x7f5cc0150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:29.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.515+0000 7f5cbffff640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc015b710 0x7f5cc014a540 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800d5f0 tx=0x7f5ca800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:29.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cbd7fa640 1 -- 172.21.15.67:0/1586626667 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80125f0 con 0x7f5cc015b710 2024-09-19T05:45:29.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cbd7fa640 1 -- 172.21.15.67:0/1586626667 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca8019070 con 0x7f5cc015b710 2024-09-19T05:45:29.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cbd7fa640 1 -- 172.21.15.67:0/1586626667 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80129b0 con 0x7f5cc015b710 2024-09-19T05:45:29.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1586626667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc014e470 con 0x7f5cc015b710 2024-09-19T05:45:29.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1586626667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc014ea30 con 0x7f5cc015b710 2024-09-19T05:45:29.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1586626667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc0071e80 con 0x7f5cc015b710 2024-09-19T05:45:29.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cbd7fa640 1 -- 172.21.15.67:0/1586626667 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ca8012b50 con 0x7f5cc015b710 2024-09-19T05:45:29.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cbd7fa640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ca00678c0 0x7f5ca0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:29.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cbd7fa640 1 -- 172.21.15.67:0/1586626667 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f5ca80861d0 con 0x7f5cc015b710 2024-09-19T05:45:29.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cc4c39640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ca00678c0 0x7f5ca0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:29.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.519+0000 7f5cc4c39640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ca00678c0 0x7f5ca0069d80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009a80 tx=0x7f5cb8003cf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:29.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.527+0000 7f5cbd7fa640 1 -- 172.21.15.67:0/1586626667 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5ca8056b50 con 0x7f5cc015b710 2024-09-19T05:45:29.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.747+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1586626667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5cc014c200 con 0x7f5cc015b710 2024-09-19T05:45:29.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.747+0000 7f5cbd7fa640 1 -- 172.21.15.67:0/1586626667 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7f5ca8056450 con 0x7f5cc015b710 2024-09-19T05:45:29.746 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:29.746 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":759,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":157,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078435671,"bytes_used":2672607232,"bytes_avail":770421506048,"bytes_total":773094113280,"write_bytes_sec":21713012,"read_op_per_sec":0,"write_op_per_sec":23},"fsmap":{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":9066}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-19T05:45:29.365944+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:45:29.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ca00678c0 msgr2=0x7f5ca0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:29.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ca00678c0 0x7f5ca0069d80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009a80 tx=0x7f5cb8003cf0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1586626667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc015b710 msgr2=0x7f5cc014a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:29.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc015b710 0x7f5cc014a540 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800d5f0 tx=0x7f5ca800dab0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1586626667 shutdown_connections 2024-09-19T05:45:29.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cc015baf0 0x7f5cc0150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc015b710 0x7f5cc014a540 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ca00678c0 0x7f5ca0069d80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 --2- 172.21.15.67:0/1586626667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cc00aef40 0x7f5cc014f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1586626667 >> 172.21.15.67:0/1586626667 conn(0x7f5cc00d0080 msgr2=0x7f5cc0072090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1586626667 shutdown_connections 2024-09-19T05:45:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:29.751+0000 7f5cc6e9d640 1 -- 172.21.15.67:0/1586626667 wait complete. 2024-09-19T05:45:29.763 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-19T05:45:29.764 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:45:29.764 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:45:29.840 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:45:29.938 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:45:29.938 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:45:29.938 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:45:29.938 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:45:29.945 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:45:30.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f671e3ae640 1 Processor -- start 2024-09-19T05:45:30.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f671e3ae640 1 -- start start 2024-09-19T05:45:30.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f671e3ae640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180b2fd0 0x7f67180b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f671e3ae640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f67180acfb0 0x7f67180ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f671e3ae640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f671806de80 con 0x7f6718159d60 2024-09-19T05:45:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f671e3ae640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f67180ad960 con 0x7f67180acfb0 2024-09-19T05:45:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f671e3ae640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f671806e160 con 0x7f67180b2fd0 2024-09-19T05:45:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f6717fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6718159d60 0x7f671806ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45750/0 (socket says 172.21.15.67:45750) 2024-09-19T05:45:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f6717fff640 1 -- 172.21.15.67:0/4108792120 learned_addr learned my addr 172.21.15.67:0/4108792120 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f671c94b640 1 --2- 172.21.15.67:0/4108792120 >> v2:172.21.15.97:3300/0 conn(0x7f67180acfb0 0x7f67180ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f67177fe640 1 --2- 172.21.15.67:0/4108792120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180b2fd0 0x7f67180b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f6716ffd640 1 -- 172.21.15.67:0/4108792120 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3357852284 0 0) 0x7f671806de80 con 0x7f6718159d60 2024-09-19T05:45:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f6716ffd640 1 -- 172.21.15.67:0/4108792120 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6700003530 con 0x7f6718159d60 2024-09-19T05:45:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f67177fe640 1 -- 172.21.15.67:0/4108792120 >> v2:172.21.15.97:3300/0 conn(0x7f67180acfb0 msgr2=0x7f67180ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f6716ffd640 1 -- 172.21.15.67:0/4108792120 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3569452489 0 0) 0x7f6700003530 con 0x7f6718159d60 2024-09-19T05:45:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f67177fe640 1 --2- 172.21.15.67:0/4108792120 >> v2:172.21.15.97:3300/0 conn(0x7f67180acfb0 0x7f67180ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f67177fe640 1 -- 172.21.15.67:0/4108792120 >> v1:172.21.15.67:6789/0 conn(0x7f6718159d60 legacy=0x7f671806ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f67177fe640 1 -- 172.21.15.67:0/4108792120 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671806e440 con 0x7f67180b2fd0 2024-09-19T05:45:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.115+0000 7f671c94b640 1 --2- 172.21.15.67:0/4108792120 >> v2:172.21.15.97:3300/0 conn(0x7f67180acfb0 0x7f67180ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:45:30.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f67177fe640 1 --2- 172.21.15.67:0/4108792120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180b2fd0 0x7f67180b3420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f670c009d90 tx=0x7f670c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97f5e164bf6c3d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f6716ffd640 1 -- 172.21.15.67:0/4108792120 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c0ac070 con 0x7f67180b2fd0 2024-09-19T05:45:30.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f6716ffd640 1 -- 172.21.15.67:0/4108792120 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f670c0a64a0 con 0x7f67180b2fd0 2024-09-19T05:45:30.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f6716ffd640 1 -- 172.21.15.67:0/4108792120 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708001680 con 0x7f67180b2fd0 2024-09-19T05:45:30.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f671e3ae640 1 -- 172.21.15.67:0/4108792120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180b2fd0 msgr2=0x7f67180b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f671e3ae640 1 --2- 172.21.15.67:0/4108792120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180b2fd0 0x7f67180b3420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f670c009d90 tx=0x7f670c01c890 comp rx=0 tx=0).stop 2024-09-19T05:45:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f671e3ae640 1 -- 172.21.15.67:0/4108792120 shutdown_connections 2024-09-19T05:45:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f671e3ae640 1 --2- 172.21.15.67:0/4108792120 >> v2:172.21.15.97:3300/0 conn(0x7f67180acfb0 0x7f67180ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f671e3ae640 1 --2- 172.21.15.67:0/4108792120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180b2fd0 0x7f67180b3420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f671e3ae640 1 -- 172.21.15.67:0/4108792120 >> 172.21.15.67:0/4108792120 conn(0x7f67180d0080 msgr2=0x7f67180d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f671e3ae640 1 -- 172.21.15.67:0/4108792120 shutdown_connections 2024-09-19T05:45:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.119+0000 7f671e3ae640 1 -- 172.21.15.67:0/4108792120 wait complete. 2024-09-19T05:45:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 Processor -- start 2024-09-19T05:45:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 -- start start 2024-09-19T05:45:30.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67180acfb0 0x7f6718146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180b2fd0 0x7f67180b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6718159d60 0x7f67180b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67180af6b0 con 0x7f67180acfb0 2024-09-19T05:45:30.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f671806f630 con 0x7f6718159d60 2024-09-19T05:45:30.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67180af830 con 0x7f67180b2fd0 2024-09-19T05:45:30.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6717fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67180acfb0 0x7f6718146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6717fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67180acfb0 0x7f6718146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40196/0 (socket says 172.21.15.67:40196) 2024-09-19T05:45:30.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6717fff640 1 -- 172.21.15.67:0/1235508495 learned_addr learned my addr 172.21.15.67:0/1235508495 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:30.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671c94b640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6718159d60 0x7f67180b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6717fff640 1 -- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180b2fd0 msgr2=0x7f67180b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6717fff640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180b2fd0 0x7f67180b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6717fff640 1 -- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6718159d60 msgr2=0x7f67180b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6717fff640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6718159d60 0x7f67180b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6717fff640 1 -- 172.21.15.67:0/1235508495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6718157840 con 0x7f67180acfb0 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671c94b640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6718159d60 0x7f67180b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6717fff640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67180acfb0 0x7f6718146130 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f67080017f0 tx=0x7f670800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6714ff9640 1 -- 172.21.15.67:0/1235508495 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708005ae0 con 0x7f67180acfb0 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6714ff9640 1 -- 172.21.15.67:0/1235508495 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6708005ca0 con 0x7f67180acfb0 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 -- 172.21.15.67:0/1235508495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6718157b20 con 0x7f67180acfb0 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6714ff9640 1 -- 172.21.15.67:0/1235508495 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67080072b0 con 0x7f67180acfb0 2024-09-19T05:45:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 -- 172.21.15.67:0/1235508495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67181580e0 con 0x7f67180acfb0 2024-09-19T05:45:30.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f671e3ae640 1 -- 172.21.15.67:0/1235508495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67180ad420 con 0x7f67180acfb0 2024-09-19T05:45:30.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6714ff9640 1 -- 172.21.15.67:0/1235508495 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6708007450 con 0x7f67180acfb0 2024-09-19T05:45:30.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6714ff9640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67040678c0 0x7f6704069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.123+0000 7f6714ff9640 1 -- 172.21.15.67:0/1235508495 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f6708085d90 con 0x7f67180acfb0 2024-09-19T05:45:30.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.127+0000 7f67177fe640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67040678c0 0x7f6704069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.127+0000 7f67177fe640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67040678c0 0x7f6704069d80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f670c0ae000 tx=0x7f670c004ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.131+0000 7f6714ff9640 1 -- 172.21.15.67:0/1235508495 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6708010300 con 0x7f67180acfb0 2024-09-19T05:45:30.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 -- 172.21.15.67:0/1235508495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f67180d0f20 con 0x7f67180acfb0 2024-09-19T05:45:30.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f6714ff9640 1 -- 172.21.15.67:0/1235508495 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v157) ==== 80+0+0 (secure 0 0 0) 0x7f6708056680 con 0x7f67180acfb0 2024-09-19T05:45:30.308 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:45:30.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 -- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67040678c0 msgr2=0x7f6704069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67040678c0 0x7f6704069d80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f670c0ae000 tx=0x7f670c004ac0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 -- 172.21.15.67:0/1235508495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67180acfb0 msgr2=0x7f6718146130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67180acfb0 0x7f6718146130 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f67080017f0 tx=0x7f670800cbe0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 -- 172.21.15.67:0/1235508495 shutdown_connections 2024-09-19T05:45:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6718159d60 0x7f67180b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67040678c0 0x7f6704069d80 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180b2fd0 0x7f67180b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 --2- 172.21.15.67:0/1235508495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67180acfb0 0x7f6718146130 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 -- 172.21.15.67:0/1235508495 >> 172.21.15.67:0/1235508495 conn(0x7f67180d0080 msgr2=0x7f67180adc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 -- 172.21.15.67:0/1235508495 shutdown_connections 2024-09-19T05:45:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.311+0000 7f671e3ae640 1 -- 172.21.15.67:0/1235508495 wait complete. 2024-09-19T05:45:30.327 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:45:30.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:30.327 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:45:30.339 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[79198]: fuse finished with error 0 and tester_r 0 2024-09-19T05:45:30.415 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:45:30.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:30.416 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:45:30.573 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:45:30.574 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:45:30.574 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:45:30.580 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:45:30.580 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:45:30.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:30.580 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:45:30.629 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:45:30.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:45:30.630 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:45:30.630 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:45:30.630 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:45:30.635 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:45:30.636 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:45:30.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:30.636 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:45:30.683 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:45:30.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:45:30.684 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:45:30.684 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:45:30.684 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:45:30.691 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:45:30.691 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:45:30.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:30.692 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:45:30.737 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:45:30.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:45:30.738 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9cde39640 1 Processor -- start 2024-09-19T05:45:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9cde39640 1 -- start start 2024-09-19T05:45:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9cde39640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb9c806dde0 0x7fb9c80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9cde39640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb9c80b3510 0x7fb9c806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9cde39640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9c806e3c0 con 0x7fb9c815c030 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9cde39640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c806e6a0 con 0x7fb9c806dde0 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9cde39640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c806e980 con 0x7fb9c80b3510 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9bffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb9c806dde0 0x7fb9c80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9c77fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb9c815c030 0x7fb9c815d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45764/0 (socket says 172.21.15.67:45764) 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9c77fe640 1 -- 172.21.15.67:0/375502967 learned_addr learned my addr 172.21.15.67:0/375502967 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9c7fff640 1 --2- 172.21.15.67:0/375502967 >> v2:172.21.15.97:3300/0 conn(0x7fb9c80b3510 0x7fb9c806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9bffff640 1 -- 172.21.15.67:0/375502967 >> v2:172.21.15.97:3300/0 conn(0x7fb9c80b3510 msgr2=0x7fb9c806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9bffff640 1 --2- 172.21.15.67:0/375502967 >> v2:172.21.15.97:3300/0 conn(0x7fb9c80b3510 0x7fb9c806f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9bffff640 1 -- 172.21.15.67:0/375502967 >> v1:172.21.15.67:6789/0 conn(0x7fb9c815c030 legacy=0x7fb9c815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9c6ffd640 1 -- 172.21.15.67:0/375502967 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537693985 0 0) 0x7fb9c806e3c0 con 0x7fb9c815c030 2024-09-19T05:45:30.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9bffff640 1 -- 172.21.15.67:0/375502967 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c806ec60 con 0x7fb9c806dde0 2024-09-19T05:45:30.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.871+0000 7fb9c7fff640 1 --2- 172.21.15.67:0/375502967 >> v2:172.21.15.97:3300/0 conn(0x7fb9c80b3510 0x7fb9c806f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9bffff640 1 --2- 172.21.15.67:0/375502967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 0x7fb9c80b2fd0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80afbf0 tx=0x7fb9b001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b99e026b835043 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c6ffd640 1 -- 172.21.15.67:0/375502967 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00b2070 con 0x7fb9c806dde0 2024-09-19T05:45:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c6ffd640 1 -- 172.21.15.67:0/375502967 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b00a9070 con 0x7fb9c806dde0 2024-09-19T05:45:30.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c6ffd640 1 -- 172.21.15.67:0/375502967 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00ad880 con 0x7fb9c806dde0 2024-09-19T05:45:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 -- 172.21.15.67:0/375502967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 msgr2=0x7fb9c80b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 --2- 172.21.15.67:0/375502967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 0x7fb9c80b2fd0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80afbf0 tx=0x7fb9b001c450 comp rx=0 tx=0).stop 2024-09-19T05:45:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 -- 172.21.15.67:0/375502967 shutdown_connections 2024-09-19T05:45:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 --2- 172.21.15.67:0/375502967 >> v2:172.21.15.97:3300/0 conn(0x7fb9c80b3510 0x7fb9c806f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 --2- 172.21.15.67:0/375502967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 0x7fb9c80b2fd0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 -- 172.21.15.67:0/375502967 >> 172.21.15.67:0/375502967 conn(0x7fb9c80d0080 msgr2=0x7fb9c80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 -- 172.21.15.67:0/375502967 shutdown_connections 2024-09-19T05:45:30.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 -- 172.21.15.67:0/375502967 wait complete. 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 Processor -- start 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 -- start start 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 0x7fb9c81557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9c80b3510 0x7fb9c809c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9c815c030 0x7fb9c80afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81692f0 con 0x7fb9c806dde0 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c815c620 con 0x7fb9c80b3510 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9cde39640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c8169470 con 0x7fb9c815c030 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 0x7fb9c81557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 0x7fb9c81557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40214/0 (socket says 172.21.15.67:40214) 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c77fe640 1 -- 172.21.15.67:0/3981467517 learned_addr learned my addr 172.21.15.67:0/3981467517 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c77fe640 1 -- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9c815c030 msgr2=0x7fb9c80afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c77fe640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9c815c030 0x7fb9c80afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c77fe640 1 -- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9c80b3510 msgr2=0x7fb9c809c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9bffff640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9c80b3510 0x7fb9c809c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c77fe640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9c80b3510 0x7fb9c809c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c77fe640 1 -- 172.21.15.67:0/3981467517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c809e060 con 0x7fb9c806dde0 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c77fe640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 0x7fb9c81557f0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c480 tx=0x7fb9b800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c4ff9640 1 -- 172.21.15.67:0/3981467517 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8018070 con 0x7fb9c806dde0 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.875+0000 7fb9c4ff9640 1 -- 172.21.15.67:0/3981467517 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b8007500 con 0x7fb9c806dde0 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.879+0000 7fb9c4ff9640 1 -- 172.21.15.67:0/3981467517 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8004a30 con 0x7fb9c806dde0 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.879+0000 7fb9cde39640 1 -- 172.21.15.67:0/3981467517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c809cfc0 con 0x7fb9c806dde0 2024-09-19T05:45:30.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.879+0000 7fb9cde39640 1 -- 172.21.15.67:0/3981467517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c809d580 con 0x7fb9c806dde0 2024-09-19T05:45:30.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.879+0000 7fb9cde39640 1 -- 172.21.15.67:0/3981467517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c80b2fd0 con 0x7fb9c806dde0 2024-09-19T05:45:30.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.879+0000 7fb9c4ff9640 1 -- 172.21.15.67:0/3981467517 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9b801b070 con 0x7fb9c806dde0 2024-09-19T05:45:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.879+0000 7fb9c4ff9640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9ac0678c0 0x7fb9ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.879+0000 7fb9c4ff9640 1 -- 172.21.15.67:0/3981467517 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fb9b8085150 con 0x7fb9c806dde0 2024-09-19T05:45:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.879+0000 7fb9bffff640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9ac0678c0 0x7fb9ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.879+0000 7fb9bffff640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9ac0678c0 0x7fb9ac069d80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00af000 tx=0x7fb9b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:30.883+0000 7fb9c4ff9640 1 -- 172.21.15.67:0/3981467517 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb9b8055ad0 con 0x7fb9c806dde0 2024-09-19T05:45:31.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 -- 172.21.15.67:0/3981467517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9c80b41a0 con 0x7fb9c806dde0 2024-09-19T05:45:31.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9c4ff9640 1 -- 172.21.15.67:0/3981467517 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7fb9b80553d0 con 0x7fb9c806dde0 2024-09-19T05:45:31.072 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:31.072 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:31.072 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:31.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 -- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9ac0678c0 msgr2=0x7fb9ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9ac0678c0 0x7fb9ac069d80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00af000 tx=0x7fb9b0008040 comp rx=0 tx=0).stop 2024-09-19T05:45:31.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 -- 172.21.15.67:0/3981467517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 msgr2=0x7fb9c81557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 0x7fb9c81557f0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c480 tx=0x7fb9b800c940 comp rx=0 tx=0).stop 2024-09-19T05:45:31.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 -- 172.21.15.67:0/3981467517 shutdown_connections 2024-09-19T05:45:31.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb9ac0678c0 0x7fb9ac069d80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9c815c030 0x7fb9c80afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9c80b3510 0x7fb9c809c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 --2- 172.21.15.67:0/3981467517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c806dde0 0x7fb9c81557f0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 -- 172.21.15.67:0/3981467517 >> 172.21.15.67:0/3981467517 conn(0x7fb9c80d0080 msgr2=0x7fb9c80b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:31.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 -- 172.21.15.67:0/3981467517 shutdown_connections 2024-09-19T05:45:31.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.075+0000 7fb9cde39640 1 -- 172.21.15.67:0/3981467517 wait complete. 2024-09-19T05:45:31.090 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:31.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff484f6640 1 Processor -- start 2024-09-19T05:45:31.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff484f6640 1 -- start start 2024-09-19T05:45:31.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff484f6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff4015c030 0x7eff4006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff484f6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7eff4015d1d0 0x7eff400b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff484f6640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff4006e3c0 con 0x7eff400b3510 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff484f6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7eff4006e6a0 con 0x7eff4015d1d0 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff484f6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7eff4006e980 con 0x7eff4015c030 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46a93640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7eff400b3510 0x7eff4006f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45768/0 (socket says 172.21.15.67:45768) 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46a93640 1 -- 172.21.15.67:0/2045905830 learned_addr learned my addr 172.21.15.67:0/2045905830 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45a91640 1 --2- 172.21.15.67:0/2045905830 >> v2:172.21.15.97:3300/0 conn(0x7eff4015d1d0 0x7eff400b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46292640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff4015c030 0x7eff4006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090694028 0 0) 0x7eff4006e3c0 con 0x7eff400b3510 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff2c003530 con 0x7eff400b3510 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2159036107 0 0) 0x7eff2c003530 con 0x7eff400b3510 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff4015c030 msgr2=0x7eff4006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff4015c030 0x7eff4006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 >> v2:172.21.15.97:3300/0 conn(0x7eff4015d1d0 msgr2=0x7eff400b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 --2- 172.21.15.67:0/2045905830 >> v2:172.21.15.97:3300/0 conn(0x7eff4015d1d0 0x7eff400b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4006ec60 con 0x7eff400b3510 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7eff38001680 con 0x7eff400b3510 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 >> v1:172.21.15.67:6789/0 conn(0x7eff400b3510 legacy=0x7eff4006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff2c0039c0 0x7eff2c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff4015c030 0x7eff2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 0x7eff2c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff4006e6a0 con 0x7eff2c004d50 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7eff4006e980 con 0x7eff2c0039c0 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7eff2c00b9d0 con 0x7eff4015c030 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46a93640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 0x7eff2c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46292640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff2c0039c0 0x7eff2c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff45a91640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff4015c030 0x7eff2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46a93640 1 -- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff4015c030 msgr2=0x7eff2c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46a93640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff4015c030 0x7eff2c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46a93640 1 -- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff2c0039c0 msgr2=0x7eff2c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46a93640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff2c0039c0 0x7eff2c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46a93640 1 -- 172.21.15.67:0/2045905830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c003530 con 0x7eff2c004d50 2024-09-19T05:45:31.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.207+0000 7eff46292640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff2c0039c0 0x7eff2c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff46a93640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 0x7eff2c0051d0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c210 tx=0x7eff3801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5367b5b5adf7c31d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38007d60 con 0x7eff2c004d50 2024-09-19T05:45:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff380a9020 con 0x7eff2c004d50 2024-09-19T05:45:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff45290640 1 -- 172.21.15.67:0/2045905830 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff380a5be0 con 0x7eff2c004d50 2024-09-19T05:45:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 -- 172.21.15.67:0/2045905830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 msgr2=0x7eff2c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 --2- 172.21.15.67:0/2045905830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 0x7eff2c0051d0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c210 tx=0x7eff3801cca0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff46a93640 1 -- 172.21.15.67:0/2045905830 reap_dead start 2024-09-19T05:45:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 -- 172.21.15.67:0/2045905830 shutdown_connections 2024-09-19T05:45:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 -- 172.21.15.67:0/2045905830 >> 172.21.15.67:0/2045905830 conn(0x7eff400d0080 msgr2=0x7eff400d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 -- 172.21.15.67:0/2045905830 shutdown_connections 2024-09-19T05:45:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 -- 172.21.15.67:0/2045905830 wait complete. 2024-09-19T05:45:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 Processor -- start 2024-09-19T05:45:31.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 -- start start 2024-09-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 0x7eff40155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff4015e0c0 0x7eff4015e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff401f21a0 0x7eff401f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff4006fb70 con 0x7eff2c004d50 2024-09-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7eff4015d630 con 0x7eff4015e0c0 2024-09-19T05:45:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff484f6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7eff4006fcf0 con 0x7eff401f21a0 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff46292640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 0x7eff40155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff46292640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 0x7eff40155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40236/0 (socket says 172.21.15.67:40236) 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.211+0000 7eff46292640 1 -- 172.21.15.67:0/2891879303 learned_addr learned my addr 172.21.15.67:0/2891879303 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff45a91640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff4015e0c0 0x7eff4015e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff46292640 1 -- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff401f21a0 msgr2=0x7eff401f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff46292640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff401f21a0 0x7eff401f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff46292640 1 -- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff4015e0c0 msgr2=0x7eff4015e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff46292640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff4015e0c0 0x7eff4015e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff46292640 1 -- 172.21.15.67:0/2891879303 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff40152f90 con 0x7eff2c004d50 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff46292640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 0x7eff40155940 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009f90 tx=0x7eff3c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff36ffd640 1 -- 172.21.15.67:0/2891879303 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c01a020 con 0x7eff2c004d50 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff36ffd640 1 -- 172.21.15.67:0/2891879303 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c015640 con 0x7eff2c004d50 2024-09-19T05:45:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff484f6640 1 -- 172.21.15.67:0/2891879303 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff40153270 con 0x7eff2c004d50 2024-09-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff36ffd640 1 -- 172.21.15.67:0/2891879303 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c015a30 con 0x7eff2c004d50 2024-09-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff484f6640 1 -- 172.21.15.67:0/2891879303 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff40153830 con 0x7eff2c004d50 2024-09-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff484f6640 1 -- 172.21.15.67:0/2891879303 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff4015c410 con 0x7eff2c004d50 2024-09-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff36ffd640 1 -- 172.21.15.67:0/2891879303 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff3c01d020 con 0x7eff2c004d50 2024-09-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff36ffd640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff240678c0 0x7eff24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff36ffd640 1 -- 172.21.15.67:0/2891879303 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7eff3c086fb0 con 0x7eff2c004d50 2024-09-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff45a91640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff240678c0 0x7eff24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.215+0000 7eff45a91640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff240678c0 0x7eff24069d80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7eff4009a4c0 tx=0x7eff30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:31.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.219+0000 7eff36ffd640 1 -- 172.21.15.67:0/2891879303 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7eff3c024030 con 0x7eff2c004d50 2024-09-19T05:45:31.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.419+0000 7eff484f6640 1 -- 172.21.15.67:0/2891879303 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff400d0f20 con 0x7eff2c004d50 2024-09-19T05:45:31.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.419+0000 7eff36ffd640 1 -- 172.21.15.67:0/2891879303 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7eff3c057930 con 0x7eff2c004d50 2024-09-19T05:45:31.417 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:31.417 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:31.417 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:31.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 -- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff240678c0 msgr2=0x7eff24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff240678c0 0x7eff24069d80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7eff4009a4c0 tx=0x7eff30008040 comp rx=0 tx=0).stop 2024-09-19T05:45:31.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 -- 172.21.15.67:0/2891879303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 msgr2=0x7eff40155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 0x7eff40155940 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009f90 tx=0x7eff3c010590 comp rx=0 tx=0).stop 2024-09-19T05:45:31.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 -- 172.21.15.67:0/2891879303 shutdown_connections 2024-09-19T05:45:31.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff240678c0 0x7eff24069d80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff401f21a0 0x7eff401f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff4015e0c0 0x7eff4015e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 --2- 172.21.15.67:0/2891879303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff2c004d50 0x7eff40155940 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 -- 172.21.15.67:0/2891879303 >> 172.21.15.67:0/2891879303 conn(0x7eff400d0080 msgr2=0x7eff400acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:31.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 -- 172.21.15.67:0/2891879303 shutdown_connections 2024-09-19T05:45:31.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.423+0000 7eff484f6640 1 -- 172.21.15.67:0/2891879303 wait complete. 2024-09-19T05:45:31.437 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:45:31.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.559+0000 7efeabe8f640 1 Processor -- start 2024-09-19T05:45:31.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.559+0000 7efeabe8f640 1 -- start start 2024-09-19T05:45:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeabe8f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea40b03a0 0x7efea40b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeabe8f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efea40b1140 con 0x7efea406bcc0 2024-09-19T05:45:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeabe8f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efea40b1420 con 0x7efea4145e10 2024-09-19T05:45:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeabe8f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efea41461f0 con 0x7efea40b03a0 2024-09-19T05:45:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeaa42c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7efea406bcc0 0x7efea40b21e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45772/0 (socket says 172.21.15.67:45772) 2024-09-19T05:45:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeaa42c640 1 -- 172.21.15.67:0/1984388995 learned_addr learned my addr 172.21.15.67:0/1984388995 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:31.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453690610 0 0) 0x7efea40b1140 con 0x7efea406bcc0 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe90003530 con 0x7efea406bcc0 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea942a640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea40b03a0 0x7efea40b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1114659187 0 0) 0x7efe90003530 con 0x7efea406bcc0 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea40b03a0 msgr2=0x7efea40b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea40b03a0 0x7efea40b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 >> v1:172.21.15.97:6789/0 conn(0x7efea4145e10 legacy=0x7efea415c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea40b1700 con 0x7efea406bcc0 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7efe9c001a00 con 0x7efea406bcc0 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 >> v1:172.21.15.67:6789/0 conn(0x7efea406bcc0 legacy=0x7efea40b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe900039f0 0x7efe90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea40b03a0 0x7efe90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe90004d50 0x7efe900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efea41461f0 con 0x7efe90004d50 2024-09-19T05:45:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efe9000bab0 con 0x7efe900039f0 2024-09-19T05:45:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efe9000bcb0 con 0x7efea40b03a0 2024-09-19T05:45:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeaa42c640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe90004d50 0x7efe900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea9c2b640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe900039f0 0x7efe90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efea942a640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea40b03a0 0x7efe90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeaa42c640 1 -- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea40b03a0 msgr2=0x7efe90004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeaa42c640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea40b03a0 0x7efe90004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeaa42c640 1 -- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe900039f0 msgr2=0x7efe90003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeaa42c640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe900039f0 0x7efe90003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.563+0000 7efeaa42c640 1 -- 172.21.15.67:0/1984388995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe90003530 con 0x7efe90004d50 2024-09-19T05:45:31.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe90004d50 0x7efe900051d0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7efe9c002240 tx=0x7efe9c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d97d1699e25fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:31.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00a4a0 con 0x7efe90004d50 2024-09-19T05:45:31.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe9c0ad650 con 0x7efe90004d50 2024-09-19T05:45:31.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efea8c29640 1 -- 172.21.15.67:0/1984388995 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0ada40 con 0x7efe90004d50 2024-09-19T05:45:31.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 -- 172.21.15.67:0/1984388995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe90004d50 msgr2=0x7efe900051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 --2- 172.21.15.67:0/1984388995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe90004d50 0x7efe900051d0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7efe9c002240 tx=0x7efe9c01d360 comp rx=0 tx=0).stop 2024-09-19T05:45:31.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 -- 172.21.15.67:0/1984388995 reap_dead start 2024-09-19T05:45:31.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 -- 172.21.15.67:0/1984388995 shutdown_connections 2024-09-19T05:45:31.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 -- 172.21.15.67:0/1984388995 >> 172.21.15.67:0/1984388995 conn(0x7efea409aa30 msgr2=0x7efea40b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 -- 172.21.15.67:0/1984388995 shutdown_connections 2024-09-19T05:45:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 -- 172.21.15.67:0/1984388995 wait complete. 2024-09-19T05:45:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 Processor -- start 2024-09-19T05:45:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 -- start start 2024-09-19T05:45:31.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea4139a00 0x7efea40b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea40b5a90 0x7efea4141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea413e630 0x7efea413eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efea40b07e0 con 0x7efea413e630 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efea40b0dd0 con 0x7efea40b5a90 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeabe8f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efea40b0960 con 0x7efea4139a00 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea413e630 0x7efea413eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea413e630 0x7efea413eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40248/0 (socket says 172.21.15.67:40248) 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 -- 172.21.15.67:0/1321979416 learned_addr learned my addr 172.21.15.67:0/1321979416 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efea9c2b640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea4139a00 0x7efea40b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efea942a640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea40b5a90 0x7efea4141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 -- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea4139a00 msgr2=0x7efea40b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea4139a00 0x7efea40b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 -- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea40b5a90 msgr2=0x7efea4141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea40b5a90 0x7efea4141460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 -- 172.21.15.67:0/1321979416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea413f000 con 0x7efea413e630 2024-09-19T05:45:31.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efea942a640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea40b5a90 0x7efea4141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efeaa42c640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea413e630 0x7efea413eac0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7efe9c01dc00 tx=0x7efe90005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.567+0000 7efe9a7fc640 1 -- 172.21.15.67:0/1321979416 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0bc070 con 0x7efea413e630 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.571+0000 7efe9a7fc640 1 -- 172.21.15.67:0/1321979416 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe9c00a480 con 0x7efea413e630 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.571+0000 7efe9a7fc640 1 -- 172.21.15.67:0/1321979416 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0011d0 con 0x7efea413e630 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.571+0000 7efeabe8f640 1 -- 172.21.15.67:0/1321979416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea40b49f0 con 0x7efea413e630 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.571+0000 7efeabe8f640 1 -- 172.21.15.67:0/1321979416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea40b4fb0 con 0x7efea413e630 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.571+0000 7efeabe8f640 1 -- 172.21.15.67:0/1321979416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea406c150 con 0x7efea413e630 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.571+0000 7efe9a7fc640 1 -- 172.21.15.67:0/1321979416 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe9c0bf070 con 0x7efea413e630 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.571+0000 7efe9a7fc640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efe880678c0 0x7efe88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.571+0000 7efe9a7fc640 1 -- 172.21.15.67:0/1321979416 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7efe9c11fcb0 con 0x7efea413e630 2024-09-19T05:45:31.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.571+0000 7efea9c2b640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efe880678c0 0x7efe88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.571+0000 7efea9c2b640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efe880678c0 0x7efe88069d80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7efea0007fd0 tx=0x7efea0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:31.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.575+0000 7efe9a7fc640 1 -- 172.21.15.67:0/1321979416 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7efe9c017070 con 0x7efea413e630 2024-09-19T05:45:31.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.735+0000 7efeabe8f640 1 -- 172.21.15.67:0/1321979416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efea409bbb0 con 0x7efea413e630 2024-09-19T05:45:31.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.735+0000 7efe9a7fc640 1 -- 172.21.15.67:0/1321979416 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+17074 (secure 0 0 0) 0x7efe9c0f0070 con 0x7efea413e630 2024-09-19T05:45:31.733 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:31.733 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":157,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:44:59.424514+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:44:44.010860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-19T05:44:45.332354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.37","mappings":[{"from":3,"to":0}]},{"pgid":"22.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:45:31.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 -- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efe880678c0 msgr2=0x7efe88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efe880678c0 0x7efe88069d80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7efea0007fd0 tx=0x7efea0009040 comp rx=0 tx=0).stop 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 -- 172.21.15.67:0/1321979416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea413e630 msgr2=0x7efea413eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea413e630 0x7efea413eac0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7efe9c01dc00 tx=0x7efe90005840 comp rx=0 tx=0).stop 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 -- 172.21.15.67:0/1321979416 shutdown_connections 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efea413e630 0x7efea413eac0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea40b5a90 0x7efea4141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efe880678c0 0x7efe88069d80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 --2- 172.21.15.67:0/1321979416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efea4139a00 0x7efea40b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 -- 172.21.15.67:0/1321979416 >> 172.21.15.67:0/1321979416 conn(0x7efea409aa30 msgr2=0x7efea409b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 -- 172.21.15.67:0/1321979416 shutdown_connections 2024-09-19T05:45:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.739+0000 7efeabe8f640 1 -- 172.21.15.67:0/1321979416 wait complete. 2024-09-19T05:45:31.752 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:45:31.752 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff309bcd640 1 Processor -- start 2024-09-19T05:45:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff309bcd640 1 -- start start 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff309bcd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff30415b710 0x7ff304071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff309bcd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff30415baf0 0x7ff30415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff309bcd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3040b3070 con 0x7ff3040aef40 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff309bcd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff3040b32e0 con 0x7ff30415baf0 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff309bcd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff3040b35c0 con 0x7ff30415b710 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff302ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff30415baf0 0x7ff30415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff302ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff30415baf0 0x7ff30415bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40262/0 (socket says 172.21.15.67:40262) 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff302ffd640 1 -- 172.21.15.67:0/997961369 learned_addr learned my addr 172.21.15.67:0/997961369 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.875+0000 7ff303fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff3040aef40 0x7ff3040af360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45786/0 (socket says 172.21.15.67:45786) 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff3037fe640 1 --2- 172.21.15.67:0/997961369 >> v2:172.21.15.97:3300/0 conn(0x7ff30415b710 0x7ff304071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff302ffd640 1 -- 172.21.15.67:0/997961369 >> v2:172.21.15.97:3300/0 conn(0x7ff30415b710 msgr2=0x7ff304071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff302ffd640 1 --2- 172.21.15.67:0/997961369 >> v2:172.21.15.97:3300/0 conn(0x7ff30415b710 0x7ff304071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff302ffd640 1 -- 172.21.15.67:0/997961369 >> v1:172.21.15.67:6789/0 conn(0x7ff3040aef40 legacy=0x7ff3040af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff3027fc640 1 -- 172.21.15.67:0/997961369 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611283973 0 0) 0x7ff3040b3070 con 0x7ff3040aef40 2024-09-19T05:45:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff302ffd640 1 -- 172.21.15.67:0/997961369 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3040afa70 con 0x7ff30415baf0 2024-09-19T05:45:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff302ffd640 1 --2- 172.21.15.67:0/997961369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415baf0 0x7ff30415bf60 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ff3040717a0 tx=0x7ff2f801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f3b516a620a652 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:31.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff3027fc640 1 -- 172.21.15.67:0/997961369 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80aa650 con 0x7ff30415baf0 2024-09-19T05:45:31.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff3027fc640 1 -- 172.21.15.67:0/997961369 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f80af070 con 0x7ff30415baf0 2024-09-19T05:45:31.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff3027fc640 1 -- 172.21.15.67:0/997961369 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80aaa10 con 0x7ff30415baf0 2024-09-19T05:45:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff309bcd640 1 -- 172.21.15.67:0/997961369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415baf0 msgr2=0x7ff30415bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff309bcd640 1 --2- 172.21.15.67:0/997961369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415baf0 0x7ff30415bf60 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ff3040717a0 tx=0x7ff2f801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff309bcd640 1 -- 172.21.15.67:0/997961369 shutdown_connections 2024-09-19T05:45:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff309bcd640 1 --2- 172.21.15.67:0/997961369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415baf0 0x7ff30415bf60 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff309bcd640 1 --2- 172.21.15.67:0/997961369 >> v2:172.21.15.97:3300/0 conn(0x7ff30415b710 0x7ff304071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff309bcd640 1 -- 172.21.15.67:0/997961369 >> 172.21.15.67:0/997961369 conn(0x7ff3040d0080 msgr2=0x7ff3040d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff309bcd640 1 -- 172.21.15.67:0/997961369 shutdown_connections 2024-09-19T05:45:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.879+0000 7ff309bcd640 1 -- 172.21.15.67:0/997961369 wait complete. 2024-09-19T05:45:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 Processor -- start 2024-09-19T05:45:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 -- start start 2024-09-19T05:45:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3040aef40 0x7ff30414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415b710 0x7ff30414cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff30415baf0 0x7ff30414d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3040b4a30 con 0x7ff30415b710 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff3040b48b0 con 0x7ff3040aef40 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff3040b4bb0 con 0x7ff30415baf0 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff302ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415b710 0x7ff30414cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff302ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415b710 0x7ff30414cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40268/0 (socket says 172.21.15.67:40268) 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff302ffd640 1 -- 172.21.15.67:0/382438118 learned_addr learned my addr 172.21.15.67:0/382438118 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff302ffd640 1 -- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff30415baf0 msgr2=0x7ff30414d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff302ffd640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff30415baf0 0x7ff30414d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff302ffd640 1 -- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3040aef40 msgr2=0x7ff30414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff302ffd640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3040aef40 0x7ff30414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff302ffd640 1 -- 172.21.15.67:0/382438118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30414ba30 con 0x7ff30415b710 2024-09-19T05:45:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff302ffd640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415b710 0x7ff30414cad0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff2f801aba0 tx=0x7ff2f801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff2ebfff640 1 -- 172.21.15.67:0/382438118 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b9070 con 0x7ff30415b710 2024-09-19T05:45:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff2ebfff640 1 -- 172.21.15.67:0/382438118 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f80a6040 con 0x7ff30415b710 2024-09-19T05:45:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 -- 172.21.15.67:0/382438118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30414bd10 con 0x7ff30415b710 2024-09-19T05:45:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff2ebfff640 1 -- 172.21.15.67:0/382438118 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8004420 con 0x7ff30415b710 2024-09-19T05:45:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 -- 172.21.15.67:0/382438118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30414c2d0 con 0x7ff30415b710 2024-09-19T05:45:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff309bcd640 1 -- 172.21.15.67:0/382438118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff304071e80 con 0x7ff30415b710 2024-09-19T05:45:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff2ebfff640 1 -- 172.21.15.67:0/382438118 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2f80aa990 con 0x7ff30415b710 2024-09-19T05:45:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff2ebfff640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2f00678c0 0x7ff2f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff2ebfff640 1 -- 172.21.15.67:0/382438118 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7ff2f811f9f0 con 0x7ff30415b710 2024-09-19T05:45:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.883+0000 7ff3037fe640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2f00678c0 0x7ff2f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.887+0000 7ff3037fe640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2f00678c0 0x7ff2f0069d80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0070b0 tx=0x7ff2fc007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:31.887+0000 7ff2ebfff640 1 -- 172.21.15.67:0/382438118 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff2f80c4070 con 0x7ff30415b710 2024-09-19T05:45:32.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.091+0000 7ff309bcd640 1 -- 172.21.15.67:0/382438118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff30406ce60 con 0x7ff30415b710 2024-09-19T05:45:32.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.091+0000 7ff2ebfff640 1 -- 172.21.15.67:0/382438118 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7ff2f80f6020 con 0x7ff30415b710 2024-09-19T05:45:32.090 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:32.090 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 -- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2f00678c0 msgr2=0x7ff2f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2f00678c0 0x7ff2f0069d80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0070b0 tx=0x7ff2fc007040 comp rx=0 tx=0).stop 2024-09-19T05:45:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 -- 172.21.15.67:0/382438118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415b710 msgr2=0x7ff30414cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415b710 0x7ff30414cad0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff2f801aba0 tx=0x7ff2f801ad30 comp rx=0 tx=0).stop 2024-09-19T05:45:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 -- 172.21.15.67:0/382438118 shutdown_connections 2024-09-19T05:45:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2f00678c0 0x7ff2f0069d80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff30415baf0 0x7ff30414d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30415b710 0x7ff30414cad0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 --2- 172.21.15.67:0/382438118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3040aef40 0x7ff30414e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 -- 172.21.15.67:0/382438118 >> 172.21.15.67:0/382438118 conn(0x7ff3040d0080 msgr2=0x7ff3040ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:32.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 -- 172.21.15.67:0/382438118 shutdown_connections 2024-09-19T05:45:32.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.095+0000 7ff309bcd640 1 -- 172.21.15.67:0/382438118 wait complete. 2024-09-19T05:45:32.108 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:32.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a3cfb640 1 Processor -- start 2024-09-19T05:45:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a3cfb640 1 -- start start 2024-09-19T05:45:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a3cfb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa19c0726b0 0x7fa19c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a3cfb640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa19c0b4420 con 0x7fa19c15e330 2024-09-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a3cfb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa19c0b4140 con 0x7fa19c0b2fd0 2024-09-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a3cfb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa19c0acfb0 con 0x7fa19c0726b0 2024-09-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a2298640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa19c0726b0 0x7fa19c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a1a97640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa19c15e330 0x7fa19c071fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45798/0 (socket says 172.21.15.67:45798) 2024-09-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a1a97640 1 -- 172.21.15.67:0/3087664633 learned_addr learned my addr 172.21.15.67:0/3087664633 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a2298640 1 -- 172.21.15.67:0/3087664633 >> v1:172.21.15.97:6789/0 conn(0x7fa19c0b2fd0 legacy=0x7fa19c06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a2298640 1 -- 172.21.15.67:0/3087664633 >> v1:172.21.15.67:6789/0 conn(0x7fa19c15e330 legacy=0x7fa19c071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a2298640 1 -- 172.21.15.67:0/3087664633 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19c06def0 con 0x7fa19c0726b0 2024-09-19T05:45:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.223+0000 7fa1a0a95640 1 -- 172.21.15.67:0/3087664633 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457349932 0 0) 0x7fa19c0b4420 con 0x7fa19c15e330 2024-09-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a2298640 1 --2- 172.21.15.67:0/3087664633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c0726b0 0x7fa19c06ee00 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fa194009d90 tx=0x7fa19401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52fb60fa9f84c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a0a95640 1 -- 172.21.15.67:0/3087664633 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1940b2070 con 0x7fa19c0726b0 2024-09-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a0a95640 1 -- 172.21.15.67:0/3087664633 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1940a5900 con 0x7fa19c0726b0 2024-09-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a0a95640 1 -- 172.21.15.67:0/3087664633 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1940a5cd0 con 0x7fa19c0726b0 2024-09-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/3087664633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c0726b0 msgr2=0x7fa19c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 --2- 172.21.15.67:0/3087664633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c0726b0 0x7fa19c06ee00 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fa194009d90 tx=0x7fa19401c930 comp rx=0 tx=0).stop 2024-09-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/3087664633 shutdown_connections 2024-09-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 --2- 172.21.15.67:0/3087664633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c0726b0 0x7fa19c06ee00 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/3087664633 >> 172.21.15.67:0/3087664633 conn(0x7fa19c0d0080 msgr2=0x7fa19c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/3087664633 shutdown_connections 2024-09-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/3087664633 wait complete. 2024-09-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 Processor -- start 2024-09-19T05:45:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- start start 2024-09-19T05:45:32.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c0726b0 0x7fa19c0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15e330 0x7fa19c146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c1470e0 0x7fa19c14bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c0cfe40 con 0x7fa19c1470e0 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c0cfcc0 con 0x7fa19c15e330 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa19c16cb30 con 0x7fa19c0726b0 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a2298640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c1470e0 0x7fa19c14bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a2298640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c1470e0 0x7fa19c14bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40280/0 (socket says 172.21.15.67:40280) 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a2298640 1 -- 172.21.15.67:0/1152158230 learned_addr learned my addr 172.21.15.67:0/1152158230 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a1a97640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c0726b0 0x7fa19c0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a1296640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15e330 0x7fa19c146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a2298640 1 -- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c0726b0 msgr2=0x7fa19c0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a2298640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c0726b0 0x7fa19c0af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a2298640 1 -- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15e330 msgr2=0x7fa19c146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a2298640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15e330 0x7fa19c146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a2298640 1 -- 172.21.15.67:0/1152158230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19c1478f0 con 0x7fa19c1470e0 2024-09-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a1296640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15e330 0x7fa19c146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a2298640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c1470e0 0x7fa19c14bb70 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fa1940b0040 tx=0x7fa1940196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa18e7fc640 1 -- 172.21.15.67:0/1152158230 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1940b2040 con 0x7fa19c1470e0 2024-09-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa18e7fc640 1 -- 172.21.15.67:0/1152158230 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1940bf070 con 0x7fa19c1470e0 2024-09-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/1152158230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19c0add20 con 0x7fa19c1470e0 2024-09-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa18e7fc640 1 -- 172.21.15.67:0/1152158230 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1940ad940 con 0x7fa19c1470e0 2024-09-19T05:45:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.227+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/1152158230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19c0aeac0 con 0x7fa19c1470e0 2024-09-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.231+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/1152158230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa19c071fa0 con 0x7fa19c1470e0 2024-09-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.231+0000 7fa18e7fc640 1 -- 172.21.15.67:0/1152158230 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1940adae0 con 0x7fa19c1470e0 2024-09-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.231+0000 7fa18e7fc640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1800678c0 0x7fa180069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.231+0000 7fa18e7fc640 1 -- 172.21.15.67:0/1152158230 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7fa1941210e0 con 0x7fa19c1470e0 2024-09-19T05:45:32.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.231+0000 7fa1a1a97640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1800678c0 0x7fa180069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.231+0000 7fa1a1a97640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1800678c0 0x7fa180069d80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa198000f70 tx=0x7fa198007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.235+0000 7fa18e7fc640 1 -- 172.21.15.67:0/1152158230 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa194016520 con 0x7fa19c1470e0 2024-09-19T05:45:32.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.423+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/1152158230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa19c161ce0 con 0x7fa19c1470e0 2024-09-19T05:45:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa18e7fc640 1 -- 172.21.15.67:0/1152158230 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7fa1940f1b80 con 0x7fa19c1470e0 2024-09-19T05:45:32.423 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:32.424 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":106,"btime":"2024-09-19T05:44:50:211150+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:44:46.335183+0000","modified":"2024-09-19T05:44:49.571001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9066},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9066":{"gid":9066,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2824250574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2824250574},{"type":"v1","addr":"172.21.15.97:6835","nonce":2824250574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9066,"qdb_cluster":[9066]},"id":10}]} 2024-09-19T05:45:32.424 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 106 2024-09-19T05:45:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1800678c0 msgr2=0x7fa180069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1800678c0 0x7fa180069d80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa198000f70 tx=0x7fa198007c10 comp rx=0 tx=0).stop 2024-09-19T05:45:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/1152158230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c1470e0 msgr2=0x7fa19c14bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c1470e0 0x7fa19c14bb70 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fa1940b0040 tx=0x7fa1940196d0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/1152158230 shutdown_connections 2024-09-19T05:45:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19c1470e0 0x7fa19c14bb70 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19c15e330 0x7fa19c146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1800678c0 0x7fa180069d80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 --2- 172.21.15.67:0/1152158230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19c0726b0 0x7fa19c0af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/1152158230 >> 172.21.15.67:0/1152158230 conn(0x7fa19c0d0080 msgr2=0x7fa19c15b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:32.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/1152158230 shutdown_connections 2024-09-19T05:45:32.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.427+0000 7fa1a3cfb640 1 -- 172.21.15.67:0/1152158230 wait complete. 2024-09-19T05:45:32.441 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:45:32.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.555+0000 7feb6bb16640 1 Processor -- start 2024-09-19T05:45:32.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.555+0000 7feb6bb16640 1 -- start start 2024-09-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb6bb16640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feb640c8c40 0x7feb640705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb6bb16640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7feb6415d290 0x7feb6409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb6bb16640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb640c7130 con 0x7feb6409af70 2024-09-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb6bb16640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7feb6409b3e0 con 0x7feb640c8c40 2024-09-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb6bb16640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7feb64070b90 con 0x7feb6415d290 2024-09-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb6a0b3640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7feb6409af70 0x7feb64159550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45812/0 (socket says 172.21.15.67:45812) 2024-09-19T05:45:32.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb698b2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feb640c8c40 0x7feb640705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb6a0b3640 1 -- 172.21.15.67:0/2413433694 learned_addr learned my addr 172.21.15.67:0/2413433694 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb690b1640 1 --2- 172.21.15.67:0/2413433694 >> v2:172.21.15.97:3300/0 conn(0x7feb6415d290 0x7feb6409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb698b2640 1 -- 172.21.15.67:0/2413433694 >> v2:172.21.15.97:3300/0 conn(0x7feb6415d290 msgr2=0x7feb6409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb698b2640 1 --2- 172.21.15.67:0/2413433694 >> v2:172.21.15.97:3300/0 conn(0x7feb6415d290 0x7feb6409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb698b2640 1 -- 172.21.15.67:0/2413433694 >> v1:172.21.15.67:6789/0 conn(0x7feb6409af70 legacy=0x7feb64159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb698b2640 1 -- 172.21.15.67:0/2413433694 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb64070e70 con 0x7feb640c8c40 2024-09-19T05:45:32.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb688b0640 1 -- 172.21.15.67:0/2413433694 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131340858 0 0) 0x7feb640c7130 con 0x7feb6409af70 2024-09-19T05:45:32.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb698b2640 1 --2- 172.21.15.67:0/2413433694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb640c8c40 0x7feb640705b0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7feb6409be90 tx=0x7feb6001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7408bd2683531fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb688b0640 1 -- 172.21.15.67:0/2413433694 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600b0070 con 0x7feb640c8c40 2024-09-19T05:45:32.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb688b0640 1 -- 172.21.15.67:0/2413433694 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb600ab600 con 0x7feb640c8c40 2024-09-19T05:45:32.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.559+0000 7feb688b0640 1 -- 172.21.15.67:0/2413433694 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600ab9d0 con 0x7feb640c8c40 2024-09-19T05:45:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- 172.21.15.67:0/2413433694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb640c8c40 msgr2=0x7feb640705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 --2- 172.21.15.67:0/2413433694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb640c8c40 0x7feb640705b0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7feb6409be90 tx=0x7feb6001c480 comp rx=0 tx=0).stop 2024-09-19T05:45:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- 172.21.15.67:0/2413433694 shutdown_connections 2024-09-19T05:45:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 --2- 172.21.15.67:0/2413433694 >> v2:172.21.15.97:3300/0 conn(0x7feb6415d290 0x7feb6409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 --2- 172.21.15.67:0/2413433694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb640c8c40 0x7feb640705b0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- 172.21.15.67:0/2413433694 >> 172.21.15.67:0/2413433694 conn(0x7feb640d22b0 msgr2=0x7feb640d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:32.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- 172.21.15.67:0/2413433694 shutdown_connections 2024-09-19T05:45:32.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- 172.21.15.67:0/2413433694 wait complete. 2024-09-19T05:45:32.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 Processor -- start 2024-09-19T05:45:32.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- start start 2024-09-19T05:45:32.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb6409af70 0x7feb641604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feb640c8c40 0x7feb64154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feb6415d290 0x7feb6415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feb6415a070 con 0x7feb6409af70 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7feb6415d670 con 0x7feb6415d290 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7feb6415a1f0 con 0x7feb640c8c40 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb698b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb6409af70 0x7feb641604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb698b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb6409af70 0x7feb641604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40300/0 (socket says 172.21.15.67:40300) 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb698b2640 1 -- 172.21.15.67:0/1373446120 learned_addr learned my addr 172.21.15.67:0/1373446120 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6a0b3640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feb6415d290 0x7feb6415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb698b2640 1 -- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feb640c8c40 msgr2=0x7feb64154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb698b2640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feb640c8c40 0x7feb64154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb698b2640 1 -- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feb6415d290 msgr2=0x7feb6415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb698b2640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feb6415d290 0x7feb6415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb698b2640 1 -- 172.21.15.67:0/1373446120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb641609e0 con 0x7feb6409af70 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6a0b3640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feb6415d290 0x7feb6415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:32.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb698b2640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb6409af70 0x7feb641604a0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7feb600ae040 tx=0x7feb6001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb5a7fc640 1 -- 172.21.15.67:0/1373446120 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600b0050 con 0x7feb6409af70 2024-09-19T05:45:32.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb5a7fc640 1 -- 172.21.15.67:0/1373446120 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb600bc070 con 0x7feb6409af70 2024-09-19T05:45:32.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- 172.21.15.67:0/1373446120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb64155650 con 0x7feb6409af70 2024-09-19T05:45:32.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb5a7fc640 1 -- 172.21.15.67:0/1373446120 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600b5a70 con 0x7feb6409af70 2024-09-19T05:45:32.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.563+0000 7feb6bb16640 1 -- 172.21.15.67:0/1373446120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb64155c10 con 0x7feb6409af70 2024-09-19T05:45:32.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.567+0000 7feb6bb16640 1 -- 172.21.15.67:0/1373446120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb640705b0 con 0x7feb6409af70 2024-09-19T05:45:32.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.567+0000 7feb5a7fc640 1 -- 172.21.15.67:0/1373446120 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb600ab4c0 con 0x7feb6409af70 2024-09-19T05:45:32.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.567+0000 7feb5a7fc640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb480678c0 0x7feb48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.567+0000 7feb5a7fc640 1 -- 172.21.15.67:0/1373446120 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7feb601206c0 con 0x7feb6409af70 2024-09-19T05:45:32.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.567+0000 7feb690b1640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb480678c0 0x7feb48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.567+0000 7feb690b1640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb480678c0 0x7feb48069d80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7feb6406a170 tx=0x7feb54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.571+0000 7feb5a7fc640 1 -- 172.21.15.67:0/1373446120 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7feb641609e0 con 0x7feb6409af70 2024-09-19T05:45:32.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.727+0000 7feb6bb16640 1 -- 172.21.15.67:0/1373446120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb6415cde0 con 0x7feb6409af70 2024-09-19T05:45:32.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.731+0000 7feb5a7fc640 1 -- 172.21.15.67:0/1373446120 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+17074 (secure 0 0 0) 0x7feb60016070 con 0x7feb6409af70 2024-09-19T05:45:32.729 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:32.729 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":157,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:44:59.424514+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:44:44.010860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-19T05:44:45.332354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.37","mappings":[{"from":3,"to":0}]},{"pgid":"22.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:45:32.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 -- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb480678c0 msgr2=0x7feb48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb480678c0 0x7feb48069d80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7feb6406a170 tx=0x7feb54008040 comp rx=0 tx=0).stop 2024-09-19T05:45:32.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 -- 172.21.15.67:0/1373446120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb6409af70 msgr2=0x7feb641604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb6409af70 0x7feb641604a0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7feb600ae040 tx=0x7feb6001acc0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 -- 172.21.15.67:0/1373446120 shutdown_connections 2024-09-19T05:45:32.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feb6415d290 0x7feb6415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7feb480678c0 0x7feb48069d80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feb640c8c40 0x7feb64154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 --2- 172.21.15.67:0/1373446120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb6409af70 0x7feb641604a0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 -- 172.21.15.67:0/1373446120 >> 172.21.15.67:0/1373446120 conn(0x7feb640d22b0 msgr2=0x7feb640b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:32.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 -- 172.21.15.67:0/1373446120 shutdown_connections 2024-09-19T05:45:32.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.735+0000 7feb6bb16640 1 -- 172.21.15.67:0/1373446120 wait complete. 2024-09-19T05:45:32.747 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:45:32.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.867+0000 7f93209d4640 1 Processor -- start 2024-09-19T05:45:32.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.867+0000 7f93209d4640 1 -- start start 2024-09-19T05:45:32.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f93209d4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f931c06ed80 0x7f931c165840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f93209d4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931c0730e0 con 0x7f931c0af730 2024-09-19T05:45:32.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f93209d4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931c0733c0 con 0x7f931c15a920 2024-09-19T05:45:32.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f93209d4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f931c0ad8c0 con 0x7f931c06ed80 2024-09-19T05:45:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f9319d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f931c0af730 0x7f931c06e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45822/0 (socket says 172.21.15.67:45822) 2024-09-19T05:45:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f9319d9b640 1 -- 172.21.15.67:0/2456235620 learned_addr learned my addr 172.21.15.67:0/2456235620 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931ad9d640 1 --2- 172.21.15.67:0/2456235620 >> v2:172.21.15.97:3300/0 conn(0x7f931c06ed80 0x7f931c165840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894753778 0 0) 0x7f931c0730e0 con 0x7f931c0af730 2024-09-19T05:45:32.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9304003530 con 0x7f931c0af730 2024-09-19T05:45:32.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3051698955 0 0) 0x7f9304003530 con 0x7f931c0af730 2024-09-19T05:45:32.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 >> v2:172.21.15.97:3300/0 conn(0x7f931c06ed80 msgr2=0x7f931c165840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:32.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 --2- 172.21.15.67:0/2456235620 >> v2:172.21.15.97:3300/0 conn(0x7f931c06ed80 0x7f931c165840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 >> v1:172.21.15.97:6789/0 conn(0x7f931c15a920 legacy=0x7f931c072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c0adba0 con 0x7f931c0af730 2024-09-19T05:45:32.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9310001680 con 0x7f931c0af730 2024-09-19T05:45:32.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 >> v1:172.21.15.67:6789/0 conn(0x7f931c0af730 legacy=0x7f931c06e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93040039c0 0x7f9304003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9304004810 0x7f9304004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93040051d0 0x7f930400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f931c0ad8c0 con 0x7f93040039c0 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f930400c070 con 0x7f93040051d0 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f930400c270 con 0x7f9304004810 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931a59c640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93040039c0 0x7f9304003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931ad9d640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93040051d0 0x7f930400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f9319d9b640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9304004810 0x7f9304004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931a59c640 1 -- 172.21.15.67:0/2456235620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9304004810 msgr2=0x7f9304004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931a59c640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9304004810 0x7f9304004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931a59c640 1 -- 172.21.15.67:0/2456235620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93040051d0 msgr2=0x7f930400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931a59c640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93040051d0 0x7f930400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931a59c640 1 -- 172.21.15.67:0/2456235620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9304003530 con 0x7f93040039c0 2024-09-19T05:45:32.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.871+0000 7f931ad9d640 1 -- 172.21.15.67:0/2456235620 reap_dead start 2024-09-19T05:45:32.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f931a59c640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93040039c0 0x7f9304003de0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f930c001780 tx=0x7f930c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4f6aea30ac4fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c0013a0 con 0x7f93040039c0 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930c0052f0 con 0x7f93040039c0 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f931959a640 1 -- 172.21.15.67:0/2456235620 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c003840 con 0x7f93040039c0 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 -- 172.21.15.67:0/2456235620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93040039c0 msgr2=0x7f9304003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93040039c0 0x7f9304003de0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f930c001780 tx=0x7f930c01c400 comp rx=0 tx=0).stop 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 -- 172.21.15.67:0/2456235620 shutdown_connections 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 --2- 172.21.15.67:0/2456235620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93040039c0 0x7f9304003de0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 -- 172.21.15.67:0/2456235620 >> 172.21.15.67:0/2456235620 conn(0x7f931c0d0080 msgr2=0x7f931c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 -- 172.21.15.67:0/2456235620 shutdown_connections 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 -- 172.21.15.67:0/2456235620 wait complete. 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 Processor -- start 2024-09-19T05:45:32.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 -- start start 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93040039c0 0x7f931c06bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c1592f0 0x7f931c1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c1515f0 0x7f931c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f931c06e5f0 con 0x7f931c1592f0 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f931c072e60 con 0x7f93040039c0 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f93209d4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f931c06e770 con 0x7f931c1515f0 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f9319d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c1592f0 0x7f931c1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f9319d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c1592f0 0x7f931c1510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40318/0 (socket says 172.21.15.67:40318) 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f9319d9b640 1 -- 172.21.15.67:0/1082682321 learned_addr learned my addr 172.21.15.67:0/1082682321 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f931a59c640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93040039c0 0x7f931c06bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f931ad9d640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c1515f0 0x7f931c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f9319d9b640 1 -- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c1515f0 msgr2=0x7f931c15c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f9319d9b640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c1515f0 0x7f931c15c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f9319d9b640 1 -- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93040039c0 msgr2=0x7f931c06bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f9319d9b640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93040039c0 0x7f931c06bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f9319d9b640 1 -- 172.21.15.67:0/1082682321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c15b260 con 0x7f931c1592f0 2024-09-19T05:45:32.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f9319d9b640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c1592f0 0x7f931c1510b0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f9310007fd0 tx=0x7f931000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f930affd640 1 -- 172.21.15.67:0/1082682321 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310019070 con 0x7f931c1592f0 2024-09-19T05:45:32.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f930affd640 1 -- 172.21.15.67:0/1082682321 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93100072d0 con 0x7f931c1592f0 2024-09-19T05:45:32.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.875+0000 7f930affd640 1 -- 172.21.15.67:0/1082682321 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93100047f0 con 0x7f931c1592f0 2024-09-19T05:45:32.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.879+0000 7f93209d4640 1 -- 172.21.15.67:0/1082682321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c15b540 con 0x7f931c1592f0 2024-09-19T05:45:32.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.879+0000 7f93209d4640 1 -- 172.21.15.67:0/1082682321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c06c460 con 0x7f931c1592f0 2024-09-19T05:45:32.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.879+0000 7f93209d4640 1 -- 172.21.15.67:0/1082682321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931c06eaa0 con 0x7f931c1592f0 2024-09-19T05:45:32.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.879+0000 7f930affd640 1 -- 172.21.15.67:0/1082682321 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9310004990 con 0x7f931c1592f0 2024-09-19T05:45:32.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.879+0000 7f930affd640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92fc0678c0 0x7f92fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.879+0000 7f930affd640 1 -- 172.21.15.67:0/1082682321 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 6159+0+0 (secure 0 0 0) 0x7f93100856a0 con 0x7f931c1592f0 2024-09-19T05:45:32.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.879+0000 7f931a59c640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92fc0678c0 0x7f92fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.879+0000 7f931a59c640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92fc0678c0 0x7f92fc069d80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f930c001750 tx=0x7f930c0011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:32.883+0000 7f930affd640 1 -- 172.21.15.67:0/1082682321 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f93100560b0 con 0x7f931c1592f0 2024-09-19T05:45:33.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.083+0000 7f93209d4640 1 -- 172.21.15.67:0/1082682321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f931c0b0790 con 0x7f931c1592f0 2024-09-19T05:45:33.083 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:45:33.087+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:45:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.087+0000 7f930affd640 1 -- 172.21.15.67:0/1082682321 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v107) ==== 161+0+0 (secure 0 0 0) 0x7f93100559b0 con 0x7f931c1592f0 2024-09-19T05:45:33.086 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:45:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 -- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92fc0678c0 msgr2=0x7f92fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92fc0678c0 0x7f92fc069d80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f930c001750 tx=0x7f930c0011a0 comp rx=0 tx=0).stop 2024-09-19T05:45:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 -- 172.21.15.67:0/1082682321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c1592f0 msgr2=0x7f931c1510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c1592f0 0x7f931c1510b0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f9310007fd0 tx=0x7f931000dc00 comp rx=0 tx=0).stop 2024-09-19T05:45:33.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 -- 172.21.15.67:0/1082682321 shutdown_connections 2024-09-19T05:45:33.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f92fc0678c0 0x7f92fc069d80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:33.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f931c1515f0 0x7f931c15c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:33.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c1592f0 0x7f931c1510b0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:33.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 --2- 172.21.15.67:0/1082682321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93040039c0 0x7f931c06bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:33.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 -- 172.21.15.67:0/1082682321 >> 172.21.15.67:0/1082682321 conn(0x7f931c0d0080 msgr2=0x7f931c0b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:33.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 -- 172.21.15.67:0/1082682321 shutdown_connections 2024-09-19T05:45:33.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.091+0000 7f93209d4640 1 -- 172.21.15.67:0/1082682321 wait complete. 2024-09-19T05:45:33.107 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:45:33.172 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:45:33.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.227+0000 7f5d03323640 1 Processor -- start 2024-09-19T05:45:33.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.227+0000 7f5d03323640 1 -- start start 2024-09-19T05:45:33.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.227+0000 7f5d03323640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cfc15b1d0 0x7f5cfc0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:33.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.227+0000 7f5d03323640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5cfc070070 0x7f5cfc0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:33.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.227+0000 7f5d03323640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cfc0aef30 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.227+0000 7f5d03323640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5cfc072210 con 0x7f5cfc15b1d0 2024-09-19T05:45:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.227+0000 7f5d03323640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5cfc0ae0f0 con 0x7f5cfc070070 2024-09-19T05:45:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.227+0000 7f5d010bf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cfc15b1d0 0x7f5cfc0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d010bf640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cfc15b1d0 0x7f5cfc0adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40328/0 (socket says 172.21.15.67:40328) 2024-09-19T05:45:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d010bf640 1 -- 172.21.15.67:0/141341745 learned_addr learned my addr 172.21.15.67:0/141341745 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d018c0640 1 --2- 172.21.15.67:0/141341745 >> v2:172.21.15.97:3300/0 conn(0x7f5cfc070070 0x7f5cfc0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d010bf640 1 -- 172.21.15.67:0/141341745 >> v2:172.21.15.97:3300/0 conn(0x7f5cfc070070 msgr2=0x7f5cfc0b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d010bf640 1 --2- 172.21.15.67:0/141341745 >> v2:172.21.15.97:3300/0 conn(0x7f5cfc070070 0x7f5cfc0b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d010bf640 1 -- 172.21.15.67:0/141341745 >> v1:172.21.15.97:6789/0 conn(0x7f5cfc06dfc0 legacy=0x7f5cfc06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:33.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d010bf640 1 -- 172.21.15.67:0/141341745 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc0ae3b0 con 0x7f5cfc15b1d0 2024-09-19T05:45:33.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d010bf640 1 --2- 172.21.15.67:0/141341745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc15b1d0 0x7f5cfc0adbb0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0b52f0 tx=0x7f5cf801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceeb5b40bfbdc6e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:33.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5cf3fff640 1 -- 172.21.15.67:0/141341745 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf80ab610 con 0x7f5cfc15b1d0 2024-09-19T05:45:33.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5cf3fff640 1 -- 172.21.15.67:0/141341745 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf80b0070 con 0x7f5cfc15b1d0 2024-09-19T05:45:33.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5cf3fff640 1 -- 172.21.15.67:0/141341745 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf80ab9d0 con 0x7f5cfc15b1d0 2024-09-19T05:45:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d03323640 1 -- 172.21.15.67:0/141341745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc15b1d0 msgr2=0x7f5cfc0adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d03323640 1 --2- 172.21.15.67:0/141341745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc15b1d0 0x7f5cfc0adbb0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0b52f0 tx=0x7f5cf801c520 comp rx=0 tx=0).stop 2024-09-19T05:45:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d03323640 1 -- 172.21.15.67:0/141341745 shutdown_connections 2024-09-19T05:45:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d03323640 1 --2- 172.21.15.67:0/141341745 >> v2:172.21.15.97:3300/0 conn(0x7f5cfc070070 0x7f5cfc0b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d03323640 1 --2- 172.21.15.67:0/141341745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc15b1d0 0x7f5cfc0adbb0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d03323640 1 -- 172.21.15.67:0/141341745 >> 172.21.15.67:0/141341745 conn(0x7f5cfc0b1e50 msgr2=0x7f5cfc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d03323640 1 -- 172.21.15.67:0/141341745 shutdown_connections 2024-09-19T05:45:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.231+0000 7f5d03323640 1 -- 172.21.15.67:0/141341745 wait complete. 2024-09-19T05:45:33.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 Processor -- start 2024-09-19T05:45:33.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 -- start start 2024-09-19T05:45:33.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc06dfc0 0x7f5cfc153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:33.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cfc070070 0x7f5cfc15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cfc15b1d0 0x7f5cfc1f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc0b4180 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc072420 con 0x7f5cfc15b1d0 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5cfc0b4300 con 0x7f5cfc070070 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d010bf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc06dfc0 0x7f5cfc153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d010bf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc06dfc0 0x7f5cfc153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40330/0 (socket says 172.21.15.67:40330) 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d010bf640 1 -- 172.21.15.67:0/1193837622 learned_addr learned my addr 172.21.15.67:0/1193837622 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d008be640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cfc070070 0x7f5cfc15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d018c0640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cfc15b1d0 0x7f5cfc1f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d010bf640 1 -- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cfc070070 msgr2=0x7f5cfc15a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d010bf640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cfc070070 0x7f5cfc15a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d010bf640 1 -- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cfc15b1d0 msgr2=0x7f5cfc1f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d010bf640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cfc15b1d0 0x7f5cfc1f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d010bf640 1 -- 172.21.15.67:0/1193837622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc1584f0 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d010bf640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc06dfc0 0x7f5cfc153270 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80ad040 tx=0x7f5cf801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5cf1ffb640 1 -- 172.21.15.67:0/1193837622 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf80be5f0 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5cf1ffb640 1 -- 172.21.15.67:0/1193837622 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf80be7b0 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5cf1ffb640 1 -- 172.21.15.67:0/1193837622 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf80beba0 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 -- 172.21.15.67:0/1193837622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cfc1587d0 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 -- 172.21.15.67:0/1193837622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cfc156540 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5d03323640 1 -- 172.21.15.67:0/1193837622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cfc158cf0 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5cf1ffb640 1 -- 172.21.15.67:0/1193837622 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5cf80b43f0 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5cf1ffb640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce00678f0 0x7f5ce0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:33.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.235+0000 7f5cf1ffb640 1 -- 172.21.15.67:0/1193837622 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 6245+0+0 (secure 0 0 0) 0x7f5cf81209b0 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.239+0000 7f5d008be640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce00678f0 0x7f5ce0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:33.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.239+0000 7f5d008be640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce00678f0 0x7f5ce0069db0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5cec007fd0 tx=0x7f5cec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:33.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.243+0000 7f5cf1ffb640 1 -- 172.21.15.67:0/1193837622 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5cf80c4060 con 0x7f5cfc06dfc0 2024-09-19T05:45:33.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:33.431+0000 7f5d03323640 1 -- 172.21.15.67:0/1193837622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5cfc0b3430 con 0x7f5cfc06dfc0 2024-09-19T05:45:34.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.095+0000 7f5cf1ffb640 1 -- 172.21.15.67:0/1193837622 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v108) ==== 104+0+0 (secure 0 0 0) 0x7f5cf80a8050 con 0x7f5cfc06dfc0 2024-09-19T05:45:34.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 -- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce00678f0 msgr2=0x7f5ce0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce00678f0 0x7f5ce0069db0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5cec007fd0 tx=0x7f5cec009040 comp rx=0 tx=0).stop 2024-09-19T05:45:34.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 -- 172.21.15.67:0/1193837622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc06dfc0 msgr2=0x7f5cfc153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc06dfc0 0x7f5cfc153270 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80ad040 tx=0x7f5cf801ad60 comp rx=0 tx=0).stop 2024-09-19T05:45:34.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 -- 172.21.15.67:0/1193837622 shutdown_connections 2024-09-19T05:45:34.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cfc15b1d0 0x7f5cfc1f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ce00678f0 0x7f5ce0069db0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cfc070070 0x7f5cfc15a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 --2- 172.21.15.67:0/1193837622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cfc06dfc0 0x7f5cfc153270 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 -- 172.21.15.67:0/1193837622 >> 172.21.15.67:0/1193837622 conn(0x7f5cfc0b1e50 msgr2=0x7f5cfc06e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:34.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 -- 172.21.15.67:0/1193837622 shutdown_connections 2024-09-19T05:45:34.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.103+0000 7f5d03323640 1 -- 172.21.15.67:0/1193837622 wait complete. 2024-09-19T05:45:34.126 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:45:34.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.263+0000 7fe8c412a640 1 Processor -- start 2024-09-19T05:45:34.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.263+0000 7fe8c412a640 1 -- start start 2024-09-19T05:45:34.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c412a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 0x7fe8bc0d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c412a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe8bc0addf0 0x7fe8bc0ae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c412a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8bc0b4e00 con 0x7fe8bc0738b0 2024-09-19T05:45:34.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c412a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe8bc0d0ed0 con 0x7fe8bc0addf0 2024-09-19T05:45:34.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c412a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe8bc0b3500 con 0x7fe8bc0d0520 2024-09-19T05:45:34.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c1ec6640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe8bc0738b0 0x7fe8bc15c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45834/0 (socket says 172.21.15.67:45834) 2024-09-19T05:45:34.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c1ec6640 1 -- 172.21.15.67:0/3023558704 learned_addr learned my addr 172.21.15.67:0/3023558704 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:34.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c26c7640 1 --2- 172.21.15.67:0/3023558704 >> v2:172.21.15.67:3300/0 conn(0x7fe8bc0addf0 0x7fe8bc0ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c0ec4640 1 -- 172.21.15.67:0/3023558704 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520985135 0 0) 0x7fe8bc0b4e00 con 0x7fe8bc0738b0 2024-09-19T05:45:34.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c16c5640 1 --2- 172.21.15.67:0/3023558704 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 0x7fe8bc0d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c0ec4640 1 -- 172.21.15.67:0/3023558704 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8a8003530 con 0x7fe8bc0738b0 2024-09-19T05:45:34.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c26c7640 1 -- 172.21.15.67:0/3023558704 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 msgr2=0x7fe8bc0d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:34.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c26c7640 1 --2- 172.21.15.67:0/3023558704 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 0x7fe8bc0d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c26c7640 1 -- 172.21.15.67:0/3023558704 >> v1:172.21.15.67:6789/0 conn(0x7fe8bc0738b0 legacy=0x7fe8bc15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c26c7640 1 -- 172.21.15.67:0/3023558704 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc0b37e0 con 0x7fe8bc0addf0 2024-09-19T05:45:34.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c16c5640 1 --2- 172.21.15.67:0/3023558704 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 0x7fe8bc0d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:34.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c26c7640 1 --2- 172.21.15.67:0/3023558704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 0x7fe8bc0ae280 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009d90 tx=0x7fe8b401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab0cba4ef541ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:34.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c0ec4640 1 -- 172.21.15.67:0/3023558704 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40b2070 con 0x7fe8bc0addf0 2024-09-19T05:45:34.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c0ec4640 1 -- 172.21.15.67:0/3023558704 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b40a5830 con 0x7fe8bc0addf0 2024-09-19T05:45:34.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.267+0000 7fe8c0ec4640 1 -- 172.21.15.67:0/3023558704 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40a5c00 con 0x7fe8bc0addf0 2024-09-19T05:45:34.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- 172.21.15.67:0/3023558704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 msgr2=0x7fe8bc0ae280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 --2- 172.21.15.67:0/3023558704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 0x7fe8bc0ae280 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009d90 tx=0x7fe8b401c970 comp rx=0 tx=0).stop 2024-09-19T05:45:34.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- 172.21.15.67:0/3023558704 shutdown_connections 2024-09-19T05:45:34.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 --2- 172.21.15.67:0/3023558704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 0x7fe8bc0ae280 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 --2- 172.21.15.67:0/3023558704 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 0x7fe8bc0d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- 172.21.15.67:0/3023558704 >> 172.21.15.67:0/3023558704 conn(0x7fe8bc06c0c0 msgr2=0x7fe8bc06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:34.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- 172.21.15.67:0/3023558704 shutdown_connections 2024-09-19T05:45:34.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- 172.21.15.67:0/3023558704 wait complete. 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 Processor -- start 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- start start 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8bc0738b0 0x7fe8bc14b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 0x7fe8bc150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 0x7fe8bc14d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc0b30b0 con 0x7fe8bc0addf0 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc073c90 con 0x7fe8bc0738b0 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe8bc0b3230 con 0x7fe8bc0d0520 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c16c5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 0x7fe8bc150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c16c5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 0x7fe8bc150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40346/0 (socket says 172.21.15.67:40346) 2024-09-19T05:45:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c16c5640 1 -- 172.21.15.67:0/954988422 learned_addr learned my addr 172.21.15.67:0/954988422 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c1ec6640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8bc0738b0 0x7fe8bc14b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c16c5640 1 -- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 msgr2=0x7fe8bc14d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c26c7640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 0x7fe8bc14d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c16c5640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 0x7fe8bc14d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c16c5640 1 -- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8bc0738b0 msgr2=0x7fe8bc14b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c16c5640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8bc0738b0 0x7fe8bc14b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c16c5640 1 -- 172.21.15.67:0/954988422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc14bc10 con 0x7fe8bc0addf0 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c1ec6640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8bc0738b0 0x7fe8bc14b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c16c5640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 0x7fe8bc150290 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c7f0 tx=0x7fe8ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8b27fc640 1 -- 172.21.15.67:0/954988422 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac015070 con 0x7fe8bc0addf0 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8b27fc640 1 -- 172.21.15.67:0/954988422 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ac007820 con 0x7fe8bc0addf0 2024-09-19T05:45:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- 172.21.15.67:0/954988422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8bc150c00 con 0x7fe8bc0addf0 2024-09-19T05:45:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8b27fc640 1 -- 172.21.15.67:0/954988422 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac007c10 con 0x7fe8bc0addf0 2024-09-19T05:45:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.271+0000 7fe8c412a640 1 -- 172.21.15.67:0/954988422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8bc1511c0 con 0x7fe8bc0addf0 2024-09-19T05:45:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.275+0000 7fe8c412a640 1 -- 172.21.15.67:0/954988422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8bc0ae280 con 0x7fe8bc0addf0 2024-09-19T05:45:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.275+0000 7fe8b27fc640 1 -- 172.21.15.67:0/954988422 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8ac018070 con 0x7fe8bc0addf0 2024-09-19T05:45:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.275+0000 7fe8b27fc640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8a00678f0 0x7fe8a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.275+0000 7fe8b27fc640 1 -- 172.21.15.67:0/954988422 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 6245+0+0 (secure 0 0 0) 0x7fe8ac085fe0 con 0x7fe8bc0addf0 2024-09-19T05:45:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.275+0000 7fe8c1ec6640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8a00678f0 0x7fe8a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.275+0000 7fe8c1ec6640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8a00678f0 0x7fe8a0069db0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8005890 tx=0x7fe8b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.279+0000 7fe8b27fc640 1 -- 172.21.15.67:0/954988422 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe8ac0568c0 con 0x7fe8bc0addf0 2024-09-19T05:45:34.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:34.447+0000 7fe8c412a640 1 -- 172.21.15.67:0/954988422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8bc06c540 con 0x7fe8bc0addf0 2024-09-19T05:45:35.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.099+0000 7fe8b27fc640 1 -- 172.21.15.67:0/954988422 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v159) ==== 181+0+0 (secure 0 0 0) 0x7fe8ac0561c0 con 0x7fe8bc0addf0 2024-09-19T05:45:35.098 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:45:35.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.103+0000 7fe8c412a640 1 -- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8a00678f0 msgr2=0x7fe8a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:35.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.103+0000 7fe8c412a640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8a00678f0 0x7fe8a0069db0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8005890 tx=0x7fe8b8009040 comp rx=0 tx=0).stop 2024-09-19T05:45:35.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.103+0000 7fe8c412a640 1 -- 172.21.15.67:0/954988422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 msgr2=0x7fe8bc150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:35.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.103+0000 7fe8c412a640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 0x7fe8bc150290 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c7f0 tx=0x7fe8ac00ccb0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.107+0000 7fe8c412a640 1 -- 172.21.15.67:0/954988422 shutdown_connections 2024-09-19T05:45:35.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.107+0000 7fe8c412a640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8a00678f0 0x7fe8a0069db0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.107+0000 7fe8c412a640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8bc0d0520 0x7fe8bc14d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.107+0000 7fe8c412a640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8bc0addf0 0x7fe8bc150290 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.107+0000 7fe8c412a640 1 --2- 172.21.15.67:0/954988422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8bc0738b0 0x7fe8bc14b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.107+0000 7fe8c412a640 1 -- 172.21.15.67:0/954988422 >> 172.21.15.67:0/954988422 conn(0x7fe8bc06c0c0 msgr2=0x7fe8bc072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:35.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.107+0000 7fe8c412a640 1 -- 172.21.15.67:0/954988422 shutdown_connections 2024-09-19T05:45:35.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.107+0000 7fe8c412a640 1 -- 172.21.15.67:0/954988422 wait complete. 2024-09-19T05:45:35.125 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:45:35.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.259+0000 7f81b8081640 1 Processor -- start 2024-09-19T05:45:35.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.259+0000 7f81b8081640 1 -- start start 2024-09-19T05:45:35.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.259+0000 7f81b8081640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f81b00cf5e0 0x7f81b00d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:35.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.259+0000 7f81b8081640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015d8d0 0x7f81b015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:35.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.259+0000 7f81b8081640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b015d030 con 0x7f81b015c850 2024-09-19T05:45:35.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.259+0000 7f81b8081640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f81b015e250 con 0x7f81b00cf5e0 2024-09-19T05:45:35.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.259+0000 7f81b8081640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f81b006de90 con 0x7f81b015d8d0 2024-09-19T05:45:35.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.259+0000 7f81b5e1d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f81b00cf5e0 0x7f81b00d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:35.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.259+0000 7f81b5e1d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f81b00cf5e0 0x7f81b00d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40348/0 (socket says 172.21.15.67:40348) 2024-09-19T05:45:35.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.259+0000 7f81b5e1d640 1 -- 172.21.15.67:0/1067504427 learned_addr learned my addr 172.21.15.67:0/1067504427 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:35.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b661e640 1 --2- 172.21.15.67:0/1067504427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015d8d0 0x7f81b015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:35.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b5e1d640 1 -- 172.21.15.67:0/1067504427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015d8d0 msgr2=0x7f81b015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:35.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b5e1d640 1 --2- 172.21.15.67:0/1067504427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015d8d0 0x7f81b015dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b5e1d640 1 -- 172.21.15.67:0/1067504427 >> v1:172.21.15.97:6789/0 conn(0x7f81b015c850 legacy=0x7f81b006e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:35.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b5e1d640 1 -- 172.21.15.67:0/1067504427 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b015d310 con 0x7f81b00cf5e0 2024-09-19T05:45:35.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b5e1d640 1 --2- 172.21.15.67:0/1067504427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 0x7f81b00d0aa0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009870 tx=0x7f81a001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd5dc413b87f01c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:35.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b4e1b640 1 -- 172.21.15.67:0/1067504427 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a00a7070 con 0x7f81b00cf5e0 2024-09-19T05:45:35.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b4e1b640 1 -- 172.21.15.67:0/1067504427 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a00b0070 con 0x7f81b00cf5e0 2024-09-19T05:45:35.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b4e1b640 1 -- 172.21.15.67:0/1067504427 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a00ab890 con 0x7f81b00cf5e0 2024-09-19T05:45:35.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b8081640 1 -- 172.21.15.67:0/1067504427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 msgr2=0x7f81b00d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:35.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b8081640 1 --2- 172.21.15.67:0/1067504427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 0x7f81b00d0aa0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009870 tx=0x7f81a001c560 comp rx=0 tx=0).stop 2024-09-19T05:45:35.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b8081640 1 -- 172.21.15.67:0/1067504427 shutdown_connections 2024-09-19T05:45:35.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b8081640 1 --2- 172.21.15.67:0/1067504427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015d8d0 0x7f81b015dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b8081640 1 --2- 172.21.15.67:0/1067504427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 0x7f81b00d0aa0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b8081640 1 -- 172.21.15.67:0/1067504427 >> 172.21.15.67:0/1067504427 conn(0x7f81b006c0c0 msgr2=0x7f81b006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:35.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b8081640 1 -- 172.21.15.67:0/1067504427 shutdown_connections 2024-09-19T05:45:35.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.263+0000 7f81b8081640 1 -- 172.21.15.67:0/1067504427 wait complete. 2024-09-19T05:45:35.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 Processor -- start 2024-09-19T05:45:35.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 -- start start 2024-09-19T05:45:35.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 0x7f81b01f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:35.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015c850 0x7f81b014b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:35.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81b015d8d0 0x7f81b014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:35.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f81b006ee90 con 0x7f81b00cf5e0 2024-09-19T05:45:35.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f81b006ed10 con 0x7f81b015d8d0 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f81b0168fb0 con 0x7f81b015c850 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b5e1d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 0x7f81b01f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b5e1d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 0x7f81b01f8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40352/0 (socket says 172.21.15.67:40352) 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b5e1d640 1 -- 172.21.15.67:0/421552732 learned_addr learned my addr 172.21.15.67:0/421552732 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b661e640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81b015d8d0 0x7f81b014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b561c640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015c850 0x7f81b014b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b5e1d640 1 -- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015c850 msgr2=0x7f81b014b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b5e1d640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015c850 0x7f81b014b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b5e1d640 1 -- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81b015d8d0 msgr2=0x7f81b014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b5e1d640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81b015d8d0 0x7f81b014f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b5e1d640 1 -- 172.21.15.67:0/421552732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b014ff10 con 0x7f81b00cf5e0 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b561c640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015c850 0x7f81b014b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b5e1d640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 0x7f81b01f8150 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f81a00ad040 tx=0x7f81a001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:35.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81a67fc640 1 -- 172.21.15.67:0/421552732 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a00be5f0 con 0x7f81b00cf5e0 2024-09-19T05:45:35.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81a67fc640 1 -- 172.21.15.67:0/421552732 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a00be7b0 con 0x7f81b00cf5e0 2024-09-19T05:45:35.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 -- 172.21.15.67:0/421552732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b01501f0 con 0x7f81b00cf5e0 2024-09-19T05:45:35.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81a67fc640 1 -- 172.21.15.67:0/421552732 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a00beba0 con 0x7f81b00cf5e0 2024-09-19T05:45:35.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 -- 172.21.15.67:0/421552732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b01f7640 con 0x7f81b00cf5e0 2024-09-19T05:45:35.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.267+0000 7f81b8081640 1 -- 172.21.15.67:0/421552732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b01503c0 con 0x7f81b00cf5e0 2024-09-19T05:45:35.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.271+0000 7f81a67fc640 1 -- 172.21.15.67:0/421552732 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81a00b43f0 con 0x7f81b00cf5e0 2024-09-19T05:45:35.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.271+0000 7f81a67fc640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81940678c0 0x7f8194069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:35.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.271+0000 7f81a67fc640 1 -- 172.21.15.67:0/421552732 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5807+0+0 (secure 0 0 0) 0x7f81a01209b0 con 0x7f81b00cf5e0 2024-09-19T05:45:35.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.271+0000 7f81b561c640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81940678c0 0x7f8194069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:35.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.271+0000 7f81b561c640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81940678c0 0x7f8194069d80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f81b006e870 tx=0x7f81ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:35.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.275+0000 7f81a67fc640 1 -- 172.21.15.67:0/421552732 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f81a00c4060 con 0x7f81b00cf5e0 2024-09-19T05:45:35.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:35.439+0000 7f81b8081640 1 -- 172.21.15.67:0/421552732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81b00d0aa0 con 0x7f81b00cf5e0 2024-09-19T05:45:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.107+0000 7f81a67fc640 1 -- 172.21.15.67:0/421552732 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v160) ==== 169+0+0 (secure 0 0 0) 0x7f81a0016150 con 0x7f81b00cf5e0 2024-09-19T05:45:36.107 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:45:36.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 -- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81940678c0 msgr2=0x7f8194069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:36.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81940678c0 0x7f8194069d80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f81b006e870 tx=0x7f81ac009040 comp rx=0 tx=0).stop 2024-09-19T05:45:36.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 -- 172.21.15.67:0/421552732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 msgr2=0x7f81b01f8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:36.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 0x7f81b01f8150 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f81a00ad040 tx=0x7f81a001ada0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 -- 172.21.15.67:0/421552732 shutdown_connections 2024-09-19T05:45:36.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81b015d8d0 0x7f81b014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f81940678c0 0x7f8194069d80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f81b015c850 0x7f81b014b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 --2- 172.21.15.67:0/421552732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00cf5e0 0x7f81b01f8150 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 -- 172.21.15.67:0/421552732 >> 172.21.15.67:0/421552732 conn(0x7f81b006c0c0 msgr2=0x7f81b006f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:36.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 -- 172.21.15.67:0/421552732 shutdown_connections 2024-09-19T05:45:36.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.115+0000 7f81b8081640 1 -- 172.21.15.67:0/421552732 wait complete. 2024-09-19T05:45:36.144 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:45:36.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.267+0000 7f44710fb640 1 Processor -- start 2024-09-19T05:45:36.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.267+0000 7f44710fb640 1 -- start start 2024-09-19T05:45:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f44710fb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f446c15b1d0 0x7f446c0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f44710fb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f446c06dfc0 0x7f446c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f44710fb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f446c0aef30 con 0x7f446c06fea0 2024-09-19T05:45:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f44710fb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f446c072210 con 0x7f446c06dfc0 2024-09-19T05:45:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f44710fb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f446c0ae0f0 con 0x7f446c15b1d0 2024-09-19T05:45:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f4463fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f446c06dfc0 0x7f446c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f4463fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f446c06dfc0 0x7f446c06f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34908/0 (socket says 172.21.15.67:34908) 2024-09-19T05:45:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f4463fff640 1 -- 172.21.15.67:0/1045909907 learned_addr learned my addr 172.21.15.67:0/1045909907 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f446ad9d640 1 --2- 172.21.15.67:0/1045909907 >> v2:172.21.15.97:3300/0 conn(0x7f446c15b1d0 0x7f446c0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f4463fff640 1 -- 172.21.15.67:0/1045909907 >> v2:172.21.15.97:3300/0 conn(0x7f446c15b1d0 msgr2=0x7f446c0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f4463fff640 1 --2- 172.21.15.67:0/1045909907 >> v2:172.21.15.97:3300/0 conn(0x7f446c15b1d0 0x7f446c0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f4463fff640 1 -- 172.21.15.67:0/1045909907 >> v1:172.21.15.97:6789/0 conn(0x7f446c06fea0 legacy=0x7f446c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f4463fff640 1 -- 172.21.15.67:0/1045909907 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c0ae3b0 con 0x7f446c06dfc0 2024-09-19T05:45:36.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f4463fff640 1 --2- 172.21.15.67:0/1045909907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 0x7f446c06f960 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f446c0711d0 tx=0x7f445401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d2f9aae6c007fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:36.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f446a59c640 1 -- 172.21.15.67:0/1045909907 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44540b0070 con 0x7f446c06dfc0 2024-09-19T05:45:36.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f446a59c640 1 -- 172.21.15.67:0/1045909907 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44540ab600 con 0x7f446c06dfc0 2024-09-19T05:45:36.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.271+0000 7f446a59c640 1 -- 172.21.15.67:0/1045909907 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44540ab9d0 con 0x7f446c06dfc0 2024-09-19T05:45:36.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- 172.21.15.67:0/1045909907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 msgr2=0x7f446c06f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:36.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 --2- 172.21.15.67:0/1045909907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 0x7f446c06f960 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f446c0711d0 tx=0x7f445401c4e0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- 172.21.15.67:0/1045909907 shutdown_connections 2024-09-19T05:45:36.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 --2- 172.21.15.67:0/1045909907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 0x7f446c06f960 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 --2- 172.21.15.67:0/1045909907 >> v2:172.21.15.97:3300/0 conn(0x7f446c15b1d0 0x7f446c0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- 172.21.15.67:0/1045909907 >> 172.21.15.67:0/1045909907 conn(0x7f446c0b1e50 msgr2=0x7f446c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:36.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- 172.21.15.67:0/1045909907 shutdown_connections 2024-09-19T05:45:36.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- 172.21.15.67:0/1045909907 wait complete. 2024-09-19T05:45:36.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 Processor -- start 2024-09-19T05:45:36.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- start start 2024-09-19T05:45:36.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 0x7f446c14f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f446c06fea0 0x7f446c15da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f446c15b1d0 0x7f446c152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f446c0b4440 con 0x7f446c06dfc0 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f446c072420 con 0x7f446c15b1d0 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f446c167df0 con 0x7f446c06fea0 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f446ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 0x7f446c14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f446ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 0x7f446c14f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34920/0 (socket says 172.21.15.67:34920) 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f446ad9d640 1 -- 172.21.15.67:0/3719614143 learned_addr learned my addr 172.21.15.67:0/3719614143 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f446b59e640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f446c15b1d0 0x7f446c152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f4463fff640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f446c06fea0 0x7f446c15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f446ad9d640 1 -- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f446c06fea0 msgr2=0x7f446c15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f446ad9d640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f446c06fea0 0x7f446c15da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f446ad9d640 1 -- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f446c15b1d0 msgr2=0x7f446c152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f446ad9d640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f446c15b1d0 0x7f446c152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f446ad9d640 1 -- 172.21.15.67:0/3719614143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c15eb30 con 0x7f446c06dfc0 2024-09-19T05:45:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f446ad9d640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 0x7f446c14f410 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f445c00d800 tx=0x7f445c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44637fe640 1 -- 172.21.15.67:0/3719614143 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c00b6c0 con 0x7f446c06dfc0 2024-09-19T05:45:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44637fe640 1 -- 172.21.15.67:0/3719614143 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f445c019070 con 0x7f446c06dfc0 2024-09-19T05:45:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- 172.21.15.67:0/3719614143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c15e570 con 0x7f446c06dfc0 2024-09-19T05:45:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44637fe640 1 -- 172.21.15.67:0/3719614143 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c00ba60 con 0x7f446c06dfc0 2024-09-19T05:45:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.275+0000 7f44710fb640 1 -- 172.21.15.67:0/3719614143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c155d30 con 0x7f446c06dfc0 2024-09-19T05:45:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.279+0000 7f44710fb640 1 -- 172.21.15.67:0/3719614143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446c0cf9b0 con 0x7f446c06dfc0 2024-09-19T05:45:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.279+0000 7f44637fe640 1 -- 172.21.15.67:0/3719614143 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f445c00bc00 con 0x7f446c06dfc0 2024-09-19T05:45:36.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.279+0000 7f44637fe640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f444c0678c0 0x7f444c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.279+0000 7f44637fe640 1 -- 172.21.15.67:0/3719614143 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5335+0+0 (secure 0 0 0) 0x7f445c085f50 con 0x7f446c06dfc0 2024-09-19T05:45:36.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.279+0000 7f4463fff640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f444c0678c0 0x7f444c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.279+0000 7f4463fff640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f444c0678c0 0x7f444c069d80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f44540ad000 tx=0x7f4454008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.283+0000 7f44637fe640 1 -- 172.21.15.67:0/3719614143 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f445c056c90 con 0x7f446c06dfc0 2024-09-19T05:45:36.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.447+0000 7f44710fb640 1 -- 172.21.15.67:0/3719614143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f446c165ba0 con 0x7f446c06dfc0 2024-09-19T05:45:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44637fe640 1 -- 172.21.15.67:0/3719614143 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v41) ==== 104+0+0 (secure 0 0 0) 0x7f445c056590 con 0x7f446c06dfc0 2024-09-19T05:45:36.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 -- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f444c0678c0 msgr2=0x7f444c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f444c0678c0 0x7f444c069d80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f44540ad000 tx=0x7f4454008040 comp rx=0 tx=0).stop 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 -- 172.21.15.67:0/3719614143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 msgr2=0x7f446c14f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 0x7f446c14f410 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f445c00d800 tx=0x7f445c00dcc0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 -- 172.21.15.67:0/3719614143 shutdown_connections 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f446c15b1d0 0x7f446c152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f444c0678c0 0x7f444c069d80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f446c06fea0 0x7f446c15da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 --2- 172.21.15.67:0/3719614143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f446c06dfc0 0x7f446c14f410 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 -- 172.21.15.67:0/3719614143 >> 172.21.15.67:0/3719614143 conn(0x7f446c0b1e50 msgr2=0x7f446c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 -- 172.21.15.67:0/3719614143 shutdown_connections 2024-09-19T05:45:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.455+0000 7f44710fb640 1 -- 172.21.15.67:0/3719614143 wait complete. 2024-09-19T05:45:36.472 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-19T05:45:36.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad8741640 1 Processor -- start 2024-09-19T05:45:36.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad8741640 1 -- start start 2024-09-19T05:45:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad8741640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3ad015b710 0x7f3ad0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad8741640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ad00aef40 0x7f3ad00af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad8741640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad00b3070 con 0x7f3ad015baf0 2024-09-19T05:45:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad8741640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad00b32e0 con 0x7f3ad015b710 2024-09-19T05:45:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad8741640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad00b35c0 con 0x7f3ad00aef40 2024-09-19T05:45:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad64dd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3ad015b710 0x7f3ad0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad64dd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3ad015b710 0x7f3ad0071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34928/0 (socket says 172.21.15.67:34928) 2024-09-19T05:45:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad64dd640 1 -- 172.21.15.67:0/760246054 learned_addr learned my addr 172.21.15.67:0/760246054 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad64dd640 1 -- 172.21.15.67:0/760246054 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ad00aef40 msgr2=0x7f3ad00af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:36.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad64dd640 1 --2- 172.21.15.67:0/760246054 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ad00aef40 0x7f3ad00af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad64dd640 1 -- 172.21.15.67:0/760246054 >> v1:172.21.15.97:6789/0 conn(0x7f3ad015baf0 legacy=0x7f3ad015bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:36.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.599+0000 7f3ad64dd640 1 -- 172.21.15.67:0/760246054 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad00b38a0 con 0x7f3ad015b710 2024-09-19T05:45:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad64dd640 1 --2- 172.21.15.67:0/760246054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 0x7f3ad0071e80 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009870 tx=0x7f3ac001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb734e603072d6dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad54db640 1 -- 172.21.15.67:0/760246054 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac00aa430 con 0x7f3ad015b710 2024-09-19T05:45:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad54db640 1 -- 172.21.15.67:0/760246054 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac00af070 con 0x7f3ad015b710 2024-09-19T05:45:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad54db640 1 -- 172.21.15.67:0/760246054 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac00aa7f0 con 0x7f3ad015b710 2024-09-19T05:45:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad8741640 1 -- 172.21.15.67:0/760246054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 msgr2=0x7f3ad0071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad8741640 1 --2- 172.21.15.67:0/760246054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 0x7f3ad0071e80 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009870 tx=0x7f3ac001c4f0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad8741640 1 -- 172.21.15.67:0/760246054 shutdown_connections 2024-09-19T05:45:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad8741640 1 --2- 172.21.15.67:0/760246054 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ad00aef40 0x7f3ad00af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad8741640 1 --2- 172.21.15.67:0/760246054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 0x7f3ad0071e80 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad8741640 1 -- 172.21.15.67:0/760246054 >> 172.21.15.67:0/760246054 conn(0x7f3ad00d0080 msgr2=0x7f3ad00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad8741640 1 -- 172.21.15.67:0/760246054 shutdown_connections 2024-09-19T05:45:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad8741640 1 -- 172.21.15.67:0/760246054 wait complete. 2024-09-19T05:45:36.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad8741640 1 Processor -- start 2024-09-19T05:45:36.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.603+0000 7f3ad8741640 1 -- start start 2024-09-19T05:45:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad8741640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ad00aef40 0x7f3ad009da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad8741640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 0x7f3ad014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad8741640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ad015baf0 0x7f3ad01486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad8741640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00b4c40 con 0x7f3ad015b710 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad8741640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00b4ac0 con 0x7f3ad00aef40 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad8741640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad00b4dc0 con 0x7f3ad015baf0 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad5cdc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 0x7f3ad014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad5cdc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 0x7f3ad014f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34938/0 (socket says 172.21.15.67:34938) 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad5cdc640 1 -- 172.21.15.67:0/3646687 learned_addr learned my addr 172.21.15.67:0/3646687 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad64dd640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ad00aef40 0x7f3ad009da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad6cde640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ad015baf0 0x7f3ad01486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad5cdc640 1 -- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ad015baf0 msgr2=0x7f3ad01486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad5cdc640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ad015baf0 0x7f3ad01486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad5cdc640 1 -- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ad00aef40 msgr2=0x7f3ad009da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad5cdc640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ad00aef40 0x7f3ad009da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad5cdc640 1 -- 172.21.15.67:0/3646687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad009df80 con 0x7f3ad015b710 2024-09-19T05:45:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad5cdc640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 0x7f3ad014f150 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400ba80 tx=0x7f3ac400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3aceffd640 1 -- 172.21.15.67:0/3646687 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400cc00 con 0x7f3ad015b710 2024-09-19T05:45:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3aceffd640 1 -- 172.21.15.67:0/3646687 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac400cda0 con 0x7f3ad015b710 2024-09-19T05:45:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3aceffd640 1 -- 172.21.15.67:0/3646687 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4003bc0 con 0x7f3ad015b710 2024-09-19T05:45:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad8741640 1 -- 172.21.15.67:0/3646687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad0147900 con 0x7f3ad015b710 2024-09-19T05:45:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad8741640 1 -- 172.21.15.67:0/3646687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad0147ec0 con 0x7f3ad015b710 2024-09-19T05:45:36.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3ad8741640 1 -- 172.21.15.67:0/3646687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad00af360 con 0x7f3ad015b710 2024-09-19T05:45:36.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3aceffd640 1 -- 172.21.15.67:0/3646687 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ac4006d10 con 0x7f3ad015b710 2024-09-19T05:45:36.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.607+0000 7f3aceffd640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3abc0678c0 0x7f3abc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:36.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.611+0000 7f3aceffd640 1 -- 172.21.15.67:0/3646687 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5335+0+0 (secure 0 0 0) 0x7f3ac40856b0 con 0x7f3ad015b710 2024-09-19T05:45:36.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.611+0000 7f3ad64dd640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3abc0678c0 0x7f3abc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:36.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.611+0000 7f3ad64dd640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3abc0678c0 0x7f3abc069d80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00ae000 tx=0x7f3ac00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:36.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.615+0000 7f3aceffd640 1 -- 172.21.15.67:0/3646687 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3ac4055d10 con 0x7f3ad015b710 2024-09-19T05:45:36.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:36.847+0000 7f3ad8741640 1 -- 172.21.15.67:0/3646687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f3ad00aeae0 con 0x7f3ad015b710 2024-09-19T05:45:37.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.111+0000 7f3aceffd640 1 -- 172.21.15.67:0/3646687 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v556) ==== 166+0+0 (secure 0 0 0) 0x7f3ac405a010 con 0x7f3ad015b710 2024-09-19T05:45:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 -- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3abc0678c0 msgr2=0x7f3abc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3abc0678c0 0x7f3abc069d80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00ae000 tx=0x7f3ac00a7000 comp rx=0 tx=0).stop 2024-09-19T05:45:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 -- 172.21.15.67:0/3646687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 msgr2=0x7f3ad014f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 0x7f3ad014f150 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400ba80 tx=0x7f3ac400bf40 comp rx=0 tx=0).stop 2024-09-19T05:45:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 -- 172.21.15.67:0/3646687 shutdown_connections 2024-09-19T05:45:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3abc0678c0 0x7f3abc069d80 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ad015baf0 0x7f3ad01486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ad015b710 0x7f3ad014f150 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 --2- 172.21.15.67:0/3646687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ad00aef40 0x7f3ad009da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 -- 172.21.15.67:0/3646687 >> 172.21.15.67:0/3646687 conn(0x7f3ad00d0080 msgr2=0x7f3ad00d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 -- 172.21.15.67:0/3646687 shutdown_connections 2024-09-19T05:45:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.115+0000 7f3ad8741640 1 -- 172.21.15.67:0/3646687 wait complete. 2024-09-19T05:45:37.133 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-19T05:45:37.134 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-19T05:45:37.134 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:45:37.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.259+0000 7f5954fc0640 1 Processor -- start 2024-09-19T05:45:37.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.259+0000 7f5954fc0640 1 -- start start 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.259+0000 7f5954fc0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f595015b1e0 0x7f59500b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.259+0000 7f5954fc0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f59500b4900 0x7f5950071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.259+0000 7f5954fc0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 0x7f5950072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.259+0000 7f5954fc0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f595015b5c0 con 0x7f595015b1e0 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.259+0000 7f5954fc0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f59500b3860 con 0x7f59500b4900 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.259+0000 7f5954fc0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f59500b3b40 con 0x7f59500723c0 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.259+0000 7f594e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f595015b1e0 0x7f59500b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f595015b1e0 0x7f59500b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34944/0 (socket says 172.21.15.67:34944) 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594e59c640 1 -- 172.21.15.67:0/1350821171 learned_addr learned my addr 172.21.15.67:0/1350821171 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594dd9b640 1 --2- 172.21.15.67:0/1350821171 >> v2:172.21.15.97:3300/0 conn(0x7f59500b4900 0x7f5950071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594ed9d640 1 --2- 172.21.15.67:0/1350821171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 0x7f5950072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594e59c640 1 -- 172.21.15.67:0/1350821171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 msgr2=0x7f5950072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594e59c640 1 --2- 172.21.15.67:0/1350821171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 0x7f5950072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594e59c640 1 -- 172.21.15.67:0/1350821171 >> v2:172.21.15.97:3300/0 conn(0x7f59500b4900 msgr2=0x7f5950071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594e59c640 1 --2- 172.21.15.67:0/1350821171 >> v2:172.21.15.97:3300/0 conn(0x7f59500b4900 0x7f5950071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594e59c640 1 -- 172.21.15.67:0/1350821171 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59500b3e20 con 0x7f595015b1e0 2024-09-19T05:45:37.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594e59c640 1 --2- 172.21.15.67:0/1350821171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f595015b1e0 0x7f59500b2fd0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f59500ad2e0 tx=0x7f594001ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9c154e50071a34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:37.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594d59a640 1 -- 172.21.15.67:0/1350821171 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594000b2d0 con 0x7f595015b1e0 2024-09-19T05:45:37.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594d59a640 1 -- 172.21.15.67:0/1350821171 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594000b470 con 0x7f595015b1e0 2024-09-19T05:45:37.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.263+0000 7f594d59a640 1 -- 172.21.15.67:0/1350821171 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59400a7c90 con 0x7f595015b1e0 2024-09-19T05:45:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 -- 172.21.15.67:0/1350821171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f595015b1e0 msgr2=0x7f59500b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 --2- 172.21.15.67:0/1350821171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f595015b1e0 0x7f59500b2fd0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f59500ad2e0 tx=0x7f594001ebc0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 -- 172.21.15.67:0/1350821171 shutdown_connections 2024-09-19T05:45:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 --2- 172.21.15.67:0/1350821171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 0x7f5950072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 --2- 172.21.15.67:0/1350821171 >> v2:172.21.15.97:3300/0 conn(0x7f59500b4900 0x7f5950071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 --2- 172.21.15.67:0/1350821171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f595015b1e0 0x7f59500b2fd0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 -- 172.21.15.67:0/1350821171 >> 172.21.15.67:0/1350821171 conn(0x7f59500d0080 msgr2=0x7f59500d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 -- 172.21.15.67:0/1350821171 shutdown_connections 2024-09-19T05:45:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 -- 172.21.15.67:0/1350821171 wait complete. 2024-09-19T05:45:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 Processor -- start 2024-09-19T05:45:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 -- start start 2024-09-19T05:45:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 0x7f595014a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59500b4900 0x7f5950099470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f595015b1e0 0x7f5950147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f595015f650 con 0x7f59500b4900 2024-09-19T05:45:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f595015f4d0 con 0x7f595015b1e0 2024-09-19T05:45:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f5954fc0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f595015f7d0 con 0x7f59500723c0 2024-09-19T05:45:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59500b4900 0x7f5950099470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59500b4900 0x7f5950099470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34946/0 (socket says 172.21.15.67:34946) 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594dd9b640 1 -- 172.21.15.67:0/3977332614 learned_addr learned my addr 172.21.15.67:0/3977332614 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594e59c640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 0x7f595014a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594ed9d640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f595015b1e0 0x7f5950147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594dd9b640 1 -- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 msgr2=0x7f595014a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594dd9b640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 0x7f595014a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594dd9b640 1 -- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f595015b1e0 msgr2=0x7f5950147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594dd9b640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f595015b1e0 0x7f5950147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594dd9b640 1 -- 172.21.15.67:0/3977332614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595014fb00 con 0x7f59500b4900 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594e59c640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 0x7f595014a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594ed9d640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f595015b1e0 0x7f5950147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.267+0000 7f594dd9b640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59500b4900 0x7f5950099470 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f593800d800 tx=0x7f593800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f5946ffd640 1 -- 172.21.15.67:0/3977332614 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593800b6c0 con 0x7f59500b4900 2024-09-19T05:45:37.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f5946ffd640 1 -- 172.21.15.67:0/3977332614 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5938019070 con 0x7f59500b4900 2024-09-19T05:45:37.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f5954fc0640 1 -- 172.21.15.67:0/3977332614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595014fde0 con 0x7f59500b4900 2024-09-19T05:45:37.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f5946ffd640 1 -- 172.21.15.67:0/3977332614 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593800ba60 con 0x7f59500b4900 2024-09-19T05:45:37.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f5954fc0640 1 -- 172.21.15.67:0/3977332614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595015ca90 con 0x7f59500b4900 2024-09-19T05:45:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f5954fc0640 1 -- 172.21.15.67:0/3977332614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595015faa0 con 0x7f59500b4900 2024-09-19T05:45:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f5946ffd640 1 -- 172.21.15.67:0/3977332614 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f593800bc00 con 0x7f59500b4900 2024-09-19T05:45:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f5946ffd640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59300678c0 0x7f5930069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f5946ffd640 1 -- 172.21.15.67:0/3977332614 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5335+0+0 (secure 0 0 0) 0x7f5938085fa0 con 0x7f59500b4900 2024-09-19T05:45:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f594e59c640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59300678c0 0x7f5930069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.271+0000 7f594e59c640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59300678c0 0x7f5930069d80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f59400b0000 tx=0x7f59400a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:37.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.275+0000 7f5946ffd640 1 -- 172.21.15.67:0/3977332614 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5938056c50 con 0x7f59500b4900 2024-09-19T05:45:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.439+0000 7f5954fc0640 1 -- 172.21.15.67:0/3977332614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5950073af0 con 0x7f59500b4900 2024-09-19T05:45:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.439+0000 7f5946ffd640 1 -- 172.21.15.67:0/3977332614 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) ==== 74+0+13279 (secure 0 0 0) 0x7f5938056550 con 0x7f59500b4900 2024-09-19T05:45:37.438 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:37.438 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":160,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:45:36.103465+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/2824250574":"2024-09-20T05:45:33.088867+0000","172.21.15.97:6834/2824250574":"2024-09-20T05:45:33.088867+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:45:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 -- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59300678c0 msgr2=0x7f5930069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59300678c0 0x7f5930069d80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f59400b0000 tx=0x7f59400a9070 comp rx=0 tx=0).stop 2024-09-19T05:45:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 -- 172.21.15.67:0/3977332614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59500b4900 msgr2=0x7f5950099470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59500b4900 0x7f5950099470 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f593800d800 tx=0x7f593800dcc0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 -- 172.21.15.67:0/3977332614 shutdown_connections 2024-09-19T05:45:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f595015b1e0 0x7f5950147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59500b4900 0x7f5950099470 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59300678c0 0x7f5930069d80 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 --2- 172.21.15.67:0/3977332614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f59500723c0 0x7f595014a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 -- 172.21.15.67:0/3977332614 >> 172.21.15.67:0/3977332614 conn(0x7f59500d0080 msgr2=0x7f5950072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 -- 172.21.15.67:0/3977332614 shutdown_connections 2024-09-19T05:45:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.443+0000 7f5954fc0640 1 -- 172.21.15.67:0/3977332614 wait complete. 2024-09-19T05:45:37.458 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:45:37.458 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:45:37.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac7c8a640 1 Processor -- start 2024-09-19T05:45:37.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac7c8a640 1 -- start start 2024-09-19T05:45:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac7c8a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9ac015b1d0 0x7f9ac00adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac7c8a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac00aef30 con 0x7f9ac006dfc0 2024-09-19T05:45:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac7c8a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac00ae0f0 con 0x7f9ac0070070 2024-09-19T05:45:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac7c8a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac0072210 con 0x7f9ac015b1d0 2024-09-19T05:45:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac5225640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9ac006dfc0 0x7f9ac006f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:53662/0 (socket says 172.21.15.67:53662) 2024-09-19T05:45:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac5225640 1 -- 172.21.15.67:0/752585344 learned_addr learned my addr 172.21.15.67:0/752585344 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:37.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac5a26640 1 --2- 172.21.15.67:0/752585344 >> v2:172.21.15.97:3300/0 conn(0x7f9ac015b1d0 0x7f9ac00adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591575396 0 0) 0x7f9ac00aef30 con 0x7f9ac006dfc0 2024-09-19T05:45:37.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.591+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9aac003530 con 0x7f9ac006dfc0 2024-09-19T05:45:37.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2847005831 0 0) 0x7f9aac003530 con 0x7f9ac006dfc0 2024-09-19T05:45:37.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 >> v2:172.21.15.97:3300/0 conn(0x7f9ac015b1d0 msgr2=0x7f9ac00adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:37.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 --2- 172.21.15.67:0/752585344 >> v2:172.21.15.97:3300/0 conn(0x7f9ac015b1d0 0x7f9ac00adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 >> v1:172.21.15.97:6789/0 conn(0x7f9ac0070070 legacy=0x7f9ac00b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac00ae3b0 con 0x7f9ac006dfc0 2024-09-19T05:45:37.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9ab0001680 con 0x7f9ac006dfc0 2024-09-19T05:45:37.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 >> v1:172.21.15.67:6789/0 conn(0x7f9ac006dfc0 legacy=0x7f9ac006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9aac0039c0 0x7f9aac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac004810 0x7f9aac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9aac0051d0 0x7f9aac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac0072210 con 0x7f9aac004810 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac00c070 con 0x7f9aac0051d0 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9aac00c270 con 0x7f9aac0039c0 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac5225640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac004810 0x7f9aac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac6227640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9aac0051d0 0x7f9aac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac5a26640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9aac0039c0 0x7f9aac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac5225640 1 -- 172.21.15.67:0/752585344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9aac0039c0 msgr2=0x7f9aac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac5225640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9aac0039c0 0x7f9aac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac5225640 1 -- 172.21.15.67:0/752585344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9aac0051d0 msgr2=0x7f9aac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:37.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac5225640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9aac0051d0 0x7f9aac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac6227640 1 -- 172.21.15.67:0/752585344 reap_dead start 2024-09-19T05:45:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac5225640 1 -- 172.21.15.67:0/752585344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac003530 con 0x7f9aac004810 2024-09-19T05:45:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac5a26640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9aac0039c0 0x7f9aac003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac5225640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac004810 0x7f9aac004c90 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c240 tx=0x7f9ab001f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ec51e8f03db4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0007d20 con 0x7f9aac004810 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab0005ae0 con 0x7f9aac004810 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.595+0000 7f9ac4a24640 1 -- 172.21.15.67:0/752585344 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0007070 con 0x7f9aac004810 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/752585344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac004810 msgr2=0x7f9aac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac004810 0x7f9aac004c90 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c240 tx=0x7f9ab001f3f0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/752585344 shutdown_connections 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 --2- 172.21.15.67:0/752585344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac004810 0x7f9aac004c90 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/752585344 >> 172.21.15.67:0/752585344 conn(0x7f9ac00b1e50 msgr2=0x7f9ac00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/752585344 shutdown_connections 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/752585344 wait complete. 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 Processor -- start 2024-09-19T05:45:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 -- start start 2024-09-19T05:45:37.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9aac004810 0x7f9ac0158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac014da10 0x7f9ac0152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ac0152e50 0x7f9ac0153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac00aec50 con 0x7f9ac014da10 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac00ae970 con 0x7f9aac004810 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac0072420 con 0x7f9ac0152e50 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5225640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac014da10 0x7f9ac0152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5225640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac014da10 0x7f9ac0152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34958/0 (socket says 172.21.15.67:34958) 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5225640 1 -- 172.21.15.67:0/3337948317 learned_addr learned my addr 172.21.15.67:0/3337948317 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5a26640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9aac004810 0x7f9ac0158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5225640 1 -- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ac0152e50 msgr2=0x7f9ac0153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac6227640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ac0152e50 0x7f9ac0153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5225640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ac0152e50 0x7f9ac0153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5225640 1 -- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9aac004810 msgr2=0x7f9ac0158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5225640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9aac004810 0x7f9ac0158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5225640 1 -- 172.21.15.67:0/3337948317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac01536b0 con 0x7f9ac014da10 2024-09-19T05:45:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5a26640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9aac004810 0x7f9ac0158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac5225640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac014da10 0x7f9ac0152910 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f9ab001f220 tx=0x7f9aac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ab67fc640 1 -- 172.21.15.67:0/3337948317 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0007d20 con 0x7f9ac014da10 2024-09-19T05:45:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ab67fc640 1 -- 172.21.15.67:0/3337948317 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab0007690 con 0x7f9ac014da10 2024-09-19T05:45:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/3337948317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac01533d0 con 0x7f9ac014da10 2024-09-19T05:45:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.599+0000 7f9ab67fc640 1 -- 172.21.15.67:0/3337948317 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0001640 con 0x7f9ac014da10 2024-09-19T05:45:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.603+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/3337948317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac014f8d0 con 0x7f9ac014da10 2024-09-19T05:45:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.603+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/3337948317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac0068530 con 0x7f9ac014da10 2024-09-19T05:45:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.603+0000 7f9ab67fc640 1 -- 172.21.15.67:0/3337948317 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ab00047f0 con 0x7f9ac014da10 2024-09-19T05:45:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.603+0000 7f9ab67fc640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9aa40678f0 0x7f9aa4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.603+0000 7f9ab67fc640 1 -- 172.21.15.67:0/3337948317 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5335+0+0 (secure 0 0 0) 0x7f9ab0122e50 con 0x7f9ac014da10 2024-09-19T05:45:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.603+0000 7f9ac5a26640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9aa40678f0 0x7f9aa4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.603+0000 7f9ac5a26640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9aa40678f0 0x7f9aa4069db0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0154fb0 tx=0x7f9abc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:37.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.607+0000 7f9ab67fc640 1 -- 172.21.15.67:0/3337948317 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9ab0019100 con 0x7f9ac014da10 2024-09-19T05:45:37.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.783+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/3337948317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9ac00aef30 con 0x7f9ac014da10 2024-09-19T05:45:37.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.783+0000 7f9ab67fc640 1 -- 172.21.15.67:0/3337948317 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) ==== 93+0+10 (secure 0 0 0) 0x7f9ab00f3ae0 con 0x7f9ac014da10 2024-09-19T05:45:37.782 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:45:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9aa40678f0 msgr2=0x7f9aa4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9aa40678f0 0x7f9aa4069db0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0154fb0 tx=0x7f9abc008040 comp rx=0 tx=0).stop 2024-09-19T05:45:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/3337948317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac014da10 msgr2=0x7f9ac0152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac014da10 0x7f9ac0152910 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f9ab001f220 tx=0x7f9aac005840 comp rx=0 tx=0).stop 2024-09-19T05:45:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/3337948317 shutdown_connections 2024-09-19T05:45:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9aa40678f0 0x7f9aa4069db0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ac0152e50 0x7f9ac0153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac014da10 0x7f9ac0152910 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 --2- 172.21.15.67:0/3337948317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9aac004810 0x7f9ac0158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/3337948317 >> 172.21.15.67:0/3337948317 conn(0x7f9ac00b1e50 msgr2=0x7f9ac00b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:37.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.787+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/3337948317 shutdown_connections 2024-09-19T05:45:37.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.791+0000 7f9ac7c8a640 1 -- 172.21.15.67:0/3337948317 wait complete. 2024-09-19T05:45:37.809 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-19T05:45:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.931+0000 7f0e1d018640 1 Processor -- start 2024-09-19T05:45:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.931+0000 7f0e1d018640 1 -- start start 2024-09-19T05:45:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.931+0000 7f0e1d018640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0e18159d60 0x7f0e1806ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.931+0000 7f0e1d018640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180b36e0 0x7f0e180acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.931+0000 7f0e1d018640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1806de80 con 0x7f0e1806f460 2024-09-19T05:45:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.931+0000 7f0e1d018640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1806e160 con 0x7f0e18159d60 2024-09-19T05:45:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.931+0000 7f0e1d018640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1806e440 con 0x7f0e180b36e0 2024-09-19T05:45:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.931+0000 7f0e1659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0e1806f460 0x7f0e180b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:53666/0 (socket says 172.21.15.67:53666) 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.931+0000 7f0e1659c640 1 -- 172.21.15.67:0/2106543116 learned_addr learned my addr 172.21.15.67:0/2106543116 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799224251 0 0) 0x7f0e1806de80 con 0x7f0e1806f460 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e00003530 con 0x7f0e1806f460 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e16d9d640 1 --2- 172.21.15.67:0/2106543116 >> v2:172.21.15.97:3300/0 conn(0x7f0e18159d60 0x7f0e1806ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e1759e640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180b36e0 0x7f0e180acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1714547127 0 0) 0x7f0e00003530 con 0x7f0e1806f460 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180b36e0 msgr2=0x7f0e180acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180b36e0 0x7f0e180acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 >> v2:172.21.15.97:3300/0 conn(0x7f0e18159d60 msgr2=0x7f0e1806ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 --2- 172.21.15.67:0/2106543116 >> v2:172.21.15.97:3300/0 conn(0x7f0e18159d60 0x7f0e1806ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1806e720 con 0x7f0e1806f460 2024-09-19T05:45:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f0e0c0016a0 con 0x7f0e1806f460 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 >> v1:172.21.15.67:6789/0 conn(0x7f0e1806f460 legacy=0x7f0e180b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 0x7f0e00003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e00004810 0x7f0e00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e000051d0 0x7f0e0000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1806e160 con 0x7f0e000039c0 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1806e440 con 0x7f0e00004810 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0e00004600 con 0x7f0e000051d0 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e16d9d640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 0x7f0e00003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e1659c640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e00004810 0x7f0e00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e1759e640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e000051d0 0x7f0e0000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e16d9d640 1 -- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e000051d0 msgr2=0x7f0e0000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e16d9d640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e000051d0 0x7f0e0000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e16d9d640 1 -- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e00004810 msgr2=0x7f0e00004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:37.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e16d9d640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e00004810 0x7f0e00004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e16d9d640 1 -- 172.21.15.67:0/2106543116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e00003530 con 0x7f0e000039c0 2024-09-19T05:45:37.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e1759e640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e000051d0 0x7f0e0000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:37.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e16d9d640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 0x7f0e00003de0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009b10 tx=0x7f0e0801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f755f5427b62dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080b2070 con 0x7f0e000039c0 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e080a55f0 con 0x7f0e000039c0 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.935+0000 7f0e15d9b640 1 -- 172.21.15.67:0/2106543116 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080096b0 con 0x7f0e000039c0 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- 172.21.15.67:0/2106543116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 msgr2=0x7f0e00003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 --2- 172.21.15.67:0/2106543116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 0x7f0e00003de0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009b10 tx=0x7f0e0801ca80 comp rx=0 tx=0).stop 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1759e640 1 -- 172.21.15.67:0/2106543116 reap_dead start 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- 172.21.15.67:0/2106543116 shutdown_connections 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- 172.21.15.67:0/2106543116 >> 172.21.15.67:0/2106543116 conn(0x7f0e180d0080 msgr2=0x7f0e180d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- 172.21.15.67:0/2106543116 shutdown_connections 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- 172.21.15.67:0/2106543116 wait complete. 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 Processor -- start 2024-09-19T05:45:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- start start 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 0x7f0e180b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180b1650 0x7f0e1814afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18154e30 0x7f0e181552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0e180af230 con 0x7f0e000039c0 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0e180af0b0 con 0x7f0e18154e30 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0e180af3b0 con 0x7f0e180b1650 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e16d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 0x7f0e180b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e16d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 0x7f0e180b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34966/0 (socket says 172.21.15.67:34966) 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e16d9d640 1 -- 172.21.15.67:0/1160721614 learned_addr learned my addr 172.21.15.67:0/1160721614 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1659c640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180b1650 0x7f0e1814afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1759e640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18154e30 0x7f0e181552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e16d9d640 1 -- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180b1650 msgr2=0x7f0e1814afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e16d9d640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180b1650 0x7f0e1814afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e16d9d640 1 -- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18154e30 msgr2=0x7f0e181552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e16d9d640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18154e30 0x7f0e181552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e16d9d640 1 -- 172.21.15.67:0/1160721614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1809e100 con 0x7f0e000039c0 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1759e640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18154e30 0x7f0e181552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e16d9d640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 0x7f0e180b03c0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f0e0801c8b0 tx=0x7f0e00005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0dff7fe640 1 -- 172.21.15.67:0/1160721614 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080bc030 con 0x7f0e000039c0 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0dff7fe640 1 -- 172.21.15.67:0/1160721614 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e080a5e20 con 0x7f0e000039c0 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0dff7fe640 1 -- 172.21.15.67:0/1160721614 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080b2040 con 0x7f0e000039c0 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- 172.21.15.67:0/1160721614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e180b0900 con 0x7f0e000039c0 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.939+0000 7f0e1d018640 1 -- 172.21.15.67:0/1160721614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1809de20 con 0x7f0e000039c0 2024-09-19T05:45:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.943+0000 7f0e1d018640 1 -- 172.21.15.67:0/1160721614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e180af7a0 con 0x7f0e000039c0 2024-09-19T05:45:37.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.943+0000 7f0dff7fe640 1 -- 172.21.15.67:0/1160721614 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e080bf070 con 0x7f0e000039c0 2024-09-19T05:45:37.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.943+0000 7f0dff7fe640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e040678c0 0x7f0e04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:37.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.943+0000 7f0dff7fe640 1 -- 172.21.15.67:0/1160721614 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5335+0+0 (secure 0 0 0) 0x7f0e0811fa60 con 0x7f0e000039c0 2024-09-19T05:45:37.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.943+0000 7f0e1659c640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e040678c0 0x7f0e04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:37.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.943+0000 7f0e1659c640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e040678c0 0x7f0e04069d80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0e18155a10 tx=0x7f0e0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:37.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:37.947+0000 7f0dff7fe640 1 -- 172.21.15.67:0/1160721614 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0e180b0900 con 0x7f0e000039c0 2024-09-19T05:45:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:38.175+0000 7f0e1d018640 1 -- 172.21.15.67:0/1160721614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f0e180d0f20 con 0x7f0e000039c0 2024-09-19T05:45:39.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.126+0000 7f0dff7fe640 1 -- 172.21.15.67:0/1160721614 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v558) ==== 169+0+0 (secure 0 0 0) 0x7f0e1809e100 con 0x7f0e000039c0 2024-09-19T05:45:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 -- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e040678c0 msgr2=0x7f0e04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e040678c0 0x7f0e04069d80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0e18155a10 tx=0x7f0e0c009040 comp rx=0 tx=0).stop 2024-09-19T05:45:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 -- 172.21.15.67:0/1160721614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 msgr2=0x7f0e180b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 0x7f0e180b03c0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f0e0801c8b0 tx=0x7f0e00005840 comp rx=0 tx=0).stop 2024-09-19T05:45:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 -- 172.21.15.67:0/1160721614 shutdown_connections 2024-09-19T05:45:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e18154e30 0x7f0e181552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0e040678c0 0x7f0e04069d80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180b1650 0x7f0e1814afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 --2- 172.21.15.67:0/1160721614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e000039c0 0x7f0e180b03c0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 -- 172.21.15.67:0/1160721614 >> 172.21.15.67:0/1160721614 conn(0x7f0e180d0080 msgr2=0x7f0e1806c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 -- 172.21.15.67:0/1160721614 shutdown_connections 2024-09-19T05:45:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.130+0000 7f0e1d018640 1 -- 172.21.15.67:0/1160721614 wait complete. 2024-09-19T05:45:39.152 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:45:39.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f26382a8640 1 Processor -- start 2024-09-19T05:45:39.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f26382a8640 1 -- start start 2024-09-19T05:45:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f26382a8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2630159c60 0x7f26300ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f26382a8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f263015a040 con 0x7f26300af3a0 2024-09-19T05:45:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f26382a8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f263015c850 con 0x7f263006ffd0 2024-09-19T05:45:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f26382a8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f263015d460 con 0x7f2630159c60 2024-09-19T05:45:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636845640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f26300af3a0 0x7f263015fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:53668/0 (socket says 172.21.15.67:53668) 2024-09-19T05:45:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636845640 1 -- 172.21.15.67:0/3553381047 learned_addr learned my addr 172.21.15.67:0/3553381047 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636044640 1 --2- 172.21.15.67:0/3553381047 >> v2:172.21.15.97:3300/0 conn(0x7f2630159c60 0x7f26300ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419514091 0 0) 0x7f263015a040 con 0x7f26300af3a0 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f261c003530 con 0x7f26300af3a0 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3947527034 0 0) 0x7f261c003530 con 0x7f26300af3a0 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 >> v2:172.21.15.97:3300/0 conn(0x7f2630159c60 msgr2=0x7f26300ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 --2- 172.21.15.67:0/3553381047 >> v2:172.21.15.97:3300/0 conn(0x7f2630159c60 0x7f26300ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 >> v1:172.21.15.97:6789/0 conn(0x7f263006ffd0 legacy=0x7f26300aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263015cb30 con 0x7f26300af3a0 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f2628001a00 con 0x7f26300af3a0 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 >> v1:172.21.15.67:6789/0 conn(0x7f26300af3a0 legacy=0x7f263015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f261c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f261c004810 0x7f261c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f261c0051d0 0x7f261c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f263015d460 con 0x7f261c0039c0 2024-09-19T05:45:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f261c00c070 con 0x7f261c004810 2024-09-19T05:45:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f261c00c270 con 0x7f261c0051d0 2024-09-19T05:45:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636044640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f261c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2635843640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f261c004810 0x7f261c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636845640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f261c0051d0 0x7f261c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636044640 1 -- 172.21.15.67:0/3553381047 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f261c0051d0 msgr2=0x7f261c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636044640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f261c0051d0 0x7f261c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636044640 1 -- 172.21.15.67:0/3553381047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f261c004810 msgr2=0x7f261c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636044640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f261c004810 0x7f261c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636044640 1 -- 172.21.15.67:0/3553381047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261c003530 con 0x7f261c0039c0 2024-09-19T05:45:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.290+0000 7f2636845640 1 -- 172.21.15.67:0/3553381047 reap_dead start 2024-09-19T05:45:39.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.294+0000 7f2636044640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f261c003de0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f262c009ae0 tx=0x7f262c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdb55e2345a2aa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:39.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.294+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c0096b0 con 0x7f261c0039c0 2024-09-19T05:45:39.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.294+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c0a9420 con 0x7f261c0039c0 2024-09-19T05:45:39.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.294+0000 7f2635042640 1 -- 172.21.15.67:0/3553381047 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c0a9810 con 0x7f261c0039c0 2024-09-19T05:45:39.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- 172.21.15.67:0/3553381047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 msgr2=0x7f261c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f261c003de0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f262c009ae0 tx=0x7f262c01ca60 comp rx=0 tx=0).stop 2024-09-19T05:45:39.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- 172.21.15.67:0/3553381047 shutdown_connections 2024-09-19T05:45:39.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 --2- 172.21.15.67:0/3553381047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f261c003de0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- 172.21.15.67:0/3553381047 >> 172.21.15.67:0/3553381047 conn(0x7f26300b1e50 msgr2=0x7f26300b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:39.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- 172.21.15.67:0/3553381047 shutdown_connections 2024-09-19T05:45:39.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- 172.21.15.67:0/3553381047 wait complete. 2024-09-19T05:45:39.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 Processor -- start 2024-09-19T05:45:39.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- start start 2024-09-19T05:45:39.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f26300739e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26301580a0 0x7f2630158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263014fa40 0x7f263014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f263015ff20 con 0x7f261c0039c0 2024-09-19T05:45:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f263015fda0 con 0x7f263014fa40 2024-09-19T05:45:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f26301600a0 con 0x7f26301580a0 2024-09-19T05:45:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2636044640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f26300739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2636044640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f26300739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34974/0 (socket says 172.21.15.67:34974) 2024-09-19T05:45:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2636044640 1 -- 172.21.15.67:0/3984262769 learned_addr learned my addr 172.21.15.67:0/3984262769 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2636845640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263014fa40 0x7f263014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2635843640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26301580a0 0x7f2630158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2636044640 1 -- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26301580a0 msgr2=0x7f2630158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2636044640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26301580a0 0x7f2630158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2636044640 1 -- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263014fa40 msgr2=0x7f263014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2636044640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263014fa40 0x7f263014fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2636044640 1 -- 172.21.15.67:0/3984262769 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26301f8140 con 0x7f261c0039c0 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2635843640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26301580a0 0x7f2630158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2636044640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f26300739e0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f262c01c890 tx=0x7f262c01b2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2626ffd640 1 -- 172.21.15.67:0/3984262769 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c0a99e0 con 0x7f261c0039c0 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2626ffd640 1 -- 172.21.15.67:0/3984262769 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c0be070 con 0x7f261c0039c0 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- 172.21.15.67:0/3984262769 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26301f8420 con 0x7f261c0039c0 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f2626ffd640 1 -- 172.21.15.67:0/3984262769 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c0a9d80 con 0x7f261c0039c0 2024-09-19T05:45:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.298+0000 7f26382a8640 1 -- 172.21.15.67:0/3984262769 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26301f89e0 con 0x7f261c0039c0 2024-09-19T05:45:39.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.302+0000 7f26382a8640 1 -- 172.21.15.67:0/3984262769 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26301f7ec0 con 0x7f261c0039c0 2024-09-19T05:45:39.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.302+0000 7f2626ffd640 1 -- 172.21.15.67:0/3984262769 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f262c0c3460 con 0x7f261c0039c0 2024-09-19T05:45:39.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.302+0000 7f2626ffd640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26140678f0 0x7f2614069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.302+0000 7f2626ffd640 1 -- 172.21.15.67:0/3984262769 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5335+0+0 (secure 0 0 0) 0x7f262c120110 con 0x7f261c0039c0 2024-09-19T05:45:39.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.302+0000 7f2635843640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26140678f0 0x7f2614069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.302+0000 7f2635843640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26140678f0 0x7f2614069db0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2620000c10 tx=0x7f2620009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.306+0000 7f2626ffd640 1 -- 172.21.15.67:0/3984262769 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f26301f7ec0 con 0x7f261c0039c0 2024-09-19T05:45:39.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.470+0000 7f26382a8640 1 -- 172.21.15.67:0/3984262769 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2630158b20 con 0x7f261c0039c0 2024-09-19T05:45:39.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.478+0000 7f2626ffd640 1 -- 172.21.15.67:0/3984262769 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f262c0ad020 con 0x7f261c0039c0 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.478+0000 7f26382a8640 1 -- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26140678f0 msgr2=0x7f2614069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.478+0000 7f26382a8640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26140678f0 0x7f2614069db0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2620000c10 tx=0x7f2620009040 comp rx=0 tx=0).stop 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.478+0000 7f26382a8640 1 -- 172.21.15.67:0/3984262769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 msgr2=0x7f26300739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.478+0000 7f26382a8640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f26300739e0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f262c01c890 tx=0x7f262c01b2a0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.478+0000 7f26382a8640 1 -- 172.21.15.67:0/3984262769 shutdown_connections 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.482+0000 7f26382a8640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263014fa40 0x7f263014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.482+0000 7f26382a8640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26140678f0 0x7f2614069db0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.482+0000 7f26382a8640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26301580a0 0x7f2630158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.482+0000 7f26382a8640 1 --2- 172.21.15.67:0/3984262769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f261c0039c0 0x7f26300739e0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.482+0000 7f26382a8640 1 -- 172.21.15.67:0/3984262769 >> 172.21.15.67:0/3984262769 conn(0x7f26300b1e50 msgr2=0x7f263015b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.482+0000 7f26382a8640 1 -- 172.21.15.67:0/3984262769 shutdown_connections 2024-09-19T05:45:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.482+0000 7f26382a8640 1 -- 172.21.15.67:0/3984262769 wait complete. 2024-09-19T05:45:39.497 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:45:39.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:45:39.568 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:45:39.646 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:45:39.646 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:45:39.646 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:45:39.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:45:39.652 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:45:39.652 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:45:39.659 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:45:39.659 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:45:39.659 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:45:39.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:45:39.700 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:45:39.700 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:45:39.706 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:45:39.706 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:45:39.706 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:39.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787ef87640 1 Processor -- start 2024-09-19T05:45:39.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787ef87640 1 -- start start 2024-09-19T05:45:39.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787ef87640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f787813f270 0x7f7878140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787ef87640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7878140980 0x7f787806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787ef87640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7878140e70 con 0x7f787806d210 2024-09-19T05:45:39.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787ef87640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f787806d670 con 0x7f787813f270 2024-09-19T05:45:39.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787ef87640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7878141150 con 0x7f7878140980 2024-09-19T05:45:39.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787d524640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f787806d210 0x7f7878141ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:53672/0 (socket says 172.21.15.67:53672) 2024-09-19T05:45:39.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787d524640 1 -- 172.21.15.67:0/253102207 learned_addr learned my addr 172.21.15.67:0/253102207 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:39.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787cd23640 1 --2- 172.21.15.67:0/253102207 >> v2:172.21.15.97:3300/0 conn(0x7f787813f270 0x7f7878140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f7877fff640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7878140980 0x7f787806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154385924 0 0) 0x7f7878140e70 con 0x7f787806d210 2024-09-19T05:45:39.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7868003530 con 0x7f787806d210 2024-09-19T05:45:39.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 238451330 0 0) 0x7f7868003530 con 0x7f787806d210 2024-09-19T05:45:39.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7878140980 msgr2=0x7f787806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7878140980 0x7f787806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 >> v2:172.21.15.97:3300/0 conn(0x7f787813f270 msgr2=0x7f7878140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 --2- 172.21.15.67:0/253102207 >> v2:172.21.15.97:3300/0 conn(0x7f787813f270 0x7f7878140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7878141430 con 0x7f787806d210 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7870001a00 con 0x7f787806d210 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f7877fff640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7878140980 0x7f787806ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 >> v1:172.21.15.67:6789/0 conn(0x7f787806d210 legacy=0x7f7878141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78680039c0 0x7f7868003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7878140980 0x7f7868004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7868004d50 0x7f78680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7878141150 con 0x7f78680039c0 2024-09-19T05:45:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f786800b9d0 con 0x7f7868004d50 2024-09-19T05:45:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f786800bbd0 con 0x7f7878140980 2024-09-19T05:45:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787cd23640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78680039c0 0x7f7868003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f7877fff640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7878140980 0x7f7868004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787d524640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7868004d50 0x7f78680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787cd23640 1 -- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7878140980 msgr2=0x7f7868004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787cd23640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7878140980 0x7f7868004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787cd23640 1 -- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7868004d50 msgr2=0x7f78680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787cd23640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7868004d50 0x7f78680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.878+0000 7f787cd23640 1 -- 172.21.15.67:0/253102207 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7868003530 con 0x7f78680039c0 2024-09-19T05:45:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f787cd23640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78680039c0 0x7f7868003de0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f786c009ae0 tx=0x7f786c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240240d88fd63051 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c0b2070 con 0x7f78680039c0 2024-09-19T05:45:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786c0a5650 con 0x7f78680039c0 2024-09-19T05:45:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f78777fe640 1 -- 172.21.15.67:0/253102207 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c0096b0 con 0x7f78680039c0 2024-09-19T05:45:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f787ef87640 1 -- 172.21.15.67:0/253102207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78680039c0 msgr2=0x7f7868003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f787ef87640 1 --2- 172.21.15.67:0/253102207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78680039c0 0x7f7868003de0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f786c009ae0 tx=0x7f786c01ca80 comp rx=0 tx=0).stop 2024-09-19T05:45:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f787d524640 1 -- 172.21.15.67:0/253102207 reap_dead start 2024-09-19T05:45:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f787ef87640 1 -- 172.21.15.67:0/253102207 shutdown_connections 2024-09-19T05:45:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f787ef87640 1 -- 172.21.15.67:0/253102207 >> 172.21.15.67:0/253102207 conn(0x7f7878072800 msgr2=0x7f7878072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f787ef87640 1 -- 172.21.15.67:0/253102207 shutdown_connections 2024-09-19T05:45:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.882+0000 7f787ef87640 1 -- 172.21.15.67:0/253102207 wait complete. 2024-09-19T05:45:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 Processor -- start 2024-09-19T05:45:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 -- start start 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78680039c0 0x7f78780caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78780cb430 0x7f78781f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78781f7960 0x7f78781f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f787815cb40 con 0x7f78780cb430 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f787815c9c0 con 0x7f78680039c0 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7878166df0 con 0x7f78781f7960 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f7877fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78780cb430 0x7f78781f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f7877fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78780cb430 0x7f78781f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34990/0 (socket says 172.21.15.67:34990) 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f7877fff640 1 -- 172.21.15.67:0/1864147015 learned_addr learned my addr 172.21.15.67:0/1864147015 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787cd23640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78680039c0 0x7f78780caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787d524640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78781f7960 0x7f78781f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f7877fff640 1 -- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78781f7960 msgr2=0x7f78781f7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f7877fff640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78781f7960 0x7f78781f7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f7877fff640 1 -- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78680039c0 msgr2=0x7f78780caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f7877fff640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78680039c0 0x7f78780caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f7877fff640 1 -- 172.21.15.67:0/1864147015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78780cba40 con 0x7f78780cb430 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f7877fff640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78780cb430 0x7f78781f7420 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f78640108f0 tx=0x7f7864010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f78757fa640 1 -- 172.21.15.67:0/1864147015 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786401a020 con 0x7f78780cb430 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f78757fa640 1 -- 172.21.15.67:0/1864147015 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786400cae0 con 0x7f78780cb430 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 -- 172.21.15.67:0/1864147015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78780cbd20 con 0x7f78780cb430 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f78757fa640 1 -- 172.21.15.67:0/1864147015 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786400e050 con 0x7f78780cb430 2024-09-19T05:45:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 -- 172.21.15.67:0/1864147015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78780cc2e0 con 0x7f78780cb430 2024-09-19T05:45:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f787ef87640 1 -- 172.21.15.67:0/1864147015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7878140440 con 0x7f78780cb430 2024-09-19T05:45:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.886+0000 7f78757fa640 1 -- 172.21.15.67:0/1864147015 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f786401d020 con 0x7f78780cb430 2024-09-19T05:45:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.890+0000 7f78757fa640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f785c0678f0 0x7f785c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.890+0000 7f78757fa640 1 -- 172.21.15.67:0/1864147015 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5335+0+0 (secure 0 0 0) 0x7f7864086160 con 0x7f78780cb430 2024-09-19T05:45:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.890+0000 7f787cd23640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f785c0678f0 0x7f785c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.890+0000 7f787cd23640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f785c0678f0 0x7f785c069db0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f786c0af000 tx=0x7f786c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:39.894+0000 7f78757fa640 1 -- 172.21.15.67:0/1864147015 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7864024020 con 0x7f78780cb430 2024-09-19T05:45:40.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.086+0000 7f787ef87640 1 -- 172.21.15.67:0/1864147015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f787813e080 con 0x7f78780cb430 2024-09-19T05:45:40.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f78757fa640 1 -- 172.21.15.67:0/1864147015 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+3913 (secure 0 0 0) 0x7f7864056e10 con 0x7f78780cb430 2024-09-19T05:45:40.087 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:40.087 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":108,"btime":"2024-09-19T05:45:34:092279+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2810676794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2810676794},{"type":"v1","addr":"172.21.15.97:6837","nonce":2810676794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/1746917835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1746917835},{"type":"v1","addr":"172.21.15.67:6834","nonce":1746917835}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9054,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/366411895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":366411895},{"type":"v1","addr":"172.21.15.67:6835","nonce":366411895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":9501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3691642611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3691642611},{"type":"v1","addr":"172.21.15.97:6835","nonce":3691642611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[]} 2024-09-19T05:45:40.088 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 108 2024-09-19T05:45:40.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 -- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f785c0678f0 msgr2=0x7f785c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f785c0678f0 0x7f785c069db0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f786c0af000 tx=0x7f786c0046d0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 -- 172.21.15.67:0/1864147015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78780cb430 msgr2=0x7f78781f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78780cb430 0x7f78781f7420 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f78640108f0 tx=0x7f7864010db0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 -- 172.21.15.67:0/1864147015 shutdown_connections 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f785c0678f0 0x7f785c069db0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f78781f7960 0x7f78781f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78780cb430 0x7f78781f7420 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 --2- 172.21.15.67:0/1864147015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78680039c0 0x7f78780caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 -- 172.21.15.67:0/1864147015 >> 172.21.15.67:0/1864147015 conn(0x7f7878072800 msgr2=0x7f787815f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 -- 172.21.15.67:0/1864147015 shutdown_connections 2024-09-19T05:45:40.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.090+0000 7f787ef87640 1 -- 172.21.15.67:0/1864147015 wait complete. 2024-09-19T05:45:40.106 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:45:40.106 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:45:40.107 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:45:40.107 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:45:40.107 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:45:40.107 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:45:40.107 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:45:40.107 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:45:40.108 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:45:40.108 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:45:40.108 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:45:40.108 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:45:40.108 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:45:40.108 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:45:40.108 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:45:40.109 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:45:40.116 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:45:40.116 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:45:40.117 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:45:40.117 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:45:40.122 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:45:40.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:45:40.124 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:45:40.124 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:45:40.164 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:45:40.165 DEBUG:teuthology.parallel:result is None 2024-09-19T05:45:40.165 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:45:40.165 DEBUG:teuthology.parallel:result is None 2024-09-19T05:45:40.170 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:45:40.170 DEBUG:teuthology.parallel:result is None 2024-09-19T05:45:40.171 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:45:40.171 DEBUG:teuthology.parallel:result is None 2024-09-19T05:45:40.171 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:45:40.223 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:45:40.227 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:45:40.242 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:45:40.244 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:45:40.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e92821640 1 Processor -- start 2024-09-19T05:45:40.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e92821640 1 -- start start 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e92821640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 0x7f7e8c0b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e92821640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7e8c1609b0 0x7f7e8c1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e92821640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e8c0afee0 0x7f7e8c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e92821640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7e8c0b5cf0 con 0x7f7e8c0afee0 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e92821640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7e8c160610 con 0x7f7e8c1609b0 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e92821640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c0b4710 con 0x7f7e8c15fcf0 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e90dbe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e8c0afee0 0x7f7e8c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e90dbe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e8c0afee0 0x7f7e8c15d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35012/0 (socket says 172.21.15.67:35012) 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e90dbe640 1 -- 172.21.15.67:0/686860003 learned_addr learned my addr 172.21.15.67:0/686860003 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e8bfff640 1 --2- 172.21.15.67:0/686860003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 0x7f7e8c0b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e8b7fe640 1 --2- 172.21.15.67:0/686860003 >> v2:172.21.15.97:3300/0 conn(0x7f7e8c1609b0 0x7f7e8c1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e90dbe640 1 -- 172.21.15.67:0/686860003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 msgr2=0x7f7e8c0b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e90dbe640 1 --2- 172.21.15.67:0/686860003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 0x7f7e8c0b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e90dbe640 1 -- 172.21.15.67:0/686860003 >> v2:172.21.15.97:3300/0 conn(0x7f7e8c1609b0 msgr2=0x7f7e8c1600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e90dbe640 1 --2- 172.21.15.67:0/686860003 >> v2:172.21.15.97:3300/0 conn(0x7f7e8c1609b0 0x7f7e8c1600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e90dbe640 1 -- 172.21.15.67:0/686860003 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c0b49f0 con 0x7f7e8c0afee0 2024-09-19T05:45:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e8b7fe640 1 --2- 172.21.15.67:0/686860003 >> v2:172.21.15.97:3300/0 conn(0x7f7e8c1609b0 0x7f7e8c1600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.286+0000 7f7e8bfff640 1 --2- 172.21.15.67:0/686860003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 0x7f7e8c0b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:40.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e90dbe640 1 --2- 172.21.15.67:0/686860003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 0x7f7e8c15d8c0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c073fc0 tx=0x7f7e8401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7aaceb8df4340a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:40.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e8affd640 1 -- 172.21.15.67:0/686860003 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840a5730 con 0x7f7e8c0afee0 2024-09-19T05:45:40.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e8affd640 1 -- 172.21.15.67:0/686860003 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e840a58d0 con 0x7f7e8c0afee0 2024-09-19T05:45:40.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e8affd640 1 -- 172.21.15.67:0/686860003 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840a5ca0 con 0x7f7e8c0afee0 2024-09-19T05:45:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 -- 172.21.15.67:0/686860003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 msgr2=0x7f7e8c15d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 --2- 172.21.15.67:0/686860003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 0x7f7e8c15d8c0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c073fc0 tx=0x7f7e8401c930 comp rx=0 tx=0).stop 2024-09-19T05:45:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 -- 172.21.15.67:0/686860003 shutdown_connections 2024-09-19T05:45:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 --2- 172.21.15.67:0/686860003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 0x7f7e8c15d8c0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 --2- 172.21.15.67:0/686860003 >> v2:172.21.15.97:3300/0 conn(0x7f7e8c1609b0 0x7f7e8c1600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 --2- 172.21.15.67:0/686860003 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 0x7f7e8c0b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 -- 172.21.15.67:0/686860003 >> 172.21.15.67:0/686860003 conn(0x7f7e8c073500 msgr2=0x7f7e8c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 -- 172.21.15.67:0/686860003 shutdown_connections 2024-09-19T05:45:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 -- 172.21.15.67:0/686860003 wait complete. 2024-09-19T05:45:40.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 Processor -- start 2024-09-19T05:45:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.290+0000 7f7e92821640 1 -- start start 2024-09-19T05:45:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e92821640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 0x7f7e8c1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e92821640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 0x7f7e8c0b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e92821640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e8c1609b0 0x7f7e8c0b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e92821640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c15c3f0 con 0x7f7e8c0afee0 2024-09-19T05:45:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e92821640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c0b0370 con 0x7f7e8c1609b0 2024-09-19T05:45:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e92821640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c15c570 con 0x7f7e8c15fcf0 2024-09-19T05:45:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 0x7f7e8c1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 0x7f7e8c1514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35026/0 (socket says 172.21.15.67:35026) 2024-09-19T05:45:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8bfff640 1 -- 172.21.15.67:0/3394010363 learned_addr learned my addr 172.21.15.67:0/3394010363 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e90dbe640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e8c1609b0 0x7f7e8c0b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8b7fe640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 0x7f7e8c0b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8bfff640 1 -- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 msgr2=0x7f7e8c0b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8bfff640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 0x7f7e8c0b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8bfff640 1 -- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e8c1609b0 msgr2=0x7f7e8c0b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8bfff640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e8c1609b0 0x7f7e8c0b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8bfff640 1 -- 172.21.15.67:0/3394010363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c1623e0 con 0x7f7e8c0afee0 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8bfff640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 0x7f7e8c1514e0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c7c0 tx=0x7f7e7c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e88ff9640 1 -- 172.21.15.67:0/3394010363 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c015070 con 0x7f7e8c0afee0 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e88ff9640 1 -- 172.21.15.67:0/3394010363 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c007a30 con 0x7f7e8c0afee0 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e92821640 1 -- 172.21.15.67:0/3394010363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c1626c0 con 0x7f7e8c0afee0 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e88ff9640 1 -- 172.21.15.67:0/3394010363 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c007e00 con 0x7f7e8c0afee0 2024-09-19T05:45:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e92821640 1 -- 172.21.15.67:0/3394010363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c162c80 con 0x7f7e8c0afee0 2024-09-19T05:45:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e92821640 1 -- 172.21.15.67:0/3394010363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c0b57b0 con 0x7f7e8c0afee0 2024-09-19T05:45:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e88ff9640 1 -- 172.21.15.67:0/3394010363 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e7c018070 con 0x7f7e8c0afee0 2024-09-19T05:45:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e88ff9640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e780678c0 0x7f7e78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e88ff9640 1 -- 172.21.15.67:0/3394010363 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5335+0+0 (secure 0 0 0) 0x7f7e7c085a80 con 0x7f7e8c0afee0 2024-09-19T05:45:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8b7fe640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e780678c0 0x7f7e78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.294+0000 7f7e8b7fe640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e780678c0 0x7f7e78069d80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7e80006fd0 tx=0x7f7e80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.298+0000 7f7e88ff9640 1 -- 172.21.15.67:0/3394010363 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7e7c056730 con 0x7f7e8c0afee0 2024-09-19T05:45:40.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:40.470+0000 7f7e92821640 1 -- 172.21.15.67:0/3394010363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7e8c166a90 con 0x7f7e8c0afee0 2024-09-19T05:45:40.900 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:45:40.903 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:45:41.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.150+0000 7f7e88ff9640 1 -- 172.21.15.67:0/3394010363 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v162) ==== 97+0+0 (secure 0 0 0) 0x7f7e7c056030 con 0x7f7e8c0afee0 2024-09-19T05:45:41.149 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:45:41.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 -- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e780678c0 msgr2=0x7f7e78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e780678c0 0x7f7e78069d80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7e80006fd0 tx=0x7f7e80008040 comp rx=0 tx=0).stop 2024-09-19T05:45:41.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 -- 172.21.15.67:0/3394010363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 msgr2=0x7f7e8c1514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 0x7f7e8c1514e0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c7c0 tx=0x7f7e7c00cc80 comp rx=0 tx=0).stop 2024-09-19T05:45:41.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 -- 172.21.15.67:0/3394010363 shutdown_connections 2024-09-19T05:45:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e8c1609b0 0x7f7e8c0b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7e780678c0 0x7f7e78069d80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7e8c15fcf0 0x7f7e8c0b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 --2- 172.21.15.67:0/3394010363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c0afee0 0x7f7e8c1514e0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 -- 172.21.15.67:0/3394010363 >> 172.21.15.67:0/3394010363 conn(0x7f7e8c073500 msgr2=0x7f7e8c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 -- 172.21.15.67:0/3394010363 shutdown_connections 2024-09-19T05:45:41.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.154+0000 7f7e92821640 1 -- 172.21.15.67:0/3394010363 wait complete. 2024-09-19T05:45:41.175 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:45:41.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f0342860640 1 Processor -- start 2024-09-19T05:45:41.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f0342860640 1 -- start start 2024-09-19T05:45:41.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f0342860640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f033c15c030 0x7f033c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f0342860640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033c15d1d0 0x7f033c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f0342860640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f033c0b3510 0x7f033c06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f0342860640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f033c06e3c0 con 0x7f033c15c030 2024-09-19T05:45:41.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f0342860640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f033c06e6a0 con 0x7f033c0b3510 2024-09-19T05:45:41.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f0342860640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f033c06e980 con 0x7f033c15d1d0 2024-09-19T05:45:41.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f033bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f033c15c030 0x7f033c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f033bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f033c15c030 0x7f033c06dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35040/0 (socket says 172.21.15.67:35040) 2024-09-19T05:45:41.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f033bfff640 1 -- 172.21.15.67:0/953232000 learned_addr learned my addr 172.21.15.67:0/953232000 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:41.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f033b7fe640 1 --2- 172.21.15.67:0/953232000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033c15d1d0 0x7f033c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f0340dfd640 1 --2- 172.21.15.67:0/953232000 >> v2:172.21.15.97:3300/0 conn(0x7f033c0b3510 0x7f033c06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f033bfff640 1 -- 172.21.15.67:0/953232000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033c15d1d0 msgr2=0x7f033c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:41.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f033bfff640 1 --2- 172.21.15.67:0/953232000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033c15d1d0 0x7f033c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f033bfff640 1 -- 172.21.15.67:0/953232000 >> v2:172.21.15.97:3300/0 conn(0x7f033c0b3510 msgr2=0x7f033c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:41.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f033bfff640 1 --2- 172.21.15.67:0/953232000 >> v2:172.21.15.97:3300/0 conn(0x7f033c0b3510 0x7f033c06f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.302+0000 7f033bfff640 1 -- 172.21.15.67:0/953232000 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c06ec60 con 0x7f033c15c030 2024-09-19T05:45:41.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f033bfff640 1 --2- 172.21.15.67:0/953232000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c15c030 0x7f033c06dde0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f033c0d0c30 tx=0x7f032c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa476f75c6b21451 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:41.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f033affd640 1 -- 172.21.15.67:0/953232000 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0b0070 con 0x7f033c15c030 2024-09-19T05:45:41.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f033affd640 1 -- 172.21.15.67:0/953232000 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c0ab600 con 0x7f033c15c030 2024-09-19T05:45:41.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f033affd640 1 -- 172.21.15.67:0/953232000 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0ab9d0 con 0x7f033c15c030 2024-09-19T05:45:41.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f0342860640 1 -- 172.21.15.67:0/953232000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c15c030 msgr2=0x7f033c06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f0342860640 1 --2- 172.21.15.67:0/953232000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c15c030 0x7f033c06dde0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f033c0d0c30 tx=0x7f032c01c460 comp rx=0 tx=0).stop 2024-09-19T05:45:41.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f0342860640 1 -- 172.21.15.67:0/953232000 shutdown_connections 2024-09-19T05:45:41.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f0342860640 1 --2- 172.21.15.67:0/953232000 >> v2:172.21.15.97:3300/0 conn(0x7f033c0b3510 0x7f033c06f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f0342860640 1 --2- 172.21.15.67:0/953232000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033c15d1d0 0x7f033c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f0342860640 1 --2- 172.21.15.67:0/953232000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c15c030 0x7f033c06dde0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f0342860640 1 -- 172.21.15.67:0/953232000 >> 172.21.15.67:0/953232000 conn(0x7f033c0d0080 msgr2=0x7f033c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:41.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f0342860640 1 -- 172.21.15.67:0/953232000 shutdown_connections 2024-09-19T05:45:41.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.306+0000 7f0342860640 1 -- 172.21.15.67:0/953232000 wait complete. 2024-09-19T05:45:41.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 Processor -- start 2024-09-19T05:45:41.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 -- start start 2024-09-19T05:45:41.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c0b3510 0x7f033c14f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033c15c030 0x7f033c1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f033c15d1d0 0x7f033c1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f033c15fd40 con 0x7f033c0b3510 2024-09-19T05:45:41.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f033c15c620 con 0x7f033c15d1d0 2024-09-19T05:45:41.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f033c15fec0 con 0x7f033c15c030 2024-09-19T05:45:41.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f033bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c0b3510 0x7f033c14f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f033bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c0b3510 0x7f033c14f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35050/0 (socket says 172.21.15.67:35050) 2024-09-19T05:45:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f033bfff640 1 -- 172.21.15.67:0/1425385239 learned_addr learned my addr 172.21.15.67:0/1425385239 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f033bfff640 1 -- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033c15c030 msgr2=0x7f033c1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f033bfff640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033c15c030 0x7f033c1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f033bfff640 1 -- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f033c15d1d0 msgr2=0x7f033c1567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f033bfff640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f033c15d1d0 0x7f033c1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f033bfff640 1 -- 172.21.15.67:0/1425385239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c1662c0 con 0x7f033c0b3510 2024-09-19T05:45:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f033bfff640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c0b3510 0x7f033c14f890 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f032c01ab10 tx=0x7f032c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0338ff9640 1 -- 172.21.15.67:0/1425385239 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0b0040 con 0x7f033c0b3510 2024-09-19T05:45:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0338ff9640 1 -- 172.21.15.67:0/1425385239 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c0b9070 con 0x7f033c0b3510 2024-09-19T05:45:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 -- 172.21.15.67:0/1425385239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033c1665a0 con 0x7f033c0b3510 2024-09-19T05:45:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0338ff9640 1 -- 172.21.15.67:0/1425385239 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0b4660 con 0x7f033c0b3510 2024-09-19T05:45:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 -- 172.21.15.67:0/1425385239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033c14fdd0 con 0x7f033c0b3510 2024-09-19T05:45:41.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0342860640 1 -- 172.21.15.67:0/1425385239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033c166770 con 0x7f033c0b3510 2024-09-19T05:45:41.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0338ff9640 1 -- 172.21.15.67:0/1425385239 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f032c0b4800 con 0x7f033c0b3510 2024-09-19T05:45:41.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0338ff9640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f031c0678c0 0x7f031c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.310+0000 7f0338ff9640 1 -- 172.21.15.67:0/1425385239 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5249+0+0 (secure 0 0 0) 0x7f032c11f7e0 con 0x7f033c0b3510 2024-09-19T05:45:41.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.314+0000 7f033b7fe640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f031c0678c0 0x7f031c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.314+0000 7f033b7fe640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f031c0678c0 0x7f031c069d80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f033c1670a0 tx=0x7f0324008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:41.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.318+0000 7f0338ff9640 1 -- 172.21.15.67:0/1425385239 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f032c016110 con 0x7f033c0b3510 2024-09-19T05:45:41.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.526+0000 7f0342860640 1 -- 172.21.15.67:0/1425385239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f033c068f90 con 0x7f033c0b3510 2024-09-19T05:45:41.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0338ff9640 1 -- 172.21.15.67:0/1425385239 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f032c0f04e0 con 0x7f033c0b3510 2024-09-19T05:45:41.527 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:41.527 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:45:41.527 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:45:41.527 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.527 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:45:41.528 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:45:41.528 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.528 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:45:41.528 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:45:41.528 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:45:41.528 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.528 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.528 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.529 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.529 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:45:41.529 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:45:41.529 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.529 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:45:41.529 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:45:41.529 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:45:41.529 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.529 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.529 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.530 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.530 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:45:41.530 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:45:41.530 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.530 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:45:41.530 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:45:41.530 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:45:41.530 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.530 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.530 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.531 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:45:41.532 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.533 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:45:41.534 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.535 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:45:41.536 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.537 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.538 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:45:41.539 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:45:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:45:41.541 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.542 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.542 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:45:41.542 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:45:41.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 -- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f031c0678c0 msgr2=0x7f031c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f031c0678c0 0x7f031c069d80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f033c1670a0 tx=0x7f0324008040 comp rx=0 tx=0).stop 2024-09-19T05:45:41.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 -- 172.21.15.67:0/1425385239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c0b3510 msgr2=0x7f033c14f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c0b3510 0x7f033c14f890 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f032c01ab10 tx=0x7f032c019200 comp rx=0 tx=0).stop 2024-09-19T05:45:41.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 -- 172.21.15.67:0/1425385239 shutdown_connections 2024-09-19T05:45:41.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f033c15d1d0 0x7f033c1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f031c0678c0 0x7f031c069d80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f033c15c030 0x7f033c1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 --2- 172.21.15.67:0/1425385239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f033c0b3510 0x7f033c14f890 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 -- 172.21.15.67:0/1425385239 >> 172.21.15.67:0/1425385239 conn(0x7f033c0d0080 msgr2=0x7f033c151340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:41.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 -- 172.21.15.67:0/1425385239 shutdown_connections 2024-09-19T05:45:41.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.530+0000 7f0342860640 1 -- 172.21.15.67:0/1425385239 wait complete. 2024-09-19T05:45:41.546 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:45:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce65db640 1 Processor -- start 2024-09-19T05:45:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce65db640 1 -- start start 2024-09-19T05:45:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce65db640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7ce00b51d0 0x7f7ce00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce65db640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce00d4d40 con 0x7f7ce0161da0 2024-09-19T05:45:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce65db640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce00d5020 con 0x7f7ce00d1590 2024-09-19T05:45:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce65db640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7ce00d0840 con 0x7f7ce00b51d0 2024-09-19T05:45:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7ce0161da0 0x7f7ce00d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:53710/0 (socket says 172.21.15.67:53710) 2024-09-19T05:45:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdffff640 1 -- 172.21.15.67:0/3572480148 learned_addr learned my addr 172.21.15.67:0/3572480148 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce4b78640 1 --2- 172.21.15.67:0/3572480148 >> v2:172.21.15.97:3300/0 conn(0x7f7ce00b51d0 0x7f7ce00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 877820707 0 0) 0x7f7ce00d4d40 con 0x7f7ce0161da0 2024-09-19T05:45:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc8003530 con 0x7f7ce0161da0 2024-09-19T05:45:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3324249636 0 0) 0x7f7cc8003530 con 0x7f7ce0161da0 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 >> v2:172.21.15.97:3300/0 conn(0x7f7ce00b51d0 msgr2=0x7f7ce00d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 --2- 172.21.15.67:0/3572480148 >> v2:172.21.15.97:3300/0 conn(0x7f7ce00b51d0 0x7f7ce00d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 >> v1:172.21.15.97:6789/0 conn(0x7f7ce00d1590 legacy=0x7f7ce00cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce00d5300 con 0x7f7ce0161da0 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7cd0001a00 con 0x7f7ce0161da0 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 >> v1:172.21.15.67:6789/0 conn(0x7f7ce0161da0 legacy=0x7f7ce00d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cc80039c0 0x7f7cc8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cc8004810 0x7f7cc8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cc80051d0 0x7f7cc800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce00d0840 con 0x7f7cc80051d0 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc800c070 con 0x7f7cc80039c0 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc800c270 con 0x7f7cc8004810 2024-09-19T05:45:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce4b78640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cc80051d0 0x7f7cc800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdffff640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cc80039c0 0x7f7cc8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdf7fe640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cc8004810 0x7f7cc8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce4b78640 1 -- 172.21.15.67:0/3572480148 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cc8004810 msgr2=0x7f7cc8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce4b78640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cc8004810 0x7f7cc8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce4b78640 1 -- 172.21.15.67:0/3572480148 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cc80039c0 msgr2=0x7f7cc8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce4b78640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cc80039c0 0x7f7cc8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7ce4b78640 1 -- 172.21.15.67:0/3572480148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc8003530 con 0x7f7cc80051d0 2024-09-19T05:45:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.662+0000 7f7cdf7fe640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cc8004810 0x7f7cc8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce4b78640 1 -- 172.21.15.67:0/3572480148 reap_dead start 2024-09-19T05:45:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce4b78640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cc80051d0 0x7f7cc800b9d0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009ae0 tx=0x7f7cd801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5283b9874230a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80096b0 con 0x7f7cc80051d0 2024-09-19T05:45:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd8004020 con 0x7f7cc80051d0 2024-09-19T05:45:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7cdeffd640 1 -- 172.21.15.67:0/3572480148 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8004410 con 0x7f7cc80051d0 2024-09-19T05:45:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 -- 172.21.15.67:0/3572480148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cc80051d0 msgr2=0x7f7cc800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cc80051d0 0x7f7cc800b9d0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009ae0 tx=0x7f7cd801cab0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 -- 172.21.15.67:0/3572480148 shutdown_connections 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 --2- 172.21.15.67:0/3572480148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cc80051d0 0x7f7cc800b9d0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 -- 172.21.15.67:0/3572480148 >> 172.21.15.67:0/3572480148 conn(0x7f7ce008bfc0 msgr2=0x7f7ce00d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 -- 172.21.15.67:0/3572480148 shutdown_connections 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 -- 172.21.15.67:0/3572480148 wait complete. 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 Processor -- start 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 -- start start 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cc80051d0 0x7f7ce01f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ce00b34b0 0x7f7ce00b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ce00b22f0 0x7f7ce015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce0162180 con 0x7f7ce00b34b0 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce00b5d00 con 0x7f7cc80051d0 2024-09-19T05:45:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7ce65db640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce00d1af0 con 0x7f7ce00b22f0 2024-09-19T05:45:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7cdf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ce00b34b0 0x7f7ce00b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7cdf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ce00b34b0 0x7f7ce00b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35070/0 (socket says 172.21.15.67:35070) 2024-09-19T05:45:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.666+0000 7f7cdf7fe640 1 -- 172.21.15.67:0/1646197806 learned_addr learned my addr 172.21.15.67:0/1646197806 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdffff640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cc80051d0 0x7f7ce01f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7ce4b78640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ce00b22f0 0x7f7ce015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdf7fe640 1 -- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ce00b22f0 msgr2=0x7f7ce015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdf7fe640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ce00b22f0 0x7f7ce015b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdf7fe640 1 -- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cc80051d0 msgr2=0x7f7ce01f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdf7fe640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cc80051d0 0x7f7ce01f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdf7fe640 1 -- 172.21.15.67:0/1646197806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce01f3c80 con 0x7f7ce00b34b0 2024-09-19T05:45:41.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdf7fe640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ce00b34b0 0x7f7ce00b72c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400d540 tx=0x7f7cd400da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:41.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdcff9640 1 -- 172.21.15.67:0/1646197806 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4005480 con 0x7f7ce00b34b0 2024-09-19T05:45:41.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdcff9640 1 -- 172.21.15.67:0/1646197806 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd4017070 con 0x7f7ce00b34b0 2024-09-19T05:45:41.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7ce65db640 1 -- 172.21.15.67:0/1646197806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce00b7d00 con 0x7f7ce00b34b0 2024-09-19T05:45:41.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdcff9640 1 -- 172.21.15.67:0/1646197806 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4003840 con 0x7f7ce00b34b0 2024-09-19T05:45:41.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7ce65db640 1 -- 172.21.15.67:0/1646197806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce01f3f40 con 0x7f7ce00b34b0 2024-09-19T05:45:41.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7ce65db640 1 -- 172.21.15.67:0/1646197806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce00d0e80 con 0x7f7ce00b34b0 2024-09-19T05:45:41.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdcff9640 1 -- 172.21.15.67:0/1646197806 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7cd40039e0 con 0x7f7ce00b34b0 2024-09-19T05:45:41.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdcff9640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7ccc0678c0 0x7f7ccc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdcff9640 1 -- 172.21.15.67:0/1646197806 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5249+0+0 (secure 0 0 0) 0x7f7cd4085800 con 0x7f7ce00b34b0 2024-09-19T05:45:41.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdffff640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7ccc0678c0 0x7f7ccc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.670+0000 7f7cdffff640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7ccc0678c0 0x7f7ccc069d80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0005d80 tx=0x7f7cd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:41.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.674+0000 7f7cdcff9640 1 -- 172.21.15.67:0/1646197806 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7cd400f2f0 con 0x7f7ce00b34b0 2024-09-19T05:45:41.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 -- 172.21.15.67:0/1646197806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7ce015f6c0 con 0x7f7ce00b34b0 2024-09-19T05:45:41.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7cdcff9640 1 -- 172.21.15.67:0/1646197806 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v164) ==== 84+0+65 (secure 0 0 0) 0x7f7cd4056590 con 0x7f7ce00b34b0 2024-09-19T05:45:41.832 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:41.832 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:45:41.832 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:45:41.832 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:45:41.832 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:45:41.832 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:41.832 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:45:41.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 -- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7ccc0678c0 msgr2=0x7f7ccc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7ccc0678c0 0x7f7ccc069d80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0005d80 tx=0x7f7cd0009040 comp rx=0 tx=0).stop 2024-09-19T05:45:41.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 -- 172.21.15.67:0/1646197806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ce00b34b0 msgr2=0x7f7ce00b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ce00b34b0 0x7f7ce00b72c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400d540 tx=0x7f7cd400da00 comp rx=0 tx=0).stop 2024-09-19T05:45:41.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 -- 172.21.15.67:0/1646197806 shutdown_connections 2024-09-19T05:45:41.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7ccc0678c0 0x7f7ccc069d80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ce00b22f0 0x7f7ce015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ce00b34b0 0x7f7ce00b72c0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 --2- 172.21.15.67:0/1646197806 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cc80051d0 0x7f7ce01f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 -- 172.21.15.67:0/1646197806 >> 172.21.15.67:0/1646197806 conn(0x7f7ce008bfc0 msgr2=0x7f7ce015eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:41.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 -- 172.21.15.67:0/1646197806 shutdown_connections 2024-09-19T05:45:41.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.834+0000 7f7ce65db640 1 -- 172.21.15.67:0/1646197806 wait complete. 2024-09-19T05:45:41.850 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:45:41.850 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:45:41.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.970+0000 7fee03ce2640 1 Processor -- start 2024-09-19T05:45:41.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.970+0000 7fee03ce2640 1 -- start start 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.970+0000 7fee03ce2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d37a0 0x7fedfc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.970+0000 7fee03ce2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fedfc0cfe30 0x7fedfc0b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.970+0000 7fee03ce2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedfc15ead0 con 0x7fedfc15e6f0 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.970+0000 7fee03ce2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fedfc0ceb40 con 0x7fedfc0cfe30 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.970+0000 7fee03ce2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fedfc0ced90 con 0x7fedfc0d37a0 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee01a7e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fedfc15e6f0 0x7fedfc0d3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:53716/0 (socket says 172.21.15.67:53716) 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee01a7e640 1 -- 172.21.15.67:0/1073098083 learned_addr learned my addr 172.21.15.67:0/1073098083 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365825036 0 0) 0x7fedfc15ead0 con 0x7fedfc15e6f0 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede8003530 con 0x7fedfc15e6f0 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee0127d640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d37a0 0x7fedfc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee0227f640 1 --2- 172.21.15.67:0/1073098083 >> v2:172.21.15.97:3300/0 conn(0x7fedfc0cfe30 0x7fedfc0b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3020513620 0 0) 0x7fede8003530 con 0x7fedfc15e6f0 2024-09-19T05:45:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d37a0 msgr2=0x7fedfc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d37a0 0x7fedfc0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 >> v2:172.21.15.97:3300/0 conn(0x7fedfc0cfe30 msgr2=0x7fedfc0b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 --2- 172.21.15.67:0/1073098083 >> v2:172.21.15.97:3300/0 conn(0x7fedfc0cfe30 0x7fedfc0b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc0cf070 con 0x7fedfc15e6f0 2024-09-19T05:45:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fedf8001680 con 0x7fedfc15e6f0 2024-09-19T05:45:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 >> v1:172.21.15.67:6789/0 conn(0x7fedfc15e6f0 legacy=0x7fedfc0d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d37a0 0x7fede80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede8003f40 0x7fede8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede8004d50 0x7fede80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc0ceb40 con 0x7fede8003f40 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc0ced90 con 0x7fede8004d50 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fede800bab0 con 0x7fedfc0d37a0 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee0127d640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede8003f40 0x7fede8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee01a7e640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d37a0 0x7fede80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee0227f640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede8004d50 0x7fede80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee0127d640 1 -- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d37a0 msgr2=0x7fede80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee0127d640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d37a0 0x7fede80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee0127d640 1 -- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede8004d50 msgr2=0x7fede80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee0127d640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede8004d50 0x7fede80051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee0127d640 1 -- 172.21.15.67:0/1073098083 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede8003530 con 0x7fede8003f40 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee01a7e640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedfc0d37a0 0x7fede80039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee0127d640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede8003f40 0x7fede8004810 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0c7ff0 tx=0x7fedec01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8dc029e052ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0096b0 con 0x7fede8003f40 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedec0b0400 con 0x7fede8003f40 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.974+0000 7fee00a7c640 1 -- 172.21.15.67:0/1073098083 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0b07f0 con 0x7fede8003f40 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- 172.21.15.67:0/1073098083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede8003f40 msgr2=0x7fede8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 --2- 172.21.15.67:0/1073098083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede8003f40 0x7fede8004810 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0c7ff0 tx=0x7fedec01c9c0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee0227f640 1 -- 172.21.15.67:0/1073098083 reap_dead start 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- 172.21.15.67:0/1073098083 shutdown_connections 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- 172.21.15.67:0/1073098083 >> 172.21.15.67:0/1073098083 conn(0x7fedfc08bfc0 msgr2=0x7fedfc0d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- 172.21.15.67:0/1073098083 shutdown_connections 2024-09-19T05:45:41.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- 172.21.15.67:0/1073098083 wait complete. 2024-09-19T05:45:41.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 Processor -- start 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- start start 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede8003f40 0x7fedfc0b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc1555d0 0x7fedfc0b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc0b9280 0x7fedfc0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc06d770 con 0x7fedfc1555d0 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc06d5f0 con 0x7fedfc0b9280 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fedfc06d8f0 con 0x7fede8003f40 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee0127d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc1555d0 0x7fedfc0b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee0127d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc1555d0 0x7fedfc0b8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35098/0 (socket says 172.21.15.67:35098) 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee0127d640 1 -- 172.21.15.67:0/3141447012 learned_addr learned my addr 172.21.15.67:0/3141447012 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee0127d640 1 -- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede8003f40 msgr2=0x7fedfc0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee0127d640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede8003f40 0x7fedfc0b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee0127d640 1 -- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc0b9280 msgr2=0x7fedfc0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee0127d640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc0b9280 0x7fedfc0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee0127d640 1 -- 172.21.15.67:0/3141447012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc0b7a90 con 0x7fedfc1555d0 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee0127d640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc1555d0 0x7fedfc0b8d40 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fedec000c10 tx=0x7fedec019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fedf27fc640 1 -- 172.21.15.67:0/3141447012 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0b07b0 con 0x7fedfc1555d0 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fedf27fc640 1 -- 172.21.15.67:0/3141447012 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedec0b0950 con 0x7fedfc1555d0 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- 172.21.15.67:0/3141447012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedfc0b7d70 con 0x7fedfc1555d0 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fedf27fc640 1 -- 172.21.15.67:0/3141447012 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0b0d40 con 0x7fedfc1555d0 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- 172.21.15.67:0/3141447012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedfc0b8330 con 0x7fedfc1555d0 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.978+0000 7fee03ce2640 1 -- 172.21.15.67:0/3141447012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedfc0b6490 con 0x7fedfc1555d0 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.982+0000 7fedf27fc640 1 -- 172.21.15.67:0/3141447012 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fedec0c3440 con 0x7fedfc1555d0 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.982+0000 7fedf27fc640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 0x7fede0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:41.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.982+0000 7fedf27fc640 1 -- 172.21.15.67:0/3141447012 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5249+0+0 (secure 0 0 0) 0x7fedec11fa60 con 0x7fedfc1555d0 2024-09-19T05:45:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.982+0000 7fee01a7e640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 0x7fede0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:41.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.982+0000 7fee01a7e640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 0x7fede0069d80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fedf8000f70 tx=0x7fedf8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:41.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:41.986+0000 7fedf27fc640 1 -- 172.21.15.67:0/3141447012 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fedec0b6070 con 0x7fedfc1555d0 2024-09-19T05:45:42.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:42.150+0000 7fee03ce2640 1 -- 172.21.15.67:0/3141447012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fedfc06a160 con 0x7fedfc1555d0 2024-09-19T05:45:43.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.154+0000 7fedf27fc640 1 -- 172.21.15.67:0/3141447012 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v165) ==== 138+0+0 (secure 0 0 0) 0x7fedec0ac030 con 0x7fedfc1555d0 2024-09-19T05:45:43.153 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:45:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 -- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 msgr2=0x7fede0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 0x7fede0069d80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fedf8000f70 tx=0x7fedf8009040 comp rx=0 tx=0).stop 2024-09-19T05:45:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 -- 172.21.15.67:0/3141447012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc1555d0 msgr2=0x7fedfc0b8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc1555d0 0x7fedfc0b8d40 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fedec000c10 tx=0x7fedec019760 comp rx=0 tx=0).stop 2024-09-19T05:45:43.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 -- 172.21.15.67:0/3141447012 shutdown_connections 2024-09-19T05:45:43.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedfc0b9280 0x7fedfc0c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:43.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedfc1555d0 0x7fedfc0b8d40 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:43.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fede00678c0 0x7fede0069d80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:43.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 --2- 172.21.15.67:0/3141447012 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede8003f40 0x7fedfc0b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:43.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 -- 172.21.15.67:0/3141447012 >> 172.21.15.67:0/3141447012 conn(0x7fedfc08bfc0 msgr2=0x7fedfc0cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:43.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 -- 172.21.15.67:0/3141447012 shutdown_connections 2024-09-19T05:45:43.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.158+0000 7fee03ce2640 1 -- 172.21.15.67:0/3141447012 wait complete. 2024-09-19T05:45:43.184 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:45:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.314+0000 7f70afa7b640 1 Processor -- start 2024-09-19T05:45:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.314+0000 7f70afa7b640 1 -- start start 2024-09-19T05:45:43.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70afa7b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70a80d4220 0x7f70a80d4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:43.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70afa7b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a80d2aa0 con 0x7f70a80b7300 2024-09-19T05:45:43.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70afa7b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a80d24e0 con 0x7f70a80b7760 2024-09-19T05:45:43.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70afa7b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f70a80cf080 con 0x7f70a80d4220 2024-09-19T05:45:43.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ad817640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70a80d4220 0x7f70a80d4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:43.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ad016640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f70a80b7300 0x7f70a80d2dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:53722/0 (socket says 172.21.15.67:53722) 2024-09-19T05:45:43.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ad817640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70a80d4220 0x7f70a80d4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35102/0 (socket says 172.21.15.67:35102) 2024-09-19T05:45:43.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ad016640 1 -- 172.21.15.67:0/2581297250 learned_addr learned my addr 172.21.15.67:0/2581297250 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:43.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ad817640 1 -- 172.21.15.67:0/2581297250 >> v1:172.21.15.97:6789/0 conn(0x7f70a80b7760 legacy=0x7f70a80cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:43.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ad817640 1 -- 172.21.15.67:0/2581297250 >> v1:172.21.15.67:6789/0 conn(0x7f70a80b7300 legacy=0x7f70a80d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:43.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ad817640 1 -- 172.21.15.67:0/2581297250 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a80d27c0 con 0x7f70a80d4220 2024-09-19T05:45:43.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ad817640 1 --2- 172.21.15.67:0/2581297250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80d4220 0x7f70a80d4600 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f70a40097f0 tx=0x7f70a401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fffdece2efb7c43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ac815640 1 -- 172.21.15.67:0/2581297250 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a40b0070 con 0x7f70a80d4220 2024-09-19T05:45:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ac815640 1 -- 172.21.15.67:0/2581297250 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a40ab600 con 0x7f70a80d4220 2024-09-19T05:45:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70ac815640 1 -- 172.21.15.67:0/2581297250 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a40ab9d0 con 0x7f70a80d4220 2024-09-19T05:45:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70afa7b640 1 -- 172.21.15.67:0/2581297250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80d4220 msgr2=0x7f70a80d4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:43.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70afa7b640 1 --2- 172.21.15.67:0/2581297250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80d4220 0x7f70a80d4600 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f70a40097f0 tx=0x7f70a401c3d0 comp rx=0 tx=0).stop 2024-09-19T05:45:43.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70afa7b640 1 -- 172.21.15.67:0/2581297250 shutdown_connections 2024-09-19T05:45:43.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70afa7b640 1 --2- 172.21.15.67:0/2581297250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80d4220 0x7f70a80d4600 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:43.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70afa7b640 1 -- 172.21.15.67:0/2581297250 >> 172.21.15.67:0/2581297250 conn(0x7f70a809d7f0 msgr2=0x7f70a808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:43.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.318+0000 7f70afa7b640 1 -- 172.21.15.67:0/2581297250 shutdown_connections 2024-09-19T05:45:43.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 -- 172.21.15.67:0/2581297250 wait complete. 2024-09-19T05:45:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 Processor -- start 2024-09-19T05:45:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 -- start start 2024-09-19T05:45:43.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a80b7300 0x7f70a81580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:43.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80b7760 0x7f70a8160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:43.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70a80d4220 0x7f70a8159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:43.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f70a80b5af0 con 0x7f70a80b7760 2024-09-19T05:45:43.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f70a815e9c0 con 0x7f70a80b7300 2024-09-19T05:45:43.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f70a80b5c70 con 0x7f70a80d4220 2024-09-19T05:45:43.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ad016640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80b7760 0x7f70a8160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:43.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ad016640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80b7760 0x7f70a8160c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35114/0 (socket says 172.21.15.67:35114) 2024-09-19T05:45:43.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ad016640 1 -- 172.21.15.67:0/2100595455 learned_addr learned my addr 172.21.15.67:0/2100595455 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ad817640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a80b7300 0x7f70a81580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ae018640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70a80d4220 0x7f70a8159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ad016640 1 -- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70a80d4220 msgr2=0x7f70a8159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ad016640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70a80d4220 0x7f70a8159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ad016640 1 -- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a80b7300 msgr2=0x7f70a81580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ad016640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a80b7300 0x7f70a81580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ad016640 1 -- 172.21.15.67:0/2100595455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a8161340 con 0x7f70a80b7760 2024-09-19T05:45:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70ad016640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80b7760 0x7f70a8160c80 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f709800c370 tx=0x7f709800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f709e7fc640 1 -- 172.21.15.67:0/2100595455 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098017070 con 0x7f70a80b7760 2024-09-19T05:45:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f709e7fc640 1 -- 172.21.15.67:0/2100595455 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7098005cf0 con 0x7f70a80b7760 2024-09-19T05:45:43.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f709e7fc640 1 -- 172.21.15.67:0/2100595455 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980072f0 con 0x7f70a80b7760 2024-09-19T05:45:43.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 -- 172.21.15.67:0/2100595455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a8161620 con 0x7f70a80b7760 2024-09-19T05:45:43.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.322+0000 7f70afa7b640 1 -- 172.21.15.67:0/2100595455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a814f490 con 0x7f70a80b7760 2024-09-19T05:45:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.326+0000 7f70afa7b640 1 -- 172.21.15.67:0/2100595455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a80d4600 con 0x7f70a80b7760 2024-09-19T05:45:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.326+0000 7f709e7fc640 1 -- 172.21.15.67:0/2100595455 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f709801a070 con 0x7f70a80b7760 2024-09-19T05:45:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.326+0000 7f709e7fc640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f708c0678f0 0x7f708c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.326+0000 7f709e7fc640 1 -- 172.21.15.67:0/2100595455 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5619+0+0 (secure 0 0 0) 0x7f7098085040 con 0x7f70a80b7760 2024-09-19T05:45:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.326+0000 7f70ad817640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f708c0678f0 0x7f708c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.326+0000 7f70ad817640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f708c0678f0 0x7f708c069db0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f70a40ad000 tx=0x7f70a40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.330+0000 7f709e7fc640 1 -- 172.21.15.67:0/2100595455 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7098055b30 con 0x7f70a80b7760 2024-09-19T05:45:43.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:43.486+0000 7f70afa7b640 1 -- 172.21.15.67:0/2100595455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f70a80b56c0 con 0x7f70a80b7760 2024-09-19T05:45:44.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.166+0000 7f709e7fc640 1 -- 172.21.15.67:0/2100595455 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v166) ==== 170+0+0 (secure 0 0 0) 0x7f7098055430 con 0x7f70a80b7760 2024-09-19T05:45:44.166 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:45:44.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 -- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f708c0678f0 msgr2=0x7f708c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:44.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f708c0678f0 0x7f708c069db0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f70a40ad000 tx=0x7f70a40a6000 comp rx=0 tx=0).stop 2024-09-19T05:45:44.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 -- 172.21.15.67:0/2100595455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80b7760 msgr2=0x7f70a8160c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:44.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80b7760 0x7f70a8160c80 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f709800c370 tx=0x7f709800c830 comp rx=0 tx=0).stop 2024-09-19T05:45:44.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 -- 172.21.15.67:0/2100595455 shutdown_connections 2024-09-19T05:45:44.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f708c0678f0 0x7f708c069db0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:44.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70a80d4220 0x7f70a8159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:44.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a80b7760 0x7f70a8160c80 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:44.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 --2- 172.21.15.67:0/2100595455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a80b7300 0x7f70a81580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:44.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 -- 172.21.15.67:0/2100595455 >> 172.21.15.67:0/2100595455 conn(0x7f70a809d7f0 msgr2=0x7f70a80d16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:44.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 -- 172.21.15.67:0/2100595455 shutdown_connections 2024-09-19T05:45:44.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.170+0000 7f70afa7b640 1 -- 172.21.15.67:0/2100595455 wait complete. 2024-09-19T05:45:44.203 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:45:44.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2de4878640 1 Processor -- start 2024-09-19T05:45:44.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2de4878640 1 -- start start 2024-09-19T05:45:44.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2de4878640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2de015e690 0x7f2de00d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2de4878640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00d4fb0 0x7f2de00d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2de4878640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de00d35a0 con 0x7f2de00d13c0 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2de4878640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2de00d32c0 con 0x7f2de015e690 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2de4878640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2de006d040 con 0x7f2de00d4fb0 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dded9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2de00d13c0 0x7f2de00cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:53730/0 (socket says 172.21.15.67:53730) 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dded9d640 1 -- 172.21.15.67:0/4278167467 learned_addr learned my addr 172.21.15.67:0/4278167467 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dddd9b640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00d4fb0 0x7f2de00d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dde59c640 1 --2- 172.21.15.67:0/4278167467 >> v2:172.21.15.97:3300/0 conn(0x7f2de015e690 0x7f2de00d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212509516 0 0) 0x7f2de00d35a0 con 0x7f2de00d13c0 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dc8003530 con 0x7f2de00d13c0 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1723298499 0 0) 0x7f2dc8003530 con 0x7f2de00d13c0 2024-09-19T05:45:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00d4fb0 msgr2=0x7f2de00d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00d4fb0 0x7f2de00d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 >> v2:172.21.15.97:3300/0 conn(0x7f2de015e690 msgr2=0x7f2de00d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 --2- 172.21.15.67:0/4278167467 >> v2:172.21.15.97:3300/0 conn(0x7f2de015e690 0x7f2de00d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de006d320 con 0x7f2de00d13c0 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f2dd8001a00 con 0x7f2de00d13c0 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 >> v1:172.21.15.67:6789/0 conn(0x7f2de00d13c0 legacy=0x7f2de00cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dc80039c0 0x7f2dc8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 0x7f2dc8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00d4fb0 0x7f2dc80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2de00d32c0 con 0x7f2dc8004810 2024-09-19T05:45:44.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2de006d040 con 0x7f2dc80039c0 2024-09-19T05:45:44.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc800b9d0 con 0x7f2de00d4fb0 2024-09-19T05:45:44.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dddd9b640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 0x7f2dc8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:44.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dde59c640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dc80039c0 0x7f2dc8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:44.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dded9d640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00d4fb0 0x7f2dc80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:44.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dddd9b640 1 -- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00d4fb0 msgr2=0x7f2dc80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:44.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dddd9b640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00d4fb0 0x7f2dc80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:44.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dddd9b640 1 -- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dc80039c0 msgr2=0x7f2dc8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:44.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dddd9b640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dc80039c0 0x7f2dc8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:44.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dddd9b640 1 -- 172.21.15.67:0/4278167467 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc8003530 con 0x7f2dc8004810 2024-09-19T05:45:44.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.330+0000 7f2dded9d640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00d4fb0 0x7f2dc80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:44.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2dddd9b640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 0x7f2dc8004c90 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009ae0 tx=0x7f2dd401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84729f8370c4b9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:44.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40b2070 con 0x7f2dc8004810 2024-09-19T05:45:44.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd40a5580 con 0x7f2dc8004810 2024-09-19T05:45:44.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2ddd59a640 1 -- 172.21.15.67:0/4278167467 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40096b0 con 0x7f2dc8004810 2024-09-19T05:45:44.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2de4878640 1 -- 172.21.15.67:0/4278167467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 msgr2=0x7f2dc8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:44.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2de4878640 1 --2- 172.21.15.67:0/4278167467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 0x7f2dc8004c90 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009ae0 tx=0x7f2dd401ca70 comp rx=0 tx=0).stop 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2dded9d640 1 -- 172.21.15.67:0/4278167467 reap_dead start 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2de4878640 1 -- 172.21.15.67:0/4278167467 shutdown_connections 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2de4878640 1 -- 172.21.15.67:0/4278167467 >> 172.21.15.67:0/4278167467 conn(0x7f2de00d4490 msgr2=0x7f2de00d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2de4878640 1 -- 172.21.15.67:0/4278167467 shutdown_connections 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.334+0000 7f2de4878640 1 -- 172.21.15.67:0/4278167467 wait complete. 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 Processor -- start 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 -- start start 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 0x7f2de00b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00b7ff0 0x7f2de00c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de01586a0 0x7f2de00cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2de00d2f80 con 0x7f2dc8004810 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2de015ea70 con 0x7f2de01586a0 2024-09-19T05:45:44.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2de006eb30 con 0x7f2de00b7ff0 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dde59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 0x7f2de00b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dde59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 0x7f2de00b8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35128/0 (socket says 172.21.15.67:35128) 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dde59c640 1 -- 172.21.15.67:0/4236479186 learned_addr learned my addr 172.21.15.67:0/4236479186 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dde59c640 1 -- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00b7ff0 msgr2=0x7f2de00c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dde59c640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00b7ff0 0x7f2de00c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dde59c640 1 -- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de01586a0 msgr2=0x7f2de00cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dde59c640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de01586a0 0x7f2de00cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dde59c640 1 -- 172.21.15.67:0/4236479186 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de00cb220 con 0x7f2dc8004810 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dde59c640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 0x7f2de00b8930 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0011690 tx=0x7f2dd0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dceffd640 1 -- 172.21.15.67:0/4236479186 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000f9c0 con 0x7f2dc8004810 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dceffd640 1 -- 172.21.15.67:0/4236479186 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd000fb60 con 0x7f2dc8004810 2024-09-19T05:45:44.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 -- 172.21.15.67:0/4236479186 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de00b8f10 con 0x7f2dc8004810 2024-09-19T05:45:44.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dceffd640 1 -- 172.21.15.67:0/4236479186 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0015460 con 0x7f2dc8004810 2024-09-19T05:45:44.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 -- 172.21.15.67:0/4236479186 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de00b77f0 con 0x7f2dc8004810 2024-09-19T05:45:44.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2de4878640 1 -- 172.21.15.67:0/4236479186 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de00d2a40 con 0x7f2dc8004810 2024-09-19T05:45:44.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.338+0000 7f2dceffd640 1 -- 172.21.15.67:0/4236479186 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2dd0015600 con 0x7f2dc8004810 2024-09-19T05:45:44.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.342+0000 7f2dceffd640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2dc00678f0 0x7f2dc0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:44.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.342+0000 7f2dceffd640 1 -- 172.21.15.67:0/4236479186 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6001+0+0 (secure 0 0 0) 0x7f2dd0086930 con 0x7f2dc8004810 2024-09-19T05:45:44.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.342+0000 7f2dddd9b640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2dc00678f0 0x7f2dc0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:44.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.342+0000 7f2dddd9b640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2dc00678f0 0x7f2dc0069db0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40af000 tx=0x7f2dd4004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:44.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.346+0000 7f2dceffd640 1 -- 172.21.15.67:0/4236479186 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2dd0019030 con 0x7f2dc8004810 2024-09-19T05:45:44.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:44.546+0000 7f2de4878640 1 -- 172.21.15.67:0/4236479186 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2de00b72c0 con 0x7f2dc8004810 2024-09-19T05:45:45.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.170+0000 7f2dceffd640 1 -- 172.21.15.67:0/4236479186 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v111) ==== 174+0+0 (secure 0 0 0) 0x7f2dd0084e20 con 0x7f2dc8004810 2024-09-19T05:45:45.169 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 23 and data pool 24 2024-09-19T05:45:45.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.174+0000 7f2de4878640 1 -- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2dc00678f0 msgr2=0x7f2dc0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.174+0000 7f2de4878640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2dc00678f0 0x7f2dc0069db0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40af000 tx=0x7f2dd4004740 comp rx=0 tx=0).stop 2024-09-19T05:45:45.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.174+0000 7f2de4878640 1 -- 172.21.15.67:0/4236479186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 msgr2=0x7f2de00b8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.174+0000 7f2de4878640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 0x7f2de00b8930 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0011690 tx=0x7f2dd0011b50 comp rx=0 tx=0).stop 2024-09-19T05:45:45.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.174+0000 7f2de4878640 1 -- 172.21.15.67:0/4236479186 shutdown_connections 2024-09-19T05:45:45.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.174+0000 7f2de4878640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de01586a0 0x7f2de00cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.174+0000 7f2de4878640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2dc00678f0 0x7f2dc0069db0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.174+0000 7f2de4878640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2de00b7ff0 0x7f2de00c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.174+0000 7f2de4878640 1 --2- 172.21.15.67:0/4236479186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dc8004810 0x7f2de00b8930 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.174+0000 7f2de4878640 1 -- 172.21.15.67:0/4236479186 >> 172.21.15.67:0/4236479186 conn(0x7f2de00d4490 msgr2=0x7f2de00b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:45.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.182+0000 7f2de4878640 1 -- 172.21.15.67:0/4236479186 shutdown_connections 2024-09-19T05:45:45.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.182+0000 7f2de4878640 1 -- 172.21.15.67:0/4236479186 wait complete. 2024-09-19T05:45:45.216 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:45:45.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11affd2640 1 Processor -- start 2024-09-19T05:45:45.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11affd2640 1 -- start start 2024-09-19T05:45:45.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11affd2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a815b710 0x7f11a8071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11affd2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f11a815baf0 0x7f11a815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11affd2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11a80b3070 con 0x7f11a80aef40 2024-09-19T05:45:45.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11affd2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f11a80b32e0 con 0x7f11a815baf0 2024-09-19T05:45:45.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11affd2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f11a80b35c0 con 0x7f11a815b710 2024-09-19T05:45:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11add6e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a815b710 0x7f11a8071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11ad56d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f11a815baf0 0x7f11a815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11ae56f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f11a80aef40 0x7f11a80af360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:55880/0 (socket says 172.21.15.67:55880) 2024-09-19T05:45:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11add6e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a815b710 0x7f11a8071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:60132/0 (socket says 172.21.15.67:60132) 2024-09-19T05:45:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11ad56d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f11a815baf0 0x7f11a815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:45880/0 (socket says 172.21.15.67:45880) 2024-09-19T05:45:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11add6e640 1 -- 172.21.15.67:0/1285425285 learned_addr learned my addr 172.21.15.67:0/1285425285 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11acd6c640 1 -- 172.21.15.67:0/1285425285 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4117866917 0 0) 0x7f11a80b3070 con 0x7f11a80aef40 2024-09-19T05:45:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11add6e640 1 -- 172.21.15.67:0/1285425285 >> v2:172.21.15.97:3300/0 conn(0x7f11a815baf0 msgr2=0x7f11a815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11add6e640 1 --2- 172.21.15.67:0/1285425285 >> v2:172.21.15.97:3300/0 conn(0x7f11a815baf0 0x7f11a815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11add6e640 1 -- 172.21.15.67:0/1285425285 >> v1:172.21.15.97:6789/0 conn(0x7f11a80aef40 legacy=0x7f11a80af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.338+0000 7f11add6e640 1 -- 172.21.15.67:0/1285425285 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a80afa70 con 0x7f11a815b710 2024-09-19T05:45:45.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.342+0000 7f11add6e640 1 --2- 172.21.15.67:0/1285425285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a815b710 0x7f11a8071e80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1198009870 tx=0x7f119801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff666c3f3d03a0f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11acd6c640 1 -- 172.21.15.67:0/1285425285 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11980a95f0 con 0x7f11a815b710 2024-09-19T05:45:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11acd6c640 1 -- 172.21.15.67:0/1285425285 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11980a9790 con 0x7f11a815b710 2024-09-19T05:45:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11acd6c640 1 -- 172.21.15.67:0/1285425285 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11980a9b60 con 0x7f11a815b710 2024-09-19T05:45:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 -- 172.21.15.67:0/1285425285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a815b710 msgr2=0x7f11a8071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 --2- 172.21.15.67:0/1285425285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a815b710 0x7f11a8071e80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1198009870 tx=0x7f119801c530 comp rx=0 tx=0).stop 2024-09-19T05:45:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 -- 172.21.15.67:0/1285425285 shutdown_connections 2024-09-19T05:45:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 --2- 172.21.15.67:0/1285425285 >> v2:172.21.15.97:3300/0 conn(0x7f11a815baf0 0x7f11a815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 --2- 172.21.15.67:0/1285425285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a815b710 0x7f11a8071e80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 -- 172.21.15.67:0/1285425285 >> 172.21.15.67:0/1285425285 conn(0x7f11a80d0080 msgr2=0x7f11a80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 -- 172.21.15.67:0/1285425285 shutdown_connections 2024-09-19T05:45:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 -- 172.21.15.67:0/1285425285 wait complete. 2024-09-19T05:45:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 Processor -- start 2024-09-19T05:45:45.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 -- start start 2024-09-19T05:45:45.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a80aef40 0x7f11a814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11a815b710 0x7f11a809da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11a815baf0 0x7f11a81f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f11a80b4a30 con 0x7f11a815baf0 2024-09-19T05:45:45.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f11a80b48b0 con 0x7f11a815b710 2024-09-19T05:45:45.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11affd2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f11a80b4bb0 con 0x7f11a80aef40 2024-09-19T05:45:45.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11ae56f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11a815baf0 0x7f11a81f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11ae56f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11a815baf0 0x7f11a81f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35142/0 (socket says 172.21.15.67:35142) 2024-09-19T05:45:45.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11ae56f640 1 -- 172.21.15.67:0/207093614 learned_addr learned my addr 172.21.15.67:0/207093614 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:45.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11ad56d640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11a815b710 0x7f11a809da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11add6e640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a80aef40 0x7f11a814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11ae56f640 1 -- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a80aef40 msgr2=0x7f11a814c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11ae56f640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a80aef40 0x7f11a814c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11ae56f640 1 -- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11a815b710 msgr2=0x7f11a809da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11ae56f640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11a815b710 0x7f11a809da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11ae56f640 1 -- 172.21.15.67:0/207093614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a809c0a0 con 0x7f11a815baf0 2024-09-19T05:45:45.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.346+0000 7f11ae56f640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11a815baf0 0x7f11a81f54a0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f11a000c780 tx=0x7f11a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:45.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f119e7fc640 1 -- 172.21.15.67:0/207093614 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0018070 con 0x7f11a815baf0 2024-09-19T05:45:45.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f119e7fc640 1 -- 172.21.15.67:0/207093614 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a000a640 con 0x7f11a815baf0 2024-09-19T05:45:45.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f11affd2640 1 -- 172.21.15.67:0/207093614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a809c380 con 0x7f11a815baf0 2024-09-19T05:45:45.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f119e7fc640 1 -- 172.21.15.67:0/207093614 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a000aa30 con 0x7f11a815baf0 2024-09-19T05:45:45.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f11affd2640 1 -- 172.21.15.67:0/207093614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a809c940 con 0x7f11a815baf0 2024-09-19T05:45:45.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f11affd2640 1 -- 172.21.15.67:0/207093614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a8071e80 con 0x7f11a815baf0 2024-09-19T05:45:45.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f119e7fc640 1 -- 172.21.15.67:0/207093614 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f11a001b070 con 0x7f11a815baf0 2024-09-19T05:45:45.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f119e7fc640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f118c0678c0 0x7f118c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f119e7fc640 1 -- 172.21.15.67:0/207093614 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f11a00853c0 con 0x7f11a815baf0 2024-09-19T05:45:45.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f11add6e640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f118c0678c0 0x7f118c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.350+0000 7f11add6e640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f118c0678c0 0x7f118c069d80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f11980ae000 tx=0x7f11980a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:45.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.354+0000 7f119e7fc640 1 -- 172.21.15.67:0/207093614 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f11a0055e00 con 0x7f11a815baf0 2024-09-19T05:45:45.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.514+0000 7f11affd2640 1 -- 172.21.15.67:0/207093614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11a80b5020 con 0x7f11a815baf0 2024-09-19T05:45:45.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.518+0000 7f119e7fc640 1 -- 172.21.15.67:0/207093614 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16921 (secure 0 0 0) 0x7f11a0055700 con 0x7f11a815baf0 2024-09-19T05:45:45.516 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:45.516 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":167,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:45:44.552056+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:45:42.191879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-19T05:45:43.532181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:45:45.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 -- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f118c0678c0 msgr2=0x7f118c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f118c0678c0 0x7f118c069d80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f11980ae000 tx=0x7f11980a7000 comp rx=0 tx=0).stop 2024-09-19T05:45:45.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 -- 172.21.15.67:0/207093614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11a815baf0 msgr2=0x7f11a81f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11a815baf0 0x7f11a81f54a0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f11a000c780 tx=0x7f11a000cc40 comp rx=0 tx=0).stop 2024-09-19T05:45:45.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 -- 172.21.15.67:0/207093614 shutdown_connections 2024-09-19T05:45:45.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11a815baf0 0x7f11a81f54a0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11a815b710 0x7f11a809da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f118c0678c0 0x7f118c069d80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 --2- 172.21.15.67:0/207093614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11a80aef40 0x7f11a814c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 -- 172.21.15.67:0/207093614 >> 172.21.15.67:0/207093614 conn(0x7f11a80d0080 msgr2=0x7f11a814d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:45.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 -- 172.21.15.67:0/207093614 shutdown_connections 2024-09-19T05:45:45.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.522+0000 7f11affd2640 1 -- 172.21.15.67:0/207093614 wait complete. 2024-09-19T05:45:45.536 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:45:45.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c95bc640 1 Processor -- start 2024-09-19T05:45:45.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c95bc640 1 -- start start 2024-09-19T05:45:45.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c95bc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67c4072590 0x7f67c4166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c95bc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67c40b3860 con 0x7f67c415b1e0 2024-09-19T05:45:45.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c95bc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67c40b3b40 con 0x7f67c40b4900 2024-09-19T05:45:45.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c95bc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f67c415b5c0 con 0x7f67c4072590 2024-09-19T05:45:45.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c2ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f67c415b1e0 0x7f67c40b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:53738/0 (socket says 172.21.15.67:53738) 2024-09-19T05:45:45.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c2ffd640 1 -- 172.21.15.67:0/1115890063 learned_addr learned my addr 172.21.15.67:0/1115890063 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:45.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c37fe640 1 --2- 172.21.15.67:0/1115890063 >> v2:172.21.15.67:3300/0 conn(0x7f67c4072590 0x7f67c4166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c1ffb640 1 -- 172.21.15.67:0/1115890063 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947782494 0 0) 0x7f67c40b3860 con 0x7f67c415b1e0 2024-09-19T05:45:45.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c1ffb640 1 -- 172.21.15.67:0/1115890063 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67ac003530 con 0x7f67c415b1e0 2024-09-19T05:45:45.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c37fe640 1 -- 172.21.15.67:0/1115890063 >> v1:172.21.15.97:6789/0 conn(0x7f67c40b4900 legacy=0x7f67c4071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:45.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c37fe640 1 -- 172.21.15.67:0/1115890063 >> v1:172.21.15.67:6789/0 conn(0x7f67c415b1e0 legacy=0x7f67c40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.662+0000 7f67c37fe640 1 -- 172.21.15.67:0/1115890063 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c40b3e20 con 0x7f67c4072590 2024-09-19T05:45:45.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c37fe640 1 --2- 172.21.15.67:0/1115890063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c4072590 0x7f67c4166050 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009d90 tx=0x7f67bc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6177e90a8d3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:45.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c1ffb640 1 -- 172.21.15.67:0/1115890063 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0b2070 con 0x7f67c4072590 2024-09-19T05:45:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c1ffb640 1 -- 172.21.15.67:0/1115890063 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67bc0a5a20 con 0x7f67c4072590 2024-09-19T05:45:45.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c1ffb640 1 -- 172.21.15.67:0/1115890063 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0a5df0 con 0x7f67c4072590 2024-09-19T05:45:45.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 -- 172.21.15.67:0/1115890063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c4072590 msgr2=0x7f67c4166050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 --2- 172.21.15.67:0/1115890063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c4072590 0x7f67c4166050 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009d90 tx=0x7f67bc01c940 comp rx=0 tx=0).stop 2024-09-19T05:45:45.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 -- 172.21.15.67:0/1115890063 shutdown_connections 2024-09-19T05:45:45.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 --2- 172.21.15.67:0/1115890063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c4072590 0x7f67c4166050 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 -- 172.21.15.67:0/1115890063 >> 172.21.15.67:0/1115890063 conn(0x7f67c40d0080 msgr2=0x7f67c40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:45.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 -- 172.21.15.67:0/1115890063 shutdown_connections 2024-09-19T05:45:45.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 -- 172.21.15.67:0/1115890063 wait complete. 2024-09-19T05:45:45.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 Processor -- start 2024-09-19T05:45:45.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 -- start start 2024-09-19T05:45:45.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c4072590 0x7f67c414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c40b4900 0x7f67c41454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.666+0000 7f67c95bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c415b1e0 0x7f67c41462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c95bc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67c4169140 con 0x7f67c40b4900 2024-09-19T05:45:45.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c95bc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67c4168fc0 con 0x7f67c4072590 2024-09-19T05:45:45.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c95bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67c41692c0 con 0x7f67c415b1e0 2024-09-19T05:45:45.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c40b4900 0x7f67c41454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c40b4900 0x7f67c41454f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35152/0 (socket says 172.21.15.67:35152) 2024-09-19T05:45:45.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c27fc640 1 -- 172.21.15.67:0/1983411702 learned_addr learned my addr 172.21.15.67:0/1983411702 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:45.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c37fe640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c415b1e0 0x7f67c41462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c2ffd640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c4072590 0x7f67c414c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c27fc640 1 -- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c415b1e0 msgr2=0x7f67c41462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c27fc640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c415b1e0 0x7f67c41462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c27fc640 1 -- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c4072590 msgr2=0x7f67c414c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c27fc640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c4072590 0x7f67c414c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c27fc640 1 -- 172.21.15.67:0/1983411702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c40b0860 con 0x7f67c40b4900 2024-09-19T05:45:45.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c37fe640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c415b1e0 0x7f67c41462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:45.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c2ffd640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c4072590 0x7f67c414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:45.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c27fc640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c40b4900 0x7f67c41454f0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f67b400c450 tx=0x7f67b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:45.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67ab7fe640 1 -- 172.21.15.67:0/1983411702 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4016020 con 0x7f67c40b4900 2024-09-19T05:45:45.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67ab7fe640 1 -- 172.21.15.67:0/1983411702 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b40052d0 con 0x7f67c40b4900 2024-09-19T05:45:45.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67ab7fe640 1 -- 172.21.15.67:0/1983411702 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4007260 con 0x7f67c40b4900 2024-09-19T05:45:45.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c95bc640 1 -- 172.21.15.67:0/1983411702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c4165c20 con 0x7f67c40b4900 2024-09-19T05:45:45.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c95bc640 1 -- 172.21.15.67:0/1983411702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c4165660 con 0x7f67c40b4900 2024-09-19T05:45:45.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c95bc640 1 -- 172.21.15.67:0/1983411702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c4165450 con 0x7f67c40b4900 2024-09-19T05:45:45.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67ab7fe640 1 -- 172.21.15.67:0/1983411702 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67b4007400 con 0x7f67c40b4900 2024-09-19T05:45:45.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67ab7fe640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b00678c0 0x7f67b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67ab7fe640 1 -- 172.21.15.67:0/1983411702 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7f67b40857e0 con 0x7f67c40b4900 2024-09-19T05:45:45.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.670+0000 7f67c2ffd640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b00678c0 0x7f67b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.674+0000 7f67c2ffd640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b00678c0 0x7f67b0069d80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f67b80011f0 tx=0x7f67b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:45.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.674+0000 7f67ab7fe640 1 -- 172.21.15.67:0/1983411702 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f67b4020020 con 0x7f67c40b4900 2024-09-19T05:45:45.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.834+0000 7f67c95bc640 1 -- 172.21.15.67:0/1983411702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67c40b3860 con 0x7f67c40b4900 2024-09-19T05:45:45.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67ab7fe640 1 -- 172.21.15.67:0/1983411702 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16921 (secure 0 0 0) 0x7f67c40b0860 con 0x7f67c40b4900 2024-09-19T05:45:45.836 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:45.836 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":167,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:45:44.552056+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:45:42.191879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-19T05:45:43.532181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:45:45.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 -- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b00678c0 msgr2=0x7f67b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b00678c0 0x7f67b0069d80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f67b80011f0 tx=0x7f67b8009040 comp rx=0 tx=0).stop 2024-09-19T05:45:45.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 -- 172.21.15.67:0/1983411702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c40b4900 msgr2=0x7f67c41454f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c40b4900 0x7f67c41454f0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f67b400c450 tx=0x7f67b400c910 comp rx=0 tx=0).stop 2024-09-19T05:45:45.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 -- 172.21.15.67:0/1983411702 shutdown_connections 2024-09-19T05:45:45.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b00678c0 0x7f67b0069d80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c415b1e0 0x7f67c41462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c40b4900 0x7f67c41454f0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 --2- 172.21.15.67:0/1983411702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c4072590 0x7f67c414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 -- 172.21.15.67:0/1983411702 >> 172.21.15.67:0/1983411702 conn(0x7f67c40d0080 msgr2=0x7f67c40aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:45.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 -- 172.21.15.67:0/1983411702 shutdown_connections 2024-09-19T05:45:45.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.838+0000 7f67c95bc640 1 -- 172.21.15.67:0/1983411702 wait complete. 2024-09-19T05:45:45.855 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:45:45.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc5600b640 1 Processor -- start 2024-09-19T05:45:45.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc5600b640 1 -- start start 2024-09-19T05:45:45.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc5600b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcc50159c60 0x7fcc500ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc5600b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc5006ffd0 0x7fcc500aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc5600b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5015a040 con 0x7fcc500b3150 2024-09-19T05:45:45.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc5600b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fcc5015d460 con 0x7fcc50159c60 2024-09-19T05:45:45.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc5600b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5015c850 con 0x7fcc5006ffd0 2024-09-19T05:45:45.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcc500b3150 0x7fcc5015fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43262/0 (socket says 172.21.15.67:43262) 2024-09-19T05:45:45.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4ffff640 1 -- 172.21.15.67:0/2573594336 learned_addr learned my addr 172.21.15.67:0/2573594336 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:45.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4f7fe640 1 --2- 172.21.15.67:0/2573594336 >> v2:172.21.15.67:3300/0 conn(0x7fcc50159c60 0x7fcc500ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4effd640 1 --2- 172.21.15.67:0/2573594336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc5006ffd0 0x7fcc500aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4e7fc640 1 -- 172.21.15.67:0/2573594336 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851567112 0 0) 0x7fcc5015a040 con 0x7fcc500b3150 2024-09-19T05:45:45.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4e7fc640 1 -- 172.21.15.67:0/2573594336 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc38003530 con 0x7fcc500b3150 2024-09-19T05:45:45.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4f7fe640 1 -- 172.21.15.67:0/2573594336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc5006ffd0 msgr2=0x7fcc500aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:45.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4f7fe640 1 --2- 172.21.15.67:0/2573594336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc5006ffd0 0x7fcc500aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4f7fe640 1 -- 172.21.15.67:0/2573594336 >> v1:172.21.15.67:6789/0 conn(0x7fcc500b3150 legacy=0x7fcc5015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4f7fe640 1 -- 172.21.15.67:0/2573594336 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5015cb30 con 0x7fcc50159c60 2024-09-19T05:45:45.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.982+0000 7fcc4effd640 1 --2- 172.21.15.67:0/2573594336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc5006ffd0 0x7fcc500aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:45.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4f7fe640 1 --2- 172.21.15.67:0/2573594336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc50159c60 0x7fcc500ad130 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097c0 tx=0x7fcc4001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6768b3ec788fa19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:45.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4e7fc640 1 -- 172.21.15.67:0/2573594336 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400a7070 con 0x7fcc50159c60 2024-09-19T05:45:45.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4e7fc640 1 -- 172.21.15.67:0/2573594336 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc400b0070 con 0x7fcc50159c60 2024-09-19T05:45:45.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4e7fc640 1 -- 172.21.15.67:0/2573594336 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400ab890 con 0x7fcc50159c60 2024-09-19T05:45:45.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 -- 172.21.15.67:0/2573594336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc50159c60 msgr2=0x7fcc500ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 --2- 172.21.15.67:0/2573594336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc50159c60 0x7fcc500ad130 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097c0 tx=0x7fcc4001c470 comp rx=0 tx=0).stop 2024-09-19T05:45:45.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 -- 172.21.15.67:0/2573594336 shutdown_connections 2024-09-19T05:45:45.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 --2- 172.21.15.67:0/2573594336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc5006ffd0 0x7fcc500aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 --2- 172.21.15.67:0/2573594336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc50159c60 0x7fcc500ad130 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 -- 172.21.15.67:0/2573594336 >> 172.21.15.67:0/2573594336 conn(0x7fcc500b1e50 msgr2=0x7fcc500b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:45.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 -- 172.21.15.67:0/2573594336 shutdown_connections 2024-09-19T05:45:45.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 -- 172.21.15.67:0/2573594336 wait complete. 2024-09-19T05:45:45.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 Processor -- start 2024-09-19T05:45:45.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 -- start start 2024-09-19T05:45:45.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5006ffd0 0x7fcc501478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc500b3150 0x7fcc50150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc50159c60 0x7fcc50145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcc500ad7f0 con 0x7fcc5006ffd0 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcc500ad670 con 0x7fcc500b3150 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc5600b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fcc50168e30 con 0x7fcc50159c60 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5006ffd0 0x7fcc501478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5006ffd0 0x7fcc501478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39982/0 (socket says 172.21.15.67:39982) 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4f7fe640 1 -- 172.21.15.67:0/2450137244 learned_addr learned my addr 172.21.15.67:0/2450137244 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4ffff640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc50159c60 0x7fcc50145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4f7fe640 1 -- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc50159c60 msgr2=0x7fcc50145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4effd640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc500b3150 0x7fcc50150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4f7fe640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc50159c60 0x7fcc50145c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4f7fe640 1 -- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc500b3150 msgr2=0x7fcc50150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:45.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4f7fe640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc500b3150 0x7fcc50150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:45.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4f7fe640 1 -- 172.21.15.67:0/2450137244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc500b0f20 con 0x7fcc5006ffd0 2024-09-19T05:45:45.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.986+0000 7fcc4f7fe640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5006ffd0 0x7fcc501478e0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fcc400ad040 tx=0x7fcc4001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:45.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc37fff640 1 -- 172.21.15.67:0/2450137244 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400bf610 con 0x7fcc5006ffd0 2024-09-19T05:45:45.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc37fff640 1 -- 172.21.15.67:0/2450137244 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc400bf7d0 con 0x7fcc5006ffd0 2024-09-19T05:45:45.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc5600b640 1 -- 172.21.15.67:0/2450137244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc50146170 con 0x7fcc5006ffd0 2024-09-19T05:45:45.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc37fff640 1 -- 172.21.15.67:0/2450137244 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400bfbc0 con 0x7fcc5006ffd0 2024-09-19T05:45:45.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc5600b640 1 -- 172.21.15.67:0/2450137244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc500b14a0 con 0x7fcc5006ffd0 2024-09-19T05:45:45.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc5600b640 1 -- 172.21.15.67:0/2450137244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc500aec90 con 0x7fcc5006ffd0 2024-09-19T05:45:45.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc37fff640 1 -- 172.21.15.67:0/2450137244 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc400bd020 con 0x7fcc5006ffd0 2024-09-19T05:45:45.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc37fff640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc3c0678c0 0x7fcc3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:45.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc37fff640 1 -- 172.21.15.67:0/2450137244 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6101+0+0 (secure 0 0 0) 0x7fcc401204b0 con 0x7fcc5006ffd0 2024-09-19T05:45:45.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc4effd640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc3c0678c0 0x7fcc3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:45.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.990+0000 7fcc4effd640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc3c0678c0 0x7fcc3c069d80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcc5015e2a0 tx=0x7fcc44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:45.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:45.994+0000 7fcc37fff640 1 -- 172.21.15.67:0/2450137244 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fcc40016090 con 0x7fcc5006ffd0 2024-09-19T05:45:46.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:46.194+0000 7fcc5600b640 1 -- 172.21.15.67:0/2450137244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcc5015f6e0 con 0x7fcc5006ffd0 2024-09-19T05:45:47.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.194+0000 7fcc37fff640 1 -- 172.21.15.67:0/2450137244 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v114) ==== 118+0+0 (secure 0 0 0) 0x7fcc400f0e60 con 0x7fcc5006ffd0 2024-09-19T05:45:47.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 -- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc3c0678c0 msgr2=0x7fcc3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc3c0678c0 0x7fcc3c069d80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcc5015e2a0 tx=0x7fcc44008040 comp rx=0 tx=0).stop 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 -- 172.21.15.67:0/2450137244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5006ffd0 msgr2=0x7fcc501478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5006ffd0 0x7fcc501478e0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fcc400ad040 tx=0x7fcc4001acb0 comp rx=0 tx=0).stop 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 -- 172.21.15.67:0/2450137244 shutdown_connections 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fcc3c0678c0 0x7fcc3c069d80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc50159c60 0x7fcc50145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc500b3150 0x7fcc50150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 --2- 172.21.15.67:0/2450137244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5006ffd0 0x7fcc501478e0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 -- 172.21.15.67:0/2450137244 >> 172.21.15.67:0/2450137244 conn(0x7fcc500b1e50 msgr2=0x7fcc5015d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 -- 172.21.15.67:0/2450137244 shutdown_connections 2024-09-19T05:45:47.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.198+0000 7fcc5600b640 1 -- 172.21.15.67:0/2450137244 wait complete. 2024-09-19T05:45:47.219 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:45:47.219 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:45:47.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cd094d640 1 Processor -- start 2024-09-19T05:45:47.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cd094d640 1 -- start start 2024-09-19T05:45:47.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cd094d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc159c60 0x7f5ccc0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:47.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cd094d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5ccc0af3a0 0x7f5ccc15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:47.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cd094d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ccc15a040 con 0x7f5ccc06ffd0 2024-09-19T05:45:47.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cd094d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5ccc15d460 con 0x7f5ccc0af3a0 2024-09-19T05:45:47.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cd094d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5ccc15c850 con 0x7f5ccc159c60 2024-09-19T05:45:47.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5ccad9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5ccc0af3a0 0x7f5ccc15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:47.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cc9d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5ccc06ffd0 0x7f5ccc0aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:59634/0 (socket says 172.21.15.67:59634) 2024-09-19T05:45:47.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cc9d9b640 1 -- 172.21.15.67:0/1972638127 learned_addr learned my addr 172.21.15.67:0/1972638127 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:47.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cca59c640 1 --2- 172.21.15.67:0/1972638127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc159c60 0x7f5ccc0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:47.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cca59c640 1 -- 172.21.15.67:0/1972638127 >> v2:172.21.15.97:3300/0 conn(0x7f5ccc0af3a0 msgr2=0x7f5ccc15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:47.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cca59c640 1 --2- 172.21.15.67:0/1972638127 >> v2:172.21.15.97:3300/0 conn(0x7f5ccc0af3a0 0x7f5ccc15fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:47.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cca59c640 1 -- 172.21.15.67:0/1972638127 >> v1:172.21.15.97:6789/0 conn(0x7f5ccc06ffd0 legacy=0x7f5ccc0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:47.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5cca59c640 1 -- 172.21.15.67:0/1972638127 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ccc15cb30 con 0x7f5ccc159c60 2024-09-19T05:45:47.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.354+0000 7f5ccad9d640 1 --2- 172.21.15.67:0/1972638127 >> v2:172.21.15.97:3300/0 conn(0x7f5ccc0af3a0 0x7f5ccc15fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:45:47.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cca59c640 1 --2- 172.21.15.67:0/1972638127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc159c60 0x7f5ccc0ad130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009d90 tx=0x7f5cbc01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e9208ae10dd45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:47.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cc959a640 1 -- 172.21.15.67:0/1972638127 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0b2070 con 0x7f5ccc159c60 2024-09-19T05:45:47.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cc959a640 1 -- 172.21.15.67:0/1972638127 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cbc0a5a00 con 0x7f5ccc159c60 2024-09-19T05:45:47.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cc959a640 1 -- 172.21.15.67:0/1972638127 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0a5dd0 con 0x7f5ccc159c60 2024-09-19T05:45:47.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cd094d640 1 -- 172.21.15.67:0/1972638127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc159c60 msgr2=0x7f5ccc0ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:47.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cd094d640 1 --2- 172.21.15.67:0/1972638127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc159c60 0x7f5ccc0ad130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009d90 tx=0x7f5cbc01c940 comp rx=0 tx=0).stop 2024-09-19T05:45:47.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cd094d640 1 -- 172.21.15.67:0/1972638127 shutdown_connections 2024-09-19T05:45:47.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cd094d640 1 --2- 172.21.15.67:0/1972638127 >> v2:172.21.15.97:3300/0 conn(0x7f5ccc0af3a0 0x7f5ccc15fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:47.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cd094d640 1 --2- 172.21.15.67:0/1972638127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc159c60 0x7f5ccc0ad130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:47.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cd094d640 1 -- 172.21.15.67:0/1972638127 >> 172.21.15.67:0/1972638127 conn(0x7f5ccc0b1e50 msgr2=0x7f5ccc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:47.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cd094d640 1 -- 172.21.15.67:0/1972638127 shutdown_connections 2024-09-19T05:45:47.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cd094d640 1 -- 172.21.15.67:0/1972638127 wait complete. 2024-09-19T05:45:47.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cd094d640 1 Processor -- start 2024-09-19T05:45:47.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.358+0000 7f5cd094d640 1 -- start start 2024-09-19T05:45:47.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cd094d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc06ffd0 0x7f5ccc147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:47.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cd094d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc0af3a0 0x7f5ccc0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:47.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cd094d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ccc159c60 0x7f5ccc150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:47.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cd094d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc168e30 con 0x7f5ccc159c60 2024-09-19T05:45:47.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cd094d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc168fb0 con 0x7f5ccc06ffd0 2024-09-19T05:45:47.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cd094d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5ccc169130 con 0x7f5ccc0af3a0 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5ccad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ccc159c60 0x7f5ccc150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5ccad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ccc159c60 0x7f5ccc150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39992/0 (socket says 172.21.15.67:39992) 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5ccad9d640 1 -- 172.21.15.67:0/4230518430 learned_addr learned my addr 172.21.15.67:0/4230518430 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cca59c640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc06ffd0 0x7f5ccc147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cc9d9b640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc0af3a0 0x7f5ccc0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5ccad9d640 1 -- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc0af3a0 msgr2=0x7f5ccc0b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5ccad9d640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc0af3a0 0x7f5ccc0b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5ccad9d640 1 -- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc06ffd0 msgr2=0x7f5ccc147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5ccad9d640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc06ffd0 0x7f5ccc147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5ccad9d640 1 -- 172.21.15.67:0/4230518430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ccc15ece0 con 0x7f5ccc159c60 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cca59c640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc06ffd0 0x7f5ccc147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5ccad9d640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ccc159c60 0x7f5ccc150940 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400e950 tx=0x7f5cc400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:47.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cc2ffd640 1 -- 172.21.15.67:0/4230518430 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4017070 con 0x7f5ccc159c60 2024-09-19T05:45:47.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cc2ffd640 1 -- 172.21.15.67:0/4230518430 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc400ca00 con 0x7f5ccc159c60 2024-09-19T05:45:47.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cd094d640 1 -- 172.21.15.67:0/4230518430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ccc15efc0 con 0x7f5ccc159c60 2024-09-19T05:45:47.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cc2ffd640 1 -- 172.21.15.67:0/4230518430 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc400cdd0 con 0x7f5ccc159c60 2024-09-19T05:45:47.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cd094d640 1 -- 172.21.15.67:0/4230518430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ccc15f580 con 0x7f5ccc159c60 2024-09-19T05:45:47.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cd094d640 1 -- 172.21.15.67:0/4230518430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ccc15fda0 con 0x7f5ccc159c60 2024-09-19T05:45:47.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cc2ffd640 1 -- 172.21.15.67:0/4230518430 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5cc4013470 con 0x7f5ccc159c60 2024-09-19T05:45:47.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cc2ffd640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5cac0678c0 0x7f5cac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:47.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cc2ffd640 1 -- 172.21.15.67:0/4230518430 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f5cc4085ca0 con 0x7f5ccc159c60 2024-09-19T05:45:47.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.362+0000 7f5cca59c640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5cac0678c0 0x7f5cac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:47.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.366+0000 7f5cca59c640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5cac0678c0 0x7f5cac069d80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0af000 tx=0x7f5cbc0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:47.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.370+0000 7f5cc2ffd640 1 -- 172.21.15.67:0/4230518430 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5cc40566e0 con 0x7f5ccc159c60 2024-09-19T05:45:47.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:47.570+0000 7f5cd094d640 1 -- 172.21.15.67:0/4230518430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5ccc06e5b0 con 0x7f5ccc159c60 2024-09-19T05:45:48.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.206+0000 7f5cc2ffd640 1 -- 172.21.15.67:0/4230518430 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v115) ==== 122+0+0 (secure 0 0 0) 0x7f5cc4055fe0 con 0x7f5ccc159c60 2024-09-19T05:45:48.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 -- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5cac0678c0 msgr2=0x7f5cac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5cac0678c0 0x7f5cac069d80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0af000 tx=0x7f5cbc0a7070 comp rx=0 tx=0).stop 2024-09-19T05:45:48.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 -- 172.21.15.67:0/4230518430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ccc159c60 msgr2=0x7f5ccc150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ccc159c60 0x7f5ccc150940 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400e950 tx=0x7f5cc400ee10 comp rx=0 tx=0).stop 2024-09-19T05:45:48.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 -- 172.21.15.67:0/4230518430 shutdown_connections 2024-09-19T05:45:48.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ccc159c60 0x7f5ccc150940 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5cac0678c0 0x7f5cac069d80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ccc0af3a0 0x7f5ccc0b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 --2- 172.21.15.67:0/4230518430 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc06ffd0 0x7f5ccc147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 -- 172.21.15.67:0/4230518430 >> 172.21.15.67:0/4230518430 conn(0x7f5ccc0b1e50 msgr2=0x7f5ccc15a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:48.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 -- 172.21.15.67:0/4230518430 shutdown_connections 2024-09-19T05:45:48.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.210+0000 7f5cd094d640 1 -- 172.21.15.67:0/4230518430 wait complete. 2024-09-19T05:45:48.230 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:45:48.230 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f08a0e2a640 1 Processor -- start 2024-09-19T05:45:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f08a0e2a640 1 -- start start 2024-09-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f08a0e2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f089c15bfe0 0x7f089c0b5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f08a0e2a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f089c0affa0 0x7f089c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f08a0e2a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f089c0b4720 con 0x7f089c0ce8e0 2024-09-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f08a0e2a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f089c0b49c0 con 0x7f089c0affa0 2024-09-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f08a0e2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f089c0b4ca0 con 0x7f089c15bfe0 2024-09-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f0891d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f089c0affa0 0x7f089c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f0891d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f089c0affa0 0x7f089c0709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40004/0 (socket says 172.21.15.67:40004) 2024-09-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f0891d9b640 1 -- 172.21.15.67:0/213632726 learned_addr learned my addr 172.21.15.67:0/213632726 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f089a59c640 1 --2- 172.21.15.67:0/213632726 >> v2:172.21.15.97:3300/0 conn(0x7f089c15bfe0 0x7f089c0b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f0891d9b640 1 -- 172.21.15.67:0/213632726 >> v2:172.21.15.97:3300/0 conn(0x7f089c15bfe0 msgr2=0x7f089c0b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:48.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f0891d9b640 1 --2- 172.21.15.67:0/213632726 >> v2:172.21.15.97:3300/0 conn(0x7f089c15bfe0 0x7f089c0b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f0891d9b640 1 -- 172.21.15.67:0/213632726 >> v1:172.21.15.67:6789/0 conn(0x7f089c0ce8e0 legacy=0x7f089c15fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f0899d9b640 1 -- 172.21.15.67:0/213632726 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159995737 0 0) 0x7f089c0b4720 con 0x7f089c0ce8e0 2024-09-19T05:45:48.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.362+0000 7f0891d9b640 1 -- 172.21.15.67:0/213632726 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c0b4f80 con 0x7f089c0affa0 2024-09-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f0891d9b640 1 --2- 172.21.15.67:0/213632726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0affa0 0x7f089c0709a0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f089c069740 tx=0x7f088401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed751ebb929e3eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f0899d9b640 1 -- 172.21.15.67:0/213632726 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08840b1070 con 0x7f089c0affa0 2024-09-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f0899d9b640 1 -- 172.21.15.67:0/213632726 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08840ac620 con 0x7f089c0affa0 2024-09-19T05:45:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f0899d9b640 1 -- 172.21.15.67:0/213632726 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08840ac9f0 con 0x7f089c0affa0 2024-09-19T05:45:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 -- 172.21.15.67:0/213632726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0affa0 msgr2=0x7f089c0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 --2- 172.21.15.67:0/213632726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0affa0 0x7f089c0709a0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f089c069740 tx=0x7f088401c460 comp rx=0 tx=0).stop 2024-09-19T05:45:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 -- 172.21.15.67:0/213632726 shutdown_connections 2024-09-19T05:45:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 --2- 172.21.15.67:0/213632726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0affa0 0x7f089c0709a0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 --2- 172.21.15.67:0/213632726 >> v2:172.21.15.97:3300/0 conn(0x7f089c15bfe0 0x7f089c0b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 -- 172.21.15.67:0/213632726 >> 172.21.15.67:0/213632726 conn(0x7f089c0735a0 msgr2=0x7f089c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 -- 172.21.15.67:0/213632726 shutdown_connections 2024-09-19T05:45:48.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 -- 172.21.15.67:0/213632726 wait complete. 2024-09-19T05:45:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 Processor -- start 2024-09-19T05:45:48.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 -- start start 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f089c0affa0 0x7f089c149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0ce8e0 0x7f089c15e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f089c15bfe0 0x7f089c15e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f089c071060 con 0x7f089c0ce8e0 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f089c070ee0 con 0x7f089c15bfe0 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f08a0e2a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f089c168f00 con 0x7f089c0affa0 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f0891d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0ce8e0 0x7f089c15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f0891d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0ce8e0 0x7f089c15e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40012/0 (socket says 172.21.15.67:40012) 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f0891d9b640 1 -- 172.21.15.67:0/2634965283 learned_addr learned my addr 172.21.15.67:0/2634965283 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f089a59c640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f089c0affa0 0x7f089c149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.366+0000 7f089ad9d640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f089c15bfe0 0x7f089c15e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f0891d9b640 1 -- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f089c0affa0 msgr2=0x7f089c149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f0891d9b640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f089c0affa0 0x7f089c149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f0891d9b640 1 -- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f089c15bfe0 msgr2=0x7f089c15e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f0891d9b640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f089c15bfe0 0x7f089c15e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f0891d9b640 1 -- 172.21.15.67:0/2634965283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c14dd00 con 0x7f089c0ce8e0 2024-09-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f089ad9d640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f089c15bfe0 0x7f089c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f0891d9b640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0ce8e0 0x7f089c15e450 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f08840af040 tx=0x7f0884019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f08937fe640 1 -- 172.21.15.67:0/2634965283 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08840bc070 con 0x7f089c0ce8e0 2024-09-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f08937fe640 1 -- 172.21.15.67:0/2634965283 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08840b7430 con 0x7f089c0ce8e0 2024-09-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f08a0e2a640 1 -- 172.21.15.67:0/2634965283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f089c14dfa0 con 0x7f089c0ce8e0 2024-09-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f08937fe640 1 -- 172.21.15.67:0/2634965283 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08840b1040 con 0x7f089c0ce8e0 2024-09-19T05:45:48.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f08a0e2a640 1 -- 172.21.15.67:0/2634965283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f089c14e560 con 0x7f089c0ce8e0 2024-09-19T05:45:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f08a0e2a640 1 -- 172.21.15.67:0/2634965283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089c0709a0 con 0x7f089c0ce8e0 2024-09-19T05:45:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f08937fe640 1 -- 172.21.15.67:0/2634965283 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f08840bf070 con 0x7f089c0ce8e0 2024-09-19T05:45:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f08937fe640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f087c0678c0 0x7f087c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f08937fe640 1 -- 172.21.15.67:0/2634965283 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f088411f700 con 0x7f089c0ce8e0 2024-09-19T05:45:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f089a59c640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f087c0678c0 0x7f087c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.370+0000 7f089a59c640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f087c0678c0 0x7f087c069d80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f089c14f6a0 tx=0x7f088c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:48.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.374+0000 7f08937fe640 1 -- 172.21.15.67:0/2634965283 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0884016110 con 0x7f089c0ce8e0 2024-09-19T05:45:48.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.578+0000 7f08a0e2a640 1 -- 172.21.15.67:0/2634965283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f089c06c870 con 0x7f089c0ce8e0 2024-09-19T05:45:48.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.578+0000 7f08937fe640 1 -- 172.21.15.67:0/2634965283 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7f08840f00b0 con 0x7f089c0ce8e0 2024-09-19T05:45:48.577 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:48.578 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:45:48.578 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:45:48.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 -- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f087c0678c0 msgr2=0x7f087c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f087c0678c0 0x7f087c069d80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f089c14f6a0 tx=0x7f088c008040 comp rx=0 tx=0).stop 2024-09-19T05:45:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 -- 172.21.15.67:0/2634965283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0ce8e0 msgr2=0x7f089c15e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0ce8e0 0x7f089c15e450 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f08840af040 tx=0x7f0884019200 comp rx=0 tx=0).stop 2024-09-19T05:45:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 -- 172.21.15.67:0/2634965283 shutdown_connections 2024-09-19T05:45:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f089c15bfe0 0x7f089c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f089c0ce8e0 0x7f089c15e450 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f087c0678c0 0x7f087c069d80 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 --2- 172.21.15.67:0/2634965283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f089c0affa0 0x7f089c149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 -- 172.21.15.67:0/2634965283 >> 172.21.15.67:0/2634965283 conn(0x7f089c0735a0 msgr2=0x7f089c15a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 -- 172.21.15.67:0/2634965283 shutdown_connections 2024-09-19T05:45:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.582+0000 7f08a0e2a640 1 -- 172.21.15.67:0/2634965283 wait complete. 2024-09-19T05:45:48.597 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:45:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f772325b640 1 Processor -- start 2024-09-19T05:45:48.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f772325b640 1 -- start start 2024-09-19T05:45:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f772325b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f771c15c030 0x7f771c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f772325b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 0x7f771c06f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f772325b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f771c06e3c0 con 0x7f771c15d1d0 2024-09-19T05:45:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f772325b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f771c06e6a0 con 0x7f771c15c030 2024-09-19T05:45:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f772325b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f771c06e980 con 0x7f771c06f460 2024-09-19T05:45:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f77217f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 0x7f771c06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f7720ff7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f771c15c030 0x7f771c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f7720ff7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f771c15c030 0x7f771c06dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:37344/0 (socket says 172.21.15.67:37344) 2024-09-19T05:45:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f77217f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 0x7f771c06f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:43908/0 (socket says 172.21.15.67:43908) 2024-09-19T05:45:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f771bfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f771c15d1d0 0x7f771c0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:59644/0 (socket says 172.21.15.67:59644) 2024-09-19T05:45:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f7720ff7640 1 -- 172.21.15.67:0/166398957 learned_addr learned my addr 172.21.15.67:0/166398957 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f7720ff7640 1 -- 172.21.15.67:0/166398957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 msgr2=0x7f771c06f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f7720ff7640 1 --2- 172.21.15.67:0/166398957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 0x7f771c06f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f7720ff7640 1 -- 172.21.15.67:0/166398957 >> v1:172.21.15.97:6789/0 conn(0x7f771c15d1d0 legacy=0x7f771c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.726+0000 7f7720ff7640 1 -- 172.21.15.67:0/166398957 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c06ec60 con 0x7f771c15c030 2024-09-19T05:45:48.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f7720ff7640 1 --2- 172.21.15.67:0/166398957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f771c15c030 0x7f771c06dde0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f770c009870 tx=0x7f770c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8799172c891eceff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f771b7fe640 1 -- 172.21.15.67:0/166398957 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c0b0070 con 0x7f771c15c030 2024-09-19T05:45:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f771b7fe640 1 -- 172.21.15.67:0/166398957 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f770c0ab600 con 0x7f771c15c030 2024-09-19T05:45:48.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f771b7fe640 1 -- 172.21.15.67:0/166398957 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c0ab9d0 con 0x7f771c15c030 2024-09-19T05:45:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f772325b640 1 -- 172.21.15.67:0/166398957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f771c15c030 msgr2=0x7f771c06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f772325b640 1 --2- 172.21.15.67:0/166398957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f771c15c030 0x7f771c06dde0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f770c009870 tx=0x7f770c01c560 comp rx=0 tx=0).stop 2024-09-19T05:45:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f772325b640 1 -- 172.21.15.67:0/166398957 shutdown_connections 2024-09-19T05:45:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f772325b640 1 --2- 172.21.15.67:0/166398957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 0x7f771c06f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f772325b640 1 --2- 172.21.15.67:0/166398957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f771c15c030 0x7f771c06dde0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f772325b640 1 -- 172.21.15.67:0/166398957 >> 172.21.15.67:0/166398957 conn(0x7f771c0d0080 msgr2=0x7f771c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f772325b640 1 -- 172.21.15.67:0/166398957 shutdown_connections 2024-09-19T05:45:48.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f772325b640 1 -- 172.21.15.67:0/166398957 wait complete. 2024-09-19T05:45:48.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f772325b640 1 Processor -- start 2024-09-19T05:45:48.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.730+0000 7f772325b640 1 -- start start 2024-09-19T05:45:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f772325b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 0x7f771c147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f772325b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f771c15c030 0x7f771c14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f772325b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f771c15d1d0 0x7f771c15a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f772325b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f771c15c590 con 0x7f771c15c030 2024-09-19T05:45:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f772325b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f771c15c410 con 0x7f771c15d1d0 2024-09-19T05:45:48.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f772325b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f771c1690e0 con 0x7f771c06f460 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f771bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f771c15c030 0x7f771c14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f771bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f771c15c030 0x7f771c14e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40026/0 (socket says 172.21.15.67:40026) 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f771bfff640 1 -- 172.21.15.67:0/4259041073 learned_addr learned my addr 172.21.15.67:0/4259041073 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f77217f8640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f771c15d1d0 0x7f771c15a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f7720ff7640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 0x7f771c147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f771bfff640 1 -- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 msgr2=0x7f771c147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f771bfff640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 0x7f771c147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f771bfff640 1 -- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f771c15d1d0 msgr2=0x7f771c15a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f771bfff640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f771c15d1d0 0x7f771c15a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f771bfff640 1 -- 172.21.15.67:0/4259041073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c14eb50 con 0x7f771c15c030 2024-09-19T05:45:48.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f771bfff640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f771c15c030 0x7f771c14e090 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f771000c730 tx=0x7f771000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f77197fa640 1 -- 172.21.15.67:0/4259041073 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710017070 con 0x7f771c15c030 2024-09-19T05:45:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f77197fa640 1 -- 172.21.15.67:0/4259041073 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f771000ce40 con 0x7f771c15c030 2024-09-19T05:45:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f772325b640 1 -- 172.21.15.67:0/4259041073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c152e70 con 0x7f771c15c030 2024-09-19T05:45:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f77197fa640 1 -- 172.21.15.67:0/4259041073 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771000a860 con 0x7f771c15c030 2024-09-19T05:45:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f772325b640 1 -- 172.21.15.67:0/4259041073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c153430 con 0x7f771c15c030 2024-09-19T05:45:48.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f772325b640 1 -- 172.21.15.67:0/4259041073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771c06f890 con 0x7f771c15c030 2024-09-19T05:45:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f77197fa640 1 -- 172.21.15.67:0/4259041073 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f771001a070 con 0x7f771c15c030 2024-09-19T05:45:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.734+0000 7f77197fa640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77080678c0 0x7f7708069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.738+0000 7f77197fa640 1 -- 172.21.15.67:0/4259041073 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f77100857b0 con 0x7f771c15c030 2024-09-19T05:45:48.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.738+0000 7f7720ff7640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77080678c0 0x7f7708069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:48.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.738+0000 7f7720ff7640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77080678c0 0x7f7708069d80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f770c0ad000 tx=0x7f770c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:48.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.738+0000 7f77197fa640 1 -- 172.21.15.67:0/4259041073 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7710021020 con 0x7f771c15c030 2024-09-19T05:45:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.906+0000 7f772325b640 1 -- 172.21.15.67:0/4259041073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f771c0b3c40 con 0x7f771c15c030 2024-09-19T05:45:48.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.906+0000 7f77197fa640 1 -- 172.21.15.67:0/4259041073 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) ==== 74+0+16908 (secure 0 0 0) 0x7f7710055b60 con 0x7f771c15c030 2024-09-19T05:45:48.906 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:48.907 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":168,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:45:46.186562+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:45:42.191879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-19T05:45:43.532181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:45:48.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 -- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77080678c0 msgr2=0x7f7708069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77080678c0 0x7f7708069d80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f770c0ad000 tx=0x7f770c008040 comp rx=0 tx=0).stop 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 -- 172.21.15.67:0/4259041073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f771c15c030 msgr2=0x7f771c14e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f771c15c030 0x7f771c14e090 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f771000c730 tx=0x7f771000cbf0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 -- 172.21.15.67:0/4259041073 shutdown_connections 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f771c15d1d0 0x7f771c15a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f771c15c030 0x7f771c14e090 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77080678c0 0x7f7708069d80 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 --2- 172.21.15.67:0/4259041073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f771c06f460 0x7f771c147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 -- 172.21.15.67:0/4259041073 >> 172.21.15.67:0/4259041073 conn(0x7f771c0d0080 msgr2=0x7f771c15d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 -- 172.21.15.67:0/4259041073 shutdown_connections 2024-09-19T05:45:48.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:48.910+0000 7f772325b640 1 -- 172.21.15.67:0/4259041073 wait complete. 2024-09-19T05:45:48.927 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:45:48.927 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:45:49.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.050+0000 7f85bb563640 1 Processor -- start 2024-09-19T05:45:49.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.050+0000 7f85bb563640 1 -- start start 2024-09-19T05:45:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85bb563640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85b415e330 0x7f85b4071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85bb563640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b40b4420 con 0x7f85b40b4bc0 2024-09-19T05:45:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85bb563640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b4162d90 con 0x7f85b40b2fd0 2024-09-19T05:45:49.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85bb563640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f85b40acfb0 con 0x7f85b415e330 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b9b00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f85b40b4bc0 0x7f85b4162680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43280/0 (socket says 172.21.15.67:43280) 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b9b00640 1 -- 172.21.15.67:0/3808652634 learned_addr learned my addr 172.21.15.67:0/3808652634 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b92ff640 1 --2- 172.21.15.67:0/3808652634 >> v2:172.21.15.97:3300/0 conn(0x7f85b415e330 0x7f85b4071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066527802 0 0) 0x7f85b40b4420 con 0x7f85b40b4bc0 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85a0003530 con 0x7f85b40b4bc0 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1466624153 0 0) 0x7f85a0003530 con 0x7f85b40b4bc0 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 >> v2:172.21.15.97:3300/0 conn(0x7f85b415e330 msgr2=0x7f85b4071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 --2- 172.21.15.67:0/3808652634 >> v2:172.21.15.97:3300/0 conn(0x7f85b415e330 0x7f85b4071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 >> v1:172.21.15.97:6789/0 conn(0x7f85b40b2fd0 legacy=0x7f85b4161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b40b4140 con 0x7f85b40b4bc0 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f85ac001a00 con 0x7f85b40b4bc0 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 >> v1:172.21.15.67:6789/0 conn(0x7f85b40b4bc0 legacy=0x7f85b4162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:49.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a00039c0 0x7f85a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a0004810 0x7f85a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85a00051d0 0x7f85a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f85a000c0f0 con 0x7f85a00039c0 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f85a000c2a0 con 0x7f85a00051d0 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f85a000c4a0 con 0x7f85a0004810 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b92ff640 1 --2- 172.21.15.67:0/3808652634 >> v2:172.21.15.97:3300/0 conn(0x7f85b415e330 0x7f85b4071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b92ff640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a00039c0 0x7f85a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b9b00640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85a00051d0 0x7f85a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b8afe640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a0004810 0x7f85a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b92ff640 1 -- 172.21.15.67:0/3808652634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a0004810 msgr2=0x7f85a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b92ff640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a0004810 0x7f85a0004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b92ff640 1 -- 172.21.15.67:0/3808652634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85a00051d0 msgr2=0x7f85a000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:49.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b92ff640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85a00051d0 0x7f85a000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b92ff640 1 -- 172.21.15.67:0/3808652634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a0003530 con 0x7f85a00039c0 2024-09-19T05:45:49.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.054+0000 7f85b9b00640 1 -- 172.21.15.67:0/3808652634 reap_dead start 2024-09-19T05:45:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b92ff640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a00039c0 0x7f85a0003de0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f85a80098b0 tx=0x7f85a801c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6e62ff2a921c9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a800f040 con 0x7f85a00039c0 2024-09-19T05:45:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a8004020 con 0x7f85a00039c0 2024-09-19T05:45:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85a7fff640 1 -- 172.21.15.67:0/3808652634 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a80041f0 con 0x7f85a00039c0 2024-09-19T05:45:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 -- 172.21.15.67:0/3808652634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a00039c0 msgr2=0x7f85a0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a00039c0 0x7f85a0003de0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f85a80098b0 tx=0x7f85a801c5b0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 -- 172.21.15.67:0/3808652634 shutdown_connections 2024-09-19T05:45:49.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 --2- 172.21.15.67:0/3808652634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a00039c0 0x7f85a0003de0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 -- 172.21.15.67:0/3808652634 >> 172.21.15.67:0/3808652634 conn(0x7f85b40d0080 msgr2=0x7f85b40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 -- 172.21.15.67:0/3808652634 shutdown_connections 2024-09-19T05:45:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 -- 172.21.15.67:0/3808652634 wait complete. 2024-09-19T05:45:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 Processor -- start 2024-09-19T05:45:49.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 -- start start 2024-09-19T05:45:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a00039c0 0x7f85b415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b41594b0 0x7f85b4159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:49.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85b409add0 0x7f85b409b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f85b40cfe40 con 0x7f85b41594b0 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f85b40cfcc0 con 0x7f85b409add0 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85bb563640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f85b4161f70 con 0x7f85a00039c0 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b8afe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b41594b0 0x7f85b4159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b8afe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b41594b0 0x7f85b4159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40042/0 (socket says 172.21.15.67:40042) 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b8afe640 1 -- 172.21.15.67:0/662395909 learned_addr learned my addr 172.21.15.67:0/662395909 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b92ff640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a00039c0 0x7f85b415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b9b00640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85b409add0 0x7f85b409b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b8afe640 1 -- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a00039c0 msgr2=0x7f85b415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b8afe640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a00039c0 0x7f85b415a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b8afe640 1 -- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85b409add0 msgr2=0x7f85b409b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b8afe640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85b409add0 0x7f85b409b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b8afe640 1 -- 172.21.15.67:0/662395909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b4158450 con 0x7f85b41594b0 2024-09-19T05:45:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.058+0000 7f85b8afe640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b41594b0 0x7f85b4159930 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f85b000d570 tx=0x7f85b000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85a5ffb640 1 -- 172.21.15.67:0/662395909 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0005480 con 0x7f85b41594b0 2024-09-19T05:45:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85a5ffb640 1 -- 172.21.15.67:0/662395909 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b0017070 con 0x7f85b41594b0 2024-09-19T05:45:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85bb563640 1 -- 172.21.15.67:0/662395909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b41586f0 con 0x7f85b41594b0 2024-09-19T05:45:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85a5ffb640 1 -- 172.21.15.67:0/662395909 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0003820 con 0x7f85b41594b0 2024-09-19T05:45:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85bb563640 1 -- 172.21.15.67:0/662395909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b4158cb0 con 0x7f85b41594b0 2024-09-19T05:45:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85bb563640 1 -- 172.21.15.67:0/662395909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b4162300 con 0x7f85b41594b0 2024-09-19T05:45:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85a5ffb640 1 -- 172.21.15.67:0/662395909 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85b00039c0 con 0x7f85b41594b0 2024-09-19T05:45:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85a5ffb640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85980678c0 0x7f8598069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:49.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85a5ffb640 1 -- 172.21.15.67:0/662395909 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f85b0085c30 con 0x7f85b41594b0 2024-09-19T05:45:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85b92ff640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85980678c0 0x7f8598069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:49.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.062+0000 7f85b92ff640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85980678c0 0x7f8598069d80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f85a80ad000 tx=0x7f85a80046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:49.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.066+0000 7f85a5ffb640 1 -- 172.21.15.67:0/662395909 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f85b0019310 con 0x7f85b41594b0 2024-09-19T05:45:49.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.222+0000 7f85bb563640 1 -- 172.21.15.67:0/662395909 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85b4161ce0 con 0x7f85980678c0 2024-09-19T05:45:49.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.238+0000 7f85a5ffb640 1 -- 172.21.15.67:0/662395909 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237320 (secure 0 0 0) 0x7f85b4161ce0 con 0x7f85980678c0 2024-09-19T05:45:49.238 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:49.240 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:45:49.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 -- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85980678c0 msgr2=0x7f8598069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:49.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85980678c0 0x7f8598069d80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f85a80ad000 tx=0x7f85a80046d0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 -- 172.21.15.67:0/662395909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b41594b0 msgr2=0x7f85b4159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:49.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b41594b0 0x7f85b4159930 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f85b000d570 tx=0x7f85b000da30 comp rx=0 tx=0).stop 2024-09-19T05:45:49.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 -- 172.21.15.67:0/662395909 shutdown_connections 2024-09-19T05:45:49.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85b409add0 0x7f85b409b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b41594b0 0x7f85b4159930 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f85980678c0 0x7f8598069d80 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 --2- 172.21.15.67:0/662395909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85a00039c0 0x7f85b415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 -- 172.21.15.67:0/662395909 >> 172.21.15.67:0/662395909 conn(0x7f85b40d0080 msgr2=0x7f85b40aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 -- 172.21.15.67:0/662395909 shutdown_connections 2024-09-19T05:45:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.242+0000 7f85bb563640 1 -- 172.21.15.67:0/662395909 wait complete. 2024-09-19T05:45:49.255 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2024-09-19T05:45:47.370900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":518040,"kb_used_data":17224,"kb_used_omap":12,"kb_used_meta":500595,"kb_avail":754456680,"statfs":{"total":773094113280,"available":772563640320,"internally_reserved":0,"allocated":17637376,"data_stored":8925224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":512609841},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.213860"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:44.158720+0000","last_change":"2024-09-19T05:45:44.158720+0000","last_active":"2024-09-19T05:45:44.158720+0000","last_peered":"2024-09-19T05:45:44.158720+0000","last_clean":"2024-09-19T05:45:44.158720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:44.158720+0000","last_undegraded":"2024-09-19T05:45:44.158720+0000","last_fullsized":"2024-09-19T05:45:44.158720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T05:45:43.148926+0000","last_change":"2024-09-19T05:45:43.148926+0000","last_active":"2024-09-19T05:45:43.148926+0000","last_peered":"2024-09-19T05:45:43.148926+0000","last_clean":"2024-09-19T05:45:43.148926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:45:43.148926+0000","last_undegraded":"2024-09-19T05:45:43.148926+0000","last_fullsized":"2024-09-19T05:45:43.148926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":431,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-19T05:45:41.559013+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:45:41.559013+0000","last_peered":"2024-09-19T05:45:41.559013+0000","last_clean":"2024-09-19T05:45:41.559013+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:45:41.559013+0000","last_undegraded":"2024-09-19T05:45:41.559013+0000","last_fullsized":"2024-09-19T05:45:41.559013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542298,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69876,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301964,"statfs":{"total":96636764160,"available":96565211136,"internally_reserved":0,"allocated":2650112,"data_stored":1558429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69296,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302544,"statfs":{"total":96636764160,"available":96565805056,"internally_reserved":0,"allocated":2056192,"data_stored":968061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542300,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47092,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324748,"statfs":{"total":96636764160,"available":96588541952,"internally_reserved":0,"allocated":2056192,"data_stored":968061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73460,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298380,"statfs":{"total":96636764160,"available":96561541120,"internally_reserved":0,"allocated":2056192,"data_stored":968061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542299,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51252,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320588,"statfs":{"total":96636764160,"available":96584282112,"internally_reserved":0,"allocated":2056192,"data_stored":968061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542299,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73456,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298384,"statfs":{"total":96636764160,"available":96561545216,"internally_reserved":0,"allocated":2056192,"data_stored":968061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542301,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59568,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312272,"statfs":{"total":96636764160,"available":96575766528,"internally_reserved":0,"allocated":2056192,"data_stored":968061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542298,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74040,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297800,"statfs":{"total":96636764160,"available":96560947200,"internally_reserved":0,"allocated":2650112,"data_stored":1558429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:45:49.260 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:45:49.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.426+0000 7f3064997640 1 Processor -- start 2024-09-19T05:45:50.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.426+0000 7f3064997640 1 -- start start 2024-09-19T05:45:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3064997640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f306006dde0 0x7f30600b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3064997640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30600b3510 0x7f306006f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3064997640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306006e3c0 con 0x7f306015c030 2024-09-19T05:45:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3064997640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f306006e6a0 con 0x7f306006dde0 2024-09-19T05:45:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3064997640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f306006e980 con 0x7f30600b3510 2024-09-19T05:45:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3055d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f306006dde0 0x7f30600b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3055d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f306006dde0 0x7f30600b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40046/0 (socket says 172.21.15.67:40046) 2024-09-19T05:45:50.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3055d9b640 1 -- 172.21.15.67:0/3351750746 learned_addr learned my addr 172.21.15.67:0/3351750746 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:50.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f305ed9d640 1 --2- 172.21.15.67:0/3351750746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30600b3510 0x7f306006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3055d9b640 1 -- 172.21.15.67:0/3351750746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30600b3510 msgr2=0x7f306006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:50.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3055d9b640 1 --2- 172.21.15.67:0/3351750746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30600b3510 0x7f306006f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3055d9b640 1 -- 172.21.15.67:0/3351750746 >> v1:172.21.15.97:6789/0 conn(0x7f306015c030 legacy=0x7f306015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:50.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3055d9b640 1 -- 172.21.15.67:0/3351750746 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306006ec60 con 0x7f306006dde0 2024-09-19T05:45:50.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f305ed9d640 1 --2- 172.21.15.67:0/3351750746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30600b3510 0x7f306006f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:50.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f3055d9b640 1 --2- 172.21.15.67:0/3351750746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306006dde0 0x7f30600b2fd0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f3050009870 tx=0x7f305001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39103c71cdf427 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f305dd9b640 1 -- 172.21.15.67:0/3351750746 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500b1070 con 0x7f306006dde0 2024-09-19T05:45:50.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f305dd9b640 1 -- 172.21.15.67:0/3351750746 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30500ac620 con 0x7f306006dde0 2024-09-19T05:45:50.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.430+0000 7f305dd9b640 1 -- 172.21.15.67:0/3351750746 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500ac9f0 con 0x7f306006dde0 2024-09-19T05:45:50.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- 172.21.15.67:0/3351750746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306006dde0 msgr2=0x7f30600b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 --2- 172.21.15.67:0/3351750746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306006dde0 0x7f30600b2fd0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f3050009870 tx=0x7f305001c4f0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- 172.21.15.67:0/3351750746 shutdown_connections 2024-09-19T05:45:50.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 --2- 172.21.15.67:0/3351750746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30600b3510 0x7f306006f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 --2- 172.21.15.67:0/3351750746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306006dde0 0x7f30600b2fd0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- 172.21.15.67:0/3351750746 >> 172.21.15.67:0/3351750746 conn(0x7f30600d0080 msgr2=0x7f30600d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- 172.21.15.67:0/3351750746 shutdown_connections 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- 172.21.15.67:0/3351750746 wait complete. 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 Processor -- start 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- start start 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f306006dde0 0x7f30601665d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30600b3510 0x7f30601643d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f306015c030 0x7f3060150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f30601692f0 con 0x7f30600b3510 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f306015c620 con 0x7f306015c030 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3060169470 con 0x7f306006dde0 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3055d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30600b3510 0x7f30601643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3055d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30600b3510 0x7f30601643d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40054/0 (socket says 172.21.15.67:40054) 2024-09-19T05:45:50.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3055d9b640 1 -- 172.21.15.67:0/2275335645 learned_addr learned my addr 172.21.15.67:0/2275335645 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:50.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f305ed9d640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f306015c030 0x7f3060150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3055d9b640 1 -- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f306006dde0 msgr2=0x7f30601665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3055d9b640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f306006dde0 0x7f30601665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3055d9b640 1 -- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f306015c030 msgr2=0x7f3060150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3055d9b640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f306015c030 0x7f3060150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3055d9b640 1 -- 172.21.15.67:0/2275335645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3060166b10 con 0x7f30600b3510 2024-09-19T05:45:50.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f305ed9d640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f306015c030 0x7f3060150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:50.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3055d9b640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30600b3510 0x7f30601643d0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f30500af040 tx=0x7f3050019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f30577fe640 1 -- 172.21.15.67:0/2275335645 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500b1040 con 0x7f30600b3510 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f30577fe640 1 -- 172.21.15.67:0/2275335645 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30500ba070 con 0x7f30600b3510 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f30577fe640 1 -- 172.21.15.67:0/2275335645 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500b58a0 con 0x7f30600b3510 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- 172.21.15.67:0/2275335645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306013f770 con 0x7f30600b3510 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.434+0000 7f3064997640 1 -- 172.21.15.67:0/2275335645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306013fd30 con 0x7f30600b3510 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.438+0000 7f3064997640 1 -- 172.21.15.67:0/2275335645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30600b2fd0 con 0x7f30600b3510 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.438+0000 7f30577fe640 1 -- 172.21.15.67:0/2275335645 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30500ac4e0 con 0x7f30600b3510 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.438+0000 7f30577fe640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30440678c0 0x7f3044069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.438+0000 7f30577fe640 1 -- 172.21.15.67:0/2275335645 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f305011fda0 con 0x7f30600b3510 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.438+0000 7f305e59c640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30440678c0 0x7f3044069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.438+0000 7f305e59c640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30440678c0 0x7f3044069d80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3048009670 tx=0x7f3048006bd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.442+0000 7f30577fe640 1 -- 172.21.15.67:0/2275335645 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3050016110 con 0x7f30600b3510 2024-09-19T05:45:50.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.598+0000 7f3064997640 1 -- 172.21.15.67:0/2275335645 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30600d0f20 con 0x7f30440678c0 2024-09-19T05:45:50.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.614+0000 7f30577fe640 1 -- 172.21.15.67:0/2275335645 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252466 (secure 0 0 0) 0x7f30600d0f20 con 0x7f30440678c0 2024-09-19T05:45:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:50.037 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:45:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 -- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30440678c0 msgr2=0x7f3044069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30440678c0 0x7f3044069d80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3048009670 tx=0x7f3048006bd0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 -- 172.21.15.67:0/2275335645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30600b3510 msgr2=0x7f30601643d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30600b3510 0x7f30601643d0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f30500af040 tx=0x7f3050019290 comp rx=0 tx=0).stop 2024-09-19T05:45:50.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 -- 172.21.15.67:0/2275335645 shutdown_connections 2024-09-19T05:45:50.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f306015c030 0x7f3060150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30600b3510 0x7f30601643d0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30440678c0 0x7f3044069d80 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 --2- 172.21.15.67:0/2275335645 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f306006dde0 0x7f30601665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 -- 172.21.15.67:0/2275335645 >> 172.21.15.67:0/2275335645 conn(0x7f30600d0080 msgr2=0x7f30600afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:50.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 -- 172.21.15.67:0/2275335645 shutdown_connections 2024-09-19T05:45:50.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:49.618+0000 7f3064997640 1 -- 172.21.15.67:0/2275335645 wait complete. 2024-09-19T05:45:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":545,"stamp":"2024-09-19T05:45:49.371464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":518420,"kb_used_data":17624,"kb_used_omap":12,"kb_used_meta":500595,"kb_avail":754456300,"statfs":{"total":773094113280,"available":772563251200,"internally_reserved":0,"allocated":18046976,"data_stored":9117092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":512609841},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001716"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.859800+0000","last_change":"2024-09-19T05:45:45.210526+0000","last_active":"2024-09-19T05:45:46.859800+0000","last_peered":"2024-09-19T05:45:46.859800+0000","last_clean":"2024-09-19T05:45:46.859800+0000","last_became_active":"2024-09-19T05:45:45.209812+0000","last_became_peered":"2024-09-19T05:45:45.209812+0000","last_unstale":"2024-09-19T05:45:46.859800+0000","last_undegraded":"2024-09-19T05:45:46.859800+0000","last_fullsized":"2024-09-19T05:45:46.859800+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:09.212993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.228695+0000","last_change":"2024-09-19T05:45:45.216062+0000","last_active":"2024-09-19T05:45:45.228695+0000","last_peered":"2024-09-19T05:45:45.228695+0000","last_clean":"2024-09-19T05:45:45.228695+0000","last_became_active":"2024-09-19T05:45:45.214991+0000","last_became_peered":"2024-09-19T05:45:45.214991+0000","last_unstale":"2024-09-19T05:45:45.228695+0000","last_undegraded":"2024-09-19T05:45:45.228695+0000","last_fullsized":"2024-09-19T05:45:45.228695+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.091521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.859260+0000","last_change":"2024-09-19T05:45:45.226447+0000","last_active":"2024-09-19T05:45:46.859260+0000","last_peered":"2024-09-19T05:45:46.859260+0000","last_clean":"2024-09-19T05:45:46.859260+0000","last_became_active":"2024-09-19T05:45:45.221081+0000","last_became_peered":"2024-09-19T05:45:45.221081+0000","last_unstale":"2024-09-19T05:45:46.859260+0000","last_undegraded":"2024-09-19T05:45:46.859260+0000","last_fullsized":"2024-09-19T05:45:46.859260+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:03.683694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.859622+0000","last_change":"2024-09-19T05:45:45.228323+0000","last_active":"2024-09-19T05:45:46.859622+0000","last_peered":"2024-09-19T05:45:46.859622+0000","last_clean":"2024-09-19T05:45:46.859622+0000","last_became_active":"2024-09-19T05:45:45.220861+0000","last_became_peered":"2024-09-19T05:45:45.220861+0000","last_unstale":"2024-09-19T05:45:46.859622+0000","last_undegraded":"2024-09-19T05:45:46.859622+0000","last_fullsized":"2024-09-19T05:45:46.859622+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:13.131094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.950034+0000","last_change":"2024-09-19T05:45:45.223194+0000","last_active":"2024-09-19T05:45:46.950034+0000","last_peered":"2024-09-19T05:45:46.950034+0000","last_clean":"2024-09-19T05:45:46.950034+0000","last_became_active":"2024-09-19T05:45:45.222903+0000","last_became_peered":"2024-09-19T05:45:45.222903+0000","last_unstale":"2024-09-19T05:45:46.950034+0000","last_undegraded":"2024-09-19T05:45:46.950034+0000","last_fullsized":"2024-09-19T05:45:46.950034+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:42.654360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.230951+0000","last_change":"2024-09-19T05:45:45.225320+0000","last_active":"2024-09-19T05:45:45.230951+0000","last_peered":"2024-09-19T05:45:45.230951+0000","last_clean":"2024-09-19T05:45:45.230951+0000","last_became_active":"2024-09-19T05:45:45.214772+0000","last_became_peered":"2024-09-19T05:45:45.214772+0000","last_unstale":"2024-09-19T05:45:45.230951+0000","last_undegraded":"2024-09-19T05:45:45.230951+0000","last_fullsized":"2024-09-19T05:45:45.230951+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:42.393908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.198713+0000","last_change":"2024-09-19T05:45:45.203367+0000","last_active":"2024-09-19T05:45:46.198713+0000","last_peered":"2024-09-19T05:45:46.198713+0000","last_clean":"2024-09-19T05:45:46.198713+0000","last_became_active":"2024-09-19T05:45:45.203082+0000","last_became_peered":"2024-09-19T05:45:45.203082+0000","last_unstale":"2024-09-19T05:45:46.198713+0000","last_undegraded":"2024-09-19T05:45:46.198713+0000","last_fullsized":"2024-09-19T05:45:46.198713+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:15.583545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.198382+0000","last_change":"2024-09-19T05:45:45.237221+0000","last_active":"2024-09-19T05:45:46.198382+0000","last_peered":"2024-09-19T05:45:46.198382+0000","last_clean":"2024-09-19T05:45:46.198382+0000","last_became_active":"2024-09-19T05:45:45.236868+0000","last_became_peered":"2024-09-19T05:45:45.236868+0000","last_unstale":"2024-09-19T05:45:46.198382+0000","last_undegraded":"2024-09-19T05:45:46.198382+0000","last_fullsized":"2024-09-19T05:45:46.198382+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:13:30.340849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.199450+0000","last_change":"2024-09-19T05:45:45.219997+0000","last_active":"2024-09-19T05:45:46.199450+0000","last_peered":"2024-09-19T05:45:46.199450+0000","last_clean":"2024-09-19T05:45:46.199450+0000","last_became_active":"2024-09-19T05:45:45.219586+0000","last_became_peered":"2024-09-19T05:45:45.219586+0000","last_unstale":"2024-09-19T05:45:46.199450+0000","last_undegraded":"2024-09-19T05:45:46.199450+0000","last_fullsized":"2024-09-19T05:45:46.199450+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:50.669372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.199322+0000","last_change":"2024-09-19T05:45:45.224970+0000","last_active":"2024-09-19T05:45:46.199322+0000","last_peered":"2024-09-19T05:45:46.199322+0000","last_clean":"2024-09-19T05:45:46.199322+0000","last_became_active":"2024-09-19T05:45:45.224717+0000","last_became_peered":"2024-09-19T05:45:45.224717+0000","last_unstale":"2024-09-19T05:45:46.199322+0000","last_undegraded":"2024-09-19T05:45:46.199322+0000","last_fullsized":"2024-09-19T05:45:46.199322+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:38.862277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684612+0000","last_change":"2024-09-19T05:45:45.201361+0000","last_active":"2024-09-19T05:45:46.684612+0000","last_peered":"2024-09-19T05:45:46.684612+0000","last_clean":"2024-09-19T05:45:46.684612+0000","last_became_active":"2024-09-19T05:45:45.198928+0000","last_became_peered":"2024-09-19T05:45:45.198928+0000","last_unstale":"2024-09-19T05:45:46.684612+0000","last_undegraded":"2024-09-19T05:45:46.684612+0000","last_fullsized":"2024-09-19T05:45:46.684612+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:01.585750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.235560+0000","last_change":"2024-09-19T05:45:45.230429+0000","last_active":"2024-09-19T05:45:45.235560+0000","last_peered":"2024-09-19T05:45:45.235560+0000","last_clean":"2024-09-19T05:45:45.235560+0000","last_became_active":"2024-09-19T05:45:45.229556+0000","last_became_peered":"2024-09-19T05:45:45.229556+0000","last_unstale":"2024-09-19T05:45:45.235560+0000","last_undegraded":"2024-09-19T05:45:45.235560+0000","last_fullsized":"2024-09-19T05:45:45.235560+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:11.366262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.188127+0000","last_change":"2024-09-19T05:45:45.219492+0000","last_active":"2024-09-19T05:45:47.188127+0000","last_peered":"2024-09-19T05:45:47.188127+0000","last_clean":"2024-09-19T05:45:47.188127+0000","last_became_active":"2024-09-19T05:45:45.219189+0000","last_became_peered":"2024-09-19T05:45:45.219189+0000","last_unstale":"2024-09-19T05:45:47.188127+0000","last_undegraded":"2024-09-19T05:45:47.188127+0000","last_fullsized":"2024-09-19T05:45:47.188127+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:58.982384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.949929+0000","last_change":"2024-09-19T05:45:45.198827+0000","last_active":"2024-09-19T05:45:46.949929+0000","last_peered":"2024-09-19T05:45:46.949929+0000","last_clean":"2024-09-19T05:45:46.949929+0000","last_became_active":"2024-09-19T05:45:45.198316+0000","last_became_peered":"2024-09-19T05:45:45.198316+0000","last_unstale":"2024-09-19T05:45:46.949929+0000","last_undegraded":"2024-09-19T05:45:46.949929+0000","last_fullsized":"2024-09-19T05:45:46.949929+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:49.372646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684129+0000","last_change":"2024-09-19T05:45:45.190658+0000","last_active":"2024-09-19T05:45:46.684129+0000","last_peered":"2024-09-19T05:45:46.684129+0000","last_clean":"2024-09-19T05:45:46.684129+0000","last_became_active":"2024-09-19T05:45:45.189917+0000","last_became_peered":"2024-09-19T05:45:45.189917+0000","last_unstale":"2024-09-19T05:45:46.684129+0000","last_undegraded":"2024-09-19T05:45:46.684129+0000","last_fullsized":"2024-09-19T05:45:46.684129+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:03.149732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.859074+0000","last_change":"2024-09-19T05:45:45.234716+0000","last_active":"2024-09-19T05:45:46.859074+0000","last_peered":"2024-09-19T05:45:46.859074+0000","last_clean":"2024-09-19T05:45:46.859074+0000","last_became_active":"2024-09-19T05:45:45.234042+0000","last_became_peered":"2024-09-19T05:45:45.234042+0000","last_unstale":"2024-09-19T05:45:46.859074+0000","last_undegraded":"2024-09-19T05:45:46.859074+0000","last_fullsized":"2024-09-19T05:45:46.859074+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:51.881869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.199600+0000","last_change":"2024-09-19T05:45:45.206113+0000","last_active":"2024-09-19T05:45:46.199600+0000","last_peered":"2024-09-19T05:45:46.199600+0000","last_clean":"2024-09-19T05:45:46.199600+0000","last_became_active":"2024-09-19T05:45:45.205713+0000","last_became_peered":"2024-09-19T05:45:45.205713+0000","last_unstale":"2024-09-19T05:45:46.199600+0000","last_undegraded":"2024-09-19T05:45:46.199600+0000","last_fullsized":"2024-09-19T05:45:46.199600+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:47.182305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.197669+0000","last_change":"2024-09-19T05:45:45.220210+0000","last_active":"2024-09-19T05:45:46.197669+0000","last_peered":"2024-09-19T05:45:46.197669+0000","last_clean":"2024-09-19T05:45:46.197669+0000","last_became_active":"2024-09-19T05:45:45.213354+0000","last_became_peered":"2024-09-19T05:45:45.213354+0000","last_unstale":"2024-09-19T05:45:46.197669+0000","last_undegraded":"2024-09-19T05:45:46.197669+0000","last_fullsized":"2024-09-19T05:45:46.197669+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:13.131094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684715+0000","last_change":"2024-09-19T05:45:45.191491+0000","last_active":"2024-09-19T05:45:46.684715+0000","last_peered":"2024-09-19T05:45:46.684715+0000","last_clean":"2024-09-19T05:45:46.684715+0000","last_became_active":"2024-09-19T05:45:45.190747+0000","last_became_peered":"2024-09-19T05:45:45.190747+0000","last_unstale":"2024-09-19T05:45:46.684715+0000","last_undegraded":"2024-09-19T05:45:46.684715+0000","last_fullsized":"2024-09-19T05:45:46.684715+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:25.866159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.540529+0000","last_change":"2024-09-19T05:45:45.194133+0000","last_active":"2024-09-19T05:45:47.540529+0000","last_peered":"2024-09-19T05:45:47.540529+0000","last_clean":"2024-09-19T05:45:47.540529+0000","last_became_active":"2024-09-19T05:45:45.193813+0000","last_became_peered":"2024-09-19T05:45:45.193813+0000","last_unstale":"2024-09-19T05:45:47.540529+0000","last_undegraded":"2024-09-19T05:45:47.540529+0000","last_fullsized":"2024-09-19T05:45:47.540529+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:55.931199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187987+0000","last_change":"2024-09-19T05:45:45.223210+0000","last_active":"2024-09-19T05:45:47.187987+0000","last_peered":"2024-09-19T05:45:47.187987+0000","last_clean":"2024-09-19T05:45:47.187987+0000","last_became_active":"2024-09-19T05:45:45.222903+0000","last_became_peered":"2024-09-19T05:45:45.222903+0000","last_unstale":"2024-09-19T05:45:47.187987+0000","last_undegraded":"2024-09-19T05:45:47.187987+0000","last_fullsized":"2024-09-19T05:45:47.187987+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:07.015460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.230987+0000","last_change":"2024-09-19T05:45:45.225716+0000","last_active":"2024-09-19T05:45:45.230987+0000","last_peered":"2024-09-19T05:45:45.230987+0000","last_clean":"2024-09-19T05:45:45.230987+0000","last_became_active":"2024-09-19T05:45:45.225004+0000","last_became_peered":"2024-09-19T05:45:45.225004+0000","last_unstale":"2024-09-19T05:45:45.230987+0000","last_undegraded":"2024-09-19T05:45:45.230987+0000","last_fullsized":"2024-09-19T05:45:45.230987+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:53.374533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.949471+0000","last_change":"2024-09-19T05:45:45.215301+0000","last_active":"2024-09-19T05:45:46.949471+0000","last_peered":"2024-09-19T05:45:46.949471+0000","last_clean":"2024-09-19T05:45:46.949471+0000","last_became_active":"2024-09-19T05:45:45.215043+0000","last_became_peered":"2024-09-19T05:45:45.215043+0000","last_unstale":"2024-09-19T05:45:46.949471+0000","last_undegraded":"2024-09-19T05:45:46.949471+0000","last_fullsized":"2024-09-19T05:45:46.949471+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:51.370467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.858977+0000","last_change":"2024-09-19T05:45:45.226817+0000","last_active":"2024-09-19T05:45:46.858977+0000","last_peered":"2024-09-19T05:45:46.858977+0000","last_clean":"2024-09-19T05:45:46.858977+0000","last_became_active":"2024-09-19T05:45:45.221334+0000","last_became_peered":"2024-09-19T05:45:45.221334+0000","last_unstale":"2024-09-19T05:45:46.858977+0000","last_undegraded":"2024-09-19T05:45:46.858977+0000","last_fullsized":"2024-09-19T05:45:46.858977+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:22.398088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.188479+0000","last_change":"2024-09-19T05:45:45.205566+0000","last_active":"2024-09-19T05:45:47.188479+0000","last_peered":"2024-09-19T05:45:47.188479+0000","last_clean":"2024-09-19T05:45:47.188479+0000","last_became_active":"2024-09-19T05:45:45.205221+0000","last_became_peered":"2024-09-19T05:45:45.205221+0000","last_unstale":"2024-09-19T05:45:47.188479+0000","last_undegraded":"2024-09-19T05:45:47.188479+0000","last_fullsized":"2024-09-19T05:45:47.188479+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:13.228539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.540362+0000","last_change":"2024-09-19T05:45:45.231141+0000","last_active":"2024-09-19T05:45:47.540362+0000","last_peered":"2024-09-19T05:45:47.540362+0000","last_clean":"2024-09-19T05:45:47.540362+0000","last_became_active":"2024-09-19T05:45:45.230828+0000","last_became_peered":"2024-09-19T05:45:45.230828+0000","last_unstale":"2024-09-19T05:45:47.540362+0000","last_undegraded":"2024-09-19T05:45:47.540362+0000","last_fullsized":"2024-09-19T05:45:47.540362+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:33.739677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.229476+0000","last_change":"2024-09-19T05:45:45.215924+0000","last_active":"2024-09-19T05:45:45.229476+0000","last_peered":"2024-09-19T05:45:45.229476+0000","last_clean":"2024-09-19T05:45:45.229476+0000","last_became_active":"2024-09-19T05:45:45.204452+0000","last_became_peered":"2024-09-19T05:45:45.204452+0000","last_unstale":"2024-09-19T05:45:45.229476+0000","last_undegraded":"2024-09-19T05:45:45.229476+0000","last_fullsized":"2024-09-19T05:45:45.229476+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:43.747697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187575+0000","last_change":"2024-09-19T05:45:45.230980+0000","last_active":"2024-09-19T05:45:47.187575+0000","last_peered":"2024-09-19T05:45:47.187575+0000","last_clean":"2024-09-19T05:45:47.187575+0000","last_became_active":"2024-09-19T05:45:45.230467+0000","last_became_peered":"2024-09-19T05:45:45.230467+0000","last_unstale":"2024-09-19T05:45:47.187575+0000","last_undegraded":"2024-09-19T05:45:47.187575+0000","last_fullsized":"2024-09-19T05:45:47.187575+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:31.774863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.230339+0000","last_change":"2024-09-19T05:45:45.224523+0000","last_active":"2024-09-19T05:45:45.230339+0000","last_peered":"2024-09-19T05:45:45.230339+0000","last_clean":"2024-09-19T05:45:45.230339+0000","last_became_active":"2024-09-19T05:45:45.216908+0000","last_became_peered":"2024-09-19T05:45:45.216908+0000","last_unstale":"2024-09-19T05:45:45.230339+0000","last_undegraded":"2024-09-19T05:45:45.230339+0000","last_fullsized":"2024-09-19T05:45:45.230339+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:45.651384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.197281+0000","last_change":"2024-09-19T05:45:45.220830+0000","last_active":"2024-09-19T05:45:46.197281+0000","last_peered":"2024-09-19T05:45:46.197281+0000","last_clean":"2024-09-19T05:45:46.197281+0000","last_became_active":"2024-09-19T05:45:45.211792+0000","last_became_peered":"2024-09-19T05:45:45.211792+0000","last_unstale":"2024-09-19T05:45:46.197281+0000","last_undegraded":"2024-09-19T05:45:46.197281+0000","last_fullsized":"2024-09-19T05:45:46.197281+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:51.881869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684279+0000","last_change":"2024-09-19T05:45:45.231296+0000","last_active":"2024-09-19T05:45:46.684279+0000","last_peered":"2024-09-19T05:45:46.684279+0000","last_clean":"2024-09-19T05:45:46.684279+0000","last_became_active":"2024-09-19T05:45:45.230663+0000","last_became_peered":"2024-09-19T05:45:45.230663+0000","last_unstale":"2024-09-19T05:45:46.684279+0000","last_undegraded":"2024-09-19T05:45:46.684279+0000","last_fullsized":"2024-09-19T05:45:46.684279+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:03.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.197278+0000","last_change":"2024-09-19T05:45:45.222188+0000","last_active":"2024-09-19T05:45:46.197278+0000","last_peered":"2024-09-19T05:45:46.197278+0000","last_clean":"2024-09-19T05:45:46.197278+0000","last_became_active":"2024-09-19T05:45:45.217416+0000","last_became_peered":"2024-09-19T05:45:45.217416+0000","last_unstale":"2024-09-19T05:45:46.197278+0000","last_undegraded":"2024-09-19T05:45:46.197278+0000","last_fullsized":"2024-09-19T05:45:46.197278+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:22.398088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.228768+0000","last_change":"2024-09-19T05:45:45.204624+0000","last_active":"2024-09-19T05:45:45.228768+0000","last_peered":"2024-09-19T05:45:45.228768+0000","last_clean":"2024-09-19T05:45:45.228768+0000","last_became_active":"2024-09-19T05:45:45.203841+0000","last_became_peered":"2024-09-19T05:45:45.203841+0000","last_unstale":"2024-09-19T05:45:45.228768+0000","last_undegraded":"2024-09-19T05:45:45.228768+0000","last_fullsized":"2024-09-19T05:45:45.228768+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:18.552582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"167'4","reported_seq":18,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.859863+0000","last_change":"2024-09-19T05:45:44.186998+0000","last_active":"2024-09-19T05:45:46.859863+0000","last_peered":"2024-09-19T05:45:46.859863+0000","last_clean":"2024-09-19T05:45:46.859863+0000","last_became_active":"2024-09-19T05:45:44.186316+0000","last_became_peered":"2024-09-19T05:45:44.186316+0000","last_unstale":"2024-09-19T05:45:46.859863+0000","last_undegraded":"2024-09-19T05:45:46.859863+0000","last_fullsized":"2024-09-19T05:45:46.859863+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:34.825987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187284+0000","last_change":"2024-09-19T05:45:45.226996+0000","last_active":"2024-09-19T05:45:47.187284+0000","last_peered":"2024-09-19T05:45:47.187284+0000","last_clean":"2024-09-19T05:45:47.187284+0000","last_became_active":"2024-09-19T05:45:45.226697+0000","last_became_peered":"2024-09-19T05:45:45.226697+0000","last_unstale":"2024-09-19T05:45:47.187284+0000","last_undegraded":"2024-09-19T05:45:47.187284+0000","last_fullsized":"2024-09-19T05:45:47.187284+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:36:33.539676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"167'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.951013+0000","last_change":"2024-09-19T05:45:44.200740+0000","last_active":"2024-09-19T05:45:46.951013+0000","last_peered":"2024-09-19T05:45:46.951013+0000","last_clean":"2024-09-19T05:45:46.951013+0000","last_became_active":"2024-09-19T05:45:44.200391+0000","last_became_peered":"2024-09-19T05:45:44.200391+0000","last_unstale":"2024-09-19T05:45:46.951013+0000","last_undegraded":"2024-09-19T05:45:46.951013+0000","last_fullsized":"2024-09-19T05:45:46.951013+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:14.573751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.949924+0000","last_change":"2024-09-19T05:45:45.199018+0000","last_active":"2024-09-19T05:45:46.949924+0000","last_peered":"2024-09-19T05:45:46.949924+0000","last_clean":"2024-09-19T05:45:46.949924+0000","last_became_active":"2024-09-19T05:45:45.198644+0000","last_became_peered":"2024-09-19T05:45:45.198644+0000","last_unstale":"2024-09-19T05:45:46.949924+0000","last_undegraded":"2024-09-19T05:45:46.949924+0000","last_fullsized":"2024-09-19T05:45:46.949924+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:42.355116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684867+0000","last_change":"2024-09-19T05:45:44.205097+0000","last_active":"2024-09-19T05:45:46.684867+0000","last_peered":"2024-09-19T05:45:46.684867+0000","last_clean":"2024-09-19T05:45:46.684867+0000","last_became_active":"2024-09-19T05:45:44.204383+0000","last_became_peered":"2024-09-19T05:45:44.204383+0000","last_unstale":"2024-09-19T05:45:46.684867+0000","last_undegraded":"2024-09-19T05:45:46.684867+0000","last_fullsized":"2024-09-19T05:45:46.684867+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:25.180253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.228544+0000","last_change":"2024-09-19T05:45:45.204645+0000","last_active":"2024-09-19T05:45:45.228544+0000","last_peered":"2024-09-19T05:45:45.228544+0000","last_clean":"2024-09-19T05:45:45.228544+0000","last_became_active":"2024-09-19T05:45:45.203872+0000","last_became_peered":"2024-09-19T05:45:45.203872+0000","last_unstale":"2024-09-19T05:45:45.228544+0000","last_undegraded":"2024-09-19T05:45:45.228544+0000","last_fullsized":"2024-09-19T05:45:45.228544+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.802063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.540655+0000","last_change":"2024-09-19T05:45:44.207076+0000","last_active":"2024-09-19T05:45:47.540655+0000","last_peered":"2024-09-19T05:45:47.540655+0000","last_clean":"2024-09-19T05:45:47.540655+0000","last_became_active":"2024-09-19T05:45:44.206515+0000","last_became_peered":"2024-09-19T05:45:44.206515+0000","last_unstale":"2024-09-19T05:45:47.540655+0000","last_undegraded":"2024-09-19T05:45:47.540655+0000","last_fullsized":"2024-09-19T05:45:47.540655+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:35.112184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.199021+0000","last_change":"2024-09-19T05:45:45.224941+0000","last_active":"2024-09-19T05:45:46.199021+0000","last_peered":"2024-09-19T05:45:46.199021+0000","last_clean":"2024-09-19T05:45:46.199021+0000","last_became_active":"2024-09-19T05:45:45.224683+0000","last_became_peered":"2024-09-19T05:45:45.224683+0000","last_unstale":"2024-09-19T05:45:46.199021+0000","last_undegraded":"2024-09-19T05:45:46.199021+0000","last_fullsized":"2024-09-19T05:45:46.199021+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:58.581002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"167'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.198880+0000","last_change":"2024-09-19T05:45:44.203330+0000","last_active":"2024-09-19T05:45:46.198880+0000","last_peered":"2024-09-19T05:45:46.198880+0000","last_clean":"2024-09-19T05:45:46.198880+0000","last_became_active":"2024-09-19T05:45:44.202649+0000","last_became_peered":"2024-09-19T05:45:44.202649+0000","last_unstale":"2024-09-19T05:45:46.198880+0000","last_undegraded":"2024-09-19T05:45:46.198880+0000","last_fullsized":"2024-09-19T05:45:46.198880+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:42.755780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.540101+0000","last_change":"2024-09-19T05:45:45.196503+0000","last_active":"2024-09-19T05:45:47.540101+0000","last_peered":"2024-09-19T05:45:47.540101+0000","last_clean":"2024-09-19T05:45:47.540101+0000","last_became_active":"2024-09-19T05:45:45.196173+0000","last_became_peered":"2024-09-19T05:45:45.196173+0000","last_unstale":"2024-09-19T05:45:47.540101+0000","last_undegraded":"2024-09-19T05:45:47.540101+0000","last_fullsized":"2024-09-19T05:45:47.540101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:19.046919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"167'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.950257+0000","last_change":"2024-09-19T05:45:44.217475+0000","last_active":"2024-09-19T05:45:46.950257+0000","last_peered":"2024-09-19T05:45:46.950257+0000","last_clean":"2024-09-19T05:45:46.950257+0000","last_became_active":"2024-09-19T05:45:44.217148+0000","last_became_peered":"2024-09-19T05:45:44.217148+0000","last_unstale":"2024-09-19T05:45:46.950257+0000","last_undegraded":"2024-09-19T05:45:46.950257+0000","last_fullsized":"2024-09-19T05:45:46.950257+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:02.568472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.540321+0000","last_change":"2024-09-19T05:45:45.214022+0000","last_active":"2024-09-19T05:45:47.540321+0000","last_peered":"2024-09-19T05:45:47.540321+0000","last_clean":"2024-09-19T05:45:47.540321+0000","last_became_active":"2024-09-19T05:45:45.213719+0000","last_became_peered":"2024-09-19T05:45:45.213719+0000","last_unstale":"2024-09-19T05:45:47.540321+0000","last_undegraded":"2024-09-19T05:45:47.540321+0000","last_fullsized":"2024-09-19T05:45:47.540321+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:01.356585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.539586+0000","last_change":"2024-09-19T05:45:44.206298+0000","last_active":"2024-09-19T05:45:47.539586+0000","last_peered":"2024-09-19T05:45:47.539586+0000","last_clean":"2024-09-19T05:45:47.539586+0000","last_became_active":"2024-09-19T05:45:44.206014+0000","last_became_peered":"2024-09-19T05:45:44.206014+0000","last_unstale":"2024-09-19T05:45:47.539586+0000","last_undegraded":"2024-09-19T05:45:47.539586+0000","last_fullsized":"2024-09-19T05:45:47.539586+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:56.385675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.859698+0000","last_change":"2024-09-19T05:45:45.210088+0000","last_active":"2024-09-19T05:45:46.859698+0000","last_peered":"2024-09-19T05:45:46.859698+0000","last_clean":"2024-09-19T05:45:46.859698+0000","last_became_active":"2024-09-19T05:45:45.209011+0000","last_became_peered":"2024-09-19T05:45:45.209011+0000","last_unstale":"2024-09-19T05:45:46.859698+0000","last_undegraded":"2024-09-19T05:45:46.859698+0000","last_fullsized":"2024-09-19T05:45:46.859698+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:04.501999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.198502+0000","last_change":"2024-09-19T05:45:44.213118+0000","last_active":"2024-09-19T05:45:46.198502+0000","last_peered":"2024-09-19T05:45:46.198502+0000","last_clean":"2024-09-19T05:45:46.198502+0000","last_became_active":"2024-09-19T05:45:44.212731+0000","last_became_peered":"2024-09-19T05:45:44.212731+0000","last_unstale":"2024-09-19T05:45:46.198502+0000","last_undegraded":"2024-09-19T05:45:46.198502+0000","last_fullsized":"2024-09-19T05:45:46.198502+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:34.432840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.230830+0000","last_change":"2024-09-19T05:45:45.224906+0000","last_active":"2024-09-19T05:45:45.230830+0000","last_peered":"2024-09-19T05:45:45.230830+0000","last_clean":"2024-09-19T05:45:45.230830+0000","last_became_active":"2024-09-19T05:45:45.215489+0000","last_became_peered":"2024-09-19T05:45:45.215489+0000","last_unstale":"2024-09-19T05:45:45.230830+0000","last_undegraded":"2024-09-19T05:45:45.230830+0000","last_fullsized":"2024-09-19T05:45:45.230830+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:33.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.188204+0000","last_change":"2024-09-19T05:45:44.211230+0000","last_active":"2024-09-19T05:45:47.188204+0000","last_peered":"2024-09-19T05:45:47.188204+0000","last_clean":"2024-09-19T05:45:47.188204+0000","last_became_active":"2024-09-19T05:45:44.210683+0000","last_became_peered":"2024-09-19T05:45:44.210683+0000","last_unstale":"2024-09-19T05:45:47.188204+0000","last_undegraded":"2024-09-19T05:45:47.188204+0000","last_fullsized":"2024-09-19T05:45:47.188204+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:16:15.875538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187305+0000","last_change":"2024-09-19T05:45:45.194987+0000","last_active":"2024-09-19T05:45:47.187305+0000","last_peered":"2024-09-19T05:45:47.187305+0000","last_clean":"2024-09-19T05:45:47.187305+0000","last_became_active":"2024-09-19T05:45:45.194770+0000","last_became_peered":"2024-09-19T05:45:45.194770+0000","last_unstale":"2024-09-19T05:45:47.187305+0000","last_undegraded":"2024-09-19T05:45:47.187305+0000","last_fullsized":"2024-09-19T05:45:47.187305+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:17.830598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"167'3","reported_seq":17,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.859217+0000","last_change":"2024-09-19T05:45:44.191607+0000","last_active":"2024-09-19T05:45:46.859217+0000","last_peered":"2024-09-19T05:45:46.859217+0000","last_clean":"2024-09-19T05:45:46.859217+0000","last_became_active":"2024-09-19T05:45:44.190852+0000","last_became_peered":"2024-09-19T05:45:44.190852+0000","last_unstale":"2024-09-19T05:45:46.859217+0000","last_undegraded":"2024-09-19T05:45:46.859217+0000","last_fullsized":"2024-09-19T05:45:46.859217+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:52.166883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.540409+0000","last_change":"2024-09-19T05:45:45.193977+0000","last_active":"2024-09-19T05:45:47.540409+0000","last_peered":"2024-09-19T05:45:47.540409+0000","last_clean":"2024-09-19T05:45:47.540409+0000","last_became_active":"2024-09-19T05:45:45.193683+0000","last_became_peered":"2024-09-19T05:45:45.193683+0000","last_unstale":"2024-09-19T05:45:47.540409+0000","last_undegraded":"2024-09-19T05:45:47.540409+0000","last_fullsized":"2024-09-19T05:45:47.540409+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:17:10.038193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"167'6","reported_seq":20,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187919+0000","last_change":"2024-09-19T05:45:44.210066+0000","last_active":"2024-09-19T05:45:47.187919+0000","last_peered":"2024-09-19T05:45:47.187919+0000","last_clean":"2024-09-19T05:45:47.187919+0000","last_became_active":"2024-09-19T05:45:44.209034+0000","last_became_peered":"2024-09-19T05:45:44.209034+0000","last_unstale":"2024-09-19T05:45:47.187919+0000","last_undegraded":"2024-09-19T05:45:47.187919+0000","last_fullsized":"2024-09-19T05:45:47.187919+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:57.870506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.197357+0000","last_change":"2024-09-19T05:45:45.226797+0000","last_active":"2024-09-19T05:45:46.197357+0000","last_peered":"2024-09-19T05:45:46.197357+0000","last_clean":"2024-09-19T05:45:46.197357+0000","last_became_active":"2024-09-19T05:45:45.226226+0000","last_became_peered":"2024-09-19T05:45:45.226226+0000","last_unstale":"2024-09-19T05:45:46.197357+0000","last_undegraded":"2024-09-19T05:45:46.197357+0000","last_fullsized":"2024-09-19T05:45:46.197357+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:03.683694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.950197+0000","last_change":"2024-09-19T05:45:44.200988+0000","last_active":"2024-09-19T05:45:46.950197+0000","last_peered":"2024-09-19T05:45:46.950197+0000","last_clean":"2024-09-19T05:45:46.950197+0000","last_became_active":"2024-09-19T05:45:44.200129+0000","last_became_peered":"2024-09-19T05:45:44.200129+0000","last_unstale":"2024-09-19T05:45:46.950197+0000","last_undegraded":"2024-09-19T05:45:46.950197+0000","last_fullsized":"2024-09-19T05:45:46.950197+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:57.571208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.199230+0000","last_change":"2024-09-19T05:45:45.200908+0000","last_active":"2024-09-19T05:45:46.199230+0000","last_peered":"2024-09-19T05:45:46.199230+0000","last_clean":"2024-09-19T05:45:46.199230+0000","last_became_active":"2024-09-19T05:45:45.200595+0000","last_became_peered":"2024-09-19T05:45:45.200595+0000","last_unstale":"2024-09-19T05:45:46.199230+0000","last_undegraded":"2024-09-19T05:45:46.199230+0000","last_fullsized":"2024-09-19T05:45:46.199230+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:15.702226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187507+0000","last_change":"2024-09-19T05:45:44.193318+0000","last_active":"2024-09-19T05:45:47.187507+0000","last_peered":"2024-09-19T05:45:47.187507+0000","last_clean":"2024-09-19T05:45:47.187507+0000","last_became_active":"2024-09-19T05:45:44.192816+0000","last_became_peered":"2024-09-19T05:45:44.192816+0000","last_unstale":"2024-09-19T05:45:47.187507+0000","last_undegraded":"2024-09-19T05:45:47.187507+0000","last_fullsized":"2024-09-19T05:45:47.187507+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:46.172511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684438+0000","last_change":"2024-09-19T05:45:45.217206+0000","last_active":"2024-09-19T05:45:46.684438+0000","last_peered":"2024-09-19T05:45:46.684438+0000","last_clean":"2024-09-19T05:45:46.684438+0000","last_became_active":"2024-09-19T05:45:45.216386+0000","last_became_peered":"2024-09-19T05:45:45.216386+0000","last_unstale":"2024-09-19T05:45:46.684438+0000","last_undegraded":"2024-09-19T05:45:46.684438+0000","last_fullsized":"2024-09-19T05:45:46.684438+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:11.260273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684421+0000","last_change":"2024-09-19T05:45:44.199994+0000","last_active":"2024-09-19T05:45:46.684421+0000","last_peered":"2024-09-19T05:45:46.684421+0000","last_clean":"2024-09-19T05:45:46.684421+0000","last_became_active":"2024-09-19T05:45:44.199400+0000","last_became_peered":"2024-09-19T05:45:44.199400+0000","last_unstale":"2024-09-19T05:45:46.684421+0000","last_undegraded":"2024-09-19T05:45:46.684421+0000","last_fullsized":"2024-09-19T05:45:46.684421+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:40.886435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.540590+0000","last_change":"2024-09-19T05:45:45.223196+0000","last_active":"2024-09-19T05:45:47.540590+0000","last_peered":"2024-09-19T05:45:47.540590+0000","last_clean":"2024-09-19T05:45:47.540590+0000","last_became_active":"2024-09-19T05:45:45.222905+0000","last_became_peered":"2024-09-19T05:45:45.222905+0000","last_unstale":"2024-09-19T05:45:47.540590+0000","last_undegraded":"2024-09-19T05:45:47.540590+0000","last_fullsized":"2024-09-19T05:45:47.540590+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:13.055400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"167'8","reported_seq":22,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.198604+0000","last_change":"2024-09-19T05:45:44.213216+0000","last_active":"2024-09-19T05:45:46.198604+0000","last_peered":"2024-09-19T05:45:46.198604+0000","last_clean":"2024-09-19T05:45:46.198604+0000","last_became_active":"2024-09-19T05:45:44.212842+0000","last_became_peered":"2024-09-19T05:45:44.212842+0000","last_unstale":"2024-09-19T05:45:46.198604+0000","last_undegraded":"2024-09-19T05:45:46.198604+0000","last_fullsized":"2024-09-19T05:45:46.198604+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:17.542788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.198437+0000","last_change":"2024-09-19T05:45:45.203430+0000","last_active":"2024-09-19T05:45:46.198437+0000","last_peered":"2024-09-19T05:45:46.198437+0000","last_clean":"2024-09-19T05:45:46.198437+0000","last_became_active":"2024-09-19T05:45:45.203128+0000","last_became_peered":"2024-09-19T05:45:45.203128+0000","last_unstale":"2024-09-19T05:45:46.198437+0000","last_undegraded":"2024-09-19T05:45:46.198437+0000","last_fullsized":"2024-09-19T05:45:46.198437+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:13.797841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"167'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.188413+0000","last_change":"2024-09-19T05:45:44.186316+0000","last_active":"2024-09-19T05:45:47.188413+0000","last_peered":"2024-09-19T05:45:47.188413+0000","last_clean":"2024-09-19T05:45:47.188413+0000","last_became_active":"2024-09-19T05:45:44.186021+0000","last_became_peered":"2024-09-19T05:45:44.186021+0000","last_unstale":"2024-09-19T05:45:47.188413+0000","last_undegraded":"2024-09-19T05:45:47.188413+0000","last_fullsized":"2024-09-19T05:45:47.188413+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:41.345322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.197969+0000","last_change":"2024-09-19T05:45:45.218648+0000","last_active":"2024-09-19T05:45:46.197969+0000","last_peered":"2024-09-19T05:45:46.197969+0000","last_clean":"2024-09-19T05:45:46.197969+0000","last_became_active":"2024-09-19T05:45:45.213012+0000","last_became_peered":"2024-09-19T05:45:45.213012+0000","last_unstale":"2024-09-19T05:45:46.197969+0000","last_undegraded":"2024-09-19T05:45:46.197969+0000","last_fullsized":"2024-09-19T05:45:46.197969+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:21.125037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.199568+0000","last_change":"2024-09-19T05:45:44.215646+0000","last_active":"2024-09-19T05:45:46.199568+0000","last_peered":"2024-09-19T05:45:46.199568+0000","last_clean":"2024-09-19T05:45:46.199568+0000","last_became_active":"2024-09-19T05:45:44.213973+0000","last_became_peered":"2024-09-19T05:45:44.213973+0000","last_unstale":"2024-09-19T05:45:46.199568+0000","last_undegraded":"2024-09-19T05:45:46.199568+0000","last_fullsized":"2024-09-19T05:45:46.199568+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:15.636239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684244+0000","last_change":"2024-09-19T05:45:45.214714+0000","last_active":"2024-09-19T05:45:46.684244+0000","last_peered":"2024-09-19T05:45:46.684244+0000","last_clean":"2024-09-19T05:45:46.684244+0000","last_became_active":"2024-09-19T05:45:45.214003+0000","last_became_peered":"2024-09-19T05:45:45.214003+0000","last_unstale":"2024-09-19T05:45:46.684244+0000","last_undegraded":"2024-09-19T05:45:46.684244+0000","last_fullsized":"2024-09-19T05:45:46.684244+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:53.957547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"167'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.950719+0000","last_change":"2024-09-19T05:45:44.201386+0000","last_active":"2024-09-19T05:45:46.950719+0000","last_peered":"2024-09-19T05:45:46.950719+0000","last_clean":"2024-09-19T05:45:46.950719+0000","last_became_active":"2024-09-19T05:45:44.199296+0000","last_became_peered":"2024-09-19T05:45:44.199296+0000","last_unstale":"2024-09-19T05:45:46.950719+0000","last_undegraded":"2024-09-19T05:45:46.950719+0000","last_fullsized":"2024-09-19T05:45:46.950719+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:12.788047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684452+0000","last_change":"2024-09-19T05:45:45.198673+0000","last_active":"2024-09-19T05:45:46.684452+0000","last_peered":"2024-09-19T05:45:46.684452+0000","last_clean":"2024-09-19T05:45:46.684452+0000","last_became_active":"2024-09-19T05:45:45.197834+0000","last_became_peered":"2024-09-19T05:45:45.197834+0000","last_unstale":"2024-09-19T05:45:46.684452+0000","last_undegraded":"2024-09-19T05:45:46.684452+0000","last_fullsized":"2024-09-19T05:45:46.684452+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:09.830364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.199191+0000","last_change":"2024-09-19T05:45:44.205392+0000","last_active":"2024-09-19T05:45:46.199191+0000","last_peered":"2024-09-19T05:45:46.199191+0000","last_clean":"2024-09-19T05:45:46.199191+0000","last_became_active":"2024-09-19T05:45:44.205110+0000","last_became_peered":"2024-09-19T05:45:44.205110+0000","last_unstale":"2024-09-19T05:45:46.199191+0000","last_undegraded":"2024-09-19T05:45:46.199191+0000","last_fullsized":"2024-09-19T05:45:46.199191+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:24.590389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187513+0000","last_change":"2024-09-19T05:45:45.230775+0000","last_active":"2024-09-19T05:45:47.187513+0000","last_peered":"2024-09-19T05:45:47.187513+0000","last_clean":"2024-09-19T05:45:47.187513+0000","last_became_active":"2024-09-19T05:45:45.230421+0000","last_became_peered":"2024-09-19T05:45:45.230421+0000","last_unstale":"2024-09-19T05:45:47.187513+0000","last_undegraded":"2024-09-19T05:45:47.187513+0000","last_fullsized":"2024-09-19T05:45:47.187513+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:57.719638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.950209+0000","last_change":"2024-09-19T05:45:44.205021+0000","last_active":"2024-09-19T05:45:46.950209+0000","last_peered":"2024-09-19T05:45:46.950209+0000","last_clean":"2024-09-19T05:45:46.950209+0000","last_became_active":"2024-09-19T05:45:44.204608+0000","last_became_peered":"2024-09-19T05:45:44.204608+0000","last_unstale":"2024-09-19T05:45:46.950209+0000","last_undegraded":"2024-09-19T05:45:46.950209+0000","last_fullsized":"2024-09-19T05:45:46.950209+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:37.852483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.950758+0000","last_change":"2024-09-19T05:45:45.196767+0000","last_active":"2024-09-19T05:45:46.950758+0000","last_peered":"2024-09-19T05:45:46.950758+0000","last_clean":"2024-09-19T05:45:46.950758+0000","last_became_active":"2024-09-19T05:45:45.193297+0000","last_became_peered":"2024-09-19T05:45:45.193297+0000","last_unstale":"2024-09-19T05:45:46.950758+0000","last_undegraded":"2024-09-19T05:45:46.950758+0000","last_fullsized":"2024-09-19T05:45:46.950758+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:23.015968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684030+0000","last_change":"2024-09-19T05:45:44.215282+0000","last_active":"2024-09-19T05:45:46.684030+0000","last_peered":"2024-09-19T05:45:46.684030+0000","last_clean":"2024-09-19T05:45:46.684030+0000","last_became_active":"2024-09-19T05:45:44.214777+0000","last_became_peered":"2024-09-19T05:45:44.214777+0000","last_unstale":"2024-09-19T05:45:46.684030+0000","last_undegraded":"2024-09-19T05:45:46.684030+0000","last_fullsized":"2024-09-19T05:45:46.684030+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:19.456683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.950738+0000","last_change":"2024-09-19T05:45:45.194507+0000","last_active":"2024-09-19T05:45:46.950738+0000","last_peered":"2024-09-19T05:45:46.950738+0000","last_clean":"2024-09-19T05:45:46.950738+0000","last_became_active":"2024-09-19T05:45:45.193990+0000","last_became_peered":"2024-09-19T05:45:45.193990+0000","last_unstale":"2024-09-19T05:45:46.950738+0000","last_undegraded":"2024-09-19T05:45:46.950738+0000","last_fullsized":"2024-09-19T05:45:46.950738+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:06:16.748978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.539882+0000","last_change":"2024-09-19T05:45:44.209838+0000","last_active":"2024-09-19T05:45:47.539882+0000","last_peered":"2024-09-19T05:45:47.539882+0000","last_clean":"2024-09-19T05:45:47.539882+0000","last_became_active":"2024-09-19T05:45:44.209482+0000","last_became_peered":"2024-09-19T05:45:44.209482+0000","last_unstale":"2024-09-19T05:45:47.539882+0000","last_undegraded":"2024-09-19T05:45:47.539882+0000","last_fullsized":"2024-09-19T05:45:47.539882+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:52.937396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.228584+0000","last_change":"2024-09-19T05:45:45.214865+0000","last_active":"2024-09-19T05:45:45.228584+0000","last_peered":"2024-09-19T05:45:45.228584+0000","last_clean":"2024-09-19T05:45:45.228584+0000","last_became_active":"2024-09-19T05:45:45.204735+0000","last_became_peered":"2024-09-19T05:45:45.204735+0000","last_unstale":"2024-09-19T05:45:45.228584+0000","last_undegraded":"2024-09-19T05:45:45.228584+0000","last_fullsized":"2024-09-19T05:45:45.228584+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:15.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.188985+0000","last_change":"2024-09-19T05:45:44.204751+0000","last_active":"2024-09-19T05:45:45.188985+0000","last_peered":"2024-09-19T05:45:45.188985+0000","last_clean":"2024-09-19T05:45:45.188985+0000","last_became_active":"2024-09-19T05:45:44.203974+0000","last_became_peered":"2024-09-19T05:45:44.203974+0000","last_unstale":"2024-09-19T05:45:45.188985+0000","last_undegraded":"2024-09-19T05:45:45.188985+0000","last_fullsized":"2024-09-19T05:45:45.188985+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:34.432840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.683973+0000","last_change":"2024-09-19T05:45:45.230673+0000","last_active":"2024-09-19T05:45:46.683973+0000","last_peered":"2024-09-19T05:45:46.683973+0000","last_clean":"2024-09-19T05:45:46.683973+0000","last_became_active":"2024-09-19T05:45:45.229995+0000","last_became_peered":"2024-09-19T05:45:45.229995+0000","last_unstale":"2024-09-19T05:45:46.683973+0000","last_undegraded":"2024-09-19T05:45:46.683973+0000","last_fullsized":"2024-09-19T05:45:46.683973+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:45.618995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.951042+0000","last_change":"2024-09-19T05:45:44.199960+0000","last_active":"2024-09-19T05:45:46.951042+0000","last_peered":"2024-09-19T05:45:46.951042+0000","last_clean":"2024-09-19T05:45:46.951042+0000","last_became_active":"2024-09-19T05:45:44.199646+0000","last_became_peered":"2024-09-19T05:45:44.199646+0000","last_unstale":"2024-09-19T05:45:46.951042+0000","last_undegraded":"2024-09-19T05:45:46.951042+0000","last_fullsized":"2024-09-19T05:45:46.951042+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:35.410720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.198568+0000","last_change":"2024-09-19T05:45:45.203272+0000","last_active":"2024-09-19T05:45:46.198568+0000","last_peered":"2024-09-19T05:45:46.198568+0000","last_clean":"2024-09-19T05:45:46.198568+0000","last_became_active":"2024-09-19T05:45:45.202953+0000","last_became_peered":"2024-09-19T05:45:45.202953+0000","last_unstale":"2024-09-19T05:45:46.198568+0000","last_undegraded":"2024-09-19T05:45:46.198568+0000","last_fullsized":"2024-09-19T05:45:46.198568+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:36.420514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"168'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.190518+0000","last_change":"2024-09-19T05:45:44.209870+0000","last_active":"2024-09-19T05:45:47.190518+0000","last_peered":"2024-09-19T05:45:47.190518+0000","last_clean":"2024-09-19T05:45:47.190518+0000","last_became_active":"2024-09-19T05:45:44.199646+0000","last_became_peered":"2024-09-19T05:45:44.199646+0000","last_unstale":"2024-09-19T05:45:47.190518+0000","last_undegraded":"2024-09-19T05:45:47.190518+0000","last_fullsized":"2024-09-19T05:45:47.190518+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:50.753839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.540123+0000","last_change":"2024-09-19T05:45:45.202951+0000","last_active":"2024-09-19T05:45:47.540123+0000","last_peered":"2024-09-19T05:45:47.540123+0000","last_clean":"2024-09-19T05:45:47.540123+0000","last_became_active":"2024-09-19T05:45:45.202234+0000","last_became_peered":"2024-09-19T05:45:45.202234+0000","last_unstale":"2024-09-19T05:45:47.540123+0000","last_undegraded":"2024-09-19T05:45:47.540123+0000","last_fullsized":"2024-09-19T05:45:47.540123+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:20.370233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187840+0000","last_change":"2024-09-19T05:45:44.209602+0000","last_active":"2024-09-19T05:45:47.187840+0000","last_peered":"2024-09-19T05:45:47.187840+0000","last_clean":"2024-09-19T05:45:47.187840+0000","last_became_active":"2024-09-19T05:45:44.209232+0000","last_became_peered":"2024-09-19T05:45:44.209232+0000","last_unstale":"2024-09-19T05:45:47.187840+0000","last_undegraded":"2024-09-19T05:45:47.187840+0000","last_fullsized":"2024-09-19T05:45:47.187840+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:59.903879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.198747+0000","last_change":"2024-09-19T05:45:45.203443+0000","last_active":"2024-09-19T05:45:46.198747+0000","last_peered":"2024-09-19T05:45:46.198747+0000","last_clean":"2024-09-19T05:45:46.198747+0000","last_became_active":"2024-09-19T05:45:45.203067+0000","last_became_peered":"2024-09-19T05:45:45.203067+0000","last_unstale":"2024-09-19T05:45:46.198747+0000","last_undegraded":"2024-09-19T05:45:46.198747+0000","last_fullsized":"2024-09-19T05:45:46.198747+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:03.578266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.540308+0000","last_change":"2024-09-19T05:45:44.210245+0000","last_active":"2024-09-19T05:45:47.540308+0000","last_peered":"2024-09-19T05:45:47.540308+0000","last_clean":"2024-09-19T05:45:47.540308+0000","last_became_active":"2024-09-19T05:45:44.209919+0000","last_became_peered":"2024-09-19T05:45:44.209919+0000","last_unstale":"2024-09-19T05:45:47.540308+0000","last_undegraded":"2024-09-19T05:45:47.540308+0000","last_fullsized":"2024-09-19T05:45:47.540308+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:57.012714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.859680+0000","last_change":"2024-09-19T05:45:45.221446+0000","last_active":"2024-09-19T05:45:46.859680+0000","last_peered":"2024-09-19T05:45:46.859680+0000","last_clean":"2024-09-19T05:45:46.859680+0000","last_became_active":"2024-09-19T05:45:45.219869+0000","last_became_peered":"2024-09-19T05:45:45.219869+0000","last_unstale":"2024-09-19T05:45:46.859680+0000","last_undegraded":"2024-09-19T05:45:46.859680+0000","last_fullsized":"2024-09-19T05:45:46.859680+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:21.125037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.858897+0000","last_change":"2024-09-19T05:45:44.200483+0000","last_active":"2024-09-19T05:45:46.858897+0000","last_peered":"2024-09-19T05:45:46.858897+0000","last_clean":"2024-09-19T05:45:46.858897+0000","last_became_active":"2024-09-19T05:45:44.199750+0000","last_became_peered":"2024-09-19T05:45:44.199750+0000","last_unstale":"2024-09-19T05:45:46.858897+0000","last_undegraded":"2024-09-19T05:45:46.858897+0000","last_fullsized":"2024-09-19T05:45:46.858897+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:22.557057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.229526+0000","last_change":"2024-09-19T05:45:45.216528+0000","last_active":"2024-09-19T05:45:45.229526+0000","last_peered":"2024-09-19T05:45:45.229526+0000","last_clean":"2024-09-19T05:45:45.229526+0000","last_became_active":"2024-09-19T05:45:45.214353+0000","last_became_peered":"2024-09-19T05:45:45.214353+0000","last_unstale":"2024-09-19T05:45:45.229526+0000","last_undegraded":"2024-09-19T05:45:45.229526+0000","last_fullsized":"2024-09-19T05:45:45.229526+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:04.154520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187734+0000","last_change":"2024-09-19T05:45:44.211001+0000","last_active":"2024-09-19T05:45:47.187734+0000","last_peered":"2024-09-19T05:45:47.187734+0000","last_clean":"2024-09-19T05:45:47.187734+0000","last_became_active":"2024-09-19T05:45:44.210732+0000","last_became_peered":"2024-09-19T05:45:44.210732+0000","last_unstale":"2024-09-19T05:45:47.187734+0000","last_undegraded":"2024-09-19T05:45:47.187734+0000","last_fullsized":"2024-09-19T05:45:47.187734+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:52.406202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187708+0000","last_change":"2024-09-19T05:45:45.231380+0000","last_active":"2024-09-19T05:45:47.187708+0000","last_peered":"2024-09-19T05:45:47.187708+0000","last_clean":"2024-09-19T05:45:47.187708+0000","last_became_active":"2024-09-19T05:45:45.231077+0000","last_became_peered":"2024-09-19T05:45:45.231077+0000","last_unstale":"2024-09-19T05:45:47.187708+0000","last_undegraded":"2024-09-19T05:45:47.187708+0000","last_fullsized":"2024-09-19T05:45:47.187708+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:27.046431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.684576+0000","last_change":"2024-09-19T05:45:44.204966+0000","last_active":"2024-09-19T05:45:46.684576+0000","last_peered":"2024-09-19T05:45:46.684576+0000","last_clean":"2024-09-19T05:45:46.684576+0000","last_became_active":"2024-09-19T05:45:44.204310+0000","last_became_peered":"2024-09-19T05:45:44.204310+0000","last_unstale":"2024-09-19T05:45:46.684576+0000","last_undegraded":"2024-09-19T05:45:46.684576+0000","last_fullsized":"2024-09-19T05:45:46.684576+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:17.672215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.540578+0000","last_change":"2024-09-19T05:45:45.195782+0000","last_active":"2024-09-19T05:45:47.540578+0000","last_peered":"2024-09-19T05:45:47.540578+0000","last_clean":"2024-09-19T05:45:47.540578+0000","last_became_active":"2024-09-19T05:45:45.195466+0000","last_became_peered":"2024-09-19T05:45:45.195466+0000","last_unstale":"2024-09-19T05:45:47.540578+0000","last_undegraded":"2024-09-19T05:45:47.540578+0000","last_fullsized":"2024-09-19T05:45:47.540578+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:05.472533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:46.949300+0000","last_change":"2024-09-19T05:45:44.204419+0000","last_active":"2024-09-19T05:45:46.949300+0000","last_peered":"2024-09-19T05:45:46.949300+0000","last_clean":"2024-09-19T05:45:46.949300+0000","last_became_active":"2024-09-19T05:45:44.203570+0000","last_became_peered":"2024-09-19T05:45:44.203570+0000","last_unstale":"2024-09-19T05:45:46.949300+0000","last_undegraded":"2024-09-19T05:45:46.949300+0000","last_fullsized":"2024-09-19T05:45:46.949300+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:13:29.331055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.230582+0000","last_change":"2024-09-19T05:45:45.226007+0000","last_active":"2024-09-19T05:45:45.230582+0000","last_peered":"2024-09-19T05:45:45.230582+0000","last_clean":"2024-09-19T05:45:45.230582+0000","last_became_active":"2024-09-19T05:45:45.225376+0000","last_became_peered":"2024-09-19T05:45:45.225376+0000","last_unstale":"2024-09-19T05:45:45.230582+0000","last_undegraded":"2024-09-19T05:45:45.230582+0000","last_fullsized":"2024-09-19T05:45:45.230582+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:44.158720+0000","last_clean_scrub_stamp":"2024-09-19T05:45:44.158720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:53.454543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-19T05:45:47.187958+0000","last_change":"2024-09-19T05:45:44.210031+0000","last_active":"2024-09-19T05:45:47.187958+0000","last_peered":"2024-09-19T05:45:47.187958+0000","last_clean":"2024-09-19T05:45:47.187958+0000","last_became_active":"2024-09-19T05:45:44.199946+0000","last_became_peered":"2024-09-19T05:45:44.199946+0000","last_unstale":"2024-09-19T05:45:47.187958+0000","last_undegraded":"2024-09-19T05:45:47.187958+0000","last_fullsized":"2024-09-19T05:45:47.187958+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:45:43.148926+0000","last_clean_scrub_stamp":"2024-09-19T05:45:43.148926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:50.360673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":437,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-19T05:45:45.189142+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:45:45.189142+0000","last_peered":"2024-09-19T05:45:45.189142+0000","last_clean":"2024-09-19T05:45:45.189142+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:45:45.189142+0000","last_undegraded":"2024-09-19T05:45:45.189142+0000","last_fullsized":"2024-09-19T05:45:45.189142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542299,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69908,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301932,"statfs":{"total":96636764160,"available":96565178368,"internally_reserved":0,"allocated":2686976,"data_stored":1578464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542299,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69344,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302496,"statfs":{"total":96636764160,"available":96565755904,"internally_reserved":0,"allocated":2105344,"data_stored":994788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542301,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47144,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324696,"statfs":{"total":96636764160,"available":96588488704,"internally_reserved":0,"allocated":2113536,"data_stored":994912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542299,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73516,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298324,"statfs":{"total":96636764160,"available":96561483776,"internally_reserved":0,"allocated":2121728,"data_stored":995552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542300,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51308,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320532,"statfs":{"total":96636764160,"available":96584224768,"internally_reserved":0,"allocated":2113536,"data_stored":990312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542300,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73496,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298344,"statfs":{"total":96636764160,"available":96561504256,"internally_reserved":0,"allocated":2093056,"data_stored":988096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542302,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59624,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312216,"statfs":{"total":96636764160,"available":96575709184,"internally_reserved":0,"allocated":2117632,"data_stored":996400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542299,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74080,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297760,"statfs":{"total":96636764160,"available":96560906240,"internally_reserved":0,"allocated":2695168,"data_stored":1578568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:45:50.045 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:45:50.045 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:45:50.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.194+0000 7f86cea3d640 1 Processor -- start 2024-09-19T05:45:50.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.194+0000 7f86cea3d640 1 -- start start 2024-09-19T05:45:50.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86cea3d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f86c815a090 0x7f86c806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86cea3d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c806c2a0 con 0x7f86c80b36e0 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86cea3d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c806c580 con 0x7f86c815daf0 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86cea3d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f86c815cbd0 con 0x7f86c815a090 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c77fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f86c80b36e0 0x7f86c815d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43296/0 (socket says 172.21.15.67:43296) 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c77fe640 1 -- 172.21.15.67:0/1953961694 learned_addr learned my addr 172.21.15.67:0/1953961694 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533067509 0 0) 0x7f86c806c2a0 con 0x7f86c80b36e0 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c7fff640 1 --2- 172.21.15.67:0/1953961694 >> v2:172.21.15.97:3300/0 conn(0x7f86c815a090 0x7f86c806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86b0003530 con 0x7f86c80b36e0 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 478083938 0 0) 0x7f86b0003530 con 0x7f86c80b36e0 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 >> v2:172.21.15.97:3300/0 conn(0x7f86c815a090 msgr2=0x7f86c806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 --2- 172.21.15.67:0/1953961694 >> v2:172.21.15.97:3300/0 conn(0x7f86c815a090 0x7f86c806bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 >> v1:172.21.15.97:6789/0 conn(0x7f86c815daf0 legacy=0x7f86c80d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c806c860 con 0x7f86c80b36e0 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f86bc001680 con 0x7f86c80b36e0 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 >> v1:172.21.15.67:6789/0 conn(0x7f86c80b36e0 legacy=0x7f86c815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86b0003a10 0x7f86b0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86b00051d0 0x7f86b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f86c815cbd0 con 0x7f86b0004810 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f86b000c100 con 0x7f86b0003a10 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f86b000c300 con 0x7f86b00051d0 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c77fe640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c7fff640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86b0003a10 0x7f86b0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86ccfda640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86b00051d0 0x7f86b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c77fe640 1 -- 172.21.15.67:0/1953961694 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86b00051d0 msgr2=0x7f86b000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c77fe640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86b00051d0 0x7f86b000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c77fe640 1 -- 172.21.15.67:0/1953961694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86b0003a10 msgr2=0x7f86b0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:50.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c77fe640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86b0003a10 0x7f86b0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c77fe640 1 -- 172.21.15.67:0/1953961694 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b0003530 con 0x7f86b0004810 2024-09-19T05:45:50.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86ccfda640 1 -- 172.21.15.67:0/1953961694 reap_dead start 2024-09-19T05:45:50.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c77fe640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86b0004c90 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c110 tx=0x7f86bc01f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0626cabfa27cac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc007c30 con 0x7f86b0004810 2024-09-19T05:45:50.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86bc005b00 con 0x7f86b0004810 2024-09-19T05:45:50.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.198+0000 7f86c6ffd640 1 -- 172.21.15.67:0/1953961694 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc007070 con 0x7f86b0004810 2024-09-19T05:45:50.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- 172.21.15.67:0/1953961694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 msgr2=0x7f86b0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86b0004c90 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c110 tx=0x7f86bc01f2f0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- 172.21.15.67:0/1953961694 shutdown_connections 2024-09-19T05:45:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 --2- 172.21.15.67:0/1953961694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86b0004c90 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- 172.21.15.67:0/1953961694 >> 172.21.15.67:0/1953961694 conn(0x7f86c809aa30 msgr2=0x7f86c80b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- 172.21.15.67:0/1953961694 shutdown_connections 2024-09-19T05:45:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- 172.21.15.67:0/1953961694 wait complete. 2024-09-19T05:45:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 Processor -- start 2024-09-19T05:45:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- start start 2024-09-19T05:45:50.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86c80b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86c81f77e0 0x7f86c80cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86c80af4e0 0x7f86c80b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f86c806be40 con 0x7f86b0004810 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f86c806bcc0 con 0x7f86c80af4e0 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f86c806bfc0 con 0x7f86c81f77e0 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86c80b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86c80b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40070/0 (socket says 172.21.15.67:40070) 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c7fff640 1 -- 172.21.15.67:0/2329605201 learned_addr learned my addr 172.21.15.67:0/2329605201 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86ccfda640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86c80af4e0 0x7f86c80b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c77fe640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86c81f77e0 0x7f86c80cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c7fff640 1 -- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86c81f77e0 msgr2=0x7f86c80cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c7fff640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86c81f77e0 0x7f86c80cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c7fff640 1 -- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86c80af4e0 msgr2=0x7f86c80b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c7fff640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86c80af4e0 0x7f86c80b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c7fff640 1 -- 172.21.15.67:0/2329605201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c81f41f0 con 0x7f86b0004810 2024-09-19T05:45:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c7fff640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86c80b0640 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f86b8011530 tx=0x7f86b80119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c4ff9640 1 -- 172.21.15.67:0/2329605201 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8015870 con 0x7f86b0004810 2024-09-19T05:45:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c4ff9640 1 -- 172.21.15.67:0/2329605201 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b8015a10 con 0x7f86b0004810 2024-09-19T05:45:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86c4ff9640 1 -- 172.21.15.67:0/2329605201 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8015dc0 con 0x7f86b0004810 2024-09-19T05:45:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- 172.21.15.67:0/2329605201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c81f7ca0 con 0x7f86b0004810 2024-09-19T05:45:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.202+0000 7f86cea3d640 1 -- 172.21.15.67:0/2329605201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c81f8260 con 0x7f86b0004810 2024-09-19T05:45:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.206+0000 7f86cea3d640 1 -- 172.21.15.67:0/2329605201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c815df00 con 0x7f86b0004810 2024-09-19T05:45:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.206+0000 7f86c4ff9640 1 -- 172.21.15.67:0/2329605201 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86b8013400 con 0x7f86b0004810 2024-09-19T05:45:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.206+0000 7f86c4ff9640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86b40678f0 0x7f86b4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.206+0000 7f86c4ff9640 1 -- 172.21.15.67:0/2329605201 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f86b80866b0 con 0x7f86b0004810 2024-09-19T05:45:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.206+0000 7f86c77fe640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86b40678f0 0x7f86b4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.206+0000 7f86c77fe640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86b40678f0 0x7f86b4069db0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ae000 tx=0x7f86bc007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.210+0000 7f86c4ff9640 1 -- 172.21.15.67:0/2329605201 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f86b8019030 con 0x7f86b0004810 2024-09-19T05:45:50.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.430+0000 7f86cea3d640 1 -- 172.21.15.67:0/2329605201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f86c815e360 con 0x7f86b0004810 2024-09-19T05:45:50.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.434+0000 7f86c4ff9640 1 -- 172.21.15.67:0/2329605201 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f86b8056fc0 con 0x7f86b0004810 2024-09-19T05:45:50.433 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:45:50.433 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:45:50.433 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:45:50.434 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:45:50.434 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:45:50.434 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:45:50.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 -- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86b40678f0 msgr2=0x7f86b4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86b40678f0 0x7f86b4069db0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ae000 tx=0x7f86bc007040 comp rx=0 tx=0).stop 2024-09-19T05:45:50.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 -- 172.21.15.67:0/2329605201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 msgr2=0x7f86c80b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86c80b0640 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f86b8011530 tx=0x7f86b80119f0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 -- 172.21.15.67:0/2329605201 shutdown_connections 2024-09-19T05:45:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86c80af4e0 0x7f86c80b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f86b40678f0 0x7f86b4069db0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f86c81f77e0 0x7f86c80cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 --2- 172.21.15.67:0/2329605201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86b0004810 0x7f86c80b0640 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 -- 172.21.15.67:0/2329605201 >> 172.21.15.67:0/2329605201 conn(0x7f86c809aa30 msgr2=0x7f86c815e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 -- 172.21.15.67:0/2329605201 shutdown_connections 2024-09-19T05:45:50.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.438+0000 7f86cea3d640 1 -- 172.21.15.67:0/2329605201 wait complete. 2024-09-19T05:45:50.452 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:50.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b2a9e9640 1 Processor -- start 2024-09-19T05:45:50.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b2a9e9640 1 -- start start 2024-09-19T05:45:50.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b2a9e9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b24162630 0x7f2b24071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b2a9e9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2b240cc3c0 0x7f2b24072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b2a9e9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2406ecc0 con 0x7f2b24162a10 2024-09-19T05:45:50.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b2a9e9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2b240cfe80 con 0x7f2b24162630 2024-09-19T05:45:50.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b2a9e9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2406ef50 con 0x7f2b240cc3c0 2024-09-19T05:45:50.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b23fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b24162630 0x7f2b24071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b23fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b24162630 0x7f2b24071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40086/0 (socket says 172.21.15.67:40086) 2024-09-19T05:45:50.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b23fff640 1 -- 172.21.15.67:0/3758593317 learned_addr learned my addr 172.21.15.67:0/3758593317 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:50.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b28f86640 1 --2- 172.21.15.67:0/3758593317 >> v2:172.21.15.97:3300/0 conn(0x7f2b240cc3c0 0x7f2b24072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b23fff640 1 -- 172.21.15.67:0/3758593317 >> v2:172.21.15.97:3300/0 conn(0x7f2b240cc3c0 msgr2=0x7f2b24072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:50.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b23fff640 1 --2- 172.21.15.67:0/3758593317 >> v2:172.21.15.97:3300/0 conn(0x7f2b240cc3c0 0x7f2b24072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b23fff640 1 -- 172.21.15.67:0/3758593317 >> v1:172.21.15.97:6789/0 conn(0x7f2b24162a10 legacy=0x7f2b24166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b23fff640 1 -- 172.21.15.67:0/3758593317 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2406f230 con 0x7f2b24162630 2024-09-19T05:45:50.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.578+0000 7f2b28f86640 1 --2- 172.21.15.67:0/3758593317 >> v2:172.21.15.97:3300/0 conn(0x7f2b240cc3c0 0x7f2b24072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:50.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b23fff640 1 --2- 172.21.15.67:0/3758593317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 0x7f2b24071fd0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f2b24072dd0 tx=0x7f2b1401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bab957ccd30648 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b22ffd640 1 -- 172.21.15.67:0/3758593317 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b140a57f0 con 0x7f2b24162630 2024-09-19T05:45:50.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b22ffd640 1 -- 172.21.15.67:0/3758593317 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b140a5990 con 0x7f2b24162630 2024-09-19T05:45:50.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b22ffd640 1 -- 172.21.15.67:0/3758593317 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b140a5d60 con 0x7f2b24162630 2024-09-19T05:45:50.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/3758593317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 msgr2=0x7f2b24071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b2a9e9640 1 --2- 172.21.15.67:0/3758593317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 0x7f2b24071fd0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f2b24072dd0 tx=0x7f2b1401c930 comp rx=0 tx=0).stop 2024-09-19T05:45:50.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/3758593317 shutdown_connections 2024-09-19T05:45:50.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b2a9e9640 1 --2- 172.21.15.67:0/3758593317 >> v2:172.21.15.97:3300/0 conn(0x7f2b240cc3c0 0x7f2b24072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b2a9e9640 1 --2- 172.21.15.67:0/3758593317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 0x7f2b24071fd0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/3758593317 >> 172.21.15.67:0/3758593317 conn(0x7f2b240d0080 msgr2=0x7f2b240d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:50.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/3758593317 shutdown_connections 2024-09-19T05:45:50.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.582+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/3758593317 wait complete. 2024-09-19T05:45:50.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 Processor -- start 2024-09-19T05:45:50.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 -- start start 2024-09-19T05:45:50.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b240cc3c0 0x7f2b24155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 0x7f2b240cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b24162a10 0x7f2b240ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2416f880 con 0x7f2b24162630 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2416f700 con 0x7f2b240cc3c0 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2416fa00 con 0x7f2b24162a10 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 0x7f2b240cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 0x7f2b240cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40100/0 (socket says 172.21.15.67:40100) 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b237fe640 1 -- 172.21.15.67:0/578666045 learned_addr learned my addr 172.21.15.67:0/578666045 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b23fff640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b240cc3c0 0x7f2b24155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b28f86640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b24162a10 0x7f2b240ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b237fe640 1 -- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b24162a10 msgr2=0x7f2b240ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b237fe640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b24162a10 0x7f2b240ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b237fe640 1 -- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b240cc3c0 msgr2=0x7f2b24155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b237fe640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b240cc3c0 0x7f2b24155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b237fe640 1 -- 172.21.15.67:0/578666045 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b240cfc50 con 0x7f2b24162630 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b237fe640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 0x7f2b240cdfb0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00c370 tx=0x7f2b0c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b20ff9640 1 -- 172.21.15.67:0/578666045 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0052d0 con 0x7f2b24162630 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b20ff9640 1 -- 172.21.15.67:0/578666045 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0c005470 con 0x7f2b24162630 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/578666045 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b24163280 con 0x7f2b24162630 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b20ff9640 1 -- 172.21.15.67:0/578666045 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c007260 con 0x7f2b24162630 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/578666045 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b24166800 con 0x7f2b24162630 2024-09-19T05:45:50.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/578666045 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b24166380 con 0x7f2b24162630 2024-09-19T05:45:50.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.586+0000 7f2b20ff9640 1 -- 172.21.15.67:0/578666045 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b0c007400 con 0x7f2b24162630 2024-09-19T05:45:50.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.590+0000 7f2b20ff9640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b040678c0 0x7f2b04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.590+0000 7f2b20ff9640 1 -- 172.21.15.67:0/578666045 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f2b0c085250 con 0x7f2b24162630 2024-09-19T05:45:50.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.590+0000 7f2b23fff640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b040678c0 0x7f2b04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.590+0000 7f2b23fff640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b040678c0 0x7f2b04069d80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2b140ae000 tx=0x7f2b140a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.594+0000 7f2b20ff9640 1 -- 172.21.15.67:0/578666045 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2b0c055510 con 0x7f2b24162630 2024-09-19T05:45:50.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.794+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/578666045 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b241635a0 con 0x7f2b24162630 2024-09-19T05:45:50.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.794+0000 7f2b20ff9640 1 -- 172.21.15.67:0/578666045 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7f2b0c059810 con 0x7f2b24162630 2024-09-19T05:45:50.793 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:50.793 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:45:50.793 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:45:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b040678c0 msgr2=0x7f2b04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b040678c0 0x7f2b04069d80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2b140ae000 tx=0x7f2b140a7070 comp rx=0 tx=0).stop 2024-09-19T05:45:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/578666045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 msgr2=0x7f2b240cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 0x7f2b240cdfb0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00c370 tx=0x7f2b0c00c830 comp rx=0 tx=0).stop 2024-09-19T05:45:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/578666045 shutdown_connections 2024-09-19T05:45:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b040678c0 0x7f2b04069d80 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b24162a10 0x7f2b240ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b24162630 0x7f2b240cdfb0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 --2- 172.21.15.67:0/578666045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b240cc3c0 0x7f2b24155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/578666045 >> 172.21.15.67:0/578666045 conn(0x7f2b240d0080 msgr2=0x7f2b240cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/578666045 shutdown_connections 2024-09-19T05:45:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:50.798+0000 7f2b2a9e9640 1 -- 172.21.15.67:0/578666045 wait complete. 2024-09-19T05:45:51.153 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-09-19T05:45:51.154+0000 7f5284aff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:45:51.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 115, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:45:44.552824+0000', 'modified': '2024-09-19T05:45:47.573580+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9579}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9579': {'gid': 9579, 'name': 'a', 'rank': 0, 'incarnation': 111, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/1716781558', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 1716781558}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 1716781558}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9579, 'qdb_cluster': [9579]} 2024-09-19T05:45:51.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:45:51.216 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T05:45:51.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64ae01d640 1 Processor -- start 2024-09-19T05:45:51.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64ae01d640 1 -- start start 2024-09-19T05:45:51.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64ae01d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64a809b140 0x7f64a80705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64ae01d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a80c7130 con 0x7f64a815d290 2024-09-19T05:45:51.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64ae01d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a8070b90 con 0x7f64a80c8c40 2024-09-19T05:45:51.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64ae01d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f64a8070e70 con 0x7f64a809b140 2024-09-19T05:45:51.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a7fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f64a815d290 0x7f64a8159550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43298/0 (socket says 172.21.15.67:43298) 2024-09-19T05:45:51.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a7fff640 1 -- 172.21.15.67:0/1986743021 learned_addr learned my addr 172.21.15.67:0/1986743021 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:51.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/1986743021 >> v2:172.21.15.97:3300/0 conn(0x7f64a809b140 0x7f64a80705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125805429 0 0) 0x7f64a80c7130 con 0x7f64a815d290 2024-09-19T05:45:51.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6490003530 con 0x7f64a815d290 2024-09-19T05:45:51.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 628903977 0 0) 0x7f6490003530 con 0x7f64a815d290 2024-09-19T05:45:51.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 >> v2:172.21.15.97:3300/0 conn(0x7f64a809b140 msgr2=0x7f64a80705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 --2- 172.21.15.67:0/1986743021 >> v2:172.21.15.97:3300/0 conn(0x7f64a809b140 0x7f64a80705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 >> v1:172.21.15.97:6789/0 conn(0x7f64a80c8c40 legacy=0x7f64a809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a8071150 con 0x7f64a815d290 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f64a0001a00 con 0x7f64a815d290 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 >> v1:172.21.15.67:6789/0 conn(0x7f64a815d290 legacy=0x7f64a8159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64900039c0 0x7f6490003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6490004810 0x7f6490004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f649000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8070e70 con 0x7f64900051d0 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f649000c070 con 0x7f6490004810 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f649000c270 con 0x7f64900039c0 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a7fff640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f649000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6490004810 0x7f6490004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a77fe640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64900039c0 0x7f6490003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a7fff640 1 -- 172.21.15.67:0/1986743021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64900039c0 msgr2=0x7f6490003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a7fff640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64900039c0 0x7f6490003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a7fff640 1 -- 172.21.15.67:0/1986743021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6490004810 msgr2=0x7f6490004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a7fff640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6490004810 0x7f6490004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.358+0000 7f64a7fff640 1 -- 172.21.15.67:0/1986743021 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6490003530 con 0x7f64900051d0 2024-09-19T05:45:51.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64a7fff640 1 -- 172.21.15.67:0/1986743021 reap_dead start 2024-09-19T05:45:51.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64a7fff640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f649000b9d0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f64a000a850 tx=0x7f64a001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6289a303ea3596d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a000a4a0 con 0x7f64900051d0 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a00ad650 con 0x7f64900051d0 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64a67fc640 1 -- 172.21.15.67:0/1986743021 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a00ada40 con 0x7f64900051d0 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 -- 172.21.15.67:0/1986743021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 msgr2=0x7f649000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f649000b9d0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f64a000a850 tx=0x7f64a001d3a0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 -- 172.21.15.67:0/1986743021 shutdown_connections 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 --2- 172.21.15.67:0/1986743021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f649000b9d0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 -- 172.21.15.67:0/1986743021 >> 172.21.15.67:0/1986743021 conn(0x7f64a80d22b0 msgr2=0x7f64a80d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 -- 172.21.15.67:0/1986743021 shutdown_connections 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 -- 172.21.15.67:0/1986743021 wait complete. 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 Processor -- start 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 -- start start 2024-09-19T05:45:51.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f64a80b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a815d860 0x7f64a80c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a815dce0 0x7f64a80c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64a80d04f0 con 0x7f64900051d0 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f64a815d6e0 con 0x7f64a815dce0 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.362+0000 7f64ae01d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f64a80705b0 con 0x7f64a815d860 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f64a80b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f64a80b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40112/0 (socket says 172.21.15.67:40112) 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a77fe640 1 -- 172.21.15.67:0/4225832781 learned_addr learned my addr 172.21.15.67:0/4225832781 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a7fff640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a815dce0 0x7f64a80c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a815d860 0x7f64a80c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a77fe640 1 -- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a815d860 msgr2=0x7f64a80c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a77fe640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a815d860 0x7f64a80c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a77fe640 1 -- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a815dce0 msgr2=0x7f64a80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a77fe640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a815dce0 0x7f64a80c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a77fe640 1 -- 172.21.15.67:0/4225832781 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a8160800 con 0x7f64900051d0 2024-09-19T05:45:51.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a77fe640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f64a80b7700 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f649800e4b0 tx=0x7f649800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:51.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f648ffff640 1 -- 172.21.15.67:0/4225832781 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64980052e0 con 0x7f64900051d0 2024-09-19T05:45:51.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f648ffff640 1 -- 172.21.15.67:0/4225832781 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6498018070 con 0x7f64900051d0 2024-09-19T05:45:51.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f648ffff640 1 -- 172.21.15.67:0/4225832781 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498005480 con 0x7f64900051d0 2024-09-19T05:45:51.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64ae01d640 1 -- 172.21.15.67:0/4225832781 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a8160ae0 con 0x7f64900051d0 2024-09-19T05:45:51.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64ae01d640 1 -- 172.21.15.67:0/4225832781 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a80b6f00 con 0x7f64900051d0 2024-09-19T05:45:51.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f648ffff640 1 -- 172.21.15.67:0/4225832781 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6498003840 con 0x7f64900051d0 2024-09-19T05:45:51.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f648ffff640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64940678c0 0x7f6494069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f648ffff640 1 -- 172.21.15.67:0/4225832781 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f6498085b50 con 0x7f64900051d0 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64940678c0 0x7f6494069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.366+0000 7f64b10d9000 1 Processor -- start 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- start start 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64940678c0 0x7f6494069d80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f64a80cb6a0 tx=0x7f649c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77b54150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77b0a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b0a6a0 0x563c77b0aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563c779edb60 con 0x563c77b0a6a0 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563c77954c70 con 0x563c77b54690 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563c778faed0 con 0x563c77b53d70 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b0a6a0 0x563c77b0aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b0a6a0 0x563c77b0aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40116/0 (socket says 172.21.15.67:40116) 2024-09-19T05:45:51.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a7fff640 1 -- 172.21.15.67:0/2628070349 learned_addr learned my addr 172.21.15.67:0/2628070349 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:51.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a77fe640 1 --2- 172.21.15.67:0/2628070349 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77b54150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/2628070349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77b0a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a7fff640 1 -- 172.21.15.67:0/2628070349 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 msgr2=0x563c77b54150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a7fff640 1 --2- 172.21.15.67:0/2628070349 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77b54150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a7fff640 1 -- 172.21.15.67:0/2628070349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 msgr2=0x563c77b0a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a7fff640 1 --2- 172.21.15.67:0/2628070349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77b0a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a7fff640 1 -- 172.21.15.67:0/2628070349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7790ce50 con 0x563c77b0a6a0 2024-09-19T05:45:51.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a77fe640 1 --2- 172.21.15.67:0/2628070349 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77b54150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a7fff640 1 --2- 172.21.15.67:0/2628070349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b0a6a0 0x563c77b0aa80 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f64a001dc40 tx=0x7f64a00a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c011db332857cb3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f648d7fa640 1 -- 172.21.15.67:0/2628070349 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a00019c0 con 0x563c77b0a6a0 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f648d7fa640 1 -- 172.21.15.67:0/2628070349 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a0004b70 con 0x563c77b0a6a0 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f648d7fa640 1 -- 172.21.15.67:0/2628070349 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a00ad430 con 0x563c77b0a6a0 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- 172.21.15.67:0/2628070349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b0a6a0 msgr2=0x563c77b0aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 --2- 172.21.15.67:0/2628070349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b0a6a0 0x563c77b0aa80 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f64a001dc40 tx=0x7f64a00a7000 comp rx=0 tx=0).stop 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- 172.21.15.67:0/2628070349 shutdown_connections 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 --2- 172.21.15.67:0/2628070349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b0a6a0 0x563c77b0aa80 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 --2- 172.21.15.67:0/2628070349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77b0a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 --2- 172.21.15.67:0/2628070349 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77b54150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- 172.21.15.67:0/2628070349 >> 172.21.15.67:0/2628070349 conn(0x563c77b0c600 msgr2=0x563c77b04630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- 172.21.15.67:0/2628070349 shutdown_connections 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- 172.21.15.67:0/2628070349 wait complete. 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- start start 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 Processor -- start 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77b40670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b54690 0x563c77b40bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b410f0 0x563c77b414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563c779b6b00 con 0x563c77b54690 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563c7792f360 con 0x563c77b410f0 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563c7792c2d0 con 0x563c77b53d70 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64b10d9000 10 client.0 _ll_register_callbacks cb 0x563c77af1820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.370+0000 7f64a6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b54690 0x563c77b40bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b54690 0x563c77b40bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40120/0 (socket says 172.21.15.67:40120) 2024-09-19T05:45:51.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a6ffd640 1 -- 172.21.15.67:0/1016358036 learned_addr learned my addr 172.21.15.67:0/1016358036 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a77fe640 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77b40670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a7fff640 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b410f0 0x563c77b414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a6ffd640 1 -- 172.21.15.67:0/1016358036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 msgr2=0x563c77b40670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77b40670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a6ffd640 1 -- 172.21.15.67:0/1016358036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b410f0 msgr2=0x563c77b414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b410f0 0x563c77b414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a6ffd640 1 -- 172.21.15.67:0/1016358036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c778fb120 con 0x563c77b54690 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a77fe640 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77b40670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a7fff640 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b410f0 0x563c77b414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b54690 0x563c77b40bb0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f649c009160 tx=0x7f649c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb251af0b8298 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64867fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64867fc640 1 -- 172.21.15.67:0/1016358036 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c027070 con 0x563c77b54690 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64867fc640 1 -- 172.21.15.67:0/1016358036 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f649c014a00 con 0x563c77b54690 2024-09-19T05:45:51.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 -- 172.21.15.67:0/1016358036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64a0004b70 con 0x563c77b54690 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64867fc640 1 -- 172.21.15.67:0/1016358036 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) ==== 24+0+0 (secure 0 0 0) 0x7f649c032050 con 0x563c77b54690 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 10 client.9702 fetch_fsmap learned FSMap version 115 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 -- 172.21.15.67:0/1016358036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) -- 0x563c778f4450 con 0x563c77b54690 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64867fc640 1 -- 172.21.15.67:0/1016358036 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a0004b70 con 0x563c77b54690 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64867fc640 1 -- 172.21.15.67:0/1016358036 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 115) ==== 3502+0+0 (secure 0 0 0) 0x7f649c035020 con 0x563c77b54690 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 10 client.9702 fetch_fsmap finished waiting for FSMap version 115 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 10 client.9702 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 20 client.9702 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x563c77b624d0 0x563c77b648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 4 client.9702 mds_command: new command op to 9579 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 -- 172.21.15.67:0/1016358036 --> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c778eec00 con 0x563c77b624d0 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a77fe640 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x563c77b624d0 0x563c77b648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64867fc640 10 client.9702 ms_handle_connect on v2:172.21.15.67:6834/1716781558 2024-09-19T05:45:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64a77fe640 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x563c77b624d0 0x563c77b648c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d6ee0a95f045f66 server_cookie=970c7e7f0e59f431 in_seq=0 out_seq=0 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64867fc640 1 -- 172.21.15.67:0/1016358036 <== mds.0 v2:172.21.15.67:6834/1716781558 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c778eec00 con 0x563c77b624d0 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64867fc640 10 client.9702 handle_command_reply: tid=0 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 client.9702 shutdown 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 -- 172.21.15.67:0/1016358036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b54690 msgr2=0x563c77b40bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b54690 0x563c77b40bb0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f649c009160 tx=0x7f649c004740 comp rx=0 tx=0).stop 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 -- 172.21.15.67:0/1016358036 shutdown_connections 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x563c77b624d0 0x563c77b648c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b410f0 0x563c77b414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b54690 0x563c77b40bb0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 --2- 172.21.15.67:0/1016358036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77b40670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64867fc640 0 client.9702 ms_handle_reset on v2:172.21.15.67:6834/1716781558 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 -- 172.21.15.67:0/1016358036 >> 172.21.15.67:0/1016358036 conn(0x563c77b0a6a0 msgr2=0x563c77b0b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 -- 172.21.15.67:0/1016358036 shutdown_connections 2024-09-19T05:45:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 1 -- 172.21.15.67:0/1016358036 wait complete. 2024-09-19T05:45:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.374+0000 7f64b10d9000 20 client.9702 trim_cache size 0 max 16384 2024-09-19T05:45:51.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 Processor -- start 2024-09-19T05:45:51.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 -- start start 2024-09-19T05:45:51.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b410f0 0x563c77b52e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b53d70 0x563c77b53340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77b648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81fc080 con 0x563c77b53d70 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81fb3e0 con 0x563c77b54690 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f64a81fba30 con 0x563c77b410f0 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64a6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b53d70 0x563c77b53340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64a6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b53d70 0x563c77b53340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40134/0 (socket says 172.21.15.67:40134) 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64a6ffd640 1 -- 172.21.15.67:0/2030730624 learned_addr learned my addr 172.21.15.67:0/2030730624 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64a6ffd640 1 -- 172.21.15.67:0/2030730624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b410f0 msgr2=0x563c77b52e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/2030730624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b410f0 0x563c77b52e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64a6ffd640 1 -- 172.21.15.67:0/2030730624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 msgr2=0x563c77b648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/2030730624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77b648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64a6ffd640 1 -- 172.21.15.67:0/2030730624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c77b41840 con 0x563c77b53d70 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/2030730624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b53d70 0x563c77b53340 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f649c0126a0 tx=0x7f649c023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826176df1002cabe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f648cff9640 1 -- 172.21.15.67:0/2030730624 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c027040 con 0x563c77b53d70 2024-09-19T05:45:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f648cff9640 1 -- 172.21.15.67:0/2030730624 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649c01b040 con 0x563c77b53d70 2024-09-19T05:45:51.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f648cff9640 1 -- 172.21.15.67:0/2030730624 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c02c550 con 0x563c77b53d70 2024-09-19T05:45:51.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 -- 172.21.15.67:0/2030730624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b53d70 msgr2=0x563c77b53340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 --2- 172.21.15.67:0/2030730624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b53d70 0x563c77b53340 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f649c0126a0 tx=0x7f649c023000 comp rx=0 tx=0).stop 2024-09-19T05:45:51.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 -- 172.21.15.67:0/2030730624 shutdown_connections 2024-09-19T05:45:51.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 --2- 172.21.15.67:0/2030730624 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77b648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 --2- 172.21.15.67:0/2030730624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b53d70 0x563c77b53340 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 --2- 172.21.15.67:0/2030730624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b410f0 0x563c77b52e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 -- 172.21.15.67:0/2030730624 >> 172.21.15.67:0/2030730624 conn(0x563c77b0a6a0 msgr2=0x563c77b04ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:51.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 -- 172.21.15.67:0/2030730624 shutdown_connections 2024-09-19T05:45:51.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.394+0000 7f64b10d9000 1 -- 172.21.15.67:0/2030730624 wait complete. 2024-09-19T05:45:51.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- start start 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 Processor -- start 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b410f0 0x563c77bc7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77bc7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77bc7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563c77953f80 con 0x563c77b410f0 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563c7790cca0 con 0x563c77b54690 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563c779592a0 con 0x563c77b53d70 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 10 client.0 _ll_register_callbacks cb 0x7f649c009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b410f0 0x563c77bc7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b410f0 0x563c77bc7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40148/0 (socket says 172.21.15.67:40148) 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a77fe640 1 -- 172.21.15.67:0/369420692 learned_addr learned my addr 172.21.15.67:0/369420692 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a7fff640 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77bc7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77bc7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a77fe640 1 -- 172.21.15.67:0/369420692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 msgr2=0x563c77bc7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a77fe640 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77bc7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a77fe640 1 -- 172.21.15.67:0/369420692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 msgr2=0x563c77bc7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a77fe640 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77bc7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a77fe640 1 -- 172.21.15.67:0/369420692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c778dbfd0 con 0x563c77b410f0 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a77fe640 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b410f0 0x563c77bc7560 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f649800ee70 tx=0x7f64980557e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0d89b627660a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64867fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64867fc640 1 -- 172.21.15.67:0/369420692 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64980523d0 con 0x563c77b410f0 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64867fc640 1 -- 172.21.15.67:0/369420692 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f6498014c60 con 0x563c77b410f0 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- 172.21.15.67:0/369420692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f649c01b040 con 0x563c77b410f0 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64867fc640 1 -- 172.21.15.67:0/369420692 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) ==== 24+0+0 (secure 0 0 0) 0x7f6498052570 con 0x563c77b410f0 2024-09-19T05:45:51.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 10 client.9708 fetch_fsmap learned FSMap version 115 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- 172.21.15.67:0/369420692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) -- 0x563c779d7750 con 0x563c77b410f0 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64867fc640 1 -- 172.21.15.67:0/369420692 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649c01b040 con 0x563c77b410f0 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64867fc640 1 -- 172.21.15.67:0/369420692 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 115) ==== 3502+0+0 (secure 0 0 0) 0x7f6498074170 con 0x563c77b410f0 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 10 client.9708 fetch_fsmap finished waiting for FSMap version 115 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 10 client.9708 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 20 client.9708 populate_metadata read hostname 'smithi067' 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x563c77b83030 0x563c77b83410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 4 client.9708 mds_command: new command op to 9579 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- 172.21.15.67:0/369420692 --> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] -- command(tid 0: {"prefix": "status"}) -- 0x563c779623a0 con 0x563c77b83030 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x563c77b83030 0x563c77b83410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64867fc640 10 client.9708 ms_handle_connect on v2:172.21.15.67:6834/1716781558 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64a6ffd640 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x563c77b83030 0x563c77b83410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceeba48a6553d446 server_cookie=28956cd03382a in_seq=0 out_seq=0 2024-09-19T05:45:51.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64867fc640 1 -- 172.21.15.67:0/369420692 <== mds.0 v2:172.21.15.67:6834/1716781558 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x563c779623a0 con 0x563c77b83030 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64867fc640 10 client.9708 handle_command_reply: tid=0 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 client.9708 shutdown 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- 172.21.15.67:0/369420692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b410f0 msgr2=0x563c77bc7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b410f0 0x563c77bc7560 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f649800ee70 tx=0x7f64980557e0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- 172.21.15.67:0/369420692 shutdown_connections 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x563c77b83030 0x563c77b83410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563c77b54690 0x563c77bc7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64867fc640 0 client.9708 ms_handle_reset on v2:172.21.15.67:6834/1716781558 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c77b53d70 0x563c77bc7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 --2- 172.21.15.67:0/369420692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563c77b410f0 0x563c77bc7560 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- 172.21.15.67:0/369420692 >> 172.21.15.67:0/369420692 conn(0x563c77b0a6a0 msgr2=0x563c77b51df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- 172.21.15.67:0/369420692 shutdown_connections 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 1 -- 172.21.15.67:0/369420692 wait complete. 2024-09-19T05:45:51.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64b10d9000 20 client.9708 trim_cache size 0 max 16384 2024-09-19T05:45:51.404 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:45:51.404 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:45:51.404 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:45:51.404 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 9579, 2024-09-19T05:45:51.404 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:45:51.404 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:45:51.404 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:45:51.404 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 6.2277458079999999, 2024-09-19T05:45:51.404 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 115, 2024-09-19T05:45:51.404 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 168, 2024-09-19T05:45:51.405 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 168, 2024-09-19T05:45:51.405 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 11.169188042 2024-09-19T05:45:51.405 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:45:51.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64ae01d640 1 -- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64940678c0 msgr2=0x7f6494069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64ae01d640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64940678c0 0x7f6494069d80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f64a80cb6a0 tx=0x7f649c008040 comp rx=0 tx=0).stop 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64ae01d640 1 -- 172.21.15.67:0/4225832781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 msgr2=0x7f64a80b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64ae01d640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f64a80b7700 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f649800e4b0 tx=0x7f649800e970 comp rx=0 tx=0).stop 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64ae01d640 1 -- 172.21.15.67:0/4225832781 shutdown_connections 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64ae01d640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a815dce0 0x7f64a80c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64ae01d640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f64940678c0 0x7f6494069d80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64ae01d640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a815d860 0x7f64a80c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64ae01d640 1 --2- 172.21.15.67:0/4225832781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64900051d0 0x7f64a80b7700 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.398+0000 7f64ae01d640 1 -- 172.21.15.67:0/4225832781 >> 172.21.15.67:0/4225832781 conn(0x7f64a80d22b0 msgr2=0x7f64a80af260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.402+0000 7f64ae01d640 1 -- 172.21.15.67:0/4225832781 shutdown_connections 2024-09-19T05:45:51.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.402+0000 7f64ae01d640 1 -- 172.21.15.67:0/4225832781 wait complete. 2024-09-19T05:45:51.415 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:45:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04f2b1640 1 Processor -- start 2024-09-19T05:45:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04f2b1640 1 -- start start 2024-09-19T05:45:51.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04f2b1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd04815c030 0x7fd04806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04f2b1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd04806f460 0x7fd04806f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04f2b1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04806e3c0 con 0x7fd04815d1d0 2024-09-19T05:45:51.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04f2b1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd04806e6a0 con 0x7fd04815c030 2024-09-19T05:45:51.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04f2b1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd04806e980 con 0x7fd04806f460 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04c84c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd04815d1d0 0x7fd0480b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43310/0 (socket says 172.21.15.67:43310) 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04c84c640 1 -- 172.21.15.67:0/591901882 learned_addr learned my addr 172.21.15.67:0/591901882 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04d84e640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd04806f460 0x7fd04806f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04d04d640 1 --2- 172.21.15.67:0/591901882 >> v2:172.21.15.97:3300/0 conn(0x7fd04815c030 0x7fd04806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802701191 0 0) 0x7fd04806e3c0 con 0x7fd04815d1d0 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd034003530 con 0x7fd04815d1d0 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2574912705 0 0) 0x7fd034003530 con 0x7fd04815d1d0 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd04806f460 msgr2=0x7fd04806f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd04806f460 0x7fd04806f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 >> v2:172.21.15.97:3300/0 conn(0x7fd04815c030 msgr2=0x7fd04806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 --2- 172.21.15.67:0/591901882 >> v2:172.21.15.97:3300/0 conn(0x7fd04815c030 0x7fd04806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04806ec60 con 0x7fd04815d1d0 2024-09-19T05:45:51.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fd038001680 con 0x7fd04815d1d0 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 >> v1:172.21.15.67:6789/0 conn(0x7fd04815d1d0 legacy=0x7fd0480b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd04806f460 0x7fd0340039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 0x7fd034004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd034004d50 0x7fd0340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd04806e6a0 con 0x7fd034003f40 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd04806e980 con 0x7fd034004d50 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd03400b9d0 con 0x7fd04806f460 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04c84c640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 0x7fd034004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04d04d640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd04806f460 0x7fd0340039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04d84e640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd034004d50 0x7fd0340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04c84c640 1 -- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd04806f460 msgr2=0x7fd0340039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04c84c640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd04806f460 0x7fd0340039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04c84c640 1 -- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd034004d50 msgr2=0x7fd0340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:51.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04c84c640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd034004d50 0x7fd0340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.534+0000 7fd04c84c640 1 -- 172.21.15.67:0/591901882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd034003530 con 0x7fd034003f40 2024-09-19T05:45:51.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd04c84c640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 0x7fd034004810 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c240 tx=0x7fd03801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef95f98b00265a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:51.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038007d40 con 0x7fd034003f40 2024-09-19T05:45:51.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd038005b00 con 0x7fd034003f40 2024-09-19T05:45:51.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd03ffff640 1 -- 172.21.15.67:0/591901882 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038007070 con 0x7fd034003f40 2024-09-19T05:45:51.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd04f2b1640 1 -- 172.21.15.67:0/591901882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 msgr2=0x7fd034004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd04f2b1640 1 --2- 172.21.15.67:0/591901882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 0x7fd034004810 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c240 tx=0x7fd03801f3b0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd04d84e640 1 -- 172.21.15.67:0/591901882 reap_dead start 2024-09-19T05:45:51.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd04f2b1640 1 -- 172.21.15.67:0/591901882 shutdown_connections 2024-09-19T05:45:51.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd04f2b1640 1 -- 172.21.15.67:0/591901882 >> 172.21.15.67:0/591901882 conn(0x7fd0480d0080 msgr2=0x7fd0480d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:51.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd04f2b1640 1 -- 172.21.15.67:0/591901882 shutdown_connections 2024-09-19T05:45:51.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd04f2b1640 1 -- 172.21.15.67:0/591901882 wait complete. 2024-09-19T05:45:51.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd04f2b1640 1 Processor -- start 2024-09-19T05:45:51.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.538+0000 7fd04f2b1640 1 -- start start 2024-09-19T05:45:51.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04f2b1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 0x7fd048153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04f2b1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd048154290 0x7fd048099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04f2b1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd048099a60 0x7fd04809cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04f2b1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd0480b36e0 con 0x7fd034003f40 2024-09-19T05:45:51.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04f2b1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd04815d660 con 0x7fd048154290 2024-09-19T05:45:51.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04f2b1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd0481547a0 con 0x7fd048099a60 2024-09-19T05:45:51.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04d04d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 0x7fd048153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04d04d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 0x7fd048153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40172/0 (socket says 172.21.15.67:40172) 2024-09-19T05:45:51.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04d04d640 1 -- 172.21.15.67:0/3603438968 learned_addr learned my addr 172.21.15.67:0/3603438968 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:51.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04c84c640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd048154290 0x7fd048099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04d84e640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd048099a60 0x7fd04809cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04d04d640 1 -- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd048099a60 msgr2=0x7fd04809cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04d04d640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd048099a60 0x7fd04809cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04d04d640 1 -- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd048154290 msgr2=0x7fd048099520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04d04d640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd048154290 0x7fd048099520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04d04d640 1 -- 172.21.15.67:0/3603438968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd048154a80 con 0x7fd034003f40 2024-09-19T05:45:51.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04d04d640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 0x7fd048153d50 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fd0440115e0 tx=0x7fd044011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:51.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd03dffb640 1 -- 172.21.15.67:0/3603438968 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04400f8f0 con 0x7fd034003f40 2024-09-19T05:45:51.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd03dffb640 1 -- 172.21.15.67:0/3603438968 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04400fa90 con 0x7fd034003f40 2024-09-19T05:45:51.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04f2b1640 1 -- 172.21.15.67:0/3603438968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd048154d60 con 0x7fd034003f40 2024-09-19T05:45:51.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd03dffb640 1 -- 172.21.15.67:0/3603438968 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04400fe40 con 0x7fd034003f40 2024-09-19T05:45:51.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04f2b1640 1 -- 172.21.15.67:0/3603438968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04809a610 con 0x7fd034003f40 2024-09-19T05:45:51.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04f2b1640 1 -- 172.21.15.67:0/3603438968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04815c410 con 0x7fd034003f40 2024-09-19T05:45:51.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd03dffb640 1 -- 172.21.15.67:0/3603438968 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd044015460 con 0x7fd034003f40 2024-09-19T05:45:51.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd03dffb640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd02c0678f0 0x7fd02c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:51.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd03dffb640 1 -- 172.21.15.67:0/3603438968 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7fd044086800 con 0x7fd034003f40 2024-09-19T05:45:51.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.542+0000 7fd04c84c640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd02c0678f0 0x7fd02c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:51.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.546+0000 7fd04c84c640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd02c0678f0 0x7fd02c069db0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd0380ae000 tx=0x7fd04806e590 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:51.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.546+0000 7fd03dffb640 1 -- 172.21.15.67:0/3603438968 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd044019030 con 0x7fd034003f40 2024-09-19T05:45:51.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 -- 172.21.15.67:0/3603438968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd0480d0f20 con 0x7fd034003f40 2024-09-19T05:45:51.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd03dffb640 1 -- 172.21.15.67:0/3603438968 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v115) ==== 53+0+73 (secure 0 0 0) 0x7fd0440571b0 con 0x7fd034003f40 2024-09-19T05:45:51.745 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:45:51.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 -- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd02c0678f0 msgr2=0x7fd02c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd02c0678f0 0x7fd02c069db0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd0380ae000 tx=0x7fd04806e590 comp rx=0 tx=0).stop 2024-09-19T05:45:51.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 -- 172.21.15.67:0/3603438968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 msgr2=0x7fd048153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:51.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 0x7fd048153d50 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fd0440115e0 tx=0x7fd044011aa0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 -- 172.21.15.67:0/3603438968 shutdown_connections 2024-09-19T05:45:51.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd02c0678f0 0x7fd02c069db0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd048099a60 0x7fd04809cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd048154290 0x7fd048099520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 --2- 172.21.15.67:0/3603438968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd034003f40 0x7fd048153d50 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:51.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 -- 172.21.15.67:0/3603438968 >> 172.21.15.67:0/3603438968 conn(0x7fd0480d0080 msgr2=0x7fd048155870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:51.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 -- 172.21.15.67:0/3603438968 shutdown_connections 2024-09-19T05:45:51.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51.746+0000 7fd04f2b1640 1 -- 172.21.15.67:0/3603438968 wait complete. 2024-09-19T05:45:51.765 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:45:51.765 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:45:51.765 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:45:51.765 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:45:51.765 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:45:51.766 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:45:51.766 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:45:51.766 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:45:51.766 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:45:51.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:51.766 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:45:51.772 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:45:51.772 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:45:51.772 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:45:51.772 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:45:51.772 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41753sec preferred_lft 41753sec 2024-09-19T05:45:51.773 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:45:51.774 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:45:51.775 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:45:51.775 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:45:51.775 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:45:51.775 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:45:51.775 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:45:51.775 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:45:51.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:51.775 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:45:51.826 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:45:51.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:51.828 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:45:51.879 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:45:51.879 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:45:51.879 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:45:51.879 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:45:51.880 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:45:51.880 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:45:51.880 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:45:51.880 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:45:51.880 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:45:51.881 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:45:51.881 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:45:51.881 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:45:51.881 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:51.881 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:45:51.882 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:45:51.882 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:45:51.882 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:51.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:45:52.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:52.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:52.008 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:45:52.014 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:45:52.014 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:45:52.015 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:45:52.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:52.015 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:45:52.072 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:45:52.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:45:52.072 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:45:52.119 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:45:52.119 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:45:52.119 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:45:52.167 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:45:52.231 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:45:52.280 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:45:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:45:52.282 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:45:52.283 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:45:52.283 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:45:52.283 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:45:52.283 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:45:52.283 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:45:52.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:52.284 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:45:52.331 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:45:52.332 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:45:52.376 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:45:52.394 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:45:52.444 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:45:52.445 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:45:52.446 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:45:52.446 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:45:52.446 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:45:52.446 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:45:52.446 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:45:52.446 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:45:52.446 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:45:52.446 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:45:52.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:52.447 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:45:52.466 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:45:52.466+0000 7fcba1a56580 -1 init, newargv = 0x5645813a28d0 newargc=15 2024-09-19T05:45:52.466 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[82261]: starting ceph client 2024-09-19T05:45:52.470 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[82261]: starting fuse 2024-09-19T05:45:53.572 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:45:53.589 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:45:53.642 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:45:53.642 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:45:53.642 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:45:53.642 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:45:53.642 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:45:53.642 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:45:53.643 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:45:53.644 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:45:53.645 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:45:53.645 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:45:53.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:53.646 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:45:53.692 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:45:53.692 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:45:53.692 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:45:53.692 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:45:53.692 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:45:53.692 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:45:53.693 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:45:53.694 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:45:53.694 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:45:53.694 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:45:53.694 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:45:53.694 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:45:53.694 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:45:53.694 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:45:53.694 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:45:53.694 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:45:53.694 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:45:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.82261.asok 2024-09-19T05:45:53.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:53.831 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.82261.asok 2024-09-19T05:45:53.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:53.832 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.82261.asok status 2024-09-19T05:45:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:45:53.991 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:45:53.991 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "82261", 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 9720, 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:45:53.992 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 9720 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 767662982 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 767662982 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.9720 192.168.0.1:0/767662982", 2024-09-19T05:45:53.993 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/767662982", 2024-09-19T05:45:53.994 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:45:53.994 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 115, 2024-09-19T05:45:53.994 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 168, 2024-09-19T05:45:53.994 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:45:53.994 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:45:53.994 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:45:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:45:54.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:54.007 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:45:54.007 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:45:54.014 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:45:54.014 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:45:54.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:45:54.015 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:45:54.073 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:54.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f133a3d8640 1 Processor -- start 2024-09-19T05:45:54.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f133a3d8640 1 -- start start 2024-09-19T05:45:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f133a3d8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f133415c030 0x7f133406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f133a3d8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133415d1d0 0x7f13340b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f133a3d8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f13340b3510 0x7f133406f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f133a3d8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f133406e3c0 con 0x7f13340b3510 2024-09-19T05:45:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f133a3d8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f133406e6a0 con 0x7f133415c030 2024-09-19T05:45:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f133a3d8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f133406e980 con 0x7f133415d1d0 2024-09-19T05:45:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f1338975640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f13340b3510 0x7f133406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f1338975640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f13340b3510 0x7f133406f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40178/0 (socket says 172.21.15.67:40178) 2024-09-19T05:45:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f1338975640 1 -- 172.21.15.67:0/3108222449 learned_addr learned my addr 172.21.15.67:0/3108222449 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f1333fff640 1 --2- 172.21.15.67:0/3108222449 >> v2:172.21.15.97:3300/0 conn(0x7f133415c030 0x7f133406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f132b7fe640 1 --2- 172.21.15.67:0/3108222449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133415d1d0 0x7f13340b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f1338975640 1 -- 172.21.15.67:0/3108222449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133415d1d0 msgr2=0x7f13340b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:54.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f1338975640 1 --2- 172.21.15.67:0/3108222449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133415d1d0 0x7f13340b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f1338975640 1 -- 172.21.15.67:0/3108222449 >> v2:172.21.15.97:3300/0 conn(0x7f133415c030 msgr2=0x7f133406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:54.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f1338975640 1 --2- 172.21.15.67:0/3108222449 >> v2:172.21.15.97:3300/0 conn(0x7f133415c030 0x7f133406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.250+0000 7f1338975640 1 -- 172.21.15.67:0/3108222449 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133406ec60 con 0x7f13340b3510 2024-09-19T05:45:54.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1338975640 1 --2- 172.21.15.67:0/3108222449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 0x7f133406f460 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f1334070390 tx=0x7f132c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6749fd26bb3b43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:54.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f13337fe640 1 -- 172.21.15.67:0/3108222449 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c0a56c0 con 0x7f13340b3510 2024-09-19T05:45:54.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f13337fe640 1 -- 172.21.15.67:0/3108222449 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c0a5860 con 0x7f13340b3510 2024-09-19T05:45:54.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f13337fe640 1 -- 172.21.15.67:0/3108222449 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c0a5c30 con 0x7f13340b3510 2024-09-19T05:45:54.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 -- 172.21.15.67:0/3108222449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 msgr2=0x7f133406f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:54.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 --2- 172.21.15.67:0/3108222449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 0x7f133406f460 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f1334070390 tx=0x7f132c01c930 comp rx=0 tx=0).stop 2024-09-19T05:45:54.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 -- 172.21.15.67:0/3108222449 shutdown_connections 2024-09-19T05:45:54.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 --2- 172.21.15.67:0/3108222449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 0x7f133406f460 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 --2- 172.21.15.67:0/3108222449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133415d1d0 0x7f13340b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 --2- 172.21.15.67:0/3108222449 >> v2:172.21.15.97:3300/0 conn(0x7f133415c030 0x7f133406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 -- 172.21.15.67:0/3108222449 >> 172.21.15.67:0/3108222449 conn(0x7f13340d0080 msgr2=0x7f13340d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:54.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 -- 172.21.15.67:0/3108222449 shutdown_connections 2024-09-19T05:45:54.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 -- 172.21.15.67:0/3108222449 wait complete. 2024-09-19T05:45:54.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 Processor -- start 2024-09-19T05:45:54.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 -- start start 2024-09-19T05:45:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 0x7f13341f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133415c030 0x7f1334149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f133415d1d0 0x7f133415e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f133415fec0 con 0x7f13340b3510 2024-09-19T05:45:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f133415fd40 con 0x7f133415d1d0 2024-09-19T05:45:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f133a3d8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1334160040 con 0x7f133415c030 2024-09-19T05:45:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1333fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 0x7f13341f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1333fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 0x7f13341f7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40190/0 (socket says 172.21.15.67:40190) 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1333fff640 1 -- 172.21.15.67:0/3642992120 learned_addr learned my addr 172.21.15.67:0/3642992120 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1338975640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f133415d1d0 0x7f133415e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f132b7fe640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133415c030 0x7f1334149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1333fff640 1 -- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133415c030 msgr2=0x7f1334149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1333fff640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133415c030 0x7f1334149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1333fff640 1 -- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f133415d1d0 msgr2=0x7f133415e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1333fff640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f133415d1d0 0x7f133415e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1333fff640 1 -- 172.21.15.67:0/3642992120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1334166740 con 0x7f13340b3510 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1338975640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f133415d1d0 0x7f133415e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f1333fff640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 0x7f13341f7400 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f132400d800 tx=0x7f132400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.254+0000 7f13317fa640 1 -- 172.21.15.67:0/3642992120 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132400b6c0 con 0x7f13340b3510 2024-09-19T05:45:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.258+0000 7f13317fa640 1 -- 172.21.15.67:0/3642992120 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1324019070 con 0x7f13340b3510 2024-09-19T05:45:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.258+0000 7f133a3d8640 1 -- 172.21.15.67:0/3642992120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1334156750 con 0x7f13340b3510 2024-09-19T05:45:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.258+0000 7f13317fa640 1 -- 172.21.15.67:0/3642992120 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132400ba60 con 0x7f13340b3510 2024-09-19T05:45:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.258+0000 7f133a3d8640 1 -- 172.21.15.67:0/3642992120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1334151d80 con 0x7f13340b3510 2024-09-19T05:45:54.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.258+0000 7f132a7fc640 1 -- 172.21.15.67:0/3642992120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f130c0052a0 con 0x7f13340b3510 2024-09-19T05:45:54.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.258+0000 7f13317fa640 1 -- 172.21.15.67:0/3642992120 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f132400bc00 con 0x7f13340b3510 2024-09-19T05:45:54.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.258+0000 7f13317fa640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13140678c0 0x7f1314069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.258+0000 7f13317fa640 1 -- 172.21.15.67:0/3642992120 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f1324086290 con 0x7f13340b3510 2024-09-19T05:45:54.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.258+0000 7f132b7fe640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13140678c0 0x7f1314069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.258+0000 7f132b7fe640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13140678c0 0x7f1314069d80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f13340cf2e0 tx=0x7f131c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:54.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.262+0000 7f13317fa640 1 -- 172.21.15.67:0/3642992120 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1324056c40 con 0x7f13340b3510 2024-09-19T05:45:54.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.470+0000 7f132a7fc640 1 -- 172.21.15.67:0/3642992120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f130c005860 con 0x7f13340b3510 2024-09-19T05:45:54.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.470+0000 7f13317fa640 1 -- 172.21.15.67:0/3642992120 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7f1324056540 con 0x7f13340b3510 2024-09-19T05:45:54.470 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:54.470 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:45:54.470 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:45:54.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 -- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13140678c0 msgr2=0x7f1314069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:54.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13140678c0 0x7f1314069d80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f13340cf2e0 tx=0x7f131c008040 comp rx=0 tx=0).stop 2024-09-19T05:45:54.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 -- 172.21.15.67:0/3642992120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 msgr2=0x7f13341f7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:54.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 0x7f13341f7400 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f132400d800 tx=0x7f132400dcc0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 -- 172.21.15.67:0/3642992120 shutdown_connections 2024-09-19T05:45:54.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f133415d1d0 0x7f133415e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f13140678c0 0x7f1314069d80 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133415c030 0x7f1334149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 --2- 172.21.15.67:0/3642992120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13340b3510 0x7f13341f7400 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 -- 172.21.15.67:0/3642992120 >> 172.21.15.67:0/3642992120 conn(0x7f13340d0080 msgr2=0x7f1334158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:54.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 -- 172.21.15.67:0/3642992120 shutdown_connections 2024-09-19T05:45:54.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.474+0000 7f132a7fc640 1 -- 172.21.15.67:0/3642992120 wait complete. 2024-09-19T05:45:54.489 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:45:54.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.618+0000 7f6f7d379640 1 Processor -- start 2024-09-19T05:45:54.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.618+0000 7f6f7d379640 1 -- start start 2024-09-19T05:45:54.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f7d379640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f7815c030 0x7f6f7806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f7d379640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6f7815d1d0 0x7f6f780b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f7d379640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7806e3c0 con 0x7f6f780b3510 2024-09-19T05:45:54.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f7d379640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6f7806e6a0 con 0x7f6f7815c030 2024-09-19T05:45:54.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f7d379640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6f7806e980 con 0x7f6f7815d1d0 2024-09-19T05:45:54.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f76ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f7815c030 0x7f6f7806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f76ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f7815c030 0x7f6f7806dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40200/0 (socket says 172.21.15.67:40200) 2024-09-19T05:45:54.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f76ffd640 1 -- 172.21.15.67:0/3880328345 learned_addr learned my addr 172.21.15.67:0/3880328345 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:54.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f767fc640 1 --2- 172.21.15.67:0/3880328345 >> v2:172.21.15.97:3300/0 conn(0x7f6f7815d1d0 0x7f6f780b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f76ffd640 1 -- 172.21.15.67:0/3880328345 >> v2:172.21.15.97:3300/0 conn(0x7f6f7815d1d0 msgr2=0x7f6f780b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:54.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f76ffd640 1 --2- 172.21.15.67:0/3880328345 >> v2:172.21.15.97:3300/0 conn(0x7f6f7815d1d0 0x7f6f780b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f76ffd640 1 -- 172.21.15.67:0/3880328345 >> v1:172.21.15.97:6789/0 conn(0x7f6f780b3510 legacy=0x7f6f7806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:54.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f76ffd640 1 -- 172.21.15.67:0/3880328345 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7806ec60 con 0x7f6f7815c030 2024-09-19T05:45:54.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f76ffd640 1 --2- 172.21.15.67:0/3880328345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 0x7f6f7806dde0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f6f780add20 tx=0x7f6f6001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8a488df91c709b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:54.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f75ffb640 1 -- 172.21.15.67:0/3880328345 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f600b1070 con 0x7f6f7815c030 2024-09-19T05:45:54.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f75ffb640 1 -- 172.21.15.67:0/3880328345 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f600ac630 con 0x7f6f7815c030 2024-09-19T05:45:54.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.622+0000 7f6f75ffb640 1 -- 172.21.15.67:0/3880328345 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f600a8050 con 0x7f6f7815c030 2024-09-19T05:45:54.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- 172.21.15.67:0/3880328345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 msgr2=0x7f6f7806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:54.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 --2- 172.21.15.67:0/3880328345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 0x7f6f7806dde0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f6f780add20 tx=0x7f6f6001c4b0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- 172.21.15.67:0/3880328345 shutdown_connections 2024-09-19T05:45:54.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 --2- 172.21.15.67:0/3880328345 >> v2:172.21.15.97:3300/0 conn(0x7f6f7815d1d0 0x7f6f780b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 --2- 172.21.15.67:0/3880328345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 0x7f6f7806dde0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- 172.21.15.67:0/3880328345 >> 172.21.15.67:0/3880328345 conn(0x7f6f780d0080 msgr2=0x7f6f780d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:54.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- 172.21.15.67:0/3880328345 shutdown_connections 2024-09-19T05:45:54.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- 172.21.15.67:0/3880328345 wait complete. 2024-09-19T05:45:54.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 Processor -- start 2024-09-19T05:45:54.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- start start 2024-09-19T05:45:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f780b3510 0x7f6f7815f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 0x7f6f7814d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7815d1d0 0x7f6f7814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7815c590 con 0x7f6f7815c030 2024-09-19T05:45:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7815c410 con 0x7f6f7815d1d0 2024-09-19T05:45:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6f781690e0 con 0x7f6f780b3510 2024-09-19T05:45:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f767fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 0x7f6f7814d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f767fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 0x7f6f7814d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40204/0 (socket says 172.21.15.67:40204) 2024-09-19T05:45:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f767fc640 1 -- 172.21.15.67:0/1045214074 learned_addr learned my addr 172.21.15.67:0/1045214074 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:45:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f767fc640 1 -- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f780b3510 msgr2=0x7f6f7815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f767fc640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f780b3510 0x7f6f7815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f777fe640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7815d1d0 0x7f6f7814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f767fc640 1 -- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7815d1d0 msgr2=0x7f6f7814daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f767fc640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7815d1d0 0x7f6f7814daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f767fc640 1 -- 172.21.15.67:0/1045214074 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f78148420 con 0x7f6f7815c030 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f767fc640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 0x7f6f7814d560 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800d620 tx=0x7f6f6800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f6f7fe640 1 -- 172.21.15.67:0/1045214074 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f680125f0 con 0x7f6f7815c030 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f6f7fe640 1 -- 172.21.15.67:0/1045214074 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f68019070 con 0x7f6f7815c030 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- 172.21.15.67:0/1045214074 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f78148700 con 0x7f6f7815c030 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f6f7fe640 1 -- 172.21.15.67:0/1045214074 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f680129f0 con 0x7f6f7815c030 2024-09-19T05:45:54.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.626+0000 7f6f7d379640 1 -- 172.21.15.67:0/1045214074 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f78148cc0 con 0x7f6f7815c030 2024-09-19T05:45:54.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.630+0000 7f6f7d379640 1 -- 172.21.15.67:0/1045214074 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f7806dde0 con 0x7f6f7815c030 2024-09-19T05:45:54.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.630+0000 7f6f6f7fe640 1 -- 172.21.15.67:0/1045214074 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f68012b90 con 0x7f6f7815c030 2024-09-19T05:45:54.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.630+0000 7f6f6f7fe640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f580678c0 0x7f6f58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:54.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.630+0000 7f6f6f7fe640 1 -- 172.21.15.67:0/1045214074 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f6f68086250 con 0x7f6f7815c030 2024-09-19T05:45:54.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.630+0000 7f6f76ffd640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f580678c0 0x7f6f58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.630+0000 7f6f76ffd640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f580678c0 0x7f6f58069d80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6f600ae000 tx=0x7f6f60004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.634+0000 7f6f6f7fe640 1 -- 172.21.15.67:0/1045214074 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6f68056c00 con 0x7f6f7815c030 2024-09-19T05:45:54.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.834+0000 7f6f7d379640 1 -- 172.21.15.67:0/1045214074 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f780d0f20 con 0x7f6f7815c030 2024-09-19T05:45:54.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.834+0000 7f6f6f7fe640 1 -- 172.21.15.67:0/1045214074 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7f6f68056500 con 0x7f6f7815c030 2024-09-19T05:45:54.833 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:45:54.833 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:45:54.834 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:45:54.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 -- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f580678c0 msgr2=0x7f6f58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:54.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f580678c0 0x7f6f58069d80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6f600ae000 tx=0x7f6f60004740 comp rx=0 tx=0).stop 2024-09-19T05:45:54.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 -- 172.21.15.67:0/1045214074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 msgr2=0x7f6f7814d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:54.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 0x7f6f7814d560 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800d620 tx=0x7f6f6800dae0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 -- 172.21.15.67:0/1045214074 shutdown_connections 2024-09-19T05:45:54.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7815d1d0 0x7f6f7814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f7815c030 0x7f6f7814d560 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f580678c0 0x7f6f58069d80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 --2- 172.21.15.67:0/1045214074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f780b3510 0x7f6f7815f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:54.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 -- 172.21.15.67:0/1045214074 >> 172.21.15.67:0/1045214074 conn(0x7f6f780d0080 msgr2=0x7f6f780afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:54.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 -- 172.21.15.67:0/1045214074 shutdown_connections 2024-09-19T05:45:54.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54.838+0000 7f6f7d379640 1 -- 172.21.15.67:0/1045214074 wait complete. 2024-09-19T05:45:54.853 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:54.853 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:54.853 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.0 2024-09-19T05:45:54.854 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:54.854 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:54.854 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:54.854 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:54.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:54.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:54.933 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:54.933 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123131 s, 85.2 MB/s 2024-09-19T05:45:54.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:54.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:54.951 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154125 s, 68.0 MB/s 2024-09-19T05:45:54.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:54.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:54.970 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156254 s, 67.1 MB/s 2024-09-19T05:45:54.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:54.985 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:54.985 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121031 s, 86.6 MB/s 2024-09-19T05:45:55.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.003 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151135 s, 69.4 MB/s 2024-09-19T05:45:55.020 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.020 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.021 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142276 s, 73.7 MB/s 2024-09-19T05:45:55.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.037 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130452 s, 80.4 MB/s 2024-09-19T05:45:55.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.054 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136365 s, 76.9 MB/s 2024-09-19T05:45:55.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.070 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.070 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012314 s, 85.2 MB/s 2024-09-19T05:45:55.087 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.087 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.087 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144188 s, 72.7 MB/s 2024-09-19T05:45:55.103 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.103 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.103 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129978 s, 80.7 MB/s 2024-09-19T05:45:55.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.121 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141281 s, 74.2 MB/s 2024-09-19T05:45:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124866 s, 84.0 MB/s 2024-09-19T05:45:55.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.153 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138815 s, 75.5 MB/s 2024-09-19T05:45:55.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113145 s, 92.7 MB/s 2024-09-19T05:45:55.184 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.185 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142672 s, 73.5 MB/s 2024-09-19T05:45:55.200 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.200 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.200 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119195 s, 88.0 MB/s 2024-09-19T05:45:55.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.217 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139849 s, 75.0 MB/s 2024-09-19T05:45:55.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.235 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140639 s, 74.6 MB/s 2024-09-19T05:45:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111765 s, 93.8 MB/s 2024-09-19T05:45:55.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.266 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136246 s, 77.0 MB/s 2024-09-19T05:45:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168652 s, 62.2 MB/s 2024-09-19T05:45:55.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.306 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150503 s, 69.7 MB/s 2024-09-19T05:45:55.323 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.323 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.323 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127384 s, 82.3 MB/s 2024-09-19T05:45:55.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.342 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143439 s, 73.1 MB/s 2024-09-19T05:45:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128978 s, 81.3 MB/s 2024-09-19T05:45:55.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.378 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138856 s, 75.5 MB/s 2024-09-19T05:45:55.394 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.395 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128812 s, 81.4 MB/s 2024-09-19T05:45:55.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.413 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147922 s, 70.9 MB/s 2024-09-19T05:45:55.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.432 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150682 s, 69.6 MB/s 2024-09-19T05:45:55.448 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.449 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133218 s, 78.7 MB/s 2024-09-19T05:45:55.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.467 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151975 s, 69.0 MB/s 2024-09-19T05:45:55.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:55.477 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:55.477 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:55.477 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.1 2024-09-19T05:45:55.477 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:55.477 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:55.477 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:55.477 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:55.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:55.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.541 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957846 s, 109 MB/s 2024-09-19T05:45:55.558 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.558 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.558 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137359 s, 76.3 MB/s 2024-09-19T05:45:55.573 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.573 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.573 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123469 s, 84.9 MB/s 2024-09-19T05:45:55.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136803 s, 76.6 MB/s 2024-09-19T05:45:55.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.605 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114353 s, 91.7 MB/s 2024-09-19T05:45:55.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136644 s, 76.7 MB/s 2024-09-19T05:45:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.637 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125475 s, 83.6 MB/s 2024-09-19T05:45:55.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.654 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.654 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138751 s, 75.6 MB/s 2024-09-19T05:45:55.670 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.670 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.670 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131767 s, 79.6 MB/s 2024-09-19T05:45:55.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.686 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133116 s, 78.8 MB/s 2024-09-19T05:45:55.701 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.701 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.701 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117673 s, 89.1 MB/s 2024-09-19T05:45:55.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.715 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111124 s, 94.4 MB/s 2024-09-19T05:45:55.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.728 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988916 s, 106 MB/s 2024-09-19T05:45:55.746 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.746 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.746 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144439 s, 72.6 MB/s 2024-09-19T05:45:55.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.759 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994817 s, 105 MB/s 2024-09-19T05:45:55.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.773 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112771 s, 93.0 MB/s 2024-09-19T05:45:55.788 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.789 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.789 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125225 s, 83.7 MB/s 2024-09-19T05:45:55.803 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.803 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.803 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111947 s, 93.7 MB/s 2024-09-19T05:45:55.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.820 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141367 s, 74.2 MB/s 2024-09-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149189 s, 70.3 MB/s 2024-09-19T05:45:55.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.859 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147544 s, 71.1 MB/s 2024-09-19T05:45:55.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.877 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129813 s, 80.8 MB/s 2024-09-19T05:45:55.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.896 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.896 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142482 s, 73.6 MB/s 2024-09-19T05:45:55.912 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.913 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125762 s, 83.4 MB/s 2024-09-19T05:45:55.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.930 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131671 s, 79.6 MB/s 2024-09-19T05:45:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108133 s, 97.0 MB/s 2024-09-19T05:45:55.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.961 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132582 s, 79.1 MB/s 2024-09-19T05:45:55.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.977 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128453 s, 81.6 MB/s 2024-09-19T05:45:55.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:55.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:55.994 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137415 s, 76.3 MB/s 2024-09-19T05:45:56.010 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.010 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.010 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122005 s, 85.9 MB/s 2024-09-19T05:45:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152292 s, 68.9 MB/s 2024-09-19T05:45:56.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.044 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129061 s, 81.2 MB/s 2024-09-19T05:45:56.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:56.053 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:56.053 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:56.053 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.2 2024-09-19T05:45:56.053 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:56.053 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:56.053 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:56.053 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:56.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:56.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.167 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113151 s, 92.7 MB/s 2024-09-19T05:45:56.184 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.185 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142157 s, 73.8 MB/s 2024-09-19T05:45:56.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.200 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01197 s, 87.6 MB/s 2024-09-19T05:45:56.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.215 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125288 s, 83.7 MB/s 2024-09-19T05:45:56.230 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.230 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.230 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120777 s, 86.8 MB/s 2024-09-19T05:45:56.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.245 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122362 s, 85.7 MB/s 2024-09-19T05:45:56.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.263 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116161 s, 90.3 MB/s 2024-09-19T05:45:56.274 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.274 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.274 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108411 s, 96.7 MB/s 2024-09-19T05:45:56.288 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107267 s, 97.8 MB/s 2024-09-19T05:45:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114914 s, 91.2 MB/s 2024-09-19T05:45:56.319 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.320 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132683 s, 79.0 MB/s 2024-09-19T05:45:56.337 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.337 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.337 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126291 s, 83.0 MB/s 2024-09-19T05:45:56.355 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.355 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.355 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142363 s, 73.7 MB/s 2024-09-19T05:45:56.371 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.371 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.371 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122162 s, 85.8 MB/s 2024-09-19T05:45:56.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.388 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011756 s, 89.2 MB/s 2024-09-19T05:45:56.403 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.403 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121177 s, 86.5 MB/s 2024-09-19T05:45:56.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.422 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137379 s, 76.3 MB/s 2024-09-19T05:45:56.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.438 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125662 s, 83.4 MB/s 2024-09-19T05:45:56.454 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.454 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.454 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126948 s, 82.6 MB/s 2024-09-19T05:45:56.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.472 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130207 s, 80.5 MB/s 2024-09-19T05:45:56.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.489 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126087 s, 83.2 MB/s 2024-09-19T05:45:56.505 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.505 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.505 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119807 s, 87.5 MB/s 2024-09-19T05:45:56.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.524 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014862 s, 70.6 MB/s 2024-09-19T05:45:56.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.542 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130196 s, 80.5 MB/s 2024-09-19T05:45:56.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.559 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131693 s, 79.6 MB/s 2024-09-19T05:45:56.576 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.577 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144786 s, 72.4 MB/s 2024-09-19T05:45:56.592 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.592 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.592 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117469 s, 89.3 MB/s 2024-09-19T05:45:56.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.609 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142429 s, 73.6 MB/s 2024-09-19T05:45:56.623 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.623 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.623 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107442 s, 97.6 MB/s 2024-09-19T05:45:56.639 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.639 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.639 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127227 s, 82.4 MB/s 2024-09-19T05:45:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115442 s, 90.8 MB/s 2024-09-19T05:45:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142278 s, 73.7 MB/s 2024-09-19T05:45:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:56.679 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:56.679 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:56.680 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.3 2024-09-19T05:45:56.680 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:56.680 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:56.680 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:56.680 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:56.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:56.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.738 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945951 s, 111 MB/s 2024-09-19T05:45:56.752 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.752 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.753 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011521 s, 91.0 MB/s 2024-09-19T05:45:56.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.765 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102364 s, 102 MB/s 2024-09-19T05:45:56.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.781 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127313 s, 82.4 MB/s 2024-09-19T05:45:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.795 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.795 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109892 s, 95.4 MB/s 2024-09-19T05:45:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110537 s, 94.9 MB/s 2024-09-19T05:45:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126193 s, 83.1 MB/s 2024-09-19T05:45:56.838 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.838 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.838 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111904 s, 93.7 MB/s 2024-09-19T05:45:56.852 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.853 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118045 s, 88.8 MB/s 2024-09-19T05:45:56.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.867 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.867 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114761 s, 91.4 MB/s 2024-09-19T05:45:56.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.880 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107766 s, 97.3 MB/s 2024-09-19T05:45:56.894 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.894 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.894 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115139 s, 91.1 MB/s 2024-09-19T05:45:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.907 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982419 s, 107 MB/s 2024-09-19T05:45:56.921 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.921 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.922 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118111 s, 88.8 MB/s 2024-09-19T05:45:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136118 s, 77.0 MB/s 2024-09-19T05:45:56.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.952 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104296 s, 101 MB/s 2024-09-19T05:45:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.966 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114903 s, 91.3 MB/s 2024-09-19T05:45:56.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.979 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105281 s, 99.6 MB/s 2024-09-19T05:45:56.992 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:56.992 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:56.992 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965395 s, 109 MB/s 2024-09-19T05:45:57.006 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114479 s, 91.6 MB/s 2024-09-19T05:45:57.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.023 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130128 s, 80.6 MB/s 2024-09-19T05:45:57.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128125 s, 81.8 MB/s 2024-09-19T05:45:57.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.056 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.056 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130307 s, 80.5 MB/s 2024-09-19T05:45:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.072 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133182 s, 78.7 MB/s 2024-09-19T05:45:57.088 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.089 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.089 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137518 s, 76.3 MB/s 2024-09-19T05:45:57.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.103 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010922 s, 96.0 MB/s 2024-09-19T05:45:57.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.122 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152711 s, 68.7 MB/s 2024-09-19T05:45:57.139 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.140 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.140 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013962 s, 75.1 MB/s 2024-09-19T05:45:57.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.159 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149871 s, 70.0 MB/s 2024-09-19T05:45:57.178 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.178 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.179 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153637 s, 68.3 MB/s 2024-09-19T05:45:57.194 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.195 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.195 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131119 s, 80.0 MB/s 2024-09-19T05:45:57.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.215 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141606 s, 74.0 MB/s 2024-09-19T05:45:57.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:57.222 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:57.222 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:57.222 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.4 2024-09-19T05:45:57.222 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:57.222 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:57.222 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:57.222 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:57.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:57.335 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.336 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138543 s, 75.7 MB/s 2024-09-19T05:45:57.351 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.351 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.351 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121507 s, 86.3 MB/s 2024-09-19T05:45:57.367 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.368 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.368 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134963 s, 77.7 MB/s 2024-09-19T05:45:57.384 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137381 s, 76.3 MB/s 2024-09-19T05:45:57.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.400 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125403 s, 83.6 MB/s 2024-09-19T05:45:57.417 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.417 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.417 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132995 s, 78.8 MB/s 2024-09-19T05:45:57.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.433 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.433 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120514 s, 87.0 MB/s 2024-09-19T05:45:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125479 s, 83.6 MB/s 2024-09-19T05:45:57.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.465 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133304 s, 78.7 MB/s 2024-09-19T05:45:57.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.481 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127053 s, 82.5 MB/s 2024-09-19T05:45:57.497 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.497 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.497 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116635 s, 89.9 MB/s 2024-09-19T05:45:57.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.514 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128424 s, 81.6 MB/s 2024-09-19T05:45:57.531 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.531 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.531 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137493 s, 76.3 MB/s 2024-09-19T05:45:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.547 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012641 s, 83.0 MB/s 2024-09-19T05:45:57.562 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.562 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.563 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115552 s, 90.7 MB/s 2024-09-19T05:45:57.578 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.579 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127859 s, 82.0 MB/s 2024-09-19T05:45:57.594 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.595 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.595 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119147 s, 88.0 MB/s 2024-09-19T05:45:57.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.609 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113704 s, 92.2 MB/s 2024-09-19T05:45:57.623 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.623 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.624 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114989 s, 91.2 MB/s 2024-09-19T05:45:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129735 s, 80.8 MB/s 2024-09-19T05:45:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121941 s, 86.0 MB/s 2024-09-19T05:45:57.670 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.670 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.670 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118332 s, 88.6 MB/s 2024-09-19T05:45:57.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.686 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132904 s, 78.9 MB/s 2024-09-19T05:45:57.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.702 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132004 s, 79.4 MB/s 2024-09-19T05:45:57.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.720 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013238 s, 79.2 MB/s 2024-09-19T05:45:57.736 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.736 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.736 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123657 s, 84.8 MB/s 2024-09-19T05:45:57.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.749 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114534 s, 91.6 MB/s 2024-09-19T05:45:57.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.766 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.766 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136036 s, 77.1 MB/s 2024-09-19T05:45:57.783 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.783 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.783 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134567 s, 77.9 MB/s 2024-09-19T05:45:57.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.802 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147936 s, 70.9 MB/s 2024-09-19T05:45:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139084 s, 75.4 MB/s 2024-09-19T05:45:57.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.837 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139975 s, 74.9 MB/s 2024-09-19T05:45:57.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:57.846 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:57.846 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:57.846 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.5 2024-09-19T05:45:57.846 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:57.846 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:57.846 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:57.846 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:57.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:57.920 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.920 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.920 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152886 s, 68.6 MB/s 2024-09-19T05:45:57.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.939 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149172 s, 70.3 MB/s 2024-09-19T05:45:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128625 s, 81.5 MB/s 2024-09-19T05:45:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141461 s, 74.1 MB/s 2024-09-19T05:45:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014626 s, 71.7 MB/s 2024-09-19T05:45:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.009 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151102 s, 69.4 MB/s 2024-09-19T05:45:58.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.024 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123638 s, 84.8 MB/s 2024-09-19T05:45:58.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.041 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140402 s, 74.7 MB/s 2024-09-19T05:45:58.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.055 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.055 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112331 s, 93.3 MB/s 2024-09-19T05:45:58.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.072 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138552 s, 75.7 MB/s 2024-09-19T05:45:58.090 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.090 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.090 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145257 s, 72.2 MB/s 2024-09-19T05:45:58.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.108 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138954 s, 75.5 MB/s 2024-09-19T05:45:58.123 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.123 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.123 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118539 s, 88.5 MB/s 2024-09-19T05:45:58.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.141 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144358 s, 72.6 MB/s 2024-09-19T05:45:58.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.156 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117755 s, 89.0 MB/s 2024-09-19T05:45:58.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.171 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116555 s, 90.0 MB/s 2024-09-19T05:45:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105123 s, 99.7 MB/s 2024-09-19T05:45:58.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.203 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140712 s, 74.5 MB/s 2024-09-19T05:45:58.221 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.221 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.221 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145536 s, 72.0 MB/s 2024-09-19T05:45:58.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.238 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128014 s, 81.9 MB/s 2024-09-19T05:45:58.254 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.254 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.254 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127628 s, 82.2 MB/s 2024-09-19T05:45:58.271 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.271 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.271 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130798 s, 80.2 MB/s 2024-09-19T05:45:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127425 s, 82.3 MB/s 2024-09-19T05:45:58.304 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.304 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.305 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132011 s, 79.4 MB/s 2024-09-19T05:45:58.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.321 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122272 s, 85.8 MB/s 2024-09-19T05:45:58.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.340 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151813 s, 69.1 MB/s 2024-09-19T05:45:58.356 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.357 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129661 s, 80.9 MB/s 2024-09-19T05:45:58.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.374 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134322 s, 78.1 MB/s 2024-09-19T05:45:58.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.392 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137825 s, 76.1 MB/s 2024-09-19T05:45:58.407 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.408 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.408 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012139 s, 86.4 MB/s 2024-09-19T05:45:58.425 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.426 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135031 s, 77.7 MB/s 2024-09-19T05:45:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156929 s, 66.8 MB/s 2024-09-19T05:45:58.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:58.454 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:58.455 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:58.455 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.6 2024-09-19T05:45:58.455 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:58.455 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:58.455 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:58.455 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:58.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:58.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.526 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119191 s, 88.0 MB/s 2024-09-19T05:45:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.540 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112928 s, 92.9 MB/s 2024-09-19T05:45:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.558 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.558 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140529 s, 74.6 MB/s 2024-09-19T05:45:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969063 s, 108 MB/s 2024-09-19T05:45:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961543 s, 109 MB/s 2024-09-19T05:45:58.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.600 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012944 s, 81.0 MB/s 2024-09-19T05:45:58.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.617 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132755 s, 79.0 MB/s 2024-09-19T05:45:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016284 s, 64.4 MB/s 2024-09-19T05:45:58.655 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.655 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.655 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132772 s, 79.0 MB/s 2024-09-19T05:45:58.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.675 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140909 s, 74.4 MB/s 2024-09-19T05:45:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119001 s, 88.1 MB/s 2024-09-19T05:45:58.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.718 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143481 s, 73.1 MB/s 2024-09-19T05:45:58.729 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118871 s, 88.2 MB/s 2024-09-19T05:45:58.747 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.747 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.747 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123005 s, 85.2 MB/s 2024-09-19T05:45:58.767 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.767 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.767 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134859 s, 77.8 MB/s 2024-09-19T05:45:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119435 s, 87.8 MB/s 2024-09-19T05:45:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122234 s, 85.8 MB/s 2024-09-19T05:45:58.819 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.819 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.819 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012922 s, 81.1 MB/s 2024-09-19T05:45:58.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.837 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135294 s, 77.5 MB/s 2024-09-19T05:45:58.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.854 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013545 s, 77.4 MB/s 2024-09-19T05:45:58.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.872 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133177 s, 78.7 MB/s 2024-09-19T05:45:58.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.889 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.889 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122043 s, 85.9 MB/s 2024-09-19T05:45:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012834 s, 81.7 MB/s 2024-09-19T05:45:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013524 s, 77.5 MB/s 2024-09-19T05:45:58.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136992 s, 76.5 MB/s 2024-09-19T05:45:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130165 s, 80.6 MB/s 2024-09-19T05:45:58.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.973 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108193 s, 96.9 MB/s 2024-09-19T05:45:58.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:58.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:58.987 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109086 s, 96.1 MB/s 2024-09-19T05:45:59.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.003 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124066 s, 84.5 MB/s 2024-09-19T05:45:59.019 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.020 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.020 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123036 s, 85.2 MB/s 2024-09-19T05:45:59.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.039 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141001 s, 74.4 MB/s 2024-09-19T05:45:59.059 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.059 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.059 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145739 s, 71.9 MB/s 2024-09-19T05:45:59.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:59.068 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:59.068 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:59.068 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.7 2024-09-19T05:45:59.068 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:59.068 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:59.068 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:59.068 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:59.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:59.140 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.140 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.140 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120683 s, 86.9 MB/s 2024-09-19T05:45:59.154 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.154 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.154 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108757 s, 96.4 MB/s 2024-09-19T05:45:59.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.167 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924173 s, 113 MB/s 2024-09-19T05:45:59.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.182 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011476 s, 91.4 MB/s 2024-09-19T05:45:59.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.201 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.201 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116495 s, 90.0 MB/s 2024-09-19T05:45:59.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.213 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119639 s, 87.6 MB/s 2024-09-19T05:45:59.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.226 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955365 s, 110 MB/s 2024-09-19T05:45:59.239 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.239 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.239 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918723 s, 114 MB/s 2024-09-19T05:45:59.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.251 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091195 s, 115 MB/s 2024-09-19T05:45:59.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.267 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011289 s, 92.9 MB/s 2024-09-19T05:45:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118175 s, 88.7 MB/s 2024-09-19T05:45:59.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.298 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117457 s, 89.3 MB/s 2024-09-19T05:45:59.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.312 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105654 s, 99.2 MB/s 2024-09-19T05:45:59.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.328 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012103 s, 86.6 MB/s 2024-09-19T05:45:59.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.344 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120023 s, 87.4 MB/s 2024-09-19T05:45:59.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.360 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129747 s, 80.8 MB/s 2024-09-19T05:45:59.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.378 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139236 s, 75.3 MB/s 2024-09-19T05:45:59.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.392 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103159 s, 102 MB/s 2024-09-19T05:45:59.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095048 s, 110 MB/s 2024-09-19T05:45:59.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.419 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115149 s, 91.1 MB/s 2024-09-19T05:45:59.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.432 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899274 s, 117 MB/s 2024-09-19T05:45:59.450 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.450 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.450 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141728 s, 74.0 MB/s 2024-09-19T05:45:59.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.466 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011919 s, 88.0 MB/s 2024-09-19T05:45:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127989 s, 81.9 MB/s 2024-09-19T05:45:59.496 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.497 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.497 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108016 s, 97.1 MB/s 2024-09-19T05:45:59.510 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.511 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.511 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101844 s, 103 MB/s 2024-09-19T05:45:59.526 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.526 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.526 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122254 s, 85.8 MB/s 2024-09-19T05:45:59.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.542 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119119 s, 88.0 MB/s 2024-09-19T05:45:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130729 s, 80.2 MB/s 2024-09-19T05:45:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123798 s, 84.7 MB/s 2024-09-19T05:45:59.591 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.591 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.591 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115838 s, 90.5 MB/s 2024-09-19T05:45:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117651 s, 89.1 MB/s 2024-09-19T05:45:59.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:45:59.615 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:45:59.616 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:45:59.616 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.8 2024-09-19T05:45:59.616 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:45:59.616 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:45:59.616 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:45:59.616 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:45:59.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:45:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:45:59.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.687 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.687 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114896 s, 91.3 MB/s 2024-09-19T05:45:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951696 s, 110 MB/s 2024-09-19T05:45:59.714 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.714 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.714 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115166 s, 91.0 MB/s 2024-09-19T05:45:59.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.730 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127821 s, 82.0 MB/s 2024-09-19T05:45:59.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914008 s, 115 MB/s 2024-09-19T05:45:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.757 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106255 s, 98.7 MB/s 2024-09-19T05:45:59.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.771 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.771 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102801 s, 102 MB/s 2024-09-19T05:45:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111682 s, 93.9 MB/s 2024-09-19T05:45:59.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.798 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887518 s, 118 MB/s 2024-09-19T05:45:59.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.811 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986853 s, 106 MB/s 2024-09-19T05:45:59.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.826 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115814 s, 90.5 MB/s 2024-09-19T05:45:59.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.842 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123891 s, 84.6 MB/s 2024-09-19T05:45:59.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.858 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.858 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125205 s, 83.7 MB/s 2024-09-19T05:45:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117457 s, 89.3 MB/s 2024-09-19T05:45:59.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.888 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928146 s, 113 MB/s 2024-09-19T05:45:59.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.901 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112289 s, 93.4 MB/s 2024-09-19T05:45:59.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923841 s, 114 MB/s 2024-09-19T05:45:59.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.931 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136393 s, 76.9 MB/s 2024-09-19T05:45:59.947 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.948 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132293 s, 79.3 MB/s 2024-09-19T05:45:59.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.962 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.962 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101718 s, 103 MB/s 2024-09-19T05:45:59.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.976 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101132 s, 104 MB/s 2024-09-19T05:45:59.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:45:59.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:45:59.993 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138149 s, 75.9 MB/s 2024-09-19T05:46:00.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.007 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105731 s, 99.2 MB/s 2024-09-19T05:46:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103978 s, 101 MB/s 2024-09-19T05:46:00.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.036 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111548 s, 94.0 MB/s 2024-09-19T05:46:00.052 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.052 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.052 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126515 s, 82.9 MB/s 2024-09-19T05:46:00.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.069 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129936 s, 80.7 MB/s 2024-09-19T05:46:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.084 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117865 s, 89.0 MB/s 2024-09-19T05:46:00.099 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.099 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.099 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117158 s, 89.5 MB/s 2024-09-19T05:46:00.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.112 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956702 s, 110 MB/s 2024-09-19T05:46:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966715 s, 108 MB/s 2024-09-19T05:46:00.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.137 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084916 s, 123 MB/s 2024-09-19T05:46:00.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:00.145 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:00.145 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:00.145 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.9 2024-09-19T05:46:00.145 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:00.145 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:00.146 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:00.146 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:00.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:00.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.215 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117397 s, 89.3 MB/s 2024-09-19T05:46:00.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.228 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951099 s, 110 MB/s 2024-09-19T05:46:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129136 s, 81.2 MB/s 2024-09-19T05:46:00.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.258 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113115 s, 92.7 MB/s 2024-09-19T05:46:00.271 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.271 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.271 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103679 s, 101 MB/s 2024-09-19T05:46:00.284 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.285 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01071 s, 97.9 MB/s 2024-09-19T05:46:00.299 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.299 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.299 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115721 s, 90.6 MB/s 2024-09-19T05:46:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.312 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106876 s, 98.1 MB/s 2024-09-19T05:46:00.325 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.325 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.325 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892137 s, 118 MB/s 2024-09-19T05:46:00.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.340 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.341 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132527 s, 79.1 MB/s 2024-09-19T05:46:00.353 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.354 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.354 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107478 s, 97.6 MB/s 2024-09-19T05:46:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014669 s, 71.5 MB/s 2024-09-19T05:46:00.382 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983006 s, 107 MB/s 2024-09-19T05:46:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797749 s, 131 MB/s 2024-09-19T05:46:00.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797545 s, 131 MB/s 2024-09-19T05:46:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109161 s, 96.1 MB/s 2024-09-19T05:46:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.430 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010531 s, 99.6 MB/s 2024-09-19T05:46:00.444 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.444 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.444 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110949 s, 94.5 MB/s 2024-09-19T05:46:00.457 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.457 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.457 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104889 s, 100 MB/s 2024-09-19T05:46:00.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.467 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00806677 s, 130 MB/s 2024-09-19T05:46:00.484 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.484 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.484 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143954 s, 72.8 MB/s 2024-09-19T05:46:00.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.495 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00811064 s, 129 MB/s 2024-09-19T05:46:00.505 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.505 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.506 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00818014 s, 128 MB/s 2024-09-19T05:46:00.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.518 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010251 s, 102 MB/s 2024-09-19T05:46:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119878 s, 87.5 MB/s 2024-09-19T05:46:00.543 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.543 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.543 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079903 s, 131 MB/s 2024-09-19T05:46:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.554 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778738 s, 135 MB/s 2024-09-19T05:46:00.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.567 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109182 s, 96.0 MB/s 2024-09-19T05:46:00.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.580 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101198 s, 104 MB/s 2024-09-19T05:46:00.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789215 s, 133 MB/s 2024-09-19T05:46:00.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.603 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998662 s, 105 MB/s 2024-09-19T05:46:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956218 s, 110 MB/s 2024-09-19T05:46:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:00.622 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:00.622 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:00.622 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.10 2024-09-19T05:46:00.622 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:00.622 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:00.623 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:00.623 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:00.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.680 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905814 s, 116 MB/s 2024-09-19T05:46:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.691 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856437 s, 122 MB/s 2024-09-19T05:46:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.705 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113372 s, 92.5 MB/s 2024-09-19T05:46:00.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.718 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109421 s, 95.8 MB/s 2024-09-19T05:46:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873359 s, 120 MB/s 2024-09-19T05:46:00.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.744 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108299 s, 96.8 MB/s 2024-09-19T05:46:00.758 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.758 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.759 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122271 s, 85.8 MB/s 2024-09-19T05:46:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011681 s, 89.8 MB/s 2024-09-19T05:46:00.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.786 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104389 s, 100 MB/s 2024-09-19T05:46:00.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.798 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959624 s, 109 MB/s 2024-09-19T05:46:00.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.810 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00893446 s, 117 MB/s 2024-09-19T05:46:00.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.825 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126 s, 83.2 MB/s 2024-09-19T05:46:00.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.840 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109249 s, 96.0 MB/s 2024-09-19T05:46:00.852 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.853 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112377 s, 93.3 MB/s 2024-09-19T05:46:00.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.866 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105889 s, 99.0 MB/s 2024-09-19T05:46:00.882 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.882 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.882 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128465 s, 81.6 MB/s 2024-09-19T05:46:00.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.893 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.893 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871882 s, 120 MB/s 2024-09-19T05:46:00.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.909 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.909 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129288 s, 81.1 MB/s 2024-09-19T05:46:00.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.924 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.924 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117941 s, 88.9 MB/s 2024-09-19T05:46:00.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.940 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127199 s, 82.4 MB/s 2024-09-19T05:46:00.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.954 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011185 s, 93.7 MB/s 2024-09-19T05:46:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011637 s, 90.1 MB/s 2024-09-19T05:46:00.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.982 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107007 s, 98.0 MB/s 2024-09-19T05:46:00.996 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:00.997 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:00.997 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122992 s, 85.3 MB/s 2024-09-19T05:46:01.011 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.011 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.012 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118347 s, 88.6 MB/s 2024-09-19T05:46:01.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.027 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131918 s, 79.5 MB/s 2024-09-19T05:46:01.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.042 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112163 s, 93.5 MB/s 2024-09-19T05:46:01.058 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.058 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.058 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140453 s, 74.7 MB/s 2024-09-19T05:46:01.074 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.074 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.074 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131755 s, 79.6 MB/s 2024-09-19T05:46:01.089 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.089 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.089 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120402 s, 87.1 MB/s 2024-09-19T05:46:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112688 s, 93.1 MB/s 2024-09-19T05:46:01.119 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.119 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.119 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133783 s, 78.4 MB/s 2024-09-19T05:46:01.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:01.127 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:01.127 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:01.128 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.11 2024-09-19T05:46:01.128 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:01.128 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:01.128 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:01.128 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:01.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:01.238 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.238 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.238 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012856 s, 81.6 MB/s 2024-09-19T05:46:01.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.251 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102662 s, 102 MB/s 2024-09-19T05:46:01.265 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.265 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.266 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011432 s, 91.7 MB/s 2024-09-19T05:46:01.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.282 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.282 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138926 s, 75.5 MB/s 2024-09-19T05:46:01.296 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.296 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.296 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106681 s, 98.3 MB/s 2024-09-19T05:46:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.311 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012593 s, 83.3 MB/s 2024-09-19T05:46:01.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.326 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122928 s, 85.3 MB/s 2024-09-19T05:46:01.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.340 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994883 s, 105 MB/s 2024-09-19T05:46:01.353 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.353 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.354 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113726 s, 92.2 MB/s 2024-09-19T05:46:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135958 s, 77.1 MB/s 2024-09-19T05:46:01.385 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.385 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.385 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012627 s, 83.0 MB/s 2024-09-19T05:46:01.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012179 s, 86.1 MB/s 2024-09-19T05:46:01.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.417 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132194 s, 79.3 MB/s 2024-09-19T05:46:01.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.431 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120124 s, 87.3 MB/s 2024-09-19T05:46:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103868 s, 101 MB/s 2024-09-19T05:46:01.458 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.458 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.458 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106842 s, 98.1 MB/s 2024-09-19T05:46:01.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.473 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121713 s, 86.2 MB/s 2024-09-19T05:46:01.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.491 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130162 s, 80.6 MB/s 2024-09-19T05:46:01.508 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.508 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.508 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106365 s, 98.6 MB/s 2024-09-19T05:46:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118917 s, 88.2 MB/s 2024-09-19T05:46:01.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.536 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114648 s, 91.5 MB/s 2024-09-19T05:46:01.548 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.548 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.548 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879525 s, 119 MB/s 2024-09-19T05:46:01.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.561 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108042 s, 97.1 MB/s 2024-09-19T05:46:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113951 s, 92.0 MB/s 2024-09-19T05:46:01.587 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.588 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.588 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967096 s, 108 MB/s 2024-09-19T05:46:01.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130337 s, 80.5 MB/s 2024-09-19T05:46:01.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906813 s, 116 MB/s 2024-09-19T05:46:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.630 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115142 s, 91.1 MB/s 2024-09-19T05:46:01.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.644 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119295 s, 87.9 MB/s 2024-09-19T05:46:01.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.657 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989125 s, 106 MB/s 2024-09-19T05:46:01.670 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.671 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.671 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110364 s, 95.0 MB/s 2024-09-19T05:46:01.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.685 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121186 s, 86.5 MB/s 2024-09-19T05:46:01.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:01.693 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:01.694 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:01.694 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.12 2024-09-19T05:46:01.694 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:01.694 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:01.694 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:01.694 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:01.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:01.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.760 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.760 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112129 s, 93.5 MB/s 2024-09-19T05:46:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.770 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787653 s, 133 MB/s 2024-09-19T05:46:01.783 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.783 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.783 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108167 s, 96.9 MB/s 2024-09-19T05:46:01.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.797 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112548 s, 93.2 MB/s 2024-09-19T05:46:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.808 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870101 s, 121 MB/s 2024-09-19T05:46:01.818 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.818 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.818 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810707 s, 129 MB/s 2024-09-19T05:46:01.829 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.829 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.829 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858681 s, 122 MB/s 2024-09-19T05:46:01.840 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.840 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.840 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826528 s, 127 MB/s 2024-09-19T05:46:01.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.853 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103983 s, 101 MB/s 2024-09-19T05:46:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122858 s, 85.3 MB/s 2024-09-19T05:46:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120476 s, 87.0 MB/s 2024-09-19T05:46:01.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.898 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.898 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118088 s, 88.8 MB/s 2024-09-19T05:46:01.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.913 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128997 s, 81.3 MB/s 2024-09-19T05:46:01.926 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.926 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.926 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960152 s, 109 MB/s 2024-09-19T05:46:01.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122193 s, 85.8 MB/s 2024-09-19T05:46:01.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.955 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011592 s, 90.5 MB/s 2024-09-19T05:46:01.971 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.971 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.971 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132163 s, 79.3 MB/s 2024-09-19T05:46:01.986 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:01.986 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:01.987 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119559 s, 87.7 MB/s 2024-09-19T05:46:02.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.002 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121882 s, 86.0 MB/s 2024-09-19T05:46:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110072 s, 95.3 MB/s 2024-09-19T05:46:02.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.031 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127916 s, 82.0 MB/s 2024-09-19T05:46:02.045 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.046 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.046 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114972 s, 91.2 MB/s 2024-09-19T05:46:02.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.057 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886223 s, 118 MB/s 2024-09-19T05:46:02.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.069 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929161 s, 113 MB/s 2024-09-19T05:46:02.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.081 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913254 s, 115 MB/s 2024-09-19T05:46:02.092 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.092 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.092 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00808806 s, 130 MB/s 2024-09-19T05:46:02.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.106 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112613 s, 93.1 MB/s 2024-09-19T05:46:02.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.121 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115895 s, 90.5 MB/s 2024-09-19T05:46:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925879 s, 113 MB/s 2024-09-19T05:46:02.148 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.148 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.148 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118391 s, 88.6 MB/s 2024-09-19T05:46:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.163 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120183 s, 87.2 MB/s 2024-09-19T05:46:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114859 s, 91.3 MB/s 2024-09-19T05:46:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:02.185 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:02.185 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:02.185 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.13 2024-09-19T05:46:02.185 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:02.188 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:02.188 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:02.188 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:02.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:02.293 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.293 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.293 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119165 s, 88.0 MB/s 2024-09-19T05:46:02.310 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143434 s, 73.1 MB/s 2024-09-19T05:46:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.322 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.323 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852415 s, 123 MB/s 2024-09-19T05:46:02.335 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.335 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.335 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095827 s, 109 MB/s 2024-09-19T05:46:02.346 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.346 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.346 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815287 s, 129 MB/s 2024-09-19T05:46:02.360 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.361 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.361 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119338 s, 87.9 MB/s 2024-09-19T05:46:02.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.375 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107624 s, 97.4 MB/s 2024-09-19T05:46:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121799 s, 86.1 MB/s 2024-09-19T05:46:02.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116501 s, 90.0 MB/s 2024-09-19T05:46:02.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.421 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133802 s, 78.4 MB/s 2024-09-19T05:46:02.436 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.437 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124813 s, 84.0 MB/s 2024-09-19T05:46:02.450 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.451 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112949 s, 92.8 MB/s 2024-09-19T05:46:02.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.467 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130518 s, 80.3 MB/s 2024-09-19T05:46:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112844 s, 92.9 MB/s 2024-09-19T05:46:02.519 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.519 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.520 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116239 s, 90.2 MB/s 2024-09-19T05:46:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906063 s, 116 MB/s 2024-09-19T05:46:02.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.546 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.546 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01187 s, 88.3 MB/s 2024-09-19T05:46:02.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.561 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118593 s, 88.4 MB/s 2024-09-19T05:46:02.576 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.577 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.577 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127454 s, 82.3 MB/s 2024-09-19T05:46:02.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.589 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941855 s, 111 MB/s 2024-09-19T05:46:02.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.606 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.606 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126493 s, 82.9 MB/s 2024-09-19T05:46:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120622 s, 86.9 MB/s 2024-09-19T05:46:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141054 s, 74.3 MB/s 2024-09-19T05:46:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011556 s, 90.7 MB/s 2024-09-19T05:46:02.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.667 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110079 s, 95.3 MB/s 2024-09-19T05:46:02.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985536 s, 106 MB/s 2024-09-19T05:46:02.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.694 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108792 s, 96.4 MB/s 2024-09-19T05:46:02.709 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.709 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.709 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01244 s, 84.3 MB/s 2024-09-19T05:46:02.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.725 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125228 s, 83.7 MB/s 2024-09-19T05:46:02.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.741 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128573 s, 81.6 MB/s 2024-09-19T05:46:02.760 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.760 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.760 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147551 s, 71.1 MB/s 2024-09-19T05:46:02.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.778 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139583 s, 75.1 MB/s 2024-09-19T05:46:02.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:02.788 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:02.788 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:02.788 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.14 2024-09-19T05:46:02.788 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:02.788 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:02.788 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:02.788 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:02.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:02.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.853 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130275 s, 80.5 MB/s 2024-09-19T05:46:02.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.868 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122659 s, 85.5 MB/s 2024-09-19T05:46:02.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.881 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963902 s, 109 MB/s 2024-09-19T05:46:02.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.895 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108272 s, 96.8 MB/s 2024-09-19T05:46:02.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.914 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156651 s, 66.9 MB/s 2024-09-19T05:46:02.928 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.928 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.929 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114828 s, 91.3 MB/s 2024-09-19T05:46:02.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.945 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013372 s, 78.4 MB/s 2024-09-19T05:46:02.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.958 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106996 s, 98.0 MB/s 2024-09-19T05:46:02.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.975 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.975 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129558 s, 80.9 MB/s 2024-09-19T05:46:02.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:02.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:02.988 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110288 s, 95.1 MB/s 2024-09-19T05:46:03.004 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.004 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.004 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128767 s, 81.4 MB/s 2024-09-19T05:46:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.022 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146102 s, 71.8 MB/s 2024-09-19T05:46:03.035 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.035 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.035 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108068 s, 97.0 MB/s 2024-09-19T05:46:03.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.049 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010644 s, 98.5 MB/s 2024-09-19T05:46:03.064 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.064 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.064 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119627 s, 87.7 MB/s 2024-09-19T05:46:03.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.079 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122115 s, 85.9 MB/s 2024-09-19T05:46:03.093 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.093 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.093 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110104 s, 95.2 MB/s 2024-09-19T05:46:03.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.110 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137823 s, 76.1 MB/s 2024-09-19T05:46:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132638 s, 79.1 MB/s 2024-09-19T05:46:03.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.142 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113644 s, 92.3 MB/s 2024-09-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.160 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01257 s, 83.4 MB/s 2024-09-19T05:46:03.175 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.175 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.175 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116885 s, 89.7 MB/s 2024-09-19T05:46:03.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.190 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114284 s, 91.8 MB/s 2024-09-19T05:46:03.205 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.206 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125574 s, 83.5 MB/s 2024-09-19T05:46:03.219 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.220 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.220 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105995 s, 98.9 MB/s 2024-09-19T05:46:03.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.237 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135378 s, 77.5 MB/s 2024-09-19T05:46:03.252 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.252 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.252 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120194 s, 87.2 MB/s 2024-09-19T05:46:03.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.269 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134949 s, 77.7 MB/s 2024-09-19T05:46:03.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.284 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.284 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107366 s, 97.7 MB/s 2024-09-19T05:46:03.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.299 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118493 s, 88.5 MB/s 2024-09-19T05:46:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013854 s, 75.7 MB/s 2024-09-19T05:46:03.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954614 s, 110 MB/s 2024-09-19T05:46:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:03.337 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:03.337 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:03.337 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.15 2024-09-19T05:46:03.337 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:03.337 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:03.337 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:03.337 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:03.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:03.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.445 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117828 s, 89.0 MB/s 2024-09-19T05:46:03.461 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.462 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013591 s, 77.2 MB/s 2024-09-19T05:46:03.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.477 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119819 s, 87.5 MB/s 2024-09-19T05:46:03.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.494 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140328 s, 74.7 MB/s 2024-09-19T05:46:03.515 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.515 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.516 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112748 s, 93.0 MB/s 2024-09-19T05:46:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.529 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111424 s, 94.1 MB/s 2024-09-19T05:46:03.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.544 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120681 s, 86.9 MB/s 2024-09-19T05:46:03.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.560 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135099 s, 77.6 MB/s 2024-09-19T05:46:03.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.573 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.573 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914209 s, 115 MB/s 2024-09-19T05:46:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951999 s, 110 MB/s 2024-09-19T05:46:03.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.603 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.603 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139056 s, 75.4 MB/s 2024-09-19T05:46:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011181 s, 93.8 MB/s 2024-09-19T05:46:03.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.637 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145961 s, 71.8 MB/s 2024-09-19T05:46:03.652 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.652 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.652 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126127 s, 83.1 MB/s 2024-09-19T05:46:03.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.672 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154729 s, 67.8 MB/s 2024-09-19T05:46:03.689 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.689 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.689 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115708 s, 90.6 MB/s 2024-09-19T05:46:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.707 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129038 s, 81.3 MB/s 2024-09-19T05:46:03.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.722 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118678 s, 88.4 MB/s 2024-09-19T05:46:03.735 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.735 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.735 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966257 s, 109 MB/s 2024-09-19T05:46:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143346 s, 73.1 MB/s 2024-09-19T05:46:03.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.769 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133084 s, 78.8 MB/s 2024-09-19T05:46:03.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.786 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141381 s, 74.2 MB/s 2024-09-19T05:46:03.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.801 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011188 s, 93.7 MB/s 2024-09-19T05:46:03.818 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.818 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.818 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140886 s, 74.4 MB/s 2024-09-19T05:46:03.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.836 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130594 s, 80.3 MB/s 2024-09-19T05:46:03.850 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.851 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.851 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114711 s, 91.4 MB/s 2024-09-19T05:46:03.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.866 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128899 s, 81.3 MB/s 2024-09-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.884 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134281 s, 78.1 MB/s 2024-09-19T05:46:03.900 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.900 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.900 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124317 s, 84.3 MB/s 2024-09-19T05:46:03.916 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.916 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.916 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129209 s, 81.2 MB/s 2024-09-19T05:46:03.932 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.932 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.932 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130606 s, 80.3 MB/s 2024-09-19T05:46:03.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:03.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:03.948 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124636 s, 84.1 MB/s 2024-09-19T05:46:03.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:03.957 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:03.957 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:03.957 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.16 2024-09-19T05:46:03.957 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:03.957 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:03.957 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:03.957 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:04.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939254 s, 112 MB/s 2024-09-19T05:46:04.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.082 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145996 s, 71.8 MB/s 2024-09-19T05:46:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115921 s, 90.5 MB/s 2024-09-19T05:46:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125654 s, 83.4 MB/s 2024-09-19T05:46:04.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.130 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.130 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134254 s, 78.1 MB/s 2024-09-19T05:46:04.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.146 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134573 s, 77.9 MB/s 2024-09-19T05:46:04.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.160 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109546 s, 95.7 MB/s 2024-09-19T05:46:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123203 s, 85.1 MB/s 2024-09-19T05:46:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120955 s, 86.7 MB/s 2024-09-19T05:46:04.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.206 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131783 s, 79.6 MB/s 2024-09-19T05:46:04.220 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.220 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.220 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117706 s, 89.1 MB/s 2024-09-19T05:46:04.236 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.237 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.237 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135907 s, 77.2 MB/s 2024-09-19T05:46:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128837 s, 81.4 MB/s 2024-09-19T05:46:04.268 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.268 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.268 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125813 s, 83.3 MB/s 2024-09-19T05:46:04.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.285 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138007 s, 76.0 MB/s 2024-09-19T05:46:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124722 s, 84.1 MB/s 2024-09-19T05:46:04.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.319 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.319 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146523 s, 71.6 MB/s 2024-09-19T05:46:04.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.334 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127094 s, 82.5 MB/s 2024-09-19T05:46:04.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.349 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115074 s, 91.1 MB/s 2024-09-19T05:46:04.365 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.365 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.365 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132302 s, 79.3 MB/s 2024-09-19T05:46:04.380 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.381 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124969 s, 83.9 MB/s 2024-09-19T05:46:04.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.397 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136793 s, 76.7 MB/s 2024-09-19T05:46:04.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.414 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.414 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130896 s, 80.1 MB/s 2024-09-19T05:46:04.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.429 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128593 s, 81.5 MB/s 2024-09-19T05:46:04.444 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.444 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.444 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120176 s, 87.3 MB/s 2024-09-19T05:46:04.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.459 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123413 s, 85.0 MB/s 2024-09-19T05:46:04.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.474 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121765 s, 86.1 MB/s 2024-09-19T05:46:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112657 s, 93.1 MB/s 2024-09-19T05:46:04.517 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.517 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.517 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103167 s, 102 MB/s 2024-09-19T05:46:04.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.529 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.529 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954971 s, 110 MB/s 2024-09-19T05:46:04.543 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.544 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.544 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122482 s, 85.6 MB/s 2024-09-19T05:46:04.556 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.556 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.556 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097594 s, 107 MB/s 2024-09-19T05:46:04.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:04.564 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:04.564 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:04.564 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.17 2024-09-19T05:46:04.564 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:04.564 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:04.564 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:04.564 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:04.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.629 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.629 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119276 s, 87.9 MB/s 2024-09-19T05:46:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117659 s, 89.1 MB/s 2024-09-19T05:46:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101376 s, 103 MB/s 2024-09-19T05:46:04.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.672 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123645 s, 84.8 MB/s 2024-09-19T05:46:04.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.687 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.687 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108422 s, 96.7 MB/s 2024-09-19T05:46:04.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.702 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121572 s, 86.3 MB/s 2024-09-19T05:46:04.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.718 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134133 s, 78.2 MB/s 2024-09-19T05:46:04.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.734 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129413 s, 81.0 MB/s 2024-09-19T05:46:04.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.750 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123215 s, 85.1 MB/s 2024-09-19T05:46:04.764 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.765 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123694 s, 84.8 MB/s 2024-09-19T05:46:04.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.781 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131167 s, 79.9 MB/s 2024-09-19T05:46:04.796 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.796 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.796 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122559 s, 85.6 MB/s 2024-09-19T05:46:04.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.811 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119787 s, 87.5 MB/s 2024-09-19T05:46:04.824 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.824 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.824 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972356 s, 108 MB/s 2024-09-19T05:46:04.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.839 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119219 s, 88.0 MB/s 2024-09-19T05:46:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901653 s, 116 MB/s 2024-09-19T05:46:04.865 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.865 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.865 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011596 s, 90.4 MB/s 2024-09-19T05:46:04.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.880 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.880 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118668 s, 88.4 MB/s 2024-09-19T05:46:04.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.895 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012034 s, 87.1 MB/s 2024-09-19T05:46:04.912 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.912 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.912 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135298 s, 77.5 MB/s 2024-09-19T05:46:04.927 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.927 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.927 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01254 s, 83.6 MB/s 2024-09-19T05:46:04.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.940 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971613 s, 108 MB/s 2024-09-19T05:46:04.956 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.956 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.957 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137539 s, 76.2 MB/s 2024-09-19T05:46:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116376 s, 90.1 MB/s 2024-09-19T05:46:04.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:04.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:04.988 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134585 s, 77.9 MB/s 2024-09-19T05:46:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116837 s, 89.7 MB/s 2024-09-19T05:46:05.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.018 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116565 s, 90.0 MB/s 2024-09-19T05:46:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128293 s, 81.7 MB/s 2024-09-19T05:46:05.050 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.050 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.050 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130041 s, 80.6 MB/s 2024-09-19T05:46:05.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.067 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125857 s, 83.3 MB/s 2024-09-19T05:46:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127578 s, 82.2 MB/s 2024-09-19T05:46:05.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.097 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114273 s, 91.8 MB/s 2024-09-19T05:46:05.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:05.105 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:05.106 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:05.106 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.18 2024-09-19T05:46:05.106 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:05.106 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:05.106 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:05.106 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:05.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147237 s, 71.2 MB/s 2024-09-19T05:46:05.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.234 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.234 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139927 s, 74.9 MB/s 2024-09-19T05:46:05.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121048 s, 86.6 MB/s 2024-09-19T05:46:05.270 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.270 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.270 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165224 s, 63.5 MB/s 2024-09-19T05:46:05.286 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.287 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.287 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130694 s, 80.2 MB/s 2024-09-19T05:46:05.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.303 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013505 s, 77.6 MB/s 2024-09-19T05:46:05.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.320 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132745 s, 79.0 MB/s 2024-09-19T05:46:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137325 s, 76.4 MB/s 2024-09-19T05:46:05.351 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.352 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012086 s, 86.8 MB/s 2024-09-19T05:46:05.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.364 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958746 s, 109 MB/s 2024-09-19T05:46:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.376 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089861 s, 117 MB/s 2024-09-19T05:46:05.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.392 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129812 s, 80.8 MB/s 2024-09-19T05:46:05.405 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.405 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.405 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107752 s, 97.3 MB/s 2024-09-19T05:46:05.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.420 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117457 s, 89.3 MB/s 2024-09-19T05:46:05.431 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.432 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976871 s, 107 MB/s 2024-09-19T05:46:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011736 s, 89.3 MB/s 2024-09-19T05:46:05.461 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.462 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131459 s, 79.8 MB/s 2024-09-19T05:46:05.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.472 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788383 s, 133 MB/s 2024-09-19T05:46:05.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.486 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011838 s, 88.6 MB/s 2024-09-19T05:46:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841078 s, 125 MB/s 2024-09-19T05:46:05.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.525 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104437 s, 100 MB/s 2024-09-19T05:46:05.535 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.536 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824388 s, 127 MB/s 2024-09-19T05:46:05.548 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.548 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.548 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993993 s, 105 MB/s 2024-09-19T05:46:05.558 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.558 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.558 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790117 s, 133 MB/s 2024-09-19T05:46:05.573 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.573 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.573 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123265 s, 85.1 MB/s 2024-09-19T05:46:05.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.585 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954127 s, 110 MB/s 2024-09-19T05:46:05.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.600 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126834 s, 82.7 MB/s 2024-09-19T05:46:05.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.614 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981604 s, 107 MB/s 2024-09-19T05:46:05.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010861 s, 96.5 MB/s 2024-09-19T05:46:05.643 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.643 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.643 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117575 s, 89.2 MB/s 2024-09-19T05:46:05.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.657 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.658 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010492 s, 99.9 MB/s 2024-09-19T05:46:05.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.672 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099582 s, 105 MB/s 2024-09-19T05:46:05.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:05.678 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:05.678 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:05.679 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.19 2024-09-19T05:46:05.679 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:05.679 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:05.679 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:05.679 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:05.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.787 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114565 s, 91.5 MB/s 2024-09-19T05:46:05.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.806 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153305 s, 68.4 MB/s 2024-09-19T05:46:05.822 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.822 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.822 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117617 s, 89.2 MB/s 2024-09-19T05:46:05.838 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.838 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.839 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124117 s, 84.5 MB/s 2024-09-19T05:46:05.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.854 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114262 s, 91.8 MB/s 2024-09-19T05:46:05.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.870 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.870 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124394 s, 84.3 MB/s 2024-09-19T05:46:05.886 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.886 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.886 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122586 s, 85.5 MB/s 2024-09-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.904 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144549 s, 72.5 MB/s 2024-09-19T05:46:05.919 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.919 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.919 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115859 s, 90.5 MB/s 2024-09-19T05:46:05.936 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.936 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.936 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126482 s, 82.9 MB/s 2024-09-19T05:46:05.952 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.952 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.952 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127066 s, 82.5 MB/s 2024-09-19T05:46:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123 s, 85.2 MB/s 2024-09-19T05:46:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929707 s, 113 MB/s 2024-09-19T05:46:05.995 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:05.996 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:05.996 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120994 s, 86.7 MB/s 2024-09-19T05:46:06.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.012 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132669 s, 79.0 MB/s 2024-09-19T05:46:06.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.030 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.030 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01393 s, 75.3 MB/s 2024-09-19T05:46:06.046 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.046 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.046 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127142 s, 82.5 MB/s 2024-09-19T05:46:06.063 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014156 s, 74.1 MB/s 2024-09-19T05:46:06.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.080 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.080 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108782 s, 96.4 MB/s 2024-09-19T05:46:06.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.094 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125629 s, 83.5 MB/s 2024-09-19T05:46:06.111 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.111 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.112 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134758 s, 77.8 MB/s 2024-09-19T05:46:06.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.129 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137231 s, 76.4 MB/s 2024-09-19T05:46:06.145 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.145 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.145 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124081 s, 84.5 MB/s 2024-09-19T05:46:06.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.162 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128518 s, 81.6 MB/s 2024-09-19T05:46:06.178 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.179 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130544 s, 80.3 MB/s 2024-09-19T05:46:06.195 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.195 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.195 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125214 s, 83.7 MB/s 2024-09-19T05:46:06.211 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.211 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.211 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131894 s, 79.5 MB/s 2024-09-19T05:46:06.225 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.225 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.225 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996342 s, 105 MB/s 2024-09-19T05:46:06.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.243 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138114 s, 75.9 MB/s 2024-09-19T05:46:06.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.258 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.258 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118783 s, 88.3 MB/s 2024-09-19T05:46:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.274 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118618 s, 88.4 MB/s 2024-09-19T05:46:06.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.292 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145756 s, 71.9 MB/s 2024-09-19T05:46:06.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:06.301 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:06.301 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:06.301 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.20 2024-09-19T05:46:06.301 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:06.301 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:06.301 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:06.301 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:06.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:06.411 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.411 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.411 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131152 s, 80.0 MB/s 2024-09-19T05:46:06.427 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.428 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126328 s, 83.0 MB/s 2024-09-19T05:46:06.441 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.441 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.441 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109783 s, 95.5 MB/s 2024-09-19T05:46:06.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153894 s, 68.1 MB/s 2024-09-19T05:46:06.475 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.475 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.475 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126546 s, 82.9 MB/s 2024-09-19T05:46:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124082 s, 84.5 MB/s 2024-09-19T05:46:06.508 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.508 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.508 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102146 s, 103 MB/s 2024-09-19T05:46:06.532 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.532 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.533 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116211 s, 90.2 MB/s 2024-09-19T05:46:06.547 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.547 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.547 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123217 s, 85.1 MB/s 2024-09-19T05:46:06.562 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.563 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.563 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121065 s, 86.6 MB/s 2024-09-19T05:46:06.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.576 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094673 s, 111 MB/s 2024-09-19T05:46:06.592 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.592 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.592 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137707 s, 76.1 MB/s 2024-09-19T05:46:06.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.605 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009612 s, 109 MB/s 2024-09-19T05:46:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.620 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124722 s, 84.1 MB/s 2024-09-19T05:46:06.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.634 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.634 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011093 s, 94.5 MB/s 2024-09-19T05:46:06.650 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.650 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.650 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132607 s, 79.1 MB/s 2024-09-19T05:46:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110392 s, 95.0 MB/s 2024-09-19T05:46:06.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130168 s, 80.6 MB/s 2024-09-19T05:46:06.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.693 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109171 s, 96.0 MB/s 2024-09-19T05:46:06.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.709 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013043 s, 80.4 MB/s 2024-09-19T05:46:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011685 s, 89.7 MB/s 2024-09-19T05:46:06.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.738 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128249 s, 81.8 MB/s 2024-09-19T05:46:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104029 s, 101 MB/s 2024-09-19T05:46:06.766 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.766 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.766 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121858 s, 86.0 MB/s 2024-09-19T05:46:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124952 s, 83.9 MB/s 2024-09-19T05:46:06.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.793 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925683 s, 113 MB/s 2024-09-19T05:46:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137118 s, 76.5 MB/s 2024-09-19T05:46:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100681 s, 104 MB/s 2024-09-19T05:46:06.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.837 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116434 s, 90.1 MB/s 2024-09-19T05:46:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888688 s, 118 MB/s 2024-09-19T05:46:06.863 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.863 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.863 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119223 s, 88.0 MB/s 2024-09-19T05:46:06.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.877 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109682 s, 95.6 MB/s 2024-09-19T05:46:06.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:06.883 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:06.883 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:06.883 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.21 2024-09-19T05:46:06.883 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:06.883 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:06.884 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:06.884 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:06.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:06.946 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.946 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.946 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102958 s, 102 MB/s 2024-09-19T05:46:06.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.961 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123879 s, 84.6 MB/s 2024-09-19T05:46:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833924 s, 126 MB/s 2024-09-19T05:46:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124047 s, 84.5 MB/s 2024-09-19T05:46:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012656 s, 82.9 MB/s 2024-09-19T05:46:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107579 s, 97.5 MB/s 2024-09-19T05:46:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111397 s, 94.1 MB/s 2024-09-19T05:46:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118867 s, 88.2 MB/s 2024-09-19T05:46:07.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.054 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812444 s, 129 MB/s 2024-09-19T05:46:07.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.067 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978916 s, 107 MB/s 2024-09-19T05:46:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.082 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122447 s, 85.6 MB/s 2024-09-19T05:46:07.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.094 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102066 s, 103 MB/s 2024-09-19T05:46:07.107 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.108 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.108 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103039 s, 102 MB/s 2024-09-19T05:46:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.122 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112023 s, 93.6 MB/s 2024-09-19T05:46:07.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.135 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.135 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974324 s, 108 MB/s 2024-09-19T05:46:07.147 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.147 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.147 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956825 s, 110 MB/s 2024-09-19T05:46:07.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.162 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118637 s, 88.4 MB/s 2024-09-19T05:46:07.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.177 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120741 s, 86.8 MB/s 2024-09-19T05:46:07.191 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.191 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.191 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112421 s, 93.3 MB/s 2024-09-19T05:46:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133791 s, 78.4 MB/s 2024-09-19T05:46:07.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.224 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136615 s, 76.8 MB/s 2024-09-19T05:46:07.239 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.239 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.239 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118922 s, 88.2 MB/s 2024-09-19T05:46:07.254 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.255 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.255 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012398 s, 84.6 MB/s 2024-09-19T05:46:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118252 s, 88.7 MB/s 2024-09-19T05:46:07.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.283 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104359 s, 100 MB/s 2024-09-19T05:46:07.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.298 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116875 s, 89.7 MB/s 2024-09-19T05:46:07.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.313 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121477 s, 86.3 MB/s 2024-09-19T05:46:07.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.328 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116481 s, 90.0 MB/s 2024-09-19T05:46:07.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.343 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.343 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124011 s, 84.6 MB/s 2024-09-19T05:46:07.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.359 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127413 s, 82.3 MB/s 2024-09-19T05:46:07.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.377 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146073 s, 71.8 MB/s 2024-09-19T05:46:07.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.392 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.392 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128726 s, 81.5 MB/s 2024-09-19T05:46:07.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:07.401 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:07.401 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:07.401 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.22 2024-09-19T05:46:07.401 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:07.402 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:07.402 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:07.402 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:07.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.550 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149659 s, 70.1 MB/s 2024-09-19T05:46:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140423 s, 74.7 MB/s 2024-09-19T05:46:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109231 s, 96.0 MB/s 2024-09-19T05:46:07.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.600 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128437 s, 81.6 MB/s 2024-09-19T05:46:07.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111102 s, 94.4 MB/s 2024-09-19T05:46:07.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105887 s, 99.0 MB/s 2024-09-19T05:46:07.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.645 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127614 s, 82.2 MB/s 2024-09-19T05:46:07.660 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125314 s, 83.7 MB/s 2024-09-19T05:46:07.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.677 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.677 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127378 s, 82.3 MB/s 2024-09-19T05:46:07.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.694 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130158 s, 80.6 MB/s 2024-09-19T05:46:07.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.713 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143229 s, 73.2 MB/s 2024-09-19T05:46:07.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.728 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117864 s, 89.0 MB/s 2024-09-19T05:46:07.748 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.748 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.748 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152824 s, 68.6 MB/s 2024-09-19T05:46:07.764 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.764 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.764 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122181 s, 85.8 MB/s 2024-09-19T05:46:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011796 s, 88.9 MB/s 2024-09-19T05:46:07.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.797 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133363 s, 78.6 MB/s 2024-09-19T05:46:07.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.815 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145638 s, 72.0 MB/s 2024-09-19T05:46:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.832 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132504 s, 79.1 MB/s 2024-09-19T05:46:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127558 s, 82.2 MB/s 2024-09-19T05:46:07.865 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.865 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.865 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131161 s, 79.9 MB/s 2024-09-19T05:46:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.882 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142644 s, 73.5 MB/s 2024-09-19T05:46:07.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.897 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113597 s, 92.3 MB/s 2024-09-19T05:46:07.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.915 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140939 s, 74.4 MB/s 2024-09-19T05:46:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132585 s, 79.1 MB/s 2024-09-19T05:46:07.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.949 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.949 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143305 s, 73.2 MB/s 2024-09-19T05:46:07.965 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.966 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.966 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136782 s, 76.7 MB/s 2024-09-19T05:46:07.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.981 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114976 s, 91.2 MB/s 2024-09-19T05:46:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:07.997 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131293 s, 79.9 MB/s 2024-09-19T05:46:08.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125984 s, 83.2 MB/s 2024-09-19T05:46:08.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.030 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.030 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013182 s, 79.5 MB/s 2024-09-19T05:46:08.046 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.046 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.046 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130178 s, 80.5 MB/s 2024-09-19T05:46:08.062 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.062 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.062 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123931 s, 84.6 MB/s 2024-09-19T05:46:08.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:08.071 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:08.071 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:08.071 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.23 2024-09-19T05:46:08.071 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:08.071 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:08.071 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:08.071 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:08.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:08.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.143 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.143 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107346 s, 97.7 MB/s 2024-09-19T05:46:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127863 s, 82.0 MB/s 2024-09-19T05:46:08.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.173 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111611 s, 93.9 MB/s 2024-09-19T05:46:08.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.188 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127829 s, 82.0 MB/s 2024-09-19T05:46:08.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.203 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119638 s, 87.6 MB/s 2024-09-19T05:46:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105979 s, 98.9 MB/s 2024-09-19T05:46:08.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.233 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134121 s, 78.2 MB/s 2024-09-19T05:46:08.246 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.247 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.247 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104642 s, 100 MB/s 2024-09-19T05:46:08.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.263 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130072 s, 80.6 MB/s 2024-09-19T05:46:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960529 s, 109 MB/s 2024-09-19T05:46:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.290 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122645 s, 85.5 MB/s 2024-09-19T05:46:08.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.304 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.304 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953916 s, 110 MB/s 2024-09-19T05:46:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101455 s, 103 MB/s 2024-09-19T05:46:08.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.328 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987941 s, 106 MB/s 2024-09-19T05:46:08.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.342 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107236 s, 97.8 MB/s 2024-09-19T05:46:08.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.358 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012152 s, 86.3 MB/s 2024-09-19T05:46:08.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.374 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122155 s, 85.8 MB/s 2024-09-19T05:46:08.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.389 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123046 s, 85.2 MB/s 2024-09-19T05:46:08.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119919 s, 87.4 MB/s 2024-09-19T05:46:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013105 s, 80.0 MB/s 2024-09-19T05:46:08.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119481 s, 87.8 MB/s 2024-09-19T05:46:08.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.449 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110825 s, 94.6 MB/s 2024-09-19T05:46:08.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.462 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010555 s, 99.3 MB/s 2024-09-19T05:46:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103474 s, 101 MB/s 2024-09-19T05:46:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010936 s, 95.9 MB/s 2024-09-19T05:46:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117264 s, 89.4 MB/s 2024-09-19T05:46:08.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.541 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127706 s, 82.1 MB/s 2024-09-19T05:46:08.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.553 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948669 s, 111 MB/s 2024-09-19T05:46:08.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.567 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010883 s, 96.3 MB/s 2024-09-19T05:46:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126822 s, 82.7 MB/s 2024-09-19T05:46:08.598 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.599 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120222 s, 87.2 MB/s 2024-09-19T05:46:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131205 s, 79.9 MB/s 2024-09-19T05:46:08.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:08.624 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:08.624 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:08.624 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.24 2024-09-19T05:46:08.624 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:08.624 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:08.625 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:08.625 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:08.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:08.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.685 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947388 s, 111 MB/s 2024-09-19T05:46:08.700 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.701 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.701 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124716 s, 84.1 MB/s 2024-09-19T05:46:08.714 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.714 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.714 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010429 s, 101 MB/s 2024-09-19T05:46:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128543 s, 81.6 MB/s 2024-09-19T05:46:08.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955396 s, 110 MB/s 2024-09-19T05:46:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.758 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.758 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120051 s, 87.3 MB/s 2024-09-19T05:46:08.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.770 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928943 s, 113 MB/s 2024-09-19T05:46:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119108 s, 88.0 MB/s 2024-09-19T05:46:08.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119482 s, 87.8 MB/s 2024-09-19T05:46:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.816 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.816 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011977 s, 87.5 MB/s 2024-09-19T05:46:08.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.828 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00898301 s, 117 MB/s 2024-09-19T05:46:08.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.843 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120369 s, 87.1 MB/s 2024-09-19T05:46:08.858 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.858 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.858 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120815 s, 86.8 MB/s 2024-09-19T05:46:08.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.874 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.874 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127089 s, 82.5 MB/s 2024-09-19T05:46:08.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.888 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106683 s, 98.3 MB/s 2024-09-19T05:46:08.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.901 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098328 s, 107 MB/s 2024-09-19T05:46:08.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936216 s, 112 MB/s 2024-09-19T05:46:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130635 s, 80.3 MB/s 2024-09-19T05:46:08.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.945 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104468 s, 100 MB/s 2024-09-19T05:46:08.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.960 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118501 s, 88.5 MB/s 2024-09-19T05:46:08.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.976 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122154 s, 85.8 MB/s 2024-09-19T05:46:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:08.990 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106462 s, 98.5 MB/s 2024-09-19T05:46:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137873 s, 76.1 MB/s 2024-09-19T05:46:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010834 s, 96.8 MB/s 2024-09-19T05:46:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123108 s, 85.2 MB/s 2024-09-19T05:46:09.053 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.053 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.054 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140548 s, 74.6 MB/s 2024-09-19T05:46:09.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.068 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.068 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109403 s, 95.8 MB/s 2024-09-19T05:46:09.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.082 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105717 s, 99.2 MB/s 2024-09-19T05:46:09.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129345 s, 81.1 MB/s 2024-09-19T05:46:09.113 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.114 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117635 s, 89.1 MB/s 2024-09-19T05:46:09.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.129 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122929 s, 85.3 MB/s 2024-09-19T05:46:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949427 s, 110 MB/s 2024-09-19T05:46:09.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:09.150 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:09.150 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:09.150 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.25 2024-09-19T05:46:09.150 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:09.150 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:09.150 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:09.150 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:09.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115137 s, 91.1 MB/s 2024-09-19T05:46:09.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.263 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.263 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863241 s, 121 MB/s 2024-09-19T05:46:09.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.276 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106088 s, 98.8 MB/s 2024-09-19T05:46:09.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.291 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117242 s, 89.4 MB/s 2024-09-19T05:46:09.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.305 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117773 s, 89.0 MB/s 2024-09-19T05:46:09.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.318 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108639 s, 96.5 MB/s 2024-09-19T05:46:09.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.335 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134535 s, 77.9 MB/s 2024-09-19T05:46:09.348 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.348 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.348 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010818 s, 96.9 MB/s 2024-09-19T05:46:09.362 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.362 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.362 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115507 s, 90.8 MB/s 2024-09-19T05:46:09.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.376 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.376 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109756 s, 95.5 MB/s 2024-09-19T05:46:09.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.389 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107308 s, 97.7 MB/s 2024-09-19T05:46:09.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.400 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856278 s, 122 MB/s 2024-09-19T05:46:09.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.416 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135185 s, 77.6 MB/s 2024-09-19T05:46:09.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.429 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102672 s, 102 MB/s 2024-09-19T05:46:09.440 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.440 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.440 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850716 s, 123 MB/s 2024-09-19T05:46:09.454 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.454 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.454 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112964 s, 92.8 MB/s 2024-09-19T05:46:09.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.468 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113069 s, 92.7 MB/s 2024-09-19T05:46:09.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.481 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106541 s, 98.4 MB/s 2024-09-19T05:46:09.493 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.493 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.493 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868548 s, 121 MB/s 2024-09-19T05:46:09.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.507 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113304 s, 92.5 MB/s 2024-09-19T05:46:09.547 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.625 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.625 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110991 s, 94.5 MB/s 2024-09-19T05:46:09.626 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.627 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116017 s, 90.4 MB/s 2024-09-19T05:46:09.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.627 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108401 s, 96.7 MB/s 2024-09-19T05:46:09.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.627 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126297 s, 83.0 MB/s 2024-09-19T05:46:09.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776862 s, 135 MB/s 2024-09-19T05:46:09.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104258 s, 101 MB/s 2024-09-19T05:46:09.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787336 s, 133 MB/s 2024-09-19T05:46:09.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.637 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.637 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104995 s, 99.9 MB/s 2024-09-19T05:46:09.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.649 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958966 s, 109 MB/s 2024-09-19T05:46:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011976 s, 87.6 MB/s 2024-09-19T05:46:09.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.676 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103469 s, 101 MB/s 2024-09-19T05:46:09.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.688 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102245 s, 103 MB/s 2024-09-19T05:46:09.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:09.694 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:09.694 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:09.694 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.26 2024-09-19T05:46:09.695 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:09.695 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:09.695 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:09.695 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:09.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:09.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.800 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130951 s, 80.1 MB/s 2024-09-19T05:46:09.813 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.813 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.814 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104576 s, 100 MB/s 2024-09-19T05:46:09.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.828 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117035 s, 89.6 MB/s 2024-09-19T05:46:09.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.842 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112638 s, 93.1 MB/s 2024-09-19T05:46:09.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.854 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.854 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984516 s, 107 MB/s 2024-09-19T05:46:09.870 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.870 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.870 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119852 s, 87.5 MB/s 2024-09-19T05:46:09.885 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.886 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.886 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123807 s, 84.7 MB/s 2024-09-19T05:46:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117254 s, 89.4 MB/s 2024-09-19T05:46:09.913 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.914 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987858 s, 106 MB/s 2024-09-19T05:46:09.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.929 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119397 s, 87.8 MB/s 2024-09-19T05:46:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.943 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853384 s, 123 MB/s 2024-09-19T05:46:09.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.961 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.961 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131528 s, 79.7 MB/s 2024-09-19T05:46:09.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.974 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.974 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010912 s, 96.1 MB/s 2024-09-19T05:46:09.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:09.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:09.988 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010085 s, 104 MB/s 2024-09-19T05:46:10.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.002 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.002 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117162 s, 89.5 MB/s 2024-09-19T05:46:10.016 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.016 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.016 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107148 s, 97.9 MB/s 2024-09-19T05:46:10.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.032 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116418 s, 90.1 MB/s 2024-09-19T05:46:10.045 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.045 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.046 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101166 s, 104 MB/s 2024-09-19T05:46:10.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.057 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.057 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881459 s, 119 MB/s 2024-09-19T05:46:10.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.072 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.072 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011942 s, 87.8 MB/s 2024-09-19T05:46:10.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.084 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009789 s, 107 MB/s 2024-09-19T05:46:10.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.095 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00807491 s, 130 MB/s 2024-09-19T05:46:10.111 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.111 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.111 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130506 s, 80.3 MB/s 2024-09-19T05:46:10.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.122 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.122 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882139 s, 119 MB/s 2024-09-19T05:46:10.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.136 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115726 s, 90.6 MB/s 2024-09-19T05:46:10.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.152 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127692 s, 82.1 MB/s 2024-09-19T05:46:10.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.167 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125842 s, 83.3 MB/s 2024-09-19T05:46:10.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.179 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870115 s, 121 MB/s 2024-09-19T05:46:10.195 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.195 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.196 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134885 s, 77.7 MB/s 2024-09-19T05:46:10.211 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.211 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.211 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127779 s, 82.1 MB/s 2024-09-19T05:46:10.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.227 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126937 s, 82.6 MB/s 2024-09-19T05:46:10.242 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.242 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.242 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120929 s, 86.7 MB/s 2024-09-19T05:46:10.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:10.250 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:10.250 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:10.250 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.27 2024-09-19T05:46:10.250 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:10.250 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:10.250 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:10.250 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:10.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:10.427 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.427 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.427 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118357 s, 88.6 MB/s 2024-09-19T05:46:10.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.440 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.440 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989713 s, 106 MB/s 2024-09-19T05:46:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979923 s, 107 MB/s 2024-09-19T05:46:10.466 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.467 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119531 s, 87.7 MB/s 2024-09-19T05:46:10.480 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.481 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.481 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114759 s, 91.4 MB/s 2024-09-19T05:46:10.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.495 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120018 s, 87.4 MB/s 2024-09-19T05:46:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215442 s, 48.7 MB/s 2024-09-19T05:46:10.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.540 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114258 s, 91.8 MB/s 2024-09-19T05:46:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.555 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012028 s, 87.2 MB/s 2024-09-19T05:46:10.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.567 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841609 s, 125 MB/s 2024-09-19T05:46:10.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.580 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.581 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011139 s, 94.1 MB/s 2024-09-19T05:46:10.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.594 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996025 s, 105 MB/s 2024-09-19T05:46:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119922 s, 87.4 MB/s 2024-09-19T05:46:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011354 s, 92.4 MB/s 2024-09-19T05:46:10.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.638 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124569 s, 84.2 MB/s 2024-09-19T05:46:10.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.653 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122474 s, 85.6 MB/s 2024-09-19T05:46:10.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.664 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879016 s, 119 MB/s 2024-09-19T05:46:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011502 s, 91.2 MB/s 2024-09-19T05:46:10.692 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.692 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.692 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103398 s, 101 MB/s 2024-09-19T05:46:10.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.707 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011499 s, 91.2 MB/s 2024-09-19T05:46:10.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.719 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928199 s, 113 MB/s 2024-09-19T05:46:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.734 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117838 s, 89.0 MB/s 2024-09-19T05:46:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115633 s, 90.7 MB/s 2024-09-19T05:46:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138793 s, 75.5 MB/s 2024-09-19T05:46:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118076 s, 88.8 MB/s 2024-09-19T05:46:10.792 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.792 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.793 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010616 s, 98.8 MB/s 2024-09-19T05:46:10.807 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.807 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.807 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114853 s, 91.3 MB/s 2024-09-19T05:46:10.823 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.823 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.823 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124603 s, 84.2 MB/s 2024-09-19T05:46:10.838 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.838 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.838 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113199 s, 92.6 MB/s 2024-09-19T05:46:10.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.854 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123246 s, 85.1 MB/s 2024-09-19T05:46:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114399 s, 91.7 MB/s 2024-09-19T05:46:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118307 s, 88.6 MB/s 2024-09-19T05:46:10.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:10.891 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:10.891 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:10.891 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.28 2024-09-19T05:46:10.891 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:10.891 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:10.891 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:10.891 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:10.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:10.947 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:46:10.950 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.959 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118503 s, 88.5 MB/s 2024-09-19T05:46:10.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.973 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110364 s, 95.0 MB/s 2024-09-19T05:46:10.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:10.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:10.988 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012756 s, 82.2 MB/s 2024-09-19T05:46:11.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.001 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985407 s, 106 MB/s 2024-09-19T05:46:11.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972052 s, 108 MB/s 2024-09-19T05:46:11.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.027 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116976 s, 89.6 MB/s 2024-09-19T05:46:11.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.043 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135225 s, 77.5 MB/s 2024-09-19T05:46:11.056 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.056 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.056 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105249 s, 99.6 MB/s 2024-09-19T05:46:11.070 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.070 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.070 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116403 s, 90.1 MB/s 2024-09-19T05:46:11.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.085 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.085 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118303 s, 88.6 MB/s 2024-09-19T05:46:11.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.097 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.097 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101302 s, 104 MB/s 2024-09-19T05:46:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116305 s, 90.2 MB/s 2024-09-19T05:46:11.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.124 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010107 s, 104 MB/s 2024-09-19T05:46:11.134 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.134 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.134 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793593 s, 132 MB/s 2024-09-19T05:46:11.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.146 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975746 s, 107 MB/s 2024-09-19T05:46:11.161 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.161 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.161 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126598 s, 82.8 MB/s 2024-09-19T05:46:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.172 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.173 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867097 s, 121 MB/s 2024-09-19T05:46:11.186 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113065 s, 92.7 MB/s 2024-09-19T05:46:11.200 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.200 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.200 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113076 s, 92.7 MB/s 2024-09-19T05:46:11.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.213 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106328 s, 98.6 MB/s 2024-09-19T05:46:11.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113459 s, 92.4 MB/s 2024-09-19T05:46:11.239 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.240 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.240 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923489 s, 114 MB/s 2024-09-19T05:46:11.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.253 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106889 s, 98.1 MB/s 2024-09-19T05:46:11.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.266 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110536 s, 94.9 MB/s 2024-09-19T05:46:11.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.277 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00814118 s, 129 MB/s 2024-09-19T05:46:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.291 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011644 s, 90.1 MB/s 2024-09-19T05:46:11.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.305 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121068 s, 86.6 MB/s 2024-09-19T05:46:11.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.315 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736042 s, 142 MB/s 2024-09-19T05:46:11.325 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.325 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.325 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785604 s, 133 MB/s 2024-09-19T05:46:11.338 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.339 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107418 s, 97.6 MB/s 2024-09-19T05:46:11.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.349 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800558 s, 131 MB/s 2024-09-19T05:46:11.362 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.362 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.362 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103659 s, 101 MB/s 2024-09-19T05:46:11.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:11.368 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:11.369 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:11.369 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.29 2024-09-19T05:46:11.369 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:11.369 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:11.369 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:11.369 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:11.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:11.471 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.472 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122443 s, 85.6 MB/s 2024-09-19T05:46:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119349 s, 87.9 MB/s 2024-09-19T05:46:11.498 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.498 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.498 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984918 s, 106 MB/s 2024-09-19T05:46:11.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907796 s, 116 MB/s 2024-09-19T05:46:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120971 s, 86.7 MB/s 2024-09-19T05:46:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914374 s, 115 MB/s 2024-09-19T05:46:11.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.559 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974855 s, 108 MB/s 2024-09-19T05:46:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111148 s, 94.3 MB/s 2024-09-19T05:46:11.586 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.586 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.586 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111081 s, 94.4 MB/s 2024-09-19T05:46:11.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.599 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108998 s, 96.2 MB/s 2024-09-19T05:46:11.612 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.612 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.612 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107918 s, 97.2 MB/s 2024-09-19T05:46:11.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134125 s, 78.2 MB/s 2024-09-19T05:46:11.643 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.644 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130358 s, 80.4 MB/s 2024-09-19T05:46:11.660 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.660 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141504 s, 74.1 MB/s 2024-09-19T05:46:11.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.676 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125993 s, 83.2 MB/s 2024-09-19T05:46:11.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.691 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126304 s, 83.0 MB/s 2024-09-19T05:46:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.702 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839226 s, 125 MB/s 2024-09-19T05:46:11.717 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.717 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.718 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128611 s, 81.5 MB/s 2024-09-19T05:46:11.729 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.729 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.729 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952797 s, 110 MB/s 2024-09-19T05:46:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106384 s, 98.6 MB/s 2024-09-19T05:46:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102616 s, 102 MB/s 2024-09-19T05:46:11.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.769 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.769 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109294 s, 95.9 MB/s 2024-09-19T05:46:11.782 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.783 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.783 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113081 s, 92.7 MB/s 2024-09-19T05:46:11.796 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.797 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.797 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109484 s, 95.8 MB/s 2024-09-19T05:46:11.809 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107523 s, 97.5 MB/s 2024-09-19T05:46:11.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.821 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876859 s, 120 MB/s 2024-09-19T05:46:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926843 s, 113 MB/s 2024-09-19T05:46:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105647 s, 99.3 MB/s 2024-09-19T05:46:11.860 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.860 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.860 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010987 s, 95.4 MB/s 2024-09-19T05:46:11.871 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863696 s, 121 MB/s 2024-09-19T05:46:11.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.888 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119309 s, 87.9 MB/s 2024-09-19T05:46:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979821 s, 107 MB/s 2024-09-19T05:46:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:11.907 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:11.907 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:11.907 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.30 2024-09-19T05:46:11.907 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:11.907 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:11.907 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:11.907 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:11.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:12.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.012 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.012 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116152 s, 90.3 MB/s 2024-09-19T05:46:12.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.023 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824316 s, 127 MB/s 2024-09-19T05:46:12.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.037 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109082 s, 96.1 MB/s 2024-09-19T05:46:12.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.051 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115793 s, 90.6 MB/s 2024-09-19T05:46:12.063 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.064 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.064 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991107 s, 106 MB/s 2024-09-19T05:46:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132336 s, 79.2 MB/s 2024-09-19T05:46:12.092 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.092 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.092 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103596 s, 101 MB/s 2024-09-19T05:46:12.107 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.107 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.107 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122719 s, 85.4 MB/s 2024-09-19T05:46:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112997 s, 92.8 MB/s 2024-09-19T05:46:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833497 s, 126 MB/s 2024-09-19T05:46:12.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.146 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111796 s, 93.8 MB/s 2024-09-19T05:46:12.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.160 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113561 s, 92.3 MB/s 2024-09-19T05:46:12.178 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.178 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.178 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150269 s, 69.8 MB/s 2024-09-19T05:46:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116789 s, 89.8 MB/s 2024-09-19T05:46:12.204 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935718 s, 112 MB/s 2024-09-19T05:46:12.218 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.219 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.219 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114756 s, 91.4 MB/s 2024-09-19T05:46:12.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.233 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111051 s, 94.4 MB/s 2024-09-19T05:46:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933007 s, 112 MB/s 2024-09-19T05:46:12.261 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.262 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140804 s, 74.5 MB/s 2024-09-19T05:46:12.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.278 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135619 s, 77.3 MB/s 2024-09-19T05:46:12.293 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.293 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.293 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120239 s, 87.2 MB/s 2024-09-19T05:46:12.307 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.307 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.307 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011496 s, 91.2 MB/s 2024-09-19T05:46:12.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.320 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100069 s, 105 MB/s 2024-09-19T05:46:12.335 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.336 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118189 s, 88.7 MB/s 2024-09-19T05:46:12.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.349 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.349 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115295 s, 90.9 MB/s 2024-09-19T05:46:12.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.365 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123313 s, 85.0 MB/s 2024-09-19T05:46:12.380 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.380 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.380 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127905 s, 82.0 MB/s 2024-09-19T05:46:12.394 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.394 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.394 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115174 s, 91.0 MB/s 2024-09-19T05:46:12.410 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.410 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.410 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129913 s, 80.7 MB/s 2024-09-19T05:46:12.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134024 s, 78.2 MB/s 2024-09-19T05:46:12.442 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.443 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.443 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013143 s, 79.8 MB/s 2024-09-19T05:46:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118401 s, 88.6 MB/s 2024-09-19T05:46:12.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:12.465 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:46:12.466 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:46:12.466 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.31 2024-09-19T05:46:12.466 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:46:12.466 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:46:12.466 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:46:12.466 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:46:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:46:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135905 s, 77.2 MB/s 2024-09-19T05:46:12.618 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.618 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.618 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103364 s, 101 MB/s 2024-09-19T05:46:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127727 s, 82.1 MB/s 2024-09-19T05:46:12.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.648 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105039 s, 99.8 MB/s 2024-09-19T05:46:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962334 s, 109 MB/s 2024-09-19T05:46:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106115 s, 98.8 MB/s 2024-09-19T05:46:12.689 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.689 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.689 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120042 s, 87.4 MB/s 2024-09-19T05:46:12.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.706 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013681 s, 76.6 MB/s 2024-09-19T05:46:12.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.722 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131613 s, 79.7 MB/s 2024-09-19T05:46:12.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.738 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127 s, 82.6 MB/s 2024-09-19T05:46:12.752 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.752 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.752 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011177 s, 93.8 MB/s 2024-09-19T05:46:12.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.770 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144284 s, 72.7 MB/s 2024-09-19T05:46:12.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.785 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119413 s, 87.8 MB/s 2024-09-19T05:46:12.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.801 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127514 s, 82.2 MB/s 2024-09-19T05:46:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.818 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117937 s, 88.9 MB/s 2024-09-19T05:46:12.835 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.835 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.835 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137619 s, 76.2 MB/s 2024-09-19T05:46:12.851 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.851 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.851 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131962 s, 79.5 MB/s 2024-09-19T05:46:12.867 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.867 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.867 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012467 s, 84.1 MB/s 2024-09-19T05:46:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.884 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132022 s, 79.4 MB/s 2024-09-19T05:46:12.898 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.898 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.898 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111724 s, 93.9 MB/s 2024-09-19T05:46:12.914 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.915 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.915 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133764 s, 78.4 MB/s 2024-09-19T05:46:12.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.931 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125033 s, 83.9 MB/s 2024-09-19T05:46:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.947 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.948 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013675 s, 76.7 MB/s 2024-09-19T05:46:12.962 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.962 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.963 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116201 s, 90.2 MB/s 2024-09-19T05:46:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.979 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128353 s, 81.7 MB/s 2024-09-19T05:46:12.996 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:12.996 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:12.996 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139935 s, 74.9 MB/s 2024-09-19T05:46:13.014 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:13.014 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:13.014 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145907 s, 71.9 MB/s 2024-09-19T05:46:13.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:13.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:13.032 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133551 s, 78.5 MB/s 2024-09-19T05:46:13.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:13.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:13.047 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114072 s, 91.9 MB/s 2024-09-19T05:46:13.064 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:13.064 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:13.064 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137589 s, 76.2 MB/s 2024-09-19T05:46:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120607 s, 86.9 MB/s 2024-09-19T05:46:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:46:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:46:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134303 s, 78.1 MB/s 2024-09-19T05:46:13.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:46:13.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:46:13.106 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub start /scrub_control_test_path recursive 2024-09-19T05:46:13.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.237+0000 7f8f4da89640 1 Processor -- start 2024-09-19T05:46:13.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.237+0000 7f8f4da89640 1 -- start start 2024-09-19T05:46:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f4da89640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8f4809b140 0x7f8f48167160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f4da89640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f480d1330 con 0x7f8f480b2d80 2024-09-19T05:46:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f4da89640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f480b3600 con 0x7f8f4815c500 2024-09-19T05:46:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f4da89640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8f480cc960 con 0x7f8f4809b140 2024-09-19T05:46:13.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f47fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8f4809b140 0x7f8f48167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f46ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8f480b2d80 0x7f8f4809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36640/0 (socket says 172.21.15.67:36640) 2024-09-19T05:46:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f47fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8f4809b140 0x7f8f48167160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48700/0 (socket says 172.21.15.67:48700) 2024-09-19T05:46:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f46ffd640 1 -- 172.21.15.67:0/3100943585 learned_addr learned my addr 172.21.15.67:0/3100943585 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f47fff640 1 -- 172.21.15.67:0/3100943585 >> v1:172.21.15.97:6789/0 conn(0x7f8f4815c500 legacy=0x7f8f480d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f47fff640 1 -- 172.21.15.67:0/3100943585 >> v1:172.21.15.67:6789/0 conn(0x7f8f480b2d80 legacy=0x7f8f4809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f47fff640 1 -- 172.21.15.67:0/3100943585 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f480b38a0 con 0x7f8f4809b140 2024-09-19T05:46:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f47fff640 1 --2- 172.21.15.67:0/3100943585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f4809b140 0x7f8f48167160 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009d90 tx=0x7f8f4001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f496b27e50ea2117 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f467fc640 1 -- 172.21.15.67:0/3100943585 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400b2070 con 0x7f8f4809b140 2024-09-19T05:46:13.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f467fc640 1 -- 172.21.15.67:0/3100943585 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f400a5930 con 0x7f8f4809b140 2024-09-19T05:46:13.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.241+0000 7f8f467fc640 1 -- 172.21.15.67:0/3100943585 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400a5d00 con 0x7f8f4809b140 2024-09-19T05:46:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- 172.21.15.67:0/3100943585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f4809b140 msgr2=0x7f8f48167160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 --2- 172.21.15.67:0/3100943585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f4809b140 0x7f8f48167160 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009d90 tx=0x7f8f4001c870 comp rx=0 tx=0).stop 2024-09-19T05:46:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- 172.21.15.67:0/3100943585 shutdown_connections 2024-09-19T05:46:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 --2- 172.21.15.67:0/3100943585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f4809b140 0x7f8f48167160 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- 172.21.15.67:0/3100943585 >> 172.21.15.67:0/3100943585 conn(0x7f8f480d2310 msgr2=0x7f8f480d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- 172.21.15.67:0/3100943585 shutdown_connections 2024-09-19T05:46:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- 172.21.15.67:0/3100943585 wait complete. 2024-09-19T05:46:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 Processor -- start 2024-09-19T05:46:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- start start 2024-09-19T05:46:13.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f4809b140 0x7f8f480cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f480b2d80 0x7f8f48155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f4815c500 0x7f8f4806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8f480c9050 con 0x7f8f480b2d80 2024-09-19T05:46:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8f480c8ed0 con 0x7f8f4815c500 2024-09-19T05:46:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8f4815c8e0 con 0x7f8f4809b140 2024-09-19T05:46:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f46ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f480b2d80 0x7f8f48155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f46ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f480b2d80 0x7f8f48155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48702/0 (socket says 172.21.15.67:48702) 2024-09-19T05:46:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f46ffd640 1 -- 172.21.15.67:0/3404368329 learned_addr learned my addr 172.21.15.67:0/3404368329 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f47fff640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f4815c500 0x7f8f4806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f477fe640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f4809b140 0x7f8f480cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f46ffd640 1 -- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f4809b140 msgr2=0x7f8f480cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f46ffd640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f4809b140 0x7f8f480cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f46ffd640 1 -- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f4815c500 msgr2=0x7f8f4806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f46ffd640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f4815c500 0x7f8f4806cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f46ffd640 1 -- 172.21.15.67:0/3404368329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f480b6810 con 0x7f8f480b2d80 2024-09-19T05:46:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f46ffd640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f480b2d80 0x7f8f48155620 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c370 tx=0x7f8f3c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f2ffff640 1 -- 172.21.15.67:0/3404368329 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c017070 con 0x7f8f480b2d80 2024-09-19T05:46:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f2ffff640 1 -- 172.21.15.67:0/3404368329 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3c005cf0 con 0x7f8f480b2d80 2024-09-19T05:46:13.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- 172.21.15.67:0/3404368329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f48156080 con 0x7f8f480b2d80 2024-09-19T05:46:13.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f2ffff640 1 -- 172.21.15.67:0/3404368329 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0072f0 con 0x7f8f480b2d80 2024-09-19T05:46:13.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.245+0000 7f8f4da89640 1 -- 172.21.15.67:0/3404368329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f480b7040 con 0x7f8f480b2d80 2024-09-19T05:46:13.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f2ffff640 1 -- 172.21.15.67:0/3404368329 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f3c01a070 con 0x7f8f480b2d80 2024-09-19T05:46:13.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f2ffff640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8f340678c0 0x7f8f34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f2ffff640 1 -- 172.21.15.67:0/3404368329 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f8f3c085200 con 0x7f8f480b2d80 2024-09-19T05:46:13.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f477fe640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8f340678c0 0x7f8f34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f50b45000 1 Processor -- start 2024-09-19T05:46:13.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f50b45000 1 -- start start 2024-09-19T05:46:13.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f477fe640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8f340678c0 0x7f8f34069d80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8f38003d60 tx=0x7f8f38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 0x55f7fcae0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae0ff0 0x55f7fca94160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fca946a0 0x55f7fca94a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f50b45000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f7fc8e4ba0 con 0x55f7fca946a0 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f50b45000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f7fc88a350 con 0x55f7fcae06d0 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f50b45000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f7fc8e0b60 con 0x55f7fcae0ff0 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fca946a0 0x55f7fca94a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fca946a0 0x55f7fca94a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48706/0 (socket says 172.21.15.67:48706) 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f47fff640 1 -- 172.21.15.67:0/243766213 learned_addr learned my addr 172.21.15.67:0/243766213 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f477fe640 1 --2- 172.21.15.67:0/243766213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 0x55f7fcae0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f46ffd640 1 --2- 172.21.15.67:0/243766213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae0ff0 0x55f7fca94160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f47fff640 1 -- 172.21.15.67:0/243766213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae0ff0 msgr2=0x55f7fca94160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f47fff640 1 --2- 172.21.15.67:0/243766213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae0ff0 0x55f7fca94160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f47fff640 1 -- 172.21.15.67:0/243766213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 msgr2=0x55f7fcae0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f47fff640 1 --2- 172.21.15.67:0/243766213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 0x55f7fcae0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f47fff640 1 -- 172.21.15.67:0/243766213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fc88dbd0 con 0x55f7fca946a0 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f477fe640 1 --2- 172.21.15.67:0/243766213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 0x55f7fcae0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f47fff640 1 --2- 172.21.15.67:0/243766213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fca946a0 0x55f7fca94a80 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f8f40019480 tx=0x7f8f40004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe65ef44b2eb5008 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.249+0000 7f8f2d7fa640 1 -- 172.21.15.67:0/243766213 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400b2040 con 0x55f7fca946a0 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f2d7fa640 1 -- 172.21.15.67:0/243766213 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f400a5a90 con 0x55f7fca946a0 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f2d7fa640 1 -- 172.21.15.67:0/243766213 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400a5e40 con 0x55f7fca946a0 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- 172.21.15.67:0/243766213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fca946a0 msgr2=0x55f7fca94a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 --2- 172.21.15.67:0/243766213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fca946a0 0x55f7fca94a80 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f8f40019480 tx=0x7f8f40004ac0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- 172.21.15.67:0/243766213 shutdown_connections 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 --2- 172.21.15.67:0/243766213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fca946a0 0x55f7fca94a80 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 --2- 172.21.15.67:0/243766213 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae0ff0 0x55f7fca94160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 --2- 172.21.15.67:0/243766213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 0x55f7fcae0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- 172.21.15.67:0/243766213 >> 172.21.15.67:0/243766213 conn(0x55f7fcac1470 msgr2=0x55f7fcac3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- 172.21.15.67:0/243766213 shutdown_connections 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- 172.21.15.67:0/243766213 wait complete. 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- start start 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 Processor -- start 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 0x55f7fcae7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae06d0 0x55f7fcae7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcae82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f7fc87e2a0 con 0x55f7fcae0ff0 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f7fc8a37d0 con 0x55f7fca946a0 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f7fc8a5f70 con 0x55f7fcae06d0 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 10 client.0 _ll_register_callbacks cb 0x55f7fca81b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcae82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcae82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48714/0 (socket says 172.21.15.67:48714) 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f47fff640 1 -- 172.21.15.67:0/340425073 learned_addr learned my addr 172.21.15.67:0/340425073 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f477fe640 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 0x55f7fcae7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f46ffd640 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae06d0 0x55f7fcae7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f47fff640 1 -- 172.21.15.67:0/340425073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae06d0 msgr2=0x55f7fcae7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f47fff640 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae06d0 0x55f7fcae7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f47fff640 1 -- 172.21.15.67:0/340425073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 msgr2=0x55f7fcae7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f47fff640 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 0x55f7fcae7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f47fff640 1 -- 172.21.15.67:0/340425073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fc8ed810 con 0x55f7fcae0ff0 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f47fff640 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcae82d0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f8f4001cde0 tx=0x7f8f4001b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6db4f20b4e5dd5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f267fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f267fc640 1 -- 172.21.15.67:0/340425073 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400b2050 con 0x55f7fcae0ff0 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f267fc640 1 -- 172.21.15.67:0/340425073 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f8f40003c20 con 0x55f7fcae0ff0 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- 172.21.15.67:0/340425073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f400a5a90 con 0x55f7fcae0ff0 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f267fc640 1 -- 172.21.15.67:0/340425073 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) ==== 24+0+0 (secure 0 0 0) 0x7f8f400d1050 con 0x55f7fcae0ff0 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 10 client.9747 fetch_fsmap learned FSMap version 115 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- 172.21.15.67:0/340425073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) -- 0x55f7fc88e9f0 con 0x55f7fcae0ff0 2024-09-19T05:46:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f267fc640 1 -- 172.21.15.67:0/340425073 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f400a5a90 con 0x55f7fcae0ff0 2024-09-19T05:46:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f267fc640 1 -- 172.21.15.67:0/340425073 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 115) ==== 3502+0+0 (secure 0 0 0) 0x7f8f400d4020 con 0x55f7fcae0ff0 2024-09-19T05:46:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 10 client.9747 fetch_fsmap finished waiting for FSMap version 115 2024-09-19T05:46:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 10 client.9747 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-19T05:46:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 20 client.9747 populate_metadata read hostname 'smithi067' 2024-09-19T05:46:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55f7fcaefc20 0x55f7fcaf2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 4 client.9747 mds_command: new command op to 9579 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:46:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f50b45000 1 -- 172.21.15.67:0/340425073 --> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7fc87ebd0 con 0x55f7fcaefc20 2024-09-19T05:46:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.253+0000 7f8f477fe640 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55f7fcaefc20 0x55f7fcaf2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f267fc640 10 client.9747 ms_handle_connect on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f477fe640 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55f7fcaefc20 0x55f7fcaf2010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82babb4a57d35307 server_cookie=a38782971d01b994 in_seq=0 out_seq=0 2024-09-19T05:46:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f267fc640 1 -- 172.21.15.67:0/340425073 <== mds.0 v2:172.21.15.67:6834/1716781558 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f7fc87ebd0 con 0x55f7fcaefc20 2024-09-19T05:46:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f267fc640 10 client.9747 handle_command_reply: tid=0 2024-09-19T05:46:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 client.9747 shutdown 2024-09-19T05:46:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 -- 172.21.15.67:0/340425073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 msgr2=0x55f7fcae82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcae82d0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f8f4001cde0 tx=0x7f8f4001b0b0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 -- 172.21.15.67:0/340425073 shutdown_connections 2024-09-19T05:46:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55f7fcaefc20 0x55f7fcaf2010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcae82d0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae06d0 0x55f7fcae7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f267fc640 0 client.9747 ms_handle_reset on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 --2- 172.21.15.67:0/340425073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 0x55f7fcae7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 -- 172.21.15.67:0/340425073 >> 172.21.15.67:0/340425073 conn(0x55f7fcac1470 msgr2=0x55f7fca93860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 -- 172.21.15.67:0/340425073 shutdown_connections 2024-09-19T05:46:13.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 1 -- 172.21.15.67:0/340425073 wait complete. 2024-09-19T05:46:13.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.257+0000 7f8f50b45000 20 client.9747 trim_cache size 0 max 16384 2024-09-19T05:46:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.273+0000 7f8f50b45000 1 Processor -- start 2024-09-19T05:46:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.273+0000 7f8f50b45000 1 -- start start 2024-09-19T05:46:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 0x55f7fca93940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae06d0 0x55f7fca93e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcaf0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8f48202ea0 con 0x55f7fcae0ff0 2024-09-19T05:46:13.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8f480cb380 con 0x55f7fca946a0 2024-09-19T05:46:13.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8f48202850 con 0x55f7fcae06d0 2024-09-19T05:46:13.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcaf0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcaf0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48722/0 (socket says 172.21.15.67:48722) 2024-09-19T05:46:13.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 -- 172.21.15.67:0/3079063717 learned_addr learned my addr 172.21.15.67:0/3079063717 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 -- 172.21.15.67:0/3079063717 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae06d0 msgr2=0x55f7fca93e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f477fe640 1 --2- 172.21.15.67:0/3079063717 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 0x55f7fca93940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f46ffd640 1 --2- 172.21.15.67:0/3079063717 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae06d0 0x55f7fca93e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 --2- 172.21.15.67:0/3079063717 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae06d0 0x55f7fca93e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 -- 172.21.15.67:0/3079063717 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 msgr2=0x55f7fca93940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 --2- 172.21.15.67:0/3079063717 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 0x55f7fca93940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 -- 172.21.15.67:0/3079063717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fc88a5a0 con 0x55f7fcae0ff0 2024-09-19T05:46:13.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f477fe640 1 --2- 172.21.15.67:0/3079063717 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 0x55f7fca93940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:13.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 --2- 172.21.15.67:0/3079063717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcaf0000 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f8f40000f90 tx=0x7f8f400c2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d228705972a0a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f2cff9640 1 -- 172.21.15.67:0/3079063717 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400ce070 con 0x55f7fcae0ff0 2024-09-19T05:46:13.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f2cff9640 1 -- 172.21.15.67:0/3079063717 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f40003ba0 con 0x55f7fcae0ff0 2024-09-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f2cff9640 1 -- 172.21.15.67:0/3079063717 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400b2040 con 0x55f7fcae0ff0 2024-09-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- 172.21.15.67:0/3079063717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 msgr2=0x55f7fcaf0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 --2- 172.21.15.67:0/3079063717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcaf0000 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f8f40000f90 tx=0x7f8f400c2000 comp rx=0 tx=0).stop 2024-09-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- 172.21.15.67:0/3079063717 shutdown_connections 2024-09-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 --2- 172.21.15.67:0/3079063717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcaf0000 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 --2- 172.21.15.67:0/3079063717 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fcae06d0 0x55f7fca93e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 --2- 172.21.15.67:0/3079063717 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fca946a0 0x55f7fca93940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- 172.21.15.67:0/3079063717 >> 172.21.15.67:0/3079063717 conn(0x55f7fcac1470 msgr2=0x55f7fcaede60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- 172.21.15.67:0/3079063717 shutdown_connections 2024-09-19T05:46:13.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- 172.21.15.67:0/3079063717 wait complete. 2024-09-19T05:46:13.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- start start 2024-09-19T05:46:13.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 Processor -- start 2024-09-19T05:46:13.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fca946a0 0x55f7fcb54380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 0x55f7fcb548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcb54e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f7fc890c10 con 0x55f7fcae0ff0 2024-09-19T05:46:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f7fc88be30 con 0x55f7fcae06d0 2024-09-19T05:46:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f7fc8698f0 con 0x55f7fca946a0 2024-09-19T05:46:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f50b45000 10 client.0 _ll_register_callbacks cb 0x7f8f40009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:46:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcb54e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcb54e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48724/0 (socket says 172.21.15.67:48724) 2024-09-19T05:46:13.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 -- 172.21.15.67:0/3599194710 learned_addr learned my addr 172.21.15.67:0/3599194710 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f46ffd640 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 0x55f7fcb548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f477fe640 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fca946a0 0x55f7fcb54380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 -- 172.21.15.67:0/3599194710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fca946a0 msgr2=0x55f7fcb54380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fca946a0 0x55f7fcb54380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 -- 172.21.15.67:0/3599194710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 msgr2=0x55f7fcb548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 0x55f7fcb548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f47fff640 1 -- 172.21.15.67:0/3599194710 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fc8845b0 con 0x55f7fcae0ff0 2024-09-19T05:46:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.277+0000 7f8f477fe640 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fca946a0 0x55f7fcb54380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f47fff640 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcb54e00 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f8f4001cde0 tx=0x7f8f400a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1aabd2b9a4bfa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f267fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:46:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f267fc640 1 -- 172.21.15.67:0/3599194710 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400b2040 con 0x55f7fcae0ff0 2024-09-19T05:46:13.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f267fc640 1 -- 172.21.15.67:0/3599194710 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f8f40003d50 con 0x55f7fcae0ff0 2024-09-19T05:46:13.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f50b45000 1 -- 172.21.15.67:0/3599194710 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f40003ba0 con 0x55f7fcae0ff0 2024-09-19T05:46:13.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f267fc640 1 -- 172.21.15.67:0/3599194710 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) ==== 24+0+0 (secure 0 0 0) 0x7f8f400e1050 con 0x55f7fcae0ff0 2024-09-19T05:46:13.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f50b45000 10 client.9753 fetch_fsmap learned FSMap version 115 2024-09-19T05:46:13.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f50b45000 1 -- 172.21.15.67:0/3599194710 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) -- 0x55f7fc87c330 con 0x55f7fcae0ff0 2024-09-19T05:46:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f267fc640 1 -- 172.21.15.67:0/3599194710 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f40003ba0 con 0x55f7fcae0ff0 2024-09-19T05:46:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f267fc640 1 -- 172.21.15.67:0/3599194710 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 115) ==== 3502+0+0 (secure 0 0 0) 0x7f8f400e4020 con 0x55f7fcae0ff0 2024-09-19T05:46:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f50b45000 10 client.9753 fetch_fsmap finished waiting for FSMap version 115 2024-09-19T05:46:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f50b45000 10 client.9753 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-19T05:46:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f50b45000 20 client.9753 populate_metadata read hostname 'smithi067' 2024-09-19T05:46:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f50b45000 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55f7fcaf3190 0x55f7fcaf3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f50b45000 4 client.9753 mds_command: new command op to 9579 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-19T05:46:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f50b45000 1 -- 172.21.15.67:0/3599194710 --> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55f7fc8f22d0 con 0x55f7fcaf3190 2024-09-19T05:46:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f477fe640 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55f7fcaf3190 0x55f7fcaf3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f477fe640 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55f7fcaf3190 0x55f7fcaf3570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d4efaa7e31ad977 server_cookie=61fb23e555f83bf1 in_seq=0 out_seq=0 2024-09-19T05:46:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.281+0000 7f8f267fc640 10 client.9753 ms_handle_connect on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f267fc640 1 -- 172.21.15.67:0/3599194710 <== mds.0 v2:172.21.15.67:6834/1716781558 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f7fc8f22d0 con 0x55f7fcaf3190 2024-09-19T05:46:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f267fc640 10 client.9753 handle_command_reply: tid=0 2024-09-19T05:46:13.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 client.9753 shutdown 2024-09-19T05:46:13.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 -- 172.21.15.67:0/3599194710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 msgr2=0x55f7fcb54e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcb54e00 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f8f4001cde0 tx=0x7f8f400a7070 comp rx=0 tx=0).stop 2024-09-19T05:46:13.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 -- 172.21.15.67:0/3599194710 shutdown_connections 2024-09-19T05:46:13.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55f7fcaf3190 0x55f7fcaf3570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f7fcae0ff0 0x55f7fcb54e00 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f7fcae06d0 0x55f7fcb548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 --2- 172.21.15.67:0/3599194710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f7fca946a0 0x55f7fcb54380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 -- 172.21.15.67:0/3599194710 >> 172.21.15.67:0/3599194710 conn(0x55f7fcac1470 msgr2=0x55f7fca92930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f267fc640 0 client.9753 ms_handle_reset on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 -- 172.21.15.67:0/3599194710 shutdown_connections 2024-09-19T05:46:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 1 -- 172.21.15.67:0/3599194710 wait complete. 2024-09-19T05:46:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f50b45000 20 client.9753 trim_cache size 0 max 16384 2024-09-19T05:46:13.312 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:46:13.312 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:46:13.313 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "c6d5a099-1aa6-4cc9-8562-c977b17f741a", 2024-09-19T05:46:13.313 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:46:13.313 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 -- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8f340678c0 msgr2=0x7f8f34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8f340678c0 0x7f8f34069d80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8f38003d60 tx=0x7f8f38009040 comp rx=0 tx=0).stop 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 -- 172.21.15.67:0/3404368329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f480b2d80 msgr2=0x7f8f48155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f480b2d80 0x7f8f48155620 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c370 tx=0x7f8f3c00c830 comp rx=0 tx=0).stop 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 -- 172.21.15.67:0/3404368329 shutdown_connections 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f4815c500 0x7f8f4806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f480b2d80 0x7f8f48155620 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8f340678c0 0x7f8f34069d80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 --2- 172.21.15.67:0/3404368329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f4809b140 0x7f8f480cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 -- 172.21.15.67:0/3404368329 >> 172.21.15.67:0/3404368329 conn(0x7f8f480d2310 msgr2=0x7f8f48159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 -- 172.21.15.67:0/3404368329 shutdown_connections 2024-09-19T05:46:13.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.285+0000 7f8f4da89640 1 -- 172.21.15.67:0/3404368329 wait complete. 2024-09-19T05:46:13.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:46:13.317 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub pause 2024-09-19T05:46:13.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f228a0fd640 1 Processor -- start 2024-09-19T05:46:13.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f228a0fd640 1 -- start start 2024-09-19T05:46:13.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f228a0fd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22840b6c70 0x7f228406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f228a0fd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f22840cff60 0x7f22840d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f228a0fd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22840cf1a0 con 0x7f228415ea60 2024-09-19T05:46:13.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f228a0fd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f22840cf480 con 0x7f22840cff60 2024-09-19T05:46:13.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f228a0fd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f22840cf760 con 0x7f22840b6c70 2024-09-19T05:46:13.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f2283fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f22840cff60 0x7f22840d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f2283fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f22840cff60 0x7f22840d2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48726/0 (socket says 172.21.15.67:48726) 2024-09-19T05:46:13.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f2283fff640 1 -- 172.21.15.67:0/4124424993 learned_addr learned my addr 172.21.15.67:0/4124424993 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f22837fe640 1 --1- 172.21.15.67:0/4124424993 >> v1:172.21.15.67:6789/0 conn(0x7f228415ea60 0x7f22840b6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36642/0 (socket says 172.21.15.67:36642) 2024-09-19T05:46:13.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f2283fff640 1 -- 172.21.15.67:0/4124424993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22840b6c70 msgr2=0x7f228406d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f2283fff640 1 --2- 172.21.15.67:0/4124424993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22840b6c70 0x7f228406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f2283fff640 1 -- 172.21.15.67:0/4124424993 >> v1:172.21.15.67:6789/0 conn(0x7f228415ea60 legacy=0x7f22840b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.477+0000 7f2283fff640 1 -- 172.21.15.67:0/4124424993 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22840b3340 con 0x7f22840cff60 2024-09-19T05:46:13.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f2283fff640 1 --2- 172.21.15.67:0/4124424993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22840cff60 0x7f22840d2910 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f227c009e50 tx=0x7f227c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76708a1fd3380efc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f22827fc640 1 -- 172.21.15.67:0/4124424993 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0a5830 con 0x7f22840cff60 2024-09-19T05:46:13.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f22827fc640 1 -- 172.21.15.67:0/4124424993 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c0a59d0 con 0x7f22840cff60 2024-09-19T05:46:13.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f22827fc640 1 -- 172.21.15.67:0/4124424993 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0a5da0 con 0x7f22840cff60 2024-09-19T05:46:13.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f228a0fd640 1 -- 172.21.15.67:0/4124424993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22840cff60 msgr2=0x7f22840d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f228a0fd640 1 --2- 172.21.15.67:0/4124424993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22840cff60 0x7f22840d2910 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f227c009e50 tx=0x7f227c01ca50 comp rx=0 tx=0).stop 2024-09-19T05:46:13.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f228a0fd640 1 -- 172.21.15.67:0/4124424993 shutdown_connections 2024-09-19T05:46:13.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f228a0fd640 1 --2- 172.21.15.67:0/4124424993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22840cff60 0x7f22840d2910 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f228a0fd640 1 --2- 172.21.15.67:0/4124424993 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22840b6c70 0x7f228406d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f228a0fd640 1 -- 172.21.15.67:0/4124424993 >> 172.21.15.67:0/4124424993 conn(0x7f22840d1620 msgr2=0x7f22840d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f228a0fd640 1 -- 172.21.15.67:0/4124424993 shutdown_connections 2024-09-19T05:46:13.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.481+0000 7f228a0fd640 1 -- 172.21.15.67:0/4124424993 wait complete. 2024-09-19T05:46:13.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f228a0fd640 1 Processor -- start 2024-09-19T05:46:13.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f228a0fd640 1 -- start start 2024-09-19T05:46:13.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f228a0fd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22840b6c70 0x7f22840cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f228a0fd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22840cff60 0x7f2284153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f228a0fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415ea60 0x7f228415fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f228a0fd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f228416bca0 con 0x7f228415ea60 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f228a0fd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f228416bb20 con 0x7f22840b6c70 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f228a0fd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f228416be20 con 0x7f22840cff60 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f2283fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415ea60 0x7f228415fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f2283fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415ea60 0x7f228415fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48740/0 (socket says 172.21.15.67:48740) 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f2283fff640 1 -- 172.21.15.67:0/1824727844 learned_addr learned my addr 172.21.15.67:0/1824727844 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f22837fe640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22840b6c70 0x7f22840cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f2282ffd640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22840cff60 0x7f2284153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f2283fff640 1 -- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22840cff60 msgr2=0x7f2284153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f2283fff640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22840cff60 0x7f2284153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f2283fff640 1 -- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22840b6c70 msgr2=0x7f22840cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f2283fff640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22840b6c70 0x7f22840cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f2283fff640 1 -- 172.21.15.67:0/1824727844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2284157ec0 con 0x7f228415ea60 2024-09-19T05:46:13.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f2283fff640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415ea60 0x7f228415fac0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f227c0af040 tx=0x7f227c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f226bfff640 1 -- 172.21.15.67:0/1824727844 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0bc020 con 0x7f228415ea60 2024-09-19T05:46:13.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f226bfff640 1 -- 172.21.15.67:0/1824727844 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c0b8880 con 0x7f228415ea60 2024-09-19T05:46:13.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f228a0fd640 1 -- 172.21.15.67:0/1824727844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22841581a0 con 0x7f228415ea60 2024-09-19T05:46:13.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f226bfff640 1 -- 172.21.15.67:0/1824727844 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0b8c70 con 0x7f228415ea60 2024-09-19T05:46:13.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.485+0000 7f228a0fd640 1 -- 172.21.15.67:0/1824727844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2284158df0 con 0x7f228415ea60 2024-09-19T05:46:13.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f226bfff640 1 -- 172.21.15.67:0/1824727844 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f227c0bf020 con 0x7f228415ea60 2024-09-19T05:46:13.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f226bfff640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22700678f0 0x7f2270069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f226bfff640 1 -- 172.21.15.67:0/1824727844 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f227c120f80 con 0x7f228415ea60 2024-09-19T05:46:13.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f22837fe640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22700678f0 0x7f2270069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f228d1b9000 1 Processor -- start 2024-09-19T05:46:13.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f228d1b9000 1 -- start start 2024-09-19T05:46:13.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f22837fe640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22700678f0 0x7f2270069db0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2278000f70 tx=0x7f2278007cf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db8adff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db861240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db861b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f228d1b9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b0db6b2cc0 con 0x55b0db861780 2024-09-19T05:46:13.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f228d1b9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b0db66da20 con 0x55b0db8adc10 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f228d1b9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b0db6aec80 con 0x55b0db8ae530 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f2283fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db861b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f2283fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db861b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48756/0 (socket says 172.21.15.67:48756) 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f2283fff640 1 -- 172.21.15.67:0/138646702 learned_addr learned my addr 172.21.15.67:0/138646702 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f22837fe640 1 --2- 172.21.15.67:0/138646702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db8adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f2282ffd640 1 --2- 172.21.15.67:0/138646702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db861240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f2283fff640 1 -- 172.21.15.67:0/138646702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 msgr2=0x55b0db861240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f2283fff640 1 --2- 172.21.15.67:0/138646702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db861240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f2283fff640 1 -- 172.21.15.67:0/138646702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 msgr2=0x55b0db8adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f2283fff640 1 --2- 172.21.15.67:0/138646702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db8adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f2283fff640 1 -- 172.21.15.67:0/138646702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0db655d40 con 0x55b0db861780 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f2283fff640 1 --2- 172.21.15.67:0/138646702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db861b60 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f227c019660 tx=0x7f227c0f0f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef049eb1748e7b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f22697fa640 1 -- 172.21.15.67:0/138646702 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0f1380 con 0x55b0db861780 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f22697fa640 1 -- 172.21.15.67:0/138646702 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c0f5730 con 0x55b0db861780 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.489+0000 7f22697fa640 1 -- 172.21.15.67:0/138646702 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0f9f60 con 0x55b0db861780 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- 172.21.15.67:0/138646702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 msgr2=0x55b0db861b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 --2- 172.21.15.67:0/138646702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db861b60 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f227c019660 tx=0x7f227c0f0f80 comp rx=0 tx=0).stop 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- 172.21.15.67:0/138646702 shutdown_connections 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 --2- 172.21.15.67:0/138646702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db861b60 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 --2- 172.21.15.67:0/138646702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db861240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 --2- 172.21.15.67:0/138646702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db8adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- 172.21.15.67:0/138646702 >> 172.21.15.67:0/138646702 conn(0x55b0db88e9b0 msgr2=0x55b0db890da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- 172.21.15.67:0/138646702 shutdown_connections 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- 172.21.15.67:0/138646702 wait complete. 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- start start 2024-09-19T05:46:13.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 Processor -- start 2024-09-19T05:46:13.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db861780 0x55b0db8b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8adc10 0x55b0db8b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db8b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b0db64c2c0 con 0x55b0db8adc10 2024-09-19T05:46:13.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b0db671370 con 0x55b0db861780 2024-09-19T05:46:13.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b0db6c0f50 con 0x55b0db8ae530 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 10 client.0 _ll_register_callbacks cb 0x55b0db713db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f2282ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8adc10 0x55b0db8b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f2282ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8adc10 0x55b0db8b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48762/0 (socket says 172.21.15.67:48762) 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f2282ffd640 1 -- 172.21.15.67:0/242922435 learned_addr learned my addr 172.21.15.67:0/242922435 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f22837fe640 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db861780 0x55b0db8b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f2283fff640 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db8b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f2282ffd640 1 -- 172.21.15.67:0/242922435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 msgr2=0x55b0db8b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f2282ffd640 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db8b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f2282ffd640 1 -- 172.21.15.67:0/242922435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db861780 msgr2=0x55b0db8b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f2282ffd640 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db861780 0x55b0db8b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f2282ffd640 1 -- 172.21.15.67:0/242922435 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0db652770 con 0x55b0db8adc10 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f2282ffd640 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8adc10 0x55b0db8b52d0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f227400bf40 tx=0x7f227400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aa8e4060188768 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f22627fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:46:13.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f22627fc640 1 -- 172.21.15.67:0/242922435 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274018020 con 0x55b0db8adc10 2024-09-19T05:46:13.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f22627fc640 1 -- 172.21.15.67:0/242922435 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f2274014670 con 0x55b0db8adc10 2024-09-19T05:46:13.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- 172.21.15.67:0/242922435 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f227c0f5730 con 0x55b0db8adc10 2024-09-19T05:46:13.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f22627fc640 1 -- 172.21.15.67:0/242922435 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) ==== 24+0+0 (secure 0 0 0) 0x7f2274022050 con 0x55b0db8adc10 2024-09-19T05:46:13.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 10 client.9768 fetch_fsmap learned FSMap version 115 2024-09-19T05:46:13.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- 172.21.15.67:0/242922435 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) -- 0x55b0db6703f0 con 0x55b0db8adc10 2024-09-19T05:46:13.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f22627fc640 1 -- 172.21.15.67:0/242922435 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c0f5730 con 0x55b0db8adc10 2024-09-19T05:46:13.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f22627fc640 1 -- 172.21.15.67:0/242922435 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 115) ==== 3502+0+0 (secure 0 0 0) 0x7f2274025020 con 0x55b0db8adc10 2024-09-19T05:46:13.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 10 client.9768 fetch_fsmap finished waiting for FSMap version 115 2024-09-19T05:46:13.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 10 client.9768 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-19T05:46:13.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 20 client.9768 populate_metadata read hostname 'smithi067' 2024-09-19T05:46:13.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55b0db8bd160 0x55b0db8bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 4 client.9768 mds_command: new command op to 9579 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:46:13.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f228d1b9000 1 -- 172.21.15.67:0/242922435 --> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0db64cd90 con 0x55b0db8bd160 2024-09-19T05:46:13.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.493+0000 7f22837fe640 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55b0db8bd160 0x55b0db8bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f22837fe640 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55b0db8bd160 0x55b0db8bf550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d3d8c1b527de847 server_cookie=ae2d0c1ce63b173c in_seq=0 out_seq=0 2024-09-19T05:46:13.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f22627fc640 10 client.9768 ms_handle_connect on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f22627fc640 1 -- 172.21.15.67:0/242922435 <== mds.0 v2:172.21.15.67:6834/1716781558 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0db64cd90 con 0x55b0db8bd160 2024-09-19T05:46:13.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f22627fc640 10 client.9768 handle_command_reply: tid=0 2024-09-19T05:46:13.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 client.9768 shutdown 2024-09-19T05:46:13.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 -- 172.21.15.67:0/242922435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8adc10 msgr2=0x55b0db8b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8adc10 0x55b0db8b52d0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f227400bf40 tx=0x7f227400f670 comp rx=0 tx=0).stop 2024-09-19T05:46:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 -- 172.21.15.67:0/242922435 shutdown_connections 2024-09-19T05:46:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55b0db8bd160 0x55b0db8bf550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db8b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8adc10 0x55b0db8b52d0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f22627fc640 0 client.9768 ms_handle_reset on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 --2- 172.21.15.67:0/242922435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db861780 0x55b0db8b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 -- 172.21.15.67:0/242922435 >> 172.21.15.67:0/242922435 conn(0x55b0db88e9b0 msgr2=0x55b0db860940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 -- 172.21.15.67:0/242922435 shutdown_connections 2024-09-19T05:46:13.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 1 -- 172.21.15.67:0/242922435 wait complete. 2024-09-19T05:46:13.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.497+0000 7f228d1b9000 20 client.9768 trim_cache size 0 max 16384 2024-09-19T05:46:13.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.513+0000 7f228d1b9000 1 Processor -- start 2024-09-19T05:46:13.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.513+0000 7f228d1b9000 1 -- start start 2024-09-19T05:46:13.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.513+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db869d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.513+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db860a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.513+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db860f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.513+0000 7f228d1b9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f22841556e0 con 0x55b0db861780 2024-09-19T05:46:13.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.513+0000 7f228d1b9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2284156f70 con 0x55b0db8adc10 2024-09-19T05:46:13.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.513+0000 7f228d1b9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2284155090 con 0x55b0db8ae530 2024-09-19T05:46:13.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db869d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db869d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48766/0 (socket says 172.21.15.67:48766) 2024-09-19T05:46:13.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22837fe640 1 -- 172.21.15.67:0/2599580056 learned_addr learned my addr 172.21.15.67:0/2599580056 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22837fe640 1 -- 172.21.15.67:0/2599580056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 msgr2=0x55b0db860f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2283fff640 1 --2- 172.21.15.67:0/2599580056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db860f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22837fe640 1 --2- 172.21.15.67:0/2599580056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db860f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22837fe640 1 -- 172.21.15.67:0/2599580056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 msgr2=0x55b0db860a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22837fe640 1 --2- 172.21.15.67:0/2599580056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db860a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22837fe640 1 -- 172.21.15.67:0/2599580056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0db734320 con 0x55b0db861780 2024-09-19T05:46:13.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22837fe640 1 --2- 172.21.15.67:0/2599580056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db869d40 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f22780077f0 tx=0x7f2278017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15012f99adb3e7b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2268ff9640 1 -- 172.21.15.67:0/2599580056 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278028040 con 0x55b0db861780 2024-09-19T05:46:13.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2268ff9640 1 -- 172.21.15.67:0/2599580056 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22780150d0 con 0x55b0db861780 2024-09-19T05:46:13.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2268ff9640 1 -- 172.21.15.67:0/2599580056 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780152a0 con 0x55b0db861780 2024-09-19T05:46:13.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 -- 172.21.15.67:0/2599580056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 msgr2=0x55b0db869d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 --2- 172.21.15.67:0/2599580056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db869d40 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f22780077f0 tx=0x7f2278017040 comp rx=0 tx=0).stop 2024-09-19T05:46:13.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 -- 172.21.15.67:0/2599580056 shutdown_connections 2024-09-19T05:46:13.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 --2- 172.21.15.67:0/2599580056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db8ae530 0x55b0db860f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 --2- 172.21.15.67:0/2599580056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db860a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 --2- 172.21.15.67:0/2599580056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db861780 0x55b0db869d40 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 -- 172.21.15.67:0/2599580056 >> 172.21.15.67:0/2599580056 conn(0x55b0db88e9b0 msgr2=0x55b0db868df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 -- 172.21.15.67:0/2599580056 shutdown_connections 2024-09-19T05:46:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 -- 172.21.15.67:0/2599580056 wait complete. 2024-09-19T05:46:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 -- start start 2024-09-19T05:46:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 Processor -- start 2024-09-19T05:46:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db861780 0x55b0db921150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db921690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8ae530 0x55b0db8ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b0db65a120 con 0x55b0db8ae530 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b0db733e90 con 0x55b0db8adc10 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55b0db65cb90 con 0x55b0db861780 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 10 client.0 _ll_register_callbacks cb 0x7f227400b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2283fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8ae530 0x55b0db8ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2283fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8ae530 0x55b0db8ba0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48776/0 (socket says 172.21.15.67:48776) 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2283fff640 1 -- 172.21.15.67:0/1114214502 learned_addr learned my addr 172.21.15.67:0/1114214502 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22837fe640 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db861780 0x55b0db921150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2282ffd640 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db921690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2283fff640 1 -- 172.21.15.67:0/1114214502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db861780 msgr2=0x55b0db921150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2283fff640 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db861780 0x55b0db921150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2283fff640 1 -- 172.21.15.67:0/1114214502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 msgr2=0x55b0db921690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2283fff640 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db921690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2283fff640 1 -- 172.21.15.67:0/1114214502 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0db6465c0 con 0x55b0db8ae530 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2282ffd640 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db921690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f2283fff640 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8ae530 0x55b0db8ba0f0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f227c01a680 tx=0x7f227c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db63a46a67f377d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22627fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22627fc640 1 -- 172.21.15.67:0/1114214502 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0f5730 con 0x55b0db8ae530 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f22627fc640 1 -- 172.21.15.67:0/1114214502 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f227c10fd10 con 0x55b0db8ae530 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.517+0000 7f228d1b9000 1 -- 172.21.15.67:0/1114214502 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22780150d0 con 0x55b0db8ae530 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f22627fc640 1 -- 172.21.15.67:0/1114214502 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) ==== 24+0+0 (secure 0 0 0) 0x7f227c0f9f60 con 0x55b0db8ae530 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 10 client.9774 fetch_fsmap learned FSMap version 115 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 -- 172.21.15.67:0/1114214502 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) -- 0x55b0db64a330 con 0x55b0db8ae530 2024-09-19T05:46:13.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f22627fc640 1 -- 172.21.15.67:0/1114214502 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22780150d0 con 0x55b0db8ae530 2024-09-19T05:46:13.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f22627fc640 1 -- 172.21.15.67:0/1114214502 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 115) ==== 3502+0+0 (secure 0 0 0) 0x7f227c0f15e0 con 0x55b0db8ae530 2024-09-19T05:46:13.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 10 client.9774 fetch_fsmap finished waiting for FSMap version 115 2024-09-19T05:46:13.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 10 client.9774 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-19T05:46:13.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 20 client.9774 populate_metadata read hostname 'smithi067' 2024-09-19T05:46:13.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55b0db8ba630 0x55b0db8baa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 4 client.9774 mds_command: new command op to 9579 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-19T05:46:13.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 -- 172.21.15.67:0/1114214502 --> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55b0db6c03f0 con 0x55b0db8ba630 2024-09-19T05:46:13.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f22837fe640 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55b0db8ba630 0x55b0db8baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f22627fc640 10 client.9774 ms_handle_connect on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f22837fe640 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55b0db8ba630 0x55b0db8baa40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=214dafb8e160da4a server_cookie=59a855258e3c2fe7 in_seq=0 out_seq=0 2024-09-19T05:46:13.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f22627fc640 1 -- 172.21.15.67:0/1114214502 <== mds.0 v2:172.21.15.67:6834/1716781558 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b0db6c03f0 con 0x55b0db8ba630 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f22627fc640 10 client.9774 handle_command_reply: tid=0 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 client.9774 shutdown 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 -- 172.21.15.67:0/1114214502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8ae530 msgr2=0x55b0db8ba0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8ae530 0x55b0db8ba0f0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f227c01a680 tx=0x7f227c009810 comp rx=0 tx=0).stop 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 -- 172.21.15.67:0/1114214502 shutdown_connections 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x55b0db8ba630 0x55b0db8baa40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0db8ae530 0x55b0db8ba0f0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f22627fc640 0 client.9774 ms_handle_reset on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b0db8adc10 0x55b0db921690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 --2- 172.21.15.67:0/1114214502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55b0db861780 0x55b0db921150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 -- 172.21.15.67:0/1114214502 >> 172.21.15.67:0/1114214502 conn(0x55b0db88e9b0 msgr2=0x55b0db869610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 -- 172.21.15.67:0/1114214502 shutdown_connections 2024-09-19T05:46:13.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 1 -- 172.21.15.67:0/1114214502 wait complete. 2024-09-19T05:46:13.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228d1b9000 20 client.9774 trim_cache size 0 max 16384 2024-09-19T05:46:13.540 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:46:13.540 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-09-19T05:46:13.540 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0 2024-09-19T05:46:13.541 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:46:13.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 -- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22700678f0 msgr2=0x7f2270069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22700678f0 0x7f2270069db0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2278000f70 tx=0x7f2278007cf0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 -- 172.21.15.67:0/1824727844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415ea60 msgr2=0x7f228415fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415ea60 0x7f228415fac0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f227c0af040 tx=0x7f227c0197f0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 -- 172.21.15.67:0/1824727844 shutdown_connections 2024-09-19T05:46:13.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415ea60 0x7f228415fac0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22700678f0 0x7f2270069db0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22840cff60 0x7f2284153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 --2- 172.21.15.67:0/1824727844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22840b6c70 0x7f22840cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 -- 172.21.15.67:0/1824727844 >> 172.21.15.67:0/1824727844 conn(0x7f22840d1620 msgr2=0x7f22840b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 -- 172.21.15.67:0/1824727844 shutdown_connections 2024-09-19T05:46:13.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.521+0000 7f228a0fd640 1 -- 172.21.15.67:0/1824727844 wait complete. 2024-09-19T05:46:13.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:46:13.545 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub status 2024-09-19T05:46:13.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.665+0000 7f2769218640 1 Processor -- start 2024-09-19T05:46:13.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.665+0000 7f2769218640 1 -- start start 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f2769218640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2764159c60 0x7f27640ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f2769218640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f276406ffd0 0x7f27640aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f2769218640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276415a040 con 0x7f27640b3150 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f2769218640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f276415d460 con 0x7f276406ffd0 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f2769218640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f276415c850 con 0x7f2764159c60 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f275bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f276406ffd0 0x7f27640aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f275bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f276406ffd0 0x7f27640aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48784/0 (socket says 172.21.15.67:48784) 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f275bfff640 1 -- 172.21.15.67:0/2619381238 learned_addr learned my addr 172.21.15.67:0/2619381238 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f2762d9d640 1 --2- 172.21.15.67:0/2619381238 >> v2:172.21.15.97:3300/0 conn(0x7f2764159c60 0x7f27640ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f276259c640 1 -- 172.21.15.67:0/2619381238 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688074983 0 0) 0x7f276415a040 con 0x7f27640b3150 2024-09-19T05:46:13.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f276259c640 1 -- 172.21.15.67:0/2619381238 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2750003530 con 0x7f27640b3150 2024-09-19T05:46:13.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f275bfff640 1 -- 172.21.15.67:0/2619381238 >> v2:172.21.15.97:3300/0 conn(0x7f2764159c60 msgr2=0x7f27640ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f275bfff640 1 --2- 172.21.15.67:0/2619381238 >> v2:172.21.15.97:3300/0 conn(0x7f2764159c60 0x7f27640ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f275bfff640 1 -- 172.21.15.67:0/2619381238 >> v1:172.21.15.67:6789/0 conn(0x7f27640b3150 legacy=0x7f276415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f275bfff640 1 -- 172.21.15.67:0/2619381238 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276415cb30 con 0x7f276406ffd0 2024-09-19T05:46:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.669+0000 7f275bfff640 1 --2- 172.21.15.67:0/2619381238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276406ffd0 0x7f27640aec90 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f27640712f0 tx=0x7f274c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd69fd157d27f832 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276259c640 1 -- 172.21.15.67:0/2619381238 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0aa650 con 0x7f276406ffd0 2024-09-19T05:46:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276259c640 1 -- 172.21.15.67:0/2619381238 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c0af070 con 0x7f276406ffd0 2024-09-19T05:46:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276259c640 1 -- 172.21.15.67:0/2619381238 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0aa9f0 con 0x7f276406ffd0 2024-09-19T05:46:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- 172.21.15.67:0/2619381238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276406ffd0 msgr2=0x7f27640aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 --2- 172.21.15.67:0/2619381238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276406ffd0 0x7f27640aec90 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f27640712f0 tx=0x7f274c01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- 172.21.15.67:0/2619381238 shutdown_connections 2024-09-19T05:46:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 --2- 172.21.15.67:0/2619381238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f276406ffd0 0x7f27640aec90 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 --2- 172.21.15.67:0/2619381238 >> v2:172.21.15.97:3300/0 conn(0x7f2764159c60 0x7f27640ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- 172.21.15.67:0/2619381238 >> 172.21.15.67:0/2619381238 conn(0x7f27640b1e50 msgr2=0x7f27640b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- 172.21.15.67:0/2619381238 shutdown_connections 2024-09-19T05:46:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- 172.21.15.67:0/2619381238 wait complete. 2024-09-19T05:46:13.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 Processor -- start 2024-09-19T05:46:13.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- start start 2024-09-19T05:46:13.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276406ffd0 0x7f276409b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27640b3150 0x7f27640b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2764159c60 0x7f27641511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f27640ad7f0 con 0x7f2764159c60 2024-09-19T05:46:13.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f27640ad670 con 0x7f276406ffd0 2024-09-19T05:46:13.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2764168e30 con 0x7f27640b3150 2024-09-19T05:46:13.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276359e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2764159c60 0x7f27641511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276359e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2764159c60 0x7f27641511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48790/0 (socket says 172.21.15.67:48790) 2024-09-19T05:46:13.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276359e640 1 -- 172.21.15.67:0/4249776668 learned_addr learned my addr 172.21.15.67:0/4249776668 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2762d9d640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276406ffd0 0x7f276409b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f275bfff640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27640b3150 0x7f27640b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276359e640 1 -- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27640b3150 msgr2=0x7f27640b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276359e640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27640b3150 0x7f27640b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276359e640 1 -- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276406ffd0 msgr2=0x7f276409b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276359e640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276406ffd0 0x7f276409b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276359e640 1 -- 172.21.15.67:0/4249776668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27640b16a0 con 0x7f2764159c60 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f276359e640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2764159c60 0x7f27641511e0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f275c00c770 tx=0x7f275c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f275b7fe640 1 -- 172.21.15.67:0/4249776668 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c003b80 con 0x7f2764159c60 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f275b7fe640 1 -- 172.21.15.67:0/4249776668 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275c003d20 con 0x7f2764159c60 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- 172.21.15.67:0/4249776668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2764151720 con 0x7f2764159c60 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f275b7fe640 1 -- 172.21.15.67:0/4249776668 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c00aa90 con 0x7f2764159c60 2024-09-19T05:46:13.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.673+0000 7f2769218640 1 -- 172.21.15.67:0/4249776668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276409bc50 con 0x7f2764159c60 2024-09-19T05:46:13.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f275b7fe640 1 -- 172.21.15.67:0/4249776668 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f275c00ac30 con 0x7f2764159c60 2024-09-19T05:46:13.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f275b7fe640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27440678c0 0x7f2744069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f275b7fe640 1 -- 172.21.15.67:0/4249776668 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f275c085de0 con 0x7f2764159c60 2024-09-19T05:46:13.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f2762d9d640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27440678c0 0x7f2744069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f276c2d4000 1 Processor -- start 2024-09-19T05:46:13.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f276c2d4000 1 -- start start 2024-09-19T05:46:13.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f2762d9d640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27440678c0 0x7f2744069d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2764165ea0 tx=0x7f2754008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c71dd70 0x56389c71e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 0x56389c6d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c6d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f276c2d4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56389c5bb960 con 0x56389c71dd70 2024-09-19T05:46:13.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f276c2d4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56389c4ff900 con 0x56389c71e690 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f276c2d4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56389c522d40 con 0x56389c6d1db0 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.677+0000 7f2762d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c71dd70 0x56389c71e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c71dd70 0x56389c71e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48798/0 (socket says 172.21.15.67:48798) 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 -- 172.21.15.67:0/3199291394 learned_addr learned my addr 172.21.15.67:0/3199291394 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276359e640 1 --2- 172.21.15.67:0/3199291394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c6d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f275bfff640 1 --2- 172.21.15.67:0/3199291394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 0x56389c6d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 -- 172.21.15.67:0/3199291394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 msgr2=0x56389c6d2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 --2- 172.21.15.67:0/3199291394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c6d2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 -- 172.21.15.67:0/3199291394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 msgr2=0x56389c6d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 --2- 172.21.15.67:0/3199291394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 0x56389c6d1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 -- 172.21.15.67:0/3199291394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56389c4c9580 con 0x56389c71dd70 2024-09-19T05:46:13.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 --2- 172.21.15.67:0/3199291394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c71dd70 0x56389c71e150 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f2754011d90 tx=0x7f2754014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410b2200ff9fa09b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2758ff9640 1 -- 172.21.15.67:0/3199291394 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754011dc0 con 0x56389c71dd70 2024-09-19T05:46:13.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2758ff9640 1 -- 172.21.15.67:0/3199291394 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2754026070 con 0x56389c71dd70 2024-09-19T05:46:13.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2758ff9640 1 -- 172.21.15.67:0/3199291394 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754021640 con 0x56389c71dd70 2024-09-19T05:46:13.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 -- 172.21.15.67:0/3199291394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c71dd70 msgr2=0x56389c71e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 --2- 172.21.15.67:0/3199291394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c71dd70 0x56389c71e150 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f2754011d90 tx=0x7f2754014000 comp rx=0 tx=0).stop 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 -- 172.21.15.67:0/3199291394 shutdown_connections 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 --2- 172.21.15.67:0/3199291394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c6d2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 --2- 172.21.15.67:0/3199291394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 0x56389c6d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 --2- 172.21.15.67:0/3199291394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c71dd70 0x56389c71e150 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 -- 172.21.15.67:0/3199291394 >> 172.21.15.67:0/3199291394 conn(0x56389c6ff040 msgr2=0x56389c701430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 -- 172.21.15.67:0/3199291394 shutdown_connections 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 -- 172.21.15.67:0/3199291394 wait complete. 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 -- start start 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 Processor -- start 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d1db0 0x56389c724ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c71dd70 0x56389c725220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 0x56389c725760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56389c51ed00 con 0x56389c6d1db0 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56389c4ddaa0 con 0x56389c71e690 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56389c4bc340 con 0x56389c71dd70 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 10 client.0 _ll_register_callbacks cb 0x56389c6bf760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d1db0 0x56389c724ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d1db0 0x56389c724ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48810/0 (socket says 172.21.15.67:48810) 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 -- 172.21.15.67:0/643090203 learned_addr learned my addr 172.21.15.67:0/643090203 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f275bfff640 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c71dd70 0x56389c725220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276359e640 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 0x56389c725760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 -- 172.21.15.67:0/643090203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c71dd70 msgr2=0x56389c725220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c71dd70 0x56389c725220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 -- 172.21.15.67:0/643090203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 msgr2=0x56389c725760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 0x56389c725760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 -- 172.21.15.67:0/643090203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56389c4c5dc0 con 0x56389c6d1db0 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276359e640 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 0x56389c725760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f275bfff640 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c71dd70 0x56389c725220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2762d9d640 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d1db0 0x56389c724ce0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f27540099b0 tx=0x7f27540046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f90b7332dd3c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2741ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2741ffb640 1 -- 172.21.15.67:0/643090203 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754021b10 con 0x56389c6d1db0 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f2741ffb640 1 -- 172.21.15.67:0/643090203 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f2754021cb0 con 0x56389c6d1db0 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.681+0000 7f276c2d4000 1 -- 172.21.15.67:0/643090203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2754026070 con 0x56389c6d1db0 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f2741ffb640 1 -- 172.21.15.67:0/643090203 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) ==== 24+0+0 (secure 0 0 0) 0x7f275403e050 con 0x56389c6d1db0 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 10 client.9789 fetch_fsmap learned FSMap version 115 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 -- 172.21.15.67:0/643090203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) -- 0x56389c4c27f0 con 0x56389c6d1db0 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f2741ffb640 1 -- 172.21.15.67:0/643090203 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2754026070 con 0x56389c6d1db0 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f2741ffb640 1 -- 172.21.15.67:0/643090203 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 115) ==== 3502+0+0 (secure 0 0 0) 0x7f2754041020 con 0x56389c6d1db0 2024-09-19T05:46:13.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 10 client.9789 fetch_fsmap finished waiting for FSMap version 115 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 10 client.9789 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 20 client.9789 populate_metadata read hostname 'smithi067' 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x56389c72d0b0 0x56389c72f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 4 client.9789 mds_command: new command op to 9579 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 -- 172.21.15.67:0/643090203 --> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56389c4bce10 con 0x56389c72d0b0 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f275bfff640 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x56389c72d0b0 0x56389c72f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f2741ffb640 10 client.9789 ms_handle_connect on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f275bfff640 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x56389c72d0b0 0x56389c72f4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=513e77be73567280 server_cookie=d6ae3abfb670a833 in_seq=0 out_seq=0 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f2741ffb640 1 -- 172.21.15.67:0/643090203 <== mds.0 v2:172.21.15.67:6834/1716781558 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56389c4bce10 con 0x56389c72d0b0 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f2741ffb640 10 client.9789 handle_command_reply: tid=0 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 client.9789 shutdown 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 -- 172.21.15.67:0/643090203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d1db0 msgr2=0x56389c724ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d1db0 0x56389c724ce0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f27540099b0 tx=0x7f27540046d0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 -- 172.21.15.67:0/643090203 shutdown_connections 2024-09-19T05:46:13.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x56389c72d0b0 0x56389c72f4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c71e690 0x56389c725760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c71dd70 0x56389c725220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 --2- 172.21.15.67:0/643090203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d1db0 0x56389c724ce0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f2741ffb640 0 client.9789 ms_handle_reset on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 -- 172.21.15.67:0/643090203 >> 172.21.15.67:0/643090203 conn(0x56389c6ff040 msgr2=0x56389c6d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 -- 172.21.15.67:0/643090203 shutdown_connections 2024-09-19T05:46:13.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 1 -- 172.21.15.67:0/643090203 wait complete. 2024-09-19T05:46:13.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.685+0000 7f276c2d4000 20 client.9789 trim_cache size 0 max 16384 2024-09-19T05:46:13.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 Processor -- start 2024-09-19T05:46:13.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- start start 2024-09-19T05:46:13.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6d6770 0x56389c78e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6ff040 0x56389c78e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c78ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f27642040c0 con 0x56389c6ff040 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f27642030e0 con 0x56389c6d6770 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f27641f84f0 con 0x56389c6d1db0 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f275bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6ff040 0x56389c78e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f275bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6ff040 0x56389c78e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48816/0 (socket says 172.21.15.67:48816) 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f275bfff640 1 -- 172.21.15.67:0/3756049989 learned_addr learned my addr 172.21.15.67:0/3756049989 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f275bfff640 1 -- 172.21.15.67:0/3756049989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 msgr2=0x56389c78ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f2762d9d640 1 --2- 172.21.15.67:0/3756049989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6d6770 0x56389c78e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f275bfff640 1 --2- 172.21.15.67:0/3756049989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c78ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f275bfff640 1 -- 172.21.15.67:0/3756049989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6d6770 msgr2=0x56389c78e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f275bfff640 1 --2- 172.21.15.67:0/3756049989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6d6770 0x56389c78e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f275bfff640 1 -- 172.21.15.67:0/3756049989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56389c4e0470 con 0x56389c6ff040 2024-09-19T05:46:13.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f275bfff640 1 --2- 172.21.15.67:0/3756049989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6ff040 0x56389c78e700 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f274c0090b0 tx=0x7f274c0a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99147f5c3d1b8ece server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f2743fff640 1 -- 172.21.15.67:0/3756049989 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0044e0 con 0x56389c6ff040 2024-09-19T05:46:13.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f2743fff640 1 -- 172.21.15.67:0/3756049989 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c0af040 con 0x56389c6ff040 2024-09-19T05:46:13.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f2743fff640 1 -- 172.21.15.67:0/3756049989 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c003820 con 0x56389c6ff040 2024-09-19T05:46:13.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- 172.21.15.67:0/3756049989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6ff040 msgr2=0x56389c78e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 --2- 172.21.15.67:0/3756049989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6ff040 0x56389c78e700 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f274c0090b0 tx=0x7f274c0a7000 comp rx=0 tx=0).stop 2024-09-19T05:46:13.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- 172.21.15.67:0/3756049989 shutdown_connections 2024-09-19T05:46:13.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 --2- 172.21.15.67:0/3756049989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c78ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 --2- 172.21.15.67:0/3756049989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6ff040 0x56389c78e700 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 --2- 172.21.15.67:0/3756049989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6d6770 0x56389c78e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- 172.21.15.67:0/3756049989 >> 172.21.15.67:0/3756049989 conn(0x56389c71d5c0 msgr2=0x56389c6d8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- 172.21.15.67:0/3756049989 shutdown_connections 2024-09-19T05:46:13.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- 172.21.15.67:0/3756049989 wait complete. 2024-09-19T05:46:13.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- start start 2024-09-19T05:46:13.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 Processor -- start 2024-09-19T05:46:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c792590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d6770 0x56389c792ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6ff040 0x56389c78ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56389c530fd0 con 0x56389c6d6770 2024-09-19T05:46:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2764202bf0 con 0x56389c6ff040 2024-09-19T05:46:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.705+0000 7f276c2d4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56389c5df0c0 con 0x56389c6d1db0 2024-09-19T05:46:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 10 client.0 _ll_register_callbacks cb 0x7f2754011c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:46:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f275bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d6770 0x56389c792ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f275bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d6770 0x56389c792ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48824/0 (socket says 172.21.15.67:48824) 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f275bfff640 1 -- 172.21.15.67:0/111093931 learned_addr learned my addr 172.21.15.67:0/111093931 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276359e640 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6ff040 0x56389c78ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2762d9d640 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c792590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f275bfff640 1 -- 172.21.15.67:0/111093931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 msgr2=0x56389c792590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f275bfff640 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c792590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f275bfff640 1 -- 172.21.15.67:0/111093931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6ff040 msgr2=0x56389c78ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f275bfff640 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6ff040 0x56389c78ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f275bfff640 1 -- 172.21.15.67:0/111093931 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56389c4b6640 con 0x56389c6d6770 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276359e640 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6ff040 0x56389c78ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f275bfff640 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d6770 0x56389c792ad0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f274c01aba0 tx=0x7f274c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3ff175ef0ce357 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2741ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2741ffb640 1 -- 172.21.15.67:0/111093931 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c003620 con 0x56389c6d6770 2024-09-19T05:46:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2741ffb640 1 -- 172.21.15.67:0/111093931 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f274c0037c0 con 0x56389c6d6770 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 -- 172.21.15.67:0/111093931 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f274c0af040 con 0x56389c6d6770 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2741ffb640 1 -- 172.21.15.67:0/111093931 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) ==== 24+0+0 (secure 0 0 0) 0x7f274c0cc050 con 0x56389c6d6770 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 10 client.9795 fetch_fsmap learned FSMap version 115 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 -- 172.21.15.67:0/111093931 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) -- 0x56389c4ba3b0 con 0x56389c6d6770 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2741ffb640 1 -- 172.21.15.67:0/111093931 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c0af040 con 0x56389c6d6770 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2741ffb640 1 -- 172.21.15.67:0/111093931 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 115) ==== 3502+0+0 (secure 0 0 0) 0x7f274c0cf020 con 0x56389c6d6770 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 10 client.9795 fetch_fsmap finished waiting for FSMap version 115 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 10 client.9795 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 20 client.9795 populate_metadata read hostname 'smithi067' 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x56389c71dd70 0x56389c78f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 4 client.9795 mds_command: new command op to 9579 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 -- 172.21.15.67:0/111093931 --> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56389c530470 con 0x56389c71dd70 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2762d9d640 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x56389c71dd70 0x56389c78f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2741ffb640 10 client.9795 ms_handle_connect on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2762d9d640 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x56389c71dd70 0x56389c78f250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83081c9b06feacc server_cookie=8e35e80bb155533d in_seq=0 out_seq=0 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2741ffb640 1 -- 172.21.15.67:0/111093931 <== mds.0 v2:172.21.15.67:6834/1716781558 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x56389c530470 con 0x56389c71dd70 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2741ffb640 10 client.9795 handle_command_reply: tid=0 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 client.9795 shutdown 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 -- 172.21.15.67:0/111093931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d6770 msgr2=0x56389c792ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d6770 0x56389c792ad0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f274c01aba0 tx=0x7f274c01ad30 comp rx=0 tx=0).stop 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 -- 172.21.15.67:0/111093931 shutdown_connections 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.67:6834/1716781558,v1:172.21.15.67:6835/1716781558] conn(0x56389c71dd70 0x56389c78f250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56389c6ff040 0x56389c78ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56389c6d6770 0x56389c792ad0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 --2- 172.21.15.67:0/111093931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56389c6d1db0 0x56389c792590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 -- 172.21.15.67:0/111093931 >> 172.21.15.67:0/111093931 conn(0x56389c71d5c0 msgr2=0x56389c6d9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2741ffb640 0 client.9795 ms_handle_reset on v2:172.21.15.67:6834/1716781558 2024-09-19T05:46:13.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 -- 172.21.15.67:0/111093931 shutdown_connections 2024-09-19T05:46:13.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 1 -- 172.21.15.67:0/111093931 wait complete. 2024-09-19T05:46:13.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f276c2d4000 20 client.9795 trim_cache size 0 max 16384 2024-09-19T05:46:13.720 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:46:13.720 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-19T05:46:13.720 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-19T05:46:13.720 INFO:teuthology.orchestra.run.smithi067.stdout: "c6d5a099-1aa6-4cc9-8562-c977b17f741a": { 2024-09-19T05:46:13.720 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/scrub_control_test_path", 2024-09-19T05:46:13.720 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "c6d5a099-1aa6-4cc9-8562-c977b17f741a", 2024-09-19T05:46:13.721 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive" 2024-09-19T05:46:13.721 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:13.721 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:13.721 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:46:13.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 -- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27440678c0 msgr2=0x7f2744069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27440678c0 0x7f2744069d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2764165ea0 tx=0x7f2754008040 comp rx=0 tx=0).stop 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 -- 172.21.15.67:0/4249776668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2764159c60 msgr2=0x7f27641511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2764159c60 0x7f27641511e0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f275c00c770 tx=0x7f275c00cc30 comp rx=0 tx=0).stop 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 -- 172.21.15.67:0/4249776668 shutdown_connections 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2764159c60 0x7f27641511e0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f27440678c0 0x7f2744069d80 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27640b3150 0x7f27640b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 --2- 172.21.15.67:0/4249776668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276406ffd0 0x7f276409b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 -- 172.21.15.67:0/4249776668 >> 172.21.15.67:0/4249776668 conn(0x7f27640b1e50 msgr2=0x7f27640b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 -- 172.21.15.67:0/4249776668 shutdown_connections 2024-09-19T05:46:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.709+0000 7f2769218640 1 -- 172.21.15.67:0/4249776668 wait complete. 2024-09-19T05:46:13.726 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:13.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.841+0000 7f6b51a18640 1 Processor -- start 2024-09-19T05:46:13.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.841+0000 7f6b51a18640 1 -- start start 2024-09-19T05:46:13.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b51a18640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b4c06dde0 0x7f6b4c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b51a18640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6b4c0b3510 0x7f6b4c06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b51a18640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b4c06e3c0 con 0x7f6b4c15c030 2024-09-19T05:46:13.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b51a18640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4c06e6a0 con 0x7f6b4c06dde0 2024-09-19T05:46:13.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b51a18640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4c06e980 con 0x7f6b4c0b3510 2024-09-19T05:46:13.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b4a7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b4c06dde0 0x7f6b4c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b4a7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b4c06dde0 0x7f6b4c0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48838/0 (socket says 172.21.15.67:48838) 2024-09-19T05:46:13.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b4a7fc640 1 -- 172.21.15.67:0/1276508156 learned_addr learned my addr 172.21.15.67:0/1276508156 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b4b7fe640 1 --2- 172.21.15.67:0/1276508156 >> v2:172.21.15.97:3300/0 conn(0x7f6b4c0b3510 0x7f6b4c06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b4a7fc640 1 -- 172.21.15.67:0/1276508156 >> v2:172.21.15.97:3300/0 conn(0x7f6b4c0b3510 msgr2=0x7f6b4c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:13.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b4a7fc640 1 --2- 172.21.15.67:0/1276508156 >> v2:172.21.15.97:3300/0 conn(0x7f6b4c0b3510 0x7f6b4c06f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b4a7fc640 1 -- 172.21.15.67:0/1276508156 >> v1:172.21.15.97:6789/0 conn(0x7f6b4c15c030 legacy=0x7f6b4c15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.845+0000 7f6b4a7fc640 1 -- 172.21.15.67:0/1276508156 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c06ec60 con 0x7f6b4c06dde0 2024-09-19T05:46:13.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4a7fc640 1 --2- 172.21.15.67:0/1276508156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 0x7f6b4c0b2fd0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0afbf0 tx=0x7f6b4001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafda47c58800e7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b49ffb640 1 -- 172.21.15.67:0/1276508156 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400a5790 con 0x7f6b4c06dde0 2024-09-19T05:46:13.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b49ffb640 1 -- 172.21.15.67:0/1276508156 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b400a5930 con 0x7f6b4c06dde0 2024-09-19T05:46:13.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b49ffb640 1 -- 172.21.15.67:0/1276508156 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400a5d00 con 0x7f6b4c06dde0 2024-09-19T05:46:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 -- 172.21.15.67:0/1276508156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 msgr2=0x7f6b4c0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 --2- 172.21.15.67:0/1276508156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 0x7f6b4c0b2fd0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0afbf0 tx=0x7f6b4001c9c0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 -- 172.21.15.67:0/1276508156 shutdown_connections 2024-09-19T05:46:13.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 --2- 172.21.15.67:0/1276508156 >> v2:172.21.15.97:3300/0 conn(0x7f6b4c0b3510 0x7f6b4c06f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 --2- 172.21.15.67:0/1276508156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 0x7f6b4c0b2fd0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 -- 172.21.15.67:0/1276508156 >> 172.21.15.67:0/1276508156 conn(0x7f6b4c0d0080 msgr2=0x7f6b4c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:13.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 -- 172.21.15.67:0/1276508156 shutdown_connections 2024-09-19T05:46:13.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 -- 172.21.15.67:0/1276508156 wait complete. 2024-09-19T05:46:13.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 Processor -- start 2024-09-19T05:46:13.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 -- start start 2024-09-19T05:46:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 0x7f6b4c099b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b4c0b3510 0x7f6b4c141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b4c15c030 0x7f6b4c09a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c1692f0 con 0x7f6b4c06dde0 2024-09-19T05:46:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c15c620 con 0x7f6b4c15c030 2024-09-19T05:46:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b51a18640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4c169470 con 0x7f6b4c0b3510 2024-09-19T05:46:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 0x7f6b4c099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 0x7f6b4c099b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48844/0 (socket says 172.21.15.67:48844) 2024-09-19T05:46:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4affd640 1 -- 172.21.15.67:0/1596358632 learned_addr learned my addr 172.21.15.67:0/1596358632 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4b7fe640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b4c15c030 0x7f6b4c09a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4a7fc640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b4c0b3510 0x7f6b4c141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4affd640 1 -- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b4c0b3510 msgr2=0x7f6b4c141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4affd640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b4c0b3510 0x7f6b4c141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4affd640 1 -- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b4c15c030 msgr2=0x7f6b4c09a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4affd640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b4c15c030 0x7f6b4c09a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:13.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.849+0000 7f6b4affd640 1 -- 172.21.15.67:0/1596358632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c15b630 con 0x7f6b4c06dde0 2024-09-19T05:46:13.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b4a7fc640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b4c0b3510 0x7f6b4c141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:13.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b4b7fe640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b4c15c030 0x7f6b4c09a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:13.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b4affd640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 0x7f6b4c099b00 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00c3a0 tx=0x7f6b3c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b33fff640 1 -- 172.21.15.67:0/1596358632 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0052d0 con 0x7f6b4c06dde0 2024-09-19T05:46:13.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b33fff640 1 -- 172.21.15.67:0/1596358632 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c005470 con 0x7f6b4c06dde0 2024-09-19T05:46:13.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b51a18640 1 -- 172.21.15.67:0/1596358632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c0cfb70 con 0x7f6b4c06dde0 2024-09-19T05:46:13.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b33fff640 1 -- 172.21.15.67:0/1596358632 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c007260 con 0x7f6b4c06dde0 2024-09-19T05:46:13.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b51a18640 1 -- 172.21.15.67:0/1596358632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c09b0c0 con 0x7f6b4c06dde0 2024-09-19T05:46:13.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b51a18640 1 -- 172.21.15.67:0/1596358632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4c0b2fd0 con 0x7f6b4c06dde0 2024-09-19T05:46:13.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b33fff640 1 -- 172.21.15.67:0/1596358632 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b3c007400 con 0x7f6b4c06dde0 2024-09-19T05:46:13.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b33fff640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b380678c0 0x7f6b38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:13.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b33fff640 1 -- 172.21.15.67:0/1596358632 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f6b3c085250 con 0x7f6b4c06dde0 2024-09-19T05:46:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b4a7fc640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b380678c0 0x7f6b38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.853+0000 7f6b4a7fc640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b380678c0 0x7f6b38069d80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6b400ae000 tx=0x7f6b400a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:13.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:13.857+0000 7f6b33fff640 1 -- 172.21.15.67:0/1596358632 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6b3c055c00 con 0x7f6b4c06dde0 2024-09-19T05:46:14.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.053+0000 7f6b51a18640 1 -- 172.21.15.67:0/1596358632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b4c15d630 con 0x7f6b4c06dde0 2024-09-19T05:46:14.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b33fff640 1 -- 172.21.15.67:0/1596358632 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7f6b3c055500 con 0x7f6b4c06dde0 2024-09-19T05:46:14.055 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:14.056 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:46:14.056 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 -- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b380678c0 msgr2=0x7f6b38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b380678c0 0x7f6b38069d80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6b400ae000 tx=0x7f6b400a7070 comp rx=0 tx=0).stop 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 -- 172.21.15.67:0/1596358632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 msgr2=0x7f6b4c099b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 0x7f6b4c099b00 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00c3a0 tx=0x7f6b3c00c860 comp rx=0 tx=0).stop 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 -- 172.21.15.67:0/1596358632 shutdown_connections 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b4c15c030 0x7f6b4c09a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6b380678c0 0x7f6b38069d80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6b4c0b3510 0x7f6b4c141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 --2- 172.21.15.67:0/1596358632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c06dde0 0x7f6b4c099b00 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 -- 172.21.15.67:0/1596358632 >> 172.21.15.67:0/1596358632 conn(0x7f6b4c0d0080 msgr2=0x7f6b4c15af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 -- 172.21.15.67:0/1596358632 shutdown_connections 2024-09-19T05:46:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.057+0000 7f6b51a18640 1 -- 172.21.15.67:0/1596358632 wait complete. 2024-09-19T05:46:14.073 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-19T05:46:14.074 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:46:14.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.197+0000 7f58ceb69640 1 Processor -- start 2024-09-19T05:46:14.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.197+0000 7f58ceb69640 1 -- start start 2024-09-19T05:46:14.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58ceb69640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f58c815e550 0x7f58c80d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:14.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58ceb69640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58c809b5d0 0x7f58c81613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:14.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58ceb69640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f58c8161920 0x7f58c815e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:14.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58ceb69640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f58c80d0970 con 0x7f58c8161920 2024-09-19T05:46:14.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58ceb69640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f58c80d0bc0 con 0x7f58c815e550 2024-09-19T05:46:14.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58ceb69640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f58c80d0ea0 con 0x7f58c809b5d0 2024-09-19T05:46:14.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58cd106640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f58c8161920 0x7f58c815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:14.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58cd106640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f58c8161920 0x7f58c815e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48850/0 (socket says 172.21.15.67:48850) 2024-09-19T05:46:14.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58cd106640 1 -- 172.21.15.67:0/1181264240 learned_addr learned my addr 172.21.15.67:0/1181264240 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:14.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58cc905640 1 --2- 172.21.15.67:0/1181264240 >> v2:172.21.15.97:3300/0 conn(0x7f58c815e550 0x7f58c80d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:14.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58c7fff640 1 --2- 172.21.15.67:0/1181264240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58c809b5d0 0x7f58c81613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:14.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58cd106640 1 -- 172.21.15.67:0/1181264240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58c809b5d0 msgr2=0x7f58c81613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:14.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58cd106640 1 --2- 172.21.15.67:0/1181264240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58c809b5d0 0x7f58c81613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58cd106640 1 -- 172.21.15.67:0/1181264240 >> v2:172.21.15.97:3300/0 conn(0x7f58c815e550 msgr2=0x7f58c80d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:14.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58cd106640 1 --2- 172.21.15.67:0/1181264240 >> v2:172.21.15.97:3300/0 conn(0x7f58c815e550 0x7f58c80d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58cd106640 1 -- 172.21.15.67:0/1181264240 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c80d1180 con 0x7f58c8161920 2024-09-19T05:46:14.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58cd106640 1 --2- 172.21.15.67:0/1181264240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 0x7f58c815e930 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f58c80737a0 tx=0x7f58c001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fb5f14b25298d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:14.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58c77fe640 1 -- 172.21.15.67:0/1181264240 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c00a5840 con 0x7f58c8161920 2024-09-19T05:46:14.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58c77fe640 1 -- 172.21.15.67:0/1181264240 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c00a59e0 con 0x7f58c8161920 2024-09-19T05:46:14.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.201+0000 7f58c77fe640 1 -- 172.21.15.67:0/1181264240 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c00a5db0 con 0x7f58c8161920 2024-09-19T05:46:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- 172.21.15.67:0/1181264240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 msgr2=0x7f58c815e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 --2- 172.21.15.67:0/1181264240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 0x7f58c815e930 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f58c80737a0 tx=0x7f58c001c9c0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- 172.21.15.67:0/1181264240 shutdown_connections 2024-09-19T05:46:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 --2- 172.21.15.67:0/1181264240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 0x7f58c815e930 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 --2- 172.21.15.67:0/1181264240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58c809b5d0 0x7f58c81613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 --2- 172.21.15.67:0/1181264240 >> v2:172.21.15.97:3300/0 conn(0x7f58c815e550 0x7f58c80d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- 172.21.15.67:0/1181264240 >> 172.21.15.67:0/1181264240 conn(0x7f58c80b3d90 msgr2=0x7f58c80b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- 172.21.15.67:0/1181264240 shutdown_connections 2024-09-19T05:46:14.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- 172.21.15.67:0/1181264240 wait complete. 2024-09-19T05:46:14.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 Processor -- start 2024-09-19T05:46:14.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- start start 2024-09-19T05:46:14.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c809b5d0 0x7f58c80b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:14.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58c815e550 0x7f58c8156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 0x7f58c8160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f58c809b9e0 con 0x7f58c8161920 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f58c8161d90 con 0x7f58c809b5d0 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f58c809bb60 con 0x7f58c815e550 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58cd106640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 0x7f58c8160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58cd106640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 0x7f58c8160060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48852/0 (socket says 172.21.15.67:48852) 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58cd106640 1 -- 172.21.15.67:0/1947908847 learned_addr learned my addr 172.21.15.67:0/1947908847 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58cc905640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c809b5d0 0x7f58c80b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58c7fff640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58c815e550 0x7f58c8156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58cd106640 1 -- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58c815e550 msgr2=0x7f58c8156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58cd106640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58c815e550 0x7f58c8156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58cd106640 1 -- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c809b5d0 msgr2=0x7f58c80b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:14.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58cd106640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c809b5d0 0x7f58c80b7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58cd106640 1 -- 172.21.15.67:0/1947908847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c8159700 con 0x7f58c8161920 2024-09-19T05:46:14.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58cd106640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 0x7f58c8160060 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f58c001d260 tx=0x7f58c0019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:14.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58c57fa640 1 -- 172.21.15.67:0/1947908847 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c00bc020 con 0x7f58c8161920 2024-09-19T05:46:14.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58c57fa640 1 -- 172.21.15.67:0/1947908847 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c00b8690 con 0x7f58c8161920 2024-09-19T05:46:14.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- 172.21.15.67:0/1947908847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c8158980 con 0x7f58c8161920 2024-09-19T05:46:14.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58c57fa640 1 -- 172.21.15.67:0/1947908847 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c00b8a80 con 0x7f58c8161920 2024-09-19T05:46:14.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.205+0000 7f58ceb69640 1 -- 172.21.15.67:0/1947908847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c8158f40 con 0x7f58c8161920 2024-09-19T05:46:14.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.209+0000 7f58ceb69640 1 -- 172.21.15.67:0/1947908847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c815f280 con 0x7f58c8161920 2024-09-19T05:46:14.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.209+0000 7f58c57fa640 1 -- 172.21.15.67:0/1947908847 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58c00bf020 con 0x7f58c8161920 2024-09-19T05:46:14.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.209+0000 7f58c57fa640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58ac0678c0 0x7f58ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:14.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.209+0000 7f58c57fa640 1 -- 172.21.15.67:0/1947908847 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f58c0120f30 con 0x7f58c8161920 2024-09-19T05:46:14.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.209+0000 7f58cc905640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58ac0678c0 0x7f58ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:14.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.209+0000 7f58cc905640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58ac0678c0 0x7f58ac069d80 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f58c806eb10 tx=0x7f58bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:14.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.213+0000 7f58c57fa640 1 -- 172.21.15.67:0/1947908847 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f58c00c6030 con 0x7f58c8161920 2024-09-19T05:46:14.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.429+0000 7f58ceb69640 1 -- 172.21.15.67:0/1947908847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f58c80d1b00 con 0x7f58c8161920 2024-09-19T05:46:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.429+0000 7f58c57fa640 1 -- 172.21.15.67:0/1947908847 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1491 (secure 0 0 0) 0x7f58c00165e0 con 0x7f58c8161920 2024-09-19T05:46:14.431 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:14.431 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":804,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":168,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1018,"data_bytes":1045699575,"bytes_used":2559328256,"bytes_avail":770534785024,"bytes_total":773094113280,"write_bytes_sec":74923682,"read_op_per_sec":0,"write_op_per_sec":75},"fsmap":{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9579}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-19T05:45:33.367088+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:46:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 -- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58ac0678c0 msgr2=0x7f58ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58ac0678c0 0x7f58ac069d80 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f58c806eb10 tx=0x7f58bc008040 comp rx=0 tx=0).stop 2024-09-19T05:46:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 -- 172.21.15.67:0/1947908847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 msgr2=0x7f58c8160060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 0x7f58c8160060 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f58c001d260 tx=0x7f58c0019760 comp rx=0 tx=0).stop 2024-09-19T05:46:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 -- 172.21.15.67:0/1947908847 shutdown_connections 2024-09-19T05:46:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58c8161920 0x7f58c8160060 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f58ac0678c0 0x7f58ac069d80 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58c815e550 0x7f58c8156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 --2- 172.21.15.67:0/1947908847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c809b5d0 0x7f58c80b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 -- 172.21.15.67:0/1947908847 >> 172.21.15.67:0/1947908847 conn(0x7f58c80b3d90 msgr2=0x7f58c80b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 -- 172.21.15.67:0/1947908847 shutdown_connections 2024-09-19T05:46:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:14.433+0000 7f58ceb69640 1 -- 172.21.15.67:0/1947908847 wait complete. 2024-09-19T05:46:14.451 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-19T05:46:15.452 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:15.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.581+0000 7f7be96c0640 1 Processor -- start 2024-09-19T05:46:15.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.581+0000 7f7be96c0640 1 -- start start 2024-09-19T05:46:15.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be96c0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7be406c300 0x7f7be40b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be96c0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7be4162da0 0x7f7be4163210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be96c0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be40b2ba0 con 0x7f7be406bf20 2024-09-19T05:46:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be96c0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7be40b5d10 con 0x7f7be4162da0 2024-09-19T05:46:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be96c0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7be40b5ff0 con 0x7f7be406c300 2024-09-19T05:46:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7be4162da0 0x7f7be4163210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7be4162da0 0x7f7be4163210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48866/0 (socket says 172.21.15.67:48866) 2024-09-19T05:46:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be37fe640 1 -- 172.21.15.67:0/3779209632 learned_addr learned my addr 172.21.15.67:0/3779209632 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be27fc640 1 --2- 172.21.15.67:0/3779209632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7be406c300 0x7f7be40b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be37fe640 1 -- 172.21.15.67:0/3779209632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7be406c300 msgr2=0x7f7be40b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be37fe640 1 --2- 172.21.15.67:0/3779209632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7be406c300 0x7f7be40b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be37fe640 1 -- 172.21.15.67:0/3779209632 >> v1:172.21.15.97:6789/0 conn(0x7f7be406bf20 legacy=0x7f7be40b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:15.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.585+0000 7f7be37fe640 1 -- 172.21.15.67:0/3779209632 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be40b62d0 con 0x7f7be4162da0 2024-09-19T05:46:15.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be37fe640 1 --2- 172.21.15.67:0/3779209632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be4162da0 0x7f7be4163210 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009e50 tx=0x7f7bdc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d0d5534b8ae0dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:15.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be1ffb640 1 -- 172.21.15.67:0/3779209632 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0a5700 con 0x7f7be4162da0 2024-09-19T05:46:15.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be1ffb640 1 -- 172.21.15.67:0/3779209632 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bdc0a58a0 con 0x7f7be4162da0 2024-09-19T05:46:15.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be1ffb640 1 -- 172.21.15.67:0/3779209632 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0a5c70 con 0x7f7be4162da0 2024-09-19T05:46:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be96c0640 1 -- 172.21.15.67:0/3779209632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be4162da0 msgr2=0x7f7be4163210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be96c0640 1 --2- 172.21.15.67:0/3779209632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be4162da0 0x7f7be4163210 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009e50 tx=0x7f7bdc01ca30 comp rx=0 tx=0).stop 2024-09-19T05:46:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be96c0640 1 -- 172.21.15.67:0/3779209632 shutdown_connections 2024-09-19T05:46:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be96c0640 1 --2- 172.21.15.67:0/3779209632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be4162da0 0x7f7be4163210 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be96c0640 1 --2- 172.21.15.67:0/3779209632 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7be406c300 0x7f7be40b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be96c0640 1 -- 172.21.15.67:0/3779209632 >> 172.21.15.67:0/3779209632 conn(0x7f7be409aa30 msgr2=0x7f7be40b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be96c0640 1 -- 172.21.15.67:0/3779209632 shutdown_connections 2024-09-19T05:46:15.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be96c0640 1 -- 172.21.15.67:0/3779209632 wait complete. 2024-09-19T05:46:15.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be96c0640 1 Processor -- start 2024-09-19T05:46:15.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.589+0000 7f7be96c0640 1 -- start start 2024-09-19T05:46:15.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be96c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7be406bf20 0x7f7be415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be96c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be406c300 0x7f7be40d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be96c0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7be4162da0 0x7f7be415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be96c0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4164a10 con 0x7f7be406c300 2024-09-19T05:46:15.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be96c0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4164890 con 0x7f7be406bf20 2024-09-19T05:46:15.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be96c0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7be4164b90 con 0x7f7be4162da0 2024-09-19T05:46:15.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be406c300 0x7f7be40d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be406c300 0x7f7be40d1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48868/0 (socket says 172.21.15.67:48868) 2024-09-19T05:46:15.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be27fc640 1 -- 172.21.15.67:0/1208322668 learned_addr learned my addr 172.21.15.67:0/1208322668 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:15.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be37fe640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7be4162da0 0x7f7be415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be2ffd640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7be406bf20 0x7f7be415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be27fc640 1 -- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7be4162da0 msgr2=0x7f7be415ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:15.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be27fc640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7be4162da0 0x7f7be415ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be27fc640 1 -- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7be406bf20 msgr2=0x7f7be415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:15.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be27fc640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7be406bf20 0x7f7be415d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be27fc640 1 -- 172.21.15.67:0/1208322668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be415c640 con 0x7f7be406c300 2024-09-19T05:46:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be27fc640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be406c300 0x7f7be40d1a70 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800e960 tx=0x7f7bd800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7bcb7fe640 1 -- 172.21.15.67:0/1208322668 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8017070 con 0x7f7be406c300 2024-09-19T05:46:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7bcb7fe640 1 -- 172.21.15.67:0/1208322668 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd800ca00 con 0x7f7be406c300 2024-09-19T05:46:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be96c0640 1 -- 172.21.15.67:0/1208322668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be415c920 con 0x7f7be406c300 2024-09-19T05:46:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7bcb7fe640 1 -- 172.21.15.67:0/1208322668 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800cdb0 con 0x7f7be406c300 2024-09-19T05:46:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be96c0640 1 -- 172.21.15.67:0/1208322668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be415cee0 con 0x7f7be406c300 2024-09-19T05:46:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.593+0000 7f7be96c0640 1 -- 172.21.15.67:0/1208322668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be4164fa0 con 0x7f7be406c300 2024-09-19T05:46:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.597+0000 7f7bcb7fe640 1 -- 172.21.15.67:0/1208322668 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7bd801a070 con 0x7f7be406c300 2024-09-19T05:46:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.597+0000 7f7bcb7fe640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7bd00678c0 0x7f7bd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.597+0000 7f7bcb7fe640 1 -- 172.21.15.67:0/1208322668 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f7bd80864f0 con 0x7f7be406c300 2024-09-19T05:46:15.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.597+0000 7f7be2ffd640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7bd00678c0 0x7f7bd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.597+0000 7f7be2ffd640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7bd00678c0 0x7f7bd0069d80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4001810 tx=0x7f7bd4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:15.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.601+0000 7f7bcb7fe640 1 -- 172.21.15.67:0/1208322668 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7bd8056930 con 0x7f7be406c300 2024-09-19T05:46:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.797+0000 7f7be96c0640 1 -- 172.21.15.67:0/1208322668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7be406ff60 con 0x7f7be406c300 2024-09-19T05:46:15.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7bcb7fe640 1 -- 172.21.15.67:0/1208322668 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7f7bd805ac30 con 0x7f7be406c300 2024-09-19T05:46:15.800 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:15.800 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:46:15.800 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:46:15.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 -- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7bd00678c0 msgr2=0x7f7bd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:15.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7bd00678c0 0x7f7bd0069d80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4001810 tx=0x7f7bd4009040 comp rx=0 tx=0).stop 2024-09-19T05:46:15.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 -- 172.21.15.67:0/1208322668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be406c300 msgr2=0x7f7be40d1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be406c300 0x7f7be40d1a70 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800e960 tx=0x7f7bd800ee20 comp rx=0 tx=0).stop 2024-09-19T05:46:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 -- 172.21.15.67:0/1208322668 shutdown_connections 2024-09-19T05:46:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7bd00678c0 0x7f7bd0069d80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7be4162da0 0x7f7be415ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7be406c300 0x7f7be40d1a70 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 --2- 172.21.15.67:0/1208322668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7be406bf20 0x7f7be415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 -- 172.21.15.67:0/1208322668 >> 172.21.15.67:0/1208322668 conn(0x7f7be409aa30 msgr2=0x7f7be40ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 -- 172.21.15.67:0/1208322668 shutdown_connections 2024-09-19T05:46:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.801+0000 7f7be96c0640 1 -- 172.21.15.67:0/1208322668 wait complete. 2024-09-19T05:46:15.820 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-19T05:46:15.820 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:46:15.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.945+0000 7feeacc58640 1 Processor -- start 2024-09-19T05:46:15.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.945+0000 7feeacc58640 1 -- start start 2024-09-19T05:46:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.945+0000 7feeacc58640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feea80b4900 0x7feea8071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.945+0000 7feeacc58640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7feea80723c0 0x7feea8072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.945+0000 7feeacc58640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea80b3860 con 0x7feea815b1e0 2024-09-19T05:46:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.945+0000 7feeacc58640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7feea815b5c0 con 0x7feea80b4900 2024-09-19T05:46:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.945+0000 7feeacc58640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7feea80b3b40 con 0x7feea80723c0 2024-09-19T05:46:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.945+0000 7feea5d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feea80b4900 0x7feea8071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea5d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feea80b4900 0x7feea8071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42636/0 (socket says 172.21.15.67:42636) 2024-09-19T05:46:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea5d9b640 1 -- 172.21.15.67:0/3390920579 learned_addr learned my addr 172.21.15.67:0/3390920579 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:15.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea659c640 1 --1- 172.21.15.67:0/3390920579 >> v1:172.21.15.67:6789/0 conn(0x7feea815b1e0 0x7feea80b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35564/0 (socket says 172.21.15.67:35564) 2024-09-19T05:46:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea6d9d640 1 --2- 172.21.15.67:0/3390920579 >> v2:172.21.15.97:3300/0 conn(0x7feea80723c0 0x7feea8072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea5d9b640 1 -- 172.21.15.67:0/3390920579 >> v2:172.21.15.97:3300/0 conn(0x7feea80723c0 msgr2=0x7feea8072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea5d9b640 1 --2- 172.21.15.67:0/3390920579 >> v2:172.21.15.97:3300/0 conn(0x7feea80723c0 0x7feea8072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea5d9b640 1 -- 172.21.15.67:0/3390920579 >> v1:172.21.15.67:6789/0 conn(0x7feea815b1e0 legacy=0x7feea80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:15.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea5d9b640 1 -- 172.21.15.67:0/3390920579 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea80b3e20 con 0x7feea80b4900 2024-09-19T05:46:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea559a640 1 -- 172.21.15.67:0/3390920579 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923098519 0 0) 0x7feea80b3860 con 0x7feea815b1e0 2024-09-19T05:46:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea6d9d640 1 --2- 172.21.15.67:0/3390920579 >> v2:172.21.15.97:3300/0 conn(0x7feea80723c0 0x7feea8072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea5d9b640 1 --2- 172.21.15.67:0/3390920579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 0x7feea8071e80 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7feea80ad040 tx=0x7fee9801e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43d87b5163ea5fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea559a640 1 -- 172.21.15.67:0/3390920579 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee980aa630 con 0x7feea80b4900 2024-09-19T05:46:15.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea559a640 1 -- 172.21.15.67:0/3390920579 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee980aa7d0 con 0x7feea80b4900 2024-09-19T05:46:15.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feea559a640 1 -- 172.21.15.67:0/3390920579 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee980aaba0 con 0x7feea80b4900 2024-09-19T05:46:15.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feeacc58640 1 -- 172.21.15.67:0/3390920579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 msgr2=0x7feea8071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:15.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feeacc58640 1 --2- 172.21.15.67:0/3390920579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 0x7feea8071e80 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7feea80ad040 tx=0x7fee9801e700 comp rx=0 tx=0).stop 2024-09-19T05:46:15.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feeacc58640 1 -- 172.21.15.67:0/3390920579 shutdown_connections 2024-09-19T05:46:15.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feeacc58640 1 --2- 172.21.15.67:0/3390920579 >> v2:172.21.15.97:3300/0 conn(0x7feea80723c0 0x7feea8072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feeacc58640 1 --2- 172.21.15.67:0/3390920579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 0x7feea8071e80 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feeacc58640 1 -- 172.21.15.67:0/3390920579 >> 172.21.15.67:0/3390920579 conn(0x7feea80d0080 msgr2=0x7feea80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:15.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feeacc58640 1 -- 172.21.15.67:0/3390920579 shutdown_connections 2024-09-19T05:46:15.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.949+0000 7feeacc58640 1 -- 172.21.15.67:0/3390920579 wait complete. 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 Processor -- start 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 -- start start 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feea80723c0 0x7feea814b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 0x7feea80992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feea815b1e0 0x7feea815b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feea806f210 con 0x7feea80b4900 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7feea806f090 con 0x7feea80723c0 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7feea806f390 con 0x7feea815b1e0 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 0x7feea80992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 0x7feea80992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42642/0 (socket says 172.21.15.67:42642) 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea5d9b640 1 -- 172.21.15.67:0/3362529377 learned_addr learned my addr 172.21.15.67:0/3362529377 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:15.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea659c640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feea80723c0 0x7feea814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea6d9d640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feea815b1e0 0x7feea815b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea5d9b640 1 -- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feea815b1e0 msgr2=0x7feea815b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea5d9b640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feea815b1e0 0x7feea815b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea5d9b640 1 -- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feea80723c0 msgr2=0x7feea814b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea5d9b640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feea80723c0 0x7feea814b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea5d9b640 1 -- 172.21.15.67:0/3362529377 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea8099da0 con 0x7feea80b4900 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea659c640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feea80723c0 0x7feea814b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feea5d9b640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 0x7feea80992f0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fee9801c330 tx=0x7fee9801b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7fee96ffd640 1 -- 172.21.15.67:0/3362529377 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee980b2810 con 0x7feea80b4900 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7fee96ffd640 1 -- 172.21.15.67:0/3362529377 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee980b29b0 con 0x7feea80b4900 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 -- 172.21.15.67:0/3362529377 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea814fb00 con 0x7feea80b4900 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7fee96ffd640 1 -- 172.21.15.67:0/3362529377 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee980b2d80 con 0x7feea80b4900 2024-09-19T05:46:15.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 -- 172.21.15.67:0/3362529377 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea81500c0 con 0x7feea80b4900 2024-09-19T05:46:15.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7feeacc58640 1 -- 172.21.15.67:0/3362529377 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea8071e80 con 0x7feea80b4900 2024-09-19T05:46:15.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.953+0000 7fee96ffd640 1 -- 172.21.15.67:0/3362529377 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee980c53f0 con 0x7feea80b4900 2024-09-19T05:46:15.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.957+0000 7fee96ffd640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee880678c0 0x7fee88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:15.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.957+0000 7fee96ffd640 1 -- 172.21.15.67:0/3362529377 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7fee98122670 con 0x7feea80b4900 2024-09-19T05:46:15.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.957+0000 7feea659c640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee880678c0 0x7fee88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:15.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.957+0000 7feea659c640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee880678c0 0x7fee88069d80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fee9c000f70 tx=0x7fee9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:15.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:15.961+0000 7fee96ffd640 1 -- 172.21.15.67:0/3362529377 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fee980ae030 con 0x7feea80b4900 2024-09-19T05:46:16.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.181+0000 7feeacc58640 1 -- 172.21.15.67:0/3362529377 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7feea814e400 con 0x7feea80b4900 2024-09-19T05:46:16.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7fee96ffd640 1 -- 172.21.15.67:0/3362529377 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1491 (secure 0 0 0) 0x7fee98018320 con 0x7feea80b4900 2024-09-19T05:46:16.183 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:16.183 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":805,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":168,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1018,"data_bytes":1045699575,"bytes_used":2559328256,"bytes_avail":770534785024,"bytes_total":773094113280,"write_bytes_sec":49190040,"read_op_per_sec":0,"write_op_per_sec":49},"fsmap":{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9579}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-19T05:45:33.367088+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:46:16.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 -- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee880678c0 msgr2=0x7fee88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:16.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee880678c0 0x7fee88069d80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fee9c000f70 tx=0x7fee9c009040 comp rx=0 tx=0).stop 2024-09-19T05:46:16.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 -- 172.21.15.67:0/3362529377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 msgr2=0x7feea80992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:16.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 0x7feea80992f0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fee9801c330 tx=0x7fee9801b4a0 comp rx=0 tx=0).stop 2024-09-19T05:46:16.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 -- 172.21.15.67:0/3362529377 shutdown_connections 2024-09-19T05:46:16.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee880678c0 0x7fee88069d80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:16.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feea815b1e0 0x7feea815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:16.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feea80b4900 0x7feea80992f0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:16.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 --2- 172.21.15.67:0/3362529377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feea80723c0 0x7feea814b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:16.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 -- 172.21.15.67:0/3362529377 >> 172.21.15.67:0/3362529377 conn(0x7feea80d0080 msgr2=0x7feea80addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:16.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 -- 172.21.15.67:0/3362529377 shutdown_connections 2024-09-19T05:46:16.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:16.185+0000 7feeacc58640 1 -- 172.21.15.67:0/3362529377 wait complete. 2024-09-19T05:46:16.204 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-19T05:46:17.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:17.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995fd04640 1 Processor -- start 2024-09-19T05:46:17.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995fd04640 1 -- start start 2024-09-19T05:46:17.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995fd04640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f995806dde0 0x7f99580b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995fd04640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995806e3c0 con 0x7f995815c030 2024-09-19T05:46:17.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995fd04640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995806e6a0 con 0x7f99580b3510 2024-09-19T05:46:17.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995fd04640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f995806e980 con 0x7f995806dde0 2024-09-19T05:46:17.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995daa0640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f995815c030 0x7f995815d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35578/0 (socket says 172.21.15.67:35578) 2024-09-19T05:46:17.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995daa0640 1 -- 172.21.15.67:0/4238937298 learned_addr learned my addr 172.21.15.67:0/4238937298 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:17.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3554003103 0 0) 0x7f995806e3c0 con 0x7f995815c030 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995d29f640 1 --2- 172.21.15.67:0/4238937298 >> v2:172.21.15.97:3300/0 conn(0x7f995806dde0 0x7f99580b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9944003530 con 0x7f995815c030 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3252532948 0 0) 0x7f9944003530 con 0x7f995815c030 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 >> v2:172.21.15.97:3300/0 conn(0x7f995806dde0 msgr2=0x7f99580b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 --2- 172.21.15.67:0/4238937298 >> v2:172.21.15.97:3300/0 conn(0x7f995806dde0 0x7f99580b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 >> v1:172.21.15.97:6789/0 conn(0x7f99580b3510 legacy=0x7f995806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995806ec60 con 0x7f995815c030 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9948001680 con 0x7f995815c030 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 >> v1:172.21.15.67:6789/0 conn(0x7f995815c030 legacy=0x7f995815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 --2- 172.21.15.67:0/4238937298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9944003a10 0x7f9944003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 --2- 172.21.15.67:0/4238937298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9944004810 0x7f9944004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 --2- 172.21.15.67:0/4238937298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f99440051d0 0x7f994400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f995806e980 con 0x7f9944004810 2024-09-19T05:46:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f994400c0d0 con 0x7f9944003a10 2024-09-19T05:46:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f994400c2d0 con 0x7f99440051d0 2024-09-19T05:46:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995d29f640 1 --2- 172.21.15.67:0/4238937298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9944004810 0x7f9944004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995daa0640 1 --2- 172.21.15.67:0/4238937298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9944003a10 0x7f9944003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995d29f640 1 -- 172.21.15.67:0/4238937298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f99440051d0 msgr2=0x7f994400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995d29f640 1 --2- 172.21.15.67:0/4238937298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f99440051d0 0x7f994400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995d29f640 1 -- 172.21.15.67:0/4238937298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9944003a10 msgr2=0x7f9944003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995d29f640 1 --2- 172.21.15.67:0/4238937298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9944003a10 0x7f9944003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995d29f640 1 -- 172.21.15.67:0/4238937298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9944003530 con 0x7f9944004810 2024-09-19T05:46:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.341+0000 7f995e2a1640 1 -- 172.21.15.67:0/4238937298 reap_dead start 2024-09-19T05:46:17.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995d29f640 1 --2- 172.21.15.67:0/4238937298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9944004810 0x7f9944004c90 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f9954009ac0 tx=0x7f995401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68373718e1296b5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99540b2070 con 0x7f9944004810 2024-09-19T05:46:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99540a5650 con 0x7f9944004810 2024-09-19T05:46:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995ca9e640 1 -- 172.21.15.67:0/4238937298 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954009690 con 0x7f9944004810 2024-09-19T05:46:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995fd04640 1 -- 172.21.15.67:0/4238937298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9944004810 msgr2=0x7f9944004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995fd04640 1 --2- 172.21.15.67:0/4238937298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9944004810 0x7f9944004c90 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f9954009ac0 tx=0x7f995401ca00 comp rx=0 tx=0).stop 2024-09-19T05:46:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995fd04640 1 -- 172.21.15.67:0/4238937298 shutdown_connections 2024-09-19T05:46:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995fd04640 1 --2- 172.21.15.67:0/4238937298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9944004810 0x7f9944004c90 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995fd04640 1 -- 172.21.15.67:0/4238937298 >> 172.21.15.67:0/4238937298 conn(0x7f99580d0080 msgr2=0x7f99580d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995fd04640 1 -- 172.21.15.67:0/4238937298 shutdown_connections 2024-09-19T05:46:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995fd04640 1 -- 172.21.15.67:0/4238937298 wait complete. 2024-09-19T05:46:17.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995fd04640 1 Processor -- start 2024-09-19T05:46:17.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.345+0000 7f995fd04640 1 -- start start 2024-09-19T05:46:17.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995fd04640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9944004810 0x7f99581453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995fd04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9958156090 0x7f995815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995fd04640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f995815e100 0x7f99581e54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995fd04640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f995815c590 con 0x7f9958156090 2024-09-19T05:46:17.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995fd04640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f995815c410 con 0x7f9944004810 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995fd04640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f99580b2fd0 con 0x7f995815e100 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995d29f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9958156090 0x7f995815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995d29f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9958156090 0x7f995815dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42650/0 (socket says 172.21.15.67:42650) 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995d29f640 1 -- 172.21.15.67:0/3286930579 learned_addr learned my addr 172.21.15.67:0/3286930579 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995daa0640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9944004810 0x7f99581453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995e2a1640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f995815e100 0x7f99581e54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995d29f640 1 -- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f995815e100 msgr2=0x7f99581e54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995d29f640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f995815e100 0x7f99581e54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995d29f640 1 -- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9944004810 msgr2=0x7f99581453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995d29f640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9944004810 0x7f99581453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995d29f640 1 -- 172.21.15.67:0/3286930579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9958155030 con 0x7f9958156090 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995d29f640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9958156090 0x7f995815dbc0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f9954009ac0 tx=0x7f99540197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:17.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f994e7fc640 1 -- 172.21.15.67:0/3286930579 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99540b2040 con 0x7f9958156090 2024-09-19T05:46:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f994e7fc640 1 -- 172.21.15.67:0/3286930579 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99540b8440 con 0x7f9958156090 2024-09-19T05:46:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995fd04640 1 -- 172.21.15.67:0/3286930579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99581552d0 con 0x7f9958156090 2024-09-19T05:46:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f994e7fc640 1 -- 172.21.15.67:0/3286930579 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99540b8830 con 0x7f9958156090 2024-09-19T05:46:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995fd04640 1 -- 172.21.15.67:0/3286930579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9958155890 con 0x7f9958156090 2024-09-19T05:46:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995fd04640 1 -- 172.21.15.67:0/3286930579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f995815e510 con 0x7f9958156090 2024-09-19T05:46:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f994e7fc640 1 -- 172.21.15.67:0/3286930579 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99540bf060 con 0x7f9958156090 2024-09-19T05:46:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f994e7fc640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f993c0678f0 0x7f993c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f994e7fc640 1 -- 172.21.15.67:0/3286930579 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f995411f640 con 0x7f9958156090 2024-09-19T05:46:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.349+0000 7f995daa0640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f993c0678f0 0x7f993c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.353+0000 7f995daa0640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f993c0678f0 0x7f993c069db0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9948001ec0 tx=0x7f9948009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:17.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.353+0000 7f994e7fc640 1 -- 172.21.15.67:0/3286930579 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f995815e510 con 0x7f9958156090 2024-09-19T05:46:17.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.553+0000 7f995fd04640 1 -- 172.21.15.67:0/3286930579 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99580d0f20 con 0x7f9958156090 2024-09-19T05:46:17.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f994e7fc640 1 -- 172.21.15.67:0/3286930579 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7f99540f4e20 con 0x7f9958156090 2024-09-19T05:46:17.556 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:17.556 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:46:17.556 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:46:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 -- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f993c0678f0 msgr2=0x7f993c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f993c0678f0 0x7f993c069db0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9948001ec0 tx=0x7f9948009040 comp rx=0 tx=0).stop 2024-09-19T05:46:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 -- 172.21.15.67:0/3286930579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9958156090 msgr2=0x7f995815dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9958156090 0x7f995815dbc0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f9954009ac0 tx=0x7f99540197f0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 -- 172.21.15.67:0/3286930579 shutdown_connections 2024-09-19T05:46:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f993c0678f0 0x7f993c069db0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f995815e100 0x7f99581e54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9958156090 0x7f995815dbc0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 --2- 172.21.15.67:0/3286930579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9944004810 0x7f99581453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 -- 172.21.15.67:0/3286930579 >> 172.21.15.67:0/3286930579 conn(0x7f99580d0080 msgr2=0x7f99581596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:17.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 -- 172.21.15.67:0/3286930579 shutdown_connections 2024-09-19T05:46:17.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.557+0000 7f995fd04640 1 -- 172.21.15.67:0/3286930579 wait complete. 2024-09-19T05:46:17.580 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-19T05:46:17.581 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:46:17.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.705+0000 7f0582a83640 1 Processor -- start 2024-09-19T05:46:17.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.705+0000 7f0582a83640 1 -- start start 2024-09-19T05:46:17.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.705+0000 7f0582a83640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f057c0b2fd0 0x7f057c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.705+0000 7f0582a83640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057c0b4420 con 0x7f057c0726b0 2024-09-19T05:46:17.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.705+0000 7f0582a83640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057c0b4140 con 0x7f057c15e330 2024-09-19T05:46:17.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.705+0000 7f0582a83640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f057c0acfb0 con 0x7f057c0b2fd0 2024-09-19T05:46:17.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.705+0000 7f0581020640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f057c0726b0 0x7f057c06ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35580/0 (socket says 172.21.15.67:35580) 2024-09-19T05:46:17.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.705+0000 7f0581020640 1 -- 172.21.15.67:0/2714859686 learned_addr learned my addr 172.21.15.67:0/2714859686 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:17.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.705+0000 7f057bfff640 1 --2- 172.21.15.67:0/2714859686 >> v2:172.21.15.67:3300/0 conn(0x7f057c0b2fd0 0x7f057c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f057b7fe640 1 -- 172.21.15.67:0/2714859686 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491509658 0 0) 0x7f057c0b4420 con 0x7f057c0726b0 2024-09-19T05:46:17.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f057b7fe640 1 -- 172.21.15.67:0/2714859686 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0568003530 con 0x7f057c0726b0 2024-09-19T05:46:17.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f057bfff640 1 -- 172.21.15.67:0/2714859686 >> v1:172.21.15.97:6789/0 conn(0x7f057c15e330 legacy=0x7f057c071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f057bfff640 1 -- 172.21.15.67:0/2714859686 >> v1:172.21.15.67:6789/0 conn(0x7f057c0726b0 legacy=0x7f057c06ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f057bfff640 1 -- 172.21.15.67:0/2714859686 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c06def0 con 0x7f057c0b2fd0 2024-09-19T05:46:17.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f057bfff640 1 --2- 172.21.15.67:0/2714859686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0b2fd0 0x7f057c06e6f0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f0564009d90 tx=0x7f056401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bd2446463cfa4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:17.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f057b7fe640 1 -- 172.21.15.67:0/2714859686 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640b2070 con 0x7f057c0b2fd0 2024-09-19T05:46:17.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f057b7fe640 1 -- 172.21.15.67:0/2714859686 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05640a5940 con 0x7f057c0b2fd0 2024-09-19T05:46:17.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f057b7fe640 1 -- 172.21.15.67:0/2714859686 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640a5cf0 con 0x7f057c0b2fd0 2024-09-19T05:46:17.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f0582a83640 1 -- 172.21.15.67:0/2714859686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0b2fd0 msgr2=0x7f057c06e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f0582a83640 1 --2- 172.21.15.67:0/2714859686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0b2fd0 0x7f057c06e6f0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f0564009d90 tx=0x7f056401c970 comp rx=0 tx=0).stop 2024-09-19T05:46:17.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f0582a83640 1 -- 172.21.15.67:0/2714859686 shutdown_connections 2024-09-19T05:46:17.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f0582a83640 1 --2- 172.21.15.67:0/2714859686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0b2fd0 0x7f057c06e6f0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f0582a83640 1 -- 172.21.15.67:0/2714859686 >> 172.21.15.67:0/2714859686 conn(0x7f057c0d0080 msgr2=0x7f057c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:17.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.709+0000 7f0582a83640 1 -- 172.21.15.67:0/2714859686 shutdown_connections 2024-09-19T05:46:17.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 -- 172.21.15.67:0/2714859686 wait complete. 2024-09-19T05:46:17.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 Processor -- start 2024-09-19T05:46:17.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 -- start start 2024-09-19T05:46:17.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0726b0 0x7f057c145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057c15e330 0x7f057c14ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f057c14ef40 0x7f057c14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f057c0cfe40 con 0x7f057c0726b0 2024-09-19T05:46:17.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f057c0cfcc0 con 0x7f057c14ef40 2024-09-19T05:46:17.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f057c16cb30 con 0x7f057c15e330 2024-09-19T05:46:17.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f058081f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0726b0 0x7f057c145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f058081f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0726b0 0x7f057c145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42658/0 (socket says 172.21.15.67:42658) 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f058081f640 1 -- 172.21.15.67:0/950644185 learned_addr learned my addr 172.21.15.67:0/950644185 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0581020640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f057c14ef40 0x7f057c14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f057bfff640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057c15e330 0x7f057c14ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f058081f640 1 -- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057c15e330 msgr2=0x7f057c14ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f058081f640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057c15e330 0x7f057c14ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f058081f640 1 -- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f057c14ef40 msgr2=0x7f057c14dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f058081f640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f057c14ef40 0x7f057c14dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f058081f640 1 -- 172.21.15.67:0/950644185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c14f5c0 con 0x7f057c0726b0 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f057bfff640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057c15e330 0x7f057c14ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f058081f640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0726b0 0x7f057c145010 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c3a0 tx=0x7f056c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f05797fa640 1 -- 172.21.15.67:0/950644185 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c0052d0 con 0x7f057c0726b0 2024-09-19T05:46:17.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f05797fa640 1 -- 172.21.15.67:0/950644185 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f056c005470 con 0x7f057c0726b0 2024-09-19T05:46:17.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f05797fa640 1 -- 172.21.15.67:0/950644185 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c007260 con 0x7f057c0726b0 2024-09-19T05:46:17.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 -- 172.21.15.67:0/950644185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057c099180 con 0x7f057c0726b0 2024-09-19T05:46:17.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 -- 172.21.15.67:0/950644185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057c1fbd40 con 0x7f057c0726b0 2024-09-19T05:46:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.713+0000 7f0582a83640 1 -- 172.21.15.67:0/950644185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057c14f350 con 0x7f057c0726b0 2024-09-19T05:46:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.717+0000 7f05797fa640 1 -- 172.21.15.67:0/950644185 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f056c007400 con 0x7f057c0726b0 2024-09-19T05:46:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.717+0000 7f05797fa640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f055c0678f0 0x7f055c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.717+0000 7f05797fa640 1 -- 172.21.15.67:0/950644185 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f056c085210 con 0x7f057c0726b0 2024-09-19T05:46:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.717+0000 7f057bfff640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f055c0678f0 0x7f055c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.717+0000 7f057bfff640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f055c0678f0 0x7f055c069db0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f05640af000 tx=0x7f05640a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.721+0000 7f05797fa640 1 -- 172.21.15.67:0/950644185 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f056c055c50 con 0x7f057c0726b0 2024-09-19T05:46:17.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.945+0000 7f0582a83640 1 -- 172.21.15.67:0/950644185 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f057c071fa0 con 0x7f057c0726b0 2024-09-19T05:46:17.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.945+0000 7f05797fa640 1 -- 172.21.15.67:0/950644185 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f056c055550 con 0x7f057c0726b0 2024-09-19T05:46:17.946 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:17.946 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":807,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":168,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1018,"data_bytes":1045699575,"bytes_used":2559328256,"bytes_avail":770534785024,"bytes_total":773094113280,"write_bytes_sec":49191790,"read_op_per_sec":0,"write_op_per_sec":49},"fsmap":{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9579}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-19T05:46:17.382338+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:46:17.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 -- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f055c0678f0 msgr2=0x7f055c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f055c0678f0 0x7f055c069db0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f05640af000 tx=0x7f05640a7070 comp rx=0 tx=0).stop 2024-09-19T05:46:17.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 -- 172.21.15.67:0/950644185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0726b0 msgr2=0x7f057c145010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:17.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0726b0 0x7f057c145010 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c3a0 tx=0x7f056c00c860 comp rx=0 tx=0).stop 2024-09-19T05:46:17.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 -- 172.21.15.67:0/950644185 shutdown_connections 2024-09-19T05:46:17.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f057c14ef40 0x7f057c14dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f055c0678f0 0x7f055c069db0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057c15e330 0x7f057c14ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 --2- 172.21.15.67:0/950644185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0726b0 0x7f057c145010 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:17.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 -- 172.21.15.67:0/950644185 >> 172.21.15.67:0/950644185 conn(0x7f057c0d0080 msgr2=0x7f057c0b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:17.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 -- 172.21.15.67:0/950644185 shutdown_connections 2024-09-19T05:46:17.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:17.949+0000 7f0582a83640 1 -- 172.21.15.67:0/950644185 wait complete. 2024-09-19T05:46:17.965 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-19T05:46:17.966 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:46:17.966 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:46:17.977 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:46:17.978 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'b', 'c', 'd'} 2024-09-19T05:46:17.978 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-19T05:46:18.144 INFO:teuthology.orchestra.run.smithi067.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-19T05:46:18.145 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-19T05:46:18.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:18.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.273+0000 7fd12f919640 1 Processor -- start 2024-09-19T05:46:18.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.273+0000 7fd12f919640 1 -- start start 2024-09-19T05:46:18.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12f919640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd12815b710 0x7fd128071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:18.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12f919640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd12815baf0 0x7fd12815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:18.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12f919640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1280b3070 con 0x7fd1280aef40 2024-09-19T05:46:18.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12f919640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd1280b32e0 con 0x7fd12815baf0 2024-09-19T05:46:18.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12f919640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd1280b35c0 con 0x7fd12815b710 2024-09-19T05:46:18.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12ceb4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd12815baf0 0x7fd12815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:18.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12ceb4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd12815baf0 0x7fd12815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42670/0 (socket says 172.21.15.67:42670) 2024-09-19T05:46:18.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12ceb4640 1 -- 172.21.15.67:0/3019021186 learned_addr learned my addr 172.21.15.67:0/3019021186 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:18.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12d6b5640 1 --2- 172.21.15.67:0/3019021186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd12815b710 0x7fd128071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:18.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12ceb4640 1 -- 172.21.15.67:0/3019021186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd12815b710 msgr2=0x7fd128071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:18.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12ceb4640 1 --2- 172.21.15.67:0/3019021186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd12815b710 0x7fd128071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12ceb4640 1 -- 172.21.15.67:0/3019021186 >> v1:172.21.15.97:6789/0 conn(0x7fd1280aef40 legacy=0x7fd1280af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:18.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12ceb4640 1 -- 172.21.15.67:0/3019021186 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1280afa70 con 0x7fd12815baf0 2024-09-19T05:46:18.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd12ceb4640 1 --2- 172.21.15.67:0/3019021186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 0x7fd12815bf30 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009870 tx=0x7fd11c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da60913a8a6598 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:18.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd11bfff640 1 -- 172.21.15.67:0/3019021186 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0a95f0 con 0x7fd12815baf0 2024-09-19T05:46:18.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd11bfff640 1 -- 172.21.15.67:0/3019021186 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11c0a9790 con 0x7fd12815baf0 2024-09-19T05:46:18.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.277+0000 7fd11bfff640 1 -- 172.21.15.67:0/3019021186 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0a9b60 con 0x7fd12815baf0 2024-09-19T05:46:18.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- 172.21.15.67:0/3019021186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 msgr2=0x7fd12815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:18.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 --2- 172.21.15.67:0/3019021186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 0x7fd12815bf30 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009870 tx=0x7fd11c01c530 comp rx=0 tx=0).stop 2024-09-19T05:46:18.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- 172.21.15.67:0/3019021186 shutdown_connections 2024-09-19T05:46:18.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 --2- 172.21.15.67:0/3019021186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 0x7fd12815bf30 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 --2- 172.21.15.67:0/3019021186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd12815b710 0x7fd128071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- 172.21.15.67:0/3019021186 >> 172.21.15.67:0/3019021186 conn(0x7fd1280d0080 msgr2=0x7fd1280d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:18.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- 172.21.15.67:0/3019021186 shutdown_connections 2024-09-19T05:46:18.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- 172.21.15.67:0/3019021186 wait complete. 2024-09-19T05:46:18.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 Processor -- start 2024-09-19T05:46:18.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- start start 2024-09-19T05:46:18.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1280aef40 0x7fd12814b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:18.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd12815b710 0x7fd128149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 0x7fd128147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd1280b4a30 con 0x7fd12815baf0 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd1280b48b0 con 0x7fd12815b710 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd1280b4bb0 con 0x7fd1280aef40 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12deb6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 0x7fd128147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12deb6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 0x7fd128147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42684/0 (socket says 172.21.15.67:42684) 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12deb6640 1 -- 172.21.15.67:0/1491095331 learned_addr learned my addr 172.21.15.67:0/1491095331 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12d6b5640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1280aef40 0x7fd12814b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12ceb4640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd12815b710 0x7fd128149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12deb6640 1 -- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1280aef40 msgr2=0x7fd12814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12deb6640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1280aef40 0x7fd12814b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12deb6640 1 -- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd12815b710 msgr2=0x7fd128149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:18.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12deb6640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd12815b710 0x7fd128149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12deb6640 1 -- 172.21.15.67:0/1491095331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd128146860 con 0x7fd12815baf0 2024-09-19T05:46:18.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12deb6640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 0x7fd128147030 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c430 tx=0x7fd12000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:18.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd119ffb640 1 -- 172.21.15.67:0/1491095331 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120005220 con 0x7fd12815baf0 2024-09-19T05:46:18.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd119ffb640 1 -- 172.21.15.67:0/1491095331 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1200053c0 con 0x7fd12815baf0 2024-09-19T05:46:18.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd119ffb640 1 -- 172.21.15.67:0/1491095331 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120007270 con 0x7fd12815baf0 2024-09-19T05:46:18.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- 172.21.15.67:0/1491095331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1281f56b0 con 0x7fd12815baf0 2024-09-19T05:46:18.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.281+0000 7fd12f919640 1 -- 172.21.15.67:0/1491095331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1281f5c70 con 0x7fd12815baf0 2024-09-19T05:46:18.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.285+0000 7fd12f919640 1 -- 172.21.15.67:0/1491095331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd128071e80 con 0x7fd12815baf0 2024-09-19T05:46:18.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.285+0000 7fd119ffb640 1 -- 172.21.15.67:0/1491095331 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd120019020 con 0x7fd12815baf0 2024-09-19T05:46:18.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.285+0000 7fd119ffb640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd10c0678c0 0x7fd10c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:18.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.285+0000 7fd119ffb640 1 -- 172.21.15.67:0/1491095331 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7fd1200851d0 con 0x7fd12815baf0 2024-09-19T05:46:18.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.285+0000 7fd12d6b5640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd10c0678c0 0x7fd10c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:18.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.285+0000 7fd12d6b5640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd10c0678c0 0x7fd10c069d80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd124003fd0 tx=0x7fd1240039a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:18.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.289+0000 7fd119ffb640 1 -- 172.21.15.67:0/1491095331 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd120055b90 con 0x7fd12815baf0 2024-09-19T05:46:18.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 -- 172.21.15.67:0/1491095331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd12806cb60 con 0x7fd12815baf0 2024-09-19T05:46:18.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd119ffb640 1 -- 172.21.15.67:0/1491095331 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7fd120055490 con 0x7fd12815baf0 2024-09-19T05:46:18.492 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:18.492 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:46:18.493 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:46:18.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 -- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd10c0678c0 msgr2=0x7fd10c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:18.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd10c0678c0 0x7fd10c069d80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd124003fd0 tx=0x7fd1240039a0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 -- 172.21.15.67:0/1491095331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 msgr2=0x7fd128147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 0x7fd128147030 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c430 tx=0x7fd12000c8f0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 -- 172.21.15.67:0/1491095331 shutdown_connections 2024-09-19T05:46:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd12815baf0 0x7fd128147030 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd12815b710 0x7fd128149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd10c0678c0 0x7fd10c069d80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 --2- 172.21.15.67:0/1491095331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1280aef40 0x7fd12814b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:18.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 -- 172.21.15.67:0/1491095331 >> 172.21.15.67:0/1491095331 conn(0x7fd1280d0080 msgr2=0x7fd12806dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:18.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 -- 172.21.15.67:0/1491095331 shutdown_connections 2024-09-19T05:46:18.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:18.493+0000 7fd12f919640 1 -- 172.21.15.67:0/1491095331 wait complete. 2024-09-19T05:46:18.511 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-19T05:46:23.512 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:23.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33ac9bc640 1 Processor -- start 2024-09-19T05:46:23.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33ac9bc640 1 -- start start 2024-09-19T05:46:23.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33ac9bc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33a806dde0 0x7f33a80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:23.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33ac9bc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a806e3c0 con 0x7f33a815c030 2024-09-19T05:46:23.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33ac9bc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a806e6a0 con 0x7f33a80b3510 2024-09-19T05:46:23.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33ac9bc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f33a806e980 con 0x7f33a806dde0 2024-09-19T05:46:23.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33a5d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33a806dde0 0x7f33a80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:23.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33a659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f33a815c030 0x7f33a815d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35584/0 (socket says 172.21.15.67:35584) 2024-09-19T05:46:23.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33a659c640 1 -- 172.21.15.67:0/1803130129 learned_addr learned my addr 172.21.15.67:0/1803130129 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33a5d9b640 1 -- 172.21.15.67:0/1803130129 >> v1:172.21.15.97:6789/0 conn(0x7f33a80b3510 legacy=0x7f33a806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33a5d9b640 1 -- 172.21.15.67:0/1803130129 >> v1:172.21.15.67:6789/0 conn(0x7f33a815c030 legacy=0x7f33a815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33a5d9b640 1 -- 172.21.15.67:0/1803130129 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a806ec60 con 0x7f33a806dde0 2024-09-19T05:46:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.649+0000 7f33a559a640 1 -- 172.21.15.67:0/1803130129 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3905056948 0 0) 0x7f33a806e3c0 con 0x7f33a815c030 2024-09-19T05:46:23.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a5d9b640 1 --2- 172.21.15.67:0/1803130129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a806dde0 0x7f33a80b2fd0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f339c0097c0 tx=0x7f339c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f05bc0187079d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:23.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a559a640 1 -- 172.21.15.67:0/1803130129 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c0ab650 con 0x7f33a806dde0 2024-09-19T05:46:23.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a559a640 1 -- 172.21.15.67:0/1803130129 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c0b0070 con 0x7f33a806dde0 2024-09-19T05:46:23.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a559a640 1 -- 172.21.15.67:0/1803130129 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c0aba10 con 0x7f33a806dde0 2024-09-19T05:46:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1803130129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a806dde0 msgr2=0x7f33a80b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 --2- 172.21.15.67:0/1803130129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a806dde0 0x7f33a80b2fd0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f339c0097c0 tx=0x7f339c01c430 comp rx=0 tx=0).stop 2024-09-19T05:46:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1803130129 shutdown_connections 2024-09-19T05:46:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 --2- 172.21.15.67:0/1803130129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a806dde0 0x7f33a80b2fd0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1803130129 >> 172.21.15.67:0/1803130129 conn(0x7f33a80d0080 msgr2=0x7f33a80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1803130129 shutdown_connections 2024-09-19T05:46:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1803130129 wait complete. 2024-09-19T05:46:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 Processor -- start 2024-09-19T05:46:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 -- start start 2024-09-19T05:46:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33a806dde0 0x7f33a8149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33a80b3510 0x7f33a815db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a815c030 0x7f33a815e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33a816a270 con 0x7f33a815c030 2024-09-19T05:46:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33a816a0f0 con 0x7f33a80b3510 2024-09-19T05:46:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33ac9bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f33a816a3f0 con 0x7f33a806dde0 2024-09-19T05:46:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a815c030 0x7f33a815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a815c030 0x7f33a815e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42712/0 (socket says 172.21.15.67:42712) 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a6d9d640 1 -- 172.21.15.67:0/1178936087 learned_addr learned my addr 172.21.15.67:0/1178936087 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a5d9b640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33a80b3510 0x7f33a815db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a659c640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33a806dde0 0x7f33a8149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a6d9d640 1 -- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33a806dde0 msgr2=0x7f33a8149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a6d9d640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33a806dde0 0x7f33a8149da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a6d9d640 1 -- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33a80b3510 msgr2=0x7f33a815db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a6d9d640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33a80b3510 0x7f33a815db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a6d9d640 1 -- 172.21.15.67:0/1178936087 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a815d540 con 0x7f33a815c030 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.653+0000 7f33a5d9b640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33a80b3510 0x7f33a815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f33a6d9d640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a815c030 0x7f33a815e060 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f33a000c7b0 tx=0x7f33a000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f3396ffd640 1 -- 172.21.15.67:0/1178936087 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0004b70 con 0x7f33a815c030 2024-09-19T05:46:23.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f3396ffd640 1 -- 172.21.15.67:0/1178936087 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a0004d10 con 0x7f33a815c030 2024-09-19T05:46:23.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f3396ffd640 1 -- 172.21.15.67:0/1178936087 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a000aa90 con 0x7f33a815c030 2024-09-19T05:46:23.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1178936087 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a814eca0 con 0x7f33a815c030 2024-09-19T05:46:23.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1178936087 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a814f260 con 0x7f33a815c030 2024-09-19T05:46:23.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1178936087 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a80b2fd0 con 0x7f33a815c030 2024-09-19T05:46:23.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f3396ffd640 1 -- 172.21.15.67:0/1178936087 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33a000ac30 con 0x7f33a815c030 2024-09-19T05:46:23.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f3396ffd640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33880678f0 0x7f3388069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:23.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f3396ffd640 1 -- 172.21.15.67:0/1178936087 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f33a0086130 con 0x7f33a815c030 2024-09-19T05:46:23.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f33a659c640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33880678f0 0x7f3388069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:23.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.657+0000 7f33a659c640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33880678f0 0x7f3388069db0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3398000f70 tx=0x7f3398009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:23.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.661+0000 7f3396ffd640 1 -- 172.21.15.67:0/1178936087 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f33a0020070 con 0x7f33a815c030 2024-09-19T05:46:23.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1178936087 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33a80af830 con 0x7f33a815c030 2024-09-19T05:46:23.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f3396ffd640 1 -- 172.21.15.67:0/1178936087 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7f33a0056a50 con 0x7f33a815c030 2024-09-19T05:46:23.864 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:23.864 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:46:23.864 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:46:23.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33880678f0 msgr2=0x7f3388069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:23.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33880678f0 0x7f3388069db0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3398000f70 tx=0x7f3398009040 comp rx=0 tx=0).stop 2024-09-19T05:46:23.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1178936087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a815c030 msgr2=0x7f33a815e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:23.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a815c030 0x7f33a815e060 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f33a000c7b0 tx=0x7f33a000cc70 comp rx=0 tx=0).stop 2024-09-19T05:46:23.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1178936087 shutdown_connections 2024-09-19T05:46:23.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a815c030 0x7f33a815e060 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:23.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33a80b3510 0x7f33a815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:23.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33880678f0 0x7f3388069db0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:23.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 --2- 172.21.15.67:0/1178936087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33a806dde0 0x7f33a8149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:23.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1178936087 >> 172.21.15.67:0/1178936087 conn(0x7f33a80d0080 msgr2=0x7f33a80b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:23.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1178936087 shutdown_connections 2024-09-19T05:46:23.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:23.865+0000 7f33ac9bc640 1 -- 172.21.15.67:0/1178936087 wait complete. 2024-09-19T05:46:23.884 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-19T05:46:28.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:29.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad7acc640 1 Processor -- start 2024-09-19T05:46:29.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad7acc640 1 -- start start 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad7acc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad0159d60 0x7f6ad006ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad7acc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6ad006f460 0x7f6ad00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad7acc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6ad00b3510 0x7f6ad00acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad7acc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad006de80 con 0x7f6ad00b3510 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad7acc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad006e160 con 0x7f6ad006f460 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad7acc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad006e440 con 0x7f6ad0159d60 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad6069640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6ad00b3510 0x7f6ad00acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad6069640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6ad00b3510 0x7f6ad00acfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40072/0 (socket says 172.21.15.67:40072) 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad6069640 1 -- 172.21.15.67:0/1704883127 learned_addr learned my addr 172.21.15.67:0/1704883127 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad5868640 1 --2- 172.21.15.67:0/1704883127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad0159d60 0x7f6ad006ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad5067640 1 --2- 172.21.15.67:0/1704883127 >> v2:172.21.15.97:3300/0 conn(0x7f6ad006f460 0x7f6ad00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad6069640 1 -- 172.21.15.67:0/1704883127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad0159d60 msgr2=0x7f6ad006ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad6069640 1 --2- 172.21.15.67:0/1704883127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad0159d60 0x7f6ad006ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad6069640 1 -- 172.21.15.67:0/1704883127 >> v2:172.21.15.97:3300/0 conn(0x7f6ad006f460 msgr2=0x7f6ad00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad6069640 1 --2- 172.21.15.67:0/1704883127 >> v2:172.21.15.97:3300/0 conn(0x7f6ad006f460 0x7f6ad00b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad6069640 1 -- 172.21.15.67:0/1704883127 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad006e720 con 0x7f6ad00b3510 2024-09-19T05:46:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.021+0000 7f6ad5067640 1 --2- 172.21.15.67:0/1704883127 >> v2:172.21.15.97:3300/0 conn(0x7f6ad006f460 0x7f6ad00b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad6069640 1 --2- 172.21.15.67:0/1704883127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad00b3510 0x7f6ad00acfb0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f6ad006da80 tx=0x7f6ac801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2a9e9b917d77c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad4866640 1 -- 172.21.15.67:0/1704883127 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80a5670 con 0x7f6ad00b3510 2024-09-19T05:46:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad4866640 1 -- 172.21.15.67:0/1704883127 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac80a5810 con 0x7f6ad00b3510 2024-09-19T05:46:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad4866640 1 -- 172.21.15.67:0/1704883127 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80a5be0 con 0x7f6ad00b3510 2024-09-19T05:46:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- 172.21.15.67:0/1704883127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad00b3510 msgr2=0x7f6ad00acfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 --2- 172.21.15.67:0/1704883127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad00b3510 0x7f6ad00acfb0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f6ad006da80 tx=0x7f6ac801c9f0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- 172.21.15.67:0/1704883127 shutdown_connections 2024-09-19T05:46:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 --2- 172.21.15.67:0/1704883127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad00b3510 0x7f6ad00acfb0 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 --2- 172.21.15.67:0/1704883127 >> v2:172.21.15.97:3300/0 conn(0x7f6ad006f460 0x7f6ad00b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 --2- 172.21.15.67:0/1704883127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad0159d60 0x7f6ad006ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- 172.21.15.67:0/1704883127 >> 172.21.15.67:0/1704883127 conn(0x7f6ad00d0080 msgr2=0x7f6ad00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- 172.21.15.67:0/1704883127 shutdown_connections 2024-09-19T05:46:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- 172.21.15.67:0/1704883127 wait complete. 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 Processor -- start 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- start start 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad006f460 0x7f6ad0158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ad00b3510 0x7f6ad00b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad0159d60 0x7f6ad00b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad00af900 con 0x7f6ad006f460 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad015fda0 con 0x7f6ad00b3510 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad0157fd0 con 0x7f6ad0159d60 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad5868640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad006f460 0x7f6ad0158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad5868640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad006f460 0x7f6ad0158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40076/0 (socket says 172.21.15.67:40076) 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad5868640 1 -- 172.21.15.67:0/480325790 learned_addr learned my addr 172.21.15.67:0/480325790 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad5067640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ad00b3510 0x7f6ad00b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad6069640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad0159d60 0x7f6ad00b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad5868640 1 -- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad0159d60 msgr2=0x7f6ad00b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad5868640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad0159d60 0x7f6ad00b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad5868640 1 -- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ad00b3510 msgr2=0x7f6ad00b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad5868640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ad00b3510 0x7f6ad00b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad5868640 1 -- 172.21.15.67:0/480325790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad0157400 con 0x7f6ad006f460 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad5868640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad006f460 0x7f6ad0158d90 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00d5f0 tx=0x7f6acc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ac67fc640 1 -- 172.21.15.67:0/480325790 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0125f0 con 0x7f6ad006f460 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ac67fc640 1 -- 172.21.15.67:0/480325790 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6acc019070 con 0x7f6ad006f460 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- 172.21.15.67:0/480325790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad01576a0 con 0x7f6ad006f460 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ac67fc640 1 -- 172.21.15.67:0/480325790 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0129b0 con 0x7f6ad006f460 2024-09-19T05:46:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.025+0000 7f6ad7acc640 1 -- 172.21.15.67:0/480325790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad0157c60 con 0x7f6ad006f460 2024-09-19T05:46:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.029+0000 7f6ad7acc640 1 -- 172.21.15.67:0/480325790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad00acfb0 con 0x7f6ad006f460 2024-09-19T05:46:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.029+0000 7f6ac67fc640 1 -- 172.21.15.67:0/480325790 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6acc012b50 con 0x7f6ad006f460 2024-09-19T05:46:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.029+0000 7f6ac67fc640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6ab40678f0 0x7f6ab4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.029+0000 7f6ac67fc640 1 -- 172.21.15.67:0/480325790 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f6acc086190 con 0x7f6ad006f460 2024-09-19T05:46:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.029+0000 7f6ad5067640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6ab40678f0 0x7f6ab4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.029+0000 7f6ad5067640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6ab40678f0 0x7f6ab4069db0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6ad006f0b0 tx=0x7f6ac0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:29.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.033+0000 7f6ac67fc640 1 -- 172.21.15.67:0/480325790 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6acc056b40 con 0x7f6ad006f460 2024-09-19T05:46:29.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.229+0000 7f6ad7acc640 1 -- 172.21.15.67:0/480325790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ad00d0f20 con 0x7f6ad006f460 2024-09-19T05:46:29.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.229+0000 7f6ac67fc640 1 -- 172.21.15.67:0/480325790 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7f6acc056440 con 0x7f6ad006f460 2024-09-19T05:46:29.230 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:29.230 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:46:29.230 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:46:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 -- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6ab40678f0 msgr2=0x7f6ab4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6ab40678f0 0x7f6ab4069db0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6ad006f0b0 tx=0x7f6ac0008040 comp rx=0 tx=0).stop 2024-09-19T05:46:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 -- 172.21.15.67:0/480325790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad006f460 msgr2=0x7f6ad0158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad006f460 0x7f6ad0158d90 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00d5f0 tx=0x7f6acc00dab0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 -- 172.21.15.67:0/480325790 shutdown_connections 2024-09-19T05:46:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6ab40678f0 0x7f6ab4069db0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad0159d60 0x7f6ad00b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ad00b3510 0x7f6ad00b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 --2- 172.21.15.67:0/480325790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ad006f460 0x7f6ad0158d90 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:29.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 -- 172.21.15.67:0/480325790 >> 172.21.15.67:0/480325790 conn(0x7f6ad00d0080 msgr2=0x7f6ad014fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:29.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 -- 172.21.15.67:0/480325790 shutdown_connections 2024-09-19T05:46:29.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:29.233+0000 7f6ad7acc640 1 -- 172.21.15.67:0/480325790 wait complete. 2024-09-19T05:46:29.248 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-19T05:46:34.248 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:34.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f3bd5640 1 Processor -- start 2024-09-19T05:46:34.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f3bd5640 1 -- start start 2024-09-19T05:46:34.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f3bd5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77ec159d60 0x7f77ec06ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:34.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f3bd5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 0x7f77ec0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:34.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f3bd5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ec06de80 con 0x7f77ec0b3510 2024-09-19T05:46:34.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f3bd5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f77ec06e160 con 0x7f77ec159d60 2024-09-19T05:46:34.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f3bd5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f77ec06e440 con 0x7f77ec06f460 2024-09-19T05:46:34.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f1971640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77ec159d60 0x7f77ec06ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:34.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f1971640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77ec159d60 0x7f77ec06ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40084/0 (socket says 172.21.15.67:40084) 2024-09-19T05:46:34.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f1971640 1 -- 172.21.15.67:0/3554798697 learned_addr learned my addr 172.21.15.67:0/3554798697 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:34.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f1170640 1 --2- 172.21.15.67:0/3554798697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 0x7f77ec0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:34.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f1971640 1 -- 172.21.15.67:0/3554798697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 msgr2=0x7f77ec0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:34.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f1971640 1 --2- 172.21.15.67:0/3554798697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 0x7f77ec0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:34.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f1971640 1 -- 172.21.15.67:0/3554798697 >> v1:172.21.15.97:6789/0 conn(0x7f77ec0b3510 legacy=0x7f77ec0acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:34.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f1971640 1 -- 172.21.15.67:0/3554798697 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec06e720 con 0x7f77ec159d60 2024-09-19T05:46:34.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.385+0000 7f77f1170640 1 --2- 172.21.15.67:0/3554798697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 0x7f77ec0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:34.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f1971640 1 --2- 172.21.15.67:0/3554798697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 0x7f77ec06ef20 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009870 tx=0x7f77e801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f2b963b50a2c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:34.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f096f640 1 -- 172.21.15.67:0/3554798697 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e80b0070 con 0x7f77ec159d60 2024-09-19T05:46:34.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f096f640 1 -- 172.21.15.67:0/3554798697 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e80ab600 con 0x7f77ec159d60 2024-09-19T05:46:34.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f096f640 1 -- 172.21.15.67:0/3554798697 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e80ab9d0 con 0x7f77ec159d60 2024-09-19T05:46:34.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 -- 172.21.15.67:0/3554798697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 msgr2=0x7f77ec06ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:34.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 --2- 172.21.15.67:0/3554798697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 0x7f77ec06ef20 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009870 tx=0x7f77e801c520 comp rx=0 tx=0).stop 2024-09-19T05:46:34.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 -- 172.21.15.67:0/3554798697 shutdown_connections 2024-09-19T05:46:34.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 --2- 172.21.15.67:0/3554798697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 0x7f77ec0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:34.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 --2- 172.21.15.67:0/3554798697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 0x7f77ec06ef20 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:34.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 -- 172.21.15.67:0/3554798697 >> 172.21.15.67:0/3554798697 conn(0x7f77ec0d0080 msgr2=0x7f77ec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:34.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 -- 172.21.15.67:0/3554798697 shutdown_connections 2024-09-19T05:46:34.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 -- 172.21.15.67:0/3554798697 wait complete. 2024-09-19T05:46:34.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 Processor -- start 2024-09-19T05:46:34.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 -- start start 2024-09-19T05:46:34.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 0x7f77ec148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:34.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77ec0b3510 0x7f77ec14f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:34.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 0x7f77ec14dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:34.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec0af6b0 con 0x7f77ec159d60 2024-09-19T05:46:34.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec0ad8d0 con 0x7f77ec0b3510 2024-09-19T05:46:34.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f3bd5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f77ec0af830 con 0x7f77ec06f460 2024-09-19T05:46:34.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f2172640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 0x7f77ec14dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:34.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f2172640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 0x7f77ec14dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40094/0 (socket says 172.21.15.67:40094) 2024-09-19T05:46:34.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f2172640 1 -- 172.21.15.67:0/785034631 learned_addr learned my addr 172.21.15.67:0/785034631 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:34.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f1170640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77ec0b3510 0x7f77ec14f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:34.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.389+0000 7f77f1971640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 0x7f77ec148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:34.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f2172640 1 -- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 msgr2=0x7f77ec148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:34.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f2172640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 0x7f77ec148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:34.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f2172640 1 -- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77ec0b3510 msgr2=0x7f77ec14f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:34.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f2172640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77ec0b3510 0x7f77ec14f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:34.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f2172640 1 -- 172.21.15.67:0/785034631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec148300 con 0x7f77ec159d60 2024-09-19T05:46:34.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f1971640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 0x7f77ec148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:34.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f2172640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 0x7f77ec14dc50 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f77e400c780 tx=0x7f77e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:34.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77e27fc640 1 -- 172.21.15.67:0/785034631 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4004b70 con 0x7f77ec159d60 2024-09-19T05:46:34.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77e27fc640 1 -- 172.21.15.67:0/785034631 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e4004d10 con 0x7f77ec159d60 2024-09-19T05:46:34.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f3bd5640 1 -- 172.21.15.67:0/785034631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec14f6a0 con 0x7f77ec159d60 2024-09-19T05:46:34.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77e27fc640 1 -- 172.21.15.67:0/785034631 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e400aa90 con 0x7f77ec159d60 2024-09-19T05:46:34.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f3bd5640 1 -- 172.21.15.67:0/785034631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec14fc60 con 0x7f77ec159d60 2024-09-19T05:46:34.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f3bd5640 1 -- 172.21.15.67:0/785034631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ec0b2fd0 con 0x7f77ec159d60 2024-09-19T05:46:34.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77e27fc640 1 -- 172.21.15.67:0/785034631 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77e400ac30 con 0x7f77ec159d60 2024-09-19T05:46:34.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77e27fc640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77d00678c0 0x7f77d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:34.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77e27fc640 1 -- 172.21.15.67:0/785034631 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6101+0+0 (secure 0 0 0) 0x7f77e40860c0 con 0x7f77ec159d60 2024-09-19T05:46:34.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f1971640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77d00678c0 0x7f77d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:34.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.393+0000 7f77f1971640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77d00678c0 0x7f77d0069d80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f77e80ad000 tx=0x7f77e8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:34.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.397+0000 7f77e27fc640 1 -- 172.21.15.67:0/785034631 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f77e4020070 con 0x7f77ec159d60 2024-09-19T05:46:34.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.593+0000 7f77f3bd5640 1 -- 172.21.15.67:0/785034631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77ec0b4860 con 0x7f77ec159d60 2024-09-19T05:46:34.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77e27fc640 1 -- 172.21.15.67:0/785034631 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+5233 (secure 0 0 0) 0x7f77ec148300 con 0x7f77ec159d60 2024-09-19T05:46:34.595 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:34.595 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":115,"btime":"2024-09-19T05:45:48:203695+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:45:47.573580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1716781558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1716781558},{"type":"v1","addr":"172.21.15.67:6835","nonce":1716781558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9579,"qdb_cluster":[9579]},"id":11}]} 2024-09-19T05:46:34.595 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 115 2024-09-19T05:46:34.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 -- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77d00678c0 msgr2=0x7f77d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:34.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77d00678c0 0x7f77d0069d80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f77e80ad000 tx=0x7f77e8008040 comp rx=0 tx=0).stop 2024-09-19T05:46:34.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 -- 172.21.15.67:0/785034631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 msgr2=0x7f77ec14dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:34.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 0x7f77ec14dc50 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f77e400c780 tx=0x7f77e400cc40 comp rx=0 tx=0).stop 2024-09-19T05:46:34.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 -- 172.21.15.67:0/785034631 shutdown_connections 2024-09-19T05:46:34.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77ec159d60 0x7f77ec14dc50 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:34.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77ec0b3510 0x7f77ec14f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:34.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f77d00678c0 0x7f77d0069d80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:34.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 --2- 172.21.15.67:0/785034631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77ec06f460 0x7f77ec148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:34.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 -- 172.21.15.67:0/785034631 >> 172.21.15.67:0/785034631 conn(0x7f77ec0d0080 msgr2=0x7f77ec15a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:34.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 -- 172.21.15.67:0/785034631 shutdown_connections 2024-09-19T05:46:34.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:34.597+0000 7f77f3bd5640 1 -- 172.21.15.67:0/785034631 wait complete. 2024-09-19T05:46:34.613 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-19T05:46:39.614 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:39.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.749+0000 7f2034531640 1 Processor -- start 2024-09-19T05:46:39.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.749+0000 7f2034531640 1 -- start start 2024-09-19T05:46:39.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.749+0000 7f2034531640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f202c070140 0x7f202c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:39.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.749+0000 7f2034531640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f202c0ae8c0 0x7f202c0aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:39.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.749+0000 7f2034531640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202c0cd350 con 0x7f202c0ccee0 2024-09-19T05:46:39.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.749+0000 7f2034531640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f202c06e790 con 0x7f202c070140 2024-09-19T05:46:39.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.749+0000 7f2034531640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f202c06ea50 con 0x7f202c0ae8c0 2024-09-19T05:46:39.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.749+0000 7f20322cd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f202c070140 0x7f202c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:39.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.749+0000 7f20322cd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f202c070140 0x7f202c15f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39942/0 (socket says 172.21.15.67:39942) 2024-09-19T05:46:39.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.749+0000 7f20322cd640 1 -- 172.21.15.67:0/2013229798 learned_addr learned my addr 172.21.15.67:0/2013229798 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:39.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f2032ace640 1 --2- 172.21.15.67:0/2013229798 >> v2:172.21.15.97:3300/0 conn(0x7f202c0ae8c0 0x7f202c0aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:39.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f20322cd640 1 -- 172.21.15.67:0/2013229798 >> v2:172.21.15.97:3300/0 conn(0x7f202c0ae8c0 msgr2=0x7f202c0aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:39.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f20322cd640 1 --2- 172.21.15.67:0/2013229798 >> v2:172.21.15.97:3300/0 conn(0x7f202c0ae8c0 0x7f202c0aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:39.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f20322cd640 1 -- 172.21.15.67:0/2013229798 >> v1:172.21.15.67:6789/0 conn(0x7f202c0ccee0 legacy=0x7f202c070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:39.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f20322cd640 1 -- 172.21.15.67:0/2013229798 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c06ed30 con 0x7f202c070140 2024-09-19T05:46:39.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f20312cb640 1 -- 172.21.15.67:0/2013229798 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743440454 0 0) 0x7f2020001120 con 0x7f202c0ccee0 2024-09-19T05:46:39.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f2032ace640 1 --2- 172.21.15.67:0/2013229798 >> v2:172.21.15.97:3300/0 conn(0x7f202c0ae8c0 0x7f202c0aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:39.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f20322cd640 1 --2- 172.21.15.67:0/2013229798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c070140 0x7f202c15f370 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f201c009e50 tx=0x7f201c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3bbac0d9d77ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:39.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f20312cb640 1 -- 172.21.15.67:0/2013229798 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0afa80 con 0x7f202c070140 2024-09-19T05:46:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f20312cb640 1 -- 172.21.15.67:0/2013229798 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c0a57f0 con 0x7f202c070140 2024-09-19T05:46:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f20312cb640 1 -- 172.21.15.67:0/2013229798 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c0a5bc0 con 0x7f202c070140 2024-09-19T05:46:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f2034531640 1 -- 172.21.15.67:0/2013229798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c070140 msgr2=0x7f202c15f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f2034531640 1 --2- 172.21.15.67:0/2013229798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c070140 0x7f202c15f370 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f201c009e50 tx=0x7f201c01c930 comp rx=0 tx=0).stop 2024-09-19T05:46:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f2034531640 1 -- 172.21.15.67:0/2013229798 shutdown_connections 2024-09-19T05:46:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f2034531640 1 --2- 172.21.15.67:0/2013229798 >> v2:172.21.15.97:3300/0 conn(0x7f202c0ae8c0 0x7f202c0aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f2034531640 1 --2- 172.21.15.67:0/2013229798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c070140 0x7f202c15f370 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f2034531640 1 -- 172.21.15.67:0/2013229798 >> 172.21.15.67:0/2013229798 conn(0x7f202c073500 msgr2=0x7f202c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f2034531640 1 -- 172.21.15.67:0/2013229798 shutdown_connections 2024-09-19T05:46:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.753+0000 7f2034531640 1 -- 172.21.15.67:0/2013229798 wait complete. 2024-09-19T05:46:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2034531640 1 Processor -- start 2024-09-19T05:46:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2034531640 1 -- start start 2024-09-19T05:46:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2034531640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f202c070140 0x7f202c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2034531640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0ae8c0 0x7f202c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2034531640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c0ccee0 0x7f202c14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2034531640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f202c15c2e0 con 0x7f202c0ae8c0 2024-09-19T05:46:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2034531640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f202c15c160 con 0x7f202c0ccee0 2024-09-19T05:46:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2034531640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f202c16afc0 con 0x7f202c070140 2024-09-19T05:46:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2031acc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0ae8c0 0x7f202c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2031acc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0ae8c0 0x7f202c158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39958/0 (socket says 172.21.15.67:39958) 2024-09-19T05:46:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2031acc640 1 -- 172.21.15.67:0/3466851313 learned_addr learned my addr 172.21.15.67:0/3466851313 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f20322cd640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f202c070140 0x7f202c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2032ace640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c0ccee0 0x7f202c14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2031acc640 1 -- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f202c070140 msgr2=0x7f202c152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2031acc640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f202c070140 0x7f202c152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2031acc640 1 -- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c0ccee0 msgr2=0x7f202c14fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2031acc640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c0ccee0 0x7f202c14fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2031acc640 1 -- 172.21.15.67:0/3466851313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c152ca0 con 0x7f202c0ae8c0 2024-09-19T05:46:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2032ace640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c0ccee0 0x7f202c14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2031acc640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0ae8c0 0x7f202c158c00 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f202000c450 tx=0x7f202000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f202affd640 1 -- 172.21.15.67:0/3466851313 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020017070 con 0x7f202c0ae8c0 2024-09-19T05:46:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f202affd640 1 -- 172.21.15.67:0/3466851313 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2020005480 con 0x7f202c0ae8c0 2024-09-19T05:46:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f202affd640 1 -- 172.21.15.67:0/3466851313 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020003840 con 0x7f202c0ae8c0 2024-09-19T05:46:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2034531640 1 -- 172.21.15.67:0/3466851313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202c152f80 con 0x7f202c0ae8c0 2024-09-19T05:46:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2034531640 1 -- 172.21.15.67:0/3466851313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f202c0ce6f0 con 0x7f202c0ae8c0 2024-09-19T05:46:39.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f2028ff9640 1 -- 172.21.15.67:0/3466851313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20100052a0 con 0x7f202c0ae8c0 2024-09-19T05:46:39.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.757+0000 7f202affd640 1 -- 172.21.15.67:0/3466851313 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f202001a070 con 0x7f202c0ae8c0 2024-09-19T05:46:39.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.761+0000 7f202affd640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20180678c0 0x7f2018069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:39.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.761+0000 7f202affd640 1 -- 172.21.15.67:0/3466851313 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7f2020085120 con 0x7f202c0ae8c0 2024-09-19T05:46:39.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.761+0000 7f20322cd640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20180678c0 0x7f2018069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:39.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.761+0000 7f20322cd640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20180678c0 0x7f2018069d80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f201c0ae000 tx=0x7f201c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:39.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.765+0000 7f202affd640 1 -- 172.21.15.67:0/3466851313 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f202c0cd350 con 0x7f202c0ae8c0 2024-09-19T05:46:39.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.961+0000 7f2028ff9640 1 -- 172.21.15.67:0/3466851313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2010005860 con 0x7f202c0ae8c0 2024-09-19T05:46:39.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.961+0000 7f202affd640 1 -- 172.21.15.67:0/3466851313 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+4410 (secure 0 0 0) 0x7f2020055b10 con 0x7f202c0ae8c0 2024-09-19T05:46:39.963 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:39.963 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":119,"btime":"2024-09-19T05:46:38:222590+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:46:38.222582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":169,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9576":{"gid":9576,"name":"c","rank":0,"incarnation":116,"state":"up:active","state_seq":17,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9576,"qdb_cluster":[9576]},"id":11}]} 2024-09-19T05:46:39.963 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 119 2024-09-19T05:46:39.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 -- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20180678c0 msgr2=0x7f2018069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:39.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20180678c0 0x7f2018069d80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f201c0ae000 tx=0x7f201c0a7070 comp rx=0 tx=0).stop 2024-09-19T05:46:39.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 -- 172.21.15.67:0/3466851313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0ae8c0 msgr2=0x7f202c158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:39.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0ae8c0 0x7f202c158c00 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f202000c450 tx=0x7f202000c910 comp rx=0 tx=0).stop 2024-09-19T05:46:39.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 -- 172.21.15.67:0/3466851313 shutdown_connections 2024-09-19T05:46:39.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c0ccee0 0x7f202c14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0ae8c0 0x7f202c158c00 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20180678c0 0x7f2018069d80 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 --2- 172.21.15.67:0/3466851313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f202c070140 0x7f202c152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 -- 172.21.15.67:0/3466851313 >> 172.21.15.67:0/3466851313 conn(0x7f202c073500 msgr2=0x7f202c15c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 -- 172.21.15.67:0/3466851313 shutdown_connections 2024-09-19T05:46:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:39.965+0000 7f2028ff9640 1 -- 172.21.15.67:0/3466851313 wait complete. 2024-09-19T05:46:39.982 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-09-19T05:46:39.982 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:40.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.109+0000 7fc9c1433640 1 Processor -- start 2024-09-19T05:46:40.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.109+0000 7fc9c1433640 1 -- start start 2024-09-19T05:46:40.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9c1433640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9bc15e330 0x7fc9bc071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9c1433640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9bc0b2fd0 0x7fc9bc0724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9c1433640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9bc0b4420 con 0x7fc9bc0b4bc0 2024-09-19T05:46:40.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9c1433640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc9bc0acfb0 con 0x7fc9bc0b2fd0 2024-09-19T05:46:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9c1433640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc9bc0b3ef0 con 0x7fc9bc15e330 2024-09-19T05:46:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9ba7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9bc0b2fd0 0x7fc9bc0724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9ba7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9bc0b2fd0 0x7fc9bc0724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39972/0 (socket says 172.21.15.67:39972) 2024-09-19T05:46:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9ba7fc640 1 -- 172.21.15.67:0/1974440264 learned_addr learned my addr 172.21.15.67:0/1974440264 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9baffd640 1 --2- 172.21.15.67:0/1974440264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9bc15e330 0x7fc9bc071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9ba7fc640 1 -- 172.21.15.67:0/1974440264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9bc15e330 msgr2=0x7fc9bc071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9ba7fc640 1 --2- 172.21.15.67:0/1974440264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9bc15e330 0x7fc9bc071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9ba7fc640 1 -- 172.21.15.67:0/1974440264 >> v1:172.21.15.67:6789/0 conn(0x7fc9bc0b4bc0 legacy=0x7fc9bc161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.113+0000 7fc9ba7fc640 1 -- 172.21.15.67:0/1974440264 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc0b4140 con 0x7fc9bc0b2fd0 2024-09-19T05:46:40.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9ba7fc640 1 --2- 172.21.15.67:0/1974440264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc0b2fd0 0x7fc9bc0724e0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009870 tx=0x7fc9b001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a37ef48339ea799 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:40.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9b9ffb640 1 -- 172.21.15.67:0/1974440264 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00ab650 con 0x7fc9bc0b2fd0 2024-09-19T05:46:40.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9b9ffb640 1 -- 172.21.15.67:0/1974440264 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b00b0070 con 0x7fc9bc0b2fd0 2024-09-19T05:46:40.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9b9ffb640 1 -- 172.21.15.67:0/1974440264 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00aba10 con 0x7fc9bc0b2fd0 2024-09-19T05:46:40.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 -- 172.21.15.67:0/1974440264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc0b2fd0 msgr2=0x7fc9bc0724e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 --2- 172.21.15.67:0/1974440264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc0b2fd0 0x7fc9bc0724e0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009870 tx=0x7fc9b001c530 comp rx=0 tx=0).stop 2024-09-19T05:46:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 -- 172.21.15.67:0/1974440264 shutdown_connections 2024-09-19T05:46:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 --2- 172.21.15.67:0/1974440264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc0b2fd0 0x7fc9bc0724e0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 --2- 172.21.15.67:0/1974440264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9bc15e330 0x7fc9bc071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 -- 172.21.15.67:0/1974440264 >> 172.21.15.67:0/1974440264 conn(0x7fc9bc0d0080 msgr2=0x7fc9bc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 -- 172.21.15.67:0/1974440264 shutdown_connections 2024-09-19T05:46:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 -- 172.21.15.67:0/1974440264 wait complete. 2024-09-19T05:46:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 Processor -- start 2024-09-19T05:46:40.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 -- start start 2024-09-19T05:46:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9bc0b4bc0 0x7fc9bc15f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9bc15e330 0x7fc9bc148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc151f80 0x7fc9bc1609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc06f880 con 0x7fc9bc151f80 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc06f700 con 0x7fc9bc0b4bc0 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9c1433640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc9bc0cfcc0 con 0x7fc9bc15e330 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9bb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc151f80 0x7fc9bc1609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9bb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc151f80 0x7fc9bc1609b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39976/0 (socket says 172.21.15.67:39976) 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9bb7fe640 1 -- 172.21.15.67:0/598102647 learned_addr learned my addr 172.21.15.67:0/598102647 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9baffd640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9bc0b4bc0 0x7fc9bc15f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9ba7fc640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9bc15e330 0x7fc9bc148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9bb7fe640 1 -- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9bc15e330 msgr2=0x7fc9bc148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9bb7fe640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9bc15e330 0x7fc9bc148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.117+0000 7fc9bb7fe640 1 -- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9bc0b4bc0 msgr2=0x7fc9bc15f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9bb7fe640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9bc0b4bc0 0x7fc9bc15f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9bb7fe640 1 -- 172.21.15.67:0/598102647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc148780 con 0x7fc9bc151f80 2024-09-19T05:46:40.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9bb7fe640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc151f80 0x7fc9bc1609b0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400c710 tx=0x7fc9b400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:40.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9a37fe640 1 -- 172.21.15.67:0/598102647 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4016020 con 0x7fc9bc151f80 2024-09-19T05:46:40.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9a37fe640 1 -- 172.21.15.67:0/598102647 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b4006d60 con 0x7fc9bc151f80 2024-09-19T05:46:40.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9c1433640 1 -- 172.21.15.67:0/598102647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc15f970 con 0x7fc9bc151f80 2024-09-19T05:46:40.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9a37fe640 1 -- 172.21.15.67:0/598102647 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4003bc0 con 0x7fc9bc151f80 2024-09-19T05:46:40.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9c1433640 1 -- 172.21.15.67:0/598102647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc1601b0 con 0x7fc9bc151f80 2024-09-19T05:46:40.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9c1433640 1 -- 172.21.15.67:0/598102647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9bc161f70 con 0x7fc9bc151f80 2024-09-19T05:46:40.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9a37fe640 1 -- 172.21.15.67:0/598102647 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc9b400a7f0 con 0x7fc9bc151f80 2024-09-19T05:46:40.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9a37fe640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9a80678c0 0x7fc9a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9a37fe640 1 -- 172.21.15.67:0/598102647 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7fc9b4085a80 con 0x7fc9bc151f80 2024-09-19T05:46:40.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9baffd640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9a80678c0 0x7fc9a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.121+0000 7fc9baffd640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9a80678c0 0x7fc9a8069d80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc14ec90 tx=0x7fc9ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.125+0000 7fc9a37fe640 1 -- 172.21.15.67:0/598102647 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc9b4020020 con 0x7fc9bc151f80 2024-09-19T05:46:40.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 -- 172.21.15.67:0/598102647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9bc161ce0 con 0x7fc9bc151f80 2024-09-19T05:46:40.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9a37fe640 1 -- 172.21.15.67:0/598102647 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+4410 (secure 0 0 0) 0x7fc9bc15f970 con 0x7fc9bc151f80 2024-09-19T05:46:40.332 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:40.333 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":119,"btime":"2024-09-19T05:46:38:222590+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:46:38.222582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":169,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9576":{"gid":9576,"name":"c","rank":0,"incarnation":116,"state":"up:active","state_seq":17,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9576,"qdb_cluster":[9576]},"id":11}]} 2024-09-19T05:46:40.333 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 119 2024-09-19T05:46:40.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 -- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9a80678c0 msgr2=0x7fc9a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9a80678c0 0x7fc9a8069d80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc14ec90 tx=0x7fc9ac008040 comp rx=0 tx=0).stop 2024-09-19T05:46:40.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 -- 172.21.15.67:0/598102647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc151f80 msgr2=0x7fc9bc1609b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc151f80 0x7fc9bc1609b0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400c710 tx=0x7fc9b400cbd0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 -- 172.21.15.67:0/598102647 shutdown_connections 2024-09-19T05:46:40.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9bc151f80 0x7fc9bc1609b0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9a80678c0 0x7fc9a8069d80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9bc15e330 0x7fc9bc148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 --2- 172.21.15.67:0/598102647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9bc0b4bc0 0x7fc9bc15f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.333+0000 7fc9c1433640 1 -- 172.21.15.67:0/598102647 >> 172.21.15.67:0/598102647 conn(0x7fc9bc0d0080 msgr2=0x7fc9bc071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:40.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.337+0000 7fc9c1433640 1 -- 172.21.15.67:0/598102647 shutdown_connections 2024-09-19T05:46:40.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.337+0000 7fc9c1433640 1 -- 172.21.15.67:0/598102647 wait complete. 2024-09-19T05:46:40.352 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-19T05:46:40.352 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:46:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.473+0000 7f3614ae9640 1 Processor -- start 2024-09-19T05:46:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.473+0000 7f3614ae9640 1 -- start start 2024-09-19T05:46:40.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f36100ad6c0 0x7f36100b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f361006de80 con 0x7f3610159d60 2024-09-19T05:46:40.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f361006e160 con 0x7f36100b2fd0 2024-09-19T05:46:40.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f361006e440 con 0x7f36100ad6c0 2024-09-19T05:46:40.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360ed9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f36100ad6c0 0x7f36100b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360ed9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f36100ad6c0 0x7f36100b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39984/0 (socket says 172.21.15.67:39984) 2024-09-19T05:46:40.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360ed9d640 1 -- 172.21.15.67:0/2066683079 learned_addr learned my addr 172.21.15.67:0/2066683079 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:40.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360e59c640 1 --1- 172.21.15.67:0/2066683079 >> v1:172.21.15.67:6789/0 conn(0x7f3610159d60 0x7f361006ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58908/0 (socket says 172.21.15.67:58908) 2024-09-19T05:46:40.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360ed9d640 1 -- 172.21.15.67:0/2066683079 >> v1:172.21.15.97:6789/0 conn(0x7f36100b2fd0 legacy=0x7f36100acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:40.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360ed9d640 1 -- 172.21.15.67:0/2066683079 >> v1:172.21.15.67:6789/0 conn(0x7f3610159d60 legacy=0x7f361006ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360ed9d640 1 -- 172.21.15.67:0/2066683079 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361006e720 con 0x7f36100ad6c0 2024-09-19T05:46:40.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360ed9d640 1 --2- 172.21.15.67:0/2066683079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 0x7f36100b3420 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f3608009870 tx=0x7f360801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fbff2042687cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:40.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360d59a640 1 -- 172.21.15.67:0/2066683079 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080b1070 con 0x7f36100ad6c0 2024-09-19T05:46:40.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360d59a640 1 -- 172.21.15.67:0/2066683079 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36080ac410 con 0x7f36100ad6c0 2024-09-19T05:46:40.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f360d59a640 1 -- 172.21.15.67:0/2066683079 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080ac7e0 con 0x7f36100ad6c0 2024-09-19T05:46:40.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 -- 172.21.15.67:0/2066683079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 msgr2=0x7f36100b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 --2- 172.21.15.67:0/2066683079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 0x7f36100b3420 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f3608009870 tx=0x7f360801c520 comp rx=0 tx=0).stop 2024-09-19T05:46:40.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 -- 172.21.15.67:0/2066683079 shutdown_connections 2024-09-19T05:46:40.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 --2- 172.21.15.67:0/2066683079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 0x7f36100b3420 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 -- 172.21.15.67:0/2066683079 >> 172.21.15.67:0/2066683079 conn(0x7f36100d0080 msgr2=0x7f36100d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:40.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 -- 172.21.15.67:0/2066683079 shutdown_connections 2024-09-19T05:46:40.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.477+0000 7f3614ae9640 1 -- 172.21.15.67:0/2066683079 wait complete. 2024-09-19T05:46:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 Processor -- start 2024-09-19T05:46:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 -- start start 2024-09-19T05:46:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 0x7f3610167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36100b2fd0 0x7f3610150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3610159d60 0x7f361015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f36100af830 con 0x7f36100ad6c0 2024-09-19T05:46:40.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f36100af6b0 con 0x7f3610159d60 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f36100af9b0 con 0x7f36100b2fd0 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 0x7f3610167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 0x7f3610167930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39986/0 (socket says 172.21.15.67:39986) 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360e59c640 1 -- 172.21.15.67:0/438824970 learned_addr learned my addr 172.21.15.67:0/438824970 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360ed9d640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3610159d60 0x7f361015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360dd9b640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36100b2fd0 0x7f3610150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360e59c640 1 -- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36100b2fd0 msgr2=0x7f3610150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360e59c640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36100b2fd0 0x7f3610150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360e59c640 1 -- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3610159d60 msgr2=0x7f361015c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360e59c640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3610159d60 0x7f361015c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360e59c640 1 -- 172.21.15.67:0/438824970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3610072530 con 0x7f36100ad6c0 2024-09-19T05:46:40.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360ed9d640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3610159d60 0x7f361015c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f360e59c640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 0x7f3610167930 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f360000c730 tx=0x7f360000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3606ffd640 1 -- 172.21.15.67:0/438824970 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600017070 con 0x7f36100ad6c0 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3606ffd640 1 -- 172.21.15.67:0/438824970 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360000ce40 con 0x7f36100ad6c0 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 -- 172.21.15.67:0/438824970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3610150da0 con 0x7f36100ad6c0 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3606ffd640 1 -- 172.21.15.67:0/438824970 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360000a860 con 0x7f36100ad6c0 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 -- 172.21.15.67:0/438824970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3610072a80 con 0x7f36100ad6c0 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.481+0000 7f3614ae9640 1 -- 172.21.15.67:0/438824970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36100d0f20 con 0x7f36100ad6c0 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.485+0000 7f3606ffd640 1 -- 172.21.15.67:0/438824970 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f360001a070 con 0x7f36100ad6c0 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.485+0000 7f3606ffd640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35f00678c0 0x7f35f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.485+0000 7f3606ffd640 1 -- 172.21.15.67:0/438824970 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7f3600085490 con 0x7f36100ad6c0 2024-09-19T05:46:40.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.485+0000 7f360dd9b640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35f00678c0 0x7f35f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:40.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.485+0000 7f360dd9b640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35f00678c0 0x7f35f0069d80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f36101680c0 tx=0x7f35f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:40.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.489+0000 7f3606ffd640 1 -- 172.21.15.67:0/438824970 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3600055d90 con 0x7f36100ad6c0 2024-09-19T05:46:40.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.713+0000 7f3614ae9640 1 -- 172.21.15.67:0/438824970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f36100b3400 con 0x7f36100ad6c0 2024-09-19T05:46:40.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.713+0000 7f3606ffd640 1 -- 172.21.15.67:0/438824970 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1509 (secure 0 0 0) 0x7f3600055690 con 0x7f36100ad6c0 2024-09-19T05:46:40.713 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:40.713 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":830,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":169,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078026223,"bytes_used":2712776704,"bytes_avail":770381336576,"bytes_total":773094113280,"read_bytes_sec":370969,"write_bytes_sec":204,"read_op_per_sec":1,"write_op_per_sec":0},"fsmap":{"epoch":119,"btime":"2024-09-19T05:46:38:222590+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9576}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-19T05:46:35.388721+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:46:40.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 -- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35f00678c0 msgr2=0x7f35f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35f00678c0 0x7f35f0069d80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f36101680c0 tx=0x7f35f8008040 comp rx=0 tx=0).stop 2024-09-19T05:46:40.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 -- 172.21.15.67:0/438824970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 msgr2=0x7f3610167930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:40.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 0x7f3610167930 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f360000c730 tx=0x7f360000cbf0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 -- 172.21.15.67:0/438824970 shutdown_connections 2024-09-19T05:46:40.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3610159d60 0x7f361015c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f35f00678c0 0x7f35f0069d80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36100b2fd0 0x7f3610150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 --2- 172.21.15.67:0/438824970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36100ad6c0 0x7f3610167930 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:40.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 -- 172.21.15.67:0/438824970 >> 172.21.15.67:0/438824970 conn(0x7f36100d0080 msgr2=0x7f36100b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:40.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 -- 172.21.15.67:0/438824970 shutdown_connections 2024-09-19T05:46:40.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:40.717+0000 7f3614ae9640 1 -- 172.21.15.67:0/438824970 wait complete. 2024-09-19T05:46:40.733 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-19T05:46:40.734 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:46:40.734 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:46:40.800 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:46:40.878 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:46:40.878 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:46:40.878 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:46:40.878 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:46:40.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f23c6d640 1 Processor -- start 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f23c6d640 1 -- start start 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f23c6d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f1c161da0 0x7f3f1c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f23c6d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f1c0d0e80 0x7f3f1c0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f23c6d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f1c0d4d40 con 0x7f3f1c0b41c0 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f23c6d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3f1c0d0840 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f23c6d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c0d1800 con 0x7f3f1c161da0 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f21208640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f1c0d0e80 0x7f3f1c0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f2220a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3f1c0b41c0 0x7f3f1c0b4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58922/0 (socket says 172.21.15.67:58922) 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f21208640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f1c0d0e80 0x7f3f1c0d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40000/0 (socket says 172.21.15.67:40000) 2024-09-19T05:46:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f2220a640 1 -- 172.21.15.67:0/4085449962 learned_addr learned my addr 172.21.15.67:0/4085449962 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:41.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f21a09640 1 --2- 172.21.15.67:0/4085449962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f1c161da0 0x7f3f1c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f20a07640 1 -- 172.21.15.67:0/4085449962 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097571843 0 0) 0x7f3f1c0d4d40 con 0x7f3f1c0b41c0 2024-09-19T05:46:41.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f20a07640 1 -- 172.21.15.67:0/4085449962 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f08003530 con 0x7f3f1c0b41c0 2024-09-19T05:46:41.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f21208640 1 -- 172.21.15.67:0/4085449962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f1c161da0 msgr2=0x7f3f1c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:41.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f21208640 1 --2- 172.21.15.67:0/4085449962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f1c161da0 0x7f3f1c0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f21208640 1 -- 172.21.15.67:0/4085449962 >> v1:172.21.15.67:6789/0 conn(0x7f3f1c0b41c0 legacy=0x7f3f1c0b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.061+0000 7f3f21208640 1 -- 172.21.15.67:0/4085449962 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c0d5020 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f21208640 1 --2- 172.21.15.67:0/4085449962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 0x7f3f1c0d12c0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f3f180097c0 tx=0x7f3f1801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b813839133ab67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:41.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f20a07640 1 -- 172.21.15.67:0/4085449962 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f180b0070 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f20a07640 1 -- 172.21.15.67:0/4085449962 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f180ab600 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f20a07640 1 -- 172.21.15.67:0/4085449962 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f180ab9b0 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4085449962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 msgr2=0x7f3f1c0d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f23c6d640 1 --2- 172.21.15.67:0/4085449962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 0x7f3f1c0d12c0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f3f180097c0 tx=0x7f3f1801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4085449962 shutdown_connections 2024-09-19T05:46:41.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f23c6d640 1 --2- 172.21.15.67:0/4085449962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 0x7f3f1c0d12c0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f23c6d640 1 --2- 172.21.15.67:0/4085449962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f1c161da0 0x7f3f1c0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4085449962 >> 172.21.15.67:0/4085449962 conn(0x7f3f1c08bfc0 msgr2=0x7f3f1c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:41.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4085449962 shutdown_connections 2024-09-19T05:46:41.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4085449962 wait complete. 2024-09-19T05:46:41.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f23c6d640 1 Processor -- start 2024-09-19T05:46:41.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.065+0000 7f3f23c6d640 1 -- start start 2024-09-19T05:46:41.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f23c6d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f1c0b41c0 0x7f3f1c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f23c6d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 0x7f3f1c0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f23c6d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f1c161da0 0x7f3f1c151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f23c6d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c162180 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f23c6d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c0b5d00 con 0x7f3f1c161da0 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f23c6d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c16b4f0 con 0x7f3f1c0b41c0 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21208640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 0x7f3f1c0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21208640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 0x7f3f1c0c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40016/0 (socket says 172.21.15.67:40016) 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21208640 1 -- 172.21.15.67:0/4251914779 learned_addr learned my addr 172.21.15.67:0/4251914779 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21a09640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f1c0b41c0 0x7f3f1c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f2220a640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f1c161da0 0x7f3f1c151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21208640 1 -- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f1c0b41c0 msgr2=0x7f3f1c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21208640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f1c0b41c0 0x7f3f1c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21208640 1 -- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f1c161da0 msgr2=0x7f3f1c151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21208640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f1c161da0 0x7f3f1c151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21208640 1 -- 172.21.15.67:0/4251914779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c0c8500 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f2220a640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f1c161da0 0x7f3f1c151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:41.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21208640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 0x7f3f1c0c7fc0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f3f180ae040 tx=0x7f3f18019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:41.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f0e7fc640 1 -- 172.21.15.67:0/4251914779 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f180ba070 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f0e7fc640 1 -- 172.21.15.67:0/4251914779 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f180b43f0 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4251914779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1c0ca910 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f0e7fc640 1 -- 172.21.15.67:0/4251914779 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f180b0040 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4251914779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1c0ca5e0 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4251914779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1c0d12c0 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f0e7fc640 1 -- 172.21.15.67:0/4251914779 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f180bd070 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f0e7fc640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f000678c0 0x7f3f00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f0e7fc640 1 -- 172.21.15.67:0/4251914779 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7f3f1811f100 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.069+0000 7f3f21a09640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f000678c0 0x7f3f00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.073+0000 7f3f21a09640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f000678c0 0x7f3f00069d80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000b930 tx=0x7f3f10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:41.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.073+0000 7f3f0e7fc640 1 -- 172.21.15.67:0/4251914779 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3f18016090 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.088 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:46:41.091 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:46:41.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.249+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4251914779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3f1c0d2390 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f0e7fc640 1 -- 172.21.15.67:0/4251914779 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v169) ==== 80+0+122 (secure 0 0 0) 0x7f3f180efa60 con 0x7f3f1c0d0e80 2024-09-19T05:46:41.252 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6835/1716781558 2024-09-20T05:46:35.207652+0000 2024-09-19T05:46:41.252 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6834/1716781558 2024-09-20T05:46:35.207652+0000 2024-09-19T05:46:41.252 INFO:teuthology.orchestra.run.smithi067.stderr:listed 2 entries 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f000678c0 msgr2=0x7f3f00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f000678c0 0x7f3f00069d80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000b930 tx=0x7f3f10008040 comp rx=0 tx=0).stop 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4251914779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 msgr2=0x7f3f1c0c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 0x7f3f1c0c7fc0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f3f180ae040 tx=0x7f3f18019240 comp rx=0 tx=0).stop 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4251914779 shutdown_connections 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f1c161da0 0x7f3f1c151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f1c0d0e80 0x7f3f1c0c7fc0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f000678c0 0x7f3f00069d80 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 --2- 172.21.15.67:0/4251914779 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f1c0b41c0 0x7f3f1c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4251914779 >> 172.21.15.67:0/4251914779 conn(0x7f3f1c08bfc0 msgr2=0x7f3f1c06ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4251914779 shutdown_connections 2024-09-19T05:46:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.253+0000 7f3f23c6d640 1 -- 172.21.15.67:0/4251914779 wait complete. 2024-09-19T05:46:41.269 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:46:41.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:46:41.269 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:46:41.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[82261]: fuse finished with error 0 and tester_r 0 2024-09-19T05:46:41.280 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:46:41.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:46:41.280 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:46:41.363 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:46:41.363 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:46:41.364 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:46:41.370 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:46:41.370 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:46:41.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:46:41.370 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:46:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:46:41.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:46:41.417 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:46:41.418 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:46:41.418 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:46:41.423 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:46:41.423 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:46:41.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:46:41.423 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:46:41.475 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:46:41.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:46:41.476 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:46:41.477 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:46:41.477 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:46:41.483 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:46:41.483 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:46:41.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:46:41.483 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:46:41.530 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:46:41.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:46:41.532 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4085b3a640 1 Processor -- start 2024-09-19T05:46:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4085b3a640 1 -- start start 2024-09-19T05:46:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4085b3a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f408015c030 0x7f408006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4085b3a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f408015d1d0 0x7f40800b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4085b3a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 0x7f408006f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4085b3a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f408006e3c0 con 0x7f408015d1d0 2024-09-19T05:46:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4085b3a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f408006e6a0 con 0x7f408015c030 2024-09-19T05:46:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4085b3a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f408006e980 con 0x7f40800b3510 2024-09-19T05:46:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4077fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f408015d1d0 0x7f40800b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4077fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f408015d1d0 0x7f40800b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40028/0 (socket says 172.21.15.67:40028) 2024-09-19T05:46:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4077fff640 1 -- 172.21.15.67:0/3971331427 learned_addr learned my addr 172.21.15.67:0/3971331427 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f407ffff640 1 --2- 172.21.15.67:0/3971331427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 0x7f408006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4077fff640 1 -- 172.21.15.67:0/3971331427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 msgr2=0x7f408006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f407f7fe640 1 --2- 172.21.15.67:0/3971331427 >> v2:172.21.15.97:3300/0 conn(0x7f408015c030 0x7f408006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4077fff640 1 --2- 172.21.15.67:0/3971331427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 0x7f408006f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4077fff640 1 -- 172.21.15.67:0/3971331427 >> v2:172.21.15.97:3300/0 conn(0x7f408015c030 msgr2=0x7f408006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4077fff640 1 --2- 172.21.15.67:0/3971331427 >> v2:172.21.15.97:3300/0 conn(0x7f408015c030 0x7f408006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f4077fff640 1 -- 172.21.15.67:0/3971331427 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408006ec60 con 0x7f408015d1d0 2024-09-19T05:46:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.661+0000 7f407f7fe640 1 --2- 172.21.15.67:0/3971331427 >> v2:172.21.15.97:3300/0 conn(0x7f408015c030 0x7f408006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4077fff640 1 --2- 172.21.15.67:0/3971331427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015d1d0 0x7f40800b2fd0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f4080070390 tx=0x7f406801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bddadb71e2ac8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f407effd640 1 -- 172.21.15.67:0/3971331427 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40680b1070 con 0x7f408015d1d0 2024-09-19T05:46:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f407effd640 1 -- 172.21.15.67:0/3971331427 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40680ac620 con 0x7f408015d1d0 2024-09-19T05:46:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f407effd640 1 -- 172.21.15.67:0/3971331427 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40680ac9f0 con 0x7f408015d1d0 2024-09-19T05:46:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 -- 172.21.15.67:0/3971331427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015d1d0 msgr2=0x7f40800b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 --2- 172.21.15.67:0/3971331427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015d1d0 0x7f40800b2fd0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f4080070390 tx=0x7f406801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 -- 172.21.15.67:0/3971331427 shutdown_connections 2024-09-19T05:46:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 --2- 172.21.15.67:0/3971331427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 0x7f408006f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 --2- 172.21.15.67:0/3971331427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015d1d0 0x7f40800b2fd0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 --2- 172.21.15.67:0/3971331427 >> v2:172.21.15.97:3300/0 conn(0x7f408015c030 0x7f408006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 -- 172.21.15.67:0/3971331427 >> 172.21.15.67:0/3971331427 conn(0x7f40800d0080 msgr2=0x7f40800d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:41.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 -- 172.21.15.67:0/3971331427 shutdown_connections 2024-09-19T05:46:41.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 -- 172.21.15.67:0/3971331427 wait complete. 2024-09-19T05:46:41.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 Processor -- start 2024-09-19T05:46:41.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 -- start start 2024-09-19T05:46:41.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 0x7f40800b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015c030 0x7f408015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f408015d1d0 0x7f408013c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f408015fd40 con 0x7f408015c030 2024-09-19T05:46:41.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f408015c620 con 0x7f408015d1d0 2024-09-19T05:46:41.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4085b3a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f408015fec0 con 0x7f40800b3510 2024-09-19T05:46:41.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4077fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015c030 0x7f408015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4077fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015c030 0x7f408015b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40040/0 (socket says 172.21.15.67:40040) 2024-09-19T05:46:41.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4077fff640 1 -- 172.21.15.67:0/1615286650 learned_addr learned my addr 172.21.15.67:0/1615286650 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f407f7fe640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 0x7f40800b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f407ffff640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f408015d1d0 0x7f408013c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4077fff640 1 -- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 msgr2=0x7f40800b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4077fff640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 0x7f40800b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4077fff640 1 -- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f408015d1d0 msgr2=0x7f408013c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4077fff640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f408015d1d0 0x7f408013c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4077fff640 1 -- 172.21.15.67:0/1615286650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4080159c80 con 0x7f408015c030 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f407f7fe640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 0x7f40800b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.665+0000 7f4077fff640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015c030 0x7f408015b120 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f406801aba0 tx=0x7f4068019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f407cff9640 1 -- 172.21.15.67:0/1615286650 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40680b1040 con 0x7f408015c030 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f4085b3a640 1 -- 172.21.15.67:0/1615286650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4080151920 con 0x7f408015c030 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f407cff9640 1 -- 172.21.15.67:0/1615286650 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40680ba070 con 0x7f408015c030 2024-09-19T05:46:41.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f407cff9640 1 -- 172.21.15.67:0/1615286650 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40680b58a0 con 0x7f408015c030 2024-09-19T05:46:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f4085b3a640 1 -- 172.21.15.67:0/1615286650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4080159630 con 0x7f408015c030 2024-09-19T05:46:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f4085b3a640 1 -- 172.21.15.67:0/1615286650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f408006dde0 con 0x7f408015c030 2024-09-19T05:46:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f407cff9640 1 -- 172.21.15.67:0/1615286650 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40680ac4e0 con 0x7f408015c030 2024-09-19T05:46:41.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f407cff9640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40600678c0 0x7f4060069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f407cff9640 1 -- 172.21.15.67:0/1615286650 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7f406811fcc0 con 0x7f408015c030 2024-09-19T05:46:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f407f7fe640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40600678c0 0x7f4060069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.669+0000 7f407f7fe640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40600678c0 0x7f4060069d80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4070006fd0 tx=0x7f4070008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:41.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.673+0000 7f407cff9640 1 -- 172.21.15.67:0/1615286650 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4068016110 con 0x7f408015c030 2024-09-19T05:46:41.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.873+0000 7f4085b3a640 1 -- 172.21.15.67:0/1615286650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40800d0f20 con 0x7f408015c030 2024-09-19T05:46:41.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.873+0000 7f407cff9640 1 -- 172.21.15.67:0/1615286650 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+4410 (secure 0 0 0) 0x7f40680f0630 con 0x7f408015c030 2024-09-19T05:46:41.876 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:41.876 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":119,"btime":"2024-09-19T05:46:38:222590+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:46:38.222582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":169,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9576":{"gid":9576,"name":"c","rank":0,"incarnation":116,"state":"up:active","state_seq":17,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9576,"qdb_cluster":[9576]},"id":11}]} 2024-09-19T05:46:41.877 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 119 2024-09-19T05:46:41.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 -- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40600678c0 msgr2=0x7f4060069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40600678c0 0x7f4060069d80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4070006fd0 tx=0x7f4070008040 comp rx=0 tx=0).stop 2024-09-19T05:46:41.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 -- 172.21.15.67:0/1615286650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015c030 msgr2=0x7f408015b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:41.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015c030 0x7f408015b120 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f406801aba0 tx=0x7f4068019290 comp rx=0 tx=0).stop 2024-09-19T05:46:41.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 -- 172.21.15.67:0/1615286650 shutdown_connections 2024-09-19T05:46:41.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f408015d1d0 0x7f408013c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f408015c030 0x7f408015b120 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f40600678c0 0x7f4060069d80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 --2- 172.21.15.67:0/1615286650 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40800b3510 0x7f40800b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:41.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 -- 172.21.15.67:0/1615286650 >> 172.21.15.67:0/1615286650 conn(0x7f40800d0080 msgr2=0x7f40800b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:41.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 -- 172.21.15.67:0/1615286650 shutdown_connections 2024-09-19T05:46:41.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:41.877+0000 7f4085b3a640 1 -- 172.21.15.67:0/1615286650 wait complete. 2024-09-19T05:46:41.894 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:42.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fc12bc640 1 Processor -- start 2024-09-19T05:46:42.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fc12bc640 1 -- start start 2024-09-19T05:46:42.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fc12bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fbc15d4d0 0x7f3fbc0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fc12bc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fbc15c740 0x7f3fbc15cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fc12bc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc068160 con 0x7f3fbc15c360 2024-09-19T05:46:42.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fc12bc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3fbc06f680 con 0x7f3fbc15c740 2024-09-19T05:46:42.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fc12bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3fbc067ba0 con 0x7f3fbc15d4d0 2024-09-19T05:46:42.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fbb7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fbc15c740 0x7f3fbc15cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fbb7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fbc15c740 0x7f3fbc15cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40056/0 (socket says 172.21.15.67:40056) 2024-09-19T05:46:42.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fbb7fe640 1 -- 172.21.15.67:0/974423078 learned_addr learned my addr 172.21.15.67:0/974423078 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:42.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fba7fc640 1 --2- 172.21.15.67:0/974423078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fbc15d4d0 0x7f3fbc0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fbb7fe640 1 -- 172.21.15.67:0/974423078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fbc15d4d0 msgr2=0x7f3fbc0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:42.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fbb7fe640 1 --2- 172.21.15.67:0/974423078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fbc15d4d0 0x7f3fbc0b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fbb7fe640 1 -- 172.21.15.67:0/974423078 >> v1:172.21.15.97:6789/0 conn(0x7f3fbc15c360 legacy=0x7f3fbc06fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.021+0000 7f3fbb7fe640 1 -- 172.21.15.67:0/974423078 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc067e80 con 0x7f3fbc15c740 2024-09-19T05:46:42.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fbb7fe640 1 --2- 172.21.15.67:0/974423078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c740 0x7f3fbc15cb90 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009e50 tx=0x7f3fac01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89104d907669b568 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:42.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fb9ffb640 1 -- 172.21.15.67:0/974423078 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0a57c0 con 0x7f3fbc15c740 2024-09-19T05:46:42.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fb9ffb640 1 -- 172.21.15.67:0/974423078 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fac0a5960 con 0x7f3fbc15c740 2024-09-19T05:46:42.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fb9ffb640 1 -- 172.21.15.67:0/974423078 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0a5d30 con 0x7f3fbc15c740 2024-09-19T05:46:42.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fc12bc640 1 -- 172.21.15.67:0/974423078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c740 msgr2=0x7f3fbc15cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fc12bc640 1 --2- 172.21.15.67:0/974423078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c740 0x7f3fbc15cb90 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009e50 tx=0x7f3fac01c8e0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fc12bc640 1 -- 172.21.15.67:0/974423078 shutdown_connections 2024-09-19T05:46:42.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fc12bc640 1 --2- 172.21.15.67:0/974423078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c740 0x7f3fbc15cb90 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fc12bc640 1 --2- 172.21.15.67:0/974423078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fbc15d4d0 0x7f3fbc0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fc12bc640 1 -- 172.21.15.67:0/974423078 >> 172.21.15.67:0/974423078 conn(0x7f3fbc073500 msgr2=0x7f3fbc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:42.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fc12bc640 1 -- 172.21.15.67:0/974423078 shutdown_connections 2024-09-19T05:46:42.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fc12bc640 1 -- 172.21.15.67:0/974423078 wait complete. 2024-09-19T05:46:42.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fc12bc640 1 Processor -- start 2024-09-19T05:46:42.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.025+0000 7f3fc12bc640 1 -- start start 2024-09-19T05:46:42.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fc12bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c360 0x7f3fbc1f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fc12bc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fbc15c740 0x7f3fbc0b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fc12bc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fbc15d4d0 0x7f3fbc14c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fc12bc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc0cdf40 con 0x7f3fbc15c360 2024-09-19T05:46:42.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fc12bc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc0cddc0 con 0x7f3fbc15d4d0 2024-09-19T05:46:42.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fc12bc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3fbc0ce0c0 con 0x7f3fbc15c740 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbaffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c360 0x7f3fbc1f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbaffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c360 0x7f3fbc1f73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40058/0 (socket says 172.21.15.67:40058) 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbaffd640 1 -- 172.21.15.67:0/489607983 learned_addr learned my addr 172.21.15.67:0/489607983 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbb7fe640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fbc15d4d0 0x7f3fbc14c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fba7fc640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fbc15c740 0x7f3fbc0b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbaffd640 1 -- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fbc15c740 msgr2=0x7f3fbc0b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbaffd640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fbc15c740 0x7f3fbc0b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbaffd640 1 -- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fbc15d4d0 msgr2=0x7f3fbc14c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbaffd640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fbc15d4d0 0x7f3fbc14c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbaffd640 1 -- 172.21.15.67:0/489607983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc0b4810 con 0x7f3fbc15c360 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbb7fe640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fbc15d4d0 0x7f3fbc14c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fbaffd640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c360 0x7f3fbc1f73b0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c3c0 tx=0x7f3fb400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:42.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fb37fe640 1 -- 172.21.15.67:0/489607983 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4017070 con 0x7f3fbc15c360 2024-09-19T05:46:42.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fb37fe640 1 -- 172.21.15.67:0/489607983 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb40052d0 con 0x7f3fbc15c360 2024-09-19T05:46:42.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fb37fe640 1 -- 172.21.15.67:0/489607983 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4003840 con 0x7f3fbc15c360 2024-09-19T05:46:42.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fc12bc640 1 -- 172.21.15.67:0/489607983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fbc0b4af0 con 0x7f3fbc15c360 2024-09-19T05:46:42.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fc12bc640 1 -- 172.21.15.67:0/489607983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fbc1f78f0 con 0x7f3fbc15c360 2024-09-19T05:46:42.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fc12bc640 1 -- 172.21.15.67:0/489607983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fbc150040 con 0x7f3fbc15c360 2024-09-19T05:46:42.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fb37fe640 1 -- 172.21.15.67:0/489607983 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3fb401a070 con 0x7f3fbc15c360 2024-09-19T05:46:42.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.029+0000 7f3fb37fe640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f9c0678c0 0x7f3f9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.033+0000 7f3fb37fe640 1 -- 172.21.15.67:0/489607983 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7f3fb4085190 con 0x7f3fbc15c360 2024-09-19T05:46:42.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.033+0000 7f3fba7fc640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f9c0678c0 0x7f3f9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.033+0000 7f3fba7fc640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f9c0678c0 0x7f3f9c069d80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc06a360 tx=0x7f3fa4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:42.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.037+0000 7f3fb37fe640 1 -- 172.21.15.67:0/489607983 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3fb4005480 con 0x7f3fbc15c360 2024-09-19T05:46:42.153 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:46:42.153+0000 7f4dd7edd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:46:42.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.233+0000 7f3fc12bc640 1 -- 172.21.15.67:0/489607983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fbc15cb90 con 0x7f3fbc15c360 2024-09-19T05:46:42.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fb37fe640 1 -- 172.21.15.67:0/489607983 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+4410 (secure 0 0 0) 0x7f3fb4055af0 con 0x7f3fbc15c360 2024-09-19T05:46:42.236 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:42.236 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":119,"btime":"2024-09-19T05:46:38:222590+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:46:38.222582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":169,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9576":{"gid":9576,"name":"c","rank":0,"incarnation":116,"state":"up:active","state_seq":17,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9576,"qdb_cluster":[9576]},"id":11}]} 2024-09-19T05:46:42.236 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 119 2024-09-19T05:46:42.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 -- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f9c0678c0 msgr2=0x7f3f9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f9c0678c0 0x7f3f9c069d80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc06a360 tx=0x7f3fa4008040 comp rx=0 tx=0).stop 2024-09-19T05:46:42.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 -- 172.21.15.67:0/489607983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c360 msgr2=0x7f3fbc1f73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c360 0x7f3fbc1f73b0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c3c0 tx=0x7f3fb400c880 comp rx=0 tx=0).stop 2024-09-19T05:46:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 -- 172.21.15.67:0/489607983 shutdown_connections 2024-09-19T05:46:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3fbc15d4d0 0x7f3fbc14c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3f9c0678c0 0x7f3f9c069d80 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3fbc15c740 0x7f3fbc0b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 --2- 172.21.15.67:0/489607983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc15c360 0x7f3fbc1f73b0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 -- 172.21.15.67:0/489607983 >> 172.21.15.67:0/489607983 conn(0x7f3fbc073500 msgr2=0x7f3fbc06fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 -- 172.21.15.67:0/489607983 shutdown_connections 2024-09-19T05:46:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.237+0000 7f3fc12bc640 1 -- 172.21.15.67:0/489607983 wait complete. 2024-09-19T05:46:42.257 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:46:42.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f057c235640 1 Processor -- start 2024-09-19T05:46:42.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f057c235640 1 -- start start 2024-09-19T05:46:42.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f057c235640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f057415e610 0x7f0574162a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f057c235640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f05740cf070 0x7f057415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f057c235640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057415ef30 0x7f05740d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f057c235640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f05740d0120 con 0x7f057415e610 2024-09-19T05:46:42.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f057c235640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0574162fb0 con 0x7f05740cf070 2024-09-19T05:46:42.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f057c235640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f05740cf510 con 0x7f057415ef30 2024-09-19T05:46:42.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f0579fd1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f057415e610 0x7f0574162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f0579fd1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f057415e610 0x7f0574162a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40060/0 (socket says 172.21.15.67:40060) 2024-09-19T05:46:42.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f0579fd1640 1 -- 172.21.15.67:0/3664868137 learned_addr learned my addr 172.21.15.67:0/3664868137 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:42.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f05797d0640 1 --2- 172.21.15.67:0/3664868137 >> v2:172.21.15.97:3300/0 conn(0x7f05740cf070 0x7f057415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f057a7d2640 1 --2- 172.21.15.67:0/3664868137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057415ef30 0x7f05740d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f0579fd1640 1 -- 172.21.15.67:0/3664868137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057415ef30 msgr2=0x7f05740d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:42.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f0579fd1640 1 --2- 172.21.15.67:0/3664868137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057415ef30 0x7f05740d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f0579fd1640 1 -- 172.21.15.67:0/3664868137 >> v2:172.21.15.97:3300/0 conn(0x7f05740cf070 msgr2=0x7f057415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:42.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f0579fd1640 1 --2- 172.21.15.67:0/3664868137 >> v2:172.21.15.97:3300/0 conn(0x7f05740cf070 0x7f057415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.377+0000 7f0579fd1640 1 -- 172.21.15.67:0/3664868137 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05740cf7f0 con 0x7f057415e610 2024-09-19T05:46:42.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f0579fd1640 1 --2- 172.21.15.67:0/3664868137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415e610 0x7f0574162a70 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f05740d0860 tx=0x7f057001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1deb404207e2b96b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:42.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f0578fcf640 1 -- 172.21.15.67:0/3664868137 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05700b0070 con 0x7f057415e610 2024-09-19T05:46:42.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f0578fcf640 1 -- 172.21.15.67:0/3664868137 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05700ab600 con 0x7f057415e610 2024-09-19T05:46:42.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f0578fcf640 1 -- 172.21.15.67:0/3664868137 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05700ab9d0 con 0x7f057415e610 2024-09-19T05:46:42.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f057c235640 1 -- 172.21.15.67:0/3664868137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415e610 msgr2=0x7f0574162a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f057c235640 1 --2- 172.21.15.67:0/3664868137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415e610 0x7f0574162a70 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f05740d0860 tx=0x7f057001c230 comp rx=0 tx=0).stop 2024-09-19T05:46:42.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f057c235640 1 -- 172.21.15.67:0/3664868137 shutdown_connections 2024-09-19T05:46:42.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f057c235640 1 --2- 172.21.15.67:0/3664868137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057415ef30 0x7f05740d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f057c235640 1 --2- 172.21.15.67:0/3664868137 >> v2:172.21.15.97:3300/0 conn(0x7f05740cf070 0x7f057415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f057c235640 1 --2- 172.21.15.67:0/3664868137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415e610 0x7f0574162a70 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f057c235640 1 -- 172.21.15.67:0/3664868137 >> 172.21.15.67:0/3664868137 conn(0x7f057408bfc0 msgr2=0x7f05740d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:42.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f057c235640 1 -- 172.21.15.67:0/3664868137 shutdown_connections 2024-09-19T05:46:42.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.381+0000 7f057c235640 1 -- 172.21.15.67:0/3664868137 wait complete. 2024-09-19T05:46:42.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057c235640 1 Processor -- start 2024-09-19T05:46:42.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057c235640 1 -- start start 2024-09-19T05:46:42.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057c235640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05740cf070 0x7f05741504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057c235640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057415e610 0x7f0574150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057c235640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415ef30 0x7f0574150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057c235640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f05740d2070 con 0x7f057415ef30 2024-09-19T05:46:42.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057c235640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f057415f340 con 0x7f05740cf070 2024-09-19T05:46:42.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057c235640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f05740d21f0 con 0x7f057415e610 2024-09-19T05:46:42.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057a7d2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415ef30 0x7f0574150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057a7d2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415ef30 0x7f0574150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40074/0 (socket says 172.21.15.67:40074) 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057a7d2640 1 -- 172.21.15.67:0/940114408 learned_addr learned my addr 172.21.15.67:0/940114408 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f0579fd1640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05740cf070 0x7f05741504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f05797d0640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057415e610 0x7f0574150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057a7d2640 1 -- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057415e610 msgr2=0x7f0574150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057a7d2640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057415e610 0x7f0574150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057a7d2640 1 -- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05740cf070 msgr2=0x7f05741504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057a7d2640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05740cf070 0x7f05741504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057a7d2640 1 -- 172.21.15.67:0/940114408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05741627c0 con 0x7f057415ef30 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057a7d2640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415ef30 0x7f0574150f80 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f056c007cf0 tx=0x7f056c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f056a7fc640 1 -- 172.21.15.67:0/940114408 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c014420 con 0x7f057415ef30 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f056a7fc640 1 -- 172.21.15.67:0/940114408 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f056c019070 con 0x7f057415ef30 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f056a7fc640 1 -- 172.21.15.67:0/940114408 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c014820 con 0x7f057415ef30 2024-09-19T05:46:42.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057c235640 1 -- 172.21.15.67:0/940114408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0574151d00 con 0x7f057415ef30 2024-09-19T05:46:42.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.385+0000 7f057c235640 1 -- 172.21.15.67:0/940114408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0574159910 con 0x7f057415ef30 2024-09-19T05:46:42.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.389+0000 7f057c235640 1 -- 172.21.15.67:0/940114408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0574162a70 con 0x7f057415ef30 2024-09-19T05:46:42.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.389+0000 7f056a7fc640 1 -- 172.21.15.67:0/940114408 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f056c0149c0 con 0x7f057415ef30 2024-09-19T05:46:42.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.389+0000 7f056a7fc640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05580678c0 0x7f0558069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.389+0000 7f056a7fc640 1 -- 172.21.15.67:0/940114408 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7f056c086600 con 0x7f057415ef30 2024-09-19T05:46:42.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.389+0000 7f0579fd1640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05580678c0 0x7f0558069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.389+0000 7f0579fd1640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05580678c0 0x7f0558069d80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f05700ad000 tx=0x7f05700a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:42.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.393+0000 7f056a7fc640 1 -- 172.21.15.67:0/940114408 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f056c056ec0 con 0x7f057415ef30 2024-09-19T05:46:42.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.557+0000 7f057c235640 1 -- 172.21.15.67:0/940114408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05740cec70 con 0x7f057415ef30 2024-09-19T05:46:42.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f056a7fc640 1 -- 172.21.15.67:0/940114408 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) ==== 74+0+17037 (secure 0 0 0) 0x7f056c0567c0 con 0x7f057415ef30 2024-09-19T05:46:42.560 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:42.561 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":169,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:46:35.207783+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:45:42.191879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-19T05:45:43.532181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/1716781558":"2024-09-20T05:46:35.207652+0000","172.21.15.67:6834/1716781558":"2024-09-20T05:46:35.207652+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 -- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05580678c0 msgr2=0x7f0558069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05580678c0 0x7f0558069d80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f05700ad000 tx=0x7f05700a6000 comp rx=0 tx=0).stop 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 -- 172.21.15.67:0/940114408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415ef30 msgr2=0x7f0574150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415ef30 0x7f0574150f80 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f056c007cf0 tx=0x7f056c00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 -- 172.21.15.67:0/940114408 shutdown_connections 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057415ef30 0x7f0574150f80 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05580678c0 0x7f0558069d80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057415e610 0x7f0574150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 --2- 172.21.15.67:0/940114408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05740cf070 0x7f05741504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 -- 172.21.15.67:0/940114408 >> 172.21.15.67:0/940114408 conn(0x7f057408bfc0 msgr2=0x7f057406e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:42.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 -- 172.21.15.67:0/940114408 shutdown_connections 2024-09-19T05:46:42.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.561+0000 7f057c235640 1 -- 172.21.15.67:0/940114408 wait complete. 2024-09-19T05:46:42.580 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:46:42.581 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:42.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e45c4640 1 Processor -- start 2024-09-19T05:46:42.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e45c4640 1 -- start start 2024-09-19T05:46:42.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e45c4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3dc15c030 0x7fa3dc06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e45c4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3dc15d1d0 0x7fa3dc0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e45c4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3dc06e3c0 con 0x7fa3dc0b3510 2024-09-19T05:46:42.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e45c4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa3dc06e6a0 con 0x7fa3dc15c030 2024-09-19T05:46:42.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e45c4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa3dc06e980 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e2360640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3dc15c030 0x7fa3dc06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e1b5f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3dc15d1d0 0x7fa3dc0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e2b61640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa3dc0b3510 0x7fa3dc06f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:54770/0 (socket says 172.21.15.67:54770) 2024-09-19T05:46:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.705+0000 7fa3e2b61640 1 -- 172.21.15.67:0/382060740 learned_addr learned my addr 172.21.15.67:0/382060740 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.709+0000 7fa3e2360640 1 -- 172.21.15.67:0/382060740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3dc15d1d0 msgr2=0x7fa3dc0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.709+0000 7fa3e2360640 1 --2- 172.21.15.67:0/382060740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3dc15d1d0 0x7fa3dc0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.709+0000 7fa3e2360640 1 -- 172.21.15.67:0/382060740 >> v1:172.21.15.97:6789/0 conn(0x7fa3dc0b3510 legacy=0x7fa3dc06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.709+0000 7fa3e2360640 1 -- 172.21.15.67:0/382060740 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc06ec60 con 0x7fa3dc15c030 2024-09-19T05:46:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.709+0000 7fa3e135e640 1 -- 172.21.15.67:0/382060740 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772524922 0 0) 0x7fa3dc06e3c0 con 0x7fa3dc0b3510 2024-09-19T05:46:42.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.709+0000 7fa3e2360640 1 --2- 172.21.15.67:0/382060740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3dc15c030 0x7fa3dc06dde0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80097c0 tx=0x7fa3d801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cae91aa9f020219 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:42.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.709+0000 7fa3e135e640 1 -- 172.21.15.67:0/382060740 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80ab600 con 0x7fa3dc15c030 2024-09-19T05:46:42.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.709+0000 7fa3e135e640 1 -- 172.21.15.67:0/382060740 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d80b0070 con 0x7fa3dc15c030 2024-09-19T05:46:42.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.709+0000 7fa3e135e640 1 -- 172.21.15.67:0/382060740 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80ab9c0 con 0x7fa3dc15c030 2024-09-19T05:46:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- 172.21.15.67:0/382060740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3dc15c030 msgr2=0x7fa3dc06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 --2- 172.21.15.67:0/382060740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3dc15c030 0x7fa3dc06dde0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80097c0 tx=0x7fa3d801c3e0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- 172.21.15.67:0/382060740 shutdown_connections 2024-09-19T05:46:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 --2- 172.21.15.67:0/382060740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3dc15d1d0 0x7fa3dc0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 --2- 172.21.15.67:0/382060740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3dc15c030 0x7fa3dc06dde0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- 172.21.15.67:0/382060740 >> 172.21.15.67:0/382060740 conn(0x7fa3dc0d0080 msgr2=0x7fa3dc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- 172.21.15.67:0/382060740 shutdown_connections 2024-09-19T05:46:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- 172.21.15.67:0/382060740 wait complete. 2024-09-19T05:46:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 Processor -- start 2024-09-19T05:46:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- start start 2024-09-19T05:46:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3dc0b3510 0x7fa3dc150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3dc15c030 0x7fa3dc14c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3dc15d1d0 0x7fa3dc1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc15c410 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc15c590 con 0x7fa3dc15c030 2024-09-19T05:46:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa3dc1690e0 con 0x7fa3dc0b3510 2024-09-19T05:46:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e2b61640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3dc15d1d0 0x7fa3dc1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e2b61640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3dc15d1d0 0x7fa3dc1493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40078/0 (socket says 172.21.15.67:40078) 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e2b61640 1 -- 172.21.15.67:0/2077257300 learned_addr learned my addr 172.21.15.67:0/2077257300 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e2360640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3dc0b3510 0x7fa3dc150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e1b5f640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3dc15c030 0x7fa3dc14c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e2b61640 1 -- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3dc0b3510 msgr2=0x7fa3dc150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e2b61640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3dc0b3510 0x7fa3dc150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e2b61640 1 -- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3dc15c030 msgr2=0x7fa3dc14c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e2b61640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3dc15c030 0x7fa3dc14c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e2b61640 1 -- 172.21.15.67:0/2077257300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc0720d0 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e2b61640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3dc15d1d0 0x7fa3dc1493a0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c7a0 tx=0x7fa3d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3d2ffd640 1 -- 172.21.15.67:0/2077257300 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4018070 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3d2ffd640 1 -- 172.21.15.67:0/2077257300 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d400a640 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3d2ffd640 1 -- 172.21.15.67:0/2077257300 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d400aab0 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- 172.21.15.67:0/2077257300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3dc0723b0 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.713+0000 7fa3e45c4640 1 -- 172.21.15.67:0/2077257300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3dc14ed10 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.717+0000 7fa3e45c4640 1 -- 172.21.15.67:0/2077257300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3dc06dde0 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.717+0000 7fa3d2ffd640 1 -- 172.21.15.67:0/2077257300 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3d401b070 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.717+0000 7fa3d2ffd640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3c00678c0 0x7fa3c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.717+0000 7fa3d2ffd640 1 -- 172.21.15.67:0/2077257300 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7fa3d4085440 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.717+0000 7fa3e2360640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3c00678c0 0x7fa3c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.717+0000 7fa3e2360640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3c00678c0 0x7fa3c0069d80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80af000 tx=0x7fa3d80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.721+0000 7fa3d2ffd640 1 -- 172.21.15.67:0/2077257300 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa3d4055750 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.921+0000 7fa3e45c4640 1 -- 172.21.15.67:0/2077257300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3dc0d0f20 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.921+0000 7fa3d2ffd640 1 -- 172.21.15.67:0/2077257300 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+4410 (secure 0 0 0) 0x7fa3d4059a50 con 0x7fa3dc15d1d0 2024-09-19T05:46:42.922 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:42.922 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":119,"btime":"2024-09-19T05:46:38:222590+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:46:38.222582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":169,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9576":{"gid":9576,"name":"c","rank":0,"incarnation":116,"state":"up:active","state_seq":17,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9576,"qdb_cluster":[9576]},"id":11}]} 2024-09-19T05:46:42.922 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 119 2024-09-19T05:46:42.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 -- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3c00678c0 msgr2=0x7fa3c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3c00678c0 0x7fa3c0069d80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80af000 tx=0x7fa3d80a7000 comp rx=0 tx=0).stop 2024-09-19T05:46:42.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 -- 172.21.15.67:0/2077257300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3dc15d1d0 msgr2=0x7fa3dc1493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:42.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3dc15d1d0 0x7fa3dc1493a0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c7a0 tx=0x7fa3d400cc60 comp rx=0 tx=0).stop 2024-09-19T05:46:42.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 -- 172.21.15.67:0/2077257300 shutdown_connections 2024-09-19T05:46:42.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3dc15d1d0 0x7fa3dc1493a0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3dc15c030 0x7fa3dc14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3c00678c0 0x7fa3c0069d80 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 --2- 172.21.15.67:0/2077257300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3dc0b3510 0x7fa3dc150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:42.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 -- 172.21.15.67:0/2077257300 >> 172.21.15.67:0/2077257300 conn(0x7fa3dc0d0080 msgr2=0x7fa3dc14b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:42.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 -- 172.21.15.67:0/2077257300 shutdown_connections 2024-09-19T05:46:42.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:42.925+0000 7fa3e45c4640 1 -- 172.21.15.67:0/2077257300 wait complete. 2024-09-19T05:46:42.942 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:43.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.061+0000 7fb1d4858640 1 Processor -- start 2024-09-19T05:46:43.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.061+0000 7fb1d4858640 1 -- start start 2024-09-19T05:46:43.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1d4858640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb1d0070140 0x7fb1d015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1d4858640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1d00ccee0 0x7fb1d0070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1d4858640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d0161ee0 0x7fb1d0162370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1d4858640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb1d00cd350 con 0x7fb1d0070140 2024-09-19T05:46:43.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1d4858640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb1d0070a60 con 0x7fb1d00ccee0 2024-09-19T05:46:43.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1d4858640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d006e790 con 0x7fb1d0161ee0 2024-09-19T05:46:43.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1ce59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb1d0070140 0x7fb1d015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1ce59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb1d0070140 0x7fb1d015f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40080/0 (socket says 172.21.15.67:40080) 2024-09-19T05:46:43.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1ce59c640 1 -- 172.21.15.67:0/2593035149 learned_addr learned my addr 172.21.15.67:0/2593035149 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:43.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1ced9d640 1 --2- 172.21.15.67:0/2593035149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d0161ee0 0x7fb1d0162370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1cdd9b640 1 --2- 172.21.15.67:0/2593035149 >> v2:172.21.15.97:3300/0 conn(0x7fb1d00ccee0 0x7fb1d0070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1ce59c640 1 -- 172.21.15.67:0/2593035149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d0161ee0 msgr2=0x7fb1d0162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:43.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1ce59c640 1 --2- 172.21.15.67:0/2593035149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d0161ee0 0x7fb1d0162370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1ce59c640 1 -- 172.21.15.67:0/2593035149 >> v2:172.21.15.97:3300/0 conn(0x7fb1d00ccee0 msgr2=0x7fb1d0070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:43.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1ce59c640 1 --2- 172.21.15.67:0/2593035149 >> v2:172.21.15.97:3300/0 conn(0x7fb1d00ccee0 0x7fb1d0070520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1ce59c640 1 -- 172.21.15.67:0/2593035149 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d006ea50 con 0x7fb1d0070140 2024-09-19T05:46:43.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1ce59c640 1 --2- 172.21.15.67:0/2593035149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d0070140 0x7fb1d015f370 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009870 tx=0x7fb1b801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2967bdc20e425f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:43.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1cd59a640 1 -- 172.21.15.67:0/2593035149 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80ab620 con 0x7fb1d0070140 2024-09-19T05:46:43.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1cd59a640 1 -- 172.21.15.67:0/2593035149 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b80b0070 con 0x7fb1d0070140 2024-09-19T05:46:43.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.065+0000 7fb1cd59a640 1 -- 172.21.15.67:0/2593035149 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80ab9e0 con 0x7fb1d0070140 2024-09-19T05:46:43.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- 172.21.15.67:0/2593035149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d0070140 msgr2=0x7fb1d015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 --2- 172.21.15.67:0/2593035149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d0070140 0x7fb1d015f370 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009870 tx=0x7fb1b801c460 comp rx=0 tx=0).stop 2024-09-19T05:46:43.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- 172.21.15.67:0/2593035149 shutdown_connections 2024-09-19T05:46:43.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 --2- 172.21.15.67:0/2593035149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d0161ee0 0x7fb1d0162370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 --2- 172.21.15.67:0/2593035149 >> v2:172.21.15.97:3300/0 conn(0x7fb1d00ccee0 0x7fb1d0070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 --2- 172.21.15.67:0/2593035149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d0070140 0x7fb1d015f370 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- 172.21.15.67:0/2593035149 >> 172.21.15.67:0/2593035149 conn(0x7fb1d0073500 msgr2=0x7fb1d006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- 172.21.15.67:0/2593035149 shutdown_connections 2024-09-19T05:46:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- 172.21.15.67:0/2593035149 wait complete. 2024-09-19T05:46:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 Processor -- start 2024-09-19T05:46:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- start start 2024-09-19T05:46:43.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d0070140 0x7fb1d0157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d00ccee0 0x7fb1d014b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d0161ee0 0x7fb1d015e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d006f810 con 0x7fb1d00ccee0 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d006f2f0 con 0x7fb1d0070140 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d015c160 con 0x7fb1d0161ee0 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1cdd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d00ccee0 0x7fb1d014b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1cdd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d00ccee0 0x7fb1d014b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40088/0 (socket says 172.21.15.67:40088) 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1cdd9b640 1 -- 172.21.15.67:0/1909351688 learned_addr learned my addr 172.21.15.67:0/1909351688 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1ced9d640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d0161ee0 0x7fb1d015e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1ce59c640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d0070140 0x7fb1d0157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1cdd9b640 1 -- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d0161ee0 msgr2=0x7fb1d015e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1cdd9b640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d0161ee0 0x7fb1d015e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1cdd9b640 1 -- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d0070140 msgr2=0x7fb1d0157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1cdd9b640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d0070140 0x7fb1d0157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1cdd9b640 1 -- 172.21.15.67:0/1909351688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d0157660 con 0x7fb1d00ccee0 2024-09-19T05:46:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1cdd9b640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d00ccee0 0x7fb1d014b050 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0007e40 tx=0x7fb1c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:43.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1c6ffd640 1 -- 172.21.15.67:0/1909351688 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0014620 con 0x7fb1d00ccee0 2024-09-19T05:46:43.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1c6ffd640 1 -- 172.21.15.67:0/1909351688 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c0019070 con 0x7fb1d00ccee0 2024-09-19T05:46:43.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- 172.21.15.67:0/1909351688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d0157930 con 0x7fb1d00ccee0 2024-09-19T05:46:43.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1c6ffd640 1 -- 172.21.15.67:0/1909351688 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0014a00 con 0x7fb1d00ccee0 2024-09-19T05:46:43.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.069+0000 7fb1d4858640 1 -- 172.21.15.67:0/1909351688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d0157ef0 con 0x7fb1d00ccee0 2024-09-19T05:46:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.073+0000 7fb1d4858640 1 -- 172.21.15.67:0/1909351688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d015f370 con 0x7fb1d00ccee0 2024-09-19T05:46:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.073+0000 7fb1c6ffd640 1 -- 172.21.15.67:0/1909351688 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1c0014ba0 con 0x7fb1d00ccee0 2024-09-19T05:46:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.073+0000 7fb1c6ffd640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1b00678f0 0x7fb1b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.073+0000 7fb1c6ffd640 1 -- 172.21.15.67:0/1909351688 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7fb1c0086730 con 0x7fb1d00ccee0 2024-09-19T05:46:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.073+0000 7fb1ce59c640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1b00678f0 0x7fb1b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.073+0000 7fb1ce59c640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1b00678f0 0x7fb1b0069db0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80af000 tx=0x7fb1b80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.077+0000 7fb1c6ffd640 1 -- 172.21.15.67:0/1909351688 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb1c0057090 con 0x7fb1d00ccee0 2024-09-19T05:46:43.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.277+0000 7fb1d4858640 1 -- 172.21.15.67:0/1909351688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1d00b5ac0 con 0x7fb1d00ccee0 2024-09-19T05:46:43.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.277+0000 7fb1c6ffd640 1 -- 172.21.15.67:0/1909351688 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+4410 (secure 0 0 0) 0x7fb1c0056990 con 0x7fb1d00ccee0 2024-09-19T05:46:43.278 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:43.278 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":119,"btime":"2024-09-19T05:46:38:222590+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:45:44.552824+0000","modified":"2024-09-19T05:46:38.222582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":169,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9576":{"gid":9576,"name":"c","rank":0,"incarnation":116,"state":"up:active","state_seq":17,"addr":"172.21.15.67:6833/1911026487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1911026487},{"type":"v1","addr":"172.21.15.67:6833","nonce":1911026487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9576,"qdb_cluster":[9576]},"id":11}]} 2024-09-19T05:46:43.278 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 119 2024-09-19T05:46:43.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 -- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1b00678f0 msgr2=0x7fb1b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1b00678f0 0x7fb1b0069db0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80af000 tx=0x7fb1b80a7000 comp rx=0 tx=0).stop 2024-09-19T05:46:43.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 -- 172.21.15.67:0/1909351688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d00ccee0 msgr2=0x7fb1d014b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d00ccee0 0x7fb1d014b050 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0007e40 tx=0x7fb1c000e4b0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 -- 172.21.15.67:0/1909351688 shutdown_connections 2024-09-19T05:46:43.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1b00678f0 0x7fb1b0069db0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d0161ee0 0x7fb1d015e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d00ccee0 0x7fb1d014b050 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 --2- 172.21.15.67:0/1909351688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d0070140 0x7fb1d0157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 -- 172.21.15.67:0/1909351688 >> 172.21.15.67:0/1909351688 conn(0x7fb1d0073500 msgr2=0x7fb1d00745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:43.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 -- 172.21.15.67:0/1909351688 shutdown_connections 2024-09-19T05:46:43.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.281+0000 7fb1d4858640 1 -- 172.21.15.67:0/1909351688 wait complete. 2024-09-19T05:46:43.298 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:46:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.429+0000 7f1a4a7d7640 1 Processor -- start 2024-09-19T05:46:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.429+0000 7f1a4a7d7640 1 -- start start 2024-09-19T05:46:43.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a440d1590 0x7f1a440d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1a440b51d0 0x7f1a440cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a440d4d40 con 0x7f1a44161da0 2024-09-19T05:46:43.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1a440d0840 con 0x7f1a440b51d0 2024-09-19T05:46:43.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1a440d5020 con 0x7f1a440d1590 2024-09-19T05:46:43.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a43fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1a44161da0 0x7f1a440d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58924/0 (socket says 172.21.15.67:58924) 2024-09-19T05:46:43.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a43fff640 1 -- 172.21.15.67:0/2648257245 learned_addr learned my addr 172.21.15.67:0/2648257245 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:43.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a48d74640 1 --2- 172.21.15.67:0/2648257245 >> v2:172.21.15.67:3300/0 conn(0x7f1a440b51d0 0x7f1a440cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a437fe640 1 --2- 172.21.15.67:0/2648257245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a440d1590 0x7f1a440d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a42ffd640 1 -- 172.21.15.67:0/2648257245 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124769404 0 0) 0x7f1a440d4d40 con 0x7f1a44161da0 2024-09-19T05:46:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a42ffd640 1 -- 172.21.15.67:0/2648257245 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a2c003530 con 0x7f1a44161da0 2024-09-19T05:46:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a48d74640 1 -- 172.21.15.67:0/2648257245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a440d1590 msgr2=0x7f1a440d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a48d74640 1 --2- 172.21.15.67:0/2648257245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a440d1590 0x7f1a440d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a48d74640 1 -- 172.21.15.67:0/2648257245 >> v1:172.21.15.67:6789/0 conn(0x7f1a44161da0 legacy=0x7f1a440d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a48d74640 1 -- 172.21.15.67:0/2648257245 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a440d5300 con 0x7f1a440b51d0 2024-09-19T05:46:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a48d74640 1 --2- 172.21.15.67:0/2648257245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 0x7f1a440cf150 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009d90 tx=0x7f1a3c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf397a87b05d100 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a42ffd640 1 -- 172.21.15.67:0/2648257245 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0b2070 con 0x7f1a440b51d0 2024-09-19T05:46:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a42ffd640 1 -- 172.21.15.67:0/2648257245 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0a5800 con 0x7f1a440b51d0 2024-09-19T05:46:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a42ffd640 1 -- 172.21.15.67:0/2648257245 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0a5bd0 con 0x7f1a440b51d0 2024-09-19T05:46:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/2648257245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 msgr2=0x7f1a440cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 --2- 172.21.15.67:0/2648257245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 0x7f1a440cf150 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009d90 tx=0x7f1a3c01c970 comp rx=0 tx=0).stop 2024-09-19T05:46:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/2648257245 shutdown_connections 2024-09-19T05:46:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 --2- 172.21.15.67:0/2648257245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 0x7f1a440cf150 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 --2- 172.21.15.67:0/2648257245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a440d1590 0x7f1a440d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/2648257245 >> 172.21.15.67:0/2648257245 conn(0x7f1a4408bfc0 msgr2=0x7f1a440d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/2648257245 shutdown_connections 2024-09-19T05:46:43.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.433+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/2648257245 wait complete. 2024-09-19T05:46:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 Processor -- start 2024-09-19T05:46:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 -- start start 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 0x7f1a440c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a440d1590 0x7f1a440b94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a44161da0 0x7f1a440b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1a440d0020 con 0x7f1a440b51d0 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1a440cfea0 con 0x7f1a440d1590 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1a440d01a0 con 0x7f1a44161da0 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 0x7f1a440c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 0x7f1a440c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40098/0 (socket says 172.21.15.67:40098) 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a43fff640 1 -- 172.21.15.67:0/3332674512 learned_addr learned my addr 172.21.15.67:0/3332674512 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a437fe640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a440d1590 0x7f1a440b94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a48d74640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a44161da0 0x7f1a440b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a43fff640 1 -- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a44161da0 msgr2=0x7f1a440b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a43fff640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a44161da0 0x7f1a440b9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a43fff640 1 -- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a440d1590 msgr2=0x7f1a440b94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a43fff640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a440d1590 0x7f1a440b94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a43fff640 1 -- 172.21.15.67:0/3332674512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a440cb020 con 0x7f1a440b51d0 2024-09-19T05:46:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a43fff640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 0x7f1a440c7fc0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c3c0 tx=0x7f1a3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a40ff9640 1 -- 172.21.15.67:0/3332674512 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34017070 con 0x7f1a440b51d0 2024-09-19T05:46:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a40ff9640 1 -- 172.21.15.67:0/3332674512 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a34005cf0 con 0x7f1a440b51d0 2024-09-19T05:46:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/3332674512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a440b8140 con 0x7f1a440b51d0 2024-09-19T05:46:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a40ff9640 1 -- 172.21.15.67:0/3332674512 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a340072f0 con 0x7f1a440b51d0 2024-09-19T05:46:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/3332674512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a440b89e0 con 0x7f1a440b51d0 2024-09-19T05:46:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.437+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/3332674512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a440cf150 con 0x7f1a440b51d0 2024-09-19T05:46:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.441+0000 7f1a40ff9640 1 -- 172.21.15.67:0/3332674512 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1a3401a070 con 0x7f1a440b51d0 2024-09-19T05:46:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.441+0000 7f1a40ff9640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a300678c0 0x7f1a30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.441+0000 7f1a40ff9640 1 -- 172.21.15.67:0/3332674512 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7f1a340852a0 con 0x7f1a440b51d0 2024-09-19T05:46:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.441+0000 7f1a437fe640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a300678c0 0x7f1a30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.441+0000 7f1a437fe640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a300678c0 0x7f1a30069d80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009af0 tx=0x7f1a38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.445+0000 7f1a40ff9640 1 -- 172.21.15.67:0/3332674512 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1a34055bf0 con 0x7f1a440b51d0 2024-09-19T05:46:43.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.609+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/3332674512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a440b38e0 con 0x7f1a440b51d0 2024-09-19T05:46:43.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.609+0000 7f1a40ff9640 1 -- 172.21.15.67:0/3332674512 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) ==== 74+0+17037 (secure 0 0 0) 0x7f1a340554f0 con 0x7f1a440b51d0 2024-09-19T05:46:43.611 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:43.611 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":169,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:46:35.207783+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:45:42.191879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-19T05:45:43.532181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/1716781558":"2024-09-20T05:46:35.207652+0000","172.21.15.67:6834/1716781558":"2024-09-20T05:46:35.207652+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a300678c0 msgr2=0x7f1a30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a300678c0 0x7f1a30069d80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009af0 tx=0x7f1a38008040 comp rx=0 tx=0).stop 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/3332674512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 msgr2=0x7f1a440c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 0x7f1a440c7fc0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c3c0 tx=0x7f1a3400c880 comp rx=0 tx=0).stop 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/3332674512 shutdown_connections 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1a300678c0 0x7f1a30069d80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a44161da0 0x7f1a440b9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a440d1590 0x7f1a440b94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 --2- 172.21.15.67:0/3332674512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a440b51d0 0x7f1a440c7fc0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/3332674512 >> 172.21.15.67:0/3332674512 conn(0x7f1a4408bfc0 msgr2=0x7f1a440b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:43.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/3332674512 shutdown_connections 2024-09-19T05:46:43.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.613+0000 7f1a4a7d7640 1 -- 172.21.15.67:0/3332674512 wait complete. 2024-09-19T05:46:43.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:46:43.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc274c48640 1 Processor -- start 2024-09-19T05:46:43.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc274c48640 1 -- start start 2024-09-19T05:46:43.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc274c48640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 0x7fc2700d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc274c48640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc2700d0160 0x7fc2700d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc274c48640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2700d4d40 con 0x7fc2700d0e80 2024-09-19T05:46:43.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc274c48640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc2700d0610 con 0x7fc2700d0160 2024-09-19T05:46:43.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc274c48640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc2700d0840 con 0x7fc270161da0 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26ed9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc2700d0160 0x7fc2700d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26e59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 0x7fc2700d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26dd9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc2700d0e80 0x7fc2700b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:54784/0 (socket says 172.21.15.67:54784) 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26dd9b640 1 -- 172.21.15.67:0/1688944174 learned_addr learned my addr 172.21.15.67:0/1688944174 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26d59a640 1 -- 172.21.15.67:0/1688944174 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848163007 0 0) 0x7fc2700d4d40 con 0x7fc2700d0e80 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26d59a640 1 -- 172.21.15.67:0/1688944174 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc258003530 con 0x7fc2700d0e80 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26ed9d640 1 -- 172.21.15.67:0/1688944174 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 msgr2=0x7fc2700d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26ed9d640 1 --2- 172.21.15.67:0/1688944174 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 0x7fc2700d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26ed9d640 1 -- 172.21.15.67:0/1688944174 >> v1:172.21.15.97:6789/0 conn(0x7fc2700d0e80 legacy=0x7fc2700b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26ed9d640 1 -- 172.21.15.67:0/1688944174 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2700d5020 con 0x7fc2700d0160 2024-09-19T05:46:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.757+0000 7fc26e59c640 1 --2- 172.21.15.67:0/1688944174 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 0x7fc2700d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:46:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc26ed9d640 1 --2- 172.21.15.67:0/1688944174 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2700d0160 0x7fc2700d12c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc268009d90 tx=0x7fc26801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc6cd500a878ea5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc26d59a640 1 -- 172.21.15.67:0/1688944174 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2680b2070 con 0x7fc2700d0160 2024-09-19T05:46:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc26d59a640 1 -- 172.21.15.67:0/1688944174 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2680a5830 con 0x7fc2700d0160 2024-09-19T05:46:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc26d59a640 1 -- 172.21.15.67:0/1688944174 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2680a5be0 con 0x7fc2700d0160 2024-09-19T05:46:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc274c48640 1 -- 172.21.15.67:0/1688944174 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2700d0160 msgr2=0x7fc2700d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc274c48640 1 --2- 172.21.15.67:0/1688944174 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2700d0160 0x7fc2700d12c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc268009d90 tx=0x7fc26801c970 comp rx=0 tx=0).stop 2024-09-19T05:46:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc274c48640 1 -- 172.21.15.67:0/1688944174 shutdown_connections 2024-09-19T05:46:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc274c48640 1 --2- 172.21.15.67:0/1688944174 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2700d0160 0x7fc2700d12c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc274c48640 1 --2- 172.21.15.67:0/1688944174 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 0x7fc2700d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc274c48640 1 -- 172.21.15.67:0/1688944174 >> 172.21.15.67:0/1688944174 conn(0x7fc27008bfc0 msgr2=0x7fc2700d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc274c48640 1 -- 172.21.15.67:0/1688944174 shutdown_connections 2024-09-19T05:46:43.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.761+0000 7fc274c48640 1 -- 172.21.15.67:0/1688944174 wait complete. 2024-09-19T05:46:43.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 Processor -- start 2024-09-19T05:46:43.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 -- start start 2024-09-19T05:46:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2700d0160 0x7fc27014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2700d0e80 0x7fc27015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 0x7fc27006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc2700b50e0 con 0x7fc2700d0e80 2024-09-19T05:46:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc270162180 con 0x7fc2700d0160 2024-09-19T05:46:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc2700b5260 con 0x7fc270161da0 2024-09-19T05:46:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2700d0e80 0x7fc27015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2700d0e80 0x7fc27015a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40108/0 (socket says 172.21.15.67:40108) 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26dd9b640 1 -- 172.21.15.67:0/3282975544 learned_addr learned my addr 172.21.15.67:0/3282975544 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26e59c640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2700d0160 0x7fc27014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26ed9d640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 0x7fc27006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26dd9b640 1 -- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 msgr2=0x7fc27006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26dd9b640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 0x7fc27006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26dd9b640 1 -- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2700d0160 msgr2=0x7fc27014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26dd9b640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2700d0160 0x7fc27014e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26dd9b640 1 -- 172.21.15.67:0/3282975544 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27014f760 con 0x7fc2700d0e80 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26e59c640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2700d0160 0x7fc27014e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc26dd9b640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2700d0e80 0x7fc27015a460 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fc26400c420 tx=0x7fc26400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc25effd640 1 -- 172.21.15.67:0/3282975544 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264017070 con 0x7fc2700d0e80 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc25effd640 1 -- 172.21.15.67:0/3282975544 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc264005d10 con 0x7fc2700d0e80 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 -- 172.21.15.67:0/3282975544 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27014ee00 con 0x7fc2700d0e80 2024-09-19T05:46:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc25effd640 1 -- 172.21.15.67:0/3282975544 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264007310 con 0x7fc2700d0e80 2024-09-19T05:46:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 -- 172.21.15.67:0/3282975544 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27014eb20 con 0x7fc2700d0e80 2024-09-19T05:46:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc274c48640 1 -- 172.21.15.67:0/3282975544 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2700d12c0 con 0x7fc2700d0e80 2024-09-19T05:46:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.765+0000 7fc25effd640 1 -- 172.21.15.67:0/3282975544 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc26401a070 con 0x7fc2700d0e80 2024-09-19T05:46:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.769+0000 7fc25effd640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2500678c0 0x7fc250069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.769+0000 7fc25effd640 1 -- 172.21.15.67:0/3282975544 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 6187+0+0 (secure 0 0 0) 0x7fc264085ac0 con 0x7fc2700d0e80 2024-09-19T05:46:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.769+0000 7fc26e59c640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2500678c0 0x7fc250069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.769+0000 7fc26e59c640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2500678c0 0x7fc250069d80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc260009b10 tx=0x7fc260008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:43.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.773+0000 7fc25effd640 1 -- 172.21.15.67:0/3282975544 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc27014f760 con 0x7fc2700d0e80 2024-09-19T05:46:43.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.969+0000 7fc274c48640 1 -- 172.21.15.67:0/3282975544 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc27015c4d0 con 0x7fc2700d0e80 2024-09-19T05:46:43.967 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:46:43.969+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:46:43.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.969+0000 7fc25effd640 1 -- 172.21.15.67:0/3282975544 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v120) ==== 161+0+0 (secure 0 0 0) 0x7fc264055c90 con 0x7fc2700d0e80 2024-09-19T05:46:43.970 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:46:43.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 -- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2500678c0 msgr2=0x7fc250069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2500678c0 0x7fc250069d80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc260009b10 tx=0x7fc260008040 comp rx=0 tx=0).stop 2024-09-19T05:46:43.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 -- 172.21.15.67:0/3282975544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2700d0e80 msgr2=0x7fc27015a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:43.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2700d0e80 0x7fc27015a460 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fc26400c420 tx=0x7fc26400c8e0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 -- 172.21.15.67:0/3282975544 shutdown_connections 2024-09-19T05:46:43.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2500678c0 0x7fc250069d80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc270161da0 0x7fc27006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2700d0e80 0x7fc27015a460 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 --2- 172.21.15.67:0/3282975544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2700d0160 0x7fc27014e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:43.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 -- 172.21.15.67:0/3282975544 >> 172.21.15.67:0/3282975544 conn(0x7fc27008bfc0 msgr2=0x7fc2701603b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:43.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 -- 172.21.15.67:0/3282975544 shutdown_connections 2024-09-19T05:46:43.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:43.973+0000 7fc274c48640 1 -- 172.21.15.67:0/3282975544 wait complete. 2024-09-19T05:46:43.991 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:46:43.993 INFO:tasks.ceph.mds.c.smithi067.stderr: -67> 2024-09-19T05:46:42.153+0000 7f4dd7edd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:46:44.025 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:46:44.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.101+0000 7f1d0723d640 1 Processor -- start 2024-09-19T05:46:44.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d0723d640 1 -- start start 2024-09-19T05:46:44.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d0723d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d00159c60 0x7f1d000ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d0723d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d000af3a0 0x7f1d0015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d0723d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d0015a040 con 0x7f1d0006ffd0 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d0723d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1d0015d460 con 0x7f1d00159c60 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d0723d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1d0015c850 con 0x7f1d000af3a0 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d04fd9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d00159c60 0x7f1d000ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d04fd9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d00159c60 0x7f1d000ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40144/0 (socket says 172.21.15.67:40144) 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d04fd9640 1 -- 172.21.15.67:0/3068432372 learned_addr learned my addr 172.21.15.67:0/3068432372 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d057da640 1 --2- 172.21.15.67:0/3068432372 >> v2:172.21.15.97:3300/0 conn(0x7f1d000af3a0 0x7f1d0015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d04fd9640 1 -- 172.21.15.67:0/3068432372 >> v2:172.21.15.97:3300/0 conn(0x7f1d000af3a0 msgr2=0x7f1d0015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d04fd9640 1 --2- 172.21.15.67:0/3068432372 >> v2:172.21.15.97:3300/0 conn(0x7f1d000af3a0 0x7f1d0015fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d04fd9640 1 -- 172.21.15.67:0/3068432372 >> v1:172.21.15.97:6789/0 conn(0x7f1d0006ffd0 legacy=0x7f1d000aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:44.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d04fd9640 1 -- 172.21.15.67:0/3068432372 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0015cb30 con 0x7f1d00159c60 2024-09-19T05:46:44.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1d04fd9640 1 --2- 172.21.15.67:0/3068432372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d00159c60 0x7f1d000ad130 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f1d00071950 tx=0x7f1cf401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d10d739252643 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:44.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1cff7fe640 1 -- 172.21.15.67:0/3068432372 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40aa650 con 0x7f1d00159c60 2024-09-19T05:46:44.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1cff7fe640 1 -- 172.21.15.67:0/3068432372 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf40af070 con 0x7f1d00159c60 2024-09-19T05:46:44.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.105+0000 7f1cff7fe640 1 -- 172.21.15.67:0/3068432372 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40aaa10 con 0x7f1d00159c60 2024-09-19T05:46:44.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- 172.21.15.67:0/3068432372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d00159c60 msgr2=0x7f1d000ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:44.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 --2- 172.21.15.67:0/3068432372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d00159c60 0x7f1d000ad130 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f1d00071950 tx=0x7f1cf401c4f0 comp rx=0 tx=0).stop 2024-09-19T05:46:44.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- 172.21.15.67:0/3068432372 shutdown_connections 2024-09-19T05:46:44.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 --2- 172.21.15.67:0/3068432372 >> v2:172.21.15.97:3300/0 conn(0x7f1d000af3a0 0x7f1d0015fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:44.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 --2- 172.21.15.67:0/3068432372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d00159c60 0x7f1d000ad130 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:44.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- 172.21.15.67:0/3068432372 >> 172.21.15.67:0/3068432372 conn(0x7f1d000b1e50 msgr2=0x7f1d000b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:44.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- 172.21.15.67:0/3068432372 shutdown_connections 2024-09-19T05:46:44.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- 172.21.15.67:0/3068432372 wait complete. 2024-09-19T05:46:44.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 Processor -- start 2024-09-19T05:46:44.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- start start 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d0006ffd0 0x7f1d00150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d000af3a0 0x7f1d0014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d00159c60 0x7f1d0015e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1d00168e30 con 0x7f1d0006ffd0 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1d00168fb0 con 0x7f1d00159c60 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1d00169130 con 0x7f1d000af3a0 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d04fd9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d0006ffd0 0x7f1d00150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d04fd9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d0006ffd0 0x7f1d00150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40150/0 (socket says 172.21.15.67:40150) 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d04fd9640 1 -- 172.21.15.67:0/3842906533 learned_addr learned my addr 172.21.15.67:0/3842906533 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1cfffff640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d000af3a0 0x7f1d0014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d057da640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d00159c60 0x7f1d0015e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d04fd9640 1 -- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d000af3a0 msgr2=0x7f1d0014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:44.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d04fd9640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d000af3a0 0x7f1d0014f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:44.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d04fd9640 1 -- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d00159c60 msgr2=0x7f1d0015e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:44.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d04fd9640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d00159c60 0x7f1d0015e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:44.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d04fd9640 1 -- 172.21.15.67:0/3842906533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d001533d0 con 0x7f1d0006ffd0 2024-09-19T05:46:44.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d057da640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d00159c60 0x7f1d0015e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:44.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d04fd9640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d0006ffd0 0x7f1d00150a00 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4019100 tx=0x7f1cf401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:44.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1cfd7fa640 1 -- 172.21.15.67:0/3842906533 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40bd5f0 con 0x7f1d0006ffd0 2024-09-19T05:46:44.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1cfd7fa640 1 -- 172.21.15.67:0/3842906533 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf40a6040 con 0x7f1d0006ffd0 2024-09-19T05:46:44.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- 172.21.15.67:0/3842906533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d001536b0 con 0x7f1d0006ffd0 2024-09-19T05:46:44.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1cfd7fa640 1 -- 172.21.15.67:0/3842906533 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40bd9d0 con 0x7f1d0006ffd0 2024-09-19T05:46:44.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.109+0000 7f1d0723d640 1 -- 172.21.15.67:0/3842906533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d00153f50 con 0x7f1d0006ffd0 2024-09-19T05:46:44.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.113+0000 7f1d0723d640 1 -- 172.21.15.67:0/3842906533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d00153aa0 con 0x7f1d0006ffd0 2024-09-19T05:46:44.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.113+0000 7f1cfd7fa640 1 -- 172.21.15.67:0/3842906533 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1cf40b33f0 con 0x7f1d0006ffd0 2024-09-19T05:46:44.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.113+0000 7f1cfd7fa640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ce40678f0 0x7f1ce4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:44.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.113+0000 7f1cfd7fa640 1 -- 172.21.15.67:0/3842906533 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 6273+0+0 (secure 0 0 0) 0x7f1cf41204e0 con 0x7f1d0006ffd0 2024-09-19T05:46:44.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.113+0000 7f1cfffff640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ce40678f0 0x7f1ce4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:44.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.113+0000 7f1cfffff640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ce40678f0 0x7f1ce4069db0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1d000b1e20 tx=0x7f1cec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.117+0000 7f1cfd7fa640 1 -- 172.21.15.67:0/3842906533 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1cf40c3060 con 0x7f1d0006ffd0 2024-09-19T05:46:44.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.309+0000 7f1d0723d640 1 -- 172.21.15.67:0/3842906533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1d00153880 con 0x7f1d0006ffd0 2024-09-19T05:46:44.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.973+0000 7f1cfd7fa640 1 -- 172.21.15.67:0/3842906533 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v121) ==== 104+0+0 (secure 0 0 0) 0x7f1cf4016110 con 0x7f1d0006ffd0 2024-09-19T05:46:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 -- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ce40678f0 msgr2=0x7f1ce4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ce40678f0 0x7f1ce4069db0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1d000b1e20 tx=0x7f1cec009040 comp rx=0 tx=0).stop 2024-09-19T05:46:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 -- 172.21.15.67:0/3842906533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d0006ffd0 msgr2=0x7f1d00150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d0006ffd0 0x7f1d00150a00 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4019100 tx=0x7f1cf401ad30 comp rx=0 tx=0).stop 2024-09-19T05:46:44.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 -- 172.21.15.67:0/3842906533 shutdown_connections 2024-09-19T05:46:44.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d00159c60 0x7f1d0015e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:44.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ce40678f0 0x7f1ce4069db0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:44.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d000af3a0 0x7f1d0014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:44.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 --2- 172.21.15.67:0/3842906533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d0006ffd0 0x7f1d00150a00 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:44.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 -- 172.21.15.67:0/3842906533 >> 172.21.15.67:0/3842906533 conn(0x7f1d000b1e50 msgr2=0x7f1d00152700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:44.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 -- 172.21.15.67:0/3842906533 shutdown_connections 2024-09-19T05:46:44.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:44.977+0000 7f1d0723d640 1 -- 172.21.15.67:0/3842906533 wait complete. 2024-09-19T05:46:45.000 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:46:45.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.181+0000 7f978c74b640 1 Processor -- start 2024-09-19T05:46:45.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.181+0000 7f978c74b640 1 -- start start 2024-09-19T05:46:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978c74b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f978415d8d0 0x7f978415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978c74b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978415d030 con 0x7f97840cf5e0 2024-09-19T05:46:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978c74b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978415d310 con 0x7f97840d0aa0 2024-09-19T05:46:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978c74b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f978406de90 con 0x7f978415d8d0 2024-09-19T05:46:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978a4e7640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f97840cf5e0 0x7f978415c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58948/0 (socket says 172.21.15.67:58948) 2024-09-19T05:46:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978a4e7640 1 -- 172.21.15.67:0/2947920449 learned_addr learned my addr 172.21.15.67:0/2947920449 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:45.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978ace8640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f978415d8d0 0x7f978415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:45.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235768938 0 0) 0x7f978415d030 con 0x7f97840cf5e0 2024-09-19T05:46:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9770003530 con 0x7f97840cf5e0 2024-09-19T05:46:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 516874911 0 0) 0x7f9770003530 con 0x7f97840cf5e0 2024-09-19T05:46:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f978415d8d0 msgr2=0x7f978415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f978415d8d0 0x7f978415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 >> v1:172.21.15.97:6789/0 conn(0x7f97840d0aa0 legacy=0x7f978406e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978415d5f0 con 0x7f97840cf5e0 2024-09-19T05:46:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f97800016a0 con 0x7f97840cf5e0 2024-09-19T05:46:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 >> v1:172.21.15.67:6789/0 conn(0x7f97840cf5e0 legacy=0x7f978415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700039f0 0x7f9770003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9770004810 0x7f9770004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f978415d8d0 0x7f97700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f978406de90 con 0x7f97700039f0 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f977000bab0 con 0x7f9770004810 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f977000bcb0 con 0x7f978415d8d0 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978a4e7640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700039f0 0x7f9770003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f9789ce6640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9770004810 0x7f9770004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978ace8640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f978415d8d0 0x7f97700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978a4e7640 1 -- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f978415d8d0 msgr2=0x7f97700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978a4e7640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f978415d8d0 0x7f97700051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978a4e7640 1 -- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9770004810 msgr2=0x7f9770004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978a4e7640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9770004810 0x7f9770004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:45.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978a4e7640 1 -- 172.21.15.67:0/2947920449 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9770003530 con 0x7f97700039f0 2024-09-19T05:46:45.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f9789ce6640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9770004810 0x7f9770004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f978a4e7640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700039f0 0x7f9770003e10 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f978415a3b0 tx=0x7f978001cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350add5d646b8f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780007c50 con 0x7f97700039f0 2024-09-19T05:46:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97800a9020 con 0x7f97700039f0 2024-09-19T05:46:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.185+0000 7f97894e5640 1 -- 172.21.15.67:0/2947920449 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780005b00 con 0x7f97700039f0 2024-09-19T05:46:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- 172.21.15.67:0/2947920449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700039f0 msgr2=0x7f9770003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 --2- 172.21.15.67:0/2947920449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97700039f0 0x7f9770003e10 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f978415a3b0 tx=0x7f978001cb40 comp rx=0 tx=0).stop 2024-09-19T05:46:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978ace8640 1 -- 172.21.15.67:0/2947920449 reap_dead start 2024-09-19T05:46:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- 172.21.15.67:0/2947920449 shutdown_connections 2024-09-19T05:46:45.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- 172.21.15.67:0/2947920449 >> 172.21.15.67:0/2947920449 conn(0x7f978406c0c0 msgr2=0x7f978406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:45.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- 172.21.15.67:0/2947920449 shutdown_connections 2024-09-19T05:46:45.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- 172.21.15.67:0/2947920449 wait complete. 2024-09-19T05:46:45.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 Processor -- start 2024-09-19T05:46:45.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- start start 2024-09-19T05:46:45.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700039f0 0x7f9784099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:45.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9784152e60 0x7f9784151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:45.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97841515c0 0x7f9784146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:45.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9784167fb0 con 0x7f97841515c0 2024-09-19T05:46:45.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f978406e170 con 0x7f9784152e60 2024-09-19T05:46:45.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9784168130 con 0x7f97700039f0 2024-09-19T05:46:45.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978ace8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97841515c0 0x7f9784146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978ace8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97841515c0 0x7f9784146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40158/0 (socket says 172.21.15.67:40158) 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978ace8640 1 -- 172.21.15.67:0/2492716080 learned_addr learned my addr 172.21.15.67:0/2492716080 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f9789ce6640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9784152e60 0x7f9784151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978a4e7640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700039f0 0x7f9784099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978ace8640 1 -- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700039f0 msgr2=0x7f9784099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978ace8640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700039f0 0x7f9784099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978ace8640 1 -- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9784152e60 msgr2=0x7f9784151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978ace8640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9784152e60 0x7f9784151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978ace8640 1 -- 172.21.15.67:0/2492716080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978414b7e0 con 0x7f97841515c0 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978ace8640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97841515c0 0x7f9784146380 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f97840702d0 tx=0x7f977c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f977affd640 1 -- 172.21.15.67:0/2492716080 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c01c070 con 0x7f97841515c0 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f977affd640 1 -- 172.21.15.67:0/2492716080 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f977c017400 con 0x7f97841515c0 2024-09-19T05:46:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- 172.21.15.67:0/2492716080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9784099eb0 con 0x7f97841515c0 2024-09-19T05:46:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f977affd640 1 -- 172.21.15.67:0/2492716080 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c0177f0 con 0x7f97841515c0 2024-09-19T05:46:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.189+0000 7f978c74b640 1 -- 172.21.15.67:0/2492716080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9784147b50 con 0x7f97841515c0 2024-09-19T05:46:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.193+0000 7f978c74b640 1 -- 172.21.15.67:0/2492716080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978415c850 con 0x7f97841515c0 2024-09-19T05:46:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.193+0000 7f977affd640 1 -- 172.21.15.67:0/2492716080 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f977c01f070 con 0x7f97841515c0 2024-09-19T05:46:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.193+0000 7f977affd640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97680678f0 0x7f9768069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.193+0000 7f977affd640 1 -- 172.21.15.67:0/2492716080 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 6273+0+0 (secure 0 0 0) 0x7f977c0862f0 con 0x7f97841515c0 2024-09-19T05:46:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.193+0000 7f978a4e7640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97680678f0 0x7f9768069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.193+0000 7f978a4e7640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97680678f0 0x7f9768069db0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f97800aa000 tx=0x7f978406e0e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:45.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.197+0000 7f977affd640 1 -- 172.21.15.67:0/2492716080 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f977c012070 con 0x7f97841515c0 2024-09-19T05:46:45.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:45.365+0000 7f978c74b640 1 -- 172.21.15.67:0/2492716080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f97840d0710 con 0x7f97841515c0 2024-09-19T05:46:46.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.277+0000 7f977affd640 1 -- 172.21.15.67:0/2492716080 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v171) ==== 181+0+0 (secure 0 0 0) 0x7f977c056b50 con 0x7f97841515c0 2024-09-19T05:46:46.276 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:46:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 -- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97680678f0 msgr2=0x7f9768069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97680678f0 0x7f9768069db0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f97800aa000 tx=0x7f978406e0e0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 -- 172.21.15.67:0/2492716080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97841515c0 msgr2=0x7f9784146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97841515c0 0x7f9784146380 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f97840702d0 tx=0x7f977c00f4a0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 -- 172.21.15.67:0/2492716080 shutdown_connections 2024-09-19T05:46:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97841515c0 0x7f9784146380 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9784152e60 0x7f9784151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97680678f0 0x7f9768069db0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 --2- 172.21.15.67:0/2492716080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97700039f0 0x7f9784099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 -- 172.21.15.67:0/2492716080 >> 172.21.15.67:0/2492716080 conn(0x7f978406c0c0 msgr2=0x7f978415fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:46.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 -- 172.21.15.67:0/2492716080 shutdown_connections 2024-09-19T05:46:46.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.281+0000 7f978c74b640 1 -- 172.21.15.67:0/2492716080 wait complete. 2024-09-19T05:46:46.304 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:46:46.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.437+0000 7f6c57e41640 1 Processor -- start 2024-09-19T05:46:46.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.437+0000 7f6c57e41640 1 -- start start 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6c5015e6f0 0x7f6c500d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6c500cfe30 0x7f6c500d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5015ead0 con 0x7f6c500b5f70 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6c500ceb40 con 0x7f6c500cfe30 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6c500ced90 con 0x7f6c5015e6f0 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c553dc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6c500cfe30 0x7f6c500d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c563de640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6c500b5f70 0x7f6c501621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33062/0 (socket says 172.21.15.67:33062) 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c563de640 1 -- 172.21.15.67:0/841077361 learned_addr learned my addr 172.21.15.67:0/841077361 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c55bdd640 1 --2- 172.21.15.67:0/841077361 >> v2:172.21.15.97:3300/0 conn(0x7f6c5015e6f0 0x7f6c500d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c553dc640 1 -- 172.21.15.67:0/841077361 >> v2:172.21.15.97:3300/0 conn(0x7f6c5015e6f0 msgr2=0x7f6c500d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:46.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c553dc640 1 --2- 172.21.15.67:0/841077361 >> v2:172.21.15.97:3300/0 conn(0x7f6c5015e6f0 0x7f6c500d3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c553dc640 1 -- 172.21.15.67:0/841077361 >> v1:172.21.15.67:6789/0 conn(0x7f6c500b5f70 legacy=0x7f6c501621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:46.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c553dc640 1 -- 172.21.15.67:0/841077361 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c500cf070 con 0x7f6c500cfe30 2024-09-19T05:46:46.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c54bdb640 1 -- 172.21.15.67:0/841077361 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789112268 0 0) 0x7f6c5015ead0 con 0x7f6c500b5f70 2024-09-19T05:46:46.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c55bdd640 1 --2- 172.21.15.67:0/841077361 >> v2:172.21.15.97:3300/0 conn(0x7f6c5015e6f0 0x7f6c500d3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:46.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c553dc640 1 --2- 172.21.15.67:0/841077361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 0x7f6c500d35d0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f6c5008dd40 tx=0x7f6c4401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c22e04a7adf2c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:46.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c54bdb640 1 -- 172.21.15.67:0/841077361 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c440b0070 con 0x7f6c500cfe30 2024-09-19T05:46:46.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c54bdb640 1 -- 172.21.15.67:0/841077361 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c440ab600 con 0x7f6c500cfe30 2024-09-19T05:46:46.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c54bdb640 1 -- 172.21.15.67:0/841077361 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c440ab9d0 con 0x7f6c500cfe30 2024-09-19T05:46:46.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 -- 172.21.15.67:0/841077361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 msgr2=0x7f6c500d35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:46.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 --2- 172.21.15.67:0/841077361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 0x7f6c500d35d0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f6c5008dd40 tx=0x7f6c4401c360 comp rx=0 tx=0).stop 2024-09-19T05:46:46.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 -- 172.21.15.67:0/841077361 shutdown_connections 2024-09-19T05:46:46.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 --2- 172.21.15.67:0/841077361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 0x7f6c500d35d0 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 --2- 172.21.15.67:0/841077361 >> v2:172.21.15.97:3300/0 conn(0x7f6c5015e6f0 0x7f6c500d3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.441+0000 7f6c57e41640 1 -- 172.21.15.67:0/841077361 >> 172.21.15.67:0/841077361 conn(0x7f6c5008bfc0 msgr2=0x7f6c500d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:46.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 -- 172.21.15.67:0/841077361 shutdown_connections 2024-09-19T05:46:46.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 -- 172.21.15.67:0/841077361 wait complete. 2024-09-19T05:46:46.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 Processor -- start 2024-09-19T05:46:46.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 -- start start 2024-09-19T05:46:46.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c500b5f70 0x7f6c500cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:46.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 0x7f6c50153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:46.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c5015e6f0 0x7f6c50154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:46.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5016b500 con 0x7f6c500cfe30 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500b67d0 con 0x7f6c500b5f70 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5016b680 con 0x7f6c5015e6f0 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c553dc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 0x7f6c50153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c553dc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 0x7f6c50153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53092/0 (socket says 172.21.15.67:53092) 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c553dc640 1 -- 172.21.15.67:0/129098178 learned_addr learned my addr 172.21.15.67:0/129098178 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c553dc640 1 -- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c5015e6f0 msgr2=0x7f6c50154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c553dc640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c5015e6f0 0x7f6c50154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c553dc640 1 -- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c500b5f70 msgr2=0x7f6c500cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c55bdd640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c500b5f70 0x7f6c500cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c553dc640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c500b5f70 0x7f6c500cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c553dc640 1 -- 172.21.15.67:0/129098178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c50152520 con 0x7f6c500cfe30 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c553dc640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 0x7f6c50153ce0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f6c44019f90 tx=0x7f6c4401aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:46.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c4e7fc640 1 -- 172.21.15.67:0/129098178 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c440bb070 con 0x7f6c500cfe30 2024-09-19T05:46:46.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c4e7fc640 1 -- 172.21.15.67:0/129098178 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c44004020 con 0x7f6c500cfe30 2024-09-19T05:46:46.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 -- 172.21.15.67:0/129098178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c50154a40 con 0x7f6c500cfe30 2024-09-19T05:46:46.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c4e7fc640 1 -- 172.21.15.67:0/129098178 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c440b0040 con 0x7f6c500cfe30 2024-09-19T05:46:46.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 -- 172.21.15.67:0/129098178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c50152240 con 0x7f6c500cfe30 2024-09-19T05:46:46.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.445+0000 7f6c57e41640 1 -- 172.21.15.67:0/129098178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c501621c0 con 0x7f6c500cfe30 2024-09-19T05:46:46.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.449+0000 7f6c4e7fc640 1 -- 172.21.15.67:0/129098178 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c44003620 con 0x7f6c500cfe30 2024-09-19T05:46:46.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.449+0000 7f6c4e7fc640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c3c0678c0 0x7f6c3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:46.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.449+0000 7f6c4e7fc640 1 -- 172.21.15.67:0/129098178 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5835+0+0 (secure 0 0 0) 0x7f6c44120240 con 0x7f6c500cfe30 2024-09-19T05:46:46.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.449+0000 7f6c55bdd640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c3c0678c0 0x7f6c3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:46.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.449+0000 7f6c55bdd640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c3c0678c0 0x7f6c3c069d80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6c5015ac00 tx=0x7f6c48008450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:46.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.453+0000 7f6c4e7fc640 1 -- 172.21.15.67:0/129098178 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6c50152520 con 0x7f6c500cfe30 2024-09-19T05:46:46.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:46.621+0000 7f6c57e41640 1 -- 172.21.15.67:0/129098178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6c500b6e20 con 0x7f6c500cfe30 2024-09-19T05:46:47.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.277+0000 7f6c4e7fc640 1 -- 172.21.15.67:0/129098178 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v172) ==== 169+0+0 (secure 0 0 0) 0x7f6c44016070 con 0x7f6c500cfe30 2024-09-19T05:46:47.279 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:46:47.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.281+0000 7f6c57e41640 1 -- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c3c0678c0 msgr2=0x7f6c3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.281+0000 7f6c57e41640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c3c0678c0 0x7f6c3c069d80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6c5015ac00 tx=0x7f6c48008450 comp rx=0 tx=0).stop 2024-09-19T05:46:47.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.281+0000 7f6c57e41640 1 -- 172.21.15.67:0/129098178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 msgr2=0x7f6c50153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.281+0000 7f6c57e41640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 0x7f6c50153ce0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f6c44019f90 tx=0x7f6c4401aba0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.281+0000 7f6c57e41640 1 -- 172.21.15.67:0/129098178 shutdown_connections 2024-09-19T05:46:47.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.281+0000 7f6c57e41640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6c3c0678c0 0x7f6c3c069d80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.281+0000 7f6c57e41640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c5015e6f0 0x7f6c50154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.281+0000 7f6c57e41640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c500cfe30 0x7f6c50153ce0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.281+0000 7f6c57e41640 1 --2- 172.21.15.67:0/129098178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c500b5f70 0x7f6c500cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.281+0000 7f6c57e41640 1 -- 172.21.15.67:0/129098178 >> 172.21.15.67:0/129098178 conn(0x7f6c5008bfc0 msgr2=0x7f6c500b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:47.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.285+0000 7f6c57e41640 1 -- 172.21.15.67:0/129098178 shutdown_connections 2024-09-19T05:46:47.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.285+0000 7f6c57e41640 1 -- 172.21.15.67:0/129098178 wait complete. 2024-09-19T05:46:47.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:46:47.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.441+0000 7f1ec20fb640 1 Processor -- start 2024-09-19T05:46:47.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.441+0000 7f1ec20fb640 1 -- start start 2024-09-19T05:46:47.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ec20fb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ebc06ffd0 0x7f1ebc0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ec20fb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc0b3150 0x7f1ebc0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ec20fb640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ebc0ad840 con 0x7f1ebc159c60 2024-09-19T05:46:47.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ec20fb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1ebc0af710 con 0x7f1ebc06ffd0 2024-09-19T05:46:47.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ec20fb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ebc15d460 con 0x7f1ebc0b3150 2024-09-19T05:46:47.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ebaffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ebc06ffd0 0x7f1ebc0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ebaffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ebc06ffd0 0x7f1ebc0aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53096/0 (socket says 172.21.15.67:53096) 2024-09-19T05:46:47.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ebaffd640 1 -- 172.21.15.67:0/888446020 learned_addr learned my addr 172.21.15.67:0/888446020 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:47.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ebaffd640 1 -- 172.21.15.67:0/888446020 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc0b3150 msgr2=0x7f1ebc0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:47.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ebaffd640 1 --2- 172.21.15.67:0/888446020 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc0b3150 0x7f1ebc0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ebaffd640 1 -- 172.21.15.67:0/888446020 >> v1:172.21.15.67:6789/0 conn(0x7f1ebc159c60 legacy=0x7f1ebc0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ebaffd640 1 -- 172.21.15.67:0/888446020 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc15a040 con 0x7f1ebc06ffd0 2024-09-19T05:46:47.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1ebaffd640 1 --2- 172.21.15.67:0/888446020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc06ffd0 0x7f1ebc0aec90 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009e50 tx=0x7f1eac01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fe71ea4dd8fd1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:47.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1eba7fc640 1 -- 172.21.15.67:0/888446020 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0a58d0 con 0x7f1ebc06ffd0 2024-09-19T05:46:47.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1eba7fc640 1 -- 172.21.15.67:0/888446020 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eac0a5a70 con 0x7f1ebc06ffd0 2024-09-19T05:46:47.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.445+0000 7f1eba7fc640 1 -- 172.21.15.67:0/888446020 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0a5e40 con 0x7f1ebc06ffd0 2024-09-19T05:46:47.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- 172.21.15.67:0/888446020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc06ffd0 msgr2=0x7f1ebc0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 --2- 172.21.15.67:0/888446020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc06ffd0 0x7f1ebc0aec90 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009e50 tx=0x7f1eac01ca00 comp rx=0 tx=0).stop 2024-09-19T05:46:47.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- 172.21.15.67:0/888446020 shutdown_connections 2024-09-19T05:46:47.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 --2- 172.21.15.67:0/888446020 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc0b3150 0x7f1ebc0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 --2- 172.21.15.67:0/888446020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc06ffd0 0x7f1ebc0aec90 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- 172.21.15.67:0/888446020 >> 172.21.15.67:0/888446020 conn(0x7f1ebc0b1e50 msgr2=0x7f1ebc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:47.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- 172.21.15.67:0/888446020 shutdown_connections 2024-09-19T05:46:47.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- 172.21.15.67:0/888446020 wait complete. 2024-09-19T05:46:47.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 Processor -- start 2024-09-19T05:46:47.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- start start 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc06ffd0 0x7f1ebc15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc0b3150 0x7f1ebc1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc159c60 0x7f1ebc147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc1605b0 con 0x7f1ebc0b3150 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc15d0f0 con 0x7f1ebc159c60 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ebc160730 con 0x7f1ebc06ffd0 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebaffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc0b3150 0x7f1ebc1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebaffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc0b3150 0x7f1ebc1524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53112/0 (socket says 172.21.15.67:53112) 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebaffd640 1 -- 172.21.15.67:0/3519600529 learned_addr learned my addr 172.21.15.67:0/3519600529 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebb7fe640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc06ffd0 0x7f1ebc15ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebbfff640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc159c60 0x7f1ebc147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebaffd640 1 -- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc06ffd0 msgr2=0x7f1ebc15ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebaffd640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc06ffd0 0x7f1ebc15ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebaffd640 1 -- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc159c60 msgr2=0x7f1ebc147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebaffd640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc159c60 0x7f1ebc147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebaffd640 1 -- 172.21.15.67:0/3519600529 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc15b330 con 0x7f1ebc0b3150 2024-09-19T05:46:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebbfff640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc159c60 0x7f1ebc147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ebaffd640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc0b3150 0x7f1ebc1524f0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0af040 tx=0x7f1eac0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1eb3fff640 1 -- 172.21.15.67:0/3519600529 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0bc020 con 0x7f1ebc0b3150 2024-09-19T05:46:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1eb3fff640 1 -- 172.21.15.67:0/3519600529 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eac0b8470 con 0x7f1ebc0b3150 2024-09-19T05:46:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- 172.21.15.67:0/3519600529 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ebc15b610 con 0x7f1ebc0b3150 2024-09-19T05:46:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1eb3fff640 1 -- 172.21.15.67:0/3519600529 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac009510 con 0x7f1ebc0b3150 2024-09-19T05:46:47.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.449+0000 7f1ec20fb640 1 -- 172.21.15.67:0/3519600529 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ebc14d920 con 0x7f1ebc0b3150 2024-09-19T05:46:47.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.453+0000 7f1ec20fb640 1 -- 172.21.15.67:0/3519600529 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ebc160af0 con 0x7f1ebc0b3150 2024-09-19T05:46:47.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.453+0000 7f1eb3fff640 1 -- 172.21.15.67:0/3519600529 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1eac0bf020 con 0x7f1ebc0b3150 2024-09-19T05:46:47.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.453+0000 7f1eb3fff640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1e9c0678c0 0x7f1e9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.453+0000 7f1eb3fff640 1 -- 172.21.15.67:0/3519600529 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5421+0+0 (secure 0 0 0) 0x7f1eac1213b0 con 0x7f1ebc0b3150 2024-09-19T05:46:47.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.453+0000 7f1ebb7fe640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1e9c0678c0 0x7f1e9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.453+0000 7f1ebb7fe640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1e9c0678c0 0x7f1e9c069d80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40015b0 tx=0x7f1ea4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:47.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.457+0000 7f1eb3fff640 1 -- 172.21.15.67:0/3519600529 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1eac0c6030 con 0x7f1ebc0b3150 2024-09-19T05:46:47.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.621+0000 7f1ec20fb640 1 -- 172.21.15.67:0/3519600529 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f1ebc14daf0 con 0x7f1ebc0b3150 2024-09-19T05:46:47.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.625+0000 7f1eb3fff640 1 -- 172.21.15.67:0/3519600529 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7f1eac11fe20 con 0x7f1ebc0b3150 2024-09-19T05:46:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 -- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1e9c0678c0 msgr2=0x7f1e9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1e9c0678c0 0x7f1e9c069d80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40015b0 tx=0x7f1ea4009040 comp rx=0 tx=0).stop 2024-09-19T05:46:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 -- 172.21.15.67:0/3519600529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc0b3150 msgr2=0x7f1ebc1524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc0b3150 0x7f1ebc1524f0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0af040 tx=0x7f1eac0197a0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 -- 172.21.15.67:0/3519600529 shutdown_connections 2024-09-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ebc159c60 0x7f1ebc147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc0b3150 0x7f1ebc1524f0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1e9c0678c0 0x7f1e9c069d80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 --2- 172.21.15.67:0/3519600529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ebc06ffd0 0x7f1ebc15ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 -- 172.21.15.67:0/3519600529 >> 172.21.15.67:0/3519600529 conn(0x7f1ebc0b1e50 msgr2=0x7f1ebc152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 -- 172.21.15.67:0/3519600529 shutdown_connections 2024-09-19T05:46:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.629+0000 7f1ec20fb640 1 -- 172.21.15.67:0/3519600529 wait complete. 2024-09-19T05:46:47.647 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-19T05:46:47.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3793e8640 1 Processor -- start 2024-09-19T05:46:47.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3793e8640 1 -- start start 2024-09-19T05:46:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3793e8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb37406dde0 0x7fb3740b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3793e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3740b3510 0x7fb37406f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3793e8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37406e3c0 con 0x7fb37415c030 2024-09-19T05:46:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3793e8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb37406e6a0 con 0x7fb37406dde0 2024-09-19T05:46:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3793e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb37406e980 con 0x7fb3740b3510 2024-09-19T05:46:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3727fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb37406dde0 0x7fb3740b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3727fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb37406dde0 0x7fb3740b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53122/0 (socket says 172.21.15.67:53122) 2024-09-19T05:46:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3727fc640 1 -- 172.21.15.67:0/1551819204 learned_addr learned my addr 172.21.15.67:0/1551819204 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3737fe640 1 --2- 172.21.15.67:0/1551819204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3740b3510 0x7fb37406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3727fc640 1 -- 172.21.15.67:0/1551819204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3740b3510 msgr2=0x7fb37406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:47.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3727fc640 1 --2- 172.21.15.67:0/1551819204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3740b3510 0x7fb37406f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3727fc640 1 -- 172.21.15.67:0/1551819204 >> v1:172.21.15.97:6789/0 conn(0x7fb37415c030 legacy=0x7fb37415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.769+0000 7fb3727fc640 1 -- 172.21.15.67:0/1551819204 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37406ec60 con 0x7fb37406dde0 2024-09-19T05:46:47.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3727fc640 1 --2- 172.21.15.67:0/1551819204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37406dde0 0x7fb3740b2fd0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fb364009870 tx=0x7fb36401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa302c7358aeafa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:47.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb371ffb640 1 -- 172.21.15.67:0/1551819204 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3640ab640 con 0x7fb37406dde0 2024-09-19T05:46:47.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb371ffb640 1 -- 172.21.15.67:0/1551819204 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3640b0070 con 0x7fb37406dde0 2024-09-19T05:46:47.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb371ffb640 1 -- 172.21.15.67:0/1551819204 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3640aba00 con 0x7fb37406dde0 2024-09-19T05:46:47.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 -- 172.21.15.67:0/1551819204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37406dde0 msgr2=0x7fb3740b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 --2- 172.21.15.67:0/1551819204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37406dde0 0x7fb3740b2fd0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fb364009870 tx=0x7fb36401c530 comp rx=0 tx=0).stop 2024-09-19T05:46:47.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 -- 172.21.15.67:0/1551819204 shutdown_connections 2024-09-19T05:46:47.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 --2- 172.21.15.67:0/1551819204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3740b3510 0x7fb37406f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 --2- 172.21.15.67:0/1551819204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37406dde0 0x7fb3740b2fd0 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 -- 172.21.15.67:0/1551819204 >> 172.21.15.67:0/1551819204 conn(0x7fb3740d0080 msgr2=0x7fb3740d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:47.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 -- 172.21.15.67:0/1551819204 shutdown_connections 2024-09-19T05:46:47.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 -- 172.21.15.67:0/1551819204 wait complete. 2024-09-19T05:46:47.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 Processor -- start 2024-09-19T05:46:47.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 -- start start 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb37406dde0 0x7fb374099b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3740b3510 0x7fb374164a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37415c030 0x7fb374164f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb3741692f0 con 0x7fb37415c030 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb37415c620 con 0x7fb3740b3510 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3793e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb374169470 con 0x7fb37406dde0 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3737fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37415c030 0x7fb374164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3737fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37415c030 0x7fb374164f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53136/0 (socket says 172.21.15.67:53136) 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3737fe640 1 -- 172.21.15.67:0/1774706474 learned_addr learned my addr 172.21.15.67:0/1774706474 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3727fc640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3740b3510 0x7fb374164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb372ffd640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb37406dde0 0x7fb374099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3737fe640 1 -- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb37406dde0 msgr2=0x7fb374099b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3737fe640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb37406dde0 0x7fb374099b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3737fe640 1 -- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3740b3510 msgr2=0x7fb374164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3737fe640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3740b3510 0x7fb374164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3737fe640 1 -- 172.21.15.67:0/1774706474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3740cfb70 con 0x7fb37415c030 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.773+0000 7fb3727fc640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3740b3510 0x7fb374164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb3737fe640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37415c030 0x7fb374164f50 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fb36c007e70 tx=0x7fb36c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb35b7fe640 1 -- 172.21.15.67:0/1774706474 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c014620 con 0x7fb37415c030 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb35b7fe640 1 -- 172.21.15.67:0/1774706474 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c019070 con 0x7fb37415c030 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb35b7fe640 1 -- 172.21.15.67:0/1774706474 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c014a20 con 0x7fb37415c030 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb3793e8640 1 -- 172.21.15.67:0/1774706474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb374073e70 con 0x7fb37415c030 2024-09-19T05:46:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb3793e8640 1 -- 172.21.15.67:0/1774706474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3740730b0 con 0x7fb37415c030 2024-09-19T05:46:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb3793e8640 1 -- 172.21.15.67:0/1774706474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3740b2fd0 con 0x7fb37415c030 2024-09-19T05:46:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb35b7fe640 1 -- 172.21.15.67:0/1774706474 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb36c014bc0 con 0x7fb37415c030 2024-09-19T05:46:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb35b7fe640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3600678c0 0x7fb360069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:47.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb35b7fe640 1 -- 172.21.15.67:0/1774706474 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5421+0+0 (secure 0 0 0) 0x7fb36c0864d0 con 0x7fb37415c030 2024-09-19T05:46:47.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb372ffd640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3600678c0 0x7fb360069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:47.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.777+0000 7fb372ffd640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3600678c0 0x7fb360069d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb3680015b0 tx=0x7fb368009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:47.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:47.781+0000 7fb35b7fe640 1 -- 172.21.15.67:0/1774706474 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb36c011260 con 0x7fb37415c030 2024-09-19T05:46:48.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.009+0000 7fb3793e8640 1 -- 172.21.15.67:0/1774706474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7fb3740b4740 con 0x7fb37415c030 2024-09-19T05:46:48.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.293+0000 7fb35b7fe640 1 -- 172.21.15.67:0/1774706474 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v608) ==== 166+0+0 (secure 0 0 0) 0x7fb36c0570a0 con 0x7fb37415c030 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 -- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3600678c0 msgr2=0x7fb360069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3600678c0 0x7fb360069d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb3680015b0 tx=0x7fb368009040 comp rx=0 tx=0).stop 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 -- 172.21.15.67:0/1774706474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37415c030 msgr2=0x7fb374164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37415c030 0x7fb374164f50 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fb36c007e70 tx=0x7fb36c00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 -- 172.21.15.67:0/1774706474 shutdown_connections 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb37415c030 0x7fb374164f50 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3740b3510 0x7fb374164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3600678c0 0x7fb360069d80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 --2- 172.21.15.67:0/1774706474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb37406dde0 0x7fb374099b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 -- 172.21.15.67:0/1774706474 >> 172.21.15.67:0/1774706474 conn(0x7fb3740d0080 msgr2=0x7fb3740b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:48.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 -- 172.21.15.67:0/1774706474 shutdown_connections 2024-09-19T05:46:48.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.297+0000 7fb3793e8640 1 -- 172.21.15.67:0/1774706474 wait complete. 2024-09-19T05:46:48.315 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-19T05:46:48.316 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-19T05:46:48.316 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:46:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab71814640 1 Processor -- start 2024-09-19T05:46:48.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab71814640 1 -- start start 2024-09-19T05:46:48.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab71814640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 0x7fab6c0afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab71814640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab6c0b59b0 0x7fab6c0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab71814640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab6c0b0330 0x7fab6c0cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab71814640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fab6c15c2c0 con 0x7fab6c0b0330 2024-09-19T05:46:48.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab71814640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fab6c15c890 con 0x7fab6c0b59b0 2024-09-19T05:46:48.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab71814640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fab6c15b6d0 con 0x7fab6c158de0 2024-09-19T05:46:48.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab6c0b0330 0x7fab6c0cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab6c0b0330 0x7fab6c0cdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53148/0 (socket says 172.21.15.67:53148) 2024-09-19T05:46:48.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6b7fe640 1 -- 172.21.15.67:0/2438889823 learned_addr learned my addr 172.21.15.67:0/2438889823 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:48.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6affd640 1 --2- 172.21.15.67:0/2438889823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 0x7fab6c0afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6a7fc640 1 --2- 172.21.15.67:0/2438889823 >> v2:172.21.15.97:3300/0 conn(0x7fab6c0b59b0 0x7fab6c0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6b7fe640 1 -- 172.21.15.67:0/2438889823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 msgr2=0x7fab6c0afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6b7fe640 1 --2- 172.21.15.67:0/2438889823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 0x7fab6c0afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6b7fe640 1 -- 172.21.15.67:0/2438889823 >> v2:172.21.15.97:3300/0 conn(0x7fab6c0b59b0 msgr2=0x7fab6c0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6b7fe640 1 --2- 172.21.15.67:0/2438889823 >> v2:172.21.15.97:3300/0 conn(0x7fab6c0b59b0 0x7fab6c0cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6b7fe640 1 -- 172.21.15.67:0/2438889823 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c15b990 con 0x7fab6c0b0330 2024-09-19T05:46:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.433+0000 7fab6affd640 1 --2- 172.21.15.67:0/2438889823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 0x7fab6c0afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:46:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab6b7fe640 1 --2- 172.21.15.67:0/2438889823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 0x7fab6c0cdaf0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0b5980 tx=0x7fab6401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a4b53f2a5e584f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab69ffb640 1 -- 172.21.15.67:0/2438889823 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6400b2d0 con 0x7fab6c0b0330 2024-09-19T05:46:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab69ffb640 1 -- 172.21.15.67:0/2438889823 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6400b470 con 0x7fab6c0b0330 2024-09-19T05:46:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab69ffb640 1 -- 172.21.15.67:0/2438889823 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640a7b20 con 0x7fab6c0b0330 2024-09-19T05:46:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 -- 172.21.15.67:0/2438889823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 msgr2=0x7fab6c0cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 --2- 172.21.15.67:0/2438889823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 0x7fab6c0cdaf0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0b5980 tx=0x7fab6401eb60 comp rx=0 tx=0).stop 2024-09-19T05:46:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 -- 172.21.15.67:0/2438889823 shutdown_connections 2024-09-19T05:46:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 --2- 172.21.15.67:0/2438889823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 0x7fab6c0cdaf0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 --2- 172.21.15.67:0/2438889823 >> v2:172.21.15.97:3300/0 conn(0x7fab6c0b59b0 0x7fab6c0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 --2- 172.21.15.67:0/2438889823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 0x7fab6c0afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 -- 172.21.15.67:0/2438889823 >> 172.21.15.67:0/2438889823 conn(0x7fab6c073500 msgr2=0x7fab6c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 -- 172.21.15.67:0/2438889823 shutdown_connections 2024-09-19T05:46:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 -- 172.21.15.67:0/2438889823 wait complete. 2024-09-19T05:46:48.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 Processor -- start 2024-09-19T05:46:48.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 -- start start 2024-09-19T05:46:48.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 0x7fab6c070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 0x7fab6c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab6c14ec40 0x7fab6c14c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c15f860 con 0x7fab6c0b0330 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c15f6e0 con 0x7fab6c14ec40 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab71814640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fab6c15f9e0 con 0x7fab6c158de0 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab6affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 0x7fab6c070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab6affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 0x7fab6c070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53156/0 (socket says 172.21.15.67:53156) 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab6affd640 1 -- 172.21.15.67:0/2088364776 learned_addr learned my addr 172.21.15.67:0/2088364776 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.437+0000 7fab6b7fe640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab6c14ec40 0x7fab6c14c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab6a7fc640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 0x7fab6c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab6affd640 1 -- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 msgr2=0x7fab6c14e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab6affd640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 0x7fab6c14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab6affd640 1 -- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab6c14ec40 msgr2=0x7fab6c14c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab6affd640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab6c14ec40 0x7fab6c14c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab6affd640 1 -- 172.21.15.67:0/2088364776 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c0ceb10 con 0x7fab6c0b0330 2024-09-19T05:46:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab6b7fe640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab6c14ec40 0x7fab6c14c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab6affd640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 0x7fab6c070960 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00d830 tx=0x7fab5c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab63fff640 1 -- 172.21.15.67:0/2088364776 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c018020 con 0x7fab6c0b0330 2024-09-19T05:46:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab63fff640 1 -- 172.21.15.67:0/2088364776 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5c0096c0 con 0x7fab6c0b0330 2024-09-19T05:46:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab71814640 1 -- 172.21.15.67:0/2088364776 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6c151220 con 0x7fab6c0b0330 2024-09-19T05:46:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab63fff640 1 -- 172.21.15.67:0/2088364776 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c009ab0 con 0x7fab6c0b0330 2024-09-19T05:46:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab71814640 1 -- 172.21.15.67:0/2088364776 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6c1517e0 con 0x7fab6c0b0330 2024-09-19T05:46:48.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab71814640 1 -- 172.21.15.67:0/2088364776 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6c151a20 con 0x7fab6c0b0330 2024-09-19T05:46:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab63fff640 1 -- 172.21.15.67:0/2088364776 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab5c01b020 con 0x7fab6c0b0330 2024-09-19T05:46:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab63fff640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab4c0678f0 0x7fab4c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab63fff640 1 -- 172.21.15.67:0/2088364776 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5421+0+0 (secure 0 0 0) 0x7fab5c085f70 con 0x7fab6c0b0330 2024-09-19T05:46:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab6a7fc640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab4c0678f0 0x7fab4c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.441+0000 7fab6a7fc640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab4c0678f0 0x7fab4c069db0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fab6c14b130 tx=0x7fab54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.445+0000 7fab63fff640 1 -- 172.21.15.67:0/2088364776 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fab5c022020 con 0x7fab6c0b0330 2024-09-19T05:46:48.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.613+0000 7fab71814640 1 -- 172.21.15.67:0/2088364776 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab6c067f50 con 0x7fab6c0b0330 2024-09-19T05:46:48.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.613+0000 7fab63fff640 1 -- 172.21.15.67:0/2088364776 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) ==== 74+0+13409 (secure 0 0 0) 0x7fab5c056c60 con 0x7fab6c0b0330 2024-09-19T05:46:48.614 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:48.614 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":172,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:46:47.281215+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6833/1911026487":"2024-09-20T05:46:43.972993+0000","172.21.15.67:6832/1911026487":"2024-09-20T05:46:43.972993+0000","172.21.15.67:6835/1716781558":"2024-09-20T05:46:35.207652+0000","172.21.15.67:6834/1716781558":"2024-09-20T05:46:35.207652+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:46:48.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 -- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab4c0678f0 msgr2=0x7fab4c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab4c0678f0 0x7fab4c069db0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fab6c14b130 tx=0x7fab54008040 comp rx=0 tx=0).stop 2024-09-19T05:46:48.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 -- 172.21.15.67:0/2088364776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 msgr2=0x7fab6c070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 0x7fab6c070960 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00d830 tx=0x7fab5c00dcf0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 -- 172.21.15.67:0/2088364776 shutdown_connections 2024-09-19T05:46:48.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab6c14ec40 0x7fab6c14c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab4c0678f0 0x7fab4c069db0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab6c158de0 0x7fab6c14e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 --2- 172.21.15.67:0/2088364776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab6c0b0330 0x7fab6c070960 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 -- 172.21.15.67:0/2088364776 >> 172.21.15.67:0/2088364776 conn(0x7fab6c073500 msgr2=0x7fab6c15a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:48.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 -- 172.21.15.67:0/2088364776 shutdown_connections 2024-09-19T05:46:48.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.617+0000 7fab71814640 1 -- 172.21.15.67:0/2088364776 wait complete. 2024-09-19T05:46:48.634 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:46:48.634 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:46:48.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.765+0000 7fe08ae51640 1 Processor -- start 2024-09-19T05:46:48.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.765+0000 7fe08ae51640 1 -- start start 2024-09-19T05:46:48.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.765+0000 7fe08ae51640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe08415b1d0 0x7fe0840adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe08ae51640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08406dfc0 0x7fe08406f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe08ae51640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe08406fea0 0x7fe08415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe08ae51640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe084072210 con 0x7fe08406fea0 2024-09-19T05:46:48.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe08ae51640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe0840aef30 con 0x7fe08415b1d0 2024-09-19T05:46:48.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe08ae51640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe0840ae0f0 con 0x7fe08406dfc0 2024-09-19T05:46:48.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe0893ee640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe08406fea0 0x7fe08415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe0893ee640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe08406fea0 0x7fe08415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53170/0 (socket says 172.21.15.67:53170) 2024-09-19T05:46:48.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe0893ee640 1 -- 172.21.15.67:0/929798203 learned_addr learned my addr 172.21.15.67:0/929798203 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:48.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe083fff640 1 --2- 172.21.15.67:0/929798203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08406dfc0 0x7fe08406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe088bed640 1 --2- 172.21.15.67:0/929798203 >> v2:172.21.15.97:3300/0 conn(0x7fe08415b1d0 0x7fe0840adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe0893ee640 1 -- 172.21.15.67:0/929798203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08406dfc0 msgr2=0x7fe08406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:48.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe0893ee640 1 --2- 172.21.15.67:0/929798203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08406dfc0 0x7fe08406f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe0893ee640 1 -- 172.21.15.67:0/929798203 >> v2:172.21.15.97:3300/0 conn(0x7fe08415b1d0 msgr2=0x7fe0840adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:48.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe0893ee640 1 --2- 172.21.15.67:0/929798203 >> v2:172.21.15.97:3300/0 conn(0x7fe08415b1d0 0x7fe0840adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe0893ee640 1 -- 172.21.15.67:0/929798203 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0840ae3b0 con 0x7fe08406fea0 2024-09-19T05:46:48.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.769+0000 7fe0893ee640 1 --2- 172.21.15.67:0/929798203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406fea0 0x7fe08415ec80 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fe0840711d0 tx=0x7fe07401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d93fc15a6fe15b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:48.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe0837fe640 1 -- 172.21.15.67:0/929798203 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740b0070 con 0x7fe08406fea0 2024-09-19T05:46:48.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe0837fe640 1 -- 172.21.15.67:0/929798203 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0740ab600 con 0x7fe08406fea0 2024-09-19T05:46:48.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe0837fe640 1 -- 172.21.15.67:0/929798203 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740ab9d0 con 0x7fe08406fea0 2024-09-19T05:46:48.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 -- 172.21.15.67:0/929798203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406fea0 msgr2=0x7fe08415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 --2- 172.21.15.67:0/929798203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406fea0 0x7fe08415ec80 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fe0840711d0 tx=0x7fe07401c260 comp rx=0 tx=0).stop 2024-09-19T05:46:48.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 -- 172.21.15.67:0/929798203 shutdown_connections 2024-09-19T05:46:48.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 --2- 172.21.15.67:0/929798203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406fea0 0x7fe08415ec80 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 --2- 172.21.15.67:0/929798203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08406dfc0 0x7fe08406f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 --2- 172.21.15.67:0/929798203 >> v2:172.21.15.97:3300/0 conn(0x7fe08415b1d0 0x7fe0840adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 -- 172.21.15.67:0/929798203 >> 172.21.15.67:0/929798203 conn(0x7fe0840b1e50 msgr2=0x7fe0840b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:48.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 -- 172.21.15.67:0/929798203 shutdown_connections 2024-09-19T05:46:48.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 -- 172.21.15.67:0/929798203 wait complete. 2024-09-19T05:46:48.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 Processor -- start 2024-09-19T05:46:48.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 -- start start 2024-09-19T05:46:48.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406dfc0 0x7fe084152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08406fea0 0x7fe08409d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1d0 0x7fe08414eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe08406e850 con 0x7fe08406dfc0 2024-09-19T05:46:48.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe084072420 con 0x7fe08415b1d0 2024-09-19T05:46:48.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe08ae51640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe08406e9d0 con 0x7fe08406fea0 2024-09-19T05:46:48.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe088bed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406dfc0 0x7fe084152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe088bed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406dfc0 0x7fe084152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53176/0 (socket says 172.21.15.67:53176) 2024-09-19T05:46:48.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe088bed640 1 -- 172.21.15.67:0/3097786755 learned_addr learned my addr 172.21.15.67:0/3097786755 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:48.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe083fff640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08406fea0 0x7fe08409d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe0893ee640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1d0 0x7fe08414eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe088bed640 1 -- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08406fea0 msgr2=0x7fe08409d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe088bed640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08406fea0 0x7fe08409d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe088bed640 1 -- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1d0 msgr2=0x7fe08414eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe088bed640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1d0 0x7fe08414eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe088bed640 1 -- 172.21.15.67:0/3097786755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08409e0d0 con 0x7fe08406dfc0 2024-09-19T05:46:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe088bed640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406dfc0 0x7fe084152f30 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00efc0 tx=0x7fe07c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe0817fa640 1 -- 172.21.15.67:0/3097786755 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c018020 con 0x7fe08406dfc0 2024-09-19T05:46:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe0817fa640 1 -- 172.21.15.67:0/3097786755 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c014480 con 0x7fe08406dfc0 2024-09-19T05:46:48.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.773+0000 7fe0817fa640 1 -- 172.21.15.67:0/3097786755 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c014850 con 0x7fe08406dfc0 2024-09-19T05:46:48.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.777+0000 7fe08ae51640 1 -- 172.21.15.67:0/3097786755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08409bbe0 con 0x7fe08406dfc0 2024-09-19T05:46:48.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.777+0000 7fe08ae51640 1 -- 172.21.15.67:0/3097786755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08415fdb0 con 0x7fe08406dfc0 2024-09-19T05:46:48.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.777+0000 7fe08ae51640 1 -- 172.21.15.67:0/3097786755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08415ec80 con 0x7fe08406dfc0 2024-09-19T05:46:48.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.777+0000 7fe0817fa640 1 -- 172.21.15.67:0/3097786755 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe07c01b020 con 0x7fe08406dfc0 2024-09-19T05:46:48.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.777+0000 7fe0817fa640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 0x7fe068069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:48.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.777+0000 7fe0817fa640 1 -- 172.21.15.67:0/3097786755 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5421+0+0 (secure 0 0 0) 0x7fe07c086650 con 0x7fe08406dfc0 2024-09-19T05:46:48.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.777+0000 7fe083fff640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 0x7fe068069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:48.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.777+0000 7fe083fff640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 0x7fe068069d80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe084153470 tx=0x7fe06c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.781+0000 7fe0817fa640 1 -- 172.21.15.67:0/3097786755 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe07c022070 con 0x7fe08406dfc0 2024-09-19T05:46:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.948+0000 7fe08ae51640 1 -- 172.21.15.67:0/3097786755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe08406f9c0 con 0x7fe08406dfc0 2024-09-19T05:46:48.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.948+0000 7fe0817fa640 1 -- 172.21.15.67:0/3097786755 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v172) ==== 93+0+10 (secure 0 0 0) 0x7fe07c010040 con 0x7fe08406dfc0 2024-09-19T05:46:48.951 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:46:48.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 -- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 msgr2=0x7fe068069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 0x7fe068069d80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe084153470 tx=0x7fe06c008040 comp rx=0 tx=0).stop 2024-09-19T05:46:48.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 -- 172.21.15.67:0/3097786755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406dfc0 msgr2=0x7fe084152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:48.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406dfc0 0x7fe084152f30 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00efc0 tx=0x7fe07c00c490 comp rx=0 tx=0).stop 2024-09-19T05:46:48.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 -- 172.21.15.67:0/3097786755 shutdown_connections 2024-09-19T05:46:48.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe08415b1d0 0x7fe08414eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0680678c0 0x7fe068069d80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe08406fea0 0x7fe08409d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 --2- 172.21.15.67:0/3097786755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe08406dfc0 0x7fe084152f30 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:48.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 -- 172.21.15.67:0/3097786755 >> 172.21.15.67:0/3097786755 conn(0x7fe0840b1e50 msgr2=0x7fe0840b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:48.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 -- 172.21.15.67:0/3097786755 shutdown_connections 2024-09-19T05:46:48.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:48.952+0000 7fe08ae51640 1 -- 172.21.15.67:0/3097786755 wait complete. 2024-09-19T05:46:48.972 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-19T05:46:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc147c74640 1 Processor -- start 2024-09-19T05:46:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc147c74640 1 -- start start 2024-09-19T05:46:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc147c74640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc140161da0 0x7fc1400d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc147c74640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1400d0e80 0x7fc1400d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc147c74640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc1400b41c0 0x7fc1400b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc147c74640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc1400d0840 con 0x7fc140161da0 2024-09-19T05:46:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc147c74640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc1400d1800 con 0x7fc1400b41c0 2024-09-19T05:46:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc147c74640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc1400d4d40 con 0x7fc1400d0e80 2024-09-19T05:46:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc145a10640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc140161da0 0x7fc1400d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc145a10640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc140161da0 0x7fc1400d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53190/0 (socket says 172.21.15.67:53190) 2024-09-19T05:46:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc145a10640 1 -- 172.21.15.67:0/3587677591 learned_addr learned my addr 172.21.15.67:0/3587677591 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc146211640 1 --2- 172.21.15.67:0/3587677591 >> v2:172.21.15.97:3300/0 conn(0x7fc1400b41c0 0x7fc1400b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc14520f640 1 --2- 172.21.15.67:0/3587677591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1400d0e80 0x7fc1400d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc145a10640 1 -- 172.21.15.67:0/3587677591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1400d0e80 msgr2=0x7fc1400d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc145a10640 1 --2- 172.21.15.67:0/3587677591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1400d0e80 0x7fc1400d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:49.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc145a10640 1 -- 172.21.15.67:0/3587677591 >> v2:172.21.15.97:3300/0 conn(0x7fc1400b41c0 msgr2=0x7fc1400b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:49.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc145a10640 1 --2- 172.21.15.67:0/3587677591 >> v2:172.21.15.97:3300/0 conn(0x7fc1400b41c0 0x7fc1400b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:49.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.096+0000 7fc145a10640 1 -- 172.21.15.67:0/3587677591 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1400d5020 con 0x7fc140161da0 2024-09-19T05:46:49.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc145a10640 1 --2- 172.21.15.67:0/3587677591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc140161da0 0x7fc1400d1af0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fc14008e7c0 tx=0x7fc13001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a96e624e765dfcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc144a0e640 1 -- 172.21.15.67:0/3587677591 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1300b1070 con 0x7fc140161da0 2024-09-19T05:46:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc144a0e640 1 -- 172.21.15.67:0/3587677591 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1300ac630 con 0x7fc140161da0 2024-09-19T05:46:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc144a0e640 1 -- 172.21.15.67:0/3587677591 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1300a8050 con 0x7fc140161da0 2024-09-19T05:46:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc147c74640 1 -- 172.21.15.67:0/3587677591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc140161da0 msgr2=0x7fc1400d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc147c74640 1 --2- 172.21.15.67:0/3587677591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc140161da0 0x7fc1400d1af0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fc14008e7c0 tx=0x7fc13001c520 comp rx=0 tx=0).stop 2024-09-19T05:46:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc147c74640 1 -- 172.21.15.67:0/3587677591 shutdown_connections 2024-09-19T05:46:49.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc147c74640 1 --2- 172.21.15.67:0/3587677591 >> v2:172.21.15.97:3300/0 conn(0x7fc1400b41c0 0x7fc1400b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:49.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc147c74640 1 --2- 172.21.15.67:0/3587677591 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1400d0e80 0x7fc1400d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:49.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc147c74640 1 --2- 172.21.15.67:0/3587677591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc140161da0 0x7fc1400d1af0 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:49.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc147c74640 1 -- 172.21.15.67:0/3587677591 >> 172.21.15.67:0/3587677591 conn(0x7fc14008bfc0 msgr2=0x7fc1400d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:49.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc147c74640 1 -- 172.21.15.67:0/3587677591 shutdown_connections 2024-09-19T05:46:49.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.100+0000 7fc147c74640 1 -- 172.21.15.67:0/3587677591 wait complete. 2024-09-19T05:46:49.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc147c74640 1 Processor -- start 2024-09-19T05:46:49.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc147c74640 1 -- start start 2024-09-19T05:46:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc147c74640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1400b41c0 0x7fc14014ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc147c74640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1400d0e80 0x7fc14014f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc147c74640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc140161da0 0x7fc140157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc147c74640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc1400cf150 con 0x7fc1400b41c0 2024-09-19T05:46:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc147c74640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc140162180 con 0x7fc1400d0e80 2024-09-19T05:46:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc147c74640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc1400cf2d0 con 0x7fc140161da0 2024-09-19T05:46:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc145a10640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1400b41c0 0x7fc14014ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc145a10640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1400b41c0 0x7fc14014ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53196/0 (socket says 172.21.15.67:53196) 2024-09-19T05:46:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc145a10640 1 -- 172.21.15.67:0/1600682372 learned_addr learned my addr 172.21.15.67:0/1600682372 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:49.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc14520f640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1400d0e80 0x7fc14014f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc146211640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc140161da0 0x7fc140157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc145a10640 1 -- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc140161da0 msgr2=0x7fc140157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc145a10640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc140161da0 0x7fc140157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc145a10640 1 -- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1400d0e80 msgr2=0x7fc14014f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc145a10640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1400d0e80 0x7fc14014f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc145a10640 1 -- 172.21.15.67:0/1600682372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1400b32a0 con 0x7fc1400b41c0 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc145a10640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1400b41c0 0x7fc14014ed80 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fc1300af040 tx=0x7fc1300192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc1367fc640 1 -- 172.21.15.67:0/1600682372 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1300bc070 con 0x7fc1400b41c0 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc1367fc640 1 -- 172.21.15.67:0/1600682372 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1300ab5e0 con 0x7fc1400b41c0 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc147c74640 1 -- 172.21.15.67:0/1600682372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1400cc940 con 0x7fc1400b41c0 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc1367fc640 1 -- 172.21.15.67:0/1600682372 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1300b1070 con 0x7fc1400b41c0 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.104+0000 7fc147c74640 1 -- 172.21.15.67:0/1600682372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1400ccf00 con 0x7fc1400b41c0 2024-09-19T05:46:49.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.108+0000 7fc147c74640 1 -- 172.21.15.67:0/1600682372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1400b4650 con 0x7fc1400b41c0 2024-09-19T05:46:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.108+0000 7fc1367fc640 1 -- 172.21.15.67:0/1600682372 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1400b53a0 con 0x7fc1400b41c0 2024-09-19T05:46:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.108+0000 7fc1367fc640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1240678c0 0x7fc124069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.108+0000 7fc1367fc640 1 -- 172.21.15.67:0/1600682372 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5421+0+0 (secure 0 0 0) 0x7fc13011f300 con 0x7fc1400b41c0 2024-09-19T05:46:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.108+0000 7fc14520f640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1240678c0 0x7fc124069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.108+0000 7fc14520f640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1240678c0 0x7fc124069d80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc14014fa40 tx=0x7fc13c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:49.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.112+0000 7fc1367fc640 1 -- 172.21.15.67:0/1600682372 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc130016110 con 0x7fc1400b41c0 2024-09-19T05:46:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:49.340+0000 7fc147c74640 1 -- 172.21.15.67:0/1600682372 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7fc1400cd0d0 con 0x7fc1400b41c0 2024-09-19T05:46:50.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.304+0000 7fc1367fc640 1 -- 172.21.15.67:0/1600682372 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v610) ==== 162+0+0 (secure 0 0 0) 0x7fc1300eff70 con 0x7fc1400b41c0 2024-09-19T05:46:50.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 -- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1240678c0 msgr2=0x7fc124069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1240678c0 0x7fc124069d80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc14014fa40 tx=0x7fc13c008040 comp rx=0 tx=0).stop 2024-09-19T05:46:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 -- 172.21.15.67:0/1600682372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1400b41c0 msgr2=0x7fc14014ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1400b41c0 0x7fc14014ed80 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fc1300af040 tx=0x7fc1300192c0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 -- 172.21.15.67:0/1600682372 shutdown_connections 2024-09-19T05:46:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc1240678c0 0x7fc124069d80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc140161da0 0x7fc140157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1400d0e80 0x7fc14014f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 --2- 172.21.15.67:0/1600682372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1400b41c0 0x7fc14014ed80 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 -- 172.21.15.67:0/1600682372 >> 172.21.15.67:0/1600682372 conn(0x7fc14008bfc0 msgr2=0x7fc1400d4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 -- 172.21.15.67:0/1600682372 shutdown_connections 2024-09-19T05:46:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.308+0000 7fc147c74640 1 -- 172.21.15.67:0/1600682372 wait complete. 2024-09-19T05:46:50.333 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:46:50.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f8b72f640 1 Processor -- start 2024-09-19T05:46:50.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f8b72f640 1 -- start start 2024-09-19T05:46:50.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f8b72f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840af3a0 0x7f5f8415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f8b72f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f840ad840 con 0x7f5f84159c60 2024-09-19T05:46:50.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f8b72f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f8415a040 con 0x7f5f8406ffd0 2024-09-19T05:46:50.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f8b72f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8415d460 con 0x7f5f840af3a0 2024-09-19T05:46:50.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f894cb640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5f84159c60 0x7f5f840ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33082/0 (socket says 172.21.15.67:33082) 2024-09-19T05:46:50.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f894cb640 1 -- 172.21.15.67:0/1702993068 learned_addr learned my addr 172.21.15.67:0/1702993068 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:50.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f89ccc640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840af3a0 0x7f5f8415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250292434 0 0) 0x7f5f840ad840 con 0x7f5f84159c60 2024-09-19T05:46:50.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f70003530 con 0x7f5f84159c60 2024-09-19T05:46:50.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1292845786 0 0) 0x7f5f70003530 con 0x7f5f84159c60 2024-09-19T05:46:50.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840af3a0 msgr2=0x7f5f8415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:50.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840af3a0 0x7f5f8415fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 >> v1:172.21.15.97:6789/0 conn(0x7f5f8406ffd0 legacy=0x7f5f840aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8415c850 con 0x7f5f84159c60 2024-09-19T05:46:50.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f5f80001a00 con 0x7f5f84159c60 2024-09-19T05:46:50.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 >> v1:172.21.15.67:6789/0 conn(0x7f5f84159c60 legacy=0x7f5f840ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 0x7f5f70003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f70004810 0x7f5f70004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840af3a0 0x7f5f70005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8415d460 con 0x7f5f700039f0 2024-09-19T05:46:50.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7000bb90 con 0x7f5f70004810 2024-09-19T05:46:50.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5f7000bd90 con 0x7f5f840af3a0 2024-09-19T05:46:50.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f894cb640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 0x7f5f70003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f89ccc640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840af3a0 0x7f5f70005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f88cca640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f70004810 0x7f5f70004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f894cb640 1 -- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840af3a0 msgr2=0x7f5f70005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:50.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f894cb640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840af3a0 0x7f5f70005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f894cb640 1 -- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f70004810 msgr2=0x7f5f70004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:50.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f894cb640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f70004810 0x7f5f70004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f894cb640 1 -- 172.21.15.67:0/1702993068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f70003530 con 0x7f5f700039f0 2024-09-19T05:46:50.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f89ccc640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840af3a0 0x7f5f70005280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:46:50.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.464+0000 7f5f88cca640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f70004810 0x7f5f70004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:46:50.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f894cb640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 0x7f5f70003e30 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000a740 tx=0x7f5f8001d230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6485fc699f2013a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:50.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000a390 con 0x7f5f700039f0 2024-09-19T05:46:50.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f800ad630 con 0x7f5f700039f0 2024-09-19T05:46:50.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f7bfff640 1 -- 172.21.15.67:0/1702993068 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800ada20 con 0x7f5f700039f0 2024-09-19T05:46:50.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1702993068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 msgr2=0x7f5f70003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f8b72f640 1 --2- 172.21.15.67:0/1702993068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 0x7f5f70003e30 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000a740 tx=0x7f5f8001d230 comp rx=0 tx=0).stop 2024-09-19T05:46:50.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f89ccc640 1 -- 172.21.15.67:0/1702993068 reap_dead start 2024-09-19T05:46:50.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1702993068 shutdown_connections 2024-09-19T05:46:50.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1702993068 >> 172.21.15.67:0/1702993068 conn(0x7f5f840b1e50 msgr2=0x7f5f840b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:50.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1702993068 shutdown_connections 2024-09-19T05:46:50.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.468+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1702993068 wait complete. 2024-09-19T05:46:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 Processor -- start 2024-09-19T05:46:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 -- start start 2024-09-19T05:46:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 0x7f5f84099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f8414f510 0x7f5f8414f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840b0dd0 0x7f5f840b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84160750 con 0x7f5f700039f0 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841605d0 con 0x7f5f8414f510 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5f841608d0 con 0x7f5f840b0dd0 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f894cb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 0x7f5f84099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f894cb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 0x7f5f84099840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53216/0 (socket says 172.21.15.67:53216) 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f894cb640 1 -- 172.21.15.67:0/1235301673 learned_addr learned my addr 172.21.15.67:0/1235301673 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f89ccc640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840b0dd0 0x7f5f840b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f88cca640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f8414f510 0x7f5f8414f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f894cb640 1 -- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840b0dd0 msgr2=0x7f5f840b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f894cb640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840b0dd0 0x7f5f840b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f894cb640 1 -- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f8414f510 msgr2=0x7f5f8414f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f894cb640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f8414f510 0x7f5f8414f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f894cb640 1 -- 172.21.15.67:0/1235301673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f84152770 con 0x7f5f700039f0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f894cb640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 0x7f5f84099840 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f5f80098c10 tx=0x7f5f70005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f79ffb640 1 -- 172.21.15.67:0/1235301673 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800ad7e0 con 0x7f5f700039f0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f79ffb640 1 -- 172.21.15.67:0/1235301673 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f800ba070 con 0x7f5f700039f0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1235301673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f84152a50 con 0x7f5f700039f0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f79ffb640 1 -- 172.21.15.67:0/1235301673 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80001740 con 0x7f5f700039f0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1235301673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f84153010 con 0x7f5f700039f0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1235301673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f840aec90 con 0x7f5f700039f0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f79ffb640 1 -- 172.21.15.67:0/1235301673 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f80001900 con 0x7f5f700039f0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.472+0000 7f5f79ffb640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f680678f0 0x7f5f68069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.476+0000 7f5f79ffb640 1 -- 172.21.15.67:0/1235301673 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5421+0+0 (secure 0 0 0) 0x7f5f801203d0 con 0x7f5f700039f0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.476+0000 7f5f88cca640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f680678f0 0x7f5f68069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.476+0000 7f5f88cca640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f680678f0 0x7f5f68069db0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5f74000c10 tx=0x7f5f74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.480+0000 7f5f79ffb640 1 -- 172.21.15.67:0/1235301673 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5f80016f70 con 0x7f5f700039f0 2024-09-19T05:46:50.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.640+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1235301673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5f84150f70 con 0x7f5f700039f0 2024-09-19T05:46:50.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f79ffb640 1 -- 172.21.15.67:0/1235301673 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7f5f800f1030 con 0x7f5f700039f0 2024-09-19T05:46:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f680678f0 msgr2=0x7f5f68069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f680678f0 0x7f5f68069db0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5f74000c10 tx=0x7f5f74009040 comp rx=0 tx=0).stop 2024-09-19T05:46:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1235301673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 msgr2=0x7f5f84099840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 0x7f5f84099840 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f5f80098c10 tx=0x7f5f70005840 comp rx=0 tx=0).stop 2024-09-19T05:46:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1235301673 shutdown_connections 2024-09-19T05:46:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f680678f0 0x7f5f68069db0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f840b0dd0 0x7f5f840b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f8414f510 0x7f5f8414f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 --2- 172.21.15.67:0/1235301673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f700039f0 0x7f5f84099840 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1235301673 >> 172.21.15.67:0/1235301673 conn(0x7f5f840b1e50 msgr2=0x7f5f840b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:50.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1235301673 shutdown_connections 2024-09-19T05:46:50.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:50.648+0000 7f5f8b72f640 1 -- 172.21.15.67:0/1235301673 wait complete. 2024-09-19T05:46:50.667 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:46:50.667 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:46:50.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:46:50.806 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:46:50.806 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:46:50.806 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:46:50.812 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:46:50.812 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:46:50.812 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:46:50.818 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:46:50.818 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:46:50.818 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:46:50.860 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:46:50.860 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:46:50.861 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:46:50.868 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:46:50.869 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:46:50.869 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:51.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.028+0000 7f846cb9b640 1 Processor -- start 2024-09-19T05:46:51.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.028+0000 7f846cb9b640 1 -- start start 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846cb9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846815b710 0x7f8468071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846cb9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f846815baf0 0x7f846815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846cb9b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84680b3070 con 0x7f84680aef40 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846cb9b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f84680b32e0 con 0x7f846815baf0 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846cb9b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f84680b35c0 con 0x7f846815b710 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f8465d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f846815baf0 0x7f846815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f8465d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f846815baf0 0x7f846815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53222/0 (socket says 172.21.15.67:53222) 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f8466d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f84680aef40 0x7f84680af360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33094/0 (socket says 172.21.15.67:33094) 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f8465d9b640 1 -- 172.21.15.67:0/3974386115 learned_addr learned my addr 172.21.15.67:0/3974386115 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846659c640 1 --2- 172.21.15.67:0/3974386115 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846815b710 0x7f8468071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f8465d9b640 1 -- 172.21.15.67:0/3974386115 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846815b710 msgr2=0x7f8468071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f8465d9b640 1 --2- 172.21.15.67:0/3974386115 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846815b710 0x7f8468071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f8465d9b640 1 -- 172.21.15.67:0/3974386115 >> v1:172.21.15.67:6789/0 conn(0x7f84680aef40 legacy=0x7f84680af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:51.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846559a640 1 -- 172.21.15.67:0/3974386115 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919314429 0 0) 0x7f84680b3070 con 0x7f84680aef40 2024-09-19T05:46:51.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f8465d9b640 1 -- 172.21.15.67:0/3974386115 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84680afa70 con 0x7f846815baf0 2024-09-19T05:46:51.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846659c640 1 --2- 172.21.15.67:0/3974386115 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846815b710 0x7f8468071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:51.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f8465d9b640 1 --2- 172.21.15.67:0/3974386115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815baf0 0x7f846815bf30 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f845000bb10 tx=0x7f845001ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcc019395c899a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:51.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846559a640 1 -- 172.21.15.67:0/3974386115 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84500b4070 con 0x7f846815baf0 2024-09-19T05:46:51.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846559a640 1 -- 172.21.15.67:0/3974386115 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84500a7cd0 con 0x7f846815baf0 2024-09-19T05:46:51.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.032+0000 7f846559a640 1 -- 172.21.15.67:0/3974386115 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84500af660 con 0x7f846815baf0 2024-09-19T05:46:51.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- 172.21.15.67:0/3974386115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815baf0 msgr2=0x7f846815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:51.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 --2- 172.21.15.67:0/3974386115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815baf0 0x7f846815bf30 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f845000bb10 tx=0x7f845001ec00 comp rx=0 tx=0).stop 2024-09-19T05:46:51.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- 172.21.15.67:0/3974386115 shutdown_connections 2024-09-19T05:46:51.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 --2- 172.21.15.67:0/3974386115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815baf0 0x7f846815bf30 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 --2- 172.21.15.67:0/3974386115 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f846815b710 0x7f8468071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- 172.21.15.67:0/3974386115 >> 172.21.15.67:0/3974386115 conn(0x7f84680d0080 msgr2=0x7f84680d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:51.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- 172.21.15.67:0/3974386115 shutdown_connections 2024-09-19T05:46:51.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- 172.21.15.67:0/3974386115 wait complete. 2024-09-19T05:46:51.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 Processor -- start 2024-09-19T05:46:51.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- start start 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84680aef40 0x7f84681462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815b710 0x7f8468147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f846815baf0 0x7f846806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f84680b4a30 con 0x7f846815b710 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f84680b48b0 con 0x7f846815baf0 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f84680b4bb0 con 0x7f84680aef40 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8465d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815b710 0x7f8468147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8465d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815b710 0x7f8468147970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53230/0 (socket says 172.21.15.67:53230) 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8465d9b640 1 -- 172.21.15.67:0/1851895897 learned_addr learned my addr 172.21.15.67:0/1851895897 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8466d9d640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f846815baf0 0x7f846806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8465d9b640 1 -- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84680aef40 msgr2=0x7f84681462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:51.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8465d9b640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84680aef40 0x7f84681462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8465d9b640 1 -- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f846815baf0 msgr2=0x7f846806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8465d9b640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f846815baf0 0x7f846806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8465d9b640 1 -- 172.21.15.67:0/1851895897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846814c7b0 con 0x7f846815b710 2024-09-19T05:46:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8466d9d640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f846815baf0 0x7f846806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f8465d9b640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815b710 0x7f8468147970 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f845000bb10 tx=0x7f845001b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f845effd640 1 -- 172.21.15.67:0/1851895897 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84500b4040 con 0x7f846815b710 2024-09-19T05:46:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f845effd640 1 -- 172.21.15.67:0/1851895897 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84500afca0 con 0x7f846815b710 2024-09-19T05:46:51.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- 172.21.15.67:0/1851895897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8468147eb0 con 0x7f846815b710 2024-09-19T05:46:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f845effd640 1 -- 172.21.15.67:0/1851895897 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450004250 con 0x7f846815b710 2024-09-19T05:46:51.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.036+0000 7f846cb9b640 1 -- 172.21.15.67:0/1851895897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f846814b390 con 0x7f846815b710 2024-09-19T05:46:51.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.040+0000 7f846cb9b640 1 -- 172.21.15.67:0/1851895897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8468071e80 con 0x7f846815b710 2024-09-19T05:46:51.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.040+0000 7f845effd640 1 -- 172.21.15.67:0/1851895897 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8450003620 con 0x7f846815b710 2024-09-19T05:46:51.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.040+0000 7f845effd640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84480678c0 0x7f8448069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.040+0000 7f845effd640 1 -- 172.21.15.67:0/1851895897 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5421+0+0 (secure 0 0 0) 0x7f8450122f70 con 0x7f846815b710 2024-09-19T05:46:51.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.040+0000 7f846659c640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84480678c0 0x7f8448069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.040+0000 7f846659c640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84480678c0 0x7f8448069d80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f845800a8d0 tx=0x7f8458008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:51.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.044+0000 7f845effd640 1 -- 172.21.15.67:0/1851895897 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8450018820 con 0x7f846815b710 2024-09-19T05:46:51.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.240+0000 7f846cb9b640 1 -- 172.21.15.67:0/1851895897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84680d0600 con 0x7f846815b710 2024-09-19T05:46:51.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f845effd640 1 -- 172.21.15.67:0/1851895897 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+3090 (secure 0 0 0) 0x7f84500b7350 con 0x7f846815b710 2024-09-19T05:46:51.244 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:51.244 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":121,"btime":"2024-09-19T05:46:44:975334+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3808469364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3808469364},{"type":"v1","addr":"172.21.15.97:6835","nonce":3808469364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3347652019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3347652019},{"type":"v1","addr":"172.21.15.97:6837","nonce":3347652019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":9948,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2316711222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2316711222},{"type":"v1","addr":"172.21.15.67:6833","nonce":2316711222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[]} 2024-09-19T05:46:51.245 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 121 2024-09-19T05:46:51.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 -- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84480678c0 msgr2=0x7f8448069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:51.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84480678c0 0x7f8448069d80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f845800a8d0 tx=0x7f8458008040 comp rx=0 tx=0).stop 2024-09-19T05:46:51.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 -- 172.21.15.67:0/1851895897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815b710 msgr2=0x7f8468147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:51.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815b710 0x7f8468147970 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f845000bb10 tx=0x7f845001b9a0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 -- 172.21.15.67:0/1851895897 shutdown_connections 2024-09-19T05:46:51.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f846815baf0 0x7f846806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f846815b710 0x7f8468147970 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f84480678c0 0x7f8448069d80 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 --2- 172.21.15.67:0/1851895897 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84680aef40 0x7f84681462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 -- 172.21.15.67:0/1851895897 >> 172.21.15.67:0/1851895897 conn(0x7f84680d0080 msgr2=0x7f84680b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:51.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 -- 172.21.15.67:0/1851895897 shutdown_connections 2024-09-19T05:46:51.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.244+0000 7f846cb9b640 1 -- 172.21.15.67:0/1851895897 wait complete. 2024-09-19T05:46:51.263 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:46:51.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:46:51.264 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:46:51.264 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:46:51.264 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:46:51.264 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:46:51.264 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:46:51.264 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:46:51.265 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:46:51.265 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:46:51.265 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:46:51.265 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:46:51.265 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:46:51.265 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:46:51.275 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:46:51.275 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:46:51.276 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:46:51.276 DEBUG:teuthology.parallel:result is None 2024-09-19T05:46:51.279 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:46:51.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:46:51.288 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:46:51.288 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:46:51.320 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:46:51.321 DEBUG:teuthology.parallel:result is None 2024-09-19T05:46:51.337 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:46:51.337 DEBUG:teuthology.parallel:result is None 2024-09-19T05:46:51.339 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:46:51.339 DEBUG:teuthology.parallel:result is None 2024-09-19T05:46:51.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:46:51.343 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:46:51.387 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:46:51.408 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:46:51.409 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:46:51.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f93426fa640 1 Processor -- start 2024-09-19T05:46:51.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f93426fa640 1 -- start start 2024-09-19T05:46:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f93426fa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f933c0d1590 0x7f933c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f93426fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b51d0 0x7f933c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f93426fa640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933c0d4d40 con 0x7f933c161da0 2024-09-19T05:46:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f93426fa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f933c0d0840 con 0x7f933c0d1590 2024-09-19T05:46:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f93426fa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f933c0d5020 con 0x7f933c0b51d0 2024-09-19T05:46:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f933bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f933c161da0 0x7f933c0d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33108/0 (socket says 172.21.15.67:33108) 2024-09-19T05:46:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f933bfff640 1 -- 172.21.15.67:0/3478444676 learned_addr learned my addr 172.21.15.67:0/3478444676 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f933b7fe640 1 --2- 172.21.15.67:0/3478444676 >> v2:172.21.15.97:3300/0 conn(0x7f933c0d1590 0x7f933c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f9340c97640 1 --2- 172.21.15.67:0/3478444676 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b51d0 0x7f933c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f933affd640 1 -- 172.21.15.67:0/3478444676 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896564088 0 0) 0x7f933c0d4d40 con 0x7f933c161da0 2024-09-19T05:46:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f933affd640 1 -- 172.21.15.67:0/3478444676 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9328003530 con 0x7f933c161da0 2024-09-19T05:46:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f933b7fe640 1 -- 172.21.15.67:0/3478444676 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b51d0 msgr2=0x7f933c0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f933b7fe640 1 --2- 172.21.15.67:0/3478444676 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b51d0 0x7f933c0cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f933b7fe640 1 -- 172.21.15.67:0/3478444676 >> v1:172.21.15.67:6789/0 conn(0x7f933c161da0 legacy=0x7f933c0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.448+0000 7f933b7fe640 1 -- 172.21.15.67:0/3478444676 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c0d5300 con 0x7f933c0d1590 2024-09-19T05:46:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f933b7fe640 1 --2- 172.21.15.67:0/3478444676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c0d1590 0x7f933c0d1af0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f93240097c0 tx=0x7f932401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fd7c711bf3e33ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f933affd640 1 -- 172.21.15.67:0/3478444676 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93240b0070 con 0x7f933c0d1590 2024-09-19T05:46:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f933affd640 1 -- 172.21.15.67:0/3478444676 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93240ab600 con 0x7f933c0d1590 2024-09-19T05:46:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f933affd640 1 -- 172.21.15.67:0/3478444676 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93240ab9b0 con 0x7f933c0d1590 2024-09-19T05:46:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 -- 172.21.15.67:0/3478444676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c0d1590 msgr2=0x7f933c0d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 --2- 172.21.15.67:0/3478444676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c0d1590 0x7f933c0d1af0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f93240097c0 tx=0x7f932401c4a0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 -- 172.21.15.67:0/3478444676 shutdown_connections 2024-09-19T05:46:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 --2- 172.21.15.67:0/3478444676 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b51d0 0x7f933c0cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 --2- 172.21.15.67:0/3478444676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c0d1590 0x7f933c0d1af0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 -- 172.21.15.67:0/3478444676 >> 172.21.15.67:0/3478444676 conn(0x7f933c08bfc0 msgr2=0x7f933c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:51.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 -- 172.21.15.67:0/3478444676 shutdown_connections 2024-09-19T05:46:51.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 -- 172.21.15.67:0/3478444676 wait complete. 2024-09-19T05:46:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 Processor -- start 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 -- start start 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b51d0 0x7f933c0b9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c0d1590 0x7f933c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c161da0 0x7f933c154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0d0020 con 0x7f933c161da0 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0cfea0 con 0x7f933c0d1590 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f93426fa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f933c0d01a0 con 0x7f933c0b51d0 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f9340c97640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c161da0 0x7f933c154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f9340c97640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c161da0 0x7f933c154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53290/0 (socket says 172.21.15.67:53290) 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f9340c97640 1 -- 172.21.15.67:0/1889274510 learned_addr learned my addr 172.21.15.67:0/1889274510 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f933bfff640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b51d0 0x7f933c0b9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.452+0000 7f933b7fe640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c0d1590 0x7f933c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9340c97640 1 -- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b51d0 msgr2=0x7f933c0b9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9340c97640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b51d0 0x7f933c0b9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9340c97640 1 -- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c0d1590 msgr2=0x7f933c0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9340c97640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c0d1590 0x7f933c0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9340c97640 1 -- 172.21.15.67:0/1889274510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c155860 con 0x7f933c161da0 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9340c97640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c161da0 0x7f933c154cb0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f933400efc0 tx=0x7f933400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9338ff9640 1 -- 172.21.15.67:0/1889274510 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334018020 con 0x7f933c161da0 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9338ff9640 1 -- 172.21.15.67:0/1889274510 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9334009b10 con 0x7f933c161da0 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f93426fa640 1 -- 172.21.15.67:0/1889274510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933c0cdd80 con 0x7f933c161da0 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9338ff9640 1 -- 172.21.15.67:0/1889274510 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93340146c0 con 0x7f933c161da0 2024-09-19T05:46:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f93426fa640 1 -- 172.21.15.67:0/1889274510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933c0b8b80 con 0x7f933c161da0 2024-09-19T05:46:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f93426fa640 1 -- 172.21.15.67:0/1889274510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933c0cf150 con 0x7f933c161da0 2024-09-19T05:46:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9338ff9640 1 -- 172.21.15.67:0/1889274510 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f933401b020 con 0x7f933c161da0 2024-09-19T05:46:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9338ff9640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f931c0678c0 0x7f931c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:51.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f9338ff9640 1 -- 172.21.15.67:0/1889274510 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5421+0+0 (secure 0 0 0) 0x7f93340865f0 con 0x7f933c161da0 2024-09-19T05:46:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f933bfff640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f931c0678c0 0x7f931c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:51.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.456+0000 7f933bfff640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f931c0678c0 0x7f931c069d80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f932c007fd0 tx=0x7f932c000bd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:51.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.460+0000 7f9338ff9640 1 -- 172.21.15.67:0/1889274510 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9334022070 con 0x7f933c161da0 2024-09-19T05:46:51.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:51.636+0000 7f93426fa640 1 -- 172.21.15.67:0/1889274510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f933c158fe0 con 0x7f933c161da0 2024-09-19T05:46:52.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.324+0000 7f9338ff9640 1 -- 172.21.15.67:0/1889274510 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v174) ==== 97+0+0 (secure 0 0 0) 0x7f9334010040 con 0x7f933c161da0 2024-09-19T05:46:52.324 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:46:52.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 -- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f931c0678c0 msgr2=0x7f931c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f931c0678c0 0x7f931c069d80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f932c007fd0 tx=0x7f932c000bd0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 -- 172.21.15.67:0/1889274510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c161da0 msgr2=0x7f933c154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c161da0 0x7f933c154cb0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f933400efc0 tx=0x7f933400c490 comp rx=0 tx=0).stop 2024-09-19T05:46:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 -- 172.21.15.67:0/1889274510 shutdown_connections 2024-09-19T05:46:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f933c161da0 0x7f933c154cb0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f933c0d1590 0x7f933c0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f931c0678c0 0x7f931c069d80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 --2- 172.21.15.67:0/1889274510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f933c0b51d0 0x7f933c0b9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 -- 172.21.15.67:0/1889274510 >> 172.21.15.67:0/1889274510 conn(0x7f933c08bfc0 msgr2=0x7f933c0b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 -- 172.21.15.67:0/1889274510 shutdown_connections 2024-09-19T05:46:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.328+0000 7f93426fa640 1 -- 172.21.15.67:0/1889274510 wait complete. 2024-09-19T05:46:52.349 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:46:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f173a935640 1 Processor -- start 2024-09-19T05:46:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f173a935640 1 -- start start 2024-09-19T05:46:52.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f173a935640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f173406ed80 0x7f1734165840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f173a935640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17340730e0 con 0x7f17340af730 2024-09-19T05:46:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f173a935640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17340733c0 con 0x7f173415a920 2024-09-19T05:46:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f173a935640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f17340ad8c0 con 0x7f173406ed80 2024-09-19T05:46:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f17337fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f17340af730 0x7f173406e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33110/0 (socket says 172.21.15.67:33110) 2024-09-19T05:46:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f17337fe640 1 -- 172.21.15.67:0/4034726207 learned_addr learned my addr 172.21.15.67:0/4034726207 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1738ed2640 1 --2- 172.21.15.67:0/4034726207 >> v2:172.21.15.97:3300/0 conn(0x7f173406ed80 0x7f1734165840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301401100 0 0) 0x7f17340730e0 con 0x7f17340af730 2024-09-19T05:46:52.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1720003530 con 0x7f17340af730 2024-09-19T05:46:52.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 726277202 0 0) 0x7f1720003530 con 0x7f17340af730 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 >> v2:172.21.15.97:3300/0 conn(0x7f173406ed80 msgr2=0x7f1734165840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 --2- 172.21.15.67:0/4034726207 >> v2:172.21.15.97:3300/0 conn(0x7f173406ed80 0x7f1734165840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 >> v1:172.21.15.97:6789/0 conn(0x7f173415a920 legacy=0x7f1734072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17340adba0 con 0x7f17340af730 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1724001680 con 0x7f17340af730 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 >> v1:172.21.15.67:6789/0 conn(0x7f17340af730 legacy=0x7f173406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1720003a10 0x7f1720003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1720004810 0x7f1720004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17200051d0 0x7f172000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f17340ad8c0 con 0x7f1720003a10 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f172000e2e0 con 0x7f17200051d0 2024-09-19T05:46:52.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f172000e4e0 con 0x7f1720004810 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1733fff640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1720003a10 0x7f1720003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f17337fe640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1720004810 0x7f1720004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1738ed2640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17200051d0 0x7f172000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1733fff640 1 -- 172.21.15.67:0/4034726207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1720004810 msgr2=0x7f1720004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1733fff640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1720004810 0x7f1720004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1733fff640 1 -- 172.21.15.67:0/4034726207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17200051d0 msgr2=0x7f172000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1733fff640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17200051d0 0x7f172000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1733fff640 1 -- 172.21.15.67:0/4034726207 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1720003530 con 0x7f1720003a10 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f17337fe640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1720004810 0x7f1720004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1738ed2640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17200051d0 0x7f172000dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.516+0000 7f1738ed2640 1 -- 172.21.15.67:0/4034726207 reap_dead start 2024-09-19T05:46:52.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f1733fff640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1720003a10 0x7f1720003e30 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f171c001780 tx=0x7f171c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ee6c828674d77d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0013a0 con 0x7f1720003a10 2024-09-19T05:46:52.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171c0052f0 con 0x7f1720003a10 2024-09-19T05:46:52.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f1732ffd640 1 -- 172.21.15.67:0/4034726207 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c003840 con 0x7f1720003a10 2024-09-19T05:46:52.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 -- 172.21.15.67:0/4034726207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1720003a10 msgr2=0x7f1720003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1720003a10 0x7f1720003e30 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f171c001780 tx=0x7f171c01c3c0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 -- 172.21.15.67:0/4034726207 shutdown_connections 2024-09-19T05:46:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 --2- 172.21.15.67:0/4034726207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1720003a10 0x7f1720003e30 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 -- 172.21.15.67:0/4034726207 >> 172.21.15.67:0/4034726207 conn(0x7f17340d0080 msgr2=0x7f17340d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 -- 172.21.15.67:0/4034726207 shutdown_connections 2024-09-19T05:46:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 -- 172.21.15.67:0/4034726207 wait complete. 2024-09-19T05:46:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 Processor -- start 2024-09-19T05:46:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 -- start start 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1720003a10 0x7f173409d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17341f7b90 0x7f173415d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f173415db90 0x7f17340ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f173406e5f0 con 0x7f173415db90 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1734072e60 con 0x7f17341f7b90 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f173a935640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f173406e770 con 0x7f1720003a10 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f1738ed2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f173415db90 0x7f17340ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f1738ed2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f173415db90 0x7f17340ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53300/0 (socket says 172.21.15.67:53300) 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.520+0000 7f1738ed2640 1 -- 172.21.15.67:0/1259623808 learned_addr learned my addr 172.21.15.67:0/1259623808 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1733fff640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1720003a10 0x7f173409d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f17337fe640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17341f7b90 0x7f173415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1738ed2640 1 -- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1720003a10 msgr2=0x7f173409d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1738ed2640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1720003a10 0x7f173409d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1738ed2640 1 -- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17341f7b90 msgr2=0x7f173415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1738ed2640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17341f7b90 0x7f173415d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1738ed2640 1 -- 172.21.15.67:0/1259623808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17340ccb10 con 0x7f173415db90 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1738ed2640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f173415db90 0x7f17340ca940 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f172c00ae30 tx=0x7f172c00f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1730ff9640 1 -- 172.21.15.67:0/1259623808 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c00a2e0 con 0x7f173415db90 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1730ff9640 1 -- 172.21.15.67:0/1259623808 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c01a070 con 0x7f173415db90 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f173a935640 1 -- 172.21.15.67:0/1259623808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17340ccdf0 con 0x7f173415db90 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1730ff9640 1 -- 172.21.15.67:0/1259623808 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c015480 con 0x7f173415db90 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f173a935640 1 -- 172.21.15.67:0/1259623808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173415e0a0 con 0x7f173415db90 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f173a935640 1 -- 172.21.15.67:0/1259623808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173406eaa0 con 0x7f173415db90 2024-09-19T05:46:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1730ff9640 1 -- 172.21.15.67:0/1259623808 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f172c013050 con 0x7f173415db90 2024-09-19T05:46:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1730ff9640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17140678f0 0x7f1714069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1730ff9640 1 -- 172.21.15.67:0/1259623808 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5249+0+0 (secure 0 0 0) 0x7f172c086190 con 0x7f173415db90 2024-09-19T05:46:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1733fff640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17140678f0 0x7f1714069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.524+0000 7f1733fff640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17140678f0 0x7f1714069db0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f171c001750 tx=0x7f171c0011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.528+0000 7f1730ff9640 1 -- 172.21.15.67:0/1259623808 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f172c011040 con 0x7f173415db90 2024-09-19T05:46:52.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 -- 172.21.15.67:0/1259623808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f17340ae570 con 0x7f173415db90 2024-09-19T05:46:52.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f1730ff9640 1 -- 172.21.15.67:0/1259623808 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f172c056e90 con 0x7f173415db90 2024-09-19T05:46:52.752 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.753 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:46:52.754 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:46:52.755 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:46:52.757 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.758 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:46:52.759 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.760 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.761 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.762 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:46:52.763 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:46:52.764 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:52.765 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:46:52.766 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:46:52.766 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:46:52.766 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:46:52.766 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:46:52.766 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:46:52.766 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.766 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:52.766 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:46:52.766 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:46:52.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 -- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17140678f0 msgr2=0x7f1714069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17140678f0 0x7f1714069db0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f171c001750 tx=0x7f171c0011a0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 -- 172.21.15.67:0/1259623808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f173415db90 msgr2=0x7f17340ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f173415db90 0x7f17340ca940 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f172c00ae30 tx=0x7f172c00f510 comp rx=0 tx=0).stop 2024-09-19T05:46:52.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 -- 172.21.15.67:0/1259623808 shutdown_connections 2024-09-19T05:46:52.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f173415db90 0x7f17340ca940 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17341f7b90 0x7f173415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f17140678f0 0x7f1714069db0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 --2- 172.21.15.67:0/1259623808 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1720003a10 0x7f173409d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 -- 172.21.15.67:0/1259623808 >> 172.21.15.67:0/1259623808 conn(0x7f17340d0080 msgr2=0x7f17340b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:52.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 -- 172.21.15.67:0/1259623808 shutdown_connections 2024-09-19T05:46:52.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.752+0000 7f173a935640 1 -- 172.21.15.67:0/1259623808 wait complete. 2024-09-19T05:46:52.772 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd136050640 1 Processor -- start 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd136050640 1 -- start start 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd136050640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd13006f460 0x7fd13006f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd136050640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd13006e3c0 con 0x7fd13006dde0 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd136050640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd13006e6a0 con 0x7fd13015c030 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd136050640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd13006e980 con 0x7fd13006f460 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd12ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd13006f460 0x7fd13006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd12effd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd13006dde0 0x7fd1300b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33122/0 (socket says 172.21.15.67:33122) 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd12effd640 1 -- 172.21.15.67:0/1308591617 learned_addr learned my addr 172.21.15.67:0/1308591617 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:52.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd12ffff640 1 -- 172.21.15.67:0/1308591617 >> v1:172.21.15.97:6789/0 conn(0x7fd13015c030 legacy=0x7fd13015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd12ffff640 1 -- 172.21.15.67:0/1308591617 >> v1:172.21.15.67:6789/0 conn(0x7fd13006dde0 legacy=0x7fd1300b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd12e7fc640 1 -- 172.21.15.67:0/1308591617 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937361304 0 0) 0x7fd13006e3c0 con 0x7fd13006dde0 2024-09-19T05:46:52.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.888+0000 7fd12ffff640 1 -- 172.21.15.67:0/1308591617 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13006ec60 con 0x7fd13006f460 2024-09-19T05:46:52.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12ffff640 1 --2- 172.21.15.67:0/1308591617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006f460 0x7fd13006f870 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fd128009d90 tx=0x7fd12801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a593065818db395 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12e7fc640 1 -- 172.21.15.67:0/1308591617 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1280b2070 con 0x7fd13006f460 2024-09-19T05:46:52.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12e7fc640 1 -- 172.21.15.67:0/1308591617 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1280a5840 con 0x7fd13006f460 2024-09-19T05:46:52.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12e7fc640 1 -- 172.21.15.67:0/1308591617 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1280a5c10 con 0x7fd13006f460 2024-09-19T05:46:52.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 -- 172.21.15.67:0/1308591617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006f460 msgr2=0x7fd13006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 --2- 172.21.15.67:0/1308591617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006f460 0x7fd13006f870 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fd128009d90 tx=0x7fd12801c970 comp rx=0 tx=0).stop 2024-09-19T05:46:52.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 -- 172.21.15.67:0/1308591617 shutdown_connections 2024-09-19T05:46:52.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 --2- 172.21.15.67:0/1308591617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006f460 0x7fd13006f870 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 -- 172.21.15.67:0/1308591617 >> 172.21.15.67:0/1308591617 conn(0x7fd1300d0080 msgr2=0x7fd1300d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 -- 172.21.15.67:0/1308591617 shutdown_connections 2024-09-19T05:46:52.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 -- 172.21.15.67:0/1308591617 wait complete. 2024-09-19T05:46:52.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 Processor -- start 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 -- start start 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006dde0 0x7fd13015dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd13006f460 0x7fd13014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd13015c030 0x7fd13015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd13016a270 con 0x7fd13006dde0 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd13016a0f0 con 0x7fd13006f460 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd136050640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd13016a3f0 con 0x7fd13015c030 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006dde0 0x7fd13015dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006dde0 0x7fd13015dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53316/0 (socket says 172.21.15.67:53316) 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12f7fe640 1 -- 172.21.15.67:0/109359938 learned_addr learned my addr 172.21.15.67:0/109359938 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12effd640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd13006f460 0x7fd13014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12ffff640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd13015c030 0x7fd13015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12f7fe640 1 -- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd13015c030 msgr2=0x7fd13015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12f7fe640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd13015c030 0x7fd13015c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12f7fe640 1 -- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd13006f460 msgr2=0x7fd13014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.892+0000 7fd12f7fe640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd13006f460 0x7fd13014f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd12f7fe640 1 -- 172.21.15.67:0/109359938 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13015e370 con 0x7fd13006dde0 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd12effd640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd13006f460 0x7fd13014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd12ffff640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd13015c030 0x7fd13015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd12f7fe640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006dde0 0x7fd13015dc90 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fd12400c3c0 tx=0x7fd12400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd117fff640 1 -- 172.21.15.67:0/109359938 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124017070 con 0x7fd13006dde0 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd117fff640 1 -- 172.21.15.67:0/109359938 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1240052d0 con 0x7fd13006dde0 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd117fff640 1 -- 172.21.15.67:0/109359938 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124003840 con 0x7fd13006dde0 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd136050640 1 -- 172.21.15.67:0/109359938 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13015e650 con 0x7fd13006dde0 2024-09-19T05:46:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd136050640 1 -- 172.21.15.67:0/109359938 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd13015ec10 con 0x7fd13006dde0 2024-09-19T05:46:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd136050640 1 -- 172.21.15.67:0/109359938 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd13006f870 con 0x7fd13006dde0 2024-09-19T05:46:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd117fff640 1 -- 172.21.15.67:0/109359938 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd12401a070 con 0x7fd13006dde0 2024-09-19T05:46:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd117fff640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd11c0678c0 0x7fd11c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd117fff640 1 -- 172.21.15.67:0/109359938 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5249+0+0 (secure 0 0 0) 0x7fd124084dd0 con 0x7fd13006dde0 2024-09-19T05:46:52.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd12effd640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd11c0678c0 0x7fd11c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.896+0000 7fd12effd640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd11c0678c0 0x7fd11c069d80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd130159230 tx=0x7fd120009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:52.900+0000 7fd117fff640 1 -- 172.21.15.67:0/109359938 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd124005480 con 0x7fd13006dde0 2024-09-19T05:46:53.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.064+0000 7fd136050640 1 -- 172.21.15.67:0/109359938 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd1300d0f20 con 0x7fd13006dde0 2024-09-19T05:46:53.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.064+0000 7fd117fff640 1 -- 172.21.15.67:0/109359938 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v175) ==== 84+0+65 (secure 0 0 0) 0x7fd124086090 con 0x7fd13006dde0 2024-09-19T05:46:53.065 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:53.065 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:46:53.065 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:46:53.065 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:46:53.065 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:46:53.065 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:46:53.065 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:46:53.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.064+0000 7fd136050640 1 -- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd11c0678c0 msgr2=0x7fd11c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.064+0000 7fd136050640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd11c0678c0 0x7fd11c069d80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd130159230 tx=0x7fd120009040 comp rx=0 tx=0).stop 2024-09-19T05:46:53.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.064+0000 7fd136050640 1 -- 172.21.15.67:0/109359938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006dde0 msgr2=0x7fd13015dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.064+0000 7fd136050640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006dde0 0x7fd13015dc90 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fd12400c3c0 tx=0x7fd12400c880 comp rx=0 tx=0).stop 2024-09-19T05:46:53.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.068+0000 7fd136050640 1 -- 172.21.15.67:0/109359938 shutdown_connections 2024-09-19T05:46:53.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.068+0000 7fd136050640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd11c0678c0 0x7fd11c069d80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.068+0000 7fd136050640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd13015c030 0x7fd13015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.068+0000 7fd136050640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd13006f460 0x7fd13014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.068+0000 7fd136050640 1 --2- 172.21.15.67:0/109359938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd13006dde0 0x7fd13015dc90 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.068+0000 7fd136050640 1 -- 172.21.15.67:0/109359938 >> 172.21.15.67:0/109359938 conn(0x7fd1300d0080 msgr2=0x7fd1300b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:53.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.068+0000 7fd136050640 1 -- 172.21.15.67:0/109359938 shutdown_connections 2024-09-19T05:46:53.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.068+0000 7fd136050640 1 -- 172.21.15.67:0/109359938 wait complete. 2024-09-19T05:46:53.083 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:46:53.083 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:46:53.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2eee9e640 1 Processor -- start 2024-09-19T05:46:53.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2eee9e640 1 -- start start 2024-09-19T05:46:53.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2eee9e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb2e815e620 0x7fb2e80d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:53.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2eee9e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2e80d5100 0x7fb2e80d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:53.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2eee9e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2e806cef0 con 0x7fb2e80d13e0 2024-09-19T05:46:53.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2eee9e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb2e806d7e0 con 0x7fb2e815e620 2024-09-19T05:46:53.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2eee9e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e815ea00 con 0x7fb2e80d5100 2024-09-19T05:46:53.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2ed43b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb2e80d13e0 0x7fb2e80cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33124/0 (socket says 172.21.15.67:33124) 2024-09-19T05:46:53.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2ed43b640 1 -- 172.21.15.67:0/1290662680 learned_addr learned my addr 172.21.15.67:0/1290662680 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:53.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2ecc3a640 1 --2- 172.21.15.67:0/1290662680 >> v2:172.21.15.67:3300/0 conn(0x7fb2e815e620 0x7fb2e80d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:53.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2e7fff640 1 --2- 172.21.15.67:0/1290662680 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2e80d5100 0x7fb2e80d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:53.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2e77fe640 1 -- 172.21.15.67:0/1290662680 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159138529 0 0) 0x7fb2e806cef0 con 0x7fb2e80d13e0 2024-09-19T05:46:53.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2e77fe640 1 -- 172.21.15.67:0/1290662680 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2d0003530 con 0x7fb2e80d13e0 2024-09-19T05:46:53.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2ecc3a640 1 -- 172.21.15.67:0/1290662680 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2e80d5100 msgr2=0x7fb2e80d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:53.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2ecc3a640 1 --2- 172.21.15.67:0/1290662680 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2e80d5100 0x7fb2e80d0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2ecc3a640 1 -- 172.21.15.67:0/1290662680 >> v1:172.21.15.67:6789/0 conn(0x7fb2e80d13e0 legacy=0x7fb2e80cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.212+0000 7fb2ecc3a640 1 -- 172.21.15.67:0/1290662680 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e80b1020 con 0x7fb2e815e620 2024-09-19T05:46:53.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2ecc3a640 1 --2- 172.21.15.67:0/1290662680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e815e620 0x7fb2e80d2a40 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fb2e806d960 tx=0x7fb2d801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd20ef1c85ee89d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:53.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2e77fe640 1 -- 172.21.15.67:0/1290662680 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80b5070 con 0x7fb2e815e620 2024-09-19T05:46:53.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2e77fe640 1 -- 172.21.15.67:0/1290662680 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d80a8990 con 0x7fb2e815e620 2024-09-19T05:46:53.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2e77fe640 1 -- 172.21.15.67:0/1290662680 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80a8d60 con 0x7fb2e815e620 2024-09-19T05:46:53.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 -- 172.21.15.67:0/1290662680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e815e620 msgr2=0x7fb2e80d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 --2- 172.21.15.67:0/1290662680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e815e620 0x7fb2e80d2a40 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fb2e806d960 tx=0x7fb2d801ec90 comp rx=0 tx=0).stop 2024-09-19T05:46:53.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 -- 172.21.15.67:0/1290662680 shutdown_connections 2024-09-19T05:46:53.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 --2- 172.21.15.67:0/1290662680 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2e80d5100 0x7fb2e80d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 --2- 172.21.15.67:0/1290662680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e815e620 0x7fb2e80d2a40 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 -- 172.21.15.67:0/1290662680 >> 172.21.15.67:0/1290662680 conn(0x7fb2e808bfc0 msgr2=0x7fb2e80d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:53.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 -- 172.21.15.67:0/1290662680 shutdown_connections 2024-09-19T05:46:53.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 -- 172.21.15.67:0/1290662680 wait complete. 2024-09-19T05:46:53.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 Processor -- start 2024-09-19T05:46:53.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 -- start start 2024-09-19T05:46:53.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e80d13e0 0x7fb2e80b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:53.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2e80d5100 0x7fb2e81534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:53.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2e81539e0 0x7fb2e80cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:53.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.216+0000 7fb2eee9e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e806d470 con 0x7fb2e80d13e0 2024-09-19T05:46:53.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2eee9e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e806d190 con 0x7fb2e81539e0 2024-09-19T05:46:53.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2eee9e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e806ec80 con 0x7fb2e80d5100 2024-09-19T05:46:53.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2ecc3a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e80d13e0 0x7fb2e80b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:53.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2ecc3a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e80d13e0 0x7fb2e80b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53342/0 (socket says 172.21.15.67:53342) 2024-09-19T05:46:53.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2ecc3a640 1 -- 172.21.15.67:0/786101791 learned_addr learned my addr 172.21.15.67:0/786101791 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:53.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2ecc3a640 1 -- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2e80d5100 msgr2=0x7fb2e81534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2ecc3a640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2e80d5100 0x7fb2e81534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2ecc3a640 1 -- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2e81539e0 msgr2=0x7fb2e80cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2ecc3a640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2e81539e0 0x7fb2e80cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2ecc3a640 1 -- 172.21.15.67:0/786101791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e8153e90 con 0x7fb2e80d13e0 2024-09-19T05:46:53.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2ecc3a640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e80d13e0 0x7fb2e80b7540 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80b3040 tx=0x7fb2d801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:53.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2e57fa640 1 -- 172.21.15.67:0/786101791 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80bf070 con 0x7fb2e80d13e0 2024-09-19T05:46:53.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2e57fa640 1 -- 172.21.15.67:0/786101791 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d80b06e0 con 0x7fb2e80d13e0 2024-09-19T05:46:53.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2eee9e640 1 -- 172.21.15.67:0/786101791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e80b9010 con 0x7fb2e80d13e0 2024-09-19T05:46:53.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2e57fa640 1 -- 172.21.15.67:0/786101791 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80b5040 con 0x7fb2e80d13e0 2024-09-19T05:46:53.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2eee9e640 1 -- 172.21.15.67:0/786101791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e80b95d0 con 0x7fb2e80d13e0 2024-09-19T05:46:53.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2eee9e640 1 -- 172.21.15.67:0/786101791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e80d0ea0 con 0x7fb2e80d13e0 2024-09-19T05:46:53.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2e57fa640 1 -- 172.21.15.67:0/786101791 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb2d80c2070 con 0x7fb2e80d13e0 2024-09-19T05:46:53.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2e57fa640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2d40678c0 0x7fb2d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:53.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2e57fa640 1 -- 172.21.15.67:0/786101791 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5249+0+0 (secure 0 0 0) 0x7fb2d8122110 con 0x7fb2e80d13e0 2024-09-19T05:46:53.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2e7fff640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2d40678c0 0x7fb2d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:53.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.220+0000 7fb2e7fff640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2d40678c0 0x7fb2d4069d80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb2e815dbb0 tx=0x7fb2dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:53.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.224+0000 7fb2e57fa640 1 -- 172.21.15.67:0/786101791 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb2d80187f0 con 0x7fb2e80d13e0 2024-09-19T05:46:53.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:53.388+0000 7fb2eee9e640 1 -- 172.21.15.67:0/786101791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb2e815bb50 con 0x7fb2e80d13e0 2024-09-19T05:46:54.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.336+0000 7fb2e57fa640 1 -- 172.21.15.67:0/786101791 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v176) ==== 138+0+0 (secure 0 0 0) 0x7fb2d80f2ea0 con 0x7fb2e80d13e0 2024-09-19T05:46:54.337 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:46:54.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 -- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2d40678c0 msgr2=0x7fb2d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2d40678c0 0x7fb2d4069d80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb2e815dbb0 tx=0x7fb2dc008040 comp rx=0 tx=0).stop 2024-09-19T05:46:54.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 -- 172.21.15.67:0/786101791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e80d13e0 msgr2=0x7fb2e80b7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e80d13e0 0x7fb2e80b7540 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80b3040 tx=0x7fb2d801ba30 comp rx=0 tx=0).stop 2024-09-19T05:46:54.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 -- 172.21.15.67:0/786101791 shutdown_connections 2024-09-19T05:46:54.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2e81539e0 0x7fb2e80cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb2d40678c0 0x7fb2d4069d80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2e80d5100 0x7fb2e81534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 --2- 172.21.15.67:0/786101791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e80d13e0 0x7fb2e80b7540 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 -- 172.21.15.67:0/786101791 >> 172.21.15.67:0/786101791 conn(0x7fb2e808bfc0 msgr2=0x7fb2e80b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:54.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 -- 172.21.15.67:0/786101791 shutdown_connections 2024-09-19T05:46:54.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.340+0000 7fb2eee9e640 1 -- 172.21.15.67:0/786101791 wait complete. 2024-09-19T05:46:54.369 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:46:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.500+0000 7f658404c640 1 Processor -- start 2024-09-19T05:46:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.500+0000 7f658404c640 1 -- start start 2024-09-19T05:46:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f658404c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f657c15cf10 0x7f657c0b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f658404c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f657c0b09d0 0x7f657c0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f658404c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657c0ae720 con 0x7f657c0735b0 2024-09-19T05:46:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f658404c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f657c0aea00 con 0x7f657c15cf10 2024-09-19T05:46:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f658404c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f657c0b3f70 con 0x7f657c0b09d0 2024-09-19T05:46:54.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f6581de8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f657c15cf10 0x7f657c0b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f65815e7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f657c0b09d0 0x7f657c0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f65825e9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f657c0735b0 0x7f657c15d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:55358/0 (socket says 172.21.15.67:55358) 2024-09-19T05:46:54.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f65825e9640 1 -- 172.21.15.67:0/3510425446 learned_addr learned my addr 172.21.15.67:0/3510425446 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:54.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f6581de8640 1 -- 172.21.15.67:0/3510425446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f657c0b09d0 msgr2=0x7f657c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:54.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f6581de8640 1 --2- 172.21.15.67:0/3510425446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f657c0b09d0 0x7f657c0b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f6581de8640 1 -- 172.21.15.67:0/3510425446 >> v1:172.21.15.97:6789/0 conn(0x7f657c0735b0 legacy=0x7f657c15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f6581de8640 1 -- 172.21.15.67:0/3510425446 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657c0aedf0 con 0x7f657c15cf10 2024-09-19T05:46:54.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f6581de8640 1 --2- 172.21.15.67:0/3510425446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f657c15cf10 0x7f657c0b3a30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f65740097c0 tx=0x7f657401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3446e0cb6185d63f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:54.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f6580de6640 1 -- 172.21.15.67:0/3510425446 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740b2070 con 0x7f657c15cf10 2024-09-19T05:46:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f6580de6640 1 -- 172.21.15.67:0/3510425446 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65740a9070 con 0x7f657c15cf10 2024-09-19T05:46:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.504+0000 7f6580de6640 1 -- 172.21.15.67:0/3510425446 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740ad880 con 0x7f657c15cf10 2024-09-19T05:46:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 -- 172.21.15.67:0/3510425446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f657c15cf10 msgr2=0x7f657c0b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 --2- 172.21.15.67:0/3510425446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f657c15cf10 0x7f657c0b3a30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f65740097c0 tx=0x7f657401c470 comp rx=0 tx=0).stop 2024-09-19T05:46:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 -- 172.21.15.67:0/3510425446 shutdown_connections 2024-09-19T05:46:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 --2- 172.21.15.67:0/3510425446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f657c0b09d0 0x7f657c0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 --2- 172.21.15.67:0/3510425446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f657c15cf10 0x7f657c0b3a30 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 -- 172.21.15.67:0/3510425446 >> 172.21.15.67:0/3510425446 conn(0x7f657c0b6a80 msgr2=0x7f657c0b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 -- 172.21.15.67:0/3510425446 shutdown_connections 2024-09-19T05:46:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 -- 172.21.15.67:0/3510425446 wait complete. 2024-09-19T05:46:54.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 Processor -- start 2024-09-19T05:46:54.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 -- start start 2024-09-19T05:46:54.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f657c0735b0 0x7f657c14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c0b09d0 0x7f657c151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f657c15cf10 0x7f657c151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f657c168fa0 con 0x7f657c0b09d0 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f657c0ae4c0 con 0x7f657c0735b0 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f658404c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f657c169120 con 0x7f657c15cf10 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f65815e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c0b09d0 0x7f657c151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f65815e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c0b09d0 0x7f657c151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53358/0 (socket says 172.21.15.67:53358) 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f65815e7640 1 -- 172.21.15.67:0/1787551183 learned_addr learned my addr 172.21.15.67:0/1787551183 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f6581de8640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f657c0735b0 0x7f657c14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.508+0000 7f65825e9640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f657c15cf10 0x7f657c151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f65815e7640 1 -- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f657c15cf10 msgr2=0x7f657c151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f65815e7640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f657c15cf10 0x7f657c151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f65815e7640 1 -- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f657c0735b0 msgr2=0x7f657c14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f65815e7640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f657c0735b0 0x7f657c14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f65815e7640 1 -- 172.21.15.67:0/1787551183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657c157880 con 0x7f657c0b09d0 2024-09-19T05:46:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f65815e7640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c0b09d0 0x7f657c151650 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f657000e930 tx=0x7f657000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f657a7fc640 1 -- 172.21.15.67:0/1787551183 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570017070 con 0x7f657c0b09d0 2024-09-19T05:46:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f657a7fc640 1 -- 172.21.15.67:0/1787551183 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657000ca00 con 0x7f657c0b09d0 2024-09-19T05:46:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f657a7fc640 1 -- 172.21.15.67:0/1787551183 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657000cdb0 con 0x7f657c0b09d0 2024-09-19T05:46:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f658404c640 1 -- 172.21.15.67:0/1787551183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657c157b60 con 0x7f657c0b09d0 2024-09-19T05:46:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f658404c640 1 -- 172.21.15.67:0/1787551183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657c158120 con 0x7f657c0b09d0 2024-09-19T05:46:54.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f658404c640 1 -- 172.21.15.67:0/1787551183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f657c0b1fc0 con 0x7f657c0b09d0 2024-09-19T05:46:54.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f657a7fc640 1 -- 172.21.15.67:0/1787551183 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f657001a070 con 0x7f657c0b09d0 2024-09-19T05:46:54.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f657a7fc640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65680678f0 0x7f6568069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f657a7fc640 1 -- 172.21.15.67:0/1787551183 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5619+0+0 (secure 0 0 0) 0x7f6570085fa0 con 0x7f657c0b09d0 2024-09-19T05:46:54.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f6581de8640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65680678f0 0x7f6568069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.512+0000 7f6581de8640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65680678f0 0x7f6568069db0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f65740af000 tx=0x7f6574008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:54.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.516+0000 7f657a7fc640 1 -- 172.21.15.67:0/1787551183 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f65700565a0 con 0x7f657c0b09d0 2024-09-19T05:46:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:54.676+0000 7f658404c640 1 -- 172.21.15.67:0/1787551183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f657c0b1bc0 con 0x7f657c0b09d0 2024-09-19T05:46:55.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.340+0000 7f657a7fc640 1 -- 172.21.15.67:0/1787551183 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v177) ==== 170+0+0 (secure 0 0 0) 0x7f657005a8a0 con 0x7f657c0b09d0 2024-09-19T05:46:55.341 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:46:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 -- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65680678f0 msgr2=0x7f6568069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65680678f0 0x7f6568069db0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f65740af000 tx=0x7f6574008040 comp rx=0 tx=0).stop 2024-09-19T05:46:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 -- 172.21.15.67:0/1787551183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c0b09d0 msgr2=0x7f657c151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c0b09d0 0x7f657c151650 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f657000e930 tx=0x7f657000edf0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 -- 172.21.15.67:0/1787551183 shutdown_connections 2024-09-19T05:46:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65680678f0 0x7f6568069db0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f657c15cf10 0x7f657c151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c0b09d0 0x7f657c151650 secure :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f657000e930 tx=0x7f657000edf0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 --2- 172.21.15.67:0/1787551183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f657c0735b0 0x7f657c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 -- 172.21.15.67:0/1787551183 >> 172.21.15.67:0/1787551183 conn(0x7f657c0b6a80 msgr2=0x7f657c15b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:55.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 -- 172.21.15.67:0/1787551183 shutdown_connections 2024-09-19T05:46:55.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.344+0000 7f658404c640 1 -- 172.21.15.67:0/1787551183 wait complete. 2024-09-19T05:46:55.394 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:46:55.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f6677b90640 1 Processor -- start 2024-09-19T05:46:55.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f6677b90640 1 -- start start 2024-09-19T05:46:55.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f6677b90640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66700b3940 0x7f6670072970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f6677b90640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66700ad9e0 0x7f667006f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f6677b90640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f667006eaa0 con 0x7f6670072eb0 2024-09-19T05:46:55.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f6677b90640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f667006e850 con 0x7f66700b3940 2024-09-19T05:46:55.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f6677b90640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f667006f3d0 con 0x7f66700ad9e0 2024-09-19T05:46:55.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f667592c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66700b3940 0x7f6670072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f667592c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66700b3940 0x7f6670072970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53366/0 (socket says 172.21.15.67:53366) 2024-09-19T05:46:55.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f667592c640 1 -- 172.21.15.67:0/3229918001 learned_addr learned my addr 172.21.15.67:0/3229918001 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:55.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f667612d640 1 --2- 172.21.15.67:0/3229918001 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66700ad9e0 0x7f667006f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f667592c640 1 -- 172.21.15.67:0/3229918001 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66700ad9e0 msgr2=0x7f667006f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:55.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f667592c640 1 --2- 172.21.15.67:0/3229918001 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66700ad9e0 0x7f667006f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f667592c640 1 -- 172.21.15.67:0/3229918001 >> v1:172.21.15.97:6789/0 conn(0x7f6670072eb0 legacy=0x7f66700ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:55.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.524+0000 7f667592c640 1 -- 172.21.15.67:0/3229918001 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667006ed80 con 0x7f66700b3940 2024-09-19T05:46:55.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f667592c640 1 --2- 172.21.15.67:0/3229918001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66700b3940 0x7f6670072970 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f666800d150 tx=0x7f666801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e46d1b31dc7e982 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:55.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f667492a640 1 -- 172.21.15.67:0/3229918001 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666800b2d0 con 0x7f66700b3940 2024-09-19T05:46:55.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f667492a640 1 -- 172.21.15.67:0/3229918001 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f666800b470 con 0x7f66700b3940 2024-09-19T05:46:55.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f667492a640 1 -- 172.21.15.67:0/3229918001 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66680a7a20 con 0x7f66700b3940 2024-09-19T05:46:55.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f6677b90640 1 -- 172.21.15.67:0/3229918001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66700b3940 msgr2=0x7f6670072970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f6677b90640 1 --2- 172.21.15.67:0/3229918001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66700b3940 0x7f6670072970 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f666800d150 tx=0x7f666801ebf0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f6677b90640 1 -- 172.21.15.67:0/3229918001 shutdown_connections 2024-09-19T05:46:55.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f6677b90640 1 --2- 172.21.15.67:0/3229918001 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66700ad9e0 0x7f667006f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f6677b90640 1 --2- 172.21.15.67:0/3229918001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66700b3940 0x7f6670072970 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f6677b90640 1 -- 172.21.15.67:0/3229918001 >> 172.21.15.67:0/3229918001 conn(0x7f66700b1e50 msgr2=0x7f66700b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:55.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f6677b90640 1 -- 172.21.15.67:0/3229918001 shutdown_connections 2024-09-19T05:46:55.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f6677b90640 1 -- 172.21.15.67:0/3229918001 wait complete. 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f6677b90640 1 Processor -- start 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.528+0000 7f6677b90640 1 -- start start 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f6677b90640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6670072eb0 0x7f667014a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f6677b90640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66700b3940 0x7f6670153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f6677b90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66701540f0 0x7f6670159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f6677b90640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66700b40f0 con 0x7f66701540f0 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f6677b90640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f66700b3f70 con 0x7f6670072eb0 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f6677b90640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f66700b4270 con 0x7f66700b3940 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667612d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66701540f0 0x7f6670159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667612d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66701540f0 0x7f6670159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53378/0 (socket says 172.21.15.67:53378) 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667612d640 1 -- 172.21.15.67:0/3215822647 learned_addr learned my addr 172.21.15.67:0/3215822647 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667512b640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66700b3940 0x7f6670153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667592c640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6670072eb0 0x7f667014a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667612d640 1 -- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66700b3940 msgr2=0x7f6670153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667612d640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66700b3940 0x7f6670153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667612d640 1 -- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6670072eb0 msgr2=0x7f667014a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667612d640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6670072eb0 0x7f667014a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667612d640 1 -- 172.21.15.67:0/3215822647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6670154770 con 0x7f66701540f0 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f667612d640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66701540f0 0x7f6670159430 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f666c00d5d0 tx=0x7f666c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f66667fc640 1 -- 172.21.15.67:0/3215822647 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0125f0 con 0x7f66701540f0 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f66667fc640 1 -- 172.21.15.67:0/3215822647 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f666c019070 con 0x7f66701540f0 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f6677b90640 1 -- 172.21.15.67:0/3215822647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6670154a50 con 0x7f66701540f0 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f66667fc640 1 -- 172.21.15.67:0/3215822647 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0129f0 con 0x7f66701540f0 2024-09-19T05:46:55.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f6677b90640 1 -- 172.21.15.67:0/3215822647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f667014a6b0 con 0x7f66701540f0 2024-09-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f6677b90640 1 -- 172.21.15.67:0/3215822647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66700b4600 con 0x7f66701540f0 2024-09-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f66667fc640 1 -- 172.21.15.67:0/3215822647 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f666c012b90 con 0x7f66701540f0 2024-09-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f66667fc640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66540678c0 0x7f6654069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.532+0000 7f66667fc640 1 -- 172.21.15.67:0/3215822647 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6001+0+0 (secure 0 0 0) 0x7f666c086c10 con 0x7f66701540f0 2024-09-19T05:46:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.536+0000 7f667592c640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66540678c0 0x7f6654069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.536+0000 7f667592c640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66540678c0 0x7f6654069d80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f66680b0000 tx=0x7f66680a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:55.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.536+0000 7f66667fc640 1 -- 172.21.15.67:0/3215822647 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f666c057700 con 0x7f66701540f0 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:55.740+0000 7f6677b90640 1 -- 172.21.15.67:0/3215822647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6670072650 con 0x7f66701540f0 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.396+0000 7f66667fc640 1 -- 172.21.15.67:0/3215822647 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v124) ==== 174+0+0 (secure 0 0 0) 0x7f666c057000 con 0x7f66701540f0 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 25 and data pool 26 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 -- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66540678c0 msgr2=0x7f6654069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66540678c0 0x7f6654069d80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f66680b0000 tx=0x7f66680a9070 comp rx=0 tx=0).stop 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 -- 172.21.15.67:0/3215822647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66701540f0 msgr2=0x7f6670159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66701540f0 0x7f6670159430 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f666c00d5d0 tx=0x7f666c00da90 comp rx=0 tx=0).stop 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 -- 172.21.15.67:0/3215822647 shutdown_connections 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66701540f0 0x7f6670159430 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f66540678c0 0x7f6654069d80 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66700b3940 0x7f6670153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 --2- 172.21.15.67:0/3215822647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6670072eb0 0x7f667014a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 -- 172.21.15.67:0/3215822647 >> 172.21.15.67:0/3215822647 conn(0x7f66700b1e50 msgr2=0x7f66700b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 -- 172.21.15.67:0/3215822647 shutdown_connections 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.416+0000 7f6677b90640 1 -- 172.21.15.67:0/3215822647 wait complete. 2024-09-19T05:46:56.442 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.556+0000 7ff2f0b28640 1 Processor -- start 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.556+0000 7ff2f0b28640 1 -- start start 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2f0b28640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff2ec0b4900 0x7ff2ec071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2f0b28640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff2ec0723c0 0x7ff2ec072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2f0b28640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2ec0b3860 con 0x7ff2ec15b1e0 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2f0b28640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ec15b5c0 con 0x7ff2ec0723c0 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2f0b28640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ec0b3b40 con 0x7ff2ec0b4900 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2ead9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff2ec0723c0 0x7ff2ec072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2ea59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff2ec15b1e0 0x7ff2ec0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46884/0 (socket says 172.21.15.67:46884) 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2ea59c640 1 -- 172.21.15.67:0/961597708 learned_addr learned my addr 172.21.15.67:0/961597708 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2e9d9b640 1 --2- 172.21.15.67:0/961597708 >> v2:172.21.15.97:3300/0 conn(0x7ff2ec0b4900 0x7ff2ec071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2ead9d640 1 -- 172.21.15.67:0/961597708 >> v2:172.21.15.97:3300/0 conn(0x7ff2ec0b4900 msgr2=0x7ff2ec071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2ead9d640 1 --2- 172.21.15.67:0/961597708 >> v2:172.21.15.97:3300/0 conn(0x7ff2ec0b4900 0x7ff2ec071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2ead9d640 1 -- 172.21.15.67:0/961597708 >> v1:172.21.15.67:6789/0 conn(0x7ff2ec15b1e0 legacy=0x7ff2ec0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2ead9d640 1 -- 172.21.15.67:0/961597708 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec0b3e20 con 0x7ff2ec0723c0 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2ead9d640 1 --2- 172.21.15.67:0/961597708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 0x7ff2ec072850 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0ad2e0 tx=0x7ff2e401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cf8dcb2190ea16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2e959a640 1 -- 172.21.15.67:0/961597708 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40b2070 con 0x7ff2ec0723c0 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2e959a640 1 -- 172.21.15.67:0/961597708 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e40a58e0 con 0x7ff2ec0723c0 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.560+0000 7ff2e959a640 1 -- 172.21.15.67:0/961597708 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40a5cb0 con 0x7ff2ec0723c0 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- 172.21.15.67:0/961597708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 msgr2=0x7ff2ec072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 --2- 172.21.15.67:0/961597708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 0x7ff2ec072850 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0ad2e0 tx=0x7ff2e401c900 comp rx=0 tx=0).stop 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- 172.21.15.67:0/961597708 shutdown_connections 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 --2- 172.21.15.67:0/961597708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 0x7ff2ec072850 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 --2- 172.21.15.67:0/961597708 >> v2:172.21.15.97:3300/0 conn(0x7ff2ec0b4900 0x7ff2ec071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- 172.21.15.67:0/961597708 >> 172.21.15.67:0/961597708 conn(0x7ff2ec0d0080 msgr2=0x7ff2ec0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- 172.21.15.67:0/961597708 shutdown_connections 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- 172.21.15.67:0/961597708 wait complete. 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 Processor -- start 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- start start 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 0x7ff2ec14afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2ec0b4900 0x7ff2ec15b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec15b1e0 0x7ff2ec15f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec0ae9b0 con 0x7ff2ec0723c0 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec0ae830 con 0x7ff2ec15b1e0 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ec0aeb30 con 0x7ff2ec0b4900 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2ea59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 0x7ff2ec14afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2ea59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 0x7ff2ec14afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43646/0 (socket says 172.21.15.67:43646) 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2ea59c640 1 -- 172.21.15.67:0/996721977 learned_addr learned my addr 172.21.15.67:0/996721977 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2e9d9b640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2ec0b4900 0x7ff2ec15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2ead9d640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec15b1e0 0x7ff2ec15f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2ea59c640 1 -- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2ec0b4900 msgr2=0x7ff2ec15b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2ea59c640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2ec0b4900 0x7ff2ec15b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2ea59c640 1 -- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec15b1e0 msgr2=0x7ff2ec15f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2ea59c640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec15b1e0 0x7ff2ec15f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2ea59c640 1 -- 172.21.15.67:0/996721977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec15da20 con 0x7ff2ec0723c0 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2e9d9b640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2ec0b4900 0x7ff2ec15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2ea59c640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 0x7ff2ec14afb0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c420 tx=0x7ff2dc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2daffd640 1 -- 172.21.15.67:0/996721977 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc017070 con 0x7ff2ec0723c0 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2daffd640 1 -- 172.21.15.67:0/996721977 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2dc005cf0 con 0x7ff2ec0723c0 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- 172.21.15.67:0/996721977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec15dcc0 con 0x7ff2ec0723c0 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2daffd640 1 -- 172.21.15.67:0/996721977 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc0072f0 con 0x7ff2ec0723c0 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.564+0000 7ff2f0b28640 1 -- 172.21.15.67:0/996721977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec15e280 con 0x7ff2ec0723c0 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.568+0000 7ff2f0b28640 1 -- 172.21.15.67:0/996721977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ec15e480 con 0x7ff2ec0723c0 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.568+0000 7ff2daffd640 1 -- 172.21.15.67:0/996721977 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2dc01a070 con 0x7ff2ec0723c0 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.568+0000 7ff2daffd640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 0x7ff2cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.568+0000 7ff2daffd640 1 -- 172.21.15.67:0/996721977 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7ff2dc085110 con 0x7ff2ec0723c0 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.568+0000 7ff2e9d9b640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 0x7ff2cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.568+0000 7ff2e9d9b640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 0x7ff2cc069d80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec1faaa0 tx=0x7ff2e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.572+0000 7ff2daffd640 1 -- 172.21.15.67:0/996721977 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff2dc055b50 con 0x7ff2ec0723c0 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.736+0000 7ff2f0b28640 1 -- 172.21.15.67:0/996721977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2ec0b4e30 con 0x7ff2ec0723c0 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.736+0000 7ff2daffd640 1 -- 172.21.15.67:0/996721977 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) ==== 74+0+16925 (secure 0 0 0) 0x7ff2dc055450 con 0x7ff2ec0723c0 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":178,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:46:55.745316+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:46:53.433544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-19T05:46:54.721763+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 -- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 msgr2=0x7ff2cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 0x7ff2cc069d80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec1faaa0 tx=0x7ff2e0008040 comp rx=0 tx=0).stop 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 -- 172.21.15.67:0/996721977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 msgr2=0x7ff2ec14afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 0x7ff2ec14afb0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c420 tx=0x7ff2dc00c8e0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 -- 172.21.15.67:0/996721977 shutdown_connections 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec15b1e0 0x7ff2ec15f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 0x7ff2cc069d80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2ec0b4900 0x7ff2ec15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 --2- 172.21.15.67:0/996721977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ec0723c0 0x7ff2ec14afb0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 -- 172.21.15.67:0/996721977 >> 172.21.15.67:0/996721977 conn(0x7ff2ec0d0080 msgr2=0x7ff2ec156390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 -- 172.21.15.67:0/996721977 shutdown_connections 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.740+0000 7ff2f0b28640 1 -- 172.21.15.67:0/996721977 wait complete. 2024-09-19T05:46:56.757 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.872+0000 7f1b49bca640 1 Processor -- start 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.872+0000 7f1b49bca640 1 -- start start 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.872+0000 7f1b49bca640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b4415b1e0 0x7f1b440b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.872+0000 7f1b49bca640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b440b3860 con 0x7f1b440b4900 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.872+0000 7f1b49bca640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b440b3b40 con 0x7f1b44072590 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.872+0000 7f1b49bca640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4415b5c0 con 0x7f1b4415b1e0 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b42ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1b440b4900 0x7f1b44071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46900/0 (socket says 172.21.15.67:46900) 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b42ffd640 1 -- 172.21.15.67:0/3528666556 learned_addr learned my addr 172.21.15.67:0/3528666556 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b437fe640 1 --2- 172.21.15.67:0/3528666556 >> v2:172.21.15.97:3300/0 conn(0x7f1b4415b1e0 0x7f1b440b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50066677 0 0) 0x7f1b440b3860 con 0x7f1b440b4900 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b2c003530 con 0x7f1b440b4900 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812790604 0 0) 0x7f1b440b3b40 con 0x7f1b44072590 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b440b3860 con 0x7f1b44072590 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1057594039 0 0) 0x7f1b2c003530 con 0x7f1b440b4900 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 >> v2:172.21.15.97:3300/0 conn(0x7f1b4415b1e0 msgr2=0x7f1b440b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 --2- 172.21.15.67:0/3528666556 >> v2:172.21.15.97:3300/0 conn(0x7f1b4415b1e0 0x7f1b440b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 >> v1:172.21.15.97:6789/0 conn(0x7f1b44072590 legacy=0x7f1b440ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b440b3e20 con 0x7f1b440b4900 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f1b38001680 con 0x7f1b440b4900 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 >> v1:172.21.15.67:6789/0 conn(0x7f1b440b4900 legacy=0x7f1b44071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 --2- 172.21.15.67:0/3528666556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b2c003b50 0x7f1b2c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 --2- 172.21.15.67:0/3528666556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b2c004810 0x7f1b2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 --2- 172.21.15.67:0/3528666556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b2c0051d0 0x7f1b2c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4415b5c0 con 0x7f1b2c003b50 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c00e260 con 0x7f1b2c004810 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b2c00e460 con 0x7f1b2c0051d0 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b437fe640 1 --2- 172.21.15.67:0/3528666556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b2c003b50 0x7f1b2c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b42ffd640 1 --2- 172.21.15.67:0/3528666556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b2c004810 0x7f1b2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b437fe640 1 -- 172.21.15.67:0/3528666556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b2c0051d0 msgr2=0x7f1b2c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b437fe640 1 --2- 172.21.15.67:0/3528666556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b2c0051d0 0x7f1b2c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b437fe640 1 -- 172.21.15.67:0/3528666556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b2c004810 msgr2=0x7f1b2c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b437fe640 1 --2- 172.21.15.67:0/3528666556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b2c004810 0x7f1b2c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b437fe640 1 -- 172.21.15.67:0/3528666556 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2c003530 con 0x7f1b2c003b50 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b43fff640 1 -- 172.21.15.67:0/3528666556 reap_dead start 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b437fe640 1 --2- 172.21.15.67:0/3528666556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b2c003b50 0x7f1b2c003f50 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009ae0 tx=0x7f1b3401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467ed54ec7d22319 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b340b2070 con 0x7f1b2c003b50 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b340a5700 con 0x7f1b2c003b50 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b427fc640 1 -- 172.21.15.67:0/3528666556 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b340096b0 con 0x7f1b2c003b50 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b49bca640 1 -- 172.21.15.67:0/3528666556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b2c003b50 msgr2=0x7f1b2c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b49bca640 1 --2- 172.21.15.67:0/3528666556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b2c003b50 0x7f1b2c003f50 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009ae0 tx=0x7f1b3401ca80 comp rx=0 tx=0).stop 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.876+0000 7f1b49bca640 1 -- 172.21.15.67:0/3528666556 shutdown_connections 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 --2- 172.21.15.67:0/3528666556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b2c003b50 0x7f1b2c003f50 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 -- 172.21.15.67:0/3528666556 >> 172.21.15.67:0/3528666556 conn(0x7f1b440d0080 msgr2=0x7f1b440d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 -- 172.21.15.67:0/3528666556 shutdown_connections 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 -- 172.21.15.67:0/3528666556 wait complete. 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 Processor -- start 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 -- start start 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b2c003b50 0x7f1b441555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b440ce9f0 0x7f1b4414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4414ae00 0x7f1b4414c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b44072000 con 0x7f1b4414ae00 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b44071e80 con 0x7f1b440ce9f0 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b44072180 con 0x7f1b2c003b50 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4414ae00 0x7f1b4414c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4414ae00 0x7f1b4414c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43670/0 (socket says 172.21.15.67:43670) 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b43fff640 1 -- 172.21.15.67:0/2997085447 learned_addr learned my addr 172.21.15.67:0/2997085447 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b42ffd640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b440ce9f0 0x7f1b4414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b437fe640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b2c003b50 0x7f1b441555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b43fff640 1 -- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b2c003b50 msgr2=0x7f1b441555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b43fff640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b2c003b50 0x7f1b441555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b43fff640 1 -- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b440ce9f0 msgr2=0x7f1b4414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b43fff640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b440ce9f0 0x7f1b4414a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b43fff640 1 -- 172.21.15.67:0/2997085447 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4415fbb0 con 0x7f1b4414ae00 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b43fff640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4414ae00 0x7f1b4414c360 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f1b440717f0 tx=0x7f1b3c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b2bfff640 1 -- 172.21.15.67:0/2997085447 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c017070 con 0x7f1b4414ae00 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b2bfff640 1 -- 172.21.15.67:0/2997085447 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c005d70 con 0x7f1b4414ae00 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 -- 172.21.15.67:0/2997085447 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b441524d0 con 0x7f1b4414ae00 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b2bfff640 1 -- 172.21.15.67:0/2997085447 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c00a850 con 0x7f1b4414ae00 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 -- 172.21.15.67:0/2997085447 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4415c2d0 con 0x7f1b4414ae00 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.880+0000 7f1b49bca640 1 -- 172.21.15.67:0/2997085447 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b440b2fd0 con 0x7f1b4414ae00 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.884+0000 7f1b2bfff640 1 -- 172.21.15.67:0/2997085447 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b3c01a070 con 0x7f1b4414ae00 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.884+0000 7f1b2bfff640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b300678c0 0x7f1b30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.884+0000 7f1b2bfff640 1 -- 172.21.15.67:0/2997085447 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7f1b3c085430 con 0x7f1b4414ae00 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.884+0000 7f1b437fe640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b300678c0 0x7f1b30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.884+0000 7f1b437fe640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b300678c0 0x7f1b30069d80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1b340af000 tx=0x7f1b34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:56.888+0000 7f1b2bfff640 1 -- 172.21.15.67:0/2997085447 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1b3c021020 con 0x7f1b4414ae00 2024-09-19T05:46:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.052+0000 7f1b49bca640 1 -- 172.21.15.67:0/2997085447 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b440b4e30 con 0x7f1b4414ae00 2024-09-19T05:46:57.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.052+0000 7f1b2bfff640 1 -- 172.21.15.67:0/2997085447 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) ==== 74+0+16925 (secure 0 0 0) 0x7f1b3c055f50 con 0x7f1b4414ae00 2024-09-19T05:46:57.055 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:57.055 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":178,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:46:55.745316+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:46:53.433544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-19T05:46:54.721763+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:46:57.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 -- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b300678c0 msgr2=0x7f1b30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:57.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b300678c0 0x7f1b30069d80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1b340af000 tx=0x7f1b34008040 comp rx=0 tx=0).stop 2024-09-19T05:46:57.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 -- 172.21.15.67:0/2997085447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4414ae00 msgr2=0x7f1b4414c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:57.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4414ae00 0x7f1b4414c360 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f1b440717f0 tx=0x7f1b3c00cb10 comp rx=0 tx=0).stop 2024-09-19T05:46:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 -- 172.21.15.67:0/2997085447 shutdown_connections 2024-09-19T05:46:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4414ae00 0x7f1b4414c360 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b440ce9f0 0x7f1b4414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b300678c0 0x7f1b30069d80 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 --2- 172.21.15.67:0/2997085447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b2c003b50 0x7f1b441555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 -- 172.21.15.67:0/2997085447 >> 172.21.15.67:0/2997085447 conn(0x7f1b440d0080 msgr2=0x7f1b44072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 -- 172.21.15.67:0/2997085447 shutdown_connections 2024-09-19T05:46:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.056+0000 7f1b49bca640 1 -- 172.21.15.67:0/2997085447 wait complete. 2024-09-19T05:46:57.074 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:46:57.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7c567e640 1 Processor -- start 2024-09-19T05:46:57.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7c567e640 1 -- start start 2024-09-19T05:46:57.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7c567e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb7c006dfc0 0x7fb7c006f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:57.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7c567e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c006fea0 0x7fb7c00b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:57.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7c567e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7c00aef30 con 0x7fb7c015b1d0 2024-09-19T05:46:57.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7c567e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb7c0072210 con 0x7fb7c006dfc0 2024-09-19T05:46:57.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7c567e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c00ae3b0 con 0x7fb7c006fea0 2024-09-19T05:46:57.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7beffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb7c015b1d0 0x7fb7c00adbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46910/0 (socket says 172.21.15.67:46910) 2024-09-19T05:46:57.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7beffd640 1 -- 172.21.15.67:0/2199126858 learned_addr learned my addr 172.21.15.67:0/2199126858 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4206451164 0 0) 0x7fb7c00aef30 con 0x7fb7c015b1d0 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bf7fe640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c006fea0 0x7fb7c00b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a8005740 con 0x7fb7c015b1d0 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7be7fc640 1 --2- 172.21.15.67:0/2199126858 >> v2:172.21.15.97:3300/0 conn(0x7fb7c006dfc0 0x7fb7c006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3208533297 0 0) 0x7fb7a8005740 con 0x7fb7c015b1d0 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c006fea0 msgr2=0x7fb7c00b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c006fea0 0x7fb7c00b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 >> v2:172.21.15.97:3300/0 conn(0x7fb7c006dfc0 msgr2=0x7fb7c006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 --2- 172.21.15.67:0/2199126858 >> v2:172.21.15.97:3300/0 conn(0x7fb7c006dfc0 0x7fb7c006f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c00ae690 con 0x7fb7c015b1d0 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fb7b0001680 con 0x7fb7c015b1d0 2024-09-19T05:46:57.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 >> v1:172.21.15.67:6789/0 conn(0x7fb7c015b1d0 legacy=0x7fb7c00adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a8005bd0 0x7fb7a8005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a8006a20 0x7fb7a8006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c006fea0 0x7fb7a80073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c0072210 con 0x7fb7a8006a20 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c00ae3b0 con 0x7fb7a8005bd0 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a800dc10 con 0x7fb7c006fea0 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7be7fc640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a8006a20 0x7fb7a8006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7beffd640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a8005bd0 0x7fb7a8005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7bf7fe640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c006fea0 0x7fb7a80073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7be7fc640 1 -- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c006fea0 msgr2=0x7fb7a80073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7be7fc640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c006fea0 0x7fb7a80073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7be7fc640 1 -- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a8005bd0 msgr2=0x7fb7a8005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:57.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7be7fc640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a8005bd0 0x7fb7a8005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7be7fc640 1 -- 172.21.15.67:0/2199126858 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a8005740 con 0x7fb7a8006a20 2024-09-19T05:46:57.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.200+0000 7fb7beffd640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7a8005bd0 0x7fb7a8005ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7be7fc640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a8006a20 0x7fb7a8006ea0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7fb7b400ba30 tx=0x7fb7b401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94e060e5daaed24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b400b600 con 0x7fb7a8006a20 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b40b0070 con 0x7fb7a8006a20 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7bdffb640 1 -- 172.21.15.67:0/2199126858 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40ab650 con 0x7fb7a8006a20 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7c567e640 1 -- 172.21.15.67:0/2199126858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a8006a20 msgr2=0x7fb7a8006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7c567e640 1 --2- 172.21.15.67:0/2199126858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7a8006a20 0x7fb7a8006ea0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7fb7b400ba30 tx=0x7fb7b401c6e0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7bf7fe640 1 -- 172.21.15.67:0/2199126858 reap_dead start 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7c567e640 1 -- 172.21.15.67:0/2199126858 shutdown_connections 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7c567e640 1 -- 172.21.15.67:0/2199126858 >> 172.21.15.67:0/2199126858 conn(0x7fb7c00b1e50 msgr2=0x7fb7c00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7c567e640 1 -- 172.21.15.67:0/2199126858 shutdown_connections 2024-09-19T05:46:57.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7c567e640 1 -- 172.21.15.67:0/2199126858 wait complete. 2024-09-19T05:46:57.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7c567e640 1 Processor -- start 2024-09-19T05:46:57.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.204+0000 7fb7c567e640 1 -- start start 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7c567e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c014aea0 0x7fb7c00b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7c567e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7c014b560 0x7fb7c00b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7c567e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7c00cfff0 0x7fb7c00d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7c567e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c0072420 con 0x7fb7c014b560 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7c567e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c00aec50 con 0x7fb7c00cfff0 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7c567e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c006e850 con 0x7fb7c014aea0 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7be7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7c014b560 0x7fb7c00b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7be7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7c014b560 0x7fb7c00b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43690/0 (socket says 172.21.15.67:43690) 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7be7fc640 1 -- 172.21.15.67:0/1616542479 learned_addr learned my addr 172.21.15.67:0/1616542479 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7bf7fe640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7c00cfff0 0x7fb7c00d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7beffd640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c014aea0 0x7fb7c00b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:57.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7be7fc640 1 -- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c014aea0 msgr2=0x7fb7c00b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7be7fc640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c014aea0 0x7fb7c00b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7be7fc640 1 -- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7c00cfff0 msgr2=0x7fb7c00d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7be7fc640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7c00cfff0 0x7fb7c00d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7be7fc640 1 -- 172.21.15.67:0/1616542479 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c015b650 con 0x7fb7c014b560 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7beffd640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c014aea0 0x7fb7c00b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7be7fc640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7c014b560 0x7fb7c00b14e0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4000c10 tx=0x7fb7a8007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7a77fe640 1 -- 172.21.15.67:0/1616542479 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40ba070 con 0x7fb7c014b560 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7a77fe640 1 -- 172.21.15.67:0/1616542479 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b40b8070 con 0x7fb7c014b560 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7c567e640 1 -- 172.21.15.67:0/1616542479 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c0153e10 con 0x7fb7c014b560 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7a77fe640 1 -- 172.21.15.67:0/1616542479 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4004480 con 0x7fb7c014b560 2024-09-19T05:46:57.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7c567e640 1 -- 172.21.15.67:0/1616542479 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c014b280 con 0x7fb7c014b560 2024-09-19T05:46:57.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7c567e640 1 -- 172.21.15.67:0/1616542479 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c0068530 con 0x7fb7c014b560 2024-09-19T05:46:57.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7a77fe640 1 -- 172.21.15.67:0/1616542479 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7b4003620 con 0x7fb7c014b560 2024-09-19T05:46:57.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7a77fe640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7ac0678f0 0x7fb7ac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:57.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.208+0000 7fb7a77fe640 1 -- 172.21.15.67:0/1616542479 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6101+0+0 (secure 0 0 0) 0x7fb7b411feb0 con 0x7fb7c014b560 2024-09-19T05:46:57.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.212+0000 7fb7beffd640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7ac0678f0 0x7fb7ac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:57.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.212+0000 7fb7beffd640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7ac0678f0 0x7fb7ac069db0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0001210 tx=0x7fb7b0001660 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:57.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.216+0000 7fb7a77fe640 1 -- 172.21.15.67:0/1616542479 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb7b40163f0 con 0x7fb7c014b560 2024-09-19T05:46:57.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:57.412+0000 7fb7c567e640 1 -- 172.21.15.67:0/1616542479 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb7c00aef30 con 0x7fb7c014b560 2024-09-19T05:46:58.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.408+0000 7fb7a77fe640 1 -- 172.21.15.67:0/1616542479 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v127) ==== 118+0+0 (secure 0 0 0) 0x7fb7b40b3e60 con 0x7fb7c014b560 2024-09-19T05:46:58.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 -- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7ac0678f0 msgr2=0x7fb7ac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7ac0678f0 0x7fb7ac069db0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0001210 tx=0x7fb7b0001660 comp rx=0 tx=0).stop 2024-09-19T05:46:58.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 -- 172.21.15.67:0/1616542479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7c014b560 msgr2=0x7fb7c00b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7c014b560 0x7fb7c00b14e0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4000c10 tx=0x7fb7a8007a50 comp rx=0 tx=0).stop 2024-09-19T05:46:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 -- 172.21.15.67:0/1616542479 shutdown_connections 2024-09-19T05:46:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb7c00cfff0 0x7fb7c00d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7c014b560 0x7fb7c00b14e0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb7ac0678f0 0x7fb7ac069db0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 --2- 172.21.15.67:0/1616542479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7c014aea0 0x7fb7c00b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 -- 172.21.15.67:0/1616542479 >> 172.21.15.67:0/1616542479 conn(0x7fb7c00b1e50 msgr2=0x7fb7c00cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 -- 172.21.15.67:0/1616542479 shutdown_connections 2024-09-19T05:46:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.412+0000 7fb7c567e640 1 -- 172.21.15.67:0/1616542479 wait complete. 2024-09-19T05:46:58.435 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:46:58.435 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:46:58.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff364667640 1 Processor -- start 2024-09-19T05:46:58.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff364667640 1 -- start start 2024-09-19T05:46:58.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff364667640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 0x7ff35c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:58.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff364667640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff35c06fea0 0x7ff35c0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:58.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff364667640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35c0aef30 con 0x7ff35c15b1d0 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff364667640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff35c072210 con 0x7ff35c06fea0 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff364667640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff35c0ae3b0 con 0x7ff35c06dfc0 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff362c04640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff35c06fea0 0x7ff35c0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff362403640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff35c15b1d0 0x7ff35c0adbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46918/0 (socket says 172.21.15.67:46918) 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff362c04640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff35c06fea0 0x7ff35c0b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43692/0 (socket says 172.21.15.67:43692) 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff362403640 1 -- 172.21.15.67:0/1529042142 learned_addr learned my addr 172.21.15.67:0/1529042142 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff361c02640 1 --2- 172.21.15.67:0/1529042142 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 0x7ff35c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff362c04640 1 -- 172.21.15.67:0/1529042142 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 msgr2=0x7ff35c06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff362c04640 1 --2- 172.21.15.67:0/1529042142 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 0x7ff35c06f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff362c04640 1 -- 172.21.15.67:0/1529042142 >> v1:172.21.15.67:6789/0 conn(0x7ff35c15b1d0 legacy=0x7ff35c0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff362c04640 1 -- 172.21.15.67:0/1529042142 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c0ae690 con 0x7ff35c06fea0 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff361401640 1 -- 172.21.15.67:0/1529042142 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187760365 0 0) 0x7ff35c0aef30 con 0x7ff35c15b1d0 2024-09-19T05:46:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.568+0000 7ff361c02640 1 --2- 172.21.15.67:0/1529042142 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 0x7ff35c06f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:58.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362c04640 1 --2- 172.21.15.67:0/1529042142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c06fea0 0x7ff35c0b3430 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7ff354009dc0 tx=0x7ff35401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb28624bc3fd21bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:58.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff361401640 1 -- 172.21.15.67:0/1529042142 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3540b2070 con 0x7ff35c06fea0 2024-09-19T05:46:58.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff361401640 1 -- 172.21.15.67:0/1529042142 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3540a5810 con 0x7ff35c06fea0 2024-09-19T05:46:58.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff361401640 1 -- 172.21.15.67:0/1529042142 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3540a5be0 con 0x7ff35c06fea0 2024-09-19T05:46:58.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 -- 172.21.15.67:0/1529042142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c06fea0 msgr2=0x7ff35c0b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 --2- 172.21.15.67:0/1529042142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c06fea0 0x7ff35c0b3430 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7ff354009dc0 tx=0x7ff35401c950 comp rx=0 tx=0).stop 2024-09-19T05:46:58.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 -- 172.21.15.67:0/1529042142 shutdown_connections 2024-09-19T05:46:58.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 --2- 172.21.15.67:0/1529042142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c06fea0 0x7ff35c0b3430 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 --2- 172.21.15.67:0/1529042142 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 0x7ff35c06f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 -- 172.21.15.67:0/1529042142 >> 172.21.15.67:0/1529042142 conn(0x7ff35c0b1e50 msgr2=0x7ff35c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:58.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 -- 172.21.15.67:0/1529042142 shutdown_connections 2024-09-19T05:46:58.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 -- 172.21.15.67:0/1529042142 wait complete. 2024-09-19T05:46:58.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 Processor -- start 2024-09-19T05:46:58.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 -- start start 2024-09-19T05:46:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 0x7ff35c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff35c06fea0 0x7ff35c154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c15b1d0 0x7ff35c154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c0b4300 con 0x7ff35c15b1d0 2024-09-19T05:46:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c0b4180 con 0x7ff35c06fea0 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff364667640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff35c0b4480 con 0x7ff35c06dfc0 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362c04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c15b1d0 0x7ff35c154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362c04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c15b1d0 0x7ff35c154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43706/0 (socket says 172.21.15.67:43706) 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362c04640 1 -- 172.21.15.67:0/1669065604 learned_addr learned my addr 172.21.15.67:0/1669065604 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362403640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 0x7ff35c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362c04640 1 -- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 msgr2=0x7ff35c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff361c02640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff35c06fea0 0x7ff35c154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362c04640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 0x7ff35c152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362c04640 1 -- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff35c06fea0 msgr2=0x7ff35c154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362c04640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff35c06fea0 0x7ff35c154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362c04640 1 -- 172.21.15.67:0/1669065604 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c09a670 con 0x7ff35c15b1d0 2024-09-19T05:46:58.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.572+0000 7ff362c04640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c15b1d0 0x7ff35c154780 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7ff3540b0040 tx=0x7ff3540196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:58.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff352ffd640 1 -- 172.21.15.67:0/1669065604 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3540b2050 con 0x7ff35c15b1d0 2024-09-19T05:46:58.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff352ffd640 1 -- 172.21.15.67:0/1669065604 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3540b3040 con 0x7ff35c15b1d0 2024-09-19T05:46:58.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff352ffd640 1 -- 172.21.15.67:0/1669065604 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3540ad850 con 0x7ff35c15b1d0 2024-09-19T05:46:58.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff364667640 1 -- 172.21.15.67:0/1669065604 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35c09a950 con 0x7ff35c15b1d0 2024-09-19T05:46:58.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff364667640 1 -- 172.21.15.67:0/1669065604 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff35c09af10 con 0x7ff35c15b1d0 2024-09-19T05:46:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff364667640 1 -- 172.21.15.67:0/1669065604 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35c0b3430 con 0x7ff35c15b1d0 2024-09-19T05:46:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff352ffd640 1 -- 172.21.15.67:0/1669065604 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3540c0020 con 0x7ff35c15b1d0 2024-09-19T05:46:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff352ffd640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3400678c0 0x7ff340069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff352ffd640 1 -- 172.21.15.67:0/1669065604 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7ff354120810 con 0x7ff35c15b1d0 2024-09-19T05:46:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff362403640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3400678c0 0x7ff340069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.576+0000 7ff362403640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3400678c0 0x7ff340069d80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff358000f70 tx=0x7ff358009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:58.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.580+0000 7ff352ffd640 1 -- 172.21.15.67:0/1669065604 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff354016540 con 0x7ff35c15b1d0 2024-09-19T05:46:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:58.784+0000 7ff364667640 1 -- 172.21.15.67:0/1669065604 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff35c071fd0 con 0x7ff35c15b1d0 2024-09-19T05:46:59.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.416+0000 7ff352ffd640 1 -- 172.21.15.67:0/1669065604 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v128) ==== 122+0+0 (secure 0 0 0) 0x7ff3540abe20 con 0x7ff35c15b1d0 2024-09-19T05:46:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 -- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3400678c0 msgr2=0x7ff340069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3400678c0 0x7ff340069d80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff358000f70 tx=0x7ff358009040 comp rx=0 tx=0).stop 2024-09-19T05:46:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 -- 172.21.15.67:0/1669065604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c15b1d0 msgr2=0x7ff35c154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c15b1d0 0x7ff35c154780 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7ff3540b0040 tx=0x7ff3540196f0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 -- 172.21.15.67:0/1669065604 shutdown_connections 2024-09-19T05:46:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff35c15b1d0 0x7ff35c154780 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff35c06fea0 0x7ff35c154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3400678c0 0x7ff340069d80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 --2- 172.21.15.67:0/1669065604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff35c06dfc0 0x7ff35c152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 -- 172.21.15.67:0/1669065604 >> 172.21.15.67:0/1669065604 conn(0x7ff35c0b1e50 msgr2=0x7ff35c0af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 -- 172.21.15.67:0/1669065604 shutdown_connections 2024-09-19T05:46:59.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.420+0000 7ff364667640 1 -- 172.21.15.67:0/1669065604 wait complete. 2024-09-19T05:46:59.441 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:46:59.441 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:46:59.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.568+0000 7f8e7ad27640 1 Processor -- start 2024-09-19T05:46:59.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e7ad27640 1 -- start start 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e7ad27640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 0x7f8e740d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e7ad27640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8e740d0e80 0x7f8e740d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e7ad27640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8e740b41c0 0x7f8e740b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e7ad27640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8e740d0840 con 0x7f8e740b41c0 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e7ad27640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8e740d1800 con 0x7f8e740d0e80 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e7ad27640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8e740d4d40 con 0x7f8e74161da0 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e792c4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8e740b41c0 0x7f8e740b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e792c4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8e740b41c0 0x7f8e740b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43712/0 (socket says 172.21.15.67:43712) 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e792c4640 1 -- 172.21.15.67:0/1973316149 learned_addr learned my addr 172.21.15.67:0/1973316149 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e78ac3640 1 --2- 172.21.15.67:0/1973316149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 0x7f8e740d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e73fff640 1 --2- 172.21.15.67:0/1973316149 >> v2:172.21.15.97:3300/0 conn(0x7f8e740d0e80 0x7f8e740d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e792c4640 1 -- 172.21.15.67:0/1973316149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 msgr2=0x7f8e740d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e792c4640 1 --2- 172.21.15.67:0/1973316149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 0x7f8e740d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e792c4640 1 -- 172.21.15.67:0/1973316149 >> v2:172.21.15.97:3300/0 conn(0x7f8e740d0e80 msgr2=0x7f8e740d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e792c4640 1 --2- 172.21.15.67:0/1973316149 >> v2:172.21.15.97:3300/0 conn(0x7f8e740d0e80 0x7f8e740d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e792c4640 1 -- 172.21.15.67:0/1973316149 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e740d5020 con 0x7f8e740b41c0 2024-09-19T05:46:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e78ac3640 1 --2- 172.21.15.67:0/1973316149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 0x7f8e740d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e792c4640 1 --2- 172.21.15.67:0/1973316149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 0x7f8e740b4670 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f8e7408d460 tx=0x7f8e6c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c682ad30407bf60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.572+0000 7f8e737fe640 1 -- 172.21.15.67:0/1973316149 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0a5760 con 0x7f8e740b41c0 2024-09-19T05:46:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e737fe640 1 -- 172.21.15.67:0/1973316149 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6c0a5900 con 0x7f8e740b41c0 2024-09-19T05:46:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e737fe640 1 -- 172.21.15.67:0/1973316149 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0a5cd0 con 0x7f8e740b41c0 2024-09-19T05:46:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 -- 172.21.15.67:0/1973316149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 msgr2=0x7f8e740b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 --2- 172.21.15.67:0/1973316149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 0x7f8e740b4670 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f8e7408d460 tx=0x7f8e6c01c9f0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 -- 172.21.15.67:0/1973316149 shutdown_connections 2024-09-19T05:46:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 --2- 172.21.15.67:0/1973316149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 0x7f8e740b4670 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 --2- 172.21.15.67:0/1973316149 >> v2:172.21.15.97:3300/0 conn(0x7f8e740d0e80 0x7f8e740d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 --2- 172.21.15.67:0/1973316149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 0x7f8e740d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 -- 172.21.15.67:0/1973316149 >> 172.21.15.67:0/1973316149 conn(0x7f8e7408bfc0 msgr2=0x7f8e740d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 -- 172.21.15.67:0/1973316149 shutdown_connections 2024-09-19T05:46:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 -- 172.21.15.67:0/1973316149 wait complete. 2024-09-19T05:46:59.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 Processor -- start 2024-09-19T05:46:59.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 -- start start 2024-09-19T05:46:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 0x7f8e74155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0e80 0x7f8e740b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 0x7f8e740b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e740cf150 con 0x7f8e740b41c0 2024-09-19T05:46:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74162180 con 0x7f8e740d0e80 2024-09-19T05:46:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e7ad27640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8e740cf2d0 con 0x7f8e74161da0 2024-09-19T05:46:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e78ac3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 0x7f8e74155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e78ac3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 0x7f8e74155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43714/0 (socket says 172.21.15.67:43714) 2024-09-19T05:46:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e78ac3640 1 -- 172.21.15.67:0/2724233211 learned_addr learned my addr 172.21.15.67:0/2724233211 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e792c4640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 0x7f8e740b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e78ac3640 1 -- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 msgr2=0x7f8e740b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e78ac3640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 0x7f8e740b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e73fff640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0e80 0x7f8e740b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e78ac3640 1 -- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0e80 msgr2=0x7f8e740b91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e78ac3640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0e80 0x7f8e740b91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.576+0000 7f8e78ac3640 1 -- 172.21.15.67:0/2724233211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e740cb7b0 con 0x7f8e740b41c0 2024-09-19T05:46:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e78ac3640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 0x7f8e74155570 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400c7f0 tx=0x7f8e6400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e717fa640 1 -- 172.21.15.67:0/2724233211 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64015070 con 0x7f8e740b41c0 2024-09-19T05:46:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e717fa640 1 -- 172.21.15.67:0/2724233211 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e64007820 con 0x7f8e740b41c0 2024-09-19T05:46:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e717fa640 1 -- 172.21.15.67:0/2724233211 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64007c10 con 0x7f8e740b41c0 2024-09-19T05:46:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e7ad27640 1 -- 172.21.15.67:0/2724233211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e740cba90 con 0x7f8e740b41c0 2024-09-19T05:46:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e7ad27640 1 -- 172.21.15.67:0/2724233211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e740cc050 con 0x7f8e740b41c0 2024-09-19T05:46:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e7ad27640 1 -- 172.21.15.67:0/2724233211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e740b4670 con 0x7f8e740b41c0 2024-09-19T05:46:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e717fa640 1 -- 172.21.15.67:0/2724233211 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e64018070 con 0x7f8e740b41c0 2024-09-19T05:46:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e717fa640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e600678c0 0x7f8e60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e717fa640 1 -- 172.21.15.67:0/2724233211 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f8e64085fc0 con 0x7f8e740b41c0 2024-09-19T05:46:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e73fff640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e600678c0 0x7f8e60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.580+0000 7f8e73fff640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e600678c0 0x7f8e60069d80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8e740ce530 tx=0x7f8e68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:59.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.584+0000 7f8e717fa640 1 -- 172.21.15.67:0/2724233211 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8e64056970 con 0x7f8e740b41c0 2024-09-19T05:46:59.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.780+0000 7f8e7ad27640 1 -- 172.21.15.67:0/2724233211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e74155ab0 con 0x7f8e740b41c0 2024-09-19T05:46:59.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.780+0000 7f8e717fa640 1 -- 172.21.15.67:0/2724233211 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) ==== 95+0+5236 (secure 0 0 0) 0x7f8e64056270 con 0x7f8e740b41c0 2024-09-19T05:46:59.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:46:59.782 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":128,"btime":"2024-09-19T05:46:59:414107+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6974,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2737632366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737632366},{"type":"v1","addr":"172.21.15.97:6835","nonce":2737632366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3498582105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3498582105},{"type":"v1","addr":"172.21.15.97:6837","nonce":3498582105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":10026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/558917076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":558917076},{"type":"v1","addr":"172.21.15.67:6833","nonce":558917076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:46:55.745812+0000","modified":"2024-09-19T05:46:58.790051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10032":{"gid":10032,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2190010946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2190010946},{"type":"v1","addr":"172.21.15.67:6835","nonce":2190010946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10032,"qdb_cluster":[10032]},"id":12}]} 2024-09-19T05:46:59.782 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 128 2024-09-19T05:46:59.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 -- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e600678c0 msgr2=0x7f8e60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e600678c0 0x7f8e60069d80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8e740ce530 tx=0x7f8e68008040 comp rx=0 tx=0).stop 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 -- 172.21.15.67:0/2724233211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 msgr2=0x7f8e74155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 0x7f8e74155570 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400c7f0 tx=0x7f8e6400ccb0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 -- 172.21.15.67:0/2724233211 shutdown_connections 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e600678c0 0x7f8e60069d80 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e74161da0 0x7f8e740b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0e80 0x7f8e740b91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 --2- 172.21.15.67:0/2724233211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e740b41c0 0x7f8e74155570 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 -- 172.21.15.67:0/2724233211 >> 172.21.15.67:0/2724233211 conn(0x7f8e7408bfc0 msgr2=0x7f8e7415c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 -- 172.21.15.67:0/2724233211 shutdown_connections 2024-09-19T05:46:59.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.784+0000 7f8e7ad27640 1 -- 172.21.15.67:0/2724233211 wait complete. 2024-09-19T05:46:59.800 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:46:59.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1de761640 1 Processor -- start 2024-09-19T05:46:59.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1de761640 1 -- start start 2024-09-19T05:46:59.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1de761640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1d80c8c40 0x7fe1d80705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1de761640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe1d809b140 0x7fe1d8159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1de761640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d80c7130 con 0x7fe1d815d290 2024-09-19T05:46:59.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1de761640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d8070b90 con 0x7fe1d80c8c40 2024-09-19T05:46:59.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1de761640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d8070e70 con 0x7fe1d809b140 2024-09-19T05:46:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1d7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1d80c8c40 0x7fe1d80705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1d7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1d80c8c40 0x7fe1d80705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43722/0 (socket says 172.21.15.67:43722) 2024-09-19T05:46:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1d7fff640 1 -- 172.21.15.67:0/2306452939 learned_addr learned my addr 172.21.15.67:0/2306452939 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1dccfe640 1 --2- 172.21.15.67:0/2306452939 >> v2:172.21.15.97:3300/0 conn(0x7fe1d809b140 0x7fe1d8159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1d7fff640 1 -- 172.21.15.67:0/2306452939 >> v2:172.21.15.97:3300/0 conn(0x7fe1d809b140 msgr2=0x7fe1d8159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1d7fff640 1 --2- 172.21.15.67:0/2306452939 >> v2:172.21.15.97:3300/0 conn(0x7fe1d809b140 0x7fe1d8159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1d7fff640 1 -- 172.21.15.67:0/2306452939 >> v1:172.21.15.97:6789/0 conn(0x7fe1d815d290 legacy=0x7fe1d809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1d7fff640 1 -- 172.21.15.67:0/2306452939 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d8071150 con 0x7fe1d80c8c40 2024-09-19T05:46:59.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.912+0000 7fe1dccfe640 1 --2- 172.21.15.67:0/2306452939 >> v2:172.21.15.97:3300/0 conn(0x7fe1d809b140 0x7fe1d8159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:46:59.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1d7fff640 1 --2- 172.21.15.67:0/2306452939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d80c8c40 0x7fe1d80705b0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fe1d806cc70 tx=0x7fe1c801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaab127d6006753 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:59.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1d77fe640 1 -- 172.21.15.67:0/2306452939 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c80b2070 con 0x7fe1d80c8c40 2024-09-19T05:46:59.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1d77fe640 1 -- 172.21.15.67:0/2306452939 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c80ad640 con 0x7fe1d80c8c40 2024-09-19T05:46:59.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1d77fe640 1 -- 172.21.15.67:0/2306452939 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c80ada10 con 0x7fe1d80c8c40 2024-09-19T05:46:59.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 -- 172.21.15.67:0/2306452939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d80c8c40 msgr2=0x7fe1d80705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:59.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 --2- 172.21.15.67:0/2306452939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d80c8c40 0x7fe1d80705b0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fe1d806cc70 tx=0x7fe1c801c4e0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 -- 172.21.15.67:0/2306452939 shutdown_connections 2024-09-19T05:46:59.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 --2- 172.21.15.67:0/2306452939 >> v2:172.21.15.97:3300/0 conn(0x7fe1d809b140 0x7fe1d8159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 --2- 172.21.15.67:0/2306452939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d80c8c40 0x7fe1d80705b0 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 -- 172.21.15.67:0/2306452939 >> 172.21.15.67:0/2306452939 conn(0x7fe1d80d22b0 msgr2=0x7fe1d80d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:59.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 -- 172.21.15.67:0/2306452939 shutdown_connections 2024-09-19T05:46:59.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 -- 172.21.15.67:0/2306452939 wait complete. 2024-09-19T05:46:59.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 Processor -- start 2024-09-19T05:46:59.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 -- start start 2024-09-19T05:46:59.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d809b140 0x7fe1d8141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d80c8c40 0x7fe1d8157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1d815d290 0x7fe1d81547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d80d0c00 con 0x7fe1d809b140 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d80d0a80 con 0x7fe1d80c8c40 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1de761640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d80d0d80 con 0x7fe1d815d290 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1d7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d809b140 0x7fe1d8141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1d7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d809b140 0x7fe1d8141d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43732/0 (socket says 172.21.15.67:43732) 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.916+0000 7fe1d7fff640 1 -- 172.21.15.67:0/2219451095 learned_addr learned my addr 172.21.15.67:0/2219451095 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d7fff640 1 -- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1d815d290 msgr2=0x7fe1d81547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d7fff640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1d815d290 0x7fe1d81547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1cf7fe640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d80c8c40 0x7fe1d8157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d7fff640 1 -- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d80c8c40 msgr2=0x7fe1d8157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d7fff640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d80c8c40 0x7fe1d8157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d7fff640 1 -- 172.21.15.67:0/2219451095 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d8157dd0 con 0x7fe1d809b140 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d7fff640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d809b140 0x7fe1d8141d40 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8000c10 tx=0x7fe1c8019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:59.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d57fa640 1 -- 172.21.15.67:0/2219451095 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c80ba020 con 0x7fe1d809b140 2024-09-19T05:46:59.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d57fa640 1 -- 172.21.15.67:0/2219451095 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c80b6610 con 0x7fe1d809b140 2024-09-19T05:46:59.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1de761640 1 -- 172.21.15.67:0/2219451095 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d81580a0 con 0x7fe1d809b140 2024-09-19T05:46:59.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d57fa640 1 -- 172.21.15.67:0/2219451095 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c80b2040 con 0x7fe1d809b140 2024-09-19T05:46:59.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1de761640 1 -- 172.21.15.67:0/2219451095 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d8158660 con 0x7fe1d809b140 2024-09-19T05:46:59.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1de761640 1 -- 172.21.15.67:0/2219451095 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d8159550 con 0x7fe1d809b140 2024-09-19T05:46:59.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d57fa640 1 -- 172.21.15.67:0/2219451095 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1c80bd020 con 0x7fe1d809b140 2024-09-19T05:46:59.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d57fa640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1b80678c0 0x7fe1b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:59.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1d57fa640 1 -- 172.21.15.67:0/2219451095 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7fe1c811fdd0 con 0x7fe1d809b140 2024-09-19T05:46:59.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1cf7fe640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1b80678c0 0x7fe1b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:59.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.920+0000 7fe1cf7fe640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1b80678c0 0x7fe1b8069d80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80b5850 tx=0x7fe1c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:59.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:46:59.924+0000 7fe1d57fa640 1 -- 172.21.15.67:0/2219451095 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe1c80c4030 con 0x7fe1d809b140 2024-09-19T05:47:00.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.088+0000 7fe1de761640 1 -- 172.21.15.67:0/2219451095 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1d80a04f0 con 0x7fe1d809b140 2024-09-19T05:47:00.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1d57fa640 1 -- 172.21.15.67:0/2219451095 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) ==== 74+0+16912 (secure 0 0 0) 0x7fe1c8121090 con 0x7fe1d809b140 2024-09-19T05:47:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:00.091 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":179,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:46:57.401001+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:46:53.433544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-19T05:46:54.721763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:47:00.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 -- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1b80678c0 msgr2=0x7fe1b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1b80678c0 0x7fe1b8069d80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80b5850 tx=0x7fe1c0008040 comp rx=0 tx=0).stop 2024-09-19T05:47:00.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 -- 172.21.15.67:0/2219451095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d809b140 msgr2=0x7fe1d8141d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d809b140 0x7fe1d8141d40 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8000c10 tx=0x7fe1c8019280 comp rx=0 tx=0).stop 2024-09-19T05:47:00.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 -- 172.21.15.67:0/2219451095 shutdown_connections 2024-09-19T05:47:00.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe1b80678c0 0x7fe1b8069d80 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1d815d290 0x7fe1d81547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d80c8c40 0x7fe1d8157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 --2- 172.21.15.67:0/2219451095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1d809b140 0x7fe1d8141d40 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 -- 172.21.15.67:0/2219451095 >> 172.21.15.67:0/2219451095 conn(0x7fe1d80d22b0 msgr2=0x7fe1d80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:00.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 -- 172.21.15.67:0/2219451095 shutdown_connections 2024-09-19T05:47:00.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.092+0000 7fe1de761640 1 -- 172.21.15.67:0/2219451095 wait complete. 2024-09-19T05:47:00.110 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:47:00.110 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:47:00.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.220+0000 7f41ef5aa640 1 Processor -- start 2024-09-19T05:47:00.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.220+0000 7f41ef5aa640 1 -- start start 2024-09-19T05:47:00.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ef5aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f41e815c030 0x7f41e806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ef5aa640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f41e815d1d0 0x7f41e80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ef5aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41e80b3510 0x7f41e806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ef5aa640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f41e806e3c0 con 0x7f41e815d1d0 2024-09-19T05:47:00.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ef5aa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f41e806e6a0 con 0x7f41e815c030 2024-09-19T05:47:00.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ef5aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f41e806e980 con 0x7f41e80b3510 2024-09-19T05:47:00.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ecb45640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f41e815d1d0 0x7f41e80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ecb45640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f41e815d1d0 0x7f41e80b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43744/0 (socket says 172.21.15.67:43744) 2024-09-19T05:47:00.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ecb45640 1 -- 172.21.15.67:0/36301101 learned_addr learned my addr 172.21.15.67:0/36301101 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:00.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ecb45640 1 -- 172.21.15.67:0/36301101 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41e80b3510 msgr2=0x7f41e806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:00.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ecb45640 1 --2- 172.21.15.67:0/36301101 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41e80b3510 0x7f41e806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ecb45640 1 -- 172.21.15.67:0/36301101 >> v2:172.21.15.97:3300/0 conn(0x7f41e815c030 msgr2=0x7f41e806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:00.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ecb45640 1 --2- 172.21.15.67:0/36301101 >> v2:172.21.15.97:3300/0 conn(0x7f41e815c030 0x7f41e806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ecb45640 1 -- 172.21.15.67:0/36301101 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e806ec60 con 0x7f41e815d1d0 2024-09-19T05:47:00.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41ecb45640 1 --2- 172.21.15.67:0/36301101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815d1d0 0x7f41e80b2fd0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f41e8070390 tx=0x7f41d801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde582c61646d4fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:00.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41dffff640 1 -- 172.21.15.67:0/36301101 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d80b1070 con 0x7f41e815d1d0 2024-09-19T05:47:00.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41dffff640 1 -- 172.21.15.67:0/36301101 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d80ac620 con 0x7f41e815d1d0 2024-09-19T05:47:00.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.224+0000 7f41dffff640 1 -- 172.21.15.67:0/36301101 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d80ac9f0 con 0x7f41e815d1d0 2024-09-19T05:47:00.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- 172.21.15.67:0/36301101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815d1d0 msgr2=0x7f41e80b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 --2- 172.21.15.67:0/36301101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815d1d0 0x7f41e80b2fd0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f41e8070390 tx=0x7f41d801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- 172.21.15.67:0/36301101 shutdown_connections 2024-09-19T05:47:00.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 --2- 172.21.15.67:0/36301101 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41e80b3510 0x7f41e806f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 --2- 172.21.15.67:0/36301101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815d1d0 0x7f41e80b2fd0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 --2- 172.21.15.67:0/36301101 >> v2:172.21.15.97:3300/0 conn(0x7f41e815c030 0x7f41e806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- 172.21.15.67:0/36301101 >> 172.21.15.67:0/36301101 conn(0x7f41e80d0080 msgr2=0x7f41e80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:00.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- 172.21.15.67:0/36301101 shutdown_connections 2024-09-19T05:47:00.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- 172.21.15.67:0/36301101 wait complete. 2024-09-19T05:47:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 Processor -- start 2024-09-19T05:47:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- start start 2024-09-19T05:47:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41e80b3510 0x7f41e8164700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815c030 0x7f41e8155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e815d1d0 0x7f41e81faf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f41e815fd40 con 0x7f41e815c030 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f41e815c620 con 0x7f41e815d1d0 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f41e815fec0 con 0x7f41e80b3510 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ecb45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815c030 0x7f41e8155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ecb45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815c030 0x7f41e8155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43750/0 (socket says 172.21.15.67:43750) 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ecb45640 1 -- 172.21.15.67:0/2779424210 learned_addr learned my addr 172.21.15.67:0/2779424210 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41edb47640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e815d1d0 0x7f41e81faf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ed346640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41e80b3510 0x7f41e8164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ecb45640 1 -- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41e80b3510 msgr2=0x7f41e8164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ecb45640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41e80b3510 0x7f41e8164700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ecb45640 1 -- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e815d1d0 msgr2=0x7f41e81faf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ecb45640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e815d1d0 0x7f41e81faf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ecb45640 1 -- 172.21.15.67:0/2779424210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e81f7d10 con 0x7f41e815c030 2024-09-19T05:47:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ecb45640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815c030 0x7f41e8155030 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f41d80af040 tx=0x7f41d8019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:00.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ddffb640 1 -- 172.21.15.67:0/2779424210 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d80bc070 con 0x7f41e815c030 2024-09-19T05:47:00.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ddffb640 1 -- 172.21.15.67:0/2779424210 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d80b7650 con 0x7f41e815c030 2024-09-19T05:47:00.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- 172.21.15.67:0/2779424210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e81fbb60 con 0x7f41e815c030 2024-09-19T05:47:00.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ddffb640 1 -- 172.21.15.67:0/2779424210 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d80b1040 con 0x7f41e815c030 2024-09-19T05:47:00.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- 172.21.15.67:0/2779424210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e8072ab0 con 0x7f41e815c030 2024-09-19T05:47:00.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.228+0000 7f41ef5aa640 1 -- 172.21.15.67:0/2779424210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e806dde0 con 0x7f41e815c030 2024-09-19T05:47:00.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.232+0000 7f41ddffb640 1 -- 172.21.15.67:0/2779424210 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f41d80bf070 con 0x7f41e815c030 2024-09-19T05:47:00.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.232+0000 7f41ddffb640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41cc0678c0 0x7f41cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.232+0000 7f41ddffb640 1 -- 172.21.15.67:0/2779424210 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f41d811fb20 con 0x7f41e815c030 2024-09-19T05:47:00.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.232+0000 7f41ed346640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41cc0678c0 0x7f41cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.232+0000 7f41ed346640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41cc0678c0 0x7f41cc069d80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f41e400a830 tx=0x7f41e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:00.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.236+0000 7f41ddffb640 1 -- 172.21.15.67:0/2779424210 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f41d8016110 con 0x7f41e815c030 2024-09-19T05:47:00.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.392+0000 7f41ef5aa640 1 -- 172.21.15.67:0/2779424210 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41e81fbe40 con 0x7f41cc0678c0 2024-09-19T05:47:00.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.412+0000 7f41ddffb640 1 -- 172.21.15.67:0/2779424210 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252449 (secure 0 0 0) 0x7f41e81fbe40 con 0x7f41cc0678c0 2024-09-19T05:47:00.414 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:00.416 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:47:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 -- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41cc0678c0 msgr2=0x7f41cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41cc0678c0 0x7f41cc069d80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f41e400a830 tx=0x7f41e4008040 comp rx=0 tx=0).stop 2024-09-19T05:47:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 -- 172.21.15.67:0/2779424210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815c030 msgr2=0x7f41e8155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815c030 0x7f41e8155030 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f41d80af040 tx=0x7f41d8019290 comp rx=0 tx=0).stop 2024-09-19T05:47:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 -- 172.21.15.67:0/2779424210 shutdown_connections 2024-09-19T05:47:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e815d1d0 0x7f41e81faf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41e815c030 0x7f41e8155030 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f41cc0678c0 0x7f41cc069d80 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 --2- 172.21.15.67:0/2779424210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41e80b3510 0x7f41e8164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 -- 172.21.15.67:0/2779424210 >> 172.21.15.67:0/2779424210 conn(0x7f41e80d0080 msgr2=0x7f41e815d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 -- 172.21.15.67:0/2779424210 shutdown_connections 2024-09-19T05:47:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.416+0000 7f41ef5aa640 1 -- 172.21.15.67:0/2779424210 wait complete. 2024-09-19T05:47:00.434 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":591,"stamp":"2024-09-19T05:46:59.395795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":529168,"kb_used_data":18696,"kb_used_omap":12,"kb_used_meta":510259,"kb_avail":754445552,"statfs":{"total":773094113280,"available":772552245248,"internally_reserved":0,"allocated":19144704,"data_stored":9641924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":522505777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.053959"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412201+0000","last_change":"2024-09-19T05:46:56.430847+0000","last_active":"2024-09-19T05:46:57.412201+0000","last_peered":"2024-09-19T05:46:57.412201+0000","last_clean":"2024-09-19T05:46:57.412201+0000","last_became_active":"2024-09-19T05:46:56.430554+0000","last_became_peered":"2024-09-19T05:46:56.430554+0000","last_unstale":"2024-09-19T05:46:57.412201+0000","last_undegraded":"2024-09-19T05:46:57.412201+0000","last_fullsized":"2024-09-19T05:46:57.412201+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:13.205115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413297+0000","last_change":"2024-09-19T05:46:56.426232+0000","last_active":"2024-09-19T05:46:57.413297+0000","last_peered":"2024-09-19T05:46:57.413297+0000","last_clean":"2024-09-19T05:46:57.413297+0000","last_became_active":"2024-09-19T05:46:56.425892+0000","last_became_peered":"2024-09-19T05:46:56.425892+0000","last_unstale":"2024-09-19T05:46:57.413297+0000","last_undegraded":"2024-09-19T05:46:57.413297+0000","last_fullsized":"2024-09-19T05:46:57.413297+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.032367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.410200+0000","last_change":"2024-09-19T05:46:56.402538+0000","last_active":"2024-09-19T05:46:56.410200+0000","last_peered":"2024-09-19T05:46:56.410200+0000","last_clean":"2024-09-19T05:46:56.410200+0000","last_became_active":"2024-09-19T05:46:56.401760+0000","last_became_peered":"2024-09-19T05:46:56.401760+0000","last_unstale":"2024-09-19T05:46:56.410200+0000","last_undegraded":"2024-09-19T05:46:56.410200+0000","last_fullsized":"2024-09-19T05:46:56.410200+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:53.576825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.410118+0000","last_change":"2024-09-19T05:46:56.406938+0000","last_active":"2024-09-19T05:46:56.410118+0000","last_peered":"2024-09-19T05:46:56.410118+0000","last_clean":"2024-09-19T05:46:56.410118+0000","last_became_active":"2024-09-19T05:46:56.405450+0000","last_became_peered":"2024-09-19T05:46:56.405450+0000","last_unstale":"2024-09-19T05:46:56.410118+0000","last_undegraded":"2024-09-19T05:46:56.410118+0000","last_fullsized":"2024-09-19T05:46:56.410118+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:26.766033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.418051+0000","last_change":"2024-09-19T05:46:56.414196+0000","last_active":"2024-09-19T05:46:56.418051+0000","last_peered":"2024-09-19T05:46:56.418051+0000","last_clean":"2024-09-19T05:46:56.418051+0000","last_became_active":"2024-09-19T05:46:56.413619+0000","last_became_peered":"2024-09-19T05:46:56.413619+0000","last_unstale":"2024-09-19T05:46:56.418051+0000","last_undegraded":"2024-09-19T05:46:56.418051+0000","last_fullsized":"2024-09-19T05:46:56.418051+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:54.033978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.418289+0000","last_change":"2024-09-19T05:46:56.411397+0000","last_active":"2024-09-19T05:46:56.418289+0000","last_peered":"2024-09-19T05:46:56.418289+0000","last_clean":"2024-09-19T05:46:56.418289+0000","last_became_active":"2024-09-19T05:46:56.411114+0000","last_became_peered":"2024-09-19T05:46:56.411114+0000","last_unstale":"2024-09-19T05:46:56.418289+0000","last_undegraded":"2024-09-19T05:46:56.418289+0000","last_fullsized":"2024-09-19T05:46:56.418289+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:12.007024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416179+0000","last_change":"2024-09-19T05:46:56.430277+0000","last_active":"2024-09-19T05:46:57.416179+0000","last_peered":"2024-09-19T05:46:57.416179+0000","last_clean":"2024-09-19T05:46:57.416179+0000","last_became_active":"2024-09-19T05:46:56.429897+0000","last_became_peered":"2024-09-19T05:46:56.429897+0000","last_unstale":"2024-09-19T05:46:57.416179+0000","last_undegraded":"2024-09-19T05:46:57.416179+0000","last_fullsized":"2024-09-19T05:46:57.416179+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:11.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.439477+0000","last_change":"2024-09-19T05:46:56.436636+0000","last_active":"2024-09-19T05:46:56.439477+0000","last_peered":"2024-09-19T05:46:56.439477+0000","last_clean":"2024-09-19T05:46:56.439477+0000","last_became_active":"2024-09-19T05:46:56.435936+0000","last_became_peered":"2024-09-19T05:46:56.435936+0000","last_unstale":"2024-09-19T05:46:56.439477+0000","last_undegraded":"2024-09-19T05:46:56.439477+0000","last_fullsized":"2024-09-19T05:46:56.439477+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:38.008245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412358+0000","last_change":"2024-09-19T05:46:56.406692+0000","last_active":"2024-09-19T05:46:57.412358+0000","last_peered":"2024-09-19T05:46:57.412358+0000","last_clean":"2024-09-19T05:46:57.412358+0000","last_became_active":"2024-09-19T05:46:56.406260+0000","last_became_peered":"2024-09-19T05:46:56.406260+0000","last_unstale":"2024-09-19T05:46:57.412358+0000","last_undegraded":"2024-09-19T05:46:57.412358+0000","last_fullsized":"2024-09-19T05:46:57.412358+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:10.074858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.435714+0000","last_change":"2024-09-19T05:46:56.435181+0000","last_active":"2024-09-19T05:46:56.435714+0000","last_peered":"2024-09-19T05:46:56.435714+0000","last_clean":"2024-09-19T05:46:56.435714+0000","last_became_active":"2024-09-19T05:46:56.434721+0000","last_became_peered":"2024-09-19T05:46:56.434721+0000","last_unstale":"2024-09-19T05:46:56.435714+0000","last_undegraded":"2024-09-19T05:46:56.435714+0000","last_fullsized":"2024-09-19T05:46:56.435714+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:29.626814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.439849+0000","last_change":"2024-09-19T05:46:56.432157+0000","last_active":"2024-09-19T05:46:56.439849+0000","last_peered":"2024-09-19T05:46:56.439849+0000","last_clean":"2024-09-19T05:46:56.439849+0000","last_became_active":"2024-09-19T05:46:56.423739+0000","last_became_peered":"2024-09-19T05:46:56.423739+0000","last_unstale":"2024-09-19T05:46:56.439849+0000","last_undegraded":"2024-09-19T05:46:56.439849+0000","last_fullsized":"2024-09-19T05:46:56.439849+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.906715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.429453+0000","last_change":"2024-09-19T05:46:56.428923+0000","last_active":"2024-09-19T05:46:56.429453+0000","last_peered":"2024-09-19T05:46:56.429453+0000","last_clean":"2024-09-19T05:46:56.429453+0000","last_became_active":"2024-09-19T05:46:56.428556+0000","last_became_peered":"2024-09-19T05:46:56.428556+0000","last_unstale":"2024-09-19T05:46:56.429453+0000","last_undegraded":"2024-09-19T05:46:56.429453+0000","last_fullsized":"2024-09-19T05:46:56.429453+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:49.622752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412384+0000","last_change":"2024-09-19T05:46:56.409132+0000","last_active":"2024-09-19T05:46:57.412384+0000","last_peered":"2024-09-19T05:46:57.412384+0000","last_clean":"2024-09-19T05:46:57.412384+0000","last_became_active":"2024-09-19T05:46:56.408393+0000","last_became_peered":"2024-09-19T05:46:56.408393+0000","last_unstale":"2024-09-19T05:46:57.412384+0000","last_undegraded":"2024-09-19T05:46:57.412384+0000","last_fullsized":"2024-09-19T05:46:57.412384+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:02.946551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416732+0000","last_change":"2024-09-19T05:46:56.390482+0000","last_active":"2024-09-19T05:46:57.416732+0000","last_peered":"2024-09-19T05:46:57.416732+0000","last_clean":"2024-09-19T05:46:57.416732+0000","last_became_active":"2024-09-19T05:46:56.389619+0000","last_became_peered":"2024-09-19T05:46:56.389619+0000","last_unstale":"2024-09-19T05:46:57.416732+0000","last_undegraded":"2024-09-19T05:46:57.416732+0000","last_fullsized":"2024-09-19T05:46:57.416732+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:29.679618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.411692+0000","last_change":"2024-09-19T05:46:56.415819+0000","last_active":"2024-09-19T05:46:57.411692+0000","last_peered":"2024-09-19T05:46:57.411692+0000","last_clean":"2024-09-19T05:46:57.411692+0000","last_became_active":"2024-09-19T05:46:56.415536+0000","last_became_peered":"2024-09-19T05:46:56.415536+0000","last_unstale":"2024-09-19T05:46:57.411692+0000","last_undegraded":"2024-09-19T05:46:57.411692+0000","last_fullsized":"2024-09-19T05:46:57.411692+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:49.415067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.418337+0000","last_change":"2024-09-19T05:46:56.413735+0000","last_active":"2024-09-19T05:46:56.418337+0000","last_peered":"2024-09-19T05:46:56.418337+0000","last_clean":"2024-09-19T05:46:56.418337+0000","last_became_active":"2024-09-19T05:46:56.413345+0000","last_became_peered":"2024-09-19T05:46:56.413345+0000","last_unstale":"2024-09-19T05:46:56.418337+0000","last_undegraded":"2024-09-19T05:46:56.418337+0000","last_fullsized":"2024-09-19T05:46:56.418337+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:22.526991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.437508+0000","last_change":"2024-09-19T05:46:56.437014+0000","last_active":"2024-09-19T05:46:56.437508+0000","last_peered":"2024-09-19T05:46:56.437508+0000","last_clean":"2024-09-19T05:46:56.437508+0000","last_became_active":"2024-09-19T05:46:56.436705+0000","last_became_peered":"2024-09-19T05:46:56.436705+0000","last_unstale":"2024-09-19T05:46:56.437508+0000","last_undegraded":"2024-09-19T05:46:56.437508+0000","last_fullsized":"2024-09-19T05:46:56.437508+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:21.993444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413022+0000","last_change":"2024-09-19T05:46:56.420533+0000","last_active":"2024-09-19T05:46:57.413022+0000","last_peered":"2024-09-19T05:46:57.413022+0000","last_clean":"2024-09-19T05:46:57.413022+0000","last_became_active":"2024-09-19T05:46:56.419738+0000","last_became_peered":"2024-09-19T05:46:56.419738+0000","last_unstale":"2024-09-19T05:46:57.413022+0000","last_undegraded":"2024-09-19T05:46:57.413022+0000","last_fullsized":"2024-09-19T05:46:57.413022+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:00.555563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412910+0000","last_change":"2024-09-19T05:46:56.430861+0000","last_active":"2024-09-19T05:46:57.412910+0000","last_peered":"2024-09-19T05:46:57.412910+0000","last_clean":"2024-09-19T05:46:57.412910+0000","last_became_active":"2024-09-19T05:46:56.430261+0000","last_became_peered":"2024-09-19T05:46:56.430261+0000","last_unstale":"2024-09-19T05:46:57.412910+0000","last_undegraded":"2024-09-19T05:46:57.412910+0000","last_fullsized":"2024-09-19T05:46:57.412910+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:53.538033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.429787+0000","last_change":"2024-09-19T05:46:56.429321+0000","last_active":"2024-09-19T05:46:56.429787+0000","last_peered":"2024-09-19T05:46:56.429787+0000","last_clean":"2024-09-19T05:46:56.429787+0000","last_became_active":"2024-09-19T05:46:56.428938+0000","last_became_peered":"2024-09-19T05:46:56.428938+0000","last_unstale":"2024-09-19T05:46:56.429787+0000","last_undegraded":"2024-09-19T05:46:56.429787+0000","last_fullsized":"2024-09-19T05:46:56.429787+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:00.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412380+0000","last_change":"2024-09-19T05:46:56.415517+0000","last_active":"2024-09-19T05:46:57.412380+0000","last_peered":"2024-09-19T05:46:57.412380+0000","last_clean":"2024-09-19T05:46:57.412380+0000","last_became_active":"2024-09-19T05:46:56.415046+0000","last_became_peered":"2024-09-19T05:46:56.415046+0000","last_unstale":"2024-09-19T05:46:57.412380+0000","last_undegraded":"2024-09-19T05:46:57.412380+0000","last_fullsized":"2024-09-19T05:46:57.412380+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:26.766033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412161+0000","last_change":"2024-09-19T05:46:56.409939+0000","last_active":"2024-09-19T05:46:57.412161+0000","last_peered":"2024-09-19T05:46:57.412161+0000","last_clean":"2024-09-19T05:46:57.412161+0000","last_became_active":"2024-09-19T05:46:56.409304+0000","last_became_peered":"2024-09-19T05:46:56.409304+0000","last_unstale":"2024-09-19T05:46:57.412161+0000","last_undegraded":"2024-09-19T05:46:57.412161+0000","last_fullsized":"2024-09-19T05:46:57.412161+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:36.402980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.435944+0000","last_change":"2024-09-19T05:46:56.427132+0000","last_active":"2024-09-19T05:46:56.435944+0000","last_peered":"2024-09-19T05:46:56.435944+0000","last_clean":"2024-09-19T05:46:56.435944+0000","last_became_active":"2024-09-19T05:46:56.426149+0000","last_became_peered":"2024-09-19T05:46:56.426149+0000","last_unstale":"2024-09-19T05:46:56.435944+0000","last_undegraded":"2024-09-19T05:46:56.435944+0000","last_fullsized":"2024-09-19T05:46:56.435944+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:32.617283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.411518+0000","last_change":"2024-09-19T05:46:56.430824+0000","last_active":"2024-09-19T05:46:57.411518+0000","last_peered":"2024-09-19T05:46:57.411518+0000","last_clean":"2024-09-19T05:46:57.411518+0000","last_became_active":"2024-09-19T05:46:56.430537+0000","last_became_peered":"2024-09-19T05:46:56.430537+0000","last_unstale":"2024-09-19T05:46:57.411518+0000","last_undegraded":"2024-09-19T05:46:57.411518+0000","last_fullsized":"2024-09-19T05:46:57.411518+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:43.715631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416657+0000","last_change":"2024-09-19T05:46:56.402977+0000","last_active":"2024-09-19T05:46:57.416657+0000","last_peered":"2024-09-19T05:46:57.416657+0000","last_clean":"2024-09-19T05:46:57.416657+0000","last_became_active":"2024-09-19T05:46:56.402543+0000","last_became_peered":"2024-09-19T05:46:56.402543+0000","last_unstale":"2024-09-19T05:46:57.416657+0000","last_undegraded":"2024-09-19T05:46:57.416657+0000","last_fullsized":"2024-09-19T05:46:57.416657+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:48.825008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.440811+0000","last_change":"2024-09-19T05:46:56.434153+0000","last_active":"2024-09-19T05:46:56.440811+0000","last_peered":"2024-09-19T05:46:56.440811+0000","last_clean":"2024-09-19T05:46:56.440811+0000","last_became_active":"2024-09-19T05:46:56.422649+0000","last_became_peered":"2024-09-19T05:46:56.422649+0000","last_unstale":"2024-09-19T05:46:56.440811+0000","last_undegraded":"2024-09-19T05:46:56.440811+0000","last_fullsized":"2024-09-19T05:46:56.440811+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:42.817714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.434840+0000","last_change":"2024-09-19T05:46:56.426506+0000","last_active":"2024-09-19T05:46:56.434840+0000","last_peered":"2024-09-19T05:46:56.434840+0000","last_clean":"2024-09-19T05:46:56.434840+0000","last_became_active":"2024-09-19T05:46:56.415420+0000","last_became_peered":"2024-09-19T05:46:56.415420+0000","last_unstale":"2024-09-19T05:46:56.434840+0000","last_undegraded":"2024-09-19T05:46:56.434840+0000","last_fullsized":"2024-09-19T05:46:56.434840+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:16.682160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.418855+0000","last_change":"2024-09-19T05:46:56.413793+0000","last_active":"2024-09-19T05:46:56.418855+0000","last_peered":"2024-09-19T05:46:56.418855+0000","last_clean":"2024-09-19T05:46:56.418855+0000","last_became_active":"2024-09-19T05:46:56.413482+0000","last_became_peered":"2024-09-19T05:46:56.413482+0000","last_unstale":"2024-09-19T05:46:56.418855+0000","last_undegraded":"2024-09-19T05:46:56.418855+0000","last_fullsized":"2024-09-19T05:46:56.418855+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:33.514723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.433168+0000","last_change":"2024-09-19T05:46:56.421869+0000","last_active":"2024-09-19T05:46:56.433168+0000","last_peered":"2024-09-19T05:46:56.433168+0000","last_clean":"2024-09-19T05:46:56.433168+0000","last_became_active":"2024-09-19T05:46:56.412733+0000","last_became_peered":"2024-09-19T05:46:56.412733+0000","last_unstale":"2024-09-19T05:46:56.433168+0000","last_undegraded":"2024-09-19T05:46:56.433168+0000","last_fullsized":"2024-09-19T05:46:56.433168+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:01.147014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.433228+0000","last_change":"2024-09-19T05:46:56.413456+0000","last_active":"2024-09-19T05:46:56.433228+0000","last_peered":"2024-09-19T05:46:56.433228+0000","last_clean":"2024-09-19T05:46:56.433228+0000","last_became_active":"2024-09-19T05:46:56.411834+0000","last_became_peered":"2024-09-19T05:46:56.411834+0000","last_unstale":"2024-09-19T05:46:56.433228+0000","last_undegraded":"2024-09-19T05:46:56.433228+0000","last_fullsized":"2024-09-19T05:46:56.433228+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:40.738985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416414+0000","last_change":"2024-09-19T05:46:56.408360+0000","last_active":"2024-09-19T05:46:57.416414+0000","last_peered":"2024-09-19T05:46:57.416414+0000","last_clean":"2024-09-19T05:46:57.416414+0000","last_became_active":"2024-09-19T05:46:56.407980+0000","last_became_peered":"2024-09-19T05:46:56.407980+0000","last_unstale":"2024-09-19T05:46:57.416414+0000","last_undegraded":"2024-09-19T05:46:57.416414+0000","last_fullsized":"2024-09-19T05:46:57.416414+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:53.180280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.435701+0000","last_change":"2024-09-19T05:46:56.435163+0000","last_active":"2024-09-19T05:46:56.435701+0000","last_peered":"2024-09-19T05:46:56.435701+0000","last_clean":"2024-09-19T05:46:56.435701+0000","last_became_active":"2024-09-19T05:46:56.434736+0000","last_became_peered":"2024-09-19T05:46:56.434736+0000","last_unstale":"2024-09-19T05:46:56.435701+0000","last_undegraded":"2024-09-19T05:46:56.435701+0000","last_fullsized":"2024-09-19T05:46:56.435701+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:01.533093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.438048+0000","last_change":"2024-09-19T05:46:56.415088+0000","last_active":"2024-09-19T05:46:56.438048+0000","last_peered":"2024-09-19T05:46:56.438048+0000","last_clean":"2024-09-19T05:46:56.438048+0000","last_became_active":"2024-09-19T05:46:56.414352+0000","last_became_peered":"2024-09-19T05:46:56.414352+0000","last_unstale":"2024-09-19T05:46:56.438048+0000","last_undegraded":"2024-09-19T05:46:56.438048+0000","last_fullsized":"2024-09-19T05:46:56.438048+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:23.360007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"178'4","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.421529+0000","last_change":"2024-09-19T05:46:55.378679+0000","last_active":"2024-09-19T05:46:56.421529+0000","last_peered":"2024-09-19T05:46:56.421529+0000","last_clean":"2024-09-19T05:46:56.421529+0000","last_became_active":"2024-09-19T05:46:55.378018+0000","last_became_peered":"2024-09-19T05:46:55.378018+0000","last_unstale":"2024-09-19T05:46:56.421529+0000","last_undegraded":"2024-09-19T05:46:56.421529+0000","last_fullsized":"2024-09-19T05:46:56.421529+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:01.472623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416897+0000","last_change":"2024-09-19T05:46:56.419108+0000","last_active":"2024-09-19T05:46:57.416897+0000","last_peered":"2024-09-19T05:46:57.416897+0000","last_clean":"2024-09-19T05:46:57.416897+0000","last_became_active":"2024-09-19T05:46:56.418718+0000","last_became_peered":"2024-09-19T05:46:56.418718+0000","last_unstale":"2024-09-19T05:46:57.416897+0000","last_undegraded":"2024-09-19T05:46:57.416897+0000","last_fullsized":"2024-09-19T05:46:57.416897+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:58.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"178'1","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.436744+0000","last_change":"2024-09-19T05:46:55.385961+0000","last_active":"2024-09-19T05:46:56.436744+0000","last_peered":"2024-09-19T05:46:56.436744+0000","last_clean":"2024-09-19T05:46:56.436744+0000","last_became_active":"2024-09-19T05:46:55.385437+0000","last_became_peered":"2024-09-19T05:46:55.385437+0000","last_unstale":"2024-09-19T05:46:56.436744+0000","last_undegraded":"2024-09-19T05:46:56.436744+0000","last_fullsized":"2024-09-19T05:46:56.436744+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:48.613634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.442175+0000","last_change":"2024-09-19T05:46:56.439807+0000","last_active":"2024-09-19T05:46:56.442175+0000","last_peered":"2024-09-19T05:46:56.442175+0000","last_clean":"2024-09-19T05:46:56.442175+0000","last_became_active":"2024-09-19T05:46:56.431751+0000","last_became_peered":"2024-09-19T05:46:56.431751+0000","last_unstale":"2024-09-19T05:46:56.442175+0000","last_undegraded":"2024-09-19T05:46:56.442175+0000","last_fullsized":"2024-09-19T05:46:56.442175+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:23:09.695988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"178'2","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.444404+0000","last_change":"2024-09-19T05:46:55.381255+0000","last_active":"2024-09-19T05:46:56.444404+0000","last_peered":"2024-09-19T05:46:56.444404+0000","last_clean":"2024-09-19T05:46:56.444404+0000","last_became_active":"2024-09-19T05:46:55.380322+0000","last_became_peered":"2024-09-19T05:46:55.380322+0000","last_unstale":"2024-09-19T05:46:56.444404+0000","last_undegraded":"2024-09-19T05:46:56.444404+0000","last_fullsized":"2024-09-19T05:46:56.444404+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:23.684469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.430016+0000","last_change":"2024-09-19T05:46:56.425393+0000","last_active":"2024-09-19T05:46:56.430016+0000","last_peered":"2024-09-19T05:46:56.430016+0000","last_clean":"2024-09-19T05:46:56.430016+0000","last_became_active":"2024-09-19T05:46:56.424844+0000","last_became_peered":"2024-09-19T05:46:56.424844+0000","last_unstale":"2024-09-19T05:46:56.430016+0000","last_undegraded":"2024-09-19T05:46:56.430016+0000","last_fullsized":"2024-09-19T05:46:56.430016+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:22.549179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"178'2","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412980+0000","last_change":"2024-09-19T05:46:55.378772+0000","last_active":"2024-09-19T05:46:57.412980+0000","last_peered":"2024-09-19T05:46:57.412980+0000","last_clean":"2024-09-19T05:46:57.412980+0000","last_became_active":"2024-09-19T05:46:55.377929+0000","last_became_peered":"2024-09-19T05:46:55.377929+0000","last_unstale":"2024-09-19T05:46:57.412980+0000","last_undegraded":"2024-09-19T05:46:57.412980+0000","last_fullsized":"2024-09-19T05:46:57.412980+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:40.514648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.411916+0000","last_change":"2024-09-19T05:46:56.418665+0000","last_active":"2024-09-19T05:46:57.411916+0000","last_peered":"2024-09-19T05:46:57.411916+0000","last_clean":"2024-09-19T05:46:57.411916+0000","last_became_active":"2024-09-19T05:46:56.416405+0000","last_became_peered":"2024-09-19T05:46:56.416405+0000","last_unstale":"2024-09-19T05:46:57.411916+0000","last_undegraded":"2024-09-19T05:46:57.411916+0000","last_fullsized":"2024-09-19T05:46:57.411916+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:04.598913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"178'1","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.436105+0000","last_change":"2024-09-19T05:46:55.385090+0000","last_active":"2024-09-19T05:46:56.436105+0000","last_peered":"2024-09-19T05:46:56.436105+0000","last_clean":"2024-09-19T05:46:56.436105+0000","last_became_active":"2024-09-19T05:46:55.382551+0000","last_became_peered":"2024-09-19T05:46:55.382551+0000","last_unstale":"2024-09-19T05:46:56.436105+0000","last_undegraded":"2024-09-19T05:46:56.436105+0000","last_fullsized":"2024-09-19T05:46:56.436105+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:03.912429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.411765+0000","last_change":"2024-09-19T05:46:56.409194+0000","last_active":"2024-09-19T05:46:57.411765+0000","last_peered":"2024-09-19T05:46:57.411765+0000","last_clean":"2024-09-19T05:46:57.411765+0000","last_became_active":"2024-09-19T05:46:56.408747+0000","last_became_peered":"2024-09-19T05:46:56.408747+0000","last_unstale":"2024-09-19T05:46:57.411765+0000","last_undegraded":"2024-09-19T05:46:57.411765+0000","last_fullsized":"2024-09-19T05:46:57.411765+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:13.100806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"178'1","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.420877+0000","last_change":"2024-09-19T05:46:55.387463+0000","last_active":"2024-09-19T05:46:56.420877+0000","last_peered":"2024-09-19T05:46:56.420877+0000","last_clean":"2024-09-19T05:46:56.420877+0000","last_became_active":"2024-09-19T05:46:55.387077+0000","last_became_peered":"2024-09-19T05:46:55.387077+0000","last_unstale":"2024-09-19T05:46:56.420877+0000","last_undegraded":"2024-09-19T05:46:56.420877+0000","last_fullsized":"2024-09-19T05:46:56.420877+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:48.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412590+0000","last_change":"2024-09-19T05:46:56.409696+0000","last_active":"2024-09-19T05:46:57.412590+0000","last_peered":"2024-09-19T05:46:57.412590+0000","last_clean":"2024-09-19T05:46:57.412590+0000","last_became_active":"2024-09-19T05:46:56.408956+0000","last_became_peered":"2024-09-19T05:46:56.408956+0000","last_unstale":"2024-09-19T05:46:57.412590+0000","last_undegraded":"2024-09-19T05:46:57.412590+0000","last_fullsized":"2024-09-19T05:46:57.412590+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:52.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412478+0000","last_change":"2024-09-19T05:46:55.384286+0000","last_active":"2024-09-19T05:46:57.412478+0000","last_peered":"2024-09-19T05:46:57.412478+0000","last_clean":"2024-09-19T05:46:57.412478+0000","last_became_active":"2024-09-19T05:46:55.383614+0000","last_became_peered":"2024-09-19T05:46:55.383614+0000","last_unstale":"2024-09-19T05:46:57.412478+0000","last_undegraded":"2024-09-19T05:46:57.412478+0000","last_fullsized":"2024-09-19T05:46:57.412478+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.628341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.442309+0000","last_change":"2024-09-19T05:46:56.439726+0000","last_active":"2024-09-19T05:46:56.442309+0000","last_peered":"2024-09-19T05:46:56.442309+0000","last_clean":"2024-09-19T05:46:56.442309+0000","last_became_active":"2024-09-19T05:46:56.439108+0000","last_became_peered":"2024-09-19T05:46:56.439108+0000","last_unstale":"2024-09-19T05:46:56.442309+0000","last_undegraded":"2024-09-19T05:46:56.442309+0000","last_fullsized":"2024-09-19T05:46:56.442309+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:33.437093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.406662+0000","last_change":"2024-09-19T05:46:55.389205+0000","last_active":"2024-09-19T05:46:56.406662+0000","last_peered":"2024-09-19T05:46:56.406662+0000","last_clean":"2024-09-19T05:46:56.406662+0000","last_became_active":"2024-09-19T05:46:55.386265+0000","last_became_peered":"2024-09-19T05:46:55.386265+0000","last_unstale":"2024-09-19T05:46:56.406662+0000","last_undegraded":"2024-09-19T05:46:56.406662+0000","last_fullsized":"2024-09-19T05:46:56.406662+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:49.088785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.418094+0000","last_change":"2024-09-19T05:46:56.411256+0000","last_active":"2024-09-19T05:46:56.418094+0000","last_peered":"2024-09-19T05:46:56.418094+0000","last_clean":"2024-09-19T05:46:56.418094+0000","last_became_active":"2024-09-19T05:46:56.410985+0000","last_became_peered":"2024-09-19T05:46:56.410985+0000","last_unstale":"2024-09-19T05:46:56.418094+0000","last_undegraded":"2024-09-19T05:46:56.418094+0000","last_fullsized":"2024-09-19T05:46:56.418094+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:42.118612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413703+0000","last_change":"2024-09-19T05:46:55.367362+0000","last_active":"2024-09-19T05:46:57.413703+0000","last_peered":"2024-09-19T05:46:57.413703+0000","last_clean":"2024-09-19T05:46:57.413703+0000","last_became_active":"2024-09-19T05:46:55.367089+0000","last_became_peered":"2024-09-19T05:46:55.367089+0000","last_unstale":"2024-09-19T05:46:57.413703+0000","last_undegraded":"2024-09-19T05:46:57.413703+0000","last_fullsized":"2024-09-19T05:46:57.413703+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:54.827163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413392+0000","last_change":"2024-09-19T05:46:56.432564+0000","last_active":"2024-09-19T05:46:57.413392+0000","last_peered":"2024-09-19T05:46:57.413392+0000","last_clean":"2024-09-19T05:46:57.413392+0000","last_became_active":"2024-09-19T05:46:56.431758+0000","last_became_peered":"2024-09-19T05:46:56.431758+0000","last_unstale":"2024-09-19T05:46:57.413392+0000","last_undegraded":"2024-09-19T05:46:57.413392+0000","last_fullsized":"2024-09-19T05:46:57.413392+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:53.837277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"178'3","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.419918+0000","last_change":"2024-09-19T05:46:55.387686+0000","last_active":"2024-09-19T05:46:56.419918+0000","last_peered":"2024-09-19T05:46:56.419918+0000","last_clean":"2024-09-19T05:46:56.419918+0000","last_became_active":"2024-09-19T05:46:55.386948+0000","last_became_peered":"2024-09-19T05:46:55.386948+0000","last_unstale":"2024-09-19T05:46:56.419918+0000","last_undegraded":"2024-09-19T05:46:56.419918+0000","last_fullsized":"2024-09-19T05:46:56.419918+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:35.393862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412688+0000","last_change":"2024-09-19T05:46:56.441103+0000","last_active":"2024-09-19T05:46:57.412688+0000","last_peered":"2024-09-19T05:46:57.412688+0000","last_clean":"2024-09-19T05:46:57.412688+0000","last_became_active":"2024-09-19T05:46:56.440833+0000","last_became_peered":"2024-09-19T05:46:56.440833+0000","last_unstale":"2024-09-19T05:46:57.412688+0000","last_undegraded":"2024-09-19T05:46:57.412688+0000","last_fullsized":"2024-09-19T05:46:57.412688+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:04.921547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"178'6","reported_seq":20,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413177+0000","last_change":"2024-09-19T05:46:55.377934+0000","last_active":"2024-09-19T05:46:57.413177+0000","last_peered":"2024-09-19T05:46:57.413177+0000","last_clean":"2024-09-19T05:46:57.413177+0000","last_became_active":"2024-09-19T05:46:55.376842+0000","last_became_peered":"2024-09-19T05:46:55.376842+0000","last_unstale":"2024-09-19T05:46:57.413177+0000","last_undegraded":"2024-09-19T05:46:57.413177+0000","last_fullsized":"2024-09-19T05:46:57.413177+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:23.971640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416167+0000","last_change":"2024-09-19T05:46:56.430226+0000","last_active":"2024-09-19T05:46:57.416167+0000","last_peered":"2024-09-19T05:46:57.416167+0000","last_clean":"2024-09-19T05:46:57.416167+0000","last_became_active":"2024-09-19T05:46:56.429893+0000","last_became_peered":"2024-09-19T05:46:56.429893+0000","last_unstale":"2024-09-19T05:46:57.416167+0000","last_undegraded":"2024-09-19T05:46:57.416167+0000","last_fullsized":"2024-09-19T05:46:57.416167+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:03.452178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"178'2","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412807+0000","last_change":"2024-09-19T05:46:55.368666+0000","last_active":"2024-09-19T05:46:57.412807+0000","last_peered":"2024-09-19T05:46:57.412807+0000","last_clean":"2024-09-19T05:46:57.412807+0000","last_became_active":"2024-09-19T05:46:55.368005+0000","last_became_peered":"2024-09-19T05:46:55.368005+0000","last_unstale":"2024-09-19T05:46:57.412807+0000","last_undegraded":"2024-09-19T05:46:57.412807+0000","last_fullsized":"2024-09-19T05:46:57.412807+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:46.594312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.420568+0000","last_change":"2024-09-19T05:46:56.419542+0000","last_active":"2024-09-19T05:46:56.420568+0000","last_peered":"2024-09-19T05:46:56.420568+0000","last_clean":"2024-09-19T05:46:56.420568+0000","last_became_active":"2024-09-19T05:46:56.419262+0000","last_became_peered":"2024-09-19T05:46:56.419262+0000","last_unstale":"2024-09-19T05:46:56.420568+0000","last_undegraded":"2024-09-19T05:46:56.420568+0000","last_fullsized":"2024-09-19T05:46:56.420568+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:54.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412454+0000","last_change":"2024-09-19T05:46:55.369687+0000","last_active":"2024-09-19T05:46:57.412454+0000","last_peered":"2024-09-19T05:46:57.412454+0000","last_clean":"2024-09-19T05:46:57.412454+0000","last_became_active":"2024-09-19T05:46:55.368921+0000","last_became_peered":"2024-09-19T05:46:55.368921+0000","last_unstale":"2024-09-19T05:46:57.412454+0000","last_undegraded":"2024-09-19T05:46:57.412454+0000","last_fullsized":"2024-09-19T05:46:57.412454+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:01.417976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412533+0000","last_change":"2024-09-19T05:46:56.404469+0000","last_active":"2024-09-19T05:46:57.412533+0000","last_peered":"2024-09-19T05:46:57.412533+0000","last_clean":"2024-09-19T05:46:57.412533+0000","last_became_active":"2024-09-19T05:46:56.403721+0000","last_became_peered":"2024-09-19T05:46:56.403721+0000","last_unstale":"2024-09-19T05:46:57.412533+0000","last_undegraded":"2024-09-19T05:46:57.412533+0000","last_fullsized":"2024-09-19T05:46:57.412533+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:17:28.068249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.393651+0000","last_change":"2024-09-19T05:46:55.381458+0000","last_active":"2024-09-19T05:46:56.393651+0000","last_peered":"2024-09-19T05:46:56.393651+0000","last_clean":"2024-09-19T05:46:56.393651+0000","last_became_active":"2024-09-19T05:46:55.381047+0000","last_became_peered":"2024-09-19T05:46:55.381047+0000","last_unstale":"2024-09-19T05:46:56.393651+0000","last_undegraded":"2024-09-19T05:46:56.393651+0000","last_fullsized":"2024-09-19T05:46:56.393651+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:03.214648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412475+0000","last_change":"2024-09-19T05:46:56.407439+0000","last_active":"2024-09-19T05:46:57.412475+0000","last_peered":"2024-09-19T05:46:57.412475+0000","last_clean":"2024-09-19T05:46:57.412475+0000","last_became_active":"2024-09-19T05:46:56.406716+0000","last_became_peered":"2024-09-19T05:46:56.406716+0000","last_unstale":"2024-09-19T05:46:57.412475+0000","last_undegraded":"2024-09-19T05:46:57.412475+0000","last_fullsized":"2024-09-19T05:46:57.412475+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:12.096590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"178'8","reported_seq":20,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.446885+0000","last_change":"2024-09-19T05:46:55.373869+0000","last_active":"2024-09-19T05:46:56.446885+0000","last_peered":"2024-09-19T05:46:56.446885+0000","last_clean":"2024-09-19T05:46:56.446885+0000","last_became_active":"2024-09-19T05:46:55.373136+0000","last_became_peered":"2024-09-19T05:46:55.373136+0000","last_unstale":"2024-09-19T05:46:56.446885+0000","last_undegraded":"2024-09-19T05:46:56.446885+0000","last_fullsized":"2024-09-19T05:46:56.446885+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:34.628087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416499+0000","last_change":"2024-09-19T05:46:56.408364+0000","last_active":"2024-09-19T05:46:57.416499+0000","last_peered":"2024-09-19T05:46:57.416499+0000","last_clean":"2024-09-19T05:46:57.416499+0000","last_became_active":"2024-09-19T05:46:56.408042+0000","last_became_peered":"2024-09-19T05:46:56.408042+0000","last_unstale":"2024-09-19T05:46:57.416499+0000","last_undegraded":"2024-09-19T05:46:57.416499+0000","last_fullsized":"2024-09-19T05:46:57.416499+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:18:09.947523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"178'1","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.440356+0000","last_change":"2024-09-19T05:46:55.375783+0000","last_active":"2024-09-19T05:46:56.440356+0000","last_peered":"2024-09-19T05:46:56.440356+0000","last_clean":"2024-09-19T05:46:56.440356+0000","last_became_active":"2024-09-19T05:46:55.374878+0000","last_became_peered":"2024-09-19T05:46:55.374878+0000","last_unstale":"2024-09-19T05:46:56.440356+0000","last_undegraded":"2024-09-19T05:46:56.440356+0000","last_fullsized":"2024-09-19T05:46:56.440356+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:40.362453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.441573+0000","last_change":"2024-09-19T05:46:56.441089+0000","last_active":"2024-09-19T05:46:56.441573+0000","last_peered":"2024-09-19T05:46:56.441573+0000","last_clean":"2024-09-19T05:46:56.441573+0000","last_became_active":"2024-09-19T05:46:56.440789+0000","last_became_peered":"2024-09-19T05:46:56.440789+0000","last_unstale":"2024-09-19T05:46:56.441573+0000","last_undegraded":"2024-09-19T05:46:56.441573+0000","last_fullsized":"2024-09-19T05:46:56.441573+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:59:38.808718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"178'2","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.434280+0000","last_change":"2024-09-19T05:46:55.381503+0000","last_active":"2024-09-19T05:46:56.434280+0000","last_peered":"2024-09-19T05:46:56.434280+0000","last_clean":"2024-09-19T05:46:56.434280+0000","last_became_active":"2024-09-19T05:46:55.381030+0000","last_became_peered":"2024-09-19T05:46:55.381030+0000","last_unstale":"2024-09-19T05:46:56.434280+0000","last_undegraded":"2024-09-19T05:46:56.434280+0000","last_fullsized":"2024-09-19T05:46:56.434280+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:12.195997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.434479+0000","last_change":"2024-09-19T05:46:56.412185+0000","last_active":"2024-09-19T05:46:56.434479+0000","last_peered":"2024-09-19T05:46:56.434479+0000","last_clean":"2024-09-19T05:46:56.434479+0000","last_became_active":"2024-09-19T05:46:56.411407+0000","last_became_peered":"2024-09-19T05:46:56.411407+0000","last_unstale":"2024-09-19T05:46:56.434479+0000","last_undegraded":"2024-09-19T05:46:56.434479+0000","last_fullsized":"2024-09-19T05:46:56.434479+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:16.004428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"178'1","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.420169+0000","last_change":"2024-09-19T05:46:55.356971+0000","last_active":"2024-09-19T05:46:56.420169+0000","last_peered":"2024-09-19T05:46:56.420169+0000","last_clean":"2024-09-19T05:46:56.420169+0000","last_became_active":"2024-09-19T05:46:55.356272+0000","last_became_peered":"2024-09-19T05:46:55.356272+0000","last_unstale":"2024-09-19T05:46:56.420169+0000","last_undegraded":"2024-09-19T05:46:56.420169+0000","last_fullsized":"2024-09-19T05:46:56.420169+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:44.103388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412520+0000","last_change":"2024-09-19T05:46:56.419430+0000","last_active":"2024-09-19T05:46:57.412520+0000","last_peered":"2024-09-19T05:46:57.412520+0000","last_clean":"2024-09-19T05:46:57.412520+0000","last_became_active":"2024-09-19T05:46:56.419145+0000","last_became_peered":"2024-09-19T05:46:56.419145+0000","last_unstale":"2024-09-19T05:46:57.412520+0000","last_undegraded":"2024-09-19T05:46:57.412520+0000","last_fullsized":"2024-09-19T05:46:57.412520+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:50.097904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.399975+0000","last_change":"2024-09-19T05:46:55.375691+0000","last_active":"2024-09-19T05:46:56.399975+0000","last_peered":"2024-09-19T05:46:56.399975+0000","last_clean":"2024-09-19T05:46:56.399975+0000","last_became_active":"2024-09-19T05:46:55.374903+0000","last_became_peered":"2024-09-19T05:46:55.374903+0000","last_unstale":"2024-09-19T05:46:56.399975+0000","last_undegraded":"2024-09-19T05:46:56.399975+0000","last_fullsized":"2024-09-19T05:46:56.399975+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:04.084910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.411631+0000","last_change":"2024-09-19T05:46:56.418111+0000","last_active":"2024-09-19T05:46:57.411631+0000","last_peered":"2024-09-19T05:46:57.411631+0000","last_clean":"2024-09-19T05:46:57.411631+0000","last_became_active":"2024-09-19T05:46:56.417811+0000","last_became_peered":"2024-09-19T05:46:56.417811+0000","last_unstale":"2024-09-19T05:46:57.411631+0000","last_undegraded":"2024-09-19T05:46:57.411631+0000","last_fullsized":"2024-09-19T05:46:57.411631+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:04.223766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"178'2","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413028+0000","last_change":"2024-09-19T05:46:55.385756+0000","last_active":"2024-09-19T05:46:57.413028+0000","last_peered":"2024-09-19T05:46:57.413028+0000","last_clean":"2024-09-19T05:46:57.413028+0000","last_became_active":"2024-09-19T05:46:55.385062+0000","last_became_peered":"2024-09-19T05:46:55.385062+0000","last_unstale":"2024-09-19T05:46:57.413028+0000","last_undegraded":"2024-09-19T05:46:57.413028+0000","last_fullsized":"2024-09-19T05:46:57.413028+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:21.540060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.414972+0000","last_change":"2024-09-19T05:46:56.410353+0000","last_active":"2024-09-19T05:46:56.414972+0000","last_peered":"2024-09-19T05:46:56.414972+0000","last_clean":"2024-09-19T05:46:56.414972+0000","last_became_active":"2024-09-19T05:46:56.410030+0000","last_became_peered":"2024-09-19T05:46:56.410030+0000","last_unstale":"2024-09-19T05:46:56.414972+0000","last_undegraded":"2024-09-19T05:46:56.414972+0000","last_fullsized":"2024-09-19T05:46:56.414972+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:50.097904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.396189+0000","last_change":"2024-09-19T05:46:55.378033+0000","last_active":"2024-09-19T05:46:56.396189+0000","last_peered":"2024-09-19T05:46:56.396189+0000","last_clean":"2024-09-19T05:46:56.396189+0000","last_became_active":"2024-09-19T05:46:55.377730+0000","last_became_peered":"2024-09-19T05:46:55.377730+0000","last_unstale":"2024-09-19T05:46:56.396189+0000","last_undegraded":"2024-09-19T05:46:56.396189+0000","last_fullsized":"2024-09-19T05:46:56.396189+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:12.091688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.420756+0000","last_change":"2024-09-19T05:46:56.415024+0000","last_active":"2024-09-19T05:46:56.420756+0000","last_peered":"2024-09-19T05:46:56.420756+0000","last_clean":"2024-09-19T05:46:56.420756+0000","last_became_active":"2024-09-19T05:46:56.414674+0000","last_became_peered":"2024-09-19T05:46:56.414674+0000","last_unstale":"2024-09-19T05:46:56.420756+0000","last_undegraded":"2024-09-19T05:46:56.420756+0000","last_fullsized":"2024-09-19T05:46:56.420756+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:52.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416364+0000","last_change":"2024-09-19T05:46:55.369546+0000","last_active":"2024-09-19T05:46:57.416364+0000","last_peered":"2024-09-19T05:46:57.416364+0000","last_clean":"2024-09-19T05:46:57.416364+0000","last_became_active":"2024-09-19T05:46:55.369082+0000","last_became_peered":"2024-09-19T05:46:55.369082+0000","last_unstale":"2024-09-19T05:46:57.416364+0000","last_undegraded":"2024-09-19T05:46:57.416364+0000","last_fullsized":"2024-09-19T05:46:57.416364+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:36.267601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.417023+0000","last_change":"2024-09-19T05:46:56.408855+0000","last_active":"2024-09-19T05:46:56.417023+0000","last_peered":"2024-09-19T05:46:56.417023+0000","last_clean":"2024-09-19T05:46:56.417023+0000","last_became_active":"2024-09-19T05:46:56.406018+0000","last_became_peered":"2024-09-19T05:46:56.406018+0000","last_unstale":"2024-09-19T05:46:56.417023+0000","last_undegraded":"2024-09-19T05:46:56.417023+0000","last_fullsized":"2024-09-19T05:46:56.417023+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.032367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.391941+0000","last_change":"2024-09-19T05:46:55.377244+0000","last_active":"2024-09-19T05:46:56.391941+0000","last_peered":"2024-09-19T05:46:56.391941+0000","last_clean":"2024-09-19T05:46:56.391941+0000","last_became_active":"2024-09-19T05:46:55.376639+0000","last_became_peered":"2024-09-19T05:46:55.376639+0000","last_unstale":"2024-09-19T05:46:56.391941+0000","last_undegraded":"2024-09-19T05:46:56.391941+0000","last_fullsized":"2024-09-19T05:46:56.391941+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:14.328319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416576+0000","last_change":"2024-09-19T05:46:56.414309+0000","last_active":"2024-09-19T05:46:57.416576+0000","last_peered":"2024-09-19T05:46:57.416576+0000","last_clean":"2024-09-19T05:46:57.416576+0000","last_became_active":"2024-09-19T05:46:56.413900+0000","last_became_peered":"2024-09-19T05:46:56.413900+0000","last_unstale":"2024-09-19T05:46:57.416576+0000","last_undegraded":"2024-09-19T05:46:57.416576+0000","last_fullsized":"2024-09-19T05:46:57.416576+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:35.404360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"178'2","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.438027+0000","last_change":"2024-09-19T05:46:55.374862+0000","last_active":"2024-09-19T05:46:56.438027+0000","last_peered":"2024-09-19T05:46:56.438027+0000","last_clean":"2024-09-19T05:46:56.438027+0000","last_became_active":"2024-09-19T05:46:55.374177+0000","last_became_peered":"2024-09-19T05:46:55.374177+0000","last_unstale":"2024-09-19T05:46:56.438027+0000","last_undegraded":"2024-09-19T05:46:56.438027+0000","last_fullsized":"2024-09-19T05:46:56.438027+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:09.065740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412600+0000","last_change":"2024-09-19T05:46:56.411761+0000","last_active":"2024-09-19T05:46:57.412600+0000","last_peered":"2024-09-19T05:46:57.412600+0000","last_clean":"2024-09-19T05:46:57.412600+0000","last_became_active":"2024-09-19T05:46:56.411399+0000","last_became_peered":"2024-09-19T05:46:56.411399+0000","last_unstale":"2024-09-19T05:46:57.412600+0000","last_undegraded":"2024-09-19T05:46:57.412600+0000","last_fullsized":"2024-09-19T05:46:57.412600+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:49.622752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"178'1","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416294+0000","last_change":"2024-09-19T05:46:55.371416+0000","last_active":"2024-09-19T05:46:57.416294+0000","last_peered":"2024-09-19T05:46:57.416294+0000","last_clean":"2024-09-19T05:46:57.416294+0000","last_became_active":"2024-09-19T05:46:55.366002+0000","last_became_peered":"2024-09-19T05:46:55.366002+0000","last_unstale":"2024-09-19T05:46:57.416294+0000","last_undegraded":"2024-09-19T05:46:57.416294+0000","last_fullsized":"2024-09-19T05:46:57.416294+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:25.420890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.434652+0000","last_change":"2024-09-19T05:46:56.426027+0000","last_active":"2024-09-19T05:46:56.434652+0000","last_peered":"2024-09-19T05:46:56.434652+0000","last_clean":"2024-09-19T05:46:56.434652+0000","last_became_active":"2024-09-19T05:46:56.414873+0000","last_became_peered":"2024-09-19T05:46:56.414873+0000","last_unstale":"2024-09-19T05:46:56.434652+0000","last_undegraded":"2024-09-19T05:46:56.434652+0000","last_fullsized":"2024-09-19T05:46:56.434652+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:30.403331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.406677+0000","last_change":"2024-09-19T05:46:55.382880+0000","last_active":"2024-09-19T05:46:56.406677+0000","last_peered":"2024-09-19T05:46:56.406677+0000","last_clean":"2024-09-19T05:46:56.406677+0000","last_became_active":"2024-09-19T05:46:55.382558+0000","last_became_peered":"2024-09-19T05:46:55.382558+0000","last_unstale":"2024-09-19T05:46:56.406677+0000","last_undegraded":"2024-09-19T05:46:56.406677+0000","last_fullsized":"2024-09-19T05:46:56.406677+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:51.953430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416758+0000","last_change":"2024-09-19T05:46:56.434241+0000","last_active":"2024-09-19T05:46:57.416758+0000","last_peered":"2024-09-19T05:46:57.416758+0000","last_clean":"2024-09-19T05:46:57.416758+0000","last_became_active":"2024-09-19T05:46:56.433967+0000","last_became_peered":"2024-09-19T05:46:56.433967+0000","last_unstale":"2024-09-19T05:46:57.416758+0000","last_undegraded":"2024-09-19T05:46:57.416758+0000","last_fullsized":"2024-09-19T05:46:57.416758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:09.382734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.406290+0000","last_change":"2024-09-19T05:46:55.385992+0000","last_active":"2024-09-19T05:46:56.406290+0000","last_peered":"2024-09-19T05:46:56.406290+0000","last_clean":"2024-09-19T05:46:56.406290+0000","last_became_active":"2024-09-19T05:46:55.385687+0000","last_became_peered":"2024-09-19T05:46:55.385687+0000","last_unstale":"2024-09-19T05:46:56.406290+0000","last_undegraded":"2024-09-19T05:46:56.406290+0000","last_fullsized":"2024-09-19T05:46:56.406290+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.756914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.410220+0000","last_change":"2024-09-19T05:46:56.403059+0000","last_active":"2024-09-19T05:46:56.410220+0000","last_peered":"2024-09-19T05:46:56.410220+0000","last_clean":"2024-09-19T05:46:56.410220+0000","last_became_active":"2024-09-19T05:46:56.402258+0000","last_became_peered":"2024-09-19T05:46:56.402258+0000","last_unstale":"2024-09-19T05:46:56.410220+0000","last_undegraded":"2024-09-19T05:46:56.410220+0000","last_fullsized":"2024-09-19T05:46:56.410220+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:04.557450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.391280+0000","last_change":"2024-09-19T05:46:55.386898+0000","last_active":"2024-09-19T05:46:56.391280+0000","last_peered":"2024-09-19T05:46:56.391280+0000","last_clean":"2024-09-19T05:46:56.391280+0000","last_became_active":"2024-09-19T05:46:55.386388+0000","last_became_peered":"2024-09-19T05:46:55.386388+0000","last_unstale":"2024-09-19T05:46:56.391280+0000","last_undegraded":"2024-09-19T05:46:56.391280+0000","last_fullsized":"2024-09-19T05:46:56.391280+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:26.370648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412627+0000","last_change":"2024-09-19T05:46:56.406658+0000","last_active":"2024-09-19T05:46:57.412627+0000","last_peered":"2024-09-19T05:46:57.412627+0000","last_clean":"2024-09-19T05:46:57.412627+0000","last_became_active":"2024-09-19T05:46:56.405204+0000","last_became_peered":"2024-09-19T05:46:56.405204+0000","last_unstale":"2024-09-19T05:46:57.412627+0000","last_undegraded":"2024-09-19T05:46:57.412627+0000","last_fullsized":"2024-09-19T05:46:57.412627+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:02.553384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.390239+0000","last_change":"2024-09-19T05:46:55.388653+0000","last_active":"2024-09-19T05:46:56.390239+0000","last_peered":"2024-09-19T05:46:56.390239+0000","last_clean":"2024-09-19T05:46:56.390239+0000","last_became_active":"2024-09-19T05:46:55.388058+0000","last_became_peered":"2024-09-19T05:46:55.388058+0000","last_unstale":"2024-09-19T05:46:56.390239+0000","last_undegraded":"2024-09-19T05:46:56.390239+0000","last_fullsized":"2024-09-19T05:46:56.390239+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:15.840238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412341+0000","last_change":"2024-09-19T05:46:56.418218+0000","last_active":"2024-09-19T05:46:57.412341+0000","last_peered":"2024-09-19T05:46:57.412341+0000","last_clean":"2024-09-19T05:46:57.412341+0000","last_became_active":"2024-09-19T05:46:56.417844+0000","last_became_peered":"2024-09-19T05:46:56.417844+0000","last_unstale":"2024-09-19T05:46:57.412341+0000","last_undegraded":"2024-09-19T05:46:57.412341+0000","last_fullsized":"2024-09-19T05:46:57.412341+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:02.481741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416464+0000","last_change":"2024-09-19T05:46:55.372032+0000","last_active":"2024-09-19T05:46:57.416464+0000","last_peered":"2024-09-19T05:46:57.416464+0000","last_clean":"2024-09-19T05:46:57.416464+0000","last_became_active":"2024-09-19T05:46:55.371711+0000","last_became_peered":"2024-09-19T05:46:55.371711+0000","last_unstale":"2024-09-19T05:46:57.416464+0000","last_undegraded":"2024-09-19T05:46:57.416464+0000","last_fullsized":"2024-09-19T05:46:57.416464+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.687056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.427392+0000","last_change":"2024-09-19T05:46:56.414141+0000","last_active":"2024-09-19T05:46:56.427392+0000","last_peered":"2024-09-19T05:46:56.427392+0000","last_clean":"2024-09-19T05:46:56.427392+0000","last_became_active":"2024-09-19T05:46:56.413332+0000","last_became_peered":"2024-09-19T05:46:56.413332+0000","last_unstale":"2024-09-19T05:46:56.427392+0000","last_undegraded":"2024-09-19T05:46:56.427392+0000","last_fullsized":"2024-09-19T05:46:56.427392+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:01.960580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.392388+0000","last_change":"2024-09-19T05:46:55.354512+0000","last_active":"2024-09-19T05:46:56.392388+0000","last_peered":"2024-09-19T05:46:56.392388+0000","last_clean":"2024-09-19T05:46:56.392388+0000","last_became_active":"2024-09-19T05:46:55.353633+0000","last_became_peered":"2024-09-19T05:46:55.353633+0000","last_unstale":"2024-09-19T05:46:56.392388+0000","last_undegraded":"2024-09-19T05:46:56.392388+0000","last_fullsized":"2024-09-19T05:46:56.392388+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:55.825183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.417006+0000","last_change":"2024-09-19T05:46:56.406733+0000","last_active":"2024-09-19T05:46:56.417006+0000","last_peered":"2024-09-19T05:46:56.417006+0000","last_clean":"2024-09-19T05:46:56.417006+0000","last_became_active":"2024-09-19T05:46:56.405885+0000","last_became_peered":"2024-09-19T05:46:56.405885+0000","last_unstale":"2024-09-19T05:46:56.417006+0000","last_undegraded":"2024-09-19T05:46:56.417006+0000","last_fullsized":"2024-09-19T05:46:56.417006+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:04.637460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.393639+0000","last_change":"2024-09-19T05:46:55.380816+0000","last_active":"2024-09-19T05:46:56.393639+0000","last_peered":"2024-09-19T05:46:56.393639+0000","last_clean":"2024-09-19T05:46:56.393639+0000","last_became_active":"2024-09-19T05:46:55.380103+0000","last_became_peered":"2024-09-19T05:46:55.380103+0000","last_unstale":"2024-09-19T05:46:56.393639+0000","last_undegraded":"2024-09-19T05:46:56.393639+0000","last_fullsized":"2024-09-19T05:46:56.393639+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:42.706512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":456,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.394174+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:46:56.394174+0000","last_peered":"2024-09-19T05:46:56.394174+0000","last_clean":"2024-09-19T05:46:56.394174+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:46:56.394174+0000","last_undegraded":"2024-09-19T05:46:56.394174+0000","last_fullsized":"2024-09-19T05:46:56.394174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542313,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70056,"kb_used_data":2764,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301784,"statfs":{"total":96636764160,"available":96565026816,"internally_reserved":0,"allocated":2830336,"data_stored":1647414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542313,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69476,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302364,"statfs":{"total":96636764160,"available":96565620736,"internally_reserved":0,"allocated":2240512,"data_stored":1057116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542315,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47284,"kb_used_data":2200,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324556,"statfs":{"total":96636764160,"available":96588345344,"internally_reserved":0,"allocated":2252800,"data_stored":1058680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542313,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73644,"kb_used_data":2200,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298196,"statfs":{"total":96636764160,"available":96561352704,"internally_reserved":0,"allocated":2252800,"data_stored":1058692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542314,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69420,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302420,"statfs":{"total":96636764160,"available":96565678080,"internally_reserved":0,"allocated":2244608,"data_stored":1057206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542314,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73636,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298204,"statfs":{"total":96636764160,"available":96561360896,"internally_reserved":0,"allocated":2240512,"data_stored":1057628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542316,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47268,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324572,"statfs":{"total":96636764160,"available":96588361728,"internally_reserved":0,"allocated":2236416,"data_stored":1057046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542313,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78384,"kb_used_data":2780,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293456,"statfs":{"total":96636764160,"available":96556498944,"internally_reserved":0,"allocated":2846720,"data_stored":1648142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:47:00.438 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:47:00.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.588+0000 7fcedbaca640 1 Processor -- start 2024-09-19T05:47:00.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.588+0000 7fcedbaca640 1 -- start start 2024-09-19T05:47:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.588+0000 7fcedbaca640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fced406bcc0 0x7fced406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.588+0000 7fcedbaca640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced40b1d70 con 0x7fced415fb00 2024-09-19T05:47:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.588+0000 7fcedbaca640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced415eb90 con 0x7fced40b1990 2024-09-19T05:47:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.588+0000 7fcedbaca640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fced415f950 con 0x7fced406bcc0 2024-09-19T05:47:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.588+0000 7fced9065640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fced406bcc0 0x7fced406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.588+0000 7fceda067640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fced415fb00 0x7fced415ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46930/0 (socket says 172.21.15.67:46930) 2024-09-19T05:47:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.588+0000 7fceda067640 1 -- 172.21.15.67:0/4059066029 learned_addr learned my addr 172.21.15.67:0/4059066029 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fced9065640 1 -- 172.21.15.67:0/4059066029 >> v1:172.21.15.97:6789/0 conn(0x7fced40b1990 legacy=0x7fced40b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fced9065640 1 -- 172.21.15.67:0/4059066029 >> v1:172.21.15.67:6789/0 conn(0x7fced415fb00 legacy=0x7fced415ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fced9065640 1 -- 172.21.15.67:0/4059066029 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced415ee70 con 0x7fced406bcc0 2024-09-19T05:47:00.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fced8864640 1 -- 172.21.15.67:0/4059066029 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884292811 0 0) 0x7fced40b1d70 con 0x7fced415fb00 2024-09-19T05:47:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fced9065640 1 --2- 172.21.15.67:0/4059066029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 0x7fced406c130 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fcec40097c0 tx=0x7fcec401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8b2e85cd0ddbf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fced8864640 1 -- 172.21.15.67:0/4059066029 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec40b1070 con 0x7fced406bcc0 2024-09-19T05:47:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fced8864640 1 -- 172.21.15.67:0/4059066029 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec40ac640 con 0x7fced406bcc0 2024-09-19T05:47:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fced8864640 1 -- 172.21.15.67:0/4059066029 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec40aca10 con 0x7fced406bcc0 2024-09-19T05:47:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fcedbaca640 1 -- 172.21.15.67:0/4059066029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 msgr2=0x7fced406c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fcedbaca640 1 --2- 172.21.15.67:0/4059066029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 0x7fced406c130 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fcec40097c0 tx=0x7fcec401c420 comp rx=0 tx=0).stop 2024-09-19T05:47:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fcedbaca640 1 -- 172.21.15.67:0/4059066029 shutdown_connections 2024-09-19T05:47:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fcedbaca640 1 --2- 172.21.15.67:0/4059066029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 0x7fced406c130 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fcedbaca640 1 -- 172.21.15.67:0/4059066029 >> 172.21.15.67:0/4059066029 conn(0x7fced409aa30 msgr2=0x7fced40b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fcedbaca640 1 -- 172.21.15.67:0/4059066029 shutdown_connections 2024-09-19T05:47:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.592+0000 7fcedbaca640 1 -- 172.21.15.67:0/4059066029 wait complete. 2024-09-19T05:47:00.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 Processor -- start 2024-09-19T05:47:00.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 -- start start 2024-09-19T05:47:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 0x7fced414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced40b1990 0x7fced4154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced415fb00 0x7fced4157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fced40b29b0 con 0x7fced406bcc0 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fced406c670 con 0x7fced415fb00 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fced414df30 con 0x7fced40b1990 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fced9866640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 0x7fced414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fced9866640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 0x7fced414efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43762/0 (socket says 172.21.15.67:43762) 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fced9866640 1 -- 172.21.15.67:0/1034606209 learned_addr learned my addr 172.21.15.67:0/1034606209 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fced9866640 1 -- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced40b1990 msgr2=0x7fced4154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fced9866640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced40b1990 0x7fced4154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fced9866640 1 -- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced415fb00 msgr2=0x7fced4157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fced9866640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced415fb00 0x7fced4157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fced9866640 1 -- 172.21.15.67:0/1034606209 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced414e210 con 0x7fced406bcc0 2024-09-19T05:47:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fced9866640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 0x7fced414efd0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fced000c450 tx=0x7fced000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fceca7fc640 1 -- 172.21.15.67:0/1034606209 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0012830 con 0x7fced406bcc0 2024-09-19T05:47:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fceca7fc640 1 -- 172.21.15.67:0/1034606209 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced0017070 con 0x7fced406bcc0 2024-09-19T05:47:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fceca7fc640 1 -- 172.21.15.67:0/1034606209 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0012c10 con 0x7fced406bcc0 2024-09-19T05:47:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 -- 172.21.15.67:0/1034606209 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced414e4f0 con 0x7fced406bcc0 2024-09-19T05:47:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 -- 172.21.15.67:0/1034606209 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced414eab0 con 0x7fced406bcc0 2024-09-19T05:47:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fcedbaca640 1 -- 172.21.15.67:0/1034606209 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced406c130 con 0x7fced406bcc0 2024-09-19T05:47:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fceca7fc640 1 -- 172.21.15.67:0/1034606209 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fced001c460 con 0x7fced406bcc0 2024-09-19T05:47:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fceca7fc640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fceb80678c0 0x7fceb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.596+0000 7fceca7fc640 1 -- 172.21.15.67:0/1034606209 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7fced0085ba0 con 0x7fced406bcc0 2024-09-19T05:47:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.600+0000 7fced9065640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fceb80678c0 0x7fceb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.600+0000 7fced9065640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fceb80678c0 0x7fceb8069d80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fcec40ae000 tx=0x7fcec4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:00.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.604+0000 7fceca7fc640 1 -- 172.21.15.67:0/1034606209 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fced00565e0 con 0x7fced406bcc0 2024-09-19T05:47:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.760+0000 7fcedbaca640 1 -- 172.21.15.67:0/1034606209 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fced4169da0 con 0x7fceb80678c0 2024-09-19T05:47:00.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.780+0000 7fceca7fc640 1 -- 172.21.15.67:0/1034606209 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252449 (secure 0 0 0) 0x7fced4169da0 con 0x7fceb80678c0 2024-09-19T05:47:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:00.783 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:47:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 -- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fceb80678c0 msgr2=0x7fceb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fceb80678c0 0x7fceb8069d80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fcec40ae000 tx=0x7fcec4008040 comp rx=0 tx=0).stop 2024-09-19T05:47:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 -- 172.21.15.67:0/1034606209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 msgr2=0x7fced414efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 0x7fced414efd0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fced000c450 tx=0x7fced000c910 comp rx=0 tx=0).stop 2024-09-19T05:47:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 -- 172.21.15.67:0/1034606209 shutdown_connections 2024-09-19T05:47:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced415fb00 0x7fced4157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fceb80678c0 0x7fceb8069d80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced40b1990 0x7fced4154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 --2- 172.21.15.67:0/1034606209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced406bcc0 0x7fced414efd0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 -- 172.21.15.67:0/1034606209 >> 172.21.15.67:0/1034606209 conn(0x7fced409aa30 msgr2=0x7fced415ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:00.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 -- 172.21.15.67:0/1034606209 shutdown_connections 2024-09-19T05:47:00.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.784+0000 7fcedbaca640 1 -- 172.21.15.67:0/1034606209 wait complete. 2024-09-19T05:47:00.801 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":591,"stamp":"2024-09-19T05:46:59.395795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":529168,"kb_used_data":18696,"kb_used_omap":12,"kb_used_meta":510259,"kb_avail":754445552,"statfs":{"total":773094113280,"available":772552245248,"internally_reserved":0,"allocated":19144704,"data_stored":9641924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":522505777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.053959"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412201+0000","last_change":"2024-09-19T05:46:56.430847+0000","last_active":"2024-09-19T05:46:57.412201+0000","last_peered":"2024-09-19T05:46:57.412201+0000","last_clean":"2024-09-19T05:46:57.412201+0000","last_became_active":"2024-09-19T05:46:56.430554+0000","last_became_peered":"2024-09-19T05:46:56.430554+0000","last_unstale":"2024-09-19T05:46:57.412201+0000","last_undegraded":"2024-09-19T05:46:57.412201+0000","last_fullsized":"2024-09-19T05:46:57.412201+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:13.205115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413297+0000","last_change":"2024-09-19T05:46:56.426232+0000","last_active":"2024-09-19T05:46:57.413297+0000","last_peered":"2024-09-19T05:46:57.413297+0000","last_clean":"2024-09-19T05:46:57.413297+0000","last_became_active":"2024-09-19T05:46:56.425892+0000","last_became_peered":"2024-09-19T05:46:56.425892+0000","last_unstale":"2024-09-19T05:46:57.413297+0000","last_undegraded":"2024-09-19T05:46:57.413297+0000","last_fullsized":"2024-09-19T05:46:57.413297+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.032367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.410200+0000","last_change":"2024-09-19T05:46:56.402538+0000","last_active":"2024-09-19T05:46:56.410200+0000","last_peered":"2024-09-19T05:46:56.410200+0000","last_clean":"2024-09-19T05:46:56.410200+0000","last_became_active":"2024-09-19T05:46:56.401760+0000","last_became_peered":"2024-09-19T05:46:56.401760+0000","last_unstale":"2024-09-19T05:46:56.410200+0000","last_undegraded":"2024-09-19T05:46:56.410200+0000","last_fullsized":"2024-09-19T05:46:56.410200+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:53.576825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.410118+0000","last_change":"2024-09-19T05:46:56.406938+0000","last_active":"2024-09-19T05:46:56.410118+0000","last_peered":"2024-09-19T05:46:56.410118+0000","last_clean":"2024-09-19T05:46:56.410118+0000","last_became_active":"2024-09-19T05:46:56.405450+0000","last_became_peered":"2024-09-19T05:46:56.405450+0000","last_unstale":"2024-09-19T05:46:56.410118+0000","last_undegraded":"2024-09-19T05:46:56.410118+0000","last_fullsized":"2024-09-19T05:46:56.410118+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:26.766033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.418051+0000","last_change":"2024-09-19T05:46:56.414196+0000","last_active":"2024-09-19T05:46:56.418051+0000","last_peered":"2024-09-19T05:46:56.418051+0000","last_clean":"2024-09-19T05:46:56.418051+0000","last_became_active":"2024-09-19T05:46:56.413619+0000","last_became_peered":"2024-09-19T05:46:56.413619+0000","last_unstale":"2024-09-19T05:46:56.418051+0000","last_undegraded":"2024-09-19T05:46:56.418051+0000","last_fullsized":"2024-09-19T05:46:56.418051+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:54.033978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.418289+0000","last_change":"2024-09-19T05:46:56.411397+0000","last_active":"2024-09-19T05:46:56.418289+0000","last_peered":"2024-09-19T05:46:56.418289+0000","last_clean":"2024-09-19T05:46:56.418289+0000","last_became_active":"2024-09-19T05:46:56.411114+0000","last_became_peered":"2024-09-19T05:46:56.411114+0000","last_unstale":"2024-09-19T05:46:56.418289+0000","last_undegraded":"2024-09-19T05:46:56.418289+0000","last_fullsized":"2024-09-19T05:46:56.418289+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:12.007024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416179+0000","last_change":"2024-09-19T05:46:56.430277+0000","last_active":"2024-09-19T05:46:57.416179+0000","last_peered":"2024-09-19T05:46:57.416179+0000","last_clean":"2024-09-19T05:46:57.416179+0000","last_became_active":"2024-09-19T05:46:56.429897+0000","last_became_peered":"2024-09-19T05:46:56.429897+0000","last_unstale":"2024-09-19T05:46:57.416179+0000","last_undegraded":"2024-09-19T05:46:57.416179+0000","last_fullsized":"2024-09-19T05:46:57.416179+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:11.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.439477+0000","last_change":"2024-09-19T05:46:56.436636+0000","last_active":"2024-09-19T05:46:56.439477+0000","last_peered":"2024-09-19T05:46:56.439477+0000","last_clean":"2024-09-19T05:46:56.439477+0000","last_became_active":"2024-09-19T05:46:56.435936+0000","last_became_peered":"2024-09-19T05:46:56.435936+0000","last_unstale":"2024-09-19T05:46:56.439477+0000","last_undegraded":"2024-09-19T05:46:56.439477+0000","last_fullsized":"2024-09-19T05:46:56.439477+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:38.008245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412358+0000","last_change":"2024-09-19T05:46:56.406692+0000","last_active":"2024-09-19T05:46:57.412358+0000","last_peered":"2024-09-19T05:46:57.412358+0000","last_clean":"2024-09-19T05:46:57.412358+0000","last_became_active":"2024-09-19T05:46:56.406260+0000","last_became_peered":"2024-09-19T05:46:56.406260+0000","last_unstale":"2024-09-19T05:46:57.412358+0000","last_undegraded":"2024-09-19T05:46:57.412358+0000","last_fullsized":"2024-09-19T05:46:57.412358+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:10.074858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.435714+0000","last_change":"2024-09-19T05:46:56.435181+0000","last_active":"2024-09-19T05:46:56.435714+0000","last_peered":"2024-09-19T05:46:56.435714+0000","last_clean":"2024-09-19T05:46:56.435714+0000","last_became_active":"2024-09-19T05:46:56.434721+0000","last_became_peered":"2024-09-19T05:46:56.434721+0000","last_unstale":"2024-09-19T05:46:56.435714+0000","last_undegraded":"2024-09-19T05:46:56.435714+0000","last_fullsized":"2024-09-19T05:46:56.435714+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:29.626814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.439849+0000","last_change":"2024-09-19T05:46:56.432157+0000","last_active":"2024-09-19T05:46:56.439849+0000","last_peered":"2024-09-19T05:46:56.439849+0000","last_clean":"2024-09-19T05:46:56.439849+0000","last_became_active":"2024-09-19T05:46:56.423739+0000","last_became_peered":"2024-09-19T05:46:56.423739+0000","last_unstale":"2024-09-19T05:46:56.439849+0000","last_undegraded":"2024-09-19T05:46:56.439849+0000","last_fullsized":"2024-09-19T05:46:56.439849+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.906715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.429453+0000","last_change":"2024-09-19T05:46:56.428923+0000","last_active":"2024-09-19T05:46:56.429453+0000","last_peered":"2024-09-19T05:46:56.429453+0000","last_clean":"2024-09-19T05:46:56.429453+0000","last_became_active":"2024-09-19T05:46:56.428556+0000","last_became_peered":"2024-09-19T05:46:56.428556+0000","last_unstale":"2024-09-19T05:46:56.429453+0000","last_undegraded":"2024-09-19T05:46:56.429453+0000","last_fullsized":"2024-09-19T05:46:56.429453+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:49.622752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412384+0000","last_change":"2024-09-19T05:46:56.409132+0000","last_active":"2024-09-19T05:46:57.412384+0000","last_peered":"2024-09-19T05:46:57.412384+0000","last_clean":"2024-09-19T05:46:57.412384+0000","last_became_active":"2024-09-19T05:46:56.408393+0000","last_became_peered":"2024-09-19T05:46:56.408393+0000","last_unstale":"2024-09-19T05:46:57.412384+0000","last_undegraded":"2024-09-19T05:46:57.412384+0000","last_fullsized":"2024-09-19T05:46:57.412384+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:02.946551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416732+0000","last_change":"2024-09-19T05:46:56.390482+0000","last_active":"2024-09-19T05:46:57.416732+0000","last_peered":"2024-09-19T05:46:57.416732+0000","last_clean":"2024-09-19T05:46:57.416732+0000","last_became_active":"2024-09-19T05:46:56.389619+0000","last_became_peered":"2024-09-19T05:46:56.389619+0000","last_unstale":"2024-09-19T05:46:57.416732+0000","last_undegraded":"2024-09-19T05:46:57.416732+0000","last_fullsized":"2024-09-19T05:46:57.416732+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:29.679618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.411692+0000","last_change":"2024-09-19T05:46:56.415819+0000","last_active":"2024-09-19T05:46:57.411692+0000","last_peered":"2024-09-19T05:46:57.411692+0000","last_clean":"2024-09-19T05:46:57.411692+0000","last_became_active":"2024-09-19T05:46:56.415536+0000","last_became_peered":"2024-09-19T05:46:56.415536+0000","last_unstale":"2024-09-19T05:46:57.411692+0000","last_undegraded":"2024-09-19T05:46:57.411692+0000","last_fullsized":"2024-09-19T05:46:57.411692+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:49.415067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.418337+0000","last_change":"2024-09-19T05:46:56.413735+0000","last_active":"2024-09-19T05:46:56.418337+0000","last_peered":"2024-09-19T05:46:56.418337+0000","last_clean":"2024-09-19T05:46:56.418337+0000","last_became_active":"2024-09-19T05:46:56.413345+0000","last_became_peered":"2024-09-19T05:46:56.413345+0000","last_unstale":"2024-09-19T05:46:56.418337+0000","last_undegraded":"2024-09-19T05:46:56.418337+0000","last_fullsized":"2024-09-19T05:46:56.418337+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:22.526991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.437508+0000","last_change":"2024-09-19T05:46:56.437014+0000","last_active":"2024-09-19T05:46:56.437508+0000","last_peered":"2024-09-19T05:46:56.437508+0000","last_clean":"2024-09-19T05:46:56.437508+0000","last_became_active":"2024-09-19T05:46:56.436705+0000","last_became_peered":"2024-09-19T05:46:56.436705+0000","last_unstale":"2024-09-19T05:46:56.437508+0000","last_undegraded":"2024-09-19T05:46:56.437508+0000","last_fullsized":"2024-09-19T05:46:56.437508+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:21.993444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413022+0000","last_change":"2024-09-19T05:46:56.420533+0000","last_active":"2024-09-19T05:46:57.413022+0000","last_peered":"2024-09-19T05:46:57.413022+0000","last_clean":"2024-09-19T05:46:57.413022+0000","last_became_active":"2024-09-19T05:46:56.419738+0000","last_became_peered":"2024-09-19T05:46:56.419738+0000","last_unstale":"2024-09-19T05:46:57.413022+0000","last_undegraded":"2024-09-19T05:46:57.413022+0000","last_fullsized":"2024-09-19T05:46:57.413022+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:00.555563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412910+0000","last_change":"2024-09-19T05:46:56.430861+0000","last_active":"2024-09-19T05:46:57.412910+0000","last_peered":"2024-09-19T05:46:57.412910+0000","last_clean":"2024-09-19T05:46:57.412910+0000","last_became_active":"2024-09-19T05:46:56.430261+0000","last_became_peered":"2024-09-19T05:46:56.430261+0000","last_unstale":"2024-09-19T05:46:57.412910+0000","last_undegraded":"2024-09-19T05:46:57.412910+0000","last_fullsized":"2024-09-19T05:46:57.412910+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:53.538033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.429787+0000","last_change":"2024-09-19T05:46:56.429321+0000","last_active":"2024-09-19T05:46:56.429787+0000","last_peered":"2024-09-19T05:46:56.429787+0000","last_clean":"2024-09-19T05:46:56.429787+0000","last_became_active":"2024-09-19T05:46:56.428938+0000","last_became_peered":"2024-09-19T05:46:56.428938+0000","last_unstale":"2024-09-19T05:46:56.429787+0000","last_undegraded":"2024-09-19T05:46:56.429787+0000","last_fullsized":"2024-09-19T05:46:56.429787+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:00.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412380+0000","last_change":"2024-09-19T05:46:56.415517+0000","last_active":"2024-09-19T05:46:57.412380+0000","last_peered":"2024-09-19T05:46:57.412380+0000","last_clean":"2024-09-19T05:46:57.412380+0000","last_became_active":"2024-09-19T05:46:56.415046+0000","last_became_peered":"2024-09-19T05:46:56.415046+0000","last_unstale":"2024-09-19T05:46:57.412380+0000","last_undegraded":"2024-09-19T05:46:57.412380+0000","last_fullsized":"2024-09-19T05:46:57.412380+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:26.766033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412161+0000","last_change":"2024-09-19T05:46:56.409939+0000","last_active":"2024-09-19T05:46:57.412161+0000","last_peered":"2024-09-19T05:46:57.412161+0000","last_clean":"2024-09-19T05:46:57.412161+0000","last_became_active":"2024-09-19T05:46:56.409304+0000","last_became_peered":"2024-09-19T05:46:56.409304+0000","last_unstale":"2024-09-19T05:46:57.412161+0000","last_undegraded":"2024-09-19T05:46:57.412161+0000","last_fullsized":"2024-09-19T05:46:57.412161+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:36.402980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.435944+0000","last_change":"2024-09-19T05:46:56.427132+0000","last_active":"2024-09-19T05:46:56.435944+0000","last_peered":"2024-09-19T05:46:56.435944+0000","last_clean":"2024-09-19T05:46:56.435944+0000","last_became_active":"2024-09-19T05:46:56.426149+0000","last_became_peered":"2024-09-19T05:46:56.426149+0000","last_unstale":"2024-09-19T05:46:56.435944+0000","last_undegraded":"2024-09-19T05:46:56.435944+0000","last_fullsized":"2024-09-19T05:46:56.435944+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:32.617283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.411518+0000","last_change":"2024-09-19T05:46:56.430824+0000","last_active":"2024-09-19T05:46:57.411518+0000","last_peered":"2024-09-19T05:46:57.411518+0000","last_clean":"2024-09-19T05:46:57.411518+0000","last_became_active":"2024-09-19T05:46:56.430537+0000","last_became_peered":"2024-09-19T05:46:56.430537+0000","last_unstale":"2024-09-19T05:46:57.411518+0000","last_undegraded":"2024-09-19T05:46:57.411518+0000","last_fullsized":"2024-09-19T05:46:57.411518+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:43.715631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416657+0000","last_change":"2024-09-19T05:46:56.402977+0000","last_active":"2024-09-19T05:46:57.416657+0000","last_peered":"2024-09-19T05:46:57.416657+0000","last_clean":"2024-09-19T05:46:57.416657+0000","last_became_active":"2024-09-19T05:46:56.402543+0000","last_became_peered":"2024-09-19T05:46:56.402543+0000","last_unstale":"2024-09-19T05:46:57.416657+0000","last_undegraded":"2024-09-19T05:46:57.416657+0000","last_fullsized":"2024-09-19T05:46:57.416657+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:48.825008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.440811+0000","last_change":"2024-09-19T05:46:56.434153+0000","last_active":"2024-09-19T05:46:56.440811+0000","last_peered":"2024-09-19T05:46:56.440811+0000","last_clean":"2024-09-19T05:46:56.440811+0000","last_became_active":"2024-09-19T05:46:56.422649+0000","last_became_peered":"2024-09-19T05:46:56.422649+0000","last_unstale":"2024-09-19T05:46:56.440811+0000","last_undegraded":"2024-09-19T05:46:56.440811+0000","last_fullsized":"2024-09-19T05:46:56.440811+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:42.817714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.434840+0000","last_change":"2024-09-19T05:46:56.426506+0000","last_active":"2024-09-19T05:46:56.434840+0000","last_peered":"2024-09-19T05:46:56.434840+0000","last_clean":"2024-09-19T05:46:56.434840+0000","last_became_active":"2024-09-19T05:46:56.415420+0000","last_became_peered":"2024-09-19T05:46:56.415420+0000","last_unstale":"2024-09-19T05:46:56.434840+0000","last_undegraded":"2024-09-19T05:46:56.434840+0000","last_fullsized":"2024-09-19T05:46:56.434840+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:16.682160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.418855+0000","last_change":"2024-09-19T05:46:56.413793+0000","last_active":"2024-09-19T05:46:56.418855+0000","last_peered":"2024-09-19T05:46:56.418855+0000","last_clean":"2024-09-19T05:46:56.418855+0000","last_became_active":"2024-09-19T05:46:56.413482+0000","last_became_peered":"2024-09-19T05:46:56.413482+0000","last_unstale":"2024-09-19T05:46:56.418855+0000","last_undegraded":"2024-09-19T05:46:56.418855+0000","last_fullsized":"2024-09-19T05:46:56.418855+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:33.514723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.433168+0000","last_change":"2024-09-19T05:46:56.421869+0000","last_active":"2024-09-19T05:46:56.433168+0000","last_peered":"2024-09-19T05:46:56.433168+0000","last_clean":"2024-09-19T05:46:56.433168+0000","last_became_active":"2024-09-19T05:46:56.412733+0000","last_became_peered":"2024-09-19T05:46:56.412733+0000","last_unstale":"2024-09-19T05:46:56.433168+0000","last_undegraded":"2024-09-19T05:46:56.433168+0000","last_fullsized":"2024-09-19T05:46:56.433168+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:01.147014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.433228+0000","last_change":"2024-09-19T05:46:56.413456+0000","last_active":"2024-09-19T05:46:56.433228+0000","last_peered":"2024-09-19T05:46:56.433228+0000","last_clean":"2024-09-19T05:46:56.433228+0000","last_became_active":"2024-09-19T05:46:56.411834+0000","last_became_peered":"2024-09-19T05:46:56.411834+0000","last_unstale":"2024-09-19T05:46:56.433228+0000","last_undegraded":"2024-09-19T05:46:56.433228+0000","last_fullsized":"2024-09-19T05:46:56.433228+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:40.738985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416414+0000","last_change":"2024-09-19T05:46:56.408360+0000","last_active":"2024-09-19T05:46:57.416414+0000","last_peered":"2024-09-19T05:46:57.416414+0000","last_clean":"2024-09-19T05:46:57.416414+0000","last_became_active":"2024-09-19T05:46:56.407980+0000","last_became_peered":"2024-09-19T05:46:56.407980+0000","last_unstale":"2024-09-19T05:46:57.416414+0000","last_undegraded":"2024-09-19T05:46:57.416414+0000","last_fullsized":"2024-09-19T05:46:57.416414+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:53.180280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.435701+0000","last_change":"2024-09-19T05:46:56.435163+0000","last_active":"2024-09-19T05:46:56.435701+0000","last_peered":"2024-09-19T05:46:56.435701+0000","last_clean":"2024-09-19T05:46:56.435701+0000","last_became_active":"2024-09-19T05:46:56.434736+0000","last_became_peered":"2024-09-19T05:46:56.434736+0000","last_unstale":"2024-09-19T05:46:56.435701+0000","last_undegraded":"2024-09-19T05:46:56.435701+0000","last_fullsized":"2024-09-19T05:46:56.435701+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:01.533093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.438048+0000","last_change":"2024-09-19T05:46:56.415088+0000","last_active":"2024-09-19T05:46:56.438048+0000","last_peered":"2024-09-19T05:46:56.438048+0000","last_clean":"2024-09-19T05:46:56.438048+0000","last_became_active":"2024-09-19T05:46:56.414352+0000","last_became_peered":"2024-09-19T05:46:56.414352+0000","last_unstale":"2024-09-19T05:46:56.438048+0000","last_undegraded":"2024-09-19T05:46:56.438048+0000","last_fullsized":"2024-09-19T05:46:56.438048+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:23.360007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"178'4","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.421529+0000","last_change":"2024-09-19T05:46:55.378679+0000","last_active":"2024-09-19T05:46:56.421529+0000","last_peered":"2024-09-19T05:46:56.421529+0000","last_clean":"2024-09-19T05:46:56.421529+0000","last_became_active":"2024-09-19T05:46:55.378018+0000","last_became_peered":"2024-09-19T05:46:55.378018+0000","last_unstale":"2024-09-19T05:46:56.421529+0000","last_undegraded":"2024-09-19T05:46:56.421529+0000","last_fullsized":"2024-09-19T05:46:56.421529+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:01.472623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416897+0000","last_change":"2024-09-19T05:46:56.419108+0000","last_active":"2024-09-19T05:46:57.416897+0000","last_peered":"2024-09-19T05:46:57.416897+0000","last_clean":"2024-09-19T05:46:57.416897+0000","last_became_active":"2024-09-19T05:46:56.418718+0000","last_became_peered":"2024-09-19T05:46:56.418718+0000","last_unstale":"2024-09-19T05:46:57.416897+0000","last_undegraded":"2024-09-19T05:46:57.416897+0000","last_fullsized":"2024-09-19T05:46:57.416897+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:58.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"178'1","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.436744+0000","last_change":"2024-09-19T05:46:55.385961+0000","last_active":"2024-09-19T05:46:56.436744+0000","last_peered":"2024-09-19T05:46:56.436744+0000","last_clean":"2024-09-19T05:46:56.436744+0000","last_became_active":"2024-09-19T05:46:55.385437+0000","last_became_peered":"2024-09-19T05:46:55.385437+0000","last_unstale":"2024-09-19T05:46:56.436744+0000","last_undegraded":"2024-09-19T05:46:56.436744+0000","last_fullsized":"2024-09-19T05:46:56.436744+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:48.613634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.442175+0000","last_change":"2024-09-19T05:46:56.439807+0000","last_active":"2024-09-19T05:46:56.442175+0000","last_peered":"2024-09-19T05:46:56.442175+0000","last_clean":"2024-09-19T05:46:56.442175+0000","last_became_active":"2024-09-19T05:46:56.431751+0000","last_became_peered":"2024-09-19T05:46:56.431751+0000","last_unstale":"2024-09-19T05:46:56.442175+0000","last_undegraded":"2024-09-19T05:46:56.442175+0000","last_fullsized":"2024-09-19T05:46:56.442175+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:23:09.695988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"178'2","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.444404+0000","last_change":"2024-09-19T05:46:55.381255+0000","last_active":"2024-09-19T05:46:56.444404+0000","last_peered":"2024-09-19T05:46:56.444404+0000","last_clean":"2024-09-19T05:46:56.444404+0000","last_became_active":"2024-09-19T05:46:55.380322+0000","last_became_peered":"2024-09-19T05:46:55.380322+0000","last_unstale":"2024-09-19T05:46:56.444404+0000","last_undegraded":"2024-09-19T05:46:56.444404+0000","last_fullsized":"2024-09-19T05:46:56.444404+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:23.684469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.430016+0000","last_change":"2024-09-19T05:46:56.425393+0000","last_active":"2024-09-19T05:46:56.430016+0000","last_peered":"2024-09-19T05:46:56.430016+0000","last_clean":"2024-09-19T05:46:56.430016+0000","last_became_active":"2024-09-19T05:46:56.424844+0000","last_became_peered":"2024-09-19T05:46:56.424844+0000","last_unstale":"2024-09-19T05:46:56.430016+0000","last_undegraded":"2024-09-19T05:46:56.430016+0000","last_fullsized":"2024-09-19T05:46:56.430016+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:22.549179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"178'2","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412980+0000","last_change":"2024-09-19T05:46:55.378772+0000","last_active":"2024-09-19T05:46:57.412980+0000","last_peered":"2024-09-19T05:46:57.412980+0000","last_clean":"2024-09-19T05:46:57.412980+0000","last_became_active":"2024-09-19T05:46:55.377929+0000","last_became_peered":"2024-09-19T05:46:55.377929+0000","last_unstale":"2024-09-19T05:46:57.412980+0000","last_undegraded":"2024-09-19T05:46:57.412980+0000","last_fullsized":"2024-09-19T05:46:57.412980+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:40.514648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.411916+0000","last_change":"2024-09-19T05:46:56.418665+0000","last_active":"2024-09-19T05:46:57.411916+0000","last_peered":"2024-09-19T05:46:57.411916+0000","last_clean":"2024-09-19T05:46:57.411916+0000","last_became_active":"2024-09-19T05:46:56.416405+0000","last_became_peered":"2024-09-19T05:46:56.416405+0000","last_unstale":"2024-09-19T05:46:57.411916+0000","last_undegraded":"2024-09-19T05:46:57.411916+0000","last_fullsized":"2024-09-19T05:46:57.411916+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:04.598913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"178'1","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.436105+0000","last_change":"2024-09-19T05:46:55.385090+0000","last_active":"2024-09-19T05:46:56.436105+0000","last_peered":"2024-09-19T05:46:56.436105+0000","last_clean":"2024-09-19T05:46:56.436105+0000","last_became_active":"2024-09-19T05:46:55.382551+0000","last_became_peered":"2024-09-19T05:46:55.382551+0000","last_unstale":"2024-09-19T05:46:56.436105+0000","last_undegraded":"2024-09-19T05:46:56.436105+0000","last_fullsized":"2024-09-19T05:46:56.436105+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:03.912429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.411765+0000","last_change":"2024-09-19T05:46:56.409194+0000","last_active":"2024-09-19T05:46:57.411765+0000","last_peered":"2024-09-19T05:46:57.411765+0000","last_clean":"2024-09-19T05:46:57.411765+0000","last_became_active":"2024-09-19T05:46:56.408747+0000","last_became_peered":"2024-09-19T05:46:56.408747+0000","last_unstale":"2024-09-19T05:46:57.411765+0000","last_undegraded":"2024-09-19T05:46:57.411765+0000","last_fullsized":"2024-09-19T05:46:57.411765+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:13.100806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"178'1","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.420877+0000","last_change":"2024-09-19T05:46:55.387463+0000","last_active":"2024-09-19T05:46:56.420877+0000","last_peered":"2024-09-19T05:46:56.420877+0000","last_clean":"2024-09-19T05:46:56.420877+0000","last_became_active":"2024-09-19T05:46:55.387077+0000","last_became_peered":"2024-09-19T05:46:55.387077+0000","last_unstale":"2024-09-19T05:46:56.420877+0000","last_undegraded":"2024-09-19T05:46:56.420877+0000","last_fullsized":"2024-09-19T05:46:56.420877+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:48.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412590+0000","last_change":"2024-09-19T05:46:56.409696+0000","last_active":"2024-09-19T05:46:57.412590+0000","last_peered":"2024-09-19T05:46:57.412590+0000","last_clean":"2024-09-19T05:46:57.412590+0000","last_became_active":"2024-09-19T05:46:56.408956+0000","last_became_peered":"2024-09-19T05:46:56.408956+0000","last_unstale":"2024-09-19T05:46:57.412590+0000","last_undegraded":"2024-09-19T05:46:57.412590+0000","last_fullsized":"2024-09-19T05:46:57.412590+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:52.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412478+0000","last_change":"2024-09-19T05:46:55.384286+0000","last_active":"2024-09-19T05:46:57.412478+0000","last_peered":"2024-09-19T05:46:57.412478+0000","last_clean":"2024-09-19T05:46:57.412478+0000","last_became_active":"2024-09-19T05:46:55.383614+0000","last_became_peered":"2024-09-19T05:46:55.383614+0000","last_unstale":"2024-09-19T05:46:57.412478+0000","last_undegraded":"2024-09-19T05:46:57.412478+0000","last_fullsized":"2024-09-19T05:46:57.412478+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.628341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.442309+0000","last_change":"2024-09-19T05:46:56.439726+0000","last_active":"2024-09-19T05:46:56.442309+0000","last_peered":"2024-09-19T05:46:56.442309+0000","last_clean":"2024-09-19T05:46:56.442309+0000","last_became_active":"2024-09-19T05:46:56.439108+0000","last_became_peered":"2024-09-19T05:46:56.439108+0000","last_unstale":"2024-09-19T05:46:56.442309+0000","last_undegraded":"2024-09-19T05:46:56.442309+0000","last_fullsized":"2024-09-19T05:46:56.442309+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:33.437093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.406662+0000","last_change":"2024-09-19T05:46:55.389205+0000","last_active":"2024-09-19T05:46:56.406662+0000","last_peered":"2024-09-19T05:46:56.406662+0000","last_clean":"2024-09-19T05:46:56.406662+0000","last_became_active":"2024-09-19T05:46:55.386265+0000","last_became_peered":"2024-09-19T05:46:55.386265+0000","last_unstale":"2024-09-19T05:46:56.406662+0000","last_undegraded":"2024-09-19T05:46:56.406662+0000","last_fullsized":"2024-09-19T05:46:56.406662+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:49.088785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.418094+0000","last_change":"2024-09-19T05:46:56.411256+0000","last_active":"2024-09-19T05:46:56.418094+0000","last_peered":"2024-09-19T05:46:56.418094+0000","last_clean":"2024-09-19T05:46:56.418094+0000","last_became_active":"2024-09-19T05:46:56.410985+0000","last_became_peered":"2024-09-19T05:46:56.410985+0000","last_unstale":"2024-09-19T05:46:56.418094+0000","last_undegraded":"2024-09-19T05:46:56.418094+0000","last_fullsized":"2024-09-19T05:46:56.418094+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:42.118612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413703+0000","last_change":"2024-09-19T05:46:55.367362+0000","last_active":"2024-09-19T05:46:57.413703+0000","last_peered":"2024-09-19T05:46:57.413703+0000","last_clean":"2024-09-19T05:46:57.413703+0000","last_became_active":"2024-09-19T05:46:55.367089+0000","last_became_peered":"2024-09-19T05:46:55.367089+0000","last_unstale":"2024-09-19T05:46:57.413703+0000","last_undegraded":"2024-09-19T05:46:57.413703+0000","last_fullsized":"2024-09-19T05:46:57.413703+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:54.827163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413392+0000","last_change":"2024-09-19T05:46:56.432564+0000","last_active":"2024-09-19T05:46:57.413392+0000","last_peered":"2024-09-19T05:46:57.413392+0000","last_clean":"2024-09-19T05:46:57.413392+0000","last_became_active":"2024-09-19T05:46:56.431758+0000","last_became_peered":"2024-09-19T05:46:56.431758+0000","last_unstale":"2024-09-19T05:46:57.413392+0000","last_undegraded":"2024-09-19T05:46:57.413392+0000","last_fullsized":"2024-09-19T05:46:57.413392+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:53.837277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"178'3","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.419918+0000","last_change":"2024-09-19T05:46:55.387686+0000","last_active":"2024-09-19T05:46:56.419918+0000","last_peered":"2024-09-19T05:46:56.419918+0000","last_clean":"2024-09-19T05:46:56.419918+0000","last_became_active":"2024-09-19T05:46:55.386948+0000","last_became_peered":"2024-09-19T05:46:55.386948+0000","last_unstale":"2024-09-19T05:46:56.419918+0000","last_undegraded":"2024-09-19T05:46:56.419918+0000","last_fullsized":"2024-09-19T05:46:56.419918+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:29:35.393862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412688+0000","last_change":"2024-09-19T05:46:56.441103+0000","last_active":"2024-09-19T05:46:57.412688+0000","last_peered":"2024-09-19T05:46:57.412688+0000","last_clean":"2024-09-19T05:46:57.412688+0000","last_became_active":"2024-09-19T05:46:56.440833+0000","last_became_peered":"2024-09-19T05:46:56.440833+0000","last_unstale":"2024-09-19T05:46:57.412688+0000","last_undegraded":"2024-09-19T05:46:57.412688+0000","last_fullsized":"2024-09-19T05:46:57.412688+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:04.921547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"178'6","reported_seq":20,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413177+0000","last_change":"2024-09-19T05:46:55.377934+0000","last_active":"2024-09-19T05:46:57.413177+0000","last_peered":"2024-09-19T05:46:57.413177+0000","last_clean":"2024-09-19T05:46:57.413177+0000","last_became_active":"2024-09-19T05:46:55.376842+0000","last_became_peered":"2024-09-19T05:46:55.376842+0000","last_unstale":"2024-09-19T05:46:57.413177+0000","last_undegraded":"2024-09-19T05:46:57.413177+0000","last_fullsized":"2024-09-19T05:46:57.413177+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:23.971640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416167+0000","last_change":"2024-09-19T05:46:56.430226+0000","last_active":"2024-09-19T05:46:57.416167+0000","last_peered":"2024-09-19T05:46:57.416167+0000","last_clean":"2024-09-19T05:46:57.416167+0000","last_became_active":"2024-09-19T05:46:56.429893+0000","last_became_peered":"2024-09-19T05:46:56.429893+0000","last_unstale":"2024-09-19T05:46:57.416167+0000","last_undegraded":"2024-09-19T05:46:57.416167+0000","last_fullsized":"2024-09-19T05:46:57.416167+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:03.452178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"178'2","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412807+0000","last_change":"2024-09-19T05:46:55.368666+0000","last_active":"2024-09-19T05:46:57.412807+0000","last_peered":"2024-09-19T05:46:57.412807+0000","last_clean":"2024-09-19T05:46:57.412807+0000","last_became_active":"2024-09-19T05:46:55.368005+0000","last_became_peered":"2024-09-19T05:46:55.368005+0000","last_unstale":"2024-09-19T05:46:57.412807+0000","last_undegraded":"2024-09-19T05:46:57.412807+0000","last_fullsized":"2024-09-19T05:46:57.412807+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:46.594312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.420568+0000","last_change":"2024-09-19T05:46:56.419542+0000","last_active":"2024-09-19T05:46:56.420568+0000","last_peered":"2024-09-19T05:46:56.420568+0000","last_clean":"2024-09-19T05:46:56.420568+0000","last_became_active":"2024-09-19T05:46:56.419262+0000","last_became_peered":"2024-09-19T05:46:56.419262+0000","last_unstale":"2024-09-19T05:46:56.420568+0000","last_undegraded":"2024-09-19T05:46:56.420568+0000","last_fullsized":"2024-09-19T05:46:56.420568+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:54.565121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412454+0000","last_change":"2024-09-19T05:46:55.369687+0000","last_active":"2024-09-19T05:46:57.412454+0000","last_peered":"2024-09-19T05:46:57.412454+0000","last_clean":"2024-09-19T05:46:57.412454+0000","last_became_active":"2024-09-19T05:46:55.368921+0000","last_became_peered":"2024-09-19T05:46:55.368921+0000","last_unstale":"2024-09-19T05:46:57.412454+0000","last_undegraded":"2024-09-19T05:46:57.412454+0000","last_fullsized":"2024-09-19T05:46:57.412454+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:01.417976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412533+0000","last_change":"2024-09-19T05:46:56.404469+0000","last_active":"2024-09-19T05:46:57.412533+0000","last_peered":"2024-09-19T05:46:57.412533+0000","last_clean":"2024-09-19T05:46:57.412533+0000","last_became_active":"2024-09-19T05:46:56.403721+0000","last_became_peered":"2024-09-19T05:46:56.403721+0000","last_unstale":"2024-09-19T05:46:57.412533+0000","last_undegraded":"2024-09-19T05:46:57.412533+0000","last_fullsized":"2024-09-19T05:46:57.412533+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:17:28.068249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.393651+0000","last_change":"2024-09-19T05:46:55.381458+0000","last_active":"2024-09-19T05:46:56.393651+0000","last_peered":"2024-09-19T05:46:56.393651+0000","last_clean":"2024-09-19T05:46:56.393651+0000","last_became_active":"2024-09-19T05:46:55.381047+0000","last_became_peered":"2024-09-19T05:46:55.381047+0000","last_unstale":"2024-09-19T05:46:56.393651+0000","last_undegraded":"2024-09-19T05:46:56.393651+0000","last_fullsized":"2024-09-19T05:46:56.393651+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:03.214648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412475+0000","last_change":"2024-09-19T05:46:56.407439+0000","last_active":"2024-09-19T05:46:57.412475+0000","last_peered":"2024-09-19T05:46:57.412475+0000","last_clean":"2024-09-19T05:46:57.412475+0000","last_became_active":"2024-09-19T05:46:56.406716+0000","last_became_peered":"2024-09-19T05:46:56.406716+0000","last_unstale":"2024-09-19T05:46:57.412475+0000","last_undegraded":"2024-09-19T05:46:57.412475+0000","last_fullsized":"2024-09-19T05:46:57.412475+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:12.096590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"178'8","reported_seq":20,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.446885+0000","last_change":"2024-09-19T05:46:55.373869+0000","last_active":"2024-09-19T05:46:56.446885+0000","last_peered":"2024-09-19T05:46:56.446885+0000","last_clean":"2024-09-19T05:46:56.446885+0000","last_became_active":"2024-09-19T05:46:55.373136+0000","last_became_peered":"2024-09-19T05:46:55.373136+0000","last_unstale":"2024-09-19T05:46:56.446885+0000","last_undegraded":"2024-09-19T05:46:56.446885+0000","last_fullsized":"2024-09-19T05:46:56.446885+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:34.628087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416499+0000","last_change":"2024-09-19T05:46:56.408364+0000","last_active":"2024-09-19T05:46:57.416499+0000","last_peered":"2024-09-19T05:46:57.416499+0000","last_clean":"2024-09-19T05:46:57.416499+0000","last_became_active":"2024-09-19T05:46:56.408042+0000","last_became_peered":"2024-09-19T05:46:56.408042+0000","last_unstale":"2024-09-19T05:46:57.416499+0000","last_undegraded":"2024-09-19T05:46:57.416499+0000","last_fullsized":"2024-09-19T05:46:57.416499+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:18:09.947523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"178'1","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.440356+0000","last_change":"2024-09-19T05:46:55.375783+0000","last_active":"2024-09-19T05:46:56.440356+0000","last_peered":"2024-09-19T05:46:56.440356+0000","last_clean":"2024-09-19T05:46:56.440356+0000","last_became_active":"2024-09-19T05:46:55.374878+0000","last_became_peered":"2024-09-19T05:46:55.374878+0000","last_unstale":"2024-09-19T05:46:56.440356+0000","last_undegraded":"2024-09-19T05:46:56.440356+0000","last_fullsized":"2024-09-19T05:46:56.440356+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:40.362453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.441573+0000","last_change":"2024-09-19T05:46:56.441089+0000","last_active":"2024-09-19T05:46:56.441573+0000","last_peered":"2024-09-19T05:46:56.441573+0000","last_clean":"2024-09-19T05:46:56.441573+0000","last_became_active":"2024-09-19T05:46:56.440789+0000","last_became_peered":"2024-09-19T05:46:56.440789+0000","last_unstale":"2024-09-19T05:46:56.441573+0000","last_undegraded":"2024-09-19T05:46:56.441573+0000","last_fullsized":"2024-09-19T05:46:56.441573+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:59:38.808718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"178'2","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.434280+0000","last_change":"2024-09-19T05:46:55.381503+0000","last_active":"2024-09-19T05:46:56.434280+0000","last_peered":"2024-09-19T05:46:56.434280+0000","last_clean":"2024-09-19T05:46:56.434280+0000","last_became_active":"2024-09-19T05:46:55.381030+0000","last_became_peered":"2024-09-19T05:46:55.381030+0000","last_unstale":"2024-09-19T05:46:56.434280+0000","last_undegraded":"2024-09-19T05:46:56.434280+0000","last_fullsized":"2024-09-19T05:46:56.434280+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:12.195997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.434479+0000","last_change":"2024-09-19T05:46:56.412185+0000","last_active":"2024-09-19T05:46:56.434479+0000","last_peered":"2024-09-19T05:46:56.434479+0000","last_clean":"2024-09-19T05:46:56.434479+0000","last_became_active":"2024-09-19T05:46:56.411407+0000","last_became_peered":"2024-09-19T05:46:56.411407+0000","last_unstale":"2024-09-19T05:46:56.434479+0000","last_undegraded":"2024-09-19T05:46:56.434479+0000","last_fullsized":"2024-09-19T05:46:56.434479+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:16.004428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"178'1","reported_seq":13,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.420169+0000","last_change":"2024-09-19T05:46:55.356971+0000","last_active":"2024-09-19T05:46:56.420169+0000","last_peered":"2024-09-19T05:46:56.420169+0000","last_clean":"2024-09-19T05:46:56.420169+0000","last_became_active":"2024-09-19T05:46:55.356272+0000","last_became_peered":"2024-09-19T05:46:55.356272+0000","last_unstale":"2024-09-19T05:46:56.420169+0000","last_undegraded":"2024-09-19T05:46:56.420169+0000","last_fullsized":"2024-09-19T05:46:56.420169+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:44.103388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412520+0000","last_change":"2024-09-19T05:46:56.419430+0000","last_active":"2024-09-19T05:46:57.412520+0000","last_peered":"2024-09-19T05:46:57.412520+0000","last_clean":"2024-09-19T05:46:57.412520+0000","last_became_active":"2024-09-19T05:46:56.419145+0000","last_became_peered":"2024-09-19T05:46:56.419145+0000","last_unstale":"2024-09-19T05:46:57.412520+0000","last_undegraded":"2024-09-19T05:46:57.412520+0000","last_fullsized":"2024-09-19T05:46:57.412520+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:50.097904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.399975+0000","last_change":"2024-09-19T05:46:55.375691+0000","last_active":"2024-09-19T05:46:56.399975+0000","last_peered":"2024-09-19T05:46:56.399975+0000","last_clean":"2024-09-19T05:46:56.399975+0000","last_became_active":"2024-09-19T05:46:55.374903+0000","last_became_peered":"2024-09-19T05:46:55.374903+0000","last_unstale":"2024-09-19T05:46:56.399975+0000","last_undegraded":"2024-09-19T05:46:56.399975+0000","last_fullsized":"2024-09-19T05:46:56.399975+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:04.084910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.411631+0000","last_change":"2024-09-19T05:46:56.418111+0000","last_active":"2024-09-19T05:46:57.411631+0000","last_peered":"2024-09-19T05:46:57.411631+0000","last_clean":"2024-09-19T05:46:57.411631+0000","last_became_active":"2024-09-19T05:46:56.417811+0000","last_became_peered":"2024-09-19T05:46:56.417811+0000","last_unstale":"2024-09-19T05:46:57.411631+0000","last_undegraded":"2024-09-19T05:46:57.411631+0000","last_fullsized":"2024-09-19T05:46:57.411631+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:04.223766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"178'2","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.413028+0000","last_change":"2024-09-19T05:46:55.385756+0000","last_active":"2024-09-19T05:46:57.413028+0000","last_peered":"2024-09-19T05:46:57.413028+0000","last_clean":"2024-09-19T05:46:57.413028+0000","last_became_active":"2024-09-19T05:46:55.385062+0000","last_became_peered":"2024-09-19T05:46:55.385062+0000","last_unstale":"2024-09-19T05:46:57.413028+0000","last_undegraded":"2024-09-19T05:46:57.413028+0000","last_fullsized":"2024-09-19T05:46:57.413028+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:21.540060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.414972+0000","last_change":"2024-09-19T05:46:56.410353+0000","last_active":"2024-09-19T05:46:56.414972+0000","last_peered":"2024-09-19T05:46:56.414972+0000","last_clean":"2024-09-19T05:46:56.414972+0000","last_became_active":"2024-09-19T05:46:56.410030+0000","last_became_peered":"2024-09-19T05:46:56.410030+0000","last_unstale":"2024-09-19T05:46:56.414972+0000","last_undegraded":"2024-09-19T05:46:56.414972+0000","last_fullsized":"2024-09-19T05:46:56.414972+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:50.097904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.396189+0000","last_change":"2024-09-19T05:46:55.378033+0000","last_active":"2024-09-19T05:46:56.396189+0000","last_peered":"2024-09-19T05:46:56.396189+0000","last_clean":"2024-09-19T05:46:56.396189+0000","last_became_active":"2024-09-19T05:46:55.377730+0000","last_became_peered":"2024-09-19T05:46:55.377730+0000","last_unstale":"2024-09-19T05:46:56.396189+0000","last_undegraded":"2024-09-19T05:46:56.396189+0000","last_fullsized":"2024-09-19T05:46:56.396189+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:12.091688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.420756+0000","last_change":"2024-09-19T05:46:56.415024+0000","last_active":"2024-09-19T05:46:56.420756+0000","last_peered":"2024-09-19T05:46:56.420756+0000","last_clean":"2024-09-19T05:46:56.420756+0000","last_became_active":"2024-09-19T05:46:56.414674+0000","last_became_peered":"2024-09-19T05:46:56.414674+0000","last_unstale":"2024-09-19T05:46:56.420756+0000","last_undegraded":"2024-09-19T05:46:56.420756+0000","last_fullsized":"2024-09-19T05:46:56.420756+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:52.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416364+0000","last_change":"2024-09-19T05:46:55.369546+0000","last_active":"2024-09-19T05:46:57.416364+0000","last_peered":"2024-09-19T05:46:57.416364+0000","last_clean":"2024-09-19T05:46:57.416364+0000","last_became_active":"2024-09-19T05:46:55.369082+0000","last_became_peered":"2024-09-19T05:46:55.369082+0000","last_unstale":"2024-09-19T05:46:57.416364+0000","last_undegraded":"2024-09-19T05:46:57.416364+0000","last_fullsized":"2024-09-19T05:46:57.416364+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:36.267601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.417023+0000","last_change":"2024-09-19T05:46:56.408855+0000","last_active":"2024-09-19T05:46:56.417023+0000","last_peered":"2024-09-19T05:46:56.417023+0000","last_clean":"2024-09-19T05:46:56.417023+0000","last_became_active":"2024-09-19T05:46:56.406018+0000","last_became_peered":"2024-09-19T05:46:56.406018+0000","last_unstale":"2024-09-19T05:46:56.417023+0000","last_undegraded":"2024-09-19T05:46:56.417023+0000","last_fullsized":"2024-09-19T05:46:56.417023+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.032367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.391941+0000","last_change":"2024-09-19T05:46:55.377244+0000","last_active":"2024-09-19T05:46:56.391941+0000","last_peered":"2024-09-19T05:46:56.391941+0000","last_clean":"2024-09-19T05:46:56.391941+0000","last_became_active":"2024-09-19T05:46:55.376639+0000","last_became_peered":"2024-09-19T05:46:55.376639+0000","last_unstale":"2024-09-19T05:46:56.391941+0000","last_undegraded":"2024-09-19T05:46:56.391941+0000","last_fullsized":"2024-09-19T05:46:56.391941+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:14.328319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416576+0000","last_change":"2024-09-19T05:46:56.414309+0000","last_active":"2024-09-19T05:46:57.416576+0000","last_peered":"2024-09-19T05:46:57.416576+0000","last_clean":"2024-09-19T05:46:57.416576+0000","last_became_active":"2024-09-19T05:46:56.413900+0000","last_became_peered":"2024-09-19T05:46:56.413900+0000","last_unstale":"2024-09-19T05:46:57.416576+0000","last_undegraded":"2024-09-19T05:46:57.416576+0000","last_fullsized":"2024-09-19T05:46:57.416576+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:35.404360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"178'2","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.438027+0000","last_change":"2024-09-19T05:46:55.374862+0000","last_active":"2024-09-19T05:46:56.438027+0000","last_peered":"2024-09-19T05:46:56.438027+0000","last_clean":"2024-09-19T05:46:56.438027+0000","last_became_active":"2024-09-19T05:46:55.374177+0000","last_became_peered":"2024-09-19T05:46:55.374177+0000","last_unstale":"2024-09-19T05:46:56.438027+0000","last_undegraded":"2024-09-19T05:46:56.438027+0000","last_fullsized":"2024-09-19T05:46:56.438027+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:09.065740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412600+0000","last_change":"2024-09-19T05:46:56.411761+0000","last_active":"2024-09-19T05:46:57.412600+0000","last_peered":"2024-09-19T05:46:57.412600+0000","last_clean":"2024-09-19T05:46:57.412600+0000","last_became_active":"2024-09-19T05:46:56.411399+0000","last_became_peered":"2024-09-19T05:46:56.411399+0000","last_unstale":"2024-09-19T05:46:57.412600+0000","last_undegraded":"2024-09-19T05:46:57.412600+0000","last_fullsized":"2024-09-19T05:46:57.412600+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:49.622752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"178'1","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416294+0000","last_change":"2024-09-19T05:46:55.371416+0000","last_active":"2024-09-19T05:46:57.416294+0000","last_peered":"2024-09-19T05:46:57.416294+0000","last_clean":"2024-09-19T05:46:57.416294+0000","last_became_active":"2024-09-19T05:46:55.366002+0000","last_became_peered":"2024-09-19T05:46:55.366002+0000","last_unstale":"2024-09-19T05:46:57.416294+0000","last_undegraded":"2024-09-19T05:46:57.416294+0000","last_fullsized":"2024-09-19T05:46:57.416294+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:25.420890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.434652+0000","last_change":"2024-09-19T05:46:56.426027+0000","last_active":"2024-09-19T05:46:56.434652+0000","last_peered":"2024-09-19T05:46:56.434652+0000","last_clean":"2024-09-19T05:46:56.434652+0000","last_became_active":"2024-09-19T05:46:56.414873+0000","last_became_peered":"2024-09-19T05:46:56.414873+0000","last_unstale":"2024-09-19T05:46:56.434652+0000","last_undegraded":"2024-09-19T05:46:56.434652+0000","last_fullsized":"2024-09-19T05:46:56.434652+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:30.403331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.406677+0000","last_change":"2024-09-19T05:46:55.382880+0000","last_active":"2024-09-19T05:46:56.406677+0000","last_peered":"2024-09-19T05:46:56.406677+0000","last_clean":"2024-09-19T05:46:56.406677+0000","last_became_active":"2024-09-19T05:46:55.382558+0000","last_became_peered":"2024-09-19T05:46:55.382558+0000","last_unstale":"2024-09-19T05:46:56.406677+0000","last_undegraded":"2024-09-19T05:46:56.406677+0000","last_fullsized":"2024-09-19T05:46:56.406677+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:51.953430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416758+0000","last_change":"2024-09-19T05:46:56.434241+0000","last_active":"2024-09-19T05:46:57.416758+0000","last_peered":"2024-09-19T05:46:57.416758+0000","last_clean":"2024-09-19T05:46:57.416758+0000","last_became_active":"2024-09-19T05:46:56.433967+0000","last_became_peered":"2024-09-19T05:46:56.433967+0000","last_unstale":"2024-09-19T05:46:57.416758+0000","last_undegraded":"2024-09-19T05:46:57.416758+0000","last_fullsized":"2024-09-19T05:46:57.416758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:09.382734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.406290+0000","last_change":"2024-09-19T05:46:55.385992+0000","last_active":"2024-09-19T05:46:56.406290+0000","last_peered":"2024-09-19T05:46:56.406290+0000","last_clean":"2024-09-19T05:46:56.406290+0000","last_became_active":"2024-09-19T05:46:55.385687+0000","last_became_peered":"2024-09-19T05:46:55.385687+0000","last_unstale":"2024-09-19T05:46:56.406290+0000","last_undegraded":"2024-09-19T05:46:56.406290+0000","last_fullsized":"2024-09-19T05:46:56.406290+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.756914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.410220+0000","last_change":"2024-09-19T05:46:56.403059+0000","last_active":"2024-09-19T05:46:56.410220+0000","last_peered":"2024-09-19T05:46:56.410220+0000","last_clean":"2024-09-19T05:46:56.410220+0000","last_became_active":"2024-09-19T05:46:56.402258+0000","last_became_peered":"2024-09-19T05:46:56.402258+0000","last_unstale":"2024-09-19T05:46:56.410220+0000","last_undegraded":"2024-09-19T05:46:56.410220+0000","last_fullsized":"2024-09-19T05:46:56.410220+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:04.557450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.391280+0000","last_change":"2024-09-19T05:46:55.386898+0000","last_active":"2024-09-19T05:46:56.391280+0000","last_peered":"2024-09-19T05:46:56.391280+0000","last_clean":"2024-09-19T05:46:56.391280+0000","last_became_active":"2024-09-19T05:46:55.386388+0000","last_became_peered":"2024-09-19T05:46:55.386388+0000","last_unstale":"2024-09-19T05:46:56.391280+0000","last_undegraded":"2024-09-19T05:46:56.391280+0000","last_fullsized":"2024-09-19T05:46:56.391280+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:26.370648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412627+0000","last_change":"2024-09-19T05:46:56.406658+0000","last_active":"2024-09-19T05:46:57.412627+0000","last_peered":"2024-09-19T05:46:57.412627+0000","last_clean":"2024-09-19T05:46:57.412627+0000","last_became_active":"2024-09-19T05:46:56.405204+0000","last_became_peered":"2024-09-19T05:46:56.405204+0000","last_unstale":"2024-09-19T05:46:57.412627+0000","last_undegraded":"2024-09-19T05:46:57.412627+0000","last_fullsized":"2024-09-19T05:46:57.412627+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:02.553384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.390239+0000","last_change":"2024-09-19T05:46:55.388653+0000","last_active":"2024-09-19T05:46:56.390239+0000","last_peered":"2024-09-19T05:46:56.390239+0000","last_clean":"2024-09-19T05:46:56.390239+0000","last_became_active":"2024-09-19T05:46:55.388058+0000","last_became_peered":"2024-09-19T05:46:55.388058+0000","last_unstale":"2024-09-19T05:46:56.390239+0000","last_undegraded":"2024-09-19T05:46:56.390239+0000","last_fullsized":"2024-09-19T05:46:56.390239+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:15.840238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.412341+0000","last_change":"2024-09-19T05:46:56.418218+0000","last_active":"2024-09-19T05:46:57.412341+0000","last_peered":"2024-09-19T05:46:57.412341+0000","last_clean":"2024-09-19T05:46:57.412341+0000","last_became_active":"2024-09-19T05:46:56.417844+0000","last_became_peered":"2024-09-19T05:46:56.417844+0000","last_unstale":"2024-09-19T05:46:57.412341+0000","last_undegraded":"2024-09-19T05:46:57.412341+0000","last_fullsized":"2024-09-19T05:46:57.412341+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:02.481741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-19T05:46:57.416464+0000","last_change":"2024-09-19T05:46:55.372032+0000","last_active":"2024-09-19T05:46:57.416464+0000","last_peered":"2024-09-19T05:46:57.416464+0000","last_clean":"2024-09-19T05:46:57.416464+0000","last_became_active":"2024-09-19T05:46:55.371711+0000","last_became_peered":"2024-09-19T05:46:55.371711+0000","last_unstale":"2024-09-19T05:46:57.416464+0000","last_undegraded":"2024-09-19T05:46:57.416464+0000","last_fullsized":"2024-09-19T05:46:57.416464+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.687056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.427392+0000","last_change":"2024-09-19T05:46:56.414141+0000","last_active":"2024-09-19T05:46:56.427392+0000","last_peered":"2024-09-19T05:46:56.427392+0000","last_clean":"2024-09-19T05:46:56.427392+0000","last_became_active":"2024-09-19T05:46:56.413332+0000","last_became_peered":"2024-09-19T05:46:56.413332+0000","last_unstale":"2024-09-19T05:46:56.427392+0000","last_undegraded":"2024-09-19T05:46:56.427392+0000","last_fullsized":"2024-09-19T05:46:56.427392+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:01.960580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.392388+0000","last_change":"2024-09-19T05:46:55.354512+0000","last_active":"2024-09-19T05:46:56.392388+0000","last_peered":"2024-09-19T05:46:56.392388+0000","last_clean":"2024-09-19T05:46:56.392388+0000","last_became_active":"2024-09-19T05:46:55.353633+0000","last_became_peered":"2024-09-19T05:46:55.353633+0000","last_unstale":"2024-09-19T05:46:56.392388+0000","last_undegraded":"2024-09-19T05:46:56.392388+0000","last_fullsized":"2024-09-19T05:46:56.392388+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:55.825183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.417006+0000","last_change":"2024-09-19T05:46:56.406733+0000","last_active":"2024-09-19T05:46:56.417006+0000","last_peered":"2024-09-19T05:46:56.417006+0000","last_clean":"2024-09-19T05:46:56.417006+0000","last_became_active":"2024-09-19T05:46:56.405885+0000","last_became_peered":"2024-09-19T05:46:56.405885+0000","last_unstale":"2024-09-19T05:46:56.417006+0000","last_undegraded":"2024-09-19T05:46:56.417006+0000","last_fullsized":"2024-09-19T05:46:56.417006+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:55.341637+0000","last_clean_scrub_stamp":"2024-09-19T05:46:55.341637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:04.637460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.393639+0000","last_change":"2024-09-19T05:46:55.380816+0000","last_active":"2024-09-19T05:46:56.393639+0000","last_peered":"2024-09-19T05:46:56.393639+0000","last_clean":"2024-09-19T05:46:56.393639+0000","last_became_active":"2024-09-19T05:46:55.380103+0000","last_became_peered":"2024-09-19T05:46:55.380103+0000","last_unstale":"2024-09-19T05:46:56.393639+0000","last_undegraded":"2024-09-19T05:46:56.393639+0000","last_fullsized":"2024-09-19T05:46:56.393639+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:46:54.332519+0000","last_clean_scrub_stamp":"2024-09-19T05:46:54.332519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:42.706512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":456,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-19T05:46:56.394174+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:46:56.394174+0000","last_peered":"2024-09-19T05:46:56.394174+0000","last_clean":"2024-09-19T05:46:56.394174+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:46:56.394174+0000","last_undegraded":"2024-09-19T05:46:56.394174+0000","last_fullsized":"2024-09-19T05:46:56.394174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542313,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70056,"kb_used_data":2764,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301784,"statfs":{"total":96636764160,"available":96565026816,"internally_reserved":0,"allocated":2830336,"data_stored":1647414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542313,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69476,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302364,"statfs":{"total":96636764160,"available":96565620736,"internally_reserved":0,"allocated":2240512,"data_stored":1057116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542315,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47284,"kb_used_data":2200,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324556,"statfs":{"total":96636764160,"available":96588345344,"internally_reserved":0,"allocated":2252800,"data_stored":1058680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542313,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73644,"kb_used_data":2200,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298196,"statfs":{"total":96636764160,"available":96561352704,"internally_reserved":0,"allocated":2252800,"data_stored":1058692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542314,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69420,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302420,"statfs":{"total":96636764160,"available":96565678080,"internally_reserved":0,"allocated":2244608,"data_stored":1057206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542314,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73636,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298204,"statfs":{"total":96636764160,"available":96561360896,"internally_reserved":0,"allocated":2240512,"data_stored":1057628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542316,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47268,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324572,"statfs":{"total":96636764160,"available":96588361728,"internally_reserved":0,"allocated":2236416,"data_stored":1057046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542313,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78384,"kb_used_data":2780,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293456,"statfs":{"total":96636764160,"available":96556498944,"internally_reserved":0,"allocated":2846720,"data_stored":1648142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:47:00.805 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:47:00.805 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:47:00.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6fdec640 1 Processor -- start 2024-09-19T05:47:00.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6fdec640 1 -- start start 2024-09-19T05:47:00.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6fdec640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 0x7f5f6815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6fdec640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5f6815d950 0x7f5f680b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6fdec640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f6815ddd0 con 0x7f5f680cecd0 2024-09-19T05:47:00.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6fdec640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5f6815e0b0 con 0x7f5f6815d950 2024-09-19T05:47:00.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6fdec640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5f6815e390 con 0x7f5f6815c210 2024-09-19T05:47:00.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6d387640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5f6815d950 0x7f5f680b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6db88640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 0x7f5f6815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6db88640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 0x7f5f6815c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:45074/0 (socket says 172.21.15.67:45074) 2024-09-19T05:47:00.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6e389640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5f680cecd0 0x7f5f6809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:35406/0 (socket says 172.21.15.67:35406) 2024-09-19T05:47:00.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6d387640 1 --2- 172.21.15.67:0/4215351556 >> v2:172.21.15.97:3300/0 conn(0x7f5f6815d950 0x7f5f680b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:49502/0 (socket says 172.21.15.67:49502) 2024-09-19T05:47:00.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6db88640 1 -- 172.21.15.67:0/4215351556 learned_addr learned my addr 172.21.15.67:0/4215351556 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:00.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6d387640 1 -- 172.21.15.67:0/4215351556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 msgr2=0x7f5f6815c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:00.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6d387640 1 --2- 172.21.15.67:0/4215351556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 0x7f5f6815c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6d387640 1 -- 172.21.15.67:0/4215351556 >> v1:172.21.15.97:6789/0 conn(0x7f5f680cecd0 legacy=0x7f5f6809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.976+0000 7f5f6d387640 1 -- 172.21.15.67:0/4215351556 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6815e670 con 0x7f5f6815d950 2024-09-19T05:47:00.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6d387640 1 --2- 172.21.15.67:0/4215351556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f6815d950 0x7f5f680b5ee0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5f640097c0 tx=0x7f5f6401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9618e58620f374 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:00.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6cb86640 1 -- 172.21.15.67:0/4215351556 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f640b0070 con 0x7f5f6815d950 2024-09-19T05:47:00.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6cb86640 1 -- 172.21.15.67:0/4215351556 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f640ab600 con 0x7f5f6815d950 2024-09-19T05:47:00.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6cb86640 1 -- 172.21.15.67:0/4215351556 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f640ab9d0 con 0x7f5f6815d950 2024-09-19T05:47:00.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6fdec640 1 -- 172.21.15.67:0/4215351556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f6815d950 msgr2=0x7f5f680b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6fdec640 1 --2- 172.21.15.67:0/4215351556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f6815d950 0x7f5f680b5ee0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5f640097c0 tx=0x7f5f6401c410 comp rx=0 tx=0).stop 2024-09-19T05:47:00.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6fdec640 1 -- 172.21.15.67:0/4215351556 shutdown_connections 2024-09-19T05:47:00.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6fdec640 1 --2- 172.21.15.67:0/4215351556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f6815d950 0x7f5f680b5ee0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6fdec640 1 --2- 172.21.15.67:0/4215351556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 0x7f5f6815c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6fdec640 1 -- 172.21.15.67:0/4215351556 >> 172.21.15.67:0/4215351556 conn(0x7f5f680b7970 msgr2=0x7f5f680b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:00.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6fdec640 1 -- 172.21.15.67:0/4215351556 shutdown_connections 2024-09-19T05:47:00.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.980+0000 7f5f6fdec640 1 -- 172.21.15.67:0/4215351556 wait complete. 2024-09-19T05:47:00.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 Processor -- start 2024-09-19T05:47:00.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 -- start start 2024-09-19T05:47:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f680cecd0 0x7f5f680b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 0x7f5f68164320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f6815d950 0x7f5f680b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5f681691e0 con 0x7f5f680cecd0 2024-09-19T05:47:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5f680b6830 con 0x7f5f6815d950 2024-09-19T05:47:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5f68169360 con 0x7f5f6815c210 2024-09-19T05:47:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6db88640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f680cecd0 0x7f5f680b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6db88640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f680cecd0 0x7f5f680b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43764/0 (socket says 172.21.15.67:43764) 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6db88640 1 -- 172.21.15.67:0/172099327 learned_addr learned my addr 172.21.15.67:0/172099327 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6e389640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f6815d950 0x7f5f680b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6d387640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 0x7f5f68164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6db88640 1 -- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 msgr2=0x7f5f68164320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6db88640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 0x7f5f68164320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6db88640 1 -- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f6815d950 msgr2=0x7f5f680b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6db88640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f6815d950 0x7f5f680b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6db88640 1 -- 172.21.15.67:0/172099327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f68164bc0 con 0x7f5f680cecd0 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6d387640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 0x7f5f68164320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6db88640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f680cecd0 0x7f5f680b1fa0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800e890 tx=0x7f5f5800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f5e7fc640 1 -- 172.21.15.67:0/172099327 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58017070 con 0x7f5f680cecd0 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f5e7fc640 1 -- 172.21.15.67:0/172099327 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5800c940 con 0x7f5f680cecd0 2024-09-19T05:47:00.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f5e7fc640 1 -- 172.21.15.67:0/172099327 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800cd30 con 0x7f5f680cecd0 2024-09-19T05:47:00.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 -- 172.21.15.67:0/172099327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f68164ea0 con 0x7f5f680cecd0 2024-09-19T05:47:00.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 -- 172.21.15.67:0/172099327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6806d150 con 0x7f5f680cecd0 2024-09-19T05:47:00.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.984+0000 7f5f6fdec640 1 -- 172.21.15.67:0/172099327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6815c5f0 con 0x7f5f680cecd0 2024-09-19T05:47:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.988+0000 7f5f5e7fc640 1 -- 172.21.15.67:0/172099327 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f5801a070 con 0x7f5f680cecd0 2024-09-19T05:47:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.988+0000 7f5f5e7fc640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f4c0678f0 0x7f5f4c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.988+0000 7f5f5e7fc640 1 -- 172.21.15.67:0/172099327 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f5f58086130 con 0x7f5f680cecd0 2024-09-19T05:47:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.988+0000 7f5f6d387640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f4c0678f0 0x7f5f4c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:00.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.988+0000 7f5f6d387640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f4c0678f0 0x7f5f4c069db0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5f640ad000 tx=0x7f5f64008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:00.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:00.992+0000 7f5f5e7fc640 1 -- 172.21.15.67:0/172099327 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5f58056ae0 con 0x7f5f680cecd0 2024-09-19T05:47:01.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.216+0000 7f5f6fdec640 1 -- 172.21.15.67:0/172099327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5f68071940 con 0x7f5f680cecd0 2024-09-19T05:47:01.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f5e7fc640 1 -- 172.21.15.67:0/172099327 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f5f580563e0 con 0x7f5f680cecd0 2024-09-19T05:47:01.221 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:47:01.221 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:47:01.221 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:47:01.221 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:47:01.221 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:47:01.221 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:47:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 -- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f4c0678f0 msgr2=0x7f5f4c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f4c0678f0 0x7f5f4c069db0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5f640ad000 tx=0x7f5f64008040 comp rx=0 tx=0).stop 2024-09-19T05:47:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 -- 172.21.15.67:0/172099327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f680cecd0 msgr2=0x7f5f680b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f680cecd0 0x7f5f680b1fa0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800e890 tx=0x7f5f5800ed50 comp rx=0 tx=0).stop 2024-09-19T05:47:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 -- 172.21.15.67:0/172099327 shutdown_connections 2024-09-19T05:47:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f6815d950 0x7f5f680b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5f4c0678f0 0x7f5f4c069db0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f6815c210 0x7f5f68164320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 --2- 172.21.15.67:0/172099327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f680cecd0 0x7f5f680b1fa0 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 -- 172.21.15.67:0/172099327 >> 172.21.15.67:0/172099327 conn(0x7f5f680b7970 msgr2=0x7f5f68159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:01.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 -- 172.21.15.67:0/172099327 shutdown_connections 2024-09-19T05:47:01.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.220+0000 7f5f6fdec640 1 -- 172.21.15.67:0/172099327 wait complete. 2024-09-19T05:47:01.241 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:47:01.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67dc66d640 1 Processor -- start 2024-09-19T05:47:01.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67dc66d640 1 -- start start 2024-09-19T05:47:01.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67dc66d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d406c3d0 0x7f67d4166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:01.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67dc66d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d40ae3d0 con 0x7f67d415cd50 2024-09-19T05:47:01.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67dc66d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d40b25c0 con 0x7f67d40b6cf0 2024-09-19T05:47:01.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67dc66d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67d415da20 con 0x7f67d406c3d0 2024-09-19T05:47:01.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67da409640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f67d415cd50 0x7f67d415d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46936/0 (socket says 172.21.15.67:46936) 2024-09-19T05:47:01.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67da409640 1 -- 172.21.15.67:0/341800009 learned_addr learned my addr 172.21.15.67:0/341800009 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:01.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186491802 0 0) 0x7f67d0001120 con 0x7f67d415cd50 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67c0003530 con 0x7f67d415cd50 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67dac0a640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d406c3d0 0x7f67d4166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2335664360 0 0) 0x7f67c0003530 con 0x7f67d415cd50 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d406c3d0 msgr2=0x7f67d4166f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d406c3d0 0x7f67d4166f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 >> v1:172.21.15.97:6789/0 conn(0x7f67d40b6cf0 legacy=0x7f67d406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d40b28a0 con 0x7f67d415cd50 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f67d0001850 con 0x7f67d415cd50 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 >> v1:172.21.15.67:6789/0 conn(0x7f67d415cd50 legacy=0x7f67d415d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c00039f0 0x7f67c0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c0004810 0x7f67c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d406c3d0 0x7f67c0005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:01.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67d415da20 con 0x7f67c00039f0 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67c000bb90 con 0x7f67c0004810 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67c000bd90 con 0x7f67d406c3d0 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67da409640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c00039f0 0x7f67c0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67dac0a640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d406c3d0 0x7f67c0005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9c08640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c0004810 0x7f67c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67da409640 1 -- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d406c3d0 msgr2=0x7f67c0005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67da409640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67d406c3d0 0x7f67c0005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67da409640 1 -- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c0004810 msgr2=0x7f67c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67da409640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c0004810 0x7f67c0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67da409640 1 -- 172.21.15.67:0/341800009 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c0003530 con 0x7f67c00039f0 2024-09-19T05:47:01.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.360+0000 7f67d9c08640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67c0004810 0x7f67c0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:01.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67da409640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c00039f0 0x7f67c0003e10 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c320 tx=0x7f67d001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16240dc7d979ac2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:01.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d0007e10 con 0x7f67c00039f0 2024-09-19T05:47:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d00a9070 con 0x7f67c00039f0 2024-09-19T05:47:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67d9407640 1 -- 172.21.15.67:0/341800009 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d0005d40 con 0x7f67c00039f0 2024-09-19T05:47:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67dc66d640 1 -- 172.21.15.67:0/341800009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c00039f0 msgr2=0x7f67c0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67dc66d640 1 --2- 172.21.15.67:0/341800009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67c00039f0 0x7f67c0003e10 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c320 tx=0x7f67d001cba0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67dac0a640 1 -- 172.21.15.67:0/341800009 reap_dead start 2024-09-19T05:47:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67dc66d640 1 -- 172.21.15.67:0/341800009 shutdown_connections 2024-09-19T05:47:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67dc66d640 1 -- 172.21.15.67:0/341800009 >> 172.21.15.67:0/341800009 conn(0x7f67d409aa30 msgr2=0x7f67d40b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67dc66d640 1 -- 172.21.15.67:0/341800009 shutdown_connections 2024-09-19T05:47:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67dc66d640 1 -- 172.21.15.67:0/341800009 wait complete. 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67dc66d640 1 Processor -- start 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.364+0000 7f67dc66d640 1 -- start start 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dc66d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c00039f0 0x7f67d4154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dc66d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67d414de80 0x7f67d409e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dc66d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d4155fc0 0x7f67d4156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dc66d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67d4165aa0 con 0x7f67d4155fc0 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dc66d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67d4165920 con 0x7f67d414de80 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dc66d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67d4165c20 con 0x7f67c00039f0 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dac0a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d4155fc0 0x7f67d4156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dac0a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d4155fc0 0x7f67d4156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43780/0 (socket says 172.21.15.67:43780) 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dac0a640 1 -- 172.21.15.67:0/2466779356 learned_addr learned my addr 172.21.15.67:0/2466779356 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67d9c08640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67d414de80 0x7f67d409e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67da409640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c00039f0 0x7f67d4154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dac0a640 1 -- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c00039f0 msgr2=0x7f67d4154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dac0a640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c00039f0 0x7f67d4154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dac0a640 1 -- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67d414de80 msgr2=0x7f67d409e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dac0a640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67d414de80 0x7f67d409e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dac0a640 1 -- 172.21.15.67:0/2466779356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d41f3110 con 0x7f67d4155fc0 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dac0a640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d4155fc0 0x7f67d4156440 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f67d4068980 tx=0x7f67cc009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67caffd640 1 -- 172.21.15.67:0/2466779356 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc007cf0 con 0x7f67d4155fc0 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67caffd640 1 -- 172.21.15.67:0/2466779356 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67cc019070 con 0x7f67d4155fc0 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dc66d640 1 -- 172.21.15.67:0/2466779356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d414e300 con 0x7f67d4155fc0 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67caffd640 1 -- 172.21.15.67:0/2466779356 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc014650 con 0x7f67d4155fc0 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dc66d640 1 -- 172.21.15.67:0/2466779356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d409edd0 con 0x7f67d4155fc0 2024-09-19T05:47:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67dc66d640 1 -- 172.21.15.67:0/2466779356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d4156980 con 0x7f67d4155fc0 2024-09-19T05:47:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67caffd640 1 -- 172.21.15.67:0/2466779356 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67cc0147f0 con 0x7f67d4155fc0 2024-09-19T05:47:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67caffd640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b80678f0 0x7f67b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67caffd640 1 -- 172.21.15.67:0/2466779356 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f67cc0861b0 con 0x7f67d4155fc0 2024-09-19T05:47:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.368+0000 7f67da409640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b80678f0 0x7f67b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.372+0000 7f67da409640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b80678f0 0x7f67b8069db0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f67d00ab000 tx=0x7f67d415c7c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:01.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.372+0000 7f67caffd640 1 -- 172.21.15.67:0/2466779356 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f67cc056bf0 con 0x7f67d4155fc0 2024-09-19T05:47:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.572+0000 7f67dc66d640 1 -- 172.21.15.67:0/2466779356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67d406bcc0 con 0x7f67d4155fc0 2024-09-19T05:47:01.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.572+0000 7f67caffd640 1 -- 172.21.15.67:0/2466779356 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) ==== 95+0+5236 (secure 0 0 0) 0x7f67cc0564f0 con 0x7f67d4155fc0 2024-09-19T05:47:01.575 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:01.575 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":128,"btime":"2024-09-19T05:46:59:414107+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6974,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2737632366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737632366},{"type":"v1","addr":"172.21.15.97:6835","nonce":2737632366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3498582105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3498582105},{"type":"v1","addr":"172.21.15.97:6837","nonce":3498582105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":10026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/558917076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":558917076},{"type":"v1","addr":"172.21.15.67:6833","nonce":558917076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:46:55.745812+0000","modified":"2024-09-19T05:46:58.790051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10032":{"gid":10032,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2190010946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2190010946},{"type":"v1","addr":"172.21.15.67:6835","nonce":2190010946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10032,"qdb_cluster":[10032]},"id":12}]} 2024-09-19T05:47:01.576 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 128 2024-09-19T05:47:01.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 -- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b80678f0 msgr2=0x7f67b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:01.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b80678f0 0x7f67b8069db0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f67d00ab000 tx=0x7f67d415c7c0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 -- 172.21.15.67:0/2466779356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d4155fc0 msgr2=0x7f67d4156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:01.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d4155fc0 0x7f67d4156440 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f67d4068980 tx=0x7f67cc009d50 comp rx=0 tx=0).stop 2024-09-19T05:47:01.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 -- 172.21.15.67:0/2466779356 shutdown_connections 2024-09-19T05:47:01.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d4155fc0 0x7f67d4156440 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67d414de80 0x7f67d409e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f67b80678f0 0x7f67b8069db0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 --2- 172.21.15.67:0/2466779356 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67c00039f0 0x7f67d4154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:01.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 -- 172.21.15.67:0/2466779356 >> 172.21.15.67:0/2466779356 conn(0x7f67d409aa30 msgr2=0x7f67d40707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:01.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 -- 172.21.15.67:0/2466779356 shutdown_connections 2024-09-19T05:47:01.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:01.576+0000 7f67dc66d640 1 -- 172.21.15.67:0/2466779356 wait complete. 2024-09-19T05:47:01.995 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 128, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:46:55.745812+0000', 'modified': '2024-09-19T05:46:58.790051+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10032}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10032': {'gid': 10032, 'name': 'c', 'rank': 0, 'incarnation': 124, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/2190010946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 2190010946}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 2190010946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10032, 'qdb_cluster': [10032]} 2024-09-19T05:47:01.995 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:47:01.996 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:47:02.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.128+0000 7f56e7cd0640 1 Processor -- start 2024-09-19T05:47:02.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.128+0000 7f56e7cd0640 1 -- start start 2024-09-19T05:47:02.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e7cd0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e0161da0 0x7f56e00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e7cd0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e00d4d40 con 0x7f56e00d0160 2024-09-19T05:47:02.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e7cd0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e00d5020 con 0x7f56e00d0e80 2024-09-19T05:47:02.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e7cd0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f56e00d0610 con 0x7f56e0161da0 2024-09-19T05:47:02.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e626d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f56e00d0160 0x7f56e00b48d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46946/0 (socket says 172.21.15.67:46946) 2024-09-19T05:47:02.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e626d640 1 -- 172.21.15.67:0/3601558787 learned_addr learned my addr 172.21.15.67:0/3601558787 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e0161da0 0x7f56e00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614933383 0 0) 0x7f56e00d4d40 con 0x7f56e00d0160 2024-09-19T05:47:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d0003530 con 0x7f56e00d0160 2024-09-19T05:47:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3129260926 0 0) 0x7f56d0003530 con 0x7f56e00d0160 2024-09-19T05:47:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e0161da0 msgr2=0x7f56e00d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e0161da0 0x7f56e00d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 >> v1:172.21.15.97:6789/0 conn(0x7f56e00d0e80 legacy=0x7f56e00b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e00d5300 con 0x7f56e00d0160 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f56d8001680 con 0x7f56e00d0160 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 >> v1:172.21.15.67:6789/0 conn(0x7f56e00d0160 legacy=0x7f56e00b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56d00039f0 0x7f56d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e0161da0 0x7f56d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56d0004d50 0x7f56d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f56d000b9d0 con 0x7f56d00039f0 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f56d000bb50 con 0x7f56d0004d50 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f56d000bd50 con 0x7f56e0161da0 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56d00039f0 0x7f56d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e526b640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e0161da0 0x7f56d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e626d640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56d0004d50 0x7f56d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e5a6c640 1 -- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e0161da0 msgr2=0x7f56d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e0161da0 0x7f56d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e5a6c640 1 -- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56d0004d50 msgr2=0x7f56d00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56d0004d50 0x7f56d00051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e5a6c640 1 -- 172.21.15.67:0/3601558787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d0003530 con 0x7f56d00039f0 2024-09-19T05:47:02.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.132+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56d00039f0 0x7f56d0003dd0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009fc0 tx=0x7f56d401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270f86d9bc7ef2bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d40b2070 con 0x7f56d00039f0 2024-09-19T05:47:02.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d40a5bd0 con 0x7f56d00039f0 2024-09-19T05:47:02.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e4a6a640 1 -- 172.21.15.67:0/3601558787 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4009c10 con 0x7f56d00039f0 2024-09-19T05:47:02.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- 172.21.15.67:0/3601558787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56d00039f0 msgr2=0x7f56d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 --2- 172.21.15.67:0/3601558787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56d00039f0 0x7f56d0003dd0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009fc0 tx=0x7f56d401cbc0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e626d640 1 -- 172.21.15.67:0/3601558787 reap_dead start 2024-09-19T05:47:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- 172.21.15.67:0/3601558787 shutdown_connections 2024-09-19T05:47:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- 172.21.15.67:0/3601558787 >> 172.21.15.67:0/3601558787 conn(0x7f56e008bfc0 msgr2=0x7f56e00d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- 172.21.15.67:0/3601558787 shutdown_connections 2024-09-19T05:47:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- 172.21.15.67:0/3601558787 wait complete. 2024-09-19T05:47:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 Processor -- start 2024-09-19T05:47:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- start start 2024-09-19T05:47:02.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56e00b61e0 0x7f56e00b9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e00b65c0 0x7f56e01f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56e015b590 0x7f56e015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f56e00b5d00 con 0x7f56e00b61e0 2024-09-19T05:47:02.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f56e00d0840 con 0x7f56e015b590 2024-09-19T05:47:02.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f56e0162180 con 0x7f56e00b65c0 2024-09-19T05:47:02.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e5a6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56e00b61e0 0x7f56e00b9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e5a6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56e00b61e0 0x7f56e00b9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43798/0 (socket says 172.21.15.67:43798) 2024-09-19T05:47:02.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e5a6c640 1 -- 172.21.15.67:0/2569344470 learned_addr learned my addr 172.21.15.67:0/2569344470 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:02.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e526b640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e00b65c0 0x7f56e01f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e5a6c640 1 -- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e00b65c0 msgr2=0x7f56e01f43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e626d640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56e015b590 0x7f56e015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e00b65c0 0x7f56e01f43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e5a6c640 1 -- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56e015b590 msgr2=0x7f56e015ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56e015b590 0x7f56e015ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e5a6c640 1 -- 172.21.15.67:0/2569344470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e006c4b0 con 0x7f56e00b61e0 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e526b640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e00b65c0 0x7f56e01f43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56e00b61e0 0x7f56e00b9d70 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f56d401c9f0 tx=0x7f56d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56de7fc640 1 -- 172.21.15.67:0/2569344470 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d40b2040 con 0x7f56e00b61e0 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56de7fc640 1 -- 172.21.15.67:0/2569344470 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d40039a0 con 0x7f56e00b61e0 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- 172.21.15.67:0/2569344470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e015bf50 con 0x7f56e00b61e0 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56de7fc640 1 -- 172.21.15.67:0/2569344470 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4009c10 con 0x7f56e00b61e0 2024-09-19T05:47:02.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.136+0000 7f56e7cd0640 1 -- 172.21.15.67:0/2569344470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e01f4b60 con 0x7f56e00b61e0 2024-09-19T05:47:02.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56de7fc640 1 -- 172.21.15.67:0/2569344470 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56d40ad930 con 0x7f56e00b61e0 2024-09-19T05:47:02.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56de7fc640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56c40678c0 0x7f56c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56de7fc640 1 -- 172.21.15.67:0/2569344470 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f56d4120860 con 0x7f56e00b61e0 2024-09-19T05:47:02.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56e526b640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56c40678c0 0x7f56c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56ead8c000 1 Processor -- start 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56ead8c000 1 -- start start 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56e526b640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56c40678c0 0x7f56c4069d80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f56cc000c10 tx=0x7f56cc00a880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 0x561987d32d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d33290 0x561987d33670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56ead8c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561987c1ab60 con 0x561987d7cb20 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56ead8c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561987b81c70 con 0x561987d33290 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56ead8c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561987b27ed0 con 0x561987d7d440 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56e5a6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56e5a6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43802/0 (socket says 172.21.15.67:43802) 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.140+0000 7f56e5a6c640 1 -- 172.21.15.67:0/3536203461 learned_addr learned my addr 172.21.15.67:0/3536203461 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:02.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e626d640 1 --2- 172.21.15.67:0/3536203461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d33290 0x561987d33670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 --2- 172.21.15.67:0/3536203461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 0x561987d32d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e5a6c640 1 -- 172.21.15.67:0/3536203461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 msgr2=0x561987d32d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/3536203461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 0x561987d32d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e5a6c640 1 -- 172.21.15.67:0/3536203461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d33290 msgr2=0x561987d33670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/3536203461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d33290 0x561987d33670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e5a6c640 1 -- 172.21.15.67:0/3536203461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561987b39e50 con 0x561987d7cb20 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 --2- 172.21.15.67:0/3536203461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 0x561987d32d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/3536203461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7cf00 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f56d40f9250 tx=0x7f56d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c28d29d87cb7e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56c37fe640 1 -- 172.21.15.67:0/3536203461 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d40c3040 con 0x561987d7cb20 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56c37fe640 1 -- 172.21.15.67:0/3536203461 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d40f9780 con 0x561987d7cb20 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56c37fe640 1 -- 172.21.15.67:0/3536203461 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d40ed210 con 0x561987d7cb20 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- 172.21.15.67:0/3536203461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 msgr2=0x561987d7cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 --2- 172.21.15.67:0/3536203461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7cf00 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f56d40f9250 tx=0x7f56d400b040 comp rx=0 tx=0).stop 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- 172.21.15.67:0/3536203461 shutdown_connections 2024-09-19T05:47:02.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 --2- 172.21.15.67:0/3536203461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d33290 0x561987d33670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 --2- 172.21.15.67:0/3536203461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 0x561987d32d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 --2- 172.21.15.67:0/3536203461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7cf00 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- 172.21.15.67:0/3536203461 >> 172.21.15.67:0/3536203461 conn(0x561987d39600 msgr2=0x561987d31630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:02.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- 172.21.15.67:0/3536203461 shutdown_connections 2024-09-19T05:47:02.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- 172.21.15.67:0/3536203461 wait complete. 2024-09-19T05:47:02.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- start start 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 Processor -- start 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d7cb20 0x561987d37c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987d381b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d3dcf0 0x561987d3e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561987be3b00 con 0x561987d7d440 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561987b5c360 con 0x561987d7cb20 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561987b592d0 con 0x561987d3dcf0 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 10 client.0 _ll_register_callbacks cb 0x561987d1e820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987d381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987d381b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43812/0 (socket says 172.21.15.67:43812) 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 -- 172.21.15.67:0/2495412053 learned_addr learned my addr 172.21.15.67:0/2495412053 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d7cb20 0x561987d37c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e626d640 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d3dcf0 0x561987d3e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 -- 172.21.15.67:0/2495412053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d3dcf0 msgr2=0x561987d3e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d3dcf0 0x561987d3e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 -- 172.21.15.67:0/2495412053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d7cb20 msgr2=0x561987d37c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d7cb20 0x561987d37c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 -- 172.21.15.67:0/2495412053 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561987b28120 con 0x561987d7d440 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e626d640 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d3dcf0 0x561987d3e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56e526b640 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987d381b0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f56cc003b80 tx=0x7f56cc001240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a6f469535704f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56c0ff9640 1 -- 172.21.15.67:0/2495412053 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc01b070 con 0x561987d7d440 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56c0ff9640 1 -- 172.21.15.67:0/2495412053 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f56cc010040 con 0x561987d7d440 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- 172.21.15.67:0/2495412053 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56d40f9780 con 0x561987d7d440 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56c0ff9640 1 -- 172.21.15.67:0/2495412053 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7f56cc015c40 con 0x561987d7d440 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 10 client.10164 fetch_fsmap learned FSMap version 128 2024-09-19T05:47:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.144+0000 7f56ead8c000 1 -- 172.21.15.67:0/2495412053 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x561987b21450 con 0x561987d7d440 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56c0ff9640 1 -- 172.21.15.67:0/2495412053 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d40f9780 con 0x561987d7d440 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56c0ff9640 1 -- 172.21.15.67:0/2495412053 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 128) ==== 3502+0+0 (secure 0 0 0) 0x7f56cc021070 con 0x561987d7d440 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 10 client.10164 fetch_fsmap finished waiting for FSMap version 128 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 10 client.10164 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 20 client.10164 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x561987d8b280 0x561987d8d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 4 client.10164 mds_command: new command op to 10032 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 -- 172.21.15.67:0/2495412053 --> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561987b1bc00 con 0x561987d8b280 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x561987d8b280 0x561987d8d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56c0ff9640 10 client.10164 ms_handle_connect on v2:172.21.15.67:6834/2190010946 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x561987d8b280 0x561987d8d670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96e2e7843a12201e server_cookie=34ef6ab5d0d1379 in_seq=0 out_seq=0 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56c0ff9640 1 -- 172.21.15.67:0/2495412053 <== mds.0 v2:172.21.15.67:6834/2190010946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561987b1bc00 con 0x561987d8b280 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56c0ff9640 10 client.10164 handle_command_reply: tid=0 2024-09-19T05:47:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 client.10164 shutdown 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 -- 172.21.15.67:0/2495412053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 msgr2=0x561987d381b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987d381b0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f56cc003b80 tx=0x7f56cc001240 comp rx=0 tx=0).stop 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 -- 172.21.15.67:0/2495412053 shutdown_connections 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x561987d8b280 0x561987d8d670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d3dcf0 0x561987d3e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987d381b0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56c0ff9640 0 client.10164 ms_handle_reset on v2:172.21.15.67:6834/2190010946 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 --2- 172.21.15.67:0/2495412053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d7cb20 0x561987d37c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 -- 172.21.15.67:0/2495412053 >> 172.21.15.67:0/2495412053 conn(0x561987d33290 msgr2=0x561987d31d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 -- 172.21.15.67:0/2495412053 shutdown_connections 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 1 -- 172.21.15.67:0/2495412053 wait complete. 2024-09-19T05:47:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.148+0000 7f56ead8c000 20 client.10164 trim_cache size 0 max 16384 2024-09-19T05:47:02.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 Processor -- start 2024-09-19T05:47:02.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- start start 2024-09-19T05:47:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d3dcf0 0x561987d7bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 0x561987d8d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0200af0 con 0x561987d7cb20 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f56e01ffe50 con 0x561987d3dcf0 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f56e02004a0 con 0x561987d7d440 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e526b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e526b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43824/0 (socket says 172.21.15.67:43824) 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e526b640 1 -- 172.21.15.67:0/486940150 learned_addr learned my addr 172.21.15.67:0/486940150 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/486940150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d3dcf0 0x561987d7bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e626d640 1 --2- 172.21.15.67:0/486940150 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 0x561987d8d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e526b640 1 -- 172.21.15.67:0/486940150 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 msgr2=0x561987d8d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e526b640 1 --2- 172.21.15.67:0/486940150 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 0x561987d8d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e526b640 1 -- 172.21.15.67:0/486940150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d3dcf0 msgr2=0x561987d7bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e526b640 1 --2- 172.21.15.67:0/486940150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d3dcf0 0x561987d7bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e526b640 1 -- 172.21.15.67:0/486940150 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561987b08fd0 con 0x561987d7cb20 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e526b640 1 --2- 172.21.15.67:0/486940150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7c0d0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f56cc011300 tx=0x7f56cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853e2718d1fb2acc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56c2ffd640 1 -- 172.21.15.67:0/486940150 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc03c070 con 0x561987d7cb20 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56c2ffd640 1 -- 172.21.15.67:0/486940150 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56cc0226c0 con 0x561987d7cb20 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56c2ffd640 1 -- 172.21.15.67:0/486940150 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc022a90 con 0x561987d7cb20 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- 172.21.15.67:0/486940150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 msgr2=0x561987d7c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 --2- 172.21.15.67:0/486940150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7c0d0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f56cc011300 tx=0x7f56cc017000 comp rx=0 tx=0).stop 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- 172.21.15.67:0/486940150 shutdown_connections 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 --2- 172.21.15.67:0/486940150 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7d440 0x561987d8d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 --2- 172.21.15.67:0/486940150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7cb20 0x561987d7c0d0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 --2- 172.21.15.67:0/486940150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d3dcf0 0x561987d7bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- 172.21.15.67:0/486940150 >> 172.21.15.67:0/486940150 conn(0x561987d33290 msgr2=0x561987d378a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- 172.21.15.67:0/486940150 shutdown_connections 2024-09-19T05:47:02.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- 172.21.15.67:0/486940150 wait complete. 2024-09-19T05:47:02.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- start start 2024-09-19T05:47:02.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 Processor -- start 2024-09-19T05:47:02.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d3dcf0 0x561987df0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7cb20 0x561987df0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987df0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561987b80f80 con 0x561987d7d440 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561987b39ca0 con 0x561987d3dcf0 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x561987b862a0 con 0x561987d7cb20 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56ead8c000 10 client.0 _ll_register_callbacks cb 0x7f56cc00ade0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e626d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987df0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e626d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987df0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43840/0 (socket says 172.21.15.67:43840) 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e626d640 1 -- 172.21.15.67:0/375471382 learned_addr learned my addr 172.21.15.67:0/375471382 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d3dcf0 0x561987df0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.168+0000 7f56e526b640 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7cb20 0x561987df0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e626d640 1 -- 172.21.15.67:0/375471382 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7cb20 msgr2=0x561987df0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e626d640 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7cb20 0x561987df0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e626d640 1 -- 172.21.15.67:0/375471382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d3dcf0 msgr2=0x561987df0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e626d640 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d3dcf0 0x561987df0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e626d640 1 -- 172.21.15.67:0/375471382 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561987c04750 con 0x561987d7d440 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e626d640 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987df0d90 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f56e00b5f50 tx=0x7f56d8010610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd44ec2c3aca7dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56c0ff9640 1 -- 172.21.15.67:0/375471382 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8014660 con 0x561987d7d440 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56c0ff9640 1 -- 172.21.15.67:0/375471382 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f56d8014800 con 0x561987d7d440 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 -- 172.21.15.67:0/375471382 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56cc0226c0 con 0x561987d7d440 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56c0ff9640 1 -- 172.21.15.67:0/375471382 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7f56d8021050 con 0x561987d7d440 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 10 client.10170 fetch_fsmap learned FSMap version 128 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 -- 172.21.15.67:0/375471382 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x561987b0fa30 con 0x561987d7d440 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56c0ff9640 1 -- 172.21.15.67:0/375471382 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56cc0226c0 con 0x561987d7d440 2024-09-19T05:47:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56c0ff9640 1 -- 172.21.15.67:0/375471382 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 128) ==== 3502+0+0 (secure 0 0 0) 0x7f56d8024020 con 0x561987d7d440 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 10 client.10170 fetch_fsmap finished waiting for FSMap version 128 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 10 client.10170 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 20 client.10170 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x561987df7560 0x561987df9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 4 client.10170 mds_command: new command op to 10032 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 -- 172.21.15.67:0/375471382 --> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] -- command(tid 0: {"prefix": "status"}) -- 0x561987b8f3a0 con 0x561987df7560 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x561987df7560 0x561987df9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56c0ff9640 10 client.10170 ms_handle_connect on v2:172.21.15.67:6834/2190010946 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e5a6c640 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x561987df7560 0x561987df9950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e205414205fe084 server_cookie=c2c2c9b5f989c8e0 in_seq=0 out_seq=0 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56c0ff9640 1 -- 172.21.15.67:0/375471382 <== mds.0 v2:172.21.15.67:6834/2190010946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x561987b8f3a0 con 0x561987df7560 2024-09-19T05:47:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56c0ff9640 10 client.10170 handle_command_reply: tid=0 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 client.10170 shutdown 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 -- 172.21.15.67:0/375471382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 msgr2=0x561987df0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987df0d90 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f56e00b5f50 tx=0x7f56d8010610 comp rx=0 tx=0).stop 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 -- 172.21.15.67:0/375471382 shutdown_connections 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x561987df7560 0x561987df9950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561987d7d440 0x561987df0d90 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561987d7cb20 0x561987df0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 --2- 172.21.15.67:0/375471382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561987d3dcf0 0x561987df0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56c0ff9640 0 client.10170 ms_handle_reset on v2:172.21.15.67:6834/2190010946 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 -- 172.21.15.67:0/375471382 >> 172.21.15.67:0/375471382 conn(0x561987d33290 msgr2=0x561987d37fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 -- 172.21.15.67:0/375471382 shutdown_connections 2024-09-19T05:47:02.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 1 -- 172.21.15.67:0/375471382 wait complete. 2024-09-19T05:47:02.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56ead8c000 20 client.10170 trim_cache size 0 max 16384 2024-09-19T05:47:02.180 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:47:02.180 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:47:02.180 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:47:02.180 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 10032, 2024-09-19T05:47:02.180 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:47:02.180 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:47:02.180 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:47:02.180 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 5.7752846910000004, 2024-09-19T05:47:02.181 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 128, 2024-09-19T05:47:02.181 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 179, 2024-09-19T05:47:02.181 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 179, 2024-09-19T05:47:02.181 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 10.783544146000001 2024-09-19T05:47:02.181 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:47:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 -- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56c40678c0 msgr2=0x7f56c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56c40678c0 0x7f56c4069d80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f56cc000c10 tx=0x7f56cc00a880 comp rx=0 tx=0).stop 2024-09-19T05:47:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 -- 172.21.15.67:0/2569344470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56e00b61e0 msgr2=0x7f56e00b9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56e00b61e0 0x7f56e00b9d70 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f56d401c9f0 tx=0x7f56d4009750 comp rx=0 tx=0).stop 2024-09-19T05:47:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 -- 172.21.15.67:0/2569344470 shutdown_connections 2024-09-19T05:47:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56e015b590 0x7f56e015ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56c40678c0 0x7f56c4069d80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56e00b65c0 0x7f56e01f43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 --2- 172.21.15.67:0/2569344470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56e00b61e0 0x7f56e00b9d70 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 -- 172.21.15.67:0/2569344470 >> 172.21.15.67:0/2569344470 conn(0x7f56e008bfc0 msgr2=0x7f56e006da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 -- 172.21.15.67:0/2569344470 shutdown_connections 2024-09-19T05:47:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.172+0000 7f56e7cd0640 1 -- 172.21.15.67:0/2569344470 wait complete. 2024-09-19T05:47:02.190 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:47:02.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb07dddc640 1 Processor -- start 2024-09-19T05:47:02.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb07dddc640 1 -- start start 2024-09-19T05:47:02.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb07dddc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb078071e80 0x7fb0780af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb07dddc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0780b3070 con 0x7fb07815c200 2024-09-19T05:47:02.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb07dddc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0780b32e0 con 0x7fb07815b710 2024-09-19T05:47:02.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb07dddc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb0780b35c0 con 0x7fb078071e80 2024-09-19T05:47:02.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb076ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb07815c200 0x7fb0780aef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46962/0 (socket says 172.21.15.67:46962) 2024-09-19T05:47:02.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb076ffd640 1 -- 172.21.15.67:0/2602962869 learned_addr learned my addr 172.21.15.67:0/2602962869 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:02.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb077fff640 1 --2- 172.21.15.67:0/2602962869 >> v2:172.21.15.67:3300/0 conn(0x7fb078071e80 0x7fb0780af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb0767fc640 1 -- 172.21.15.67:0/2602962869 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990891006 0 0) 0x7fb0780b3070 con 0x7fb07815c200 2024-09-19T05:47:02.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb0767fc640 1 -- 172.21.15.67:0/2602962869 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb060003530 con 0x7fb07815c200 2024-09-19T05:47:02.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb077fff640 1 -- 172.21.15.67:0/2602962869 >> v1:172.21.15.97:6789/0 conn(0x7fb07815b710 legacy=0x7fb07815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb077fff640 1 -- 172.21.15.67:0/2602962869 >> v1:172.21.15.67:6789/0 conn(0x7fb07815c200 legacy=0x7fb0780aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.304+0000 7fb077fff640 1 -- 172.21.15.67:0/2602962869 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0780b38a0 con 0x7fb078071e80 2024-09-19T05:47:02.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb077fff640 1 --2- 172.21.15.67:0/2602962869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb078071e80 0x7fb0780af650 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fb0700097c0 tx=0x7fb07001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87373e7e5af4e0a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb0767fc640 1 -- 172.21.15.67:0/2602962869 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0700b1070 con 0x7fb078071e80 2024-09-19T05:47:02.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb0767fc640 1 -- 172.21.15.67:0/2602962869 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0700ac410 con 0x7fb078071e80 2024-09-19T05:47:02.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb0767fc640 1 -- 172.21.15.67:0/2602962869 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0700ac7c0 con 0x7fb078071e80 2024-09-19T05:47:02.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 -- 172.21.15.67:0/2602962869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb078071e80 msgr2=0x7fb0780af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 --2- 172.21.15.67:0/2602962869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb078071e80 0x7fb0780af650 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fb0700097c0 tx=0x7fb07001c4a0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 -- 172.21.15.67:0/2602962869 shutdown_connections 2024-09-19T05:47:02.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 --2- 172.21.15.67:0/2602962869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb078071e80 0x7fb0780af650 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 -- 172.21.15.67:0/2602962869 >> 172.21.15.67:0/2602962869 conn(0x7fb0780d0080 msgr2=0x7fb0780d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:02.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 -- 172.21.15.67:0/2602962869 shutdown_connections 2024-09-19T05:47:02.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 -- 172.21.15.67:0/2602962869 wait complete. 2024-09-19T05:47:02.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 Processor -- start 2024-09-19T05:47:02.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 -- start start 2024-09-19T05:47:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb078071e80 0x7fb078148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb07815b710 0x7fb078147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb07815c200 0x7fb078153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb0780b4c40 con 0x7fb07815b710 2024-09-19T05:47:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb0780b4ac0 con 0x7fb078071e80 2024-09-19T05:47:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb07dddc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb0780b4dc0 con 0x7fb07815c200 2024-09-19T05:47:02.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb076ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb07815b710 0x7fb078147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb076ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb07815b710 0x7fb078147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43852/0 (socket says 172.21.15.67:43852) 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb076ffd640 1 -- 172.21.15.67:0/3777039636 learned_addr learned my addr 172.21.15.67:0/3777039636 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb0777fe640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb078071e80 0x7fb078148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb077fff640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb07815c200 0x7fb078153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb076ffd640 1 -- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb07815c200 msgr2=0x7fb078153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb076ffd640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb07815c200 0x7fb078153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb076ffd640 1 -- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb078071e80 msgr2=0x7fb078148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb076ffd640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb078071e80 0x7fb078148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb076ffd640 1 -- 172.21.15.67:0/3777039636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0780b11b0 con 0x7fb07815b710 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb077fff640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb07815c200 0x7fb078153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.308+0000 7fb076ffd640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb07815b710 0x7fb078147710 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00cbc0 tx=0x7fb06c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb05ffff640 1 -- 172.21.15.67:0/3777039636 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c017070 con 0x7fb07815b710 2024-09-19T05:47:02.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb05ffff640 1 -- 172.21.15.67:0/3777039636 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06c00ad40 con 0x7fb07815b710 2024-09-19T05:47:02.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb05ffff640 1 -- 172.21.15.67:0/3777039636 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c012620 con 0x7fb07815b710 2024-09-19T05:47:02.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb07dddc640 1 -- 172.21.15.67:0/3777039636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0781534c0 con 0x7fb07815b710 2024-09-19T05:47:02.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb07dddc640 1 -- 172.21.15.67:0/3777039636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0780b0dd0 con 0x7fb07815b710 2024-09-19T05:47:02.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb07dddc640 1 -- 172.21.15.67:0/3777039636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07815baf0 con 0x7fb07815b710 2024-09-19T05:47:02.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb05ffff640 1 -- 172.21.15.67:0/3777039636 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb06c01a070 con 0x7fb07815b710 2024-09-19T05:47:02.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb05ffff640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0640678f0 0x7fb064069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb05ffff640 1 -- 172.21.15.67:0/3777039636 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7fb06c085c30 con 0x7fb07815b710 2024-09-19T05:47:02.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb0777fe640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0640678f0 0x7fb064069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.312+0000 7fb0777fe640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0640678f0 0x7fb064069db0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb068000f70 tx=0x7fb068009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.316+0000 7fb05ffff640 1 -- 172.21.15.67:0/3777039636 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb06c0565e0 con 0x7fb07815b710 2024-09-19T05:47:02.329 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:47:02.328+0000 7fb460a2f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:47:02.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.516+0000 7fb07dddc640 1 -- 172.21.15.67:0/3777039636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb0780d0710 con 0x7fb07815b710 2024-09-19T05:47:02.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.516+0000 7fb05ffff640 1 -- 172.21.15.67:0/3777039636 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v128) ==== 53+0+73 (secure 0 0 0) 0x7fb06c055ee0 con 0x7fb07815b710 2024-09-19T05:47:02.518 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:47:02.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 -- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0640678f0 msgr2=0x7fb064069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0640678f0 0x7fb064069db0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb068000f70 tx=0x7fb068009040 comp rx=0 tx=0).stop 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 -- 172.21.15.67:0/3777039636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb07815b710 msgr2=0x7fb078147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb07815b710 0x7fb078147710 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00cbc0 tx=0x7fb06c00a430 comp rx=0 tx=0).stop 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 -- 172.21.15.67:0/3777039636 shutdown_connections 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb0640678f0 0x7fb064069db0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb07815c200 0x7fb078153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb07815b710 0x7fb078147710 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 --2- 172.21.15.67:0/3777039636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb078071e80 0x7fb078148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 -- 172.21.15.67:0/3777039636 >> 172.21.15.67:0/3777039636 conn(0x7fb0780d0080 msgr2=0x7fb078148420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 -- 172.21.15.67:0/3777039636 shutdown_connections 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02.520+0000 7fb07dddc640 1 -- 172.21.15.67:0/3777039636 wait complete. 2024-09-19T05:47:02.537 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:47:02.537 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:47:02.537 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:47:02.537 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:47:02.537 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:02.537 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:47:02.537 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:47:02.538 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:47:02.538 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:47:02.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:02.538 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:47:02.544 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:47:02.544 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:47:02.544 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:47:02.544 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:02.544 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:47:02.544 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:02.544 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41682sec preferred_lft 41682sec 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:47:02.545 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:47:02.546 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:02.547 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:47:02.547 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:02.547 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:47:02.547 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:02.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:02.547 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:47:02.602 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:47:02.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:02.603 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:47:02.657 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:47:02.658 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:47:02.658 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:02.658 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:47:02.658 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:47:02.658 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:47:02.658 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:02.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:47:02.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:02.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:02.780 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:47:02.786 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:47:02.786 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:47:02.786 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:47:02.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:02.787 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:47:02.839 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:47:02.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:47:02.839 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:02.888 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:47:02.888 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:47:02.888 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:02.936 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:47:02.994 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:47:03.042 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:47:03.042 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:47:03.042 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:47:03.042 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:47:03.042 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:47:03.043 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:47:03.044 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:03.045 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:03.045 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:03.045 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:03.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:03.046 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:47:03.093 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:47:03.093 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:47:03.137 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:47:03.152 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:47:03.205 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:47:03.206 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:47:03.207 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:47:03.207 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:47:03.207 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:03.207 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:03.207 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:03.207 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:03.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:03.207 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:47:03.217 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:47:03.216+0000 7f22c4106580 -1 init, newargv = 0x564fb3b753b0 newargc=15 2024-09-19T05:47:03.217 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[85131]: starting ceph client 2024-09-19T05:47:03.223 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[85131]: starting fuse 2024-09-19T05:47:04.322 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:47:04.340 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:47:04.393 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:47:04.393 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:47:04.393 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:47:04.393 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:47:04.393 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:47:04.393 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:47:04.394 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:04.396 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:04.396 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:04.396 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:04.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:04.397 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:47:04.444 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:47:04.445 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:47:04.445 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:47:04.445 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:47:04.445 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:47:04.445 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:47:04.445 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:47:04.445 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:47:04.445 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:47:04.446 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:47:04.447 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:47:04.447 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:47:04.447 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:47:04.447 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:47:04.447 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:47:04.571 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.85131.asok 2024-09-19T05:47:04.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:04.583 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85131.asok 2024-09-19T05:47:04.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:04.583 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85131.asok status 2024-09-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:47:04.745 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "85131", 2024-09-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 10185, 2024-09-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:47:04.746 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 10185 2024-09-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 347097929 2024-09-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:04.747 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 347097929 2024-09-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.10185 192.168.0.1:0/347097929", 2024-09-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/347097929", 2024-09-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:47:04.748 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 128, 2024-09-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 179, 2024-09-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:47:04.749 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:47:04.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:04.759 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:47:04.759 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:04.766 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:47:04.766 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:04.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:04.767 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:04.820 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:04.821 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:04.821 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.0 2024-09-19T05:47:04.821 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:04.821 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:04.821 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:04.821 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:04.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:04.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:04.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:04.953 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204979 s, 51.2 MB/s 2024-09-19T05:47:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145535 s, 72.0 MB/s 2024-09-19T05:47:04.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:04.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:04.989 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153113 s, 68.5 MB/s 2024-09-19T05:47:05.004 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121 s, 86.7 MB/s 2024-09-19T05:47:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014531 s, 72.2 MB/s 2024-09-19T05:47:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137429 s, 76.3 MB/s 2024-09-19T05:47:05.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.054 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121472 s, 86.3 MB/s 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134126 s, 78.2 MB/s 2024-09-19T05:47:05.089 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.089 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.089 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141456 s, 74.1 MB/s 2024-09-19T05:47:05.107 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.107 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.107 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151083 s, 69.4 MB/s 2024-09-19T05:47:05.123 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.123 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.123 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126103 s, 83.2 MB/s 2024-09-19T05:47:05.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.141 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135991 s, 77.1 MB/s 2024-09-19T05:47:05.158 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.158 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.158 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138715 s, 75.6 MB/s 2024-09-19T05:47:05.175 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.176 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139476 s, 75.2 MB/s 2024-09-19T05:47:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012267 s, 85.5 MB/s 2024-09-19T05:47:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170912 s, 61.4 MB/s 2024-09-19T05:47:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143565 s, 73.0 MB/s 2024-09-19T05:47:05.246 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.246 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.246 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013178 s, 79.6 MB/s 2024-09-19T05:47:05.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.262 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127793 s, 82.1 MB/s 2024-09-19T05:47:05.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.281 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156034 s, 67.2 MB/s 2024-09-19T05:47:05.300 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.300 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.300 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013903 s, 75.4 MB/s 2024-09-19T05:47:05.317 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.318 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140636 s, 74.6 MB/s 2024-09-19T05:47:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145122 s, 72.3 MB/s 2024-09-19T05:47:05.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.352 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120505 s, 87.0 MB/s 2024-09-19T05:47:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166362 s, 63.0 MB/s 2024-09-19T05:47:05.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.388 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122016 s, 85.9 MB/s 2024-09-19T05:47:05.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.405 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.405 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113379 s, 92.5 MB/s 2024-09-19T05:47:05.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.421 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150416 s, 69.7 MB/s 2024-09-19T05:47:05.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.439 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141642 s, 74.0 MB/s 2024-09-19T05:47:05.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.456 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.456 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013324 s, 78.7 MB/s 2024-09-19T05:47:05.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.474 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014777 s, 71.0 MB/s 2024-09-19T05:47:05.490 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.490 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.490 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132126 s, 79.4 MB/s 2024-09-19T05:47:05.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:05.499 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:05.499 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:05.500 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.1 2024-09-19T05:47:05.500 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:05.500 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:05.500 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:05.500 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:05.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:05.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.568 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105273 s, 99.6 MB/s 2024-09-19T05:47:05.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.585 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141335 s, 74.2 MB/s 2024-09-19T05:47:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130579 s, 80.3 MB/s 2024-09-19T05:47:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110224 s, 95.1 MB/s 2024-09-19T05:47:05.627 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.628 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.628 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978656 s, 107 MB/s 2024-09-19T05:47:05.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.645 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.645 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139951 s, 74.9 MB/s 2024-09-19T05:47:05.660 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.660 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.660 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121647 s, 86.2 MB/s 2024-09-19T05:47:05.678 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013783 s, 76.1 MB/s 2024-09-19T05:47:05.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.693 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.693 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128635 s, 81.5 MB/s 2024-09-19T05:47:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115134 s, 91.1 MB/s 2024-09-19T05:47:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136586 s, 76.8 MB/s 2024-09-19T05:47:05.739 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.741 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122095 s, 85.9 MB/s 2024-09-19T05:47:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121159 s, 86.5 MB/s 2024-09-19T05:47:05.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.773 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150856 s, 69.5 MB/s 2024-09-19T05:47:05.787 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.788 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.788 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118142 s, 88.8 MB/s 2024-09-19T05:47:05.805 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.805 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.805 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136334 s, 76.9 MB/s 2024-09-19T05:47:05.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.821 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131063 s, 80.0 MB/s 2024-09-19T05:47:05.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.838 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132533 s, 79.1 MB/s 2024-09-19T05:47:05.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.853 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128555 s, 81.6 MB/s 2024-09-19T05:47:05.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.869 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.870 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132359 s, 79.2 MB/s 2024-09-19T05:47:05.886 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.886 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.886 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131366 s, 79.8 MB/s 2024-09-19T05:47:05.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.902 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.902 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127551 s, 82.2 MB/s 2024-09-19T05:47:05.917 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.917 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.917 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012211 s, 85.9 MB/s 2024-09-19T05:47:05.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.931 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112664 s, 93.1 MB/s 2024-09-19T05:47:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134814 s, 77.8 MB/s 2024-09-19T05:47:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149254 s, 70.3 MB/s 2024-09-19T05:47:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124858 s, 84.0 MB/s 2024-09-19T05:47:05.998 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:05.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:05.999 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013377 s, 78.4 MB/s 2024-09-19T05:47:06.014 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.014 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.014 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123433 s, 85.0 MB/s 2024-09-19T05:47:06.030 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.030 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.030 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126077 s, 83.2 MB/s 2024-09-19T05:47:06.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.047 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133815 s, 78.4 MB/s 2024-09-19T05:47:06.062 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.062 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.062 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122586 s, 85.5 MB/s 2024-09-19T05:47:06.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:06.070 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:06.070 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:06.070 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.2 2024-09-19T05:47:06.070 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:06.070 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:06.070 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:06.070 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:06.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:06.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.141 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146055 s, 71.8 MB/s 2024-09-19T05:47:06.155 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.155 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.155 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113445 s, 92.4 MB/s 2024-09-19T05:47:06.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113089 s, 92.7 MB/s 2024-09-19T05:47:06.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.185 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126658 s, 82.8 MB/s 2024-09-19T05:47:06.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.199 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113671 s, 92.2 MB/s 2024-09-19T05:47:06.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.215 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128073 s, 81.9 MB/s 2024-09-19T05:47:06.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.229 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118291 s, 88.6 MB/s 2024-09-19T05:47:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104496 s, 100 MB/s 2024-09-19T05:47:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011801 s, 88.9 MB/s 2024-09-19T05:47:06.272 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.272 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.272 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123247 s, 85.1 MB/s 2024-09-19T05:47:06.288 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.289 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.289 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139454 s, 75.2 MB/s 2024-09-19T05:47:06.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.304 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.304 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122691 s, 85.5 MB/s 2024-09-19T05:47:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.320 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131192 s, 79.9 MB/s 2024-09-19T05:47:06.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.334 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109758 s, 95.5 MB/s 2024-09-19T05:47:06.348 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.348 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.348 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115117 s, 91.1 MB/s 2024-09-19T05:47:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147918 s, 70.9 MB/s 2024-09-19T05:47:06.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.381 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124387 s, 84.3 MB/s 2024-09-19T05:47:06.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.396 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129782 s, 80.8 MB/s 2024-09-19T05:47:06.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.412 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129441 s, 81.0 MB/s 2024-09-19T05:47:06.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.428 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124573 s, 84.2 MB/s 2024-09-19T05:47:06.443 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.443 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.443 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125385 s, 83.6 MB/s 2024-09-19T05:47:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124214 s, 84.4 MB/s 2024-09-19T05:47:06.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.476 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140206 s, 74.8 MB/s 2024-09-19T05:47:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931937 s, 113 MB/s 2024-09-19T05:47:06.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.503 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122288 s, 85.7 MB/s 2024-09-19T05:47:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.518 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012039 s, 87.1 MB/s 2024-09-19T05:47:06.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.533 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120454 s, 87.1 MB/s 2024-09-19T05:47:06.547 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.548 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.548 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117634 s, 89.1 MB/s 2024-09-19T05:47:06.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.559 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.560 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092391 s, 113 MB/s 2024-09-19T05:47:06.576 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.576 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.576 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132566 s, 79.1 MB/s 2024-09-19T05:47:06.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.590 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.590 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113196 s, 92.6 MB/s 2024-09-19T05:47:06.604 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.605 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113199 s, 92.6 MB/s 2024-09-19T05:47:06.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:06.614 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:06.614 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:06.614 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.3 2024-09-19T05:47:06.614 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:06.614 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:06.614 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:06.614 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:06.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978743 s, 107 MB/s 2024-09-19T05:47:06.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.738 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.738 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121705 s, 86.2 MB/s 2024-09-19T05:47:06.756 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.756 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.756 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149081 s, 70.3 MB/s 2024-09-19T05:47:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012556 s, 83.5 MB/s 2024-09-19T05:47:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106824 s, 98.2 MB/s 2024-09-19T05:47:06.801 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.802 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.802 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131029 s, 80.0 MB/s 2024-09-19T05:47:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101472 s, 103 MB/s 2024-09-19T05:47:06.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.836 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.836 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143868 s, 72.9 MB/s 2024-09-19T05:47:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127114 s, 82.5 MB/s 2024-09-19T05:47:06.865 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.865 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.866 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013386 s, 78.3 MB/s 2024-09-19T05:47:06.879 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.879 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.879 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104687 s, 100 MB/s 2024-09-19T05:47:06.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.895 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130097 s, 80.6 MB/s 2024-09-19T05:47:06.911 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.911 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.911 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127734 s, 82.1 MB/s 2024-09-19T05:47:06.928 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.929 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133646 s, 78.5 MB/s 2024-09-19T05:47:06.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.945 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127701 s, 82.1 MB/s 2024-09-19T05:47:06.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.958 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101045 s, 104 MB/s 2024-09-19T05:47:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133261 s, 78.7 MB/s 2024-09-19T05:47:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146707 s, 71.5 MB/s 2024-09-19T05:47:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.009 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127885 s, 82.0 MB/s 2024-09-19T05:47:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137947 s, 76.0 MB/s 2024-09-19T05:47:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128176 s, 81.8 MB/s 2024-09-19T05:47:07.062 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.063 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.063 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143901 s, 72.9 MB/s 2024-09-19T05:47:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142212 s, 73.7 MB/s 2024-09-19T05:47:07.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.099 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132675 s, 79.0 MB/s 2024-09-19T05:47:07.115 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.115 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.115 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132538 s, 79.1 MB/s 2024-09-19T05:47:07.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.133 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140061 s, 74.9 MB/s 2024-09-19T05:47:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146215 s, 71.7 MB/s 2024-09-19T05:47:07.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143172 s, 73.2 MB/s 2024-09-19T05:47:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161054 s, 65.1 MB/s 2024-09-19T05:47:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.208 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014431 s, 72.7 MB/s 2024-09-19T05:47:07.225 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.226 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.226 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144428 s, 72.6 MB/s 2024-09-19T05:47:07.242 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.244 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137408 s, 76.3 MB/s 2024-09-19T05:47:07.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:07.251 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:07.251 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:07.251 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.4 2024-09-19T05:47:07.251 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:07.251 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:07.251 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:07.251 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:07.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.316 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126381 s, 83.0 MB/s 2024-09-19T05:47:07.331 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.331 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.331 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125554 s, 83.5 MB/s 2024-09-19T05:47:07.345 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.346 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.346 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01196 s, 87.7 MB/s 2024-09-19T05:47:07.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.359 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.359 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111555 s, 94.0 MB/s 2024-09-19T05:47:07.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.375 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123243 s, 85.1 MB/s 2024-09-19T05:47:07.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.388 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011225 s, 93.4 MB/s 2024-09-19T05:47:07.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127968 s, 81.9 MB/s 2024-09-19T05:47:07.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.416 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.416 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959697 s, 109 MB/s 2024-09-19T05:47:07.430 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.430 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.430 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011455 s, 91.5 MB/s 2024-09-19T05:47:07.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.445 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012418 s, 84.4 MB/s 2024-09-19T05:47:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122866 s, 85.3 MB/s 2024-09-19T05:47:07.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.474 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115781 s, 90.6 MB/s 2024-09-19T05:47:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137201 s, 76.4 MB/s 2024-09-19T05:47:07.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.506 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.507 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129128 s, 81.2 MB/s 2024-09-19T05:47:07.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.521 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115619 s, 90.7 MB/s 2024-09-19T05:47:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.536 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01251 s, 83.8 MB/s 2024-09-19T05:47:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.553 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141847 s, 73.9 MB/s 2024-09-19T05:47:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.569 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124168 s, 84.4 MB/s 2024-09-19T05:47:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119373 s, 87.8 MB/s 2024-09-19T05:47:07.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.599 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128363 s, 81.7 MB/s 2024-09-19T05:47:07.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126911 s, 82.6 MB/s 2024-09-19T05:47:07.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.631 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135029 s, 77.7 MB/s 2024-09-19T05:47:07.646 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.646 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.646 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119757 s, 87.6 MB/s 2024-09-19T05:47:07.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.661 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.661 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125712 s, 83.4 MB/s 2024-09-19T05:47:07.678 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142677 s, 73.5 MB/s 2024-09-19T05:47:07.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.694 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131006 s, 80.0 MB/s 2024-09-19T05:47:07.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.711 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138752 s, 75.6 MB/s 2024-09-19T05:47:07.726 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.726 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.726 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117103 s, 89.5 MB/s 2024-09-19T05:47:07.739 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.739 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.739 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101614 s, 103 MB/s 2024-09-19T05:47:07.756 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.756 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.756 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131892 s, 79.5 MB/s 2024-09-19T05:47:07.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.770 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120569 s, 87.0 MB/s 2024-09-19T05:47:07.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.785 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123755 s, 84.7 MB/s 2024-09-19T05:47:07.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:07.794 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:07.794 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:07.794 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.5 2024-09-19T05:47:07.794 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:07.794 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:07.794 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:07.794 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:07.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:07.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.901 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127912 s, 82.0 MB/s 2024-09-19T05:47:07.918 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.919 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.919 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141756 s, 74.0 MB/s 2024-09-19T05:47:07.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.936 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.936 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135223 s, 77.5 MB/s 2024-09-19T05:47:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.954 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142848 s, 73.4 MB/s 2024-09-19T05:47:07.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.967 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104997 s, 99.9 MB/s 2024-09-19T05:47:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:07.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135468 s, 77.4 MB/s 2024-09-19T05:47:07.999 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.000 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121862 s, 86.0 MB/s 2024-09-19T05:47:08.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128055 s, 81.9 MB/s 2024-09-19T05:47:08.032 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.032 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.033 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137655 s, 76.2 MB/s 2024-09-19T05:47:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134224 s, 78.1 MB/s 2024-09-19T05:47:08.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.066 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137661 s, 76.2 MB/s 2024-09-19T05:47:08.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.082 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130873 s, 80.1 MB/s 2024-09-19T05:47:08.099 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.099 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.099 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134568 s, 77.9 MB/s 2024-09-19T05:47:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125463 s, 83.6 MB/s 2024-09-19T05:47:08.130 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.130 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.130 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128658 s, 81.5 MB/s 2024-09-19T05:47:08.144 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.145 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.145 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113278 s, 92.6 MB/s 2024-09-19T05:47:08.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.160 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127701 s, 82.1 MB/s 2024-09-19T05:47:08.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.174 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108985 s, 96.2 MB/s 2024-09-19T05:47:08.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.190 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127627 s, 82.2 MB/s 2024-09-19T05:47:08.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.206 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.206 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131768 s, 79.6 MB/s 2024-09-19T05:47:08.223 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.223 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.223 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148477 s, 70.6 MB/s 2024-09-19T05:47:08.238 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.238 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.238 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118469 s, 88.5 MB/s 2024-09-19T05:47:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151487 s, 69.2 MB/s 2024-09-19T05:47:08.271 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.271 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.271 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125838 s, 83.3 MB/s 2024-09-19T05:47:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.287 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128474 s, 81.6 MB/s 2024-09-19T05:47:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121288 s, 86.5 MB/s 2024-09-19T05:47:08.317 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.318 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012352 s, 84.9 MB/s 2024-09-19T05:47:08.333 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.333 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.333 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125595 s, 83.5 MB/s 2024-09-19T05:47:08.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.351 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140504 s, 74.6 MB/s 2024-09-19T05:47:08.367 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.367 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.367 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135213 s, 77.5 MB/s 2024-09-19T05:47:08.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.381 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116074 s, 90.3 MB/s 2024-09-19T05:47:08.398 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.398 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.398 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137337 s, 76.4 MB/s 2024-09-19T05:47:08.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:08.406 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:08.406 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:08.406 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.6 2024-09-19T05:47:08.406 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:08.406 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:08.407 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:08.407 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:08.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:08.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.522 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136661 s, 76.7 MB/s 2024-09-19T05:47:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.538 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132405 s, 79.2 MB/s 2024-09-19T05:47:08.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.554 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124953 s, 83.9 MB/s 2024-09-19T05:47:08.569 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.569 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.569 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116249 s, 90.2 MB/s 2024-09-19T05:47:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01097 s, 95.6 MB/s 2024-09-19T05:47:08.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.599 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133333 s, 78.6 MB/s 2024-09-19T05:47:08.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.616 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013599 s, 77.1 MB/s 2024-09-19T05:47:08.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.631 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124518 s, 84.2 MB/s 2024-09-19T05:47:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101521 s, 103 MB/s 2024-09-19T05:47:08.660 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.660 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.660 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125238 s, 83.7 MB/s 2024-09-19T05:47:08.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.676 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125633 s, 83.5 MB/s 2024-09-19T05:47:08.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.688 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095454 s, 110 MB/s 2024-09-19T05:47:08.705 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144541 s, 72.5 MB/s 2024-09-19T05:47:08.720 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.721 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.721 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122588 s, 85.5 MB/s 2024-09-19T05:47:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116946 s, 89.7 MB/s 2024-09-19T05:47:08.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.751 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125197 s, 83.8 MB/s 2024-09-19T05:47:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126145 s, 83.1 MB/s 2024-09-19T05:47:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121121 s, 86.6 MB/s 2024-09-19T05:47:08.796 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.796 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.796 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118571 s, 88.4 MB/s 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012125 s, 86.5 MB/s 2024-09-19T05:47:08.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.826 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120078 s, 87.3 MB/s 2024-09-19T05:47:08.840 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.840 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.840 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995105 s, 105 MB/s 2024-09-19T05:47:08.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.853 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102825 s, 102 MB/s 2024-09-19T05:47:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982608 s, 107 MB/s 2024-09-19T05:47:08.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.881 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117678 s, 89.1 MB/s 2024-09-19T05:47:08.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.897 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129409 s, 81.0 MB/s 2024-09-19T05:47:08.911 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.911 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.911 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110065 s, 95.3 MB/s 2024-09-19T05:47:08.927 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.927 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131957 s, 79.5 MB/s 2024-09-19T05:47:08.942 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.943 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.943 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122134 s, 85.9 MB/s 2024-09-19T05:47:08.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.960 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.960 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137131 s, 76.5 MB/s 2024-09-19T05:47:08.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.977 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134454 s, 78.0 MB/s 2024-09-19T05:47:08.991 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:08.991 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:08.992 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111999 s, 93.6 MB/s 2024-09-19T05:47:08.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:09.000 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:09.000 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:09.000 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.7 2024-09-19T05:47:09.000 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:09.000 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:09.000 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:09.000 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:09.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:09.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.069 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122694 s, 85.5 MB/s 2024-09-19T05:47:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.084 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124726 s, 84.1 MB/s 2024-09-19T05:47:09.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.099 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114279 s, 91.8 MB/s 2024-09-19T05:47:09.115 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.116 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141081 s, 74.3 MB/s 2024-09-19T05:47:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121301 s, 86.4 MB/s 2024-09-19T05:47:09.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.147 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125591 s, 83.5 MB/s 2024-09-19T05:47:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111172 s, 94.3 MB/s 2024-09-19T05:47:09.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.176 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119808 s, 87.5 MB/s 2024-09-19T05:47:09.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.190 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114021 s, 92.0 MB/s 2024-09-19T05:47:09.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.204 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.204 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103071 s, 102 MB/s 2024-09-19T05:47:09.219 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.220 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.220 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130587 s, 80.3 MB/s 2024-09-19T05:47:09.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.234 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010795 s, 97.1 MB/s 2024-09-19T05:47:09.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.250 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.250 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134128 s, 78.2 MB/s 2024-09-19T05:47:09.264 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.265 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.265 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116135 s, 90.3 MB/s 2024-09-19T05:47:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133411 s, 78.6 MB/s 2024-09-19T05:47:09.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.295 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.296 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115677 s, 90.6 MB/s 2024-09-19T05:47:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131159 s, 79.9 MB/s 2024-09-19T05:47:09.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.326 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.326 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011511 s, 91.1 MB/s 2024-09-19T05:47:09.341 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.342 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123409 s, 85.0 MB/s 2024-09-19T05:47:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123842 s, 84.7 MB/s 2024-09-19T05:47:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111736 s, 93.8 MB/s 2024-09-19T05:47:09.384 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.384 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.384 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102797 s, 102 MB/s 2024-09-19T05:47:09.399 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.399 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.399 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120795 s, 86.8 MB/s 2024-09-19T05:47:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978568 s, 107 MB/s 2024-09-19T05:47:09.427 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.427 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.427 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118814 s, 88.3 MB/s 2024-09-19T05:47:09.440 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.440 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.440 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010098 s, 104 MB/s 2024-09-19T05:47:09.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.455 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112195 s, 93.5 MB/s 2024-09-19T05:47:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126018 s, 83.2 MB/s 2024-09-19T05:47:09.487 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.487 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.487 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127093 s, 82.5 MB/s 2024-09-19T05:47:09.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.503 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120201 s, 87.2 MB/s 2024-09-19T05:47:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.517 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.517 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106471 s, 98.5 MB/s 2024-09-19T05:47:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130281 s, 80.5 MB/s 2024-09-19T05:47:09.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:09.541 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:09.541 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:09.541 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.8 2024-09-19T05:47:09.541 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:09.541 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:09.541 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:09.541 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:09.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:09.607 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.607 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.608 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861761 s, 122 MB/s 2024-09-19T05:47:09.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968819 s, 108 MB/s 2024-09-19T05:47:09.634 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.635 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.635 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103681 s, 101 MB/s 2024-09-19T05:47:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117458 s, 89.3 MB/s 2024-09-19T05:47:09.666 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.667 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.667 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125908 s, 83.3 MB/s 2024-09-19T05:47:09.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.682 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119661 s, 87.6 MB/s 2024-09-19T05:47:09.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.700 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.700 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118538 s, 88.5 MB/s 2024-09-19T05:47:09.714 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.714 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.714 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132018 s, 79.4 MB/s 2024-09-19T05:47:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103693 s, 101 MB/s 2024-09-19T05:47:09.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.749 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127091 s, 82.5 MB/s 2024-09-19T05:47:09.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.768 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.768 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136639 s, 76.7 MB/s 2024-09-19T05:47:09.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.786 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119037 s, 88.1 MB/s 2024-09-19T05:47:09.805 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.806 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136127 s, 77.0 MB/s 2024-09-19T05:47:09.824 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.824 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.824 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013079 s, 80.2 MB/s 2024-09-19T05:47:09.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.842 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120557 s, 87.0 MB/s 2024-09-19T05:47:09.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.862 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.862 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140572 s, 74.6 MB/s 2024-09-19T05:47:09.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.881 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.881 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131203 s, 79.9 MB/s 2024-09-19T05:47:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132574 s, 79.1 MB/s 2024-09-19T05:47:09.921 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.922 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.922 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151353 s, 69.3 MB/s 2024-09-19T05:47:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148285 s, 70.7 MB/s 2024-09-19T05:47:09.963 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.963 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.963 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151466 s, 69.2 MB/s 2024-09-19T05:47:09.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:09.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:09.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014473 s, 72.5 MB/s 2024-09-19T05:47:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120808 s, 86.8 MB/s 2024-09-19T05:47:10.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.015 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.015 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114604 s, 91.5 MB/s 2024-09-19T05:47:10.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.031 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.031 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012784 s, 82.0 MB/s 2024-09-19T05:47:10.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.047 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.047 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113349 s, 92.5 MB/s 2024-09-19T05:47:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.066 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.066 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150062 s, 69.9 MB/s 2024-09-19T05:47:10.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.081 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113758 s, 92.2 MB/s 2024-09-19T05:47:10.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.096 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120599 s, 86.9 MB/s 2024-09-19T05:47:10.113 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.113 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.113 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133575 s, 78.5 MB/s 2024-09-19T05:47:10.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.129 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126241 s, 83.1 MB/s 2024-09-19T05:47:10.145 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.146 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128636 s, 81.5 MB/s 2024-09-19T05:47:10.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:10.155 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:10.155 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:10.155 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.9 2024-09-19T05:47:10.155 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:10.155 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:10.155 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:10.155 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:10.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963528 s, 109 MB/s 2024-09-19T05:47:10.246 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.247 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126198 s, 83.1 MB/s 2024-09-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124911 s, 83.9 MB/s 2024-09-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106205 s, 98.7 MB/s 2024-09-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.291 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116733 s, 89.8 MB/s 2024-09-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.305 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.306 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112458 s, 93.2 MB/s 2024-09-19T05:47:10.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.321 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122378 s, 85.7 MB/s 2024-09-19T05:47:10.337 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.337 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.337 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132237 s, 79.3 MB/s 2024-09-19T05:47:10.353 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.353 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.353 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130939 s, 80.1 MB/s 2024-09-19T05:47:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118987 s, 88.1 MB/s 2024-09-19T05:47:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923343 s, 114 MB/s 2024-09-19T05:47:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128002 s, 81.9 MB/s 2024-09-19T05:47:10.411 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.411 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.411 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117708 s, 89.1 MB/s 2024-09-19T05:47:10.425 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.425 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.425 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111525 s, 94.0 MB/s 2024-09-19T05:47:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940391 s, 112 MB/s 2024-09-19T05:47:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122577 s, 85.5 MB/s 2024-09-19T05:47:10.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.469 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131555 s, 79.7 MB/s 2024-09-19T05:47:10.483 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.483 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.483 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112687 s, 93.1 MB/s 2024-09-19T05:47:10.499 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.499 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.499 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124105 s, 84.5 MB/s 2024-09-19T05:47:10.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.512 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.512 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981457 s, 107 MB/s 2024-09-19T05:47:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128201 s, 81.8 MB/s 2024-09-19T05:47:10.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.540 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965069 s, 109 MB/s 2024-09-19T05:47:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103409 s, 101 MB/s 2024-09-19T05:47:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124207 s, 84.4 MB/s 2024-09-19T05:47:10.582 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.582 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.582 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010166 s, 103 MB/s 2024-09-19T05:47:10.598 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.598 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.598 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128057 s, 81.9 MB/s 2024-09-19T05:47:10.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.614 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.614 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125673 s, 83.4 MB/s 2024-09-19T05:47:10.629 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.629 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.629 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120696 s, 86.9 MB/s 2024-09-19T05:47:10.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.644 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.645 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126947 s, 82.6 MB/s 2024-09-19T05:47:10.659 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.659 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.659 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114434 s, 91.6 MB/s 2024-09-19T05:47:10.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.676 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142511 s, 73.6 MB/s 2024-09-19T05:47:10.691 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.692 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.692 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122674 s, 85.5 MB/s 2024-09-19T05:47:10.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:10.700 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:10.700 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:10.700 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.10 2024-09-19T05:47:10.700 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:10.701 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:10.701 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:10.701 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107089 s, 97.9 MB/s 2024-09-19T05:47:10.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.786 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124094 s, 84.5 MB/s 2024-09-19T05:47:10.804 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.804 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.804 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139372 s, 75.2 MB/s 2024-09-19T05:47:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130146 s, 80.6 MB/s 2024-09-19T05:47:10.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.837 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.837 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129829 s, 80.8 MB/s 2024-09-19T05:47:10.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.853 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.853 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129652 s, 80.9 MB/s 2024-09-19T05:47:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117333 s, 89.4 MB/s 2024-09-19T05:47:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120897 s, 86.7 MB/s 2024-09-19T05:47:10.898 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.898 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.898 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114891 s, 91.3 MB/s 2024-09-19T05:47:10.915 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.915 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.915 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130882 s, 80.1 MB/s 2024-09-19T05:47:10.929 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.930 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.930 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011915 s, 88.0 MB/s 2024-09-19T05:47:10.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.945 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.945 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125963 s, 83.2 MB/s 2024-09-19T05:47:10.962 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.963 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.963 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138732 s, 75.6 MB/s 2024-09-19T05:47:10.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.977 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111385 s, 94.1 MB/s 2024-09-19T05:47:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137168 s, 76.4 MB/s 2024-09-19T05:47:11.011 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.011 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.011 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137247 s, 76.4 MB/s 2024-09-19T05:47:11.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.029 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135482 s, 77.4 MB/s 2024-09-19T05:47:11.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.044 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116247 s, 90.2 MB/s 2024-09-19T05:47:11.060 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.060 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.061 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125234 s, 83.7 MB/s 2024-09-19T05:47:11.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.078 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.078 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138548 s, 75.7 MB/s 2024-09-19T05:47:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129745 s, 80.8 MB/s 2024-09-19T05:47:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117627 s, 89.1 MB/s 2024-09-19T05:47:11.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.125 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.126 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129719 s, 80.8 MB/s 2024-09-19T05:47:11.136 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:47:11.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:47:11.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.141 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012373 s, 84.7 MB/s 2024-09-19T05:47:11.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.156 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.156 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110274 s, 95.1 MB/s 2024-09-19T05:47:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.171 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121484 s, 86.3 MB/s 2024-09-19T05:47:11.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.185 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.185 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107632 s, 97.4 MB/s 2024-09-19T05:47:11.198 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.199 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103007 s, 102 MB/s 2024-09-19T05:47:11.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.214 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122129 s, 85.9 MB/s 2024-09-19T05:47:11.230 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.231 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138389 s, 75.8 MB/s 2024-09-19T05:47:11.264 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.265 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.265 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089998 s, 117 MB/s 2024-09-19T05:47:11.276 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.277 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.277 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930881 s, 113 MB/s 2024-09-19T05:47:11.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:11.284 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:11.284 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:11.285 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.11 2024-09-19T05:47:11.285 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:11.285 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:11.285 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:11.285 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:11.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.391 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114946 s, 91.2 MB/s 2024-09-19T05:47:11.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.407 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.407 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126316 s, 83.0 MB/s 2024-09-19T05:47:11.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.426 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.426 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147218 s, 71.2 MB/s 2024-09-19T05:47:11.438 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.439 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983177 s, 107 MB/s 2024-09-19T05:47:11.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.455 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134647 s, 77.9 MB/s 2024-09-19T05:47:11.469 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.470 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.470 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119315 s, 87.9 MB/s 2024-09-19T05:47:11.483 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.483 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.483 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01035 s, 101 MB/s 2024-09-19T05:47:11.497 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.497 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.497 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011337 s, 92.5 MB/s 2024-09-19T05:47:11.510 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.510 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.511 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109597 s, 95.7 MB/s 2024-09-19T05:47:11.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.523 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889512 s, 118 MB/s 2024-09-19T05:47:11.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.540 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144611 s, 72.5 MB/s 2024-09-19T05:47:11.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.554 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111804 s, 93.8 MB/s 2024-09-19T05:47:11.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112687 s, 93.1 MB/s 2024-09-19T05:47:11.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.583 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116747 s, 89.8 MB/s 2024-09-19T05:47:11.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.597 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.597 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103948 s, 101 MB/s 2024-09-19T05:47:11.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.610 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.610 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100023 s, 105 MB/s 2024-09-19T05:47:11.624 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.624 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.625 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118235 s, 88.7 MB/s 2024-09-19T05:47:11.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.638 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111933 s, 93.7 MB/s 2024-09-19T05:47:11.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.654 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118186 s, 88.7 MB/s 2024-09-19T05:47:11.667 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.668 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.668 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111056 s, 94.4 MB/s 2024-09-19T05:47:11.681 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.681 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.681 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101447 s, 103 MB/s 2024-09-19T05:47:11.695 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.695 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.695 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109863 s, 95.4 MB/s 2024-09-19T05:47:11.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.708 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102177 s, 103 MB/s 2024-09-19T05:47:11.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.722 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.722 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111363 s, 94.2 MB/s 2024-09-19T05:47:11.736 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.736 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.736 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109598 s, 95.7 MB/s 2024-09-19T05:47:11.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.749 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.750 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103945 s, 101 MB/s 2024-09-19T05:47:11.763 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.763 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.763 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104048 s, 101 MB/s 2024-09-19T05:47:11.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.777 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107394 s, 97.6 MB/s 2024-09-19T05:47:11.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.793 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109717 s, 95.6 MB/s 2024-09-19T05:47:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115336 s, 90.9 MB/s 2024-09-19T05:47:11.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.826 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.826 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117031 s, 89.6 MB/s 2024-09-19T05:47:11.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.839 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883538 s, 119 MB/s 2024-09-19T05:47:11.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:11.847 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:11.847 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:11.847 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.12 2024-09-19T05:47:11.847 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:11.847 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:11.847 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:11.847 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:11.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.958 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948516 s, 111 MB/s 2024-09-19T05:47:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118048 s, 88.8 MB/s 2024-09-19T05:47:11.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:11.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:11.990 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136181 s, 77.0 MB/s 2024-09-19T05:47:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.006 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116054 s, 90.4 MB/s 2024-09-19T05:47:12.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.022 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.022 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120275 s, 87.2 MB/s 2024-09-19T05:47:12.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.038 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126441 s, 82.9 MB/s 2024-09-19T05:47:12.053 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.053 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.054 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119423 s, 87.8 MB/s 2024-09-19T05:47:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120777 s, 86.8 MB/s 2024-09-19T05:47:12.085 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.085 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.086 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125302 s, 83.7 MB/s 2024-09-19T05:47:12.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.102 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136921 s, 76.6 MB/s 2024-09-19T05:47:12.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.116 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.116 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108576 s, 96.6 MB/s 2024-09-19T05:47:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102291 s, 103 MB/s 2024-09-19T05:47:12.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.147 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138881 s, 75.5 MB/s 2024-09-19T05:47:12.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.160 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102632 s, 102 MB/s 2024-09-19T05:47:12.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.178 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.178 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141943 s, 73.9 MB/s 2024-09-19T05:47:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123895 s, 84.6 MB/s 2024-09-19T05:47:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124746 s, 84.1 MB/s 2024-09-19T05:47:12.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.224 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011135 s, 94.2 MB/s 2024-09-19T05:47:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177437 s, 59.1 MB/s 2024-09-19T05:47:12.271 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.271 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.271 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109822 s, 95.5 MB/s 2024-09-19T05:47:12.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.285 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115067 s, 91.1 MB/s 2024-09-19T05:47:12.299 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.299 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.299 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110395 s, 95.0 MB/s 2024-09-19T05:47:12.312 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.313 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105295 s, 99.6 MB/s 2024-09-19T05:47:12.327 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.327 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.327 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117883 s, 89.0 MB/s 2024-09-19T05:47:12.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.342 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120931 s, 86.7 MB/s 2024-09-19T05:47:12.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.357 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111942 s, 93.7 MB/s 2024-09-19T05:47:12.372 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.372 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.372 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119105 s, 88.0 MB/s 2024-09-19T05:47:12.386 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.386 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.386 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109987 s, 95.3 MB/s 2024-09-19T05:47:12.401 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.401 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.401 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120324 s, 87.1 MB/s 2024-09-19T05:47:12.417 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.417 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.417 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129664 s, 80.9 MB/s 2024-09-19T05:47:12.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.432 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012384 s, 84.7 MB/s 2024-09-19T05:47:12.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.446 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.446 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119534 s, 87.7 MB/s 2024-09-19T05:47:12.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:12.454 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:12.454 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:12.455 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.13 2024-09-19T05:47:12.455 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:12.455 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:12.455 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:12.455 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:12.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117652 s, 89.1 MB/s 2024-09-19T05:47:12.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.579 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143316 s, 73.2 MB/s 2024-09-19T05:47:12.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.593 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.593 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991482 s, 106 MB/s 2024-09-19T05:47:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134094 s, 78.2 MB/s 2024-09-19T05:47:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961869 s, 109 MB/s 2024-09-19T05:47:12.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.638 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110656 s, 94.8 MB/s 2024-09-19T05:47:12.655 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.655 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.655 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142012 s, 73.8 MB/s 2024-09-19T05:47:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.672 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127543 s, 82.2 MB/s 2024-09-19T05:47:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.688 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127512 s, 82.2 MB/s 2024-09-19T05:47:12.703 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.704 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.704 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123041 s, 85.2 MB/s 2024-09-19T05:47:12.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.719 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126191 s, 83.1 MB/s 2024-09-19T05:47:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119813 s, 87.5 MB/s 2024-09-19T05:47:12.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.751 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134714 s, 77.8 MB/s 2024-09-19T05:47:12.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.766 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.766 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114928 s, 91.2 MB/s 2024-09-19T05:47:12.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.781 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.781 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120339 s, 87.1 MB/s 2024-09-19T05:47:12.795 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.796 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.796 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110582 s, 94.8 MB/s 2024-09-19T05:47:12.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.811 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.811 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125267 s, 83.7 MB/s 2024-09-19T05:47:12.824 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.825 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986878 s, 106 MB/s 2024-09-19T05:47:12.840 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.841 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130422 s, 80.4 MB/s 2024-09-19T05:47:12.856 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.856 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.856 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116699 s, 89.9 MB/s 2024-09-19T05:47:12.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.873 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013165 s, 79.6 MB/s 2024-09-19T05:47:12.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.888 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119244 s, 87.9 MB/s 2024-09-19T05:47:12.906 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.906 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.906 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136449 s, 76.8 MB/s 2024-09-19T05:47:12.923 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.923 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.923 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127919 s, 82.0 MB/s 2024-09-19T05:47:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129258 s, 81.1 MB/s 2024-09-19T05:47:12.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.958 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132565 s, 79.1 MB/s 2024-09-19T05:47:12.975 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.975 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.975 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118495 s, 88.5 MB/s 2024-09-19T05:47:12.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:12.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:12.990 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108723 s, 96.4 MB/s 2024-09-19T05:47:13.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.005 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118115 s, 88.8 MB/s 2024-09-19T05:47:13.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.021 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131131 s, 80.0 MB/s 2024-09-19T05:47:13.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.037 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.038 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128285 s, 81.7 MB/s 2024-09-19T05:47:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.053 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.053 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116091 s, 90.3 MB/s 2024-09-19T05:47:13.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:13.061 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:13.062 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:13.062 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.14 2024-09-19T05:47:13.062 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:13.062 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:13.062 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:13.062 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:13.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:13.173 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.173 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.173 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127016 s, 82.6 MB/s 2024-09-19T05:47:13.190 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.191 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.191 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141775 s, 74.0 MB/s 2024-09-19T05:47:13.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.207 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013554 s, 77.4 MB/s 2024-09-19T05:47:13.222 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.222 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.222 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112203 s, 93.5 MB/s 2024-09-19T05:47:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111173 s, 94.3 MB/s 2024-09-19T05:47:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143972 s, 72.8 MB/s 2024-09-19T05:47:13.300 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.301 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136781 s, 76.7 MB/s 2024-09-19T05:47:13.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.318 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134908 s, 77.7 MB/s 2024-09-19T05:47:13.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.336 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.337 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144072 s, 72.8 MB/s 2024-09-19T05:47:13.354 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.355 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.355 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142552 s, 73.6 MB/s 2024-09-19T05:47:13.370 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.370 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.370 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118873 s, 88.2 MB/s 2024-09-19T05:47:13.387 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.387 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.387 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136498 s, 76.8 MB/s 2024-09-19T05:47:13.405 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.405 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.405 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145197 s, 72.2 MB/s 2024-09-19T05:47:13.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.422 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013658 s, 76.8 MB/s 2024-09-19T05:47:13.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.437 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012253 s, 85.6 MB/s 2024-09-19T05:47:13.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.455 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.456 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149842 s, 70.0 MB/s 2024-09-19T05:47:13.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.473 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.473 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013531 s, 77.5 MB/s 2024-09-19T05:47:13.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.489 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134315 s, 78.1 MB/s 2024-09-19T05:47:13.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.504 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120631 s, 86.9 MB/s 2024-09-19T05:47:13.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.522 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138838 s, 75.5 MB/s 2024-09-19T05:47:13.537 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.537 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.537 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119079 s, 88.1 MB/s 2024-09-19T05:47:13.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.553 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.553 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013049 s, 80.4 MB/s 2024-09-19T05:47:13.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.567 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106599 s, 98.4 MB/s 2024-09-19T05:47:13.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.583 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012978 s, 80.8 MB/s 2024-09-19T05:47:13.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.599 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.599 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122238 s, 85.8 MB/s 2024-09-19T05:47:13.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.616 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.616 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135354 s, 77.5 MB/s 2024-09-19T05:47:13.634 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.634 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.634 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014803 s, 70.8 MB/s 2024-09-19T05:47:13.651 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.651 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.651 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134567 s, 77.9 MB/s 2024-09-19T05:47:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.665 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112277 s, 93.4 MB/s 2024-09-19T05:47:13.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.682 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.682 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132815 s, 79.0 MB/s 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131552 s, 79.7 MB/s 2024-09-19T05:47:13.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.715 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138603 s, 75.7 MB/s 2024-09-19T05:47:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:13.725 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:13.725 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:13.725 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.15 2024-09-19T05:47:13.725 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:13.725 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:13.725 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:13.725 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:13.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:13.796 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.796 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.796 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117248 s, 89.4 MB/s 2024-09-19T05:47:13.813 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.814 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150326 s, 69.8 MB/s 2024-09-19T05:47:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106438 s, 98.5 MB/s 2024-09-19T05:47:13.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.844 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01238 s, 84.7 MB/s 2024-09-19T05:47:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120357 s, 87.1 MB/s 2024-09-19T05:47:13.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.876 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133197 s, 78.7 MB/s 2024-09-19T05:47:13.890 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.890 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.891 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118968 s, 88.1 MB/s 2024-09-19T05:47:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133963 s, 78.3 MB/s 2024-09-19T05:47:13.923 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.923 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.923 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121302 s, 86.4 MB/s 2024-09-19T05:47:13.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141542 s, 74.1 MB/s 2024-09-19T05:47:13.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.958 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136047 s, 77.1 MB/s 2024-09-19T05:47:13.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.973 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.973 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126897 s, 82.6 MB/s 2024-09-19T05:47:13.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:13.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:13.991 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134101 s, 78.2 MB/s 2024-09-19T05:47:14.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.007 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.007 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130868 s, 80.1 MB/s 2024-09-19T05:47:14.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.023 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.024 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129245 s, 81.1 MB/s 2024-09-19T05:47:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924761 s, 113 MB/s 2024-09-19T05:47:14.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.049 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.049 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988163 s, 106 MB/s 2024-09-19T05:47:14.062 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.062 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.062 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969466 s, 108 MB/s 2024-09-19T05:47:14.075 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.076 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.076 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100504 s, 104 MB/s 2024-09-19T05:47:14.090 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.090 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.090 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112945 s, 92.8 MB/s 2024-09-19T05:47:14.105 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.105 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.105 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120523 s, 87.0 MB/s 2024-09-19T05:47:14.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.121 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117314 s, 89.4 MB/s 2024-09-19T05:47:14.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.137 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014076 s, 74.5 MB/s 2024-09-19T05:47:14.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.152 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115881 s, 90.5 MB/s 2024-09-19T05:47:14.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.167 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124573 s, 84.2 MB/s 2024-09-19T05:47:14.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.183 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.183 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120475 s, 87.0 MB/s 2024-09-19T05:47:14.198 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.198 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.198 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121463 s, 86.3 MB/s 2024-09-19T05:47:14.212 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.213 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114401 s, 91.7 MB/s 2024-09-19T05:47:14.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.227 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.227 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107887 s, 97.2 MB/s 2024-09-19T05:47:14.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.243 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.244 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134036 s, 78.2 MB/s 2024-09-19T05:47:14.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.303 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.303 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123402 s, 85.0 MB/s 2024-09-19T05:47:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114831 s, 91.3 MB/s 2024-09-19T05:47:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:14.327 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:14.327 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:14.327 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.16 2024-09-19T05:47:14.327 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:14.327 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:14.327 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:14.327 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:14.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:14.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.391 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113667 s, 92.2 MB/s 2024-09-19T05:47:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120483 s, 87.0 MB/s 2024-09-19T05:47:14.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.421 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103935 s, 101 MB/s 2024-09-19T05:47:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113013 s, 92.8 MB/s 2024-09-19T05:47:14.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133821 s, 78.4 MB/s 2024-09-19T05:47:14.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.468 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119047 s, 88.1 MB/s 2024-09-19T05:47:14.484 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.484 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.484 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127115 s, 82.5 MB/s 2024-09-19T05:47:14.499 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.499 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115599 s, 90.7 MB/s 2024-09-19T05:47:14.514 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.514 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.514 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115165 s, 91.1 MB/s 2024-09-19T05:47:14.527 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.527 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.527 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996274 s, 105 MB/s 2024-09-19T05:47:14.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.540 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105004 s, 99.9 MB/s 2024-09-19T05:47:14.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.555 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116743 s, 89.8 MB/s 2024-09-19T05:47:14.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.571 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.571 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128286 s, 81.7 MB/s 2024-09-19T05:47:14.586 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.586 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.587 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114122 s, 91.9 MB/s 2024-09-19T05:47:14.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.602 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.602 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110741 s, 94.7 MB/s 2024-09-19T05:47:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109492 s, 95.8 MB/s 2024-09-19T05:47:14.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.636 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014075 s, 74.5 MB/s 2024-09-19T05:47:14.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.653 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129061 s, 81.2 MB/s 2024-09-19T05:47:14.668 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.668 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.668 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119001 s, 88.1 MB/s 2024-09-19T05:47:14.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.685 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135091 s, 77.6 MB/s 2024-09-19T05:47:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.700 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.700 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118878 s, 88.2 MB/s 2024-09-19T05:47:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.713 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105485 s, 99.4 MB/s 2024-09-19T05:47:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111214 s, 94.3 MB/s 2024-09-19T05:47:14.744 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140455 s, 74.7 MB/s 2024-09-19T05:47:14.760 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.760 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.760 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012011 s, 87.3 MB/s 2024-09-19T05:47:14.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.777 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.777 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133997 s, 78.3 MB/s 2024-09-19T05:47:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127969 s, 81.9 MB/s 2024-09-19T05:47:14.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.810 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139602 s, 75.1 MB/s 2024-09-19T05:47:14.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.825 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116399 s, 90.1 MB/s 2024-09-19T05:47:14.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.842 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131337 s, 79.8 MB/s 2024-09-19T05:47:14.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.859 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125215 s, 83.7 MB/s 2024-09-19T05:47:14.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:14.876 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:14.876 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130031 s, 80.6 MB/s 2024-09-19T05:47:14.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:14.885 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:14.885 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:14.885 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.17 2024-09-19T05:47:14.885 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:14.886 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:14.886 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:14.886 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:14.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:15.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.003 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.003 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134428 s, 78.0 MB/s 2024-09-19T05:47:15.018 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.018 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.018 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114877 s, 91.3 MB/s 2024-09-19T05:47:15.033 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.034 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.034 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122933 s, 85.3 MB/s 2024-09-19T05:47:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128542 s, 81.6 MB/s 2024-09-19T05:47:15.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.065 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.065 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119019 s, 88.1 MB/s 2024-09-19T05:47:15.082 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.083 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.083 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136252 s, 77.0 MB/s 2024-09-19T05:47:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966736 s, 108 MB/s 2024-09-19T05:47:15.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.110 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109317 s, 95.9 MB/s 2024-09-19T05:47:15.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.124 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.124 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106651 s, 98.3 MB/s 2024-09-19T05:47:15.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.137 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935878 s, 112 MB/s 2024-09-19T05:47:15.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.152 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.152 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122132 s, 85.9 MB/s 2024-09-19T05:47:15.166 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.166 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.166 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010797 s, 97.1 MB/s 2024-09-19T05:47:15.179 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.180 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.180 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010616 s, 98.8 MB/s 2024-09-19T05:47:15.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.197 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145018 s, 72.3 MB/s 2024-09-19T05:47:15.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.213 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.213 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119734 s, 87.6 MB/s 2024-09-19T05:47:15.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.229 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125835 s, 83.3 MB/s 2024-09-19T05:47:15.248 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.248 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.248 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155386 s, 67.5 MB/s 2024-09-19T05:47:15.280 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.281 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.281 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147384 s, 71.1 MB/s 2024-09-19T05:47:15.297 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.298 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.298 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128547 s, 81.6 MB/s 2024-09-19T05:47:15.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.315 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.315 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133916 s, 78.3 MB/s 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124786 s, 84.0 MB/s 2024-09-19T05:47:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.348 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.348 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129275 s, 81.1 MB/s 2024-09-19T05:47:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131011 s, 80.0 MB/s 2024-09-19T05:47:15.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.381 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.381 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137895 s, 76.0 MB/s 2024-09-19T05:47:15.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.397 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.397 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123529 s, 84.9 MB/s 2024-09-19T05:47:15.414 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.414 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.414 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134013 s, 78.2 MB/s 2024-09-19T05:47:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.430 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124482 s, 84.2 MB/s 2024-09-19T05:47:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126639 s, 82.8 MB/s 2024-09-19T05:47:15.461 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.461 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.461 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127046 s, 82.5 MB/s 2024-09-19T05:47:15.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.476 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114693 s, 91.4 MB/s 2024-09-19T05:47:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126606 s, 82.8 MB/s 2024-09-19T05:47:15.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140229 s, 74.8 MB/s 2024-09-19T05:47:15.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:15.518 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:15.518 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:15.518 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.18 2024-09-19T05:47:15.518 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:15.518 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:15.518 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:15.518 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:15.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.584 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012487 s, 84.0 MB/s 2024-09-19T05:47:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141964 s, 73.9 MB/s 2024-09-19T05:47:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.617 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012817 s, 81.8 MB/s 2024-09-19T05:47:15.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.633 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129431 s, 81.0 MB/s 2024-09-19T05:47:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114601 s, 91.5 MB/s 2024-09-19T05:47:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115335 s, 90.9 MB/s 2024-09-19T05:47:15.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127161 s, 82.5 MB/s 2024-09-19T05:47:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011672 s, 89.8 MB/s 2024-09-19T05:47:15.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.706 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.706 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892137 s, 118 MB/s 2024-09-19T05:47:15.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.719 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.719 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989675 s, 106 MB/s 2024-09-19T05:47:15.731 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.731 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.731 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843482 s, 124 MB/s 2024-09-19T05:47:15.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.743 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100397 s, 104 MB/s 2024-09-19T05:47:15.758 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.758 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.758 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117778 s, 89.0 MB/s 2024-09-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.773 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.774 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122364 s, 85.7 MB/s 2024-09-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.787 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107647 s, 97.4 MB/s 2024-09-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.803 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129334 s, 81.1 MB/s 2024-09-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.817 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106962 s, 98.0 MB/s 2024-09-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.832 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121933 s, 86.0 MB/s 2024-09-19T05:47:15.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.844 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.844 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944957 s, 111 MB/s 2024-09-19T05:47:15.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.858 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.858 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104161 s, 101 MB/s 2024-09-19T05:47:15.871 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.872 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108157 s, 96.9 MB/s 2024-09-19T05:47:15.885 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.886 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.886 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114042 s, 91.9 MB/s 2024-09-19T05:47:15.900 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.900 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.900 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108263 s, 96.9 MB/s 2024-09-19T05:47:15.915 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.983 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126269 s, 83.0 MB/s 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012915 s, 81.2 MB/s 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136257 s, 77.0 MB/s 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013576 s, 77.2 MB/s 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113758 s, 92.2 MB/s 2024-09-19T05:47:15.995 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:15.995 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:15.995 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112984 s, 92.8 MB/s 2024-09-19T05:47:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124879 s, 84.0 MB/s 2024-09-19T05:47:16.028 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.029 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014368 s, 73.0 MB/s 2024-09-19T05:47:16.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.044 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.044 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011617 s, 90.3 MB/s 2024-09-19T05:47:16.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:16.052 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:16.052 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:16.052 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.19 2024-09-19T05:47:16.052 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:16.052 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:16.052 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:16.052 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:16.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:16.161 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.162 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.162 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101197 s, 104 MB/s 2024-09-19T05:47:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.177 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130249 s, 80.5 MB/s 2024-09-19T05:47:16.191 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.191 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.192 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011171 s, 93.9 MB/s 2024-09-19T05:47:16.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.207 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123216 s, 85.1 MB/s 2024-09-19T05:47:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122725 s, 85.4 MB/s 2024-09-19T05:47:16.238 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.238 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.238 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128367 s, 81.7 MB/s 2024-09-19T05:47:16.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.251 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.251 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101701 s, 103 MB/s 2024-09-19T05:47:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940757 s, 111 MB/s 2024-09-19T05:47:16.307 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.307 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.307 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114705 s, 91.4 MB/s 2024-09-19T05:47:16.322 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.322 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.322 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114205 s, 91.8 MB/s 2024-09-19T05:47:16.338 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.338 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.338 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132959 s, 78.9 MB/s 2024-09-19T05:47:16.353 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.353 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.353 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011851 s, 88.5 MB/s 2024-09-19T05:47:16.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.375 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.375 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188131 s, 55.7 MB/s 2024-09-19T05:47:16.390 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.391 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127447 s, 82.3 MB/s 2024-09-19T05:47:16.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.406 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116678 s, 89.9 MB/s 2024-09-19T05:47:16.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.422 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114401 s, 91.7 MB/s 2024-09-19T05:47:16.439 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.440 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.440 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148539 s, 70.6 MB/s 2024-09-19T05:47:16.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925041 s, 113 MB/s 2024-09-19T05:47:16.467 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.468 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.468 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127243 s, 82.4 MB/s 2024-09-19T05:47:16.480 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.480 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.480 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950944 s, 110 MB/s 2024-09-19T05:47:16.494 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.495 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119885 s, 87.5 MB/s 2024-09-19T05:47:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112445 s, 93.3 MB/s 2024-09-19T05:47:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108186 s, 96.9 MB/s 2024-09-19T05:47:16.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.538 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.539 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122709 s, 85.5 MB/s 2024-09-19T05:47:16.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.551 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985815 s, 106 MB/s 2024-09-19T05:47:16.566 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.566 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.566 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115714 s, 90.6 MB/s 2024-09-19T05:47:16.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.580 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110682 s, 94.7 MB/s 2024-09-19T05:47:16.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.589 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.589 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733901 s, 143 MB/s 2024-09-19T05:47:16.598 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.598 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.598 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690007 s, 152 MB/s 2024-09-19T05:47:16.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.609 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.610 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092356 s, 114 MB/s 2024-09-19T05:47:16.622 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.622 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.622 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103975 s, 101 MB/s 2024-09-19T05:47:16.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.636 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117208 s, 89.5 MB/s 2024-09-19T05:47:16.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:16.642 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:16.643 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:16.643 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.20 2024-09-19T05:47:16.643 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:16.643 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:16.643 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:16.643 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:16.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:16.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.742 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116293 s, 90.2 MB/s 2024-09-19T05:47:16.754 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.754 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.754 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105662 s, 99.2 MB/s 2024-09-19T05:47:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134462 s, 78.0 MB/s 2024-09-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125572 s, 83.5 MB/s 2024-09-19T05:47:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.800 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010644 s, 98.5 MB/s 2024-09-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.814 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119809 s, 87.5 MB/s 2024-09-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.827 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977101 s, 107 MB/s 2024-09-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.842 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125728 s, 83.4 MB/s 2024-09-19T05:47:16.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.857 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121616 s, 86.2 MB/s 2024-09-19T05:47:16.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.872 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116751 s, 89.8 MB/s 2024-09-19T05:47:16.886 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.886 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.886 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108327 s, 96.8 MB/s 2024-09-19T05:47:16.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.901 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012176 s, 86.1 MB/s 2024-09-19T05:47:16.916 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.916 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.916 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122145 s, 85.8 MB/s 2024-09-19T05:47:16.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.931 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.931 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116624 s, 89.9 MB/s 2024-09-19T05:47:16.946 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.947 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.947 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128728 s, 81.5 MB/s 2024-09-19T05:47:16.959 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.959 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.960 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099364 s, 106 MB/s 2024-09-19T05:47:16.975 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.975 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.975 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125817 s, 83.3 MB/s 2024-09-19T05:47:16.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:16.990 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:16.990 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113886 s, 92.1 MB/s 2024-09-19T05:47:17.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.005 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118595 s, 88.4 MB/s 2024-09-19T05:47:17.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.021 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.022 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123909 s, 84.6 MB/s 2024-09-19T05:47:17.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.036 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.036 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113646 s, 92.3 MB/s 2024-09-19T05:47:17.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.051 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.051 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118282 s, 88.7 MB/s 2024-09-19T05:47:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.067 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110286 s, 95.1 MB/s 2024-09-19T05:47:17.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.081 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.081 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125156 s, 83.8 MB/s 2024-09-19T05:47:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105119 s, 99.8 MB/s 2024-09-19T05:47:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128611 s, 81.5 MB/s 2024-09-19T05:47:17.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.127 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126012 s, 83.2 MB/s 2024-09-19T05:47:17.143 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.143 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.143 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129511 s, 81.0 MB/s 2024-09-19T05:47:17.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.159 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.159 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123459 s, 84.9 MB/s 2024-09-19T05:47:17.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.176 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.176 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133883 s, 78.3 MB/s 2024-09-19T05:47:17.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.197 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159426 s, 65.8 MB/s 2024-09-19T05:47:17.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.217 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015452 s, 67.9 MB/s 2024-09-19T05:47:17.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:17.226 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:17.226 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:17.226 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.21 2024-09-19T05:47:17.226 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:17.227 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:17.227 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:17.227 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:17.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:17.333 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107939 s, 97.1 MB/s 2024-09-19T05:47:17.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.350 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137075 s, 76.5 MB/s 2024-09-19T05:47:17.362 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.363 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.363 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955909 s, 110 MB/s 2024-09-19T05:47:17.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.380 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133505 s, 78.5 MB/s 2024-09-19T05:47:17.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.395 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.395 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120976 s, 86.7 MB/s 2024-09-19T05:47:17.411 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.411 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.411 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126918 s, 82.6 MB/s 2024-09-19T05:47:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.429 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137386 s, 76.3 MB/s 2024-09-19T05:47:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102074 s, 103 MB/s 2024-09-19T05:47:17.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.459 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.459 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135021 s, 77.7 MB/s 2024-09-19T05:47:17.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.474 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.474 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117267 s, 89.4 MB/s 2024-09-19T05:47:17.488 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.489 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.489 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104986 s, 99.9 MB/s 2024-09-19T05:47:17.503 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.504 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.504 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122974 s, 85.3 MB/s 2024-09-19T05:47:17.520 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.520 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.521 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131385 s, 79.8 MB/s 2024-09-19T05:47:17.534 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.534 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.534 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990697 s, 106 MB/s 2024-09-19T05:47:17.549 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.549 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.550 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126627 s, 82.8 MB/s 2024-09-19T05:47:17.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.565 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.565 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012826 s, 81.8 MB/s 2024-09-19T05:47:17.582 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.583 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.583 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137661 s, 76.2 MB/s 2024-09-19T05:47:17.598 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.598 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.598 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125074 s, 83.8 MB/s 2024-09-19T05:47:17.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.615 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.615 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135443 s, 77.4 MB/s 2024-09-19T05:47:17.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.633 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148936 s, 70.4 MB/s 2024-09-19T05:47:17.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.649 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121111 s, 86.6 MB/s 2024-09-19T05:47:17.665 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.665 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.665 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133674 s, 78.4 MB/s 2024-09-19T05:47:17.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010507 s, 99.8 MB/s 2024-09-19T05:47:17.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.696 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134689 s, 77.9 MB/s 2024-09-19T05:47:17.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.712 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.712 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131934 s, 79.5 MB/s 2024-09-19T05:47:17.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.728 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125315 s, 83.7 MB/s 2024-09-19T05:47:17.745 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.745 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.745 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142835 s, 73.4 MB/s 2024-09-19T05:47:17.762 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.762 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.762 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139528 s, 75.2 MB/s 2024-09-19T05:47:17.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.778 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.778 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121703 s, 86.2 MB/s 2024-09-19T05:47:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.795 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.795 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135145 s, 77.6 MB/s 2024-09-19T05:47:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124561 s, 84.2 MB/s 2024-09-19T05:47:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.825 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122224 s, 85.8 MB/s 2024-09-19T05:47:17.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:17.834 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:17.834 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:17.834 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.22 2024-09-19T05:47:17.834 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:17.835 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:17.835 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:17.835 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:17.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:17.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.941 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.941 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125535 s, 83.5 MB/s 2024-09-19T05:47:17.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.958 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.958 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137049 s, 76.5 MB/s 2024-09-19T05:47:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.976 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133593 s, 78.5 MB/s 2024-09-19T05:47:17.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:17.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:17.993 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138705 s, 75.6 MB/s 2024-09-19T05:47:18.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.008 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114378 s, 91.7 MB/s 2024-09-19T05:47:18.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.024 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126686 s, 82.8 MB/s 2024-09-19T05:47:18.042 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.043 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145875 s, 71.9 MB/s 2024-09-19T05:47:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012556 s, 83.5 MB/s 2024-09-19T05:47:18.075 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.075 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.075 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128358 s, 81.7 MB/s 2024-09-19T05:47:18.092 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.092 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.092 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136885 s, 76.6 MB/s 2024-09-19T05:47:18.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.106 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.106 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991962 s, 106 MB/s 2024-09-19T05:47:18.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.121 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.121 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114165 s, 91.8 MB/s 2024-09-19T05:47:18.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.137 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124725 s, 84.1 MB/s 2024-09-19T05:47:18.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.153 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.153 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129248 s, 81.1 MB/s 2024-09-19T05:47:18.168 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.168 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.168 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118291 s, 88.6 MB/s 2024-09-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116976 s, 89.6 MB/s 2024-09-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.199 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131602 s, 79.7 MB/s 2024-09-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132321 s, 79.2 MB/s 2024-09-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.231 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129037 s, 81.3 MB/s 2024-09-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.245 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011073 s, 94.7 MB/s 2024-09-19T05:47:18.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.262 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140261 s, 74.8 MB/s 2024-09-19T05:47:18.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.291 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.291 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117355 s, 89.4 MB/s 2024-09-19T05:47:18.309 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.309 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.309 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109064 s, 96.1 MB/s 2024-09-19T05:47:18.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.321 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.321 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012459 s, 84.2 MB/s 2024-09-19T05:47:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.337 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013123 s, 79.9 MB/s 2024-09-19T05:47:18.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.351 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106407 s, 98.5 MB/s 2024-09-19T05:47:18.362 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.362 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.363 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912292 s, 115 MB/s 2024-09-19T05:47:18.377 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.378 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012144 s, 86.3 MB/s 2024-09-19T05:47:18.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.391 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.391 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011071 s, 94.7 MB/s 2024-09-19T05:47:18.408 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.409 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136715 s, 76.7 MB/s 2024-09-19T05:47:18.424 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.424 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.425 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123983 s, 84.6 MB/s 2024-09-19T05:47:18.441 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.441 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.441 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129778 s, 80.8 MB/s 2024-09-19T05:47:18.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:18.450 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:18.450 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:18.450 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.23 2024-09-19T05:47:18.450 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:18.450 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:18.450 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:18.450 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:18.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:18.514 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.514 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.514 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117998 s, 88.9 MB/s 2024-09-19T05:47:18.527 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.528 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.528 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010551 s, 99.4 MB/s 2024-09-19T05:47:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.540 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922241 s, 114 MB/s 2024-09-19T05:47:18.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.555 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112147 s, 93.5 MB/s 2024-09-19T05:47:18.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.568 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.568 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105211 s, 99.7 MB/s 2024-09-19T05:47:18.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.584 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.585 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124429 s, 84.3 MB/s 2024-09-19T05:47:18.600 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.601 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.601 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127497 s, 82.2 MB/s 2024-09-19T05:47:18.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.617 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.617 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122511 s, 85.6 MB/s 2024-09-19T05:47:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118492 s, 88.5 MB/s 2024-09-19T05:47:18.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.648 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124957 s, 83.9 MB/s 2024-09-19T05:47:18.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.665 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.665 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125523 s, 83.5 MB/s 2024-09-19T05:47:18.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.679 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.679 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117517 s, 89.2 MB/s 2024-09-19T05:47:18.695 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.695 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.695 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118449 s, 88.5 MB/s 2024-09-19T05:47:18.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.708 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.708 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103722 s, 101 MB/s 2024-09-19T05:47:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124817 s, 84.0 MB/s 2024-09-19T05:47:18.740 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.741 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124195 s, 84.4 MB/s 2024-09-19T05:47:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128037 s, 81.9 MB/s 2024-09-19T05:47:18.774 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.774 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.774 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133325 s, 78.6 MB/s 2024-09-19T05:47:18.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.791 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134776 s, 77.8 MB/s 2024-09-19T05:47:18.807 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.808 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.808 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134513 s, 78.0 MB/s 2024-09-19T05:47:18.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.825 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.825 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136341 s, 76.9 MB/s 2024-09-19T05:47:18.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.842 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.842 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137818 s, 76.1 MB/s 2024-09-19T05:47:18.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.859 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.859 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128072 s, 81.9 MB/s 2024-09-19T05:47:18.875 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.875 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.875 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131515 s, 79.7 MB/s 2024-09-19T05:47:18.891 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.892 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.892 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135109 s, 77.6 MB/s 2024-09-19T05:47:18.907 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.908 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.908 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012549 s, 83.6 MB/s 2024-09-19T05:47:18.921 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.921 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.922 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108448 s, 96.7 MB/s 2024-09-19T05:47:18.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.939 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.939 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148077 s, 70.8 MB/s 2024-09-19T05:47:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129779 s, 80.8 MB/s 2024-09-19T05:47:18.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.972 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.973 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134121 s, 78.2 MB/s 2024-09-19T05:47:18.988 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:18.989 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:18.989 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130573 s, 80.3 MB/s 2024-09-19T05:47:19.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.005 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.005 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136592 s, 76.8 MB/s 2024-09-19T05:47:19.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:19.014 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:19.014 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:19.014 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.24 2024-09-19T05:47:19.014 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:19.014 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:19.014 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:19.014 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:19.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:19.119 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.120 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.120 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112961 s, 92.8 MB/s 2024-09-19T05:47:19.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.137 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.138 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145273 s, 72.2 MB/s 2024-09-19T05:47:19.151 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.151 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.152 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108437 s, 96.7 MB/s 2024-09-19T05:47:19.166 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.166 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.166 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115725 s, 90.6 MB/s 2024-09-19T05:47:19.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.182 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.182 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122074 s, 85.9 MB/s 2024-09-19T05:47:19.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.199 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137103 s, 76.5 MB/s 2024-09-19T05:47:19.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.214 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116741 s, 89.8 MB/s 2024-09-19T05:47:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133244 s, 78.7 MB/s 2024-09-19T05:47:19.248 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.248 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.248 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131186 s, 79.9 MB/s 2024-09-19T05:47:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110991 s, 94.5 MB/s 2024-09-19T05:47:19.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.306 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.306 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112479 s, 93.2 MB/s 2024-09-19T05:47:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991083 s, 106 MB/s 2024-09-19T05:47:19.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.339 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.339 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147657 s, 71.0 MB/s 2024-09-19T05:47:19.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.357 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139853 s, 75.0 MB/s 2024-09-19T05:47:19.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.374 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.374 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126949 s, 82.6 MB/s 2024-09-19T05:47:19.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120208 s, 87.2 MB/s 2024-09-19T05:47:19.405 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.406 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.406 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120618 s, 86.9 MB/s 2024-09-19T05:47:19.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.422 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.422 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135412 s, 77.4 MB/s 2024-09-19T05:47:19.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.437 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.437 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108507 s, 96.6 MB/s 2024-09-19T05:47:19.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.452 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.452 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122554 s, 85.6 MB/s 2024-09-19T05:47:19.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.472 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.472 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161365 s, 65.0 MB/s 2024-09-19T05:47:19.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.486 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.486 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111561 s, 94.0 MB/s 2024-09-19T05:47:19.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.502 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.502 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127317 s, 82.4 MB/s 2024-09-19T05:47:19.517 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.517 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.517 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123616 s, 84.8 MB/s 2024-09-19T05:47:19.533 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.534 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.534 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134171 s, 78.2 MB/s 2024-09-19T05:47:19.549 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.549 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.549 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120712 s, 86.9 MB/s 2024-09-19T05:47:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138348 s, 75.8 MB/s 2024-09-19T05:47:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117327 s, 89.4 MB/s 2024-09-19T05:47:19.597 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.597 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.597 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121659 s, 86.2 MB/s 2024-09-19T05:47:19.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.613 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.613 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135275 s, 77.5 MB/s 2024-09-19T05:47:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149443 s, 70.2 MB/s 2024-09-19T05:47:19.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.648 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.648 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124388 s, 84.3 MB/s 2024-09-19T05:47:19.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:19.657 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:19.657 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:19.657 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.25 2024-09-19T05:47:19.657 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:19.657 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:19.658 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:19.658 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:19.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138165 s, 75.9 MB/s 2024-09-19T05:47:19.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.743 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011086 s, 94.6 MB/s 2024-09-19T05:47:19.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.759 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135592 s, 77.3 MB/s 2024-09-19T05:47:19.774 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.774 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.774 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112015 s, 93.6 MB/s 2024-09-19T05:47:19.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.791 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.791 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135057 s, 77.6 MB/s 2024-09-19T05:47:19.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.806 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.806 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122471 s, 85.6 MB/s 2024-09-19T05:47:19.823 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.823 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.823 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132095 s, 79.4 MB/s 2024-09-19T05:47:19.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.841 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.841 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132795 s, 79.0 MB/s 2024-09-19T05:47:19.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.857 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.858 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144362 s, 72.6 MB/s 2024-09-19T05:47:19.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.872 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117139 s, 89.5 MB/s 2024-09-19T05:47:19.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.888 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.888 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124312 s, 84.4 MB/s 2024-09-19T05:47:19.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.901 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.901 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01025 s, 102 MB/s 2024-09-19T05:47:19.917 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.918 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.918 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132753 s, 79.0 MB/s 2024-09-19T05:47:19.934 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.934 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.934 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013375 s, 78.4 MB/s 2024-09-19T05:47:19.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.951 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.951 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132814 s, 79.0 MB/s 2024-09-19T05:47:19.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.967 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.967 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130538 s, 80.3 MB/s 2024-09-19T05:47:19.981 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.982 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.982 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117216 s, 89.5 MB/s 2024-09-19T05:47:19.998 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:19.998 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:19.998 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130804 s, 80.2 MB/s 2024-09-19T05:47:20.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.013 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.013 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123112 s, 85.2 MB/s 2024-09-19T05:47:20.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.029 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.029 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122608 s, 85.5 MB/s 2024-09-19T05:47:20.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.043 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118378 s, 88.6 MB/s 2024-09-19T05:47:20.058 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.059 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.059 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01173 s, 89.4 MB/s 2024-09-19T05:47:20.073 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.073 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.073 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115111 s, 91.1 MB/s 2024-09-19T05:47:20.085 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.085 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.086 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946328 s, 111 MB/s 2024-09-19T05:47:20.099 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.099 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.099 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103659 s, 101 MB/s 2024-09-19T05:47:20.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.114 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122743 s, 85.4 MB/s 2024-09-19T05:47:20.128 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.128 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.128 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111182 s, 94.3 MB/s 2024-09-19T05:47:20.145 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.145 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.145 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115698 s, 90.6 MB/s 2024-09-19T05:47:20.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.157 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.157 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115002 s, 91.2 MB/s 2024-09-19T05:47:20.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.169 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.169 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922187 s, 114 MB/s 2024-09-19T05:47:20.183 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.183 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.183 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011389 s, 92.1 MB/s 2024-09-19T05:47:20.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.197 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.197 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111718 s, 93.9 MB/s 2024-09-19T05:47:20.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:20.204 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:20.204 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:20.204 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.26 2024-09-19T05:47:20.204 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:20.204 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:20.204 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:20.204 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:20.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:20.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.318 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.318 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122037 s, 85.9 MB/s 2024-09-19T05:47:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119912 s, 87.4 MB/s 2024-09-19T05:47:20.345 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.345 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.345 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878844 s, 119 MB/s 2024-09-19T05:47:20.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.358 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.358 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111466 s, 94.1 MB/s 2024-09-19T05:47:20.372 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.372 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.373 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112827 s, 92.9 MB/s 2024-09-19T05:47:20.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.383 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.383 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00801896 s, 131 MB/s 2024-09-19T05:47:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.400 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144368 s, 72.6 MB/s 2024-09-19T05:47:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010922 s, 96.0 MB/s 2024-09-19T05:47:20.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.428 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.428 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117368 s, 89.3 MB/s 2024-09-19T05:47:20.441 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.441 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.441 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106451 s, 98.5 MB/s 2024-09-19T05:47:20.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.451 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.451 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768211 s, 136 MB/s 2024-09-19T05:47:20.462 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.463 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.463 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859361 s, 122 MB/s 2024-09-19T05:47:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011826 s, 88.7 MB/s 2024-09-19T05:47:20.488 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.488 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.488 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952647 s, 110 MB/s 2024-09-19T05:47:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096016 s, 109 MB/s 2024-09-19T05:47:20.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.513 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.513 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106486 s, 98.5 MB/s 2024-09-19T05:47:20.526 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.526 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.526 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104969 s, 99.9 MB/s 2024-09-19T05:47:20.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.542 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.542 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129143 s, 81.2 MB/s 2024-09-19T05:47:20.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.554 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.554 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095499 s, 110 MB/s 2024-09-19T05:47:20.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.567 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114235 s, 91.8 MB/s 2024-09-19T05:47:20.578 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.579 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.579 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878118 s, 119 MB/s 2024-09-19T05:47:20.592 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.592 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.592 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105785 s, 99.1 MB/s 2024-09-19T05:47:20.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.606 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113017 s, 92.8 MB/s 2024-09-19T05:47:20.620 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012605 s, 83.2 MB/s 2024-09-19T05:47:20.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.636 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.636 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128943 s, 81.3 MB/s 2024-09-19T05:47:20.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.649 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.650 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105348 s, 99.5 MB/s 2024-09-19T05:47:20.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.664 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.665 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121218 s, 86.5 MB/s 2024-09-19T05:47:20.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.680 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.681 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131198 s, 79.9 MB/s 2024-09-19T05:47:20.695 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.696 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.696 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120742 s, 86.8 MB/s 2024-09-19T05:47:20.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.711 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.711 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012454 s, 84.2 MB/s 2024-09-19T05:47:20.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.727 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127244 s, 82.4 MB/s 2024-09-19T05:47:20.741 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.742 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.742 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120035 s, 87.4 MB/s 2024-09-19T05:47:20.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:20.750 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:20.750 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:20.750 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.27 2024-09-19T05:47:20.750 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:20.750 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:20.750 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:20.750 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:20.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:20.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.821 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129442 s, 81.0 MB/s 2024-09-19T05:47:20.838 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.839 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.839 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126933 s, 82.6 MB/s 2024-09-19T05:47:20.855 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.855 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.855 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122299 s, 85.7 MB/s 2024-09-19T05:47:20.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.872 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.872 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013944 s, 75.2 MB/s 2024-09-19T05:47:20.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.887 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.887 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123727 s, 84.7 MB/s 2024-09-19T05:47:20.903 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.903 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.903 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125379 s, 83.6 MB/s 2024-09-19T05:47:20.917 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.917 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.918 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113678 s, 92.2 MB/s 2024-09-19T05:47:20.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.935 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.935 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140415 s, 74.7 MB/s 2024-09-19T05:47:20.950 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.950 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.950 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114934 s, 91.2 MB/s 2024-09-19T05:47:20.964 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.964 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.964 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104796 s, 100 MB/s 2024-09-19T05:47:20.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.979 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.980 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121744 s, 86.1 MB/s 2024-09-19T05:47:20.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:20.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:20.994 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111961 s, 93.7 MB/s 2024-09-19T05:47:21.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.008 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115898 s, 90.5 MB/s 2024-09-19T05:47:21.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.024 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01275 s, 82.2 MB/s 2024-09-19T05:47:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105457 s, 99.4 MB/s 2024-09-19T05:47:21.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.054 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.054 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133054 s, 78.8 MB/s 2024-09-19T05:47:21.069 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.070 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.070 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124799 s, 84.0 MB/s 2024-09-19T05:47:21.086 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.087 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.087 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124769 s, 84.0 MB/s 2024-09-19T05:47:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141636 s, 74.0 MB/s 2024-09-19T05:47:21.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.118 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.118 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122645 s, 85.5 MB/s 2024-09-19T05:47:21.134 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.134 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.134 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130189 s, 80.5 MB/s 2024-09-19T05:47:21.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.149 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.149 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115628 s, 90.7 MB/s 2024-09-19T05:47:21.166 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.166 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.166 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139885 s, 75.0 MB/s 2024-09-19T05:47:21.181 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.181 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.181 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011441 s, 91.7 MB/s 2024-09-19T05:47:21.198 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.199 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.199 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014292 s, 73.4 MB/s 2024-09-19T05:47:21.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.214 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.215 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125554 s, 83.5 MB/s 2024-09-19T05:47:21.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.231 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130029 s, 80.6 MB/s 2024-09-19T05:47:21.246 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.247 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.247 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124079 s, 84.5 MB/s 2024-09-19T05:47:21.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.266 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.266 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015643 s, 67.0 MB/s 2024-09-19T05:47:21.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.285 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.286 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136865 s, 76.6 MB/s 2024-09-19T05:47:21.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.311 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.312 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127858 s, 82.0 MB/s 2024-09-19T05:47:21.327 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.327 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.327 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117693 s, 89.1 MB/s 2024-09-19T05:47:21.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:21.335 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:21.335 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:21.336 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.28 2024-09-19T05:47:21.336 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:21.336 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:21.336 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:21.336 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:21.405 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.405 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.405 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136779 s, 76.7 MB/s 2024-09-19T05:47:21.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.419 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106853 s, 98.1 MB/s 2024-09-19T05:47:21.432 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.433 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.433 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102554 s, 102 MB/s 2024-09-19T05:47:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013594 s, 77.1 MB/s 2024-09-19T05:47:21.463 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.464 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010895 s, 96.2 MB/s 2024-09-19T05:47:21.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.479 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.479 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124245 s, 84.4 MB/s 2024-09-19T05:47:21.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.495 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.496 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130415 s, 80.4 MB/s 2024-09-19T05:47:21.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.509 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.509 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105905 s, 99.0 MB/s 2024-09-19T05:47:21.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.523 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.523 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110353 s, 95.0 MB/s 2024-09-19T05:47:21.537 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.537 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.537 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110669 s, 94.7 MB/s 2024-09-19T05:47:21.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.551 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113306 s, 92.5 MB/s 2024-09-19T05:47:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130512 s, 80.3 MB/s 2024-09-19T05:47:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012386 s, 84.7 MB/s 2024-09-19T05:47:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.596 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105508 s, 99.4 MB/s 2024-09-19T05:47:21.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.608 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.608 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104252 s, 101 MB/s 2024-09-19T05:47:21.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.621 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.621 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107066 s, 97.9 MB/s 2024-09-19T05:47:21.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.634 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961756 s, 109 MB/s 2024-09-19T05:47:21.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.647 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.647 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112904 s, 92.9 MB/s 2024-09-19T05:47:21.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.662 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.662 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124458 s, 84.3 MB/s 2024-09-19T05:47:21.675 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.676 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.676 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112797 s, 93.0 MB/s 2024-09-19T05:47:21.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.686 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816098 s, 128 MB/s 2024-09-19T05:47:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825322 s, 127 MB/s 2024-09-19T05:47:21.710 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.710 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.710 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103115 s, 102 MB/s 2024-09-19T05:47:21.723 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.723 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.723 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103969 s, 101 MB/s 2024-09-19T05:47:21.733 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.734 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795204 s, 132 MB/s 2024-09-19T05:47:21.747 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.747 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.747 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106757 s, 98.2 MB/s 2024-09-19T05:47:21.759 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010424 s, 101 MB/s 2024-09-19T05:47:21.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.770 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.770 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826014 s, 127 MB/s 2024-09-19T05:47:21.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.785 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.785 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120459 s, 87.0 MB/s 2024-09-19T05:47:21.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.800 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.800 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124498 s, 84.2 MB/s 2024-09-19T05:47:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.814 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108238 s, 96.9 MB/s 2024-09-19T05:47:21.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.827 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.827 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113912 s, 92.1 MB/s 2024-09-19T05:47:21.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:21.835 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:21.835 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:21.835 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.29 2024-09-19T05:47:21.835 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:21.836 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:21.836 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:21.836 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116012 s, 90.4 MB/s 2024-09-19T05:47:21.910 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.910 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.910 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011832 s, 88.6 MB/s 2024-09-19T05:47:21.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.925 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125169 s, 83.8 MB/s 2024-09-19T05:47:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128935 s, 81.3 MB/s 2024-09-19T05:47:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104098 s, 101 MB/s 2024-09-19T05:47:21.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.969 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.969 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110156 s, 95.2 MB/s 2024-09-19T05:47:21.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:21.984 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:21.984 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113434 s, 92.4 MB/s 2024-09-19T05:47:22.000 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.001 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.001 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138676 s, 75.6 MB/s 2024-09-19T05:47:22.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.017 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.017 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134867 s, 77.7 MB/s 2024-09-19T05:47:22.032 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.032 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.032 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120662 s, 86.9 MB/s 2024-09-19T05:47:22.048 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.048 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.048 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128555 s, 81.6 MB/s 2024-09-19T05:47:22.063 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.063 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.063 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119072 s, 88.1 MB/s 2024-09-19T05:47:22.075 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.075 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.075 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858826 s, 122 MB/s 2024-09-19T05:47:22.087 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.087 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.087 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886018 s, 118 MB/s 2024-09-19T05:47:22.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.098 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.098 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883275 s, 119 MB/s 2024-09-19T05:47:22.113 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.114 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.114 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120033 s, 87.4 MB/s 2024-09-19T05:47:22.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.127 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.127 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103277 s, 102 MB/s 2024-09-19T05:47:22.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.142 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.142 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117881 s, 89.0 MB/s 2024-09-19T05:47:22.158 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.158 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.158 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127463 s, 82.3 MB/s 2024-09-19T05:47:22.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.174 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133794 s, 78.4 MB/s 2024-09-19T05:47:22.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.189 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122689 s, 85.5 MB/s 2024-09-19T05:47:22.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.207 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.207 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143758 s, 72.9 MB/s 2024-09-19T05:47:22.223 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.224 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.224 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131787 s, 79.6 MB/s 2024-09-19T05:47:22.240 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.240 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.241 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125709 s, 83.4 MB/s 2024-09-19T05:47:22.260 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.260 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.260 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140794 s, 74.5 MB/s 2024-09-19T05:47:22.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.278 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137576 s, 76.2 MB/s 2024-09-19T05:47:22.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.316 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.316 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127626 s, 82.2 MB/s 2024-09-19T05:47:22.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.334 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.334 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147934 s, 70.9 MB/s 2024-09-19T05:47:22.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.352 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.352 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136858 s, 76.6 MB/s 2024-09-19T05:47:22.370 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.370 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.370 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143583 s, 73.0 MB/s 2024-09-19T05:47:22.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.390 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148514 s, 70.6 MB/s 2024-09-19T05:47:22.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.409 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.409 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152791 s, 68.6 MB/s 2024-09-19T05:47:22.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:22.419 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:22.419 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:22.419 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.30 2024-09-19T05:47:22.419 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:22.419 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:22.419 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:22.419 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:22.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:22.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.536 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.536 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125179 s, 83.8 MB/s 2024-09-19T05:47:22.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.551 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.551 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123603 s, 84.8 MB/s 2024-09-19T05:47:22.569 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.569 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.569 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139194 s, 75.3 MB/s 2024-09-19T05:47:22.586 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.586 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.586 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131852 s, 79.5 MB/s 2024-09-19T05:47:22.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.605 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.605 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137479 s, 76.3 MB/s 2024-09-19T05:47:22.622 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.622 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.622 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015437 s, 67.9 MB/s 2024-09-19T05:47:22.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.638 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.638 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128619 s, 81.5 MB/s 2024-09-19T05:47:22.652 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.653 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.653 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115582 s, 90.7 MB/s 2024-09-19T05:47:22.669 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.669 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.669 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012204 s, 85.9 MB/s 2024-09-19T05:47:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013707 s, 76.5 MB/s 2024-09-19T05:47:22.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.702 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.702 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127747 s, 82.1 MB/s 2024-09-19T05:47:22.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.718 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.718 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133489 s, 78.6 MB/s 2024-09-19T05:47:22.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.734 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.734 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124368 s, 84.3 MB/s 2024-09-19T05:47:22.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.751 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.751 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131991 s, 79.4 MB/s 2024-09-19T05:47:22.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.765 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.765 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107636 s, 97.4 MB/s 2024-09-19T05:47:22.782 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.782 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.782 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138055 s, 76.0 MB/s 2024-09-19T05:47:22.798 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.799 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.799 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129896 s, 80.7 MB/s 2024-09-19T05:47:22.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.815 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.815 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012329 s, 85.0 MB/s 2024-09-19T05:47:22.830 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.830 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.830 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124136 s, 84.5 MB/s 2024-09-19T05:47:22.845 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.845 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.845 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116503 s, 90.0 MB/s 2024-09-19T05:47:22.860 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.860 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.860 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121899 s, 86.0 MB/s 2024-09-19T05:47:22.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.877 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.877 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138795 s, 75.5 MB/s 2024-09-19T05:47:22.894 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.894 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.895 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138345 s, 75.8 MB/s 2024-09-19T05:47:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01256 s, 83.5 MB/s 2024-09-19T05:47:22.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.925 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.925 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012013 s, 87.3 MB/s 2024-09-19T05:47:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134043 s, 78.2 MB/s 2024-09-19T05:47:22.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.957 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.957 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115228 s, 91.0 MB/s 2024-09-19T05:47:22.976 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.977 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162258 s, 64.6 MB/s 2024-09-19T05:47:22.993 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:22.994 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:22.994 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137848 s, 76.1 MB/s 2024-09-19T05:47:23.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.008 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.008 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114326 s, 91.7 MB/s 2024-09-19T05:47:23.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.024 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.024 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125993 s, 83.2 MB/s 2024-09-19T05:47:23.041 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.042 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.042 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142267 s, 73.7 MB/s 2024-09-19T05:47:23.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:23.051 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-19T05:47:23.051 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:23.051 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p scrub_control_test_path/dir.31 2024-09-19T05:47:23.051 DEBUG:teuthology.orchestra.run.smithi067:> for ((i = 0; i < 32; i++)); do 2024-09-19T05:47:23.051 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-19T05:47:23.051 DEBUG:teuthology.orchestra.run.smithi067:> done 2024-09-19T05:47:23.051 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:23.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:47:23.117 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.117 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.118 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113485 s, 92.4 MB/s 2024-09-19T05:47:23.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.133 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.133 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130503 s, 80.3 MB/s 2024-09-19T05:47:23.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.146 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.146 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991751 s, 106 MB/s 2024-09-19T05:47:23.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.160 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011155 s, 94.0 MB/s 2024-09-19T05:47:23.173 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.173 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.173 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104211 s, 101 MB/s 2024-09-19T05:47:23.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.188 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.188 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123068 s, 85.2 MB/s 2024-09-19T05:47:23.202 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.203 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.203 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011775 s, 89.1 MB/s 2024-09-19T05:47:23.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.217 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.217 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107393 s, 97.6 MB/s 2024-09-19T05:47:23.231 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.232 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.232 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122573 s, 85.5 MB/s 2024-09-19T05:47:23.244 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.245 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.245 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103036 s, 102 MB/s 2024-09-19T05:47:23.259 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.259 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.259 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116397 s, 90.1 MB/s 2024-09-19T05:47:23.275 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.275 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.275 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127626 s, 82.2 MB/s 2024-09-19T05:47:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126349 s, 83.0 MB/s 2024-09-19T05:47:23.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.313 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.313 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124522 s, 84.2 MB/s 2024-09-19T05:47:23.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.328 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124884 s, 84.0 MB/s 2024-09-19T05:47:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109241 s, 96.0 MB/s 2024-09-19T05:47:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117042 s, 89.6 MB/s 2024-09-19T05:47:23.372 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.372 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.372 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125574 s, 83.5 MB/s 2024-09-19T05:47:23.388 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.389 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.389 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132099 s, 79.4 MB/s 2024-09-19T05:47:23.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.404 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.404 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113457 s, 92.4 MB/s 2024-09-19T05:47:23.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.421 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.421 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137424 s, 76.3 MB/s 2024-09-19T05:47:23.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.435 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.435 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104791 s, 100 MB/s 2024-09-19T05:47:23.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.449 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.449 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104762 s, 100 MB/s 2024-09-19T05:47:23.463 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.464 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.464 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119778 s, 87.5 MB/s 2024-09-19T05:47:23.478 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.478 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.478 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011284 s, 92.9 MB/s 2024-09-19T05:47:23.491 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.492 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.492 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102172 s, 103 MB/s 2024-09-19T05:47:23.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.507 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.507 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123669 s, 84.8 MB/s 2024-09-19T05:47:23.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.522 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.522 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011838 s, 88.6 MB/s 2024-09-19T05:47:23.540 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.541 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.541 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147641 s, 71.0 MB/s 2024-09-19T05:47:23.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.555 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.555 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115966 s, 90.4 MB/s 2024-09-19T05:47:23.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.572 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.573 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139441 s, 75.2 MB/s 2024-09-19T05:47:23.587 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-19T05:47:23.588 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-19T05:47:23.588 INFO:teuthology.orchestra.run.smithi067.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123241 s, 85.1 MB/s 2024-09-19T05:47:23.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:23.596 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-09-19T05:47:23.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f9116c33640 1 Processor -- start 2024-09-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f9116c33640 1 -- start start 2024-09-19T05:47:23.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f9116c33640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f91100af3a0 0x7f911015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f9116c33640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91100ad840 con 0x7f9110159c60 2024-09-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f9116c33640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f911015a040 con 0x7f911006ffd0 2024-09-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f9116c33640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f911015d460 con 0x7f91100af3a0 2024-09-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91149cf640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9110159c60 0x7f91100ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:39266/0 (socket says 172.21.15.67:39266) 2024-09-19T05:47:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91149cf640 1 -- 172.21.15.67:0/200409186 learned_addr learned my addr 172.21.15.67:0/200409186 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:23.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91151d0640 1 --2- 172.21.15.67:0/200409186 >> v2:172.21.15.97:3300/0 conn(0x7f91100af3a0 0x7f911015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247532111 0 0) 0x7f91100ad840 con 0x7f9110159c60 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90f8003530 con 0x7f9110159c60 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2639738450 0 0) 0x7f90f8003530 con 0x7f9110159c60 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 >> v2:172.21.15.97:3300/0 conn(0x7f91100af3a0 msgr2=0x7f911015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 --2- 172.21.15.67:0/200409186 >> v2:172.21.15.97:3300/0 conn(0x7f91100af3a0 0x7f911015fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 >> v1:172.21.15.97:6789/0 conn(0x7f911006ffd0 legacy=0x7f91100aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911015c850 con 0x7f9110159c60 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f910c001680 con 0x7f9110159c60 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 >> v1:172.21.15.67:6789/0 conn(0x7f9110159c60 legacy=0x7f91100ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f80039c0 0x7f90f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90f8004810 0x7f90f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90f80051d0 0x7f90f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f911015d460 con 0x7f90f80039c0 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f90f800c070 con 0x7f90f80051d0 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f90f800c270 con 0x7f90f8004810 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91149cf640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f80039c0 0x7f90f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91151d0640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90f80051d0 0x7f90f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f9107fff640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90f8004810 0x7f90f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91149cf640 1 -- 172.21.15.67:0/200409186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90f8004810 msgr2=0x7f90f8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91149cf640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90f8004810 0x7f90f8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91149cf640 1 -- 172.21.15.67:0/200409186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90f80051d0 msgr2=0x7f90f800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91149cf640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90f80051d0 0x7f90f800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91149cf640 1 -- 172.21.15.67:0/200409186 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f8003530 con 0x7f90f80039c0 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91151d0640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90f80051d0 0x7f90f800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.735+0000 7f91151d0640 1 -- 172.21.15.67:0/200409186 reap_dead start 2024-09-19T05:47:23.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f91149cf640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f80039c0 0x7f90f8003de0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f910c00c240 tx=0x7f910c01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a146d333dc8f1a01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c007d20 con 0x7f90f80039c0 2024-09-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f910c0a9070 con 0x7f90f80039c0 2024-09-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f91077fe640 1 -- 172.21.15.67:0/200409186 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c005da0 con 0x7f90f80039c0 2024-09-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 -- 172.21.15.67:0/200409186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f80039c0 msgr2=0x7f90f8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f80039c0 0x7f90f8003de0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f910c00c240 tx=0x7f910c01cc10 comp rx=0 tx=0).stop 2024-09-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 -- 172.21.15.67:0/200409186 shutdown_connections 2024-09-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 --2- 172.21.15.67:0/200409186 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f80039c0 0x7f90f8003de0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 -- 172.21.15.67:0/200409186 >> 172.21.15.67:0/200409186 conn(0x7f91100b1e50 msgr2=0x7f91100b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 -- 172.21.15.67:0/200409186 shutdown_connections 2024-09-19T05:47:23.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 -- 172.21.15.67:0/200409186 wait complete. 2024-09-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 Processor -- start 2024-09-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 -- start start 2024-09-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90f80039c0 0x7f911014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f911014c7a0 0x7f91101e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91101e94b0 0x7f91101e9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:23.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f91100ad130 con 0x7f91101e94b0 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f911015d0f0 con 0x7f911014c7a0 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f9116c33640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f91100ad2b0 con 0x7f90f80039c0 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f91151d0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91101e94b0 0x7f91101e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f91151d0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91101e94b0 0x7f91101e9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49242/0 (socket says 172.21.15.67:49242) 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.739+0000 7f91151d0640 1 -- 172.21.15.67:0/481668800 learned_addr learned my addr 172.21.15.67:0/481668800 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f9107fff640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f911014c7a0 0x7f91101e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91149cf640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90f80039c0 0x7f911014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91151d0640 1 -- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90f80039c0 msgr2=0x7f911014bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91151d0640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90f80039c0 0x7f911014bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91151d0640 1 -- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f911014c7a0 msgr2=0x7f91101e7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91151d0640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f911014c7a0 0x7f91101e7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91151d0640 1 -- 172.21.15.67:0/481668800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91101e8410 con 0x7f91101e94b0 2024-09-19T05:47:23.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91151d0640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91101e94b0 0x7f91101e9930 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f911015d3d0 tx=0x7f910800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91057fa640 1 -- 172.21.15.67:0/481668800 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108016420 con 0x7f91101e94b0 2024-09-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91057fa640 1 -- 172.21.15.67:0/481668800 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f910801b070 con 0x7f91101e94b0 2024-09-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f9116c33640 1 -- 172.21.15.67:0/481668800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91101e86f0 con 0x7f91101e94b0 2024-09-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91057fa640 1 -- 172.21.15.67:0/481668800 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91080167c0 con 0x7f91101e94b0 2024-09-19T05:47:23.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f9116c33640 1 -- 172.21.15.67:0/481668800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91101e8cb0 con 0x7f91101e94b0 2024-09-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f9116c33640 1 -- 172.21.15.67:0/481668800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91100ad640 con 0x7f91101e94b0 2024-09-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91057fa640 1 -- 172.21.15.67:0/481668800 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9108016960 con 0x7f91101e94b0 2024-09-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91057fa640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90fc0678f0 0x7f90fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91057fa640 1 -- 172.21.15.67:0/481668800 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f9108086b60 con 0x7f91101e94b0 2024-09-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91149cf640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90fc0678f0 0x7f90fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:23.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.743+0000 7f91149cf640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90fc0678f0 0x7f90fc069db0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f910c0ab000 tx=0x7f910c0b1040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:23.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.747+0000 7f91057fa640 1 -- 172.21.15.67:0/481668800 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9108057470 con 0x7f91101e94b0 2024-09-19T05:47:23.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:23.951+0000 7f9116c33640 1 -- 172.21.15.67:0/481668800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f91100b0120 con 0x7f91101e94b0 2024-09-19T05:47:24.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.483+0000 7f91057fa640 1 -- 172.21.15.67:0/481668800 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v129) ==== 105+0+0 (secure 0 0 0) 0x7f9108056d70 con 0x7f91101e94b0 2024-09-19T05:47:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 -- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90fc0678f0 msgr2=0x7f90fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90fc0678f0 0x7f90fc069db0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f910c0ab000 tx=0x7f910c0b1040 comp rx=0 tx=0).stop 2024-09-19T05:47:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 -- 172.21.15.67:0/481668800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91101e94b0 msgr2=0x7f91101e9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91101e94b0 0x7f91101e9930 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f911015d3d0 tx=0x7f910800f520 comp rx=0 tx=0).stop 2024-09-19T05:47:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 -- 172.21.15.67:0/481668800 shutdown_connections 2024-09-19T05:47:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91101e94b0 0x7f91101e9930 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f911014c7a0 0x7f91101e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f90fc0678f0 0x7f90fc069db0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 --2- 172.21.15.67:0/481668800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90f80039c0 0x7f911014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 -- 172.21.15.67:0/481668800 >> 172.21.15.67:0/481668800 conn(0x7f91100b1e50 msgr2=0x7f911006dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 -- 172.21.15.67:0/481668800 shutdown_connections 2024-09-19T05:47:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.487+0000 7f9116c33640 1 -- 172.21.15.67:0/481668800 wait complete. 2024-09-19T05:47:24.504 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-19T05:47:24.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f98828d3640 1 Processor -- start 2024-09-19T05:47:24.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f98828d3640 1 -- start start 2024-09-19T05:47:24.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f98828d3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f987c15b1d0 0x7f987c0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:24.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f98828d3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f987c06dfc0 0x7f987c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:24.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f98828d3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f987c06fea0 0x7f987c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:24.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f98828d3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f987c072210 con 0x7f987c06fea0 2024-09-19T05:47:24.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f98828d3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f987c0aef30 con 0x7f987c15b1d0 2024-09-19T05:47:24.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f98828d3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f987c0ae0f0 con 0x7f987c06dfc0 2024-09-19T05:47:24.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f9880e70640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f987c06fea0 0x7f987c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:24.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f9880e70640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f987c06fea0 0x7f987c15ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49258/0 (socket says 172.21.15.67:49258) 2024-09-19T05:47:24.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f9880e70640 1 -- 172.21.15.67:0/3390419969 learned_addr learned my addr 172.21.15.67:0/3390419969 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:24.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f987bfff640 1 --2- 172.21.15.67:0/3390419969 >> v2:172.21.15.97:3300/0 conn(0x7f987c15b1d0 0x7f987c0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:24.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f987b7fe640 1 --2- 172.21.15.67:0/3390419969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f987c06dfc0 0x7f987c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:24.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f9880e70640 1 -- 172.21.15.67:0/3390419969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f987c06dfc0 msgr2=0x7f987c06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:24.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f9880e70640 1 --2- 172.21.15.67:0/3390419969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f987c06dfc0 0x7f987c06f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f9880e70640 1 -- 172.21.15.67:0/3390419969 >> v2:172.21.15.97:3300/0 conn(0x7f987c15b1d0 msgr2=0x7f987c0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:24.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f9880e70640 1 --2- 172.21.15.67:0/3390419969 >> v2:172.21.15.97:3300/0 conn(0x7f987c15b1d0 0x7f987c0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f9880e70640 1 -- 172.21.15.67:0/3390419969 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c0ae3b0 con 0x7f987c06fea0 2024-09-19T05:47:24.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.639+0000 7f9880e70640 1 --2- 172.21.15.67:0/3390419969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c06fea0 0x7f987c15ec80 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f987c0711d0 tx=0x7f986c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff564faaf9dbf1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:24.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f987affd640 1 -- 172.21.15.67:0/3390419969 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c0b0070 con 0x7f987c06fea0 2024-09-19T05:47:24.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f987affd640 1 -- 172.21.15.67:0/3390419969 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986c0ab600 con 0x7f987c06fea0 2024-09-19T05:47:24.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f987affd640 1 -- 172.21.15.67:0/3390419969 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c0ab9d0 con 0x7f987c06fea0 2024-09-19T05:47:24.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 -- 172.21.15.67:0/3390419969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c06fea0 msgr2=0x7f987c15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:24.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 --2- 172.21.15.67:0/3390419969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c06fea0 0x7f987c15ec80 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f987c0711d0 tx=0x7f986c01c260 comp rx=0 tx=0).stop 2024-09-19T05:47:24.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 -- 172.21.15.67:0/3390419969 shutdown_connections 2024-09-19T05:47:24.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 --2- 172.21.15.67:0/3390419969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c06fea0 0x7f987c15ec80 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 --2- 172.21.15.67:0/3390419969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f987c06dfc0 0x7f987c06f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 --2- 172.21.15.67:0/3390419969 >> v2:172.21.15.97:3300/0 conn(0x7f987c15b1d0 0x7f987c0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 -- 172.21.15.67:0/3390419969 >> 172.21.15.67:0/3390419969 conn(0x7f987c0b1e50 msgr2=0x7f987c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:24.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 -- 172.21.15.67:0/3390419969 shutdown_connections 2024-09-19T05:47:24.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 -- 172.21.15.67:0/3390419969 wait complete. 2024-09-19T05:47:24.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 Processor -- start 2024-09-19T05:47:24.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 -- start start 2024-09-19T05:47:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f987c06dfc0 0x7f987c14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f987c06fea0 0x7f987c14e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c15b1d0 0x7f987c0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f987c06e850 con 0x7f987c15b1d0 2024-09-19T05:47:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f987c072420 con 0x7f987c06fea0 2024-09-19T05:47:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f98828d3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f987c06e9d0 con 0x7f987c06dfc0 2024-09-19T05:47:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f9880e70640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c15b1d0 0x7f987c0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f9880e70640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c15b1d0 0x7f987c0b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49262/0 (socket says 172.21.15.67:49262) 2024-09-19T05:47:24.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f9880e70640 1 -- 172.21.15.67:0/1567757927 learned_addr learned my addr 172.21.15.67:0/1567757927 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.643+0000 7f987b7fe640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f987c06fea0 0x7f987c14e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f987bfff640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f987c06dfc0 0x7f987c14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9880e70640 1 -- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f987c06dfc0 msgr2=0x7f987c14e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9880e70640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f987c06dfc0 0x7f987c14e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9880e70640 1 -- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f987c06fea0 msgr2=0x7f987c14e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9880e70640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f987c06fea0 0x7f987c14e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9880e70640 1 -- 172.21.15.67:0/1567757927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c14efb0 con 0x7f987c15b1d0 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9880e70640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c15b1d0 0x7f987c0b3430 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f986c01a910 tx=0x7f986c01aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9878ff9640 1 -- 172.21.15.67:0/1567757927 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c0b0040 con 0x7f987c15b1d0 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9878ff9640 1 -- 172.21.15.67:0/1567757927 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986c0bc070 con 0x7f987c15b1d0 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f98828d3640 1 -- 172.21.15.67:0/1567757927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987c14f290 con 0x7f987c15b1d0 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9878ff9640 1 -- 172.21.15.67:0/1567757927 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c0b6660 con 0x7f987c15b1d0 2024-09-19T05:47:24.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f98828d3640 1 -- 172.21.15.67:0/1567757927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987c14f850 con 0x7f987c15b1d0 2024-09-19T05:47:24.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f98828d3640 1 -- 172.21.15.67:0/1567757927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f987c09a770 con 0x7f987c15b1d0 2024-09-19T05:47:24.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9878ff9640 1 -- 172.21.15.67:0/1567757927 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f986c0b6800 con 0x7f987c15b1d0 2024-09-19T05:47:24.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9878ff9640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98680678f0 0x7f9868069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:24.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f9878ff9640 1 -- 172.21.15.67:0/1567757927 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f986c1201c0 con 0x7f987c15b1d0 2024-09-19T05:47:24.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f987bfff640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98680678f0 0x7f9868069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:24.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.647+0000 7f987bfff640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98680678f0 0x7f9868069db0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f987400b930 tx=0x7f9874008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:24.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.651+0000 7f9878ff9640 1 -- 172.21.15.67:0/1567757927 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f986c016110 con 0x7f987c15b1d0 2024-09-19T05:47:24.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:24.851+0000 7f98828d3640 1 -- 172.21.15.67:0/1567757927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f987c06f980 con 0x7f987c15b1d0 2024-09-19T05:47:25.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.219+0000 7f9878ff9640 1 -- 172.21.15.67:0/1567757927 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v130) ==== 121+0+0 (secure 0 0 0) 0x7f986c0f0b50 con 0x7f987c15b1d0 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 -- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98680678f0 msgr2=0x7f9868069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98680678f0 0x7f9868069db0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f987400b930 tx=0x7f9874008040 comp rx=0 tx=0).stop 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 -- 172.21.15.67:0/1567757927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c15b1d0 msgr2=0x7f987c0b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c15b1d0 0x7f987c0b3430 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f986c01a910 tx=0x7f986c01aaa0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 -- 172.21.15.67:0/1567757927 shutdown_connections 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987c15b1d0 0x7f987c0b3430 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f987c06fea0 0x7f987c14e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98680678f0 0x7f9868069db0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 --2- 172.21.15.67:0/1567757927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f987c06dfc0 0x7f987c14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 -- 172.21.15.67:0/1567757927 >> 172.21.15.67:0/1567757927 conn(0x7f987c0b1e50 msgr2=0x7f987c153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:25.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 -- 172.21.15.67:0/1567757927 shutdown_connections 2024-09-19T05:47:25.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.223+0000 7f98828d3640 1 -- 172.21.15.67:0/1567757927 wait complete. 2024-09-19T05:47:25.248 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:47:25.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb8733640 1 Processor -- start 2024-09-19T05:47:25.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb8733640 1 -- start start 2024-09-19T05:47:25.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb8733640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7cb015e640 0x7f7cb00b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb8733640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7cb00ae0a0 0x7f7cb00b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb8733640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cb00b2430 0x7f7cb006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb8733640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7cb00b4780 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb8733640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7cb00b5b90 con 0x7f7cb015e640 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb8733640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb00ae510 con 0x7f7cb00b2430 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb5cce640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7cb00ae0a0 0x7f7cb00b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb5cce640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7cb00ae0a0 0x7f7cb00b6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49272/0 (socket says 172.21.15.67:49272) 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb5cce640 1 -- 172.21.15.67:0/2884572976 learned_addr learned my addr 172.21.15.67:0/2884572976 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb6cd0640 1 --2- 172.21.15.67:0/2884572976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cb00b2430 0x7f7cb006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb64cf640 1 --2- 172.21.15.67:0/2884572976 >> v2:172.21.15.97:3300/0 conn(0x7f7cb015e640 0x7f7cb00b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:25.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb5cce640 1 -- 172.21.15.67:0/2884572976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cb00b2430 msgr2=0x7f7cb006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:25.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb5cce640 1 --2- 172.21.15.67:0/2884572976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cb00b2430 0x7f7cb006bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb5cce640 1 -- 172.21.15.67:0/2884572976 >> v2:172.21.15.97:3300/0 conn(0x7f7cb015e640 msgr2=0x7f7cb00b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:25.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb5cce640 1 --2- 172.21.15.67:0/2884572976 >> v2:172.21.15.97:3300/0 conn(0x7f7cb015e640 0x7f7cb00b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.371+0000 7f7cb5cce640 1 -- 172.21.15.67:0/2884572976 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb00b15f0 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb5cce640 1 --2- 172.21.15.67:0/2884572976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 0x7f7cb00b6cf0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00689b0 tx=0x7f7ca001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbea06845314ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:25.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb54cd640 1 -- 172.21.15.67:0/2884572976 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00b0070 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb54cd640 1 -- 172.21.15.67:0/2884572976 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca00a4e50 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb54cd640 1 -- 172.21.15.67:0/2884572976 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00ab820 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb8733640 1 -- 172.21.15.67:0/2884572976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 msgr2=0x7f7cb00b6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:25.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb8733640 1 --2- 172.21.15.67:0/2884572976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 0x7f7cb00b6cf0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00689b0 tx=0x7f7ca001c400 comp rx=0 tx=0).stop 2024-09-19T05:47:25.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb8733640 1 -- 172.21.15.67:0/2884572976 shutdown_connections 2024-09-19T05:47:25.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb8733640 1 --2- 172.21.15.67:0/2884572976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cb00b2430 0x7f7cb006bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb8733640 1 --2- 172.21.15.67:0/2884572976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 0x7f7cb00b6cf0 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb8733640 1 --2- 172.21.15.67:0/2884572976 >> v2:172.21.15.97:3300/0 conn(0x7f7cb015e640 0x7f7cb00b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb8733640 1 -- 172.21.15.67:0/2884572976 >> 172.21.15.67:0/2884572976 conn(0x7f7cb009aa30 msgr2=0x7f7cb00b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:25.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb8733640 1 -- 172.21.15.67:0/2884572976 shutdown_connections 2024-09-19T05:47:25.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.375+0000 7f7cb8733640 1 -- 172.21.15.67:0/2884572976 wait complete. 2024-09-19T05:47:25.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb8733640 1 Processor -- start 2024-09-19T05:47:25.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb8733640 1 -- start start 2024-09-19T05:47:25.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb8733640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 0x7f7cb01608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:25.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb8733640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cb00b2430 0x7f7cb01522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:25.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb8733640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cb015e640 0x7f7cb01517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:25.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb8733640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb00b0790 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb8733640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb006c610 con 0x7f7cb015e640 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb8733640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb00b0910 con 0x7f7cb00b2430 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb64cf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 0x7f7cb01608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb64cf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 0x7f7cb01608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49280/0 (socket says 172.21.15.67:49280) 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb64cf640 1 -- 172.21.15.67:0/2879165870 learned_addr learned my addr 172.21.15.67:0/2879165870 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb5cce640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cb00b2430 0x7f7cb01522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb6cd0640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cb015e640 0x7f7cb01517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb64cf640 1 -- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cb00b2430 msgr2=0x7f7cb01522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb64cf640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cb00b2430 0x7f7cb01522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb64cf640 1 -- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cb015e640 msgr2=0x7f7cb01517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb64cf640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cb015e640 0x7f7cb01517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb64cf640 1 -- 172.21.15.67:0/2879165870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb0160fe0 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb6cd0640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cb015e640 0x7f7cb01517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:25.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7cb64cf640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 0x7f7cb01608e0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00d800 tx=0x7f7cac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:25.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.379+0000 7f7ca6ffd640 1 -- 172.21.15.67:0/2879165870 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00b6c0 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.383+0000 7f7ca6ffd640 1 -- 172.21.15.67:0/2879165870 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cac019070 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.383+0000 7f7ca6ffd640 1 -- 172.21.15.67:0/2879165870 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00ba60 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.383+0000 7f7cb8733640 1 -- 172.21.15.67:0/2879165870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb01683f0 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.383+0000 7f7cb8733640 1 -- 172.21.15.67:0/2879165870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb01689b0 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.383+0000 7f7cb8733640 1 -- 172.21.15.67:0/2879165870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb0068e20 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.383+0000 7f7ca6ffd640 1 -- 172.21.15.67:0/2879165870 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7cac00bc00 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.383+0000 7f7ca6ffd640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c940678c0 0x7f7c94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:25.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.383+0000 7f7ca6ffd640 1 -- 172.21.15.67:0/2879165870 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f7cac086290 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.383+0000 7f7cb5cce640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c940678c0 0x7f7c94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:25.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.387+0000 7f7cb5cce640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c940678c0 0x7f7c94069d80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00ad000 tx=0x7f7ca0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:25.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.387+0000 7f7ca6ffd640 1 -- 172.21.15.67:0/2879165870 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7cac056c40 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.603+0000 7f7cb8733640 1 -- 172.21.15.67:0/2879165870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cb00b41e0 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7ca6ffd640 1 -- 172.21.15.67:0/2879165870 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5243 (secure 0 0 0) 0x7f7cac056540 con 0x7f7cb00ae0a0 2024-09-19T05:47:25.604 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:25.604 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":130,"btime":"2024-09-19T05:47:25:220670+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6974,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2737632366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737632366},{"type":"v1","addr":"172.21.15.97:6835","nonce":2737632366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3498582105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3498582105},{"type":"v1","addr":"172.21.15.97:6837","nonce":3498582105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":130,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:46:55.745812+0000","modified":"2024-09-19T05:47:25.220626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10026":{"gid":10026,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/558917076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":558917076},{"type":"v1","addr":"172.21.15.67:6833","nonce":558917076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10032":{"gid":10032,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2190010946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2190010946},{"type":"v1","addr":"172.21.15.67:6835","nonce":2190010946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10032,"qdb_cluster":[10032]},"id":12}]} 2024-09-19T05:47:25.604 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 130 2024-09-19T05:47:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 -- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c940678c0 msgr2=0x7f7c94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c940678c0 0x7f7c94069d80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00ad000 tx=0x7f7ca0008040 comp rx=0 tx=0).stop 2024-09-19T05:47:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 -- 172.21.15.67:0/2879165870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 msgr2=0x7f7cb01608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 0x7f7cb01608e0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00d800 tx=0x7f7cac00dcc0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 -- 172.21.15.67:0/2879165870 shutdown_connections 2024-09-19T05:47:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cb015e640 0x7f7cb01517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7c940678c0 0x7f7c94069d80 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cb00b2430 0x7f7cb01522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 --2- 172.21.15.67:0/2879165870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cb00ae0a0 0x7f7cb01608e0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:25.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 -- 172.21.15.67:0/2879165870 >> 172.21.15.67:0/2879165870 conn(0x7f7cb009aa30 msgr2=0x7f7cb00b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:25.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 -- 172.21.15.67:0/2879165870 shutdown_connections 2024-09-19T05:47:25.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:25.607+0000 7f7cb8733640 1 -- 172.21.15.67:0/2879165870 wait complete. 2024-09-19T05:47:26.025 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 130, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T05:46:55.745812+0000', 'modified': '2024-09-19T05:47:25.220626+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10032}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10026': {'gid': 10026, 'name': 'a', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.67:6833/558917076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 558917076}, {'type': 'v1', 'addr': '172.21.15.67:6833', 'nonce': 558917076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_10032': {'gid': 10032, 'name': 'c', 'rank': 0, 'incarnation': 124, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/2190010946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 2190010946}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 2190010946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10032, 'qdb_cluster': [10032]} 2024-09-19T05:47:26.025 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:47:26.026 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:47:26.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.159+0000 7f72f9d63640 1 Processor -- start 2024-09-19T05:47:26.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.159+0000 7f72f9d63640 1 -- start start 2024-09-19T05:47:26.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f415c030 0x7f72f406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72f406f460 0x7f72f406f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f406e3c0 con 0x7f72f415d1d0 2024-09-19T05:47:26.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f72f406e6a0 con 0x7f72f406f460 2024-09-19T05:47:26.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f72f406e980 con 0x7f72f415c030 2024-09-19T05:47:26.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72f406f460 0x7f72f406f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72f406f460 0x7f72f406f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54262/0 (socket says 172.21.15.67:54262) 2024-09-19T05:47:26.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f3fff640 1 -- 172.21.15.67:0/4223297702 learned_addr learned my addr 172.21.15.67:0/4223297702 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f37fe640 1 --2- 172.21.15.67:0/4223297702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f415c030 0x7f72f406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f3fff640 1 -- 172.21.15.67:0/4223297702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f415c030 msgr2=0x7f72f406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f3fff640 1 --2- 172.21.15.67:0/4223297702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f415c030 0x7f72f406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f3fff640 1 -- 172.21.15.67:0/4223297702 >> v1:172.21.15.97:6789/0 conn(0x7f72f415d1d0 legacy=0x7f72f40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f3fff640 1 -- 172.21.15.67:0/4223297702 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f406ec60 con 0x7f72f406f460 2024-09-19T05:47:26.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f3fff640 1 --2- 172.21.15.67:0/4223297702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f406f460 0x7f72f406f8d0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009e50 tx=0x7f72ec01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cecec0a1945f9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f27fc640 1 -- 172.21.15.67:0/4223297702 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0a5860 con 0x7f72f406f460 2024-09-19T05:47:26.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f27fc640 1 -- 172.21.15.67:0/4223297702 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ec0a5a00 con 0x7f72f406f460 2024-09-19T05:47:26.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f27fc640 1 -- 172.21.15.67:0/4223297702 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0a5dd0 con 0x7f72f406f460 2024-09-19T05:47:26.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 -- 172.21.15.67:0/4223297702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f406f460 msgr2=0x7f72f406f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 --2- 172.21.15.67:0/4223297702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f406f460 0x7f72f406f8d0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009e50 tx=0x7f72ec01c9c0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 -- 172.21.15.67:0/4223297702 shutdown_connections 2024-09-19T05:47:26.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 --2- 172.21.15.67:0/4223297702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f406f460 0x7f72f406f8d0 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 --2- 172.21.15.67:0/4223297702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f415c030 0x7f72f406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 -- 172.21.15.67:0/4223297702 >> 172.21.15.67:0/4223297702 conn(0x7f72f40d0080 msgr2=0x7f72f40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 -- 172.21.15.67:0/4223297702 shutdown_connections 2024-09-19T05:47:26.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.163+0000 7f72f9d63640 1 -- 172.21.15.67:0/4223297702 wait complete. 2024-09-19T05:47:26.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f9d63640 1 Processor -- start 2024-09-19T05:47:26.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f9d63640 1 -- start start 2024-09-19T05:47:26.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f9d63640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f406f460 0x7f72f41546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f9d63640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f415c030 0x7f72f4158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f9d63640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72f415d1d0 0x7f72f41517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f9d63640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f72f415c590 con 0x7f72f415c030 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f9d63640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f72f415c410 con 0x7f72f415d1d0 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f9d63640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f72f41690e0 con 0x7f72f406f460 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f415c030 0x7f72f4158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f415c030 0x7f72f4158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54266/0 (socket says 172.21.15.67:54266) 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f2ffd640 1 -- 172.21.15.67:0/1767018561 learned_addr learned my addr 172.21.15.67:0/1767018561 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f3fff640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72f415d1d0 0x7f72f41517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f406f460 0x7f72f41546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f2ffd640 1 -- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f406f460 msgr2=0x7f72f41546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f406f460 0x7f72f41546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f2ffd640 1 -- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72f415d1d0 msgr2=0x7f72f41517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72f415d1d0 0x7f72f41517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f2ffd640 1 -- 172.21.15.67:0/1767018561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f41555f0 con 0x7f72f415c030 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f3fff640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72f415d1d0 0x7f72f41517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f406f460 0x7f72f41546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f415c030 0x7f72f4158180 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f72e400b3e0 tx=0x7f72e400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72dbfff640 1 -- 172.21.15.67:0/1767018561 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4015020 con 0x7f72f415c030 2024-09-19T05:47:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72dbfff640 1 -- 172.21.15.67:0/1767018561 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e4011830 con 0x7f72f415c030 2024-09-19T05:47:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f9d63640 1 -- 172.21.15.67:0/1767018561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f41558d0 con 0x7f72f415c030 2024-09-19T05:47:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72dbfff640 1 -- 172.21.15.67:0/1767018561 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4011c60 con 0x7f72f415c030 2024-09-19T05:47:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.167+0000 7f72f9d63640 1 -- 172.21.15.67:0/1767018561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f4157c60 con 0x7f72f415c030 2024-09-19T05:47:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72dbfff640 1 -- 172.21.15.67:0/1767018561 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72e4018020 con 0x7f72f415c030 2024-09-19T05:47:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72dbfff640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72e00678c0 0x7f72e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72dbfff640 1 -- 172.21.15.67:0/1767018561 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f72e4085aa0 con 0x7f72f415c030 2024-09-19T05:47:26.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72e00678c0 0x7f72e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 Processor -- start 2024-09-19T05:47:26.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 -- start start 2024-09-19T05:47:26.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72e00678c0 0x7f72e0069d80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f72f40cfc60 tx=0x7f72e8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c76150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c76690 0x55e9e4c2c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c2c6a0 0x55e9e4c2ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e9e4b0fb60 con 0x55e9e4c75d70 2024-09-19T05:47:26.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e9e4a76c70 con 0x55e9e4c2c6a0 2024-09-19T05:47:26.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55e9e4a1ced0 con 0x55e9e4c76690 2024-09-19T05:47:26.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c76150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c76150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54274/0 (socket says 172.21.15.67:54274) 2024-09-19T05:47:26.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 -- 172.21.15.67:0/1868939083 learned_addr learned my addr 172.21.15.67:0/1868939083 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/1868939083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c76690 0x55e9e4c2c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f3fff640 1 --2- 172.21.15.67:0/1868939083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c2c6a0 0x55e9e4c2ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 -- 172.21.15.67:0/1868939083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c76690 msgr2=0x55e9e4c2c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1868939083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c76690 0x55e9e4c2c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 -- 172.21.15.67:0/1868939083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c2c6a0 msgr2=0x55e9e4c2ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1868939083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c2c6a0 0x55e9e4c2ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 -- 172.21.15.67:0/1868939083 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e4a2ee50 con 0x55e9e4c75d70 2024-09-19T05:47:26.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f3fff640 1 --2- 172.21.15.67:0/1868939083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c2c6a0 0x55e9e4c2ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1868939083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c76150 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f72e8004350 tx=0x7f72e8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e460ecf9a10d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72d97fa640 1 -- 172.21.15.67:0/1868939083 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e800f040 con 0x55e9e4c75d70 2024-09-19T05:47:26.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72d97fa640 1 -- 172.21.15.67:0/1868939083 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8004380 con 0x55e9e4c75d70 2024-09-19T05:47:26.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72d97fa640 1 -- 172.21.15.67:0/1868939083 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e800ee80 con 0x55e9e4c75d70 2024-09-19T05:47:26.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 -- 172.21.15.67:0/1868939083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 msgr2=0x55e9e4c76150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 --2- 172.21.15.67:0/1868939083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c76150 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f72e8004350 tx=0x7f72e8011000 comp rx=0 tx=0).stop 2024-09-19T05:47:26.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 -- 172.21.15.67:0/1868939083 shutdown_connections 2024-09-19T05:47:26.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 --2- 172.21.15.67:0/1868939083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c2c6a0 0x55e9e4c2ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 --2- 172.21.15.67:0/1868939083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c76690 0x55e9e4c2c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 --2- 172.21.15.67:0/1868939083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c76150 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 -- 172.21.15.67:0/1868939083 >> 172.21.15.67:0/1868939083 conn(0x55e9e4c2e600 msgr2=0x55e9e4c26630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 -- 172.21.15.67:0/1868939083 shutdown_connections 2024-09-19T05:47:26.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.171+0000 7f72fce1f000 1 -- 172.21.15.67:0/1868939083 wait complete. 2024-09-19T05:47:26.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 -- start start 2024-09-19T05:47:26.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 Processor -- start 2024-09-19T05:47:26.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c75d70 0x55e9e4c7beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 0x55e9e4c7c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4c62870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e9e4ad8b00 con 0x55e9e4c62490 2024-09-19T05:47:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e9e4a51360 con 0x55e9e4c76690 2024-09-19T05:47:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55e9e4a4e2d0 con 0x55e9e4c75d70 2024-09-19T05:47:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 10 client.0 _ll_register_callbacks cb 0x55e9e4c13820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4c62870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4c62870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54280/0 (socket says 172.21.15.67:54280) 2024-09-19T05:47:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f3fff640 1 -- 172.21.15.67:0/1468594686 learned_addr learned my addr 172.21.15.67:0/1468594686 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 0x55e9e4c7c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c75d70 0x55e9e4c7beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f3fff640 1 -- 172.21.15.67:0/1468594686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c75d70 msgr2=0x55e9e4c7beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f3fff640 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c75d70 0x55e9e4c7beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f3fff640 1 -- 172.21.15.67:0/1468594686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 msgr2=0x55e9e4c7c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f3fff640 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 0x55e9e4c7c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f3fff640 1 -- 172.21.15.67:0/1468594686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e4a1d120 con 0x55e9e4c62490 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 0x55e9e4c7c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c75d70 0x55e9e4c7beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f3fff640 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4c62870 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0af040 tx=0x7f72ec01b200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d8869a7f7bc365 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:26.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72d27fc640 1 -- 172.21.15.67:0/1468594686 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0bd070 con 0x55e9e4c62490 2024-09-19T05:47:26.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72d27fc640 1 -- 172.21.15.67:0/1468594686 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f72ec0a5ae0 con 0x55e9e4c62490 2024-09-19T05:47:26.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 -- 172.21.15.67:0/1468594686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72e8004380 con 0x55e9e4c62490 2024-09-19T05:47:26.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72d27fc640 1 -- 172.21.15.67:0/1468594686 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f72ec0a5ce0 con 0x55e9e4c62490 2024-09-19T05:47:26.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 10 client.10215 fetch_fsmap learned FSMap version 130 2024-09-19T05:47:26.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 -- 172.21.15.67:0/1468594686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55e9e4a16450 con 0x55e9e4c62490 2024-09-19T05:47:26.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72d27fc640 1 -- 172.21.15.67:0/1468594686 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8004380 con 0x55e9e4c62490 2024-09-19T05:47:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72d27fc640 1 -- 172.21.15.67:0/1468594686 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 130) ==== 3490+0+0 (secure 0 0 0) 0x7f72ec008040 con 0x55e9e4c62490 2024-09-19T05:47:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 10 client.10215 fetch_fsmap finished waiting for FSMap version 130 2024-09-19T05:47:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 10 client.10215 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:47:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 20 client.10215 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x55e9e4c63280 0x55e9e4c63660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 4 client.10215 mds_command: new command op to 10032 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:47:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 -- 172.21.15.67:0/1468594686 --> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9e4a10c00 con 0x55e9e4c63280 2024-09-19T05:47:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x55e9e4c63280 0x55e9e4c63660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72d27fc640 10 client.10215 ms_handle_connect on v2:172.21.15.67:6834/2190010946 2024-09-19T05:47:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72f37fe640 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x55e9e4c63280 0x55e9e4c63660 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0a33401b2cd2305 server_cookie=c16d45bad448300 in_seq=0 out_seq=0 2024-09-19T05:47:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72d27fc640 1 -- 172.21.15.67:0/1468594686 <== mds.0 v2:172.21.15.67:6834/2190010946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9e4a10c00 con 0x55e9e4c63280 2024-09-19T05:47:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72d27fc640 10 client.10215 handle_command_reply: tid=0 2024-09-19T05:47:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.175+0000 7f72fce1f000 1 client.10215 shutdown 2024-09-19T05:47:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 1 -- 172.21.15.67:0/1468594686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 msgr2=0x55e9e4c62870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4c62870 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0af040 tx=0x7f72ec01b200 comp rx=0 tx=0).stop 2024-09-19T05:47:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 1 -- 172.21.15.67:0/1468594686 shutdown_connections 2024-09-19T05:47:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x55e9e4c63280 0x55e9e4c63660 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4c62870 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 0x55e9e4c7c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 1 --2- 172.21.15.67:0/1468594686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c75d70 0x55e9e4c7beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72d27fc640 0 client.10215 ms_handle_reset on v2:172.21.15.67:6834/2190010946 2024-09-19T05:47:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 1 -- 172.21.15.67:0/1468594686 >> 172.21.15.67:0/1468594686 conn(0x55e9e4c2c6a0 msgr2=0x55e9e4c2d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 1 -- 172.21.15.67:0/1468594686 shutdown_connections 2024-09-19T05:47:26.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 1 -- 172.21.15.67:0/1468594686 wait complete. 2024-09-19T05:47:26.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.179+0000 7f72fce1f000 20 client.10215 trim_cache size 0 max 16384 2024-09-19T05:47:26.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72fce1f000 1 Processor -- start 2024-09-19T05:47:26.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72fce1f000 1 -- start start 2024-09-19T05:47:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c62490 0x55e9e4c8c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c8c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 0x55e9e4c7aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72fce1f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f72f41ffc90 con 0x55e9e4c75d70 2024-09-19T05:47:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72fce1f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4156e90 con 0x55e9e4c76690 2024-09-19T05:47:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72fce1f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f72f40733a0 con 0x55e9e4c62490 2024-09-19T05:47:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72f2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c8c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72f2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c8c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54282/0 (socket says 172.21.15.67:54282) 2024-09-19T05:47:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72f2ffd640 1 -- 172.21.15.67:0/811175468 learned_addr learned my addr 172.21.15.67:0/811175468 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72f2ffd640 1 -- 172.21.15.67:0/811175468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c62490 msgr2=0x55e9e4c8c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72f3fff640 1 --2- 172.21.15.67:0/811175468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 0x55e9e4c7aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72f37fe640 1 --2- 172.21.15.67:0/811175468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c62490 0x55e9e4c8c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/811175468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c62490 0x55e9e4c8c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72f2ffd640 1 -- 172.21.15.67:0/811175468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 msgr2=0x55e9e4c7aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/811175468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 0x55e9e4c7aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.195+0000 7f72f2ffd640 1 -- 172.21.15.67:0/811175468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e49fdfd0 con 0x55e9e4c75d70 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/811175468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c8c7a0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f72e405e400 tx=0x7f72e4056580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966abfa41aeef8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72d8ff9640 1 -- 172.21.15.67:0/811175468 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4081020 con 0x55e9e4c75d70 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72d8ff9640 1 -- 172.21.15.67:0/811175468 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e4083f50 con 0x55e9e4c75d70 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72d8ff9640 1 -- 172.21.15.67:0/811175468 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4054050 con 0x55e9e4c75d70 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- 172.21.15.67:0/811175468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 msgr2=0x55e9e4c8c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 --2- 172.21.15.67:0/811175468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c8c7a0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f72e405e400 tx=0x7f72e4056580 comp rx=0 tx=0).stop 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- 172.21.15.67:0/811175468 shutdown_connections 2024-09-19T05:47:26.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 --2- 172.21.15.67:0/811175468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c76690 0x55e9e4c7aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 --2- 172.21.15.67:0/811175468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c75d70 0x55e9e4c8c7a0 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 --2- 172.21.15.67:0/811175468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c62490 0x55e9e4c8c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- 172.21.15.67:0/811175468 >> 172.21.15.67:0/811175468 conn(0x55e9e4c2c6a0 msgr2=0x55e9e4c26ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- 172.21.15.67:0/811175468 shutdown_connections 2024-09-19T05:47:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- 172.21.15.67:0/811175468 wait complete. 2024-09-19T05:47:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- start start 2024-09-19T05:47:26.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 Processor -- start 2024-09-19T05:47:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4ce9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c75d70 0x55e9e4cea190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c76690 0x55e9e4cea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e9e4a75f80 con 0x55e9e4c62490 2024-09-19T05:47:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e9e4a2eca0 con 0x55e9e4c75d70 2024-09-19T05:47:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55e9e4a7b2a0 con 0x55e9e4c76690 2024-09-19T05:47:26.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 10 client.0 _ll_register_callbacks cb 0x7f72f415d840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4ce9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4ce9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54298/0 (socket says 172.21.15.67:54298) 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f37fe640 1 -- 172.21.15.67:0/116820890 learned_addr learned my addr 172.21.15.67:0/116820890 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f37fe640 1 -- 172.21.15.67:0/116820890 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c76690 msgr2=0x55e9e4cea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f37fe640 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c76690 0x55e9e4cea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f37fe640 1 -- 172.21.15.67:0/116820890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c75d70 msgr2=0x55e9e4cea190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f37fe640 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c75d70 0x55e9e4cea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f37fe640 1 -- 172.21.15.67:0/116820890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e4af9750 con 0x55e9e4c62490 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f37fe640 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4ce9c50 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f72e80096b0 tx=0x7f72e8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5223325c40f33f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72d27fc640 1 -- 172.21.15.67:0/116820890 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8028040 con 0x55e9e4c62490 2024-09-19T05:47:26.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72d27fc640 1 -- 172.21.15.67:0/116820890 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f72e801e040 con 0x55e9e4c62490 2024-09-19T05:47:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- 172.21.15.67:0/116820890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72e4083f50 con 0x55e9e4c62490 2024-09-19T05:47:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72d27fc640 1 -- 172.21.15.67:0/116820890 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f72e8038050 con 0x55e9e4c62490 2024-09-19T05:47:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 10 client.10221 fetch_fsmap learned FSMap version 130 2024-09-19T05:47:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- 172.21.15.67:0/116820890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55e9e4a04a30 con 0x55e9e4c62490 2024-09-19T05:47:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72d27fc640 1 -- 172.21.15.67:0/116820890 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e4083f50 con 0x55e9e4c62490 2024-09-19T05:47:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72d27fc640 1 -- 172.21.15.67:0/116820890 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 130) ==== 3490+0+0 (secure 0 0 0) 0x7f72e803b020 con 0x55e9e4c62490 2024-09-19T05:47:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 10 client.10221 fetch_fsmap finished waiting for FSMap version 130 2024-09-19T05:47:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 10 client.10221 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:47:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 20 client.10221 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:26.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x55e9e4c82090 0x55e9e4c81030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 4 client.10221 mds_command: new command op to 10032 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:47:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72fce1f000 1 -- 172.21.15.67:0/116820890 --> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] -- command(tid 0: {"prefix": "status"}) -- 0x55e9e4a843a0 con 0x55e9e4c82090 2024-09-19T05:47:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x55e9e4c82090 0x55e9e4c81030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72f2ffd640 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x55e9e4c82090 0x55e9e4c81030 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ac013cd85a83efe server_cookie=6cee4a346cdc08a8 in_seq=0 out_seq=0 2024-09-19T05:47:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.199+0000 7f72d27fc640 10 client.10221 ms_handle_connect on v2:172.21.15.67:6834/2190010946 2024-09-19T05:47:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72d27fc640 1 -- 172.21.15.67:0/116820890 <== mds.0 v2:172.21.15.67:6834/2190010946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x55e9e4a843a0 con 0x55e9e4c82090 2024-09-19T05:47:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72d27fc640 10 client.10221 handle_command_reply: tid=0 2024-09-19T05:47:26.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 client.10221 shutdown 2024-09-19T05:47:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 -- 172.21.15.67:0/116820890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 msgr2=0x55e9e4ce9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4ce9c50 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f72e80096b0 tx=0x7f72e8004740 comp rx=0 tx=0).stop 2024-09-19T05:47:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 -- 172.21.15.67:0/116820890 shutdown_connections 2024-09-19T05:47:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.67:6834/2190010946,v1:172.21.15.67:6835/2190010946] conn(0x55e9e4c82090 0x55e9e4c81030 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e9e4c76690 0x55e9e4cea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e9e4c75d70 0x55e9e4cea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72d27fc640 0 client.10221 ms_handle_reset on v2:172.21.15.67:6834/2190010946 2024-09-19T05:47:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 --2- 172.21.15.67:0/116820890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9e4c62490 0x55e9e4ce9c50 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 -- 172.21.15.67:0/116820890 >> 172.21.15.67:0/116820890 conn(0x55e9e4c2c6a0 msgr2=0x55e9e4c8b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 -- 172.21.15.67:0/116820890 shutdown_connections 2024-09-19T05:47:26.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 1 -- 172.21.15.67:0/116820890 wait complete. 2024-09-19T05:47:26.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72fce1f000 20 client.10221 trim_cache size 0 max 16384 2024-09-19T05:47:26.207 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:47:26.207 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:47:26.207 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:47:26.208 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 10032, 2024-09-19T05:47:26.208 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:47:26.208 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:47:26.208 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:47:26.208 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 29.801723528, 2024-09-19T05:47:26.208 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 130, 2024-09-19T05:47:26.208 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 179, 2024-09-19T05:47:26.209 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 179, 2024-09-19T05:47:26.209 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 34.809997967999998 2024-09-19T05:47:26.209 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:47:26.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 -- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72e00678c0 msgr2=0x7f72e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72e00678c0 0x7f72e0069d80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f72f40cfc60 tx=0x7f72e8008040 comp rx=0 tx=0).stop 2024-09-19T05:47:26.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 -- 172.21.15.67:0/1767018561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f415c030 msgr2=0x7f72f4158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f415c030 0x7f72f4158180 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f72e400b3e0 tx=0x7f72e400b8a0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 -- 172.21.15.67:0/1767018561 shutdown_connections 2024-09-19T05:47:26.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72f415d1d0 0x7f72f41517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72f415c030 0x7f72f4158180 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72e00678c0 0x7f72e0069d80 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 --2- 172.21.15.67:0/1767018561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72f406f460 0x7f72f41546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 -- 172.21.15.67:0/1767018561 >> 172.21.15.67:0/1767018561 conn(0x7f72f40d0080 msgr2=0x7f72f415e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 -- 172.21.15.67:0/1767018561 shutdown_connections 2024-09-19T05:47:26.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.203+0000 7f72f9d63640 1 -- 172.21.15.67:0/1767018561 wait complete. 2024-09-19T05:47:26.216 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub start /scrub_control_test_path recursive 2024-09-19T05:47:26.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d91f87640 1 Processor -- start 2024-09-19T05:47:26.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d91f87640 1 -- start start 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d91f87640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7d8c15e6f0 0x7f7d8c0d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d91f87640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d8c0cfe30 0x7f7d8c0d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d91f87640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8c15ead0 con 0x7f7d8c0b5f70 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d91f87640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c0ceb40 con 0x7f7d8c15e6f0 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d91f87640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c0ced90 con 0x7f7d8c0cfe30 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d8b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7d8c15e6f0 0x7f7d8c0d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d8bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7d8c0b5f70 0x7f7d8c1621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45490/0 (socket says 172.21.15.67:45490) 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d8bfff640 1 -- 172.21.15.67:0/595161844 learned_addr learned my addr 172.21.15.67:0/595161844 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d8affd640 1 --2- 172.21.15.67:0/595161844 >> v2:172.21.15.97:3300/0 conn(0x7f7d8c0cfe30 0x7f7d8c0d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/595161844 >> v2:172.21.15.97:3300/0 conn(0x7f7d8c0cfe30 msgr2=0x7f7d8c0d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/595161844 >> v2:172.21.15.97:3300/0 conn(0x7f7d8c0cfe30 0x7f7d8c0d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/595161844 >> v1:172.21.15.67:6789/0 conn(0x7f7d8c0b5f70 legacy=0x7f7d8c1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d8a7fc640 1 -- 172.21.15.67:0/595161844 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561887148 0 0) 0x7f7d8c15ead0 con 0x7f7d8c0b5f70 2024-09-19T05:47:26.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.335+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/595161844 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c0cf070 con 0x7f7d8c15e6f0 2024-09-19T05:47:26.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/595161844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d8c15e6f0 0x7f7d8c0d3090 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0c7ff0 tx=0x7f7d7401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79ccb0c4f3de73d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d8a7fc640 1 -- 172.21.15.67:0/595161844 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740b2070 con 0x7f7d8c15e6f0 2024-09-19T05:47:26.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d8a7fc640 1 -- 172.21.15.67:0/595161844 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d740a57c0 con 0x7f7d8c15e6f0 2024-09-19T05:47:26.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d8a7fc640 1 -- 172.21.15.67:0/595161844 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740a5b90 con 0x7f7d8c15e6f0 2024-09-19T05:47:26.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d91f87640 1 -- 172.21.15.67:0/595161844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d8c15e6f0 msgr2=0x7f7d8c0d3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d91f87640 1 --2- 172.21.15.67:0/595161844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d8c15e6f0 0x7f7d8c0d3090 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0c7ff0 tx=0x7f7d7401c810 comp rx=0 tx=0).stop 2024-09-19T05:47:26.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d91f87640 1 -- 172.21.15.67:0/595161844 shutdown_connections 2024-09-19T05:47:26.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d91f87640 1 --2- 172.21.15.67:0/595161844 >> v2:172.21.15.97:3300/0 conn(0x7f7d8c0cfe30 0x7f7d8c0d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d91f87640 1 --2- 172.21.15.67:0/595161844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d8c15e6f0 0x7f7d8c0d3090 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d91f87640 1 -- 172.21.15.67:0/595161844 >> 172.21.15.67:0/595161844 conn(0x7f7d8c08bfc0 msgr2=0x7f7d8c0d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d91f87640 1 -- 172.21.15.67:0/595161844 shutdown_connections 2024-09-19T05:47:26.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.339+0000 7f7d91f87640 1 -- 172.21.15.67:0/595161844 wait complete. 2024-09-19T05:47:26.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d91f87640 1 Processor -- start 2024-09-19T05:47:26.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d91f87640 1 -- start start 2024-09-19T05:47:26.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d91f87640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0b5f70 0x7f7d8c0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d91f87640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d8c0cfe30 0x7f7d8c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d91f87640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d8c15e6f0 0x7f7d8c157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d91f87640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c16b500 con 0x7f7d8c0cfe30 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d91f87640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c0b67d0 con 0x7f7d8c15e6f0 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d91f87640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c16b680 con 0x7f7d8c0b5f70 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d8c0cfe30 0x7f7d8c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d8c0cfe30 0x7f7d8c0cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54320/0 (socket says 172.21.15.67:54320) 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8affd640 1 -- 172.21.15.67:0/2953816404 learned_addr learned my addr 172.21.15.67:0/2953816404 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0b5f70 0x7f7d8c0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8bfff640 1 --2- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d8c15e6f0 0x7f7d8c157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8affd640 1 -- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0b5f70 msgr2=0x7f7d8c0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8affd640 1 --2- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0b5f70 0x7f7d8c0cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8affd640 1 -- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d8c15e6f0 msgr2=0x7f7d8c157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8affd640 1 --2- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d8c15e6f0 0x7f7d8c157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8affd640 1 -- 172.21.15.67:0/2953816404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c0cc010 con 0x7f7d8c0cfe30 2024-09-19T05:47:26.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0b5f70 0x7f7d8c0cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8bfff640 1 --2- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d8c15e6f0 0x7f7d8c157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d8affd640 1 --2- 172.21.15.67:0/2953816404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d8c0cfe30 0x7f7d8c0cb5c0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00d830 tx=0x7f7d7c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d83fff640 1 -- 172.21.15.67:0/2953816404 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00b6c0 con 0x7f7d8c0cfe30 2024-09-19T05:47:26.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d83fff640 1 -- 172.21.15.67:0/2953816404 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c019070 con 0x7f7d8c0cfe30 2024-09-19T05:47:26.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d91f87640 1 -- 172.21.15.67:0/2953816404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c15c000 con 0x7f7d8c0cfe30 2024-09-19T05:47:26.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d83fff640 1 -- 172.21.15.67:0/2953816404 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00bac0 con 0x7f7d8c0cfe30 2024-09-19T05:47:26.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.343+0000 7f7d91f87640 1 -- 172.21.15.67:0/2953816404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c15a8d0 con 0x7f7d8c0cfe30 2024-09-19T05:47:26.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d83fff640 1 -- 172.21.15.67:0/2953816404 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d7c01e460 con 0x7f7d8c0cfe30 2024-09-19T05:47:26.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d83fff640 1 --2- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d6c0678c0 0x7f7d6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d83fff640 1 -- 172.21.15.67:0/2953816404 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f7d7c086530 con 0x7f7d8c0cfe30 2024-09-19T05:47:26.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d95043000 1 Processor -- start 2024-09-19T05:47:26.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d95043000 1 -- start start 2024-09-19T05:47:26.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d6c0678c0 0x7f7d6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d95043000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c797a0 0x564986c79b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d95043000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986c2d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d95043000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c2d5f0 0x564986c2d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d95043000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564986b16d30 con 0x564986c7a0c0 2024-09-19T05:47:26.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d95043000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564986a7cbd0 con 0x564986c2d5f0 2024-09-19T05:47:26.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d95043000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564986a222a0 con 0x564986c797a0 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986c2d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986c2d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54326/0 (socket says 172.21.15.67:54326) 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8affd640 1 -- 172.21.15.67:0/20815729 learned_addr learned my addr 172.21.15.67:0/20815729 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/2953816404 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7d6c0678c0 0x7f7d6c069d80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7d740af000 tx=0x7f7d740a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/20815729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c797a0 0x564986c79b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8bfff640 1 --2- 172.21.15.67:0/20815729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c2d5f0 0x564986c2d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8affd640 1 -- 172.21.15.67:0/20815729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c797a0 msgr2=0x564986c79b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8affd640 1 --2- 172.21.15.67:0/20815729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c797a0 0x564986c79b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8affd640 1 -- 172.21.15.67:0/20815729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c2d5f0 msgr2=0x564986c2d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8affd640 1 --2- 172.21.15.67:0/20815729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c2d5f0 0x564986c2d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8affd640 1 -- 172.21.15.67:0/20815729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564986a4f9f0 con 0x564986c7a0c0 2024-09-19T05:47:26.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d8affd640 1 --2- 172.21.15.67:0/20815729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986c2d0b0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c007fd0 tx=0x7f7d7c0561d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e83afa154f11c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d817fa640 1 -- 172.21.15.67:0/20815729 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c05ac20 con 0x564986c7a0c0 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d817fa640 1 -- 172.21.15.67:0/20815729 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c05f450 con 0x564986c7a0c0 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.347+0000 7f7d817fa640 1 -- 172.21.15.67:0/20815729 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c054b70 con 0x564986c7a0c0 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- 172.21.15.67:0/20815729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 msgr2=0x564986c2d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 --2- 172.21.15.67:0/20815729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986c2d0b0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c007fd0 tx=0x7f7d7c0561d0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- 172.21.15.67:0/20815729 shutdown_connections 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 --2- 172.21.15.67:0/20815729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c2d5f0 0x564986c2d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 --2- 172.21.15.67:0/20815729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986c2d0b0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 --2- 172.21.15.67:0/20815729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c797a0 0x564986c79b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- 172.21.15.67:0/20815729 >> 172.21.15.67:0/20815729 conn(0x564986c5aa40 msgr2=0x564986c5ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- 172.21.15.67:0/20815729 shutdown_connections 2024-09-19T05:47:26.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- 172.21.15.67:0/20815729 wait complete. 2024-09-19T05:47:26.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- start start 2024-09-19T05:47:26.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 Processor -- start 2024-09-19T05:47:26.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986c5a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 0x564986c34db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c7a0c0 0x564986c352f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564986a78b90 con 0x564986c2d5f0 2024-09-19T05:47:26.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564986a44490 con 0x564986c797a0 2024-09-19T05:47:26.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564986a33810 con 0x564986c7a0c0 2024-09-19T05:47:26.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 10 client.0 _ll_register_callbacks cb 0x564986c1ad40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:26.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986c5a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986c5a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54336/0 (socket says 172.21.15.67:54336) 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/228445028 learned_addr learned my addr 172.21.15.67:0/228445028 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8bfff640 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c7a0c0 0x564986c352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8affd640 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 0x564986c34db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/228445028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c7a0c0 msgr2=0x564986c352f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c7a0c0 0x564986c352f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/228445028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 msgr2=0x564986c34db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 0x564986c34db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/228445028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564986a224d0 con 0x564986c2d5f0 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8affd640 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 0x564986c34db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986c5a270 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f7d7401a440 tx=0x7f7d7401b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be788226b9855ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:26.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/228445028 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740b2040 con 0x564986c2d5f0 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/228445028 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f7d740a5dc0 con 0x564986c2d5f0 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- 172.21.15.67:0/228445028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d7c05f450 con 0x564986c2d5f0 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/228445028 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f7d740039a0 con 0x564986c2d5f0 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 10 client.10236 fetch_fsmap learned FSMap version 130 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- 172.21.15.67:0/228445028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x564986a1c500 con 0x564986c2d5f0 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/228445028 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c05f450 con 0x564986c2d5f0 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/228445028 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 130) ==== 3490+0+0 (secure 0 0 0) 0x7f7d74003b40 con 0x564986c2d5f0 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 10 client.10236 fetch_fsmap finished waiting for FSMap version 130 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 10 client.10236 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 20 client.10236 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564986c5b650 0x564986c8a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 4 client.10236 mds_command: new command op to 10026 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d95043000 1 -- 172.21.15.67:0/228445028 --> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564986a16b20 con 0x564986c5b650 2024-09-19T05:47:26.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8affd640 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564986c5b650 0x564986c8a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d6a7fc640 10 client.10236 ms_handle_connect on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.351+0000 7f7d8affd640 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564986c5b650 0x564986c8a840 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10026 client_cookie=87f0118924608395 server_cookie=e8f39753fcdd7b5e in_seq=0 out_seq=0 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/228445028 <== mds.10026 v2:172.21.15.67:6832/558917076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7d7c07be80 con 0x564986c5b650 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d6a7fc640 10 client.10236 handle_command_reply: tid=0 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 client.10236 shutdown 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 -- 172.21.15.67:0/228445028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 msgr2=0x564986c5a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986c5a270 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f7d7401a440 tx=0x7f7d7401b050 comp rx=0 tx=0).stop 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 -- 172.21.15.67:0/228445028 shutdown_connections 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564986c5b650 0x564986c8a840 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c7a0c0 0x564986c352f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 0x564986c34db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d6a7fc640 0 client.10236 ms_handle_reset on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 --2- 172.21.15.67:0/228445028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986c5a270 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 -- 172.21.15.67:0/228445028 >> 172.21.15.67:0/228445028 conn(0x564986c5aa40 msgr2=0x564986c2c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 -- 172.21.15.67:0/228445028 shutdown_connections 2024-09-19T05:47:26.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 1 -- 172.21.15.67:0/228445028 wait complete. 2024-09-19T05:47:26.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.355+0000 7f7d95043000 20 client.10236 trim_cache size 0 max 16384 2024-09-19T05:47:26.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 Processor -- start 2024-09-19T05:47:26.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 -- start start 2024-09-19T05:47:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986ce9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c797a0 0x564986ce98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c7a0c0 0x564986ce9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c204050 con 0x564986c2d5f0 2024-09-19T05:47:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c15d680 con 0x564986c7a0c0 2024-09-19T05:47:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c15dcd0 con 0x564986c797a0 2024-09-19T05:47:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986ce9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986ce9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54348/0 (socket says 172.21.15.67:54348) 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/398026413 learned_addr learned my addr 172.21.15.67:0/398026413 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/398026413 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c797a0 msgr2=0x564986ce98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/398026413 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c797a0 0x564986ce98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/398026413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c7a0c0 msgr2=0x564986ce9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/398026413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c7a0c0 0x564986ce9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d8b7fe640 1 -- 172.21.15.67:0/398026413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564986c2ccf0 con 0x564986c2d5f0 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/398026413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986ce9360 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f7d74004a90 tx=0x7f7d740c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b03e54d6d83add server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d80ff9640 1 -- 172.21.15.67:0/398026413 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740da070 con 0x564986c2d5f0 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d80ff9640 1 -- 172.21.15.67:0/398026413 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d74003b40 con 0x564986c2d5f0 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d80ff9640 1 -- 172.21.15.67:0/398026413 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740b2040 con 0x564986c2d5f0 2024-09-19T05:47:26.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 -- 172.21.15.67:0/398026413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 msgr2=0x564986ce9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 --2- 172.21.15.67:0/398026413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986ce9360 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f7d74004a90 tx=0x7f7d740c1000 comp rx=0 tx=0).stop 2024-09-19T05:47:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 -- 172.21.15.67:0/398026413 shutdown_connections 2024-09-19T05:47:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 --2- 172.21.15.67:0/398026413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c7a0c0 0x564986ce9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 --2- 172.21.15.67:0/398026413 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c797a0 0x564986ce98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 --2- 172.21.15.67:0/398026413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c2d5f0 0x564986ce9360 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 -- 172.21.15.67:0/398026413 >> 172.21.15.67:0/398026413 conn(0x564986c5aa40 msgr2=0x564986c78e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 -- 172.21.15.67:0/398026413 shutdown_connections 2024-09-19T05:47:26.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.371+0000 7f7d95043000 1 -- 172.21.15.67:0/398026413 wait complete. 2024-09-19T05:47:26.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- start start 2024-09-19T05:47:26.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 Processor -- start 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c2d5f0 0x564986cecda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 0x564986ced2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986ced820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564986b3a850 con 0x564986c7a0c0 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564986a332b0 con 0x564986c797a0 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564986a23d80 con 0x564986c2d5f0 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 10 client.0 _ll_register_callbacks cb 0x7f7d740b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986ced820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986ced820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54354/0 (socket says 172.21.15.67:54354) 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8bfff640 1 -- 172.21.15.67:0/1032821826 learned_addr learned my addr 172.21.15.67:0/1032821826 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8bfff640 1 -- 172.21.15.67:0/1032821826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c2d5f0 msgr2=0x564986cecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8bfff640 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c2d5f0 0x564986cecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8bfff640 1 -- 172.21.15.67:0/1032821826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 msgr2=0x564986ced2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8affd640 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 0x564986ced2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8bfff640 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 0x564986ced2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8bfff640 1 -- 172.21.15.67:0/1032821826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564986a3a5f0 con 0x564986c7a0c0 2024-09-19T05:47:26.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8bfff640 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986ced820 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f7d84001d90 tx=0x7f7d84001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71db4f98a321c89d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:26.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/1032821826 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d840070d0 con 0x564986c7a0c0 2024-09-19T05:47:26.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/1032821826 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f7d84007270 con 0x564986c7a0c0 2024-09-19T05:47:26.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- 172.21.15.67:0/1032821826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d74003b40 con 0x564986c7a0c0 2024-09-19T05:47:26.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/1032821826 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f7d84007470 con 0x564986c7a0c0 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 10 client.10242 fetch_fsmap learned FSMap version 130 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- 172.21.15.67:0/1032821826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x564986a87e10 con 0x564986c7a0c0 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/1032821826 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d74003b40 con 0x564986c7a0c0 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/1032821826 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 130) ==== 3490+0+0 (secure 0 0 0) 0x7f7d840047f0 con 0x564986c7a0c0 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 10 client.10242 fetch_fsmap finished waiting for FSMap version 130 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 10 client.10242 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 20 client.10242 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564986ca9640 0x564986ca86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 4 client.10242 mds_command: new command op to 10026 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- 172.21.15.67:0/1032821826 --> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x564986a8a300 con 0x564986ca9640 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564986ca9640 0x564986ca86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d6a7fc640 10 client.10242 ms_handle_connect on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d8b7fe640 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564986ca9640 0x564986ca86f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10026 client_cookie=d70d8a0c1791788c server_cookie=67213991501188f1 in_seq=0 out_seq=0 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d6a7fc640 1 -- 172.21.15.67:0/1032821826 <== mds.10026 v2:172.21.15.67:6832/558917076 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x564986a8a300 con 0x564986ca9640 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d6a7fc640 10 client.10242 handle_command_reply: tid=0 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 client.10242 shutdown 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- 172.21.15.67:0/1032821826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 msgr2=0x564986ced820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986ced820 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f7d84001d90 tx=0x7f7d84001e80 comp rx=0 tx=0).stop 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- 172.21.15.67:0/1032821826 shutdown_connections 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564986ca9640 0x564986ca86f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564986c7a0c0 0x564986ced820 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564986c797a0 0x564986ced2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d6a7fc640 0 client.10242 ms_handle_reset on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 --2- 172.21.15.67:0/1032821826 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564986c2d5f0 0x564986cecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- 172.21.15.67:0/1032821826 >> 172.21.15.67:0/1032821826 conn(0x564986c5aa40 msgr2=0x564986c8a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- 172.21.15.67:0/1032821826 shutdown_connections 2024-09-19T05:47:26.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 1 -- 172.21.15.67:0/1032821826 wait complete. 2024-09-19T05:47:26.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.375+0000 7f7d95043000 20 client.10242 trim_cache size 0 max 16384 2024-09-19T05:47:26.381 INFO:teuthology.orchestra.run.smithi067.stderr:Error EINVAL: MDS is not active 2024-09-19T05:47:26.381 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-19T05:47:26.382 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub pause 2024-09-19T05:47:26.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aacbd0640 1 Processor -- start 2024-09-19T05:47:26.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aacbd0640 1 -- start start 2024-09-19T05:47:26.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aacbd0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7aa815f950 0x7f7aa80ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aacbd0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7aa80d0de0 0x7f7aa80b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aacbd0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa80cea90 con 0x7f7aa80b3750 2024-09-19T05:47:26.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aacbd0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa80af1a0 con 0x7f7aa815f950 2024-09-19T05:47:26.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aacbd0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa80ce110 con 0x7f7aa80d0de0 2024-09-19T05:47:26.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aa659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7aa815f950 0x7f7aa80ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aa659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7aa815f950 0x7f7aa80ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54366/0 (socket says 172.21.15.67:54366) 2024-09-19T05:47:26.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aa659c640 1 -- 172.21.15.67:0/1802082601 learned_addr learned my addr 172.21.15.67:0/1802082601 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aa5d9b640 1 --1- 172.21.15.67:0/1802082601 >> v1:172.21.15.67:6789/0 conn(0x7f7aa80b3750 0x7f7aa80d06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45506/0 (socket says 172.21.15.67:45506) 2024-09-19T05:47:26.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aa659c640 1 -- 172.21.15.67:0/1802082601 >> v2:172.21.15.97:3300/0 conn(0x7f7aa80d0de0 msgr2=0x7f7aa80b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aa659c640 1 --2- 172.21.15.67:0/1802082601 >> v2:172.21.15.97:3300/0 conn(0x7f7aa80d0de0 0x7f7aa80b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aa659c640 1 -- 172.21.15.67:0/1802082601 >> v1:172.21.15.67:6789/0 conn(0x7f7aa80b3750 legacy=0x7f7aa80d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aa659c640 1 -- 172.21.15.67:0/1802082601 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa80cd7e0 con 0x7f7aa815f950 2024-09-19T05:47:26.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.535+0000 7f7aa559a640 1 -- 172.21.15.67:0/1802082601 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972665550 0 0) 0x7f7aa80cea90 con 0x7f7aa80b3750 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa659c640 1 --2- 172.21.15.67:0/1802082601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa815f950 0x7f7aa80ce4b0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80cfe00 tx=0x7f7aa001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b71f4cf9f394d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa559a640 1 -- 172.21.15.67:0/1802082601 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00aa650 con 0x7f7aa815f950 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa559a640 1 -- 172.21.15.67:0/1802082601 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa00af070 con 0x7f7aa815f950 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa559a640 1 -- 172.21.15.67:0/1802082601 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00aaa10 con 0x7f7aa815f950 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 -- 172.21.15.67:0/1802082601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa815f950 msgr2=0x7f7aa80ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 --2- 172.21.15.67:0/1802082601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa815f950 0x7f7aa80ce4b0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80cfe00 tx=0x7f7aa001c4f0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 -- 172.21.15.67:0/1802082601 shutdown_connections 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 --2- 172.21.15.67:0/1802082601 >> v2:172.21.15.97:3300/0 conn(0x7f7aa80d0de0 0x7f7aa80b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 --2- 172.21.15.67:0/1802082601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa815f950 0x7f7aa80ce4b0 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 -- 172.21.15.67:0/1802082601 >> 172.21.15.67:0/1802082601 conn(0x7f7aa80d22f0 msgr2=0x7f7aa80d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 -- 172.21.15.67:0/1802082601 shutdown_connections 2024-09-19T05:47:26.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 -- 172.21.15.67:0/1802082601 wait complete. 2024-09-19T05:47:26.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 Processor -- start 2024-09-19T05:47:26.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 -- start start 2024-09-19T05:47:26.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa80b3750 0x7f7aa80b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa80d0de0 0x7f7aa8155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa815f950 0x7f7aa81565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa815feb0 con 0x7f7aa80b3750 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa815fd30 con 0x7f7aa815f950 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aacbd0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa80b2b90 con 0x7f7aa80d0de0 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa80b3750 0x7f7aa80b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa80b3750 0x7f7aa80b7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54376/0 (socket says 172.21.15.67:54376) 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa659c640 1 -- 172.21.15.67:0/4148504322 learned_addr learned my addr 172.21.15.67:0/4148504322 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa6d9d640 1 --2- 172.21.15.67:0/4148504322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa815f950 0x7f7aa81565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa659c640 1 -- 172.21.15.67:0/4148504322 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa80d0de0 msgr2=0x7f7aa8155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa659c640 1 --2- 172.21.15.67:0/4148504322 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7aa80d0de0 0x7f7aa8155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa659c640 1 -- 172.21.15.67:0/4148504322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa815f950 msgr2=0x7f7aa81565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa659c640 1 --2- 172.21.15.67:0/4148504322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa815f950 0x7f7aa81565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa659c640 1 -- 172.21.15.67:0/4148504322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa8158630 con 0x7f7aa80b3750 2024-09-19T05:47:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.539+0000 7f7aa659c640 1 --2- 172.21.15.67:0/4148504322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7aa80b3750 0x7f7aa80b7f00 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00ac040 tx=0x7f7aa001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7a9effd640 1 -- 172.21.15.67:0/4148504322 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00b9070 con 0x7f7aa80b3750 2024-09-19T05:47:26.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7a9effd640 1 -- 172.21.15.67:0/4148504322 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa00a6040 con 0x7f7aa80b3750 2024-09-19T05:47:26.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aacbd0640 1 -- 172.21.15.67:0/4148504322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa8157e10 con 0x7f7aa80b3750 2024-09-19T05:47:26.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7a9effd640 1 -- 172.21.15.67:0/4148504322 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0004020 con 0x7f7aa80b3750 2024-09-19T05:47:26.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aacbd0640 1 -- 172.21.15.67:0/4148504322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa8158bb0 con 0x7f7aa80b3750 2024-09-19T05:47:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7a9effd640 1 -- 172.21.15.67:0/4148504322 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7aa00041c0 con 0x7f7aa80b3750 2024-09-19T05:47:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7a9effd640 1 --2- 172.21.15.67:0/4148504322 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7a9effd640 1 -- 172.21.15.67:0/4148504322 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f7aa011fe60 con 0x7f7aa80b3750 2024-09-19T05:47:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa5d9b640 1 --2- 172.21.15.67:0/4148504322 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aafc8c000 1 Processor -- start 2024-09-19T05:47:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aafc8c000 1 -- start start 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa5d9b640 1 --2- 172.21.15.67:0/4148504322 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7a880678c0 0x7f7a88069d80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7a900011f0 tx=0x7f7a90007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d351380 0x55fe4d351760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351ca0 0x55fe4d304ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d305420 0x55fe4d305800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fe4d10a5b0 con 0x55fe4d305420 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fe4d154bf0 con 0x55fe4d351ca0 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55fe4d10f900 con 0x55fe4d351380 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d305420 0x55fe4d305800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d305420 0x55fe4d305800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54384/0 (socket says 172.21.15.67:54384) 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa6d9d640 1 -- 172.21.15.67:0/3777958435 learned_addr learned my addr 172.21.15.67:0/3777958435 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa659c640 1 --2- 172.21.15.67:0/3777958435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d351380 0x55fe4d351760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa5d9b640 1 --2- 172.21.15.67:0/3777958435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351ca0 0x55fe4d304ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa6d9d640 1 -- 172.21.15.67:0/3777958435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d351380 msgr2=0x55fe4d351760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa6d9d640 1 --2- 172.21.15.67:0/3777958435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d351380 0x55fe4d351760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa6d9d640 1 -- 172.21.15.67:0/3777958435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351ca0 msgr2=0x55fe4d304ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa6d9d640 1 --2- 172.21.15.67:0/3777958435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351ca0 0x55fe4d304ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa6d9d640 1 -- 172.21.15.67:0/3777958435 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4d10e9d0 con 0x55fe4d305420 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.543+0000 7f7aa5d9b640 1 --2- 172.21.15.67:0/3777958435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351ca0 0x55fe4d304ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa6d9d640 1 --2- 172.21.15.67:0/3777958435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d305420 0x55fe4d305800 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f7a98007d60 tx=0x7f7a9800c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85b026f5c91939e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7a87fff640 1 -- 172.21.15.67:0/3777958435 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98015020 con 0x55fe4d305420 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7a87fff640 1 -- 172.21.15.67:0/3777958435 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a98011650 con 0x55fe4d305420 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7a87fff640 1 -- 172.21.15.67:0/3777958435 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98011a40 con 0x55fe4d305420 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3777958435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d305420 msgr2=0x55fe4d305800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/3777958435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d305420 0x55fe4d305800 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f7a98007d60 tx=0x7f7a9800c560 comp rx=0 tx=0).stop 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3777958435 shutdown_connections 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/3777958435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d305420 0x55fe4d305800 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/3777958435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351ca0 0x55fe4d304ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/3777958435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d351380 0x55fe4d351760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3777958435 >> 172.21.15.67:0/3777958435 conn(0x55fe4d2fef30 msgr2=0x55fe4d334410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3777958435 shutdown_connections 2024-09-19T05:47:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3777958435 wait complete. 2024-09-19T05:47:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- start start 2024-09-19T05:47:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 Processor -- start 2024-09-19T05:47:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d3580e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d358620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d351ca0 0x55fe4d358b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fe4d0ee190 con 0x55fe4d351ca0 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fe4d150bb0 con 0x55fe4d351380 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55fe4d118590 con 0x55fe4d305420 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 10 client.0 _ll_register_callbacks cb 0x55fe4d2f2910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d351ca0 0x55fe4d358b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d351ca0 0x55fe4d358b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54400/0 (socket says 172.21.15.67:54400) 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa6d9d640 1 -- 172.21.15.67:0/3210911558 learned_addr learned my addr 172.21.15.67:0/3210911558 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa5d9b640 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d358620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa659c640 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d3580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa6d9d640 1 -- 172.21.15.67:0/3210911558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 msgr2=0x55fe4d3580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa6d9d640 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d3580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa6d9d640 1 -- 172.21.15.67:0/3210911558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 msgr2=0x55fe4d358620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa6d9d640 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d358620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa6d9d640 1 -- 172.21.15.67:0/3210911558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4d111570 con 0x55fe4d351ca0 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa659c640 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d3580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa6d9d640 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d351ca0 0x55fe4d358b60 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800c5a0 tx=0x7f7a98004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a518eee77dd7be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7a857fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7a857fa640 1 -- 172.21.15.67:0/3210911558 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9802a060 con 0x55fe4d351ca0 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7a857fa640 1 -- 172.21.15.67:0/3210911558 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f7a98011430 con 0x55fe4d351ca0 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3210911558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a98011650 con 0x55fe4d351ca0 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7a857fa640 1 -- 172.21.15.67:0/3210911558 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f7a98030050 con 0x55fe4d351ca0 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 10 client.10257 fetch_fsmap learned FSMap version 130 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3210911558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55fe4d1153c0 con 0x55fe4d351ca0 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7a857fa640 1 -- 172.21.15.67:0/3210911558 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a98011650 con 0x55fe4d351ca0 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7a857fa640 1 -- 172.21.15.67:0/3210911558 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 130) ==== 3490+0+0 (secure 0 0 0) 0x7f7a98033020 con 0x55fe4d351ca0 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 10 client.10257 fetch_fsmap finished waiting for FSMap version 130 2024-09-19T05:47:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 10 client.10257 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 20 client.10257 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x55fe4d3604b0 0x55fe4d3628a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 4 client.10257 mds_command: new command op to 10026 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3210911558 --> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe4d1ed040 con 0x55fe4d3604b0 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.547+0000 7f7aa659c640 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x55fe4d3604b0 0x55fe4d3628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aa659c640 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x55fe4d3604b0 0x55fe4d3628a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10026 client_cookie=9e156996273af6b4 server_cookie=4364ffa02a0523d in_seq=0 out_seq=0 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7a857fa640 10 client.10257 ms_handle_connect on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7a857fa640 1 -- 172.21.15.67:0/3210911558 <== mds.10026 v2:172.21.15.67:6832/558917076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe4d1ed040 con 0x55fe4d3604b0 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7a857fa640 10 client.10257 handle_command_reply: tid=0 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 client.10257 shutdown 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3210911558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d351ca0 msgr2=0x55fe4d358b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d351ca0 0x55fe4d358b60 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800c5a0 tx=0x7f7a98004a50 comp rx=0 tx=0).stop 2024-09-19T05:47:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3210911558 shutdown_connections 2024-09-19T05:47:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x55fe4d3604b0 0x55fe4d3628a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d351ca0 0x55fe4d358b60 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d358620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/3210911558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d3580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3210911558 >> 172.21.15.67:0/3210911558 conn(0x55fe4d2fef30 msgr2=0x55fe4d3045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7a857fa640 0 client.10257 ms_handle_reset on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3210911558 shutdown_connections 2024-09-19T05:47:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 1 -- 172.21.15.67:0/3210911558 wait complete. 2024-09-19T05:47:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.551+0000 7f7aafc8c000 20 client.10257 trim_cache size 0 max 16384 2024-09-19T05:47:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aafc8c000 1 Processor -- start 2024-09-19T05:47:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aafc8c000 1 -- start start 2024-09-19T05:47:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d336610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d336b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d3628a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa82012a0 con 0x55fe4d2fef30 2024-09-19T05:47:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa8201970 con 0x55fe4d351380 2024-09-19T05:47:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa80b6d80 con 0x55fe4d305420 2024-09-19T05:47:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aa659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d336610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aa659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d336610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54406/0 (socket says 172.21.15.67:54406) 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aa659c640 1 -- 172.21.15.67:0/2218584406 learned_addr learned my addr 172.21.15.67:0/2218584406 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aa659c640 1 -- 172.21.15.67:0/2218584406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 msgr2=0x55fe4d336b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aa659c640 1 --2- 172.21.15.67:0/2218584406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d336b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aa659c640 1 -- 172.21.15.67:0/2218584406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 msgr2=0x55fe4d3628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aa659c640 1 --2- 172.21.15.67:0/2218584406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d3628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aa659c640 1 -- 172.21.15.67:0/2218584406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4d0f45c0 con 0x55fe4d2fef30 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7aa659c640 1 --2- 172.21.15.67:0/2218584406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d336610 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0006c90 tx=0x7f7aa00bf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e0ca9d28a99dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7a877fe640 1 -- 172.21.15.67:0/2218584406 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00f08a0 con 0x55fe4d2fef30 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7a877fe640 1 -- 172.21.15.67:0/2218584406 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa00af040 con 0x55fe4d2fef30 2024-09-19T05:47:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.567+0000 7f7a877fe640 1 -- 172.21.15.67:0/2218584406 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00f01a0 con 0x55fe4d2fef30 2024-09-19T05:47:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/2218584406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 msgr2=0x55fe4d336610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/2218584406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d336610 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0006c90 tx=0x7f7aa00bf040 comp rx=0 tx=0).stop 2024-09-19T05:47:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/2218584406 shutdown_connections 2024-09-19T05:47:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/2218584406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d3628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/2218584406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d336b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/2218584406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d336610 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/2218584406 >> 172.21.15.67:0/2218584406 conn(0x55fe4d30d1e0 msgr2=0x55fe4d335f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/2218584406 shutdown_connections 2024-09-19T05:47:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/2218584406 wait complete. 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- start start 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 Processor -- start 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d365870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d380b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d3810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fe4d1521a0 con 0x55fe4d2fef30 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa8200530 con 0x55fe4d351380 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55fe4d0f4b00 con 0x55fe4d305420 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 10 client.0 _ll_register_callbacks cb 0x7f7a98007b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d365870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d365870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54418/0 (socket says 172.21.15.67:54418) 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa659c640 1 -- 172.21.15.67:0/1242161617 learned_addr learned my addr 172.21.15.67:0/1242161617 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa5d9b640 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d380b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa6d9d640 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d3810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa659c640 1 -- 172.21.15.67:0/1242161617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 msgr2=0x55fe4d380b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa659c640 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d380b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa659c640 1 -- 172.21.15.67:0/1242161617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 msgr2=0x55fe4d3810d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa659c640 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d3810d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa659c640 1 -- 172.21.15.67:0/1242161617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4d1d6280 con 0x55fe4d2fef30 2024-09-19T05:47:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa6d9d640 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d3810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa659c640 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d365870 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0019100 tx=0x7f7aa0009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aad14dec7b78912 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7a857fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7a857fa640 1 -- 172.21.15.67:0/1242161617 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00f8d80 con 0x55fe4d2fef30 2024-09-19T05:47:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7a857fa640 1 -- 172.21.15.67:0/1242161617 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f7aa00ec810 con 0x55fe4d2fef30 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/1242161617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aa00af040 con 0x55fe4d2fef30 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7a857fa640 1 -- 172.21.15.67:0/1242161617 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f7aa011d050 con 0x55fe4d2fef30 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 10 client.10263 fetch_fsmap learned FSMap version 130 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/1242161617 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55fe4d1ad7d0 con 0x55fe4d2fef30 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7a857fa640 1 -- 172.21.15.67:0/1242161617 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa00af040 con 0x55fe4d2fef30 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7a857fa640 1 -- 172.21.15.67:0/1242161617 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 130) ==== 3490+0+0 (secure 0 0 0) 0x7f7aa00c5030 con 0x55fe4d2fef30 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 10 client.10263 fetch_fsmap finished waiting for FSMap version 130 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 10 client.10263 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 20 client.10263 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x55fe4d351ca0 0x55fe4d381610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 4 client.10263 mds_command: new command op to 10026 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/1242161617 --> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55fe4d0ee930 con 0x55fe4d351ca0 2024-09-19T05:47:26.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa5d9b640 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x55fe4d351ca0 0x55fe4d381610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7a857fa640 10 client.10263 ms_handle_connect on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aa5d9b640 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x55fe4d351ca0 0x55fe4d381610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10026 client_cookie=a55782e9134bc924 server_cookie=2f0660a75b4e5a74 in_seq=0 out_seq=0 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7a857fa640 1 -- 172.21.15.67:0/1242161617 <== mds.10026 v2:172.21.15.67:6832/558917076 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55fe4d0ee930 con 0x55fe4d351ca0 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7a857fa640 10 client.10263 handle_command_reply: tid=0 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 client.10263 shutdown 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/1242161617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 msgr2=0x55fe4d365870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d365870 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0019100 tx=0x7f7aa0009240 comp rx=0 tx=0).stop 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/1242161617 shutdown_connections 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x55fe4d351ca0 0x55fe4d381610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fe4d351380 0x55fe4d3810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55fe4d305420 0x55fe4d380b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 --2- 172.21.15.67:0/1242161617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fe4d2fef30 0x55fe4d365870 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7a857fa640 0 client.10263 ms_handle_reset on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/1242161617 >> 172.21.15.67:0/1242161617 conn(0x55fe4d30d1e0 msgr2=0x55fe4d336720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/1242161617 shutdown_connections 2024-09-19T05:47:26.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.571+0000 7f7aafc8c000 1 -- 172.21.15.67:0/1242161617 wait complete. 2024-09-19T05:47:26.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.575+0000 7f7aafc8c000 20 client.10263 trim_cache size 0 max 16384 2024-09-19T05:47:26.578 INFO:teuthology.orchestra.run.smithi067.stderr:Error EINVAL: MDS is not active 2024-09-19T05:47:26.578 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-19T05:47:26.579 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub abort 2024-09-19T05:47:26.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa19d49b640 1 Processor -- start 2024-09-19T05:47:26.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa19d49b640 1 -- start start 2024-09-19T05:47:26.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa19d49b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19815b1d0 0x7fa1980adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa19d49b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa19806dfc0 0x7fa19806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa19d49b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa19806fea0 0x7fa19815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa19d49b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa198072210 con 0x7fa19806fea0 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa19d49b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa1980aef30 con 0x7fa19806dfc0 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa19d49b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa1980ae0f0 con 0x7fa19815b1d0 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa1977fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa19806fea0 0x7fa19815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa1977fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa19806fea0 0x7fa19815ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54428/0 (socket says 172.21.15.67:54428) 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa1977fe640 1 -- 172.21.15.67:0/3623217999 learned_addr learned my addr 172.21.15.67:0/3623217999 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa196ffd640 1 --2- 172.21.15.67:0/3623217999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19815b1d0 0x7fa1980adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.687+0000 7fa1967fc640 1 --2- 172.21.15.67:0/3623217999 >> v2:172.21.15.97:3300/0 conn(0x7fa19806dfc0 0x7fa19806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa1977fe640 1 -- 172.21.15.67:0/3623217999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19815b1d0 msgr2=0x7fa1980adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa1977fe640 1 --2- 172.21.15.67:0/3623217999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19815b1d0 0x7fa1980adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa1977fe640 1 -- 172.21.15.67:0/3623217999 >> v2:172.21.15.97:3300/0 conn(0x7fa19806dfc0 msgr2=0x7fa19806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa1977fe640 1 --2- 172.21.15.67:0/3623217999 >> v2:172.21.15.97:3300/0 conn(0x7fa19806dfc0 0x7fa19806f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa1977fe640 1 -- 172.21.15.67:0/3623217999 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1980ae3b0 con 0x7fa19806fea0 2024-09-19T05:47:26.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa1967fc640 1 --2- 172.21.15.67:0/3623217999 >> v2:172.21.15.97:3300/0 conn(0x7fa19806dfc0 0x7fa19806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:26.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa196ffd640 1 --2- 172.21.15.67:0/3623217999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19815b1d0 0x7fa1980adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:26.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa1977fe640 1 --2- 172.21.15.67:0/3623217999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19806fea0 0x7fa19815ec80 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fa198071610 tx=0x7fa18801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ce24a316595974 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa195ffb640 1 -- 172.21.15.67:0/3623217999 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1880b0070 con 0x7fa19806fea0 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa195ffb640 1 -- 172.21.15.67:0/3623217999 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1880ab600 con 0x7fa19806fea0 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa195ffb640 1 -- 172.21.15.67:0/3623217999 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1880ab9d0 con 0x7fa19806fea0 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa19d49b640 1 -- 172.21.15.67:0/3623217999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19806fea0 msgr2=0x7fa19815ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa19d49b640 1 --2- 172.21.15.67:0/3623217999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19806fea0 0x7fa19815ec80 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fa198071610 tx=0x7fa18801c260 comp rx=0 tx=0).stop 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa19d49b640 1 -- 172.21.15.67:0/3623217999 shutdown_connections 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa19d49b640 1 --2- 172.21.15.67:0/3623217999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19806fea0 0x7fa19815ec80 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa19d49b640 1 --2- 172.21.15.67:0/3623217999 >> v2:172.21.15.97:3300/0 conn(0x7fa19806dfc0 0x7fa19806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa19d49b640 1 --2- 172.21.15.67:0/3623217999 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19815b1d0 0x7fa1980adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.691+0000 7fa19d49b640 1 -- 172.21.15.67:0/3623217999 >> 172.21.15.67:0/3623217999 conn(0x7fa1980b1e50 msgr2=0x7fa1980b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 -- 172.21.15.67:0/3623217999 shutdown_connections 2024-09-19T05:47:26.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 -- 172.21.15.67:0/3623217999 wait complete. 2024-09-19T05:47:26.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 Processor -- start 2024-09-19T05:47:26.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 -- start start 2024-09-19T05:47:26.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19806dfc0 0x7fa19815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19806fea0 0x7fa19815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19815b1d0 0x7fa198164420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa19806e850 con 0x7fa19815b1d0 2024-09-19T05:47:26.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa198072420 con 0x7fa19806dfc0 2024-09-19T05:47:26.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa19806e9d0 con 0x7fa19806fea0 2024-09-19T05:47:26.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa1977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19815b1d0 0x7fa198164420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa1977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19815b1d0 0x7fa198164420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54432/0 (socket says 172.21.15.67:54432) 2024-09-19T05:47:26.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa1977fe640 1 -- 172.21.15.67:0/537778472 learned_addr learned my addr 172.21.15.67:0/537778472 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa1967fc640 1 --2- 172.21.15.67:0/537778472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19806fea0 0x7fa19815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa196ffd640 1 --2- 172.21.15.67:0/537778472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19806dfc0 0x7fa19815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa1977fe640 1 -- 172.21.15.67:0/537778472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19806fea0 msgr2=0x7fa19815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa1977fe640 1 --2- 172.21.15.67:0/537778472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa19806fea0 0x7fa19815d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa1977fe640 1 -- 172.21.15.67:0/537778472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19806dfc0 msgr2=0x7fa19815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa1977fe640 1 --2- 172.21.15.67:0/537778472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa19806dfc0 0x7fa19815c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa1977fe640 1 -- 172.21.15.67:0/537778472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19815b7c0 con 0x7fa19815b1d0 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa1977fe640 1 --2- 172.21.15.67:0/537778472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa19815b1d0 0x7fa198164420 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fa1880ae040 tx=0x7fa18801aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa17f7fe640 1 -- 172.21.15.67:0/537778472 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1880b0040 con 0x7fa19815b1d0 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa17f7fe640 1 -- 172.21.15.67:0/537778472 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1880bc070 con 0x7fa19815b1d0 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa17f7fe640 1 -- 172.21.15.67:0/537778472 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1880b6640 con 0x7fa19815b1d0 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 -- 172.21.15.67:0/537778472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19815baa0 con 0x7fa19815b1d0 2024-09-19T05:47:26.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.695+0000 7fa19d49b640 1 -- 172.21.15.67:0/537778472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19815dd90 con 0x7fa19815b1d0 2024-09-19T05:47:26.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa17f7fe640 1 -- 172.21.15.67:0/537778472 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1880b67e0 con 0x7fa19815b1d0 2024-09-19T05:47:26.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa17f7fe640 1 --2- 172.21.15.67:0/537778472 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1840678c0 0x7fa184069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa17f7fe640 1 -- 172.21.15.67:0/537778472 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7fa188120250 con 0x7fa19815b1d0 2024-09-19T05:47:26.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa196ffd640 1 --2- 172.21.15.67:0/537778472 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1840678c0 0x7fa184069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1a0557000 1 Processor -- start 2024-09-19T05:47:26.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1a0557000 1 -- start start 2024-09-19T05:47:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa196ffd640 1 --2- 172.21.15.67:0/537778472 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa1840678c0 0x7fa184069d80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa190009ed0 tx=0x7fa19000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b049e8380 0x564b049e8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b0499bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b0499c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1a0557000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564b047a15b0 con 0x564b049e8ca0 2024-09-19T05:47:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1a0557000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564b047ebbf0 con 0x564b049e8380 2024-09-19T05:47:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1a0557000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564b047a6900 con 0x564b0499c420 2024-09-19T05:47:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1967fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b0499bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1967fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b0499bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54448/0 (socket says 172.21.15.67:54448) 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1967fc640 1 -- 172.21.15.67:0/2477999656 learned_addr learned my addr 172.21.15.67:0/2477999656 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1977fe640 1 --2- 172.21.15.67:0/2477999656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b0499c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa196ffd640 1 --2- 172.21.15.67:0/2477999656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b049e8380 0x564b049e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1967fc640 1 -- 172.21.15.67:0/2477999656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 msgr2=0x564b0499c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1967fc640 1 --2- 172.21.15.67:0/2477999656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b0499c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1967fc640 1 -- 172.21.15.67:0/2477999656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b049e8380 msgr2=0x564b049e8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1967fc640 1 --2- 172.21.15.67:0/2477999656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b049e8380 0x564b049e8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1967fc640 1 -- 172.21.15.67:0/2477999656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b047a59d0 con 0x564b049e8ca0 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa1967fc640 1 --2- 172.21.15.67:0/2477999656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b0499bee0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00d810 tx=0x7fa18c00dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1bffddb40a64e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa17cff9640 1 -- 172.21.15.67:0/2477999656 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c018070 con 0x564b049e8ca0 2024-09-19T05:47:26.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa17cff9640 1 -- 172.21.15.67:0/2477999656 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa18c00f960 con 0x564b049e8ca0 2024-09-19T05:47:26.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.699+0000 7fa17cff9640 1 -- 172.21.15.67:0/2477999656 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00fd30 con 0x564b049e8ca0 2024-09-19T05:47:26.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- 172.21.15.67:0/2477999656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 msgr2=0x564b0499bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 --2- 172.21.15.67:0/2477999656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b0499bee0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00d810 tx=0x7fa18c00dcd0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- 172.21.15.67:0/2477999656 shutdown_connections 2024-09-19T05:47:26.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 --2- 172.21.15.67:0/2477999656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b0499c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 --2- 172.21.15.67:0/2477999656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b0499bee0 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 --2- 172.21.15.67:0/2477999656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b049e8380 0x564b049e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- 172.21.15.67:0/2477999656 >> 172.21.15.67:0/2477999656 conn(0x564b04995f30 msgr2=0x564b049cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- 172.21.15.67:0/2477999656 shutdown_connections 2024-09-19T05:47:26.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- 172.21.15.67:0/2477999656 wait complete. 2024-09-19T05:47:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- start start 2024-09-19T05:47:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 Processor -- start 2024-09-19T05:47:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b0499c420 0x564b049c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b049e8380 0x564b049a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b049a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564b04785190 con 0x564b049e8ca0 2024-09-19T05:47:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564b047e7bb0 con 0x564b0499c420 2024-09-19T05:47:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564b047f7980 con 0x564b049e8380 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 10 client.0 _ll_register_callbacks cb 0x564b04989910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b049a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b049a4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54462/0 (socket says 172.21.15.67:54462) 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1977fe640 1 -- 172.21.15.67:0/342315259 learned_addr learned my addr 172.21.15.67:0/342315259 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa196ffd640 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b0499c420 0x564b049c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1967fc640 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b049e8380 0x564b049a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1977fe640 1 -- 172.21.15.67:0/342315259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b049e8380 msgr2=0x564b049a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1977fe640 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b049e8380 0x564b049a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1977fe640 1 -- 172.21.15.67:0/342315259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b0499c420 msgr2=0x564b049c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1977fe640 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b0499c420 0x564b049c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1977fe640 1 -- 172.21.15.67:0/342315259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b047a8570 con 0x564b049e8ca0 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa196ffd640 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b0499c420 0x564b049c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1977fe640 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b049a4210 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fa188097af0 tx=0x7fa1881200b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1828f23eefcc9da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa175ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa175ffb640 1 -- 172.21.15.67:0/342315259 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1880f08d0 con 0x564b049e8ca0 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa175ffb640 1 -- 172.21.15.67:0/342315259 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7fa1880f8c50 con 0x564b049e8ca0 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- 172.21.15.67:0/342315259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa18c00f960 con 0x564b049e8ca0 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa175ffb640 1 -- 172.21.15.67:0/342315259 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fa1880f4820 con 0x564b049e8ca0 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 10 client.10275 fetch_fsmap learned FSMap version 130 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- 172.21.15.67:0/342315259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x564b047ac3c0 con 0x564b049e8ca0 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa175ffb640 1 -- 172.21.15.67:0/342315259 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa18c00f960 con 0x564b049e8ca0 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa175ffb640 1 -- 172.21.15.67:0/342315259 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 130) ==== 3490+0+0 (secure 0 0 0) 0x7fa1880b3030 con 0x564b049e8ca0 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 10 client.10275 fetch_fsmap finished waiting for FSMap version 130 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 10 client.10275 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 20 client.10275 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:26.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564b049ca920 0x564b049cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 4 client.10275 mds_command: new command op to 10026 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa1a0557000 1 -- 172.21.15.67:0/342315259 --> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b04884040 con 0x564b049ca920 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa196ffd640 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564b049ca920 0x564b049cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa175ffb640 10 client.10275 ms_handle_connect on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.703+0000 7fa196ffd640 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564b049ca920 0x564b049cad00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10026 client_cookie=c0d09efa7dabbbe server_cookie=5154e7eef53bb21c in_seq=0 out_seq=0 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa175ffb640 1 -- 172.21.15.67:0/342315259 <== mds.10026 v2:172.21.15.67:6832/558917076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b04884040 con 0x564b049ca920 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa175ffb640 10 client.10275 handle_command_reply: tid=0 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 client.10275 shutdown 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 -- 172.21.15.67:0/342315259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 msgr2=0x564b049a4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b049a4210 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fa188097af0 tx=0x7fa1881200b0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 -- 172.21.15.67:0/342315259 shutdown_connections 2024-09-19T05:47:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564b049ca920 0x564b049cad00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8ca0 0x564b049a4210 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b049e8380 0x564b049a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa175ffb640 0 client.10275 ms_handle_reset on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 --2- 172.21.15.67:0/342315259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b0499c420 0x564b049c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 -- 172.21.15.67:0/342315259 >> 172.21.15.67:0/342315259 conn(0x564b04995f30 msgr2=0x564b0499b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 -- 172.21.15.67:0/342315259 shutdown_connections 2024-09-19T05:47:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 1 -- 172.21.15.67:0/342315259 wait complete. 2024-09-19T05:47:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.707+0000 7fa1a0557000 20 client.10275 trim_cache size 0 max 16384 2024-09-19T05:47:26.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 Processor -- start 2024-09-19T05:47:26.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 -- start start 2024-09-19T05:47:26.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b04995f30 0x564b049ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b049e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b049e8380 0x564b049e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa198203ef0 con 0x564b04995f30 2024-09-19T05:47:26.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa198155fd0 con 0x564b049e8380 2024-09-19T05:47:26.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa198202900 con 0x564b0499c420 2024-09-19T05:47:26.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa196ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b04995f30 0x564b049ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa196ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b04995f30 0x564b049ffab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54468/0 (socket says 172.21.15.67:54468) 2024-09-19T05:47:26.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa196ffd640 1 -- 172.21.15.67:0/4274559195 learned_addr learned my addr 172.21.15.67:0/4274559195 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa196ffd640 1 -- 172.21.15.67:0/4274559195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 msgr2=0x564b049e74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa196ffd640 1 --2- 172.21.15.67:0/4274559195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b049e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa196ffd640 1 -- 172.21.15.67:0/4274559195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b049e8380 msgr2=0x564b049e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa196ffd640 1 --2- 172.21.15.67:0/4274559195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b049e8380 0x564b049e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa196ffd640 1 -- 172.21.15.67:0/4274559195 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0478b5c0 con 0x564b04995f30 2024-09-19T05:47:26.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa196ffd640 1 --2- 172.21.15.67:0/4274559195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b04995f30 0x564b049ffab0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fa1900155e0 tx=0x7fa190014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e9a2dde5e2be5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa177fff640 1 -- 172.21.15.67:0/4274559195 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190003ba0 con 0x564b04995f30 2024-09-19T05:47:26.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa177fff640 1 -- 172.21.15.67:0/4274559195 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa190003d40 con 0x564b04995f30 2024-09-19T05:47:26.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa177fff640 1 -- 172.21.15.67:0/4274559195 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190022a50 con 0x564b04995f30 2024-09-19T05:47:26.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 -- 172.21.15.67:0/4274559195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b04995f30 msgr2=0x564b049ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 --2- 172.21.15.67:0/4274559195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b04995f30 0x564b049ffab0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fa1900155e0 tx=0x7fa190014000 comp rx=0 tx=0).stop 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 -- 172.21.15.67:0/4274559195 shutdown_connections 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 --2- 172.21.15.67:0/4274559195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b049e8380 0x564b049e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 --2- 172.21.15.67:0/4274559195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b049e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 --2- 172.21.15.67:0/4274559195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b04995f30 0x564b049ffab0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 -- 172.21.15.67:0/4274559195 >> 172.21.15.67:0/4274559195 conn(0x564b049a0de0 msgr2=0x564b049e6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 -- 172.21.15.67:0/4274559195 shutdown_connections 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.723+0000 7fa1a0557000 1 -- 172.21.15.67:0/4274559195 wait complete. 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- start start 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 Processor -- start 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b04995f30 0x564b04a5ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b049fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8380 0x564b049fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564b047f29f0 con 0x564b049e8380 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564b047e7bb0 con 0x564b04995f30 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x564b047edc40 con 0x564b0499c420 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 10 client.0 _ll_register_callbacks cb 0x7fa1880094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8380 0x564b049fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8380 0x564b049fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54476/0 (socket says 172.21.15.67:54476) 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1977fe640 1 -- 172.21.15.67:0/1101446298 learned_addr learned my addr 172.21.15.67:0/1101446298 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa196ffd640 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b04995f30 0x564b04a5ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1967fc640 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b049fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1977fe640 1 -- 172.21.15.67:0/1101446298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 msgr2=0x564b049fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1977fe640 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b049fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1977fe640 1 -- 172.21.15.67:0/1101446298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b04995f30 msgr2=0x564b04a5ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1977fe640 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b04995f30 0x564b04a5ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1977fe640 1 -- 172.21.15.67:0/1101446298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0486d280 con 0x564b049e8380 2024-09-19T05:47:26.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa196ffd640 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b04995f30 0x564b04a5ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1977fe640 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8380 0x564b049fd1c0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fa1880f0170 tx=0x7fa1880abf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630e94cd985dd9c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa175ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:26.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa175ffb640 1 -- 172.21.15.67:0/1101446298 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1880effb0 con 0x564b049e8380 2024-09-19T05:47:26.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa175ffb640 1 -- 172.21.15.67:0/1101446298 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7fa1880ef8c0 con 0x564b049e8380 2024-09-19T05:47:26.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- 172.21.15.67:0/1101446298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa190003d40 con 0x564b049e8380 2024-09-19T05:47:26.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa175ffb640 1 -- 172.21.15.67:0/1101446298 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fa188114050 con 0x564b049e8380 2024-09-19T05:47:26.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 10 client.10281 fetch_fsmap learned FSMap version 130 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- 172.21.15.67:0/1101446298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x564b048447d0 con 0x564b049e8380 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa175ffb640 1 -- 172.21.15.67:0/1101446298 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa190003d40 con 0x564b049e8380 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa175ffb640 1 -- 172.21.15.67:0/1101446298 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 130) ==== 3490+0+0 (secure 0 0 0) 0x7fa188117020 con 0x564b049e8380 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 10 client.10281 fetch_fsmap finished waiting for FSMap version 130 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 10 client.10281 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 20 client.10281 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564b049e8ca0 0x564b049fd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 4 client.10281 mds_command: new command op to 10026 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- 172.21.15.67:0/1101446298 --> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x564b04785930 con 0x564b049e8ca0 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa196ffd640 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564b049e8ca0 0x564b049fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa175ffb640 10 client.10281 ms_handle_connect on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa196ffd640 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564b049e8ca0 0x564b049fd700 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10026 client_cookie=74e384e5b6c7dca1 server_cookie=2789ea7480d80f08 in_seq=0 out_seq=0 2024-09-19T05:47:26.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa175ffb640 1 -- 172.21.15.67:0/1101446298 <== mds.10026 v2:172.21.15.67:6832/558917076 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x564b04785930 con 0x564b049e8ca0 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa175ffb640 10 client.10281 handle_command_reply: tid=0 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 client.10281 shutdown 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- 172.21.15.67:0/1101446298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8380 msgr2=0x564b049fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8380 0x564b049fd1c0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fa1880f0170 tx=0x7fa1880abf90 comp rx=0 tx=0).stop 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- 172.21.15.67:0/1101446298 shutdown_connections 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x564b049e8ca0 0x564b049fd700 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564b049e8380 0x564b049fd1c0 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa175ffb640 0 client.10281 ms_handle_reset on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x564b0499c420 0x564b049fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 --2- 172.21.15.67:0/1101446298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564b04995f30 0x564b04a5ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- 172.21.15.67:0/1101446298 >> 172.21.15.67:0/1101446298 conn(0x564b049a0de0 msgr2=0x564b049e7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- 172.21.15.67:0/1101446298 shutdown_connections 2024-09-19T05:47:26.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 1 -- 172.21.15.67:0/1101446298 wait complete. 2024-09-19T05:47:26.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.727+0000 7fa1a0557000 20 client.10281 trim_cache size 0 max 16384 2024-09-19T05:47:26.733 INFO:teuthology.orchestra.run.smithi067.stderr:Error EINVAL: MDS is not active 2024-09-19T05:47:26.733 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-19T05:47:26.734 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub resume 2024-09-19T05:47:26.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.847+0000 7fe4a4d95640 1 Processor -- start 2024-09-19T05:47:26.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.847+0000 7fe4a4d95640 1 -- start start 2024-09-19T05:47:26.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe4a4d95640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4a015e690 0x7fe4a00d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe4a4d95640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a00d35a0 con 0x7fe4a00d1590 2024-09-19T05:47:26.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe4a4d95640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a00d32c0 con 0x7fe4a00d4fb0 2024-09-19T05:47:26.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe4a4d95640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a006d040 con 0x7fe4a015e690 2024-09-19T05:47:26.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4a015e690 0x7fe4a00d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49ed9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe4a00d1590 0x7fe4a006db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45520/0 (socket says 172.21.15.67:45520) 2024-09-19T05:47:26.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49ed9d640 1 -- 172.21.15.67:0/388241703 learned_addr learned my addr 172.21.15.67:0/388241703 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:26.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49e59c640 1 -- 172.21.15.67:0/388241703 >> v1:172.21.15.97:6789/0 conn(0x7fe4a00d4fb0 legacy=0x7fe4a00d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49e59c640 1 -- 172.21.15.67:0/388241703 >> v1:172.21.15.67:6789/0 conn(0x7fe4a00d1590 legacy=0x7fe4a006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49e59c640 1 -- 172.21.15.67:0/388241703 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a006d320 con 0x7fe4a015e690 2024-09-19T05:47:26.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49d59a640 1 -- 172.21.15.67:0/388241703 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1800676193 0 0) 0x7fe4a00d35a0 con 0x7fe4a00d1590 2024-09-19T05:47:26.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49e59c640 1 --2- 172.21.15.67:0/388241703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4a015e690 0x7fe4a00d2a40 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fe4900097c0 tx=0x7fe49001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d55d2a0a5d27fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49d59a640 1 -- 172.21.15.67:0/388241703 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4900b1070 con 0x7fe4a015e690 2024-09-19T05:47:26.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49d59a640 1 -- 172.21.15.67:0/388241703 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4900ac630 con 0x7fe4a015e690 2024-09-19T05:47:26.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.851+0000 7fe49d59a640 1 -- 172.21.15.67:0/388241703 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4900a8050 con 0x7fe4a015e690 2024-09-19T05:47:26.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- 172.21.15.67:0/388241703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4a015e690 msgr2=0x7fe4a00d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 --2- 172.21.15.67:0/388241703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4a015e690 0x7fe4a00d2a40 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fe4900097c0 tx=0x7fe49001c430 comp rx=0 tx=0).stop 2024-09-19T05:47:26.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- 172.21.15.67:0/388241703 shutdown_connections 2024-09-19T05:47:26.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 --2- 172.21.15.67:0/388241703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4a015e690 0x7fe4a00d2a40 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- 172.21.15.67:0/388241703 >> 172.21.15.67:0/388241703 conn(0x7fe4a00d4490 msgr2=0x7fe4a00d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- 172.21.15.67:0/388241703 shutdown_connections 2024-09-19T05:47:26.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- 172.21.15.67:0/388241703 wait complete. 2024-09-19T05:47:26.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 Processor -- start 2024-09-19T05:47:26.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- start start 2024-09-19T05:47:26.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a00d1590 0x7fe4a00b8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4a00d4fb0 0x7fe4a00b9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4a015e690 0x7fe4a01575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a006ebc0 con 0x7fe4a00d4fb0 2024-09-19T05:47:26.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a006ea40 con 0x7fe4a00d1590 2024-09-19T05:47:26.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a016c260 con 0x7fe4a015e690 2024-09-19T05:47:26.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4a00d4fb0 0x7fe4a00b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4a00d4fb0 0x7fe4a00b9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54496/0 (socket says 172.21.15.67:54496) 2024-09-19T05:47:26.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49dd9b640 1 -- 172.21.15.67:0/610777642 learned_addr learned my addr 172.21.15.67:0/610777642 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49e59c640 1 --2- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a00d1590 0x7fe4a00b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49ed9d640 1 --2- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4a015e690 0x7fe4a01575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49dd9b640 1 -- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4a015e690 msgr2=0x7fe4a01575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4a015e690 0x7fe4a01575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49dd9b640 1 -- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a00d1590 msgr2=0x7fe4a00b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a00d1590 0x7fe4a00b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49dd9b640 1 -- 172.21.15.67:0/610777642 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a00c83e0 con 0x7fe4a00d4fb0 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49e59c640 1 --2- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4a00d1590 0x7fe4a00b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49ed9d640 1 --2- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4a015e690 0x7fe4a01575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/610777642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4a00d4fb0 0x7fe4a00b9700 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c450 tx=0x7fe49400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe48effd640 1 -- 172.21.15.67:0/610777642 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494011790 con 0x7fe4a00d4fb0 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe48effd640 1 -- 172.21.15.67:0/610777642 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe494017070 con 0x7fe4a00d4fb0 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- 172.21.15.67:0/610777642 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a00b7cd0 con 0x7fe4a00d4fb0 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe48effd640 1 -- 172.21.15.67:0/610777642 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494011b90 con 0x7fe4a00d4fb0 2024-09-19T05:47:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.855+0000 7fe4a4d95640 1 -- 172.21.15.67:0/610777642 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a00cadd0 con 0x7fe4a00d4fb0 2024-09-19T05:47:26.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe48effd640 1 -- 172.21.15.67:0/610777642 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe494011d30 con 0x7fe4a00d4fb0 2024-09-19T05:47:26.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe48effd640 1 --2- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4800678c0 0x7fe480069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe48effd640 1 -- 172.21.15.67:0/610777642 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7fe494085c40 con 0x7fe4a00d4fb0 2024-09-19T05:47:26.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49e59c640 1 --2- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4800678c0 0x7fe480069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe4a7e51000 1 Processor -- start 2024-09-19T05:47:26.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe4a7e51000 1 -- start start 2024-09-19T05:47:26.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49e59c640 1 --2- 172.21.15.67:0/610777642 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe4800678c0 0x7fe480069d80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe4900ae000 tx=0x7fe490008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6978c10 0x558bd6978ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd692c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd692cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558bd677dcc0 con 0x558bd6979530 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558bd6738a20 con 0x558bd692c780 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x558bd6779c80 con 0x558bd6978c10 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd692c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd692c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54508/0 (socket says 172.21.15.67:54508) 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49dd9b640 1 -- 172.21.15.67:0/60649490 learned_addr learned my addr 172.21.15.67:0/60649490 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49e59c640 1 --2- 172.21.15.67:0/60649490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6978c10 0x558bd6978ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49dd9b640 1 -- 172.21.15.67:0/60649490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6978c10 msgr2=0x558bd6978ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49ed9d640 1 --2- 172.21.15.67:0/60649490 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd692cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/60649490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6978c10 0x558bd6978ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49dd9b640 1 -- 172.21.15.67:0/60649490 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 msgr2=0x558bd692cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/60649490 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd692cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49dd9b640 1 -- 172.21.15.67:0/60649490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bd6720d40 con 0x558bd6979530 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49e59c640 1 --2- 172.21.15.67:0/60649490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6978c10 0x558bd6978ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/60649490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd692c240 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fe49405e590 tx=0x7fe494055fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ad842fcccedbf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe47ffff640 1 -- 172.21.15.67:0/60649490 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494082070 con 0x558bd6979530 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe47ffff640 1 -- 172.21.15.67:0/60649490 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4940541e0 con 0x558bd6979530 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.859+0000 7fe47ffff640 1 -- 172.21.15.67:0/60649490 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494056140 con 0x558bd6979530 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- 172.21.15.67:0/60649490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 msgr2=0x558bd692c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/60649490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd692c240 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fe49405e590 tx=0x7fe494055fa0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- 172.21.15.67:0/60649490 shutdown_connections 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/60649490 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd692cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/60649490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd692c240 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/60649490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6978c10 0x558bd6978ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- 172.21.15.67:0/60649490 >> 172.21.15.67:0/60649490 conn(0x558bd69599b0 msgr2=0x558bd695bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- 172.21.15.67:0/60649490 shutdown_connections 2024-09-19T05:47:26.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- 172.21.15.67:0/60649490 wait complete. 2024-09-19T05:47:26.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- start start 2024-09-19T05:47:26.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 Processor -- start 2024-09-19T05:47:26.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd697ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd69804b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6979530 0x558bd6932490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558bd67172c0 con 0x558bd6978c10 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558bd673c370 con 0x558bd692c780 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x558bd678bf50 con 0x558bd6979530 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 10 client.0 _ll_register_callbacks cb 0x558bd67dedb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd69804b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd69804b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54518/0 (socket says 172.21.15.67:54518) 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49dd9b640 1 -- 172.21.15.67:0/3981305695 learned_addr learned my addr 172.21.15.67:0/3981305695 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49ed9d640 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6979530 0x558bd6932490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49e59c640 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd697ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49dd9b640 1 -- 172.21.15.67:0/3981305695 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6979530 msgr2=0x558bd6932490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6979530 0x558bd6932490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49dd9b640 1 -- 172.21.15.67:0/3981305695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 msgr2=0x558bd697ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd697ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49dd9b640 1 -- 172.21.15.67:0/3981305695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bd671d770 con 0x558bd6978c10 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd69804b0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fe494055be0 tx=0x7fe494007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6371b815f040008 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe47d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe47d7fa640 1 -- 172.21.15.67:0/3981305695 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494082030 con 0x558bd6978c10 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe47d7fa640 1 -- 172.21.15.67:0/3981305695 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7fe494056140 con 0x558bd6978c10 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- 172.21.15.67:0/3981305695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4940541e0 con 0x558bd6978c10 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe47d7fa640 1 -- 172.21.15.67:0/3981305695 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fe494056340 con 0x558bd6978c10 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 10 client.10296 fetch_fsmap learned FSMap version 130 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- 172.21.15.67:0/3981305695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x558bd673b3f0 con 0x558bd6978c10 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe47d7fa640 1 -- 172.21.15.67:0/3981305695 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4940541e0 con 0x558bd6978c10 2024-09-19T05:47:26.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe47d7fa640 1 -- 172.21.15.67:0/3981305695 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 130) ==== 3490+0+0 (secure 0 0 0) 0x7fe49405e630 con 0x558bd6978c10 2024-09-19T05:47:26.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 10 client.10296 fetch_fsmap finished waiting for FSMap version 130 2024-09-19T05:47:26.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 10 client.10296 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:47:26.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 20 client.10296 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:26.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x558bd6932ea0 0x558bd6933280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 4 client.10296 mds_command: new command op to 10026 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:47:26.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe4a7e51000 1 -- 172.21.15.67:0/3981305695 --> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bd6717d90 con 0x558bd6932ea0 2024-09-19T05:47:26.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49e59c640 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x558bd6932ea0 0x558bd6933280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe47d7fa640 10 client.10296 ms_handle_connect on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.863+0000 7fe49e59c640 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x558bd6932ea0 0x558bd6933280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10026 client_cookie=53935bda109a7757 server_cookie=754d5bfffe725891 in_seq=0 out_seq=0 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe47d7fa640 1 -- 172.21.15.67:0/3981305695 <== mds.10026 v2:172.21.15.67:6832/558917076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bd6717d90 con 0x558bd6932ea0 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe47d7fa640 10 client.10296 handle_command_reply: tid=0 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 client.10296 shutdown 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 -- 172.21.15.67:0/3981305695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 msgr2=0x558bd69804b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd69804b0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fe494055be0 tx=0x7fe494007f90 comp rx=0 tx=0).stop 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 -- 172.21.15.67:0/3981305695 shutdown_connections 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x558bd6932ea0 0x558bd6933280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6979530 0x558bd6932490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd69804b0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe47d7fa640 0 client.10296 ms_handle_reset on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/3981305695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd697ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 -- 172.21.15.67:0/3981305695 >> 172.21.15.67:0/3981305695 conn(0x558bd69599b0 msgr2=0x558bd692b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 -- 172.21.15.67:0/3981305695 shutdown_connections 2024-09-19T05:47:26.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 1 -- 172.21.15.67:0/3981305695 wait complete. 2024-09-19T05:47:26.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.867+0000 7fe4a7e51000 20 client.10296 trim_cache size 0 max 16384 2024-09-19T05:47:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe4a7e51000 1 Processor -- start 2024-09-19T05:47:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe4a7e51000 1 -- start start 2024-09-19T05:47:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd698f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd698f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6979530 0x558bd698fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a0203c80 con 0x558bd6978c10 2024-09-19T05:47:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a00ca6a0 con 0x558bd692c780 2024-09-19T05:47:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a02026d0 con 0x558bd6979530 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd698f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd698f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54534/0 (socket says 172.21.15.67:54534) 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49dd9b640 1 -- 172.21.15.67:0/2905442102 learned_addr learned my addr 172.21.15.67:0/2905442102 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49e59c640 1 --2- 172.21.15.67:0/2905442102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd698f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49dd9b640 1 -- 172.21.15.67:0/2905442102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6979530 msgr2=0x558bd698fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49ed9d640 1 --2- 172.21.15.67:0/2905442102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6979530 0x558bd698fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/2905442102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6979530 0x558bd698fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49dd9b640 1 -- 172.21.15.67:0/2905442102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 msgr2=0x558bd698f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/2905442102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd698f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49dd9b640 1 -- 172.21.15.67:0/2905442102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bd67ff320 con 0x558bd6978c10 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/2905442102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd698f850 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fe494055e70 tx=0x7fe49407f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc39342cee48c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe47f7fe640 1 -- 172.21.15.67:0/2905442102 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494062070 con 0x558bd6978c10 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe47f7fe640 1 -- 172.21.15.67:0/2905442102 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe49405e630 con 0x558bd6978c10 2024-09-19T05:47:26.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.883+0000 7fe47f7fe640 1 -- 172.21.15.67:0/2905442102 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494082050 con 0x558bd6978c10 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2905442102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 msgr2=0x558bd698f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/2905442102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd698f850 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fe494055e70 tx=0x7fe49407f000 comp rx=0 tx=0).stop 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2905442102 shutdown_connections 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/2905442102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd6979530 0x558bd698fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/2905442102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6978c10 0x558bd698f850 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/2905442102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd692c780 0x558bd698f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2905442102 >> 172.21.15.67:0/2905442102 conn(0x558bd69599b0 msgr2=0x558bd692aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2905442102 shutdown_connections 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2905442102 wait complete. 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- start start 2024-09-19T05:47:26.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 Processor -- start 2024-09-19T05:47:26.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd692c780 0x558bd69eb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd6978c10 0x558bd69850d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd6985610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558bd6725120 con 0x558bd6979530 2024-09-19T05:47:26.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558bd67fee90 con 0x558bd6978c10 2024-09-19T05:47:26.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x558bd6727b90 con 0x558bd692c780 2024-09-19T05:47:26.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 10 client.0 _ll_register_callbacks cb 0x7fe494080070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd6985610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd6985610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54546/0 (socket says 172.21.15.67:54546) 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49ed9d640 1 -- 172.21.15.67:0/2243414702 learned_addr learned my addr 172.21.15.67:0/2243414702 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49e59c640 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd692c780 0x558bd69eb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49ed9d640 1 -- 172.21.15.67:0/2243414702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd692c780 msgr2=0x558bd69eb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49ed9d640 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd692c780 0x558bd69eb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49dd9b640 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd6978c10 0x558bd69850d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49ed9d640 1 -- 172.21.15.67:0/2243414702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd6978c10 msgr2=0x558bd69850d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49ed9d640 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd6978c10 0x558bd69850d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49ed9d640 1 -- 172.21.15.67:0/2243414702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bd67115c0 con 0x558bd6979530 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49ed9d640 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd6985610 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7fe498010550 tx=0x7fe498010a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adf1886ae0aebb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe47d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe47d7fa640 1 -- 172.21.15.67:0/2243414702 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4980070d0 con 0x558bd6979530 2024-09-19T05:47:26.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe47d7fa640 1 -- 172.21.15.67:0/2243414702 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7fe498016910 con 0x558bd6979530 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2243414702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe49405e630 con 0x558bd6979530 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe47d7fa640 1 -- 172.21.15.67:0/2243414702 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fe498016b10 con 0x558bd6979530 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 10 client.10302 fetch_fsmap learned FSMap version 130 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2243414702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x558bd6715330 con 0x558bd6979530 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe47d7fa640 1 -- 172.21.15.67:0/2243414702 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe49405e630 con 0x558bd6979530 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe47d7fa640 1 -- 172.21.15.67:0/2243414702 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 130) ==== 3490+0+0 (secure 0 0 0) 0x7fe498016cb0 con 0x558bd6979530 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 10 client.10302 fetch_fsmap finished waiting for FSMap version 130 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 10 client.10302 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 20 client.10302 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x558bd6985b50 0x558bd6985f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 4 client.10302 mds_command: new command op to 10026 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-19T05:47:26.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2243414702 --> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x558bd678b3f0 con 0x558bd6985b50 2024-09-19T05:47:26.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49e59c640 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x558bd6985b50 0x558bd6985f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:26.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe49e59c640 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x558bd6985b50 0x558bd6985f30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10026 client_cookie=830b1fe6128c3c72 server_cookie=76d0841e0be34cca in_seq=0 out_seq=0 2024-09-19T05:47:26.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe47d7fa640 10 client.10302 ms_handle_connect on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe47d7fa640 1 -- 172.21.15.67:0/2243414702 <== mds.10026 v2:172.21.15.67:6832/558917076 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x558bd678b3f0 con 0x558bd6985b50 2024-09-19T05:47:26.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe47d7fa640 10 client.10302 handle_command_reply: tid=0 2024-09-19T05:47:26.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.887+0000 7fe4a7e51000 1 client.10302 shutdown 2024-09-19T05:47:26.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2243414702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 msgr2=0x558bd6985610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:26.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd6985610 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7fe498010550 tx=0x7fe498010a10 comp rx=0 tx=0).stop 2024-09-19T05:47:26.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2243414702 shutdown_connections 2024-09-19T05:47:26.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.67:6832/558917076,v1:172.21.15.67:6833/558917076] conn(0x558bd6985b50 0x558bd6985f30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558bd6979530 0x558bd6985610 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bd6978c10 0x558bd69850d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 1 --2- 172.21.15.67:0/2243414702 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x558bd692c780 0x558bd69eb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:26.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe47d7fa640 0 client.10302 ms_handle_reset on v2:172.21.15.67:6832/558917076 2024-09-19T05:47:26.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2243414702 >> 172.21.15.67:0/2243414702 conn(0x558bd69599b0 msgr2=0x558bd698fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:26.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2243414702 shutdown_connections 2024-09-19T05:47:26.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 1 -- 172.21.15.67:0/2243414702 wait complete. 2024-09-19T05:47:26.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:26.891+0000 7fe4a7e51000 20 client.10302 trim_cache size 0 max 16384 2024-09-19T05:47:26.894 INFO:teuthology.orchestra.run.smithi067.stderr:Error EINVAL: MDS is not active 2024-09-19T05:47:26.895 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-19T05:47:26.895 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:47:26.896 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:47:26.981 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:47:27.053 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:47:27.054 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:47:27.054 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:47:27.054 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:47:27.061 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:47:27.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.239+0000 7f2cee9ea640 1 Processor -- start 2024-09-19T05:47:27.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.239+0000 7f2cee9ea640 1 -- start start 2024-09-19T05:47:27.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.239+0000 7f2cee9ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80b51d0 0x7f2ce80d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.239+0000 7f2cee9ea640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce80d4d40 con 0x7f2ce80d1590 2024-09-19T05:47:27.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.239+0000 7f2cee9ea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce80d5020 con 0x7f2ce8161da0 2024-09-19T05:47:27.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.239+0000 7f2cee9ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce80d0840 con 0x7f2ce80b51d0 2024-09-19T05:47:27.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.239+0000 7f2ce77fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2ce80d1590 0x7f2ce80cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45526/0 (socket says 172.21.15.67:45526) 2024-09-19T05:47:27.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.239+0000 7f2ce77fe640 1 -- 172.21.15.67:0/3026587455 learned_addr learned my addr 172.21.15.67:0/3026587455 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:27.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.239+0000 7f2cecf87640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80b51d0 0x7f2ce80d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034865149 0 0) 0x7f2ce80d4d40 con 0x7f2ce80d1590 2024-09-19T05:47:27.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cd0003530 con 0x7f2ce80d1590 2024-09-19T05:47:27.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1698338012 0 0) 0x7f2cd0003530 con 0x7f2ce80d1590 2024-09-19T05:47:27.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80b51d0 msgr2=0x7f2ce80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:27.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80b51d0 0x7f2ce80d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 >> v1:172.21.15.97:6789/0 conn(0x7f2ce8161da0 legacy=0x7f2ce80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce80d5300 con 0x7f2ce80d1590 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f2cdc0016a0 con 0x7f2ce80d1590 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 >> v1:172.21.15.67:6789/0 conn(0x7f2ce80d1590 legacy=0x7f2ce80cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cd00039f0 0x7f2cd0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80b51d0 0x7f2cd0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cd0004d50 0x7f2cd00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce80d0840 con 0x7f2cd0004d50 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd000bab0 con 0x7f2cd00039f0 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd000bcb0 con 0x7f2ce80b51d0 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cecf87640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cd0004d50 0x7f2cd00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce77fe640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80b51d0 0x7f2cd0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce7fff640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cd00039f0 0x7f2cd0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cecf87640 1 -- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80b51d0 msgr2=0x7f2cd0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:27.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cecf87640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80b51d0 0x7f2cd0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cecf87640 1 -- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cd00039f0 msgr2=0x7f2cd0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:27.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cecf87640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cd00039f0 0x7f2cd0003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cecf87640 1 -- 172.21.15.67:0/3026587455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd0003530 con 0x7f2cd0004d50 2024-09-19T05:47:27.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cecf87640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cd0004d50 0x7f2cd00051d0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009f90 tx=0x7f2ce001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9518d6df4f24df96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:27.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00b2070 con 0x7f2cd0004d50 2024-09-19T05:47:27.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce00a5c50 con 0x7f2cd0004d50 2024-09-19T05:47:27.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2ce6ffd640 1 -- 172.21.15.67:0/3026587455 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0009c10 con 0x7f2cd0004d50 2024-09-19T05:47:27.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3026587455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cd0004d50 msgr2=0x7f2cd00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:27.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cee9ea640 1 --2- 172.21.15.67:0/3026587455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cd0004d50 0x7f2cd00051d0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009f90 tx=0x7f2ce001cc40 comp rx=0 tx=0).stop 2024-09-19T05:47:27.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cecf87640 1 -- 172.21.15.67:0/3026587455 reap_dead start 2024-09-19T05:47:27.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3026587455 shutdown_connections 2024-09-19T05:47:27.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3026587455 >> 172.21.15.67:0/3026587455 conn(0x7f2ce808bfc0 msgr2=0x7f2ce80d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:27.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3026587455 shutdown_connections 2024-09-19T05:47:27.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.243+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3026587455 wait complete. 2024-09-19T05:47:27.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 Processor -- start 2024-09-19T05:47:27.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 -- start start 2024-09-19T05:47:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80c8b10 0x7f2ce80cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ce80c8ef0 0x7f2ce80cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce80cc870 0x7f2ce81525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8162180 con 0x7f2ce80cc870 2024-09-19T05:47:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce80b5d00 con 0x7f2ce80c8ef0 2024-09-19T05:47:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce80d1af0 con 0x7f2ce80c8b10 2024-09-19T05:47:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cecf87640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce80cc870 0x7f2ce81525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cecf87640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce80cc870 0x7f2ce81525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54558/0 (socket says 172.21.15.67:54558) 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cecf87640 1 -- 172.21.15.67:0/3811916807 learned_addr learned my addr 172.21.15.67:0/3811916807 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2ce7fff640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80c8b10 0x7f2ce80cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2ce77fe640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ce80c8ef0 0x7f2ce80cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cecf87640 1 -- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80c8b10 msgr2=0x7f2ce80cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cecf87640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80c8b10 0x7f2ce80cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cecf87640 1 -- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ce80c8ef0 msgr2=0x7f2ce80cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cecf87640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ce80c8ef0 0x7f2ce80cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cecf87640 1 -- 172.21.15.67:0/3811916807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce80ccd10 con 0x7f2ce80cc870 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cecf87640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce80cc870 0x7f2ce81525f0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00b0040 tx=0x7f2ce0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2ce4ff9640 1 -- 172.21.15.67:0/3811916807 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00bd070 con 0x7f2ce80cc870 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2ce4ff9640 1 -- 172.21.15.67:0/3811916807 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce00a5a50 con 0x7f2ce80cc870 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3811916807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce80ccff0 con 0x7f2ce80cc870 2024-09-19T05:47:27.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2ce4ff9640 1 -- 172.21.15.67:0/3811916807 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00b2040 con 0x7f2ce80cc870 2024-09-19T05:47:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3811916807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce80cd5b0 con 0x7f2ce80cc870 2024-09-19T05:47:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.247+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3811916807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce80d0e80 con 0x7f2ce80cc870 2024-09-19T05:47:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.251+0000 7f2ce4ff9640 1 -- 172.21.15.67:0/3811916807 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ce00c0070 con 0x7f2ce80cc870 2024-09-19T05:47:27.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.251+0000 7f2ce4ff9640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2cd40678c0 0x7f2cd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.251+0000 7f2ce4ff9640 1 -- 172.21.15.67:0/3811916807 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f2ce011f810 con 0x7f2ce80cc870 2024-09-19T05:47:27.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.251+0000 7f2ce7fff640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2cd40678c0 0x7f2cd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.251+0000 7f2ce7fff640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2cd40678c0 0x7f2cd4069d80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8001720 tx=0x7f2cd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:27.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.255+0000 7f2ce4ff9640 1 -- 172.21.15.67:0/3811916807 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2ce0016950 con 0x7f2ce80cc870 2024-09-19T05:47:27.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.431+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3811916807 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2ce80cb200 con 0x7f2ce80cc870 2024-09-19T05:47:27.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.431+0000 7f2ce4ff9640 1 -- 172.21.15.67:0/3811916807 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v179) ==== 80+0+0 (secure 0 0 0) 0x7f2ce00a5c20 con 0x7f2ce80cc870 2024-09-19T05:47:27.429 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:47:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2cd40678c0 msgr2=0x7f2cd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2cd40678c0 0x7f2cd4069d80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8001720 tx=0x7f2cd8009040 comp rx=0 tx=0).stop 2024-09-19T05:47:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3811916807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce80cc870 msgr2=0x7f2ce81525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce80cc870 0x7f2ce81525f0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00b0040 tx=0x7f2ce0009750 comp rx=0 tx=0).stop 2024-09-19T05:47:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3811916807 shutdown_connections 2024-09-19T05:47:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce80cc870 0x7f2ce81525f0 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ce80c8ef0 0x7f2ce80cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2cd40678c0 0x7f2cd4069d80 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 --2- 172.21.15.67:0/3811916807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ce80c8b10 0x7f2ce80cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3811916807 >> 172.21.15.67:0/3811916807 conn(0x7f2ce808bfc0 msgr2=0x7f2ce80d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3811916807 shutdown_connections 2024-09-19T05:47:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.435+0000 7f2cee9ea640 1 -- 172.21.15.67:0/3811916807 wait complete. 2024-09-19T05:47:27.447 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:47:27.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:27.447 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:27.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[85131]: fuse finished with error 0 and tester_r 0 2024-09-19T05:47:27.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:47:27.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:27.532 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:47:27.689 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:47:27.690 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:47:27.690 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:47:27.695 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:47:27.695 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:47:27.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:27.696 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:47:27.744 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:47:27.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:47:27.745 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:47:27.745 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:47:27.745 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:47:27.752 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:47:27.752 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:47:27.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:27.753 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:47:27.804 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:47:27.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:47:27.805 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:47:27.805 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:47:27.805 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:47:27.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:47:27.810 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:47:27.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:27.811 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:47:27.856 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:47:27.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:47:27.858 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:47:27.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f1e0df640 1 Processor -- start 2024-09-19T05:47:27.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f1e0df640 1 -- start start 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f1e0df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1815c030 0x7f6f1806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f1e0df640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f1815d1d0 0x7f6f180b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f1e0df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1806e3c0 con 0x7f6f180b3510 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f1e0df640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1806e6a0 con 0x7f6f1815d1d0 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f1e0df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6f1806e980 con 0x7f6f1815c030 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f16ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f1815d1d0 0x7f6f180b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f16ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f1815d1d0 0x7f6f180b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54572/0 (socket says 172.21.15.67:54572) 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f16ffd640 1 -- 172.21.15.67:0/2772352053 learned_addr learned my addr 172.21.15.67:0/2772352053 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f177fe640 1 --2- 172.21.15.67:0/2772352053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1815c030 0x7f6f1806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f16ffd640 1 -- 172.21.15.67:0/2772352053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1815c030 msgr2=0x7f6f1806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:27.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f16ffd640 1 --2- 172.21.15.67:0/2772352053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1815c030 0x7f6f1806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f16ffd640 1 -- 172.21.15.67:0/2772352053 >> v1:172.21.15.97:6789/0 conn(0x7f6f180b3510 legacy=0x7f6f1806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:27.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f16ffd640 1 -- 172.21.15.67:0/2772352053 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1806ec60 con 0x7f6f1815d1d0 2024-09-19T05:47:27.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.987+0000 7f6f177fe640 1 --2- 172.21.15.67:0/2772352053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1815c030 0x7f6f1806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:27.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f16ffd640 1 --2- 172.21.15.67:0/2772352053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815d1d0 0x7f6f180b2fd0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009870 tx=0x7f6f0c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b233b3d5fa212 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:27.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f167fc640 1 -- 172.21.15.67:0/2772352053 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0aa430 con 0x7f6f1815d1d0 2024-09-19T05:47:27.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f167fc640 1 -- 172.21.15.67:0/2772352053 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c0af070 con 0x7f6f1815d1d0 2024-09-19T05:47:27.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f167fc640 1 -- 172.21.15.67:0/2772352053 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0aa7f0 con 0x7f6f1815d1d0 2024-09-19T05:47:27.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 -- 172.21.15.67:0/2772352053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815d1d0 msgr2=0x7f6f180b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:27.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 --2- 172.21.15.67:0/2772352053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815d1d0 0x7f6f180b2fd0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009870 tx=0x7f6f0c01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 -- 172.21.15.67:0/2772352053 shutdown_connections 2024-09-19T05:47:27.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 --2- 172.21.15.67:0/2772352053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815d1d0 0x7f6f180b2fd0 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 --2- 172.21.15.67:0/2772352053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f1815c030 0x7f6f1806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 -- 172.21.15.67:0/2772352053 >> 172.21.15.67:0/2772352053 conn(0x7f6f180d0080 msgr2=0x7f6f180d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:27.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 -- 172.21.15.67:0/2772352053 shutdown_connections 2024-09-19T05:47:27.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 -- 172.21.15.67:0/2772352053 wait complete. 2024-09-19T05:47:27.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 Processor -- start 2024-09-19T05:47:27.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 -- start start 2024-09-19T05:47:27.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f180b3510 0x7f6f18151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815c030 0x7f6f18155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1815d1d0 0x7f6f181527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1815c590 con 0x7f6f1815c030 2024-09-19T05:47:27.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1815c410 con 0x7f6f1815d1d0 2024-09-19T05:47:27.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f1e0df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6f181690e0 con 0x7f6f180b3510 2024-09-19T05:47:27.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f16ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815c030 0x7f6f18155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f16ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815c030 0x7f6f18155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54576/0 (socket says 172.21.15.67:54576) 2024-09-19T05:47:27.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f16ffd640 1 -- 172.21.15.67:0/4200240893 learned_addr learned my addr 172.21.15.67:0/4200240893 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:27.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.991+0000 7f6f177fe640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f180b3510 0x7f6f18151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f17fff640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1815d1d0 0x7f6f181527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f16ffd640 1 -- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f180b3510 msgr2=0x7f6f18151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:27.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f16ffd640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f180b3510 0x7f6f18151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f16ffd640 1 -- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1815d1d0 msgr2=0x7f6f181527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:27.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f16ffd640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1815d1d0 0x7f6f181527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:27.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f16ffd640 1 -- 172.21.15.67:0/4200240893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f18151ed0 con 0x7f6f1815c030 2024-09-19T05:47:27.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f17fff640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1815d1d0 0x7f6f181527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:27.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f16ffd640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815c030 0x7f6f18155c70 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0ac040 tx=0x7f6f0c019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:27.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6efffff640 1 -- 172.21.15.67:0/4200240893 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0b4810 con 0x7f6f1815c030 2024-09-19T05:47:27.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6efffff640 1 -- 172.21.15.67:0/4200240893 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c0b49d0 con 0x7f6f1815c030 2024-09-19T05:47:27.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6efffff640 1 -- 172.21.15.67:0/4200240893 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0b4dc0 con 0x7f6f1815c030 2024-09-19T05:47:27.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f1e0df640 1 -- 172.21.15.67:0/4200240893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1809c550 con 0x7f6f1815c030 2024-09-19T05:47:27.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f1e0df640 1 -- 172.21.15.67:0/4200240893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f181f9170 con 0x7f6f1815c030 2024-09-19T05:47:27.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f1e0df640 1 -- 172.21.15.67:0/4200240893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f1806dde0 con 0x7f6f1815c030 2024-09-19T05:47:27.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6efffff640 1 -- 172.21.15.67:0/4200240893 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f0c0bc020 con 0x7f6f1815c030 2024-09-19T05:47:27.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6efffff640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f040678c0 0x7f6f04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:27.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6efffff640 1 -- 172.21.15.67:0/4200240893 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f6f0c1205d0 con 0x7f6f1815c030 2024-09-19T05:47:27.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.995+0000 7f6f177fe640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f040678c0 0x7f6f04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:27.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.999+0000 7f6f177fe640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f040678c0 0x7f6f04069d80 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6f18158620 tx=0x7f6f08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:27.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:27.999+0000 7f6efffff640 1 -- 172.21.15.67:0/4200240893 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6f0c0c5030 con 0x7f6f1815c030 2024-09-19T05:47:28.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.195+0000 7f6f1e0df640 1 -- 172.21.15.67:0/4200240893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f1815b6e0 con 0x7f6f1815c030 2024-09-19T05:47:28.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6efffff640 1 -- 172.21.15.67:0/4200240893 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5243 (secure 0 0 0) 0x7f6f0c016110 con 0x7f6f1815c030 2024-09-19T05:47:28.196 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:28.196 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":130,"btime":"2024-09-19T05:47:25:220670+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6974,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2737632366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737632366},{"type":"v1","addr":"172.21.15.97:6835","nonce":2737632366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3498582105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3498582105},{"type":"v1","addr":"172.21.15.97:6837","nonce":3498582105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":130,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:46:55.745812+0000","modified":"2024-09-19T05:47:25.220626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10026":{"gid":10026,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/558917076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":558917076},{"type":"v1","addr":"172.21.15.67:6833","nonce":558917076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10032":{"gid":10032,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2190010946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2190010946},{"type":"v1","addr":"172.21.15.67:6835","nonce":2190010946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10032,"qdb_cluster":[10032]},"id":12}]} 2024-09-19T05:47:28.196 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 130 2024-09-19T05:47:28.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 -- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f040678c0 msgr2=0x7f6f04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f040678c0 0x7f6f04069d80 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6f18158620 tx=0x7f6f08008040 comp rx=0 tx=0).stop 2024-09-19T05:47:28.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 -- 172.21.15.67:0/4200240893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815c030 msgr2=0x7f6f18155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815c030 0x7f6f18155c70 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0ac040 tx=0x7f6f0c019290 comp rx=0 tx=0).stop 2024-09-19T05:47:28.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 -- 172.21.15.67:0/4200240893 shutdown_connections 2024-09-19T05:47:28.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f1815d1d0 0x7f6f181527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f1815c030 0x7f6f18155c70 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6f040678c0 0x7f6f04069d80 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 --2- 172.21.15.67:0/4200240893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6f180b3510 0x7f6f18151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 -- 172.21.15.67:0/4200240893 >> 172.21.15.67:0/4200240893 conn(0x7f6f180d0080 msgr2=0x7f6f1815dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:28.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 -- 172.21.15.67:0/4200240893 shutdown_connections 2024-09-19T05:47:28.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.199+0000 7f6f1e0df640 1 -- 172.21.15.67:0/4200240893 wait complete. 2024-09-19T05:47:28.216 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:47:28.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.339+0000 7f7d1bca5640 1 Processor -- start 2024-09-19T05:47:28.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.339+0000 7f7d1bca5640 1 -- start start 2024-09-19T05:47:28.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.339+0000 7f7d1bca5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d1415e610 0x7f7d14162a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.339+0000 7f7d1bca5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d14162fb0 con 0x7f7d140cf070 2024-09-19T05:47:28.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.339+0000 7f7d1bca5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d140cf510 con 0x7f7d1415f100 2024-09-19T05:47:28.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.339+0000 7f7d1bca5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7d140d0120 con 0x7f7d1415e610 2024-09-19T05:47:28.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19240640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7d140cf070 0x7f7d1415e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45534/0 (socket says 172.21.15.67:45534) 2024-09-19T05:47:28.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19240640 1 -- 172.21.15.67:0/114447337 learned_addr learned my addr 172.21.15.67:0/114447337 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:28.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19a41640 1 --2- 172.21.15.67:0/114447337 >> v2:172.21.15.97:3300/0 conn(0x7f7d1415e610 0x7f7d14162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073235867 0 0) 0x7f7d04001120 con 0x7f7d140cf070 2024-09-19T05:47:28.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d00003530 con 0x7f7d140cf070 2024-09-19T05:47:28.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3261347731 0 0) 0x7f7d00003530 con 0x7f7d140cf070 2024-09-19T05:47:28.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 >> v2:172.21.15.97:3300/0 conn(0x7f7d1415e610 msgr2=0x7f7d14162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:28.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 --2- 172.21.15.67:0/114447337 >> v2:172.21.15.97:3300/0 conn(0x7f7d1415e610 0x7f7d14162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 >> v1:172.21.15.97:6789/0 conn(0x7f7d1415f100 legacy=0x7f7d140d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d140cf7f0 con 0x7f7d140cf070 2024-09-19T05:47:28.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7d04001850 con 0x7f7d140cf070 2024-09-19T05:47:28.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 >> v1:172.21.15.67:6789/0 conn(0x7f7d140cf070 legacy=0x7f7d1415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d000039c0 0x7f7d00003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 0x7f7d00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d000051d0 0x7f7d0000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140d0120 con 0x7f7d00004810 2024-09-19T05:47:28.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0000c070 con 0x7f7d000039c0 2024-09-19T05:47:28.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0000c270 con 0x7f7d000051d0 2024-09-19T05:47:28.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19240640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 0x7f7d00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19a41640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d000039c0 0x7f7d00003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d1a242640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d000051d0 0x7f7d0000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19240640 1 -- 172.21.15.67:0/114447337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d000051d0 msgr2=0x7f7d0000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:28.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19240640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d000051d0 0x7f7d0000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19240640 1 -- 172.21.15.67:0/114447337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d000039c0 msgr2=0x7f7d00003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:28.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19240640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d000039c0 0x7f7d00003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19240640 1 -- 172.21.15.67:0/114447337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d00003530 con 0x7f7d00004810 2024-09-19T05:47:28.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d1a242640 1 -- 172.21.15.67:0/114447337 reap_dead start 2024-09-19T05:47:28.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d19240640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 0x7f7d00004c90 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400c4c0 tx=0x7f7d0401f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107574d9dcbfa78d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:28.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400c0e0 con 0x7f7d00004810 2024-09-19T05:47:28.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d04005b00 con 0x7f7d00004810 2024-09-19T05:47:28.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.343+0000 7f7d18a3f640 1 -- 172.21.15.67:0/114447337 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04007070 con 0x7f7d00004810 2024-09-19T05:47:28.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- 172.21.15.67:0/114447337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 msgr2=0x7f7d00004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 0x7f7d00004c90 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400c4c0 tx=0x7f7d0401f420 comp rx=0 tx=0).stop 2024-09-19T05:47:28.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- 172.21.15.67:0/114447337 shutdown_connections 2024-09-19T05:47:28.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 --2- 172.21.15.67:0/114447337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d00004810 0x7f7d00004c90 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- 172.21.15.67:0/114447337 >> 172.21.15.67:0/114447337 conn(0x7f7d1408bfc0 msgr2=0x7f7d140d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:28.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- 172.21.15.67:0/114447337 shutdown_connections 2024-09-19T05:47:28.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- 172.21.15.67:0/114447337 wait complete. 2024-09-19T05:47:28.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 Processor -- start 2024-09-19T05:47:28.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- start start 2024-09-19T05:47:28.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d00004810 0x7f7d14153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d14160ec0 0x7f7d140b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d140b2600 0x7f7d140c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1415f830 con 0x7f7d14160ec0 2024-09-19T05:47:28.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140cfdb0 con 0x7f7d00004810 2024-09-19T05:47:28.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7d14162a70 con 0x7f7d140b2600 2024-09-19T05:47:28.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d19240640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d14160ec0 0x7f7d140b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d19240640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d14160ec0 0x7f7d140b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54600/0 (socket says 172.21.15.67:54600) 2024-09-19T05:47:28.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d19240640 1 -- 172.21.15.67:0/64214713 learned_addr learned my addr 172.21.15.67:0/64214713 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:28.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d19a41640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d00004810 0x7f7d14153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1a242640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d140b2600 0x7f7d140c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d19240640 1 -- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d140b2600 msgr2=0x7f7d140c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d19240640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d140b2600 0x7f7d140c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d19240640 1 -- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d00004810 msgr2=0x7f7d14153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d19240640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d00004810 0x7f7d14153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d19240640 1 -- 172.21.15.67:0/64214713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d141608c0 con 0x7f7d14160ec0 2024-09-19T05:47:28.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d19240640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d14160ec0 0x7f7d140b20c0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f7d04026090 tx=0x7f7d00005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:28.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d0a7fc640 1 -- 172.21.15.67:0/64214713 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04001120 con 0x7f7d14160ec0 2024-09-19T05:47:28.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d0a7fc640 1 -- 172.21.15.67:0/64214713 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d040b6070 con 0x7f7d14160ec0 2024-09-19T05:47:28.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d0a7fc640 1 -- 172.21.15.67:0/64214713 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04001830 con 0x7f7d14160ec0 2024-09-19T05:47:28.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- 172.21.15.67:0/64214713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d140c92a0 con 0x7f7d14160ec0 2024-09-19T05:47:28.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.347+0000 7f7d1bca5640 1 -- 172.21.15.67:0/64214713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d140c9860 con 0x7f7d14160ec0 2024-09-19T05:47:28.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.351+0000 7f7d1bca5640 1 -- 172.21.15.67:0/64214713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d14162da0 con 0x7f7d14160ec0 2024-09-19T05:47:28.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.351+0000 7f7d0a7fc640 1 -- 172.21.15.67:0/64214713 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d040047f0 con 0x7f7d14160ec0 2024-09-19T05:47:28.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.351+0000 7f7d0a7fc640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7cf80678c0 0x7f7cf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.351+0000 7f7d0a7fc640 1 -- 172.21.15.67:0/64214713 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f7d04123380 con 0x7f7d14160ec0 2024-09-19T05:47:28.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.351+0000 7f7d19a41640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7cf80678c0 0x7f7cf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.351+0000 7f7d19a41640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7cf80678c0 0x7f7cf8069d80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009ab0 tx=0x7f7d10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:28.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.355+0000 7f7d0a7fc640 1 -- 172.21.15.67:0/64214713 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7d14162fb0 con 0x7f7d14160ec0 2024-09-19T05:47:28.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.559+0000 7f7d1bca5640 1 -- 172.21.15.67:0/64214713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d140b29e0 con 0x7f7d14160ec0 2024-09-19T05:47:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d0a7fc640 1 -- 172.21.15.67:0/64214713 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5243 (secure 0 0 0) 0x7f7d040f3c00 con 0x7f7d14160ec0 2024-09-19T05:47:28.560 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:28.560 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":130,"btime":"2024-09-19T05:47:25:220670+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6974,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2737632366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737632366},{"type":"v1","addr":"172.21.15.97:6835","nonce":2737632366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3498582105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3498582105},{"type":"v1","addr":"172.21.15.97:6837","nonce":3498582105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":130,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:46:55.745812+0000","modified":"2024-09-19T05:47:25.220626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10026":{"gid":10026,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/558917076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":558917076},{"type":"v1","addr":"172.21.15.67:6833","nonce":558917076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10032":{"gid":10032,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2190010946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2190010946},{"type":"v1","addr":"172.21.15.67:6835","nonce":2190010946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10032,"qdb_cluster":[10032]},"id":12}]} 2024-09-19T05:47:28.560 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 130 2024-09-19T05:47:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 -- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7cf80678c0 msgr2=0x7f7cf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7cf80678c0 0x7f7cf8069d80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009ab0 tx=0x7f7d10008040 comp rx=0 tx=0).stop 2024-09-19T05:47:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 -- 172.21.15.67:0/64214713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d14160ec0 msgr2=0x7f7d140b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d14160ec0 0x7f7d140b20c0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f7d04026090 tx=0x7f7d00005840 comp rx=0 tx=0).stop 2024-09-19T05:47:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 -- 172.21.15.67:0/64214713 shutdown_connections 2024-09-19T05:47:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7cf80678c0 0x7f7cf8069d80 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d140b2600 0x7f7d140c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d14160ec0 0x7f7d140b20c0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 --2- 172.21.15.67:0/64214713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d00004810 0x7f7d14153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 -- 172.21.15.67:0/64214713 >> 172.21.15.67:0/64214713 conn(0x7f7d1408bfc0 msgr2=0x7f7d1415d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 -- 172.21.15.67:0/64214713 shutdown_connections 2024-09-19T05:47:28.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.563+0000 7f7d1bca5640 1 -- 172.21.15.67:0/64214713 wait complete. 2024-09-19T05:47:28.580 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:47:28.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff226a93640 1 Processor -- start 2024-09-19T05:47:28.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff226a93640 1 -- start start 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff226a93640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220072590 0x7ff220166050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff226a93640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2200b3860 con 0x7ff2200b4900 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff226a93640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2200b3b40 con 0x7ff22015b1e0 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff226a93640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff22015b5c0 con 0x7ff220072590 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff217fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff2200b4900 0x7ff220071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45536/0 (socket says 172.21.15.67:45536) 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff217fff640 1 -- 172.21.15.67:0/2010340971 learned_addr learned my addr 172.21.15.67:0/2010340971 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff225030640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220072590 0x7ff220166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280256791 0 0) 0x7ff2200b3860 con 0x7ff2200b4900 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff208003530 con 0x7ff2200b4900 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3032586183 0 0) 0x7ff208003530 con 0x7ff2200b4900 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220072590 msgr2=0x7ff220166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220072590 0x7ff220166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 >> v1:172.21.15.97:6789/0 conn(0x7ff22015b1e0 legacy=0x7ff2200b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2200b3e20 con 0x7ff2200b4900 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7ff21c001680 con 0x7ff2200b4900 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 >> v1:172.21.15.67:6789/0 conn(0x7ff2200b4900 legacy=0x7ff220071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2080039f0 0x7ff208003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220072590 0x7ff208004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff208004d50 0x7ff2080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff22015b5c0 con 0x7ff208004d50 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff20800bab0 con 0x7ff2080039f0 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff20800bcb0 con 0x7ff220072590 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff225030640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff208004d50 0x7ff2080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff217fff640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220072590 0x7ff208004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff22482f640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2080039f0 0x7ff208003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff225030640 1 -- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220072590 msgr2=0x7ff208004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff225030640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220072590 0x7ff208004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff225030640 1 -- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2080039f0 msgr2=0x7ff208003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff225030640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2080039f0 0x7ff208003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.703+0000 7ff225030640 1 -- 172.21.15.67:0/2010340971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff208003530 con 0x7ff208004d50 2024-09-19T05:47:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff225030640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff208004d50 0x7ff2080051d0 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7ff218009f90 tx=0x7ff21801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6394dab1f52503f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2180b2070 con 0x7ff208004d50 2024-09-19T05:47:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2180a5c50 con 0x7ff208004d50 2024-09-19T05:47:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff2177fe640 1 -- 172.21.15.67:0/2010340971 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218009c10 con 0x7ff208004d50 2024-09-19T05:47:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff226a93640 1 -- 172.21.15.67:0/2010340971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff208004d50 msgr2=0x7ff2080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff226a93640 1 --2- 172.21.15.67:0/2010340971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff208004d50 0x7ff2080051d0 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7ff218009f90 tx=0x7ff21801cc40 comp rx=0 tx=0).stop 2024-09-19T05:47:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff225030640 1 -- 172.21.15.67:0/2010340971 reap_dead start 2024-09-19T05:47:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff226a93640 1 -- 172.21.15.67:0/2010340971 shutdown_connections 2024-09-19T05:47:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff226a93640 1 -- 172.21.15.67:0/2010340971 >> 172.21.15.67:0/2010340971 conn(0x7ff2200d0080 msgr2=0x7ff2200d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff226a93640 1 -- 172.21.15.67:0/2010340971 shutdown_connections 2024-09-19T05:47:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff226a93640 1 -- 172.21.15.67:0/2010340971 wait complete. 2024-09-19T05:47:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff226a93640 1 Processor -- start 2024-09-19T05:47:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.707+0000 7ff226a93640 1 -- start start 2024-09-19T05:47:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff226a93640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff220145b20 0x7ff22015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff226a93640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220145f00 0x7ff2201489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff226a93640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff220148f30 0x7ff220146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff226a93640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff220072a20 con 0x7ff220148f30 2024-09-19T05:47:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff226a93640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff2200b43e0 con 0x7ff220145b20 2024-09-19T05:47:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff226a93640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff220072ba0 con 0x7ff220145f00 2024-09-19T05:47:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff225030640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff220148f30 0x7ff220146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff225030640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff220148f30 0x7ff220146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54618/0 (socket says 172.21.15.67:54618) 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff225030640 1 -- 172.21.15.67:0/1675576514 learned_addr learned my addr 172.21.15.67:0/1675576514 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff217fff640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220145f00 0x7ff2201489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff22482f640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff220145b20 0x7ff22015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff225030640 1 -- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220145f00 msgr2=0x7ff2201489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff225030640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220145f00 0x7ff2201489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff225030640 1 -- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff220145b20 msgr2=0x7ff22015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff225030640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff220145b20 0x7ff22015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff225030640 1 -- 172.21.15.67:0/1675576514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2201f2410 con 0x7ff220148f30 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff22482f640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff220145b20 0x7ff22015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff225030640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff220148f30 0x7ff220146f80 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7ff2180b0040 tx=0x7ff218009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff2157fa640 1 -- 172.21.15.67:0/1675576514 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2180bd070 con 0x7ff220148f30 2024-09-19T05:47:28.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff2157fa640 1 -- 172.21.15.67:0/1675576514 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2180a5a50 con 0x7ff220148f30 2024-09-19T05:47:28.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff226a93640 1 -- 172.21.15.67:0/1675576514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22014e5d0 con 0x7ff220148f30 2024-09-19T05:47:28.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff2157fa640 1 -- 172.21.15.67:0/1675576514 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2180b2040 con 0x7ff220148f30 2024-09-19T05:47:28.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff226a93640 1 -- 172.21.15.67:0/1675576514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22014eb90 con 0x7ff220148f30 2024-09-19T05:47:28.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff226a93640 1 -- 172.21.15.67:0/1675576514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff220071e80 con 0x7ff220148f30 2024-09-19T05:47:28.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff2157fa640 1 -- 172.21.15.67:0/1675576514 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2180aeb60 con 0x7ff220148f30 2024-09-19T05:47:28.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff2157fa640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff20c0678b0 0x7ff20c069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:28.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff2157fa640 1 -- 172.21.15.67:0/1675576514 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7ff21811fa30 con 0x7ff220148f30 2024-09-19T05:47:28.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.711+0000 7ff22482f640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff20c0678b0 0x7ff20c069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:28.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.715+0000 7ff22482f640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff20c0678b0 0x7ff20c069d70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff2100016e0 tx=0x7ff210009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:28.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.715+0000 7ff2157fa640 1 -- 172.21.15.67:0/1675576514 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff2201f2410 con 0x7ff220148f30 2024-09-19T05:47:28.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.883+0000 7ff226a93640 1 -- 172.21.15.67:0/1675576514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2200b4e30 con 0x7ff220148f30 2024-09-19T05:47:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff2157fa640 1 -- 172.21.15.67:0/1675576514 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) ==== 74+0+16912 (secure 0 0 0) 0x7ff218016950 con 0x7ff220148f30 2024-09-19T05:47:28.884 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:28.885 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":179,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:46:57.401001+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:46:53.433544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-19T05:46:54.721763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 -- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff20c0678b0 msgr2=0x7ff20c069d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff20c0678b0 0x7ff20c069d70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff2100016e0 tx=0x7ff210009040 comp rx=0 tx=0).stop 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 -- 172.21.15.67:0/1675576514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff220148f30 msgr2=0x7ff220146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff220148f30 0x7ff220146f80 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7ff2180b0040 tx=0x7ff218009750 comp rx=0 tx=0).stop 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 -- 172.21.15.67:0/1675576514 shutdown_connections 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff220148f30 0x7ff220146f80 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff20c0678b0 0x7ff20c069d70 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff220145f00 0x7ff2201489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 --2- 172.21.15.67:0/1675576514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff220145b20 0x7ff22015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 -- 172.21.15.67:0/1675576514 >> 172.21.15.67:0/1675576514 conn(0x7ff2200d0080 msgr2=0x7ff22015d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 -- 172.21.15.67:0/1675576514 shutdown_connections 2024-09-19T05:47:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:28.887+0000 7ff226a93640 1 -- 172.21.15.67:0/1675576514 wait complete. 2024-09-19T05:47:28.905 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:47:28.905 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:47:29.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.031+0000 7f3e6c51b640 1 Processor -- start 2024-09-19T05:47:29.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.031+0000 7f3e6c51b640 1 -- start start 2024-09-19T05:47:29.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6c51b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e640b4900 0x7f3e64071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6c51b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3e640723c0 0x7f3e64072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6c51b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e640b3860 con 0x7f3e6415b1e0 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6c51b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3e6415b5c0 con 0x7f3e640723c0 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6c51b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e640b3b40 con 0x7f3e640b4900 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6a2b7640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3e6415b1e0 0x7f3e640b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45540/0 (socket says 172.21.15.67:45540) 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6a2b7640 1 -- 172.21.15.67:0/1420823603 learned_addr learned my addr 172.21.15.67:0/1420823603 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6aab8640 1 --2- 172.21.15.67:0/1420823603 >> v2:172.21.15.97:3300/0 conn(0x7f3e640723c0 0x7f3e64072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e69ab6640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e640b4900 0x7f3e64071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2796129261 0 0) 0x7f3e640b3860 con 0x7f3e6415b1e0 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e50003530 con 0x7f3e6415b1e0 2024-09-19T05:47:29.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3774542311 0 0) 0x7f3e50003530 con 0x7f3e6415b1e0 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e640b4900 msgr2=0x7f3e64071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e640b4900 0x7f3e64071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 >> v2:172.21.15.97:3300/0 conn(0x7f3e640723c0 msgr2=0x7f3e64072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 --2- 172.21.15.67:0/1420823603 >> v2:172.21.15.97:3300/0 conn(0x7f3e640723c0 0x7f3e64072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e640b3e20 con 0x7f3e6415b1e0 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3e60001680 con 0x7f3e6415b1e0 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e69ab6640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e640b4900 0x7f3e64071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 >> v1:172.21.15.67:6789/0 conn(0x7f3e6415b1e0 legacy=0x7f3e640b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e640b4900 0x7f3e500039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 0x7f3e50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e50004d50 0x7f3e500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6415b5c0 con 0x7f3e50003f00 2024-09-19T05:47:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e640b3b40 con 0x7f3e50004d50 2024-09-19T05:47:29.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5000b9d0 con 0x7f3e640b4900 2024-09-19T05:47:29.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6aab8640 1 --2- 172.21.15.67:0/1420823603 >> v2:172.21.15.97:3300/0 conn(0x7f3e640723c0 0x7f3e64072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:47:29.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e69ab6640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 0x7f3e50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6a2b7640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e640b4900 0x7f3e500039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e6aab8640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e50004d50 0x7f3e500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e69ab6640 1 -- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e640b4900 msgr2=0x7f3e500039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:29.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e69ab6640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e640b4900 0x7f3e500039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e69ab6640 1 -- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e50004d50 msgr2=0x7f3e500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:29.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e69ab6640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e50004d50 0x7f3e500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.035+0000 7f3e69ab6640 1 -- 172.21.15.67:0/1420823603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e50003530 con 0x7f3e50003f00 2024-09-19T05:47:29.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e69ab6640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 0x7f3e50004810 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009cb0 tx=0x7f3e5401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528af6d4787b7231 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e540b2070 con 0x7f3e50003f00 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e540a57c0 con 0x7f3e50003f00 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e692b5640 1 -- 172.21.15.67:0/1420823603 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e54009880 con 0x7f3e50003f00 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 -- 172.21.15.67:0/1420823603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 msgr2=0x7f3e50004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 --2- 172.21.15.67:0/1420823603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 0x7f3e50004810 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009cb0 tx=0x7f3e5401cc10 comp rx=0 tx=0).stop 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6aab8640 1 -- 172.21.15.67:0/1420823603 reap_dead start 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 -- 172.21.15.67:0/1420823603 shutdown_connections 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 -- 172.21.15.67:0/1420823603 >> 172.21.15.67:0/1420823603 conn(0x7f3e640d0080 msgr2=0x7f3e640d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 -- 172.21.15.67:0/1420823603 shutdown_connections 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 -- 172.21.15.67:0/1420823603 wait complete. 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 Processor -- start 2024-09-19T05:47:29.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 -- start start 2024-09-19T05:47:29.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 0x7f3e64099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e64147920 0x7f3e64147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e6415d020 0x7f3e6415d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e64071e80 con 0x7f3e50003f00 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e640b43e0 con 0x7f3e64147920 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6c51b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e64072000 con 0x7f3e6415d020 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.039+0000 7f3e6a2b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 0x7f3e64099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6a2b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 0x7f3e64099520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54628/0 (socket says 172.21.15.67:54628) 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6a2b7640 1 -- 172.21.15.67:0/3803343352 learned_addr learned my addr 172.21.15.67:0/3803343352 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6aab8640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e6415d020 0x7f3e6415d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e69ab6640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e64147920 0x7f3e64147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6a2b7640 1 -- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e6415d020 msgr2=0x7f3e6415d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6a2b7640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e6415d020 0x7f3e6415d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6a2b7640 1 -- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e64147920 msgr2=0x7f3e64147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6a2b7640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e64147920 0x7f3e64147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6a2b7640 1 -- 172.21.15.67:0/3803343352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e64143ea0 con 0x7f3e50003f00 2024-09-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e69ab6640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e64147920 0x7f3e64147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6a2b7640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 0x7f3e64099520 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f3e600118b0 tx=0x7f3e60011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e5affd640 1 -- 172.21.15.67:0/3803343352 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60010040 con 0x7f3e50003f00 2024-09-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e5affd640 1 -- 172.21.15.67:0/3803343352 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6001a070 con 0x7f3e50003f00 2024-09-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6c51b640 1 -- 172.21.15.67:0/3803343352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e64144180 con 0x7f3e50003f00 2024-09-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e5affd640 1 -- 172.21.15.67:0/3803343352 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000fda0 con 0x7f3e50003f00 2024-09-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6c51b640 1 -- 172.21.15.67:0/3803343352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e64144740 con 0x7f3e50003f00 2024-09-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e6c51b640 1 -- 172.21.15.67:0/3803343352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e64072850 con 0x7f3e50003f00 2024-09-19T05:47:29.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e5affd640 1 -- 172.21.15.67:0/3803343352 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e6001f460 con 0x7f3e50003f00 2024-09-19T05:47:29.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e5affd640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 0x7f3e48069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e5affd640 1 -- 172.21.15.67:0/3803343352 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f3e60089120 con 0x7f3e50003f00 2024-09-19T05:47:29.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e69ab6640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 0x7f3e48069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.043+0000 7f3e69ab6640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 0x7f3e48069db0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3e540af000 tx=0x7f3e540046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:29.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.047+0000 7f3e5affd640 1 -- 172.21.15.67:0/3803343352 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3e60059ad0 con 0x7f3e50003f00 2024-09-19T05:47:29.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.247+0000 7f3e6c51b640 1 -- 172.21.15.67:0/3803343352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e640b4e30 con 0x7f3e50003f00 2024-09-19T05:47:29.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.247+0000 7f3e5affd640 1 -- 172.21.15.67:0/3803343352 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5243 (secure 0 0 0) 0x7f3e600593d0 con 0x7f3e50003f00 2024-09-19T05:47:29.246 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:29.246 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":130,"btime":"2024-09-19T05:47:25:220670+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6974,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2737632366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737632366},{"type":"v1","addr":"172.21.15.97:6835","nonce":2737632366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3498582105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3498582105},{"type":"v1","addr":"172.21.15.97:6837","nonce":3498582105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":130,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:46:55.745812+0000","modified":"2024-09-19T05:47:25.220626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10026":{"gid":10026,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/558917076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":558917076},{"type":"v1","addr":"172.21.15.67:6833","nonce":558917076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10032":{"gid":10032,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2190010946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2190010946},{"type":"v1","addr":"172.21.15.67:6835","nonce":2190010946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10032,"qdb_cluster":[10032]},"id":12}]} 2024-09-19T05:47:29.247 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 130 2024-09-19T05:47:29.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 -- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 msgr2=0x7f3e48069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 0x7f3e48069db0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3e540af000 tx=0x7f3e540046d0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 -- 172.21.15.67:0/3803343352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 msgr2=0x7f3e64099520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 0x7f3e64099520 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f3e600118b0 tx=0x7f3e60011d70 comp rx=0 tx=0).stop 2024-09-19T05:47:29.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 -- 172.21.15.67:0/3803343352 shutdown_connections 2024-09-19T05:47:29.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 0x7f3e48069db0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e6415d020 0x7f3e6415d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e64147920 0x7f3e64147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 --2- 172.21.15.67:0/3803343352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e50003f00 0x7f3e64099520 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 -- 172.21.15.67:0/3803343352 >> 172.21.15.67:0/3803343352 conn(0x7f3e640d0080 msgr2=0x7f3e641578c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:29.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 -- 172.21.15.67:0/3803343352 shutdown_connections 2024-09-19T05:47:29.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.251+0000 7f3e6c51b640 1 -- 172.21.15.67:0/3803343352 wait complete. 2024-09-19T05:47:29.265 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:47:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2aa3da640 1 Processor -- start 2024-09-19T05:47:29.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2aa3da640 1 -- start start 2024-09-19T05:47:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2aa3da640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2a415c030 0x7fc2a406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2aa3da640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc2a406f460 0x7fc2a406f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2aa3da640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a406e3c0 con 0x7fc2a415d1d0 2024-09-19T05:47:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2aa3da640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc2a406e6a0 con 0x7fc2a415c030 2024-09-19T05:47:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2aa3da640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc2a406e980 con 0x7fc2a406f460 2024-09-19T05:47:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2a3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2a415c030 0x7fc2a406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2a37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc2a415d1d0 0x7fc2a40b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45546/0 (socket says 172.21.15.67:45546) 2024-09-19T05:47:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2a37fe640 1 -- 172.21.15.67:0/2221525400 learned_addr learned my addr 172.21.15.67:0/2221525400 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2a8977640 1 --2- 172.21.15.67:0/2221525400 >> v2:172.21.15.97:3300/0 conn(0x7fc2a406f460 0x7fc2a406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2a2ffd640 1 -- 172.21.15.67:0/2221525400 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620241260 0 0) 0x7fc2a406e3c0 con 0x7fc2a415d1d0 2024-09-19T05:47:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2a2ffd640 1 -- 172.21.15.67:0/2221525400 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc28c003530 con 0x7fc2a415d1d0 2024-09-19T05:47:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2a3fff640 1 -- 172.21.15.67:0/2221525400 >> v2:172.21.15.97:3300/0 conn(0x7fc2a406f460 msgr2=0x7fc2a406f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2a3fff640 1 --2- 172.21.15.67:0/2221525400 >> v2:172.21.15.97:3300/0 conn(0x7fc2a406f460 0x7fc2a406f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2a3fff640 1 -- 172.21.15.67:0/2221525400 >> v1:172.21.15.67:6789/0 conn(0x7fc2a415d1d0 legacy=0x7fc2a40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.387+0000 7fc2a3fff640 1 -- 172.21.15.67:0/2221525400 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a406ec60 con 0x7fc2a415c030 2024-09-19T05:47:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a3fff640 1 --2- 172.21.15.67:0/2221525400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 0x7fc2a406dde0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40afbf0 tx=0x7fc29401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81eaaf42a5bf65a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a2ffd640 1 -- 172.21.15.67:0/2221525400 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940b0070 con 0x7fc2a415c030 2024-09-19T05:47:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a2ffd640 1 -- 172.21.15.67:0/2221525400 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2940ab600 con 0x7fc2a415c030 2024-09-19T05:47:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a2ffd640 1 -- 172.21.15.67:0/2221525400 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940ab9d0 con 0x7fc2a415c030 2024-09-19T05:47:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2221525400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 msgr2=0x7fc2a406dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 --2- 172.21.15.67:0/2221525400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 0x7fc2a406dde0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40afbf0 tx=0x7fc29401c480 comp rx=0 tx=0).stop 2024-09-19T05:47:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2221525400 shutdown_connections 2024-09-19T05:47:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 --2- 172.21.15.67:0/2221525400 >> v2:172.21.15.97:3300/0 conn(0x7fc2a406f460 0x7fc2a406f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 --2- 172.21.15.67:0/2221525400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 0x7fc2a406dde0 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2221525400 >> 172.21.15.67:0/2221525400 conn(0x7fc2a40d0080 msgr2=0x7fc2a40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2221525400 shutdown_connections 2024-09-19T05:47:29.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2221525400 wait complete. 2024-09-19T05:47:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 Processor -- start 2024-09-19T05:47:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- start start 2024-09-19T05:47:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2a406f460 0x7fc2a414f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 0x7fc2a409db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2a415d1d0 0x7fc2a4155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a415c590 con 0x7fc2a415c030 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a415c410 con 0x7fc2a406f460 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a41690e0 con 0x7fc2a415d1d0 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 0x7fc2a409db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 0x7fc2a409db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54646/0 (socket says 172.21.15.67:54646) 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a37fe640 1 -- 172.21.15.67:0/2834230722 learned_addr learned my addr 172.21.15.67:0/2834230722 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a37fe640 1 -- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2a415d1d0 msgr2=0x7fc2a4155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a37fe640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2a415d1d0 0x7fc2a4155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a37fe640 1 -- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2a406f460 msgr2=0x7fc2a414f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a37fe640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2a406f460 0x7fc2a414f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a37fe640 1 -- 172.21.15.67:0/2834230722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a409e080 con 0x7fc2a415c030 2024-09-19T05:47:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a37fe640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 0x7fc2a409db40 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c3f0 tx=0x7fc29800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a0ff9640 1 -- 172.21.15.67:0/2834230722 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298017070 con 0x7fc2a415c030 2024-09-19T05:47:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a0ff9640 1 -- 172.21.15.67:0/2834230722 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc298005cf0 con 0x7fc2a415c030 2024-09-19T05:47:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2a0ff9640 1 -- 172.21.15.67:0/2834230722 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2980072f0 con 0x7fc2a415c030 2024-09-19T05:47:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2834230722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a4152d90 con 0x7fc2a415c030 2024-09-19T05:47:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.391+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2834230722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a4153350 con 0x7fc2a415c030 2024-09-19T05:47:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.395+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2834230722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a406f870 con 0x7fc2a415c030 2024-09-19T05:47:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.395+0000 7fc2a0ff9640 1 -- 172.21.15.67:0/2834230722 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc29801a070 con 0x7fc2a415c030 2024-09-19T05:47:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.395+0000 7fc2a0ff9640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2900678c0 0x7fc290069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.395+0000 7fc2a0ff9640 1 -- 172.21.15.67:0/2834230722 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7fc2980851e0 con 0x7fc2a415c030 2024-09-19T05:47:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.395+0000 7fc2a3fff640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2900678c0 0x7fc290069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.395+0000 7fc2a3fff640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2900678c0 0x7fc290069d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc2940ad000 tx=0x7fc294004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:29.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.399+0000 7fc2a0ff9640 1 -- 172.21.15.67:0/2834230722 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc298055c20 con 0x7fc2a415c030 2024-09-19T05:47:29.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.603+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2834230722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2a40d0f20 con 0x7fc2a415c030 2024-09-19T05:47:29.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.603+0000 7fc2a0ff9640 1 -- 172.21.15.67:0/2834230722 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5243 (secure 0 0 0) 0x7fc298055520 con 0x7fc2a415c030 2024-09-19T05:47:29.603 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:29.603 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":130,"btime":"2024-09-19T05:47:25:220670+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6974,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2737632366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737632366},{"type":"v1","addr":"172.21.15.97:6835","nonce":2737632366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3498582105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3498582105},{"type":"v1","addr":"172.21.15.97:6837","nonce":3498582105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":130,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:46:55.745812+0000","modified":"2024-09-19T05:47:25.220626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10032},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10026":{"gid":10026,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/558917076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":558917076},{"type":"v1","addr":"172.21.15.67:6833","nonce":558917076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10032":{"gid":10032,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2190010946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2190010946},{"type":"v1","addr":"172.21.15.67:6835","nonce":2190010946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10032,"qdb_cluster":[10032]},"id":12}]} 2024-09-19T05:47:29.603 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 130 2024-09-19T05:47:29.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2900678c0 msgr2=0x7fc290069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2900678c0 0x7fc290069d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc2940ad000 tx=0x7fc294004740 comp rx=0 tx=0).stop 2024-09-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2834230722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 msgr2=0x7fc2a409db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 0x7fc2a409db40 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c3f0 tx=0x7fc29800c8b0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2834230722 shutdown_connections 2024-09-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2900678c0 0x7fc290069d80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2a415d1d0 0x7fc2a4155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2a415c030 0x7fc2a409db40 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 --2- 172.21.15.67:0/2834230722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2a406f460 0x7fc2a414f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2834230722 >> 172.21.15.67:0/2834230722 conn(0x7fc2a40d0080 msgr2=0x7fc2a415f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2834230722 shutdown_connections 2024-09-19T05:47:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.607+0000 7fc2aa3da640 1 -- 172.21.15.67:0/2834230722 wait complete. 2024-09-19T05:47:29.622 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:47:29.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f093a85c640 1 Processor -- start 2024-09-19T05:47:29.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f093a85c640 1 -- start start 2024-09-19T05:47:29.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f093a85c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0934161da0 0x7f09340d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f093a85c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f09340d0e80 0x7f09340d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f093a85c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09340b41c0 0x7f09340b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f093a85c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f09340d1830 con 0x7f0934161da0 2024-09-19T05:47:29.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f093a85c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f09340d0840 con 0x7f09340d0e80 2024-09-19T05:47:29.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f093a85c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f09340d4d40 con 0x7f09340b41c0 2024-09-19T05:47:29.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f0933fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0934161da0 0x7f09340d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f0933fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0934161da0 0x7f09340d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54648/0 (socket says 172.21.15.67:54648) 2024-09-19T05:47:29.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f0933fff640 1 -- 172.21.15.67:0/3387205514 learned_addr learned my addr 172.21.15.67:0/3387205514 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:29.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f09337fe640 1 --2- 172.21.15.67:0/3387205514 >> v2:172.21.15.97:3300/0 conn(0x7f09340d0e80 0x7f09340d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f0938df9640 1 --2- 172.21.15.67:0/3387205514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09340b41c0 0x7f09340b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f0933fff640 1 -- 172.21.15.67:0/3387205514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09340b41c0 msgr2=0x7f09340b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:29.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f0933fff640 1 --2- 172.21.15.67:0/3387205514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09340b41c0 0x7f09340b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f0933fff640 1 -- 172.21.15.67:0/3387205514 >> v2:172.21.15.97:3300/0 conn(0x7f09340d0e80 msgr2=0x7f09340d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:29.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f0933fff640 1 --2- 172.21.15.67:0/3387205514 >> v2:172.21.15.97:3300/0 conn(0x7f09340d0e80 0x7f09340d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.743+0000 7f0933fff640 1 -- 172.21.15.67:0/3387205514 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09340d5020 con 0x7f0934161da0 2024-09-19T05:47:29.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f0933fff640 1 --2- 172.21.15.67:0/3387205514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 0x7f09340d1af0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f09340d4440 tx=0x7f092401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb445b0c1c5c8465 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:29.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f0932ffd640 1 -- 172.21.15.67:0/3387205514 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09240a5760 con 0x7f0934161da0 2024-09-19T05:47:29.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f0932ffd640 1 -- 172.21.15.67:0/3387205514 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09240a5900 con 0x7f0934161da0 2024-09-19T05:47:29.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f0932ffd640 1 -- 172.21.15.67:0/3387205514 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09240a5cd0 con 0x7f0934161da0 2024-09-19T05:47:29.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 -- 172.21.15.67:0/3387205514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 msgr2=0x7f09340d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 --2- 172.21.15.67:0/3387205514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 0x7f09340d1af0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f09340d4440 tx=0x7f092401c9f0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 -- 172.21.15.67:0/3387205514 shutdown_connections 2024-09-19T05:47:29.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 --2- 172.21.15.67:0/3387205514 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09340b41c0 0x7f09340b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 --2- 172.21.15.67:0/3387205514 >> v2:172.21.15.97:3300/0 conn(0x7f09340d0e80 0x7f09340d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 --2- 172.21.15.67:0/3387205514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 0x7f09340d1af0 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 -- 172.21.15.67:0/3387205514 >> 172.21.15.67:0/3387205514 conn(0x7f093408bfc0 msgr2=0x7f09340d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:29.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 -- 172.21.15.67:0/3387205514 shutdown_connections 2024-09-19T05:47:29.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 -- 172.21.15.67:0/3387205514 wait complete. 2024-09-19T05:47:29.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 Processor -- start 2024-09-19T05:47:29.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.747+0000 7f093a85c640 1 -- start start 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f093a85c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09340b41c0 0x7f093415f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f093a85c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09340d0e80 0x7f093414f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f093a85c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 0x7f09340b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f093a85c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f09340cf150 con 0x7f0934161da0 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f093a85c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0934162180 con 0x7f09340b41c0 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f093a85c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f09340cf2d0 con 0x7f09340d0e80 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0938df9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 0x7f09340b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0938df9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 0x7f09340b89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54662/0 (socket says 172.21.15.67:54662) 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0938df9640 1 -- 172.21.15.67:0/3558547864 learned_addr learned my addr 172.21.15.67:0/3558547864 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f09337fe640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09340d0e80 0x7f093414f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0933fff640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09340b41c0 0x7f093415f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0938df9640 1 -- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09340d0e80 msgr2=0x7f093414f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0938df9640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09340d0e80 0x7f093414f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0938df9640 1 -- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09340b41c0 msgr2=0x7f093415f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0938df9640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09340b41c0 0x7f093415f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0938df9640 1 -- 172.21.15.67:0/3558547864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09340ba1b0 con 0x7f0934161da0 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0938df9640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 0x7f09340b89c0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f092c00d580 tx=0x7f092c00da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0930ff9640 1 -- 172.21.15.67:0/3558547864 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c018020 con 0x7f0934161da0 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0930ff9640 1 -- 172.21.15.67:0/3558547864 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092c014620 con 0x7f0934161da0 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f093a85c640 1 -- 172.21.15.67:0/3558547864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09340b9110 con 0x7f0934161da0 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0930ff9640 1 -- 172.21.15.67:0/3558547864 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c014a10 con 0x7f0934161da0 2024-09-19T05:47:29.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f093a85c640 1 -- 172.21.15.67:0/3558547864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09340b96d0 con 0x7f0934161da0 2024-09-19T05:47:29.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f093a85c640 1 -- 172.21.15.67:0/3558547864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09340b4630 con 0x7f0934161da0 2024-09-19T05:47:29.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0930ff9640 1 -- 172.21.15.67:0/3558547864 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f092c01b020 con 0x7f0934161da0 2024-09-19T05:47:29.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0930ff9640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09200678c0 0x7f0920069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:29.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.751+0000 7f0930ff9640 1 -- 172.21.15.67:0/3558547864 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7f092c0862e0 con 0x7f0934161da0 2024-09-19T05:47:29.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.755+0000 7f0933fff640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09200678c0 0x7f0920069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:29.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.755+0000 7f0933fff640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09200678c0 0x7f0920069d80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f09240ae000 tx=0x7f09240a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:29.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.755+0000 7f0930ff9640 1 -- 172.21.15.67:0/3558547864 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f092c022020 con 0x7f0934161da0 2024-09-19T05:47:29.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.915+0000 7f093a85c640 1 -- 172.21.15.67:0/3558547864 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09340d2810 con 0x7f0934161da0 2024-09-19T05:47:29.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f0930ff9640 1 -- 172.21.15.67:0/3558547864 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) ==== 74+0+16912 (secure 0 0 0) 0x7f092c056c00 con 0x7f0934161da0 2024-09-19T05:47:29.916 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:29.916 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":179,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:46:57.401001+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:46:53.433544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-19T05:46:54.721763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 -- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09200678c0 msgr2=0x7f0920069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09200678c0 0x7f0920069d80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f09240ae000 tx=0x7f09240a7070 comp rx=0 tx=0).stop 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 -- 172.21.15.67:0/3558547864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 msgr2=0x7f09340b89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 0x7f09340b89c0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f092c00d580 tx=0x7f092c00da40 comp rx=0 tx=0).stop 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 -- 172.21.15.67:0/3558547864 shutdown_connections 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0934161da0 0x7f09340b89c0 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f09200678c0 0x7f0920069d80 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09340d0e80 0x7f093414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 --2- 172.21.15.67:0/3558547864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09340b41c0 0x7f093415f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 -- 172.21.15.67:0/3558547864 >> 172.21.15.67:0/3558547864 conn(0x7f093408bfc0 msgr2=0x7f0934158f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 -- 172.21.15.67:0/3558547864 shutdown_connections 2024-09-19T05:47:29.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:29.919+0000 7f093a85c640 1 -- 172.21.15.67:0/3558547864 wait complete. 2024-09-19T05:47:29.934 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:47:30.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc47119640 1 Processor -- start 2024-09-19T05:47:30.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc47119640 1 -- start start 2024-09-19T05:47:30.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc47119640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc400d1590 0x7efc400d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc47119640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc400b51d0 0x7efc400cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc47119640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc400d4d40 con 0x7efc40161da0 2024-09-19T05:47:30.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc47119640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7efc400d0840 con 0x7efc400d1590 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc47119640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efc400d5020 con 0x7efc400b51d0 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc44eb5640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7efc40161da0 0x7efc400d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45558/0 (socket says 172.21.15.67:45558) 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc44eb5640 1 -- 172.21.15.67:0/426239845 learned_addr learned my addr 172.21.15.67:0/426239845 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc456b6640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc400b51d0 0x7efc400cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242908627 0 0) 0x7efc400d4d40 con 0x7efc40161da0 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3ffff640 1 --2- 172.21.15.67:0/426239845 >> v2:172.21.15.97:3300/0 conn(0x7efc400d1590 0x7efc400d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc28003530 con 0x7efc40161da0 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2941051541 0 0) 0x7efc28003530 con 0x7efc40161da0 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc400b51d0 msgr2=0x7efc400cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc400b51d0 0x7efc400cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 >> v2:172.21.15.97:3300/0 conn(0x7efc400d1590 msgr2=0x7efc400d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 --2- 172.21.15.67:0/426239845 >> v2:172.21.15.97:3300/0 conn(0x7efc400d1590 0x7efc400d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc400d5300 con 0x7efc40161da0 2024-09-19T05:47:30.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7efc300016a0 con 0x7efc40161da0 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 >> v1:172.21.15.67:6789/0 conn(0x7efc40161da0 legacy=0x7efc400d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc280039c0 0x7efc28003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc400b51d0 0x7efc28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc28004d50 0x7efc280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efc400d0840 con 0x7efc28004d50 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efc400d5020 con 0x7efc280039c0 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efc2800b9d0 con 0x7efc400b51d0 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc456b6640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc28004d50 0x7efc280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc44eb5640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc280039c0 0x7efc28003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc3ffff640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc400b51d0 0x7efc28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc456b6640 1 -- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc400b51d0 msgr2=0x7efc28004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc456b6640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc400b51d0 0x7efc28004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc456b6640 1 -- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc280039c0 msgr2=0x7efc28003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:30.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc456b6640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc280039c0 0x7efc28003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.051+0000 7efc456b6640 1 -- 172.21.15.67:0/426239845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc28003530 con 0x7efc28004d50 2024-09-19T05:47:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc456b6640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc28004d50 0x7efc280051d0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7efc38009fd0 tx=0x7efc3801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc701c20f6d066bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380b2070 con 0x7efc28004d50 2024-09-19T05:47:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc380a5d10 con 0x7efc28004d50 2024-09-19T05:47:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc3f7fe640 1 -- 172.21.15.67:0/426239845 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38009bf0 con 0x7efc28004d50 2024-09-19T05:47:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 -- 172.21.15.67:0/426239845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc28004d50 msgr2=0x7efc280051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 --2- 172.21.15.67:0/426239845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc28004d50 0x7efc280051d0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7efc38009fd0 tx=0x7efc3801cc40 comp rx=0 tx=0).stop 2024-09-19T05:47:30.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc456b6640 1 -- 172.21.15.67:0/426239845 reap_dead start 2024-09-19T05:47:30.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 -- 172.21.15.67:0/426239845 shutdown_connections 2024-09-19T05:47:30.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 -- 172.21.15.67:0/426239845 >> 172.21.15.67:0/426239845 conn(0x7efc4008bfc0 msgr2=0x7efc400d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:30.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 -- 172.21.15.67:0/426239845 shutdown_connections 2024-09-19T05:47:30.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 -- 172.21.15.67:0/426239845 wait complete. 2024-09-19T05:47:30.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 Processor -- start 2024-09-19T05:47:30.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 -- start start 2024-09-19T05:47:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc28004d50 0x7efc4015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc400cd0f0 0x7efc400cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc400ca760 0x7efc400cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efc40162180 con 0x7efc400cd0f0 2024-09-19T05:47:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efc400b5d00 con 0x7efc400ca760 2024-09-19T05:47:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc47119640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efc400cf150 con 0x7efc28004d50 2024-09-19T05:47:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc400cd0f0 0x7efc400cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc400cd0f0 0x7efc400cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54688/0 (socket says 172.21.15.67:54688) 2024-09-19T05:47:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc3ffff640 1 -- 172.21.15.67:0/4085320025 learned_addr learned my addr 172.21.15.67:0/4085320025 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc44eb5640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc28004d50 0x7efc4015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc456b6640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc400ca760 0x7efc400cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc3ffff640 1 -- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc28004d50 msgr2=0x7efc4015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc3ffff640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc28004d50 0x7efc4015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc3ffff640 1 -- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc400ca760 msgr2=0x7efc400cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.055+0000 7efc3ffff640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc400ca760 0x7efc400cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc3ffff640 1 -- 172.21.15.67:0/4085320025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4015df80 con 0x7efc400cd0f0 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc3ffff640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc400cd0f0 0x7efc400cd550 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7efc34011660 tx=0x7efc34011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc3d7fa640 1 -- 172.21.15.67:0/4085320025 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3400f9c0 con 0x7efc400cd0f0 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc3d7fa640 1 -- 172.21.15.67:0/4085320025 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3400fb60 con 0x7efc400cd0f0 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc47119640 1 -- 172.21.15.67:0/4085320025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4015e470 con 0x7efc400cd0f0 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc3d7fa640 1 -- 172.21.15.67:0/4085320025 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34015460 con 0x7efc400cd0f0 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc47119640 1 -- 172.21.15.67:0/4085320025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc400cdf00 con 0x7efc400cd0f0 2024-09-19T05:47:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc47119640 1 -- 172.21.15.67:0/4085320025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc400d1af0 con 0x7efc400cd0f0 2024-09-19T05:47:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc3d7fa640 1 -- 172.21.15.67:0/4085320025 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc34015600 con 0x7efc400cd0f0 2024-09-19T05:47:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc3d7fa640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc2c0678c0 0x7efc2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc3d7fa640 1 -- 172.21.15.67:0/4085320025 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6101+0+0 (secure 0 0 0) 0x7efc340867e0 con 0x7efc400cd0f0 2024-09-19T05:47:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc44eb5640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc2c0678c0 0x7efc2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.059+0000 7efc44eb5640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc2c0678c0 0x7efc2c069d80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efc30000c10 tx=0x7efc30009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:30.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.063+0000 7efc3d7fa640 1 -- 172.21.15.67:0/4085320025 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7efc34019030 con 0x7efc400cd0f0 2024-09-19T05:47:30.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.263+0000 7efc47119640 1 -- 172.21.15.67:0/4085320025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7efc400cff10 con 0x7efc400cd0f0 2024-09-19T05:47:30.261 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:47:30.263+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:47:30.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.267+0000 7efc3d7fa640 1 -- 172.21.15.67:0/4085320025 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v131) ==== 161+0+0 (secure 0 0 0) 0x7efc34057220 con 0x7efc400cd0f0 2024-09-19T05:47:30.264 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:47:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.267+0000 7efc47119640 1 -- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc2c0678c0 msgr2=0x7efc2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc2c0678c0 0x7efc2c069d80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efc30000c10 tx=0x7efc30009040 comp rx=0 tx=0).stop 2024-09-19T05:47:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 -- 172.21.15.67:0/4085320025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc400cd0f0 msgr2=0x7efc400cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc400cd0f0 0x7efc400cd550 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7efc34011660 tx=0x7efc34011b20 comp rx=0 tx=0).stop 2024-09-19T05:47:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 -- 172.21.15.67:0/4085320025 shutdown_connections 2024-09-19T05:47:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc400ca760 0x7efc400cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc400cd0f0 0x7efc400cd550 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efc2c0678c0 0x7efc2c069d80 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 --2- 172.21.15.67:0/4085320025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc28004d50 0x7efc4015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 -- 172.21.15.67:0/4085320025 >> 172.21.15.67:0/4085320025 conn(0x7efc4008bfc0 msgr2=0x7efc40160a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:30.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 -- 172.21.15.67:0/4085320025 shutdown_connections 2024-09-19T05:47:30.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.271+0000 7efc47119640 1 -- 172.21.15.67:0/4085320025 wait complete. 2024-09-19T05:47:30.288 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:47:30.307 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:47:30.313 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:47:30.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abfd02640 1 Processor -- start 2024-09-19T05:47:30.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abfd02640 1 -- start start 2024-09-19T05:47:30.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abfd02640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab8159c60 0x7f1ab80ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abfd02640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ab806ffd0 0x7f1ab80aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abfd02640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1ab80b3150 0x7f1ab80af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abfd02640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1ab80af710 con 0x7f1ab806ffd0 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abfd02640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1ab815d460 con 0x7f1ab80b3150 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abfd02640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab815a040 con 0x7f1ab8159c60 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abd29d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ab806ffd0 0x7f1ab80aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abd29d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ab806ffd0 0x7f1ab80aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54738/0 (socket says 172.21.15.67:54738) 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abd29d640 1 -- 172.21.15.67:0/3084643330 learned_addr learned my addr 172.21.15.67:0/3084643330 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abd29d640 1 -- 172.21.15.67:0/3084643330 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab8159c60 msgr2=0x7f1ab80ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abe29f640 1 --2- 172.21.15.67:0/3084643330 >> v2:172.21.15.97:3300/0 conn(0x7f1ab80b3150 0x7f1ab80af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abda9e640 1 --2- 172.21.15.67:0/3084643330 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab8159c60 0x7f1ab80ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abd29d640 1 --2- 172.21.15.67:0/3084643330 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab8159c60 0x7f1ab80ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abd29d640 1 -- 172.21.15.67:0/3084643330 >> v2:172.21.15.97:3300/0 conn(0x7f1ab80b3150 msgr2=0x7f1ab80af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:30.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abd29d640 1 --2- 172.21.15.67:0/3084643330 >> v2:172.21.15.97:3300/0 conn(0x7f1ab80b3150 0x7f1ab80af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.403+0000 7f1abd29d640 1 -- 172.21.15.67:0/3084643330 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab815c850 con 0x7f1ab806ffd0 2024-09-19T05:47:30.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abd29d640 1 --2- 172.21.15.67:0/3084643330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab806ffd0 0x7f1ab80aec90 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80b2e70 tx=0x7f1ab001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33009c700e3b3ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:30.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abca9c640 1 -- 172.21.15.67:0/3084643330 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a5840 con 0x7f1ab806ffd0 2024-09-19T05:47:30.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abca9c640 1 -- 172.21.15.67:0/3084643330 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab00a59e0 con 0x7f1ab806ffd0 2024-09-19T05:47:30.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abca9c640 1 -- 172.21.15.67:0/3084643330 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a5db0 con 0x7f1ab806ffd0 2024-09-19T05:47:30.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abfd02640 1 -- 172.21.15.67:0/3084643330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab806ffd0 msgr2=0x7f1ab80aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:30.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abfd02640 1 --2- 172.21.15.67:0/3084643330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab806ffd0 0x7f1ab80aec90 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80b2e70 tx=0x7f1ab001c9c0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abfd02640 1 -- 172.21.15.67:0/3084643330 shutdown_connections 2024-09-19T05:47:30.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abfd02640 1 --2- 172.21.15.67:0/3084643330 >> v2:172.21.15.97:3300/0 conn(0x7f1ab80b3150 0x7f1ab80af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abfd02640 1 --2- 172.21.15.67:0/3084643330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab806ffd0 0x7f1ab80aec90 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abfd02640 1 --2- 172.21.15.67:0/3084643330 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab8159c60 0x7f1ab80ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abfd02640 1 -- 172.21.15.67:0/3084643330 >> 172.21.15.67:0/3084643330 conn(0x7f1ab80b1e50 msgr2=0x7f1ab80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:30.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abfd02640 1 -- 172.21.15.67:0/3084643330 shutdown_connections 2024-09-19T05:47:30.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.407+0000 7f1abfd02640 1 -- 172.21.15.67:0/3084643330 wait complete. 2024-09-19T05:47:30.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 Processor -- start 2024-09-19T05:47:30.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 -- start start 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab806ffd0 0x7f1ab814b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ab80b3150 0x7f1ab814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab8159c60 0x7f1ab806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab80ad7f0 con 0x7f1ab8159c60 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab80ad670 con 0x7f1ab80b3150 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab81605b0 con 0x7f1ab806ffd0 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abe29f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab8159c60 0x7f1ab806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abe29f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab8159c60 0x7f1ab806f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54742/0 (socket says 172.21.15.67:54742) 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abe29f640 1 -- 172.21.15.67:0/379176102 learned_addr learned my addr 172.21.15.67:0/379176102 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abd29d640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ab80b3150 0x7f1ab814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abda9e640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab806ffd0 0x7f1ab814b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abe29f640 1 -- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab806ffd0 msgr2=0x7f1ab814b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abe29f640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab806ffd0 0x7f1ab814b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abe29f640 1 -- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ab80b3150 msgr2=0x7f1ab814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abe29f640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ab80b3150 0x7f1ab814e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abe29f640 1 -- 172.21.15.67:0/379176102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab81654a0 con 0x7f1ab8159c60 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abda9e640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab806ffd0 0x7f1ab814b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abe29f640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab8159c60 0x7f1ab806f0d0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800c7f0 tx=0x7f1aa800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1ab67fc640 1 -- 172.21.15.67:0/379176102 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8015070 con 0x7f1ab8159c60 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1ab67fc640 1 -- 172.21.15.67:0/379176102 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa8004220 con 0x7f1ab8159c60 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 -- 172.21.15.67:0/379176102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab8165780 con 0x7f1ab8159c60 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1ab67fc640 1 -- 172.21.15.67:0/379176102 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8003620 con 0x7f1ab8159c60 2024-09-19T05:47:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 -- 172.21.15.67:0/379176102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab814b9f0 con 0x7f1ab8159c60 2024-09-19T05:47:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1abfd02640 1 -- 172.21.15.67:0/379176102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab8160990 con 0x7f1ab8159c60 2024-09-19T05:47:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1ab67fc640 1 -- 172.21.15.67:0/379176102 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1aa80037c0 con 0x7f1ab8159c60 2024-09-19T05:47:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.411+0000 7f1ab67fc640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aa40678c0 0x7f1aa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.415+0000 7f1ab67fc640 1 -- 172.21.15.67:0/379176102 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6187+0+0 (secure 0 0 0) 0x7f1aa8085dc0 con 0x7f1ab8159c60 2024-09-19T05:47:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.415+0000 7f1abda9e640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aa40678c0 0x7f1aa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.415+0000 7f1abda9e640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aa40678c0 0x7f1aa4069d80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1aac006fd0 tx=0x7f1aac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:30.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.419+0000 7f1ab67fc640 1 -- 172.21.15.67:0/379176102 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1aa8056740 con 0x7f1ab8159c60 2024-09-19T05:47:30.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:30.615+0000 7f1abfd02640 1 -- 172.21.15.67:0/379176102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1ab80b4210 con 0x7f1ab8159c60 2024-09-19T05:47:31.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.267+0000 7f1ab67fc640 1 -- 172.21.15.67:0/379176102 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v132) ==== 104+0+0 (secure 0 0 0) 0x7f1aa8056040 con 0x7f1ab8159c60 2024-09-19T05:47:31.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 -- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aa40678c0 msgr2=0x7f1aa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aa40678c0 0x7f1aa4069d80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1aac006fd0 tx=0x7f1aac008040 comp rx=0 tx=0).stop 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 -- 172.21.15.67:0/379176102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab8159c60 msgr2=0x7f1ab806f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab8159c60 0x7f1ab806f0d0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800c7f0 tx=0x7f1aa800ccb0 comp rx=0 tx=0).stop 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 -- 172.21.15.67:0/379176102 shutdown_connections 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab8159c60 0x7f1ab806f0d0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ab80b3150 0x7f1ab814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1aa40678c0 0x7f1aa4069d80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 --2- 172.21.15.67:0/379176102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab806ffd0 0x7f1ab814b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 -- 172.21.15.67:0/379176102 >> 172.21.15.67:0/379176102 conn(0x7f1ab80b1e50 msgr2=0x7f1ab814f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 -- 172.21.15.67:0/379176102 shutdown_connections 2024-09-19T05:47:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.271+0000 7f1abfd02640 1 -- 172.21.15.67:0/379176102 wait complete. 2024-09-19T05:47:31.292 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:47:31.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.467+0000 7ff2e61a2640 1 Processor -- start 2024-09-19T05:47:31.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.467+0000 7ff2e61a2640 1 -- start start 2024-09-19T05:47:31.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2e00d0aa0 0x7ff2e006e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:31.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff2e006eb40 0x7ff2e015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:31.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e015d030 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff2e00d0f00 con 0x7ff2e006eb40 2024-09-19T05:47:31.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e006de90 con 0x7ff2e00d0aa0 2024-09-19T05:47:31.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2df7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff2e00cf5e0 0x7ff2e015c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45570/0 (socket says 172.21.15.67:45570) 2024-09-19T05:47:31.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2df7fe640 1 -- 172.21.15.67:0/1689415524 learned_addr learned my addr 172.21.15.67:0/1689415524 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:31.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2dffff640 1 --2- 172.21.15.67:0/1689415524 >> v2:172.21.15.67:3300/0 conn(0x7ff2e006eb40 0x7ff2e015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:31.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2de7fc640 1 -- 172.21.15.67:0/1689415524 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3816126627 0 0) 0x7ff2e015d030 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2deffd640 1 --2- 172.21.15.67:0/1689415524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2e00d0aa0 0x7ff2e006e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:31.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2de7fc640 1 -- 172.21.15.67:0/1689415524 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2c8003530 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2dffff640 1 -- 172.21.15.67:0/1689415524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2e00d0aa0 msgr2=0x7ff2e006e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:31.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2dffff640 1 --2- 172.21.15.67:0/1689415524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2e00d0aa0 0x7ff2e006e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:31.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2dffff640 1 -- 172.21.15.67:0/1689415524 >> v1:172.21.15.67:6789/0 conn(0x7ff2e00cf5e0 legacy=0x7ff2e015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:31.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2dffff640 1 -- 172.21.15.67:0/1689415524 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e015d310 con 0x7ff2e006eb40 2024-09-19T05:47:31.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2dffff640 1 --2- 172.21.15.67:0/1689415524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e006eb40 0x7ff2e015d8d0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009d90 tx=0x7ff2d801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868abc4fe27c039 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:31.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2de7fc640 1 -- 172.21.15.67:0/1689415524 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80b2070 con 0x7ff2e006eb40 2024-09-19T05:47:31.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2de7fc640 1 -- 172.21.15.67:0/1689415524 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d80a5830 con 0x7ff2e006eb40 2024-09-19T05:47:31.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2de7fc640 1 -- 172.21.15.67:0/1689415524 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80a5c00 con 0x7ff2e006eb40 2024-09-19T05:47:31.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1689415524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e006eb40 msgr2=0x7ff2e015d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:31.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 --2- 172.21.15.67:0/1689415524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e006eb40 0x7ff2e015d8d0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009d90 tx=0x7ff2d801c970 comp rx=0 tx=0).stop 2024-09-19T05:47:31.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1689415524 shutdown_connections 2024-09-19T05:47:31.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 --2- 172.21.15.67:0/1689415524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e006eb40 0x7ff2e015d8d0 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:31.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 --2- 172.21.15.67:0/1689415524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2e00d0aa0 0x7ff2e006e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:31.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1689415524 >> 172.21.15.67:0/1689415524 conn(0x7ff2e006c0c0 msgr2=0x7ff2e006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:31.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1689415524 shutdown_connections 2024-09-19T05:47:31.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.471+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1689415524 wait complete. 2024-09-19T05:47:31.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 Processor -- start 2024-09-19T05:47:31.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 -- start start 2024-09-19T05:47:31.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2e006eb40 0x7ff2e014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:31.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e00cf5e0 0x7ff2e0165360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:31.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2e00d0aa0 0x7ff2e01658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:31.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e0169340 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e01691c0 con 0x7ff2e00d0aa0 2024-09-19T05:47:31.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e01694c0 con 0x7ff2e006eb40 2024-09-19T05:47:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2deffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e00cf5e0 0x7ff2e0165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2deffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e00cf5e0 0x7ff2e0165360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54772/0 (socket says 172.21.15.67:54772) 2024-09-19T05:47:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2deffd640 1 -- 172.21.15.67:0/1669148133 learned_addr learned my addr 172.21.15.67:0/1669148133 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2df7fe640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2e006eb40 0x7ff2e014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2deffd640 1 -- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2e006eb40 msgr2=0x7ff2e014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2deffd640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2e006eb40 0x7ff2e014e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2deffd640 1 -- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2e00d0aa0 msgr2=0x7ff2e01658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2dffff640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2e00d0aa0 0x7ff2e01658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2deffd640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2e00d0aa0 0x7ff2e01658a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2deffd640 1 -- 172.21.15.67:0/1669148133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e015f2f0 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2deffd640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e00cf5e0 0x7ff2e0165360 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400d5d0 tx=0x7ff2d400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2c7fff640 1 -- 172.21.15.67:0/1669148133 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4004240 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2c7fff640 1 -- 172.21.15.67:0/1669148133 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d40043e0 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1669148133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e015f5d0 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2c7fff640 1 -- 172.21.15.67:0/1669148133 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4003840 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1669148133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e015fe70 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.475+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1669148133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e015f9c0 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.479+0000 7ff2c7fff640 1 -- 172.21.15.67:0/1669148133 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2d40039e0 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.479+0000 7ff2c7fff640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 0x7ff2cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:31.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.479+0000 7ff2c7fff640 1 -- 172.21.15.67:0/1669148133 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6187+0+0 (secure 0 0 0) 0x7ff2d40861a0 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.479+0000 7ff2df7fe640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 0x7ff2cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:31.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.479+0000 7ff2df7fe640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 0x7ff2cc069d80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0007fd0 tx=0x7ff2d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:31.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.483+0000 7ff2c7fff640 1 -- 172.21.15.67:0/1669148133 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff2d401c360 con 0x7ff2e00cf5e0 2024-09-19T05:47:31.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:31.647+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1669148133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff2e015d8d0 con 0x7ff2e00cf5e0 2024-09-19T05:47:32.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.519+0000 7ff2c7fff640 1 -- 172.21.15.67:0/1669148133 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v181) ==== 181+0+0 (secure 0 0 0) 0x7ff2d4056b00 con 0x7ff2e00cf5e0 2024-09-19T05:47:32.519 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:47:32.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 msgr2=0x7ff2cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:32.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 0x7ff2cc069d80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0007fd0 tx=0x7ff2d0009040 comp rx=0 tx=0).stop 2024-09-19T05:47:32.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1669148133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e00cf5e0 msgr2=0x7ff2e0165360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e00cf5e0 0x7ff2e0165360 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400d5d0 tx=0x7ff2d400da90 comp rx=0 tx=0).stop 2024-09-19T05:47:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1669148133 shutdown_connections 2024-09-19T05:47:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2e00d0aa0 0x7ff2e01658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e00cf5e0 0x7ff2e0165360 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2cc0678c0 0x7ff2cc069d80 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 --2- 172.21.15.67:0/1669148133 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2e006eb40 0x7ff2e014e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1669148133 >> 172.21.15.67:0/1669148133 conn(0x7ff2e006c0c0 msgr2=0x7ff2e00b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1669148133 shutdown_connections 2024-09-19T05:47:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.523+0000 7ff2e61a2640 1 -- 172.21.15.67:0/1669148133 wait complete. 2024-09-19T05:47:32.549 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:47:32.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04cfb5640 1 Processor -- start 2024-09-19T05:47:32.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04cfb5640 1 -- start start 2024-09-19T05:47:32.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04cfb5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0480cf5e0 0x7fe0480d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:32.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04cfb5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe04815d8d0 0x7fe04815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04cfb5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04815d030 con 0x7fe04815c850 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04cfb5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe04806de90 con 0x7fe0480cf5e0 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04cfb5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe04806e170 con 0x7fe04815d8d0 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0480cf5e0 0x7fe0480d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0480cf5e0 0x7fe0480d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54786/0 (socket says 172.21.15.67:54786) 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04659c640 1 -- 172.21.15.67:0/359247964 learned_addr learned my addr 172.21.15.67:0/359247964 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe045d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe04815c850 0x7fe04806e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45576/0 (socket says 172.21.15.67:45576) 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe046d9d640 1 --2- 172.21.15.67:0/359247964 >> v2:172.21.15.97:3300/0 conn(0x7fe04815d8d0 0x7fe04815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04659c640 1 -- 172.21.15.67:0/359247964 >> v2:172.21.15.97:3300/0 conn(0x7fe04815d8d0 msgr2=0x7fe04815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04659c640 1 --2- 172.21.15.67:0/359247964 >> v2:172.21.15.97:3300/0 conn(0x7fe04815d8d0 0x7fe04815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04559a640 1 -- 172.21.15.67:0/359247964 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459825872 0 0) 0x7fe04815d030 con 0x7fe04815c850 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04659c640 1 -- 172.21.15.67:0/359247964 >> v1:172.21.15.67:6789/0 conn(0x7fe04815c850 legacy=0x7fe04806e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.687+0000 7fe04659c640 1 -- 172.21.15.67:0/359247964 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04815d310 con 0x7fe0480cf5e0 2024-09-19T05:47:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04659c640 1 --2- 172.21.15.67:0/359247964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0480cf5e0 0x7fe0480d0aa0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fe048156e10 tx=0x7fe03801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defe898f35fba735 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04559a640 1 -- 172.21.15.67:0/359247964 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0380ab430 con 0x7fe0480cf5e0 2024-09-19T05:47:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04559a640 1 -- 172.21.15.67:0/359247964 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0380b0070 con 0x7fe0480cf5e0 2024-09-19T05:47:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04559a640 1 -- 172.21.15.67:0/359247964 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0380ab7f0 con 0x7fe0480cf5e0 2024-09-19T05:47:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04cfb5640 1 -- 172.21.15.67:0/359247964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0480cf5e0 msgr2=0x7fe0480d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04cfb5640 1 --2- 172.21.15.67:0/359247964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0480cf5e0 0x7fe0480d0aa0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fe048156e10 tx=0x7fe03801c520 comp rx=0 tx=0).stop 2024-09-19T05:47:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04cfb5640 1 -- 172.21.15.67:0/359247964 shutdown_connections 2024-09-19T05:47:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04cfb5640 1 --2- 172.21.15.67:0/359247964 >> v2:172.21.15.97:3300/0 conn(0x7fe04815d8d0 0x7fe04815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04cfb5640 1 --2- 172.21.15.67:0/359247964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0480cf5e0 0x7fe0480d0aa0 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04cfb5640 1 -- 172.21.15.67:0/359247964 >> 172.21.15.67:0/359247964 conn(0x7fe04806c0c0 msgr2=0x7fe04806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04cfb5640 1 -- 172.21.15.67:0/359247964 shutdown_connections 2024-09-19T05:47:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04cfb5640 1 -- 172.21.15.67:0/359247964 wait complete. 2024-09-19T05:47:32.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04cfb5640 1 Processor -- start 2024-09-19T05:47:32.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.691+0000 7fe04cfb5640 1 -- start start 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04cfb5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0480cf5e0 0x7fe04813d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04cfb5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe04815c850 0x7fe04814c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04cfb5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe04815d8d0 0x7fe04814c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04cfb5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe04806ee90 con 0x7fe04815d8d0 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04cfb5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe04806ed10 con 0x7fe04815c850 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04cfb5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe048168fb0 con 0x7fe0480cf5e0 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe046d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe04815d8d0 0x7fe04814c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe046d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe04815d8d0 0x7fe04814c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54792/0 (socket says 172.21.15.67:54792) 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe046d9d640 1 -- 172.21.15.67:0/2212072394 learned_addr learned my addr 172.21.15.67:0/2212072394 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04659c640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0480cf5e0 0x7fe04813d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:32.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe045d9b640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe04815c850 0x7fe04814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe046d9d640 1 -- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0480cf5e0 msgr2=0x7fe04813d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe046d9d640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0480cf5e0 0x7fe04813d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe046d9d640 1 -- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe04815c850 msgr2=0x7fe04814c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe046d9d640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe04815c850 0x7fe04814c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe046d9d640 1 -- 172.21.15.67:0/2212072394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04813d820 con 0x7fe04815d8d0 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe046d9d640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe04815d8d0 0x7fe04814c590 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fe040007e60 tx=0x7fe04000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe036ffd640 1 -- 172.21.15.67:0/2212072394 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe040014420 con 0x7fe04815d8d0 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe036ffd640 1 -- 172.21.15.67:0/2212072394 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe040019070 con 0x7fe04815d8d0 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04cfb5640 1 -- 172.21.15.67:0/2212072394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04815e520 con 0x7fe04815d8d0 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe036ffd640 1 -- 172.21.15.67:0/2212072394 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe040014820 con 0x7fe04815d8d0 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04cfb5640 1 -- 172.21.15.67:0/2212072394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04815eae0 con 0x7fe04815d8d0 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04cfb5640 1 -- 172.21.15.67:0/2212072394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0480d0aa0 con 0x7fe04815d8d0 2024-09-19T05:47:32.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe036ffd640 1 -- 172.21.15.67:0/2212072394 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe0400149c0 con 0x7fe04815d8d0 2024-09-19T05:47:32.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe036ffd640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0280678f0 0x7fe028069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:32.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe036ffd640 1 -- 172.21.15.67:0/2212072394 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5749+0+0 (secure 0 0 0) 0x7fe0400864f0 con 0x7fe04815d8d0 2024-09-19T05:47:32.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.695+0000 7fe04659c640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0280678f0 0x7fe028069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:32.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.699+0000 7fe04659c640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0280678f0 0x7fe028069db0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe0380af000 tx=0x7fe0380a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:32.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.699+0000 7fe036ffd640 1 -- 172.21.15.67:0/2212072394 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe040057000 con 0x7fe04815d8d0 2024-09-19T05:47:32.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:32.863+0000 7fe04cfb5640 1 -- 172.21.15.67:0/2212072394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe0480b1370 con 0x7fe04815d8d0 2024-09-19T05:47:33.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.531+0000 7fe036ffd640 1 -- 172.21.15.67:0/2212072394 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v182) ==== 169+0+0 (secure 0 0 0) 0x7fe040056900 con 0x7fe04815d8d0 2024-09-19T05:47:33.529 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:47:33.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.535+0000 7fe04cfb5640 1 -- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0280678f0 msgr2=0x7fe028069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:33.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.535+0000 7fe04cfb5640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0280678f0 0x7fe028069db0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe0380af000 tx=0x7fe0380a7000 comp rx=0 tx=0).stop 2024-09-19T05:47:33.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.535+0000 7fe04cfb5640 1 -- 172.21.15.67:0/2212072394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe04815d8d0 msgr2=0x7fe04814c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:33.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.535+0000 7fe04cfb5640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe04815d8d0 0x7fe04814c590 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fe040007e60 tx=0x7fe04000e4b0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.535+0000 7fe04cfb5640 1 -- 172.21.15.67:0/2212072394 shutdown_connections 2024-09-19T05:47:33.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.535+0000 7fe04cfb5640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe04815d8d0 0x7fe04814c590 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.535+0000 7fe04cfb5640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe04815c850 0x7fe04814c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.535+0000 7fe04cfb5640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe0280678f0 0x7fe028069db0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.535+0000 7fe04cfb5640 1 --2- 172.21.15.67:0/2212072394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe0480cf5e0 0x7fe04813d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.535+0000 7fe04cfb5640 1 -- 172.21.15.67:0/2212072394 >> 172.21.15.67:0/2212072394 conn(0x7fe04806c0c0 msgr2=0x7fe04806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:33.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.539+0000 7fe04cfb5640 1 -- 172.21.15.67:0/2212072394 shutdown_connections 2024-09-19T05:47:33.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.539+0000 7fe04cfb5640 1 -- 172.21.15.67:0/2212072394 wait complete. 2024-09-19T05:47:33.563 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:47:33.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.691+0000 7f37e5e32640 1 Processor -- start 2024-09-19T05:47:33.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.691+0000 7f37e5e32640 1 -- start start 2024-09-19T05:47:33.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37e5e32640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f37e015e690 0x7f37e00d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:33.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37e5e32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 0x7f37e00d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:33.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37e5e32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37e00d13c0 0x7f37e00cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:33.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37e5e32640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f37e00d35a0 con 0x7f37e015e690 2024-09-19T05:47:33.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37e5e32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f37e00d32c0 con 0x7f37e00d13c0 2024-09-19T05:47:33.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37e5e32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f37e006d040 con 0x7f37e00d4fb0 2024-09-19T05:47:33.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37df7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f37e015e690 0x7f37e00d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37df7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f37e015e690 0x7f37e00d2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54794/0 (socket says 172.21.15.67:54794) 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37df7fe640 1 -- 172.21.15.67:0/2397236747 learned_addr learned my addr 172.21.15.67:0/2397236747 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37deffd640 1 --2- 172.21.15.67:0/2397236747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 0x7f37e00d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37df7fe640 1 -- 172.21.15.67:0/2397236747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 msgr2=0x7f37e00d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37dffff640 1 --2- 172.21.15.67:0/2397236747 >> v2:172.21.15.97:3300/0 conn(0x7f37e00d13c0 0x7f37e00cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37df7fe640 1 --2- 172.21.15.67:0/2397236747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 0x7f37e00d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37df7fe640 1 -- 172.21.15.67:0/2397236747 >> v2:172.21.15.97:3300/0 conn(0x7f37e00d13c0 msgr2=0x7f37e00cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37df7fe640 1 --2- 172.21.15.67:0/2397236747 >> v2:172.21.15.97:3300/0 conn(0x7f37e00d13c0 0x7f37e00cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37df7fe640 1 -- 172.21.15.67:0/2397236747 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e006d320 con 0x7f37e015e690 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37deffd640 1 --2- 172.21.15.67:0/2397236747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 0x7f37e00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:33.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37dffff640 1 --2- 172.21.15.67:0/2397236747 >> v2:172.21.15.97:3300/0 conn(0x7f37e00d13c0 0x7f37e00cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:33.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.695+0000 7f37df7fe640 1 --2- 172.21.15.67:0/2397236747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 0x7f37e00d2a40 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f37e00cea70 tx=0x7f37d001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3578a6d03267f3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:33.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37de7fc640 1 -- 172.21.15.67:0/2397236747 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d00a5700 con 0x7f37e015e690 2024-09-19T05:47:33.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37de7fc640 1 -- 172.21.15.67:0/2397236747 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d00a58a0 con 0x7f37e015e690 2024-09-19T05:47:33.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37de7fc640 1 -- 172.21.15.67:0/2397236747 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d00a5c70 con 0x7f37e015e690 2024-09-19T05:47:33.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 -- 172.21.15.67:0/2397236747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 msgr2=0x7f37e00d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:33.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 --2- 172.21.15.67:0/2397236747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 0x7f37e00d2a40 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f37e00cea70 tx=0x7f37d001c9f0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 -- 172.21.15.67:0/2397236747 shutdown_connections 2024-09-19T05:47:33.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 --2- 172.21.15.67:0/2397236747 >> v2:172.21.15.97:3300/0 conn(0x7f37e00d13c0 0x7f37e00cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 --2- 172.21.15.67:0/2397236747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 0x7f37e00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 --2- 172.21.15.67:0/2397236747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 0x7f37e00d2a40 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 -- 172.21.15.67:0/2397236747 >> 172.21.15.67:0/2397236747 conn(0x7f37e00d4490 msgr2=0x7f37e00d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 -- 172.21.15.67:0/2397236747 shutdown_connections 2024-09-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 -- 172.21.15.67:0/2397236747 wait complete. 2024-09-19T05:47:33.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 Processor -- start 2024-09-19T05:47:33.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 -- start start 2024-09-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37e00d13c0 0x7f37e0151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 0x7f37e00b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 0x7f37e00b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f37e006dca0 con 0x7f37e015e690 2024-09-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f37e006db20 con 0x7f37e00d13c0 2024-09-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37e5e32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f37e006de20 con 0x7f37e00d4fb0 2024-09-19T05:47:33.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37dffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 0x7f37e00b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37dffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 0x7f37e00b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54806/0 (socket says 172.21.15.67:54806) 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37dffff640 1 -- 172.21.15.67:0/1132678424 learned_addr learned my addr 172.21.15.67:0/1132678424 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37df7fe640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37e00d13c0 0x7f37e0151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.699+0000 7f37deffd640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 0x7f37e00b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37dffff640 1 -- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 msgr2=0x7f37e00b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37dffff640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 0x7f37e00b9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37dffff640 1 -- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37e00d13c0 msgr2=0x7f37e0151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37dffff640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37e00d13c0 0x7f37e0151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37dffff640 1 -- 172.21.15.67:0/1132678424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e00cb7b0 con 0x7f37e015e690 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37deffd640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 0x7f37e00b9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37dffff640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 0x7f37e00b49b0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c7f0 tx=0x7f37d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:33.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37c7fff640 1 -- 172.21.15.67:0/1132678424 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8015070 con 0x7f37e015e690 2024-09-19T05:47:33.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37c7fff640 1 -- 172.21.15.67:0/1132678424 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8007860 con 0x7f37e015e690 2024-09-19T05:47:33.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37e5e32640 1 -- 172.21.15.67:0/1132678424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e00cba90 con 0x7f37e015e690 2024-09-19T05:47:33.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37c7fff640 1 -- 172.21.15.67:0/1132678424 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8007c50 con 0x7f37e015e690 2024-09-19T05:47:33.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37e5e32640 1 -- 172.21.15.67:0/1132678424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e0151850 con 0x7f37e015e690 2024-09-19T05:47:33.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37e5e32640 1 -- 172.21.15.67:0/1132678424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e00d0e80 con 0x7f37e015e690 2024-09-19T05:47:33.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37c7fff640 1 -- 172.21.15.67:0/1132678424 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37d8018070 con 0x7f37e015e690 2024-09-19T05:47:33.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37c7fff640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37cc0678c0 0x7f37cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:33.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37c7fff640 1 -- 172.21.15.67:0/1132678424 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7f37d8085c30 con 0x7f37e015e690 2024-09-19T05:47:33.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37df7fe640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37cc0678c0 0x7f37cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:33.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.703+0000 7f37df7fe640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37cc0678c0 0x7f37cc069d80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f37d00ae000 tx=0x7f37d00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:33.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.707+0000 7f37c7fff640 1 -- 172.21.15.67:0/1132678424 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f37d8056290 con 0x7f37e015e690 2024-09-19T05:47:33.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.871+0000 7f37e5e32640 1 -- 172.21.15.67:0/1132678424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f37e00d0ba0 con 0x7f37e015e690 2024-09-19T05:47:33.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.875+0000 7f37c7fff640 1 -- 172.21.15.67:0/1132678424 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7f37d805a590 con 0x7f37e015e690 2024-09-19T05:47:33.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 -- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37cc0678c0 msgr2=0x7f37cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:33.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37cc0678c0 0x7f37cc069d80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f37d00ae000 tx=0x7f37d00a7070 comp rx=0 tx=0).stop 2024-09-19T05:47:33.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 -- 172.21.15.67:0/1132678424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 msgr2=0x7f37e00b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:33.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 0x7f37e00b49b0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c7f0 tx=0x7f37d800ccb0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 -- 172.21.15.67:0/1132678424 shutdown_connections 2024-09-19T05:47:33.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37e015e690 0x7f37e00b49b0 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f37cc0678c0 0x7f37cc069d80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37e00d4fb0 0x7f37e00b9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 --2- 172.21.15.67:0/1132678424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37e00d13c0 0x7f37e0151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:33.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 -- 172.21.15.67:0/1132678424 >> 172.21.15.67:0/1132678424 conn(0x7f37e00d4490 msgr2=0x7f37e00d4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:33.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 -- 172.21.15.67:0/1132678424 shutdown_connections 2024-09-19T05:47:33.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:33.879+0000 7f37e5e32640 1 -- 172.21.15.67:0/1132678424 wait complete. 2024-09-19T05:47:33.896 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-19T05:47:34.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.031+0000 7fb5d5949640 1 Processor -- start 2024-09-19T05:47:34.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.031+0000 7fb5d5949640 1 -- start start 2024-09-19T05:47:34.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.031+0000 7fb5d5949640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5d00b2fd0 0x7fb5d006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.031+0000 7fb5d5949640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d00b4420 con 0x7fb5d00726b0 2024-09-19T05:47:34.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.031+0000 7fb5d5949640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d00b4140 con 0x7fb5d015e330 2024-09-19T05:47:34.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.031+0000 7fb5d5949640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d00acfb0 con 0x7fb5d00b2fd0 2024-09-19T05:47:34.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cf7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb5d00726b0 0x7fb5d006ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45586/0 (socket says 172.21.15.67:45586) 2024-09-19T05:47:34.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cf7fe640 1 -- 172.21.15.67:0/169058179 learned_addr learned my addr 172.21.15.67:0/169058179 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:34.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5ce7fc640 1 --2- 172.21.15.67:0/169058179 >> v2:172.21.15.97:3300/0 conn(0x7fb5d00b2fd0 0x7fb5d006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3123155786 0 0) 0x7fb5d00b4420 con 0x7fb5d00726b0 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b8003530 con 0x7fb5d00726b0 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 781566598 0 0) 0x7fb5b8003530 con 0x7fb5d00726b0 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 >> v2:172.21.15.97:3300/0 conn(0x7fb5d00b2fd0 msgr2=0x7fb5d006e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 --2- 172.21.15.67:0/169058179 >> v2:172.21.15.97:3300/0 conn(0x7fb5d00b2fd0 0x7fb5d006e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 >> v1:172.21.15.97:6789/0 conn(0x7fb5d015e330 legacy=0x7fb5d0071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d006def0 con 0x7fb5d00726b0 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fb5c8001a00 con 0x7fb5d00726b0 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 >> v1:172.21.15.67:6789/0 conn(0x7fb5d00726b0 legacy=0x7fb5d006ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b80039c0 0x7fb5b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b8004810 0x7fb5b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80051d0 0x7fb5b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b800c040 con 0x7fb5b80051d0 2024-09-19T05:47:34.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b800c1f0 con 0x7fb5b80039c0 2024-09-19T05:47:34.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b800c3f0 con 0x7fb5b8004810 2024-09-19T05:47:34.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cf7fe640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80051d0 0x7fb5b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5ceffd640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b80039c0 0x7fb5b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5ce7fc640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b8004810 0x7fb5b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cf7fe640 1 -- 172.21.15.67:0/169058179 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b8004810 msgr2=0x7fb5b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:34.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cf7fe640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5b8004810 0x7fb5b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cf7fe640 1 -- 172.21.15.67:0/169058179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b80039c0 msgr2=0x7fb5b8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:34.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cf7fe640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b80039c0 0x7fb5b8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cf7fe640 1 -- 172.21.15.67:0/169058179 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b8003530 con 0x7fb5b80051d0 2024-09-19T05:47:34.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5ceffd640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b80039c0 0x7fb5b8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cf7fe640 1 -- 172.21.15.67:0/169058179 reap_dead start 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cf7fe640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80051d0 0x7fb5b800b9d0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0071860 tx=0x7fb5c801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8c766257310b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800a460 con 0x7fb5b80051d0 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c80ac640 con 0x7fb5b80051d0 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.035+0000 7fb5cdffb640 1 -- 172.21.15.67:0/169058179 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80aca30 con 0x7fb5b80051d0 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- 172.21.15.67:0/169058179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80051d0 msgr2=0x7fb5b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80051d0 0x7fb5b800b9d0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0071860 tx=0x7fb5c801d300 comp rx=0 tx=0).stop 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- 172.21.15.67:0/169058179 shutdown_connections 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 --2- 172.21.15.67:0/169058179 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80051d0 0x7fb5b800b9d0 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- 172.21.15.67:0/169058179 >> 172.21.15.67:0/169058179 conn(0x7fb5d00d0080 msgr2=0x7fb5d00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- 172.21.15.67:0/169058179 shutdown_connections 2024-09-19T05:47:34.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- 172.21.15.67:0/169058179 wait complete. 2024-09-19T05:47:34.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 Processor -- start 2024-09-19T05:47:34.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- start start 2024-09-19T05:47:34.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b80051d0 0x7fb5d009db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5d009a1a0 0x7fb5d009a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d014ce60 0x7fb5d014d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d015e710 con 0x7fb5d014ce60 2024-09-19T05:47:34.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d00b3ef0 con 0x7fb5b80051d0 2024-09-19T05:47:34.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d00cfcc0 con 0x7fb5d009a1a0 2024-09-19T05:47:34.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5cf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d014ce60 0x7fb5d014d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5cf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d014ce60 0x7fb5d014d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54826/0 (socket says 172.21.15.67:54826) 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5cf7fe640 1 -- 172.21.15.67:0/2747423298 learned_addr learned my addr 172.21.15.67:0/2747423298 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5ceffd640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b80051d0 0x7fb5d009db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5ce7fc640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5d009a1a0 0x7fb5d009a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5cf7fe640 1 -- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5d009a1a0 msgr2=0x7fb5d009a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5cf7fe640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5d009a1a0 0x7fb5d009a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5cf7fe640 1 -- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b80051d0 msgr2=0x7fb5d009db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5cf7fe640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b80051d0 0x7fb5d009db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5cf7fe640 1 -- 172.21.15.67:0/2747423298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d0161430 con 0x7fb5d014ce60 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5ce7fc640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5d009a1a0 0x7fb5d009a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5cf7fe640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d014ce60 0x7fb5d014d2e0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fb5c801d130 tx=0x7fb5b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5b7fff640 1 -- 172.21.15.67:0/2747423298 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8001fc0 con 0x7fb5d014ce60 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5b7fff640 1 -- 172.21.15.67:0/2747423298 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c80019c0 con 0x7fb5d014ce60 2024-09-19T05:47:34.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- 172.21.15.67:0/2747423298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d0160670 con 0x7fb5d014ce60 2024-09-19T05:47:34.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5b7fff640 1 -- 172.21.15.67:0/2747423298 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80ac9f0 con 0x7fb5d014ce60 2024-09-19T05:47:34.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.039+0000 7fb5d5949640 1 -- 172.21.15.67:0/2747423298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d0160c30 con 0x7fb5d014ce60 2024-09-19T05:47:34.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.043+0000 7fb5d5949640 1 -- 172.21.15.67:0/2747423298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d00b4bc0 con 0x7fb5d014ce60 2024-09-19T05:47:34.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.043+0000 7fb5b7fff640 1 -- 172.21.15.67:0/2747423298 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5c80b8470 con 0x7fb5d014ce60 2024-09-19T05:47:34.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.043+0000 7fb5b7fff640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5bc0678c0 0x7fb5bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.043+0000 7fb5b7fff640 1 -- 172.21.15.67:0/2747423298 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7fb5c811ffb0 con 0x7fb5d014ce60 2024-09-19T05:47:34.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.043+0000 7fb5ceffd640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5bc0678c0 0x7fb5bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.043+0000 7fb5ceffd640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5bc0678c0 0x7fb5bc069d80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb5d006a210 tx=0x7fb5c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:34.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.047+0000 7fb5b7fff640 1 -- 172.21.15.67:0/2747423298 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb5c8017010 con 0x7fb5d014ce60 2024-09-19T05:47:34.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.271+0000 7fb5d5949640 1 -- 172.21.15.67:0/2747423298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7fb5d0161ce0 con 0x7fb5d014ce60 2024-09-19T05:47:34.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.531+0000 7fb5b7fff640 1 -- 172.21.15.67:0/2747423298 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v644) ==== 159+0+0 (secure 0 0 0) 0x7fb5c80f06a0 con 0x7fb5d014ce60 2024-09-19T05:47:34.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 -- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5bc0678c0 msgr2=0x7fb5bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5bc0678c0 0x7fb5bc069d80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb5d006a210 tx=0x7fb5c0009040 comp rx=0 tx=0).stop 2024-09-19T05:47:34.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 -- 172.21.15.67:0/2747423298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d014ce60 msgr2=0x7fb5d014d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d014ce60 0x7fb5d014d2e0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fb5c801d130 tx=0x7fb5b8005840 comp rx=0 tx=0).stop 2024-09-19T05:47:34.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 -- 172.21.15.67:0/2747423298 shutdown_connections 2024-09-19T05:47:34.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d014ce60 0x7fb5d014d2e0 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5bc0678c0 0x7fb5bc069d80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5d009a1a0 0x7fb5d009a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 --2- 172.21.15.67:0/2747423298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b80051d0 0x7fb5d009db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 -- 172.21.15.67:0/2747423298 >> 172.21.15.67:0/2747423298 conn(0x7fb5d00d0080 msgr2=0x7fb5d00ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:34.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 -- 172.21.15.67:0/2747423298 shutdown_connections 2024-09-19T05:47:34.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.535+0000 7fb5d5949640 1 -- 172.21.15.67:0/2747423298 wait complete. 2024-09-19T05:47:34.553 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-19T05:47:34.554 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-19T05:47:34.554 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:47:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15e5ff8640 1 Processor -- start 2024-09-19T05:47:34.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15e5ff8640 1 -- start start 2024-09-19T05:47:34.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15e5ff8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f15e0161da0 0x7f15e00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15e5ff8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e00d05d0 con 0x7f15e00d0160 2024-09-19T05:47:34.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15e5ff8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e00d4d40 con 0x7f15e00d0e80 2024-09-19T05:47:34.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15e5ff8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f15e00d0840 con 0x7f15e0161da0 2024-09-19T05:47:34.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15dffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f15e00d0160 0x7f15e00b48d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:45596/0 (socket says 172.21.15.67:45596) 2024-09-19T05:47:34.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15dffff640 1 -- 172.21.15.67:0/2772391824 learned_addr learned my addr 172.21.15.67:0/2772391824 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:34.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15df7fe640 1 --2- 172.21.15.67:0/2772391824 >> v2:172.21.15.67:3300/0 conn(0x7f15e0161da0 0x7f15e00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15deffd640 1 -- 172.21.15.67:0/2772391824 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211251092 0 0) 0x7f15e00d05d0 con 0x7f15e00d0160 2024-09-19T05:47:34.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15deffd640 1 -- 172.21.15.67:0/2772391824 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15cc003530 con 0x7f15e00d0160 2024-09-19T05:47:34.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15df7fe640 1 -- 172.21.15.67:0/2772391824 >> v1:172.21.15.97:6789/0 conn(0x7f15e00d0e80 legacy=0x7f15e00b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15df7fe640 1 -- 172.21.15.67:0/2772391824 >> v1:172.21.15.67:6789/0 conn(0x7f15e00d0160 legacy=0x7f15e00b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.679+0000 7f15df7fe640 1 -- 172.21.15.67:0/2772391824 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e00d5020 con 0x7f15e0161da0 2024-09-19T05:47:34.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15df7fe640 1 --2- 172.21.15.67:0/2772391824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 0x7f15e00d1af0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f15d00097c0 tx=0x7f15d001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd13c657e639c049 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:34.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15deffd640 1 -- 172.21.15.67:0/2772391824 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d00b1070 con 0x7f15e0161da0 2024-09-19T05:47:34.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15deffd640 1 -- 172.21.15.67:0/2772391824 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d00ac5f0 con 0x7f15e0161da0 2024-09-19T05:47:34.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15deffd640 1 -- 172.21.15.67:0/2772391824 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d00ac9c0 con 0x7f15e0161da0 2024-09-19T05:47:34.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 -- 172.21.15.67:0/2772391824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 msgr2=0x7f15e00d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 --2- 172.21.15.67:0/2772391824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 0x7f15e00d1af0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f15d00097c0 tx=0x7f15d001c4a0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 -- 172.21.15.67:0/2772391824 shutdown_connections 2024-09-19T05:47:34.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 --2- 172.21.15.67:0/2772391824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 0x7f15e00d1af0 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 -- 172.21.15.67:0/2772391824 >> 172.21.15.67:0/2772391824 conn(0x7f15e008bfc0 msgr2=0x7f15e00d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:34.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 -- 172.21.15.67:0/2772391824 shutdown_connections 2024-09-19T05:47:34.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 -- 172.21.15.67:0/2772391824 wait complete. 2024-09-19T05:47:34.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 Processor -- start 2024-09-19T05:47:34.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 -- start start 2024-09-19T05:47:34.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15e00d0160 0x7f15e00b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15e00d0e80 0x7f15e014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 0x7f15e00b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0162180 con 0x7f15e0161da0 2024-09-19T05:47:34.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f15e00b53f0 con 0x7f15e00d0e80 2024-09-19T05:47:34.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15e5ff8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f15e00d16a0 con 0x7f15e00d0160 2024-09-19T05:47:34.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15dffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 0x7f15e00b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15dffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 0x7f15e00b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54830/0 (socket says 172.21.15.67:54830) 2024-09-19T05:47:34.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15dffff640 1 -- 172.21.15.67:0/3964085902 learned_addr learned my addr 172.21.15.67:0/3964085902 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:34.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15d7fff640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15e00d0e80 0x7f15e014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15dffff640 1 -- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15e00d0160 msgr2=0x7f15e00b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15dffff640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15e00d0160 0x7f15e00b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15dffff640 1 -- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15e00d0e80 msgr2=0x7f15e014e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15dffff640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15e00d0e80 0x7f15e014e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.683+0000 7f15dffff640 1 -- 172.21.15.67:0/3964085902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e00b8420 con 0x7f15e0161da0 2024-09-19T05:47:34.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15dffff640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 0x7f15e00b2160 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f15d800caa0 tx=0x7f15d800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:34.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15dcff9640 1 -- 172.21.15.67:0/3964085902 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8017070 con 0x7f15e0161da0 2024-09-19T05:47:34.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15dcff9640 1 -- 172.21.15.67:0/3964085902 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d800ac00 con 0x7f15e0161da0 2024-09-19T05:47:34.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15dcff9640 1 -- 172.21.15.67:0/3964085902 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8012400 con 0x7f15e0161da0 2024-09-19T05:47:34.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15e5ff8640 1 -- 172.21.15.67:0/3964085902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e014e6f0 con 0x7f15e0161da0 2024-09-19T05:47:34.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15e5ff8640 1 -- 172.21.15.67:0/3964085902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e00b89a0 con 0x7f15e0161da0 2024-09-19T05:47:34.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15e5ff8640 1 -- 172.21.15.67:0/3964085902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e00d1af0 con 0x7f15e0161da0 2024-09-19T05:47:34.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15dcff9640 1 -- 172.21.15.67:0/3964085902 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15d801a070 con 0x7f15e0161da0 2024-09-19T05:47:34.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15dcff9640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15c00678c0 0x7f15c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:34.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15dcff9640 1 -- 172.21.15.67:0/3964085902 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7f15d8085840 con 0x7f15e0161da0 2024-09-19T05:47:34.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15df7fe640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15c00678c0 0x7f15c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:34.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.687+0000 7f15df7fe640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15c00678c0 0x7f15c0069d80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f15d00ae000 tx=0x7f15d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:34.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.691+0000 7f15dcff9640 1 -- 172.21.15.67:0/3964085902 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f15d8056580 con 0x7f15e0161da0 2024-09-19T05:47:34.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.859+0000 7f15e5ff8640 1 -- 172.21.15.67:0/3964085902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15e01575a0 con 0x7f15e0161da0 2024-09-19T05:47:34.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.859+0000 7f15dcff9640 1 -- 172.21.15.67:0/3964085902 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+13279 (secure 0 0 0) 0x7f15d8055e80 con 0x7f15e0161da0 2024-09-19T05:47:34.858 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:34.858 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":182,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:47:33.523788+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/2190010946":"2024-09-20T05:47:30.266136+0000","172.21.15.67:6834/2190010946":"2024-09-20T05:47:30.266136+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:47:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 -- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15c00678c0 msgr2=0x7f15c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15c00678c0 0x7f15c0069d80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f15d00ae000 tx=0x7f15d0008040 comp rx=0 tx=0).stop 2024-09-19T05:47:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 -- 172.21.15.67:0/3964085902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 msgr2=0x7f15e00b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 0x7f15e00b2160 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f15d800caa0 tx=0x7f15d800cf60 comp rx=0 tx=0).stop 2024-09-19T05:47:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 -- 172.21.15.67:0/3964085902 shutdown_connections 2024-09-19T05:47:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15e0161da0 0x7f15e00b2160 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15e00d0e80 0x7f15e014e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f15c00678c0 0x7f15c0069d80 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 --2- 172.21.15.67:0/3964085902 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15e00d0160 0x7f15e00b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 -- 172.21.15.67:0/3964085902 >> 172.21.15.67:0/3964085902 conn(0x7f15e008bfc0 msgr2=0x7f15e006e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 -- 172.21.15.67:0/3964085902 shutdown_connections 2024-09-19T05:47:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:34.863+0000 7f15e5ff8640 1 -- 172.21.15.67:0/3964085902 wait complete. 2024-09-19T05:47:34.878 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:47:34.879 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:47:35.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72e171f640 1 Processor -- start 2024-09-19T05:47:35.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72e171f640 1 -- start start 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72e171f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72dc0d1130 0x7f72dc0d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72e171f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0b32d0 0x7f72dc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72e171f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72dc06d680 0x7f72dc162870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72e171f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0d39e0 con 0x7f72dc0d1130 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72e171f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc06db20 con 0x7f72dc06d680 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72e171f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc06de00 con 0x7f72dc0b32d0 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72daffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72dc0d1130 0x7f72dc0d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72daffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72dc0d1130 0x7f72dc0d3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54838/0 (socket says 172.21.15.67:54838) 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72daffd640 1 -- 172.21.15.67:0/2960055229 learned_addr learned my addr 172.21.15.67:0/2960055229 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72db7fe640 1 --2- 172.21.15.67:0/2960055229 >> v2:172.21.15.97:3300/0 conn(0x7f72dc06d680 0x7f72dc162870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72da7fc640 1 --2- 172.21.15.67:0/2960055229 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0b32d0 0x7f72dc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72daffd640 1 -- 172.21.15.67:0/2960055229 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0b32d0 msgr2=0x7f72dc06d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:35.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72daffd640 1 --2- 172.21.15.67:0/2960055229 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0b32d0 0x7f72dc06d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72daffd640 1 -- 172.21.15.67:0/2960055229 >> v2:172.21.15.97:3300/0 conn(0x7f72dc06d680 msgr2=0x7f72dc162870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:35.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72daffd640 1 --2- 172.21.15.67:0/2960055229 >> v2:172.21.15.97:3300/0 conn(0x7f72dc06d680 0x7f72dc162870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72daffd640 1 -- 172.21.15.67:0/2960055229 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc0d3670 con 0x7f72dc0d1130 2024-09-19T05:47:35.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.011+0000 7f72db7fe640 1 --2- 172.21.15.67:0/2960055229 >> v2:172.21.15.97:3300/0 conn(0x7f72dc06d680 0x7f72dc162870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:35.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72daffd640 1 --2- 172.21.15.67:0/2960055229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0d1130 0x7f72dc0d3e70 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b3ed0 tx=0x7f72cc01c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876593fa1e180ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:35.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72d9ffb640 1 -- 172.21.15.67:0/2960055229 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0b0070 con 0x7f72dc0d1130 2024-09-19T05:47:35.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72d9ffb640 1 -- 172.21.15.67:0/2960055229 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc0ab600 con 0x7f72dc0d1130 2024-09-19T05:47:35.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72d9ffb640 1 -- 172.21.15.67:0/2960055229 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0ab9d0 con 0x7f72dc0d1130 2024-09-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 -- 172.21.15.67:0/2960055229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0d1130 msgr2=0x7f72dc0d3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 --2- 172.21.15.67:0/2960055229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0d1130 0x7f72dc0d3e70 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b3ed0 tx=0x7f72cc01c1d0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 -- 172.21.15.67:0/2960055229 shutdown_connections 2024-09-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 --2- 172.21.15.67:0/2960055229 >> v2:172.21.15.97:3300/0 conn(0x7f72dc06d680 0x7f72dc162870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 --2- 172.21.15.67:0/2960055229 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0b32d0 0x7f72dc06d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 --2- 172.21.15.67:0/2960055229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0d1130 0x7f72dc0d3e70 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 -- 172.21.15.67:0/2960055229 >> 172.21.15.67:0/2960055229 conn(0x7f72dc08bfc0 msgr2=0x7f72dc0d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 -- 172.21.15.67:0/2960055229 shutdown_connections 2024-09-19T05:47:35.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 -- 172.21.15.67:0/2960055229 wait complete. 2024-09-19T05:47:35.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 Processor -- start 2024-09-19T05:47:35.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.015+0000 7f72e171f640 1 -- start start 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72e171f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc06d680 0x7f72dc0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72e171f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0b32d0 0x7f72dc1576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72e171f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0d1130 0x7f72dc15c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72e171f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0cfcb0 con 0x7f72dc0b32d0 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72e171f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0cfb30 con 0x7f72dc06d680 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72e171f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc0cfe30 con 0x7f72dc0d1130 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72da7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0b32d0 0x7f72dc1576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72da7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0b32d0 0x7f72dc1576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54846/0 (socket says 172.21.15.67:54846) 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72da7fc640 1 -- 172.21.15.67:0/3676447597 learned_addr learned my addr 172.21.15.67:0/3676447597 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72db7fe640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0d1130 0x7f72dc15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72daffd640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc06d680 0x7f72dc0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72da7fc640 1 -- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0d1130 msgr2=0x7f72dc15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72da7fc640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0d1130 0x7f72dc15c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72da7fc640 1 -- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc06d680 msgr2=0x7f72dc0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72da7fc640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc06d680 0x7f72dc0cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72da7fc640 1 -- 172.21.15.67:0/3676447597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc0cda50 con 0x7f72dc0b32d0 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72db7fe640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0d1130 0x7f72dc15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72da7fc640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0b32d0 0x7f72dc1576c0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c7f0 tx=0x7f72c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72d37fe640 1 -- 172.21.15.67:0/3676447597 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4015070 con 0x7f72dc0b32d0 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72d37fe640 1 -- 172.21.15.67:0/3676447597 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c4004240 con 0x7f72dc0b32d0 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72d37fe640 1 -- 172.21.15.67:0/3676447597 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4003620 con 0x7f72dc0b32d0 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72e171f640 1 -- 172.21.15.67:0/3676447597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc0cdd30 con 0x7f72dc0b32d0 2024-09-19T05:47:35.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72e171f640 1 -- 172.21.15.67:0/3676447597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc157e80 con 0x7f72dc0b32d0 2024-09-19T05:47:35.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72e171f640 1 -- 172.21.15.67:0/3676447597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc06d140 con 0x7f72dc0b32d0 2024-09-19T05:47:35.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72d37fe640 1 -- 172.21.15.67:0/3676447597 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72c40039d0 con 0x7f72dc0b32d0 2024-09-19T05:47:35.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72d37fe640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72bc0678c0 0x7f72bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72d37fe640 1 -- 172.21.15.67:0/3676447597 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7f72c4085c10 con 0x7f72dc0b32d0 2024-09-19T05:47:35.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.019+0000 7f72daffd640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72bc0678c0 0x7f72bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.023+0000 7f72daffd640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72bc0678c0 0x7f72bc069d80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0ad000 tx=0x7f72cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:35.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.023+0000 7f72d37fe640 1 -- 172.21.15.67:0/3676447597 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f72c40568c0 con 0x7f72dc0b32d0 2024-09-19T05:47:35.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 -- 172.21.15.67:0/3676447597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f72dc0cdf00 con 0x7f72dc0b32d0 2024-09-19T05:47:35.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72d37fe640 1 -- 172.21.15.67:0/3676447597 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v182) ==== 93+0+10 (secure 0 0 0) 0x7f72c40561c0 con 0x7f72dc0b32d0 2024-09-19T05:47:35.189 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:47:35.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 -- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72bc0678c0 msgr2=0x7f72bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:35.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72bc0678c0 0x7f72bc069d80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0ad000 tx=0x7f72cc008040 comp rx=0 tx=0).stop 2024-09-19T05:47:35.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 -- 172.21.15.67:0/3676447597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0b32d0 msgr2=0x7f72dc1576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:35.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0b32d0 0x7f72dc1576c0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c7f0 tx=0x7f72c400ccb0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 -- 172.21.15.67:0/3676447597 shutdown_connections 2024-09-19T05:47:35.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72bc0678c0 0x7f72bc069d80 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72dc0d1130 0x7f72dc15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc0b32d0 0x7f72dc1576c0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 --2- 172.21.15.67:0/3676447597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc06d680 0x7f72dc0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 -- 172.21.15.67:0/3676447597 >> 172.21.15.67:0/3676447597 conn(0x7f72dc08bfc0 msgr2=0x7f72dc0b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:35.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 -- 172.21.15.67:0/3676447597 shutdown_connections 2024-09-19T05:47:35.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.191+0000 7f72e171f640 1 -- 172.21.15.67:0/3676447597 wait complete. 2024-09-19T05:47:35.209 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-19T05:47:35.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d64b3a640 1 Processor -- start 2024-09-19T05:47:35.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d64b3a640 1 -- start start 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d64b3a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3d60161da0 0x7f3d600d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d64b3a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d600d0e80 0x7f3d600d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d64b3a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3d600b41c0 0x7f3d600b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d64b3a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3d600d0840 con 0x7f3d60161da0 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d64b3a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3d600d1800 con 0x7f3d600b41c0 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d64b3a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3d600d4d40 con 0x7f3d600d0e80 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d5e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3d60161da0 0x7f3d600d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d5e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3d60161da0 0x7f3d600d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54854/0 (socket says 172.21.15.67:54854) 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d5e59c640 1 -- 172.21.15.67:0/3876890842 learned_addr learned my addr 172.21.15.67:0/3876890842 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d5ed9d640 1 --2- 172.21.15.67:0/3876890842 >> v2:172.21.15.97:3300/0 conn(0x7f3d600b41c0 0x7f3d600b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d5dd9b640 1 --2- 172.21.15.67:0/3876890842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d600d0e80 0x7f3d600d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d5e59c640 1 -- 172.21.15.67:0/3876890842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d600d0e80 msgr2=0x7f3d600d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:35.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d5e59c640 1 --2- 172.21.15.67:0/3876890842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d600d0e80 0x7f3d600d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d5e59c640 1 -- 172.21.15.67:0/3876890842 >> v2:172.21.15.97:3300/0 conn(0x7f3d600b41c0 msgr2=0x7f3d600b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:35.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d5e59c640 1 --2- 172.21.15.67:0/3876890842 >> v2:172.21.15.97:3300/0 conn(0x7f3d600b41c0 0x7f3d600b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.331+0000 7f3d5e59c640 1 -- 172.21.15.67:0/3876890842 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d600d5020 con 0x7f3d60161da0 2024-09-19T05:47:35.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d5e59c640 1 --2- 172.21.15.67:0/3876890842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 0x7f3d600d1af0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f3d6008e7c0 tx=0x7f3d5001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196dc7c186f41e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:35.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d5d59a640 1 -- 172.21.15.67:0/3876890842 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d500b1070 con 0x7f3d60161da0 2024-09-19T05:47:35.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d5d59a640 1 -- 172.21.15.67:0/3876890842 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d500ac630 con 0x7f3d60161da0 2024-09-19T05:47:35.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d5d59a640 1 -- 172.21.15.67:0/3876890842 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d500a8050 con 0x7f3d60161da0 2024-09-19T05:47:35.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3876890842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 msgr2=0x7f3d600d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:35.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 --2- 172.21.15.67:0/3876890842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 0x7f3d600d1af0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f3d6008e7c0 tx=0x7f3d5001c520 comp rx=0 tx=0).stop 2024-09-19T05:47:35.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3876890842 shutdown_connections 2024-09-19T05:47:35.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 --2- 172.21.15.67:0/3876890842 >> v2:172.21.15.97:3300/0 conn(0x7f3d600b41c0 0x7f3d600b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 --2- 172.21.15.67:0/3876890842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d600d0e80 0x7f3d600d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 --2- 172.21.15.67:0/3876890842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 0x7f3d600d1af0 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3876890842 >> 172.21.15.67:0/3876890842 conn(0x7f3d6008bfc0 msgr2=0x7f3d600d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:35.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3876890842 shutdown_connections 2024-09-19T05:47:35.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3876890842 wait complete. 2024-09-19T05:47:35.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 Processor -- start 2024-09-19T05:47:35.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.335+0000 7f3d64b3a640 1 -- start start 2024-09-19T05:47:35.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d64b3a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d600b41c0 0x7f3d6014ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d64b3a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d600d0e80 0x7f3d6014f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d64b3a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 0x7f3d60157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d64b3a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3d600cf150 con 0x7f3d60161da0 2024-09-19T05:47:35.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d64b3a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3d60162180 con 0x7f3d600d0e80 2024-09-19T05:47:35.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d64b3a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3d600cf2d0 con 0x7f3d600b41c0 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 0x7f3d60157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 0x7f3d60157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54862/0 (socket says 172.21.15.67:54862) 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5ed9d640 1 -- 172.21.15.67:0/3639337326 learned_addr learned my addr 172.21.15.67:0/3639337326 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5e59c640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d600b41c0 0x7f3d6014ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5dd9b640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d600d0e80 0x7f3d6014f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5ed9d640 1 -- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d600b41c0 msgr2=0x7f3d6014ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5ed9d640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d600b41c0 0x7f3d6014ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5ed9d640 1 -- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d600d0e80 msgr2=0x7f3d6014f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5ed9d640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d600d0e80 0x7f3d6014f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5ed9d640 1 -- 172.21.15.67:0/3639337326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d600b32a0 con 0x7f3d60161da0 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5dd9b640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d600d0e80 0x7f3d6014f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:35.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d5ed9d640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 0x7f3d60157810 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800d580 tx=0x7f3d5800da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d56ffd640 1 -- 172.21.15.67:0/3639337326 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58018020 con 0x7f3d60161da0 2024-09-19T05:47:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d56ffd640 1 -- 172.21.15.67:0/3639337326 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d58014620 con 0x7f3d60161da0 2024-09-19T05:47:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d56ffd640 1 -- 172.21.15.67:0/3639337326 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58014a10 con 0x7f3d60161da0 2024-09-19T05:47:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3639337326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d600cc940 con 0x7f3d60161da0 2024-09-19T05:47:35.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3639337326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d600ccf00 con 0x7f3d60161da0 2024-09-19T05:47:35.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3639337326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d600b4650 con 0x7f3d60161da0 2024-09-19T05:47:35.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.339+0000 7f3d56ffd640 1 -- 172.21.15.67:0/3639337326 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d5801b020 con 0x7f3d60161da0 2024-09-19T05:47:35.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.343+0000 7f3d56ffd640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3d400678c0 0x7f3d40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:35.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.343+0000 7f3d56ffd640 1 -- 172.21.15.67:0/3639337326 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7f3d58085ff0 con 0x7f3d60161da0 2024-09-19T05:47:35.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.343+0000 7f3d5e59c640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3d400678c0 0x7f3d40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:35.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.343+0000 7f3d5e59c640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3d400678c0 0x7f3d40069d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3d500ae000 tx=0x7f3d50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:35.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.347+0000 7f3d56ffd640 1 -- 172.21.15.67:0/3639337326 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3d58022020 con 0x7f3d60161da0 2024-09-19T05:47:35.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:35.567+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3639337326 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f3d600d0340 con 0x7f3d60161da0 2024-09-19T05:47:36.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.543+0000 7f3d56ffd640 1 -- 172.21.15.67:0/3639337326 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v646) ==== 143+0+0 (secure 0 0 0) 0x7f3d58056cb0 con 0x7f3d60161da0 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3d400678c0 msgr2=0x7f3d40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3d400678c0 0x7f3d40069d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3d500ae000 tx=0x7f3d50008040 comp rx=0 tx=0).stop 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3639337326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 msgr2=0x7f3d60157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 0x7f3d60157810 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800d580 tx=0x7f3d5800da40 comp rx=0 tx=0).stop 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3639337326 shutdown_connections 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d60161da0 0x7f3d60157810 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d600d0e80 0x7f3d6014f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3d400678c0 0x7f3d40069d80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 --2- 172.21.15.67:0/3639337326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d600b41c0 0x7f3d6014ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3639337326 >> 172.21.15.67:0/3639337326 conn(0x7f3d6008bfc0 msgr2=0x7f3d600d4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3639337326 shutdown_connections 2024-09-19T05:47:36.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.547+0000 7f3d64b3a640 1 -- 172.21.15.67:0/3639337326 wait complete. 2024-09-19T05:47:36.565 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:47:36.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c08656640 1 Processor -- start 2024-09-19T05:47:36.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c08656640 1 -- start start 2024-09-19T05:47:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c08656640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c0015e690 0x7f9c000d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c08656640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c000d1590 0x7f9c0006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c08656640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c000d35a0 con 0x7f9c000d4fb0 2024-09-19T05:47:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c08656640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9c000d32c0 con 0x7f9c000d1590 2024-09-19T05:47:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c08656640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0006d040 con 0x7f9c0015e690 2024-09-19T05:47:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c06bf3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c000d1590 0x7f9c0006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c06bf3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c000d1590 0x7f9c0006db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36116/0 (socket says 172.21.15.67:36116) 2024-09-19T05:47:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c06bf3640 1 -- 172.21.15.67:0/1376381044 learned_addr learned my addr 172.21.15.67:0/1376381044 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c063f2640 1 --2- 172.21.15.67:0/1376381044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c0015e690 0x7f9c000d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:36.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c06bf3640 1 -- 172.21.15.67:0/1376381044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c0015e690 msgr2=0x7f9c000d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:36.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c06bf3640 1 --2- 172.21.15.67:0/1376381044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c0015e690 0x7f9c000d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c06bf3640 1 -- 172.21.15.67:0/1376381044 >> v1:172.21.15.97:6789/0 conn(0x7f9c000d4fb0 legacy=0x7f9c000d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:36.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.699+0000 7f9c06bf3640 1 -- 172.21.15.67:0/1376381044 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0006d320 con 0x7f9c000d1590 2024-09-19T05:47:36.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c06bf3640 1 --2- 172.21.15.67:0/1376381044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 0x7f9c0006db20 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009e50 tx=0x7f9bf801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1a6b9bf8b5b8b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c053f0640 1 -- 172.21.15.67:0/1376381044 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80a57e0 con 0x7f9c000d1590 2024-09-19T05:47:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c053f0640 1 -- 172.21.15.67:0/1376381044 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf80a5980 con 0x7f9c000d1590 2024-09-19T05:47:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c053f0640 1 -- 172.21.15.67:0/1376381044 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80a5d50 con 0x7f9c000d1590 2024-09-19T05:47:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 -- 172.21.15.67:0/1376381044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 msgr2=0x7f9c0006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 --2- 172.21.15.67:0/1376381044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 0x7f9c0006db20 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009e50 tx=0x7f9bf801c9c0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 -- 172.21.15.67:0/1376381044 shutdown_connections 2024-09-19T05:47:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 --2- 172.21.15.67:0/1376381044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 0x7f9c0006db20 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 --2- 172.21.15.67:0/1376381044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c0015e690 0x7f9c000d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 -- 172.21.15.67:0/1376381044 >> 172.21.15.67:0/1376381044 conn(0x7f9c000d4490 msgr2=0x7f9c000d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:36.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 -- 172.21.15.67:0/1376381044 shutdown_connections 2024-09-19T05:47:36.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 -- 172.21.15.67:0/1376381044 wait complete. 2024-09-19T05:47:36.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 Processor -- start 2024-09-19T05:47:36.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 -- start start 2024-09-19T05:47:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 0x7f9c00159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c000d4fb0 0x7f9c00151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0015e690 0x7f9c000b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0006e9f0 con 0x7f9c000d1590 2024-09-19T05:47:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0006e870 con 0x7f9c0015e690 2024-09-19T05:47:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c08656640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0006eb70 con 0x7f9c000d4fb0 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.703+0000 7f9c063f2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 0x7f9c00159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c063f2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 0x7f9c00159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36132/0 (socket says 172.21.15.67:36132) 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c063f2640 1 -- 172.21.15.67:0/3513888188 learned_addr learned my addr 172.21.15.67:0/3513888188 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c06bf3640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0015e690 0x7f9c000b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c05bf1640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c000d4fb0 0x7f9c00151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c063f2640 1 -- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c000d4fb0 msgr2=0x7f9c00151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c063f2640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c000d4fb0 0x7f9c00151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c063f2640 1 -- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0015e690 msgr2=0x7f9c000b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c063f2640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0015e690 0x7f9c000b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c063f2640 1 -- 172.21.15.67:0/3513888188 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c00152250 con 0x7f9c000d1590 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c06bf3640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0015e690 0x7f9c000b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c05bf1640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c000d4fb0 0x7f9c00151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c063f2640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 0x7f9c00159b10 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00d5f0 tx=0x7f9bfc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/3513888188 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0125f0 con 0x7f9c000d1590 2024-09-19T05:47:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/3513888188 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc019070 con 0x7f9c000d1590 2024-09-19T05:47:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c08656640 1 -- 172.21.15.67:0/3513888188 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c000b31c0 con 0x7f9c000d1590 2024-09-19T05:47:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/3513888188 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0129b0 con 0x7f9c000d1590 2024-09-19T05:47:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c08656640 1 -- 172.21.15.67:0/3513888188 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c000b2c00 con 0x7f9c000d1590 2024-09-19T05:47:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c08656640 1 -- 172.21.15.67:0/3513888188 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0006db20 con 0x7f9c000d1590 2024-09-19T05:47:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/3513888188 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9bfc012b50 con 0x7f9c000d1590 2024-09-19T05:47:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9bf6ffd640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678c0 0x7f9be4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/3513888188 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7f9bfc086980 con 0x7f9c000d1590 2024-09-19T05:47:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.707+0000 7f9c05bf1640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678c0 0x7f9be4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.711+0000 7f9c05bf1640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678c0 0x7f9be4069d80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9c000d49e0 tx=0x7f9bf0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:36.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.711+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/3513888188 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9bfc057710 con 0x7f9c000d1590 2024-09-19T05:47:36.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.875+0000 7f9c08656640 1 -- 172.21.15.67:0/3513888188 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9c0006bde0 con 0x7f9c000d1590 2024-09-19T05:47:36.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.883+0000 7f9bf6ffd640 1 -- 172.21.15.67:0/3513888188 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f9bfc057010 con 0x7f9c000d1590 2024-09-19T05:47:36.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.883+0000 7f9c08656640 1 -- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678c0 msgr2=0x7f9be4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.883+0000 7f9c08656640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678c0 0x7f9be4069d80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9c000d49e0 tx=0x7f9bf0009040 comp rx=0 tx=0).stop 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.883+0000 7f9c08656640 1 -- 172.21.15.67:0/3513888188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 msgr2=0x7f9c00159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.883+0000 7f9c08656640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 0x7f9c00159b10 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00d5f0 tx=0x7f9bfc00dab0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.887+0000 7f9c08656640 1 -- 172.21.15.67:0/3513888188 shutdown_connections 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.887+0000 7f9c08656640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0015e690 0x7f9c000b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.887+0000 7f9c08656640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9be40678c0 0x7f9be4069d80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.887+0000 7f9c08656640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c000d4fb0 0x7f9c00151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.887+0000 7f9c08656640 1 --2- 172.21.15.67:0/3513888188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c000d1590 0x7f9c00159b10 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.887+0000 7f9c08656640 1 -- 172.21.15.67:0/3513888188 >> 172.21.15.67:0/3513888188 conn(0x7f9c000d4490 msgr2=0x7f9c000b6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.887+0000 7f9c08656640 1 -- 172.21.15.67:0/3513888188 shutdown_connections 2024-09-19T05:47:36.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:36.887+0000 7f9c08656640 1 -- 172.21.15.67:0/3513888188 wait complete. 2024-09-19T05:47:36.901 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:47:36.901 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:47:36.977 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:47:37.062 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:47:37.062 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:47:37.062 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:47:37.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:47:37.068 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:47:37.068 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:47:37.074 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:47:37.074 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:47:37.074 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:47:37.116 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:47:37.116 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:47:37.116 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:47:37.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:47:37.124 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:47:37.125 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:47:37.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e61de3640 1 Processor -- start 2024-09-19T05:47:37.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e61de3640 1 -- start start 2024-09-19T05:47:37.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e61de3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3e5c0d1590 0x7f3e5c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e61de3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0b51d0 0x7f3e5c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e61de3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e5c0d4d40 con 0x7f3e5c161da0 2024-09-19T05:47:37.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e61de3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3e5c0d0840 con 0x7f3e5c0d1590 2024-09-19T05:47:37.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e61de3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c0d5020 con 0x7f3e5c0b51d0 2024-09-19T05:47:37.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5b7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3e5c161da0 0x7f3e5c0d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42808/0 (socket says 172.21.15.67:42808) 2024-09-19T05:47:37.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5b7fe640 1 -- 172.21.15.67:0/1919811903 learned_addr learned my addr 172.21.15.67:0/1919811903 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:37.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477780298 0 0) 0x7f3e5c0d4d40 con 0x7f3e5c161da0 2024-09-19T05:47:37.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e44003530 con 0x7f3e5c161da0 2024-09-19T05:47:37.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5affd640 1 --2- 172.21.15.67:0/1919811903 >> v2:172.21.15.97:3300/0 conn(0x7f3e5c0d1590 0x7f3e5c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5bfff640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0b51d0 0x7f3e5c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1765622048 0 0) 0x7f3e44003530 con 0x7f3e5c161da0 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0b51d0 msgr2=0x7f3e5c0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0b51d0 0x7f3e5c0cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 >> v2:172.21.15.97:3300/0 conn(0x7f3e5c0d1590 msgr2=0x7f3e5c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 --2- 172.21.15.67:0/1919811903 >> v2:172.21.15.97:3300/0 conn(0x7f3e5c0d1590 0x7f3e5c0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c0d5300 con 0x7f3e5c161da0 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3e500016a0 con 0x7f3e5c161da0 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5affd640 1 --2- 172.21.15.67:0/1919811903 >> v2:172.21.15.97:3300/0 conn(0x7f3e5c0d1590 0x7f3e5c0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 >> v1:172.21.15.67:6789/0 conn(0x7f3e5c161da0 legacy=0x7f3e5c0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e440039c0 0x7f3e44003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 0x7f3e44004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0b51d0 0x7f3e440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c0d0840 con 0x7f3e44004810 2024-09-19T05:47:37.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c0d5020 con 0x7f3e440039c0 2024-09-19T05:47:37.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4400ba00 con 0x7f3e5c0b51d0 2024-09-19T05:47:37.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5affd640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 0x7f3e44004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5b7fe640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e440039c0 0x7f3e44003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5affd640 1 -- 172.21.15.67:0/1919811903 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0b51d0 msgr2=0x7f3e440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:37.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5affd640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0b51d0 0x7f3e440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5affd640 1 -- 172.21.15.67:0/1919811903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e440039c0 msgr2=0x7f3e44003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:37.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5affd640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e440039c0 0x7f3e44003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.295+0000 7f3e5affd640 1 -- 172.21.15.67:0/1919811903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e44003530 con 0x7f3e44004810 2024-09-19T05:47:37.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e5affd640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 0x7f3e44004c90 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0098d0 tx=0x7f3e4c01c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ccb55b3bfdb607 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:37.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c00f040 con 0x7f3e44004810 2024-09-19T05:47:37.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0a9480 con 0x7f3e44004810 2024-09-19T05:47:37.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e5a7fc640 1 -- 172.21.15.67:0/1919811903 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0a9830 con 0x7f3e44004810 2024-09-19T05:47:37.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 -- 172.21.15.67:0/1919811903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 msgr2=0x7f3e44004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 --2- 172.21.15.67:0/1919811903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 0x7f3e44004c90 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0098d0 tx=0x7f3e4c01c650 comp rx=0 tx=0).stop 2024-09-19T05:47:37.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e5bfff640 1 -- 172.21.15.67:0/1919811903 reap_dead start 2024-09-19T05:47:37.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 -- 172.21.15.67:0/1919811903 shutdown_connections 2024-09-19T05:47:37.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 -- 172.21.15.67:0/1919811903 >> 172.21.15.67:0/1919811903 conn(0x7f3e5c08bfc0 msgr2=0x7f3e5c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:37.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 -- 172.21.15.67:0/1919811903 shutdown_connections 2024-09-19T05:47:37.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 -- 172.21.15.67:0/1919811903 wait complete. 2024-09-19T05:47:37.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 Processor -- start 2024-09-19T05:47:37.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 -- start start 2024-09-19T05:47:37.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 0x7f3e5c0b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0cb560 0x7f3e5c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5c1f1490 0x7f3e5c1f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c162180 con 0x7f3e44004810 2024-09-19T05:47:37.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c0b5d00 con 0x7f3e5c1f1490 2024-09-19T05:47:37.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.299+0000 7f3e61de3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c0cf150 con 0x7f3e5c0cb560 2024-09-19T05:47:37.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 0x7f3e5c0b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 0x7f3e5c0b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36150/0 (socket says 172.21.15.67:36150) 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5b7fe640 1 -- 172.21.15.67:0/447785424 learned_addr learned my addr 172.21.15.67:0/447785424 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5b7fe640 1 -- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0cb560 msgr2=0x7f3e5c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5b7fe640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0cb560 0x7f3e5c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5bfff640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5c1f1490 0x7f3e5c1f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5b7fe640 1 -- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5c1f1490 msgr2=0x7f3e5c1f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5b7fe640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5c1f1490 0x7f3e5c1f1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5b7fe640 1 -- 172.21.15.67:0/447785424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c1f1e50 con 0x7f3e44004810 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5b7fe640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 0x7f3e5c0b22f0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f3e50001000 tx=0x7f3e50005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e43fff640 1 -- 172.21.15.67:0/447785424 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5001b070 con 0x7f3e44004810 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e43fff640 1 -- 172.21.15.67:0/447785424 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e50011040 con 0x7f3e44004810 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e61de3640 1 -- 172.21.15.67:0/447785424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5c0cc020 con 0x7f3e44004810 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e43fff640 1 -- 172.21.15.67:0/447785424 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000ed20 con 0x7f3e44004810 2024-09-19T05:47:37.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e61de3640 1 -- 172.21.15.67:0/447785424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5c0ccc60 con 0x7f3e44004810 2024-09-19T05:47:37.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e61de3640 1 -- 172.21.15.67:0/447785424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5c0cca70 con 0x7f3e44004810 2024-09-19T05:47:37.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e43fff640 1 -- 172.21.15.67:0/447785424 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e5001e070 con 0x7f3e44004810 2024-09-19T05:47:37.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e43fff640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 0x7f3e48069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e43fff640 1 -- 172.21.15.67:0/447785424 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7f3e50088470 con 0x7f3e44004810 2024-09-19T05:47:37.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5affd640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 0x7f3e48069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.303+0000 7f3e5affd640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 0x7f3e48069db0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0ae000 tx=0x7f3e4c004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:37.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.307+0000 7f3e43fff640 1 -- 172.21.15.67:0/447785424 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3e500591b0 con 0x7f3e44004810 2024-09-19T05:47:37.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.507+0000 7f3e61de3640 1 -- 172.21.15.67:0/447785424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e5c15feb0 con 0x7f3e44004810 2024-09-19T05:47:37.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.507+0000 7f3e43fff640 1 -- 172.21.15.67:0/447785424 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 132 v132) ==== 95+0+3918 (secure 0 0 0) 0x7f3e50058ab0 con 0x7f3e44004810 2024-09-19T05:47:37.507 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:37.507 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":132,"btime":"2024-09-19T05:47:31:268610+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6974,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2737632366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737632366},{"type":"v1","addr":"172.21.15.97:6835","nonce":2737632366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3498582105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3498582105},{"type":"v1","addr":"172.21.15.97:6837","nonce":3498582105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":10362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4008263611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4008263611},{"type":"v1","addr":"172.21.15.67:6833","nonce":4008263611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":10368,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/3175312005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3175312005},{"type":"v1","addr":"172.21.15.67:6835","nonce":3175312005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[]} 2024-09-19T05:47:37.507 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 132 2024-09-19T05:47:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 -- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 msgr2=0x7f3e48069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 0x7f3e48069db0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0ae000 tx=0x7f3e4c004740 comp rx=0 tx=0).stop 2024-09-19T05:47:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 -- 172.21.15.67:0/447785424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 msgr2=0x7f3e5c0b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 0x7f3e5c0b22f0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f3e50001000 tx=0x7f3e50005720 comp rx=0 tx=0).stop 2024-09-19T05:47:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 -- 172.21.15.67:0/447785424 shutdown_connections 2024-09-19T05:47:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e5c1f1490 0x7f3e5c1f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3e480678f0 0x7f3e48069db0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3e5c0cb560 0x7f3e5c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 --2- 172.21.15.67:0/447785424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e44004810 0x7f3e5c0b22f0 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 -- 172.21.15.67:0/447785424 >> 172.21.15.67:0/447785424 conn(0x7f3e5c08bfc0 msgr2=0x7f3e5c0b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 -- 172.21.15.67:0/447785424 shutdown_connections 2024-09-19T05:47:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.511+0000 7f3e61de3640 1 -- 172.21.15.67:0/447785424 wait complete. 2024-09-19T05:47:37.527 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:47:37.528 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:47:37.528 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:47:37.528 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:47:37.528 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:47:37.528 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:47:37.528 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:47:37.529 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:47:37.529 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:47:37.529 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:47:37.529 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:47:37.529 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:47:37.530 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:47:37.530 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:47:37.530 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:47:37.530 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:47:37.543 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:47:37.543 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:47:37.544 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:47:37.544 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:47:37.545 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:47:37.545 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:47:37.546 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:47:37.546 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:47:37.589 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:47:37.589 DEBUG:teuthology.parallel:result is None 2024-09-19T05:47:37.590 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:47:37.590 DEBUG:teuthology.parallel:result is None 2024-09-19T05:47:37.593 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:47:37.593 DEBUG:teuthology.parallel:result is None 2024-09-19T05:47:37.594 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:47:37.594 DEBUG:teuthology.parallel:result is None 2024-09-19T05:47:37.594 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:47:37.654 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:47:37.658 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:47:37.663 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:47:37.665 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:47:37.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.719+0000 7fabdb8dc640 1 Processor -- start 2024-09-19T05:47:37.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.719+0000 7fabdb8dc640 1 -- start start 2024-09-19T05:47:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.719+0000 7fabdb8dc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fabd415b1e0 0x7fabd40b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.719+0000 7fabdb8dc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd40b3860 con 0x7fabd4072590 2024-09-19T05:47:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.719+0000 7fabdb8dc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd40b3b40 con 0x7fabd40b4900 2024-09-19T05:47:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.719+0000 7fabdb8dc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fabd415b5c0 con 0x7fabd415b1e0 2024-09-19T05:47:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.719+0000 7fabd9e79640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fabd4072590 0x7fabd40ade10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42826/0 (socket says 172.21.15.67:42826) 2024-09-19T05:47:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.719+0000 7fabd9e79640 1 -- 172.21.15.67:0/1830417021 learned_addr learned my addr 172.21.15.67:0/1830417021 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025845220 0 0) 0x7fabd40b3860 con 0x7fabd4072590 2024-09-19T05:47:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd9678640 1 --2- 172.21.15.67:0/1830417021 >> v2:172.21.15.97:3300/0 conn(0x7fabd415b1e0 0x7fabd40b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabbc003530 con 0x7fabd4072590 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4066211213 0 0) 0x7fabbc003530 con 0x7fabd4072590 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 >> v2:172.21.15.97:3300/0 conn(0x7fabd415b1e0 msgr2=0x7fabd40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 --2- 172.21.15.67:0/1830417021 >> v2:172.21.15.97:3300/0 conn(0x7fabd415b1e0 0x7fabd40b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 >> v1:172.21.15.97:6789/0 conn(0x7fabd40b4900 legacy=0x7fabd4071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd40b3e20 con 0x7fabd4072590 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fabcc001680 con 0x7fabd4072590 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 >> v1:172.21.15.67:6789/0 conn(0x7fabd4072590 legacy=0x7fabd40ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabbc0039c0 0x7fabbc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabbc0043c0 0x7fabbc004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabbc005090 0x7fabbc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fabd415b5c0 con 0x7fabbc0043c0 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc00bff0 con 0x7fabbc0039c0 2024-09-19T05:47:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fabbc00e400 con 0x7fabbc005090 2024-09-19T05:47:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd8e77640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabbc0043c0 0x7fabbc004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd9678640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabbc0039c0 0x7fabbc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd9e79640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabbc005090 0x7fabbc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd8e77640 1 -- 172.21.15.67:0/1830417021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabbc005090 msgr2=0x7fabbc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd8e77640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabbc005090 0x7fabbc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd8e77640 1 -- 172.21.15.67:0/1830417021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabbc0039c0 msgr2=0x7fabbc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd8e77640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabbc0039c0 0x7fabbc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd8e77640 1 -- 172.21.15.67:0/1830417021 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabbc003530 con 0x7fabbc0043c0 2024-09-19T05:47:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd9e79640 1 -- 172.21.15.67:0/1830417021 reap_dead start 2024-09-19T05:47:37.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd8e77640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabbc0043c0 0x7fabbc004890 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fabc8001860 tx=0x7fabc801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31d301a36103c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:37.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8001460 con 0x7fabbc0043c0 2024-09-19T05:47:37.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc80b0070 con 0x7fabbc0043c0 2024-09-19T05:47:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabd3fff640 1 -- 172.21.15.67:0/1830417021 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc80ab900 con 0x7fabbc0043c0 2024-09-19T05:47:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabdb8dc640 1 -- 172.21.15.67:0/1830417021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabbc0043c0 msgr2=0x7fabbc004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabdb8dc640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabbc0043c0 0x7fabbc004890 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fabc8001860 tx=0x7fabc801c4b0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabdb8dc640 1 -- 172.21.15.67:0/1830417021 shutdown_connections 2024-09-19T05:47:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabdb8dc640 1 --2- 172.21.15.67:0/1830417021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabbc0043c0 0x7fabbc004890 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabdb8dc640 1 -- 172.21.15.67:0/1830417021 >> 172.21.15.67:0/1830417021 conn(0x7fabd40d0080 msgr2=0x7fabd40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabdb8dc640 1 -- 172.21.15.67:0/1830417021 shutdown_connections 2024-09-19T05:47:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.723+0000 7fabdb8dc640 1 -- 172.21.15.67:0/1830417021 wait complete. 2024-09-19T05:47:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 Processor -- start 2024-09-19T05:47:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 -- start start 2024-09-19T05:47:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabbc0043c0 0x7fabd414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd415c9f0 0x7fabd4158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabd41591b0 0x7fabd414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fabd4072000 con 0x7fabd41591b0 2024-09-19T05:47:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fabd4071e80 con 0x7fabbc0043c0 2024-09-19T05:47:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fabd4072180 con 0x7fabd415c9f0 2024-09-19T05:47:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd9e79640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabd41591b0 0x7fabd414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd9e79640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabd41591b0 0x7fabd414bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36200/0 (socket says 172.21.15.67:36200) 2024-09-19T05:47:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd9e79640 1 -- 172.21.15.67:0/266876691 learned_addr learned my addr 172.21.15.67:0/266876691 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd8e77640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd415c9f0 0x7fabd4158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd9678640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabbc0043c0 0x7fabd414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd9e79640 1 -- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd415c9f0 msgr2=0x7fabd4158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd9e79640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd415c9f0 0x7fabd4158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd9e79640 1 -- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabbc0043c0 msgr2=0x7fabd414cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd9e79640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabbc0043c0 0x7fabd414cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd9e79640 1 -- 172.21.15.67:0/266876691 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd4157430 con 0x7fabd41591b0 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd9e79640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabd41591b0 0x7fabd414bfb0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fabcc000c10 tx=0x7fabcc004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd1ffb640 1 -- 172.21.15.67:0/266876691 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00f660 con 0x7fabd41591b0 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd1ffb640 1 -- 172.21.15.67:0/266876691 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabcc018070 con 0x7fabd41591b0 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabd1ffb640 1 -- 172.21.15.67:0/266876691 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00fa80 con 0x7fabd41591b0 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 -- 172.21.15.67:0/266876691 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd414f690 con 0x7fabd41591b0 2024-09-19T05:47:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 -- 172.21.15.67:0/266876691 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd414fc50 con 0x7fabd41591b0 2024-09-19T05:47:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.727+0000 7fabdb8dc640 1 -- 172.21.15.67:0/266876691 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd4157600 con 0x7fabd41591b0 2024-09-19T05:47:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.731+0000 7fabd1ffb640 1 -- 172.21.15.67:0/266876691 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fabcc00fc20 con 0x7fabd41591b0 2024-09-19T05:47:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.731+0000 7fabd1ffb640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fabc00678f0 0x7fabc0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.731+0000 7fabd1ffb640 1 -- 172.21.15.67:0/266876691 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7fabcc085740 con 0x7fabd41591b0 2024-09-19T05:47:37.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.731+0000 7fabd9678640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fabc00678f0 0x7fabc0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:37.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.731+0000 7fabd9678640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fabc00678f0 0x7fabc0069db0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fabd406a420 tx=0x7fabc400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.735+0000 7fabd1ffb640 1 -- 172.21.15.67:0/266876691 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fabcc055e30 con 0x7fabd41591b0 2024-09-19T05:47:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:37.911+0000 7fabdb8dc640 1 -- 172.21.15.67:0/266876691 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fabd40b2fd0 con 0x7fabd41591b0 2024-09-19T05:47:38.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.911+0000 7fabd1ffb640 1 -- 172.21.15.67:0/266876691 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v187) ==== 97+0+0 (secure 0 0 0) 0x7fabcc05a130 con 0x7fabd41591b0 2024-09-19T05:47:38.908 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:47:38.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 -- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fabc00678f0 msgr2=0x7fabc0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:38.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fabc00678f0 0x7fabc0069db0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fabd406a420 tx=0x7fabc400b040 comp rx=0 tx=0).stop 2024-09-19T05:47:38.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 -- 172.21.15.67:0/266876691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabd41591b0 msgr2=0x7fabd414bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:38.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabd41591b0 0x7fabd414bfb0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fabcc000c10 tx=0x7fabcc004f90 comp rx=0 tx=0).stop 2024-09-19T05:47:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 -- 172.21.15.67:0/266876691 shutdown_connections 2024-09-19T05:47:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabd41591b0 0x7fabd414bfb0 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fabc00678f0 0x7fabc0069db0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd415c9f0 0x7fabd4158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 --2- 172.21.15.67:0/266876691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabbc0043c0 0x7fabd414cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 -- 172.21.15.67:0/266876691 >> 172.21.15.67:0/266876691 conn(0x7fabd40d0080 msgr2=0x7fabd40afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 -- 172.21.15.67:0/266876691 shutdown_connections 2024-09-19T05:47:38.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:38.915+0000 7fabdb8dc640 1 -- 172.21.15.67:0/266876691 wait complete. 2024-09-19T05:47:38.936 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:47:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f225e257640 1 Processor -- start 2024-09-19T05:47:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f225e257640 1 -- start start 2024-09-19T05:47:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f225e257640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f225806f460 0x7f225806f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f225e257640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f225806e3c0 con 0x7f225806dde0 2024-09-19T05:47:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f225e257640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f225806e6a0 con 0x7f225815c030 2024-09-19T05:47:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f225e257640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f225806e980 con 0x7f225806f460 2024-09-19T05:47:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f2257fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f225806f460 0x7f225806f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f2257fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f225806f460 0x7f225806f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36210/0 (socket says 172.21.15.67:36210) 2024-09-19T05:47:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f2257fff640 1 -- 172.21.15.67:0/1603815463 learned_addr learned my addr 172.21.15.67:0/1603815463 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f2257fff640 1 -- 172.21.15.67:0/1603815463 >> v1:172.21.15.97:6789/0 conn(0x7f225815c030 legacy=0x7f225815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:39.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f2257fff640 1 -- 172.21.15.67:0/1603815463 >> v1:172.21.15.67:6789/0 conn(0x7f225806dde0 legacy=0x7f22580b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.067+0000 7f2257fff640 1 -- 172.21.15.67:0/1603815463 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225806ec60 con 0x7f225806f460 2024-09-19T05:47:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f2257fff640 1 --2- 172.21.15.67:0/1603815463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 0x7f225806f870 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f2250009e50 tx=0x7f225001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513ccb8f17be5e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f22567fc640 1 -- 172.21.15.67:0/1603815463 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22500a56c0 con 0x7f225806f460 2024-09-19T05:47:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f22567fc640 1 -- 172.21.15.67:0/1603815463 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22500a5860 con 0x7f225806f460 2024-09-19T05:47:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f22567fc640 1 -- 172.21.15.67:0/1603815463 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22500a5c30 con 0x7f225806f460 2024-09-19T05:47:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f225e257640 1 -- 172.21.15.67:0/1603815463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 msgr2=0x7f225806f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f225e257640 1 --2- 172.21.15.67:0/1603815463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 0x7f225806f870 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f2250009e50 tx=0x7f225001c9f0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f225e257640 1 -- 172.21.15.67:0/1603815463 shutdown_connections 2024-09-19T05:47:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f225e257640 1 --2- 172.21.15.67:0/1603815463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 0x7f225806f870 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f225e257640 1 -- 172.21.15.67:0/1603815463 >> 172.21.15.67:0/1603815463 conn(0x7f22580d0080 msgr2=0x7f22580d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f225e257640 1 -- 172.21.15.67:0/1603815463 shutdown_connections 2024-09-19T05:47:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f225e257640 1 -- 172.21.15.67:0/1603815463 wait complete. 2024-09-19T05:47:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f225e257640 1 Processor -- start 2024-09-19T05:47:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.071+0000 7f225e257640 1 -- start start 2024-09-19T05:47:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f225e257640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f225806dde0 0x7f225814eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f225e257640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 0x7f2258147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f225e257640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f225815c030 0x7f225815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f225e257640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f225816a270 con 0x7f225806f460 2024-09-19T05:47:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f225e257640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f225816a0f0 con 0x7f225815c030 2024-09-19T05:47:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f225e257640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f225816a3f0 con 0x7f225806dde0 2024-09-19T05:47:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f2256ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 0x7f2258147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f2256ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 0x7f2258147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36220/0 (socket says 172.21.15.67:36220) 2024-09-19T05:47:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f2256ffd640 1 -- 172.21.15.67:0/2995042683 learned_addr learned my addr 172.21.15.67:0/2995042683 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f22577fe640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f225806dde0 0x7f225814eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f2257fff640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f225815c030 0x7f225815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f2256ffd640 1 -- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f225806dde0 msgr2=0x7f225814eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f2256ffd640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f225806dde0 0x7f225814eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f2256ffd640 1 -- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f225815c030 msgr2=0x7f225815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f2256ffd640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f225815c030 0x7f225815d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f2256ffd640 1 -- 172.21.15.67:0/2995042683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2258150400 con 0x7f225806f460 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f22577fe640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f225806dde0 0x7f225814eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f2256ffd640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 0x7f2258147560 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f224800c450 tx=0x7f224800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f223ffff640 1 -- 172.21.15.67:0/2995042683 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248016020 con 0x7f225806f460 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f223ffff640 1 -- 172.21.15.67:0/2995042683 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22480052d0 con 0x7f225806f460 2024-09-19T05:47:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f223ffff640 1 -- 172.21.15.67:0/2995042683 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248007260 con 0x7f225806f460 2024-09-19T05:47:39.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f225e257640 1 -- 172.21.15.67:0/2995042683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225815f130 con 0x7f225806f460 2024-09-19T05:47:39.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f225e257640 1 -- 172.21.15.67:0/2995042683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225814e6e0 con 0x7f225806f460 2024-09-19T05:47:39.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f225e257640 1 -- 172.21.15.67:0/2995042683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225806f870 con 0x7f225806f460 2024-09-19T05:47:39.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f223ffff640 1 -- 172.21.15.67:0/2995042683 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2248007400 con 0x7f225806f460 2024-09-19T05:47:39.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.075+0000 7f223ffff640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22440678c0 0x7f2244069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.079+0000 7f223ffff640 1 -- 172.21.15.67:0/2995042683 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5249+0+0 (secure 0 0 0) 0x7f2248085400 con 0x7f225806f460 2024-09-19T05:47:39.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.079+0000 7f22577fe640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22440678c0 0x7f2244069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.079+0000 7f22577fe640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22440678c0 0x7f2244069d80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f224c0098b0 tx=0x7f224c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:39.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.083+0000 7f223ffff640 1 -- 172.21.15.67:0/2995042683 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2248020020 con 0x7f225806f460 2024-09-19T05:47:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 -- 172.21.15.67:0/2995042683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f22580d0f20 con 0x7f225806f460 2024-09-19T05:47:39.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f223ffff640 1 -- 172.21.15.67:0/2995042683 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7f2248005480 con 0x7f225806f460 2024-09-19T05:47:39.300 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:39.300 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:47:39.300 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:47:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:47:39.302 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.303 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.304 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.305 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:47:39.306 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.307 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:47:39.308 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:47:39.309 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:47:39.310 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.311 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.312 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.313 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:47:39.314 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 -- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22440678c0 msgr2=0x7f2244069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22440678c0 0x7f2244069d80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f224c0098b0 tx=0x7f224c008040 comp rx=0 tx=0).stop 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 -- 172.21.15.67:0/2995042683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 msgr2=0x7f2258147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 0x7f2258147560 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f224800c450 tx=0x7f224800c910 comp rx=0 tx=0).stop 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 -- 172.21.15.67:0/2995042683 shutdown_connections 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f225815c030 0x7f225815d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f225806f460 0x7f2258147560 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f22440678c0 0x7f2244069d80 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 --2- 172.21.15.67:0/2995042683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f225806dde0 0x7f225814eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 -- 172.21.15.67:0/2995042683 >> 172.21.15.67:0/2995042683 conn(0x7f22580d0080 msgr2=0x7f225815adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:39.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 -- 172.21.15.67:0/2995042683 shutdown_connections 2024-09-19T05:47:39.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.303+0000 7f225e257640 1 -- 172.21.15.67:0/2995042683 wait complete. 2024-09-19T05:47:39.319 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:47:39.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.439+0000 7fc942cd1640 1 Processor -- start 2024-09-19T05:47:39.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.439+0000 7fc942cd1640 1 -- start start 2024-09-19T05:47:39.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc942cd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc93c15c030 0x7fc93c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc942cd1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc93c06f460 0x7fc93c06f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc942cd1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93c06e3c0 con 0x7fc93c15d1d0 2024-09-19T05:47:39.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc942cd1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc93c06e6a0 con 0x7fc93c06f460 2024-09-19T05:47:39.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc942cd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c06e980 con 0x7fc93c15c030 2024-09-19T05:47:39.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc94126e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc93c06f460 0x7fc93c06f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc94126e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc93c06f460 0x7fc93c06f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36226/0 (socket says 172.21.15.67:36226) 2024-09-19T05:47:39.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc94126e640 1 -- 172.21.15.67:0/2540863614 learned_addr learned my addr 172.21.15.67:0/2540863614 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:39.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc940a6d640 1 --2- 172.21.15.67:0/2540863614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc93c15c030 0x7fc93c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc94126e640 1 -- 172.21.15.67:0/2540863614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc93c15c030 msgr2=0x7fc93c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:39.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc94126e640 1 --2- 172.21.15.67:0/2540863614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc93c15c030 0x7fc93c06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc94126e640 1 -- 172.21.15.67:0/2540863614 >> v1:172.21.15.67:6789/0 conn(0x7fc93c15d1d0 legacy=0x7fc93c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc94126e640 1 -- 172.21.15.67:0/2540863614 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c06ec60 con 0x7fc93c06f460 2024-09-19T05:47:39.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc94126e640 1 --2- 172.21.15.67:0/2540863614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c06f460 0x7fc93c06f8d0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7fc934009e50 tx=0x7fc93401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353efdee2026eab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:39.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc93b7fe640 1 -- 172.21.15.67:0/2540863614 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340a57f0 con 0x7fc93c06f460 2024-09-19T05:47:39.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc93b7fe640 1 -- 172.21.15.67:0/2540863614 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340a5990 con 0x7fc93c06f460 2024-09-19T05:47:39.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.443+0000 7fc93b7fe640 1 -- 172.21.15.67:0/2540863614 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340a5d60 con 0x7fc93c06f460 2024-09-19T05:47:39.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- 172.21.15.67:0/2540863614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c06f460 msgr2=0x7fc93c06f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 --2- 172.21.15.67:0/2540863614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c06f460 0x7fc93c06f8d0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7fc934009e50 tx=0x7fc93401ca00 comp rx=0 tx=0).stop 2024-09-19T05:47:39.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- 172.21.15.67:0/2540863614 shutdown_connections 2024-09-19T05:47:39.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 --2- 172.21.15.67:0/2540863614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c06f460 0x7fc93c06f8d0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 --2- 172.21.15.67:0/2540863614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc93c15c030 0x7fc93c06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- 172.21.15.67:0/2540863614 >> 172.21.15.67:0/2540863614 conn(0x7fc93c0d0080 msgr2=0x7fc93c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:39.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- 172.21.15.67:0/2540863614 shutdown_connections 2024-09-19T05:47:39.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- 172.21.15.67:0/2540863614 wait complete. 2024-09-19T05:47:39.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 Processor -- start 2024-09-19T05:47:39.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- start start 2024-09-19T05:47:39.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc93c06f460 0x7fc93c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c15c030 0x7fc93c073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc93c15d1d0 0x7fc93c0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c15c590 con 0x7fc93c15c030 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c15c410 con 0x7fc93c15d1d0 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c1690e0 con 0x7fc93c06f460 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc93bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c15c030 0x7fc93c073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc93bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c15c030 0x7fc93c073780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36236/0 (socket says 172.21.15.67:36236) 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc93bfff640 1 -- 172.21.15.67:0/3051293565 learned_addr learned my addr 172.21.15.67:0/3051293565 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc93bfff640 1 -- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc93c06f460 msgr2=0x7fc93c15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc93bfff640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc93c06f460 0x7fc93c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc93bfff640 1 -- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc93c15d1d0 msgr2=0x7fc93c0afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc94126e640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc93c15d1d0 0x7fc93c0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc93bfff640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc93c15d1d0 0x7fc93c0afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc93bfff640 1 -- 172.21.15.67:0/3051293565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c15aef0 con 0x7fc93c15c030 2024-09-19T05:47:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc93bfff640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c15c030 0x7fc93c073780 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00c3c0 tx=0x7fc92c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc9397fa640 1 -- 172.21.15.67:0/3051293565 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c017070 con 0x7fc93c15c030 2024-09-19T05:47:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc9397fa640 1 -- 172.21.15.67:0/3051293565 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c0052d0 con 0x7fc93c15c030 2024-09-19T05:47:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- 172.21.15.67:0/3051293565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93c159630 con 0x7fc93c15c030 2024-09-19T05:47:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc9397fa640 1 -- 172.21.15.67:0/3051293565 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c003820 con 0x7fc93c15c030 2024-09-19T05:47:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.447+0000 7fc942cd1640 1 -- 172.21.15.67:0/3051293565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93c159bf0 con 0x7fc93c15c030 2024-09-19T05:47:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.451+0000 7fc942cd1640 1 -- 172.21.15.67:0/3051293565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93c06dde0 con 0x7fc93c15c030 2024-09-19T05:47:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.451+0000 7fc9397fa640 1 -- 172.21.15.67:0/3051293565 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc92c01a070 con 0x7fc93c15c030 2024-09-19T05:47:39.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.451+0000 7fc9397fa640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9280678c0 0x7fc928069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.451+0000 7fc9397fa640 1 -- 172.21.15.67:0/3051293565 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5249+0+0 (secure 0 0 0) 0x7fc92c084e10 con 0x7fc93c15c030 2024-09-19T05:47:39.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.451+0000 7fc940a6d640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9280678c0 0x7fc928069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.451+0000 7fc940a6d640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9280678c0 0x7fc928069d80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc9300098f0 tx=0x7fc930008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:39.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.455+0000 7fc9397fa640 1 -- 172.21.15.67:0/3051293565 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc92c005480 con 0x7fc93c15c030 2024-09-19T05:47:39.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.619+0000 7fc942cd1640 1 -- 172.21.15.67:0/3051293565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc93c150200 con 0x7fc93c15c030 2024-09-19T05:47:39.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.619+0000 7fc9397fa640 1 -- 172.21.15.67:0/3051293565 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v187) ==== 84+0+65 (secure 0 0 0) 0x7fc92c055b10 con 0x7fc93c15c030 2024-09-19T05:47:39.618 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:39.619 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:47:39.619 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:47:39.619 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:47:39.619 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:47:39.619 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:39.619 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:47:39.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 -- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9280678c0 msgr2=0x7fc928069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9280678c0 0x7fc928069d80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc9300098f0 tx=0x7fc930008040 comp rx=0 tx=0).stop 2024-09-19T05:47:39.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 -- 172.21.15.67:0/3051293565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c15c030 msgr2=0x7fc93c073780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c15c030 0x7fc93c073780 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00c3c0 tx=0x7fc92c00c880 comp rx=0 tx=0).stop 2024-09-19T05:47:39.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 -- 172.21.15.67:0/3051293565 shutdown_connections 2024-09-19T05:47:39.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc93c15d1d0 0x7fc93c0afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c15c030 0x7fc93c073780 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc9280678c0 0x7fc928069d80 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 --2- 172.21.15.67:0/3051293565 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc93c06f460 0x7fc93c15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 -- 172.21.15.67:0/3051293565 >> 172.21.15.67:0/3051293565 conn(0x7fc93c0d0080 msgr2=0x7fc93c15d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:39.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 -- 172.21.15.67:0/3051293565 shutdown_connections 2024-09-19T05:47:39.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.623+0000 7fc942cd1640 1 -- 172.21.15.67:0/3051293565 wait complete. 2024-09-19T05:47:39.638 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:47:39.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:47:39.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82efc3640 1 Processor -- start 2024-09-19T05:47:39.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82efc3640 1 -- start start 2024-09-19T05:47:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82efc3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff8280d0520 0x7ff8280d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82efc3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280addf0 0x7ff8280ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82efc3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8280b4e00 con 0x7ff8280738b0 2024-09-19T05:47:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82efc3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff8280d0ed0 con 0x7ff8280d0520 2024-09-19T05:47:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82efc3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff8280b3500 con 0x7ff8280addf0 2024-09-19T05:47:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82d560640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280addf0 0x7ff8280ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff827fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff8280d0520 0x7ff8280d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82d560640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280addf0 0x7ff8280ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:49296/0 (socket says 172.21.15.67:49296) 2024-09-19T05:47:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82cd5f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff8280738b0 0x7ff82815c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:57504/0 (socket says 172.21.15.67:57504) 2024-09-19T05:47:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff827fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff8280d0520 0x7ff8280d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:58344/0 (socket says 172.21.15.67:58344) 2024-09-19T05:47:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.759+0000 7ff82cd5f640 1 -- 172.21.15.67:0/2168517367 learned_addr learned my addr 172.21.15.67:0/2168517367 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.763+0000 7ff827fff640 1 -- 172.21.15.67:0/2168517367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280addf0 msgr2=0x7ff8280ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.763+0000 7ff827fff640 1 --2- 172.21.15.67:0/2168517367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280addf0 0x7ff8280ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.763+0000 7ff827fff640 1 -- 172.21.15.67:0/2168517367 >> v1:172.21.15.97:6789/0 conn(0x7ff8280738b0 legacy=0x7ff82815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.763+0000 7ff827fff640 1 -- 172.21.15.67:0/2168517367 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8280b37e0 con 0x7ff8280d0520 2024-09-19T05:47:39.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.763+0000 7ff827fff640 1 --2- 172.21.15.67:0/2168517367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8280d0520 0x7ff8280d0990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff8140097c0 tx=0x7ff81401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e3572a89520007e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:39.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.763+0000 7ff8277fe640 1 -- 172.21.15.67:0/2168517367 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8140b0070 con 0x7ff8280d0520 2024-09-19T05:47:39.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.763+0000 7ff8277fe640 1 -- 172.21.15.67:0/2168517367 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8140ab600 con 0x7ff8280d0520 2024-09-19T05:47:39.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.763+0000 7ff8277fe640 1 -- 172.21.15.67:0/2168517367 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8140ab9d0 con 0x7ff8280d0520 2024-09-19T05:47:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- 172.21.15.67:0/2168517367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8280d0520 msgr2=0x7ff8280d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 --2- 172.21.15.67:0/2168517367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8280d0520 0x7ff8280d0990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff8140097c0 tx=0x7ff81401c4a0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- 172.21.15.67:0/2168517367 shutdown_connections 2024-09-19T05:47:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 --2- 172.21.15.67:0/2168517367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280addf0 0x7ff8280ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 --2- 172.21.15.67:0/2168517367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8280d0520 0x7ff8280d0990 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- 172.21.15.67:0/2168517367 >> 172.21.15.67:0/2168517367 conn(0x7ff82806c0c0 msgr2=0x7ff82806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- 172.21.15.67:0/2168517367 shutdown_connections 2024-09-19T05:47:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- 172.21.15.67:0/2168517367 wait complete. 2024-09-19T05:47:39.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 Processor -- start 2024-09-19T05:47:39.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- start start 2024-09-19T05:47:39.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8280738b0 0x7ff828149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8280addf0 0x7ff828154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280d0520 0x7ff828155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff8280b30b0 con 0x7ff8280738b0 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff828073c90 con 0x7ff8280addf0 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff8280b3230 con 0x7ff8280d0520 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82cd5f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8280738b0 0x7ff828149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82cd5f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8280738b0 0x7ff828149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36246/0 (socket says 172.21.15.67:36246) 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82cd5f640 1 -- 172.21.15.67:0/1048665368 learned_addr learned my addr 172.21.15.67:0/1048665368 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82d560640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280d0520 0x7ff828155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff827fff640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8280addf0 0x7ff828154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82cd5f640 1 -- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280d0520 msgr2=0x7ff828155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82cd5f640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280d0520 0x7ff828155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82cd5f640 1 -- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8280addf0 msgr2=0x7ff828154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82cd5f640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8280addf0 0x7ff828154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82cd5f640 1 -- 172.21.15.67:0/1048665368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82815c140 con 0x7ff8280738b0 2024-09-19T05:47:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82cd5f640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8280738b0 0x7ff828149280 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c420 tx=0x7ff81c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff8257fa640 1 -- 172.21.15.67:0/1048665368 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c017070 con 0x7ff8280738b0 2024-09-19T05:47:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff8257fa640 1 -- 172.21.15.67:0/1048665368 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81c005cf0 con 0x7ff8280738b0 2024-09-19T05:47:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff8257fa640 1 -- 172.21.15.67:0/1048665368 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c0072f0 con 0x7ff8280738b0 2024-09-19T05:47:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- 172.21.15.67:0/1048665368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82815c420 con 0x7ff8280738b0 2024-09-19T05:47:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.767+0000 7ff82efc3640 1 -- 172.21.15.67:0/1048665368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff82815c9e0 con 0x7ff8280738b0 2024-09-19T05:47:39.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.771+0000 7ff82efc3640 1 -- 172.21.15.67:0/1048665368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8280ae220 con 0x7ff8280738b0 2024-09-19T05:47:39.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.771+0000 7ff8257fa640 1 -- 172.21.15.67:0/1048665368 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff81c01a070 con 0x7ff8280738b0 2024-09-19T05:47:39.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.771+0000 7ff8257fa640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff80c0678c0 0x7ff80c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:39.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.771+0000 7ff8257fa640 1 -- 172.21.15.67:0/1048665368 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5249+0+0 (secure 0 0 0) 0x7ff81c084ed0 con 0x7ff8280738b0 2024-09-19T05:47:39.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.771+0000 7ff827fff640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff80c0678c0 0x7ff80c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:39.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.771+0000 7ff827fff640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff80c0678c0 0x7ff80c069d80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff8140ad000 tx=0x7ff8140a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:39.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.775+0000 7ff8257fa640 1 -- 172.21.15.67:0/1048665368 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff81c055bd0 con 0x7ff8280738b0 2024-09-19T05:47:39.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:39.935+0000 7ff82efc3640 1 -- 172.21.15.67:0/1048665368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff8280b5390 con 0x7ff8280738b0 2024-09-19T05:47:40.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.915+0000 7ff8257fa640 1 -- 172.21.15.67:0/1048665368 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v188) ==== 138+0+0 (secure 0 0 0) 0x7ff81c0554d0 con 0x7ff8280738b0 2024-09-19T05:47:40.914 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 -- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff80c0678c0 msgr2=0x7ff80c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff80c0678c0 0x7ff80c069d80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff8140ad000 tx=0x7ff8140a6000 comp rx=0 tx=0).stop 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 -- 172.21.15.67:0/1048665368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8280738b0 msgr2=0x7ff828149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8280738b0 0x7ff828149280 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c420 tx=0x7ff81c00c8e0 comp rx=0 tx=0).stop 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 -- 172.21.15.67:0/1048665368 shutdown_connections 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff80c0678c0 0x7ff80c069d80 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8280d0520 0x7ff828155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8280addf0 0x7ff828154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 --2- 172.21.15.67:0/1048665368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8280738b0 0x7ff828149280 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 -- 172.21.15.67:0/1048665368 >> 172.21.15.67:0/1048665368 conn(0x7ff82806c0c0 msgr2=0x7ff828159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:40.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 -- 172.21.15.67:0/1048665368 shutdown_connections 2024-09-19T05:47:40.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:40.919+0000 7ff82efc3640 1 -- 172.21.15.67:0/1048665368 wait complete. 2024-09-19T05:47:40.945 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:47:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.083+0000 7fb1dfcbd640 1 Processor -- start 2024-09-19T05:47:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.083+0000 7fb1dfcbd640 1 -- start start 2024-09-19T05:47:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.083+0000 7fb1dfcbd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1d815b390 0x7fb1d80ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.083+0000 7fb1dfcbd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d806ef70 0x7fb1d80cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.083+0000 7fb1dfcbd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d80d0e60 con 0x7fb1d80cf5e0 2024-09-19T05:47:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dfcbd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb1d806f4c0 con 0x7fb1d815b390 2024-09-19T05:47:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dfcbd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d80d0930 con 0x7fb1d806ef70 2024-09-19T05:47:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dd258640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d806ef70 0x7fb1d80cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dd258640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d806ef70 0x7fb1d80cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:49320/0 (socket says 172.21.15.67:49320) 2024-09-19T05:47:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dda59640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1d815b390 0x7fb1d80ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dd258640 1 -- 172.21.15.67:0/233906996 learned_addr learned my addr 172.21.15.67:0/233906996 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:41.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dda59640 1 -- 172.21.15.67:0/233906996 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d806ef70 msgr2=0x7fb1d80cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:41.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dda59640 1 --2- 172.21.15.67:0/233906996 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d806ef70 0x7fb1d80cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:41.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dda59640 1 -- 172.21.15.67:0/233906996 >> v1:172.21.15.97:6789/0 conn(0x7fb1d80cf5e0 legacy=0x7fb1d80d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:41.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dda59640 1 -- 172.21.15.67:0/233906996 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d80d0b80 con 0x7fb1d815b390 2024-09-19T05:47:41.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dda59640 1 --2- 172.21.15.67:0/233906996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d815b390 0x7fb1d80ce440 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40097c0 tx=0x7fb1d401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0bd3f014df46b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:41.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dca57640 1 -- 172.21.15.67:0/233906996 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40b0070 con 0x7fb1d815b390 2024-09-19T05:47:41.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dca57640 1 -- 172.21.15.67:0/233906996 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d40a4e50 con 0x7fb1d815b390 2024-09-19T05:47:41.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dca57640 1 -- 172.21.15.67:0/233906996 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40ab820 con 0x7fb1d815b390 2024-09-19T05:47:41.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/233906996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d815b390 msgr2=0x7fb1d80ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:41.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.087+0000 7fb1dfcbd640 1 --2- 172.21.15.67:0/233906996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d815b390 0x7fb1d80ce440 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40097c0 tx=0x7fb1d401c410 comp rx=0 tx=0).stop 2024-09-19T05:47:41.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/233906996 shutdown_connections 2024-09-19T05:47:41.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 --2- 172.21.15.67:0/233906996 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d806ef70 0x7fb1d80cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:41.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 --2- 172.21.15.67:0/233906996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d815b390 0x7fb1d80ce440 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:41.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/233906996 >> 172.21.15.67:0/233906996 conn(0x7fb1d80b6570 msgr2=0x7fb1d80b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:41.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/233906996 shutdown_connections 2024-09-19T05:47:41.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/233906996 wait complete. 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 Processor -- start 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 -- start start 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d806ef70 0x7fb1d8146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d80cf5e0 0x7fb1d815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d815b390 0x7fb1d80b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d80cf9f0 con 0x7fb1d806ef70 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d80cd680 con 0x7fb1d815b390 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d80cfb70 con 0x7fb1d80cf5e0 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dda59640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d806ef70 0x7fb1d8146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dda59640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d806ef70 0x7fb1d8146c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36254/0 (socket says 172.21.15.67:36254) 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dda59640 1 -- 172.21.15.67:0/1213417834 learned_addr learned my addr 172.21.15.67:0/1213417834 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:41.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1de25a640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d815b390 0x7fb1d80b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dd258640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d80cf5e0 0x7fb1d815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dda59640 1 -- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d80cf5e0 msgr2=0x7fb1d815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dda59640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d80cf5e0 0x7fb1d815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dda59640 1 -- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d815b390 msgr2=0x7fb1d80b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dda59640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d815b390 0x7fb1d80b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dda59640 1 -- 172.21.15.67:0/1213417834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d81471b0 con 0x7fb1d806ef70 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dda59640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d806ef70 0x7fb1d8146c70 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7fb1d401a040 tx=0x7fb1d40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1ce7fc640 1 -- 172.21.15.67:0/1213417834 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40b8020 con 0x7fb1d806ef70 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/1213417834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d815c3e0 con 0x7fb1d806ef70 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1ce7fc640 1 -- 172.21.15.67:0/1213417834 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d40abdf0 con 0x7fb1d806ef70 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1ce7fc640 1 -- 172.21.15.67:0/1213417834 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40b0040 con 0x7fb1d806ef70 2024-09-19T05:47:41.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.091+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/1213417834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d80b23c0 con 0x7fb1d806ef70 2024-09-19T05:47:41.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.095+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/1213417834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d80cf0a0 con 0x7fb1d806ef70 2024-09-19T05:47:41.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.095+0000 7fb1ce7fc640 1 -- 172.21.15.67:0/1213417834 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1d40bb020 con 0x7fb1d806ef70 2024-09-19T05:47:41.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.095+0000 7fb1ce7fc640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1bc0678f0 0x7fb1bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:41.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.095+0000 7fb1ce7fc640 1 -- 172.21.15.67:0/1213417834 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5619+0+0 (secure 0 0 0) 0x7fb1d411f540 con 0x7fb1d806ef70 2024-09-19T05:47:41.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.095+0000 7fb1dd258640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1bc0678f0 0x7fb1bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:41.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.095+0000 7fb1dd258640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1bc0678f0 0x7fb1bc069db0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb1d81f6770 tx=0x7fb1c800b450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:41.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.099+0000 7fb1ce7fc640 1 -- 172.21.15.67:0/1213417834 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb1d40c2030 con 0x7fb1d806ef70 2024-09-19T05:47:41.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.263+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/1213417834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb1d80ce700 con 0x7fb1d806ef70 2024-09-19T05:47:41.267 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:47:41.270 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:47:41.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.927+0000 7fb1ce7fc640 1 -- 172.21.15.67:0/1213417834 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v189) ==== 170+0+0 (secure 0 0 0) 0x7fb1d4016090 con 0x7fb1d806ef70 2024-09-19T05:47:41.928 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:47:41.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1bc0678f0 msgr2=0x7fb1bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:41.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1bc0678f0 0x7fb1bc069db0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb1d81f6770 tx=0x7fb1c800b450 comp rx=0 tx=0).stop 2024-09-19T05:47:41.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/1213417834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d806ef70 msgr2=0x7fb1d8146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:41.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d806ef70 0x7fb1d8146c70 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7fb1d401a040 tx=0x7fb1d40191b0 comp rx=0 tx=0).stop 2024-09-19T05:47:41.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/1213417834 shutdown_connections 2024-09-19T05:47:41.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1d815b390 0x7fb1d80b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:41.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb1bc0678f0 0x7fb1bc069db0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:41.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1d80cf5e0 0x7fb1d815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:41.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 --2- 172.21.15.67:0/1213417834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1d806ef70 0x7fb1d8146c70 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:41.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/1213417834 >> 172.21.15.67:0/1213417834 conn(0x7fb1d80b6570 msgr2=0x7fb1d80ae410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:41.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/1213417834 shutdown_connections 2024-09-19T05:47:41.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:41.931+0000 7fb1dfcbd640 1 -- 172.21.15.67:0/1213417834 wait complete. 2024-09-19T05:47:41.962 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:47:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fb04f5640 1 Processor -- start 2024-09-19T05:47:42.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fb04f5640 1 -- start start 2024-09-19T05:47:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fb04f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0fa815b1d0 0x7f0fa80adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fb04f5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0fa806dfc0 0x7f0fa806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fb04f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa80aef30 con 0x7f0fa806fea0 2024-09-19T05:47:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fb04f5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa8072210 con 0x7f0fa806dfc0 2024-09-19T05:47:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fb04f5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa80ae0f0 con 0x7f0fa815b1d0 2024-09-19T05:47:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fada90640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0fa806dfc0 0x7f0fa806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fada90640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0fa806dfc0 0x7f0fa806f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36266/0 (socket says 172.21.15.67:36266) 2024-09-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fada90640 1 -- 172.21.15.67:0/4141388735 learned_addr learned my addr 172.21.15.67:0/4141388735 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fada90640 1 -- 172.21.15.67:0/4141388735 >> v2:172.21.15.97:3300/0 conn(0x7f0fa815b1d0 msgr2=0x7f0fa80adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fada90640 1 --2- 172.21.15.67:0/4141388735 >> v2:172.21.15.97:3300/0 conn(0x7f0fa815b1d0 0x7f0fa80adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fada90640 1 -- 172.21.15.67:0/4141388735 >> v1:172.21.15.97:6789/0 conn(0x7f0fa806fea0 legacy=0x7f0fa815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.087+0000 7f0fada90640 1 -- 172.21.15.67:0/4141388735 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa80ae3b0 con 0x7f0fa806dfc0 2024-09-19T05:47:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fada90640 1 --2- 172.21.15.67:0/4141388735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 0x7f0fa806f960 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80711d0 tx=0x7f0f9801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8d47a2d88177c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fad28f640 1 -- 172.21.15.67:0/4141388735 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f980b4070 con 0x7f0fa806dfc0 2024-09-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fad28f640 1 -- 172.21.15.67:0/4141388735 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f980a79a0 con 0x7f0fa806dfc0 2024-09-19T05:47:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fad28f640 1 -- 172.21.15.67:0/4141388735 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f980a7d70 con 0x7f0fa806dfc0 2024-09-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 -- 172.21.15.67:0/4141388735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 msgr2=0x7f0fa806f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 --2- 172.21.15.67:0/4141388735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 0x7f0fa806f960 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80711d0 tx=0x7f0f9801ebb0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 -- 172.21.15.67:0/4141388735 shutdown_connections 2024-09-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 --2- 172.21.15.67:0/4141388735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 0x7f0fa806f960 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 --2- 172.21.15.67:0/4141388735 >> v2:172.21.15.97:3300/0 conn(0x7f0fa815b1d0 0x7f0fa80adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 -- 172.21.15.67:0/4141388735 >> 172.21.15.67:0/4141388735 conn(0x7f0fa80b1e50 msgr2=0x7f0fa80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 -- 172.21.15.67:0/4141388735 shutdown_connections 2024-09-19T05:47:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 -- 172.21.15.67:0/4141388735 wait complete. 2024-09-19T05:47:42.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 Processor -- start 2024-09-19T05:47:42.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 -- start start 2024-09-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 0x7f0fa814d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fa806fea0 0x7f0fa8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fa815b1d0 0x7f0fa8154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:42.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa80b4440 con 0x7f0fa806dfc0 2024-09-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa8072420 con 0x7f0fa815b1d0 2024-09-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fb04f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa806e850 con 0x7f0fa806fea0 2024-09-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fae291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 0x7f0fa814d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fae291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 0x7f0fa814d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36278/0 (socket says 172.21.15.67:36278) 2024-09-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.091+0000 7f0fae291640 1 -- 172.21.15.67:0/3297221818 learned_addr learned my addr 172.21.15.67:0/3297221818 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0faea92640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fa815b1d0 0x7f0fa8154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fada90640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fa806fea0 0x7f0fa8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fae291640 1 -- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fa806fea0 msgr2=0x7f0fa8153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:42.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fae291640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fa806fea0 0x7f0fa8153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fae291640 1 -- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fa815b1d0 msgr2=0x7f0fa8154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fae291640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fa815b1d0 0x7f0fa8154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fae291640 1 -- 172.21.15.67:0/3297221818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa80735d0 con 0x7f0fa806dfc0 2024-09-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0faea92640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fa815b1d0 0x7f0fa8154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fae291640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 0x7f0fa814d6b0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400b410 tx=0x7f0fa400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0f9effd640 1 -- 172.21.15.67:0/3297221818 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4015020 con 0x7f0fa806dfc0 2024-09-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0f9effd640 1 -- 172.21.15.67:0/3297221818 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa4011830 con 0x7f0fa806dfc0 2024-09-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0f9effd640 1 -- 172.21.15.67:0/3297221818 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4011c20 con 0x7f0fa806dfc0 2024-09-19T05:47:42.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fb04f5640 1 -- 172.21.15.67:0/3297221818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa815b7c0 con 0x7f0fa806dfc0 2024-09-19T05:47:42.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fb04f5640 1 -- 172.21.15.67:0/3297221818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa815bd80 con 0x7f0fa806dfc0 2024-09-19T05:47:42.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fb04f5640 1 -- 172.21.15.67:0/3297221818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa80adbb0 con 0x7f0fa806dfc0 2024-09-19T05:47:42.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0f9effd640 1 -- 172.21.15.67:0/3297221818 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0fa4018020 con 0x7f0fa806dfc0 2024-09-19T05:47:42.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0f9effd640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f8c0678c0 0x7f0f8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:42.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0f9effd640 1 -- 172.21.15.67:0/3297221818 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6001+0+0 (secure 0 0 0) 0x7f0fa4085c30 con 0x7f0fa806dfc0 2024-09-19T05:47:42.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fada90640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f8c0678c0 0x7f0f8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:42.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.095+0000 7f0fada90640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f8c0678c0 0x7f0f8c069d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0f980b1000 tx=0x7f0f980a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:42.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.099+0000 7f0f9effd640 1 -- 172.21.15.67:0/3297221818 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0fa401f020 con 0x7f0fa806dfc0 2024-09-19T05:47:42.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.299+0000 7f0fb04f5640 1 -- 172.21.15.67:0/3297221818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0fa8072740 con 0x7f0fa806dfc0 2024-09-19T05:47:42.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.955+0000 7f0f9effd640 1 -- 172.21.15.67:0/3297221818 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 27 and data pool 28 v134) ==== 174+0+0 (secure 0 0 0) 0x7f0fa40172c0 con 0x7f0fa806dfc0 2024-09-19T05:47:42.953 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 27 and data pool 28 2024-09-19T05:47:42.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 -- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f8c0678c0 msgr2=0x7f0f8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:42.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f8c0678c0 0x7f0f8c069d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0f980b1000 tx=0x7f0f980a9070 comp rx=0 tx=0).stop 2024-09-19T05:47:42.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 -- 172.21.15.67:0/3297221818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 msgr2=0x7f0fa814d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:42.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 0x7f0fa814d6b0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400b410 tx=0x7f0fa400b8d0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 -- 172.21.15.67:0/3297221818 shutdown_connections 2024-09-19T05:47:42.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fa815b1d0 0x7f0fa8154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0f8c0678c0 0x7f0f8c069d80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fa806fea0 0x7f0fa8153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 --2- 172.21.15.67:0/3297221818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fa806dfc0 0x7f0fa814d6b0 secure :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400b410 tx=0x7f0fa400b8d0 comp rx=0 tx=0).stop 2024-09-19T05:47:42.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 -- 172.21.15.67:0/3297221818 >> 172.21.15.67:0/3297221818 conn(0x7f0fa80b1e50 msgr2=0x7f0fa806ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:42.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 -- 172.21.15.67:0/3297221818 shutdown_connections 2024-09-19T05:47:42.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:42.963+0000 7f0fb04f5640 1 -- 172.21.15.67:0/3297221818 wait complete. 2024-09-19T05:47:42.994 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:47:43.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed49e9f640 1 Processor -- start 2024-09-19T05:47:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed49e9f640 1 -- start start 2024-09-19T05:47:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed49e9f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fed4406bcc0 0x7fed4406c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed49e9f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed441559d0 con 0x7fed440ae1e0 2024-09-19T05:47:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed49e9f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed4406c620 con 0x7fed441555f0 2024-09-19T05:47:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed49e9f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fed4415f8a0 con 0x7fed4406bcc0 2024-09-19T05:47:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed43fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fed440ae1e0 0x7fed440ae600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42852/0 (socket says 172.21.15.67:42852) 2024-09-19T05:47:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed43fff640 1 -- 172.21.15.67:0/1199695456 learned_addr learned my addr 172.21.15.67:0/1199695456 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed42ffd640 1 --2- 172.21.15.67:0/1199695456 >> v2:172.21.15.97:3300/0 conn(0x7fed4406bcc0 0x7fed4406c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437681513 0 0) 0x7fed441559d0 con 0x7fed440ae1e0 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed2c003530 con 0x7fed440ae1e0 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 15572158 0 0) 0x7fed2c003530 con 0x7fed440ae1e0 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 >> v2:172.21.15.97:3300/0 conn(0x7fed4406bcc0 msgr2=0x7fed4406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 --2- 172.21.15.67:0/1199695456 >> v2:172.21.15.97:3300/0 conn(0x7fed4406bcc0 0x7fed4406c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 >> v1:172.21.15.97:6789/0 conn(0x7fed441555f0 legacy=0x7fed440b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4415ec90 con 0x7fed440ae1e0 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fed3c001a00 con 0x7fed440ae1e0 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 >> v1:172.21.15.67:6789/0 conn(0x7fed440ae1e0 legacy=0x7fed440ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed2c0039c0 0x7fed2c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed2c004810 0x7fed2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed2c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c00c040 con 0x7fed2c0051d0 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c00c1f0 con 0x7fed2c004810 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fed2c00c3f0 con 0x7fed2c0039c0 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed43fff640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed2c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed437fe640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed2c0039c0 0x7fed2c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed42ffd640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed2c004810 0x7fed2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed43fff640 1 -- 172.21.15.67:0/1199695456 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed2c0039c0 msgr2=0x7fed2c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed43fff640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed2c0039c0 0x7fed2c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed43fff640 1 -- 172.21.15.67:0/1199695456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed2c004810 msgr2=0x7fed2c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed43fff640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed2c004810 0x7fed2c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.115+0000 7fed43fff640 1 -- 172.21.15.67:0/1199695456 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c003530 con 0x7fed2c0051d0 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed43fff640 1 -- 172.21.15.67:0/1199695456 reap_dead start 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed43fff640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed2c00b9d0 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00a830 tx=0x7fed3c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c123342cd7e26c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00a480 con 0x7fed2c0051d0 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3c0ac640 con 0x7fed2c0051d0 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed427fc640 1 -- 172.21.15.67:0/1199695456 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0aca30 con 0x7fed2c0051d0 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed49e9f640 1 -- 172.21.15.67:0/1199695456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 msgr2=0x7fed2c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed49e9f640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed2c00b9d0 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00a830 tx=0x7fed3c01d360 comp rx=0 tx=0).stop 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed49e9f640 1 -- 172.21.15.67:0/1199695456 shutdown_connections 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed49e9f640 1 --2- 172.21.15.67:0/1199695456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed2c00b9d0 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed49e9f640 1 -- 172.21.15.67:0/1199695456 >> 172.21.15.67:0/1199695456 conn(0x7fed4409aa30 msgr2=0x7fed440b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:43.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed49e9f640 1 -- 172.21.15.67:0/1199695456 shutdown_connections 2024-09-19T05:47:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.119+0000 7fed49e9f640 1 -- 172.21.15.67:0/1199695456 wait complete. 2024-09-19T05:47:43.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 Processor -- start 2024-09-19T05:47:43.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 -- start start 2024-09-19T05:47:43.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed441f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed44152c40 0x7fed4409b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed4409d850 0x7fed4409dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed4415f250 con 0x7fed2c0051d0 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fed4415ef70 con 0x7fed44152c40 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fed4415f530 con 0x7fed4409d850 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed437fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed441f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed437fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed441f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36284/0 (socket says 172.21.15.67:36284) 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed437fe640 1 -- 172.21.15.67:0/2647240622 learned_addr learned my addr 172.21.15.67:0/2647240622 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed42ffd640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed44152c40 0x7fed4409b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed43fff640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed4409d850 0x7fed4409dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed437fe640 1 -- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed4409d850 msgr2=0x7fed4409dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed437fe640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed4409d850 0x7fed4409dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed437fe640 1 -- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed44152c40 msgr2=0x7fed4409b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed437fe640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed44152c40 0x7fed4409b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed437fe640 1 -- 172.21.15.67:0/2647240622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4409b900 con 0x7fed2c0051d0 2024-09-19T05:47:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed437fe640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed441f3f20 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7fed3400e4b0 tx=0x7fed3400e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed2bfff640 1 -- 172.21.15.67:0/2647240622 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed340052e0 con 0x7fed2c0051d0 2024-09-19T05:47:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed2bfff640 1 -- 172.21.15.67:0/2647240622 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed34018070 con 0x7fed2c0051d0 2024-09-19T05:47:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 -- 172.21.15.67:0/2647240622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4409bbe0 con 0x7fed2c0051d0 2024-09-19T05:47:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed2bfff640 1 -- 172.21.15.67:0/2647240622 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34005480 con 0x7fed2c0051d0 2024-09-19T05:47:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 -- 172.21.15.67:0/2647240622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4409c1a0 con 0x7fed2c0051d0 2024-09-19T05:47:43.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed49e9f640 1 -- 172.21.15.67:0/2647240622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed440b6ef0 con 0x7fed2c0051d0 2024-09-19T05:47:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.123+0000 7fed2bfff640 1 -- 172.21.15.67:0/2647240622 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed34003840 con 0x7fed2c0051d0 2024-09-19T05:47:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.127+0000 7fed2bfff640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed300678c0 0x7fed30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.127+0000 7fed2bfff640 1 -- 172.21.15.67:0/2647240622 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6101+0+0 (secure 0 0 0) 0x7fed340863e0 con 0x7fed2c0051d0 2024-09-19T05:47:43.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.127+0000 7fed42ffd640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed300678c0 0x7fed30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.127+0000 7fed42ffd640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed300678c0 0x7fed30069d80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fed4415c930 tx=0x7fed38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:43.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.131+0000 7fed2bfff640 1 -- 172.21.15.67:0/2647240622 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fed34056f00 con 0x7fed2c0051d0 2024-09-19T05:47:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.291+0000 7fed49e9f640 1 -- 172.21.15.67:0/2647240622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed4415d960 con 0x7fed2c0051d0 2024-09-19T05:47:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.295+0000 7fed2bfff640 1 -- 172.21.15.67:0/2647240622 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) ==== 74+0+16989 (secure 0 0 0) 0x7fed3405d0d0 con 0x7fed2c0051d0 2024-09-19T05:47:43.294 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:43.294 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":190,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:47:42.303466+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:47:39.977348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-19T05:47:41.308745+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:47:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 -- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed300678c0 msgr2=0x7fed30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed300678c0 0x7fed30069d80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fed4415c930 tx=0x7fed38008040 comp rx=0 tx=0).stop 2024-09-19T05:47:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 -- 172.21.15.67:0/2647240622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 msgr2=0x7fed441f3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed441f3f20 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7fed3400e4b0 tx=0x7fed3400e970 comp rx=0 tx=0).stop 2024-09-19T05:47:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 -- 172.21.15.67:0/2647240622 shutdown_connections 2024-09-19T05:47:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed300678c0 0x7fed30069d80 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed4409d850 0x7fed4409dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed44152c40 0x7fed4409b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 --2- 172.21.15.67:0/2647240622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed2c0051d0 0x7fed441f3f20 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 -- 172.21.15.67:0/2647240622 >> 172.21.15.67:0/2647240622 conn(0x7fed4409aa30 msgr2=0x7fed44153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 -- 172.21.15.67:0/2647240622 shutdown_connections 2024-09-19T05:47:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.299+0000 7fed49e9f640 1 -- 172.21.15.67:0/2647240622 wait complete. 2024-09-19T05:47:43.314 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:47:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f65adfde640 1 Processor -- start 2024-09-19T05:47:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f65adfde640 1 -- start start 2024-09-19T05:47:43.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f65adfde640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65a815c740 0x7f65a815cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f65adfde640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a8068160 con 0x7f65a815d4d0 2024-09-19T05:47:43.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f65adfde640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a8067ba0 con 0x7f65a815c360 2024-09-19T05:47:43.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f65adfde640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f65a806f680 con 0x7f65a815c740 2024-09-19T05:47:43.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f659effd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f65a815d4d0 0x7f65a80b0050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42868/0 (socket says 172.21.15.67:42868) 2024-09-19T05:47:43.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f659effd640 1 -- 172.21.15.67:0/3659202568 learned_addr learned my addr 172.21.15.67:0/3659202568 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f65a7fff640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65a815c740 0x7f65a815cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649046698 0 0) 0x7f65a8068160 con 0x7f65a815d4d0 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.431+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6594003530 con 0x7f65a815d4d0 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3952798562 0 0) 0x7f6594003530 con 0x7f65a815d4d0 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65a815c740 msgr2=0x7f65a815cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65a815c740 0x7f65a815cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 >> v1:172.21.15.97:6789/0 conn(0x7f65a815c360 legacy=0x7f65a806fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a8067e80 con 0x7f65a815d4d0 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6590001680 con 0x7f65a815d4d0 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 >> v1:172.21.15.67:6789/0 conn(0x7f65a815d4d0 legacy=0x7f65a80b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65940039f0 0x7f6594003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6594004810 0x7f6594004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65a815c740 0x7f659400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f65a806f680 con 0x7f65940039f0 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6594005530 con 0x7f6594004810 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f659400bf10 con 0x7f65a815c740 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a77fe640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65940039f0 0x7f6594003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f659effd640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6594004810 0x7f6594004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a7fff640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65a815c740 0x7f659400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a77fe640 1 -- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65a815c740 msgr2=0x7f659400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a77fe640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65a815c740 0x7f659400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a77fe640 1 -- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6594004810 msgr2=0x7f6594004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a77fe640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6594004810 0x7f6594004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a77fe640 1 -- 172.21.15.67:0/3659202568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6594003530 con 0x7f65940039f0 2024-09-19T05:47:43.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f659effd640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6594004810 0x7f6594004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a77fe640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65940039f0 0x7f6594003e10 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f6598001780 tx=0x7f659801c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5d4e6426178e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65980013a0 con 0x7f65940039f0 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65980052f0 con 0x7f65940039f0 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a6ffd640 1 -- 172.21.15.67:0/3659202568 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598003840 con 0x7f65940039f0 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65adfde640 1 -- 172.21.15.67:0/3659202568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65940039f0 msgr2=0x7f6594003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65adfde640 1 --2- 172.21.15.67:0/3659202568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65940039f0 0x7f6594003e10 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f6598001780 tx=0x7f659801c0d0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65a7fff640 1 -- 172.21.15.67:0/3659202568 reap_dead start 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65adfde640 1 -- 172.21.15.67:0/3659202568 shutdown_connections 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65adfde640 1 -- 172.21.15.67:0/3659202568 >> 172.21.15.67:0/3659202568 conn(0x7f65a8073500 msgr2=0x7f65a806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65adfde640 1 -- 172.21.15.67:0/3659202568 shutdown_connections 2024-09-19T05:47:43.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.435+0000 7f65adfde640 1 -- 172.21.15.67:0/3659202568 wait complete. 2024-09-19T05:47:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 Processor -- start 2024-09-19T05:47:43.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 -- start start 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65940039f0 0x7f65a8145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65a81460b0 0x7f65a814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a81501a0 0x7f65a8150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8168550 con 0x7f65a81460b0 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f65a81683d0 con 0x7f65a81501a0 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f65a81686d0 con 0x7f65940039f0 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f659effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65a81460b0 0x7f65a814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f659effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65a81460b0 0x7f65a814fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36302/0 (socket says 172.21.15.67:36302) 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f659effd640 1 -- 172.21.15.67:0/747564181 learned_addr learned my addr 172.21.15.67:0/747564181 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65a77fe640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65940039f0 0x7f65a8145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65a7fff640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a81501a0 0x7f65a8150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f659effd640 1 -- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65940039f0 msgr2=0x7f65a8145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f659effd640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65940039f0 0x7f65a8145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f659effd640 1 -- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a81501a0 msgr2=0x7f65a8150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f659effd640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a81501a0 0x7f65a8150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f659effd640 1 -- 172.21.15.67:0/747564181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a814c810 con 0x7f65a81460b0 2024-09-19T05:47:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f659effd640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65a81460b0 0x7f65a814fc60 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f6590000fc0 tx=0x7f659000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65a4ff9640 1 -- 172.21.15.67:0/747564181 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590019070 con 0x7f65a81460b0 2024-09-19T05:47:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65a4ff9640 1 -- 172.21.15.67:0/747564181 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65900072d0 con 0x7f65a81460b0 2024-09-19T05:47:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 -- 172.21.15.67:0/747564181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a814caf0 con 0x7f65a81460b0 2024-09-19T05:47:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65a4ff9640 1 -- 172.21.15.67:0/747564181 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65900047f0 con 0x7f65a81460b0 2024-09-19T05:47:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 -- 172.21.15.67:0/747564181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a814d0b0 con 0x7f65a81460b0 2024-09-19T05:47:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.439+0000 7f65adfde640 1 -- 172.21.15.67:0/747564181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a814d490 con 0x7f65a81460b0 2024-09-19T05:47:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.443+0000 7f65a4ff9640 1 -- 172.21.15.67:0/747564181 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f659001c070 con 0x7f65a81460b0 2024-09-19T05:47:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.443+0000 7f65a4ff9640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65880678f0 0x7f6588069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.443+0000 7f65a4ff9640 1 -- 172.21.15.67:0/747564181 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6101+0+0 (secure 0 0 0) 0x7f6590085b40 con 0x7f65a81460b0 2024-09-19T05:47:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.443+0000 7f65a77fe640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65880678f0 0x7f6588069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.443+0000 7f65a77fe640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65880678f0 0x7f6588069db0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6598001750 tx=0x7f65980011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.447+0000 7f65a4ff9640 1 -- 172.21.15.67:0/747564181 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f65a814d490 con 0x7f65a81460b0 2024-09-19T05:47:43.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.611+0000 7f65adfde640 1 -- 172.21.15.67:0/747564181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65a806fb10 con 0x7f65a81460b0 2024-09-19T05:47:43.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65a4ff9640 1 -- 172.21.15.67:0/747564181 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) ==== 74+0+16989 (secure 0 0 0) 0x7f6590023020 con 0x7f65a81460b0 2024-09-19T05:47:43.612 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:43.612 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":190,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:47:42.303466+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:47:39.977348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-19T05:47:41.308745+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:47:43.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 -- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65880678f0 msgr2=0x7f6588069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65880678f0 0x7f6588069db0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6598001750 tx=0x7f65980011a0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 -- 172.21.15.67:0/747564181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65a81460b0 msgr2=0x7f65a814fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65a81460b0 0x7f65a814fc60 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f6590000fc0 tx=0x7f659000db50 comp rx=0 tx=0).stop 2024-09-19T05:47:43.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 -- 172.21.15.67:0/747564181 shutdown_connections 2024-09-19T05:47:43.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a81501a0 0x7f65a8150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65a81460b0 0x7f65a814fc60 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f65880678f0 0x7f6588069db0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 --2- 172.21.15.67:0/747564181 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65940039f0 0x7f65a8145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 -- 172.21.15.67:0/747564181 >> 172.21.15.67:0/747564181 conn(0x7f65a8073500 msgr2=0x7f65a815e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:43.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 -- 172.21.15.67:0/747564181 shutdown_connections 2024-09-19T05:47:43.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.615+0000 7f65adfde640 1 -- 172.21.15.67:0/747564181 wait complete. 2024-09-19T05:47:43.632 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:47:43.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f099ed640 1 Processor -- start 2024-09-19T05:47:43.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f099ed640 1 -- start start 2024-09-19T05:47:43.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f099ed640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5f0406dfc0 0x7f5f0406f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f099ed640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f0406fea0 0x7f5f040b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f099ed640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f040aef30 con 0x7f5f0415b1d0 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f099ed640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5f04072210 con 0x7f5f0406dfc0 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f099ed640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5f040ae3b0 con 0x7f5f0406fea0 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f027fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5f0406dfc0 0x7f5f0406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f027fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5f0406dfc0 0x7f5f0406f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36312/0 (socket says 172.21.15.67:36312) 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f027fc640 1 -- 172.21.15.67:0/3226273724 learned_addr learned my addr 172.21.15.67:0/3226273724 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f037fe640 1 --2- 172.21.15.67:0/3226273724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f0406fea0 0x7f5f040b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f027fc640 1 -- 172.21.15.67:0/3226273724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f0406fea0 msgr2=0x7f5f040b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f027fc640 1 --2- 172.21.15.67:0/3226273724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f0406fea0 0x7f5f040b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f027fc640 1 -- 172.21.15.67:0/3226273724 >> v1:172.21.15.67:6789/0 conn(0x7f5f0415b1d0 legacy=0x7f5f040adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.759+0000 7f5f027fc640 1 -- 172.21.15.67:0/3226273724 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f040ae690 con 0x7f5f0406dfc0 2024-09-19T05:47:43.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f027fc640 1 --2- 172.21.15.67:0/3226273724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406dfc0 0x7f5f0406f960 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009870 tx=0x7f5ef801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210a4c87d2241adb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f01ffb640 1 -- 172.21.15.67:0/3226273724 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80b2070 con 0x7f5f0406dfc0 2024-09-19T05:47:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f01ffb640 1 -- 172.21.15.67:0/3226273724 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef80a9070 con 0x7f5f0406dfc0 2024-09-19T05:47:43.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f01ffb640 1 -- 172.21.15.67:0/3226273724 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80ad880 con 0x7f5f0406dfc0 2024-09-19T05:47:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f099ed640 1 -- 172.21.15.67:0/3226273724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406dfc0 msgr2=0x7f5f0406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f099ed640 1 --2- 172.21.15.67:0/3226273724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406dfc0 0x7f5f0406f960 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009870 tx=0x7f5ef801c560 comp rx=0 tx=0).stop 2024-09-19T05:47:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f099ed640 1 -- 172.21.15.67:0/3226273724 shutdown_connections 2024-09-19T05:47:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f099ed640 1 --2- 172.21.15.67:0/3226273724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f0406fea0 0x7f5f040b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f099ed640 1 --2- 172.21.15.67:0/3226273724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406dfc0 0x7f5f0406f960 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f099ed640 1 -- 172.21.15.67:0/3226273724 >> 172.21.15.67:0/3226273724 conn(0x7f5f040b1e50 msgr2=0x7f5f040b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f099ed640 1 -- 172.21.15.67:0/3226273724 shutdown_connections 2024-09-19T05:47:43.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f099ed640 1 -- 172.21.15.67:0/3226273724 wait complete. 2024-09-19T05:47:43.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f099ed640 1 Processor -- start 2024-09-19T05:47:43.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.763+0000 7f5f099ed640 1 -- start start 2024-09-19T05:47:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f099ed640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f0406dfc0 0x7f5f040992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f099ed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406fea0 0x7f5f04155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f099ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f0415b1d0 0x7f5f04153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f099ed640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5f040b4300 con 0x7f5f0406fea0 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f099ed640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5f040b4180 con 0x7f5f0415b1d0 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f099ed640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5f040b4480 con 0x7f5f0406dfc0 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f027fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406fea0 0x7f5f04155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f027fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406fea0 0x7f5f04155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36324/0 (socket says 172.21.15.67:36324) 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f027fc640 1 -- 172.21.15.67:0/2531363048 learned_addr learned my addr 172.21.15.67:0/2531363048 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f02ffd640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f0406dfc0 0x7f5f040992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f037fe640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f0415b1d0 0x7f5f04153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f027fc640 1 -- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f0406dfc0 msgr2=0x7f5f040992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f027fc640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f0406dfc0 0x7f5f040992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f027fc640 1 -- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f0415b1d0 msgr2=0x7f5f04153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f027fc640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f0415b1d0 0x7f5f04153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f027fc640 1 -- 172.21.15.67:0/2531363048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f04099b90 con 0x7f5f0406fea0 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f027fc640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406fea0 0x7f5f04155c10 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80b0040 tx=0x7f5ef8019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5eebfff640 1 -- 172.21.15.67:0/2531363048 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80b2040 con 0x7f5f0406fea0 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5eebfff640 1 -- 172.21.15.67:0/2531363048 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef80adb20 con 0x7f5f0406fea0 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f099ed640 1 -- 172.21.15.67:0/2531363048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f04152a20 con 0x7f5f0406fea0 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5eebfff640 1 -- 172.21.15.67:0/2531363048 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80b6410 con 0x7f5f0406fea0 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f099ed640 1 -- 172.21.15.67:0/2531363048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f04152fe0 con 0x7f5f0406fea0 2024-09-19T05:47:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f099ed640 1 -- 172.21.15.67:0/2531363048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f040b3430 con 0x7f5f0406fea0 2024-09-19T05:47:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5eebfff640 1 -- 172.21.15.67:0/2531363048 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ef80be020 con 0x7f5f0406fea0 2024-09-19T05:47:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5eebfff640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ef00678c0 0x7f5ef0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5eebfff640 1 -- 172.21.15.67:0/2531363048 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6101+0+0 (secure 0 0 0) 0x7f5ef811f130 con 0x7f5f0406fea0 2024-09-19T05:47:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.767+0000 7f5f02ffd640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ef00678c0 0x7f5ef0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.771+0000 7f5f02ffd640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ef00678c0 0x7f5ef0069d80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5f0415fd40 tx=0x7f5ef4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:43.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.771+0000 7f5eebfff640 1 -- 172.21.15.67:0/2531363048 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5ef80c5020 con 0x7f5f0406fea0 2024-09-19T05:47:43.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:43.975+0000 7f5f099ed640 1 -- 172.21.15.67:0/2531363048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5f040b10b0 con 0x7f5f0406fea0 2024-09-19T05:47:44.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5eebfff640 1 -- 172.21.15.67:0/2531363048 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v137) ==== 118+0+0 (secure 0 0 0) 0x7f5ef8016150 con 0x7f5f0406fea0 2024-09-19T05:47:44.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 -- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ef00678c0 msgr2=0x7f5ef0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:44.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ef00678c0 0x7f5ef0069d80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5f0415fd40 tx=0x7f5ef4009040 comp rx=0 tx=0).stop 2024-09-19T05:47:44.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 -- 172.21.15.67:0/2531363048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406fea0 msgr2=0x7f5f04155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406fea0 0x7f5f04155c10 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80b0040 tx=0x7f5ef8019300 comp rx=0 tx=0).stop 2024-09-19T05:47:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 -- 172.21.15.67:0/2531363048 shutdown_connections 2024-09-19T05:47:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f0415b1d0 0x7f5f04153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0406fea0 0x7f5f04155c10 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ef00678c0 0x7f5ef0069d80 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 --2- 172.21.15.67:0/2531363048 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f0406dfc0 0x7f5f040992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 -- 172.21.15.67:0/2531363048 >> 172.21.15.67:0/2531363048 conn(0x7f5f040b1e50 msgr2=0x7f5f040b4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 -- 172.21.15.67:0/2531363048 shutdown_connections 2024-09-19T05:47:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:44.971+0000 7f5f099ed640 1 -- 172.21.15.67:0/2531363048 wait complete. 2024-09-19T05:47:44.994 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:47:44.994 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:47:45.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.131+0000 7f7f4b518640 1 Processor -- start 2024-09-19T05:47:45.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.131+0000 7f7f4b518640 1 -- start start 2024-09-19T05:47:45.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f4b518640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4415cc30 0x7f7f440aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:45.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f4b518640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f440ada80 con 0x7f7f44071f60 2024-09-19T05:47:45.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f4b518640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f440add60 con 0x7f7f441639f0 2024-09-19T05:47:45.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f4b518640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7f440ad840 con 0x7f7f4415cc30 2024-09-19T05:47:45.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f49ab5640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7f44071f60 0x7f7f440b3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42880/0 (socket says 172.21.15.67:42880) 2024-09-19T05:47:45.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f49ab5640 1 -- 172.21.15.67:0/382362442 learned_addr learned my addr 172.21.15.67:0/382362442 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:45.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f492b4640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4415cc30 0x7f7f440aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:45.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395480555 0 0) 0x7f7f440ada80 con 0x7f7f44071f60 2024-09-19T05:47:45.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f2c003530 con 0x7f7f44071f60 2024-09-19T05:47:45.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2885758407 0 0) 0x7f7f2c003530 con 0x7f7f44071f60 2024-09-19T05:47:45.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4415cc30 msgr2=0x7f7f440aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:45.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4415cc30 0x7f7f440aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:45.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 >> v1:172.21.15.97:6789/0 conn(0x7f7f441639f0 legacy=0x7f7f440ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:45.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f440ae040 con 0x7f7f44071f60 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7f3c001680 con 0x7f7f44071f60 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 >> v1:172.21.15.67:6789/0 conn(0x7f7f44071f60 legacy=0x7f7f440b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f2c0039f0 0x7f7f2c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f2c004810 0x7f7f2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4415cc30 0x7f7f2c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7f440ad840 con 0x7f7f2c0039f0 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c00bb00 con 0x7f7f2c004810 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c00bd00 con 0x7f7f4415cc30 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f492b4640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f2c0039f0 0x7f7f2c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f49ab5640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4415cc30 0x7f7f2c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f48ab3640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f2c004810 0x7f7f2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f492b4640 1 -- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4415cc30 msgr2=0x7f7f2c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f492b4640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4415cc30 0x7f7f2c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:45.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f492b4640 1 -- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f2c004810 msgr2=0x7f7f2c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:45.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f492b4640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f2c004810 0x7f7f2c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:45.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f492b4640 1 -- 172.21.15.67:0/382362442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c003530 con 0x7f7f2c0039f0 2024-09-19T05:47:45.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.135+0000 7f7f49ab5640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4415cc30 0x7f7f2c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:45.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f492b4640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f2c0039f0 0x7f7f2c003e10 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009ae0 tx=0x7f7f3401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9655cc755ca6810 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:45.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f340096b0 con 0x7f7f2c0039f0 2024-09-19T05:47:45.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f340a6450 con 0x7f7f2c0039f0 2024-09-19T05:47:45.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f43fff640 1 -- 172.21.15.67:0/382362442 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f340a6840 con 0x7f7f2c0039f0 2024-09-19T05:47:45.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f4b518640 1 -- 172.21.15.67:0/382362442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f2c0039f0 msgr2=0x7f7f2c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:45.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f4b518640 1 --2- 172.21.15.67:0/382362442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f2c0039f0 0x7f7f2c003e10 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009ae0 tx=0x7f7f3401ca70 comp rx=0 tx=0).stop 2024-09-19T05:47:45.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f49ab5640 1 -- 172.21.15.67:0/382362442 reap_dead start 2024-09-19T05:47:45.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f4b518640 1 -- 172.21.15.67:0/382362442 shutdown_connections 2024-09-19T05:47:45.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f4b518640 1 -- 172.21.15.67:0/382362442 >> 172.21.15.67:0/382362442 conn(0x7f7f440b1e50 msgr2=0x7f7f440b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:45.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f4b518640 1 -- 172.21.15.67:0/382362442 shutdown_connections 2024-09-19T05:47:45.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f4b518640 1 -- 172.21.15.67:0/382362442 wait complete. 2024-09-19T05:47:45.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f4b518640 1 Processor -- start 2024-09-19T05:47:45.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.139+0000 7f7f4b518640 1 -- start start 2024-09-19T05:47:45.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f4b518640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f441596b0 0x7f7f4409dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:45.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f4b518640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4409e020 0x7f7f440d0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:45.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f4b518640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f440cea50 0x7f7f440d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:45.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f4b518640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4416e850 con 0x7f7f441596b0 2024-09-19T05:47:45.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f4b518640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4416e6d0 con 0x7f7f440cea50 2024-09-19T05:47:45.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f4b518640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4416e9d0 con 0x7f7f4409e020 2024-09-19T05:47:45.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f492b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f441596b0 0x7f7f4409dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:45.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f492b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f441596b0 0x7f7f4409dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36346/0 (socket says 172.21.15.67:36346) 2024-09-19T05:47:45.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f492b4640 1 -- 172.21.15.67:0/820858036 learned_addr learned my addr 172.21.15.67:0/820858036 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:45.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f48ab3640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4409e020 0x7f7f440d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:45.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f492b4640 1 -- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4409e020 msgr2=0x7f7f440d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:45.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f49ab5640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f440cea50 0x7f7f440d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:45.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f492b4640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4409e020 0x7f7f440d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:45.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f492b4640 1 -- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f440cea50 msgr2=0x7f7f440d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:45.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f492b4640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f440cea50 0x7f7f440d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:45.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f492b4640 1 -- 172.21.15.67:0/820858036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f440cf210 con 0x7f7f441596b0 2024-09-19T05:47:45.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f492b4640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f441596b0 0x7f7f4409dae0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f7f3401cf50 tx=0x7f7f34019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:45.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f41ffb640 1 -- 172.21.15.67:0/820858036 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f340096b0 con 0x7f7f441596b0 2024-09-19T05:47:45.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f41ffb640 1 -- 172.21.15.67:0/820858036 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f340a6c00 con 0x7f7f441596b0 2024-09-19T05:47:45.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f41ffb640 1 -- 172.21.15.67:0/820858036 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34004020 con 0x7f7f441596b0 2024-09-19T05:47:45.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f4b518640 1 -- 172.21.15.67:0/820858036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f440cef30 con 0x7f7f441596b0 2024-09-19T05:47:45.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f4b518640 1 -- 172.21.15.67:0/820858036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f440ccd40 con 0x7f7f441596b0 2024-09-19T05:47:45.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f4b518640 1 -- 172.21.15.67:0/820858036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f440b3150 con 0x7f7f441596b0 2024-09-19T05:47:45.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f41ffb640 1 -- 172.21.15.67:0/820858036 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f340041c0 con 0x7f7f441596b0 2024-09-19T05:47:45.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f41ffb640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f300678c0 0x7f7f30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:45.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.143+0000 7f7f41ffb640 1 -- 172.21.15.67:0/820858036 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f7f3411f830 con 0x7f7f441596b0 2024-09-19T05:47:45.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.147+0000 7f7f48ab3640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f300678c0 0x7f7f30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:45.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.147+0000 7f7f48ab3640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f300678c0 0x7f7f30069d80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f7f38000f90 tx=0x7f7f38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:45.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.151+0000 7f7f41ffb640 1 -- 172.21.15.67:0/820858036 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f7f340c2030 con 0x7f7f441596b0 2024-09-19T05:47:45.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.351+0000 7f7f4b518640 1 -- 172.21.15.67:0/820858036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7f440b51a0 con 0x7f7f441596b0 2024-09-19T05:47:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f41ffb640 1 -- 172.21.15.67:0/820858036 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v138) ==== 122+0+0 (secure 0 0 0) 0x7f7f340ac020 con 0x7f7f441596b0 2024-09-19T05:47:45.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 -- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f300678c0 msgr2=0x7f7f30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:45.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f300678c0 0x7f7f30069d80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f7f38000f90 tx=0x7f7f38009040 comp rx=0 tx=0).stop 2024-09-19T05:47:45.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 -- 172.21.15.67:0/820858036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f441596b0 msgr2=0x7f7f4409dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:45.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f441596b0 0x7f7f4409dae0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f7f3401cf50 tx=0x7f7f34019810 comp rx=0 tx=0).stop 2024-09-19T05:47:45.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 -- 172.21.15.67:0/820858036 shutdown_connections 2024-09-19T05:47:45.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f440cea50 0x7f7f440d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:45.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f7f300678c0 0x7f7f30069d80 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:45.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f4409e020 0x7f7f440d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:45.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 --2- 172.21.15.67:0/820858036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f441596b0 0x7f7f4409dae0 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:45.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 -- 172.21.15.67:0/820858036 >> 172.21.15.67:0/820858036 conn(0x7f7f440b1e50 msgr2=0x7f7f4406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:45.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 -- 172.21.15.67:0/820858036 shutdown_connections 2024-09-19T05:47:45.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:45.975+0000 7f7f4b518640 1 -- 172.21.15.67:0/820858036 wait complete. 2024-09-19T05:47:45.996 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:47:45.996 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:47:46.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.123+0000 7fc272b27640 1 Processor -- start 2024-09-19T05:47:46.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc272b27640 1 -- start start 2024-09-19T05:47:46.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc272b27640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc26c0726e0 0x7fc26c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc272b27640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc26c162a10 0x7fc26c0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc272b27640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26c06ecc0 con 0x7fc26c162630 2024-09-19T05:47:46.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc272b27640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc26c0cfe80 con 0x7fc26c162a10 2024-09-19T05:47:46.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc272b27640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc26c06ef50 con 0x7fc26c0726e0 2024-09-19T05:47:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc2710c4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc26c162a10 0x7fc26c0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc2710c4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc26c162a10 0x7fc26c0b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59838/0 (socket says 172.21.15.67:59838) 2024-09-19T05:47:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc2710c4640 1 -- 172.21.15.67:0/1743511434 learned_addr learned my addr 172.21.15.67:0/1743511434 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc26bfff640 1 --2- 172.21.15.67:0/1743511434 >> v2:172.21.15.97:3300/0 conn(0x7fc26c0726e0 0x7fc26c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc2710c4640 1 -- 172.21.15.67:0/1743511434 >> v2:172.21.15.97:3300/0 conn(0x7fc26c0726e0 msgr2=0x7fc26c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc2710c4640 1 --2- 172.21.15.67:0/1743511434 >> v2:172.21.15.97:3300/0 conn(0x7fc26c0726e0 0x7fc26c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc2710c4640 1 -- 172.21.15.67:0/1743511434 >> v1:172.21.15.97:6789/0 conn(0x7fc26c162630 legacy=0x7fc26c071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:46.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc2710c4640 1 -- 172.21.15.67:0/1743511434 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c06f230 con 0x7fc26c162a10 2024-09-19T05:47:46.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.127+0000 7fc2710c4640 1 --2- 172.21.15.67:0/1743511434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 0x7fc26c0b3ad0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fc26c073990 tx=0x7fc26401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d49671b66fd3ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:46.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc26b7fe640 1 -- 172.21.15.67:0/1743511434 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640ab620 con 0x7fc26c162a10 2024-09-19T05:47:46.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc26b7fe640 1 -- 172.21.15.67:0/1743511434 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640b0070 con 0x7fc26c162a10 2024-09-19T05:47:46.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc26b7fe640 1 -- 172.21.15.67:0/1743511434 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640ab9e0 con 0x7fc26c162a10 2024-09-19T05:47:46.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 -- 172.21.15.67:0/1743511434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 msgr2=0x7fc26c0b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 --2- 172.21.15.67:0/1743511434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 0x7fc26c0b3ad0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fc26c073990 tx=0x7fc26401c420 comp rx=0 tx=0).stop 2024-09-19T05:47:46.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 -- 172.21.15.67:0/1743511434 shutdown_connections 2024-09-19T05:47:46.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 --2- 172.21.15.67:0/1743511434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 0x7fc26c0b3ad0 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 --2- 172.21.15.67:0/1743511434 >> v2:172.21.15.97:3300/0 conn(0x7fc26c0726e0 0x7fc26c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 -- 172.21.15.67:0/1743511434 >> 172.21.15.67:0/1743511434 conn(0x7fc26c0d0080 msgr2=0x7fc26c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:46.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 -- 172.21.15.67:0/1743511434 shutdown_connections 2024-09-19T05:47:46.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 -- 172.21.15.67:0/1743511434 wait complete. 2024-09-19T05:47:46.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 Processor -- start 2024-09-19T05:47:46.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 -- start start 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26c0726e0 0x7fc26c0ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc26c162630 0x7fc26c15d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 0x7fc26c1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c16f700 con 0x7fc26c162a10 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c0b4820 con 0x7fc26c0726e0 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc272b27640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c16f880 con 0x7fc26c162630 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2710c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 0x7fc26c1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2710c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 0x7fc26c1521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59844/0 (socket says 172.21.15.67:59844) 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2710c4640 1 -- 172.21.15.67:0/557958994 learned_addr learned my addr 172.21.15.67:0/557958994 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2708c3640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26c0726e0 0x7fc26c0ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc26bfff640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc26c162630 0x7fc26c15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2710c4640 1 -- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc26c162630 msgr2=0x7fc26c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2710c4640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc26c162630 0x7fc26c15d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2710c4640 1 -- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26c0726e0 msgr2=0x7fc26c0ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2710c4640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26c0726e0 0x7fc26c0ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2710c4640 1 -- 172.21.15.67:0/557958994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c154220 con 0x7fc26c162a10 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2708c3640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26c0726e0 0x7fc26c0ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.131+0000 7fc2710c4640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 0x7fc26c1521a0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fc26401a050 tx=0x7fc26401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc2697fa640 1 -- 172.21.15.67:0/557958994 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640abd50 con 0x7fc26c162a10 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc2697fa640 1 -- 172.21.15.67:0/557958994 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640be3f0 con 0x7fc26c162a10 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc272b27640 1 -- 172.21.15.67:0/557958994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26c154490 con 0x7fc26c162a10 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc2697fa640 1 -- 172.21.15.67:0/557958994 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640be7e0 con 0x7fc26c162a10 2024-09-19T05:47:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc272b27640 1 -- 172.21.15.67:0/557958994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc26c159010 con 0x7fc26c162a10 2024-09-19T05:47:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc272b27640 1 -- 172.21.15.67:0/557958994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc26c071fd0 con 0x7fc26c162a10 2024-09-19T05:47:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc2697fa640 1 -- 172.21.15.67:0/557958994 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc2640b43f0 con 0x7fc26c162a10 2024-09-19T05:47:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc2697fa640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2580678f0 0x7fc258069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc2697fa640 1 -- 172.21.15.67:0/557958994 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fc264120170 con 0x7fc26c162a10 2024-09-19T05:47:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc2708c3640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2580678f0 0x7fc258069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.135+0000 7fc2708c3640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2580678f0 0x7fc258069db0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0045c0 tx=0x7fc25c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:46.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.139+0000 7fc2697fa640 1 -- 172.21.15.67:0/557958994 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc2640c4060 con 0x7fc26c162a10 2024-09-19T05:47:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.343+0000 7fc272b27640 1 -- 172.21.15.67:0/557958994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc26c0701a0 con 0x7fc26c162a10 2024-09-19T05:47:46.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.343+0000 7fc2697fa640 1 -- 172.21.15.67:0/557958994 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+5239 (secure 0 0 0) 0x7fc2640160d0 con 0x7fc26c162a10 2024-09-19T05:47:46.342 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:46.342 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":138,"btime":"2024-09-19T05:47:45:972719+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/4294715394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4294715394},{"type":"v1","addr":"172.21.15.97:6835","nonce":4294715394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":7139,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1234134657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1234134657},{"type":"v1","addr":"172.21.15.97:6837","nonce":1234134657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":10449,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2992690092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2992690092},{"type":"v1","addr":"172.21.15.67:6833","nonce":2992690092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:47:42.304037+0000","modified":"2024-09-19T05:47:45.355124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10458":{"gid":10458,"name":"c","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2221933052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2221933052},{"type":"v1","addr":"172.21.15.67:6835","nonce":2221933052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10458,"qdb_cluster":[10458]},"id":13}]} 2024-09-19T05:47:46.342 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 138 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 -- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2580678f0 msgr2=0x7fc258069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2580678f0 0x7fc258069db0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0045c0 tx=0x7fc25c009040 comp rx=0 tx=0).stop 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 -- 172.21.15.67:0/557958994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 msgr2=0x7fc26c1521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 0x7fc26c1521a0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fc26401a050 tx=0x7fc26401ac60 comp rx=0 tx=0).stop 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 -- 172.21.15.67:0/557958994 shutdown_connections 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc26c162a10 0x7fc26c1521a0 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc2580678f0 0x7fc258069db0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc26c162630 0x7fc26c15d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 --2- 172.21.15.67:0/557958994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26c0726e0 0x7fc26c0ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 -- 172.21.15.67:0/557958994 >> 172.21.15.67:0/557958994 conn(0x7fc26c0d0080 msgr2=0x7fc26c0b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:46.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 -- 172.21.15.67:0/557958994 shutdown_connections 2024-09-19T05:47:46.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.347+0000 7fc272b27640 1 -- 172.21.15.67:0/557958994 wait complete. 2024-09-19T05:47:46.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:47:46.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.479+0000 7fed78b23640 1 Processor -- start 2024-09-19T05:47:46.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.479+0000 7fed78b23640 1 -- start start 2024-09-19T05:47:46.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed78b23640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed7415b710 0x7fed74071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed78b23640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed740b3070 con 0x7fed740aef40 2024-09-19T05:47:46.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed78b23640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed740afa70 con 0x7fed7415baf0 2024-09-19T05:47:46.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed78b23640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fed740b32e0 con 0x7fed7415b710 2024-09-19T05:47:46.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed72d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fed740aef40 0x7fed740af360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46494/0 (socket says 172.21.15.67:46494) 2024-09-19T05:47:46.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed72d9d640 1 -- 172.21.15.67:0/4292221124 learned_addr learned my addr 172.21.15.67:0/4292221124 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:46.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7259c640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed7415b710 0x7fed74071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990545090 0 0) 0x7fed740b3070 con 0x7fed740aef40 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed5c003530 con 0x7fed740aef40 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1452651984 0 0) 0x7fed5c003530 con 0x7fed740aef40 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed7415b710 msgr2=0x7fed74071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed7415b710 0x7fed74071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 >> v1:172.21.15.97:6789/0 conn(0x7fed7415baf0 legacy=0x7fed7415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed740b35c0 con 0x7fed740aef40 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fed6c001a00 con 0x7fed740aef40 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 >> v1:172.21.15.67:6789/0 conn(0x7fed740aef40 legacy=0x7fed740af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed7415b710 0x7fed5c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 0x7fed5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed5c004d50 0x7fed5c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed740b32e0 con 0x7fed5c003f70 2024-09-19T05:47:46.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c00dcc0 con 0x7fed5c004d50 2024-09-19T05:47:46.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fed5c00dec0 con 0x7fed7415b710 2024-09-19T05:47:46.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed71d9b640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 0x7fed5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed7259c640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed7415b710 0x7fed5c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed72d9d640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed5c004d50 0x7fed5c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed71d9b640 1 -- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed7415b710 msgr2=0x7fed5c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:46.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed71d9b640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed7415b710 0x7fed5c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed71d9b640 1 -- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed5c004d50 msgr2=0x7fed5c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:46.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed71d9b640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed5c004d50 0x7fed5c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.483+0000 7fed71d9b640 1 -- 172.21.15.67:0/4292221124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c003530 con 0x7fed5c003f70 2024-09-19T05:47:46.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed71d9b640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 0x7fed5c004810 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7fed68001780 tx=0x7fed6801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ec06759b8bbf85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:46.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed680013a0 con 0x7fed5c003f70 2024-09-19T05:47:46.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed680052f0 con 0x7fed5c003f70 2024-09-19T05:47:46.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7159a640 1 -- 172.21.15.67:0/4292221124 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68003840 con 0x7fed5c003f70 2024-09-19T05:47:46.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 -- 172.21.15.67:0/4292221124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 msgr2=0x7fed5c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 --2- 172.21.15.67:0/4292221124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 0x7fed5c004810 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7fed68001780 tx=0x7fed6801c420 comp rx=0 tx=0).stop 2024-09-19T05:47:46.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed72d9d640 1 -- 172.21.15.67:0/4292221124 reap_dead start 2024-09-19T05:47:46.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 -- 172.21.15.67:0/4292221124 shutdown_connections 2024-09-19T05:47:46.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 -- 172.21.15.67:0/4292221124 >> 172.21.15.67:0/4292221124 conn(0x7fed740d0080 msgr2=0x7fed740d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:46.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 -- 172.21.15.67:0/4292221124 shutdown_connections 2024-09-19T05:47:46.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 -- 172.21.15.67:0/4292221124 wait complete. 2024-09-19T05:47:46.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 Processor -- start 2024-09-19T05:47:46.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 -- start start 2024-09-19T05:47:46.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 0x7fed74147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed741478d0 0x7fed7414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed741491c0 0x7fed7406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed74071e80 con 0x7fed5c003f70 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fed740b3b80 con 0x7fed741491c0 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed78b23640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fed74072000 con 0x7fed741478d0 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 0x7fed74147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 0x7fed74147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59854/0 (socket says 172.21.15.67:59854) 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7259c640 1 -- 172.21.15.67:0/521113784 learned_addr learned my addr 172.21.15.67:0/521113784 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed71d9b640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed741478d0 0x7fed7414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed72d9d640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed741491c0 0x7fed7406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7259c640 1 -- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed741478d0 msgr2=0x7fed7414d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7259c640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed741478d0 0x7fed7414d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7259c640 1 -- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed741491c0 msgr2=0x7fed7406ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7259c640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed741491c0 0x7fed7406ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7259c640 1 -- 172.21.15.67:0/521113784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed74148120 con 0x7fed5c003f70 2024-09-19T05:47:46.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed71d9b640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed741478d0 0x7fed7414d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:46.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.487+0000 7fed7259c640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 0x7fed74147370 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fed64011610 tx=0x7fed64011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:46.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed62ffd640 1 -- 172.21.15.67:0/521113784 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6400f8f0 con 0x7fed5c003f70 2024-09-19T05:47:46.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed62ffd640 1 -- 172.21.15.67:0/521113784 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed6400fa90 con 0x7fed5c003f70 2024-09-19T05:47:46.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed78b23640 1 -- 172.21.15.67:0/521113784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed74148400 con 0x7fed5c003f70 2024-09-19T05:47:46.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed62ffd640 1 -- 172.21.15.67:0/521113784 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6400fe40 con 0x7fed5c003f70 2024-09-19T05:47:46.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed78b23640 1 -- 172.21.15.67:0/521113784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed741489c0 con 0x7fed5c003f70 2024-09-19T05:47:46.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed78b23640 1 -- 172.21.15.67:0/521113784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed740af360 con 0x7fed5c003f70 2024-09-19T05:47:46.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed62ffd640 1 -- 172.21.15.67:0/521113784 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed64015460 con 0x7fed5c003f70 2024-09-19T05:47:46.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed62ffd640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed540678c0 0x7fed54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed62ffd640 1 -- 172.21.15.67:0/521113784 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fed640867a0 con 0x7fed5c003f70 2024-09-19T05:47:46.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed71d9b640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed540678c0 0x7fed54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.491+0000 7fed71d9b640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed540678c0 0x7fed54069d80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fed68001750 tx=0x7fed680011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:46.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.495+0000 7fed62ffd640 1 -- 172.21.15.67:0/521113784 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fed64019030 con 0x7fed5c003f70 2024-09-19T05:47:46.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.663+0000 7fed78b23640 1 -- 172.21.15.67:0/521113784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed740b5020 con 0x7fed5c003f70 2024-09-19T05:47:46.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed62ffd640 1 -- 172.21.15.67:0/521113784 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+16976 (secure 0 0 0) 0x7fed640571e0 con 0x7fed5c003f70 2024-09-19T05:47:46.665 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:46.665 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":191,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:47:43.948247+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:47:39.977348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-19T05:47:41.308745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 -- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed540678c0 msgr2=0x7fed54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed540678c0 0x7fed54069d80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fed68001750 tx=0x7fed680011a0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 -- 172.21.15.67:0/521113784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 msgr2=0x7fed74147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 0x7fed74147370 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fed64011610 tx=0x7fed64011ad0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 -- 172.21.15.67:0/521113784 shutdown_connections 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed741491c0 0x7fed7406ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fed540678c0 0x7fed54069d80 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fed741478d0 0x7fed7414d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 --2- 172.21.15.67:0/521113784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed5c003f70 0x7fed74147370 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 -- 172.21.15.67:0/521113784 >> 172.21.15.67:0/521113784 conn(0x7fed740d0080 msgr2=0x7fed7406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:46.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 -- 172.21.15.67:0/521113784 shutdown_connections 2024-09-19T05:47:46.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.667+0000 7fed78b23640 1 -- 172.21.15.67:0/521113784 wait complete. 2024-09-19T05:47:46.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:47:46.685 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:47:46.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.811+0000 7f5216f4a640 1 Processor -- start 2024-09-19T05:47:46.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.811+0000 7f5216f4a640 1 -- start start 2024-09-19T05:47:46.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5216f4a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f521006dde0 0x7f52100b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5216f4a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52100b3510 0x7f521006f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5216f4a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f521006e3c0 con 0x7f521015c030 2024-09-19T05:47:46.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5216f4a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f521006e6a0 con 0x7f521006dde0 2024-09-19T05:47:46.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5216f4a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f521006e980 con 0x7f52100b3510 2024-09-19T05:47:46.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5214ce6640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f521015c030 0x7f521015d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46510/0 (socket says 172.21.15.67:46510) 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5214ce6640 1 -- 172.21.15.67:0/2162279299 learned_addr learned my addr 172.21.15.67:0/2162279299 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f52154e7640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52100b3510 0x7f521006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520ffff640 1 --2- 172.21.15.67:0/2162279299 >> v2:172.21.15.97:3300/0 conn(0x7f521006dde0 0x7f52100b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755056083 0 0) 0x7f521006e3c0 con 0x7f521015c030 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51fc003530 con 0x7f521015c030 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 169366036 0 0) 0x7f51fc003530 con 0x7f521015c030 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52100b3510 msgr2=0x7f521006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52100b3510 0x7f521006f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 >> v2:172.21.15.97:3300/0 conn(0x7f521006dde0 msgr2=0x7f52100b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 --2- 172.21.15.67:0/2162279299 >> v2:172.21.15.97:3300/0 conn(0x7f521006dde0 0x7f52100b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521006ec60 con 0x7f521015c030 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f5208001a00 con 0x7f521015c030 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 >> v1:172.21.15.67:6789/0 conn(0x7f521015c030 legacy=0x7f521015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51fc0039c0 0x7f51fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51fc004810 0x7f51fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52100b3510 0x7f51fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f521006e6a0 con 0x7f51fc0039c0 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f521006e980 con 0x7f51fc004810 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc00b9d0 con 0x7f52100b3510 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5214ce6640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51fc0039c0 0x7f51fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f52154e7640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52100b3510 0x7f51fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520ffff640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51fc004810 0x7f51fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5214ce6640 1 -- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52100b3510 msgr2=0x7f51fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5214ce6640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f52100b3510 0x7f51fc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5214ce6640 1 -- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51fc004810 msgr2=0x7f51fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:46.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5214ce6640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51fc004810 0x7f51fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f5214ce6640 1 -- 172.21.15.67:0/2162279299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc003530 con 0x7f51fc0039c0 2024-09-19T05:47:46.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.815+0000 7f520ffff640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51fc004810 0x7f51fc004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:46.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5214ce6640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51fc0039c0 0x7f51fc003de0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f520800a880 tx=0x7f520801d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa48c2f794d0d4e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:46.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520800a4a0 con 0x7f51fc0039c0 2024-09-19T05:47:46.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52080ad650 con 0x7f51fc0039c0 2024-09-19T05:47:46.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520f7fe640 1 -- 172.21.15.67:0/2162279299 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52080ada40 con 0x7f51fc0039c0 2024-09-19T05:47:46.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 -- 172.21.15.67:0/2162279299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51fc0039c0 msgr2=0x7f51fc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 --2- 172.21.15.67:0/2162279299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51fc0039c0 0x7f51fc003de0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f520800a880 tx=0x7f520801d370 comp rx=0 tx=0).stop 2024-09-19T05:47:46.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f52154e7640 1 -- 172.21.15.67:0/2162279299 reap_dead start 2024-09-19T05:47:46.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 -- 172.21.15.67:0/2162279299 shutdown_connections 2024-09-19T05:47:46.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 -- 172.21.15.67:0/2162279299 >> 172.21.15.67:0/2162279299 conn(0x7f52100d0080 msgr2=0x7f52100d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:46.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 -- 172.21.15.67:0/2162279299 shutdown_connections 2024-09-19T05:47:46.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 -- 172.21.15.67:0/2162279299 wait complete. 2024-09-19T05:47:46.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 Processor -- start 2024-09-19T05:47:46.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 -- start start 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51fc0039c0 0x7f52101463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52101f5340 0x7f5210158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5210159390 0x7f52100b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f52100ad380 con 0x7f52101f5340 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f52100ad200 con 0x7f5210159390 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5216f4a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f52100ad500 con 0x7f51fc0039c0 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52101f5340 0x7f5210158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52101f5340 0x7f5210158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59870/0 (socket says 172.21.15.67:59870) 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520ffff640 1 -- 172.21.15.67:0/2540495733 learned_addr learned my addr 172.21.15.67:0/2540495733 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f5214ce6640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51fc0039c0 0x7f52101463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f52154e7640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5210159390 0x7f52100b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520ffff640 1 -- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51fc0039c0 msgr2=0x7f52101463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520ffff640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51fc0039c0 0x7f52101463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520ffff640 1 -- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5210159390 msgr2=0x7f52100b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:46.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520ffff640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5210159390 0x7f52100b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:46.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.819+0000 7f520ffff640 1 -- 172.21.15.67:0/2540495733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52101535e0 con 0x7f52101f5340 2024-09-19T05:47:46.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f520ffff640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52101f5340 0x7f5210158e50 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f51f80109b0 tx=0x7f51f8010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:46.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f520d7fa640 1 -- 172.21.15.67:0/2540495733 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f800f040 con 0x7f52101f5340 2024-09-19T05:47:46.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f520d7fa640 1 -- 172.21.15.67:0/2540495733 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f800ec20 con 0x7f52101f5340 2024-09-19T05:47:46.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f5216f4a640 1 -- 172.21.15.67:0/2540495733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5210161f80 con 0x7f52101f5340 2024-09-19T05:47:46.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f520d7fa640 1 -- 172.21.15.67:0/2540495733 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8004020 con 0x7f52101f5340 2024-09-19T05:47:46.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f5216f4a640 1 -- 172.21.15.67:0/2540495733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5210162540 con 0x7f52101f5340 2024-09-19T05:47:46.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f5216f4a640 1 -- 172.21.15.67:0/2540495733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5210068f70 con 0x7f52101f5340 2024-09-19T05:47:46.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f520d7fa640 1 -- 172.21.15.67:0/2540495733 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f51f80041c0 con 0x7f52101f5340 2024-09-19T05:47:46.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f520d7fa640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51f00678c0 0x7f51f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:46.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f520d7fa640 1 -- 172.21.15.67:0/2540495733 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f51f8085e00 con 0x7f52101f5340 2024-09-19T05:47:46.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f5214ce6640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51f00678c0 0x7f51f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:46.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.823+0000 7f5214ce6640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51f00678c0 0x7f51f0069d80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f52080ad000 tx=0x7f521006e590 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:46.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.827+0000 7f520d7fa640 1 -- 172.21.15.67:0/2540495733 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f51f8018030 con 0x7f52101f5340 2024-09-19T05:47:46.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:46.987+0000 7f5216f4a640 1 -- 172.21.15.67:0/2540495733 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52100ad8c0 con 0x7f51f00678c0 2024-09-19T05:47:47.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.007+0000 7f520d7fa640 1 -- 172.21.15.67:0/2540495733 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247097 (secure 0 0 0) 0x7f52080f7550 con 0x7f51f00678c0 2024-09-19T05:47:47.012 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:47.014 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:47:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 -- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51f00678c0 msgr2=0x7f51f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51f00678c0 0x7f51f0069d80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f52080ad000 tx=0x7f521006e590 comp rx=0 tx=0).stop 2024-09-19T05:47:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 -- 172.21.15.67:0/2540495733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52101f5340 msgr2=0x7f5210158e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52101f5340 0x7f5210158e50 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f51f80109b0 tx=0x7f51f8010e70 comp rx=0 tx=0).stop 2024-09-19T05:47:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 -- 172.21.15.67:0/2540495733 shutdown_connections 2024-09-19T05:47:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5210159390 0x7f52100b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52101f5340 0x7f5210158e50 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51f00678c0 0x7f51f0069d80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 --2- 172.21.15.67:0/2540495733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51fc0039c0 0x7f52101463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 -- 172.21.15.67:0/2540495733 >> 172.21.15.67:0/2540495733 conn(0x7f52100d0080 msgr2=0x7f52100b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:47.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 -- 172.21.15.67:0/2540495733 shutdown_connections 2024-09-19T05:47:47.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.011+0000 7f5216f4a640 1 -- 172.21.15.67:0/2540495733 wait complete. 2024-09-19T05:47:47.027 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":626,"stamp":"2024-09-19T05:47:45.412063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":546840,"kb_used_data":19728,"kb_used_omap":12,"kb_used_meta":526899,"kb_avail":754427880,"statfs":{"total":773094113280,"available":772534149120,"internally_reserved":0,"allocated":20201472,"data_stored":10152186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":539545137},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.488099"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940180+0000","last_change":"2024-09-19T05:47:41.940180+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940180+0000","last_undegraded":"2024-09-19T05:47:41.940180+0000","last_fullsized":"2024-09-19T05:47:41.940180+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939965+0000","last_change":"2024-09-19T05:47:41.939965+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939965+0000","last_undegraded":"2024-09-19T05:47:41.939965+0000","last_fullsized":"2024-09-19T05:47:41.939965+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.953830+0000","last_change":"2024-09-19T05:47:41.953830+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.953830+0000","last_undegraded":"2024-09-19T05:47:41.953830+0000","last_fullsized":"2024-09-19T05:47:41.953830+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949936+0000","last_change":"2024-09-19T05:47:41.949936+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949936+0000","last_undegraded":"2024-09-19T05:47:41.949936+0000","last_fullsized":"2024-09-19T05:47:41.949936+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947364+0000","last_change":"2024-09-19T05:47:41.947364+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947364+0000","last_undegraded":"2024-09-19T05:47:41.947364+0000","last_fullsized":"2024-09-19T05:47:41.947364+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948780+0000","last_change":"2024-09-19T05:47:41.948780+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948780+0000","last_undegraded":"2024-09-19T05:47:41.948780+0000","last_fullsized":"2024-09-19T05:47:41.948780+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946499+0000","last_change":"2024-09-19T05:47:41.946499+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946499+0000","last_undegraded":"2024-09-19T05:47:41.946499+0000","last_fullsized":"2024-09-19T05:47:41.946499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950493+0000","last_change":"2024-09-19T05:47:41.950493+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950493+0000","last_undegraded":"2024-09-19T05:47:41.950493+0000","last_fullsized":"2024-09-19T05:47:41.950493+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948580+0000","last_change":"2024-09-19T05:47:41.948580+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948580+0000","last_undegraded":"2024-09-19T05:47:41.948580+0000","last_fullsized":"2024-09-19T05:47:41.948580+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948677+0000","last_change":"2024-09-19T05:47:41.948677+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948677+0000","last_undegraded":"2024-09-19T05:47:41.948677+0000","last_fullsized":"2024-09-19T05:47:41.948677+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.953401+0000","last_change":"2024-09-19T05:47:41.953401+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.953401+0000","last_undegraded":"2024-09-19T05:47:41.953401+0000","last_fullsized":"2024-09-19T05:47:41.953401+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950433+0000","last_change":"2024-09-19T05:47:41.950433+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950433+0000","last_undegraded":"2024-09-19T05:47:41.950433+0000","last_fullsized":"2024-09-19T05:47:41.950433+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948591+0000","last_change":"2024-09-19T05:47:41.948591+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948591+0000","last_undegraded":"2024-09-19T05:47:41.948591+0000","last_fullsized":"2024-09-19T05:47:41.948591+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946921+0000","last_change":"2024-09-19T05:47:41.946921+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946921+0000","last_undegraded":"2024-09-19T05:47:41.946921+0000","last_fullsized":"2024-09-19T05:47:41.946921+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942282+0000","last_change":"2024-09-19T05:47:41.942282+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942282+0000","last_undegraded":"2024-09-19T05:47:41.942282+0000","last_fullsized":"2024-09-19T05:47:41.942282+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.952887+0000","last_change":"2024-09-19T05:47:41.952887+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.952887+0000","last_undegraded":"2024-09-19T05:47:41.952887+0000","last_fullsized":"2024-09-19T05:47:41.952887+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947978+0000","last_change":"2024-09-19T05:47:41.947978+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947978+0000","last_undegraded":"2024-09-19T05:47:41.947978+0000","last_fullsized":"2024-09-19T05:47:41.947978+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946134+0000","last_change":"2024-09-19T05:47:41.946134+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946134+0000","last_undegraded":"2024-09-19T05:47:41.946134+0000","last_fullsized":"2024-09-19T05:47:41.946134+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945573+0000","last_change":"2024-09-19T05:47:41.945573+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945573+0000","last_undegraded":"2024-09-19T05:47:41.945573+0000","last_fullsized":"2024-09-19T05:47:41.945573+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950975+0000","last_change":"2024-09-19T05:47:41.950975+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950975+0000","last_undegraded":"2024-09-19T05:47:41.950975+0000","last_fullsized":"2024-09-19T05:47:41.950975+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948069+0000","last_change":"2024-09-19T05:47:41.948069+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948069+0000","last_undegraded":"2024-09-19T05:47:41.948069+0000","last_fullsized":"2024-09-19T05:47:41.948069+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945902+0000","last_change":"2024-09-19T05:47:41.945902+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945902+0000","last_undegraded":"2024-09-19T05:47:41.945902+0000","last_fullsized":"2024-09-19T05:47:41.945902+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940487+0000","last_change":"2024-09-19T05:47:41.940487+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940487+0000","last_undegraded":"2024-09-19T05:47:41.940487+0000","last_fullsized":"2024-09-19T05:47:41.940487+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946999+0000","last_change":"2024-09-19T05:47:41.946999+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946999+0000","last_undegraded":"2024-09-19T05:47:41.946999+0000","last_fullsized":"2024-09-19T05:47:41.946999+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947370+0000","last_change":"2024-09-19T05:47:41.947370+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947370+0000","last_undegraded":"2024-09-19T05:47:41.947370+0000","last_fullsized":"2024-09-19T05:47:41.947370+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941457+0000","last_change":"2024-09-19T05:47:41.941457+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941457+0000","last_undegraded":"2024-09-19T05:47:41.941457+0000","last_fullsized":"2024-09-19T05:47:41.941457+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949404+0000","last_change":"2024-09-19T05:47:41.949404+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949404+0000","last_undegraded":"2024-09-19T05:47:41.949404+0000","last_fullsized":"2024-09-19T05:47:41.949404+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946520+0000","last_change":"2024-09-19T05:47:41.946520+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946520+0000","last_undegraded":"2024-09-19T05:47:41.946520+0000","last_fullsized":"2024-09-19T05:47:41.946520+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944476+0000","last_change":"2024-09-19T05:47:41.944476+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944476+0000","last_undegraded":"2024-09-19T05:47:41.944476+0000","last_fullsized":"2024-09-19T05:47:41.944476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944442+0000","last_change":"2024-09-19T05:47:41.944442+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944442+0000","last_undegraded":"2024-09-19T05:47:41.944442+0000","last_fullsized":"2024-09-19T05:47:41.944442+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.952444+0000","last_change":"2024-09-19T05:47:41.952444+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.952444+0000","last_undegraded":"2024-09-19T05:47:41.952444+0000","last_fullsized":"2024-09-19T05:47:41.952444+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949314+0000","last_change":"2024-09-19T05:47:41.949314+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949314+0000","last_undegraded":"2024-09-19T05:47:41.949314+0000","last_fullsized":"2024-09-19T05:47:41.949314+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939697+0000","last_change":"2024-09-19T05:47:41.939697+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939697+0000","last_undegraded":"2024-09-19T05:47:41.939697+0000","last_fullsized":"2024-09-19T05:47:41.939697+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.974835+0000","last_change":"2024-09-19T05:47:41.972348+0000","last_active":"2024-09-19T05:47:41.974835+0000","last_peered":"2024-09-19T05:47:41.974835+0000","last_clean":"2024-09-19T05:47:41.974835+0000","last_became_active":"2024-09-19T05:47:41.971855+0000","last_became_peered":"2024-09-19T05:47:41.971855+0000","last_unstale":"2024-09-19T05:47:41.974835+0000","last_undegraded":"2024-09-19T05:47:41.974835+0000","last_fullsized":"2024-09-19T05:47:41.974835+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:41.408991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942800+0000","last_change":"2024-09-19T05:47:41.942800+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942800+0000","last_undegraded":"2024-09-19T05:47:41.942800+0000","last_fullsized":"2024-09-19T05:47:41.942800+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958617+0000","last_change":"2024-09-19T05:47:41.955701+0000","last_active":"2024-09-19T05:47:41.958617+0000","last_peered":"2024-09-19T05:47:41.958617+0000","last_clean":"2024-09-19T05:47:41.958617+0000","last_became_active":"2024-09-19T05:47:41.953352+0000","last_became_peered":"2024-09-19T05:47:41.953352+0000","last_unstale":"2024-09-19T05:47:41.958617+0000","last_undegraded":"2024-09-19T05:47:41.958617+0000","last_fullsized":"2024-09-19T05:47:41.958617+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:33.061928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944794+0000","last_change":"2024-09-19T05:47:41.944794+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944794+0000","last_undegraded":"2024-09-19T05:47:41.944794+0000","last_fullsized":"2024-09-19T05:47:41.944794+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954715+0000","last_change":"2024-09-19T05:47:41.944967+0000","last_active":"2024-09-19T05:47:41.954715+0000","last_peered":"2024-09-19T05:47:41.954715+0000","last_clean":"2024-09-19T05:47:41.954715+0000","last_became_active":"2024-09-19T05:47:41.944696+0000","last_became_peered":"2024-09-19T05:47:41.944696+0000","last_unstale":"2024-09-19T05:47:41.954715+0000","last_undegraded":"2024-09-19T05:47:41.954715+0000","last_fullsized":"2024-09-19T05:47:41.954715+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:17.350651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946969+0000","last_change":"2024-09-19T05:47:41.946969+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946969+0000","last_undegraded":"2024-09-19T05:47:41.946969+0000","last_fullsized":"2024-09-19T05:47:41.946969+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.969647+0000","last_change":"2024-09-19T05:47:41.969151+0000","last_active":"2024-09-19T05:47:41.969647+0000","last_peered":"2024-09-19T05:47:41.969647+0000","last_clean":"2024-09-19T05:47:41.969647+0000","last_became_active":"2024-09-19T05:47:41.968800+0000","last_became_peered":"2024-09-19T05:47:41.968800+0000","last_unstale":"2024-09-19T05:47:41.969647+0000","last_undegraded":"2024-09-19T05:47:41.969647+0000","last_fullsized":"2024-09-19T05:47:41.969647+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:11.896933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942875+0000","last_change":"2024-09-19T05:47:41.942875+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942875+0000","last_undegraded":"2024-09-19T05:47:41.942875+0000","last_fullsized":"2024-09-19T05:47:41.942875+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973178+0000","last_change":"2024-09-19T05:47:41.970704+0000","last_active":"2024-09-19T05:47:41.973178+0000","last_peered":"2024-09-19T05:47:41.973178+0000","last_clean":"2024-09-19T05:47:41.973178+0000","last_became_active":"2024-09-19T05:47:41.970086+0000","last_became_peered":"2024-09-19T05:47:41.970086+0000","last_unstale":"2024-09-19T05:47:41.973178+0000","last_undegraded":"2024-09-19T05:47:41.973178+0000","last_fullsized":"2024-09-19T05:47:41.973178+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:15.199524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.951396+0000","last_change":"2024-09-19T05:47:41.951396+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.951396+0000","last_undegraded":"2024-09-19T05:47:41.951396+0000","last_fullsized":"2024-09-19T05:47:41.951396+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.972238+0000","last_change":"2024-09-19T05:47:41.970568+0000","last_active":"2024-09-19T05:47:41.972238+0000","last_peered":"2024-09-19T05:47:41.972238+0000","last_clean":"2024-09-19T05:47:41.972238+0000","last_became_active":"2024-09-19T05:47:41.970029+0000","last_became_peered":"2024-09-19T05:47:41.970029+0000","last_unstale":"2024-09-19T05:47:41.972238+0000","last_undegraded":"2024-09-19T05:47:41.972238+0000","last_fullsized":"2024-09-19T05:47:41.972238+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:47.105803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946834+0000","last_change":"2024-09-19T05:47:41.946834+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946834+0000","last_undegraded":"2024-09-19T05:47:41.946834+0000","last_fullsized":"2024-09-19T05:47:41.946834+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.964655+0000","last_change":"2024-09-19T05:47:41.963677+0000","last_active":"2024-09-19T05:47:41.964655+0000","last_peered":"2024-09-19T05:47:41.964655+0000","last_clean":"2024-09-19T05:47:41.964655+0000","last_became_active":"2024-09-19T05:47:41.963381+0000","last_became_peered":"2024-09-19T05:47:41.963381+0000","last_unstale":"2024-09-19T05:47:41.964655+0000","last_undegraded":"2024-09-19T05:47:41.964655+0000","last_fullsized":"2024-09-19T05:47:41.964655+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:36.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944697+0000","last_change":"2024-09-19T05:47:41.944697+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944697+0000","last_undegraded":"2024-09-19T05:47:41.944697+0000","last_fullsized":"2024-09-19T05:47:41.944697+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.961836+0000","last_change":"2024-09-19T05:47:41.959230+0000","last_active":"2024-09-19T05:47:41.961836+0000","last_peered":"2024-09-19T05:47:41.961836+0000","last_clean":"2024-09-19T05:47:41.961836+0000","last_became_active":"2024-09-19T05:47:41.958352+0000","last_became_peered":"2024-09-19T05:47:41.958352+0000","last_unstale":"2024-09-19T05:47:41.961836+0000","last_undegraded":"2024-09-19T05:47:41.961836+0000","last_fullsized":"2024-09-19T05:47:41.961836+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:46.163005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945418+0000","last_change":"2024-09-19T05:47:41.945418+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945418+0000","last_undegraded":"2024-09-19T05:47:41.945418+0000","last_fullsized":"2024-09-19T05:47:41.945418+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.977955+0000","last_change":"2024-09-19T05:47:41.977216+0000","last_active":"2024-09-19T05:47:41.977955+0000","last_peered":"2024-09-19T05:47:41.977955+0000","last_clean":"2024-09-19T05:47:41.977955+0000","last_became_active":"2024-09-19T05:47:41.976763+0000","last_became_peered":"2024-09-19T05:47:41.976763+0000","last_unstale":"2024-09-19T05:47:41.977955+0000","last_undegraded":"2024-09-19T05:47:41.977955+0000","last_fullsized":"2024-09-19T05:47:41.977955+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:24.381428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.943265+0000","last_change":"2024-09-19T05:47:41.943265+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.943265+0000","last_undegraded":"2024-09-19T05:47:41.943265+0000","last_fullsized":"2024-09-19T05:47:41.943265+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954979+0000","last_change":"2024-09-19T05:47:41.954229+0000","last_active":"2024-09-19T05:47:41.954979+0000","last_peered":"2024-09-19T05:47:41.954979+0000","last_clean":"2024-09-19T05:47:41.954979+0000","last_became_active":"2024-09-19T05:47:41.953798+0000","last_became_peered":"2024-09-19T05:47:41.953798+0000","last_unstale":"2024-09-19T05:47:41.954979+0000","last_undegraded":"2024-09-19T05:47:41.954979+0000","last_fullsized":"2024-09-19T05:47:41.954979+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:30.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945863+0000","last_change":"2024-09-19T05:47:41.945863+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945863+0000","last_undegraded":"2024-09-19T05:47:41.945863+0000","last_fullsized":"2024-09-19T05:47:41.945863+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973771+0000","last_change":"2024-09-19T05:47:41.972755+0000","last_active":"2024-09-19T05:47:41.973771+0000","last_peered":"2024-09-19T05:47:41.973771+0000","last_clean":"2024-09-19T05:47:41.973771+0000","last_became_active":"2024-09-19T05:47:41.972124+0000","last_became_peered":"2024-09-19T05:47:41.972124+0000","last_unstale":"2024-09-19T05:47:41.973771+0000","last_undegraded":"2024-09-19T05:47:41.973771+0000","last_fullsized":"2024-09-19T05:47:41.973771+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.566154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946100+0000","last_change":"2024-09-19T05:47:41.946100+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946100+0000","last_undegraded":"2024-09-19T05:47:41.946100+0000","last_fullsized":"2024-09-19T05:47:41.946100+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.955505+0000","last_change":"2024-09-19T05:47:41.954745+0000","last_active":"2024-09-19T05:47:41.955505+0000","last_peered":"2024-09-19T05:47:41.955505+0000","last_clean":"2024-09-19T05:47:41.955505+0000","last_became_active":"2024-09-19T05:47:41.954279+0000","last_became_peered":"2024-09-19T05:47:41.954279+0000","last_unstale":"2024-09-19T05:47:41.955505+0000","last_undegraded":"2024-09-19T05:47:41.955505+0000","last_fullsized":"2024-09-19T05:47:41.955505+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:18.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945273+0000","last_change":"2024-09-19T05:47:41.945273+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945273+0000","last_undegraded":"2024-09-19T05:47:41.945273+0000","last_fullsized":"2024-09-19T05:47:41.945273+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.957289+0000","last_change":"2024-09-19T05:47:41.956777+0000","last_active":"2024-09-19T05:47:41.957289+0000","last_peered":"2024-09-19T05:47:41.957289+0000","last_clean":"2024-09-19T05:47:41.957289+0000","last_became_active":"2024-09-19T05:47:41.956381+0000","last_became_peered":"2024-09-19T05:47:41.956381+0000","last_unstale":"2024-09-19T05:47:41.957289+0000","last_undegraded":"2024-09-19T05:47:41.957289+0000","last_fullsized":"2024-09-19T05:47:41.957289+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:49.599888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941200+0000","last_change":"2024-09-19T05:47:41.941200+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941200+0000","last_undegraded":"2024-09-19T05:47:41.941200+0000","last_fullsized":"2024-09-19T05:47:41.941200+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.960325+0000","last_change":"2024-09-19T05:47:41.959689+0000","last_active":"2024-09-19T05:47:41.960325+0000","last_peered":"2024-09-19T05:47:41.960325+0000","last_clean":"2024-09-19T05:47:41.960325+0000","last_became_active":"2024-09-19T05:47:41.959337+0000","last_became_peered":"2024-09-19T05:47:41.959337+0000","last_unstale":"2024-09-19T05:47:41.960325+0000","last_undegraded":"2024-09-19T05:47:41.960325+0000","last_fullsized":"2024-09-19T05:47:41.960325+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:43.673298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949476+0000","last_change":"2024-09-19T05:47:41.949476+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949476+0000","last_undegraded":"2024-09-19T05:47:41.949476+0000","last_fullsized":"2024-09-19T05:47:41.949476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967434+0000","last_change":"2024-09-19T05:47:41.967000+0000","last_active":"2024-09-19T05:47:41.967434+0000","last_peered":"2024-09-19T05:47:41.967434+0000","last_clean":"2024-09-19T05:47:41.967434+0000","last_became_active":"2024-09-19T05:47:41.966638+0000","last_became_peered":"2024-09-19T05:47:41.966638+0000","last_unstale":"2024-09-19T05:47:41.967434+0000","last_undegraded":"2024-09-19T05:47:41.967434+0000","last_fullsized":"2024-09-19T05:47:41.967434+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:34:40.290020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949422+0000","last_change":"2024-09-19T05:47:41.949422+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949422+0000","last_undegraded":"2024-09-19T05:47:41.949422+0000","last_fullsized":"2024-09-19T05:47:41.949422+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967707+0000","last_change":"2024-09-19T05:47:41.963785+0000","last_active":"2024-09-19T05:47:41.967707+0000","last_peered":"2024-09-19T05:47:41.967707+0000","last_clean":"2024-09-19T05:47:41.967707+0000","last_became_active":"2024-09-19T05:47:41.963188+0000","last_became_peered":"2024-09-19T05:47:41.963188+0000","last_unstale":"2024-09-19T05:47:41.967707+0000","last_undegraded":"2024-09-19T05:47:41.967707+0000","last_fullsized":"2024-09-19T05:47:41.967707+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:02.922556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941277+0000","last_change":"2024-09-19T05:47:41.941277+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941277+0000","last_undegraded":"2024-09-19T05:47:41.941277+0000","last_fullsized":"2024-09-19T05:47:41.941277+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.968204+0000","last_change":"2024-09-19T05:47:41.966113+0000","last_active":"2024-09-19T05:47:41.968204+0000","last_peered":"2024-09-19T05:47:41.968204+0000","last_clean":"2024-09-19T05:47:41.968204+0000","last_became_active":"2024-09-19T05:47:41.965410+0000","last_became_peered":"2024-09-19T05:47:41.965410+0000","last_unstale":"2024-09-19T05:47:41.968204+0000","last_undegraded":"2024-09-19T05:47:41.968204+0000","last_fullsized":"2024-09-19T05:47:41.968204+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:23.524781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.937951+0000","last_change":"2024-09-19T05:47:41.937951+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.937951+0000","last_undegraded":"2024-09-19T05:47:41.937951+0000","last_fullsized":"2024-09-19T05:47:41.937951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.963878+0000","last_change":"2024-09-19T05:47:41.962814+0000","last_active":"2024-09-19T05:47:41.963878+0000","last_peered":"2024-09-19T05:47:41.963878+0000","last_clean":"2024-09-19T05:47:41.963878+0000","last_became_active":"2024-09-19T05:47:41.962547+0000","last_became_peered":"2024-09-19T05:47:41.962547+0000","last_unstale":"2024-09-19T05:47:41.963878+0000","last_undegraded":"2024-09-19T05:47:41.963878+0000","last_fullsized":"2024-09-19T05:47:41.963878+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.635828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946873+0000","last_change":"2024-09-19T05:47:41.946873+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946873+0000","last_undegraded":"2024-09-19T05:47:41.946873+0000","last_fullsized":"2024-09-19T05:47:41.946873+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.963110+0000","last_change":"2024-09-19T05:47:41.962422+0000","last_active":"2024-09-19T05:47:41.963110+0000","last_peered":"2024-09-19T05:47:41.963110+0000","last_clean":"2024-09-19T05:47:41.963110+0000","last_became_active":"2024-09-19T05:47:41.962067+0000","last_became_peered":"2024-09-19T05:47:41.962067+0000","last_unstale":"2024-09-19T05:47:41.963110+0000","last_undegraded":"2024-09-19T05:47:41.963110+0000","last_fullsized":"2024-09-19T05:47:41.963110+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:12.695351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939698+0000","last_change":"2024-09-19T05:47:41.939698+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939698+0000","last_undegraded":"2024-09-19T05:47:41.939698+0000","last_fullsized":"2024-09-19T05:47:41.939698+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958745+0000","last_change":"2024-09-19T05:47:41.957647+0000","last_active":"2024-09-19T05:47:41.958745+0000","last_peered":"2024-09-19T05:47:41.958745+0000","last_clean":"2024-09-19T05:47:41.958745+0000","last_became_active":"2024-09-19T05:47:41.957340+0000","last_became_peered":"2024-09-19T05:47:41.957340+0000","last_unstale":"2024-09-19T05:47:41.958745+0000","last_undegraded":"2024-09-19T05:47:41.958745+0000","last_fullsized":"2024-09-19T05:47:41.958745+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:04.880777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.960155+0000","last_change":"2024-09-19T05:47:41.960155+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.960155+0000","last_undegraded":"2024-09-19T05:47:41.960155+0000","last_fullsized":"2024-09-19T05:47:41.960155+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.959020+0000","last_change":"2024-09-19T05:47:41.956446+0000","last_active":"2024-09-19T05:47:41.959020+0000","last_peered":"2024-09-19T05:47:41.959020+0000","last_clean":"2024-09-19T05:47:41.959020+0000","last_became_active":"2024-09-19T05:47:41.956016+0000","last_became_peered":"2024-09-19T05:47:41.956016+0000","last_unstale":"2024-09-19T05:47:41.959020+0000","last_undegraded":"2024-09-19T05:47:41.959020+0000","last_fullsized":"2024-09-19T05:47:41.959020+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.383814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940471+0000","last_change":"2024-09-19T05:47:41.940471+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940471+0000","last_undegraded":"2024-09-19T05:47:41.940471+0000","last_fullsized":"2024-09-19T05:47:41.940471+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970336+0000","last_change":"2024-09-19T05:47:41.967485+0000","last_active":"2024-09-19T05:47:41.970336+0000","last_peered":"2024-09-19T05:47:41.970336+0000","last_clean":"2024-09-19T05:47:41.970336+0000","last_became_active":"2024-09-19T05:47:41.966573+0000","last_became_peered":"2024-09-19T05:47:41.966573+0000","last_unstale":"2024-09-19T05:47:41.970336+0000","last_undegraded":"2024-09-19T05:47:41.970336+0000","last_fullsized":"2024-09-19T05:47:41.970336+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:47.999804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945692+0000","last_change":"2024-09-19T05:47:41.945692+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945692+0000","last_undegraded":"2024-09-19T05:47:41.945692+0000","last_fullsized":"2024-09-19T05:47:41.945692+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967332+0000","last_change":"2024-09-19T05:47:41.958616+0000","last_active":"2024-09-19T05:47:41.967332+0000","last_peered":"2024-09-19T05:47:41.967332+0000","last_clean":"2024-09-19T05:47:41.967332+0000","last_became_active":"2024-09-19T05:47:41.958118+0000","last_became_peered":"2024-09-19T05:47:41.958118+0000","last_unstale":"2024-09-19T05:47:41.967332+0000","last_undegraded":"2024-09-19T05:47:41.967332+0000","last_fullsized":"2024-09-19T05:47:41.967332+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:42.814320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948406+0000","last_change":"2024-09-19T05:47:41.948406+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948406+0000","last_undegraded":"2024-09-19T05:47:41.948406+0000","last_fullsized":"2024-09-19T05:47:41.948406+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973076+0000","last_change":"2024-09-19T05:47:41.972593+0000","last_active":"2024-09-19T05:47:41.973076+0000","last_peered":"2024-09-19T05:47:41.973076+0000","last_clean":"2024-09-19T05:47:41.973076+0000","last_became_active":"2024-09-19T05:47:41.972351+0000","last_became_peered":"2024-09-19T05:47:41.972351+0000","last_unstale":"2024-09-19T05:47:41.973076+0000","last_undegraded":"2024-09-19T05:47:41.973076+0000","last_fullsized":"2024-09-19T05:47:41.973076+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:01.536776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944552+0000","last_change":"2024-09-19T05:47:41.944552+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944552+0000","last_undegraded":"2024-09-19T05:47:41.944552+0000","last_fullsized":"2024-09-19T05:47:41.944552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970864+0000","last_change":"2024-09-19T05:47:41.961283+0000","last_active":"2024-09-19T05:47:41.970864+0000","last_peered":"2024-09-19T05:47:41.970864+0000","last_clean":"2024-09-19T05:47:41.970864+0000","last_became_active":"2024-09-19T05:47:41.960599+0000","last_became_peered":"2024-09-19T05:47:41.960599+0000","last_unstale":"2024-09-19T05:47:41.970864+0000","last_undegraded":"2024-09-19T05:47:41.970864+0000","last_fullsized":"2024-09-19T05:47:41.970864+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:10.299523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.943862+0000","last_change":"2024-09-19T05:47:41.943862+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.943862+0000","last_undegraded":"2024-09-19T05:47:41.943862+0000","last_fullsized":"2024-09-19T05:47:41.943862+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967083+0000","last_change":"2024-09-19T05:47:41.961093+0000","last_active":"2024-09-19T05:47:41.967083+0000","last_peered":"2024-09-19T05:47:41.967083+0000","last_clean":"2024-09-19T05:47:41.967083+0000","last_became_active":"2024-09-19T05:47:41.954232+0000","last_became_peered":"2024-09-19T05:47:41.954232+0000","last_unstale":"2024-09-19T05:47:41.967083+0000","last_undegraded":"2024-09-19T05:47:41.967083+0000","last_fullsized":"2024-09-19T05:47:41.967083+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:33.410187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941134+0000","last_change":"2024-09-19T05:47:41.941134+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941134+0000","last_undegraded":"2024-09-19T05:47:41.941134+0000","last_fullsized":"2024-09-19T05:47:41.941134+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958710+0000","last_change":"2024-09-19T05:47:41.956832+0000","last_active":"2024-09-19T05:47:41.958710+0000","last_peered":"2024-09-19T05:47:41.958710+0000","last_clean":"2024-09-19T05:47:41.958710+0000","last_became_active":"2024-09-19T05:47:41.956161+0000","last_became_peered":"2024-09-19T05:47:41.956161+0000","last_unstale":"2024-09-19T05:47:41.958710+0000","last_undegraded":"2024-09-19T05:47:41.958710+0000","last_fullsized":"2024-09-19T05:47:41.958710+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:33.570626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950106+0000","last_change":"2024-09-19T05:47:41.950106+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950106+0000","last_undegraded":"2024-09-19T05:47:41.950106+0000","last_fullsized":"2024-09-19T05:47:41.950106+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970877+0000","last_change":"2024-09-19T05:47:41.961628+0000","last_active":"2024-09-19T05:47:41.970877+0000","last_peered":"2024-09-19T05:47:41.970877+0000","last_clean":"2024-09-19T05:47:41.970877+0000","last_became_active":"2024-09-19T05:47:41.961017+0000","last_became_peered":"2024-09-19T05:47:41.961017+0000","last_unstale":"2024-09-19T05:47:41.970877+0000","last_undegraded":"2024-09-19T05:47:41.970877+0000","last_fullsized":"2024-09-19T05:47:41.970877+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:13.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.951834+0000","last_change":"2024-09-19T05:47:41.951834+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.951834+0000","last_undegraded":"2024-09-19T05:47:41.951834+0000","last_fullsized":"2024-09-19T05:47:41.951834+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.969641+0000","last_change":"2024-09-19T05:47:41.969077+0000","last_active":"2024-09-19T05:47:41.969641+0000","last_peered":"2024-09-19T05:47:41.969641+0000","last_clean":"2024-09-19T05:47:41.969641+0000","last_became_active":"2024-09-19T05:47:41.968721+0000","last_became_peered":"2024-09-19T05:47:41.968721+0000","last_unstale":"2024-09-19T05:47:41.969641+0000","last_undegraded":"2024-09-19T05:47:41.969641+0000","last_fullsized":"2024-09-19T05:47:41.969641+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:53.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949405+0000","last_change":"2024-09-19T05:47:41.949405+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949405+0000","last_undegraded":"2024-09-19T05:47:41.949405+0000","last_fullsized":"2024-09-19T05:47:41.949405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967236+0000","last_change":"2024-09-19T05:47:41.958286+0000","last_active":"2024-09-19T05:47:41.967236+0000","last_peered":"2024-09-19T05:47:41.967236+0000","last_clean":"2024-09-19T05:47:41.967236+0000","last_became_active":"2024-09-19T05:47:41.957781+0000","last_became_peered":"2024-09-19T05:47:41.957781+0000","last_unstale":"2024-09-19T05:47:41.967236+0000","last_undegraded":"2024-09-19T05:47:41.967236+0000","last_fullsized":"2024-09-19T05:47:41.967236+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:37.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945018+0000","last_change":"2024-09-19T05:47:41.945018+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945018+0000","last_undegraded":"2024-09-19T05:47:41.945018+0000","last_fullsized":"2024-09-19T05:47:41.945018+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.962065+0000","last_change":"2024-09-19T05:47:41.959238+0000","last_active":"2024-09-19T05:47:41.962065+0000","last_peered":"2024-09-19T05:47:41.962065+0000","last_clean":"2024-09-19T05:47:41.962065+0000","last_became_active":"2024-09-19T05:47:41.958803+0000","last_became_peered":"2024-09-19T05:47:41.958803+0000","last_unstale":"2024-09-19T05:47:41.962065+0000","last_undegraded":"2024-09-19T05:47:41.962065+0000","last_fullsized":"2024-09-19T05:47:41.962065+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:07.195273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.936877+0000","last_change":"2024-09-19T05:47:41.936877+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.936877+0000","last_undegraded":"2024-09-19T05:47:41.936877+0000","last_fullsized":"2024-09-19T05:47:41.936877+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954786+0000","last_change":"2024-09-19T05:47:41.953928+0000","last_active":"2024-09-19T05:47:41.954786+0000","last_peered":"2024-09-19T05:47:41.954786+0000","last_clean":"2024-09-19T05:47:41.954786+0000","last_became_active":"2024-09-19T05:47:41.953597+0000","last_became_peered":"2024-09-19T05:47:41.953597+0000","last_unstale":"2024-09-19T05:47:41.954786+0000","last_undegraded":"2024-09-19T05:47:41.954786+0000","last_fullsized":"2024-09-19T05:47:41.954786+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:36.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":476,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.961300+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:47:41.961300+0000","last_peered":"2024-09-19T05:47:41.961300+0000","last_clean":"2024-09-19T05:47:41.961300+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:47:41.961300+0000","last_undegraded":"2024-09-19T05:47:41.961300+0000","last_fullsized":"2024-09-19T05:47:41.961300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542322,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74340,"kb_used_data":2892,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297500,"statfs":{"total":96636764160,"available":96560640000,"internally_reserved":0,"allocated":2961408,"data_stored":1706799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542322,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73776,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298064,"statfs":{"total":96636764160,"available":96561217536,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51572,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320268,"statfs":{"total":96636764160,"available":96583954432,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73772,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298068,"statfs":{"total":96636764160,"available":96561221632,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542323,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73692,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298148,"statfs":{"total":96636764160,"available":96561303552,"internally_reserved":0,"allocated":2367488,"data_stored":1116431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73772,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298068,"statfs":{"total":96636764160,"available":96561221632,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542325,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47408,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324432,"statfs":{"total":96636764160,"available":96588218368,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542322,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78508,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293332,"statfs":{"total":96636764160,"available":96556371968,"internally_reserved":0,"allocated":2973696,"data_stored":1713466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:47:47.032 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:47:47.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c53a7f640 1 Processor -- start 2024-09-19T05:47:47.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c53a7f640 1 -- start start 2024-09-19T05:47:47.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c53a7f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c06dde0 0x7f2c4c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c53a7f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c4c06e3c0 con 0x7f2c4c15c030 2024-09-19T05:47:47.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c53a7f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c4c06e6a0 con 0x7f2c4c0b3510 2024-09-19T05:47:47.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c53a7f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4c06e980 con 0x7f2c4c06dde0 2024-09-19T05:47:47.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5181b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2c4c15c030 0x7f2c4c15d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46526/0 (socket says 172.21.15.67:46526) 2024-09-19T05:47:47.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5181b640 1 -- 172.21.15.67:0/3300546775 learned_addr learned my addr 172.21.15.67:0/3300546775 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:47.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5101a640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c06dde0 0x7f2c4c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996037375 0 0) 0x7f2c4c06e3c0 con 0x7f2c4c15c030 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c38003530 con 0x7f2c4c15c030 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 664179798 0 0) 0x7f2c38003530 con 0x7f2c4c15c030 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c06dde0 msgr2=0x7f2c4c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c06dde0 0x7f2c4c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 >> v1:172.21.15.97:6789/0 conn(0x7f2c4c0b3510 legacy=0x7f2c4c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4c06ec60 con 0x7f2c4c15c030 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f2c48001680 con 0x7f2c4c15c030 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 >> v1:172.21.15.67:6789/0 conn(0x7f2c4c15c030 legacy=0x7f2c4c15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c380039f0 0x7f2c38003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c06dde0 0x7f2c38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c38004d50 0x7f2c380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c06e980 con 0x7f2c380039f0 2024-09-19T05:47:47.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3800bb30 con 0x7f2c38004d50 2024-09-19T05:47:47.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3800bd30 con 0x7f2c4c06dde0 2024-09-19T05:47:47.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5181b640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c380039f0 0x7f2c38003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5101a640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c06dde0 0x7f2c38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5201c640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c38004d50 0x7f2c380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5181b640 1 -- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c06dde0 msgr2=0x7f2c38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:47.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5181b640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c06dde0 0x7f2c38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5181b640 1 -- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c38004d50 msgr2=0x7f2c380051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:47.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5181b640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c38004d50 0x7f2c380051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.203+0000 7f2c5181b640 1 -- 172.21.15.67:0/3300546775 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c38003530 con 0x7f2c380039f0 2024-09-19T05:47:47.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c5181b640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c380039f0 0x7f2c38003e10 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800c1c0 tx=0x7f2c4801cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ab3a215a41ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48007d00 con 0x7f2c380039f0 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c480a9020 con 0x7f2c380039f0 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c50819640 1 -- 172.21.15.67:0/3300546775 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48005b00 con 0x7f2c380039f0 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c53a7f640 1 -- 172.21.15.67:0/3300546775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c380039f0 msgr2=0x7f2c38003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c53a7f640 1 --2- 172.21.15.67:0/3300546775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c380039f0 0x7f2c38003e10 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800c1c0 tx=0x7f2c4801cb70 comp rx=0 tx=0).stop 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c5201c640 1 -- 172.21.15.67:0/3300546775 reap_dead start 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c53a7f640 1 -- 172.21.15.67:0/3300546775 shutdown_connections 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c53a7f640 1 -- 172.21.15.67:0/3300546775 >> 172.21.15.67:0/3300546775 conn(0x7f2c4c0d0080 msgr2=0x7f2c4c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c53a7f640 1 -- 172.21.15.67:0/3300546775 shutdown_connections 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c53a7f640 1 -- 172.21.15.67:0/3300546775 wait complete. 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c53a7f640 1 Processor -- start 2024-09-19T05:47:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.207+0000 7f2c53a7f640 1 -- start start 2024-09-19T05:47:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c53a7f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c380039f0 0x7f2c4c1624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c53a7f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c4c145df0 0x7f2c4c151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c53a7f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c1f9120 0x7f2c4c1f95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c53a7f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c15c620 con 0x7f2c4c145df0 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c53a7f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c1680e0 con 0x7f2c380039f0 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c53a7f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4c168260 con 0x7f2c4c1f9120 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5101a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c4c145df0 0x7f2c4c151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5101a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c4c145df0 0x7f2c4c151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59888/0 (socket says 172.21.15.67:59888) 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5101a640 1 -- 172.21.15.67:0/165005933 learned_addr learned my addr 172.21.15.67:0/165005933 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5181b640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c380039f0 0x7f2c4c1624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5201c640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c1f9120 0x7f2c4c1f95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5101a640 1 -- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c1f9120 msgr2=0x7f2c4c1f95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5101a640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c1f9120 0x7f2c4c1f95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5101a640 1 -- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c380039f0 msgr2=0x7f2c4c1624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5101a640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c380039f0 0x7f2c4c1624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5101a640 1 -- 172.21.15.67:0/165005933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4c161090 con 0x7f2c4c145df0 2024-09-19T05:47:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5201c640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c1f9120 0x7f2c4c1f95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5101a640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c4c145df0 0x7f2c4c151530 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c011610 tx=0x7f2c3c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c427fc640 1 -- 172.21.15.67:0/165005933 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c00f8f0 con 0x7f2c4c145df0 2024-09-19T05:47:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c427fc640 1 -- 172.21.15.67:0/165005933 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3c00fa90 con 0x7f2c4c145df0 2024-09-19T05:47:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c427fc640 1 -- 172.21.15.67:0/165005933 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c00fe40 con 0x7f2c4c145df0 2024-09-19T05:47:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c53a7f640 1 -- 172.21.15.67:0/165005933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4c151e10 con 0x7f2c4c145df0 2024-09-19T05:47:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c53a7f640 1 -- 172.21.15.67:0/165005933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4c165160 con 0x7f2c4c145df0 2024-09-19T05:47:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c53a7f640 1 -- 172.21.15.67:0/165005933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4c06f460 con 0x7f2c4c145df0 2024-09-19T05:47:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c427fc640 1 -- 172.21.15.67:0/165005933 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c3c015460 con 0x7f2c4c145df0 2024-09-19T05:47:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c427fc640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c300678f0 0x7f2c30069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c427fc640 1 -- 172.21.15.67:0/165005933 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f2c3c086510 con 0x7f2c4c145df0 2024-09-19T05:47:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.211+0000 7f2c5181b640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c300678f0 0x7f2c30069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.215+0000 7f2c5181b640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c300678f0 0x7f2c30069db0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2c480aa000 tx=0x7f2c480b1040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:47.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.215+0000 7f2c427fc640 1 -- 172.21.15.67:0/165005933 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2c3c019030 con 0x7f2c4c145df0 2024-09-19T05:47:47.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.379+0000 7f2c53a7f640 1 -- 172.21.15.67:0/165005933 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c4c0d0f20 con 0x7f2c300678f0 2024-09-19T05:47:47.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.395+0000 7f2c427fc640 1 -- 172.21.15.67:0/165005933 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247097 (secure 0 0 0) 0x7f2c4c0d0f20 con 0x7f2c300678f0 2024-09-19T05:47:47.395 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:47.397 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:47:47.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 -- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c300678f0 msgr2=0x7f2c30069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c300678f0 0x7f2c30069db0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2c480aa000 tx=0x7f2c480b1040 comp rx=0 tx=0).stop 2024-09-19T05:47:47.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 -- 172.21.15.67:0/165005933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c4c145df0 msgr2=0x7f2c4c151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c4c145df0 0x7f2c4c151530 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c011610 tx=0x7f2c3c011ad0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 -- 172.21.15.67:0/165005933 shutdown_connections 2024-09-19T05:47:47.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2c300678f0 0x7f2c30069db0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c4c1f9120 0x7f2c4c1f95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c4c145df0 0x7f2c4c151530 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 --2- 172.21.15.67:0/165005933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c380039f0 0x7f2c4c1624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 -- 172.21.15.67:0/165005933 >> 172.21.15.67:0/165005933 conn(0x7f2c4c0d0080 msgr2=0x7f2c4c0b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:47.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 -- 172.21.15.67:0/165005933 shutdown_connections 2024-09-19T05:47:47.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.399+0000 7f2c53a7f640 1 -- 172.21.15.67:0/165005933 wait complete. 2024-09-19T05:47:47.415 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":626,"stamp":"2024-09-19T05:47:45.412063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":546840,"kb_used_data":19728,"kb_used_omap":12,"kb_used_meta":526899,"kb_avail":754427880,"statfs":{"total":773094113280,"available":772534149120,"internally_reserved":0,"allocated":20201472,"data_stored":10152186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":539545137},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.488099"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940180+0000","last_change":"2024-09-19T05:47:41.940180+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940180+0000","last_undegraded":"2024-09-19T05:47:41.940180+0000","last_fullsized":"2024-09-19T05:47:41.940180+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939965+0000","last_change":"2024-09-19T05:47:41.939965+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939965+0000","last_undegraded":"2024-09-19T05:47:41.939965+0000","last_fullsized":"2024-09-19T05:47:41.939965+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.953830+0000","last_change":"2024-09-19T05:47:41.953830+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.953830+0000","last_undegraded":"2024-09-19T05:47:41.953830+0000","last_fullsized":"2024-09-19T05:47:41.953830+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949936+0000","last_change":"2024-09-19T05:47:41.949936+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949936+0000","last_undegraded":"2024-09-19T05:47:41.949936+0000","last_fullsized":"2024-09-19T05:47:41.949936+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947364+0000","last_change":"2024-09-19T05:47:41.947364+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947364+0000","last_undegraded":"2024-09-19T05:47:41.947364+0000","last_fullsized":"2024-09-19T05:47:41.947364+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948780+0000","last_change":"2024-09-19T05:47:41.948780+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948780+0000","last_undegraded":"2024-09-19T05:47:41.948780+0000","last_fullsized":"2024-09-19T05:47:41.948780+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946499+0000","last_change":"2024-09-19T05:47:41.946499+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946499+0000","last_undegraded":"2024-09-19T05:47:41.946499+0000","last_fullsized":"2024-09-19T05:47:41.946499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950493+0000","last_change":"2024-09-19T05:47:41.950493+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950493+0000","last_undegraded":"2024-09-19T05:47:41.950493+0000","last_fullsized":"2024-09-19T05:47:41.950493+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948580+0000","last_change":"2024-09-19T05:47:41.948580+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948580+0000","last_undegraded":"2024-09-19T05:47:41.948580+0000","last_fullsized":"2024-09-19T05:47:41.948580+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948677+0000","last_change":"2024-09-19T05:47:41.948677+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948677+0000","last_undegraded":"2024-09-19T05:47:41.948677+0000","last_fullsized":"2024-09-19T05:47:41.948677+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.953401+0000","last_change":"2024-09-19T05:47:41.953401+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.953401+0000","last_undegraded":"2024-09-19T05:47:41.953401+0000","last_fullsized":"2024-09-19T05:47:41.953401+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950433+0000","last_change":"2024-09-19T05:47:41.950433+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950433+0000","last_undegraded":"2024-09-19T05:47:41.950433+0000","last_fullsized":"2024-09-19T05:47:41.950433+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948591+0000","last_change":"2024-09-19T05:47:41.948591+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948591+0000","last_undegraded":"2024-09-19T05:47:41.948591+0000","last_fullsized":"2024-09-19T05:47:41.948591+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946921+0000","last_change":"2024-09-19T05:47:41.946921+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946921+0000","last_undegraded":"2024-09-19T05:47:41.946921+0000","last_fullsized":"2024-09-19T05:47:41.946921+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942282+0000","last_change":"2024-09-19T05:47:41.942282+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942282+0000","last_undegraded":"2024-09-19T05:47:41.942282+0000","last_fullsized":"2024-09-19T05:47:41.942282+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.952887+0000","last_change":"2024-09-19T05:47:41.952887+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.952887+0000","last_undegraded":"2024-09-19T05:47:41.952887+0000","last_fullsized":"2024-09-19T05:47:41.952887+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947978+0000","last_change":"2024-09-19T05:47:41.947978+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947978+0000","last_undegraded":"2024-09-19T05:47:41.947978+0000","last_fullsized":"2024-09-19T05:47:41.947978+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946134+0000","last_change":"2024-09-19T05:47:41.946134+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946134+0000","last_undegraded":"2024-09-19T05:47:41.946134+0000","last_fullsized":"2024-09-19T05:47:41.946134+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945573+0000","last_change":"2024-09-19T05:47:41.945573+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945573+0000","last_undegraded":"2024-09-19T05:47:41.945573+0000","last_fullsized":"2024-09-19T05:47:41.945573+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950975+0000","last_change":"2024-09-19T05:47:41.950975+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950975+0000","last_undegraded":"2024-09-19T05:47:41.950975+0000","last_fullsized":"2024-09-19T05:47:41.950975+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948069+0000","last_change":"2024-09-19T05:47:41.948069+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948069+0000","last_undegraded":"2024-09-19T05:47:41.948069+0000","last_fullsized":"2024-09-19T05:47:41.948069+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945902+0000","last_change":"2024-09-19T05:47:41.945902+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945902+0000","last_undegraded":"2024-09-19T05:47:41.945902+0000","last_fullsized":"2024-09-19T05:47:41.945902+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940487+0000","last_change":"2024-09-19T05:47:41.940487+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940487+0000","last_undegraded":"2024-09-19T05:47:41.940487+0000","last_fullsized":"2024-09-19T05:47:41.940487+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946999+0000","last_change":"2024-09-19T05:47:41.946999+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946999+0000","last_undegraded":"2024-09-19T05:47:41.946999+0000","last_fullsized":"2024-09-19T05:47:41.946999+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947370+0000","last_change":"2024-09-19T05:47:41.947370+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947370+0000","last_undegraded":"2024-09-19T05:47:41.947370+0000","last_fullsized":"2024-09-19T05:47:41.947370+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941457+0000","last_change":"2024-09-19T05:47:41.941457+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941457+0000","last_undegraded":"2024-09-19T05:47:41.941457+0000","last_fullsized":"2024-09-19T05:47:41.941457+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949404+0000","last_change":"2024-09-19T05:47:41.949404+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949404+0000","last_undegraded":"2024-09-19T05:47:41.949404+0000","last_fullsized":"2024-09-19T05:47:41.949404+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946520+0000","last_change":"2024-09-19T05:47:41.946520+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946520+0000","last_undegraded":"2024-09-19T05:47:41.946520+0000","last_fullsized":"2024-09-19T05:47:41.946520+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944476+0000","last_change":"2024-09-19T05:47:41.944476+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944476+0000","last_undegraded":"2024-09-19T05:47:41.944476+0000","last_fullsized":"2024-09-19T05:47:41.944476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944442+0000","last_change":"2024-09-19T05:47:41.944442+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944442+0000","last_undegraded":"2024-09-19T05:47:41.944442+0000","last_fullsized":"2024-09-19T05:47:41.944442+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.952444+0000","last_change":"2024-09-19T05:47:41.952444+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.952444+0000","last_undegraded":"2024-09-19T05:47:41.952444+0000","last_fullsized":"2024-09-19T05:47:41.952444+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949314+0000","last_change":"2024-09-19T05:47:41.949314+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949314+0000","last_undegraded":"2024-09-19T05:47:41.949314+0000","last_fullsized":"2024-09-19T05:47:41.949314+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939697+0000","last_change":"2024-09-19T05:47:41.939697+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939697+0000","last_undegraded":"2024-09-19T05:47:41.939697+0000","last_fullsized":"2024-09-19T05:47:41.939697+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.974835+0000","last_change":"2024-09-19T05:47:41.972348+0000","last_active":"2024-09-19T05:47:41.974835+0000","last_peered":"2024-09-19T05:47:41.974835+0000","last_clean":"2024-09-19T05:47:41.974835+0000","last_became_active":"2024-09-19T05:47:41.971855+0000","last_became_peered":"2024-09-19T05:47:41.971855+0000","last_unstale":"2024-09-19T05:47:41.974835+0000","last_undegraded":"2024-09-19T05:47:41.974835+0000","last_fullsized":"2024-09-19T05:47:41.974835+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:41.408991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942800+0000","last_change":"2024-09-19T05:47:41.942800+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942800+0000","last_undegraded":"2024-09-19T05:47:41.942800+0000","last_fullsized":"2024-09-19T05:47:41.942800+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958617+0000","last_change":"2024-09-19T05:47:41.955701+0000","last_active":"2024-09-19T05:47:41.958617+0000","last_peered":"2024-09-19T05:47:41.958617+0000","last_clean":"2024-09-19T05:47:41.958617+0000","last_became_active":"2024-09-19T05:47:41.953352+0000","last_became_peered":"2024-09-19T05:47:41.953352+0000","last_unstale":"2024-09-19T05:47:41.958617+0000","last_undegraded":"2024-09-19T05:47:41.958617+0000","last_fullsized":"2024-09-19T05:47:41.958617+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:33.061928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944794+0000","last_change":"2024-09-19T05:47:41.944794+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944794+0000","last_undegraded":"2024-09-19T05:47:41.944794+0000","last_fullsized":"2024-09-19T05:47:41.944794+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954715+0000","last_change":"2024-09-19T05:47:41.944967+0000","last_active":"2024-09-19T05:47:41.954715+0000","last_peered":"2024-09-19T05:47:41.954715+0000","last_clean":"2024-09-19T05:47:41.954715+0000","last_became_active":"2024-09-19T05:47:41.944696+0000","last_became_peered":"2024-09-19T05:47:41.944696+0000","last_unstale":"2024-09-19T05:47:41.954715+0000","last_undegraded":"2024-09-19T05:47:41.954715+0000","last_fullsized":"2024-09-19T05:47:41.954715+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:17.350651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946969+0000","last_change":"2024-09-19T05:47:41.946969+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946969+0000","last_undegraded":"2024-09-19T05:47:41.946969+0000","last_fullsized":"2024-09-19T05:47:41.946969+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.969647+0000","last_change":"2024-09-19T05:47:41.969151+0000","last_active":"2024-09-19T05:47:41.969647+0000","last_peered":"2024-09-19T05:47:41.969647+0000","last_clean":"2024-09-19T05:47:41.969647+0000","last_became_active":"2024-09-19T05:47:41.968800+0000","last_became_peered":"2024-09-19T05:47:41.968800+0000","last_unstale":"2024-09-19T05:47:41.969647+0000","last_undegraded":"2024-09-19T05:47:41.969647+0000","last_fullsized":"2024-09-19T05:47:41.969647+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:11.896933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942875+0000","last_change":"2024-09-19T05:47:41.942875+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942875+0000","last_undegraded":"2024-09-19T05:47:41.942875+0000","last_fullsized":"2024-09-19T05:47:41.942875+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973178+0000","last_change":"2024-09-19T05:47:41.970704+0000","last_active":"2024-09-19T05:47:41.973178+0000","last_peered":"2024-09-19T05:47:41.973178+0000","last_clean":"2024-09-19T05:47:41.973178+0000","last_became_active":"2024-09-19T05:47:41.970086+0000","last_became_peered":"2024-09-19T05:47:41.970086+0000","last_unstale":"2024-09-19T05:47:41.973178+0000","last_undegraded":"2024-09-19T05:47:41.973178+0000","last_fullsized":"2024-09-19T05:47:41.973178+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:15.199524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.951396+0000","last_change":"2024-09-19T05:47:41.951396+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.951396+0000","last_undegraded":"2024-09-19T05:47:41.951396+0000","last_fullsized":"2024-09-19T05:47:41.951396+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.972238+0000","last_change":"2024-09-19T05:47:41.970568+0000","last_active":"2024-09-19T05:47:41.972238+0000","last_peered":"2024-09-19T05:47:41.972238+0000","last_clean":"2024-09-19T05:47:41.972238+0000","last_became_active":"2024-09-19T05:47:41.970029+0000","last_became_peered":"2024-09-19T05:47:41.970029+0000","last_unstale":"2024-09-19T05:47:41.972238+0000","last_undegraded":"2024-09-19T05:47:41.972238+0000","last_fullsized":"2024-09-19T05:47:41.972238+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:47.105803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946834+0000","last_change":"2024-09-19T05:47:41.946834+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946834+0000","last_undegraded":"2024-09-19T05:47:41.946834+0000","last_fullsized":"2024-09-19T05:47:41.946834+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.964655+0000","last_change":"2024-09-19T05:47:41.963677+0000","last_active":"2024-09-19T05:47:41.964655+0000","last_peered":"2024-09-19T05:47:41.964655+0000","last_clean":"2024-09-19T05:47:41.964655+0000","last_became_active":"2024-09-19T05:47:41.963381+0000","last_became_peered":"2024-09-19T05:47:41.963381+0000","last_unstale":"2024-09-19T05:47:41.964655+0000","last_undegraded":"2024-09-19T05:47:41.964655+0000","last_fullsized":"2024-09-19T05:47:41.964655+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:36.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944697+0000","last_change":"2024-09-19T05:47:41.944697+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944697+0000","last_undegraded":"2024-09-19T05:47:41.944697+0000","last_fullsized":"2024-09-19T05:47:41.944697+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.961836+0000","last_change":"2024-09-19T05:47:41.959230+0000","last_active":"2024-09-19T05:47:41.961836+0000","last_peered":"2024-09-19T05:47:41.961836+0000","last_clean":"2024-09-19T05:47:41.961836+0000","last_became_active":"2024-09-19T05:47:41.958352+0000","last_became_peered":"2024-09-19T05:47:41.958352+0000","last_unstale":"2024-09-19T05:47:41.961836+0000","last_undegraded":"2024-09-19T05:47:41.961836+0000","last_fullsized":"2024-09-19T05:47:41.961836+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:46.163005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945418+0000","last_change":"2024-09-19T05:47:41.945418+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945418+0000","last_undegraded":"2024-09-19T05:47:41.945418+0000","last_fullsized":"2024-09-19T05:47:41.945418+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.977955+0000","last_change":"2024-09-19T05:47:41.977216+0000","last_active":"2024-09-19T05:47:41.977955+0000","last_peered":"2024-09-19T05:47:41.977955+0000","last_clean":"2024-09-19T05:47:41.977955+0000","last_became_active":"2024-09-19T05:47:41.976763+0000","last_became_peered":"2024-09-19T05:47:41.976763+0000","last_unstale":"2024-09-19T05:47:41.977955+0000","last_undegraded":"2024-09-19T05:47:41.977955+0000","last_fullsized":"2024-09-19T05:47:41.977955+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:24.381428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.943265+0000","last_change":"2024-09-19T05:47:41.943265+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.943265+0000","last_undegraded":"2024-09-19T05:47:41.943265+0000","last_fullsized":"2024-09-19T05:47:41.943265+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954979+0000","last_change":"2024-09-19T05:47:41.954229+0000","last_active":"2024-09-19T05:47:41.954979+0000","last_peered":"2024-09-19T05:47:41.954979+0000","last_clean":"2024-09-19T05:47:41.954979+0000","last_became_active":"2024-09-19T05:47:41.953798+0000","last_became_peered":"2024-09-19T05:47:41.953798+0000","last_unstale":"2024-09-19T05:47:41.954979+0000","last_undegraded":"2024-09-19T05:47:41.954979+0000","last_fullsized":"2024-09-19T05:47:41.954979+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:30.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945863+0000","last_change":"2024-09-19T05:47:41.945863+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945863+0000","last_undegraded":"2024-09-19T05:47:41.945863+0000","last_fullsized":"2024-09-19T05:47:41.945863+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973771+0000","last_change":"2024-09-19T05:47:41.972755+0000","last_active":"2024-09-19T05:47:41.973771+0000","last_peered":"2024-09-19T05:47:41.973771+0000","last_clean":"2024-09-19T05:47:41.973771+0000","last_became_active":"2024-09-19T05:47:41.972124+0000","last_became_peered":"2024-09-19T05:47:41.972124+0000","last_unstale":"2024-09-19T05:47:41.973771+0000","last_undegraded":"2024-09-19T05:47:41.973771+0000","last_fullsized":"2024-09-19T05:47:41.973771+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.566154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946100+0000","last_change":"2024-09-19T05:47:41.946100+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946100+0000","last_undegraded":"2024-09-19T05:47:41.946100+0000","last_fullsized":"2024-09-19T05:47:41.946100+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.955505+0000","last_change":"2024-09-19T05:47:41.954745+0000","last_active":"2024-09-19T05:47:41.955505+0000","last_peered":"2024-09-19T05:47:41.955505+0000","last_clean":"2024-09-19T05:47:41.955505+0000","last_became_active":"2024-09-19T05:47:41.954279+0000","last_became_peered":"2024-09-19T05:47:41.954279+0000","last_unstale":"2024-09-19T05:47:41.955505+0000","last_undegraded":"2024-09-19T05:47:41.955505+0000","last_fullsized":"2024-09-19T05:47:41.955505+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:18.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945273+0000","last_change":"2024-09-19T05:47:41.945273+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945273+0000","last_undegraded":"2024-09-19T05:47:41.945273+0000","last_fullsized":"2024-09-19T05:47:41.945273+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.957289+0000","last_change":"2024-09-19T05:47:41.956777+0000","last_active":"2024-09-19T05:47:41.957289+0000","last_peered":"2024-09-19T05:47:41.957289+0000","last_clean":"2024-09-19T05:47:41.957289+0000","last_became_active":"2024-09-19T05:47:41.956381+0000","last_became_peered":"2024-09-19T05:47:41.956381+0000","last_unstale":"2024-09-19T05:47:41.957289+0000","last_undegraded":"2024-09-19T05:47:41.957289+0000","last_fullsized":"2024-09-19T05:47:41.957289+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:49.599888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941200+0000","last_change":"2024-09-19T05:47:41.941200+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941200+0000","last_undegraded":"2024-09-19T05:47:41.941200+0000","last_fullsized":"2024-09-19T05:47:41.941200+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.960325+0000","last_change":"2024-09-19T05:47:41.959689+0000","last_active":"2024-09-19T05:47:41.960325+0000","last_peered":"2024-09-19T05:47:41.960325+0000","last_clean":"2024-09-19T05:47:41.960325+0000","last_became_active":"2024-09-19T05:47:41.959337+0000","last_became_peered":"2024-09-19T05:47:41.959337+0000","last_unstale":"2024-09-19T05:47:41.960325+0000","last_undegraded":"2024-09-19T05:47:41.960325+0000","last_fullsized":"2024-09-19T05:47:41.960325+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:43.673298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949476+0000","last_change":"2024-09-19T05:47:41.949476+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949476+0000","last_undegraded":"2024-09-19T05:47:41.949476+0000","last_fullsized":"2024-09-19T05:47:41.949476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967434+0000","last_change":"2024-09-19T05:47:41.967000+0000","last_active":"2024-09-19T05:47:41.967434+0000","last_peered":"2024-09-19T05:47:41.967434+0000","last_clean":"2024-09-19T05:47:41.967434+0000","last_became_active":"2024-09-19T05:47:41.966638+0000","last_became_peered":"2024-09-19T05:47:41.966638+0000","last_unstale":"2024-09-19T05:47:41.967434+0000","last_undegraded":"2024-09-19T05:47:41.967434+0000","last_fullsized":"2024-09-19T05:47:41.967434+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:34:40.290020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949422+0000","last_change":"2024-09-19T05:47:41.949422+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949422+0000","last_undegraded":"2024-09-19T05:47:41.949422+0000","last_fullsized":"2024-09-19T05:47:41.949422+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967707+0000","last_change":"2024-09-19T05:47:41.963785+0000","last_active":"2024-09-19T05:47:41.967707+0000","last_peered":"2024-09-19T05:47:41.967707+0000","last_clean":"2024-09-19T05:47:41.967707+0000","last_became_active":"2024-09-19T05:47:41.963188+0000","last_became_peered":"2024-09-19T05:47:41.963188+0000","last_unstale":"2024-09-19T05:47:41.967707+0000","last_undegraded":"2024-09-19T05:47:41.967707+0000","last_fullsized":"2024-09-19T05:47:41.967707+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:02.922556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941277+0000","last_change":"2024-09-19T05:47:41.941277+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941277+0000","last_undegraded":"2024-09-19T05:47:41.941277+0000","last_fullsized":"2024-09-19T05:47:41.941277+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.968204+0000","last_change":"2024-09-19T05:47:41.966113+0000","last_active":"2024-09-19T05:47:41.968204+0000","last_peered":"2024-09-19T05:47:41.968204+0000","last_clean":"2024-09-19T05:47:41.968204+0000","last_became_active":"2024-09-19T05:47:41.965410+0000","last_became_peered":"2024-09-19T05:47:41.965410+0000","last_unstale":"2024-09-19T05:47:41.968204+0000","last_undegraded":"2024-09-19T05:47:41.968204+0000","last_fullsized":"2024-09-19T05:47:41.968204+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:23.524781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.937951+0000","last_change":"2024-09-19T05:47:41.937951+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.937951+0000","last_undegraded":"2024-09-19T05:47:41.937951+0000","last_fullsized":"2024-09-19T05:47:41.937951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.963878+0000","last_change":"2024-09-19T05:47:41.962814+0000","last_active":"2024-09-19T05:47:41.963878+0000","last_peered":"2024-09-19T05:47:41.963878+0000","last_clean":"2024-09-19T05:47:41.963878+0000","last_became_active":"2024-09-19T05:47:41.962547+0000","last_became_peered":"2024-09-19T05:47:41.962547+0000","last_unstale":"2024-09-19T05:47:41.963878+0000","last_undegraded":"2024-09-19T05:47:41.963878+0000","last_fullsized":"2024-09-19T05:47:41.963878+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.635828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946873+0000","last_change":"2024-09-19T05:47:41.946873+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946873+0000","last_undegraded":"2024-09-19T05:47:41.946873+0000","last_fullsized":"2024-09-19T05:47:41.946873+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.963110+0000","last_change":"2024-09-19T05:47:41.962422+0000","last_active":"2024-09-19T05:47:41.963110+0000","last_peered":"2024-09-19T05:47:41.963110+0000","last_clean":"2024-09-19T05:47:41.963110+0000","last_became_active":"2024-09-19T05:47:41.962067+0000","last_became_peered":"2024-09-19T05:47:41.962067+0000","last_unstale":"2024-09-19T05:47:41.963110+0000","last_undegraded":"2024-09-19T05:47:41.963110+0000","last_fullsized":"2024-09-19T05:47:41.963110+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:12.695351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939698+0000","last_change":"2024-09-19T05:47:41.939698+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939698+0000","last_undegraded":"2024-09-19T05:47:41.939698+0000","last_fullsized":"2024-09-19T05:47:41.939698+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958745+0000","last_change":"2024-09-19T05:47:41.957647+0000","last_active":"2024-09-19T05:47:41.958745+0000","last_peered":"2024-09-19T05:47:41.958745+0000","last_clean":"2024-09-19T05:47:41.958745+0000","last_became_active":"2024-09-19T05:47:41.957340+0000","last_became_peered":"2024-09-19T05:47:41.957340+0000","last_unstale":"2024-09-19T05:47:41.958745+0000","last_undegraded":"2024-09-19T05:47:41.958745+0000","last_fullsized":"2024-09-19T05:47:41.958745+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:04.880777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.960155+0000","last_change":"2024-09-19T05:47:41.960155+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.960155+0000","last_undegraded":"2024-09-19T05:47:41.960155+0000","last_fullsized":"2024-09-19T05:47:41.960155+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.959020+0000","last_change":"2024-09-19T05:47:41.956446+0000","last_active":"2024-09-19T05:47:41.959020+0000","last_peered":"2024-09-19T05:47:41.959020+0000","last_clean":"2024-09-19T05:47:41.959020+0000","last_became_active":"2024-09-19T05:47:41.956016+0000","last_became_peered":"2024-09-19T05:47:41.956016+0000","last_unstale":"2024-09-19T05:47:41.959020+0000","last_undegraded":"2024-09-19T05:47:41.959020+0000","last_fullsized":"2024-09-19T05:47:41.959020+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.383814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940471+0000","last_change":"2024-09-19T05:47:41.940471+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940471+0000","last_undegraded":"2024-09-19T05:47:41.940471+0000","last_fullsized":"2024-09-19T05:47:41.940471+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970336+0000","last_change":"2024-09-19T05:47:41.967485+0000","last_active":"2024-09-19T05:47:41.970336+0000","last_peered":"2024-09-19T05:47:41.970336+0000","last_clean":"2024-09-19T05:47:41.970336+0000","last_became_active":"2024-09-19T05:47:41.966573+0000","last_became_peered":"2024-09-19T05:47:41.966573+0000","last_unstale":"2024-09-19T05:47:41.970336+0000","last_undegraded":"2024-09-19T05:47:41.970336+0000","last_fullsized":"2024-09-19T05:47:41.970336+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:47.999804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945692+0000","last_change":"2024-09-19T05:47:41.945692+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945692+0000","last_undegraded":"2024-09-19T05:47:41.945692+0000","last_fullsized":"2024-09-19T05:47:41.945692+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967332+0000","last_change":"2024-09-19T05:47:41.958616+0000","last_active":"2024-09-19T05:47:41.967332+0000","last_peered":"2024-09-19T05:47:41.967332+0000","last_clean":"2024-09-19T05:47:41.967332+0000","last_became_active":"2024-09-19T05:47:41.958118+0000","last_became_peered":"2024-09-19T05:47:41.958118+0000","last_unstale":"2024-09-19T05:47:41.967332+0000","last_undegraded":"2024-09-19T05:47:41.967332+0000","last_fullsized":"2024-09-19T05:47:41.967332+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:42.814320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948406+0000","last_change":"2024-09-19T05:47:41.948406+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948406+0000","last_undegraded":"2024-09-19T05:47:41.948406+0000","last_fullsized":"2024-09-19T05:47:41.948406+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973076+0000","last_change":"2024-09-19T05:47:41.972593+0000","last_active":"2024-09-19T05:47:41.973076+0000","last_peered":"2024-09-19T05:47:41.973076+0000","last_clean":"2024-09-19T05:47:41.973076+0000","last_became_active":"2024-09-19T05:47:41.972351+0000","last_became_peered":"2024-09-19T05:47:41.972351+0000","last_unstale":"2024-09-19T05:47:41.973076+0000","last_undegraded":"2024-09-19T05:47:41.973076+0000","last_fullsized":"2024-09-19T05:47:41.973076+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:01.536776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944552+0000","last_change":"2024-09-19T05:47:41.944552+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944552+0000","last_undegraded":"2024-09-19T05:47:41.944552+0000","last_fullsized":"2024-09-19T05:47:41.944552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970864+0000","last_change":"2024-09-19T05:47:41.961283+0000","last_active":"2024-09-19T05:47:41.970864+0000","last_peered":"2024-09-19T05:47:41.970864+0000","last_clean":"2024-09-19T05:47:41.970864+0000","last_became_active":"2024-09-19T05:47:41.960599+0000","last_became_peered":"2024-09-19T05:47:41.960599+0000","last_unstale":"2024-09-19T05:47:41.970864+0000","last_undegraded":"2024-09-19T05:47:41.970864+0000","last_fullsized":"2024-09-19T05:47:41.970864+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:10.299523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.943862+0000","last_change":"2024-09-19T05:47:41.943862+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.943862+0000","last_undegraded":"2024-09-19T05:47:41.943862+0000","last_fullsized":"2024-09-19T05:47:41.943862+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967083+0000","last_change":"2024-09-19T05:47:41.961093+0000","last_active":"2024-09-19T05:47:41.967083+0000","last_peered":"2024-09-19T05:47:41.967083+0000","last_clean":"2024-09-19T05:47:41.967083+0000","last_became_active":"2024-09-19T05:47:41.954232+0000","last_became_peered":"2024-09-19T05:47:41.954232+0000","last_unstale":"2024-09-19T05:47:41.967083+0000","last_undegraded":"2024-09-19T05:47:41.967083+0000","last_fullsized":"2024-09-19T05:47:41.967083+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:33.410187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941134+0000","last_change":"2024-09-19T05:47:41.941134+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941134+0000","last_undegraded":"2024-09-19T05:47:41.941134+0000","last_fullsized":"2024-09-19T05:47:41.941134+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958710+0000","last_change":"2024-09-19T05:47:41.956832+0000","last_active":"2024-09-19T05:47:41.958710+0000","last_peered":"2024-09-19T05:47:41.958710+0000","last_clean":"2024-09-19T05:47:41.958710+0000","last_became_active":"2024-09-19T05:47:41.956161+0000","last_became_peered":"2024-09-19T05:47:41.956161+0000","last_unstale":"2024-09-19T05:47:41.958710+0000","last_undegraded":"2024-09-19T05:47:41.958710+0000","last_fullsized":"2024-09-19T05:47:41.958710+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:33.570626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950106+0000","last_change":"2024-09-19T05:47:41.950106+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950106+0000","last_undegraded":"2024-09-19T05:47:41.950106+0000","last_fullsized":"2024-09-19T05:47:41.950106+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970877+0000","last_change":"2024-09-19T05:47:41.961628+0000","last_active":"2024-09-19T05:47:41.970877+0000","last_peered":"2024-09-19T05:47:41.970877+0000","last_clean":"2024-09-19T05:47:41.970877+0000","last_became_active":"2024-09-19T05:47:41.961017+0000","last_became_peered":"2024-09-19T05:47:41.961017+0000","last_unstale":"2024-09-19T05:47:41.970877+0000","last_undegraded":"2024-09-19T05:47:41.970877+0000","last_fullsized":"2024-09-19T05:47:41.970877+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:13.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.951834+0000","last_change":"2024-09-19T05:47:41.951834+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.951834+0000","last_undegraded":"2024-09-19T05:47:41.951834+0000","last_fullsized":"2024-09-19T05:47:41.951834+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.969641+0000","last_change":"2024-09-19T05:47:41.969077+0000","last_active":"2024-09-19T05:47:41.969641+0000","last_peered":"2024-09-19T05:47:41.969641+0000","last_clean":"2024-09-19T05:47:41.969641+0000","last_became_active":"2024-09-19T05:47:41.968721+0000","last_became_peered":"2024-09-19T05:47:41.968721+0000","last_unstale":"2024-09-19T05:47:41.969641+0000","last_undegraded":"2024-09-19T05:47:41.969641+0000","last_fullsized":"2024-09-19T05:47:41.969641+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:53.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949405+0000","last_change":"2024-09-19T05:47:41.949405+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949405+0000","last_undegraded":"2024-09-19T05:47:41.949405+0000","last_fullsized":"2024-09-19T05:47:41.949405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967236+0000","last_change":"2024-09-19T05:47:41.958286+0000","last_active":"2024-09-19T05:47:41.967236+0000","last_peered":"2024-09-19T05:47:41.967236+0000","last_clean":"2024-09-19T05:47:41.967236+0000","last_became_active":"2024-09-19T05:47:41.957781+0000","last_became_peered":"2024-09-19T05:47:41.957781+0000","last_unstale":"2024-09-19T05:47:41.967236+0000","last_undegraded":"2024-09-19T05:47:41.967236+0000","last_fullsized":"2024-09-19T05:47:41.967236+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:37.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945018+0000","last_change":"2024-09-19T05:47:41.945018+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945018+0000","last_undegraded":"2024-09-19T05:47:41.945018+0000","last_fullsized":"2024-09-19T05:47:41.945018+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.962065+0000","last_change":"2024-09-19T05:47:41.959238+0000","last_active":"2024-09-19T05:47:41.962065+0000","last_peered":"2024-09-19T05:47:41.962065+0000","last_clean":"2024-09-19T05:47:41.962065+0000","last_became_active":"2024-09-19T05:47:41.958803+0000","last_became_peered":"2024-09-19T05:47:41.958803+0000","last_unstale":"2024-09-19T05:47:41.962065+0000","last_undegraded":"2024-09-19T05:47:41.962065+0000","last_fullsized":"2024-09-19T05:47:41.962065+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:07.195273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.936877+0000","last_change":"2024-09-19T05:47:41.936877+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.936877+0000","last_undegraded":"2024-09-19T05:47:41.936877+0000","last_fullsized":"2024-09-19T05:47:41.936877+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954786+0000","last_change":"2024-09-19T05:47:41.953928+0000","last_active":"2024-09-19T05:47:41.954786+0000","last_peered":"2024-09-19T05:47:41.954786+0000","last_clean":"2024-09-19T05:47:41.954786+0000","last_became_active":"2024-09-19T05:47:41.953597+0000","last_became_peered":"2024-09-19T05:47:41.953597+0000","last_unstale":"2024-09-19T05:47:41.954786+0000","last_undegraded":"2024-09-19T05:47:41.954786+0000","last_fullsized":"2024-09-19T05:47:41.954786+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:36.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":476,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.961300+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:47:41.961300+0000","last_peered":"2024-09-19T05:47:41.961300+0000","last_clean":"2024-09-19T05:47:41.961300+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:47:41.961300+0000","last_undegraded":"2024-09-19T05:47:41.961300+0000","last_fullsized":"2024-09-19T05:47:41.961300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542322,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74340,"kb_used_data":2892,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297500,"statfs":{"total":96636764160,"available":96560640000,"internally_reserved":0,"allocated":2961408,"data_stored":1706799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542322,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73776,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298064,"statfs":{"total":96636764160,"available":96561217536,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51572,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320268,"statfs":{"total":96636764160,"available":96583954432,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73772,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298068,"statfs":{"total":96636764160,"available":96561221632,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542323,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73692,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298148,"statfs":{"total":96636764160,"available":96561303552,"internally_reserved":0,"allocated":2367488,"data_stored":1116431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73772,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298068,"statfs":{"total":96636764160,"available":96561221632,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542325,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47408,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324432,"statfs":{"total":96636764160,"available":96588218368,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542322,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78508,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293332,"statfs":{"total":96636764160,"available":96556371968,"internally_reserved":0,"allocated":2973696,"data_stored":1713466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:47:47.419 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:47:47.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa155208640 1 Processor -- start 2024-09-19T05:47:47.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa155208640 1 -- start start 2024-09-19T05:47:47.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa155208640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1500d1590 0x7fa1500d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa155208640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa1500b51d0 0x7fa1500cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa155208640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1500d4d40 con 0x7fa150161da0 2024-09-19T05:47:47.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa155208640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa1500d0840 con 0x7fa1500b51d0 2024-09-19T05:47:47.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa155208640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa1500d5020 con 0x7fa1500d1590 2024-09-19T05:47:47.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa14f59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa1500b51d0 0x7fa1500cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa14f59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa1500b51d0 0x7fa1500cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59900/0 (socket says 172.21.15.67:59900) 2024-09-19T05:47:47.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa14f59e640 1 -- 172.21.15.67:0/3099305740 learned_addr learned my addr 172.21.15.67:0/3099305740 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:47.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa14e59c640 1 --2- 172.21.15.67:0/3099305740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1500d1590 0x7fa1500d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa14f59e640 1 -- 172.21.15.67:0/3099305740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1500d1590 msgr2=0x7fa1500d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:47.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa14f59e640 1 --2- 172.21.15.67:0/3099305740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1500d1590 0x7fa1500d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa14f59e640 1 -- 172.21.15.67:0/3099305740 >> v1:172.21.15.97:6789/0 conn(0x7fa150161da0 legacy=0x7fa1500d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:47.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.591+0000 7fa14f59e640 1 -- 172.21.15.67:0/3099305740 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1500d5300 con 0x7fa1500b51d0 2024-09-19T05:47:47.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa14f59e640 1 --2- 172.21.15.67:0/3099305740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 0x7fa1500cf150 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7fa148009e50 tx=0x7fa14801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09a3f08badaf86b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:47.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa14dd9b640 1 -- 172.21.15.67:0/3099305740 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1480a5640 con 0x7fa1500b51d0 2024-09-19T05:47:47.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa14dd9b640 1 -- 172.21.15.67:0/3099305740 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1480a57e0 con 0x7fa1500b51d0 2024-09-19T05:47:47.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa14dd9b640 1 -- 172.21.15.67:0/3099305740 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1480a5bb0 con 0x7fa1500b51d0 2024-09-19T05:47:47.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 -- 172.21.15.67:0/3099305740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 msgr2=0x7fa1500cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 --2- 172.21.15.67:0/3099305740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 0x7fa1500cf150 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7fa148009e50 tx=0x7fa14801c9f0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 -- 172.21.15.67:0/3099305740 shutdown_connections 2024-09-19T05:47:47.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 --2- 172.21.15.67:0/3099305740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 0x7fa1500cf150 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 --2- 172.21.15.67:0/3099305740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1500d1590 0x7fa1500d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 -- 172.21.15.67:0/3099305740 >> 172.21.15.67:0/3099305740 conn(0x7fa15008bfc0 msgr2=0x7fa1500d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:47.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 -- 172.21.15.67:0/3099305740 shutdown_connections 2024-09-19T05:47:47.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 -- 172.21.15.67:0/3099305740 wait complete. 2024-09-19T05:47:47.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 Processor -- start 2024-09-19T05:47:47.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 -- start start 2024-09-19T05:47:47.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 0x7fa15015ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1500d1590 0x7fa150153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa150161da0 0x7fa150156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa1500d0020 con 0x7fa1500b51d0 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa1500cfea0 con 0x7fa150161da0 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa155208640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa1500d01a0 con 0x7fa1500d1590 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa14ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 0x7fa15015ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa14ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 0x7fa15015ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59906/0 (socket says 172.21.15.67:59906) 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa14ed9d640 1 -- 172.21.15.67:0/3693637410 learned_addr learned my addr 172.21.15.67:0/3693637410 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.595+0000 7fa14e59c640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1500d1590 0x7fa150153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa14f59e640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa150161da0 0x7fa150156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa14ed9d640 1 -- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1500d1590 msgr2=0x7fa150153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa14ed9d640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1500d1590 0x7fa150153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa14ed9d640 1 -- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa150161da0 msgr2=0x7fa150156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa14ed9d640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa150161da0 0x7fa150156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa14ed9d640 1 -- 172.21.15.67:0/3693637410 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15015df90 con 0x7fa1500b51d0 2024-09-19T05:47:47.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa14ed9d640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 0x7fa15015ef90 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fa14000b440 tx=0x7fa14000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:47.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa1377fe640 1 -- 172.21.15.67:0/3693637410 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140015020 con 0x7fa1500b51d0 2024-09-19T05:47:47.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa1377fe640 1 -- 172.21.15.67:0/3693637410 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa140011890 con 0x7fa1500b51d0 2024-09-19T05:47:47.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa1377fe640 1 -- 172.21.15.67:0/3693637410 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140011c80 con 0x7fa1500b51d0 2024-09-19T05:47:47.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa155208640 1 -- 172.21.15.67:0/3693637410 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15015e270 con 0x7fa1500b51d0 2024-09-19T05:47:47.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa155208640 1 -- 172.21.15.67:0/3693637410 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa150154ea0 con 0x7fa1500b51d0 2024-09-19T05:47:47.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa155208640 1 -- 172.21.15.67:0/3693637410 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1500cf150 con 0x7fa1500b51d0 2024-09-19T05:47:47.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa1377fe640 1 -- 172.21.15.67:0/3693637410 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa140018020 con 0x7fa1500b51d0 2024-09-19T05:47:47.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa1377fe640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa13c0678c0 0x7fa13c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa1377fe640 1 -- 172.21.15.67:0/3693637410 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fa140085cf0 con 0x7fa1500b51d0 2024-09-19T05:47:47.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa14e59c640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa13c0678c0 0x7fa13c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.599+0000 7fa14e59c640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa13c0678c0 0x7fa13c069d80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa150155c10 tx=0x7fa144008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:47.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.603+0000 7fa1377fe640 1 -- 172.21.15.67:0/3693637410 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa14001f030 con 0x7fa1500b51d0 2024-09-19T05:47:47.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.763+0000 7fa155208640 1 -- 172.21.15.67:0/3693637410 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa15006bd70 con 0x7fa13c0678c0 2024-09-19T05:47:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.779+0000 7fa1377fe640 1 -- 172.21.15.67:0/3693637410 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247097 (secure 0 0 0) 0x7fa15006bd70 con 0x7fa13c0678c0 2024-09-19T05:47:47.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:47.784 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:47:47.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 -- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa13c0678c0 msgr2=0x7fa13c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa13c0678c0 0x7fa13c069d80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa150155c10 tx=0x7fa144008040 comp rx=0 tx=0).stop 2024-09-19T05:47:47.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 -- 172.21.15.67:0/3693637410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 msgr2=0x7fa15015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 0x7fa15015ef90 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fa14000b440 tx=0x7fa14000b900 comp rx=0 tx=0).stop 2024-09-19T05:47:47.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 -- 172.21.15.67:0/3693637410 shutdown_connections 2024-09-19T05:47:47.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa150161da0 0x7fa150156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa13c0678c0 0x7fa13c069d80 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1500d1590 0x7fa150153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 --2- 172.21.15.67:0/3693637410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1500b51d0 0x7fa15015ef90 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 -- 172.21.15.67:0/3693637410 >> 172.21.15.67:0/3693637410 conn(0x7fa15008bfc0 msgr2=0x7fa1501603b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:47.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 -- 172.21.15.67:0/3693637410 shutdown_connections 2024-09-19T05:47:47.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.783+0000 7fa155208640 1 -- 172.21.15.67:0/3693637410 wait complete. 2024-09-19T05:47:47.800 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":627,"stamp":"2024-09-19T05:47:47.412760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":546840,"kb_used_data":19728,"kb_used_omap":12,"kb_used_meta":526899,"kb_avail":754427880,"statfs":{"total":773094113280,"available":772534149120,"internally_reserved":0,"allocated":20201472,"data_stored":10152186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":539545137},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001878"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940180+0000","last_change":"2024-09-19T05:47:41.940180+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940180+0000","last_undegraded":"2024-09-19T05:47:41.940180+0000","last_fullsized":"2024-09-19T05:47:41.940180+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939965+0000","last_change":"2024-09-19T05:47:41.939965+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939965+0000","last_undegraded":"2024-09-19T05:47:41.939965+0000","last_fullsized":"2024-09-19T05:47:41.939965+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.953830+0000","last_change":"2024-09-19T05:47:41.953830+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.953830+0000","last_undegraded":"2024-09-19T05:47:41.953830+0000","last_fullsized":"2024-09-19T05:47:41.953830+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949936+0000","last_change":"2024-09-19T05:47:41.949936+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949936+0000","last_undegraded":"2024-09-19T05:47:41.949936+0000","last_fullsized":"2024-09-19T05:47:41.949936+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947364+0000","last_change":"2024-09-19T05:47:41.947364+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947364+0000","last_undegraded":"2024-09-19T05:47:41.947364+0000","last_fullsized":"2024-09-19T05:47:41.947364+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948780+0000","last_change":"2024-09-19T05:47:41.948780+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948780+0000","last_undegraded":"2024-09-19T05:47:41.948780+0000","last_fullsized":"2024-09-19T05:47:41.948780+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946499+0000","last_change":"2024-09-19T05:47:41.946499+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946499+0000","last_undegraded":"2024-09-19T05:47:41.946499+0000","last_fullsized":"2024-09-19T05:47:41.946499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950493+0000","last_change":"2024-09-19T05:47:41.950493+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950493+0000","last_undegraded":"2024-09-19T05:47:41.950493+0000","last_fullsized":"2024-09-19T05:47:41.950493+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948580+0000","last_change":"2024-09-19T05:47:41.948580+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948580+0000","last_undegraded":"2024-09-19T05:47:41.948580+0000","last_fullsized":"2024-09-19T05:47:41.948580+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948677+0000","last_change":"2024-09-19T05:47:41.948677+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948677+0000","last_undegraded":"2024-09-19T05:47:41.948677+0000","last_fullsized":"2024-09-19T05:47:41.948677+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.953401+0000","last_change":"2024-09-19T05:47:41.953401+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.953401+0000","last_undegraded":"2024-09-19T05:47:41.953401+0000","last_fullsized":"2024-09-19T05:47:41.953401+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950433+0000","last_change":"2024-09-19T05:47:41.950433+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950433+0000","last_undegraded":"2024-09-19T05:47:41.950433+0000","last_fullsized":"2024-09-19T05:47:41.950433+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948591+0000","last_change":"2024-09-19T05:47:41.948591+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948591+0000","last_undegraded":"2024-09-19T05:47:41.948591+0000","last_fullsized":"2024-09-19T05:47:41.948591+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946921+0000","last_change":"2024-09-19T05:47:41.946921+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946921+0000","last_undegraded":"2024-09-19T05:47:41.946921+0000","last_fullsized":"2024-09-19T05:47:41.946921+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942282+0000","last_change":"2024-09-19T05:47:41.942282+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942282+0000","last_undegraded":"2024-09-19T05:47:41.942282+0000","last_fullsized":"2024-09-19T05:47:41.942282+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.952887+0000","last_change":"2024-09-19T05:47:41.952887+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.952887+0000","last_undegraded":"2024-09-19T05:47:41.952887+0000","last_fullsized":"2024-09-19T05:47:41.952887+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947978+0000","last_change":"2024-09-19T05:47:41.947978+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947978+0000","last_undegraded":"2024-09-19T05:47:41.947978+0000","last_fullsized":"2024-09-19T05:47:41.947978+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946134+0000","last_change":"2024-09-19T05:47:41.946134+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946134+0000","last_undegraded":"2024-09-19T05:47:41.946134+0000","last_fullsized":"2024-09-19T05:47:41.946134+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945573+0000","last_change":"2024-09-19T05:47:41.945573+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945573+0000","last_undegraded":"2024-09-19T05:47:41.945573+0000","last_fullsized":"2024-09-19T05:47:41.945573+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950975+0000","last_change":"2024-09-19T05:47:41.950975+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950975+0000","last_undegraded":"2024-09-19T05:47:41.950975+0000","last_fullsized":"2024-09-19T05:47:41.950975+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948069+0000","last_change":"2024-09-19T05:47:41.948069+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948069+0000","last_undegraded":"2024-09-19T05:47:41.948069+0000","last_fullsized":"2024-09-19T05:47:41.948069+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945902+0000","last_change":"2024-09-19T05:47:41.945902+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945902+0000","last_undegraded":"2024-09-19T05:47:41.945902+0000","last_fullsized":"2024-09-19T05:47:41.945902+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940487+0000","last_change":"2024-09-19T05:47:41.940487+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940487+0000","last_undegraded":"2024-09-19T05:47:41.940487+0000","last_fullsized":"2024-09-19T05:47:41.940487+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946999+0000","last_change":"2024-09-19T05:47:41.946999+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946999+0000","last_undegraded":"2024-09-19T05:47:41.946999+0000","last_fullsized":"2024-09-19T05:47:41.946999+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947370+0000","last_change":"2024-09-19T05:47:41.947370+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947370+0000","last_undegraded":"2024-09-19T05:47:41.947370+0000","last_fullsized":"2024-09-19T05:47:41.947370+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941457+0000","last_change":"2024-09-19T05:47:41.941457+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941457+0000","last_undegraded":"2024-09-19T05:47:41.941457+0000","last_fullsized":"2024-09-19T05:47:41.941457+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949404+0000","last_change":"2024-09-19T05:47:41.949404+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949404+0000","last_undegraded":"2024-09-19T05:47:41.949404+0000","last_fullsized":"2024-09-19T05:47:41.949404+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946520+0000","last_change":"2024-09-19T05:47:41.946520+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946520+0000","last_undegraded":"2024-09-19T05:47:41.946520+0000","last_fullsized":"2024-09-19T05:47:41.946520+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944476+0000","last_change":"2024-09-19T05:47:41.944476+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944476+0000","last_undegraded":"2024-09-19T05:47:41.944476+0000","last_fullsized":"2024-09-19T05:47:41.944476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944442+0000","last_change":"2024-09-19T05:47:41.944442+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944442+0000","last_undegraded":"2024-09-19T05:47:41.944442+0000","last_fullsized":"2024-09-19T05:47:41.944442+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.952444+0000","last_change":"2024-09-19T05:47:41.952444+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.952444+0000","last_undegraded":"2024-09-19T05:47:41.952444+0000","last_fullsized":"2024-09-19T05:47:41.952444+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949314+0000","last_change":"2024-09-19T05:47:41.949314+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949314+0000","last_undegraded":"2024-09-19T05:47:41.949314+0000","last_fullsized":"2024-09-19T05:47:41.949314+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939697+0000","last_change":"2024-09-19T05:47:41.939697+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939697+0000","last_undegraded":"2024-09-19T05:47:41.939697+0000","last_fullsized":"2024-09-19T05:47:41.939697+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.974835+0000","last_change":"2024-09-19T05:47:41.972348+0000","last_active":"2024-09-19T05:47:41.974835+0000","last_peered":"2024-09-19T05:47:41.974835+0000","last_clean":"2024-09-19T05:47:41.974835+0000","last_became_active":"2024-09-19T05:47:41.971855+0000","last_became_peered":"2024-09-19T05:47:41.971855+0000","last_unstale":"2024-09-19T05:47:41.974835+0000","last_undegraded":"2024-09-19T05:47:41.974835+0000","last_fullsized":"2024-09-19T05:47:41.974835+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:41.408991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942800+0000","last_change":"2024-09-19T05:47:41.942800+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942800+0000","last_undegraded":"2024-09-19T05:47:41.942800+0000","last_fullsized":"2024-09-19T05:47:41.942800+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958617+0000","last_change":"2024-09-19T05:47:41.955701+0000","last_active":"2024-09-19T05:47:41.958617+0000","last_peered":"2024-09-19T05:47:41.958617+0000","last_clean":"2024-09-19T05:47:41.958617+0000","last_became_active":"2024-09-19T05:47:41.953352+0000","last_became_peered":"2024-09-19T05:47:41.953352+0000","last_unstale":"2024-09-19T05:47:41.958617+0000","last_undegraded":"2024-09-19T05:47:41.958617+0000","last_fullsized":"2024-09-19T05:47:41.958617+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:33.061928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944794+0000","last_change":"2024-09-19T05:47:41.944794+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944794+0000","last_undegraded":"2024-09-19T05:47:41.944794+0000","last_fullsized":"2024-09-19T05:47:41.944794+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954715+0000","last_change":"2024-09-19T05:47:41.944967+0000","last_active":"2024-09-19T05:47:41.954715+0000","last_peered":"2024-09-19T05:47:41.954715+0000","last_clean":"2024-09-19T05:47:41.954715+0000","last_became_active":"2024-09-19T05:47:41.944696+0000","last_became_peered":"2024-09-19T05:47:41.944696+0000","last_unstale":"2024-09-19T05:47:41.954715+0000","last_undegraded":"2024-09-19T05:47:41.954715+0000","last_fullsized":"2024-09-19T05:47:41.954715+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:17.350651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946969+0000","last_change":"2024-09-19T05:47:41.946969+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946969+0000","last_undegraded":"2024-09-19T05:47:41.946969+0000","last_fullsized":"2024-09-19T05:47:41.946969+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.969647+0000","last_change":"2024-09-19T05:47:41.969151+0000","last_active":"2024-09-19T05:47:41.969647+0000","last_peered":"2024-09-19T05:47:41.969647+0000","last_clean":"2024-09-19T05:47:41.969647+0000","last_became_active":"2024-09-19T05:47:41.968800+0000","last_became_peered":"2024-09-19T05:47:41.968800+0000","last_unstale":"2024-09-19T05:47:41.969647+0000","last_undegraded":"2024-09-19T05:47:41.969647+0000","last_fullsized":"2024-09-19T05:47:41.969647+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:11.896933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942875+0000","last_change":"2024-09-19T05:47:41.942875+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942875+0000","last_undegraded":"2024-09-19T05:47:41.942875+0000","last_fullsized":"2024-09-19T05:47:41.942875+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973178+0000","last_change":"2024-09-19T05:47:41.970704+0000","last_active":"2024-09-19T05:47:41.973178+0000","last_peered":"2024-09-19T05:47:41.973178+0000","last_clean":"2024-09-19T05:47:41.973178+0000","last_became_active":"2024-09-19T05:47:41.970086+0000","last_became_peered":"2024-09-19T05:47:41.970086+0000","last_unstale":"2024-09-19T05:47:41.973178+0000","last_undegraded":"2024-09-19T05:47:41.973178+0000","last_fullsized":"2024-09-19T05:47:41.973178+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:15.199524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.951396+0000","last_change":"2024-09-19T05:47:41.951396+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.951396+0000","last_undegraded":"2024-09-19T05:47:41.951396+0000","last_fullsized":"2024-09-19T05:47:41.951396+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.972238+0000","last_change":"2024-09-19T05:47:41.970568+0000","last_active":"2024-09-19T05:47:41.972238+0000","last_peered":"2024-09-19T05:47:41.972238+0000","last_clean":"2024-09-19T05:47:41.972238+0000","last_became_active":"2024-09-19T05:47:41.970029+0000","last_became_peered":"2024-09-19T05:47:41.970029+0000","last_unstale":"2024-09-19T05:47:41.972238+0000","last_undegraded":"2024-09-19T05:47:41.972238+0000","last_fullsized":"2024-09-19T05:47:41.972238+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:47.105803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946834+0000","last_change":"2024-09-19T05:47:41.946834+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946834+0000","last_undegraded":"2024-09-19T05:47:41.946834+0000","last_fullsized":"2024-09-19T05:47:41.946834+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.964655+0000","last_change":"2024-09-19T05:47:41.963677+0000","last_active":"2024-09-19T05:47:41.964655+0000","last_peered":"2024-09-19T05:47:41.964655+0000","last_clean":"2024-09-19T05:47:41.964655+0000","last_became_active":"2024-09-19T05:47:41.963381+0000","last_became_peered":"2024-09-19T05:47:41.963381+0000","last_unstale":"2024-09-19T05:47:41.964655+0000","last_undegraded":"2024-09-19T05:47:41.964655+0000","last_fullsized":"2024-09-19T05:47:41.964655+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:36.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944697+0000","last_change":"2024-09-19T05:47:41.944697+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944697+0000","last_undegraded":"2024-09-19T05:47:41.944697+0000","last_fullsized":"2024-09-19T05:47:41.944697+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.961836+0000","last_change":"2024-09-19T05:47:41.959230+0000","last_active":"2024-09-19T05:47:41.961836+0000","last_peered":"2024-09-19T05:47:41.961836+0000","last_clean":"2024-09-19T05:47:41.961836+0000","last_became_active":"2024-09-19T05:47:41.958352+0000","last_became_peered":"2024-09-19T05:47:41.958352+0000","last_unstale":"2024-09-19T05:47:41.961836+0000","last_undegraded":"2024-09-19T05:47:41.961836+0000","last_fullsized":"2024-09-19T05:47:41.961836+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:46.163005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945418+0000","last_change":"2024-09-19T05:47:41.945418+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945418+0000","last_undegraded":"2024-09-19T05:47:41.945418+0000","last_fullsized":"2024-09-19T05:47:41.945418+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.977955+0000","last_change":"2024-09-19T05:47:41.977216+0000","last_active":"2024-09-19T05:47:41.977955+0000","last_peered":"2024-09-19T05:47:41.977955+0000","last_clean":"2024-09-19T05:47:41.977955+0000","last_became_active":"2024-09-19T05:47:41.976763+0000","last_became_peered":"2024-09-19T05:47:41.976763+0000","last_unstale":"2024-09-19T05:47:41.977955+0000","last_undegraded":"2024-09-19T05:47:41.977955+0000","last_fullsized":"2024-09-19T05:47:41.977955+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:24.381428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.943265+0000","last_change":"2024-09-19T05:47:41.943265+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.943265+0000","last_undegraded":"2024-09-19T05:47:41.943265+0000","last_fullsized":"2024-09-19T05:47:41.943265+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954979+0000","last_change":"2024-09-19T05:47:41.954229+0000","last_active":"2024-09-19T05:47:41.954979+0000","last_peered":"2024-09-19T05:47:41.954979+0000","last_clean":"2024-09-19T05:47:41.954979+0000","last_became_active":"2024-09-19T05:47:41.953798+0000","last_became_peered":"2024-09-19T05:47:41.953798+0000","last_unstale":"2024-09-19T05:47:41.954979+0000","last_undegraded":"2024-09-19T05:47:41.954979+0000","last_fullsized":"2024-09-19T05:47:41.954979+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:30.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945863+0000","last_change":"2024-09-19T05:47:41.945863+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945863+0000","last_undegraded":"2024-09-19T05:47:41.945863+0000","last_fullsized":"2024-09-19T05:47:41.945863+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973771+0000","last_change":"2024-09-19T05:47:41.972755+0000","last_active":"2024-09-19T05:47:41.973771+0000","last_peered":"2024-09-19T05:47:41.973771+0000","last_clean":"2024-09-19T05:47:41.973771+0000","last_became_active":"2024-09-19T05:47:41.972124+0000","last_became_peered":"2024-09-19T05:47:41.972124+0000","last_unstale":"2024-09-19T05:47:41.973771+0000","last_undegraded":"2024-09-19T05:47:41.973771+0000","last_fullsized":"2024-09-19T05:47:41.973771+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.566154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946100+0000","last_change":"2024-09-19T05:47:41.946100+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946100+0000","last_undegraded":"2024-09-19T05:47:41.946100+0000","last_fullsized":"2024-09-19T05:47:41.946100+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.955505+0000","last_change":"2024-09-19T05:47:41.954745+0000","last_active":"2024-09-19T05:47:41.955505+0000","last_peered":"2024-09-19T05:47:41.955505+0000","last_clean":"2024-09-19T05:47:41.955505+0000","last_became_active":"2024-09-19T05:47:41.954279+0000","last_became_peered":"2024-09-19T05:47:41.954279+0000","last_unstale":"2024-09-19T05:47:41.955505+0000","last_undegraded":"2024-09-19T05:47:41.955505+0000","last_fullsized":"2024-09-19T05:47:41.955505+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:18.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945273+0000","last_change":"2024-09-19T05:47:41.945273+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945273+0000","last_undegraded":"2024-09-19T05:47:41.945273+0000","last_fullsized":"2024-09-19T05:47:41.945273+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.957289+0000","last_change":"2024-09-19T05:47:41.956777+0000","last_active":"2024-09-19T05:47:41.957289+0000","last_peered":"2024-09-19T05:47:41.957289+0000","last_clean":"2024-09-19T05:47:41.957289+0000","last_became_active":"2024-09-19T05:47:41.956381+0000","last_became_peered":"2024-09-19T05:47:41.956381+0000","last_unstale":"2024-09-19T05:47:41.957289+0000","last_undegraded":"2024-09-19T05:47:41.957289+0000","last_fullsized":"2024-09-19T05:47:41.957289+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:49.599888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941200+0000","last_change":"2024-09-19T05:47:41.941200+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941200+0000","last_undegraded":"2024-09-19T05:47:41.941200+0000","last_fullsized":"2024-09-19T05:47:41.941200+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.960325+0000","last_change":"2024-09-19T05:47:41.959689+0000","last_active":"2024-09-19T05:47:41.960325+0000","last_peered":"2024-09-19T05:47:41.960325+0000","last_clean":"2024-09-19T05:47:41.960325+0000","last_became_active":"2024-09-19T05:47:41.959337+0000","last_became_peered":"2024-09-19T05:47:41.959337+0000","last_unstale":"2024-09-19T05:47:41.960325+0000","last_undegraded":"2024-09-19T05:47:41.960325+0000","last_fullsized":"2024-09-19T05:47:41.960325+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:43.673298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949476+0000","last_change":"2024-09-19T05:47:41.949476+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949476+0000","last_undegraded":"2024-09-19T05:47:41.949476+0000","last_fullsized":"2024-09-19T05:47:41.949476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967434+0000","last_change":"2024-09-19T05:47:41.967000+0000","last_active":"2024-09-19T05:47:41.967434+0000","last_peered":"2024-09-19T05:47:41.967434+0000","last_clean":"2024-09-19T05:47:41.967434+0000","last_became_active":"2024-09-19T05:47:41.966638+0000","last_became_peered":"2024-09-19T05:47:41.966638+0000","last_unstale":"2024-09-19T05:47:41.967434+0000","last_undegraded":"2024-09-19T05:47:41.967434+0000","last_fullsized":"2024-09-19T05:47:41.967434+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:34:40.290020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949422+0000","last_change":"2024-09-19T05:47:41.949422+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949422+0000","last_undegraded":"2024-09-19T05:47:41.949422+0000","last_fullsized":"2024-09-19T05:47:41.949422+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967707+0000","last_change":"2024-09-19T05:47:41.963785+0000","last_active":"2024-09-19T05:47:41.967707+0000","last_peered":"2024-09-19T05:47:41.967707+0000","last_clean":"2024-09-19T05:47:41.967707+0000","last_became_active":"2024-09-19T05:47:41.963188+0000","last_became_peered":"2024-09-19T05:47:41.963188+0000","last_unstale":"2024-09-19T05:47:41.967707+0000","last_undegraded":"2024-09-19T05:47:41.967707+0000","last_fullsized":"2024-09-19T05:47:41.967707+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:02.922556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941277+0000","last_change":"2024-09-19T05:47:41.941277+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941277+0000","last_undegraded":"2024-09-19T05:47:41.941277+0000","last_fullsized":"2024-09-19T05:47:41.941277+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.968204+0000","last_change":"2024-09-19T05:47:41.966113+0000","last_active":"2024-09-19T05:47:41.968204+0000","last_peered":"2024-09-19T05:47:41.968204+0000","last_clean":"2024-09-19T05:47:41.968204+0000","last_became_active":"2024-09-19T05:47:41.965410+0000","last_became_peered":"2024-09-19T05:47:41.965410+0000","last_unstale":"2024-09-19T05:47:41.968204+0000","last_undegraded":"2024-09-19T05:47:41.968204+0000","last_fullsized":"2024-09-19T05:47:41.968204+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:23.524781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.937951+0000","last_change":"2024-09-19T05:47:41.937951+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.937951+0000","last_undegraded":"2024-09-19T05:47:41.937951+0000","last_fullsized":"2024-09-19T05:47:41.937951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.963878+0000","last_change":"2024-09-19T05:47:41.962814+0000","last_active":"2024-09-19T05:47:41.963878+0000","last_peered":"2024-09-19T05:47:41.963878+0000","last_clean":"2024-09-19T05:47:41.963878+0000","last_became_active":"2024-09-19T05:47:41.962547+0000","last_became_peered":"2024-09-19T05:47:41.962547+0000","last_unstale":"2024-09-19T05:47:41.963878+0000","last_undegraded":"2024-09-19T05:47:41.963878+0000","last_fullsized":"2024-09-19T05:47:41.963878+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.635828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946873+0000","last_change":"2024-09-19T05:47:41.946873+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946873+0000","last_undegraded":"2024-09-19T05:47:41.946873+0000","last_fullsized":"2024-09-19T05:47:41.946873+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.963110+0000","last_change":"2024-09-19T05:47:41.962422+0000","last_active":"2024-09-19T05:47:41.963110+0000","last_peered":"2024-09-19T05:47:41.963110+0000","last_clean":"2024-09-19T05:47:41.963110+0000","last_became_active":"2024-09-19T05:47:41.962067+0000","last_became_peered":"2024-09-19T05:47:41.962067+0000","last_unstale":"2024-09-19T05:47:41.963110+0000","last_undegraded":"2024-09-19T05:47:41.963110+0000","last_fullsized":"2024-09-19T05:47:41.963110+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:12.695351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939698+0000","last_change":"2024-09-19T05:47:41.939698+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939698+0000","last_undegraded":"2024-09-19T05:47:41.939698+0000","last_fullsized":"2024-09-19T05:47:41.939698+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958745+0000","last_change":"2024-09-19T05:47:41.957647+0000","last_active":"2024-09-19T05:47:41.958745+0000","last_peered":"2024-09-19T05:47:41.958745+0000","last_clean":"2024-09-19T05:47:41.958745+0000","last_became_active":"2024-09-19T05:47:41.957340+0000","last_became_peered":"2024-09-19T05:47:41.957340+0000","last_unstale":"2024-09-19T05:47:41.958745+0000","last_undegraded":"2024-09-19T05:47:41.958745+0000","last_fullsized":"2024-09-19T05:47:41.958745+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:04.880777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.960155+0000","last_change":"2024-09-19T05:47:41.960155+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.960155+0000","last_undegraded":"2024-09-19T05:47:41.960155+0000","last_fullsized":"2024-09-19T05:47:41.960155+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.959020+0000","last_change":"2024-09-19T05:47:41.956446+0000","last_active":"2024-09-19T05:47:41.959020+0000","last_peered":"2024-09-19T05:47:41.959020+0000","last_clean":"2024-09-19T05:47:41.959020+0000","last_became_active":"2024-09-19T05:47:41.956016+0000","last_became_peered":"2024-09-19T05:47:41.956016+0000","last_unstale":"2024-09-19T05:47:41.959020+0000","last_undegraded":"2024-09-19T05:47:41.959020+0000","last_fullsized":"2024-09-19T05:47:41.959020+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.383814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940471+0000","last_change":"2024-09-19T05:47:41.940471+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940471+0000","last_undegraded":"2024-09-19T05:47:41.940471+0000","last_fullsized":"2024-09-19T05:47:41.940471+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970336+0000","last_change":"2024-09-19T05:47:41.967485+0000","last_active":"2024-09-19T05:47:41.970336+0000","last_peered":"2024-09-19T05:47:41.970336+0000","last_clean":"2024-09-19T05:47:41.970336+0000","last_became_active":"2024-09-19T05:47:41.966573+0000","last_became_peered":"2024-09-19T05:47:41.966573+0000","last_unstale":"2024-09-19T05:47:41.970336+0000","last_undegraded":"2024-09-19T05:47:41.970336+0000","last_fullsized":"2024-09-19T05:47:41.970336+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:47.999804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945692+0000","last_change":"2024-09-19T05:47:41.945692+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945692+0000","last_undegraded":"2024-09-19T05:47:41.945692+0000","last_fullsized":"2024-09-19T05:47:41.945692+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967332+0000","last_change":"2024-09-19T05:47:41.958616+0000","last_active":"2024-09-19T05:47:41.967332+0000","last_peered":"2024-09-19T05:47:41.967332+0000","last_clean":"2024-09-19T05:47:41.967332+0000","last_became_active":"2024-09-19T05:47:41.958118+0000","last_became_peered":"2024-09-19T05:47:41.958118+0000","last_unstale":"2024-09-19T05:47:41.967332+0000","last_undegraded":"2024-09-19T05:47:41.967332+0000","last_fullsized":"2024-09-19T05:47:41.967332+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:42.814320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948406+0000","last_change":"2024-09-19T05:47:41.948406+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948406+0000","last_undegraded":"2024-09-19T05:47:41.948406+0000","last_fullsized":"2024-09-19T05:47:41.948406+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973076+0000","last_change":"2024-09-19T05:47:41.972593+0000","last_active":"2024-09-19T05:47:41.973076+0000","last_peered":"2024-09-19T05:47:41.973076+0000","last_clean":"2024-09-19T05:47:41.973076+0000","last_became_active":"2024-09-19T05:47:41.972351+0000","last_became_peered":"2024-09-19T05:47:41.972351+0000","last_unstale":"2024-09-19T05:47:41.973076+0000","last_undegraded":"2024-09-19T05:47:41.973076+0000","last_fullsized":"2024-09-19T05:47:41.973076+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:01.536776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944552+0000","last_change":"2024-09-19T05:47:41.944552+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944552+0000","last_undegraded":"2024-09-19T05:47:41.944552+0000","last_fullsized":"2024-09-19T05:47:41.944552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970864+0000","last_change":"2024-09-19T05:47:41.961283+0000","last_active":"2024-09-19T05:47:41.970864+0000","last_peered":"2024-09-19T05:47:41.970864+0000","last_clean":"2024-09-19T05:47:41.970864+0000","last_became_active":"2024-09-19T05:47:41.960599+0000","last_became_peered":"2024-09-19T05:47:41.960599+0000","last_unstale":"2024-09-19T05:47:41.970864+0000","last_undegraded":"2024-09-19T05:47:41.970864+0000","last_fullsized":"2024-09-19T05:47:41.970864+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:10.299523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.943862+0000","last_change":"2024-09-19T05:47:41.943862+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.943862+0000","last_undegraded":"2024-09-19T05:47:41.943862+0000","last_fullsized":"2024-09-19T05:47:41.943862+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967083+0000","last_change":"2024-09-19T05:47:41.961093+0000","last_active":"2024-09-19T05:47:41.967083+0000","last_peered":"2024-09-19T05:47:41.967083+0000","last_clean":"2024-09-19T05:47:41.967083+0000","last_became_active":"2024-09-19T05:47:41.954232+0000","last_became_peered":"2024-09-19T05:47:41.954232+0000","last_unstale":"2024-09-19T05:47:41.967083+0000","last_undegraded":"2024-09-19T05:47:41.967083+0000","last_fullsized":"2024-09-19T05:47:41.967083+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:33.410187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941134+0000","last_change":"2024-09-19T05:47:41.941134+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941134+0000","last_undegraded":"2024-09-19T05:47:41.941134+0000","last_fullsized":"2024-09-19T05:47:41.941134+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958710+0000","last_change":"2024-09-19T05:47:41.956832+0000","last_active":"2024-09-19T05:47:41.958710+0000","last_peered":"2024-09-19T05:47:41.958710+0000","last_clean":"2024-09-19T05:47:41.958710+0000","last_became_active":"2024-09-19T05:47:41.956161+0000","last_became_peered":"2024-09-19T05:47:41.956161+0000","last_unstale":"2024-09-19T05:47:41.958710+0000","last_undegraded":"2024-09-19T05:47:41.958710+0000","last_fullsized":"2024-09-19T05:47:41.958710+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:33.570626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950106+0000","last_change":"2024-09-19T05:47:41.950106+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950106+0000","last_undegraded":"2024-09-19T05:47:41.950106+0000","last_fullsized":"2024-09-19T05:47:41.950106+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970877+0000","last_change":"2024-09-19T05:47:41.961628+0000","last_active":"2024-09-19T05:47:41.970877+0000","last_peered":"2024-09-19T05:47:41.970877+0000","last_clean":"2024-09-19T05:47:41.970877+0000","last_became_active":"2024-09-19T05:47:41.961017+0000","last_became_peered":"2024-09-19T05:47:41.961017+0000","last_unstale":"2024-09-19T05:47:41.970877+0000","last_undegraded":"2024-09-19T05:47:41.970877+0000","last_fullsized":"2024-09-19T05:47:41.970877+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:13.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.951834+0000","last_change":"2024-09-19T05:47:41.951834+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.951834+0000","last_undegraded":"2024-09-19T05:47:41.951834+0000","last_fullsized":"2024-09-19T05:47:41.951834+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.969641+0000","last_change":"2024-09-19T05:47:41.969077+0000","last_active":"2024-09-19T05:47:41.969641+0000","last_peered":"2024-09-19T05:47:41.969641+0000","last_clean":"2024-09-19T05:47:41.969641+0000","last_became_active":"2024-09-19T05:47:41.968721+0000","last_became_peered":"2024-09-19T05:47:41.968721+0000","last_unstale":"2024-09-19T05:47:41.969641+0000","last_undegraded":"2024-09-19T05:47:41.969641+0000","last_fullsized":"2024-09-19T05:47:41.969641+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:53.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949405+0000","last_change":"2024-09-19T05:47:41.949405+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949405+0000","last_undegraded":"2024-09-19T05:47:41.949405+0000","last_fullsized":"2024-09-19T05:47:41.949405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967236+0000","last_change":"2024-09-19T05:47:41.958286+0000","last_active":"2024-09-19T05:47:41.967236+0000","last_peered":"2024-09-19T05:47:41.967236+0000","last_clean":"2024-09-19T05:47:41.967236+0000","last_became_active":"2024-09-19T05:47:41.957781+0000","last_became_peered":"2024-09-19T05:47:41.957781+0000","last_unstale":"2024-09-19T05:47:41.967236+0000","last_undegraded":"2024-09-19T05:47:41.967236+0000","last_fullsized":"2024-09-19T05:47:41.967236+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:37.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945018+0000","last_change":"2024-09-19T05:47:41.945018+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945018+0000","last_undegraded":"2024-09-19T05:47:41.945018+0000","last_fullsized":"2024-09-19T05:47:41.945018+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.962065+0000","last_change":"2024-09-19T05:47:41.959238+0000","last_active":"2024-09-19T05:47:41.962065+0000","last_peered":"2024-09-19T05:47:41.962065+0000","last_clean":"2024-09-19T05:47:41.962065+0000","last_became_active":"2024-09-19T05:47:41.958803+0000","last_became_peered":"2024-09-19T05:47:41.958803+0000","last_unstale":"2024-09-19T05:47:41.962065+0000","last_undegraded":"2024-09-19T05:47:41.962065+0000","last_fullsized":"2024-09-19T05:47:41.962065+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:07.195273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.936877+0000","last_change":"2024-09-19T05:47:41.936877+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.936877+0000","last_undegraded":"2024-09-19T05:47:41.936877+0000","last_fullsized":"2024-09-19T05:47:41.936877+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954786+0000","last_change":"2024-09-19T05:47:41.953928+0000","last_active":"2024-09-19T05:47:41.954786+0000","last_peered":"2024-09-19T05:47:41.954786+0000","last_clean":"2024-09-19T05:47:41.954786+0000","last_became_active":"2024-09-19T05:47:41.953597+0000","last_became_peered":"2024-09-19T05:47:41.953597+0000","last_unstale":"2024-09-19T05:47:41.954786+0000","last_undegraded":"2024-09-19T05:47:41.954786+0000","last_fullsized":"2024-09-19T05:47:41.954786+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:36.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":476,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.961300+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:47:41.961300+0000","last_peered":"2024-09-19T05:47:41.961300+0000","last_clean":"2024-09-19T05:47:41.961300+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:47:41.961300+0000","last_undegraded":"2024-09-19T05:47:41.961300+0000","last_fullsized":"2024-09-19T05:47:41.961300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542322,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74340,"kb_used_data":2892,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297500,"statfs":{"total":96636764160,"available":96560640000,"internally_reserved":0,"allocated":2961408,"data_stored":1706799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542322,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73776,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298064,"statfs":{"total":96636764160,"available":96561217536,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51572,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320268,"statfs":{"total":96636764160,"available":96583954432,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73772,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298068,"statfs":{"total":96636764160,"available":96561221632,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542323,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73692,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298148,"statfs":{"total":96636764160,"available":96561303552,"internally_reserved":0,"allocated":2367488,"data_stored":1116431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73772,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298068,"statfs":{"total":96636764160,"available":96561221632,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542325,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47408,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324432,"statfs":{"total":96636764160,"available":96588218368,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542322,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78508,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293332,"statfs":{"total":96636764160,"available":96556371968,"internally_reserved":0,"allocated":2973696,"data_stored":1713466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:47:47.804 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3f is not active+clean 2024-09-19T05:47:47.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.940180+0000', 'last_change': '2024-09-19T05:47:41.940180+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.940180+0000', 'last_undegraded': '2024-09-19T05:47:41.940180+0000', 'last_fullsized': '2024-09-19T05:47:41.940180+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:47:47.804 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3e is not active+clean 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.939965+0000', 'last_change': '2024-09-19T05:47:41.939965+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.939965+0000', 'last_undegraded': '2024-09-19T05:47:41.939965+0000', 'last_fullsized': '2024-09-19T05:47:41.939965+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3d is not active+clean 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.953830+0000', 'last_change': '2024-09-19T05:47:41.953830+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.953830+0000', 'last_undegraded': '2024-09-19T05:47:41.953830+0000', 'last_fullsized': '2024-09-19T05:47:41.953830+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3c is not active+clean 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.949936+0000', 'last_change': '2024-09-19T05:47:41.949936+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.949936+0000', 'last_undegraded': '2024-09-19T05:47:41.949936+0000', 'last_fullsized': '2024-09-19T05:47:41.949936+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3b is not active+clean 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.947364+0000', 'last_change': '2024-09-19T05:47:41.947364+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.947364+0000', 'last_undegraded': '2024-09-19T05:47:41.947364+0000', 'last_fullsized': '2024-09-19T05:47:41.947364+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3a is not active+clean 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.948780+0000', 'last_change': '2024-09-19T05:47:41.948780+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.948780+0000', 'last_undegraded': '2024-09-19T05:47:41.948780+0000', 'last_fullsized': '2024-09-19T05:47:41.948780+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:PG 28.39 is not active+clean 2024-09-19T05:47:47.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.946499+0000', 'last_change': '2024-09-19T05:47:41.946499+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.946499+0000', 'last_undegraded': '2024-09-19T05:47:41.946499+0000', 'last_fullsized': '2024-09-19T05:47:41.946499+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:PG 28.38 is not active+clean 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.950493+0000', 'last_change': '2024-09-19T05:47:41.950493+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.950493+0000', 'last_undegraded': '2024-09-19T05:47:41.950493+0000', 'last_fullsized': '2024-09-19T05:47:41.950493+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:PG 28.37 is not active+clean 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.948580+0000', 'last_change': '2024-09-19T05:47:41.948580+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.948580+0000', 'last_undegraded': '2024-09-19T05:47:41.948580+0000', 'last_fullsized': '2024-09-19T05:47:41.948580+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:PG 28.36 is not active+clean 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.948677+0000', 'last_change': '2024-09-19T05:47:41.948677+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.948677+0000', 'last_undegraded': '2024-09-19T05:47:41.948677+0000', 'last_fullsized': '2024-09-19T05:47:41.948677+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:PG 28.35 is not active+clean 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.953401+0000', 'last_change': '2024-09-19T05:47:41.953401+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.953401+0000', 'last_undegraded': '2024-09-19T05:47:41.953401+0000', 'last_fullsized': '2024-09-19T05:47:41.953401+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:PG 28.34 is not active+clean 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.950433+0000', 'last_change': '2024-09-19T05:47:41.950433+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.950433+0000', 'last_undegraded': '2024-09-19T05:47:41.950433+0000', 'last_fullsized': '2024-09-19T05:47:41.950433+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:47:47.806 INFO:tasks.ceph.ceph_manager.ceph:PG 28.33 is not active+clean 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.948591+0000', 'last_change': '2024-09-19T05:47:41.948591+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.948591+0000', 'last_undegraded': '2024-09-19T05:47:41.948591+0000', 'last_fullsized': '2024-09-19T05:47:41.948591+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:PG 28.32 is not active+clean 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.946921+0000', 'last_change': '2024-09-19T05:47:41.946921+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.946921+0000', 'last_undegraded': '2024-09-19T05:47:41.946921+0000', 'last_fullsized': '2024-09-19T05:47:41.946921+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:PG 28.31 is not active+clean 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.942282+0000', 'last_change': '2024-09-19T05:47:41.942282+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.942282+0000', 'last_undegraded': '2024-09-19T05:47:41.942282+0000', 'last_fullsized': '2024-09-19T05:47:41.942282+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:PG 28.30 is not active+clean 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.952887+0000', 'last_change': '2024-09-19T05:47:41.952887+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.952887+0000', 'last_undegraded': '2024-09-19T05:47:41.952887+0000', 'last_fullsized': '2024-09-19T05:47:41.952887+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2f is not active+clean 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.947978+0000', 'last_change': '2024-09-19T05:47:41.947978+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.947978+0000', 'last_undegraded': '2024-09-19T05:47:41.947978+0000', 'last_fullsized': '2024-09-19T05:47:41.947978+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2e is not active+clean 2024-09-19T05:47:47.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.946134+0000', 'last_change': '2024-09-19T05:47:41.946134+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.946134+0000', 'last_undegraded': '2024-09-19T05:47:41.946134+0000', 'last_fullsized': '2024-09-19T05:47:41.946134+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2d is not active+clean 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.945573+0000', 'last_change': '2024-09-19T05:47:41.945573+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.945573+0000', 'last_undegraded': '2024-09-19T05:47:41.945573+0000', 'last_fullsized': '2024-09-19T05:47:41.945573+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2c is not active+clean 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.950975+0000', 'last_change': '2024-09-19T05:47:41.950975+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.950975+0000', 'last_undegraded': '2024-09-19T05:47:41.950975+0000', 'last_fullsized': '2024-09-19T05:47:41.950975+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2b is not active+clean 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.948069+0000', 'last_change': '2024-09-19T05:47:41.948069+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.948069+0000', 'last_undegraded': '2024-09-19T05:47:41.948069+0000', 'last_fullsized': '2024-09-19T05:47:41.948069+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2a is not active+clean 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.945902+0000', 'last_change': '2024-09-19T05:47:41.945902+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.945902+0000', 'last_undegraded': '2024-09-19T05:47:41.945902+0000', 'last_fullsized': '2024-09-19T05:47:41.945902+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:PG 28.29 is not active+clean 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.940487+0000', 'last_change': '2024-09-19T05:47:41.940487+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.940487+0000', 'last_undegraded': '2024-09-19T05:47:41.940487+0000', 'last_fullsized': '2024-09-19T05:47:41.940487+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:47:47.808 INFO:tasks.ceph.ceph_manager.ceph:PG 28.28 is not active+clean 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.946999+0000', 'last_change': '2024-09-19T05:47:41.946999+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.946999+0000', 'last_undegraded': '2024-09-19T05:47:41.946999+0000', 'last_fullsized': '2024-09-19T05:47:41.946999+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:PG 28.27 is not active+clean 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.947370+0000', 'last_change': '2024-09-19T05:47:41.947370+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.947370+0000', 'last_undegraded': '2024-09-19T05:47:41.947370+0000', 'last_fullsized': '2024-09-19T05:47:41.947370+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:PG 28.26 is not active+clean 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.941457+0000', 'last_change': '2024-09-19T05:47:41.941457+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.941457+0000', 'last_undegraded': '2024-09-19T05:47:41.941457+0000', 'last_fullsized': '2024-09-19T05:47:41.941457+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:PG 28.25 is not active+clean 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.949404+0000', 'last_change': '2024-09-19T05:47:41.949404+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.949404+0000', 'last_undegraded': '2024-09-19T05:47:41.949404+0000', 'last_fullsized': '2024-09-19T05:47:41.949404+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:PG 28.24 is not active+clean 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.946520+0000', 'last_change': '2024-09-19T05:47:41.946520+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.946520+0000', 'last_undegraded': '2024-09-19T05:47:41.946520+0000', 'last_fullsized': '2024-09-19T05:47:41.946520+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:PG 28.23 is not active+clean 2024-09-19T05:47:47.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.944476+0000', 'last_change': '2024-09-19T05:47:41.944476+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.944476+0000', 'last_undegraded': '2024-09-19T05:47:41.944476+0000', 'last_fullsized': '2024-09-19T05:47:41.944476+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:PG 28.22 is not active+clean 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.944442+0000', 'last_change': '2024-09-19T05:47:41.944442+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.944442+0000', 'last_undegraded': '2024-09-19T05:47:41.944442+0000', 'last_fullsized': '2024-09-19T05:47:41.944442+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:PG 28.21 is not active+clean 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.952444+0000', 'last_change': '2024-09-19T05:47:41.952444+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.952444+0000', 'last_undegraded': '2024-09-19T05:47:41.952444+0000', 'last_fullsized': '2024-09-19T05:47:41.952444+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:PG 28.20 is not active+clean 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.949314+0000', 'last_change': '2024-09-19T05:47:41.949314+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.949314+0000', 'last_undegraded': '2024-09-19T05:47:41.949314+0000', 'last_fullsized': '2024-09-19T05:47:41.949314+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:PG 28.18 is not active+clean 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.939697+0000', 'last_change': '2024-09-19T05:47:41.939697+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.939697+0000', 'last_undegraded': '2024-09-19T05:47:41.939697+0000', 'last_fullsized': '2024-09-19T05:47:41.939697+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:PG 28.19 is not active+clean 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.942800+0000', 'last_change': '2024-09-19T05:47:41.942800+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.942800+0000', 'last_undegraded': '2024-09-19T05:47:41.942800+0000', 'last_fullsized': '2024-09-19T05:47:41.942800+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:47:47.810 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1a is not active+clean 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.944794+0000', 'last_change': '2024-09-19T05:47:41.944794+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.944794+0000', 'last_undegraded': '2024-09-19T05:47:41.944794+0000', 'last_fullsized': '2024-09-19T05:47:41.944794+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1b is not active+clean 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.946969+0000', 'last_change': '2024-09-19T05:47:41.946969+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.946969+0000', 'last_undegraded': '2024-09-19T05:47:41.946969+0000', 'last_fullsized': '2024-09-19T05:47:41.946969+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1c is not active+clean 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.942875+0000', 'last_change': '2024-09-19T05:47:41.942875+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.942875+0000', 'last_undegraded': '2024-09-19T05:47:41.942875+0000', 'last_fullsized': '2024-09-19T05:47:41.942875+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1e is not active+clean 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.951396+0000', 'last_change': '2024-09-19T05:47:41.951396+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.951396+0000', 'last_undegraded': '2024-09-19T05:47:41.951396+0000', 'last_fullsized': '2024-09-19T05:47:41.951396+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1f is not active+clean 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.946834+0000', 'last_change': '2024-09-19T05:47:41.946834+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.946834+0000', 'last_undegraded': '2024-09-19T05:47:41.946834+0000', 'last_fullsized': '2024-09-19T05:47:41.946834+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:PG 28.10 is not active+clean 2024-09-19T05:47:47.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.944697+0000', 'last_change': '2024-09-19T05:47:41.944697+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.944697+0000', 'last_undegraded': '2024-09-19T05:47:41.944697+0000', 'last_fullsized': '2024-09-19T05:47:41.944697+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:47:47.812 INFO:tasks.ceph.ceph_manager.ceph:PG 28.11 is not active+clean 2024-09-19T05:47:47.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.945418+0000', 'last_change': '2024-09-19T05:47:41.945418+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.945418+0000', 'last_undegraded': '2024-09-19T05:47:41.945418+0000', 'last_fullsized': '2024-09-19T05:47:41.945418+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:47:47.812 INFO:tasks.ceph.ceph_manager.ceph:PG 28.12 is not active+clean 2024-09-19T05:47:47.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.943265+0000', 'last_change': '2024-09-19T05:47:41.943265+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.943265+0000', 'last_undegraded': '2024-09-19T05:47:41.943265+0000', 'last_fullsized': '2024-09-19T05:47:41.943265+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:47:47.812 INFO:tasks.ceph.ceph_manager.ceph:PG 28.13 is not active+clean 2024-09-19T05:47:47.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.945863+0000', 'last_change': '2024-09-19T05:47:41.945863+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.945863+0000', 'last_undegraded': '2024-09-19T05:47:41.945863+0000', 'last_fullsized': '2024-09-19T05:47:41.945863+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:47:47.812 INFO:tasks.ceph.ceph_manager.ceph:PG 28.14 is not active+clean 2024-09-19T05:47:47.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.946100+0000', 'last_change': '2024-09-19T05:47:41.946100+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.946100+0000', 'last_undegraded': '2024-09-19T05:47:41.946100+0000', 'last_fullsized': '2024-09-19T05:47:41.946100+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:47:47.812 INFO:tasks.ceph.ceph_manager.ceph:PG 28.15 is not active+clean 2024-09-19T05:47:47.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.945273+0000', 'last_change': '2024-09-19T05:47:41.945273+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.945273+0000', 'last_undegraded': '2024-09-19T05:47:41.945273+0000', 'last_fullsized': '2024-09-19T05:47:41.945273+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:PG 28.16 is not active+clean 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.941200+0000', 'last_change': '2024-09-19T05:47:41.941200+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.941200+0000', 'last_undegraded': '2024-09-19T05:47:41.941200+0000', 'last_fullsized': '2024-09-19T05:47:41.941200+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:PG 28.17 is not active+clean 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.949476+0000', 'last_change': '2024-09-19T05:47:41.949476+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.949476+0000', 'last_undegraded': '2024-09-19T05:47:41.949476+0000', 'last_fullsized': '2024-09-19T05:47:41.949476+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:PG 28.8 is not active+clean 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.949422+0000', 'last_change': '2024-09-19T05:47:41.949422+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.949422+0000', 'last_undegraded': '2024-09-19T05:47:41.949422+0000', 'last_fullsized': '2024-09-19T05:47:41.949422+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:PG 28.9 is not active+clean 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.941277+0000', 'last_change': '2024-09-19T05:47:41.941277+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.941277+0000', 'last_undegraded': '2024-09-19T05:47:41.941277+0000', 'last_fullsized': '2024-09-19T05:47:41.941277+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:PG 28.a is not active+clean 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.937951+0000', 'last_change': '2024-09-19T05:47:41.937951+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.937951+0000', 'last_undegraded': '2024-09-19T05:47:41.937951+0000', 'last_fullsized': '2024-09-19T05:47:41.937951+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:47:47.813 INFO:tasks.ceph.ceph_manager.ceph:PG 28.b is not active+clean 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.946873+0000', 'last_change': '2024-09-19T05:47:41.946873+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.946873+0000', 'last_undegraded': '2024-09-19T05:47:41.946873+0000', 'last_fullsized': '2024-09-19T05:47:41.946873+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:PG 28.c is not active+clean 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.939698+0000', 'last_change': '2024-09-19T05:47:41.939698+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.939698+0000', 'last_undegraded': '2024-09-19T05:47:41.939698+0000', 'last_fullsized': '2024-09-19T05:47:41.939698+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:PG 28.d is not active+clean 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.960155+0000', 'last_change': '2024-09-19T05:47:41.960155+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.960155+0000', 'last_undegraded': '2024-09-19T05:47:41.960155+0000', 'last_fullsized': '2024-09-19T05:47:41.960155+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:PG 28.e is not active+clean 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.940471+0000', 'last_change': '2024-09-19T05:47:41.940471+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.940471+0000', 'last_undegraded': '2024-09-19T05:47:41.940471+0000', 'last_fullsized': '2024-09-19T05:47:41.940471+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:PG 28.f is not active+clean 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.945692+0000', 'last_change': '2024-09-19T05:47:41.945692+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.945692+0000', 'last_undegraded': '2024-09-19T05:47:41.945692+0000', 'last_fullsized': '2024-09-19T05:47:41.945692+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:PG 28.0 is not active+clean 2024-09-19T05:47:47.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.948406+0000', 'last_change': '2024-09-19T05:47:41.948406+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.948406+0000', 'last_undegraded': '2024-09-19T05:47:41.948406+0000', 'last_fullsized': '2024-09-19T05:47:41.948406+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.815 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1 is not active+clean 2024-09-19T05:47:47.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.944552+0000', 'last_change': '2024-09-19T05:47:41.944552+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.944552+0000', 'last_undegraded': '2024-09-19T05:47:41.944552+0000', 'last_fullsized': '2024-09-19T05:47:41.944552+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:47:47.815 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2 is not active+clean 2024-09-19T05:47:47.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.943862+0000', 'last_change': '2024-09-19T05:47:41.943862+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.943862+0000', 'last_undegraded': '2024-09-19T05:47:41.943862+0000', 'last_fullsized': '2024-09-19T05:47:41.943862+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T05:47:47.815 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3 is not active+clean 2024-09-19T05:47:47.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.941134+0000', 'last_change': '2024-09-19T05:47:41.941134+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.941134+0000', 'last_undegraded': '2024-09-19T05:47:41.941134+0000', 'last_fullsized': '2024-09-19T05:47:41.941134+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:47:47.815 INFO:tasks.ceph.ceph_manager.ceph:PG 28.4 is not active+clean 2024-09-19T05:47:47.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.950106+0000', 'last_change': '2024-09-19T05:47:41.950106+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.950106+0000', 'last_undegraded': '2024-09-19T05:47:41.950106+0000', 'last_fullsized': '2024-09-19T05:47:41.950106+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T05:47:47.816 INFO:tasks.ceph.ceph_manager.ceph:PG 28.5 is not active+clean 2024-09-19T05:47:47.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.951834+0000', 'last_change': '2024-09-19T05:47:41.951834+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.951834+0000', 'last_undegraded': '2024-09-19T05:47:41.951834+0000', 'last_fullsized': '2024-09-19T05:47:41.951834+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:47:47.816 INFO:tasks.ceph.ceph_manager.ceph:PG 28.6 is not active+clean 2024-09-19T05:47:47.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.949405+0000', 'last_change': '2024-09-19T05:47:41.949405+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.949405+0000', 'last_undegraded': '2024-09-19T05:47:41.949405+0000', 'last_fullsized': '2024-09-19T05:47:41.949405+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T05:47:47.816 INFO:tasks.ceph.ceph_manager.ceph:PG 28.7 is not active+clean 2024-09-19T05:47:47.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.945018+0000', 'last_change': '2024-09-19T05:47:41.945018+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.945018+0000', 'last_undegraded': '2024-09-19T05:47:41.945018+0000', 'last_fullsized': '2024-09-19T05:47:41.945018+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T05:47:47.817 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1d is not active+clean 2024-09-19T05:47:47.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:47:41.936877+0000', 'last_change': '2024-09-19T05:47:41.936877+0000', 'last_active': '2024-09-19T05:47:41.918933+0000', 'last_peered': '2024-09-19T05:47:41.918933+0000', 'last_clean': '2024-09-19T05:47:41.918933+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:47:41.936877+0000', 'last_undegraded': '2024-09-19T05:47:41.936877+0000', 'last_fullsized': '2024-09-19T05:47:41.936877+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'last_clean_scrub_stamp': '2024-09-19T05:47:41.918933+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:47:47.817 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:47:47.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.967+0000 7f8095aba640 1 Processor -- start 2024-09-19T05:47:47.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.967+0000 7f8095aba640 1 -- start start 2024-09-19T05:47:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f8095aba640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f809006f8e0 0x7f809006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f8095aba640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f809015c730 con 0x7f8090067ed0 2024-09-19T05:47:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f8095aba640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8090070200 con 0x7f8090162d70 2024-09-19T05:47:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f8095aba640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f809015c920 con 0x7f809006f8e0 2024-09-19T05:47:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f808f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f809006f8e0 0x7f809006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f808f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f809006f8e0 0x7f809006fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59908/0 (socket says 172.21.15.67:59908) 2024-09-19T05:47:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f808f7fe640 1 -- 172.21.15.67:0/3176272669 learned_addr learned my addr 172.21.15.67:0/3176272669 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f808f7fe640 1 -- 172.21.15.67:0/3176272669 >> v1:172.21.15.97:6789/0 conn(0x7f8090162d70 legacy=0x7f8090165160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f808f7fe640 1 -- 172.21.15.67:0/3176272669 >> v1:172.21.15.67:6789/0 conn(0x7f8090067ed0 legacy=0x7f80900afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f808f7fe640 1 -- 172.21.15.67:0/3176272669 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809015b970 con 0x7f809006f8e0 2024-09-19T05:47:47.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.971+0000 7f808f7fe640 1 --2- 172.21.15.67:0/3176272669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 0x7f809006fcc0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f808000bb10 tx=0x7f808001ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91842698b0352c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:47.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f808effd640 1 -- 172.21.15.67:0/3176272669 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80800b4070 con 0x7f809006f8e0 2024-09-19T05:47:47.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f808effd640 1 -- 172.21.15.67:0/3176272669 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80800a79c0 con 0x7f809006f8e0 2024-09-19T05:47:47.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f808effd640 1 -- 172.21.15.67:0/3176272669 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80800a7d90 con 0x7f809006f8e0 2024-09-19T05:47:47.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 -- 172.21.15.67:0/3176272669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 msgr2=0x7f809006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 --2- 172.21.15.67:0/3176272669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 0x7f809006fcc0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f808000bb10 tx=0x7f808001ebf0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 -- 172.21.15.67:0/3176272669 shutdown_connections 2024-09-19T05:47:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 --2- 172.21.15.67:0/3176272669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 0x7f809006fcc0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 -- 172.21.15.67:0/3176272669 >> 172.21.15.67:0/3176272669 conn(0x7f8090073500 msgr2=0x7f809006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 -- 172.21.15.67:0/3176272669 shutdown_connections 2024-09-19T05:47:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 -- 172.21.15.67:0/3176272669 wait complete. 2024-09-19T05:47:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 Processor -- start 2024-09-19T05:47:47.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 -- start start 2024-09-19T05:47:47.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8090067ed0 0x7f809014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 0x7f8090164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8090162d70 0x7f8090147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8090155b00 con 0x7f809006f8e0 2024-09-19T05:47:47.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f809015c2a0 con 0x7f8090067ed0 2024-09-19T05:47:47.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8095aba640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8090155c80 con 0x7f8090162d70 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8087fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 0x7f8090164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8087fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 0x7f8090164430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59910/0 (socket says 172.21.15.67:59910) 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8087fff640 1 -- 172.21.15.67:0/798346944 learned_addr learned my addr 172.21.15.67:0/798346944 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f808f7fe640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8090067ed0 0x7f809014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8087fff640 1 -- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8090162d70 msgr2=0x7f8090147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f808ffff640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8090162d70 0x7f8090147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8087fff640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8090162d70 0x7f8090147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8087fff640 1 -- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8090067ed0 msgr2=0x7f809014cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8087fff640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8090067ed0 0x7f809014cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8087fff640 1 -- 172.21.15.67:0/798346944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8090164ba0 con 0x7f809006f8e0 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f808f7fe640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8090067ed0 0x7f809014cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f808ffff640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8090162d70 0x7f8090147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.975+0000 7f8087fff640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 0x7f8090164430 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f807800c370 tx=0x7f807800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f808cff9640 1 -- 172.21.15.67:0/798346944 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80780052d0 con 0x7f809006f8e0 2024-09-19T05:47:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f808cff9640 1 -- 172.21.15.67:0/798346944 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8078005470 con 0x7f809006f8e0 2024-09-19T05:47:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f8095aba640 1 -- 172.21.15.67:0/798346944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8090164e80 con 0x7f809006f8e0 2024-09-19T05:47:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f808cff9640 1 -- 172.21.15.67:0/798346944 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078007260 con 0x7f809006f8e0 2024-09-19T05:47:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f8095aba640 1 -- 172.21.15.67:0/798346944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8090147ac0 con 0x7f809006f8e0 2024-09-19T05:47:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f8095aba640 1 -- 172.21.15.67:0/798346944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809006fcc0 con 0x7f809006f8e0 2024-09-19T05:47:47.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f808cff9640 1 -- 172.21.15.67:0/798346944 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8078007400 con 0x7f809006f8e0 2024-09-19T05:47:47.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f808cff9640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f80700678c0 0x7f8070069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:47.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f808cff9640 1 -- 172.21.15.67:0/798346944 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f80780852a0 con 0x7f809006f8e0 2024-09-19T05:47:47.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f808f7fe640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f80700678c0 0x7f8070069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:47.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.979+0000 7f808f7fe640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f80700678c0 0x7f8070069d80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f80800b1000 tx=0x7f8080008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:47.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:47.983+0000 7f808cff9640 1 -- 172.21.15.67:0/798346944 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8078055c50 con 0x7f809006f8e0 2024-09-19T05:47:48.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.211+0000 7f8095aba640 1 -- 172.21.15.67:0/798346944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f809006c640 con 0x7f809006f8e0 2024-09-19T05:47:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.211+0000 7f808cff9640 1 -- 172.21.15.67:0/798346944 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1243 (secure 0 0 0) 0x7f8078055550 con 0x7f809006f8e0 2024-09-19T05:47:48.211 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:48.211 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":897,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":191,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":559964160,"bytes_avail":772534149120,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":138,"btime":"2024-09-19T05:47:45:972719+0000","id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"c","status":"up:active","gid":10458}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-19T05:46:43.391737+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:47:48.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 -- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f80700678c0 msgr2=0x7f8070069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:48.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f80700678c0 0x7f8070069d80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f80800b1000 tx=0x7f8080008040 comp rx=0 tx=0).stop 2024-09-19T05:47:48.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 -- 172.21.15.67:0/798346944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 msgr2=0x7f8090164430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:48.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 0x7f8090164430 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f807800c370 tx=0x7f807800c830 comp rx=0 tx=0).stop 2024-09-19T05:47:48.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 -- 172.21.15.67:0/798346944 shutdown_connections 2024-09-19T05:47:48.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f80700678c0 0x7f8070069d80 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8090162d70 0x7f8090147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f809006f8e0 0x7f8090164430 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 --2- 172.21.15.67:0/798346944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8090067ed0 0x7f809014cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 -- 172.21.15.67:0/798346944 >> 172.21.15.67:0/798346944 conn(0x7f8090073500 msgr2=0x7f8090154910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:48.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 -- 172.21.15.67:0/798346944 shutdown_connections 2024-09-19T05:47:48.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.215+0000 7f8095aba640 1 -- 172.21.15.67:0/798346944 wait complete. 2024-09-19T05:47:48.231 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T05:47:48.231 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:47:48.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6997f7a640 1 Processor -- start 2024-09-19T05:47:48.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6997f7a640 1 -- start start 2024-09-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6997f7a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6990161da0 0x7f69900d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6997f7a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69900d0160 0x7f69900d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6997f7a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69900d05d0 con 0x7f69900d0e80 2024-09-19T05:47:48.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6997f7a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f69900d1830 con 0x7f6990161da0 2024-09-19T05:47:48.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6997f7a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f69900d0840 con 0x7f69900d0160 2024-09-19T05:47:48.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6995515640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f69900d0e80 0x7f69900b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46550/0 (socket says 172.21.15.67:46550) 2024-09-19T05:47:48.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6995515640 1 -- 172.21.15.67:0/1404986957 learned_addr learned my addr 172.21.15.67:0/1404986957 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6996517640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69900d0160 0x7f69900d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:48.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004596208 0 0) 0x7f69900d05d0 con 0x7f69900d0e80 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6995d16640 1 --2- 172.21.15.67:0/1404986957 >> v2:172.21.15.97:3300/0 conn(0x7f6990161da0 0x7f69900d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f697c003530 con 0x7f69900d0e80 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 605517808 0 0) 0x7f697c003530 con 0x7f69900d0e80 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69900d0160 msgr2=0x7f69900d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69900d0160 0x7f69900d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 >> v2:172.21.15.97:3300/0 conn(0x7f6990161da0 msgr2=0x7f69900d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 --2- 172.21.15.67:0/1404986957 >> v2:172.21.15.97:3300/0 conn(0x7f6990161da0 0x7f69900d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69900d4d40 con 0x7f69900d0e80 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f69800016a0 con 0x7f69900d0e80 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 >> v1:172.21.15.67:6789/0 conn(0x7f69900d0e80 legacy=0x7f69900b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f697c0039f0 0x7f697c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69900d0160 0x7f697c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:48.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f697c004d50 0x7f697c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:48.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f69900d1830 con 0x7f697c004d50 2024-09-19T05:47:48.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f69900d0840 con 0x7f697c0039f0 2024-09-19T05:47:48.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f697c00b9d0 con 0x7f69900d0160 2024-09-19T05:47:48.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6996517640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f697c004d50 0x7f697c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:48.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6995515640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69900d0160 0x7f697c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:48.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6995d16640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f697c0039f0 0x7f697c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:48.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6996517640 1 -- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69900d0160 msgr2=0x7f697c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6996517640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69900d0160 0x7f697c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6996517640 1 -- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f697c0039f0 msgr2=0x7f697c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6996517640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f697c0039f0 0x7f697c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.351+0000 7f6996517640 1 -- 172.21.15.67:0/1404986957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c003530 con 0x7f697c004d50 2024-09-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6996517640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f697c004d50 0x7f697c0051d0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f6988009fc0 tx=0x7f698801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38c23877cb3509e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69880b2070 con 0x7f697c004d50 2024-09-19T05:47:48.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69880a5c90 con 0x7f697c004d50 2024-09-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6994d14640 1 -- 172.21.15.67:0/1404986957 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6988009c10 con 0x7f697c004d50 2024-09-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6997f7a640 1 -- 172.21.15.67:0/1404986957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f697c004d50 msgr2=0x7f697c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6997f7a640 1 --2- 172.21.15.67:0/1404986957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f697c004d50 0x7f697c0051d0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f6988009fc0 tx=0x7f698801cc20 comp rx=0 tx=0).stop 2024-09-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6996517640 1 -- 172.21.15.67:0/1404986957 reap_dead start 2024-09-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6997f7a640 1 -- 172.21.15.67:0/1404986957 shutdown_connections 2024-09-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6997f7a640 1 -- 172.21.15.67:0/1404986957 >> 172.21.15.67:0/1404986957 conn(0x7f699008bfc0 msgr2=0x7f69900d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6997f7a640 1 -- 172.21.15.67:0/1404986957 shutdown_connections 2024-09-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6997f7a640 1 -- 172.21.15.67:0/1404986957 wait complete. 2024-09-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6997f7a640 1 Processor -- start 2024-09-19T05:47:48.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.355+0000 7f6997f7a640 1 -- start start 2024-09-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6997f7a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f697c004d50 0x7f69900b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6997f7a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69900b72c0 0x7f699006e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6997f7a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69901f7c50 0x7f69900b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6997f7a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f69900b3ca0 con 0x7f69900b72c0 2024-09-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6997f7a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f69900d5300 con 0x7f69901f7c50 2024-09-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6997f7a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f69900b5d00 con 0x7f697c004d50 2024-09-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995515640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69900b72c0 0x7f699006e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995515640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69900b72c0 0x7f699006e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59926/0 (socket says 172.21.15.67:59926) 2024-09-19T05:47:48.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995515640 1 -- 172.21.15.67:0/1745031585 learned_addr learned my addr 172.21.15.67:0/1745031585 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995d16640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f697c004d50 0x7f69900b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6996517640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69901f7c50 0x7f69900b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995515640 1 -- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f697c004d50 msgr2=0x7f69900b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995515640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f697c004d50 0x7f69900b7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995515640 1 -- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69901f7c50 msgr2=0x7f69900b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995515640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69901f7c50 0x7f69900b96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995515640 1 -- 172.21.15.67:0/1745031585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69900cc1d0 con 0x7f69900b72c0 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995515640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69900b72c0 0x7f699006e0a0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f698000e780 tx=0x7f698000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f69867fc640 1 -- 172.21.15.67:0/1745031585 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698000ee90 con 0x7f69900b72c0 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f69867fc640 1 -- 172.21.15.67:0/1745031585 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6980018070 con 0x7f69900b72c0 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f69867fc640 1 -- 172.21.15.67:0/1745031585 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698000cab0 con 0x7f69900b72c0 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6997f7a640 1 -- 172.21.15.67:0/1745031585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69900cc4b0 con 0x7f69900b72c0 2024-09-19T05:47:48.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6997f7a640 1 -- 172.21.15.67:0/1745031585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69901f80d0 con 0x7f69900b72c0 2024-09-19T05:47:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6997f7a640 1 -- 172.21.15.67:0/1745031585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6990162180 con 0x7f69900b72c0 2024-09-19T05:47:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f69867fc640 1 -- 172.21.15.67:0/1745031585 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f698000cc50 con 0x7f69900b72c0 2024-09-19T05:47:48.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f69867fc640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6974067a90 0x7f6974069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f69867fc640 1 -- 172.21.15.67:0/1745031585 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f6980086280 con 0x7f69900b72c0 2024-09-19T05:47:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.359+0000 7f6995d16640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6974067a90 0x7f6974069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:48.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.363+0000 7f6995d16640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6974067a90 0x7f6974069f50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f698c009ab0 tx=0x7f698c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:48.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.363+0000 7f69867fc640 1 -- 172.21.15.67:0/1745031585 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6980056da0 con 0x7f69900b72c0 2024-09-19T05:47:48.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.523+0000 7f6997f7a640 1 -- 172.21.15.67:0/1745031585 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69900cbf80 con 0x7f6974067a90 2024-09-19T05:47:48.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.543+0000 7f69867fc640 1 -- 172.21.15.67:0/1745031585 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247097 (secure 0 0 0) 0x7f69900cbf80 con 0x7f6974067a90 2024-09-19T05:47:48.542 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:48.544 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:47:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 -- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6974067a90 msgr2=0x7f6974069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6974067a90 0x7f6974069f50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f698c009ab0 tx=0x7f698c008040 comp rx=0 tx=0).stop 2024-09-19T05:47:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 -- 172.21.15.67:0/1745031585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69900b72c0 msgr2=0x7f699006e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69900b72c0 0x7f699006e0a0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f698000e780 tx=0x7f698000ec40 comp rx=0 tx=0).stop 2024-09-19T05:47:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 -- 172.21.15.67:0/1745031585 shutdown_connections 2024-09-19T05:47:48.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69901f7c50 0x7f69900b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69900b72c0 0x7f699006e0a0 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6974067a90 0x7f6974069f50 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 --2- 172.21.15.67:0/1745031585 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f697c004d50 0x7f69900b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 -- 172.21.15.67:0/1745031585 >> 172.21.15.67:0/1745031585 conn(0x7f699008bfc0 msgr2=0x7f69900d2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 -- 172.21.15.67:0/1745031585 shutdown_connections 2024-09-19T05:47:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:48.547+0000 7f6997f7a640 1 -- 172.21.15.67:0/1745031585 wait complete. 2024-09-19T05:47:48.562 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":627,"stamp":"2024-09-19T05:47:47.412760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":546840,"kb_used_data":19728,"kb_used_omap":12,"kb_used_meta":526899,"kb_avail":754427880,"statfs":{"total":773094113280,"available":772534149120,"internally_reserved":0,"allocated":20201472,"data_stored":10152186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":539545137},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001878"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940180+0000","last_change":"2024-09-19T05:47:41.940180+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940180+0000","last_undegraded":"2024-09-19T05:47:41.940180+0000","last_fullsized":"2024-09-19T05:47:41.940180+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939965+0000","last_change":"2024-09-19T05:47:41.939965+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939965+0000","last_undegraded":"2024-09-19T05:47:41.939965+0000","last_fullsized":"2024-09-19T05:47:41.939965+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.953830+0000","last_change":"2024-09-19T05:47:41.953830+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.953830+0000","last_undegraded":"2024-09-19T05:47:41.953830+0000","last_fullsized":"2024-09-19T05:47:41.953830+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949936+0000","last_change":"2024-09-19T05:47:41.949936+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949936+0000","last_undegraded":"2024-09-19T05:47:41.949936+0000","last_fullsized":"2024-09-19T05:47:41.949936+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947364+0000","last_change":"2024-09-19T05:47:41.947364+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947364+0000","last_undegraded":"2024-09-19T05:47:41.947364+0000","last_fullsized":"2024-09-19T05:47:41.947364+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948780+0000","last_change":"2024-09-19T05:47:41.948780+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948780+0000","last_undegraded":"2024-09-19T05:47:41.948780+0000","last_fullsized":"2024-09-19T05:47:41.948780+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946499+0000","last_change":"2024-09-19T05:47:41.946499+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946499+0000","last_undegraded":"2024-09-19T05:47:41.946499+0000","last_fullsized":"2024-09-19T05:47:41.946499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950493+0000","last_change":"2024-09-19T05:47:41.950493+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950493+0000","last_undegraded":"2024-09-19T05:47:41.950493+0000","last_fullsized":"2024-09-19T05:47:41.950493+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948580+0000","last_change":"2024-09-19T05:47:41.948580+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948580+0000","last_undegraded":"2024-09-19T05:47:41.948580+0000","last_fullsized":"2024-09-19T05:47:41.948580+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948677+0000","last_change":"2024-09-19T05:47:41.948677+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948677+0000","last_undegraded":"2024-09-19T05:47:41.948677+0000","last_fullsized":"2024-09-19T05:47:41.948677+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.953401+0000","last_change":"2024-09-19T05:47:41.953401+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.953401+0000","last_undegraded":"2024-09-19T05:47:41.953401+0000","last_fullsized":"2024-09-19T05:47:41.953401+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950433+0000","last_change":"2024-09-19T05:47:41.950433+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950433+0000","last_undegraded":"2024-09-19T05:47:41.950433+0000","last_fullsized":"2024-09-19T05:47:41.950433+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948591+0000","last_change":"2024-09-19T05:47:41.948591+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948591+0000","last_undegraded":"2024-09-19T05:47:41.948591+0000","last_fullsized":"2024-09-19T05:47:41.948591+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946921+0000","last_change":"2024-09-19T05:47:41.946921+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946921+0000","last_undegraded":"2024-09-19T05:47:41.946921+0000","last_fullsized":"2024-09-19T05:47:41.946921+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942282+0000","last_change":"2024-09-19T05:47:41.942282+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942282+0000","last_undegraded":"2024-09-19T05:47:41.942282+0000","last_fullsized":"2024-09-19T05:47:41.942282+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.952887+0000","last_change":"2024-09-19T05:47:41.952887+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.952887+0000","last_undegraded":"2024-09-19T05:47:41.952887+0000","last_fullsized":"2024-09-19T05:47:41.952887+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947978+0000","last_change":"2024-09-19T05:47:41.947978+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947978+0000","last_undegraded":"2024-09-19T05:47:41.947978+0000","last_fullsized":"2024-09-19T05:47:41.947978+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946134+0000","last_change":"2024-09-19T05:47:41.946134+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946134+0000","last_undegraded":"2024-09-19T05:47:41.946134+0000","last_fullsized":"2024-09-19T05:47:41.946134+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945573+0000","last_change":"2024-09-19T05:47:41.945573+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945573+0000","last_undegraded":"2024-09-19T05:47:41.945573+0000","last_fullsized":"2024-09-19T05:47:41.945573+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950975+0000","last_change":"2024-09-19T05:47:41.950975+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950975+0000","last_undegraded":"2024-09-19T05:47:41.950975+0000","last_fullsized":"2024-09-19T05:47:41.950975+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948069+0000","last_change":"2024-09-19T05:47:41.948069+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948069+0000","last_undegraded":"2024-09-19T05:47:41.948069+0000","last_fullsized":"2024-09-19T05:47:41.948069+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945902+0000","last_change":"2024-09-19T05:47:41.945902+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945902+0000","last_undegraded":"2024-09-19T05:47:41.945902+0000","last_fullsized":"2024-09-19T05:47:41.945902+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940487+0000","last_change":"2024-09-19T05:47:41.940487+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940487+0000","last_undegraded":"2024-09-19T05:47:41.940487+0000","last_fullsized":"2024-09-19T05:47:41.940487+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946999+0000","last_change":"2024-09-19T05:47:41.946999+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946999+0000","last_undegraded":"2024-09-19T05:47:41.946999+0000","last_fullsized":"2024-09-19T05:47:41.946999+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.947370+0000","last_change":"2024-09-19T05:47:41.947370+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.947370+0000","last_undegraded":"2024-09-19T05:47:41.947370+0000","last_fullsized":"2024-09-19T05:47:41.947370+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941457+0000","last_change":"2024-09-19T05:47:41.941457+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941457+0000","last_undegraded":"2024-09-19T05:47:41.941457+0000","last_fullsized":"2024-09-19T05:47:41.941457+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949404+0000","last_change":"2024-09-19T05:47:41.949404+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949404+0000","last_undegraded":"2024-09-19T05:47:41.949404+0000","last_fullsized":"2024-09-19T05:47:41.949404+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946520+0000","last_change":"2024-09-19T05:47:41.946520+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946520+0000","last_undegraded":"2024-09-19T05:47:41.946520+0000","last_fullsized":"2024-09-19T05:47:41.946520+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944476+0000","last_change":"2024-09-19T05:47:41.944476+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944476+0000","last_undegraded":"2024-09-19T05:47:41.944476+0000","last_fullsized":"2024-09-19T05:47:41.944476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944442+0000","last_change":"2024-09-19T05:47:41.944442+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944442+0000","last_undegraded":"2024-09-19T05:47:41.944442+0000","last_fullsized":"2024-09-19T05:47:41.944442+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.952444+0000","last_change":"2024-09-19T05:47:41.952444+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.952444+0000","last_undegraded":"2024-09-19T05:47:41.952444+0000","last_fullsized":"2024-09-19T05:47:41.952444+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949314+0000","last_change":"2024-09-19T05:47:41.949314+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949314+0000","last_undegraded":"2024-09-19T05:47:41.949314+0000","last_fullsized":"2024-09-19T05:47:41.949314+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939697+0000","last_change":"2024-09-19T05:47:41.939697+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939697+0000","last_undegraded":"2024-09-19T05:47:41.939697+0000","last_fullsized":"2024-09-19T05:47:41.939697+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.974835+0000","last_change":"2024-09-19T05:47:41.972348+0000","last_active":"2024-09-19T05:47:41.974835+0000","last_peered":"2024-09-19T05:47:41.974835+0000","last_clean":"2024-09-19T05:47:41.974835+0000","last_became_active":"2024-09-19T05:47:41.971855+0000","last_became_peered":"2024-09-19T05:47:41.971855+0000","last_unstale":"2024-09-19T05:47:41.974835+0000","last_undegraded":"2024-09-19T05:47:41.974835+0000","last_fullsized":"2024-09-19T05:47:41.974835+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:41.408991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942800+0000","last_change":"2024-09-19T05:47:41.942800+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942800+0000","last_undegraded":"2024-09-19T05:47:41.942800+0000","last_fullsized":"2024-09-19T05:47:41.942800+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958617+0000","last_change":"2024-09-19T05:47:41.955701+0000","last_active":"2024-09-19T05:47:41.958617+0000","last_peered":"2024-09-19T05:47:41.958617+0000","last_clean":"2024-09-19T05:47:41.958617+0000","last_became_active":"2024-09-19T05:47:41.953352+0000","last_became_peered":"2024-09-19T05:47:41.953352+0000","last_unstale":"2024-09-19T05:47:41.958617+0000","last_undegraded":"2024-09-19T05:47:41.958617+0000","last_fullsized":"2024-09-19T05:47:41.958617+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:33.061928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944794+0000","last_change":"2024-09-19T05:47:41.944794+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944794+0000","last_undegraded":"2024-09-19T05:47:41.944794+0000","last_fullsized":"2024-09-19T05:47:41.944794+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954715+0000","last_change":"2024-09-19T05:47:41.944967+0000","last_active":"2024-09-19T05:47:41.954715+0000","last_peered":"2024-09-19T05:47:41.954715+0000","last_clean":"2024-09-19T05:47:41.954715+0000","last_became_active":"2024-09-19T05:47:41.944696+0000","last_became_peered":"2024-09-19T05:47:41.944696+0000","last_unstale":"2024-09-19T05:47:41.954715+0000","last_undegraded":"2024-09-19T05:47:41.954715+0000","last_fullsized":"2024-09-19T05:47:41.954715+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:17.350651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946969+0000","last_change":"2024-09-19T05:47:41.946969+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946969+0000","last_undegraded":"2024-09-19T05:47:41.946969+0000","last_fullsized":"2024-09-19T05:47:41.946969+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.969647+0000","last_change":"2024-09-19T05:47:41.969151+0000","last_active":"2024-09-19T05:47:41.969647+0000","last_peered":"2024-09-19T05:47:41.969647+0000","last_clean":"2024-09-19T05:47:41.969647+0000","last_became_active":"2024-09-19T05:47:41.968800+0000","last_became_peered":"2024-09-19T05:47:41.968800+0000","last_unstale":"2024-09-19T05:47:41.969647+0000","last_undegraded":"2024-09-19T05:47:41.969647+0000","last_fullsized":"2024-09-19T05:47:41.969647+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:11.896933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.942875+0000","last_change":"2024-09-19T05:47:41.942875+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.942875+0000","last_undegraded":"2024-09-19T05:47:41.942875+0000","last_fullsized":"2024-09-19T05:47:41.942875+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973178+0000","last_change":"2024-09-19T05:47:41.970704+0000","last_active":"2024-09-19T05:47:41.973178+0000","last_peered":"2024-09-19T05:47:41.973178+0000","last_clean":"2024-09-19T05:47:41.973178+0000","last_became_active":"2024-09-19T05:47:41.970086+0000","last_became_peered":"2024-09-19T05:47:41.970086+0000","last_unstale":"2024-09-19T05:47:41.973178+0000","last_undegraded":"2024-09-19T05:47:41.973178+0000","last_fullsized":"2024-09-19T05:47:41.973178+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:15.199524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.951396+0000","last_change":"2024-09-19T05:47:41.951396+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.951396+0000","last_undegraded":"2024-09-19T05:47:41.951396+0000","last_fullsized":"2024-09-19T05:47:41.951396+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.972238+0000","last_change":"2024-09-19T05:47:41.970568+0000","last_active":"2024-09-19T05:47:41.972238+0000","last_peered":"2024-09-19T05:47:41.972238+0000","last_clean":"2024-09-19T05:47:41.972238+0000","last_became_active":"2024-09-19T05:47:41.970029+0000","last_became_peered":"2024-09-19T05:47:41.970029+0000","last_unstale":"2024-09-19T05:47:41.972238+0000","last_undegraded":"2024-09-19T05:47:41.972238+0000","last_fullsized":"2024-09-19T05:47:41.972238+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:47.105803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946834+0000","last_change":"2024-09-19T05:47:41.946834+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946834+0000","last_undegraded":"2024-09-19T05:47:41.946834+0000","last_fullsized":"2024-09-19T05:47:41.946834+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.964655+0000","last_change":"2024-09-19T05:47:41.963677+0000","last_active":"2024-09-19T05:47:41.964655+0000","last_peered":"2024-09-19T05:47:41.964655+0000","last_clean":"2024-09-19T05:47:41.964655+0000","last_became_active":"2024-09-19T05:47:41.963381+0000","last_became_peered":"2024-09-19T05:47:41.963381+0000","last_unstale":"2024-09-19T05:47:41.964655+0000","last_undegraded":"2024-09-19T05:47:41.964655+0000","last_fullsized":"2024-09-19T05:47:41.964655+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:36.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944697+0000","last_change":"2024-09-19T05:47:41.944697+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944697+0000","last_undegraded":"2024-09-19T05:47:41.944697+0000","last_fullsized":"2024-09-19T05:47:41.944697+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.961836+0000","last_change":"2024-09-19T05:47:41.959230+0000","last_active":"2024-09-19T05:47:41.961836+0000","last_peered":"2024-09-19T05:47:41.961836+0000","last_clean":"2024-09-19T05:47:41.961836+0000","last_became_active":"2024-09-19T05:47:41.958352+0000","last_became_peered":"2024-09-19T05:47:41.958352+0000","last_unstale":"2024-09-19T05:47:41.961836+0000","last_undegraded":"2024-09-19T05:47:41.961836+0000","last_fullsized":"2024-09-19T05:47:41.961836+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:46.163005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945418+0000","last_change":"2024-09-19T05:47:41.945418+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945418+0000","last_undegraded":"2024-09-19T05:47:41.945418+0000","last_fullsized":"2024-09-19T05:47:41.945418+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.977955+0000","last_change":"2024-09-19T05:47:41.977216+0000","last_active":"2024-09-19T05:47:41.977955+0000","last_peered":"2024-09-19T05:47:41.977955+0000","last_clean":"2024-09-19T05:47:41.977955+0000","last_became_active":"2024-09-19T05:47:41.976763+0000","last_became_peered":"2024-09-19T05:47:41.976763+0000","last_unstale":"2024-09-19T05:47:41.977955+0000","last_undegraded":"2024-09-19T05:47:41.977955+0000","last_fullsized":"2024-09-19T05:47:41.977955+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:24.381428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.943265+0000","last_change":"2024-09-19T05:47:41.943265+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.943265+0000","last_undegraded":"2024-09-19T05:47:41.943265+0000","last_fullsized":"2024-09-19T05:47:41.943265+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954979+0000","last_change":"2024-09-19T05:47:41.954229+0000","last_active":"2024-09-19T05:47:41.954979+0000","last_peered":"2024-09-19T05:47:41.954979+0000","last_clean":"2024-09-19T05:47:41.954979+0000","last_became_active":"2024-09-19T05:47:41.953798+0000","last_became_peered":"2024-09-19T05:47:41.953798+0000","last_unstale":"2024-09-19T05:47:41.954979+0000","last_undegraded":"2024-09-19T05:47:41.954979+0000","last_fullsized":"2024-09-19T05:47:41.954979+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:30.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945863+0000","last_change":"2024-09-19T05:47:41.945863+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945863+0000","last_undegraded":"2024-09-19T05:47:41.945863+0000","last_fullsized":"2024-09-19T05:47:41.945863+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973771+0000","last_change":"2024-09-19T05:47:41.972755+0000","last_active":"2024-09-19T05:47:41.973771+0000","last_peered":"2024-09-19T05:47:41.973771+0000","last_clean":"2024-09-19T05:47:41.973771+0000","last_became_active":"2024-09-19T05:47:41.972124+0000","last_became_peered":"2024-09-19T05:47:41.972124+0000","last_unstale":"2024-09-19T05:47:41.973771+0000","last_undegraded":"2024-09-19T05:47:41.973771+0000","last_fullsized":"2024-09-19T05:47:41.973771+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:07.566154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946100+0000","last_change":"2024-09-19T05:47:41.946100+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946100+0000","last_undegraded":"2024-09-19T05:47:41.946100+0000","last_fullsized":"2024-09-19T05:47:41.946100+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.955505+0000","last_change":"2024-09-19T05:47:41.954745+0000","last_active":"2024-09-19T05:47:41.955505+0000","last_peered":"2024-09-19T05:47:41.955505+0000","last_clean":"2024-09-19T05:47:41.955505+0000","last_became_active":"2024-09-19T05:47:41.954279+0000","last_became_peered":"2024-09-19T05:47:41.954279+0000","last_unstale":"2024-09-19T05:47:41.955505+0000","last_undegraded":"2024-09-19T05:47:41.955505+0000","last_fullsized":"2024-09-19T05:47:41.955505+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:18.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945273+0000","last_change":"2024-09-19T05:47:41.945273+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945273+0000","last_undegraded":"2024-09-19T05:47:41.945273+0000","last_fullsized":"2024-09-19T05:47:41.945273+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.957289+0000","last_change":"2024-09-19T05:47:41.956777+0000","last_active":"2024-09-19T05:47:41.957289+0000","last_peered":"2024-09-19T05:47:41.957289+0000","last_clean":"2024-09-19T05:47:41.957289+0000","last_became_active":"2024-09-19T05:47:41.956381+0000","last_became_peered":"2024-09-19T05:47:41.956381+0000","last_unstale":"2024-09-19T05:47:41.957289+0000","last_undegraded":"2024-09-19T05:47:41.957289+0000","last_fullsized":"2024-09-19T05:47:41.957289+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:49.599888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941200+0000","last_change":"2024-09-19T05:47:41.941200+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941200+0000","last_undegraded":"2024-09-19T05:47:41.941200+0000","last_fullsized":"2024-09-19T05:47:41.941200+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.960325+0000","last_change":"2024-09-19T05:47:41.959689+0000","last_active":"2024-09-19T05:47:41.960325+0000","last_peered":"2024-09-19T05:47:41.960325+0000","last_clean":"2024-09-19T05:47:41.960325+0000","last_became_active":"2024-09-19T05:47:41.959337+0000","last_became_peered":"2024-09-19T05:47:41.959337+0000","last_unstale":"2024-09-19T05:47:41.960325+0000","last_undegraded":"2024-09-19T05:47:41.960325+0000","last_fullsized":"2024-09-19T05:47:41.960325+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:43.673298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949476+0000","last_change":"2024-09-19T05:47:41.949476+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949476+0000","last_undegraded":"2024-09-19T05:47:41.949476+0000","last_fullsized":"2024-09-19T05:47:41.949476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967434+0000","last_change":"2024-09-19T05:47:41.967000+0000","last_active":"2024-09-19T05:47:41.967434+0000","last_peered":"2024-09-19T05:47:41.967434+0000","last_clean":"2024-09-19T05:47:41.967434+0000","last_became_active":"2024-09-19T05:47:41.966638+0000","last_became_peered":"2024-09-19T05:47:41.966638+0000","last_unstale":"2024-09-19T05:47:41.967434+0000","last_undegraded":"2024-09-19T05:47:41.967434+0000","last_fullsized":"2024-09-19T05:47:41.967434+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:34:40.290020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949422+0000","last_change":"2024-09-19T05:47:41.949422+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949422+0000","last_undegraded":"2024-09-19T05:47:41.949422+0000","last_fullsized":"2024-09-19T05:47:41.949422+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967707+0000","last_change":"2024-09-19T05:47:41.963785+0000","last_active":"2024-09-19T05:47:41.967707+0000","last_peered":"2024-09-19T05:47:41.967707+0000","last_clean":"2024-09-19T05:47:41.967707+0000","last_became_active":"2024-09-19T05:47:41.963188+0000","last_became_peered":"2024-09-19T05:47:41.963188+0000","last_unstale":"2024-09-19T05:47:41.967707+0000","last_undegraded":"2024-09-19T05:47:41.967707+0000","last_fullsized":"2024-09-19T05:47:41.967707+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:02.922556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941277+0000","last_change":"2024-09-19T05:47:41.941277+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941277+0000","last_undegraded":"2024-09-19T05:47:41.941277+0000","last_fullsized":"2024-09-19T05:47:41.941277+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.968204+0000","last_change":"2024-09-19T05:47:41.966113+0000","last_active":"2024-09-19T05:47:41.968204+0000","last_peered":"2024-09-19T05:47:41.968204+0000","last_clean":"2024-09-19T05:47:41.968204+0000","last_became_active":"2024-09-19T05:47:41.965410+0000","last_became_peered":"2024-09-19T05:47:41.965410+0000","last_unstale":"2024-09-19T05:47:41.968204+0000","last_undegraded":"2024-09-19T05:47:41.968204+0000","last_fullsized":"2024-09-19T05:47:41.968204+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:23.524781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.937951+0000","last_change":"2024-09-19T05:47:41.937951+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.937951+0000","last_undegraded":"2024-09-19T05:47:41.937951+0000","last_fullsized":"2024-09-19T05:47:41.937951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.963878+0000","last_change":"2024-09-19T05:47:41.962814+0000","last_active":"2024-09-19T05:47:41.963878+0000","last_peered":"2024-09-19T05:47:41.963878+0000","last_clean":"2024-09-19T05:47:41.963878+0000","last_became_active":"2024-09-19T05:47:41.962547+0000","last_became_peered":"2024-09-19T05:47:41.962547+0000","last_unstale":"2024-09-19T05:47:41.963878+0000","last_undegraded":"2024-09-19T05:47:41.963878+0000","last_fullsized":"2024-09-19T05:47:41.963878+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.635828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.946873+0000","last_change":"2024-09-19T05:47:41.946873+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.946873+0000","last_undegraded":"2024-09-19T05:47:41.946873+0000","last_fullsized":"2024-09-19T05:47:41.946873+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.963110+0000","last_change":"2024-09-19T05:47:41.962422+0000","last_active":"2024-09-19T05:47:41.963110+0000","last_peered":"2024-09-19T05:47:41.963110+0000","last_clean":"2024-09-19T05:47:41.963110+0000","last_became_active":"2024-09-19T05:47:41.962067+0000","last_became_peered":"2024-09-19T05:47:41.962067+0000","last_unstale":"2024-09-19T05:47:41.963110+0000","last_undegraded":"2024-09-19T05:47:41.963110+0000","last_fullsized":"2024-09-19T05:47:41.963110+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:12.695351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.939698+0000","last_change":"2024-09-19T05:47:41.939698+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.939698+0000","last_undegraded":"2024-09-19T05:47:41.939698+0000","last_fullsized":"2024-09-19T05:47:41.939698+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958745+0000","last_change":"2024-09-19T05:47:41.957647+0000","last_active":"2024-09-19T05:47:41.958745+0000","last_peered":"2024-09-19T05:47:41.958745+0000","last_clean":"2024-09-19T05:47:41.958745+0000","last_became_active":"2024-09-19T05:47:41.957340+0000","last_became_peered":"2024-09-19T05:47:41.957340+0000","last_unstale":"2024-09-19T05:47:41.958745+0000","last_undegraded":"2024-09-19T05:47:41.958745+0000","last_fullsized":"2024-09-19T05:47:41.958745+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:04.880777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.960155+0000","last_change":"2024-09-19T05:47:41.960155+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.960155+0000","last_undegraded":"2024-09-19T05:47:41.960155+0000","last_fullsized":"2024-09-19T05:47:41.960155+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.959020+0000","last_change":"2024-09-19T05:47:41.956446+0000","last_active":"2024-09-19T05:47:41.959020+0000","last_peered":"2024-09-19T05:47:41.959020+0000","last_clean":"2024-09-19T05:47:41.959020+0000","last_became_active":"2024-09-19T05:47:41.956016+0000","last_became_peered":"2024-09-19T05:47:41.956016+0000","last_unstale":"2024-09-19T05:47:41.959020+0000","last_undegraded":"2024-09-19T05:47:41.959020+0000","last_fullsized":"2024-09-19T05:47:41.959020+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.383814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.940471+0000","last_change":"2024-09-19T05:47:41.940471+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.940471+0000","last_undegraded":"2024-09-19T05:47:41.940471+0000","last_fullsized":"2024-09-19T05:47:41.940471+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970336+0000","last_change":"2024-09-19T05:47:41.967485+0000","last_active":"2024-09-19T05:47:41.970336+0000","last_peered":"2024-09-19T05:47:41.970336+0000","last_clean":"2024-09-19T05:47:41.970336+0000","last_became_active":"2024-09-19T05:47:41.966573+0000","last_became_peered":"2024-09-19T05:47:41.966573+0000","last_unstale":"2024-09-19T05:47:41.970336+0000","last_undegraded":"2024-09-19T05:47:41.970336+0000","last_fullsized":"2024-09-19T05:47:41.970336+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:47.999804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945692+0000","last_change":"2024-09-19T05:47:41.945692+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945692+0000","last_undegraded":"2024-09-19T05:47:41.945692+0000","last_fullsized":"2024-09-19T05:47:41.945692+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967332+0000","last_change":"2024-09-19T05:47:41.958616+0000","last_active":"2024-09-19T05:47:41.967332+0000","last_peered":"2024-09-19T05:47:41.967332+0000","last_clean":"2024-09-19T05:47:41.967332+0000","last_became_active":"2024-09-19T05:47:41.958118+0000","last_became_peered":"2024-09-19T05:47:41.958118+0000","last_unstale":"2024-09-19T05:47:41.967332+0000","last_undegraded":"2024-09-19T05:47:41.967332+0000","last_fullsized":"2024-09-19T05:47:41.967332+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:42.814320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.948406+0000","last_change":"2024-09-19T05:47:41.948406+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.948406+0000","last_undegraded":"2024-09-19T05:47:41.948406+0000","last_fullsized":"2024-09-19T05:47:41.948406+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.973076+0000","last_change":"2024-09-19T05:47:41.972593+0000","last_active":"2024-09-19T05:47:41.973076+0000","last_peered":"2024-09-19T05:47:41.973076+0000","last_clean":"2024-09-19T05:47:41.973076+0000","last_became_active":"2024-09-19T05:47:41.972351+0000","last_became_peered":"2024-09-19T05:47:41.972351+0000","last_unstale":"2024-09-19T05:47:41.973076+0000","last_undegraded":"2024-09-19T05:47:41.973076+0000","last_fullsized":"2024-09-19T05:47:41.973076+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:01.536776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.944552+0000","last_change":"2024-09-19T05:47:41.944552+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.944552+0000","last_undegraded":"2024-09-19T05:47:41.944552+0000","last_fullsized":"2024-09-19T05:47:41.944552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970864+0000","last_change":"2024-09-19T05:47:41.961283+0000","last_active":"2024-09-19T05:47:41.970864+0000","last_peered":"2024-09-19T05:47:41.970864+0000","last_clean":"2024-09-19T05:47:41.970864+0000","last_became_active":"2024-09-19T05:47:41.960599+0000","last_became_peered":"2024-09-19T05:47:41.960599+0000","last_unstale":"2024-09-19T05:47:41.970864+0000","last_undegraded":"2024-09-19T05:47:41.970864+0000","last_fullsized":"2024-09-19T05:47:41.970864+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:10.299523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.943862+0000","last_change":"2024-09-19T05:47:41.943862+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.943862+0000","last_undegraded":"2024-09-19T05:47:41.943862+0000","last_fullsized":"2024-09-19T05:47:41.943862+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967083+0000","last_change":"2024-09-19T05:47:41.961093+0000","last_active":"2024-09-19T05:47:41.967083+0000","last_peered":"2024-09-19T05:47:41.967083+0000","last_clean":"2024-09-19T05:47:41.967083+0000","last_became_active":"2024-09-19T05:47:41.954232+0000","last_became_peered":"2024-09-19T05:47:41.954232+0000","last_unstale":"2024-09-19T05:47:41.967083+0000","last_undegraded":"2024-09-19T05:47:41.967083+0000","last_fullsized":"2024-09-19T05:47:41.967083+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:33.410187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.941134+0000","last_change":"2024-09-19T05:47:41.941134+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.941134+0000","last_undegraded":"2024-09-19T05:47:41.941134+0000","last_fullsized":"2024-09-19T05:47:41.941134+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.958710+0000","last_change":"2024-09-19T05:47:41.956832+0000","last_active":"2024-09-19T05:47:41.958710+0000","last_peered":"2024-09-19T05:47:41.958710+0000","last_clean":"2024-09-19T05:47:41.958710+0000","last_became_active":"2024-09-19T05:47:41.956161+0000","last_became_peered":"2024-09-19T05:47:41.956161+0000","last_unstale":"2024-09-19T05:47:41.958710+0000","last_undegraded":"2024-09-19T05:47:41.958710+0000","last_fullsized":"2024-09-19T05:47:41.958710+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:33.570626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.950106+0000","last_change":"2024-09-19T05:47:41.950106+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.950106+0000","last_undegraded":"2024-09-19T05:47:41.950106+0000","last_fullsized":"2024-09-19T05:47:41.950106+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.970877+0000","last_change":"2024-09-19T05:47:41.961628+0000","last_active":"2024-09-19T05:47:41.970877+0000","last_peered":"2024-09-19T05:47:41.970877+0000","last_clean":"2024-09-19T05:47:41.970877+0000","last_became_active":"2024-09-19T05:47:41.961017+0000","last_became_peered":"2024-09-19T05:47:41.961017+0000","last_unstale":"2024-09-19T05:47:41.970877+0000","last_undegraded":"2024-09-19T05:47:41.970877+0000","last_fullsized":"2024-09-19T05:47:41.970877+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:13.093581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.951834+0000","last_change":"2024-09-19T05:47:41.951834+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.951834+0000","last_undegraded":"2024-09-19T05:47:41.951834+0000","last_fullsized":"2024-09-19T05:47:41.951834+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.969641+0000","last_change":"2024-09-19T05:47:41.969077+0000","last_active":"2024-09-19T05:47:41.969641+0000","last_peered":"2024-09-19T05:47:41.969641+0000","last_clean":"2024-09-19T05:47:41.969641+0000","last_became_active":"2024-09-19T05:47:41.968721+0000","last_became_peered":"2024-09-19T05:47:41.968721+0000","last_unstale":"2024-09-19T05:47:41.969641+0000","last_undegraded":"2024-09-19T05:47:41.969641+0000","last_fullsized":"2024-09-19T05:47:41.969641+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:53.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.949405+0000","last_change":"2024-09-19T05:47:41.949405+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.949405+0000","last_undegraded":"2024-09-19T05:47:41.949405+0000","last_fullsized":"2024-09-19T05:47:41.949405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.967236+0000","last_change":"2024-09-19T05:47:41.958286+0000","last_active":"2024-09-19T05:47:41.967236+0000","last_peered":"2024-09-19T05:47:41.967236+0000","last_clean":"2024-09-19T05:47:41.967236+0000","last_became_active":"2024-09-19T05:47:41.957781+0000","last_became_peered":"2024-09-19T05:47:41.957781+0000","last_unstale":"2024-09-19T05:47:41.967236+0000","last_undegraded":"2024-09-19T05:47:41.967236+0000","last_fullsized":"2024-09-19T05:47:41.967236+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:37.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.945018+0000","last_change":"2024-09-19T05:47:41.945018+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.945018+0000","last_undegraded":"2024-09-19T05:47:41.945018+0000","last_fullsized":"2024-09-19T05:47:41.945018+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.962065+0000","last_change":"2024-09-19T05:47:41.959238+0000","last_active":"2024-09-19T05:47:41.962065+0000","last_peered":"2024-09-19T05:47:41.962065+0000","last_clean":"2024-09-19T05:47:41.962065+0000","last_became_active":"2024-09-19T05:47:41.958803+0000","last_became_peered":"2024-09-19T05:47:41.958803+0000","last_unstale":"2024-09-19T05:47:41.962065+0000","last_undegraded":"2024-09-19T05:47:41.962065+0000","last_fullsized":"2024-09-19T05:47:41.962065+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:07.195273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-09-19T05:47:41.936877+0000","last_change":"2024-09-19T05:47:41.936877+0000","last_active":"2024-09-19T05:47:41.918933+0000","last_peered":"2024-09-19T05:47:41.918933+0000","last_clean":"2024-09-19T05:47:41.918933+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:47:41.936877+0000","last_undegraded":"2024-09-19T05:47:41.936877+0000","last_fullsized":"2024-09-19T05:47:41.936877+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.954786+0000","last_change":"2024-09-19T05:47:41.953928+0000","last_active":"2024-09-19T05:47:41.954786+0000","last_peered":"2024-09-19T05:47:41.954786+0000","last_clean":"2024-09-19T05:47:41.954786+0000","last_became_active":"2024-09-19T05:47:41.953597+0000","last_became_peered":"2024-09-19T05:47:41.953597+0000","last_unstale":"2024-09-19T05:47:41.954786+0000","last_undegraded":"2024-09-19T05:47:41.954786+0000","last_fullsized":"2024-09-19T05:47:41.954786+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:36.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":476,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-19T05:47:41.961300+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:47:41.961300+0000","last_peered":"2024-09-19T05:47:41.961300+0000","last_clean":"2024-09-19T05:47:41.961300+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:47:41.961300+0000","last_undegraded":"2024-09-19T05:47:41.961300+0000","last_fullsized":"2024-09-19T05:47:41.961300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542322,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74340,"kb_used_data":2892,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297500,"statfs":{"total":96636764160,"available":96560640000,"internally_reserved":0,"allocated":2961408,"data_stored":1706799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542322,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73776,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298064,"statfs":{"total":96636764160,"available":96561217536,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51572,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320268,"statfs":{"total":96636764160,"available":96583954432,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73772,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298068,"statfs":{"total":96636764160,"available":96561221632,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542323,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73692,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298148,"statfs":{"total":96636764160,"available":96561303552,"internally_reserved":0,"allocated":2367488,"data_stored":1116431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73772,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298068,"statfs":{"total":96636764160,"available":96561221632,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542325,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47408,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324432,"statfs":{"total":96636764160,"available":96588218368,"internally_reserved":0,"allocated":2379776,"data_stored":1123098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542322,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78508,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293332,"statfs":{"total":96636764160,"available":96556371968,"internally_reserved":0,"allocated":2973696,"data_stored":1713466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:47:48.567 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:47:48.567+0000 7f20f829e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:47:51.568 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:47:51.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f2987126640 1 Processor -- start 2024-09-19T05:47:51.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f2987126640 1 -- start start 2024-09-19T05:47:51.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f2987126640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2980161da0 0x7f29800d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:51.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f2987126640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29800d0e80 0x7f29800d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:51.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f2987126640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f29800b41c0 0x7f29800b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:51.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f2987126640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f29800d0840 con 0x7f29800d0e80 2024-09-19T05:47:51.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f2987126640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f29800d1800 con 0x7f29800b41c0 2024-09-19T05:47:51.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f2987126640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f29800d4d40 con 0x7f2980161da0 2024-09-19T05:47:51.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f297ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29800d0e80 0x7f29800d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:51.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f297ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29800d0e80 0x7f29800d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59940/0 (socket says 172.21.15.67:59940) 2024-09-19T05:47:51.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f297ffff640 1 -- 172.21.15.67:0/2932134513 learned_addr learned my addr 172.21.15.67:0/2932134513 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:51.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f29856c3640 1 --2- 172.21.15.67:0/2932134513 >> v2:172.21.15.97:3300/0 conn(0x7f29800b41c0 0x7f29800b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:51.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f2984ec2640 1 --2- 172.21.15.67:0/2932134513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2980161da0 0x7f29800d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:51.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f297ffff640 1 -- 172.21.15.67:0/2932134513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2980161da0 msgr2=0x7f29800d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:51.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f297ffff640 1 --2- 172.21.15.67:0/2932134513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2980161da0 0x7f29800d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f297ffff640 1 -- 172.21.15.67:0/2932134513 >> v2:172.21.15.97:3300/0 conn(0x7f29800b41c0 msgr2=0x7f29800b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:51.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f297ffff640 1 --2- 172.21.15.67:0/2932134513 >> v2:172.21.15.97:3300/0 conn(0x7f29800b41c0 0x7f29800b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.706+0000 7f297ffff640 1 -- 172.21.15.67:0/2932134513 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29800d5020 con 0x7f29800d0e80 2024-09-19T05:47:51.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f297ffff640 1 --2- 172.21.15.67:0/2932134513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 0x7f29800d12c0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f298008e7c0 tx=0x7f297401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514e87f230457bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:51.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f297f7fe640 1 -- 172.21.15.67:0/2932134513 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29740b1070 con 0x7f29800d0e80 2024-09-19T05:47:51.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f297f7fe640 1 -- 172.21.15.67:0/2932134513 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29740ac630 con 0x7f29800d0e80 2024-09-19T05:47:51.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f297f7fe640 1 -- 172.21.15.67:0/2932134513 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29740a8050 con 0x7f29800d0e80 2024-09-19T05:47:51.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 -- 172.21.15.67:0/2932134513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 msgr2=0x7f29800d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:51.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 --2- 172.21.15.67:0/2932134513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 0x7f29800d12c0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f298008e7c0 tx=0x7f297401c520 comp rx=0 tx=0).stop 2024-09-19T05:47:51.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 -- 172.21.15.67:0/2932134513 shutdown_connections 2024-09-19T05:47:51.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 --2- 172.21.15.67:0/2932134513 >> v2:172.21.15.97:3300/0 conn(0x7f29800b41c0 0x7f29800b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 --2- 172.21.15.67:0/2932134513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 0x7f29800d12c0 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 --2- 172.21.15.67:0/2932134513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2980161da0 0x7f29800d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 -- 172.21.15.67:0/2932134513 >> 172.21.15.67:0/2932134513 conn(0x7f298008bfc0 msgr2=0x7f29800d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:51.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 -- 172.21.15.67:0/2932134513 shutdown_connections 2024-09-19T05:47:51.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 -- 172.21.15.67:0/2932134513 wait complete. 2024-09-19T05:47:51.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 Processor -- start 2024-09-19T05:47:51.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.710+0000 7f2987126640 1 -- start start 2024-09-19T05:47:51.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2987126640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29800b41c0 0x7f298006e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:51.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2987126640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 0x7f298015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:51.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2987126640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2980161da0 0x7f29800cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:51.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2987126640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f29800cf150 con 0x7f29800d0e80 2024-09-19T05:47:51.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2987126640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2980162180 con 0x7f2980161da0 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2987126640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f29800cf2d0 con 0x7f29800b41c0 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 0x7f298015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 0x7f298015d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59946/0 (socket says 172.21.15.67:59946) 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297ffff640 1 -- 172.21.15.67:0/1317662612 learned_addr learned my addr 172.21.15.67:0/1317662612 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2984ec2640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29800b41c0 0x7f298006e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f29856c3640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2980161da0 0x7f29800cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297ffff640 1 -- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29800b41c0 msgr2=0x7f298006e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297ffff640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29800b41c0 0x7f298006e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297ffff640 1 -- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2980161da0 msgr2=0x7f29800cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297ffff640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2980161da0 0x7f29800cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297ffff640 1 -- 172.21.15.67:0/1317662612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2980155da0 con 0x7f29800d0e80 2024-09-19T05:47:51.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297ffff640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 0x7f298015d020 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f29740af040 tx=0x7f29740192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:51.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297d7fa640 1 -- 172.21.15.67:0/1317662612 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29740bc070 con 0x7f29800d0e80 2024-09-19T05:47:51.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297d7fa640 1 -- 172.21.15.67:0/1317662612 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29740ab5e0 con 0x7f29800d0e80 2024-09-19T05:47:51.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2987126640 1 -- 172.21.15.67:0/1317662612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298006ebe0 con 0x7f29800d0e80 2024-09-19T05:47:51.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297d7fa640 1 -- 172.21.15.67:0/1317662612 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29740b1070 con 0x7f29800d0e80 2024-09-19T05:47:51.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2987126640 1 -- 172.21.15.67:0/1317662612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29800cc930 con 0x7f29800d0e80 2024-09-19T05:47:51.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2987126640 1 -- 172.21.15.67:0/1317662612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29800d12c0 con 0x7f29800d0e80 2024-09-19T05:47:51.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297d7fa640 1 -- 172.21.15.67:0/1317662612 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29740bf070 con 0x7f29800d0e80 2024-09-19T05:47:51.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297d7fa640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f296c0678c0 0x7f296c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:51.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f297d7fa640 1 -- 172.21.15.67:0/1317662612 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f297411f850 con 0x7f29800d0e80 2024-09-19T05:47:51.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.714+0000 7f2984ec2640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f296c0678c0 0x7f296c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:51.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.718+0000 7f2984ec2640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f296c0678c0 0x7f296c069d80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f297000b930 tx=0x7f2970008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:51.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.718+0000 7f297d7fa640 1 -- 172.21.15.67:0/1317662612 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2974016110 con 0x7f29800d0e80 2024-09-19T05:47:51.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.878+0000 7f2987126640 1 -- 172.21.15.67:0/1317662612 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29800d1a20 con 0x7f296c0678c0 2024-09-19T05:47:51.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.898+0000 7f297d7fa640 1 -- 172.21.15.67:0/1317662612 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252502 (secure 0 0 0) 0x7f29800d1a20 con 0x7f296c0678c0 2024-09-19T05:47:51.900 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:51.902 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:47:51.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 -- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f296c0678c0 msgr2=0x7f296c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:51.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f296c0678c0 0x7f296c069d80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f297000b930 tx=0x7f2970008040 comp rx=0 tx=0).stop 2024-09-19T05:47:51.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 -- 172.21.15.67:0/1317662612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 msgr2=0x7f298015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:51.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 0x7f298015d020 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f29740af040 tx=0x7f29740192c0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 -- 172.21.15.67:0/1317662612 shutdown_connections 2024-09-19T05:47:51.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2980161da0 0x7f29800cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29800d0e80 0x7f298015d020 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f296c0678c0 0x7f296c069d80 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 --2- 172.21.15.67:0/1317662612 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29800b41c0 0x7f298006e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:51.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 -- 172.21.15.67:0/1317662612 >> 172.21.15.67:0/1317662612 conn(0x7f298008bfc0 msgr2=0x7f298006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:51.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 -- 172.21.15.67:0/1317662612 shutdown_connections 2024-09-19T05:47:51.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:51.902+0000 7f2987126640 1 -- 172.21.15.67:0/1317662612 wait complete. 2024-09-19T05:47:51.917 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":629,"stamp":"2024-09-19T05:47:51.414324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":547108,"kb_used_data":20008,"kb_used_omap":12,"kb_used_meta":526899,"kb_avail":754427612,"statfs":{"total":773094113280,"available":772533874688,"internally_reserved":0,"allocated":20488192,"data_stored":10281212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":539545137},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":53,"apply_latency_ms":53,"commit_latency_ns":53000000,"apply_latency_ns":53000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.488855"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.983729+0000","last_change":"2024-09-19T05:47:42.983590+0000","last_active":"2024-09-19T05:47:43.983729+0000","last_peered":"2024-09-19T05:47:43.983729+0000","last_clean":"2024-09-19T05:47:43.983729+0000","last_became_active":"2024-09-19T05:47:42.982739+0000","last_became_peered":"2024-09-19T05:47:42.982739+0000","last_unstale":"2024-09-19T05:47:43.983729+0000","last_undegraded":"2024-09-19T05:47:43.983729+0000","last_fullsized":"2024-09-19T05:47:43.983729+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:14.353694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.963246+0000","last_change":"2024-09-19T05:47:42.995204+0000","last_active":"2024-09-19T05:47:43.963246+0000","last_peered":"2024-09-19T05:47:43.963246+0000","last_clean":"2024-09-19T05:47:43.963246+0000","last_became_active":"2024-09-19T05:47:42.994892+0000","last_became_peered":"2024-09-19T05:47:42.994892+0000","last_unstale":"2024-09-19T05:47:43.963246+0000","last_undegraded":"2024-09-19T05:47:43.963246+0000","last_fullsized":"2024-09-19T05:47:43.963246+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:52.369481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.976545+0000","last_change":"2024-09-19T05:47:42.991633+0000","last_active":"2024-09-19T05:47:43.976545+0000","last_peered":"2024-09-19T05:47:43.976545+0000","last_clean":"2024-09-19T05:47:43.976545+0000","last_became_active":"2024-09-19T05:47:42.991199+0000","last_became_peered":"2024-09-19T05:47:42.991199+0000","last_unstale":"2024-09-19T05:47:43.976545+0000","last_undegraded":"2024-09-19T05:47:43.976545+0000","last_fullsized":"2024-09-19T05:47:43.976545+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:06.358492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982989+0000","last_change":"2024-09-19T05:47:42.990697+0000","last_active":"2024-09-19T05:47:43.982989+0000","last_peered":"2024-09-19T05:47:43.982989+0000","last_clean":"2024-09-19T05:47:43.982989+0000","last_became_active":"2024-09-19T05:47:42.990047+0000","last_became_peered":"2024-09-19T05:47:42.990047+0000","last_unstale":"2024-09-19T05:47:43.982989+0000","last_undegraded":"2024-09-19T05:47:43.982989+0000","last_fullsized":"2024-09-19T05:47:43.982989+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:28.246872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981499+0000","last_change":"2024-09-19T05:47:42.951987+0000","last_active":"2024-09-19T05:47:43.981499+0000","last_peered":"2024-09-19T05:47:43.981499+0000","last_clean":"2024-09-19T05:47:43.981499+0000","last_became_active":"2024-09-19T05:47:42.951239+0000","last_became_peered":"2024-09-19T05:47:42.951239+0000","last_unstale":"2024-09-19T05:47:43.981499+0000","last_undegraded":"2024-09-19T05:47:43.981499+0000","last_fullsized":"2024-09-19T05:47:43.981499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.939694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981673+0000","last_change":"2024-09-19T05:47:42.955508+0000","last_active":"2024-09-19T05:47:43.981673+0000","last_peered":"2024-09-19T05:47:43.981673+0000","last_clean":"2024-09-19T05:47:43.981673+0000","last_became_active":"2024-09-19T05:47:42.954816+0000","last_became_peered":"2024-09-19T05:47:42.954816+0000","last_unstale":"2024-09-19T05:47:43.981673+0000","last_undegraded":"2024-09-19T05:47:43.981673+0000","last_fullsized":"2024-09-19T05:47:43.981673+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:56.778562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.980936+0000","last_change":"2024-09-19T05:47:42.960320+0000","last_active":"2024-09-19T05:47:43.980936+0000","last_peered":"2024-09-19T05:47:43.980936+0000","last_clean":"2024-09-19T05:47:43.980936+0000","last_became_active":"2024-09-19T05:47:42.959569+0000","last_became_peered":"2024-09-19T05:47:42.959569+0000","last_unstale":"2024-09-19T05:47:43.980936+0000","last_undegraded":"2024-09-19T05:47:43.980936+0000","last_fullsized":"2024-09-19T05:47:43.980936+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:01.694396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.971177+0000","last_change":"2024-09-19T05:47:42.965129+0000","last_active":"2024-09-19T05:47:43.971177+0000","last_peered":"2024-09-19T05:47:43.971177+0000","last_clean":"2024-09-19T05:47:43.971177+0000","last_became_active":"2024-09-19T05:47:42.964276+0000","last_became_peered":"2024-09-19T05:47:42.964276+0000","last_unstale":"2024-09-19T05:47:43.971177+0000","last_undegraded":"2024-09-19T05:47:43.971177+0000","last_fullsized":"2024-09-19T05:47:43.971177+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:09.937303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966887+0000","last_change":"2024-09-19T05:47:42.980627+0000","last_active":"2024-09-19T05:47:43.966887+0000","last_peered":"2024-09-19T05:47:43.966887+0000","last_clean":"2024-09-19T05:47:43.966887+0000","last_became_active":"2024-09-19T05:47:42.980335+0000","last_became_peered":"2024-09-19T05:47:42.980335+0000","last_unstale":"2024-09-19T05:47:43.966887+0000","last_undegraded":"2024-09-19T05:47:43.966887+0000","last_fullsized":"2024-09-19T05:47:43.966887+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:44.324818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.972173+0000","last_change":"2024-09-19T05:47:42.973900+0000","last_active":"2024-09-19T05:47:43.972173+0000","last_peered":"2024-09-19T05:47:43.972173+0000","last_clean":"2024-09-19T05:47:43.972173+0000","last_became_active":"2024-09-19T05:47:42.973195+0000","last_became_peered":"2024-09-19T05:47:42.973195+0000","last_unstale":"2024-09-19T05:47:43.972173+0000","last_undegraded":"2024-09-19T05:47:43.972173+0000","last_fullsized":"2024-09-19T05:47:43.972173+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:24.585540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.976545+0000","last_change":"2024-09-19T05:47:42.966485+0000","last_active":"2024-09-19T05:47:43.976545+0000","last_peered":"2024-09-19T05:47:43.976545+0000","last_clean":"2024-09-19T05:47:43.976545+0000","last_became_active":"2024-09-19T05:47:42.965852+0000","last_became_peered":"2024-09-19T05:47:42.965852+0000","last_unstale":"2024-09-19T05:47:43.976545+0000","last_undegraded":"2024-09-19T05:47:43.976545+0000","last_fullsized":"2024-09-19T05:47:43.976545+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:22:51.946400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981096+0000","last_change":"2024-09-19T05:47:42.959802+0000","last_active":"2024-09-19T05:47:43.981096+0000","last_peered":"2024-09-19T05:47:43.981096+0000","last_clean":"2024-09-19T05:47:43.981096+0000","last_became_active":"2024-09-19T05:47:42.959369+0000","last_became_peered":"2024-09-19T05:47:42.959369+0000","last_unstale":"2024-09-19T05:47:43.981096+0000","last_undegraded":"2024-09-19T05:47:43.981096+0000","last_fullsized":"2024-09-19T05:47:43.981096+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:43.997663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982371+0000","last_change":"2024-09-19T05:47:42.969535+0000","last_active":"2024-09-19T05:47:43.982371+0000","last_peered":"2024-09-19T05:47:43.982371+0000","last_clean":"2024-09-19T05:47:43.982371+0000","last_became_active":"2024-09-19T05:47:42.968606+0000","last_became_peered":"2024-09-19T05:47:42.968606+0000","last_unstale":"2024-09-19T05:47:43.982371+0000","last_undegraded":"2024-09-19T05:47:43.982371+0000","last_fullsized":"2024-09-19T05:47:43.982371+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:25.255670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.971394+0000","last_change":"2024-09-19T05:47:42.985598+0000","last_active":"2024-09-19T05:47:43.971394+0000","last_peered":"2024-09-19T05:47:43.971394+0000","last_clean":"2024-09-19T05:47:43.971394+0000","last_became_active":"2024-09-19T05:47:42.985018+0000","last_became_peered":"2024-09-19T05:47:42.985018+0000","last_unstale":"2024-09-19T05:47:43.971394+0000","last_undegraded":"2024-09-19T05:47:43.971394+0000","last_fullsized":"2024-09-19T05:47:43.971394+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:16.980627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966760+0000","last_change":"2024-09-19T05:47:42.961798+0000","last_active":"2024-09-19T05:47:43.966760+0000","last_peered":"2024-09-19T05:47:43.966760+0000","last_clean":"2024-09-19T05:47:43.966760+0000","last_became_active":"2024-09-19T05:47:42.960862+0000","last_became_peered":"2024-09-19T05:47:42.960862+0000","last_unstale":"2024-09-19T05:47:43.966760+0000","last_undegraded":"2024-09-19T05:47:43.966760+0000","last_fullsized":"2024-09-19T05:47:43.966760+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:20.014389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.976260+0000","last_change":"2024-09-19T05:47:42.955617+0000","last_active":"2024-09-19T05:47:43.976260+0000","last_peered":"2024-09-19T05:47:43.976260+0000","last_clean":"2024-09-19T05:47:43.976260+0000","last_became_active":"2024-09-19T05:47:42.954825+0000","last_became_peered":"2024-09-19T05:47:42.954825+0000","last_unstale":"2024-09-19T05:47:43.976260+0000","last_undegraded":"2024-09-19T05:47:43.976260+0000","last_fullsized":"2024-09-19T05:47:43.976260+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:28.246872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.967002+0000","last_change":"2024-09-19T05:47:42.966673+0000","last_active":"2024-09-19T05:47:43.967002+0000","last_peered":"2024-09-19T05:47:43.967002+0000","last_clean":"2024-09-19T05:47:43.967002+0000","last_became_active":"2024-09-19T05:47:42.966256+0000","last_became_peered":"2024-09-19T05:47:42.966256+0000","last_unstale":"2024-09-19T05:47:43.967002+0000","last_undegraded":"2024-09-19T05:47:43.967002+0000","last_fullsized":"2024-09-19T05:47:43.967002+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:31.465653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966812+0000","last_change":"2024-09-19T05:47:42.955886+0000","last_active":"2024-09-19T05:47:43.966812+0000","last_peered":"2024-09-19T05:47:43.966812+0000","last_clean":"2024-09-19T05:47:43.966812+0000","last_became_active":"2024-09-19T05:47:42.955005+0000","last_became_peered":"2024-09-19T05:47:42.955005+0000","last_unstale":"2024-09-19T05:47:43.966812+0000","last_undegraded":"2024-09-19T05:47:43.966812+0000","last_fullsized":"2024-09-19T05:47:43.966812+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:50.426500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.972472+0000","last_change":"2024-09-19T05:47:42.959105+0000","last_active":"2024-09-19T05:47:43.972472+0000","last_peered":"2024-09-19T05:47:43.972472+0000","last_clean":"2024-09-19T05:47:43.972472+0000","last_became_active":"2024-09-19T05:47:42.958310+0000","last_became_peered":"2024-09-19T05:47:42.958310+0000","last_unstale":"2024-09-19T05:47:43.972472+0000","last_undegraded":"2024-09-19T05:47:43.972472+0000","last_fullsized":"2024-09-19T05:47:43.972472+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:51.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.972720+0000","last_change":"2024-09-19T05:47:42.959457+0000","last_active":"2024-09-19T05:47:43.972720+0000","last_peered":"2024-09-19T05:47:43.972720+0000","last_clean":"2024-09-19T05:47:43.972720+0000","last_became_active":"2024-09-19T05:47:42.958697+0000","last_became_peered":"2024-09-19T05:47:42.958697+0000","last_unstale":"2024-09-19T05:47:43.972720+0000","last_undegraded":"2024-09-19T05:47:43.972720+0000","last_fullsized":"2024-09-19T05:47:43.972720+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:31.797287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.973400+0000","last_change":"2024-09-19T05:47:42.980195+0000","last_active":"2024-09-19T05:47:43.973400+0000","last_peered":"2024-09-19T05:47:43.973400+0000","last_clean":"2024-09-19T05:47:43.973400+0000","last_became_active":"2024-09-19T05:47:42.973313+0000","last_became_peered":"2024-09-19T05:47:42.973313+0000","last_unstale":"2024-09-19T05:47:43.973400+0000","last_undegraded":"2024-09-19T05:47:43.973400+0000","last_fullsized":"2024-09-19T05:47:43.973400+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:30.292926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.971753+0000","last_change":"2024-09-19T05:47:42.986002+0000","last_active":"2024-09-19T05:47:43.971753+0000","last_peered":"2024-09-19T05:47:43.971753+0000","last_clean":"2024-09-19T05:47:43.971753+0000","last_became_active":"2024-09-19T05:47:42.985355+0000","last_became_peered":"2024-09-19T05:47:42.985355+0000","last_unstale":"2024-09-19T05:47:43.971753+0000","last_undegraded":"2024-09-19T05:47:43.971753+0000","last_fullsized":"2024-09-19T05:47:43.971753+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:19.194579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.962604+0000","last_change":"2024-09-19T05:47:42.981992+0000","last_active":"2024-09-19T05:47:43.962604+0000","last_peered":"2024-09-19T05:47:43.962604+0000","last_clean":"2024-09-19T05:47:43.962604+0000","last_became_active":"2024-09-19T05:47:42.981778+0000","last_became_peered":"2024-09-19T05:47:42.981778+0000","last_unstale":"2024-09-19T05:47:43.962604+0000","last_undegraded":"2024-09-19T05:47:43.962604+0000","last_fullsized":"2024-09-19T05:47:43.962604+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:24.589685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.980852+0000","last_change":"2024-09-19T05:47:42.958711+0000","last_active":"2024-09-19T05:47:43.980852+0000","last_peered":"2024-09-19T05:47:43.980852+0000","last_clean":"2024-09-19T05:47:43.980852+0000","last_became_active":"2024-09-19T05:47:42.951754+0000","last_became_peered":"2024-09-19T05:47:42.951754+0000","last_unstale":"2024-09-19T05:47:43.980852+0000","last_undegraded":"2024-09-19T05:47:43.980852+0000","last_fullsized":"2024-09-19T05:47:43.980852+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:32:57.964331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.967108+0000","last_change":"2024-09-19T05:47:42.960418+0000","last_active":"2024-09-19T05:47:43.967108+0000","last_peered":"2024-09-19T05:47:43.967108+0000","last_clean":"2024-09-19T05:47:43.967108+0000","last_became_active":"2024-09-19T05:47:42.957033+0000","last_became_peered":"2024-09-19T05:47:42.957033+0000","last_unstale":"2024-09-19T05:47:43.967108+0000","last_undegraded":"2024-09-19T05:47:43.967108+0000","last_fullsized":"2024-09-19T05:47:43.967108+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:36:53.010339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.983982+0000","last_change":"2024-09-19T05:47:42.981379+0000","last_active":"2024-09-19T05:47:43.983982+0000","last_peered":"2024-09-19T05:47:43.983982+0000","last_clean":"2024-09-19T05:47:43.983982+0000","last_became_active":"2024-09-19T05:47:42.980004+0000","last_became_peered":"2024-09-19T05:47:42.980004+0000","last_unstale":"2024-09-19T05:47:43.983982+0000","last_undegraded":"2024-09-19T05:47:43.983982+0000","last_fullsized":"2024-09-19T05:47:43.983982+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:25.551739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.976749+0000","last_change":"2024-09-19T05:47:42.965833+0000","last_active":"2024-09-19T05:47:43.976749+0000","last_peered":"2024-09-19T05:47:43.976749+0000","last_clean":"2024-09-19T05:47:43.976749+0000","last_became_active":"2024-09-19T05:47:42.965534+0000","last_became_peered":"2024-09-19T05:47:42.965534+0000","last_unstale":"2024-09-19T05:47:43.976749+0000","last_undegraded":"2024-09-19T05:47:43.976749+0000","last_fullsized":"2024-09-19T05:47:43.976749+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:15.023827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981261+0000","last_change":"2024-09-19T05:47:42.992642+0000","last_active":"2024-09-19T05:47:43.981261+0000","last_peered":"2024-09-19T05:47:43.981261+0000","last_clean":"2024-09-19T05:47:43.981261+0000","last_became_active":"2024-09-19T05:47:42.992304+0000","last_became_peered":"2024-09-19T05:47:42.992304+0000","last_unstale":"2024-09-19T05:47:43.981261+0000","last_undegraded":"2024-09-19T05:47:43.981261+0000","last_fullsized":"2024-09-19T05:47:43.981261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:50.467908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966647+0000","last_change":"2024-09-19T05:47:42.960362+0000","last_active":"2024-09-19T05:47:43.966647+0000","last_peered":"2024-09-19T05:47:43.966647+0000","last_clean":"2024-09-19T05:47:43.966647+0000","last_became_active":"2024-09-19T05:47:42.955802+0000","last_became_peered":"2024-09-19T05:47:42.955802+0000","last_unstale":"2024-09-19T05:47:43.966647+0000","last_undegraded":"2024-09-19T05:47:43.966647+0000","last_fullsized":"2024-09-19T05:47:43.966647+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:09.592178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966800+0000","last_change":"2024-09-19T05:47:42.946906+0000","last_active":"2024-09-19T05:47:43.966800+0000","last_peered":"2024-09-19T05:47:43.966800+0000","last_clean":"2024-09-19T05:47:43.966800+0000","last_became_active":"2024-09-19T05:47:42.946130+0000","last_became_peered":"2024-09-19T05:47:42.946130+0000","last_unstale":"2024-09-19T05:47:43.966800+0000","last_undegraded":"2024-09-19T05:47:43.966800+0000","last_fullsized":"2024-09-19T05:47:43.966800+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:51.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981621+0000","last_change":"2024-09-19T05:47:42.971883+0000","last_active":"2024-09-19T05:47:43.981621+0000","last_peered":"2024-09-19T05:47:43.981621+0000","last_clean":"2024-09-19T05:47:43.981621+0000","last_became_active":"2024-09-19T05:47:42.971189+0000","last_became_peered":"2024-09-19T05:47:42.971189+0000","last_unstale":"2024-09-19T05:47:43.981621+0000","last_undegraded":"2024-09-19T05:47:43.981621+0000","last_fullsized":"2024-09-19T05:47:43.981621+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:33.965737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981516+0000","last_change":"2024-09-19T05:47:42.968900+0000","last_active":"2024-09-19T05:47:43.981516+0000","last_peered":"2024-09-19T05:47:43.981516+0000","last_clean":"2024-09-19T05:47:43.981516+0000","last_became_active":"2024-09-19T05:47:42.967991+0000","last_became_peered":"2024-09-19T05:47:42.967991+0000","last_unstale":"2024-09-19T05:47:43.981516+0000","last_undegraded":"2024-09-19T05:47:43.981516+0000","last_fullsized":"2024-09-19T05:47:43.981516+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:27.634759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.962593+0000","last_change":"2024-09-19T05:47:42.980008+0000","last_active":"2024-09-19T05:47:43.962593+0000","last_peered":"2024-09-19T05:47:43.962593+0000","last_clean":"2024-09-19T05:47:43.962593+0000","last_became_active":"2024-09-19T05:47:42.979786+0000","last_became_peered":"2024-09-19T05:47:42.979786+0000","last_unstale":"2024-09-19T05:47:43.962593+0000","last_undegraded":"2024-09-19T05:47:43.962593+0000","last_fullsized":"2024-09-19T05:47:43.962593+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:55.769310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.967400+0000","last_change":"2024-09-19T05:47:41.972348+0000","last_active":"2024-09-19T05:47:43.967400+0000","last_peered":"2024-09-19T05:47:43.967400+0000","last_clean":"2024-09-19T05:47:43.967400+0000","last_became_active":"2024-09-19T05:47:41.971855+0000","last_became_peered":"2024-09-19T05:47:41.971855+0000","last_unstale":"2024-09-19T05:47:43.967400+0000","last_undegraded":"2024-09-19T05:47:43.967400+0000","last_fullsized":"2024-09-19T05:47:43.967400+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:02.422066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982227+0000","last_change":"2024-09-19T05:47:42.962957+0000","last_active":"2024-09-19T05:47:43.982227+0000","last_peered":"2024-09-19T05:47:43.982227+0000","last_clean":"2024-09-19T05:47:43.982227+0000","last_became_active":"2024-09-19T05:47:42.962158+0000","last_became_peered":"2024-09-19T05:47:42.962158+0000","last_unstale":"2024-09-19T05:47:43.982227+0000","last_undegraded":"2024-09-19T05:47:43.982227+0000","last_fullsized":"2024-09-19T05:47:43.982227+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:09:58.166192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.983889+0000","last_change":"2024-09-19T05:47:41.955701+0000","last_active":"2024-09-19T05:47:43.983889+0000","last_peered":"2024-09-19T05:47:43.983889+0000","last_clean":"2024-09-19T05:47:43.983889+0000","last_became_active":"2024-09-19T05:47:41.953352+0000","last_became_peered":"2024-09-19T05:47:41.953352+0000","last_unstale":"2024-09-19T05:47:43.983889+0000","last_undegraded":"2024-09-19T05:47:43.983889+0000","last_fullsized":"2024-09-19T05:47:43.983889+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:35.795960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.972185+0000","last_change":"2024-09-19T05:47:42.963774+0000","last_active":"2024-09-19T05:47:43.972185+0000","last_peered":"2024-09-19T05:47:43.972185+0000","last_clean":"2024-09-19T05:47:43.972185+0000","last_became_active":"2024-09-19T05:47:42.962927+0000","last_became_peered":"2024-09-19T05:47:42.962927+0000","last_unstale":"2024-09-19T05:47:43.972185+0000","last_undegraded":"2024-09-19T05:47:43.972185+0000","last_fullsized":"2024-09-19T05:47:43.972185+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:20.014389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.962991+0000","last_change":"2024-09-19T05:47:41.944967+0000","last_active":"2024-09-19T05:47:43.962991+0000","last_peered":"2024-09-19T05:47:43.962991+0000","last_clean":"2024-09-19T05:47:43.962991+0000","last_became_active":"2024-09-19T05:47:41.944696+0000","last_became_peered":"2024-09-19T05:47:41.944696+0000","last_unstale":"2024-09-19T05:47:43.962991+0000","last_undegraded":"2024-09-19T05:47:43.962991+0000","last_fullsized":"2024-09-19T05:47:43.962991+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:49.421914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981087+0000","last_change":"2024-09-19T05:47:42.958475+0000","last_active":"2024-09-19T05:47:43.981087+0000","last_peered":"2024-09-19T05:47:43.981087+0000","last_clean":"2024-09-19T05:47:43.981087+0000","last_became_active":"2024-09-19T05:47:42.950225+0000","last_became_peered":"2024-09-19T05:47:42.950225+0000","last_unstale":"2024-09-19T05:47:43.981087+0000","last_undegraded":"2024-09-19T05:47:43.981087+0000","last_fullsized":"2024-09-19T05:47:43.981087+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:55.821240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966782+0000","last_change":"2024-09-19T05:47:41.969151+0000","last_active":"2024-09-19T05:47:43.966782+0000","last_peered":"2024-09-19T05:47:43.966782+0000","last_clean":"2024-09-19T05:47:43.966782+0000","last_became_active":"2024-09-19T05:47:41.968800+0000","last_became_peered":"2024-09-19T05:47:41.968800+0000","last_unstale":"2024-09-19T05:47:43.966782+0000","last_undegraded":"2024-09-19T05:47:43.966782+0000","last_fullsized":"2024-09-19T05:47:43.966782+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:27.242286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.967135+0000","last_change":"2024-09-19T05:47:42.947217+0000","last_active":"2024-09-19T05:47:43.967135+0000","last_peered":"2024-09-19T05:47:43.967135+0000","last_clean":"2024-09-19T05:47:43.967135+0000","last_became_active":"2024-09-19T05:47:42.946464+0000","last_became_peered":"2024-09-19T05:47:42.946464+0000","last_unstale":"2024-09-19T05:47:43.967135+0000","last_undegraded":"2024-09-19T05:47:43.967135+0000","last_fullsized":"2024-09-19T05:47:43.967135+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:18.210805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982540+0000","last_change":"2024-09-19T05:47:41.970704+0000","last_active":"2024-09-19T05:47:43.982540+0000","last_peered":"2024-09-19T05:47:43.982540+0000","last_clean":"2024-09-19T05:47:43.982540+0000","last_became_active":"2024-09-19T05:47:41.970086+0000","last_became_peered":"2024-09-19T05:47:41.970086+0000","last_unstale":"2024-09-19T05:47:43.982540+0000","last_undegraded":"2024-09-19T05:47:43.982540+0000","last_fullsized":"2024-09-19T05:47:43.982540+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:34.383706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966886+0000","last_change":"2024-09-19T05:47:42.946834+0000","last_active":"2024-09-19T05:47:43.966886+0000","last_peered":"2024-09-19T05:47:43.966886+0000","last_clean":"2024-09-19T05:47:43.966886+0000","last_became_active":"2024-09-19T05:47:42.946097+0000","last_became_peered":"2024-09-19T05:47:42.946097+0000","last_unstale":"2024-09-19T05:47:43.966886+0000","last_undegraded":"2024-09-19T05:47:43.966886+0000","last_fullsized":"2024-09-19T05:47:43.966886+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:31.797287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981888+0000","last_change":"2024-09-19T05:47:41.970568+0000","last_active":"2024-09-19T05:47:43.981888+0000","last_peered":"2024-09-19T05:47:43.981888+0000","last_clean":"2024-09-19T05:47:43.981888+0000","last_became_active":"2024-09-19T05:47:41.970029+0000","last_became_peered":"2024-09-19T05:47:41.970029+0000","last_unstale":"2024-09-19T05:47:43.981888+0000","last_undegraded":"2024-09-19T05:47:43.981888+0000","last_fullsized":"2024-09-19T05:47:43.981888+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:57.866131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.967210+0000","last_change":"2024-09-19T05:47:42.956321+0000","last_active":"2024-09-19T05:47:43.967210+0000","last_peered":"2024-09-19T05:47:43.967210+0000","last_clean":"2024-09-19T05:47:43.967210+0000","last_became_active":"2024-09-19T05:47:42.955638+0000","last_became_peered":"2024-09-19T05:47:42.955638+0000","last_unstale":"2024-09-19T05:47:43.967210+0000","last_undegraded":"2024-09-19T05:47:43.967210+0000","last_fullsized":"2024-09-19T05:47:43.967210+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:21.386896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.976299+0000","last_change":"2024-09-19T05:47:41.963677+0000","last_active":"2024-09-19T05:47:43.976299+0000","last_peered":"2024-09-19T05:47:43.976299+0000","last_clean":"2024-09-19T05:47:43.976299+0000","last_became_active":"2024-09-19T05:47:41.963381+0000","last_became_peered":"2024-09-19T05:47:41.963381+0000","last_unstale":"2024-09-19T05:47:43.976299+0000","last_undegraded":"2024-09-19T05:47:43.976299+0000","last_fullsized":"2024-09-19T05:47:43.976299+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:43.673298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966263+0000","last_change":"2024-09-19T05:47:42.951079+0000","last_active":"2024-09-19T05:47:43.966263+0000","last_peered":"2024-09-19T05:47:43.966263+0000","last_clean":"2024-09-19T05:47:43.966263+0000","last_became_active":"2024-09-19T05:47:42.950178+0000","last_became_peered":"2024-09-19T05:47:42.950178+0000","last_unstale":"2024-09-19T05:47:43.966263+0000","last_undegraded":"2024-09-19T05:47:43.966263+0000","last_fullsized":"2024-09-19T05:47:43.966263+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:24.585540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981388+0000","last_change":"2024-09-19T05:47:41.959230+0000","last_active":"2024-09-19T05:47:43.981388+0000","last_peered":"2024-09-19T05:47:43.981388+0000","last_clean":"2024-09-19T05:47:43.981388+0000","last_became_active":"2024-09-19T05:47:41.958352+0000","last_became_peered":"2024-09-19T05:47:41.958352+0000","last_unstale":"2024-09-19T05:47:43.981388+0000","last_undegraded":"2024-09-19T05:47:43.981388+0000","last_fullsized":"2024-09-19T05:47:43.981388+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:49.178372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.976874+0000","last_change":"2024-09-19T05:47:42.950174+0000","last_active":"2024-09-19T05:47:43.976874+0000","last_peered":"2024-09-19T05:47:43.976874+0000","last_clean":"2024-09-19T05:47:43.976874+0000","last_became_active":"2024-09-19T05:47:42.949382+0000","last_became_peered":"2024-09-19T05:47:42.949382+0000","last_unstale":"2024-09-19T05:47:43.976874+0000","last_undegraded":"2024-09-19T05:47:43.976874+0000","last_fullsized":"2024-09-19T05:47:43.976874+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:13.716168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.983423+0000","last_change":"2024-09-19T05:47:41.977216+0000","last_active":"2024-09-19T05:47:43.983423+0000","last_peered":"2024-09-19T05:47:43.983423+0000","last_clean":"2024-09-19T05:47:43.983423+0000","last_became_active":"2024-09-19T05:47:41.976763+0000","last_became_peered":"2024-09-19T05:47:41.976763+0000","last_unstale":"2024-09-19T05:47:43.983423+0000","last_undegraded":"2024-09-19T05:47:43.983423+0000","last_fullsized":"2024-09-19T05:47:43.983423+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:36.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966504+0000","last_change":"2024-09-19T05:47:42.950212+0000","last_active":"2024-09-19T05:47:43.966504+0000","last_peered":"2024-09-19T05:47:43.966504+0000","last_clean":"2024-09-19T05:47:43.966504+0000","last_became_active":"2024-09-19T05:47:42.949377+0000","last_became_peered":"2024-09-19T05:47:42.949377+0000","last_unstale":"2024-09-19T05:47:43.966504+0000","last_undegraded":"2024-09-19T05:47:43.966504+0000","last_fullsized":"2024-09-19T05:47:43.966504+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:45.679258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"190'3","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966874+0000","last_change":"2024-09-19T05:47:41.954229+0000","last_active":"2024-09-19T05:47:43.966874+0000","last_peered":"2024-09-19T05:47:43.966874+0000","last_clean":"2024-09-19T05:47:43.966874+0000","last_became_active":"2024-09-19T05:47:41.953798+0000","last_became_peered":"2024-09-19T05:47:41.953798+0000","last_unstale":"2024-09-19T05:47:43.966874+0000","last_undegraded":"2024-09-19T05:47:43.966874+0000","last_fullsized":"2024-09-19T05:47:43.966874+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:32.961151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981288+0000","last_change":"2024-09-19T05:47:42.963440+0000","last_active":"2024-09-19T05:47:43.981288+0000","last_peered":"2024-09-19T05:47:43.981288+0000","last_clean":"2024-09-19T05:47:43.981288+0000","last_became_active":"2024-09-19T05:47:42.962912+0000","last_became_peered":"2024-09-19T05:47:42.962912+0000","last_unstale":"2024-09-19T05:47:43.981288+0000","last_undegraded":"2024-09-19T05:47:43.981288+0000","last_fullsized":"2024-09-19T05:47:43.981288+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:24.165317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"190'6","reported_seq":20,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.983149+0000","last_change":"2024-09-19T05:47:41.972755+0000","last_active":"2024-09-19T05:47:43.983149+0000","last_peered":"2024-09-19T05:47:43.983149+0000","last_clean":"2024-09-19T05:47:43.983149+0000","last_became_active":"2024-09-19T05:47:41.972124+0000","last_became_peered":"2024-09-19T05:47:41.972124+0000","last_unstale":"2024-09-19T05:47:43.983149+0000","last_undegraded":"2024-09-19T05:47:43.983149+0000","last_fullsized":"2024-09-19T05:47:43.983149+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:45.661609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.963043+0000","last_change":"2024-09-19T05:47:42.964464+0000","last_active":"2024-09-19T05:47:43.963043+0000","last_peered":"2024-09-19T05:47:43.963043+0000","last_clean":"2024-09-19T05:47:43.963043+0000","last_became_active":"2024-09-19T05:47:42.963737+0000","last_became_peered":"2024-09-19T05:47:42.963737+0000","last_unstale":"2024-09-19T05:47:43.963043+0000","last_undegraded":"2024-09-19T05:47:43.963043+0000","last_fullsized":"2024-09-19T05:47:43.963043+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:01:44.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.962915+0000","last_change":"2024-09-19T05:47:41.954745+0000","last_active":"2024-09-19T05:47:43.962915+0000","last_peered":"2024-09-19T05:47:43.962915+0000","last_clean":"2024-09-19T05:47:43.962915+0000","last_became_active":"2024-09-19T05:47:41.954279+0000","last_became_peered":"2024-09-19T05:47:41.954279+0000","last_unstale":"2024-09-19T05:47:43.962915+0000","last_undegraded":"2024-09-19T05:47:43.962915+0000","last_fullsized":"2024-09-19T05:47:43.962915+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:49.850894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.976750+0000","last_change":"2024-09-19T05:47:42.954817+0000","last_active":"2024-09-19T05:47:43.976750+0000","last_peered":"2024-09-19T05:47:43.976750+0000","last_clean":"2024-09-19T05:47:43.976750+0000","last_became_active":"2024-09-19T05:47:42.953992+0000","last_became_peered":"2024-09-19T05:47:42.953992+0000","last_unstale":"2024-09-19T05:47:43.976750+0000","last_undegraded":"2024-09-19T05:47:43.976750+0000","last_fullsized":"2024-09-19T05:47:43.976750+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:23.023859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.976399+0000","last_change":"2024-09-19T05:47:41.956777+0000","last_active":"2024-09-19T05:47:43.976399+0000","last_peered":"2024-09-19T05:47:43.976399+0000","last_clean":"2024-09-19T05:47:43.976399+0000","last_became_active":"2024-09-19T05:47:41.956381+0000","last_became_peered":"2024-09-19T05:47:41.956381+0000","last_unstale":"2024-09-19T05:47:43.976399+0000","last_undegraded":"2024-09-19T05:47:43.976399+0000","last_fullsized":"2024-09-19T05:47:43.976399+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:30.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.967076+0000","last_change":"2024-09-19T05:47:42.956556+0000","last_active":"2024-09-19T05:47:43.967076+0000","last_peered":"2024-09-19T05:47:43.967076+0000","last_clean":"2024-09-19T05:47:43.967076+0000","last_became_active":"2024-09-19T05:47:42.953740+0000","last_became_peered":"2024-09-19T05:47:42.953740+0000","last_unstale":"2024-09-19T05:47:43.967076+0000","last_undegraded":"2024-09-19T05:47:43.967076+0000","last_fullsized":"2024-09-19T05:47:43.967076+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:11.626426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966407+0000","last_change":"2024-09-19T05:47:41.959689+0000","last_active":"2024-09-19T05:47:43.966407+0000","last_peered":"2024-09-19T05:47:43.966407+0000","last_clean":"2024-09-19T05:47:43.966407+0000","last_became_active":"2024-09-19T05:47:41.959337+0000","last_became_peered":"2024-09-19T05:47:41.959337+0000","last_unstale":"2024-09-19T05:47:43.966407+0000","last_undegraded":"2024-09-19T05:47:43.966407+0000","last_fullsized":"2024-09-19T05:47:43.966407+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:01.017730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.983694+0000","last_change":"2024-09-19T05:47:42.996372+0000","last_active":"2024-09-19T05:47:43.983694+0000","last_peered":"2024-09-19T05:47:43.983694+0000","last_clean":"2024-09-19T05:47:43.983694+0000","last_became_active":"2024-09-19T05:47:42.995727+0000","last_became_peered":"2024-09-19T05:47:42.995727+0000","last_unstale":"2024-09-19T05:47:43.983694+0000","last_undegraded":"2024-09-19T05:47:43.983694+0000","last_fullsized":"2024-09-19T05:47:43.983694+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:23.023859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":22,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.980788+0000","last_change":"2024-09-19T05:47:41.967000+0000","last_active":"2024-09-19T05:47:43.980788+0000","last_peered":"2024-09-19T05:47:43.980788+0000","last_clean":"2024-09-19T05:47:43.980788+0000","last_became_active":"2024-09-19T05:47:41.966638+0000","last_became_peered":"2024-09-19T05:47:41.966638+0000","last_unstale":"2024-09-19T05:47:43.980788+0000","last_undegraded":"2024-09-19T05:47:43.980788+0000","last_fullsized":"2024-09-19T05:47:43.980788+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:50.713173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.973870+0000","last_change":"2024-09-19T05:47:42.973897+0000","last_active":"2024-09-19T05:47:43.973870+0000","last_peered":"2024-09-19T05:47:43.973870+0000","last_clean":"2024-09-19T05:47:43.973870+0000","last_became_active":"2024-09-19T05:47:42.973010+0000","last_became_peered":"2024-09-19T05:47:42.973010+0000","last_unstale":"2024-09-19T05:47:43.973870+0000","last_undegraded":"2024-09-19T05:47:43.973870+0000","last_fullsized":"2024-09-19T05:47:43.973870+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:50.801062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.983953+0000","last_change":"2024-09-19T05:47:41.963785+0000","last_active":"2024-09-19T05:47:43.983953+0000","last_peered":"2024-09-19T05:47:43.983953+0000","last_clean":"2024-09-19T05:47:43.983953+0000","last_became_active":"2024-09-19T05:47:41.963188+0000","last_became_peered":"2024-09-19T05:47:41.963188+0000","last_unstale":"2024-09-19T05:47:43.983953+0000","last_undegraded":"2024-09-19T05:47:43.983953+0000","last_fullsized":"2024-09-19T05:47:43.983953+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:48.319903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982454+0000","last_change":"2024-09-19T05:47:42.971122+0000","last_active":"2024-09-19T05:47:43.982454+0000","last_peered":"2024-09-19T05:47:43.982454+0000","last_clean":"2024-09-19T05:47:43.982454+0000","last_became_active":"2024-09-19T05:47:42.968707+0000","last_became_peered":"2024-09-19T05:47:42.968707+0000","last_unstale":"2024-09-19T05:47:43.982454+0000","last_undegraded":"2024-09-19T05:47:43.982454+0000","last_fullsized":"2024-09-19T05:47:43.982454+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:41.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.984075+0000","last_change":"2024-09-19T05:47:41.966113+0000","last_active":"2024-09-19T05:47:43.984075+0000","last_peered":"2024-09-19T05:47:43.984075+0000","last_clean":"2024-09-19T05:47:43.984075+0000","last_became_active":"2024-09-19T05:47:41.965410+0000","last_became_peered":"2024-09-19T05:47:41.965410+0000","last_unstale":"2024-09-19T05:47:43.984075+0000","last_undegraded":"2024-09-19T05:47:43.984075+0000","last_fullsized":"2024-09-19T05:47:43.984075+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:43.684509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982933+0000","last_change":"2024-09-19T05:47:42.969277+0000","last_active":"2024-09-19T05:47:43.982933+0000","last_peered":"2024-09-19T05:47:43.982933+0000","last_clean":"2024-09-19T05:47:43.982933+0000","last_became_active":"2024-09-19T05:47:42.968511+0000","last_became_peered":"2024-09-19T05:47:42.968511+0000","last_unstale":"2024-09-19T05:47:43.982933+0000","last_undegraded":"2024-09-19T05:47:43.982933+0000","last_fullsized":"2024-09-19T05:47:43.982933+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:04.513766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.963042+0000","last_change":"2024-09-19T05:47:41.962814+0000","last_active":"2024-09-19T05:47:43.963042+0000","last_peered":"2024-09-19T05:47:43.963042+0000","last_clean":"2024-09-19T05:47:43.963042+0000","last_became_active":"2024-09-19T05:47:41.962547+0000","last_became_peered":"2024-09-19T05:47:41.962547+0000","last_unstale":"2024-09-19T05:47:43.963042+0000","last_undegraded":"2024-09-19T05:47:43.963042+0000","last_fullsized":"2024-09-19T05:47:43.963042+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:43.320232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.972873+0000","last_change":"2024-09-19T05:47:42.992091+0000","last_active":"2024-09-19T05:47:43.972873+0000","last_peered":"2024-09-19T05:47:43.972873+0000","last_clean":"2024-09-19T05:47:43.972873+0000","last_became_active":"2024-09-19T05:47:42.991367+0000","last_became_peered":"2024-09-19T05:47:42.991367+0000","last_unstale":"2024-09-19T05:47:43.972873+0000","last_undegraded":"2024-09-19T05:47:43.972873+0000","last_fullsized":"2024-09-19T05:47:43.972873+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:18.210805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981207+0000","last_change":"2024-09-19T05:47:41.962422+0000","last_active":"2024-09-19T05:47:43.981207+0000","last_peered":"2024-09-19T05:47:43.981207+0000","last_clean":"2024-09-19T05:47:43.981207+0000","last_became_active":"2024-09-19T05:47:41.962067+0000","last_became_peered":"2024-09-19T05:47:41.962067+0000","last_unstale":"2024-09-19T05:47:43.981207+0000","last_undegraded":"2024-09-19T05:47:43.981207+0000","last_fullsized":"2024-09-19T05:47:43.981207+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:59.905359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.963440+0000","last_change":"2024-09-19T05:47:42.992863+0000","last_active":"2024-09-19T05:47:43.963440+0000","last_peered":"2024-09-19T05:47:43.963440+0000","last_clean":"2024-09-19T05:47:43.963440+0000","last_became_active":"2024-09-19T05:47:42.992087+0000","last_became_peered":"2024-09-19T05:47:42.992087+0000","last_unstale":"2024-09-19T05:47:43.963440+0000","last_undegraded":"2024-09-19T05:47:43.963440+0000","last_fullsized":"2024-09-19T05:47:43.963440+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:16.391739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981391+0000","last_change":"2024-09-19T05:47:41.957647+0000","last_active":"2024-09-19T05:47:43.981391+0000","last_peered":"2024-09-19T05:47:43.981391+0000","last_clean":"2024-09-19T05:47:43.981391+0000","last_became_active":"2024-09-19T05:47:41.957340+0000","last_became_peered":"2024-09-19T05:47:41.957340+0000","last_unstale":"2024-09-19T05:47:43.981391+0000","last_undegraded":"2024-09-19T05:47:43.981391+0000","last_fullsized":"2024-09-19T05:47:43.981391+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:49.406585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.983186+0000","last_change":"2024-09-19T05:47:42.993347+0000","last_active":"2024-09-19T05:47:43.983186+0000","last_peered":"2024-09-19T05:47:43.983186+0000","last_clean":"2024-09-19T05:47:43.983186+0000","last_became_active":"2024-09-19T05:47:42.992108+0000","last_became_peered":"2024-09-19T05:47:42.992108+0000","last_unstale":"2024-09-19T05:47:43.983186+0000","last_undegraded":"2024-09-19T05:47:43.983186+0000","last_fullsized":"2024-09-19T05:47:43.983186+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:22:51.946400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.962848+0000","last_change":"2024-09-19T05:47:41.956446+0000","last_active":"2024-09-19T05:47:43.962848+0000","last_peered":"2024-09-19T05:47:43.962848+0000","last_clean":"2024-09-19T05:47:43.962848+0000","last_became_active":"2024-09-19T05:47:41.956016+0000","last_became_peered":"2024-09-19T05:47:41.956016+0000","last_unstale":"2024-09-19T05:47:43.962848+0000","last_undegraded":"2024-09-19T05:47:43.962848+0000","last_fullsized":"2024-09-19T05:47:43.962848+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:08.587592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966981+0000","last_change":"2024-09-19T05:47:42.991561+0000","last_active":"2024-09-19T05:47:43.966981+0000","last_peered":"2024-09-19T05:47:43.966981+0000","last_clean":"2024-09-19T05:47:43.966981+0000","last_became_active":"2024-09-19T05:47:42.991191+0000","last_became_peered":"2024-09-19T05:47:42.991191+0000","last_unstale":"2024-09-19T05:47:43.966981+0000","last_undegraded":"2024-09-19T05:47:43.966981+0000","last_fullsized":"2024-09-19T05:47:43.966981+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:22:16.422295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.967714+0000","last_change":"2024-09-19T05:47:41.967485+0000","last_active":"2024-09-19T05:47:43.967714+0000","last_peered":"2024-09-19T05:47:43.967714+0000","last_clean":"2024-09-19T05:47:43.967714+0000","last_became_active":"2024-09-19T05:47:41.966573+0000","last_became_peered":"2024-09-19T05:47:41.966573+0000","last_unstale":"2024-09-19T05:47:43.967714+0000","last_undegraded":"2024-09-19T05:47:43.967714+0000","last_fullsized":"2024-09-19T05:47:43.967714+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:12.952477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.973970+0000","last_change":"2024-09-19T05:47:42.965072+0000","last_active":"2024-09-19T05:47:43.973970+0000","last_peered":"2024-09-19T05:47:43.973970+0000","last_clean":"2024-09-19T05:47:43.973970+0000","last_became_active":"2024-09-19T05:47:42.964314+0000","last_became_peered":"2024-09-19T05:47:42.964314+0000","last_unstale":"2024-09-19T05:47:43.973970+0000","last_undegraded":"2024-09-19T05:47:43.973970+0000","last_fullsized":"2024-09-19T05:47:43.973970+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:35.992363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982099+0000","last_change":"2024-09-19T05:47:41.958616+0000","last_active":"2024-09-19T05:47:43.982099+0000","last_peered":"2024-09-19T05:47:43.982099+0000","last_clean":"2024-09-19T05:47:43.982099+0000","last_became_active":"2024-09-19T05:47:41.958118+0000","last_became_peered":"2024-09-19T05:47:41.958118+0000","last_unstale":"2024-09-19T05:47:43.982099+0000","last_undegraded":"2024-09-19T05:47:43.982099+0000","last_fullsized":"2024-09-19T05:47:43.982099+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:03.477111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.971744+0000","last_change":"2024-09-19T05:47:42.974722+0000","last_active":"2024-09-19T05:47:43.971744+0000","last_peered":"2024-09-19T05:47:43.971744+0000","last_clean":"2024-09-19T05:47:43.971744+0000","last_became_active":"2024-09-19T05:47:42.973660+0000","last_became_peered":"2024-09-19T05:47:42.973660+0000","last_unstale":"2024-09-19T05:47:43.971744+0000","last_undegraded":"2024-09-19T05:47:43.971744+0000","last_fullsized":"2024-09-19T05:47:43.971744+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:03.259456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.967279+0000","last_change":"2024-09-19T05:47:41.972593+0000","last_active":"2024-09-19T05:47:43.967279+0000","last_peered":"2024-09-19T05:47:43.967279+0000","last_clean":"2024-09-19T05:47:43.967279+0000","last_became_active":"2024-09-19T05:47:41.972351+0000","last_became_peered":"2024-09-19T05:47:41.972351+0000","last_unstale":"2024-09-19T05:47:43.967279+0000","last_undegraded":"2024-09-19T05:47:43.967279+0000","last_fullsized":"2024-09-19T05:47:43.967279+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:05.353906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.977221+0000","last_change":"2024-09-19T05:47:42.965203+0000","last_active":"2024-09-19T05:47:43.977221+0000","last_peered":"2024-09-19T05:47:43.977221+0000","last_clean":"2024-09-19T05:47:43.977221+0000","last_became_active":"2024-09-19T05:47:42.964787+0000","last_became_peered":"2024-09-19T05:47:42.964787+0000","last_unstale":"2024-09-19T05:47:43.977221+0000","last_undegraded":"2024-09-19T05:47:43.977221+0000","last_fullsized":"2024-09-19T05:47:43.977221+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:01.196944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"191'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.972080+0000","last_change":"2024-09-19T05:47:41.961283+0000","last_active":"2024-09-19T05:47:43.972080+0000","last_peered":"2024-09-19T05:47:43.972080+0000","last_clean":"2024-09-19T05:47:43.972080+0000","last_became_active":"2024-09-19T05:47:41.960599+0000","last_became_peered":"2024-09-19T05:47:41.960599+0000","last_unstale":"2024-09-19T05:47:43.972080+0000","last_undegraded":"2024-09-19T05:47:43.972080+0000","last_fullsized":"2024-09-19T05:47:43.972080+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:30.295303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966521+0000","last_change":"2024-09-19T05:47:42.954505+0000","last_active":"2024-09-19T05:47:43.966521+0000","last_peered":"2024-09-19T05:47:43.966521+0000","last_clean":"2024-09-19T05:47:43.966521+0000","last_became_active":"2024-09-19T05:47:42.953386+0000","last_became_peered":"2024-09-19T05:47:42.953386+0000","last_unstale":"2024-09-19T05:47:43.966521+0000","last_undegraded":"2024-09-19T05:47:43.966521+0000","last_fullsized":"2024-09-19T05:47:43.966521+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:50.855480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966998+0000","last_change":"2024-09-19T05:47:41.961093+0000","last_active":"2024-09-19T05:47:43.966998+0000","last_peered":"2024-09-19T05:47:43.966998+0000","last_clean":"2024-09-19T05:47:43.966998+0000","last_became_active":"2024-09-19T05:47:41.954232+0000","last_became_peered":"2024-09-19T05:47:41.954232+0000","last_unstale":"2024-09-19T05:47:43.966998+0000","last_undegraded":"2024-09-19T05:47:43.966998+0000","last_fullsized":"2024-09-19T05:47:43.966998+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:52.829733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982371+0000","last_change":"2024-09-19T05:47:42.993243+0000","last_active":"2024-09-19T05:47:43.982371+0000","last_peered":"2024-09-19T05:47:43.982371+0000","last_clean":"2024-09-19T05:47:43.982371+0000","last_became_active":"2024-09-19T05:47:42.992649+0000","last_became_peered":"2024-09-19T05:47:42.992649+0000","last_unstale":"2024-09-19T05:47:43.982371+0000","last_undegraded":"2024-09-19T05:47:43.982371+0000","last_fullsized":"2024-09-19T05:47:43.982371+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:47.268449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982834+0000","last_change":"2024-09-19T05:47:41.956832+0000","last_active":"2024-09-19T05:47:43.982834+0000","last_peered":"2024-09-19T05:47:43.982834+0000","last_clean":"2024-09-19T05:47:43.982834+0000","last_became_active":"2024-09-19T05:47:41.956161+0000","last_became_peered":"2024-09-19T05:47:41.956161+0000","last_unstale":"2024-09-19T05:47:43.982834+0000","last_undegraded":"2024-09-19T05:47:43.982834+0000","last_fullsized":"2024-09-19T05:47:43.982834+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:29.330158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.973004+0000","last_change":"2024-09-19T05:47:42.967571+0000","last_active":"2024-09-19T05:47:43.973004+0000","last_peered":"2024-09-19T05:47:43.973004+0000","last_clean":"2024-09-19T05:47:43.973004+0000","last_became_active":"2024-09-19T05:47:42.966847+0000","last_became_peered":"2024-09-19T05:47:42.966847+0000","last_unstale":"2024-09-19T05:47:43.973004+0000","last_undegraded":"2024-09-19T05:47:43.973004+0000","last_fullsized":"2024-09-19T05:47:43.973004+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:57.135116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.973115+0000","last_change":"2024-09-19T05:47:41.961628+0000","last_active":"2024-09-19T05:47:43.973115+0000","last_peered":"2024-09-19T05:47:43.973115+0000","last_clean":"2024-09-19T05:47:43.973115+0000","last_became_active":"2024-09-19T05:47:41.961017+0000","last_became_peered":"2024-09-19T05:47:41.961017+0000","last_unstale":"2024-09-19T05:47:43.973115+0000","last_undegraded":"2024-09-19T05:47:43.973115+0000","last_fullsized":"2024-09-19T05:47:43.973115+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:14.586225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.983398+0000","last_change":"2024-09-19T05:47:42.992771+0000","last_active":"2024-09-19T05:47:43.983398+0000","last_peered":"2024-09-19T05:47:43.983398+0000","last_clean":"2024-09-19T05:47:43.983398+0000","last_became_active":"2024-09-19T05:47:42.991343+0000","last_became_peered":"2024-09-19T05:47:42.991343+0000","last_unstale":"2024-09-19T05:47:43.983398+0000","last_undegraded":"2024-09-19T05:47:43.983398+0000","last_fullsized":"2024-09-19T05:47:43.983398+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:15.023827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966690+0000","last_change":"2024-09-19T05:47:41.969077+0000","last_active":"2024-09-19T05:47:43.966690+0000","last_peered":"2024-09-19T05:47:43.966690+0000","last_clean":"2024-09-19T05:47:43.966690+0000","last_became_active":"2024-09-19T05:47:41.968721+0000","last_became_peered":"2024-09-19T05:47:41.968721+0000","last_unstale":"2024-09-19T05:47:43.966690+0000","last_undegraded":"2024-09-19T05:47:43.966690+0000","last_fullsized":"2024-09-19T05:47:43.966690+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:24.251084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.983172+0000","last_change":"2024-09-19T05:47:42.992291+0000","last_active":"2024-09-19T05:47:43.983172+0000","last_peered":"2024-09-19T05:47:43.983172+0000","last_clean":"2024-09-19T05:47:43.983172+0000","last_became_active":"2024-09-19T05:47:42.991691+0000","last_became_peered":"2024-09-19T05:47:42.991691+0000","last_unstale":"2024-09-19T05:47:43.983172+0000","last_undegraded":"2024-09-19T05:47:43.983172+0000","last_fullsized":"2024-09-19T05:47:43.983172+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:06.358492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982583+0000","last_change":"2024-09-19T05:47:41.958286+0000","last_active":"2024-09-19T05:47:43.982583+0000","last_peered":"2024-09-19T05:47:43.982583+0000","last_clean":"2024-09-19T05:47:43.982583+0000","last_became_active":"2024-09-19T05:47:41.957781+0000","last_became_peered":"2024-09-19T05:47:41.957781+0000","last_unstale":"2024-09-19T05:47:43.982583+0000","last_undegraded":"2024-09-19T05:47:43.982583+0000","last_fullsized":"2024-09-19T05:47:43.982583+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:38.042168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.976751+0000","last_change":"2024-09-19T05:47:42.966542+0000","last_active":"2024-09-19T05:47:43.976751+0000","last_peered":"2024-09-19T05:47:43.976751+0000","last_clean":"2024-09-19T05:47:43.976751+0000","last_became_active":"2024-09-19T05:47:42.966259+0000","last_became_peered":"2024-09-19T05:47:42.966259+0000","last_unstale":"2024-09-19T05:47:43.976751+0000","last_undegraded":"2024-09-19T05:47:43.976751+0000","last_fullsized":"2024-09-19T05:47:43.976751+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:19.131754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.980972+0000","last_change":"2024-09-19T05:47:41.959238+0000","last_active":"2024-09-19T05:47:43.980972+0000","last_peered":"2024-09-19T05:47:43.980972+0000","last_clean":"2024-09-19T05:47:43.980972+0000","last_became_active":"2024-09-19T05:47:41.958803+0000","last_became_peered":"2024-09-19T05:47:41.958803+0000","last_unstale":"2024-09-19T05:47:43.980972+0000","last_undegraded":"2024-09-19T05:47:43.980972+0000","last_fullsized":"2024-09-19T05:47:43.980972+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:42.374622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.982188+0000","last_change":"2024-09-19T05:47:42.963300+0000","last_active":"2024-09-19T05:47:43.982188+0000","last_peered":"2024-09-19T05:47:43.982188+0000","last_clean":"2024-09-19T05:47:43.982188+0000","last_became_active":"2024-09-19T05:47:42.962564+0000","last_became_peered":"2024-09-19T05:47:42.962564+0000","last_unstale":"2024-09-19T05:47:43.982188+0000","last_undegraded":"2024-09-19T05:47:43.982188+0000","last_fullsized":"2024-09-19T05:47:43.982188+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:41.918933+0000","last_clean_scrub_stamp":"2024-09-19T05:47:41.918933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.677897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.966590+0000","last_change":"2024-09-19T05:47:41.953928+0000","last_active":"2024-09-19T05:47:43.966590+0000","last_peered":"2024-09-19T05:47:43.966590+0000","last_clean":"2024-09-19T05:47:43.966590+0000","last_became_active":"2024-09-19T05:47:41.953597+0000","last_became_peered":"2024-09-19T05:47:41.953597+0000","last_unstale":"2024-09-19T05:47:43.966590+0000","last_undegraded":"2024-09-19T05:47:43.966590+0000","last_fullsized":"2024-09-19T05:47:43.966590+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:47:40.914347+0000","last_clean_scrub_stamp":"2024-09-19T05:47:40.914347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:26.630173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":480,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-19T05:47:43.981592+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:47:43.981592+0000","last_peered":"2024-09-19T05:47:43.981592+0000","last_clean":"2024-09-19T05:47:43.981592+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:47:43.981592+0000","last_undegraded":"2024-09-19T05:47:43.981592+0000","last_fullsized":"2024-09-19T05:47:43.981592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542323,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74392,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297448,"statfs":{"total":96636764160,"available":96560586752,"internally_reserved":0,"allocated":3014656,"data_stored":1729007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542323,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73812,"kb_used_data":2364,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298028,"statfs":{"total":96636764160,"available":96561180672,"internally_reserved":0,"allocated":2420736,"data_stored":1139151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542325,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51596,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320244,"statfs":{"total":96636764160,"available":96583929856,"internally_reserved":0,"allocated":2412544,"data_stored":1137013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542323,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73796,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298044,"statfs":{"total":96636764160,"available":96561197056,"internally_reserved":0,"allocated":2408448,"data_stored":1137539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542324,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73744,"kb_used_data":2360,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298096,"statfs":{"total":96636764160,"available":96561250304,"internally_reserved":0,"allocated":2416640,"data_stored":1137083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542324,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73796,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298044,"statfs":{"total":96636764160,"available":96561197056,"internally_reserved":0,"allocated":2408448,"data_stored":1137047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542326,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47428,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324412,"statfs":{"total":96636764160,"available":96588197888,"internally_reserved":0,"allocated":2404352,"data_stored":1136957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542323,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78544,"kb_used_data":2932,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293296,"statfs":{"total":96636764160,"available":96556335104,"internally_reserved":0,"allocated":3002368,"data_stored":1727415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:47:51.921 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:47:51.921 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:47:52.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.082+0000 7f392da10640 1 Processor -- start 2024-09-19T05:47:52.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.082+0000 7f392da10640 1 -- start start 2024-09-19T05:47:52.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f392da10640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392815c2b0 0x7f39280d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f392da10640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3928067a00 0x7f392806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f392da10640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3928067fa0 con 0x7f392806d210 2024-09-19T05:47:52.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f392da10640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f39280b4200 con 0x7f3928067a00 2024-09-19T05:47:52.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f392da10640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f39280b3bb0 con 0x7f392815c2b0 2024-09-19T05:47:52.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39277fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f392806d210 0x7f392815fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46560/0 (socket says 172.21.15.67:46560) 2024-09-19T05:47:52.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39277fe640 1 -- 172.21.15.67:0/1753766820 learned_addr learned my addr 172.21.15.67:0/1753766820 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:52.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f3926ffd640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392815c2b0 0x7f39280d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618154701 0 0) 0x7f3928067fa0 con 0x7f392806d210 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f391ffff640 1 --2- 172.21.15.67:0/1753766820 >> v2:172.21.15.97:3300/0 conn(0x7f3928067a00 0x7f392806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3914003530 con 0x7f392806d210 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1518062409 0 0) 0x7f3914003530 con 0x7f392806d210 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392815c2b0 msgr2=0x7f39280d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392815c2b0 0x7f39280d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 >> v2:172.21.15.97:3300/0 conn(0x7f3928067a00 msgr2=0x7f392806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 --2- 172.21.15.67:0/1753766820 >> v2:172.21.15.97:3300/0 conn(0x7f3928067a00 0x7f392806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39280b3e90 con 0x7f392806d210 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3920001a00 con 0x7f392806d210 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 >> v1:172.21.15.67:6789/0 conn(0x7f392806d210 legacy=0x7f392815fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39140039c0 0x7f3914003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 0x7f3914004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392815c2b0 0x7f39140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f39280b4200 con 0x7f3914004810 2024-09-19T05:47:52.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f39280b3bb0 con 0x7f39140039c0 2024-09-19T05:47:52.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f391400b9d0 con 0x7f392815c2b0 2024-09-19T05:47:52.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f391ffff640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 0x7f3914004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f3926ffd640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39140039c0 0x7f3914003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f391ffff640 1 -- 172.21.15.67:0/1753766820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392815c2b0 msgr2=0x7f39140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:52.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f391ffff640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392815c2b0 0x7f39140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f391ffff640 1 -- 172.21.15.67:0/1753766820 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39140039c0 msgr2=0x7f3914003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:52.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f391ffff640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39140039c0 0x7f3914003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f391ffff640 1 -- 172.21.15.67:0/1753766820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3914003530 con 0x7f3914004810 2024-09-19T05:47:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.086+0000 7f391ffff640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 0x7f3914004c90 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f3918009ab0 tx=0x7f391801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4016de17ba4381a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39180b2070 con 0x7f3914004810 2024-09-19T05:47:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39180a55a0 con 0x7f3914004810 2024-09-19T05:47:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f39267fc640 1 -- 172.21.15.67:0/1753766820 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39180096b0 con 0x7f3914004810 2024-09-19T05:47:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- 172.21.15.67:0/1753766820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 msgr2=0x7f3914004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 --2- 172.21.15.67:0/1753766820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 0x7f3914004c90 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f3918009ab0 tx=0x7f391801ca90 comp rx=0 tx=0).stop 2024-09-19T05:47:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f39277fe640 1 -- 172.21.15.67:0/1753766820 reap_dead start 2024-09-19T05:47:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- 172.21.15.67:0/1753766820 shutdown_connections 2024-09-19T05:47:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- 172.21.15.67:0/1753766820 >> 172.21.15.67:0/1753766820 conn(0x7f39280727b0 msgr2=0x7f3928072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- 172.21.15.67:0/1753766820 shutdown_connections 2024-09-19T05:47:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- 172.21.15.67:0/1753766820 wait complete. 2024-09-19T05:47:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 Processor -- start 2024-09-19T05:47:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- start start 2024-09-19T05:47:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 0x7f392806f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f392814cd70 0x7f392806f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392814d1f0 0x7f39280ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f39280d0120 con 0x7f3914004810 2024-09-19T05:47:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f39280b58f0 con 0x7f392814cd70 2024-09-19T05:47:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f39280d02a0 con 0x7f392814d1f0 2024-09-19T05:47:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3926ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 0x7f392806f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3926ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 0x7f392806f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59968/0 (socket says 172.21.15.67:59968) 2024-09-19T05:47:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3926ffd640 1 -- 172.21.15.67:0/1642860390 learned_addr learned my addr 172.21.15.67:0/1642860390 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f39277fe640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392814d1f0 0x7f39280ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f391ffff640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f392814cd70 0x7f392806f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3926ffd640 1 -- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392814d1f0 msgr2=0x7f39280ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3926ffd640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392814d1f0 0x7f39280ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3926ffd640 1 -- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f392814cd70 msgr2=0x7f392806f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3926ffd640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f392814cd70 0x7f392806f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3926ffd640 1 -- 172.21.15.67:0/1642860390 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3928150dc0 con 0x7f3914004810 2024-09-19T05:47:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f39277fe640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392814d1f0 0x7f39280ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3926ffd640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 0x7f392806f4b0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f39100115e0 tx=0x7f3910011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:52.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3924ff9640 1 -- 172.21.15.67:0/1642860390 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391000f8f0 con 0x7f3914004810 2024-09-19T05:47:52.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3924ff9640 1 -- 172.21.15.67:0/1642860390 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391000fa90 con 0x7f3914004810 2024-09-19T05:47:52.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- 172.21.15.67:0/1642860390 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39281510a0 con 0x7f3914004810 2024-09-19T05:47:52.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f3924ff9640 1 -- 172.21.15.67:0/1642860390 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391000fe40 con 0x7f3914004810 2024-09-19T05:47:52.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.090+0000 7f392da10640 1 -- 172.21.15.67:0/1642860390 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392806ef60 con 0x7f3914004810 2024-09-19T05:47:52.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.094+0000 7f392da10640 1 -- 172.21.15.67:0/1642860390 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39280d0660 con 0x7f3914004810 2024-09-19T05:47:52.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.094+0000 7f3924ff9640 1 -- 172.21.15.67:0/1642860390 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3910015460 con 0x7f3914004810 2024-09-19T05:47:52.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.094+0000 7f3924ff9640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39080678c0 0x7f3908069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.094+0000 7f3924ff9640 1 -- 172.21.15.67:0/1642860390 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f3910086740 con 0x7f3914004810 2024-09-19T05:47:52.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.094+0000 7f391ffff640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39080678c0 0x7f3908069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.094+0000 7f391ffff640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39080678c0 0x7f3908069d80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f39180af000 tx=0x7f39180046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:52.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.098+0000 7f3924ff9640 1 -- 172.21.15.67:0/1642860390 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3910019030 con 0x7f3914004810 2024-09-19T05:47:52.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.318+0000 7f392da10640 1 -- 172.21.15.67:0/1642860390 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3928072dd0 con 0x7f3914004810 2024-09-19T05:47:52.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f3924ff9640 1 -- 172.21.15.67:0/1642860390 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7f39100570f0 con 0x7f3914004810 2024-09-19T05:47:52.327 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:47:52.327 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:47:52.327 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:47:52.328 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:47:52.328 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:47:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:47:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 -- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39080678c0 msgr2=0x7f3908069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39080678c0 0x7f3908069d80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f39180af000 tx=0x7f39180046d0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 -- 172.21.15.67:0/1642860390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 msgr2=0x7f392806f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 0x7f392806f4b0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f39100115e0 tx=0x7f3910011aa0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 -- 172.21.15.67:0/1642860390 shutdown_connections 2024-09-19T05:47:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39080678c0 0x7f3908069d80 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f392814d1f0 0x7f39280ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f392814cd70 0x7f392806f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 --2- 172.21.15.67:0/1642860390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3914004810 0x7f392806f4b0 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 -- 172.21.15.67:0/1642860390 >> 172.21.15.67:0/1642860390 conn(0x7f39280727b0 msgr2=0x7f39280b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:52.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 -- 172.21.15.67:0/1642860390 shutdown_connections 2024-09-19T05:47:52.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.322+0000 7f392da10640 1 -- 172.21.15.67:0/1642860390 wait complete. 2024-09-19T05:47:52.348 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:47:52.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64fa83640 1 Processor -- start 2024-09-19T05:47:52.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64fa83640 1 -- start start 2024-09-19T05:47:52.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64fa83640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd648161da0 0x7fd6480d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64fa83640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6480d0e80 0x7fd6480d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64fa83640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6480d4d40 con 0x7fd6480b41c0 2024-09-19T05:47:52.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64fa83640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd6480d1830 con 0x7fd648161da0 2024-09-19T05:47:52.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64fa83640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd6480d0840 con 0x7fd6480d0e80 2024-09-19T05:47:52.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64d81f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd648161da0 0x7fd6480d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64d81f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd648161da0 0x7fd6480d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59972/0 (socket says 172.21.15.67:59972) 2024-09-19T05:47:52.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64d81f640 1 -- 172.21.15.67:0/677893577 learned_addr learned my addr 172.21.15.67:0/677893577 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:52.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64d01e640 1 --2- 172.21.15.67:0/677893577 >> v2:172.21.15.97:3300/0 conn(0x7fd6480d0e80 0x7fd6480d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64d81f640 1 -- 172.21.15.67:0/677893577 >> v2:172.21.15.97:3300/0 conn(0x7fd6480d0e80 msgr2=0x7fd6480d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:52.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64d81f640 1 --2- 172.21.15.67:0/677893577 >> v2:172.21.15.97:3300/0 conn(0x7fd6480d0e80 0x7fd6480d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64d81f640 1 -- 172.21.15.67:0/677893577 >> v1:172.21.15.97:6789/0 conn(0x7fd6480b41c0 legacy=0x7fd6480b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:52.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.462+0000 7fd64d81f640 1 -- 172.21.15.67:0/677893577 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6480d5020 con 0x7fd648161da0 2024-09-19T05:47:52.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64d81f640 1 --2- 172.21.15.67:0/677893577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 0x7fd6480d1af0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fd6480d4440 tx=0x7fd64401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7d51a6f30469e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:52.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64c81d640 1 -- 172.21.15.67:0/677893577 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6440ab610 con 0x7fd648161da0 2024-09-19T05:47:52.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64c81d640 1 -- 172.21.15.67:0/677893577 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6440b0070 con 0x7fd648161da0 2024-09-19T05:47:52.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64c81d640 1 -- 172.21.15.67:0/677893577 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6440ab9d0 con 0x7fd648161da0 2024-09-19T05:47:52.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64fa83640 1 -- 172.21.15.67:0/677893577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 msgr2=0x7fd6480d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64fa83640 1 --2- 172.21.15.67:0/677893577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 0x7fd6480d1af0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fd6480d4440 tx=0x7fd64401c520 comp rx=0 tx=0).stop 2024-09-19T05:47:52.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64fa83640 1 -- 172.21.15.67:0/677893577 shutdown_connections 2024-09-19T05:47:52.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64fa83640 1 --2- 172.21.15.67:0/677893577 >> v2:172.21.15.97:3300/0 conn(0x7fd6480d0e80 0x7fd6480d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64fa83640 1 --2- 172.21.15.67:0/677893577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 0x7fd6480d1af0 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64fa83640 1 -- 172.21.15.67:0/677893577 >> 172.21.15.67:0/677893577 conn(0x7fd64808bfc0 msgr2=0x7fd6480d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:52.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64fa83640 1 -- 172.21.15.67:0/677893577 shutdown_connections 2024-09-19T05:47:52.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64fa83640 1 -- 172.21.15.67:0/677893577 wait complete. 2024-09-19T05:47:52.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64fa83640 1 Processor -- start 2024-09-19T05:47:52.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.466+0000 7fd64fa83640 1 -- start start 2024-09-19T05:47:52.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64fa83640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6480b41c0 0x7fd648155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64fa83640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6480d0e80 0x7fd6480cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64fa83640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 0x7fd648153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64fa83640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd648162180 con 0x7fd648161da0 2024-09-19T05:47:52.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64fa83640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd6480b5d00 con 0x7fd6480d0e80 2024-09-19T05:47:52.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64fa83640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd64816b4f0 con 0x7fd6480b41c0 2024-09-19T05:47:52.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64e020640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 0x7fd648153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64e020640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 0x7fd648153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59978/0 (socket says 172.21.15.67:59978) 2024-09-19T05:47:52.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64e020640 1 -- 172.21.15.67:0/1948676590 learned_addr learned my addr 172.21.15.67:0/1948676590 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:52.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64d81f640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6480b41c0 0x7fd648155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64d01e640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6480d0e80 0x7fd6480cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64e020640 1 -- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6480b41c0 msgr2=0x7fd648155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64e020640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6480b41c0 0x7fd648155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64e020640 1 -- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6480d0e80 msgr2=0x7fd6480cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64e020640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6480d0e80 0x7fd6480cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64e020640 1 -- 172.21.15.67:0/1948676590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6480c7fa0 con 0x7fd648161da0 2024-09-19T05:47:52.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64e020640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 0x7fd648153670 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fd64000c6c0 tx=0x7fd64000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:52.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd63e7fc640 1 -- 172.21.15.67:0/1948676590 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640003b80 con 0x7fd648161da0 2024-09-19T05:47:52.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd63e7fc640 1 -- 172.21.15.67:0/1948676590 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd640003d20 con 0x7fd648161da0 2024-09-19T05:47:52.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd63e7fc640 1 -- 172.21.15.67:0/1948676590 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6400052f0 con 0x7fd648161da0 2024-09-19T05:47:52.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64fa83640 1 -- 172.21.15.67:0/1948676590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64815d6f0 con 0x7fd648161da0 2024-09-19T05:47:52.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64fa83640 1 -- 172.21.15.67:0/1948676590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64815dcb0 con 0x7fd648161da0 2024-09-19T05:47:52.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd64fa83640 1 -- 172.21.15.67:0/1948676590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6480d12f0 con 0x7fd648161da0 2024-09-19T05:47:52.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd63e7fc640 1 -- 172.21.15.67:0/1948676590 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd640005490 con 0x7fd648161da0 2024-09-19T05:47:52.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.470+0000 7fd63e7fc640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd62c0678c0 0x7fd62c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:52.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.474+0000 7fd63e7fc640 1 -- 172.21.15.67:0/1948676590 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fd640085d60 con 0x7fd648161da0 2024-09-19T05:47:52.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.474+0000 7fd64d81f640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd62c0678c0 0x7fd62c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:52.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.474+0000 7fd64d81f640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd62c0678c0 0x7fd62c069d80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd6440af000 tx=0x7fd6440a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:52.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.478+0000 7fd63e7fc640 1 -- 172.21.15.67:0/1948676590 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd640056680 con 0x7fd648161da0 2024-09-19T05:47:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.674+0000 7fd64fa83640 1 -- 172.21.15.67:0/1948676590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6480b6d20 con 0x7fd648161da0 2024-09-19T05:47:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.674+0000 7fd63e7fc640 1 -- 172.21.15.67:0/1948676590 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+5239 (secure 0 0 0) 0x7fd640055f80 con 0x7fd648161da0 2024-09-19T05:47:52.674 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:52.675 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":138,"btime":"2024-09-19T05:47:45:972719+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/4294715394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4294715394},{"type":"v1","addr":"172.21.15.97:6835","nonce":4294715394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":7139,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1234134657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1234134657},{"type":"v1","addr":"172.21.15.97:6837","nonce":1234134657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":10449,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2992690092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2992690092},{"type":"v1","addr":"172.21.15.67:6833","nonce":2992690092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:47:42.304037+0000","modified":"2024-09-19T05:47:45.355124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10458":{"gid":10458,"name":"c","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2221933052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2221933052},{"type":"v1","addr":"172.21.15.67:6835","nonce":2221933052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10458,"qdb_cluster":[10458]},"id":13}]} 2024-09-19T05:47:52.675 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 138 2024-09-19T05:47:52.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 -- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd62c0678c0 msgr2=0x7fd62c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd62c0678c0 0x7fd62c069d80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd6440af000 tx=0x7fd6440a7000 comp rx=0 tx=0).stop 2024-09-19T05:47:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 -- 172.21.15.67:0/1948676590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 msgr2=0x7fd648153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 0x7fd648153670 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fd64000c6c0 tx=0x7fd64000cb80 comp rx=0 tx=0).stop 2024-09-19T05:47:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 -- 172.21.15.67:0/1948676590 shutdown_connections 2024-09-19T05:47:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd648161da0 0x7fd648153670 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6480d0e80 0x7fd6480cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd62c0678c0 0x7fd62c069d80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 --2- 172.21.15.67:0/1948676590 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6480b41c0 0x7fd648155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 -- 172.21.15.67:0/1948676590 >> 172.21.15.67:0/1948676590 conn(0x7fd64808bfc0 msgr2=0x7fd6480b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 -- 172.21.15.67:0/1948676590 shutdown_connections 2024-09-19T05:47:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:52.678+0000 7fd64fa83640 1 -- 172.21.15.67:0/1948676590 wait complete. 2024-09-19T05:47:53.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 138, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:47:42.304037+0000', 'modified': '2024-09-19T05:47:45.355124+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10458}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10458': {'gid': 10458, 'name': 'c', 'rank': 0, 'incarnation': 134, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/2221933052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 2221933052}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 2221933052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10458, 'qdb_cluster': [10458]} 2024-09-19T05:47:53.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:47:53.097 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:47:53.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf34806640 1 Processor -- start 2024-09-19T05:47:53.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf34806640 1 -- start start 2024-09-19T05:47:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf34806640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbf3015b1e0 0x7fbf300b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf34806640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf30072590 0x7fbf300ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf34806640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf300b3860 con 0x7fbf300b4900 2024-09-19T05:47:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf34806640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fbf3015b5c0 con 0x7fbf3015b1e0 2024-09-19T05:47:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf34806640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbf300b3b40 con 0x7fbf30072590 2024-09-19T05:47:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbf3015b1e0 0x7fbf300b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2dd9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fbf300b4900 0x7fbf30071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:50016/0 (socket says 172.21.15.67:50016) 2024-09-19T05:47:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2ed9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf30072590 0x7fbf300ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2dd9b640 1 -- 172.21.15.67:0/1526589696 learned_addr learned my addr 172.21.15.67:0/1526589696 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2d59a640 1 -- 172.21.15.67:0/1526589696 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1504675274 0 0) 0x7fbf300b3860 con 0x7fbf300b4900 2024-09-19T05:47:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2d59a640 1 -- 172.21.15.67:0/1526589696 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf18003530 con 0x7fbf300b4900 2024-09-19T05:47:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2e59c640 1 -- 172.21.15.67:0/1526589696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf30072590 msgr2=0x7fbf300ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/1526589696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf30072590 0x7fbf300ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2e59c640 1 -- 172.21.15.67:0/1526589696 >> v1:172.21.15.97:6789/0 conn(0x7fbf300b4900 legacy=0x7fbf30071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2e59c640 1 -- 172.21.15.67:0/1526589696 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf300b3e20 con 0x7fbf3015b1e0 2024-09-19T05:47:53.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.238+0000 7fbf2ed9d640 1 --2- 172.21.15.67:0/1526589696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf30072590 0x7fbf300ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:47:53.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/1526589696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf3015b1e0 0x7fbf300b2fd0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbf200097c0 tx=0x7fbf2001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a94c3bcaf2b5d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:53.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf2d59a640 1 -- 172.21.15.67:0/1526589696 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200aa5f0 con 0x7fbf3015b1e0 2024-09-19T05:47:53.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf2d59a640 1 -- 172.21.15.67:0/1526589696 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf200af070 con 0x7fbf3015b1e0 2024-09-19T05:47:53.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf2d59a640 1 -- 172.21.15.67:0/1526589696 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200aa990 con 0x7fbf3015b1e0 2024-09-19T05:47:53.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf34806640 1 -- 172.21.15.67:0/1526589696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf3015b1e0 msgr2=0x7fbf300b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf34806640 1 --2- 172.21.15.67:0/1526589696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf3015b1e0 0x7fbf300b2fd0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbf200097c0 tx=0x7fbf2001c470 comp rx=0 tx=0).stop 2024-09-19T05:47:53.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf34806640 1 -- 172.21.15.67:0/1526589696 shutdown_connections 2024-09-19T05:47:53.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf34806640 1 --2- 172.21.15.67:0/1526589696 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf30072590 0x7fbf300ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf34806640 1 --2- 172.21.15.67:0/1526589696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf3015b1e0 0x7fbf300b2fd0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf34806640 1 -- 172.21.15.67:0/1526589696 >> 172.21.15.67:0/1526589696 conn(0x7fbf300d0080 msgr2=0x7fbf300d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf34806640 1 -- 172.21.15.67:0/1526589696 shutdown_connections 2024-09-19T05:47:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf34806640 1 -- 172.21.15.67:0/1526589696 wait complete. 2024-09-19T05:47:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.242+0000 7fbf34806640 1 Processor -- start 2024-09-19T05:47:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf34806640 1 -- start start 2024-09-19T05:47:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf34806640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf30072590 0x7fbf30073870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf34806640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf300b4900 0x7fbf300998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf34806640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf3015b1e0 0x7fbf301f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf34806640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbf301681e0 con 0x7fbf3015b1e0 2024-09-19T05:47:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf34806640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbf30168060 con 0x7fbf30072590 2024-09-19T05:47:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf34806640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbf30168360 con 0x7fbf300b4900 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf3015b1e0 0x7fbf301f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf3015b1e0 0x7fbf301f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59984/0 (socket says 172.21.15.67:59984) 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2ed9d640 1 -- 172.21.15.67:0/607369886 learned_addr learned my addr 172.21.15.67:0/607369886 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf30072590 0x7fbf30073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2dd9b640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf300b4900 0x7fbf300998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2ed9d640 1 -- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf300b4900 msgr2=0x7fbf300998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2ed9d640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf300b4900 0x7fbf300998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2ed9d640 1 -- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf30072590 msgr2=0x7fbf30073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2ed9d640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf30072590 0x7fbf30073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2ed9d640 1 -- 172.21.15.67:0/607369886 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3015c880 con 0x7fbf3015b1e0 2024-09-19T05:47:53.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf2ed9d640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf3015b1e0 0x7fbf301f5500 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009e60 tx=0x7fbf2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:53.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf1effd640 1 -- 172.21.15.67:0/607369886 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28018030 con 0x7fbf3015b1e0 2024-09-19T05:47:53.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf1effd640 1 -- 172.21.15.67:0/607369886 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2800cdf0 con 0x7fbf3015b1e0 2024-09-19T05:47:53.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf1effd640 1 -- 172.21.15.67:0/607369886 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28003bc0 con 0x7fbf3015b1e0 2024-09-19T05:47:53.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf34806640 1 -- 172.21.15.67:0/607369886 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf30157850 con 0x7fbf3015b1e0 2024-09-19T05:47:53.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf34806640 1 -- 172.21.15.67:0/607369886 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3015cb40 con 0x7fbf3015b1e0 2024-09-19T05:47:53.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.246+0000 7fbf1effd640 1 -- 172.21.15.67:0/607369886 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbf2801b070 con 0x7fbf3015b1e0 2024-09-19T05:47:53.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf1effd640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf100678c0 0x7fbf10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf1effd640 1 -- 172.21.15.67:0/607369886 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fbf28086680 con 0x7fbf3015b1e0 2024-09-19T05:47:53.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf100678c0 0x7fbf10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 Processor -- start 2024-09-19T05:47:53.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 -- start start 2024-09-19T05:47:53.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf100678c0 0x7fbf10069d80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbf200ae000 tx=0x7fbf200b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:53.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f9440 0x55f37a9aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9af290 0x55f37a9af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f37a896b60 con 0x55f37a9f8b20 2024-09-19T05:47:53.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f37a7fdc70 con 0x55f37a9f9440 2024-09-19T05:47:53.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f37a7a3ed0 con 0x55f37a9af290 2024-09-19T05:47:53.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59996/0 (socket says 172.21.15.67:59996) 2024-09-19T05:47:53.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 -- 172.21.15.67:0/2388694727 learned_addr learned my addr 172.21.15.67:0/2388694727 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:53.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2dd9b640 1 --2- 172.21.15.67:0/2388694727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f9440 0x55f37a9aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2ed9d640 1 --2- 172.21.15.67:0/2388694727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9af290 0x55f37a9af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 -- 172.21.15.67:0/2388694727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9af290 msgr2=0x55f37a9af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/2388694727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9af290 0x55f37a9af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 -- 172.21.15.67:0/2388694727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f9440 msgr2=0x55f37a9aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/2388694727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f9440 0x55f37a9aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 -- 172.21.15.67:0/2388694727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37a7b5e50 con 0x55f37a9f8b20 2024-09-19T05:47:53.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/2388694727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8f00 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fbf20000c10 tx=0x7fbf20004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f818db286f58e3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:53.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf0ffff640 1 -- 172.21.15.67:0/2388694727 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200cc070 con 0x55f37a9f8b20 2024-09-19T05:47:53.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf0ffff640 1 -- 172.21.15.67:0/2388694727 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf200af040 con 0x55f37a9f8b20 2024-09-19T05:47:53.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf0ffff640 1 -- 172.21.15.67:0/2388694727 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20003e30 con 0x55f37a9f8b20 2024-09-19T05:47:53.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 -- 172.21.15.67:0/2388694727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 msgr2=0x55f37a9f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 --2- 172.21.15.67:0/2388694727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8f00 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fbf20000c10 tx=0x7fbf20004740 comp rx=0 tx=0).stop 2024-09-19T05:47:53.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 -- 172.21.15.67:0/2388694727 shutdown_connections 2024-09-19T05:47:53.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 --2- 172.21.15.67:0/2388694727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9af290 0x55f37a9af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 --2- 172.21.15.67:0/2388694727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f9440 0x55f37a9aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 --2- 172.21.15.67:0/2388694727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8f00 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 -- 172.21.15.67:0/2388694727 >> 172.21.15.67:0/2388694727 conn(0x55f37a9b5600 msgr2=0x55f37a9ad630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:53.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 -- 172.21.15.67:0/2388694727 shutdown_connections 2024-09-19T05:47:53.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.250+0000 7fbf378c2000 1 -- 172.21.15.67:0/2388694727 wait complete. 2024-09-19T05:47:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 -- start start 2024-09-19T05:47:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 Processor -- start 2024-09-19T05:47:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9f9440 0x55f37a9b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9b4330 0x55f37a9ba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f37a85fb00 con 0x55f37a9f8b20 2024-09-19T05:47:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f37a7d8360 con 0x55f37a9b4330 2024-09-19T05:47:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f37a7d52d0 con 0x55f37a9f9440 2024-09-19T05:47:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 10 client.0 _ll_register_callbacks cb 0x55f37a99a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60006/0 (socket says 172.21.15.67:60006) 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2e59c640 1 -- 172.21.15.67:0/519556672 learned_addr learned my addr 172.21.15.67:0/519556672 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2ed9d640 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9b4330 0x55f37a9ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2dd9b640 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9f9440 0x55f37a9b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2e59c640 1 -- 172.21.15.67:0/519556672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9f9440 msgr2=0x55f37a9b9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9f9440 0x55f37a9b9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2e59c640 1 -- 172.21.15.67:0/519556672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9b4330 msgr2=0x55f37a9ba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9b4330 0x55f37a9ba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2e59c640 1 -- 172.21.15.67:0/519556672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37a7a4120 con 0x55f37a9f8b20 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2dd9b640 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9f9440 0x55f37a9b9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9b3df0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7fbf2001ab20 tx=0x7fbf2001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7721138e60417e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/519556672 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200cc040 con 0x55f37a9f8b20 2024-09-19T05:47:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/519556672 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fbf200bd9b0 con 0x55f37a9f8b20 2024-09-19T05:47:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 -- 172.21.15.67:0/519556672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf200af040 con 0x55f37a9f8b20 2024-09-19T05:47:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/519556672 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7fbf200bdbb0 con 0x55f37a9f8b20 2024-09-19T05:47:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 10 client.10590 fetch_fsmap learned FSMap version 138 2024-09-19T05:47:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 -- 172.21.15.67:0/519556672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x55f37a79d450 con 0x55f37a9f8b20 2024-09-19T05:47:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/519556672 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf200af040 con 0x55f37a9f8b20 2024-09-19T05:47:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/519556672 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7fbf200cf070 con 0x55f37a9f8b20 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 10 client.10590 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 10 client.10590 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 20 client.10590 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55f37aa07280 0x55f37aa09670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 4 client.10590 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf378c2000 1 -- 172.21.15.67:0/519556672 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f37a797c00 con 0x55f37aa07280 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2dd9b640 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55f37aa07280 0x55f37aa09670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf0d7fa640 10 client.10590 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf2dd9b640 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55f37aa07280 0x55f37aa09670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39872915cb18e0ab server_cookie=f8d9e3266e3c2e06 in_seq=0 out_seq=0 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/519556672 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f37a797c00 con 0x55f37aa07280 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.254+0000 7fbf0d7fa640 10 client.10590 handle_command_reply: tid=0 2024-09-19T05:47:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 client.10590 shutdown 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 -- 172.21.15.67:0/519556672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 msgr2=0x55f37a9b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9b3df0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7fbf2001ab20 tx=0x7fbf2001acb0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 -- 172.21.15.67:0/519556672 shutdown_connections 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55f37aa07280 0x55f37aa09670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9b4330 0x55f37a9ba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf0d7fa640 0 client.10590 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9f9440 0x55f37a9b9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 --2- 172.21.15.67:0/519556672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9b3df0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 -- 172.21.15.67:0/519556672 >> 172.21.15.67:0/519556672 conn(0x55f37a9af290 msgr2=0x55f37a9add40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 -- 172.21.15.67:0/519556672 shutdown_connections 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 1 -- 172.21.15.67:0/519556672 wait complete. 2024-09-19T05:47:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.258+0000 7fbf378c2000 20 client.10590 trim_cache size 0 max 16384 2024-09-19T05:47:53.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf378c2000 1 Processor -- start 2024-09-19T05:47:53.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf378c2000 1 -- start start 2024-09-19T05:47:53.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9b4330 0x55f37a9f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f9440 0x55f37aa09670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf378c2000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbf302013e0 con 0x55f37a9f8b20 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf378c2000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbf30150d60 con 0x55f37a9f9440 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf378c2000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbf30200d90 con 0x55f37a9b4330 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf2dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf2dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60016/0 (socket says 172.21.15.67:60016) 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.274+0000 7fbf2dd9b640 1 -- 172.21.15.67:0/2202449356 learned_addr learned my addr 172.21.15.67:0/2202449356 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2dd9b640 1 -- 172.21.15.67:0/2202449356 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9b4330 msgr2=0x55f37a9f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2dd9b640 1 --2- 172.21.15.67:0/2202449356 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9b4330 0x55f37a9f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2dd9b640 1 -- 172.21.15.67:0/2202449356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f9440 msgr2=0x55f37aa09670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2ed9d640 1 --2- 172.21.15.67:0/2202449356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f9440 0x55f37aa09670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2dd9b640 1 --2- 172.21.15.67:0/2202449356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f9440 0x55f37aa09670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2dd9b640 1 -- 172.21.15.67:0/2202449356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37a784fd0 con 0x55f37a9f8b20 2024-09-19T05:47:53.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2dd9b640 1 --2- 172.21.15.67:0/2202449356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8200 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7fbf24005890 tx=0x7fbf24000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b8559873192f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:53.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf0f7fe640 1 -- 172.21.15.67:0/2202449356 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24024070 con 0x55f37a9f8b20 2024-09-19T05:47:53.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf0f7fe640 1 -- 172.21.15.67:0/2202449356 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf24018890 con 0x55f37a9f8b20 2024-09-19T05:47:53.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf0f7fe640 1 -- 172.21.15.67:0/2202449356 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24018ca0 con 0x55f37a9f8b20 2024-09-19T05:47:53.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- 172.21.15.67:0/2202449356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 msgr2=0x55f37a9f8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 --2- 172.21.15.67:0/2202449356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8200 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7fbf24005890 tx=0x7fbf24000bd0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- 172.21.15.67:0/2202449356 shutdown_connections 2024-09-19T05:47:53.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 --2- 172.21.15.67:0/2202449356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f9440 0x55f37aa09670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 --2- 172.21.15.67:0/2202449356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f8b20 0x55f37a9f8200 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 --2- 172.21.15.67:0/2202449356 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9b4330 0x55f37a9f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- 172.21.15.67:0/2202449356 >> 172.21.15.67:0/2202449356 conn(0x55f37a9af290 msgr2=0x55f37a9b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:53.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- 172.21.15.67:0/2202449356 shutdown_connections 2024-09-19T05:47:53.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- 172.21.15.67:0/2202449356 wait complete. 2024-09-19T05:47:53.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- start start 2024-09-19T05:47:53.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 Processor -- start 2024-09-19T05:47:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9b4330 0x55f37aa0c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f8b20 0x55f37aa27960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f9440 0x55f37aa27ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f37a7fcf80 con 0x55f37a9f9440 2024-09-19T05:47:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f37a7b5ca0 con 0x55f37a9f8b20 2024-09-19T05:47:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55f37a8022a0 con 0x55f37a9b4330 2024-09-19T05:47:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 10 client.0 _ll_register_callbacks cb 0x7fbf200ca070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f9440 0x55f37aa27ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f9440 0x55f37aa27ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60030/0 (socket says 172.21.15.67:60030) 2024-09-19T05:47:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2ed9d640 1 -- 172.21.15.67:0/1985442278 learned_addr learned my addr 172.21.15.67:0/1985442278 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2dd9b640 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f8b20 0x55f37aa27960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9b4330 0x55f37aa0c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2ed9d640 1 -- 172.21.15.67:0/1985442278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9b4330 msgr2=0x55f37aa0c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2ed9d640 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9b4330 0x55f37aa0c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2ed9d640 1 -- 172.21.15.67:0/1985442278 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f8b20 msgr2=0x55f37aa27960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2ed9d640 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f8b20 0x55f37aa27960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2ed9d640 1 -- 172.21.15.67:0/1985442278 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37a880750 con 0x55f37a9f9440 2024-09-19T05:47:53.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf2ed9d640 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f9440 0x55f37aa27ea0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7fbf2805efe0 tx=0x7fbf280569e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c3473cade9953e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:53.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:53.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/1985442278 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2805f510 con 0x55f37a9f9440 2024-09-19T05:47:53.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/1985442278 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fbf28080c60 con 0x55f37a9f9440 2024-09-19T05:47:53.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- 172.21.15.67:0/1985442278 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf24018890 con 0x55f37a9f9440 2024-09-19T05:47:53.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/1985442278 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7fbf28080e60 con 0x55f37a9f9440 2024-09-19T05:47:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 10 client.10596 fetch_fsmap learned FSMap version 138 2024-09-19T05:47:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- 172.21.15.67:0/1985442278 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x55f37a78ba30 con 0x55f37a9f9440 2024-09-19T05:47:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/1985442278 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf24018890 con 0x55f37a9f9440 2024-09-19T05:47:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/1985442278 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7fbf28025060 con 0x55f37a9f9440 2024-09-19T05:47:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 10 client.10596 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:47:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 10 client.10596 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:47:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 20 client.10596 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55f37aa283e0 0x55f37aa6bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 4 client.10596 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:47:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.278+0000 7fbf378c2000 1 -- 172.21.15.67:0/1985442278 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "status"}) -- 0x55f37a80b3a0 con 0x55f37aa283e0 2024-09-19T05:47:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55f37aa283e0 0x55f37aa6bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf2e59c640 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55f37aa283e0 0x55f37aa6bc00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c8d9745f557d10 server_cookie=f5cfa2344e098ef4 in_seq=0 out_seq=0 2024-09-19T05:47:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf0d7fa640 10 client.10596 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf0d7fa640 1 -- 172.21.15.67:0/1985442278 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x55f37a80b3a0 con 0x55f37aa283e0 2024-09-19T05:47:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf0d7fa640 10 client.10596 handle_command_reply: tid=0 2024-09-19T05:47:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 client.10596 shutdown 2024-09-19T05:47:53.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 -- 172.21.15.67:0/1985442278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f9440 msgr2=0x55f37aa27ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f9440 0x55f37aa27ea0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7fbf2805efe0 tx=0x7fbf280569e0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 -- 172.21.15.67:0/1985442278 shutdown_connections 2024-09-19T05:47:53.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55f37aa283e0 0x55f37aa6bc00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f37a9f9440 0x55f37aa27ea0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f37a9f8b20 0x55f37aa27960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf0d7fa640 0 client.10596 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:53.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 --2- 172.21.15.67:0/1985442278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f37a9b4330 0x55f37aa0c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 -- 172.21.15.67:0/1985442278 >> 172.21.15.67:0/1985442278 conn(0x55f37a9af290 msgr2=0x55f37a9f6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:53.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 -- 172.21.15.67:0/1985442278 shutdown_connections 2024-09-19T05:47:53.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 1 -- 172.21.15.67:0/1985442278 wait complete. 2024-09-19T05:47:53.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf378c2000 20 client.10596 trim_cache size 0 max 16384 2024-09-19T05:47:53.291 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:47:53.292 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:47:53.292 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:47:53.292 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 10458, 2024-09-19T05:47:53.292 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:47:53.292 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:47:53.292 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:47:53.292 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 10.326600845, 2024-09-19T05:47:53.292 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 138, 2024-09-19T05:47:53.293 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 191, 2024-09-19T05:47:53.293 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 191, 2024-09-19T05:47:53.293 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 15.619737281000001 2024-09-19T05:47:53.293 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:47:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 -- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf100678c0 msgr2=0x7fbf10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf100678c0 0x7fbf10069d80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbf200ae000 tx=0x7fbf200b5040 comp rx=0 tx=0).stop 2024-09-19T05:47:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 -- 172.21.15.67:0/607369886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf3015b1e0 msgr2=0x7fbf301f5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf3015b1e0 0x7fbf301f5500 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009e60 tx=0x7fbf2800c490 comp rx=0 tx=0).stop 2024-09-19T05:47:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 -- 172.21.15.67:0/607369886 shutdown_connections 2024-09-19T05:47:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf3015b1e0 0x7fbf301f5500 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbf100678c0 0x7fbf10069d80 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf300b4900 0x7fbf300998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 --2- 172.21.15.67:0/607369886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf30072590 0x7fbf30073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 -- 172.21.15.67:0/607369886 >> 172.21.15.67:0/607369886 conn(0x7fbf300d0080 msgr2=0x7fbf300aef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:53.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 -- 172.21.15.67:0/607369886 shutdown_connections 2024-09-19T05:47:53.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.282+0000 7fbf34806640 1 -- 172.21.15.67:0/607369886 wait complete. 2024-09-19T05:47:53.297 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:47:53.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.406+0000 7f8e427ad640 1 Processor -- start 2024-09-19T05:47:53.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.406+0000 7f8e427ad640 1 -- start start 2024-09-19T05:47:53.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e427ad640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8e3c0c8c40 0x7f8e3c0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e427ad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c15d290 0x7f8e3c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e427ad640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e3c0c7130 con 0x7f8e3c09af70 2024-09-19T05:47:53.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e427ad640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8e3c070b90 con 0x7f8e3c0c8c40 2024-09-19T05:47:53.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e427ad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3c070e70 con 0x7f8e3c15d290 2024-09-19T05:47:53.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e40d4a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8e3c09af70 0x7f8e3c159550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:46566/0 (socket says 172.21.15.67:46566) 2024-09-19T05:47:53.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e40d4a640 1 -- 172.21.15.67:0/3531447761 learned_addr learned my addr 172.21.15.67:0/3531447761 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:53.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3bfff640 1 --2- 172.21.15.67:0/3531447761 >> v2:172.21.15.97:3300/0 conn(0x7f8e3c0c8c40 0x7f8e3c0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3b7fe640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c15d290 0x7f8e3c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553268766 0 0) 0x7f8e3c0c7130 con 0x7f8e3c09af70 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e28003530 con 0x7f8e3c09af70 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1543711829 0 0) 0x7f8e28003530 con 0x7f8e3c09af70 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c15d290 msgr2=0x7f8e3c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c15d290 0x7f8e3c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 >> v2:172.21.15.97:3300/0 conn(0x7f8e3c0c8c40 msgr2=0x7f8e3c0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 --2- 172.21.15.67:0/3531447761 >> v2:172.21.15.97:3300/0 conn(0x7f8e3c0c8c40 0x7f8e3c0705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c071150 con 0x7f8e3c09af70 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f8e34001680 con 0x7f8e3c09af70 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 >> v1:172.21.15.67:6789/0 conn(0x7f8e3c09af70 legacy=0x7f8e3c159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c15d290 0x7f8e280039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e28003f40 0x7f8e28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e28004d50 0x7f8e280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c070b90 con 0x7f8e28003f40 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c070e70 con 0x7f8e28004d50 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8e2800b9d0 con 0x7f8e3c15d290 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3b7fe640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e28003f40 0x7f8e28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e40d4a640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e28004d50 0x7f8e280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3b7fe640 1 -- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c15d290 msgr2=0x7f8e280039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3bfff640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c15d290 0x7f8e280039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3b7fe640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c15d290 0x7f8e280039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3b7fe640 1 -- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e28004d50 msgr2=0x7f8e280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3b7fe640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e28004d50 0x7f8e280051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e3b7fe640 1 -- 172.21.15.67:0/3531447761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e28003530 con 0x7f8e28003f40 2024-09-19T05:47:53.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.410+0000 7f8e40d4a640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e28004d50 0x7f8e280051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3b7fe640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e28003f40 0x7f8e28004810 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009ab0 tx=0x7f8e2c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c1e3ecf5b186e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0b2070 con 0x7f8e28003f40 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2c0a5640 con 0x7f8e28003f40 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3affd640 1 -- 172.21.15.67:0/3531447761 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0096b0 con 0x7f8e28003f40 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- 172.21.15.67:0/3531447761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e28003f40 msgr2=0x7f8e28004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 --2- 172.21.15.67:0/3531447761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e28003f40 0x7f8e28004810 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009ab0 tx=0x7f8e2c01c9f0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e40d4a640 1 -- 172.21.15.67:0/3531447761 reap_dead start 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- 172.21.15.67:0/3531447761 shutdown_connections 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- 172.21.15.67:0/3531447761 >> 172.21.15.67:0/3531447761 conn(0x7f8e3c0d22b0 msgr2=0x7f8e3c0d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- 172.21.15.67:0/3531447761 shutdown_connections 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- 172.21.15.67:0/3531447761 wait complete. 2024-09-19T05:47:53.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 Processor -- start 2024-09-19T05:47:53.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- start start 2024-09-19T05:47:53.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e3c0d1410 0x7f8e3c06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c0d17f0 0x7f8e3c1e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c06e600 0x7f8e3c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c0d04f0 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c15d6f0 con 0x7f8e3c0d1410 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3c09aa30 con 0x7f8e3c06e600 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c0d17f0 0x7f8e3c1e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c0d17f0 0x7f8e3c1e6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60052/0 (socket says 172.21.15.67:60052) 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3b7fe640 1 -- 172.21.15.67:0/4195485451 learned_addr learned my addr 172.21.15.67:0/4195485451 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e40d4a640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c06e600 0x7f8e3c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3bfff640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e3c0d1410 0x7f8e3c06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3b7fe640 1 -- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c06e600 msgr2=0x7f8e3c0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3b7fe640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c06e600 0x7f8e3c0c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3b7fe640 1 -- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e3c0d1410 msgr2=0x7f8e3c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3b7fe640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e3c0d1410 0x7f8e3c06cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3b7fe640 1 -- 172.21.15.67:0/4195485451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c06d560 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e3b7fe640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c0d17f0 0x7f8e3c1e6940 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c01b100 tx=0x7f8e2c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:53.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e38ff9640 1 -- 172.21.15.67:0/4195485451 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0ba020 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e38ff9640 1 -- 172.21.15.67:0/4195485451 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2c0ad440 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- 172.21.15.67:0/4195485451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3c06d840 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e38ff9640 1 -- 172.21.15.67:0/4195485451 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0b2040 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.414+0000 7f8e427ad640 1 -- 172.21.15.67:0/4195485451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e3c06de00 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.418+0000 7f8e427ad640 1 -- 172.21.15.67:0/4195485451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e3c0705b0 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.418+0000 7f8e38ff9640 1 -- 172.21.15.67:0/4195485451 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e2c0bd070 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.418+0000 7f8e38ff9640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e1c0678c0 0x7f8e1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:53.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.418+0000 7f8e38ff9640 1 -- 172.21.15.67:0/4195485451 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f8e2c11ed60 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.418+0000 7f8e3bfff640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e1c0678c0 0x7f8e1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:53.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.418+0000 7f8e3bfff640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e1c0678c0 0x7f8e1c069d80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8e240074a0 tx=0x7f8e2400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:53.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.422+0000 7f8e38ff9640 1 -- 172.21.15.67:0/4195485451 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f8e2c016760 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.618+0000 7f8e427ad640 1 -- 172.21.15.67:0/4195485451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8e3c06f100 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e38ff9640 1 -- 172.21.15.67:0/4195485451 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v138) ==== 53+0+73 (secure 0 0 0) 0x7f8e2c0ef7a0 con 0x7f8e3c0d17f0 2024-09-19T05:47:53.620 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:47:53.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 -- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e1c0678c0 msgr2=0x7f8e1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e1c0678c0 0x7f8e1c069d80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8e240074a0 tx=0x7f8e2400b040 comp rx=0 tx=0).stop 2024-09-19T05:47:53.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 -- 172.21.15.67:0/4195485451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c0d17f0 msgr2=0x7f8e3c1e6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:53.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c0d17f0 0x7f8e3c1e6940 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c01b100 tx=0x7f8e2c0197f0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 -- 172.21.15.67:0/4195485451 shutdown_connections 2024-09-19T05:47:53.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8e1c0678c0 0x7f8e1c069d80 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e3c06e600 0x7f8e3c0c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c0d17f0 0x7f8e3c1e6940 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 --2- 172.21.15.67:0/4195485451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e3c0d1410 0x7f8e3c06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:53.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 -- 172.21.15.67:0/4195485451 >> 172.21.15.67:0/4195485451 conn(0x7f8e3c0d22b0 msgr2=0x7f8e3c0c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:53.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 -- 172.21.15.67:0/4195485451 shutdown_connections 2024-09-19T05:47:53.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53.622+0000 7f8e427ad640 1 -- 172.21.15.67:0/4195485451 wait complete. 2024-09-19T05:47:53.639 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:47:53.639 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:47:53.639 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:47:53.640 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:47:53.640 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:53.640 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:47:53.640 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:47:53.640 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:47:53.640 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:47:53.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:53.640 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:47:53.648 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:47:53.648 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:47:53.648 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:47:53.648 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:53.648 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:47:53.648 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:53.648 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:47:53.648 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41631sec preferred_lft 41631sec 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:47:53.649 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:47:53.650 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:53.651 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:47:53.651 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:53.651 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:47:53.651 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:53.651 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:47:53.651 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:47:53.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:53.651 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:47:53.700 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:47:53.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:53.702 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:47:53.751 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:47:53.751 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:47:53.751 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:47:53.751 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:47:53.752 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:47:53.752 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:47:53.752 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:47:53.752 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:47:53.752 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:47:53.752 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:47:53.752 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:47:53.752 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:47:53.752 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:47:53.753 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:47:53.753 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:47:53.753 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:47:53.753 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:47:53.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:47:53.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:53.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:53.873 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:47:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:47:53.879 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:47:53.879 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:47:53.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:53.879 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:47:53.931 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:47:53.931 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:47:53.931 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:47:53.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:47:53.978 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:54.024 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:47:54.082 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:47:54.129 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:47:54.129 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:47:54.130 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:54.132 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:54.132 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:54.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:54.133 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:47:54.181 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:47:54.181 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:47:54.225 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:47:54.241 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:47:54.288 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:47:54.288 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:47:54.288 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:47:54.288 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:47:54.288 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:47:54.289 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:54.290 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:54.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:54.292 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:47:54.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:47:54.310+0000 7f79e4f76580 -1 init, newargv = 0x5652ac8053f0 newargc=15 2024-09-19T05:47:54.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[87903]: starting ceph client 2024-09-19T05:47:54.318 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[87903]: starting fuse 2024-09-19T05:47:55.416 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:47:55.433 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:47:55.483 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:47:55.483 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:47:55.483 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:47:55.483 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:47:55.483 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:47:55.483 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:47:55.483 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:47:55.484 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:55.485 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:47:55.486 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:55.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:55.487 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:47:55.533 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:47:55.534 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:47:55.534 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:47:55.534 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:47:55.534 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:47:55.534 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:47:55.534 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:47:55.534 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:47:55.534 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:47:55.534 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:47:55.534 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:47:55.534 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:47:55.535 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:47:55.536 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:47:55.536 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:47:55.660 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.87903.asok 2024-09-19T05:47:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:47:55.673 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.87903.asok 2024-09-19T05:47:55.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:55.673 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.87903.asok status 2024-09-19T05:47:55.837 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:47:55.837 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:47:55.837 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:47:55.837 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:47:55.837 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:47:55.837 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:47:55.837 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:47:55.837 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "87903", 2024-09-19T05:47:55.837 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 10608, 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 10608 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 908528873 2024-09-19T05:47:55.838 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 908528873 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.10608 192.168.0.1:0/908528873", 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/908528873", 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 138, 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 191, 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:47:55.839 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:47:55.840 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:47:55.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:55.851 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:47:55.851 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:55.857 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:47:55.858 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:55.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:55.858 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:55.913 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-19T05:47:56.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbddc225640 1 Processor -- start 2024-09-19T05:47:56.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbddc225640 1 -- start start 2024-09-19T05:47:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbddc225640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbdd40d1130 0x7fbdd40d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbddc225640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1510 0x7fbdd40cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbddc225640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd406d850 con 0x7fbdd40b32d0 2024-09-19T05:47:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbddc225640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd40d39e0 con 0x7fbdd40d1130 2024-09-19T05:47:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbddc225640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd40d33d0 con 0x7fbdd40d1510 2024-09-19T05:47:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbdd9fc1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbdd40d1130 0x7fbdd40d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbdda7c2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1510 0x7fbdd40cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbdd97c0640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fbdd40b32d0 0x7fbdd406d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:51762/0 (socket says 172.21.15.67:51762) 2024-09-19T05:47:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbdd9fc1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbdd40d1130 0x7fbdd40d3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:38038/0 (socket says 172.21.15.67:38038) 2024-09-19T05:47:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbdd97c0640 1 -- 172.21.15.67:0/97205036 learned_addr learned my addr 172.21.15.67:0/97205036 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbdd9fc1640 1 -- 172.21.15.67:0/97205036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1510 msgr2=0x7fbdd40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/97205036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1510 0x7fbdd40cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbdd9fc1640 1 -- 172.21.15.67:0/97205036 >> v1:172.21.15.97:6789/0 conn(0x7fbdd40b32d0 legacy=0x7fbdd406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbdd9fc1640 1 -- 172.21.15.67:0/97205036 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd406db20 con 0x7fbdd40d1130 2024-09-19T05:47:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.094+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/97205036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1510 0x7fbdd40cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:47:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/97205036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbdd40d1130 0x7fbdd40d3e70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00097c0 tx=0x7fbdd001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7785c89982544bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbdd8fbf640 1 -- 172.21.15.67:0/97205036 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00b1070 con 0x7fbdd40d1130 2024-09-19T05:47:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbdd8fbf640 1 -- 172.21.15.67:0/97205036 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd00a8050 con 0x7fbdd40d1130 2024-09-19T05:47:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbdd8fbf640 1 -- 172.21.15.67:0/97205036 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00ac860 con 0x7fbdd40d1130 2024-09-19T05:47:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbddc225640 1 -- 172.21.15.67:0/97205036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbdd40d1130 msgr2=0x7fbdd40d3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbddc225640 1 --2- 172.21.15.67:0/97205036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbdd40d1130 0x7fbdd40d3e70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00097c0 tx=0x7fbdd001c3e0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbddc225640 1 -- 172.21.15.67:0/97205036 shutdown_connections 2024-09-19T05:47:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbddc225640 1 --2- 172.21.15.67:0/97205036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1510 0x7fbdd40cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbddc225640 1 --2- 172.21.15.67:0/97205036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbdd40d1130 0x7fbdd40d3e70 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbddc225640 1 -- 172.21.15.67:0/97205036 >> 172.21.15.67:0/97205036 conn(0x7fbdd408bfc0 msgr2=0x7fbdd40d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbddc225640 1 -- 172.21.15.67:0/97205036 shutdown_connections 2024-09-19T05:47:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbddc225640 1 -- 172.21.15.67:0/97205036 wait complete. 2024-09-19T05:47:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbddc225640 1 Processor -- start 2024-09-19T05:47:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.098+0000 7fbddc225640 1 -- start start 2024-09-19T05:47:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbddc225640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbdd40b32d0 0x7fbdd409e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbddc225640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1130 0x7fbdd415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbddc225640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd40d1510 0x7fbdd415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbddc225640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd40d2750 con 0x7fbdd40d1510 2024-09-19T05:47:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbddc225640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd40d25d0 con 0x7fbdd40b32d0 2024-09-19T05:47:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbddc225640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd40d28d0 con 0x7fbdd40d1130 2024-09-19T05:47:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdda7c2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd40d1510 0x7fbdd415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdda7c2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd40d1510 0x7fbdd415ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60790/0 (socket says 172.21.15.67:60790) 2024-09-19T05:47:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdda7c2640 1 -- 172.21.15.67:0/2221677405 learned_addr learned my addr 172.21.15.67:0/2221677405 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdd97c0640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1130 0x7fbdd415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbdd40b32d0 0x7fbdd409e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdda7c2640 1 -- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1130 msgr2=0x7fbdd415a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1130 0x7fbdd415a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdda7c2640 1 -- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbdd40b32d0 msgr2=0x7fbdd409e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbdd40b32d0 0x7fbdd409e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdda7c2640 1 -- 172.21.15.67:0/2221677405 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd415b8b0 con 0x7fbdd40d1510 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdd97c0640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1130 0x7fbdd415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbdd40b32d0 0x7fbdd409e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd40d1510 0x7fbdd415ad40 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00efc0 tx=0x7fbdcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdca7fc640 1 -- 172.21.15.67:0/2221677405 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc018030 con 0x7fbdd40d1510 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdca7fc640 1 -- 172.21.15.67:0/2221677405 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc00cd30 con 0x7fbdd40d1510 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbddc225640 1 -- 172.21.15.67:0/2221677405 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd415bb90 con 0x7fbdd40d1510 2024-09-19T05:47:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdca7fc640 1 -- 172.21.15.67:0/2221677405 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc003bc0 con 0x7fbdd40d1510 2024-09-19T05:47:56.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbddc225640 1 -- 172.21.15.67:0/2221677405 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd409e950 con 0x7fbdd40d1510 2024-09-19T05:47:56.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdca7fc640 1 -- 172.21.15.67:0/2221677405 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbdcc01b070 con 0x7fbdd40d1510 2024-09-19T05:47:56.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdca7fc640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdb80678c0 0x7fbdb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.102+0000 7fbdca7fc640 1 -- 172.21.15.67:0/2221677405 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fbdcc0866e0 con 0x7fbdd40d1510 2024-09-19T05:47:56.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdb80678c0 0x7fbdb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdb80678c0 0x7fbdb8069d80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00ae000 tx=0x7fbdd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 Processor -- start 2024-09-19T05:47:56.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 -- start start 2024-09-19T05:47:56.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d677913760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d6778c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6778c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d6777b0c40 con 0x55d677913ca0 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d677717d50 con 0x55d6778c97d0 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d6776d2ab0 con 0x55d677913380 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd97c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d6778c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd97c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d6778c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60792/0 (socket says 172.21.15.67:60792) 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd97c0640 1 -- 172.21.15.67:0/3927745535 learned_addr learned my addr 172.21.15.67:0/3927745535 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/3927745535 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d677913760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/3927745535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6778c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd97c0640 1 -- 172.21.15.67:0/3927745535 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 msgr2=0x55d677913760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd97c0640 1 --2- 172.21.15.67:0/3927745535 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d677913760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd97c0640 1 -- 172.21.15.67:0/3927745535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 msgr2=0x55d6778c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd97c0640 1 --2- 172.21.15.67:0/3927745535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6778c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd97c0640 1 -- 172.21.15.67:0/3927745535 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6776be590 con 0x55d677913ca0 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdd97c0640 1 --2- 172.21.15.67:0/3927745535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d6778c9290 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40015c0 tx=0x7fbdc4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306831e1cfa5c648 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdb77fe640 1 -- 172.21.15.67:0/3927745535 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4019070 con 0x55d677913ca0 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdb77fe640 1 -- 172.21.15.67:0/3927745535 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc40058a0 con 0x55d677913ca0 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbdb77fe640 1 -- 172.21.15.67:0/3927745535 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4005c50 con 0x55d677913ca0 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3927745535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 msgr2=0x55d6778c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/3927745535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d6778c9290 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40015c0 tx=0x7fbdc4001a80 comp rx=0 tx=0).stop 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3927745535 shutdown_connections 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/3927745535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6778c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/3927745535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d6778c9290 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/3927745535 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d677913760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3927745535 >> 172.21.15.67:0/3927745535 conn(0x55d6778c0bc0 msgr2=0x55d6778c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3927745535 shutdown_connections 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.106+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3927745535 wait complete. 2024-09-19T05:47:56.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 -- start start 2024-09-19T05:47:56.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 Processor -- start 2024-09-19T05:47:56.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6778ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913380 0x55d6778fd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913ca0 0x55d6778fdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d6776d6400 con 0x55d677913380 2024-09-19T05:47:56.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d6777d43a0 con 0x55d6778c97d0 2024-09-19T05:47:56.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d677757260 con 0x55d677913ca0 2024-09-19T05:47:56.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 10 client.0 _ll_register_callbacks cb 0x55d677779020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:56.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd97c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913380 0x55d6778fd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd97c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913380 0x55d6778fd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60798/0 (socket says 172.21.15.67:60798) 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd97c0640 1 -- 172.21.15.67:0/2495632876 learned_addr learned my addr 172.21.15.67:0/2495632876 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913ca0 0x55d6778fdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6778ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd97c0640 1 -- 172.21.15.67:0/2495632876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913ca0 msgr2=0x55d6778fdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd97c0640 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913ca0 0x55d6778fdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd97c0640 1 -- 172.21.15.67:0/2495632876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 msgr2=0x55d6778ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd97c0640 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6778ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd97c0640 1 -- 172.21.15.67:0/2495632876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6776badd0 con 0x55d677913380 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6778ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd97c0640 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913380 0x55d6778fd5d0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009010 tx=0x7fbdc4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cda9e08b615469 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:56.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/2495632876 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4023020 con 0x55d677913380 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/2495632876 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fbdc4007190 con 0x55d677913380 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2495632876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdc40058a0 con 0x55d677913380 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/2495632876 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7fbdc402d050 con 0x55d677913380 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 10 client.10617 fetch_fsmap learned FSMap version 138 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2495632876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x55d6776b7800 con 0x55d677913380 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/2495632876 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc40058a0 con 0x55d677913380 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/2495632876 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7fbdc4030020 con 0x55d677913380 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 10 client.10617 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 10 client.10617 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 20 client.10617 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55d6778ceda0 0x55d67791a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 4 client.10617 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2495632876 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6776b1e20 con 0x55d6778ceda0 2024-09-19T05:47:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55d6778ceda0 0x55d67791a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55d6778ceda0 0x55d67791a150 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7503b55938e0f8a5 server_cookie=fa8846e9a7b210c3 in_seq=0 out_seq=0 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdb4ff9640 10 client.10617 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/2495632876 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6776b1e20 con 0x55d6778ceda0 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdb4ff9640 10 client.10617 handle_command_reply: tid=0 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 client.10617 shutdown 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2495632876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913380 msgr2=0x55d6778fd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913380 0x55d6778fd5d0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009010 tx=0x7fbdc4000bd0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2495632876 shutdown_connections 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55d6778ceda0 0x55d67791a150 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913ca0 0x55d6778fdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913380 0x55d6778fd5d0 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbdb4ff9640 0 client.10617 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/2495632876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6778ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.110+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2495632876 >> 172.21.15.67:0/2495632876 conn(0x55d6778c0bc0 msgr2=0x55d6778c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.114+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2495632876 shutdown_connections 2024-09-19T05:47:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.114+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2495632876 wait complete. 2024-09-19T05:47:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.114+0000 7fbddf2e1000 20 client.10617 trim_cache size 0 max 16384 2024-09-19T05:47:56.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbddf2e1000 1 Processor -- start 2024-09-19T05:47:56.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbddf2e1000 1 -- start start 2024-09-19T05:47:56.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6779820f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d677982630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677982b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd4203180 con 0x55d677913ca0 2024-09-19T05:47:56.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd40a0cf0 con 0x55d6778c97d0 2024-09-19T05:47:56.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd40a1340 con 0x55d677913380 2024-09-19T05:47:56.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdda7c2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677982b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdda7c2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677982b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60812/0 (socket says 172.21.15.67:60812) 2024-09-19T05:47:56.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdda7c2640 1 -- 172.21.15.67:0/2230889469 learned_addr learned my addr 172.21.15.67:0/2230889469 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdda7c2640 1 -- 172.21.15.67:0/2230889469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 msgr2=0x55d677982630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/2230889469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d677982630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdda7c2640 1 -- 172.21.15.67:0/2230889469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 msgr2=0x55d6779820f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/2230889469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6779820f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdda7c2640 1 -- 172.21.15.67:0/2230889469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6776d5480 con 0x55d677913ca0 2024-09-19T05:47:56.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/2230889469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677982b70 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc056690 tx=0x7fbdcc012480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5242b50569eb7f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdb6ffd640 1 -- 172.21.15.67:0/2230889469 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc06e070 con 0x55d677913ca0 2024-09-19T05:47:56.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdb6ffd640 1 -- 172.21.15.67:0/2230889469 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc05ad40 con 0x55d677913ca0 2024-09-19T05:47:56.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.126+0000 7fbdb6ffd640 1 -- 172.21.15.67:0/2230889469 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc05f570 con 0x55d677913ca0 2024-09-19T05:47:56.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2230889469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 msgr2=0x55d677982b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/2230889469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677982b70 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc056690 tx=0x7fbdcc012480 comp rx=0 tx=0).stop 2024-09-19T05:47:56.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2230889469 shutdown_connections 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/2230889469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677982b70 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/2230889469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d677982630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/2230889469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d6779820f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2230889469 >> 172.21.15.67:0/2230889469 conn(0x55d6778c0bc0 msgr2=0x55d6778fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2230889469 shutdown_connections 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- 172.21.15.67:0/2230889469 wait complete. 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- start start 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 Processor -- start 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d677928f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d6779294c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677929a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d6776bdf30 con 0x55d677913ca0 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d6776d67d0 con 0x55d6778c97d0 2024-09-19T05:47:56.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d677717060 con 0x55d677913380 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 10 client.0 _ll_register_callbacks cb 0x7fbdc4017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdda7c2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677929a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdda7c2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677929a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60824/0 (socket says 172.21.15.67:60824) 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdda7c2640 1 -- 172.21.15.67:0/3208428503 learned_addr learned my addr 172.21.15.67:0/3208428503 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdd97c0640 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d6779294c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d677928f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdda7c2640 1 -- 172.21.15.67:0/3208428503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 msgr2=0x55d6779294c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d6779294c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdda7c2640 1 -- 172.21.15.67:0/3208428503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 msgr2=0x55d677928f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d677928f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdda7c2640 1 -- 172.21.15.67:0/3208428503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6776ab650 con 0x55d677913ca0 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdd97c0640 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d6779294c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d677928f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdda7c2640 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677929a00 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc056920 tx=0x7fbdcc084950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3475d02ef396f3b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/3208428503 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc072030 con 0x55d677913ca0 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/3208428503 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fbdcc05d0b0 con 0x55d677913ca0 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3208428503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdcc05ad40 con 0x55d677913ca0 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/3208428503 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7fbdcc06e050 con 0x55d677913ca0 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 10 client.10623 fetch_fsmap learned FSMap version 138 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3208428503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x55d6776af3c0 con 0x55d677913ca0 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/3208428503 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc05ad40 con 0x55d677913ca0 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/3208428503 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7fbdcc025060 con 0x55d677913ca0 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 10 client.10623 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 10 client.10623 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-19T05:47:56.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 20 client.10623 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55d6779833c0 0x55d677929f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 4 client.10623 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3208428503 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d677725480 con 0x55d6779833c0 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55d6779833c0 0x55d677929f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdd9fc1640 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55d6779833c0 0x55d677929f40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb2d3c4b20f1920c server_cookie=afaf4158771bee7b in_seq=0 out_seq=0 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdb4ff9640 10 client.10623 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdb4ff9640 1 -- 172.21.15.67:0/3208428503 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d677725480 con 0x55d6779833c0 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbdb4ff9640 10 client.10623 handle_command_reply: tid=0 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 client.10623 shutdown 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3208428503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 msgr2=0x55d677929a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.130+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677929a00 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc056920 tx=0x7fbdcc084950 comp rx=0 tx=0).stop 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3208428503 shutdown_connections 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55d6779833c0 0x55d677929f40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d677913ca0 0x55d677929a00 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d677913380 0x55d6779294c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddf2e1000 1 --2- 172.21.15.67:0/3208428503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d6778c97d0 0x55d677928f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbdb4ff9640 0 client.10623 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3208428503 >> 172.21.15.67:0/3208428503 conn(0x55d6778c0bc0 msgr2=0x55d6778fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3208428503 shutdown_connections 2024-09-19T05:47:56.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddf2e1000 1 -- 172.21.15.67:0/3208428503 wait complete. 2024-09-19T05:47:56.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddf2e1000 20 client.10623 trim_cache size 0 max 16384 2024-09-19T05:47:56.139 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-19T05:47:56.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 -- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdb80678c0 msgr2=0x7fbdb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdb80678c0 0x7fbdb8069d80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00ae000 tx=0x7fbdd0008040 comp rx=0 tx=0).stop 2024-09-19T05:47:56.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 -- 172.21.15.67:0/2221677405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd40d1510 msgr2=0x7fbdd415ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd40d1510 0x7fbdd415ad40 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00efc0 tx=0x7fbdcc00c490 comp rx=0 tx=0).stop 2024-09-19T05:47:56.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 -- 172.21.15.67:0/2221677405 shutdown_connections 2024-09-19T05:47:56.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd40d1510 0x7fbdd415ad40 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbdb80678c0 0x7fbdb8069d80 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbdd40d1130 0x7fbdd415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 --2- 172.21.15.67:0/2221677405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbdd40b32d0 0x7fbdd409e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 -- 172.21.15.67:0/2221677405 >> 172.21.15.67:0/2221677405 conn(0x7fbdd408bfc0 msgr2=0x7fbdd40b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 -- 172.21.15.67:0/2221677405 shutdown_connections 2024-09-19T05:47:56.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.134+0000 7fbddc225640 1 -- 172.21.15.67:0/2221677405 wait complete. 2024-09-19T05:47:56.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T05:47:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.266+0000 7faa263a5640 1 Processor -- start 2024-09-19T05:47:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.266+0000 7faa263a5640 1 -- start start 2024-09-19T05:47:56.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.266+0000 7faa263a5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cd920 0x7faa200cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.266+0000 7faa263a5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa2009b8d0 con 0x7faa2009b440 2024-09-19T05:47:56.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.266+0000 7faa263a5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa2009bbb0 con 0x7faa2015fed0 2024-09-19T05:47:56.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.266+0000 7faa263a5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faa20160d50 con 0x7faa200cd920 2024-09-19T05:47:56.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.266+0000 7faa17fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7faa2009b440 0x7faa201602b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43038/0 (socket says 172.21.15.67:43038) 2024-09-19T05:47:56.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa17fff640 1 -- 172.21.15.67:0/3809541262 learned_addr learned my addr 172.21.15.67:0/3809541262 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:47:56.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa24942640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cd920 0x7faa200cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3912631082 0 0) 0x7faa2009b8d0 con 0x7faa2009b440 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa0c003530 con 0x7faa2009b440 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3639331531 0 0) 0x7faa0c003530 con 0x7faa2009b440 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cd920 msgr2=0x7faa200cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cd920 0x7faa200cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 >> v1:172.21.15.97:6789/0 conn(0x7faa2015fed0 legacy=0x7faa200b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa200cd120 con 0x7faa2009b440 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7faa08001680 con 0x7faa2009b440 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 >> v1:172.21.15.67:6789/0 conn(0x7faa2009b440 legacy=0x7faa201602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cd920 0x7faa0c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa0c003f70 0x7faa0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa0c004d50 0x7faa0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c00ba80 con 0x7faa0c004d50 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c00bc30 con 0x7faa0c003f70 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c00be30 con 0x7faa200cd920 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa24942640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa0c004d50 0x7faa0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa17fff640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa0c003f70 0x7faa0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1ffff640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cd920 0x7faa0c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa24942640 1 -- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cd920 msgr2=0x7faa0c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa24942640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cd920 0x7faa0c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa24942640 1 -- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa0c003f70 msgr2=0x7faa0c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa24942640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa0c003f70 0x7faa0c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa24942640 1 -- 172.21.15.67:0/3809541262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c003530 con 0x7faa0c004d50 2024-09-19T05:47:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1ffff640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cd920 0x7faa0c0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa24942640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa0c004d50 0x7faa0c0051d0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7faa18009fa0 tx=0x7faa1801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51f8c1fdfd5562b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa180b2070 con 0x7faa0c004d50 2024-09-19T05:47:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa180a5d10 con 0x7faa0c004d50 2024-09-19T05:47:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.270+0000 7faa1f7fe640 1 -- 172.21.15.67:0/3809541262 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18009bf0 con 0x7faa0c004d50 2024-09-19T05:47:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- 172.21.15.67:0/3809541262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa0c004d50 msgr2=0x7faa0c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 --2- 172.21.15.67:0/3809541262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa0c004d50 0x7faa0c0051d0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7faa18009fa0 tx=0x7faa1801cc40 comp rx=0 tx=0).stop 2024-09-19T05:47:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa24942640 1 -- 172.21.15.67:0/3809541262 reap_dead start 2024-09-19T05:47:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- 172.21.15.67:0/3809541262 shutdown_connections 2024-09-19T05:47:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- 172.21.15.67:0/3809541262 >> 172.21.15.67:0/3809541262 conn(0x7faa200b3d90 msgr2=0x7faa200b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- 172.21.15.67:0/3809541262 shutdown_connections 2024-09-19T05:47:56.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- 172.21.15.67:0/3809541262 wait complete. 2024-09-19T05:47:56.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 Processor -- start 2024-09-19T05:47:56.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- start start 2024-09-19T05:47:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa0c004d50 0x7faa201575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cb160 0x7faa200d0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa201599d0 0x7faa20159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faa200ccd40 con 0x7faa201599d0 2024-09-19T05:47:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faa2015d6b0 con 0x7faa0c004d50 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7faa200ccec0 con 0x7faa200cb160 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa24942640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa201599d0 0x7faa20159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa24942640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa201599d0 0x7faa20159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60844/0 (socket says 172.21.15.67:60844) 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa24942640 1 -- 172.21.15.67:0/3434037531 learned_addr learned my addr 172.21.15.67:0/3434037531 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa17fff640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cb160 0x7faa200d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa1ffff640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa0c004d50 0x7faa201575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa24942640 1 -- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cb160 msgr2=0x7faa200d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa24942640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cb160 0x7faa200d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa24942640 1 -- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa0c004d50 msgr2=0x7faa201575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa24942640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa0c004d50 0x7faa201575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa24942640 1 -- 172.21.15.67:0/3434037531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa200d0d60 con 0x7faa201599d0 2024-09-19T05:47:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa1ffff640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa0c004d50 0x7faa201575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:56.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa24942640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa201599d0 0x7faa20159e50 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7faa18002240 tx=0x7faa18009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa1d7fa640 1 -- 172.21.15.67:0/3434037531 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa180b2040 con 0x7faa201599d0 2024-09-19T05:47:56.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa1d7fa640 1 -- 172.21.15.67:0/3434037531 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa180a5b10 con 0x7faa201599d0 2024-09-19T05:47:56.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- 172.21.15.67:0/3434037531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa20157c60 con 0x7faa201599d0 2024-09-19T05:47:56.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa1d7fa640 1 -- 172.21.15.67:0/3434037531 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18009bf0 con 0x7faa201599d0 2024-09-19T05:47:56.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.274+0000 7faa263a5640 1 -- 172.21.15.67:0/3434037531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa200b5600 con 0x7faa201599d0 2024-09-19T05:47:56.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.278+0000 7faa263a5640 1 -- 172.21.15.67:0/3434037531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa2015a390 con 0x7faa201599d0 2024-09-19T05:47:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.278+0000 7faa1d7fa640 1 -- 172.21.15.67:0/3434037531 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa180c0030 con 0x7faa201599d0 2024-09-19T05:47:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.278+0000 7faa1d7fa640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa000678f0 0x7faa00069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.278+0000 7faa1d7fa640 1 -- 172.21.15.67:0/3434037531 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7faa18120560 con 0x7faa201599d0 2024-09-19T05:47:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.278+0000 7faa1ffff640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa000678f0 0x7faa00069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.278+0000 7faa1ffff640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa000678f0 0x7faa00069db0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7faa100036c0 tx=0x7faa10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.282+0000 7faa1d7fa640 1 -- 172.21.15.67:0/3434037531 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7faa180c7060 con 0x7faa201599d0 2024-09-19T05:47:56.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.478+0000 7faa263a5640 1 -- 172.21.15.67:0/3434037531 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faa2009b830 con 0x7faa201599d0 2024-09-19T05:47:56.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.478+0000 7faa1d7fa640 1 -- 172.21.15.67:0/3434037531 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7faa18016950 con 0x7faa201599d0 2024-09-19T05:47:56.479 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:47:56.479 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T05:47:56.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 -- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa000678f0 msgr2=0x7faa00069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa000678f0 0x7faa00069db0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7faa100036c0 tx=0x7faa10009040 comp rx=0 tx=0).stop 2024-09-19T05:47:56.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 -- 172.21.15.67:0/3434037531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa201599d0 msgr2=0x7faa20159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa201599d0 0x7faa20159e50 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7faa18002240 tx=0x7faa18009750 comp rx=0 tx=0).stop 2024-09-19T05:47:56.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 -- 172.21.15.67:0/3434037531 shutdown_connections 2024-09-19T05:47:56.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa201599d0 0x7faa20159e50 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7faa000678f0 0x7faa00069db0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faa200cb160 0x7faa200d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 --2- 172.21.15.67:0/3434037531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa0c004d50 0x7faa201575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 -- 172.21.15.67:0/3434037531 >> 172.21.15.67:0/3434037531 conn(0x7faa200b3d90 msgr2=0x7faa2015e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 -- 172.21.15.67:0/3434037531 shutdown_connections 2024-09-19T05:47:56.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.482+0000 7faa263a5640 1 -- 172.21.15.67:0/3434037531 wait complete. 2024-09-19T05:47:56.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:56.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub start '~mdsdir' recursive 2024-09-19T05:47:56.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac344f5640 1 Processor -- start 2024-09-19T05:47:56.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac344f5640 1 -- start start 2024-09-19T05:47:56.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac344f5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac2c0cf5e0 0x7fac2c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac344f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 0x7fac2c15dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac344f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac2c15d030 con 0x7fac2c15c850 2024-09-19T05:47:56.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac344f5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fac2c15e250 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac344f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fac2c06de90 con 0x7fac2c15d8d0 2024-09-19T05:47:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac32291640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac2c0cf5e0 0x7fac2c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac32291640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac2c0cf5e0 0x7fac2c0d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60848/0 (socket says 172.21.15.67:60848) 2024-09-19T05:47:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac32291640 1 -- 172.21.15.67:0/851217805 learned_addr learned my addr 172.21.15.67:0/851217805 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac32a92640 1 --2- 172.21.15.67:0/851217805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 0x7fac2c15dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac32291640 1 -- 172.21.15.67:0/851217805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 msgr2=0x7fac2c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac32291640 1 --2- 172.21.15.67:0/851217805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 0x7fac2c15dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac32291640 1 -- 172.21.15.67:0/851217805 >> v1:172.21.15.97:6789/0 conn(0x7fac2c15c850 legacy=0x7fac2c06e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac32291640 1 -- 172.21.15.67:0/851217805 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2c15d310 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.626+0000 7fac32a92640 1 --2- 172.21.15.67:0/851217805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 0x7fac2c15dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:56.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac32291640 1 --2- 172.21.15.67:0/851217805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 0x7fac2c0d0aa0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009870 tx=0x7fac1c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41da46e9bb9cf91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac3128f640 1 -- 172.21.15.67:0/851217805 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0a7070 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac3128f640 1 -- 172.21.15.67:0/851217805 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c0b0070 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac3128f640 1 -- 172.21.15.67:0/851217805 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0ab890 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac344f5640 1 -- 172.21.15.67:0/851217805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 msgr2=0x7fac2c0d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac344f5640 1 --2- 172.21.15.67:0/851217805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 0x7fac2c0d0aa0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009870 tx=0x7fac1c01c560 comp rx=0 tx=0).stop 2024-09-19T05:47:56.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac344f5640 1 -- 172.21.15.67:0/851217805 shutdown_connections 2024-09-19T05:47:56.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac344f5640 1 --2- 172.21.15.67:0/851217805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 0x7fac2c15dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac344f5640 1 --2- 172.21.15.67:0/851217805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 0x7fac2c0d0aa0 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac344f5640 1 -- 172.21.15.67:0/851217805 >> 172.21.15.67:0/851217805 conn(0x7fac2c06c0c0 msgr2=0x7fac2c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac344f5640 1 -- 172.21.15.67:0/851217805 shutdown_connections 2024-09-19T05:47:56.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.630+0000 7fac344f5640 1 -- 172.21.15.67:0/851217805 wait complete. 2024-09-19T05:47:56.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac344f5640 1 Processor -- start 2024-09-19T05:47:56.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac344f5640 1 -- start start 2024-09-19T05:47:56.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac344f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 0x7fac2c15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac344f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac2c15c850 0x7fac2c099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac344f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 0x7fac2c072690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac344f5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c06ee90 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac344f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c06ed10 con 0x7fac2c15c850 2024-09-19T05:47:56.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac344f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fac2c168fb0 con 0x7fac2c15d8d0 2024-09-19T05:47:56.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac32291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 0x7fac2c15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac32291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 0x7fac2c15b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60862/0 (socket says 172.21.15.67:60862) 2024-09-19T05:47:56.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac32291640 1 -- 172.21.15.67:0/2730615727 learned_addr learned my addr 172.21.15.67:0/2730615727 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac32a92640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 0x7fac2c072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac31a90640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac2c15c850 0x7fac2c099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac32291640 1 -- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 msgr2=0x7fac2c072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac32291640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 0x7fac2c072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac32291640 1 -- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac2c15c850 msgr2=0x7fac2c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac32291640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac2c15c850 0x7fac2c099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac32291640 1 -- 172.21.15.67:0/2730615727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2c099eb0 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac32291640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 0x7fac2c15b740 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0ad040 tx=0x7fac1c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac22ffd640 1 -- 172.21.15.67:0/2730615727 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0be5f0 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac22ffd640 1 -- 172.21.15.67:0/2730615727 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c0be790 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac22ffd640 1 -- 172.21.15.67:0/2730615727 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0beb80 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac344f5640 1 -- 172.21.15.67:0/2730615727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2c155760 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.634+0000 7fac344f5640 1 -- 172.21.15.67:0/2730615727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2c155d20 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac22ffd640 1 -- 172.21.15.67:0/2730615727 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac1c0b43f0 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac22ffd640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac180678c0 0x7fac18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac22ffd640 1 -- 172.21.15.67:0/2730615727 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fac1c120ac0 con 0x7fac2c0cf5e0 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac31a90640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac180678c0 0x7fac18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac375b1000 1 Processor -- start 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac375b1000 1 -- start start 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac31a90640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac180678c0 0x7fac18069d80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fac2c073500 tx=0x7fac28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac375b1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b8af840 0x55753b8afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac375b1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 0x55753b865ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac375b1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b8663e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac375b1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55753b6b3b20 con 0x55753b866000 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac375b1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55753b66e870 con 0x55753b8b0160 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac375b1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55753b6afae0 con 0x55753b8af840 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac32a92640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b8663e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac32a92640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b8663e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60872/0 (socket says 172.21.15.67:60872) 2024-09-19T05:47:56.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac32a92640 1 -- 172.21.15.67:0/1071729072 learned_addr learned my addr 172.21.15.67:0/1071729072 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac32291640 1 --2- 172.21.15.67:0/1071729072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b8af840 0x55753b8afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac31a90640 1 --2- 172.21.15.67:0/1071729072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 0x55753b865ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac32a92640 1 -- 172.21.15.67:0/1071729072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b8af840 msgr2=0x55753b8afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac32a92640 1 --2- 172.21.15.67:0/1071729072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b8af840 0x55753b8afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac32a92640 1 -- 172.21.15.67:0/1071729072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 msgr2=0x55753b865ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac32a92640 1 --2- 172.21.15.67:0/1071729072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 0x55753b865ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac32a92640 1 -- 172.21.15.67:0/1071729072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753b686940 con 0x55753b866000 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac32a92640 1 --2- 172.21.15.67:0/1071729072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b8663e0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fac240074e0 tx=0x7fac240079a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecd6a52c4cd0c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac13fff640 1 -- 172.21.15.67:0/1071729072 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2401a020 con 0x55753b866000 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac13fff640 1 -- 172.21.15.67:0/1071729072 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac24015850 con 0x55753b866000 2024-09-19T05:47:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac13fff640 1 -- 172.21.15.67:0/1071729072 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24015c00 con 0x55753b866000 2024-09-19T05:47:56.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac375b1000 1 -- 172.21.15.67:0/1071729072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 msgr2=0x55753b8663e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.638+0000 7fac375b1000 1 --2- 172.21.15.67:0/1071729072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b8663e0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fac240074e0 tx=0x7fac240079a0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- 172.21.15.67:0/1071729072 shutdown_connections 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 --2- 172.21.15.67:0/1071729072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b8663e0 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 --2- 172.21.15.67:0/1071729072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 0x55753b865ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 --2- 172.21.15.67:0/1071729072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b8af840 0x55753b8afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- 172.21.15.67:0/1071729072 >> 172.21.15.67:0/1071729072 conn(0x55753b86c160 msgr2=0x55753b8643a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- 172.21.15.67:0/1071729072 shutdown_connections 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- 172.21.15.67:0/1071729072 wait complete. 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- start start 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 Processor -- start 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b89c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b8af840 0x55753b86a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 0x55753b86aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55753b6808e0 con 0x55753b866000 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55753b6579b0 con 0x55753b8b0160 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55753b67b260 con 0x55753b8af840 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 10 client.0 _ll_register_callbacks cb 0x55753b851540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b89c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b89c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60884/0 (socket says 172.21.15.67:60884) 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32291640 1 -- 172.21.15.67:0/998809060 learned_addr learned my addr 172.21.15.67:0/998809060 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac31a90640 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b8af840 0x55753b86a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32a92640 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 0x55753b86aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32291640 1 -- 172.21.15.67:0/998809060 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b8af840 msgr2=0x55753b86a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32291640 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b8af840 0x55753b86a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32291640 1 -- 172.21.15.67:0/998809060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 msgr2=0x55753b86aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32291640 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 0x55753b86aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32291640 1 -- 172.21.15.67:0/998809060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753b66eac0 con 0x55753b866000 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32a92640 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 0x55753b86aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac32291640 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b89c710 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7fac1c097f40 tx=0x7fac1c0f0fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ad5868825ac9af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac117fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac117fa640 1 -- 172.21.15.67:0/998809060 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0f04f0 con 0x55753b866000 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac117fa640 1 -- 172.21.15.67:0/998809060 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fac1c0f73a0 con 0x55753b866000 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- 172.21.15.67:0/998809060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac24015850 con 0x55753b866000 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac117fa640 1 -- 172.21.15.67:0/998809060 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7fac1c101050 con 0x55753b866000 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 10 client.10641 fetch_fsmap learned FSMap version 138 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- 172.21.15.67:0/998809060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x55753b653810 con 0x55753b866000 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac117fa640 1 -- 172.21.15.67:0/998809060 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac24015850 con 0x55753b866000 2024-09-19T05:47:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac117fa640 1 -- 172.21.15.67:0/998809060 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7fac1c104020 con 0x55753b866000 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 10 client.10641 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 10 client.10641 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 20 client.10641 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55753b89d710 0x55753b8c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 4 client.10641 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac375b1000 1 -- 172.21.15.67:0/998809060 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55753b64de30 con 0x55753b89d710 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac31a90640 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55753b89d710 0x55753b8c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac117fa640 10 client.10641 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac31a90640 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55753b89d710 0x55753b8c08e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=327bb4fa655f36fe server_cookie=99579836a6388dbc in_seq=0 out_seq=0 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac117fa640 1 -- 172.21.15.67:0/998809060 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55753b64de30 con 0x55753b89d710 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.642+0000 7fac117fa640 10 client.10641 handle_command_reply: tid=0 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 client.10641 shutdown 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 -- 172.21.15.67:0/998809060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 msgr2=0x55753b89c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b89c710 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7fac1c097f40 tx=0x7fac1c0f0fe0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 -- 172.21.15.67:0/998809060 shutdown_connections 2024-09-19T05:47:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55753b89d710 0x55753b8c08e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b8b0160 0x55753b86aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac117fa640 0 client.10641 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b8af840 0x55753b86a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 --2- 172.21.15.67:0/998809060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b866000 0x55753b89c710 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 -- 172.21.15.67:0/998809060 >> 172.21.15.67:0/998809060 conn(0x55753b86c160 msgr2=0x55753b8643a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 -- 172.21.15.67:0/998809060 shutdown_connections 2024-09-19T05:47:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 1 -- 172.21.15.67:0/998809060 wait complete. 2024-09-19T05:47:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.646+0000 7fac375b1000 20 client.10641 trim_cache size 0 max 16384 2024-09-19T05:47:56.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac375b1000 1 Processor -- start 2024-09-19T05:47:56.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac375b1000 1 -- start start 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac375b1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b86c160 0x55753b91ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac375b1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 0x55753b91ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac375b1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b91f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac375b1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c204280 con 0x55753b8af840 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac375b1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c203280 con 0x55753b866000 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac375b1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fac2c0b4320 con 0x55753b86c160 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac32a92640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b91f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac32a92640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b91f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60896/0 (socket says 172.21.15.67:60896) 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac32a92640 1 -- 172.21.15.67:0/581481016 learned_addr learned my addr 172.21.15.67:0/581481016 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac32291640 1 --2- 172.21.15.67:0/581481016 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b86c160 0x55753b91ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac32a92640 1 -- 172.21.15.67:0/581481016 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b86c160 msgr2=0x55753b91ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac31a90640 1 --2- 172.21.15.67:0/581481016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 0x55753b91ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac32a92640 1 --2- 172.21.15.67:0/581481016 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b86c160 0x55753b91ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac32a92640 1 -- 172.21.15.67:0/581481016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 msgr2=0x55753b91ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac32a92640 1 --2- 172.21.15.67:0/581481016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 0x55753b91ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac32a92640 1 -- 172.21.15.67:0/581481016 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753b671240 con 0x55753b8af840 2024-09-19T05:47:56.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.662+0000 7fac32a92640 1 --2- 172.21.15.67:0/581481016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b91f4a0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fac24008010 tx=0x7fac24013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b1132339fd13c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac137fe640 1 -- 172.21.15.67:0/581481016 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2401a040 con 0x55753b8af840 2024-09-19T05:47:56.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac137fe640 1 -- 172.21.15.67:0/581481016 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac24003ba0 con 0x55753b8af840 2024-09-19T05:47:56.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac137fe640 1 -- 172.21.15.67:0/581481016 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24015650 con 0x55753b8af840 2024-09-19T05:47:56.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- 172.21.15.67:0/581481016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 msgr2=0x55753b91f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 --2- 172.21.15.67:0/581481016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b91f4a0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fac24008010 tx=0x7fac24013000 comp rx=0 tx=0).stop 2024-09-19T05:47:56.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- 172.21.15.67:0/581481016 shutdown_connections 2024-09-19T05:47:56.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 --2- 172.21.15.67:0/581481016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b91f4a0 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 --2- 172.21.15.67:0/581481016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 0x55753b91ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 --2- 172.21.15.67:0/581481016 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b86c160 0x55753b91ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- 172.21.15.67:0/581481016 >> 172.21.15.67:0/581481016 conn(0x55753b867d20 msgr2=0x55753b8aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- 172.21.15.67:0/581481016 shutdown_connections 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- 172.21.15.67:0/581481016 wait complete. 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- start start 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 Processor -- start 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 0x55753b922ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b86c160 0x55753b923220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b8ddc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55753b680520 con 0x55753b8af840 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c202c30 con 0x55753b866000 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55753b6b2e30 con 0x55753b86c160 2024-09-19T05:47:56.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 10 client.0 _ll_register_callbacks cb 0x7fac1c006ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32a92640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b8ddc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32a92640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b8ddc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60912/0 (socket says 172.21.15.67:60912) 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32a92640 1 -- 172.21.15.67:0/937176672 learned_addr learned my addr 172.21.15.67:0/937176672 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac31a90640 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b86c160 0x55753b923220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32291640 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 0x55753b922ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32a92640 1 -- 172.21.15.67:0/937176672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b86c160 msgr2=0x55753b923220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32a92640 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b86c160 0x55753b923220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32a92640 1 -- 172.21.15.67:0/937176672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 msgr2=0x55753b922ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32a92640 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 0x55753b922ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32a92640 1 -- 172.21.15.67:0/937176672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753b736330 con 0x55753b8af840 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32291640 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 0x55753b922ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32a92640 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b8ddc10 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fac24009620 tx=0x7fac24004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b376b5f59f6ffebd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac117fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac117fa640 1 -- 172.21.15.67:0/937176672 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24038060 con 0x55753b8af840 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac117fa640 1 -- 172.21.15.67:0/937176672 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fac24015e00 con 0x55753b8af840 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- 172.21.15.67:0/937176672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac24003ba0 con 0x55753b8af840 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac117fa640 1 -- 172.21.15.67:0/937176672 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7fac2403e050 con 0x55753b8af840 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 10 client.10647 fetch_fsmap learned FSMap version 138 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- 172.21.15.67:0/937176672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x55753b36e400 con 0x55753b8af840 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac117fa640 1 -- 172.21.15.67:0/937176672 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac24003ba0 con 0x55753b8af840 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac117fa640 1 -- 172.21.15.67:0/937176672 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7fac24041020 con 0x55753b8af840 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 10 client.10647 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 10 client.10647 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 20 client.10647 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55753b8b0160 0x55753b8de150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 4 client.10647 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac375b1000 1 -- 172.21.15.67:0/937176672 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55753b6c1250 con 0x55753b8b0160 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.666+0000 7fac32291640 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55753b8b0160 0x55753b8de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac32291640 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55753b8b0160 0x55753b8de150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe812512a75147b0 server_cookie=cb36940a2b8b49d3 in_seq=0 out_seq=0 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac117fa640 10 client.10647 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac117fa640 1 -- 172.21.15.67:0/937176672 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55753b6c1250 con 0x55753b8b0160 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac117fa640 10 client.10647 handle_command_reply: tid=0 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 client.10647 shutdown 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 -- 172.21.15.67:0/937176672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 msgr2=0x55753b8ddc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b8ddc10 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fac24009620 tx=0x7fac24004ac0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 -- 172.21.15.67:0/937176672 shutdown_connections 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55753b8b0160 0x55753b8de150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55753b8af840 0x55753b8ddc10 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55753b86c160 0x55753b923220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 --2- 172.21.15.67:0/937176672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55753b866000 0x55753b922ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 -- 172.21.15.67:0/937176672 >> 172.21.15.67:0/937176672 conn(0x55753b867d20 msgr2=0x55753b8c08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac117fa640 0 client.10647 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 -- 172.21.15.67:0/937176672 shutdown_connections 2024-09-19T05:47:56.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 1 -- 172.21.15.67:0/937176672 wait complete. 2024-09-19T05:47:56.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac375b1000 20 client.10647 trim_cache size 0 max 16384 2024-09-19T05:47:56.674 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:47:56.674 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:47:56.674 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "9fa578da-1974-4299-be3a-c84a9d937d0c", 2024-09-19T05:47:56.674 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:47:56.675 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:47:56.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 -- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac180678c0 msgr2=0x7fac18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac180678c0 0x7fac18069d80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fac2c073500 tx=0x7fac28009040 comp rx=0 tx=0).stop 2024-09-19T05:47:56.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 -- 172.21.15.67:0/2730615727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 msgr2=0x7fac2c15b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 0x7fac2c15b740 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0ad040 tx=0x7fac1c01ada0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 -- 172.21.15.67:0/2730615727 shutdown_connections 2024-09-19T05:47:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fac180678c0 0x7fac18069d80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fac2c15d8d0 0x7fac2c072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac2c15c850 0x7fac2c099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 --2- 172.21.15.67:0/2730615727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2c0cf5e0 0x7fac2c15b740 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 -- 172.21.15.67:0/2730615727 >> 172.21.15.67:0/2730615727 conn(0x7fac2c06c0c0 msgr2=0x7fac2c14cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 -- 172.21.15.67:0/2730615727 shutdown_connections 2024-09-19T05:47:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.670+0000 7fac344f5640 1 -- 172.21.15.67:0/2730615727 wait complete. 2024-09-19T05:47:56.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:56.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-19T05:47:56.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.802+0000 7f75d24d9640 1 Processor -- start 2024-09-19T05:47:56.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75d24d9640 1 -- start start 2024-09-19T05:47:56.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75d24d9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f75cc159c60 0x7f75cc0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75d24d9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc06ffd0 0x7f75cc0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75d24d9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f75cc0b3150 0x7f75cc0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75d24d9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f75cc0af710 con 0x7f75cc159c60 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75d24d9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f75cc15d460 con 0x7f75cc0b3150 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75d24d9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f75cc15a040 con 0x7f75cc06ffd0 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75cbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f75cc159c60 0x7f75cc0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75cbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f75cc159c60 0x7f75cc0ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60916/0 (socket says 172.21.15.67:60916) 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75cbfff640 1 -- 172.21.15.67:0/4176198059 learned_addr learned my addr 172.21.15.67:0/4176198059 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/4176198059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc06ffd0 0x7f75cc0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75d0a76640 1 --2- 172.21.15.67:0/4176198059 >> v2:172.21.15.97:3300/0 conn(0x7f75cc0b3150 0x7f75cc0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75cbfff640 1 -- 172.21.15.67:0/4176198059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc06ffd0 msgr2=0x7f75cc0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75cbfff640 1 --2- 172.21.15.67:0/4176198059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc06ffd0 0x7f75cc0aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75cbfff640 1 -- 172.21.15.67:0/4176198059 >> v2:172.21.15.97:3300/0 conn(0x7f75cc0b3150 msgr2=0x7f75cc0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75cbfff640 1 --2- 172.21.15.67:0/4176198059 >> v2:172.21.15.97:3300/0 conn(0x7f75cc0b3150 0x7f75cc0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.806+0000 7f75cbfff640 1 -- 172.21.15.67:0/4176198059 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc15c850 con 0x7f75cc159c60 2024-09-19T05:47:56.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cbfff640 1 --2- 172.21.15.67:0/4176198059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc159c60 0x7f75cc0ad130 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0b2e70 tx=0x7f75bc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378a5bd85aff125a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75caffd640 1 -- 172.21.15.67:0/4176198059 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0aa610 con 0x7f75cc159c60 2024-09-19T05:47:56.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75caffd640 1 -- 172.21.15.67:0/4176198059 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75bc0af070 con 0x7f75cc159c60 2024-09-19T05:47:56.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75caffd640 1 -- 172.21.15.67:0/4176198059 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0aa9d0 con 0x7f75cc159c60 2024-09-19T05:47:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 -- 172.21.15.67:0/4176198059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc159c60 msgr2=0x7f75cc0ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 --2- 172.21.15.67:0/4176198059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc159c60 0x7f75cc0ad130 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0b2e70 tx=0x7f75bc01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 -- 172.21.15.67:0/4176198059 shutdown_connections 2024-09-19T05:47:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 --2- 172.21.15.67:0/4176198059 >> v2:172.21.15.97:3300/0 conn(0x7f75cc0b3150 0x7f75cc0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 --2- 172.21.15.67:0/4176198059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc06ffd0 0x7f75cc0aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 --2- 172.21.15.67:0/4176198059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc159c60 0x7f75cc0ad130 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 -- 172.21.15.67:0/4176198059 >> 172.21.15.67:0/4176198059 conn(0x7f75cc0b1e50 msgr2=0x7f75cc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 -- 172.21.15.67:0/4176198059 shutdown_connections 2024-09-19T05:47:56.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 -- 172.21.15.67:0/4176198059 wait complete. 2024-09-19T05:47:56.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 Processor -- start 2024-09-19T05:47:56.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 -- start start 2024-09-19T05:47:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc06ffd0 0x7f75cc14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75cc0b3150 0x7f75cc1f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc159c60 0x7f75cc09bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc0ad7f0 con 0x7f75cc06ffd0 2024-09-19T05:47:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc0ad670 con 0x7f75cc0b3150 2024-09-19T05:47:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f75cc1605d0 con 0x7f75cc159c60 2024-09-19T05:47:56.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc06ffd0 0x7f75cc14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc06ffd0 0x7f75cc14e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60920/0 (socket says 172.21.15.67:60920) 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cbfff640 1 -- 172.21.15.67:0/1356630133 learned_addr learned my addr 172.21.15.67:0/1356630133 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75cc0b3150 0x7f75cc1f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d0a76640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc159c60 0x7f75cc09bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cbfff640 1 -- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc159c60 msgr2=0x7f75cc09bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cbfff640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc159c60 0x7f75cc09bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cbfff640 1 -- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75cc0b3150 msgr2=0x7f75cc1f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cbfff640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75cc0b3150 0x7f75cc1f4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cbfff640 1 -- 172.21.15.67:0/1356630133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc1f5420 con 0x7f75cc06ffd0 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d0a76640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc159c60 0x7f75cc09bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75cc0b3150 0x7f75cc1f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:56.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75cbfff640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc06ffd0 0x7f75cc14e690 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f75bc01cd90 tx=0x7f75bc01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75c8ff9640 1 -- 172.21.15.67:0/1356630133 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0bd5f0 con 0x7f75cc06ffd0 2024-09-19T05:47:56.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75c8ff9640 1 -- 172.21.15.67:0/1356630133 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75bc0bd7b0 con 0x7f75cc06ffd0 2024-09-19T05:47:56.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75d24d9640 1 -- 172.21.15.67:0/1356630133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75cc09c4f0 con 0x7f75cc06ffd0 2024-09-19T05:47:56.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.810+0000 7f75c8ff9640 1 -- 172.21.15.67:0/1356630133 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0bdba0 con 0x7f75cc06ffd0 2024-09-19T05:47:56.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75d24d9640 1 -- 172.21.15.67:0/1356630133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75cc09cab0 con 0x7f75cc06ffd0 2024-09-19T05:47:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75c8ff9640 1 -- 172.21.15.67:0/1356630133 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75bc0b33f0 con 0x7f75cc06ffd0 2024-09-19T05:47:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75c8ff9640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75b80678c0 0x7f75b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75c8ff9640 1 -- 172.21.15.67:0/1356630133 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f75bc120c00 con 0x7f75cc06ffd0 2024-09-19T05:47:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75b80678c0 0x7f75b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75d5595000 1 Processor -- start 2024-09-19T05:47:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75d5595000 1 -- start start 2024-09-19T05:47:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75b80678c0 0x7f75b8069d80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f75cc09b930 tx=0x7f75c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75d5595000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 0x562223984150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75d5595000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x562223937870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75d5595000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223937db0 0x562223938190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75d5595000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562223821960 con 0x562223984690 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75d5595000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562223765900 con 0x562223937db0 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75d5595000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x562223788d40 con 0x562223983d70 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75cb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x562223937870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75cb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x562223937870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60936/0 (socket says 172.21.15.67:60936) 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75cb7fe640 1 -- 172.21.15.67:0/540949556 learned_addr learned my addr 172.21.15.67:0/540949556 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.814+0000 7f75cbfff640 1 --2- 172.21.15.67:0/540949556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 0x562223984150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d0a76640 1 --2- 172.21.15.67:0/540949556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223937db0 0x562223938190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cb7fe640 1 -- 172.21.15.67:0/540949556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 msgr2=0x562223984150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/540949556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 0x562223984150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cb7fe640 1 -- 172.21.15.67:0/540949556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223937db0 msgr2=0x562223938190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/540949556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223937db0 0x562223938190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cb7fe640 1 -- 172.21.15.67:0/540949556 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222372f580 con 0x562223984690 2024-09-19T05:47:56.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/540949556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x562223937870 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f75c0004350 tx=0x7f75c0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163a8e2c63ae36d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75b1ffb640 1 -- 172.21.15.67:0/540949556 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c000f040 con 0x562223984690 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75b1ffb640 1 -- 172.21.15.67:0/540949556 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c0004440 con 0x562223984690 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75b1ffb640 1 -- 172.21.15.67:0/540949556 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0003820 con 0x562223984690 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- 172.21.15.67:0/540949556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 msgr2=0x562223937870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 --2- 172.21.15.67:0/540949556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x562223937870 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f75c0004350 tx=0x7f75c0011000 comp rx=0 tx=0).stop 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- 172.21.15.67:0/540949556 shutdown_connections 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 --2- 172.21.15.67:0/540949556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223937db0 0x562223938190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 --2- 172.21.15.67:0/540949556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x562223937870 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 --2- 172.21.15.67:0/540949556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 0x562223984150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- 172.21.15.67:0/540949556 >> 172.21.15.67:0/540949556 conn(0x562223965040 msgr2=0x562223967430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- 172.21.15.67:0/540949556 shutdown_connections 2024-09-19T05:47:56.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- 172.21.15.67:0/540949556 wait complete. 2024-09-19T05:47:56.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- start start 2024-09-19T05:47:56.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 Processor -- start 2024-09-19T05:47:56.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223937db0 0x56222398ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223983d70 0x56222398b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223984690 0x56222398b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562223784d00 con 0x562223937db0 2024-09-19T05:47:56.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562223743aa0 con 0x562223983d70 2024-09-19T05:47:56.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x562223722340 con 0x562223984690 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 10 client.0 _ll_register_callbacks cb 0x562223925760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223937db0 0x56222398ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223937db0 0x56222398ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60944/0 (socket says 172.21.15.67:60944) 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cbfff640 1 -- 172.21.15.67:0/3727872481 learned_addr learned my addr 172.21.15.67:0/3727872481 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d0a76640 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223984690 0x56222398b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223983d70 0x56222398b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cbfff640 1 -- 172.21.15.67:0/3727872481 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223984690 msgr2=0x56222398b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cbfff640 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223984690 0x56222398b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cbfff640 1 -- 172.21.15.67:0/3727872481 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223983d70 msgr2=0x56222398b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cbfff640 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223983d70 0x56222398b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cbfff640 1 -- 172.21.15.67:0/3727872481 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56222372bdc0 con 0x562223937db0 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75cbfff640 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223937db0 0x56222398ace0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f75bc097f80 tx=0x7f75bc0f1660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8322b726abff752 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:56.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75aaffd640 1 -- 172.21.15.67:0/3727872481 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc11d060 con 0x562223937db0 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75aaffd640 1 -- 172.21.15.67:0/3727872481 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f75bc0f0460 con 0x562223937db0 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- 172.21.15.67:0/3727872481 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75c0004440 con 0x562223937db0 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75aaffd640 1 -- 172.21.15.67:0/3727872481 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7f75bc10e050 con 0x562223937db0 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 10 client.10659 fetch_fsmap learned FSMap version 138 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75d5595000 1 -- 172.21.15.67:0/3727872481 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x5622237287f0 con 0x562223937db0 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75aaffd640 1 -- 172.21.15.67:0/3727872481 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c0004440 con 0x562223937db0 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.818+0000 7f75aaffd640 1 -- 172.21.15.67:0/3727872481 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7f75bc0c6070 con 0x562223937db0 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 10 client.10659 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 10 client.10659 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 20 client.10659 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x5622239930b0 0x5622239954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 4 client.10659 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 -- 172.21.15.67:0/3727872481 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562223722e10 con 0x5622239930b0 2024-09-19T05:47:56.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x5622239930b0 0x5622239954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75aaffd640 10 client.10659 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x5622239930b0 0x5622239954a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=821f907e44128f70 server_cookie=74b0d57e385f3202 in_seq=0 out_seq=0 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75aaffd640 1 -- 172.21.15.67:0/3727872481 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562223722e10 con 0x5622239930b0 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75aaffd640 10 client.10659 handle_command_reply: tid=0 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 client.10659 shutdown 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 -- 172.21.15.67:0/3727872481 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223937db0 msgr2=0x56222398ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223937db0 0x56222398ace0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f75bc097f80 tx=0x7f75bc0f1660 comp rx=0 tx=0).stop 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 -- 172.21.15.67:0/3727872481 shutdown_connections 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x5622239930b0 0x5622239954a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223984690 0x56222398b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223983d70 0x56222398b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 --2- 172.21.15.67:0/3727872481 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223937db0 0x56222398ace0 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75aaffd640 0 client.10659 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 -- 172.21.15.67:0/3727872481 >> 172.21.15.67:0/3727872481 conn(0x562223965040 msgr2=0x562223936f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 -- 172.21.15.67:0/3727872481 shutdown_connections 2024-09-19T05:47:56.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 1 -- 172.21.15.67:0/3727872481 wait complete. 2024-09-19T05:47:56.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.822+0000 7f75d5595000 20 client.10659 trim_cache size 0 max 16384 2024-09-19T05:47:56.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.838+0000 7f75d5595000 1 Processor -- start 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.838+0000 7f75d5595000 1 -- start start 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.838+0000 7f75d5595000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223937db0 0x5622239911e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.838+0000 7f75d5595000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 0x562223991720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.838+0000 7f75d5595000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x56222393ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.838+0000 7f75d5595000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc2019b0 con 0x562223984690 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.838+0000 7f75d5595000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc2009d0 con 0x562223937db0 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.838+0000 7f75d5595000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f75cc150820 con 0x562223983d70 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d0a76640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x56222393ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d0a76640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x56222393ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60952/0 (socket says 172.21.15.67:60952) 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d0a76640 1 -- 172.21.15.67:0/1661987104 learned_addr learned my addr 172.21.15.67:0/1661987104 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/1661987104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 0x562223991720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d0a76640 1 -- 172.21.15.67:0/1661987104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 msgr2=0x562223991720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d0a76640 1 --2- 172.21.15.67:0/1661987104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 0x562223991720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d0a76640 1 -- 172.21.15.67:0/1661987104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223937db0 msgr2=0x5622239911e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cbfff640 1 --2- 172.21.15.67:0/1661987104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223937db0 0x5622239911e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d0a76640 1 --2- 172.21.15.67:0/1661987104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223937db0 0x5622239911e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d0a76640 1 -- 172.21.15.67:0/1661987104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562223746470 con 0x562223984690 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/1661987104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 0x562223991720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d0a76640 1 --2- 172.21.15.67:0/1661987104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x56222393ec20 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009f40 tx=0x7f75c40077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658e945c5123a702 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75b17fa640 1 -- 172.21.15.67:0/1661987104 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c401b030 con 0x562223984690 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75b17fa640 1 -- 172.21.15.67:0/1661987104 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c40039a0 con 0x562223984690 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75b17fa640 1 -- 172.21.15.67:0/1661987104 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4003b70 con 0x562223984690 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- 172.21.15.67:0/1661987104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 msgr2=0x56222393ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 --2- 172.21.15.67:0/1661987104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x56222393ec20 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009f40 tx=0x7f75c40077c0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- 172.21.15.67:0/1661987104 shutdown_connections 2024-09-19T05:47:56.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 --2- 172.21.15.67:0/1661987104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223984690 0x56222393ec20 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 --2- 172.21.15.67:0/1661987104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223983d70 0x562223991720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 --2- 172.21.15.67:0/1661987104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223937db0 0x5622239911e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- 172.21.15.67:0/1661987104 >> 172.21.15.67:0/1661987104 conn(0x562223965040 msgr2=0x562223990ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- 172.21.15.67:0/1661987104 shutdown_connections 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- 172.21.15.67:0/1661987104 wait complete. 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- start start 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 Processor -- start 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223937db0 0x5622239dfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223983d70 0x5622239e0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223984690 0x5622239e07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56222372ef20 con 0x562223983d70 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc09e040 con 0x562223984690 2024-09-19T05:47:56.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56222373eac0 con 0x562223937db0 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 10 client.0 _ll_register_callbacks cb 0x7f75bc0f1510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223983d70 0x5622239e0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223983d70 0x5622239e0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60968/0 (socket says 172.21.15.67:60968) 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 -- 172.21.15.67:0/1911800875 learned_addr learned my addr 172.21.15.67:0/1911800875 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cbfff640 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223937db0 0x5622239dfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d0a76640 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223984690 0x5622239e07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 -- 172.21.15.67:0/1911800875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223937db0 msgr2=0x5622239dfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223937db0 0x5622239dfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 -- 172.21.15.67:0/1911800875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223984690 msgr2=0x5622239e07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223984690 0x5622239e07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 -- 172.21.15.67:0/1911800875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56222371c640 con 0x562223983d70 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75cb7fe640 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223983d70 0x5622239e0030 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7f75c0004320 tx=0x7f75c0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49379aee9e92420 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:56.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75aaffd640 1 -- 172.21.15.67:0/1911800875 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0027040 con 0x562223983d70 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75aaffd640 1 -- 172.21.15.67:0/1911800875 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f75c0038c50 con 0x562223983d70 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- 172.21.15.67:0/1911800875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75c40039a0 con 0x562223983d70 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75aaffd640 1 -- 172.21.15.67:0/1911800875 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7f75c0038e50 con 0x562223983d70 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 10 client.10665 fetch_fsmap learned FSMap version 138 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.842+0000 7f75d5595000 1 -- 172.21.15.67:0/1911800875 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x5622237203b0 con 0x562223983d70 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75aaffd640 1 -- 172.21.15.67:0/1911800875 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c40039a0 con 0x562223983d70 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75aaffd640 1 -- 172.21.15.67:0/1911800875 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7f75c003f050 con 0x562223983d70 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 10 client.10665 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 10 client.10665 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 20 client.10665 populate_metadata read hostname 'smithi067' 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x5622239e0d00 0x5622239e1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 4 client.10665 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:47:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 -- 172.21.15.67:0/1911800875 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562223796470 con 0x5622239e0d00 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75cbfff640 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x5622239e0d00 0x5622239e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75aaffd640 10 client.10665 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75cbfff640 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x5622239e0d00 0x5622239e1110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcbfe90a83bd2f75 server_cookie=10bab8de62939ea1 in_seq=0 out_seq=0 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75aaffd640 1 -- 172.21.15.67:0/1911800875 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+257 (crc 0 0 0) 0x562223796470 con 0x5622239e0d00 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75aaffd640 10 client.10665 handle_command_reply: tid=0 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 client.10665 shutdown 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 -- 172.21.15.67:0/1911800875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223983d70 msgr2=0x5622239e0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223983d70 0x5622239e0030 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7f75c0004320 tx=0x7f75c0004740 comp rx=0 tx=0).stop 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 -- 172.21.15.67:0/1911800875 shutdown_connections 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x5622239e0d00 0x5622239e1110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562223984690 0x5622239e07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562223983d70 0x5622239e0030 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 --2- 172.21.15.67:0/1911800875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x562223937db0 0x5622239dfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75aaffd640 0 client.10665 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:47:56.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 -- 172.21.15.67:0/1911800875 >> 172.21.15.67:0/1911800875 conn(0x562223965040 msgr2=0x5622239912f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 -- 172.21.15.67:0/1911800875 shutdown_connections 2024-09-19T05:47:56.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 1 -- 172.21.15.67:0/1911800875 wait complete. 2024-09-19T05:47:56.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d5595000 20 client.10665 trim_cache size 0 max 16384 2024-09-19T05:47:56.852 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:47:56.852 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T05:47:56.852 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-19T05:47:56.852 INFO:teuthology.orchestra.run.smithi067.stdout: "9fa578da-1974-4299-be3a-c84a9d937d0c": { 2024-09-19T05:47:56.852 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "~mds0", 2024-09-19T05:47:56.853 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "9fa578da-1974-4299-be3a-c84a9d937d0c", 2024-09-19T05:47:56.853 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive" 2024-09-19T05:47:56.853 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:56.853 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:47:56.853 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:47:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 -- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75b80678c0 msgr2=0x7f75b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75b80678c0 0x7f75b8069d80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f75cc09b930 tx=0x7f75c0008040 comp rx=0 tx=0).stop 2024-09-19T05:47:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 -- 172.21.15.67:0/1356630133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc06ffd0 msgr2=0x7f75cc14e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc06ffd0 0x7f75cc14e690 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f75bc01cd90 tx=0x7f75bc01ad30 comp rx=0 tx=0).stop 2024-09-19T05:47:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 -- 172.21.15.67:0/1356630133 shutdown_connections 2024-09-19T05:47:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f75b80678c0 0x7f75b8069d80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75cc159c60 0x7f75cc09bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75cc0b3150 0x7f75cc1f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 --2- 172.21.15.67:0/1356630133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc06ffd0 0x7f75cc14e690 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:56.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 -- 172.21.15.67:0/1356630133 >> 172.21.15.67:0/1356630133 conn(0x7f75cc0b1e50 msgr2=0x7f75cc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:56.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 -- 172.21.15.67:0/1356630133 shutdown_connections 2024-09-19T05:47:56.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:47:56.846+0000 7f75d24d9640 1 -- 172.21.15.67:0/1356630133 wait complete. 2024-09-19T05:47:56.861 INFO:tasks.cephfs.filesystem:scrub status for tag:9fa578da-1974-4299-be3a-c84a9d937d0c - {'path': '~mds0', 'tag': '9fa578da-1974-4299-be3a-c84a9d937d0c', 'options': 'recursive'} 2024-09-19T05:48:11.316 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:48:11.318 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:48:26.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:26.863 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-19T05:48:27.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.001+0000 7efd073af640 1 Processor -- start 2024-09-19T05:48:27.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.001+0000 7efd073af640 1 -- start start 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 0x7efd000aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efd000b3150 0x7efd000af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd000ad840 con 0x7efd00159c60 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7efd000af710 con 0x7efd000b3150 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efd0015d460 con 0x7efd0006ffd0 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd0594c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efd000b3150 0x7efd000af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd0594c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efd000b3150 0x7efd000af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39834/0 (socket says 172.21.15.67:39834) 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd0594c640 1 -- 172.21.15.67:0/4114999933 learned_addr learned my addr 172.21.15.67:0/4114999933 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd0494a640 1 --2- 172.21.15.67:0/4114999933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 0x7efd000aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd0594c640 1 -- 172.21.15.67:0/4114999933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 msgr2=0x7efd000aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd0594c640 1 --2- 172.21.15.67:0/4114999933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 0x7efd000aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd0594c640 1 -- 172.21.15.67:0/4114999933 >> v1:172.21.15.97:6789/0 conn(0x7efd00159c60 legacy=0x7efd000ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd0594c640 1 -- 172.21.15.67:0/4114999933 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0015a040 con 0x7efd000b3150 2024-09-19T05:48:27.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd0594c640 1 --2- 172.21.15.67:0/4114999933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 0x7efd000af1d0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009e50 tx=0x7efcf801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c8d70188183b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efcf3fff640 1 -- 172.21.15.67:0/4114999933 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf80a57e0 con 0x7efd000b3150 2024-09-19T05:48:27.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efcf3fff640 1 -- 172.21.15.67:0/4114999933 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf80a5980 con 0x7efd000b3150 2024-09-19T05:48:27.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efcf3fff640 1 -- 172.21.15.67:0/4114999933 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf80a5d50 con 0x7efd000b3150 2024-09-19T05:48:27.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 -- 172.21.15.67:0/4114999933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 msgr2=0x7efd000af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 --2- 172.21.15.67:0/4114999933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 0x7efd000af1d0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009e50 tx=0x7efcf801ca00 comp rx=0 tx=0).stop 2024-09-19T05:48:27.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 -- 172.21.15.67:0/4114999933 shutdown_connections 2024-09-19T05:48:27.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 --2- 172.21.15.67:0/4114999933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 0x7efd000af1d0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 --2- 172.21.15.67:0/4114999933 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 0x7efd000aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.005+0000 7efd073af640 1 -- 172.21.15.67:0/4114999933 >> 172.21.15.67:0/4114999933 conn(0x7efd000b1e50 msgr2=0x7efd000b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 -- 172.21.15.67:0/4114999933 shutdown_connections 2024-09-19T05:48:27.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 -- 172.21.15.67:0/4114999933 wait complete. 2024-09-19T05:48:27.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 Processor -- start 2024-09-19T05:48:27.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 -- start start 2024-09-19T05:48:27.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 0x7efd00149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 0x7efd00150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd00159c60 0x7efd001485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efd001605b0 con 0x7efd000b3150 2024-09-19T05:48:27.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efd0015d0f0 con 0x7efd00159c60 2024-09-19T05:48:27.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efd00160730 con 0x7efd0006ffd0 2024-09-19T05:48:27.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0494a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 0x7efd00150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0494a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 0x7efd00150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39844/0 (socket says 172.21.15.67:39844) 2024-09-19T05:48:27.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0494a640 1 -- 172.21.15.67:0/2447575764 learned_addr learned my addr 172.21.15.67:0/2447575764 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0594c640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd00159c60 0x7efd001485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0514b640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 0x7efd00149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0494a640 1 -- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 msgr2=0x7efd00149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0494a640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 0x7efd00149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0494a640 1 -- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd00159c60 msgr2=0x7efd001485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0494a640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd00159c60 0x7efd001485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0494a640 1 -- 172.21.15.67:0/2447575764 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd001508d0 con 0x7efd000b3150 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0594c640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd00159c60 0x7efd001485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0514b640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 0x7efd00149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd0494a640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 0x7efd00150390 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7efcf400d7d0 tx=0x7efcf400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efcf1ffb640 1 -- 172.21.15.67:0/2447575764 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf400b6c0 con 0x7efd000b3150 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efcf1ffb640 1 -- 172.21.15.67:0/2447575764 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf4019070 con 0x7efd000b3150 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efcf1ffb640 1 -- 172.21.15.67:0/2447575764 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf400baa0 con 0x7efd000b3150 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 -- 172.21.15.67:0/2447575764 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd00150b70 con 0x7efd000b3150 2024-09-19T05:48:27.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.009+0000 7efd073af640 1 -- 172.21.15.67:0/2447575764 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0014c400 con 0x7efd000b3150 2024-09-19T05:48:27.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efcf1ffb640 1 -- 172.21.15.67:0/2447575764 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efcf400bc40 con 0x7efd000b3150 2024-09-19T05:48:27.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efcf1ffb640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efce40678c0 0x7efce4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efcf1ffb640 1 -- 172.21.15.67:0/2447575764 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7efcf4086380 con 0x7efd000b3150 2024-09-19T05:48:27.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0514b640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efce40678c0 0x7efce4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0a46b000 1 Processor -- start 2024-09-19T05:48:27.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0a46b000 1 -- start start 2024-09-19T05:48:27.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0514b640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efce40678c0 0x7efce4069d80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7efcfc001670 tx=0x7efcfc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 0x55dfbf37f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf332870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf333190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0a46b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dfbf21c960 con 0x55dfbf37f690 2024-09-19T05:48:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0a46b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55dfbf160900 con 0x55dfbf332db0 2024-09-19T05:48:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0a46b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55dfbf183d40 con 0x55dfbf37ed70 2024-09-19T05:48:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0494a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf332870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0494a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf332870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39854/0 (socket says 172.21.15.67:39854) 2024-09-19T05:48:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0494a640 1 -- 172.21.15.67:0/3066895849 learned_addr learned my addr 172.21.15.67:0/3066895849 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0514b640 1 --2- 172.21.15.67:0/3066895849 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 0x55dfbf37f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0594c640 1 --2- 172.21.15.67:0/3066895849 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf333190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0494a640 1 -- 172.21.15.67:0/3066895849 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 msgr2=0x55dfbf37f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0494a640 1 --2- 172.21.15.67:0/3066895849 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 0x55dfbf37f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0494a640 1 -- 172.21.15.67:0/3066895849 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 msgr2=0x55dfbf333190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0494a640 1 --2- 172.21.15.67:0/3066895849 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf333190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0494a640 1 -- 172.21.15.67:0/3066895849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfbf12a580 con 0x55dfbf37f690 2024-09-19T05:48:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.013+0000 7efd0494a640 1 --2- 172.21.15.67:0/3066895849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf332870 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7efcf4084670 tx=0x7efcf40561c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23119450a1fab80a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efce2ffd640 1 -- 172.21.15.67:0/3066895849 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf406e020 con 0x55dfbf37f690 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efce2ffd640 1 -- 172.21.15.67:0/3066895849 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf4082070 con 0x55dfbf37f690 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efce2ffd640 1 -- 172.21.15.67:0/3066895849 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf405f1c0 con 0x55dfbf37f690 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- 172.21.15.67:0/3066895849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 msgr2=0x55dfbf332870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 --2- 172.21.15.67:0/3066895849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf332870 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7efcf4084670 tx=0x7efcf40561c0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- 172.21.15.67:0/3066895849 shutdown_connections 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 --2- 172.21.15.67:0/3066895849 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf333190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 --2- 172.21.15.67:0/3066895849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf332870 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 --2- 172.21.15.67:0/3066895849 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 0x55dfbf37f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- 172.21.15.67:0/3066895849 >> 172.21.15.67:0/3066895849 conn(0x55dfbf360040 msgr2=0x55dfbf362430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- 172.21.15.67:0/3066895849 shutdown_connections 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- 172.21.15.67:0/3066895849 wait complete. 2024-09-19T05:48:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- start start 2024-09-19T05:48:27.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 Processor -- start 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf385ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf386220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37f690 0x55dfbf386760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dfbf17fd00 con 0x55dfbf37ed70 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55dfbf13eaa0 con 0x55dfbf332db0 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55dfbf11d340 con 0x55dfbf37f690 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 10 client.0 _ll_register_callbacks cb 0x55dfbf320760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0494a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf386220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0494a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf386220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39858/0 (socket says 172.21.15.67:39858) 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0494a640 1 -- 172.21.15.67:0/3984524932 learned_addr learned my addr 172.21.15.67:0/3984524932 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0594c640 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37f690 0x55dfbf386760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0514b640 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf385ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0494a640 1 -- 172.21.15.67:0/3984524932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37f690 msgr2=0x55dfbf386760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0494a640 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37f690 0x55dfbf386760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0494a640 1 -- 172.21.15.67:0/3984524932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 msgr2=0x55dfbf385ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0494a640 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf385ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0494a640 1 -- 172.21.15.67:0/3984524932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfbf126dc0 con 0x55dfbf37ed70 2024-09-19T05:48:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0494a640 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf386220 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7efcf405ec90 tx=0x7efcf4059070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5e162d968f16d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efcdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:48:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efcdbfff640 1 -- 172.21.15.67:0/3984524932 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf405f1c0 con 0x55dfbf37ed70 2024-09-19T05:48:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efcdbfff640 1 -- 172.21.15.67:0/3984524932 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7efcf40860d0 con 0x55dfbf37ed70 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- 172.21.15.67:0/3984524932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf4082070 con 0x55dfbf37ed70 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efcdbfff640 1 -- 172.21.15.67:0/3984524932 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7efcf4052bc0 con 0x55dfbf37ed70 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 10 client.10677 fetch_fsmap learned FSMap version 138 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- 172.21.15.67:0/3984524932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x55dfbf1237f0 con 0x55dfbf37ed70 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efcdbfff640 1 -- 172.21.15.67:0/3984524932 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf4082070 con 0x55dfbf37ed70 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efcdbfff640 1 -- 172.21.15.67:0/3984524932 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7efcf4013070 con 0x55dfbf37ed70 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 10 client.10677 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 10 client.10677 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 20 client.10677 populate_metadata read hostname 'smithi067' 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55dfbf38e0b0 0x55dfbf3904a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 4 client.10677 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.017+0000 7efd0a46b000 1 -- 172.21.15.67:0/3984524932 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfbf11de10 con 0x55dfbf38e0b0 2024-09-19T05:48:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0514b640 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55dfbf38e0b0 0x55dfbf3904a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0514b640 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55dfbf38e0b0 0x55dfbf3904a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2605f52f0a3096e3 server_cookie=368995382b21c713 in_seq=0 out_seq=0 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efcdbfff640 10 client.10677 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efcdbfff640 1 -- 172.21.15.67:0/3984524932 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfbf11de10 con 0x55dfbf38e0b0 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efcdbfff640 10 client.10677 handle_command_reply: tid=0 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 client.10677 shutdown 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 -- 172.21.15.67:0/3984524932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 msgr2=0x55dfbf386220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf386220 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7efcf405ec90 tx=0x7efcf4059070 comp rx=0 tx=0).stop 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 -- 172.21.15.67:0/3984524932 shutdown_connections 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55dfbf38e0b0 0x55dfbf3904a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37f690 0x55dfbf386760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efcdbfff640 0 client.10677 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:48:27.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf386220 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 --2- 172.21.15.67:0/3984524932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf385ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 -- 172.21.15.67:0/3984524932 >> 172.21.15.67:0/3984524932 conn(0x55dfbf360040 msgr2=0x55dfbf331f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 -- 172.21.15.67:0/3984524932 shutdown_connections 2024-09-19T05:48:27.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 1 -- 172.21.15.67:0/3984524932 wait complete. 2024-09-19T05:48:27.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.021+0000 7efd0a46b000 20 client.10677 trim_cache size 0 max 16384 2024-09-19T05:48:27.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.037+0000 7efd0a46b000 1 Processor -- start 2024-09-19T05:48:27.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.037+0000 7efd0a46b000 1 -- start start 2024-09-19T05:48:27.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf393d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 0x55dfbf38c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf38c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efd002040a0 con 0x55dfbf37f690 2024-09-19T05:48:27.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efd00203080 con 0x55dfbf332db0 2024-09-19T05:48:27.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7efd0014d7f0 con 0x55dfbf37ed70 2024-09-19T05:48:27.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0594c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf38c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0594c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf38c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39872/0 (socket says 172.21.15.67:39872) 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0594c640 1 -- 172.21.15.67:0/342337937 learned_addr learned my addr 172.21.15.67:0/342337937 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0514b640 1 --2- 172.21.15.67:0/342337937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf393d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0494a640 1 --2- 172.21.15.67:0/342337937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 0x55dfbf38c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0594c640 1 -- 172.21.15.67:0/342337937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 msgr2=0x55dfbf38c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0594c640 1 --2- 172.21.15.67:0/342337937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 0x55dfbf38c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0594c640 1 -- 172.21.15.67:0/342337937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 msgr2=0x55dfbf393d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0594c640 1 --2- 172.21.15.67:0/342337937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf393d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0594c640 1 -- 172.21.15.67:0/342337937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfbf141470 con 0x55dfbf37f690 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0494a640 1 --2- 172.21.15.67:0/342337937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 0x55dfbf38c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0594c640 1 --2- 172.21.15.67:0/342337937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf38c930 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009e50 tx=0x7efcf80a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f2994be492f2b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efce27fc640 1 -- 172.21.15.67:0/342337937 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf80a57e0 con 0x55dfbf37f690 2024-09-19T05:48:27.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efce27fc640 1 -- 172.21.15.67:0/342337937 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf80a5980 con 0x55dfbf37f690 2024-09-19T05:48:27.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efce27fc640 1 -- 172.21.15.67:0/342337937 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf80a5d70 con 0x55dfbf37f690 2024-09-19T05:48:27.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- 172.21.15.67:0/342337937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 msgr2=0x55dfbf38c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 --2- 172.21.15.67:0/342337937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf38c930 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009e50 tx=0x7efcf80a7070 comp rx=0 tx=0).stop 2024-09-19T05:48:27.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- 172.21.15.67:0/342337937 shutdown_connections 2024-09-19T05:48:27.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 --2- 172.21.15.67:0/342337937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37f690 0x55dfbf38c930 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 --2- 172.21.15.67:0/342337937 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37ed70 0x55dfbf38c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 --2- 172.21.15.67:0/342337937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf393d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- 172.21.15.67:0/342337937 >> 172.21.15.67:0/342337937 conn(0x55dfbf360040 msgr2=0x55dfbf38bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- 172.21.15.67:0/342337937 shutdown_connections 2024-09-19T05:48:27.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- 172.21.15.67:0/342337937 wait complete. 2024-09-19T05:48:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- start start 2024-09-19T05:48:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 Processor -- start 2024-09-19T05:48:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf393330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf3f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37f690 0x55dfbf3f3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dfbf339a30 con 0x55dfbf37ed70 2024-09-19T05:48:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55dfbf14b400 con 0x55dfbf332db0 2024-09-19T05:48:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55dfbf1423f0 con 0x55dfbf37f690 2024-09-19T05:48:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0a46b000 10 client.0 _ll_register_callbacks cb 0x7efcf4055f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0494a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf3f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0494a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf3f2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39888/0 (socket says 172.21.15.67:39888) 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0494a640 1 -- 172.21.15.67:0/828971837 learned_addr learned my addr 172.21.15.67:0/828971837 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0514b640 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf393330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.041+0000 7efd0594c640 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37f690 0x55dfbf3f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0494a640 1 -- 172.21.15.67:0/828971837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37f690 msgr2=0x55dfbf3f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0494a640 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37f690 0x55dfbf3f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0494a640 1 -- 172.21.15.67:0/828971837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 msgr2=0x55dfbf393330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0494a640 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf393330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0494a640 1 -- 172.21.15.67:0/828971837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfbf117640 con 0x55dfbf37ed70 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0494a640 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf3f2ad0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7efcf405aac0 tx=0x7efcf4052920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ff0821bae52ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efcdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efcdbfff640 1 -- 172.21.15.67:0/828971837 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4063070 con 0x55dfbf37ed70 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efcdbfff640 1 -- 172.21.15.67:0/828971837 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7efcf4055ba0 con 0x55dfbf37ed70 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 -- 172.21.15.67:0/828971837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf80a5980 con 0x55dfbf37ed70 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efcdbfff640 1 -- 172.21.15.67:0/828971837 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7efcf406e040 con 0x55dfbf37ed70 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 10 client.10683 fetch_fsmap learned FSMap version 138 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 -- 172.21.15.67:0/828971837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x55dfbf11b3b0 con 0x55dfbf37ed70 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efcdbfff640 1 -- 172.21.15.67:0/828971837 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf80a5980 con 0x55dfbf37ed70 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efcdbfff640 1 -- 172.21.15.67:0/828971837 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7efcf4066030 con 0x55dfbf37ed70 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 10 client.10683 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 10 client.10683 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 20 client.10683 populate_metadata read hostname 'smithi067' 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55dfbf3f3550 0x55dfbf3ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 4 client.10683 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:48:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 -- 172.21.15.67:0/828971837 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dfbf191470 con 0x55dfbf3f3550 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0514b640 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55dfbf3f3550 0x55dfbf3ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0514b640 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55dfbf3f3550 0x55dfbf3ef4c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dd41d6c2a61744d server_cookie=903211fccdb00996 in_seq=0 out_seq=0 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efcdbfff640 10 client.10683 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efcdbfff640 1 -- 172.21.15.67:0/828971837 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dfbf191470 con 0x55dfbf3f3550 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efcdbfff640 10 client.10683 handle_command_reply: tid=0 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 client.10683 shutdown 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 -- 172.21.15.67:0/828971837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 msgr2=0x55dfbf3f2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf3f2ad0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7efcf405aac0 tx=0x7efcf4052920 comp rx=0 tx=0).stop 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 -- 172.21.15.67:0/828971837 shutdown_connections 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x55dfbf3f3550 0x55dfbf3ef4c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55dfbf37f690 0x55dfbf3f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dfbf37ed70 0x55dfbf3f2ad0 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 --2- 172.21.15.67:0/828971837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dfbf332db0 0x55dfbf393330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efcdbfff640 0 client.10683 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:48:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 -- 172.21.15.67:0/828971837 >> 172.21.15.67:0/828971837 conn(0x55dfbf360040 msgr2=0x55dfbf38c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 -- 172.21.15.67:0/828971837 shutdown_connections 2024-09-19T05:48:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 1 -- 172.21.15.67:0/828971837 wait complete. 2024-09-19T05:48:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd0a46b000 20 client.10683 trim_cache size 0 max 16384 2024-09-19T05:48:27.052 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:48:27.052 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-19T05:48:27.052 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {} 2024-09-19T05:48:27.052 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:48:27.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 -- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efce40678c0 msgr2=0x7efce4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efce40678c0 0x7efce4069d80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7efcfc001670 tx=0x7efcfc009040 comp rx=0 tx=0).stop 2024-09-19T05:48:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 -- 172.21.15.67:0/2447575764 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 msgr2=0x7efd00150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 0x7efd00150390 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7efcf400d7d0 tx=0x7efcf400dc90 comp rx=0 tx=0).stop 2024-09-19T05:48:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 -- 172.21.15.67:0/2447575764 shutdown_connections 2024-09-19T05:48:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd00159c60 0x7efd001485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd000b3150 0x7efd00150390 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7efce40678c0 0x7efce4069d80 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 --2- 172.21.15.67:0/2447575764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd0006ffd0 0x7efd00149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 -- 172.21.15.67:0/2447575764 >> 172.21.15.67:0/2447575764 conn(0x7efd000b1e50 msgr2=0x7efd0006ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 -- 172.21.15.67:0/2447575764 shutdown_connections 2024-09-19T05:48:27.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.045+0000 7efd073af640 1 -- 172.21.15.67:0/2447575764 wait complete. 2024-09-19T05:48:27.063 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:48:27.063 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-19T05:48:27.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.181+0000 7f39f2c5e640 1 Processor -- start 2024-09-19T05:48:27.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.181+0000 7f39f2c5e640 1 -- start start 2024-09-19T05:48:27.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.181+0000 7f39f2c5e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f39ec15e660 0x7f39ec0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.181+0000 7f39f2c5e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f39ec0b3a60 0x7f39ec0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.181+0000 7f39f2c5e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f39ec0aef50 0x7f39ec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.181+0000 7f39f2c5e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f39ec15ea40 con 0x7f39ec0b3a60 2024-09-19T05:48:27.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.181+0000 7f39f2c5e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f39ec070610 con 0x7f39ec0aef50 2024-09-19T05:48:27.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.181+0000 7f39f2c5e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f39ec071110 con 0x7f39ec15e660 2024-09-19T05:48:27.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.181+0000 7f39ebfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f39ec0b3a60 0x7f39ec0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39ebfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f39ec0b3a60 0x7f39ec0aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39892/0 (socket says 172.21.15.67:39892) 2024-09-19T05:48:27.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39ebfff640 1 -- 172.21.15.67:0/2333810613 learned_addr learned my addr 172.21.15.67:0/2333810613 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f09fa640 1 --2- 172.21.15.67:0/2333810613 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f39ec15e660 0x7f39ec0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f11fb640 1 --2- 172.21.15.67:0/2333810613 >> v2:172.21.15.97:3300/0 conn(0x7f39ec0aef50 0x7f39ec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39ebfff640 1 -- 172.21.15.67:0/2333810613 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f39ec15e660 msgr2=0x7f39ec0b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39ebfff640 1 --2- 172.21.15.67:0/2333810613 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f39ec15e660 0x7f39ec0b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39ebfff640 1 -- 172.21.15.67:0/2333810613 >> v2:172.21.15.97:3300/0 conn(0x7f39ec0aef50 msgr2=0x7f39ec06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39ebfff640 1 --2- 172.21.15.67:0/2333810613 >> v2:172.21.15.97:3300/0 conn(0x7f39ec0aef50 0x7f39ec06f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39ebfff640 1 -- 172.21.15.67:0/2333810613 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec0b4240 con 0x7f39ec0b3a60 2024-09-19T05:48:27.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39ebfff640 1 --2- 172.21.15.67:0/2333810613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0b3a60 0x7f39ec0aea10 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f39ec06dd60 tx=0x7f39e001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e325cede049d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39eb7fe640 1 -- 172.21.15.67:0/2333810613 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e00a9430 con 0x7f39ec0b3a60 2024-09-19T05:48:27.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39eb7fe640 1 -- 172.21.15.67:0/2333810613 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e00ae070 con 0x7f39ec0b3a60 2024-09-19T05:48:27.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39eb7fe640 1 -- 172.21.15.67:0/2333810613 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e00a97f0 con 0x7f39ec0b3a60 2024-09-19T05:48:27.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f2c5e640 1 -- 172.21.15.67:0/2333810613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0b3a60 msgr2=0x7f39ec0aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f2c5e640 1 --2- 172.21.15.67:0/2333810613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0b3a60 0x7f39ec0aea10 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f39ec06dd60 tx=0x7f39e001c6a0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f2c5e640 1 -- 172.21.15.67:0/2333810613 shutdown_connections 2024-09-19T05:48:27.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f2c5e640 1 --2- 172.21.15.67:0/2333810613 >> v2:172.21.15.97:3300/0 conn(0x7f39ec0aef50 0x7f39ec06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f2c5e640 1 --2- 172.21.15.67:0/2333810613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0b3a60 0x7f39ec0aea10 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f2c5e640 1 --2- 172.21.15.67:0/2333810613 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f39ec15e660 0x7f39ec0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f2c5e640 1 -- 172.21.15.67:0/2333810613 >> 172.21.15.67:0/2333810613 conn(0x7f39ec0b2f40 msgr2=0x7f39ec0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f2c5e640 1 -- 172.21.15.67:0/2333810613 shutdown_connections 2024-09-19T05:48:27.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.185+0000 7f39f2c5e640 1 -- 172.21.15.67:0/2333810613 wait complete. 2024-09-19T05:48:27.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f2c5e640 1 Processor -- start 2024-09-19T05:48:27.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f2c5e640 1 -- start start 2024-09-19T05:48:27.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f2c5e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0aef50 0x7f39ec0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f2c5e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39ec0b3a60 0x7f39ec0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f2c5e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f39ec15e660 0x7f39ec0b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f2c5e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec0b48c0 con 0x7f39ec0aef50 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f2c5e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec0b4740 con 0x7f39ec0b3a60 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f2c5e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f39ec0b4a40 con 0x7f39ec15e660 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f09fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0aef50 0x7f39ec0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f09fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0aef50 0x7f39ec0b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39896/0 (socket says 172.21.15.67:39896) 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f09fa640 1 -- 172.21.15.67:0/1287585018 learned_addr learned my addr 172.21.15.67:0/1287585018 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f11fb640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f39ec15e660 0x7f39ec0b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39ebfff640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39ec0b3a60 0x7f39ec0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f09fa640 1 -- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f39ec15e660 msgr2=0x7f39ec0b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f09fa640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f39ec15e660 0x7f39ec0b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f09fa640 1 -- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39ec0b3a60 msgr2=0x7f39ec0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f09fa640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39ec0b3a60 0x7f39ec0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f09fa640 1 -- 172.21.15.67:0/1287585018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec0b6390 con 0x7f39ec0aef50 2024-09-19T05:48:27.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f09fa640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0aef50 0x7f39ec0b14a0 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00d5f0 tx=0x7f39dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39e97fa640 1 -- 172.21.15.67:0/1287585018 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0125f0 con 0x7f39ec0aef50 2024-09-19T05:48:27.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39e97fa640 1 -- 172.21.15.67:0/1287585018 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc019070 con 0x7f39ec0aef50 2024-09-19T05:48:27.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f2c5e640 1 -- 172.21.15.67:0/1287585018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ec0b6670 con 0x7f39ec0aef50 2024-09-19T05:48:27.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39e97fa640 1 -- 172.21.15.67:0/1287585018 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0129b0 con 0x7f39ec0aef50 2024-09-19T05:48:27.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.189+0000 7f39f2c5e640 1 -- 172.21.15.67:0/1287585018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ec0b2870 con 0x7f39ec0aef50 2024-09-19T05:48:27.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39e97fa640 1 -- 172.21.15.67:0/1287585018 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f39dc012b50 con 0x7f39ec0aef50 2024-09-19T05:48:27.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39e97fa640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39d80678c0 0x7f39d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39e97fa640 1 -- 172.21.15.67:0/1287585018 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f39dc086240 con 0x7f39ec0aef50 2024-09-19T05:48:27.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39ebfff640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39d80678c0 0x7f39d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f5d1a000 1 Processor -- start 2024-09-19T05:48:27.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f5d1a000 1 -- start start 2024-09-19T05:48:27.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39ebfff640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39d80678c0 0x7f39d8069d80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f39e00ad000 tx=0x7f39e00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af71760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af27290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1af27bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559a1ae0ec40 con 0x559a1af71380 2024-09-19T05:48:27.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559a1ad75d50 con 0x559a1af277d0 2024-09-19T05:48:27.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559a1ad30ab0 con 0x559a1af71ca0 2024-09-19T05:48:27.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f09fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af71760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f09fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af71760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39912/0 (socket says 172.21.15.67:39912) 2024-09-19T05:48:27.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f09fa640 1 -- 172.21.15.67:0/1881473010 learned_addr learned my addr 172.21.15.67:0/1881473010 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39ebfff640 1 --2- 172.21.15.67:0/1881473010 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af27290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f11fb640 1 --2- 172.21.15.67:0/1881473010 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1af27bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f09fa640 1 -- 172.21.15.67:0/1881473010 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 msgr2=0x559a1af27290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f09fa640 1 --2- 172.21.15.67:0/1881473010 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af27290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f09fa640 1 -- 172.21.15.67:0/1881473010 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 msgr2=0x559a1af27bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f09fa640 1 --2- 172.21.15.67:0/1881473010 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1af27bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f09fa640 1 -- 172.21.15.67:0/1881473010 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a1ad1c590 con 0x559a1af71380 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f11fb640 1 --2- 172.21.15.67:0/1881473010 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1af27bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39f09fa640 1 --2- 172.21.15.67:0/1881473010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af71760 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f39dc084530 tx=0x7f39dc011400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f762c2f30c58691 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39d27fc640 1 -- 172.21.15.67:0/1881473010 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc086070 con 0x559a1af71380 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39d27fc640 1 -- 172.21.15.67:0/1881473010 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc05a850 con 0x559a1af71380 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.193+0000 7f39d27fc640 1 -- 172.21.15.67:0/1881473010 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc05f080 con 0x559a1af71380 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1881473010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 msgr2=0x559a1af71760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/1881473010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af71760 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f39dc084530 tx=0x7f39dc011400 comp rx=0 tx=0).stop 2024-09-19T05:48:27.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1881473010 shutdown_connections 2024-09-19T05:48:27.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/1881473010 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1af27bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/1881473010 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af27290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/1881473010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af71760 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1881473010 >> 172.21.15.67:0/1881473010 conn(0x559a1af1ebc0 msgr2=0x559a1af25b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1881473010 shutdown_connections 2024-09-19T05:48:27.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1881473010 wait complete. 2024-09-19T05:48:27.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- start start 2024-09-19T05:48:27.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 Processor -- start 2024-09-19T05:48:27.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1af2c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af5b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af5bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559a1ad34400 con 0x559a1af71380 2024-09-19T05:48:27.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559a1ae323a0 con 0x559a1af277d0 2024-09-19T05:48:27.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559a1adb5260 con 0x559a1af71ca0 2024-09-19T05:48:27.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 10 client.0 _ll_register_callbacks cb 0x559a1add7020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:48:27.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39ebfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af5b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39ebfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af5b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39924/0 (socket says 172.21.15.67:39924) 2024-09-19T05:48:27.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39ebfff640 1 -- 172.21.15.67:0/1407660523 learned_addr learned my addr 172.21.15.67:0/1407660523 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f09fa640 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1af2c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f11fb640 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af5bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39ebfff640 1 -- 172.21.15.67:0/1407660523 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 msgr2=0x559a1af5bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39ebfff640 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af5bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39ebfff640 1 -- 172.21.15.67:0/1407660523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 msgr2=0x559a1af2c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39ebfff640 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1af2c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39ebfff640 1 -- 172.21.15.67:0/1407660523 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a1ad18dd0 con 0x559a1af71380 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f09fa640 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1af2c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f11fb640 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af5bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39ebfff640 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af5b5d0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f39e001cb80 tx=0x7f39e001aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd586415f6c6ffc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39cb7fe640 1 -- 172.21.15.67:0/1407660523 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e00c8640 con 0x559a1af71380 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39cb7fe640 1 -- 172.21.15.67:0/1407660523 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f39e00be410 con 0x559a1af71380 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1407660523 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39dc05a850 con 0x559a1af71380 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39cb7fe640 1 -- 172.21.15.67:0/1407660523 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7f39e00c87e0 con 0x559a1af71380 2024-09-19T05:48:27.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 10 client.10695 fetch_fsmap learned FSMap version 138 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1407660523 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x559a1ad15800 con 0x559a1af71380 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39cb7fe640 1 -- 172.21.15.67:0/1407660523 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc05a850 con 0x559a1af71380 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39cb7fe640 1 -- 172.21.15.67:0/1407660523 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7f39e00c6070 con 0x559a1af71380 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 10 client.10695 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 10 client.10695 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 20 client.10695 populate_metadata read hostname 'smithi067' 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x559a1af2cda0 0x559a1af78150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 4 client.10695 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1407660523 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a1ad0fe20 con 0x559a1af2cda0 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f09fa640 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x559a1af2cda0 0x559a1af78150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39cb7fe640 10 client.10695 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.197+0000 7f39f09fa640 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x559a1af2cda0 0x559a1af78150 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db0870d7a232979a server_cookie=a5369b31b335e777 in_seq=0 out_seq=0 2024-09-19T05:48:27.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39cb7fe640 1 -- 172.21.15.67:0/1407660523 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a1ad0fe20 con 0x559a1af2cda0 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39cb7fe640 10 client.10695 handle_command_reply: tid=0 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 client.10695 shutdown 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1407660523 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 msgr2=0x559a1af5b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af5b5d0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f39e001cb80 tx=0x7f39e001aee0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1407660523 shutdown_connections 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x559a1af2cda0 0x559a1af78150 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af5bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71380 0x559a1af5b5d0 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39cb7fe640 0 client.10695 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/1407660523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1af2c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1407660523 >> 172.21.15.67:0/1407660523 conn(0x559a1af1ebc0 msgr2=0x559a1af26280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1407660523 shutdown_connections 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 1 -- 172.21.15.67:0/1407660523 wait complete. 2024-09-19T05:48:27.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.201+0000 7f39f5d1a000 20 client.10695 trim_cache size 0 max 16384 2024-09-19T05:48:27.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f5d1a000 1 Processor -- start 2024-09-19T05:48:27.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f5d1a000 1 -- start start 2024-09-19T05:48:27.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1afe00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71380 0x559a1afe0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71ca0 0x559a1afe0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec2032f0 con 0x559a1af71ca0 2024-09-19T05:48:27.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec149a30 con 0x559a1af277d0 2024-09-19T05:48:27.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f39ec202e40 con 0x559a1af71380 2024-09-19T05:48:27.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f11fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71ca0 0x559a1afe0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f11fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71ca0 0x559a1afe0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39934/0 (socket says 172.21.15.67:39934) 2024-09-19T05:48:27.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.213+0000 7f39f11fb640 1 -- 172.21.15.67:0/3674313253 learned_addr learned my addr 172.21.15.67:0/3674313253 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39ebfff640 1 --2- 172.21.15.67:0/3674313253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71380 0x559a1afe0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f11fb640 1 -- 172.21.15.67:0/3674313253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71380 msgr2=0x559a1afe0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f11fb640 1 --2- 172.21.15.67:0/3674313253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71380 0x559a1afe0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f11fb640 1 -- 172.21.15.67:0/3674313253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 msgr2=0x559a1afe00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f09fa640 1 --2- 172.21.15.67:0/3674313253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1afe00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f11fb640 1 --2- 172.21.15.67:0/3674313253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1afe00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f11fb640 1 -- 172.21.15.67:0/3674313253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a1ad33480 con 0x559a1af71ca0 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f11fb640 1 --2- 172.21.15.67:0/3674313253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71ca0 0x559a1afe0b70 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f39e400c9d0 tx=0x7f39e400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd079b90c90f29c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39d1ffb640 1 -- 172.21.15.67:0/3674313253 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4019070 con 0x559a1af71ca0 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39d1ffb640 1 -- 172.21.15.67:0/3674313253 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e4011b80 con 0x559a1af71ca0 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39d1ffb640 1 -- 172.21.15.67:0/3674313253 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4015460 con 0x559a1af71ca0 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- 172.21.15.67:0/3674313253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71ca0 msgr2=0x559a1afe0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/3674313253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71ca0 0x559a1afe0b70 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f39e400c9d0 tx=0x7f39e400ce90 comp rx=0 tx=0).stop 2024-09-19T05:48:27.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- 172.21.15.67:0/3674313253 shutdown_connections 2024-09-19T05:48:27.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/3674313253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af71ca0 0x559a1afe0b70 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/3674313253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71380 0x559a1afe0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/3674313253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af277d0 0x559a1afe00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- 172.21.15.67:0/3674313253 >> 172.21.15.67:0/3674313253 conn(0x559a1af1ebc0 msgr2=0x559a1af5a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- 172.21.15.67:0/3674313253 shutdown_connections 2024-09-19T05:48:27.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- 172.21.15.67:0/3674313253 wait complete. 2024-09-19T05:48:27.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- start start 2024-09-19T05:48:27.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 Processor -- start 2024-09-19T05:48:27.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af277d0 0x559a1afe5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af71380 0x559a1afe56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af86ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559a1ad1bf30 con 0x559a1af277d0 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559a1ad347d0 con 0x559a1af71380 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x559a1ad75060 con 0x559a1af71ca0 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 10 client.0 _ll_register_callbacks cb 0x7f39e0009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f09fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af277d0 0x559a1afe5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f09fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af277d0 0x559a1afe5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39944/0 (socket says 172.21.15.67:39944) 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f09fa640 1 -- 172.21.15.67:0/716621866 learned_addr learned my addr 172.21.15.67:0/716621866 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f09fa640 1 -- 172.21.15.67:0/716621866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 msgr2=0x559a1af86ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f11fb640 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af86ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39ebfff640 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af71380 0x559a1afe56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f09fa640 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af86ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f09fa640 1 -- 172.21.15.67:0/716621866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af71380 msgr2=0x559a1afe56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f09fa640 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af71380 0x559a1afe56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f09fa640 1 -- 172.21.15.67:0/716621866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a1ad09650 con 0x559a1af277d0 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f09fa640 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af277d0 0x559a1afe5180 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f39dc05eb50 tx=0x7f39dc020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7f21e1551a893 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39cb7fe640 1 -- 172.21.15.67:0/716621866 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc083060 con 0x559a1af277d0 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39cb7fe640 1 -- 172.21.15.67:0/716621866 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f39dc0547a0 con 0x559a1af277d0 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- 172.21.15.67:0/716621866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39e4011b80 con 0x559a1af277d0 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39cb7fe640 1 -- 172.21.15.67:0/716621866 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7f39dc055fe0 con 0x559a1af277d0 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 10 client.10701 fetch_fsmap learned FSMap version 138 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 1 -- 172.21.15.67:0/716621866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x559a1ad0d3c0 con 0x559a1af277d0 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39cb7fe640 1 -- 172.21.15.67:0/716621866 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e4011b80 con 0x559a1af277d0 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39cb7fe640 1 -- 172.21.15.67:0/716621866 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7f39dc013070 con 0x559a1af277d0 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 10 client.10701 fetch_fsmap finished waiting for FSMap version 138 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 10 client.10701 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.217+0000 7f39f5d1a000 20 client.10701 populate_metadata read hostname 'smithi067' 2024-09-19T05:48:27.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x559a1af87410 0x559a1af87820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 4 client.10701 mds_command: new command op to 10458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 -- 172.21.15.67:0/716621866 --> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a1ad83480 con 0x559a1af87410 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39ebfff640 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x559a1af87410 0x559a1af87820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39ebfff640 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x559a1af87410 0x559a1af87820 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0d65127697dc090 server_cookie=7ba609ea3513a45d in_seq=0 out_seq=0 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39cb7fe640 10 client.10701 ms_handle_connect on v2:172.21.15.67:6834/2221933052 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39cb7fe640 1 -- 172.21.15.67:0/716621866 <== mds.0 v2:172.21.15.67:6834/2221933052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a1ad83480 con 0x559a1af87410 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39cb7fe640 10 client.10701 handle_command_reply: tid=0 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 client.10701 shutdown 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 -- 172.21.15.67:0/716621866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af277d0 msgr2=0x559a1afe5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af277d0 0x559a1afe5180 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f39dc05eb50 tx=0x7f39dc020070 comp rx=0 tx=0).stop 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 -- 172.21.15.67:0/716621866 shutdown_connections 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.67:6834/2221933052,v1:172.21.15.67:6835/2221933052] conn(0x559a1af87410 0x559a1af87820 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559a1af71ca0 0x559a1af86ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a1af71380 0x559a1afe56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39cb7fe640 0 client.10701 ms_handle_reset on v2:172.21.15.67:6834/2221933052 2024-09-19T05:48:27.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 --2- 172.21.15.67:0/716621866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a1af277d0 0x559a1afe5180 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 -- 172.21.15.67:0/716621866 >> 172.21.15.67:0/716621866 conn(0x559a1af1ebc0 msgr2=0x559a1af5aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 -- 172.21.15.67:0/716621866 shutdown_connections 2024-09-19T05:48:27.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 1 -- 172.21.15.67:0/716621866 wait complete. 2024-09-19T05:48:27.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f5d1a000 20 client.10701 trim_cache size 0 max 16384 2024-09-19T05:48:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-19T05:48:27.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 -- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39d80678c0 msgr2=0x7f39d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39d80678c0 0x7f39d8069d80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f39e00ad000 tx=0x7f39e00a7000 comp rx=0 tx=0).stop 2024-09-19T05:48:27.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 -- 172.21.15.67:0/1287585018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0aef50 msgr2=0x7f39ec0b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0aef50 0x7f39ec0b14a0 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00d5f0 tx=0x7f39dc00dab0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 -- 172.21.15.67:0/1287585018 shutdown_connections 2024-09-19T05:48:27.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39d80678c0 0x7f39d8069d80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f39ec15e660 0x7f39ec0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39ec0b3a60 0x7f39ec0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 --2- 172.21.15.67:0/1287585018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39ec0aef50 0x7f39ec0b14a0 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 -- 172.21.15.67:0/1287585018 >> 172.21.15.67:0/1287585018 conn(0x7f39ec0b2f40 msgr2=0x7f39ec14bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 -- 172.21.15.67:0/1287585018 shutdown_connections 2024-09-19T05:48:27.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.221+0000 7f39f2c5e640 1 -- 172.21.15.67:0/1287585018 wait complete. 2024-09-19T05:48:27.238 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T05:48:27.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.345+0000 7ff2d8e86640 1 Processor -- start 2024-09-19T05:48:27.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.345+0000 7ff2d8e86640 1 -- start start 2024-09-19T05:48:27.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d8e86640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff2d415e640 0x7ff2d40b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d8e86640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2d40ae0a0 0x7ff2d40b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d8e86640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d40b5b90 con 0x7ff2d40b2430 2024-09-19T05:48:27.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d8e86640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d40b4780 con 0x7ff2d415e640 2024-09-19T05:48:27.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d8e86640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d40b15f0 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d2d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff2d40b2430 0x7ff2d406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58674/0 (socket says 172.21.15.67:58674) 2024-09-19T05:48:27.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d2d9d640 1 -- 172.21.15.67:0/881905193 learned_addr learned my addr 172.21.15.67:0/881905193 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:27.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d259c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff2d415e640 0x7ff2d40b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d1d9b640 1 --2- 172.21.15.67:0/881905193 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2d40ae0a0 0x7ff2d40b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d159a640 1 -- 172.21.15.67:0/881905193 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716025248 0 0) 0x7ff2cc0014a0 con 0x7ff2d40b2430 2024-09-19T05:48:27.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d159a640 1 -- 172.21.15.67:0/881905193 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2bc003530 con 0x7ff2d40b2430 2024-09-19T05:48:27.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d259c640 1 -- 172.21.15.67:0/881905193 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2d40ae0a0 msgr2=0x7ff2d40b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d259c640 1 --2- 172.21.15.67:0/881905193 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2d40ae0a0 0x7ff2d40b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d259c640 1 -- 172.21.15.67:0/881905193 >> v1:172.21.15.67:6789/0 conn(0x7ff2d40b2430 legacy=0x7ff2d406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d259c640 1 -- 172.21.15.67:0/881905193 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d40ae4e0 con 0x7ff2d415e640 2024-09-19T05:48:27.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d259c640 1 --2- 172.21.15.67:0/881905193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d415e640 0x7ff2d40b6050 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80097c0 tx=0x7ff2c801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfec7f0b1f62bff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d159a640 1 -- 172.21.15.67:0/881905193 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80b0070 con 0x7ff2d415e640 2024-09-19T05:48:27.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d159a640 1 -- 172.21.15.67:0/881905193 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c80ab600 con 0x7ff2d415e640 2024-09-19T05:48:27.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.349+0000 7ff2d159a640 1 -- 172.21.15.67:0/881905193 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80ab9d0 con 0x7ff2d415e640 2024-09-19T05:48:27.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- 172.21.15.67:0/881905193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d415e640 msgr2=0x7ff2d40b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 --2- 172.21.15.67:0/881905193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d415e640 0x7ff2d40b6050 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80097c0 tx=0x7ff2c801c380 comp rx=0 tx=0).stop 2024-09-19T05:48:27.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- 172.21.15.67:0/881905193 shutdown_connections 2024-09-19T05:48:27.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 --2- 172.21.15.67:0/881905193 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2d40ae0a0 0x7ff2d40b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 --2- 172.21.15.67:0/881905193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d415e640 0x7ff2d40b6050 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- 172.21.15.67:0/881905193 >> 172.21.15.67:0/881905193 conn(0x7ff2d409aa30 msgr2=0x7ff2d40b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- 172.21.15.67:0/881905193 shutdown_connections 2024-09-19T05:48:27.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- 172.21.15.67:0/881905193 wait complete. 2024-09-19T05:48:27.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 Processor -- start 2024-09-19T05:48:27.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- start start 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d40ae0a0 0x7ff2d415f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2d40b2430 0x7ff2d4157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2d415e640 0x7ff2d4155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d40b0910 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d40b0790 con 0x7ff2d415e640 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d40b40c0 con 0x7ff2d40b2430 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d40ae0a0 0x7ff2d415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d40ae0a0 0x7ff2d415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39960/0 (socket says 172.21.15.67:39960) 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d259c640 1 -- 172.21.15.67:0/3750865039 learned_addr learned my addr 172.21.15.67:0/3750865039 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d1d9b640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2d40b2430 0x7ff2d4157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d259c640 1 -- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2d40b2430 msgr2=0x7ff2d4157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d259c640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2d40b2430 0x7ff2d4157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d259c640 1 -- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2d415e640 msgr2=0x7ff2d4155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d259c640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2d415e640 0x7ff2d4155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d259c640 1 -- 172.21.15.67:0/3750865039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d41568f0 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d259c640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d40ae0a0 0x7ff2d415f500 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80097c0 tx=0x7ff2c801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2c2ffd640 1 -- 172.21.15.67:0/3750865039 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80b0050 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2c2ffd640 1 -- 172.21.15.67:0/3750865039 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c80bc070 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2c2ffd640 1 -- 172.21.15.67:0/3750865039 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8006e20 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- 172.21.15.67:0/3750865039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d4156bd0 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.353+0000 7ff2d8e86640 1 -- 172.21.15.67:0/3750865039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d415efe0 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.357+0000 7ff2d8e86640 1 -- 172.21.15.67:0/3750865039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d40b6cf0 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.357+0000 7ff2c2ffd640 1 -- 172.21.15.67:0/3750865039 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2c80b5830 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.357+0000 7ff2c2ffd640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2b40678c0 0x7ff2b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.357+0000 7ff2c2ffd640 1 -- 172.21.15.67:0/3750865039 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7ff2c81204d0 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.357+0000 7ff2d1d9b640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2b40678c0 0x7ff2b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.357+0000 7ff2d1d9b640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2b40678c0 0x7ff2b4069d80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4073d90 tx=0x7ff2c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.361+0000 7ff2c2ffd640 1 -- 172.21.15.67:0/3750865039 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff2c8016090 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.553+0000 7ff2d8e86640 1 -- 172.21.15.67:0/3750865039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff2d4162210 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.553+0000 7ff2c2ffd640 1 -- 172.21.15.67:0/3750865039 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff2c80f0f50 con 0x7ff2d40ae0a0 2024-09-19T05:48:27.555 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:27.555 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 -- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2b40678c0 msgr2=0x7ff2b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2b40678c0 0x7ff2b4069d80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4073d90 tx=0x7ff2c4008040 comp rx=0 tx=0).stop 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 -- 172.21.15.67:0/3750865039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d40ae0a0 msgr2=0x7ff2d415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d40ae0a0 0x7ff2d415f500 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80097c0 tx=0x7ff2c801abc0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 -- 172.21.15.67:0/3750865039 shutdown_connections 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2d415e640 0x7ff2d4155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff2b40678c0 0x7ff2b4069d80 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff2d40b2430 0x7ff2d4157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 --2- 172.21.15.67:0/3750865039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2d40ae0a0 0x7ff2d415f500 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 -- 172.21.15.67:0/3750865039 >> 172.21.15.67:0/3750865039 conn(0x7ff2d409aa30 msgr2=0x7ff2d4162730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 -- 172.21.15.67:0/3750865039 shutdown_connections 2024-09-19T05:48:27.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.557+0000 7ff2d8e86640 1 -- 172.21.15.67:0/3750865039 wait complete. 2024-09-19T05:48:27.574 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:48:27.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:48:27.681 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:48:27.761 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:48:27.761 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:48:27.762 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:48:27.762 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:48:27.768 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:48:27.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.941+0000 7f5a4b17e640 1 Processor -- start 2024-09-19T05:48:27.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.941+0000 7f5a4b17e640 1 -- start start 2024-09-19T05:48:27.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a4415b710 0x7f5a44071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5a4415baf0 0x7f5a4415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a440aef40 0x7f5a440af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5a440b3070 con 0x7f5a4415b710 2024-09-19T05:48:27.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5a440b32e0 con 0x7f5a4415baf0 2024-09-19T05:48:27.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5a440b35c0 con 0x7f5a440aef40 2024-09-19T05:48:27.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a48f1a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a4415b710 0x7f5a44071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a48f1a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a4415b710 0x7f5a44071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39974/0 (socket says 172.21.15.67:39974) 2024-09-19T05:48:27.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a48f1a640 1 -- 172.21.15.67:0/1063479659 learned_addr learned my addr 172.21.15.67:0/1063479659 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4971b640 1 --2- 172.21.15.67:0/1063479659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a440aef40 0x7f5a440af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a43fff640 1 --2- 172.21.15.67:0/1063479659 >> v2:172.21.15.97:3300/0 conn(0x7f5a4415baf0 0x7f5a4415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a48f1a640 1 -- 172.21.15.67:0/1063479659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a440aef40 msgr2=0x7f5a440af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a48f1a640 1 --2- 172.21.15.67:0/1063479659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a440aef40 0x7f5a440af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a48f1a640 1 -- 172.21.15.67:0/1063479659 >> v2:172.21.15.97:3300/0 conn(0x7f5a4415baf0 msgr2=0x7f5a4415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:27.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a48f1a640 1 --2- 172.21.15.67:0/1063479659 >> v2:172.21.15.97:3300/0 conn(0x7f5a4415baf0 0x7f5a4415bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a48f1a640 1 -- 172.21.15.67:0/1063479659 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a440b38a0 con 0x7f5a4415b710 2024-09-19T05:48:27.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a48f1a640 1 --2- 172.21.15.67:0/1063479659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a4415b710 0x7f5a44071e80 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f5a440b34f0 tx=0x7f5a3801cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08359925cd0f029 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a437fe640 1 -- 172.21.15.67:0/1063479659 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380aa430 con 0x7f5a4415b710 2024-09-19T05:48:27.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a437fe640 1 -- 172.21.15.67:0/1063479659 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a380af070 con 0x7f5a4415b710 2024-09-19T05:48:27.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a437fe640 1 -- 172.21.15.67:0/1063479659 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380aa7f0 con 0x7f5a4415b710 2024-09-19T05:48:27.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1063479659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a4415b710 msgr2=0x7f5a44071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 --2- 172.21.15.67:0/1063479659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a4415b710 0x7f5a44071e80 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f5a440b34f0 tx=0x7f5a3801cf50 comp rx=0 tx=0).stop 2024-09-19T05:48:27.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1063479659 shutdown_connections 2024-09-19T05:48:27.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 --2- 172.21.15.67:0/1063479659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a440aef40 0x7f5a440af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 --2- 172.21.15.67:0/1063479659 >> v2:172.21.15.97:3300/0 conn(0x7f5a4415baf0 0x7f5a4415bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.945+0000 7f5a4b17e640 1 --2- 172.21.15.67:0/1063479659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a4415b710 0x7f5a44071e80 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1063479659 >> 172.21.15.67:0/1063479659 conn(0x7f5a440d0080 msgr2=0x7f5a440d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:27.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1063479659 shutdown_connections 2024-09-19T05:48:27.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1063479659 wait complete. 2024-09-19T05:48:27.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 Processor -- start 2024-09-19T05:48:27.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 -- start start 2024-09-19T05:48:27.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a440aef40 0x7f5a44096790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a4415b710 0x7f5a44154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a4415baf0 0x7f5a44154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5a440b48b0 con 0x7f5a440aef40 2024-09-19T05:48:27.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5a440b4a30 con 0x7f5a4415baf0 2024-09-19T05:48:27.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5a440b4bb0 con 0x7f5a4415b710 2024-09-19T05:48:27.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a48f1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a440aef40 0x7f5a44096790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a48f1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a440aef40 0x7f5a44096790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39976/0 (socket says 172.21.15.67:39976) 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a48f1a640 1 -- 172.21.15.67:0/1783497729 learned_addr learned my addr 172.21.15.67:0/1783497729 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4971b640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a4415baf0 0x7f5a44154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a48f1a640 1 -- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a4415b710 msgr2=0x7f5a44154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a43fff640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a4415b710 0x7f5a44154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a48f1a640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a4415b710 0x7f5a44154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a48f1a640 1 -- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a4415baf0 msgr2=0x7f5a44154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a48f1a640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a4415baf0 0x7f5a44154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a48f1a640 1 -- 172.21.15.67:0/1783497729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a44096cd0 con 0x7f5a440aef40 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4971b640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a4415baf0 0x7f5a44154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a43fff640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a4415b710 0x7f5a44154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a48f1a640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a440aef40 0x7f5a44096790 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f5a3801cd90 tx=0x7f5a3801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a417fa640 1 -- 172.21.15.67:0/1783497729 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380bd5f0 con 0x7f5a440aef40 2024-09-19T05:48:27.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a417fa640 1 -- 172.21.15.67:0/1783497729 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a380bd790 con 0x7f5a440aef40 2024-09-19T05:48:27.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1783497729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a441483e0 con 0x7f5a440aef40 2024-09-19T05:48:27.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a417fa640 1 -- 172.21.15.67:0/1783497729 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380bdb60 con 0x7f5a440aef40 2024-09-19T05:48:27.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.949+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1783497729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4414b0c0 con 0x7f5a440aef40 2024-09-19T05:48:27.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.953+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1783497729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a44071e80 con 0x7f5a440aef40 2024-09-19T05:48:27.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.953+0000 7f5a417fa640 1 -- 172.21.15.67:0/1783497729 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a380b33f0 con 0x7f5a440aef40 2024-09-19T05:48:27.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.953+0000 7f5a417fa640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a280678c0 0x7f5a28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:27.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.953+0000 7f5a417fa640 1 -- 172.21.15.67:0/1783497729 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f5a381208a0 con 0x7f5a440aef40 2024-09-19T05:48:27.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.953+0000 7f5a43fff640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a280678c0 0x7f5a28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:27.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.953+0000 7f5a43fff640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a280678c0 0x7f5a28069d80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5a4414de20 tx=0x7f5a30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:27.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:27.957+0000 7f5a417fa640 1 -- 172.21.15.67:0/1783497729 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5a380c3060 con 0x7f5a440aef40 2024-09-19T05:48:28.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.129+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1783497729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5a440b5020 con 0x7f5a440aef40 2024-09-19T05:48:28.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.129+0000 7f5a417fa640 1 -- 172.21.15.67:0/1783497729 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v193) ==== 80+0+0 (secure 0 0 0) 0x7f5a38016110 con 0x7f5a440aef40 2024-09-19T05:48:28.131 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:48:28.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a280678c0 msgr2=0x7f5a28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:28.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a280678c0 0x7f5a28069d80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5a4414de20 tx=0x7f5a30008040 comp rx=0 tx=0).stop 2024-09-19T05:48:28.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1783497729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a440aef40 msgr2=0x7f5a44096790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:28.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a440aef40 0x7f5a44096790 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f5a3801cd90 tx=0x7f5a3801ad30 comp rx=0 tx=0).stop 2024-09-19T05:48:28.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1783497729 shutdown_connections 2024-09-19T05:48:28.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a4415baf0 0x7f5a44154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5a280678c0 0x7f5a28069d80 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a4415b710 0x7f5a44154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 --2- 172.21.15.67:0/1783497729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a440aef40 0x7f5a44096790 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1783497729 >> 172.21.15.67:0/1783497729 conn(0x7f5a440d0080 msgr2=0x7f5a44150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:28.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1783497729 shutdown_connections 2024-09-19T05:48:28.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.133+0000 7f5a4b17e640 1 -- 172.21.15.67:0/1783497729 wait complete. 2024-09-19T05:48:28.149 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:48:28.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:28.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:48:28.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[87903]: fuse finished with error 0 and tester_r 0 2024-09-19T05:48:28.164 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:48:28.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:28.165 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:48:28.345 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:48:28.345 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:48:28.345 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:48:28.352 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:48:28.352 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:48:28.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:28.353 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:48:28.411 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:48:28.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:48:28.413 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:48:28.413 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:48:28.413 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:48:28.420 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:48:28.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:48:28.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:28.421 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:48:28.470 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:48:28.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:48:28.472 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:48:28.472 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:48:28.472 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:48:28.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:48:28.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:48:28.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:28.478 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:48:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:48:28.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:48:28.533 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:48:28.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e1ef50640 1 Processor -- start 2024-09-19T05:48:28.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e1ef50640 1 -- start start 2024-09-19T05:48:28.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e1ef50640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e181555f0 0x7f2e180b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:28.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e1ef50640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e181559d0 con 0x7f2e180b6040 2024-09-19T05:48:28.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e1ef50640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1815ec90 con 0x7f2e1806c3d0 2024-09-19T05:48:28.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e1ef50640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1815f8a0 con 0x7f2e181555f0 2024-09-19T05:48:28.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e17fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2e180b6040 0x7f2e1806bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58682/0 (socket says 172.21.15.67:58682) 2024-09-19T05:48:28.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e17fff640 1 -- 172.21.15.67:0/3515581602 learned_addr learned my addr 172.21.15.67:0/3515581602 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:28.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e1ccec640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e181555f0 0x7f2e180b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:28.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1734917077 0 0) 0x7f2e181559d0 con 0x7f2e180b6040 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e00003530 con 0x7f2e180b6040 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1660601384 0 0) 0x7f2e00003530 con 0x7f2e180b6040 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e181555f0 msgr2=0x7f2e180b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e181555f0 0x7f2e180b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 >> v1:172.21.15.97:6789/0 conn(0x7f2e1806c3d0 legacy=0x7f2e180ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1815ef70 con 0x7f2e180b6040 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f2e0c001680 con 0x7f2e180b6040 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 >> v1:172.21.15.67:6789/0 conn(0x7f2e180b6040 legacy=0x7f2e1806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e000039f0 0x7f2e00003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 0x7f2e00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e181555f0 0x7f2e000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0000ba80 con 0x7f2e00004810 2024-09-19T05:48:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0000bc00 con 0x7f2e000039f0 2024-09-19T05:48:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0000be00 con 0x7f2e181555f0 2024-09-19T05:48:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e17fff640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 0x7f2e00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e1ccec640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e000039f0 0x7f2e00003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e1d4ed640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e181555f0 0x7f2e000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e17fff640 1 -- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e181555f0 msgr2=0x7f2e000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e17fff640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e181555f0 0x7f2e000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e17fff640 1 -- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e000039f0 msgr2=0x7f2e00003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e17fff640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e000039f0 0x7f2e00003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e17fff640 1 -- 172.21.15.67:0/3515581602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e00003530 con 0x7f2e00004810 2024-09-19T05:48:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.665+0000 7f2e1ccec640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e000039f0 0x7f2e00003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e17fff640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 0x7f2e00004c90 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f2e180b58f0 tx=0x7f2e0c01f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7cf1862bb91709 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c007d00 con 0x7f2e00004810 2024-09-19T05:48:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c005b00 con 0x7f2e00004810 2024-09-19T05:48:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e177fe640 1 -- 172.21.15.67:0/3515581602 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c007070 con 0x7f2e00004810 2024-09-19T05:48:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3515581602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 msgr2=0x7f2e00004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e1ef50640 1 --2- 172.21.15.67:0/3515581602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 0x7f2e00004c90 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f2e180b58f0 tx=0x7f2e0c01f350 comp rx=0 tx=0).stop 2024-09-19T05:48:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e1d4ed640 1 -- 172.21.15.67:0/3515581602 reap_dead start 2024-09-19T05:48:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3515581602 shutdown_connections 2024-09-19T05:48:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3515581602 >> 172.21.15.67:0/3515581602 conn(0x7f2e1809aa30 msgr2=0x7f2e180b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3515581602 shutdown_connections 2024-09-19T05:48:28.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3515581602 wait complete. 2024-09-19T05:48:28.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.669+0000 7f2e1ef50640 1 Processor -- start 2024-09-19T05:48:28.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ef50640 1 -- start start 2024-09-19T05:48:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ef50640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 0x7f2e18147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ef50640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e18151d50 0x7f2e1809eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ef50640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e180b0c10 0x7f2e180b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ef50640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2e180b6ef0 con 0x7f2e00004810 2024-09-19T05:48:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ef50640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1815f530 con 0x7f2e180b0c10 2024-09-19T05:48:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ef50640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2e180b5b00 con 0x7f2e18151d50 2024-09-19T05:48:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ccec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 0x7f2e18147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ccec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 0x7f2e18147b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40000/0 (socket says 172.21.15.67:40000) 2024-09-19T05:48:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ccec640 1 -- 172.21.15.67:0/3438940285 learned_addr learned my addr 172.21.15.67:0/3438940285 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1d4ed640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e180b0c10 0x7f2e180b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e17fff640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e18151d50 0x7f2e1809eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ccec640 1 -- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e18151d50 msgr2=0x7f2e1809eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ccec640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e18151d50 0x7f2e1809eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ccec640 1 -- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e180b0c10 msgr2=0x7f2e180b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ccec640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e180b0c10 0x7f2e180b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ccec640 1 -- 172.21.15.67:0/3438940285 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e18153d60 con 0x7f2e00004810 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e17fff640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e18151d50 0x7f2e1809eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ccec640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 0x7f2e18147b00 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f2e080116a0 tx=0x7f2e08011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e157fa640 1 -- 172.21.15.67:0/3438940285 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08004220 con 0x7f2e00004810 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e157fa640 1 -- 172.21.15.67:0/3438940285 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e080043c0 con 0x7f2e00004810 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3438940285 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e18148040 con 0x7f2e00004810 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e157fa640 1 -- 172.21.15.67:0/3438940285 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800f980 con 0x7f2e00004810 2024-09-19T05:48:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3438940285 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e181542e0 con 0x7f2e00004810 2024-09-19T05:48:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3438940285 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e1806bcc0 con 0x7f2e00004810 2024-09-19T05:48:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e157fa640 1 -- 172.21.15.67:0/3438940285 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e0800fb20 con 0x7f2e00004810 2024-09-19T05:48:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e157fa640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e040678c0 0x7f2e04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.673+0000 7f2e157fa640 1 -- 172.21.15.67:0/3438940285 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f2e080864e0 con 0x7f2e00004810 2024-09-19T05:48:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.677+0000 7f2e17fff640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e040678c0 0x7f2e04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:28.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.677+0000 7f2e17fff640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e040678c0 0x7f2e04069d80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0ae000 tx=0x7f2e1815ee60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.681+0000 7f2e157fa640 1 -- 172.21.15.67:0/3438940285 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f2e08019030 con 0x7f2e00004810 2024-09-19T05:48:28.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.877+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3438940285 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e1815c610 con 0x7f2e00004810 2024-09-19T05:48:28.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e157fa640 1 -- 172.21.15.67:0/3438940285 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+5239 (secure 0 0 0) 0x7f2e08056eb0 con 0x7f2e00004810 2024-09-19T05:48:28.881 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:28.881 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":138,"btime":"2024-09-19T05:47:45:972719+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/4294715394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4294715394},{"type":"v1","addr":"172.21.15.97:6835","nonce":4294715394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":7139,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1234134657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1234134657},{"type":"v1","addr":"172.21.15.97:6837","nonce":1234134657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":10449,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2992690092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2992690092},{"type":"v1","addr":"172.21.15.67:6833","nonce":2992690092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:47:42.304037+0000","modified":"2024-09-19T05:47:45.355124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10458":{"gid":10458,"name":"c","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2221933052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2221933052},{"type":"v1","addr":"172.21.15.67:6835","nonce":2221933052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10458,"qdb_cluster":[10458]},"id":13}]} 2024-09-19T05:48:28.881 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 138 2024-09-19T05:48:28.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e040678c0 msgr2=0x7f2e04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:28.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e040678c0 0x7f2e04069d80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0ae000 tx=0x7f2e1815ee60 comp rx=0 tx=0).stop 2024-09-19T05:48:28.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3438940285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 msgr2=0x7f2e18147b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 0x7f2e18147b00 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f2e080116a0 tx=0x7f2e08011b60 comp rx=0 tx=0).stop 2024-09-19T05:48:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3438940285 shutdown_connections 2024-09-19T05:48:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e180b0c10 0x7f2e180b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2e040678c0 0x7f2e04069d80 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e18151d50 0x7f2e1809eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 --2- 172.21.15.67:0/3438940285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e00004810 0x7f2e18147b00 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3438940285 >> 172.21.15.67:0/3438940285 conn(0x7f2e1809aa30 msgr2=0x7f2e1815fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3438940285 shutdown_connections 2024-09-19T05:48:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:28.881+0000 7f2e1ef50640 1 -- 172.21.15.67:0/3438940285 wait complete. 2024-09-19T05:48:28.901 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:48:29.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.017+0000 7fa3f1c23640 1 Processor -- start 2024-09-19T05:48:29.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.017+0000 7fa3f1c23640 1 -- start start 2024-09-19T05:48:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3f1c23640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3ec15e640 0x7fa3ec0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3f1c23640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3ec0b6cf0 0x7fa3ec06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3f1c23640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3ec0b5b90 con 0x7fa3ec0ae0a0 2024-09-19T05:48:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3f1c23640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa3ec0b4780 con 0x7fa3ec15e640 2024-09-19T05:48:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3f1c23640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa3ec0ae510 con 0x7fa3ec0b6cf0 2024-09-19T05:48:29.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3eb7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3ec15e640 0x7fa3ec0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3eb7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3ec15e640 0x7fa3ec0b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40002/0 (socket says 172.21.15.67:40002) 2024-09-19T05:48:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3eb7fe640 1 -- 172.21.15.67:0/383538218 learned_addr learned my addr 172.21.15.67:0/383538218 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3ebfff640 1 --2- 172.21.15.67:0/383538218 >> v2:172.21.15.97:3300/0 conn(0x7fa3ec0b6cf0 0x7fa3ec06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3eb7fe640 1 -- 172.21.15.67:0/383538218 >> v2:172.21.15.97:3300/0 conn(0x7fa3ec0b6cf0 msgr2=0x7fa3ec06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3eb7fe640 1 --2- 172.21.15.67:0/383538218 >> v2:172.21.15.97:3300/0 conn(0x7fa3ec0b6cf0 0x7fa3ec06bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3eb7fe640 1 -- 172.21.15.67:0/383538218 >> v1:172.21.15.97:6789/0 conn(0x7fa3ec0ae0a0 legacy=0x7fa3ec0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:29.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3eb7fe640 1 -- 172.21.15.67:0/383538218 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec0b15f0 con 0x7fa3ec15e640 2024-09-19T05:48:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3eb7fe640 1 --2- 172.21.15.67:0/383538218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 0x7fa3ec0b6050 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0d21f0 tx=0x7fa3dc01c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5003ea58220e1e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3ea7fc640 1 -- 172.21.15.67:0/383538218 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0b0070 con 0x7fa3ec15e640 2024-09-19T05:48:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3ea7fc640 1 -- 172.21.15.67:0/383538218 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc0ab600 con 0x7fa3ec15e640 2024-09-19T05:48:29.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.021+0000 7fa3ea7fc640 1 -- 172.21.15.67:0/383538218 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0ab9d0 con 0x7fa3ec15e640 2024-09-19T05:48:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- 172.21.15.67:0/383538218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 msgr2=0x7fa3ec0b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 --2- 172.21.15.67:0/383538218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 0x7fa3ec0b6050 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0d21f0 tx=0x7fa3dc01c1b0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- 172.21.15.67:0/383538218 shutdown_connections 2024-09-19T05:48:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 --2- 172.21.15.67:0/383538218 >> v2:172.21.15.97:3300/0 conn(0x7fa3ec0b6cf0 0x7fa3ec06bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 --2- 172.21.15.67:0/383538218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 0x7fa3ec0b6050 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- 172.21.15.67:0/383538218 >> 172.21.15.67:0/383538218 conn(0x7fa3ec09aa30 msgr2=0x7fa3ec0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- 172.21.15.67:0/383538218 shutdown_connections 2024-09-19T05:48:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- 172.21.15.67:0/383538218 wait complete. 2024-09-19T05:48:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 Processor -- start 2024-09-19T05:48:29.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- start start 2024-09-19T05:48:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3ec0ae0a0 0x7fa3ec0cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3ec0b6cf0 0x7fa3ec155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 0x7fa3ec155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec0b2b40 con 0x7fa3ec15e640 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec0b7100 con 0x7fa3ec0ae0a0 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa3ec0b0790 con 0x7fa3ec0b6cf0 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3ebfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 0x7fa3ec155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3ebfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 0x7fa3ec155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40004/0 (socket says 172.21.15.67:40004) 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3ebfff640 1 -- 172.21.15.67:0/493804577 learned_addr learned my addr 172.21.15.67:0/493804577 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3eaffd640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3ec0b6cf0 0x7fa3ec155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3eb7fe640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3ec0ae0a0 0x7fa3ec0cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3ebfff640 1 -- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3ec0b6cf0 msgr2=0x7fa3ec155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3ebfff640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3ec0b6cf0 0x7fa3ec155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3ebfff640 1 -- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3ec0ae0a0 msgr2=0x7fa3ec0cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3ebfff640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3ec0ae0a0 0x7fa3ec0cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3ebfff640 1 -- 172.21.15.67:0/493804577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec0cc8b0 con 0x7fa3ec15e640 2024-09-19T05:48:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3ebfff640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 0x7fa3ec155db0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400cc30 tx=0x7fa3e400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3d3fff640 1 -- 172.21.15.67:0/493804577 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400ce40 con 0x7fa3ec15e640 2024-09-19T05:48:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3d3fff640 1 -- 172.21.15.67:0/493804577 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e40039a0 con 0x7fa3ec15e640 2024-09-19T05:48:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3d3fff640 1 -- 172.21.15.67:0/493804577 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4003d50 con 0x7fa3ec15e640 2024-09-19T05:48:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- 172.21.15.67:0/493804577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ec0ccb90 con 0x7fa3ec15e640 2024-09-19T05:48:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.025+0000 7fa3f1c23640 1 -- 172.21.15.67:0/493804577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ec0ced30 con 0x7fa3ec15e640 2024-09-19T05:48:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.029+0000 7fa3f1c23640 1 -- 172.21.15.67:0/493804577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ec0b40c0 con 0x7fa3ec15e640 2024-09-19T05:48:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.029+0000 7fa3d3fff640 1 -- 172.21.15.67:0/493804577 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3e4003f30 con 0x7fa3ec15e640 2024-09-19T05:48:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.029+0000 7fa3d3fff640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3d80678f0 0x7fa3d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.029+0000 7fa3d3fff640 1 -- 172.21.15.67:0/493804577 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fa3e4086280 con 0x7fa3ec15e640 2024-09-19T05:48:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.029+0000 7fa3eb7fe640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3d80678f0 0x7fa3d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.029+0000 7fa3eb7fe640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3d80678f0 0x7fa3d8069db0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0ad000 tx=0x7fa3dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:29.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.033+0000 7fa3d3fff640 1 -- 172.21.15.67:0/493804577 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa3e4014030 con 0x7fa3ec15e640 2024-09-19T05:48:29.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.225+0000 7fa3f1c23640 1 -- 172.21.15.67:0/493804577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3ec070740 con 0x7fa3ec15e640 2024-09-19T05:48:29.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3d3fff640 1 -- 172.21.15.67:0/493804577 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+5239 (secure 0 0 0) 0x7fa3e4056c70 con 0x7fa3ec15e640 2024-09-19T05:48:29.229 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:29.229 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":138,"btime":"2024-09-19T05:47:45:972719+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/4294715394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4294715394},{"type":"v1","addr":"172.21.15.97:6835","nonce":4294715394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":7139,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1234134657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1234134657},{"type":"v1","addr":"172.21.15.97:6837","nonce":1234134657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":10449,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2992690092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2992690092},{"type":"v1","addr":"172.21.15.67:6833","nonce":2992690092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:47:42.304037+0000","modified":"2024-09-19T05:47:45.355124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10458":{"gid":10458,"name":"c","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2221933052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2221933052},{"type":"v1","addr":"172.21.15.67:6835","nonce":2221933052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10458,"qdb_cluster":[10458]},"id":13}]} 2024-09-19T05:48:29.229 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 138 2024-09-19T05:48:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 -- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3d80678f0 msgr2=0x7fa3d8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3d80678f0 0x7fa3d8069db0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0ad000 tx=0x7fa3dc008040 comp rx=0 tx=0).stop 2024-09-19T05:48:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 -- 172.21.15.67:0/493804577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 msgr2=0x7fa3ec155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 0x7fa3ec155db0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400cc30 tx=0x7fa3e400a5c0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 -- 172.21.15.67:0/493804577 shutdown_connections 2024-09-19T05:48:29.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3ec15e640 0x7fa3ec155db0 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa3d80678f0 0x7fa3d8069db0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3ec0b6cf0 0x7fa3ec155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 --2- 172.21.15.67:0/493804577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3ec0ae0a0 0x7fa3ec0cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 -- 172.21.15.67:0/493804577 >> 172.21.15.67:0/493804577 conn(0x7fa3ec09aa30 msgr2=0x7fa3ec06fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 -- 172.21.15.67:0/493804577 shutdown_connections 2024-09-19T05:48:29.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.229+0000 7fa3f1c23640 1 -- 172.21.15.67:0/493804577 wait complete. 2024-09-19T05:48:29.247 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:48:29.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc111c8e640 1 Processor -- start 2024-09-19T05:48:29.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc111c8e640 1 -- start start 2024-09-19T05:48:29.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc111c8e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c15c0d0 0x7fc10c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc111c8e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc10c0709a0 0x7fc10c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc111c8e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10c0b5790 con 0x7fc10c15c4b0 2024-09-19T05:48:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc111c8e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc10c0b5a70 con 0x7fc10c0709a0 2024-09-19T05:48:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc111c8e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c15ca00 con 0x7fc10c15c0d0 2024-09-19T05:48:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc10bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc10c0709a0 0x7fc10c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc10bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc10c0709a0 0x7fc10c15d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40014/0 (socket says 172.21.15.67:40014) 2024-09-19T05:48:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc10bfff640 1 -- 172.21.15.67:0/3591756473 learned_addr learned my addr 172.21.15.67:0/3591756473 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc10b7fe640 1 --2- 172.21.15.67:0/3591756473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c15c0d0 0x7fc10c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc10bfff640 1 -- 172.21.15.67:0/3591756473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c15c0d0 msgr2=0x7fc10c0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc10bfff640 1 --2- 172.21.15.67:0/3591756473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c15c0d0 0x7fc10c0b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc10bfff640 1 -- 172.21.15.67:0/3591756473 >> v1:172.21.15.67:6789/0 conn(0x7fc10c15c4b0 legacy=0x7fc10c0b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.369+0000 7fc10bfff640 1 -- 172.21.15.67:0/3591756473 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c15cce0 con 0x7fc10c0709a0 2024-09-19T05:48:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc10bfff640 1 --2- 172.21.15.67:0/3591756473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c0709a0 0x7fc10c15d200 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7fc104009870 tx=0x7fc10401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f589205d2536bfe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc10a7fc640 1 -- 172.21.15.67:0/3591756473 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1040a7070 con 0x7fc10c0709a0 2024-09-19T05:48:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc10a7fc640 1 -- 172.21.15.67:0/3591756473 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1040b0070 con 0x7fc10c0709a0 2024-09-19T05:48:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc10a7fc640 1 -- 172.21.15.67:0/3591756473 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1040ab890 con 0x7fc10c0709a0 2024-09-19T05:48:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 -- 172.21.15.67:0/3591756473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c0709a0 msgr2=0x7fc10c15d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 --2- 172.21.15.67:0/3591756473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c0709a0 0x7fc10c15d200 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7fc104009870 tx=0x7fc10401c560 comp rx=0 tx=0).stop 2024-09-19T05:48:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 -- 172.21.15.67:0/3591756473 shutdown_connections 2024-09-19T05:48:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 --2- 172.21.15.67:0/3591756473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c0709a0 0x7fc10c15d200 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 --2- 172.21.15.67:0/3591756473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c15c0d0 0x7fc10c0b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 -- 172.21.15.67:0/3591756473 >> 172.21.15.67:0/3591756473 conn(0x7fc10c073500 msgr2=0x7fc10c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 -- 172.21.15.67:0/3591756473 shutdown_connections 2024-09-19T05:48:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 -- 172.21.15.67:0/3591756473 wait complete. 2024-09-19T05:48:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 Processor -- start 2024-09-19T05:48:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 -- start start 2024-09-19T05:48:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c0709a0 0x7fc10c149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c15c0d0 0x7fc10c070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10c15c4b0 0x7fc10c06efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c15e2e0 con 0x7fc10c15c0d0 2024-09-19T05:48:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c15e160 con 0x7fc10c15c4b0 2024-09-19T05:48:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc111c8e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c15e460 con 0x7fc10c0709a0 2024-09-19T05:48:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc10affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c15c0d0 0x7fc10c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc10affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c15c0d0 0x7fc10c070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40024/0 (socket says 172.21.15.67:40024) 2024-09-19T05:48:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.373+0000 7fc10affd640 1 -- 172.21.15.67:0/3636079228 learned_addr learned my addr 172.21.15.67:0/3636079228 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10b7fe640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c0709a0 0x7fc10c149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10bfff640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10c15c4b0 0x7fc10c06efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10affd640 1 -- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c0709a0 msgr2=0x7fc10c149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10affd640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c0709a0 0x7fc10c149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10affd640 1 -- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10c15c4b0 msgr2=0x7fc10c06efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10affd640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10c15c4b0 0x7fc10c06efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10affd640 1 -- 172.21.15.67:0/3636079228 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c06fe00 con 0x7fc10c15c0d0 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10bfff640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10c15c4b0 0x7fc10c06efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10b7fe640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c0709a0 0x7fc10c149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10affd640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c15c0d0 0x7fc10c070240 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c340 tx=0x7fc10000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc0f3fff640 1 -- 172.21.15.67:0/3636079228 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000052d0 con 0x7fc10c15c0d0 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc0f3fff640 1 -- 172.21.15.67:0/3636079228 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc100005470 con 0x7fc10c15c0d0 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc111c8e640 1 -- 172.21.15.67:0/3636079228 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10c0ae350 con 0x7fc10c15c0d0 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc0f3fff640 1 -- 172.21.15.67:0/3636079228 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc100007260 con 0x7fc10c15c0d0 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc111c8e640 1 -- 172.21.15.67:0/3636079228 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc10c0ae910 con 0x7fc10c15c0d0 2024-09-19T05:48:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc111c8e640 1 -- 172.21.15.67:0/3636079228 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc10c15d200 con 0x7fc10c15c0d0 2024-09-19T05:48:29.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc0f3fff640 1 -- 172.21.15.67:0/3636079228 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc100007400 con 0x7fc10c15c0d0 2024-09-19T05:48:29.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc0f3fff640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0f80678f0 0x7fc0f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc0f3fff640 1 -- 172.21.15.67:0/3636079228 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fc100085380 con 0x7fc10c15c0d0 2024-09-19T05:48:29.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10b7fe640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0f80678f0 0x7fc0f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.377+0000 7fc10b7fe640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0f80678f0 0x7fc0f8069db0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc003fd0 tx=0x7fc0fc0039e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:29.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.381+0000 7fc0f3fff640 1 -- 172.21.15.67:0/3636079228 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc10c06fe00 con 0x7fc10c15c0d0 2024-09-19T05:48:29.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.545+0000 7fc111c8e640 1 -- 172.21.15.67:0/3636079228 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc10c149a00 con 0x7fc10c15c0d0 2024-09-19T05:48:29.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.549+0000 7fc0f3fff640 1 -- 172.21.15.67:0/3636079228 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) ==== 74+0+17060 (secure 0 0 0) 0x7fc100055c50 con 0x7fc10c15c0d0 2024-09-19T05:48:29.550 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:29.550 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":193,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:47:59.503744+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:47:39.977348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-19T05:47:41.308745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.0","mappings":[{"from":6,"to":1}]},{"pgid":"28.9","mappings":[{"from":6,"to":4}]},{"pgid":"28.26","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:48:29.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 -- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0f80678f0 msgr2=0x7fc0f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0f80678f0 0x7fc0f8069db0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc003fd0 tx=0x7fc0fc0039e0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 -- 172.21.15.67:0/3636079228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c15c0d0 msgr2=0x7fc10c070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c15c0d0 0x7fc10c070240 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c340 tx=0x7fc10000c800 comp rx=0 tx=0).stop 2024-09-19T05:48:29.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 -- 172.21.15.67:0/3636079228 shutdown_connections 2024-09-19T05:48:29.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10c15c4b0 0x7fc10c06efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc10c15c0d0 0x7fc10c070240 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc0f80678f0 0x7fc0f8069db0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 --2- 172.21.15.67:0/3636079228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc10c0709a0 0x7fc10c149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 -- 172.21.15.67:0/3636079228 >> 172.21.15.67:0/3636079228 conn(0x7fc10c073500 msgr2=0x7fc10c0b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:29.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 -- 172.21.15.67:0/3636079228 shutdown_connections 2024-09-19T05:48:29.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.553+0000 7fc111c8e640 1 -- 172.21.15.67:0/3636079228 wait complete. 2024-09-19T05:48:29.570 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:48:29.570 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:48:29.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c850e8640 1 Processor -- start 2024-09-19T05:48:29.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c850e8640 1 -- start start 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c850e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c800ad6c0 0x7f9c800b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c850e8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c8006de80 con 0x7f9c800b2fd0 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c850e8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c8006e160 con 0x7f9c80159d60 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c850e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8006e440 con 0x7f9c800ad6c0 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7e59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9c800b2fd0 0x7f9c800acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58700/0 (socket says 172.21.15.67:58700) 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7e59c640 1 -- 172.21.15.67:0/4193250972 learned_addr learned my addr 172.21.15.67:0/4193250972 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7f59e640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c800ad6c0 0x7f9c800b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179304407 0 0) 0x7f9c8006de80 con 0x7f9c800b2fd0 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c68003530 con 0x7f9c800b2fd0 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1295558751 0 0) 0x7f9c68003530 con 0x7f9c800b2fd0 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c800ad6c0 msgr2=0x7f9c800b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:29.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c800ad6c0 0x7f9c800b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 >> v1:172.21.15.97:6789/0 conn(0x7f9c80159d60 legacy=0x7f9c8006ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8006e720 con 0x7f9c800b2fd0 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f9c740016a0 con 0x7f9c800b2fd0 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 >> v1:172.21.15.67:6789/0 conn(0x7f9c800b2fd0 legacy=0x7f9c800acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c680039f0 0x7f9c68003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c800ad6c0 0x7f9c68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c68004d50 0x7f9c680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8006e440 con 0x7f9c68004d50 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6800bab0 con 0x7f9c680039f0 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9c6800bcb0 con 0x7f9c800ad6c0 2024-09-19T05:48:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7f59e640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c68004d50 0x7f9c680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7ed9d640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c680039f0 0x7f9c68003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7e59c640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c800ad6c0 0x7f9c68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7f59e640 1 -- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c800ad6c0 msgr2=0x7f9c68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:29.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7f59e640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c800ad6c0 0x7f9c68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7f59e640 1 -- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c680039f0 msgr2=0x7f9c68003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:29.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7f59e640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c680039f0 0x7f9c68003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7f59e640 1 -- 172.21.15.67:0/4193250972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c68003530 con 0x7f9c68004d50 2024-09-19T05:48:29.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7e59c640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c800ad6c0 0x7f9c68004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:29.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.697+0000 7f9c7ed9d640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c680039f0 0x7f9c68003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:29.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c7f59e640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c68004d50 0x7f9c680051d0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009a90 tx=0x7f9c7801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f073eb2152d7e4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:29.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c780b2070 con 0x7f9c68004d50 2024-09-19T05:48:29.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c780a5620 con 0x7f9c68004d50 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c7dd9b640 1 -- 172.21.15.67:0/4193250972 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c78009690 con 0x7f9c68004d50 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c850e8640 1 -- 172.21.15.67:0/4193250972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c68004d50 msgr2=0x7f9c680051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c850e8640 1 --2- 172.21.15.67:0/4193250972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c68004d50 0x7f9c680051d0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009a90 tx=0x7f9c7801ca30 comp rx=0 tx=0).stop 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c7f59e640 1 -- 172.21.15.67:0/4193250972 reap_dead start 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c850e8640 1 -- 172.21.15.67:0/4193250972 shutdown_connections 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c850e8640 1 -- 172.21.15.67:0/4193250972 >> 172.21.15.67:0/4193250972 conn(0x7f9c800d0080 msgr2=0x7f9c800d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c850e8640 1 -- 172.21.15.67:0/4193250972 shutdown_connections 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c850e8640 1 -- 172.21.15.67:0/4193250972 wait complete. 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c850e8640 1 Processor -- start 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.701+0000 7f9c850e8640 1 -- start start 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c850e8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c8014f310 0x7f9c80099570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c850e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c8014f6f0 0x7f9c80099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c850e8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c8009cc50 0x7f9c8009d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c850e8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8006f630 con 0x7f9c8014f310 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c850e8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8015a140 con 0x7f9c8009cc50 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c850e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9c800b3420 con 0x7f9c8014f6f0 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c8014f310 0x7f9c80099570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c8014f310 0x7f9c80099570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40052/0 (socket says 172.21.15.67:40052) 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7ed9d640 1 -- 172.21.15.67:0/3726155792 learned_addr learned my addr 172.21.15.67:0/3726155792 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7e59c640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c8014f6f0 0x7f9c80099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7ed9d640 1 -- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c8014f6f0 msgr2=0x7f9c80099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7f59e640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c8009cc50 0x7f9c8009d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7ed9d640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c8014f6f0 0x7f9c80099ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7ed9d640 1 -- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c8009cc50 msgr2=0x7f9c8009d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7ed9d640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c8009cc50 0x7f9c8009d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7ed9d640 1 -- 172.21.15.67:0/3726155792 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8009d850 con 0x7f9c8014f310 2024-09-19T05:48:29.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7ed9d640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c8014f310 0x7f9c80099570 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000e900 tx=0x7f9c7000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:29.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c677fe640 1 -- 172.21.15.67:0/3726155792 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70003b90 con 0x7f9c8014f310 2024-09-19T05:48:29.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c677fe640 1 -- 172.21.15.67:0/3726155792 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c70018070 con 0x7f9c8014f310 2024-09-19T05:48:29.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c850e8640 1 -- 172.21.15.67:0/3726155792 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8009db30 con 0x7f9c8014f310 2024-09-19T05:48:29.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c677fe640 1 -- 172.21.15.67:0/3726155792 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000c780 con 0x7f9c8014f310 2024-09-19T05:48:29.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c850e8640 1 -- 172.21.15.67:0/3726155792 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c8009e0f0 con 0x7f9c8014f310 2024-09-19T05:48:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c850e8640 1 -- 172.21.15.67:0/3726155792 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c800d0f20 con 0x7f9c8014f310 2024-09-19T05:48:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c677fe640 1 -- 172.21.15.67:0/3726155792 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c7000c920 con 0x7f9c8014f310 2024-09-19T05:48:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c677fe640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c6c0678f0 0x7f9c6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c677fe640 1 -- 172.21.15.67:0/3726155792 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f9c70085f60 con 0x7f9c8014f310 2024-09-19T05:48:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.705+0000 7f9c7e59c640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c6c0678f0 0x7f9c6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.709+0000 7f9c7e59c640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c6c0678f0 0x7f9c6c069db0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9c740011f0 tx=0x7f9c74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:29.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.709+0000 7f9c677fe640 1 -- 172.21.15.67:0/3726155792 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9c7001a310 con 0x7f9c8014f310 2024-09-19T05:48:29.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.909+0000 7f9c850e8640 1 -- 172.21.15.67:0/3726155792 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c8015a4d0 con 0x7f9c8014f310 2024-09-19T05:48:29.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.909+0000 7f9c677fe640 1 -- 172.21.15.67:0/3726155792 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+5239 (secure 0 0 0) 0x7f9c700568c0 con 0x7f9c8014f310 2024-09-19T05:48:29.911 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:29.911 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":138,"btime":"2024-09-19T05:47:45:972719+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/4294715394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4294715394},{"type":"v1","addr":"172.21.15.97:6835","nonce":4294715394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":7139,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1234134657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1234134657},{"type":"v1","addr":"172.21.15.97:6837","nonce":1234134657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":10449,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2992690092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2992690092},{"type":"v1","addr":"172.21.15.67:6833","nonce":2992690092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:47:42.304037+0000","modified":"2024-09-19T05:47:45.355124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10458":{"gid":10458,"name":"c","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2221933052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2221933052},{"type":"v1","addr":"172.21.15.67:6835","nonce":2221933052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10458,"qdb_cluster":[10458]},"id":13}]} 2024-09-19T05:48:29.912 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 138 2024-09-19T05:48:29.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 -- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c6c0678f0 msgr2=0x7f9c6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c6c0678f0 0x7f9c6c069db0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9c740011f0 tx=0x7f9c74009040 comp rx=0 tx=0).stop 2024-09-19T05:48:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 -- 172.21.15.67:0/3726155792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c8014f310 msgr2=0x7f9c80099570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c8014f310 0x7f9c80099570 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000e900 tx=0x7f9c7000edc0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 -- 172.21.15.67:0/3726155792 shutdown_connections 2024-09-19T05:48:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c8009cc50 0x7f9c8009d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9c6c0678f0 0x7f9c6c069db0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c8014f6f0 0x7f9c80099ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 --2- 172.21.15.67:0/3726155792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c8014f310 0x7f9c80099570 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 -- 172.21.15.67:0/3726155792 >> 172.21.15.67:0/3726155792 conn(0x7f9c800d0080 msgr2=0x7f9c8015ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 -- 172.21.15.67:0/3726155792 shutdown_connections 2024-09-19T05:48:29.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:29.913+0000 7f9c850e8640 1 -- 172.21.15.67:0/3726155792 wait complete. 2024-09-19T05:48:29.931 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:48:30.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.053+0000 7fef8fa75640 1 Processor -- start 2024-09-19T05:48:30.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.053+0000 7fef8fa75640 1 -- start start 2024-09-19T05:48:30.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8fa75640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef88162630 0x7fef88071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8fa75640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fef88162a10 0x7fef88072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8fa75640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef8806ecc0 con 0x7fef880cc3c0 2024-09-19T05:48:30.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8fa75640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fef880cfe80 con 0x7fef88162630 2024-09-19T05:48:30.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8fa75640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fef8806ef50 con 0x7fef88162a10 2024-09-19T05:48:30.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8d811640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef88162630 0x7fef88071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8d811640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef88162630 0x7fef88071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40058/0 (socket says 172.21.15.67:40058) 2024-09-19T05:48:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8d811640 1 -- 172.21.15.67:0/4047253383 learned_addr learned my addr 172.21.15.67:0/4047253383 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8e012640 1 --1- 172.21.15.67:0/4047253383 >> v1:172.21.15.67:6789/0 conn(0x7fef880cc3c0 0x7fef88166380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58714/0 (socket says 172.21.15.67:58714) 2024-09-19T05:48:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8d010640 1 --2- 172.21.15.67:0/4047253383 >> v2:172.21.15.97:3300/0 conn(0x7fef88162a10 0x7fef88072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8d811640 1 -- 172.21.15.67:0/4047253383 >> v2:172.21.15.97:3300/0 conn(0x7fef88162a10 msgr2=0x7fef88072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8d811640 1 --2- 172.21.15.67:0/4047253383 >> v2:172.21.15.97:3300/0 conn(0x7fef88162a10 0x7fef88072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8d811640 1 -- 172.21.15.67:0/4047253383 >> v1:172.21.15.67:6789/0 conn(0x7fef880cc3c0 legacy=0x7fef88166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8d811640 1 -- 172.21.15.67:0/4047253383 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8806f230 con 0x7fef88162630 2024-09-19T05:48:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8d811640 1 --2- 172.21.15.67:0/4047253383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 0x7fef88071fd0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fef88073990 tx=0x7fef8401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd7e2a2ed64c4af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8c80f640 1 -- 172.21.15.67:0/4047253383 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef840a57f0 con 0x7fef88162630 2024-09-19T05:48:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8c80f640 1 -- 172.21.15.67:0/4047253383 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef840a5990 con 0x7fef88162630 2024-09-19T05:48:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.057+0000 7fef8c80f640 1 -- 172.21.15.67:0/4047253383 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef840a5d60 con 0x7fef88162630 2024-09-19T05:48:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- 172.21.15.67:0/4047253383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 msgr2=0x7fef88071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 --2- 172.21.15.67:0/4047253383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 0x7fef88071fd0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fef88073990 tx=0x7fef8401c930 comp rx=0 tx=0).stop 2024-09-19T05:48:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- 172.21.15.67:0/4047253383 shutdown_connections 2024-09-19T05:48:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 --2- 172.21.15.67:0/4047253383 >> v2:172.21.15.97:3300/0 conn(0x7fef88162a10 0x7fef88072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 --2- 172.21.15.67:0/4047253383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 0x7fef88071fd0 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- 172.21.15.67:0/4047253383 >> 172.21.15.67:0/4047253383 conn(0x7fef880d0080 msgr2=0x7fef880d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:30.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- 172.21.15.67:0/4047253383 shutdown_connections 2024-09-19T05:48:30.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- 172.21.15.67:0/4047253383 wait complete. 2024-09-19T05:48:30.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 Processor -- start 2024-09-19T05:48:30.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- start start 2024-09-19T05:48:30.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef880cc3c0 0x7fef8815db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 0x7fef88151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef88162a10 0x7fef8815f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fef8816f880 con 0x7fef88162630 2024-09-19T05:48:30.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fef8816f700 con 0x7fef880cc3c0 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fef8816fa00 con 0x7fef88162a10 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8d010640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 0x7fef88151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8d010640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 0x7fef88151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40072/0 (socket says 172.21.15.67:40072) 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8d010640 1 -- 172.21.15.67:0/2432182818 learned_addr learned my addr 172.21.15.67:0/2432182818 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8d811640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef880cc3c0 0x7fef8815db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8e012640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef88162a10 0x7fef8815f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8d010640 1 -- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef88162a10 msgr2=0x7fef8815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8d010640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef88162a10 0x7fef8815f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8d010640 1 -- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef880cc3c0 msgr2=0x7fef8815db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8d010640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef880cc3c0 0x7fef8815db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8d010640 1 -- 172.21.15.67:0/2432182818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef88153f50 con 0x7fef88162630 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8d010640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 0x7fef88151c90 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fef7800d7d0 tx=0x7fef7800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:30.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef7e7fc640 1 -- 172.21.15.67:0/2432182818 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7800b6c0 con 0x7fef88162630 2024-09-19T05:48:30.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef7e7fc640 1 -- 172.21.15.67:0/2432182818 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef78019070 con 0x7fef88162630 2024-09-19T05:48:30.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- 172.21.15.67:0/2432182818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef88154230 con 0x7fef88162630 2024-09-19T05:48:30.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef7e7fc640 1 -- 172.21.15.67:0/2432182818 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7800ba80 con 0x7fef88162630 2024-09-19T05:48:30.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.061+0000 7fef8fa75640 1 -- 172.21.15.67:0/2432182818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef88160150 con 0x7fef88162630 2024-09-19T05:48:30.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.065+0000 7fef8fa75640 1 -- 172.21.15.67:0/2432182818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef880b1a30 con 0x7fef88162630 2024-09-19T05:48:30.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.065+0000 7fef7e7fc640 1 -- 172.21.15.67:0/2432182818 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef7800bc20 con 0x7fef88162630 2024-09-19T05:48:30.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.065+0000 7fef7e7fc640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef6c0678c0 0x7fef6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.065+0000 7fef7e7fc640 1 -- 172.21.15.67:0/2432182818 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fef780861e0 con 0x7fef88162630 2024-09-19T05:48:30.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.065+0000 7fef8d811640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef6c0678c0 0x7fef6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.065+0000 7fef8d811640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef6c0678c0 0x7fef6c069d80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fef840ae000 tx=0x7fef840a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:30.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.069+0000 7fef7e7fc640 1 -- 172.21.15.67:0/2432182818 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fef880b1a30 con 0x7fef88162630 2024-09-19T05:48:30.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.265+0000 7fef8fa75640 1 -- 172.21.15.67:0/2432182818 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef88166380 con 0x7fef88162630 2024-09-19T05:48:30.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.265+0000 7fef7e7fc640 1 -- 172.21.15.67:0/2432182818 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+5239 (secure 0 0 0) 0x7fef78056bd0 con 0x7fef88162630 2024-09-19T05:48:30.266 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:30.266 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":138,"btime":"2024-09-19T05:47:45:972719+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/4294715394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4294715394},{"type":"v1","addr":"172.21.15.97:6835","nonce":4294715394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":7139,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1234134657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1234134657},{"type":"v1","addr":"172.21.15.97:6837","nonce":1234134657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":10449,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2992690092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2992690092},{"type":"v1","addr":"172.21.15.67:6833","nonce":2992690092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:47:42.304037+0000","modified":"2024-09-19T05:47:45.355124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10458":{"gid":10458,"name":"c","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2221933052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2221933052},{"type":"v1","addr":"172.21.15.67:6835","nonce":2221933052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10458,"qdb_cluster":[10458]},"id":13}]} 2024-09-19T05:48:30.266 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 138 2024-09-19T05:48:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.265+0000 7fef8fa75640 1 -- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef6c0678c0 msgr2=0x7fef6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef6c0678c0 0x7fef6c069d80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fef840ae000 tx=0x7fef840a7070 comp rx=0 tx=0).stop 2024-09-19T05:48:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 -- 172.21.15.67:0/2432182818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 msgr2=0x7fef88151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 0x7fef88151c90 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fef7800d7d0 tx=0x7fef7800dc90 comp rx=0 tx=0).stop 2024-09-19T05:48:30.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 -- 172.21.15.67:0/2432182818 shutdown_connections 2024-09-19T05:48:30.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef6c0678c0 0x7fef6c069d80 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef88162a10 0x7fef8815f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef88162630 0x7fef88151c90 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 --2- 172.21.15.67:0/2432182818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef880cc3c0 0x7fef8815db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 -- 172.21.15.67:0/2432182818 >> 172.21.15.67:0/2432182818 conn(0x7fef880d0080 msgr2=0x7fef88162e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:30.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 -- 172.21.15.67:0/2432182818 shutdown_connections 2024-09-19T05:48:30.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.269+0000 7fef8fa75640 1 -- 172.21.15.67:0/2432182818 wait complete. 2024-09-19T05:48:30.284 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:48:30.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.405+0000 7f331defe640 1 Processor -- start 2024-09-19T05:48:30.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.405+0000 7f331defe640 1 -- start start 2024-09-19T05:48:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f331defe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f331815c200 0x7f3318071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f331defe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f33180aef40 0x7f33180af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f331defe640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33180b3070 con 0x7f331815b710 2024-09-19T05:48:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f331defe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f33180b32e0 con 0x7f33180aef40 2024-09-19T05:48:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f331defe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f33180b35c0 con 0x7f331815c200 2024-09-19T05:48:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33177fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f331815b710 0x7f331815baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58716/0 (socket says 172.21.15.67:58716) 2024-09-19T05:48:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33177fe640 1 -- 172.21.15.67:0/2310425957 learned_addr learned my addr 172.21.15.67:0/2310425957 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f3316ffd640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f331815c200 0x7f3318071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f3317fff640 1 --2- 172.21.15.67:0/2310425957 >> v2:172.21.15.97:3300/0 conn(0x7f33180aef40 0x7f33180af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607776908 0 0) 0x7f33180b3070 con 0x7f331815b710 2024-09-19T05:48:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3300003530 con 0x7f331815b710 2024-09-19T05:48:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3245670978 0 0) 0x7f3300003530 con 0x7f331815b710 2024-09-19T05:48:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f331815c200 msgr2=0x7f3318071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f331815c200 0x7f3318071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 >> v2:172.21.15.97:3300/0 conn(0x7f33180aef40 msgr2=0x7f33180af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 --2- 172.21.15.67:0/2310425957 >> v2:172.21.15.97:3300/0 conn(0x7f33180aef40 0x7f33180af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33180b38a0 con 0x7f331815b710 2024-09-19T05:48:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3308001680 con 0x7f331815b710 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 >> v1:172.21.15.67:6789/0 conn(0x7f331815b710 legacy=0x7f331815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33000039c0 0x7f3300003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f331815c200 0x7f3300004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3300004d50 0x7f33000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33180b32e0 con 0x7f33000039c0 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33180b35c0 con 0x7f3300004d50 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f330000dbe0 con 0x7f331815c200 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33177fe640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33000039c0 0x7f3300003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f3316ffd640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f331815c200 0x7f3300004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f3317fff640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3300004d50 0x7f33000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33177fe640 1 -- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f331815c200 msgr2=0x7f3300004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33177fe640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f331815c200 0x7f3300004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33177fe640 1 -- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3300004d50 msgr2=0x7f33000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33177fe640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3300004d50 0x7f33000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33177fe640 1 -- 172.21.15.67:0/2310425957 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3300003530 con 0x7f33000039c0 2024-09-19T05:48:30.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.409+0000 7f33177fe640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33000039c0 0x7f3300003de0 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f330800c270 tx=0x7f330801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d45039706cb1763 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:30.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3308007d40 con 0x7f33000039c0 2024-09-19T05:48:30.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33080a9020 con 0x7f33000039c0 2024-09-19T05:48:30.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f33167fc640 1 -- 172.21.15.67:0/2310425957 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3308005ae0 con 0x7f33000039c0 2024-09-19T05:48:30.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- 172.21.15.67:0/2310425957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33000039c0 msgr2=0x7f3300003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 --2- 172.21.15.67:0/2310425957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33000039c0 0x7f3300003de0 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f330800c270 tx=0x7f330801cc70 comp rx=0 tx=0).stop 2024-09-19T05:48:30.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3317fff640 1 -- 172.21.15.67:0/2310425957 reap_dead start 2024-09-19T05:48:30.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- 172.21.15.67:0/2310425957 shutdown_connections 2024-09-19T05:48:30.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- 172.21.15.67:0/2310425957 >> 172.21.15.67:0/2310425957 conn(0x7f33180d0080 msgr2=0x7f33180d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- 172.21.15.67:0/2310425957 shutdown_connections 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- 172.21.15.67:0/2310425957 wait complete. 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 Processor -- start 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- start start 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33000039c0 0x7f33181479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3318154480 0x7f33181532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3318149c90 0x7f331814cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33180b4c40 con 0x7f3318149c90 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33180b4ac0 con 0x7f33000039c0 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f33180b4dc0 con 0x7f3318154480 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3317fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3318149c90 0x7f331814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3317fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3318149c90 0x7f331814cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40088/0 (socket says 172.21.15.67:40088) 2024-09-19T05:48:30.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3317fff640 1 -- 172.21.15.67:0/3493712401 learned_addr learned my addr 172.21.15.67:0/3493712401 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f33177fe640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33000039c0 0x7f33181479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3316ffd640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3318154480 0x7f33181532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3317fff640 1 -- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3318154480 msgr2=0x7f33181532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3317fff640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3318154480 0x7f33181532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3317fff640 1 -- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33000039c0 msgr2=0x7f33181479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3317fff640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33000039c0 0x7f33181479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3317fff640 1 -- 172.21.15.67:0/3493712401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33181537f0 con 0x7f3318149c90 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f33177fe640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33000039c0 0x7f33181479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f3317fff640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3318149c90 0x7f331814cbc0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f3310007d10 tx=0x7f33100115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f32fffff640 1 -- 172.21.15.67:0/3493712401 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310011de0 con 0x7f3318149c90 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f32fffff640 1 -- 172.21.15.67:0/3493712401 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331001b070 con 0x7f3318149c90 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- 172.21.15.67:0/3493712401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3318154af0 con 0x7f3318149c90 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f32fffff640 1 -- 172.21.15.67:0/3493712401 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33100039a0 con 0x7f3318149c90 2024-09-19T05:48:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.413+0000 7f331defe640 1 -- 172.21.15.67:0/3493712401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3318149490 con 0x7f3318149c90 2024-09-19T05:48:30.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.417+0000 7f331defe640 1 -- 172.21.15.67:0/3493712401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3318154860 con 0x7f3318149c90 2024-09-19T05:48:30.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.417+0000 7f32fffff640 1 -- 172.21.15.67:0/3493712401 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3310003b40 con 0x7f3318149c90 2024-09-19T05:48:30.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.417+0000 7f32fffff640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33040678f0 0x7f3304069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.417+0000 7f32fffff640 1 -- 172.21.15.67:0/3493712401 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f3310086590 con 0x7f3318149c90 2024-09-19T05:48:30.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.417+0000 7f33177fe640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33040678f0 0x7f3304069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.417+0000 7f33177fe640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33040678f0 0x7f3304069db0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f33080aa000 tx=0x7f331815b6a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.421+0000 7f32fffff640 1 -- 172.21.15.67:0/3493712401 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3310025020 con 0x7f3318149c90 2024-09-19T05:48:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.585+0000 7f331defe640 1 -- 172.21.15.67:0/3493712401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33180af390 con 0x7f3318149c90 2024-09-19T05:48:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.589+0000 7f32fffff640 1 -- 172.21.15.67:0/3493712401 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) ==== 74+0+17060 (secure 0 0 0) 0x7f3310056ee0 con 0x7f3318149c90 2024-09-19T05:48:30.589 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:30.590 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":193,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:47:59.503744+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:47:39.977348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-19T05:47:41.308745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.0","mappings":[{"from":6,"to":1}]},{"pgid":"28.9","mappings":[{"from":6,"to":4}]},{"pgid":"28.26","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:48:30.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 -- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33040678f0 msgr2=0x7f3304069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33040678f0 0x7f3304069db0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f33080aa000 tx=0x7f331815b6a0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 -- 172.21.15.67:0/3493712401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3318149c90 msgr2=0x7f331814cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3318149c90 0x7f331814cbc0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f3310007d10 tx=0x7f33100115a0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 -- 172.21.15.67:0/3493712401 shutdown_connections 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3318149c90 0x7f331814cbc0 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33040678f0 0x7f3304069db0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3318154480 0x7f33181532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 --2- 172.21.15.67:0/3493712401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33000039c0 0x7f33181479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 -- 172.21.15.67:0/3493712401 >> 172.21.15.67:0/3493712401 conn(0x7f33180d0080 msgr2=0x7f3318154fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 -- 172.21.15.67:0/3493712401 shutdown_connections 2024-09-19T05:48:30.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.593+0000 7f331defe640 1 -- 172.21.15.67:0/3493712401 wait complete. 2024-09-19T05:48:30.610 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:48:30.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.729+0000 7f880a18c640 1 Processor -- start 2024-09-19T05:48:30.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.729+0000 7f880a18c640 1 -- start start 2024-09-19T05:48:30.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.729+0000 7f880a18c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f88040d1590 0x7f88040d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.729+0000 7f880a18c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 0x7f88040cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.729+0000 7f880a18c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88040d4d40 con 0x7f8804161da0 2024-09-19T05:48:30.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.729+0000 7f880a18c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f88040d0840 con 0x7f88040d1590 2024-09-19T05:48:30.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.729+0000 7f880a18c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f88040d5020 con 0x7f88040b51d0 2024-09-19T05:48:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f8802ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f88040d1590 0x7f88040d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f8803fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 0x7f88040cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f8803fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 0x7f88040cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:37740/0 (socket says 172.21.15.67:37740) 2024-09-19T05:48:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f8802ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f88040d1590 0x7f88040d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:52826/0 (socket says 172.21.15.67:52826) 2024-09-19T05:48:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f8803fff640 1 -- 172.21.15.67:0/1263756430 learned_addr learned my addr 172.21.15.67:0/1263756430 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f88037fe640 1 --1- 172.21.15.67:0/1263756430 >> v1:172.21.15.97:6789/0 conn(0x7f8804161da0 0x7f88040d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:53014/0 (socket says 172.21.15.67:53014) 2024-09-19T05:48:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f8802ffd640 1 -- 172.21.15.67:0/1263756430 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 msgr2=0x7f88040cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f8802ffd640 1 --2- 172.21.15.67:0/1263756430 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 0x7f88040cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f8802ffd640 1 -- 172.21.15.67:0/1263756430 >> v1:172.21.15.97:6789/0 conn(0x7f8804161da0 legacy=0x7f88040d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f8802ffd640 1 -- 172.21.15.67:0/1263756430 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88040d5300 con 0x7f88040d1590 2024-09-19T05:48:30.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f8802ffd640 1 --2- 172.21.15.67:0/1263756430 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88040d1590 0x7f88040d1af0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097c0 tx=0x7f87f801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b21b554978b543e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:30.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f88027fc640 1 -- 172.21.15.67:0/1263756430 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f80b0070 con 0x7f88040d1590 2024-09-19T05:48:30.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f88027fc640 1 -- 172.21.15.67:0/1263756430 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f80ab600 con 0x7f88040d1590 2024-09-19T05:48:30.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.733+0000 7f88027fc640 1 -- 172.21.15.67:0/1263756430 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f80ab9d0 con 0x7f88040d1590 2024-09-19T05:48:30.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- 172.21.15.67:0/1263756430 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88040d1590 msgr2=0x7f88040d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 --2- 172.21.15.67:0/1263756430 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88040d1590 0x7f88040d1af0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097c0 tx=0x7f87f801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- 172.21.15.67:0/1263756430 shutdown_connections 2024-09-19T05:48:30.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 --2- 172.21.15.67:0/1263756430 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 0x7f88040cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 --2- 172.21.15.67:0/1263756430 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88040d1590 0x7f88040d1af0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- 172.21.15.67:0/1263756430 >> 172.21.15.67:0/1263756430 conn(0x7f880408bfc0 msgr2=0x7f88040d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:30.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- 172.21.15.67:0/1263756430 shutdown_connections 2024-09-19T05:48:30.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- 172.21.15.67:0/1263756430 wait complete. 2024-09-19T05:48:30.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 Processor -- start 2024-09-19T05:48:30.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- start start 2024-09-19T05:48:30.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 0x7f8804155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88040d1590 0x7f8804158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8804161da0 0x7f8804158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f88040d0020 con 0x7f88040d1590 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f88040cfea0 con 0x7f8804161da0 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f88040d01a0 con 0x7f88040b51d0 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88040d1590 0x7f8804158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88040d1590 0x7f8804158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40094/0 (socket says 172.21.15.67:40094) 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8802ffd640 1 -- 172.21.15.67:0/1906365143 learned_addr learned my addr 172.21.15.67:0/1906365143 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f88037fe640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 0x7f8804155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8803fff640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8804161da0 0x7f8804158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8802ffd640 1 -- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 msgr2=0x7f8804155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8802ffd640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 0x7f8804155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8802ffd640 1 -- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8804161da0 msgr2=0x7f8804158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8802ffd640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8804161da0 0x7f8804158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8802ffd640 1 -- 172.21.15.67:0/1906365143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8804156ec0 con 0x7f88040d1590 2024-09-19T05:48:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f88037fe640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 0x7f8804155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8803fff640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8804161da0 0x7f8804158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f8802ffd640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88040d1590 0x7f8804158980 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f87f80ae040 tx=0x7f87f8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f87ebfff640 1 -- 172.21.15.67:0/1906365143 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f80b0040 con 0x7f88040d1590 2024-09-19T05:48:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f87ebfff640 1 -- 172.21.15.67:0/1906365143 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f80ab400 con 0x7f88040d1590 2024-09-19T05:48:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- 172.21.15.67:0/1906365143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88041fed90 con 0x7f88040d1590 2024-09-19T05:48:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f87ebfff640 1 -- 172.21.15.67:0/1906365143 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f80b4670 con 0x7f88040d1590 2024-09-19T05:48:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.737+0000 7f880a18c640 1 -- 172.21.15.67:0/1906365143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88041ff350 con 0x7f88040d1590 2024-09-19T05:48:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.741+0000 7f880a18c640 1 -- 172.21.15.67:0/1906365143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88040cf150 con 0x7f88040d1590 2024-09-19T05:48:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.741+0000 7f87ebfff640 1 -- 172.21.15.67:0/1906365143 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87f80bb020 con 0x7f88040d1590 2024-09-19T05:48:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.741+0000 7f87ebfff640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87f00678c0 0x7f87f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.741+0000 7f87ebfff640 1 -- 172.21.15.67:0/1906365143 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f87f811fc00 con 0x7f88040d1590 2024-09-19T05:48:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.741+0000 7f88037fe640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87f00678c0 0x7f87f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.741+0000 7f88037fe640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87f00678c0 0x7f87f0069d80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f87f4000f70 tx=0x7f87f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:30.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.745+0000 7f87ebfff640 1 -- 172.21.15.67:0/1906365143 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f87f80c2020 con 0x7f88040d1590 2024-09-19T05:48:30.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.937+0000 7f880a18c640 1 -- 172.21.15.67:0/1906365143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f88040731d0 con 0x7f88040d1590 2024-09-19T05:48:30.941 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:48:30.941+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:48:30.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.941+0000 7f87ebfff640 1 -- 172.21.15.67:0/1906365143 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v139) ==== 161+0+0 (secure 0 0 0) 0x7f87f8016090 con 0x7f88040d1590 2024-09-19T05:48:30.943 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:48:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 -- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87f00678c0 msgr2=0x7f87f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87f00678c0 0x7f87f0069d80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f87f4000f70 tx=0x7f87f4009040 comp rx=0 tx=0).stop 2024-09-19T05:48:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 -- 172.21.15.67:0/1906365143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88040d1590 msgr2=0x7f8804158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88040d1590 0x7f8804158980 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f87f80ae040 tx=0x7f87f8019240 comp rx=0 tx=0).stop 2024-09-19T05:48:30.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 -- 172.21.15.67:0/1906365143 shutdown_connections 2024-09-19T05:48:30.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8804161da0 0x7f8804158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88040d1590 0x7f8804158980 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f87f00678c0 0x7f87f0069d80 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 --2- 172.21.15.67:0/1906365143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f88040b51d0 0x7f8804155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:30.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 -- 172.21.15.67:0/1906365143 >> 172.21.15.67:0/1906365143 conn(0x7f880408bfc0 msgr2=0x7f880406df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:30.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 -- 172.21.15.67:0/1906365143 shutdown_connections 2024-09-19T05:48:30.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:30.945+0000 7f880a18c640 1 -- 172.21.15.67:0/1906365143 wait complete. 2024-09-19T05:48:30.951 INFO:tasks.ceph.mds.c.smithi067.stderr: -2357> 2024-09-19T05:47:48.567+0000 7f20f829e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:48:30.966 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:48:30.988 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:48:31.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.077+0000 7f57af111640 1 Processor -- start 2024-09-19T05:48:31.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.077+0000 7f57af111640 1 -- start start 2024-09-19T05:48:31.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.077+0000 7f57af111640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f57a8159c60 0x7f57a80ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:31.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.077+0000 7f57af111640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57a806ffd0 0x7f57a80aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:31.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.077+0000 7f57af111640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f57a80b3150 0x7f57a80af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:31.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.077+0000 7f57af111640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f57a80af710 con 0x7f57a8159c60 2024-09-19T05:48:31.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.077+0000 7f57af111640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f57a815d460 con 0x7f57a80b3150 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.077+0000 7f57af111640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f57a815a040 con 0x7f57a806ffd0 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.077+0000 7f57acead640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f57a8159c60 0x7f57a80ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57acead640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f57a8159c60 0x7f57a80ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40104/0 (socket says 172.21.15.67:40104) 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57acead640 1 -- 172.21.15.67:0/3277542287 learned_addr learned my addr 172.21.15.67:0/3277542287 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57a7fff640 1 --2- 172.21.15.67:0/3277542287 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57a806ffd0 0x7f57a80aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57ad6ae640 1 --2- 172.21.15.67:0/3277542287 >> v2:172.21.15.97:3300/0 conn(0x7f57a80b3150 0x7f57a80af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57acead640 1 -- 172.21.15.67:0/3277542287 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57a806ffd0 msgr2=0x7f57a80aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57acead640 1 --2- 172.21.15.67:0/3277542287 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57a806ffd0 0x7f57a80aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57acead640 1 -- 172.21.15.67:0/3277542287 >> v2:172.21.15.97:3300/0 conn(0x7f57a80b3150 msgr2=0x7f57a80af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57acead640 1 --2- 172.21.15.67:0/3277542287 >> v2:172.21.15.97:3300/0 conn(0x7f57a80b3150 0x7f57a80af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57acead640 1 -- 172.21.15.67:0/3277542287 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a815c850 con 0x7f57a8159c60 2024-09-19T05:48:31.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57acead640 1 --2- 172.21.15.67:0/3277542287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 0x7f57a80ad130 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f57a80b2e70 tx=0x7f579801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7da52599d430845 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:31.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57a77fe640 1 -- 172.21.15.67:0/3277542287 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57980aa610 con 0x7f57a8159c60 2024-09-19T05:48:31.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57a77fe640 1 -- 172.21.15.67:0/3277542287 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57980af070 con 0x7f57a8159c60 2024-09-19T05:48:31.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57a77fe640 1 -- 172.21.15.67:0/3277542287 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57980aa9d0 con 0x7f57a8159c60 2024-09-19T05:48:31.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57af111640 1 -- 172.21.15.67:0/3277542287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 msgr2=0x7f57a80ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:31.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57af111640 1 --2- 172.21.15.67:0/3277542287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 0x7f57a80ad130 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f57a80b2e70 tx=0x7f579801c4f0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57af111640 1 -- 172.21.15.67:0/3277542287 shutdown_connections 2024-09-19T05:48:31.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57af111640 1 --2- 172.21.15.67:0/3277542287 >> v2:172.21.15.97:3300/0 conn(0x7f57a80b3150 0x7f57a80af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57af111640 1 --2- 172.21.15.67:0/3277542287 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57a806ffd0 0x7f57a80aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57af111640 1 --2- 172.21.15.67:0/3277542287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 0x7f57a80ad130 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57af111640 1 -- 172.21.15.67:0/3277542287 >> 172.21.15.67:0/3277542287 conn(0x7f57a80b1e50 msgr2=0x7f57a80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:31.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57af111640 1 -- 172.21.15.67:0/3277542287 shutdown_connections 2024-09-19T05:48:31.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.081+0000 7f57af111640 1 -- 172.21.15.67:0/3277542287 wait complete. 2024-09-19T05:48:31.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 Processor -- start 2024-09-19T05:48:31.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 -- start start 2024-09-19T05:48:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57a806ffd0 0x7f57a8145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57a80b3150 0x7f57a80b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 0x7f57a8150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f57a80ad7f0 con 0x7f57a8159c60 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f57a80ad670 con 0x7f57a80b3150 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f57a81605d0 con 0x7f57a806ffd0 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57ad6ae640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 0x7f57a8150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57ad6ae640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 0x7f57a8150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40118/0 (socket says 172.21.15.67:40118) 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57ad6ae640 1 -- 172.21.15.67:0/1523032348 learned_addr learned my addr 172.21.15.67:0/1523032348 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57acead640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57a806ffd0 0x7f57a8145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57a7fff640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57a80b3150 0x7f57a80b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57ad6ae640 1 -- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57a806ffd0 msgr2=0x7f57a8145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57ad6ae640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57a806ffd0 0x7f57a8145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57ad6ae640 1 -- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57a80b3150 msgr2=0x7f57a80b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57ad6ae640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57a80b3150 0x7f57a80b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57ad6ae640 1 -- 172.21.15.67:0/1523032348 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a80b1a90 con 0x7f57a8159c60 2024-09-19T05:48:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57ad6ae640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 0x7f57a8150890 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f57a0007e70 tx=0x7f57a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57a57fa640 1 -- 172.21.15.67:0/1523032348 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0014620 con 0x7f57a8159c60 2024-09-19T05:48:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57a57fa640 1 -- 172.21.15.67:0/1523032348 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a0019070 con 0x7f57a8159c60 2024-09-19T05:48:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 -- 172.21.15.67:0/1523032348 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a80b0770 con 0x7f57a8159c60 2024-09-19T05:48:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57a57fa640 1 -- 172.21.15.67:0/1523032348 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0014a20 con 0x7f57a8159c60 2024-09-19T05:48:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 -- 172.21.15.67:0/1523032348 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a8166aa0 con 0x7f57a8159c60 2024-09-19T05:48:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57af111640 1 -- 172.21.15.67:0/1523032348 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a81609b0 con 0x7f57a8159c60 2024-09-19T05:48:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.085+0000 7f57a57fa640 1 -- 172.21.15.67:0/1523032348 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57a0014bc0 con 0x7f57a8159c60 2024-09-19T05:48:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.089+0000 7f57a57fa640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57940678c0 0x7f5794069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.089+0000 7f57a57fa640 1 -- 172.21.15.67:0/1523032348 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 6274+0+0 (secure 0 0 0) 0x7f57a0086760 con 0x7f57a8159c60 2024-09-19T05:48:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.089+0000 7f57acead640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57940678c0 0x7f5794069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.089+0000 7f57acead640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57940678c0 0x7f5794069d80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f57980ae000 tx=0x7f57980a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:31.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.093+0000 7f57a57fa640 1 -- 172.21.15.67:0/1523032348 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f57a00570f0 con 0x7f57a8159c60 2024-09-19T05:48:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.297+0000 7f57af111640 1 -- 172.21.15.67:0/1523032348 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f57a80b3770 con 0x7f57a8159c60 2024-09-19T05:48:31.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.945+0000 7f57a57fa640 1 -- 172.21.15.67:0/1523032348 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v140) ==== 104+0+0 (secure 0 0 0) 0x7f57a00569f0 con 0x7f57a8159c60 2024-09-19T05:48:31.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 -- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57940678c0 msgr2=0x7f5794069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57940678c0 0x7f5794069d80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f57980ae000 tx=0x7f57980a7000 comp rx=0 tx=0).stop 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 -- 172.21.15.67:0/1523032348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 msgr2=0x7f57a8150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 0x7f57a8150890 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f57a0007e70 tx=0x7f57a000e4b0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 -- 172.21.15.67:0/1523032348 shutdown_connections 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57a8159c60 0x7f57a8150890 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57a80b3150 0x7f57a80b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f57940678c0 0x7f5794069d80 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 --2- 172.21.15.67:0/1523032348 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57a806ffd0 0x7f57a8145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 -- 172.21.15.67:0/1523032348 >> 172.21.15.67:0/1523032348 conn(0x7f57a80b1e50 msgr2=0x7f57a815aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 -- 172.21.15.67:0/1523032348 shutdown_connections 2024-09-19T05:48:31.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:31.949+0000 7f57af111640 1 -- 172.21.15.67:0/1523032348 wait complete. 2024-09-19T05:48:31.975 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:48:32.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.149+0000 7f62708b2640 1 Processor -- start 2024-09-19T05:48:32.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.149+0000 7f62708b2640 1 -- start start 2024-09-19T05:48:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f62708b2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0cf5e0 0x7f626c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f62708b2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626c15d030 con 0x7f626c15c850 2024-09-19T05:48:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f62708b2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626c15d310 con 0x7f626c15d8d0 2024-09-19T05:48:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f62708b2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f626c06de90 con 0x7f626c0cf5e0 2024-09-19T05:48:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f6269d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f626c15c850 0x7f626c06e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58730/0 (socket says 172.21.15.67:58730) 2024-09-19T05:48:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f6269d9b640 1 -- 172.21.15.67:0/97273559 learned_addr learned my addr 172.21.15.67:0/97273559 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626a59c640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0cf5e0 0x7f626c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254497387 0 0) 0x7f626c15d030 con 0x7f626c15c850 2024-09-19T05:48:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6254003530 con 0x7f626c15c850 2024-09-19T05:48:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2583158527 0 0) 0x7f6254003530 con 0x7f626c15c850 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0cf5e0 msgr2=0x7f626c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0cf5e0 0x7f626c0d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 >> v1:172.21.15.97:6789/0 conn(0x7f626c15d8d0 legacy=0x7f626c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626c15d5f0 con 0x7f626c15c850 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f6260001680 con 0x7f626c15c850 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 >> v1:172.21.15.67:6789/0 conn(0x7f626c15c850 legacy=0x7f626c06e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62540039f0 0x7f6254003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6254004810 0x7f6254004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0cf5e0 0x7f62540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f626c06de90 con 0x7f6254004810 2024-09-19T05:48:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f625400bab0 con 0x7f62540039f0 2024-09-19T05:48:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f625400bcb0 con 0x7f626c0cf5e0 2024-09-19T05:48:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f6269d9b640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6254004810 0x7f6254004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626ad9d640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0cf5e0 0x7f62540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626a59c640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62540039f0 0x7f6254003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f6269d9b640 1 -- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0cf5e0 msgr2=0x7f62540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f6269d9b640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0cf5e0 0x7f62540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f6269d9b640 1 -- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62540039f0 msgr2=0x7f6254003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f6269d9b640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62540039f0 0x7f6254003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f6269d9b640 1 -- 172.21.15.67:0/97273559 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6254003530 con 0x7f6254004810 2024-09-19T05:48:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.153+0000 7f626ad9d640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0cf5e0 0x7f62540051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f6269d9b640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6254004810 0x7f6254004c90 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f626000c0e0 tx=0x7f626001f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c113b6fe665a35f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260007c30 con 0x7f6254004810 2024-09-19T05:48:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62600ac020 con 0x7f6254004810 2024-09-19T05:48:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f626959a640 1 -- 172.21.15.67:0/97273559 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62600058e0 con 0x7f6254004810 2024-09-19T05:48:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 -- 172.21.15.67:0/97273559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6254004810 msgr2=0x7f6254004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 --2- 172.21.15.67:0/97273559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6254004810 0x7f6254004c90 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f626000c0e0 tx=0x7f626001f2b0 comp rx=0 tx=0).stop 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f626ad9d640 1 -- 172.21.15.67:0/97273559 reap_dead start 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 -- 172.21.15.67:0/97273559 shutdown_connections 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 -- 172.21.15.67:0/97273559 >> 172.21.15.67:0/97273559 conn(0x7f626c06c0c0 msgr2=0x7f626c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 -- 172.21.15.67:0/97273559 shutdown_connections 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 -- 172.21.15.67:0/97273559 wait complete. 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 Processor -- start 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 -- start start 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6254004810 0x7f626c099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f626c1609e0 0x7f626c0af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0b1850 0x7f626c0b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f626c0cf9c0 con 0x7f626c1609e0 2024-09-19T05:48:32.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f626c06e170 con 0x7f6254004810 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f62708b2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f626c0cfb40 con 0x7f626c0b1850 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f6269d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f626c1609e0 0x7f626c0af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f6269d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f626c1609e0 0x7f626c0af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40136/0 (socket says 172.21.15.67:40136) 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f6269d9b640 1 -- 172.21.15.67:0/2814874468 learned_addr learned my addr 172.21.15.67:0/2814874468 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f626a59c640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6254004810 0x7f626c099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.157+0000 7f626ad9d640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0b1850 0x7f626c0b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f6269d9b640 1 -- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0b1850 msgr2=0x7f626c0b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f6269d9b640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0b1850 0x7f626c0b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f6269d9b640 1 -- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6254004810 msgr2=0x7f626c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f6269d9b640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6254004810 0x7f626c099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f6269d9b640 1 -- 172.21.15.67:0/2814874468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626c099eb0 con 0x7f626c1609e0 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f626a59c640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6254004810 0x7f626c099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f6269d9b640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f626c1609e0 0x7f626c0af890 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f62600ae040 tx=0x7f6254005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f625affd640 1 -- 172.21.15.67:0/2814874468 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62600049f0 con 0x7f626c1609e0 2024-09-19T05:48:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f625affd640 1 -- 172.21.15.67:0/2814874468 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6260004b90 con 0x7f626c1609e0 2024-09-19T05:48:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f62708b2640 1 -- 172.21.15.67:0/2814874468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f626c0b00e0 con 0x7f626c1609e0 2024-09-19T05:48:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f625affd640 1 -- 172.21.15.67:0/2814874468 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62600070d0 con 0x7f626c1609e0 2024-09-19T05:48:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f62708b2640 1 -- 172.21.15.67:0/2814874468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f626c0b06a0 con 0x7f626c1609e0 2024-09-19T05:48:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f62708b2640 1 -- 172.21.15.67:0/2814874468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f626c0d0aa0 con 0x7f626c1609e0 2024-09-19T05:48:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f625affd640 1 -- 172.21.15.67:0/2814874468 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6260007270 con 0x7f626c1609e0 2024-09-19T05:48:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f625affd640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f624c0678f0 0x7f624c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f625affd640 1 -- 172.21.15.67:0/2814874468 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 6274+0+0 (secure 0 0 0) 0x7f6260123570 con 0x7f626c1609e0 2024-09-19T05:48:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f626a59c640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f624c0678f0 0x7f624c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.161+0000 7f626a59c640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f624c0678f0 0x7f624c069db0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f625c009af0 tx=0x7f625c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:32.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.165+0000 7f625affd640 1 -- 172.21.15.67:0/2814874468 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6260018fc0 con 0x7f626c1609e0 2024-09-19T05:48:32.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.329+0000 7f62708b2640 1 -- 172.21.15.67:0/2814874468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f626c154e80 con 0x7f626c1609e0 2024-09-19T05:48:32.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.957+0000 7f625affd640 1 -- 172.21.15.67:0/2814874468 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v195) ==== 181+0+0 (secure 0 0 0) 0x7f62600f3dd0 con 0x7f626c1609e0 2024-09-19T05:48:32.959 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:48:32.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 -- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f624c0678f0 msgr2=0x7f624c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:32.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f624c0678f0 0x7f624c069db0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f625c009af0 tx=0x7f625c008040 comp rx=0 tx=0).stop 2024-09-19T05:48:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 -- 172.21.15.67:0/2814874468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f626c1609e0 msgr2=0x7f626c0af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f626c1609e0 0x7f626c0af890 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f62600ae040 tx=0x7f6254005840 comp rx=0 tx=0).stop 2024-09-19T05:48:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 -- 172.21.15.67:0/2814874468 shutdown_connections 2024-09-19T05:48:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f624c0678f0 0x7f624c069db0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f626c0b1850 0x7f626c0b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f626c1609e0 0x7f626c0af890 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 --2- 172.21.15.67:0/2814874468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6254004810 0x7f626c099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 -- 172.21.15.67:0/2814874468 >> 172.21.15.67:0/2814874468 conn(0x7f626c06c0c0 msgr2=0x7f626c0737b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:32.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 -- 172.21.15.67:0/2814874468 shutdown_connections 2024-09-19T05:48:32.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:32.961+0000 7f62708b2640 1 -- 172.21.15.67:0/2814874468 wait complete. 2024-09-19T05:48:32.985 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:48:33.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.109+0000 7f307bc6e640 1 Processor -- start 2024-09-19T05:48:33.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.109+0000 7f307bc6e640 1 -- start start 2024-09-19T05:48:33.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.109+0000 7f307bc6e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f307415a950 0x7f30740b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:33.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.109+0000 7f307bc6e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30740b4ca0 con 0x7f3074071e30 2024-09-19T05:48:33.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.109+0000 7f307bc6e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30740b5200 con 0x7f3074072e50 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.109+0000 7f307bc6e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f307406dfc0 con 0x7f307415a950 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.109+0000 7f3079209640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3074071e30 0x7f3074072740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58740/0 (socket says 172.21.15.67:58740) 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.109+0000 7f3079209640 1 -- 172.21.15.67:0/3199733568 learned_addr learned my addr 172.21.15.67:0/3199733568 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3079a0a640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f307415a950 0x7f30740b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 69360164 0 0) 0x7f30700014a0 con 0x7f3074071e30 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f305c007940 con 0x7f3074071e30 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3074460097 0 0) 0x7f305c007940 con 0x7f3074071e30 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f307415a950 msgr2=0x7f30740b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f307415a950 0x7f30740b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 >> v1:172.21.15.97:6789/0 conn(0x7f3074072e50 legacy=0x7f307406ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30740b4f20 con 0x7f3074071e30 2024-09-19T05:48:33.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3070001bd0 con 0x7f3074071e30 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 >> v1:172.21.15.67:6789/0 conn(0x7f3074071e30 legacy=0x7f3074072740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f307415a950 0x7f305c007e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f305c008380 0x7f305c008c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 0x7f305c0095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f307406dfc0 con 0x7f305c009160 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f305c00ff70 con 0x7f305c008380 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f305c010170 con 0x7f307415a950 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307a20b640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 0x7f305c0095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3079209640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f305c008380 0x7f305c008c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307a20b640 1 -- 172.21.15.67:0/3199733568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f307415a950 msgr2=0x7f305c007e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:33.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307a20b640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f307415a950 0x7f305c007e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307a20b640 1 -- 172.21.15.67:0/3199733568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f305c008380 msgr2=0x7f305c008c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:33.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307a20b640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f305c008380 0x7f305c008c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307a20b640 1 -- 172.21.15.67:0/3199733568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305c007940 con 0x7f305c009160 2024-09-19T05:48:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307a20b640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 0x7f305c0095e0 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f30740cc5b0 tx=0x7f306401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eed37d6d426911e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:33.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30640013c0 con 0x7f305c009160 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30640052d0 con 0x7f305c009160 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f3078a08640 1 -- 172.21.15.67:0/3199733568 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064003800 con 0x7f305c009160 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307bc6e640 1 -- 172.21.15.67:0/3199733568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 msgr2=0x7f305c0095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307bc6e640 1 --2- 172.21.15.67:0/3199733568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 0x7f305c0095e0 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f30740cc5b0 tx=0x7f306401c3c0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307a20b640 1 -- 172.21.15.67:0/3199733568 reap_dead start 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307bc6e640 1 -- 172.21.15.67:0/3199733568 shutdown_connections 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307bc6e640 1 -- 172.21.15.67:0/3199733568 >> 172.21.15.67:0/3199733568 conn(0x7f307406c0c0 msgr2=0x7f307406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307bc6e640 1 -- 172.21.15.67:0/3199733568 shutdown_connections 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.113+0000 7f307bc6e640 1 -- 172.21.15.67:0/3199733568 wait complete. 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 Processor -- start 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 -- start start 2024-09-19T05:48:33.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 0x7f3074157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30741595b0 0x7f30740ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30740cd4b0 0x7f30740cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f30740ad550 con 0x7f305c009160 2024-09-19T05:48:33.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f307406e540 con 0x7f30740cd4b0 2024-09-19T05:48:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f30740ad6d0 con 0x7f30741595b0 2024-09-19T05:48:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f3079a0a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 0x7f3074157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f3079a0a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 0x7f3074157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40150/0 (socket says 172.21.15.67:40150) 2024-09-19T05:48:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f3079a0a640 1 -- 172.21.15.67:0/2261882960 learned_addr learned my addr 172.21.15.67:0/2261882960 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f3079209640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30741595b0 0x7f30740ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307a20b640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30740cd4b0 0x7f30740cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f3079a0a640 1 -- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30741595b0 msgr2=0x7f30740ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f3079a0a640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30741595b0 0x7f30740ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f3079a0a640 1 -- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30740cd4b0 msgr2=0x7f30740cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:33.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f3079a0a640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30740cd4b0 0x7f30740cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f3079a0a640 1 -- 172.21.15.67:0/2261882960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3074156e40 con 0x7f305c009160 2024-09-19T05:48:33.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f3079a0a640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 0x7f3074157ee0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f306c00b8a0 tx=0x7f306c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:33.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f306a7fc640 1 -- 172.21.15.67:0/2261882960 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c01b070 con 0x7f305c009160 2024-09-19T05:48:33.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f306a7fc640 1 -- 172.21.15.67:0/2261882960 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c00ed70 con 0x7f305c009160 2024-09-19T05:48:33.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 -- 172.21.15.67:0/2261882960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3074157120 con 0x7f305c009160 2024-09-19T05:48:33.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f306a7fc640 1 -- 172.21.15.67:0/2261882960 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c016610 con 0x7f305c009160 2024-09-19T05:48:33.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 -- 172.21.15.67:0/2261882960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30741576e0 con 0x7f305c009160 2024-09-19T05:48:33.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f307bc6e640 1 -- 172.21.15.67:0/2261882960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30740b4760 con 0x7f305c009160 2024-09-19T05:48:33.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.117+0000 7f306a7fc640 1 -- 172.21.15.67:0/2261882960 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f306c0167b0 con 0x7f305c009160 2024-09-19T05:48:33.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.121+0000 7f306a7fc640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30600678f0 0x7f3060069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.121+0000 7f306a7fc640 1 -- 172.21.15.67:0/2261882960 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5836+0+0 (secure 0 0 0) 0x7f306c085ee0 con 0x7f305c009160 2024-09-19T05:48:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.121+0000 7f3079209640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30600678f0 0x7f3060069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.121+0000 7f3079209640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30600678f0 0x7f3060069db0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f30740ceda0 tx=0x7f30700012a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.125+0000 7f306a7fc640 1 -- 172.21.15.67:0/2261882960 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f306c013070 con 0x7f305c009160 2024-09-19T05:48:33.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.289+0000 7f307bc6e640 1 -- 172.21.15.67:0/2261882960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f30740addf0 con 0x7f305c009160 2024-09-19T05:48:33.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.965+0000 7f306a7fc640 1 -- 172.21.15.67:0/2261882960 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v196) ==== 169+0+0 (secure 0 0 0) 0x7f306c056920 con 0x7f305c009160 2024-09-19T05:48:33.968 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:48:33.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 -- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30600678f0 msgr2=0x7f3060069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:33.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30600678f0 0x7f3060069db0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f30740ceda0 tx=0x7f30700012a0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 -- 172.21.15.67:0/2261882960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 msgr2=0x7f3074157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:33.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 0x7f3074157ee0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f306c00b8a0 tx=0x7f306c00bd60 comp rx=0 tx=0).stop 2024-09-19T05:48:33.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 -- 172.21.15.67:0/2261882960 shutdown_connections 2024-09-19T05:48:33.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30740cd4b0 0x7f30740cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30600678f0 0x7f3060069db0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30741595b0 0x7f30740ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 --2- 172.21.15.67:0/2261882960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c009160 0x7f3074157ee0 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:33.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 -- 172.21.15.67:0/2261882960 >> 172.21.15.67:0/2261882960 conn(0x7f307406c0c0 msgr2=0x7f30740b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:33.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 -- 172.21.15.67:0/2261882960 shutdown_connections 2024-09-19T05:48:33.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:33.973+0000 7f307bc6e640 1 -- 172.21.15.67:0/2261882960 wait complete. 2024-09-19T05:48:33.996 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:48:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26b14af640 1 Processor -- start 2024-09-19T05:48:34.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26b14af640 1 -- start start 2024-09-19T05:48:34.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26b14af640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26ac0d4fb0 0x7f26ac0d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26b14af640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f26ac0d13c0 0x7f26ac06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26b14af640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26ac0d35a0 con 0x7f26ac15e690 2024-09-19T05:48:34.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26b14af640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f26ac0d17f0 con 0x7f26ac0d4fb0 2024-09-19T05:48:34.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26b14af640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f26ac0d32c0 con 0x7f26ac0d13c0 2024-09-19T05:48:34.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26aa7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26ac0d4fb0 0x7f26ac0d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26aa7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26ac0d4fb0 0x7f26ac0d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40166/0 (socket says 172.21.15.67:40166) 2024-09-19T05:48:34.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26aa7fc640 1 -- 172.21.15.67:0/1614542579 learned_addr learned my addr 172.21.15.67:0/1614542579 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:34.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26ab7fe640 1 --2- 172.21.15.67:0/1614542579 >> v2:172.21.15.97:3300/0 conn(0x7f26ac0d13c0 0x7f26ac06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26aa7fc640 1 -- 172.21.15.67:0/1614542579 >> v2:172.21.15.97:3300/0 conn(0x7f26ac0d13c0 msgr2=0x7f26ac06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:34.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26aa7fc640 1 --2- 172.21.15.67:0/1614542579 >> v2:172.21.15.97:3300/0 conn(0x7f26ac0d13c0 0x7f26ac06db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26aa7fc640 1 -- 172.21.15.67:0/1614542579 >> v1:172.21.15.97:6789/0 conn(0x7f26ac15e690 legacy=0x7f26ac0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:34.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.125+0000 7f26aa7fc640 1 -- 172.21.15.67:0/1614542579 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac06d040 con 0x7f26ac0d4fb0 2024-09-19T05:48:34.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26aa7fc640 1 --2- 172.21.15.67:0/1614542579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac0d4fb0 0x7f26ac0d0e80 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0d3770 tx=0x7f269c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd541764024a626c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:34.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26a9ffb640 1 -- 172.21.15.67:0/1614542579 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0aa650 con 0x7f26ac0d4fb0 2024-09-19T05:48:34.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26a9ffb640 1 -- 172.21.15.67:0/1614542579 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269c0af070 con 0x7f26ac0d4fb0 2024-09-19T05:48:34.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26a9ffb640 1 -- 172.21.15.67:0/1614542579 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0aaa10 con 0x7f26ac0d4fb0 2024-09-19T05:48:34.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26b14af640 1 -- 172.21.15.67:0/1614542579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac0d4fb0 msgr2=0x7f26ac0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26b14af640 1 --2- 172.21.15.67:0/1614542579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac0d4fb0 0x7f26ac0d0e80 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0d3770 tx=0x7f269c01c4f0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26b14af640 1 -- 172.21.15.67:0/1614542579 shutdown_connections 2024-09-19T05:48:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26b14af640 1 --2- 172.21.15.67:0/1614542579 >> v2:172.21.15.97:3300/0 conn(0x7f26ac0d13c0 0x7f26ac06db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26b14af640 1 --2- 172.21.15.67:0/1614542579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac0d4fb0 0x7f26ac0d0e80 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26b14af640 1 -- 172.21.15.67:0/1614542579 >> 172.21.15.67:0/1614542579 conn(0x7f26ac0d4490 msgr2=0x7f26ac0d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26b14af640 1 -- 172.21.15.67:0/1614542579 shutdown_connections 2024-09-19T05:48:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26b14af640 1 -- 172.21.15.67:0/1614542579 wait complete. 2024-09-19T05:48:34.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26b14af640 1 Processor -- start 2024-09-19T05:48:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.129+0000 7f26b14af640 1 -- start start 2024-09-19T05:48:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26b14af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26ac0d13c0 0x7f26ac1f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26b14af640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26ac0d4fb0 0x7f26ac1f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26b14af640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac15e690 0x7f26ac1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26b14af640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac06e9f0 con 0x7f26ac15e690 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26b14af640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac06e870 con 0x7f26ac0d4fb0 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26b14af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f26ac06eb70 con 0x7f26ac0d13c0 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26ab7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac15e690 0x7f26ac1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26ab7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac15e690 0x7f26ac1590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40176/0 (socket says 172.21.15.67:40176) 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26ab7fe640 1 -- 172.21.15.67:0/196890422 learned_addr learned my addr 172.21.15.67:0/196890422 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26aaffd640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26ac0d13c0 0x7f26ac1f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26aa7fc640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26ac0d4fb0 0x7f26ac1f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26ab7fe640 1 -- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26ac0d13c0 msgr2=0x7f26ac1f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26ab7fe640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26ac0d13c0 0x7f26ac1f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26ab7fe640 1 -- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26ac0d4fb0 msgr2=0x7f26ac1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26ab7fe640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26ac0d4fb0 0x7f26ac1f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26ab7fe640 1 -- 172.21.15.67:0/196890422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac1f72d0 con 0x7f26ac15e690 2024-09-19T05:48:34.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26aa7fc640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26ac0d4fb0 0x7f26ac1f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:34.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26ab7fe640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac15e690 0x7f26ac1590b0 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f26a4007e70 tx=0x7f26a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:34.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26937fe640 1 -- 172.21.15.67:0/196890422 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4014620 con 0x7f26ac15e690 2024-09-19T05:48:34.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26937fe640 1 -- 172.21.15.67:0/196890422 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a4019070 con 0x7f26ac15e690 2024-09-19T05:48:34.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26b14af640 1 -- 172.21.15.67:0/196890422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ac1f75b0 con 0x7f26ac15e690 2024-09-19T05:48:34.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26937fe640 1 -- 172.21.15.67:0/196890422 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4014a20 con 0x7f26ac15e690 2024-09-19T05:48:34.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26b14af640 1 -- 172.21.15.67:0/196890422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ac1f6f10 con 0x7f26ac15e690 2024-09-19T05:48:34.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26b14af640 1 -- 172.21.15.67:0/196890422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ac159f00 con 0x7f26ac15e690 2024-09-19T05:48:34.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26937fe640 1 -- 172.21.15.67:0/196890422 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f26a4014bc0 con 0x7f26ac15e690 2024-09-19T05:48:34.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26937fe640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26980678f0 0x7f2698069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26937fe640 1 -- 172.21.15.67:0/196890422 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f26a4086350 con 0x7f26ac15e690 2024-09-19T05:48:34.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.133+0000 7f26aaffd640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26980678f0 0x7f2698069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.137+0000 7f26aaffd640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26980678f0 0x7f2698069db0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0cea40 tx=0x7f26a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:34.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.137+0000 7f26937fe640 1 -- 172.21.15.67:0/196890422 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f26a4057000 con 0x7f26ac15e690 2024-09-19T05:48:34.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.321+0000 7f26b14af640 1 -- 172.21.15.67:0/196890422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f26ac06db20 con 0x7f26ac15e690 2024-09-19T05:48:34.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.325+0000 7f26937fe640 1 -- 172.21.15.67:0/196890422 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v47) ==== 104+0+0 (secure 0 0 0) 0x7f26a4056900 con 0x7f26ac15e690 2024-09-19T05:48:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 -- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26980678f0 msgr2=0x7f2698069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26980678f0 0x7f2698069db0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0cea40 tx=0x7f26a0009040 comp rx=0 tx=0).stop 2024-09-19T05:48:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 -- 172.21.15.67:0/196890422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac15e690 msgr2=0x7f26ac1590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac15e690 0x7f26ac1590b0 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f26a4007e70 tx=0x7f26a400e4b0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 -- 172.21.15.67:0/196890422 shutdown_connections 2024-09-19T05:48:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26ac15e690 0x7f26ac1590b0 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26ac0d4fb0 0x7f26ac1f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f26980678f0 0x7f2698069db0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 --2- 172.21.15.67:0/196890422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26ac0d13c0 0x7f26ac1f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 -- 172.21.15.67:0/196890422 >> 172.21.15.67:0/196890422 conn(0x7f26ac0d4490 msgr2=0x7f26ac0b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 -- 172.21.15.67:0/196890422 shutdown_connections 2024-09-19T05:48:34.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.329+0000 7f26b14af640 1 -- 172.21.15.67:0/196890422 wait complete. 2024-09-19T05:48:34.347 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-19T05:48:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83b028d640 1 Processor -- start 2024-09-19T05:48:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83b028d640 1 -- start start 2024-09-19T05:48:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83b028d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a8071e80 0x7f83a80af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83b028d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a80b3070 con 0x7f83a815b710 2024-09-19T05:48:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83b028d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a80b32e0 con 0x7f83a815c200 2024-09-19T05:48:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83b028d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f83a80b35c0 con 0x7f83a8071e80 2024-09-19T05:48:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ae029640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f83a815b710 0x7f83a815baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58744/0 (socket says 172.21.15.67:58744) 2024-09-19T05:48:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ae029640 1 -- 172.21.15.67:0/1629291077 learned_addr learned my addr 172.21.15.67:0/1629291077 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ae82a640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a8071e80 0x7f83a80af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725092172 0 0) 0x7f83a80b3070 con 0x7f83a815b710 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8394003530 con 0x7f83a815b710 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 200281753 0 0) 0x7f8394003530 con 0x7f83a815b710 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a8071e80 msgr2=0x7f83a80af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a8071e80 0x7f83a80af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 >> v1:172.21.15.97:6789/0 conn(0x7f83a815c200 legacy=0x7f83a80aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a80b38a0 con 0x7f83a815b710 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f83a4001a00 con 0x7f83a815b710 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 >> v1:172.21.15.67:6789/0 conn(0x7f83a815b710 legacy=0x7f83a815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83940039f0 0x7f8394003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a8071e80 0x7f8394004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 0x7f83940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80b35c0 con 0x7f8394004d50 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f839400bab0 con 0x7f83940039f0 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f839400dec0 con 0x7f83a8071e80 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ae82a640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 0x7f83940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ae029640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83940039f0 0x7f8394003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ad828640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a8071e80 0x7f8394004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ae82a640 1 -- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a8071e80 msgr2=0x7f8394004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ae82a640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a8071e80 0x7f8394004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ae82a640 1 -- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83940039f0 msgr2=0x7f8394003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ae82a640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83940039f0 0x7f8394003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.465+0000 7f83ae82a640 1 -- 172.21.15.67:0/1629291077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8394003530 con 0x7f8394004d50 2024-09-19T05:48:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83ae82a640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 0x7f83940051d0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009ab0 tx=0x7f83a001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd14271337fb6bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a00b2070 con 0x7f8394004d50 2024-09-19T05:48:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a00a5640 con 0x7f8394004d50 2024-09-19T05:48:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83ad027640 1 -- 172.21.15.67:0/1629291077 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a00096b0 con 0x7f8394004d50 2024-09-19T05:48:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83b028d640 1 -- 172.21.15.67:0/1629291077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 msgr2=0x7f83940051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83b028d640 1 --2- 172.21.15.67:0/1629291077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 0x7f83940051d0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009ab0 tx=0x7f83a001ca50 comp rx=0 tx=0).stop 2024-09-19T05:48:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83ae82a640 1 -- 172.21.15.67:0/1629291077 reap_dead start 2024-09-19T05:48:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83b028d640 1 -- 172.21.15.67:0/1629291077 shutdown_connections 2024-09-19T05:48:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83b028d640 1 -- 172.21.15.67:0/1629291077 >> 172.21.15.67:0/1629291077 conn(0x7f83a80d0080 msgr2=0x7f83a80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83b028d640 1 -- 172.21.15.67:0/1629291077 shutdown_connections 2024-09-19T05:48:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83b028d640 1 -- 172.21.15.67:0/1629291077 wait complete. 2024-09-19T05:48:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83b028d640 1 Processor -- start 2024-09-19T05:48:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.469+0000 7f83b028d640 1 -- start start 2024-09-19T05:48:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83b028d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 0x7f83a814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83b028d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83a809dab0 0x7f83a814c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83b028d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a814c720 0x7f83a81f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83b028d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80af7d0 con 0x7f8394004d50 2024-09-19T05:48:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83b028d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80af650 con 0x7f83a809dab0 2024-09-19T05:48:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83b028d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f83a80af950 con 0x7f83a814c720 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ae029640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 0x7f83a814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ae029640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 0x7f83a814eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40208/0 (socket says 172.21.15.67:40208) 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ae029640 1 -- 172.21.15.67:0/1925950175 learned_addr learned my addr 172.21.15.67:0/1925950175 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ae82a640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a814c720 0x7f83a81f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ad828640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83a809dab0 0x7f83a814c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ae029640 1 -- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a814c720 msgr2=0x7f83a81f01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ae029640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a814c720 0x7f83a81f01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ae029640 1 -- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83a809dab0 msgr2=0x7f83a814c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ae029640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83a809dab0 0x7f83a814c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ae029640 1 -- 172.21.15.67:0/1925950175 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a81e6220 con 0x7f8394004d50 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ae029640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 0x7f83a814eda0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f83a4007a80 tx=0x7f83a400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f839affd640 1 -- 172.21.15.67:0/1925950175 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4013420 con 0x7f8394004d50 2024-09-19T05:48:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f839affd640 1 -- 172.21.15.67:0/1925950175 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a4018070 con 0x7f8394004d50 2024-09-19T05:48:34.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f839affd640 1 -- 172.21.15.67:0/1925950175 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4013800 con 0x7f8394004d50 2024-09-19T05:48:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83b028d640 1 -- 172.21.15.67:0/1925950175 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a814dd00 con 0x7f8394004d50 2024-09-19T05:48:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83b028d640 1 -- 172.21.15.67:0/1925950175 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a814e2c0 con 0x7f8394004d50 2024-09-19T05:48:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83b028d640 1 -- 172.21.15.67:0/1925950175 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a815baf0 con 0x7f8394004d50 2024-09-19T05:48:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f839affd640 1 -- 172.21.15.67:0/1925950175 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83a40139a0 con 0x7f8394004d50 2024-09-19T05:48:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f839affd640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f838c0678c0 0x7f838c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f839affd640 1 -- 172.21.15.67:0/1925950175 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f83a4086280 con 0x7f8394004d50 2024-09-19T05:48:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.473+0000 7f83ad828640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f838c0678c0 0x7f838c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:34.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.477+0000 7f83ad828640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f838c0678c0 0x7f838c069d80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f83a8153240 tx=0x7f839c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:34.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.477+0000 7f839affd640 1 -- 172.21.15.67:0/1925950175 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f83a4056f30 con 0x7f8394004d50 2024-09-19T05:48:34.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.697+0000 7f83b028d640 1 -- 172.21.15.67:0/1925950175 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f83a80b5020 con 0x7f8394004d50 2024-09-19T05:48:34.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.969+0000 7f839affd640 1 -- 172.21.15.67:0/1925950175 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v687) ==== 140+0+0 (secure 0 0 0) 0x7f83a4056830 con 0x7f8394004d50 2024-09-19T05:48:34.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 -- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f838c0678c0 msgr2=0x7f838c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f838c0678c0 0x7f838c069d80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f83a8153240 tx=0x7f839c009040 comp rx=0 tx=0).stop 2024-09-19T05:48:34.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 -- 172.21.15.67:0/1925950175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 msgr2=0x7f83a814eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:34.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 0x7f83a814eda0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f83a4007a80 tx=0x7f83a400e530 comp rx=0 tx=0).stop 2024-09-19T05:48:34.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 -- 172.21.15.67:0/1925950175 shutdown_connections 2024-09-19T05:48:34.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f838c0678c0 0x7f838c069d80 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83a814c720 0x7f83a81f01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83a809dab0 0x7f83a814c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 --2- 172.21.15.67:0/1925950175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8394004d50 0x7f83a814eda0 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:34.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 -- 172.21.15.67:0/1925950175 >> 172.21.15.67:0/1925950175 conn(0x7f83a80d0080 msgr2=0x7f83a80cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:34.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 -- 172.21.15.67:0/1925950175 shutdown_connections 2024-09-19T05:48:34.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:34.973+0000 7f83b028d640 1 -- 172.21.15.67:0/1925950175 wait complete. 2024-09-19T05:48:34.993 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-19T05:48:34.994 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-19T05:48:34.995 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:48:35.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.109+0000 7eff58407640 1 Processor -- start 2024-09-19T05:48:35.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.109+0000 7eff58407640 1 -- start start 2024-09-19T05:48:35.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff58407640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff5006f460 0x7eff5006f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff58407640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5006e3c0 con 0x7eff5006dde0 2024-09-19T05:48:35.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff58407640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5006e6a0 con 0x7eff5015c030 2024-09-19T05:48:35.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff58407640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7eff5006e980 con 0x7eff5006f460 2024-09-19T05:48:35.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff569a4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff5006f460 0x7eff5006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff559a2640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7eff5006dde0 0x7eff500b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58750/0 (socket says 172.21.15.67:58750) 2024-09-19T05:48:35.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff559a2640 1 -- 172.21.15.67:0/1547015736 learned_addr learned my addr 172.21.15.67:0/1547015736 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:35.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff569a4640 1 --2- 172.21.15.67:0/1547015736 >> v2:172.21.15.67:3300/0 conn(0x7eff5006f460 0x7eff5006f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40214/0 (socket says 172.21.15.67:40214) 2024-09-19T05:48:35.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff569a4640 1 -- 172.21.15.67:0/1547015736 >> v1:172.21.15.97:6789/0 conn(0x7eff5015c030 legacy=0x7eff5015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:35.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff569a4640 1 -- 172.21.15.67:0/1547015736 >> v1:172.21.15.67:6789/0 conn(0x7eff5006dde0 legacy=0x7eff500b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff569a4640 1 -- 172.21.15.67:0/1547015736 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5006ec60 con 0x7eff5006f460 2024-09-19T05:48:35.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff569a4640 1 --2- 172.21.15.67:0/1547015736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5006f460 0x7eff5006f870 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7eff48009d90 tx=0x7eff4801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17aeae5abbb75140 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:35.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff551a1640 1 -- 172.21.15.67:0/1547015736 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff480b2070 con 0x7eff5006f460 2024-09-19T05:48:35.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff551a1640 1 -- 172.21.15.67:0/1547015736 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff480a57f0 con 0x7eff5006f460 2024-09-19T05:48:35.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff551a1640 1 -- 172.21.15.67:0/1547015736 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff480a5bc0 con 0x7eff5006f460 2024-09-19T05:48:35.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff58407640 1 -- 172.21.15.67:0/1547015736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5006f460 msgr2=0x7eff5006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.113+0000 7eff58407640 1 --2- 172.21.15.67:0/1547015736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5006f460 0x7eff5006f870 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7eff48009d90 tx=0x7eff4801c930 comp rx=0 tx=0).stop 2024-09-19T05:48:35.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- 172.21.15.67:0/1547015736 shutdown_connections 2024-09-19T05:48:35.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 --2- 172.21.15.67:0/1547015736 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5006f460 0x7eff5006f870 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- 172.21.15.67:0/1547015736 >> 172.21.15.67:0/1547015736 conn(0x7eff500d0080 msgr2=0x7eff500d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- 172.21.15.67:0/1547015736 shutdown_connections 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- 172.21.15.67:0/1547015736 wait complete. 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 Processor -- start 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- start start 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff5006dde0 0x7eff50073b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff5006f460 0x7eff50071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5015c030 0x7eff500723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff5016a270 con 0x7eff5015c030 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7eff5016a0f0 con 0x7eff5006dde0 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7eff5016a3f0 con 0x7eff5006f460 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff569a4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5015c030 0x7eff500723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff569a4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5015c030 0x7eff500723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40230/0 (socket says 172.21.15.67:40230) 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff569a4640 1 -- 172.21.15.67:0/803696823 learned_addr learned my addr 172.21.15.67:0/803696823 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff559a2640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff5006f460 0x7eff50071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff569a4640 1 -- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff5006f460 msgr2=0x7eff50071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff569a4640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff5006f460 0x7eff50071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff569a4640 1 -- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff5006dde0 msgr2=0x7eff50073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff561a3640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff5006dde0 0x7eff50073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff569a4640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff5006dde0 0x7eff50073b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff569a4640 1 -- 172.21.15.67:0/803696823 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff50153a50 con 0x7eff5015c030 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff569a4640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5015c030 0x7eff500723c0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7eff480b0040 tx=0x7eff480196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff46ffd640 1 -- 172.21.15.67:0/803696823 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff480b2040 con 0x7eff5015c030 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff46ffd640 1 -- 172.21.15.67:0/803696823 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff480bf070 con 0x7eff5015c030 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- 172.21.15.67:0/803696823 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff50153d30 con 0x7eff5015c030 2024-09-19T05:48:35.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff46ffd640 1 -- 172.21.15.67:0/803696823 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff480b88b0 con 0x7eff5015c030 2024-09-19T05:48:35.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- 172.21.15.67:0/803696823 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff501542f0 con 0x7eff5015c030 2024-09-19T05:48:35.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.117+0000 7eff58407640 1 -- 172.21.15.67:0/803696823 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff5006f870 con 0x7eff5015c030 2024-09-19T05:48:35.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.121+0000 7eff46ffd640 1 -- 172.21.15.67:0/803696823 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff480b8a50 con 0x7eff5015c030 2024-09-19T05:48:35.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.121+0000 7eff46ffd640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff340678c0 0x7eff34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.121+0000 7eff46ffd640 1 -- 172.21.15.67:0/803696823 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7eff48120c90 con 0x7eff5015c030 2024-09-19T05:48:35.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.121+0000 7eff561a3640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff340678c0 0x7eff34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.121+0000 7eff561a3640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff340678c0 0x7eff34069d80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7eff500b1390 tx=0x7eff4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:35.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.125+0000 7eff46ffd640 1 -- 172.21.15.67:0/803696823 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7eff48016520 con 0x7eff5015c030 2024-09-19T05:48:35.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.281+0000 7eff58407640 1 -- 172.21.15.67:0/803696823 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff5014ad80 con 0x7eff5015c030 2024-09-19T05:48:35.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.281+0000 7eff46ffd640 1 -- 172.21.15.67:0/803696823 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) ==== 74+0+13279 (secure 0 0 0) 0x7eff480f1a60 con 0x7eff5015c030 2024-09-19T05:48:35.283 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:35.283 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":196,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:48:33.963508+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/2221933052":"2024-09-20T05:48:30.945041+0000","172.21.15.67:6834/2221933052":"2024-09-20T05:48:30.945041+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:48:35.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 -- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff340678c0 msgr2=0x7eff34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff340678c0 0x7eff34069d80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7eff500b1390 tx=0x7eff4c008040 comp rx=0 tx=0).stop 2024-09-19T05:48:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 -- 172.21.15.67:0/803696823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5015c030 msgr2=0x7eff500723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5015c030 0x7eff500723c0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7eff480b0040 tx=0x7eff480196d0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 -- 172.21.15.67:0/803696823 shutdown_connections 2024-09-19T05:48:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff5015c030 0x7eff500723c0 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff340678c0 0x7eff34069d80 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff5006f460 0x7eff50071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 --2- 172.21.15.67:0/803696823 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff5006dde0 0x7eff50073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 -- 172.21.15.67:0/803696823 >> 172.21.15.67:0/803696823 conn(0x7eff500d0080 msgr2=0x7eff5015b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 -- 172.21.15.67:0/803696823 shutdown_connections 2024-09-19T05:48:35.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.285+0000 7eff58407640 1 -- 172.21.15.67:0/803696823 wait complete. 2024-09-19T05:48:35.302 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:33:03.181927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:48:35.302 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:48:35.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.425+0000 7fee6985b640 1 Processor -- start 2024-09-19T05:48:35.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.425+0000 7fee6985b640 1 -- start start 2024-09-19T05:48:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee6985b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee6406ffd0 0x7fee640aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee6985b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fee640b3150 0x7fee640af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee6985b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee640ad840 con 0x7fee64159c60 2024-09-19T05:48:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee6985b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fee640af710 con 0x7fee6406ffd0 2024-09-19T05:48:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee6985b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fee6415d460 con 0x7fee640b3150 2024-09-19T05:48:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee62ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fee64159c60 0x7fee640ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58762/0 (socket says 172.21.15.67:58762) 2024-09-19T05:48:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee62ffd640 1 -- 172.21.15.67:0/2835428817 learned_addr learned my addr 172.21.15.67:0/2835428817 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee627fc640 1 --2- 172.21.15.67:0/2835428817 >> v2:172.21.15.67:3300/0 conn(0x7fee6406ffd0 0x7fee640aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee637fe640 1 --2- 172.21.15.67:0/2835428817 >> v2:172.21.15.97:3300/0 conn(0x7fee640b3150 0x7fee640af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee61ffb640 1 -- 172.21.15.67:0/2835428817 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524032667 0 0) 0x7fee640ad840 con 0x7fee64159c60 2024-09-19T05:48:35.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee61ffb640 1 -- 172.21.15.67:0/2835428817 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee50003530 con 0x7fee64159c60 2024-09-19T05:48:35.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee627fc640 1 -- 172.21.15.67:0/2835428817 >> v2:172.21.15.97:3300/0 conn(0x7fee640b3150 msgr2=0x7fee640af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:35.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee627fc640 1 --2- 172.21.15.67:0/2835428817 >> v2:172.21.15.97:3300/0 conn(0x7fee640b3150 0x7fee640af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee627fc640 1 -- 172.21.15.67:0/2835428817 >> v1:172.21.15.67:6789/0 conn(0x7fee64159c60 legacy=0x7fee640ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee627fc640 1 -- 172.21.15.67:0/2835428817 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6415a040 con 0x7fee6406ffd0 2024-09-19T05:48:35.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee627fc640 1 --2- 172.21.15.67:0/2835428817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee6406ffd0 0x7fee640aec90 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7fee64071950 tx=0x7fee5401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627b4a2f0e9b2bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:35.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee61ffb640 1 -- 172.21.15.67:0/2835428817 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee540ab650 con 0x7fee6406ffd0 2024-09-19T05:48:35.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee61ffb640 1 -- 172.21.15.67:0/2835428817 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee540b0070 con 0x7fee6406ffd0 2024-09-19T05:48:35.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee61ffb640 1 -- 172.21.15.67:0/2835428817 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee540ab9f0 con 0x7fee6406ffd0 2024-09-19T05:48:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee6985b640 1 -- 172.21.15.67:0/2835428817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee6406ffd0 msgr2=0x7fee640aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.429+0000 7fee6985b640 1 --2- 172.21.15.67:0/2835428817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee6406ffd0 0x7fee640aec90 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7fee64071950 tx=0x7fee5401c450 comp rx=0 tx=0).stop 2024-09-19T05:48:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 -- 172.21.15.67:0/2835428817 shutdown_connections 2024-09-19T05:48:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 --2- 172.21.15.67:0/2835428817 >> v2:172.21.15.97:3300/0 conn(0x7fee640b3150 0x7fee640af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 --2- 172.21.15.67:0/2835428817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee6406ffd0 0x7fee640aec90 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 -- 172.21.15.67:0/2835428817 >> 172.21.15.67:0/2835428817 conn(0x7fee640b1e50 msgr2=0x7fee640b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 -- 172.21.15.67:0/2835428817 shutdown_connections 2024-09-19T05:48:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 -- 172.21.15.67:0/2835428817 wait complete. 2024-09-19T05:48:35.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 Processor -- start 2024-09-19T05:48:35.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 -- start start 2024-09-19T05:48:35.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6406ffd0 0x7fee6414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee640b3150 0x7fee6415ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee64159c60 0x7fee6415f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fee641605b0 con 0x7fee64159c60 2024-09-19T05:48:35.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fee6415d0f0 con 0x7fee6406ffd0 2024-09-19T05:48:35.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fee64160730 con 0x7fee640b3150 2024-09-19T05:48:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee64159c60 0x7fee6415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee64159c60 0x7fee6415f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40248/0 (socket says 172.21.15.67:40248) 2024-09-19T05:48:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee637fe640 1 -- 172.21.15.67:0/2784717156 learned_addr learned my addr 172.21.15.67:0/2784717156 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee62ffd640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6406ffd0 0x7fee6414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee627fc640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee640b3150 0x7fee6415ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee637fe640 1 -- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee640b3150 msgr2=0x7fee6415ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee637fe640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee640b3150 0x7fee6415ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee637fe640 1 -- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6406ffd0 msgr2=0x7fee6414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee637fe640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6406ffd0 0x7fee6414fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee637fe640 1 -- 172.21.15.67:0/2784717156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee64153940 con 0x7fee64159c60 2024-09-19T05:48:35.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee627fc640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee640b3150 0x7fee6415ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:35.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee637fe640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee64159c60 0x7fee6415f440 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7fee5c007e40 tx=0x7fee5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:35.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee5bfff640 1 -- 172.21.15.67:0/2784717156 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c014620 con 0x7fee64159c60 2024-09-19T05:48:35.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee5bfff640 1 -- 172.21.15.67:0/2784717156 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5c019070 con 0x7fee64159c60 2024-09-19T05:48:35.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 -- 172.21.15.67:0/2784717156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6414bd80 con 0x7fee64159c60 2024-09-19T05:48:35.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee5bfff640 1 -- 172.21.15.67:0/2784717156 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c014a20 con 0x7fee64159c60 2024-09-19T05:48:35.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.433+0000 7fee6985b640 1 -- 172.21.15.67:0/2784717156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6414e9f0 con 0x7fee64159c60 2024-09-19T05:48:35.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.437+0000 7fee6985b640 1 -- 172.21.15.67:0/2784717156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee64160ac0 con 0x7fee64159c60 2024-09-19T05:48:35.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.437+0000 7fee5bfff640 1 -- 172.21.15.67:0/2784717156 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee5c014bc0 con 0x7fee64159c60 2024-09-19T05:48:35.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.437+0000 7fee5bfff640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee440678c0 0x7fee44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.437+0000 7fee5bfff640 1 -- 172.21.15.67:0/2784717156 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fee5c086350 con 0x7fee64159c60 2024-09-19T05:48:35.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.437+0000 7fee62ffd640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee440678c0 0x7fee44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.437+0000 7fee62ffd640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee440678c0 0x7fee44069d80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fee4c007fd0 tx=0x7fee4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:35.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.441+0000 7fee5bfff640 1 -- 172.21.15.67:0/2784717156 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fee5c057090 con 0x7fee64159c60 2024-09-19T05:48:35.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.605+0000 7fee6985b640 1 -- 172.21.15.67:0/2784717156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fee640b44b0 con 0x7fee64159c60 2024-09-19T05:48:35.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.605+0000 7fee5bfff640 1 -- 172.21.15.67:0/2784717156 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v196) ==== 93+0+10 (secure 0 0 0) 0x7fee5c056990 con 0x7fee64159c60 2024-09-19T05:48:35.605 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-19T05:48:35.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.605+0000 7fee6985b640 1 -- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee440678c0 msgr2=0x7fee44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.605+0000 7fee6985b640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee440678c0 0x7fee44069d80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fee4c007fd0 tx=0x7fee4c009040 comp rx=0 tx=0).stop 2024-09-19T05:48:35.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.605+0000 7fee6985b640 1 -- 172.21.15.67:0/2784717156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee64159c60 msgr2=0x7fee6415f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.605+0000 7fee6985b640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee64159c60 0x7fee6415f440 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7fee5c007e40 tx=0x7fee5c00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.605+0000 7fee6985b640 1 -- 172.21.15.67:0/2784717156 shutdown_connections 2024-09-19T05:48:35.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.605+0000 7fee6985b640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee64159c60 0x7fee6415f440 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.605+0000 7fee6985b640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fee440678c0 0x7fee44069d80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.609+0000 7fee6985b640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee640b3150 0x7fee6415ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.609+0000 7fee6985b640 1 --2- 172.21.15.67:0/2784717156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6406ffd0 0x7fee6414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.609+0000 7fee6985b640 1 -- 172.21.15.67:0/2784717156 >> 172.21.15.67:0/2784717156 conn(0x7fee640b1e50 msgr2=0x7fee640b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:35.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.609+0000 7fee6985b640 1 -- 172.21.15.67:0/2784717156 shutdown_connections 2024-09-19T05:48:35.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.609+0000 7fee6985b640 1 -- 172.21.15.67:0/2784717156 wait complete. 2024-09-19T05:48:35.625 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-19T05:48:35.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f515da97640 1 Processor -- start 2024-09-19T05:48:35.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f515da97640 1 -- start start 2024-09-19T05:48:35.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f515da97640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f515809b140 0x7f51580705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f515da97640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f515815d290 0x7f5158159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f515da97640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51580c7130 con 0x7f51580c8c40 2024-09-19T05:48:35.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f515da97640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5158070b90 con 0x7f515815d290 2024-09-19T05:48:35.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f515da97640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5158070e70 con 0x7f515809b140 2024-09-19T05:48:35.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f51577fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f51580c8c40 0x7f515809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58768/0 (socket says 172.21.15.67:58768) 2024-09-19T05:48:35.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f51577fe640 1 -- 172.21.15.67:0/666349739 learned_addr learned my addr 172.21.15.67:0/666349739 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:35.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f5157fff640 1 --2- 172.21.15.67:0/666349739 >> v2:172.21.15.67:3300/0 conn(0x7f515815d290 0x7f5158159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f5156ffd640 1 --2- 172.21.15.67:0/666349739 >> v2:172.21.15.97:3300/0 conn(0x7f515809b140 0x7f51580705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f51567fc640 1 -- 172.21.15.67:0/666349739 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 256957616 0 0) 0x7f51580c7130 con 0x7f51580c8c40 2024-09-19T05:48:35.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f51567fc640 1 -- 172.21.15.67:0/666349739 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5144003530 con 0x7f51580c8c40 2024-09-19T05:48:35.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f5157fff640 1 -- 172.21.15.67:0/666349739 >> v2:172.21.15.97:3300/0 conn(0x7f515809b140 msgr2=0x7f51580705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:35.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f5157fff640 1 --2- 172.21.15.67:0/666349739 >> v2:172.21.15.97:3300/0 conn(0x7f515809b140 0x7f51580705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f5157fff640 1 -- 172.21.15.67:0/666349739 >> v1:172.21.15.67:6789/0 conn(0x7f51580c8c40 legacy=0x7f515809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.741+0000 7f5157fff640 1 -- 172.21.15.67:0/666349739 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5158071150 con 0x7f515815d290 2024-09-19T05:48:35.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f5157fff640 1 --2- 172.21.15.67:0/666349739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 0x7f5158159550 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f515809be90 tx=0x7f514801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4817e58511a924 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:35.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f51567fc640 1 -- 172.21.15.67:0/666349739 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51480b1070 con 0x7f515815d290 2024-09-19T05:48:35.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f51567fc640 1 -- 172.21.15.67:0/666349739 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51480ac5f0 con 0x7f515815d290 2024-09-19T05:48:35.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f51567fc640 1 -- 172.21.15.67:0/666349739 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51480ac9c0 con 0x7f515815d290 2024-09-19T05:48:35.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f515da97640 1 -- 172.21.15.67:0/666349739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 msgr2=0x7f5158159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f515da97640 1 --2- 172.21.15.67:0/666349739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 0x7f5158159550 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f515809be90 tx=0x7f514801cee0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f515da97640 1 -- 172.21.15.67:0/666349739 shutdown_connections 2024-09-19T05:48:35.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f515da97640 1 --2- 172.21.15.67:0/666349739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 0x7f5158159550 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f515da97640 1 --2- 172.21.15.67:0/666349739 >> v2:172.21.15.97:3300/0 conn(0x7f515809b140 0x7f51580705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f515da97640 1 -- 172.21.15.67:0/666349739 >> 172.21.15.67:0/666349739 conn(0x7f51580d22b0 msgr2=0x7f51580d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:35.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f515da97640 1 -- 172.21.15.67:0/666349739 shutdown_connections 2024-09-19T05:48:35.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f515da97640 1 -- 172.21.15.67:0/666349739 wait complete. 2024-09-19T05:48:35.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f515da97640 1 Processor -- start 2024-09-19T05:48:35.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.745+0000 7f515da97640 1 -- start start 2024-09-19T05:48:35.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f515da97640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f515809b140 0x7f515806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f515da97640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51580c8c40 0x7f5158153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f515da97640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 0x7f51581666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f515da97640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f51580d0be0 con 0x7f515815d290 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f515da97640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f51580d0a60 con 0x7f515809b140 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f515da97640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f51580d0d60 con 0x7f51580c8c40 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f5157fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 0x7f51581666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f5157fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 0x7f51581666d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40270/0 (socket says 172.21.15.67:40270) 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f5157fff640 1 -- 172.21.15.67:0/3073528849 learned_addr learned my addr 172.21.15.67:0/3073528849 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f5156ffd640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51580c8c40 0x7f5158153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f51577fe640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f515809b140 0x7f515806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f5157fff640 1 -- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51580c8c40 msgr2=0x7f5158153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f5157fff640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51580c8c40 0x7f5158153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f5157fff640 1 -- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f515809b140 msgr2=0x7f515806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f5157fff640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f515809b140 0x7f515806d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f5157fff640 1 -- 172.21.15.67:0/3073528849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5158165c30 con 0x7f515815d290 2024-09-19T05:48:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f5157fff640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 0x7f51581666d0 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f514801ab30 tx=0x7f5148019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f514ffff640 1 -- 172.21.15.67:0/3073528849 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51480b1040 con 0x7f515815d290 2024-09-19T05:48:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f514ffff640 1 -- 172.21.15.67:0/3073528849 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51480bc070 con 0x7f515815d290 2024-09-19T05:48:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f514ffff640 1 -- 172.21.15.67:0/3073528849 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51480b5410 con 0x7f515815d290 2024-09-19T05:48:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f515da97640 1 -- 172.21.15.67:0/3073528849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515806dd20 con 0x7f515815d290 2024-09-19T05:48:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f515da97640 1 -- 172.21.15.67:0/3073528849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5158159770 con 0x7f515815d290 2024-09-19T05:48:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f515da97640 1 -- 172.21.15.67:0/3073528849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51580705b0 con 0x7f515815d290 2024-09-19T05:48:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f514ffff640 1 -- 172.21.15.67:0/3073528849 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f51480b55b0 con 0x7f515815d290 2024-09-19T05:48:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f514ffff640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51380678c0 0x7f5138069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.749+0000 7f514ffff640 1 -- 172.21.15.67:0/3073528849 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f514811ff20 con 0x7f515815d290 2024-09-19T05:48:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.753+0000 7f51577fe640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51380678c0 0x7f5138069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.753+0000 7f51577fe640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51380678c0 0x7f5138069d80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f5158154850 tx=0x7f5150009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:35.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.753+0000 7f514ffff640 1 -- 172.21.15.67:0/3073528849 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f51480a9070 con 0x7f515815d290 2024-09-19T05:48:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:35.973+0000 7f515da97640 1 -- 172.21.15.67:0/3073528849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f51580a0510 con 0x7f515815d290 2024-09-19T05:48:36.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.981+0000 7f514ffff640 1 -- 172.21.15.67:0/3073528849 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v689) ==== 136+0+0 (secure 0 0 0) 0x7f5148016070 con 0x7f515815d290 2024-09-19T05:48:36.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 -- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51380678c0 msgr2=0x7f5138069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:36.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51380678c0 0x7f5138069d80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f5158154850 tx=0x7f5150009040 comp rx=0 tx=0).stop 2024-09-19T05:48:36.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 -- 172.21.15.67:0/3073528849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 msgr2=0x7f51581666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:36.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 0x7f51581666d0 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f514801ab30 tx=0x7f5148019220 comp rx=0 tx=0).stop 2024-09-19T05:48:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 -- 172.21.15.67:0/3073528849 shutdown_connections 2024-09-19T05:48:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515815d290 0x7f51581666d0 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51380678c0 0x7f5138069d80 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51580c8c40 0x7f5158153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 --2- 172.21.15.67:0/3073528849 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f515809b140 0x7f515806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 -- 172.21.15.67:0/3073528849 >> 172.21.15.67:0/3073528849 conn(0x7f51580d22b0 msgr2=0x7f515809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 -- 172.21.15.67:0/3073528849 shutdown_connections 2024-09-19T05:48:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:36.985+0000 7f515da97640 1 -- 172.21.15.67:0/3073528849 wait complete. 2024-09-19T05:48:37.007 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T05:48:37.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.137+0000 7f14ee001640 1 Processor -- start 2024-09-19T05:48:37.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.137+0000 7f14ee001640 1 -- start start 2024-09-19T05:48:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.137+0000 7f14ee001640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f14e815f950 0x7f14e80ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.137+0000 7f14ee001640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e80cea90 con 0x7f14e80d0de0 2024-09-19T05:48:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.137+0000 7f14ee001640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e80cd7e0 con 0x7f14e80b3750 2024-09-19T05:48:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.137+0000 7f14ee001640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f14e80af1a0 con 0x7f14e815f950 2024-09-19T05:48:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.137+0000 7f14e77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f14e815f950 0x7f14e80ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.137+0000 7f14e7fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f14e80d0de0 0x7f14e80b1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58034/0 (socket says 172.21.15.67:58034) 2024-09-19T05:48:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.137+0000 7f14e7fff640 1 -- 172.21.15.67:0/1914767829 learned_addr learned my addr 172.21.15.67:0/1914767829 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.137+0000 7f14e77fe640 1 -- 172.21.15.67:0/1914767829 >> v1:172.21.15.97:6789/0 conn(0x7f14e80b3750 legacy=0x7f14e80d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:37.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14e77fe640 1 -- 172.21.15.67:0/1914767829 >> v1:172.21.15.67:6789/0 conn(0x7f14e80d0de0 legacy=0x7f14e80b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14e77fe640 1 -- 172.21.15.67:0/1914767829 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e80cdac0 con 0x7f14e815f950 2024-09-19T05:48:37.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14e67fc640 1 -- 172.21.15.67:0/1914767829 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262519299 0 0) 0x7f14e80cea90 con 0x7f14e80d0de0 2024-09-19T05:48:37.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14e77fe640 1 --2- 172.21.15.67:0/1914767829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 0x7f14e80ce4b0 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7f14d80097c0 tx=0x7f14d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c97c668ee7cbd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:37.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14e67fc640 1 -- 172.21.15.67:0/1914767829 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80b0070 con 0x7f14e815f950 2024-09-19T05:48:37.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14e67fc640 1 -- 172.21.15.67:0/1914767829 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d80ab600 con 0x7f14e815f950 2024-09-19T05:48:37.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14e67fc640 1 -- 172.21.15.67:0/1914767829 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80ab9d0 con 0x7f14e815f950 2024-09-19T05:48:37.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14ee001640 1 -- 172.21.15.67:0/1914767829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 msgr2=0x7f14e80ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14ee001640 1 --2- 172.21.15.67:0/1914767829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 0x7f14e80ce4b0 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7f14d80097c0 tx=0x7f14d801c460 comp rx=0 tx=0).stop 2024-09-19T05:48:37.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14ee001640 1 -- 172.21.15.67:0/1914767829 shutdown_connections 2024-09-19T05:48:37.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14ee001640 1 --2- 172.21.15.67:0/1914767829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 0x7f14e80ce4b0 unknown :-1 s=CLOSED pgs=2399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14ee001640 1 -- 172.21.15.67:0/1914767829 >> 172.21.15.67:0/1914767829 conn(0x7f14e80d22f0 msgr2=0x7f14e80d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:37.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14ee001640 1 -- 172.21.15.67:0/1914767829 shutdown_connections 2024-09-19T05:48:37.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.141+0000 7f14ee001640 1 -- 172.21.15.67:0/1914767829 wait complete. 2024-09-19T05:48:37.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 Processor -- start 2024-09-19T05:48:37.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 -- start start 2024-09-19T05:48:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e80b3750 0x7f14e80b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e80d0de0 0x7f14e80cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 0x7f14e80cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f14e80b2ee0 con 0x7f14e815f950 2024-09-19T05:48:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f14e80b2d60 con 0x7f14e80b3750 2024-09-19T05:48:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f14e80b3060 con 0x7f14e80d0de0 2024-09-19T05:48:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 0x7f14e80cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 0x7f14e80cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47722/0 (socket says 172.21.15.67:47722) 2024-09-19T05:48:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e7fff640 1 -- 172.21.15.67:0/3826289260 learned_addr learned my addr 172.21.15.67:0/3826289260 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e77fe640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e80b3750 0x7f14e80b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e6ffd640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e80d0de0 0x7f14e80cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e7fff640 1 -- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e80d0de0 msgr2=0x7f14e80cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e7fff640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e80d0de0 0x7f14e80cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e7fff640 1 -- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e80b3750 msgr2=0x7f14e80b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e7fff640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e80b3750 0x7f14e80b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e7fff640 1 -- 172.21.15.67:0/3826289260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e814f9c0 con 0x7f14e815f950 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e6ffd640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e80d0de0 0x7f14e80cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e77fe640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e80b3750 0x7f14e80b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14e7fff640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 0x7f14e80cb690 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7f14e000c780 tx=0x7f14e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14cffff640 1 -- 172.21.15.67:0/3826289260 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0018070 con 0x7f14e815f950 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14cffff640 1 -- 172.21.15.67:0/3826289260 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e000a640 con 0x7f14e815f950 2024-09-19T05:48:37.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 -- 172.21.15.67:0/3826289260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e814fca0 con 0x7f14e815f950 2024-09-19T05:48:37.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14cffff640 1 -- 172.21.15.67:0/3826289260 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e000aab0 con 0x7f14e815f950 2024-09-19T05:48:37.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 -- 172.21.15.67:0/3826289260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e80cbf10 con 0x7f14e815f950 2024-09-19T05:48:37.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14ee001640 1 -- 172.21.15.67:0/3826289260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e80ce4b0 con 0x7f14e815f950 2024-09-19T05:48:37.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.145+0000 7f14cffff640 1 -- 172.21.15.67:0/3826289260 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f14e001b070 con 0x7f14e815f950 2024-09-19T05:48:37.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.149+0000 7f14cffff640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f14d40678c0 0x7f14d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.149+0000 7f14cffff640 1 -- 172.21.15.67:0/3826289260 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f14e0085150 con 0x7f14e815f950 2024-09-19T05:48:37.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.149+0000 7f14e77fe640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f14d40678c0 0x7f14d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.149+0000 7f14e77fe640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f14d40678c0 0x7f14d4069d80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f14d80ad000 tx=0x7f14d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.153+0000 7f14cffff640 1 -- 172.21.15.67:0/3826289260 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f14e0055e00 con 0x7f14e815f950 2024-09-19T05:48:37.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.317+0000 7f14ee001640 1 -- 172.21.15.67:0/3826289260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f14e80b0900 con 0x7f14e815f950 2024-09-19T05:48:37.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.321+0000 7f14cffff640 1 -- 172.21.15.67:0/3826289260 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f14e0055700 con 0x7f14e815f950 2024-09-19T05:48:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 -- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f14d40678c0 msgr2=0x7f14d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f14d40678c0 0x7f14d4069d80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f14d80ad000 tx=0x7f14d8008040 comp rx=0 tx=0).stop 2024-09-19T05:48:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 -- 172.21.15.67:0/3826289260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 msgr2=0x7f14e80cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 0x7f14e80cb690 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7f14e000c780 tx=0x7f14e000cc40 comp rx=0 tx=0).stop 2024-09-19T05:48:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 -- 172.21.15.67:0/3826289260 shutdown_connections 2024-09-19T05:48:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14e815f950 0x7f14e80cb690 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f14d40678c0 0x7f14d4069d80 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f14e80d0de0 0x7f14e80cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 --2- 172.21.15.67:0/3826289260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14e80b3750 0x7f14e80b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 -- 172.21.15.67:0/3826289260 >> 172.21.15.67:0/3826289260 conn(0x7f14e80d22f0 msgr2=0x7f14e81583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 -- 172.21.15.67:0/3826289260 shutdown_connections 2024-09-19T05:48:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.325+0000 7f14ee001640 1 -- 172.21.15.67:0/3826289260 wait complete. 2024-09-19T05:48:37.344 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:48:37.345 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:48:37.409 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:48:37.489 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:48:37.490 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:48:37.490 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:48:37.495 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:48:37.495 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:48:37.495 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:48:37.501 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:48:37.501 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:48:37.501 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:48:37.541 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:48:37.541 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:48:37.541 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:48:37.548 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:48:37.549 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T05:48:37.549 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:48:37.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5cd1f640 1 Processor -- start 2024-09-19T05:48:37.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5cd1f640 1 -- start start 2024-09-19T05:48:37.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5cd1f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b580b4900 0x7f9b58071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5cd1f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9b580723c0 0x7f9b58072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5cd1f640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b580b3860 con 0x7f9b5815b1e0 2024-09-19T05:48:37.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5cd1f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9b5815b5c0 con 0x7f9b580723c0 2024-09-19T05:48:37.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5cd1f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9b580b3b40 con 0x7f9b580b4900 2024-09-19T05:48:37.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9b5815b1e0 0x7f9b580b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58050/0 (socket says 172.21.15.67:58050) 2024-09-19T05:48:37.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5659c640 1 -- 172.21.15.67:0/932879056 learned_addr learned my addr 172.21.15.67:0/932879056 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b55d9b640 1 --2- 172.21.15.67:0/932879056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b580b4900 0x7f9b58071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b56d9d640 1 --2- 172.21.15.67:0/932879056 >> v2:172.21.15.97:3300/0 conn(0x7f9b580723c0 0x7f9b58072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5559a640 1 -- 172.21.15.67:0/932879056 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63426879 0 0) 0x7f9b580b3860 con 0x7f9b5815b1e0 2024-09-19T05:48:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b5559a640 1 -- 172.21.15.67:0/932879056 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b40003530 con 0x7f9b5815b1e0 2024-09-19T05:48:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b56d9d640 1 -- 172.21.15.67:0/932879056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b580b4900 msgr2=0x7f9b58071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:37.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b56d9d640 1 --2- 172.21.15.67:0/932879056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b580b4900 0x7f9b58071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b56d9d640 1 -- 172.21.15.67:0/932879056 >> v1:172.21.15.67:6789/0 conn(0x7f9b5815b1e0 legacy=0x7f9b580b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.717+0000 7f9b56d9d640 1 -- 172.21.15.67:0/932879056 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b580b3e20 con 0x7f9b580723c0 2024-09-19T05:48:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b56d9d640 1 --2- 172.21.15.67:0/932879056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b580723c0 0x7f9b58072850 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009d90 tx=0x7f9b5001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b16375352bbcc377 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5559a640 1 -- 172.21.15.67:0/932879056 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b500b2070 con 0x7f9b580723c0 2024-09-19T05:48:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5559a640 1 -- 172.21.15.67:0/932879056 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b500a5920 con 0x7f9b580723c0 2024-09-19T05:48:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5559a640 1 -- 172.21.15.67:0/932879056 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b500a5cd0 con 0x7f9b580723c0 2024-09-19T05:48:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/932879056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b580723c0 msgr2=0x7f9b58072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5cd1f640 1 --2- 172.21.15.67:0/932879056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b580723c0 0x7f9b58072850 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009d90 tx=0x7f9b5001c940 comp rx=0 tx=0).stop 2024-09-19T05:48:37.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/932879056 shutdown_connections 2024-09-19T05:48:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5cd1f640 1 --2- 172.21.15.67:0/932879056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b580723c0 0x7f9b58072850 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5cd1f640 1 --2- 172.21.15.67:0/932879056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b580b4900 0x7f9b58071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/932879056 >> 172.21.15.67:0/932879056 conn(0x7f9b580d0080 msgr2=0x7f9b580d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/932879056 shutdown_connections 2024-09-19T05:48:37.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/932879056 wait complete. 2024-09-19T05:48:37.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5cd1f640 1 Processor -- start 2024-09-19T05:48:37.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.721+0000 7f9b5cd1f640 1 -- start start 2024-09-19T05:48:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5cd1f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b580723c0 0x7f9b581495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5cd1f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b580b4900 0x7f9b580ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5cd1f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b5815b1e0 0x7f9b580aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5cd1f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5806f290 con 0x7f9b580b4900 2024-09-19T05:48:37.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5cd1f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5806f110 con 0x7f9b5815b1e0 2024-09-19T05:48:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5cd1f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f9b5806f410 con 0x7f9b580723c0 2024-09-19T05:48:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b55d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b580b4900 0x7f9b580ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b55d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b580b4900 0x7f9b580ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47726/0 (socket says 172.21.15.67:47726) 2024-09-19T05:48:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b55d9b640 1 -- 172.21.15.67:0/2505400026 learned_addr learned my addr 172.21.15.67:0/2505400026 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5659c640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b580723c0 0x7f9b581495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b56d9d640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b5815b1e0 0x7f9b580aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b55d9b640 1 -- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b580723c0 msgr2=0x7f9b581495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b55d9b640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b580723c0 0x7f9b581495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b55d9b640 1 -- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b5815b1e0 msgr2=0x7f9b580aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b55d9b640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b5815b1e0 0x7f9b580aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b55d9b640 1 -- 172.21.15.67:0/2505400026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b58154e70 con 0x7f9b580b4900 2024-09-19T05:48:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b55d9b640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b580b4900 0x7f9b580ae680 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800e870 tx=0x7f9b4800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b46ffd640 1 -- 172.21.15.67:0/2505400026 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b48017070 con 0x7f9b580b4900 2024-09-19T05:48:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b46ffd640 1 -- 172.21.15.67:0/2505400026 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b4800c940 con 0x7f9b580b4900 2024-09-19T05:48:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/2505400026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b58152790 con 0x7f9b580b4900 2024-09-19T05:48:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b46ffd640 1 -- 172.21.15.67:0/2505400026 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4800ccf0 con 0x7f9b580b4900 2024-09-19T05:48:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/2505400026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b58152fc0 con 0x7f9b580b4900 2024-09-19T05:48:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/2505400026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b58072850 con 0x7f9b580b4900 2024-09-19T05:48:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b46ffd640 1 -- 172.21.15.67:0/2505400026 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b4801a070 con 0x7f9b580b4900 2024-09-19T05:48:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b46ffd640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b380678c0 0x7f9b38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b46ffd640 1 -- 172.21.15.67:0/2505400026 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f9b48085a80 con 0x7f9b580b4900 2024-09-19T05:48:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.725+0000 7f9b5659c640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b380678c0 0x7f9b38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.729+0000 7f9b5659c640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b380678c0 0x7f9b38069d80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c005890 tx=0x7f9b4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.733+0000 7f9b46ffd640 1 -- 172.21.15.67:0/2505400026 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9b480566b0 con 0x7f9b580b4900 2024-09-19T05:48:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.929+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/2505400026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b580b4e30 con 0x7f9b580b4900 2024-09-19T05:48:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.929+0000 7f9b46ffd640 1 -- 172.21.15.67:0/2505400026 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 140 v140) ==== 95+0+3918 (secure 0 0 0) 0x7f9b48055fb0 con 0x7f9b580b4900 2024-09-19T05:48:37.930 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:37.930 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":140,"btime":"2024-09-19T05:48:31:947950+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/4294715394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4294715394},{"type":"v1","addr":"172.21.15.97:6835","nonce":4294715394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":7139,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1234134657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1234134657},{"type":"v1","addr":"172.21.15.97:6837","nonce":1234134657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":10449,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2992690092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2992690092},{"type":"v1","addr":"172.21.15.67:6833","nonce":2992690092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":10764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2684484300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2684484300},{"type":"v1","addr":"172.21.15.67:6835","nonce":2684484300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[]} 2024-09-19T05:48:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 140 2024-09-19T05:48:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b380678c0 msgr2=0x7f9b38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b380678c0 0x7f9b38069d80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c005890 tx=0x7f9b4c009040 comp rx=0 tx=0).stop 2024-09-19T05:48:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/2505400026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b580b4900 msgr2=0x7f9b580ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b580b4900 0x7f9b580ae680 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800e870 tx=0x7f9b4800ec70 comp rx=0 tx=0).stop 2024-09-19T05:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/2505400026 shutdown_connections 2024-09-19T05:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b5815b1e0 0x7f9b580aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b580b4900 0x7f9b580ae680 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f9b380678c0 0x7f9b38069d80 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 --2- 172.21.15.67:0/2505400026 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b580723c0 0x7f9b581495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/2505400026 >> 172.21.15.67:0/2505400026 conn(0x7f9b580d0080 msgr2=0x7f9b5814a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/2505400026 shutdown_connections 2024-09-19T05:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:37.933+0000 7f9b5cd1f640 1 -- 172.21.15.67:0/2505400026 wait complete. 2024-09-19T05:48:37.949 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:48:37.949 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T05:48:37.949 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:48:37.949 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:48:37.949 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:48:37.949 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T05:48:37.950 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:48:37.950 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:48:37.950 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:48:37.950 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T05:48:37.950 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:48:37.950 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:48:37.950 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:48:37.950 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T05:48:37.951 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:48:37.951 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:48:37.959 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:48:37.959 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:48:37.960 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:48:37.960 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:48:37.962 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:48:37.963 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:48:37.964 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:48:37.964 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:48:38.002 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:48:38.002 DEBUG:teuthology.parallel:result is None 2024-09-19T05:48:38.002 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:48:38.003 DEBUG:teuthology.parallel:result is None 2024-09-19T05:48:38.008 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:48:38.009 DEBUG:teuthology.parallel:result is None 2024-09-19T05:48:38.010 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:48:38.010 DEBUG:teuthology.parallel:result is None 2024-09-19T05:48:38.010 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T05:48:38.059 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-09-19T05:48:38.065 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:48:38.079 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2024-09-19T05:48:38.081 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2024-09-19T05:48:38.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.121+0000 7f0427b11640 1 Processor -- start 2024-09-19T05:48:38.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.121+0000 7f0427b11640 1 -- start start 2024-09-19T05:48:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0420161da0 0x7f04200d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f04200d0e80 0x7f04200d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04200d4d40 con 0x7f04200b41c0 2024-09-19T05:48:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f04200d1830 con 0x7f0420161da0 2024-09-19T05:48:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f04200d0840 con 0x7f04200d0e80 2024-09-19T05:48:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04258ad640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0420161da0 0x7f04200d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04258ad640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0420161da0 0x7f04200d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47746/0 (socket says 172.21.15.67:47746) 2024-09-19T05:48:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04258ad640 1 -- 172.21.15.67:0/3429031371 learned_addr learned my addr 172.21.15.67:0/3429031371 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04250ac640 1 --2- 172.21.15.67:0/3429031371 >> v2:172.21.15.97:3300/0 conn(0x7f04200d0e80 0x7f04200d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:38.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04258ad640 1 -- 172.21.15.67:0/3429031371 >> v2:172.21.15.97:3300/0 conn(0x7f04200d0e80 msgr2=0x7f04200d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:38.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04258ad640 1 --2- 172.21.15.67:0/3429031371 >> v2:172.21.15.97:3300/0 conn(0x7f04200d0e80 0x7f04200d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:38.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04258ad640 1 -- 172.21.15.67:0/3429031371 >> v1:172.21.15.97:6789/0 conn(0x7f04200b41c0 legacy=0x7f04200b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:38.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04258ad640 1 -- 172.21.15.67:0/3429031371 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04200d5020 con 0x7f0420161da0 2024-09-19T05:48:38.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04250ac640 1 --2- 172.21.15.67:0/3429031371 >> v2:172.21.15.97:3300/0 conn(0x7f04200d0e80 0x7f04200d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:38.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04258ad640 1 --2- 172.21.15.67:0/3429031371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0420161da0 0x7f04200d1af0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f04200d4440 tx=0x7f041c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1115c6d4950a8a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:38.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04248ab640 1 -- 172.21.15.67:0/3429031371 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c0ab610 con 0x7f0420161da0 2024-09-19T05:48:38.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04248ab640 1 -- 172.21.15.67:0/3429031371 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c0b0070 con 0x7f0420161da0 2024-09-19T05:48:38.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f04248ab640 1 -- 172.21.15.67:0/3429031371 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c0ab9d0 con 0x7f0420161da0 2024-09-19T05:48:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 -- 172.21.15.67:0/3429031371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0420161da0 msgr2=0x7f04200d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 --2- 172.21.15.67:0/3429031371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0420161da0 0x7f04200d1af0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f04200d4440 tx=0x7f041c01c520 comp rx=0 tx=0).stop 2024-09-19T05:48:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 -- 172.21.15.67:0/3429031371 shutdown_connections 2024-09-19T05:48:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 --2- 172.21.15.67:0/3429031371 >> v2:172.21.15.97:3300/0 conn(0x7f04200d0e80 0x7f04200d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 --2- 172.21.15.67:0/3429031371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0420161da0 0x7f04200d1af0 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 -- 172.21.15.67:0/3429031371 >> 172.21.15.67:0/3429031371 conn(0x7f042008bfc0 msgr2=0x7f04200d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 -- 172.21.15.67:0/3429031371 shutdown_connections 2024-09-19T05:48:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.125+0000 7f0427b11640 1 -- 172.21.15.67:0/3429031371 wait complete. 2024-09-19T05:48:38.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 Processor -- start 2024-09-19T05:48:38.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 -- start start 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04200b41c0 0x7f042014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04200d0e80 0x7f04200b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0420161da0 0x7f04200b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0420162180 con 0x7f04200d0e80 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f04200b5d00 con 0x7f04200b41c0 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f042016b4f0 con 0x7f0420161da0 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04250ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04200d0e80 0x7f04200b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04250ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04200d0e80 0x7f04200b2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47756/0 (socket says 172.21.15.67:47756) 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04250ac640 1 -- 172.21.15.67:0/2840813794 learned_addr learned my addr 172.21.15.67:0/2840813794 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04258ad640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04200b41c0 0x7f042014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:38.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04260ae640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0420161da0 0x7f04200b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04250ac640 1 -- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0420161da0 msgr2=0x7f04200b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04250ac640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0420161da0 0x7f04200b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04250ac640 1 -- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04200b41c0 msgr2=0x7f042014ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04250ac640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04200b41c0 0x7f042014ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04250ac640 1 -- 172.21.15.67:0/2840813794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042006a210 con 0x7f04200d0e80 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04250ac640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04200d0e80 0x7f04200b2920 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f041000e810 tx=0x7f041000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04167fc640 1 -- 172.21.15.67:0/2840813794 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410017070 con 0x7f04200d0e80 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04167fc640 1 -- 172.21.15.67:0/2840813794 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041000c8d0 con 0x7f04200d0e80 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 -- 172.21.15.67:0/2840813794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04200b94a0 con 0x7f04200d0e80 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04167fc640 1 -- 172.21.15.67:0/2840813794 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041000f040 con 0x7f04200d0e80 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 -- 172.21.15.67:0/2840813794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04200b8400 con 0x7f04200d0e80 2024-09-19T05:48:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f0427b11640 1 -- 172.21.15.67:0/2840813794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04200d12f0 con 0x7f04200d0e80 2024-09-19T05:48:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.129+0000 7f04167fc640 1 -- 172.21.15.67:0/2840813794 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f041001a070 con 0x7f04200d0e80 2024-09-19T05:48:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.133+0000 7f04167fc640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04040678c0 0x7f0404069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.133+0000 7f04167fc640 1 -- 172.21.15.67:0/2840813794 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f04100855f0 con 0x7f04200d0e80 2024-09-19T05:48:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.133+0000 7f04258ad640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04040678c0 0x7f0404069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.133+0000 7f04258ad640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04040678c0 0x7f0404069d80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f041c0af000 tx=0x7f041c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:38.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.137+0000 7f04167fc640 1 -- 172.21.15.67:0/2840813794 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f04200b94a0 con 0x7f04200d0e80 2024-09-19T05:48:38.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:38.313+0000 7f0427b11640 1 -- 172.21.15.67:0/2840813794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f04200b49b0 con 0x7f04200d0e80 2024-09-19T05:48:39.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.349+0000 7f04167fc640 1 -- 172.21.15.67:0/2840813794 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v201) ==== 97+0+0 (secure 0 0 0) 0x7f0410055ce0 con 0x7f04200d0e80 2024-09-19T05:48:39.350 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-09-19T05:48:39.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 -- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04040678c0 msgr2=0x7f0404069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04040678c0 0x7f0404069d80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f041c0af000 tx=0x7f041c0a7000 comp rx=0 tx=0).stop 2024-09-19T05:48:39.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 -- 172.21.15.67:0/2840813794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04200d0e80 msgr2=0x7f04200b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04200d0e80 0x7f04200b2920 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f041000e810 tx=0x7f041000ecd0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 -- 172.21.15.67:0/2840813794 shutdown_connections 2024-09-19T05:48:39.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04040678c0 0x7f0404069d80 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0420161da0 0x7f04200b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04200d0e80 0x7f04200b2920 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 --2- 172.21.15.67:0/2840813794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04200b41c0 0x7f042014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 -- 172.21.15.67:0/2840813794 >> 172.21.15.67:0/2840813794 conn(0x7f042008bfc0 msgr2=0x7f04200b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:39.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 -- 172.21.15.67:0/2840813794 shutdown_connections 2024-09-19T05:48:39.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.353+0000 7f0427b11640 1 -- 172.21.15.67:0/2840813794 wait complete. 2024-09-19T05:48:39.376 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T05:48:39.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65f4e1640 1 Processor -- start 2024-09-19T05:48:39.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65f4e1640 1 -- start start 2024-09-19T05:48:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65f4e1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff65815b1e0 0x7ff6580b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65f4e1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff658072590 0x7ff6580ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65f4e1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6580b3860 con 0x7ff6580b4900 2024-09-19T05:48:39.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65f4e1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff65815b5c0 con 0x7ff65815b1e0 2024-09-19T05:48:39.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65f4e1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff6580b3b40 con 0x7ff658072590 2024-09-19T05:48:39.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65d27d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff65815b1e0 0x7ff6580b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65ca7c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff6580b4900 0x7ff658071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58060/0 (socket says 172.21.15.67:58060) 2024-09-19T05:48:39.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65ca7c640 1 -- 172.21.15.67:0/2313476034 learned_addr learned my addr 172.21.15.67:0/2313476034 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:39.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65da7e640 1 --2- 172.21.15.67:0/2313476034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff658072590 0x7ff6580ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65d27d640 1 -- 172.21.15.67:0/2313476034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff658072590 msgr2=0x7ff6580ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:39.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65d27d640 1 --2- 172.21.15.67:0/2313476034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff658072590 0x7ff6580ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65d27d640 1 -- 172.21.15.67:0/2313476034 >> v1:172.21.15.67:6789/0 conn(0x7ff6580b4900 legacy=0x7ff658071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.505+0000 7ff65d27d640 1 -- 172.21.15.67:0/2313476034 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6580b3e20 con 0x7ff65815b1e0 2024-09-19T05:48:39.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff65d27d640 1 --2- 172.21.15.67:0/2313476034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff65815b1e0 0x7ff6580b2fd0 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7ff6540097c0 tx=0x7ff65401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44469921dd006e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:39.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff64ffff640 1 -- 172.21.15.67:0/2313476034 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540aa5f0 con 0x7ff65815b1e0 2024-09-19T05:48:39.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff64ffff640 1 -- 172.21.15.67:0/2313476034 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6540af070 con 0x7ff65815b1e0 2024-09-19T05:48:39.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff64ffff640 1 -- 172.21.15.67:0/2313476034 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540aa9b0 con 0x7ff65815b1e0 2024-09-19T05:48:39.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff65f4e1640 1 -- 172.21.15.67:0/2313476034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff65815b1e0 msgr2=0x7ff6580b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff65f4e1640 1 --2- 172.21.15.67:0/2313476034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff65815b1e0 0x7ff6580b2fd0 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7ff6540097c0 tx=0x7ff65401c470 comp rx=0 tx=0).stop 2024-09-19T05:48:39.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff65f4e1640 1 -- 172.21.15.67:0/2313476034 shutdown_connections 2024-09-19T05:48:39.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff65f4e1640 1 --2- 172.21.15.67:0/2313476034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff658072590 0x7ff6580ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff65f4e1640 1 --2- 172.21.15.67:0/2313476034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff65815b1e0 0x7ff6580b2fd0 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff65f4e1640 1 -- 172.21.15.67:0/2313476034 >> 172.21.15.67:0/2313476034 conn(0x7ff6580d0080 msgr2=0x7ff6580d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff65f4e1640 1 -- 172.21.15.67:0/2313476034 shutdown_connections 2024-09-19T05:48:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.509+0000 7ff65f4e1640 1 -- 172.21.15.67:0/2313476034 wait complete. 2024-09-19T05:48:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 Processor -- start 2024-09-19T05:48:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 -- start start 2024-09-19T05:48:39.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff658072590 0x7ff6581560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6580b4900 0x7ff658156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff65815b1e0 0x7ff65814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581681e0 con 0x7ff658072590 2024-09-19T05:48:39.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff658168060 con 0x7ff6580b4900 2024-09-19T05:48:39.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff658168360 con 0x7ff65815b1e0 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65d27d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff658072590 0x7ff6581560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65d27d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff658072590 0x7ff6581560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47768/0 (socket says 172.21.15.67:47768) 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65d27d640 1 -- 172.21.15.67:0/1180787451 learned_addr learned my addr 172.21.15.67:0/1180787451 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65ca7c640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6580b4900 0x7ff658156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65da7e640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff65815b1e0 0x7ff65814ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65d27d640 1 -- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff65815b1e0 msgr2=0x7ff65814ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65d27d640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff65815b1e0 0x7ff65814ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65d27d640 1 -- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6580b4900 msgr2=0x7ff658156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65d27d640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6580b4900 0x7ff658156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65d27d640 1 -- 172.21.15.67:0/1180787451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff658098700 con 0x7ff658072590 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65ca7c640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6580b4900 0x7ff658156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65da7e640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff65815b1e0 0x7ff65814ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:39.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65d27d640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff658072590 0x7ff6581560f0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7ff65401a0a0 tx=0x7ff65401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:39.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff64dffb640 1 -- 172.21.15.67:0/1180787451 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540be610 con 0x7ff658072590 2024-09-19T05:48:39.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff64dffb640 1 -- 172.21.15.67:0/1180787451 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6540be7b0 con 0x7ff658072590 2024-09-19T05:48:39.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 -- 172.21.15.67:0/1180787451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6580989e0 con 0x7ff658072590 2024-09-19T05:48:39.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff64dffb640 1 -- 172.21.15.67:0/1180787451 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540beba0 con 0x7ff658072590 2024-09-19T05:48:39.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 -- 172.21.15.67:0/1180787451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff658098fa0 con 0x7ff658072590 2024-09-19T05:48:39.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff65f4e1640 1 -- 172.21.15.67:0/1180787451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6580ade10 con 0x7ff658072590 2024-09-19T05:48:39.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.513+0000 7ff64dffb640 1 -- 172.21.15.67:0/1180787451 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff6540bc020 con 0x7ff658072590 2024-09-19T05:48:39.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.517+0000 7ff64dffb640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff63c0678c0 0x7ff63c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.517+0000 7ff64dffb640 1 -- 172.21.15.67:0/1180787451 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 5249+0+0 (secure 0 0 0) 0x7ff654120020 con 0x7ff658072590 2024-09-19T05:48:39.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.517+0000 7ff65ca7c640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff63c0678c0 0x7ff63c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.517+0000 7ff65ca7c640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff63c0678c0 0x7ff63c069d80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff65815e3e0 tx=0x7ff648009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:39.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.521+0000 7ff64dffb640 1 -- 172.21.15.67:0/1180787451 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff654016090 con 0x7ff658072590 2024-09-19T05:48:39.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.741+0000 7ff65f4e1640 1 -- 172.21.15.67:0/1180787451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff6580b4e30 con 0x7ff658072590 2024-09-19T05:48:39.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.741+0000 7ff64dffb640 1 -- 172.21.15.67:0/1180787451 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) ==== 80+0+5304 (secure 0 0 0) 0x7ff6540f0db0 con 0x7ff658072590 2024-09-19T05:48:39.743 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:39.743 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm/1fmIhAAIGyzjLlVbpLF+3l8nkXsjw==", 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.744 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmAJZ5MRAAMotGzhVmDB6CB1wTF8Q/ig==", 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tm8PCLKxAAL/FSuYYJCEOuhBfSSLbQZg==", 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:48:39.745 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmNszeORAAEqY3RYyMIOYqB2fdPvxsEw==", 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.746 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBdt+tme54cDhAA7i7XQ7oG4Kn7d4HE2P4mmw==", 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-09-19T05:48:39.747 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBgt+tmuBVhHBAAN06U+l9+1hAMF99RS4oFMg==", 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBjt+tm8AipKxAAHQiykYALPxuoW0vn50S+4A==", 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.748 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBnt+tmeA8nABAAQHef8Y+uFaQQwq5B3CPm0g==", 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBtt+tmEIp1CxAAUTUd48oLC9AnHBN74iwT4A==", 2024-09-19T05:48:39.749 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBwt+tm+D3cGRAAYdoTm+sFCYbBDpGD/WMKsg==", 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.750 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBzt+tmcsFLLBAAdbebGRzpD5rrX06MVIrWFQ==", 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQB2t+tm9k2UORAAgJZFEx49RB+DCwKrnaz/RQ==", 2024-09-19T05:48:39.751 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.752 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-09-19T05:48:39.752 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-09-19T05:48:39.752 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.752 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.752 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.752 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.752 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-09-19T05:48:39.752 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A==", 2024-09-19T05:48:39.752 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow r", 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmUvzOCxAA2mdQnrdHCIqRxD+QgnjQ9g==", 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:48:39.753 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmkYg5CRAATrSPbbTKvFxWCwAmxRLHGQ==", 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBat+tmNingEBAAeUdY5rBsrpqdEF5vGJ/Xzg==", 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmlwwiDBAAMVQiF8LUWiORDBepIcWxMg==", 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:48:39.755 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmtQ6CHxAAuZ+1jnzW6i3tkZPN5mUOSg==", 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:39.756 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:39.757 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-09-19T05:48:39.757 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBZt+tmdlzPHBAAZPIBvpLOHoBnC2sE4TBFrg==", 2024-09-19T05:48:39.757 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-09-19T05:48:39.757 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-09-19T05:48:39.757 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-09-19T05:48:39.757 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-09-19T05:48:39.757 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.757 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:39.757 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-19T05:48:39.757 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:48:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 -- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff63c0678c0 msgr2=0x7ff63c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff63c0678c0 0x7ff63c069d80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff65815e3e0 tx=0x7ff648009040 comp rx=0 tx=0).stop 2024-09-19T05:48:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 -- 172.21.15.67:0/1180787451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff658072590 msgr2=0x7ff6581560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff658072590 0x7ff6581560f0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7ff65401a0a0 tx=0x7ff65401acb0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 -- 172.21.15.67:0/1180787451 shutdown_connections 2024-09-19T05:48:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff63c0678c0 0x7ff63c069d80 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff65815b1e0 0x7ff65814ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6580b4900 0x7ff658156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 --2- 172.21.15.67:0/1180787451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff658072590 0x7ff6581560f0 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 -- 172.21.15.67:0/1180787451 >> 172.21.15.67:0/1180787451 conn(0x7ff6580d0080 msgr2=0x7ff658142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 -- 172.21.15.67:0/1180787451 shutdown_connections 2024-09-19T05:48:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.745+0000 7ff65f4e1640 1 -- 172.21.15.67:0/1180787451 wait complete. 2024-09-19T05:48:39.761 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:48:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f9e5a640 1 Processor -- start 2024-09-19T05:48:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f9e5a640 1 -- start start 2024-09-19T05:48:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f9e5a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f03f415c030 0x7f03f406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f9e5a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03f406e3c0 con 0x7f03f406f460 2024-09-19T05:48:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f9e5a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03f406e6a0 con 0x7f03f415d1d0 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f9e5a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f03f406e980 con 0x7f03f415c030 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f3fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f03f406f460 0x7f03f40acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58072/0 (socket says 172.21.15.67:58072) 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f3fff640 1 -- 172.21.15.67:0/3106971740 learned_addr learned my addr 172.21.15.67:0/3106971740 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f37fe640 1 --2- 172.21.15.67:0/3106971740 >> v2:172.21.15.97:3300/0 conn(0x7f03f415c030 0x7f03f406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888422143 0 0) 0x7f03f406e3c0 con 0x7f03f406f460 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03dc003530 con 0x7f03f406f460 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3711220082 0 0) 0x7f03dc003530 con 0x7f03f406f460 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 >> v2:172.21.15.97:3300/0 conn(0x7f03f415c030 msgr2=0x7f03f406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 --2- 172.21.15.67:0/3106971740 >> v2:172.21.15.97:3300/0 conn(0x7f03f415c030 0x7f03f406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 >> v1:172.21.15.97:6789/0 conn(0x7f03f415d1d0 legacy=0x7f03f40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f406ec60 con 0x7f03f406f460 2024-09-19T05:48:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f03ec001a00 con 0x7f03f406f460 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 >> v1:172.21.15.67:6789/0 conn(0x7f03f406f460 legacy=0x7f03f40acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 --2- 172.21.15.67:0/3106971740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03dc0039c0 0x7f03dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 --2- 172.21.15.67:0/3106971740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03dc004810 0x7f03dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 --2- 172.21.15.67:0/3106971740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03dc0051d0 0x7f03dc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f03f406e980 con 0x7f03dc0039c0 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc00c070 con 0x7f03dc0051d0 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f03dc00c270 con 0x7f03dc004810 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f37fe640 1 --2- 172.21.15.67:0/3106971740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03dc0039c0 0x7f03dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f37fe640 1 -- 172.21.15.67:0/3106971740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03dc004810 msgr2=0x7f03dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f37fe640 1 --2- 172.21.15.67:0/3106971740 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03dc004810 0x7f03dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f3fff640 1 --2- 172.21.15.67:0/3106971740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03dc0051d0 0x7f03dc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f37fe640 1 -- 172.21.15.67:0/3106971740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03dc0051d0 msgr2=0x7f03dc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f37fe640 1 --2- 172.21.15.67:0/3106971740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03dc0051d0 0x7f03dc00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f3fff640 1 -- 172.21.15.67:0/3106971740 reap_dead start 2024-09-19T05:48:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.885+0000 7f03f37fe640 1 -- 172.21.15.67:0/3106971740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc003530 con 0x7f03dc0039c0 2024-09-19T05:48:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f37fe640 1 --2- 172.21.15.67:0/3106971740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03dc0039c0 0x7f03dc003de0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009ae0 tx=0x7f03e801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d99d9bda91da39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e80b2070 con 0x7f03dc0039c0 2024-09-19T05:48:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e80a5520 con 0x7f03dc0039c0 2024-09-19T05:48:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f27fc640 1 -- 172.21.15.67:0/3106971740 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e80096b0 con 0x7f03dc0039c0 2024-09-19T05:48:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 -- 172.21.15.67:0/3106971740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03dc0039c0 msgr2=0x7f03dc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 --2- 172.21.15.67:0/3106971740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03dc0039c0 0x7f03dc003de0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009ae0 tx=0x7f03e801ca40 comp rx=0 tx=0).stop 2024-09-19T05:48:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 -- 172.21.15.67:0/3106971740 shutdown_connections 2024-09-19T05:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 --2- 172.21.15.67:0/3106971740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03dc0039c0 0x7f03dc003de0 unknown :-1 s=CLOSED pgs=2414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 -- 172.21.15.67:0/3106971740 >> 172.21.15.67:0/3106971740 conn(0x7f03f40d0080 msgr2=0x7f03f40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 -- 172.21.15.67:0/3106971740 shutdown_connections 2024-09-19T05:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 -- 172.21.15.67:0/3106971740 wait complete. 2024-09-19T05:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 Processor -- start 2024-09-19T05:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 -- start start 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03dc0039c0 0x7f03f415a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03f414a6e0 0x7f03f415ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03f4151ac0 0x7f03f415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f03f415c410 con 0x7f03f414a6e0 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f03f406fc50 con 0x7f03dc0039c0 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.889+0000 7f03f9e5a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f03f415c590 con 0x7f03f4151ac0 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03f414a6e0 0x7f03f415ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03f414a6e0 0x7f03f415ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47786/0 (socket says 172.21.15.67:47786) 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f2ffd640 1 -- 172.21.15.67:0/782383595 learned_addr learned my addr 172.21.15.67:0/782383595 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f37fe640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03dc0039c0 0x7f03f415a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f3fff640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03f4151ac0 0x7f03f415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f2ffd640 1 -- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03f4151ac0 msgr2=0x7f03f415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f2ffd640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03f4151ac0 0x7f03f415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f2ffd640 1 -- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03dc0039c0 msgr2=0x7f03f415a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f2ffd640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03dc0039c0 0x7f03f415a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f2ffd640 1 -- 172.21.15.67:0/782383595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f4149e90 con 0x7f03f414a6e0 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f2ffd640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03f414a6e0 0x7f03f415ab10 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c4d0 tx=0x7f03e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03dbfff640 1 -- 172.21.15.67:0/782383595 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e40052d0 con 0x7f03f414a6e0 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03dbfff640 1 -- 172.21.15.67:0/782383595 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e4005470 con 0x7f03f414a6e0 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f9e5a640 1 -- 172.21.15.67:0/782383595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f414a170 con 0x7f03f414a6e0 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03dbfff640 1 -- 172.21.15.67:0/782383595 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4012870 con 0x7f03f414a6e0 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f9e5a640 1 -- 172.21.15.67:0/782383595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f4149a60 con 0x7f03f414a6e0 2024-09-19T05:48:39.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f9e5a640 1 -- 172.21.15.67:0/782383595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f40acfb0 con 0x7f03f414a6e0 2024-09-19T05:48:39.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03dbfff640 1 -- 172.21.15.67:0/782383595 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f03e4012a10 con 0x7f03f414a6e0 2024-09-19T05:48:39.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03dbfff640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03e00678f0 0x7f03e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:39.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03dbfff640 1 -- 172.21.15.67:0/782383595 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 5249+0+0 (secure 0 0 0) 0x7f03e4085540 con 0x7f03f414a6e0 2024-09-19T05:48:39.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f37fe640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03e00678f0 0x7f03e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:39.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.893+0000 7f03f37fe640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03e00678f0 0x7f03e0069db0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f03e80af000 tx=0x7f03e80046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:39.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:39.897+0000 7f03dbfff640 1 -- 172.21.15.67:0/782383595 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f03e40562d0 con 0x7f03f414a6e0 2024-09-19T05:48:40.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.065+0000 7f03f9e5a640 1 -- 172.21.15.67:0/782383595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f03f415cf90 con 0x7f03f414a6e0 2024-09-19T05:48:40.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.065+0000 7f03dbfff640 1 -- 172.21.15.67:0/782383595 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v201) ==== 84+0+65 (secure 0 0 0) 0x7f03e4055bd0 con 0x7f03f414a6e0 2024-09-19T05:48:40.066 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:40.066 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-19T05:48:40.066 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-19T05:48:40.067 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-19T05:48:40.067 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-19T05:48:40.067 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:40.067 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-19T05:48:40.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 -- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03e00678f0 msgr2=0x7f03e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:40.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03e00678f0 0x7f03e0069db0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f03e80af000 tx=0x7f03e80046d0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 -- 172.21.15.67:0/782383595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03f414a6e0 msgr2=0x7f03f415ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:40.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03f414a6e0 0x7f03f415ab10 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c4d0 tx=0x7f03e400c990 comp rx=0 tx=0).stop 2024-09-19T05:48:40.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 -- 172.21.15.67:0/782383595 shutdown_connections 2024-09-19T05:48:40.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03e00678f0 0x7f03e0069db0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03f4151ac0 0x7f03f415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03f414a6e0 0x7f03f415ab10 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 --2- 172.21.15.67:0/782383595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03dc0039c0 0x7f03f415a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 -- 172.21.15.67:0/782383595 >> 172.21.15.67:0/782383595 conn(0x7f03f40d0080 msgr2=0x7f03f4155590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:40.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 -- 172.21.15.67:0/782383595 shutdown_connections 2024-09-19T05:48:40.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.069+0000 7f03f9e5a640 1 -- 172.21.15.67:0/782383595 wait complete. 2024-09-19T05:48:40.085 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:48:40.085 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:48:40.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbafab8d640 1 Processor -- start 2024-09-19T05:48:40.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbafab8d640 1 -- start start 2024-09-19T05:48:40.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbafab8d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbaf40738b0 0x7fbaf415c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:40.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbafab8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbaf40d0520 0x7fbaf40d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:40.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbafab8d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbaf415ec20 0x7fbaf415f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:40.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbafab8d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf40d0ed0 con 0x7fbaf40738b0 2024-09-19T05:48:40.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbafab8d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf40b4e00 con 0x7fbaf415ec20 2024-09-19T05:48:40.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbafab8d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf415c5c0 con 0x7fbaf40d0520 2024-09-19T05:48:40.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbaf8929640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbaf40738b0 0x7fbaf415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:40.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbaf8929640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbaf40738b0 0x7fbaf415c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47798/0 (socket says 172.21.15.67:47798) 2024-09-19T05:48:40.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbaf8929640 1 -- 172.21.15.67:0/108806605 learned_addr learned my addr 172.21.15.67:0/108806605 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:40.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbaf8929640 1 -- 172.21.15.67:0/108806605 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbaf40d0520 msgr2=0x7fbaf40d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:40.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbaf8929640 1 --2- 172.21.15.67:0/108806605 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbaf40d0520 0x7fbaf40d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbaf8929640 1 -- 172.21.15.67:0/108806605 >> v2:172.21.15.97:3300/0 conn(0x7fbaf415ec20 msgr2=0x7fbaf415f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:40.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbaf8929640 1 --2- 172.21.15.67:0/108806605 >> v2:172.21.15.97:3300/0 conn(0x7fbaf415ec20 0x7fbaf415f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.201+0000 7fbaf8929640 1 -- 172.21.15.67:0/108806605 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf40b3500 con 0x7fbaf40738b0 2024-09-19T05:48:40.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbaf8929640 1 --2- 172.21.15.67:0/108806605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40738b0 0x7fbaf415c080 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40cfb80 tx=0x7fbae401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d057af8f183b8de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:40.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbaf37fe640 1 -- 172.21.15.67:0/108806605 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae40b0070 con 0x7fbaf40738b0 2024-09-19T05:48:40.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbaf37fe640 1 -- 172.21.15.67:0/108806605 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae40ab600 con 0x7fbaf40738b0 2024-09-19T05:48:40.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbaf37fe640 1 -- 172.21.15.67:0/108806605 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae40ab9d0 con 0x7fbaf40738b0 2024-09-19T05:48:40.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 -- 172.21.15.67:0/108806605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40738b0 msgr2=0x7fbaf415c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:40.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 --2- 172.21.15.67:0/108806605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40738b0 0x7fbaf415c080 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40cfb80 tx=0x7fbae401c520 comp rx=0 tx=0).stop 2024-09-19T05:48:40.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 -- 172.21.15.67:0/108806605 shutdown_connections 2024-09-19T05:48:40.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 --2- 172.21.15.67:0/108806605 >> v2:172.21.15.97:3300/0 conn(0x7fbaf415ec20 0x7fbaf415f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 --2- 172.21.15.67:0/108806605 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbaf40d0520 0x7fbaf40d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 --2- 172.21.15.67:0/108806605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40738b0 0x7fbaf415c080 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 -- 172.21.15.67:0/108806605 >> 172.21.15.67:0/108806605 conn(0x7fbaf406c0c0 msgr2=0x7fbaf406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:40.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 -- 172.21.15.67:0/108806605 shutdown_connections 2024-09-19T05:48:40.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 -- 172.21.15.67:0/108806605 wait complete. 2024-09-19T05:48:40.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 Processor -- start 2024-09-19T05:48:40.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.205+0000 7fbafab8d640 1 -- start start 2024-09-19T05:48:40.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbafab8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbaf40738b0 0x7fbaf4153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:40.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbafab8d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40d0520 0x7fbaf40ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:40.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbafab8d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaf415ec20 0x7fbaf40aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:40.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbafab8d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf4073c90 con 0x7fbaf40d0520 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbafab8d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf40b4080 con 0x7fbaf415ec20 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbafab8d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf415f9e0 con 0x7fbaf40738b0 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40d0520 0x7fbaf40ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40d0520 0x7fbaf40ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47814/0 (socket says 172.21.15.67:47814) 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf3fff640 1 -- 172.21.15.67:0/632092014 learned_addr learned my addr 172.21.15.67:0/632092014 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf8929640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbaf40738b0 0x7fbaf4153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf3fff640 1 -- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbaf40738b0 msgr2=0x7fbaf4153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf912a640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaf415ec20 0x7fbaf40aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf3fff640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbaf40738b0 0x7fbaf4153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf3fff640 1 -- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaf415ec20 msgr2=0x7fbaf40aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf3fff640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaf415ec20 0x7fbaf40aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf3fff640 1 -- 172.21.15.67:0/632092014 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf4165a30 con 0x7fbaf40d0520 2024-09-19T05:48:40.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf3fff640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40d0520 0x7fbaf40ae600 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7fbae800ba50 tx=0x7fbae800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:40.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf17fa640 1 -- 172.21.15.67:0/632092014 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8019070 con 0x7fbaf40d0520 2024-09-19T05:48:40.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf17fa640 1 -- 172.21.15.67:0/632092014 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae800cc00 con 0x7fbaf40d0520 2024-09-19T05:48:40.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf17fa640 1 -- 172.21.15.67:0/632092014 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8014440 con 0x7fbaf40d0520 2024-09-19T05:48:40.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbafab8d640 1 -- 172.21.15.67:0/632092014 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf415d910 con 0x7fbaf40d0520 2024-09-19T05:48:40.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbafab8d640 1 -- 172.21.15.67:0/632092014 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf4153880 con 0x7fbaf40d0520 2024-09-19T05:48:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbafab8d640 1 -- 172.21.15.67:0/632092014 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf40b30b0 con 0x7fbaf40d0520 2024-09-19T05:48:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf17fa640 1 -- 172.21.15.67:0/632092014 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbae801c070 con 0x7fbaf40d0520 2024-09-19T05:48:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf17fa640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbae00678c0 0x7fbae0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf17fa640 1 -- 172.21.15.67:0/632092014 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 5249+0+0 (secure 0 0 0) 0x7fbae80857f0 con 0x7fbaf40d0520 2024-09-19T05:48:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.209+0000 7fbaf8929640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbae00678c0 0x7fbae0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:40.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.213+0000 7fbaf8929640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbae00678c0 0x7fbae0069d80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbae40ad000 tx=0x7fbae4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:40.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.213+0000 7fbaf17fa640 1 -- 172.21.15.67:0/632092014 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fbae8056580 con 0x7fbaf40d0520 2024-09-19T05:48:40.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:40.381+0000 7fbafab8d640 1 -- 172.21.15.67:0/632092014 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbaf40b5390 con 0x7fbaf40d0520 2024-09-19T05:48:41.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.353+0000 7fbaf17fa640 1 -- 172.21.15.67:0/632092014 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v202) ==== 138+0+0 (secure 0 0 0) 0x7fbae8055e80 con 0x7fbaf40d0520 2024-09-19T05:48:41.355 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 -- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbae00678c0 msgr2=0x7fbae0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbae00678c0 0x7fbae0069d80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbae40ad000 tx=0x7fbae4008040 comp rx=0 tx=0).stop 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 -- 172.21.15.67:0/632092014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40d0520 msgr2=0x7fbaf40ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40d0520 0x7fbaf40ae600 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7fbae800ba50 tx=0x7fbae800bf10 comp rx=0 tx=0).stop 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 -- 172.21.15.67:0/632092014 shutdown_connections 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaf415ec20 0x7fbaf40aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaf40d0520 0x7fbaf40ae600 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbae00678c0 0x7fbae0069d80 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 --2- 172.21.15.67:0/632092014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbaf40738b0 0x7fbaf4153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 -- 172.21.15.67:0/632092014 >> 172.21.15.67:0/632092014 conn(0x7fbaf406c0c0 msgr2=0x7fbaf415bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 -- 172.21.15.67:0/632092014 shutdown_connections 2024-09-19T05:48:41.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.357+0000 7fbafab8d640 1 -- 172.21.15.67:0/632092014 wait complete. 2024-09-19T05:48:41.387 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:48:41.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.525+0000 7f3f08ef2640 1 Processor -- start 2024-09-19T05:48:41.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.525+0000 7f3f08ef2640 1 -- start start 2024-09-19T05:48:41.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.525+0000 7f3f08ef2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f040cf9c0 0x7f3f0415f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:41.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.525+0000 7f3f08ef2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f0415f910 con 0x7f3f04072670 2024-09-19T05:48:41.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.525+0000 7f3f08ef2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f0406e540 con 0x7f3f0406dfc0 2024-09-19T05:48:41.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.525+0000 7f3f08ef2640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0406e820 con 0x7f3f040cf9c0 2024-09-19T05:48:41.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.525+0000 7f3f02d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3f04072670 0x7f3f040b3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58076/0 (socket says 172.21.15.67:58076) 2024-09-19T05:48:41.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.525+0000 7f3f0259c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f040cf9c0 0x7f3f0415f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:41.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.525+0000 7f3f02d9d640 1 -- 172.21.15.67:0/1010341938 learned_addr learned my addr 172.21.15.67:0/1010341938 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:41.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.529+0000 7f3f0259c640 1 -- 172.21.15.67:0/1010341938 >> v1:172.21.15.97:6789/0 conn(0x7f3f0406dfc0 legacy=0x7f3f04071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:41.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.529+0000 7f3f0259c640 1 -- 172.21.15.67:0/1010341938 >> v1:172.21.15.67:6789/0 conn(0x7f3f04072670 legacy=0x7f3f040b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:41.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.529+0000 7f3f0159a640 1 -- 172.21.15.67:0/1010341938 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913329755 0 0) 0x7f3ef4001120 con 0x7f3f04072670 2024-09-19T05:48:41.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.529+0000 7f3f0259c640 1 -- 172.21.15.67:0/1010341938 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0406eb00 con 0x7f3f040cf9c0 2024-09-19T05:48:41.530 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:48:41.532 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:48:41.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f0259c640 1 --2- 172.21.15.67:0/1010341938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 0x7f3f0415f3d0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009d90 tx=0x7f3efc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0696986cf8e837 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f0159a640 1 -- 172.21.15.67:0/1010341938 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0b2070 con 0x7f3f040cf9c0 2024-09-19T05:48:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f0159a640 1 -- 172.21.15.67:0/1010341938 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3efc0a5a00 con 0x7f3f040cf9c0 2024-09-19T05:48:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f0159a640 1 -- 172.21.15.67:0/1010341938 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0a5dd0 con 0x7f3f040cf9c0 2024-09-19T05:48:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 -- 172.21.15.67:0/1010341938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 msgr2=0x7f3f0415f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 --2- 172.21.15.67:0/1010341938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 0x7f3f0415f3d0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009d90 tx=0x7f3efc01c940 comp rx=0 tx=0).stop 2024-09-19T05:48:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 -- 172.21.15.67:0/1010341938 shutdown_connections 2024-09-19T05:48:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 --2- 172.21.15.67:0/1010341938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 0x7f3f0415f3d0 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 -- 172.21.15.67:0/1010341938 >> 172.21.15.67:0/1010341938 conn(0x7f3f040b1e50 msgr2=0x7f3f040b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 -- 172.21.15.67:0/1010341938 shutdown_connections 2024-09-19T05:48:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 -- 172.21.15.67:0/1010341938 wait complete. 2024-09-19T05:48:41.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 Processor -- start 2024-09-19T05:48:41.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 -- start start 2024-09-19T05:48:41.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f0406dfc0 0x7f3f04149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:41.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f04072670 0x7f3f04145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:41.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 0x7f3f040999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:41.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3f040b42f0 con 0x7f3f040cf9c0 2024-09-19T05:48:41.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3f040b4170 con 0x7f3f0406dfc0 2024-09-19T05:48:41.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f08ef2640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3f040b4470 con 0x7f3f04072670 2024-09-19T05:48:41.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f02d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 0x7f3f040999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:41.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f02d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 0x7f3f040999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47830/0 (socket says 172.21.15.67:47830) 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f02d9d640 1 -- 172.21.15.67:0/645119189 learned_addr learned my addr 172.21.15.67:0/645119189 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f0259c640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f0406dfc0 0x7f3f04149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f01d9b640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f04072670 0x7f3f04145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f02d9d640 1 -- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f04072670 msgr2=0x7f3f04145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f02d9d640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f04072670 0x7f3f04145b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f02d9d640 1 -- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f0406dfc0 msgr2=0x7f3f04149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f02d9d640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f0406dfc0 0x7f3f04149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f02d9d640 1 -- 172.21.15.67:0/645119189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f04149950 con 0x7f3f040cf9c0 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.533+0000 7f3f0259c640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f0406dfc0 0x7f3f04149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3f02d9d640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 0x7f3f040999e0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c3e0 tx=0x7f3ef400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3efaffd640 1 -- 172.21.15.67:0/645119189 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40074e0 con 0x7f3f040cf9c0 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3efaffd640 1 -- 172.21.15.67:0/645119189 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef40047f0 con 0x7f3f040cf9c0 2024-09-19T05:48:41.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3f08ef2640 1 -- 172.21.15.67:0/645119189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f040aef10 con 0x7f3f040cf9c0 2024-09-19T05:48:41.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3efaffd640 1 -- 172.21.15.67:0/645119189 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4004be0 con 0x7f3f040cf9c0 2024-09-19T05:48:41.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3f08ef2640 1 -- 172.21.15.67:0/645119189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f040af4d0 con 0x7f3f040cf9c0 2024-09-19T05:48:41.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3f08ef2640 1 -- 172.21.15.67:0/645119189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f0415f3d0 con 0x7f3f040cf9c0 2024-09-19T05:48:41.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3efaffd640 1 -- 172.21.15.67:0/645119189 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ef4011070 con 0x7f3f040cf9c0 2024-09-19T05:48:41.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3efaffd640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3ee80678c0 0x7f3ee8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:41.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3efaffd640 1 -- 172.21.15.67:0/645119189 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5619+0+0 (secure 0 0 0) 0x7f3ef4085850 con 0x7f3f040cf9c0 2024-09-19T05:48:41.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3f0259c640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3ee80678c0 0x7f3ee8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:41.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.537+0000 7f3f0259c640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3ee80678c0 0x7f3ee8069d80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0af000 tx=0x7f3efc0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:41.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.541+0000 7f3efaffd640 1 -- 172.21.15.67:0/645119189 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3f0415f910 con 0x7f3f040cf9c0 2024-09-19T05:48:41.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:41.709+0000 7f3f08ef2640 1 -- 172.21.15.67:0/645119189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3f040b51a0 con 0x7f3f040cf9c0 2024-09-19T05:48:42.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.365+0000 7f3efaffd640 1 -- 172.21.15.67:0/645119189 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v203) ==== 170+0+0 (secure 0 0 0) 0x7f3ef40563e0 con 0x7f3f040cf9c0 2024-09-19T05:48:42.368 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-19T05:48:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 -- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3ee80678c0 msgr2=0x7f3ee8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3ee80678c0 0x7f3ee8069d80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0af000 tx=0x7f3efc0a7070 comp rx=0 tx=0).stop 2024-09-19T05:48:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 -- 172.21.15.67:0/645119189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 msgr2=0x7f3f040999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 0x7f3f040999e0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c3e0 tx=0x7f3ef400c8a0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 -- 172.21.15.67:0/645119189 shutdown_connections 2024-09-19T05:48:42.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f040cf9c0 0x7f3f040999e0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f3ee80678c0 0x7f3ee8069d80 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f04072670 0x7f3f04145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 --2- 172.21.15.67:0/645119189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f0406dfc0 0x7f3f04149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 -- 172.21.15.67:0/645119189 >> 172.21.15.67:0/645119189 conn(0x7f3f040b1e50 msgr2=0x7f3f040b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:42.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 -- 172.21.15.67:0/645119189 shutdown_connections 2024-09-19T05:48:42.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.369+0000 7f3f08ef2640 1 -- 172.21.15.67:0/645119189 wait complete. 2024-09-19T05:48:42.397 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:48:42.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe32b9ea640 1 Processor -- start 2024-09-19T05:48:42.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe32b9ea640 1 -- start start 2024-09-19T05:48:42.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe32b9ea640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe324159c60 0x7fe3240ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:42.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe32b9ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3240af3a0 0x7fe32415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:42.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe32b9ea640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32415a040 con 0x7fe32406ffd0 2024-09-19T05:48:42.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe32b9ea640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe32415d460 con 0x7fe324159c60 2024-09-19T05:48:42.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe32b9ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe32415c850 con 0x7fe3240af3a0 2024-09-19T05:48:42.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe329786640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe324159c60 0x7fe3240ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:42.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe329786640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe324159c60 0x7fe3240ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47842/0 (socket says 172.21.15.67:47842) 2024-09-19T05:48:42.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe329786640 1 -- 172.21.15.67:0/3130850007 learned_addr learned my addr 172.21.15.67:0/3130850007 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe329f87640 1 --2- 172.21.15.67:0/3130850007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3240af3a0 0x7fe32415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe329786640 1 -- 172.21.15.67:0/3130850007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3240af3a0 msgr2=0x7fe32415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe329786640 1 --2- 172.21.15.67:0/3130850007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3240af3a0 0x7fe32415fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe329786640 1 -- 172.21.15.67:0/3130850007 >> v1:172.21.15.67:6789/0 conn(0x7fe32406ffd0 legacy=0x7fe3240aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.533+0000 7fe329786640 1 -- 172.21.15.67:0/3130850007 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32415cb30 con 0x7fe324159c60 2024-09-19T05:48:42.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329786640 1 --2- 172.21.15.67:0/3130850007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe324159c60 0x7fe3240ad130 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7fe320009870 tx=0x7fe32001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bc22b7bc29a833 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:42.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe31bfff640 1 -- 172.21.15.67:0/3130850007 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3200aa600 con 0x7fe324159c60 2024-09-19T05:48:42.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe31bfff640 1 -- 172.21.15.67:0/3130850007 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3200af070 con 0x7fe324159c60 2024-09-19T05:48:42.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe31bfff640 1 -- 172.21.15.67:0/3130850007 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3200aa9c0 con 0x7fe324159c60 2024-09-19T05:48:42.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 -- 172.21.15.67:0/3130850007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe324159c60 msgr2=0x7fe3240ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:42.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 --2- 172.21.15.67:0/3130850007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe324159c60 0x7fe3240ad130 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7fe320009870 tx=0x7fe32001c4a0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 -- 172.21.15.67:0/3130850007 shutdown_connections 2024-09-19T05:48:42.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 --2- 172.21.15.67:0/3130850007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3240af3a0 0x7fe32415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 --2- 172.21.15.67:0/3130850007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe324159c60 0x7fe3240ad130 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 -- 172.21.15.67:0/3130850007 >> 172.21.15.67:0/3130850007 conn(0x7fe3240b1e50 msgr2=0x7fe3240b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:42.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 -- 172.21.15.67:0/3130850007 shutdown_connections 2024-09-19T05:48:42.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 -- 172.21.15.67:0/3130850007 wait complete. 2024-09-19T05:48:42.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 Processor -- start 2024-09-19T05:48:42.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 -- start start 2024-09-19T05:48:42.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe32406ffd0 0x7fe3241472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:42.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3240af3a0 0x7fe3241530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:42.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe324159c60 0x7fe3241535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:42.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe324168fb0 con 0x7fe32406ffd0 2024-09-19T05:48:42.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe324168e30 con 0x7fe3240af3a0 2024-09-19T05:48:42.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe32b9ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe324169130 con 0x7fe324159c60 2024-09-19T05:48:42.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329786640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe32406ffd0 0x7fe3241472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:42.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329786640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe32406ffd0 0x7fe3241472d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47846/0 (socket says 172.21.15.67:47846) 2024-09-19T05:48:42.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329786640 1 -- 172.21.15.67:0/2406944892 learned_addr learned my addr 172.21.15.67:0/2406944892 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:42.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329f87640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe324159c60 0x7fe3241535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe328f85640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3240af3a0 0x7fe3241530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329786640 1 -- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe324159c60 msgr2=0x7fe3241535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329786640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe324159c60 0x7fe3241535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329786640 1 -- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3240af3a0 msgr2=0x7fe3241530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329786640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3240af3a0 0x7fe3241530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329786640 1 -- 172.21.15.67:0/2406944892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe324150d10 con 0x7fe32406ffd0 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.537+0000 7fe329f87640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe324159c60 0x7fe3241535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe329786640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe32406ffd0 0x7fe3241472d0 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7fe3200ac040 tx=0x7fe32001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe319ffb640 1 -- 172.21.15.67:0/2406944892 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3200bd5f0 con 0x7fe32406ffd0 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe319ffb640 1 -- 172.21.15.67:0/2406944892 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3200bd790 con 0x7fe32406ffd0 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe32b9ea640 1 -- 172.21.15.67:0/2406944892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe324150470 con 0x7fe32406ffd0 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe319ffb640 1 -- 172.21.15.67:0/2406944892 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3200bdb60 con 0x7fe32406ffd0 2024-09-19T05:48:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe32b9ea640 1 -- 172.21.15.67:0/2406944892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe324150a30 con 0x7fe32406ffd0 2024-09-19T05:48:42.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe32b9ea640 1 -- 172.21.15.67:0/2406944892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32415fdc0 con 0x7fe32406ffd0 2024-09-19T05:48:42.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe319ffb640 1 -- 172.21.15.67:0/2406944892 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3200a9070 con 0x7fe32406ffd0 2024-09-19T05:48:42.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe319ffb640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3080678f0 0x7fe308069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:42.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe319ffb640 1 -- 172.21.15.67:0/2406944892 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 6001+0+0 (secure 0 0 0) 0x7fe3201207c0 con 0x7fe32406ffd0 2024-09-19T05:48:42.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe328f85640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3080678f0 0x7fe308069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:42.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.541+0000 7fe328f85640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3080678f0 0x7fe308069db0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe314007fd0 tx=0x7fe314009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:42.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.549+0000 7fe319ffb640 1 -- 172.21.15.67:0/2406944892 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe3200c3060 con 0x7fe32406ffd0 2024-09-19T05:48:42.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:42.745+0000 7fe32b9ea640 1 -- 172.21.15.67:0/2406944892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe32415fdc0 con 0x7fe32406ffd0 2024-09-19T05:48:43.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.389+0000 7fe319ffb640 1 -- 172.21.15.67:0/2406944892 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 29 and data pool 30 v142) ==== 174+0+0 (secure 0 0 0) 0x7fe320016150 con 0x7fe32406ffd0 2024-09-19T05:48:43.404 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 29 and data pool 30 2024-09-19T05:48:43.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 -- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3080678f0 msgr2=0x7fe308069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3080678f0 0x7fe308069db0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe314007fd0 tx=0x7fe314009040 comp rx=0 tx=0).stop 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 -- 172.21.15.67:0/2406944892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe32406ffd0 msgr2=0x7fe3241472d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe32406ffd0 0x7fe3241472d0 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7fe3200ac040 tx=0x7fe32001ace0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 -- 172.21.15.67:0/2406944892 shutdown_connections 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe3080678f0 0x7fe308069db0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe324159c60 0x7fe3241535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3240af3a0 0x7fe3241530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 --2- 172.21.15.67:0/2406944892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe32406ffd0 0x7fe3241472d0 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 -- 172.21.15.67:0/2406944892 >> 172.21.15.67:0/2406944892 conn(0x7fe3240b1e50 msgr2=0x7fe32406e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 -- 172.21.15.67:0/2406944892 shutdown_connections 2024-09-19T05:48:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.409+0000 7fe32b9ea640 1 -- 172.21.15.67:0/2406944892 wait complete. 2024-09-19T05:48:43.434 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:48:43.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.549+0000 7f98339ad640 1 Processor -- start 2024-09-19T05:48:43.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.549+0000 7f98339ad640 1 -- start start 2024-09-19T05:48:43.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f98339ad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f982c0af730 0x7f982c15a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f98339ad640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f982c072840 0x7f982c15e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f98339ad640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c0730e0 con 0x7f982c15ea50 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f98339ad640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f982c15ae60 con 0x7f982c072840 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f98339ad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f982c0733c0 con 0x7f982c0af730 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9830f48640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f982c072840 0x7f982c15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9831f4a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f982c15ea50 0x7f982c06dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58098/0 (socket says 172.21.15.67:58098) 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9831f4a640 1 -- 172.21.15.67:0/1925416138 learned_addr learned my addr 172.21.15.67:0/1925416138 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9831749640 1 --2- 172.21.15.67:0/1925416138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f982c0af730 0x7f982c15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9830f48640 1 -- 172.21.15.67:0/1925416138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f982c0af730 msgr2=0x7f982c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9830f48640 1 --2- 172.21.15.67:0/1925416138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f982c0af730 0x7f982c15a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9830f48640 1 -- 172.21.15.67:0/1925416138 >> v1:172.21.15.67:6789/0 conn(0x7f982c15ea50 legacy=0x7f982c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9823fff640 1 -- 172.21.15.67:0/1925416138 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733347730 0 0) 0x7f982c0730e0 con 0x7f982c15ea50 2024-09-19T05:48:43.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9830f48640 1 -- 172.21.15.67:0/1925416138 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c0ad8c0 con 0x7f982c072840 2024-09-19T05:48:43.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9830f48640 1 --2- 172.21.15.67:0/1925416138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c072840 0x7f982c15e510 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f98280097c0 tx=0x7f982801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9013d531cc5a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:43.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9823fff640 1 -- 172.21.15.67:0/1925416138 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98280b0070 con 0x7f982c072840 2024-09-19T05:48:43.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9823fff640 1 -- 172.21.15.67:0/1925416138 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9828004230 con 0x7f982c072840 2024-09-19T05:48:43.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.553+0000 7f9823fff640 1 -- 172.21.15.67:0/1925416138 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828003620 con 0x7f982c072840 2024-09-19T05:48:43.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- 172.21.15.67:0/1925416138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c072840 msgr2=0x7f982c15e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 --2- 172.21.15.67:0/1925416138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c072840 0x7f982c15e510 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f98280097c0 tx=0x7f982801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- 172.21.15.67:0/1925416138 shutdown_connections 2024-09-19T05:48:43.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 --2- 172.21.15.67:0/1925416138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c072840 0x7f982c15e510 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 --2- 172.21.15.67:0/1925416138 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f982c0af730 0x7f982c15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- 172.21.15.67:0/1925416138 >> 172.21.15.67:0/1925416138 conn(0x7f982c0d0080 msgr2=0x7f982c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:43.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- 172.21.15.67:0/1925416138 shutdown_connections 2024-09-19T05:48:43.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- 172.21.15.67:0/1925416138 wait complete. 2024-09-19T05:48:43.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 Processor -- start 2024-09-19T05:48:43.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- start start 2024-09-19T05:48:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f982c072840 0x7f982c14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f982c0af730 0x7f982c14d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c15ea50 0x7f982c14e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0af350 con 0x7f982c15ea50 2024-09-19T05:48:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0af1d0 con 0x7f982c0af730 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f982c072c80 con 0x7f982c072840 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9831f4a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c15ea50 0x7f982c14e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9831f4a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c15ea50 0x7f982c14e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47874/0 (socket says 172.21.15.67:47874) 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9831f4a640 1 -- 172.21.15.67:0/2689351007 learned_addr learned my addr 172.21.15.67:0/2689351007 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9831749640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f982c072840 0x7f982c14ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9831f4a640 1 -- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f982c072840 msgr2=0x7f982c14ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9831f4a640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f982c072840 0x7f982c14ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9831f4a640 1 -- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f982c0af730 msgr2=0x7f982c14d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9830f48640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f982c0af730 0x7f982c14d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9831f4a640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f982c0af730 0x7f982c14d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9831f4a640 1 -- 172.21.15.67:0/2689351007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c14ce30 con 0x7f982c15ea50 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9830f48640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f982c0af730 0x7f982c14d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9831f4a640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c15ea50 0x7f982c14e520 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f982400c7d0 tx=0x7f982400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:43.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9821ffb640 1 -- 172.21.15.67:0/2689351007 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824018070 con 0x7f982c15ea50 2024-09-19T05:48:43.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9821ffb640 1 -- 172.21.15.67:0/2689351007 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982400a640 con 0x7f982c15ea50 2024-09-19T05:48:43.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- 172.21.15.67:0/2689351007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c14f4a0 con 0x7f982c15ea50 2024-09-19T05:48:43.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f9821ffb640 1 -- 172.21.15.67:0/2689351007 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982400aa70 con 0x7f982c15ea50 2024-09-19T05:48:43.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.557+0000 7f98339ad640 1 -- 172.21.15.67:0/2689351007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c14f1c0 con 0x7f982c15ea50 2024-09-19T05:48:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.561+0000 7f98339ad640 1 -- 172.21.15.67:0/2689351007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c06ed00 con 0x7f982c15ea50 2024-09-19T05:48:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.561+0000 7f9821ffb640 1 -- 172.21.15.67:0/2689351007 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f982401b070 con 0x7f982c15ea50 2024-09-19T05:48:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.561+0000 7f9821ffb640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98100678c0 0x7f9810069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.561+0000 7f9821ffb640 1 -- 172.21.15.67:0/2689351007 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f98240854a0 con 0x7f982c15ea50 2024-09-19T05:48:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.561+0000 7f9831749640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98100678c0 0x7f9810069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.561+0000 7f9831749640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98100678c0 0x7f9810069d80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f981c00b930 tx=0x7f981c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:43.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.565+0000 7f9821ffb640 1 -- 172.21.15.67:0/2689351007 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f9824055dc0 con 0x7f982c15ea50 2024-09-19T05:48:43.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.729+0000 7f98339ad640 1 -- 172.21.15.67:0/2689351007 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f982c14b160 con 0x7f982c15ea50 2024-09-19T05:48:43.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f9821ffb640 1 -- 172.21.15.67:0/2689351007 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) ==== 74+0+16921 (secure 0 0 0) 0x7f98240556c0 con 0x7f982c15ea50 2024-09-19T05:48:43.733 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:43.733 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":204,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:48:42.753061+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:48:40.426332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-19T05:48:41.753955+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:48:43.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 -- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98100678c0 msgr2=0x7f9810069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98100678c0 0x7f9810069d80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f981c00b930 tx=0x7f981c008040 comp rx=0 tx=0).stop 2024-09-19T05:48:43.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 -- 172.21.15.67:0/2689351007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c15ea50 msgr2=0x7f982c14e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c15ea50 0x7f982c14e520 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f982400c7d0 tx=0x7f982400cc90 comp rx=0 tx=0).stop 2024-09-19T05:48:43.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 -- 172.21.15.67:0/2689351007 shutdown_connections 2024-09-19T05:48:43.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c15ea50 0x7f982c14e520 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f982c0af730 0x7f982c14d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98100678c0 0x7f9810069d80 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 --2- 172.21.15.67:0/2689351007 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f982c072840 0x7f982c14ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 -- 172.21.15.67:0/2689351007 >> 172.21.15.67:0/2689351007 conn(0x7f982c0d0080 msgr2=0x7f982c0b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:43.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 -- 172.21.15.67:0/2689351007 shutdown_connections 2024-09-19T05:48:43.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.733+0000 7f98339ad640 1 -- 172.21.15.67:0/2689351007 wait complete. 2024-09-19T05:48:43.752 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:48:43.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2aceb5640 1 Processor -- start 2024-09-19T05:48:43.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2aceb5640 1 -- start start 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2aceb5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe2a815c030 0x7fe2a806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2aceb5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a806e3c0 con 0x7fe2a815d1d0 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2aceb5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a806e6a0 con 0x7fe2a806f460 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2aceb5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a806e980 con 0x7fe2a815c030 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2a659c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe2a815c030 0x7fe2a806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe29ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe2a815d1d0 0x7fe2a80b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58114/0 (socket says 172.21.15.67:58114) 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe29ffff640 1 -- 172.21.15.67:0/1576088597 learned_addr learned my addr 172.21.15.67:0/1576088597 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2a5d9b640 1 -- 172.21.15.67:0/1576088597 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415433951 0 0) 0x7fe2a806e3c0 con 0x7fe2a815d1d0 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2a5d9b640 1 -- 172.21.15.67:0/1576088597 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe294003530 con 0x7fe2a815d1d0 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2a659c640 1 -- 172.21.15.67:0/1576088597 >> v1:172.21.15.97:6789/0 conn(0x7fe2a806f460 legacy=0x7fe2a80acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:43.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2a659c640 1 -- 172.21.15.67:0/1576088597 >> v1:172.21.15.67:6789/0 conn(0x7fe2a815d1d0 legacy=0x7fe2a80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.865+0000 7fe2a659c640 1 -- 172.21.15.67:0/1576088597 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a806ec60 con 0x7fe2a815c030 2024-09-19T05:48:43.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2a659c640 1 --2- 172.21.15.67:0/1576088597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 0x7fe2a806dde0 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7fe2900097c0 tx=0x7fe29001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c592d6c4405bbbce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:43.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2a5d9b640 1 -- 172.21.15.67:0/1576088597 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900b0070 con 0x7fe2a815c030 2024-09-19T05:48:43.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2a5d9b640 1 -- 172.21.15.67:0/1576088597 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe290004230 con 0x7fe2a815c030 2024-09-19T05:48:43.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2a5d9b640 1 -- 172.21.15.67:0/1576088597 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290003620 con 0x7fe2a815c030 2024-09-19T05:48:43.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- 172.21.15.67:0/1576088597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 msgr2=0x7fe2a806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 --2- 172.21.15.67:0/1576088597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 0x7fe2a806dde0 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7fe2900097c0 tx=0x7fe29001c430 comp rx=0 tx=0).stop 2024-09-19T05:48:43.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- 172.21.15.67:0/1576088597 shutdown_connections 2024-09-19T05:48:43.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 --2- 172.21.15.67:0/1576088597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 0x7fe2a806dde0 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- 172.21.15.67:0/1576088597 >> 172.21.15.67:0/1576088597 conn(0x7fe2a80d0080 msgr2=0x7fe2a80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:43.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- 172.21.15.67:0/1576088597 shutdown_connections 2024-09-19T05:48:43.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- 172.21.15.67:0/1576088597 wait complete. 2024-09-19T05:48:43.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 Processor -- start 2024-09-19T05:48:43.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- start start 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2a806f460 0x7fe2a80b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 0x7fe2a8099530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2a815d1d0 0x7fe2a8099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a815c590 con 0x7fe2a815c030 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a815c410 con 0x7fe2a815d1d0 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a80ad6c0 con 0x7fe2a806f460 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 0x7fe2a8099530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 0x7fe2a8099530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47882/0 (socket says 172.21.15.67:47882) 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29ffff640 1 -- 172.21.15.67:0/786142814 learned_addr learned my addr 172.21.15.67:0/786142814 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2a659c640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2a806f460 0x7fe2a80b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2a6d9d640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2a815d1d0 0x7fe2a8099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29ffff640 1 -- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2a806f460 msgr2=0x7fe2a80b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29ffff640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2a806f460 0x7fe2a80b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29ffff640 1 -- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2a815d1d0 msgr2=0x7fe2a8099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29ffff640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2a815d1d0 0x7fe2a8099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29ffff640 1 -- 172.21.15.67:0/786142814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a80b0610 con 0x7fe2a815c030 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2a6d9d640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2a815d1d0 0x7fe2a8099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2a659c640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2a806f460 0x7fe2a80b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29ffff640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 0x7fe2a8099530 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c3c0 tx=0x7fe29800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29effd640 1 -- 172.21.15.67:0/786142814 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298017070 con 0x7fe2a815c030 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29effd640 1 -- 172.21.15.67:0/786142814 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe298005cf0 con 0x7fe2a815c030 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe29effd640 1 -- 172.21.15.67:0/786142814 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2980072f0 con 0x7fe2a815c030 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- 172.21.15.67:0/786142814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a8151ff0 con 0x7fe2a815c030 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.869+0000 7fe2aceb5640 1 -- 172.21.15.67:0/786142814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a8148820 con 0x7fe2a815c030 2024-09-19T05:48:43.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.873+0000 7fe2aceb5640 1 -- 172.21.15.67:0/786142814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a806dde0 con 0x7fe2a815c030 2024-09-19T05:48:43.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.873+0000 7fe29effd640 1 -- 172.21.15.67:0/786142814 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe29801a070 con 0x7fe2a815c030 2024-09-19T05:48:43.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.873+0000 7fe29effd640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe2880678c0 0x7fe288069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:43.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.873+0000 7fe29effd640 1 -- 172.21.15.67:0/786142814 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fe298085640 con 0x7fe2a815c030 2024-09-19T05:48:43.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.873+0000 7fe2a659c640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe2880678c0 0x7fe288069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:43.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.873+0000 7fe2a659c640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe2880678c0 0x7fe288069d80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ad000 tx=0x7fe290008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:43.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:43.877+0000 7fe29effd640 1 -- 172.21.15.67:0/786142814 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe298021020 con 0x7fe2a815c030 2024-09-19T05:48:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.033+0000 7fe2aceb5640 1 -- 172.21.15.67:0/786142814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2a80d0f20 con 0x7fe2a815c030 2024-09-19T05:48:44.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.037+0000 7fe29effd640 1 -- 172.21.15.67:0/786142814 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) ==== 74+0+16921 (secure 0 0 0) 0x7fe298056060 con 0x7fe2a815c030 2024-09-19T05:48:44.039 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:44.039 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":204,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:48:42.753061+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:48:40.426332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-19T05:48:41.753955+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:48:44.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 -- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe2880678c0 msgr2=0x7fe288069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:44.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe2880678c0 0x7fe288069d80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ad000 tx=0x7fe290008040 comp rx=0 tx=0).stop 2024-09-19T05:48:44.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 -- 172.21.15.67:0/786142814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 msgr2=0x7fe2a8099530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 0x7fe2a8099530 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c3c0 tx=0x7fe29800c880 comp rx=0 tx=0).stop 2024-09-19T05:48:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 -- 172.21.15.67:0/786142814 shutdown_connections 2024-09-19T05:48:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2a815d1d0 0x7fe2a8099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2a815c030 0x7fe2a8099530 unknown :-1 s=CLOSED pgs=2429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe2880678c0 0x7fe288069d80 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 --2- 172.21.15.67:0/786142814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2a806f460 0x7fe2a80b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 -- 172.21.15.67:0/786142814 >> 172.21.15.67:0/786142814 conn(0x7fe2a80d0080 msgr2=0x7fe2a814f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 -- 172.21.15.67:0/786142814 shutdown_connections 2024-09-19T05:48:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.041+0000 7fe2aceb5640 1 -- 172.21.15.67:0/786142814 wait complete. 2024-09-19T05:48:44.058 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:48:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f372a5640 1 Processor -- start 2024-09-19T05:48:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f372a5640 1 -- start start 2024-09-19T05:48:44.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f372a5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4f30072670 0x7f4f301692d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:44.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f372a5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3006e540 con 0x7f4f300cf9c0 2024-09-19T05:48:44.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f372a5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3006e820 con 0x7f4f3006dfc0 2024-09-19T05:48:44.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f372a5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4f3006eb00 con 0x7f4f30072670 2024-09-19T05:48:44.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35041640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4f300cf9c0 0x7f4f3015f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58126/0 (socket says 172.21.15.67:58126) 2024-09-19T05:48:44.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35041640 1 -- 172.21.15.67:0/404874866 learned_addr learned my addr 172.21.15.67:0/404874866 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:44.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3325305425 0 0) 0x7f4f3006e540 con 0x7f4f300cf9c0 2024-09-19T05:48:44.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f18003530 con 0x7f4f300cf9c0 2024-09-19T05:48:44.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35842640 1 --2- 172.21.15.67:0/404874866 >> v2:172.21.15.97:3300/0 conn(0x7f4f30072670 0x7f4f301692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:44.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2075394249 0 0) 0x7f4f18003530 con 0x7f4f300cf9c0 2024-09-19T05:48:44.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 >> v2:172.21.15.97:3300/0 conn(0x7f4f30072670 msgr2=0x7f4f301692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:44.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 --2- 172.21.15.67:0/404874866 >> v2:172.21.15.97:3300/0 conn(0x7f4f30072670 0x7f4f301692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:44.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 >> v1:172.21.15.97:6789/0 conn(0x7f4f3006dfc0 legacy=0x7f4f30071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3006ede0 con 0x7f4f300cf9c0 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f4f20001680 con 0x7f4f300cf9c0 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 >> v1:172.21.15.67:6789/0 conn(0x7f4f300cf9c0 legacy=0x7f4f3015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f18003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f18004810 0x7f4f18004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f180051d0 0x7f4f1800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3006eb00 con 0x7f4f18003a10 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1800c0d0 con 0x7f4f180051d0 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1800c2d0 con 0x7f4f18004810 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35041640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f18003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f34840640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f18004810 0x7f4f18004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35842640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f180051d0 0x7f4f1800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35041640 1 -- 172.21.15.67:0/404874866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f18004810 msgr2=0x7f4f18004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:44.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35041640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f18004810 0x7f4f18004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:44.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35041640 1 -- 172.21.15.67:0/404874866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f180051d0 msgr2=0x7f4f1800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:44.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35041640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f180051d0 0x7f4f1800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:44.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35041640 1 -- 172.21.15.67:0/404874866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f18003530 con 0x7f4f18003a10 2024-09-19T05:48:44.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35842640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f180051d0 0x7f4f1800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:44.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.181+0000 7f4f35842640 1 -- 172.21.15.67:0/404874866 reap_dead start 2024-09-19T05:48:44.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f35041640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f18003e30 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000c110 tx=0x7f4f2001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28941518819a4f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:44.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20007c30 con 0x7f4f18003a10 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f200a9020 con 0x7f4f18003a10 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f2ffff640 1 -- 172.21.15.67:0/404874866 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20005ae0 con 0x7f4f18003a10 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f372a5640 1 -- 172.21.15.67:0/404874866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 msgr2=0x7f4f18003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f372a5640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f18003e30 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000c110 tx=0x7f4f2001cb70 comp rx=0 tx=0).stop 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f372a5640 1 -- 172.21.15.67:0/404874866 shutdown_connections 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f372a5640 1 --2- 172.21.15.67:0/404874866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f18003e30 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f372a5640 1 -- 172.21.15.67:0/404874866 >> 172.21.15.67:0/404874866 conn(0x7f4f300b1e50 msgr2=0x7f4f300b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f372a5640 1 -- 172.21.15.67:0/404874866 shutdown_connections 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f372a5640 1 -- 172.21.15.67:0/404874866 wait complete. 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f372a5640 1 Processor -- start 2024-09-19T05:48:44.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.185+0000 7f4f372a5640 1 -- start start 2024-09-19T05:48:44.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f372a5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f30147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:44.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f372a5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f30153730 0x7f4f3009a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:44.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f372a5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f30157de0 0x7f4f30158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f372a5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3015f7e0 con 0x7f4f18003a10 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f372a5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4f30162750 con 0x7f4f30153730 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f372a5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4f301478b0 con 0x7f4f30157de0 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f35041640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f30147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f35041640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f30147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47890/0 (socket says 172.21.15.67:47890) 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f35041640 1 -- 172.21.15.67:0/3853818954 learned_addr learned my addr 172.21.15.67:0/3853818954 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f34840640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f30153730 0x7f4f3009a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f35041640 1 -- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f30157de0 msgr2=0x7f4f30158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f35041640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f30157de0 0x7f4f30158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f35041640 1 -- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f30153730 msgr2=0x7f4f3009a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f35041640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f30153730 0x7f4f3009a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f35041640 1 -- 172.21.15.67:0/3853818954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f30144c40 con 0x7f4f18003a10 2024-09-19T05:48:44.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f34840640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f30153730 0x7f4f3009a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:44.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f35041640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f30147370 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f4f200ab040 tx=0x7f4f18005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:44.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f2dffb640 1 -- 172.21.15.67:0/3853818954 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20007c30 con 0x7f4f18003a10 2024-09-19T05:48:44.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f2dffb640 1 -- 172.21.15.67:0/3853818954 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f200070d0 con 0x7f4f18003a10 2024-09-19T05:48:44.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f372a5640 1 -- 172.21.15.67:0/3853818954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f30144f20 con 0x7f4f18003a10 2024-09-19T05:48:44.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f2dffb640 1 -- 172.21.15.67:0/3853818954 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20001680 con 0x7f4f18003a10 2024-09-19T05:48:44.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f372a5640 1 -- 172.21.15.67:0/3853818954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f301454e0 con 0x7f4f18003a10 2024-09-19T05:48:44.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f372a5640 1 -- 172.21.15.67:0/3853818954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f30162ae0 con 0x7f4f18003a10 2024-09-19T05:48:44.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f2dffb640 1 -- 172.21.15.67:0/3853818954 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f200074c0 con 0x7f4f18003a10 2024-09-19T05:48:44.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f2dffb640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f1c0678f0 0x7f4f1c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:44.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f2dffb640 1 -- 172.21.15.67:0/3853818954 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f4f2011fad0 con 0x7f4f18003a10 2024-09-19T05:48:44.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.189+0000 7f4f34840640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f1c0678f0 0x7f4f1c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:44.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.193+0000 7f4f34840640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f1c0678f0 0x7f4f1c069db0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4f24007fd0 tx=0x7f4f24009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:44.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.193+0000 7f4f2dffb640 1 -- 172.21.15.67:0/3853818954 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4f200168b0 con 0x7f4f18003a10 2024-09-19T05:48:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:44.389+0000 7f4f372a5640 1 -- 172.21.15.67:0/3853818954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4f300b51a0 con 0x7f4f18003a10 2024-09-19T05:48:45.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.393+0000 7f4f2dffb640 1 -- 172.21.15.67:0/3853818954 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v145) ==== 118+0+0 (secure 0 0 0) 0x7f4f200f0480 con 0x7f4f18003a10 2024-09-19T05:48:45.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 -- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f1c0678f0 msgr2=0x7f4f1c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:45.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f1c0678f0 0x7f4f1c069db0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4f24007fd0 tx=0x7f4f24009040 comp rx=0 tx=0).stop 2024-09-19T05:48:45.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 -- 172.21.15.67:0/3853818954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 msgr2=0x7f4f30147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:45.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f30147370 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f4f200ab040 tx=0x7f4f18005840 comp rx=0 tx=0).stop 2024-09-19T05:48:45.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 -- 172.21.15.67:0/3853818954 shutdown_connections 2024-09-19T05:48:45.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4f1c0678f0 0x7f4f1c069db0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:45.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f30157de0 0x7f4f30158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:45.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f30153730 0x7f4f3009a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:45.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 --2- 172.21.15.67:0/3853818954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f18003a10 0x7f4f30147370 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:45.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 -- 172.21.15.67:0/3853818954 >> 172.21.15.67:0/3853818954 conn(0x7f4f300b1e50 msgr2=0x7f4f300b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:45.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 -- 172.21.15.67:0/3853818954 shutdown_connections 2024-09-19T05:48:45.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.397+0000 7f4f372a5640 1 -- 172.21.15.67:0/3853818954 wait complete. 2024-09-19T05:48:45.420 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T05:48:45.420 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:48:45.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b17f0c640 1 Processor -- start 2024-09-19T05:48:45.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b17f0c640 1 -- start start 2024-09-19T05:48:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b17f0c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5b1015c210 0x7f5b1015c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b17f0c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b1015ddd0 con 0x7f5b1015d950 2024-09-19T05:48:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b17f0c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b1015e0b0 con 0x7f5b100cecd0 2024-09-19T05:48:45.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b17f0c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1015e390 con 0x7f5b1015c210 2024-09-19T05:48:45.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b154a7640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5b1015d950 0x7f5b100b5ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:58136/0 (socket says 172.21.15.67:58136) 2024-09-19T05:48:45.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b154a7640 1 -- 172.21.15.67:0/3635365495 learned_addr learned my addr 172.21.15.67:0/3635365495 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:45.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 929446105 0 0) 0x7f5b1015ddd0 con 0x7f5b1015d950 2024-09-19T05:48:45.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5afc003530 con 0x7f5b1015d950 2024-09-19T05:48:45.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b15ca8640 1 --2- 172.21.15.67:0/3635365495 >> v2:172.21.15.97:3300/0 conn(0x7f5b1015c210 0x7f5b1015c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3352642061 0 0) 0x7f5afc003530 con 0x7f5b1015d950 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 >> v2:172.21.15.97:3300/0 conn(0x7f5b1015c210 msgr2=0x7f5b1015c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 --2- 172.21.15.67:0/3635365495 >> v2:172.21.15.97:3300/0 conn(0x7f5b1015c210 0x7f5b1015c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 >> v1:172.21.15.97:6789/0 conn(0x7f5b100cecd0 legacy=0x7f5b1015ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1015e670 con 0x7f5b1015d950 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f5b00001680 con 0x7f5b1015d950 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 >> v1:172.21.15.67:6789/0 conn(0x7f5b1015d950 legacy=0x7f5b100b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5afc003a10 0x7f5afc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc004810 0x7f5afc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc005220 0x7f5afc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1015e390 con 0x7f5afc004810 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5afc00c170 con 0x7f5afc005220 2024-09-19T05:48:45.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5afc00c370 con 0x7f5afc003a10 2024-09-19T05:48:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b154a7640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc004810 0x7f5afc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.553+0000 7f5b15ca8640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5afc003a10 0x7f5afc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b164a9640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc005220 0x7f5afc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b154a7640 1 -- 172.21.15.67:0/3635365495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5afc003a10 msgr2=0x7f5afc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b154a7640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5afc003a10 0x7f5afc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b154a7640 1 -- 172.21.15.67:0/3635365495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc005220 msgr2=0x7f5afc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b154a7640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc005220 0x7f5afc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b154a7640 1 -- 172.21.15.67:0/3635365495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5afc003530 con 0x7f5afc004810 2024-09-19T05:48:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b164a9640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc005220 0x7f5afc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:45.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b164a9640 1 -- 172.21.15.67:0/3635365495 reap_dead start 2024-09-19T05:48:45.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b154a7640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc004810 0x7f5afc004c90 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000c0e0 tx=0x7f5b0001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa635d62199237 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:45.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00007c30 con 0x7f5afc004810 2024-09-19T05:48:45.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b000a9020 con 0x7f5afc004810 2024-09-19T05:48:45.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b14ca6640 1 -- 172.21.15.67:0/3635365495 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00005ae0 con 0x7f5afc004810 2024-09-19T05:48:45.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b17f0c640 1 -- 172.21.15.67:0/3635365495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc004810 msgr2=0x7f5afc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:45.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b17f0c640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc004810 0x7f5afc004c90 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000c0e0 tx=0x7f5b0001cb60 comp rx=0 tx=0).stop 2024-09-19T05:48:45.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b17f0c640 1 -- 172.21.15.67:0/3635365495 shutdown_connections 2024-09-19T05:48:45.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b17f0c640 1 --2- 172.21.15.67:0/3635365495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc004810 0x7f5afc004c90 unknown :-1 s=CLOSED pgs=2434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:45.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b17f0c640 1 -- 172.21.15.67:0/3635365495 >> 172.21.15.67:0/3635365495 conn(0x7f5b100b7970 msgr2=0x7f5b100b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:45.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b17f0c640 1 -- 172.21.15.67:0/3635365495 shutdown_connections 2024-09-19T05:48:45.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.557+0000 7f5b17f0c640 1 -- 172.21.15.67:0/3635365495 wait complete. 2024-09-19T05:48:45.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 Processor -- start 2024-09-19T05:48:45.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 -- start start 2024-09-19T05:48:45.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc004810 0x7f5b1014fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:45.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b10152d70 0x7f5b10150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:45.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b100708f0 0x7f5b10070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:45.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5b100b6270 con 0x7f5b100708f0 2024-09-19T05:48:45.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5b100b60f0 con 0x7f5afc004810 2024-09-19T05:48:45.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5b100b63f0 con 0x7f5b10152d70 2024-09-19T05:48:45.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b164a9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b100708f0 0x7f5b10070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:45.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b164a9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b100708f0 0x7f5b10070da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47908/0 (socket says 172.21.15.67:47908) 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b164a9640 1 -- 172.21.15.67:0/1888423011 learned_addr learned my addr 172.21.15.67:0/1888423011 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b15ca8640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc004810 0x7f5b1014fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b154a7640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b10152d70 0x7f5b10150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b164a9640 1 -- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b10152d70 msgr2=0x7f5b10150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b164a9640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b10152d70 0x7f5b10150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b164a9640 1 -- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc004810 msgr2=0x7f5b1014fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b164a9640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc004810 0x7f5b1014fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b164a9640 1 -- 172.21.15.67:0/1888423011 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b101566f0 con 0x7f5b100708f0 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b15ca8640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc004810 0x7f5b1014fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b164a9640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b100708f0 0x7f5b10070da0 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f5b100b7020 tx=0x7f5b0800d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b067fc640 1 -- 172.21.15.67:0/1888423011 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08018070 con 0x7f5b100708f0 2024-09-19T05:48:45.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b067fc640 1 -- 172.21.15.67:0/1888423011 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b08003db0 con 0x7f5b100708f0 2024-09-19T05:48:45.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 -- 172.21.15.67:0/1888423011 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b10151cd0 con 0x7f5b100708f0 2024-09-19T05:48:45.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b067fc640 1 -- 172.21.15.67:0/1888423011 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08005310 con 0x7f5b100708f0 2024-09-19T05:48:45.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 -- 172.21.15.67:0/1888423011 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b10152290 con 0x7f5b100708f0 2024-09-19T05:48:45.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b17f0c640 1 -- 172.21.15.67:0/1888423011 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b100b6780 con 0x7f5b100708f0 2024-09-19T05:48:45.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b067fc640 1 -- 172.21.15.67:0/1888423011 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b0801b070 con 0x7f5b100708f0 2024-09-19T05:48:45.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b067fc640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5af40678f0 0x7f5af4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:45.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.561+0000 7f5b067fc640 1 -- 172.21.15.67:0/1888423011 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f5b08085440 con 0x7f5b100708f0 2024-09-19T05:48:45.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.565+0000 7f5b15ca8640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5af40678f0 0x7f5af4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:45.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.565+0000 7f5b15ca8640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5af40678f0 0x7f5af4069db0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009aa0 tx=0x7f5b0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:45.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.569+0000 7f5b067fc640 1 -- 172.21.15.67:0/1888423011 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5b08055e80 con 0x7f5b100708f0 2024-09-19T05:48:45.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:45.765+0000 7f5b17f0c640 1 -- 172.21.15.67:0/1888423011 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5b100af210 con 0x7f5b100708f0 2024-09-19T05:48:46.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.405+0000 7f5b067fc640 1 -- 172.21.15.67:0/1888423011 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v146) ==== 122+0+0 (secure 0 0 0) 0x7f5b08055780 con 0x7f5b100708f0 2024-09-19T05:48:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 -- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5af40678f0 msgr2=0x7f5af4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5af40678f0 0x7f5af4069db0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009aa0 tx=0x7f5b0c008040 comp rx=0 tx=0).stop 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 -- 172.21.15.67:0/1888423011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b100708f0 msgr2=0x7f5b10070da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b100708f0 0x7f5b10070da0 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f5b100b7020 tx=0x7f5b0800d8e0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 -- 172.21.15.67:0/1888423011 shutdown_connections 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b100708f0 0x7f5b10070da0 unknown :-1 s=CLOSED pgs=2435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5af40678f0 0x7f5af4069db0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b10152d70 0x7f5b10150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 --2- 172.21.15.67:0/1888423011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5afc004810 0x7f5b1014fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 -- 172.21.15.67:0/1888423011 >> 172.21.15.67:0/1888423011 conn(0x7f5b100b7970 msgr2=0x7f5b1015ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 -- 172.21.15.67:0/1888423011 shutdown_connections 2024-09-19T05:48:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.409+0000 7f5b17f0c640 1 -- 172.21.15.67:0/1888423011 wait complete. 2024-09-19T05:48:46.429 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:48:46.429 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:48:46.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e10ffd640 1 Processor -- start 2024-09-19T05:48:46.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e10ffd640 1 -- start start 2024-09-19T05:48:46.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e10ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e0c15c030 0x7f6e0c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e10ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e0c15d1d0 0x7f6e0c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e10ffd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0c06e3c0 con 0x7f6e0c0b3510 2024-09-19T05:48:46.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e10ffd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6e0c06e6a0 con 0x7f6e0c15d1d0 2024-09-19T05:48:46.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e10ffd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0c06e980 con 0x7f6e0c15c030 2024-09-19T05:48:46.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e09d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e0c15d1d0 0x7f6e0c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e09d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e0c15d1d0 0x7f6e0c0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42456/0 (socket says 172.21.15.67:42456) 2024-09-19T05:48:46.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e09d9b640 1 -- 172.21.15.67:0/2498919344 learned_addr learned my addr 172.21.15.67:0/2498919344 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:46.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e09d9b640 1 -- 172.21.15.67:0/2498919344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e0c15c030 msgr2=0x7f6e0c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:46.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e0a59c640 1 --2- 172.21.15.67:0/2498919344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e0c15c030 0x7f6e0c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e09d9b640 1 --2- 172.21.15.67:0/2498919344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e0c15c030 0x7f6e0c06dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e09d9b640 1 -- 172.21.15.67:0/2498919344 >> v1:172.21.15.97:6789/0 conn(0x7f6e0c0b3510 legacy=0x7f6e0c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:46.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.557+0000 7f6e09d9b640 1 -- 172.21.15.67:0/2498919344 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c06ec60 con 0x7f6e0c15d1d0 2024-09-19T05:48:46.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e09d9b640 1 --2- 172.21.15.67:0/2498919344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c15d1d0 0x7f6e0c0b2fd0 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009870 tx=0x7f6df401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95211e130e2ad08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:46.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0959a640 1 -- 172.21.15.67:0/2498919344 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df40aa430 con 0x7f6e0c15d1d0 2024-09-19T05:48:46.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0959a640 1 -- 172.21.15.67:0/2498919344 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df40af070 con 0x7f6e0c15d1d0 2024-09-19T05:48:46.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0959a640 1 -- 172.21.15.67:0/2498919344 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df40aa7f0 con 0x7f6e0c15d1d0 2024-09-19T05:48:46.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- 172.21.15.67:0/2498919344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c15d1d0 msgr2=0x7f6e0c0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 --2- 172.21.15.67:0/2498919344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c15d1d0 0x7f6e0c0b2fd0 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009870 tx=0x7f6df401c4f0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- 172.21.15.67:0/2498919344 shutdown_connections 2024-09-19T05:48:46.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 --2- 172.21.15.67:0/2498919344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c15d1d0 0x7f6e0c0b2fd0 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 --2- 172.21.15.67:0/2498919344 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e0c15c030 0x7f6e0c06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- 172.21.15.67:0/2498919344 >> 172.21.15.67:0/2498919344 conn(0x7f6e0c0d0080 msgr2=0x7f6e0c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:46.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- 172.21.15.67:0/2498919344 shutdown_connections 2024-09-19T05:48:46.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- 172.21.15.67:0/2498919344 wait complete. 2024-09-19T05:48:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 Processor -- start 2024-09-19T05:48:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- start start 2024-09-19T05:48:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b3510 0x7f6e0c148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e0c15c030 0x7f6e0c159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e0c15d1d0 0x7f6e0c0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c15c590 con 0x7f6e0c0b3510 2024-09-19T05:48:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c15c410 con 0x7f6e0c15c030 2024-09-19T05:48:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0c1690e0 con 0x7f6e0c15d1d0 2024-09-19T05:48:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b3510 0x7f6e0c148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b3510 0x7f6e0c148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42464/0 (socket says 172.21.15.67:42464) 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0a59c640 1 -- 172.21.15.67:0/1564315664 learned_addr learned my addr 172.21.15.67:0/1564315664 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e09d9b640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e0c15c030 0x7f6e0c159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0a59c640 1 -- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e0c15d1d0 msgr2=0x7f6e0c0afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0a59c640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e0c15d1d0 0x7f6e0c0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0a59c640 1 -- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e0c15c030 msgr2=0x7f6e0c159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0a59c640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e0c15c030 0x7f6e0c159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0a59c640 1 -- 172.21.15.67:0/1564315664 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c148580 con 0x7f6e0c0b3510 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e0a59c640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b3510 0x7f6e0c148040 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00c7f0 tx=0x7f6dfc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e02ffd640 1 -- 172.21.15.67:0/1564315664 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc015070 con 0x7f6e0c0b3510 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e02ffd640 1 -- 172.21.15.67:0/1564315664 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dfc004240 con 0x7f6e0c0b3510 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- 172.21.15.67:0/1564315664 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0c15b840 con 0x7f6e0c0b3510 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e02ffd640 1 -- 172.21.15.67:0/1564315664 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc003620 con 0x7f6e0c0b3510 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.561+0000 7f6e10ffd640 1 -- 172.21.15.67:0/1564315664 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e0c0992c0 con 0x7f6e0c0b3510 2024-09-19T05:48:46.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.565+0000 7f6e10ffd640 1 -- 172.21.15.67:0/1564315664 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0c06dde0 con 0x7f6e0c0b3510 2024-09-19T05:48:46.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.565+0000 7f6e02ffd640 1 -- 172.21.15.67:0/1564315664 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6dfc0039d0 con 0x7f6e0c0b3510 2024-09-19T05:48:46.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.565+0000 7f6e02ffd640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6dec0678f0 0x7f6dec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.565+0000 7f6e02ffd640 1 -- 172.21.15.67:0/1564315664 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f6dfc085db0 con 0x7f6e0c0b3510 2024-09-19T05:48:46.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.565+0000 7f6e09d9b640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6dec0678f0 0x7f6dec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.565+0000 7f6e09d9b640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6dec0678f0 0x7f6dec069db0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6df40ae000 tx=0x7f6df40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:46.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.569+0000 7f6e02ffd640 1 -- 172.21.15.67:0/1564315664 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6dfc0567f0 con 0x7f6e0c0b3510 2024-09-19T05:48:46.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.769+0000 7f6e10ffd640 1 -- 172.21.15.67:0/1564315664 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e0c15cbd0 con 0x7f6e0c0b3510 2024-09-19T05:48:46.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.769+0000 7f6e02ffd640 1 -- 172.21.15.67:0/1564315664 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+5236 (secure 0 0 0) 0x7f6dfc0560f0 con 0x7f6e0c0b3510 2024-09-19T05:48:46.772 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:46.772 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":146,"btime":"2024-09-19T05:48:46:398467+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2335567881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2335567881},{"type":"v1","addr":"172.21.15.97:6837","nonce":2335567881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":8551,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1743099743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1743099743},{"type":"v1","addr":"172.21.15.97:6835","nonce":1743099743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":10839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/644096538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":644096538},{"type":"v1","addr":"172.21.15.67:6833","nonce":644096538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:48:42.753814+0000","modified":"2024-09-19T05:48:45.770434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10845":{"gid":10845,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1771202736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1771202736},{"type":"v1","addr":"172.21.15.67:6835","nonce":1771202736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10845,"qdb_cluster":[10845]},"id":14}]} 2024-09-19T05:48:46.772 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 146 2024-09-19T05:48:46.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 -- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6dec0678f0 msgr2=0x7f6dec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6dec0678f0 0x7f6dec069db0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6df40ae000 tx=0x7f6df40a7000 comp rx=0 tx=0).stop 2024-09-19T05:48:46.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 -- 172.21.15.67:0/1564315664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b3510 msgr2=0x7f6e0c148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b3510 0x7f6e0c148040 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00c7f0 tx=0x7f6dfc00ccb0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 -- 172.21.15.67:0/1564315664 shutdown_connections 2024-09-19T05:48:46.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f6dec0678f0 0x7f6dec069db0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e0c15d1d0 0x7f6e0c0afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e0c15c030 0x7f6e0c159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 --2- 172.21.15.67:0/1564315664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b3510 0x7f6e0c148040 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 -- 172.21.15.67:0/1564315664 >> 172.21.15.67:0/1564315664 conn(0x7f6e0c0d0080 msgr2=0x7f6e0c15e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:46.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 -- 172.21.15.67:0/1564315664 shutdown_connections 2024-09-19T05:48:46.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.773+0000 7f6e10ffd640 1 -- 172.21.15.67:0/1564315664 wait complete. 2024-09-19T05:48:46.791 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:48:46.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.913+0000 7f982147c640 1 Processor -- start 2024-09-19T05:48:46.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.913+0000 7f982147c640 1 -- start start 2024-09-19T05:48:46.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f982147c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15c030 0x7f981c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f982147c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f981c15d1d0 0x7f981c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f982147c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c06e3c0 con 0x7f981c0b3510 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f982147c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f981c06e6a0 con 0x7f981c15d1d0 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f982147c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f981c06e980 con 0x7f981c15c030 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f981b7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f981c0b3510 0x7f981c06f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55124/0 (socket says 172.21.15.67:55124) 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f981b7fe640 1 -- 172.21.15.67:0/4192071578 learned_addr learned my addr 172.21.15.67:0/4192071578 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f981affd640 1 --2- 172.21.15.67:0/4192071578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15c030 0x7f981c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f981a7fc640 1 --2- 172.21.15.67:0/4192071578 >> v2:172.21.15.97:3300/0 conn(0x7f981c15d1d0 0x7f981c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f9819ffb640 1 -- 172.21.15.67:0/4192071578 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143341458 0 0) 0x7f981c06e3c0 con 0x7f981c0b3510 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f9819ffb640 1 -- 172.21.15.67:0/4192071578 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9804003530 con 0x7f981c0b3510 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f9819ffb640 1 -- 172.21.15.67:0/4192071578 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1860026290 0 0) 0x7f9804003530 con 0x7f981c0b3510 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f981a7fc640 1 -- 172.21.15.67:0/4192071578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15c030 msgr2=0x7f981c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:46.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f981a7fc640 1 --2- 172.21.15.67:0/4192071578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15c030 0x7f981c06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f981a7fc640 1 -- 172.21.15.67:0/4192071578 >> v1:172.21.15.67:6789/0 conn(0x7f981c0b3510 legacy=0x7f981c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f981a7fc640 1 -- 172.21.15.67:0/4192071578 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c06ec60 con 0x7f981c15d1d0 2024-09-19T05:48:46.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f981a7fc640 1 --2- 172.21.15.67:0/4192071578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f981c15d1d0 0x7f981c0b2fd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f980c0097c0 tx=0x7f980c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b27f14b120555272 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:46.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f9819ffb640 1 -- 172.21.15.67:0/4192071578 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c0b0070 con 0x7f981c15d1d0 2024-09-19T05:48:46.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f9819ffb640 1 -- 172.21.15.67:0/4192071578 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c0ab400 con 0x7f981c15d1d0 2024-09-19T05:48:46.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.917+0000 7f9819ffb640 1 -- 172.21.15.67:0/4192071578 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814001a00 con 0x7f981c15d1d0 2024-09-19T05:48:46.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- 172.21.15.67:0/4192071578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f981c15d1d0 msgr2=0x7f981c0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 --2- 172.21.15.67:0/4192071578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f981c15d1d0 0x7f981c0b2fd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f980c0097c0 tx=0x7f980c01c390 comp rx=0 tx=0).stop 2024-09-19T05:48:46.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- 172.21.15.67:0/4192071578 shutdown_connections 2024-09-19T05:48:46.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 --2- 172.21.15.67:0/4192071578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f981c15d1d0 0x7f981c0b2fd0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 --2- 172.21.15.67:0/4192071578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15c030 0x7f981c06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- 172.21.15.67:0/4192071578 >> 172.21.15.67:0/4192071578 conn(0x7f981c0d0080 msgr2=0x7f981c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:46.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- 172.21.15.67:0/4192071578 shutdown_connections 2024-09-19T05:48:46.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- 172.21.15.67:0/4192071578 wait complete. 2024-09-19T05:48:46.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 Processor -- start 2024-09-19T05:48:46.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- start start 2024-09-19T05:48:46.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f981c0b3510 0x7f981c14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981c15c030 0x7f981c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15d1d0 0x7f981c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f981c15c590 con 0x7f981c15c030 2024-09-19T05:48:46.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f981c15c410 con 0x7f981c0b3510 2024-09-19T05:48:46.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f981c1690e0 con 0x7f981c15d1d0 2024-09-19T05:48:46.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981c15c030 0x7f981c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981c15c030 0x7f981c152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42474/0 (socket says 172.21.15.67:42474) 2024-09-19T05:48:46.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981a7fc640 1 -- 172.21.15.67:0/2201710913 learned_addr learned my addr 172.21.15.67:0/2201710913 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:46.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981affd640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f981c0b3510 0x7f981c14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981b7fe640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15d1d0 0x7f981c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981a7fc640 1 -- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15d1d0 msgr2=0x7f981c1530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981a7fc640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15d1d0 0x7f981c1530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981a7fc640 1 -- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f981c0b3510 msgr2=0x7f981c14d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:46.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981a7fc640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f981c0b3510 0x7f981c14d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:46.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981a7fc640 1 -- 172.21.15.67:0/2201710913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c164840 con 0x7f981c15c030 2024-09-19T05:48:46.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981b7fe640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15d1d0 0x7f981c1530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f981a7fc640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981c15c030 0x7f981c152b70 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f980c0ae040 tx=0x7f980c019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f98037fe640 1 -- 172.21.15.67:0/2201710913 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c0b0050 con 0x7f981c15c030 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f98037fe640 1 -- 172.21.15.67:0/2201710913 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c0b1040 con 0x7f981c15c030 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- 172.21.15.67:0/2201710913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c164ac0 con 0x7f981c15c030 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f98037fe640 1 -- 172.21.15.67:0/2201710913 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c003a30 con 0x7f981c15c030 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.921+0000 7f982147c640 1 -- 172.21.15.67:0/2201710913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c165080 con 0x7f981c15c030 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.925+0000 7f982147c640 1 -- 172.21.15.67:0/2201710913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981c06dde0 con 0x7f981c15c030 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.925+0000 7f98037fe640 1 -- 172.21.15.67:0/2201710913 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f980c0be020 con 0x7f981c15c030 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.925+0000 7f98037fe640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98080678c0 0x7f9808069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.925+0000 7f98037fe640 1 -- 172.21.15.67:0/2201710913 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f980c11faf0 con 0x7f981c15c030 2024-09-19T05:48:46.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.925+0000 7f981affd640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98080678c0 0x7f9808069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:46.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.925+0000 7f981affd640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98080678c0 0x7f9808069d80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9810009b60 tx=0x7f9810009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:46.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:46.929+0000 7f98037fe640 1 -- 172.21.15.67:0/2201710913 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f981c164840 con 0x7f981c15c030 2024-09-19T05:48:47.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.093+0000 7f982147c640 1 -- 172.21.15.67:0/2201710913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f981c0af810 con 0x7f981c15c030 2024-09-19T05:48:47.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f98037fe640 1 -- 172.21.15.67:0/2201710913 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) ==== 74+0+16908 (secure 0 0 0) 0x7f980c015fb0 con 0x7f981c15c030 2024-09-19T05:48:47.096 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:47.097 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":205,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:48:44.388270+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:48:40.426332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-19T05:48:41.753955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:48:47.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 -- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98080678c0 msgr2=0x7f9808069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98080678c0 0x7f9808069d80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9810009b60 tx=0x7f9810009190 comp rx=0 tx=0).stop 2024-09-19T05:48:47.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 -- 172.21.15.67:0/2201710913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981c15c030 msgr2=0x7f981c152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981c15c030 0x7f981c152b70 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f980c0ae040 tx=0x7f980c019130 comp rx=0 tx=0).stop 2024-09-19T05:48:47.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 -- 172.21.15.67:0/2201710913 shutdown_connections 2024-09-19T05:48:47.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f98080678c0 0x7f9808069d80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f981c15d1d0 0x7f981c1530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981c15c030 0x7f981c152b70 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 --2- 172.21.15.67:0/2201710913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f981c0b3510 0x7f981c14d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 -- 172.21.15.67:0/2201710913 >> 172.21.15.67:0/2201710913 conn(0x7f981c0d0080 msgr2=0x7f981c15d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:47.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 -- 172.21.15.67:0/2201710913 shutdown_connections 2024-09-19T05:48:47.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.097+0000 7f982147c640 1 -- 172.21.15.67:0/2201710913 wait complete. 2024-09-19T05:48:47.116 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:48:47.117 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:48:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f33714fd640 1 Processor -- start 2024-09-19T05:48:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f33714fd640 1 -- start start 2024-09-19T05:48:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f33714fd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f336c0d0720 0x7f336c0d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f33714fd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0cce90 0x7f336c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f33714fd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f336c071e50 con 0x7f336c15f830 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f33714fd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f336c0d10d0 con 0x7f336c0d0720 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f33714fd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f336c072130 con 0x7f336c0cce90 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f336a7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f336c0d0720 0x7f336c0d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f336affd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f336c15f830 0x7f336c0ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55134/0 (socket says 172.21.15.67:55134) 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f336affd640 1 -- 172.21.15.67:0/2385671519 learned_addr learned my addr 172.21.15.67:0/2385671519 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f336b7fe640 1 --2- 172.21.15.67:0/2385671519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0cce90 0x7f336c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f3369ffb640 1 -- 172.21.15.67:0/2385671519 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1108309954 0 0) 0x7f336c071e50 con 0x7f336c15f830 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f3369ffb640 1 -- 172.21.15.67:0/2385671519 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3358003530 con 0x7f336c15f830 2024-09-19T05:48:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f336a7fc640 1 -- 172.21.15.67:0/2385671519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0cce90 msgr2=0x7f336c0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f336a7fc640 1 --2- 172.21.15.67:0/2385671519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0cce90 0x7f336c0cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f336a7fc640 1 -- 172.21.15.67:0/2385671519 >> v1:172.21.15.67:6789/0 conn(0x7f336c15f830 legacy=0x7f336c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.241+0000 7f336a7fc640 1 -- 172.21.15.67:0/2385671519 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c070bd0 con 0x7f336c0d0720 2024-09-19T05:48:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f336a7fc640 1 --2- 172.21.15.67:0/2385671519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0d0720 0x7f336c0d0b90 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7f33540097c0 tx=0x7f335401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3755e6f6f405e475 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f3369ffb640 1 -- 172.21.15.67:0/2385671519 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540a7070 con 0x7f336c0d0720 2024-09-19T05:48:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f3369ffb640 1 -- 172.21.15.67:0/2385671519 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33540b0070 con 0x7f336c0d0720 2024-09-19T05:48:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f3369ffb640 1 -- 172.21.15.67:0/2385671519 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540ab890 con 0x7f336c0d0720 2024-09-19T05:48:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f33714fd640 1 -- 172.21.15.67:0/2385671519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0d0720 msgr2=0x7f336c0d0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f33714fd640 1 --2- 172.21.15.67:0/2385671519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0d0720 0x7f336c0d0b90 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7f33540097c0 tx=0x7f335401c470 comp rx=0 tx=0).stop 2024-09-19T05:48:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f33714fd640 1 -- 172.21.15.67:0/2385671519 shutdown_connections 2024-09-19T05:48:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f33714fd640 1 --2- 172.21.15.67:0/2385671519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0cce90 0x7f336c0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f33714fd640 1 --2- 172.21.15.67:0/2385671519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0d0720 0x7f336c0d0b90 unknown :-1 s=CLOSED pgs=2441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f33714fd640 1 -- 172.21.15.67:0/2385671519 >> 172.21.15.67:0/2385671519 conn(0x7f336c0d22d0 msgr2=0x7f336c0d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f33714fd640 1 -- 172.21.15.67:0/2385671519 shutdown_connections 2024-09-19T05:48:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.245+0000 7f33714fd640 1 -- 172.21.15.67:0/2385671519 wait complete. 2024-09-19T05:48:47.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 Processor -- start 2024-09-19T05:48:47.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 -- start start 2024-09-19T05:48:47.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0cce90 0x7f336c147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0d0720 0x7f336c0b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c15f830 0x7f336c0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f336c15fc10 con 0x7f336c0cce90 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f336c0b18a0 con 0x7f336c15f830 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f336c15fd90 con 0x7f336c0d0720 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0cce90 0x7f336c147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0cce90 0x7f336c147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42480/0 (socket says 172.21.15.67:42480) 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336affd640 1 -- 172.21.15.67:0/3218419505 learned_addr learned my addr 172.21.15.67:0/3218419505 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336a7fc640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0d0720 0x7f336c0b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336b7fe640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c15f830 0x7f336c0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336affd640 1 -- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0d0720 msgr2=0x7f336c0b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336affd640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0d0720 0x7f336c0b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336affd640 1 -- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c15f830 msgr2=0x7f336c0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336affd640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c15f830 0x7f336c0cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336affd640 1 -- 172.21.15.67:0/3218419505 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c0b5d50 con 0x7f336c0cce90 2024-09-19T05:48:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f336affd640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0cce90 0x7f336c147ee0 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f335c00cb40 tx=0x7f335c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33637fe640 1 -- 172.21.15.67:0/3218419505 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c017070 con 0x7f336c0cce90 2024-09-19T05:48:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33637fe640 1 -- 172.21.15.67:0/3218419505 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335c00aca0 con 0x7f336c0cce90 2024-09-19T05:48:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 -- 172.21.15.67:0/3218419505 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336c0b6030 con 0x7f336c0cce90 2024-09-19T05:48:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33637fe640 1 -- 172.21.15.67:0/3218419505 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c012620 con 0x7f336c0cce90 2024-09-19T05:48:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 -- 172.21.15.67:0/3218419505 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f336c0b65f0 con 0x7f336c0cce90 2024-09-19T05:48:47.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.249+0000 7f33714fd640 1 -- 172.21.15.67:0/3218419505 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336c0cd300 con 0x7f336c0cce90 2024-09-19T05:48:47.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.253+0000 7f33637fe640 1 -- 172.21.15.67:0/3218419505 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f335c01a070 con 0x7f336c0cce90 2024-09-19T05:48:47.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.253+0000 7f33637fe640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f334c0678f0 0x7f334c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.253+0000 7f33637fe640 1 -- 172.21.15.67:0/3218419505 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f335c085f50 con 0x7f336c0cce90 2024-09-19T05:48:47.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.253+0000 7f336a7fc640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f334c0678f0 0x7f334c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.253+0000 7f336a7fc640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f334c0678f0 0x7f334c069db0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f33540af000 tx=0x7f33540a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:47.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.257+0000 7f33637fe640 1 -- 172.21.15.67:0/3218419505 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f335c021020 con 0x7f336c0cce90 2024-09-19T05:48:47.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.413+0000 7f33714fd640 1 -- 172.21.15.67:0/3218419505 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f336c0d2ec0 con 0x7f334c0678f0 2024-09-19T05:48:47.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.433+0000 7f33637fe640 1 -- 172.21.15.67:0/3218419505 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246380 (secure 0 0 0) 0x7f336c0d2ec0 con 0x7f334c0678f0 2024-09-19T05:48:47.436 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:47.438 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:48:47.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 -- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f334c0678f0 msgr2=0x7f334c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f334c0678f0 0x7f334c069db0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f33540af000 tx=0x7f33540a7000 comp rx=0 tx=0).stop 2024-09-19T05:48:47.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 -- 172.21.15.67:0/3218419505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0cce90 msgr2=0x7f336c147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0cce90 0x7f336c147ee0 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f335c00cb40 tx=0x7f335c00a060 comp rx=0 tx=0).stop 2024-09-19T05:48:47.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 -- 172.21.15.67:0/3218419505 shutdown_connections 2024-09-19T05:48:47.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c15f830 0x7f336c0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f334c0678f0 0x7f334c069db0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0d0720 0x7f336c0b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 --2- 172.21.15.67:0/3218419505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0cce90 0x7f336c147ee0 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 -- 172.21.15.67:0/3218419505 >> 172.21.15.67:0/3218419505 conn(0x7f336c0d22d0 msgr2=0x7f336c0b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:47.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 -- 172.21.15.67:0/3218419505 shutdown_connections 2024-09-19T05:48:47.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.437+0000 7f33714fd640 1 -- 172.21.15.67:0/3218419505 wait complete. 2024-09-19T05:48:47.456 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":670,"stamp":"2024-09-19T05:48:45.433561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":548156,"kb_used_data":21064,"kb_used_omap":12,"kb_used_meta":526899,"kb_avail":754426564,"statfs":{"total":773094113280,"available":772532801536,"internally_reserved":0,"allocated":21569536,"data_stored":10802768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":539545137},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.073178"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.390703+0000","last_change":"2024-09-19T05:48:42.390703+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.390703+0000","last_undegraded":"2024-09-19T05:48:42.390703+0000","last_fullsized":"2024-09-19T05:48:42.390703+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.388660+0000","last_change":"2024-09-19T05:48:42.388660+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.388660+0000","last_undegraded":"2024-09-19T05:48:42.388660+0000","last_fullsized":"2024-09-19T05:48:42.388660+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.398878+0000","last_change":"2024-09-19T05:48:42.398878+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.398878+0000","last_undegraded":"2024-09-19T05:48:42.398878+0000","last_fullsized":"2024-09-19T05:48:42.398878+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.388063+0000","last_change":"2024-09-19T05:48:42.388063+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.388063+0000","last_undegraded":"2024-09-19T05:48:42.388063+0000","last_fullsized":"2024-09-19T05:48:42.388063+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.389524+0000","last_change":"2024-09-19T05:48:42.389524+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.389524+0000","last_undegraded":"2024-09-19T05:48:42.389524+0000","last_fullsized":"2024-09-19T05:48:42.389524+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383369+0000","last_change":"2024-09-19T05:48:42.383369+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383369+0000","last_undegraded":"2024-09-19T05:48:42.383369+0000","last_fullsized":"2024-09-19T05:48:42.383369+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.394371+0000","last_change":"2024-09-19T05:48:42.394371+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.394371+0000","last_undegraded":"2024-09-19T05:48:42.394371+0000","last_fullsized":"2024-09-19T05:48:42.394371+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.381725+0000","last_change":"2024-09-19T05:48:42.381725+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.381725+0000","last_undegraded":"2024-09-19T05:48:42.381725+0000","last_fullsized":"2024-09-19T05:48:42.381725+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.399645+0000","last_change":"2024-09-19T05:48:42.399645+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.399645+0000","last_undegraded":"2024-09-19T05:48:42.399645+0000","last_fullsized":"2024-09-19T05:48:42.399645+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.397789+0000","last_change":"2024-09-19T05:48:42.397789+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.397789+0000","last_undegraded":"2024-09-19T05:48:42.397789+0000","last_fullsized":"2024-09-19T05:48:42.397789+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.390013+0000","last_change":"2024-09-19T05:48:42.390013+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.390013+0000","last_undegraded":"2024-09-19T05:48:42.390013+0000","last_fullsized":"2024-09-19T05:48:42.390013+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.405386+0000","last_change":"2024-09-19T05:48:42.405386+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.405386+0000","last_undegraded":"2024-09-19T05:48:42.405386+0000","last_fullsized":"2024-09-19T05:48:42.405386+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.379145+0000","last_change":"2024-09-19T05:48:42.379145+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.379145+0000","last_undegraded":"2024-09-19T05:48:42.379145+0000","last_fullsized":"2024-09-19T05:48:42.379145+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.402774+0000","last_change":"2024-09-19T05:48:42.402774+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.402774+0000","last_undegraded":"2024-09-19T05:48:42.402774+0000","last_fullsized":"2024-09-19T05:48:42.402774+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.380801+0000","last_change":"2024-09-19T05:48:42.380801+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.380801+0000","last_undegraded":"2024-09-19T05:48:42.380801+0000","last_fullsized":"2024-09-19T05:48:42.380801+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.380643+0000","last_change":"2024-09-19T05:48:42.380643+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.380643+0000","last_undegraded":"2024-09-19T05:48:42.380643+0000","last_fullsized":"2024-09-19T05:48:42.380643+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.405237+0000","last_change":"2024-09-19T05:48:42.405237+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.405237+0000","last_undegraded":"2024-09-19T05:48:42.405237+0000","last_fullsized":"2024-09-19T05:48:42.405237+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.396695+0000","last_change":"2024-09-19T05:48:42.396695+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.396695+0000","last_undegraded":"2024-09-19T05:48:42.396695+0000","last_fullsized":"2024-09-19T05:48:42.396695+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.395083+0000","last_change":"2024-09-19T05:48:42.395083+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.395083+0000","last_undegraded":"2024-09-19T05:48:42.395083+0000","last_fullsized":"2024-09-19T05:48:42.395083+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.381075+0000","last_change":"2024-09-19T05:48:42.381075+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.381075+0000","last_undegraded":"2024-09-19T05:48:42.381075+0000","last_fullsized":"2024-09-19T05:48:42.381075+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.393132+0000","last_change":"2024-09-19T05:48:42.393132+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.393132+0000","last_undegraded":"2024-09-19T05:48:42.393132+0000","last_fullsized":"2024-09-19T05:48:42.393132+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382859+0000","last_change":"2024-09-19T05:48:42.382859+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382859+0000","last_undegraded":"2024-09-19T05:48:42.382859+0000","last_fullsized":"2024-09-19T05:48:42.382859+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.398031+0000","last_change":"2024-09-19T05:48:42.398031+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.398031+0000","last_undegraded":"2024-09-19T05:48:42.398031+0000","last_fullsized":"2024-09-19T05:48:42.398031+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.389385+0000","last_change":"2024-09-19T05:48:42.389385+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.389385+0000","last_undegraded":"2024-09-19T05:48:42.389385+0000","last_fullsized":"2024-09-19T05:48:42.389385+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.389608+0000","last_change":"2024-09-19T05:48:42.389608+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.389608+0000","last_undegraded":"2024-09-19T05:48:42.389608+0000","last_fullsized":"2024-09-19T05:48:42.389608+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.395520+0000","last_change":"2024-09-19T05:48:42.395520+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.395520+0000","last_undegraded":"2024-09-19T05:48:42.395520+0000","last_fullsized":"2024-09-19T05:48:42.395520+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387834+0000","last_change":"2024-09-19T05:48:42.387834+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387834+0000","last_undegraded":"2024-09-19T05:48:42.387834+0000","last_fullsized":"2024-09-19T05:48:42.387834+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.402429+0000","last_change":"2024-09-19T05:48:42.402429+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.402429+0000","last_undegraded":"2024-09-19T05:48:42.402429+0000","last_fullsized":"2024-09-19T05:48:42.402429+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387413+0000","last_change":"2024-09-19T05:48:42.387413+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387413+0000","last_undegraded":"2024-09-19T05:48:42.387413+0000","last_fullsized":"2024-09-19T05:48:42.387413+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384409+0000","last_change":"2024-09-19T05:48:42.384409+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384409+0000","last_undegraded":"2024-09-19T05:48:42.384409+0000","last_fullsized":"2024-09-19T05:48:42.384409+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387413+0000","last_change":"2024-09-19T05:48:42.387413+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387413+0000","last_undegraded":"2024-09-19T05:48:42.387413+0000","last_fullsized":"2024-09-19T05:48:42.387413+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.378949+0000","last_change":"2024-09-19T05:48:42.378949+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.378949+0000","last_undegraded":"2024-09-19T05:48:42.378949+0000","last_fullsized":"2024-09-19T05:48:42.378949+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383884+0000","last_change":"2024-09-19T05:48:42.383884+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383884+0000","last_undegraded":"2024-09-19T05:48:42.383884+0000","last_fullsized":"2024-09-19T05:48:42.383884+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.409830+0000","last_change":"2024-09-19T05:48:42.408182+0000","last_active":"2024-09-19T05:48:42.409830+0000","last_peered":"2024-09-19T05:48:42.409830+0000","last_clean":"2024-09-19T05:48:42.409830+0000","last_became_active":"2024-09-19T05:48:42.407894+0000","last_became_peered":"2024-09-19T05:48:42.407894+0000","last_unstale":"2024-09-19T05:48:42.409830+0000","last_undegraded":"2024-09-19T05:48:42.409830+0000","last_fullsized":"2024-09-19T05:48:42.409830+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:26.752644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382803+0000","last_change":"2024-09-19T05:48:42.382803+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382803+0000","last_undegraded":"2024-09-19T05:48:42.382803+0000","last_fullsized":"2024-09-19T05:48:42.382803+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.427119+0000","last_change":"2024-09-19T05:48:42.418659+0000","last_active":"2024-09-19T05:48:42.427119+0000","last_peered":"2024-09-19T05:48:42.427119+0000","last_clean":"2024-09-19T05:48:42.427119+0000","last_became_active":"2024-09-19T05:48:42.412905+0000","last_became_peered":"2024-09-19T05:48:42.412905+0000","last_unstale":"2024-09-19T05:48:42.427119+0000","last_undegraded":"2024-09-19T05:48:42.427119+0000","last_fullsized":"2024-09-19T05:48:42.427119+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:58.307080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.385801+0000","last_change":"2024-09-19T05:48:42.385801+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.385801+0000","last_undegraded":"2024-09-19T05:48:42.385801+0000","last_fullsized":"2024-09-19T05:48:42.385801+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.414241+0000","last_change":"2024-09-19T05:48:42.411654+0000","last_active":"2024-09-19T05:48:42.414241+0000","last_peered":"2024-09-19T05:48:42.414241+0000","last_clean":"2024-09-19T05:48:42.414241+0000","last_became_active":"2024-09-19T05:48:42.410979+0000","last_became_peered":"2024-09-19T05:48:42.410979+0000","last_unstale":"2024-09-19T05:48:42.414241+0000","last_undegraded":"2024-09-19T05:48:42.414241+0000","last_fullsized":"2024-09-19T05:48:42.414241+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:21.609538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383959+0000","last_change":"2024-09-19T05:48:42.383959+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383959+0000","last_undegraded":"2024-09-19T05:48:42.383959+0000","last_fullsized":"2024-09-19T05:48:42.383959+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":3,"reported_epoch":203,"state":"creating+activating","last_fresh":"2024-09-19T05:48:42.374848+0000","last_change":"2024-09-19T05:48:42.374848+0000","last_active":"2024-09-19T05:48:41.355296+0000","last_peered":"2024-09-19T05:48:41.355296+0000","last_clean":"2024-09-19T05:48:41.355296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.374848+0000","last_undegraded":"2024-09-19T05:48:42.374848+0000","last_fullsized":"2024-09-19T05:48:42.374848+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.386208+0000","last_change":"2024-09-19T05:48:42.386208+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.386208+0000","last_undegraded":"2024-09-19T05:48:42.386208+0000","last_fullsized":"2024-09-19T05:48:42.386208+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-19T05:48:41.374050+0000","last_change":"2024-09-19T05:48:41.374050+0000","last_active":"2024-09-19T05:48:41.355296+0000","last_peered":"2024-09-19T05:48:41.355296+0000","last_clean":"2024-09-19T05:48:41.355296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:41.374050+0000","last_undegraded":"2024-09-19T05:48:41.374050+0000","last_fullsized":"2024-09-19T05:48:41.374050+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.380752+0000","last_change":"2024-09-19T05:48:42.380752+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.380752+0000","last_undegraded":"2024-09-19T05:48:42.380752+0000","last_fullsized":"2024-09-19T05:48:42.380752+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.435632+0000","last_change":"2024-09-19T05:48:42.434205+0000","last_active":"2024-09-19T05:48:42.435632+0000","last_peered":"2024-09-19T05:48:42.435632+0000","last_clean":"2024-09-19T05:48:42.435632+0000","last_became_active":"2024-09-19T05:48:42.433523+0000","last_became_peered":"2024-09-19T05:48:42.433523+0000","last_unstale":"2024-09-19T05:48:42.435632+0000","last_undegraded":"2024-09-19T05:48:42.435632+0000","last_fullsized":"2024-09-19T05:48:42.435632+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:08.007103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384392+0000","last_change":"2024-09-19T05:48:42.384392+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384392+0000","last_undegraded":"2024-09-19T05:48:42.384392+0000","last_fullsized":"2024-09-19T05:48:42.384392+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.404599+0000","last_change":"2024-09-19T05:48:42.403566+0000","last_active":"2024-09-19T05:48:42.404599+0000","last_peered":"2024-09-19T05:48:42.404599+0000","last_clean":"2024-09-19T05:48:42.404599+0000","last_became_active":"2024-09-19T05:48:42.403314+0000","last_became_peered":"2024-09-19T05:48:42.403314+0000","last_unstale":"2024-09-19T05:48:42.404599+0000","last_undegraded":"2024-09-19T05:48:42.404599+0000","last_fullsized":"2024-09-19T05:48:42.404599+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:48.481362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.381055+0000","last_change":"2024-09-19T05:48:42.381055+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.381055+0000","last_undegraded":"2024-09-19T05:48:42.381055+0000","last_fullsized":"2024-09-19T05:48:42.381055+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-19T05:48:41.373934+0000","last_change":"2024-09-19T05:48:41.373934+0000","last_active":"2024-09-19T05:48:41.355296+0000","last_peered":"2024-09-19T05:48:41.355296+0000","last_clean":"2024-09-19T05:48:41.355296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:41.373934+0000","last_undegraded":"2024-09-19T05:48:41.373934+0000","last_fullsized":"2024-09-19T05:48:41.373934+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.380550+0000","last_change":"2024-09-19T05:48:42.380550+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.380550+0000","last_undegraded":"2024-09-19T05:48:42.380550+0000","last_fullsized":"2024-09-19T05:48:42.380550+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.435514+0000","last_change":"2024-09-19T05:48:42.433952+0000","last_active":"2024-09-19T05:48:42.435514+0000","last_peered":"2024-09-19T05:48:42.435514+0000","last_clean":"2024-09-19T05:48:42.435514+0000","last_became_active":"2024-09-19T05:48:42.433338+0000","last_became_peered":"2024-09-19T05:48:42.433338+0000","last_unstale":"2024-09-19T05:48:42.435514+0000","last_undegraded":"2024-09-19T05:48:42.435514+0000","last_fullsized":"2024-09-19T05:48:42.435514+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:15.640473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384235+0000","last_change":"2024-09-19T05:48:42.384235+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384235+0000","last_undegraded":"2024-09-19T05:48:42.384235+0000","last_fullsized":"2024-09-19T05:48:42.384235+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-19T05:48:41.374166+0000","last_change":"2024-09-19T05:48:41.374166+0000","last_active":"2024-09-19T05:48:41.355296+0000","last_peered":"2024-09-19T05:48:41.355296+0000","last_clean":"2024-09-19T05:48:41.355296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:41.374166+0000","last_undegraded":"2024-09-19T05:48:41.374166+0000","last_fullsized":"2024-09-19T05:48:41.374166+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387790+0000","last_change":"2024-09-19T05:48:42.387790+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387790+0000","last_undegraded":"2024-09-19T05:48:42.387790+0000","last_fullsized":"2024-09-19T05:48:42.387790+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.416978+0000","last_change":"2024-09-19T05:48:42.413681+0000","last_active":"2024-09-19T05:48:42.416978+0000","last_peered":"2024-09-19T05:48:42.416978+0000","last_clean":"2024-09-19T05:48:42.416978+0000","last_became_active":"2024-09-19T05:48:42.412962+0000","last_became_peered":"2024-09-19T05:48:42.412962+0000","last_unstale":"2024-09-19T05:48:42.416978+0000","last_undegraded":"2024-09-19T05:48:42.416978+0000","last_fullsized":"2024-09-19T05:48:42.416978+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:35.853981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.385571+0000","last_change":"2024-09-19T05:48:42.385571+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.385571+0000","last_undegraded":"2024-09-19T05:48:42.385571+0000","last_fullsized":"2024-09-19T05:48:42.385571+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":8,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.431123+0000","last_change":"2024-09-19T05:48:42.431123+0000","last_active":"2024-09-19T05:48:42.431123+0000","last_peered":"2024-09-19T05:48:42.431123+0000","last_clean":"2024-09-19T05:48:42.431123+0000","last_became_active":"2024-09-19T05:48:42.429778+0000","last_became_peered":"2024-09-19T05:48:42.429778+0000","last_unstale":"2024-09-19T05:48:42.431123+0000","last_undegraded":"2024-09-19T05:48:42.431123+0000","last_fullsized":"2024-09-19T05:48:42.431123+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:31.276539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.385116+0000","last_change":"2024-09-19T05:48:42.385116+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.385116+0000","last_undegraded":"2024-09-19T05:48:42.385116+0000","last_fullsized":"2024-09-19T05:48:42.385116+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":3,"reported_epoch":203,"state":"creating+activating","last_fresh":"2024-09-19T05:48:42.386437+0000","last_change":"2024-09-19T05:48:42.386437+0000","last_active":"2024-09-19T05:48:41.355296+0000","last_peered":"2024-09-19T05:48:41.355296+0000","last_clean":"2024-09-19T05:48:41.355296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.386437+0000","last_undegraded":"2024-09-19T05:48:42.386437+0000","last_fullsized":"2024-09-19T05:48:42.386437+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382692+0000","last_change":"2024-09-19T05:48:42.382692+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382692+0000","last_undegraded":"2024-09-19T05:48:42.382692+0000","last_fullsized":"2024-09-19T05:48:42.382692+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.408807+0000","last_change":"2024-09-19T05:48:42.407613+0000","last_active":"2024-09-19T05:48:42.408807+0000","last_peered":"2024-09-19T05:48:42.408807+0000","last_clean":"2024-09-19T05:48:42.408807+0000","last_became_active":"2024-09-19T05:48:42.406711+0000","last_became_peered":"2024-09-19T05:48:42.406711+0000","last_unstale":"2024-09-19T05:48:42.408807+0000","last_undegraded":"2024-09-19T05:48:42.408807+0000","last_fullsized":"2024-09-19T05:48:42.408807+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:39.135197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.381127+0000","last_change":"2024-09-19T05:48:42.381127+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.381127+0000","last_undegraded":"2024-09-19T05:48:42.381127+0000","last_fullsized":"2024-09-19T05:48:42.381127+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":6,"reported_epoch":203,"state":"active","last_fresh":"2024-09-19T05:48:42.431126+0000","last_change":"2024-09-19T05:48:42.430952+0000","last_active":"2024-09-19T05:48:42.431126+0000","last_peered":"2024-09-19T05:48:42.431126+0000","last_clean":"2024-09-19T05:48:41.355296+0000","last_became_active":"2024-09-19T05:48:42.430952+0000","last_became_peered":"2024-09-19T05:48:42.430952+0000","last_unstale":"2024-09-19T05:48:42.431126+0000","last_undegraded":"2024-09-19T05:48:42.431126+0000","last_fullsized":"2024-09-19T05:48:42.431126+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.390097+0000","last_change":"2024-09-19T05:48:42.390097+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.390097+0000","last_undegraded":"2024-09-19T05:48:42.390097+0000","last_fullsized":"2024-09-19T05:48:42.390097+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.421422+0000","last_change":"2024-09-19T05:48:42.420938+0000","last_active":"2024-09-19T05:48:42.421422+0000","last_peered":"2024-09-19T05:48:42.421422+0000","last_clean":"2024-09-19T05:48:42.421422+0000","last_became_active":"2024-09-19T05:48:42.420638+0000","last_became_peered":"2024-09-19T05:48:42.420638+0000","last_unstale":"2024-09-19T05:48:42.421422+0000","last_undegraded":"2024-09-19T05:48:42.421422+0000","last_fullsized":"2024-09-19T05:48:42.421422+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:00.623412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.390875+0000","last_change":"2024-09-19T05:48:42.390875+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.390875+0000","last_undegraded":"2024-09-19T05:48:42.390875+0000","last_fullsized":"2024-09-19T05:48:42.390875+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.410637+0000","last_change":"2024-09-19T05:48:42.409982+0000","last_active":"2024-09-19T05:48:42.410637+0000","last_peered":"2024-09-19T05:48:42.410637+0000","last_clean":"2024-09-19T05:48:42.410637+0000","last_became_active":"2024-09-19T05:48:42.409215+0000","last_became_peered":"2024-09-19T05:48:42.409215+0000","last_unstale":"2024-09-19T05:48:42.410637+0000","last_undegraded":"2024-09-19T05:48:42.410637+0000","last_fullsized":"2024-09-19T05:48:42.410637+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:47.160673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383136+0000","last_change":"2024-09-19T05:48:42.383136+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383136+0000","last_undegraded":"2024-09-19T05:48:42.383136+0000","last_fullsized":"2024-09-19T05:48:42.383136+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":8,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.421032+0000","last_change":"2024-09-19T05:48:42.421032+0000","last_active":"2024-09-19T05:48:42.421032+0000","last_peered":"2024-09-19T05:48:42.421032+0000","last_clean":"2024-09-19T05:48:42.421032+0000","last_became_active":"2024-09-19T05:48:42.420242+0000","last_became_peered":"2024-09-19T05:48:42.420242+0000","last_unstale":"2024-09-19T05:48:42.421032+0000","last_undegraded":"2024-09-19T05:48:42.421032+0000","last_fullsized":"2024-09-19T05:48:42.421032+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:46.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387198+0000","last_change":"2024-09-19T05:48:42.387198+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387198+0000","last_undegraded":"2024-09-19T05:48:42.387198+0000","last_fullsized":"2024-09-19T05:48:42.387198+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":8,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.426287+0000","last_change":"2024-09-19T05:48:42.426287+0000","last_active":"2024-09-19T05:48:42.426287+0000","last_peered":"2024-09-19T05:48:42.426287+0000","last_clean":"2024-09-19T05:48:42.426287+0000","last_became_active":"2024-09-19T05:48:42.425397+0000","last_became_peered":"2024-09-19T05:48:42.425397+0000","last_unstale":"2024-09-19T05:48:42.426287+0000","last_undegraded":"2024-09-19T05:48:42.426287+0000","last_fullsized":"2024-09-19T05:48:42.426287+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:48.185434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.386556+0000","last_change":"2024-09-19T05:48:42.386556+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.386556+0000","last_undegraded":"2024-09-19T05:48:42.386556+0000","last_fullsized":"2024-09-19T05:48:42.386556+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":8,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.426204+0000","last_change":"2024-09-19T05:48:42.426204+0000","last_active":"2024-09-19T05:48:42.426204+0000","last_peered":"2024-09-19T05:48:42.426204+0000","last_clean":"2024-09-19T05:48:42.426204+0000","last_became_active":"2024-09-19T05:48:42.413060+0000","last_became_peered":"2024-09-19T05:48:42.413060+0000","last_unstale":"2024-09-19T05:48:42.426204+0000","last_undegraded":"2024-09-19T05:48:42.426204+0000","last_fullsized":"2024-09-19T05:48:42.426204+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:34.824655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.389884+0000","last_change":"2024-09-19T05:48:42.389884+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.389884+0000","last_undegraded":"2024-09-19T05:48:42.389884+0000","last_fullsized":"2024-09-19T05:48:42.389884+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.396006+0000","last_change":"2024-09-19T05:48:42.394779+0000","last_active":"2024-09-19T05:48:42.396006+0000","last_peered":"2024-09-19T05:48:42.396006+0000","last_clean":"2024-09-19T05:48:42.396006+0000","last_became_active":"2024-09-19T05:48:42.392507+0000","last_became_peered":"2024-09-19T05:48:42.392507+0000","last_unstale":"2024-09-19T05:48:42.396006+0000","last_undegraded":"2024-09-19T05:48:42.396006+0000","last_fullsized":"2024-09-19T05:48:42.396006+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:58.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.385594+0000","last_change":"2024-09-19T05:48:42.385594+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.385594+0000","last_undegraded":"2024-09-19T05:48:42.385594+0000","last_fullsized":"2024-09-19T05:48:42.385594+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":3,"reported_epoch":203,"state":"creating+activating","last_fresh":"2024-09-19T05:48:42.374621+0000","last_change":"2024-09-19T05:48:42.374621+0000","last_active":"2024-09-19T05:48:41.355296+0000","last_peered":"2024-09-19T05:48:41.355296+0000","last_clean":"2024-09-19T05:48:41.355296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.374621+0000","last_undegraded":"2024-09-19T05:48:42.374621+0000","last_fullsized":"2024-09-19T05:48:42.374621+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383047+0000","last_change":"2024-09-19T05:48:42.383047+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383047+0000","last_undegraded":"2024-09-19T05:48:42.383047+0000","last_fullsized":"2024-09-19T05:48:42.383047+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.408375+0000","last_change":"2024-09-19T05:48:42.402825+0000","last_active":"2024-09-19T05:48:42.408375+0000","last_peered":"2024-09-19T05:48:42.408375+0000","last_clean":"2024-09-19T05:48:42.408375+0000","last_became_active":"2024-09-19T05:48:42.402113+0000","last_became_peered":"2024-09-19T05:48:42.402113+0000","last_unstale":"2024-09-19T05:48:42.408375+0000","last_undegraded":"2024-09-19T05:48:42.408375+0000","last_fullsized":"2024-09-19T05:48:42.408375+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:02.018087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.385631+0000","last_change":"2024-09-19T05:48:42.385631+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.385631+0000","last_undegraded":"2024-09-19T05:48:42.385631+0000","last_fullsized":"2024-09-19T05:48:42.385631+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":8,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.430481+0000","last_change":"2024-09-19T05:48:42.430481+0000","last_active":"2024-09-19T05:48:42.430481+0000","last_peered":"2024-09-19T05:48:42.430481+0000","last_clean":"2024-09-19T05:48:42.430481+0000","last_became_active":"2024-09-19T05:48:42.429578+0000","last_became_peered":"2024-09-19T05:48:42.429578+0000","last_unstale":"2024-09-19T05:48:42.430481+0000","last_undegraded":"2024-09-19T05:48:42.430481+0000","last_fullsized":"2024-09-19T05:48:42.430481+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:36.559427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.389703+0000","last_change":"2024-09-19T05:48:42.389703+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.389703+0000","last_undegraded":"2024-09-19T05:48:42.389703+0000","last_fullsized":"2024-09-19T05:48:42.389703+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":3,"reported_epoch":203,"state":"creating+activating","last_fresh":"2024-09-19T05:48:42.374895+0000","last_change":"2024-09-19T05:48:42.374895+0000","last_active":"2024-09-19T05:48:41.355296+0000","last_peered":"2024-09-19T05:48:41.355296+0000","last_clean":"2024-09-19T05:48:41.355296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.374895+0000","last_undegraded":"2024-09-19T05:48:42.374895+0000","last_fullsized":"2024-09-19T05:48:42.374895+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.379070+0000","last_change":"2024-09-19T05:48:42.379070+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.379070+0000","last_undegraded":"2024-09-19T05:48:42.379070+0000","last_fullsized":"2024-09-19T05:48:42.379070+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.393688+0000","last_change":"2024-09-19T05:48:42.392461+0000","last_active":"2024-09-19T05:48:42.393688+0000","last_peered":"2024-09-19T05:48:42.393688+0000","last_clean":"2024-09-19T05:48:42.393688+0000","last_became_active":"2024-09-19T05:48:42.392083+0000","last_became_peered":"2024-09-19T05:48:42.392083+0000","last_unstale":"2024-09-19T05:48:42.393688+0000","last_undegraded":"2024-09-19T05:48:42.393688+0000","last_fullsized":"2024-09-19T05:48:42.393688+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:07.874926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.386365+0000","last_change":"2024-09-19T05:48:42.386365+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.386365+0000","last_undegraded":"2024-09-19T05:48:42.386365+0000","last_fullsized":"2024-09-19T05:48:42.386365+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.429638+0000","last_change":"2024-09-19T05:48:42.412842+0000","last_active":"2024-09-19T05:48:42.429638+0000","last_peered":"2024-09-19T05:48:42.429638+0000","last_clean":"2024-09-19T05:48:42.429638+0000","last_became_active":"2024-09-19T05:48:42.412103+0000","last_became_peered":"2024-09-19T05:48:42.412103+0000","last_unstale":"2024-09-19T05:48:42.429638+0000","last_undegraded":"2024-09-19T05:48:42.429638+0000","last_fullsized":"2024-09-19T05:48:42.429638+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:01:24.822377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383350+0000","last_change":"2024-09-19T05:48:42.383350+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383350+0000","last_undegraded":"2024-09-19T05:48:42.383350+0000","last_fullsized":"2024-09-19T05:48:42.383350+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":8,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.429925+0000","last_change":"2024-09-19T05:48:42.429925+0000","last_active":"2024-09-19T05:48:42.429925+0000","last_peered":"2024-09-19T05:48:42.429925+0000","last_clean":"2024-09-19T05:48:42.429925+0000","last_became_active":"2024-09-19T05:48:42.426314+0000","last_became_peered":"2024-09-19T05:48:42.426314+0000","last_unstale":"2024-09-19T05:48:42.429925+0000","last_undegraded":"2024-09-19T05:48:42.429925+0000","last_fullsized":"2024-09-19T05:48:42.429925+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:22.394430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382366+0000","last_change":"2024-09-19T05:48:42.382366+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382366+0000","last_undegraded":"2024-09-19T05:48:42.382366+0000","last_fullsized":"2024-09-19T05:48:42.382366+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.399269+0000","last_change":"2024-09-19T05:48:42.396864+0000","last_active":"2024-09-19T05:48:42.399269+0000","last_peered":"2024-09-19T05:48:42.399269+0000","last_clean":"2024-09-19T05:48:42.399269+0000","last_became_active":"2024-09-19T05:48:42.396113+0000","last_became_peered":"2024-09-19T05:48:42.396113+0000","last_unstale":"2024-09-19T05:48:42.399269+0000","last_undegraded":"2024-09-19T05:48:42.399269+0000","last_fullsized":"2024-09-19T05:48:42.399269+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:47.546752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.388465+0000","last_change":"2024-09-19T05:48:42.388465+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.388465+0000","last_undegraded":"2024-09-19T05:48:42.388465+0000","last_fullsized":"2024-09-19T05:48:42.388465+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-19T05:48:41.372651+0000","last_change":"2024-09-19T05:48:41.372651+0000","last_active":"2024-09-19T05:48:41.355296+0000","last_peered":"2024-09-19T05:48:41.355296+0000","last_clean":"2024-09-19T05:48:41.355296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:41.372651+0000","last_undegraded":"2024-09-19T05:48:41.372651+0000","last_fullsized":"2024-09-19T05:48:41.372651+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.405484+0000","last_change":"2024-09-19T05:48:42.405484+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.405484+0000","last_undegraded":"2024-09-19T05:48:42.405484+0000","last_fullsized":"2024-09-19T05:48:42.405484+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":8,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.430171+0000","last_change":"2024-09-19T05:48:42.430171+0000","last_active":"2024-09-19T05:48:42.430171+0000","last_peered":"2024-09-19T05:48:42.430171+0000","last_clean":"2024-09-19T05:48:42.430171+0000","last_became_active":"2024-09-19T05:48:42.427129+0000","last_became_peered":"2024-09-19T05:48:42.427129+0000","last_unstale":"2024-09-19T05:48:42.430171+0000","last_undegraded":"2024-09-19T05:48:42.430171+0000","last_fullsized":"2024-09-19T05:48:42.430171+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:50.040837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.399646+0000","last_change":"2024-09-19T05:48:42.399646+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.399646+0000","last_undegraded":"2024-09-19T05:48:42.399646+0000","last_fullsized":"2024-09-19T05:48:42.399646+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2024-09-19T05:48:41.372809+0000","last_change":"2024-09-19T05:48:41.372809+0000","last_active":"2024-09-19T05:48:41.355296+0000","last_peered":"2024-09-19T05:48:41.355296+0000","last_clean":"2024-09-19T05:48:41.355296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:41.372809+0000","last_undegraded":"2024-09-19T05:48:41.372809+0000","last_fullsized":"2024-09-19T05:48:41.372809+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":501,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-19T05:48:41.372898+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:48:41.372898+0000","last_peered":"2024-09-19T05:48:41.372898+0000","last_clean":"2024-09-19T05:48:41.372898+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:48:41.372898+0000","last_undegraded":"2024-09-19T05:48:41.372898+0000","last_fullsized":"2024-09-19T05:48:41.372898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542334,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74516,"kb_used_data":3068,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297324,"statfs":{"total":96636764160,"available":96560459776,"internally_reserved":0,"allocated":3141632,"data_stored":1793122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542334,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73932,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297908,"statfs":{"total":96636764160,"available":96561057792,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542336,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542334,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73932,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297908,"statfs":{"total":96636764160,"available":96561057792,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542335,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73868,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297972,"statfs":{"total":96636764160,"available":96561123328,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73932,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297908,"statfs":{"total":96636764160,"available":96561057792,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47564,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324276,"statfs":{"total":96636764160,"available":96588058624,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542334,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78684,"kb_used_data":3068,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293156,"statfs":{"total":96636764160,"available":96556191744,"internally_reserved":0,"allocated":3141632,"data_stored":1793122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:48:47.461 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:48:47.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.625+0000 7f0443415640 1 Processor -- start 2024-09-19T05:48:47.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.625+0000 7f0443415640 1 -- start start 2024-09-19T05:48:47.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.625+0000 7f0443415640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 0x7f043c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.625+0000 7f0443415640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f043c0ae8c0 0x7f043c0aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.625+0000 7f0443415640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043c0cd320 con 0x7f043c0ccee0 2024-09-19T05:48:47.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.625+0000 7f0443415640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f043c06e790 con 0x7f043c0ae8c0 2024-09-19T05:48:47.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.625+0000 7f0443415640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f043c06ea50 con 0x7f043c070140 2024-09-19T05:48:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04411b1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 0x7f043c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04419b2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f043c0ae8c0 0x7f043c0aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04409b0640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f043c0ccee0 0x7f043c070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:38056/0 (socket says 172.21.15.67:38056) 2024-09-19T05:48:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04419b2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f043c0ae8c0 0x7f043c0aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:45324/0 (socket says 172.21.15.67:45324) 2024-09-19T05:48:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04409b0640 1 -- 172.21.15.67:0/2351766165 learned_addr learned my addr 172.21.15.67:0/2351766165 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04411b1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 0x7f043c15f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:57494/0 (socket says 172.21.15.67:57494) 2024-09-19T05:48:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04419b2640 1 -- 172.21.15.67:0/2351766165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 msgr2=0x7f043c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04419b2640 1 --2- 172.21.15.67:0/2351766165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 0x7f043c15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04419b2640 1 -- 172.21.15.67:0/2351766165 >> v1:172.21.15.97:6789/0 conn(0x7f043c0ccee0 legacy=0x7f043c070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04419b2640 1 -- 172.21.15.67:0/2351766165 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c06ed30 con 0x7f043c0ae8c0 2024-09-19T05:48:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f04419b2640 1 --2- 172.21.15.67:0/2351766165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f043c0ae8c0 0x7f043c0aed70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0434009d90 tx=0x7f043401c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=641699d57f426720 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:47.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f0433fff640 1 -- 172.21.15.67:0/2351766165 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04340b2070 con 0x7f043c0ae8c0 2024-09-19T05:48:47.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f0433fff640 1 -- 172.21.15.67:0/2351766165 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04340a5970 con 0x7f043c0ae8c0 2024-09-19T05:48:47.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f0433fff640 1 -- 172.21.15.67:0/2351766165 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04340a5d40 con 0x7f043c0ae8c0 2024-09-19T05:48:47.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f0443415640 1 -- 172.21.15.67:0/2351766165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f043c0ae8c0 msgr2=0x7f043c0aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f0443415640 1 --2- 172.21.15.67:0/2351766165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f043c0ae8c0 0x7f043c0aed70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0434009d90 tx=0x7f043401c8b0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f0443415640 1 -- 172.21.15.67:0/2351766165 shutdown_connections 2024-09-19T05:48:47.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f0443415640 1 --2- 172.21.15.67:0/2351766165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f043c0ae8c0 0x7f043c0aed70 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f0443415640 1 --2- 172.21.15.67:0/2351766165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 0x7f043c15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f0443415640 1 -- 172.21.15.67:0/2351766165 >> 172.21.15.67:0/2351766165 conn(0x7f043c073500 msgr2=0x7f043c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:47.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.629+0000 7f0443415640 1 -- 172.21.15.67:0/2351766165 shutdown_connections 2024-09-19T05:48:47.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 -- 172.21.15.67:0/2351766165 wait complete. 2024-09-19T05:48:47.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 Processor -- start 2024-09-19T05:48:47.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 -- start start 2024-09-19T05:48:47.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 0x7f043c1f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f043c0ae8c0 0x7f043c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f043c0ccee0 0x7f043c0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f043c15c2e0 con 0x7f043c0ccee0 2024-09-19T05:48:47.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f043c15c160 con 0x7f043c0ae8c0 2024-09-19T05:48:47.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f043c16afc0 con 0x7f043c070140 2024-09-19T05:48:47.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04419b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f043c0ccee0 0x7f043c0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04419b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f043c0ccee0 0x7f043c0ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42490/0 (socket says 172.21.15.67:42490) 2024-09-19T05:48:47.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04419b2640 1 -- 172.21.15.67:0/3217194307 learned_addr learned my addr 172.21.15.67:0/3217194307 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:47.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04409b0640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f043c0ae8c0 0x7f043c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04411b1640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 0x7f043c1f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04419b2640 1 -- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 msgr2=0x7f043c1f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04419b2640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 0x7f043c1f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04419b2640 1 -- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f043c0ae8c0 msgr2=0x7f043c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04419b2640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f043c0ae8c0 0x7f043c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04419b2640 1 -- 172.21.15.67:0/3217194307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c15dd10 con 0x7f043c0ccee0 2024-09-19T05:48:47.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04411b1640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 0x7f043c1f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:47.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f04419b2640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f043c0ccee0 0x7f043c0ce410 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f04340b0040 tx=0x7f0434019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:47.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0431ffb640 1 -- 172.21.15.67:0/3217194307 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04340bd020 con 0x7f043c0ccee0 2024-09-19T05:48:47.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0431ffb640 1 -- 172.21.15.67:0/3217194307 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04340b8470 con 0x7f043c0ccee0 2024-09-19T05:48:47.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 -- 172.21.15.67:0/3217194307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043c0ce950 con 0x7f043c0ccee0 2024-09-19T05:48:47.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0431ffb640 1 -- 172.21.15.67:0/3217194307 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04340b2040 con 0x7f043c0ccee0 2024-09-19T05:48:47.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.633+0000 7f0443415640 1 -- 172.21.15.67:0/3217194307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043c0cd650 con 0x7f043c0ccee0 2024-09-19T05:48:47.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.637+0000 7f0443415640 1 -- 172.21.15.67:0/3217194307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f043c0b5ac0 con 0x7f043c0ccee0 2024-09-19T05:48:47.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.637+0000 7f0431ffb640 1 -- 172.21.15.67:0/3217194307 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04340c0020 con 0x7f043c0ccee0 2024-09-19T05:48:47.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.637+0000 7f0431ffb640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04200678f0 0x7f0420069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:47.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.637+0000 7f0431ffb640 1 -- 172.21.15.67:0/3217194307 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f0434120ba0 con 0x7f043c0ccee0 2024-09-19T05:48:47.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.637+0000 7f04411b1640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04200678f0 0x7f0420069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:47.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.637+0000 7f04411b1640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04200678f0 0x7f0420069db0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0438009a40 tx=0x7f0438008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:47.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.641+0000 7f0431ffb640 1 -- 172.21.15.67:0/3217194307 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f04340c7070 con 0x7f043c0ccee0 2024-09-19T05:48:47.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.805+0000 7f0443415640 1 -- 172.21.15.67:0/3217194307 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f043c156190 con 0x7f04200678f0 2024-09-19T05:48:47.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.821+0000 7f0431ffb640 1 -- 172.21.15.67:0/3217194307 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249651 (secure 0 0 0) 0x7f043c156190 con 0x7f04200678f0 2024-09-19T05:48:47.824 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:47.826 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 -- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04200678f0 msgr2=0x7f0420069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04200678f0 0x7f0420069db0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0438009a40 tx=0x7f0438008040 comp rx=0 tx=0).stop 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 -- 172.21.15.67:0/3217194307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f043c0ccee0 msgr2=0x7f043c0ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f043c0ccee0 0x7f043c0ce410 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f04340b0040 tx=0x7f0434019650 comp rx=0 tx=0).stop 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 -- 172.21.15.67:0/3217194307 shutdown_connections 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f043c0ccee0 0x7f043c0ce410 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f043c0ae8c0 0x7f043c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f04200678f0 0x7f0420069db0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 --2- 172.21.15.67:0/3217194307 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f043c070140 0x7f043c1f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 -- 172.21.15.67:0/3217194307 >> 172.21.15.67:0/3217194307 conn(0x7f043c073500 msgr2=0x7f043c0b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:47.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 -- 172.21.15.67:0/3217194307 shutdown_connections 2024-09-19T05:48:47.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:47.825+0000 7f0443415640 1 -- 172.21.15.67:0/3217194307 wait complete. 2024-09-19T05:48:47.844 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":671,"stamp":"2024-09-19T05:48:47.436345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590562,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":552492,"kb_used_data":21240,"kb_used_omap":12,"kb_used_meta":531059,"kb_avail":754422228,"statfs":{"total":773094113280,"available":772528361472,"internally_reserved":0,"allocated":21749760,"data_stored":10887282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":543804977},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.004006"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600294+0000","last_change":"2024-09-19T05:48:43.428484+0000","last_active":"2024-09-19T05:48:44.600294+0000","last_peered":"2024-09-19T05:48:44.600294+0000","last_clean":"2024-09-19T05:48:44.600294+0000","last_became_active":"2024-09-19T05:48:43.427731+0000","last_became_peered":"2024-09-19T05:48:43.427731+0000","last_unstale":"2024-09-19T05:48:44.600294+0000","last_undegraded":"2024-09-19T05:48:44.600294+0000","last_fullsized":"2024-09-19T05:48:44.600294+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:01.627681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783364+0000","last_change":"2024-09-19T05:48:43.406998+0000","last_active":"2024-09-19T05:48:44.783364+0000","last_peered":"2024-09-19T05:48:44.783364+0000","last_clean":"2024-09-19T05:48:44.783364+0000","last_became_active":"2024-09-19T05:48:43.404769+0000","last_became_peered":"2024-09-19T05:48:43.404769+0000","last_unstale":"2024-09-19T05:48:44.783364+0000","last_undegraded":"2024-09-19T05:48:44.783364+0000","last_fullsized":"2024-09-19T05:48:44.783364+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:13.589670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.398878+0000","last_change":"2024-09-19T05:48:42.398878+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.398878+0000","last_undegraded":"2024-09-19T05:48:42.398878+0000","last_fullsized":"2024-09-19T05:48:42.398878+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.388063+0000","last_change":"2024-09-19T05:48:42.388063+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.388063+0000","last_undegraded":"2024-09-19T05:48:42.388063+0000","last_fullsized":"2024-09-19T05:48:42.388063+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599773+0000","last_change":"2024-09-19T05:48:43.401953+0000","last_active":"2024-09-19T05:48:44.599773+0000","last_peered":"2024-09-19T05:48:44.599773+0000","last_clean":"2024-09-19T05:48:44.599773+0000","last_became_active":"2024-09-19T05:48:43.401185+0000","last_became_peered":"2024-09-19T05:48:43.401185+0000","last_unstale":"2024-09-19T05:48:44.599773+0000","last_undegraded":"2024-09-19T05:48:44.599773+0000","last_fullsized":"2024-09-19T05:48:44.599773+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:59.221775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383369+0000","last_change":"2024-09-19T05:48:42.383369+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383369+0000","last_undegraded":"2024-09-19T05:48:42.383369+0000","last_fullsized":"2024-09-19T05:48:42.383369+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.394371+0000","last_change":"2024-09-19T05:48:42.394371+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.394371+0000","last_undegraded":"2024-09-19T05:48:42.394371+0000","last_fullsized":"2024-09-19T05:48:42.394371+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.381725+0000","last_change":"2024-09-19T05:48:42.381725+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.381725+0000","last_undegraded":"2024-09-19T05:48:42.381725+0000","last_fullsized":"2024-09-19T05:48:42.381725+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.399645+0000","last_change":"2024-09-19T05:48:42.399645+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.399645+0000","last_undegraded":"2024-09-19T05:48:42.399645+0000","last_fullsized":"2024-09-19T05:48:42.399645+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.397789+0000","last_change":"2024-09-19T05:48:42.397789+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.397789+0000","last_undegraded":"2024-09-19T05:48:42.397789+0000","last_fullsized":"2024-09-19T05:48:42.397789+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.390013+0000","last_change":"2024-09-19T05:48:42.390013+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.390013+0000","last_undegraded":"2024-09-19T05:48:42.390013+0000","last_fullsized":"2024-09-19T05:48:42.390013+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868599+0000","last_change":"2024-09-19T05:48:43.445279+0000","last_active":"2024-09-19T05:48:44.868599+0000","last_peered":"2024-09-19T05:48:44.868599+0000","last_clean":"2024-09-19T05:48:44.868599+0000","last_became_active":"2024-09-19T05:48:43.443235+0000","last_became_peered":"2024-09-19T05:48:43.443235+0000","last_unstale":"2024-09-19T05:48:44.868599+0000","last_undegraded":"2024-09-19T05:48:44.868599+0000","last_fullsized":"2024-09-19T05:48:44.868599+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:12.067057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.379145+0000","last_change":"2024-09-19T05:48:42.379145+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.379145+0000","last_undegraded":"2024-09-19T05:48:42.379145+0000","last_fullsized":"2024-09-19T05:48:42.379145+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867568+0000","last_change":"2024-09-19T05:48:43.435859+0000","last_active":"2024-09-19T05:48:44.867568+0000","last_peered":"2024-09-19T05:48:44.867568+0000","last_clean":"2024-09-19T05:48:44.867568+0000","last_became_active":"2024-09-19T05:48:43.434858+0000","last_became_peered":"2024-09-19T05:48:43.434858+0000","last_unstale":"2024-09-19T05:48:44.867568+0000","last_undegraded":"2024-09-19T05:48:44.867568+0000","last_fullsized":"2024-09-19T05:48:44.867568+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.765450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400513+0000","last_change":"2024-09-19T05:48:43.405560+0000","last_active":"2024-09-19T05:48:44.400513+0000","last_peered":"2024-09-19T05:48:44.400513+0000","last_clean":"2024-09-19T05:48:44.400513+0000","last_became_active":"2024-09-19T05:48:43.405181+0000","last_became_peered":"2024-09-19T05:48:43.405181+0000","last_unstale":"2024-09-19T05:48:44.400513+0000","last_undegraded":"2024-09-19T05:48:44.400513+0000","last_fullsized":"2024-09-19T05:48:44.400513+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:39.032330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.380643+0000","last_change":"2024-09-19T05:48:42.380643+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.380643+0000","last_undegraded":"2024-09-19T05:48:42.380643+0000","last_fullsized":"2024-09-19T05:48:42.380643+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868635+0000","last_change":"2024-09-19T05:48:43.445682+0000","last_active":"2024-09-19T05:48:44.868635+0000","last_peered":"2024-09-19T05:48:44.868635+0000","last_clean":"2024-09-19T05:48:44.868635+0000","last_became_active":"2024-09-19T05:48:43.445097+0000","last_became_peered":"2024-09-19T05:48:43.445097+0000","last_unstale":"2024-09-19T05:48:44.868635+0000","last_undegraded":"2024-09-19T05:48:44.868635+0000","last_fullsized":"2024-09-19T05:48:44.868635+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:21.827527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.396695+0000","last_change":"2024-09-19T05:48:42.396695+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.396695+0000","last_undegraded":"2024-09-19T05:48:42.396695+0000","last_fullsized":"2024-09-19T05:48:42.396695+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599639+0000","last_change":"2024-09-19T05:48:43.419947+0000","last_active":"2024-09-19T05:48:44.599639+0000","last_peered":"2024-09-19T05:48:44.599639+0000","last_clean":"2024-09-19T05:48:44.599639+0000","last_became_active":"2024-09-19T05:48:43.408971+0000","last_became_peered":"2024-09-19T05:48:43.408971+0000","last_unstale":"2024-09-19T05:48:44.599639+0000","last_undegraded":"2024-09-19T05:48:44.599639+0000","last_fullsized":"2024-09-19T05:48:44.599639+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:56.260686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.381075+0000","last_change":"2024-09-19T05:48:42.381075+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.381075+0000","last_undegraded":"2024-09-19T05:48:42.381075+0000","last_fullsized":"2024-09-19T05:48:42.381075+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.393132+0000","last_change":"2024-09-19T05:48:42.393132+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.393132+0000","last_undegraded":"2024-09-19T05:48:42.393132+0000","last_fullsized":"2024-09-19T05:48:42.393132+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400253+0000","last_change":"2024-09-19T05:48:43.422670+0000","last_active":"2024-09-19T05:48:44.400253+0000","last_peered":"2024-09-19T05:48:44.400253+0000","last_clean":"2024-09-19T05:48:44.400253+0000","last_became_active":"2024-09-19T05:48:43.422215+0000","last_became_peered":"2024-09-19T05:48:43.422215+0000","last_unstale":"2024-09-19T05:48:44.400253+0000","last_undegraded":"2024-09-19T05:48:44.400253+0000","last_fullsized":"2024-09-19T05:48:44.400253+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:49.485630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.398031+0000","last_change":"2024-09-19T05:48:42.398031+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.398031+0000","last_undegraded":"2024-09-19T05:48:42.398031+0000","last_fullsized":"2024-09-19T05:48:42.398031+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599585+0000","last_change":"2024-09-19T05:48:43.402276+0000","last_active":"2024-09-19T05:48:44.599585+0000","last_peered":"2024-09-19T05:48:44.599585+0000","last_clean":"2024-09-19T05:48:44.599585+0000","last_became_active":"2024-09-19T05:48:43.401561+0000","last_became_peered":"2024-09-19T05:48:43.401561+0000","last_unstale":"2024-09-19T05:48:44.599585+0000","last_undegraded":"2024-09-19T05:48:44.599585+0000","last_fullsized":"2024-09-19T05:48:44.599585+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:50.285249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600487+0000","last_change":"2024-09-19T05:48:43.406290+0000","last_active":"2024-09-19T05:48:44.600487+0000","last_peered":"2024-09-19T05:48:44.600487+0000","last_clean":"2024-09-19T05:48:44.600487+0000","last_became_active":"2024-09-19T05:48:43.404595+0000","last_became_peered":"2024-09-19T05:48:43.404595+0000","last_unstale":"2024-09-19T05:48:44.600487+0000","last_undegraded":"2024-09-19T05:48:44.600487+0000","last_fullsized":"2024-09-19T05:48:44.600487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:58.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.395520+0000","last_change":"2024-09-19T05:48:42.395520+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.395520+0000","last_undegraded":"2024-09-19T05:48:42.395520+0000","last_fullsized":"2024-09-19T05:48:42.395520+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387834+0000","last_change":"2024-09-19T05:48:42.387834+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387834+0000","last_undegraded":"2024-09-19T05:48:42.387834+0000","last_fullsized":"2024-09-19T05:48:42.387834+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868077+0000","last_change":"2024-09-19T05:48:43.418863+0000","last_active":"2024-09-19T05:48:44.868077+0000","last_peered":"2024-09-19T05:48:44.868077+0000","last_clean":"2024-09-19T05:48:44.868077+0000","last_became_active":"2024-09-19T05:48:43.418168+0000","last_became_peered":"2024-09-19T05:48:43.418168+0000","last_unstale":"2024-09-19T05:48:44.868077+0000","last_undegraded":"2024-09-19T05:48:44.868077+0000","last_fullsized":"2024-09-19T05:48:44.868077+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:31.906285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783339+0000","last_change":"2024-09-19T05:48:43.414630+0000","last_active":"2024-09-19T05:48:44.783339+0000","last_peered":"2024-09-19T05:48:44.783339+0000","last_clean":"2024-09-19T05:48:44.783339+0000","last_became_active":"2024-09-19T05:48:43.414339+0000","last_became_peered":"2024-09-19T05:48:43.414339+0000","last_unstale":"2024-09-19T05:48:44.783339+0000","last_undegraded":"2024-09-19T05:48:44.783339+0000","last_fullsized":"2024-09-19T05:48:44.783339+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:28.950820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384409+0000","last_change":"2024-09-19T05:48:42.384409+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384409+0000","last_undegraded":"2024-09-19T05:48:42.384409+0000","last_fullsized":"2024-09-19T05:48:42.384409+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387413+0000","last_change":"2024-09-19T05:48:42.387413+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387413+0000","last_undegraded":"2024-09-19T05:48:42.387413+0000","last_fullsized":"2024-09-19T05:48:42.387413+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.378949+0000","last_change":"2024-09-19T05:48:42.378949+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.378949+0000","last_undegraded":"2024-09-19T05:48:42.378949+0000","last_fullsized":"2024-09-19T05:48:42.378949+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383884+0000","last_change":"2024-09-19T05:48:42.383884+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383884+0000","last_undegraded":"2024-09-19T05:48:42.383884+0000","last_fullsized":"2024-09-19T05:48:42.383884+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.409830+0000","last_change":"2024-09-19T05:48:42.408182+0000","last_active":"2024-09-19T05:48:42.409830+0000","last_peered":"2024-09-19T05:48:42.409830+0000","last_clean":"2024-09-19T05:48:42.409830+0000","last_became_active":"2024-09-19T05:48:42.407894+0000","last_became_peered":"2024-09-19T05:48:42.407894+0000","last_unstale":"2024-09-19T05:48:42.409830+0000","last_undegraded":"2024-09-19T05:48:42.409830+0000","last_fullsized":"2024-09-19T05:48:42.409830+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:26.752644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382803+0000","last_change":"2024-09-19T05:48:42.382803+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382803+0000","last_undegraded":"2024-09-19T05:48:42.382803+0000","last_fullsized":"2024-09-19T05:48:42.382803+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868507+0000","last_change":"2024-09-19T05:48:42.418659+0000","last_active":"2024-09-19T05:48:44.868507+0000","last_peered":"2024-09-19T05:48:44.868507+0000","last_clean":"2024-09-19T05:48:44.868507+0000","last_became_active":"2024-09-19T05:48:42.412905+0000","last_became_peered":"2024-09-19T05:48:42.412905+0000","last_unstale":"2024-09-19T05:48:44.868507+0000","last_undegraded":"2024-09-19T05:48:44.868507+0000","last_fullsized":"2024-09-19T05:48:44.868507+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:18.568117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868306+0000","last_change":"2024-09-19T05:48:43.449114+0000","last_active":"2024-09-19T05:48:44.868306+0000","last_peered":"2024-09-19T05:48:44.868306+0000","last_clean":"2024-09-19T05:48:44.868306+0000","last_became_active":"2024-09-19T05:48:43.447233+0000","last_became_peered":"2024-09-19T05:48:43.447233+0000","last_unstale":"2024-09-19T05:48:44.868306+0000","last_undegraded":"2024-09-19T05:48:44.868306+0000","last_fullsized":"2024-09-19T05:48:44.868306+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:53.450971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.414241+0000","last_change":"2024-09-19T05:48:42.411654+0000","last_active":"2024-09-19T05:48:42.414241+0000","last_peered":"2024-09-19T05:48:42.414241+0000","last_clean":"2024-09-19T05:48:42.414241+0000","last_became_active":"2024-09-19T05:48:42.410979+0000","last_became_peered":"2024-09-19T05:48:42.410979+0000","last_unstale":"2024-09-19T05:48:42.414241+0000","last_undegraded":"2024-09-19T05:48:42.414241+0000","last_fullsized":"2024-09-19T05:48:42.414241+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:21.609538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383959+0000","last_change":"2024-09-19T05:48:42.383959+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383959+0000","last_undegraded":"2024-09-19T05:48:42.383959+0000","last_fullsized":"2024-09-19T05:48:42.383959+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400407+0000","last_change":"2024-09-19T05:48:42.431885+0000","last_active":"2024-09-19T05:48:44.400407+0000","last_peered":"2024-09-19T05:48:44.400407+0000","last_clean":"2024-09-19T05:48:44.400407+0000","last_became_active":"2024-09-19T05:48:42.431522+0000","last_became_peered":"2024-09-19T05:48:42.431522+0000","last_unstale":"2024-09-19T05:48:44.400407+0000","last_undegraded":"2024-09-19T05:48:44.400407+0000","last_fullsized":"2024-09-19T05:48:44.400407+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:08.098674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867307+0000","last_change":"2024-09-19T05:48:43.418828+0000","last_active":"2024-09-19T05:48:44.867307+0000","last_peered":"2024-09-19T05:48:44.867307+0000","last_clean":"2024-09-19T05:48:44.867307+0000","last_became_active":"2024-09-19T05:48:43.418076+0000","last_became_peered":"2024-09-19T05:48:43.418076+0000","last_unstale":"2024-09-19T05:48:44.867307+0000","last_undegraded":"2024-09-19T05:48:44.867307+0000","last_fullsized":"2024-09-19T05:48:44.867307+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:51.296112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599404+0000","last_change":"2024-09-19T05:48:42.421966+0000","last_active":"2024-09-19T05:48:44.599404+0000","last_peered":"2024-09-19T05:48:44.599404+0000","last_clean":"2024-09-19T05:48:44.599404+0000","last_became_active":"2024-09-19T05:48:42.421205+0000","last_became_peered":"2024-09-19T05:48:42.421205+0000","last_unstale":"2024-09-19T05:48:44.599404+0000","last_undegraded":"2024-09-19T05:48:44.599404+0000","last_fullsized":"2024-09-19T05:48:44.599404+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:37.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400257+0000","last_change":"2024-09-19T05:48:43.422693+0000","last_active":"2024-09-19T05:48:44.400257+0000","last_peered":"2024-09-19T05:48:44.400257+0000","last_clean":"2024-09-19T05:48:44.400257+0000","last_became_active":"2024-09-19T05:48:43.422093+0000","last_became_peered":"2024-09-19T05:48:43.422093+0000","last_unstale":"2024-09-19T05:48:44.400257+0000","last_undegraded":"2024-09-19T05:48:44.400257+0000","last_fullsized":"2024-09-19T05:48:44.400257+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:01.627681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.435632+0000","last_change":"2024-09-19T05:48:42.434205+0000","last_active":"2024-09-19T05:48:42.435632+0000","last_peered":"2024-09-19T05:48:42.435632+0000","last_clean":"2024-09-19T05:48:42.435632+0000","last_became_active":"2024-09-19T05:48:42.433523+0000","last_became_peered":"2024-09-19T05:48:42.433523+0000","last_unstale":"2024-09-19T05:48:42.435632+0000","last_undegraded":"2024-09-19T05:48:42.435632+0000","last_fullsized":"2024-09-19T05:48:42.435632+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:08.007103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384392+0000","last_change":"2024-09-19T05:48:42.384392+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384392+0000","last_undegraded":"2024-09-19T05:48:42.384392+0000","last_fullsized":"2024-09-19T05:48:42.384392+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.404599+0000","last_change":"2024-09-19T05:48:42.403566+0000","last_active":"2024-09-19T05:48:42.404599+0000","last_peered":"2024-09-19T05:48:42.404599+0000","last_clean":"2024-09-19T05:48:42.404599+0000","last_became_active":"2024-09-19T05:48:42.403314+0000","last_became_peered":"2024-09-19T05:48:42.403314+0000","last_unstale":"2024-09-19T05:48:42.404599+0000","last_undegraded":"2024-09-19T05:48:42.404599+0000","last_fullsized":"2024-09-19T05:48:42.404599+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:48.481362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400666+0000","last_change":"2024-09-19T05:48:43.385022+0000","last_active":"2024-09-19T05:48:44.400666+0000","last_peered":"2024-09-19T05:48:44.400666+0000","last_clean":"2024-09-19T05:48:44.400666+0000","last_became_active":"2024-09-19T05:48:43.383301+0000","last_became_peered":"2024-09-19T05:48:43.383301+0000","last_unstale":"2024-09-19T05:48:44.400666+0000","last_undegraded":"2024-09-19T05:48:44.400666+0000","last_fullsized":"2024-09-19T05:48:44.400666+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:12.719066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600709+0000","last_change":"2024-09-19T05:48:42.416006+0000","last_active":"2024-09-19T05:48:44.600709+0000","last_peered":"2024-09-19T05:48:44.600709+0000","last_clean":"2024-09-19T05:48:44.600709+0000","last_became_active":"2024-09-19T05:48:42.415230+0000","last_became_peered":"2024-09-19T05:48:42.415230+0000","last_unstale":"2024-09-19T05:48:44.600709+0000","last_undegraded":"2024-09-19T05:48:44.600709+0000","last_fullsized":"2024-09-19T05:48:44.600709+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:20.858387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.401002+0000","last_change":"2024-09-19T05:48:43.396355+0000","last_active":"2024-09-19T05:48:44.401002+0000","last_peered":"2024-09-19T05:48:44.401002+0000","last_clean":"2024-09-19T05:48:44.401002+0000","last_became_active":"2024-09-19T05:48:43.395006+0000","last_became_peered":"2024-09-19T05:48:43.395006+0000","last_unstale":"2024-09-19T05:48:44.401002+0000","last_undegraded":"2024-09-19T05:48:44.401002+0000","last_fullsized":"2024-09-19T05:48:44.401002+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:28.144785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.435514+0000","last_change":"2024-09-19T05:48:42.433952+0000","last_active":"2024-09-19T05:48:42.435514+0000","last_peered":"2024-09-19T05:48:42.435514+0000","last_clean":"2024-09-19T05:48:42.435514+0000","last_became_active":"2024-09-19T05:48:42.433338+0000","last_became_peered":"2024-09-19T05:48:42.433338+0000","last_unstale":"2024-09-19T05:48:42.435514+0000","last_undegraded":"2024-09-19T05:48:42.435514+0000","last_fullsized":"2024-09-19T05:48:42.435514+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:15.640473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384235+0000","last_change":"2024-09-19T05:48:42.384235+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384235+0000","last_undegraded":"2024-09-19T05:48:42.384235+0000","last_fullsized":"2024-09-19T05:48:42.384235+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"204'3","reported_seq":17,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600029+0000","last_change":"2024-09-19T05:48:42.415855+0000","last_active":"2024-09-19T05:48:44.600029+0000","last_peered":"2024-09-19T05:48:44.600029+0000","last_clean":"2024-09-19T05:48:44.600029+0000","last_became_active":"2024-09-19T05:48:42.415026+0000","last_became_peered":"2024-09-19T05:48:42.415026+0000","last_unstale":"2024-09-19T05:48:44.600029+0000","last_undegraded":"2024-09-19T05:48:44.600029+0000","last_fullsized":"2024-09-19T05:48:44.600029+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:54.202845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387790+0000","last_change":"2024-09-19T05:48:42.387790+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387790+0000","last_undegraded":"2024-09-19T05:48:42.387790+0000","last_fullsized":"2024-09-19T05:48:42.387790+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.416978+0000","last_change":"2024-09-19T05:48:42.413681+0000","last_active":"2024-09-19T05:48:42.416978+0000","last_peered":"2024-09-19T05:48:42.416978+0000","last_clean":"2024-09-19T05:48:42.416978+0000","last_became_active":"2024-09-19T05:48:42.412962+0000","last_became_peered":"2024-09-19T05:48:42.412962+0000","last_unstale":"2024-09-19T05:48:42.416978+0000","last_undegraded":"2024-09-19T05:48:42.416978+0000","last_fullsized":"2024-09-19T05:48:42.416978+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:35.853981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782704+0000","last_change":"2024-09-19T05:48:43.414543+0000","last_active":"2024-09-19T05:48:44.782704+0000","last_peered":"2024-09-19T05:48:44.782704+0000","last_clean":"2024-09-19T05:48:44.782704+0000","last_became_active":"2024-09-19T05:48:43.414252+0000","last_became_peered":"2024-09-19T05:48:43.414252+0000","last_unstale":"2024-09-19T05:48:44.782704+0000","last_undegraded":"2024-09-19T05:48:44.782704+0000","last_fullsized":"2024-09-19T05:48:44.782704+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:18.500272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867921+0000","last_change":"2024-09-19T05:48:42.431123+0000","last_active":"2024-09-19T05:48:44.867921+0000","last_peered":"2024-09-19T05:48:44.867921+0000","last_clean":"2024-09-19T05:48:44.867921+0000","last_became_active":"2024-09-19T05:48:42.429778+0000","last_became_peered":"2024-09-19T05:48:42.429778+0000","last_unstale":"2024-09-19T05:48:44.867921+0000","last_undegraded":"2024-09-19T05:48:44.867921+0000","last_fullsized":"2024-09-19T05:48:44.867921+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:27.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867387+0000","last_change":"2024-09-19T05:48:43.440102+0000","last_active":"2024-09-19T05:48:44.867387+0000","last_peered":"2024-09-19T05:48:44.867387+0000","last_clean":"2024-09-19T05:48:44.867387+0000","last_became_active":"2024-09-19T05:48:43.435435+0000","last_became_peered":"2024-09-19T05:48:43.435435+0000","last_unstale":"2024-09-19T05:48:44.867387+0000","last_undegraded":"2024-09-19T05:48:44.867387+0000","last_fullsized":"2024-09-19T05:48:44.867387+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:50.867131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782810+0000","last_change":"2024-09-19T05:48:42.402961+0000","last_active":"2024-09-19T05:48:44.782810+0000","last_peered":"2024-09-19T05:48:44.782810+0000","last_clean":"2024-09-19T05:48:44.782810+0000","last_became_active":"2024-09-19T05:48:42.402277+0000","last_became_peered":"2024-09-19T05:48:42.402277+0000","last_unstale":"2024-09-19T05:48:44.782810+0000","last_undegraded":"2024-09-19T05:48:44.782810+0000","last_fullsized":"2024-09-19T05:48:44.782810+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:58.217507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382692+0000","last_change":"2024-09-19T05:48:42.382692+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382692+0000","last_undegraded":"2024-09-19T05:48:42.382692+0000","last_fullsized":"2024-09-19T05:48:42.382692+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.408807+0000","last_change":"2024-09-19T05:48:42.407613+0000","last_active":"2024-09-19T05:48:42.408807+0000","last_peered":"2024-09-19T05:48:42.408807+0000","last_clean":"2024-09-19T05:48:42.408807+0000","last_became_active":"2024-09-19T05:48:42.406711+0000","last_became_peered":"2024-09-19T05:48:42.406711+0000","last_unstale":"2024-09-19T05:48:42.408807+0000","last_undegraded":"2024-09-19T05:48:42.408807+0000","last_fullsized":"2024-09-19T05:48:42.408807+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:39.135197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400411+0000","last_change":"2024-09-19T05:48:43.411228+0000","last_active":"2024-09-19T05:48:44.400411+0000","last_peered":"2024-09-19T05:48:44.400411+0000","last_clean":"2024-09-19T05:48:44.400411+0000","last_became_active":"2024-09-19T05:48:43.408701+0000","last_became_peered":"2024-09-19T05:48:43.408701+0000","last_unstale":"2024-09-19T05:48:44.400411+0000","last_undegraded":"2024-09-19T05:48:44.400411+0000","last_fullsized":"2024-09-19T05:48:44.400411+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:58.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"204'8","reported_seq":22,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867265+0000","last_change":"2024-09-19T05:48:42.432352+0000","last_active":"2024-09-19T05:48:44.867265+0000","last_peered":"2024-09-19T05:48:44.867265+0000","last_clean":"2024-09-19T05:48:44.867265+0000","last_became_active":"2024-09-19T05:48:42.430952+0000","last_became_peered":"2024-09-19T05:48:42.430952+0000","last_unstale":"2024-09-19T05:48:44.867265+0000","last_undegraded":"2024-09-19T05:48:44.867265+0000","last_fullsized":"2024-09-19T05:48:44.867265+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:54.318575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783337+0000","last_change":"2024-09-19T05:48:43.450955+0000","last_active":"2024-09-19T05:48:44.783337+0000","last_peered":"2024-09-19T05:48:44.783337+0000","last_clean":"2024-09-19T05:48:44.783337+0000","last_became_active":"2024-09-19T05:48:43.450677+0000","last_became_peered":"2024-09-19T05:48:43.450677+0000","last_unstale":"2024-09-19T05:48:44.783337+0000","last_undegraded":"2024-09-19T05:48:44.783337+0000","last_fullsized":"2024-09-19T05:48:44.783337+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:01.042268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.421422+0000","last_change":"2024-09-19T05:48:42.420938+0000","last_active":"2024-09-19T05:48:42.421422+0000","last_peered":"2024-09-19T05:48:42.421422+0000","last_clean":"2024-09-19T05:48:42.421422+0000","last_became_active":"2024-09-19T05:48:42.420638+0000","last_became_peered":"2024-09-19T05:48:42.420638+0000","last_unstale":"2024-09-19T05:48:42.421422+0000","last_undegraded":"2024-09-19T05:48:42.421422+0000","last_fullsized":"2024-09-19T05:48:42.421422+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:00.623412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599654+0000","last_change":"2024-09-19T05:48:43.398153+0000","last_active":"2024-09-19T05:48:44.599654+0000","last_peered":"2024-09-19T05:48:44.599654+0000","last_clean":"2024-09-19T05:48:44.599654+0000","last_became_active":"2024-09-19T05:48:43.397481+0000","last_became_peered":"2024-09-19T05:48:43.397481+0000","last_unstale":"2024-09-19T05:48:44.599654+0000","last_undegraded":"2024-09-19T05:48:44.599654+0000","last_fullsized":"2024-09-19T05:48:44.599654+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:40.978044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.410637+0000","last_change":"2024-09-19T05:48:42.409982+0000","last_active":"2024-09-19T05:48:42.410637+0000","last_peered":"2024-09-19T05:48:42.410637+0000","last_clean":"2024-09-19T05:48:42.410637+0000","last_became_active":"2024-09-19T05:48:42.409215+0000","last_became_peered":"2024-09-19T05:48:42.409215+0000","last_unstale":"2024-09-19T05:48:42.410637+0000","last_undegraded":"2024-09-19T05:48:42.410637+0000","last_fullsized":"2024-09-19T05:48:42.410637+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:47.160673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383136+0000","last_change":"2024-09-19T05:48:42.383136+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383136+0000","last_undegraded":"2024-09-19T05:48:42.383136+0000","last_fullsized":"2024-09-19T05:48:42.383136+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868094+0000","last_change":"2024-09-19T05:48:42.421032+0000","last_active":"2024-09-19T05:48:44.868094+0000","last_peered":"2024-09-19T05:48:44.868094+0000","last_clean":"2024-09-19T05:48:44.868094+0000","last_became_active":"2024-09-19T05:48:42.420242+0000","last_became_peered":"2024-09-19T05:48:42.420242+0000","last_unstale":"2024-09-19T05:48:44.868094+0000","last_undegraded":"2024-09-19T05:48:44.868094+0000","last_fullsized":"2024-09-19T05:48:44.868094+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868739+0000","last_change":"2024-09-19T05:48:43.442967+0000","last_active":"2024-09-19T05:48:44.868739+0000","last_peered":"2024-09-19T05:48:44.868739+0000","last_clean":"2024-09-19T05:48:44.868739+0000","last_became_active":"2024-09-19T05:48:43.442390+0000","last_became_peered":"2024-09-19T05:48:43.442390+0000","last_unstale":"2024-09-19T05:48:44.868739+0000","last_undegraded":"2024-09-19T05:48:44.868739+0000","last_fullsized":"2024-09-19T05:48:44.868739+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:56.209941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868575+0000","last_change":"2024-09-19T05:48:42.426287+0000","last_active":"2024-09-19T05:48:44.868575+0000","last_peered":"2024-09-19T05:48:44.868575+0000","last_clean":"2024-09-19T05:48:44.868575+0000","last_became_active":"2024-09-19T05:48:42.425397+0000","last_became_peered":"2024-09-19T05:48:42.425397+0000","last_unstale":"2024-09-19T05:48:44.868575+0000","last_undegraded":"2024-09-19T05:48:44.868575+0000","last_fullsized":"2024-09-19T05:48:44.868575+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:33.402100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867343+0000","last_change":"2024-09-19T05:48:43.434066+0000","last_active":"2024-09-19T05:48:44.867343+0000","last_peered":"2024-09-19T05:48:44.867343+0000","last_clean":"2024-09-19T05:48:44.867343+0000","last_became_active":"2024-09-19T05:48:43.404070+0000","last_became_peered":"2024-09-19T05:48:43.404070+0000","last_unstale":"2024-09-19T05:48:44.867343+0000","last_undegraded":"2024-09-19T05:48:44.867343+0000","last_fullsized":"2024-09-19T05:48:44.867343+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:10.032809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867935+0000","last_change":"2024-09-19T05:48:42.426204+0000","last_active":"2024-09-19T05:48:44.867935+0000","last_peered":"2024-09-19T05:48:44.867935+0000","last_clean":"2024-09-19T05:48:44.867935+0000","last_became_active":"2024-09-19T05:48:42.413060+0000","last_became_peered":"2024-09-19T05:48:42.413060+0000","last_unstale":"2024-09-19T05:48:44.867935+0000","last_undegraded":"2024-09-19T05:48:44.867935+0000","last_fullsized":"2024-09-19T05:48:44.867935+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:22.460222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600064+0000","last_change":"2024-09-19T05:48:43.415898+0000","last_active":"2024-09-19T05:48:44.600064+0000","last_peered":"2024-09-19T05:48:44.600064+0000","last_clean":"2024-09-19T05:48:44.600064+0000","last_became_active":"2024-09-19T05:48:43.407456+0000","last_became_peered":"2024-09-19T05:48:43.407456+0000","last_unstale":"2024-09-19T05:48:44.600064+0000","last_undegraded":"2024-09-19T05:48:44.600064+0000","last_fullsized":"2024-09-19T05:48:44.600064+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:23.933931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400352+0000","last_change":"2024-09-19T05:48:42.394779+0000","last_active":"2024-09-19T05:48:44.400352+0000","last_peered":"2024-09-19T05:48:44.400352+0000","last_clean":"2024-09-19T05:48:44.400352+0000","last_became_active":"2024-09-19T05:48:42.392507+0000","last_became_peered":"2024-09-19T05:48:42.392507+0000","last_unstale":"2024-09-19T05:48:44.400352+0000","last_undegraded":"2024-09-19T05:48:44.400352+0000","last_fullsized":"2024-09-19T05:48:44.400352+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:59.104953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782875+0000","last_change":"2024-09-19T05:48:43.448238+0000","last_active":"2024-09-19T05:48:44.782875+0000","last_peered":"2024-09-19T05:48:44.782875+0000","last_clean":"2024-09-19T05:48:44.782875+0000","last_became_active":"2024-09-19T05:48:43.447945+0000","last_became_peered":"2024-09-19T05:48:43.447945+0000","last_unstale":"2024-09-19T05:48:44.782875+0000","last_undegraded":"2024-09-19T05:48:44.782875+0000","last_fullsized":"2024-09-19T05:48:44.782875+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:26.569443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400226+0000","last_change":"2024-09-19T05:48:42.402586+0000","last_active":"2024-09-19T05:48:44.400226+0000","last_peered":"2024-09-19T05:48:44.400226+0000","last_clean":"2024-09-19T05:48:44.400226+0000","last_became_active":"2024-09-19T05:48:42.402273+0000","last_became_peered":"2024-09-19T05:48:42.402273+0000","last_unstale":"2024-09-19T05:48:44.400226+0000","last_undegraded":"2024-09-19T05:48:44.400226+0000","last_fullsized":"2024-09-19T05:48:44.400226+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:30.885834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383047+0000","last_change":"2024-09-19T05:48:42.383047+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383047+0000","last_undegraded":"2024-09-19T05:48:42.383047+0000","last_fullsized":"2024-09-19T05:48:42.383047+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.408375+0000","last_change":"2024-09-19T05:48:42.402825+0000","last_active":"2024-09-19T05:48:42.408375+0000","last_peered":"2024-09-19T05:48:42.408375+0000","last_clean":"2024-09-19T05:48:42.408375+0000","last_became_active":"2024-09-19T05:48:42.402113+0000","last_became_peered":"2024-09-19T05:48:42.402113+0000","last_unstale":"2024-09-19T05:48:42.408375+0000","last_undegraded":"2024-09-19T05:48:42.408375+0000","last_fullsized":"2024-09-19T05:48:42.408375+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:02.018087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783133+0000","last_change":"2024-09-19T05:48:43.411949+0000","last_active":"2024-09-19T05:48:44.783133+0000","last_peered":"2024-09-19T05:48:44.783133+0000","last_clean":"2024-09-19T05:48:44.783133+0000","last_became_active":"2024-09-19T05:48:43.411664+0000","last_became_peered":"2024-09-19T05:48:43.411664+0000","last_unstale":"2024-09-19T05:48:44.783133+0000","last_undegraded":"2024-09-19T05:48:44.783133+0000","last_fullsized":"2024-09-19T05:48:44.783133+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.815536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868895+0000","last_change":"2024-09-19T05:48:42.430481+0000","last_active":"2024-09-19T05:48:44.868895+0000","last_peered":"2024-09-19T05:48:44.868895+0000","last_clean":"2024-09-19T05:48:44.868895+0000","last_became_active":"2024-09-19T05:48:42.429578+0000","last_became_peered":"2024-09-19T05:48:42.429578+0000","last_unstale":"2024-09-19T05:48:44.868895+0000","last_undegraded":"2024-09-19T05:48:44.868895+0000","last_fullsized":"2024-09-19T05:48:44.868895+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:01.458679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600314+0000","last_change":"2024-09-19T05:48:43.428371+0000","last_active":"2024-09-19T05:48:44.600314+0000","last_peered":"2024-09-19T05:48:44.600314+0000","last_clean":"2024-09-19T05:48:44.600314+0000","last_became_active":"2024-09-19T05:48:43.427134+0000","last_became_peered":"2024-09-19T05:48:43.427134+0000","last_unstale":"2024-09-19T05:48:44.600314+0000","last_undegraded":"2024-09-19T05:48:44.600314+0000","last_fullsized":"2024-09-19T05:48:44.600314+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:49.485630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"205'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400594+0000","last_change":"2024-09-19T05:48:42.402888+0000","last_active":"2024-09-19T05:48:44.400594+0000","last_peered":"2024-09-19T05:48:44.400594+0000","last_clean":"2024-09-19T05:48:44.400594+0000","last_became_active":"2024-09-19T05:48:42.402425+0000","last_became_peered":"2024-09-19T05:48:42.402425+0000","last_unstale":"2024-09-19T05:48:44.400594+0000","last_undegraded":"2024-09-19T05:48:44.400594+0000","last_fullsized":"2024-09-19T05:48:44.400594+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:27.307738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.379070+0000","last_change":"2024-09-19T05:48:42.379070+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.379070+0000","last_undegraded":"2024-09-19T05:48:42.379070+0000","last_fullsized":"2024-09-19T05:48:42.379070+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.401016+0000","last_change":"2024-09-19T05:48:42.392461+0000","last_active":"2024-09-19T05:48:44.401016+0000","last_peered":"2024-09-19T05:48:44.401016+0000","last_clean":"2024-09-19T05:48:44.401016+0000","last_became_active":"2024-09-19T05:48:42.392083+0000","last_became_peered":"2024-09-19T05:48:42.392083+0000","last_unstale":"2024-09-19T05:48:44.401016+0000","last_undegraded":"2024-09-19T05:48:44.401016+0000","last_fullsized":"2024-09-19T05:48:44.401016+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:04.533503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.386365+0000","last_change":"2024-09-19T05:48:42.386365+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.386365+0000","last_undegraded":"2024-09-19T05:48:42.386365+0000","last_fullsized":"2024-09-19T05:48:42.386365+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868856+0000","last_change":"2024-09-19T05:48:42.412842+0000","last_active":"2024-09-19T05:48:44.868856+0000","last_peered":"2024-09-19T05:48:44.868856+0000","last_clean":"2024-09-19T05:48:44.868856+0000","last_became_active":"2024-09-19T05:48:42.412103+0000","last_became_peered":"2024-09-19T05:48:42.412103+0000","last_unstale":"2024-09-19T05:48:44.868856+0000","last_undegraded":"2024-09-19T05:48:44.868856+0000","last_fullsized":"2024-09-19T05:48:44.868856+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:27.071122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383350+0000","last_change":"2024-09-19T05:48:42.383350+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383350+0000","last_undegraded":"2024-09-19T05:48:42.383350+0000","last_fullsized":"2024-09-19T05:48:42.383350+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868282+0000","last_change":"2024-09-19T05:48:42.429925+0000","last_active":"2024-09-19T05:48:44.868282+0000","last_peered":"2024-09-19T05:48:44.868282+0000","last_clean":"2024-09-19T05:48:44.868282+0000","last_became_active":"2024-09-19T05:48:42.426314+0000","last_became_peered":"2024-09-19T05:48:42.426314+0000","last_unstale":"2024-09-19T05:48:44.868282+0000","last_undegraded":"2024-09-19T05:48:44.868282+0000","last_fullsized":"2024-09-19T05:48:44.868282+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:14.460190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382366+0000","last_change":"2024-09-19T05:48:42.382366+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382366+0000","last_undegraded":"2024-09-19T05:48:42.382366+0000","last_fullsized":"2024-09-19T05:48:42.382366+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.399269+0000","last_change":"2024-09-19T05:48:42.396864+0000","last_active":"2024-09-19T05:48:42.399269+0000","last_peered":"2024-09-19T05:48:42.399269+0000","last_clean":"2024-09-19T05:48:42.399269+0000","last_became_active":"2024-09-19T05:48:42.396113+0000","last_became_peered":"2024-09-19T05:48:42.396113+0000","last_unstale":"2024-09-19T05:48:42.399269+0000","last_undegraded":"2024-09-19T05:48:42.399269+0000","last_fullsized":"2024-09-19T05:48:42.399269+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:47.546752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.388465+0000","last_change":"2024-09-19T05:48:42.388465+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.388465+0000","last_undegraded":"2024-09-19T05:48:42.388465+0000","last_fullsized":"2024-09-19T05:48:42.388465+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599757+0000","last_change":"2024-09-19T05:48:42.410610+0000","last_active":"2024-09-19T05:48:44.599757+0000","last_peered":"2024-09-19T05:48:44.599757+0000","last_clean":"2024-09-19T05:48:44.599757+0000","last_became_active":"2024-09-19T05:48:42.409545+0000","last_became_peered":"2024-09-19T05:48:42.409545+0000","last_unstale":"2024-09-19T05:48:44.599757+0000","last_undegraded":"2024-09-19T05:48:44.599757+0000","last_fullsized":"2024-09-19T05:48:44.599757+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:58.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867663+0000","last_change":"2024-09-19T05:48:43.452913+0000","last_active":"2024-09-19T05:48:44.867663+0000","last_peered":"2024-09-19T05:48:44.867663+0000","last_clean":"2024-09-19T05:48:44.867663+0000","last_became_active":"2024-09-19T05:48:43.452362+0000","last_became_peered":"2024-09-19T05:48:43.452362+0000","last_unstale":"2024-09-19T05:48:44.867663+0000","last_undegraded":"2024-09-19T05:48:44.867663+0000","last_fullsized":"2024-09-19T05:48:44.867663+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:16.862927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867587+0000","last_change":"2024-09-19T05:48:42.430171+0000","last_active":"2024-09-19T05:48:44.867587+0000","last_peered":"2024-09-19T05:48:44.867587+0000","last_clean":"2024-09-19T05:48:44.867587+0000","last_became_active":"2024-09-19T05:48:42.427129+0000","last_became_peered":"2024-09-19T05:48:42.427129+0000","last_unstale":"2024-09-19T05:48:44.867587+0000","last_undegraded":"2024-09-19T05:48:44.867587+0000","last_fullsized":"2024-09-19T05:48:44.867587+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:12.337882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.399646+0000","last_change":"2024-09-19T05:48:42.399646+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.399646+0000","last_undegraded":"2024-09-19T05:48:42.399646+0000","last_fullsized":"2024-09-19T05:48:42.399646+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599624+0000","last_change":"2024-09-19T05:48:42.407348+0000","last_active":"2024-09-19T05:48:44.599624+0000","last_peered":"2024-09-19T05:48:44.599624+0000","last_clean":"2024-09-19T05:48:44.599624+0000","last_became_active":"2024-09-19T05:48:42.406620+0000","last_became_peered":"2024-09-19T05:48:42.406620+0000","last_unstale":"2024-09-19T05:48:44.599624+0000","last_undegraded":"2024-09-19T05:48:44.599624+0000","last_fullsized":"2024-09-19T05:48:44.599624+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:07.874926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":507,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599856+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:48:44.599856+0000","last_peered":"2024-09-19T05:48:44.599856+0000","last_clean":"2024-09-19T05:48:44.599856+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:48:44.599856+0000","last_undegraded":"2024-09-19T05:48:44.599856+0000","last_fullsized":"2024-09-19T05:48:44.599856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542335,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74564,"kb_used_data":3112,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297276,"statfs":{"total":96636764160,"available":96560410624,"internally_reserved":0,"allocated":3186688,"data_stored":1814320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542335,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73996,"kb_used_data":2548,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297844,"statfs":{"total":96636764160,"available":96560992256,"internally_reserved":0,"allocated":2609152,"data_stored":1225018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542336,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542334,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73932,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297908,"statfs":{"total":96636764160,"available":96561057792,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542335,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73868,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297972,"statfs":{"total":96636764160,"available":96561123328,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73932,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297908,"statfs":{"total":96636764160,"available":96561057792,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542338,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51764,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320076,"statfs":{"total":96636764160,"available":96583757824,"internally_reserved":0,"allocated":2584576,"data_stored":1223280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542335,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78708,"kb_used_data":3104,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293132,"statfs":{"total":96636764160,"available":96556167168,"internally_reserved":0,"allocated":3178496,"data_stored":1813648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:48:47.848 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:48:48.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041f507640 1 Processor -- start 2024-09-19T05:48:48.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041f507640 1 -- start start 2024-09-19T05:48:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041f507640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 0x7f04180d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041f507640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f04180d0e80 0x7f04180d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041f507640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f04180b41c0 0x7f04180b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041f507640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f04180d0840 con 0x7f04180d0e80 2024-09-19T05:48:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041f507640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f04180d1800 con 0x7f04180b41c0 2024-09-19T05:48:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041f507640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f04180d4d40 con 0x7f0418161da0 2024-09-19T05:48:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041caa2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f04180d0e80 0x7f04180d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041caa2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f04180d0e80 0x7f04180d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42496/0 (socket says 172.21.15.67:42496) 2024-09-19T05:48:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041caa2640 1 -- 172.21.15.67:0/1312456888 learned_addr learned my addr 172.21.15.67:0/1312456888 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041daa4640 1 --2- 172.21.15.67:0/1312456888 >> v2:172.21.15.97:3300/0 conn(0x7f04180b41c0 0x7f04180b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041d2a3640 1 --2- 172.21.15.67:0/1312456888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 0x7f04180d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041caa2640 1 -- 172.21.15.67:0/1312456888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 msgr2=0x7f04180d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041caa2640 1 --2- 172.21.15.67:0/1312456888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 0x7f04180d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041caa2640 1 -- 172.21.15.67:0/1312456888 >> v2:172.21.15.97:3300/0 conn(0x7f04180b41c0 msgr2=0x7f04180b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041caa2640 1 --2- 172.21.15.67:0/1312456888 >> v2:172.21.15.97:3300/0 conn(0x7f04180b41c0 0x7f04180b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.017+0000 7f041caa2640 1 -- 172.21.15.67:0/1312456888 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04180d5020 con 0x7f04180d0e80 2024-09-19T05:48:48.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041caa2640 1 --2- 172.21.15.67:0/1312456888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180d0e80 0x7f04180d12c0 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f041808e7c0 tx=0x7f040801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9f50fb9680ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:48.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f040ffff640 1 -- 172.21.15.67:0/1312456888 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04080b1070 con 0x7f04180d0e80 2024-09-19T05:48:48.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f040ffff640 1 -- 172.21.15.67:0/1312456888 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04080ac630 con 0x7f04180d0e80 2024-09-19T05:48:48.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f040ffff640 1 -- 172.21.15.67:0/1312456888 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04080a8050 con 0x7f04180d0e80 2024-09-19T05:48:48.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 -- 172.21.15.67:0/1312456888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180d0e80 msgr2=0x7f04180d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 --2- 172.21.15.67:0/1312456888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180d0e80 0x7f04180d12c0 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f041808e7c0 tx=0x7f040801c520 comp rx=0 tx=0).stop 2024-09-19T05:48:48.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 -- 172.21.15.67:0/1312456888 shutdown_connections 2024-09-19T05:48:48.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 --2- 172.21.15.67:0/1312456888 >> v2:172.21.15.97:3300/0 conn(0x7f04180b41c0 0x7f04180b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 --2- 172.21.15.67:0/1312456888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180d0e80 0x7f04180d12c0 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 --2- 172.21.15.67:0/1312456888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 0x7f04180d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 -- 172.21.15.67:0/1312456888 >> 172.21.15.67:0/1312456888 conn(0x7f041808bfc0 msgr2=0x7f04180d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:48.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 -- 172.21.15.67:0/1312456888 shutdown_connections 2024-09-19T05:48:48.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 -- 172.21.15.67:0/1312456888 wait complete. 2024-09-19T05:48:48.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 Processor -- start 2024-09-19T05:48:48.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 -- start start 2024-09-19T05:48:48.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180b41c0 0x7f041815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04180d0e80 0x7f0418150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 0x7f041814fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f04180cf150 con 0x7f04180b41c0 2024-09-19T05:48:48.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0418162180 con 0x7f04180d0e80 2024-09-19T05:48:48.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041f507640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f04180cf2d0 con 0x7f0418161da0 2024-09-19T05:48:48.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041d2a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180b41c0 0x7f041815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041d2a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180b41c0 0x7f041815f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42498/0 (socket says 172.21.15.67:42498) 2024-09-19T05:48:48.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041d2a3640 1 -- 172.21.15.67:0/313223655 learned_addr learned my addr 172.21.15.67:0/313223655 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:48.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.021+0000 7f041caa2640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04180d0e80 0x7f0418150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041daa4640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 0x7f041814fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041d2a3640 1 -- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 msgr2=0x7f041814fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041d2a3640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 0x7f041814fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041d2a3640 1 -- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04180d0e80 msgr2=0x7f0418150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041d2a3640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04180d0e80 0x7f0418150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041d2a3640 1 -- 172.21.15.67:0/313223655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04180cb560 con 0x7f04180b41c0 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041daa4640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 0x7f041814fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041caa2640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04180d0e80 0x7f0418150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041d2a3640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180b41c0 0x7f041815f8f0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f041400d620 tx=0x7f041400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f040dffb640 1 -- 172.21.15.67:0/313223655 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041400b620 con 0x7f04180b41c0 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f040dffb640 1 -- 172.21.15.67:0/313223655 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0414019070 con 0x7f04180b41c0 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f040dffb640 1 -- 172.21.15.67:0/313223655 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041400ba20 con 0x7f04180b41c0 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041f507640 1 -- 172.21.15.67:0/313223655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04180cb840 con 0x7f04180b41c0 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041f507640 1 -- 172.21.15.67:0/313223655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04180cbe00 con 0x7f04180b41c0 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041f507640 1 -- 172.21.15.67:0/313223655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04180d12c0 con 0x7f04180b41c0 2024-09-19T05:48:48.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f040dffb640 1 -- 172.21.15.67:0/313223655 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f041400bbc0 con 0x7f04180b41c0 2024-09-19T05:48:48.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f040dffb640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03fc0678f0 0x7f03fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f040dffb640 1 -- 172.21.15.67:0/313223655 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f0414086320 con 0x7f04180b41c0 2024-09-19T05:48:48.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041caa2640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03fc0678f0 0x7f03fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.025+0000 7f041caa2640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03fc0678f0 0x7f03fc069db0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f04080ae000 tx=0x7f0408008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:48.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.029+0000 7f040dffb640 1 -- 172.21.15.67:0/313223655 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0414056c40 con 0x7f04180b41c0 2024-09-19T05:48:48.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.189+0000 7f041f507640 1 -- 172.21.15.67:0/313223655 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f041806bd70 con 0x7f03fc0678f0 2024-09-19T05:48:48.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f040dffb640 1 -- 172.21.15.67:0/313223655 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249651 (secure 0 0 0) 0x7f041806bd70 con 0x7f03fc0678f0 2024-09-19T05:48:48.207 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:48.210 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:48:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 -- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03fc0678f0 msgr2=0x7f03fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03fc0678f0 0x7f03fc069db0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f04080ae000 tx=0x7f0408008040 comp rx=0 tx=0).stop 2024-09-19T05:48:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 -- 172.21.15.67:0/313223655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180b41c0 msgr2=0x7f041815f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180b41c0 0x7f041815f8f0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f041400d620 tx=0x7f041400dae0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 -- 172.21.15.67:0/313223655 shutdown_connections 2024-09-19T05:48:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f03fc0678f0 0x7f03fc069db0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0418161da0 0x7f041814fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04180d0e80 0x7f0418150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 --2- 172.21.15.67:0/313223655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04180b41c0 0x7f041815f8f0 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 -- 172.21.15.67:0/313223655 >> 172.21.15.67:0/313223655 conn(0x7f041808bfc0 msgr2=0x7f041806e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:48.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 -- 172.21.15.67:0/313223655 shutdown_connections 2024-09-19T05:48:48.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.209+0000 7f041f507640 1 -- 172.21.15.67:0/313223655 wait complete. 2024-09-19T05:48:48.227 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":671,"stamp":"2024-09-19T05:48:47.436345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590562,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":552492,"kb_used_data":21240,"kb_used_omap":12,"kb_used_meta":531059,"kb_avail":754422228,"statfs":{"total":773094113280,"available":772528361472,"internally_reserved":0,"allocated":21749760,"data_stored":10887282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":543804977},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.004006"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600294+0000","last_change":"2024-09-19T05:48:43.428484+0000","last_active":"2024-09-19T05:48:44.600294+0000","last_peered":"2024-09-19T05:48:44.600294+0000","last_clean":"2024-09-19T05:48:44.600294+0000","last_became_active":"2024-09-19T05:48:43.427731+0000","last_became_peered":"2024-09-19T05:48:43.427731+0000","last_unstale":"2024-09-19T05:48:44.600294+0000","last_undegraded":"2024-09-19T05:48:44.600294+0000","last_fullsized":"2024-09-19T05:48:44.600294+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:01.627681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783364+0000","last_change":"2024-09-19T05:48:43.406998+0000","last_active":"2024-09-19T05:48:44.783364+0000","last_peered":"2024-09-19T05:48:44.783364+0000","last_clean":"2024-09-19T05:48:44.783364+0000","last_became_active":"2024-09-19T05:48:43.404769+0000","last_became_peered":"2024-09-19T05:48:43.404769+0000","last_unstale":"2024-09-19T05:48:44.783364+0000","last_undegraded":"2024-09-19T05:48:44.783364+0000","last_fullsized":"2024-09-19T05:48:44.783364+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:13.589670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.398878+0000","last_change":"2024-09-19T05:48:42.398878+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.398878+0000","last_undegraded":"2024-09-19T05:48:42.398878+0000","last_fullsized":"2024-09-19T05:48:42.398878+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.388063+0000","last_change":"2024-09-19T05:48:42.388063+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.388063+0000","last_undegraded":"2024-09-19T05:48:42.388063+0000","last_fullsized":"2024-09-19T05:48:42.388063+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599773+0000","last_change":"2024-09-19T05:48:43.401953+0000","last_active":"2024-09-19T05:48:44.599773+0000","last_peered":"2024-09-19T05:48:44.599773+0000","last_clean":"2024-09-19T05:48:44.599773+0000","last_became_active":"2024-09-19T05:48:43.401185+0000","last_became_peered":"2024-09-19T05:48:43.401185+0000","last_unstale":"2024-09-19T05:48:44.599773+0000","last_undegraded":"2024-09-19T05:48:44.599773+0000","last_fullsized":"2024-09-19T05:48:44.599773+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:59.221775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383369+0000","last_change":"2024-09-19T05:48:42.383369+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383369+0000","last_undegraded":"2024-09-19T05:48:42.383369+0000","last_fullsized":"2024-09-19T05:48:42.383369+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.394371+0000","last_change":"2024-09-19T05:48:42.394371+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.394371+0000","last_undegraded":"2024-09-19T05:48:42.394371+0000","last_fullsized":"2024-09-19T05:48:42.394371+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.381725+0000","last_change":"2024-09-19T05:48:42.381725+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.381725+0000","last_undegraded":"2024-09-19T05:48:42.381725+0000","last_fullsized":"2024-09-19T05:48:42.381725+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.399645+0000","last_change":"2024-09-19T05:48:42.399645+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.399645+0000","last_undegraded":"2024-09-19T05:48:42.399645+0000","last_fullsized":"2024-09-19T05:48:42.399645+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.397789+0000","last_change":"2024-09-19T05:48:42.397789+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.397789+0000","last_undegraded":"2024-09-19T05:48:42.397789+0000","last_fullsized":"2024-09-19T05:48:42.397789+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.390013+0000","last_change":"2024-09-19T05:48:42.390013+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.390013+0000","last_undegraded":"2024-09-19T05:48:42.390013+0000","last_fullsized":"2024-09-19T05:48:42.390013+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868599+0000","last_change":"2024-09-19T05:48:43.445279+0000","last_active":"2024-09-19T05:48:44.868599+0000","last_peered":"2024-09-19T05:48:44.868599+0000","last_clean":"2024-09-19T05:48:44.868599+0000","last_became_active":"2024-09-19T05:48:43.443235+0000","last_became_peered":"2024-09-19T05:48:43.443235+0000","last_unstale":"2024-09-19T05:48:44.868599+0000","last_undegraded":"2024-09-19T05:48:44.868599+0000","last_fullsized":"2024-09-19T05:48:44.868599+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:12.067057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.379145+0000","last_change":"2024-09-19T05:48:42.379145+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.379145+0000","last_undegraded":"2024-09-19T05:48:42.379145+0000","last_fullsized":"2024-09-19T05:48:42.379145+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867568+0000","last_change":"2024-09-19T05:48:43.435859+0000","last_active":"2024-09-19T05:48:44.867568+0000","last_peered":"2024-09-19T05:48:44.867568+0000","last_clean":"2024-09-19T05:48:44.867568+0000","last_became_active":"2024-09-19T05:48:43.434858+0000","last_became_peered":"2024-09-19T05:48:43.434858+0000","last_unstale":"2024-09-19T05:48:44.867568+0000","last_undegraded":"2024-09-19T05:48:44.867568+0000","last_fullsized":"2024-09-19T05:48:44.867568+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.765450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400513+0000","last_change":"2024-09-19T05:48:43.405560+0000","last_active":"2024-09-19T05:48:44.400513+0000","last_peered":"2024-09-19T05:48:44.400513+0000","last_clean":"2024-09-19T05:48:44.400513+0000","last_became_active":"2024-09-19T05:48:43.405181+0000","last_became_peered":"2024-09-19T05:48:43.405181+0000","last_unstale":"2024-09-19T05:48:44.400513+0000","last_undegraded":"2024-09-19T05:48:44.400513+0000","last_fullsized":"2024-09-19T05:48:44.400513+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:39.032330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.380643+0000","last_change":"2024-09-19T05:48:42.380643+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.380643+0000","last_undegraded":"2024-09-19T05:48:42.380643+0000","last_fullsized":"2024-09-19T05:48:42.380643+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868635+0000","last_change":"2024-09-19T05:48:43.445682+0000","last_active":"2024-09-19T05:48:44.868635+0000","last_peered":"2024-09-19T05:48:44.868635+0000","last_clean":"2024-09-19T05:48:44.868635+0000","last_became_active":"2024-09-19T05:48:43.445097+0000","last_became_peered":"2024-09-19T05:48:43.445097+0000","last_unstale":"2024-09-19T05:48:44.868635+0000","last_undegraded":"2024-09-19T05:48:44.868635+0000","last_fullsized":"2024-09-19T05:48:44.868635+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:21.827527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.396695+0000","last_change":"2024-09-19T05:48:42.396695+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.396695+0000","last_undegraded":"2024-09-19T05:48:42.396695+0000","last_fullsized":"2024-09-19T05:48:42.396695+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599639+0000","last_change":"2024-09-19T05:48:43.419947+0000","last_active":"2024-09-19T05:48:44.599639+0000","last_peered":"2024-09-19T05:48:44.599639+0000","last_clean":"2024-09-19T05:48:44.599639+0000","last_became_active":"2024-09-19T05:48:43.408971+0000","last_became_peered":"2024-09-19T05:48:43.408971+0000","last_unstale":"2024-09-19T05:48:44.599639+0000","last_undegraded":"2024-09-19T05:48:44.599639+0000","last_fullsized":"2024-09-19T05:48:44.599639+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:56.260686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.381075+0000","last_change":"2024-09-19T05:48:42.381075+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.381075+0000","last_undegraded":"2024-09-19T05:48:42.381075+0000","last_fullsized":"2024-09-19T05:48:42.381075+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.393132+0000","last_change":"2024-09-19T05:48:42.393132+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.393132+0000","last_undegraded":"2024-09-19T05:48:42.393132+0000","last_fullsized":"2024-09-19T05:48:42.393132+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400253+0000","last_change":"2024-09-19T05:48:43.422670+0000","last_active":"2024-09-19T05:48:44.400253+0000","last_peered":"2024-09-19T05:48:44.400253+0000","last_clean":"2024-09-19T05:48:44.400253+0000","last_became_active":"2024-09-19T05:48:43.422215+0000","last_became_peered":"2024-09-19T05:48:43.422215+0000","last_unstale":"2024-09-19T05:48:44.400253+0000","last_undegraded":"2024-09-19T05:48:44.400253+0000","last_fullsized":"2024-09-19T05:48:44.400253+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:49.485630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.398031+0000","last_change":"2024-09-19T05:48:42.398031+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.398031+0000","last_undegraded":"2024-09-19T05:48:42.398031+0000","last_fullsized":"2024-09-19T05:48:42.398031+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599585+0000","last_change":"2024-09-19T05:48:43.402276+0000","last_active":"2024-09-19T05:48:44.599585+0000","last_peered":"2024-09-19T05:48:44.599585+0000","last_clean":"2024-09-19T05:48:44.599585+0000","last_became_active":"2024-09-19T05:48:43.401561+0000","last_became_peered":"2024-09-19T05:48:43.401561+0000","last_unstale":"2024-09-19T05:48:44.599585+0000","last_undegraded":"2024-09-19T05:48:44.599585+0000","last_fullsized":"2024-09-19T05:48:44.599585+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:50.285249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600487+0000","last_change":"2024-09-19T05:48:43.406290+0000","last_active":"2024-09-19T05:48:44.600487+0000","last_peered":"2024-09-19T05:48:44.600487+0000","last_clean":"2024-09-19T05:48:44.600487+0000","last_became_active":"2024-09-19T05:48:43.404595+0000","last_became_peered":"2024-09-19T05:48:43.404595+0000","last_unstale":"2024-09-19T05:48:44.600487+0000","last_undegraded":"2024-09-19T05:48:44.600487+0000","last_fullsized":"2024-09-19T05:48:44.600487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:58.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.395520+0000","last_change":"2024-09-19T05:48:42.395520+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.395520+0000","last_undegraded":"2024-09-19T05:48:42.395520+0000","last_fullsized":"2024-09-19T05:48:42.395520+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387834+0000","last_change":"2024-09-19T05:48:42.387834+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387834+0000","last_undegraded":"2024-09-19T05:48:42.387834+0000","last_fullsized":"2024-09-19T05:48:42.387834+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868077+0000","last_change":"2024-09-19T05:48:43.418863+0000","last_active":"2024-09-19T05:48:44.868077+0000","last_peered":"2024-09-19T05:48:44.868077+0000","last_clean":"2024-09-19T05:48:44.868077+0000","last_became_active":"2024-09-19T05:48:43.418168+0000","last_became_peered":"2024-09-19T05:48:43.418168+0000","last_unstale":"2024-09-19T05:48:44.868077+0000","last_undegraded":"2024-09-19T05:48:44.868077+0000","last_fullsized":"2024-09-19T05:48:44.868077+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:31.906285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783339+0000","last_change":"2024-09-19T05:48:43.414630+0000","last_active":"2024-09-19T05:48:44.783339+0000","last_peered":"2024-09-19T05:48:44.783339+0000","last_clean":"2024-09-19T05:48:44.783339+0000","last_became_active":"2024-09-19T05:48:43.414339+0000","last_became_peered":"2024-09-19T05:48:43.414339+0000","last_unstale":"2024-09-19T05:48:44.783339+0000","last_undegraded":"2024-09-19T05:48:44.783339+0000","last_fullsized":"2024-09-19T05:48:44.783339+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:28.950820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384409+0000","last_change":"2024-09-19T05:48:42.384409+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384409+0000","last_undegraded":"2024-09-19T05:48:42.384409+0000","last_fullsized":"2024-09-19T05:48:42.384409+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387413+0000","last_change":"2024-09-19T05:48:42.387413+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387413+0000","last_undegraded":"2024-09-19T05:48:42.387413+0000","last_fullsized":"2024-09-19T05:48:42.387413+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.378949+0000","last_change":"2024-09-19T05:48:42.378949+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.378949+0000","last_undegraded":"2024-09-19T05:48:42.378949+0000","last_fullsized":"2024-09-19T05:48:42.378949+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383884+0000","last_change":"2024-09-19T05:48:42.383884+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383884+0000","last_undegraded":"2024-09-19T05:48:42.383884+0000","last_fullsized":"2024-09-19T05:48:42.383884+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.409830+0000","last_change":"2024-09-19T05:48:42.408182+0000","last_active":"2024-09-19T05:48:42.409830+0000","last_peered":"2024-09-19T05:48:42.409830+0000","last_clean":"2024-09-19T05:48:42.409830+0000","last_became_active":"2024-09-19T05:48:42.407894+0000","last_became_peered":"2024-09-19T05:48:42.407894+0000","last_unstale":"2024-09-19T05:48:42.409830+0000","last_undegraded":"2024-09-19T05:48:42.409830+0000","last_fullsized":"2024-09-19T05:48:42.409830+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:26.752644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382803+0000","last_change":"2024-09-19T05:48:42.382803+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382803+0000","last_undegraded":"2024-09-19T05:48:42.382803+0000","last_fullsized":"2024-09-19T05:48:42.382803+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868507+0000","last_change":"2024-09-19T05:48:42.418659+0000","last_active":"2024-09-19T05:48:44.868507+0000","last_peered":"2024-09-19T05:48:44.868507+0000","last_clean":"2024-09-19T05:48:44.868507+0000","last_became_active":"2024-09-19T05:48:42.412905+0000","last_became_peered":"2024-09-19T05:48:42.412905+0000","last_unstale":"2024-09-19T05:48:44.868507+0000","last_undegraded":"2024-09-19T05:48:44.868507+0000","last_fullsized":"2024-09-19T05:48:44.868507+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:18.568117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868306+0000","last_change":"2024-09-19T05:48:43.449114+0000","last_active":"2024-09-19T05:48:44.868306+0000","last_peered":"2024-09-19T05:48:44.868306+0000","last_clean":"2024-09-19T05:48:44.868306+0000","last_became_active":"2024-09-19T05:48:43.447233+0000","last_became_peered":"2024-09-19T05:48:43.447233+0000","last_unstale":"2024-09-19T05:48:44.868306+0000","last_undegraded":"2024-09-19T05:48:44.868306+0000","last_fullsized":"2024-09-19T05:48:44.868306+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:53.450971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.414241+0000","last_change":"2024-09-19T05:48:42.411654+0000","last_active":"2024-09-19T05:48:42.414241+0000","last_peered":"2024-09-19T05:48:42.414241+0000","last_clean":"2024-09-19T05:48:42.414241+0000","last_became_active":"2024-09-19T05:48:42.410979+0000","last_became_peered":"2024-09-19T05:48:42.410979+0000","last_unstale":"2024-09-19T05:48:42.414241+0000","last_undegraded":"2024-09-19T05:48:42.414241+0000","last_fullsized":"2024-09-19T05:48:42.414241+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:21.609538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383959+0000","last_change":"2024-09-19T05:48:42.383959+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383959+0000","last_undegraded":"2024-09-19T05:48:42.383959+0000","last_fullsized":"2024-09-19T05:48:42.383959+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400407+0000","last_change":"2024-09-19T05:48:42.431885+0000","last_active":"2024-09-19T05:48:44.400407+0000","last_peered":"2024-09-19T05:48:44.400407+0000","last_clean":"2024-09-19T05:48:44.400407+0000","last_became_active":"2024-09-19T05:48:42.431522+0000","last_became_peered":"2024-09-19T05:48:42.431522+0000","last_unstale":"2024-09-19T05:48:44.400407+0000","last_undegraded":"2024-09-19T05:48:44.400407+0000","last_fullsized":"2024-09-19T05:48:44.400407+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:08.098674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867307+0000","last_change":"2024-09-19T05:48:43.418828+0000","last_active":"2024-09-19T05:48:44.867307+0000","last_peered":"2024-09-19T05:48:44.867307+0000","last_clean":"2024-09-19T05:48:44.867307+0000","last_became_active":"2024-09-19T05:48:43.418076+0000","last_became_peered":"2024-09-19T05:48:43.418076+0000","last_unstale":"2024-09-19T05:48:44.867307+0000","last_undegraded":"2024-09-19T05:48:44.867307+0000","last_fullsized":"2024-09-19T05:48:44.867307+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:51.296112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599404+0000","last_change":"2024-09-19T05:48:42.421966+0000","last_active":"2024-09-19T05:48:44.599404+0000","last_peered":"2024-09-19T05:48:44.599404+0000","last_clean":"2024-09-19T05:48:44.599404+0000","last_became_active":"2024-09-19T05:48:42.421205+0000","last_became_peered":"2024-09-19T05:48:42.421205+0000","last_unstale":"2024-09-19T05:48:44.599404+0000","last_undegraded":"2024-09-19T05:48:44.599404+0000","last_fullsized":"2024-09-19T05:48:44.599404+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:37.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400257+0000","last_change":"2024-09-19T05:48:43.422693+0000","last_active":"2024-09-19T05:48:44.400257+0000","last_peered":"2024-09-19T05:48:44.400257+0000","last_clean":"2024-09-19T05:48:44.400257+0000","last_became_active":"2024-09-19T05:48:43.422093+0000","last_became_peered":"2024-09-19T05:48:43.422093+0000","last_unstale":"2024-09-19T05:48:44.400257+0000","last_undegraded":"2024-09-19T05:48:44.400257+0000","last_fullsized":"2024-09-19T05:48:44.400257+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:01.627681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.435632+0000","last_change":"2024-09-19T05:48:42.434205+0000","last_active":"2024-09-19T05:48:42.435632+0000","last_peered":"2024-09-19T05:48:42.435632+0000","last_clean":"2024-09-19T05:48:42.435632+0000","last_became_active":"2024-09-19T05:48:42.433523+0000","last_became_peered":"2024-09-19T05:48:42.433523+0000","last_unstale":"2024-09-19T05:48:42.435632+0000","last_undegraded":"2024-09-19T05:48:42.435632+0000","last_fullsized":"2024-09-19T05:48:42.435632+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:08.007103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384392+0000","last_change":"2024-09-19T05:48:42.384392+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384392+0000","last_undegraded":"2024-09-19T05:48:42.384392+0000","last_fullsized":"2024-09-19T05:48:42.384392+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.404599+0000","last_change":"2024-09-19T05:48:42.403566+0000","last_active":"2024-09-19T05:48:42.404599+0000","last_peered":"2024-09-19T05:48:42.404599+0000","last_clean":"2024-09-19T05:48:42.404599+0000","last_became_active":"2024-09-19T05:48:42.403314+0000","last_became_peered":"2024-09-19T05:48:42.403314+0000","last_unstale":"2024-09-19T05:48:42.404599+0000","last_undegraded":"2024-09-19T05:48:42.404599+0000","last_fullsized":"2024-09-19T05:48:42.404599+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:48.481362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400666+0000","last_change":"2024-09-19T05:48:43.385022+0000","last_active":"2024-09-19T05:48:44.400666+0000","last_peered":"2024-09-19T05:48:44.400666+0000","last_clean":"2024-09-19T05:48:44.400666+0000","last_became_active":"2024-09-19T05:48:43.383301+0000","last_became_peered":"2024-09-19T05:48:43.383301+0000","last_unstale":"2024-09-19T05:48:44.400666+0000","last_undegraded":"2024-09-19T05:48:44.400666+0000","last_fullsized":"2024-09-19T05:48:44.400666+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:12.719066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600709+0000","last_change":"2024-09-19T05:48:42.416006+0000","last_active":"2024-09-19T05:48:44.600709+0000","last_peered":"2024-09-19T05:48:44.600709+0000","last_clean":"2024-09-19T05:48:44.600709+0000","last_became_active":"2024-09-19T05:48:42.415230+0000","last_became_peered":"2024-09-19T05:48:42.415230+0000","last_unstale":"2024-09-19T05:48:44.600709+0000","last_undegraded":"2024-09-19T05:48:44.600709+0000","last_fullsized":"2024-09-19T05:48:44.600709+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:20.858387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.401002+0000","last_change":"2024-09-19T05:48:43.396355+0000","last_active":"2024-09-19T05:48:44.401002+0000","last_peered":"2024-09-19T05:48:44.401002+0000","last_clean":"2024-09-19T05:48:44.401002+0000","last_became_active":"2024-09-19T05:48:43.395006+0000","last_became_peered":"2024-09-19T05:48:43.395006+0000","last_unstale":"2024-09-19T05:48:44.401002+0000","last_undegraded":"2024-09-19T05:48:44.401002+0000","last_fullsized":"2024-09-19T05:48:44.401002+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:28.144785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.435514+0000","last_change":"2024-09-19T05:48:42.433952+0000","last_active":"2024-09-19T05:48:42.435514+0000","last_peered":"2024-09-19T05:48:42.435514+0000","last_clean":"2024-09-19T05:48:42.435514+0000","last_became_active":"2024-09-19T05:48:42.433338+0000","last_became_peered":"2024-09-19T05:48:42.433338+0000","last_unstale":"2024-09-19T05:48:42.435514+0000","last_undegraded":"2024-09-19T05:48:42.435514+0000","last_fullsized":"2024-09-19T05:48:42.435514+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:15.640473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384235+0000","last_change":"2024-09-19T05:48:42.384235+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384235+0000","last_undegraded":"2024-09-19T05:48:42.384235+0000","last_fullsized":"2024-09-19T05:48:42.384235+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"204'3","reported_seq":17,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600029+0000","last_change":"2024-09-19T05:48:42.415855+0000","last_active":"2024-09-19T05:48:44.600029+0000","last_peered":"2024-09-19T05:48:44.600029+0000","last_clean":"2024-09-19T05:48:44.600029+0000","last_became_active":"2024-09-19T05:48:42.415026+0000","last_became_peered":"2024-09-19T05:48:42.415026+0000","last_unstale":"2024-09-19T05:48:44.600029+0000","last_undegraded":"2024-09-19T05:48:44.600029+0000","last_fullsized":"2024-09-19T05:48:44.600029+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:54.202845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387790+0000","last_change":"2024-09-19T05:48:42.387790+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387790+0000","last_undegraded":"2024-09-19T05:48:42.387790+0000","last_fullsized":"2024-09-19T05:48:42.387790+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.416978+0000","last_change":"2024-09-19T05:48:42.413681+0000","last_active":"2024-09-19T05:48:42.416978+0000","last_peered":"2024-09-19T05:48:42.416978+0000","last_clean":"2024-09-19T05:48:42.416978+0000","last_became_active":"2024-09-19T05:48:42.412962+0000","last_became_peered":"2024-09-19T05:48:42.412962+0000","last_unstale":"2024-09-19T05:48:42.416978+0000","last_undegraded":"2024-09-19T05:48:42.416978+0000","last_fullsized":"2024-09-19T05:48:42.416978+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:35.853981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782704+0000","last_change":"2024-09-19T05:48:43.414543+0000","last_active":"2024-09-19T05:48:44.782704+0000","last_peered":"2024-09-19T05:48:44.782704+0000","last_clean":"2024-09-19T05:48:44.782704+0000","last_became_active":"2024-09-19T05:48:43.414252+0000","last_became_peered":"2024-09-19T05:48:43.414252+0000","last_unstale":"2024-09-19T05:48:44.782704+0000","last_undegraded":"2024-09-19T05:48:44.782704+0000","last_fullsized":"2024-09-19T05:48:44.782704+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:18.500272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867921+0000","last_change":"2024-09-19T05:48:42.431123+0000","last_active":"2024-09-19T05:48:44.867921+0000","last_peered":"2024-09-19T05:48:44.867921+0000","last_clean":"2024-09-19T05:48:44.867921+0000","last_became_active":"2024-09-19T05:48:42.429778+0000","last_became_peered":"2024-09-19T05:48:42.429778+0000","last_unstale":"2024-09-19T05:48:44.867921+0000","last_undegraded":"2024-09-19T05:48:44.867921+0000","last_fullsized":"2024-09-19T05:48:44.867921+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:27.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867387+0000","last_change":"2024-09-19T05:48:43.440102+0000","last_active":"2024-09-19T05:48:44.867387+0000","last_peered":"2024-09-19T05:48:44.867387+0000","last_clean":"2024-09-19T05:48:44.867387+0000","last_became_active":"2024-09-19T05:48:43.435435+0000","last_became_peered":"2024-09-19T05:48:43.435435+0000","last_unstale":"2024-09-19T05:48:44.867387+0000","last_undegraded":"2024-09-19T05:48:44.867387+0000","last_fullsized":"2024-09-19T05:48:44.867387+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:50.867131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782810+0000","last_change":"2024-09-19T05:48:42.402961+0000","last_active":"2024-09-19T05:48:44.782810+0000","last_peered":"2024-09-19T05:48:44.782810+0000","last_clean":"2024-09-19T05:48:44.782810+0000","last_became_active":"2024-09-19T05:48:42.402277+0000","last_became_peered":"2024-09-19T05:48:42.402277+0000","last_unstale":"2024-09-19T05:48:44.782810+0000","last_undegraded":"2024-09-19T05:48:44.782810+0000","last_fullsized":"2024-09-19T05:48:44.782810+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:58.217507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382692+0000","last_change":"2024-09-19T05:48:42.382692+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382692+0000","last_undegraded":"2024-09-19T05:48:42.382692+0000","last_fullsized":"2024-09-19T05:48:42.382692+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.408807+0000","last_change":"2024-09-19T05:48:42.407613+0000","last_active":"2024-09-19T05:48:42.408807+0000","last_peered":"2024-09-19T05:48:42.408807+0000","last_clean":"2024-09-19T05:48:42.408807+0000","last_became_active":"2024-09-19T05:48:42.406711+0000","last_became_peered":"2024-09-19T05:48:42.406711+0000","last_unstale":"2024-09-19T05:48:42.408807+0000","last_undegraded":"2024-09-19T05:48:42.408807+0000","last_fullsized":"2024-09-19T05:48:42.408807+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:39.135197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400411+0000","last_change":"2024-09-19T05:48:43.411228+0000","last_active":"2024-09-19T05:48:44.400411+0000","last_peered":"2024-09-19T05:48:44.400411+0000","last_clean":"2024-09-19T05:48:44.400411+0000","last_became_active":"2024-09-19T05:48:43.408701+0000","last_became_peered":"2024-09-19T05:48:43.408701+0000","last_unstale":"2024-09-19T05:48:44.400411+0000","last_undegraded":"2024-09-19T05:48:44.400411+0000","last_fullsized":"2024-09-19T05:48:44.400411+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:58.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"204'8","reported_seq":22,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867265+0000","last_change":"2024-09-19T05:48:42.432352+0000","last_active":"2024-09-19T05:48:44.867265+0000","last_peered":"2024-09-19T05:48:44.867265+0000","last_clean":"2024-09-19T05:48:44.867265+0000","last_became_active":"2024-09-19T05:48:42.430952+0000","last_became_peered":"2024-09-19T05:48:42.430952+0000","last_unstale":"2024-09-19T05:48:44.867265+0000","last_undegraded":"2024-09-19T05:48:44.867265+0000","last_fullsized":"2024-09-19T05:48:44.867265+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:54.318575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783337+0000","last_change":"2024-09-19T05:48:43.450955+0000","last_active":"2024-09-19T05:48:44.783337+0000","last_peered":"2024-09-19T05:48:44.783337+0000","last_clean":"2024-09-19T05:48:44.783337+0000","last_became_active":"2024-09-19T05:48:43.450677+0000","last_became_peered":"2024-09-19T05:48:43.450677+0000","last_unstale":"2024-09-19T05:48:44.783337+0000","last_undegraded":"2024-09-19T05:48:44.783337+0000","last_fullsized":"2024-09-19T05:48:44.783337+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:01.042268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.421422+0000","last_change":"2024-09-19T05:48:42.420938+0000","last_active":"2024-09-19T05:48:42.421422+0000","last_peered":"2024-09-19T05:48:42.421422+0000","last_clean":"2024-09-19T05:48:42.421422+0000","last_became_active":"2024-09-19T05:48:42.420638+0000","last_became_peered":"2024-09-19T05:48:42.420638+0000","last_unstale":"2024-09-19T05:48:42.421422+0000","last_undegraded":"2024-09-19T05:48:42.421422+0000","last_fullsized":"2024-09-19T05:48:42.421422+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:00.623412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599654+0000","last_change":"2024-09-19T05:48:43.398153+0000","last_active":"2024-09-19T05:48:44.599654+0000","last_peered":"2024-09-19T05:48:44.599654+0000","last_clean":"2024-09-19T05:48:44.599654+0000","last_became_active":"2024-09-19T05:48:43.397481+0000","last_became_peered":"2024-09-19T05:48:43.397481+0000","last_unstale":"2024-09-19T05:48:44.599654+0000","last_undegraded":"2024-09-19T05:48:44.599654+0000","last_fullsized":"2024-09-19T05:48:44.599654+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:40.978044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.410637+0000","last_change":"2024-09-19T05:48:42.409982+0000","last_active":"2024-09-19T05:48:42.410637+0000","last_peered":"2024-09-19T05:48:42.410637+0000","last_clean":"2024-09-19T05:48:42.410637+0000","last_became_active":"2024-09-19T05:48:42.409215+0000","last_became_peered":"2024-09-19T05:48:42.409215+0000","last_unstale":"2024-09-19T05:48:42.410637+0000","last_undegraded":"2024-09-19T05:48:42.410637+0000","last_fullsized":"2024-09-19T05:48:42.410637+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:47.160673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383136+0000","last_change":"2024-09-19T05:48:42.383136+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383136+0000","last_undegraded":"2024-09-19T05:48:42.383136+0000","last_fullsized":"2024-09-19T05:48:42.383136+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868094+0000","last_change":"2024-09-19T05:48:42.421032+0000","last_active":"2024-09-19T05:48:44.868094+0000","last_peered":"2024-09-19T05:48:44.868094+0000","last_clean":"2024-09-19T05:48:44.868094+0000","last_became_active":"2024-09-19T05:48:42.420242+0000","last_became_peered":"2024-09-19T05:48:42.420242+0000","last_unstale":"2024-09-19T05:48:44.868094+0000","last_undegraded":"2024-09-19T05:48:44.868094+0000","last_fullsized":"2024-09-19T05:48:44.868094+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868739+0000","last_change":"2024-09-19T05:48:43.442967+0000","last_active":"2024-09-19T05:48:44.868739+0000","last_peered":"2024-09-19T05:48:44.868739+0000","last_clean":"2024-09-19T05:48:44.868739+0000","last_became_active":"2024-09-19T05:48:43.442390+0000","last_became_peered":"2024-09-19T05:48:43.442390+0000","last_unstale":"2024-09-19T05:48:44.868739+0000","last_undegraded":"2024-09-19T05:48:44.868739+0000","last_fullsized":"2024-09-19T05:48:44.868739+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:56.209941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868575+0000","last_change":"2024-09-19T05:48:42.426287+0000","last_active":"2024-09-19T05:48:44.868575+0000","last_peered":"2024-09-19T05:48:44.868575+0000","last_clean":"2024-09-19T05:48:44.868575+0000","last_became_active":"2024-09-19T05:48:42.425397+0000","last_became_peered":"2024-09-19T05:48:42.425397+0000","last_unstale":"2024-09-19T05:48:44.868575+0000","last_undegraded":"2024-09-19T05:48:44.868575+0000","last_fullsized":"2024-09-19T05:48:44.868575+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:33.402100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867343+0000","last_change":"2024-09-19T05:48:43.434066+0000","last_active":"2024-09-19T05:48:44.867343+0000","last_peered":"2024-09-19T05:48:44.867343+0000","last_clean":"2024-09-19T05:48:44.867343+0000","last_became_active":"2024-09-19T05:48:43.404070+0000","last_became_peered":"2024-09-19T05:48:43.404070+0000","last_unstale":"2024-09-19T05:48:44.867343+0000","last_undegraded":"2024-09-19T05:48:44.867343+0000","last_fullsized":"2024-09-19T05:48:44.867343+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:10.032809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867935+0000","last_change":"2024-09-19T05:48:42.426204+0000","last_active":"2024-09-19T05:48:44.867935+0000","last_peered":"2024-09-19T05:48:44.867935+0000","last_clean":"2024-09-19T05:48:44.867935+0000","last_became_active":"2024-09-19T05:48:42.413060+0000","last_became_peered":"2024-09-19T05:48:42.413060+0000","last_unstale":"2024-09-19T05:48:44.867935+0000","last_undegraded":"2024-09-19T05:48:44.867935+0000","last_fullsized":"2024-09-19T05:48:44.867935+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:22.460222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600064+0000","last_change":"2024-09-19T05:48:43.415898+0000","last_active":"2024-09-19T05:48:44.600064+0000","last_peered":"2024-09-19T05:48:44.600064+0000","last_clean":"2024-09-19T05:48:44.600064+0000","last_became_active":"2024-09-19T05:48:43.407456+0000","last_became_peered":"2024-09-19T05:48:43.407456+0000","last_unstale":"2024-09-19T05:48:44.600064+0000","last_undegraded":"2024-09-19T05:48:44.600064+0000","last_fullsized":"2024-09-19T05:48:44.600064+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:23.933931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400352+0000","last_change":"2024-09-19T05:48:42.394779+0000","last_active":"2024-09-19T05:48:44.400352+0000","last_peered":"2024-09-19T05:48:44.400352+0000","last_clean":"2024-09-19T05:48:44.400352+0000","last_became_active":"2024-09-19T05:48:42.392507+0000","last_became_peered":"2024-09-19T05:48:42.392507+0000","last_unstale":"2024-09-19T05:48:44.400352+0000","last_undegraded":"2024-09-19T05:48:44.400352+0000","last_fullsized":"2024-09-19T05:48:44.400352+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:59.104953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782875+0000","last_change":"2024-09-19T05:48:43.448238+0000","last_active":"2024-09-19T05:48:44.782875+0000","last_peered":"2024-09-19T05:48:44.782875+0000","last_clean":"2024-09-19T05:48:44.782875+0000","last_became_active":"2024-09-19T05:48:43.447945+0000","last_became_peered":"2024-09-19T05:48:43.447945+0000","last_unstale":"2024-09-19T05:48:44.782875+0000","last_undegraded":"2024-09-19T05:48:44.782875+0000","last_fullsized":"2024-09-19T05:48:44.782875+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:26.569443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400226+0000","last_change":"2024-09-19T05:48:42.402586+0000","last_active":"2024-09-19T05:48:44.400226+0000","last_peered":"2024-09-19T05:48:44.400226+0000","last_clean":"2024-09-19T05:48:44.400226+0000","last_became_active":"2024-09-19T05:48:42.402273+0000","last_became_peered":"2024-09-19T05:48:42.402273+0000","last_unstale":"2024-09-19T05:48:44.400226+0000","last_undegraded":"2024-09-19T05:48:44.400226+0000","last_fullsized":"2024-09-19T05:48:44.400226+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:30.885834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383047+0000","last_change":"2024-09-19T05:48:42.383047+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383047+0000","last_undegraded":"2024-09-19T05:48:42.383047+0000","last_fullsized":"2024-09-19T05:48:42.383047+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.408375+0000","last_change":"2024-09-19T05:48:42.402825+0000","last_active":"2024-09-19T05:48:42.408375+0000","last_peered":"2024-09-19T05:48:42.408375+0000","last_clean":"2024-09-19T05:48:42.408375+0000","last_became_active":"2024-09-19T05:48:42.402113+0000","last_became_peered":"2024-09-19T05:48:42.402113+0000","last_unstale":"2024-09-19T05:48:42.408375+0000","last_undegraded":"2024-09-19T05:48:42.408375+0000","last_fullsized":"2024-09-19T05:48:42.408375+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:02.018087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783133+0000","last_change":"2024-09-19T05:48:43.411949+0000","last_active":"2024-09-19T05:48:44.783133+0000","last_peered":"2024-09-19T05:48:44.783133+0000","last_clean":"2024-09-19T05:48:44.783133+0000","last_became_active":"2024-09-19T05:48:43.411664+0000","last_became_peered":"2024-09-19T05:48:43.411664+0000","last_unstale":"2024-09-19T05:48:44.783133+0000","last_undegraded":"2024-09-19T05:48:44.783133+0000","last_fullsized":"2024-09-19T05:48:44.783133+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.815536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868895+0000","last_change":"2024-09-19T05:48:42.430481+0000","last_active":"2024-09-19T05:48:44.868895+0000","last_peered":"2024-09-19T05:48:44.868895+0000","last_clean":"2024-09-19T05:48:44.868895+0000","last_became_active":"2024-09-19T05:48:42.429578+0000","last_became_peered":"2024-09-19T05:48:42.429578+0000","last_unstale":"2024-09-19T05:48:44.868895+0000","last_undegraded":"2024-09-19T05:48:44.868895+0000","last_fullsized":"2024-09-19T05:48:44.868895+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:01.458679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600314+0000","last_change":"2024-09-19T05:48:43.428371+0000","last_active":"2024-09-19T05:48:44.600314+0000","last_peered":"2024-09-19T05:48:44.600314+0000","last_clean":"2024-09-19T05:48:44.600314+0000","last_became_active":"2024-09-19T05:48:43.427134+0000","last_became_peered":"2024-09-19T05:48:43.427134+0000","last_unstale":"2024-09-19T05:48:44.600314+0000","last_undegraded":"2024-09-19T05:48:44.600314+0000","last_fullsized":"2024-09-19T05:48:44.600314+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:49.485630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"205'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400594+0000","last_change":"2024-09-19T05:48:42.402888+0000","last_active":"2024-09-19T05:48:44.400594+0000","last_peered":"2024-09-19T05:48:44.400594+0000","last_clean":"2024-09-19T05:48:44.400594+0000","last_became_active":"2024-09-19T05:48:42.402425+0000","last_became_peered":"2024-09-19T05:48:42.402425+0000","last_unstale":"2024-09-19T05:48:44.400594+0000","last_undegraded":"2024-09-19T05:48:44.400594+0000","last_fullsized":"2024-09-19T05:48:44.400594+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:27.307738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.379070+0000","last_change":"2024-09-19T05:48:42.379070+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.379070+0000","last_undegraded":"2024-09-19T05:48:42.379070+0000","last_fullsized":"2024-09-19T05:48:42.379070+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.401016+0000","last_change":"2024-09-19T05:48:42.392461+0000","last_active":"2024-09-19T05:48:44.401016+0000","last_peered":"2024-09-19T05:48:44.401016+0000","last_clean":"2024-09-19T05:48:44.401016+0000","last_became_active":"2024-09-19T05:48:42.392083+0000","last_became_peered":"2024-09-19T05:48:42.392083+0000","last_unstale":"2024-09-19T05:48:44.401016+0000","last_undegraded":"2024-09-19T05:48:44.401016+0000","last_fullsized":"2024-09-19T05:48:44.401016+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:04.533503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.386365+0000","last_change":"2024-09-19T05:48:42.386365+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.386365+0000","last_undegraded":"2024-09-19T05:48:42.386365+0000","last_fullsized":"2024-09-19T05:48:42.386365+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868856+0000","last_change":"2024-09-19T05:48:42.412842+0000","last_active":"2024-09-19T05:48:44.868856+0000","last_peered":"2024-09-19T05:48:44.868856+0000","last_clean":"2024-09-19T05:48:44.868856+0000","last_became_active":"2024-09-19T05:48:42.412103+0000","last_became_peered":"2024-09-19T05:48:42.412103+0000","last_unstale":"2024-09-19T05:48:44.868856+0000","last_undegraded":"2024-09-19T05:48:44.868856+0000","last_fullsized":"2024-09-19T05:48:44.868856+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:27.071122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383350+0000","last_change":"2024-09-19T05:48:42.383350+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383350+0000","last_undegraded":"2024-09-19T05:48:42.383350+0000","last_fullsized":"2024-09-19T05:48:42.383350+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868282+0000","last_change":"2024-09-19T05:48:42.429925+0000","last_active":"2024-09-19T05:48:44.868282+0000","last_peered":"2024-09-19T05:48:44.868282+0000","last_clean":"2024-09-19T05:48:44.868282+0000","last_became_active":"2024-09-19T05:48:42.426314+0000","last_became_peered":"2024-09-19T05:48:42.426314+0000","last_unstale":"2024-09-19T05:48:44.868282+0000","last_undegraded":"2024-09-19T05:48:44.868282+0000","last_fullsized":"2024-09-19T05:48:44.868282+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:14.460190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382366+0000","last_change":"2024-09-19T05:48:42.382366+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382366+0000","last_undegraded":"2024-09-19T05:48:42.382366+0000","last_fullsized":"2024-09-19T05:48:42.382366+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.399269+0000","last_change":"2024-09-19T05:48:42.396864+0000","last_active":"2024-09-19T05:48:42.399269+0000","last_peered":"2024-09-19T05:48:42.399269+0000","last_clean":"2024-09-19T05:48:42.399269+0000","last_became_active":"2024-09-19T05:48:42.396113+0000","last_became_peered":"2024-09-19T05:48:42.396113+0000","last_unstale":"2024-09-19T05:48:42.399269+0000","last_undegraded":"2024-09-19T05:48:42.399269+0000","last_fullsized":"2024-09-19T05:48:42.399269+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:47.546752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.388465+0000","last_change":"2024-09-19T05:48:42.388465+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.388465+0000","last_undegraded":"2024-09-19T05:48:42.388465+0000","last_fullsized":"2024-09-19T05:48:42.388465+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599757+0000","last_change":"2024-09-19T05:48:42.410610+0000","last_active":"2024-09-19T05:48:44.599757+0000","last_peered":"2024-09-19T05:48:44.599757+0000","last_clean":"2024-09-19T05:48:44.599757+0000","last_became_active":"2024-09-19T05:48:42.409545+0000","last_became_peered":"2024-09-19T05:48:42.409545+0000","last_unstale":"2024-09-19T05:48:44.599757+0000","last_undegraded":"2024-09-19T05:48:44.599757+0000","last_fullsized":"2024-09-19T05:48:44.599757+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:58.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867663+0000","last_change":"2024-09-19T05:48:43.452913+0000","last_active":"2024-09-19T05:48:44.867663+0000","last_peered":"2024-09-19T05:48:44.867663+0000","last_clean":"2024-09-19T05:48:44.867663+0000","last_became_active":"2024-09-19T05:48:43.452362+0000","last_became_peered":"2024-09-19T05:48:43.452362+0000","last_unstale":"2024-09-19T05:48:44.867663+0000","last_undegraded":"2024-09-19T05:48:44.867663+0000","last_fullsized":"2024-09-19T05:48:44.867663+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:16.862927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867587+0000","last_change":"2024-09-19T05:48:42.430171+0000","last_active":"2024-09-19T05:48:44.867587+0000","last_peered":"2024-09-19T05:48:44.867587+0000","last_clean":"2024-09-19T05:48:44.867587+0000","last_became_active":"2024-09-19T05:48:42.427129+0000","last_became_peered":"2024-09-19T05:48:42.427129+0000","last_unstale":"2024-09-19T05:48:44.867587+0000","last_undegraded":"2024-09-19T05:48:44.867587+0000","last_fullsized":"2024-09-19T05:48:44.867587+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:12.337882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.399646+0000","last_change":"2024-09-19T05:48:42.399646+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.399646+0000","last_undegraded":"2024-09-19T05:48:42.399646+0000","last_fullsized":"2024-09-19T05:48:42.399646+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599624+0000","last_change":"2024-09-19T05:48:42.407348+0000","last_active":"2024-09-19T05:48:44.599624+0000","last_peered":"2024-09-19T05:48:44.599624+0000","last_clean":"2024-09-19T05:48:44.599624+0000","last_became_active":"2024-09-19T05:48:42.406620+0000","last_became_peered":"2024-09-19T05:48:42.406620+0000","last_unstale":"2024-09-19T05:48:44.599624+0000","last_undegraded":"2024-09-19T05:48:44.599624+0000","last_fullsized":"2024-09-19T05:48:44.599624+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:07.874926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":507,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599856+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:48:44.599856+0000","last_peered":"2024-09-19T05:48:44.599856+0000","last_clean":"2024-09-19T05:48:44.599856+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:48:44.599856+0000","last_undegraded":"2024-09-19T05:48:44.599856+0000","last_fullsized":"2024-09-19T05:48:44.599856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542335,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74564,"kb_used_data":3112,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297276,"statfs":{"total":96636764160,"available":96560410624,"internally_reserved":0,"allocated":3186688,"data_stored":1814320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542335,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73996,"kb_used_data":2548,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297844,"statfs":{"total":96636764160,"available":96560992256,"internally_reserved":0,"allocated":2609152,"data_stored":1225018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542336,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542334,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73932,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297908,"statfs":{"total":96636764160,"available":96561057792,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542335,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73868,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297972,"statfs":{"total":96636764160,"available":96561123328,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73932,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297908,"statfs":{"total":96636764160,"available":96561057792,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542338,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51764,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320076,"statfs":{"total":96636764160,"available":96583757824,"internally_reserved":0,"allocated":2584576,"data_stored":1223280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542335,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78708,"kb_used_data":3104,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293132,"statfs":{"total":96636764160,"available":96556167168,"internally_reserved":0,"allocated":3178496,"data_stored":1813648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:48:48.231 INFO:tasks.ceph.ceph_manager.ceph:PG 30.3d is not active+clean 2024-09-19T05:48:48.231 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.398878+0000', 'last_change': '2024-09-19T05:48:42.398878+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.398878+0000', 'last_undegraded': '2024-09-19T05:48:42.398878+0000', 'last_fullsized': '2024-09-19T05:48:42.398878+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.231 INFO:tasks.ceph.ceph_manager.ceph:PG 30.3c is not active+clean 2024-09-19T05:48:48.231 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.388063+0000', 'last_change': '2024-09-19T05:48:42.388063+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.388063+0000', 'last_undegraded': '2024-09-19T05:48:42.388063+0000', 'last_fullsized': '2024-09-19T05:48:42.388063+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:48:48.231 INFO:tasks.ceph.ceph_manager.ceph:PG 30.3a is not active+clean 2024-09-19T05:48:48.231 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.383369+0000', 'last_change': '2024-09-19T05:48:42.383369+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.383369+0000', 'last_undegraded': '2024-09-19T05:48:42.383369+0000', 'last_fullsized': '2024-09-19T05:48:42.383369+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:48:48.231 INFO:tasks.ceph.ceph_manager.ceph:PG 30.39 is not active+clean 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.394371+0000', 'last_change': '2024-09-19T05:48:42.394371+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.394371+0000', 'last_undegraded': '2024-09-19T05:48:42.394371+0000', 'last_fullsized': '2024-09-19T05:48:42.394371+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:PG 30.38 is not active+clean 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.381725+0000', 'last_change': '2024-09-19T05:48:42.381725+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.381725+0000', 'last_undegraded': '2024-09-19T05:48:42.381725+0000', 'last_fullsized': '2024-09-19T05:48:42.381725+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:PG 30.37 is not active+clean 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.399645+0000', 'last_change': '2024-09-19T05:48:42.399645+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.399645+0000', 'last_undegraded': '2024-09-19T05:48:42.399645+0000', 'last_fullsized': '2024-09-19T05:48:42.399645+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:PG 30.36 is not active+clean 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.397789+0000', 'last_change': '2024-09-19T05:48:42.397789+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.397789+0000', 'last_undegraded': '2024-09-19T05:48:42.397789+0000', 'last_fullsized': '2024-09-19T05:48:42.397789+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:PG 30.35 is not active+clean 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.390013+0000', 'last_change': '2024-09-19T05:48:42.390013+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.390013+0000', 'last_undegraded': '2024-09-19T05:48:42.390013+0000', 'last_fullsized': '2024-09-19T05:48:42.390013+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:PG 30.33 is not active+clean 2024-09-19T05:48:48.232 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.379145+0000', 'last_change': '2024-09-19T05:48:42.379145+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.379145+0000', 'last_undegraded': '2024-09-19T05:48:42.379145+0000', 'last_fullsized': '2024-09-19T05:48:42.379145+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:PG 30.30 is not active+clean 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.380643+0000', 'last_change': '2024-09-19T05:48:42.380643+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.380643+0000', 'last_undegraded': '2024-09-19T05:48:42.380643+0000', 'last_fullsized': '2024-09-19T05:48:42.380643+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:PG 30.2e is not active+clean 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.396695+0000', 'last_change': '2024-09-19T05:48:42.396695+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.396695+0000', 'last_undegraded': '2024-09-19T05:48:42.396695+0000', 'last_fullsized': '2024-09-19T05:48:42.396695+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:PG 30.2c is not active+clean 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.381075+0000', 'last_change': '2024-09-19T05:48:42.381075+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.381075+0000', 'last_undegraded': '2024-09-19T05:48:42.381075+0000', 'last_fullsized': '2024-09-19T05:48:42.381075+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:PG 30.2b is not active+clean 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.393132+0000', 'last_change': '2024-09-19T05:48:42.393132+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.393132+0000', 'last_undegraded': '2024-09-19T05:48:42.393132+0000', 'last_fullsized': '2024-09-19T05:48:42.393132+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:PG 30.29 is not active+clean 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.398031+0000', 'last_change': '2024-09-19T05:48:42.398031+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.398031+0000', 'last_undegraded': '2024-09-19T05:48:42.398031+0000', 'last_fullsized': '2024-09-19T05:48:42.398031+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:48:48.233 INFO:tasks.ceph.ceph_manager.ceph:PG 30.26 is not active+clean 2024-09-19T05:48:48.234 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.395520+0000', 'last_change': '2024-09-19T05:48:42.395520+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.395520+0000', 'last_undegraded': '2024-09-19T05:48:42.395520+0000', 'last_fullsized': '2024-09-19T05:48:42.395520+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.234 INFO:tasks.ceph.ceph_manager.ceph:PG 30.25 is not active+clean 2024-09-19T05:48:48.234 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.387834+0000', 'last_change': '2024-09-19T05:48:42.387834+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.387834+0000', 'last_undegraded': '2024-09-19T05:48:42.387834+0000', 'last_fullsized': '2024-09-19T05:48:42.387834+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:48:48.234 INFO:tasks.ceph.ceph_manager.ceph:PG 30.22 is not active+clean 2024-09-19T05:48:48.234 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.384409+0000', 'last_change': '2024-09-19T05:48:42.384409+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.384409+0000', 'last_undegraded': '2024-09-19T05:48:42.384409+0000', 'last_fullsized': '2024-09-19T05:48:42.384409+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:48:48.234 INFO:tasks.ceph.ceph_manager.ceph:PG 30.21 is not active+clean 2024-09-19T05:48:48.234 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.387413+0000', 'last_change': '2024-09-19T05:48:42.387413+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.387413+0000', 'last_undegraded': '2024-09-19T05:48:42.387413+0000', 'last_fullsized': '2024-09-19T05:48:42.387413+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:48:48.234 INFO:tasks.ceph.ceph_manager.ceph:PG 30.20 is not active+clean 2024-09-19T05:48:48.234 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.378949+0000', 'last_change': '2024-09-19T05:48:42.378949+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.378949+0000', 'last_undegraded': '2024-09-19T05:48:42.378949+0000', 'last_fullsized': '2024-09-19T05:48:42.378949+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:48:48.234 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1c is not active+clean 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.383884+0000', 'last_change': '2024-09-19T05:48:42.383884+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.383884+0000', 'last_undegraded': '2024-09-19T05:48:42.383884+0000', 'last_fullsized': '2024-09-19T05:48:42.383884+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1d is not active+clean 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.382803+0000', 'last_change': '2024-09-19T05:48:42.382803+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.382803+0000', 'last_undegraded': '2024-09-19T05:48:42.382803+0000', 'last_fullsized': '2024-09-19T05:48:42.382803+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 30.18 is not active+clean 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.383959+0000', 'last_change': '2024-09-19T05:48:42.383959+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.383959+0000', 'last_undegraded': '2024-09-19T05:48:42.383959+0000', 'last_fullsized': '2024-09-19T05:48:42.383959+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1b is not active+clean 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.384392+0000', 'last_change': '2024-09-19T05:48:42.384392+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.384392+0000', 'last_undegraded': '2024-09-19T05:48:42.384392+0000', 'last_fullsized': '2024-09-19T05:48:42.384392+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 30.16 is not active+clean 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.384235+0000', 'last_change': '2024-09-19T05:48:42.384235+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.384235+0000', 'last_undegraded': '2024-09-19T05:48:42.384235+0000', 'last_fullsized': '2024-09-19T05:48:42.384235+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:PG 30.17 is not active+clean 2024-09-19T05:48:48.235 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.387790+0000', 'last_change': '2024-09-19T05:48:42.387790+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.387790+0000', 'last_undegraded': '2024-09-19T05:48:42.387790+0000', 'last_fullsized': '2024-09-19T05:48:42.387790+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 30.12 is not active+clean 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.382692+0000', 'last_change': '2024-09-19T05:48:42.382692+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.382692+0000', 'last_undegraded': '2024-09-19T05:48:42.382692+0000', 'last_fullsized': '2024-09-19T05:48:42.382692+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 30.e is not active+clean 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.383136+0000', 'last_change': '2024-09-19T05:48:42.383136+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.383136+0000', 'last_undegraded': '2024-09-19T05:48:42.383136+0000', 'last_fullsized': '2024-09-19T05:48:42.383136+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 30.b is not active+clean 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.383047+0000', 'last_change': '2024-09-19T05:48:42.383047+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.383047+0000', 'last_undegraded': '2024-09-19T05:48:42.383047+0000', 'last_fullsized': '2024-09-19T05:48:42.383047+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 30.6 is not active+clean 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.379070+0000', 'last_change': '2024-09-19T05:48:42.379070+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.379070+0000', 'last_undegraded': '2024-09-19T05:48:42.379070+0000', 'last_fullsized': '2024-09-19T05:48:42.379070+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 30.7 is not active+clean 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.386365+0000', 'last_change': '2024-09-19T05:48:42.386365+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.386365+0000', 'last_undegraded': '2024-09-19T05:48:42.386365+0000', 'last_fullsized': '2024-09-19T05:48:42.386365+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:48:48.236 INFO:tasks.ceph.ceph_manager.ceph:PG 30.0 is not active+clean 2024-09-19T05:48:48.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.383350+0000', 'last_change': '2024-09-19T05:48:42.383350+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.383350+0000', 'last_undegraded': '2024-09-19T05:48:42.383350+0000', 'last_fullsized': '2024-09-19T05:48:42.383350+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.237 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1 is not active+clean 2024-09-19T05:48:48.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.382366+0000', 'last_change': '2024-09-19T05:48:42.382366+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.382366+0000', 'last_undegraded': '2024-09-19T05:48:42.382366+0000', 'last_fullsized': '2024-09-19T05:48:42.382366+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.237 INFO:tasks.ceph.ceph_manager.ceph:PG 30.2 is not active+clean 2024-09-19T05:48:48.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.388465+0000', 'last_change': '2024-09-19T05:48:42.388465+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.388465+0000', 'last_undegraded': '2024-09-19T05:48:42.388465+0000', 'last_fullsized': '2024-09-19T05:48:42.388465+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T05:48:48.237 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1f is not active+clean 2024-09-19T05:48:48.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 203, 'state': 'creating+peering', 'last_fresh': '2024-09-19T05:48:42.399646+0000', 'last_change': '2024-09-19T05:48:42.399646+0000', 'last_active': '2024-09-19T05:48:42.359565+0000', 'last_peered': '2024-09-19T05:48:42.359565+0000', 'last_clean': '2024-09-19T05:48:42.359565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T05:48:42.399646+0000', 'last_undegraded': '2024-09-19T05:48:42.399646+0000', 'last_fullsized': '2024-09-19T05:48:42.399646+0000', 'mapping_epoch': 203, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 203, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'last_clean_scrub_stamp': '2024-09-19T05:48:42.359565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T05:48:48.238 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T05:48:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb546f1c640 1 Processor -- start 2024-09-19T05:48:48.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb546f1c640 1 -- start start 2024-09-19T05:48:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb546f1c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb54015eb20 0x7fb5401657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb546f1c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54015ac90 con 0x7fb54015f040 2024-09-19T05:48:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb546f1c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb540070d90 con 0x7fb54015a8b0 2024-09-19T05:48:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb546f1c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb540071070 con 0x7fb54015eb20 2024-09-19T05:48:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb5454b9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb54015eb20 0x7fb5401657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb53ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb54015f040 0x7fb54015e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55146/0 (socket says 172.21.15.67:55146) 2024-09-19T05:48:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb53ffff640 1 -- 172.21.15.67:0/1319451971 learned_addr learned my addr 172.21.15.67:0/1319451971 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:48.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb5454b9640 1 -- 172.21.15.67:0/1319451971 >> v1:172.21.15.97:6789/0 conn(0x7fb54015a8b0 legacy=0x7fb5400cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb5454b9640 1 -- 172.21.15.67:0/1319451971 >> v1:172.21.15.67:6789/0 conn(0x7fb54015f040 legacy=0x7fb54015e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb53f7fe640 1 -- 172.21.15.67:0/1319451971 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211285327 0 0) 0x7fb54015ac90 con 0x7fb54015f040 2024-09-19T05:48:48.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.393+0000 7fb5454b9640 1 -- 172.21.15.67:0/1319451971 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5400cfbc0 con 0x7fb54015eb20 2024-09-19T05:48:48.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb5454b9640 1 --2- 172.21.15.67:0/1319451971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 0x7fb5401657a0 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7fb5380097c0 tx=0x7fb53801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955a4eb5626405b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:48.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb53f7fe640 1 -- 172.21.15.67:0/1319451971 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5380b0070 con 0x7fb54015eb20 2024-09-19T05:48:48.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb53f7fe640 1 -- 172.21.15.67:0/1319451971 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5380ab600 con 0x7fb54015eb20 2024-09-19T05:48:48.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb53f7fe640 1 -- 172.21.15.67:0/1319451971 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5380ab9d0 con 0x7fb54015eb20 2024-09-19T05:48:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb546f1c640 1 -- 172.21.15.67:0/1319451971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 msgr2=0x7fb5401657a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb546f1c640 1 --2- 172.21.15.67:0/1319451971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 0x7fb5401657a0 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7fb5380097c0 tx=0x7fb53801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb546f1c640 1 -- 172.21.15.67:0/1319451971 shutdown_connections 2024-09-19T05:48:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb546f1c640 1 --2- 172.21.15.67:0/1319451971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 0x7fb5401657a0 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb546f1c640 1 -- 172.21.15.67:0/1319451971 >> 172.21.15.67:0/1319451971 conn(0x7fb540073500 msgr2=0x7fb54006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:48.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb546f1c640 1 -- 172.21.15.67:0/1319451971 shutdown_connections 2024-09-19T05:48:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb546f1c640 1 -- 172.21.15.67:0/1319451971 wait complete. 2024-09-19T05:48:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb546f1c640 1 Processor -- start 2024-09-19T05:48:48.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.397+0000 7fb546f1c640 1 -- start start 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb546f1c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb54015a8b0 0x7fb54014a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb546f1c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 0x7fb540145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb546f1c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54015f040 0x7fb54015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb546f1c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb540167e80 con 0x7fb54015eb20 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb546f1c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb540167d00 con 0x7fb54015a8b0 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb546f1c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb540168000 con 0x7fb54015f040 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 0x7fb540145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 0x7fb540145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42518/0 (socket says 172.21.15.67:42518) 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53ffff640 1 -- 172.21.15.67:0/2913422561 learned_addr learned my addr 172.21.15.67:0/2913422561 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb544cb8640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb54015a8b0 0x7fb54014a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb5454b9640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54015f040 0x7fb54015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53ffff640 1 -- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54015f040 msgr2=0x7fb54015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53ffff640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54015f040 0x7fb54015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53ffff640 1 -- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb54015a8b0 msgr2=0x7fb54014a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53ffff640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb54015a8b0 0x7fb54014a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53ffff640 1 -- 172.21.15.67:0/2913422561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54014ae80 con 0x7fb54015eb20 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb5454b9640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54015f040 0x7fb54015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53ffff640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 0x7fb540145540 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7fb52800cad0 tx=0x7fb52800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53d7fa640 1 -- 172.21.15.67:0/2913422561 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52800ac30 con 0x7fb54015eb20 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53d7fa640 1 -- 172.21.15.67:0/2913422561 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb52800add0 con 0x7fb54015eb20 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb546f1c640 1 -- 172.21.15.67:0/2913422561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54014d440 con 0x7fb54015eb20 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53d7fa640 1 -- 172.21.15.67:0/2913422561 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528012640 con 0x7fb54015eb20 2024-09-19T05:48:48.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb546f1c640 1 -- 172.21.15.67:0/2913422561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb54014da00 con 0x7fb54015eb20 2024-09-19T05:48:48.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb546f1c640 1 -- 172.21.15.67:0/2913422561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5400cd560 con 0x7fb54015eb20 2024-09-19T05:48:48.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53d7fa640 1 -- 172.21.15.67:0/2913422561 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5280127e0 con 0x7fb54015eb20 2024-09-19T05:48:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53d7fa640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5200678c0 0x7fb520069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb53d7fa640 1 -- 172.21.15.67:0/2913422561 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7fb528086570 con 0x7fb54015eb20 2024-09-19T05:48:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.401+0000 7fb544cb8640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5200678c0 0x7fb520069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.405+0000 7fb544cb8640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5200678c0 0x7fb520069d80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb54015d120 tx=0x7fb530009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:48.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.405+0000 7fb53d7fa640 1 -- 172.21.15.67:0/2913422561 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb528056e80 con 0x7fb54015eb20 2024-09-19T05:48:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.633+0000 7fb546f1c640 1 -- 172.21.15.67:0/2913422561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb5400b5d60 con 0x7fb54015eb20 2024-09-19T05:48:48.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb53d7fa640 1 -- 172.21.15.67:0/2913422561 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2954 (secure 0 0 0) 0x7fb528056780 con 0x7fb54015eb20 2024-09-19T05:48:48.636 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:48.636 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":958,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":205,"num_osds":8,"num_up_osds":8,"osd_up_since":1726723982,"num_in_osds":8,"osd_in_since":1726723972,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":63},{"state_name":"creating+peering","count":34}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":590562,"bytes_used":565751808,"bytes_avail":772528361472,"bytes_total":773094113280,"inactive_pgs_ratio":0.3505154550075531,"write_bytes_sec":1534,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":146,"btime":"2024-09-19T05:48:46:398467+0000","id":14,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":14,"rank":0,"name":"c","status":"up:active","gid":10845}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-19T05:48:31.429611+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T05:48:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 -- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5200678c0 msgr2=0x7fb520069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5200678c0 0x7fb520069d80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb54015d120 tx=0x7fb530009040 comp rx=0 tx=0).stop 2024-09-19T05:48:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 -- 172.21.15.67:0/2913422561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 msgr2=0x7fb540145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 0x7fb540145540 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7fb52800cad0 tx=0x7fb52800cf90 comp rx=0 tx=0).stop 2024-09-19T05:48:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 -- 172.21.15.67:0/2913422561 shutdown_connections 2024-09-19T05:48:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb5200678c0 0x7fb520069d80 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb54015f040 0x7fb54015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54015eb20 0x7fb540145540 unknown :-1 s=CLOSED pgs=2448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 --2- 172.21.15.67:0/2913422561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb54015a8b0 0x7fb54014a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 -- 172.21.15.67:0/2913422561 >> 172.21.15.67:0/2913422561 conn(0x7fb540073500 msgr2=0x7fb5400b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 -- 172.21.15.67:0/2913422561 shutdown_connections 2024-09-19T05:48:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.637+0000 7fb546f1c640 1 -- 172.21.15.67:0/2913422561 wait complete. 2024-09-19T05:48:48.656 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T05:48:48.656 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:48:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3fa929640 1 Processor -- start 2024-09-19T05:48:48.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3fa929640 1 -- start start 2024-09-19T05:48:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3fa929640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f415c030 0x7ff3f406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3fa929640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f406e3c0 con 0x7ff3f406f460 2024-09-19T05:48:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3fa929640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f406e6a0 con 0x7ff3f415d1d0 2024-09-19T05:48:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3fa929640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f406e980 con 0x7ff3f415c030 2024-09-19T05:48:48.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f8ec6640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff3f406f460 0x7ff3f40acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55148/0 (socket says 172.21.15.67:55148) 2024-09-19T05:48:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f8ec6640 1 -- 172.21.15.67:0/26868805 learned_addr learned my addr 172.21.15.67:0/26868805 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f3fff640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f415c030 0x7ff3f406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005829637 0 0) 0x7ff3f406e3c0 con 0x7ff3f406f460 2024-09-19T05:48:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3dc003530 con 0x7ff3f406f460 2024-09-19T05:48:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3192031935 0 0) 0x7ff3dc003530 con 0x7ff3f406f460 2024-09-19T05:48:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f415c030 msgr2=0x7ff3f406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f415c030 0x7ff3f406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 >> v1:172.21.15.97:6789/0 conn(0x7ff3f415d1d0 legacy=0x7ff3f40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f406ec60 con 0x7ff3f406f460 2024-09-19T05:48:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7ff3ec001a00 con 0x7ff3f406f460 2024-09-19T05:48:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 >> v1:172.21.15.67:6789/0 conn(0x7ff3f406f460 legacy=0x7ff3f40acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f415c030 0x7ff3dc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3dc003f30 0x7ff3dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3dc004d50 0x7ff3dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f406e980 con 0x7ff3dc004d50 2024-09-19T05:48:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc00ba30 con 0x7ff3dc003f30 2024-09-19T05:48:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff3dc00bc30 con 0x7ff3f415c030 2024-09-19T05:48:48.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f8ec6640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3dc004d50 0x7ff3dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f3fff640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f415c030 0x7ff3dc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f37fe640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3dc003f30 0x7ff3dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f8ec6640 1 -- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f415c030 msgr2=0x7ff3dc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f8ec6640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f415c030 0x7ff3dc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f8ec6640 1 -- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3dc003f30 msgr2=0x7ff3dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f8ec6640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3dc003f30 0x7ff3dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.781+0000 7ff3f8ec6640 1 -- 172.21.15.67:0/26868805 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc003530 con 0x7ff3dc004d50 2024-09-19T05:48:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3f8ec6640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3dc004d50 0x7ff3dc0051d0 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00a860 tx=0x7ff3ec01fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5794dfc7ff8d683f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00a480 con 0x7ff3dc004d50 2024-09-19T05:48:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec0aa6f0 con 0x7ff3dc004d50 2024-09-19T05:48:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3f2ffd640 1 -- 172.21.15.67:0/26868805 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec0aab40 con 0x7ff3dc004d50 2024-09-19T05:48:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3fa929640 1 -- 172.21.15.67:0/26868805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3dc004d50 msgr2=0x7ff3dc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3fa929640 1 --2- 172.21.15.67:0/26868805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3dc004d50 0x7ff3dc0051d0 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00a860 tx=0x7ff3ec01fac0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3f8ec6640 1 -- 172.21.15.67:0/26868805 reap_dead start 2024-09-19T05:48:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3fa929640 1 -- 172.21.15.67:0/26868805 shutdown_connections 2024-09-19T05:48:48.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3fa929640 1 -- 172.21.15.67:0/26868805 >> 172.21.15.67:0/26868805 conn(0x7ff3f40d0080 msgr2=0x7ff3f40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3fa929640 1 -- 172.21.15.67:0/26868805 shutdown_connections 2024-09-19T05:48:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3fa929640 1 -- 172.21.15.67:0/26868805 wait complete. 2024-09-19T05:48:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3fa929640 1 Processor -- start 2024-09-19T05:48:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.785+0000 7ff3fa929640 1 -- start start 2024-09-19T05:48:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3fa929640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3dc004d50 0x7ff3f41f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3fa929640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f4155550 0x7ff3f41515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3fa929640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3f41f4b90 0x7ff3f4151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3fa929640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40b36e0 con 0x7ff3f41f4b90 2024-09-19T05:48:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3fa929640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f415d630 con 0x7ff3f4155550 2024-09-19T05:48:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3fa929640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f4150310 con 0x7ff3dc004d50 2024-09-19T05:48:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f8ec6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3f41f4b90 0x7ff3f4151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f8ec6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3f41f4b90 0x7ff3f4151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42538/0 (socket says 172.21.15.67:42538) 2024-09-19T05:48:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f8ec6640 1 -- 172.21.15.67:0/2654614775 learned_addr learned my addr 172.21.15.67:0/2654614775 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f8ec6640 1 -- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3dc004d50 msgr2=0x7ff3f41f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f8ec6640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3dc004d50 0x7ff3f41f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f8ec6640 1 -- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f4155550 msgr2=0x7ff3f41515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f8ec6640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f4155550 0x7ff3f41515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f8ec6640 1 -- 172.21.15.67:0/2654614775 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f4150560 con 0x7ff3f41f4b90 2024-09-19T05:48:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f8ec6640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3f41f4b90 0x7ff3f4151b20 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec020360 tx=0x7ff3dc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f0ff9640 1 -- 172.21.15.67:0/2654614775 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00a480 con 0x7ff3f41f4b90 2024-09-19T05:48:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f0ff9640 1 -- 172.21.15.67:0/2654614775 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec0b8070 con 0x7ff3f41f4b90 2024-09-19T05:48:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f0ff9640 1 -- 172.21.15.67:0/2654614775 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec001fe0 con 0x7ff3f41f4b90 2024-09-19T05:48:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3fa929640 1 -- 172.21.15.67:0/2654614775 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f4150840 con 0x7ff3f41f4b90 2024-09-19T05:48:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3fa929640 1 -- 172.21.15.67:0/2654614775 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f4150e00 con 0x7ff3f41f4b90 2024-09-19T05:48:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3fa929640 1 -- 172.21.15.67:0/2654614775 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f415cbd0 con 0x7ff3f41f4b90 2024-09-19T05:48:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f0ff9640 1 -- 172.21.15.67:0/2654614775 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3ec004b70 con 0x7ff3f41f4b90 2024-09-19T05:48:48.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f0ff9640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3e00678c0 0x7ff3e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:48.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f0ff9640 1 -- 172.21.15.67:0/2654614775 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7ff3ec1233c0 con 0x7ff3f41f4b90 2024-09-19T05:48:48.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.789+0000 7ff3f3fff640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3e00678c0 0x7ff3e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:48.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.793+0000 7ff3f3fff640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3e00678c0 0x7ff3e0069d80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009ad0 tx=0x7ff3e80095f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:48.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.793+0000 7ff3f0ff9640 1 -- 172.21.15.67:0/2654614775 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7ff3ec0c4030 con 0x7ff3f41f4b90 2024-09-19T05:48:48.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.953+0000 7ff3fa929640 1 -- 172.21.15.67:0/2654614775 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3f40b4f40 con 0x7ff3e00678c0 2024-09-19T05:48:48.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.973+0000 7ff3f0ff9640 1 -- 172.21.15.67:0/2654614775 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249651 (secure 0 0 0) 0x7ff3f40b4f40 con 0x7ff3e00678c0 2024-09-19T05:48:48.975 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:48.984 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:48:48.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 -- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3e00678c0 msgr2=0x7ff3e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3e00678c0 0x7ff3e0069d80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009ad0 tx=0x7ff3e80095f0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 -- 172.21.15.67:0/2654614775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3f41f4b90 msgr2=0x7ff3f4151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3f41f4b90 0x7ff3f4151b20 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec020360 tx=0x7ff3dc005840 comp rx=0 tx=0).stop 2024-09-19T05:48:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 -- 172.21.15.67:0/2654614775 shutdown_connections 2024-09-19T05:48:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3f41f4b90 0x7ff3f4151b20 unknown :-1 s=CLOSED pgs=2451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f4155550 0x7ff3f41515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7ff3e00678c0 0x7ff3e0069d80 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 --2- 172.21.15.67:0/2654614775 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3dc004d50 0x7ff3f41f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 -- 172.21.15.67:0/2654614775 >> 172.21.15.67:0/2654614775 conn(0x7ff3f40d0080 msgr2=0x7ff3f40af470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 -- 172.21.15.67:0/2654614775 shutdown_connections 2024-09-19T05:48:48.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:48.977+0000 7ff3fa929640 1 -- 172.21.15.67:0/2654614775 wait complete. 2024-09-19T05:48:48.995 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":671,"stamp":"2024-09-19T05:48:47.436345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590562,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":552492,"kb_used_data":21240,"kb_used_omap":12,"kb_used_meta":531059,"kb_avail":754422228,"statfs":{"total":773094113280,"available":772528361472,"internally_reserved":0,"allocated":21749760,"data_stored":10887282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":543804977},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.004006"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600294+0000","last_change":"2024-09-19T05:48:43.428484+0000","last_active":"2024-09-19T05:48:44.600294+0000","last_peered":"2024-09-19T05:48:44.600294+0000","last_clean":"2024-09-19T05:48:44.600294+0000","last_became_active":"2024-09-19T05:48:43.427731+0000","last_became_peered":"2024-09-19T05:48:43.427731+0000","last_unstale":"2024-09-19T05:48:44.600294+0000","last_undegraded":"2024-09-19T05:48:44.600294+0000","last_fullsized":"2024-09-19T05:48:44.600294+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:01.627681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783364+0000","last_change":"2024-09-19T05:48:43.406998+0000","last_active":"2024-09-19T05:48:44.783364+0000","last_peered":"2024-09-19T05:48:44.783364+0000","last_clean":"2024-09-19T05:48:44.783364+0000","last_became_active":"2024-09-19T05:48:43.404769+0000","last_became_peered":"2024-09-19T05:48:43.404769+0000","last_unstale":"2024-09-19T05:48:44.783364+0000","last_undegraded":"2024-09-19T05:48:44.783364+0000","last_fullsized":"2024-09-19T05:48:44.783364+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:13.589670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.398878+0000","last_change":"2024-09-19T05:48:42.398878+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.398878+0000","last_undegraded":"2024-09-19T05:48:42.398878+0000","last_fullsized":"2024-09-19T05:48:42.398878+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.388063+0000","last_change":"2024-09-19T05:48:42.388063+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.388063+0000","last_undegraded":"2024-09-19T05:48:42.388063+0000","last_fullsized":"2024-09-19T05:48:42.388063+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599773+0000","last_change":"2024-09-19T05:48:43.401953+0000","last_active":"2024-09-19T05:48:44.599773+0000","last_peered":"2024-09-19T05:48:44.599773+0000","last_clean":"2024-09-19T05:48:44.599773+0000","last_became_active":"2024-09-19T05:48:43.401185+0000","last_became_peered":"2024-09-19T05:48:43.401185+0000","last_unstale":"2024-09-19T05:48:44.599773+0000","last_undegraded":"2024-09-19T05:48:44.599773+0000","last_fullsized":"2024-09-19T05:48:44.599773+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:59.221775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383369+0000","last_change":"2024-09-19T05:48:42.383369+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383369+0000","last_undegraded":"2024-09-19T05:48:42.383369+0000","last_fullsized":"2024-09-19T05:48:42.383369+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.394371+0000","last_change":"2024-09-19T05:48:42.394371+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.394371+0000","last_undegraded":"2024-09-19T05:48:42.394371+0000","last_fullsized":"2024-09-19T05:48:42.394371+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.381725+0000","last_change":"2024-09-19T05:48:42.381725+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.381725+0000","last_undegraded":"2024-09-19T05:48:42.381725+0000","last_fullsized":"2024-09-19T05:48:42.381725+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.399645+0000","last_change":"2024-09-19T05:48:42.399645+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.399645+0000","last_undegraded":"2024-09-19T05:48:42.399645+0000","last_fullsized":"2024-09-19T05:48:42.399645+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.397789+0000","last_change":"2024-09-19T05:48:42.397789+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.397789+0000","last_undegraded":"2024-09-19T05:48:42.397789+0000","last_fullsized":"2024-09-19T05:48:42.397789+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.390013+0000","last_change":"2024-09-19T05:48:42.390013+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.390013+0000","last_undegraded":"2024-09-19T05:48:42.390013+0000","last_fullsized":"2024-09-19T05:48:42.390013+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868599+0000","last_change":"2024-09-19T05:48:43.445279+0000","last_active":"2024-09-19T05:48:44.868599+0000","last_peered":"2024-09-19T05:48:44.868599+0000","last_clean":"2024-09-19T05:48:44.868599+0000","last_became_active":"2024-09-19T05:48:43.443235+0000","last_became_peered":"2024-09-19T05:48:43.443235+0000","last_unstale":"2024-09-19T05:48:44.868599+0000","last_undegraded":"2024-09-19T05:48:44.868599+0000","last_fullsized":"2024-09-19T05:48:44.868599+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:12.067057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.379145+0000","last_change":"2024-09-19T05:48:42.379145+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.379145+0000","last_undegraded":"2024-09-19T05:48:42.379145+0000","last_fullsized":"2024-09-19T05:48:42.379145+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867568+0000","last_change":"2024-09-19T05:48:43.435859+0000","last_active":"2024-09-19T05:48:44.867568+0000","last_peered":"2024-09-19T05:48:44.867568+0000","last_clean":"2024-09-19T05:48:44.867568+0000","last_became_active":"2024-09-19T05:48:43.434858+0000","last_became_peered":"2024-09-19T05:48:43.434858+0000","last_unstale":"2024-09-19T05:48:44.867568+0000","last_undegraded":"2024-09-19T05:48:44.867568+0000","last_fullsized":"2024-09-19T05:48:44.867568+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.765450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400513+0000","last_change":"2024-09-19T05:48:43.405560+0000","last_active":"2024-09-19T05:48:44.400513+0000","last_peered":"2024-09-19T05:48:44.400513+0000","last_clean":"2024-09-19T05:48:44.400513+0000","last_became_active":"2024-09-19T05:48:43.405181+0000","last_became_peered":"2024-09-19T05:48:43.405181+0000","last_unstale":"2024-09-19T05:48:44.400513+0000","last_undegraded":"2024-09-19T05:48:44.400513+0000","last_fullsized":"2024-09-19T05:48:44.400513+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:39.032330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.380643+0000","last_change":"2024-09-19T05:48:42.380643+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.380643+0000","last_undegraded":"2024-09-19T05:48:42.380643+0000","last_fullsized":"2024-09-19T05:48:42.380643+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868635+0000","last_change":"2024-09-19T05:48:43.445682+0000","last_active":"2024-09-19T05:48:44.868635+0000","last_peered":"2024-09-19T05:48:44.868635+0000","last_clean":"2024-09-19T05:48:44.868635+0000","last_became_active":"2024-09-19T05:48:43.445097+0000","last_became_peered":"2024-09-19T05:48:43.445097+0000","last_unstale":"2024-09-19T05:48:44.868635+0000","last_undegraded":"2024-09-19T05:48:44.868635+0000","last_fullsized":"2024-09-19T05:48:44.868635+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:21.827527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.396695+0000","last_change":"2024-09-19T05:48:42.396695+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.396695+0000","last_undegraded":"2024-09-19T05:48:42.396695+0000","last_fullsized":"2024-09-19T05:48:42.396695+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599639+0000","last_change":"2024-09-19T05:48:43.419947+0000","last_active":"2024-09-19T05:48:44.599639+0000","last_peered":"2024-09-19T05:48:44.599639+0000","last_clean":"2024-09-19T05:48:44.599639+0000","last_became_active":"2024-09-19T05:48:43.408971+0000","last_became_peered":"2024-09-19T05:48:43.408971+0000","last_unstale":"2024-09-19T05:48:44.599639+0000","last_undegraded":"2024-09-19T05:48:44.599639+0000","last_fullsized":"2024-09-19T05:48:44.599639+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:56.260686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.381075+0000","last_change":"2024-09-19T05:48:42.381075+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.381075+0000","last_undegraded":"2024-09-19T05:48:42.381075+0000","last_fullsized":"2024-09-19T05:48:42.381075+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.393132+0000","last_change":"2024-09-19T05:48:42.393132+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.393132+0000","last_undegraded":"2024-09-19T05:48:42.393132+0000","last_fullsized":"2024-09-19T05:48:42.393132+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400253+0000","last_change":"2024-09-19T05:48:43.422670+0000","last_active":"2024-09-19T05:48:44.400253+0000","last_peered":"2024-09-19T05:48:44.400253+0000","last_clean":"2024-09-19T05:48:44.400253+0000","last_became_active":"2024-09-19T05:48:43.422215+0000","last_became_peered":"2024-09-19T05:48:43.422215+0000","last_unstale":"2024-09-19T05:48:44.400253+0000","last_undegraded":"2024-09-19T05:48:44.400253+0000","last_fullsized":"2024-09-19T05:48:44.400253+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:49.485630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.398031+0000","last_change":"2024-09-19T05:48:42.398031+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.398031+0000","last_undegraded":"2024-09-19T05:48:42.398031+0000","last_fullsized":"2024-09-19T05:48:42.398031+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599585+0000","last_change":"2024-09-19T05:48:43.402276+0000","last_active":"2024-09-19T05:48:44.599585+0000","last_peered":"2024-09-19T05:48:44.599585+0000","last_clean":"2024-09-19T05:48:44.599585+0000","last_became_active":"2024-09-19T05:48:43.401561+0000","last_became_peered":"2024-09-19T05:48:43.401561+0000","last_unstale":"2024-09-19T05:48:44.599585+0000","last_undegraded":"2024-09-19T05:48:44.599585+0000","last_fullsized":"2024-09-19T05:48:44.599585+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:50.285249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600487+0000","last_change":"2024-09-19T05:48:43.406290+0000","last_active":"2024-09-19T05:48:44.600487+0000","last_peered":"2024-09-19T05:48:44.600487+0000","last_clean":"2024-09-19T05:48:44.600487+0000","last_became_active":"2024-09-19T05:48:43.404595+0000","last_became_peered":"2024-09-19T05:48:43.404595+0000","last_unstale":"2024-09-19T05:48:44.600487+0000","last_undegraded":"2024-09-19T05:48:44.600487+0000","last_fullsized":"2024-09-19T05:48:44.600487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:58.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.395520+0000","last_change":"2024-09-19T05:48:42.395520+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.395520+0000","last_undegraded":"2024-09-19T05:48:42.395520+0000","last_fullsized":"2024-09-19T05:48:42.395520+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387834+0000","last_change":"2024-09-19T05:48:42.387834+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387834+0000","last_undegraded":"2024-09-19T05:48:42.387834+0000","last_fullsized":"2024-09-19T05:48:42.387834+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868077+0000","last_change":"2024-09-19T05:48:43.418863+0000","last_active":"2024-09-19T05:48:44.868077+0000","last_peered":"2024-09-19T05:48:44.868077+0000","last_clean":"2024-09-19T05:48:44.868077+0000","last_became_active":"2024-09-19T05:48:43.418168+0000","last_became_peered":"2024-09-19T05:48:43.418168+0000","last_unstale":"2024-09-19T05:48:44.868077+0000","last_undegraded":"2024-09-19T05:48:44.868077+0000","last_fullsized":"2024-09-19T05:48:44.868077+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:31.906285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783339+0000","last_change":"2024-09-19T05:48:43.414630+0000","last_active":"2024-09-19T05:48:44.783339+0000","last_peered":"2024-09-19T05:48:44.783339+0000","last_clean":"2024-09-19T05:48:44.783339+0000","last_became_active":"2024-09-19T05:48:43.414339+0000","last_became_peered":"2024-09-19T05:48:43.414339+0000","last_unstale":"2024-09-19T05:48:44.783339+0000","last_undegraded":"2024-09-19T05:48:44.783339+0000","last_fullsized":"2024-09-19T05:48:44.783339+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:28.950820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384409+0000","last_change":"2024-09-19T05:48:42.384409+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384409+0000","last_undegraded":"2024-09-19T05:48:42.384409+0000","last_fullsized":"2024-09-19T05:48:42.384409+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387413+0000","last_change":"2024-09-19T05:48:42.387413+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387413+0000","last_undegraded":"2024-09-19T05:48:42.387413+0000","last_fullsized":"2024-09-19T05:48:42.387413+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.378949+0000","last_change":"2024-09-19T05:48:42.378949+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.378949+0000","last_undegraded":"2024-09-19T05:48:42.378949+0000","last_fullsized":"2024-09-19T05:48:42.378949+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383884+0000","last_change":"2024-09-19T05:48:42.383884+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383884+0000","last_undegraded":"2024-09-19T05:48:42.383884+0000","last_fullsized":"2024-09-19T05:48:42.383884+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.409830+0000","last_change":"2024-09-19T05:48:42.408182+0000","last_active":"2024-09-19T05:48:42.409830+0000","last_peered":"2024-09-19T05:48:42.409830+0000","last_clean":"2024-09-19T05:48:42.409830+0000","last_became_active":"2024-09-19T05:48:42.407894+0000","last_became_peered":"2024-09-19T05:48:42.407894+0000","last_unstale":"2024-09-19T05:48:42.409830+0000","last_undegraded":"2024-09-19T05:48:42.409830+0000","last_fullsized":"2024-09-19T05:48:42.409830+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:26.752644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382803+0000","last_change":"2024-09-19T05:48:42.382803+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382803+0000","last_undegraded":"2024-09-19T05:48:42.382803+0000","last_fullsized":"2024-09-19T05:48:42.382803+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868507+0000","last_change":"2024-09-19T05:48:42.418659+0000","last_active":"2024-09-19T05:48:44.868507+0000","last_peered":"2024-09-19T05:48:44.868507+0000","last_clean":"2024-09-19T05:48:44.868507+0000","last_became_active":"2024-09-19T05:48:42.412905+0000","last_became_peered":"2024-09-19T05:48:42.412905+0000","last_unstale":"2024-09-19T05:48:44.868507+0000","last_undegraded":"2024-09-19T05:48:44.868507+0000","last_fullsized":"2024-09-19T05:48:44.868507+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:18.568117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868306+0000","last_change":"2024-09-19T05:48:43.449114+0000","last_active":"2024-09-19T05:48:44.868306+0000","last_peered":"2024-09-19T05:48:44.868306+0000","last_clean":"2024-09-19T05:48:44.868306+0000","last_became_active":"2024-09-19T05:48:43.447233+0000","last_became_peered":"2024-09-19T05:48:43.447233+0000","last_unstale":"2024-09-19T05:48:44.868306+0000","last_undegraded":"2024-09-19T05:48:44.868306+0000","last_fullsized":"2024-09-19T05:48:44.868306+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:53.450971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.414241+0000","last_change":"2024-09-19T05:48:42.411654+0000","last_active":"2024-09-19T05:48:42.414241+0000","last_peered":"2024-09-19T05:48:42.414241+0000","last_clean":"2024-09-19T05:48:42.414241+0000","last_became_active":"2024-09-19T05:48:42.410979+0000","last_became_peered":"2024-09-19T05:48:42.410979+0000","last_unstale":"2024-09-19T05:48:42.414241+0000","last_undegraded":"2024-09-19T05:48:42.414241+0000","last_fullsized":"2024-09-19T05:48:42.414241+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:21.609538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383959+0000","last_change":"2024-09-19T05:48:42.383959+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383959+0000","last_undegraded":"2024-09-19T05:48:42.383959+0000","last_fullsized":"2024-09-19T05:48:42.383959+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400407+0000","last_change":"2024-09-19T05:48:42.431885+0000","last_active":"2024-09-19T05:48:44.400407+0000","last_peered":"2024-09-19T05:48:44.400407+0000","last_clean":"2024-09-19T05:48:44.400407+0000","last_became_active":"2024-09-19T05:48:42.431522+0000","last_became_peered":"2024-09-19T05:48:42.431522+0000","last_unstale":"2024-09-19T05:48:44.400407+0000","last_undegraded":"2024-09-19T05:48:44.400407+0000","last_fullsized":"2024-09-19T05:48:44.400407+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:08.098674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867307+0000","last_change":"2024-09-19T05:48:43.418828+0000","last_active":"2024-09-19T05:48:44.867307+0000","last_peered":"2024-09-19T05:48:44.867307+0000","last_clean":"2024-09-19T05:48:44.867307+0000","last_became_active":"2024-09-19T05:48:43.418076+0000","last_became_peered":"2024-09-19T05:48:43.418076+0000","last_unstale":"2024-09-19T05:48:44.867307+0000","last_undegraded":"2024-09-19T05:48:44.867307+0000","last_fullsized":"2024-09-19T05:48:44.867307+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:51.296112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599404+0000","last_change":"2024-09-19T05:48:42.421966+0000","last_active":"2024-09-19T05:48:44.599404+0000","last_peered":"2024-09-19T05:48:44.599404+0000","last_clean":"2024-09-19T05:48:44.599404+0000","last_became_active":"2024-09-19T05:48:42.421205+0000","last_became_peered":"2024-09-19T05:48:42.421205+0000","last_unstale":"2024-09-19T05:48:44.599404+0000","last_undegraded":"2024-09-19T05:48:44.599404+0000","last_fullsized":"2024-09-19T05:48:44.599404+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:37.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400257+0000","last_change":"2024-09-19T05:48:43.422693+0000","last_active":"2024-09-19T05:48:44.400257+0000","last_peered":"2024-09-19T05:48:44.400257+0000","last_clean":"2024-09-19T05:48:44.400257+0000","last_became_active":"2024-09-19T05:48:43.422093+0000","last_became_peered":"2024-09-19T05:48:43.422093+0000","last_unstale":"2024-09-19T05:48:44.400257+0000","last_undegraded":"2024-09-19T05:48:44.400257+0000","last_fullsized":"2024-09-19T05:48:44.400257+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:01.627681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.435632+0000","last_change":"2024-09-19T05:48:42.434205+0000","last_active":"2024-09-19T05:48:42.435632+0000","last_peered":"2024-09-19T05:48:42.435632+0000","last_clean":"2024-09-19T05:48:42.435632+0000","last_became_active":"2024-09-19T05:48:42.433523+0000","last_became_peered":"2024-09-19T05:48:42.433523+0000","last_unstale":"2024-09-19T05:48:42.435632+0000","last_undegraded":"2024-09-19T05:48:42.435632+0000","last_fullsized":"2024-09-19T05:48:42.435632+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:08.007103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384392+0000","last_change":"2024-09-19T05:48:42.384392+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384392+0000","last_undegraded":"2024-09-19T05:48:42.384392+0000","last_fullsized":"2024-09-19T05:48:42.384392+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.404599+0000","last_change":"2024-09-19T05:48:42.403566+0000","last_active":"2024-09-19T05:48:42.404599+0000","last_peered":"2024-09-19T05:48:42.404599+0000","last_clean":"2024-09-19T05:48:42.404599+0000","last_became_active":"2024-09-19T05:48:42.403314+0000","last_became_peered":"2024-09-19T05:48:42.403314+0000","last_unstale":"2024-09-19T05:48:42.404599+0000","last_undegraded":"2024-09-19T05:48:42.404599+0000","last_fullsized":"2024-09-19T05:48:42.404599+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:48.481362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400666+0000","last_change":"2024-09-19T05:48:43.385022+0000","last_active":"2024-09-19T05:48:44.400666+0000","last_peered":"2024-09-19T05:48:44.400666+0000","last_clean":"2024-09-19T05:48:44.400666+0000","last_became_active":"2024-09-19T05:48:43.383301+0000","last_became_peered":"2024-09-19T05:48:43.383301+0000","last_unstale":"2024-09-19T05:48:44.400666+0000","last_undegraded":"2024-09-19T05:48:44.400666+0000","last_fullsized":"2024-09-19T05:48:44.400666+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:12.719066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600709+0000","last_change":"2024-09-19T05:48:42.416006+0000","last_active":"2024-09-19T05:48:44.600709+0000","last_peered":"2024-09-19T05:48:44.600709+0000","last_clean":"2024-09-19T05:48:44.600709+0000","last_became_active":"2024-09-19T05:48:42.415230+0000","last_became_peered":"2024-09-19T05:48:42.415230+0000","last_unstale":"2024-09-19T05:48:44.600709+0000","last_undegraded":"2024-09-19T05:48:44.600709+0000","last_fullsized":"2024-09-19T05:48:44.600709+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:20.858387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.401002+0000","last_change":"2024-09-19T05:48:43.396355+0000","last_active":"2024-09-19T05:48:44.401002+0000","last_peered":"2024-09-19T05:48:44.401002+0000","last_clean":"2024-09-19T05:48:44.401002+0000","last_became_active":"2024-09-19T05:48:43.395006+0000","last_became_peered":"2024-09-19T05:48:43.395006+0000","last_unstale":"2024-09-19T05:48:44.401002+0000","last_undegraded":"2024-09-19T05:48:44.401002+0000","last_fullsized":"2024-09-19T05:48:44.401002+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:28.144785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.435514+0000","last_change":"2024-09-19T05:48:42.433952+0000","last_active":"2024-09-19T05:48:42.435514+0000","last_peered":"2024-09-19T05:48:42.435514+0000","last_clean":"2024-09-19T05:48:42.435514+0000","last_became_active":"2024-09-19T05:48:42.433338+0000","last_became_peered":"2024-09-19T05:48:42.433338+0000","last_unstale":"2024-09-19T05:48:42.435514+0000","last_undegraded":"2024-09-19T05:48:42.435514+0000","last_fullsized":"2024-09-19T05:48:42.435514+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:15.640473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.384235+0000","last_change":"2024-09-19T05:48:42.384235+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.384235+0000","last_undegraded":"2024-09-19T05:48:42.384235+0000","last_fullsized":"2024-09-19T05:48:42.384235+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"204'3","reported_seq":17,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600029+0000","last_change":"2024-09-19T05:48:42.415855+0000","last_active":"2024-09-19T05:48:44.600029+0000","last_peered":"2024-09-19T05:48:44.600029+0000","last_clean":"2024-09-19T05:48:44.600029+0000","last_became_active":"2024-09-19T05:48:42.415026+0000","last_became_peered":"2024-09-19T05:48:42.415026+0000","last_unstale":"2024-09-19T05:48:44.600029+0000","last_undegraded":"2024-09-19T05:48:44.600029+0000","last_fullsized":"2024-09-19T05:48:44.600029+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:54.202845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.387790+0000","last_change":"2024-09-19T05:48:42.387790+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.387790+0000","last_undegraded":"2024-09-19T05:48:42.387790+0000","last_fullsized":"2024-09-19T05:48:42.387790+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.416978+0000","last_change":"2024-09-19T05:48:42.413681+0000","last_active":"2024-09-19T05:48:42.416978+0000","last_peered":"2024-09-19T05:48:42.416978+0000","last_clean":"2024-09-19T05:48:42.416978+0000","last_became_active":"2024-09-19T05:48:42.412962+0000","last_became_peered":"2024-09-19T05:48:42.412962+0000","last_unstale":"2024-09-19T05:48:42.416978+0000","last_undegraded":"2024-09-19T05:48:42.416978+0000","last_fullsized":"2024-09-19T05:48:42.416978+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:35.853981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782704+0000","last_change":"2024-09-19T05:48:43.414543+0000","last_active":"2024-09-19T05:48:44.782704+0000","last_peered":"2024-09-19T05:48:44.782704+0000","last_clean":"2024-09-19T05:48:44.782704+0000","last_became_active":"2024-09-19T05:48:43.414252+0000","last_became_peered":"2024-09-19T05:48:43.414252+0000","last_unstale":"2024-09-19T05:48:44.782704+0000","last_undegraded":"2024-09-19T05:48:44.782704+0000","last_fullsized":"2024-09-19T05:48:44.782704+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:18.500272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867921+0000","last_change":"2024-09-19T05:48:42.431123+0000","last_active":"2024-09-19T05:48:44.867921+0000","last_peered":"2024-09-19T05:48:44.867921+0000","last_clean":"2024-09-19T05:48:44.867921+0000","last_became_active":"2024-09-19T05:48:42.429778+0000","last_became_peered":"2024-09-19T05:48:42.429778+0000","last_unstale":"2024-09-19T05:48:44.867921+0000","last_undegraded":"2024-09-19T05:48:44.867921+0000","last_fullsized":"2024-09-19T05:48:44.867921+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:27.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867387+0000","last_change":"2024-09-19T05:48:43.440102+0000","last_active":"2024-09-19T05:48:44.867387+0000","last_peered":"2024-09-19T05:48:44.867387+0000","last_clean":"2024-09-19T05:48:44.867387+0000","last_became_active":"2024-09-19T05:48:43.435435+0000","last_became_peered":"2024-09-19T05:48:43.435435+0000","last_unstale":"2024-09-19T05:48:44.867387+0000","last_undegraded":"2024-09-19T05:48:44.867387+0000","last_fullsized":"2024-09-19T05:48:44.867387+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:50.867131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782810+0000","last_change":"2024-09-19T05:48:42.402961+0000","last_active":"2024-09-19T05:48:44.782810+0000","last_peered":"2024-09-19T05:48:44.782810+0000","last_clean":"2024-09-19T05:48:44.782810+0000","last_became_active":"2024-09-19T05:48:42.402277+0000","last_became_peered":"2024-09-19T05:48:42.402277+0000","last_unstale":"2024-09-19T05:48:44.782810+0000","last_undegraded":"2024-09-19T05:48:44.782810+0000","last_fullsized":"2024-09-19T05:48:44.782810+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:58.217507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382692+0000","last_change":"2024-09-19T05:48:42.382692+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382692+0000","last_undegraded":"2024-09-19T05:48:42.382692+0000","last_fullsized":"2024-09-19T05:48:42.382692+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.408807+0000","last_change":"2024-09-19T05:48:42.407613+0000","last_active":"2024-09-19T05:48:42.408807+0000","last_peered":"2024-09-19T05:48:42.408807+0000","last_clean":"2024-09-19T05:48:42.408807+0000","last_became_active":"2024-09-19T05:48:42.406711+0000","last_became_peered":"2024-09-19T05:48:42.406711+0000","last_unstale":"2024-09-19T05:48:42.408807+0000","last_undegraded":"2024-09-19T05:48:42.408807+0000","last_fullsized":"2024-09-19T05:48:42.408807+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:39.135197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400411+0000","last_change":"2024-09-19T05:48:43.411228+0000","last_active":"2024-09-19T05:48:44.400411+0000","last_peered":"2024-09-19T05:48:44.400411+0000","last_clean":"2024-09-19T05:48:44.400411+0000","last_became_active":"2024-09-19T05:48:43.408701+0000","last_became_peered":"2024-09-19T05:48:43.408701+0000","last_unstale":"2024-09-19T05:48:44.400411+0000","last_undegraded":"2024-09-19T05:48:44.400411+0000","last_fullsized":"2024-09-19T05:48:44.400411+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:58.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"204'8","reported_seq":22,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867265+0000","last_change":"2024-09-19T05:48:42.432352+0000","last_active":"2024-09-19T05:48:44.867265+0000","last_peered":"2024-09-19T05:48:44.867265+0000","last_clean":"2024-09-19T05:48:44.867265+0000","last_became_active":"2024-09-19T05:48:42.430952+0000","last_became_peered":"2024-09-19T05:48:42.430952+0000","last_unstale":"2024-09-19T05:48:44.867265+0000","last_undegraded":"2024-09-19T05:48:44.867265+0000","last_fullsized":"2024-09-19T05:48:44.867265+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:54.318575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783337+0000","last_change":"2024-09-19T05:48:43.450955+0000","last_active":"2024-09-19T05:48:44.783337+0000","last_peered":"2024-09-19T05:48:44.783337+0000","last_clean":"2024-09-19T05:48:44.783337+0000","last_became_active":"2024-09-19T05:48:43.450677+0000","last_became_peered":"2024-09-19T05:48:43.450677+0000","last_unstale":"2024-09-19T05:48:44.783337+0000","last_undegraded":"2024-09-19T05:48:44.783337+0000","last_fullsized":"2024-09-19T05:48:44.783337+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:01.042268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.421422+0000","last_change":"2024-09-19T05:48:42.420938+0000","last_active":"2024-09-19T05:48:42.421422+0000","last_peered":"2024-09-19T05:48:42.421422+0000","last_clean":"2024-09-19T05:48:42.421422+0000","last_became_active":"2024-09-19T05:48:42.420638+0000","last_became_peered":"2024-09-19T05:48:42.420638+0000","last_unstale":"2024-09-19T05:48:42.421422+0000","last_undegraded":"2024-09-19T05:48:42.421422+0000","last_fullsized":"2024-09-19T05:48:42.421422+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:00.623412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599654+0000","last_change":"2024-09-19T05:48:43.398153+0000","last_active":"2024-09-19T05:48:44.599654+0000","last_peered":"2024-09-19T05:48:44.599654+0000","last_clean":"2024-09-19T05:48:44.599654+0000","last_became_active":"2024-09-19T05:48:43.397481+0000","last_became_peered":"2024-09-19T05:48:43.397481+0000","last_unstale":"2024-09-19T05:48:44.599654+0000","last_undegraded":"2024-09-19T05:48:44.599654+0000","last_fullsized":"2024-09-19T05:48:44.599654+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:40.978044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.410637+0000","last_change":"2024-09-19T05:48:42.409982+0000","last_active":"2024-09-19T05:48:42.410637+0000","last_peered":"2024-09-19T05:48:42.410637+0000","last_clean":"2024-09-19T05:48:42.410637+0000","last_became_active":"2024-09-19T05:48:42.409215+0000","last_became_peered":"2024-09-19T05:48:42.409215+0000","last_unstale":"2024-09-19T05:48:42.410637+0000","last_undegraded":"2024-09-19T05:48:42.410637+0000","last_fullsized":"2024-09-19T05:48:42.410637+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:47.160673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383136+0000","last_change":"2024-09-19T05:48:42.383136+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383136+0000","last_undegraded":"2024-09-19T05:48:42.383136+0000","last_fullsized":"2024-09-19T05:48:42.383136+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868094+0000","last_change":"2024-09-19T05:48:42.421032+0000","last_active":"2024-09-19T05:48:44.868094+0000","last_peered":"2024-09-19T05:48:44.868094+0000","last_clean":"2024-09-19T05:48:44.868094+0000","last_became_active":"2024-09-19T05:48:42.420242+0000","last_became_peered":"2024-09-19T05:48:42.420242+0000","last_unstale":"2024-09-19T05:48:44.868094+0000","last_undegraded":"2024-09-19T05:48:44.868094+0000","last_fullsized":"2024-09-19T05:48:44.868094+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868739+0000","last_change":"2024-09-19T05:48:43.442967+0000","last_active":"2024-09-19T05:48:44.868739+0000","last_peered":"2024-09-19T05:48:44.868739+0000","last_clean":"2024-09-19T05:48:44.868739+0000","last_became_active":"2024-09-19T05:48:43.442390+0000","last_became_peered":"2024-09-19T05:48:43.442390+0000","last_unstale":"2024-09-19T05:48:44.868739+0000","last_undegraded":"2024-09-19T05:48:44.868739+0000","last_fullsized":"2024-09-19T05:48:44.868739+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:56.209941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868575+0000","last_change":"2024-09-19T05:48:42.426287+0000","last_active":"2024-09-19T05:48:44.868575+0000","last_peered":"2024-09-19T05:48:44.868575+0000","last_clean":"2024-09-19T05:48:44.868575+0000","last_became_active":"2024-09-19T05:48:42.425397+0000","last_became_peered":"2024-09-19T05:48:42.425397+0000","last_unstale":"2024-09-19T05:48:44.868575+0000","last_undegraded":"2024-09-19T05:48:44.868575+0000","last_fullsized":"2024-09-19T05:48:44.868575+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:33.402100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867343+0000","last_change":"2024-09-19T05:48:43.434066+0000","last_active":"2024-09-19T05:48:44.867343+0000","last_peered":"2024-09-19T05:48:44.867343+0000","last_clean":"2024-09-19T05:48:44.867343+0000","last_became_active":"2024-09-19T05:48:43.404070+0000","last_became_peered":"2024-09-19T05:48:43.404070+0000","last_unstale":"2024-09-19T05:48:44.867343+0000","last_undegraded":"2024-09-19T05:48:44.867343+0000","last_fullsized":"2024-09-19T05:48:44.867343+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:10.032809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867935+0000","last_change":"2024-09-19T05:48:42.426204+0000","last_active":"2024-09-19T05:48:44.867935+0000","last_peered":"2024-09-19T05:48:44.867935+0000","last_clean":"2024-09-19T05:48:44.867935+0000","last_became_active":"2024-09-19T05:48:42.413060+0000","last_became_peered":"2024-09-19T05:48:42.413060+0000","last_unstale":"2024-09-19T05:48:44.867935+0000","last_undegraded":"2024-09-19T05:48:44.867935+0000","last_fullsized":"2024-09-19T05:48:44.867935+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:22.460222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600064+0000","last_change":"2024-09-19T05:48:43.415898+0000","last_active":"2024-09-19T05:48:44.600064+0000","last_peered":"2024-09-19T05:48:44.600064+0000","last_clean":"2024-09-19T05:48:44.600064+0000","last_became_active":"2024-09-19T05:48:43.407456+0000","last_became_peered":"2024-09-19T05:48:43.407456+0000","last_unstale":"2024-09-19T05:48:44.600064+0000","last_undegraded":"2024-09-19T05:48:44.600064+0000","last_fullsized":"2024-09-19T05:48:44.600064+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:23.933931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400352+0000","last_change":"2024-09-19T05:48:42.394779+0000","last_active":"2024-09-19T05:48:44.400352+0000","last_peered":"2024-09-19T05:48:44.400352+0000","last_clean":"2024-09-19T05:48:44.400352+0000","last_became_active":"2024-09-19T05:48:42.392507+0000","last_became_peered":"2024-09-19T05:48:42.392507+0000","last_unstale":"2024-09-19T05:48:44.400352+0000","last_undegraded":"2024-09-19T05:48:44.400352+0000","last_fullsized":"2024-09-19T05:48:44.400352+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:59.104953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782875+0000","last_change":"2024-09-19T05:48:43.448238+0000","last_active":"2024-09-19T05:48:44.782875+0000","last_peered":"2024-09-19T05:48:44.782875+0000","last_clean":"2024-09-19T05:48:44.782875+0000","last_became_active":"2024-09-19T05:48:43.447945+0000","last_became_peered":"2024-09-19T05:48:43.447945+0000","last_unstale":"2024-09-19T05:48:44.782875+0000","last_undegraded":"2024-09-19T05:48:44.782875+0000","last_fullsized":"2024-09-19T05:48:44.782875+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:26.569443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400226+0000","last_change":"2024-09-19T05:48:42.402586+0000","last_active":"2024-09-19T05:48:44.400226+0000","last_peered":"2024-09-19T05:48:44.400226+0000","last_clean":"2024-09-19T05:48:44.400226+0000","last_became_active":"2024-09-19T05:48:42.402273+0000","last_became_peered":"2024-09-19T05:48:42.402273+0000","last_unstale":"2024-09-19T05:48:44.400226+0000","last_undegraded":"2024-09-19T05:48:44.400226+0000","last_fullsized":"2024-09-19T05:48:44.400226+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:30.885834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383047+0000","last_change":"2024-09-19T05:48:42.383047+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383047+0000","last_undegraded":"2024-09-19T05:48:42.383047+0000","last_fullsized":"2024-09-19T05:48:42.383047+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.408375+0000","last_change":"2024-09-19T05:48:42.402825+0000","last_active":"2024-09-19T05:48:42.408375+0000","last_peered":"2024-09-19T05:48:42.408375+0000","last_clean":"2024-09-19T05:48:42.408375+0000","last_became_active":"2024-09-19T05:48:42.402113+0000","last_became_peered":"2024-09-19T05:48:42.402113+0000","last_unstale":"2024-09-19T05:48:42.408375+0000","last_undegraded":"2024-09-19T05:48:42.408375+0000","last_fullsized":"2024-09-19T05:48:42.408375+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:02.018087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783133+0000","last_change":"2024-09-19T05:48:43.411949+0000","last_active":"2024-09-19T05:48:44.783133+0000","last_peered":"2024-09-19T05:48:44.783133+0000","last_clean":"2024-09-19T05:48:44.783133+0000","last_became_active":"2024-09-19T05:48:43.411664+0000","last_became_peered":"2024-09-19T05:48:43.411664+0000","last_unstale":"2024-09-19T05:48:44.783133+0000","last_undegraded":"2024-09-19T05:48:44.783133+0000","last_fullsized":"2024-09-19T05:48:44.783133+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.815536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868895+0000","last_change":"2024-09-19T05:48:42.430481+0000","last_active":"2024-09-19T05:48:44.868895+0000","last_peered":"2024-09-19T05:48:44.868895+0000","last_clean":"2024-09-19T05:48:44.868895+0000","last_became_active":"2024-09-19T05:48:42.429578+0000","last_became_peered":"2024-09-19T05:48:42.429578+0000","last_unstale":"2024-09-19T05:48:44.868895+0000","last_undegraded":"2024-09-19T05:48:44.868895+0000","last_fullsized":"2024-09-19T05:48:44.868895+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:01.458679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600314+0000","last_change":"2024-09-19T05:48:43.428371+0000","last_active":"2024-09-19T05:48:44.600314+0000","last_peered":"2024-09-19T05:48:44.600314+0000","last_clean":"2024-09-19T05:48:44.600314+0000","last_became_active":"2024-09-19T05:48:43.427134+0000","last_became_peered":"2024-09-19T05:48:43.427134+0000","last_unstale":"2024-09-19T05:48:44.600314+0000","last_undegraded":"2024-09-19T05:48:44.600314+0000","last_fullsized":"2024-09-19T05:48:44.600314+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:49.485630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"205'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400594+0000","last_change":"2024-09-19T05:48:42.402888+0000","last_active":"2024-09-19T05:48:44.400594+0000","last_peered":"2024-09-19T05:48:44.400594+0000","last_clean":"2024-09-19T05:48:44.400594+0000","last_became_active":"2024-09-19T05:48:42.402425+0000","last_became_peered":"2024-09-19T05:48:42.402425+0000","last_unstale":"2024-09-19T05:48:44.400594+0000","last_undegraded":"2024-09-19T05:48:44.400594+0000","last_fullsized":"2024-09-19T05:48:44.400594+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:27.307738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.379070+0000","last_change":"2024-09-19T05:48:42.379070+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.379070+0000","last_undegraded":"2024-09-19T05:48:42.379070+0000","last_fullsized":"2024-09-19T05:48:42.379070+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.401016+0000","last_change":"2024-09-19T05:48:42.392461+0000","last_active":"2024-09-19T05:48:44.401016+0000","last_peered":"2024-09-19T05:48:44.401016+0000","last_clean":"2024-09-19T05:48:44.401016+0000","last_became_active":"2024-09-19T05:48:42.392083+0000","last_became_peered":"2024-09-19T05:48:42.392083+0000","last_unstale":"2024-09-19T05:48:44.401016+0000","last_undegraded":"2024-09-19T05:48:44.401016+0000","last_fullsized":"2024-09-19T05:48:44.401016+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:04.533503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.386365+0000","last_change":"2024-09-19T05:48:42.386365+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.386365+0000","last_undegraded":"2024-09-19T05:48:42.386365+0000","last_fullsized":"2024-09-19T05:48:42.386365+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868856+0000","last_change":"2024-09-19T05:48:42.412842+0000","last_active":"2024-09-19T05:48:44.868856+0000","last_peered":"2024-09-19T05:48:44.868856+0000","last_clean":"2024-09-19T05:48:44.868856+0000","last_became_active":"2024-09-19T05:48:42.412103+0000","last_became_peered":"2024-09-19T05:48:42.412103+0000","last_unstale":"2024-09-19T05:48:44.868856+0000","last_undegraded":"2024-09-19T05:48:44.868856+0000","last_fullsized":"2024-09-19T05:48:44.868856+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:27.071122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.383350+0000","last_change":"2024-09-19T05:48:42.383350+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.383350+0000","last_undegraded":"2024-09-19T05:48:42.383350+0000","last_fullsized":"2024-09-19T05:48:42.383350+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868282+0000","last_change":"2024-09-19T05:48:42.429925+0000","last_active":"2024-09-19T05:48:44.868282+0000","last_peered":"2024-09-19T05:48:44.868282+0000","last_clean":"2024-09-19T05:48:44.868282+0000","last_became_active":"2024-09-19T05:48:42.426314+0000","last_became_peered":"2024-09-19T05:48:42.426314+0000","last_unstale":"2024-09-19T05:48:44.868282+0000","last_undegraded":"2024-09-19T05:48:44.868282+0000","last_fullsized":"2024-09-19T05:48:44.868282+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:14.460190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.382366+0000","last_change":"2024-09-19T05:48:42.382366+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.382366+0000","last_undegraded":"2024-09-19T05:48:42.382366+0000","last_fullsized":"2024-09-19T05:48:42.382366+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-09-19T05:48:42.399269+0000","last_change":"2024-09-19T05:48:42.396864+0000","last_active":"2024-09-19T05:48:42.399269+0000","last_peered":"2024-09-19T05:48:42.399269+0000","last_clean":"2024-09-19T05:48:42.399269+0000","last_became_active":"2024-09-19T05:48:42.396113+0000","last_became_peered":"2024-09-19T05:48:42.396113+0000","last_unstale":"2024-09-19T05:48:42.399269+0000","last_undegraded":"2024-09-19T05:48:42.399269+0000","last_fullsized":"2024-09-19T05:48:42.399269+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:47.546752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.388465+0000","last_change":"2024-09-19T05:48:42.388465+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.388465+0000","last_undegraded":"2024-09-19T05:48:42.388465+0000","last_fullsized":"2024-09-19T05:48:42.388465+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599757+0000","last_change":"2024-09-19T05:48:42.410610+0000","last_active":"2024-09-19T05:48:44.599757+0000","last_peered":"2024-09-19T05:48:44.599757+0000","last_clean":"2024-09-19T05:48:44.599757+0000","last_became_active":"2024-09-19T05:48:42.409545+0000","last_became_peered":"2024-09-19T05:48:42.409545+0000","last_unstale":"2024-09-19T05:48:44.599757+0000","last_undegraded":"2024-09-19T05:48:44.599757+0000","last_fullsized":"2024-09-19T05:48:44.599757+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:58.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867663+0000","last_change":"2024-09-19T05:48:43.452913+0000","last_active":"2024-09-19T05:48:44.867663+0000","last_peered":"2024-09-19T05:48:44.867663+0000","last_clean":"2024-09-19T05:48:44.867663+0000","last_became_active":"2024-09-19T05:48:43.452362+0000","last_became_peered":"2024-09-19T05:48:43.452362+0000","last_unstale":"2024-09-19T05:48:44.867663+0000","last_undegraded":"2024-09-19T05:48:44.867663+0000","last_fullsized":"2024-09-19T05:48:44.867663+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:16.862927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867587+0000","last_change":"2024-09-19T05:48:42.430171+0000","last_active":"2024-09-19T05:48:44.867587+0000","last_peered":"2024-09-19T05:48:44.867587+0000","last_clean":"2024-09-19T05:48:44.867587+0000","last_became_active":"2024-09-19T05:48:42.427129+0000","last_became_peered":"2024-09-19T05:48:42.427129+0000","last_unstale":"2024-09-19T05:48:44.867587+0000","last_undegraded":"2024-09-19T05:48:44.867587+0000","last_fullsized":"2024-09-19T05:48:44.867587+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:12.337882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":203,"state":"creating+peering","last_fresh":"2024-09-19T05:48:42.399646+0000","last_change":"2024-09-19T05:48:42.399646+0000","last_active":"2024-09-19T05:48:42.359565+0000","last_peered":"2024-09-19T05:48:42.359565+0000","last_clean":"2024-09-19T05:48:42.359565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T05:48:42.399646+0000","last_undegraded":"2024-09-19T05:48:42.399646+0000","last_fullsized":"2024-09-19T05:48:42.399646+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599624+0000","last_change":"2024-09-19T05:48:42.407348+0000","last_active":"2024-09-19T05:48:44.599624+0000","last_peered":"2024-09-19T05:48:44.599624+0000","last_clean":"2024-09-19T05:48:44.599624+0000","last_became_active":"2024-09-19T05:48:42.406620+0000","last_became_peered":"2024-09-19T05:48:42.406620+0000","last_unstale":"2024-09-19T05:48:44.599624+0000","last_undegraded":"2024-09-19T05:48:44.599624+0000","last_fullsized":"2024-09-19T05:48:44.599624+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:07.874926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":507,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599856+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:48:44.599856+0000","last_peered":"2024-09-19T05:48:44.599856+0000","last_clean":"2024-09-19T05:48:44.599856+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:48:44.599856+0000","last_undegraded":"2024-09-19T05:48:44.599856+0000","last_fullsized":"2024-09-19T05:48:44.599856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":194,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542335,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74564,"kb_used_data":3112,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297276,"statfs":{"total":96636764160,"available":96560410624,"internally_reserved":0,"allocated":3186688,"data_stored":1814320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542335,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73996,"kb_used_data":2548,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297844,"statfs":{"total":96636764160,"available":96560992256,"internally_reserved":0,"allocated":2609152,"data_stored":1225018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542336,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542334,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73932,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297908,"statfs":{"total":96636764160,"available":96561057792,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542335,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73868,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297972,"statfs":{"total":96636764160,"available":96561123328,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73932,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297908,"statfs":{"total":96636764160,"available":96561057792,"internally_reserved":0,"allocated":2547712,"data_stored":1202754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542338,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51764,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320076,"statfs":{"total":96636764160,"available":96583757824,"internally_reserved":0,"allocated":2584576,"data_stored":1223280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542335,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78708,"kb_used_data":3104,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293132,"statfs":{"total":96636764160,"available":96556167168,"internally_reserved":0,"allocated":3178496,"data_stored":1813648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:48:49.011 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:48:49.009+0000 7f8969eeb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:48:52.001 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:48:52.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f3954a72640 1 Processor -- start 2024-09-19T05:48:52.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f3954a72640 1 -- start start 2024-09-19T05:48:52.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f3954a72640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f39500726b0 0x7f395006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f3954a72640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39500b4420 con 0x7f39500b2fd0 2024-09-19T05:48:52.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f3954a72640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39500b4140 con 0x7f395015e330 2024-09-19T05:48:52.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f3954a72640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f39500acfb0 con 0x7f39500726b0 2024-09-19T05:48:52.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394dd9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f39500b2fd0 0x7f395006e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55156/0 (socket says 172.21.15.67:55156) 2024-09-19T05:48:52.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394dd9b640 1 -- 172.21.15.67:0/4052166866 learned_addr learned my addr 172.21.15.67:0/4052166866 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394ed9d640 1 --2- 172.21.15.67:0/4052166866 >> v2:172.21.15.97:3300/0 conn(0x7f39500726b0 0x7f395006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629880346 0 0) 0x7f39500b4420 con 0x7f39500b2fd0 2024-09-19T05:48:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f393c003530 con 0x7f39500b2fd0 2024-09-19T05:48:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1590210850 0 0) 0x7f393c003530 con 0x7f39500b2fd0 2024-09-19T05:48:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 >> v2:172.21.15.97:3300/0 conn(0x7f39500726b0 msgr2=0x7f395006ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 --2- 172.21.15.67:0/4052166866 >> v2:172.21.15.97:3300/0 conn(0x7f39500726b0 0x7f395006ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 >> v1:172.21.15.97:6789/0 conn(0x7f395015e330 legacy=0x7f3950071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395006def0 con 0x7f39500b2fd0 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f3940001a00 con 0x7f39500b2fd0 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 >> v1:172.21.15.67:6789/0 conn(0x7f39500b2fd0 legacy=0x7f395006e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f393c003a10 0x7f393c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f393c004810 0x7f393c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f393c0051d0 0x7f393c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f393c00c0a0 con 0x7f393c003a10 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f393c00c250 con 0x7f393c004810 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f393c00c450 con 0x7f393c0051d0 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394e59c640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f393c003a10 0x7f393c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394dd9b640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f393c004810 0x7f393c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394ed9d640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f393c0051d0 0x7f393c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394e59c640 1 -- 172.21.15.67:0/4052166866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f393c0051d0 msgr2=0x7f393c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:52.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394e59c640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f393c0051d0 0x7f393c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394e59c640 1 -- 172.21.15.67:0/4052166866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f393c004810 msgr2=0x7f393c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:52.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394e59c640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f393c004810 0x7f393c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394ed9d640 1 -- 172.21.15.67:0/4052166866 reap_dead start 2024-09-19T05:48:52.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.137+0000 7f394e59c640 1 -- 172.21.15.67:0/4052166866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393c003530 con 0x7f393c003a10 2024-09-19T05:48:52.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f394e59c640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f393c003a10 0x7f393c003e30 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7f3938001780 tx=0x7f393801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb87dc911b27b8a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:52.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39380013a0 con 0x7f393c003a10 2024-09-19T05:48:52.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39380052f0 con 0x7f393c003a10 2024-09-19T05:48:52.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f394d59a640 1 -- 172.21.15.67:0/4052166866 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938003840 con 0x7f393c003a10 2024-09-19T05:48:52.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f3954a72640 1 -- 172.21.15.67:0/4052166866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f393c003a10 msgr2=0x7f393c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f3954a72640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f393c003a10 0x7f393c003e30 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7f3938001780 tx=0x7f393801c420 comp rx=0 tx=0).stop 2024-09-19T05:48:52.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f3954a72640 1 -- 172.21.15.67:0/4052166866 shutdown_connections 2024-09-19T05:48:52.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f3954a72640 1 --2- 172.21.15.67:0/4052166866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f393c003a10 0x7f393c003e30 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f3954a72640 1 -- 172.21.15.67:0/4052166866 >> 172.21.15.67:0/4052166866 conn(0x7f39500d0080 msgr2=0x7f39500d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:52.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f3954a72640 1 -- 172.21.15.67:0/4052166866 shutdown_connections 2024-09-19T05:48:52.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.141+0000 7f3954a72640 1 -- 172.21.15.67:0/4052166866 wait complete. 2024-09-19T05:48:52.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 Processor -- start 2024-09-19T05:48:52.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 -- start start 2024-09-19T05:48:52.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f393c003a10 0x7f3950145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3950145840 0x7f39500b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39500b1300 0x7f39501517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f39500cfe40 con 0x7f39500b1300 2024-09-19T05:48:52.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f39500cfcc0 con 0x7f3950145840 2024-09-19T05:48:52.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3950162780 con 0x7f393c003a10 2024-09-19T05:48:52.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39500b1300 0x7f39501517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39500b1300 0x7f39501517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42550/0 (socket says 172.21.15.67:42550) 2024-09-19T05:48:52.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394ed9d640 1 -- 172.21.15.67:0/750645926 learned_addr learned my addr 172.21.15.67:0/750645926 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:52.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394e59c640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f393c003a10 0x7f3950145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394dd9b640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3950145840 0x7f39500b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394ed9d640 1 -- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f393c003a10 msgr2=0x7f3950145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394ed9d640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f393c003a10 0x7f3950145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394ed9d640 1 -- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3950145840 msgr2=0x7f39500b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394ed9d640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3950145840 0x7f39500b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394ed9d640 1 -- 172.21.15.67:0/750645926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3950152540 con 0x7f39500b1300 2024-09-19T05:48:52.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f394ed9d640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39500b1300 0x7f39501517e0 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7f39500d0bc0 tx=0x7f3948011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:52.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3946ffd640 1 -- 172.21.15.67:0/750645926 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948019020 con 0x7f39500b1300 2024-09-19T05:48:52.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3946ffd640 1 -- 172.21.15.67:0/750645926 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3948003620 con 0x7f39500b1300 2024-09-19T05:48:52.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 -- 172.21.15.67:0/750645926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3950152820 con 0x7f39500b1300 2024-09-19T05:48:52.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3946ffd640 1 -- 172.21.15.67:0/750645926 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948003a10 con 0x7f39500b1300 2024-09-19T05:48:52.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 -- 172.21.15.67:0/750645926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395015f4d0 con 0x7f39500b1300 2024-09-19T05:48:52.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3954a72640 1 -- 172.21.15.67:0/750645926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3950162b10 con 0x7f39500b1300 2024-09-19T05:48:52.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3946ffd640 1 -- 172.21.15.67:0/750645926 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f394801c020 con 0x7f39500b1300 2024-09-19T05:48:52.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.145+0000 7f3946ffd640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39300678c0 0x7f3930069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.149+0000 7f3946ffd640 1 -- 172.21.15.67:0/750645926 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f3948086640 con 0x7f39500b1300 2024-09-19T05:48:52.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.149+0000 7f394e59c640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39300678c0 0x7f3930069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.149+0000 7f394e59c640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39300678c0 0x7f3930069d80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3938001750 tx=0x7f39380011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:52.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.149+0000 7f3946ffd640 1 -- 172.21.15.67:0/750645926 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3948023020 con 0x7f39500b1300 2024-09-19T05:48:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.313+0000 7f3954a72640 1 -- 172.21.15.67:0/750645926 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f395015f6a0 con 0x7f39300678c0 2024-09-19T05:48:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.329+0000 7f3946ffd640 1 -- 172.21.15.67:0/750645926 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252493 (secure 0 0 0) 0x7f395015f6a0 con 0x7f39300678c0 2024-09-19T05:48:52.333 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:52.334 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:48:52.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 -- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39300678c0 msgr2=0x7f3930069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39300678c0 0x7f3930069d80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3938001750 tx=0x7f39380011a0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 -- 172.21.15.67:0/750645926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39500b1300 msgr2=0x7f39501517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39500b1300 0x7f39501517e0 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7f39500d0bc0 tx=0x7f3948011920 comp rx=0 tx=0).stop 2024-09-19T05:48:52.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 -- 172.21.15.67:0/750645926 shutdown_connections 2024-09-19T05:48:52.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39500b1300 0x7f39501517e0 unknown :-1 s=CLOSED pgs=2454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3950145840 0x7f39500b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f39300678c0 0x7f3930069d80 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 --2- 172.21.15.67:0/750645926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f393c003a10 0x7f3950145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 -- 172.21.15.67:0/750645926 >> 172.21.15.67:0/750645926 conn(0x7f39500d0080 msgr2=0x7f395015c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:52.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 -- 172.21.15.67:0/750645926 shutdown_connections 2024-09-19T05:48:52.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.333+0000 7f3954a72640 1 -- 172.21.15.67:0/750645926 wait complete. 2024-09-19T05:48:52.351 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":673,"stamp":"2024-09-19T05:48:51.437958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":556832,"kb_used_data":21416,"kb_used_omap":12,"kb_used_meta":535219,"kb_avail":754417888,"statfs":{"total":773094113280,"available":772523917312,"internally_reserved":0,"allocated":21929984,"data_stored":10971796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":548064817},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.062122"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600294+0000","last_change":"2024-09-19T05:48:43.428484+0000","last_active":"2024-09-19T05:48:44.600294+0000","last_peered":"2024-09-19T05:48:44.600294+0000","last_clean":"2024-09-19T05:48:44.600294+0000","last_became_active":"2024-09-19T05:48:43.427731+0000","last_became_peered":"2024-09-19T05:48:43.427731+0000","last_unstale":"2024-09-19T05:48:44.600294+0000","last_undegraded":"2024-09-19T05:48:44.600294+0000","last_fullsized":"2024-09-19T05:48:44.600294+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:01.627681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783364+0000","last_change":"2024-09-19T05:48:43.406998+0000","last_active":"2024-09-19T05:48:44.783364+0000","last_peered":"2024-09-19T05:48:44.783364+0000","last_clean":"2024-09-19T05:48:44.783364+0000","last_became_active":"2024-09-19T05:48:43.404769+0000","last_became_peered":"2024-09-19T05:48:43.404769+0000","last_unstale":"2024-09-19T05:48:44.783364+0000","last_undegraded":"2024-09-19T05:48:44.783364+0000","last_fullsized":"2024-09-19T05:48:44.783364+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:13.589670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397814+0000","last_change":"2024-09-19T05:48:43.409318+0000","last_active":"2024-09-19T05:48:44.397814+0000","last_peered":"2024-09-19T05:48:44.397814+0000","last_clean":"2024-09-19T05:48:44.397814+0000","last_became_active":"2024-09-19T05:48:43.408870+0000","last_became_peered":"2024-09-19T05:48:43.408870+0000","last_unstale":"2024-09-19T05:48:44.397814+0000","last_undegraded":"2024-09-19T05:48:44.397814+0000","last_fullsized":"2024-09-19T05:48:44.397814+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:37.588137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.401306+0000","last_change":"2024-09-19T05:48:43.423130+0000","last_active":"2024-09-19T05:48:44.401306+0000","last_peered":"2024-09-19T05:48:44.401306+0000","last_clean":"2024-09-19T05:48:44.401306+0000","last_became_active":"2024-09-19T05:48:43.422354+0000","last_became_peered":"2024-09-19T05:48:43.422354+0000","last_unstale":"2024-09-19T05:48:44.401306+0000","last_undegraded":"2024-09-19T05:48:44.401306+0000","last_fullsized":"2024-09-19T05:48:44.401306+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:13.342150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599773+0000","last_change":"2024-09-19T05:48:43.401953+0000","last_active":"2024-09-19T05:48:44.599773+0000","last_peered":"2024-09-19T05:48:44.599773+0000","last_clean":"2024-09-19T05:48:44.599773+0000","last_became_active":"2024-09-19T05:48:43.401185+0000","last_became_peered":"2024-09-19T05:48:43.401185+0000","last_unstale":"2024-09-19T05:48:44.599773+0000","last_undegraded":"2024-09-19T05:48:44.599773+0000","last_fullsized":"2024-09-19T05:48:44.599773+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:59.221775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.759172+0000","last_change":"2024-09-19T05:48:43.400293+0000","last_active":"2024-09-19T05:48:45.759172+0000","last_peered":"2024-09-19T05:48:45.759172+0000","last_clean":"2024-09-19T05:48:45.759172+0000","last_became_active":"2024-09-19T05:48:43.399476+0000","last_became_peered":"2024-09-19T05:48:43.399476+0000","last_unstale":"2024-09-19T05:48:45.759172+0000","last_undegraded":"2024-09-19T05:48:45.759172+0000","last_fullsized":"2024-09-19T05:48:45.759172+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:05.923222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397437+0000","last_change":"2024-09-19T05:48:43.402941+0000","last_active":"2024-09-19T05:48:44.397437+0000","last_peered":"2024-09-19T05:48:44.397437+0000","last_clean":"2024-09-19T05:48:44.397437+0000","last_became_active":"2024-09-19T05:48:43.402665+0000","last_became_peered":"2024-09-19T05:48:43.402665+0000","last_unstale":"2024-09-19T05:48:44.397437+0000","last_undegraded":"2024-09-19T05:48:44.397437+0000","last_fullsized":"2024-09-19T05:48:44.397437+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758432+0000","last_change":"2024-09-19T05:48:43.420011+0000","last_active":"2024-09-19T05:48:45.758432+0000","last_peered":"2024-09-19T05:48:45.758432+0000","last_clean":"2024-09-19T05:48:45.758432+0000","last_became_active":"2024-09-19T05:48:43.419327+0000","last_became_peered":"2024-09-19T05:48:43.419327+0000","last_unstale":"2024-09-19T05:48:45.758432+0000","last_undegraded":"2024-09-19T05:48:45.758432+0000","last_fullsized":"2024-09-19T05:48:45.758432+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:46.858108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758933+0000","last_change":"2024-09-19T05:48:43.399123+0000","last_active":"2024-09-19T05:48:45.758933+0000","last_peered":"2024-09-19T05:48:45.758933+0000","last_clean":"2024-09-19T05:48:45.758933+0000","last_became_active":"2024-09-19T05:48:43.398708+0000","last_became_peered":"2024-09-19T05:48:43.398708+0000","last_unstale":"2024-09-19T05:48:45.758933+0000","last_undegraded":"2024-09-19T05:48:45.758933+0000","last_fullsized":"2024-09-19T05:48:45.758933+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:39.195434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397991+0000","last_change":"2024-09-19T05:48:43.425822+0000","last_active":"2024-09-19T05:48:44.397991+0000","last_peered":"2024-09-19T05:48:44.397991+0000","last_clean":"2024-09-19T05:48:44.397991+0000","last_became_active":"2024-09-19T05:48:43.425600+0000","last_became_peered":"2024-09-19T05:48:43.425600+0000","last_unstale":"2024-09-19T05:48:44.397991+0000","last_undegraded":"2024-09-19T05:48:44.397991+0000","last_fullsized":"2024-09-19T05:48:44.397991+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:35.627037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400710+0000","last_change":"2024-09-19T05:48:43.411278+0000","last_active":"2024-09-19T05:48:44.400710+0000","last_peered":"2024-09-19T05:48:44.400710+0000","last_clean":"2024-09-19T05:48:44.400710+0000","last_became_active":"2024-09-19T05:48:43.410191+0000","last_became_peered":"2024-09-19T05:48:43.410191+0000","last_unstale":"2024-09-19T05:48:44.400710+0000","last_undegraded":"2024-09-19T05:48:44.400710+0000","last_fullsized":"2024-09-19T05:48:44.400710+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:32.280807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868599+0000","last_change":"2024-09-19T05:48:43.445279+0000","last_active":"2024-09-19T05:48:44.868599+0000","last_peered":"2024-09-19T05:48:44.868599+0000","last_clean":"2024-09-19T05:48:44.868599+0000","last_became_active":"2024-09-19T05:48:43.443235+0000","last_became_peered":"2024-09-19T05:48:43.443235+0000","last_unstale":"2024-09-19T05:48:44.868599+0000","last_undegraded":"2024-09-19T05:48:44.868599+0000","last_fullsized":"2024-09-19T05:48:44.868599+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:12.067057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758961+0000","last_change":"2024-09-19T05:48:43.413194+0000","last_active":"2024-09-19T05:48:45.758961+0000","last_peered":"2024-09-19T05:48:45.758961+0000","last_clean":"2024-09-19T05:48:45.758961+0000","last_became_active":"2024-09-19T05:48:43.412282+0000","last_became_peered":"2024-09-19T05:48:43.412282+0000","last_unstale":"2024-09-19T05:48:45.758961+0000","last_undegraded":"2024-09-19T05:48:45.758961+0000","last_fullsized":"2024-09-19T05:48:45.758961+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:07.121495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867568+0000","last_change":"2024-09-19T05:48:43.435859+0000","last_active":"2024-09-19T05:48:44.867568+0000","last_peered":"2024-09-19T05:48:44.867568+0000","last_clean":"2024-09-19T05:48:44.867568+0000","last_became_active":"2024-09-19T05:48:43.434858+0000","last_became_peered":"2024-09-19T05:48:43.434858+0000","last_unstale":"2024-09-19T05:48:44.867568+0000","last_undegraded":"2024-09-19T05:48:44.867568+0000","last_fullsized":"2024-09-19T05:48:44.867568+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.765450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400513+0000","last_change":"2024-09-19T05:48:43.405560+0000","last_active":"2024-09-19T05:48:44.400513+0000","last_peered":"2024-09-19T05:48:44.400513+0000","last_clean":"2024-09-19T05:48:44.400513+0000","last_became_active":"2024-09-19T05:48:43.405181+0000","last_became_peered":"2024-09-19T05:48:43.405181+0000","last_unstale":"2024-09-19T05:48:44.400513+0000","last_undegraded":"2024-09-19T05:48:44.400513+0000","last_fullsized":"2024-09-19T05:48:44.400513+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:39.032330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758634+0000","last_change":"2024-09-19T05:48:43.408793+0000","last_active":"2024-09-19T05:48:45.758634+0000","last_peered":"2024-09-19T05:48:45.758634+0000","last_clean":"2024-09-19T05:48:45.758634+0000","last_became_active":"2024-09-19T05:48:43.408108+0000","last_became_peered":"2024-09-19T05:48:43.408108+0000","last_unstale":"2024-09-19T05:48:45.758634+0000","last_undegraded":"2024-09-19T05:48:45.758634+0000","last_fullsized":"2024-09-19T05:48:45.758634+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:21.126379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868635+0000","last_change":"2024-09-19T05:48:43.445682+0000","last_active":"2024-09-19T05:48:44.868635+0000","last_peered":"2024-09-19T05:48:44.868635+0000","last_clean":"2024-09-19T05:48:44.868635+0000","last_became_active":"2024-09-19T05:48:43.445097+0000","last_became_peered":"2024-09-19T05:48:43.445097+0000","last_unstale":"2024-09-19T05:48:44.868635+0000","last_undegraded":"2024-09-19T05:48:44.868635+0000","last_fullsized":"2024-09-19T05:48:44.868635+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:21.827527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397966+0000","last_change":"2024-09-19T05:48:43.410805+0000","last_active":"2024-09-19T05:48:44.397966+0000","last_peered":"2024-09-19T05:48:44.397966+0000","last_clean":"2024-09-19T05:48:44.397966+0000","last_became_active":"2024-09-19T05:48:43.410539+0000","last_became_peered":"2024-09-19T05:48:43.410539+0000","last_unstale":"2024-09-19T05:48:44.397966+0000","last_undegraded":"2024-09-19T05:48:44.397966+0000","last_fullsized":"2024-09-19T05:48:44.397966+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:44.714182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599639+0000","last_change":"2024-09-19T05:48:43.419947+0000","last_active":"2024-09-19T05:48:44.599639+0000","last_peered":"2024-09-19T05:48:44.599639+0000","last_clean":"2024-09-19T05:48:44.599639+0000","last_became_active":"2024-09-19T05:48:43.408971+0000","last_became_peered":"2024-09-19T05:48:43.408971+0000","last_unstale":"2024-09-19T05:48:44.599639+0000","last_undegraded":"2024-09-19T05:48:44.599639+0000","last_fullsized":"2024-09-19T05:48:44.599639+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:56.260686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.759200+0000","last_change":"2024-09-19T05:48:43.415710+0000","last_active":"2024-09-19T05:48:45.759200+0000","last_peered":"2024-09-19T05:48:45.759200+0000","last_clean":"2024-09-19T05:48:45.759200+0000","last_became_active":"2024-09-19T05:48:43.414718+0000","last_became_peered":"2024-09-19T05:48:43.414718+0000","last_unstale":"2024-09-19T05:48:45.759200+0000","last_undegraded":"2024-09-19T05:48:45.759200+0000","last_fullsized":"2024-09-19T05:48:45.759200+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:07.055894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397545+0000","last_change":"2024-09-19T05:48:43.409048+0000","last_active":"2024-09-19T05:48:44.397545+0000","last_peered":"2024-09-19T05:48:44.397545+0000","last_clean":"2024-09-19T05:48:44.397545+0000","last_became_active":"2024-09-19T05:48:43.408758+0000","last_became_peered":"2024-09-19T05:48:43.408758+0000","last_unstale":"2024-09-19T05:48:44.397545+0000","last_undegraded":"2024-09-19T05:48:44.397545+0000","last_fullsized":"2024-09-19T05:48:44.397545+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:44.111484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400253+0000","last_change":"2024-09-19T05:48:43.422670+0000","last_active":"2024-09-19T05:48:44.400253+0000","last_peered":"2024-09-19T05:48:44.400253+0000","last_clean":"2024-09-19T05:48:44.400253+0000","last_became_active":"2024-09-19T05:48:43.422215+0000","last_became_peered":"2024-09-19T05:48:43.422215+0000","last_unstale":"2024-09-19T05:48:44.400253+0000","last_undegraded":"2024-09-19T05:48:44.400253+0000","last_fullsized":"2024-09-19T05:48:44.400253+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:49.485630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758148+0000","last_change":"2024-09-19T05:48:43.399094+0000","last_active":"2024-09-19T05:48:45.758148+0000","last_peered":"2024-09-19T05:48:45.758148+0000","last_clean":"2024-09-19T05:48:45.758148+0000","last_became_active":"2024-09-19T05:48:43.398772+0000","last_became_peered":"2024-09-19T05:48:43.398772+0000","last_unstale":"2024-09-19T05:48:45.758148+0000","last_undegraded":"2024-09-19T05:48:45.758148+0000","last_fullsized":"2024-09-19T05:48:45.758148+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:31.988402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599585+0000","last_change":"2024-09-19T05:48:43.402276+0000","last_active":"2024-09-19T05:48:44.599585+0000","last_peered":"2024-09-19T05:48:44.599585+0000","last_clean":"2024-09-19T05:48:44.599585+0000","last_became_active":"2024-09-19T05:48:43.401561+0000","last_became_peered":"2024-09-19T05:48:43.401561+0000","last_unstale":"2024-09-19T05:48:44.599585+0000","last_undegraded":"2024-09-19T05:48:44.599585+0000","last_fullsized":"2024-09-19T05:48:44.599585+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:50.285249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600487+0000","last_change":"2024-09-19T05:48:43.406290+0000","last_active":"2024-09-19T05:48:44.600487+0000","last_peered":"2024-09-19T05:48:44.600487+0000","last_clean":"2024-09-19T05:48:44.600487+0000","last_became_active":"2024-09-19T05:48:43.404595+0000","last_became_peered":"2024-09-19T05:48:43.404595+0000","last_unstale":"2024-09-19T05:48:44.600487+0000","last_undegraded":"2024-09-19T05:48:44.600487+0000","last_fullsized":"2024-09-19T05:48:44.600487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:58.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.398038+0000","last_change":"2024-09-19T05:48:43.451657+0000","last_active":"2024-09-19T05:48:44.398038+0000","last_peered":"2024-09-19T05:48:44.398038+0000","last_clean":"2024-09-19T05:48:44.398038+0000","last_became_active":"2024-09-19T05:48:43.451293+0000","last_became_peered":"2024-09-19T05:48:43.451293+0000","last_unstale":"2024-09-19T05:48:44.398038+0000","last_undegraded":"2024-09-19T05:48:44.398038+0000","last_fullsized":"2024-09-19T05:48:44.398038+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:02.987109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.401034+0000","last_change":"2024-09-19T05:48:43.394917+0000","last_active":"2024-09-19T05:48:44.401034+0000","last_peered":"2024-09-19T05:48:44.401034+0000","last_clean":"2024-09-19T05:48:44.401034+0000","last_became_active":"2024-09-19T05:48:43.394166+0000","last_became_peered":"2024-09-19T05:48:43.394166+0000","last_unstale":"2024-09-19T05:48:44.401034+0000","last_undegraded":"2024-09-19T05:48:44.401034+0000","last_fullsized":"2024-09-19T05:48:44.401034+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:55.322844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868077+0000","last_change":"2024-09-19T05:48:43.418863+0000","last_active":"2024-09-19T05:48:44.868077+0000","last_peered":"2024-09-19T05:48:44.868077+0000","last_clean":"2024-09-19T05:48:44.868077+0000","last_became_active":"2024-09-19T05:48:43.418168+0000","last_became_peered":"2024-09-19T05:48:43.418168+0000","last_unstale":"2024-09-19T05:48:44.868077+0000","last_undegraded":"2024-09-19T05:48:44.868077+0000","last_fullsized":"2024-09-19T05:48:44.868077+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:31.906285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783339+0000","last_change":"2024-09-19T05:48:43.414630+0000","last_active":"2024-09-19T05:48:44.783339+0000","last_peered":"2024-09-19T05:48:44.783339+0000","last_clean":"2024-09-19T05:48:44.783339+0000","last_became_active":"2024-09-19T05:48:43.414339+0000","last_became_peered":"2024-09-19T05:48:43.414339+0000","last_unstale":"2024-09-19T05:48:44.783339+0000","last_undegraded":"2024-09-19T05:48:44.783339+0000","last_fullsized":"2024-09-19T05:48:44.783339+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:28.950820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758668+0000","last_change":"2024-09-19T05:48:43.450780+0000","last_active":"2024-09-19T05:48:45.758668+0000","last_peered":"2024-09-19T05:48:45.758668+0000","last_clean":"2024-09-19T05:48:45.758668+0000","last_became_active":"2024-09-19T05:48:43.450060+0000","last_became_peered":"2024-09-19T05:48:43.450060+0000","last_unstale":"2024-09-19T05:48:45.758668+0000","last_undegraded":"2024-09-19T05:48:45.758668+0000","last_fullsized":"2024-09-19T05:48:45.758668+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:06.905191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758038+0000","last_change":"2024-09-19T05:48:43.409009+0000","last_active":"2024-09-19T05:48:45.758038+0000","last_peered":"2024-09-19T05:48:45.758038+0000","last_clean":"2024-09-19T05:48:45.758038+0000","last_became_active":"2024-09-19T05:48:43.408719+0000","last_became_peered":"2024-09-19T05:48:43.408719+0000","last_unstale":"2024-09-19T05:48:45.758038+0000","last_undegraded":"2024-09-19T05:48:45.758038+0000","last_fullsized":"2024-09-19T05:48:45.758038+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:06.267041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758891+0000","last_change":"2024-09-19T05:48:43.451556+0000","last_active":"2024-09-19T05:48:45.758891+0000","last_peered":"2024-09-19T05:48:45.758891+0000","last_clean":"2024-09-19T05:48:45.758891+0000","last_became_active":"2024-09-19T05:48:43.451009+0000","last_became_peered":"2024-09-19T05:48:43.451009+0000","last_unstale":"2024-09-19T05:48:45.758891+0000","last_undegraded":"2024-09-19T05:48:45.758891+0000","last_fullsized":"2024-09-19T05:48:45.758891+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:55.005584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397793+0000","last_change":"2024-09-19T05:48:43.418387+0000","last_active":"2024-09-19T05:48:44.397793+0000","last_peered":"2024-09-19T05:48:44.397793+0000","last_clean":"2024-09-19T05:48:44.397793+0000","last_became_active":"2024-09-19T05:48:43.418025+0000","last_became_peered":"2024-09-19T05:48:43.418025+0000","last_unstale":"2024-09-19T05:48:44.397793+0000","last_undegraded":"2024-09-19T05:48:44.397793+0000","last_fullsized":"2024-09-19T05:48:44.397793+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:37.974923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"204'4","reported_seq":18,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758939+0000","last_change":"2024-09-19T05:48:42.408182+0000","last_active":"2024-09-19T05:48:45.758939+0000","last_peered":"2024-09-19T05:48:45.758939+0000","last_clean":"2024-09-19T05:48:45.758939+0000","last_became_active":"2024-09-19T05:48:42.407894+0000","last_became_peered":"2024-09-19T05:48:42.407894+0000","last_unstale":"2024-09-19T05:48:45.758939+0000","last_undegraded":"2024-09-19T05:48:45.758939+0000","last_fullsized":"2024-09-19T05:48:45.758939+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:58.166778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397889+0000","last_change":"2024-09-19T05:48:43.402013+0000","last_active":"2024-09-19T05:48:44.397889+0000","last_peered":"2024-09-19T05:48:44.397889+0000","last_clean":"2024-09-19T05:48:44.397889+0000","last_became_active":"2024-09-19T05:48:43.401614+0000","last_became_peered":"2024-09-19T05:48:43.401614+0000","last_unstale":"2024-09-19T05:48:44.397889+0000","last_undegraded":"2024-09-19T05:48:44.397889+0000","last_fullsized":"2024-09-19T05:48:44.397889+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:19.549289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868507+0000","last_change":"2024-09-19T05:48:42.418659+0000","last_active":"2024-09-19T05:48:44.868507+0000","last_peered":"2024-09-19T05:48:44.868507+0000","last_clean":"2024-09-19T05:48:44.868507+0000","last_became_active":"2024-09-19T05:48:42.412905+0000","last_became_peered":"2024-09-19T05:48:42.412905+0000","last_unstale":"2024-09-19T05:48:44.868507+0000","last_undegraded":"2024-09-19T05:48:44.868507+0000","last_fullsized":"2024-09-19T05:48:44.868507+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:18.568117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868306+0000","last_change":"2024-09-19T05:48:43.449114+0000","last_active":"2024-09-19T05:48:44.868306+0000","last_peered":"2024-09-19T05:48:44.868306+0000","last_clean":"2024-09-19T05:48:44.868306+0000","last_became_active":"2024-09-19T05:48:43.447233+0000","last_became_peered":"2024-09-19T05:48:43.447233+0000","last_unstale":"2024-09-19T05:48:44.868306+0000","last_undegraded":"2024-09-19T05:48:44.868306+0000","last_fullsized":"2024-09-19T05:48:44.868306+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:53.450971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.759068+0000","last_change":"2024-09-19T05:48:42.411654+0000","last_active":"2024-09-19T05:48:45.759068+0000","last_peered":"2024-09-19T05:48:45.759068+0000","last_clean":"2024-09-19T05:48:45.759068+0000","last_became_active":"2024-09-19T05:48:42.410979+0000","last_became_peered":"2024-09-19T05:48:42.410979+0000","last_unstale":"2024-09-19T05:48:45.759068+0000","last_undegraded":"2024-09-19T05:48:45.759068+0000","last_fullsized":"2024-09-19T05:48:45.759068+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:21.932022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397407+0000","last_change":"2024-09-19T05:48:43.426521+0000","last_active":"2024-09-19T05:48:44.397407+0000","last_peered":"2024-09-19T05:48:44.397407+0000","last_clean":"2024-09-19T05:48:44.397407+0000","last_became_active":"2024-09-19T05:48:43.426305+0000","last_became_peered":"2024-09-19T05:48:43.426305+0000","last_unstale":"2024-09-19T05:48:44.397407+0000","last_undegraded":"2024-09-19T05:48:44.397407+0000","last_fullsized":"2024-09-19T05:48:44.397407+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:36.474941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400407+0000","last_change":"2024-09-19T05:48:42.431885+0000","last_active":"2024-09-19T05:48:44.400407+0000","last_peered":"2024-09-19T05:48:44.400407+0000","last_clean":"2024-09-19T05:48:44.400407+0000","last_became_active":"2024-09-19T05:48:42.431522+0000","last_became_peered":"2024-09-19T05:48:42.431522+0000","last_unstale":"2024-09-19T05:48:44.400407+0000","last_undegraded":"2024-09-19T05:48:44.400407+0000","last_fullsized":"2024-09-19T05:48:44.400407+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:08.098674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867307+0000","last_change":"2024-09-19T05:48:43.418828+0000","last_active":"2024-09-19T05:48:44.867307+0000","last_peered":"2024-09-19T05:48:44.867307+0000","last_clean":"2024-09-19T05:48:44.867307+0000","last_became_active":"2024-09-19T05:48:43.418076+0000","last_became_peered":"2024-09-19T05:48:43.418076+0000","last_unstale":"2024-09-19T05:48:44.867307+0000","last_undegraded":"2024-09-19T05:48:44.867307+0000","last_fullsized":"2024-09-19T05:48:44.867307+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:51.296112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599404+0000","last_change":"2024-09-19T05:48:42.421966+0000","last_active":"2024-09-19T05:48:44.599404+0000","last_peered":"2024-09-19T05:48:44.599404+0000","last_clean":"2024-09-19T05:48:44.599404+0000","last_became_active":"2024-09-19T05:48:42.421205+0000","last_became_peered":"2024-09-19T05:48:42.421205+0000","last_unstale":"2024-09-19T05:48:44.599404+0000","last_undegraded":"2024-09-19T05:48:44.599404+0000","last_fullsized":"2024-09-19T05:48:44.599404+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:37.521650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400257+0000","last_change":"2024-09-19T05:48:43.422693+0000","last_active":"2024-09-19T05:48:44.400257+0000","last_peered":"2024-09-19T05:48:44.400257+0000","last_clean":"2024-09-19T05:48:44.400257+0000","last_became_active":"2024-09-19T05:48:43.422093+0000","last_became_peered":"2024-09-19T05:48:43.422093+0000","last_unstale":"2024-09-19T05:48:44.400257+0000","last_undegraded":"2024-09-19T05:48:44.400257+0000","last_fullsized":"2024-09-19T05:48:44.400257+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:01.627681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.399905+0000","last_change":"2024-09-19T05:48:42.434205+0000","last_active":"2024-09-19T05:48:44.399905+0000","last_peered":"2024-09-19T05:48:44.399905+0000","last_clean":"2024-09-19T05:48:44.399905+0000","last_became_active":"2024-09-19T05:48:42.433523+0000","last_became_peered":"2024-09-19T05:48:42.433523+0000","last_unstale":"2024-09-19T05:48:44.399905+0000","last_undegraded":"2024-09-19T05:48:44.399905+0000","last_fullsized":"2024-09-19T05:48:44.399905+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:46.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758549+0000","last_change":"2024-09-19T05:48:43.414503+0000","last_active":"2024-09-19T05:48:45.758549+0000","last_peered":"2024-09-19T05:48:45.758549+0000","last_clean":"2024-09-19T05:48:45.758549+0000","last_became_active":"2024-09-19T05:48:43.414221+0000","last_became_peered":"2024-09-19T05:48:43.414221+0000","last_unstale":"2024-09-19T05:48:45.758549+0000","last_undegraded":"2024-09-19T05:48:45.758549+0000","last_fullsized":"2024-09-19T05:48:45.758549+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:25.276365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397514+0000","last_change":"2024-09-19T05:48:42.403566+0000","last_active":"2024-09-19T05:48:44.397514+0000","last_peered":"2024-09-19T05:48:44.397514+0000","last_clean":"2024-09-19T05:48:44.397514+0000","last_became_active":"2024-09-19T05:48:42.403314+0000","last_became_peered":"2024-09-19T05:48:42.403314+0000","last_unstale":"2024-09-19T05:48:44.397514+0000","last_undegraded":"2024-09-19T05:48:44.397514+0000","last_fullsized":"2024-09-19T05:48:44.397514+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:57.433024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400666+0000","last_change":"2024-09-19T05:48:43.385022+0000","last_active":"2024-09-19T05:48:44.400666+0000","last_peered":"2024-09-19T05:48:44.400666+0000","last_clean":"2024-09-19T05:48:44.400666+0000","last_became_active":"2024-09-19T05:48:43.383301+0000","last_became_peered":"2024-09-19T05:48:43.383301+0000","last_unstale":"2024-09-19T05:48:44.400666+0000","last_undegraded":"2024-09-19T05:48:44.400666+0000","last_fullsized":"2024-09-19T05:48:44.400666+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:40:12.719066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600709+0000","last_change":"2024-09-19T05:48:42.416006+0000","last_active":"2024-09-19T05:48:44.600709+0000","last_peered":"2024-09-19T05:48:44.600709+0000","last_clean":"2024-09-19T05:48:44.600709+0000","last_became_active":"2024-09-19T05:48:42.415230+0000","last_became_peered":"2024-09-19T05:48:42.415230+0000","last_unstale":"2024-09-19T05:48:44.600709+0000","last_undegraded":"2024-09-19T05:48:44.600709+0000","last_fullsized":"2024-09-19T05:48:44.600709+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:20.858387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.401002+0000","last_change":"2024-09-19T05:48:43.396355+0000","last_active":"2024-09-19T05:48:44.401002+0000","last_peered":"2024-09-19T05:48:44.401002+0000","last_clean":"2024-09-19T05:48:44.401002+0000","last_became_active":"2024-09-19T05:48:43.395006+0000","last_became_peered":"2024-09-19T05:48:43.395006+0000","last_unstale":"2024-09-19T05:48:44.401002+0000","last_undegraded":"2024-09-19T05:48:44.401002+0000","last_fullsized":"2024-09-19T05:48:44.401002+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:28.144785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400820+0000","last_change":"2024-09-19T05:48:42.433952+0000","last_active":"2024-09-19T05:48:44.400820+0000","last_peered":"2024-09-19T05:48:44.400820+0000","last_clean":"2024-09-19T05:48:44.400820+0000","last_became_active":"2024-09-19T05:48:42.433338+0000","last_became_peered":"2024-09-19T05:48:42.433338+0000","last_unstale":"2024-09-19T05:48:44.400820+0000","last_undegraded":"2024-09-19T05:48:44.400820+0000","last_fullsized":"2024-09-19T05:48:44.400820+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:34.824655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.398120+0000","last_change":"2024-09-19T05:48:43.407865+0000","last_active":"2024-09-19T05:48:44.398120+0000","last_peered":"2024-09-19T05:48:44.398120+0000","last_clean":"2024-09-19T05:48:44.398120+0000","last_became_active":"2024-09-19T05:48:43.407532+0000","last_became_peered":"2024-09-19T05:48:43.407532+0000","last_unstale":"2024-09-19T05:48:44.398120+0000","last_undegraded":"2024-09-19T05:48:44.398120+0000","last_fullsized":"2024-09-19T05:48:44.398120+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:41.386948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"204'3","reported_seq":17,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600029+0000","last_change":"2024-09-19T05:48:42.415855+0000","last_active":"2024-09-19T05:48:44.600029+0000","last_peered":"2024-09-19T05:48:44.600029+0000","last_clean":"2024-09-19T05:48:44.600029+0000","last_became_active":"2024-09-19T05:48:42.415026+0000","last_became_peered":"2024-09-19T05:48:42.415026+0000","last_unstale":"2024-09-19T05:48:44.600029+0000","last_undegraded":"2024-09-19T05:48:44.600029+0000","last_fullsized":"2024-09-19T05:48:44.600029+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:54.202845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400908+0000","last_change":"2024-09-19T05:48:43.411958+0000","last_active":"2024-09-19T05:48:44.400908+0000","last_peered":"2024-09-19T05:48:44.400908+0000","last_clean":"2024-09-19T05:48:44.400908+0000","last_became_active":"2024-09-19T05:48:43.410638+0000","last_became_peered":"2024-09-19T05:48:43.410638+0000","last_unstale":"2024-09-19T05:48:44.400908+0000","last_undegraded":"2024-09-19T05:48:44.400908+0000","last_fullsized":"2024-09-19T05:48:44.400908+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:45.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"204'6","reported_seq":20,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.759323+0000","last_change":"2024-09-19T05:48:42.413681+0000","last_active":"2024-09-19T05:48:45.759323+0000","last_peered":"2024-09-19T05:48:45.759323+0000","last_clean":"2024-09-19T05:48:45.759323+0000","last_became_active":"2024-09-19T05:48:42.412962+0000","last_became_peered":"2024-09-19T05:48:42.412962+0000","last_unstale":"2024-09-19T05:48:45.759323+0000","last_undegraded":"2024-09-19T05:48:45.759323+0000","last_fullsized":"2024-09-19T05:48:45.759323+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:08.288761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782704+0000","last_change":"2024-09-19T05:48:43.414543+0000","last_active":"2024-09-19T05:48:44.782704+0000","last_peered":"2024-09-19T05:48:44.782704+0000","last_clean":"2024-09-19T05:48:44.782704+0000","last_became_active":"2024-09-19T05:48:43.414252+0000","last_became_peered":"2024-09-19T05:48:43.414252+0000","last_unstale":"2024-09-19T05:48:44.782704+0000","last_undegraded":"2024-09-19T05:48:44.782704+0000","last_fullsized":"2024-09-19T05:48:44.782704+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:18.500272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867921+0000","last_change":"2024-09-19T05:48:42.431123+0000","last_active":"2024-09-19T05:48:44.867921+0000","last_peered":"2024-09-19T05:48:44.867921+0000","last_clean":"2024-09-19T05:48:44.867921+0000","last_became_active":"2024-09-19T05:48:42.429778+0000","last_became_peered":"2024-09-19T05:48:42.429778+0000","last_unstale":"2024-09-19T05:48:44.867921+0000","last_undegraded":"2024-09-19T05:48:44.867921+0000","last_fullsized":"2024-09-19T05:48:44.867921+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:27.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867387+0000","last_change":"2024-09-19T05:48:43.440102+0000","last_active":"2024-09-19T05:48:44.867387+0000","last_peered":"2024-09-19T05:48:44.867387+0000","last_clean":"2024-09-19T05:48:44.867387+0000","last_became_active":"2024-09-19T05:48:43.435435+0000","last_became_peered":"2024-09-19T05:48:43.435435+0000","last_unstale":"2024-09-19T05:48:44.867387+0000","last_undegraded":"2024-09-19T05:48:44.867387+0000","last_fullsized":"2024-09-19T05:48:44.867387+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:50.867131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782810+0000","last_change":"2024-09-19T05:48:42.402961+0000","last_active":"2024-09-19T05:48:44.782810+0000","last_peered":"2024-09-19T05:48:44.782810+0000","last_clean":"2024-09-19T05:48:44.782810+0000","last_became_active":"2024-09-19T05:48:42.402277+0000","last_became_peered":"2024-09-19T05:48:42.402277+0000","last_unstale":"2024-09-19T05:48:44.782810+0000","last_undegraded":"2024-09-19T05:48:44.782810+0000","last_fullsized":"2024-09-19T05:48:44.782810+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:58.217507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397615+0000","last_change":"2024-09-19T05:48:43.418049+0000","last_active":"2024-09-19T05:48:44.397615+0000","last_peered":"2024-09-19T05:48:44.397615+0000","last_clean":"2024-09-19T05:48:44.397615+0000","last_became_active":"2024-09-19T05:48:43.417703+0000","last_became_peered":"2024-09-19T05:48:43.417703+0000","last_unstale":"2024-09-19T05:48:44.397615+0000","last_undegraded":"2024-09-19T05:48:44.397615+0000","last_fullsized":"2024-09-19T05:48:44.397615+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:24.073821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758230+0000","last_change":"2024-09-19T05:48:42.407613+0000","last_active":"2024-09-19T05:48:45.758230+0000","last_peered":"2024-09-19T05:48:45.758230+0000","last_clean":"2024-09-19T05:48:45.758230+0000","last_became_active":"2024-09-19T05:48:42.406711+0000","last_became_peered":"2024-09-19T05:48:42.406711+0000","last_unstale":"2024-09-19T05:48:45.758230+0000","last_undegraded":"2024-09-19T05:48:45.758230+0000","last_fullsized":"2024-09-19T05:48:45.758230+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:44.204371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400411+0000","last_change":"2024-09-19T05:48:43.411228+0000","last_active":"2024-09-19T05:48:44.400411+0000","last_peered":"2024-09-19T05:48:44.400411+0000","last_clean":"2024-09-19T05:48:44.400411+0000","last_became_active":"2024-09-19T05:48:43.408701+0000","last_became_peered":"2024-09-19T05:48:43.408701+0000","last_unstale":"2024-09-19T05:48:44.400411+0000","last_undegraded":"2024-09-19T05:48:44.400411+0000","last_fullsized":"2024-09-19T05:48:44.400411+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:58.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"204'8","reported_seq":22,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867265+0000","last_change":"2024-09-19T05:48:42.432352+0000","last_active":"2024-09-19T05:48:44.867265+0000","last_peered":"2024-09-19T05:48:44.867265+0000","last_clean":"2024-09-19T05:48:44.867265+0000","last_became_active":"2024-09-19T05:48:42.430952+0000","last_became_peered":"2024-09-19T05:48:42.430952+0000","last_unstale":"2024-09-19T05:48:44.867265+0000","last_undegraded":"2024-09-19T05:48:44.867265+0000","last_fullsized":"2024-09-19T05:48:44.867265+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:54.318575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783337+0000","last_change":"2024-09-19T05:48:43.450955+0000","last_active":"2024-09-19T05:48:44.783337+0000","last_peered":"2024-09-19T05:48:44.783337+0000","last_clean":"2024-09-19T05:48:44.783337+0000","last_became_active":"2024-09-19T05:48:43.450677+0000","last_became_peered":"2024-09-19T05:48:43.450677+0000","last_unstale":"2024-09-19T05:48:44.783337+0000","last_undegraded":"2024-09-19T05:48:44.783337+0000","last_fullsized":"2024-09-19T05:48:44.783337+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:01.042268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397738+0000","last_change":"2024-09-19T05:48:42.420938+0000","last_active":"2024-09-19T05:48:44.397738+0000","last_peered":"2024-09-19T05:48:44.397738+0000","last_clean":"2024-09-19T05:48:44.397738+0000","last_became_active":"2024-09-19T05:48:42.420638+0000","last_became_peered":"2024-09-19T05:48:42.420638+0000","last_unstale":"2024-09-19T05:48:44.397738+0000","last_undegraded":"2024-09-19T05:48:44.397738+0000","last_fullsized":"2024-09-19T05:48:44.397738+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:38.028062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599654+0000","last_change":"2024-09-19T05:48:43.398153+0000","last_active":"2024-09-19T05:48:44.599654+0000","last_peered":"2024-09-19T05:48:44.599654+0000","last_clean":"2024-09-19T05:48:44.599654+0000","last_became_active":"2024-09-19T05:48:43.397481+0000","last_became_peered":"2024-09-19T05:48:43.397481+0000","last_unstale":"2024-09-19T05:48:44.599654+0000","last_undegraded":"2024-09-19T05:48:44.599654+0000","last_fullsized":"2024-09-19T05:48:44.599654+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:40.978044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758434+0000","last_change":"2024-09-19T05:48:42.409982+0000","last_active":"2024-09-19T05:48:45.758434+0000","last_peered":"2024-09-19T05:48:45.758434+0000","last_clean":"2024-09-19T05:48:45.758434+0000","last_became_active":"2024-09-19T05:48:42.409215+0000","last_became_peered":"2024-09-19T05:48:42.409215+0000","last_unstale":"2024-09-19T05:48:45.758434+0000","last_undegraded":"2024-09-19T05:48:45.758434+0000","last_fullsized":"2024-09-19T05:48:45.758434+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:55.709647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.398382+0000","last_change":"2024-09-19T05:48:43.410199+0000","last_active":"2024-09-19T05:48:44.398382+0000","last_peered":"2024-09-19T05:48:44.398382+0000","last_clean":"2024-09-19T05:48:44.398382+0000","last_became_active":"2024-09-19T05:48:43.407128+0000","last_became_peered":"2024-09-19T05:48:43.407128+0000","last_unstale":"2024-09-19T05:48:44.398382+0000","last_undegraded":"2024-09-19T05:48:44.398382+0000","last_fullsized":"2024-09-19T05:48:44.398382+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:33.346630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"204'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868094+0000","last_change":"2024-09-19T05:48:42.421032+0000","last_active":"2024-09-19T05:48:44.868094+0000","last_peered":"2024-09-19T05:48:44.868094+0000","last_clean":"2024-09-19T05:48:44.868094+0000","last_became_active":"2024-09-19T05:48:42.420242+0000","last_became_peered":"2024-09-19T05:48:42.420242+0000","last_unstale":"2024-09-19T05:48:44.868094+0000","last_undegraded":"2024-09-19T05:48:44.868094+0000","last_fullsized":"2024-09-19T05:48:44.868094+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:01.977725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868739+0000","last_change":"2024-09-19T05:48:43.442967+0000","last_active":"2024-09-19T05:48:44.868739+0000","last_peered":"2024-09-19T05:48:44.868739+0000","last_clean":"2024-09-19T05:48:44.868739+0000","last_became_active":"2024-09-19T05:48:43.442390+0000","last_became_peered":"2024-09-19T05:48:43.442390+0000","last_unstale":"2024-09-19T05:48:44.868739+0000","last_undegraded":"2024-09-19T05:48:44.868739+0000","last_fullsized":"2024-09-19T05:48:44.868739+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:56.209941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868575+0000","last_change":"2024-09-19T05:48:42.426287+0000","last_active":"2024-09-19T05:48:44.868575+0000","last_peered":"2024-09-19T05:48:44.868575+0000","last_clean":"2024-09-19T05:48:44.868575+0000","last_became_active":"2024-09-19T05:48:42.425397+0000","last_became_peered":"2024-09-19T05:48:42.425397+0000","last_unstale":"2024-09-19T05:48:44.868575+0000","last_undegraded":"2024-09-19T05:48:44.868575+0000","last_fullsized":"2024-09-19T05:48:44.868575+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:33.402100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867343+0000","last_change":"2024-09-19T05:48:43.434066+0000","last_active":"2024-09-19T05:48:44.867343+0000","last_peered":"2024-09-19T05:48:44.867343+0000","last_clean":"2024-09-19T05:48:44.867343+0000","last_became_active":"2024-09-19T05:48:43.404070+0000","last_became_peered":"2024-09-19T05:48:43.404070+0000","last_unstale":"2024-09-19T05:48:44.867343+0000","last_undegraded":"2024-09-19T05:48:44.867343+0000","last_fullsized":"2024-09-19T05:48:44.867343+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:10.032809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867935+0000","last_change":"2024-09-19T05:48:42.426204+0000","last_active":"2024-09-19T05:48:44.867935+0000","last_peered":"2024-09-19T05:48:44.867935+0000","last_clean":"2024-09-19T05:48:44.867935+0000","last_became_active":"2024-09-19T05:48:42.413060+0000","last_became_peered":"2024-09-19T05:48:42.413060+0000","last_unstale":"2024-09-19T05:48:44.867935+0000","last_undegraded":"2024-09-19T05:48:44.867935+0000","last_fullsized":"2024-09-19T05:48:44.867935+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:22.460222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600064+0000","last_change":"2024-09-19T05:48:43.415898+0000","last_active":"2024-09-19T05:48:44.600064+0000","last_peered":"2024-09-19T05:48:44.600064+0000","last_clean":"2024-09-19T05:48:44.600064+0000","last_became_active":"2024-09-19T05:48:43.407456+0000","last_became_peered":"2024-09-19T05:48:43.407456+0000","last_unstale":"2024-09-19T05:48:44.600064+0000","last_undegraded":"2024-09-19T05:48:44.600064+0000","last_fullsized":"2024-09-19T05:48:44.600064+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:23.933931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400352+0000","last_change":"2024-09-19T05:48:42.394779+0000","last_active":"2024-09-19T05:48:44.400352+0000","last_peered":"2024-09-19T05:48:44.400352+0000","last_clean":"2024-09-19T05:48:44.400352+0000","last_became_active":"2024-09-19T05:48:42.392507+0000","last_became_peered":"2024-09-19T05:48:42.392507+0000","last_unstale":"2024-09-19T05:48:44.400352+0000","last_undegraded":"2024-09-19T05:48:44.400352+0000","last_fullsized":"2024-09-19T05:48:44.400352+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:59.104953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.782875+0000","last_change":"2024-09-19T05:48:43.448238+0000","last_active":"2024-09-19T05:48:44.782875+0000","last_peered":"2024-09-19T05:48:44.782875+0000","last_clean":"2024-09-19T05:48:44.782875+0000","last_became_active":"2024-09-19T05:48:43.447945+0000","last_became_peered":"2024-09-19T05:48:43.447945+0000","last_unstale":"2024-09-19T05:48:44.782875+0000","last_undegraded":"2024-09-19T05:48:44.782875+0000","last_fullsized":"2024-09-19T05:48:44.782875+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:26.569443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400226+0000","last_change":"2024-09-19T05:48:42.402586+0000","last_active":"2024-09-19T05:48:44.400226+0000","last_peered":"2024-09-19T05:48:44.400226+0000","last_clean":"2024-09-19T05:48:44.400226+0000","last_became_active":"2024-09-19T05:48:42.402273+0000","last_became_peered":"2024-09-19T05:48:42.402273+0000","last_unstale":"2024-09-19T05:48:44.400226+0000","last_undegraded":"2024-09-19T05:48:44.400226+0000","last_fullsized":"2024-09-19T05:48:44.400226+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:30.885834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397703+0000","last_change":"2024-09-19T05:48:43.454666+0000","last_active":"2024-09-19T05:48:44.397703+0000","last_peered":"2024-09-19T05:48:44.397703+0000","last_clean":"2024-09-19T05:48:44.397703+0000","last_became_active":"2024-09-19T05:48:43.454341+0000","last_became_peered":"2024-09-19T05:48:43.454341+0000","last_unstale":"2024-09-19T05:48:44.397703+0000","last_undegraded":"2024-09-19T05:48:44.397703+0000","last_fullsized":"2024-09-19T05:48:44.397703+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:26.856823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.757938+0000","last_change":"2024-09-19T05:48:42.402825+0000","last_active":"2024-09-19T05:48:45.757938+0000","last_peered":"2024-09-19T05:48:45.757938+0000","last_clean":"2024-09-19T05:48:45.757938+0000","last_became_active":"2024-09-19T05:48:42.402113+0000","last_became_peered":"2024-09-19T05:48:42.402113+0000","last_unstale":"2024-09-19T05:48:45.757938+0000","last_undegraded":"2024-09-19T05:48:45.757938+0000","last_fullsized":"2024-09-19T05:48:45.757938+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:28.831373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.783133+0000","last_change":"2024-09-19T05:48:43.411949+0000","last_active":"2024-09-19T05:48:44.783133+0000","last_peered":"2024-09-19T05:48:44.783133+0000","last_clean":"2024-09-19T05:48:44.783133+0000","last_became_active":"2024-09-19T05:48:43.411664+0000","last_became_peered":"2024-09-19T05:48:43.411664+0000","last_unstale":"2024-09-19T05:48:44.783133+0000","last_undegraded":"2024-09-19T05:48:44.783133+0000","last_fullsized":"2024-09-19T05:48:44.783133+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.815536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868895+0000","last_change":"2024-09-19T05:48:42.430481+0000","last_active":"2024-09-19T05:48:44.868895+0000","last_peered":"2024-09-19T05:48:44.868895+0000","last_clean":"2024-09-19T05:48:44.868895+0000","last_became_active":"2024-09-19T05:48:42.429578+0000","last_became_peered":"2024-09-19T05:48:42.429578+0000","last_unstale":"2024-09-19T05:48:44.868895+0000","last_undegraded":"2024-09-19T05:48:44.868895+0000","last_fullsized":"2024-09-19T05:48:44.868895+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:01.458679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.600314+0000","last_change":"2024-09-19T05:48:43.428371+0000","last_active":"2024-09-19T05:48:44.600314+0000","last_peered":"2024-09-19T05:48:44.600314+0000","last_clean":"2024-09-19T05:48:44.600314+0000","last_became_active":"2024-09-19T05:48:43.427134+0000","last_became_peered":"2024-09-19T05:48:43.427134+0000","last_unstale":"2024-09-19T05:48:44.600314+0000","last_undegraded":"2024-09-19T05:48:44.600314+0000","last_fullsized":"2024-09-19T05:48:44.600314+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:49.485630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"205'1","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400594+0000","last_change":"2024-09-19T05:48:42.402888+0000","last_active":"2024-09-19T05:48:44.400594+0000","last_peered":"2024-09-19T05:48:44.400594+0000","last_clean":"2024-09-19T05:48:44.400594+0000","last_became_active":"2024-09-19T05:48:42.402425+0000","last_became_peered":"2024-09-19T05:48:42.402425+0000","last_unstale":"2024-09-19T05:48:44.400594+0000","last_undegraded":"2024-09-19T05:48:44.400594+0000","last_fullsized":"2024-09-19T05:48:44.400594+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:27.307738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.759028+0000","last_change":"2024-09-19T05:48:43.452008+0000","last_active":"2024-09-19T05:48:45.759028+0000","last_peered":"2024-09-19T05:48:45.759028+0000","last_clean":"2024-09-19T05:48:45.759028+0000","last_became_active":"2024-09-19T05:48:43.451442+0000","last_became_peered":"2024-09-19T05:48:43.451442+0000","last_unstale":"2024-09-19T05:48:45.759028+0000","last_undegraded":"2024-09-19T05:48:45.759028+0000","last_fullsized":"2024-09-19T05:48:45.759028+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:12.501380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.401016+0000","last_change":"2024-09-19T05:48:42.392461+0000","last_active":"2024-09-19T05:48:44.401016+0000","last_peered":"2024-09-19T05:48:44.401016+0000","last_clean":"2024-09-19T05:48:44.401016+0000","last_became_active":"2024-09-19T05:48:42.392083+0000","last_became_peered":"2024-09-19T05:48:42.392083+0000","last_unstale":"2024-09-19T05:48:44.401016+0000","last_undegraded":"2024-09-19T05:48:44.401016+0000","last_fullsized":"2024-09-19T05:48:44.401016+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:04.533503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758251+0000","last_change":"2024-09-19T05:48:43.409045+0000","last_active":"2024-09-19T05:48:45.758251+0000","last_peered":"2024-09-19T05:48:45.758251+0000","last_clean":"2024-09-19T05:48:45.758251+0000","last_became_active":"2024-09-19T05:48:43.408767+0000","last_became_peered":"2024-09-19T05:48:43.408767+0000","last_unstale":"2024-09-19T05:48:45.758251+0000","last_undegraded":"2024-09-19T05:48:45.758251+0000","last_fullsized":"2024-09-19T05:48:45.758251+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:42.862553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868856+0000","last_change":"2024-09-19T05:48:42.412842+0000","last_active":"2024-09-19T05:48:44.868856+0000","last_peered":"2024-09-19T05:48:44.868856+0000","last_clean":"2024-09-19T05:48:44.868856+0000","last_became_active":"2024-09-19T05:48:42.412103+0000","last_became_peered":"2024-09-19T05:48:42.412103+0000","last_unstale":"2024-09-19T05:48:44.868856+0000","last_undegraded":"2024-09-19T05:48:44.868856+0000","last_fullsized":"2024-09-19T05:48:44.868856+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:27.071122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397407+0000","last_change":"2024-09-19T05:48:43.451587+0000","last_active":"2024-09-19T05:48:44.397407+0000","last_peered":"2024-09-19T05:48:44.397407+0000","last_clean":"2024-09-19T05:48:44.397407+0000","last_became_active":"2024-09-19T05:48:43.451259+0000","last_became_peered":"2024-09-19T05:48:43.451259+0000","last_unstale":"2024-09-19T05:48:44.397407+0000","last_undegraded":"2024-09-19T05:48:44.397407+0000","last_fullsized":"2024-09-19T05:48:44.397407+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:43.719013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.868282+0000","last_change":"2024-09-19T05:48:42.429925+0000","last_active":"2024-09-19T05:48:44.868282+0000","last_peered":"2024-09-19T05:48:44.868282+0000","last_clean":"2024-09-19T05:48:44.868282+0000","last_became_active":"2024-09-19T05:48:42.426314+0000","last_became_peered":"2024-09-19T05:48:42.426314+0000","last_unstale":"2024-09-19T05:48:44.868282+0000","last_undegraded":"2024-09-19T05:48:44.868282+0000","last_fullsized":"2024-09-19T05:48:44.868282+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:14.460190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397645+0000","last_change":"2024-09-19T05:48:43.408288+0000","last_active":"2024-09-19T05:48:44.397645+0000","last_peered":"2024-09-19T05:48:44.397645+0000","last_clean":"2024-09-19T05:48:44.397645+0000","last_became_active":"2024-09-19T05:48:43.407935+0000","last_became_peered":"2024-09-19T05:48:43.407935+0000","last_unstale":"2024-09-19T05:48:44.397645+0000","last_undegraded":"2024-09-19T05:48:44.397645+0000","last_fullsized":"2024-09-19T05:48:44.397645+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:38.969658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.400174+0000","last_change":"2024-09-19T05:48:42.396864+0000","last_active":"2024-09-19T05:48:44.400174+0000","last_peered":"2024-09-19T05:48:44.400174+0000","last_clean":"2024-09-19T05:48:44.400174+0000","last_became_active":"2024-09-19T05:48:42.396113+0000","last_became_peered":"2024-09-19T05:48:42.396113+0000","last_unstale":"2024-09-19T05:48:44.400174+0000","last_undegraded":"2024-09-19T05:48:44.400174+0000","last_fullsized":"2024-09-19T05:48:44.400174+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:58.307080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:45.758357+0000","last_change":"2024-09-19T05:48:43.400076+0000","last_active":"2024-09-19T05:48:45.758357+0000","last_peered":"2024-09-19T05:48:45.758357+0000","last_clean":"2024-09-19T05:48:45.758357+0000","last_became_active":"2024-09-19T05:48:43.399779+0000","last_became_peered":"2024-09-19T05:48:43.399779+0000","last_unstale":"2024-09-19T05:48:45.758357+0000","last_undegraded":"2024-09-19T05:48:45.758357+0000","last_fullsized":"2024-09-19T05:48:45.758357+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:38.168088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599757+0000","last_change":"2024-09-19T05:48:42.410610+0000","last_active":"2024-09-19T05:48:44.599757+0000","last_peered":"2024-09-19T05:48:44.599757+0000","last_clean":"2024-09-19T05:48:44.599757+0000","last_became_active":"2024-09-19T05:48:42.409545+0000","last_became_peered":"2024-09-19T05:48:42.409545+0000","last_unstale":"2024-09-19T05:48:44.599757+0000","last_undegraded":"2024-09-19T05:48:44.599757+0000","last_fullsized":"2024-09-19T05:48:44.599757+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:58.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867663+0000","last_change":"2024-09-19T05:48:43.452913+0000","last_active":"2024-09-19T05:48:44.867663+0000","last_peered":"2024-09-19T05:48:44.867663+0000","last_clean":"2024-09-19T05:48:44.867663+0000","last_became_active":"2024-09-19T05:48:43.452362+0000","last_became_peered":"2024-09-19T05:48:43.452362+0000","last_unstale":"2024-09-19T05:48:44.867663+0000","last_undegraded":"2024-09-19T05:48:44.867663+0000","last_fullsized":"2024-09-19T05:48:44.867663+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:16.862927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.867587+0000","last_change":"2024-09-19T05:48:42.430171+0000","last_active":"2024-09-19T05:48:44.867587+0000","last_peered":"2024-09-19T05:48:44.867587+0000","last_clean":"2024-09-19T05:48:44.867587+0000","last_became_active":"2024-09-19T05:48:42.427129+0000","last_became_peered":"2024-09-19T05:48:42.427129+0000","last_unstale":"2024-09-19T05:48:44.867587+0000","last_undegraded":"2024-09-19T05:48:44.867587+0000","last_fullsized":"2024-09-19T05:48:44.867587+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:12.337882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":12,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.397634+0000","last_change":"2024-09-19T05:48:43.448726+0000","last_active":"2024-09-19T05:48:44.397634+0000","last_peered":"2024-09-19T05:48:44.397634+0000","last_clean":"2024-09-19T05:48:44.397634+0000","last_became_active":"2024-09-19T05:48:43.448422+0000","last_became_peered":"2024-09-19T05:48:43.448422+0000","last_unstale":"2024-09-19T05:48:44.397634+0000","last_undegraded":"2024-09-19T05:48:44.397634+0000","last_fullsized":"2024-09-19T05:48:44.397634+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:42.359565+0000","last_clean_scrub_stamp":"2024-09-19T05:48:42.359565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:18.931159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"204'2","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599624+0000","last_change":"2024-09-19T05:48:42.407348+0000","last_active":"2024-09-19T05:48:44.599624+0000","last_peered":"2024-09-19T05:48:44.599624+0000","last_clean":"2024-09-19T05:48:44.599624+0000","last_became_active":"2024-09-19T05:48:42.406620+0000","last_became_peered":"2024-09-19T05:48:42.406620+0000","last_unstale":"2024-09-19T05:48:44.599624+0000","last_undegraded":"2024-09-19T05:48:44.599624+0000","last_fullsized":"2024-09-19T05:48:44.599624+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:48:41.355296+0000","last_clean_scrub_stamp":"2024-09-19T05:48:41.355296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:07.874926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":507,"reported_epoch":205,"state":"active+clean","last_fresh":"2024-09-19T05:48:44.599856+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:48:44.599856+0000","last_peered":"2024-09-19T05:48:44.599856+0000","last_clean":"2024-09-19T05:48:44.599856+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:48:44.599856+0000","last_undegraded":"2024-09-19T05:48:44.599856+0000","last_fullsized":"2024-09-19T05:48:44.599856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542335,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74564,"kb_used_data":3112,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297276,"statfs":{"total":96636764160,"available":96560410624,"internally_reserved":0,"allocated":3186688,"data_stored":1814320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542335,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73996,"kb_used_data":2548,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297844,"statfs":{"total":96636764160,"available":96560992256,"internally_reserved":0,"allocated":2609152,"data_stored":1225018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542337,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51776,"kb_used_data":2540,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320064,"statfs":{"total":96636764160,"available":96583745536,"internally_reserved":0,"allocated":2600960,"data_stored":1224962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542335,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78132,"kb_used_data":2528,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293708,"statfs":{"total":96636764160,"available":96556756992,"internally_reserved":0,"allocated":2588672,"data_stored":1223370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542336,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73912,"kb_used_data":2528,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297928,"statfs":{"total":96636764160,"available":96561078272,"internally_reserved":0,"allocated":2588672,"data_stored":1223302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542336,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73980,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297860,"statfs":{"total":96636764160,"available":96561008640,"internally_reserved":0,"allocated":2592768,"data_stored":1223896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542338,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51764,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320076,"statfs":{"total":96636764160,"available":96583757824,"internally_reserved":0,"allocated":2584576,"data_stored":1223280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542335,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78708,"kb_used_data":3104,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293132,"statfs":{"total":96636764160,"available":96556167168,"internally_reserved":0,"allocated":3178496,"data_stored":1813648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:48:52.355 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:48:52.356 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T05:48:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.517+0000 7f192abfe640 1 Processor -- start 2024-09-19T05:48:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.517+0000 7f192abfe640 1 -- start start 2024-09-19T05:48:52.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192abfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f192415b1d0 0x7f19240adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192abfe640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19240aef30 con 0x7f1924070070 2024-09-19T05:48:52.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192abfe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19240ae0f0 con 0x7f192406dfc0 2024-09-19T05:48:52.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192abfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1924072210 con 0x7f192415b1d0 2024-09-19T05:48:52.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192919b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1924070070 0x7f19240b3430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55168/0 (socket says 172.21.15.67:55168) 2024-09-19T05:48:52.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192919b640 1 -- 172.21.15.67:0/2689641261 learned_addr learned my addr 172.21.15.67:0/2689641261 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192899a640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f192415b1d0 0x7f19240adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074427588 0 0) 0x7f19240aef30 con 0x7f1924070070 2024-09-19T05:48:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1910003530 con 0x7f1924070070 2024-09-19T05:48:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2262522736 0 0) 0x7f1910003530 con 0x7f1924070070 2024-09-19T05:48:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f192415b1d0 msgr2=0x7f19240adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f192415b1d0 0x7f19240adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 >> v1:172.21.15.97:6789/0 conn(0x7f192406dfc0 legacy=0x7f192406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19240ae3b0 con 0x7f1924070070 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f191c001a00 con 0x7f1924070070 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192899a640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f192415b1d0 0x7f19240adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 >> v1:172.21.15.67:6789/0 conn(0x7f1924070070 legacy=0x7f19240b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19100039f0 0x7f1910003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1910004810 0x7f1910004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f192415b1d0 0x7f19100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1924072210 con 0x7f19100039f0 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f191000dce0 con 0x7f1910004810 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f191000dee0 con 0x7f192415b1d0 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192899a640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19100039f0 0x7f1910003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f1923fff640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1910004810 0x7f1910004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192919b640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f192415b1d0 0x7f19100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192899a640 1 -- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f192415b1d0 msgr2=0x7f19100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:52.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192899a640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f192415b1d0 0x7f19100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192899a640 1 -- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1910004810 msgr2=0x7f1910004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:52.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192899a640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1910004810 0x7f1910004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192899a640 1 -- 172.21.15.67:0/2689641261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1910003530 con 0x7f19100039f0 2024-09-19T05:48:52.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.521+0000 7f192919b640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f192415b1d0 0x7f19100051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.525+0000 7f192899a640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19100039f0 0x7f1910003e10 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f19140098d0 tx=0x7f191401c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6d863f4f5ecdcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.525+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19140b0070 con 0x7f19100039f0 2024-09-19T05:48:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.525+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19140ab600 con 0x7f19100039f0 2024-09-19T05:48:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.525+0000 7f19237fe640 1 -- 172.21.15.67:0/2689641261 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191400f040 con 0x7f19100039f0 2024-09-19T05:48:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- 172.21.15.67:0/2689641261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19100039f0 msgr2=0x7f1910003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 --2- 172.21.15.67:0/2689641261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19100039f0 0x7f1910003e10 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f19140098d0 tx=0x7f191401c5d0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192919b640 1 -- 172.21.15.67:0/2689641261 reap_dead start 2024-09-19T05:48:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- 172.21.15.67:0/2689641261 shutdown_connections 2024-09-19T05:48:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- 172.21.15.67:0/2689641261 >> 172.21.15.67:0/2689641261 conn(0x7f19240b1e50 msgr2=0x7f19240b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- 172.21.15.67:0/2689641261 shutdown_connections 2024-09-19T05:48:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- 172.21.15.67:0/2689641261 wait complete. 2024-09-19T05:48:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 Processor -- start 2024-09-19T05:48:52.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- start start 2024-09-19T05:48:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19100039f0 0x7f1924150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f192415a3c0 0x7f19241f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19241f6ff0 0x7f19241f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f192406e850 con 0x7f192415a3c0 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1924072420 con 0x7f19241f6ff0 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f192406e9d0 con 0x7f19100039f0 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f1923fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f192415a3c0 0x7f19241f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f1923fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f192415a3c0 0x7f19241f6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42562/0 (socket says 172.21.15.67:42562) 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f1923fff640 1 -- 172.21.15.67:0/205621171 learned_addr learned my addr 172.21.15.67:0/205621171 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192919b640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19241f6ff0 0x7f19241f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192899a640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19100039f0 0x7f1924150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f1923fff640 1 -- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19100039f0 msgr2=0x7f1924150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f1923fff640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19100039f0 0x7f1924150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f1923fff640 1 -- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19241f6ff0 msgr2=0x7f19241f7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f1923fff640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19241f6ff0 0x7f19241f7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f1923fff640 1 -- 172.21.15.67:0/205621171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192414b9b0 con 0x7f192415a3c0 2024-09-19T05:48:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192899a640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19100039f0 0x7f1924150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f1923fff640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f192415a3c0 0x7f19241f6ab0 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f190c00f7f0 tx=0x7f190c00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f19217fa640 1 -- 172.21.15.67:0/205621171 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c0050d0 con 0x7f192415a3c0 2024-09-19T05:48:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f19217fa640 1 -- 172.21.15.67:0/205621171 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190c018070 con 0x7f192415a3c0 2024-09-19T05:48:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- 172.21.15.67:0/205621171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19241f79c0 con 0x7f192415a3c0 2024-09-19T05:48:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f19217fa640 1 -- 172.21.15.67:0/205621171 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c005490 con 0x7f192415a3c0 2024-09-19T05:48:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.529+0000 7f192abfe640 1 -- 172.21.15.67:0/205621171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f192414fb60 con 0x7f192415a3c0 2024-09-19T05:48:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.533+0000 7f192abfe640 1 -- 172.21.15.67:0/205621171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19240b3430 con 0x7f192415a3c0 2024-09-19T05:48:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.533+0000 7f19217fa640 1 -- 172.21.15.67:0/205621171 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f190c00d6d0 con 0x7f192415a3c0 2024-09-19T05:48:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.533+0000 7f19217fa640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1904067a60 0x7f1904069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.533+0000 7f19217fa640 1 -- 172.21.15.67:0/205621171 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f190c085c30 con 0x7f192415a3c0 2024-09-19T05:48:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.533+0000 7f192899a640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1904067a60 0x7f1904069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.533+0000 7f192899a640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1904067a60 0x7f1904069f20 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f19140ad000 tx=0x7f19140046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:52.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.537+0000 7f19217fa640 1 -- 172.21.15.67:0/205621171 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f190c0565e0 con 0x7f192415a3c0 2024-09-19T05:48:52.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.753+0000 7f192abfe640 1 -- 172.21.15.67:0/205621171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1924150e70 con 0x7f192415a3c0 2024-09-19T05:48:52.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.753+0000 7f19217fa640 1 -- 172.21.15.67:0/205621171 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) ==== 190+0+147 (secure 0 0 0) 0x7f190c055ee0 con 0x7f192415a3c0 2024-09-19T05:48:52.756 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-19T05:48:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBat+tmtjUBBBAABrXTT0ww8At39LVgV1xB+A== 2024-09-19T05:48:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-09-19T05:48:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-09-19T05:48:52.756 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T05:48:52.757 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-09-19T05:48:52.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 -- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1904067a60 msgr2=0x7f1904069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1904067a60 0x7f1904069f20 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f19140ad000 tx=0x7f19140046d0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 -- 172.21.15.67:0/205621171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f192415a3c0 msgr2=0x7f19241f6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f192415a3c0 0x7f19241f6ab0 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f190c00f7f0 tx=0x7f190c00fcb0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 -- 172.21.15.67:0/205621171 shutdown_connections 2024-09-19T05:48:52.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19241f6ff0 0x7f19241f7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f192415a3c0 0x7f19241f6ab0 unknown :-1 s=CLOSED pgs=2457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1904067a60 0x7f1904069f20 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 --2- 172.21.15.67:0/205621171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19100039f0 0x7f1924150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 -- 172.21.15.67:0/205621171 >> 172.21.15.67:0/205621171 conn(0x7f19240b1e50 msgr2=0x7f19240b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:52.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 -- 172.21.15.67:0/205621171 shutdown_connections 2024-09-19T05:48:52.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.757+0000 7f192abfe640 1 -- 172.21.15.67:0/205621171 wait complete. 2024-09-19T05:48:52.774 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:48:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b508b0640 1 Processor -- start 2024-09-19T05:48:52.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b508b0640 1 -- start start 2024-09-19T05:48:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b508b0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c15c030 0x7f1b4c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b508b0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b4c06f460 0x7f1b4c06f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b508b0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4c06e3c0 con 0x7f1b4c15d1d0 2024-09-19T05:48:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b508b0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c06e6a0 con 0x7f1b4c06f460 2024-09-19T05:48:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b508b0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c06e980 con 0x7f1b4c15c030 2024-09-19T05:48:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b4c06f460 0x7f1b4c06f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b4c06f460 0x7f1b4c06f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42564/0 (socket says 172.21.15.67:42564) 2024-09-19T05:48:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4ad9d640 1 -- 172.21.15.67:0/2428717709 learned_addr learned my addr 172.21.15.67:0/2428717709 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4a59c640 1 --2- 172.21.15.67:0/2428717709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c15c030 0x7f1b4c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4ad9d640 1 -- 172.21.15.67:0/2428717709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c15c030 msgr2=0x7f1b4c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4ad9d640 1 --2- 172.21.15.67:0/2428717709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c15c030 0x7f1b4c06dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4ad9d640 1 -- 172.21.15.67:0/2428717709 >> v1:172.21.15.97:6789/0 conn(0x7f1b4c15d1d0 legacy=0x7f1b4c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:52.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4ad9d640 1 -- 172.21.15.67:0/2428717709 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c06ec60 con 0x7f1b4c06f460 2024-09-19T05:48:52.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4ad9d640 1 --2- 172.21.15.67:0/2428717709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c06f460 0x7f1b4c06f8d0 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009870 tx=0x7f1b4401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5ad28575fc9172 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:52.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4959a640 1 -- 172.21.15.67:0/2428717709 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b440aa430 con 0x7f1b4c06f460 2024-09-19T05:48:52.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4959a640 1 -- 172.21.15.67:0/2428717709 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b440af070 con 0x7f1b4c06f460 2024-09-19T05:48:52.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.897+0000 7f1b4959a640 1 -- 172.21.15.67:0/2428717709 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b440aa7f0 con 0x7f1b4c06f460 2024-09-19T05:48:52.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- 172.21.15.67:0/2428717709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c06f460 msgr2=0x7f1b4c06f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 --2- 172.21.15.67:0/2428717709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c06f460 0x7f1b4c06f8d0 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009870 tx=0x7f1b4401c4f0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- 172.21.15.67:0/2428717709 shutdown_connections 2024-09-19T05:48:52.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 --2- 172.21.15.67:0/2428717709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c06f460 0x7f1b4c06f8d0 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 --2- 172.21.15.67:0/2428717709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c15c030 0x7f1b4c06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- 172.21.15.67:0/2428717709 >> 172.21.15.67:0/2428717709 conn(0x7f1b4c0d0080 msgr2=0x7f1b4c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:52.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- 172.21.15.67:0/2428717709 shutdown_connections 2024-09-19T05:48:52.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- 172.21.15.67:0/2428717709 wait complete. 2024-09-19T05:48:52.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 Processor -- start 2024-09-19T05:48:52.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- start start 2024-09-19T05:48:52.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c06f460 0x7f1b4c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c15c030 0x7f1b4c14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b4c15d1d0 0x7f1b4c0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c15c590 con 0x7f1b4c15c030 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c15c410 con 0x7f1b4c15d1d0 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c1690e0 con 0x7f1b4c06f460 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b49d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c15c030 0x7f1b4c14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b49d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c15c030 0x7f1b4c14a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42574/0 (socket says 172.21.15.67:42574) 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b49d9b640 1 -- 172.21.15.67:0/3689525970 learned_addr learned my addr 172.21.15.67:0/3689525970 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b4ad9d640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b4c15d1d0 0x7f1b4c0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b4a59c640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c06f460 0x7f1b4c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b49d9b640 1 -- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c06f460 msgr2=0x7f1b4c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b49d9b640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c06f460 0x7f1b4c1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b49d9b640 1 -- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b4c15d1d0 msgr2=0x7f1b4c0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b49d9b640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b4c15d1d0 0x7f1b4c0cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b49d9b640 1 -- 172.21.15.67:0/3689525970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c156600 con 0x7f1b4c15c030 2024-09-19T05:48:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b4a59c640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c06f460 0x7f1b4c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b49d9b640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c15c030 0x7f1b4c14a970 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000b410 tx=0x7f1b4000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b3affd640 1 -- 172.21.15.67:0/3689525970 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40015030 con 0x7f1b4c15c030 2024-09-19T05:48:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b3affd640 1 -- 172.21.15.67:0/3689525970 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b40004020 con 0x7f1b4c15c030 2024-09-19T05:48:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b3affd640 1 -- 172.21.15.67:0/3689525970 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40004410 con 0x7f1b4c15c030 2024-09-19T05:48:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- 172.21.15.67:0/3689525970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c1568a0 con 0x7f1b4c15c030 2024-09-19T05:48:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.901+0000 7f1b508b0640 1 -- 172.21.15.67:0/3689525970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c0ce740 con 0x7f1b4c15c030 2024-09-19T05:48:52.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.905+0000 7f1b508b0640 1 -- 172.21.15.67:0/3689525970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b4c06dde0 con 0x7f1b4c15c030 2024-09-19T05:48:52.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.905+0000 7f1b3affd640 1 -- 172.21.15.67:0/3689525970 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b40018070 con 0x7f1b4c15c030 2024-09-19T05:48:52.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.905+0000 7f1b3affd640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 0x7f1b2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:52.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.905+0000 7f1b3affd640 1 -- 172.21.15.67:0/3689525970 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f1b40085980 con 0x7f1b4c15c030 2024-09-19T05:48:52.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.905+0000 7f1b4a59c640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 0x7f1b2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:52.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.905+0000 7f1b4a59c640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 0x7f1b2c069d80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c007f50 tx=0x7f1b3c0074a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:52.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:52.909+0000 7f1b3affd640 1 -- 172.21.15.67:0/3689525970 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1b400563c0 con 0x7f1b4c15c030 2024-09-19T05:48:53.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.105+0000 7f1b508b0640 1 -- 172.21.15.67:0/3689525970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b4c0ceec0 con 0x7f1b4c15c030 2024-09-19T05:48:53.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b3affd640 1 -- 172.21.15.67:0/3689525970 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+5236 (secure 0 0 0) 0x7f1b40055cc0 con 0x7f1b4c15c030 2024-09-19T05:48:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:53.108 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":146,"btime":"2024-09-19T05:48:46:398467+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2335567881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2335567881},{"type":"v1","addr":"172.21.15.97:6837","nonce":2335567881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":8551,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1743099743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1743099743},{"type":"v1","addr":"172.21.15.97:6835","nonce":1743099743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":10839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/644096538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":644096538},{"type":"v1","addr":"172.21.15.67:6833","nonce":644096538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:48:42.753814+0000","modified":"2024-09-19T05:48:45.770434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10845":{"gid":10845,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1771202736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1771202736},{"type":"v1","addr":"172.21.15.67:6835","nonce":1771202736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10845,"qdb_cluster":[10845]},"id":14}]} 2024-09-19T05:48:53.108 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 146 2024-09-19T05:48:53.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 -- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 msgr2=0x7f1b2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 0x7f1b2c069d80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c007f50 tx=0x7f1b3c0074a0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 -- 172.21.15.67:0/3689525970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c15c030 msgr2=0x7f1b4c14a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c15c030 0x7f1b4c14a970 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000b410 tx=0x7f1b4000b8d0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 -- 172.21.15.67:0/3689525970 shutdown_connections 2024-09-19T05:48:53.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b4c15d1d0 0x7f1b4c0cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c15c030 0x7f1b4c14a970 unknown :-1 s=CLOSED pgs=2459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1b2c0678c0 0x7f1b2c069d80 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 --2- 172.21.15.67:0/3689525970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b4c06f460 0x7f1b4c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 -- 172.21.15.67:0/3689525970 >> 172.21.15.67:0/3689525970 conn(0x7f1b4c0d0080 msgr2=0x7f1b4c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:53.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 -- 172.21.15.67:0/3689525970 shutdown_connections 2024-09-19T05:48:53.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.109+0000 7f1b508b0640 1 -- 172.21.15.67:0/3689525970 wait complete. 2024-09-19T05:48:53.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 146, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:48:42.753814+0000', 'modified': '2024-09-19T05:48:45.770434+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10845}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10845': {'gid': 10845, 'name': 'c', 'rank': 0, 'incarnation': 142, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/1771202736', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 1771202736}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 1771202736}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10845, 'qdb_cluster': [10845]} 2024-09-19T05:48:53.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:48:53.531 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:48:53.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.669+0000 7f2835ff3640 1 Processor -- start 2024-09-19T05:48:53.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.669+0000 7f2835ff3640 1 -- start start 2024-09-19T05:48:53.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f2835ff3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f283015c030 0x7f283006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f2835ff3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283006e3c0 con 0x7f283015d1d0 2024-09-19T05:48:53.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f2835ff3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283006e6a0 con 0x7f283006f460 2024-09-19T05:48:53.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f2835ff3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f283006e980 con 0x7f283015c030 2024-09-19T05:48:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f282f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f283015c030 0x7f283006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f282effd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f283015d1d0 0x7f28300b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55180/0 (socket says 172.21.15.67:55180) 2024-09-19T05:48:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f282effd640 1 -- 172.21.15.67:0/1524886103 learned_addr learned my addr 172.21.15.67:0/1524886103 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f282f7fe640 1 -- 172.21.15.67:0/1524886103 >> v1:172.21.15.97:6789/0 conn(0x7f283006f460 legacy=0x7f28300acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f282f7fe640 1 -- 172.21.15.67:0/1524886103 >> v1:172.21.15.67:6789/0 conn(0x7f283015d1d0 legacy=0x7f28300b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f282f7fe640 1 -- 172.21.15.67:0/1524886103 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283006ec60 con 0x7f283015c030 2024-09-19T05:48:53.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f282f7fe640 1 --2- 172.21.15.67:0/1524886103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 0x7f283006dde0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7f28200097c0 tx=0x7f282001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0abd4a03fb5aac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:53.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f282e7fc640 1 -- 172.21.15.67:0/1524886103 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28200b1070 con 0x7f283015c030 2024-09-19T05:48:53.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f282e7fc640 1 -- 172.21.15.67:0/1524886103 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28200ac5f0 con 0x7f283015c030 2024-09-19T05:48:53.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.673+0000 7f282e7fc640 1 -- 172.21.15.67:0/1524886103 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28200ac9c0 con 0x7f283015c030 2024-09-19T05:48:53.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- 172.21.15.67:0/1524886103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 msgr2=0x7f283006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 --2- 172.21.15.67:0/1524886103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 0x7f283006dde0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7f28200097c0 tx=0x7f282001c470 comp rx=0 tx=0).stop 2024-09-19T05:48:53.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- 172.21.15.67:0/1524886103 shutdown_connections 2024-09-19T05:48:53.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 --2- 172.21.15.67:0/1524886103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 0x7f283006dde0 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- 172.21.15.67:0/1524886103 >> 172.21.15.67:0/1524886103 conn(0x7f28300d0080 msgr2=0x7f28300d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:53.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- 172.21.15.67:0/1524886103 shutdown_connections 2024-09-19T05:48:53.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- 172.21.15.67:0/1524886103 wait complete. 2024-09-19T05:48:53.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 Processor -- start 2024-09-19T05:48:53.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- start start 2024-09-19T05:48:53.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f283006f460 0x7f283014d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 0x7f283009a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f283015d1d0 0x7f283009cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f283015c590 con 0x7f283015c030 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f283015c410 con 0x7f283006f460 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f28300ad6c0 con 0x7f283015d1d0 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 0x7f283009a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 0x7f283009a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42604/0 (socket says 172.21.15.67:42604) 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282effd640 1 -- 172.21.15.67:0/3413573691 learned_addr learned my addr 172.21.15.67:0/3413573691 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282f7fe640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f283006f460 0x7f283014d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282ffff640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f283015d1d0 0x7f283009cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282effd640 1 -- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f283015d1d0 msgr2=0x7f283009cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282effd640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f283015d1d0 0x7f283009cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282effd640 1 -- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f283006f460 msgr2=0x7f283014d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282effd640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f283006f460 0x7f283014d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282effd640 1 -- 172.21.15.67:0/3413573691 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283009d460 con 0x7f283015c030 2024-09-19T05:48:53.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282ffff640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f283015d1d0 0x7f283009cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:53.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f282effd640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 0x7f283009a1a0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f282400c430 tx=0x7f282400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:53.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2817fff640 1 -- 172.21.15.67:0/3413573691 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824017070 con 0x7f283015c030 2024-09-19T05:48:53.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2817fff640 1 -- 172.21.15.67:0/3413573691 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2824005cf0 con 0x7f283015c030 2024-09-19T05:48:53.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- 172.21.15.67:0/3413573691 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283009a860 con 0x7f283015c030 2024-09-19T05:48:53.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2817fff640 1 -- 172.21.15.67:0/3413573691 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28240072d0 con 0x7f283015c030 2024-09-19T05:48:53.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.677+0000 7f2835ff3640 1 -- 172.21.15.67:0/3413573691 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283009ae20 con 0x7f283015c030 2024-09-19T05:48:53.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f2817fff640 1 -- 172.21.15.67:0/3413573691 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f282401a070 con 0x7f283015c030 2024-09-19T05:48:53.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f2817fff640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f281c0678c0 0x7f281c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f2817fff640 1 -- 172.21.15.67:0/3413573691 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f28240850c0 con 0x7f283015c030 2024-09-19T05:48:53.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f281c0678c0 0x7f281c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28390af000 1 Processor -- start 2024-09-19T05:48:53.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28390af000 1 -- start start 2024-09-19T05:48:53.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f281c0678c0 0x7f281c069d80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f28200ae000 tx=0x7f28200a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:53.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28390af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28390af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x56379449cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28390af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56379449d290 0x56379449d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28390af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563794384b60 con 0x5637944e6b20 2024-09-19T05:48:53.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28390af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5637942ebc70 con 0x5637944e7440 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28390af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563794291ed0 con 0x56379449d290 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42608/0 (socket says 172.21.15.67:42608) 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 -- 172.21.15.67:0/3978495209 learned_addr learned my addr 172.21.15.67:0/3978495209 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282effd640 1 --2- 172.21.15.67:0/3978495209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x56379449cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282ffff640 1 --2- 172.21.15.67:0/3978495209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56379449d290 0x56379449d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 -- 172.21.15.67:0/3978495209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56379449d290 msgr2=0x56379449d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 --2- 172.21.15.67:0/3978495209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56379449d290 0x56379449d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 -- 172.21.15.67:0/3978495209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 msgr2=0x56379449cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 --2- 172.21.15.67:0/3978495209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x56379449cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 -- 172.21.15.67:0/3978495209 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637942a3e50 con 0x5637944e6b20 2024-09-19T05:48:53.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f282f7fe640 1 --2- 172.21.15.67:0/3978495209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e6f00 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7f2820000c10 tx=0x7f2820004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5da429f415af1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:53.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28157fa640 1 -- 172.21.15.67:0/3978495209 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28200b1040 con 0x5637944e6b20 2024-09-19T05:48:53.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28157fa640 1 -- 172.21.15.67:0/3978495209 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28200acdd0 con 0x5637944e6b20 2024-09-19T05:48:53.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.681+0000 7f28157fa640 1 -- 172.21.15.67:0/3978495209 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28200b7b90 con 0x5637944e6b20 2024-09-19T05:48:53.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- 172.21.15.67:0/3978495209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 msgr2=0x5637944e6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 --2- 172.21.15.67:0/3978495209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e6f00 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7f2820000c10 tx=0x7f2820004740 comp rx=0 tx=0).stop 2024-09-19T05:48:53.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- 172.21.15.67:0/3978495209 shutdown_connections 2024-09-19T05:48:53.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 --2- 172.21.15.67:0/3978495209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56379449d290 0x56379449d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 --2- 172.21.15.67:0/3978495209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x56379449cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 --2- 172.21.15.67:0/3978495209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e6f00 unknown :-1 s=CLOSED pgs=2463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- 172.21.15.67:0/3978495209 >> 172.21.15.67:0/3978495209 conn(0x5637944a3600 msgr2=0x56379449b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- 172.21.15.67:0/3978495209 shutdown_connections 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- 172.21.15.67:0/3978495209 wait complete. 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- start start 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 Processor -- start 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x5637944a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944a8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56379434db00 con 0x5637944e6b20 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5637942c6360 con 0x5637944e7440 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5637942c32d0 con 0x5637944a2330 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 10 client.0 _ll_register_callbacks cb 0x563794488820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42614/0 (socket says 172.21.15.67:42614) 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282f7fe640 1 -- 172.21.15.67:0/2487120876 learned_addr learned my addr 172.21.15.67:0/2487120876 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282effd640 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x5637944a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282ffff640 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282f7fe640 1 -- 172.21.15.67:0/2487120876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 msgr2=0x5637944a8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282f7fe640 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944a8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282f7fe640 1 -- 172.21.15.67:0/2487120876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 msgr2=0x5637944a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282f7fe640 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x5637944a7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282f7fe640 1 -- 172.21.15.67:0/2487120876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563794292120 con 0x5637944e6b20 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282f7fe640 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944a1df0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7f282001a0a0 tx=0x7f282001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572a10d938c98b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f280e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f280e7fc640 1 -- 172.21.15.67:0/2487120876 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28200b1040 con 0x5637944e6b20 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- 172.21.15.67:0/2487120876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28200acdd0 con 0x5637944e6b20 2024-09-19T05:48:53.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f280e7fc640 1 -- 172.21.15.67:0/2487120876 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f28200cb450 con 0x5637944e6b20 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f280e7fc640 1 -- 172.21.15.67:0/2487120876 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) ==== 24+0+0 (secure 0 0 0) 0x7f28200d9050 con 0x5637944e6b20 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 10 client.11007 fetch_fsmap learned FSMap version 146 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- 172.21.15.67:0/2487120876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=2+}) -- 0x56379428b450 con 0x5637944e6b20 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f280e7fc640 1 -- 172.21.15.67:0/2487120876 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28200acdd0 con 0x5637944e6b20 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f280e7fc640 1 -- 172.21.15.67:0/2487120876 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 146) ==== 3502+0+0 (secure 0 0 0) 0x7f28200dc020 con 0x5637944e6b20 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 10 client.11007 fetch_fsmap finished waiting for FSMap version 146 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 10 client.11007 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 20 client.11007 populate_metadata read hostname 'smithi067' 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x5637944f5280 0x5637944f7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 4 client.11007 mds_command: new command op to 10845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f28390af000 1 -- 172.21.15.67:0/2487120876 --> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563794285c00 con 0x5637944f5280 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.685+0000 7f282effd640 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x5637944f5280 0x5637944f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f280e7fc640 10 client.11007 ms_handle_connect on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f282effd640 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x5637944f5280 0x5637944f7670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c5c244a3935b050 server_cookie=544bd14f2a074ae6 in_seq=0 out_seq=0 2024-09-19T05:48:53.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f280e7fc640 1 -- 172.21.15.67:0/2487120876 <== mds.0 v2:172.21.15.67:6834/1771202736 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563794285c00 con 0x5637944f5280 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f280e7fc640 10 client.11007 handle_command_reply: tid=0 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 client.11007 shutdown 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 -- 172.21.15.67:0/2487120876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 msgr2=0x5637944a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944a1df0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7f282001a0a0 tx=0x7f282001acb0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 -- 172.21.15.67:0/2487120876 shutdown_connections 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944a8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x5637944a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x5637944f5280 0x5637944f7670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 --2- 172.21.15.67:0/2487120876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944a1df0 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f280e7fc640 0 client.11007 ms_handle_reset on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 -- 172.21.15.67:0/2487120876 >> 172.21.15.67:0/2487120876 conn(0x56379449d290 msgr2=0x56379449bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 -- 172.21.15.67:0/2487120876 shutdown_connections 2024-09-19T05:48:53.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 1 -- 172.21.15.67:0/2487120876 wait complete. 2024-09-19T05:48:53.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.689+0000 7f28390af000 20 client.11007 trim_cache size 0 max 16384 2024-09-19T05:48:53.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.705+0000 7f28390af000 1 Processor -- start 2024-09-19T05:48:53.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.705+0000 7f28390af000 1 -- start start 2024-09-19T05:48:53.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x5637944f7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2830200c60 con 0x5637944e6b20 2024-09-19T05:48:53.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f28301f5cd0 con 0x5637944e7440 2024-09-19T05:48:53.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2830200610 con 0x5637944a2330 2024-09-19T05:48:53.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42628/0 (socket says 172.21.15.67:42628) 2024-09-19T05:48:53.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 -- 172.21.15.67:0/2726227863 learned_addr learned my addr 172.21.15.67:0/2726227863 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282ffff640 1 --2- 172.21.15.67:0/2726227863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x5637944f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282f7fe640 1 --2- 172.21.15.67:0/2726227863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 -- 172.21.15.67:0/2726227863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 msgr2=0x5637944e5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 --2- 172.21.15.67:0/2726227863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944e5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 -- 172.21.15.67:0/2726227863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 msgr2=0x5637944f7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 --2- 172.21.15.67:0/2726227863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x5637944f7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 -- 172.21.15.67:0/2726227863 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637944e7270 con 0x5637944e6b20 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282ffff640 1 --2- 172.21.15.67:0/2726227863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x5637944f7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 --2- 172.21.15.67:0/2726227863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e61d0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f28240070a0 tx=0x7f2824083330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d965521fb0538cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f2814ff9640 1 -- 172.21.15.67:0/2726227863 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824051a90 con 0x5637944e6b20 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f2814ff9640 1 -- 172.21.15.67:0/2726227863 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282406d150 con 0x5637944e6b20 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f2814ff9640 1 -- 172.21.15.67:0/2726227863 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824051c30 con 0x5637944e6b20 2024-09-19T05:48:53.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- 172.21.15.67:0/2726227863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 msgr2=0x5637944e61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 --2- 172.21.15.67:0/2726227863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e61d0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f28240070a0 tx=0x7f2824083330 comp rx=0 tx=0).stop 2024-09-19T05:48:53.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- 172.21.15.67:0/2726227863 shutdown_connections 2024-09-19T05:48:53.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 --2- 172.21.15.67:0/2726227863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x5637944f7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 --2- 172.21.15.67:0/2726227863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x5637944e61d0 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 --2- 172.21.15.67:0/2726227863 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944e5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- 172.21.15.67:0/2726227863 >> 172.21.15.67:0/2726227863 conn(0x56379449d290 msgr2=0x5637944a15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:53.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- 172.21.15.67:0/2726227863 shutdown_connections 2024-09-19T05:48:53.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- 172.21.15.67:0/2726227863 wait complete. 2024-09-19T05:48:53.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- start start 2024-09-19T05:48:53.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 Processor -- start 2024-09-19T05:48:53.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x563794519d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x56379451a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5637942eaf80 con 0x5637944e6b20 2024-09-19T05:48:53.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5637942a3ca0 con 0x5637944e7440 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x5637942f02a0 con 0x5637944a2330 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f28390af000 10 client.0 _ll_register_callbacks cb 0x7f2820009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x563794519d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x563794519d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42632/0 (socket says 172.21.15.67:42632) 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282effd640 1 -- 172.21.15.67:0/2669619998 learned_addr learned my addr 172.21.15.67:0/2669619998 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.709+0000 7f282f7fe640 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f282ffff640 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x56379451a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f282effd640 1 -- 172.21.15.67:0/2669619998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 msgr2=0x5637944faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f282effd640 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f282effd640 1 -- 172.21.15.67:0/2669619998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 msgr2=0x56379451a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f282effd640 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x56379451a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f282effd640 1 -- 172.21.15.67:0/2669619998 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563794272fd0 con 0x5637944e6b20 2024-09-19T05:48:53.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f282ffff640 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x56379451a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f280e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f282effd640 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x563794519d70 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f2824083430 tx=0x7f2824014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf18e11ff8674475 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f280e7fc640 1 -- 172.21.15.67:0/2669619998 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824007670 con 0x5637944e6b20 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 -- 172.21.15.67:0/2669619998 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f282406d150 con 0x5637944e6b20 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f280e7fc640 1 -- 172.21.15.67:0/2669619998 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f2824054870 con 0x5637944e6b20 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f280e7fc640 1 -- 172.21.15.67:0/2669619998 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) ==== 24+0+0 (secure 0 0 0) 0x7f2824054ab0 con 0x5637944e6b20 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 10 client.11013 fetch_fsmap learned FSMap version 146 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 -- 172.21.15.67:0/2669619998 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=2+}) -- 0x56379436e750 con 0x5637944e6b20 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f280e7fc640 1 -- 172.21.15.67:0/2669619998 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282406d150 con 0x5637944e6b20 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f280e7fc640 1 -- 172.21.15.67:0/2669619998 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 146) ==== 3502+0+0 (secure 0 0 0) 0x7f2824051170 con 0x5637944e6b20 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 10 client.11013 fetch_fsmap finished waiting for FSMap version 146 2024-09-19T05:48:53.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 10 client.11013 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 20 client.11013 populate_metadata read hostname 'smithi067' 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x56379451a7f0 0x56379455e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 4 client.11013 mds_command: new command op to 10845 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 -- 172.21.15.67:0/2669619998 --> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] -- command(tid 0: {"prefix": "status"}) -- 0x5637942f93a0 con 0x56379451a7f0 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f282f7fe640 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x56379451a7f0 0x56379455e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f280e7fc640 10 client.11013 ms_handle_connect on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f282f7fe640 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x56379451a7f0 0x56379455e220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4c0e48694b63cb0 server_cookie=a57facdb2c5ebf41 in_seq=0 out_seq=0 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f280e7fc640 1 -- 172.21.15.67:0/2669619998 <== mds.0 v2:172.21.15.67:6834/1771202736 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x5637942f93a0 con 0x56379451a7f0 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f280e7fc640 10 client.11013 handle_command_reply: tid=0 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 client.11013 shutdown 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 -- 172.21.15.67:0/2669619998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 msgr2=0x563794519d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x563794519d70 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f2824083430 tx=0x7f2824014040 comp rx=0 tx=0).stop 2024-09-19T05:48:53.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 -- 172.21.15.67:0/2669619998 shutdown_connections 2024-09-19T05:48:53.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5637944e7440 0x56379451a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x56379451a7f0 0x56379455e220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5637944e6b20 0x563794519d70 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 --2- 172.21.15.67:0/2669619998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5637944a2330 0x5637944faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f280e7fc640 0 client.11013 ms_handle_reset on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:53.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 -- 172.21.15.67:0/2669619998 >> 172.21.15.67:0/2669619998 conn(0x56379449d290 msgr2=0x5637944e4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:53.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 -- 172.21.15.67:0/2669619998 shutdown_connections 2024-09-19T05:48:53.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 1 -- 172.21.15.67:0/2669619998 wait complete. 2024-09-19T05:48:53.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f28390af000 20 client.11013 trim_cache size 0 max 16384 2024-09-19T05:48:53.720 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dd76f598-8c3d-42aa-abf8-24c2f9728b78", 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 10845, 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 10.326464402999999, 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 146, 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 205, 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 205, 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 15.647096597999999 2024-09-19T05:48:53.721 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:48:53.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 -- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f281c0678c0 msgr2=0x7f281c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f281c0678c0 0x7f281c069d80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f28200ae000 tx=0x7f28200a7000 comp rx=0 tx=0).stop 2024-09-19T05:48:53.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 -- 172.21.15.67:0/3413573691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 msgr2=0x7f283009a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 0x7f283009a1a0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f282400c430 tx=0x7f282400c8f0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 -- 172.21.15.67:0/3413573691 shutdown_connections 2024-09-19T05:48:53.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f281c0678c0 0x7f281c069d80 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f283015d1d0 0x7f283009cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f283015c030 0x7f283009a1a0 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 --2- 172.21.15.67:0/3413573691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f283006f460 0x7f283014d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 -- 172.21.15.67:0/3413573691 >> 172.21.15.67:0/3413573691 conn(0x7f28300d0080 msgr2=0x7f2830154090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:53.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 -- 172.21.15.67:0/3413573691 shutdown_connections 2024-09-19T05:48:53.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.713+0000 7f2835ff3640 1 -- 172.21.15.67:0/3413573691 wait complete. 2024-09-19T05:48:53.731 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:48:53.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.841+0000 7f32d2307640 1 Processor -- start 2024-09-19T05:48:53.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.841+0000 7f32d2307640 1 -- start start 2024-09-19T05:48:53.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d2307640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f32cc15c030 0x7f32cc06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d2307640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32cc06e3c0 con 0x7f32cc15d1d0 2024-09-19T05:48:53.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d2307640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32cc06e6a0 con 0x7f32cc06f460 2024-09-19T05:48:53.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d2307640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f32cc06e980 con 0x7f32cc15c030 2024-09-19T05:48:53.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32cb7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f32cc15d1d0 0x7f32cc0b2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55186/0 (socket says 172.21.15.67:55186) 2024-09-19T05:48:53.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32cb7fe640 1 -- 172.21.15.67:0/2706700353 learned_addr learned my addr 172.21.15.67:0/2706700353 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32cbfff640 1 --2- 172.21.15.67:0/2706700353 >> v2:172.21.15.97:3300/0 conn(0x7f32cc15c030 0x7f32cc06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152872530 0 0) 0x7f32cc06e3c0 con 0x7f32cc15d1d0 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32b4003530 con 0x7f32cc15d1d0 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3729451189 0 0) 0x7f32b4003530 con 0x7f32cc15d1d0 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 >> v2:172.21.15.97:3300/0 conn(0x7f32cc15c030 msgr2=0x7f32cc06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 --2- 172.21.15.67:0/2706700353 >> v2:172.21.15.97:3300/0 conn(0x7f32cc15c030 0x7f32cc06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 >> v1:172.21.15.97:6789/0 conn(0x7f32cc06f460 legacy=0x7f32cc0acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc06ec60 con 0x7f32cc15d1d0 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f32bc001680 con 0x7f32cc15d1d0 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 >> v1:172.21.15.67:6789/0 conn(0x7f32cc15d1d0 legacy=0x7f32cc0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32b40039c0 0x7f32b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32b4004810 0x7f32b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc06e980 con 0x7f32b40051d0 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f32b400c070 con 0x7f32b4004810 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f32b400c270 con 0x7f32b40039c0 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d08a4640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32cb7fe640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32b4004810 0x7f32b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32cbfff640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32b40039c0 0x7f32b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d08a4640 1 -- 172.21.15.67:0/2706700353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32b40039c0 msgr2=0x7f32b4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d08a4640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32b40039c0 0x7f32b4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d08a4640 1 -- 172.21.15.67:0/2706700353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32b4004810 msgr2=0x7f32b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d08a4640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32b4004810 0x7f32b4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d08a4640 1 -- 172.21.15.67:0/2706700353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b4003530 con 0x7f32b40051d0 2024-09-19T05:48:53.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32cbfff640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32b40039c0 0x7f32b4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d08a4640 1 -- 172.21.15.67:0/2706700353 reap_dead start 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.845+0000 7f32d08a4640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32b400b9d0 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f32c4001e70 tx=0x7f32c401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2591b33eead7b70c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4001a90 con 0x7f32b40051d0 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c4003bc0 con 0x7f32b40051d0 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32caffd640 1 -- 172.21.15.67:0/2706700353 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4005020 con 0x7f32b40051d0 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- 172.21.15.67:0/2706700353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 msgr2=0x7f32b400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32b400b9d0 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f32c4001e70 tx=0x7f32c401c780 comp rx=0 tx=0).stop 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- 172.21.15.67:0/2706700353 shutdown_connections 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 --2- 172.21.15.67:0/2706700353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32b400b9d0 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- 172.21.15.67:0/2706700353 >> 172.21.15.67:0/2706700353 conn(0x7f32cc0d0080 msgr2=0x7f32cc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- 172.21.15.67:0/2706700353 shutdown_connections 2024-09-19T05:48:53.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- 172.21.15.67:0/2706700353 wait complete. 2024-09-19T05:48:53.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 Processor -- start 2024-09-19T05:48:53.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- start start 2024-09-19T05:48:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32cc1f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32cc153550 0x7f32cc1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32cc14c970 0x7f32cc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc15c410 con 0x7f32b40051d0 2024-09-19T05:48:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc15d660 con 0x7f32cc153550 2024-09-19T05:48:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f32cc15c590 con 0x7f32cc14c970 2024-09-19T05:48:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32cc1f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32cc1f2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42650/0 (socket says 172.21.15.67:42650) 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cbfff640 1 -- 172.21.15.67:0/1675774345 learned_addr learned my addr 172.21.15.67:0/1675774345 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cb7fe640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32cc153550 0x7f32cc1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d08a4640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32cc14c970 0x7f32cc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cbfff640 1 -- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32cc14c970 msgr2=0x7f32cc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cbfff640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32cc14c970 0x7f32cc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cbfff640 1 -- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32cc153550 msgr2=0x7f32cc1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cbfff640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32cc153550 0x7f32cc1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cbfff640 1 -- 172.21.15.67:0/1675774345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc1f3370 con 0x7f32b40051d0 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cb7fe640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32cc153550 0x7f32cc1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32cbfff640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32cc1f2e30 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f32c00108d0 tx=0x7f32c0010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32c8ff9640 1 -- 172.21.15.67:0/1675774345 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c000f040 con 0x7f32b40051d0 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32c8ff9640 1 -- 172.21.15.67:0/1675774345 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c0004220 con 0x7f32b40051d0 2024-09-19T05:48:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- 172.21.15.67:0/1675774345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32cc152210 con 0x7f32b40051d0 2024-09-19T05:48:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32c8ff9640 1 -- 172.21.15.67:0/1675774345 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c000e900 con 0x7f32b40051d0 2024-09-19T05:48:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.849+0000 7f32d2307640 1 -- 172.21.15.67:0/1675774345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32cc152790 con 0x7f32b40051d0 2024-09-19T05:48:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.853+0000 7f32d2307640 1 -- 172.21.15.67:0/1675774345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32cc06f870 con 0x7f32b40051d0 2024-09-19T05:48:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.853+0000 7f32c8ff9640 1 -- 172.21.15.67:0/1675774345 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32c000eaa0 con 0x7f32b40051d0 2024-09-19T05:48:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.853+0000 7f32c8ff9640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32b80678f0 0x7f32b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.853+0000 7f32c8ff9640 1 -- 172.21.15.67:0/1675774345 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f32c0086210 con 0x7f32b40051d0 2024-09-19T05:48:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.853+0000 7f32cb7fe640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32b80678f0 0x7f32b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.853+0000 7f32cb7fe640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32b80678f0 0x7f32b8069db0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f32bc001ec0 tx=0x7f32bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:53.857+0000 7f32c8ff9640 1 -- 172.21.15.67:0/1675774345 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f32cc1f3370 con 0x7f32b40051d0 2024-09-19T05:48:54.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 -- 172.21.15.67:0/1675774345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f32cc0d0f20 con 0x7f32b40051d0 2024-09-19T05:48:54.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32c8ff9640 1 -- 172.21.15.67:0/1675774345 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v146) ==== 53+0+73 (secure 0 0 0) 0x7f32c0018030 con 0x7f32b40051d0 2024-09-19T05:48:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:48:54.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 -- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32b80678f0 msgr2=0x7f32b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:54.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32b80678f0 0x7f32b8069db0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f32bc001ec0 tx=0x7f32bc009040 comp rx=0 tx=0).stop 2024-09-19T05:48:54.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 -- 172.21.15.67:0/1675774345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 msgr2=0x7f32cc1f2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:54.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32cc1f2e30 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f32c00108d0 tx=0x7f32c0010d90 comp rx=0 tx=0).stop 2024-09-19T05:48:54.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 -- 172.21.15.67:0/1675774345 shutdown_connections 2024-09-19T05:48:54.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32b80678f0 0x7f32b8069db0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:54.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32cc14c970 0x7f32cc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:54.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32cc153550 0x7f32cc1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:54.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 --2- 172.21.15.67:0/1675774345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32b40051d0 0x7f32cc1f2e30 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:54.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 -- 172.21.15.67:0/1675774345 >> 172.21.15.67:0/1675774345 conn(0x7f32cc0d0080 msgr2=0x7f32cc0acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:54.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 -- 172.21.15.67:0/1675774345 shutdown_connections 2024-09-19T05:48:54.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54.053+0000 7f32d2307640 1 -- 172.21.15.67:0/1675774345 wait complete. 2024-09-19T05:48:54.071 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:48:54.072 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:48:54.072 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-19T05:48:54.072 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:48:54.072 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:48:54.072 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:48:54.072 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:48:54.072 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:48:54.072 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:48:54.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:54.073 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-19T05:48:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:48:54.079 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:48:54.079 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:48:54.080 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:48:54.080 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-19T05:48:54.080 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:48:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:48:54.080 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:48:54.080 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-19T05:48:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:48:54.080 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:48:54.080 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-19T05:48:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41570sec preferred_lft 41570sec 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:86:91:07:47 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-19T05:48:54.081 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:48:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-19T05:48:54.083 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:48:54.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:54.083 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:48:54.129 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-19T05:48:54.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:54.131 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-19T05:48:54.180 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:48:54.181 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:48:54.181 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-19T05:48:54.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:48:54.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:48:54.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:48:54.181 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-19T05:48:54.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:48:54.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:48:54.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:54.305 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:48:54.310 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:48:54.311 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:48:54.311 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:48:54.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:54.311 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-19T05:48:54.366 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:48:54.366 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:48:54.366 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:48:54.413 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:48:54.413 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:48:54.413 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:48:54.460 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:48:54.518 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:48:54.567 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:48:54.567 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:48:54.567 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:48:54.567 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:48:54.567 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:48:54.568 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:48:54.569 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:48:54.570 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:48:54.570 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:48:54.570 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:48:54.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:54.571 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:48:54.617 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:48:54.617 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:48:54.662 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:48:54.677 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:48:54.729 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:48:54.729 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:48:54.729 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:48:54.729 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:48:54.729 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:48:54.729 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:48:54.729 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:48:54.730 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:48:54.731 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:48:54.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:54.732 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:48:54.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-09-19T05:48:54.745+0000 7f724b040580 -1 init, newargv = 0x557c25fec170 newargc=15 2024-09-19T05:48:54.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[89463]: starting ceph client 2024-09-19T05:48:54.753 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[89463]: starting fuse 2024-09-19T05:48:55.851 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-09-19T05:48:55.867 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:48:55.919 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-09-19T05:48:55.919 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-09-19T05:48:55.919 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:48:55.920 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:48:55.921 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:48:55.922 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:48:55.922 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-09-19T05:48:55.922 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:48:55.922 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:48:55.922 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:48:55.922 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:48:55.922 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:48:55.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:55.923 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-09-19T05:48:55.969 INFO:teuthology.orchestra.run.smithi067.stdout:45 2024-09-19T05:48:55.969 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-19T05:48:55.969 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:48:55.969 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-09-19T05:48:55.969 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-09-19T05:48:55.969 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-09-19T05:48:55.970 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:48:55.971 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:48:55.971 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:48:55.971 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-09-19T05:48:55.971 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-09-19T05:48:55.971 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-09-19T05:48:55.971 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:48:55.971 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:48:55.971 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-09-19T05:48:55.971 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:48:56.097 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.89463.asok 2024-09-19T05:48:56.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:48:56.109 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.89463.asok 2024-09-19T05:48:56.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:56.109 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.89463.asok status 2024-09-19T05:48:56.266 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:48:56.266 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-09-19T05:48:56.266 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:48:56.266 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:48:56.266 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-09-19T05:48:56.266 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-09-19T05:48:56.266 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:48:56.266 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "89463", 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 11028, 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 11028 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:48:56.267 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 696180848 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 696180848 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.11028 192.168.0.1:0/696180848", 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/696180848", 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 146, 2024-09-19T05:48:56.268 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 205, 2024-09-19T05:48:56.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:48:56.269 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-09-19T05:48:56.269 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-09-19T05:48:56.269 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:48:56.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:56.281 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-09-19T05:48:56.281 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:48:56.286 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-09-19T05:48:56.286 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:48:56.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:56.286 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:48:56.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:56.341 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-19T05:48:56.398 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:48:56.398 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:48:56.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:56.445 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-19T05:48:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:6+0 records in 2024-09-19T05:48:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:6+0 records out 2024-09-19T05:48:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0740723 s, 84.9 MB/s 2024-09-19T05:48:56.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T05:48:56.576 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T05:48:56.606 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2024-09-19T05:48:56.607 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2024-09-19T05:48:56.608 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2024-09-19T05:48:56.609 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.67,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]" 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = dd76f598-8c3d-42aa-abf8-24c2f9728b78 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2024-09-19T05:48:56.610 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug trim objects = true 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 20 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 20 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:48:56.612 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 10 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-09-19T05:48:56.613 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2024-09-19T05:48:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2024-09-19T05:48:56.615 INFO:teuthology.orchestra.run.smithi067.stdout: mon down mkfs grace = 300 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on pool no app = False 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = "" 2024-09-19T05:48:56.616 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds balancer = 20 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:48:56.617 INFO:teuthology.orchestra.run.smithi067.stdout: mds cache max size = 1000 2024-09-19T05:48:56.618 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2024-09-19T05:48:56.618 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2024-09-19T05:48:56.618 INFO:teuthology.orchestra.run.smithi067.stdout: mds log max segments = 1 2024-09-19T05:48:56.618 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2024-09-19T05:48:56.618 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = False 2024-09-19T05:48:56.618 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-09-19T05:48:56.618 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-09-19T05:48:56.618 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-09-19T05:48:56.619 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-09-19T05:48:56.620 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-09-19T05:48:56.621 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-09-19T05:48:56.622 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.67,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]" 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = dd76f598-8c3d-42aa-abf8-24c2f9728b78 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-09-19T05:48:56.623 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-09-19T05:48:56.624 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 20 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 20 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:48:56.625 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 10 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:48:56.626 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-09-19T05:48:56.627 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-09-19T05:48:56.628 INFO:teuthology.orchestra.run.smithi097.stdout: mon down mkfs grace = 300 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: mon op complaint time = 120 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on pool no app = False 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: client mount timeout = 600 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = "" 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-09-19T05:48:56.629 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout:[mds] 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds = 20 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds balancer = 20 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout: mds cache max size = 1000 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug frag = True 2024-09-19T05:48:56.630 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug scatterstat = True 2024-09-19T05:48:56.631 INFO:teuthology.orchestra.run.smithi097.stdout: mds log max segments = 1 2024-09-19T05:48:56.631 INFO:teuthology.orchestra.run.smithi097.stdout: mds op complaint time = 180 2024-09-19T05:48:56.631 INFO:teuthology.orchestra.run.smithi097.stdout: mds verify scatter = False 2024-09-19T05:48:56.631 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-09-19T05:48:56.631 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-09-19T05:48:56.631 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-09-19T05:48:56.632 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T05:48:56.670 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T05:48:56.698 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-09-19T05:48:56.698 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2024-09-19T05:48:56.698 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T05:48:56.698 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2024-09-19T05:48:56.698 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.698 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2024-09-19T05:48:56.698 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.698 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2024-09-19T05:48:56.698 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.699 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T05:48:56.700 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.67,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]" 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = dd76f598-8c3d-42aa-abf8-24c2f9728b78 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.701 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug trim objects = true 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2024-09-19T05:48:56.702 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 20 2024-09-19T05:48:56.703 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 20 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 10 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2024-09-19T05:48:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2024-09-19T05:48:56.705 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.706 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: mon down mkfs grace = 300 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on pool no app = False 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2024-09-19T05:48:56.707 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = "" 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2024-09-19T05:48:56.708 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds balancer = 20 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: mds cache max size = 1000 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = False 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: mds log max segments = 1 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = False 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-09-19T05:48:56.709 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-09-19T05:48:56.711 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-09-19T05:48:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-09-19T05:48:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T05:48:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-09-19T05:48:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-09-19T05:48:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-09-19T05:48:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-09-19T05:48:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.67,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]" 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = dd76f598-8c3d-42aa-abf8-24c2f9728b78 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-09-19T05:48:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-09-19T05:48:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 20 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 20 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 10 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-09-19T05:48:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-09-19T05:48:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: mon down mkfs grace = 300 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: mon op complaint time = 120 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on pool no app = False 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T05:48:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: client mount timeout = 600 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = "" 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout:[mds] 2024-09-19T05:48:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds = 20 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds balancer = 20 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: mds cache max size = 1000 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug frag = True 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug scatterstat = False 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: mds log max segments = 1 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: mds op complaint time = 180 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: mds verify scatter = False 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-09-19T05:48:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> import stat 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> import json 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> import sys 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> try: 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> except OSError as e: 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> sys.exit(e.errno) 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-19T05:48:56.723 DEBUG:teuthology.orchestra.run.smithi067:> print(json.dumps( 2024-09-19T05:48:56.724 DEBUG:teuthology.orchestra.run.smithi067:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-19T05:48:56.724 DEBUG:teuthology.orchestra.run.smithi067:> indent=2)) 2024-09-19T05:48:56.724 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:48:56.827 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:48:56.827 INFO:teuthology.orchestra.run.smithi067.stdout: "st_mode": 33204, 2024-09-19T05:48:56.827 INFO:teuthology.orchestra.run.smithi067.stdout: "st_ino": 1099511627777, 2024-09-19T05:48:56.827 INFO:teuthology.orchestra.run.smithi067.stdout: "st_dev": 45, 2024-09-19T05:48:56.827 INFO:teuthology.orchestra.run.smithi067.stdout: "st_nlink": 1, 2024-09-19T05:48:56.827 INFO:teuthology.orchestra.run.smithi067.stdout: "st_uid": 1000, 2024-09-19T05:48:56.827 INFO:teuthology.orchestra.run.smithi067.stdout: "st_gid": 1271, 2024-09-19T05:48:56.827 INFO:teuthology.orchestra.run.smithi067.stdout: "st_size": 6291456, 2024-09-19T05:48:56.827 INFO:teuthology.orchestra.run.smithi067.stdout: "st_atime": 1726724936.4992762, 2024-09-19T05:48:56.828 INFO:teuthology.orchestra.run.smithi067.stdout: "st_mtime": 1726724936.5480747, 2024-09-19T05:48:56.828 INFO:teuthology.orchestra.run.smithi067.stdout: "st_ctime": 1726724936.5480747 2024-09-19T05:48:56.828 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:48:56.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:48:56.838 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:48:57.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad14291640 1 Processor -- start 2024-09-19T05:48:57.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad14291640 1 -- start start 2024-09-19T05:48:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad14291640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fad0c06f850 0x7fad0c0d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad14291640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad0c06fcc0 con 0x7fad0c0d0b20 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad14291640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad0c073110 con 0x7fad0c15b1a0 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad14291640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fad0c0d0f90 con 0x7fad0c06f850 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1282e640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fad0c0d0b20 0x7fad0c0b3730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55412/0 (socket says 172.21.15.67:55412) 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1282e640 1 -- 172.21.15.67:0/745602297 learned_addr learned my addr 172.21.15.67:0/745602297 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1182c640 1 --2- 172.21.15.67:0/745602297 >> v2:172.21.15.97:3300/0 conn(0x7fad0c06f850 0x7fad0c0d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2473175340 0 0) 0x7fad0c06fcc0 con 0x7fad0c0d0b20 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf8003530 con 0x7fad0c0d0b20 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3081778487 0 0) 0x7facf8003530 con 0x7fad0c0d0b20 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 >> v2:172.21.15.97:3300/0 conn(0x7fad0c06f850 msgr2=0x7fad0c0d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 --2- 172.21.15.67:0/745602297 >> v2:172.21.15.97:3300/0 conn(0x7fad0c06f850 0x7fad0c0d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 >> v1:172.21.15.97:6789/0 conn(0x7fad0c15b1a0 legacy=0x7fad0c0adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c0733f0 con 0x7fad0c0d0b20 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fad04001a00 con 0x7fad0c0d0b20 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 >> v1:172.21.15.67:6789/0 conn(0x7fad0c0d0b20 legacy=0x7fad0c0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facf80039c0 0x7facf8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facf8004810 0x7facf8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facf80052f0 0x7facf800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c0d0f90 con 0x7facf8004810 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7facf800c1c0 con 0x7facf80039c0 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7facf800c3c0 con 0x7facf80052f0 2024-09-19T05:48:57.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1182c640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facf8004810 0x7facf8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1182c640 1 -- 172.21.15.67:0/745602297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facf80052f0 msgr2=0x7facf800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1182c640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7facf80052f0 0x7facf800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1182c640 1 -- 172.21.15.67:0/745602297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facf80039c0 msgr2=0x7facf8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1202d640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facf80039c0 0x7facf8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1182c640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facf80039c0 0x7facf8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1282e640 1 -- 172.21.15.67:0/745602297 reap_dead start 2024-09-19T05:48:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1182c640 1 -- 172.21.15.67:0/745602297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf8003530 con 0x7facf8004810 2024-09-19T05:48:57.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.005+0000 7fad1202d640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facf80039c0 0x7facf8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:57.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad1182c640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facf8004810 0x7facf8004c90 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7facfc009ab0 tx=0x7facfc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c13c2a59a79439 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc0096b0 con 0x7facf8004810 2024-09-19T05:48:57.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facfc0a64f0 con 0x7facf8004810 2024-09-19T05:48:57.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad1102b640 1 -- 172.21.15.67:0/745602297 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc0a68e0 con 0x7facf8004810 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 -- 172.21.15.67:0/745602297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facf8004810 msgr2=0x7facf8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facf8004810 0x7facf8004c90 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7facfc009ab0 tx=0x7facfc01ca00 comp rx=0 tx=0).stop 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 -- 172.21.15.67:0/745602297 shutdown_connections 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 --2- 172.21.15.67:0/745602297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facf8004810 0x7facf8004c90 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 -- 172.21.15.67:0/745602297 >> 172.21.15.67:0/745602297 conn(0x7fad0c06c040 msgr2=0x7fad0c06c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 -- 172.21.15.67:0/745602297 shutdown_connections 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 -- 172.21.15.67:0/745602297 wait complete. 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 Processor -- start 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 -- start start 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facf8004810 0x7fad0c1f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c150c70 0x7fad0c155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.009+0000 7fad14291640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad0c1fb850 0x7fad0c153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad14291640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c072ed0 con 0x7fad0c150c70 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad14291640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c072d50 con 0x7facf8004810 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad14291640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fad0c072480 con 0x7fad0c1fb850 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1182c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c150c70 0x7fad0c155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1182c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c150c70 0x7fad0c155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57160/0 (socket says 172.21.15.67:57160) 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1182c640 1 -- 172.21.15.67:0/688075084 learned_addr learned my addr 172.21.15.67:0/688075084 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1202d640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facf8004810 0x7fad0c1f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1282e640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad0c1fb850 0x7fad0c153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1182c640 1 -- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad0c1fb850 msgr2=0x7fad0c153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1182c640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad0c1fb850 0x7fad0c153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1182c640 1 -- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facf8004810 msgr2=0x7fad0c1f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1182c640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facf8004810 0x7fad0c1f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1182c640 1 -- 172.21.15.67:0/688075084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c1559c0 con 0x7fad0c150c70 2024-09-19T05:48:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1182c640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c150c70 0x7fad0c155190 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7facfc01c830 tx=0x7facfc0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad02ffd640 1 -- 172.21.15.67:0/688075084 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc0a66a0 con 0x7fad0c150c70 2024-09-19T05:48:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad02ffd640 1 -- 172.21.15.67:0/688075084 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facfc0be070 con 0x7fad0c150c70 2024-09-19T05:48:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad14291640 1 -- 172.21.15.67:0/688075084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c155ca0 con 0x7fad0c150c70 2024-09-19T05:48:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad02ffd640 1 -- 172.21.15.67:0/688075084 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc0a6a40 con 0x7fad0c150c70 2024-09-19T05:48:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad14291640 1 -- 172.21.15.67:0/688075084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c1fb330 con 0x7fad0c150c70 2024-09-19T05:48:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad14291640 1 -- 172.21.15.67:0/688075084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0c0b3730 con 0x7fad0c150c70 2024-09-19T05:48:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad02ffd640 1 -- 172.21.15.67:0/688075084 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7facfc0a6be0 con 0x7fad0c150c70 2024-09-19T05:48:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad02ffd640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facf00678c0 0x7facf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad02ffd640 1 -- 172.21.15.67:0/688075084 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7facfc1204d0 con 0x7fad0c150c70 2024-09-19T05:48:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.013+0000 7fad1202d640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facf00678c0 0x7facf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.017+0000 7fad1202d640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facf00678c0 0x7facf0069d80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fad0c051960 tx=0x7fad08009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.021+0000 7fad02ffd640 1 -- 172.21.15.67:0/688075084 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7facfc016740 con 0x7fad0c150c70 2024-09-19T05:48:57.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 -- 172.21.15.67:0/688075084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad0c15e900 con 0x7fad0c150c70 2024-09-19T05:48:57.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad02ffd640 1 -- 172.21.15.67:0/688075084 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+5236 (secure 0 0 0) 0x7facfc0f0f10 con 0x7fad0c150c70 2024-09-19T05:48:57.221 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:48:57.221 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":146,"btime":"2024-09-19T05:48:46:398467+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2335567881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2335567881},{"type":"v1","addr":"172.21.15.97:6837","nonce":2335567881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":8551,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1743099743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1743099743},{"type":"v1","addr":"172.21.15.97:6835","nonce":1743099743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":10839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/644096538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":644096538},{"type":"v1","addr":"172.21.15.67:6833","nonce":644096538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:48:42.753814+0000","modified":"2024-09-19T05:48:45.770434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10845":{"gid":10845,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1771202736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1771202736},{"type":"v1","addr":"172.21.15.67:6835","nonce":1771202736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10845,"qdb_cluster":[10845]},"id":14}]} 2024-09-19T05:48:57.221 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 146 2024-09-19T05:48:57.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 -- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facf00678c0 msgr2=0x7facf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facf00678c0 0x7facf0069d80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fad0c051960 tx=0x7fad08009040 comp rx=0 tx=0).stop 2024-09-19T05:48:57.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 -- 172.21.15.67:0/688075084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c150c70 msgr2=0x7fad0c155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c150c70 0x7fad0c155190 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7facfc01c830 tx=0x7facfc0197a0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 -- 172.21.15.67:0/688075084 shutdown_connections 2024-09-19T05:48:57.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7facf00678c0 0x7facf0069d80 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad0c1fb850 0x7fad0c153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c150c70 0x7fad0c155190 unknown :-1 s=CLOSED pgs=2475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 --2- 172.21.15.67:0/688075084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facf8004810 0x7fad0c1f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 -- 172.21.15.67:0/688075084 >> 172.21.15.67:0/688075084 conn(0x7fad0c06c040 msgr2=0x7fad0c0afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 -- 172.21.15.67:0/688075084 shutdown_connections 2024-09-19T05:48:57.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.221+0000 7fad14291640 1 -- 172.21.15.67:0/688075084 wait complete. 2024-09-19T05:48:57.241 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-19T05:48:57.401 INFO:teuthology.orchestra.run.smithi067.stdout:{"message":"","return_code":0} 2024-09-19T05:48:57.402 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-19T05:48:57.402 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-09-19T05:48:57.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.441+0000 7f04592f3080 1 Processor -- start 2024-09-19T05:48:57.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.441+0000 7f04592f3080 1 -- start start 2024-09-19T05:48:57.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.441+0000 7f04592f3080 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555f4312cab0 0x555f431437c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.441+0000 7f04592f3080 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f431cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.441+0000 7f04592f3080 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555f43144a00 0x555f4313ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x555f43145510 con 0x555f4312ce90 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x555f4304d1b0 con 0x555f4312cab0 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x555f431457b0 con 0x555f43144a00 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f431cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f431cfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57166/0 (socket says 172.21.15.67:57166) 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 -- 172.21.15.67:0/3678865050 learned_addr learned my addr 172.21.15.67:0/3678865050 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456e06640 1 --2- 172.21.15.67:0/3678865050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555f4312cab0 0x555f431437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0457607640 1 --2- 172.21.15.67:0/3678865050 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555f43144a00 0x555f4313ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 -- 172.21.15.67:0/3678865050 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555f43144a00 msgr2=0x555f4313ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 --2- 172.21.15.67:0/3678865050 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555f43144a00 0x555f4313ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 -- 172.21.15.67:0/3678865050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555f4312cab0 msgr2=0x555f431437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 --2- 172.21.15.67:0/3678865050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555f4312cab0 0x555f431437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 -- 172.21.15.67:0/3678865050 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f431cf690 con 0x555f4312ce90 2024-09-19T05:48:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 --2- 172.21.15.67:0/3678865050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f431cfdd0 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f044c009930 tx=0x7f044c005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2976b50fbeb5c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0455603640 1 -- 172.21.15.67:0/3678865050 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c008da0 con 0x555f4312ce90 2024-09-19T05:48:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0455603640 1 -- 172.21.15.67:0/3678865050 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c018070 con 0x555f4312ce90 2024-09-19T05:48:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0455603640 1 -- 172.21.15.67:0/3678865050 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c013620 con 0x555f4312ce90 2024-09-19T05:48:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- 172.21.15.67:0/3678865050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 msgr2=0x555f431cfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 --2- 172.21.15.67:0/3678865050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f431cfdd0 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f044c009930 tx=0x7f044c005ad0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- 172.21.15.67:0/3678865050 shutdown_connections 2024-09-19T05:48:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 --2- 172.21.15.67:0/3678865050 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555f43144a00 0x555f4313ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 --2- 172.21.15.67:0/3678865050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f431cfdd0 unknown :-1 s=CLOSED pgs=2476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 --2- 172.21.15.67:0/3678865050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555f4312cab0 0x555f431437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- 172.21.15.67:0/3678865050 >> 172.21.15.67:0/3678865050 conn(0x555f43129330 msgr2=0x555f431cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- 172.21.15.67:0/3678865050 shutdown_connections 2024-09-19T05:48:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- 172.21.15.67:0/3678865050 wait complete. 2024-09-19T05:48:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 Processor -- start 2024-09-19T05:48:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- start start 2024-09-19T05:48:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555f4312cab0 0x555f431c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f4313f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555f43144a00 0x555f4313da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x555f431cf930 con 0x555f4312ce90 2024-09-19T05:48:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x555f431cd6e0 con 0x555f4312cab0 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f04592f3080 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x555f431cd360 con 0x555f43144a00 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f4313f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f4313f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57174/0 (socket says 172.21.15.67:57174) 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 -- 172.21.15.67:0/226856907 learned_addr learned my addr 172.21.15.67:0/226856907 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456e06640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555f4312cab0 0x555f431c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0457607640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555f43144a00 0x555f4313da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 -- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555f43144a00 msgr2=0x555f4313da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555f43144a00 0x555f4313da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 -- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555f4312cab0 msgr2=0x555f431c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555f4312cab0 0x555f431c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 -- 172.21.15.67:0/226856907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4313e4f0 con 0x555f4312ce90 2024-09-19T05:48:57.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0457607640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555f43144a00 0x555f4313da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f0456605640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f4313f410 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7f044c005dc0 tx=0x7f044c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.445+0000 7f043ffff640 1 -- 172.21.15.67:0/226856907 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c008ea0 con 0x555f4312ce90 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f043ffff640 1 -- 172.21.15.67:0/226856907 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c021070 con 0x555f4312ce90 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f04592f3080 1 -- 172.21.15.67:0/226856907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f4313e790 con 0x555f4312ce90 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f043ffff640 1 -- 172.21.15.67:0/226856907 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c0094e0 con 0x555f4312ce90 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f04592f3080 1 -- 172.21.15.67:0/226856907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f4313ecd0 con 0x555f4312ce90 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f043ffff640 1 -- 172.21.15.67:0/226856907 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f044c01d400 con 0x555f4312ce90 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f043ffff640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0444066470 0x7f0444068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f043ffff640 1 -- 172.21.15.67:0/226856907 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f044c086f10 con 0x555f4312ce90 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f04592f3080 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x555f4313dfd0 0x555f4326b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f04592f3080 1 -- 172.21.15.67:0/226856907 --> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] -- osd_op(unknown.0.0:1 30.7 30:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e205) -- 0x555f4326b5a0 con 0x555f4313dfd0 2024-09-19T05:48:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f0456e06640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0444066470 0x7f0444068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f0457607640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x555f4313dfd0 0x555f4326b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f0457607640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x555f4313dfd0 0x555f4326b060 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.449+0000 7f0456e06640 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0444066470 0x7f0444068930 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f04480ad000 tx=0x7f04480a5070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f0457607640 1 -- 172.21.15.67:0/226856907 <== osd.2 v2:172.21.15.67:6824/3795893630 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v205'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f04500103b0 con 0x555f4313dfd0 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f04592f3080 1 -- 172.21.15.67:0/226856907 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x555f4313dfd0 msgr2=0x555f4326b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f04592f3080 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x555f4313dfd0 0x555f4326b060 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f04592f3080 1 -- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0444066470 msgr2=0x7f0444068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f04592f3080 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0444066470 0x7f0444068930 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f04480ad000 tx=0x7f04480a5070 comp rx=0 tx=0).stop 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f04592f3080 1 -- 172.21.15.67:0/226856907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 msgr2=0x555f4313f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f04592f3080 1 --2- 172.21.15.67:0/226856907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555f4312ce90 0x555f4313f410 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7f044c005dc0 tx=0x7f044c003030 comp rx=0 tx=0).stop 2024-09-19T05:48:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f0457607640 1 -- 172.21.15.67:0/226856907 reap_dead start 2024-09-19T05:48:57.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f04592f3080 1 -- 172.21.15.67:0/226856907 shutdown_connections 2024-09-19T05:48:57.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f04592f3080 1 -- 172.21.15.67:0/226856907 >> 172.21.15.67:0/226856907 conn(0x555f43129330 msgr2=0x555f431c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f04592f3080 1 -- 172.21.15.67:0/226856907 shutdown_connections 2024-09-19T05:48:57.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.453+0000 7f04592f3080 1 -- 172.21.15.67:0/226856907 wait complete. 2024-09-19T05:48:57.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:57.458 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub start / recursive,repair 2024-09-19T05:48:57.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefcd308640 1 Processor -- start 2024-09-19T05:48:57.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefcd308640 1 -- start start 2024-09-19T05:48:57.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefcd308640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fefc806bfa0 0x7fefc806c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefcd308640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fefc80b4d60 0x7fefc80b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefcd308640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefc806c8c0 con 0x7fefc815b360 2024-09-19T05:48:57.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefcd308640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fefc80739f0 con 0x7fefc80b4d60 2024-09-19T05:48:57.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefcd308640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fefc8073710 con 0x7fefc806bfa0 2024-09-19T05:48:57.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefc77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fefc80b4d60 0x7fefc80b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefc77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fefc80b4d60 0x7fefc80b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57186/0 (socket says 172.21.15.67:57186) 2024-09-19T05:48:57.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefc77fe640 1 -- 172.21.15.67:0/1175415633 learned_addr learned my addr 172.21.15.67:0/1175415633 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/1175415633 >> v2:172.21.15.97:3300/0 conn(0x7fefc806bfa0 0x7fefc806c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefc77fe640 1 -- 172.21.15.67:0/1175415633 >> v2:172.21.15.97:3300/0 conn(0x7fefc806bfa0 msgr2=0x7fefc806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefc77fe640 1 --2- 172.21.15.67:0/1175415633 >> v2:172.21.15.97:3300/0 conn(0x7fefc806bfa0 0x7fefc806c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefc77fe640 1 -- 172.21.15.67:0/1175415633 >> v1:172.21.15.97:6789/0 conn(0x7fefc815b360 legacy=0x7fefc8072e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.633+0000 7fefc77fe640 1 -- 172.21.15.67:0/1175415633 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc80b3180 con 0x7fefc80b4d60 2024-09-19T05:48:57.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefc77fe640 1 --2- 172.21.15.67:0/1175415633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc80b4d60 0x7fefc80b3c60 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7fefc806d800 tx=0x7fefc001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db0fca44671a592 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefc5ffb640 1 -- 172.21.15.67:0/1175415633 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc00a5620 con 0x7fefc80b4d60 2024-09-19T05:48:57.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefc5ffb640 1 -- 172.21.15.67:0/1175415633 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc00a57c0 con 0x7fefc80b4d60 2024-09-19T05:48:57.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefc5ffb640 1 -- 172.21.15.67:0/1175415633 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc00a5b90 con 0x7fefc80b4d60 2024-09-19T05:48:57.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefcd308640 1 -- 172.21.15.67:0/1175415633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc80b4d60 msgr2=0x7fefc80b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefcd308640 1 --2- 172.21.15.67:0/1175415633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc80b4d60 0x7fefc80b3c60 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7fefc806d800 tx=0x7fefc001c960 comp rx=0 tx=0).stop 2024-09-19T05:48:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefcd308640 1 -- 172.21.15.67:0/1175415633 shutdown_connections 2024-09-19T05:48:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefcd308640 1 --2- 172.21.15.67:0/1175415633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc80b4d60 0x7fefc80b3c60 unknown :-1 s=CLOSED pgs=2478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefcd308640 1 --2- 172.21.15.67:0/1175415633 >> v2:172.21.15.97:3300/0 conn(0x7fefc806bfa0 0x7fefc806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefcd308640 1 -- 172.21.15.67:0/1175415633 >> 172.21.15.67:0/1175415633 conn(0x7fefc80b21e0 msgr2=0x7fefc80b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefcd308640 1 -- 172.21.15.67:0/1175415633 shutdown_connections 2024-09-19T05:48:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefcd308640 1 -- 172.21.15.67:0/1175415633 wait complete. 2024-09-19T05:48:57.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefcd308640 1 Processor -- start 2024-09-19T05:48:57.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.637+0000 7fefcd308640 1 -- start start 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefcd308640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefc806bfa0 0x7fefc80cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefcd308640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefc80b4d60 0x7fefc8153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefcd308640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc8157ed0 0x7fefc815d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefcd308640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fefc8168030 con 0x7fefc8157ed0 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefcd308640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fefc8167eb0 con 0x7fefc80b4d60 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefcd308640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fefc81681b0 con 0x7fefc806bfa0 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc8157ed0 0x7fefc815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc8157ed0 0x7fefc815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57200/0 (socket says 172.21.15.67:57200) 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc77fe640 1 -- 172.21.15.67:0/709611509 learned_addr learned my addr 172.21.15.67:0/709611509 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc67fc640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefc80b4d60 0x7fefc8153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefc806bfa0 0x7fefc80cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc77fe640 1 -- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefc806bfa0 msgr2=0x7fefc80cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc77fe640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefc806bfa0 0x7fefc80cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc77fe640 1 -- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefc80b4d60 msgr2=0x7fefc8153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc77fe640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefc80b4d60 0x7fefc8153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc77fe640 1 -- 172.21.15.67:0/709611509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc80cf000 con 0x7fefc8157ed0 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc67fc640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefc80b4d60 0x7fefc8153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefc806bfa0 0x7fefc80cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc77fe640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc8157ed0 0x7fefc815d040 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fefc00af040 tx=0x7fefc0019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefaf7fe640 1 -- 172.21.15.67:0/709611509 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc00bc020 con 0x7fefc8157ed0 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefaf7fe640 1 -- 172.21.15.67:0/709611509 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc00b8880 con 0x7fefc8157ed0 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefcd308640 1 -- 172.21.15.67:0/709611509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc8154240 con 0x7fefc8157ed0 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefaf7fe640 1 -- 172.21.15.67:0/709611509 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0009510 con 0x7fefc8157ed0 2024-09-19T05:48:57.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefcd308640 1 -- 172.21.15.67:0/709611509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc80cf550 con 0x7fefc8157ed0 2024-09-19T05:48:57.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefaf7fe640 1 -- 172.21.15.67:0/709611509 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fefc00bf020 con 0x7fefc8157ed0 2024-09-19T05:48:57.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefaf7fe640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefb40678c0 0x7fefb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefaf7fe640 1 -- 172.21.15.67:0/709611509 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7fefc0120ff0 con 0x7fefc8157ed0 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.641+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefb40678c0 0x7fefb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 Processor -- start 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 -- start start 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefb40678c0 0x7fefb4069d80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fefb80097a0 tx=0x7fefb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc94080 0x55e91fc94460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 0x55e91fc4a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc4a840 0x55e91fc4ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e91fa94e40 con 0x55e91fc94080 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e91fa4fba0 con 0x55e91fc949a0 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55e91fa90e00 con 0x55e91fc4a840 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc94080 0x55e91fc94460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc94080 0x55e91fc94460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57216/0 (socket says 172.21.15.67:57216) 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc6ffd640 1 -- 172.21.15.67:0/1967838107 learned_addr learned my addr 172.21.15.67:0/1967838107 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc77fe640 1 --2- 172.21.15.67:0/1967838107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc4a840 0x55e91fc4ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc67fc640 1 --2- 172.21.15.67:0/1967838107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 0x55e91fc4a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc6ffd640 1 -- 172.21.15.67:0/1967838107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc4a840 msgr2=0x55e91fc4ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/1967838107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc4a840 0x55e91fc4ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc6ffd640 1 -- 172.21.15.67:0/1967838107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 msgr2=0x55e91fc4a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/1967838107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 0x55e91fc4a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc6ffd640 1 -- 172.21.15.67:0/1967838107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91fa37ec0 con 0x55e91fc94080 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc67fc640 1 --2- 172.21.15.67:0/1967838107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 0x55e91fc4a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/1967838107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc94080 0x55e91fc94460 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7fefb8004350 tx=0x7fefb8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f77a2f87105be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefacff9640 1 -- 172.21.15.67:0/1967838107 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb800f040 con 0x55e91fc94080 2024-09-19T05:48:57.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefacff9640 1 -- 172.21.15.67:0/1967838107 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb8004380 con 0x55e91fc94080 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefacff9640 1 -- 172.21.15.67:0/1967838107 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb800ee80 con 0x55e91fc94080 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 -- 172.21.15.67:0/1967838107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc94080 msgr2=0x55e91fc94460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 --2- 172.21.15.67:0/1967838107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc94080 0x55e91fc94460 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7fefb8004350 tx=0x7fefb8011000 comp rx=0 tx=0).stop 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 -- 172.21.15.67:0/1967838107 shutdown_connections 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 --2- 172.21.15.67:0/1967838107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc4a840 0x55e91fc4ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 --2- 172.21.15.67:0/1967838107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 0x55e91fc4a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 --2- 172.21.15.67:0/1967838107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc94080 0x55e91fc94460 unknown :-1 s=CLOSED pgs=2480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 -- 172.21.15.67:0/1967838107 >> 172.21.15.67:0/1967838107 conn(0x55e91fc423e0 msgr2=0x55e91fc447d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 -- 172.21.15.67:0/1967838107 shutdown_connections 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 -- 172.21.15.67:0/1967838107 wait complete. 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 -- start start 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.645+0000 7fefd03c4000 1 Processor -- start 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 0x55e91fc7e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fc7eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fc7f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e91fa2e440 con 0x55e91fc949a0 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e91fa534f0 con 0x55e91fc4a840 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55e91fb15920 con 0x55e91fc94080 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 10 client.0 _ll_register_callbacks cb 0x55e91fc31510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fc7f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fc7f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57222/0 (socket says 172.21.15.67:57222) 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc77fe640 1 -- 172.21.15.67:0/716759908 learned_addr learned my addr 172.21.15.67:0/716759908 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc67fc640 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fc7eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 0x55e91fc7e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc77fe640 1 -- 172.21.15.67:0/716759908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 msgr2=0x55e91fc7eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc77fe640 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fc7eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc77fe640 1 -- 172.21.15.67:0/716759908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 msgr2=0x55e91fc7e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc77fe640 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 0x55e91fc7e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc77fe640 1 -- 172.21.15.67:0/716759908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e91fa348f0 con 0x55e91fc949a0 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 0x55e91fc7e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc77fe640 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fc7f050 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7fefc001a590 tx=0x7fefc00f1ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915d22c82dbac676 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefa5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefa5ffb640 1 -- 172.21.15.67:0/716759908 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc00f9ef0 con 0x55e91fc949a0 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefa5ffb640 1 -- 172.21.15.67:0/716759908 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7fefc00a56a0 con 0x55e91fc949a0 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- 172.21.15.67:0/716759908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefb8004380 con 0x55e91fc949a0 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefa5ffb640 1 -- 172.21.15.67:0/716759908 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) ==== 24+0+0 (secure 0 0 0) 0x7fefc011f0a0 con 0x55e91fc949a0 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 10 client.11052 fetch_fsmap learned FSMap version 146 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- 172.21.15.67:0/716759908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=2+}) -- 0x55e91fa52570 con 0x55e91fc949a0 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefa5ffb640 1 -- 172.21.15.67:0/716759908 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb8004380 con 0x55e91fc949a0 2024-09-19T05:48:57.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefa5ffb640 1 -- 172.21.15.67:0/716759908 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 146) ==== 3502+0+0 (secure 0 0 0) 0x7fefc00f1570 con 0x55e91fc949a0 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 10 client.11052 fetch_fsmap finished waiting for FSMap version 146 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 10 client.11052 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 20 client.11052 populate_metadata read hostname 'smithi067' 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55e91fc7fd30 0x55e91fc80110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 4 client.11052 mds_command: new command op to 10845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- 172.21.15.67:0/716759908 --> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e91fa2ef10 con 0x55e91fc7fd30 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55e91fc7fd30 0x55e91fc80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefa5ffb640 10 client.11052 ms_handle_connect on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55e91fc7fd30 0x55e91fc80110 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=101324caf15cd5d2 server_cookie=311a7c1f3f2cb546 in_seq=0 out_seq=0 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefa5ffb640 1 -- 172.21.15.67:0/716759908 <== mds.0 v2:172.21.15.67:6834/1771202736 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e91fa2ef10 con 0x55e91fc7fd30 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefa5ffb640 10 client.11052 handle_command_reply: tid=0 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 client.11052 shutdown 2024-09-19T05:48:57.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- 172.21.15.67:0/716759908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 msgr2=0x55e91fc7f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fc7f050 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7fefc001a590 tx=0x7fefc00f1ad0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- 172.21.15.67:0/716759908 shutdown_connections 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55e91fc7fd30 0x55e91fc80110 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fc7f050 unknown :-1 s=CLOSED pgs=2481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fc7eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 --2- 172.21.15.67:0/716759908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 0x55e91fc7e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefa5ffb640 0 client.11052 ms_handle_reset on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- 172.21.15.67:0/716759908 >> 172.21.15.67:0/716759908 conn(0x55e91fc423e0 msgr2=0x55e91fc4b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- 172.21.15.67:0/716759908 shutdown_connections 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 1 -- 172.21.15.67:0/716759908 wait complete. 2024-09-19T05:48:57.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.649+0000 7fefd03c4000 20 client.11052 trim_cache size 0 max 16384 2024-09-19T05:48:57.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefd03c4000 1 Processor -- start 2024-09-19T05:48:57.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefd03c4000 1 -- start start 2024-09-19T05:48:57.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc4a840 0x55e91fc7ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fc7f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 0x55e91fc921a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefd03c4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fefc8159f70 con 0x55e91fc4a840 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefd03c4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fefc8152b70 con 0x55e91fc949a0 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefd03c4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fefc81531c0 con 0x55e91fc94080 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc4a840 0x55e91fc7ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc4a840 0x55e91fc7ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57236/0 (socket says 172.21.15.67:57236) 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc6ffd640 1 -- 172.21.15.67:0/597119495 learned_addr learned my addr 172.21.15.67:0/597119495 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc77fe640 1 --2- 172.21.15.67:0/597119495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 0x55e91fc921a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc6ffd640 1 -- 172.21.15.67:0/597119495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 msgr2=0x55e91fc7f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/597119495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fc7f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc6ffd640 1 -- 172.21.15.67:0/597119495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 msgr2=0x55e91fc921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/597119495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 0x55e91fc921a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc6ffd640 1 -- 172.21.15.67:0/597119495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91fc947d0 con 0x55e91fc4a840 2024-09-19T05:48:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc77fe640 1 --2- 172.21.15.67:0/597119495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 0x55e91fc921a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/597119495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc4a840 0x55e91fc7ec30 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7fefb8004320 tx=0x7fefb8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13cc99b56c0a309 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefa7fff640 1 -- 172.21.15.67:0/597119495 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8004380 con 0x55e91fc4a840 2024-09-19T05:48:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefa7fff640 1 -- 172.21.15.67:0/597119495 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb8003c20 con 0x55e91fc4a840 2024-09-19T05:48:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefa7fff640 1 -- 172.21.15.67:0/597119495 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8003dd0 con 0x55e91fc4a840 2024-09-19T05:48:57.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefd03c4000 1 -- 172.21.15.67:0/597119495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc4a840 msgr2=0x55e91fc7ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.669+0000 7fefd03c4000 1 --2- 172.21.15.67:0/597119495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc4a840 0x55e91fc7ec30 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7fefb8004320 tx=0x7fefb8012000 comp rx=0 tx=0).stop 2024-09-19T05:48:57.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- 172.21.15.67:0/597119495 shutdown_connections 2024-09-19T05:48:57.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 --2- 172.21.15.67:0/597119495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc949a0 0x55e91fc921a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 --2- 172.21.15.67:0/597119495 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fc7f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 --2- 172.21.15.67:0/597119495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc4a840 0x55e91fc7ec30 unknown :-1 s=CLOSED pgs=2482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- 172.21.15.67:0/597119495 >> 172.21.15.67:0/597119495 conn(0x55e91fc423e0 msgr2=0x55e91fc45660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- 172.21.15.67:0/597119495 shutdown_connections 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- 172.21.15.67:0/597119495 wait complete. 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- start start 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 Processor -- start 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 0x55e91fc4b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fd07d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fd08280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e91fa3b020 con 0x55e91fc949a0 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e91fa538c0 con 0x55e91fc4a840 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55e91fa94150 con 0x55e91fc94080 2024-09-19T05:48:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 10 client.0 _ll_register_callbacks cb 0x7fefc00ace40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fd08280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fd08280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57252/0 (socket says 172.21.15.67:57252) 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc77fe640 1 -- 172.21.15.67:0/1926722089 learned_addr learned my addr 172.21.15.67:0/1926722089 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc67fc640 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fd07d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 0x55e91fc4b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc77fe640 1 -- 172.21.15.67:0/1926722089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 msgr2=0x55e91fd07d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc77fe640 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fd07d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc77fe640 1 -- 172.21.15.67:0/1926722089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 msgr2=0x55e91fc4b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc77fe640 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 0x55e91fc4b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc77fe640 1 -- 172.21.15.67:0/1926722089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e91fb15db0 con 0x55e91fc949a0 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc77fe640 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fd08280 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7fefc001c790 tx=0x7fefc011f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fda265476e4ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefa5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:48:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefa5ffb640 1 -- 172.21.15.67:0/1926722089 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0115060 con 0x55e91fc949a0 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefa5ffb640 1 -- 172.21.15.67:0/1926722089 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7fefc010fde0 con 0x55e91fc949a0 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- 172.21.15.67:0/1926722089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefb8003c20 con 0x55e91fc949a0 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefa5ffb640 1 -- 172.21.15.67:0/1926722089 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) ==== 24+0+0 (secure 0 0 0) 0x7fefc00f9a60 con 0x55e91fc949a0 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 10 client.11058 fetch_fsmap learned FSMap version 146 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- 172.21.15.67:0/1926722089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=2+}) -- 0x55e91fa28740 con 0x55e91fc949a0 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefa5ffb640 1 -- 172.21.15.67:0/1926722089 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb8003c20 con 0x55e91fc949a0 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefa5ffb640 1 -- 172.21.15.67:0/1926722089 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 146) ==== 3502+0+0 (secure 0 0 0) 0x7fefc00f0760 con 0x55e91fc949a0 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 10 client.11058 fetch_fsmap finished waiting for FSMap version 146 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 10 client.11058 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 20 client.11058 populate_metadata read hostname 'smithi067' 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55e91fc4ba50 0x55e91fca7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 4 client.11058 mds_command: new command op to 10845 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 -- 172.21.15.67:0/1926722089 --> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x55e91faa2570 con 0x55e91fc4ba50 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55e91fc4ba50 0x55e91fca7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefa5ffb640 10 client.11058 ms_handle_connect on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefc6ffd640 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55e91fc4ba50 0x55e91fca7390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c5dd759985567e5 server_cookie=3b2ee0cf98982c22 in_seq=0 out_seq=0 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefa5ffb640 1 -- 172.21.15.67:0/1926722089 <== mds.0 v2:172.21.15.67:6834/1771202736 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e91faa2570 con 0x55e91fc4ba50 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefa5ffb640 10 client.11058 handle_command_reply: tid=0 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.673+0000 7fefd03c4000 1 client.11058 shutdown 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 1 -- 172.21.15.67:0/1926722089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 msgr2=0x55e91fd08280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fd08280 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7fefc001c790 tx=0x7fefc011f290 comp rx=0 tx=0).stop 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 1 -- 172.21.15.67:0/1926722089 shutdown_connections 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55e91fc4ba50 0x55e91fca7390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e91fc949a0 0x55e91fd08280 unknown :-1 s=CLOSED pgs=2483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55e91fc94080 0x55e91fd07d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 1 --2- 172.21.15.67:0/1926722089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e91fc4a840 0x55e91fc4b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefa5ffb640 0 client.11058 ms_handle_reset on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:57.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 1 -- 172.21.15.67:0/1926722089 >> 172.21.15.67:0/1926722089 conn(0x55e91fc423e0 msgr2=0x55e91fc4ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.682 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-09-19T05:48:57.677+0000 7f8965ee3640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-09-19T05:48:56.540061+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={11028=0-12582912@1} caps={11028=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=11028 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x56240474d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(30)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:48:57.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 1 -- 172.21.15.67:0/1926722089 shutdown_connections 2024-09-19T05:48:57.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 1 -- 172.21.15.67:0/1926722089 wait complete. 2024-09-19T05:48:57.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefd03c4000 20 client.11058 trim_cache size 0 max 16384 2024-09-19T05:48:57.683 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:48:57.683 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-19T05:48:57.683 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "07a9aefe-c85a-4c01-bcc9-9ed6d47a4521", 2024-09-19T05:48:57.683 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-19T05:48:57.683 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:48:57.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 -- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefb40678c0 msgr2=0x7fefb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefb40678c0 0x7fefb4069d80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fefb80097a0 tx=0x7fefb8008040 comp rx=0 tx=0).stop 2024-09-19T05:48:57.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 -- 172.21.15.67:0/709611509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc8157ed0 msgr2=0x7fefc815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc8157ed0 0x7fefc815d040 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fefc00af040 tx=0x7fefc0019700 comp rx=0 tx=0).stop 2024-09-19T05:48:57.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 -- 172.21.15.67:0/709611509 shutdown_connections 2024-09-19T05:48:57.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc8157ed0 0x7fefc815d040 unknown :-1 s=CLOSED pgs=2479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fefc80b4d60 0x7fefc8153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fefb40678c0 0x7fefb4069d80 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 --2- 172.21.15.67:0/709611509 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fefc806bfa0 0x7fefc80cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 -- 172.21.15.67:0/709611509 >> 172.21.15.67:0/709611509 conn(0x7fefc80b21e0 msgr2=0x7fefc814f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 -- 172.21.15.67:0/709611509 shutdown_connections 2024-09-19T05:48:57.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.677+0000 7fefcd308640 1 -- 172.21.15.67:0/709611509 wait complete. 2024-09-19T05:48:57.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:48:57.694 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-19T05:48:57.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b77779640 1 Processor -- start 2024-09-19T05:48:57.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b77779640 1 -- start start 2024-09-19T05:48:57.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b77779640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b7015ee70 0x7f2b7015f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b77779640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 0x7f2b700b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b77779640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b700b4270 con 0x7f2b7015b570 2024-09-19T05:48:57.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b77779640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2b700b3850 con 0x7f2b7015ee70 2024-09-19T05:48:57.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b77779640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2b70071020 con 0x7f2b700ae970 2024-09-19T05:48:57.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b75515640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b7015ee70 0x7f2b7015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b75515640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b7015ee70 0x7f2b7015f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57266/0 (socket says 172.21.15.67:57266) 2024-09-19T05:48:57.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b75515640 1 -- 172.21.15.67:0/3537274854 learned_addr learned my addr 172.21.15.67:0/3537274854 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.809+0000 7f2b74d14640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2b7015b570 0x7f2b700b4be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55418/0 (socket says 172.21.15.67:55418) 2024-09-19T05:48:57.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b75d16640 1 --2- 172.21.15.67:0/3537274854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 0x7f2b700b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b75515640 1 -- 172.21.15.67:0/3537274854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 msgr2=0x7f2b700b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b75515640 1 --2- 172.21.15.67:0/3537274854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 0x7f2b700b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b75515640 1 -- 172.21.15.67:0/3537274854 >> v1:172.21.15.67:6789/0 conn(0x7f2b7015b570 legacy=0x7f2b700b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b67fff640 1 -- 172.21.15.67:0/3537274854 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468842594 0 0) 0x7f2b700b4270 con 0x7f2b7015b570 2024-09-19T05:48:57.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b75515640 1 -- 172.21.15.67:0/3537274854 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7015fb40 con 0x7f2b7015ee70 2024-09-19T05:48:57.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b75515640 1 --2- 172.21.15.67:0/3537274854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015ee70 0x7f2b7015f250 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009870 tx=0x7f2b6c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc82a767d9727136 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b67fff640 1 -- 172.21.15.67:0/3537274854 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0b2070 con 0x7f2b7015ee70 2024-09-19T05:48:57.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b67fff640 1 -- 172.21.15.67:0/3537274854 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c0a9070 con 0x7f2b7015ee70 2024-09-19T05:48:57.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b67fff640 1 -- 172.21.15.67:0/3537274854 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0ad880 con 0x7f2b7015ee70 2024-09-19T05:48:57.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b77779640 1 -- 172.21.15.67:0/3537274854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015ee70 msgr2=0x7f2b7015f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b77779640 1 --2- 172.21.15.67:0/3537274854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015ee70 0x7f2b7015f250 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009870 tx=0x7f2b6c01c560 comp rx=0 tx=0).stop 2024-09-19T05:48:57.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b77779640 1 -- 172.21.15.67:0/3537274854 shutdown_connections 2024-09-19T05:48:57.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b77779640 1 --2- 172.21.15.67:0/3537274854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 0x7f2b700b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b77779640 1 --2- 172.21.15.67:0/3537274854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015ee70 0x7f2b7015f250 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b77779640 1 -- 172.21.15.67:0/3537274854 >> 172.21.15.67:0/3537274854 conn(0x7f2b700733e0 msgr2=0x7f2b700b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b77779640 1 -- 172.21.15.67:0/3537274854 shutdown_connections 2024-09-19T05:48:57.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.813+0000 7f2b77779640 1 -- 172.21.15.67:0/3537274854 wait complete. 2024-09-19T05:48:57.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b77779640 1 Processor -- start 2024-09-19T05:48:57.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b77779640 1 -- start start 2024-09-19T05:48:57.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b77779640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 0x7f2b7015dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b77779640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015b570 0x7f2b70156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b77779640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b7015ee70 0x7f2b70157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b77779640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7006bc40 con 0x7f2b7015b570 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b77779640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2b700b5a40 con 0x7f2b7015ee70 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b77779640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7006bdc0 con 0x7f2b700ae970 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b74d14640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015b570 0x7f2b70156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b74d14640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015b570 0x7f2b70156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57272/0 (socket says 172.21.15.67:57272) 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b74d14640 1 -- 172.21.15.67:0/1560442862 learned_addr learned my addr 172.21.15.67:0/1560442862 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b75515640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 0x7f2b7015dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b75d16640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b7015ee70 0x7f2b70157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b74d14640 1 -- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 msgr2=0x7f2b7015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b74d14640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 0x7f2b7015dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b74d14640 1 -- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b7015ee70 msgr2=0x7f2b70157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b74d14640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b7015ee70 0x7f2b70157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b74d14640 1 -- 172.21.15.67:0/1560442862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b70158a90 con 0x7f2b7015b570 2024-09-19T05:48:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b75515640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 0x7f2b7015dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b75d16640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b7015ee70 0x7f2b70157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b74d14640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015b570 0x7f2b70156d50 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f2b600011f0 tx=0x7f2b6000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b65ffb640 1 -- 172.21.15.67:0/1560442862 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60018070 con 0x7f2b7015b570 2024-09-19T05:48:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b65ffb640 1 -- 172.21.15.67:0/1560442862 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b600074e0 con 0x7f2b7015b570 2024-09-19T05:48:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b77779640 1 -- 172.21.15.67:0/1560442862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b701579f0 con 0x7f2b7015b570 2024-09-19T05:48:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b65ffb640 1 -- 172.21.15.67:0/1560442862 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60004a10 con 0x7f2b7015b570 2024-09-19T05:48:57.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.817+0000 7f2b77779640 1 -- 172.21.15.67:0/1560442862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b70157fb0 con 0x7f2b7015b570 2024-09-19T05:48:57.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b65ffb640 1 -- 172.21.15.67:0/1560442862 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b6001b070 con 0x7f2b7015b570 2024-09-19T05:48:57.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b65ffb640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b540678c0 0x7f2b54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b65ffb640 1 -- 172.21.15.67:0/1560442862 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f2b60085160 con 0x7f2b7015b570 2024-09-19T05:48:57.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b540678c0 0x7f2b54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 Processor -- start 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 -- start start 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b540678c0 0x7f2b54069d80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0af000 tx=0x7f2b6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219262150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x563219215870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219215db0 0x563219216190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5632190ff960 con 0x563219261d70 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563219043900 con 0x563219262690 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563219066d40 con 0x563219215db0 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219262150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219262150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57282/0 (socket says 172.21.15.67:57282) 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 -- 172.21.15.67:0/2576694402 learned_addr learned my addr 172.21.15.67:0/2576694402 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b74d14640 1 --2- 172.21.15.67:0/2576694402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x563219215870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75d16640 1 --2- 172.21.15.67:0/2576694402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219215db0 0x563219216190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 -- 172.21.15.67:0/2576694402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219215db0 msgr2=0x563219216190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 --2- 172.21.15.67:0/2576694402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219215db0 0x563219216190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 -- 172.21.15.67:0/2576694402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 msgr2=0x563219215870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 --2- 172.21.15.67:0/2576694402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x563219215870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 -- 172.21.15.67:0/2576694402 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56321900d580 con 0x563219261d70 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b75515640 1 --2- 172.21.15.67:0/2576694402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219262150 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0b0040 tx=0x7f2b6c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae41612fd3d8b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b5affd640 1 -- 172.21.15.67:0/2576694402 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0c8070 con 0x563219261d70 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b5affd640 1 -- 172.21.15.67:0/2576694402 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c0c3420 con 0x563219261d70 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b5affd640 1 -- 172.21.15.67:0/2576694402 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0b2040 con 0x563219261d70 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 -- 172.21.15.67:0/2576694402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 msgr2=0x563219262150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 --2- 172.21.15.67:0/2576694402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219262150 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0b0040 tx=0x7f2b6c004740 comp rx=0 tx=0).stop 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 -- 172.21.15.67:0/2576694402 shutdown_connections 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 --2- 172.21.15.67:0/2576694402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219215db0 0x563219216190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 --2- 172.21.15.67:0/2576694402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x563219215870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 --2- 172.21.15.67:0/2576694402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219262150 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 -- 172.21.15.67:0/2576694402 >> 172.21.15.67:0/2576694402 conn(0x563219243040 msgr2=0x563219245430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 -- 172.21.15.67:0/2576694402 shutdown_connections 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.821+0000 7f2b7a835000 1 -- 172.21.15.67:0/2576694402 wait complete. 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- start start 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 Processor -- start 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219215db0 0x563219268ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219269220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x563219269760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563219062d00 con 0x563219261d70 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563219021aa0 con 0x563219262690 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x563219000340 con 0x563219215db0 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 10 client.0 _ll_register_callbacks cb 0x563219203760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b74d14640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219269220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b74d14640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219269220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57296/0 (socket says 172.21.15.67:57296) 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b74d14640 1 -- 172.21.15.67:0/26495597 learned_addr learned my addr 172.21.15.67:0/26495597 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b75515640 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219215db0 0x563219268ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b75d16640 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x563219269760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b74d14640 1 -- 172.21.15.67:0/26495597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219215db0 msgr2=0x563219268ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b74d14640 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219215db0 0x563219268ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b74d14640 1 -- 172.21.15.67:0/26495597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 msgr2=0x563219269760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b74d14640 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x563219269760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b74d14640 1 -- 172.21.15.67:0/26495597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563219009dc0 con 0x563219261d70 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b74d14640 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219269220 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f2b6005dac0 tx=0x7f2b60055550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce665d6d0b692cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b4ffff640 1 -- 172.21.15.67:0/26495597 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6007ce60 con 0x563219261d70 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b4ffff640 1 -- 172.21.15.67:0/26495597 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f2b6006d1c0 con 0x563219261d70 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- 172.21.15.67:0/26495597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b6c0c3420 con 0x563219261d70 2024-09-19T05:48:57.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b4ffff640 1 -- 172.21.15.67:0/26495597 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) ==== 24+0+0 (secure 0 0 0) 0x7f2b6006d020 con 0x563219261d70 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 10 client.11073 fetch_fsmap learned FSMap version 146 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- 172.21.15.67:0/26495597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=2+}) -- 0x5632190067f0 con 0x563219261d70 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b4ffff640 1 -- 172.21.15.67:0/26495597 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c0c3420 con 0x563219261d70 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b4ffff640 1 -- 172.21.15.67:0/26495597 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 146) ==== 3502+0+0 (secure 0 0 0) 0x7f2b60054860 con 0x563219261d70 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 10 client.11073 fetch_fsmap finished waiting for FSMap version 146 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 10 client.11073 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 20 client.11073 populate_metadata read hostname 'smithi067' 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x5632192710b0 0x5632192734a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 4 client.11073 mds_command: new command op to 10845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- 172.21.15.67:0/26495597 --> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563219000e10 con 0x5632192710b0 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b75515640 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x5632192710b0 0x5632192734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b4ffff640 10 client.11073 ms_handle_connect on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:57.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b75515640 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x5632192710b0 0x5632192734a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=117f5068b4f30b4e server_cookie=abe812b172a8f955 in_seq=0 out_seq=0 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b4ffff640 1 -- 172.21.15.67:0/26495597 <== mds.0 v2:172.21.15.67:6834/1771202736 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563219000e10 con 0x5632192710b0 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b4ffff640 10 client.11073 handle_command_reply: tid=0 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 client.11073 shutdown 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- 172.21.15.67:0/26495597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 msgr2=0x563219269220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219269220 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f2b6005dac0 tx=0x7f2b60055550 comp rx=0 tx=0).stop 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- 172.21.15.67:0/26495597 shutdown_connections 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x563219269760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x5632192710b0 0x5632192734a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219261d70 0x563219269220 unknown :-1 s=CLOSED pgs=2488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 --2- 172.21.15.67:0/26495597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219215db0 0x563219268ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b4ffff640 0 client.11073 ms_handle_reset on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- 172.21.15.67:0/26495597 >> 172.21.15.67:0/26495597 conn(0x563219243040 msgr2=0x563219214f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- 172.21.15.67:0/26495597 shutdown_connections 2024-09-19T05:48:57.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.825+0000 7f2b7a835000 1 -- 172.21.15.67:0/26495597 wait complete. 2024-09-19T05:48:57.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.829+0000 7f2b7a835000 20 client.11073 trim_cache size 0 max 16384 2024-09-19T05:48:57.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b7a835000 1 Processor -- start 2024-09-19T05:48:57.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b7a835000 1 -- start start 2024-09-19T05:48:57.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192768f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219261d70 0x56321926f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x56321926f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b7a835000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2b702045b0 con 0x563219215db0 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b7a835000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70203660 con 0x563219262690 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b7a835000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7009bde0 con 0x563219261d70 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75515640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75515640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192768f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57302/0 (socket says 172.21.15.67:57302) 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75515640 1 -- 172.21.15.67:0/1281455272 learned_addr learned my addr 172.21.15.67:0/1281455272 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75d16640 1 --2- 172.21.15.67:0/1281455272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x56321926f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75515640 1 -- 172.21.15.67:0/1281455272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219261d70 msgr2=0x56321926f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75515640 1 --2- 172.21.15.67:0/1281455272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219261d70 0x56321926f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75515640 1 -- 172.21.15.67:0/1281455272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 msgr2=0x56321926f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75515640 1 --2- 172.21.15.67:0/1281455272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x56321926f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75515640 1 -- 172.21.15.67:0/1281455272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563219024470 con 0x563219215db0 2024-09-19T05:48:57.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75d16640 1 --2- 172.21.15.67:0/1281455272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x56321926f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:48:57.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b75515640 1 --2- 172.21.15.67:0/1281455272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192768f0 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c01ca40 tx=0x7f2b6c0a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f352515b78ec02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b5a7fc640 1 -- 172.21.15.67:0/1281455272 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0d2020 con 0x563219215db0 2024-09-19T05:48:57.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b5a7fc640 1 -- 172.21.15.67:0/1281455272 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c003620 con 0x563219215db0 2024-09-19T05:48:57.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.845+0000 7f2b5a7fc640 1 -- 172.21.15.67:0/1281455272 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0c8040 con 0x563219215db0 2024-09-19T05:48:57.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1281455272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 msgr2=0x5632192768f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- 172.21.15.67:0/1281455272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192768f0 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c01ca40 tx=0x7f2b6c0a9000 comp rx=0 tx=0).stop 2024-09-19T05:48:57.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1281455272 shutdown_connections 2024-09-19T05:48:57.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- 172.21.15.67:0/1281455272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x56321926f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- 172.21.15.67:0/1281455272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219261d70 0x56321926f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- 172.21.15.67:0/1281455272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192768f0 unknown :-1 s=CLOSED pgs=2489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1281455272 >> 172.21.15.67:0/1281455272 conn(0x563219243040 msgr2=0x56321926ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1281455272 shutdown_connections 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1281455272 wait complete. 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- start start 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 Processor -- start 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219261d70 0x5632192d61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x5632192757e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56321906b370 con 0x563219215db0 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5632190a6780 con 0x563219262690 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x56321902e400 con 0x563219261d70 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 10 client.0 _ll_register_callbacks cb 0x7f2b600516d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b75515640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b75515640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192d5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57318/0 (socket says 172.21.15.67:57318) 2024-09-19T05:48:57.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b75515640 1 -- 172.21.15.67:0/1284050583 learned_addr learned my addr 172.21.15.67:0/1284050583 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b75d16640 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x5632192757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b74d14640 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219261d70 0x5632192d61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b75515640 1 -- 172.21.15.67:0/1284050583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219261d70 msgr2=0x5632192d61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b75515640 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219261d70 0x5632192d61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b75515640 1 -- 172.21.15.67:0/1284050583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 msgr2=0x5632192757e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b75515640 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x5632192757e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b75515640 1 -- 172.21.15.67:0/1284050583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563218ffa640 con 0x563219215db0 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b75515640 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192d5c80 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c01c5a0 tx=0x7f2b6c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d15abae9f1e9d7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b4ffff640 1 -- 172.21.15.67:0/1284050583 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0d2040 con 0x563219215db0 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b4ffff640 1 -- 172.21.15.67:0/1284050583 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(205..205 src has 1..205) ==== 6101+0+0 (secure 0 0 0) 0x7f2b6c0d8c50 con 0x563219215db0 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1284050583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b6c003620 con 0x563219215db0 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b4ffff640 1 -- 172.21.15.67:0/1284050583 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) ==== 24+0+0 (secure 0 0 0) 0x7f2b6c0df050 con 0x563219215db0 2024-09-19T05:48:57.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 10 client.11079 fetch_fsmap learned FSMap version 146 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1284050583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=2+}) -- 0x563218ffe3b0 con 0x563219215db0 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b4ffff640 1 -- 172.21.15.67:0/1284050583 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c003620 con 0x563219215db0 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b4ffff640 1 -- 172.21.15.67:0/1284050583 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 146) ==== 3502+0+0 (secure 0 0 0) 0x7f2b6c0e2020 con 0x563219215db0 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 10 client.11079 fetch_fsmap finished waiting for FSMap version 146 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 10 client.11079 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 20 client.11079 populate_metadata read hostname 'smithi067' 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x563219275d20 0x563219276130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 4 client.11079 mds_command: new command op to 10845 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1284050583 --> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563219074470 con 0x563219275d20 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b74d14640 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x563219275d20 0x563219276130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b74d14640 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x563219275d20 0x563219276130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6400c0c6cadefbb3 server_cookie=acd24de792aab9e1 in_seq=0 out_seq=0 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b4ffff640 10 client.11079 ms_handle_connect on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:57.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b4ffff640 1 -- 172.21.15.67:0/1284050583 <== mds.0 v2:172.21.15.67:6834/1771202736 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x563219074470 con 0x563219275d20 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b4ffff640 10 client.11079 handle_command_reply: tid=0 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 client.11079 shutdown 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1284050583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 msgr2=0x5632192d5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192d5c80 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c01c5a0 tx=0x7f2b6c01ada0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1284050583 shutdown_connections 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563219262690 0x5632192757e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563219261d70 0x5632192d61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x563219275d20 0x563219276130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 --2- 172.21.15.67:0/1284050583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563219215db0 0x5632192d5c80 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b7a835000 1 -- 172.21.15.67:0/1284050583 >> 172.21.15.67:0/1284050583 conn(0x563219243040 msgr2=0x56321926f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.849+0000 7f2b4ffff640 0 client.11079 ms_handle_reset on v2:172.21.15.67:6834/1771202736 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b7a835000 1 -- 172.21.15.67:0/1284050583 shutdown_connections 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b7a835000 1 -- 172.21.15.67:0/1284050583 wait complete. 2024-09-19T05:48:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b7a835000 20 client.11079 trim_cache size 0 max 16384 2024-09-19T05:48:57.858 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:48:57.858 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T05:48:57.858 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-19T05:48:57.858 INFO:teuthology.orchestra.run.smithi067.stdout: "07a9aefe-c85a-4c01-bcc9-9ed6d47a4521": { 2024-09-19T05:48:57.858 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-19T05:48:57.858 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "07a9aefe-c85a-4c01-bcc9-9ed6d47a4521", 2024-09-19T05:48:57.858 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,repair" 2024-09-19T05:48:57.858 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:57.858 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-19T05:48:57.858 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:48:57.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 -- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b540678c0 msgr2=0x7f2b54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b540678c0 0x7f2b54069d80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0af000 tx=0x7f2b6c008040 comp rx=0 tx=0).stop 2024-09-19T05:48:57.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 -- 172.21.15.67:0/1560442862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015b570 msgr2=0x7f2b70156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:48:57.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015b570 0x7f2b70156d50 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f2b600011f0 tx=0x7f2b6000c9b0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 -- 172.21.15.67:0/1560442862 shutdown_connections 2024-09-19T05:48:57.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b7015ee70 0x7f2b70157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b7015b570 0x7f2b70156d50 unknown :-1 s=CLOSED pgs=2486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f2b540678c0 0x7f2b54069d80 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 --2- 172.21.15.67:0/1560442862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2b700ae970 0x7f2b7015dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:48:57.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 -- 172.21.15.67:0/1560442862 >> 172.21.15.67:0/1560442862 conn(0x7f2b700733e0 msgr2=0x7f2b7015a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:48:57.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 -- 172.21.15.67:0/1560442862 shutdown_connections 2024-09-19T05:48:57.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:48:57.853+0000 7f2b77779640 1 -- 172.21.15.67:0/1560442862 wait complete. 2024-09-19T05:48:57.869 INFO:tasks.cephfs.filesystem:scrub status for tag:07a9aefe-c85a-4c01-bcc9-9ed6d47a4521 - {'path': '/', 'tag': '07a9aefe-c85a-4c01-bcc9-9ed6d47a4521', 'options': 'recursive,repair'} 2024-09-19T05:49:11.578 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:49:11.581 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:49:27.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:27.871 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-19T05:49:28.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.008+0000 7f3706281640 1 Processor -- start 2024-09-19T05:49:28.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f3706281640 1 -- start start 2024-09-19T05:49:28.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f3706281640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f370015c310 0x7f37000aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f3706281640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37000af220 0x7f37000d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f3706281640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37000adf20 con 0x7f3700155620 2024-09-19T05:49:28.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f3706281640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f37000ae850 con 0x7f370015c310 2024-09-19T05:49:28.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f3706281640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f37000ae200 con 0x7f37000af220 2024-09-19T05:49:28.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f36fffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3700155620 0x7f370006eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51252/0 (socket says 172.21.15.67:51252) 2024-09-19T05:49:28.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f36ff7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f370015c310 0x7f37000aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f36fffff640 1 -- 172.21.15.67:0/3848333655 learned_addr learned my addr 172.21.15.67:0/3848333655 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:28.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f370481e640 1 --2- 172.21.15.67:0/3848333655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37000af220 0x7f37000d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f36ff7fe640 1 -- 172.21.15.67:0/3848333655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37000af220 msgr2=0x7f37000d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/3848333655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37000af220 0x7f37000d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f36ff7fe640 1 -- 172.21.15.67:0/3848333655 >> v1:172.21.15.67:6789/0 conn(0x7f3700155620 legacy=0x7f370006eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f36feffd640 1 -- 172.21.15.67:0/3848333655 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223544078 0 0) 0x7f37000adf20 con 0x7f3700155620 2024-09-19T05:49:28.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f36ff7fe640 1 -- 172.21.15.67:0/3848333655 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37000ae4e0 con 0x7f370015c310 2024-09-19T05:49:28.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.012+0000 7f370481e640 1 --2- 172.21.15.67:0/3848333655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37000af220 0x7f37000d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:28.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/3848333655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 0x7f37000aece0 secure :-1 s=READY pgs=2492 cs=0 l=1 rev1=1 crypto rx=0x7f36e80097f0 tx=0x7f36e801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9317fd654b9c9244 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f36feffd640 1 -- 172.21.15.67:0/3848333655 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80b0070 con 0x7f370015c310 2024-09-19T05:49:28.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f36feffd640 1 -- 172.21.15.67:0/3848333655 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e80ab600 con 0x7f370015c310 2024-09-19T05:49:28.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f36feffd640 1 -- 172.21.15.67:0/3848333655 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80ab9d0 con 0x7f370015c310 2024-09-19T05:49:28.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 -- 172.21.15.67:0/3848333655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 msgr2=0x7f37000aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 --2- 172.21.15.67:0/3848333655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 0x7f37000aece0 secure :-1 s=READY pgs=2492 cs=0 l=1 rev1=1 crypto rx=0x7f36e80097f0 tx=0x7f36e801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 -- 172.21.15.67:0/3848333655 shutdown_connections 2024-09-19T05:49:28.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 --2- 172.21.15.67:0/3848333655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37000af220 0x7f37000d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 --2- 172.21.15.67:0/3848333655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 0x7f37000aece0 unknown :-1 s=CLOSED pgs=2492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 -- 172.21.15.67:0/3848333655 >> 172.21.15.67:0/3848333655 conn(0x7f370006be10 msgr2=0x7f370006c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:28.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 -- 172.21.15.67:0/3848333655 shutdown_connections 2024-09-19T05:49:28.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 -- 172.21.15.67:0/3848333655 wait complete. 2024-09-19T05:49:28.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 Processor -- start 2024-09-19T05:49:28.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 -- start start 2024-09-19T05:49:28.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000af220 0x7f3700165350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3700155620 0x7f370015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 0x7f3700150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3700167fc0 con 0x7f370015c310 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3700167e40 con 0x7f37000af220 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f3706281640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3700168140 con 0x7f3700155620 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f370481e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 0x7f3700150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f370481e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 0x7f3700150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50848/0 (socket says 172.21.15.67:50848) 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f370481e640 1 -- 172.21.15.67:0/452216447 learned_addr learned my addr 172.21.15.67:0/452216447 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f36fffff640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000af220 0x7f3700165350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.016+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3700155620 0x7f370015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f370481e640 1 -- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3700155620 msgr2=0x7f370015eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f370481e640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3700155620 0x7f370015eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f370481e640 1 -- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000af220 msgr2=0x7f3700165350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f370481e640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000af220 0x7f3700165350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f370481e640 1 -- 172.21.15.67:0/452216447 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37000b3720 con 0x7f370015c310 2024-09-19T05:49:28.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f370481e640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 0x7f3700150be0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c7f0 tx=0x7f36f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f36fcff9640 1 -- 172.21.15.67:0/452216447 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8015070 con 0x7f370015c310 2024-09-19T05:49:28.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f36fcff9640 1 -- 172.21.15.67:0/452216447 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f8007820 con 0x7f370015c310 2024-09-19T05:49:28.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f3706281640 1 -- 172.21.15.67:0/452216447 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37000b3a00 con 0x7f370015c310 2024-09-19T05:49:28.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f36fcff9640 1 -- 172.21.15.67:0/452216447 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8007c50 con 0x7f370015c310 2024-09-19T05:49:28.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f3706281640 1 -- 172.21.15.67:0/452216447 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37000b3fc0 con 0x7f370015c310 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f36fcff9640 1 -- 172.21.15.67:0/452216447 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36f8018070 con 0x7f370015c310 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f36fcff9640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e00678c0 0x7f36e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f36fcff9640 1 -- 172.21.15.67:0/452216447 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7f36f8086170 con 0x7f370015c310 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f36fffff640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e00678c0 0x7f36e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f36fffff640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e00678c0 0x7f36e0069d80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f36f0007fd0 tx=0x7f36f0007ee0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f370933d000 1 Processor -- start 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.020+0000 7f370933d000 1 -- start start 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d4534cb690 0x55d45347e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d45347edb0 0x55d45347f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d453368960 con 0x55d4534cad70 2024-09-19T05:49:28.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d4532ac900 con 0x55d4534cb690 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d4532cfd40 con 0x55d45347edb0 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36fffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36fffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50864/0 (socket says 172.21.15.67:50864) 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36fffff640 1 -- 172.21.15.67:0/2366324599 learned_addr learned my addr 172.21.15.67:0/2366324599 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/2366324599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d4534cb690 0x55d45347e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370481e640 1 --2- 172.21.15.67:0/2366324599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d45347edb0 0x55d45347f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36fffff640 1 -- 172.21.15.67:0/2366324599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d45347edb0 msgr2=0x55d45347f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36fffff640 1 --2- 172.21.15.67:0/2366324599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d45347edb0 0x55d45347f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36fffff640 1 -- 172.21.15.67:0/2366324599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d4534cb690 msgr2=0x55d45347e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36fffff640 1 --2- 172.21.15.67:0/2366324599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d4534cb690 0x55d45347e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36fffff640 1 -- 172.21.15.67:0/2366324599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d453276580 con 0x55d4534cad70 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36fffff640 1 --2- 172.21.15.67:0/2366324599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534cb150 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7f36f0001dc0 tx=0x7f36f0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b319cd25f98c28c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36f5ffb640 1 -- 172.21.15.67:0/2366324599 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0015a80 con 0x55d4534cad70 2024-09-19T05:49:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36f5ffb640 1 -- 172.21.15.67:0/2366324599 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f0015c20 con 0x55d4534cad70 2024-09-19T05:49:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36f5ffb640 1 -- 172.21.15.67:0/2366324599 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0021450 con 0x55d4534cad70 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- 172.21.15.67:0/2366324599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 msgr2=0x55d4534cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 --2- 172.21.15.67:0/2366324599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534cb150 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7f36f0001dc0 tx=0x7f36f0012000 comp rx=0 tx=0).stop 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- 172.21.15.67:0/2366324599 shutdown_connections 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 --2- 172.21.15.67:0/2366324599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d45347edb0 0x55d45347f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 --2- 172.21.15.67:0/2366324599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d4534cb690 0x55d45347e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 --2- 172.21.15.67:0/2366324599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534cb150 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- 172.21.15.67:0/2366324599 >> 172.21.15.67:0/2366324599 conn(0x55d4534ac040 msgr2=0x55d4534ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- 172.21.15.67:0/2366324599 shutdown_connections 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- 172.21.15.67:0/2366324599 wait complete. 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- start start 2024-09-19T05:49:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 Processor -- start 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4534d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534cb690 0x55d4534d2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d4532cbd00 con 0x55d4534cad70 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d45328aaa0 con 0x55d45347edb0 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d453269340 con 0x55d4534cb690 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f370933d000 10 client.0 _ll_register_callbacks cb 0x55d45346c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.024+0000 7f36ff7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36ff7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50880/0 (socket says 172.21.15.67:50880) 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36ff7fe640 1 -- 172.21.15.67:0/3771390485 learned_addr learned my addr 172.21.15.67:0/3771390485 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36fffff640 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4534d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370481e640 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534cb690 0x55d4534d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36ff7fe640 1 -- 172.21.15.67:0/3771390485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534cb690 msgr2=0x55d4534d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534cb690 0x55d4534d2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36ff7fe640 1 -- 172.21.15.67:0/3771390485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 msgr2=0x55d4534d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4534d1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36ff7fe640 1 -- 172.21.15.67:0/3771390485 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d453272dc0 con 0x55d4534cad70 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d2220 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7f36e80ae040 tx=0x7f36e801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25348400a0bb131b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36deffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36deffd640 1 -- 172.21.15.67:0/3771390485 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80b0040 con 0x55d4534cad70 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36deffd640 1 -- 172.21.15.67:0/3771390485 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7f36e8003820 con 0x55d4534cad70 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 -- 172.21.15.67:0/3771390485 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36f0015c20 con 0x55d4534cad70 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36deffd640 1 -- 172.21.15.67:0/3771390485 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) ==== 24+0+0 (secure 0 0 0) 0x7f36e8003a20 con 0x55d4534cad70 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 10 client.11094 fetch_fsmap learned FSMap version 146 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 -- 172.21.15.67:0/3771390485 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=2+}) -- 0x55d45326f7f0 con 0x55d4534cad70 2024-09-19T05:49:28.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36deffd640 1 -- 172.21.15.67:0/3771390485 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f0015c20 con 0x55d4534cad70 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36deffd640 1 -- 172.21.15.67:0/3771390485 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 146) ==== 3502+0+0 (secure 0 0 0) 0x7f36e8003bc0 con 0x55d4534cad70 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 10 client.11094 fetch_fsmap finished waiting for FSMap version 146 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 10 client.11094 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 20 client.11094 populate_metadata read hostname 'smithi067' 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55d4534da0b0 0x55d4534dc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 4 client.11094 mds_command: new command op to 10845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 -- 172.21.15.67:0/3771390485 --> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d453269e10 con 0x55d4534da0b0 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36fffff640 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55d4534da0b0 0x55d4534dc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36fffff640 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55d4534da0b0 0x55d4534dc4a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfaf13d67fc55150 server_cookie=108c7f1bada82313 in_seq=0 out_seq=0 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36deffd640 10 client.11094 ms_handle_connect on v2:172.21.15.67:6834/1771202736 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36deffd640 1 -- 172.21.15.67:0/3771390485 <== mds.0 v2:172.21.15.67:6834/1771202736 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d453269e10 con 0x55d4534da0b0 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36deffd640 10 client.11094 handle_command_reply: tid=0 2024-09-19T05:49:28.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 client.11094 shutdown 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 -- 172.21.15.67:0/3771390485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 msgr2=0x55d4534d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d2220 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7f36e80ae040 tx=0x7f36e801ace0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 -- 172.21.15.67:0/3771390485 shutdown_connections 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534cb690 0x55d4534d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55d4534da0b0 0x55d4534dc4a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d2220 unknown :-1 s=CLOSED pgs=2495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 --2- 172.21.15.67:0/3771390485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4534d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f36deffd640 0 client.11094 ms_handle_reset on v2:172.21.15.67:6834/1771202736 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 -- 172.21.15.67:0/3771390485 >> 172.21.15.67:0/3771390485 conn(0x55d4534ac040 msgr2=0x55d45347df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 -- 172.21.15.67:0/3771390485 shutdown_connections 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 1 -- 172.21.15.67:0/3771390485 wait complete. 2024-09-19T05:49:28.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.028+0000 7f370933d000 20 client.11094 trim_cache size 0 max 16384 2024-09-19T05:49:28.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 Processor -- start 2024-09-19T05:49:28.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 -- start start 2024-09-19T05:49:28.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534ac040 0x55d453486ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4534870e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f37002045d0 con 0x55d4534cad70 2024-09-19T05:49:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3700203650 con 0x55d45347edb0 2024-09-19T05:49:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f3700157ff0 con 0x55d4534ac040 2024-09-19T05:49:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370481e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370481e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50884/0 (socket says 172.21.15.67:50884) 2024-09-19T05:49:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370481e640 1 -- 172.21.15.67:0/2689659648 learned_addr learned my addr 172.21.15.67:0/2689659648 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/2689659648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4534870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f36fffff640 1 --2- 172.21.15.67:0/2689659648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534ac040 0x55d453486ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370481e640 1 -- 172.21.15.67:0/2689659648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534ac040 msgr2=0x55d453486ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370481e640 1 --2- 172.21.15.67:0/2689659648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534ac040 0x55d453486ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370481e640 1 -- 172.21.15.67:0/2689659648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 msgr2=0x55d4534870e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370481e640 1 --2- 172.21.15.67:0/2689659648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4534870e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370481e640 1 -- 172.21.15.67:0/2689659648 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d45328d470 con 0x55d4534cad70 2024-09-19T05:49:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/2689659648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4534870e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370481e640 1 --2- 172.21.15.67:0/2689659648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d4d00 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7f36f8055f80 tx=0x7f36f8055ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9008776df795849 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f36f57fa640 1 -- 172.21.15.67:0/2689659648 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f806e020 con 0x55d4534cad70 2024-09-19T05:49:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f36f57fa640 1 -- 172.21.15.67:0/2689659648 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f8054580 con 0x55d4534cad70 2024-09-19T05:49:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f36f57fa640 1 -- 172.21.15.67:0/2689659648 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f801f070 con 0x55d4534cad70 2024-09-19T05:49:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 -- 172.21.15.67:0/2689659648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 msgr2=0x55d4534d4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 --2- 172.21.15.67:0/2689659648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d4d00 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7f36f8055f80 tx=0x7f36f8055ef0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 -- 172.21.15.67:0/2689659648 shutdown_connections 2024-09-19T05:49:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 --2- 172.21.15.67:0/2689659648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534cad70 0x55d4534d4d00 unknown :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 --2- 172.21.15.67:0/2689659648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4534870e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 --2- 172.21.15.67:0/2689659648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534ac040 0x55d453486ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 -- 172.21.15.67:0/2689659648 >> 172.21.15.67:0/2689659648 conn(0x55d453483770 msgr2=0x55d4534d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 -- 172.21.15.67:0/2689659648 shutdown_connections 2024-09-19T05:49:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.048+0000 7f370933d000 1 -- 172.21.15.67:0/2689659648 wait complete. 2024-09-19T05:49:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- start start 2024-09-19T05:49:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 Processor -- start 2024-09-19T05:49:28.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4535407f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534ac040 0x55d453542d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534cad70 0x55d453545290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d4532ddfd0 con 0x55d4534ac040 2024-09-19T05:49:28.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d45348a3f0 con 0x55d45347edb0 2024-09-19T05:49:28.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x55d4534859d0 con 0x55d4534cad70 2024-09-19T05:49:28.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 10 client.0 _ll_register_callbacks cb 0x7f36e80ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:49:28.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36ff7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534ac040 0x55d453542d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36ff7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534ac040 0x55d453542d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50896/0 (socket says 172.21.15.67:50896) 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36ff7fe640 1 -- 172.21.15.67:0/2981539948 learned_addr learned my addr 172.21.15.67:0/2981539948 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36fffff640 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4535407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370481e640 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534cad70 0x55d453545290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36ff7fe640 1 -- 172.21.15.67:0/2981539948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534cad70 msgr2=0x55d453545290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534cad70 0x55d453545290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36ff7fe640 1 -- 172.21.15.67:0/2981539948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 msgr2=0x55d4535407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4535407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36ff7fe640 1 -- 172.21.15.67:0/2981539948 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d453263640 con 0x55d4534ac040 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36fffff640 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4535407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:49:28.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36ff7fe640 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534ac040 0x55d453542d40 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7f36e801a0d0 tx=0x7f36e8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39ee3137a2407b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36deffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-19T05:49:28.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36deffd640 1 -- 172.21.15.67:0/2981539948 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80b0040 con 0x55d4534ac040 2024-09-19T05:49:28.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36deffd640 1 -- 172.21.15.67:0/2981539948 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7f36e80b6610 con 0x55d4534ac040 2024-09-19T05:49:28.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- 172.21.15.67:0/2981539948 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36f8054580 con 0x55d4534ac040 2024-09-19T05:49:28.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36deffd640 1 -- 172.21.15.67:0/2981539948 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) ==== 24+0+0 (secure 0 0 0) 0x7f36e80d8050 con 0x55d4534ac040 2024-09-19T05:49:28.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 10 client.11100 fetch_fsmap learned FSMap version 146 2024-09-19T05:49:28.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- 172.21.15.67:0/2981539948 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=2+}) -- 0x55d4532673b0 con 0x55d4534ac040 2024-09-19T05:49:28.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36deffd640 1 -- 172.21.15.67:0/2981539948 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f8054580 con 0x55d4534ac040 2024-09-19T05:49:28.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36deffd640 1 -- 172.21.15.67:0/2981539948 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 146) ==== 3502+0+0 (secure 0 0 0) 0x7f36e80db020 con 0x55d4534ac040 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 10 client.11100 fetch_fsmap finished waiting for FSMap version 146 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 10 client.11100 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 20 client.11100 populate_metadata read hostname 'smithi067' 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55d4534cb690 0x55d4535477e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 4 client.11100 mds_command: new command op to 10845 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- 172.21.15.67:0/2981539948 --> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d4532dd470 con 0x55d4534cb690 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36fffff640 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55d4534cb690 0x55d4535477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36deffd640 10 client.11100 ms_handle_connect on v2:172.21.15.67:6834/1771202736 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36fffff640 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55d4534cb690 0x55d4535477e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b0b3cd4d161546f server_cookie=d603ad40bebbc3ce in_seq=0 out_seq=0 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36deffd640 1 -- 172.21.15.67:0/2981539948 <== mds.0 v2:172.21.15.67:6834/1771202736 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d4532dd470 con 0x55d4534cb690 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36deffd640 10 client.11100 handle_command_reply: tid=0 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 client.11100 shutdown 2024-09-19T05:49:28.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- 172.21.15.67:0/2981539948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534ac040 msgr2=0x55d453542d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534ac040 0x55d453542d40 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7f36e801a0d0 tx=0x7f36e8009190 comp rx=0 tx=0).stop 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- 172.21.15.67:0/2981539948 shutdown_connections 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55d4534cad70 0x55d453545290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.67:6834/1771202736,v1:172.21.15.67:6835/1771202736] conn(0x55d4534cb690 0x55d4535477e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d4534ac040 0x55d453542d40 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 --2- 172.21.15.67:0/2981539948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d45347edb0 0x55d4535407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- 172.21.15.67:0/2981539948 >> 172.21.15.67:0/2981539948 conn(0x55d453483770 msgr2=0x55d453485b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f36deffd640 0 client.11100 ms_handle_reset on v2:172.21.15.67:6834/1771202736 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- 172.21.15.67:0/2981539948 shutdown_connections 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 1 -- 172.21.15.67:0/2981539948 wait complete. 2024-09-19T05:49:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.052+0000 7f370933d000 20 client.11100 trim_cache size 0 max 16384 2024-09-19T05:49:28.060 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:49:28.060 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-19T05:49:28.060 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {} 2024-09-19T05:49:28.060 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:49:28.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 -- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e00678c0 msgr2=0x7f36e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e00678c0 0x7f36e0069d80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f36f0007fd0 tx=0x7f36f0007ee0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 -- 172.21.15.67:0/452216447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 msgr2=0x7f3700150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 0x7f3700150be0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c7f0 tx=0x7f36f800ccb0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 -- 172.21.15.67:0/452216447 shutdown_connections 2024-09-19T05:49:28.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370015c310 0x7f3700150be0 unknown :-1 s=CLOSED pgs=2493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f36e00678c0 0x7f36e0069d80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3700155620 0x7f370015eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 --2- 172.21.15.67:0/452216447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000af220 0x7f3700165350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 -- 172.21.15.67:0/452216447 >> 172.21.15.67:0/452216447 conn(0x7f370006be10 msgr2=0x7f3700152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:28.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 -- 172.21.15.67:0/452216447 shutdown_connections 2024-09-19T05:49:28.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.056+0000 7f3706281640 1 -- 172.21.15.67:0/452216447 wait complete. 2024-09-19T05:49:28.069 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:49:28.070 DEBUG:teuthology.orchestra.run.smithi067:> stdin-killer -- python3 -c ' 2024-09-19T05:49:28.070 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-09-19T05:49:28.070 DEBUG:teuthology.orchestra.run.smithi067:> import stat 2024-09-19T05:49:28.070 DEBUG:teuthology.orchestra.run.smithi067:> import json 2024-09-19T05:49:28.070 DEBUG:teuthology.orchestra.run.smithi067:> import sys 2024-09-19T05:49:28.071 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:49:28.071 DEBUG:teuthology.orchestra.run.smithi067:> try: 2024-09-19T05:49:28.071 DEBUG:teuthology.orchestra.run.smithi067:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-19T05:49:28.071 DEBUG:teuthology.orchestra.run.smithi067:> except OSError as e: 2024-09-19T05:49:28.071 DEBUG:teuthology.orchestra.run.smithi067:> sys.exit(e.errno) 2024-09-19T05:49:28.071 DEBUG:teuthology.orchestra.run.smithi067:> 2024-09-19T05:49:28.071 DEBUG:teuthology.orchestra.run.smithi067:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-19T05:49:28.072 DEBUG:teuthology.orchestra.run.smithi067:> print(json.dumps( 2024-09-19T05:49:28.072 DEBUG:teuthology.orchestra.run.smithi067:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-19T05:49:28.072 DEBUG:teuthology.orchestra.run.smithi067:> indent=2)) 2024-09-19T05:49:28.072 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-09-19T05:49:28.132 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:49:28.132 INFO:teuthology.orchestra.run.smithi067.stdout: "st_mode": 33204, 2024-09-19T05:49:28.132 INFO:teuthology.orchestra.run.smithi067.stdout: "st_ino": 1099511627777, 2024-09-19T05:49:28.132 INFO:teuthology.orchestra.run.smithi067.stdout: "st_dev": 45, 2024-09-19T05:49:28.132 INFO:teuthology.orchestra.run.smithi067.stdout: "st_nlink": 1, 2024-09-19T05:49:28.132 INFO:teuthology.orchestra.run.smithi067.stdout: "st_uid": 1000, 2024-09-19T05:49:28.132 INFO:teuthology.orchestra.run.smithi067.stdout: "st_gid": 1271, 2024-09-19T05:49:28.132 INFO:teuthology.orchestra.run.smithi067.stdout: "st_size": 6291456, 2024-09-19T05:49:28.133 INFO:teuthology.orchestra.run.smithi067.stdout: "st_atime": 1726724936.4992762, 2024-09-19T05:49:28.133 INFO:teuthology.orchestra.run.smithi067.stdout: "st_mtime": 1726724936.5480747, 2024-09-19T05:49:28.133 INFO:teuthology.orchestra.run.smithi067.stdout: "st_ctime": 1726724936.5480747 2024-09-19T05:49:28.133 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:49:28.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:49:28.142 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:49:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff84cb5640 1 Processor -- start 2024-09-19T05:49:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff84cb5640 1 -- start start 2024-09-19T05:49:28.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff84cb5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7eff8015e510 0x7eff800b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff84cb5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2000 0x7eff800d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff84cb5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff80160010 con 0x7eff800d2430 2024-09-19T05:49:28.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff84cb5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7eff801602f0 con 0x7eff8015e510 2024-09-19T05:49:28.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff84cb5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7eff801605d0 con 0x7eff800d2000 2024-09-19T05:49:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff7dd9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2000 0x7eff800d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff7dd9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2000 0x7eff800d29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:55048/0 (socket says 172.21.15.67:55048) 2024-09-19T05:49:28.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff7dd9b640 1 -- 172.21.15.67:0/185607733 learned_addr learned my addr 172.21.15.67:0/185607733 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:28.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff7e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7eff8015e510 0x7eff800b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff7dd9b640 1 -- 172.21.15.67:0/185607733 >> v2:172.21.15.97:3300/0 conn(0x7eff8015e510 msgr2=0x7eff800b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff7dd9b640 1 --2- 172.21.15.67:0/185607733 >> v2:172.21.15.97:3300/0 conn(0x7eff8015e510 0x7eff800b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff7dd9b640 1 -- 172.21.15.67:0/185607733 >> v1:172.21.15.97:6789/0 conn(0x7eff800d2430 legacy=0x7eff801610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.316+0000 7eff7dd9b640 1 -- 172.21.15.67:0/185607733 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff801608b0 con 0x7eff800d2000 2024-09-19T05:49:28.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff7dd9b640 1 --2- 172.21.15.67:0/185607733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2000 0x7eff800d29d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff68006fd0 tx=0x7eff6801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c5e9758dacb0bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff7d59a640 1 -- 172.21.15.67:0/185607733 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff680b2070 con 0x7eff800d2000 2024-09-19T05:49:28.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff7d59a640 1 -- 172.21.15.67:0/185607733 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff680ad640 con 0x7eff800d2000 2024-09-19T05:49:28.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff7d59a640 1 -- 172.21.15.67:0/185607733 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff680ada10 con 0x7eff800d2000 2024-09-19T05:49:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff84cb5640 1 -- 172.21.15.67:0/185607733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2000 msgr2=0x7eff800d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff84cb5640 1 --2- 172.21.15.67:0/185607733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2000 0x7eff800d29d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff68006fd0 tx=0x7eff6801c480 comp rx=0 tx=0).stop 2024-09-19T05:49:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff84cb5640 1 -- 172.21.15.67:0/185607733 shutdown_connections 2024-09-19T05:49:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff84cb5640 1 --2- 172.21.15.67:0/185607733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2000 0x7eff800d29d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff84cb5640 1 --2- 172.21.15.67:0/185607733 >> v2:172.21.15.97:3300/0 conn(0x7eff8015e510 0x7eff800b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff84cb5640 1 -- 172.21.15.67:0/185607733 >> 172.21.15.67:0/185607733 conn(0x7eff8008bff0 msgr2=0x7eff800d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff84cb5640 1 -- 172.21.15.67:0/185607733 shutdown_connections 2024-09-19T05:49:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff84cb5640 1 -- 172.21.15.67:0/185607733 wait complete. 2024-09-19T05:49:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff84cb5640 1 Processor -- start 2024-09-19T05:49:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.320+0000 7eff84cb5640 1 -- start start 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff84cb5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff800d2000 0x7eff80158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff84cb5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2430 0x7eff800b9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff84cb5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8015e510 0x7eff800b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff84cb5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff8015ec80 con 0x7eff8015e510 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff84cb5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7eff8015eb00 con 0x7eff800d2000 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff84cb5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7eff8015ee00 con 0x7eff800d2430 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8015e510 0x7eff800b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8015e510 0x7eff800b7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50906/0 (socket says 172.21.15.67:50906) 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7ed9d640 1 -- 172.21.15.67:0/2399443804 learned_addr learned my addr 172.21.15.67:0/2399443804 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7e59c640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff800d2000 0x7eff80158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7dd9b640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2430 0x7eff800b9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7ed9d640 1 -- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2430 msgr2=0x7eff800b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7ed9d640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2430 0x7eff800b9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7ed9d640 1 -- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff800d2000 msgr2=0x7eff80158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7ed9d640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff800d2000 0x7eff80158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7ed9d640 1 -- 172.21.15.67:0/2399443804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff800d0d10 con 0x7eff8015e510 2024-09-19T05:49:28.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7dd9b640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2430 0x7eff800b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:49:28.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7ed9d640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8015e510 0x7eff800b7260 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7eff7800c6c0 tx=0x7eff7800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff76ffd640 1 -- 172.21.15.67:0/2399443804 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78003b80 con 0x7eff8015e510 2024-09-19T05:49:28.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff76ffd640 1 -- 172.21.15.67:0/2399443804 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff78003d20 con 0x7eff8015e510 2024-09-19T05:49:28.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff84cb5640 1 -- 172.21.15.67:0/2399443804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff800b8070 con 0x7eff8015e510 2024-09-19T05:49:28.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff76ffd640 1 -- 172.21.15.67:0/2399443804 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff780052f0 con 0x7eff8015e510 2024-09-19T05:49:28.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff84cb5640 1 -- 172.21.15.67:0/2399443804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff800b9540 con 0x7eff8015e510 2024-09-19T05:49:28.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff84cb5640 1 -- 172.21.15.67:0/2399443804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff800b8590 con 0x7eff8015e510 2024-09-19T05:49:28.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff76ffd640 1 -- 172.21.15.67:0/2399443804 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff78005490 con 0x7eff8015e510 2024-09-19T05:49:28.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff76ffd640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff600678c0 0x7eff60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff76ffd640 1 -- 172.21.15.67:0/2399443804 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7eff78085c50 con 0x7eff8015e510 2024-09-19T05:49:28.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.324+0000 7eff7e59c640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff600678c0 0x7eff60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.328+0000 7eff7e59c640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff600678c0 0x7eff60069d80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7eff70009ac0 tx=0x7eff70009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.332+0000 7eff76ffd640 1 -- 172.21.15.67:0/2399443804 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7eff7808b020 con 0x7eff8015e510 2024-09-19T05:49:28.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.528+0000 7eff84cb5640 1 -- 172.21.15.67:0/2399443804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff800d29d0 con 0x7eff8015e510 2024-09-19T05:49:28.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff76ffd640 1 -- 172.21.15.67:0/2399443804 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+5236 (secure 0 0 0) 0x7eff800d0d10 con 0x7eff8015e510 2024-09-19T05:49:28.529 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:28.529 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":146,"btime":"2024-09-19T05:48:46:398467+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2335567881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2335567881},{"type":"v1","addr":"172.21.15.97:6837","nonce":2335567881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":8551,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1743099743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1743099743},{"type":"v1","addr":"172.21.15.97:6835","nonce":1743099743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":10839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/644096538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":644096538},{"type":"v1","addr":"172.21.15.67:6833","nonce":644096538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:48:42.753814+0000","modified":"2024-09-19T05:48:45.770434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10845":{"gid":10845,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1771202736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1771202736},{"type":"v1","addr":"172.21.15.67:6835","nonce":1771202736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10845,"qdb_cluster":[10845]},"id":14}]} 2024-09-19T05:49:28.529 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 146 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 -- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff600678c0 msgr2=0x7eff60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff600678c0 0x7eff60069d80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7eff70009ac0 tx=0x7eff70009190 comp rx=0 tx=0).stop 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 -- 172.21.15.67:0/2399443804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8015e510 msgr2=0x7eff800b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8015e510 0x7eff800b7260 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7eff7800c6c0 tx=0x7eff7800cb80 comp rx=0 tx=0).stop 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 -- 172.21.15.67:0/2399443804 shutdown_connections 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8015e510 0x7eff800b7260 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7eff600678c0 0x7eff60069d80 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff800d2430 0x7eff800b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 --2- 172.21.15.67:0/2399443804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff800d2000 0x7eff80158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 -- 172.21.15.67:0/2399443804 >> 172.21.15.67:0/2399443804 conn(0x7eff8008bff0 msgr2=0x7eff800b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 -- 172.21.15.67:0/2399443804 shutdown_connections 2024-09-19T05:49:28.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.532+0000 7eff84cb5640 1 -- 172.21.15.67:0/2399443804 wait complete. 2024-09-19T05:49:28.549 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-19T05:49:28.695 INFO:teuthology.orchestra.run.smithi067.stdout:{"message":"","return_code":0} 2024-09-19T05:49:28.695 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-19T05:49:28.696 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-19T05:49:28.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd176830080 1 Processor -- start 2024-09-19T05:49:28.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd176830080 1 -- start start 2024-09-19T05:49:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd176830080 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565227f57930 0x565227f57d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd176830080 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fe0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd176830080 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565227f10b00 0x565227fe0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd176830080 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x565227e601b0 con 0x565227f10720 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd176830080 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x565227eb97b0 con 0x565227f57930 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd176830080 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x565227fe4e40 con 0x565227f10b00 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd173b42640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fe0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd173b42640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fe0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50928/0 (socket says 172.21.15.67:50928) 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd173b42640 1 -- 172.21.15.67:0/1576340117 learned_addr learned my addr 172.21.15.67:0/1576340117 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd174b44640 1 --2- 172.21.15.67:0/1576340117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565227f10b00 0x565227fe0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd174343640 1 --2- 172.21.15.67:0/1576340117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565227f57930 0x565227f57d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd173b42640 1 -- 172.21.15.67:0/1576340117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565227f10b00 msgr2=0x565227fe0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd173b42640 1 --2- 172.21.15.67:0/1576340117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565227f10b00 0x565227fe0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd173b42640 1 -- 172.21.15.67:0/1576340117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565227f57930 msgr2=0x565227f57d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd173b42640 1 --2- 172.21.15.67:0/1576340117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565227f57930 0x565227f57d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.736+0000 7fd173b42640 1 -- 172.21.15.67:0/1576340117 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565227f12300 con 0x565227f10720 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd173b42640 1 --2- 172.21.15.67:0/1576340117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fe0670 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7fd15c01c0b0 tx=0x7fd15c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa7968a487dc907 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd172b40640 1 -- 172.21.15.67:0/1576340117 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c00a240 con 0x565227f10720 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd172b40640 1 -- 172.21.15.67:0/1576340117 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15c00a400 con 0x565227f10720 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd172b40640 1 -- 172.21.15.67:0/1576340117 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0a7a10 con 0x565227f10720 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- 172.21.15.67:0/1576340117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 msgr2=0x565227fe0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 --2- 172.21.15.67:0/1576340117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fe0670 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7fd15c01c0b0 tx=0x7fd15c003030 comp rx=0 tx=0).stop 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- 172.21.15.67:0/1576340117 shutdown_connections 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 --2- 172.21.15.67:0/1576340117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565227f10b00 0x565227fe0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 --2- 172.21.15.67:0/1576340117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fe0670 unknown :-1 s=CLOSED pgs=2501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 --2- 172.21.15.67:0/1576340117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565227f57930 0x565227f57d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- 172.21.15.67:0/1576340117 >> 172.21.15.67:0/1576340117 conn(0x565227f39920 msgr2=0x565227f3cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- 172.21.15.67:0/1576340117 shutdown_connections 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- 172.21.15.67:0/1576340117 wait complete. 2024-09-19T05:49:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 Processor -- start 2024-09-19T05:49:28.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- start start 2024-09-19T05:49:28.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fcca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565227f10b00 0x565227fdd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565227f57930 0x565227f55220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x565227f11b20 con 0x565227f10720 2024-09-19T05:49:28.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x565227f11dc0 con 0x565227f57930 2024-09-19T05:49:28.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x565227f12060 con 0x565227f10b00 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174343640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fcca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174343640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fcca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50938/0 (socket says 172.21.15.67:50938) 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174343640 1 -- 172.21.15.67:0/990224986 learned_addr learned my addr 172.21.15.67:0/990224986 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174b44640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565227f57930 0x565227f55220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd173b42640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565227f10b00 0x565227fdd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174343640 1 -- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565227f10b00 msgr2=0x565227fdd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174343640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x565227f10b00 0x565227fdd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174343640 1 -- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565227f57930 msgr2=0x565227f55220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174343640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565227f57930 0x565227f55220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174343640 1 -- 172.21.15.67:0/990224986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565227fe8220 con 0x565227f10720 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174b44640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x565227f57930 0x565227f55220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd174343640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fcca90 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00e6b0 tx=0x7fd16c00eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd171b3e640 1 -- 172.21.15.67:0/990224986 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00ca00 con 0x565227f10720 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd171b3e640 1 -- 172.21.15.67:0/990224986 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16c00cba0 con 0x565227f10720 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd171b3e640 1 -- 172.21.15.67:0/990224986 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c019430 con 0x565227f10720 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- 172.21.15.67:0/990224986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565227fe84c0 con 0x565227f10720 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.740+0000 7fd176830080 1 -- 172.21.15.67:0/990224986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565227f54d80 con 0x565227f10720 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd171b3e640 1 -- 172.21.15.67:0/990224986 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd16c0233f0 con 0x565227f10720 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd171b3e640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd1540662d0 0x7fd154068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd171b3e640 1 -- 172.21.15.67:0/990224986 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7fd16c085970 con 0x565227f10720 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x565227feac40 0x565227fcd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 -- 172.21.15.67:0/990224986 --> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] -- osd_op(unknown.0.0:1 30.7 30:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e207) -- 0x565227fcd870 con 0x565227feac40 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd173b42640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd1540662d0 0x7fd154068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd174b44640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x565227feac40 0x565227fcd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd174b44640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x565227feac40 0x565227fcd330 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd174b44640 1 -- 172.21.15.67:0/990224986 <== osd.2 v2:172.21.15.67:6824/3795893630 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7fd164001620 con 0x565227feac40 2024-09-19T05:49:28.745 INFO:teuthology.orchestra.run.smithi067.stdout:Ysixmegssubdir  2024-09-19T05:49:28.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd173b42640 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd1540662d0 0x7fd154068790 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0ba000 tx=0x7fd15c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:28.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 -- 172.21.15.67:0/990224986 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x565227feac40 msgr2=0x565227fcd330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x565227feac40 0x565227fcd330 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:28.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 -- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd1540662d0 msgr2=0x7fd154068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd1540662d0 0x7fd154068790 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0ba000 tx=0x7fd15c0a6000 comp rx=0 tx=0).stop 2024-09-19T05:49:28.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 -- 172.21.15.67:0/990224986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 msgr2=0x565227fcca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:28.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 --2- 172.21.15.67:0/990224986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565227f10720 0x565227fcca90 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00e6b0 tx=0x7fd16c00eb70 comp rx=0 tx=0).stop 2024-09-19T05:49:28.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd174b44640 1 -- 172.21.15.67:0/990224986 reap_dead start 2024-09-19T05:49:28.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 -- 172.21.15.67:0/990224986 shutdown_connections 2024-09-19T05:49:28.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 -- 172.21.15.67:0/990224986 >> 172.21.15.67:0/990224986 conn(0x565227f39920 msgr2=0x565227f0fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:28.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 -- 172.21.15.67:0/990224986 shutdown_connections 2024-09-19T05:49:28.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:28.744+0000 7fd176830080 1 -- 172.21.15.67:0/990224986 wait complete. 2024-09-19T05:49:28.748 DEBUG:teuthology.orchestra.run.smithi067:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-19T05:49:28.836 INFO:teuthology.orchestra.run.smithi067.stderr:error: stray data at end of buffer, offset 95 2024-09-19T05:49:28.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:49:28.839 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T05:49:28.839 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:49:28.954 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T05:49:29.030 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T05:49:29.030 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:49:29.030 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:49:29.031 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:49:29.037 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:49:29.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f568bb49640 1 Processor -- start 2024-09-19T05:49:29.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f568bb49640 1 -- start start 2024-09-19T05:49:29.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f568bb49640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b3a40 0x7f56840d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f568bb49640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56840c8130 con 0x7f568415e960 2024-09-19T05:49:29.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f568bb49640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56840d10b0 con 0x7f568415e580 2024-09-19T05:49:29.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f568bb49640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f56840c83d0 con 0x7f56840b3a40 2024-09-19T05:49:29.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56890e4640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f568415e960 0x7f56840cc8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51268/0 (socket says 172.21.15.67:51268) 2024-09-19T05:49:29.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56890e4640 1 -- 172.21.15.67:0/722608347 learned_addr learned my addr 172.21.15.67:0/722608347 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f568a0e6640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b3a40 0x7f56840d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023326463 0 0) 0x7f56840c8130 con 0x7f568415e960 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5670003530 con 0x7f568415e960 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2037070619 0 0) 0x7f5670003530 con 0x7f568415e960 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b3a40 msgr2=0x7f56840d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b3a40 0x7f56840d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 >> v1:172.21.15.97:6789/0 conn(0x7f568415e580 legacy=0x7f56840b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56840c86b0 con 0x7f568415e960 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f56740016a0 con 0x7f568415e960 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 >> v1:172.21.15.67:6789/0 conn(0x7f568415e960 legacy=0x7f56840cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:29.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56700039f0 0x7f5670003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b3a40 0x7f5670004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5670004d50 0x7f56700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f56840c83d0 con 0x7f5670004d50 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f567000ba80 con 0x7f56700039f0 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f567000bc80 con 0x7f56840b3a40 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f568a0e6640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5670004d50 0x7f56700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56890e4640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b3a40 0x7f5670004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.212+0000 7f56898e5640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56700039f0 0x7f5670003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568a0e6640 1 -- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b3a40 msgr2=0x7f5670004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568a0e6640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b3a40 0x7f5670004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568a0e6640 1 -- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56700039f0 msgr2=0x7f5670003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:29.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568a0e6640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56700039f0 0x7f5670003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568a0e6640 1 -- 172.21.15.67:0/722608347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5670003530 con 0x7f5670004d50 2024-09-19T05:49:29.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f56890e4640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b3a40 0x7f5670004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:49:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568a0e6640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5670004d50 0x7f56700051d0 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7f567c009f90 tx=0x7f567c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc13af90f08ac106 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0b2070 con 0x7f5670004d50 2024-09-19T05:49:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c0a5c50 con 0x7f5670004d50 2024-09-19T05:49:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f56888e3640 1 -- 172.21.15.67:0/722608347 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c009c10 con 0x7f5670004d50 2024-09-19T05:49:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568bb49640 1 -- 172.21.15.67:0/722608347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5670004d50 msgr2=0x7f56700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568bb49640 1 --2- 172.21.15.67:0/722608347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5670004d50 0x7f56700051d0 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7f567c009f90 tx=0x7f567c01cc40 comp rx=0 tx=0).stop 2024-09-19T05:49:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568a0e6640 1 -- 172.21.15.67:0/722608347 reap_dead start 2024-09-19T05:49:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568bb49640 1 -- 172.21.15.67:0/722608347 shutdown_connections 2024-09-19T05:49:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568bb49640 1 -- 172.21.15.67:0/722608347 >> 172.21.15.67:0/722608347 conn(0x7f56840d22a0 msgr2=0x7f56840d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:29.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568bb49640 1 -- 172.21.15.67:0/722608347 shutdown_connections 2024-09-19T05:49:29.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.216+0000 7f568bb49640 1 -- 172.21.15.67:0/722608347 wait complete. 2024-09-19T05:49:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 Processor -- start 2024-09-19T05:49:29.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 -- start start 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5670004d50 0x7f568409c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b6240 0x7f5684154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56840b7880 0x7f5684157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f568409bd10 con 0x7f56840b7880 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f56840c8e90 con 0x7f5670004d50 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f56840d0b40 con 0x7f56840b6240 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568a0e6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56840b7880 0x7f5684157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568a0e6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56840b7880 0x7f5684157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50950/0 (socket says 172.21.15.67:50950) 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568a0e6640 1 -- 172.21.15.67:0/739904174 learned_addr learned my addr 172.21.15.67:0/739904174 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f56898e5640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5670004d50 0x7f568409c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f56890e4640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b6240 0x7f5684154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568a0e6640 1 -- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b6240 msgr2=0x7f5684154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568a0e6640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b6240 0x7f5684154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568a0e6640 1 -- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5670004d50 msgr2=0x7f568409c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568a0e6640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5670004d50 0x7f568409c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568a0e6640 1 -- 172.21.15.67:0/739904174 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56840b67e0 con 0x7f56840b7880 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f56898e5640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5670004d50 0x7f568409c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f56890e4640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b6240 0x7f5684154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568a0e6640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56840b7880 0x7f5684157d40 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f567c0b0040 tx=0x7f567c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f567a7fc640 1 -- 172.21.15.67:0/739904174 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0bd070 con 0x7f56840b7880 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f567a7fc640 1 -- 172.21.15.67:0/739904174 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c0a5a50 con 0x7f56840b7880 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 -- 172.21.15.67:0/739904174 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56840b6ac0 con 0x7f56840b7880 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f567a7fc640 1 -- 172.21.15.67:0/739904174 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0b2040 con 0x7f56840b7880 2024-09-19T05:49:29.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 -- 172.21.15.67:0/739904174 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56840b7080 con 0x7f56840b7880 2024-09-19T05:49:29.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f568bb49640 1 -- 172.21.15.67:0/739904174 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56840d2080 con 0x7f56840b7880 2024-09-19T05:49:29.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f567a7fc640 1 -- 172.21.15.67:0/739904174 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f567c0c0070 con 0x7f56840b7880 2024-09-19T05:49:29.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.220+0000 7f567a7fc640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56680678c0 0x7f5668069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.224+0000 7f567a7fc640 1 -- 172.21.15.67:0/739904174 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7f567c11fc20 con 0x7f56840b7880 2024-09-19T05:49:29.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.224+0000 7f56898e5640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56680678c0 0x7f5668069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.224+0000 7f56898e5640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56680678c0 0x7f5668069d80 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f5680000c10 tx=0x7f5680009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:29.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.228+0000 7f567a7fc640 1 -- 172.21.15.67:0/739904174 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f567c016950 con 0x7f56840b7880 2024-09-19T05:49:29.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.400+0000 7f568bb49640 1 -- 172.21.15.67:0/739904174 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f568415bb40 con 0x7f56840b7880 2024-09-19T05:49:29.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.400+0000 7f567a7fc640 1 -- 172.21.15.67:0/739904174 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v207) ==== 80+0+0 (secure 0 0 0) 0x7f567c0efe80 con 0x7f56840b7880 2024-09-19T05:49:29.400 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-09-19T05:49:29.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 -- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56680678c0 msgr2=0x7f5668069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56680678c0 0x7f5668069d80 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f5680000c10 tx=0x7f5680009040 comp rx=0 tx=0).stop 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 -- 172.21.15.67:0/739904174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56840b7880 msgr2=0x7f5684157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56840b7880 0x7f5684157d40 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f567c0b0040 tx=0x7f567c009750 comp rx=0 tx=0).stop 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 -- 172.21.15.67:0/739904174 shutdown_connections 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56840b7880 0x7f5684157d40 unknown :-1 s=CLOSED pgs=2505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f56680678c0 0x7f5668069d80 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56840b6240 0x7f5684154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 --2- 172.21.15.67:0/739904174 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5670004d50 0x7f568409c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 -- 172.21.15.67:0/739904174 >> 172.21.15.67:0/739904174 conn(0x7f56840d22a0 msgr2=0x7f56840c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 -- 172.21.15.67:0/739904174 shutdown_connections 2024-09-19T05:49:29.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.404+0000 7f568bb49640 1 -- 172.21.15.67:0/739904174 wait complete. 2024-09-19T05:49:29.419 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-09-19T05:49:29.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:29.420 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:49:29.431 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[89463]: fuse finished with error 0 and tester_r 0 2024-09-19T05:49:29.433 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:49:29.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:29.433 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:49:29.581 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:49:29.581 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:49:29.582 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:49:29.588 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:49:29.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:49:29.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:29.588 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T05:49:29.637 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T05:49:29.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:49:29.639 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:49:29.639 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:49:29.639 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:49:29.646 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:49:29.646 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:49:29.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:29.646 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T05:49:29.696 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T05:49:29.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:49:29.698 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T05:49:29.698 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:49:29.698 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:49:29.704 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:49:29.704 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:49:29.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:29.704 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T05:49:29.753 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T05:49:29.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:49:29.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:49:29.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477918d640 1 Processor -- start 2024-09-19T05:49:29.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477918d640 1 -- start start 2024-09-19T05:49:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477918d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4774071e00 0x7f47740d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477918d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47740d09f0 0x7f4774165e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477918d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477406f770 con 0x7f477415c0b0 2024-09-19T05:49:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477918d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f47740d0e60 con 0x7f47740d09f0 2024-09-19T05:49:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477918d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4774072220 con 0x7f4774071e00 2024-09-19T05:49:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477359e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47740d09f0 0x7f4774165e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477359e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47740d09f0 0x7f4774165e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50962/0 (socket says 172.21.15.67:50962) 2024-09-19T05:49:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477359e640 1 -- 172.21.15.67:0/4162618946 learned_addr learned my addr 172.21.15.67:0/4162618946 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f476bfff640 1 --2- 172.21.15.67:0/4162618946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4774071e00 0x7f47740d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477359e640 1 -- 172.21.15.67:0/4162618946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4774071e00 msgr2=0x7f47740d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:29.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477359e640 1 --2- 172.21.15.67:0/4162618946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4774071e00 0x7f47740d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477359e640 1 -- 172.21.15.67:0/4162618946 >> v1:172.21.15.97:6789/0 conn(0x7f477415c0b0 legacy=0x7f47740ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:29.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.892+0000 7f477359e640 1 -- 172.21.15.67:0/4162618946 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477415c8d0 con 0x7f47740d09f0 2024-09-19T05:49:29.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477359e640 1 --2- 172.21.15.67:0/4162618946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 0x7f4774165e80 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7f476c009e50 tx=0x7f476c01c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774d224ef4dc1a74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:29.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477259c640 1 -- 172.21.15.67:0/4162618946 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c0a5660 con 0x7f47740d09f0 2024-09-19T05:49:29.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477259c640 1 -- 172.21.15.67:0/4162618946 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476c0a5800 con 0x7f47740d09f0 2024-09-19T05:49:29.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477259c640 1 -- 172.21.15.67:0/4162618946 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c0a5bd0 con 0x7f47740d09f0 2024-09-19T05:49:29.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 -- 172.21.15.67:0/4162618946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 msgr2=0x7f4774165e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:29.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 --2- 172.21.15.67:0/4162618946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 0x7f4774165e80 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7f476c009e50 tx=0x7f476c01c7e0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 -- 172.21.15.67:0/4162618946 shutdown_connections 2024-09-19T05:49:29.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 --2- 172.21.15.67:0/4162618946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 0x7f4774165e80 unknown :-1 s=CLOSED pgs=2506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 --2- 172.21.15.67:0/4162618946 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4774071e00 0x7f47740d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 -- 172.21.15.67:0/4162618946 >> 172.21.15.67:0/4162618946 conn(0x7f477406c040 msgr2=0x7f477406c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:29.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 -- 172.21.15.67:0/4162618946 shutdown_connections 2024-09-19T05:49:29.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 -- 172.21.15.67:0/4162618946 wait complete. 2024-09-19T05:49:29.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 Processor -- start 2024-09-19T05:49:29.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 -- start start 2024-09-19T05:49:29.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4774071e00 0x7f477414f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 0x7f4774153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477415c0b0 0x7f4774153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47740ad7d0 con 0x7f47740d09f0 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f477415d450 con 0x7f4774071e00 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477918d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f477415c490 con 0x7f477415c0b0 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f476bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 0x7f4774153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f476bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 0x7f4774153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50964/0 (socket says 172.21.15.67:50964) 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f476bfff640 1 -- 172.21.15.67:0/1145467323 learned_addr learned my addr 172.21.15.67:0/1145467323 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f477359e640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477415c0b0 0x7f4774153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f4772d9d640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4774071e00 0x7f477414f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f476bfff640 1 -- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477415c0b0 msgr2=0x7f4774153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f476bfff640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477415c0b0 0x7f4774153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f476bfff640 1 -- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4774071e00 msgr2=0x7f477414f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f476bfff640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4774071e00 0x7f477414f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f476bfff640 1 -- 172.21.15.67:0/1145467323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4774155ee0 con 0x7f47740d09f0 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f476bfff640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 0x7f4774153970 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7f475c00d5f0 tx=0x7f475c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:29.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.896+0000 7f476b7fe640 1 -- 172.21.15.67:0/1145467323 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c0125f0 con 0x7f47740d09f0 2024-09-19T05:49:29.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.900+0000 7f476b7fe640 1 -- 172.21.15.67:0/1145467323 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475c019070 con 0x7f47740d09f0 2024-09-19T05:49:29.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.900+0000 7f476b7fe640 1 -- 172.21.15.67:0/1145467323 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c0129b0 con 0x7f47740d09f0 2024-09-19T05:49:29.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.900+0000 7f477918d640 1 -- 172.21.15.67:0/1145467323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47741561c0 con 0x7f47740d09f0 2024-09-19T05:49:29.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.900+0000 7f477918d640 1 -- 172.21.15.67:0/1145467323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477415ec80 con 0x7f47740d09f0 2024-09-19T05:49:29.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.900+0000 7f477918d640 1 -- 172.21.15.67:0/1145467323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47740d04b0 con 0x7f47740d09f0 2024-09-19T05:49:29.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.900+0000 7f476b7fe640 1 -- 172.21.15.67:0/1145467323 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f475c012b50 con 0x7f47740d09f0 2024-09-19T05:49:29.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.900+0000 7f476b7fe640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47540678f0 0x7f4754069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:29.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.900+0000 7f476b7fe640 1 -- 172.21.15.67:0/1145467323 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7f475c086290 con 0x7f47740d09f0 2024-09-19T05:49:29.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.900+0000 7f4772d9d640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47540678f0 0x7f4754069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:29.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.900+0000 7f4772d9d640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47540678f0 0x7f4754069db0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f4774152110 tx=0x7f4764009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:29.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:29.904+0000 7f476b7fe640 1 -- 172.21.15.67:0/1145467323 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f475c056bd0 con 0x7f47740d09f0 2024-09-19T05:49:30.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 -- 172.21.15.67:0/1145467323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47740ad310 con 0x7f47740d09f0 2024-09-19T05:49:30.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f476b7fe640 1 -- 172.21.15.67:0/1145467323 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+5236 (secure 0 0 0) 0x7f475c0564d0 con 0x7f47740d09f0 2024-09-19T05:49:30.098 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:30.098 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":146,"btime":"2024-09-19T05:48:46:398467+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2335567881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2335567881},{"type":"v1","addr":"172.21.15.97:6837","nonce":2335567881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":8551,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1743099743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1743099743},{"type":"v1","addr":"172.21.15.97:6835","nonce":1743099743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":10839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/644096538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":644096538},{"type":"v1","addr":"172.21.15.67:6833","nonce":644096538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:48:42.753814+0000","modified":"2024-09-19T05:48:45.770434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10845":{"gid":10845,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1771202736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1771202736},{"type":"v1","addr":"172.21.15.67:6835","nonce":1771202736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10845,"qdb_cluster":[10845]},"id":14}]} 2024-09-19T05:49:30.098 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 146 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 -- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47540678f0 msgr2=0x7f4754069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47540678f0 0x7f4754069db0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f4774152110 tx=0x7f4764009040 comp rx=0 tx=0).stop 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 -- 172.21.15.67:0/1145467323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 msgr2=0x7f4774153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 0x7f4774153970 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7f475c00d5f0 tx=0x7f475c00dab0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 -- 172.21.15.67:0/1145467323 shutdown_connections 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f47540678f0 0x7f4754069db0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f477415c0b0 0x7f4774153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47740d09f0 0x7f4774153970 unknown :-1 s=CLOSED pgs=2507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 --2- 172.21.15.67:0/1145467323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4774071e00 0x7f477414f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 -- 172.21.15.67:0/1145467323 >> 172.21.15.67:0/1145467323 conn(0x7f477406c040 msgr2=0x7f477406e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 -- 172.21.15.67:0/1145467323 shutdown_connections 2024-09-19T05:49:30.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.100+0000 7f477918d640 1 -- 172.21.15.67:0/1145467323 wait complete. 2024-09-19T05:49:30.116 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:49:30.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.228+0000 7f32f9390640 1 Processor -- start 2024-09-19T05:49:30.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.228+0000 7f32f9390640 1 -- start start 2024-09-19T05:49:30.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f9390640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32f415b1a0 0x7f32f4071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f9390640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f4072e30 con 0x7f32f406f810 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f9390640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f415b580 con 0x7f32f40d0bc0 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f9390640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f32f4072830 con 0x7f32f415b1a0 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f27fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f32f406f810 0x7f32f40d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51284/0 (socket says 172.21.15.67:51284) 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f27fc640 1 -- 172.21.15.67:0/1949379094 learned_addr learned my addr 172.21.15.67:0/1949379094 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f2ffd640 1 --2- 172.21.15.67:0/1949379094 >> v2:172.21.15.67:3300/0 conn(0x7f32f415b1a0 0x7f32f4071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f1ffb640 1 -- 172.21.15.67:0/1949379094 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291954854 0 0) 0x7f32f4072e30 con 0x7f32f406f810 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f1ffb640 1 -- 172.21.15.67:0/1949379094 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32dc005740 con 0x7f32f406f810 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f2ffd640 1 -- 172.21.15.67:0/1949379094 >> v1:172.21.15.97:6789/0 conn(0x7f32f40d0bc0 legacy=0x7f32f40ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f2ffd640 1 -- 172.21.15.67:0/1949379094 >> v1:172.21.15.67:6789/0 conn(0x7f32f406f810 legacy=0x7f32f40d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f2ffd640 1 -- 172.21.15.67:0/1949379094 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f40730d0 con 0x7f32f415b1a0 2024-09-19T05:49:30.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f2ffd640 1 --2- 172.21.15.67:0/1949379094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f415b1a0 0x7f32f4071f90 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 crypto rx=0x7f32e40097c0 tx=0x7f32e401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becb3d43271c10e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:30.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f1ffb640 1 -- 172.21.15.67:0/1949379094 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e40a7070 con 0x7f32f415b1a0 2024-09-19T05:49:30.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f1ffb640 1 -- 172.21.15.67:0/1949379094 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e40b0070 con 0x7f32f415b1a0 2024-09-19T05:49:30.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.232+0000 7f32f1ffb640 1 -- 172.21.15.67:0/1949379094 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e40ab890 con 0x7f32f415b1a0 2024-09-19T05:49:30.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- 172.21.15.67:0/1949379094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f415b1a0 msgr2=0x7f32f4071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 --2- 172.21.15.67:0/1949379094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f415b1a0 0x7f32f4071f90 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 crypto rx=0x7f32e40097c0 tx=0x7f32e401c470 comp rx=0 tx=0).stop 2024-09-19T05:49:30.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- 172.21.15.67:0/1949379094 shutdown_connections 2024-09-19T05:49:30.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 --2- 172.21.15.67:0/1949379094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f415b1a0 0x7f32f4071f90 unknown :-1 s=CLOSED pgs=2509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- 172.21.15.67:0/1949379094 >> 172.21.15.67:0/1949379094 conn(0x7f32f406c040 msgr2=0x7f32f406c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:30.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- 172.21.15.67:0/1949379094 shutdown_connections 2024-09-19T05:49:30.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- 172.21.15.67:0/1949379094 wait complete. 2024-09-19T05:49:30.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 Processor -- start 2024-09-19T05:49:30.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- start start 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f406f810 0x7f32f4149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32f40d0bc0 0x7f32f40b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32f415b1a0 0x7f32f4138190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f32f40aeff0 con 0x7f32f406f810 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f32f406fbf0 con 0x7f32f40d0bc0 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f32f40af170 con 0x7f32f415b1a0 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f406f810 0x7f32f4149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f406f810 0x7f32f4149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50984/0 (socket says 172.21.15.67:50984) 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f2ffd640 1 -- 172.21.15.67:0/194290202 learned_addr learned my addr 172.21.15.67:0/194290202 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f27fc640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32f40d0bc0 0x7f32f40b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f37fe640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32f415b1a0 0x7f32f4138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f2ffd640 1 -- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32f415b1a0 msgr2=0x7f32f4138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f2ffd640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32f415b1a0 0x7f32f4138190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f2ffd640 1 -- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32f40d0bc0 msgr2=0x7f32f40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f2ffd640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32f40d0bc0 0x7f32f40b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f2ffd640 1 -- 172.21.15.67:0/194290202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f40b1410 con 0x7f32f406f810 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f27fc640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32f40d0bc0 0x7f32f40b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f2ffd640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f406f810 0x7f32f4149ad0 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 crypto rx=0x7f32e40ad040 tx=0x7f32e401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32db7fe640 1 -- 172.21.15.67:0/194290202 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e40bf610 con 0x7f32f406f810 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32db7fe640 1 -- 172.21.15.67:0/194290202 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e40bf7d0 con 0x7f32f406f810 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- 172.21.15.67:0/194290202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f40b16f0 con 0x7f32f406f810 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32db7fe640 1 -- 172.21.15.67:0/194290202 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e40bfbc0 con 0x7f32f406f810 2024-09-19T05:49:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.236+0000 7f32f9390640 1 -- 172.21.15.67:0/194290202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f40b1cb0 con 0x7f32f406f810 2024-09-19T05:49:30.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.240+0000 7f32f9390640 1 -- 172.21.15.67:0/194290202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f4071f90 con 0x7f32f406f810 2024-09-19T05:49:30.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.240+0000 7f32db7fe640 1 -- 172.21.15.67:0/194290202 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32e40bd020 con 0x7f32f406f810 2024-09-19T05:49:30.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.240+0000 7f32db7fe640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32e00678c0 0x7f32e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.240+0000 7f32db7fe640 1 -- 172.21.15.67:0/194290202 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7f32e4120590 con 0x7f32f406f810 2024-09-19T05:49:30.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.240+0000 7f32f27fc640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32e00678c0 0x7f32e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.240+0000 7f32f27fc640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32e00678c0 0x7f32e0069d80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f32f4158830 tx=0x7f32e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:30.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.244+0000 7f32db7fe640 1 -- 172.21.15.67:0/194290202 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f32e4016090 con 0x7f32f406f810 2024-09-19T05:49:30.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.436+0000 7f32f9390640 1 -- 172.21.15.67:0/194290202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32f406e950 con 0x7f32f406f810 2024-09-19T05:49:30.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.436+0000 7f32db7fe640 1 -- 172.21.15.67:0/194290202 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+5236 (secure 0 0 0) 0x7f32e40f0e40 con 0x7f32f406f810 2024-09-19T05:49:30.435 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:30.435 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":146,"btime":"2024-09-19T05:48:46:398467+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2335567881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2335567881},{"type":"v1","addr":"172.21.15.97:6837","nonce":2335567881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":8551,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1743099743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1743099743},{"type":"v1","addr":"172.21.15.97:6835","nonce":1743099743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":10839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/644096538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":644096538},{"type":"v1","addr":"172.21.15.67:6833","nonce":644096538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:48:42.753814+0000","modified":"2024-09-19T05:48:45.770434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10845":{"gid":10845,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1771202736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1771202736},{"type":"v1","addr":"172.21.15.67:6835","nonce":1771202736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10845,"qdb_cluster":[10845]},"id":14}]} 2024-09-19T05:49:30.435 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 146 2024-09-19T05:49:30.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 -- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32e00678c0 msgr2=0x7f32e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32e00678c0 0x7f32e0069d80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f32f4158830 tx=0x7f32e8009040 comp rx=0 tx=0).stop 2024-09-19T05:49:30.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 -- 172.21.15.67:0/194290202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f406f810 msgr2=0x7f32f4149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f406f810 0x7f32f4149ad0 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 crypto rx=0x7f32e40ad040 tx=0x7f32e401acb0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 -- 172.21.15.67:0/194290202 shutdown_connections 2024-09-19T05:49:30.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f32e00678c0 0x7f32e0069d80 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32f415b1a0 0x7f32f4138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32f40d0bc0 0x7f32f40b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 --2- 172.21.15.67:0/194290202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f406f810 0x7f32f4149ad0 unknown :-1 s=CLOSED pgs=2510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 -- 172.21.15.67:0/194290202 >> 172.21.15.67:0/194290202 conn(0x7f32f406c040 msgr2=0x7f32f40ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:30.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 -- 172.21.15.67:0/194290202 shutdown_connections 2024-09-19T05:49:30.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.440+0000 7f32f9390640 1 -- 172.21.15.67:0/194290202 wait complete. 2024-09-19T05:49:30.453 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:49:30.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a32688640 1 Processor -- start 2024-09-19T05:49:30.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a32688640 1 -- start start 2024-09-19T05:49:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a32688640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0a2c071e00 0x7f0a2c0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a32688640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a2c072250 con 0x7f0a2c0d09f0 2024-09-19T05:49:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a32688640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a2c06f770 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a32688640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0a2c0d0df0 con 0x7f0a2c071e00 2024-09-19T05:49:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a30c25640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0a2c0d09f0 0x7f0a2c165e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51298/0 (socket says 172.21.15.67:51298) 2024-09-19T05:49:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a30c25640 1 -- 172.21.15.67:0/839079151 learned_addr learned my addr 172.21.15.67:0/839079151 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a23fff640 1 --2- 172.21.15.67:0/839079151 >> v2:172.21.15.67:3300/0 conn(0x7f0a2c071e00 0x7f0a2c0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a2b7fe640 1 -- 172.21.15.67:0/839079151 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538348576 0 0) 0x7f0a2c072250 con 0x7f0a2c0d09f0 2024-09-19T05:49:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a2b7fe640 1 -- 172.21.15.67:0/839079151 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a18003530 con 0x7f0a2c0d09f0 2024-09-19T05:49:30.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a23fff640 1 -- 172.21.15.67:0/839079151 >> v1:172.21.15.97:6789/0 conn(0x7f0a2c15c0b0 legacy=0x7f0a2c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a23fff640 1 -- 172.21.15.67:0/839079151 >> v1:172.21.15.67:6789/0 conn(0x7f0a2c0d09f0 legacy=0x7f0a2c165e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a23fff640 1 -- 172.21.15.67:0/839079151 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2c15c8d0 con 0x7f0a2c071e00 2024-09-19T05:49:30.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.568+0000 7f0a23fff640 1 --2- 172.21.15.67:0/839079151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c071e00 0x7f0a2c0d04b0 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f0a140097c0 tx=0x7f0a1401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdb75a842a914ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:30.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a2b7fe640 1 -- 172.21.15.67:0/839079151 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a140a7070 con 0x7f0a2c071e00 2024-09-19T05:49:30.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a2b7fe640 1 -- 172.21.15.67:0/839079151 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a140b0070 con 0x7f0a2c071e00 2024-09-19T05:49:30.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a2b7fe640 1 -- 172.21.15.67:0/839079151 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a140ab890 con 0x7f0a2c071e00 2024-09-19T05:49:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- 172.21.15.67:0/839079151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c071e00 msgr2=0x7f0a2c0d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 --2- 172.21.15.67:0/839079151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c071e00 0x7f0a2c0d04b0 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f0a140097c0 tx=0x7f0a1401c470 comp rx=0 tx=0).stop 2024-09-19T05:49:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- 172.21.15.67:0/839079151 shutdown_connections 2024-09-19T05:49:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 --2- 172.21.15.67:0/839079151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c071e00 0x7f0a2c0d04b0 unknown :-1 s=CLOSED pgs=2512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- 172.21.15.67:0/839079151 >> 172.21.15.67:0/839079151 conn(0x7f0a2c06c040 msgr2=0x7f0a2c06c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- 172.21.15.67:0/839079151 shutdown_connections 2024-09-19T05:49:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- 172.21.15.67:0/839079151 wait complete. 2024-09-19T05:49:30.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 Processor -- start 2024-09-19T05:49:30.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- start start 2024-09-19T05:49:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a2c071e00 0x7f0a2c09db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a2c0d09f0 0x7f0a2c154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c15c0b0 0x7f0a2c099930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2c0ad7d0 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2c15d450 con 0x7f0a2c0d09f0 2024-09-19T05:49:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2c15c490 con 0x7f0a2c071e00 2024-09-19T05:49:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a30c25640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c15c0b0 0x7f0a2c099930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a30c25640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c15c0b0 0x7f0a2c099930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51006/0 (socket says 172.21.15.67:51006) 2024-09-19T05:49:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a30c25640 1 -- 172.21.15.67:0/3402864364 learned_addr learned my addr 172.21.15.67:0/3402864364 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a23fff640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a2c0d09f0 0x7f0a2c154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a30c25640 1 -- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a2c071e00 msgr2=0x7f0a2c09db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a30c25640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a2c071e00 0x7f0a2c09db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a30c25640 1 -- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a2c0d09f0 msgr2=0x7f0a2c154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a30c25640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a2c0d09f0 0x7f0a2c154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a30c25640 1 -- 172.21.15.67:0/3402864364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2c1456c0 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a30c25640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c15c0b0 0x7f0a2c099930 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f0a2400cb40 tx=0x7f0a2400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a297fa640 1 -- 172.21.15.67:0/3402864364 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24017070 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a297fa640 1 -- 172.21.15.67:0/3402864364 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2400aca0 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- 172.21.15.67:0/3402864364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2c142fc0 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a297fa640 1 -- 172.21.15.67:0/3402864364 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24012620 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.572+0000 7f0a32688640 1 -- 172.21.15.67:0/3402864364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2c143260 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.576+0000 7f0a32688640 1 -- 172.21.15.67:0/3402864364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a2c0d04b0 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.576+0000 7f0a297fa640 1 -- 172.21.15.67:0/3402864364 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a2401a070 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.576+0000 7f0a297fa640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a0c0678c0 0x7f0a0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.576+0000 7f0a297fa640 1 -- 172.21.15.67:0/3402864364 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7f0a24085bf0 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.576+0000 7f0a2bfff640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a0c0678c0 0x7f0a0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.576+0000 7f0a2bfff640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a0c0678c0 0x7f0a0c069d80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c000f70 tx=0x7f0a1c0079c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.580+0000 7f0a297fa640 1 -- 172.21.15.67:0/3402864364 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0a2c1456c0 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.740+0000 7f0a32688640 1 -- 172.21.15.67:0/3402864364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a2c0b1950 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a297fa640 1 -- 172.21.15.67:0/3402864364 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v207) ==== 74+0+17105 (secure 0 0 0) 0x7f0a240565c0 con 0x7f0a2c15c0b0 2024-09-19T05:49:30.741 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:30.741 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":207,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:49:00.276114+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:48:40.426332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-19T05:48:41.753955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.0","mappings":[{"from":6,"to":0}]},{"pgid":"29.16","mappings":[{"from":6,"to":0}]},{"pgid":"29.19","mappings":[{"from":6,"to":0}]},{"pgid":"29.1d","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:49:30.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 -- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a0c0678c0 msgr2=0x7f0a0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a0c0678c0 0x7f0a0c069d80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c000f70 tx=0x7f0a1c0079c0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 -- 172.21.15.67:0/3402864364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c15c0b0 msgr2=0x7f0a2c099930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c15c0b0 0x7f0a2c099930 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f0a2400cb40 tx=0x7f0a2400a060 comp rx=0 tx=0).stop 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 -- 172.21.15.67:0/3402864364 shutdown_connections 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a2c15c0b0 0x7f0a2c099930 unknown :-1 s=CLOSED pgs=2513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a2c0d09f0 0x7f0a2c154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0a0c0678c0 0x7f0a0c069d80 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 --2- 172.21.15.67:0/3402864364 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a2c071e00 0x7f0a2c09db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 -- 172.21.15.67:0/3402864364 >> 172.21.15.67:0/3402864364 conn(0x7f0a2c06c040 msgr2=0x7f0a2c0b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 -- 172.21.15.67:0/3402864364 shutdown_connections 2024-09-19T05:49:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.744+0000 7f0a32688640 1 -- 172.21.15.67:0/3402864364 wait complete. 2024-09-19T05:49:30.760 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:49:30.760 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:49:30.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e1d776640 1 Processor -- start 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e1d776640 1 -- start start 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e1d776640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815b1a0 0x7f0e1806f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e1d776640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0e180adc60 0x7f0e180d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e1d776640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e18073110 con 0x7f0e180ae0a0 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e1d776640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0e180733f0 con 0x7f0e180adc60 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e1d776640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0e180736d0 con 0x7f0e1815b1a0 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e0ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0e180adc60 0x7f0e180d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e177fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0e180ae0a0 0x7f0e180b3730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51302/0 (socket says 172.21.15.67:51302) 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e177fe640 1 -- 172.21.15.67:0/582590513 learned_addr learned my addr 172.21.15.67:0/582590513 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e16ffd640 1 --2- 172.21.15.67:0/582590513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815b1a0 0x7f0e1806f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e0ffff640 1 -- 172.21.15.67:0/582590513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815b1a0 msgr2=0x7f0e1806f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e0ffff640 1 --2- 172.21.15.67:0/582590513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815b1a0 0x7f0e1806f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e0ffff640 1 -- 172.21.15.67:0/582590513 >> v1:172.21.15.67:6789/0 conn(0x7f0e180ae0a0 legacy=0x7f0e180b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e167fc640 1 -- 172.21.15.67:0/582590513 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584791070 0 0) 0x7f0e18073110 con 0x7f0e180ae0a0 2024-09-19T05:49:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.888+0000 7f0e0ffff640 1 -- 172.21.15.67:0/582590513 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e180b3210 con 0x7f0e180adc60 2024-09-19T05:49:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e0ffff640 1 --2- 172.21.15.67:0/582590513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e180adc60 0x7f0e180d05e0 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7f0e000097c0 tx=0x7f0e0001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ecfb71a52cc098 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:30.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e167fc640 1 -- 172.21.15.67:0/582590513 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000b0070 con 0x7f0e180adc60 2024-09-19T05:49:30.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e167fc640 1 -- 172.21.15.67:0/582590513 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e000ab600 con 0x7f0e180adc60 2024-09-19T05:49:30.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e167fc640 1 -- 172.21.15.67:0/582590513 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000ab9d0 con 0x7f0e180adc60 2024-09-19T05:49:30.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 -- 172.21.15.67:0/582590513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e180adc60 msgr2=0x7f0e180d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 --2- 172.21.15.67:0/582590513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e180adc60 0x7f0e180d05e0 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7f0e000097c0 tx=0x7f0e0001c380 comp rx=0 tx=0).stop 2024-09-19T05:49:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 -- 172.21.15.67:0/582590513 shutdown_connections 2024-09-19T05:49:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 --2- 172.21.15.67:0/582590513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e180adc60 0x7f0e180d05e0 unknown :-1 s=CLOSED pgs=2515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 --2- 172.21.15.67:0/582590513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1815b1a0 0x7f0e1806f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 -- 172.21.15.67:0/582590513 >> 172.21.15.67:0/582590513 conn(0x7f0e1806c040 msgr2=0x7f0e1806c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 -- 172.21.15.67:0/582590513 shutdown_connections 2024-09-19T05:49:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 -- 172.21.15.67:0/582590513 wait complete. 2024-09-19T05:49:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 Processor -- start 2024-09-19T05:49:30.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 -- start start 2024-09-19T05:49:30.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180adc60 0x7f0e1809a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e180ae0a0 0x7f0e18155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e1815b1a0 0x7f0e18156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0e18072600 con 0x7f0e1815b1a0 2024-09-19T05:49:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0e18072480 con 0x7f0e180ae0a0 2024-09-19T05:49:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e1d776640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f0e18166500 con 0x7f0e180adc60 2024-09-19T05:49:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e177fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e1815b1a0 0x7f0e18156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e177fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e1815b1a0 0x7f0e18156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51014/0 (socket says 172.21.15.67:51014) 2024-09-19T05:49:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e177fe640 1 -- 172.21.15.67:0/1132860706 learned_addr learned my addr 172.21.15.67:0/1132860706 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e16ffd640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180adc60 0x7f0e1809a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e0ffff640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e180ae0a0 0x7f0e18155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e177fe640 1 -- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180adc60 msgr2=0x7f0e1809a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e177fe640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180adc60 0x7f0e1809a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e177fe640 1 -- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e180ae0a0 msgr2=0x7f0e18155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e177fe640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e180ae0a0 0x7f0e18155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e177fe640 1 -- 172.21.15.67:0/1132860706 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e18154b20 con 0x7f0e1815b1a0 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e16ffd640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180adc60 0x7f0e1809a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e177fe640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e1815b1a0 0x7f0e18156100 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000c7a0 tx=0x7f0e1000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.892+0000 7f0e0f7fe640 1 -- 172.21.15.67:0/1132860706 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10018070 con 0x7f0e1815b1a0 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.896+0000 7f0e0f7fe640 1 -- 172.21.15.67:0/1132860706 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1000a640 con 0x7f0e1815b1a0 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.896+0000 7f0e1d776640 1 -- 172.21.15.67:0/1132860706 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e18154e00 con 0x7f0e1815b1a0 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.896+0000 7f0e0f7fe640 1 -- 172.21.15.67:0/1132860706 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000aab0 con 0x7f0e1815b1a0 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.896+0000 7f0e1d776640 1 -- 172.21.15.67:0/1132860706 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e181553c0 con 0x7f0e1815b1a0 2024-09-19T05:49:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.896+0000 7f0e1d776640 1 -- 172.21.15.67:0/1132860706 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e18166960 con 0x7f0e1815b1a0 2024-09-19T05:49:30.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.896+0000 7f0e0f7fe640 1 -- 172.21.15.67:0/1132860706 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e1001b070 con 0x7f0e1815b1a0 2024-09-19T05:49:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.896+0000 7f0e0f7fe640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0df80678f0 0x7f0df8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.896+0000 7f0e0f7fe640 1 -- 172.21.15.67:0/1132860706 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7f0e100853a0 con 0x7f0e1815b1a0 2024-09-19T05:49:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.896+0000 7f0e16ffd640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0df80678f0 0x7f0df8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.896+0000 7f0e16ffd640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0df80678f0 0x7f0df8069db0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0e180d0600 tx=0x7f0e08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:30.900+0000 7f0e0f7fe640 1 -- 172.21.15.67:0/1132860706 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0e10055d70 con 0x7f0e1815b1a0 2024-09-19T05:49:31.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.092+0000 7f0e1d776640 1 -- 172.21.15.67:0/1132860706 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e1815e900 con 0x7f0e1815b1a0 2024-09-19T05:49:31.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.092+0000 7f0e0f7fe640 1 -- 172.21.15.67:0/1132860706 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+5236 (secure 0 0 0) 0x7f0e10055670 con 0x7f0e1815b1a0 2024-09-19T05:49:31.091 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:31.091 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":146,"btime":"2024-09-19T05:48:46:398467+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2335567881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2335567881},{"type":"v1","addr":"172.21.15.97:6837","nonce":2335567881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":8551,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1743099743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1743099743},{"type":"v1","addr":"172.21.15.97:6835","nonce":1743099743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":10839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/644096538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":644096538},{"type":"v1","addr":"172.21.15.67:6833","nonce":644096538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:48:42.753814+0000","modified":"2024-09-19T05:48:45.770434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10845":{"gid":10845,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1771202736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1771202736},{"type":"v1","addr":"172.21.15.67:6835","nonce":1771202736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10845,"qdb_cluster":[10845]},"id":14}]} 2024-09-19T05:49:31.091 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 146 2024-09-19T05:49:31.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 -- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0df80678f0 msgr2=0x7f0df8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0df80678f0 0x7f0df8069db0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0e180d0600 tx=0x7f0e08008040 comp rx=0 tx=0).stop 2024-09-19T05:49:31.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 -- 172.21.15.67:0/1132860706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e1815b1a0 msgr2=0x7f0e18156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e1815b1a0 0x7f0e18156100 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000c7a0 tx=0x7f0e1000cc60 comp rx=0 tx=0).stop 2024-09-19T05:49:31.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 -- 172.21.15.67:0/1132860706 shutdown_connections 2024-09-19T05:49:31.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e1815b1a0 0x7f0e18156100 unknown :-1 s=CLOSED pgs=2516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e180ae0a0 0x7f0e18155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f0df80678f0 0x7f0df8069db0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 --2- 172.21.15.67:0/1132860706 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e180adc60 0x7f0e1809a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 -- 172.21.15.67:0/1132860706 >> 172.21.15.67:0/1132860706 conn(0x7f0e1806c040 msgr2=0x7f0e1806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:31.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 -- 172.21.15.67:0/1132860706 shutdown_connections 2024-09-19T05:49:31.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.096+0000 7f0e1d776640 1 -- 172.21.15.67:0/1132860706 wait complete. 2024-09-19T05:49:31.109 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:49:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa64089e640 1 Processor -- start 2024-09-19T05:49:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa64089e640 1 -- start start 2024-09-19T05:49:31.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa64089e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa63c161930 0x7fa63c0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa64089e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa63c06d720 0x7fa63c161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa64089e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa63c06dcb0 con 0x7fa63c0b2150 2024-09-19T05:49:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa64089e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa63c06df90 con 0x7fa63c06d720 2024-09-19T05:49:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa64089e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa63c0d0890 con 0x7fa63c161930 2024-09-19T05:49:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa63ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa63c06d720 0x7fa63c161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa63ad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa63c06d720 0x7fa63c161ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51030/0 (socket says 172.21.15.67:51030) 2024-09-19T05:49:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa63ad9d640 1 -- 172.21.15.67:0/4076643268 learned_addr learned my addr 172.21.15.67:0/4076643268 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:31.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa63a59c640 1 --2- 172.21.15.67:0/4076643268 >> v2:172.21.15.97:3300/0 conn(0x7fa63c161930 0x7fa63c0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa63ad9d640 1 -- 172.21.15.67:0/4076643268 >> v2:172.21.15.97:3300/0 conn(0x7fa63c161930 msgr2=0x7fa63c0b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa63ad9d640 1 --2- 172.21.15.67:0/4076643268 >> v2:172.21.15.97:3300/0 conn(0x7fa63c161930 0x7fa63c0b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa63ad9d640 1 -- 172.21.15.67:0/4076643268 >> v1:172.21.15.97:6789/0 conn(0x7fa63c0b2150 legacy=0x7fa63c0d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.224+0000 7fa63ad9d640 1 -- 172.21.15.67:0/4076643268 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63c0d0b70 con 0x7fa63c06d720 2024-09-19T05:49:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63ad9d640 1 --2- 172.21.15.67:0/4076643268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 0x7fa63c161ec0 secure :-1 s=READY pgs=2517 cs=0 l=1 rev1=1 crypto rx=0x7fa63c073550 tx=0x7fa63401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4814ff6894c59e3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63959a640 1 -- 172.21.15.67:0/4076643268 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6340b0070 con 0x7fa63c06d720 2024-09-19T05:49:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63959a640 1 -- 172.21.15.67:0/4076643268 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6340ab600 con 0x7fa63c06d720 2024-09-19T05:49:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63959a640 1 -- 172.21.15.67:0/4076643268 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6340ab9d0 con 0x7fa63c06d720 2024-09-19T05:49:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 -- 172.21.15.67:0/4076643268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 msgr2=0x7fa63c161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 --2- 172.21.15.67:0/4076643268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 0x7fa63c161ec0 secure :-1 s=READY pgs=2517 cs=0 l=1 rev1=1 crypto rx=0x7fa63c073550 tx=0x7fa63401c520 comp rx=0 tx=0).stop 2024-09-19T05:49:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 -- 172.21.15.67:0/4076643268 shutdown_connections 2024-09-19T05:49:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 --2- 172.21.15.67:0/4076643268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 0x7fa63c161ec0 unknown :-1 s=CLOSED pgs=2517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 --2- 172.21.15.67:0/4076643268 >> v2:172.21.15.97:3300/0 conn(0x7fa63c161930 0x7fa63c0b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 -- 172.21.15.67:0/4076643268 >> 172.21.15.67:0/4076643268 conn(0x7fa63c0b3da0 msgr2=0x7fa63c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:31.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 -- 172.21.15.67:0/4076643268 shutdown_connections 2024-09-19T05:49:31.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 -- 172.21.15.67:0/4076643268 wait complete. 2024-09-19T05:49:31.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 Processor -- start 2024-09-19T05:49:31.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 -- start start 2024-09-19T05:49:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 0x7fa63c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa63c0b2150 0x7fa63c151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa63c161930 0x7fa63c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c16b3e0 con 0x7fa63c06d720 2024-09-19T05:49:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c16b260 con 0x7fa63c0b2150 2024-09-19T05:49:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa63c16b560 con 0x7fa63c161930 2024-09-19T05:49:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 0x7fa63c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 0x7fa63c15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51046/0 (socket says 172.21.15.67:51046) 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63a59c640 1 -- 172.21.15.67:0/2032616069 learned_addr learned my addr 172.21.15.67:0/2032616069 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63a59c640 1 -- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa63c161930 msgr2=0x7fa63c15d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63a59c640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa63c161930 0x7fa63c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63a59c640 1 -- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa63c0b2150 msgr2=0x7fa63c151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa639d9b640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa63c0b2150 0x7fa63c151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63a59c640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa63c0b2150 0x7fa63c151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63a59c640 1 -- 172.21.15.67:0/2032616069 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63c15a010 con 0x7fa63c06d720 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa63a59c640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 0x7fa63c15f1a0 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7fa63000e8a0 tx=0x7fa63000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa62affd640 1 -- 172.21.15.67:0/2032616069 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630017070 con 0x7fa63c06d720 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa62affd640 1 -- 172.21.15.67:0/2032616069 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63000c940 con 0x7fa63c06d720 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa64089e640 1 -- 172.21.15.67:0/2032616069 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa63c15f8f0 con 0x7fa63c06d720 2024-09-19T05:49:31.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.228+0000 7fa62affd640 1 -- 172.21.15.67:0/2032616069 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63000ccf0 con 0x7fa63c06d720 2024-09-19T05:49:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.232+0000 7fa64089e640 1 -- 172.21.15.67:0/2032616069 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa63c15feb0 con 0x7fa63c06d720 2024-09-19T05:49:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.232+0000 7fa64089e640 1 -- 172.21.15.67:0/2032616069 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63c161ec0 con 0x7fa63c06d720 2024-09-19T05:49:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.232+0000 7fa62affd640 1 -- 172.21.15.67:0/2032616069 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa63001a070 con 0x7fa63c06d720 2024-09-19T05:49:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.232+0000 7fa62affd640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa61c0678c0 0x7fa61c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.232+0000 7fa62affd640 1 -- 172.21.15.67:0/2032616069 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7fa630085db0 con 0x7fa63c06d720 2024-09-19T05:49:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.232+0000 7fa639d9b640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa61c0678c0 0x7fa61c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.232+0000 7fa639d9b640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa61c0678c0 0x7fa61c069d80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa63c1faf00 tx=0x7fa62c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:31.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.236+0000 7fa62affd640 1 -- 172.21.15.67:0/2032616069 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa6300566d0 con 0x7fa63c06d720 2024-09-19T05:49:31.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.436+0000 7fa64089e640 1 -- 172.21.15.67:0/2032616069 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa63c075200 con 0x7fa63c06d720 2024-09-19T05:49:31.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.436+0000 7fa62affd640 1 -- 172.21.15.67:0/2032616069 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+5236 (secure 0 0 0) 0x7fa630055fd0 con 0x7fa63c06d720 2024-09-19T05:49:31.436 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:31.436 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":146,"btime":"2024-09-19T05:48:46:398467+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2335567881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2335567881},{"type":"v1","addr":"172.21.15.97:6837","nonce":2335567881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":8551,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1743099743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1743099743},{"type":"v1","addr":"172.21.15.97:6835","nonce":1743099743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":10839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/644096538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":644096538},{"type":"v1","addr":"172.21.15.67:6833","nonce":644096538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:48:42.753814+0000","modified":"2024-09-19T05:48:45.770434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10845":{"gid":10845,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/1771202736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1771202736},{"type":"v1","addr":"172.21.15.67:6835","nonce":1771202736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10845,"qdb_cluster":[10845]},"id":14}]} 2024-09-19T05:49:31.436 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 146 2024-09-19T05:49:31.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 -- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa61c0678c0 msgr2=0x7fa61c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa61c0678c0 0x7fa61c069d80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa63c1faf00 tx=0x7fa62c009040 comp rx=0 tx=0).stop 2024-09-19T05:49:31.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 -- 172.21.15.67:0/2032616069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 msgr2=0x7fa63c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 0x7fa63c15f1a0 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7fa63000e8a0 tx=0x7fa63000eca0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 -- 172.21.15.67:0/2032616069 shutdown_connections 2024-09-19T05:49:31.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa61c0678c0 0x7fa61c069d80 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa63c161930 0x7fa63c15d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa63c0b2150 0x7fa63c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 --2- 172.21.15.67:0/2032616069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa63c06d720 0x7fa63c15f1a0 unknown :-1 s=CLOSED pgs=2518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 -- 172.21.15.67:0/2032616069 >> 172.21.15.67:0/2032616069 conn(0x7fa63c0b3da0 msgr2=0x7fa63c071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:31.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 -- 172.21.15.67:0/2032616069 shutdown_connections 2024-09-19T05:49:31.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.440+0000 7fa64089e640 1 -- 172.21.15.67:0/2032616069 wait complete. 2024-09-19T05:49:31.454 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:49:31.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.572+0000 7f01a85f3640 1 Processor -- start 2024-09-19T05:49:31.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.572+0000 7f01a85f3640 1 -- start start 2024-09-19T05:49:31.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f01a00ae000 0x7f01a01628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae960 0x7f01a006e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f01a00ae3e0 0x7f01a006ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f01a00b05d0 con 0x7f01a00ae3e0 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f01a0162e10 con 0x7f01a00ae000 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f01a00af530 con 0x7f01a00ae960 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a6b90640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f01a00ae3e0 0x7f01a006ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a6b90640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f01a00ae3e0 0x7f01a006ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51054/0 (socket says 172.21.15.67:51054) 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a6b90640 1 -- 172.21.15.67:0/3355273211 learned_addr learned my addr 172.21.15.67:0/3355273211 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a638f640 1 --2- 172.21.15.67:0/3355273211 >> v2:172.21.15.97:3300/0 conn(0x7f01a00ae000 0x7f01a01628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a5b8e640 1 --2- 172.21.15.67:0/3355273211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae960 0x7f01a006e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a6b90640 1 -- 172.21.15.67:0/3355273211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae960 msgr2=0x7f01a006e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a6b90640 1 --2- 172.21.15.67:0/3355273211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae960 0x7f01a006e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a6b90640 1 -- 172.21.15.67:0/3355273211 >> v2:172.21.15.97:3300/0 conn(0x7f01a00ae000 msgr2=0x7f01a01628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a6b90640 1 --2- 172.21.15.67:0/3355273211 >> v2:172.21.15.97:3300/0 conn(0x7f01a00ae000 0x7f01a01628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a6b90640 1 -- 172.21.15.67:0/3355273211 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a00af810 con 0x7f01a00ae3e0 2024-09-19T05:49:31.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a5b8e640 1 --2- 172.21.15.67:0/3355273211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae960 0x7f01a006e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:31.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a638f640 1 --2- 172.21.15.67:0/3355273211 >> v2:172.21.15.97:3300/0 conn(0x7f01a00ae000 0x7f01a01628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a6b90640 1 --2- 172.21.15.67:0/3355273211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 0x7f01a006ec90 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7f01a0071290 tx=0x7f019801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f27c2e6fa6c7c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a538d640 1 -- 172.21.15.67:0/3355273211 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01980a55b0 con 0x7f01a00ae3e0 2024-09-19T05:49:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a538d640 1 -- 172.21.15.67:0/3355273211 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01980a5750 con 0x7f01a00ae3e0 2024-09-19T05:49:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a538d640 1 -- 172.21.15.67:0/3355273211 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01980a5b20 con 0x7f01a00ae3e0 2024-09-19T05:49:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 -- 172.21.15.67:0/3355273211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 msgr2=0x7f01a006ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 --2- 172.21.15.67:0/3355273211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 0x7f01a006ec90 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7f01a0071290 tx=0x7f019801c930 comp rx=0 tx=0).stop 2024-09-19T05:49:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 -- 172.21.15.67:0/3355273211 shutdown_connections 2024-09-19T05:49:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 --2- 172.21.15.67:0/3355273211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 0x7f01a006ec90 unknown :-1 s=CLOSED pgs=2519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 --2- 172.21.15.67:0/3355273211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae960 0x7f01a006e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 --2- 172.21.15.67:0/3355273211 >> v2:172.21.15.97:3300/0 conn(0x7f01a00ae000 0x7f01a01628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 -- 172.21.15.67:0/3355273211 >> 172.21.15.67:0/3355273211 conn(0x7f01a006bc40 msgr2=0x7f01a006c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:31.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 -- 172.21.15.67:0/3355273211 shutdown_connections 2024-09-19T05:49:31.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.576+0000 7f01a85f3640 1 -- 172.21.15.67:0/3355273211 wait complete. 2024-09-19T05:49:31.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 Processor -- start 2024-09-19T05:49:31.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 -- start start 2024-09-19T05:49:31.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae000 0x7f01a015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 0x7f01a0151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01a00ae960 0x7f01a015c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f01a015e3f0 con 0x7f01a00ae3e0 2024-09-19T05:49:31.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f01a015e270 con 0x7f01a00ae960 2024-09-19T05:49:31.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f01a015e570 con 0x7f01a00ae000 2024-09-19T05:49:31.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a5b8e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 0x7f01a0151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a5b8e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 0x7f01a0151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51062/0 (socket says 172.21.15.67:51062) 2024-09-19T05:49:31.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a5b8e640 1 -- 172.21.15.67:0/2022298529 learned_addr learned my addr 172.21.15.67:0/2022298529 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:31.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a6b90640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01a00ae960 0x7f01a015c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a638f640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae000 0x7f01a015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a5b8e640 1 -- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae000 msgr2=0x7f01a015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a5b8e640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae000 0x7f01a015d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a5b8e640 1 -- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01a00ae960 msgr2=0x7f01a015c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a5b8e640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01a00ae960 0x7f01a015c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a5b8e640 1 -- 172.21.15.67:0/2022298529 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a015bc80 con 0x7f01a00ae3e0 2024-09-19T05:49:31.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a5b8e640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 0x7f01a0151da0 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7f019c00c7f0 tx=0x7f019c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:31.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f0192ffd640 1 -- 172.21.15.67:0/2022298529 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c015070 con 0x7f01a00ae3e0 2024-09-19T05:49:31.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f0192ffd640 1 -- 172.21.15.67:0/2022298529 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c007820 con 0x7f01a00ae3e0 2024-09-19T05:49:31.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 -- 172.21.15.67:0/2022298529 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a015dce0 con 0x7f01a00ae3e0 2024-09-19T05:49:31.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f0192ffd640 1 -- 172.21.15.67:0/2022298529 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c007bd0 con 0x7f01a00ae3e0 2024-09-19T05:49:31.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 -- 172.21.15.67:0/2022298529 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a015bf20 con 0x7f01a00ae3e0 2024-09-19T05:49:31.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.580+0000 7f01a85f3640 1 -- 172.21.15.67:0/2022298529 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a01628b0 con 0x7f01a00ae3e0 2024-09-19T05:49:31.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.584+0000 7f0192ffd640 1 -- 172.21.15.67:0/2022298529 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f019c018070 con 0x7f01a00ae3e0 2024-09-19T05:49:31.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.584+0000 7f0192ffd640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f01840678c0 0x7f0184069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.584+0000 7f0192ffd640 1 -- 172.21.15.67:0/2022298529 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7f019c085ee0 con 0x7f01a00ae3e0 2024-09-19T05:49:31.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.584+0000 7f01a638f640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f01840678c0 0x7f0184069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.584+0000 7f01a638f640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f01840678c0 0x7f0184069d80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0194006fd0 tx=0x7f0194008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:31.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.588+0000 7f0192ffd640 1 -- 172.21.15.67:0/2022298529 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f019c056820 con 0x7f01a00ae3e0 2024-09-19T05:49:31.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.748+0000 7f01a85f3640 1 -- 172.21.15.67:0/2022298529 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01a01522e0 con 0x7f01a00ae3e0 2024-09-19T05:49:31.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f0192ffd640 1 -- 172.21.15.67:0/2022298529 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v207) ==== 74+0+17105 (secure 0 0 0) 0x7f019c056120 con 0x7f01a00ae3e0 2024-09-19T05:49:31.748 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:31.749 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":207,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:49:00.276114+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:48:40.426332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-19T05:48:41.753955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.0","mappings":[{"from":6,"to":0}]},{"pgid":"29.16","mappings":[{"from":6,"to":0}]},{"pgid":"29.19","mappings":[{"from":6,"to":0}]},{"pgid":"29.1d","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:49:31.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 -- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f01840678c0 msgr2=0x7f0184069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f01840678c0 0x7f0184069d80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0194006fd0 tx=0x7f0194008040 comp rx=0 tx=0).stop 2024-09-19T05:49:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 -- 172.21.15.67:0/2022298529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 msgr2=0x7f01a0151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 0x7f01a0151da0 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7f019c00c7f0 tx=0x7f019c00ccb0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 -- 172.21.15.67:0/2022298529 shutdown_connections 2024-09-19T05:49:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01a00ae960 0x7f01a015c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01a00ae3e0 0x7f01a0151da0 unknown :-1 s=CLOSED pgs=2520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f01840678c0 0x7f0184069d80 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 --2- 172.21.15.67:0/2022298529 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a00ae000 0x7f01a015d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 -- 172.21.15.67:0/2022298529 >> 172.21.15.67:0/2022298529 conn(0x7f01a006bc40 msgr2=0x7f01a006e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:31.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 -- 172.21.15.67:0/2022298529 shutdown_connections 2024-09-19T05:49:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.752+0000 7f01a85f3640 1 -- 172.21.15.67:0/2022298529 wait complete. 2024-09-19T05:49:31.767 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:49:31.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.892+0000 7f677f573640 1 Processor -- start 2024-09-19T05:49:31.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.892+0000 7f677f573640 1 -- start start 2024-09-19T05:49:31.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677f573640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 0x7f67780d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677f573640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f67780b13f0 0x7f67780b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677f573640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67780d5390 con 0x7f67780cf540 2024-09-19T05:49:31.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677f573640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f67780cf280 con 0x7f67780b13f0 2024-09-19T05:49:31.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677f573640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f67780d5130 con 0x7f67780cee40 2024-09-19T05:49:31.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677cb0e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 0x7f67780d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677cb0e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 0x7f67780d4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:55216/0 (socket says 172.21.15.67:55216) 2024-09-19T05:49:31.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677cb0e640 1 -- 172.21.15.67:0/2823642196 learned_addr learned my addr 172.21.15.67:0/2823642196 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:31.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677db10640 1 --2- 172.21.15.67:0/2823642196 >> v2:172.21.15.97:3300/0 conn(0x7f67780b13f0 0x7f67780b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f676ffff640 1 -- 172.21.15.67:0/2823642196 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3629150090 0 0) 0x7f67780d5390 con 0x7f67780cf540 2024-09-19T05:49:31.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f676ffff640 1 -- 172.21.15.67:0/2823642196 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6764003530 con 0x7f67780cf540 2024-09-19T05:49:31.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677cb0e640 1 -- 172.21.15.67:0/2823642196 >> v2:172.21.15.97:3300/0 conn(0x7f67780b13f0 msgr2=0x7f67780b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:31.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677cb0e640 1 --2- 172.21.15.67:0/2823642196 >> v2:172.21.15.97:3300/0 conn(0x7f67780b13f0 0x7f67780b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677cb0e640 1 -- 172.21.15.67:0/2823642196 >> v1:172.21.15.97:6789/0 conn(0x7f67780cf540 legacy=0x7f67780cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.896+0000 7f677cb0e640 1 -- 172.21.15.67:0/2823642196 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67780d3190 con 0x7f67780cee40 2024-09-19T05:49:31.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677cb0e640 1 --2- 172.21.15.67:0/2823642196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 0x7f67780d4bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6768006fd0 tx=0x7f676801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c596282873f7b05f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:31.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f676ffff640 1 -- 172.21.15.67:0/2823642196 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67680b0070 con 0x7f67780cee40 2024-09-19T05:49:31.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f676ffff640 1 -- 172.21.15.67:0/2823642196 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67680ab600 con 0x7f67780cee40 2024-09-19T05:49:31.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f676ffff640 1 -- 172.21.15.67:0/2823642196 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67680ab9b0 con 0x7f67780cee40 2024-09-19T05:49:31.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- 172.21.15.67:0/2823642196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 msgr2=0x7f67780d4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 --2- 172.21.15.67:0/2823642196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 0x7f67780d4bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6768006fd0 tx=0x7f676801c4b0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- 172.21.15.67:0/2823642196 shutdown_connections 2024-09-19T05:49:31.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 --2- 172.21.15.67:0/2823642196 >> v2:172.21.15.97:3300/0 conn(0x7f67780b13f0 0x7f67780b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 --2- 172.21.15.67:0/2823642196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 0x7f67780d4bf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- 172.21.15.67:0/2823642196 >> 172.21.15.67:0/2823642196 conn(0x7f677808bff0 msgr2=0x7f67780d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:31.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- 172.21.15.67:0/2823642196 shutdown_connections 2024-09-19T05:49:31.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- 172.21.15.67:0/2823642196 wait complete. 2024-09-19T05:49:31.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 Processor -- start 2024-09-19T05:49:31.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- start start 2024-09-19T05:49:31.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67780b13f0 0x7f67780b9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 0x7f67780c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67780cf540 0x7f6778157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f677816b6a0 con 0x7f67780cf540 2024-09-19T05:49:31.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f677816b520 con 0x7f67780b13f0 2024-09-19T05:49:31.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f677816b820 con 0x7f67780cee40 2024-09-19T05:49:31.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677db10640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67780cf540 0x7f6778157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677db10640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67780cf540 0x7f6778157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51068/0 (socket says 172.21.15.67:51068) 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677db10640 1 -- 172.21.15.67:0/11285460 learned_addr learned my addr 172.21.15.67:0/11285460 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677d30f640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67780b13f0 0x7f67780b9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677cb0e640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 0x7f67780c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677db10640 1 -- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 msgr2=0x7f67780c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677db10640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 0x7f67780c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677db10640 1 -- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67780b13f0 msgr2=0x7f67780b9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677db10640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67780b13f0 0x7f67780b9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677db10640 1 -- 172.21.15.67:0/11285460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67780c9430 con 0x7f67780cf540 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677db10640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67780cf540 0x7f6778157dd0 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7f677000ec10 tx=0x7f677000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f676dffb640 1 -- 172.21.15.67:0/11285460 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770018020 con 0x7f67780cf540 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f676dffb640 1 -- 172.21.15.67:0/11285460 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677000cd20 con 0x7f67780cf540 2024-09-19T05:49:31.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- 172.21.15.67:0/11285460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67780c9710 con 0x7f67780cf540 2024-09-19T05:49:31.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f676dffb640 1 -- 172.21.15.67:0/11285460 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67700146c0 con 0x7f67780cf540 2024-09-19T05:49:31.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.900+0000 7f677f573640 1 -- 172.21.15.67:0/11285460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67780c9cd0 con 0x7f67780cf540 2024-09-19T05:49:31.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.904+0000 7f677f573640 1 -- 172.21.15.67:0/11285460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67780d4bf0 con 0x7f67780cf540 2024-09-19T05:49:31.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.904+0000 7f676dffb640 1 -- 172.21.15.67:0/11285460 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f677001b020 con 0x7f67780cf540 2024-09-19T05:49:31.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.904+0000 7f676dffb640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f675c0678c0 0x7f675c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:31.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.904+0000 7f676dffb640 1 -- 172.21.15.67:0/11285460 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6217+0+0 (secure 0 0 0) 0x7f6770086da0 con 0x7f67780cf540 2024-09-19T05:49:31.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.904+0000 7f677d30f640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f675c0678c0 0x7f675c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:31.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.904+0000 7f677d30f640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f675c0678c0 0x7f675c069d80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6774007fd0 tx=0x7f6774009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:31.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:31.908+0000 7f676dffb640 1 -- 172.21.15.67:0/11285460 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f6770022030 con 0x7f67780cf540 2024-09-19T05:49:32.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.104+0000 7f677f573640 1 -- 172.21.15.67:0/11285460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f67780ce8a0 con 0x7f67780cf540 2024-09-19T05:49:32.102 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-09-19T05:49:32.104+0000 7fcbef45a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:49:32.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f676dffb640 1 -- 172.21.15.67:0/11285460 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v147) ==== 161+0+0 (secure 0 0 0) 0x7f6770010040 con 0x7f67780cf540 2024-09-19T05:49:32.104 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:49:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f677f573640 1 -- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f675c0678c0 msgr2=0x7f675c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f677f573640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f675c0678c0 0x7f675c069d80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6774007fd0 tx=0x7f6774009040 comp rx=0 tx=0).stop 2024-09-19T05:49:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f677f573640 1 -- 172.21.15.67:0/11285460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67780cf540 msgr2=0x7f6778157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:32.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f677f573640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67780cf540 0x7f6778157dd0 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7f677000ec10 tx=0x7f677000c490 comp rx=0 tx=0).stop 2024-09-19T05:49:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f677f573640 1 -- 172.21.15.67:0/11285460 shutdown_connections 2024-09-19T05:49:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f677f573640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67780cf540 0x7f6778157dd0 unknown :-1 s=CLOSED pgs=2521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f677f573640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f675c0678c0 0x7f675c069d80 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f677f573640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67780cee40 0x7f67780c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f677f573640 1 --2- 172.21.15.67:0/11285460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67780b13f0 0x7f67780b9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:32.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.108+0000 7f677f573640 1 -- 172.21.15.67:0/11285460 >> 172.21.15.67:0/11285460 conn(0x7f677808bff0 msgr2=0x7f6778075100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:32.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.112+0000 7f677f573640 1 -- 172.21.15.67:0/11285460 shutdown_connections 2024-09-19T05:49:32.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.112+0000 7f677f573640 1 -- 172.21.15.67:0/11285460 wait complete. 2024-09-19T05:49:32.113 INFO:tasks.ceph.mds.c.smithi067.stderr: -5268> 2024-09-19T05:48:49.009+0000 7f8969eeb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:49:32.117 INFO:tasks.ceph.mds.c.smithi067.stderr: -3216> 2024-09-19T05:48:57.677+0000 7f8965ee3640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-09-19T05:48:56.540061+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={11028=0-12582912@1} caps={11028=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=11028 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x56240474d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(30)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:49:32.128 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:49:32.146 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-09-19T05:49:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa3366e8640 1 Processor -- start 2024-09-19T05:49:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa3366e8640 1 -- start start 2024-09-19T05:49:32.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa3366e8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa33015bef0 0x7fa330073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa3366e8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3300d0980 0x7fa330071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa3366e8640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3300ad610 con 0x7fa33015c2d0 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa3366e8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa3300ad8f0 con 0x7fa3300d0980 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa3366e8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa3300b3230 con 0x7fa33015bef0 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa334c85640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3300d0980 0x7fa330071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa32f7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa33015c2d0 0x7fa3300d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51316/0 (socket says 172.21.15.67:51316) 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa32f7fe640 1 -- 172.21.15.67:0/1877140131 learned_addr learned my addr 172.21.15.67:0/1877140131 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa32ffff640 1 --2- 172.21.15.67:0/1877140131 >> v2:172.21.15.97:3300/0 conn(0x7fa33015bef0 0x7fa330073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa32effd640 1 -- 172.21.15.67:0/1877140131 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3548875696 0 0) 0x7fa3300ad610 con 0x7fa33015c2d0 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa334c85640 1 -- 172.21.15.67:0/1877140131 >> v2:172.21.15.97:3300/0 conn(0x7fa33015bef0 msgr2=0x7fa330073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa334c85640 1 --2- 172.21.15.67:0/1877140131 >> v2:172.21.15.97:3300/0 conn(0x7fa33015bef0 0x7fa330073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa334c85640 1 -- 172.21.15.67:0/1877140131 >> v1:172.21.15.67:6789/0 conn(0x7fa33015c2d0 legacy=0x7fa3300d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa334c85640 1 -- 172.21.15.67:0/1877140131 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3300b3510 con 0x7fa3300d0980 2024-09-19T05:49:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.244+0000 7fa32ffff640 1 --2- 172.21.15.67:0/1877140131 >> v2:172.21.15.97:3300/0 conn(0x7fa33015bef0 0x7fa330073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa334c85640 1 --2- 172.21.15.67:0/1877140131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 0x7fa330071e50 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7fa3300700c0 tx=0x7fa32801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e55bdc085054b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32effd640 1 -- 172.21.15.67:0/1877140131 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3280b2070 con 0x7fa3300d0980 2024-09-19T05:49:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32effd640 1 -- 172.21.15.67:0/1877140131 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3280a5920 con 0x7fa3300d0980 2024-09-19T05:49:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32effd640 1 -- 172.21.15.67:0/1877140131 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3280a5cf0 con 0x7fa3300d0980 2024-09-19T05:49:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- 172.21.15.67:0/1877140131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 msgr2=0x7fa330071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 --2- 172.21.15.67:0/1877140131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 0x7fa330071e50 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7fa3300700c0 tx=0x7fa32801c8a0 comp rx=0 tx=0).stop 2024-09-19T05:49:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- 172.21.15.67:0/1877140131 shutdown_connections 2024-09-19T05:49:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 --2- 172.21.15.67:0/1877140131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 0x7fa330071e50 unknown :-1 s=CLOSED pgs=2526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 --2- 172.21.15.67:0/1877140131 >> v2:172.21.15.97:3300/0 conn(0x7fa33015bef0 0x7fa330073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- 172.21.15.67:0/1877140131 >> 172.21.15.67:0/1877140131 conn(0x7fa33006be10 msgr2=0x7fa33006c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- 172.21.15.67:0/1877140131 shutdown_connections 2024-09-19T05:49:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- 172.21.15.67:0/1877140131 wait complete. 2024-09-19T05:49:32.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 Processor -- start 2024-09-19T05:49:32.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- start start 2024-09-19T05:49:32.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 0x7fa330099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:32.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33015bef0 0x7fa330156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:32.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3301577b0 0x7fa330157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa330168ec0 con 0x7fa3300d0980 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa330168d40 con 0x7fa33015bef0 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa330169040 con 0x7fa3301577b0 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 0x7fa330099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 0x7fa330099850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51108/0 (socket says 172.21.15.67:51108) 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32ffff640 1 -- 172.21.15.67:0/4103857082 learned_addr learned my addr 172.21.15.67:0/4103857082 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32ffff640 1 -- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3301577b0 msgr2=0x7fa330157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32ffff640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3301577b0 0x7fa330157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32ffff640 1 -- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33015bef0 msgr2=0x7fa330156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32ffff640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33015bef0 0x7fa330156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32ffff640 1 -- 172.21.15.67:0/4103857082 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33014e5d0 con 0x7fa3300d0980 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32ffff640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 0x7fa330099850 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c7c0 tx=0x7fa32000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32cff9640 1 -- 172.21.15.67:0/4103857082 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320007a30 con 0x7fa3300d0980 2024-09-19T05:49:32.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32cff9640 1 -- 172.21.15.67:0/4103857082 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa320007bd0 con 0x7fa3300d0980 2024-09-19T05:49:32.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- 172.21.15.67:0/4103857082 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33014e890 con 0x7fa3300d0980 2024-09-19T05:49:32.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa32cff9640 1 -- 172.21.15.67:0/4103857082 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3200113f0 con 0x7fa3300d0980 2024-09-19T05:49:32.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.248+0000 7fa3366e8640 1 -- 172.21.15.67:0/4103857082 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33014ee50 con 0x7fa3300d0980 2024-09-19T05:49:32.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.252+0000 7fa3366e8640 1 -- 172.21.15.67:0/4103857082 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa330071e50 con 0x7fa3300d0980 2024-09-19T05:49:32.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.252+0000 7fa32cff9640 1 -- 172.21.15.67:0/4103857082 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa320011590 con 0x7fa3300d0980 2024-09-19T05:49:32.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.252+0000 7fa32cff9640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa31c0678c0 0x7fa31c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:32.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.252+0000 7fa32cff9640 1 -- 172.21.15.67:0/4103857082 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(208..208 src has 1..208) ==== 6303+0+0 (secure 0 0 0) 0x7fa3200860f0 con 0x7fa3300d0980 2024-09-19T05:49:32.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.252+0000 7fa32f7fe640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa31c0678c0 0x7fa31c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:32.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.252+0000 7fa32f7fe640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa31c0678c0 0x7fa31c069d80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa330148840 tx=0x7fa324007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:32.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.256+0000 7fa32cff9640 1 -- 172.21.15.67:0/4103857082 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa320015020 con 0x7fa3300d0980 2024-09-19T05:49:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:32.448+0000 7fa3366e8640 1 -- 172.21.15.67:0/4103857082 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa33006c1f0 con 0x7fa3300d0980 2024-09-19T05:49:33.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.108+0000 7fa32cff9640 1 -- 172.21.15.67:0/4103857082 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v148) ==== 104+0+0 (secure 0 0 0) 0x7fa3200569e0 con 0x7fa3300d0980 2024-09-19T05:49:33.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 -- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa31c0678c0 msgr2=0x7fa31c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa31c0678c0 0x7fa31c069d80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa330148840 tx=0x7fa324007970 comp rx=0 tx=0).stop 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 -- 172.21.15.67:0/4103857082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 msgr2=0x7fa330099850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 0x7fa330099850 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c7c0 tx=0x7fa32000cc80 comp rx=0 tx=0).stop 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 -- 172.21.15.67:0/4103857082 shutdown_connections 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa31c0678c0 0x7fa31c069d80 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3301577b0 0x7fa330157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33015bef0 0x7fa330156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 --2- 172.21.15.67:0/4103857082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3300d0980 0x7fa330099850 unknown :-1 s=CLOSED pgs=2527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 -- 172.21.15.67:0/4103857082 >> 172.21.15.67:0/4103857082 conn(0x7fa33006be10 msgr2=0x7fa330074f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 -- 172.21.15.67:0/4103857082 shutdown_connections 2024-09-19T05:49:33.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.112+0000 7fa3366e8640 1 -- 172.21.15.67:0/4103857082 wait complete. 2024-09-19T05:49:33.134 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:49:33.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.312+0000 7f7317e22640 1 Processor -- start 2024-09-19T05:49:33.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.312+0000 7f7317e22640 1 -- start start 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73100d0c30 0x7f73100d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f731015e620 0x7f73100d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f73100d2a80 0x7f7310161f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f73100ceb90 con 0x7f731015e620 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f73100d2f20 con 0x7f73100d2a80 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f73100d3200 con 0x7f73100d0c30 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f73153bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f731015e620 0x7f73100d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f73153bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f731015e620 0x7f73100d2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51114/0 (socket says 172.21.15.67:51114) 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f73153bd640 1 -- 172.21.15.67:0/647067196 learned_addr learned my addr 172.21.15.67:0/647067196 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f73163bf640 1 --2- 172.21.15.67:0/647067196 >> v2:172.21.15.97:3300/0 conn(0x7f73100d2a80 0x7f7310161f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:33.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7315bbe640 1 --2- 172.21.15.67:0/647067196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73100d0c30 0x7f73100d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:33.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f73153bd640 1 -- 172.21.15.67:0/647067196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73100d0c30 msgr2=0x7f73100d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:33.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f73153bd640 1 --2- 172.21.15.67:0/647067196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73100d0c30 0x7f73100d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f73153bd640 1 -- 172.21.15.67:0/647067196 >> v2:172.21.15.97:3300/0 conn(0x7f73100d2a80 msgr2=0x7f7310161f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:33.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f73153bd640 1 --2- 172.21.15.67:0/647067196 >> v2:172.21.15.97:3300/0 conn(0x7f73100d2a80 0x7f7310161f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f73153bd640 1 -- 172.21.15.67:0/647067196 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73100d34e0 con 0x7f731015e620 2024-09-19T05:49:33.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f73153bd640 1 --2- 172.21.15.67:0/647067196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f731015e620 0x7f73100d2540 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f73100b3e10 tx=0x7f730401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e2fc843ad58660 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:33.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7314bbc640 1 -- 172.21.15.67:0/647067196 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040aa430 con 0x7f731015e620 2024-09-19T05:49:33.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7314bbc640 1 -- 172.21.15.67:0/647067196 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73040af070 con 0x7f731015e620 2024-09-19T05:49:33.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7314bbc640 1 -- 172.21.15.67:0/647067196 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040aa7f0 con 0x7f731015e620 2024-09-19T05:49:33.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 -- 172.21.15.67:0/647067196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f731015e620 msgr2=0x7f73100d2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:33.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 --2- 172.21.15.67:0/647067196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f731015e620 0x7f73100d2540 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f73100b3e10 tx=0x7f730401c4f0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 -- 172.21.15.67:0/647067196 shutdown_connections 2024-09-19T05:49:33.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 --2- 172.21.15.67:0/647067196 >> v2:172.21.15.97:3300/0 conn(0x7f73100d2a80 0x7f7310161f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 --2- 172.21.15.67:0/647067196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f731015e620 0x7f73100d2540 unknown :-1 s=CLOSED pgs=2528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 --2- 172.21.15.67:0/647067196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73100d0c30 0x7f73100d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 -- 172.21.15.67:0/647067196 >> 172.21.15.67:0/647067196 conn(0x7f731009d820 msgr2=0x7f731008bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:33.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.316+0000 7f7317e22640 1 -- 172.21.15.67:0/647067196 shutdown_connections 2024-09-19T05:49:33.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 -- 172.21.15.67:0/647067196 wait complete. 2024-09-19T05:49:33.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 Processor -- start 2024-09-19T05:49:33.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 -- start start 2024-09-19T05:49:33.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73100d0c30 0x7f73100b9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:33.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73100d2a80 0x7f7310160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:33.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f731015e620 0x7f7310160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:33.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73100cf180 con 0x7f73100d2a80 2024-09-19T05:49:33.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f73100cf000 con 0x7f731015e620 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f73100cf300 con 0x7f73100d0c30 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73153bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73100d2a80 0x7f7310160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73153bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73100d2a80 0x7f7310160a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51128/0 (socket says 172.21.15.67:51128) 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73153bd640 1 -- 172.21.15.67:0/1249373313 learned_addr learned my addr 172.21.15.67:0/1249373313 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7315bbe640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73100d0c30 0x7f73100b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73163bf640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f731015e620 0x7f7310160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73153bd640 1 -- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73100d0c30 msgr2=0x7f73100b9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73153bd640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73100d0c30 0x7f73100b9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73153bd640 1 -- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f731015e620 msgr2=0x7f7310160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73153bd640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f731015e620 0x7f7310160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73153bd640 1 -- 172.21.15.67:0/1249373313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73100ba060 con 0x7f73100d2a80 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73163bf640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f731015e620 0x7f7310160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:33.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f73153bd640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73100d2a80 0x7f7310160a30 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7f73040ac040 tx=0x7f7304019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:33.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f730e7fc640 1 -- 172.21.15.67:0/1249373313 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040be610 con 0x7f73100d2a80 2024-09-19T05:49:33.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f730e7fc640 1 -- 172.21.15.67:0/1249373313 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73040be7d0 con 0x7f73100d2a80 2024-09-19T05:49:33.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f730e7fc640 1 -- 172.21.15.67:0/1249373313 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040bebc0 con 0x7f73100d2a80 2024-09-19T05:49:33.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 -- 172.21.15.67:0/1249373313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73100ba340 con 0x7f73100d2a80 2024-09-19T05:49:33.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.320+0000 7f7317e22640 1 -- 172.21.15.67:0/1249373313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73101448e0 con 0x7f73100d2a80 2024-09-19T05:49:33.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.324+0000 7f7317e22640 1 -- 172.21.15.67:0/1249373313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7310161f50 con 0x7f73100d2a80 2024-09-19T05:49:33.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.324+0000 7f730e7fc640 1 -- 172.21.15.67:0/1249373313 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73040bc020 con 0x7f73100d2a80 2024-09-19T05:49:33.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.324+0000 7f730e7fc640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72fc0678c0 0x7f72fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:33.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.324+0000 7f730e7fc640 1 -- 172.21.15.67:0/1249373313 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(208..208 src has 1..208) ==== 6303+0+0 (secure 0 0 0) 0x7f7304120050 con 0x7f73100d2a80 2024-09-19T05:49:33.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.324+0000 7f7315bbe640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72fc0678c0 0x7f72fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:33.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.324+0000 7f7315bbe640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72fc0678c0 0x7f72fc069d80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f7308009f80 tx=0x7f730800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:33.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.328+0000 7f730e7fc640 1 -- 172.21.15.67:0/1249373313 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f73040c5030 con 0x7f73100d2a80 2024-09-19T05:49:33.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:33.492+0000 7f7317e22640 1 -- 172.21.15.67:0/1249373313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f731006ddb0 con 0x7f73100d2a80 2024-09-19T05:49:34.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.120+0000 7f730e7fc640 1 -- 172.21.15.67:0/1249373313 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v209) ==== 181+0+0 (secure 0 0 0) 0x7f7304016110 con 0x7f73100d2a80 2024-09-19T05:49:34.118 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:49:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 -- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72fc0678c0 msgr2=0x7f72fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72fc0678c0 0x7f72fc069d80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f7308009f80 tx=0x7f730800b040 comp rx=0 tx=0).stop 2024-09-19T05:49:34.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 -- 172.21.15.67:0/1249373313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73100d2a80 msgr2=0x7f7310160a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73100d2a80 0x7f7310160a30 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7f73040ac040 tx=0x7f7304019290 comp rx=0 tx=0).stop 2024-09-19T05:49:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 -- 172.21.15.67:0/1249373313 shutdown_connections 2024-09-19T05:49:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f731015e620 0x7f7310160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73100d2a80 0x7f7310160a30 unknown :-1 s=CLOSED pgs=2529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f72fc0678c0 0x7f72fc069d80 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 --2- 172.21.15.67:0/1249373313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73100d0c30 0x7f73100b9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:34.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 -- 172.21.15.67:0/1249373313 >> 172.21.15.67:0/1249373313 conn(0x7f731009d820 msgr2=0x7f73100cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:34.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 -- 172.21.15.67:0/1249373313 shutdown_connections 2024-09-19T05:49:34.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.124+0000 7f7317e22640 1 -- 172.21.15.67:0/1249373313 wait complete. 2024-09-19T05:49:34.144 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:49:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.272+0000 7f345520b640 1 Processor -- start 2024-09-19T05:49:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.272+0000 7f345520b640 1 -- start start 2024-09-19T05:49:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.272+0000 7f345520b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 0x7f345015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.272+0000 7f345520b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f345006c4b0 0x7f345015b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.272+0000 7f345520b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34500b4570 con 0x7f345006c0d0 2024-09-19T05:49:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.272+0000 7f345520b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f34500ae120 con 0x7f345006c4b0 2024-09-19T05:49:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.272+0000 7f345520b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f34500ae400 con 0x7f3450071e30 2024-09-19T05:49:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f3447fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 0x7f345015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f344f59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f345006c4b0 0x7f345015b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f344ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f345006c0d0 0x7f34500b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.67:33698/0 (socket says 172.21.15.67:33698) 2024-09-19T05:49:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f3447fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 0x7f345015abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:55254/0 (socket says 172.21.15.67:55254) 2024-09-19T05:49:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f344f59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f345006c4b0 0x7f345015b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.67:43868/0 (socket says 172.21.15.67:43868) 2024-09-19T05:49:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f344ed9d640 1 -- 172.21.15.67:0/680830658 learned_addr learned my addr 172.21.15.67:0/680830658 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f3447fff640 1 -- 172.21.15.67:0/680830658 >> v2:172.21.15.97:3300/0 conn(0x7f345006c4b0 msgr2=0x7f345015b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f3447fff640 1 --2- 172.21.15.67:0/680830658 >> v2:172.21.15.97:3300/0 conn(0x7f345006c4b0 0x7f345015b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f3447fff640 1 -- 172.21.15.67:0/680830658 >> v1:172.21.15.97:6789/0 conn(0x7f345006c0d0 legacy=0x7f34500b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f3447fff640 1 -- 172.21.15.67:0/680830658 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34500ae6e0 con 0x7f3450071e30 2024-09-19T05:49:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f344f59e640 1 --2- 172.21.15.67:0/680830658 >> v2:172.21.15.97:3300/0 conn(0x7f345006c4b0 0x7f345015b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:49:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f3447fff640 1 --2- 172.21.15.67:0/680830658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 0x7f345015abb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f34380097c0 tx=0x7f343801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14cb0fef6bda80b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f344e59c640 1 -- 172.21.15.67:0/680830658 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380ab430 con 0x7f3450071e30 2024-09-19T05:49:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f344e59c640 1 -- 172.21.15.67:0/680830658 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34380b0070 con 0x7f3450071e30 2024-09-19T05:49:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.276+0000 7f344e59c640 1 -- 172.21.15.67:0/680830658 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380ab7f0 con 0x7f3450071e30 2024-09-19T05:49:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- 172.21.15.67:0/680830658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 msgr2=0x7f345015abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 --2- 172.21.15.67:0/680830658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 0x7f345015abb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f34380097c0 tx=0x7f343801c410 comp rx=0 tx=0).stop 2024-09-19T05:49:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- 172.21.15.67:0/680830658 shutdown_connections 2024-09-19T05:49:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 --2- 172.21.15.67:0/680830658 >> v2:172.21.15.97:3300/0 conn(0x7f345006c4b0 0x7f345015b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 --2- 172.21.15.67:0/680830658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 0x7f345015abb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- 172.21.15.67:0/680830658 >> 172.21.15.67:0/680830658 conn(0x7f34500b21e0 msgr2=0x7f34500b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- 172.21.15.67:0/680830658 shutdown_connections 2024-09-19T05:49:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- 172.21.15.67:0/680830658 wait complete. 2024-09-19T05:49:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 Processor -- start 2024-09-19T05:49:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- start start 2024-09-19T05:49:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345006c0d0 0x7f3450145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345006c4b0 0x7f345014b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 0x7f345014b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f34500af590 con 0x7f345006c0d0 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f34500af410 con 0x7f345006c4b0 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f34500af710 con 0x7f3450071e30 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f344ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345006c0d0 0x7f3450145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f344ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345006c0d0 0x7f3450145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51132/0 (socket says 172.21.15.67:51132) 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f344ed9d640 1 -- 172.21.15.67:0/4027556817 learned_addr learned my addr 172.21.15.67:0/4027556817 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f3447fff640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345006c4b0 0x7f345014b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f344f59e640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 0x7f345014b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f344ed9d640 1 -- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 msgr2=0x7f345014b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f344ed9d640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 0x7f345014b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f344ed9d640 1 -- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345006c4b0 msgr2=0x7f345014b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f344ed9d640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345006c4b0 0x7f345014b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f344ed9d640 1 -- 172.21.15.67:0/4027556817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34501580a0 con 0x7f345006c0d0 2024-09-19T05:49:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f3447fff640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345006c4b0 0x7f345014b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:49:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f344ed9d640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345006c0d0 0x7f3450145fa0 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7f344000c420 tx=0x7f344000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f34477fe640 1 -- 172.21.15.67:0/4027556817 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440017070 con 0x7f345006c0d0 2024-09-19T05:49:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f34477fe640 1 -- 172.21.15.67:0/4027556817 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3440005cf0 con 0x7f345006c0d0 2024-09-19T05:49:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- 172.21.15.67:0/4027556817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345015c3b0 con 0x7f345006c0d0 2024-09-19T05:49:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f34477fe640 1 -- 172.21.15.67:0/4027556817 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400072f0 con 0x7f345006c0d0 2024-09-19T05:49:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.280+0000 7f345520b640 1 -- 172.21.15.67:0/4027556817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345015c970 con 0x7f345006c0d0 2024-09-19T05:49:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.284+0000 7f345520b640 1 -- 172.21.15.67:0/4027556817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34500b3af0 con 0x7f345006c0d0 2024-09-19T05:49:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.284+0000 7f34477fe640 1 -- 172.21.15.67:0/4027556817 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f344001a070 con 0x7f345006c0d0 2024-09-19T05:49:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.284+0000 7f34477fe640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 0x7f3430069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.284+0000 7f34477fe640 1 -- 172.21.15.67:0/4027556817 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5749+0+0 (secure 0 0 0) 0x7f34400850c0 con 0x7f345006c0d0 2024-09-19T05:49:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.284+0000 7f3447fff640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 0x7f3430069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.284+0000 7f3447fff640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 0x7f3430069d80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f34380af000 tx=0x7f34380a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:34.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.288+0000 7f34477fe640 1 -- 172.21.15.67:0/4027556817 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3440055bd0 con 0x7f345006c0d0 2024-09-19T05:49:34.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:34.452+0000 7f345520b640 1 -- 172.21.15.67:0/4027556817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f34500b15d0 con 0x7f345006c0d0 2024-09-19T05:49:35.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.132+0000 7f34477fe640 1 -- 172.21.15.67:0/4027556817 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v210) ==== 169+0+0 (secure 0 0 0) 0x7f34400554d0 con 0x7f345006c0d0 2024-09-19T05:49:35.130 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-19T05:49:35.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 -- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 msgr2=0x7f3430069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 0x7f3430069d80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f34380af000 tx=0x7f34380a7000 comp rx=0 tx=0).stop 2024-09-19T05:49:35.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 -- 172.21.15.67:0/4027556817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345006c0d0 msgr2=0x7f3450145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345006c0d0 0x7f3450145fa0 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7f344000c420 tx=0x7f344000c8e0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 -- 172.21.15.67:0/4027556817 shutdown_connections 2024-09-19T05:49:35.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f34300678c0 0x7f3430069d80 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3450071e30 0x7f345014b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f345006c4b0 0x7f345014b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 --2- 172.21.15.67:0/4027556817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f345006c0d0 0x7f3450145fa0 unknown :-1 s=CLOSED pgs=2530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 -- 172.21.15.67:0/4027556817 >> 172.21.15.67:0/4027556817 conn(0x7f34500b21e0 msgr2=0x7f34500afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:35.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 -- 172.21.15.67:0/4027556817 shutdown_connections 2024-09-19T05:49:35.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.136+0000 7f345520b640 1 -- 172.21.15.67:0/4027556817 wait complete. 2024-09-19T05:49:35.158 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T05:49:35.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.284+0000 7fc791f1c640 1 Processor -- start 2024-09-19T05:49:35.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.284+0000 7fc791f1c640 1 -- start start 2024-09-19T05:49:35.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.284+0000 7fc791f1c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc78c15bef0 0x7fc78c073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.284+0000 7fc791f1c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c15c2d0 0x7fc78c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.284+0000 7fc791f1c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78c0ad610 con 0x7fc78c0b3d10 2024-09-19T05:49:35.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.284+0000 7fc791f1c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc78c0ad8f0 con 0x7fc78c15bef0 2024-09-19T05:49:35.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.284+0000 7fc791f1c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc78c0b3230 con 0x7fc78c15c2d0 2024-09-19T05:49:35.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.284+0000 7fc78bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc78c0b3d10 0x7fc78c15fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51320/0 (socket says 172.21.15.67:51320) 2024-09-19T05:49:35.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.284+0000 7fc78b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc78c15bef0 0x7fc78c073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.284+0000 7fc78bfff640 1 -- 172.21.15.67:0/1289900798 learned_addr learned my addr 172.21.15.67:0/1289900798 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:35.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc78affd640 1 --2- 172.21.15.67:0/1289900798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c15c2d0 0x7fc78c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc78b7fe640 1 -- 172.21.15.67:0/1289900798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c15c2d0 msgr2=0x7fc78c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:35.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc78b7fe640 1 --2- 172.21.15.67:0/1289900798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c15c2d0 0x7fc78c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc78a7fc640 1 -- 172.21.15.67:0/1289900798 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149973479 0 0) 0x7fc78c0ad610 con 0x7fc78c0b3d10 2024-09-19T05:49:35.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc78b7fe640 1 -- 172.21.15.67:0/1289900798 >> v1:172.21.15.67:6789/0 conn(0x7fc78c0b3d10 legacy=0x7fc78c15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc78b7fe640 1 -- 172.21.15.67:0/1289900798 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78c0b3510 con 0x7fc78c15bef0 2024-09-19T05:49:35.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc78b7fe640 1 --2- 172.21.15.67:0/1289900798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 0x7fc78c073fd0 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7fc7740097c0 tx=0x7fc77401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a8cb7baeebac13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:35.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc78a7fc640 1 -- 172.21.15.67:0/1289900798 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7740b1070 con 0x7fc78c15bef0 2024-09-19T05:49:35.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc78a7fc640 1 -- 172.21.15.67:0/1289900798 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7740ac410 con 0x7fc78c15bef0 2024-09-19T05:49:35.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc78a7fc640 1 -- 172.21.15.67:0/1289900798 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7740ac7e0 con 0x7fc78c15bef0 2024-09-19T05:49:35.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc791f1c640 1 -- 172.21.15.67:0/1289900798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 msgr2=0x7fc78c073fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc791f1c640 1 --2- 172.21.15.67:0/1289900798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 0x7fc78c073fd0 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7fc7740097c0 tx=0x7fc77401c4a0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc791f1c640 1 -- 172.21.15.67:0/1289900798 shutdown_connections 2024-09-19T05:49:35.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc791f1c640 1 --2- 172.21.15.67:0/1289900798 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c15c2d0 0x7fc78c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc791f1c640 1 --2- 172.21.15.67:0/1289900798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 0x7fc78c073fd0 unknown :-1 s=CLOSED pgs=2532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc791f1c640 1 -- 172.21.15.67:0/1289900798 >> 172.21.15.67:0/1289900798 conn(0x7fc78c06be10 msgr2=0x7fc78c06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:35.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc791f1c640 1 -- 172.21.15.67:0/1289900798 shutdown_connections 2024-09-19T05:49:35.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.288+0000 7fc791f1c640 1 -- 172.21.15.67:0/1289900798 wait complete. 2024-09-19T05:49:35.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 Processor -- start 2024-09-19T05:49:35.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 -- start start 2024-09-19T05:49:35.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc78c0b3d10 0x7fc78c1451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 0x7fc78c14ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c145800 0x7fc78c1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc78c168f50 con 0x7fc78c15bef0 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc78c0d0bc0 con 0x7fc78c0b3d10 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc78c1690d0 con 0x7fc78c145800 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 0x7fc78c14ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 0x7fc78c14ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51158/0 (socket says 172.21.15.67:51158) 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78affd640 1 -- 172.21.15.67:0/1051427555 learned_addr learned my addr 172.21.15.67:0/1051427555 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78b7fe640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc78c0b3d10 0x7fc78c1451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78bfff640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c145800 0x7fc78c1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78affd640 1 -- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c145800 msgr2=0x7fc78c1493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78affd640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c145800 0x7fc78c1493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78affd640 1 -- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc78c0b3d10 msgr2=0x7fc78c1451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78affd640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc78c0b3d10 0x7fc78c1451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78affd640 1 -- 172.21.15.67:0/1051427555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78c1f9090 con 0x7fc78c15bef0 2024-09-19T05:49:35.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78bfff640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c145800 0x7fc78c1493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:35.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc78affd640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 0x7fc78c14ef70 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00d5f0 tx=0x7fc77c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:35.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc783fff640 1 -- 172.21.15.67:0/1051427555 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0125f0 con 0x7fc78c15bef0 2024-09-19T05:49:35.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc783fff640 1 -- 172.21.15.67:0/1051427555 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77c019070 con 0x7fc78c15bef0 2024-09-19T05:49:35.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 -- 172.21.15.67:0/1051427555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc78c1f9370 con 0x7fc78c15bef0 2024-09-19T05:49:35.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc783fff640 1 -- 172.21.15.67:0/1051427555 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0129b0 con 0x7fc78c15bef0 2024-09-19T05:49:35.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 -- 172.21.15.67:0/1051427555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc78c1f9930 con 0x7fc78c15bef0 2024-09-19T05:49:35.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc791f1c640 1 -- 172.21.15.67:0/1051427555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc78c073fd0 con 0x7fc78c15bef0 2024-09-19T05:49:35.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.292+0000 7fc783fff640 1 -- 172.21.15.67:0/1051427555 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc77c012b50 con 0x7fc78c15bef0 2024-09-19T05:49:35.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.296+0000 7fc783fff640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc76c0678c0 0x7fc76c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.296+0000 7fc783fff640 1 -- 172.21.15.67:0/1051427555 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fc77c0860e0 con 0x7fc78c15bef0 2024-09-19T05:49:35.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.296+0000 7fc78b7fe640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc76c0678c0 0x7fc76c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.296+0000 7fc78b7fe640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc76c0678c0 0x7fc76c069d80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fc7740ae000 tx=0x7fc774008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:35.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.300+0000 7fc783fff640 1 -- 172.21.15.67:0/1051427555 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fc77c056c70 con 0x7fc78c15bef0 2024-09-19T05:49:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.472+0000 7fc791f1c640 1 -- 172.21.15.67:0/1051427555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc78c071e50 con 0x7fc78c15bef0 2024-09-19T05:49:35.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.480+0000 7fc783fff640 1 -- 172.21.15.67:0/1051427555 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7fc77c056570 con 0x7fc78c15bef0 2024-09-19T05:49:35.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.480+0000 7fc791f1c640 1 -- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc76c0678c0 msgr2=0x7fc76c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.480+0000 7fc791f1c640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc76c0678c0 0x7fc76c069d80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fc7740ae000 tx=0x7fc774008040 comp rx=0 tx=0).stop 2024-09-19T05:49:35.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.480+0000 7fc791f1c640 1 -- 172.21.15.67:0/1051427555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 msgr2=0x7fc78c14ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.480+0000 7fc791f1c640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 0x7fc78c14ef70 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00d5f0 tx=0x7fc77c00dab0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.484+0000 7fc791f1c640 1 -- 172.21.15.67:0/1051427555 shutdown_connections 2024-09-19T05:49:35.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.484+0000 7fc791f1c640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc76c0678c0 0x7fc76c069d80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.484+0000 7fc791f1c640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc78c145800 0x7fc78c1493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.484+0000 7fc791f1c640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc78c15bef0 0x7fc78c14ef70 unknown :-1 s=CLOSED pgs=2533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.484+0000 7fc791f1c640 1 --2- 172.21.15.67:0/1051427555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc78c0b3d10 0x7fc78c1451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.484+0000 7fc791f1c640 1 -- 172.21.15.67:0/1051427555 >> 172.21.15.67:0/1051427555 conn(0x7fc78c06be10 msgr2=0x7fc78c0afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:35.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.484+0000 7fc791f1c640 1 -- 172.21.15.67:0/1051427555 shutdown_connections 2024-09-19T05:49:35.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.484+0000 7fc791f1c640 1 -- 172.21.15.67:0/1051427555 wait complete. 2024-09-19T05:49:35.498 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-19T05:49:35.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.628+0000 7f3114a21640 1 Processor -- start 2024-09-19T05:49:35.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.628+0000 7f3114a21640 1 -- start start 2024-09-19T05:49:35.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.628+0000 7f3114a21640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f311015c0b0 0x7f3110071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.628+0000 7f3114a21640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31100ad0c0 0x7f31100ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.628+0000 7f3114a21640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f31100d04b0 0x7f31100d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.628+0000 7f3114a21640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f311006f770 con 0x7f31100d04b0 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.628+0000 7f3114a21640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f311015c8d0 con 0x7f311015c0b0 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.628+0000 7f3114a21640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f311015cbb0 con 0x7f31100ad0c0 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310ed9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f31100d04b0 0x7f31100d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310ed9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f31100d04b0 0x7f31100d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51170/0 (socket says 172.21.15.67:51170) 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310ed9d640 1 -- 172.21.15.67:0/1096023152 learned_addr learned my addr 172.21.15.67:0/1096023152 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310e59c640 1 --2- 172.21.15.67:0/1096023152 >> v2:172.21.15.97:3300/0 conn(0x7f311015c0b0 0x7f3110071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310dd9b640 1 --2- 172.21.15.67:0/1096023152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31100ad0c0 0x7f31100ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310ed9d640 1 -- 172.21.15.67:0/1096023152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31100ad0c0 msgr2=0x7f31100ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310ed9d640 1 --2- 172.21.15.67:0/1096023152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31100ad0c0 0x7f31100ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310ed9d640 1 -- 172.21.15.67:0/1096023152 >> v2:172.21.15.97:3300/0 conn(0x7f311015c0b0 msgr2=0x7f3110071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310ed9d640 1 --2- 172.21.15.67:0/1096023152 >> v2:172.21.15.97:3300/0 conn(0x7f311015c0b0 0x7f3110071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310ed9d640 1 -- 172.21.15.67:0/1096023152 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311015ce90 con 0x7f31100d04b0 2024-09-19T05:49:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310e59c640 1 --2- 172.21.15.67:0/1096023152 >> v2:172.21.15.97:3300/0 conn(0x7f311015c0b0 0x7f3110071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:49:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310ed9d640 1 --2- 172.21.15.67:0/1096023152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31100d04b0 0x7f31100d0960 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 crypto rx=0x7f3110073e20 tx=0x7f310801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d964259d167646 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310d59a640 1 -- 172.21.15.67:0/1096023152 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31080a5760 con 0x7f31100d04b0 2024-09-19T05:49:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310d59a640 1 -- 172.21.15.67:0/1096023152 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31080a5900 con 0x7f31100d04b0 2024-09-19T05:49:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f310d59a640 1 -- 172.21.15.67:0/1096023152 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31080a5cd0 con 0x7f31100d04b0 2024-09-19T05:49:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f3114a21640 1 -- 172.21.15.67:0/1096023152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31100d04b0 msgr2=0x7f31100d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f3114a21640 1 --2- 172.21.15.67:0/1096023152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31100d04b0 0x7f31100d0960 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 crypto rx=0x7f3110073e20 tx=0x7f310801c9f0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f3114a21640 1 -- 172.21.15.67:0/1096023152 shutdown_connections 2024-09-19T05:49:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f3114a21640 1 --2- 172.21.15.67:0/1096023152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31100d04b0 0x7f31100d0960 unknown :-1 s=CLOSED pgs=2534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f3114a21640 1 --2- 172.21.15.67:0/1096023152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31100ad0c0 0x7f31100ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f3114a21640 1 --2- 172.21.15.67:0/1096023152 >> v2:172.21.15.97:3300/0 conn(0x7f311015c0b0 0x7f3110071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f3114a21640 1 -- 172.21.15.67:0/1096023152 >> 172.21.15.67:0/1096023152 conn(0x7f311006c040 msgr2=0x7f311006c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f3114a21640 1 -- 172.21.15.67:0/1096023152 shutdown_connections 2024-09-19T05:49:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.632+0000 7f3114a21640 1 -- 172.21.15.67:0/1096023152 wait complete. 2024-09-19T05:49:35.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 Processor -- start 2024-09-19T05:49:35.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 -- start start 2024-09-19T05:49:35.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31100ad0c0 0x7f3110145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31100d04b0 0x7f31101564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f311015c0b0 0x7f3110156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f311006e670 con 0x7f311015c0b0 2024-09-19T05:49:35.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f311006e7f0 con 0x7f31100ad0c0 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f311006e970 con 0x7f31100d04b0 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f311015c0b0 0x7f3110156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f311015c0b0 0x7f3110156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51176/0 (socket says 172.21.15.67:51176) 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310ed9d640 1 -- 172.21.15.67:0/738997776 learned_addr learned my addr 172.21.15.67:0/738997776 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310dd9b640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31100d04b0 0x7f31101564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310e59c640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31100ad0c0 0x7f3110145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310ed9d640 1 -- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31100d04b0 msgr2=0x7f31101564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310ed9d640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31100d04b0 0x7f31101564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310ed9d640 1 -- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31100ad0c0 msgr2=0x7f3110145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310ed9d640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31100ad0c0 0x7f3110145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310ed9d640 1 -- 172.21.15.67:0/738997776 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311015a430 con 0x7f311015c0b0 2024-09-19T05:49:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f310ed9d640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f311015c0b0 0x7f3110156a10 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7f31080af040 tx=0x7f3108019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3106ffd640 1 -- 172.21.15.67:0/738997776 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31080bc020 con 0x7f311015c0b0 2024-09-19T05:49:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3106ffd640 1 -- 172.21.15.67:0/738997776 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31080b8670 con 0x7f311015c0b0 2024-09-19T05:49:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 -- 172.21.15.67:0/738997776 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3110145a40 con 0x7f311015c0b0 2024-09-19T05:49:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3106ffd640 1 -- 172.21.15.67:0/738997776 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31080b8a60 con 0x7f311015c0b0 2024-09-19T05:49:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 -- 172.21.15.67:0/738997776 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31100cf900 con 0x7f311015c0b0 2024-09-19T05:49:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.636+0000 7f3114a21640 1 -- 172.21.15.67:0/738997776 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311006ec60 con 0x7f311015c0b0 2024-09-19T05:49:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.640+0000 7f3106ffd640 1 -- 172.21.15.67:0/738997776 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f31080bf020 con 0x7f311015c0b0 2024-09-19T05:49:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.640+0000 7f3106ffd640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30f00678c0 0x7f30f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.640+0000 7f3106ffd640 1 -- 172.21.15.67:0/738997776 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f3108120c20 con 0x7f311015c0b0 2024-09-19T05:49:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.640+0000 7f310e59c640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30f00678c0 0x7f30f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.640+0000 7f310e59c640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30f00678c0 0x7f30f0069d80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f310000b930 tx=0x7f3100008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:35.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.644+0000 7f3106ffd640 1 -- 172.21.15.67:0/738997776 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f31080c6030 con 0x7f311015c0b0 2024-09-19T05:49:35.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:35.868+0000 7f3114a21640 1 -- 172.21.15.67:0/738997776 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f31100b28a0 con 0x7f311015c0b0 2024-09-19T05:49:36.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.140+0000 7f3106ffd640 1 -- 172.21.15.67:0/738997776 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v732) ==== 133+0+0 (secure 0 0 0) 0x7f311015a430 con 0x7f311015c0b0 2024-09-19T05:49:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 -- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30f00678c0 msgr2=0x7f30f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30f00678c0 0x7f30f0069d80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f310000b930 tx=0x7f3100008040 comp rx=0 tx=0).stop 2024-09-19T05:49:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 -- 172.21.15.67:0/738997776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f311015c0b0 msgr2=0x7f3110156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f311015c0b0 0x7f3110156a10 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7f31080af040 tx=0x7f3108019790 comp rx=0 tx=0).stop 2024-09-19T05:49:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 -- 172.21.15.67:0/738997776 shutdown_connections 2024-09-19T05:49:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f311015c0b0 0x7f3110156a10 unknown :-1 s=CLOSED pgs=2535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f30f00678c0 0x7f30f0069d80 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31100d04b0 0x7f31101564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:36.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 --2- 172.21.15.67:0/738997776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31100ad0c0 0x7f3110145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:36.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 -- 172.21.15.67:0/738997776 >> 172.21.15.67:0/738997776 conn(0x7f311006c040 msgr2=0x7f311015abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:36.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 -- 172.21.15.67:0/738997776 shutdown_connections 2024-09-19T05:49:36.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:36.144+0000 7f3114a21640 1 -- 172.21.15.67:0/738997776 wait complete. 2024-09-19T05:49:36.164 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ERROR 2024-09-19T05:49:36.164 INFO:tasks.cephfs_test_runner: 2024-09-19T05:49:36.164 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-19T05:49:36.164 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-19T05:49:36.165 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner: 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner:Ran 13 tests in 948.555s 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner: 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner: 2024-09-19T05:49:36.166 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-19T05:49:36.167 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-19T05:49:36.168 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-19T05:49:36.168 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-19T05:49:36.168 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-19T05:49:36.168 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-19T05:49:36.168 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-19T05:49:36.168 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-19T05:49:36.168 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-19T05:49:36.168 INFO:tasks.cephfs_test_runner: 2024-09-19T05:49:36.168 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-19T05:49:36.338 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a60acebb0a8948e2a1680f16b50e72ac Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-19T05:49:36.339 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-19T05:49:36.354 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T05:49:36.428 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T05:49:36.429 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:49:36.429 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:49:36.442 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:49:36.442 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-19T05:49:36.443 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:49:36.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T05:49:36.490 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:49:36.490 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:49:36.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:49:36.497 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-19T05:49:36.497 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:49:36.545 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336472k,nr_inodes=4084118,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17173 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T05:49:36.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:36.546 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-19T05:49:36.552 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T05:49:36.552 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:49:36.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:36.552 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T05:49:36.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:36.615 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:49:36.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:36.670 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-09-19T05:49:36.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:36.867 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2024-09-19T05:49:36.873 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T05:49:36.874 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T05:49:36.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:36.874 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T05:49:36.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:36.931 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T05:49:37.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:49:37.013 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link delete ceph-brx 2024-09-19T05:49:37.186 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-19T05:49:37.195 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:49:37.195 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:49:37.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1ef4ece640 1 Processor -- start 2024-09-19T05:49:37.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1ef4ece640 1 -- start start 2024-09-19T05:49:37.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1ef4ece640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef015b1a0 0x7f1ef006f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1ef4ece640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ef00d0cf0 0x7f1ef00b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1ef4ece640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef0073110 con 0x7f1ef00adc60 2024-09-19T05:49:37.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1ef4ece640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef00733f0 con 0x7f1ef00d0cf0 2024-09-19T05:49:37.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1ef4ece640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef00736d0 con 0x7f1ef015b1a0 2024-09-19T05:49:37.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1eeed9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ef00d0cf0 0x7f1ef00b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1eedd9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1ef00adc60 0x7f1ef00d05e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41512/0 (socket says 172.21.15.67:41512) 2024-09-19T05:49:37.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1eedd9b640 1 -- 172.21.15.67:0/1078991056 learned_addr learned my addr 172.21.15.67:0/1078991056 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:37.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1eeed9d640 1 --2- 172.21.15.67:0/1078991056 >> v2:172.21.15.67:3300/0 conn(0x7f1ef00d0cf0 0x7f1ef00b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42882/0 (socket says 172.21.15.67:42882) 2024-09-19T05:49:37.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1eee59c640 1 --2- 172.21.15.67:0/1078991056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef015b1a0 0x7f1ef006f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1eeed9d640 1 -- 172.21.15.67:0/1078991056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef015b1a0 msgr2=0x7f1ef006f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:37.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1eeed9d640 1 --2- 172.21.15.67:0/1078991056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef015b1a0 0x7f1ef006f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1eeed9d640 1 -- 172.21.15.67:0/1078991056 >> v1:172.21.15.67:6789/0 conn(0x7f1ef00adc60 legacy=0x7f1ef00d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1eed59a640 1 -- 172.21.15.67:0/1078991056 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468649673 0 0) 0x7f1ef0073110 con 0x7f1ef00adc60 2024-09-19T05:49:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.336+0000 7f1eeed9d640 1 -- 172.21.15.67:0/1078991056 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef00b3210 con 0x7f1ef00d0cf0 2024-09-19T05:49:37.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eeed9d640 1 --2- 172.21.15.67:0/1078991056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef00d0cf0 0x7f1ef00b3730 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800bfa0 tx=0x7f1ee801ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509c2997366da3ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:37.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eed59a640 1 -- 172.21.15.67:0/1078991056 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee800b2d0 con 0x7f1ef00d0cf0 2024-09-19T05:49:37.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eed59a640 1 -- 172.21.15.67:0/1078991056 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee80a7700 con 0x7f1ef00d0cf0 2024-09-19T05:49:37.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eed59a640 1 -- 172.21.15.67:0/1078991056 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80a7ad0 con 0x7f1ef00d0cf0 2024-09-19T05:49:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 -- 172.21.15.67:0/1078991056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef00d0cf0 msgr2=0x7f1ef00b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 --2- 172.21.15.67:0/1078991056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef00d0cf0 0x7f1ef00b3730 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800bfa0 tx=0x7f1ee801ea50 comp rx=0 tx=0).stop 2024-09-19T05:49:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 -- 172.21.15.67:0/1078991056 shutdown_connections 2024-09-19T05:49:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 --2- 172.21.15.67:0/1078991056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef00d0cf0 0x7f1ef00b3730 unknown :-1 s=CLOSED pgs=2537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 --2- 172.21.15.67:0/1078991056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef015b1a0 0x7f1ef006f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 -- 172.21.15.67:0/1078991056 >> 172.21.15.67:0/1078991056 conn(0x7f1ef006c040 msgr2=0x7f1ef006c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 -- 172.21.15.67:0/1078991056 shutdown_connections 2024-09-19T05:49:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 -- 172.21.15.67:0/1078991056 wait complete. 2024-09-19T05:49:37.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 Processor -- start 2024-09-19T05:49:37.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 -- start start 2024-09-19T05:49:37.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef00adc60 0x7f1ef0156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ef00d0cf0 0x7f1ef009a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef015b1a0 0x7f1ef00afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef006dfe0 con 0x7f1ef015b1a0 2024-09-19T05:49:37.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef006de60 con 0x7f1ef00d0cf0 2024-09-19T05:49:37.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef006e160 con 0x7f1ef00adc60 2024-09-19T05:49:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eeed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef015b1a0 0x7f1ef00afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eeed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef015b1a0 0x7f1ef00afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42884/0 (socket says 172.21.15.67:42884) 2024-09-19T05:49:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eeed9d640 1 -- 172.21.15.67:0/68772520 learned_addr learned my addr 172.21.15.67:0/68772520 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eee59c640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef00adc60 0x7f1ef0156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eedd9b640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ef00d0cf0 0x7f1ef009a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eeed9d640 1 -- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef00adc60 msgr2=0x7f1ef0156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eeed9d640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef00adc60 0x7f1ef0156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eeed9d640 1 -- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ef00d0cf0 msgr2=0x7f1ef009a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eeed9d640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ef00d0cf0 0x7f1ef009a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eeed9d640 1 -- 172.21.15.67:0/68772520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef009db60 con 0x7f1ef015b1a0 2024-09-19T05:49:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eedd9b640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ef00d0cf0 0x7f1ef009a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1eeed9d640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef015b1a0 0x7f1ef00afcc0 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80b1040 tx=0x7f1ee801b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1edeffd640 1 -- 172.21.15.67:0/68772520 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8009740 con 0x7f1ef015b1a0 2024-09-19T05:49:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1edeffd640 1 -- 172.21.15.67:0/68772520 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee80be070 con 0x7f1ef015b1a0 2024-09-19T05:49:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1edeffd640 1 -- 172.21.15.67:0/68772520 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8009b40 con 0x7f1ef015b1a0 2024-09-19T05:49:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.340+0000 7f1ef4ece640 1 -- 172.21.15.67:0/68772520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef009d5a0 con 0x7f1ef015b1a0 2024-09-19T05:49:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.344+0000 7f1ef4ece640 1 -- 172.21.15.67:0/68772520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef0156990 con 0x7f1ef015b1a0 2024-09-19T05:49:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.344+0000 7f1ef4ece640 1 -- 172.21.15.67:0/68772520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef00b3730 con 0x7f1ef015b1a0 2024-09-19T05:49:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.344+0000 7f1edeffd640 1 -- 172.21.15.67:0/68772520 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ee80b6070 con 0x7f1ef015b1a0 2024-09-19T05:49:37.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.344+0000 7f1edeffd640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ed00678c0 0x7f1ed0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.344+0000 7f1edeffd640 1 -- 172.21.15.67:0/68772520 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f1ee81207a0 con 0x7f1ef015b1a0 2024-09-19T05:49:37.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.344+0000 7f1eee59c640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ed00678c0 0x7f1ed0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.344+0000 7f1eee59c640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ed00678c0 0x7f1ed0069d80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000b930 tx=0x7f1ee0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.348+0000 7f1edeffd640 1 -- 172.21.15.67:0/68772520 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f1ee8018760 con 0x7f1ef015b1a0 2024-09-19T05:49:37.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.508+0000 7f1ef4ece640 1 -- 172.21.15.67:0/68772520 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ef015e900 con 0x7f1ed00678c0 2024-09-19T05:49:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1edeffd640 1 -- 172.21.15.67:0/68772520 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13525 (secure 0 0 0) 0x7f1ef015e900 con 0x7f1ed00678c0 2024-09-19T05:49:37.508 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:49:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 -- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ed00678c0 msgr2=0x7f1ed0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ed00678c0 0x7f1ed0069d80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000b930 tx=0x7f1ee0008040 comp rx=0 tx=0).stop 2024-09-19T05:49:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 -- 172.21.15.67:0/68772520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef015b1a0 msgr2=0x7f1ef00afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef015b1a0 0x7f1ef00afcc0 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80b1040 tx=0x7f1ee801b7f0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 -- 172.21.15.67:0/68772520 shutdown_connections 2024-09-19T05:49:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ef015b1a0 0x7f1ef00afcc0 unknown :-1 s=CLOSED pgs=2538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ef00d0cf0 0x7f1ef009a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f1ed00678c0 0x7f1ed0069d80 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 --2- 172.21.15.67:0/68772520 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef00adc60 0x7f1ef0156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 -- 172.21.15.67:0/68772520 >> 172.21.15.67:0/68772520 conn(0x7f1ef006c040 msgr2=0x7f1ef015dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:37.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 -- 172.21.15.67:0/68772520 shutdown_connections 2024-09-19T05:49:37.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.512+0000 7f1ef4ece640 1 -- 172.21.15.67:0/68772520 wait complete. 2024-09-19T05:49:37.528 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":701,"stamp":"2024-09-19T05:49:37.455227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":567324,"kb_used_data":31948,"kb_used_omap":12,"kb_used_meta":535219,"kb_avail":754407396,"statfs":{"total":773094113280,"available":772513173504,"internally_reserved":0,"allocated":32714752,"data_stored":21625655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":548064817},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6307574,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-76,"num_write_kb":-6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002150"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":517,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-19T05:49:36.807904+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:49:36.807904+0000","last_peered":"2024-09-19T05:49:36.807904+0000","last_clean":"2024-09-19T05:49:36.807904+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:49:36.807904+0000","last_undegraded":"2024-09-19T05:49:36.807904+0000","last_fullsized":"2024-09-19T05:49:36.807904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542345,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76640,"kb_used_data":5196,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295200,"statfs":{"total":96636764160,"available":96558284800,"internally_reserved":0,"allocated":5320704,"data_stored":3931035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542345,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74036,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297804,"statfs":{"total":96636764160,"available":96560951296,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542346,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51808,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320032,"statfs":{"total":96636764160,"available":96583712768,"internally_reserved":0,"allocated":2637824,"data_stored":1252785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542344,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78152,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293688,"statfs":{"total":96636764160,"available":96556736512,"internally_reserved":0,"allocated":2613248,"data_stored":1236344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542345,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73928,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297912,"statfs":{"total":96636764160,"available":96561061888,"internally_reserved":0,"allocated":2613248,"data_stored":1236276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542345,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78092,"kb_used_data":6652,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94293748,"statfs":{"total":96636764160,"available":96556797952,"internally_reserved":0,"allocated":6811648,"data_stored":5431174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51828,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320012,"statfs":{"total":96636764160,"available":96583692288,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542345,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82840,"kb_used_data":7236,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94289000,"statfs":{"total":96636764160,"available":96551936000,"internally_reserved":0,"allocated":7409664,"data_stored":6027515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:49:37.529 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:49:37.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f5943227640 1 Processor -- start 2024-09-19T05:49:37.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f5943227640 1 -- start start 2024-09-19T05:49:37.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f5943227640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f593c0b3af0 0x7f593c0d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f5943227640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f593c0d3310 con 0x7f593c0d2f10 2024-09-19T05:49:37.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f5943227640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f593c160010 con 0x7f593c15e510 2024-09-19T05:49:37.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f5943227640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f593c1602f0 con 0x7f593c0b3af0 2024-09-19T05:49:37.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f593bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f593c0b3af0 0x7f593c0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f59417c4640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f593c0d2f10 0x7f593c1610b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41520/0 (socket says 172.21.15.67:41520) 2024-09-19T05:49:37.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f59417c4640 1 -- 172.21.15.67:0/2532243023 learned_addr learned my addr 172.21.15.67:0/2532243023 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f593bfff640 1 -- 172.21.15.67:0/2532243023 >> v1:172.21.15.97:6789/0 conn(0x7f593c15e510 legacy=0x7f593c0d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f593bfff640 1 -- 172.21.15.67:0/2532243023 >> v1:172.21.15.67:6789/0 conn(0x7f593c0d2f10 legacy=0x7f593c1610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.660+0000 7f593bfff640 1 -- 172.21.15.67:0/2532243023 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c1605d0 con 0x7f593c0b3af0 2024-09-19T05:49:37.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593bfff640 1 --2- 172.21.15.67:0/2532243023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0b3af0 0x7f593c0d29d0 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7f5930009de0 tx=0x7f593001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200944ea80f28f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593b7fe640 1 -- 172.21.15.67:0/2532243023 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59300b2070 con 0x7f593c0b3af0 2024-09-19T05:49:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593b7fe640 1 -- 172.21.15.67:0/2532243023 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59300a5960 con 0x7f593c0b3af0 2024-09-19T05:49:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593b7fe640 1 -- 172.21.15.67:0/2532243023 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59300a5d30 con 0x7f593c0b3af0 2024-09-19T05:49:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 -- 172.21.15.67:0/2532243023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0b3af0 msgr2=0x7f593c0d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 --2- 172.21.15.67:0/2532243023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0b3af0 0x7f593c0d29d0 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7f5930009de0 tx=0x7f593001c9b0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 -- 172.21.15.67:0/2532243023 shutdown_connections 2024-09-19T05:49:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 --2- 172.21.15.67:0/2532243023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0b3af0 0x7f593c0d29d0 unknown :-1 s=CLOSED pgs=2540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 -- 172.21.15.67:0/2532243023 >> 172.21.15.67:0/2532243023 conn(0x7f593c08bff0 msgr2=0x7f593c0d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 -- 172.21.15.67:0/2532243023 shutdown_connections 2024-09-19T05:49:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 -- 172.21.15.67:0/2532243023 wait complete. 2024-09-19T05:49:37.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 Processor -- start 2024-09-19T05:49:37.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 -- start start 2024-09-19T05:49:37.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f593c0b3af0 0x7f593c14a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0d2f10 0x7f593c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f593c15e510 0x7f593c0b9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f593c15fa80 con 0x7f593c0d2f10 2024-09-19T05:49:37.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f593c15f900 con 0x7f593c15e510 2024-09-19T05:49:37.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f5943227640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f593c16c3e0 con 0x7f593c0b3af0 2024-09-19T05:49:37.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0d2f10 0x7f593c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0d2f10 0x7f593c0b8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42898/0 (socket says 172.21.15.67:42898) 2024-09-19T05:49:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593bfff640 1 -- 172.21.15.67:0/4157442671 learned_addr learned my addr 172.21.15.67:0/4157442671 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f59417c4640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f593c15e510 0x7f593c0b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593bfff640 1 -- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f593c0b3af0 msgr2=0x7f593c14a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593bfff640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f593c0b3af0 0x7f593c14a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593bfff640 1 -- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f593c15e510 msgr2=0x7f593c0b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593bfff640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f593c15e510 0x7f593c0b9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593bfff640 1 -- 172.21.15.67:0/4157442671 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c0b7580 con 0x7f593c0d2f10 2024-09-19T05:49:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f59417c4640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f593c15e510 0x7f593c0b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f593bfff640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0d2f10 0x7f593c0b8af0 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7f59300195c0 tx=0x7f5930019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.664+0000 7f59397fa640 1 -- 172.21.15.67:0/4157442671 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59300b2050 con 0x7f593c0d2f10 2024-09-19T05:49:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.668+0000 7f59397fa640 1 -- 172.21.15.67:0/4157442671 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59300be070 con 0x7f593c0d2f10 2024-09-19T05:49:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.668+0000 7f5943227640 1 -- 172.21.15.67:0/4157442671 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c15bdc0 con 0x7f593c0d2f10 2024-09-19T05:49:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.668+0000 7f59397fa640 1 -- 172.21.15.67:0/4157442671 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59300adbd0 con 0x7f593c0d2f10 2024-09-19T05:49:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.668+0000 7f5943227640 1 -- 172.21.15.67:0/4157442671 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c15c380 con 0x7f593c0d2f10 2024-09-19T05:49:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.668+0000 7f5943227640 1 -- 172.21.15.67:0/4157442671 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593c0d29d0 con 0x7f593c0d2f10 2024-09-19T05:49:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.668+0000 7f59397fa640 1 -- 172.21.15.67:0/4157442671 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59300c3460 con 0x7f593c0d2f10 2024-09-19T05:49:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.668+0000 7f59397fa640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59280678c0 0x7f5928069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.668+0000 7f59397fa640 1 -- 172.21.15.67:0/4157442671 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f5930121100 con 0x7f593c0d2f10 2024-09-19T05:49:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.668+0000 7f5940fc3640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59280678c0 0x7f5928069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.668+0000 7f5940fc3640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59280678c0 0x7f5928069d80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f592c000f70 tx=0x7f592c0079e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:37.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.672+0000 7f59397fa640 1 -- 172.21.15.67:0/4157442671 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f59300165a0 con 0x7f593c0d2f10 2024-09-19T05:49:37.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.832+0000 7f5943227640 1 -- 172.21.15.67:0/4157442671 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f593c0ba3b0 con 0x7f59280678c0 2024-09-19T05:49:37.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f59397fa640 1 -- 172.21.15.67:0/4157442671 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13525 (secure 0 0 0) 0x7f593c0ba3b0 con 0x7f59280678c0 2024-09-19T05:49:37.833 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:37.833 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:49:37.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 -- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59280678c0 msgr2=0x7f5928069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59280678c0 0x7f5928069d80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f592c000f70 tx=0x7f592c0079e0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 -- 172.21.15.67:0/4157442671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0d2f10 msgr2=0x7f593c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0d2f10 0x7f593c0b8af0 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7f59300195c0 tx=0x7f5930019750 comp rx=0 tx=0).stop 2024-09-19T05:49:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 -- 172.21.15.67:0/4157442671 shutdown_connections 2024-09-19T05:49:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f593c15e510 0x7f593c0b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f593c0d2f10 0x7f593c0b8af0 unknown :-1 s=CLOSED pgs=2541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f59280678c0 0x7f5928069d80 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 --2- 172.21.15.67:0/4157442671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f593c0b3af0 0x7f593c14a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 -- 172.21.15.67:0/4157442671 >> 172.21.15.67:0/4157442671 conn(0x7f593c08bff0 msgr2=0x7f593c06e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 -- 172.21.15.67:0/4157442671 shutdown_connections 2024-09-19T05:49:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.836+0000 7f5943227640 1 -- 172.21.15.67:0/4157442671 wait complete. 2024-09-19T05:49:37.851 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":701,"stamp":"2024-09-19T05:49:37.455227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":567324,"kb_used_data":31948,"kb_used_omap":12,"kb_used_meta":535219,"kb_avail":754407396,"statfs":{"total":773094113280,"available":772513173504,"internally_reserved":0,"allocated":32714752,"data_stored":21625655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":548064817},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6307574,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-76,"num_write_kb":-6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002150"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":517,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-19T05:49:36.807904+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:49:36.807904+0000","last_peered":"2024-09-19T05:49:36.807904+0000","last_clean":"2024-09-19T05:49:36.807904+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:49:36.807904+0000","last_undegraded":"2024-09-19T05:49:36.807904+0000","last_fullsized":"2024-09-19T05:49:36.807904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542345,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76640,"kb_used_data":5196,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295200,"statfs":{"total":96636764160,"available":96558284800,"internally_reserved":0,"allocated":5320704,"data_stored":3931035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542345,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74036,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297804,"statfs":{"total":96636764160,"available":96560951296,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542346,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51808,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320032,"statfs":{"total":96636764160,"available":96583712768,"internally_reserved":0,"allocated":2637824,"data_stored":1252785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542344,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78152,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293688,"statfs":{"total":96636764160,"available":96556736512,"internally_reserved":0,"allocated":2613248,"data_stored":1236344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542345,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73928,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297912,"statfs":{"total":96636764160,"available":96561061888,"internally_reserved":0,"allocated":2613248,"data_stored":1236276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542345,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78092,"kb_used_data":6652,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94293748,"statfs":{"total":96636764160,"available":96556797952,"internally_reserved":0,"allocated":6811648,"data_stored":5431174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51828,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320012,"statfs":{"total":96636764160,"available":96583692288,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542345,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82840,"kb_used_data":7236,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94289000,"statfs":{"total":96636764160,"available":96551936000,"internally_reserved":0,"allocated":7409664,"data_stored":6027515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:49:37.852 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:49:37.853 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:49:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.980+0000 7f9802bbb640 1 Processor -- start 2024-09-19T05:49:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.980+0000 7f9802bbb640 1 -- start start 2024-09-19T05:49:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.980+0000 7f9802bbb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97fc15c0b0 0x7f97fc071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.980+0000 7f9802bbb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f97fc0d0bc0 0x7f97fc0ad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.980+0000 7f9802bbb640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97fc06f770 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.980+0000 7f9802bbb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc15c8d0 con 0x7f97fc0d0bc0 2024-09-19T05:49:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.980+0000 7f9802bbb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc15cbb0 con 0x7f97fc15c0b0 2024-09-19T05:49:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f97fbfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f97fc0ad0c0 0x7f97fc0d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41524/0 (socket says 172.21.15.67:41524) 2024-09-19T05:49:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f97fbfff640 1 -- 172.21.15.67:0/1851503333 learned_addr learned my addr 172.21.15.67:0/1851503333 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9801158640 1 --2- 172.21.15.67:0/1851503333 >> v2:172.21.15.67:3300/0 conn(0x7f97fc0d0bc0 0x7f97fc0ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9800957640 1 --2- 172.21.15.67:0/1851503333 >> v2:172.21.15.97:3300/0 conn(0x7f97fc15c0b0 0x7f97fc071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f97fb7fe640 1 -- 172.21.15.67:0/1851503333 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 244014977 0 0) 0x7f97e4001120 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f97fb7fe640 1 -- 172.21.15.67:0/1851503333 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97e8003530 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9801158640 1 -- 172.21.15.67:0/1851503333 >> v2:172.21.15.97:3300/0 conn(0x7f97fc15c0b0 msgr2=0x7f97fc071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9801158640 1 --2- 172.21.15.67:0/1851503333 >> v2:172.21.15.97:3300/0 conn(0x7f97fc15c0b0 0x7f97fc071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9801158640 1 -- 172.21.15.67:0/1851503333 >> v1:172.21.15.67:6789/0 conn(0x7f97fc0ad0c0 legacy=0x7f97fc0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9801158640 1 -- 172.21.15.67:0/1851503333 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc15ce90 con 0x7f97fc0d0bc0 2024-09-19T05:49:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9801158640 1 --2- 172.21.15.67:0/1851503333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0d0bc0 0x7f97fc0ad510 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f97fc073e20 tx=0x7f97ec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ff0ee9745f3a0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f97fb7fe640 1 -- 172.21.15.67:0/1851503333 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0ab650 con 0x7f97fc0d0bc0 2024-09-19T05:49:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f97fb7fe640 1 -- 172.21.15.67:0/1851503333 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ec0b0070 con 0x7f97fc0d0bc0 2024-09-19T05:49:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f97fb7fe640 1 -- 172.21.15.67:0/1851503333 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0aba10 con 0x7f97fc0d0bc0 2024-09-19T05:49:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9802bbb640 1 -- 172.21.15.67:0/1851503333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0d0bc0 msgr2=0x7f97fc0ad510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9802bbb640 1 --2- 172.21.15.67:0/1851503333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0d0bc0 0x7f97fc0ad510 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f97fc073e20 tx=0x7f97ec01c450 comp rx=0 tx=0).stop 2024-09-19T05:49:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9802bbb640 1 -- 172.21.15.67:0/1851503333 shutdown_connections 2024-09-19T05:49:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9802bbb640 1 --2- 172.21.15.67:0/1851503333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0d0bc0 0x7f97fc0ad510 unknown :-1 s=CLOSED pgs=2543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9802bbb640 1 --2- 172.21.15.67:0/1851503333 >> v2:172.21.15.97:3300/0 conn(0x7f97fc15c0b0 0x7f97fc071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9802bbb640 1 -- 172.21.15.67:0/1851503333 >> 172.21.15.67:0/1851503333 conn(0x7f97fc06c040 msgr2=0x7f97fc06c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9802bbb640 1 -- 172.21.15.67:0/1851503333 shutdown_connections 2024-09-19T05:49:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.984+0000 7f9802bbb640 1 -- 172.21.15.67:0/1851503333 wait complete. 2024-09-19T05:49:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 Processor -- start 2024-09-19T05:49:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 -- start start 2024-09-19T05:49:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0ad0c0 0x7f97fc0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97fc0d0bc0 0x7f97fc09cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97fc15c0b0 0x7f97fc09d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc1686a0 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc168820 con 0x7f97fc15c0b0 2024-09-19T05:49:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc1689a0 con 0x7f97fc0d0bc0 2024-09-19T05:49:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9800957640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0ad0c0 0x7f97fc0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9800957640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0ad0c0 0x7f97fc0cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42912/0 (socket says 172.21.15.67:42912) 2024-09-19T05:49:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9800957640 1 -- 172.21.15.67:0/4172584285 learned_addr learned my addr 172.21.15.67:0/4172584285 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9800957640 1 -- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97fc0d0bc0 msgr2=0x7f97fc09cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9800957640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97fc0d0bc0 0x7f97fc09cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9801158640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97fc15c0b0 0x7f97fc09d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9800957640 1 -- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97fc15c0b0 msgr2=0x7f97fc09d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9800957640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97fc15c0b0 0x7f97fc09d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9800957640 1 -- 172.21.15.67:0/4172584285 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0b0800 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9800957640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0ad0c0 0x7f97fc0cf810 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f97f400efc0 tx=0x7f97f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f97f97fa640 1 -- 172.21.15.67:0/4172584285 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4018020 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f97f97fa640 1 -- 172.21.15.67:0/4172584285 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f4014480 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f97f97fa640 1 -- 172.21.15.67:0/4172584285 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4014850 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 -- 172.21.15.67:0/4172584285 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc0b0ae0 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 -- 172.21.15.67:0/4172584285 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc0b10a0 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.988+0000 7f9802bbb640 1 -- 172.21.15.67:0/4172584285 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc0ad510 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.992+0000 7f97f97fa640 1 -- 172.21.15.67:0/4172584285 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97f401b020 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.992+0000 7f97f97fa640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97dc0678f0 0x7f97dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.992+0000 7f97f97fa640 1 -- 172.21.15.67:0/4172584285 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f97f40865c0 con 0x7f97fc0ad0c0 2024-09-19T05:49:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.992+0000 7f97fbfff640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97dc0678f0 0x7f97dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.992+0000 7f97fbfff640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97dc0678f0 0x7f97dc069db0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f97e4000f70 tx=0x7f97e4001120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:37.996+0000 7f97f97fa640 1 -- 172.21.15.67:0/4172584285 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f97f4022070 con 0x7f97fc0ad0c0 2024-09-19T05:49:38.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.160+0000 7f9802bbb640 1 -- 172.21.15.67:0/4172584285 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97fc15b490 con 0x7f97dc0678f0 2024-09-19T05:49:38.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.160+0000 7f97f97fa640 1 -- 172.21.15.67:0/4172584285 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13525 (secure 0 0 0) 0x7f97fc15b490 con 0x7f97dc0678f0 2024-09-19T05:49:38.160 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:38.160 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:49:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 -- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97dc0678f0 msgr2=0x7f97dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97dc0678f0 0x7f97dc069db0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f97e4000f70 tx=0x7f97e4001120 comp rx=0 tx=0).stop 2024-09-19T05:49:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 -- 172.21.15.67:0/4172584285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0ad0c0 msgr2=0x7f97fc0cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0ad0c0 0x7f97fc0cf810 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f97f400efc0 tx=0x7f97f400c490 comp rx=0 tx=0).stop 2024-09-19T05:49:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 -- 172.21.15.67:0/4172584285 shutdown_connections 2024-09-19T05:49:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97fc15c0b0 0x7f97fc09d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f97dc0678f0 0x7f97dc069db0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97fc0d0bc0 0x7f97fc09cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 --2- 172.21.15.67:0/4172584285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97fc0ad0c0 0x7f97fc0cf810 unknown :-1 s=CLOSED pgs=2544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 -- 172.21.15.67:0/4172584285 >> 172.21.15.67:0/4172584285 conn(0x7f97fc06c040 msgr2=0x7f97fc1596b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 -- 172.21.15.67:0/4172584285 shutdown_connections 2024-09-19T05:49:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.164+0000 7f9802bbb640 1 -- 172.21.15.67:0/4172584285 wait complete. 2024-09-19T05:49:38.179 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":701,"stamp":"2024-09-19T05:49:37.455227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":567324,"kb_used_data":31948,"kb_used_omap":12,"kb_used_meta":535219,"kb_avail":754407396,"statfs":{"total":773094113280,"available":772513173504,"internally_reserved":0,"allocated":32714752,"data_stored":21625655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":548064817},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6307574,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-76,"num_write_kb":-6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002150"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":517,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-19T05:49:36.807904+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:49:36.807904+0000","last_peered":"2024-09-19T05:49:36.807904+0000","last_clean":"2024-09-19T05:49:36.807904+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:49:36.807904+0000","last_undegraded":"2024-09-19T05:49:36.807904+0000","last_fullsized":"2024-09-19T05:49:36.807904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542345,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76640,"kb_used_data":5196,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295200,"statfs":{"total":96636764160,"available":96558284800,"internally_reserved":0,"allocated":5320704,"data_stored":3931035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542345,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74036,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297804,"statfs":{"total":96636764160,"available":96560951296,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542346,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51808,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320032,"statfs":{"total":96636764160,"available":96583712768,"internally_reserved":0,"allocated":2637824,"data_stored":1252785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542344,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78152,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293688,"statfs":{"total":96636764160,"available":96556736512,"internally_reserved":0,"allocated":2613248,"data_stored":1236344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542345,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73928,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297912,"statfs":{"total":96636764160,"available":96561061888,"internally_reserved":0,"allocated":2613248,"data_stored":1236276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542345,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78092,"kb_used_data":6652,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94293748,"statfs":{"total":96636764160,"available":96556797952,"internally_reserved":0,"allocated":6811648,"data_stored":5431174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51828,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320012,"statfs":{"total":96636764160,"available":96583692288,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542345,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82840,"kb_used_data":7236,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94289000,"statfs":{"total":96636764160,"available":96551936000,"internally_reserved":0,"allocated":7409664,"data_stored":6027515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:49:38.180 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.304+0000 7f765e367640 1 Processor -- start 2024-09-19T05:49:38.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.304+0000 7f765e367640 1 -- start start 2024-09-19T05:49:38.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f765e367640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76580d0f10 0x7f76580d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:38.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f765e367640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f76580ceb50 0x7f76580cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:38.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f765e367640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76580d1830 con 0x7f76580b5ff0 2024-09-19T05:49:38.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f765e367640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f76580b43b0 con 0x7f76580ceb50 2024-09-19T05:49:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f765e367640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f76580b10d0 con 0x7f76580d0f10 2024-09-19T05:49:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f765c904640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f76580b5ff0 0x7f76580b6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41526/0 (socket says 172.21.15.67:41526) 2024-09-19T05:49:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f765c904640 1 -- 172.21.15.67:0/4142936492 learned_addr learned my addr 172.21.15.67:0/4142936492 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f76577fe640 1 --2- 172.21.15.67:0/4142936492 >> v2:172.21.15.97:3300/0 conn(0x7f76580ceb50 0x7f76580cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7657fff640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76580d0f10 0x7f76580d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2786407035 0 0) 0x7f76580d1830 con 0x7f76580b5ff0 2024-09-19T05:49:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7640003530 con 0x7f76580b5ff0 2024-09-19T05:49:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 955979977 0 0) 0x7f7640003530 con 0x7f76580b5ff0 2024-09-19T05:49:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76580d0f10 msgr2=0x7f76580d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76580d0f10 0x7f76580d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 >> v2:172.21.15.97:3300/0 conn(0x7f76580ceb50 msgr2=0x7f76580cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 --2- 172.21.15.67:0/4142936492 >> v2:172.21.15.97:3300/0 conn(0x7f76580ceb50 0x7f76580cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76580cf5a0 con 0x7f76580b5ff0 2024-09-19T05:49:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f7650001a00 con 0x7f76580b5ff0 2024-09-19T05:49:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 >> v1:172.21.15.67:6789/0 conn(0x7f76580b5ff0 legacy=0x7f76580b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76400039c0 0x7f7640003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 0x7f7640004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76580d0f10 0x7f76400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f76580b43b0 con 0x7f7640004810 2024-09-19T05:49:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f76580b10d0 con 0x7f76400039c0 2024-09-19T05:49:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f764000b9d0 con 0x7f76580d0f10 2024-09-19T05:49:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f76577fe640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 0x7f7640004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f7657fff640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76400039c0 0x7f7640003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f765c904640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76580d0f10 0x7f76400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:38.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f76577fe640 1 -- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76580d0f10 msgr2=0x7f76400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:38.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f76577fe640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76580d0f10 0x7f76400051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f76577fe640 1 -- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76400039c0 msgr2=0x7f7640003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:38.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f76577fe640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76400039c0 0x7f7640003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f76577fe640 1 -- 172.21.15.67:0/4142936492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7640003530 con 0x7f7640004810 2024-09-19T05:49:38.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.308+0000 7f76577fe640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 0x7f7640004c90 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7f764c009ab0 tx=0x7f764c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4477f08faac644cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:38.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c0b2070 con 0x7f7640004810 2024-09-19T05:49:38.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c0a55a0 con 0x7f7640004810 2024-09-19T05:49:38.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7656ffd640 1 -- 172.21.15.67:0/4142936492 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c0096b0 con 0x7f7640004810 2024-09-19T05:49:38.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 -- 172.21.15.67:0/4142936492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 msgr2=0x7f7640004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:38.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 --2- 172.21.15.67:0/4142936492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 0x7f7640004c90 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7f764c009ab0 tx=0x7f764c01ca90 comp rx=0 tx=0).stop 2024-09-19T05:49:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765c904640 1 -- 172.21.15.67:0/4142936492 reap_dead start 2024-09-19T05:49:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 -- 172.21.15.67:0/4142936492 shutdown_connections 2024-09-19T05:49:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 -- 172.21.15.67:0/4142936492 >> 172.21.15.67:0/4142936492 conn(0x7f765809d7e0 msgr2=0x7f765808bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 -- 172.21.15.67:0/4142936492 shutdown_connections 2024-09-19T05:49:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 -- 172.21.15.67:0/4142936492 wait complete. 2024-09-19T05:49:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 Processor -- start 2024-09-19T05:49:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 -- start start 2024-09-19T05:49:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 0x7f76580caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76580b7330 0x7f76580b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:38.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7658160570 0x7f76581609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:38.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f76580cfe40 con 0x7f7640004810 2024-09-19T05:49:38.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f76580cfb60 con 0x7f76580b7330 2024-09-19T05:49:38.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765e367640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f765815e900 con 0x7f7658160570 2024-09-19T05:49:38.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7657fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 0x7f76580caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:38.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7657fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 0x7f76580caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42940/0 (socket says 172.21.15.67:42940) 2024-09-19T05:49:38.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7657fff640 1 -- 172.21.15.67:0/1201650590 learned_addr learned my addr 172.21.15.67:0/1201650590 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:38.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f76577fe640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76580b7330 0x7f76580b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:38.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f765c904640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7658160570 0x7f76581609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:38.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7657fff640 1 -- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7658160570 msgr2=0x7f76581609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:38.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7657fff640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7658160570 0x7f76581609f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7657fff640 1 -- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76580b7330 msgr2=0x7f76580b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:38.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7657fff640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76580b7330 0x7f76580b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.312+0000 7f7657fff640 1 -- 172.21.15.67:0/1201650590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7658161180 con 0x7f7640004810 2024-09-19T05:49:38.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f7657fff640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 0x7f76580caa60 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 crypto rx=0x7f76480119a0 tx=0x7f7648011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:38.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f7654ff9640 1 -- 172.21.15.67:0/1201650590 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764800faf0 con 0x7f7640004810 2024-09-19T05:49:38.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f7654ff9640 1 -- 172.21.15.67:0/1201650590 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764800fc90 con 0x7f7640004810 2024-09-19T05:49:38.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f7654ff9640 1 -- 172.21.15.67:0/1201650590 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648014460 con 0x7f7640004810 2024-09-19T05:49:38.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f765e367640 1 -- 172.21.15.67:0/1201650590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76580cb670 con 0x7f7640004810 2024-09-19T05:49:38.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f765e367640 1 -- 172.21.15.67:0/1201650590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7658161460 con 0x7f7640004810 2024-09-19T05:49:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f765e367640 1 -- 172.21.15.67:0/1201650590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76580d2820 con 0x7f7640004810 2024-09-19T05:49:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f7654ff9640 1 -- 172.21.15.67:0/1201650590 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7648012040 con 0x7f7640004810 2024-09-19T05:49:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f7654ff9640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76440678c0 0x7f7644069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f7654ff9640 1 -- 172.21.15.67:0/1201650590 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f7648086640 con 0x7f7640004810 2024-09-19T05:49:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.316+0000 7f76577fe640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76440678c0 0x7f7644069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.320+0000 7f76577fe640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76440678c0 0x7f7644069d80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f764c0af000 tx=0x7f764c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:38.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.320+0000 7f7654ff9640 1 -- 172.21.15.67:0/1201650590 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f764802c080 con 0x7f7640004810 2024-09-19T05:49:38.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.484+0000 7f765e367640 1 -- 172.21.15.67:0/1201650590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76580b19c0 con 0x7f7640004810 2024-09-19T05:49:38.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.484+0000 7f7654ff9640 1 -- 172.21.15.67:0/1201650590 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v210) ==== 74+0+13279 (secure 0 0 0) 0x7f7648019030 con 0x7f7640004810 2024-09-19T05:49:38.483 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:38.484 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":210,"fsid":"dd76f598-8c3d-42aa-abf8-24c2f9728b78","created":"2024-09-19T05:32:50.315644+0000","modified":"2024-09-19T05:49:35.122261+0000","last_up_change":"2024-09-19T05:33:02.316771+0000","last_in_change":"2024-09-19T05:32:52.616116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:33:03.181927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"87ebf7df-59d2-4d0c-ab12-2168183fc2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6817","nonce":1029707859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6819","nonce":1029707859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6823","nonce":1029707859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1029707859},{"type":"v1","addr":"172.21.15.67:6821","nonce":1029707859}]},"public_addr":"172.21.15.67:6817/1029707859","cluster_addr":"172.21.15.67:6819/1029707859","heartbeat_back_addr":"172.21.15.67:6823/1029707859","heartbeat_front_addr":"172.21.15.67:6821/1029707859","state":["exists","up"]},{"osd":1,"uuid":"107bed39-5265-4ceb-bcb9-a136b4ce865c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6809","nonce":4222529913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6811","nonce":4222529913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6815","nonce":4222529913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":4222529913},{"type":"v1","addr":"172.21.15.67:6813","nonce":4222529913}]},"public_addr":"172.21.15.67:6809/4222529913","cluster_addr":"172.21.15.67:6811/4222529913","heartbeat_back_addr":"172.21.15.67:6815/4222529913","heartbeat_front_addr":"172.21.15.67:6813/4222529913","state":["exists","up"]},{"osd":2,"uuid":"29548f31-3605-4ea8-8df8-e81fc231c108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6825","nonce":3795893630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6827","nonce":3795893630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6831","nonce":3795893630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3795893630},{"type":"v1","addr":"172.21.15.67:6829","nonce":3795893630}]},"public_addr":"172.21.15.67:6825/3795893630","cluster_addr":"172.21.15.67:6827/3795893630","heartbeat_back_addr":"172.21.15.67:6831/3795893630","heartbeat_front_addr":"172.21.15.67:6829/3795893630","state":["exists","up"]},{"osd":3,"uuid":"9d87ca79-16a4-4477-a769-b67e2366d2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6801","nonce":1322632471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6803","nonce":1322632471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6807","nonce":1322632471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1322632471},{"type":"v1","addr":"172.21.15.67:6805","nonce":1322632471}]},"public_addr":"172.21.15.67:6801/1322632471","cluster_addr":"172.21.15.67:6803/1322632471","heartbeat_back_addr":"172.21.15.67:6807/1322632471","heartbeat_front_addr":"172.21.15.67:6805/1322632471","state":["exists","up"]},{"osd":4,"uuid":"965c2ff0-d4e2-432b-8ea8-44423ec51b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6804","nonce":1358994016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6808","nonce":1358994016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6815","nonce":1358994016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1358994016},{"type":"v1","addr":"172.21.15.97:6811","nonce":1358994016}]},"public_addr":"172.21.15.97:6804/1358994016","cluster_addr":"172.21.15.97:6808/1358994016","heartbeat_back_addr":"172.21.15.97:6815/1358994016","heartbeat_front_addr":"172.21.15.97:6811/1358994016","state":["exists","up"]},{"osd":5,"uuid":"18ec9c58-2074-4265-b302-5f366c996986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6825","nonce":112548817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6827","nonce":112548817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6831","nonce":112548817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":112548817},{"type":"v1","addr":"172.21.15.97:6829","nonce":112548817}]},"public_addr":"172.21.15.97:6825/112548817","cluster_addr":"172.21.15.97:6827/112548817","heartbeat_back_addr":"172.21.15.97:6831/112548817","heartbeat_front_addr":"172.21.15.97:6829/112548817","state":["exists","up"]},{"osd":6,"uuid":"55d1bccb-1876-4e18-a368-bd7c74ae178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6801","nonce":2892447445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6805","nonce":2892447445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6814","nonce":2892447445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":2892447445},{"type":"v1","addr":"172.21.15.97:6809","nonce":2892447445}]},"public_addr":"172.21.15.97:6801/2892447445","cluster_addr":"172.21.15.97:6805/2892447445","heartbeat_back_addr":"172.21.15.97:6814/2892447445","heartbeat_front_addr":"172.21.15.97:6809/2892447445","state":["exists","up"]},{"osd":7,"uuid":"0afdef64-e7cc-4586-94ea-75283cd56966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6817","nonce":3738159386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6819","nonce":3738159386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6823","nonce":3738159386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3738159386},{"type":"v1","addr":"172.21.15.97:6821","nonce":3738159386}]},"public_addr":"172.21.15.97:6817/3738159386","cluster_addr":"172.21.15.97:6819/3738159386","heartbeat_back_addr":"172.21.15.97:6823/3738159386","heartbeat_front_addr":"172.21.15.97:6821/3738159386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.050642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.912833+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.700609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.894570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.938972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.457413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:58.757005+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:32:59.189369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/1771202736":"2024-09-20T05:49:32.105881+0000","172.21.15.67:6834/1771202736":"2024-09-20T05:49:32.105881+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:49:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 -- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76440678c0 msgr2=0x7f7644069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76440678c0 0x7f7644069d80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f764c0af000 tx=0x7f764c0046d0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 -- 172.21.15.67:0/1201650590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 msgr2=0x7f76580caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:38.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 0x7f76580caa60 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 crypto rx=0x7f76480119a0 tx=0x7f7648011e60 comp rx=0 tx=0).stop 2024-09-19T05:49:38.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 -- 172.21.15.67:0/1201650590 shutdown_connections 2024-09-19T05:49:38.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f76440678c0 0x7f7644069d80 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7658160570 0x7f76581609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76580b7330 0x7f76580b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 --2- 172.21.15.67:0/1201650590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7640004810 0x7f76580caa60 unknown :-1 s=CLOSED pgs=2547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:38.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 -- 172.21.15.67:0/1201650590 >> 172.21.15.67:0/1201650590 conn(0x7f765809d7e0 msgr2=0x7f76580b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:38.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 -- 172.21.15.67:0/1201650590 shutdown_connections 2024-09-19T05:49:38.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:38.488+0000 7f765e367640 1 -- 172.21.15.67:0/1201650590 wait complete. 2024-09-19T05:49:39.502 INFO:tasks.ceph:Scrubbing osd.0 2024-09-19T05:49:39.502 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:49:39.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.643+0000 7fab6aa48640 1 Processor -- start 2024-09-19T05:49:39.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.643+0000 7fab6aa48640 1 -- start start 2024-09-19T05:49:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab6aa48640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab64070d40 0x7fab6409b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab6aa48640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab640700d0 0x7fab640d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab6aa48640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab64070560 con 0x7fab64162d30 2024-09-19T05:49:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab6aa48640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fab64162250 con 0x7fab64070d40 2024-09-19T05:49:39.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab6aa48640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fab64162530 con 0x7fab640700d0 2024-09-19T05:49:39.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab63fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab64070d40 0x7fab6409b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab63fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab64070d40 0x7fab6409b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42950/0 (socket says 172.21.15.67:42950) 2024-09-19T05:49:39.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab63fff640 1 -- 172.21.15.67:0/2190903997 learned_addr learned my addr 172.21.15.67:0/2190903997 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab637fe640 1 --2- 172.21.15.67:0/2190903997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab640700d0 0x7fab640d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab63fff640 1 -- 172.21.15.67:0/2190903997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab640700d0 msgr2=0x7fab640d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab63fff640 1 --2- 172.21.15.67:0/2190903997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab640700d0 0x7fab640d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab63fff640 1 -- 172.21.15.67:0/2190903997 >> v1:172.21.15.97:6789/0 conn(0x7fab64162d30 legacy=0x7fab640d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab63fff640 1 -- 172.21.15.67:0/2190903997 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab64162810 con 0x7fab64070d40 2024-09-19T05:49:39.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab63fff640 1 --2- 172.21.15.67:0/2190903997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab64070d40 0x7fab6409b720 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 crypto rx=0x7fab54009870 tx=0x7fab5401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b9312f23b3fae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:39.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab62ffd640 1 -- 172.21.15.67:0/2190903997 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab540b2070 con 0x7fab64070d40 2024-09-19T05:49:39.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab62ffd640 1 -- 172.21.15.67:0/2190903997 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab540a9070 con 0x7fab64070d40 2024-09-19T05:49:39.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.647+0000 7fab62ffd640 1 -- 172.21.15.67:0/2190903997 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab540ad880 con 0x7fab64070d40 2024-09-19T05:49:39.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- 172.21.15.67:0/2190903997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab64070d40 msgr2=0x7fab6409b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 --2- 172.21.15.67:0/2190903997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab64070d40 0x7fab6409b720 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 crypto rx=0x7fab54009870 tx=0x7fab5401c560 comp rx=0 tx=0).stop 2024-09-19T05:49:39.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- 172.21.15.67:0/2190903997 shutdown_connections 2024-09-19T05:49:39.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 --2- 172.21.15.67:0/2190903997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab640700d0 0x7fab640d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 --2- 172.21.15.67:0/2190903997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab64070d40 0x7fab6409b720 unknown :-1 s=CLOSED pgs=2548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- 172.21.15.67:0/2190903997 >> 172.21.15.67:0/2190903997 conn(0x7fab640d22c0 msgr2=0x7fab640d26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:39.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- 172.21.15.67:0/2190903997 shutdown_connections 2024-09-19T05:49:39.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- 172.21.15.67:0/2190903997 wait complete. 2024-09-19T05:49:39.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 Processor -- start 2024-09-19T05:49:39.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- start start 2024-09-19T05:49:39.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab64070d40 0x7fab640c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab64162d30 0x7fab640c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab640c6300 0x7fab64157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fab6415f9e0 con 0x7fab640c6300 2024-09-19T05:49:39.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fab6415f860 con 0x7fab64070d40 2024-09-19T05:49:39.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fab6416bc60 con 0x7fab64162d30 2024-09-19T05:49:39.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab68fe5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab640c6300 0x7fab64157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab68fe5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab640c6300 0x7fab64157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42956/0 (socket says 172.21.15.67:42956) 2024-09-19T05:49:39.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab68fe5640 1 -- 172.21.15.67:0/86673444 learned_addr learned my addr 172.21.15.67:0/86673444 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:39.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab63fff640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab64070d40 0x7fab640c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab637fe640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab64162d30 0x7fab640c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab68fe5640 1 -- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab64162d30 msgr2=0x7fab640c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab68fe5640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab64162d30 0x7fab640c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab68fe5640 1 -- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab64070d40 msgr2=0x7fab640c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab68fe5640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab64070d40 0x7fab640c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab68fe5640 1 -- 172.21.15.67:0/86673444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6406e680 con 0x7fab640c6300 2024-09-19T05:49:39.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab68fe5640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab640c6300 0x7fab64157df0 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c730 tx=0x7fab5c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:39.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab60ff9640 1 -- 172.21.15.67:0/86673444 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c003b80 con 0x7fab640c6300 2024-09-19T05:49:39.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab60ff9640 1 -- 172.21.15.67:0/86673444 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5c003d20 con 0x7fab640c6300 2024-09-19T05:49:39.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6406d8e0 con 0x7fab640c6300 2024-09-19T05:49:39.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab60ff9640 1 -- 172.21.15.67:0/86673444 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c005310 con 0x7fab640c6300 2024-09-19T05:49:39.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.651+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6406de80 con 0x7fab640c6300 2024-09-19T05:49:39.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab6409b720 con 0x7fab640c6300 2024-09-19T05:49:39.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab60ff9640 1 -- 172.21.15.67:0/86673444 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab5c0056c0 con 0x7fab640c6300 2024-09-19T05:49:39.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab60ff9640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab440678c0 0x7fab44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab60ff9640 1 -- 172.21.15.67:0/86673444 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fab5c086580 con 0x7fab640c6300 2024-09-19T05:49:39.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab60ff9640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x7fab4406dd60 0x7fab440701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab60ff9640 1 -- 172.21.15.67:0/86673444 --> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab44070870 con 0x7fab4406dd60 2024-09-19T05:49:39.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab60ff9640 1 -- 172.21.15.67:0/86673444 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) ==== 24+0+0 (secure 0 0 0) 0x7fab5c086a10 con 0x7fab640c6300 2024-09-19T05:49:39.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab637fe640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x7fab4406dd60 0x7fab440701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab63fff640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab440678c0 0x7fab44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab637fe640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x7fab4406dd60 0x7fab440701a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:39.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab63fff640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab440678c0 0x7fab44069d80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fab540af000 tx=0x7fab54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:39.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.655+0000 7fab60ff9640 1 -- 172.21.15.67:0/86673444 <== osd.0 v2:172.21.15.67:6816/1029707859 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab44070870 con 0x7fab4406dd60 2024-09-19T05:49:39.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 --> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fab640d2ef0 con 0x7fab4406dd60 2024-09-19T05:49:39.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab60ff9640 1 -- 172.21.15.67:0/86673444 <== osd.0 v2:172.21.15.67:6816/1029707859 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fab640d2ef0 con 0x7fab4406dd60 2024-09-19T05:49:39.670 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:49:39.670 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:49:39.670 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:49:39.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x7fab4406dd60 msgr2=0x7fab440701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.67:6816/1029707859,v1:172.21.15.67:6817/1029707859] conn(0x7fab4406dd60 0x7fab440701a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab440678c0 msgr2=0x7fab44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fab440678c0 0x7fab44069d80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fab540af000 tx=0x7fab54008040 comp rx=0 tx=0).stop 2024-09-19T05:49:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab640c6300 msgr2=0x7fab64157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 --2- 172.21.15.67:0/86673444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab640c6300 0x7fab64157df0 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c730 tx=0x7fab5c00cbf0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab68fe5640 1 -- 172.21.15.67:0/86673444 reap_dead start 2024-09-19T05:49:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 shutdown_connections 2024-09-19T05:49:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 >> 172.21.15.67:0/86673444 conn(0x7fab640d22c0 msgr2=0x7fab640b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 shutdown_connections 2024-09-19T05:49:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.671+0000 7fab6aa48640 1 -- 172.21.15.67:0/86673444 wait complete. 2024-09-19T05:49:39.685 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-19T05:49:39.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c434a640 1 Processor -- start 2024-09-19T05:49:39.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c434a640 1 -- start start 2024-09-19T05:49:39.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c434a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3bc15bef0 0x7fb3bc073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c434a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3bc15c2d0 0x7fb3bc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c434a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3bc0ad610 con 0x7fb3bc0b3d10 2024-09-19T05:49:39.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c434a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb3bc0ad8f0 con 0x7fb3bc15bef0 2024-09-19T05:49:39.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c434a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc0b3230 con 0x7fb3bc15c2d0 2024-09-19T05:49:39.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c20e6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3bc15bef0 0x7fb3bc073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c28e7640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb3bc0b3d10 0x7fb3bc15fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41530/0 (socket says 172.21.15.67:41530) 2024-09-19T05:49:39.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c28e7640 1 -- 172.21.15.67:0/2837547506 learned_addr learned my addr 172.21.15.67:0/2837547506 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:39.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c18e5640 1 --2- 172.21.15.67:0/2837547506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3bc15c2d0 0x7fb3bc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c20e6640 1 -- 172.21.15.67:0/2837547506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3bc15c2d0 msgr2=0x7fb3bc0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:39.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c20e6640 1 --2- 172.21.15.67:0/2837547506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3bc15c2d0 0x7fb3bc0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c20e6640 1 -- 172.21.15.67:0/2837547506 >> v1:172.21.15.67:6789/0 conn(0x7fb3bc0b3d10 legacy=0x7fb3bc15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.803+0000 7fb3c20e6640 1 -- 172.21.15.67:0/2837547506 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc0b3510 con 0x7fb3bc15bef0 2024-09-19T05:49:39.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c20e6640 1 --2- 172.21.15.67:0/2837547506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15bef0 0x7fb3bc073fd0 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80097c0 tx=0x7fb3b801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819f550a00950365 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:39.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c10e4640 1 -- 172.21.15.67:0/2837547506 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80b1070 con 0x7fb3bc15bef0 2024-09-19T05:49:39.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c10e4640 1 -- 172.21.15.67:0/2837547506 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b80ac410 con 0x7fb3bc15bef0 2024-09-19T05:49:39.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c10e4640 1 -- 172.21.15.67:0/2837547506 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80ac7e0 con 0x7fb3bc15bef0 2024-09-19T05:49:39.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 -- 172.21.15.67:0/2837547506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15bef0 msgr2=0x7fb3bc073fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 --2- 172.21.15.67:0/2837547506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15bef0 0x7fb3bc073fd0 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80097c0 tx=0x7fb3b801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 -- 172.21.15.67:0/2837547506 shutdown_connections 2024-09-19T05:49:39.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 --2- 172.21.15.67:0/2837547506 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3bc15c2d0 0x7fb3bc0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 --2- 172.21.15.67:0/2837547506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15bef0 0x7fb3bc073fd0 unknown :-1 s=CLOSED pgs=2551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 -- 172.21.15.67:0/2837547506 >> 172.21.15.67:0/2837547506 conn(0x7fb3bc06be10 msgr2=0x7fb3bc06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:39.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 -- 172.21.15.67:0/2837547506 shutdown_connections 2024-09-19T05:49:39.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 -- 172.21.15.67:0/2837547506 wait complete. 2024-09-19T05:49:39.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 Processor -- start 2024-09-19T05:49:39.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 -- start start 2024-09-19T05:49:39.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3bc0b3d10 0x7fb3bc099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3bc0b03f0 0x7fb3bc0b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15aa20 0x7fb3bc15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc168f50 con 0x7fb3bc15aa20 2024-09-19T05:49:39.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc0d0bc0 con 0x7fb3bc0b03f0 2024-09-19T05:49:39.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c434a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc1690d0 con 0x7fb3bc0b3d10 2024-09-19T05:49:39.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c28e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15aa20 0x7fb3bc15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c28e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15aa20 0x7fb3bc15aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42986/0 (socket says 172.21.15.67:42986) 2024-09-19T05:49:39.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.807+0000 7fb3c28e7640 1 -- 172.21.15.67:0/2583818914 learned_addr learned my addr 172.21.15.67:0/2583818914 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:39.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c18e5640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3bc0b03f0 0x7fb3bc0b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c20e6640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3bc0b3d10 0x7fb3bc099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c28e7640 1 -- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3bc0b3d10 msgr2=0x7fb3bc099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c28e7640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3bc0b3d10 0x7fb3bc099850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c28e7640 1 -- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3bc0b03f0 msgr2=0x7fb3bc0b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c28e7640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3bc0b03f0 0x7fb3bc0b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c28e7640 1 -- 172.21.15.67:0/2583818914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc06ef60 con 0x7fb3bc15aa20 2024-09-19T05:49:39.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c28e7640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15aa20 0x7fb3bc15aea0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400cbf0 tx=0x7fb3b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:39.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3b2ffd640 1 -- 172.21.15.67:0/2583818914 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4017070 con 0x7fb3bc15aa20 2024-09-19T05:49:39.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3b2ffd640 1 -- 172.21.15.67:0/2583818914 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b400ad40 con 0x7fb3bc15aa20 2024-09-19T05:49:39.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c434a640 1 -- 172.21.15.67:0/2583818914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3bc06f240 con 0x7fb3bc15aa20 2024-09-19T05:49:39.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3b2ffd640 1 -- 172.21.15.67:0/2583818914 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4012600 con 0x7fb3bc15aa20 2024-09-19T05:49:39.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c434a640 1 -- 172.21.15.67:0/2583818914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3bc06f800 con 0x7fb3bc15aa20 2024-09-19T05:49:39.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c434a640 1 -- 172.21.15.67:0/2583818914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3bc073fd0 con 0x7fb3bc15aa20 2024-09-19T05:49:39.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3b2ffd640 1 -- 172.21.15.67:0/2583818914 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3b401a070 con 0x7fb3bc15aa20 2024-09-19T05:49:39.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3b2ffd640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3a00678f0 0x7fb3a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:39.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3b2ffd640 1 -- 172.21.15.67:0/2583818914 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fb3b4085790 con 0x7fb3bc15aa20 2024-09-19T05:49:39.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c20e6640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3a00678f0 0x7fb3a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:39.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.811+0000 7fb3c20e6640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3a00678f0 0x7fb3a0069db0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80ae000 tx=0x7fb3b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:39.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.815+0000 7fb3b2ffd640 1 -- 172.21.15.67:0/2583818914 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fb3b4055df0 con 0x7fb3bc15aa20 2024-09-19T05:49:39.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.979+0000 7fb3c434a640 1 -- 172.21.15.67:0/2583818914 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb3bc1543b0 con 0x7fb3a00678f0 2024-09-19T05:49:39.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.979+0000 7fb3b2ffd640 1 -- 172.21.15.67:0/2583818914 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb3bc1543b0 con 0x7fb3a00678f0 2024-09-19T05:49:39.978 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 0 to deep-scrub 2024-09-19T05:49:39.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 -- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3a00678f0 msgr2=0x7fb3a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3a00678f0 0x7fb3a0069db0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80ae000 tx=0x7fb3b8008040 comp rx=0 tx=0).stop 2024-09-19T05:49:39.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 -- 172.21.15.67:0/2583818914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15aa20 msgr2=0x7fb3bc15aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:39.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15aa20 0x7fb3bc15aea0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400cbf0 tx=0x7fb3b400a430 comp rx=0 tx=0).stop 2024-09-19T05:49:39.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 -- 172.21.15.67:0/2583818914 shutdown_connections 2024-09-19T05:49:39.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc15aa20 0x7fb3bc15aea0 unknown :-1 s=CLOSED pgs=2552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3bc0b03f0 0x7fb3bc0b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fb3a00678f0 0x7fb3a0069db0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 --2- 172.21.15.67:0/2583818914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3bc0b3d10 0x7fb3bc099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:39.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 -- 172.21.15.67:0/2583818914 >> 172.21.15.67:0/2583818914 conn(0x7fb3bc06be10 msgr2=0x7fb3bc152790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:39.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 -- 172.21.15.67:0/2583818914 shutdown_connections 2024-09-19T05:49:39.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:39.983+0000 7fb3c434a640 1 -- 172.21.15.67:0/2583818914 wait complete. 2024-09-19T05:49:39.999 INFO:tasks.ceph:Scrubbing osd.1 2024-09-19T05:49:39.999 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:49:40.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.123+0000 7f5acb738640 1 Processor -- start 2024-09-19T05:49:40.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.123+0000 7f5acb738640 1 -- start start 2024-09-19T05:49:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.123+0000 7f5acb738640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ac406f6c0 0x7f5ac406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.123+0000 7f5acb738640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac40af560 con 0x7f5ac415c150 2024-09-19T05:49:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.123+0000 7f5acb738640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac415c530 con 0x7f5ac406be70 2024-09-19T05:49:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.123+0000 7f5acb738640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac40af830 con 0x7f5ac406f6c0 2024-09-19T05:49:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.123+0000 7f5ac8cd3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ac406f6c0 0x7f5ac406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.123+0000 7f5ac94d4640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5ac415c150 0x7f5ac40aee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41544/0 (socket says 172.21.15.67:41544) 2024-09-19T05:49:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.123+0000 7f5ac94d4640 1 -- 172.21.15.67:0/2183609919 learned_addr learned my addr 172.21.15.67:0/2183609919 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5ac8cd3640 1 -- 172.21.15.67:0/2183609919 >> v1:172.21.15.97:6789/0 conn(0x7f5ac406be70 legacy=0x7f5ac406c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5ac8cd3640 1 -- 172.21.15.67:0/2183609919 >> v1:172.21.15.67:6789/0 conn(0x7f5ac415c150 legacy=0x7f5ac40aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5ac8cd3640 1 -- 172.21.15.67:0/2183609919 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac40afb10 con 0x7f5ac406f6c0 2024-09-19T05:49:40.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5ac3fff640 1 -- 172.21.15.67:0/2183609919 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448486576 0 0) 0x7f5ac40af560 con 0x7f5ac415c150 2024-09-19T05:49:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5ac8cd3640 1 --2- 172.21.15.67:0/2183609919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac406f6c0 0x7f5ac406ea10 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80097c0 tx=0x7f5ab801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3db7d5e8eafbb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5ac3fff640 1 -- 172.21.15.67:0/2183609919 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80a7070 con 0x7f5ac406f6c0 2024-09-19T05:49:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5ac3fff640 1 -- 172.21.15.67:0/2183609919 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab80b0070 con 0x7f5ac406f6c0 2024-09-19T05:49:40.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5ac3fff640 1 -- 172.21.15.67:0/2183609919 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80ab890 con 0x7f5ac406f6c0 2024-09-19T05:49:40.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5acb738640 1 -- 172.21.15.67:0/2183609919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac406f6c0 msgr2=0x7f5ac406ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5acb738640 1 --2- 172.21.15.67:0/2183609919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac406f6c0 0x7f5ac406ea10 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80097c0 tx=0x7f5ab801c470 comp rx=0 tx=0).stop 2024-09-19T05:49:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5acb738640 1 -- 172.21.15.67:0/2183609919 shutdown_connections 2024-09-19T05:49:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5acb738640 1 --2- 172.21.15.67:0/2183609919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac406f6c0 0x7f5ac406ea10 unknown :-1 s=CLOSED pgs=2554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5acb738640 1 -- 172.21.15.67:0/2183609919 >> 172.21.15.67:0/2183609919 conn(0x7f5ac40b21e0 msgr2=0x7f5ac40b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5acb738640 1 -- 172.21.15.67:0/2183609919 shutdown_connections 2024-09-19T05:49:40.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.127+0000 7f5acb738640 1 -- 172.21.15.67:0/2183609919 wait complete. 2024-09-19T05:49:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 Processor -- start 2024-09-19T05:49:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 -- start start 2024-09-19T05:49:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ac406be70 0x7f5ac4148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ac406f6c0 0x7f5ac4166190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac415c150 0x7f5ac414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac40b3a70 con 0x7f5ac415c150 2024-09-19T05:49:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac40b38f0 con 0x7f5ac406be70 2024-09-19T05:49:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac40b3bf0 con 0x7f5ac406f6c0 2024-09-19T05:49:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac9cd5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac415c150 0x7f5ac414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac9cd5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac415c150 0x7f5ac414c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43016/0 (socket says 172.21.15.67:43016) 2024-09-19T05:49:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac9cd5640 1 -- 172.21.15.67:0/3899381265 learned_addr learned my addr 172.21.15.67:0/3899381265 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac94d4640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ac406be70 0x7f5ac4148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac8cd3640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ac406f6c0 0x7f5ac4166190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac9cd5640 1 -- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ac406f6c0 msgr2=0x7f5ac4166190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac9cd5640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ac406f6c0 0x7f5ac4166190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac9cd5640 1 -- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ac406be70 msgr2=0x7f5ac4148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac9cd5640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ac406be70 0x7f5ac4148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac9cd5640 1 -- 172.21.15.67:0/3899381265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac4149330 con 0x7f5ac415c150 2024-09-19T05:49:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac9cd5640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac415c150 0x7f5ac414c990 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c340 tx=0x7f5ab400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac1ffb640 1 -- 172.21.15.67:0/3899381265 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4005220 con 0x7f5ac415c150 2024-09-19T05:49:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac1ffb640 1 -- 172.21.15.67:0/3899381265 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab40053c0 con 0x7f5ac415c150 2024-09-19T05:49:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac41653d0 con 0x7f5ac415c150 2024-09-19T05:49:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac1ffb640 1 -- 172.21.15.67:0/3899381265 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4007270 con 0x7f5ac415c150 2024-09-19T05:49:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac4165990 con 0x7f5ac415c150 2024-09-19T05:49:40.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ac406ea10 con 0x7f5ac415c150 2024-09-19T05:49:40.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.131+0000 7f5ac1ffb640 1 -- 172.21.15.67:0/3899381265 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ab4019020 con 0x7f5ac415c150 2024-09-19T05:49:40.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.135+0000 7f5ac1ffb640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ab00678c0 0x7f5ab0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.135+0000 7f5ac1ffb640 1 -- 172.21.15.67:0/3899381265 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f5ab4085560 con 0x7f5ac415c150 2024-09-19T05:49:40.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.135+0000 7f5ac1ffb640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] conn(0x7f5ab006dd60 0x7f5ab00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.135+0000 7f5ac1ffb640 1 -- 172.21.15.67:0/3899381265 --> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ab401ee50 con 0x7f5ab006dd60 2024-09-19T05:49:40.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.135+0000 7f5ac1ffb640 1 -- 172.21.15.67:0/3899381265 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) ==== 24+0+0 (secure 0 0 0) 0x7f5ab40859f0 con 0x7f5ac415c150 2024-09-19T05:49:40.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.135+0000 7f5ac8cd3640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] conn(0x7f5ab006dd60 0x7f5ab00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.135+0000 7f5ac94d4640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ab00678c0 0x7f5ab0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.135+0000 7f5ac8cd3640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] conn(0x7f5ab006dd60 0x7f5ab00701a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.135+0000 7f5ac94d4640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ab00678c0 0x7f5ab0069d80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5abc007fd0 tx=0x7f5abc007f20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.135+0000 7f5ac1ffb640 1 -- 172.21.15.67:0/3899381265 <== osd.1 v2:172.21.15.67:6808/4222529913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ab401ee50 con 0x7f5ab006dd60 2024-09-19T05:49:40.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 --> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5ac40cf9d0 con 0x7f5ab006dd60 2024-09-19T05:49:40.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5ac1ffb640 1 -- 172.21.15.67:0/3899381265 <== osd.1 v2:172.21.15.67:6808/4222529913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5ac40cf9d0 con 0x7f5ab006dd60 2024-09-19T05:49:40.148 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:49:40.148 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:49:40.148 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:49:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 >> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] conn(0x7f5ab006dd60 msgr2=0x7f5ab00701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.67:6808/4222529913,v1:172.21.15.67:6809/4222529913] conn(0x7f5ab006dd60 0x7f5ab00701a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ab00678c0 msgr2=0x7f5ab0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f5ab00678c0 0x7f5ab0069d80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5abc007fd0 tx=0x7f5abc007f20 comp rx=0 tx=0).stop 2024-09-19T05:49:40.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac415c150 msgr2=0x7f5ac414c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 --2- 172.21.15.67:0/3899381265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac415c150 0x7f5ac414c990 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c340 tx=0x7f5ab400c800 comp rx=0 tx=0).stop 2024-09-19T05:49:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5ac9cd5640 1 -- 172.21.15.67:0/3899381265 reap_dead start 2024-09-19T05:49:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 shutdown_connections 2024-09-19T05:49:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 >> 172.21.15.67:0/3899381265 conn(0x7f5ac40b21e0 msgr2=0x7f5ac40b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 shutdown_connections 2024-09-19T05:49:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.147+0000 7f5acb738640 1 -- 172.21.15.67:0/3899381265 wait complete. 2024-09-19T05:49:40.165 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-19T05:49:40.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.283+0000 7f4cb5eeb640 1 Processor -- start 2024-09-19T05:49:40.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.283+0000 7f4cb5eeb640 1 -- start start 2024-09-19T05:49:40.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4cb009acc0 0x7f4cb00d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4cb00b4900 0x7f4cb00d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4cb009b0a0 0x7f4cb00d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb0070a90 con 0x7f4cb009acc0 2024-09-19T05:49:40.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb00ccb90 con 0x7f4cb00b4900 2024-09-19T05:49:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb0070ce0 con 0x7f4cb009b0a0 2024-09-19T05:49:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caf7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4cb009acc0 0x7f4cb00d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caf7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4cb009acc0 0x7f4cb00d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43028/0 (socket says 172.21.15.67:43028) 2024-09-19T05:49:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caf7fe640 1 -- 172.21.15.67:0/2380407467 learned_addr learned my addr 172.21.15.67:0/2380407467 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caf7fe640 1 -- 172.21.15.67:0/2380407467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4cb009b0a0 msgr2=0x7f4cb00d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caf7fe640 1 --2- 172.21.15.67:0/2380407467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4cb009b0a0 0x7f4cb00d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caf7fe640 1 -- 172.21.15.67:0/2380407467 >> v2:172.21.15.97:3300/0 conn(0x7f4cb00b4900 msgr2=0x7f4cb00d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4ca6ffd640 1 --2- 172.21.15.67:0/2380407467 >> v2:172.21.15.97:3300/0 conn(0x7f4cb00b4900 0x7f4cb00d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caf7fe640 1 --2- 172.21.15.67:0/2380407467 >> v2:172.21.15.97:3300/0 conn(0x7f4cb00b4900 0x7f4cb00d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caf7fe640 1 -- 172.21.15.67:0/2380407467 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb0070fc0 con 0x7f4cb009acc0 2024-09-19T05:49:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caf7fe640 1 --2- 172.21.15.67:0/2380407467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009acc0 0x7f4cb00d0160 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0073710 tx=0x7f4ca001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907e9a8c0db0b03a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caeffd640 1 -- 172.21.15.67:0/2380407467 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00b0070 con 0x7f4cb009acc0 2024-09-19T05:49:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caeffd640 1 -- 172.21.15.67:0/2380407467 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca00ab600 con 0x7f4cb009acc0 2024-09-19T05:49:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4caeffd640 1 -- 172.21.15.67:0/2380407467 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00ab9d0 con 0x7f4cb009acc0 2024-09-19T05:49:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/2380407467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009acc0 msgr2=0x7f4cb00d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 --2- 172.21.15.67:0/2380407467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009acc0 0x7f4cb00d0160 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0073710 tx=0x7f4ca001c520 comp rx=0 tx=0).stop 2024-09-19T05:49:40.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/2380407467 shutdown_connections 2024-09-19T05:49:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 --2- 172.21.15.67:0/2380407467 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4cb009b0a0 0x7f4cb00d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 --2- 172.21.15.67:0/2380407467 >> v2:172.21.15.97:3300/0 conn(0x7f4cb00b4900 0x7f4cb00d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 --2- 172.21.15.67:0/2380407467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009acc0 0x7f4cb00d0160 unknown :-1 s=CLOSED pgs=2556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/2380407467 >> 172.21.15.67:0/2380407467 conn(0x7f4cb00b3de0 msgr2=0x7f4cb00b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/2380407467 shutdown_connections 2024-09-19T05:49:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.287+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/2380407467 wait complete. 2024-09-19T05:49:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 Processor -- start 2024-09-19T05:49:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 -- start start 2024-09-19T05:49:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4cb009acc0 0x7f4cb0159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009b0a0 0x7f4cb0153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cb00b4900 0x7f4cb00cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0160fc0 con 0x7f4cb009b0a0 2024-09-19T05:49:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0160e40 con 0x7f4cb00b4900 2024-09-19T05:49:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb0161140 con 0x7f4cb009acc0 2024-09-19T05:49:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4ca6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009b0a0 0x7f4cb0153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4ca6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009b0a0 0x7f4cb0153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43038/0 (socket says 172.21.15.67:43038) 2024-09-19T05:49:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4ca6ffd640 1 -- 172.21.15.67:0/1174216755 learned_addr learned my addr 172.21.15.67:0/1174216755 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4caffff640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cb00b4900 0x7f4cb00cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4caf7fe640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4cb009acc0 0x7f4cb0159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4ca6ffd640 1 -- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4cb009acc0 msgr2=0x7f4cb0159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4ca6ffd640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4cb009acc0 0x7f4cb0159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4ca6ffd640 1 -- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cb00b4900 msgr2=0x7f4cb00cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4ca6ffd640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cb00b4900 0x7f4cb00cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4ca6ffd640 1 -- 172.21.15.67:0/1174216755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb00ce3a0 con 0x7f4cb009b0a0 2024-09-19T05:49:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4caf7fe640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4cb009acc0 0x7f4cb0159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4caffff640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cb00b4900 0x7f4cb00cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4ca6ffd640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009b0a0 0x7f4cb0153700 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c820 tx=0x7f4c9800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cacff9640 1 -- 172.21.15.67:0/1174216755 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98015070 con 0x7f4cb009b0a0 2024-09-19T05:49:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cacff9640 1 -- 172.21.15.67:0/1174216755 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c98004240 con 0x7f4cb009b0a0 2024-09-19T05:49:40.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/1174216755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb0153c40 con 0x7f4cb009b0a0 2024-09-19T05:49:40.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cacff9640 1 -- 172.21.15.67:0/1174216755 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800ce10 con 0x7f4cb009b0a0 2024-09-19T05:49:40.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/1174216755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb0158590 con 0x7f4cb009b0a0 2024-09-19T05:49:40.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/1174216755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb00d0920 con 0x7f4cb009b0a0 2024-09-19T05:49:40.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.291+0000 7f4cacff9640 1 -- 172.21.15.67:0/1174216755 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c98007830 con 0x7f4cb009b0a0 2024-09-19T05:49:40.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.295+0000 7f4cacff9640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4c900678c0 0x7f4c90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.295+0000 7f4cacff9640 1 -- 172.21.15.67:0/1174216755 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f4c980858e0 con 0x7f4cb009b0a0 2024-09-19T05:49:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.295+0000 7f4caf7fe640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4c900678c0 0x7f4c90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.295+0000 7f4caf7fe640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4c900678c0 0x7f4c90069d80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00ad000 tx=0x7f4ca0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.299+0000 7f4cacff9640 1 -- 172.21.15.67:0/1174216755 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f4cb0153c40 con 0x7f4cb009b0a0 2024-09-19T05:49:40.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.455+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/1174216755 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4cb00c5bc0 con 0x7f4c900678c0 2024-09-19T05:49:40.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.455+0000 7f4cacff9640 1 -- 172.21.15.67:0/1174216755 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4cb00c5bc0 con 0x7f4c900678c0 2024-09-19T05:49:40.454 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 1 to deep-scrub 2024-09-19T05:49:40.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4c900678c0 msgr2=0x7f4c90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4c900678c0 0x7f4c90069d80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00ad000 tx=0x7f4ca0008040 comp rx=0 tx=0).stop 2024-09-19T05:49:40.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/1174216755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009b0a0 msgr2=0x7f4cb0153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009b0a0 0x7f4cb0153700 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c820 tx=0x7f4c9800cce0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/1174216755 shutdown_connections 2024-09-19T05:49:40.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cb00b4900 0x7f4cb00cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb009b0a0 0x7f4cb0153700 unknown :-1 s=CLOSED pgs=2557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f4c900678c0 0x7f4c90069d80 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 --2- 172.21.15.67:0/1174216755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4cb009acc0 0x7f4cb0159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/1174216755 >> 172.21.15.67:0/1174216755 conn(0x7f4cb00b3de0 msgr2=0x7f4cb00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:40.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/1174216755 shutdown_connections 2024-09-19T05:49:40.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.459+0000 7f4cb5eeb640 1 -- 172.21.15.67:0/1174216755 wait complete. 2024-09-19T05:49:40.472 INFO:tasks.ceph:Scrubbing osd.2 2024-09-19T05:49:40.473 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:49:40.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.595+0000 7f73d42dc640 1 Processor -- start 2024-09-19T05:49:40.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.595+0000 7f73d42dc640 1 -- start start 2024-09-19T05:49:40.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.595+0000 7f73d42dc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f73cc0ae0d0 0x7f73cc0d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.595+0000 7f73d42dc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73cc15c9e0 con 0x7f73cc0b1710 2024-09-19T05:49:40.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.595+0000 7f73d42dc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73cc0ce600 con 0x7f73cc15c600 2024-09-19T05:49:40.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.595+0000 7f73d42dc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f73cc0ce8e0 con 0x7f73cc0ae0d0 2024-09-19T05:49:40.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.595+0000 7f73d2879640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f73cc0ae0d0 0x7f73cc0d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.595+0000 7f73d1877640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f73cc0b1710 0x7f73cc0d0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41556/0 (socket says 172.21.15.67:41556) 2024-09-19T05:49:40.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.595+0000 7f73d1877640 1 -- 172.21.15.67:0/3222699577 learned_addr learned my addr 172.21.15.67:0/3222699577 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:40.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d2879640 1 -- 172.21.15.67:0/3222699577 >> v1:172.21.15.97:6789/0 conn(0x7f73cc15c600 legacy=0x7f73cc0b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:40.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d2879640 1 -- 172.21.15.67:0/3222699577 >> v1:172.21.15.67:6789/0 conn(0x7f73cc0b1710 legacy=0x7f73cc0d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d1076640 1 -- 172.21.15.67:0/3222699577 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1563883617 0 0) 0x7f73cc15c9e0 con 0x7f73cc0b1710 2024-09-19T05:49:40.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d2879640 1 -- 172.21.15.67:0/3222699577 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc0cebc0 con 0x7f73cc0ae0d0 2024-09-19T05:49:40.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d2879640 1 --2- 172.21.15.67:0/3222699577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73cc0ae0d0 0x7f73cc0d0890 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 crypto rx=0x7f73c80097c0 tx=0x7f73c801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4827dbd3c104163f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d1076640 1 -- 172.21.15.67:0/3222699577 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c80b1070 con 0x7f73cc0ae0d0 2024-09-19T05:49:40.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d1076640 1 -- 172.21.15.67:0/3222699577 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c80ac5f0 con 0x7f73cc0ae0d0 2024-09-19T05:49:40.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d1076640 1 -- 172.21.15.67:0/3222699577 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c80ac9c0 con 0x7f73cc0ae0d0 2024-09-19T05:49:40.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d42dc640 1 -- 172.21.15.67:0/3222699577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73cc0ae0d0 msgr2=0x7f73cc0d0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d42dc640 1 --2- 172.21.15.67:0/3222699577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73cc0ae0d0 0x7f73cc0d0890 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 crypto rx=0x7f73c80097c0 tx=0x7f73c801c4a0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d42dc640 1 -- 172.21.15.67:0/3222699577 shutdown_connections 2024-09-19T05:49:40.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d42dc640 1 --2- 172.21.15.67:0/3222699577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73cc0ae0d0 0x7f73cc0d0890 unknown :-1 s=CLOSED pgs=2559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d42dc640 1 -- 172.21.15.67:0/3222699577 >> 172.21.15.67:0/3222699577 conn(0x7f73cc0b6830 msgr2=0x7f73cc0b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:40.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d42dc640 1 -- 172.21.15.67:0/3222699577 shutdown_connections 2024-09-19T05:49:40.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.599+0000 7f73d42dc640 1 -- 172.21.15.67:0/3222699577 wait complete. 2024-09-19T05:49:40.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 Processor -- start 2024-09-19T05:49:40.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 -- start start 2024-09-19T05:49:40.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73cc0ae0d0 0x7f73cc13caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73cc0b1710 0x7f73cc14e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73cc15c600 0x7f73cc14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc0b3890 con 0x7f73cc0b1710 2024-09-19T05:49:40.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc0b3710 con 0x7f73cc0ae0d0 2024-09-19T05:49:40.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f73cc0b3a10 con 0x7f73cc15c600 2024-09-19T05:49:40.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d1877640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73cc0b1710 0x7f73cc14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d1877640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73cc0b1710 0x7f73cc14e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43054/0 (socket says 172.21.15.67:43054) 2024-09-19T05:49:40.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d1877640 1 -- 172.21.15.67:0/1895803848 learned_addr learned my addr 172.21.15.67:0/1895803848 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:40.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d2879640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73cc15c600 0x7f73cc14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d2078640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73cc0ae0d0 0x7f73cc13caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d1877640 1 -- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73cc15c600 msgr2=0x7f73cc14edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d1877640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73cc15c600 0x7f73cc14edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d1877640 1 -- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73cc0ae0d0 msgr2=0x7f73cc13caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d1877640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73cc0ae0d0 0x7f73cc13caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d1877640 1 -- 172.21.15.67:0/1895803848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc152fb0 con 0x7f73cc0b1710 2024-09-19T05:49:40.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d2879640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f73cc15c600 0x7f73cc14edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:40.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d2078640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73cc0ae0d0 0x7f73cc13caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:40.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d1877640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73cc0b1710 0x7f73cc14e870 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00c4a0 tx=0x7f73bc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73c2ffd640 1 -- 172.21.15.67:0/1895803848 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc018070 con 0x7f73cc0b1710 2024-09-19T05:49:40.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73c2ffd640 1 -- 172.21.15.67:0/1895803848 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73bc0074e0 con 0x7f73cc0b1710 2024-09-19T05:49:40.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73c2ffd640 1 -- 172.21.15.67:0/1895803848 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc004a30 con 0x7f73cc0b1710 2024-09-19T05:49:40.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73cc1521f0 con 0x7f73cc0b1710 2024-09-19T05:49:40.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73cc1527b0 con 0x7f73cc0b1710 2024-09-19T05:49:40.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73cc0b1000 con 0x7f73cc0b1710 2024-09-19T05:49:40.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.603+0000 7f73c2ffd640 1 -- 172.21.15.67:0/1895803848 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73bc01b360 con 0x7f73cc0b1710 2024-09-19T05:49:40.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.607+0000 7f73c2ffd640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73b00678c0 0x7f73b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.607+0000 7f73c2ffd640 1 -- 172.21.15.67:0/1895803848 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f73bc085560 con 0x7f73cc0b1710 2024-09-19T05:49:40.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.607+0000 7f73c2ffd640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x7f73b006dd60 0x7f73b00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.607+0000 7f73c2ffd640 1 -- 172.21.15.67:0/1895803848 --> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73bc017ec0 con 0x7f73b006dd60 2024-09-19T05:49:40.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.607+0000 7f73c2ffd640 1 -- 172.21.15.67:0/1895803848 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) ==== 24+0+0 (secure 0 0 0) 0x7f73bc0859f0 con 0x7f73cc0b1710 2024-09-19T05:49:40.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.607+0000 7f73d2078640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73b00678c0 0x7f73b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.607+0000 7f73d2879640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x7f73b006dd60 0x7f73b00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.607+0000 7f73d2879640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x7f73b006dd60 0x7f73b00701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.607+0000 7f73d2078640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73b00678c0 0x7f73b0069d80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f73c4007fd0 tx=0x7f73c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.607+0000 7f73c2ffd640 1 -- 172.21.15.67:0/1895803848 <== osd.2 v2:172.21.15.67:6824/3795893630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73bc017ec0 con 0x7f73b006dd60 2024-09-19T05:49:40.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 --> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f73cc06f9a0 con 0x7f73b006dd60 2024-09-19T05:49:40.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73c2ffd640 1 -- 172.21.15.67:0/1895803848 <== osd.2 v2:172.21.15.67:6824/3795893630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f73cc06f9a0 con 0x7f73b006dd60 2024-09-19T05:49:40.620 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:49:40.620 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:49:40.620 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:49:40.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x7f73b006dd60 msgr2=0x7f73b00701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.67:6824/3795893630,v1:172.21.15.67:6825/3795893630] conn(0x7f73b006dd60 0x7f73b00701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73b00678c0 msgr2=0x7f73b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f73b00678c0 0x7f73b0069d80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f73c4007fd0 tx=0x7f73c4009040 comp rx=0 tx=0).stop 2024-09-19T05:49:40.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73cc0b1710 msgr2=0x7f73cc14e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 --2- 172.21.15.67:0/1895803848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73cc0b1710 0x7f73cc14e870 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00c4a0 tx=0x7f73bc00c960 comp rx=0 tx=0).stop 2024-09-19T05:49:40.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d2879640 1 -- 172.21.15.67:0/1895803848 reap_dead start 2024-09-19T05:49:40.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 shutdown_connections 2024-09-19T05:49:40.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 >> 172.21.15.67:0/1895803848 conn(0x7f73cc0b6830 msgr2=0x7f73cc06f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:40.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 shutdown_connections 2024-09-19T05:49:40.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.619+0000 7f73d42dc640 1 -- 172.21.15.67:0/1895803848 wait complete. 2024-09-19T05:49:40.636 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-19T05:49:40.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcf2a9a640 1 Processor -- start 2024-09-19T05:49:40.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcf2a9a640 1 -- start start 2024-09-19T05:49:40.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcf2a9a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec15bef0 0x7fbcec073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcf2a9a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbcec0d0980 0x7fbcec071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcf2a9a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcec0ad610 con 0x7fbcec15c2d0 2024-09-19T05:49:40.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcf2a9a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fbcec0ad8f0 con 0x7fbcec0d0980 2024-09-19T05:49:40.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcf2a9a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbcec0b3230 con 0x7fbcec15bef0 2024-09-19T05:49:40.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcebfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbcec15c2d0 0x7fbcec0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41560/0 (socket says 172.21.15.67:41560) 2024-09-19T05:49:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcebfff640 1 -- 172.21.15.67:0/1099822437 learned_addr learned my addr 172.21.15.67:0/1099822437 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcf1037640 1 --2- 172.21.15.67:0/1099822437 >> v2:172.21.15.97:3300/0 conn(0x7fbcec0d0980 0x7fbcec071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcf0836640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec15bef0 0x7fbcec073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452345394 0 0) 0x7fbcec0ad610 con 0x7fbcec15c2d0 2024-09-19T05:49:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd8003530 con 0x7fbcec15c2d0 2024-09-19T05:49:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 302736700 0 0) 0x7fbcd8003530 con 0x7fbcec15c2d0 2024-09-19T05:49:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec15bef0 msgr2=0x7fbcec073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec15bef0 0x7fbcec073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 >> v2:172.21.15.97:3300/0 conn(0x7fbcec0d0980 msgr2=0x7fbcec071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 --2- 172.21.15.67:0/1099822437 >> v2:172.21.15.97:3300/0 conn(0x7fbcec0d0980 0x7fbcec071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec0b3510 con 0x7fbcec15c2d0 2024-09-19T05:49:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7fbcd4001a00 con 0x7fbcec15c2d0 2024-09-19T05:49:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 >> v1:172.21.15.67:6789/0 conn(0x7fbcec15c2d0 legacy=0x7fbcec0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec15bef0 0x7fbcd80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 0x7fbcd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd8004d50 0x7fbcd80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0ad8f0 con 0x7fbcd8003f40 2024-09-19T05:49:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0b3230 con 0x7fbcd8004d50 2024-09-19T05:49:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd800b9d0 con 0x7fbcec15bef0 2024-09-19T05:49:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.751+0000 7fbcebfff640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 0x7fbcd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcf1037640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd8004d50 0x7fbcd80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcf0836640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec15bef0 0x7fbcd80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcebfff640 1 -- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec15bef0 msgr2=0x7fbcd80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcebfff640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec15bef0 0x7fbcd80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcebfff640 1 -- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd8004d50 msgr2=0x7fbcd80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:40.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcebfff640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd8004d50 0x7fbcd80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcebfff640 1 -- 172.21.15.67:0/1099822437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd8003530 con 0x7fbcd8003f40 2024-09-19T05:49:40.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcf0836640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec15bef0 0x7fbcd80039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:40.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcebfff640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 0x7fbcd8004810 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 crypto rx=0x7fbcec15fba0 tx=0x7fbcd401fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd5f99ebe96f5a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd400a4a0 con 0x7fbcd8003f40 2024-09-19T05:49:40.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd40aa6f0 con 0x7fbcd8003f40 2024-09-19T05:49:40.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbceb7fe640 1 -- 172.21.15.67:0/1099822437 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40aab20 con 0x7fbcd8003f40 2024-09-19T05:49:40.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/1099822437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 msgr2=0x7fbcd8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcf2a9a640 1 --2- 172.21.15.67:0/1099822437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 0x7fbcd8004810 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 crypto rx=0x7fbcec15fba0 tx=0x7fbcd401fa40 comp rx=0 tx=0).stop 2024-09-19T05:49:40.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcf1037640 1 -- 172.21.15.67:0/1099822437 reap_dead start 2024-09-19T05:49:40.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/1099822437 shutdown_connections 2024-09-19T05:49:40.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/1099822437 >> 172.21.15.67:0/1099822437 conn(0x7fbcec06be10 msgr2=0x7fbcec06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:40.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/1099822437 shutdown_connections 2024-09-19T05:49:40.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.755+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/1099822437 wait complete. 2024-09-19T05:49:40.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 Processor -- start 2024-09-19T05:49:40.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 -- start start 2024-09-19T05:49:40.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 0x7fbcec159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec154ad0 0x7fbcec15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcec15afd0 0x7fbcec09d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0b3d10 con 0x7fbcd8003f40 2024-09-19T05:49:40.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0cf820 con 0x7fbcec15afd0 2024-09-19T05:49:40.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fbcec0b3e90 con 0x7fbcec154ad0 2024-09-19T05:49:40.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf0836640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 0x7fbcec159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf0836640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 0x7fbcec159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43062/0 (socket says 172.21.15.67:43062) 2024-09-19T05:49:40.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf0836640 1 -- 172.21.15.67:0/667133860 learned_addr learned my addr 172.21.15.67:0/667133860 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:40.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcebfff640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec154ad0 0x7fbcec15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf1037640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcec15afd0 0x7fbcec09d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf0836640 1 -- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec154ad0 msgr2=0x7fbcec15a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf0836640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec154ad0 0x7fbcec15a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf0836640 1 -- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcec15afd0 msgr2=0x7fbcec09d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf0836640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcec15afd0 0x7fbcec09d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf0836640 1 -- 172.21.15.67:0/667133860 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec15b520 con 0x7fbcd8003f40 2024-09-19T05:49:40.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf1037640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcec15afd0 0x7fbcec09d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:40.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf0836640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 0x7fbcec159ed0 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7fbce4010930 tx=0x7fbce4010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbce97fa640 1 -- 172.21.15.67:0/667133860 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce400f040 con 0x7fbcd8003f40 2024-09-19T05:49:40.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbce97fa640 1 -- 172.21.15.67:0/667133860 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce400ec20 con 0x7fbcd8003f40 2024-09-19T05:49:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/667133860 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcec06e830 con 0x7fbcd8003f40 2024-09-19T05:49:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbce97fa640 1 -- 172.21.15.67:0/667133860 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4004020 con 0x7fbcd8003f40 2024-09-19T05:49:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/667133860 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcec06edf0 con 0x7fbcd8003f40 2024-09-19T05:49:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/667133860 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcec0ad050 con 0x7fbcd8003f40 2024-09-19T05:49:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.759+0000 7fbce97fa640 1 -- 172.21.15.67:0/667133860 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbce40041c0 con 0x7fbcd8003f40 2024-09-19T05:49:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.763+0000 7fbce97fa640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbccc0678c0 0x7fbccc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.763+0000 7fbce97fa640 1 -- 172.21.15.67:0/667133860 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fbce4085f40 con 0x7fbcd8003f40 2024-09-19T05:49:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.763+0000 7fbcebfff640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbccc0678c0 0x7fbccc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:40.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.763+0000 7fbcebfff640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbccc0678c0 0x7fbccc069d80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40b1000 tx=0x7fbcd4007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:40.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.767+0000 7fbce97fa640 1 -- 172.21.15.67:0/667133860 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fbce4018030 con 0x7fbcd8003f40 2024-09-19T05:49:40.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.923+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/667133860 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fbcec0736d0 con 0x7fbccc0678c0 2024-09-19T05:49:40.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.923+0000 7fbce97fa640 1 -- 172.21.15.67:0/667133860 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbcec0736d0 con 0x7fbccc0678c0 2024-09-19T05:49:40.924 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 2 to deep-scrub 2024-09-19T05:49:40.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbccc0678c0 msgr2=0x7fbccc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbccc0678c0 0x7fbccc069d80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40b1000 tx=0x7fbcd4007040 comp rx=0 tx=0).stop 2024-09-19T05:49:40.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/667133860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 msgr2=0x7fbcec159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:40.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 0x7fbcec159ed0 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7fbce4010930 tx=0x7fbce4010df0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/667133860 shutdown_connections 2024-09-19T05:49:40.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcec15afd0 0x7fbcec09d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fbccc0678c0 0x7fbccc069d80 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcec154ad0 0x7fbcec15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 --2- 172.21.15.67:0/667133860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbcd8003f40 0x7fbcec159ed0 unknown :-1 s=CLOSED pgs=2563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:40.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/667133860 >> 172.21.15.67:0/667133860 conn(0x7fbcec06be10 msgr2=0x7fbcec15cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:40.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/667133860 shutdown_connections 2024-09-19T05:49:40.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:40.927+0000 7fbcf2a9a640 1 -- 172.21.15.67:0/667133860 wait complete. 2024-09-19T05:49:40.942 INFO:tasks.ceph:Scrubbing osd.3 2024-09-19T05:49:40.942 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:49:41.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82fea7640 1 Processor -- start 2024-09-19T05:49:41.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82fea7640 1 -- start start 2024-09-19T05:49:41.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82fea7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc828147ee0 0x7fc8280b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82fea7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc8280b2a40 0x7fc82806bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82fea7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc82806c180 0x7fc82815eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82fea7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc8280ca510 con 0x7fc828147ee0 2024-09-19T05:49:41.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82fea7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc8281482c0 con 0x7fc8280b2a40 2024-09-19T05:49:41.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82fea7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc82815fd50 con 0x7fc82806c180 2024-09-19T05:49:41.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82dc43640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc828147ee0 0x7fc8280b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82dc43640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc828147ee0 0x7fc8280b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43070/0 (socket says 172.21.15.67:43070) 2024-09-19T05:49:41.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82dc43640 1 -- 172.21.15.67:0/2127299842 learned_addr learned my addr 172.21.15.67:0/2127299842 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:41.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82d442640 1 --2- 172.21.15.67:0/2127299842 >> v2:172.21.15.97:3300/0 conn(0x7fc8280b2a40 0x7fc82806bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82e444640 1 --2- 172.21.15.67:0/2127299842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc82806c180 0x7fc82815eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82dc43640 1 -- 172.21.15.67:0/2127299842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc82806c180 msgr2=0x7fc82815eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:41.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82dc43640 1 --2- 172.21.15.67:0/2127299842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc82806c180 0x7fc82815eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82dc43640 1 -- 172.21.15.67:0/2127299842 >> v2:172.21.15.97:3300/0 conn(0x7fc8280b2a40 msgr2=0x7fc82806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:41.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82dc43640 1 --2- 172.21.15.67:0/2127299842 >> v2:172.21.15.97:3300/0 conn(0x7fc8280b2a40 0x7fc82806bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.071+0000 7fc82dc43640 1 -- 172.21.15.67:0/2127299842 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc828160030 con 0x7fc828147ee0 2024-09-19T05:49:41.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82dc43640 1 --2- 172.21.15.67:0/2127299842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828147ee0 0x7fc8280b2500 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7fc824009870 tx=0x7fc82401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9342961aa41155c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82cc41640 1 -- 172.21.15.67:0/2127299842 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8240b1070 con 0x7fc828147ee0 2024-09-19T05:49:41.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82cc41640 1 -- 172.21.15.67:0/2127299842 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8240ac630 con 0x7fc828147ee0 2024-09-19T05:49:41.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82cc41640 1 -- 172.21.15.67:0/2127299842 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8240a8050 con 0x7fc828147ee0 2024-09-19T05:49:41.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 -- 172.21.15.67:0/2127299842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828147ee0 msgr2=0x7fc8280b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 --2- 172.21.15.67:0/2127299842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828147ee0 0x7fc8280b2500 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7fc824009870 tx=0x7fc82401c520 comp rx=0 tx=0).stop 2024-09-19T05:49:41.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 -- 172.21.15.67:0/2127299842 shutdown_connections 2024-09-19T05:49:41.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 --2- 172.21.15.67:0/2127299842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc82806c180 0x7fc82815eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 --2- 172.21.15.67:0/2127299842 >> v2:172.21.15.97:3300/0 conn(0x7fc8280b2a40 0x7fc82806bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 --2- 172.21.15.67:0/2127299842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828147ee0 0x7fc8280b2500 unknown :-1 s=CLOSED pgs=2564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 -- 172.21.15.67:0/2127299842 >> 172.21.15.67:0/2127299842 conn(0x7fc82809aa60 msgr2=0x7fc8280b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:41.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 -- 172.21.15.67:0/2127299842 shutdown_connections 2024-09-19T05:49:41.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 -- 172.21.15.67:0/2127299842 wait complete. 2024-09-19T05:49:41.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 Processor -- start 2024-09-19T05:49:41.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.075+0000 7fc82fea7640 1 -- start start 2024-09-19T05:49:41.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82fea7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82806c180 0x7fc8280cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82fea7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8280b2a40 0x7fc8281442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82fea7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828147ee0 0x7fc828144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82fea7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc828160df0 con 0x7fc828147ee0 2024-09-19T05:49:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82fea7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc8280b7050 con 0x7fc82806c180 2024-09-19T05:49:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82fea7640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fc828160f70 con 0x7fc8280b2a40 2024-09-19T05:49:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82e444640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828147ee0 0x7fc828144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82e444640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828147ee0 0x7fc828144830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43082/0 (socket says 172.21.15.67:43082) 2024-09-19T05:49:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82e444640 1 -- 172.21.15.67:0/2069744872 learned_addr learned my addr 172.21.15.67:0/2069744872 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82dc43640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82806c180 0x7fc8280cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82d442640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8280b2a40 0x7fc8281442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82e444640 1 -- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8280b2a40 msgr2=0x7fc8281442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82e444640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8280b2a40 0x7fc8281442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82e444640 1 -- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82806c180 msgr2=0x7fc8280cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82e444640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82806c180 0x7fc8280cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82e444640 1 -- 172.21.15.67:0/2069744872 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8280ccf80 con 0x7fc828147ee0 2024-09-19T05:49:41.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82e444640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828147ee0 0x7fc828144830 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 crypto rx=0x7fc820007e60 tx=0x7fc82000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc81a7fc640 1 -- 172.21.15.67:0/2069744872 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820014620 con 0x7fc828147ee0 2024-09-19T05:49:41.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc81a7fc640 1 -- 172.21.15.67:0/2069744872 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc820019070 con 0x7fc828147ee0 2024-09-19T05:49:41.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82813c840 con 0x7fc828147ee0 2024-09-19T05:49:41.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc81a7fc640 1 -- 172.21.15.67:0/2069744872 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820014a20 con 0x7fc828147ee0 2024-09-19T05:49:41.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82813ce00 con 0x7fc828147ee0 2024-09-19T05:49:41.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc82806bc40 con 0x7fc828147ee0 2024-09-19T05:49:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc81a7fc640 1 -- 172.21.15.67:0/2069744872 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc820014bc0 con 0x7fc828147ee0 2024-09-19T05:49:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc81a7fc640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc80c0678c0 0x7fc80c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc81a7fc640 1 -- 172.21.15.67:0/2069744872 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fc820086390 con 0x7fc828147ee0 2024-09-19T05:49:41.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc81a7fc640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] conn(0x7fc80c06dd60 0x7fc80c0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc81a7fc640 1 -- 172.21.15.67:0/2069744872 --> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc82001aec0 con 0x7fc80c06dd60 2024-09-19T05:49:41.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc81a7fc640 1 -- 172.21.15.67:0/2069744872 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) ==== 24+0+0 (secure 0 0 0) 0x7fc82008d050 con 0x7fc828147ee0 2024-09-19T05:49:41.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82d442640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] conn(0x7fc80c06dd60 0x7fc80c0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82dc43640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc80c0678c0 0x7fc80c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.079+0000 7fc82d442640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] conn(0x7fc80c06dd60 0x7fc80c0701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.083+0000 7fc82dc43640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc80c0678c0 0x7fc80c069d80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc8240ae000 tx=0x7fc824008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.083+0000 7fc81a7fc640 1 -- 172.21.15.67:0/2069744872 <== osd.3 v2:172.21.15.67:6800/1322632471 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc82001aec0 con 0x7fc80c06dd60 2024-09-19T05:49:41.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 --> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc82809f4e0 con 0x7fc80c06dd60 2024-09-19T05:49:41.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc81a7fc640 1 -- 172.21.15.67:0/2069744872 <== osd.3 v2:172.21.15.67:6800/1322632471 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc82809f4e0 con 0x7fc80c06dd60 2024-09-19T05:49:41.094 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:49:41.094 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:49:41.094 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:49:41.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 >> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] conn(0x7fc80c06dd60 msgr2=0x7fc80c0701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.67:6800/1322632471,v1:172.21.15.67:6801/1322632471] conn(0x7fc80c06dd60 0x7fc80c0701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc80c0678c0 msgr2=0x7fc80c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fc80c0678c0 0x7fc80c069d80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc8240ae000 tx=0x7fc824008040 comp rx=0 tx=0).stop 2024-09-19T05:49:41.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828147ee0 msgr2=0x7fc828144830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 --2- 172.21.15.67:0/2069744872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828147ee0 0x7fc828144830 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 crypto rx=0x7fc820007e60 tx=0x7fc82000e4b0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82e444640 1 -- 172.21.15.67:0/2069744872 reap_dead start 2024-09-19T05:49:41.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 shutdown_connections 2024-09-19T05:49:41.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 >> 172.21.15.67:0/2069744872 conn(0x7fc82809aa60 msgr2=0x7fc82815e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:41.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 shutdown_connections 2024-09-19T05:49:41.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.095+0000 7fc82fea7640 1 -- 172.21.15.67:0/2069744872 wait complete. 2024-09-19T05:49:41.110 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-19T05:49:41.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c9d00640 1 Processor -- start 2024-09-19T05:49:41.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c9d00640 1 -- start start 2024-09-19T05:49:41.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c9d00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5c4155620 0x7fa5c406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c9d00640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa5c40d0270 0x7fa5c40d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c9d00640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c40adf20 con 0x7fa5c415c310 2024-09-19T05:49:41.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c9d00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c40ae850 con 0x7fa5c4155620 2024-09-19T05:49:41.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c9d00640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c40ae200 con 0x7fa5c40d0270 2024-09-19T05:49:41.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5c4155620 0x7fa5c406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5c4155620 0x7fa5c406eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43096/0 (socket says 172.21.15.67:43096) 2024-09-19T05:49:41.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c37fe640 1 -- 172.21.15.67:0/2349005011 learned_addr learned my addr 172.21.15.67:0/2349005011 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:41.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.223+0000 7fa5c3fff640 1 --2- 172.21.15.67:0/2349005011 >> v2:172.21.15.97:3300/0 conn(0x7fa5c40d0270 0x7fa5c40d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c37fe640 1 -- 172.21.15.67:0/2349005011 >> v2:172.21.15.97:3300/0 conn(0x7fa5c40d0270 msgr2=0x7fa5c40d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:41.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c37fe640 1 --2- 172.21.15.67:0/2349005011 >> v2:172.21.15.97:3300/0 conn(0x7fa5c40d0270 0x7fa5c40d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c37fe640 1 -- 172.21.15.67:0/2349005011 >> v1:172.21.15.97:6789/0 conn(0x7fa5c415c310 legacy=0x7fa5c40aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c37fe640 1 -- 172.21.15.67:0/2349005011 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c40ae4e0 con 0x7fa5c4155620 2024-09-19T05:49:41.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c37fe640 1 --2- 172.21.15.67:0/2349005011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c4155620 0x7fa5c406eb00 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009870 tx=0x7fa5b401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ca33c48cf2390f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c27fc640 1 -- 172.21.15.67:0/2349005011 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40b0070 con 0x7fa5c4155620 2024-09-19T05:49:41.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c27fc640 1 -- 172.21.15.67:0/2349005011 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b40ab600 con 0x7fa5c4155620 2024-09-19T05:49:41.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c27fc640 1 -- 172.21.15.67:0/2349005011 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40ab9d0 con 0x7fa5c4155620 2024-09-19T05:49:41.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c9d00640 1 -- 172.21.15.67:0/2349005011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c4155620 msgr2=0x7fa5c406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c9d00640 1 --2- 172.21.15.67:0/2349005011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c4155620 0x7fa5c406eb00 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009870 tx=0x7fa5b401c490 comp rx=0 tx=0).stop 2024-09-19T05:49:41.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c9d00640 1 -- 172.21.15.67:0/2349005011 shutdown_connections 2024-09-19T05:49:41.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c9d00640 1 --2- 172.21.15.67:0/2349005011 >> v2:172.21.15.97:3300/0 conn(0x7fa5c40d0270 0x7fa5c40d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c9d00640 1 --2- 172.21.15.67:0/2349005011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c4155620 0x7fa5c406eb00 unknown :-1 s=CLOSED pgs=2566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c9d00640 1 -- 172.21.15.67:0/2349005011 >> 172.21.15.67:0/2349005011 conn(0x7fa5c406be10 msgr2=0x7fa5c406c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c9d00640 1 -- 172.21.15.67:0/2349005011 shutdown_connections 2024-09-19T05:49:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.227+0000 7fa5c9d00640 1 -- 172.21.15.67:0/2349005011 wait complete. 2024-09-19T05:49:41.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 Processor -- start 2024-09-19T05:49:41.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 -- start start 2024-09-19T05:49:41.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5c40d0270 0x7fa5c4150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5c4155620 0x7fa5c41f7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c415c310 0x7fa5c41530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c406f1c0 con 0x7fa5c415c310 2024-09-19T05:49:41.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c406f040 con 0x7fa5c4155620 2024-09-19T05:49:41.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c4167c30 con 0x7fa5c40d0270 2024-09-19T05:49:41.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c415c310 0x7fa5c41530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c415c310 0x7fa5c41530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43100/0 (socket says 172.21.15.67:43100) 2024-09-19T05:49:41.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c3fff640 1 -- 172.21.15.67:0/3427229423 learned_addr learned my addr 172.21.15.67:0/3427229423 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:41.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c37fe640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5c40d0270 0x7fa5c4150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c3fff640 1 -- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5c40d0270 msgr2=0x7fa5c4150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c3fff640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5c40d0270 0x7fa5c4150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c3fff640 1 -- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5c4155620 msgr2=0x7fa5c41f7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c3fff640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5c4155620 0x7fa5c41f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c3fff640 1 -- 172.21.15.67:0/3427229423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c4150a70 con 0x7fa5c415c310 2024-09-19T05:49:41.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c3fff640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c415c310 0x7fa5c41530f0 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00efc0 tx=0x7fa5bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5abfff640 1 -- 172.21.15.67:0/3427229423 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc018020 con 0x7fa5c415c310 2024-09-19T05:49:41.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5abfff640 1 -- 172.21.15.67:0/3427229423 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc014480 con 0x7fa5c415c310 2024-09-19T05:49:41.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5abfff640 1 -- 172.21.15.67:0/3427229423 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc014870 con 0x7fa5c415c310 2024-09-19T05:49:41.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 -- 172.21.15.67:0/3427229423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c4150d50 con 0x7fa5c415c310 2024-09-19T05:49:41.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 -- 172.21.15.67:0/3427229423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c4151310 con 0x7fa5c415c310 2024-09-19T05:49:41.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5c9d00640 1 -- 172.21.15.67:0/3427229423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c40d0700 con 0x7fa5c415c310 2024-09-19T05:49:41.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.231+0000 7fa5abfff640 1 -- 172.21.15.67:0/3427229423 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5bc01b020 con 0x7fa5c415c310 2024-09-19T05:49:41.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.235+0000 7fa5abfff640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5b00678c0 0x7fa5b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.235+0000 7fa5abfff640 1 -- 172.21.15.67:0/3427229423 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fa5bc086a00 con 0x7fa5c415c310 2024-09-19T05:49:41.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.235+0000 7fa5c37fe640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5b00678c0 0x7fa5b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.235+0000 7fa5c37fe640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5b00678c0 0x7fa5b0069d80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40ad4a0 tx=0x7fa5b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.239+0000 7fa5abfff640 1 -- 172.21.15.67:0/3427229423 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa5bc022020 con 0x7fa5c415c310 2024-09-19T05:49:41.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.399+0000 7fa5c9d00640 1 -- 172.21.15.67:0/3427229423 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa5c4158d90 con 0x7fa5b00678c0 2024-09-19T05:49:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5abfff640 1 -- 172.21.15.67:0/3427229423 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa5c4158d90 con 0x7fa5b00678c0 2024-09-19T05:49:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 3 to deep-scrub 2024-09-19T05:49:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 -- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5b00678c0 msgr2=0x7fa5b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5b00678c0 0x7fa5b0069d80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40ad4a0 tx=0x7fa5b4008040 comp rx=0 tx=0).stop 2024-09-19T05:49:41.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 -- 172.21.15.67:0/3427229423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c415c310 msgr2=0x7fa5c41530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c415c310 0x7fa5c41530f0 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00efc0 tx=0x7fa5bc00c490 comp rx=0 tx=0).stop 2024-09-19T05:49:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 -- 172.21.15.67:0/3427229423 shutdown_connections 2024-09-19T05:49:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5c415c310 0x7fa5c41530f0 unknown :-1 s=CLOSED pgs=2567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5c4155620 0x7fa5c41f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa5b00678c0 0x7fa5b0069d80 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 --2- 172.21.15.67:0/3427229423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5c40d0270 0x7fa5c4150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 -- 172.21.15.67:0/3427229423 >> 172.21.15.67:0/3427229423 conn(0x7fa5c406be10 msgr2=0x7fa5c40b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:41.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 -- 172.21.15.67:0/3427229423 shutdown_connections 2024-09-19T05:49:41.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.403+0000 7fa5c9d00640 1 -- 172.21.15.67:0/3427229423 wait complete. 2024-09-19T05:49:41.420 INFO:tasks.ceph:Scrubbing osd.4 2024-09-19T05:49:41.420 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:49:41.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd97ed640 1 Processor -- start 2024-09-19T05:49:41.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd97ed640 1 -- start start 2024-09-19T05:49:41.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd97ed640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8fd409b7a0 0x7f8fd40cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd97ed640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fd40cfa60 con 0x7f8fd409b170 2024-09-19T05:49:41.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd97ed640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fd40cc900 con 0x7f8fd415c5b0 2024-09-19T05:49:41.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd97ed640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8fd40c77e0 con 0x7f8fd409b7a0 2024-09-19T05:49:41.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd27fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8fd409b170 0x7f8fd40ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41572/0 (socket says 172.21.15.67:41572) 2024-09-19T05:49:41.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd27fc640 1 -- 172.21.15.67:0/2878119799 learned_addr learned my addr 172.21.15.67:0/2878119799 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:41.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd37fe640 1 --2- 172.21.15.67:0/2878119799 >> v2:172.21.15.67:3300/0 conn(0x7f8fd409b7a0 0x7f8fd40cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd1ffb640 1 -- 172.21.15.67:0/2878119799 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1367169243 0 0) 0x7f8fd40cfa60 con 0x7f8fd409b170 2024-09-19T05:49:41.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd1ffb640 1 -- 172.21.15.67:0/2878119799 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fbc003530 con 0x7f8fd409b170 2024-09-19T05:49:41.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd37fe640 1 -- 172.21.15.67:0/2878119799 >> v1:172.21.15.97:6789/0 conn(0x7f8fd415c5b0 legacy=0x7f8fd409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd37fe640 1 -- 172.21.15.67:0/2878119799 >> v1:172.21.15.67:6789/0 conn(0x7f8fd409b170 legacy=0x7f8fd40ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.551+0000 7f8fd37fe640 1 -- 172.21.15.67:0/2878119799 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd40c7a30 con 0x7f8fd409b7a0 2024-09-19T05:49:41.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd37fe640 1 --2- 172.21.15.67:0/2878119799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd409b7a0 0x7f8fd40cd4f0 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009d90 tx=0x7f8fd40ce240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4491228016c7dae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd1ffb640 1 -- 172.21.15.67:0/2878119799 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0b2070 con 0x7f8fd409b7a0 2024-09-19T05:49:41.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd1ffb640 1 -- 172.21.15.67:0/2878119799 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0a5a30 con 0x7f8fd409b7a0 2024-09-19T05:49:41.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd1ffb640 1 -- 172.21.15.67:0/2878119799 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0a5e00 con 0x7f8fd409b7a0 2024-09-19T05:49:41.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 -- 172.21.15.67:0/2878119799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd409b7a0 msgr2=0x7f8fd40cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 --2- 172.21.15.67:0/2878119799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd409b7a0 0x7f8fd40cd4f0 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009d90 tx=0x7f8fd40ce240 comp rx=0 tx=0).stop 2024-09-19T05:49:41.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 -- 172.21.15.67:0/2878119799 shutdown_connections 2024-09-19T05:49:41.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 --2- 172.21.15.67:0/2878119799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd409b7a0 0x7f8fd40cd4f0 unknown :-1 s=CLOSED pgs=2569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 -- 172.21.15.67:0/2878119799 >> 172.21.15.67:0/2878119799 conn(0x7f8fd40ced20 msgr2=0x7f8fd40cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:41.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 -- 172.21.15.67:0/2878119799 shutdown_connections 2024-09-19T05:49:41.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 -- 172.21.15.67:0/2878119799 wait complete. 2024-09-19T05:49:41.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 Processor -- start 2024-09-19T05:49:41.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 -- start start 2024-09-19T05:49:41.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fd409b170 0x7f8fd406d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fd409b7a0 0x7f8fd41498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd415c5b0 0x7f8fd406df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd416a190 con 0x7f8fd415c5b0 2024-09-19T05:49:41.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd416a010 con 0x7f8fd409b7a0 2024-09-19T05:49:41.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd97ed640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd416a310 con 0x7f8fd409b170 2024-09-19T05:49:41.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd415c5b0 0x7f8fd406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd415c5b0 0x7f8fd406df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43118/0 (socket says 172.21.15.67:43118) 2024-09-19T05:49:41.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.555+0000 7f8fd37fe640 1 -- 172.21.15.67:0/3710080215 learned_addr learned my addr 172.21.15.67:0/3710080215 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:41.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd27fc640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fd409b7a0 0x7f8fd41498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd2ffd640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fd409b170 0x7f8fd406d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd37fe640 1 -- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fd409b170 msgr2=0x7f8fd406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd37fe640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fd409b170 0x7f8fd406d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd37fe640 1 -- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fd409b7a0 msgr2=0x7f8fd41498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd37fe640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fd409b7a0 0x7f8fd41498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd37fe640 1 -- 172.21.15.67:0/3710080215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd414a680 con 0x7f8fd415c5b0 2024-09-19T05:49:41.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd37fe640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd415c5b0 0x7f8fd406df90 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc019580 tx=0x7f8fcc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fbb7fe640 1 -- 172.21.15.67:0/3710080215 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0b2040 con 0x7f8fd415c5b0 2024-09-19T05:49:41.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fbb7fe640 1 -- 172.21.15.67:0/3710080215 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0be070 con 0x7f8fd415c5b0 2024-09-19T05:49:41.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd414a920 con 0x7f8fd415c5b0 2024-09-19T05:49:41.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fbb7fe640 1 -- 172.21.15.67:0/3710080215 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0ad980 con 0x7f8fd415c5b0 2024-09-19T05:49:41.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd406e4d0 con 0x7f8fd415c5b0 2024-09-19T05:49:41.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8fd409aa60 con 0x7f8fd415c5b0 2024-09-19T05:49:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fbb7fe640 1 -- 172.21.15.67:0/3710080215 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8fcc0adb20 con 0x7f8fd415c5b0 2024-09-19T05:49:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fbb7fe640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fc00678c0 0x7f8fc0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fbb7fe640 1 -- 172.21.15.67:0/3710080215 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f8fcc1212b0 con 0x7f8fd415c5b0 2024-09-19T05:49:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fbb7fe640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] conn(0x7f8fc006dd60 0x7f8fc00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fbb7fe640 1 -- 172.21.15.67:0/3710080215 --> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fcc0b5e50 con 0x7f8fc006dd60 2024-09-19T05:49:41.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fbb7fe640 1 -- 172.21.15.67:0/3710080215 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) ==== 24+0+0 (secure 0 0 0) 0x7f8fcc121740 con 0x7f8fd415c5b0 2024-09-19T05:49:41.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd2ffd640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fc00678c0 0x7f8fc0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd27fc640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] conn(0x7f8fc006dd60 0x7f8fc00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.559+0000 7f8fd27fc640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] conn(0x7f8fc006dd60 0x7f8fc00701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.563+0000 7f8fd2ffd640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fc00678c0 0x7f8fc0069d80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4007fd0 tx=0x7f8fc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.563+0000 7f8fbb7fe640 1 -- 172.21.15.67:0/3710080215 <== osd.4 v2:172.21.15.97:6802/1358994016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fcc0b5e50 con 0x7f8fc006dd60 2024-09-19T05:49:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.575+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 --> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8fd40d0dc0 con 0x7f8fc006dd60 2024-09-19T05:49:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.575+0000 7f8fbb7fe640 1 -- 172.21.15.67:0/3710080215 <== osd.4 v2:172.21.15.97:6802/1358994016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8fd40d0dc0 con 0x7f8fc006dd60 2024-09-19T05:49:41.576 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:49:41.576 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:49:41.576 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:49:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.575+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] conn(0x7f8fc006dd60 msgr2=0x7f8fc00701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.575+0000 7f8fd97ed640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:6802/1358994016,v1:172.21.15.97:6804/1358994016] conn(0x7f8fc006dd60 0x7f8fc00701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.575+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fc00678c0 msgr2=0x7f8fc0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.575+0000 7f8fd97ed640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f8fc00678c0 0x7f8fc0069d80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4007fd0 tx=0x7f8fc4009040 comp rx=0 tx=0).stop 2024-09-19T05:49:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.575+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd415c5b0 msgr2=0x7f8fd406df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.575+0000 7f8fd97ed640 1 --2- 172.21.15.67:0/3710080215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd415c5b0 0x7f8fd406df90 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc019580 tx=0x7f8fcc019710 comp rx=0 tx=0).stop 2024-09-19T05:49:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.579+0000 7f8fd37fe640 1 -- 172.21.15.67:0/3710080215 reap_dead start 2024-09-19T05:49:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.579+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 shutdown_connections 2024-09-19T05:49:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.579+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 >> 172.21.15.67:0/3710080215 conn(0x7f8fd40ced20 msgr2=0x7f8fd40ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.579+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 shutdown_connections 2024-09-19T05:49:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.579+0000 7f8fd97ed640 1 -- 172.21.15.67:0/3710080215 wait complete. 2024-09-19T05:49:41.592 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-19T05:49:41.647 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:49:41.650 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:49:41.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.699+0000 7f4692157640 1 Processor -- start 2024-09-19T05:49:41.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.699+0000 7f4692157640 1 -- start start 2024-09-19T05:49:41.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.699+0000 7f4692157640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f468c072d50 0x7f468c06e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.699+0000 7f4692157640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f468c15baa0 0x7f468c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.699+0000 7f4692157640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f468c06f3b0 con 0x7f468c15b6c0 2024-09-19T05:49:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.699+0000 7f4692157640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f468c155260 con 0x7f468c072d50 2024-09-19T05:49:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.699+0000 7f4692157640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f468c0701a0 con 0x7f468c15baa0 2024-09-19T05:49:41.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468affd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f468c072d50 0x7f468c06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468affd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f468c072d50 0x7f468c06e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43128/0 (socket says 172.21.15.67:43128) 2024-09-19T05:49:41.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468affd640 1 -- 172.21.15.67:0/2382621870 learned_addr learned my addr 172.21.15.67:0/2382621870 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:41.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468b7fe640 1 --1- 172.21.15.67:0/2382621870 >> v1:172.21.15.67:6789/0 conn(0x7f468c15b6c0 0x7f468c072640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41584/0 (socket says 172.21.15.67:41584) 2024-09-19T05:49:41.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468bfff640 1 --2- 172.21.15.67:0/2382621870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f468c15baa0 0x7f468c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468affd640 1 -- 172.21.15.67:0/2382621870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f468c15baa0 msgr2=0x7f468c06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:41.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468affd640 1 --2- 172.21.15.67:0/2382621870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f468c15baa0 0x7f468c06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468affd640 1 -- 172.21.15.67:0/2382621870 >> v1:172.21.15.67:6789/0 conn(0x7f468c15b6c0 legacy=0x7f468c072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468affd640 1 -- 172.21.15.67:0/2382621870 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c06f620 con 0x7f468c072d50 2024-09-19T05:49:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468a7fc640 1 -- 172.21.15.67:0/2382621870 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215211247 0 0) 0x7f468c06f3b0 con 0x7f468c15b6c0 2024-09-19T05:49:41.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468affd640 1 --2- 172.21.15.67:0/2382621870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c072d50 0x7f468c06e930 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7f467c00bb10 tx=0x7f467c01eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8206732962cd95c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468a7fc640 1 -- 172.21.15.67:0/2382621870 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c0b4070 con 0x7f468c072d50 2024-09-19T05:49:41.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468a7fc640 1 -- 172.21.15.67:0/2382621870 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467c0a7bc0 con 0x7f468c072d50 2024-09-19T05:49:41.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f468a7fc640 1 -- 172.21.15.67:0/2382621870 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c0af440 con 0x7f468c072d50 2024-09-19T05:49:41.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f4692157640 1 -- 172.21.15.67:0/2382621870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c072d50 msgr2=0x7f468c06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f4692157640 1 --2- 172.21.15.67:0/2382621870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c072d50 0x7f468c06e930 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7f467c00bb10 tx=0x7f467c01eb70 comp rx=0 tx=0).stop 2024-09-19T05:49:41.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f4692157640 1 -- 172.21.15.67:0/2382621870 shutdown_connections 2024-09-19T05:49:41.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f4692157640 1 --2- 172.21.15.67:0/2382621870 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f468c15baa0 0x7f468c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f4692157640 1 --2- 172.21.15.67:0/2382621870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c072d50 0x7f468c06e930 unknown :-1 s=CLOSED pgs=2572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f4692157640 1 -- 172.21.15.67:0/2382621870 >> 172.21.15.67:0/2382621870 conn(0x7f468c06be10 msgr2=0x7f468c06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:41.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f4692157640 1 -- 172.21.15.67:0/2382621870 shutdown_connections 2024-09-19T05:49:41.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.703+0000 7f4692157640 1 -- 172.21.15.67:0/2382621870 wait complete. 2024-09-19T05:49:41.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 Processor -- start 2024-09-19T05:49:41.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 -- start start 2024-09-19T05:49:41.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f468c072d50 0x7f468c153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c15b6c0 0x7f468c14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f468c15baa0 0x7f468c146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0b3500 con 0x7f468c15b6c0 2024-09-19T05:49:41.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0b3380 con 0x7f468c072d50 2024-09-19T05:49:41.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f468c0b3680 con 0x7f468c15baa0 2024-09-19T05:49:41.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c15b6c0 0x7f468c14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c15b6c0 0x7f468c14f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43144/0 (socket says 172.21.15.67:43144) 2024-09-19T05:49:41.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468affd640 1 -- 172.21.15.67:0/941937934 learned_addr learned my addr 172.21.15.67:0/941937934 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:41.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468bfff640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f468c15baa0 0x7f468c146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468affd640 1 -- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f468c15baa0 msgr2=0x7f468c146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468affd640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f468c15baa0 0x7f468c146830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468affd640 1 -- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f468c072d50 msgr2=0x7f468c153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468b7fe640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f468c072d50 0x7f468c153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468affd640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f468c072d50 0x7f468c153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468affd640 1 -- 172.21.15.67:0/941937934 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c147540 con 0x7f468c15b6c0 2024-09-19T05:49:41.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f468affd640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c15b6c0 0x7f468c14f370 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7f467c00bb10 tx=0x7f467c01b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4673fff640 1 -- 172.21.15.67:0/941937934 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c0b4040 con 0x7f468c15b6c0 2024-09-19T05:49:41.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4673fff640 1 -- 172.21.15.67:0/941937934 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467c0afca0 con 0x7f468c15b6c0 2024-09-19T05:49:41.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 -- 172.21.15.67:0/941937934 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468c148a20 con 0x7f468c15b6c0 2024-09-19T05:49:41.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4673fff640 1 -- 172.21.15.67:0/941937934 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c004260 con 0x7f468c15b6c0 2024-09-19T05:49:41.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 -- 172.21.15.67:0/941937934 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468c148fe0 con 0x7f468c15b6c0 2024-09-19T05:49:41.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4692157640 1 -- 172.21.15.67:0/941937934 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468c072640 con 0x7f468c15b6c0 2024-09-19T05:49:41.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4673fff640 1 -- 172.21.15.67:0/941937934 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f467c0b7070 con 0x7f468c15b6c0 2024-09-19T05:49:41.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4673fff640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46780678f0 0x7f4678069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:41.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.707+0000 7f4673fff640 1 -- 172.21.15.67:0/941937934 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f467c122d60 con 0x7f468c15b6c0 2024-09-19T05:49:41.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.711+0000 7f468b7fe640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46780678f0 0x7f4678069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:41.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.711+0000 7f468b7fe640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46780678f0 0x7f4678069db0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4680000f70 tx=0x7f4680009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:41.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.715+0000 7f4673fff640 1 -- 172.21.15.67:0/941937934 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f467c0c7030 con 0x7f468c15b6c0 2024-09-19T05:49:41.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.875+0000 7f4692157640 1 -- 172.21.15.67:0/941937934 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f468c0cc5d0 con 0x7f46780678f0 2024-09-19T05:49:41.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.875+0000 7f4673fff640 1 -- 172.21.15.67:0/941937934 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f468c0cc5d0 con 0x7f46780678f0 2024-09-19T05:49:41.876 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 4 to deep-scrub 2024-09-19T05:49:41.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 -- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46780678f0 msgr2=0x7f4678069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46780678f0 0x7f4678069db0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4680000f70 tx=0x7f4680009040 comp rx=0 tx=0).stop 2024-09-19T05:49:41.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 -- 172.21.15.67:0/941937934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c15b6c0 msgr2=0x7f468c14f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:41.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c15b6c0 0x7f468c14f370 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7f467c00bb10 tx=0x7f467c01b910 comp rx=0 tx=0).stop 2024-09-19T05:49:41.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 -- 172.21.15.67:0/941937934 shutdown_connections 2024-09-19T05:49:41.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f46780678f0 0x7f4678069db0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f468c15baa0 0x7f468c146830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f468c15b6c0 0x7f468c14f370 unknown :-1 s=CLOSED pgs=2573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 --2- 172.21.15.67:0/941937934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f468c072d50 0x7f468c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:41.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 -- 172.21.15.67:0/941937934 >> 172.21.15.67:0/941937934 conn(0x7f468c06be10 msgr2=0x7f468c15d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:41.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 -- 172.21.15.67:0/941937934 shutdown_connections 2024-09-19T05:49:41.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:41.879+0000 7f4692157640 1 -- 172.21.15.67:0/941937934 wait complete. 2024-09-19T05:49:41.896 INFO:tasks.ceph:Scrubbing osd.5 2024-09-19T05:49:41.896 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:49:42.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.075+0000 7f2104d27640 1 Processor -- start 2024-09-19T05:49:42.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.075+0000 7f2104d27640 1 -- start start 2024-09-19T05:49:42.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f2104d27640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f21000d0c30 0x7f21000d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f2104d27640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21000d2c50 con 0x7f210015e620 2024-09-19T05:49:42.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f2104d27640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21000d2f20 con 0x7f21000b4170 2024-09-19T05:49:42.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f2104d27640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f21000ceb90 con 0x7f21000d0c30 2024-09-19T05:49:42.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fdd9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f210015e620 0x7f21000d2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41598/0 (socket says 172.21.15.67:41598) 2024-09-19T05:49:42.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fdd9b640 1 -- 172.21.15.67:0/3662489396 learned_addr learned my addr 172.21.15.67:0/3662489396 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:42.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fe59c640 1 --2- 172.21.15.67:0/3662489396 >> v2:172.21.15.97:3300/0 conn(0x7f21000d0c30 0x7f21000d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2042781299 0 0) 0x7f21000d2c50 con 0x7f210015e620 2024-09-19T05:49:42.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20e8003530 con 0x7f210015e620 2024-09-19T05:49:42.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1993783093 0 0) 0x7f20e8003530 con 0x7f210015e620 2024-09-19T05:49:42.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 >> v2:172.21.15.97:3300/0 conn(0x7f21000d0c30 msgr2=0x7f21000d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:42.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 --2- 172.21.15.67:0/3662489396 >> v2:172.21.15.97:3300/0 conn(0x7f21000d0c30 0x7f21000d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 >> v1:172.21.15.97:6789/0 conn(0x7f21000b4170 legacy=0x7f21000cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21000d3200 con 0x7f210015e620 2024-09-19T05:49:42.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3533112528 0 0) 0x7f20f4001680 con 0x7f210015e620 2024-09-19T05:49:42.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 >> v1:172.21.15.67:6789/0 conn(0x7f210015e620 legacy=0x7f21000d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e80039c0 0x7f20e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e8004810 0x7f20e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e80051d0 0x7f20e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f21000ceb90 con 0x7f20e80051d0 2024-09-19T05:49:42.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f20e800c120 con 0x7f20e80039c0 2024-09-19T05:49:42.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f20e800c320 con 0x7f20e8004810 2024-09-19T05:49:42.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fe59c640 1 --2- 172.21.15.67:0/3662489396 >> v2:172.21.15.97:3300/0 conn(0x7f21000d0c30 0x7f21000d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:49:42.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fed9d640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e80051d0 0x7f20e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fdd9b640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e8004810 0x7f20e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fed9d640 1 -- 172.21.15.67:0/3662489396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e8004810 msgr2=0x7f20e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:42.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fed9d640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e8004810 0x7f20e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fed9d640 1 -- 172.21.15.67:0/3662489396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e80039c0 msgr2=0x7f20e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:42.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fed9d640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e80039c0 0x7f20e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fed9d640 1 -- 172.21.15.67:0/3662489396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e8003530 con 0x7f20e80051d0 2024-09-19T05:49:42.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fdd9b640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f20e8004810 0x7f20e8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fed9d640 1 -- 172.21.15.67:0/3662489396 reap_dead start 2024-09-19T05:49:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fed9d640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e80051d0 0x7f20e800b9d0 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7f20f8001e40 tx=0x7f20f801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1776efbea51063ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.079+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8001a90 con 0x7f20e80051d0 2024-09-19T05:49:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f8003b80 con 0x7f20e80051d0 2024-09-19T05:49:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fd59a640 1 -- 172.21.15.67:0/3662489396 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8005020 con 0x7f20e80051d0 2024-09-19T05:49:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- 172.21.15.67:0/3662489396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e80051d0 msgr2=0x7f20e800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e80051d0 0x7f20e800b9d0 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7f20f8001e40 tx=0x7f20f801c760 comp rx=0 tx=0).stop 2024-09-19T05:49:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- 172.21.15.67:0/3662489396 shutdown_connections 2024-09-19T05:49:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 --2- 172.21.15.67:0/3662489396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e80051d0 0x7f20e800b9d0 unknown :-1 s=CLOSED pgs=2575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- 172.21.15.67:0/3662489396 >> 172.21.15.67:0/3662489396 conn(0x7f210009d820 msgr2=0x7f210008bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- 172.21.15.67:0/3662489396 shutdown_connections 2024-09-19T05:49:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- 172.21.15.67:0/3662489396 wait complete. 2024-09-19T05:49:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 Processor -- start 2024-09-19T05:49:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- start start 2024-09-19T05:49:42.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e80051d0 0x7f210015af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21000b9b80 0x7f210006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21000ba000 0x7f210006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f21000b6b40 con 0x7f21000ba000 2024-09-19T05:49:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f21000d37c0 con 0x7f20e80051d0 2024-09-19T05:49:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f21000b6cc0 con 0x7f21000b9b80 2024-09-19T05:49:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21000ba000 0x7f210006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21000ba000 0x7f210006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43152/0 (socket says 172.21.15.67:43152) 2024-09-19T05:49:42.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fed9d640 1 -- 172.21.15.67:0/1790264077 learned_addr learned my addr 172.21.15.67:0/1790264077 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fdd9b640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21000b9b80 0x7f210006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fe59c640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e80051d0 0x7f210015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fed9d640 1 -- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21000b9b80 msgr2=0x7f210006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fed9d640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f21000b9b80 0x7f210006ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fed9d640 1 -- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e80051d0 msgr2=0x7f210015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fed9d640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e80051d0 0x7f210015af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fed9d640 1 -- 172.21.15.67:0/1790264077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21000b83c0 con 0x7f21000ba000 2024-09-19T05:49:42.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fe59c640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20e80051d0 0x7f210015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:42.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20fed9d640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21000ba000 0x7f210006d3d0 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7f20f801c590 tx=0x7f20e8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20eeffd640 1 -- 172.21.15.67:0/1790264077 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f80b6070 con 0x7f21000ba000 2024-09-19T05:49:42.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20eeffd640 1 -- 172.21.15.67:0/1790264077 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f80ad070 con 0x7f21000ba000 2024-09-19T05:49:42.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21000b86a0 con 0x7f21000ba000 2024-09-19T05:49:42.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f20eeffd640 1 -- 172.21.15.67:0/1790264077 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8001a90 con 0x7f21000ba000 2024-09-19T05:49:42.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.083+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21000b8c60 con 0x7f21000ba000 2024-09-19T05:49:42.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f21000d1010 con 0x7f21000ba000 2024-09-19T05:49:42.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f20eeffd640 1 -- 172.21.15.67:0/1790264077 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20f80b9070 con 0x7f21000ba000 2024-09-19T05:49:42.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f20eeffd640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20e00678c0 0x7f20e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f20eeffd640 1 -- 172.21.15.67:0/1790264077 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f20f811ee20 con 0x7f21000ba000 2024-09-19T05:49:42.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f20eeffd640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] conn(0x7f20e006dd60 0x7f20e00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f20eeffd640 1 -- 172.21.15.67:0/1790264077 --> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20f8003b80 con 0x7f20e006dd60 2024-09-19T05:49:42.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f20eeffd640 1 -- 172.21.15.67:0/1790264077 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) ==== 24+0+0 (secure 0 0 0) 0x7f20f8121440 con 0x7f21000ba000 2024-09-19T05:49:42.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f20fe59c640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20e00678c0 0x7f20e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f20fdd9b640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] conn(0x7f20e006dd60 0x7f20e00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f20fdd9b640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] conn(0x7f20e006dd60 0x7f20e00701a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.087+0000 7f20fe59c640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20e00678c0 0x7f20e0069d80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f20f000d8a0 tx=0x7f20f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.091+0000 7f20eeffd640 1 -- 172.21.15.67:0/1790264077 <== osd.5 v2:172.21.15.97:6824/112548817 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20f8003b80 con 0x7f20e006dd60 2024-09-19T05:49:42.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 --> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f21000b2b50 con 0x7f20e006dd60 2024-09-19T05:49:42.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f20eeffd640 1 -- 172.21.15.67:0/1790264077 <== osd.5 v2:172.21.15.97:6824/112548817 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f21000b2b50 con 0x7f20e006dd60 2024-09-19T05:49:42.102 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:49:42.102 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:49:42.103 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:49:42.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] conn(0x7f20e006dd60 msgr2=0x7f20e00701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:6824/112548817,v1:172.21.15.97:6825/112548817] conn(0x7f20e006dd60 0x7f20e00701a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20e00678c0 msgr2=0x7f20e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f20e00678c0 0x7f20e0069d80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f20f000d8a0 tx=0x7f20f0008040 comp rx=0 tx=0).stop 2024-09-19T05:49:42.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21000ba000 msgr2=0x7f210006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 --2- 172.21.15.67:0/1790264077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21000ba000 0x7f210006d3d0 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7f20f801c590 tx=0x7f20e8005840 comp rx=0 tx=0).stop 2024-09-19T05:49:42.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f20fed9d640 1 -- 172.21.15.67:0/1790264077 reap_dead start 2024-09-19T05:49:42.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 shutdown_connections 2024-09-19T05:49:42.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 >> 172.21.15.67:0/1790264077 conn(0x7f210009d820 msgr2=0x7f210008bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:42.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 shutdown_connections 2024-09-19T05:49:42.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.103+0000 7f2104d27640 1 -- 172.21.15.67:0/1790264077 wait complete. 2024-09-19T05:49:42.118 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-19T05:49:42.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f517a1e4640 1 Processor -- start 2024-09-19T05:49:42.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f517a1e4640 1 -- start start 2024-09-19T05:49:42.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f517a1e4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f51740cf540 0x7f51740cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f517a1e4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740d4bf0 0x7f51740cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f517a1e4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51740d5390 con 0x7f51741621e0 2024-09-19T05:49:42.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f517a1e4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f51740d3190 con 0x7f51740cf540 2024-09-19T05:49:42.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f517a1e4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f51740cfe60 con 0x7f51740d4bf0 2024-09-19T05:49:42.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f5173fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f51741621e0 0x7f5174162670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41614/0 (socket says 172.21.15.67:41614) 2024-09-19T05:49:42.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f5173fff640 1 -- 172.21.15.67:0/2012087593 learned_addr learned my addr 172.21.15.67:0/2012087593 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-09-19T05:49:42.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f51737fe640 1 --2- 172.21.15.67:0/2012087593 >> v2:172.21.15.67:3300/0 conn(0x7f51740cf540 0x7f51740cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f5172ffd640 1 --2- 172.21.15.67:0/2012087593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740d4bf0 0x7f51740cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f51727fc640 1 -- 172.21.15.67:0/2012087593 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576449096 0 0) 0x7f51740d5390 con 0x7f51741621e0 2024-09-19T05:49:42.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f51727fc640 1 -- 172.21.15.67:0/2012087593 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5160003530 con 0x7f51741621e0 2024-09-19T05:49:42.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f51737fe640 1 -- 172.21.15.67:0/2012087593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740d4bf0 msgr2=0x7f51740cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:42.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f51737fe640 1 --2- 172.21.15.67:0/2012087593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740d4bf0 0x7f51740cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f51737fe640 1 -- 172.21.15.67:0/2012087593 >> v1:172.21.15.67:6789/0 conn(0x7f51741621e0 legacy=0x7f5174162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.235+0000 7f51737fe640 1 -- 172.21.15.67:0/2012087593 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51740d3430 con 0x7f51740cf540 2024-09-19T05:49:42.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f51737fe640 1 --2- 172.21.15.67:0/2012087593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51740cf540 0x7f51740cee40 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7f516c009d90 tx=0x7f516c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a087c42960a260b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f51727fc640 1 -- 172.21.15.67:0/2012087593 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c0b2070 con 0x7f51740cf540 2024-09-19T05:49:42.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f51727fc640 1 -- 172.21.15.67:0/2012087593 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f516c0a5710 con 0x7f51740cf540 2024-09-19T05:49:42.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f51727fc640 1 -- 172.21.15.67:0/2012087593 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c0a5ae0 con 0x7f51740cf540 2024-09-19T05:49:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 -- 172.21.15.67:0/2012087593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51740cf540 msgr2=0x7f51740cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 --2- 172.21.15.67:0/2012087593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51740cf540 0x7f51740cee40 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7f516c009d90 tx=0x7f516c01c850 comp rx=0 tx=0).stop 2024-09-19T05:49:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 -- 172.21.15.67:0/2012087593 shutdown_connections 2024-09-19T05:49:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 --2- 172.21.15.67:0/2012087593 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740d4bf0 0x7f51740cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 --2- 172.21.15.67:0/2012087593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51740cf540 0x7f51740cee40 unknown :-1 s=CLOSED pgs=2578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 -- 172.21.15.67:0/2012087593 >> 172.21.15.67:0/2012087593 conn(0x7f517408bff0 msgr2=0x7f51740d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 -- 172.21.15.67:0/2012087593 shutdown_connections 2024-09-19T05:49:42.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 -- 172.21.15.67:0/2012087593 wait complete. 2024-09-19T05:49:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 Processor -- start 2024-09-19T05:49:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 -- start start 2024-09-19T05:49:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740cf540 0x7f51740cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51740d4bf0 0x7f51741559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51741621e0 0x7f5174155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f517416beb0 con 0x7f51741621e0 2024-09-19T05:49:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f517416bd30 con 0x7f51740d4bf0 2024-09-19T05:49:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f517a1e4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f517416c030 con 0x7f51740cf540 2024-09-19T05:49:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f5173fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51741621e0 0x7f5174155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f5173fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51741621e0 0x7f5174155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43172/0 (socket says 172.21.15.67:43172) 2024-09-19T05:49:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.239+0000 7f5173fff640 1 -- 172.21.15.67:0/3086665571 learned_addr learned my addr 172.21.15.67:0/3086665571 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f5172ffd640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51740d4bf0 0x7f51741559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f51737fe640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740cf540 0x7f51740cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f5173fff640 1 -- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740cf540 msgr2=0x7f51740cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f5173fff640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740cf540 0x7f51740cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f5173fff640 1 -- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51740d4bf0 msgr2=0x7f51741559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f5173fff640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51740d4bf0 0x7f51741559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f5173fff640 1 -- 172.21.15.67:0/3086665571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5174154940 con 0x7f51741621e0 2024-09-19T05:49:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f5172ffd640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51740d4bf0 0x7f51741559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f51737fe640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740cf540 0x7f51740cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f5173fff640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51741621e0 0x7f5174155f20 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7f516400c3f0 tx=0x7f5164001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f516bfff640 1 -- 172.21.15.67:0/3086665571 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5164017070 con 0x7f51741621e0 2024-09-19T05:49:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f516bfff640 1 -- 172.21.15.67:0/3086665571 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5164005cf0 con 0x7f51741621e0 2024-09-19T05:49:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f516bfff640 1 -- 172.21.15.67:0/3086665571 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5164007310 con 0x7f51741621e0 2024-09-19T05:49:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f517a1e4640 1 -- 172.21.15.67:0/3086665571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51741551e0 con 0x7f51741621e0 2024-09-19T05:49:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f517a1e4640 1 -- 172.21.15.67:0/3086665571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51740cbd50 con 0x7f51741621e0 2024-09-19T05:49:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f517a1e4640 1 -- 172.21.15.67:0/3086665571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51740cee40 con 0x7f51741621e0 2024-09-19T05:49:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f516bfff640 1 -- 172.21.15.67:0/3086665571 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f516401a070 con 0x7f51741621e0 2024-09-19T05:49:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f516bfff640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51540678c0 0x7f5154069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f516bfff640 1 -- 172.21.15.67:0/3086665571 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f5164084df0 con 0x7f51741621e0 2024-09-19T05:49:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f51737fe640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51540678c0 0x7f5154069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.243+0000 7f51737fe640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51540678c0 0x7f5154069d80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f516c0af000 tx=0x7f516c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.247+0000 7f516bfff640 1 -- 172.21.15.67:0/3086665571 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f5164055b10 con 0x7f51741621e0 2024-09-19T05:49:42.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.407+0000 7f517a1e4640 1 -- 172.21.15.67:0/3086665571 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f51741546f0 con 0x7f51540678c0 2024-09-19T05:49:42.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.407+0000 7f516bfff640 1 -- 172.21.15.67:0/3086665571 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f51741546f0 con 0x7f51540678c0 2024-09-19T05:49:42.408 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 5 to deep-scrub 2024-09-19T05:49:42.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 -- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51540678c0 msgr2=0x7f5154069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51540678c0 0x7f5154069d80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f516c0af000 tx=0x7f516c0a7070 comp rx=0 tx=0).stop 2024-09-19T05:49:42.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 -- 172.21.15.67:0/3086665571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51741621e0 msgr2=0x7f5174155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51741621e0 0x7f5174155f20 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7f516400c3f0 tx=0x7f5164001e80 comp rx=0 tx=0).stop 2024-09-19T05:49:42.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 -- 172.21.15.67:0/3086665571 shutdown_connections 2024-09-19T05:49:42.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51741621e0 0x7f5174155f20 unknown :-1 s=CLOSED pgs=2579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51740d4bf0 0x7f51741559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f51540678c0 0x7f5154069d80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 --2- 172.21.15.67:0/3086665571 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f51740cf540 0x7f51740cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 -- 172.21.15.67:0/3086665571 >> 172.21.15.67:0/3086665571 conn(0x7f517408bff0 msgr2=0x7f51740d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:42.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 -- 172.21.15.67:0/3086665571 shutdown_connections 2024-09-19T05:49:42.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.411+0000 7f517a1e4640 1 -- 172.21.15.67:0/3086665571 wait complete. 2024-09-19T05:49:42.426 INFO:tasks.ceph:Scrubbing osd.6 2024-09-19T05:49:42.426 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:49:42.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70ec992640 1 Processor -- start 2024-09-19T05:49:42.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70ec992640 1 -- start start 2024-09-19T05:49:42.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70ec992640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f70e8158c30 0x7f70e80af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70ec992640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70e80afe10 0x7f70e806e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70ec992640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e80ad9e0 con 0x7f70e8158850 2024-09-19T05:49:42.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70ec992640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f70e80b0280 con 0x7f70e80afe10 2024-09-19T05:49:42.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70ec992640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f70e8071020 con 0x7f70e8158c30 2024-09-19T05:49:42.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70e6d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70e80afe10 0x7f70e806e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70e6d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70e80afe10 0x7f70e806e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43174/0 (socket says 172.21.15.67:43174) 2024-09-19T05:49:42.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70e6d9d640 1 -- 172.21.15.67:0/1683757531 learned_addr learned my addr 172.21.15.67:0/1683757531 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:42.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70e5d9b640 1 --2- 172.21.15.67:0/1683757531 >> v2:172.21.15.97:3300/0 conn(0x7f70e8158c30 0x7f70e80af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70e6d9d640 1 -- 172.21.15.67:0/1683757531 >> v2:172.21.15.97:3300/0 conn(0x7f70e8158c30 msgr2=0x7f70e80af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:42.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70e6d9d640 1 --2- 172.21.15.67:0/1683757531 >> v2:172.21.15.97:3300/0 conn(0x7f70e8158c30 0x7f70e80af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70e6d9d640 1 -- 172.21.15.67:0/1683757531 >> v1:172.21.15.97:6789/0 conn(0x7f70e8158850 legacy=0x7f70e8070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:42.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70e6d9d640 1 -- 172.21.15.67:0/1683757531 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e80adcc0 con 0x7f70e80afe10 2024-09-19T05:49:42.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.547+0000 7f70e5d9b640 1 --2- 172.21.15.67:0/1683757531 >> v2:172.21.15.97:3300/0 conn(0x7f70e8158c30 0x7f70e80af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:42.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70e6d9d640 1 --2- 172.21.15.67:0/1683757531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e80afe10 0x7f70e806e7e0 secure :-1 s=READY pgs=2580 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009e50 tx=0x7f70e001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab31c367f38c78a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70e559a640 1 -- 172.21.15.67:0/1683757531 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e00a5870 con 0x7f70e80afe10 2024-09-19T05:49:42.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70e559a640 1 -- 172.21.15.67:0/1683757531 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e00a5a10 con 0x7f70e80afe10 2024-09-19T05:49:42.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70e559a640 1 -- 172.21.15.67:0/1683757531 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e00a5de0 con 0x7f70e80afe10 2024-09-19T05:49:42.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70ec992640 1 -- 172.21.15.67:0/1683757531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e80afe10 msgr2=0x7f70e806e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70ec992640 1 --2- 172.21.15.67:0/1683757531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e80afe10 0x7f70e806e7e0 secure :-1 s=READY pgs=2580 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009e50 tx=0x7f70e001c9b0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70ec992640 1 -- 172.21.15.67:0/1683757531 shutdown_connections 2024-09-19T05:49:42.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70ec992640 1 --2- 172.21.15.67:0/1683757531 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e80afe10 0x7f70e806e7e0 unknown :-1 s=CLOSED pgs=2580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70ec992640 1 --2- 172.21.15.67:0/1683757531 >> v2:172.21.15.97:3300/0 conn(0x7f70e8158c30 0x7f70e80af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70ec992640 1 -- 172.21.15.67:0/1683757531 >> 172.21.15.67:0/1683757531 conn(0x7f70e80735c0 msgr2=0x7f70e806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:42.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70ec992640 1 -- 172.21.15.67:0/1683757531 shutdown_connections 2024-09-19T05:49:42.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70ec992640 1 -- 172.21.15.67:0/1683757531 wait complete. 2024-09-19T05:49:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.551+0000 7f70ec992640 1 Processor -- start 2024-09-19T05:49:42.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70ec992640 1 -- start start 2024-09-19T05:49:42.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70ec992640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e80afe10 0x7f70e8157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70ec992640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70e8158850 0x7f70e8151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70ec992640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e8158c30 0x7f70e8152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70ec992640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f70e80af5d0 con 0x7f70e80afe10 2024-09-19T05:49:42.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70ec992640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f70e80af450 con 0x7f70e8158c30 2024-09-19T05:49:42.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70ec992640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f70e806f530 con 0x7f70e8158850 2024-09-19T05:49:42.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e80afe10 0x7f70e8157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e80afe10 0x7f70e8157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43178/0 (socket says 172.21.15.67:43178) 2024-09-19T05:49:42.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e659c640 1 -- 172.21.15.67:0/2525304869 learned_addr learned my addr 172.21.15.67:0/2525304869 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:42.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e6d9d640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e8158c30 0x7f70e8152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e5d9b640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70e8158850 0x7f70e8151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e659c640 1 -- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70e8158850 msgr2=0x7f70e8151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e659c640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70e8158850 0x7f70e8151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e659c640 1 -- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e8158c30 msgr2=0x7f70e8152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e659c640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e8158c30 0x7f70e8152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e659c640 1 -- 172.21.15.67:0/2525304869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e8156180 con 0x7f70e80afe10 2024-09-19T05:49:42.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e5d9b640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70e8158850 0x7f70e8151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:42.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70e659c640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e80afe10 0x7f70e8157220 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c450 tx=0x7f70d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70d6ffd640 1 -- 172.21.15.67:0/2525304869 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8012830 con 0x7f70e80afe10 2024-09-19T05:49:42.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70d6ffd640 1 -- 172.21.15.67:0/2525304869 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d8017070 con 0x7f70e80afe10 2024-09-19T05:49:42.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e8156460 con 0x7f70e80afe10 2024-09-19T05:49:42.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70d6ffd640 1 -- 172.21.15.67:0/2525304869 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8012c30 con 0x7f70e80afe10 2024-09-19T05:49:42.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e8156a20 con 0x7f70e80afe10 2024-09-19T05:49:42.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70e806f830 con 0x7f70e80afe10 2024-09-19T05:49:42.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70d6ffd640 1 -- 172.21.15.67:0/2525304869 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70d801c460 con 0x7f70e80afe10 2024-09-19T05:49:42.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.555+0000 7f70d6ffd640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70c80678c0 0x7f70c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.559+0000 7f70d6ffd640 1 -- 172.21.15.67:0/2525304869 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f70d8086400 con 0x7f70e80afe10 2024-09-19T05:49:42.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.559+0000 7f70d6ffd640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x7f70c806dd60 0x7f70c80701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.559+0000 7f70d6ffd640 1 -- 172.21.15.67:0/2525304869 --> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70c8070870 con 0x7f70c806dd60 2024-09-19T05:49:42.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.559+0000 7f70d6ffd640 1 -- 172.21.15.67:0/2525304869 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) ==== 24+0+0 (secure 0 0 0) 0x7f70d8086890 con 0x7f70e80afe10 2024-09-19T05:49:42.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.559+0000 7f70e5d9b640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70c80678c0 0x7f70c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.559+0000 7f70e6d9d640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x7f70c806dd60 0x7f70c80701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.559+0000 7f70e5d9b640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70c80678c0 0x7f70c8069d80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f70e815f990 tx=0x7f70dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.559+0000 7f70e6d9d640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x7f70c806dd60 0x7f70c80701a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.559+0000 7f70d6ffd640 1 -- 172.21.15.67:0/2525304869 <== osd.6 v2:172.21.15.97:6800/2892447445 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70c8070870 con 0x7f70c806dd60 2024-09-19T05:49:42.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 --> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f70e806eb00 con 0x7f70c806dd60 2024-09-19T05:49:42.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70d6ffd640 1 -- 172.21.15.67:0/2525304869 <== osd.6 v2:172.21.15.97:6800/2892447445 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f70e806eb00 con 0x7f70c806dd60 2024-09-19T05:49:42.573 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:49:42.573 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:49:42.573 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:49:42.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x7f70c806dd60 msgr2=0x7f70c80701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:6800/2892447445,v1:172.21.15.97:6801/2892447445] conn(0x7f70c806dd60 0x7f70c80701a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70c80678c0 msgr2=0x7f70c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f70c80678c0 0x7f70c8069d80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f70e815f990 tx=0x7f70dc008040 comp rx=0 tx=0).stop 2024-09-19T05:49:42.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e80afe10 msgr2=0x7f70e8157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 --2- 172.21.15.67:0/2525304869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e80afe10 0x7f70e8157220 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c450 tx=0x7f70d800c910 comp rx=0 tx=0).stop 2024-09-19T05:49:42.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70e6d9d640 1 -- 172.21.15.67:0/2525304869 reap_dead start 2024-09-19T05:49:42.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 shutdown_connections 2024-09-19T05:49:42.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 >> 172.21.15.67:0/2525304869 conn(0x7f70e80735c0 msgr2=0x7f70e8161c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:42.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 shutdown_connections 2024-09-19T05:49:42.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.575+0000 7f70ec992640 1 -- 172.21.15.67:0/2525304869 wait complete. 2024-09-19T05:49:42.589 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-19T05:49:42.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd5a17d1640 1 Processor -- start 2024-09-19T05:49:42.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd5a17d1640 1 -- start start 2024-09-19T05:49:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd5a17d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd59c06db50 0x7fd59c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd5a17d1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd59c0b37a0 0x7fd59c0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd5a17d1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59c09bdc0 con 0x7fd59c161b70 2024-09-19T05:49:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd5a17d1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd59c0d3220 con 0x7fd59c0b37a0 2024-09-19T05:49:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd5a17d1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd59c0d2f40 con 0x7fd59c06db50 2024-09-19T05:49:42.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd59b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd59c0b37a0 0x7fd59c0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd59b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd59c0b37a0 0x7fd59c0cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43194/0 (socket says 172.21.15.67:43194) 2024-09-19T05:49:42.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd59b7fe640 1 -- 172.21.15.67:0/1985078373 learned_addr learned my addr 172.21.15.67:0/1985078373 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:42.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd59a7fc640 1 --2- 172.21.15.67:0/1985078373 >> v2:172.21.15.97:3300/0 conn(0x7fd59c06db50 0x7fd59c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd59b7fe640 1 -- 172.21.15.67:0/1985078373 >> v2:172.21.15.97:3300/0 conn(0x7fd59c06db50 msgr2=0x7fd59c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:42.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd59b7fe640 1 --2- 172.21.15.67:0/1985078373 >> v2:172.21.15.97:3300/0 conn(0x7fd59c06db50 0x7fd59c0d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd59b7fe640 1 -- 172.21.15.67:0/1985078373 >> v1:172.21.15.97:6789/0 conn(0x7fd59c161b70 legacy=0x7fd59c06d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:42.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd59b7fe640 1 -- 172.21.15.67:0/1985078373 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c0d10c0 con 0x7fd59c0b37a0 2024-09-19T05:49:42.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.707+0000 7fd59a7fc640 1 --2- 172.21.15.67:0/1985078373 >> v2:172.21.15.97:3300/0 conn(0x7fd59c06db50 0x7fd59c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:42.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd59b7fe640 1 --2- 172.21.15.67:0/1985078373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 0x7fd59c0cc940 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7fd59c073c30 tx=0x7fd59401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3204d8b2f08464a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd599ffb640 1 -- 172.21.15.67:0/1985078373 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5940b0070 con 0x7fd59c0b37a0 2024-09-19T05:49:42.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd599ffb640 1 -- 172.21.15.67:0/1985078373 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5940a4e50 con 0x7fd59c0b37a0 2024-09-19T05:49:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd599ffb640 1 -- 172.21.15.67:0/1985078373 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5940ab820 con 0x7fd59c0b37a0 2024-09-19T05:49:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd5a17d1640 1 -- 172.21.15.67:0/1985078373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 msgr2=0x7fd59c0cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd5a17d1640 1 --2- 172.21.15.67:0/1985078373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 0x7fd59c0cc940 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7fd59c073c30 tx=0x7fd59401c3c0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd5a17d1640 1 -- 172.21.15.67:0/1985078373 shutdown_connections 2024-09-19T05:49:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd5a17d1640 1 --2- 172.21.15.67:0/1985078373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 0x7fd59c0cc940 unknown :-1 s=CLOSED pgs=2582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd5a17d1640 1 --2- 172.21.15.67:0/1985078373 >> v2:172.21.15.97:3300/0 conn(0x7fd59c06db50 0x7fd59c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd5a17d1640 1 -- 172.21.15.67:0/1985078373 >> 172.21.15.67:0/1985078373 conn(0x7fd59c0d22f0 msgr2=0x7fd59c0d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:42.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd5a17d1640 1 -- 172.21.15.67:0/1985078373 shutdown_connections 2024-09-19T05:49:42.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd5a17d1640 1 -- 172.21.15.67:0/1985078373 wait complete. 2024-09-19T05:49:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.711+0000 7fd5a17d1640 1 Processor -- start 2024-09-19T05:49:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5a17d1640 1 -- start start 2024-09-19T05:49:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5a17d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59c06db50 0x7fd59c14c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5a17d1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 0x7fd59c0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5a17d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59c161b70 0x7fd59c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5a17d1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c16b460 con 0x7fd59c0b37a0 2024-09-19T05:49:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5a17d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c16b2e0 con 0x7fd59c06db50 2024-09-19T05:49:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5a17d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd59c16b5e0 con 0x7fd59c161b70 2024-09-19T05:49:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 0x7fd59c0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 0x7fd59c0cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43196/0 (socket says 172.21.15.67:43196) 2024-09-19T05:49:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59a7fc640 1 -- 172.21.15.67:0/3380507439 learned_addr learned my addr 172.21.15.67:0/3380507439 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59b7fe640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59c161b70 0x7fd59c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59affd640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59c06db50 0x7fd59c14c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59a7fc640 1 -- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59c161b70 msgr2=0x7fd59c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59a7fc640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59c161b70 0x7fd59c0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59a7fc640 1 -- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59c06db50 msgr2=0x7fd59c14c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59a7fc640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59c06db50 0x7fd59c14c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59a7fc640 1 -- 172.21.15.67:0/3380507439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c14cf30 con 0x7fd59c0b37a0 2024-09-19T05:49:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59affd640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59c06db50 0x7fd59c14c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59b7fe640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59c161b70 0x7fd59c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd59a7fc640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 0x7fd59c0cafe0 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c7f0 tx=0x7fd58400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5937fe640 1 -- 172.21.15.67:0/3380507439 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584015070 con 0x7fd59c0b37a0 2024-09-19T05:49:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5937fe640 1 -- 172.21.15.67:0/3380507439 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd584007820 con 0x7fd59c0b37a0 2024-09-19T05:49:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5937fe640 1 -- 172.21.15.67:0/3380507439 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584007c10 con 0x7fd59c0b37a0 2024-09-19T05:49:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5a17d1640 1 -- 172.21.15.67:0/3380507439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c0ca100 con 0x7fd59c0b37a0 2024-09-19T05:49:42.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5a17d1640 1 -- 172.21.15.67:0/3380507439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c0ca9a0 con 0x7fd59c0b37a0 2024-09-19T05:49:42.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5a17d1640 1 -- 172.21.15.67:0/3380507439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59c0d18c0 con 0x7fd59c0b37a0 2024-09-19T05:49:42.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5937fe640 1 -- 172.21.15.67:0/3380507439 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd584018070 con 0x7fd59c0b37a0 2024-09-19T05:49:42.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.715+0000 7fd5937fe640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd57c0678c0 0x7fd57c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:42.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.719+0000 7fd5937fe640 1 -- 172.21.15.67:0/3380507439 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fd584085cf0 con 0x7fd59c0b37a0 2024-09-19T05:49:42.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.719+0000 7fd59affd640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd57c0678c0 0x7fd57c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:42.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.719+0000 7fd59affd640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd57c0678c0 0x7fd57c069d80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd58c007fd0 tx=0x7fd58c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.723+0000 7fd5937fe640 1 -- 172.21.15.67:0/3380507439 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fd584056900 con 0x7fd59c0b37a0 2024-09-19T05:49:42.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.879+0000 7fd5a17d1640 1 -- 172.21.15.67:0/3380507439 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fd59c070c80 con 0x7fd57c0678c0 2024-09-19T05:49:42.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5937fe640 1 -- 172.21.15.67:0/3380507439 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd59c070c80 con 0x7fd57c0678c0 2024-09-19T05:49:42.880 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 6 to deep-scrub 2024-09-19T05:49:42.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 -- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd57c0678c0 msgr2=0x7fd57c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd57c0678c0 0x7fd57c069d80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd58c007fd0 tx=0x7fd58c009040 comp rx=0 tx=0).stop 2024-09-19T05:49:42.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 -- 172.21.15.67:0/3380507439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 msgr2=0x7fd59c0cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:42.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 0x7fd59c0cafe0 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c7f0 tx=0x7fd58400ccb0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 -- 172.21.15.67:0/3380507439 shutdown_connections 2024-09-19T05:49:42.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd57c0678c0 0x7fd57c069d80 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59c161b70 0x7fd59c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd59c0b37a0 0x7fd59c0cafe0 unknown :-1 s=CLOSED pgs=2583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 --2- 172.21.15.67:0/3380507439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59c06db50 0x7fd59c14c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:42.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 -- 172.21.15.67:0/3380507439 >> 172.21.15.67:0/3380507439 conn(0x7fd59c0d22f0 msgr2=0x7fd59c0d26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:42.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 -- 172.21.15.67:0/3380507439 shutdown_connections 2024-09-19T05:49:42.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:42.883+0000 7fd5a17d1640 1 -- 172.21.15.67:0/3380507439 wait complete. 2024-09-19T05:49:42.898 INFO:tasks.ceph:Scrubbing osd.7 2024-09-19T05:49:42.899 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:49:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3bdbf5640 1 Processor -- start 2024-09-19T05:49:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3bdbf5640 1 -- start start 2024-09-19T05:49:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3bdbf5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd3b806bfa0 0x7fd3b806c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3bdbf5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3b80b4d60 0x7fd3b80b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3bdbf5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b806c8c0 con 0x7fd3b815b360 2024-09-19T05:49:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3bdbf5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b80739f0 con 0x7fd3b80b4d60 2024-09-19T05:49:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3bdbf5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b8073710 con 0x7fd3b806bfa0 2024-09-19T05:49:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3b7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3b80b4d60 0x7fd3b80b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3b7fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3b80b4d60 0x7fd3b80b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43212/0 (socket says 172.21.15.67:43212) 2024-09-19T05:49:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3b7fff640 1 -- 172.21.15.67:0/2110070700 learned_addr learned my addr 172.21.15.67:0/2110070700 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3b77fe640 1 --2- 172.21.15.67:0/2110070700 >> v2:172.21.15.97:3300/0 conn(0x7fd3b806bfa0 0x7fd3b806c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3b7fff640 1 -- 172.21.15.67:0/2110070700 >> v2:172.21.15.97:3300/0 conn(0x7fd3b806bfa0 msgr2=0x7fd3b806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3b7fff640 1 --2- 172.21.15.67:0/2110070700 >> v2:172.21.15.97:3300/0 conn(0x7fd3b806bfa0 0x7fd3b806c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3b7fff640 1 -- 172.21.15.67:0/2110070700 >> v1:172.21.15.97:6789/0 conn(0x7fd3b815b360 legacy=0x7fd3b8072e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.031+0000 7fd3b7fff640 1 -- 172.21.15.67:0/2110070700 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b80b3180 con 0x7fd3b80b4d60 2024-09-19T05:49:43.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3b7fff640 1 --2- 172.21.15.67:0/2110070700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b4d60 0x7fd3b80b3c60 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7fd3b806d800 tx=0x7fd3b001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480cd0836268e104 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:43.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3b67fc640 1 -- 172.21.15.67:0/2110070700 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00a55e0 con 0x7fd3b80b4d60 2024-09-19T05:49:43.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3b67fc640 1 -- 172.21.15.67:0/2110070700 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b00a5780 con 0x7fd3b80b4d60 2024-09-19T05:49:43.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3b67fc640 1 -- 172.21.15.67:0/2110070700 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00a5b50 con 0x7fd3b80b4d60 2024-09-19T05:49:43.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/2110070700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b4d60 msgr2=0x7fd3b80b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 --2- 172.21.15.67:0/2110070700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b4d60 0x7fd3b80b3c60 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7fd3b806d800 tx=0x7fd3b001c920 comp rx=0 tx=0).stop 2024-09-19T05:49:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/2110070700 shutdown_connections 2024-09-19T05:49:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 --2- 172.21.15.67:0/2110070700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b4d60 0x7fd3b80b3c60 unknown :-1 s=CLOSED pgs=2584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 --2- 172.21.15.67:0/2110070700 >> v2:172.21.15.97:3300/0 conn(0x7fd3b806bfa0 0x7fd3b806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/2110070700 >> 172.21.15.67:0/2110070700 conn(0x7fd3b80b21e0 msgr2=0x7fd3b80b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/2110070700 shutdown_connections 2024-09-19T05:49:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/2110070700 wait complete. 2024-09-19T05:49:43.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 Processor -- start 2024-09-19T05:49:43.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 -- start start 2024-09-19T05:49:43.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3b806bfa0 0x7fd3b8099910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b4d60 0x7fd3b8154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b8154960 0x7fd3b80b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b8168030 con 0x7fd3b80b4d60 2024-09-19T05:49:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b8167eb0 con 0x7fd3b8154960 2024-09-19T05:49:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3bdbf5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b81681b0 con 0x7fd3b806bfa0 2024-09-19T05:49:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3b6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b4d60 0x7fd3b8154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3b6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b4d60 0x7fd3b8154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43216/0 (socket says 172.21.15.67:43216) 2024-09-19T05:49:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3b6ffd640 1 -- 172.21.15.67:0/1227815356 learned_addr learned my addr 172.21.15.67:0/1227815356 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3b7fff640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b8154960 0x7fd3b80b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.035+0000 7fd3b77fe640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3b806bfa0 0x7fd3b8099910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3b6ffd640 1 -- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3b806bfa0 msgr2=0x7fd3b8099910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3b6ffd640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3b806bfa0 0x7fd3b8099910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3b6ffd640 1 -- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b8154960 msgr2=0x7fd3b80b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3b6ffd640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b8154960 0x7fd3b80b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3b6ffd640 1 -- 172.21.15.67:0/1227815356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b80ccbf0 con 0x7fd3b80b4d60 2024-09-19T05:49:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3b6ffd640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b4d60 0x7fd3b8154420 secure :-1 s=READY pgs=2585 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00c450 tx=0x7fd3ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd39ffff640 1 -- 172.21.15.67:0/1227815356 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac012830 con 0x7fd3b80b4d60 2024-09-19T05:49:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd39ffff640 1 -- 172.21.15.67:0/1227815356 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ac017070 con 0x7fd3b80b4d60 2024-09-19T05:49:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd39ffff640 1 -- 172.21.15.67:0/1227815356 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac012c30 con 0x7fd3b80b4d60 2024-09-19T05:49:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b80cced0 con 0x7fd3b80b4d60 2024-09-19T05:49:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b80cd490 con 0x7fd3b80b4d60 2024-09-19T05:49:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3b806c380 con 0x7fd3b80b4d60 2024-09-19T05:49:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd39ffff640 1 -- 172.21.15.67:0/1227815356 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3ac01c460 con 0x7fd3b80b4d60 2024-09-19T05:49:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd39ffff640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3a40678f0 0x7fd3a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd39ffff640 1 -- 172.21.15.67:0/1227815356 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fd3ac0862b0 con 0x7fd3b80b4d60 2024-09-19T05:49:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd39ffff640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] conn(0x7fd3a406dd90 0x7fd3a40701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd39ffff640 1 -- 172.21.15.67:0/1227815356 --> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3a40708a0 con 0x7fd3a406dd90 2024-09-19T05:49:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd39ffff640 1 -- 172.21.15.67:0/1227815356 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) ==== 24+0+0 (secure 0 0 0) 0x7fd3ac086740 con 0x7fd3b80b4d60 2024-09-19T05:49:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3b77fe640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3a40678f0 0x7fd3a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3b7fff640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] conn(0x7fd3a406dd90 0x7fd3a40701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3b77fe640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3a40678f0 0x7fd3a4069db0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80096f0 tx=0x7fd3a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.039+0000 7fd3b7fff640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] conn(0x7fd3a406dd90 0x7fd3a40701d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.043+0000 7fd39ffff640 1 -- 172.21.15.67:0/1227815356 <== osd.7 v2:172.21.15.97:6816/3738159386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3a40708a0 con 0x7fd3a406dd90 2024-09-19T05:49:43.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 --> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd3b809e430 con 0x7fd3a406dd90 2024-09-19T05:49:43.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd39ffff640 1 -- 172.21.15.67:0/1227815356 <== osd.7 v2:172.21.15.97:6816/3738159386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd3b809e430 con 0x7fd3a406dd90 2024-09-19T05:49:43.056 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-19T05:49:43.056 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:49:43.056 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-19T05:49:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] conn(0x7fd3a406dd90 msgr2=0x7fd3a40701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:6816/3738159386,v1:172.21.15.97:6817/3738159386] conn(0x7fd3a406dd90 0x7fd3a40701d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3a40678f0 msgr2=0x7fd3a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fd3a40678f0 0x7fd3a4069db0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80096f0 tx=0x7fd3a8008040 comp rx=0 tx=0).stop 2024-09-19T05:49:43.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b4d60 msgr2=0x7fd3b8154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 --2- 172.21.15.67:0/1227815356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3b80b4d60 0x7fd3b8154420 secure :-1 s=READY pgs=2585 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00c450 tx=0x7fd3ac00c910 comp rx=0 tx=0).stop 2024-09-19T05:49:43.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3b7fff640 1 -- 172.21.15.67:0/1227815356 reap_dead start 2024-09-19T05:49:43.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 shutdown_connections 2024-09-19T05:49:43.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 >> 172.21.15.67:0/1227815356 conn(0x7fd3b80b21e0 msgr2=0x7fd3b8072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:43.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 shutdown_connections 2024-09-19T05:49:43.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.055+0000 7fd3bdbf5640 1 -- 172.21.15.67:0/1227815356 wait complete. 2024-09-19T05:49:43.072 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-19T05:49:43.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa76583d640 1 Processor -- start 2024-09-19T05:49:43.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa76583d640 1 -- start start 2024-09-19T05:49:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa76583d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa76015bef0 0x7fa760073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa76583d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa7600d0980 0x7fa760071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa76583d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7600ad610 con 0x7fa76015c2d0 2024-09-19T05:49:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa76583d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa7600ad8f0 con 0x7fa7600d0980 2024-09-19T05:49:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa76583d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa7600b3230 con 0x7fa76015bef0 2024-09-19T05:49:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa75effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa76015bef0 0x7fa760073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa75f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa7600d0980 0x7fa760071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa75effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa76015bef0 0x7fa760073fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.67:42924/0 (socket says 172.21.15.67:42924) 2024-09-19T05:49:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa75effd640 1 -- 172.21.15.67:0/2485440981 learned_addr learned my addr 172.21.15.67:0/2485440981 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa75effd640 1 -- 172.21.15.67:0/2485440981 >> v2:172.21.15.97:3300/0 conn(0x7fa7600d0980 msgr2=0x7fa760071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa75effd640 1 --2- 172.21.15.67:0/2485440981 >> v2:172.21.15.97:3300/0 conn(0x7fa7600d0980 0x7fa760071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa75effd640 1 -- 172.21.15.67:0/2485440981 >> v1:172.21.15.97:6789/0 conn(0x7fa76015c2d0 legacy=0x7fa7600d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.187+0000 7fa75effd640 1 -- 172.21.15.67:0/2485440981 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7600b3510 con 0x7fa76015bef0 2024-09-19T05:49:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75effd640 1 --2- 172.21.15.67:0/2485440981 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa76015bef0 0x7fa760073fd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa750009e50 tx=0x7fa75001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4d89474ba95e194 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:43.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75dffb640 1 -- 172.21.15.67:0/2485440981 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7500a58c0 con 0x7fa76015bef0 2024-09-19T05:49:43.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75dffb640 1 -- 172.21.15.67:0/2485440981 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7500a5a60 con 0x7fa76015bef0 2024-09-19T05:49:43.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75dffb640 1 -- 172.21.15.67:0/2485440981 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7500a5e30 con 0x7fa76015bef0 2024-09-19T05:49:43.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 -- 172.21.15.67:0/2485440981 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa76015bef0 msgr2=0x7fa760073fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 --2- 172.21.15.67:0/2485440981 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa76015bef0 0x7fa760073fd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa750009e50 tx=0x7fa75001ca30 comp rx=0 tx=0).stop 2024-09-19T05:49:43.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 -- 172.21.15.67:0/2485440981 shutdown_connections 2024-09-19T05:49:43.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 --2- 172.21.15.67:0/2485440981 >> v2:172.21.15.97:3300/0 conn(0x7fa7600d0980 0x7fa760071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 --2- 172.21.15.67:0/2485440981 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa76015bef0 0x7fa760073fd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 -- 172.21.15.67:0/2485440981 >> 172.21.15.67:0/2485440981 conn(0x7fa76006be10 msgr2=0x7fa76006c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:43.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 -- 172.21.15.67:0/2485440981 shutdown_connections 2024-09-19T05:49:43.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 -- 172.21.15.67:0/2485440981 wait complete. 2024-09-19T05:49:43.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 Processor -- start 2024-09-19T05:49:43.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 -- start start 2024-09-19T05:49:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7600d0980 0x7fa76009dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76015bef0 0x7fa760151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa760099a10 0x7fa76009ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa760168ec0 con 0x7fa76015bef0 2024-09-19T05:49:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa760168d40 con 0x7fa7600d0980 2024-09-19T05:49:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa76583d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fa760169040 con 0x7fa760099a10 2024-09-19T05:49:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76015bef0 0x7fa760151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76015bef0 0x7fa760151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43230/0 (socket says 172.21.15.67:43230) 2024-09-19T05:49:43.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75e7fc640 1 -- 172.21.15.67:0/2106277039 learned_addr learned my addr 172.21.15.67:0/2106277039 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:43.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75effd640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7600d0980 0x7fa76009dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75f7fe640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa760099a10 0x7fa76009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75e7fc640 1 -- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa760099a10 msgr2=0x7fa76009ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75e7fc640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa760099a10 0x7fa76009ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75e7fc640 1 -- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7600d0980 msgr2=0x7fa76009dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75e7fc640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7600d0980 0x7fa76009dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75e7fc640 1 -- 172.21.15.67:0/2106277039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa760099ea0 con 0x7fa76015bef0 2024-09-19T05:49:43.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.191+0000 7fa75effd640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7600d0980 0x7fa76009dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:49:43.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa75e7fc640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76015bef0 0x7fa760151050 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c310 tx=0x7fa74800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:43.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa757fff640 1 -- 172.21.15.67:0/2106277039 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480052d0 con 0x7fa76015bef0 2024-09-19T05:49:43.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa757fff640 1 -- 172.21.15.67:0/2106277039 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa748005470 con 0x7fa76015bef0 2024-09-19T05:49:43.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa76583d640 1 -- 172.21.15.67:0/2106277039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa760151750 con 0x7fa76015bef0 2024-09-19T05:49:43.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa757fff640 1 -- 172.21.15.67:0/2106277039 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748007260 con 0x7fa76015bef0 2024-09-19T05:49:43.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa76583d640 1 -- 172.21.15.67:0/2106277039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76009a370 con 0x7fa76015bef0 2024-09-19T05:49:43.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa76583d640 1 -- 172.21.15.67:0/2106277039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa760071e50 con 0x7fa76015bef0 2024-09-19T05:49:43.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa757fff640 1 -- 172.21.15.67:0/2106277039 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa748007400 con 0x7fa76015bef0 2024-09-19T05:49:43.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa757fff640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7400678c0 0x7fa740069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa757fff640 1 -- 172.21.15.67:0/2106277039 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fa748084fd0 con 0x7fa76015bef0 2024-09-19T05:49:43.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa75effd640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7400678c0 0x7fa740069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.195+0000 7fa75effd640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7400678c0 0x7fa740069d80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa7500ae000 tx=0x7fa7500a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:43.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.199+0000 7fa757fff640 1 -- 172.21.15.67:0/2106277039 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fa748055c80 con 0x7fa76015bef0 2024-09-19T05:49:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 -- 172.21.15.67:0/2106277039 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fa760156140 con 0x7fa7400678c0 2024-09-19T05:49:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa757fff640 1 -- 172.21.15.67:0/2106277039 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa760156140 con 0x7fa7400678c0 2024-09-19T05:49:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 7 to deep-scrub 2024-09-19T05:49:43.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 -- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7400678c0 msgr2=0x7fa740069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7400678c0 0x7fa740069d80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa7500ae000 tx=0x7fa7500a7070 comp rx=0 tx=0).stop 2024-09-19T05:49:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 -- 172.21.15.67:0/2106277039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76015bef0 msgr2=0x7fa760151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76015bef0 0x7fa760151050 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c310 tx=0x7fa74800c7d0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 -- 172.21.15.67:0/2106277039 shutdown_connections 2024-09-19T05:49:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fa7400678c0 0x7fa740069d80 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa760099a10 0x7fa76009ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76015bef0 0x7fa760151050 unknown :-1 s=CLOSED pgs=2586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 --2- 172.21.15.67:0/2106277039 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7600d0980 0x7fa76009dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 -- 172.21.15.67:0/2106277039 >> 172.21.15.67:0/2106277039 conn(0x7fa76006be10 msgr2=0x7fa760155010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 -- 172.21.15.67:0/2106277039 shutdown_connections 2024-09-19T05:49:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.359+0000 7fa76583d640 1 -- 172.21.15.67:0/2106277039 wait complete. 2024-09-19T05:49:43.375 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:49:43.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe8642f6640 1 Processor -- start 2024-09-19T05:49:43.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe8642f6640 1 -- start start 2024-09-19T05:49:43.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe8642f6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe85c15b1a0 0x7fe85c06f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe8642f6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c0ae0d0 0x7fe85c0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe8642f6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe85c073110 con 0x7fe85c0adc60 2024-09-19T05:49:43.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe8642f6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe85c0733f0 con 0x7fe85c15b1a0 2024-09-19T05:49:43.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe8642f6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c0736d0 con 0x7fe85c0ae0d0 2024-09-19T05:49:43.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe862092640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe85c15b1a0 0x7fe85c06f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe862092640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe85c15b1a0 0x7fe85c06f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43240/0 (socket says 172.21.15.67:43240) 2024-09-19T05:49:43.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe862092640 1 -- 172.21.15.67:0/1348000658 learned_addr learned my addr 172.21.15.67:0/1348000658 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:43.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe862893640 1 --2- 172.21.15.67:0/1348000658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c0ae0d0 0x7fe85c0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe862092640 1 -- 172.21.15.67:0/1348000658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c0ae0d0 msgr2=0x7fe85c0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:49:43.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe862092640 1 --2- 172.21.15.67:0/1348000658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c0ae0d0 0x7fe85c0b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe862092640 1 -- 172.21.15.67:0/1348000658 >> v1:172.21.15.97:6789/0 conn(0x7fe85c0adc60 legacy=0x7fe85c0d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.499+0000 7fe862092640 1 -- 172.21.15.67:0/1348000658 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c0b3210 con 0x7fe85c15b1a0 2024-09-19T05:49:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe862092640 1 --2- 172.21.15.67:0/1348000658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 0x7fe85c06f850 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7fe858009870 tx=0x7fe85801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b095c0e1ad06514 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe861090640 1 -- 172.21.15.67:0/1348000658 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580b0070 con 0x7fe85c15b1a0 2024-09-19T05:49:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe861090640 1 -- 172.21.15.67:0/1348000658 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8580ab600 con 0x7fe85c15b1a0 2024-09-19T05:49:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe861090640 1 -- 172.21.15.67:0/1348000658 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580ab9d0 con 0x7fe85c15b1a0 2024-09-19T05:49:43.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 -- 172.21.15.67:0/1348000658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 msgr2=0x7fe85c06f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 --2- 172.21.15.67:0/1348000658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 0x7fe85c06f850 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7fe858009870 tx=0x7fe85801c440 comp rx=0 tx=0).stop 2024-09-19T05:49:43.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 -- 172.21.15.67:0/1348000658 shutdown_connections 2024-09-19T05:49:43.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 --2- 172.21.15.67:0/1348000658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c0ae0d0 0x7fe85c0b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 --2- 172.21.15.67:0/1348000658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 0x7fe85c06f850 unknown :-1 s=CLOSED pgs=2587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 -- 172.21.15.67:0/1348000658 >> 172.21.15.67:0/1348000658 conn(0x7fe85c06c040 msgr2=0x7fe85c06c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:43.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 -- 172.21.15.67:0/1348000658 shutdown_connections 2024-09-19T05:49:43.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 -- 172.21.15.67:0/1348000658 wait complete. 2024-09-19T05:49:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 Processor -- start 2024-09-19T05:49:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 -- start start 2024-09-19T05:49:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c0adc60 0x7fe85c1492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 0x7fe85c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c154f70 0x7fe85c155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c0d0e70 con 0x7fe85c15b1a0 2024-09-19T05:49:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c0d0cf0 con 0x7fe85c0adc60 2024-09-19T05:49:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe8642f6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c06de60 con 0x7fe85c154f70 2024-09-19T05:49:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe861891640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 0x7fe85c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe861891640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 0x7fe85c1555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43248/0 (socket says 172.21.15.67:43248) 2024-09-19T05:49:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.503+0000 7fe861891640 1 -- 172.21.15.67:0/2138885459 learned_addr learned my addr 172.21.15.67:0/2138885459 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:49:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe862092640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c0adc60 0x7fe85c1492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe862893640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c154f70 0x7fe85c155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe861891640 1 -- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c154f70 msgr2=0x7fe85c155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe861891640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c154f70 0x7fe85c155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe861891640 1 -- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c0adc60 msgr2=0x7fe85c1492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe861891640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c0adc60 0x7fe85c1492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe861891640 1 -- 172.21.15.67:0/2138885459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c156470 con 0x7fe85c15b1a0 2024-09-19T05:49:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe862893640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c154f70 0x7fe85c155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:49:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe861891640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 0x7fe85c1555f0 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00c420 tx=0x7fe84c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe852ffd640 1 -- 172.21.15.67:0/2138885459 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84c0052d0 con 0x7fe85c15b1a0 2024-09-19T05:49:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe852ffd640 1 -- 172.21.15.67:0/2138885459 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe84c005470 con 0x7fe85c15b1a0 2024-09-19T05:49:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe8642f6640 1 -- 172.21.15.67:0/2138885459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85c156710 con 0x7fe85c15b1a0 2024-09-19T05:49:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe852ffd640 1 -- 172.21.15.67:0/2138885459 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84c007260 con 0x7fe85c15b1a0 2024-09-19T05:49:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe8642f6640 1 -- 172.21.15.67:0/2138885459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85c154a50 con 0x7fe85c15b1a0 2024-09-19T05:49:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe8642f6640 1 -- 172.21.15.67:0/2138885459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85c0b3730 con 0x7fe85c15b1a0 2024-09-19T05:49:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe852ffd640 1 -- 172.21.15.67:0/2138885459 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe84c007400 con 0x7fe85c15b1a0 2024-09-19T05:49:43.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe852ffd640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8400678c0 0x7fe840069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:49:43.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe852ffd640 1 -- 172.21.15.67:0/2138885459 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fe84c085050 con 0x7fe85c15b1a0 2024-09-19T05:49:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe862092640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8400678c0 0x7fe840069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:49:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.507+0000 7fe862092640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8400678c0 0x7fe840069d80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe8580ad000 tx=0x7fe858008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:49:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.511+0000 7fe852ffd640 1 -- 172.21.15.67:0/2138885459 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fe84c055d00 con 0x7fe85c15b1a0 2024-09-19T05:49:43.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.671+0000 7fe8642f6640 1 -- 172.21.15.67:0/2138885459 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe85c15e900 con 0x7fe8400678c0 2024-09-19T05:49:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.671+0000 7fe852ffd640 1 -- 172.21.15.67:0/2138885459 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13393 (secure 0 0 0) 0x7fe85c15e900 con 0x7fe8400678c0 2024-09-19T05:49:43.672 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:49:43.672 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:49:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 -- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8400678c0 msgr2=0x7fe840069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8400678c0 0x7fe840069d80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe8580ad000 tx=0x7fe858008040 comp rx=0 tx=0).stop 2024-09-19T05:49:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 -- 172.21.15.67:0/2138885459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 msgr2=0x7fe85c1555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:49:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 0x7fe85c1555f0 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00c420 tx=0x7fe84c00c8e0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 -- 172.21.15.67:0/2138885459 shutdown_connections 2024-09-19T05:49:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fe8400678c0 0x7fe840069d80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe85c154f70 0x7fe85c155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe85c15b1a0 0x7fe85c1555f0 unknown :-1 s=CLOSED pgs=2588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 --2- 172.21.15.67:0/2138885459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c0adc60 0x7fe85c1492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:49:43.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 -- 172.21.15.67:0/2138885459 >> 172.21.15.67:0/2138885459 conn(0x7fe85c06c040 msgr2=0x7fe85c0ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:49:43.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 -- 172.21.15.67:0/2138885459 shutdown_connections 2024-09-19T05:49:43.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:49:43.675+0000 7fe8642f6640 1 -- 172.21.15.67:0/2138885459 wait complete. 2024-09-19T05:49:43.689 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":704,"stamp":"2024-09-19T05:49:43.456806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":557292,"kb_used_data":21896,"kb_used_omap":12,"kb_used_meta":535219,"kb_avail":754417428,"statfs":{"total":773094113280,"available":772523446272,"internally_reserved":0,"allocated":22421504,"data_stored":11222840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":548064817},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-7,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.332034"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":517,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-19T05:49:36.807904+0000","last_change":"2024-09-19T05:33:04.817009+0000","last_active":"2024-09-19T05:49:36.807904+0000","last_peered":"2024-09-19T05:49:36.807904+0000","last_clean":"2024-09-19T05:49:36.807904+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:49:36.807904+0000","last_undegraded":"2024-09-19T05:49:36.807904+0000","last_fullsized":"2024-09-19T05:49:36.807904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:33:03.319800+0000","last_clean_scrub_stamp":"2024-09-19T05:33:03.319800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:05.115567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74616,"kb_used_data":3172,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297224,"statfs":{"total":96636764160,"available":96560357376,"internally_reserved":0,"allocated":3248128,"data_stored":1845631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74036,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297804,"statfs":{"total":96636764160,"available":96560951296,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542348,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51828,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320012,"statfs":{"total":96636764160,"available":96583692288,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78196,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293644,"statfs":{"total":96636764160,"available":96556691456,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542347,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73976,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297864,"statfs":{"total":96636764160,"available":96561012736,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542347,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74036,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297804,"statfs":{"total":96636764160,"available":96560951296,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51828,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320012,"statfs":{"total":96636764160,"available":96583692288,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78776,"kb_used_data":3172,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293064,"statfs":{"total":96636764160,"available":96556097536,"internally_reserved":0,"allocated":3248128,"data_stored":1845631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:49:43.692 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-19T05:33:03.319800+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=33, tm_sec=3, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=49, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:49:43.692 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T05:50:03.693 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:50:03.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.831+0000 7fef89b9c640 1 Processor -- start 2024-09-19T05:50:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef89b9c640 1 -- start start 2024-09-19T05:50:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef89b9c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fef8415c0b0 0x7fef84071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef89b9c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef840ad0c0 0x7fef840ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef89b9c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef840d04b0 0x7fef840d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef89b9c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fef8406f770 con 0x7fef840d04b0 2024-09-19T05:50:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef89b9c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fef8415c8d0 con 0x7fef8415c0b0 2024-09-19T05:50:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef89b9c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fef8415cbb0 con 0x7fef840ad0c0 2024-09-19T05:50:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef83fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef840d04b0 0x7fef840d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef83fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef840d04b0 0x7fef840d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48558/0 (socket says 172.21.15.67:48558) 2024-09-19T05:50:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef83fff640 1 -- 172.21.15.67:0/4179878493 learned_addr learned my addr 172.21.15.67:0/4179878493 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:50:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef837fe640 1 --2- 172.21.15.67:0/4179878493 >> v2:172.21.15.97:3300/0 conn(0x7fef8415c0b0 0x7fef84071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef82ffd640 1 --2- 172.21.15.67:0/4179878493 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef840ad0c0 0x7fef840ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:03.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef83fff640 1 -- 172.21.15.67:0/4179878493 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef840ad0c0 msgr2=0x7fef840ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:50:03.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef83fff640 1 --2- 172.21.15.67:0/4179878493 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef840ad0c0 0x7fef840ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:03.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef83fff640 1 -- 172.21.15.67:0/4179878493 >> v2:172.21.15.97:3300/0 conn(0x7fef8415c0b0 msgr2=0x7fef84071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:50:03.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef83fff640 1 --2- 172.21.15.67:0/4179878493 >> v2:172.21.15.97:3300/0 conn(0x7fef8415c0b0 0x7fef84071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:03.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef83fff640 1 -- 172.21.15.67:0/4179878493 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8415ce90 con 0x7fef840d04b0 2024-09-19T05:50:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.835+0000 7fef83fff640 1 --2- 172.21.15.67:0/4179878493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840d04b0 0x7fef840d0960 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7fef84073e20 tx=0x7fef7c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bae8383ade8aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:50:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef827fc640 1 -- 172.21.15.67:0/4179878493 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0b1070 con 0x7fef840d04b0 2024-09-19T05:50:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef827fc640 1 -- 172.21.15.67:0/4179878493 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7c0ac630 con 0x7fef840d04b0 2024-09-19T05:50:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef827fc640 1 -- 172.21.15.67:0/4179878493 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0a8050 con 0x7fef840d04b0 2024-09-19T05:50:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- 172.21.15.67:0/4179878493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840d04b0 msgr2=0x7fef840d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 --2- 172.21.15.67:0/4179878493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840d04b0 0x7fef840d0960 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7fef84073e20 tx=0x7fef7c01c520 comp rx=0 tx=0).stop 2024-09-19T05:50:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- 172.21.15.67:0/4179878493 shutdown_connections 2024-09-19T05:50:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 --2- 172.21.15.67:0/4179878493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840d04b0 0x7fef840d0960 unknown :-1 s=CLOSED pgs=2589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 --2- 172.21.15.67:0/4179878493 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef840ad0c0 0x7fef840ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 --2- 172.21.15.67:0/4179878493 >> v2:172.21.15.97:3300/0 conn(0x7fef8415c0b0 0x7fef84071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- 172.21.15.67:0/4179878493 >> 172.21.15.67:0/4179878493 conn(0x7fef8406c040 msgr2=0x7fef8406c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:50:03.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- 172.21.15.67:0/4179878493 shutdown_connections 2024-09-19T05:50:03.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- 172.21.15.67:0/4179878493 wait complete. 2024-09-19T05:50:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 Processor -- start 2024-09-19T05:50:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- start start 2024-09-19T05:50:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840ad0c0 0x7fef84145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef840d04b0 0x7fef84159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8415c0b0 0x7fef840b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:03.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fef8406e670 con 0x7fef840ad0c0 2024-09-19T05:50:03.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fef8406e7f0 con 0x7fef840d04b0 2024-09-19T05:50:03.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7fef8406e970 con 0x7fef8415c0b0 2024-09-19T05:50:03.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840ad0c0 0x7fef84145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:03.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840ad0c0 0x7fef84145620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48566/0 (socket says 172.21.15.67:48566) 2024-09-19T05:50:03.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef837fe640 1 -- 172.21.15.67:0/2898393791 learned_addr learned my addr 172.21.15.67:0/2898393791 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:50:03.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef82ffd640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef840d04b0 0x7fef84159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:03.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef83fff640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8415c0b0 0x7fef840b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:03.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef837fe640 1 -- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8415c0b0 msgr2=0x7fef840b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:03.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef837fe640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8415c0b0 0x7fef840b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:03.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef837fe640 1 -- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef840d04b0 msgr2=0x7fef84159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:03.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef837fe640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef840d04b0 0x7fef84159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:03.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef837fe640 1 -- 172.21.15.67:0/2898393791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef840b4870 con 0x7fef840ad0c0 2024-09-19T05:50:03.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef82ffd640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef840d04b0 0x7fef84159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:50:03.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef83fff640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8415c0b0 0x7fef840b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:50:03.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef837fe640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840ad0c0 0x7fef84145620 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 crypto rx=0x7fef74007e70 tx=0x7fef7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:50:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef7bfff640 1 -- 172.21.15.67:0/2898393791 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74014620 con 0x7fef840ad0c0 2024-09-19T05:50:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef7bfff640 1 -- 172.21.15.67:0/2898393791 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef74019070 con 0x7fef840ad0c0 2024-09-19T05:50:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- 172.21.15.67:0/2898393791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef840b4b50 con 0x7fef840ad0c0 2024-09-19T05:50:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef7bfff640 1 -- 172.21.15.67:0/2898393791 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74014a00 con 0x7fef840ad0c0 2024-09-19T05:50:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.839+0000 7fef89b9c640 1 -- 172.21.15.67:0/2898393791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef840b5110 con 0x7fef840ad0c0 2024-09-19T05:50:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.843+0000 7fef89b9c640 1 -- 172.21.15.67:0/2898393791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef840d0960 con 0x7fef840ad0c0 2024-09-19T05:50:03.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.843+0000 7fef7bfff640 1 -- 172.21.15.67:0/2898393791 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef74014ba0 con 0x7fef840ad0c0 2024-09-19T05:50:03.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.843+0000 7fef7bfff640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef640678f0 0x7fef64069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:03.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.843+0000 7fef7bfff640 1 -- 172.21.15.67:0/2898393791 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7fef74086310 con 0x7fef840ad0c0 2024-09-19T05:50:03.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.843+0000 7fef82ffd640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef640678f0 0x7fef64069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:03.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.843+0000 7fef82ffd640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef640678f0 0x7fef64069db0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fef84157de0 tx=0x7fef6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:50:03.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:03.847+0000 7fef7bfff640 1 -- 172.21.15.67:0/2898393791 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7fef74011260 con 0x7fef840ad0c0 2024-09-19T05:50:04.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.007+0000 7fef89b9c640 1 -- 172.21.15.67:0/2898393791 --> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef84074be0 con 0x7fef640678f0 2024-09-19T05:50:04.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.011+0000 7fef7bfff640 1 -- 172.21.15.67:0/2898393791 <== mgr.4102 v2:172.21.15.97:6832/4012304794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13386 (secure 0 0 0) 0x7fef84074be0 con 0x7fef640678f0 2024-09-19T05:50:04.009 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:50:04.010 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-19T05:50:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 -- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef640678f0 msgr2=0x7fef64069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef640678f0 0x7fef64069db0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fef84157de0 tx=0x7fef6c008040 comp rx=0 tx=0).stop 2024-09-19T05:50:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 -- 172.21.15.67:0/2898393791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840ad0c0 msgr2=0x7fef84145620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840ad0c0 0x7fef84145620 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 crypto rx=0x7fef74007e70 tx=0x7fef7400e4b0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 -- 172.21.15.67:0/2898393791 shutdown_connections 2024-09-19T05:50:04.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7fef640678f0 0x7fef64069db0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8415c0b0 0x7fef840b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef840d04b0 0x7fef84159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 --2- 172.21.15.67:0/2898393791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef840ad0c0 0x7fef84145620 unknown :-1 s=CLOSED pgs=2590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 -- 172.21.15.67:0/2898393791 >> 172.21.15.67:0/2898393791 conn(0x7fef8406c040 msgr2=0x7fef8415e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:50:04.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 -- 172.21.15.67:0/2898393791 shutdown_connections 2024-09-19T05:50:04.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.015+0000 7fef89b9c640 1 -- 172.21.15.67:0/2898393791 wait complete. 2024-09-19T05:50:04.030 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":714,"stamp":"2024-09-19T05:50:03.461813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":557284,"kb_used_data":21896,"kb_used_omap":12,"kb_used_meta":535219,"kb_avail":754417436,"statfs":{"total":773094113280,"available":772523454464,"internally_reserved":0,"allocated":22421504,"data_stored":11222840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":548064817},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002979"},"pg_stats":[{"pgid":"1.0","version":"210'119","reported_seq":528,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-19T05:49:43.785307+0000","last_change":"2024-09-19T05:49:43.785381+0000","last_active":"2024-09-19T05:49:43.785307+0000","last_peered":"2024-09-19T05:49:43.785307+0000","last_clean":"2024-09-19T05:49:43.785307+0000","last_became_active":"2024-09-19T05:33:04.814941+0000","last_became_peered":"2024-09-19T05:33:04.814941+0000","last_unstale":"2024-09-19T05:49:43.785307+0000","last_undegraded":"2024-09-19T05:49:43.785307+0000","last_fullsized":"2024-09-19T05:49:43.785307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"210'119","last_scrub_stamp":"2024-09-19T05:49:43.785143+0000","last_deep_scrub":"210'119","last_deep_scrub_stamp":"2024-09-19T05:49:43.785143+0000","last_clean_scrub_stamp":"2024-09-19T05:49:43.785143+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:37.900520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542350,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74612,"kb_used_data":3172,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297228,"statfs":{"total":96636764160,"available":96560361472,"internally_reserved":0,"allocated":3248128,"data_stored":1845631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542350,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74036,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297804,"statfs":{"total":96636764160,"available":96560951296,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51828,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320012,"statfs":{"total":96636764160,"available":96583692288,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542350,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78196,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293644,"statfs":{"total":96636764160,"available":96556691456,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542351,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73976,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297864,"statfs":{"total":96636764160,"available":96561012736,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542351,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74036,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297804,"statfs":{"total":96636764160,"available":96560951296,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542353,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51828,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320012,"statfs":{"total":96636764160,"available":96583692288,"internally_reserved":0,"allocated":2654208,"data_stored":1255263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542350,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78772,"kb_used_data":3172,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293068,"statfs":{"total":96636764160,"available":96556101632,"internally_reserved":0,"allocated":3248128,"data_stored":1845631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:50:04.032 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-19T05:50:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f33719ed640 1 Processor -- start 2024-09-19T05:50:04.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f33719ed640 1 -- start start 2024-09-19T05:50:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f33719ed640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c15c310 0x7f336c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f33719ed640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f336c0af220 0x7f336c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f33719ed640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f336c0adf20 con 0x7f336c155620 2024-09-19T05:50:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f33719ed640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f336c0ae850 con 0x7f336c0af220 2024-09-19T05:50:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f33719ed640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f336c0ae200 con 0x7f336c15c310 2024-09-19T05:50:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f336b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f336c0af220 0x7f336c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f336b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f336c0af220 0x7f336c0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48570/0 (socket says 172.21.15.67:48570) 2024-09-19T05:50:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f336b7fe640 1 -- 172.21.15.67:0/3194312967 learned_addr learned my addr 172.21.15.67:0/3194312967 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:50:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f336a7fc640 1 --2- 172.21.15.67:0/3194312967 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c15c310 0x7f336c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f336b7fe640 1 -- 172.21.15.67:0/3194312967 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c15c310 msgr2=0x7f336c0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:50:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f336b7fe640 1 --2- 172.21.15.67:0/3194312967 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c15c310 0x7f336c0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f336b7fe640 1 -- 172.21.15.67:0/3194312967 >> v1:172.21.15.97:6789/0 conn(0x7f336c155620 legacy=0x7f336c06eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f336b7fe640 1 -- 172.21.15.67:0/3194312967 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c0ae4e0 con 0x7f336c0af220 2024-09-19T05:50:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.155+0000 7f336a7fc640 1 --2- 172.21.15.67:0/3194312967 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c15c310 0x7f336c0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:50:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f336b7fe640 1 --2- 172.21.15.67:0/3194312967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0af220 0x7f336c0d0270 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 crypto rx=0x7f336400d150 tx=0x7f336401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ac8106ebe7ac15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:50:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f3369ffb640 1 -- 172.21.15.67:0/3194312967 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336400b2d0 con 0x7f336c0af220 2024-09-19T05:50:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f3369ffb640 1 -- 172.21.15.67:0/3194312967 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336400b470 con 0x7f336c0af220 2024-09-19T05:50:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f3369ffb640 1 -- 172.21.15.67:0/3194312967 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33640a7b20 con 0x7f336c0af220 2024-09-19T05:50:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 -- 172.21.15.67:0/3194312967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0af220 msgr2=0x7f336c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 --2- 172.21.15.67:0/3194312967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0af220 0x7f336c0d0270 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 crypto rx=0x7f336400d150 tx=0x7f336401ec30 comp rx=0 tx=0).stop 2024-09-19T05:50:04.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 -- 172.21.15.67:0/3194312967 shutdown_connections 2024-09-19T05:50:04.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 --2- 172.21.15.67:0/3194312967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c0af220 0x7f336c0d0270 unknown :-1 s=CLOSED pgs=2591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 --2- 172.21.15.67:0/3194312967 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c15c310 0x7f336c0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 -- 172.21.15.67:0/3194312967 >> 172.21.15.67:0/3194312967 conn(0x7f336c06be10 msgr2=0x7f336c06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:50:04.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 -- 172.21.15.67:0/3194312967 shutdown_connections 2024-09-19T05:50:04.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 -- 172.21.15.67:0/3194312967 wait complete. 2024-09-19T05:50:04.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 Processor -- start 2024-09-19T05:50:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 -- start start 2024-09-19T05:50:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0af220 0x7f336c14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c155620 0x7f336c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c15c310 0x7f336c06f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f336c0b3500 con 0x7f336c15c310 2024-09-19T05:50:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f336c0b3380 con 0x7f336c155620 2024-09-19T05:50:04.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f33719ed640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f336c0b3680 con 0x7f336c0af220 2024-09-19T05:50:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f336b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c15c310 0x7f336c06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f336b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c15c310 0x7f336c06f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48582/0 (socket says 172.21.15.67:48582) 2024-09-19T05:50:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.159+0000 7f336b7fe640 1 -- 172.21.15.67:0/277216528 learned_addr learned my addr 172.21.15.67:0/277216528 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:50:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336a7fc640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c155620 0x7f336c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336affd640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0af220 0x7f336c14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336b7fe640 1 -- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0af220 msgr2=0x7f336c14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336b7fe640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0af220 0x7f336c14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336b7fe640 1 -- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c155620 msgr2=0x7f336c151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336b7fe640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c155620 0x7f336c151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336b7fe640 1 -- 172.21.15.67:0/277216528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c157b40 con 0x7f336c15c310 2024-09-19T05:50:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336a7fc640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c155620 0x7f336c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:50:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336affd640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0af220 0x7f336c14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:50:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336b7fe640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c15c310 0x7f336c06f600 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7f33640b1040 tx=0x7f336401b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:50:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f3353fff640 1 -- 172.21.15.67:0/277216528 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364009800 con 0x7f336c15c310 2024-09-19T05:50:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f3353fff640 1 -- 172.21.15.67:0/277216528 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33640be070 con 0x7f336c15c310 2024-09-19T05:50:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f3353fff640 1 -- 172.21.15.67:0/277216528 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364009c00 con 0x7f336c15c310 2024-09-19T05:50:04.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f33719ed640 1 -- 172.21.15.67:0/277216528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336c157e20 con 0x7f336c15c310 2024-09-19T05:50:04.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f33719ed640 1 -- 172.21.15.67:0/277216528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f336c1583e0 con 0x7f336c15c310 2024-09-19T05:50:04.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f33719ed640 1 -- 172.21.15.67:0/277216528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336c0d0270 con 0x7f336c15c310 2024-09-19T05:50:04.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f3353fff640 1 -- 172.21.15.67:0/277216528 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33640b6070 con 0x7f336c15c310 2024-09-19T05:50:04.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f3353fff640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33580678c0 0x7f3358069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f3353fff640 1 -- 172.21.15.67:0/277216528 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f3364121650 con 0x7f336c15c310 2024-09-19T05:50:04.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.163+0000 7f336affd640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33580678c0 0x7f3358069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.167+0000 7f336affd640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33580678c0 0x7f3358069d80 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f335c0016f0 tx=0x7f335c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:50:04.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.167+0000 7f3353fff640 1 -- 172.21.15.67:0/277216528 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f3364018820 con 0x7f336c15c310 2024-09-19T05:50:04.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.331+0000 7f33719ed640 1 -- 172.21.15.67:0/277216528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f336c1523f0 con 0x7f336c15c310 2024-09-19T05:50:04.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.339+0000 7f3353fff640 1 -- 172.21.15.67:0/277216528 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v50)=0 v50) ==== 123+0+0 (secure 0 0 0) 0x7f33640f23a0 con 0x7f336c15c310 2024-09-19T05:50:04.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f3353fff640 1 -- 172.21.15.67:0/277216528 <== mon.0 v2:172.21.15.67:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f33640f1ca0 con 0x7f336c15c310 2024-09-19T05:50:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 -- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33580678c0 msgr2=0x7f3358069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33580678c0 0x7f3358069d80 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f335c0016f0 tx=0x7f335c009040 comp rx=0 tx=0).stop 2024-09-19T05:50:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 -- 172.21.15.67:0/277216528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c15c310 msgr2=0x7f336c06f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c15c310 0x7f336c06f600 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7f33640b1040 tx=0x7f336401b9d0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 -- 172.21.15.67:0/277216528 shutdown_connections 2024-09-19T05:50:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f336c15c310 0x7f336c06f600 unknown :-1 s=CLOSED pgs=2592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f336c155620 0x7f336c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f33580678c0 0x7f3358069d80 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 --2- 172.21.15.67:0/277216528 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f336c0af220 0x7f336c14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 -- 172.21.15.67:0/277216528 >> 172.21.15.67:0/277216528 conn(0x7f336c06be10 msgr2=0x7f336c073de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:50:04.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 -- 172.21.15.67:0/277216528 shutdown_connections 2024-09-19T05:50:04.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.343+0000 7f33719ed640 1 -- 172.21.15.67:0/277216528 wait complete. 2024-09-19T05:50:04.359 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:50:04.360 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:50:04.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0522ea3640 1 Processor -- start 2024-09-19T05:50:04.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0522ea3640 1 -- start start 2024-09-19T05:50:04.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0522ea3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f051c15c0b0 0x7f051c071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0522ea3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f051c0ad0c0 0x7f051c0ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0522ea3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f051c0d04b0 0x7f051c0d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0522ea3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f051c06f770 con 0x7f051c15c0b0 2024-09-19T05:50:04.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0522ea3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f051c15c8d0 con 0x7f051c0d04b0 2024-09-19T05:50:04.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0522ea3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f051c15cbb0 con 0x7f051c0ad0c0 2024-09-19T05:50:04.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0520c3f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f051c15c0b0 0x7f051c071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0520c3f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f051c15c0b0 0x7f051c071e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48590/0 (socket says 172.21.15.67:48590) 2024-09-19T05:50:04.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0520c3f640 1 -- 172.21.15.67:0/3482257503 learned_addr learned my addr 172.21.15.67:0/3482257503 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:50:04.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0521440640 1 --2- 172.21.15.67:0/3482257503 >> v2:172.21.15.97:3300/0 conn(0x7f051c0d04b0 0x7f051c0d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f051bfff640 1 --2- 172.21.15.67:0/3482257503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f051c0ad0c0 0x7f051c0ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0520c3f640 1 -- 172.21.15.67:0/3482257503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f051c0ad0c0 msgr2=0x7f051c0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:50:04.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0520c3f640 1 --2- 172.21.15.67:0/3482257503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f051c0ad0c0 0x7f051c0ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0520c3f640 1 -- 172.21.15.67:0/3482257503 >> v2:172.21.15.97:3300/0 conn(0x7f051c0d04b0 msgr2=0x7f051c0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:50:04.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0520c3f640 1 --2- 172.21.15.67:0/3482257503 >> v2:172.21.15.97:3300/0 conn(0x7f051c0d04b0 0x7f051c0d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.479+0000 7f0520c3f640 1 -- 172.21.15.67:0/3482257503 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c15ce90 con 0x7f051c15c0b0 2024-09-19T05:50:04.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0520c3f640 1 --2- 172.21.15.67:0/3482257503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 0x7f051c071e00 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7f051c0702e0 tx=0x7f051001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a73685273c02532 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:50:04.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f051b7fe640 1 -- 172.21.15.67:0/3482257503 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05100b1070 con 0x7f051c15c0b0 2024-09-19T05:50:04.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f051b7fe640 1 -- 172.21.15.67:0/3482257503 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f05100ac630 con 0x7f051c15c0b0 2024-09-19T05:50:04.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f051b7fe640 1 -- 172.21.15.67:0/3482257503 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05100a8050 con 0x7f051c15c0b0 2024-09-19T05:50:04.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 -- 172.21.15.67:0/3482257503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 msgr2=0x7f051c071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 --2- 172.21.15.67:0/3482257503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 0x7f051c071e00 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7f051c0702e0 tx=0x7f051001c520 comp rx=0 tx=0).stop 2024-09-19T05:50:04.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 -- 172.21.15.67:0/3482257503 shutdown_connections 2024-09-19T05:50:04.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 --2- 172.21.15.67:0/3482257503 >> v2:172.21.15.97:3300/0 conn(0x7f051c0d04b0 0x7f051c0d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 --2- 172.21.15.67:0/3482257503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f051c0ad0c0 0x7f051c0ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 --2- 172.21.15.67:0/3482257503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 0x7f051c071e00 unknown :-1 s=CLOSED pgs=2593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 -- 172.21.15.67:0/3482257503 >> 172.21.15.67:0/3482257503 conn(0x7f051c06c040 msgr2=0x7f051c06c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:50:04.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 -- 172.21.15.67:0/3482257503 shutdown_connections 2024-09-19T05:50:04.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 -- 172.21.15.67:0/3482257503 wait complete. 2024-09-19T05:50:04.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 Processor -- start 2024-09-19T05:50:04.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 -- start start 2024-09-19T05:50:04.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f051c0ad0c0 0x7f051c0cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051c0d04b0 0x7f051c09c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 0x7f051c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f051c06e670 con 0x7f051c15c0b0 2024-09-19T05:50:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f051c06e7f0 con 0x7f051c0d04b0 2024-09-19T05:50:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.483+0000 7f0522ea3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 -- 0x7f051c06e970 con 0x7f051c0ad0c0 2024-09-19T05:50:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0521440640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 0x7f051c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0521440640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 0x7f051c15e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48594/0 (socket says 172.21.15.67:48594) 2024-09-19T05:50:04.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0521440640 1 -- 172.21.15.67:0/2595724347 learned_addr learned my addr 172.21.15.67:0/2595724347 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-19T05:50:04.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f051bfff640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051c0d04b0 0x7f051c09c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0521440640 1 -- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f051c0ad0c0 msgr2=0x7f051c0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0520c3f640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f051c0ad0c0 0x7f051c0cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0521440640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f051c0ad0c0 0x7f051c0cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0521440640 1 -- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051c0d04b0 msgr2=0x7f051c09c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0521440640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051c0d04b0 0x7f051c09c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0521440640 1 -- 172.21.15.67:0/2595724347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c160a40 con 0x7f051c15c0b0 2024-09-19T05:50:04.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f051bfff640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051c0d04b0 0x7f051c09c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:50:04.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0521440640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 0x7f051c15e4b0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7f0514007e70 tx=0x7f051400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:50:04.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f05197fa640 1 -- 172.21.15.67:0/2595724347 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514014620 con 0x7f051c15c0b0 2024-09-19T05:50:04.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f05197fa640 1 -- 172.21.15.67:0/2595724347 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0514019070 con 0x7f051c15c0b0 2024-09-19T05:50:04.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0522ea3640 1 -- 172.21.15.67:0/2595724347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051c1601a0 con 0x7f051c15c0b0 2024-09-19T05:50:04.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f05197fa640 1 -- 172.21.15.67:0/2595724347 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514014a40 con 0x7f051c15c0b0 2024-09-19T05:50:04.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0522ea3640 1 -- 172.21.15.67:0/2595724347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051c160760 con 0x7f051c15c0b0 2024-09-19T05:50:04.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0522ea3640 1 -- 172.21.15.67:0/2595724347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f051c0ad4a0 con 0x7f051c15c0b0 2024-09-19T05:50:04.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f05197fa640 1 -- 172.21.15.67:0/2595724347 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0514014be0 con 0x7f051c15c0b0 2024-09-19T05:50:04.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f05197fa640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05080678c0 0x7f0508069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:50:04.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f05197fa640 1 -- 172.21.15.67:0/2595724347 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5335+0+0 (secure 0 0 0) 0x7f05140864a0 con 0x7f051c15c0b0 2024-09-19T05:50:04.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0520c3f640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05080678c0 0x7f0508069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:50:04.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.487+0000 7f0520c3f640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05080678c0 0x7f0508069d80 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f05100ae000 tx=0x7f05100a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:50:04.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.491+0000 7f05197fa640 1 -- 172.21.15.67:0/2595724347 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180342 (secure 0 0 0) 0x7f0514011260 con 0x7f051c15c0b0 2024-09-19T05:50:04.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.691+0000 7f0522ea3640 1 -- 172.21.15.67:0/2595724347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f051c15f520 con 0x7f051c15c0b0 2024-09-19T05:50:04.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.691+0000 7f05197fa640 1 -- 172.21.15.67:0/2595724347 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 148 v148) ==== 95+0+3915 (secure 0 0 0) 0x7f05140570a0 con 0x7f051c15c0b0 2024-09-19T05:50:04.690 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-19T05:50:04.690 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":148,"btime":"2024-09-19T05:49:33:108491+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2335567881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2335567881},{"type":"v1","addr":"172.21.15.97:6837","nonce":2335567881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":8551,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1743099743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1743099743},{"type":"v1","addr":"172.21.15.97:6835","nonce":1743099743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":10839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/644096538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":644096538},{"type":"v1","addr":"172.21.15.67:6833","nonce":644096538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":11175,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2191997730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2191997730},{"type":"v1","addr":"172.21.15.67:6835","nonce":2191997730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":148}],"filesystems":[]} 2024-09-19T05:50:04.691 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 148 2024-09-19T05:50:04.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.691+0000 7f0522ea3640 1 -- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05080678c0 msgr2=0x7f0508069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05080678c0 0x7f0508069d80 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f05100ae000 tx=0x7f05100a7000 comp rx=0 tx=0).stop 2024-09-19T05:50:04.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 -- 172.21.15.67:0/2595724347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 msgr2=0x7f051c15e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:50:04.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 0x7f051c15e4b0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7f0514007e70 tx=0x7f051400e4b0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 -- 172.21.15.67:0/2595724347 shutdown_connections 2024-09-19T05:50:04.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f051c15c0b0 0x7f051c15e4b0 unknown :-1 s=CLOSED pgs=2594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051c0d04b0 0x7f051c09c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:6832/4012304794,v1:172.21.15.97:6833/4012304794] conn(0x7f05080678c0 0x7f0508069d80 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 --2- 172.21.15.67:0/2595724347 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f051c0ad0c0 0x7f051c0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:50:04.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 -- 172.21.15.67:0/2595724347 >> 172.21.15.67:0/2595724347 conn(0x7f051c06c040 msgr2=0x7f051c0b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:50:04.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 -- 172.21.15.67:0/2595724347 shutdown_connections 2024-09-19T05:50:04.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-19T05:50:04.695+0000 7f0522ea3640 1 -- 172.21.15.67:0/2595724347 wait complete. 2024-09-19T05:50:04.709 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-19T05:50:04.710 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-19T05:50:04.710 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:50:04.710 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:04.721 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:50:04.722 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:50:04.722 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:04.773 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:50:04.773 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:50:04.773 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:04.787 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:50:04.787 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:50:04.788 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:04.846 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:50:04.846 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-19T05:50:04.847 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-19T05:50:04.847 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:04.914 INFO:tasks.ceph.osd.0:Stopped 2024-09-19T05:50:04.915 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-19T05:50:04.915 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:05.006 INFO:tasks.ceph.osd.1:Stopped 2024-09-19T05:50:05.006 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-19T05:50:05.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:09.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-19T05:50:11.108 INFO:tasks.ceph.osd.2:Stopped 2024-09-19T05:50:11.109 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-19T05:50:11.109 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:11.183 INFO:tasks.ceph.osd.3:Stopped 2024-09-19T05:50:11.183 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-19T05:50:11.183 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:11.268 INFO:tasks.ceph.osd.4:Stopped 2024-09-19T05:50:11.268 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-19T05:50:11.269 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:11.360 INFO:tasks.ceph.osd.5:Stopped 2024-09-19T05:50:11.360 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-19T05:50:11.360 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:11.761 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:50:11.765 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:50:15.403 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-19T05:50:15.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-19T05:50:17.462 INFO:tasks.ceph.osd.6:Stopped 2024-09-19T05:50:17.463 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-19T05:50:17.463 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:17.534 INFO:tasks.ceph.osd.7:Stopped 2024-09-19T05:50:17.535 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-19T05:50:17.535 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-19T05:50:17.535 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:17.569 INFO:tasks.ceph.mgr.y:Stopped 2024-09-19T05:50:17.570 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-19T05:50:17.570 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:17.608 INFO:tasks.ceph.mgr.x:Stopped 2024-09-19T05:50:17.608 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-19T05:50:17.609 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T05:50:17.609 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:17.629 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T05:50:17.629 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T05:50:17.629 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:17.667 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T05:50:17.667 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T05:50:17.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:50:17.726 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T05:50:17.726 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-19T05:50:17.726 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-09-19T05:50:17.747 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:50:17.748 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-19T05:50:18.075 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:50:18.075 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-19T05:50:18.295 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:50:18.295 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-19T05:50:18.470 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:50:18.470 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-19T05:50:18.638 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:50:18.638 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-19T05:50:18.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:50:18.992 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-19T05:50:19.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:50:19.207 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-19T05:50:19.375 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:50:19.376 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-19T05:50:19.544 INFO:tasks.ceph:Archiving mon data... 2024-09-19T05:50:19.545 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672/data/mon.a.tgz 2024-09-19T05:50:19.545 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-09-19T05:50:19.552 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.9pC66qZr80 2024-09-19T05:50:19.552 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.9pC66qZr80 2024-09-19T05:50:19.713 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.9pC66qZr80 2024-09-19T05:50:19.773 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.9pC66qZr80 is 469KB 2024-09-19T05:50:19.834 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.9pC66qZr80 2024-09-19T05:50:19.840 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672/data/mon.b.tgz 2024-09-19T05:50:19.841 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-19T05:50:19.847 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.SlEeV6lJCM 2024-09-19T05:50:19.847 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SlEeV6lJCM 2024-09-19T05:50:19.993 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.SlEeV6lJCM 2024-09-19T05:50:20.057 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.SlEeV6lJCM is 471KB 2024-09-19T05:50:20.115 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.SlEeV6lJCM 2024-09-19T05:50:20.120 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672/data/mon.c.tgz 2024-09-19T05:50:20.121 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-19T05:50:20.169 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.M9tS9SrkuS 2024-09-19T05:50:20.169 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.M9tS9SrkuS 2024-09-19T05:50:20.322 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.M9tS9SrkuS 2024-09-19T05:50:20.386 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.M9tS9SrkuS is 471KB 2024-09-19T05:50:20.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-19T05:50:20.447 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.M9tS9SrkuS 2024-09-19T05:50:20.452 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-19T05:50:20.452 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T05:50:20.454 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T05:50:20.515 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T05:50:20.561 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T05:50:20.562 INFO:tasks.ceph:Archiving crash dumps... 2024-09-19T05:50:20.564 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672/remote/smithi067/crash 2024-09-19T05:50:20.565 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T05:50:20.582 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672/remote/smithi097/crash 2024-09-19T05:50:20.583 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T05:50:20.617 INFO:tasks.ceph:Shutting down logrotate 2024-09-19T05:50:20.617 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:50:20.625 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:50:20.702 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T05:50:20.715 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T05:50:20.757 INFO:tasks.ceph:Compressing logs... 2024-09-19T05:50:20.757 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:50:20.760 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:50:20.785 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50893.log 2024-09-19T05:50:20.786 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35584.log 2024-09-19T05:50:20.786 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59959.log 2024-09-19T05:50:20.786 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35584.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50893.log.gz 2024-09-19T05:50:20.787 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89569.log 2024-09-19T05:50:20.787 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35584.log.gz 2024-09-19T05:50:20.798 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.59959.log: /var/log/ceph/ceph-client.admin.51884.log 2024-09-19T05:50:20.798 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35144.log 2024-09-19T05:50:20.799 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59959.log.gz 2024-09-19T05:50:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72775.log 2024-09-19T05:50:20.799 INFO:teuthology.orchestra.run.smithi067.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.89569.log.gz 2024-09-19T05:50:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28834.log 2024-09-19T05:50:20.799 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35144.log.gz 2024-09-19T05:50:20.799 INFO:teuthology.orchestra.run.smithi067.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51884.log.gz 2024-09-19T05:50:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88236.log 2024-09-19T05:50:20.800 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72775.log: /var/log/ceph/ceph-client.admin.28834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87797.log 2024-09-19T05:50:20.800 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72775.log.gz 2024-09-19T05:50:20.800 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88302.log 2024-09-19T05:50:20.800 INFO:teuthology.orchestra.run.smithi067.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.28834.log.gz 2024-09-19T05:50:20.800 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87797.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88236.log.gz 2024-09-19T05:50:20.800 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75382.log 2024-09-19T05:50:20.800 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88659.log 2024-09-19T05:50:20.801 INFO:teuthology.orchestra.run.smithi067.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.87797.log.gz 2024-09-19T05:50:20.801 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75382.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.88302.log.gz 2024-09-19T05:50:20.801 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59618.log 2024-09-19T05:50:20.801 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75382.log.gz 2024-09-19T05:50:20.801 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81106.log 2024-09-19T05:50:20.801 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88659.log.gz 2024-09-19T05:50:20.801 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75974.log 2024-09-19T05:50:20.802 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.81106.log: -- /var/log/ceph/ceph-client.admin.72671.log 2024-09-19T05:50:20.802 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59618.log.gz 2024-09-19T05:50:20.802 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37206.log 2024-09-19T05:50:20.802 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81106.log.gz 2024-09-19T05:50:20.802 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72671.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75974.log.gz 2024-09-19T05:50:20.802 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78486.log 2024-09-19T05:50:20.802 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72671.log.gz 2024-09-19T05:50:20.803 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73170.log 2024-09-19T05:50:20.803 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78486.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37206.log.gz 2024-09-19T05:50:20.803 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78337.log 2024-09-19T05:50:20.803 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52643.log 2024-09-19T05:50:20.803 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78486.log.gz 2024-09-19T05:50:20.803 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73170.log: /var/log/ceph/ceph-client.admin.78337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57478.log 2024-09-19T05:50:20.803 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73170.log.gz 2024-09-19T05:50:20.803 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78337.log.gz 2024-09-19T05:50:20.804 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77599.log 2024-09-19T05:50:20.804 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56227.log 2024-09-19T05:50:20.804 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83751.log 2024-09-19T05:50:20.804 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77599.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52643.log.gz 2024-09-19T05:50:20.804 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57478.log.gz 2024-09-19T05:50:20.804 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56227.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77599.log.gz 2024-09-19T05:50:20.804 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34323.log 2024-09-19T05:50:20.805 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56227.log.gz 2024-09-19T05:50:20.805 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53855.log 2024-09-19T05:50:20.805 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83751.log.gz 2024-09-19T05:50:20.805 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73576.log 2024-09-19T05:50:20.805 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37056.log 2024-09-19T05:50:20.805 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34323.log.gz 2024-09-19T05:50:20.805 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.73576.log: /var/log/ceph/ceph-client.admin.35924.log 2024-09-19T05:50:20.805 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53855.log.gz 2024-09-19T05:50:20.806 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83725.log 2024-09-19T05:50:20.806 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37056.log.gz 2024-09-19T05:50:20.806 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35380.log 2024-09-19T05:50:20.861 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29023.log 2024-09-19T05:50:20.861 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-19T05:50:20.861 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29023.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-19T05:50:20.861 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.7.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29023.log.gz 2024-09-19T05:50:20.862 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29095.log 2024-09-19T05:50:20.862 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.35046.log 2024-09-19T05:50:20.862 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29095.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-19T05:50:20.862 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29095.log.gz 2024-09-19T05:50:20.862 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28975.log 2024-09-19T05:50:20.863 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.3.35046.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34927.log 2024-09-19T05:50:20.863 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29071.log 2024-09-19T05:50:20.863 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.1.34927.log: /var/log/ceph/ceph-client.admin.28975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29047.log 2024-09-19T05:50:20.863 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-19T05:50:20.864 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.3.35046.log.gz 2024-09-19T05:50:20.864 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29071.log: 89.0% -- replaced with /var/log/ceph/ceph-client.1.34927.log.gz 2024-09-19T05:50:20.864 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28975.log.gz 2024-09-19T05:50:20.864 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29071.log.gz 2024-09-19T05:50:20.865 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29047.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T05:50:20.865 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mgr.x.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29047.log.gz 2024-09-19T05:50:20.865 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29143.log 2024-09-19T05:50:20.865 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29119.log 2024-09-19T05:50:20.865 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29143.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-19T05:50:20.866 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29143.log.gz 2024-09-19T05:50:20.866 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29119.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T05:50:20.866 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-19T05:50:20.866 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29119.log.gz 2024-09-19T05:50:20.867 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-19T05:50:20.867 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.d.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T05:50:20.867 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-19T05:50:20.867 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.b.log: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T05:50:20.867 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-19T05:50:20.870 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28999.log 2024-09-19T05:50:20.901 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.28999.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28999.log.gz 2024-09-19T05:50:20.937 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83725.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35924.log.gz 2024-09-19T05:50:20.937 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75408.log 2024-09-19T05:50:20.937 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35380.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.83725.log.gz 2024-09-19T05:50:20.937 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57855.log 2024-09-19T05:50:20.938 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35380.log.gz 2024-09-19T05:50:20.938 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54343.log 2024-09-19T05:50:20.938 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75408.log.gz 2024-09-19T05:50:20.938 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56999.log 2024-09-19T05:50:20.938 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57855.log: 88.7%/var/log/ceph/ceph-client.0.54343.log: -- replaced with /var/log/ceph/ceph-client.admin.57855.log.gz 2024-09-19T05:50:20.938 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-19T05:50:20.938 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56359.log 2024-09-19T05:50:20.938 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56999.log: /var/log/ceph/ceph-mgr.y.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56999.log.gz 2024-09-19T05:50:20.939 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80978.log 2024-09-19T05:50:20.939 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77677.log 2024-09-19T05:50:20.939 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.56359.log: /var/log/ceph/ceph-client.admin.80978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51062.log 2024-09-19T05:50:20.939 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.77677.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51001.log 2024-09-19T05:50:20.939 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51062.log: 88.3% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.80978.log.gz 2024-09-19T05:50:20.939 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72853.log 2024-09-19T05:50:20.939 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77677.log.gz 2024-09-19T05:50:20.939 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51062.log.gz 2024-09-19T05:50:20.940 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75699.log 2024-09-19T05:50:20.940 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51001.log.gz 2024-09-19T05:50:20.940 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55049.log 2024-09-19T05:50:20.940 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75699.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.56359.log.gz 2024-09-19T05:50:20.940 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34694.log 2024-09-19T05:50:20.940 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72853.log.gz 2024-09-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi067.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75699.log.gz 2024-09-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58766.log 2024-09-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55049.log: /var/log/ceph/ceph-client.admin.34694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72964.log 2024-09-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55049.log.gz 2024-09-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34694.log.gz 2024-09-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53621.log 2024-09-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58766.log: /var/log/ceph/ceph-client.admin.72964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54785.log 2024-09-19T05:50:20.941 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58766.log.gz 2024-09-19T05:50:20.942 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72964.log.gz 2024-09-19T05:50:20.942 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58972.log 2024-09-19T05:50:20.942 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53621.log.gz 2024-09-19T05:50:20.942 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51634.log 2024-09-19T05:50:20.942 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54785.log: /var/log/ceph/ceph-client.admin.58972.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54785.log.gz 2024-09-19T05:50:20.942 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52390.log 2024-09-19T05:50:20.942 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51684.log 2024-09-19T05:50:20.942 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51634.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58972.log.gz 2024-09-19T05:50:20.942 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84329.log 2024-09-19T05:50:20.943 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.51684.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.79066.log 2024-09-19T05:50:20.943 INFO:teuthology.orchestra.run.smithi067.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51634.log.gz 2024-09-19T05:50:20.943 INFO:teuthology.orchestra.run.smithi067.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52390.log.gz 2024-09-19T05:50:20.943 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34290.log 2024-09-19T05:50:20.943 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84329.log.gz 2024-09-19T05:50:20.943 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.79066.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51684.log.gz 2024-09-19T05:50:20.943 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37363.log 2024-09-19T05:50:20.943 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79066.log.gz 2024-09-19T05:50:20.944 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90095.log 2024-09-19T05:50:20.944 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86971.log 2024-09-19T05:50:20.944 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34290.log.gz 2024-09-19T05:50:20.944 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90095.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37363.log.gz 2024-09-19T05:50:20.944 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56938.log 2024-09-19T05:50:20.944 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90095.log.gz 2024-09-19T05:50:20.944 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73142.log 2024-09-19T05:50:20.944 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56938.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86971.log.gz 2024-09-19T05:50:20.945 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84206.log 2024-09-19T05:50:20.945 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84180.log 2024-09-19T05:50:20.945 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.73142.log.gz 2024-09-19T05:50:20.945 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56938.log.gz 2024-09-19T05:50:20.945 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79040.log 2024-09-19T05:50:20.945 INFO:teuthology.orchestra.run.smithi067.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-19T05:50:20.945 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84206.log.gz 2024-09-19T05:50:20.945 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50919.log 2024-09-19T05:50:20.946 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.79040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75462.log 2024-09-19T05:50:20.946 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84180.log.gz 2024-09-19T05:50:20.946 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79040.log.gz 2024-09-19T05:50:20.946 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84258.log 2024-09-19T05:50:20.946 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50919.log.gz 2024-09-19T05:50:20.946 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86374.log 2024-09-19T05:50:20.946 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53124.log 2024-09-19T05:50:20.946 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75462.log.gz 2024-09-19T05:50:20.946 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.84258.log.gz 2024-09-19T05:50:20.947 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55478.log 2024-09-19T05:50:20.947 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86374.log.gz 2024-09-19T05:50:20.947 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76000.log 2024-09-19T05:50:20.947 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53124.log.gz 2024-09-19T05:50:20.947 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73114.log 2024-09-19T05:50:20.947 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55478.log: /var/log/ceph/ceph-client.admin.76000.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55478.log.gz 2024-09-19T05:50:20.947 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37417.log 2024-09-19T05:50:20.947 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76000.log.gz 2024-09-19T05:50:20.948 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36549.log 2024-09-19T05:50:20.948 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73114.log: /var/log/ceph/ceph-client.admin.37417.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-19T05:50:20.948 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73114.log.gz 2024-09-19T05:50:20.948 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37417.log.gz 2024-09-19T05:50:20.948 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80724.log 2024-09-19T05:50:20.948 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36549.log.gz 2024-09-19T05:50:20.948 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86777.log 2024-09-19T05:50:20.948 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88380.log 2024-09-19T05:50:20.949 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80724.log: /var/log/ceph/ceph-client.admin.86777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90687.log 2024-09-19T05:50:20.949 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.80724.log.gz 2024-09-19T05:50:20.949 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86777.log.gz 2024-09-19T05:50:20.949 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35794.log 2024-09-19T05:50:20.949 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90687.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88380.log.gz 2024-09-19T05:50:20.949 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84697.log 2024-09-19T05:50:20.949 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90687.log.gz 2024-09-19T05:50:20.949 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35196.log 2024-09-19T05:50:20.950 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75870.log 2024-09-19T05:50:20.950 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35794.log.gz 2024-09-19T05:50:20.950 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84697.log.gz 2024-09-19T05:50:20.950 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52745.log 2024-09-19T05:50:20.950 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75870.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35196.log.gz 2024-09-19T05:50:20.950 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73257.log 2024-09-19T05:50:20.950 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75870.log.gz 2024-09-19T05:50:20.950 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79092.log 2024-09-19T05:50:20.950 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51118.log 2024-09-19T05:50:20.951 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.79092.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73257.log.gz 2024-09-19T05:50:20.951 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59698.log 2024-09-19T05:50:20.951 INFO:teuthology.orchestra.run.smithi067.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52745.log.gz 2024-09-19T05:50:20.951 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83956.log 2024-09-19T05:50:20.951 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51118.log.gz 2024-09-19T05:50:20.951 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59698.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75762.log 2024-09-19T05:50:20.951 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79092.log.gz 2024-09-19T05:50:20.951 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83956.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59698.log.gz 2024-09-19T05:50:20.952 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56149.log 2024-09-19T05:50:20.952 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83956.log.gz 2024-09-19T05:50:20.952 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50657.log 2024-09-19T05:50:20.952 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89842.log 2024-09-19T05:50:20.952 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7%/var/log/ceph/ceph-client.admin.56149.log: -- replaced with /var/log/ceph/ceph-client.admin.75762.log.gz 2024-09-19T05:50:20.952 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50657.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56149.log.gz 2024-09-19T05:50:20.952 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87153.log 2024-09-19T05:50:20.952 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50657.log.gz 2024-09-19T05:50:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89998.log 2024-09-19T05:50:20.953 INFO:teuthology.orchestra.run.smithi067.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.54343.log.gz 2024-09-19T05:50:20.953 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89842.log.gz 2024-09-19T05:50:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.87153.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36391.log 2024-09-19T05:50:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36497.log 2024-09-19T05:50:20.953 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87153.log.gz 2024-09-19T05:50:20.953 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89998.log.gz 2024-09-19T05:50:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56019.log 2024-09-19T05:50:20.953 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36391.log.gz 2024-09-19T05:50:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57390.log 2024-09-19T05:50:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36497.log: /var/log/ceph/ceph-client.admin.56019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87641.log 2024-09-19T05:50:20.954 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36497.log.gz 2024-09-19T05:50:20.954 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56019.log.gz 2024-09-19T05:50:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77781.log 2024-09-19T05:50:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55850.log 2024-09-19T05:50:20.954 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57390.log.gz 2024-09-19T05:50:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87641.log: /var/log/ceph/ceph-client.admin.77781.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87641.log.gz 2024-09-19T05:50:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55452.log 2024-09-19T05:50:20.955 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77781.log.gz 2024-09-19T05:50:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88922.log 2024-09-19T05:50:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55850.log: /var/log/ceph/ceph-client.admin.55452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50973.log 2024-09-19T05:50:20.955 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55850.log.gz 2024-09-19T05:50:20.955 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55452.log.gz 2024-09-19T05:50:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78011.log 2024-09-19T05:50:20.955 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88922.log.gz 2024-09-19T05:50:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89173.log 2024-09-19T05:50:20.956 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50973.log: /var/log/ceph/ceph-client.admin.78011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72931.log 2024-09-19T05:50:20.956 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50973.log.gz 2024-09-19T05:50:20.956 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55400.log 2024-09-19T05:50:20.956 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78011.log.gz 2024-09-19T05:50:20.956 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89173.log.gz 2024-09-19T05:50:20.956 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73392.log 2024-09-19T05:50:20.956 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72931.log.gz 2024-09-19T05:50:20.956 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59829.log 2024-09-19T05:50:20.957 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55400.log: /var/log/ceph/ceph-client.admin.73392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52364.log 2024-09-19T05:50:20.957 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55400.log.gz 2024-09-19T05:50:20.957 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59829.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73392.log.gz 2024-09-19T05:50:20.957 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57627.log 2024-09-19T05:50:20.957 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59829.log.gz 2024-09-19T05:50:20.957 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59907.log 2024-09-19T05:50:20.957 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52364.log: /var/log/ceph/ceph-client.admin.57627.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52364.log.gz 2024-09-19T05:50:20.957 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84999.log 2024-09-19T05:50:20.957 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57627.log.gz 2024-09-19T05:50:20.958 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37445.log 2024-09-19T05:50:20.958 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59907.log: /var/log/ceph/ceph-client.admin.84999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88033.log 2024-09-19T05:50:20.958 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59907.log.gz 2024-09-19T05:50:20.958 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84999.log.gz 2024-09-19T05:50:20.958 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82341.log 2024-09-19T05:50:20.958 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37445.log.gz 2024-09-19T05:50:20.958 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36188.log 2024-09-19T05:50:20.958 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88033.log: /var/log/ceph/ceph-client.admin.82341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89331.log 2024-09-19T05:50:20.959 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36188.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82341.log.gz 2024-09-19T05:50:20.959 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53595.log 2024-09-19T05:50:20.959 INFO:teuthology.orchestra.run.smithi067.stderr: 91.2% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36188.log.gz -- replaced with /var/log/ceph/ceph-client.admin.88033.log.gz 2024-09-19T05:50:20.959 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-19T05:50:20.959 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78858.log 2024-09-19T05:50:20.959 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89331.log: /var/log/ceph/ceph-client.admin.53595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54574.log 2024-09-19T05:50:20.959 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89331.log.gz 2024-09-19T05:50:20.959 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78858.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53595.log.gz 2024-09-19T05:50:20.960 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77959.log 2024-09-19T05:50:20.960 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54574.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78858.log.gz 2024-09-19T05:50:20.960 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72248.log 2024-09-19T05:50:20.960 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58139.log 2024-09-19T05:50:20.960 INFO:teuthology.orchestra.run.smithi067.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54574.log.gz 2024-09-19T05:50:20.960 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77959.log.gz 2024-09-19T05:50:20.960 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59225.log 2024-09-19T05:50:20.960 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75434.log 2024-09-19T05:50:20.961 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59933.log 2024-09-19T05:50:20.961 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58139.log.gz 2024-09-19T05:50:20.961 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59225.log.gz 2024-09-19T05:50:20.961 INFO:teuthology.orchestra.run.smithi067.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.72248.log.gz 2024-09-19T05:50:20.961 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75670.log 2024-09-19T05:50:20.961 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59933.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75434.log.gz 2024-09-19T05:50:20.961 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81328.log 2024-09-19T05:50:20.961 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59933.log.gz 2024-09-19T05:50:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57959.log 2024-09-19T05:50:20.962 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75670.log.gz 2024-09-19T05:50:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35366.log 2024-09-19T05:50:20.962 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81328.log.gz 2024-09-19T05:50:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50683.log 2024-09-19T05:50:20.962 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57959.log.gz 2024-09-19T05:50:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52039.log 2024-09-19T05:50:20.962 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35366.log.gz 2024-09-19T05:50:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84008.log 2024-09-19T05:50:20.963 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50683.log.gz 2024-09-19T05:50:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54634.log 2024-09-19T05:50:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76080.log 2024-09-19T05:50:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84008.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52039.log.gz 2024-09-19T05:50:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54516.log 2024-09-19T05:50:20.963 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84008.log.gz 2024-09-19T05:50:20.963 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.76080.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54634.log.gz 2024-09-19T05:50:20.964 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90069.log 2024-09-19T05:50:20.964 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6%/var/log/ceph/ceph-client.admin.54516.log: -- replaced with /var/log/ceph/ceph-client.admin.76080.log.gz 2024-09-19T05:50:20.964 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35248.log 2024-09-19T05:50:20.964 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54516.log.gz 2024-09-19T05:50:20.964 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87075.log 2024-09-19T05:50:20.964 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90069.log.gz 2024-09-19T05:50:20.964 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87745.log 2024-09-19T05:50:20.964 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35248.log.gz 2024-09-19T05:50:20.965 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88711.log 2024-09-19T05:50:20.965 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87075.log.gz 2024-09-19T05:50:20.965 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57059.log 2024-09-19T05:50:20.965 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87745.log.gz 2024-09-19T05:50:20.965 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90583.log 2024-09-19T05:50:20.965 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88711.log.gz 2024-09-19T05:50:20.965 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84812.log 2024-09-19T05:50:20.965 INFO:teuthology.orchestra.run.smithi067.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57059.log.gz 2024-09-19T05:50:20.965 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84894.log 2024-09-19T05:50:20.966 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90583.log.gz 2024-09-19T05:50:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34642.log 2024-09-19T05:50:20.966 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84812.log.gz 2024-09-19T05:50:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59672.log 2024-09-19T05:50:20.966 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84894.log.gz 2024-09-19T05:50:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89463.log 2024-09-19T05:50:20.966 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34642.log.gz 2024-09-19T05:50:20.966 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50827.log 2024-09-19T05:50:20.967 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59672.log.gz 2024-09-19T05:50:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.89463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88581.log 2024-09-19T05:50:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37082.log 2024-09-19T05:50:20.967 INFO:teuthology.orchestra.run.smithi067.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50827.log.gz 2024-09-19T05:50:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34590.log 2024-09-19T05:50:20.967 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88581.log: /var/log/ceph/ceph-client.admin.37082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56201.log 2024-09-19T05:50:20.967 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88581.log.gz 2024-09-19T05:50:20.967 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37082.log.gz 2024-09-19T05:50:20.968 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87719.log 2024-09-19T05:50:20.968 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34590.log.gz 2024-09-19T05:50:20.968 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51354.log 2024-09-19T05:50:20.968 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58878.log 2024-09-19T05:50:20.968 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56201.log.gz 2024-09-19T05:50:20.968 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87719.log: /var/log/ceph/ceph-client.admin.51354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81799.log 2024-09-19T05:50:20.968 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.87719.log.gz 2024-09-19T05:50:20.968 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51354.log.gz 2024-09-19T05:50:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53973.log 2024-09-19T05:50:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.81799.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52440.log 2024-09-19T05:50:20.969 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58878.log.gz 2024-09-19T05:50:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89277.log 2024-09-19T05:50:20.969 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81799.log.gz 2024-09-19T05:50:20.969 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53973.log.gz 2024-09-19T05:50:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90024.log 2024-09-19T05:50:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88268.log 2024-09-19T05:50:20.969 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89277.log.gz 2024-09-19T05:50:20.970 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90024.log: 94.2% -- replaced with /var/log/ceph/ceph-client.0.89463.log.gz 2024-09-19T05:50:20.970 INFO:teuthology.orchestra.run.smithi067.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52440.log.gz 2024-09-19T05:50:20.970 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59277.log 2024-09-19T05:50:20.970 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90024.log.gz 2024-09-19T05:50:20.970 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54628.log 2024-09-19T05:50:20.970 INFO:teuthology.orchestra.run.smithi067.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.88268.log.gz 2024-09-19T05:50:20.970 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80518.log 2024-09-19T05:50:20.970 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59277.log.gz 2024-09-19T05:50:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56640.log 2024-09-19T05:50:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80518.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54628.log.gz 2024-09-19T05:50:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-19T05:50:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50482.log 2024-09-19T05:50:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56640.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.80518.log.gz 2024-09-19T05:50:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75844.log 2024-09-19T05:50:20.971 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56640.log.gz 2024-09-19T05:50:20.971 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58405.log 2024-09-19T05:50:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75844.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50482.log.gz 2024-09-19T05:50:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34532.log 2024-09-19T05:50:20.972 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75844.log.gz 2024-09-19T05:50:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87127.log 2024-09-19T05:50:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90425.log 2024-09-19T05:50:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34532.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58405.log.gz 2024-09-19T05:50:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87127.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34532.log.gz 2024-09-19T05:50:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36011.log 2024-09-19T05:50:20.973 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87127.log.gz 2024-09-19T05:50:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55584.log 2024-09-19T05:50:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77729.log 2024-09-19T05:50:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36011.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.90425.log.gz 2024-09-19T05:50:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34441.log 2024-09-19T05:50:20.973 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36011.log.gz 2024-09-19T05:50:20.973 INFO:teuthology.orchestra.run.smithi067.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55584.log.gz 2024-09-19T05:50:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54133.log 2024-09-19T05:50:20.974 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77729.log: /var/log/ceph/ceph-client.admin.34441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86750.log 2024-09-19T05:50:20.974 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77729.log.gz 2024-09-19T05:50:20.974 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34441.log.gz 2024-09-19T05:50:20.974 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81773.log 2024-09-19T05:50:20.974 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54133.log.gz 2024-09-19T05:50:20.974 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37694.log 2024-09-19T05:50:20.974 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80928.log 2024-09-19T05:50:20.974 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81773.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86750.log.gz 2024-09-19T05:50:20.975 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89644.log 2024-09-19T05:50:20.975 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81773.log.gz 2024-09-19T05:50:20.975 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80928.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37694.log.gz 2024-09-19T05:50:20.975 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36985.log 2024-09-19T05:50:20.975 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34746.log 2024-09-19T05:50:20.975 INFO:teuthology.orchestra.run.smithi067.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.80928.log.gz 2024-09-19T05:50:20.975 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54055.log 2024-09-19T05:50:20.975 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54399.log 2024-09-19T05:50:20.975 INFO:teuthology.orchestra.run.smithi067.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.89644.log.gz 2024-09-19T05:50:20.976 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36985.log.gz 2024-09-19T05:50:20.976 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34746.log.gz 2024-09-19T05:50:20.976 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55080.log 2024-09-19T05:50:20.976 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54055.log.gz 2024-09-19T05:50:20.976 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35587.log 2024-09-19T05:50:20.976 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55080.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54399.log.gz 2024-09-19T05:50:20.976 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89305.log 2024-09-19T05:50:20.976 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55080.log.gz 2024-09-19T05:50:20.977 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84485.log 2024-09-19T05:50:20.977 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50059.log 2024-09-19T05:50:20.977 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5%/var/log/ceph/ceph-client.admin.89305.log: -- replaced with /var/log/ceph/ceph-client.admin.35587.log.gz 2024-09-19T05:50:20.977 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81484.log 2024-09-19T05:50:20.977 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89305.log.gz 2024-09-19T05:50:20.977 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84485.log.gz 2024-09-19T05:50:20.977 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57656.log 2024-09-19T05:50:20.977 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50534.log 2024-09-19T05:50:20.978 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81484.log.gz 2024-09-19T05:50:20.978 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89357.log 2024-09-19T05:50:20.978 INFO:teuthology.orchestra.run.smithi067.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50059.log.gz 2024-09-19T05:50:20.978 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57656.log.gz 2024-09-19T05:50:20.978 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55644.log 2024-09-19T05:50:20.978 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37180.log 2024-09-19T05:50:20.978 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89357.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50534.log.gz 2024-09-19T05:50:20.978 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34497.log 2024-09-19T05:50:20.979 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55644.log.gz 2024-09-19T05:50:20.979 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37590.log 2024-09-19T05:50:20.979 INFO:teuthology.orchestra.run.smithi067.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.89357.log.gz 2024-09-19T05:50:20.979 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37180.log: /var/log/ceph/ceph-client.admin.34497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72827.log 2024-09-19T05:50:20.979 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37180.log.gz 2024-09-19T05:50:20.979 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37590.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.78089.log -- replaced with /var/log/ceph/ceph-client.admin.34497.log.gz 2024-09-19T05:50:20.979 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-19T05:50:20.979 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37590.log.gz 2024-09-19T05:50:20.979 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90121.log 2024-09-19T05:50:20.980 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83885.log 2024-09-19T05:50:20.980 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78089.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72827.log.gz 2024-09-19T05:50:20.980 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55558.log 2024-09-19T05:50:20.980 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78089.log.gz 2024-09-19T05:50:20.980 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90121.log.gz 2024-09-19T05:50:20.980 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83885.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-19T05:50:20.980 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55558.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83885.log.gz 2024-09-19T05:50:20.980 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88607.log 2024-09-19T05:50:20.981 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55558.log.gz 2024-09-19T05:50:20.981 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56542.log 2024-09-19T05:50:20.981 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75356.log 2024-09-19T05:50:20.981 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56542.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80750.log 2024-09-19T05:50:20.981 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.88607.log.gz 2024-09-19T05:50:20.981 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75356.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.56542.log.gz -5 2024-09-19T05:50:20.981 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58920.log 2024-09-19T05:50:20.981 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72593.log 2024-09-19T05:50:20.981 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75356.log.gz 2024-09-19T05:50:20.982 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58920.log: /var/log/ceph/ceph-client.admin.80750.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58920.log.gz 2024-09-19T05:50:20.982 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80750.log.gz 2024-09-19T05:50:20.982 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36959.log 2024-09-19T05:50:20.982 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50404.log 2024-09-19T05:50:20.982 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50456.log 2024-09-19T05:50:20.982 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72593.log.gz 2024-09-19T05:50:20.982 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59803.log 2024-09-19T05:50:20.982 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36959.log.gz 2024-09-19T05:50:20.983 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50404.log.gz 2024-09-19T05:50:20.983 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50456.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50456.log.gz 2024-09-19T05:50:20.983 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75521.log 2024-09-19T05:50:20.983 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54107.log 2024-09-19T05:50:20.983 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75521.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59803.log.gz 2024-09-19T05:50:20.983 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84868.log 2024-09-19T05:50:20.983 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58195.log 2024-09-19T05:50:20.983 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75521.log.gz 2024-09-19T05:50:20.984 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54107.log.gz 2024-09-19T05:50:20.984 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84868.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.84868.log.gz 2024-09-19T05:50:20.984 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53764.log 2024-09-19T05:50:20.984 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.58195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35036.log 2024-09-19T05:50:20.984 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51170.log 2024-09-19T05:50:20.984 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35588.log 2024-09-19T05:50:20.984 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53764.log.gz 2024-09-19T05:50:20.984 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51170.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35036.log.gz 2024-09-19T05:50:20.985 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51170.log.gz 2024-09-19T05:50:20.988 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52899.log 2024-09-19T05:50:20.988 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56717.log 2024-09-19T05:50:20.989 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52899.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35588.log.gz 2024-09-19T05:50:20.989 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35580.log 2024-09-19T05:50:20.989 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72450.log 2024-09-19T05:50:20.989 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4%/var/log/ceph/ceph-client.admin.56717.log: -- replaced with /var/log/ceph/ceph-client.admin.52899.log.gz 2024-09-19T05:50:20.989 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35580.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56717.log.gz 2024-09-19T05:50:20.989 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35580.log.gz 2024-09-19T05:50:20.989 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72996.log 2024-09-19T05:50:20.989 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51784.log 2024-09-19T05:50:20.990 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79198.log 2024-09-19T05:50:20.990 INFO:teuthology.orchestra.run.smithi067.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72450.log.gz 89.5% -- replaced with /var/log/ceph/ceph-client.admin.72996.log.gz 2024-09-19T05:50:20.990 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-19T05:50:20.990 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51784.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51784.log.gz 2024-09-19T05:50:20.990 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90399.log 2024-09-19T05:50:20.990 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.79198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34232.log 2024-09-19T05:50:20.990 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84946.log 2024-09-19T05:50:20.990 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6%/var/log/ceph/ceph-client.admin.34232.log: -- replaced with /var/log/ceph/ceph-client.admin.90399.log.gz 2024-09-19T05:50:20.990 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34232.log.gz 2024-09-19T05:50:20.991 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55225.log 2024-09-19T05:50:20.991 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59050.log 2024-09-19T05:50:20.991 INFO:teuthology.orchestra.run.smithi067.stderr: 87.0%/var/log/ceph/ceph-client.admin.55225.log: -- replaced with /var/log/ceph/ceph-client.admin.84946.log.gz 2024-09-19T05:50:20.991 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55225.log.gz 2024-09-19T05:50:20.991 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56881.log 2024-09-19T05:50:20.991 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53074.log 2024-09-19T05:50:20.991 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59050.log: /var/log/ceph/ceph-client.0.56881.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59050.log.gz 2024-09-19T05:50:20.992 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51380.log 2024-09-19T05:50:20.992 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53074.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.53074.log.gz 2024-09-19T05:50:20.992 INFO:teuthology.orchestra.run.smithi067.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51934.log 2024-09-19T05:50:20.992 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.0.56881.log.gz 2024-09-19T05:50:20.992 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51380.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51380.log.gz 2024-09-19T05:50:20.992 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78155.log 2024-09-19T05:50:20.992 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52164.log 2024-09-19T05:50:20.992 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51934.log: /var/log/ceph/ceph-client.admin.78155.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78155.log.gz 2024-09-19T05:50:20.992 INFO:teuthology.orchestra.run.smithi067.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.58195.log.gz 2024-09-19T05:50:20.993 INFO:teuthology.orchestra.run.smithi067.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51934.log.gz 2024-09-19T05:50:20.993 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89199.log 2024-09-19T05:50:20.993 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56303.log 2024-09-19T05:50:20.993 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72905.log 2024-09-19T05:50:20.993 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89199.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52164.log.gz 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89199.log.gz 2024-09-19T05:50:20.993 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56303.log: 2024-09-19T05:50:20.993 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56303.log.gz 2024-09-19T05:50:20.993 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58638.log 2024-09-19T05:50:20.994 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37232.log 2024-09-19T05:50:20.994 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8%/var/log/ceph/ceph-client.admin.58638.log: -- replaced with /var/log/ceph/ceph-client.admin.72905.log.gz 2024-09-19T05:50:20.994 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81432.log 2024-09-19T05:50:20.994 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37232.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37232.log.gz 2024-09-19T05:50:20.994 INFO:teuthology.orchestra.run.smithi067.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.58638.log.gz 2024-09-19T05:50:20.994 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73366.log 2024-09-19T05:50:20.994 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35361.log 2024-09-19T05:50:20.994 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1%/var/log/ceph/ceph-client.admin.73366.log: -- replaced with /var/log/ceph/ceph-client.admin.81432.log.gz 2024-09-19T05:50:20.994 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81891.log 2024-09-19T05:50:20.995 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73366.log.gz 2024-09-19T05:50:20.995 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35361.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35361.log.gz 2024-09-19T05:50:20.995 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87481.log 2024-09-19T05:50:20.995 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35118.log 2024-09-19T05:50:20.995 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5%/var/log/ceph/ceph-client.admin.87481.log: -- replaced with /var/log/ceph/ceph-client.admin.81891.log.gz 2024-09-19T05:50:20.995 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89407.log 2024-09-19T05:50:20.995 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87481.log.gz 2024-09-19T05:50:20.995 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35118.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35118.log.gz 2024-09-19T05:50:20.995 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37798.log 2024-09-19T05:50:20.996 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72619.log 2024-09-19T05:50:20.996 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37798.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89407.log.gz 2024-09-19T05:50:20.996 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77499.log 2024-09-19T05:50:20.996 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81190.log 2024-09-19T05:50:20.996 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37798.log.gz 2024-09-19T05:50:20.996 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72619.log: /var/log/ceph/ceph-client.admin.77499.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72619.log.gz 2024-09-19T05:50:20.996 INFO:teuthology.orchestra.run.smithi067.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58406.log 2024-09-19T05:50:20.996 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77499.log.gz 2024-09-19T05:50:20.997 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55251.log 2024-09-19T05:50:20.997 INFO:teuthology.orchestra.run.smithi067.stderr:gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81190.log.gz -5 2024-09-19T05:50:20.997 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.87667.log 2024-09-19T05:50:20.997 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58406.log: /var/log/ceph/ceph-client.admin.55251.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58406.log.gz 2024-09-19T05:50:20.997 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55251.log.gz 2024-09-19T05:50:20.997 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55121.log 2024-09-19T05:50:20.997 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84642.log 2024-09-19T05:50:20.997 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5%/var/log/ceph/ceph-client.admin.55121.log: -- replaced with /var/log/ceph/ceph-client.admin.87667.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80776.log 2024-09-19T05:50:20.998 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-19T05:50:20.998 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55121.log.gz 2024-09-19T05:50:20.998 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84642.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84642.log.gz 2024-09-19T05:50:20.998 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81276.log 2024-09-19T05:50:20.998 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86997.log 2024-09-19T05:50:20.998 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54451.log 2024-09-19T05:50:20.998 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1%/var/log/ceph/ceph-client.admin.86997.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.80776.log.gz 2024-09-19T05:50:20.998 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81276.log.gz 2024-09-19T05:50:20.999 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86997.log.gz 2024-09-19T05:50:20.999 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51986.log 2024-09-19T05:50:20.999 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86487.log 2024-09-19T05:50:20.999 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51986.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58345.log 2024-09-19T05:50:20.999 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54451.log.gz 2024-09-19T05:50:20.999 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86487.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51986.log.gz 2024-09-19T05:50:20.999 INFO:teuthology.orchestra.run.smithi067.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.86487.log.gz 2024-09-19T05:50:20.999 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37824.log 2024-09-19T05:50:21.000 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80468.log 2024-09-19T05:50:21.000 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57907.log 2024-09-19T05:50:21.000 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37824.log: 91.2% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37824.log.gz 2024-09-19T05:50:21.000 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58345.log.gz 2024-09-19T05:50:21.000 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80468.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.80468.log.gz 2024-09-19T05:50:21.000 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84725.log 2024-09-19T05:50:21.000 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53647.log 2024-09-19T05:50:21.000 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84725.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84760.log 2024-09-19T05:50:21.000 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57907.log.gz 2024-09-19T05:50:21.001 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.84725.log.gz/var/log/ceph/ceph-client.admin.53647.log: 2024-09-19T05:50:21.001 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57684.log 2024-09-19T05:50:21.001 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84760.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53647.log.gz 2024-09-19T05:50:21.001 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84760.log.gz 2024-09-19T05:50:21.001 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84154.log 2024-09-19T05:50:21.001 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58404.log 2024-09-19T05:50:21.001 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57684.log: /var/log/ceph/ceph-client.admin.84154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54159.log 2024-09-19T05:50:21.002 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57684.log.gz 2024-09-19T05:50:21.002 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84154.log.gz 2024-09-19T05:50:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58404.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58404.log.gz 2024-09-19T05:50:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74885.log 2024-09-19T05:50:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76106.log 2024-09-19T05:50:21.002 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9%/var/log/ceph/ceph-client.admin.74885.log: -- replaced with /var/log/ceph/ceph-client.admin.54159.log.gzgzip 2024-09-19T05:50:21.002 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58688.log 2024-09-19T05:50:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.76106.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.74885.log.gz 2024-09-19T05:50:21.003 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76106.log.gz 2024-09-19T05:50:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82315.log 2024-09-19T05:50:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51248.log 2024-09-19T05:50:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.82315.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58688.log.gz 2024-09-19T05:50:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55885.log 2024-09-19T05:50:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59251.log 2024-09-19T05:50:21.003 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.82315.log.gz 2024-09-19T05:50:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51248.log: /var/log/ceph/ceph-client.admin.55885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51248.log.gz 2024-09-19T05:50:21.004 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55885.log.gz 2024-09-19T05:50:21.004 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58063.log 2024-09-19T05:50:21.004 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78988.log 2024-09-19T05:50:21.004 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9%/var/log/ceph/ceph-client.admin.58063.log: -- replaced with /var/log/ceph/ceph-client.admin.59251.log.gz 2024-09-19T05:50:21.004 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80826.log 2024-09-19T05:50:21.004 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58063.log.gz 2024-09-19T05:50:21.004 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78988.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78988.log.gz 2024-09-19T05:50:21.004 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37720.log 2024-09-19T05:50:21.004 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58582.log 2024-09-19T05:50:21.005 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90451.log 2024-09-19T05:50:21.005 INFO:teuthology.orchestra.run.smithi067.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.80826.log.gz/var/log/ceph/ceph-client.admin.58582.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37720.log.gz 2024-09-19T05:50:21.005 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-19T05:50:21.005 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58582.log.gz 2024-09-19T05:50:21.005 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53342.log 2024-09-19T05:50:21.005 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75330.log 2024-09-19T05:50:21.005 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2%/var/log/ceph/ceph-client.admin.53342.log: -- replaced with /var/log/ceph/ceph-client.admin.90451.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53999.log 2024-09-19T05:50:21.005 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-19T05:50:21.006 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53342.log.gz 2024-09-19T05:50:21.006 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75330.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75330.log.gz 2024-09-19T05:50:21.006 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86881.log 2024-09-19T05:50:21.006 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54841.log 2024-09-19T05:50:21.006 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86881.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50508.log 2024-09-19T05:50:21.006 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53999.log.gz 2024-09-19T05:50:21.006 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86881.log.gz 2024-09-19T05:50:21.006 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54841.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54841.log.gz 2024-09-19T05:50:21.006 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76028.log 2024-09-19T05:50:21.007 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78538.log 2024-09-19T05:50:21.007 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5%/var/log/ceph/ceph-client.admin.76028.log: -- replaced with /var/log/ceph/ceph-client.admin.50508.log.gz 2024-09-19T05:50:21.007 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58714.log 2024-09-19T05:50:21.007 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76028.log.gz 2024-09-19T05:50:21.007 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78538.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78538.log.gz 2024-09-19T05:50:21.007 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88186.log 2024-09-19T05:50:21.007 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86348.log 2024-09-19T05:50:21.007 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58714.log.gz 2024-09-19T05:50:21.007 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35274.log 2024-09-19T05:50:21.008 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86348.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86348.log.gz 2024-09-19T05:50:21.008 INFO:teuthology.orchestra.run.smithi067.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.88186.log.gz 2024-09-19T05:50:21.008 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37480.log 2024-09-19T05:50:21.008 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90740.log 2024-09-19T05:50:21.008 INFO:teuthology.orchestra.run.smithi067.stderr: 89.5%/var/log/ceph/ceph-client.admin.37480.log: -- replaced with /var/log/ceph/ceph-client.admin.35274.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88458.log 2024-09-19T05:50:21.008 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-19T05:50:21.008 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37480.log.gz 2024-09-19T05:50:21.008 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90740.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.90740.log.gz 2024-09-19T05:50:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60087.log 2024-09-19T05:50:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55199.log 2024-09-19T05:50:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.60087.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88458.log.gz 2024-09-19T05:50:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86586.log 2024-09-19T05:50:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35820.log 2024-09-19T05:50:21.009 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60087.log.gz 2024-09-19T05:50:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55199.log: /var/log/ceph/ceph-client.admin.86586.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55199.log.gz 2024-09-19T05:50:21.009 INFO:teuthology.orchestra.run.smithi067.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.86586.log.gz 2024-09-19T05:50:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89868.log 2024-09-19T05:50:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78233.log 2024-09-19T05:50:21.010 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3%/var/log/ceph/ceph-client.admin.89868.log: -- replaced with /var/log/ceph/ceph-client.admin.35820.log.gz 2024-09-19T05:50:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78884.log 2024-09-19T05:50:21.010 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89868.log.gz 2024-09-19T05:50:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78233.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78233.log.gz 2024-09-19T05:50:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36721.log 2024-09-19T05:50:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78884.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-19T05:50:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36721.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85025.log 2024-09-19T05:50:21.011 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78884.log.gz 2024-09-19T05:50:21.011 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.3.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36721.log.gz 2024-09-19T05:50:21.011 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77549.log 2024-09-19T05:50:21.011 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.85025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85075.log 2024-09-19T05:50:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77549.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.85025.log.gz 2024-09-19T05:50:21.036 INFO:teuthology.orchestra.run.smithi067.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.77549.log.gz 2024-09-19T05:50:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83623.log 2024-09-19T05:50:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84518.log 2024-09-19T05:50:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.85075.log: /var/log/ceph/ceph-client.admin.83623.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85075.log.gz 2024-09-19T05:50:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78121.log 2024-09-19T05:50:21.037 INFO:teuthology.orchestra.run.smithi067.stderr: 91.1%/var/log/ceph/ceph-client.admin.84518.log: -- replaced with /var/log/ceph/ceph-client.admin.83623.log.gz 2024-09-19T05:50:21.037 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84518.log.gz 2024-09-19T05:50:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57085.log 2024-09-19T05:50:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88083.log 2024-09-19T05:50:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78121.log: /var/log/ceph/ceph-client.admin.57085.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78121.log.gz 2024-09-19T05:50:21.038 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88633.log 2024-09-19T05:50:21.038 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57085.log.gz 2024-09-19T05:50:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88083.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.88083.log.gz 2024-09-19T05:50:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35377.log 2024-09-19T05:50:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89095.log 2024-09-19T05:50:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88633.log: /var/log/ceph/ceph-client.admin.35377.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88633.log.gz 2024-09-19T05:50:21.038 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35377.log.gz 2024-09-19T05:50:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73340.log 2024-09-19T05:50:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82103.log 2024-09-19T05:50:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89095.log: /var/log/ceph/ceph-client.admin.73340.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89095.log.gz 2024-09-19T05:50:21.039 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73340.log.gz 2024-09-19T05:50:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50159.log 2024-09-19T05:50:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78460.log 2024-09-19T05:50:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.82103.log: /var/log/ceph/ceph-client.admin.50159.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.82103.log.gz 2024-09-19T05:50:21.039 INFO:teuthology.orchestra.run.smithi067.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50159.log.gz 2024-09-19T05:50:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78311.log 2024-09-19T05:50:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75181.log 2024-09-19T05:50:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78460.log: /var/log/ceph/ceph-client.admin.78311.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78460.log.gz 2024-09-19T05:50:21.040 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78311.log.gz 2024-09-19T05:50:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81917.log 2024-09-19T05:50:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52693.log 2024-09-19T05:50:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75181.log: /var/log/ceph/ceph-client.admin.81917.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75181.log.gz 2024-09-19T05:50:21.041 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81917.log.gz 2024-09-19T05:50:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75043.log 2024-09-19T05:50:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52693.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52693.log.gz 2024-09-19T05:50:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81458.log 2024-09-19T05:50:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84972.log 2024-09-19T05:50:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75043.log: /var/log/ceph/ceph-client.admin.81458.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75043.log.gz 2024-09-19T05:50:21.041 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81458.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55374.log 2024-09-19T05:50:21.041 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-19T05:50:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84972.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84972.log.gz 2024-09-19T05:50:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88007.log 2024-09-19T05:50:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51274.log 2024-09-19T05:50:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55374.log: /var/log/ceph/ceph-client.admin.88007.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55374.log.gz 2024-09-19T05:50:21.042 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.88007.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53829.log 2024-09-19T05:50:21.042 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-19T05:50:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51274.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51274.log.gz 2024-09-19T05:50:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72801.log 2024-09-19T05:50:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59751.log 2024-09-19T05:50:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53829.log: /var/log/ceph/ceph-client.admin.72801.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53829.log.gz 2024-09-19T05:50:21.043 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72801.log.gz 2024-09-19T05:50:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51196.log 2024-09-19T05:50:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72507.log 2024-09-19T05:50:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59751.log: /var/log/ceph/ceph-client.admin.51196.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59751.log.gz 2024-09-19T05:50:21.043 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51196.log.gz 2024-09-19T05:50:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53394.log 2024-09-19T05:50:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58946.log 2024-09-19T05:50:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72507.log: /var/log/ceph/ceph-client.admin.53394.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72507.log.gz 2024-09-19T05:50:21.044 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53394.log.gz 2024-09-19T05:50:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51144.log 2024-09-19T05:50:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58946.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58946.log.gz 2024-09-19T05:50:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55610.log 2024-09-19T05:50:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52924.log 2024-09-19T05:50:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51144.log: /var/log/ceph/ceph-client.admin.55610.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51144.log.gz 2024-09-19T05:50:21.044 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55610.log.gz 2024-09-19T05:50:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59985.log 2024-09-19T05:50:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52924.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52924.log.gz 2024-09-19T05:50:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83982.log 2024-09-19T05:50:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54917.log 2024-09-19T05:50:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59985.log: /var/log/ceph/ceph-client.admin.83982.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59985.log.gz 2024-09-19T05:50:21.045 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.83982.log.gz 2024-09-19T05:50:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76238.log 2024-09-19T05:50:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53368.log 2024-09-19T05:50:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54917.log: /var/log/ceph/ceph-client.0.76238.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54917.log.gz 2024-09-19T05:50:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54425.log 2024-09-19T05:50:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53368.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.53368.log.gz 2024-09-19T05:50:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53517.log 2024-09-19T05:50:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54425.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54425.log.gz 2024-09-19T05:50:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78698.log 2024-09-19T05:50:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53517.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53517.log.gz 2024-09-19T05:50:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84459.log 2024-09-19T05:50:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78698.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78698.log.gz 2024-09-19T05:50:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90295.log 2024-09-19T05:50:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84459.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84459.log.gz 2024-09-19T05:50:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54543.log 2024-09-19T05:50:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90295.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.90295.log.gz 2024-09-19T05:50:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81747.log 2024-09-19T05:50:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54543.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54543.log.gz 2024-09-19T05:50:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59881.log 2024-09-19T05:50:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81747.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81747.log.gz 2024-09-19T05:50:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75618.log 2024-09-19T05:50:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59881.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59881.log.gz 2024-09-19T05:50:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57829.log 2024-09-19T05:50:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75618.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75618.log.gz 2024-09-19T05:50:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34822.log 2024-09-19T05:50:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57829.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57829.log.gz 2024-09-19T05:50:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75155.log 2024-09-19T05:50:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34822.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34822.log.gz 2024-09-19T05:50:21.049 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52543.log 2024-09-19T05:50:21.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75155.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75155.log.gz 2024-09-19T05:50:21.049 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35585.log 2024-09-19T05:50:21.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52543.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52543.log.gz 2024-09-19T05:50:21.049 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56253.log 2024-09-19T05:50:21.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35585.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35585.log.gz 2024-09-19T05:50:21.049 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79014.log 2024-09-19T05:50:21.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56253.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56253.log.gz 2024-09-19T05:50:21.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77909.log 2024-09-19T05:50:21.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.79014.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79014.log.gz 2024-09-19T05:50:21.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53024.log 2024-09-19T05:50:21.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77909.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.77909.log.gz 2024-09-19T05:50:21.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54943.log 2024-09-19T05:50:21.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53024.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.53024.log.gz 2024-09-19T05:50:21.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72298.log 2024-09-19T05:50:21.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54943.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54943.log.gz 2024-09-19T05:50:21.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86411.log 2024-09-19T05:50:21.051 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72298.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.72298.log.gz 2024-09-19T05:50:21.051 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54025.log 2024-09-19T05:50:21.051 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86411.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86411.log.gz 2024-09-19T05:50:21.051 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55426.log 2024-09-19T05:50:21.051 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54025.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54025.log.gz 2024-09-19T05:50:21.051 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54867.log 2024-09-19T05:50:21.051 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55426.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55426.log.gz 2024-09-19T05:50:21.051 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88952.log 2024-09-19T05:50:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54867.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54867.log.gz 2024-09-19T05:50:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86907.log 2024-09-19T05:50:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88952.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88952.log.gz 2024-09-19T05:50:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-19T05:50:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86907.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86907.log.gz 2024-09-19T05:50:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55967.log 2024-09-19T05:50:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59472.log 2024-09-19T05:50:21.052 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55967.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55967.log.gz 2024-09-19T05:50:21.053 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81028.log 2024-09-19T05:50:21.054 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59472.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59472.log.gz 2024-09-19T05:50:21.054 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78778.log 2024-09-19T05:50:21.054 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81028.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81028.log.gz 2024-09-19T05:50:21.056 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37285.log 2024-09-19T05:50:21.057 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78778.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78778.log.gz 2024-09-19T05:50:21.072 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50579.log 2024-09-19T05:50:21.073 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37285.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37285.log.gz 2024-09-19T05:50:21.081 INFO:teuthology.orchestra.run.smithi097.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-19T05:50:21.084 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88406.log 2024-09-19T05:50:21.085 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50579.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50579.log.gz 2024-09-19T05:50:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56743.log 2024-09-19T05:50:21.097 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88406.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88406.log.gz 2024-09-19T05:50:21.111 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35376.log 2024-09-19T05:50:21.112 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56743.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56743.log.gz 2024-09-19T05:50:21.120 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53569.log 2024-09-19T05:50:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35376.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51222.log 2024-09-19T05:50:21.133 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53569.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53569.log.gz 2024-09-19T05:50:21.136 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35376.log.gz 2024-09-19T05:50:21.140 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50945.log 2024-09-19T05:50:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51222.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51222.log.gz 2024-09-19T05:50:21.153 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81943.log 2024-09-19T05:50:21.154 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50945.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50945.log.gz 2024-09-19T05:50:21.164 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78632.log 2024-09-19T05:50:21.165 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81943.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81943.log.gz 2024-09-19T05:50:21.176 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54635.log 2024-09-19T05:50:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78632.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78632.log.gz 2024-09-19T05:50:21.197 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87847.log 2024-09-19T05:50:21.197 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54635.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54635.log.gz 2024-09-19T05:50:21.208 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81080.log 2024-09-19T05:50:21.209 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87847.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.87847.log.gz 2024-09-19T05:50:21.220 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50378.log 2024-09-19T05:50:21.221 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81080.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81080.log.gz 2024-09-19T05:50:21.232 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50318.log 2024-09-19T05:50:21.233 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50378.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50378.log.gz 2024-09-19T05:50:21.252 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77703.log 2024-09-19T05:50:21.253 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50318.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50318.log.gz 2024-09-19T05:50:21.264 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50762.log 2024-09-19T05:50:21.265 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77703.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77703.log.gz 2024-09-19T05:50:21.276 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57286.log 2024-09-19T05:50:21.277 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50762.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50762.log.gz 2024-09-19T05:50:21.292 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84355.log 2024-09-19T05:50:21.293 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57286.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57286.log.gz 2024-09-19T05:50:21.304 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54185.log 2024-09-19T05:50:21.305 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84355.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84355.log.gz 2024-09-19T05:50:21.316 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53446.log 2024-09-19T05:50:21.317 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54185.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54185.log.gz 2024-09-19T05:50:21.332 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80902.log 2024-09-19T05:50:21.334 INFO:teuthology.orchestra.run.smithi097.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-19T05:50:21.334 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53446.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53446.log.gz 2024-09-19T05:50:21.344 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56539.log 2024-09-19T05:50:21.345 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80902.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80902.log.gz 2024-09-19T05:50:21.356 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75304.log 2024-09-19T05:50:21.357 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56539.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56539.log.gz 2024-09-19T05:50:21.357 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51834.log 2024-09-19T05:50:21.358 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75304.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75304.log.gz 2024-09-19T05:50:21.368 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55741.log 2024-09-19T05:50:21.370 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51834.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51834.log.gz 2024-09-19T05:50:21.380 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89069.log 2024-09-19T05:50:21.381 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55741.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55741.log.gz 2024-09-19T05:50:21.392 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88432.log 2024-09-19T05:50:21.393 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89069.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89069.log.gz 2024-09-19T05:50:21.404 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51734.log 2024-09-19T05:50:21.405 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88432.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.88432.log.gz 2024-09-19T05:50:21.416 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89920.log 2024-09-19T05:50:21.417 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51734.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51734.log.gz 2024-09-19T05:50:21.427 INFO:teuthology.orchestra.run.smithi097.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-19T05:50:21.436 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57985.log 2024-09-19T05:50:21.437 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89920.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89920.log.gz 2024-09-19T05:50:21.438 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81680.log 2024-09-19T05:50:21.438 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57985.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57985.log.gz 2024-09-19T05:50:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56097.log 2024-09-19T05:50:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81680.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.81680.log.gz 2024-09-19T05:50:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80646.log 2024-09-19T05:50:21.441 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56097.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56097.log.gz 2024-09-19T05:50:21.441 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80876.log 2024-09-19T05:50:21.442 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80646.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.80646.log.gz 2024-09-19T05:50:21.442 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75814.log 2024-09-19T05:50:21.443 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80876.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.80876.log.gz 2024-09-19T05:50:21.444 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56505.log 2024-09-19T05:50:21.445 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75814.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.75814.log.gz 2024-09-19T05:50:21.445 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72879.log 2024-09-19T05:50:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56505.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.56505.log.gz 2024-09-19T05:50:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77859.log 2024-09-19T05:50:21.447 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72879.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72879.log.gz 2024-09-19T05:50:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86536.log 2024-09-19T05:50:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77859.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.77859.log.gz 2024-09-19T05:50:21.450 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81354.log 2024-09-19T05:50:21.451 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86536.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.86536.log.gz 2024-09-19T05:50:21.451 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85131.log 2024-09-19T05:50:21.452 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81354.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81354.log.gz 2024-09-19T05:50:21.452 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37616.log 2024-09-19T05:50:21.468 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.85131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81510.log 2024-09-19T05:50:21.469 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37616.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37616.log.gz 2024-09-19T05:50:21.492 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87771.log 2024-09-19T05:50:21.493 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81510.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81510.log.gz 2024-09-19T05:50:21.500 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36471.log 2024-09-19T05:50:21.501 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87771.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87771.log.gz 2024-09-19T05:50:21.512 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87394.log 2024-09-19T05:50:21.513 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36471.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36471.log.gz 2024-09-19T05:50:21.520 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52798.log 2024-09-19T05:50:21.521 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87394.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87394.log.gz 2024-09-19T05:50:21.528 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73418.log 2024-09-19T05:50:21.530 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52798.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52798.log.gz 2024-09-19T05:50:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90503.log 2024-09-19T05:50:21.537 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73418.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73418.log.gz 2024-09-19T05:50:21.544 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57510.log 2024-09-19T05:50:21.545 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90503.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90503.log.gz 2024-09-19T05:50:21.552 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84128.log 2024-09-19T05:50:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57510.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57510.log.gz 2024-09-19T05:50:21.560 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88868.log 2024-09-19T05:50:21.561 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84128.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84128.log.gz 2024-09-19T05:50:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37564.log 2024-09-19T05:50:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88868.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88868.log.gz 2024-09-19T05:50:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86724.log 2024-09-19T05:50:21.581 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37564.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37564.log.gz 2024-09-19T05:50:21.588 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35009.log 2024-09-19T05:50:21.589 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86724.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86724.log.gz 2024-09-19T05:50:21.596 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75011.log 2024-09-19T05:50:21.597 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35009.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35009.log.gz 2024-09-19T05:50:21.604 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80568.log 2024-09-19T05:50:21.605 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75011.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75011.log.gz 2024-09-19T05:50:21.612 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54237.log 2024-09-19T05:50:21.613 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80568.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80568.log.gz 2024-09-19T05:50:21.620 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81588.log 2024-09-19T05:50:21.621 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54237.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54237.log.gz 2024-09-19T05:50:21.628 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74835.log 2024-09-19T05:50:21.629 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81588.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.81588.log.gz 2024-09-19T05:50:21.636 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90347.log 2024-09-19T05:50:21.637 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.74835.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.74835.log.gz 2024-09-19T05:50:21.644 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58556.log 2024-09-19T05:50:21.645 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90347.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90347.log.gz 2024-09-19T05:50:21.652 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78600.log 2024-09-19T05:50:21.653 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58556.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58556.log.gz 2024-09-19T05:50:21.660 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84303.log 2024-09-19T05:50:21.661 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78600.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78600.log.gz 2024-09-19T05:50:21.668 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59355.log 2024-09-19T05:50:21.669 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84303.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84303.log.gz 2024-09-19T05:50:21.676 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83777.log 2024-09-19T05:50:21.677 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59355.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59355.log.gz 2024-09-19T05:50:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56421.log 2024-09-19T05:50:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83777.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83777.log.gz 2024-09-19T05:50:21.704 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83859.log 2024-09-19T05:50:21.705 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56421.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56421.log.gz 2024-09-19T05:50:21.712 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83833.log 2024-09-19T05:50:21.713 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83859.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83859.log.gz 2024-09-19T05:50:21.732 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89946.log 2024-09-19T05:50:21.733 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83833.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.83833.log.gz 2024-09-19T05:50:21.750 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56071.log 2024-09-19T05:50:21.750 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89946.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89946.log.gz 2024-09-19T05:50:21.764 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80672.log 2024-09-19T05:50:21.765 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56071.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56071.log.gz 2024-09-19T05:50:21.777 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89147.log 2024-09-19T05:50:21.777 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80672.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80672.log.gz 2024-09-19T05:50:21.796 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89594.log 2024-09-19T05:50:21.797 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89147.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89147.log.gz 2024-09-19T05:50:21.809 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75644.log 2024-09-19T05:50:21.813 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89594.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.89594.log.gz 2024-09-19T05:50:21.825 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53290.log 2024-09-19T05:50:21.826 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75644.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75644.log.gz 2024-09-19T05:50:21.844 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83673.log 2024-09-19T05:50:21.845 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53290.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53290.log.gz 2024-09-19T05:50:21.856 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59564.log 2024-09-19T05:50:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83673.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83673.log.gz 2024-09-19T05:50:21.872 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58253.log 2024-09-19T05:50:21.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59564.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59564.log.gz 2024-09-19T05:50:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80418.log 2024-09-19T05:50:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58253.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58253.log.gz 2024-09-19T05:50:21.901 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35371.log 2024-09-19T05:50:21.901 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80418.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.80418.log.gz 2024-09-19T05:50:21.921 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87589.log 2024-09-19T05:50:21.921 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35371.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35371.log.gz 2024-09-19T05:50:21.928 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82051.log 2024-09-19T05:50:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87589.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87589.log.gz 2024-09-19T05:50:21.936 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53316.log 2024-09-19T05:50:21.937 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.82051.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82051.log.gz 2024-09-19T05:50:21.953 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58037.log 2024-09-19T05:50:21.953 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53316.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53316.log.gz 2024-09-19T05:50:21.960 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75788.log 2024-09-19T05:50:21.961 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58037.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58037.log.gz 2024-09-19T05:50:21.968 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90557.log 2024-09-19T05:50:21.969 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75788.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75788.log.gz 2024-09-19T05:50:21.976 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51328.log 2024-09-19T05:50:21.977 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90557.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.90557.log.gz 2024-09-19T05:50:21.985 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73288.log 2024-09-19T05:50:21.985 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51328.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51328.log.gz 2024-09-19T05:50:21.992 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76132.log 2024-09-19T05:50:21.993 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73288.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73288.log.gz 2024-09-19T05:50:21.998 INFO:teuthology.orchestra.run.smithi067.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.73576.log.gz 2024-09-19T05:50:22.012 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73444.log 2024-09-19T05:50:22.013 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.76132.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.76132.log.gz 2024-09-19T05:50:22.029 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51585.log 2024-09-19T05:50:22.029 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73444.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73444.log.gz 2024-09-19T05:50:22.045 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58288.log 2024-09-19T05:50:22.045 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51585.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51585.log.gz 2024-09-19T05:50:22.069 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T05:50:22.069 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58288.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58288.log.gz 2024-09-19T05:50:22.081 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81856.log 2024-09-19T05:50:22.095 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.log: 86.9% 93.7% -- replaced with /var/log/ceph/ceph-client.0.79198.log.gz 2024-09-19T05:50:22.096 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78382.log 2024-09-19T05:50:22.097 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81856.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81856.log.gz 2024-09-19T05:50:22.098 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57575.log 2024-09-19T05:50:22.098 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78382.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78382.log.gz 2024-09-19T05:50:22.099 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56175.log 2024-09-19T05:50:22.100 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57575.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57575.log.gz 2024-09-19T05:50:22.100 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T05:50:22.100 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55993.log 2024-09-19T05:50:22.101 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56175.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56175.log.gz 2024-09-19T05:50:22.101 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28943.log 2024-09-19T05:50:22.102 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55993.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55993.log.gz 2024-09-19T05:50:22.103 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84433.log 2024-09-19T05:50:22.104 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.28943.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28943.log.gz 2024-09-19T05:50:22.104 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89121.log 2024-09-19T05:50:22.105 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84433.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84433.log.gz 2024-09-19T05:50:22.105 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87186.log 2024-09-19T05:50:22.106 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89121.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89121.log.gz 2024-09-19T05:50:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36855.log 2024-09-19T05:50:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87186.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87186.log.gz 2024-09-19T05:50:22.108 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52314.log 2024-09-19T05:50:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36855.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36855.log.gz 2024-09-19T05:50:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75896.log 2024-09-19T05:50:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52314.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52314.log.gz 2024-09-19T05:50:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90147.log 2024-09-19T05:50:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75896.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75896.log.gz 2024-09-19T05:50:22.112 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80620.log 2024-09-19T05:50:22.112 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90147.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90147.log.gz 2024-09-19T05:50:22.113 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89542.log 2024-09-19T05:50:22.114 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80620.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.80620.log.gz 2024-09-19T05:50:22.114 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84102.log 2024-09-19T05:50:22.115 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89542.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89542.log.gz 2024-09-19T05:50:22.115 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56541.log 2024-09-19T05:50:22.116 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84102.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.84102.log.gz 2024-09-19T05:50:22.116 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89251.log 2024-09-19T05:50:22.117 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56541.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56541.log.gz 2024-09-19T05:50:22.118 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81158.log 2024-09-19T05:50:22.118 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89251.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89251.log.gz 2024-09-19T05:50:22.119 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86829.log 2024-09-19T05:50:22.120 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81158.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.81158.log.gz 2024-09-19T05:50:22.120 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35326.log 2024-09-19T05:50:22.121 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86829.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86829.log.gz 2024-09-19T05:50:22.121 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75922.log 2024-09-19T05:50:22.122 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35326.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35326.log.gz 2024-09-19T05:50:22.123 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74785.log 2024-09-19T05:50:22.123 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75922.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75922.log.gz 2024-09-19T05:50:22.124 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75077.log 2024-09-19T05:50:22.125 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.74785.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.74785.log.gz 2024-09-19T05:50:22.125 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89808.log 2024-09-19T05:50:22.126 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75077.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75077.log.gz 2024-09-19T05:50:22.127 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58612.log 2024-09-19T05:50:22.127 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89808.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89808.log.gz 2024-09-19T05:50:22.128 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54636.log 2024-09-19T05:50:22.129 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58612.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58612.log.gz 2024-09-19T05:50:22.129 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87023.log 2024-09-19T05:50:22.130 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54636.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54636.log.gz 2024-09-19T05:50:22.130 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73088.log 2024-09-19T05:50:22.131 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87023.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.87023.log.gz 2024-09-19T05:50:22.132 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90609.log 2024-09-19T05:50:22.133 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73088.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73088.log.gz 2024-09-19T05:50:22.133 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90635.log 2024-09-19T05:50:22.134 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90609.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.90609.log.gz 2024-09-19T05:50:22.134 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78806.log 2024-09-19T05:50:22.135 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90635.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90635.log.gz 2024-09-19T05:50:22.135 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55911.log 2024-09-19T05:50:22.136 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78806.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78806.log.gz 2024-09-19T05:50:22.137 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54081.log 2024-09-19T05:50:22.137 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55911.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55911.log.gz 2024-09-19T05:50:22.138 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87429.log 2024-09-19T05:50:22.138 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54081.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54081.log.gz 2024-09-19T05:50:22.139 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58011.log 2024-09-19T05:50:22.140 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87429.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87429.log.gz 2024-09-19T05:50:22.140 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35066.log 2024-09-19T05:50:22.141 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58011.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58011.log.gz 2024-09-19T05:50:22.141 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55793.log 2024-09-19T05:50:22.142 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35066.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35066.log.gz 2024-09-19T05:50:22.143 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75553.log 2024-09-19T05:50:22.143 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55793.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55793.log.gz 2024-09-19T05:50:22.144 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60145.log 2024-09-19T05:50:22.145 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75553.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75553.log.gz 2024-09-19T05:50:22.145 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89749.log 2024-09-19T05:50:22.146 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.60145.log: 93.8% -- replaced with /var/log/ceph/ceph-client.0.76238.log.gz 2024-09-19T05:50:22.146 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86437.log 2024-09-19T05:50:22.147 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89749.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89749.log.gz 2024-09-19T05:50:22.148 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52139.log 2024-09-19T05:50:22.149 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86437.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.86437.log.gz 2024-09-19T05:50:22.149 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77625.log 2024-09-19T05:50:22.150 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52139.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.52139.log.gz 2024-09-19T05:50:22.151 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87364.log 2024-09-19T05:50:22.151 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77625.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77625.log.gz 2024-09-19T05:50:22.152 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83803.log 2024-09-19T05:50:22.154 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87364.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87364.log.gz 2024-09-19T05:50:22.154 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75129.log 2024-09-19T05:50:22.154 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83803.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83803.log.gz 2024-09-19T05:50:22.155 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50430.log 2024-09-19T05:50:22.155 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75129.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75129.log.gz 2024-09-19T05:50:22.156 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54211.log 2024-09-19T05:50:22.157 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50430.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50430.log.gz 2024-09-19T05:50:22.157 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59147.log 2024-09-19T05:50:22.158 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54211.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54211.log.gz 2024-09-19T05:50:22.158 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53732.log 2024-09-19T05:50:22.159 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59147.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59147.log.gz 2024-09-19T05:50:22.160 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52852.log 2024-09-19T05:50:22.161 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53732.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53732.log.gz 2024-09-19T05:50:22.161 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59538.log 2024-09-19T05:50:22.162 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52852.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52852.log.gz 2024-09-19T05:50:22.163 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57416.log 2024-09-19T05:50:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59538.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59538.log.gz 2024-09-19T05:50:22.164 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53150.log 2024-09-19T05:50:22.165 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57416.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57416.log.gz 2024-09-19T05:50:22.165 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76182.log 2024-09-19T05:50:22.167 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53150.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53150.log.gz 2024-09-19T05:50:22.167 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36666.log 2024-09-19T05:50:22.168 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.76182.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76182.log.gz 2024-09-19T05:50:22.168 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87615.log 2024-09-19T05:50:22.169 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36666.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36666.log.gz 2024-09-19T05:50:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77755.log 2024-09-19T05:50:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87615.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87615.log.gz 2024-09-19T05:50:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35872.log 2024-09-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77755.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77755.log.gz 2024-09-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57033.log 2024-09-19T05:50:22.173 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35872.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35872.log.gz 2024-09-19T05:50:22.173 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60199.log 2024-09-19T05:50:22.174 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57033.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57033.log.gz 2024-09-19T05:50:22.175 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2024-09-19T05:50:22.176 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.60199.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60199.log.gz 2024-09-19T05:50:22.176 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84786.log 2024-09-19T05:50:22.177 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50631.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2024-09-19T05:50:22.177 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78750.log 2024-09-19T05:50:22.178 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84786.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84786.log.gz 2024-09-19T05:50:22.179 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87511.log 2024-09-19T05:50:22.179 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78750.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78750.log.gz 2024-09-19T05:50:22.180 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78832.log 2024-09-19T05:50:22.181 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87511.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87511.log.gz 2024-09-19T05:50:22.181 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90764.log 2024-09-19T05:50:22.182 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78832.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78832.log.gz 2024-09-19T05:50:22.182 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34950.log 2024-09-19T05:50:22.183 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90764.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.90764.log.gz 2024-09-19T05:50:22.184 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58998.log 2024-09-19T05:50:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34950.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.34950.log.gz 2024-09-19T05:50:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59590.log 2024-09-19T05:50:22.188 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58998.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58998.log.gz 2024-09-19T05:50:22.188 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59329.log 2024-09-19T05:50:22.189 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59590.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59590.log.gz 2024-09-19T05:50:22.189 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57364.log 2024-09-19T05:50:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59329.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59329.log.gz 2024-09-19T05:50:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53543.log 2024-09-19T05:50:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57364.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57364.log.gz 2024-09-19T05:50:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37956.log 2024-09-19T05:50:22.193 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53543.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53543.log.gz 2024-09-19T05:50:22.194 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55676.log 2024-09-19T05:50:22.213 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.37956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36359.log 2024-09-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55676.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55676.log.gz 2024-09-19T05:50:22.214 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87284.log 2024-09-19T05:50:22.215 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36359.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36359.log.gz 2024-09-19T05:50:22.215 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78207.log 2024-09-19T05:50:22.216 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87284.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87284.log.gz 2024-09-19T05:50:22.220 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77651.log 2024-09-19T05:50:22.225 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78207.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78207.log.gz 2024-09-19T05:50:22.228 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34720.log 2024-09-19T05:50:22.229 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77651.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77651.log.gz 2024-09-19T05:50:22.244 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89225.log 2024-09-19T05:50:22.245 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34720.log.gz 2024-09-19T05:50:22.259 INFO:teuthology.orchestra.run.smithi067.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-19T05:50:22.260 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50605.log 2024-09-19T05:50:22.263 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89225.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89225.log.gz 2024-09-19T05:50:22.263 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90243.log 2024-09-19T05:50:22.263 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50605.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50605.log.gz 2024-09-19T05:50:22.263 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51300.log 2024-09-19T05:50:22.264 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90243.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90243.log.gz 2024-09-19T05:50:22.265 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77807.log 2024-09-19T05:50:22.265 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51300.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51300.log.gz 2024-09-19T05:50:22.265 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73470.log 2024-09-19T05:50:22.266 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77807.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77807.log.gz 2024-09-19T05:50:22.266 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36751.log 2024-09-19T05:50:22.267 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73470.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.73470.log.gz 2024-09-19T05:50:22.268 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52214.log 2024-09-19T05:50:22.269 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36751.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36751.log.gz 2024-09-19T05:50:22.269 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58846.log 2024-09-19T05:50:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52214.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52214.log.gz 2024-09-19T05:50:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36640.log 2024-09-19T05:50:22.272 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58846.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58846.log.gz 2024-09-19T05:50:22.272 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73314.log 2024-09-19T05:50:22.273 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36640.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36640.log.gz 2024-09-19T05:50:22.273 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35574.log 2024-09-19T05:50:22.275 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73314.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73314.log.gz 2024-09-19T05:50:22.275 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78724.log 2024-09-19T05:50:22.275 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35574.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35574.log.gz 2024-09-19T05:50:22.276 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38010.log 2024-09-19T05:50:22.276 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78724.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78724.log.gz 2024-09-19T05:50:22.277 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59303.log 2024-09-19T05:50:22.278 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38010.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38010.log.gz 2024-09-19T05:50:22.278 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37642.log 2024-09-19T05:50:22.279 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59303.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59303.log.gz 2024-09-19T05:50:22.279 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36907.log 2024-09-19T05:50:22.280 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37642.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37642.log.gz 2024-09-19T05:50:22.281 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51036.log 2024-09-19T05:50:22.281 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36907.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36907.log.gz 2024-09-19T05:50:22.282 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72697.log 2024-09-19T05:50:22.283 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51036.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51036.log.gz 2024-09-19T05:50:22.283 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81224.log 2024-09-19T05:50:22.284 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72697.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72697.log.gz 2024-09-19T05:50:22.284 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37746.log 2024-09-19T05:50:22.285 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81224.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81224.log.gz 2024-09-19T05:50:22.286 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82129.log 2024-09-19T05:50:22.286 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37746.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37746.log.gz 2024-09-19T05:50:22.287 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50735.log 2024-09-19T05:50:22.288 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.82129.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82129.log.gz 2024-09-19T05:50:22.288 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78512.log 2024-09-19T05:50:22.289 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50735.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50735.log.gz 2024-09-19T05:50:22.289 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54999.log 2024-09-19T05:50:22.290 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78512.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78512.log.gz 2024-09-19T05:50:22.290 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51406.log 2024-09-19T05:50:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54999.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54999.log.gz 2024-09-19T05:50:22.292 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59440.log 2024-09-19T05:50:22.293 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51406.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51406.log.gz 2024-09-19T05:50:22.294 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89972.log 2024-09-19T05:50:22.295 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59440.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59440.log.gz 2024-09-19T05:50:22.295 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82155.log 2024-09-19T05:50:22.296 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89972.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.89972.log.gz 2024-09-19T05:50:22.296 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90790.log 2024-09-19T05:50:22.297 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.82155.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.82155.log.gz 2024-09-19T05:50:22.298 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72645.log 2024-09-19T05:50:22.299 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90790.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.90790.log.gz 2024-09-19T05:50:22.299 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88136.log 2024-09-19T05:50:22.300 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72645.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72645.log.gz 2024-09-19T05:50:22.300 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56773.log 2024-09-19T05:50:22.302 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88136.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.88136.log.gz 2024-09-19T05:50:22.302 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52974.log 2024-09-19T05:50:22.303 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56773.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56773.log.gz 2024-09-19T05:50:22.304 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84920.log 2024-09-19T05:50:22.305 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52974.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52974.log.gz 2024-09-19T05:50:22.305 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83573.log 2024-09-19T05:50:22.306 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84920.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84920.log.gz 2024-09-19T05:50:22.306 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35950.log 2024-09-19T05:50:22.308 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83573.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.83573.log.gz 2024-09-19T05:50:22.308 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78564.log 2024-09-19T05:50:22.309 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35950.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35950.log.gz 2024-09-19T05:50:22.310 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T05:50:22.310 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78564.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.78564.log.gz 2024-09-19T05:50:22.311 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90217.log 2024-09-19T05:50:22.315 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.audit.log: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T05:50:22.316 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60037.log 2024-09-19T05:50:22.317 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90217.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90217.log.gz 2024-09-19T05:50:22.317 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-19T05:50:22.318 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.60037.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60037.log.gz 2024-09-19T05:50:22.319 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57601.log 2024-09-19T05:50:22.332 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34389.log 2024-09-19T05:50:22.333 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57601.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57601.log.gz 2024-09-19T05:50:22.344 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75727.log 2024-09-19T05:50:22.345 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34389.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34389.log.gz 2024-09-19T05:50:22.349 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86855.log 2024-09-19T05:50:22.350 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75727.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75727.log.gz 2024-09-19T05:50:22.361 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81380.log 2024-09-19T05:50:22.361 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86855.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.86855.log.gz 2024-09-19T05:50:22.368 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55173.log 2024-09-19T05:50:22.369 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81380.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81380.log.gz 2024-09-19T05:50:22.376 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60011.log 2024-09-19T05:50:22.377 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55173.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55173.log.gz 2024-09-19T05:50:22.384 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59855.log 2024-09-19T05:50:22.385 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.60011.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60011.log.gz 2024-09-19T05:50:22.392 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53881.log 2024-09-19T05:50:22.393 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59855.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59855.log.gz 2024-09-19T05:50:22.401 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55348.log 2024-09-19T05:50:22.401 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53881.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53881.log.gz 2024-09-19T05:50:22.408 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37030.log 2024-09-19T05:50:22.409 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55348.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55348.log.gz 2024-09-19T05:50:22.416 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73231.log 2024-09-19T05:50:22.417 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37030.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37030.log.gz 2024-09-19T05:50:22.425 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87336.log 2024-09-19T05:50:22.426 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73231.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73231.log.gz 2024-09-19T05:50:22.432 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83911.log 2024-09-19T05:50:22.433 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87336.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.87336.log.gz 2024-09-19T05:50:22.440 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-19T05:50:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83911.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.83911.log.gz 2024-09-19T05:50:22.448 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81054.log 2024-09-19T05:50:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29042.log 2024-09-19T05:50:22.461 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81054.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81054.log.gz 2024-09-19T05:50:22.468 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51088.log 2024-09-19T05:50:22.469 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.29042.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29042.log.gz 2024-09-19T05:50:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57933.log 2024-09-19T05:50:22.477 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51088.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51088.log.gz 2024-09-19T05:50:22.485 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72749.log 2024-09-19T05:50:22.485 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57933.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57933.log.gz 2024-09-19T05:50:22.496 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59102.log 2024-09-19T05:50:22.497 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72749.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72749.log.gz 2024-09-19T05:50:22.505 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72567.log 2024-09-19T05:50:22.505 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59102.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59102.log.gz 2024-09-19T05:50:22.520 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57745.log 2024-09-19T05:50:22.521 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72567.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72567.log.gz 2024-09-19T05:50:22.537 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72400.log 2024-09-19T05:50:22.537 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57745.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57745.log.gz 2024-09-19T05:50:22.552 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51512.log 2024-09-19T05:50:22.553 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72400.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.72400.log.gz 2024-09-19T05:50:22.564 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35586.log 2024-09-19T05:50:22.576 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.51512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59076.log 2024-09-19T05:50:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35586.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35586.log.gz 2024-09-19T05:50:22.584 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83699.log 2024-09-19T05:50:22.585 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59076.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59076.log.gz 2024-09-19T05:50:22.596 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88776.log 2024-09-19T05:50:22.597 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83699.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.83699.log.gz 2024-09-19T05:50:22.605 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50352.log 2024-09-19T05:50:22.605 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88776.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88776.log.gz 2024-09-19T05:50:22.614 INFO:teuthology.orchestra.run.smithi097.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-19T05:50:22.617 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78936.log 2024-09-19T05:50:22.617 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50352.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50352.log.gz 2024-09-19T05:50:22.617 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.85131.log.gz 2024-09-19T05:50:22.618 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87455.log 2024-09-19T05:50:22.619 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78936.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78936.log.gz 2024-09-19T05:50:22.619 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37389.log 2024-09-19T05:50:22.620 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87455.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87455.log.gz 2024-09-19T05:50:22.620 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84076.log 2024-09-19T05:50:22.621 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37389.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37389.log.gz 2024-09-19T05:50:22.621 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35768.log 2024-09-19T05:50:22.622 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84076.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.84076.log.gz 2024-09-19T05:50:22.622 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58796.log 2024-09-19T05:50:22.623 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35768.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35768.log.gz 2024-09-19T05:50:22.624 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37668.log 2024-09-19T05:50:22.625 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58796.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58796.log.gz 2024-09-19T05:50:22.625 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50795.log 2024-09-19T05:50:22.626 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37668.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37668.log.gz 2024-09-19T05:50:22.627 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54481.log 2024-09-19T05:50:22.628 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50795.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50795.log.gz 2024-09-19T05:50:22.628 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50212.log 2024-09-19T05:50:22.629 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54481.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54481.log.gz 2024-09-19T05:50:22.635 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57881.log 2024-09-19T05:50:22.635 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50212.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50212.log.gz 2024-09-19T05:50:22.635 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2024-09-19T05:50:22.636 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57881.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57881.log.gz 2024-09-19T05:50:22.636 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73520.log 2024-09-19T05:50:22.636 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37259.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2024-09-19T05:50:22.636 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87049.log 2024-09-19T05:50:22.636 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73520.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73520.log.gz 2024-09-19T05:50:22.636 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86803.log 2024-09-19T05:50:22.638 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87049.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87049.log.gz 2024-09-19T05:50:22.638 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57189.log 2024-09-19T05:50:22.638 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86803.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86803.log.gz 2024-09-19T05:50:22.638 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80594.log 2024-09-19T05:50:22.639 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57189.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57189.log.gz 2024-09-19T05:50:22.639 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78285.log 2024-09-19T05:50:22.640 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80594.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80594.log.gz 2024-09-19T05:50:22.640 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56448.log 2024-09-19T05:50:22.641 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78285.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78285.log.gz 2024-09-19T05:50:22.641 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75488.log 2024-09-19T05:50:22.642 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56448.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56448.log.gz 2024-09-19T05:50:22.642 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79142.log 2024-09-19T05:50:22.643 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75488.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75488.log.gz 2024-09-19T05:50:22.644 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81132.log 2024-09-19T05:50:22.645 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.79142.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79142.log.gz 2024-09-19T05:50:22.645 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90269.log 2024-09-19T05:50:22.646 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81132.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81132.log.gz 2024-09-19T05:50:22.646 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57443.log 2024-09-19T05:50:22.647 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90269.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90269.log.gz 2024-09-19T05:50:22.647 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88987.log 2024-09-19T05:50:22.648 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57443.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57443.log.gz 2024-09-19T05:50:22.649 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90191.log 2024-09-19T05:50:22.650 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88987.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88987.log.gz 2024-09-19T05:50:22.650 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84232.log 2024-09-19T05:50:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90191.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90191.log.gz 2024-09-19T05:50:22.651 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88842.log 2024-09-19T05:50:22.652 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84232.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.84232.log.gz 2024-09-19T05:50:22.652 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87693.log 2024-09-19T05:50:22.653 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88842.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88842.log.gz 2024-09-19T05:50:22.654 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89697.log 2024-09-19T05:50:22.654 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87693.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87693.log.gz 2024-09-19T05:50:22.655 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36419.log 2024-09-19T05:50:22.656 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89697.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.89697.log.gz 2024-09-19T05:50:22.657 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55277.log 2024-09-19T05:50:22.658 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36419.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36419.log.gz 2024-09-19T05:50:22.658 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54969.log 2024-09-19T05:50:22.659 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55277.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55277.log.gz 2024-09-19T05:50:22.659 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78962.log 2024-09-19T05:50:22.660 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54969.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54969.log.gz 2024-09-19T05:50:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53200.log 2024-09-19T05:50:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78962.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78962.log.gz 2024-09-19T05:50:22.662 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37772.log 2024-09-19T05:50:22.663 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53200.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53200.log.gz 2024-09-19T05:50:22.664 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35898.log 2024-09-19T05:50:22.665 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37772.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37772.log.gz 2024-09-19T05:50:22.665 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34772.log 2024-09-19T05:50:22.666 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35898.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35898.log.gz 2024-09-19T05:50:22.666 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59724.log 2024-09-19T05:50:22.668 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34772.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34772.log.gz 2024-09-19T05:50:22.668 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54287.log 2024-09-19T05:50:22.669 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59724.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59724.log.gz 2024-09-19T05:50:22.669 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72723.log 2024-09-19T05:50:22.670 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54287.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54287.log.gz 2024-09-19T05:50:22.670 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53256.log 2024-09-19T05:50:22.671 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72723.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72723.log.gz 2024-09-19T05:50:22.672 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75233.log 2024-09-19T05:50:22.673 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53256.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53256.log.gz 2024-09-19T05:50:22.673 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50262.log 2024-09-19T05:50:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75233.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75233.log.gz 2024-09-19T05:50:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87903.log 2024-09-19T05:50:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50262.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50262.log.gz 2024-09-19T05:50:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37850.log 2024-09-19T05:50:22.678 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.87903.log: 92.2% -- replaced with /var/log/ceph/ceph-client.0.87903.log.gz 2024-09-19T05:50:22.678 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57225.log 2024-09-19T05:50:22.679 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37850.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37850.log.gz 2024-09-19T05:50:22.680 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57260.log 2024-09-19T05:50:22.680 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57225.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57225.log.gz 2024-09-19T05:50:22.681 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56478.log 2024-09-19T05:50:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57260.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57260.log.gz 2024-09-19T05:50:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37115.log 2024-09-19T05:50:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56478.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56478.log.gz 2024-09-19T05:50:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55532.log 2024-09-19T05:50:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37115.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37115.log.gz 2024-09-19T05:50:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89776.log 2024-09-19T05:50:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55532.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55532.log.gz 2024-09-19T05:50:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89039.log 2024-09-19T05:50:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89776.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.89776.log.gz 2024-09-19T05:50:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59777.log 2024-09-19T05:50:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89039.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89039.log.gz 2024-09-19T05:50:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81562.log 2024-09-19T05:50:22.689 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59777.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59777.log.gz 2024-09-19T05:50:22.690 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81999.log 2024-09-19T05:50:22.691 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81562.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81562.log.gz 2024-09-19T05:50:22.691 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54811.log 2024-09-19T05:50:22.692 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81999.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81999.log.gz 2024-09-19T05:50:22.692 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77833.log 2024-09-19T05:50:22.693 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54811.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54811.log.gz 2024-09-19T05:50:22.694 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77985.log 2024-09-19T05:50:22.695 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77833.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77833.log.gz 2024-09-19T05:50:22.695 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57312.log 2024-09-19T05:50:22.696 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77985.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77985.log.gz 2024-09-19T05:50:22.696 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59024.log 2024-09-19T05:50:22.697 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57312.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57312.log.gz 2024-09-19T05:50:22.698 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89013.log 2024-09-19T05:50:22.698 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59024.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59024.log.gz 2024-09-19T05:50:22.699 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88685.log 2024-09-19T05:50:22.700 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89013.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89013.log.gz 2024-09-19T05:50:22.700 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59173.log 2024-09-19T05:50:22.701 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88685.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88685.log.gz 2024-09-19T05:50:22.701 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75103.log 2024-09-19T05:50:22.702 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59173.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59173.log.gz 2024-09-19T05:50:22.703 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35846.log 2024-09-19T05:50:22.703 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75103.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75103.log.gz 2024-09-19T05:50:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50709.log 2024-09-19T05:50:22.705 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35846.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35846.log.gz 2024-09-19T05:50:22.705 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53938.log 2024-09-19T05:50:22.706 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50709.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50709.log.gz 2024-09-19T05:50:22.706 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36523.log 2024-09-19T05:50:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53938.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53938.log.gz 2024-09-19T05:50:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55303.log 2024-09-19T05:50:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36523.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36523.log.gz 2024-09-19T05:50:22.709 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57137.log 2024-09-19T05:50:22.710 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55303.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55303.log.gz 2024-09-19T05:50:22.710 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90373.log 2024-09-19T05:50:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57137.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57137.log.gz 2024-09-19T05:50:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52264.log 2024-09-19T05:50:22.712 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90373.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.90373.log.gz 2024-09-19T05:50:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57163.log 2024-09-19T05:50:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52264.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.52264.log.gz 2024-09-19T05:50:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78037.log 2024-09-19T05:50:22.715 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57163.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57163.log.gz 2024-09-19T05:50:22.717 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87310.log 2024-09-19T05:50:22.717 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78037.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78037.log.gz 2024-09-19T05:50:22.717 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81536.log 2024-09-19T05:50:22.718 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87310.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87310.log.gz 2024-09-19T05:50:22.718 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90661.log 2024-09-19T05:50:22.719 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81536.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.81536.log.gz 2024-09-19T05:50:22.719 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37900.log 2024-09-19T05:50:22.720 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90661.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90661.log.gz 2024-09-19T05:50:22.721 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56535.log 2024-09-19T05:50:22.721 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37900.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37900.log.gz 2024-09-19T05:50:22.722 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34415.log 2024-09-19T05:50:22.723 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56535.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56535.log.gz 2024-09-19T05:50:22.723 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35222.log 2024-09-19T05:50:22.724 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34415.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34415.log.gz 2024-09-19T05:50:22.724 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35372.log 2024-09-19T05:50:22.725 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35222.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35222.log.gz 2024-09-19T05:50:22.725 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77449.log 2024-09-19T05:50:22.726 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35372.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35372.log.gz 2024-09-19T05:50:22.727 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37534.log 2024-09-19T05:50:22.728 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77449.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.77449.log.gz 2024-09-19T05:50:22.728 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59381.log 2024-09-19T05:50:22.729 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37534.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37534.log.gz 2024-09-19T05:50:22.730 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90321.log 2024-09-19T05:50:22.730 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59381.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59381.log.gz 2024-09-19T05:50:22.731 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56045.log 2024-09-19T05:50:22.732 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90321.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90321.log.gz 2024-09-19T05:50:22.732 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58315.log 2024-09-19T05:50:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56045.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56045.log.gz 2024-09-19T05:50:22.733 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87101.log 2024-09-19T05:50:22.734 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58315.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58315.log.gz 2024-09-19T05:50:22.735 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53910.log 2024-09-19T05:50:22.736 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87101.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.87101.log.gz 2024-09-19T05:50:22.736 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82025.log 2024-09-19T05:50:22.737 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53910.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53910.log.gz 2024-09-19T05:50:22.737 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36445.log 2024-09-19T05:50:22.738 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.82025.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82025.log.gz 2024-09-19T05:50:22.739 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36333.log 2024-09-19T05:50:22.739 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36445.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36445.log.gz 2024-09-19T05:50:22.740 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36777.log 2024-09-19T05:50:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36333.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36333.log.gz 2024-09-19T05:50:22.741 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86690.log 2024-09-19T05:50:22.742 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36777.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36777.log.gz 2024-09-19T05:50:22.742 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81828.log 2024-09-19T05:50:22.743 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86690.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86690.log.gz 2024-09-19T05:50:22.743 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57803.log 2024-09-19T05:50:22.744 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81828.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81828.log.gz 2024-09-19T05:50:22.745 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78063.log 2024-09-19T05:50:22.746 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57803.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57803.log.gz 2024-09-19T05:50:22.746 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78259.log 2024-09-19T05:50:22.747 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78063.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78063.log.gz 2024-09-19T05:50:22.747 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57338.log 2024-09-19T05:50:22.748 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78259.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78259.log.gz 2024-09-19T05:50:22.749 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87218.log 2024-09-19T05:50:22.750 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57338.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57338.log.gz 2024-09-19T05:50:22.750 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75948.log 2024-09-19T05:50:22.751 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87218.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87218.log.gz 2024-09-19T05:50:22.751 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81648.log 2024-09-19T05:50:22.752 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75948.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75948.log.gz 2024-09-19T05:50:22.752 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90477.log 2024-09-19T05:50:22.753 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81648.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81648.log.gz 2024-09-19T05:50:22.754 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88894.log 2024-09-19T05:50:22.754 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90477.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90477.log.gz 2024-09-19T05:50:22.755 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36609.log 2024-09-19T05:50:22.756 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88894.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.88894.log.gz 2024-09-19T05:50:22.756 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35567.log 2024-09-19T05:50:22.757 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36609.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36609.log.gz 2024-09-19T05:50:22.758 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83523.log 2024-09-19T05:50:22.758 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35567.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35567.log.gz 2024-09-19T05:50:22.759 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58407.log 2024-09-19T05:50:22.760 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83523.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.83523.log.gz 2024-09-19T05:50:22.761 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89894.log 2024-09-19T05:50:22.761 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58407.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58407.log.gz 2024-09-19T05:50:22.762 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82261.log 2024-09-19T05:50:22.762 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89894.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89894.log.gz 2024-09-19T05:50:22.763 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50109.log 2024-09-19T05:50:22.780 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.82261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81406.log 2024-09-19T05:50:22.782 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50109.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50109.log.gz 2024-09-19T05:50:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52494.log 2024-09-19T05:50:22.801 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81406.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81406.log.gz 2024-09-19T05:50:22.808 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72348.log 2024-09-19T05:50:22.809 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52494.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52494.log.gz 2024-09-19T05:50:22.816 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36933.log 2024-09-19T05:50:22.817 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72348.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.72348.log.gz 2024-09-19T05:50:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81973.log 2024-09-19T05:50:22.825 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36933.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36933.log.gz 2024-09-19T05:50:22.836 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58740.log 2024-09-19T05:50:22.836 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81973.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81973.log.gz 2024-09-19T05:50:22.844 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88555.log 2024-09-19T05:50:22.845 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58740.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58740.log.gz 2024-09-19T05:50:22.860 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73205.log 2024-09-19T05:50:22.861 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88555.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88555.log.gz 2024-09-19T05:50:22.877 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56823.log 2024-09-19T05:50:22.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73205.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73205.log.gz 2024-09-19T05:50:22.884 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34668.log 2024-09-19T05:50:22.885 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56823.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56823.log.gz 2024-09-19T05:50:22.909 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78181.log 2024-09-19T05:50:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34668.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34668.log.gz 2024-09-19T05:50:22.920 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74985.log 2024-09-19T05:50:22.921 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78181.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78181.log.gz 2024-09-19T05:50:22.936 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81302.log 2024-09-19T05:50:22.937 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.74985.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74985.log.gz 2024-09-19T05:50:22.949 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72541.log 2024-09-19T05:50:22.949 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81302.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81302.log.gz 2024-09-19T05:50:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37311.log 2024-09-19T05:50:22.965 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72541.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72541.log.gz 2024-09-19T05:50:22.981 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37337.log 2024-09-19T05:50:22.981 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37311.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37311.log.gz 2024-09-19T05:50:22.996 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59646.log 2024-09-19T05:50:22.997 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37337.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37337.log.gz 2024-09-19T05:50:23.008 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53673.log 2024-09-19T05:50:23.009 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59646.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59646.log.gz 2024-09-19T05:50:23.024 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88328.log 2024-09-19T05:50:23.025 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53673.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53673.log.gz 2024-09-19T05:50:23.036 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80698.log 2024-09-19T05:50:23.040 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88328.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88328.log.gz 2024-09-19T05:50:23.052 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59199.log 2024-09-19T05:50:23.053 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.80698.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80698.log.gz 2024-09-19T05:50:23.065 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34616.log 2024-09-19T05:50:23.066 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59199.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59199.log.gz 2024-09-19T05:50:23.080 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37508.log 2024-09-19T05:50:23.081 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34616.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34616.log.gz 2024-09-19T05:50:23.092 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34469.log 2024-09-19T05:50:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37508.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37508.log.gz 2024-09-19T05:50:23.101 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55506.log 2024-09-19T05:50:23.111 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34469.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34469.log.gz 2024-09-19T05:50:23.112 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82205.log 2024-09-19T05:50:23.113 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55506.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55506.log.gz 2024-09-19T05:50:23.128 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86635.log 2024-09-19T05:50:23.129 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.82205.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.82205.log.gz 2024-09-19T05:50:23.153 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74935.log 2024-09-19T05:50:23.153 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86635.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.86635.log.gz 2024-09-19T05:50:23.168 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53699.log 2024-09-19T05:50:23.170 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.74935.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74935.log.gz 2024-09-19T05:50:23.180 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78408.log 2024-09-19T05:50:23.181 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53699.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53699.log.gz 2024-09-19T05:50:23.200 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55767.log 2024-09-19T05:50:23.201 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78408.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78408.log.gz 2024-09-19T05:50:23.220 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75207.log 2024-09-19T05:50:23.221 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55767.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55767.log.gz 2024-09-19T05:50:23.241 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55822.log 2024-09-19T05:50:23.241 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75207.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75207.log.gz 2024-09-19T05:50:23.252 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53472.log 2024-09-19T05:50:23.253 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55822.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55822.log.gz 2024-09-19T05:50:23.268 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34562.log 2024-09-19T05:50:23.269 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53472.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53472.log.gz 2024-09-19T05:50:23.280 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84842.log 2024-09-19T05:50:23.281 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34562.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34562.log.gz 2024-09-19T05:50:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59407.log 2024-09-19T05:50:23.297 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84842.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84842.log.gz 2024-09-19T05:50:23.312 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88354.log 2024-09-19T05:50:23.313 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59407.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59407.log.gz 2024-09-19T05:50:23.332 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84616.log 2024-09-19T05:50:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88354.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88354.log.gz 2024-09-19T05:50:23.348 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56123.log 2024-09-19T05:50:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84616.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84616.log.gz 2024-09-19T05:50:23.364 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84407.log 2024-09-19T05:50:23.365 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56123.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56123.log.gz 2024-09-19T05:50:23.380 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87563.log 2024-09-19T05:50:23.381 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84407.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.84407.log.gz 2024-09-19T05:50:23.396 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81250.log 2024-09-19T05:50:23.397 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87563.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87563.log.gz 2024-09-19T05:50:23.412 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87957.log 2024-09-19T05:50:23.413 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81250.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81250.log.gz 2024-09-19T05:50:23.420 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36582.log 2024-09-19T05:50:23.421 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87957.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.87957.log.gz 2024-09-19T05:50:23.436 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55937.log 2024-09-19T05:50:23.437 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36582.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36582.log.gz 2024-09-19T05:50:23.452 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78434.log 2024-09-19T05:50:23.453 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55937.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55937.log.gz 2024-09-19T05:50:23.468 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36136.log 2024-09-19T05:50:23.469 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78434.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78434.log.gz 2024-09-19T05:50:23.476 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35379.log 2024-09-19T05:50:23.477 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.36136.log: 90.0% -- replaced with /var/log/ceph/ceph-client.0.36136.log.gz 2024-09-19T05:50:23.484 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35170.log 2024-09-19T05:50:23.485 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35379.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35379.log.gz 2024-09-19T05:50:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52593.log 2024-09-19T05:50:23.493 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35170.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35170.log.gz 2024-09-19T05:50:23.500 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57111.log 2024-09-19T05:50:23.501 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52593.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52593.log.gz 2024-09-19T05:50:23.516 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.24008.log 2024-09-19T05:50:23.517 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57111.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57111.log.gz 2024-09-19T05:50:23.524 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76054.log 2024-09-19T05:50:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.tmp-client.admin.24008.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.24008.log.gz 2024-09-19T05:50:23.532 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75259.log 2024-09-19T05:50:23.533 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.76054.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76054.log.gz 2024-09-19T05:50:23.548 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51456.log 2024-09-19T05:50:23.550 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75259.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75259.log.gz 2024-09-19T05:50:23.564 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90713.log 2024-09-19T05:50:23.565 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51456.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51456.log.gz 2024-09-19T05:50:23.580 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52092.log 2024-09-19T05:50:23.581 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90713.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90713.log.gz 2024-09-19T05:50:23.596 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84040.log 2024-09-19T05:50:23.598 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52092.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.52092.log.gz 2024-09-19T05:50:23.612 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78910.log 2024-09-19T05:50:23.613 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84040.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.84040.log.gz 2024-09-19T05:50:23.620 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87537.log 2024-09-19T05:50:23.621 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78910.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78910.log.gz 2024-09-19T05:50:23.632 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36694.log 2024-09-19T05:50:23.633 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87537.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87537.log.gz 2024-09-19T05:50:23.644 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55147.log 2024-09-19T05:50:23.645 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36694.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36694.log.gz 2024-09-19T05:50:23.645 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36829.log 2024-09-19T05:50:23.646 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55147.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55147.log.gz 2024-09-19T05:50:23.660 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84668.log 2024-09-19T05:50:23.661 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36829.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36829.log.gz 2024-09-19T05:50:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36881.log 2024-09-19T05:50:23.669 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84668.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84668.log.gz 2024-09-19T05:50:23.676 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81614.log 2024-09-19T05:50:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36881.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36881.log.gz 2024-09-19T05:50:23.684 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88484.log 2024-09-19T05:50:23.685 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81614.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81614.log.gz 2024-09-19T05:50:23.692 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90529.log 2024-09-19T05:50:23.693 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88484.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.88484.log.gz 2024-09-19T05:50:23.708 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88744.log 2024-09-19T05:50:23.709 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90529.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90529.log.gz 2024-09-19T05:50:23.716 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36803.log 2024-09-19T05:50:23.717 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88744.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88744.log.gz 2024-09-19T05:50:23.728 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57771.log 2024-09-19T05:50:23.729 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.36803.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36803.log.gz 2024-09-19T05:50:23.736 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88529.log 2024-09-19T05:50:23.737 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57771.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57771.log.gz 2024-09-19T05:50:23.748 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36283.log 2024-09-19T05:50:23.749 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88529.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88529.log.gz 2024-09-19T05:50:23.756 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73062.log 2024-09-19T05:50:23.757 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.2.36283.log: 89.5% -- replaced with /var/log/ceph/ceph-client.2.36283.log.gz 2024-09-19T05:50:23.768 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84569.log 2024-09-19T05:50:23.769 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73062.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73062.log.gz 2024-09-19T05:50:23.776 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82077.log 2024-09-19T05:50:23.777 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84569.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84569.log.gz 2024-09-19T05:50:23.797 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53420.log 2024-09-19T05:50:23.797 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.82077.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82077.log.gz 2024-09-19T05:50:23.804 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57719.log 2024-09-19T05:50:23.805 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.53420.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53420.log.gz 2024-09-19T05:50:23.812 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35300.log 2024-09-19T05:50:23.813 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57719.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57719.log.gz 2024-09-19T05:50:23.820 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35092.log 2024-09-19T05:50:23.821 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35300.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35300.log.gz 2024-09-19T05:50:23.828 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58089.log 2024-09-19T05:50:23.829 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.35092.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35092.log.gz 2024-09-19T05:50:23.836 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84381.log 2024-09-19T05:50:23.837 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58089.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.58089.log.gz 2024-09-19T05:50:23.845 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84381.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.84381.log.gz 2024-09-19T05:50:23.865 INFO:teuthology.orchestra.run.smithi067.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.82261.log.gz 2024-09-19T05:50:25.553 INFO:teuthology.orchestra.run.smithi067.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.51512.log.gz 2024-09-19T05:50:25.914 INFO:teuthology.orchestra.run.smithi097.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-19T05:50:26.224 INFO:teuthology.orchestra.run.smithi097.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-19T05:50:26.716 INFO:teuthology.orchestra.run.smithi097.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-19T05:50:27.779 INFO:teuthology.orchestra.run.smithi097.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-19T05:50:29.155 INFO:teuthology.orchestra.run.smithi067.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-19T05:50:29.353 INFO:teuthology.orchestra.run.smithi067.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-19T05:50:29.794 INFO:teuthology.orchestra.run.smithi067.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-19T05:50:29.867 INFO:teuthology.orchestra.run.smithi067.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.37956.log.gz 2024-09-19T05:50:30.100 INFO:teuthology.orchestra.run.smithi067.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-19T05:50:30.127 INFO:teuthology.orchestra.run.smithi067.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.60145.log.gz 2024-09-19T05:50:31.532 INFO:teuthology.orchestra.run.smithi067.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-19T05:50:43.536 INFO:teuthology.orchestra.run.smithi097.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-19T05:50:43.538 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-19T05:50:43.538 INFO:teuthology.orchestra.run.smithi097.stderr:real 0m22.727s 2024-09-19T05:50:43.538 INFO:teuthology.orchestra.run.smithi097.stderr:user 0m47.357s 2024-09-19T05:50:43.538 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m1.499s 2024-09-19T05:50:49.563 INFO:teuthology.orchestra.run.smithi067.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-19T05:50:49.564 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-19T05:50:49.564 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m28.801s 2024-09-19T05:50:49.564 INFO:teuthology.orchestra.run.smithi067.stderr:user 1m30.022s 2024-09-19T05:50:49.565 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m2.705s 2024-09-19T05:50:49.565 INFO:tasks.ceph:Archiving logs... 2024-09-19T05:50:49.565 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672/remote/smithi067/log 2024-09-19T05:50:49.566 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T05:50:58.764 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672/remote/smithi097/log 2024-09-19T05:50:58.765 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T05:51:04.445 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T05:51:04.454 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T05:51:04.454 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T05:51:04.457 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T05:51:04.532 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T05:51:04.541 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T05:51:04.541 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:51:04.544 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:51:04.554 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T05:51:04.554 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2024-09-19T05:51:04.554 INFO:teuthology.orchestra.run.smithi067.stdout:*hv01.front.sepi 67.205.162.81 3 u 46 64 377 0.057 -5.802 0.819 2024-09-19T05:51:04.554 INFO:teuthology.orchestra.run.smithi067.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.086 -5.194 1.378 2024-09-19T05:51:04.555 INFO:teuthology.orchestra.run.smithi067.stdout:+hv03.front.sepi 74.6.168.72 3 u 33 64 377 0.075 -5.841 0.910 2024-09-19T05:51:04.555 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-19T05:51:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T05:51:04.556 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-09-19T05:51:04.556 INFO:teuthology.orchestra.run.smithi097.stdout:*hv01.front.sepi 67.205.162.81 3 u 45 64 377 0.090 -4.061 0.347 2024-09-19T05:51:04.556 INFO:teuthology.orchestra.run.smithi097.stdout:+hv02.front.sepi 63.231.80.2 3 u 50 64 377 0.088 -4.476 0.293 2024-09-19T05:51:04.557 INFO:teuthology.orchestra.run.smithi097.stdout:+hv03.front.sepi 74.6.168.72 3 u 45 64 377 0.087 -3.317 0.483 2024-09-19T05:51:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-19T05:51:04.558 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T05:51:04.567 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T05:51:04.568 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T05:51:04.584 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T05:51:04.593 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T05:51:04.626 INFO:teuthology.task.internal:Duration was 1756.273356 seconds 2024-09-19T05:51:04.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T05:51:04.635 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T05:51:04.635 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T05:51:04.638 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T05:51:04.675 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T05:51:04.675 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-09-19T05:51:04.675 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T05:51:04.729 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-09-19T05:51:04.730 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T05:51:04.740 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T05:51:04.740 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T05:51:04.773 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T05:51:04.811 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T05:51:04.812 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T05:51:04.850 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T05:51:04.935 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T05:51:04.944 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T05:51:04.945 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T05:51:04.957 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T05:51:04.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T05:51:04.986 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:51:05.002 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:51:05.010 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-09-19T05:51:05.024 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-09-19T05:51:05.037 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:51:05.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:51:05.073 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:51:05.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:51:05.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T05:51:05.094 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T05:51:05.095 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672/remote/smithi067 2024-09-19T05:51:05.095 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T05:51:05.138 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911672/remote/smithi097 2024-09-19T05:51:05.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T05:51:05.158 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T05:51:05.158 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T05:51:05.180 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T05:51:05.205 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T05:51:05.217 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T05:51:05.217 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T05:51:05.235 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T05:51:05.235 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T05:51:05.237 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T05:51:05.241 INFO:teuthology.orchestra.run.smithi067.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 05:51 /home/ubuntu/cephtest 2024-09-19T05:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout: 658463 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 05:51 /home/ubuntu/cephtest 2024-09-19T05:51:05.255 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T05:51:05.265 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T05:51:05.289 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub} duration: 1756.2733561992645 failure_reason: 'Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a60acebb0a8948e2a1680f16b50e72ac status: fail success: false 2024-09-19T05:51:05.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:51:05.383 INFO:teuthology.run:FAIL